2024-09-19T13:25:57.091 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T13:25:57.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T13:25:57.207 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912477 branch: wip-yuval-test description: rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: null first_in_suite: false job_id: '7912477' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuval-test ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 valgrind: - --tool=memcheck - --max-threads=1024 compression type: random ec-data-pool: true frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuval-test sha1: 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 owner: scheduled_yuvalif@teuthology priority: 50 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 4251 sha1: 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 sleep_before_teardown: 0 subset: 1/3 suite: rgw suite_branch: wip-yuval-test suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_08af21e0d16078b88ddf808fe9ba2ab84dbe6754/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 targets: smithi153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEguNgJFyXfkHRaml1HeE5UuWPsNwvTWTUH99/1dIFvb8HFRbnc6vsq5ISoY+idp05uI024G12I+Y5fwf5lLDQI= smithi196.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGOF+XNEuP5uKim6VdZGOdOkAsxCYZJtXQTJXyJbDWYxrS2+V/aVOS23mxL00WBzycbvxVBujaz/OLPBb7bkyQ4= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-19_13:09:30 tube: smithi user: yuvalif verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T13:25:57.207 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_08af21e0d16078b88ddf808fe9ba2ab84dbe6754/qa; will attempt to use it 2024-09-19T13:25:57.208 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_08af21e0d16078b88ddf808fe9ba2ab84dbe6754/qa/tasks 2024-09-19T13:25:57.208 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T13:25:57.209 INFO:teuthology.task.internal:Checking packages... 2024-09-19T13:25:57.230 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '08af21e0d16078b88ddf808fe9ba2ab84dbe6754' 2024-09-19T13:25:57.230 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T13:25:57.230 INFO:teuthology.packaging:ref: None 2024-09-19T13:25:57.231 INFO:teuthology.packaging:tag: None 2024-09-19T13:25:57.231 INFO:teuthology.packaging:branch: wip-yuval-test 2024-09-19T13:25:57.231 INFO:teuthology.packaging:sha1: 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:25:57.231 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuval-test 2024-09-19T13:25:57.384 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5012-g08af21e0-1jammy 2024-09-19T13:25:57.385 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T13:25:57.392 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T13:25:57.392 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T13:25:57.409 INFO:teuthology.task.internal:Saving configuration 2024-09-19T13:25:57.428 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T13:25:57.436 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T13:25:57.469 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912477', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 13:20:07.366906', 'locked_by': 'scheduled_yuvalif@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEJqVYR+CHabyCP/3qg5onaoTfzV2Nwnkv+f6BQpuWh1'} 2024-09-19T13:25:57.501 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912477', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 13:20:07.368667', 'locked_by': 'scheduled_yuvalif@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIC008rv5IlMoT1ZLtQnNPdEJ0o5+z2Od28LTGgNhWyEp'} 2024-09-19T13:25:57.501 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T13:25:57.508 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-19T13:25:57.508 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-19T13:25:57.508 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T13:25:57.590 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1d79fe3ac0>, signals=[15]) 2024-09-19T13:25:57.590 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T13:25:57.596 INFO:teuthology.task.internal:Opening connections... 2024-09-19T13:25:57.596 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2024-09-19T13:25:57.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T13:25:57.687 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi196.front.sepia.ceph.com 2024-09-19T13:25:57.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T13:25:57.774 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T13:25:57.781 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2024-09-19T13:25:57.786 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2024-09-19T13:25:57.786 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2024-09-19T13:25:57.833 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-19T13:25:57.833 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu" 2024-09-19T13:25:57.833 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="22.04" 2024-09-19T13:25:57.834 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-19T13:25:57.834 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=jammy 2024-09-19T13:25:57.834 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu 2024-09-19T13:25:57.834 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian 2024-09-19T13:25:57.834 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-19T13:25:57.834 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-19T13:25:57.834 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-19T13:25:57.834 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-19T13:25:57.834 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=jammy 2024-09-19T13:25:57.835 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2024-09-19T13:25:57.864 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2024-09-19T13:25:57.868 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2024-09-19T13:25:57.869 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-09-19T13:25:57.916 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-19T13:25:57.916 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Ubuntu" 2024-09-19T13:25:57.916 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="22.04" 2024-09-19T13:25:57.916 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-19T13:25:57.916 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_CODENAME=jammy 2024-09-19T13:25:57.917 INFO:teuthology.orchestra.run.smithi196.stdout:ID=ubuntu 2024-09-19T13:25:57.917 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE=debian 2024-09-19T13:25:57.917 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-19T13:25:57.917 INFO:teuthology.orchestra.run.smithi196.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-19T13:25:57.917 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-19T13:25:57.917 INFO:teuthology.orchestra.run.smithi196.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-19T13:25:57.917 INFO:teuthology.orchestra.run.smithi196.stdout:UBUNTU_CODENAME=jammy 2024-09-19T13:25:57.917 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-09-19T13:25:57.947 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T13:25:57.957 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T13:25:57.962 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T13:25:57.962 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2024-09-19T13:25:57.964 DEBUG:teuthology.orchestra.run.smithi196:> test '!' -e /home/ubuntu/cephtest 2024-09-19T13:25:57.969 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T13:25:57.975 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T13:25:57.975 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2024-09-19T13:25:58.010 DEBUG:teuthology.orchestra.run.smithi196:> test -z $(ls -A /var/lib/ceph) 2024-09-19T13:25:58.082 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T13:25:58.157 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T13:25:58.171 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-19T13:25:58.172 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-19T13:25:58.172 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T13:25:58.172 DEBUG:teuthology.orchestra.run.smithi196:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T13:25:58.177 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T13:25:58.177 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-09-19T13:25:58.178 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T13:25:58.178 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2024-09-19T13:25:58.224 INFO:teuthology.orchestra.run.smithi196.stdout:5.15.0-56-generic 2024-09-19T13:25:58.225 INFO:teuthology.task.kernel:Running kernel on smithi196: 5.15.0-56-generic 2024-09-19T13:25:58.225 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get clean 2024-09-19T13:25:58.226 INFO:teuthology.orchestra.run.smithi153.stdout:5.15.0-56-generic 2024-09-19T13:25:58.226 INFO:teuthology.task.kernel:Running kernel on smithi153: 5.15.0-56-generic 2024-09-19T13:25:58.226 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get clean 2024-09-19T13:25:58.355 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2024-09-19T13:25:58.364 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get update 2024-09-19T13:25:58.509 INFO:teuthology.orchestra.run.smithi196.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-19T13:25:58.565 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-19T13:25:58.624 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-19T13:25:58.636 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-19T13:25:58.705 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-19T13:25:58.706 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-19T13:25:58.719 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-19T13:25:58.794 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,839 kB] 2024-09-19T13:25:58.822 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-19T13:25:58.826 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-19T13:25:58.828 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-19T13:25:58.829 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-19T13:25:58.849 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-19T13:25:58.849 INFO:teuthology.orchestra.run.smithi196.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-19T13:25:58.853 INFO:teuthology.orchestra.run.smithi196.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-19T13:25:58.853 INFO:teuthology.orchestra.run.smithi196.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [628 kB] 2024-09-19T13:25:58.857 INFO:teuthology.orchestra.run.smithi196.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [903 kB] 2024-09-19T13:25:58.864 INFO:teuthology.orchestra.run.smithi196.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-19T13:25:58.866 INFO:teuthology.orchestra.run.smithi196.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-19T13:25:58.866 INFO:teuthology.orchestra.run.smithi196.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-19T13:25:58.878 INFO:teuthology.orchestra.run.smithi196.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-19T13:25:58.879 INFO:teuthology.orchestra.run.smithi196.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-19T13:25:58.906 INFO:teuthology.orchestra.run.smithi196.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-19T13:25:58.917 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [544 kB] 2024-09-19T13:25:58.922 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [298 kB] 2024-09-19T13:25:58.925 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-19T13:25:58.925 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-19T13:25:58.925 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,431 kB] 2024-09-19T13:25:58.947 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [418 kB] 2024-09-19T13:25:58.951 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-19T13:25:58.951 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [628 kB] 2024-09-19T13:25:58.956 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [903 kB] 2024-09-19T13:25:58.963 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [177 kB] 2024-09-19T13:25:58.965 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.3 kB] 2024-09-19T13:25:58.965 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-19T13:25:58.966 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-19T13:25:58.966 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-19T13:25:58.995 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-19T13:25:59.059 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-19T13:25:59.061 INFO:teuthology.orchestra.run.smithi196.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-19T13:25:59.197 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-19T13:25:59.200 INFO:teuthology.orchestra.run.smithi196.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-19T13:25:59.395 INFO:teuthology.orchestra.run.smithi196.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,058 kB] 2024-09-19T13:25:59.516 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [701 kB] 2024-09-19T13:25:59.551 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-19T13:25:59.557 INFO:teuthology.orchestra.run.smithi196.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [355 kB] 2024-09-19T13:25:59.565 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-19T13:25:59.565 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-19T13:25:59.569 INFO:teuthology.orchestra.run.smithi196.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-19T13:25:59.569 INFO:teuthology.orchestra.run.smithi196.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,495 kB] 2024-09-19T13:25:59.635 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-19T13:25:59.636 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-19T13:25:59.639 INFO:teuthology.orchestra.run.smithi196.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-19T13:25:59.643 INFO:teuthology.orchestra.run.smithi196.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [429 kB] 2024-09-19T13:25:59.654 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-19T13:25:59.654 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [733 kB] 2024-09-19T13:25:59.659 INFO:teuthology.orchestra.run.smithi196.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-19T13:25:59.659 INFO:teuthology.orchestra.run.smithi196.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [733 kB] 2024-09-19T13:25:59.676 INFO:teuthology.orchestra.run.smithi153.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,125 kB] 2024-09-19T13:25:59.680 INFO:teuthology.orchestra.run.smithi196.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,125 kB] 2024-09-19T13:25:59.704 INFO:teuthology.orchestra.run.smithi153.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-19T13:25:59.708 INFO:teuthology.orchestra.run.smithi196.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-19T13:25:59.709 INFO:teuthology.orchestra.run.smithi153.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-19T13:25:59.710 INFO:teuthology.orchestra.run.smithi153.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-19T13:25:59.710 INFO:teuthology.orchestra.run.smithi153.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-19T13:25:59.713 INFO:teuthology.orchestra.run.smithi196.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-19T13:25:59.719 INFO:teuthology.orchestra.run.smithi196.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-19T13:25:59.719 INFO:teuthology.orchestra.run.smithi196.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-19T13:25:59.761 INFO:teuthology.orchestra.run.smithi153.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-19T13:25:59.762 INFO:teuthology.orchestra.run.smithi153.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-19T13:25:59.762 INFO:teuthology.orchestra.run.smithi153.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-19T13:25:59.764 INFO:teuthology.orchestra.run.smithi153.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-19T13:25:59.765 INFO:teuthology.orchestra.run.smithi153.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-19T13:25:59.792 INFO:teuthology.orchestra.run.smithi196.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-19T13:25:59.793 INFO:teuthology.orchestra.run.smithi196.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-19T13:25:59.793 INFO:teuthology.orchestra.run.smithi196.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-19T13:25:59.795 INFO:teuthology.orchestra.run.smithi196.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-19T13:25:59.796 INFO:teuthology.orchestra.run.smithi196.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-19T13:25:59.800 INFO:teuthology.orchestra.run.smithi196.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-19T13:25:59.801 INFO:teuthology.orchestra.run.smithi196.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-19T13:25:59.801 INFO:teuthology.orchestra.run.smithi196.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-19T13:25:59.843 INFO:teuthology.orchestra.run.smithi153.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-19T13:25:59.843 INFO:teuthology.orchestra.run.smithi153.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-19T13:25:59.844 INFO:teuthology.orchestra.run.smithi153.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-19T13:25:59.845 INFO:teuthology.orchestra.run.smithi153.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-19T13:25:59.845 INFO:teuthology.orchestra.run.smithi153.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-19T13:25:59.882 INFO:teuthology.orchestra.run.smithi196.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-19T13:25:59.882 INFO:teuthology.orchestra.run.smithi196.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-19T13:26:05.276 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 16.2 MB in 2s (7,033 kB/s) 2024-09-19T13:26:05.342 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 16.2 MB in 2s (7,436 kB/s) 2024-09-19T13:26:06.730 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-19T13:26:06.747 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-19T13:26:06.797 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-09-19T13:26:06.809 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-19T13:26:06.814 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-19T13:26:06.877 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-09-19T13:26:07.014 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-09-19T13:26:07.014 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-09-19T13:26:07.084 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2024-09-19T13:26:07.084 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2024-09-19T13:26:07.192 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T13:26:07.192 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T13:26:07.192 INFO:teuthology.orchestra.run.smithi153.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T13:26:07.192 INFO:teuthology.orchestra.run.smithi153.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T13:26:07.193 INFO:teuthology.orchestra.run.smithi153.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-19T13:26:07.193 INFO:teuthology.orchestra.run.smithi153.stdout: python2.7-minimal 2024-09-19T13:26:07.193 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T13:26:07.194 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2024-09-19T13:26:07.194 INFO:teuthology.orchestra.run.smithi153.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-19T13:26:07.194 INFO:teuthology.orchestra.run.smithi153.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-19T13:26:07.194 INFO:teuthology.orchestra.run.smithi153.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-19T13:26:07.196 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2024-09-19T13:26:07.196 INFO:teuthology.orchestra.run.smithi153.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-19T13:26:07.196 INFO:teuthology.orchestra.run.smithi153.stdout:Recommended packages: 2024-09-19T13:26:07.196 INFO:teuthology.orchestra.run.smithi153.stdout: thermald 2024-09-19T13:26:07.242 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2024-09-19T13:26:07.242 INFO:teuthology.orchestra.run.smithi153.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-19T13:26:07.242 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-19T13:26:07.242 INFO:teuthology.orchestra.run.smithi153.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-19T13:26:07.243 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages will be upgraded: 2024-09-19T13:26:07.244 INFO:teuthology.orchestra.run.smithi153.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-19T13:26:07.276 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T13:26:07.276 INFO:teuthology.orchestra.run.smithi196.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T13:26:07.276 INFO:teuthology.orchestra.run.smithi196.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T13:26:07.277 INFO:teuthology.orchestra.run.smithi196.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T13:26:07.277 INFO:teuthology.orchestra.run.smithi196.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-19T13:26:07.277 INFO:teuthology.orchestra.run.smithi196.stdout: python2.7-minimal 2024-09-19T13:26:07.277 INFO:teuthology.orchestra.run.smithi196.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T13:26:07.279 INFO:teuthology.orchestra.run.smithi196.stdout:The following additional packages will be installed: 2024-09-19T13:26:07.279 INFO:teuthology.orchestra.run.smithi196.stdout: linux-generic linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-19T13:26:07.279 INFO:teuthology.orchestra.run.smithi196.stdout: linux-headers-generic linux-image-5.15.0-122-generic 2024-09-19T13:26:07.279 INFO:teuthology.orchestra.run.smithi196.stdout: linux-modules-5.15.0-122-generic linux-modules-extra-5.15.0-122-generic 2024-09-19T13:26:07.281 INFO:teuthology.orchestra.run.smithi196.stdout:Suggested packages: 2024-09-19T13:26:07.281 INFO:teuthology.orchestra.run.smithi196.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-19T13:26:07.281 INFO:teuthology.orchestra.run.smithi196.stdout:Recommended packages: 2024-09-19T13:26:07.281 INFO:teuthology.orchestra.run.smithi196.stdout: thermald 2024-09-19T13:26:07.340 INFO:teuthology.orchestra.run.smithi196.stdout:The following NEW packages will be installed: 2024-09-19T13:26:07.340 INFO:teuthology.orchestra.run.smithi196.stdout: linux-headers-5.15.0-122 linux-headers-5.15.0-122-generic 2024-09-19T13:26:07.341 INFO:teuthology.orchestra.run.smithi196.stdout: linux-image-5.15.0-122-generic linux-modules-5.15.0-122-generic 2024-09-19T13:26:07.341 INFO:teuthology.orchestra.run.smithi196.stdout: linux-modules-extra-5.15.0-122-generic 2024-09-19T13:26:07.341 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages will be upgraded: 2024-09-19T13:26:07.342 INFO:teuthology.orchestra.run.smithi196.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-19T13:26:07.427 INFO:teuthology.orchestra.run.smithi153.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-19T13:26:07.427 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 113 MB of archives. 2024-09-19T13:26:07.427 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-19T13:26:07.427 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-19T13:26:07.521 INFO:teuthology.orchestra.run.smithi196.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-19T13:26:07.521 INFO:teuthology.orchestra.run.smithi196.stdout:Need to get 113 MB of archives. 2024-09-19T13:26:07.521 INFO:teuthology.orchestra.run.smithi196.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-19T13:26:07.521 INFO:teuthology.orchestra.run.smithi196.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-122-generic amd64 5.15.0-122.132 [22.7 MB] 2024-09-19T13:26:08.772 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-19T13:26:08.998 INFO:teuthology.orchestra.run.smithi196.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-122-generic amd64 5.15.0-122.132 [11.5 MB] 2024-09-19T13:26:09.121 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-19T13:26:09.348 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-122-generic amd64 5.15.0-122.132 [63.9 MB] 2024-09-19T13:26:11.409 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-19T13:26:11.409 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-19T13:26:11.409 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-19T13:26:11.567 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.122.122 [1,692 B] 2024-09-19T13:26:11.567 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.122.122 [2,436 B] 2024-09-19T13:26:11.567 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122 all 5.15.0-122.132 [12.3 MB] 2024-09-19T13:26:11.761 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-19T13:26:11.842 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-19T13:26:12.085 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-122-generic amd64 5.15.0-122.132 [2,827 kB] 2024-09-19T13:26:12.214 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.122.122 [2,294 B] 2024-09-19T13:26:12.243 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 113 MB in 5s (24.7 MB/s) 2024-09-19T13:26:12.418 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-19T13:26:12.640 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 113 MB in 5s (23.3 MB/s) 2024-09-19T13:26:12.798 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-modules-5.15.0-122-generic. 2024-09-19T13:26:14.349 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-19T13:26:14.353 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-19T13:26:14.424 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T13:26:14.726 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-19T13:26:14.730 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../0-linux-modules-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-19T13:26:14.786 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T13:26:16.500 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-19T13:26:16.521 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-19T13:26:16.607 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T13:26:17.078 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-19T13:26:17.099 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-19T13:26:17.128 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-image-5.15.0-122-generic. 2024-09-19T13:26:17.136 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T13:26:17.150 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../1-linux-image-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-19T13:26:17.233 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T13:26:17.690 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-122-generic. 2024-09-19T13:26:17.710 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-19T13:26:17.740 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T13:26:23.988 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-19T13:26:24.098 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-19T13:26:24.170 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../3-linux-generic_5.15.0.122.122_amd64.deb ... 2024-09-19T13:26:24.297 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-19T13:26:24.425 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-19T13:26:24.545 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-19T13:26:24.624 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.122.122_amd64.deb ... 2024-09-19T13:26:24.752 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-image-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-19T13:26:24.832 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-19T13:26:24.855 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-19T13:26:24.898 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-19T13:26:25.063 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-headers-5.15.0-122. 2024-09-19T13:26:25.086 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../5-linux-headers-5.15.0-122_5.15.0-122.132_all.deb ... 2024-09-19T13:26:25.147 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-19T13:26:30.382 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-19T13:26:30.419 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-19T13:26:30.449 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T13:26:30.847 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-headers-5.15.0-122-generic. 2024-09-19T13:26:30.885 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../6-linux-headers-5.15.0-122-generic_5.15.0-122.132_amd64.deb ... 2024-09-19T13:26:30.930 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T13:26:33.001 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-19T13:26:33.127 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-19T13:26:33.469 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-19T13:26:33.566 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.122.122_amd64.deb ... 2024-09-19T13:26:33.573 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T13:26:33.681 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-headers-generic (5.15.0.122.122) over (5.15.0.56.54) ... 2024-09-19T13:26:33.682 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-19T13:26:33.812 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T13:26:34.982 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-headers-5.15.0-122 (5.15.0-122.132) ... 2024-09-19T13:26:35.111 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-headers-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T13:26:35.237 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-headers-generic (5.15.0.122.122) ... 2024-09-19T13:26:35.366 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T13:26:35.486 INFO:teuthology.orchestra.run.smithi196.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-19T13:26:35.487 INFO:teuthology.orchestra.run.smithi196.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-19T13:26:35.487 INFO:teuthology.orchestra.run.smithi196.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-19T13:26:35.487 INFO:teuthology.orchestra.run.smithi196.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-19T13:26:35.647 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T13:26:36.709 INFO:teuthology.orchestra.run.smithi153.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-19T13:26:36.709 INFO:teuthology.orchestra.run.smithi153.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-19T13:26:36.709 INFO:teuthology.orchestra.run.smithi153.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-122-generic 2024-09-19T13:26:36.710 INFO:teuthology.orchestra.run.smithi153.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-122-generic 2024-09-19T13:26:36.869 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-modules-extra-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T13:26:37.023 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-19T13:26:37.134 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-19T13:26:37.260 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T13:26:38.287 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-image-generic (5.15.0.122.122) ... 2024-09-19T13:26:38.434 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-generic (5.15.0.122.122) ... 2024-09-19T13:26:38.555 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-modules-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T13:26:38.646 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T13:26:38.708 INFO:teuthology.orchestra.run.smithi196.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-19T13:26:38.708 INFO:teuthology.orchestra.run.smithi196.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-19T13:26:40.040 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for linux-image-5.15.0-122-generic (5.15.0-122.132) ... 2024-09-19T13:26:40.766 INFO:teuthology.orchestra.run.smithi153.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-19T13:26:40.766 INFO:teuthology.orchestra.run.smithi153.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-122-generic 2024-09-19T13:26:52.359 INFO:teuthology.orchestra.run.smithi196.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-19T13:26:52.359 INFO:teuthology.orchestra.run.smithi196.stdout:Sourcing file `/etc/default/grub' 2024-09-19T13:26:52.369 INFO:teuthology.orchestra.run.smithi196.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-19T13:26:52.391 INFO:teuthology.orchestra.run.smithi196.stdout:Generating grub configuration file ... 2024-09-19T13:26:52.644 INFO:teuthology.orchestra.run.smithi196.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-19T13:26:52.669 INFO:teuthology.orchestra.run.smithi196.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-19T13:26:52.924 INFO:teuthology.orchestra.run.smithi196.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-19T13:26:52.930 INFO:teuthology.orchestra.run.smithi196.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-19T13:26:53.001 INFO:teuthology.orchestra.run.smithi196.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-19T13:26:53.007 INFO:teuthology.orchestra.run.smithi196.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-19T13:26:53.171 INFO:teuthology.orchestra.run.smithi196.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-19T13:26:53.171 INFO:teuthology.orchestra.run.smithi196.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-19T13:26:53.171 INFO:teuthology.orchestra.run.smithi196.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-19T13:26:53.208 INFO:teuthology.orchestra.run.smithi196.stdout:done 2024-09-19T13:26:53.682 DEBUG:teuthology.orchestra.run.smithi196:> dpkg -s linux-image-generic 2024-09-19T13:26:53.699 INFO:teuthology.orchestra.run.smithi196.stdout:Package: linux-image-generic 2024-09-19T13:26:53.699 INFO:teuthology.orchestra.run.smithi196.stdout:Status: install ok installed 2024-09-19T13:26:53.699 INFO:teuthology.orchestra.run.smithi196.stdout:Priority: optional 2024-09-19T13:26:53.699 INFO:teuthology.orchestra.run.smithi196.stdout:Section: kernel 2024-09-19T13:26:53.699 INFO:teuthology.orchestra.run.smithi196.stdout:Installed-Size: 21 2024-09-19T13:26:53.699 INFO:teuthology.orchestra.run.smithi196.stdout:Maintainer: Ubuntu Kernel Team 2024-09-19T13:26:53.699 INFO:teuthology.orchestra.run.smithi196.stdout:Architecture: amd64 2024-09-19T13:26:53.699 INFO:teuthology.orchestra.run.smithi196.stdout:Source: linux-meta 2024-09-19T13:26:53.699 INFO:teuthology.orchestra.run.smithi196.stdout:Version: 5.15.0.122.122 2024-09-19T13:26:53.699 INFO:teuthology.orchestra.run.smithi196.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-19T13:26:53.699 INFO:teuthology.orchestra.run.smithi196.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-19T13:26:53.700 INFO:teuthology.orchestra.run.smithi196.stdout:Recommends: thermald 2024-09-19T13:26:53.700 INFO:teuthology.orchestra.run.smithi196.stdout:Description: Generic Linux kernel image 2024-09-19T13:26:53.700 INFO:teuthology.orchestra.run.smithi196.stdout: This package will always depend on the latest generic kernel image 2024-09-19T13:26:53.700 INFO:teuthology.orchestra.run.smithi196.stdout: available. 2024-09-19T13:26:53.700 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-19T13:26:53.700 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T13:26:53.700 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T13:26:53.700 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-19T13:26:53.700 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi196.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T13:26:53.701 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get clean 2024-09-19T13:26:53.850 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get update 2024-09-19T13:26:53.960 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-19T13:26:53.971 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-19T13:26:53.988 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-19T13:26:54.081 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-19T13:26:54.256 INFO:teuthology.orchestra.run.smithi153.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-19T13:26:54.256 INFO:teuthology.orchestra.run.smithi153.stdout:Sourcing file `/etc/default/grub' 2024-09-19T13:26:54.275 INFO:teuthology.orchestra.run.smithi153.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-19T13:26:54.301 INFO:teuthology.orchestra.run.smithi153.stdout:Generating grub configuration file ... 2024-09-19T13:26:54.576 INFO:teuthology.orchestra.run.smithi153.stdout:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-19T13:26:54.596 INFO:teuthology.orchestra.run.smithi153.stdout:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-19T13:26:54.869 INFO:teuthology.orchestra.run.smithi153.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-19T13:26:54.875 INFO:teuthology.orchestra.run.smithi153.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-19T13:26:54.954 INFO:teuthology.orchestra.run.smithi153.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-19T13:26:54.960 INFO:teuthology.orchestra.run.smithi153.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-19T13:26:55.143 INFO:teuthology.orchestra.run.smithi153.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-19T13:26:55.144 INFO:teuthology.orchestra.run.smithi153.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-19T13:26:55.144 INFO:teuthology.orchestra.run.smithi153.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-19T13:26:55.183 INFO:teuthology.orchestra.run.smithi153.stdout:done 2024-09-19T13:26:55.387 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-09-19T13:26:55.406 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-19T13:26:55.459 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-09-19T13:26:55.566 DEBUG:teuthology.orchestra.run.smithi153:> dpkg -s linux-image-generic 2024-09-19T13:26:55.590 INFO:teuthology.orchestra.run.smithi153.stdout:Package: linux-image-generic 2024-09-19T13:26:55.590 INFO:teuthology.orchestra.run.smithi153.stdout:Status: install ok installed 2024-09-19T13:26:55.590 INFO:teuthology.orchestra.run.smithi153.stdout:Priority: optional 2024-09-19T13:26:55.590 INFO:teuthology.orchestra.run.smithi153.stdout:Section: kernel 2024-09-19T13:26:55.590 INFO:teuthology.orchestra.run.smithi153.stdout:Installed-Size: 21 2024-09-19T13:26:55.590 INFO:teuthology.orchestra.run.smithi153.stdout:Maintainer: Ubuntu Kernel Team 2024-09-19T13:26:55.591 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: amd64 2024-09-19T13:26:55.591 INFO:teuthology.orchestra.run.smithi153.stdout:Source: linux-meta 2024-09-19T13:26:55.591 INFO:teuthology.orchestra.run.smithi153.stdout:Version: 5.15.0.122.122 2024-09-19T13:26:55.591 INFO:teuthology.orchestra.run.smithi153.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-19T13:26:55.591 INFO:teuthology.orchestra.run.smithi153.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-19T13:26:55.591 INFO:teuthology.orchestra.run.smithi153.stdout:Recommends: thermald 2024-09-19T13:26:55.591 INFO:teuthology.orchestra.run.smithi153.stdout:Description: Generic Linux kernel image 2024-09-19T13:26:55.591 INFO:teuthology.orchestra.run.smithi153.stdout: This package will always depend on the latest generic kernel image 2024-09-19T13:26:55.591 INFO:teuthology.orchestra.run.smithi153.stdout: available. 2024-09-19T13:26:55.591 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-122-generic 2024-09-19T13:26:55.591 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T13:26:55.592 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T13:26:55.592 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-19T13:26:55.592 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi153.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T13:26:55.592 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get clean 2024-09-19T13:26:55.645 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2024-09-19T13:26:55.646 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2024-09-19T13:26:55.785 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2024-09-19T13:26:55.817 INFO:teuthology.orchestra.run.smithi196.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-19T13:26:55.817 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T13:26:55.817 INFO:teuthology.orchestra.run.smithi196.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T13:26:55.817 INFO:teuthology.orchestra.run.smithi196.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T13:26:55.817 INFO:teuthology.orchestra.run.smithi196.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T13:26:55.817 INFO:teuthology.orchestra.run.smithi196.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-19T13:26:55.817 INFO:teuthology.orchestra.run.smithi196.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-19T13:26:55.818 INFO:teuthology.orchestra.run.smithi196.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T13:26:55.858 INFO:teuthology.orchestra.run.smithi196.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-19T13:26:55.860 DEBUG:teuthology.orchestra.run.smithi196:> dpkg -s linux-image-generic 2024-09-19T13:26:55.918 INFO:teuthology.orchestra.run.smithi196.stdout:Package: linux-image-generic 2024-09-19T13:26:55.918 INFO:teuthology.orchestra.run.smithi196.stdout:Status: install ok installed 2024-09-19T13:26:55.918 INFO:teuthology.orchestra.run.smithi196.stdout:Priority: optional 2024-09-19T13:26:55.918 INFO:teuthology.orchestra.run.smithi196.stdout:Section: kernel 2024-09-19T13:26:55.918 INFO:teuthology.orchestra.run.smithi196.stdout:Installed-Size: 21 2024-09-19T13:26:55.918 INFO:teuthology.orchestra.run.smithi196.stdout:Maintainer: Ubuntu Kernel Team 2024-09-19T13:26:55.918 INFO:teuthology.orchestra.run.smithi196.stdout:Architecture: amd64 2024-09-19T13:26:55.919 INFO:teuthology.orchestra.run.smithi196.stdout:Source: linux-meta 2024-09-19T13:26:55.919 INFO:teuthology.orchestra.run.smithi196.stdout:Version: 5.15.0.122.122 2024-09-19T13:26:55.919 INFO:teuthology.orchestra.run.smithi196.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-19T13:26:55.919 INFO:teuthology.orchestra.run.smithi196.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-19T13:26:55.919 INFO:teuthology.orchestra.run.smithi196.stdout:Recommends: thermald 2024-09-19T13:26:55.919 INFO:teuthology.orchestra.run.smithi196.stdout:Description: Generic Linux kernel image 2024-09-19T13:26:55.919 INFO:teuthology.orchestra.run.smithi196.stdout: This package will always depend on the latest generic kernel image 2024-09-19T13:26:55.919 INFO:teuthology.orchestra.run.smithi196.stdout: available. 2024-09-19T13:26:55.919 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2024-09-19T13:26:55.963 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.Kicp5b77cN 2024-09-19T13:26:55.963 DEBUG:teuthology.orchestra.run.smithi196:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Kicp5b77cN 2024-09-19T13:26:56.019 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.Kicp5b77cN 2024-09-19T13:26:56.041 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-19T13:26:56.041 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-19T13:26:56.103 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-19T13:26:56.144 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.Kicp5b77cN is 10KB 2024-09-19T13:26:56.157 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.Kicp5b77cN 2024-09-19T13:26:56.162 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-19T13:26:56.184 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-19T13:26:56.215 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-19T13:26:56.216 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-19T13:26:56.216 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-19T13:26:56.282 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-19T13:26:56.283 DEBUG:teuthology.orchestra.run.smithi196:> sudo update-grub 2024-09-19T13:26:57.496 INFO:teuthology.orchestra.run.smithi196.stderr:Sourcing file `/etc/default/grub' 2024-09-19T13:26:57.497 INFO:teuthology.orchestra.run.smithi196.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-19T13:26:57.500 INFO:teuthology.orchestra.run.smithi196.stderr:Generating grub configuration file ... 2024-09-19T13:26:57.509 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-19T13:26:57.528 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-19T13:26:57.591 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-19T13:26:57.676 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-19T13:26:57.682 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-19T13:26:57.802 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-09-19T13:26:57.803 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-09-19T13:26:57.910 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-19T13:26:57.915 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-19T13:26:57.956 INFO:teuthology.orchestra.run.smithi196.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-19T13:26:57.961 INFO:teuthology.orchestra.run.smithi196.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-19T13:26:57.991 INFO:teuthology.orchestra.run.smithi153.stdout:linux-image-generic is already the newest version (5.15.0.122.122). 2024-09-19T13:26:57.991 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T13:26:57.991 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T13:26:57.991 INFO:teuthology.orchestra.run.smithi153.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T13:26:57.992 INFO:teuthology.orchestra.run.smithi153.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T13:26:57.992 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-19T13:26:57.992 INFO:teuthology.orchestra.run.smithi153.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-19T13:26:57.992 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T13:26:58.034 INFO:teuthology.orchestra.run.smithi153.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-19T13:26:58.036 DEBUG:teuthology.orchestra.run.smithi153:> dpkg -s linux-image-generic 2024-09-19T13:26:58.051 INFO:teuthology.orchestra.run.smithi153.stdout:Package: linux-image-generic 2024-09-19T13:26:58.051 INFO:teuthology.orchestra.run.smithi153.stdout:Status: install ok installed 2024-09-19T13:26:58.052 INFO:teuthology.orchestra.run.smithi153.stdout:Priority: optional 2024-09-19T13:26:58.052 INFO:teuthology.orchestra.run.smithi153.stdout:Section: kernel 2024-09-19T13:26:58.052 INFO:teuthology.orchestra.run.smithi153.stdout:Installed-Size: 21 2024-09-19T13:26:58.052 INFO:teuthology.orchestra.run.smithi153.stdout:Maintainer: Ubuntu Kernel Team 2024-09-19T13:26:58.052 INFO:teuthology.orchestra.run.smithi153.stdout:Architecture: amd64 2024-09-19T13:26:58.052 INFO:teuthology.orchestra.run.smithi153.stdout:Source: linux-meta 2024-09-19T13:26:58.052 INFO:teuthology.orchestra.run.smithi153.stdout:Version: 5.15.0.122.122 2024-09-19T13:26:58.052 INFO:teuthology.orchestra.run.smithi153.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-122), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-19T13:26:58.052 INFO:teuthology.orchestra.run.smithi153.stdout:Depends: linux-image-5.15.0-122-generic, linux-modules-extra-5.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-19T13:26:58.052 INFO:teuthology.orchestra.run.smithi153.stdout:Recommends: thermald 2024-09-19T13:26:58.052 INFO:teuthology.orchestra.run.smithi153.stdout:Description: Generic Linux kernel image 2024-09-19T13:26:58.052 INFO:teuthology.orchestra.run.smithi153.stdout: This package will always depend on the latest generic kernel image 2024-09-19T13:26:58.052 INFO:teuthology.orchestra.run.smithi153.stdout: available. 2024-09-19T13:26:58.053 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-09-19T13:26:58.083 INFO:teuthology.orchestra.run.smithi196.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-19T13:26:58.083 INFO:teuthology.orchestra.run.smithi196.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-19T13:26:58.083 INFO:teuthology.orchestra.run.smithi196.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-19T13:26:58.098 INFO:teuthology.orchestra.run.smithi196.stderr:done 2024-09-19T13:26:58.100 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.kWpnScEMVX 2024-09-19T13:26:58.100 DEBUG:teuthology.orchestra.run.smithi153:> sudo cp /boot/grub/grub.cfg /tmp/tmp.kWpnScEMVX 2024-09-19T13:26:58.116 DEBUG:teuthology.orchestra.run.smithi196:> sudo shutdown -r now 2024-09-19T13:26:58.156 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.kWpnScEMVX 2024-09-19T13:26:58.283 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.kWpnScEMVX is 10KB 2024-09-19T13:26:58.295 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.kWpnScEMVX 2024-09-19T13:26:58.300 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-19T13:26:58.356 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:26:58.356 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-19T13:26:58.356 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-19T13:26:58.423 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-122-generic 2024-09-19T13:26:58.423 DEBUG:teuthology.orchestra.run.smithi153:> sudo update-grub 2024-09-19T13:26:59.645 INFO:teuthology.orchestra.run.smithi153.stderr:Sourcing file `/etc/default/grub' 2024-09-19T13:26:59.646 INFO:teuthology.orchestra.run.smithi153.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-19T13:26:59.649 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2024-09-19T13:26:59.823 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.15.0-122-generic 2024-09-19T13:26:59.828 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.15.0-122-generic 2024-09-19T13:27:00.058 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-19T13:27:00.063 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-19T13:27:00.103 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-19T13:27:00.109 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-19T13:27:00.254 INFO:teuthology.orchestra.run.smithi153.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-19T13:27:00.254 INFO:teuthology.orchestra.run.smithi153.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-19T13:27:00.254 INFO:teuthology.orchestra.run.smithi153.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-19T13:27:00.266 INFO:teuthology.orchestra.run.smithi153.stderr:done 2024-09-19T13:27:00.281 DEBUG:teuthology.orchestra.run.smithi153:> sudo shutdown -r now 2024-09-19T13:27:28.145 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-19T13:27:28.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-09-19T13:27:28.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T13:27:30.285 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-19T13:27:30.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-19T13:27:30.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T13:28:04.925 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2024-09-19T13:28:13.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-19T13:28:13.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T13:28:28.165 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T13:28:37.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-09-19T13:28:37.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T13:28:37.660 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-09-19T13:28:38.427 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-09-19T13:28:38.427 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-122-generic"... 2024-09-19T13:28:38.427 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2024-09-19T13:28:38.476 INFO:teuthology.orchestra.run.smithi196.stdout:5.15.0-122-generic 2024-09-19T13:28:38.476 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-19T13:28:38.476 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T13:28:38.476 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-19T13:28:39.477 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-19T13:28:39.477 DEBUG:teuthology.orchestra.run.smithi196:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T13:28:39.643 INFO:teuthology.orchestra.run.smithi196.stdout:ttyS1 2024-09-19T13:28:39.669 DEBUG:teuthology.parallel:result is None 2024-09-19T13:29:13.956 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T13:29:25.957 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-19T13:29:25.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T13:29:26.178 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-09-19T13:29:26.737 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-19T13:29:26.737 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-122-generic"... 2024-09-19T13:29:26.738 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2024-09-19T13:29:26.785 INFO:teuthology.orchestra.run.smithi153.stdout:5.15.0-122-generic 2024-09-19T13:29:26.786 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-122-generic vs 5.15.0-122-generic 2024-09-19T13:29:26.786 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T13:29:26.786 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-19T13:29:27.787 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-19T13:29:27.787 DEBUG:teuthology.orchestra.run.smithi153:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T13:29:28.144 INFO:teuthology.orchestra.run.smithi153.stdout:ttyS1 2024-09-19T13:29:28.167 DEBUG:teuthology.parallel:result is None 2024-09-19T13:29:28.167 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T13:29:28.175 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T13:29:28.175 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T13:29:28.177 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T13:29:28.183 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T13:29:28.194 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T13:29:28.204 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T13:29:28.204 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T13:29:28.227 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T13:29:28.248 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T13:29:28.255 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T13:29:28.255 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T13:29:28.287 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T13:29:28.304 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T13:29:28.308 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T13:29:28.313 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T13:29:28.318 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T13:29:28.320 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T13:29:28.328 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T13:29:28.328 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T13:29:28.363 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T13:29:28.376 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T13:29:28.385 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T13:29:28.385 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T13:29:28.419 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T13:29:28.424 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T13:29:28.470 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T13:29:28.518 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:29:28.518 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T13:29:28.591 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T13:29:28.597 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T13:29:28.643 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-19T13:29:28.643 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T13:29:28.725 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2024-09-19T13:29:28.727 DEBUG:teuthology.orchestra.run.smithi196:> sudo service rsyslog restart 2024-09-19T13:29:28.796 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T13:29:28.804 INFO:teuthology.task.internal:Starting timer... 2024-09-19T13:29:28.804 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T13:29:28.814 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T13:29:28.824 DEBUG:teuthology.task.selinux:Excluding smithi153: OS 'ubuntu' does not support SELinux 2024-09-19T13:29:28.824 DEBUG:teuthology.task.selinux:Excluding smithi196: OS 'ubuntu' does not support SELinux 2024-09-19T13:29:28.824 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T13:29:28.824 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-19T13:29:28.824 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T13:29:28.824 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T13:29:28.834 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T13:29:28.846 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T13:29:28.847 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi153.front.sepia.ceph.com,smithi196.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T13:36:58.955 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi153.front.sepia.ceph.com'), Remote(name='ubuntu@smithi196.front.sepia.ceph.com')] 2024-09-19T13:36:58.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-19T13:36:58.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T13:36:59.045 DEBUG:teuthology.orchestra.run.smithi153:> true 2024-09-19T13:36:59.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2024-09-19T13:36:59.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-09-19T13:36:59.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T13:36:59.207 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-09-19T13:36:59.284 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-09-19T13:36:59.285 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T13:36:59.294 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T13:36:59.294 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T13:36:59.295 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T13:36:59.297 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T13:36:59.297 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T13:36:59.322 INFO:teuthology.orchestra.run.smithi153.stdout:19 Sep 13:36:59 ntpd[18498]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-19T13:36:59.322 INFO:teuthology.orchestra.run.smithi153.stdout:19 Sep 13:36:59 ntpd[18498]: Command line: ntpd -gq 2024-09-19T13:36:59.322 INFO:teuthology.orchestra.run.smithi153.stdout:19 Sep 13:36:59 ntpd[18498]: ---------------------------------------------------- 2024-09-19T13:36:59.322 INFO:teuthology.orchestra.run.smithi153.stdout:19 Sep 13:36:59 ntpd[18498]: ntp-4 is maintained by Network Time Foundation, 2024-09-19T13:36:59.322 INFO:teuthology.orchestra.run.smithi153.stdout:19 Sep 13:36:59 ntpd[18498]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-19T13:36:59.323 INFO:teuthology.orchestra.run.smithi153.stdout:19 Sep 13:36:59 ntpd[18498]: corporation. Support and training for ntp-4 are 2024-09-19T13:36:59.323 INFO:teuthology.orchestra.run.smithi153.stdout:19 Sep 13:36:59 ntpd[18498]: available at https://www.nwtime.org/support 2024-09-19T13:36:59.323 INFO:teuthology.orchestra.run.smithi153.stdout:19 Sep 13:36:59 ntpd[18498]: ---------------------------------------------------- 2024-09-19T13:36:59.323 INFO:teuthology.orchestra.run.smithi153.stdout:19 Sep 13:36:59 ntpd[18498]: proto: precision = 0.050 usec (-24) 2024-09-19T13:36:59.323 INFO:teuthology.orchestra.run.smithi153.stdout:19 Sep 13:36:59 ntpd[18498]: basedate set to 2022-02-04 2024-09-19T13:36:59.324 INFO:teuthology.orchestra.run.smithi153.stdout:19 Sep 13:36:59 ntpd[18498]: gps base set to 2022-02-06 (week 2196) 2024-09-19T13:36:59.324 INFO:teuthology.orchestra.run.smithi153.stdout:19 Sep 13:36:59 ntpd[18498]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-19T13:36:59.324 INFO:teuthology.orchestra.run.smithi153.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-19T13:36:59.324 INFO:teuthology.orchestra.run.smithi153.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-19T13:36:59.325 INFO:teuthology.orchestra.run.smithi153.stdout:19 Sep 13:36:59 ntpd[18498]: restrict ::: KOD does nothing without LIMITED. 2024-09-19T13:36:59.325 INFO:teuthology.orchestra.run.smithi153.stdout:19 Sep 13:36:59 ntpd[18498]: Listen and drop on 0 v6wildcard [::]:123 2024-09-19T13:36:59.325 INFO:teuthology.orchestra.run.smithi153.stdout:19 Sep 13:36:59 ntpd[18498]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-19T13:36:59.325 INFO:teuthology.orchestra.run.smithi153.stdout:19 Sep 13:36:59 ntpd[18498]: Listen normally on 2 lo 127.0.0.1:123 2024-09-19T13:36:59.325 INFO:teuthology.orchestra.run.smithi153.stdout:19 Sep 13:36:59 ntpd[18498]: Listen normally on 3 enp3s0f1 172.21.15.153:123 2024-09-19T13:36:59.325 INFO:teuthology.orchestra.run.smithi153.stdout:19 Sep 13:36:59 ntpd[18498]: Listen normally on 4 lo [::1]:123 2024-09-19T13:36:59.326 INFO:teuthology.orchestra.run.smithi153.stdout:19 Sep 13:36:59 ntpd[18498]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6deb%5]:123 2024-09-19T13:36:59.326 INFO:teuthology.orchestra.run.smithi153.stdout:19 Sep 13:36:59 ntpd[18498]: Listening on routing socket on fd #22 for interface updates 2024-09-19T13:36:59.352 INFO:teuthology.orchestra.run.smithi196.stdout:19 Sep 13:36:59 ntpd[18536]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-19T13:36:59.352 INFO:teuthology.orchestra.run.smithi196.stdout:19 Sep 13:36:59 ntpd[18536]: Command line: ntpd -gq 2024-09-19T13:36:59.352 INFO:teuthology.orchestra.run.smithi196.stdout:19 Sep 13:36:59 ntpd[18536]: ---------------------------------------------------- 2024-09-19T13:36:59.352 INFO:teuthology.orchestra.run.smithi196.stdout:19 Sep 13:36:59 ntpd[18536]: ntp-4 is maintained by Network Time Foundation, 2024-09-19T13:36:59.352 INFO:teuthology.orchestra.run.smithi196.stdout:19 Sep 13:36:59 ntpd[18536]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-19T13:36:59.352 INFO:teuthology.orchestra.run.smithi196.stdout:19 Sep 13:36:59 ntpd[18536]: corporation. Support and training for ntp-4 are 2024-09-19T13:36:59.352 INFO:teuthology.orchestra.run.smithi196.stdout:19 Sep 13:36:59 ntpd[18536]: available at https://www.nwtime.org/support 2024-09-19T13:36:59.352 INFO:teuthology.orchestra.run.smithi196.stdout:19 Sep 13:36:59 ntpd[18536]: ---------------------------------------------------- 2024-09-19T13:36:59.353 INFO:teuthology.orchestra.run.smithi196.stdout:19 Sep 13:36:59 ntpd[18536]: proto: precision = 0.044 usec (-24) 2024-09-19T13:36:59.353 INFO:teuthology.orchestra.run.smithi196.stdout:19 Sep 13:36:59 ntpd[18536]: basedate set to 2022-02-04 2024-09-19T13:36:59.353 INFO:teuthology.orchestra.run.smithi196.stdout:19 Sep 13:36:59 ntpd[18536]: gps base set to 2022-02-06 (week 2196) 2024-09-19T13:36:59.353 INFO:teuthology.orchestra.run.smithi196.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-19T13:36:59.354 INFO:teuthology.orchestra.run.smithi196.stdout:19 Sep 13:36:59 ntpd[18536]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-19T13:36:59.354 INFO:teuthology.orchestra.run.smithi196.stdout:19 Sep 13:36:59 ntpd[18536]: restrict ::: KOD does nothing without LIMITED. 2024-09-19T13:36:59.354 INFO:teuthology.orchestra.run.smithi196.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-19T13:36:59.355 INFO:teuthology.orchestra.run.smithi196.stdout:19 Sep 13:36:59 ntpd[18536]: Listen and drop on 0 v6wildcard [::]:123 2024-09-19T13:36:59.355 INFO:teuthology.orchestra.run.smithi196.stdout:19 Sep 13:36:59 ntpd[18536]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-19T13:36:59.355 INFO:teuthology.orchestra.run.smithi196.stdout:19 Sep 13:36:59 ntpd[18536]: Listen normally on 2 lo 127.0.0.1:123 2024-09-19T13:36:59.355 INFO:teuthology.orchestra.run.smithi196.stdout:19 Sep 13:36:59 ntpd[18536]: Listen normally on 3 enp3s0f1 172.21.15.196:123 2024-09-19T13:36:59.355 INFO:teuthology.orchestra.run.smithi196.stdout:19 Sep 13:36:59 ntpd[18536]: Listen normally on 4 lo [::1]:123 2024-09-19T13:36:59.355 INFO:teuthology.orchestra.run.smithi196.stdout:19 Sep 13:36:59 ntpd[18536]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f47%5]:123 2024-09-19T13:36:59.355 INFO:teuthology.orchestra.run.smithi196.stdout:19 Sep 13:36:59 ntpd[18536]: Listening on routing socket on fd #22 for interface updates 2024-09-19T13:37:00.322 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:00 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:00.322 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:00 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:00.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:00 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:00.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:00 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:00.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:00 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:00.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:00 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:00.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:00 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:00.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:00 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:00.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:00 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:00.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:00 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:00.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:00 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:00.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:00 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:00.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:00 ntpd[18536]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T13:37:00.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:00 ntpd[18536]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T13:37:00.355 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:00 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:00.355 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:00 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:00.355 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:00 ntpd[18536]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T13:37:00.355 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:00 ntpd[18536]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T13:37:00.355 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:00 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:00.355 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:00 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:00.355 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:00 ntpd[18536]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T13:37:00.355 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:00 ntpd[18536]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T13:37:02.326 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:02 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:02.326 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:02 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:02.326 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:02 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:02.326 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:02 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:02.326 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:02 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:02.326 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:02 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:02.327 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:02 ntpd[18498]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T13:37:02.327 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:02 ntpd[18498]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T13:37:02.327 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:02 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:02.327 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:02 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:02.327 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:02 ntpd[18498]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T13:37:02.329 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:02 ntpd[18498]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T13:37:02.352 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:02 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:02.353 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:02 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:02.360 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:02 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:02.360 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:02 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:02.360 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:02 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:02.360 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:02 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:02.360 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:02 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:02.360 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:02 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:02.360 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:02 ntpd[18536]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T13:37:02.360 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:02 ntpd[18536]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T13:37:02.360 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:02 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:02.361 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:02 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:02.361 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:02 ntpd[18536]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T13:37:02.365 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:02 ntpd[18536]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T13:37:02.365 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:02 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:02.365 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:02 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:02.365 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:02 ntpd[18536]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T13:37:02.365 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:02 ntpd[18536]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T13:37:04.323 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:04 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:04.323 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:04 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:04.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:04 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:04.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:04 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:04.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:04 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:04.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:04 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:04.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:04 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:04.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:04 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:04.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:04 ntpd[18498]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T13:37:04.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:04 ntpd[18498]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T13:37:04.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:04 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:04.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:04 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:04.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:04 ntpd[18498]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T13:37:04.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:04 ntpd[18498]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T13:37:04.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:04 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:04.325 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:04 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:04.325 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:04 ntpd[18498]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T13:37:04.325 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:04 ntpd[18498]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T13:37:04.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:04 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:04.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:04 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:04.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:04 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:04.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:04 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:04.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:04 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:04.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:04 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:04.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:04 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:04.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:04 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:04.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:04 ntpd[18536]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T13:37:04.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:04 ntpd[18536]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T13:37:04.355 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:04 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:04.355 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:04 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:04.355 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:04 ntpd[18536]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T13:37:04.355 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:04 ntpd[18536]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T13:37:04.355 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:04 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:04.355 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:04 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:04.355 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:04 ntpd[18536]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T13:37:04.355 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:04 ntpd[18536]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T13:37:06.323 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:06 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:06.323 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:06 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:06.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:06 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:06.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:06 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:06.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:06 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:06.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:06 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:06.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:06 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:06.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:06 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:06.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:06 ntpd[18498]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T13:37:06.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:06 ntpd[18498]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T13:37:06.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:06 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:06.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:06 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:06.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:06 ntpd[18498]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T13:37:06.324 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:06 ntpd[18498]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T13:37:06.325 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:06 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:06.325 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:06 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:06.325 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:06 ntpd[18498]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T13:37:06.325 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:06 ntpd[18498]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T13:37:06.353 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:06 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:06.353 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:06 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:06.353 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:06 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:06.353 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:06 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:06.353 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:06 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:06.353 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:06 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:06.353 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:06 ntpd[18536]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:06.353 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:06 ntpd[18536]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:06.353 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:06 ntpd[18536]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T13:37:06.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:06 ntpd[18536]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T13:37:06.354 INFO:teuthology.orchestra.run.smithi196.stdout:19 Sep 13:37:06 ntpd[18536]: ntpd: time slew -0.000943 s 2024-09-19T13:37:06.354 INFO:teuthology.orchestra.run.smithi196.stdout:ntpd: time slew -0.000943s 2024-09-19T13:37:06.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:06 ntpd[18536]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-19T13:37:06.354 INFO:teuthology.orchestra.run.smithi196.stderr:19 Sep 13:37:06 ntpd[18536]: can't open /var/log/ntpstats/loopstats.20240919: Permission denied 2024-09-19T13:37:06.412 INFO:teuthology.orchestra.run.smithi196.stdout: remote refid st t when poll reach delay offset jitter 2024-09-19T13:37:06.413 INFO:teuthology.orchestra.run.smithi196.stdout:============================================================================== 2024-09-19T13:37:06.413 INFO:teuthology.orchestra.run.smithi196.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-19T13:37:06.413 INFO:teuthology.orchestra.run.smithi196.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-19T13:37:06.413 INFO:teuthology.orchestra.run.smithi196.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-19T13:37:06.413 INFO:teuthology.orchestra.run.smithi196.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-19T13:37:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:08 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:08 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:08 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:08 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:08 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:08 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:08 ntpd[18498]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-19T13:37:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:08 ntpd[18498]: can't open /var/log/ntpstats/rawstats.20240919: Permission denied 2024-09-19T13:37:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:08 ntpd[18498]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-19T13:37:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:08 ntpd[18498]: can't open /var/log/ntpstats/peerstats.20240919: Permission denied 2024-09-19T13:37:08.327 INFO:teuthology.orchestra.run.smithi153.stdout:19 Sep 13:37:08 ntpd[18498]: ntpd: time slew +0.000167 s 2024-09-19T13:37:08.327 INFO:teuthology.orchestra.run.smithi153.stdout:ntpd: time slew +0.000167s 2024-09-19T13:37:08.327 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:08 ntpd[18498]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-19T13:37:08.327 INFO:teuthology.orchestra.run.smithi153.stderr:19 Sep 13:37:08 ntpd[18498]: can't open /var/log/ntpstats/loopstats.20240919: Permission denied 2024-09-19T13:37:08.376 INFO:teuthology.orchestra.run.smithi153.stdout: remote refid st t when poll reach delay offset jitter 2024-09-19T13:37:08.376 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================== 2024-09-19T13:37:08.376 INFO:teuthology.orchestra.run.smithi153.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-19T13:37:08.376 INFO:teuthology.orchestra.run.smithi153.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-19T13:37:08.376 INFO:teuthology.orchestra.run.smithi153.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-19T13:37:08.376 INFO:teuthology.orchestra.run.smithi153.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-19T13:37:08.377 INFO:teuthology.run_tasks:Running task install... 2024-09-19T13:37:08.385 DEBUG:teuthology.task.install:project ceph 2024-09-19T13:37:08.385 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'}} 2024-09-19T13:37:08.385 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'} 2024-09-19T13:37:08.385 INFO:teuthology.task.install:Using flavor: default 2024-09-19T13:37:08.390 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T13:37:08.390 INFO:teuthology.task.install:extra packages: [] 2024-09-19T13:37:08.391 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-key list | grep Ceph 2024-09-19T13:37:08.391 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-key list | grep Ceph 2024-09-19T13:37:08.457 INFO:teuthology.orchestra.run.smithi196.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-19T13:37:08.481 INFO:teuthology.orchestra.run.smithi153.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-19T13:37:08.487 INFO:teuthology.orchestra.run.smithi196.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-19T13:37:08.487 INFO:teuthology.orchestra.run.smithi196.stdout:uid [ unknown] Ceph.com (release key) 2024-09-19T13:37:08.487 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-19T13:37:08.487 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-19T13:37:08.488 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:37:08.509 INFO:teuthology.orchestra.run.smithi153.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-19T13:37:08.509 INFO:teuthology.orchestra.run.smithi153.stdout:uid [ unknown] Ceph.com (release key) 2024-09-19T13:37:08.510 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-19T13:37:08.510 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-19T13:37:08.510 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:37:08.642 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default/ 2024-09-19T13:37:08.642 INFO:teuthology.task.install.deb:Package version is 19.3.0-5012-g08af21e0-1jammy 2024-09-19T13:37:08.653 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default/ 2024-09-19T13:37:08.653 INFO:teuthology.task.install.deb:Package version is 19.3.0-5012-g08af21e0-1jammy 2024-09-19T13:37:08.762 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-19T13:37:08.762 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-19T13:37:08.774 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:37:08.774 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-19T13:37:08.776 DEBUG:teuthology.orchestra.run.smithi196:> sudo apt-get update 2024-09-19T13:37:08.788 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2024-09-19T13:37:08.944 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-19T13:37:08.952 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-19T13:37:08.954 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-19T13:37:08.963 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-19T13:37:08.971 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-19T13:37:08.999 INFO:teuthology.orchestra.run.smithi196.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy InRelease 2024-09-19T13:37:09.007 INFO:teuthology.orchestra.run.smithi153.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy InRelease 2024-09-19T13:37:09.021 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-19T13:37:09.030 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-19T13:37:09.038 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-19T13:37:09.043 INFO:teuthology.orchestra.run.smithi196.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-19T13:37:09.052 INFO:teuthology.orchestra.run.smithi153.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-19T13:37:09.064 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,432 B] 2024-09-19T13:37:09.069 INFO:teuthology.orchestra.run.smithi196.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-19T13:37:09.073 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-19T13:37:09.079 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-19T13:37:09.090 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-19T13:37:09.100 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,432 B] 2024-09-19T13:37:09.116 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-19T13:37:09.290 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 29.3 kB in 0s (87.8 kB/s) 2024-09-19T13:37:10.298 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-09-19T13:37:10.313 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-5012-g08af21e0-1jammy cephadm=19.3.0-5012-g08af21e0-1jammy ceph-mds=19.3.0-5012-g08af21e0-1jammy ceph-mgr=19.3.0-5012-g08af21e0-1jammy ceph-common=19.3.0-5012-g08af21e0-1jammy ceph-fuse=19.3.0-5012-g08af21e0-1jammy ceph-test=19.3.0-5012-g08af21e0-1jammy ceph-volume=19.3.0-5012-g08af21e0-1jammy radosgw=19.3.0-5012-g08af21e0-1jammy python3-rados=19.3.0-5012-g08af21e0-1jammy python3-rgw=19.3.0-5012-g08af21e0-1jammy python3-cephfs=19.3.0-5012-g08af21e0-1jammy python3-rbd=19.3.0-5012-g08af21e0-1jammy libcephfs2=19.3.0-5012-g08af21e0-1jammy libcephfs-dev=19.3.0-5012-g08af21e0-1jammy librados2=19.3.0-5012-g08af21e0-1jammy librbd1=19.3.0-5012-g08af21e0-1jammy rbd-fuse=19.3.0-5012-g08af21e0-1jammy 2024-09-19T13:37:10.377 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-09-19T13:37:10.586 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2024-09-19T13:37:10.587 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2024-09-19T13:37:10.785 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T13:37:10.785 INFO:teuthology.orchestra.run.smithi196.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T13:37:10.785 INFO:teuthology.orchestra.run.smithi196.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T13:37:10.785 INFO:teuthology.orchestra.run.smithi196.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T13:37:10.789 INFO:teuthology.orchestra.run.smithi196.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-19T13:37:10.789 INFO:teuthology.orchestra.run.smithi196.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-19T13:37:10.790 INFO:teuthology.orchestra.run.smithi196.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T13:37:10.790 INFO:teuthology.orchestra.run.smithi196.stdout:The following additional packages will be installed: 2024-09-19T13:37:10.790 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-19T13:37:10.790 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-19T13:37:10.790 INFO:teuthology.orchestra.run.smithi196.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-19T13:37:10.790 INFO:teuthology.orchestra.run.smithi196.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-19T13:37:10.790 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-19T13:37:10.790 INFO:teuthology.orchestra.run.smithi196.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-19T13:37:10.790 INFO:teuthology.orchestra.run.smithi196.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-19T13:37:10.790 INFO:teuthology.orchestra.run.smithi196.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-19T13:37:10.790 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-19T13:37:10.791 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-19T13:37:10.791 INFO:teuthology.orchestra.run.smithi196.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-19T13:37:10.791 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-19T13:37:10.791 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-19T13:37:10.791 INFO:teuthology.orchestra.run.smithi196.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-19T13:37:10.791 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-19T13:37:10.791 INFO:teuthology.orchestra.run.smithi196.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-19T13:37:10.791 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-19T13:37:10.791 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-19T13:37:10.791 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-19T13:37:10.791 INFO:teuthology.orchestra.run.smithi196.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-19T13:37:10.791 INFO:teuthology.orchestra.run.smithi196.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-19T13:37:10.791 INFO:teuthology.orchestra.run.smithi196.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-19T13:37:10.792 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-19T13:37:10.792 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet zip 2024-09-19T13:37:10.792 INFO:teuthology.orchestra.run.smithi196.stdout:Suggested packages: 2024-09-19T13:37:10.792 INFO:teuthology.orchestra.run.smithi196.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-19T13:37:10.792 INFO:teuthology.orchestra.run.smithi196.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-19T13:37:10.792 INFO:teuthology.orchestra.run.smithi196.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-19T13:37:10.792 INFO:teuthology.orchestra.run.smithi196.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-19T13:37:10.792 INFO:teuthology.orchestra.run.smithi196.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-19T13:37:10.792 INFO:teuthology.orchestra.run.smithi196.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-19T13:37:10.792 INFO:teuthology.orchestra.run.smithi196.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-19T13:37:10.792 INFO:teuthology.orchestra.run.smithi196.stdout:Recommended packages: 2024-09-19T13:37:10.792 INFO:teuthology.orchestra.run.smithi196.stdout: btrfs-tools 2024-09-19T13:37:10.892 INFO:teuthology.orchestra.run.smithi196.stdout:The following NEW packages will be installed: 2024-09-19T13:37:10.892 INFO:teuthology.orchestra.run.smithi196.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-19T13:37:10.892 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-19T13:37:10.892 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-19T13:37:10.892 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-19T13:37:10.892 INFO:teuthology.orchestra.run.smithi196.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-19T13:37:10.892 INFO:teuthology.orchestra.run.smithi196.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-19T13:37:10.893 INFO:teuthology.orchestra.run.smithi196.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-19T13:37:10.894 INFO:teuthology.orchestra.run.smithi196.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-19T13:37:10.894 INFO:teuthology.orchestra.run.smithi196.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-19T13:37:10.894 INFO:teuthology.orchestra.run.smithi196.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-19T13:37:10.894 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-19T13:37:10.894 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-19T13:37:10.894 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-19T13:37:10.894 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-19T13:37:10.894 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-19T13:37:10.894 INFO:teuthology.orchestra.run.smithi196.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-19T13:37:10.894 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-19T13:37:10.894 INFO:teuthology.orchestra.run.smithi196.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-19T13:37:10.894 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-19T13:37:10.894 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-19T13:37:10.895 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-19T13:37:10.895 INFO:teuthology.orchestra.run.smithi196.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-19T13:37:10.895 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-19T13:37:10.895 INFO:teuthology.orchestra.run.smithi196.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-19T13:37:10.895 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-19T13:37:10.895 INFO:teuthology.orchestra.run.smithi196.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-19T13:37:10.953 INFO:teuthology.orchestra.run.smithi196.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-19T13:37:10.953 INFO:teuthology.orchestra.run.smithi196.stdout:Need to get 244 MB of archives. 2024-09-19T13:37:10.954 INFO:teuthology.orchestra.run.smithi196.stdout:After this operation, 909 MB of additional disk space will be used. 2024-09-19T13:37:10.954 INFO:teuthology.orchestra.run.smithi196.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-19T13:37:11.037 INFO:teuthology.orchestra.run.smithi196.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-5012-g08af21e0-1jammy [3,634 kB] 2024-09-19T13:37:11.041 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-19T13:37:11.044 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-19T13:37:11.061 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-19T13:37:11.120 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-19T13:37:11.125 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-19T13:37:11.137 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-19T13:37:11.141 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-19T13:37:11.142 INFO:teuthology.orchestra.run.smithi196.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-19T13:37:11.143 INFO:teuthology.orchestra.run.smithi196.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-19T13:37:11.143 INFO:teuthology.orchestra.run.smithi196.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-19T13:37:11.152 INFO:teuthology.orchestra.run.smithi196.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-19T13:37:11.154 INFO:teuthology.orchestra.run.smithi196.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-19T13:37:11.156 INFO:teuthology.orchestra.run.smithi196.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-19T13:37:11.159 INFO:teuthology.orchestra.run.smithi196.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-19T13:37:11.159 INFO:teuthology.orchestra.run.smithi196.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-19T13:37:11.176 INFO:teuthology.orchestra.run.smithi196.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-19T13:37:11.178 INFO:teuthology.orchestra.run.smithi196.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-19T13:37:11.180 INFO:teuthology.orchestra.run.smithi196.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-19T13:37:11.180 INFO:teuthology.orchestra.run.smithi196.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-19T13:37:11.181 INFO:teuthology.orchestra.run.smithi196.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-19T13:37:11.182 INFO:teuthology.orchestra.run.smithi196.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-19T13:37:11.182 INFO:teuthology.orchestra.run.smithi196.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-19T13:37:11.183 INFO:teuthology.orchestra.run.smithi196.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-19T13:37:11.193 INFO:teuthology.orchestra.run.smithi196.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-19T13:37:11.194 INFO:teuthology.orchestra.run.smithi196.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-19T13:37:11.210 INFO:teuthology.orchestra.run.smithi196.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-19T13:37:11.211 INFO:teuthology.orchestra.run.smithi196.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-19T13:37:11.213 INFO:teuthology.orchestra.run.smithi196.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-19T13:37:11.214 INFO:teuthology.orchestra.run.smithi196.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-19T13:37:11.214 INFO:teuthology.orchestra.run.smithi196.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-19T13:37:11.215 INFO:teuthology.orchestra.run.smithi196.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-19T13:37:11.216 INFO:teuthology.orchestra.run.smithi196.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-19T13:37:11.216 INFO:teuthology.orchestra.run.smithi196.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-19T13:37:11.226 INFO:teuthology.orchestra.run.smithi196.stdout:Get:36 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-5012-g08af21e0-1jammy [3,336 kB] 2024-09-19T13:37:11.228 INFO:teuthology.orchestra.run.smithi196.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-19T13:37:11.229 INFO:teuthology.orchestra.run.smithi196.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-19T13:37:11.245 INFO:teuthology.orchestra.run.smithi196.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-19T13:37:11.245 INFO:teuthology.orchestra.run.smithi196.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-19T13:37:11.250 INFO:teuthology.orchestra.run.smithi196.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-19T13:37:11.251 INFO:teuthology.orchestra.run.smithi196.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-19T13:37:11.251 INFO:teuthology.orchestra.run.smithi196.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-19T13:37:11.252 INFO:teuthology.orchestra.run.smithi196.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-19T13:37:11.253 INFO:teuthology.orchestra.run.smithi196.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-19T13:37:11.255 INFO:teuthology.orchestra.run.smithi196.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-19T13:37:11.261 INFO:teuthology.orchestra.run.smithi196.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-19T13:37:11.263 INFO:teuthology.orchestra.run.smithi196.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-19T13:37:11.273 INFO:teuthology.orchestra.run.smithi196.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-19T13:37:11.273 INFO:teuthology.orchestra.run.smithi196.stdout:Get:50 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-5012-g08af21e0-1jammy [722 kB] 2024-09-19T13:37:11.275 INFO:teuthology.orchestra.run.smithi196.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-19T13:37:11.276 INFO:teuthology.orchestra.run.smithi196.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-19T13:37:11.277 INFO:teuthology.orchestra.run.smithi196.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-19T13:37:11.279 INFO:teuthology.orchestra.run.smithi196.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-19T13:37:11.284 INFO:teuthology.orchestra.run.smithi196.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-5012-g08af21e0-1jammy [356 kB] 2024-09-19T13:37:11.290 INFO:teuthology.orchestra.run.smithi196.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-5012-g08af21e0-1jammy [32.8 kB] 2024-09-19T13:37:11.291 INFO:teuthology.orchestra.run.smithi196.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-5012-g08af21e0-1jammy [180 kB] 2024-09-19T13:37:11.294 INFO:teuthology.orchestra.run.smithi196.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-5012-g08af21e0-1jammy [72.8 kB] 2024-09-19T13:37:11.295 INFO:teuthology.orchestra.run.smithi196.stdout:Get:59 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-5012-g08af21e0-1jammy [338 kB] 2024-09-19T13:37:11.300 INFO:teuthology.orchestra.run.smithi196.stdout:Get:60 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-5012-g08af21e0-1jammy [7,969 kB] 2024-09-19T13:37:11.331 INFO:teuthology.orchestra.run.smithi196.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-19T13:37:11.332 INFO:teuthology.orchestra.run.smithi196.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-19T13:37:11.333 INFO:teuthology.orchestra.run.smithi196.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-19T13:37:11.333 INFO:teuthology.orchestra.run.smithi196.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-19T13:37:11.334 INFO:teuthology.orchestra.run.smithi196.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-19T13:37:11.351 INFO:teuthology.orchestra.run.smithi196.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-19T13:37:11.353 INFO:teuthology.orchestra.run.smithi196.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-19T13:37:11.353 INFO:teuthology.orchestra.run.smithi196.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-19T13:37:11.368 INFO:teuthology.orchestra.run.smithi196.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-19T13:37:11.368 INFO:teuthology.orchestra.run.smithi196.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-19T13:37:11.368 INFO:teuthology.orchestra.run.smithi196.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-19T13:37:11.369 INFO:teuthology.orchestra.run.smithi196.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-19T13:37:11.369 INFO:teuthology.orchestra.run.smithi196.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-19T13:37:11.369 INFO:teuthology.orchestra.run.smithi196.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-19T13:37:11.383 INFO:teuthology.orchestra.run.smithi196.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-19T13:37:11.384 INFO:teuthology.orchestra.run.smithi196.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-19T13:37:11.387 INFO:teuthology.orchestra.run.smithi196.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-19T13:37:11.400 INFO:teuthology.orchestra.run.smithi196.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-19T13:37:11.402 INFO:teuthology.orchestra.run.smithi196.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-19T13:37:11.402 INFO:teuthology.orchestra.run.smithi196.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-19T13:37:11.405 INFO:teuthology.orchestra.run.smithi196.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-19T13:37:11.407 INFO:teuthology.orchestra.run.smithi196.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-19T13:37:11.408 INFO:teuthology.orchestra.run.smithi196.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-19T13:37:11.408 INFO:teuthology.orchestra.run.smithi196.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-19T13:37:11.417 INFO:teuthology.orchestra.run.smithi196.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-19T13:37:11.418 INFO:teuthology.orchestra.run.smithi196.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-19T13:37:11.421 INFO:teuthology.orchestra.run.smithi196.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-19T13:37:11.432 INFO:teuthology.orchestra.run.smithi196.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-5012-g08af21e0-1jammy [112 kB] 2024-09-19T13:37:11.434 INFO:teuthology.orchestra.run.smithi196.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-5012-g08af21e0-1jammy [473 kB] 2024-09-19T13:37:11.435 INFO:teuthology.orchestra.run.smithi196.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-19T13:37:11.435 INFO:teuthology.orchestra.run.smithi196.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-19T13:37:11.436 INFO:teuthology.orchestra.run.smithi196.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-19T13:37:11.437 INFO:teuthology.orchestra.run.smithi196.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-19T13:37:11.437 INFO:teuthology.orchestra.run.smithi196.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-19T13:37:11.440 INFO:teuthology.orchestra.run.smithi196.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-5012-g08af21e0-1jammy [28.3 MB] 2024-09-19T13:37:11.444 INFO:teuthology.orchestra.run.smithi196.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-19T13:37:11.444 INFO:teuthology.orchestra.run.smithi196.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-19T13:37:11.451 INFO:teuthology.orchestra.run.smithi196.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-19T13:37:11.453 INFO:teuthology.orchestra.run.smithi196.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-19T13:37:11.454 INFO:teuthology.orchestra.run.smithi196.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-19T13:37:12.021 INFO:teuthology.orchestra.run.smithi196.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-5012-g08af21e0-1jammy [5,208 kB] 2024-09-19T13:37:12.086 INFO:teuthology.orchestra.run.smithi196.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-5012-g08af21e0-1jammy [252 kB] 2024-09-19T13:37:12.089 INFO:teuthology.orchestra.run.smithi196.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-5012-g08af21e0-1jammy [124 kB] 2024-09-19T13:37:12.090 INFO:teuthology.orchestra.run.smithi196.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-5012-g08af21e0-1jammy [1,561 kB] 2024-09-19T13:37:12.103 INFO:teuthology.orchestra.run.smithi196.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-5012-g08af21e0-1jammy [6,312 kB] 2024-09-19T13:37:12.195 INFO:teuthology.orchestra.run.smithi196.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-5012-g08af21e0-1jammy [23.1 MB] 2024-09-19T13:37:12.654 INFO:teuthology.orchestra.run.smithi196.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-5012-g08af21e0-1jammy [14.1 kB] 2024-09-19T13:37:12.654 INFO:teuthology.orchestra.run.smithi196.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-5012-g08af21e0-1jammy [880 kB] 2024-09-19T13:37:12.664 INFO:teuthology.orchestra.run.smithi196.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-5012-g08af21e0-1jammy [2,453 kB] 2024-09-19T13:37:12.691 INFO:teuthology.orchestra.run.smithi196.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-5012-g08af21e0-1jammy [814 kB] 2024-09-19T13:37:12.700 INFO:teuthology.orchestra.run.smithi196.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-5012-g08af21e0-1jammy [160 kB] 2024-09-19T13:37:12.702 INFO:teuthology.orchestra.run.smithi196.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-5012-g08af21e0-1jammy [61.5 MB] 2024-09-19T13:37:13.352 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 183 kB in 0s (553 kB/s) 2024-09-19T13:37:13.995 INFO:teuthology.orchestra.run.smithi196.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-5012-g08af21e0-1jammy [8,625 kB] 2024-09-19T13:37:14.103 INFO:teuthology.orchestra.run.smithi196.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-5012-g08af21e0-1jammy [14.2 kB] 2024-09-19T13:37:14.103 INFO:teuthology.orchestra.run.smithi196.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-5012-g08af21e0-1jammy [48.5 MB] 2024-09-19T13:37:14.418 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-19T13:37:14.435 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-5012-g08af21e0-1jammy cephadm=19.3.0-5012-g08af21e0-1jammy ceph-mds=19.3.0-5012-g08af21e0-1jammy ceph-mgr=19.3.0-5012-g08af21e0-1jammy ceph-common=19.3.0-5012-g08af21e0-1jammy ceph-fuse=19.3.0-5012-g08af21e0-1jammy ceph-test=19.3.0-5012-g08af21e0-1jammy ceph-volume=19.3.0-5012-g08af21e0-1jammy radosgw=19.3.0-5012-g08af21e0-1jammy python3-rados=19.3.0-5012-g08af21e0-1jammy python3-rgw=19.3.0-5012-g08af21e0-1jammy python3-cephfs=19.3.0-5012-g08af21e0-1jammy python3-rbd=19.3.0-5012-g08af21e0-1jammy libcephfs2=19.3.0-5012-g08af21e0-1jammy libcephfs-dev=19.3.0-5012-g08af21e0-1jammy librados2=19.3.0-5012-g08af21e0-1jammy librbd1=19.3.0-5012-g08af21e0-1jammy rbd-fuse=19.3.0-5012-g08af21e0-1jammy 2024-09-19T13:37:14.498 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-19T13:37:14.685 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-09-19T13:37:14.686 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-09-19T13:37:14.876 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T13:37:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T13:37:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T13:37:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T13:37:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-19T13:37:14.876 INFO:teuthology.orchestra.run.smithi153.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-19T13:37:14.876 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T13:37:14.877 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2024-09-19T13:37:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-19T13:37:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-19T13:37:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-19T13:37:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-19T13:37:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-19T13:37:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-19T13:37:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-19T13:37:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-19T13:37:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-19T13:37:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-19T13:37:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-19T13:37:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-19T13:37:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-19T13:37:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-19T13:37:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-19T13:37:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-19T13:37:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-19T13:37:14.879 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-19T13:37:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-19T13:37:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-19T13:37:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-19T13:37:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-19T13:37:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-19T13:37:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet zip 2024-09-19T13:37:14.880 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2024-09-19T13:37:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-19T13:37:14.880 INFO:teuthology.orchestra.run.smithi153.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-19T13:37:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-19T13:37:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-19T13:37:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-19T13:37:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-19T13:37:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-19T13:37:14.881 INFO:teuthology.orchestra.run.smithi153.stdout:Recommended packages: 2024-09-19T13:37:14.881 INFO:teuthology.orchestra.run.smithi153.stdout: btrfs-tools 2024-09-19T13:37:14.983 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2024-09-19T13:37:14.983 INFO:teuthology.orchestra.run.smithi153.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-19T13:37:14.983 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-19T13:37:14.983 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-19T13:37:14.983 INFO:teuthology.orchestra.run.smithi153.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-19T13:37:14.984 INFO:teuthology.orchestra.run.smithi153.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-19T13:37:14.984 INFO:teuthology.orchestra.run.smithi153.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-19T13:37:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-19T13:37:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-19T13:37:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-19T13:37:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-19T13:37:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-19T13:37:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-19T13:37:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-19T13:37:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-19T13:37:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-19T13:37:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-19T13:37:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-19T13:37:14.985 INFO:teuthology.orchestra.run.smithi153.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-19T13:37:14.986 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-19T13:37:14.986 INFO:teuthology.orchestra.run.smithi153.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-19T13:37:14.986 INFO:teuthology.orchestra.run.smithi153.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-19T13:37:14.986 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-19T13:37:14.986 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-19T13:37:14.986 INFO:teuthology.orchestra.run.smithi153.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-19T13:37:14.986 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-19T13:37:14.986 INFO:teuthology.orchestra.run.smithi153.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-19T13:37:15.045 INFO:teuthology.orchestra.run.smithi153.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-19T13:37:15.046 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 244 MB of archives. 2024-09-19T13:37:15.046 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 909 MB of additional disk space will be used. 2024-09-19T13:37:15.046 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-19T13:37:15.128 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-5012-g08af21e0-1jammy [3,634 kB] 2024-09-19T13:37:15.134 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-19T13:37:15.137 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-19T13:37:15.154 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-19T13:37:15.161 INFO:teuthology.orchestra.run.smithi196.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-5012-g08af21e0-1jammy [130 kB] 2024-09-19T13:37:15.163 INFO:teuthology.orchestra.run.smithi196.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-5012-g08af21e0-1jammy [39.0 kB] 2024-09-19T13:37:15.165 INFO:teuthology.orchestra.run.smithi196.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-5012-g08af21e0-1jammy [15.8 MB] 2024-09-19T13:37:15.213 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-19T13:37:15.218 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-19T13:37:15.230 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-19T13:37:15.234 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-19T13:37:15.235 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-19T13:37:15.236 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-19T13:37:15.237 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-19T13:37:15.245 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-19T13:37:15.247 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-19T13:37:15.250 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-19T13:37:15.252 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-19T13:37:15.252 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-19T13:37:15.269 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-19T13:37:15.271 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-19T13:37:15.273 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-19T13:37:15.274 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-19T13:37:15.274 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-19T13:37:15.275 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-19T13:37:15.276 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-19T13:37:15.276 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-19T13:37:15.286 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-19T13:37:15.287 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-19T13:37:15.304 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-19T13:37:15.304 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-19T13:37:15.306 INFO:teuthology.orchestra.run.smithi153.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-19T13:37:15.307 INFO:teuthology.orchestra.run.smithi153.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-19T13:37:15.307 INFO:teuthology.orchestra.run.smithi153.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-19T13:37:15.308 INFO:teuthology.orchestra.run.smithi153.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-19T13:37:15.309 INFO:teuthology.orchestra.run.smithi153.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-19T13:37:15.309 INFO:teuthology.orchestra.run.smithi153.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-19T13:37:15.321 INFO:teuthology.orchestra.run.smithi153.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-19T13:37:15.322 INFO:teuthology.orchestra.run.smithi153.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-19T13:37:15.338 INFO:teuthology.orchestra.run.smithi153.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-19T13:37:15.339 INFO:teuthology.orchestra.run.smithi153.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-19T13:37:15.350 INFO:teuthology.orchestra.run.smithi153.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-19T13:37:15.350 INFO:teuthology.orchestra.run.smithi153.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-19T13:37:15.351 INFO:teuthology.orchestra.run.smithi153.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-19T13:37:15.352 INFO:teuthology.orchestra.run.smithi153.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-19T13:37:15.355 INFO:teuthology.orchestra.run.smithi153.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-19T13:37:15.359 INFO:teuthology.orchestra.run.smithi153.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-19T13:37:15.360 INFO:teuthology.orchestra.run.smithi153.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-19T13:37:15.363 INFO:teuthology.orchestra.run.smithi153.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-19T13:37:15.374 INFO:teuthology.orchestra.run.smithi153.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-19T13:37:15.378 INFO:teuthology.orchestra.run.smithi153.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-19T13:37:15.379 INFO:teuthology.orchestra.run.smithi153.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-19T13:37:15.380 INFO:teuthology.orchestra.run.smithi153.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-19T13:37:15.392 INFO:teuthology.orchestra.run.smithi153.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-19T13:37:15.410 INFO:teuthology.orchestra.run.smithi153.stdout:Get:53 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-5012-g08af21e0-1jammy [3,336 kB] 2024-09-19T13:37:15.462 INFO:teuthology.orchestra.run.smithi153.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-19T13:37:15.462 INFO:teuthology.orchestra.run.smithi153.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-19T13:37:15.464 INFO:teuthology.orchestra.run.smithi153.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-19T13:37:15.464 INFO:teuthology.orchestra.run.smithi153.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-19T13:37:15.465 INFO:teuthology.orchestra.run.smithi153.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-19T13:37:15.483 INFO:teuthology.orchestra.run.smithi153.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-19T13:37:15.484 INFO:teuthology.orchestra.run.smithi153.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-19T13:37:15.485 INFO:teuthology.orchestra.run.smithi153.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-19T13:37:15.494 INFO:teuthology.orchestra.run.smithi153.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-5012-g08af21e0-1jammy [722 kB] 2024-09-19T13:37:15.499 INFO:teuthology.orchestra.run.smithi153.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-19T13:37:15.499 INFO:teuthology.orchestra.run.smithi153.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-19T13:37:15.500 INFO:teuthology.orchestra.run.smithi153.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-19T13:37:15.500 INFO:teuthology.orchestra.run.smithi153.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-19T13:37:15.501 INFO:teuthology.orchestra.run.smithi153.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-19T13:37:15.501 INFO:teuthology.orchestra.run.smithi153.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-19T13:37:15.506 INFO:teuthology.orchestra.run.smithi153.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-5012-g08af21e0-1jammy [356 kB] 2024-09-19T13:37:15.511 INFO:teuthology.orchestra.run.smithi153.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-5012-g08af21e0-1jammy [32.8 kB] 2024-09-19T13:37:15.512 INFO:teuthology.orchestra.run.smithi153.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-5012-g08af21e0-1jammy [180 kB] 2024-09-19T13:37:15.514 INFO:teuthology.orchestra.run.smithi153.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-5012-g08af21e0-1jammy [72.8 kB] 2024-09-19T13:37:15.515 INFO:teuthology.orchestra.run.smithi153.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-19T13:37:15.516 INFO:teuthology.orchestra.run.smithi153.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-19T13:37:15.516 INFO:teuthology.orchestra.run.smithi153.stdout:Get:75 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-5012-g08af21e0-1jammy [338 kB] 2024-09-19T13:37:15.518 INFO:teuthology.orchestra.run.smithi153.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-19T13:37:15.520 INFO:teuthology.orchestra.run.smithi153.stdout:Get:77 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-5012-g08af21e0-1jammy [7,969 kB] 2024-09-19T13:37:15.532 INFO:teuthology.orchestra.run.smithi153.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-19T13:37:15.534 INFO:teuthology.orchestra.run.smithi153.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-19T13:37:15.534 INFO:teuthology.orchestra.run.smithi153.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-19T13:37:15.537 INFO:teuthology.orchestra.run.smithi153.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-19T13:37:15.539 INFO:teuthology.orchestra.run.smithi153.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-19T13:37:15.540 INFO:teuthology.orchestra.run.smithi153.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-19T13:37:15.541 INFO:teuthology.orchestra.run.smithi153.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-19T13:37:15.549 INFO:teuthology.orchestra.run.smithi196.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-5012-g08af21e0-1jammy [91.2 kB] 2024-09-19T13:37:15.550 INFO:teuthology.orchestra.run.smithi153.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-19T13:37:15.550 INFO:teuthology.orchestra.run.smithi153.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-19T13:37:15.553 INFO:teuthology.orchestra.run.smithi153.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-19T13:37:15.567 INFO:teuthology.orchestra.run.smithi153.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-19T13:37:15.568 INFO:teuthology.orchestra.run.smithi153.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-19T13:37:15.568 INFO:teuthology.orchestra.run.smithi153.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-19T13:37:15.569 INFO:teuthology.orchestra.run.smithi153.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-19T13:37:15.570 INFO:teuthology.orchestra.run.smithi153.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-19T13:37:15.576 INFO:teuthology.orchestra.run.smithi153.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-19T13:37:15.576 INFO:teuthology.orchestra.run.smithi153.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-19T13:37:15.584 INFO:teuthology.orchestra.run.smithi153.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-19T13:37:15.586 INFO:teuthology.orchestra.run.smithi153.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-19T13:37:15.587 INFO:teuthology.orchestra.run.smithi153.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-19T13:37:15.651 INFO:teuthology.orchestra.run.smithi153.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-5012-g08af21e0-1jammy [112 kB] 2024-09-19T13:37:15.653 INFO:teuthology.orchestra.run.smithi153.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-5012-g08af21e0-1jammy [473 kB] 2024-09-19T13:37:15.659 INFO:teuthology.orchestra.run.smithi153.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-5012-g08af21e0-1jammy [28.3 MB] 2024-09-19T13:37:16.121 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 244 MB in 5s (52.5 MB/s) 2024-09-19T13:37:16.265 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-19T13:37:16.272 INFO:teuthology.orchestra.run.smithi153.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-5012-g08af21e0-1jammy [5,208 kB] 2024-09-19T13:37:16.338 INFO:teuthology.orchestra.run.smithi153.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-5012-g08af21e0-1jammy [252 kB] 2024-09-19T13:37:16.341 INFO:teuthology.orchestra.run.smithi153.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-5012-g08af21e0-1jammy [124 kB] 2024-09-19T13:37:16.342 INFO:teuthology.orchestra.run.smithi153.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-5012-g08af21e0-1jammy [1,561 kB] 2024-09-19T13:37:16.356 INFO:teuthology.orchestra.run.smithi153.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-5012-g08af21e0-1jammy [6,312 kB] 2024-09-19T13:37:16.363 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-19T13:37:16.369 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-19T13:37:16.447 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-19T13:37:16.448 INFO:teuthology.orchestra.run.smithi153.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-5012-g08af21e0-1jammy [23.1 MB] 2024-09-19T13:37:16.775 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-19T13:37:16.801 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-19T13:37:16.841 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-19T13:37:16.901 INFO:teuthology.orchestra.run.smithi153.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-5012-g08af21e0-1jammy [14.1 kB] 2024-09-19T13:37:16.901 INFO:teuthology.orchestra.run.smithi153.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-5012-g08af21e0-1jammy [880 kB] 2024-09-19T13:37:16.911 INFO:teuthology.orchestra.run.smithi153.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-5012-g08af21e0-1jammy [2,453 kB] 2024-09-19T13:37:16.938 INFO:teuthology.orchestra.run.smithi153.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-5012-g08af21e0-1jammy [814 kB] 2024-09-19T13:37:16.947 INFO:teuthology.orchestra.run.smithi153.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-5012-g08af21e0-1jammy [160 kB] 2024-09-19T13:37:16.949 INFO:teuthology.orchestra.run.smithi153.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-5012-g08af21e0-1jammy [61.5 MB] 2024-09-19T13:37:17.178 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-19T13:37:17.204 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-19T13:37:17.269 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-19T13:37:17.723 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-19T13:37:17.749 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-19T13:37:17.797 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T13:37:18.201 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-19T13:37:18.227 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-19T13:37:18.244 INFO:teuthology.orchestra.run.smithi153.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-5012-g08af21e0-1jammy [8,625 kB] 2024-09-19T13:37:18.267 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T13:37:18.369 INFO:teuthology.orchestra.run.smithi153.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-5012-g08af21e0-1jammy [14.2 kB] 2024-09-19T13:37:18.369 INFO:teuthology.orchestra.run.smithi153.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-5012-g08af21e0-1jammy [48.5 MB] 2024-09-19T13:37:18.595 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-19T13:37:18.621 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-19T13:37:18.661 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T13:37:19.008 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-19T13:37:19.035 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-19T13:37:19.075 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-19T13:37:19.392 INFO:teuthology.orchestra.run.smithi153.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-5012-g08af21e0-1jammy [130 kB] 2024-09-19T13:37:19.394 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librados2. 2024-09-19T13:37:19.395 INFO:teuthology.orchestra.run.smithi153.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-5012-g08af21e0-1jammy [39.0 kB] 2024-09-19T13:37:19.396 INFO:teuthology.orchestra.run.smithi153.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-5012-g08af21e0-1jammy [15.8 MB] 2024-09-19T13:37:19.420 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../007-librados2_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:19.461 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librados2 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:19.695 INFO:teuthology.orchestra.run.smithi153.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-5012-g08af21e0-1jammy [91.2 kB] 2024-09-19T13:37:19.939 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libnbd0. 2024-09-19T13:37:19.965 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-19T13:37:20.005 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-19T13:37:20.268 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 244 MB in 5s (51.8 MB/s) 2024-09-19T13:37:20.291 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librbd1. 2024-09-19T13:37:20.318 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../009-librbd1_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:20.358 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librbd1 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:20.427 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-19T13:37:20.527 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-19T13:37:20.533 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-19T13:37:20.618 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-19T13:37:20.769 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcephfs2. 2024-09-19T13:37:20.795 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:20.835 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcephfs2 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:20.955 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-19T13:37:20.981 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-19T13:37:21.021 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-19T13:37:21.121 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rados. 2024-09-19T13:37:21.148 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../011-python3-rados_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:21.187 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rados (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:21.324 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-19T13:37:21.351 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-19T13:37:21.382 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-19T13:37:21.532 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-19T13:37:21.558 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T13:37:21.607 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-ceph-argparse (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:21.805 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-19T13:37:21.833 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-19T13:37:21.851 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cephfs. 2024-09-19T13:37:21.866 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:21.880 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T13:37:21.901 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cephfs (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:22.266 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-19T13:37:22.270 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-19T13:37:22.292 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-19T13:37:22.296 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T13:37:22.332 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T13:37:22.336 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-ceph-common (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:22.656 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-19T13:37:22.683 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-19T13:37:22.693 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-19T13:37:22.720 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-19T13:37:22.723 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-19T13:37:22.760 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T13:37:23.042 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-prettytable. 2024-09-19T13:37:23.069 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-19T13:37:23.072 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-19T13:37:23.087 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-19T13:37:23.109 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-19T13:37:23.122 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-19T13:37:23.369 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rbd. 2024-09-19T13:37:23.385 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:23.428 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rbd (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:23.441 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librados2. 2024-09-19T13:37:23.467 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../007-librados2_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:23.507 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librados2 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:23.731 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-19T13:37:23.757 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-19T13:37:23.789 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-19T13:37:24.027 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libnbd0. 2024-09-19T13:37:24.053 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-19T13:37:24.058 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-19T13:37:24.077 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-19T13:37:24.093 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-19T13:37:24.116 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-19T13:37:24.363 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librbd1. 2024-09-19T13:37:24.389 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../009-librbd1_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:24.410 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-19T13:37:24.426 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-19T13:37:24.429 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librbd1 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:24.469 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-19T13:37:24.772 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package lua5.1. 2024-09-19T13:37:24.798 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-19T13:37:24.830 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-19T13:37:24.840 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcephfs2. 2024-09-19T13:37:24.867 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:24.907 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcephfs2 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:25.141 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package lua-any. 2024-09-19T13:37:25.157 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-19T13:37:25.176 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rados. 2024-09-19T13:37:25.191 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../011-python3-rados_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:25.200 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-19T13:37:25.234 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rados (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:25.469 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package zip. 2024-09-19T13:37:25.495 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-19T13:37:25.535 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking zip (3.0-12build2) ... 2024-09-19T13:37:25.553 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-19T13:37:25.580 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T13:37:25.620 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-ceph-argparse (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:25.847 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package unzip. 2024-09-19T13:37:25.873 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-19T13:37:25.881 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cephfs. 2024-09-19T13:37:25.896 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:25.913 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-19T13:37:25.931 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cephfs (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:26.200 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-19T13:37:26.227 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T13:37:26.258 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-ceph-common (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:26.275 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package luarocks. 2024-09-19T13:37:26.302 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-19T13:37:26.342 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-19T13:37:26.569 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-19T13:37:26.596 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-19T13:37:26.636 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-19T13:37:26.716 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package librgw2. 2024-09-19T13:37:26.743 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../026-librgw2_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:26.783 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking librgw2 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:26.947 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-prettytable. 2024-09-19T13:37:26.974 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-19T13:37:27.014 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-19T13:37:27.275 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rbd. 2024-09-19T13:37:27.301 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:27.341 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rbd (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:27.393 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rgw. 2024-09-19T13:37:27.409 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:27.452 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rgw (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:27.788 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-19T13:37:27.814 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-19T13:37:27.846 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-19T13:37:27.886 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-19T13:37:27.912 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-19T13:37:27.944 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-19T13:37:28.149 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libradosstriper1. 2024-09-19T13:37:28.175 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:28.214 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-19T13:37:28.224 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libradosstriper1 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:28.240 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-19T13:37:28.280 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-19T13:37:28.574 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-19T13:37:28.590 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-19T13:37:28.633 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-19T13:37:28.644 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-common. 2024-09-19T13:37:28.670 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../030-ceph-common_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:28.711 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-common (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:28.936 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package lua5.1. 2024-09-19T13:37:28.962 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-19T13:37:29.002 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-19T13:37:29.289 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package lua-any. 2024-09-19T13:37:29.304 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-19T13:37:29.355 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-19T13:37:29.607 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package zip. 2024-09-19T13:37:29.622 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-19T13:37:29.666 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking zip (3.0-12build2) ... 2024-09-19T13:37:29.994 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package unzip. 2024-09-19T13:37:30.020 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-19T13:37:30.060 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-19T13:37:30.182 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-base. 2024-09-19T13:37:30.208 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../031-ceph-base_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:30.257 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-base (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:30.431 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package luarocks. 2024-09-19T13:37:30.457 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-19T13:37:30.497 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-19T13:37:30.844 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-19T13:37:30.855 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librgw2. 2024-09-19T13:37:30.870 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-19T13:37:30.881 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../026-librgw2_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:30.911 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-19T13:37:30.913 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librgw2 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:31.205 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cheroot. 2024-09-19T13:37:31.232 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-19T13:37:31.263 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-19T13:37:31.482 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rgw. 2024-09-19T13:37:31.497 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:31.540 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rgw (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:31.549 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-19T13:37:31.576 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-19T13:37:31.616 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-19T13:37:31.868 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-19T13:37:31.894 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-19T13:37:31.919 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-19T13:37:31.934 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-19T13:37:31.945 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-19T13:37:31.985 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-19T13:37:32.254 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libradosstriper1. 2024-09-19T13:37:32.280 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:32.288 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-19T13:37:32.315 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-19T13:37:32.320 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libradosstriper1 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:32.355 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-19T13:37:32.649 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-tempora. 2024-09-19T13:37:32.676 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-19T13:37:32.699 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-common. 2024-09-19T13:37:32.716 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-19T13:37:32.725 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../030-ceph-common_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:32.757 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-common (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:32.994 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-portend. 2024-09-19T13:37:33.020 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-19T13:37:33.060 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-19T13:37:33.363 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-19T13:37:33.389 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-19T13:37:33.429 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-19T13:37:33.749 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-19T13:37:33.775 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-19T13:37:33.824 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-19T13:37:34.143 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-natsort. 2024-09-19T13:37:34.159 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-19T13:37:34.194 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-19T13:37:34.270 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-base. 2024-09-19T13:37:34.296 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../031-ceph-base_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:34.346 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-base (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:34.497 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-logutils. 2024-09-19T13:37:34.523 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-19T13:37:34.563 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-19T13:37:34.874 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-19T13:37:34.901 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-19T13:37:34.907 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-19T13:37:34.934 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-19T13:37:34.949 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-19T13:37:34.966 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-19T13:37:35.219 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cheroot. 2024-09-19T13:37:35.245 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-19T13:37:35.252 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-mako. 2024-09-19T13:37:35.276 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-19T13:37:35.278 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-19T13:37:35.318 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-19T13:37:35.546 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-19T13:37:35.573 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-19T13:37:35.605 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-19T13:37:35.613 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-19T13:37:35.639 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-19T13:37:35.679 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-19T13:37:35.899 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-19T13:37:35.926 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-19T13:37:35.982 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-19T13:37:35.988 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-19T13:37:36.008 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-19T13:37:36.049 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-19T13:37:36.293 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-19T13:37:36.319 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-19T13:37:36.343 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-webob. 2024-09-19T13:37:36.359 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-19T13:37:36.369 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-19T13:37:36.410 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-19T13:37:36.637 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-tempora. 2024-09-19T13:37:36.664 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-19T13:37:36.704 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-19T13:37:36.788 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-waitress. 2024-09-19T13:37:36.814 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-19T13:37:36.858 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-19T13:37:36.940 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-portend. 2024-09-19T13:37:36.955 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-19T13:37:36.990 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-19T13:37:37.132 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-tempita. 2024-09-19T13:37:37.158 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-19T13:37:37.199 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-19T13:37:37.292 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-19T13:37:37.319 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-19T13:37:37.359 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-19T13:37:37.662 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-19T13:37:37.688 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-19T13:37:37.689 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-paste. 2024-09-19T13:37:37.715 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-19T13:37:37.728 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-19T13:37:37.818 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-19T13:37:38.090 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-natsort. 2024-09-19T13:37:38.117 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-19T13:37:38.121 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-19T13:37:38.136 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-19T13:37:38.156 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-19T13:37:38.171 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-19T13:37:38.423 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-19T13:37:38.426 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-logutils. 2024-09-19T13:37:38.439 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-19T13:37:38.442 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-19T13:37:38.476 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-19T13:37:38.481 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-19T13:37:38.785 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-webtest. 2024-09-19T13:37:38.787 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-19T13:37:38.811 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-19T13:37:38.814 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-19T13:37:38.851 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-19T13:37:38.853 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-19T13:37:39.157 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-mako. 2024-09-19T13:37:39.162 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pecan. 2024-09-19T13:37:39.183 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-19T13:37:39.189 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-19T13:37:39.223 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-19T13:37:39.229 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-19T13:37:39.559 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-19T13:37:39.586 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-19T13:37:39.592 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-certifi. 2024-09-19T13:37:39.618 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-19T13:37:39.626 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-19T13:37:39.658 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-19T13:37:39.887 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-19T13:37:39.913 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-19T13:37:39.936 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-idna. 2024-09-19T13:37:39.945 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-19T13:37:39.951 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-19T13:37:39.986 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-19T13:37:40.240 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-webob. 2024-09-19T13:37:40.267 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-19T13:37:40.306 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-19T13:37:40.314 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-urllib3. 2024-09-19T13:37:40.340 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-19T13:37:40.380 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-19T13:37:40.659 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-waitress. 2024-09-19T13:37:40.685 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-19T13:37:40.692 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-requests. 2024-09-19T13:37:40.718 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-19T13:37:40.728 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-19T13:37:40.758 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-19T13:37:41.037 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-tempita. 2024-09-19T13:37:41.064 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-19T13:37:41.069 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-19T13:37:41.096 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-19T13:37:41.103 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-19T13:37:41.136 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-19T13:37:41.415 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-paste. 2024-09-19T13:37:41.422 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-19T13:37:41.438 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T13:37:41.441 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-19T13:37:41.480 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-modules-core (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:41.481 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-19T13:37:41.792 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-19T13:37:41.816 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-19T13:37:41.859 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-19T13:37:41.894 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-19T13:37:41.920 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:41.960 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:42.162 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-19T13:37:42.188 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-19T13:37:42.228 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-19T13:37:42.271 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-19T13:37:42.298 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-19T13:37:42.490 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-webtest. 2024-09-19T13:37:42.512 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-19T13:37:42.516 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-19T13:37:42.547 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-19T13:37:42.859 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pecan. 2024-09-19T13:37:42.886 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-19T13:37:42.925 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-19T13:37:43.263 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-certifi. 2024-09-19T13:37:43.278 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-19T13:37:43.330 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-19T13:37:43.449 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-openssl. 2024-09-19T13:37:43.475 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-19T13:37:43.515 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-19T13:37:43.649 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-idna. 2024-09-19T13:37:43.676 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-19T13:37:43.716 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-19T13:37:43.835 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr. 2024-09-19T13:37:43.862 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:43.902 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:44.035 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-urllib3. 2024-09-19T13:37:44.062 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-19T13:37:44.101 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-19T13:37:44.296 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mon. 2024-09-19T13:37:44.323 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:44.363 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mon (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:44.696 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-requests. 2024-09-19T13:37:44.723 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-19T13:37:44.771 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-19T13:37:44.958 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-osd. 2024-09-19T13:37:44.985 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:45.024 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-osd (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:45.082 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-19T13:37:45.109 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-19T13:37:45.149 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-19T13:37:45.460 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-19T13:37:45.487 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T13:37:45.527 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-modules-core (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:45.890 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-19T13:37:45.905 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:45.939 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:46.060 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph. 2024-09-19T13:37:46.076 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../067-ceph_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:46.119 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:46.226 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-19T13:37:46.252 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-19T13:37:46.292 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-19T13:37:46.438 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-fuse. 2024-09-19T13:37:46.464 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:46.504 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-fuse (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:46.553 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-openssl. 2024-09-19T13:37:46.580 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-19T13:37:46.611 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-19T13:37:46.874 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mds. 2024-09-19T13:37:46.900 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:46.939 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr. 2024-09-19T13:37:46.949 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mds (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:46.966 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:47.006 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:47.318 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package cephadm. 2024-09-19T13:37:47.345 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../070-cephadm_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:47.385 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking cephadm (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:47.392 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mon. 2024-09-19T13:37:47.419 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:47.459 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mon (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:47.671 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-19T13:37:47.697 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-19T13:37:47.737 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-19T13:37:48.021 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-osd. 2024-09-19T13:37:48.040 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-19T13:37:48.047 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:48.055 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-19T13:37:48.078 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-osd (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:48.090 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-19T13:37:49.095 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-babel. 2024-09-19T13:37:49.106 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph. 2024-09-19T13:37:49.122 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-19T13:37:49.133 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../067-ceph_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:49.161 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-19T13:37:49.173 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:49.481 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-jinja2. 2024-09-19T13:37:49.507 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-19T13:37:49.547 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-19T13:37:49.900 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-19T13:37:49.927 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T13:37:49.967 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-cephadm (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:50.327 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-fuse. 2024-09-19T13:37:50.328 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-19T13:37:50.354 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:50.355 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-19T13:37:50.393 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-fuse (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:50.394 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-19T13:37:50.697 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-routes. 2024-09-19T13:37:50.724 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-19T13:37:50.762 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mds. 2024-09-19T13:37:50.764 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-19T13:37:50.789 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:50.828 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mds (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:51.092 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-19T13:37:51.120 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T13:37:51.158 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-dashboard (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:51.173 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephadm. 2024-09-19T13:37:51.201 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../070-cephadm_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:37:51.231 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephadm (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:51.543 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-19T13:37:51.569 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-19T13:37:51.609 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-19T13:37:51.879 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-19T13:37:51.905 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-19T13:37:51.945 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-19T13:37:52.975 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-babel. 2024-09-19T13:37:53.002 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-19T13:37:53.041 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-19T13:37:53.344 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jinja2. 2024-09-19T13:37:53.371 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-19T13:37:53.410 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-19T13:37:53.722 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-19T13:37:53.748 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T13:37:53.796 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-cephadm (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:54.013 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-19T13:37:54.030 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-19T13:37:54.071 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-19T13:37:54.141 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-19T13:37:54.168 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-19T13:37:54.208 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-19T13:37:54.469 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-routes. 2024-09-19T13:37:54.495 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-19T13:37:54.527 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-19T13:37:54.549 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-joblib. 2024-09-19T13:37:54.577 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-19T13:37:54.607 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-19T13:37:54.986 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-19T13:37:55.014 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-19T13:37:55.052 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-19T13:37:55.064 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-19T13:37:55.090 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T13:37:55.122 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-dashboard (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:55.371 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-sklearn. 2024-09-19T13:37:55.399 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-19T13:37:55.523 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-19T13:37:56.235 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-19T13:37:56.263 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T13:37:56.301 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:37:57.271 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-cachetools. 2024-09-19T13:37:57.298 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-19T13:37:57.337 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-19T13:37:57.581 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-19T13:37:57.598 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-19T13:37:57.631 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-19T13:37:57.701 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-19T13:37:57.731 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-19T13:37:57.776 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-19T13:37:57.935 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-19T13:37:57.962 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-19T13:37:58.001 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-19T13:37:58.246 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-joblib. 2024-09-19T13:37:58.273 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-19T13:37:58.312 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-19T13:37:58.329 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-rsa. 2024-09-19T13:37:58.357 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-19T13:37:58.396 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-19T13:37:58.666 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-19T13:37:58.691 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-google-auth. 2024-09-19T13:37:58.694 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-19T13:37:58.708 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-19T13:37:58.724 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-19T13:37:58.741 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-19T13:37:59.002 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-sklearn. 2024-09-19T13:37:59.029 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-19T13:37:59.036 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-19T13:37:59.063 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-19T13:37:59.102 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-19T13:37:59.154 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-19T13:37:59.414 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-websocket. 2024-09-19T13:37:59.441 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-19T13:37:59.480 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-19T13:37:59.792 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-19T13:37:59.819 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-19T13:37:59.848 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-19T13:37:59.858 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-19T13:37:59.876 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T13:37:59.914 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:00.489 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-19T13:38:00.517 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T13:38:00.555 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:00.818 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cachetools. 2024-09-19T13:38:00.833 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-19T13:38:00.845 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-19T13:38:00.861 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-19T13:38:00.884 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-19T13:38:00.890 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-19T13:38:01.186 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-19T13:38:01.214 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-19T13:38:01.236 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-19T13:38:01.253 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-19T13:38:01.263 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-19T13:38:01.302 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-19T13:38:01.571 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package jq. 2024-09-19T13:38:01.589 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-19T13:38:01.599 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-19T13:38:01.617 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-19T13:38:01.637 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-19T13:38:01.656 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-19T13:38:01.890 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package socat. 2024-09-19T13:38:01.906 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-19T13:38:01.925 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rsa. 2024-09-19T13:38:01.942 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-19T13:38:01.948 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-19T13:38:01.975 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-19T13:38:02.210 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package xmlstarlet. 2024-09-19T13:38:02.230 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-19T13:38:02.260 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-19T13:38:02.296 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-google-auth. 2024-09-19T13:38:02.324 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-19T13:38:02.362 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-19T13:38:02.639 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-test. 2024-09-19T13:38:02.667 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../098-ceph-test_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:38:02.705 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-test (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:02.707 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-19T13:38:02.735 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-19T13:38:02.773 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-19T13:38:03.085 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-websocket. 2024-09-19T13:38:03.113 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-19T13:38:03.151 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-19T13:38:03.471 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-19T13:38:03.499 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-19T13:38:03.537 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-19T13:38:04.309 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-19T13:38:04.399 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T13:38:04.399 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:04.654 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-19T13:38:04.682 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-19T13:38:04.720 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-19T13:38:04.877 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package ceph-volume. 2024-09-19T13:38:04.904 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T13:38:04.943 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking ceph-volume (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:05.056 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-19T13:38:05.084 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-19T13:38:05.123 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-19T13:38:05.246 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-19T13:38:05.262 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:38:05.305 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcephfs-dev (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:05.609 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package jq. 2024-09-19T13:38:05.625 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-19T13:38:05.641 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-19T13:38:05.667 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-19T13:38:05.668 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-19T13:38:05.707 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-19T13:38:05.911 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package socat. 2024-09-19T13:38:05.927 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-19T13:38:05.977 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-19T13:38:06.020 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-19T13:38:06.048 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-19T13:38:06.078 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-19T13:38:06.247 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package xmlstarlet. 2024-09-19T13:38:06.264 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-19T13:38:06.297 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-19T13:38:06.474 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package nvme-cli. 2024-09-19T13:38:06.501 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-19T13:38:06.540 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-19T13:38:06.643 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-test. 2024-09-19T13:38:06.659 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../098-ceph-test_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:38:06.701 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-test (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:06.895 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package pkg-config. 2024-09-19T13:38:06.923 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-19T13:38:06.953 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-19T13:38:07.206 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-19T13:38:07.234 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-19T13:38:07.272 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-19T13:38:07.675 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-19T13:38:07.703 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-19T13:38:07.742 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-19T13:38:08.045 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pastescript. 2024-09-19T13:38:08.073 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-19T13:38:08.111 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-19T13:38:08.414 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pluggy. 2024-09-19T13:38:08.443 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-19T13:38:08.481 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-19T13:38:08.813 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-volume. 2024-09-19T13:38:08.829 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-5012-g08af21e0-1jammy_all.deb ... 2024-09-19T13:38:08.863 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-volume (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:09.084 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-psutil. 2024-09-19T13:38:09.112 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-19T13:38:09.142 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-19T13:38:09.150 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-19T13:38:09.158 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:38:09.192 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcephfs-dev (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:09.478 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-py. 2024-09-19T13:38:09.507 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-19T13:38:09.511 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-19T13:38:09.539 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-19T13:38:09.545 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-19T13:38:09.578 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-19T13:38:09.823 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pygments. 2024-09-19T13:38:09.839 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-19T13:38:09.872 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-19T13:38:09.899 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-19T13:38:09.927 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-19T13:38:09.965 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-19T13:38:10.293 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-19T13:38:10.319 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package nvme-cli. 2024-09-19T13:38:10.322 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-19T13:38:10.347 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-19T13:38:10.360 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-19T13:38:10.385 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-19T13:38:10.687 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-toml. 2024-09-19T13:38:10.715 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-19T13:38:10.754 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-19T13:38:10.798 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package pkg-config. 2024-09-19T13:38:10.815 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-19T13:38:10.857 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-19T13:38:11.006 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-pytest. 2024-09-19T13:38:11.022 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-19T13:38:11.056 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-19T13:38:11.076 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-19T13:38:11.092 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-19T13:38:11.134 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-19T13:38:11.376 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-simplejson. 2024-09-19T13:38:11.405 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-19T13:38:11.443 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-19T13:38:11.546 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-19T13:38:11.574 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-19T13:38:11.612 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-19T13:38:11.712 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-19T13:38:11.729 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-19T13:38:11.770 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-19T13:38:11.915 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pastescript. 2024-09-19T13:38:11.943 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-19T13:38:11.981 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-19T13:38:12.302 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pluggy. 2024-09-19T13:38:12.330 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-19T13:38:12.368 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-19T13:38:12.457 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package radosgw. 2024-09-19T13:38:12.486 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../117-radosgw_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:38:12.523 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking radosgw (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:12.705 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-psutil. 2024-09-19T13:38:12.732 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-19T13:38:12.770 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-19T13:38:13.073 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-py. 2024-09-19T13:38:13.101 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-19T13:38:13.131 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-19T13:38:13.427 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pygments. 2024-09-19T13:38:13.427 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package rbd-fuse. 2024-09-19T13:38:13.454 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-19T13:38:13.455 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:38:13.485 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-19T13:38:13.493 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking rbd-fuse (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:13.772 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-19T13:38:13.947 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-19T13:38:13.975 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-19T13:38:14.013 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-19T13:38:14.056 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-19T13:38:14.182 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-19T13:38:14.299 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-toml. 2024-09-19T13:38:14.327 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-19T13:38:14.365 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-19T13:38:14.440 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-19T13:38:14.668 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pytest. 2024-09-19T13:38:14.697 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-19T13:38:14.735 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-19T13:38:14.766 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-19T13:38:15.088 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-simplejson. 2024-09-19T13:38:15.116 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-19T13:38:15.154 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-19T13:38:15.208 INFO:teuthology.orchestra.run.smithi196.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-19T13:38:15.275 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up cephadm (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:15.432 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-19T13:38:15.457 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-19T13:38:15.498 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-19T13:38:15.800 INFO:teuthology.orchestra.run.smithi196.stdout:Adding system user cephadm....done 2024-09-19T13:38:15.931 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-19T13:38:16.186 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package radosgw. 2024-09-19T13:38:16.208 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-19T13:38:16.214 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../117-radosgw_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:38:16.252 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking radosgw (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:16.459 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-19T13:38:16.560 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-19T13:38:16.803 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-19T13:38:17.054 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-19T13:38:17.121 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package rbd-fuse. 2024-09-19T13:38:17.138 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-5012-g08af21e0-1jammy_amd64.deb ... 2024-09-19T13:38:17.163 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-19T13:38:17.180 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking rbd-fuse (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:17.456 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-19T13:38:17.476 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-19T13:38:17.726 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-19T13:38:17.816 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-19T13:38:17.844 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-19T13:38:18.085 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-19T13:38:18.100 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-19T13:38:18.344 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-19T13:38:18.449 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-19T13:38:18.637 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-19T13:38:18.905 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-19T13:38:18.907 INFO:teuthology.orchestra.run.smithi153.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-19T13:38:18.971 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephadm (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:19.164 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-19T13:38:19.423 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-ceph-argparse (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:19.513 INFO:teuthology.orchestra.run.smithi153.stdout:Adding system user cephadm....done 2024-09-19T13:38:19.668 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-19T13:38:19.682 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-19T13:38:19.925 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-19T13:38:19.961 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-19T13:38:20.051 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-19T13:38:20.169 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-19T13:38:20.221 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-19T13:38:20.295 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-19T13:38:20.347 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-19T13:38:20.546 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-19T13:38:20.606 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-19T13:38:21.000 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-19T13:38:21.027 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-19T13:38:21.049 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-19T13:38:21.091 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-19T13:38:21.150 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-19T13:38:21.200 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-19T13:38:21.427 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-19T13:38:21.543 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-19T13:38:21.669 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-19T13:38:21.787 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-19T13:38:21.920 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-19T13:38:22.038 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-19T13:38:22.162 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-19T13:38:22.305 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-19T13:38:22.480 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up zip (3.0-12build2) ... 2024-09-19T13:38:22.540 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-19T13:38:22.606 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-19T13:38:22.791 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-19T13:38:23.026 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-19T13:38:23.277 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-ceph-argparse (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:23.300 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-19T13:38:23.543 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-19T13:38:23.644 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-19T13:38:23.652 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-19T13:38:23.770 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-19T13:38:23.778 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-19T13:38:23.896 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-19T13:38:24.022 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-19T13:38:24.062 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-19T13:38:24.148 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-19T13:38:24.391 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-19T13:38:24.430 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-19T13:38:24.681 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-19T13:38:24.764 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-19T13:38:24.797 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-19T13:38:24.860 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-19T13:38:24.986 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-19T13:38:25.049 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-19T13:38:25.334 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-19T13:38:25.345 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-19T13:38:25.472 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-19T13:38:25.660 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-19T13:38:25.731 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-19T13:38:25.902 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-19T13:38:25.982 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-19T13:38:26.029 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-ceph-common (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:26.267 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up zip (3.0-12build2) ... 2024-09-19T13:38:26.330 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-19T13:38:26.367 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-19T13:38:26.647 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-19T13:38:27.044 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-19T13:38:27.295 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-19T13:38:27.421 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-19T13:38:27.547 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-19T13:38:27.821 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-19T13:38:27.840 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-19T13:38:28.081 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T13:38:28.215 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-19T13:38:28.241 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-19T13:38:28.475 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-19T13:38:28.483 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-19T13:38:28.609 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-19T13:38:28.726 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-19T13:38:28.852 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-19T13:38:28.994 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-19T13:38:29.145 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-19T13:38:29.254 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-19T13:38:29.505 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T13:38:29.538 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-19T13:38:29.631 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-19T13:38:29.789 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-19T13:38:29.906 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-ceph-common (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:29.924 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-19T13:38:30.199 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-19T13:38:30.208 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-19T13:38:30.460 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-19T13:38:30.500 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-19T13:38:30.702 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-19T13:38:30.953 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-19T13:38:31.221 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-19T13:38:31.347 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-19T13:38:31.631 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-19T13:38:31.689 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-19T13:38:31.757 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-19T13:38:31.916 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T13:38:32.025 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-19T13:38:32.058 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-19T13:38:32.276 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-19T13:38:32.359 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-19T13:38:32.402 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-19T13:38:32.528 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-19T13:38:32.610 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-19T13:38:32.711 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-19T13:38:32.821 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-19T13:38:32.846 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-19T13:38:32.909 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-19T13:38:33.105 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-19T13:38:33.130 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-19T13:38:33.256 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-19T13:38:33.356 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T13:38:33.466 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-19T13:38:33.633 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-19T13:38:33.767 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-19T13:38:33.884 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-19T13:38:33.993 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-19T13:38:34.018 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-19T13:38:34.244 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T13:38:34.277 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-19T13:38:34.370 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-19T13:38:34.528 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-19T13:38:34.679 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-19T13:38:34.779 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-19T13:38:34.989 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-19T13:38:35.039 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-19T13:38:35.164 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-19T13:38:35.290 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-19T13:38:35.416 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-19T13:38:35.474 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-19T13:38:35.600 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-19T13:38:35.692 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-19T13:38:35.901 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-19T13:38:36.037 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-19T13:38:36.194 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-19T13:38:36.288 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-19T13:38:36.453 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-19T13:38:36.579 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-19T13:38:36.705 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-19T13:38:36.714 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-19T13:38:36.793 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-19T13:38:36.991 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-19T13:38:37.048 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-19T13:38:37.149 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-19T13:38:37.310 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-19T13:38:37.411 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librados2 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:37.517 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-19T13:38:37.521 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libsqlite3-mod-ceph (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:37.646 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-19T13:38:37.777 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-19T13:38:37.903 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-19T13:38:37.982 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcephfs2 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:38.117 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libradosstriper1 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:38.162 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-19T13:38:38.243 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-19T13:38:38.288 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-19T13:38:38.503 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librbd1 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:38.622 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-19T13:38:38.629 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-modules-core (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:38.755 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-fuse (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:38.906 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-19T13:38:38.965 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-19T13:38:38.965 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-19T13:38:39.166 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-19T13:38:39.300 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-19T13:38:39.456 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcephfs-dev (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:39.565 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rados (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:39.568 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-19T13:38:39.920 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up librgw2 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:39.929 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-19T13:38:40.184 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-19T13:38:40.205 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-19T13:38:40.582 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-19T13:38:40.867 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-19T13:38:41.186 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-19T13:38:41.320 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librados2 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:41.354 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rbd (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:41.446 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libsqlite3-mod-ceph (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:41.480 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up rbd-fuse (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:41.572 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-19T13:38:41.606 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-rgw (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:41.732 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-cephfs (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:41.858 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-common (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:41.892 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcephfs2 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:42.018 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libradosstriper1 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:42.144 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-19T13:38:42.369 INFO:teuthology.orchestra.run.smithi196.stdout:Adding group ceph....done 2024-09-19T13:38:42.420 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librbd1 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:42.563 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-modules-core (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:42.654 INFO:teuthology.orchestra.run.smithi196.stdout:Adding system user ceph....done 2024-09-19T13:38:42.689 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-fuse (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:42.896 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-19T13:38:42.896 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-19T13:38:42.914 INFO:teuthology.orchestra.run.smithi196.stdout:Setting system user ceph properties....done 2024-09-19T13:38:42.933 INFO:teuthology.orchestra.run.smithi196.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-19T13:38:43.071 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-19T13:38:43.332 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcephfs-dev (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:43.415 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-19T13:38:43.449 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rados (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:43.575 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librgw2 (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:43.701 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-19T13:38:43.911 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-test (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:44.071 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up radosgw (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:44.579 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-19T13:38:44.579 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-19T13:38:44.863 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rbd (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:44.989 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up rbd-fuse (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:45.109 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rgw (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:45.114 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-base (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:45.226 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cephfs (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:45.352 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-common (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:45.468 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-19T13:38:45.920 INFO:teuthology.orchestra.run.smithi153.stdout:Adding group ceph....done 2024-09-19T13:38:45.942 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mds (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:46.164 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-19T13:38:46.164 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-19T13:38:46.263 INFO:teuthology.orchestra.run.smithi153.stdout:Adding system user ceph....done 2024-09-19T13:38:46.423 INFO:teuthology.orchestra.run.smithi153.stdout:Setting system user ceph properties....done 2024-09-19T13:38:46.438 INFO:teuthology.orchestra.run.smithi153.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-19T13:38:46.570 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-19T13:38:46.651 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:46.847 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-19T13:38:46.848 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-19T13:38:46.887 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-19T13:38:47.362 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-test (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:47.394 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-osd (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:47.487 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up radosgw (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:47.669 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-19T13:38:47.669 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-19T13:38:47.951 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-19T13:38:47.951 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-19T13:38:48.188 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-k8sevents (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:48.314 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:48.439 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-base (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:48.473 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mon (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:48.692 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-19T13:38:48.692 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-19T13:38:48.768 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-19T13:38:49.166 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-cephadm (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:49.258 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mds (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:49.308 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:49.409 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-mgr-dashboard (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:49.485 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-19T13:38:49.485 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-19T13:38:49.536 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up ceph-volume (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:49.938 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-19T13:38:49.952 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:50.055 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-19T13:38:50.157 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-19T13:38:50.157 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-19T13:38:50.208 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-19T13:38:50.661 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-osd (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:50.933 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-19T13:38:50.933 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-19T13:38:51.268 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-19T13:38:51.429 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-k8sevents (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:51.877 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:51.939 INFO:teuthology.orchestra.run.smithi196.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-19T13:38:51.942 DEBUG:teuthology.orchestra.run.smithi196:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-19T13:38:51.997 INFO:teuthology.orchestra.run.smithi196.stdout:Reading package lists... 2024-09-19T13:38:52.032 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mon (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:52.220 INFO:teuthology.orchestra.run.smithi196.stdout:Building dependency tree... 2024-09-19T13:38:52.221 INFO:teuthology.orchestra.run.smithi196.stdout:Reading state information... 2024-09-19T13:38:52.247 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-19T13:38:52.247 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-19T13:38:52.427 INFO:teuthology.orchestra.run.smithi196.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T13:38:52.427 INFO:teuthology.orchestra.run.smithi196.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T13:38:52.427 INFO:teuthology.orchestra.run.smithi196.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T13:38:52.428 INFO:teuthology.orchestra.run.smithi196.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T13:38:52.428 INFO:teuthology.orchestra.run.smithi196.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-19T13:38:52.428 INFO:teuthology.orchestra.run.smithi196.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-19T13:38:52.428 INFO:teuthology.orchestra.run.smithi196.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T13:38:52.430 INFO:teuthology.orchestra.run.smithi196.stdout:The following additional packages will be installed: 2024-09-19T13:38:52.430 INFO:teuthology.orchestra.run.smithi196.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-19T13:38:52.430 INFO:teuthology.orchestra.run.smithi196.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-19T13:38:52.430 INFO:teuthology.orchestra.run.smithi196.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-19T13:38:52.430 INFO:teuthology.orchestra.run.smithi196.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-19T13:38:52.430 INFO:teuthology.orchestra.run.smithi196.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-19T13:38:52.430 INFO:teuthology.orchestra.run.smithi196.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-19T13:38:52.430 INFO:teuthology.orchestra.run.smithi196.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-19T13:38:52.430 INFO:teuthology.orchestra.run.smithi196.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-19T13:38:52.430 INFO:teuthology.orchestra.run.smithi196.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-19T13:38:52.430 INFO:teuthology.orchestra.run.smithi196.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-19T13:38:52.431 INFO:teuthology.orchestra.run.smithi196.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-19T13:38:52.432 INFO:teuthology.orchestra.run.smithi196.stdout:Suggested packages: 2024-09-19T13:38:52.432 INFO:teuthology.orchestra.run.smithi196.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-19T13:38:52.432 INFO:teuthology.orchestra.run.smithi196.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-19T13:38:52.432 INFO:teuthology.orchestra.run.smithi196.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-19T13:38:52.432 INFO:teuthology.orchestra.run.smithi196.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-19T13:38:52.432 INFO:teuthology.orchestra.run.smithi196.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-19T13:38:52.474 INFO:teuthology.orchestra.run.smithi196.stdout:The following NEW packages will be installed: 2024-09-19T13:38:52.475 INFO:teuthology.orchestra.run.smithi196.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-19T13:38:52.475 INFO:teuthology.orchestra.run.smithi196.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-19T13:38:52.475 INFO:teuthology.orchestra.run.smithi196.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-19T13:38:52.475 INFO:teuthology.orchestra.run.smithi196.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-19T13:38:52.475 INFO:teuthology.orchestra.run.smithi196.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-19T13:38:52.475 INFO:teuthology.orchestra.run.smithi196.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-19T13:38:52.475 INFO:teuthology.orchestra.run.smithi196.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-19T13:38:52.475 INFO:teuthology.orchestra.run.smithi196.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-19T13:38:52.475 INFO:teuthology.orchestra.run.smithi196.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-19T13:38:52.475 INFO:teuthology.orchestra.run.smithi196.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-19T13:38:52.476 INFO:teuthology.orchestra.run.smithi196.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-19T13:38:52.476 INFO:teuthology.orchestra.run.smithi196.stdout: s3cmd 2024-09-19T13:38:52.658 INFO:teuthology.orchestra.run.smithi196.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-19T13:38:52.658 INFO:teuthology.orchestra.run.smithi196.stdout:Need to get 10.4 MB of archives. 2024-09-19T13:38:52.659 INFO:teuthology.orchestra.run.smithi196.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-19T13:38:52.659 INFO:teuthology.orchestra.run.smithi196.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-19T13:38:52.741 INFO:teuthology.orchestra.run.smithi196.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-19T13:38:52.741 INFO:teuthology.orchestra.run.smithi196.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-19T13:38:52.741 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-cephadm (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:52.758 INFO:teuthology.orchestra.run.smithi196.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-19T13:38:52.893 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:52.918 INFO:teuthology.orchestra.run.smithi196.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-19T13:38:52.991 INFO:teuthology.orchestra.run.smithi196.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-19T13:38:52.998 INFO:teuthology.orchestra.run.smithi196.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-19T13:38:53.018 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-dashboard (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:53.130 INFO:teuthology.orchestra.run.smithi196.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-19T13:38:53.169 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-volume (19.3.0-5012-g08af21e0-1jammy) ... 2024-09-19T13:38:53.223 INFO:teuthology.orchestra.run.smithi196.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-19T13:38:53.224 INFO:teuthology.orchestra.run.smithi196.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-19T13:38:53.228 INFO:teuthology.orchestra.run.smithi196.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-19T13:38:53.372 INFO:teuthology.orchestra.run.smithi196.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-19T13:38:53.373 INFO:teuthology.orchestra.run.smithi196.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-19T13:38:53.413 INFO:teuthology.orchestra.run.smithi196.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-19T13:38:53.414 INFO:teuthology.orchestra.run.smithi196.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-19T13:38:53.415 INFO:teuthology.orchestra.run.smithi196.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-19T13:38:53.416 INFO:teuthology.orchestra.run.smithi196.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-19T13:38:53.417 INFO:teuthology.orchestra.run.smithi196.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-19T13:38:53.423 INFO:teuthology.orchestra.run.smithi196.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-19T13:38:53.424 INFO:teuthology.orchestra.run.smithi196.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-19T13:38:53.469 INFO:teuthology.orchestra.run.smithi196.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-19T13:38:53.472 INFO:teuthology.orchestra.run.smithi196.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-19T13:38:53.519 INFO:teuthology.orchestra.run.smithi196.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-19T13:38:53.520 INFO:teuthology.orchestra.run.smithi196.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-19T13:38:53.521 INFO:teuthology.orchestra.run.smithi196.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-19T13:38:53.523 INFO:teuthology.orchestra.run.smithi196.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-19T13:38:53.524 INFO:teuthology.orchestra.run.smithi196.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-19T13:38:53.531 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-19T13:38:53.551 INFO:teuthology.orchestra.run.smithi196.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-19T13:38:53.559 INFO:teuthology.orchestra.run.smithi196.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-19T13:38:53.563 INFO:teuthology.orchestra.run.smithi196.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-19T13:38:53.632 INFO:teuthology.orchestra.run.smithi196.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-19T13:38:53.632 INFO:teuthology.orchestra.run.smithi196.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-19T13:38:53.648 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-19T13:38:53.665 INFO:teuthology.orchestra.run.smithi196.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-19T13:38:53.666 INFO:teuthology.orchestra.run.smithi196.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-19T13:38:53.666 INFO:teuthology.orchestra.run.smithi196.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-19T13:38:53.792 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-19T13:38:54.113 INFO:teuthology.orchestra.run.smithi196.stdout:Fetched 10.4 MB in 1s (8,762 kB/s) 2024-09-19T13:38:54.197 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-19T13:38:54.274 INFO:teuthology.orchestra.run.smithi196.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176264 files and directories currently installed.) 2024-09-19T13:38:54.280 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-19T13:38:54.321 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-19T13:38:54.541 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-19T13:38:54.557 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-19T13:38:54.590 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-19T13:38:54.810 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-19T13:38:54.827 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-19T13:38:54.851 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-19T13:38:54.868 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-19T13:38:55.121 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-19T13:38:55.149 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-19T13:38:55.187 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-19T13:38:55.431 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-19T13:38:55.448 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-19T13:38:55.481 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-19T13:38:55.511 INFO:teuthology.orchestra.run.smithi153.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-19T13:38:55.515 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-19T13:38:55.572 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-19T13:38:55.784 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-09-19T13:38:55.786 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-09-19T13:38:55.810 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-19T13:38:55.839 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-19T13:38:55.877 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-19T13:38:55.983 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T13:38:55.983 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T13:38:55.983 INFO:teuthology.orchestra.run.smithi153.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T13:38:55.984 INFO:teuthology.orchestra.run.smithi153.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T13:38:55.984 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-19T13:38:55.984 INFO:teuthology.orchestra.run.smithi153.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-19T13:38:55.984 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T13:38:55.985 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2024-09-19T13:38:55.985 INFO:teuthology.orchestra.run.smithi153.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-19T13:38:55.985 INFO:teuthology.orchestra.run.smithi153.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-19T13:38:55.985 INFO:teuthology.orchestra.run.smithi153.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-19T13:38:55.985 INFO:teuthology.orchestra.run.smithi153.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-19T13:38:55.985 INFO:teuthology.orchestra.run.smithi153.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-19T13:38:55.985 INFO:teuthology.orchestra.run.smithi153.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-19T13:38:55.987 INFO:teuthology.orchestra.run.smithi153.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-19T13:38:55.987 INFO:teuthology.orchestra.run.smithi153.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-19T13:38:55.987 INFO:teuthology.orchestra.run.smithi153.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-19T13:38:55.987 INFO:teuthology.orchestra.run.smithi153.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-19T13:38:55.987 INFO:teuthology.orchestra.run.smithi153.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-19T13:38:55.987 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2024-09-19T13:38:55.987 INFO:teuthology.orchestra.run.smithi153.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-19T13:38:55.987 INFO:teuthology.orchestra.run.smithi153.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-19T13:38:55.988 INFO:teuthology.orchestra.run.smithi153.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-19T13:38:55.988 INFO:teuthology.orchestra.run.smithi153.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-19T13:38:55.988 INFO:teuthology.orchestra.run.smithi153.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-19T13:38:56.025 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2024-09-19T13:38:56.026 INFO:teuthology.orchestra.run.smithi153.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-19T13:38:56.026 INFO:teuthology.orchestra.run.smithi153.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-19T13:38:56.026 INFO:teuthology.orchestra.run.smithi153.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-19T13:38:56.026 INFO:teuthology.orchestra.run.smithi153.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-19T13:38:56.026 INFO:teuthology.orchestra.run.smithi153.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-19T13:38:56.026 INFO:teuthology.orchestra.run.smithi153.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-19T13:38:56.027 INFO:teuthology.orchestra.run.smithi153.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-19T13:38:56.027 INFO:teuthology.orchestra.run.smithi153.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-19T13:38:56.027 INFO:teuthology.orchestra.run.smithi153.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-19T13:38:56.027 INFO:teuthology.orchestra.run.smithi153.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-19T13:38:56.027 INFO:teuthology.orchestra.run.smithi153.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-19T13:38:56.027 INFO:teuthology.orchestra.run.smithi153.stdout: s3cmd 2024-09-19T13:38:56.130 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-19T13:38:56.157 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-19T13:38:56.196 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-19T13:38:56.207 INFO:teuthology.orchestra.run.smithi153.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-19T13:38:56.207 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 10.4 MB of archives. 2024-09-19T13:38:56.207 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-19T13:38:56.207 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-19T13:38:56.289 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-19T13:38:56.289 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-19T13:38:56.306 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-19T13:38:56.457 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-19T13:38:56.468 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-19T13:38:56.473 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-19T13:38:56.515 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-19T13:38:56.541 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-19T13:38:56.547 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-19T13:38:56.681 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-19T13:38:56.759 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-19T13:38:56.773 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-19T13:38:56.774 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-19T13:38:56.775 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-19T13:38:56.777 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-19T13:38:56.809 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-19T13:38:56.921 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-19T13:38:56.922 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-19T13:38:56.962 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-19T13:38:56.962 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-19T13:38:56.964 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-19T13:38:56.965 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-19T13:38:56.966 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-19T13:38:56.971 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-19T13:38:56.974 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-19T13:38:57.018 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-19T13:38:57.020 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-19T13:38:57.045 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libjsr305-java. 2024-09-19T13:38:57.061 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-19T13:38:57.071 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-19T13:38:57.072 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-19T13:38:57.072 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-19T13:38:57.073 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-19T13:38:57.074 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-19T13:38:57.101 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-19T13:38:57.103 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-19T13:38:57.110 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-19T13:38:57.115 INFO:teuthology.orchestra.run.smithi153.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-19T13:38:57.180 INFO:teuthology.orchestra.run.smithi153.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-19T13:38:57.181 INFO:teuthology.orchestra.run.smithi153.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-19T13:38:57.214 INFO:teuthology.orchestra.run.smithi153.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-19T13:38:57.214 INFO:teuthology.orchestra.run.smithi153.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-19T13:38:57.215 INFO:teuthology.orchestra.run.smithi153.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-19T13:38:57.356 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libguava-java. 2024-09-19T13:38:57.384 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-19T13:38:57.422 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-19T13:38:57.660 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 10.4 MB in 1s (8,774 kB/s) 2024-09-19T13:38:57.739 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-19T13:38:57.807 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176264 files and directories currently installed.) 2024-09-19T13:38:57.813 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-19T13:38:57.842 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-19T13:38:57.855 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-19T13:38:57.870 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-19T13:38:57.908 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-19T13:38:58.100 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-19T13:38:58.116 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-19T13:38:58.160 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libguice-java. 2024-09-19T13:38:58.166 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-19T13:38:58.177 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-19T13:38:58.211 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-19T13:38:58.402 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-19T13:38:58.419 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-19T13:38:58.461 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-19T13:38:58.548 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-19T13:38:58.576 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-19T13:38:58.606 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-19T13:38:58.730 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-19T13:38:58.746 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-19T13:38:58.780 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-19T13:38:58.842 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-19T13:38:58.858 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-19T13:38:58.900 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-19T13:38:59.007 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-19T13:38:59.025 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-19T13:38:59.066 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-19T13:38:59.161 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libjansi-java. 2024-09-19T13:38:59.189 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-19T13:38:59.228 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-19T13:38:59.335 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-19T13:38:59.363 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-19T13:38:59.402 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-19T13:38:59.480 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-19T13:38:59.508 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-19T13:38:59.546 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-19T13:38:59.646 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-19T13:38:59.674 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-19T13:38:59.712 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-19T13:38:59.782 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-19T13:38:59.798 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-19T13:38:59.832 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-19T13:38:59.931 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-19T13:38:59.948 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-19T13:38:59.990 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-19T13:39:00.110 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-19T13:39:00.126 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-19T13:39:00.168 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-19T13:39:00.301 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-19T13:39:00.329 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-19T13:39:00.367 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-19T13:39:00.438 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-19T13:39:00.466 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-19T13:39:00.504 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-19T13:39:00.619 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjsr305-java. 2024-09-19T13:39:00.636 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-19T13:39:00.678 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-19T13:39:00.910 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-19T13:39:00.923 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libguava-java. 2024-09-19T13:39:00.926 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-19T13:39:00.950 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-19T13:39:00.967 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-19T13:39:00.980 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-19T13:39:01.220 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-19T13:39:01.237 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-19T13:39:01.270 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-19T13:39:01.400 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-19T13:39:01.416 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-19T13:39:01.458 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-19T13:39:01.472 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-19T13:39:01.489 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-19T13:39:01.531 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-19T13:39:01.711 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libguice-java. 2024-09-19T13:39:01.739 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-19T13:39:01.777 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-19T13:39:01.783 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-19T13:39:01.800 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-19T13:39:01.841 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-19T13:39:02.102 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-19T13:39:02.119 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-19T13:39:02.161 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-19T13:39:02.241 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-19T13:39:02.269 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-19T13:39:02.307 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-19T13:39:02.405 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-19T13:39:02.421 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-19T13:39:02.463 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-19T13:39:02.577 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-19T13:39:02.605 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-19T13:39:02.643 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-19T13:39:02.682 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libslf4j-java. 2024-09-19T13:39:02.698 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-19T13:39:02.732 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-19T13:39:02.896 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjansi-java. 2024-09-19T13:39:02.924 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-19T13:39:02.962 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-19T13:39:02.994 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-19T13:39:03.010 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-19T13:39:03.052 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-19T13:39:03.173 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-19T13:39:03.189 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-19T13:39:03.223 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-19T13:39:03.340 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-19T13:39:03.354 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-19T13:39:03.396 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-19T13:39:03.467 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-19T13:39:03.484 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-19T13:39:03.526 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-19T13:39:03.649 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-19T13:39:03.666 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-19T13:39:03.724 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-19T13:39:03.804 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-19T13:39:03.819 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-19T13:39:03.861 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-19T13:39:04.078 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-19T13:39:04.094 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-19T13:39:04.114 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-19T13:39:04.128 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-19T13:39:04.142 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-19T13:39:04.181 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-19T13:39:04.372 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-19T13:39:04.400 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-19T13:39:04.438 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-19T13:39:04.476 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-19T13:39:04.505 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-19T13:39:04.543 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-19T13:39:04.804 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-19T13:39:04.832 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-19T13:39:04.870 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-19T13:39:04.900 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package maven. 2024-09-19T13:39:04.928 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-19T13:39:04.966 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking maven (3.6.3-5) ... 2024-09-19T13:39:05.106 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-19T13:39:05.122 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-19T13:39:05.164 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-19T13:39:05.261 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package python3-magic. 2024-09-19T13:39:05.289 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-19T13:39:05.328 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-19T13:39:05.425 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-19T13:39:05.441 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-19T13:39:05.483 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-19T13:39:05.597 INFO:teuthology.orchestra.run.smithi196.stdout:Selecting previously unselected package s3cmd. 2024-09-19T13:39:05.626 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-19T13:39:05.663 INFO:teuthology.orchestra.run.smithi196.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-19T13:39:05.694 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-19T13:39:05.711 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-19T13:39:05.752 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-19T13:39:06.038 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-19T13:39:06.051 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-19T13:39:06.066 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-19T13:39:06.105 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-19T13:39:06.178 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-19T13:39:06.343 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-19T13:39:06.357 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libslf4j-java. 2024-09-19T13:39:06.374 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-19T13:39:06.418 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-19T13:39:06.430 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-19T13:39:06.564 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-19T13:39:06.665 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-19T13:39:06.704 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-19T13:39:06.719 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-19T13:39:06.753 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-19T13:39:06.766 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-19T13:39:06.875 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-19T13:39:07.002 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-19T13:39:07.022 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-19T13:39:07.039 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-19T13:39:07.072 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-19T13:39:07.136 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-19T13:39:07.262 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-19T13:39:07.350 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-19T13:39:07.379 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-19T13:39:07.387 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-19T13:39:07.416 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-19T13:39:07.513 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-19T13:39:07.642 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-19T13:39:07.748 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-19T13:39:07.787 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-19T13:39:07.816 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-19T13:39:07.854 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-19T13:39:07.874 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-19T13:39:08.107 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-19T13:39:08.125 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-19T13:39:08.134 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-19T13:39:08.173 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-19T13:39:08.251 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-19T13:39:08.378 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-19T13:39:08.503 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-19T13:39:08.584 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package maven. 2024-09-19T13:39:08.613 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-19T13:39:08.613 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-19T13:39:08.642 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking maven (3.6.3-5) ... 2024-09-19T13:39:08.714 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-19T13:39:08.815 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-19T13:39:09.038 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-magic. 2024-09-19T13:39:09.060 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-19T13:39:09.104 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-19T13:39:09.107 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-19T13:39:09.217 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-19T13:39:09.343 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libguava-java (29.0-6) ... 2024-09-19T13:39:09.432 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package s3cmd. 2024-09-19T13:39:09.454 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-19T13:39:09.469 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-19T13:39:09.498 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-19T13:39:09.595 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-19T13:39:09.738 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-19T13:39:09.864 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-19T13:39:09.870 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-19T13:39:09.979 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-19T13:39:09.989 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-19T13:39:10.088 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-19T13:39:10.090 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-19T13:39:10.191 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-19T13:39:10.214 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-19T13:39:10.301 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-19T13:39:10.340 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-19T13:39:10.426 INFO:teuthology.orchestra.run.smithi196.stdout:Setting up maven (3.6.3-5) ... 2024-09-19T13:39:10.466 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-19T13:39:10.592 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-19T13:39:10.685 INFO:teuthology.orchestra.run.smithi196.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-19T13:39:10.726 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-19T13:39:10.756 INFO:teuthology.orchestra.run.smithi196.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-19T13:39:10.852 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-19T13:39:10.961 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-19T13:39:11.070 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-19T13:39:11.180 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-19T13:39:11.306 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-19T13:39:11.432 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-19T13:39:11.558 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-19T13:39:11.683 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-19T13:39:11.952 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-19T13:39:12.086 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-19T13:39:12.204 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-19T13:39:12.381 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-19T13:39:12.391 INFO:teuthology.orchestra.run.smithi196.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-19T13:39:12.396 DEBUG:teuthology.parallel:result is None 2024-09-19T13:39:12.532 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-19T13:39:12.658 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-19T13:39:12.784 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-19T13:39:13.094 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-19T13:39:13.211 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-19T13:39:13.329 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libguava-java (29.0-6) ... 2024-09-19T13:39:13.430 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-19T13:39:13.556 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-19T13:39:13.681 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-19T13:39:13.807 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-19T13:39:13.942 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-19T13:39:14.143 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-19T13:39:14.269 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-19T13:39:14.403 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-19T13:39:14.512 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up maven (3.6.3-5) ... 2024-09-19T13:39:14.769 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-19T13:39:14.825 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-19T13:39:16.206 INFO:teuthology.orchestra.run.smithi153.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-19T13:39:16.210 DEBUG:teuthology.parallel:result is None 2024-09-19T13:39:16.211 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:39:16.373 DEBUG:teuthology.orchestra.run.smithi153:> dpkg-query -W -f '${Version}' ceph 2024-09-19T13:39:16.392 INFO:teuthology.orchestra.run.smithi153.stdout:19.3.0-5012-g08af21e0-1jammy 2024-09-19T13:39:16.392 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5012-g08af21e0-1jammy 2024-09-19T13:39:16.393 INFO:teuthology.task.install:The correct ceph version 19.3.0-5012-g08af21e0-1jammy is installed. 2024-09-19T13:39:16.394 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:39:16.542 DEBUG:teuthology.orchestra.run.smithi196:> dpkg-query -W -f '${Version}' ceph 2024-09-19T13:39:16.561 INFO:teuthology.orchestra.run.smithi196.stdout:19.3.0-5012-g08af21e0-1jammy 2024-09-19T13:39:16.561 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5012-g08af21e0-1jammy 2024-09-19T13:39:16.561 INFO:teuthology.task.install:The correct ceph version 19.3.0-5012-g08af21e0-1jammy is installed. 2024-09-19T13:39:16.563 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T13:39:16.564 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:39:16.564 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T13:39:16.581 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-19T13:39:16.581 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T13:39:16.619 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T13:39:16.620 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:39:16.620 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T13:39:16.634 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T13:39:16.686 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-19T13:39:16.686 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T13:39:16.699 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T13:39:16.754 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T13:39:16.754 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:39:16.754 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T13:39:16.768 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T13:39:16.822 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-19T13:39:16.822 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T13:39:16.835 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T13:39:16.889 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T13:39:16.889 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:39:16.889 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T13:39:16.902 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T13:39:16.962 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-19T13:39:16.962 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T13:39:16.974 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T13:39:17.029 INFO:teuthology.run_tasks:Running task ceph... 2024-09-19T13:39:17.122 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-19T13:39:17.122 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /var/log/ceph 2024-09-19T13:39:17.125 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 777 /var/log/ceph 2024-09-19T13:39:17.137 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-19T13:39:17.137 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-19T13:39:17.180 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-19T13:39:17.192 INFO:tasks.ceph:Creating extra log directories... 2024-09-19T13:39:17.192 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-19T13:39:17.232 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-19T13:39:17.257 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-19T13:39:17.257 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-19T13:39:17.257 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912477', 'branch': 'wip-yuval-test', 'description': 'rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7912477', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuval-test'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'ec-data-pool': True, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuval-test', 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'}}, 'owner': 'scheduled_yuvalif@teuthology', 'priority': 50, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 4251, 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754', 'sleep_before_teardown': 0, 'subset': '1/3', 'suite': 'rgw', 'suite_branch': 'wip-yuval-test', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_08af21e0d16078b88ddf808fe9ba2ab84dbe6754/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754', 'targets': {'smithi153.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEguNgJFyXfkHRaml1HeE5UuWPsNwvTWTUH99/1dIFvb8HFRbnc6vsq5ISoY+idp05uI024G12I+Y5fwf5lLDQI=', 'smithi196.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGOF+XNEuP5uKim6VdZGOdOkAsxCYZJtXQTJXyJbDWYxrS2+V/aVOS23mxL00WBzycbvxVBujaz/OLPBb7bkyQ4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-19_13:09:30', 'tube': 'smithi', 'user': 'yuvalif', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-19T13:39:17.258 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-19T13:39:17.288 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-19T13:39:17.294 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/run/ceph 2024-09-19T13:39:17.336 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/run/ceph 2024-09-19T13:39:17.349 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:39:17.349 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T13:39:17.396 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T13:39:17.396 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2024-09-19T13:39:17.443 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T13:39:17.444 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T13:39:17.444 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 877 Links: 1 2024-09-19T13:39:17.444 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T13:39:17.444 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-19 13:33:29.047454502 +0000 2024-09-19T13:39:17.444 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-19 13:33:28.811456610 +0000 2024-09-19T13:39:17.444 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-19 13:33:28.811456610 +0000 2024-09-19T13:39:17.444 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-09-19T13:39:17.444 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T13:39:17.502 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-19T13:39:17.502 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-19T13:39:17.502 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000388686 s, 1.3 MB/s 2024-09-19T13:39:17.503 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T13:39:17.552 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2024-09-19T13:39:17.599 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T13:39:17.599 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T13:39:17.599 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-09-19T13:39:17.599 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T13:39:17.599 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-19 13:33:29.543450071 +0000 2024-09-19T13:39:17.600 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-19 13:33:29.291452322 +0000 2024-09-19T13:39:17.600 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-19 13:33:29.291452322 +0000 2024-09-19T13:39:17.600 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-09-19T13:39:17.600 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T13:39:17.654 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-19T13:39:17.654 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-19T13:39:17.654 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.00035425 s, 1.4 MB/s 2024-09-19T13:39:17.655 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T13:39:17.704 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2024-09-19T13:39:17.751 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T13:39:17.751 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T13:39:17.751 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-09-19T13:39:17.751 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T13:39:17.751 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-19 13:33:30.027445748 +0000 2024-09-19T13:39:17.751 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-19 13:33:29.783447927 +0000 2024-09-19T13:39:17.751 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-19 13:33:29.783447927 +0000 2024-09-19T13:39:17.752 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-09-19T13:39:17.752 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T13:39:17.805 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-19T13:39:17.805 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-19T13:39:17.805 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000429383 s, 1.2 MB/s 2024-09-19T13:39:17.806 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T13:39:17.857 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2024-09-19T13:39:17.903 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T13:39:17.903 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T13:39:17.903 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-09-19T13:39:17.903 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T13:39:17.903 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2024-09-19 13:33:30.519441354 +0000 2024-09-19T13:39:17.904 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2024-09-19 13:33:30.267443604 +0000 2024-09-19T13:39:17.904 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2024-09-19 13:33:30.267443604 +0000 2024-09-19T13:39:17.904 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2024-09-19T13:39:17.904 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T13:39:17.957 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2024-09-19T13:39:17.957 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2024-09-19T13:39:17.957 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000325451 s, 1.6 MB/s 2024-09-19T13:39:17.959 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T13:39:18.008 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T13:39:18.008 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-19T13:39:18.008 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T13:39:18.014 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T13:39:18.015 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_1 2024-09-19T13:39:18.063 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T13:39:18.063 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T13:39:18.063 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-09-19T13:39:18.063 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T13:39:18.063 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-09-19 13:33:31.416834125 +0000 2024-09-19T13:39:18.063 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-09-19 13:33:31.188836161 +0000 2024-09-19T13:39:18.063 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-09-19 13:33:31.188836161 +0000 2024-09-19T13:39:18.063 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2024-09-19T13:39:18.063 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T13:39:18.117 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-09-19T13:39:18.117 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-09-19T13:39:18.117 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000444833 s, 1.2 MB/s 2024-09-19T13:39:18.118 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T13:39:18.167 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_2 2024-09-19T13:39:18.214 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T13:39:18.214 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T13:39:18.214 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 901 Links: 1 2024-09-19T13:39:18.214 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T13:39:18.215 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-09-19 13:33:31.916829659 +0000 2024-09-19T13:39:18.215 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-09-19 13:33:31.652832017 +0000 2024-09-19T13:39:18.215 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-09-19 13:33:31.652832017 +0000 2024-09-19T13:39:18.215 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2024-09-19T13:39:18.215 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T13:39:18.268 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-09-19T13:39:18.268 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-09-19T13:39:18.268 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000337425 s, 1.5 MB/s 2024-09-19T13:39:18.269 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T13:39:18.319 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_3 2024-09-19T13:39:18.366 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T13:39:18.366 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T13:39:18.366 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 922 Links: 1 2024-09-19T13:39:18.366 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T13:39:18.366 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-09-19 13:33:32.376825549 +0000 2024-09-19T13:39:18.367 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-09-19 13:33:32.132827730 +0000 2024-09-19T13:39:18.367 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-09-19 13:33:32.132827730 +0000 2024-09-19T13:39:18.367 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2024-09-19T13:39:18.367 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T13:39:18.420 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-09-19T13:39:18.420 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-09-19T13:39:18.420 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.00033321 s, 1.5 MB/s 2024-09-19T13:39:18.421 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T13:39:18.471 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_4 2024-09-19T13:39:18.518 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T13:39:18.518 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T13:39:18.518 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 934 Links: 1 2024-09-19T13:39:18.518 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T13:39:18.518 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-09-19 13:33:32.616823407 +0000 2024-09-19T13:39:18.518 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-09-19 13:33:32.612823441 +0000 2024-09-19T13:39:18.518 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-09-19 13:33:32.612823441 +0000 2024-09-19T13:39:18.518 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: - 2024-09-19T13:39:18.519 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T13:39:18.572 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-09-19T13:39:18.572 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-09-19T13:39:18.572 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000404483 s, 1.3 MB/s 2024-09-19T13:39:18.574 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T13:39:18.623 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T13:39:18.624 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-19T13:39:18.624 INFO:tasks.ceph:Generating config... 2024-09-19T13:39:18.625 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-19T13:39:18.625 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-19T13:39:18.626 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-19T13:39:18.626 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-19T13:39:18.626 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-19T13:39:18.626 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-19T13:39:18.626 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-09-19T13:39:18.626 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-09-19T13:39:18.626 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-19T13:39:18.626 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-19T13:39:18.626 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-19T13:39:18.626 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-19T13:39:18.626 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-19T13:39:18.626 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-19T13:39:18.627 INFO:tasks.ceph:[client] setuser = ceph 2024-09-19T13:39:18.627 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-19T13:39:18.627 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-19T13:39:18.627 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-09-19T13:39:18.627 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-19T13:39:18.627 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-19T13:39:18.627 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-19T13:39:18.627 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-19T13:39:18.627 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-19T13:39:18.627 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-19T13:39:18.627 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-19T13:39:18.627 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-19T13:39:18.628 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-19T13:39:18.628 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-19T13:39:18.628 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-19T13:39:18.628 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-19T13:39:18.628 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-19T13:39:18.628 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-19T13:39:18.628 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-19T13:39:18.628 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-19T13:39:18.628 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-19T13:39:18.628 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-19T13:39:18.628 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-19T13:39:18.628 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-19T13:39:18.629 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-19T13:39:18.629 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-19T13:39:18.629 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-19T13:39:18.629 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-19T13:39:18.629 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-19T13:39:18.629 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-19T13:39:18.629 INFO:tasks.ceph:Setting up mon.a... 2024-09-19T13:39:18.629 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-19T13:39:18.664 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.keyring 2024-09-19T13:39:18.679 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-19T13:39:18.759 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T13:39:18.814 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.153'), ('mon.c', '[v2:172.21.15.153:3301,v1:172.21.15.153:6790]'), ('mon.b', '172.21.15.196')] 2024-09-19T13:39:18.814 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.153,[v2:172.21.15.153:3301,v1:172.21.15.153:6790],172.21.15.196', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-19T13:39:18.815 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:39:18.815 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-19T13:39:18.865 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.153 --addv c '[v2:172.21.15.153:3301,v1:172.21.15.153:6790]' --add b 172.21.15.196 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:39:18.949 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:39:18.949 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:39:18.950 INFO:teuthology.orchestra.run.smithi153.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:39:18.950 INFO:teuthology.orchestra.run.smithi153.stdout:monmaptool: generated fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T13:39:18.950 INFO:teuthology.orchestra.run.smithi153.stdout:setting min_mon_release = quincy 2024-09-19T13:39:18.950 INFO:teuthology.orchestra.run.smithi153.stdout:epoch 0 2024-09-19T13:39:18.950 INFO:teuthology.orchestra.run.smithi153.stdout:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T13:39:18.950 INFO:teuthology.orchestra.run.smithi153.stdout:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T13:39:18.950 INFO:teuthology.orchestra.run.smithi153.stdout:created 2024-09-19T13:39:18.951178+0000 2024-09-19T13:39:18.950 INFO:teuthology.orchestra.run.smithi153.stdout:min_mon_release 17 (quincy) 2024-09-19T13:39:18.951 INFO:teuthology.orchestra.run.smithi153.stdout:election_strategy: 1 2024-09-19T13:39:18.951 INFO:teuthology.orchestra.run.smithi153.stdout:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T13:39:18.951 INFO:teuthology.orchestra.run.smithi153.stdout:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T13:39:18.951 INFO:teuthology.orchestra.run.smithi153.stdout:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T13:39:18.951 INFO:teuthology.orchestra.run.smithi153.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-19T13:39:18.952 DEBUG:teuthology.orchestra.run.smithi153:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-19T13:39:18.999 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05... 2024-09-19T13:39:19.000 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-19T13:39:19.044 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-19T13:39:19.071 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2024-09-19T13:39:19.072 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2024-09-19T13:39:19.072 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-19T13:39:19.072 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2024-09-19T13:39:19.072 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.072 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2024-09-19T13:39:19.072 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.072 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2024-09-19T13:39:19.072 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.072 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2024-09-19T13:39:19.072 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2024-09-19T13:39:19.072 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.072 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2024-09-19T13:39:19.073 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2024-09-19T13:39:19.073 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.073 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-19T13:39:19.073 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2024-09-19T13:39:19.073 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.073 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2024-09-19T13:39:19.073 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-19T13:39:19.073 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.073 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2024-09-19T13:39:19.073 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.073 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2024-09-19T13:39:19.073 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2024-09-19T13:39:19.073 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2024-09-19T13:39:19.073 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2024-09-19T13:39:19.074 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2024-09-19T13:39:19.074 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2024-09-19T13:39:19.074 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2024-09-19T13:39:19.074 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-19T13:39:19.074 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-19T13:39:19.074 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2024-09-19T13:39:19.074 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.074 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-19T13:39:19.074 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.074 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2024-09-19T13:39:19.074 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.074 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2024-09-19T13:39:19.074 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.074 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2024-09-19T13:39:19.075 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2024-09-19T13:39:19.075 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2024-09-19T13:39:19.075 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.153,[v2:172.21.15.153:3301,v1:172.21.15.153:6790],172.21.15.196" 2024-09-19T13:39:19.075 INFO:teuthology.orchestra.run.smithi153.stdout: mon client directed command retry = 5 2024-09-19T13:39:19.075 INFO:teuthology.orchestra.run.smithi153.stdout: ms inject socket failures = 5000 2024-09-19T13:39:19.075 INFO:teuthology.orchestra.run.smithi153.stdout: osd heartbeat grace = 40 2024-09-19T13:39:19.075 INFO:teuthology.orchestra.run.smithi153.stdout: osd_max_pg_log_entries = 10 2024-09-19T13:39:19.075 INFO:teuthology.orchestra.run.smithi153.stdout: osd_min_pg_log_entries = 10 2024-09-19T13:39:19.075 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T13:39:19.075 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.075 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2024-09-19T13:39:19.075 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2024-09-19T13:39:19.075 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.075 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2024-09-19T13:39:19.076 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2024-09-19T13:39:19.076 INFO:teuthology.orchestra.run.smithi153.stdout: osd mclock profile = high_recovery_ops 2024-09-19T13:39:19.076 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.076 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2024-09-19T13:39:19.076 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2024-09-19T13:39:19.076 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.076 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2024-09-19T13:39:19.076 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2024-09-19T13:39:19.076 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2024-09-19T13:39:19.076 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug trim objects = true 2024-09-19T13:39:19.076 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.076 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2024-09-19T13:39:19.076 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2024-09-19T13:39:19.076 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.077 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2024-09-19T13:39:19.077 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.077 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2024-09-19T13:39:19.077 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.077 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2024-09-19T13:39:19.077 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.077 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2024-09-19T13:39:19.077 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2024-09-19T13:39:19.077 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.077 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2024-09-19T13:39:19.077 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2024-09-19T13:39:19.077 INFO:teuthology.orchestra.run.smithi153.stdout: bdev async discard = True 2024-09-19T13:39:19.077 INFO:teuthology.orchestra.run.smithi153.stdout: bdev enable discard = True 2024-09-19T13:39:19.077 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore allocator = bitmap 2024-09-19T13:39:19.078 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2024-09-19T13:39:19.078 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2024-09-19T13:39:19.078 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 1/20 2024-09-19T13:39:19.078 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 1/20 2024-09-19T13:39:19.078 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-19T13:39:19.078 INFO:teuthology.orchestra.run.smithi153.stdout: debug objclass = 20 2024-09-19T13:39:19.078 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2024-09-19T13:39:19.078 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 4/10 2024-09-19T13:39:19.078 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2024-09-19T13:39:19.078 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2024-09-19T13:39:19.078 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2024-09-19T13:39:19.078 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2024-09-19T13:39:19.078 INFO:teuthology.orchestra.run.smithi153.stdout: osd fast shutdown = False 2024-09-19T13:39:19.078 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2024-09-19T13:39:19.079 INFO:teuthology.orchestra.run.smithi153.stdout: osd shutdown pgref assert = True 2024-09-19T13:39:19.079 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.079 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2024-09-19T13:39:19.079 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-19T13:39:19.079 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2024-09-19T13:39:19.079 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-09-19T13:39:19.079 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-09-19T13:39:19.079 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-09-19T13:39:19.079 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-09-19T13:39:19.079 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2024-09-19T13:39:19.079 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.079 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2024-09-19T13:39:19.079 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2024-09-19T13:39:19.079 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2024-09-19T13:39:19.079 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2024-09-19T13:39:19.080 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2024-09-19T13:39:19.080 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2024-09-19T13:39:19.080 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2024-09-19T13:39:19.080 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2024-09-19T13:39:19.080 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2024-09-19T13:39:19.080 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2024-09-19T13:39:19.080 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2024-09-19T13:39:19.080 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.080 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-19T13:39:19.080 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2024-09-19T13:39:19.080 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2024-09-19T13:39:19.080 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.080 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2024-09-19T13:39:19.080 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-19T13:39:19.080 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-19T13:39:19.081 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.081 INFO:teuthology.orchestra.run.smithi153.stdout: # 1m isn't quite enough 2024-09-19T13:39:19.081 INFO:teuthology.orchestra.run.smithi153.stdout: mon_down_mkfs_grace = 2m 2024-09-19T13:39:19.081 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.081 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_filestore_osds = false 2024-09-19T13:39:19.081 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd crush smoke test = False 2024-09-19T13:39:19.081 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:39:19.081 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2024-09-19T13:39:19.081 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2024-09-19T13:39:19.081 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2024-09-19T13:39:19.081 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2024-09-19T13:39:19.081 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-19T13:39:19.081 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-19T13:39:19.081 INFO:teuthology.orchestra.run.smithi153.stdout: debug rgw = 20 2024-09-19T13:39:19.082 INFO:teuthology.orchestra.run.smithi153.stdout: debug rgw notification = 20 2024-09-19T13:39:19.082 INFO:teuthology.orchestra.run.smithi153.stdout: rgw bucket counters cache = True 2024-09-19T13:39:19.082 INFO:teuthology.orchestra.run.smithi153.stdout: rgw crypt require ssl = False 2024-09-19T13:39:19.082 INFO:teuthology.orchestra.run.smithi153.stdout: rgw crypt s3 kms backend = testing 2024-09-19T13:39:19.082 INFO:teuthology.orchestra.run.smithi153.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-19T13:39:19.082 INFO:teuthology.orchestra.run.smithi153.stdout: rgw max chunk size = 4194304 2024-09-19T13:39:19.082 INFO:teuthology.orchestra.run.smithi153.stdout: rgw obj stripe size = 6291456 2024-09-19T13:39:19.082 INFO:teuthology.orchestra.run.smithi153.stdout: rgw reshard progress judge interval = 10 2024-09-19T13:39:19.082 INFO:teuthology.orchestra.run.smithi153.stdout: rgw s3 auth use sts = True 2024-09-19T13:39:19.082 INFO:teuthology.orchestra.run.smithi153.stdout: rgw sts key = abcdefghijklmnop 2024-09-19T13:39:19.082 INFO:teuthology.orchestra.run.smithi153.stdout: rgw torrent flag = True 2024-09-19T13:39:19.082 INFO:teuthology.orchestra.run.smithi153.stdout: rgw user counters cache = True 2024-09-19T13:39:19.082 INFO:teuthology.orchestra.run.smithi153.stdout: setgroup = ceph 2024-09-19T13:39:19.082 INFO:teuthology.orchestra.run.smithi153.stdout: setuser = ceph 2024-09-19T13:39:19.082 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2024-09-19T13:39:19.083 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2024-09-19T13:39:19.083 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2024-09-19T13:39:19.083 INFO:teuthology.orchestra.run.smithi196.stdout:[global] 2024-09-19T13:39:19.083 INFO:teuthology.orchestra.run.smithi196.stdout: chdir = "" 2024-09-19T13:39:19.083 INFO:teuthology.orchestra.run.smithi196.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-19T13:39:19.083 INFO:teuthology.orchestra.run.smithi196.stdout: auth supported = cephx 2024-09-19T13:39:19.083 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.084 INFO:teuthology.orchestra.run.smithi196.stdout: filestore xattr use omap = true 2024-09-19T13:39:19.084 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.084 INFO:teuthology.orchestra.run.smithi196.stdout: mon clock drift allowed = 1.000 2024-09-19T13:39:19.084 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.084 INFO:teuthology.orchestra.run.smithi196.stdout: osd crush chooseleaf type = 0 2024-09-19T13:39:19.084 INFO:teuthology.orchestra.run.smithi196.stdout: auth debug = true 2024-09-19T13:39:19.084 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.084 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on old message = true 2024-09-19T13:39:19.084 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on bug = true 2024-09-19T13:39:19.084 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.084 INFO:teuthology.orchestra.run.smithi196.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-19T13:39:19.084 INFO:teuthology.orchestra.run.smithi196.stdout: mon pg warn max object skew = 0 2024-09-19T13:39:19.084 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.084 INFO:teuthology.orchestra.run.smithi196.stdout: # disable pg_autoscaler by default for new pools 2024-09-19T13:39:19.085 INFO:teuthology.orchestra.run.smithi196.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-19T13:39:19.085 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.085 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default size = 2 2024-09-19T13:39:19.085 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.085 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow primary affinity = true 2024-09-19T13:39:19.085 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow pg remap = true 2024-09-19T13:39:19.085 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on legacy crush tunables = false 2024-09-19T13:39:19.085 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on crush straw calc version zero = false 2024-09-19T13:39:19.085 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on no sortbitwise = false 2024-09-19T13:39:19.085 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on osd down out interval zero = false 2024-09-19T13:39:19.086 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on too few osds = false 2024-09-19T13:39:19.086 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-19T13:39:19.086 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-19T13:39:19.086 INFO:teuthology.orchestra.run.smithi196.stdout: mon_allow_pool_size_one = true 2024-09-19T13:39:19.086 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.086 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-19T13:39:19.086 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.086 INFO:teuthology.orchestra.run.smithi196.stdout: osd default data pool replay window = 5 2024-09-19T13:39:19.086 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.086 INFO:teuthology.orchestra.run.smithi196.stdout: mon allow pool delete = true 2024-09-19T13:39:19.086 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.086 INFO:teuthology.orchestra.run.smithi196.stdout: mon cluster log file level = debug 2024-09-19T13:39:19.086 INFO:teuthology.orchestra.run.smithi196.stdout: debug asserts on shutdown = true 2024-09-19T13:39:19.086 INFO:teuthology.orchestra.run.smithi196.stdout: mon health detail to clog = false 2024-09-19T13:39:19.087 INFO:teuthology.orchestra.run.smithi196.stdout: mon host = "172.21.15.153,[v2:172.21.15.153:3301,v1:172.21.15.153:6790],172.21.15.196" 2024-09-19T13:39:19.087 INFO:teuthology.orchestra.run.smithi196.stdout: mon client directed command retry = 5 2024-09-19T13:39:19.087 INFO:teuthology.orchestra.run.smithi196.stdout: ms inject socket failures = 5000 2024-09-19T13:39:19.087 INFO:teuthology.orchestra.run.smithi196.stdout: osd heartbeat grace = 40 2024-09-19T13:39:19.087 INFO:teuthology.orchestra.run.smithi196.stdout: osd_max_pg_log_entries = 10 2024-09-19T13:39:19.087 INFO:teuthology.orchestra.run.smithi196.stdout: osd_min_pg_log_entries = 10 2024-09-19T13:39:19.087 INFO:teuthology.orchestra.run.smithi196.stdout: fsid = 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T13:39:19.087 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.087 INFO:teuthology.orchestra.run.smithi196.stdout:[osd] 2024-09-19T13:39:19.087 INFO:teuthology.orchestra.run.smithi196.stdout: osd journal size = 100 2024-09-19T13:39:19.087 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.087 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub load threshold = 5.0 2024-09-19T13:39:19.087 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub max interval = 600 2024-09-19T13:39:19.087 INFO:teuthology.orchestra.run.smithi196.stdout: osd mclock profile = high_recovery_ops 2024-09-19T13:39:19.088 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.088 INFO:teuthology.orchestra.run.smithi196.stdout: osd recover clone overlap = true 2024-09-19T13:39:19.088 INFO:teuthology.orchestra.run.smithi196.stdout: osd recovery max chunk = 1048576 2024-09-19T13:39:19.088 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.088 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug shutdown = true 2024-09-19T13:39:19.088 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug op order = true 2024-09-19T13:39:19.088 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug verify stray on activate = true 2024-09-19T13:39:19.088 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug trim objects = true 2024-09-19T13:39:19.088 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.088 INFO:teuthology.orchestra.run.smithi196.stdout: osd open classes on start = true 2024-09-19T13:39:19.088 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug pg log writeout = true 2024-09-19T13:39:19.088 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.088 INFO:teuthology.orchestra.run.smithi196.stdout: osd deep scrub update digest min age = 30 2024-09-19T13:39:19.088 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.089 INFO:teuthology.orchestra.run.smithi196.stdout: osd map max advance = 10 2024-09-19T13:39:19.089 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.089 INFO:teuthology.orchestra.run.smithi196.stdout: journal zero on create = true 2024-09-19T13:39:19.089 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.089 INFO:teuthology.orchestra.run.smithi196.stdout: filestore ondisk finisher threads = 3 2024-09-19T13:39:19.089 INFO:teuthology.orchestra.run.smithi196.stdout: filestore apply finisher threads = 3 2024-09-19T13:39:19.089 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.089 INFO:teuthology.orchestra.run.smithi196.stdout: bdev debug aio = true 2024-09-19T13:39:19.089 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug misdirected ops = true 2024-09-19T13:39:19.089 INFO:teuthology.orchestra.run.smithi196.stdout: bdev async discard = True 2024-09-19T13:39:19.089 INFO:teuthology.orchestra.run.smithi196.stdout: bdev enable discard = True 2024-09-19T13:39:19.089 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore allocator = bitmap 2024-09-19T13:39:19.089 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore block size = 96636764160 2024-09-19T13:39:19.089 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore fsck on mount = True 2024-09-19T13:39:19.089 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluefs = 1/20 2024-09-19T13:39:19.090 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluestore = 1/20 2024-09-19T13:39:19.090 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-09-19T13:39:19.090 INFO:teuthology.orchestra.run.smithi196.stdout: debug objclass = 20 2024-09-19T13:39:19.090 INFO:teuthology.orchestra.run.smithi196.stdout: debug osd = 20 2024-09-19T13:39:19.090 INFO:teuthology.orchestra.run.smithi196.stdout: debug rocksdb = 4/10 2024-09-19T13:39:19.090 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd backfillfull_ratio = 0.85 2024-09-19T13:39:19.090 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd full ratio = 0.9 2024-09-19T13:39:19.090 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd nearfull ratio = 0.8 2024-09-19T13:39:19.090 INFO:teuthology.orchestra.run.smithi196.stdout: osd failsafe full ratio = 0.95 2024-09-19T13:39:19.090 INFO:teuthology.orchestra.run.smithi196.stdout: osd fast shutdown = False 2024-09-19T13:39:19.090 INFO:teuthology.orchestra.run.smithi196.stdout: osd objectstore = bluestore 2024-09-19T13:39:19.090 INFO:teuthology.orchestra.run.smithi196.stdout: osd shutdown pgref assert = True 2024-09-19T13:39:19.090 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.090 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr] 2024-09-19T13:39:19.091 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-09-19T13:39:19.091 INFO:teuthology.orchestra.run.smithi196.stdout: debug mgr = 20 2024-09-19T13:39:19.091 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2024-09-19T13:39:19.091 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2024-09-19T13:39:19.091 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2024-09-19T13:39:19.091 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2024-09-19T13:39:19.091 INFO:teuthology.orchestra.run.smithi196.stdout: mgr/telemetry/nag = false 2024-09-19T13:39:19.091 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.091 INFO:teuthology.orchestra.run.smithi196.stdout:[mon] 2024-09-19T13:39:19.091 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-09-19T13:39:19.091 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2024-09-19T13:39:19.091 INFO:teuthology.orchestra.run.smithi196.stdout: debug paxos = 20 2024-09-19T13:39:19.091 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2024-09-19T13:39:19.091 INFO:teuthology.orchestra.run.smithi196.stdout: mon data avail warn = 5 2024-09-19T13:39:19.091 INFO:teuthology.orchestra.run.smithi196.stdout: mon mgr mkfs grace = 240 2024-09-19T13:39:19.092 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2024-09-19T13:39:19.092 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd reporter subtree level = osd 2024-09-19T13:39:19.092 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd prime pg temp = true 2024-09-19T13:39:19.092 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2024-09-19T13:39:19.092 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.092 INFO:teuthology.orchestra.run.smithi196.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-19T13:39:19.092 INFO:teuthology.orchestra.run.smithi196.stdout: auth mon ticket ttl = 660 # 11m 2024-09-19T13:39:19.092 INFO:teuthology.orchestra.run.smithi196.stdout: auth service ticket ttl = 240 # 4m 2024-09-19T13:39:19.092 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.092 INFO:teuthology.orchestra.run.smithi196.stdout: # don't complain about insecure global_id in the test suite 2024-09-19T13:39:19.092 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-19T13:39:19.092 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-19T13:39:19.092 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.092 INFO:teuthology.orchestra.run.smithi196.stdout: # 1m isn't quite enough 2024-09-19T13:39:19.093 INFO:teuthology.orchestra.run.smithi196.stdout: mon_down_mkfs_grace = 2m 2024-09-19T13:39:19.093 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.093 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_filestore_osds = false 2024-09-19T13:39:19.093 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd crush smoke test = False 2024-09-19T13:39:19.093 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-09-19T13:39:19.093 INFO:teuthology.orchestra.run.smithi196.stdout:[client] 2024-09-19T13:39:19.093 INFO:teuthology.orchestra.run.smithi196.stdout: rgw cache enabled = true 2024-09-19T13:39:19.093 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable ops log = true 2024-09-19T13:39:19.093 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable usage log = true 2024-09-19T13:39:19.093 INFO:teuthology.orchestra.run.smithi196.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-19T13:39:19.093 INFO:teuthology.orchestra.run.smithi196.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-19T13:39:19.093 INFO:teuthology.orchestra.run.smithi196.stdout: debug rgw = 20 2024-09-19T13:39:19.093 INFO:teuthology.orchestra.run.smithi196.stdout: debug rgw notification = 20 2024-09-19T13:39:19.093 INFO:teuthology.orchestra.run.smithi196.stdout: rgw bucket counters cache = True 2024-09-19T13:39:19.093 INFO:teuthology.orchestra.run.smithi196.stdout: rgw crypt require ssl = False 2024-09-19T13:39:19.094 INFO:teuthology.orchestra.run.smithi196.stdout: rgw crypt s3 kms backend = testing 2024-09-19T13:39:19.094 INFO:teuthology.orchestra.run.smithi196.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-19T13:39:19.094 INFO:teuthology.orchestra.run.smithi196.stdout: rgw max chunk size = 4194304 2024-09-19T13:39:19.094 INFO:teuthology.orchestra.run.smithi196.stdout: rgw obj stripe size = 6291456 2024-09-19T13:39:19.094 INFO:teuthology.orchestra.run.smithi196.stdout: rgw reshard progress judge interval = 10 2024-09-19T13:39:19.094 INFO:teuthology.orchestra.run.smithi196.stdout: rgw s3 auth use sts = True 2024-09-19T13:39:19.094 INFO:teuthology.orchestra.run.smithi196.stdout: rgw sts key = abcdefghijklmnop 2024-09-19T13:39:19.094 INFO:teuthology.orchestra.run.smithi196.stdout: rgw torrent flag = True 2024-09-19T13:39:19.094 INFO:teuthology.orchestra.run.smithi196.stdout: rgw user counters cache = True 2024-09-19T13:39:19.094 INFO:teuthology.orchestra.run.smithi196.stdout: setgroup = ceph 2024-09-19T13:39:19.094 INFO:teuthology.orchestra.run.smithi196.stdout: setuser = ceph 2024-09-19T13:39:19.094 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.a] 2024-09-19T13:39:19.094 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.c] 2024-09-19T13:39:19.094 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.b] 2024-09-19T13:39:19.096 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-19T13:39:19.096 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-19T13:39:19.186 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-19T13:39:19.186 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:39:19.186 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-19T13:39:19.191 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:39:19.191 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-19T13:39:19.239 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi153.front.sepia.ceph.com 2024-09-19T13:39:19.239 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:39:19.239 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-19T13:39:19.239 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T13:39:19.303 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:39:19.303 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:39:19.351 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi196.front.sepia.ceph.com 2024-09-19T13:39:19.351 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-19T13:39:19.352 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-19T13:39:19.352 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T13:39:19.375 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-19T13:39:19.375 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:39:19.422 INFO:tasks.ceph:Setting up mon nodes... 2024-09-19T13:39:19.422 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-19T13:39:19.423 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-19T13:39:19.467 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-19T13:39:19.470 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-19T13:39:19.513 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-19T13:39:19.527 INFO:tasks.ceph:Setting up mds nodes... 2024-09-19T13:39:19.527 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-19T13:39:19.527 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T13:39:19.563 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-19T13:39:19.574 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-19T13:39:19.610 INFO:teuthology.orchestra.run.smithi196.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-19T13:39:19.620 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-19T13:39:19.620 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-19T13:39:19.620 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-19T13:39:19.632 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T13:39:19.633 INFO:tasks.ceph:role: osd.0 2024-09-19T13:39:19.633 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-19T13:39:19.633 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-19T13:39:19.694 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T13:39:19.694 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T13:39:19.694 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T13:39:19.694 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-19T13:39:19.694 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T13:39:19.695 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-19T13:39:19.695 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T13:39:19.695 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-19T13:39:19.695 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T13:39:19.695 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T13:39:20.177 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-09-19T13:39:20.179 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-19T13:39:20.180 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-19T13:39:20.329 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-19T13:39:20.340 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-09-19T13:39:20.341 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T13:39:20.341 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-19T13:39:20.394 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T13:39:20.394 INFO:tasks.ceph:role: osd.1 2024-09-19T13:39:20.394 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-19T13:39:20.395 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-19T13:39:20.459 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T13:39:20.459 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T13:39:20.459 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T13:39:20.459 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-19T13:39:20.459 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T13:39:20.459 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-19T13:39:20.459 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T13:39:20.459 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-19T13:39:20.459 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T13:39:20.459 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T13:39:20.915 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-09-19T13:39:20.917 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-19T13:39:20.917 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-19T13:39:21.010 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-19T13:39:21.020 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-09-19T13:39:21.020 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T13:39:21.021 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-19T13:39:21.072 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T13:39:21.072 INFO:tasks.ceph:role: osd.2 2024-09-19T13:39:21.072 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-19T13:39:21.072 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-19T13:39:21.134 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T13:39:21.134 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T13:39:21.134 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T13:39:21.134 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-19T13:39:21.135 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T13:39:21.135 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-19T13:39:21.135 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T13:39:21.135 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-19T13:39:21.135 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T13:39:21.135 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T13:39:21.602 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-09-19T13:39:21.604 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-19T13:39:21.604 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-19T13:39:21.735 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-19T13:39:21.746 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-09-19T13:39:21.746 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T13:39:21.747 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-19T13:39:21.802 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T13:39:21.802 INFO:tasks.ceph:role: osd.3 2024-09-19T13:39:21.803 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-19T13:39:21.803 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-19T13:39:21.871 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T13:39:21.872 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T13:39:21.872 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T13:39:21.872 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-19T13:39:21.872 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T13:39:21.872 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2024-09-19T13:39:21.872 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T13:39:21.872 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-19T13:39:21.872 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T13:39:21.872 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T13:39:22.374 INFO:teuthology.orchestra.run.smithi153.stdout:Discarding blocks...Done. 2024-09-19T13:39:22.376 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2024-09-19T13:39:22.377 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-19T13:39:22.522 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-19T13:39:22.535 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T13:39:22.536 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2024-09-19T13:39:22.536 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:39:22.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:39:22.649+0000 7f4be60037c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-19T13:39:22.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:39:22.661+0000 7f4be60037c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-19T13:39:22.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:39:22.661+0000 7f4be60037c0 -1 bdev(0x55f5f00ff800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-19T13:39:22.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:39:22.661+0000 7f4be60037c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-19T13:39:25.783 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-19T13:39:25.797 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:39:25.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:39:25.873+0000 7fead835d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-19T13:39:25.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:39:25.873+0000 7fead835d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-19T13:39:25.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:39:25.873+0000 7fead835d7c0 -1 bdev(0x55663986f800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-19T13:39:25.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:39:25.873+0000 7fead835d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-19T13:39:29.014 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-19T13:39:29.071 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:39:29.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:39:29.149+0000 7f3ef75957c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-19T13:39:29.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:39:29.149+0000 7f3ef75957c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-19T13:39:29.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:39:29.149+0000 7f3ef75957c0 -1 bdev(0x55d8122a7800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-19T13:39:29.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:39:29.149+0000 7f3ef75957c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-19T13:39:32.321 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-19T13:39:32.376 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:39:32.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:39:32.453+0000 7f19e06a37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-19T13:39:32.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:39:32.453+0000 7f19e06a37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-19T13:39:32.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:39:32.453+0000 7f19e06a37c0 -1 bdev(0x561c01dfb800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-19T13:39:32.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:39:32.457+0000 7f19e06a37c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-19T13:39:35.595 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-19T13:39:35.651 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-19T13:39:35.665 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T13:39:35.665 INFO:tasks.ceph:role: osd.4 2024-09-19T13:39:35.665 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com 2024-09-19T13:39:35.666 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-19T13:39:35.729 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T13:39:35.729 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T13:39:35.729 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T13:39:35.729 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-19T13:39:35.729 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T13:39:35.729 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-09-19T13:39:35.730 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T13:39:35.730 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-19T13:39:35.730 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T13:39:35.730 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T13:39:36.219 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-09-19T13:39:36.221 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-09-19T13:39:36.221 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-19T13:39:36.375 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-19T13:39:36.386 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2024-09-19T13:39:36.386 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T13:39:36.387 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-19T13:39:36.441 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T13:39:36.441 INFO:tasks.ceph:role: osd.5 2024-09-19T13:39:36.441 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com 2024-09-19T13:39:36.441 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-19T13:39:36.506 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T13:39:36.506 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T13:39:36.506 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T13:39:36.506 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-19T13:39:36.506 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T13:39:36.506 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-09-19T13:39:36.506 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T13:39:36.506 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-19T13:39:36.507 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T13:39:36.507 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T13:39:36.962 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-09-19T13:39:36.964 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-09-19T13:39:36.964 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-19T13:39:37.049 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-19T13:39:37.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T13:39:37.107 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2024-09-19T13:39:37.107 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-19T13:39:37.163 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T13:39:37.163 INFO:tasks.ceph:role: osd.6 2024-09-19T13:39:37.163 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com 2024-09-19T13:39:37.163 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-19T13:39:37.225 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T13:39:37.226 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T13:39:37.226 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T13:39:37.226 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-19T13:39:37.226 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T13:39:37.226 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-09-19T13:39:37.226 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T13:39:37.226 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-19T13:39:37.226 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T13:39:37.226 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T13:39:37.683 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-09-19T13:39:37.983 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-09-19T13:39:37.983 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-19T13:39:38.129 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-19T13:39:38.140 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2024-09-19T13:39:38.141 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T13:39:38.141 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-19T13:39:38.197 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T13:39:38.197 INFO:tasks.ceph:role: osd.7 2024-09-19T13:39:38.198 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi196.front.sepia.ceph.com 2024-09-19T13:39:38.198 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-19T13:39:38.263 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T13:39:38.263 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T13:39:38.263 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T13:39:38.263 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-19T13:39:38.263 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T13:39:38.263 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-09-19T13:39:38.263 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T13:39:38.263 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-19T13:39:38.263 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T13:39:38.263 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T13:39:38.695 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-09-19T13:39:38.697 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-09-19T13:39:38.698 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-19T13:39:38.773 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-19T13:39:38.826 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: /sbin/restorecon: command not found 2024-09-19T13:39:38.827 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T13:39:38.827 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:39:38.954 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-19T13:39:38.954+0000 7fb587a6c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-19T13:39:38.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-19T13:39:38.954+0000 7fb587a6c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-19T13:39:38.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-19T13:39:38.954+0000 7fb587a6c7c0 -1 bdev(0x55c1294c7800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-19T13:39:38.957 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-19T13:39:38.954+0000 7fb587a6c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-19T13:39:42.079 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-19T13:39:42.093 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:39:42.172 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-19T13:39:42.170+0000 7f99c90507c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-19T13:39:42.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-19T13:39:42.170+0000 7f99c90507c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-19T13:39:42.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-19T13:39:42.170+0000 7f99c90507c0 -1 bdev(0x5634a9937800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-19T13:39:42.173 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-19T13:39:42.170+0000 7f99c90507c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-19T13:39:45.316 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-19T13:39:45.375 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:39:45.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-19T13:39:45.454+0000 7f17f01f57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-19T13:39:45.456 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-19T13:39:45.454+0000 7f17f01f57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-19T13:39:45.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-19T13:39:45.454+0000 7f17f01f57c0 -1 bdev(0x5603d8807800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-19T13:39:45.457 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-19T13:39:45.454+0000 7f17f01f57c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-19T13:39:48.598 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-19T13:39:48.655 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:39:48.735 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-19T13:39:48.734+0000 7fc562b997c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-19T13:39:48.736 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-19T13:39:48.734+0000 7fc562b997c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-19T13:39:48.736 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-19T13:39:48.734+0000 7fc562b997c0 -1 bdev(0x5591af8c3800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-19T13:39:48.736 INFO:teuthology.orchestra.run.smithi196.stderr:2024-09-19T13:39:48.734+0000 7fc562b997c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-19T13:39:51.886 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-19T13:39:51.941 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-19T13:39:51.942 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:39:51.942 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-19T13:39:51.956 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:39:51.956 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-19T13:39:52.010 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:39:52.010 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-19T13:39:52.070 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:39:52.070 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-19T13:39:52.125 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:39:52.125 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-19T13:39:52.177 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-19T13:39:52.177 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-19T13:39:52.191 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-19T13:39:52.192 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-19T13:39:52.245 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-19T13:39:52.245 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-19T13:39:52.301 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-19T13:39:52.301 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-19T13:39:52.357 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-19T13:39:52.357 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-19T13:39:52.413 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:39:52.413 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-19T13:39:52.419 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-19T13:39:52.419 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-19T13:39:52.462 INFO:tasks.ceph:Adding keys to all mons... 2024-09-19T13:39:52.462 DEBUG:teuthology.orchestra.run.smithi153:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-19T13:39:52.464 DEBUG:teuthology.orchestra.run.smithi196:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-19T13:39:52.507 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.y] 2024-09-19T13:39:52.508 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCHKexmTtrtGxAArMJRGDlaNW+irOTzH04i/g== 2024-09-19T13:39:52.508 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.0] 2024-09-19T13:39:52.508 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCKKexmbBQUJxAAvFVltYc1wCIkBCfR9dIHOA== 2024-09-19T13:39:52.508 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.1] 2024-09-19T13:39:52.508 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCNKexmRzFdNBAAkfIxczW/7UHvpvdfnkW/yw== 2024-09-19T13:39:52.508 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.2] 2024-09-19T13:39:52.508 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCRKexmQDcvCRAAqZayamxRcqPrjs6ryC7qiQ== 2024-09-19T13:39:52.508 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.3] 2024-09-19T13:39:52.508 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCUKexmCKZXGxAAZjnKuJt95uYrxWV9EIlFKQ== 2024-09-19T13:39:52.508 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.x] 2024-09-19T13:39:52.508 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCHKexmRsyqHhAAMUXe67I9IVpaVNOUw3s3vw== 2024-09-19T13:39:52.509 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.4] 2024-09-19T13:39:52.509 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCaKexmBEv7OBAA9ejWH10rdBubgHDRQ6AEkQ== 2024-09-19T13:39:52.509 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.5] 2024-09-19T13:39:52.509 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCeKexmNjllChAAb2P0H/HFZ6K2pgmFD0fQhQ== 2024-09-19T13:39:52.509 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.6] 2024-09-19T13:39:52.509 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQChKexmsqJQGxAA3l3hhK1uj4sxBZ55na9P0g== 2024-09-19T13:39:52.509 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.7] 2024-09-19T13:39:52.509 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCkKexm5T/7KxAA1FpbQ3YGCbrZUohE4ZWT+w== 2024-09-19T13:39:52.509 INFO:teuthology.orchestra.run.smithi153.stdout:[client.0] 2024-09-19T13:39:52.509 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCHKexmwTClIRAAhHkMCsnOAMoAS8tdjLJI1A== 2024-09-19T13:39:52.509 INFO:teuthology.orchestra.run.smithi153.stdout:[client.1] 2024-09-19T13:39:52.509 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCHKexmCy96JBAAayuGbtfvSfLTtVjRDAOohA== 2024-09-19T13:39:52.516 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.y] 2024-09-19T13:39:52.516 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQCHKexmTtrtGxAArMJRGDlaNW+irOTzH04i/g== 2024-09-19T13:39:52.516 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.0] 2024-09-19T13:39:52.516 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQCKKexmbBQUJxAAvFVltYc1wCIkBCfR9dIHOA== 2024-09-19T13:39:52.517 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.1] 2024-09-19T13:39:52.517 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQCNKexmRzFdNBAAkfIxczW/7UHvpvdfnkW/yw== 2024-09-19T13:39:52.517 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.2] 2024-09-19T13:39:52.517 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQCRKexmQDcvCRAAqZayamxRcqPrjs6ryC7qiQ== 2024-09-19T13:39:52.517 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.3] 2024-09-19T13:39:52.517 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQCUKexmCKZXGxAAZjnKuJt95uYrxWV9EIlFKQ== 2024-09-19T13:39:52.517 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.x] 2024-09-19T13:39:52.517 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQCHKexmRsyqHhAAMUXe67I9IVpaVNOUw3s3vw== 2024-09-19T13:39:52.517 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.4] 2024-09-19T13:39:52.517 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQCaKexmBEv7OBAA9ejWH10rdBubgHDRQ6AEkQ== 2024-09-19T13:39:52.517 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.5] 2024-09-19T13:39:52.517 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQCeKexmNjllChAAb2P0H/HFZ6K2pgmFD0fQhQ== 2024-09-19T13:39:52.517 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.6] 2024-09-19T13:39:52.517 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQChKexmsqJQGxAA3l3hhK1uj4sxBZ55na9P0g== 2024-09-19T13:39:52.518 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.7] 2024-09-19T13:39:52.518 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQCkKexm5T/7KxAA1FpbQ3YGCbrZUohE4ZWT+w== 2024-09-19T13:39:52.518 INFO:teuthology.orchestra.run.smithi196.stdout:[client.0] 2024-09-19T13:39:52.518 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQCHKexmwTClIRAAhHkMCsnOAMoAS8tdjLJI1A== 2024-09-19T13:39:52.518 INFO:teuthology.orchestra.run.smithi196.stdout:[client.1] 2024-09-19T13:39:52.518 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQCHKexmCy96JBAAayuGbtfvSfLTtVjRDAOohA== 2024-09-19T13:39:52.519 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T13:39:52.556 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T13:39:52.607 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:39:52.644 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:39:52.691 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:39:52.732 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:39:52.777 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:39:52.823 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:39:52.870 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:39:52.912 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:39:52.954 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T13:39:53.000 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T13:39:53.045 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:39:53.094 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:39:53.140 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:39:53.180 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:39:53.226 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:39:53.265 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:39:53.318 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:39:53.352 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T13:39:53.397 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T13:39:53.399 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T13:39:53.489 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T13:39:53.492 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T13:39:53.535 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-19T13:39:53.535 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-19T13:39:53.584 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T13:39:53.673 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-19T13:39:53.685 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-19T13:39:53.736 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T13:39:53.822 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-19T13:39:53.876 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-19T13:39:53.890 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T13:39:53.989 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-19T13:39:54.001 DEBUG:teuthology.orchestra.run.smithi153:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:39:54.003 DEBUG:teuthology.orchestra.run.smithi196:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-19T13:39:54.049 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-19T13:39:54.050 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-19T13:39:54.050 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-19T13:39:54.052 INFO:tasks.ceph.mon.a:Started 2024-09-19T13:39:54.052 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-19T13:39:54.052 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-19T13:39:54.054 INFO:tasks.ceph.mon.c:Started 2024-09-19T13:39:54.055 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-19T13:39:54.055 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-19T13:39:54.094 INFO:tasks.ceph.mon.b:Started 2024-09-19T13:39:54.095 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-19T13:39:54.095 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-19T13:39:54.095 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-19T13:39:54.097 INFO:tasks.ceph.mgr.y:Started 2024-09-19T13:39:54.098 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-19T13:39:54.098 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-19T13:39:54.100 INFO:tasks.ceph.mgr.x:Started 2024-09-19T13:39:54.100 DEBUG:tasks.ceph:set 0 configs 2024-09-19T13:39:54.100 INFO:tasks.ceph:Setting crush tunables to default 2024-09-19T13:39:54.100 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd crush tunables default 2024-09-19T13:40:00.302 INFO:teuthology.orchestra.run.smithi153.stderr:adjusted tunables profile to default 2024-09-19T13:40:00.321 INFO:tasks.ceph:check_enable_crimson: False 2024-09-19T13:40:00.321 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-19T13:40:00.321 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:40:00.321 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-19T13:40:00.331 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:40:00.332 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-19T13:40:00.383 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:40:00.383 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-19T13:40:00.436 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:40:00.436 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-19T13:40:00.492 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-19T13:40:00.492 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-19T13:40:00.505 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-19T13:40:00.505 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-19T13:40:00.560 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-19T13:40:00.560 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-19T13:40:00.611 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-09-19T13:40:00.612 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-19T13:40:00.664 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new ce8bbbf7-8bf7-46c4-ac60-162b6eb810a1 0 2024-09-19T13:40:00.915 INFO:teuthology.orchestra.run.smithi196.stdout:0 2024-09-19T13:40:00.932 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 8635f339-d51b-4aa9-b61e-359098a3eb26 1 2024-09-19T13:40:01.132 INFO:teuthology.orchestra.run.smithi196.stdout:1 2024-09-19T13:40:01.149 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new e0dc4d61-fb7e-44a7-a674-fe3a681bd238 2 2024-09-19T13:40:01.342 INFO:teuthology.orchestra.run.smithi196.stdout:2 2024-09-19T13:40:01.358 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 83649989-6b85-458b-b1ad-3d907675d1f1 3 2024-09-19T13:40:01.555 INFO:teuthology.orchestra.run.smithi196.stdout:3 2024-09-19T13:40:01.571 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new bedde2b8-933e-48a8-ad6f-fab9979eed30 4 2024-09-19T13:40:01.770 INFO:teuthology.orchestra.run.smithi196.stdout:4 2024-09-19T13:40:01.786 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new adee05a9-01f6-4d19-9bd7-c6abf045ab64 5 2024-09-19T13:40:02.025 INFO:teuthology.orchestra.run.smithi196.stdout:5 2024-09-19T13:40:02.041 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 0cab8a06-6eb0-484f-89ac-1efc8afd346a 6 2024-09-19T13:40:02.209 INFO:tasks.ceph.mgr.x.smithi196.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-19T13:40:02.210 INFO:tasks.ceph.mgr.x.smithi196.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-19T13:40:02.210 INFO:tasks.ceph.mgr.x.smithi196.stderr: from numpy import show_config as show_numpy_config 2024-09-19T13:40:02.224 INFO:teuthology.orchestra.run.smithi196.stdout:6 2024-09-19T13:40:02.241 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 92f735a8-569b-44e9-b61e-ccc5abaf6741 7 2024-09-19T13:40:02.400 INFO:tasks.ceph.mgr.y.smithi153.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-19T13:40:02.400 INFO:tasks.ceph.mgr.y.smithi153.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-19T13:40:02.400 INFO:tasks.ceph.mgr.y.smithi153.stderr: from numpy import show_config as show_numpy_config 2024-09-19T13:40:02.440 INFO:teuthology.orchestra.run.smithi196.stdout:7 2024-09-19T13:40:02.457 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-19T13:40:02.458 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-19T13:40:02.460 INFO:tasks.ceph.osd.0:Started 2024-09-19T13:40:02.460 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-19T13:40:02.460 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-19T13:40:02.463 INFO:tasks.ceph.osd.1:Started 2024-09-19T13:40:02.463 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-19T13:40:02.464 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-19T13:40:02.465 INFO:tasks.ceph.osd.2:Started 2024-09-19T13:40:02.466 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-19T13:40:02.466 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-19T13:40:02.469 INFO:tasks.ceph.osd.3:Started 2024-09-19T13:40:02.469 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-19T13:40:02.469 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-19T13:40:02.471 INFO:tasks.ceph.osd.4:Started 2024-09-19T13:40:02.471 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-19T13:40:02.471 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-19T13:40:02.473 INFO:tasks.ceph.osd.5:Started 2024-09-19T13:40:02.473 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-19T13:40:02.474 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-19T13:40:02.475 INFO:tasks.ceph.osd.6:Started 2024-09-19T13:40:02.476 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-19T13:40:02.476 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-19T13:40:02.478 INFO:tasks.ceph.osd.7:Started 2024-09-19T13:40:02.479 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T13:40:02.684 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:40:02.685 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":10,"fsid":"3b892dc0-ee3c-4a62-acaf-b5dc1a676e05","created":"2024-09-19T13:39:59.415855+0000","modified":"2024-09-19T13:40:02.436813+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T13:40:02.436813+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ce8bbbf7-8bf7-46c4-ac60-162b6eb810a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8635f339-d51b-4aa9-b61e-359098a3eb26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e0dc4d61-fb7e-44a7-a674-fe3a681bd238","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"83649989-6b85-458b-b1ad-3d907675d1f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bedde2b8-933e-48a8-ad6f-fab9979eed30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"adee05a9-01f6-4d19-9bd7-c6abf045ab64","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0cab8a06-6eb0-484f-89ac-1efc8afd346a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"92f735a8-569b-44e9-b61e-ccc5abaf6741","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T13:40:02.701 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-19T13:40:02.702 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-19T13:40:03.508 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T13:40:03.602 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-09-19T13:40:03.602+0000 7eff967be7c0 -1 Falling back to public interface 2024-09-19T13:40:03.619 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-19T13:40:03.617+0000 7f650065b7c0 -1 Falling back to public interface 2024-09-19T13:40:03.634 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-09-19T13:40:03.633+0000 7fb6288837c0 -1 Falling back to public interface 2024-09-19T13:40:03.706 INFO:teuthology.misc.health.smithi153.stdout: 2024-09-19T13:40:03.706 INFO:teuthology.misc.health.smithi153.stdout:{"epoch":10,"fsid":"3b892dc0-ee3c-4a62-acaf-b5dc1a676e05","created":"2024-09-19T13:39:59.415855+0000","modified":"2024-09-19T13:40:02.436813+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T13:40:02.436813+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ce8bbbf7-8bf7-46c4-ac60-162b6eb810a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8635f339-d51b-4aa9-b61e-359098a3eb26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e0dc4d61-fb7e-44a7-a674-fe3a681bd238","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"83649989-6b85-458b-b1ad-3d907675d1f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bedde2b8-933e-48a8-ad6f-fab9979eed30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"adee05a9-01f6-4d19-9bd7-c6abf045ab64","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0cab8a06-6eb0-484f-89ac-1efc8afd346a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"92f735a8-569b-44e9-b61e-ccc5abaf6741","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T13:40:03.721 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-19T13:40:04.093 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-19T13:40:04.089+0000 7f3f36c0a7c0 -1 Falling back to public interface 2024-09-19T13:40:04.111 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-09-19T13:40:04.110+0000 7f4f652e37c0 -1 Falling back to public interface 2024-09-19T13:40:04.146 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-19T13:40:04.146+0000 7f527f0ee7c0 -1 Falling back to public interface 2024-09-19T13:40:04.303 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-09-19T13:40:04.302+0000 7ff1084bd7c0 -1 Falling back to public interface 2024-09-19T13:40:04.352 INFO:tasks.ceph.osd.3.smithi153.stderr:2024-09-19T13:40:04.349+0000 7f33058a67c0 -1 Falling back to public interface 2024-09-19T13:40:05.097 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-19T13:40:05.098+0000 7f3010388640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-19T13:40:05.100 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-09-19T13:40:05.098+0000 7f3010388640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-19T13:40:07.581 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-09-19T13:40:07.578+0000 7eff967be7c0 -1 osd.5 0 log_to_monitors true 2024-09-19T13:40:07.642 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-09-19T13:40:07.637+0000 7fb6288837c0 -1 osd.0 0 log_to_monitors true 2024-09-19T13:40:07.717 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-19T13:40:07.713+0000 7f650065b7c0 -1 osd.1 0 log_to_monitors true 2024-09-19T13:40:08.083 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-09-19T13:40:08.082+0000 7f4f652e37c0 -1 osd.7 0 log_to_monitors true 2024-09-19T13:40:08.201 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-19T13:40:08.202+0000 7f527f0ee7c0 -1 osd.6 0 log_to_monitors true 2024-09-19T13:40:08.272 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-09-19T13:40:08.270+0000 7ff1084bd7c0 -1 osd.4 0 log_to_monitors true 2024-09-19T13:40:08.384 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-19T13:40:08.381+0000 7f3f36c0a7c0 -1 osd.2 0 log_to_monitors true 2024-09-19T13:40:08.663 INFO:tasks.ceph.osd.3.smithi153.stderr:2024-09-19T13:40:08.661+0000 7f33058a67c0 -1 osd.3 0 log_to_monitors true 2024-09-19T13:40:10.528 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T13:40:10.561 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-09-19T13:40:10.562+0000 7f4f61a9e640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T13:40:10.577 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-09-19T13:40:10.578+0000 7eff92767640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T13:40:10.600 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-09-19T13:40:10.598+0000 7f4f590be640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T13:40:10.617 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-09-19T13:40:10.618+0000 7eff8a599640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T13:40:10.621 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-19T13:40:10.617+0000 7f64fce16640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T13:40:10.663 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-09-19T13:40:10.661+0000 7fb62503e640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T13:40:10.736 INFO:tasks.ceph.osd.1.smithi153.stderr:2024-09-19T13:40:10.733+0000 7f64f4436640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T13:40:10.747 INFO:tasks.ceph.osd.0.smithi153.stderr:2024-09-19T13:40:10.745+0000 7fb61c65e640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T13:40:10.874 INFO:teuthology.misc.health.smithi153.stdout: 2024-09-19T13:40:10.874 INFO:teuthology.misc.health.smithi153.stdout:{"epoch":13,"fsid":"3b892dc0-ee3c-4a62-acaf-b5dc1a676e05","created":"2024-09-19T13:39:59.415855+0000","modified":"2024-09-19T13:40:10.103076+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T13:40:02.436813+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ce8bbbf7-8bf7-46c4-ac60-162b6eb810a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8635f339-d51b-4aa9-b61e-359098a3eb26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e0dc4d61-fb7e-44a7-a674-fe3a681bd238","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"83649989-6b85-458b-b1ad-3d907675d1f1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bedde2b8-933e-48a8-ad6f-fab9979eed30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"adee05a9-01f6-4d19-9bd7-c6abf045ab64","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0cab8a06-6eb0-484f-89ac-1efc8afd346a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"92f735a8-569b-44e9-b61e-ccc5abaf6741","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T13:40:10.890 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-19T13:40:11.468 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-19T13:40:11.465+0000 7f3f32bb3640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T13:40:11.491 INFO:tasks.ceph.osd.2.smithi153.stderr:2024-09-19T13:40:11.489+0000 7f3f2a9e5640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T13:40:11.497 INFO:tasks.ceph.osd.3.smithi153.stderr:2024-09-19T13:40:11.493+0000 7f330184f640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T13:40:11.501 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-09-19T13:40:11.502+0000 7ff104466640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T13:40:11.525 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-09-19T13:40:11.526+0000 7ff0fc298640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T13:40:11.527 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-19T13:40:11.526+0000 7f527b097640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T13:40:11.530 INFO:tasks.ceph.osd.3.smithi153.stderr:2024-09-19T13:40:11.529+0000 7f32f9681640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T13:40:11.554 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-09-19T13:40:11.554+0000 7f5272ec9640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T13:40:17.697 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T13:40:18.013 INFO:teuthology.misc.health.smithi153.stdout: 2024-09-19T13:40:18.013 INFO:teuthology.misc.health.smithi153.stdout:{"epoch":17,"fsid":"3b892dc0-ee3c-4a62-acaf-b5dc1a676e05","created":"2024-09-19T13:39:59.415855+0000","modified":"2024-09-19T13:40:14.608178+0000","last_up_change":"2024-09-19T13:40:11.599431+0000","last_in_change":"2024-09-19T13:40:02.436813+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T13:40:12.124782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce8bbbf7-8bf7-46c4-ac60-162b6eb810a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4220035009},{"type":"v1","addr":"172.21.15.153:6809","nonce":4220035009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4220035009},{"type":"v1","addr":"172.21.15.153:6811","nonce":4220035009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4220035009},{"type":"v1","addr":"172.21.15.153:6815","nonce":4220035009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4220035009},{"type":"v1","addr":"172.21.15.153:6813","nonce":4220035009}]},"public_addr":"172.21.15.153:6809/4220035009","cluster_addr":"172.21.15.153:6811/4220035009","heartbeat_back_addr":"172.21.15.153:6815/4220035009","heartbeat_front_addr":"172.21.15.153:6813/4220035009","state":["exists","up"]},{"osd":1,"uuid":"8635f339-d51b-4aa9-b61e-359098a3eb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2952519065},{"type":"v1","addr":"172.21.15.153:6801","nonce":2952519065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2952519065},{"type":"v1","addr":"172.21.15.153:6803","nonce":2952519065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2952519065},{"type":"v1","addr":"172.21.15.153:6807","nonce":2952519065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2952519065},{"type":"v1","addr":"172.21.15.153:6805","nonce":2952519065}]},"public_addr":"172.21.15.153:6801/2952519065","cluster_addr":"172.21.15.153:6803/2952519065","heartbeat_back_addr":"172.21.15.153:6807/2952519065","heartbeat_front_addr":"172.21.15.153:6805/2952519065","state":["exists","up"]},{"osd":2,"uuid":"e0dc4d61-fb7e-44a7-a674-fe3a681bd238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":795993612},{"type":"v1","addr":"172.21.15.153:6817","nonce":795993612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":795993612},{"type":"v1","addr":"172.21.15.153:6819","nonce":795993612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":795993612},{"type":"v1","addr":"172.21.15.153:6823","nonce":795993612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":795993612},{"type":"v1","addr":"172.21.15.153:6821","nonce":795993612}]},"public_addr":"172.21.15.153:6817/795993612","cluster_addr":"172.21.15.153:6819/795993612","heartbeat_back_addr":"172.21.15.153:6823/795993612","heartbeat_front_addr":"172.21.15.153:6821/795993612","state":["exists","up"]},{"osd":3,"uuid":"83649989-6b85-458b-b1ad-3d907675d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2028182193},{"type":"v1","addr":"172.21.15.153:6825","nonce":2028182193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2028182193},{"type":"v1","addr":"172.21.15.153:6827","nonce":2028182193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2028182193},{"type":"v1","addr":"172.21.15.153:6831","nonce":2028182193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2028182193},{"type":"v1","addr":"172.21.15.153:6829","nonce":2028182193}]},"public_addr":"172.21.15.153:6825/2028182193","cluster_addr":"172.21.15.153:6827/2028182193","heartbeat_back_addr":"172.21.15.153:6831/2028182193","heartbeat_front_addr":"172.21.15.153:6829/2028182193","state":["exists","up"]},{"osd":4,"uuid":"bedde2b8-933e-48a8-ad6f-fab9979eed30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":138851534},{"type":"v1","addr":"172.21.15.196:6827","nonce":138851534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":138851534},{"type":"v1","addr":"172.21.15.196:6829","nonce":138851534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":138851534},{"type":"v1","addr":"172.21.15.196:6833","nonce":138851534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":138851534},{"type":"v1","addr":"172.21.15.196:6831","nonce":138851534}]},"public_addr":"172.21.15.196:6827/138851534","cluster_addr":"172.21.15.196:6829/138851534","heartbeat_back_addr":"172.21.15.196:6833/138851534","heartbeat_front_addr":"172.21.15.196:6831/138851534","state":["exists","up"]},{"osd":5,"uuid":"adee05a9-01f6-4d19-9bd7-c6abf045ab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2881705388},{"type":"v1","addr":"172.21.15.196:6801","nonce":2881705388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2881705388},{"type":"v1","addr":"172.21.15.196:6803","nonce":2881705388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2881705388},{"type":"v1","addr":"172.21.15.196:6807","nonce":2881705388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2881705388},{"type":"v1","addr":"172.21.15.196:6805","nonce":2881705388}]},"public_addr":"172.21.15.196:6801/2881705388","cluster_addr":"172.21.15.196:6803/2881705388","heartbeat_back_addr":"172.21.15.196:6807/2881705388","heartbeat_front_addr":"172.21.15.196:6805/2881705388","state":["exists","up"]},{"osd":6,"uuid":"0cab8a06-6eb0-484f-89ac-1efc8afd346a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":638579357},{"type":"v1","addr":"172.21.15.196:6819","nonce":638579357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":638579357},{"type":"v1","addr":"172.21.15.196:6821","nonce":638579357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":638579357},{"type":"v1","addr":"172.21.15.196:6825","nonce":638579357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":638579357},{"type":"v1","addr":"172.21.15.196:6823","nonce":638579357}]},"public_addr":"172.21.15.196:6819/638579357","cluster_addr":"172.21.15.196:6821/638579357","heartbeat_back_addr":"172.21.15.196:6825/638579357","heartbeat_front_addr":"172.21.15.196:6823/638579357","state":["exists","up"]},{"osd":7,"uuid":"92f735a8-569b-44e9-b61e-ccc5abaf6741","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":3095707395},{"type":"v1","addr":"172.21.15.196:6811","nonce":3095707395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":3095707395},{"type":"v1","addr":"172.21.15.196:6813","nonce":3095707395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3095707395},{"type":"v1","addr":"172.21.15.196:6817","nonce":3095707395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":3095707395},{"type":"v1","addr":"172.21.15.196:6815","nonce":3095707395}]},"public_addr":"172.21.15.196:6811/3095707395","cluster_addr":"172.21.15.196:6813/3095707395","heartbeat_back_addr":"172.21.15.196:6817/3095707395","heartbeat_front_addr":"172.21.15.196:6815/3095707395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:08.672776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:08.725276+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:09.373468+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:09.633556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:09.238299+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:08.567918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:09.247935+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:09.051448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T13:40:18.031 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-19T13:40:18.031 INFO:tasks.ceph:Creating RBD pool 2024-09-19T13:40:18.031 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-19T13:40:19.077 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'rbd' created 2024-09-19T13:40:19.103 DEBUG:teuthology.orchestra.run.smithi153:> rbd --cluster ceph pool init rbd 2024-09-19T13:40:19.139 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:40:19.139 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:40:22.143 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-19T13:40:22.144 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-19T13:40:22.145 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-19T13:40:22.504 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:40:22.523 INFO:teuthology.orchestra.run.smithi153.stdout:[{"version":9,"timestamp":"2024-09-19T13:40:11.530449+0000","name":"","changes":[{"name":"osd.6/osd_mclock_max_capacity_iops_ssd","new_value":"5698.379756"}]}] 2024-09-19T13:40:22.523 INFO:tasks.ceph_manager:config epoch is 9 2024-09-19T13:40:22.524 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T13:40:22.524 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-19T13:40:22.524 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-19T13:40:22.875 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:40:22.892 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":2353680615},{"type":"v1","addr":"172.21.15.196:6809","nonce":2353680615}]},"active_addr":"172.21.15.196:6809/2353680615","active_change":"2024-09-19T13:40:04.074762+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":2476437341}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":49057484}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":4152103561}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":3456694686}]}]} 2024-09-19T13:40:22.901 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-19T13:40:22.902 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-19T13:40:22.902 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T13:40:23.191 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:40:23.191 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":21,"fsid":"3b892dc0-ee3c-4a62-acaf-b5dc1a676e05","created":"2024-09-19T13:39:59.415855+0000","modified":"2024-09-19T13:40:22.101425+0000","last_up_change":"2024-09-19T13:40:11.599431+0000","last_in_change":"2024-09-19T13:40:02.436813+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T13:40:12.124782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-19T13:40:18.340794+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce8bbbf7-8bf7-46c4-ac60-162b6eb810a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4220035009},{"type":"v1","addr":"172.21.15.153:6809","nonce":4220035009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4220035009},{"type":"v1","addr":"172.21.15.153:6811","nonce":4220035009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4220035009},{"type":"v1","addr":"172.21.15.153:6815","nonce":4220035009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4220035009},{"type":"v1","addr":"172.21.15.153:6813","nonce":4220035009}]},"public_addr":"172.21.15.153:6809/4220035009","cluster_addr":"172.21.15.153:6811/4220035009","heartbeat_back_addr":"172.21.15.153:6815/4220035009","heartbeat_front_addr":"172.21.15.153:6813/4220035009","state":["exists","up"]},{"osd":1,"uuid":"8635f339-d51b-4aa9-b61e-359098a3eb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2952519065},{"type":"v1","addr":"172.21.15.153:6801","nonce":2952519065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2952519065},{"type":"v1","addr":"172.21.15.153:6803","nonce":2952519065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2952519065},{"type":"v1","addr":"172.21.15.153:6807","nonce":2952519065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2952519065},{"type":"v1","addr":"172.21.15.153:6805","nonce":2952519065}]},"public_addr":"172.21.15.153:6801/2952519065","cluster_addr":"172.21.15.153:6803/2952519065","heartbeat_back_addr":"172.21.15.153:6807/2952519065","heartbeat_front_addr":"172.21.15.153:6805/2952519065","state":["exists","up"]},{"osd":2,"uuid":"e0dc4d61-fb7e-44a7-a674-fe3a681bd238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":795993612},{"type":"v1","addr":"172.21.15.153:6817","nonce":795993612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":795993612},{"type":"v1","addr":"172.21.15.153:6819","nonce":795993612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":795993612},{"type":"v1","addr":"172.21.15.153:6823","nonce":795993612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":795993612},{"type":"v1","addr":"172.21.15.153:6821","nonce":795993612}]},"public_addr":"172.21.15.153:6817/795993612","cluster_addr":"172.21.15.153:6819/795993612","heartbeat_back_addr":"172.21.15.153:6823/795993612","heartbeat_front_addr":"172.21.15.153:6821/795993612","state":["exists","up"]},{"osd":3,"uuid":"83649989-6b85-458b-b1ad-3d907675d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2028182193},{"type":"v1","addr":"172.21.15.153:6825","nonce":2028182193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2028182193},{"type":"v1","addr":"172.21.15.153:6827","nonce":2028182193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2028182193},{"type":"v1","addr":"172.21.15.153:6831","nonce":2028182193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2028182193},{"type":"v1","addr":"172.21.15.153:6829","nonce":2028182193}]},"public_addr":"172.21.15.153:6825/2028182193","cluster_addr":"172.21.15.153:6827/2028182193","heartbeat_back_addr":"172.21.15.153:6831/2028182193","heartbeat_front_addr":"172.21.15.153:6829/2028182193","state":["exists","up"]},{"osd":4,"uuid":"bedde2b8-933e-48a8-ad6f-fab9979eed30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":138851534},{"type":"v1","addr":"172.21.15.196:6827","nonce":138851534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":138851534},{"type":"v1","addr":"172.21.15.196:6829","nonce":138851534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":138851534},{"type":"v1","addr":"172.21.15.196:6833","nonce":138851534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":138851534},{"type":"v1","addr":"172.21.15.196:6831","nonce":138851534}]},"public_addr":"172.21.15.196:6827/138851534","cluster_addr":"172.21.15.196:6829/138851534","heartbeat_back_addr":"172.21.15.196:6833/138851534","heartbeat_front_addr":"172.21.15.196:6831/138851534","state":["exists","up"]},{"osd":5,"uuid":"adee05a9-01f6-4d19-9bd7-c6abf045ab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2881705388},{"type":"v1","addr":"172.21.15.196:6801","nonce":2881705388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2881705388},{"type":"v1","addr":"172.21.15.196:6803","nonce":2881705388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2881705388},{"type":"v1","addr":"172.21.15.196:6807","nonce":2881705388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2881705388},{"type":"v1","addr":"172.21.15.196:6805","nonce":2881705388}]},"public_addr":"172.21.15.196:6801/2881705388","cluster_addr":"172.21.15.196:6803/2881705388","heartbeat_back_addr":"172.21.15.196:6807/2881705388","heartbeat_front_addr":"172.21.15.196:6805/2881705388","state":["exists","up"]},{"osd":6,"uuid":"0cab8a06-6eb0-484f-89ac-1efc8afd346a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":638579357},{"type":"v1","addr":"172.21.15.196:6819","nonce":638579357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":638579357},{"type":"v1","addr":"172.21.15.196:6821","nonce":638579357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":638579357},{"type":"v1","addr":"172.21.15.196:6825","nonce":638579357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":638579357},{"type":"v1","addr":"172.21.15.196:6823","nonce":638579357}]},"public_addr":"172.21.15.196:6819/638579357","cluster_addr":"172.21.15.196:6821/638579357","heartbeat_back_addr":"172.21.15.196:6825/638579357","heartbeat_front_addr":"172.21.15.196:6823/638579357","state":["exists","up"]},{"osd":7,"uuid":"92f735a8-569b-44e9-b61e-ccc5abaf6741","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":3095707395},{"type":"v1","addr":"172.21.15.196:6811","nonce":3095707395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":3095707395},{"type":"v1","addr":"172.21.15.196:6813","nonce":3095707395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3095707395},{"type":"v1","addr":"172.21.15.196:6817","nonce":3095707395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":3095707395},{"type":"v1","addr":"172.21.15.196:6815","nonce":3095707395}]},"public_addr":"172.21.15.196:6811/3095707395","cluster_addr":"172.21.15.196:6813/3095707395","heartbeat_back_addr":"172.21.15.196:6817/3095707395","heartbeat_front_addr":"172.21.15.196:6815/3095707395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:08.672776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:08.725276+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:09.373468+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:09.633556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:09.238299+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:08.567918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:09.247935+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:09.051448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T13:40:23.209 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-19T13:40:23.210 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T13:40:23.492 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:40:23.492 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":21,"fsid":"3b892dc0-ee3c-4a62-acaf-b5dc1a676e05","created":"2024-09-19T13:39:59.415855+0000","modified":"2024-09-19T13:40:22.101425+0000","last_up_change":"2024-09-19T13:40:11.599431+0000","last_in_change":"2024-09-19T13:40:02.436813+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T13:40:12.124782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-19T13:40:18.340794+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce8bbbf7-8bf7-46c4-ac60-162b6eb810a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4220035009},{"type":"v1","addr":"172.21.15.153:6809","nonce":4220035009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4220035009},{"type":"v1","addr":"172.21.15.153:6811","nonce":4220035009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4220035009},{"type":"v1","addr":"172.21.15.153:6815","nonce":4220035009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4220035009},{"type":"v1","addr":"172.21.15.153:6813","nonce":4220035009}]},"public_addr":"172.21.15.153:6809/4220035009","cluster_addr":"172.21.15.153:6811/4220035009","heartbeat_back_addr":"172.21.15.153:6815/4220035009","heartbeat_front_addr":"172.21.15.153:6813/4220035009","state":["exists","up"]},{"osd":1,"uuid":"8635f339-d51b-4aa9-b61e-359098a3eb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2952519065},{"type":"v1","addr":"172.21.15.153:6801","nonce":2952519065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2952519065},{"type":"v1","addr":"172.21.15.153:6803","nonce":2952519065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2952519065},{"type":"v1","addr":"172.21.15.153:6807","nonce":2952519065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2952519065},{"type":"v1","addr":"172.21.15.153:6805","nonce":2952519065}]},"public_addr":"172.21.15.153:6801/2952519065","cluster_addr":"172.21.15.153:6803/2952519065","heartbeat_back_addr":"172.21.15.153:6807/2952519065","heartbeat_front_addr":"172.21.15.153:6805/2952519065","state":["exists","up"]},{"osd":2,"uuid":"e0dc4d61-fb7e-44a7-a674-fe3a681bd238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":795993612},{"type":"v1","addr":"172.21.15.153:6817","nonce":795993612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":795993612},{"type":"v1","addr":"172.21.15.153:6819","nonce":795993612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":795993612},{"type":"v1","addr":"172.21.15.153:6823","nonce":795993612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":795993612},{"type":"v1","addr":"172.21.15.153:6821","nonce":795993612}]},"public_addr":"172.21.15.153:6817/795993612","cluster_addr":"172.21.15.153:6819/795993612","heartbeat_back_addr":"172.21.15.153:6823/795993612","heartbeat_front_addr":"172.21.15.153:6821/795993612","state":["exists","up"]},{"osd":3,"uuid":"83649989-6b85-458b-b1ad-3d907675d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2028182193},{"type":"v1","addr":"172.21.15.153:6825","nonce":2028182193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2028182193},{"type":"v1","addr":"172.21.15.153:6827","nonce":2028182193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2028182193},{"type":"v1","addr":"172.21.15.153:6831","nonce":2028182193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2028182193},{"type":"v1","addr":"172.21.15.153:6829","nonce":2028182193}]},"public_addr":"172.21.15.153:6825/2028182193","cluster_addr":"172.21.15.153:6827/2028182193","heartbeat_back_addr":"172.21.15.153:6831/2028182193","heartbeat_front_addr":"172.21.15.153:6829/2028182193","state":["exists","up"]},{"osd":4,"uuid":"bedde2b8-933e-48a8-ad6f-fab9979eed30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":138851534},{"type":"v1","addr":"172.21.15.196:6827","nonce":138851534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":138851534},{"type":"v1","addr":"172.21.15.196:6829","nonce":138851534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":138851534},{"type":"v1","addr":"172.21.15.196:6833","nonce":138851534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":138851534},{"type":"v1","addr":"172.21.15.196:6831","nonce":138851534}]},"public_addr":"172.21.15.196:6827/138851534","cluster_addr":"172.21.15.196:6829/138851534","heartbeat_back_addr":"172.21.15.196:6833/138851534","heartbeat_front_addr":"172.21.15.196:6831/138851534","state":["exists","up"]},{"osd":5,"uuid":"adee05a9-01f6-4d19-9bd7-c6abf045ab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2881705388},{"type":"v1","addr":"172.21.15.196:6801","nonce":2881705388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2881705388},{"type":"v1","addr":"172.21.15.196:6803","nonce":2881705388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2881705388},{"type":"v1","addr":"172.21.15.196:6807","nonce":2881705388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2881705388},{"type":"v1","addr":"172.21.15.196:6805","nonce":2881705388}]},"public_addr":"172.21.15.196:6801/2881705388","cluster_addr":"172.21.15.196:6803/2881705388","heartbeat_back_addr":"172.21.15.196:6807/2881705388","heartbeat_front_addr":"172.21.15.196:6805/2881705388","state":["exists","up"]},{"osd":6,"uuid":"0cab8a06-6eb0-484f-89ac-1efc8afd346a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":638579357},{"type":"v1","addr":"172.21.15.196:6819","nonce":638579357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":638579357},{"type":"v1","addr":"172.21.15.196:6821","nonce":638579357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":638579357},{"type":"v1","addr":"172.21.15.196:6825","nonce":638579357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":638579357},{"type":"v1","addr":"172.21.15.196:6823","nonce":638579357}]},"public_addr":"172.21.15.196:6819/638579357","cluster_addr":"172.21.15.196:6821/638579357","heartbeat_back_addr":"172.21.15.196:6825/638579357","heartbeat_front_addr":"172.21.15.196:6823/638579357","state":["exists","up"]},{"osd":7,"uuid":"92f735a8-569b-44e9-b61e-ccc5abaf6741","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":3095707395},{"type":"v1","addr":"172.21.15.196:6811","nonce":3095707395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":3095707395},{"type":"v1","addr":"172.21.15.196:6813","nonce":3095707395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3095707395},{"type":"v1","addr":"172.21.15.196:6817","nonce":3095707395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":3095707395},{"type":"v1","addr":"172.21.15.196:6815","nonce":3095707395}]},"public_addr":"172.21.15.196:6811/3095707395","cluster_addr":"172.21.15.196:6813/3095707395","heartbeat_back_addr":"172.21.15.196:6817/3095707395","heartbeat_front_addr":"172.21.15.196:6815/3095707395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:08.672776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:08.725276+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:09.373468+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:09.633556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:09.238299+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:08.567918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:09.247935+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:09.051448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T13:40:23.510 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-19T13:40:23.510 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-19T13:40:23.510 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-19T13:40:23.511 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-19T13:40:23.511 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-19T13:40:23.512 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-19T13:40:23.512 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-19T13:40:23.512 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-19T13:40:23.751 INFO:teuthology.orchestra.run.smithi153.stdout:60129542149 2024-09-19T13:40:23.751 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-19T13:40:23.770 INFO:teuthology.orchestra.run.smithi153.stdout:60129542150 2024-09-19T13:40:23.770 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-19T13:40:23.789 INFO:teuthology.orchestra.run.smithi153.stdout:60129542150 2024-09-19T13:40:23.789 INFO:teuthology.orchestra.run.smithi153.stdout:60129542149 2024-09-19T13:40:23.790 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-19T13:40:23.790 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-19T13:40:23.791 INFO:teuthology.orchestra.run.smithi153.stdout:60129542149 2024-09-19T13:40:23.791 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-19T13:40:23.792 INFO:teuthology.orchestra.run.smithi153.stdout:60129542148 2024-09-19T13:40:23.793 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-19T13:40:23.797 INFO:teuthology.orchestra.run.smithi153.stdout:60129542150 2024-09-19T13:40:23.797 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-19T13:40:23.802 INFO:teuthology.orchestra.run.smithi153.stdout:60129542149 2024-09-19T13:40:23.802 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-19T13:40:24.303 INFO:teuthology.orchestra.run.smithi153.stdout:60129542149 2024-09-19T13:40:24.321 INFO:teuthology.orchestra.run.smithi153.stdout:60129542150 2024-09-19T13:40:24.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.1 2024-09-19T13:40:24.333 INFO:teuthology.orchestra.run.smithi153.stdout:60129542150 2024-09-19T13:40:24.334 INFO:teuthology.orchestra.run.smithi153.stdout:60129542148 2024-09-19T13:40:24.334 DEBUG:teuthology.parallel:result is None 2024-09-19T13:40:24.337 INFO:teuthology.orchestra.run.smithi153.stdout:60129542150 2024-09-19T13:40:24.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2024-09-19T13:40:24.357 DEBUG:teuthology.parallel:result is None 2024-09-19T13:40:24.360 INFO:teuthology.orchestra.run.smithi153.stdout:60129542149 2024-09-19T13:40:24.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2024-09-19T13:40:24.361 DEBUG:teuthology.parallel:result is None 2024-09-19T13:40:24.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.0 2024-09-19T13:40:24.369 DEBUG:teuthology.parallel:result is None 2024-09-19T13:40:24.371 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.4 2024-09-19T13:40:24.371 DEBUG:teuthology.parallel:result is None 2024-09-19T13:40:24.374 INFO:teuthology.orchestra.run.smithi153.stdout:60129542149 2024-09-19T13:40:24.380 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2024-09-19T13:40:24.380 DEBUG:teuthology.parallel:result is None 2024-09-19T13:40:24.383 INFO:teuthology.orchestra.run.smithi153.stdout:60129542149 2024-09-19T13:40:24.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.6 2024-09-19T13:40:24.394 DEBUG:teuthology.parallel:result is None 2024-09-19T13:40:24.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2024-09-19T13:40:24.402 DEBUG:teuthology.parallel:result is None 2024-09-19T13:40:24.402 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T13:40:24.402 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T13:40:24.721 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:40:24.722 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-19T13:40:24.738 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-19T13:40:24.141321+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219056,"kb_used_data":2808,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755664,"statfs":{"total":773094113280,"available":772869799936,"internally_reserved":0,"allocated":2875392,"data_stored":1744926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.057912"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:40:22.308370+0000","last_change":"2024-09-19T13:40:22.308878+0000","last_active":"2024-09-19T13:40:22.308370+0000","last_peered":"2024-09-19T13:40:22.308370+0000","last_clean":"2024-09-19T13:40:22.308370+0000","last_became_active":"2024-09-19T13:40:20.103134+0000","last_became_peered":"2024-09-19T13:40:20.103134+0000","last_unstale":"2024-09-19T13:40:22.308370+0000","last_undegraded":"2024-09-19T13:40:22.308370+0000","last_fullsized":"2024-09-19T13:40:22.308370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:38.150405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093870599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:40:22.113992+0000","last_change":"2024-09-19T13:40:22.113992+0000","last_active":"2024-09-19T13:40:22.113992+0000","last_peered":"2024-09-19T13:40:22.113992+0000","last_clean":"2024-09-19T13:40:22.113992+0000","last_became_active":"2024-09-19T13:40:20.101186+0000","last_became_peered":"2024-09-19T13:40:20.101186+0000","last_unstale":"2024-09-19T13:40:22.113992+0000","last_undegraded":"2024-09-19T13:40:22.113992+0000","last_fullsized":"2024-09-19T13:40:22.113992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:40.208910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010323750000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:40:23.120767+0000","last_change":"2024-09-19T13:40:23.121258+0000","last_active":"2024-09-19T13:40:23.120767+0000","last_peered":"2024-09-19T13:40:23.120767+0000","last_clean":"2024-09-19T13:40:23.120767+0000","last_became_active":"2024-09-19T13:40:20.096321+0000","last_became_peered":"2024-09-19T13:40:20.096321+0000","last_unstale":"2024-09-19T13:40:23.120767+0000","last_undegraded":"2024-09-19T13:40:23.120767+0000","last_fullsized":"2024-09-19T13:40:23.120767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:56.853216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001025329,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:40:22.113821+0000","last_change":"2024-09-19T13:40:22.113821+0000","last_active":"2024-09-19T13:40:22.113821+0000","last_peered":"2024-09-19T13:40:22.113821+0000","last_clean":"2024-09-19T13:40:22.113821+0000","last_became_active":"2024-09-19T13:40:20.095294+0000","last_became_peered":"2024-09-19T13:40:20.095294+0000","last_unstale":"2024-09-19T13:40:22.113821+0000","last_undegraded":"2024-09-19T13:40:22.113821+0000","last_fullsized":"2024-09-19T13:40:22.113821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:38.696147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088577700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:40:22.122819+0000","last_change":"2024-09-19T13:40:22.121910+0000","last_active":"2024-09-19T13:40:22.122819+0000","last_peered":"2024-09-19T13:40:22.122819+0000","last_clean":"2024-09-19T13:40:22.122819+0000","last_became_active":"2024-09-19T13:40:20.101198+0000","last_became_peered":"2024-09-19T13:40:20.101198+0000","last_unstale":"2024-09-19T13:40:22.122819+0000","last_undegraded":"2024-09-19T13:40:22.122819+0000","last_fullsized":"2024-09-19T13:40:22.122819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:03:31.869167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026053059999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:40:22.374972+0000","last_change":"2024-09-19T13:40:22.375307+0000","last_active":"2024-09-19T13:40:22.374972+0000","last_peered":"2024-09-19T13:40:22.374972+0000","last_clean":"2024-09-19T13:40:22.374972+0000","last_became_active":"2024-09-19T13:40:20.096900+0000","last_became_peered":"2024-09-19T13:40:20.096900+0000","last_unstale":"2024-09-19T13:40:22.374972+0000","last_undegraded":"2024-09-19T13:40:22.374972+0000","last_fullsized":"2024-09-19T13:40:22.374972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:28.240242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074274699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:40:23.120594+0000","last_change":"2024-09-19T13:40:23.121191+0000","last_active":"2024-09-19T13:40:23.120594+0000","last_peered":"2024-09-19T13:40:23.120594+0000","last_clean":"2024-09-19T13:40:23.120594+0000","last_became_active":"2024-09-19T13:40:20.099608+0000","last_became_peered":"2024-09-19T13:40:20.099608+0000","last_unstale":"2024-09-19T13:40:23.120594+0000","last_undegraded":"2024-09-19T13:40:23.120594+0000","last_fullsized":"2024-09-19T13:40:23.120594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:29.188183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001034798,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:40:22.120433+0000","last_change":"2024-09-19T13:40:22.120433+0000","last_active":"2024-09-19T13:40:22.120433+0000","last_peered":"2024-09-19T13:40:22.120433+0000","last_clean":"2024-09-19T13:40:22.120433+0000","last_became_active":"2024-09-19T13:40:20.100760+0000","last_became_peered":"2024-09-19T13:40:20.100760+0000","last_unstale":"2024-09-19T13:40:22.120433+0000","last_undegraded":"2024-09-19T13:40:22.120433+0000","last_fullsized":"2024-09-19T13:40:22.120433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:10.051308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001106569,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:40:23.120054+0000","last_change":"2024-09-19T13:40:13.616691+0000","last_active":"2024-09-19T13:40:23.120054+0000","last_peered":"2024-09-19T13:40:23.120054+0000","last_clean":"2024-09-19T13:40:23.120054+0000","last_became_active":"2024-09-19T13:40:13.615965+0000","last_became_peered":"2024-09-19T13:40:13.615965+0000","last_unstale":"2024-09-19T13:40:23.120054+0000","last_undegraded":"2024-09-19T13:40:23.120054+0000","last_fullsized":"2024-09-19T13:40:23.120054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:12.602317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:12.602317+0000","last_clean_scrub_stamp":"2024-09-19T13:40:12.602317+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:03.931360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":794624,"data_stored":656513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":71977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":71977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":71977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":71977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":794624,"data_stored":656513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T13:40:24.739 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T13:40:25.017 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:40:25.017 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-19T13:40:25.034 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-19T13:40:24.141321+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219056,"kb_used_data":2808,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755664,"statfs":{"total":773094113280,"available":772869799936,"internally_reserved":0,"allocated":2875392,"data_stored":1744926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.057912"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:40:22.308370+0000","last_change":"2024-09-19T13:40:22.308878+0000","last_active":"2024-09-19T13:40:22.308370+0000","last_peered":"2024-09-19T13:40:22.308370+0000","last_clean":"2024-09-19T13:40:22.308370+0000","last_became_active":"2024-09-19T13:40:20.103134+0000","last_became_peered":"2024-09-19T13:40:20.103134+0000","last_unstale":"2024-09-19T13:40:22.308370+0000","last_undegraded":"2024-09-19T13:40:22.308370+0000","last_fullsized":"2024-09-19T13:40:22.308370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:38.150405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093870599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:40:22.113992+0000","last_change":"2024-09-19T13:40:22.113992+0000","last_active":"2024-09-19T13:40:22.113992+0000","last_peered":"2024-09-19T13:40:22.113992+0000","last_clean":"2024-09-19T13:40:22.113992+0000","last_became_active":"2024-09-19T13:40:20.101186+0000","last_became_peered":"2024-09-19T13:40:20.101186+0000","last_unstale":"2024-09-19T13:40:22.113992+0000","last_undegraded":"2024-09-19T13:40:22.113992+0000","last_fullsized":"2024-09-19T13:40:22.113992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:40.208910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010323750000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:40:23.120767+0000","last_change":"2024-09-19T13:40:23.121258+0000","last_active":"2024-09-19T13:40:23.120767+0000","last_peered":"2024-09-19T13:40:23.120767+0000","last_clean":"2024-09-19T13:40:23.120767+0000","last_became_active":"2024-09-19T13:40:20.096321+0000","last_became_peered":"2024-09-19T13:40:20.096321+0000","last_unstale":"2024-09-19T13:40:23.120767+0000","last_undegraded":"2024-09-19T13:40:23.120767+0000","last_fullsized":"2024-09-19T13:40:23.120767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:56.853216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001025329,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:40:22.113821+0000","last_change":"2024-09-19T13:40:22.113821+0000","last_active":"2024-09-19T13:40:22.113821+0000","last_peered":"2024-09-19T13:40:22.113821+0000","last_clean":"2024-09-19T13:40:22.113821+0000","last_became_active":"2024-09-19T13:40:20.095294+0000","last_became_peered":"2024-09-19T13:40:20.095294+0000","last_unstale":"2024-09-19T13:40:22.113821+0000","last_undegraded":"2024-09-19T13:40:22.113821+0000","last_fullsized":"2024-09-19T13:40:22.113821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:38.696147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088577700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:40:22.122819+0000","last_change":"2024-09-19T13:40:22.121910+0000","last_active":"2024-09-19T13:40:22.122819+0000","last_peered":"2024-09-19T13:40:22.122819+0000","last_clean":"2024-09-19T13:40:22.122819+0000","last_became_active":"2024-09-19T13:40:20.101198+0000","last_became_peered":"2024-09-19T13:40:20.101198+0000","last_unstale":"2024-09-19T13:40:22.122819+0000","last_undegraded":"2024-09-19T13:40:22.122819+0000","last_fullsized":"2024-09-19T13:40:22.122819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:03:31.869167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026053059999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:40:22.374972+0000","last_change":"2024-09-19T13:40:22.375307+0000","last_active":"2024-09-19T13:40:22.374972+0000","last_peered":"2024-09-19T13:40:22.374972+0000","last_clean":"2024-09-19T13:40:22.374972+0000","last_became_active":"2024-09-19T13:40:20.096900+0000","last_became_peered":"2024-09-19T13:40:20.096900+0000","last_unstale":"2024-09-19T13:40:22.374972+0000","last_undegraded":"2024-09-19T13:40:22.374972+0000","last_fullsized":"2024-09-19T13:40:22.374972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:28.240242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074274699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:40:23.120594+0000","last_change":"2024-09-19T13:40:23.121191+0000","last_active":"2024-09-19T13:40:23.120594+0000","last_peered":"2024-09-19T13:40:23.120594+0000","last_clean":"2024-09-19T13:40:23.120594+0000","last_became_active":"2024-09-19T13:40:20.099608+0000","last_became_peered":"2024-09-19T13:40:20.099608+0000","last_unstale":"2024-09-19T13:40:23.120594+0000","last_undegraded":"2024-09-19T13:40:23.120594+0000","last_fullsized":"2024-09-19T13:40:23.120594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:29.188183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001034798,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:40:22.120433+0000","last_change":"2024-09-19T13:40:22.120433+0000","last_active":"2024-09-19T13:40:22.120433+0000","last_peered":"2024-09-19T13:40:22.120433+0000","last_clean":"2024-09-19T13:40:22.120433+0000","last_became_active":"2024-09-19T13:40:20.100760+0000","last_became_peered":"2024-09-19T13:40:20.100760+0000","last_unstale":"2024-09-19T13:40:22.120433+0000","last_undegraded":"2024-09-19T13:40:22.120433+0000","last_fullsized":"2024-09-19T13:40:22.120433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:10.051308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001106569,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T13:40:23.120054+0000","last_change":"2024-09-19T13:40:13.616691+0000","last_active":"2024-09-19T13:40:23.120054+0000","last_peered":"2024-09-19T13:40:23.120054+0000","last_clean":"2024-09-19T13:40:23.120054+0000","last_became_active":"2024-09-19T13:40:13.615965+0000","last_became_peered":"2024-09-19T13:40:13.615965+0000","last_unstale":"2024-09-19T13:40:23.120054+0000","last_undegraded":"2024-09-19T13:40:23.120054+0000","last_fullsized":"2024-09-19T13:40:23.120054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:12.602317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:12.602317+0000","last_clean_scrub_stamp":"2024-09-19T13:40:12.602317+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:03.931360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":794624,"data_stored":656513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":71977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":212992,"data_stored":71977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":71977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":71977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":794624,"data_stored":656513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T13:40:25.034 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T13:40:25.035 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T13:40:25.035 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-19T13:40:25.035 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-19T13:40:25.356 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:40:25.356 INFO:teuthology.orchestra.run.smithi153.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T13:40:25.373 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-19T13:40:25.373 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-19T13:40:25.385 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-09-19T13:40:25.386 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-19T13:40:25.390 DEBUG:teuthology.orchestra.run.smithi153:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-09-19T13:40:27.059 INFO:teuthology.orchestra.run.smithi153.stderr:......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+.......+............+..+.........+......+.+............+..+.+...+..+.........+....+.....+.+......+...+.....+.+...+...+..+.....................+....+...+..+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....................+..+.......+..+....+.........+.....+.+............+.......................+.+...........+.........+...............+.+.........+.....+......+...+...................+..+....+..........................+.+..+......+...................+...+.........+.....+...+.....................+......+.+..+.+.........................................+...............+.+.........+........+.+..+....+.........+......+...............+......+...+.........+.....................+..+........................+..................+.+..+...........................+......+......+.............+..+.............+..+.........................+...............+..............+.+.....+...+...+...+....+...+.....+..........+...............+..+...............+...............+...+....+.....+....+......+.........+..............+..........+...........+....+........+.......+..+....+......+...........+.........+.+..+.+.....+......+...+......+.......+....................+.......+............+...+......+.....+.+....................+.+.........+......+...+.........+.....+...+....+......+........+............+.............+.....+............+........................+...+......+....+........+..........+....................+.............+.....+.......+..............+....+.....+...............+.......+.........+.....+....+..+.........+......+....+.........+.....+.........+.+..+............+.+......+...........+..................+.......+..............+.+............+..+...+...............+.+.....+....+..+...+.......+......+.........+.....+...............+......+.......+..+.............+..................+..+.+......+.....+............................+.................+.........+................+.........+.........+........+...+.....................+...+.+..+....+...+..+.+.....+.............+.....+......+...+.+......+.....+....+......+....................+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-19T13:40:27.521 INFO:teuthology.orchestra.run.smithi153.stderr:..+.........+.....+..........+.....+......+............+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+.+.....+.........+......+.+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*............+......+..+...+.+...+.........................................+....+...+........+..........+..+............+.+.........+..+..........+........+...+....+...+...........+.+......+..+...+....+.....+................+...+..+.......+.................+.........+.+......+.............................+.+...+..+............+......+...............+....+............+........+......+....+......+............+........+.......+...+..............+..........+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-19T13:40:27.535 INFO:teuthology.orchestra.run.smithi153.stderr:----- 2024-09-19T13:40:27.543 DEBUG:teuthology.orchestra.run.smithi153:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/local/share/ca-certificates/root.crt 2024-09-19T13:40:27.611 DEBUG:teuthology.orchestra.run.smithi153:> sudo update-ca-certificates 2024-09-19T13:40:27.671 INFO:teuthology.orchestra.run.smithi153.stdout:Updating certificates in /etc/ssl/certs... 2024-09-19T13:40:28.314 INFO:teuthology.orchestra.run.smithi153.stderr:rehash: warning: skipping ca-certificates.crt,it does not contain exactly one certificate or CRL 2024-09-19T13:40:28.334 INFO:teuthology.orchestra.run.smithi153.stdout:1 added, 0 removed; done. 2024-09-19T13:40:28.343 INFO:teuthology.orchestra.run.smithi153.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-09-19T13:40:28.346 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T13:40:29.917 INFO:teuthology.orchestra.run.smithi153.stdout:Adding debian:root.pem 2024-09-19T13:40:29.941 INFO:teuthology.orchestra.run.smithi153.stdout:done. 2024-09-19T13:40:29.942 INFO:teuthology.orchestra.run.smithi153.stdout:done. 2024-09-19T13:40:29.947 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-19T13:40:29.995 DEBUG:teuthology.orchestra.run.smithi153:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi153.front.sepia.ceph.com 2024-09-19T13:40:30.268 INFO:teuthology.orchestra.run.smithi153.stderr:..+...+....+......+...+......+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+...+..+.......+..+....+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....+......+..+...+............................+..+....+..............+.+.....+......+.......+............+...+.....+.+......+........+...+...................+.....+...+.+..............+......+.......+........+......+...+..........+..+.............+.....+.+..+...+......+.+...+..............+..........+...+.....+..................+....+......+...............+..+.......+.....+.+......+...+............+.........+..+.......+..+.+........+....+..+....+.....+..........+..+..................+.......+..+.......+...+..+.+..+......+.......+.........+.....+.+..+...+...+.....................+.+..+.+..+...................+...+...+...+..+....+...+..+....+.....+.+.....+......+...+.+.....+......+...+....+......+.................+.......+........+............+......+......+...+.......+......+..+...+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-19T13:40:30.366 INFO:teuthology.orchestra.run.smithi153.stderr:...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+.+..............+...+...+.+...........+.......+........+.......+......+..+....+...............+...........+...+.+...+............+.....+...............+.........+.......+.................+.+.........+..+......+..........+...+..............+.+...............+.....+.+...+............+...+..+.........+.........+.+......+...+......+.................+.......+...+..+.............+............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-19T13:40:30.369 INFO:teuthology.orchestra.run.smithi153.stderr:----- 2024-09-19T13:40:30.373 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:40:30.373 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-19T13:40:30.419 DEBUG:teuthology.orchestra.run.smithi153:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-19T13:40:30.470 INFO:teuthology.orchestra.run.smithi153.stderr:Certificate request self-signature ok 2024-09-19T13:40:30.470 INFO:teuthology.orchestra.run.smithi153.stderr:subject=CN = smithi153.front.sepia.ceph.com 2024-09-19T13:40:30.482 DEBUG:teuthology.orchestra.run.smithi153:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-19T13:40:30.531 DEBUG:teuthology.orchestra.run.smithi153:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-19T13:40:30.583 INFO:teuthology.orchestra.run.smithi153.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-09-19T13:40:30.583 DEBUG:teuthology.orchestra.run.smithi153:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-19T13:40:30.631 INFO:teuthology.run_tasks:Running task rgw... 2024-09-19T13:40:30.645 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-09-19T13:40:30.645 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-19T13:40:30.645 INFO:tasks.rgw:Creating data pools 2024-09-19T13:40:30.646 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-19T13:40:30.646 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-09-19T13:40:31.196 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-19T13:40:33.181 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'default.rgw.buckets.data' created 2024-09-19T13:40:33.216 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-19T13:40:34.203 INFO:teuthology.orchestra.run.smithi153.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-19T13:40:34.244 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-19T13:40:35.198 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'default.rgw.buckets.index' created 2024-09-19T13:40:35.230 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-19T13:40:36.216 INFO:teuthology.orchestra.run.smithi153.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-19T13:40:36.256 DEBUG:tasks.rgw:Pools created 2024-09-19T13:40:36.257 INFO:tasks.rgw:Configuring compression type = random 2024-09-19T13:40:36.257 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-19T13:40:36.257 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-19T13:40:36.258 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-19T13:40:36.310 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:40:36.310 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:40:38.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.292+0000 7f8048efb640 0 -- >> [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] conn(0x5560b51f3370 msgr2=0x5560b51f37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2024-09-19T13:40:38.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.300+0000 7f804b3f59c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:38.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.300+0000 7f80496fc640 0 -- 172.21.15.153:0/1629529185 >> [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] conn(0x7f7f10071be0 msgr2=0x7f7f100740a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:40:38.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.300+0000 7f804b3f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:40:38.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.300+0000 7f804b3f59c0 20 realm 2024-09-19T13:40:38.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.300+0000 7f804b3f59c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:38.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.300+0000 7f804b3f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:40:38.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.300+0000 7f804b3f59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:40:38.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.300+0000 7f804b3f59c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:38.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.300+0000 7f804b3f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:40:38.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.300+0000 7f804b3f59c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:38.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.304+0000 7f804b3f59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:40:38.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.304+0000 7f804b3f59c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:38.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.304+0000 7f804b3f59c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T13:40:38.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.304+0000 7f804b3f59c0 20 searching for the correct realm 2024-09-19T13:40:38.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.324+0000 7f804b3f59c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:40:38.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.324+0000 7f804b3f59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:40:38.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.324+0000 7f804b3f59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:40:38.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.324+0000 7f804b3f59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:40:38.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.324+0000 7f804b3f59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:40:38.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.324+0000 7f804b3f59c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:40:38.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.324+0000 7f804b3f59c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:38.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.324+0000 7f804b3f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:40:38.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.324+0000 7f804b3f59c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:38.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.328+0000 7f804b3f59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:40:38.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.328+0000 7f804b3f59c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:38.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.328+0000 7f804b3f59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T13:40:38.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.328+0000 7f804b3f59c0 20 zone default found 2024-09-19T13:40:38.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.328+0000 7f804b3f59c0 4 Realm: () 2024-09-19T13:40:38.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.328+0000 7f804b3f59c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:40:38.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.328+0000 7f804b3f59c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:40:38.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.328+0000 7f804b3f59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:40:38.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.328+0000 7f804b3f59c0 20 zonegroup default 2024-09-19T13:40:38.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.328+0000 7f804b3f59c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:38.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.328+0000 7f804b3f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:40:38.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:38.328+0000 7f804b3f59c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:40.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:40.244+0000 7f804b3f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:40:40.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:40.244+0000 7f804b3f59c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:40.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:40.244+0000 7f804b3f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:40:40.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:40.244+0000 7f804b3f59c0 20 started sync module instance, tier type = 2024-09-19T13:40:40.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:40.244+0000 7f804b3f59c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:40:42.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.276+0000 7f804b3f59c0 20 add_watcher() i=0 2024-09-19T13:40:42.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.276+0000 7f804b3f59c0 20 add_watcher() i=1 2024-09-19T13:40:42.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.276+0000 7f804b3f59c0 20 add_watcher() i=2 2024-09-19T13:40:42.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.276+0000 7f804b3f59c0 20 add_watcher() i=3 2024-09-19T13:40:42.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.276+0000 7f804b3f59c0 20 add_watcher() i=4 2024-09-19T13:40:42.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.276+0000 7f804b3f59c0 20 add_watcher() i=5 2024-09-19T13:40:42.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.276+0000 7f804b3f59c0 20 add_watcher() i=6 2024-09-19T13:40:42.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.280+0000 7f804b3f59c0 20 add_watcher() i=7 2024-09-19T13:40:42.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.280+0000 7f804b3f59c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:40:42.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.280+0000 7f804b3f59c0 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-19T13:40:42.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.280+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-19T13:40:42.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.280+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.280+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-19T13:40:42.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.280+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-19T13:40:42.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.280+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.280+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-19T13:40:42.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.280+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-19T13:40:42.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.280+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.284+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-19T13:40:42.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.284+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-19T13:40:42.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.284+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.284+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-19T13:40:42.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.284+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-19T13:40:42.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.284+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.284+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-19T13:40:42.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.284+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-19T13:40:42.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.284+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.284+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-19T13:40:42.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.284+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-19T13:40:42.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.284+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.284+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-19T13:40:42.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.284+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-19T13:40:42.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.284+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.284+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-19T13:40:42.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.284+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-19T13:40:42.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.284+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.284+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-19T13:40:42.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.284+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-19T13:40:42.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.284+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.288+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-19T13:40:42.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.288+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-19T13:40:42.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.288+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.288+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-19T13:40:42.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.288+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-19T13:40:42.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.288+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.288+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-19T13:40:42.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.288+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-19T13:40:42.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.288+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.288+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-19T13:40:42.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.288+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-19T13:40:42.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.288+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.288+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-19T13:40:42.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.288+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-19T13:40:42.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.288+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.288+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-19T13:40:42.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.288+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-19T13:40:42.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.288+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.292+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-19T13:40:42.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.292+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-19T13:40:42.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.292+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.292+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-19T13:40:42.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.292+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-19T13:40:42.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.292+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.292+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-19T13:40:42.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.292+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-19T13:40:42.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.292+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.292+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-19T13:40:42.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.292+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-19T13:40:42.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.292+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.292+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-19T13:40:42.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.292+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-19T13:40:42.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.292+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.292+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-19T13:40:42.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.292+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-19T13:40:42.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.292+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.296+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-19T13:40:42.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.296+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-19T13:40:42.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.296+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.296+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-19T13:40:42.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.296+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-19T13:40:42.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.296+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.296+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-19T13:40:42.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.296+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-19T13:40:42.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.296+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.296+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-19T13:40:42.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.296+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-19T13:40:42.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.296+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.296+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-19T13:40:42.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.296+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-19T13:40:42.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.296+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.296+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-19T13:40:42.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.296+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-19T13:40:42.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.296+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.300+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-19T13:40:42.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.300+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-19T13:40:42.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.300+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.300+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-19T13:40:42.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.300+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-19T13:40:42.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.300+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.300+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-19T13:40:42.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.300+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-19T13:40:42.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.300+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.300+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-19T13:40:42.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.300+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-19T13:40:42.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.300+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.300+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-19T13:40:42.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.300+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-19T13:40:42.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.300+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.300+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-19T13:40:42.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.300+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-19T13:40:42.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.300+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.304+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-19T13:40:42.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.304+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-19T13:40:42.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.304+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.304+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-19T13:40:42.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.304+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-19T13:40:42.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.304+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.304+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-19T13:40:42.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.304+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-19T13:40:42.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.304+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.304+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-19T13:40:42.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.304+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-19T13:40:42.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.304+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.304+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-19T13:40:42.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.304+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-19T13:40:42.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.304+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.304+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-19T13:40:42.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.304+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-19T13:40:42.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.304+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.304+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-19T13:40:42.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.304+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-19T13:40:42.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.304+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.308+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-19T13:40:42.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.308+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-19T13:40:42.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.308+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.308+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-19T13:40:42.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.308+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-19T13:40:42.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.308+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.308+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-19T13:40:42.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.308+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-19T13:40:42.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.308+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.308+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-19T13:40:42.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.308+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-19T13:40:42.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.308+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.308+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-19T13:40:42.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.308+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-19T13:40:42.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.308+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.308+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-19T13:40:42.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.308+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-19T13:40:42.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.308+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.312+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-19T13:40:42.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.312+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-19T13:40:42.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.312+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.312+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-19T13:40:42.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.312+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-19T13:40:42.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.312+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.312+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-19T13:40:42.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.312+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-19T13:40:42.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.312+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.312+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-19T13:40:42.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.312+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-19T13:40:42.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.312+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.312+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-19T13:40:42.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.312+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-19T13:40:42.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.312+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.312+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-19T13:40:42.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.312+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-19T13:40:42.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.312+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.312+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-19T13:40:42.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.312+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-19T13:40:42.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.312+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.316+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-19T13:40:42.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.316+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-19T13:40:42.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.316+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.316+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-19T13:40:42.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.316+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-19T13:40:42.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.316+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.316+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-19T13:40:42.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.316+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-19T13:40:42.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.316+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.316+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-19T13:40:42.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.316+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-19T13:40:42.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.316+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.316+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-19T13:40:42.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.316+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-19T13:40:42.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.316+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.316+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-19T13:40:42.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.316+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-19T13:40:42.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.316+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.316+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-19T13:40:42.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.316+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-19T13:40:42.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.316+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.320+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-19T13:40:42.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.320+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-19T13:40:42.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.320+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.320+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-19T13:40:42.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.320+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-19T13:40:42.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.320+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.320+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-19T13:40:42.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.320+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-19T13:40:42.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.320+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.320+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-19T13:40:42.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.320+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-19T13:40:42.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.320+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.320+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-19T13:40:42.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.320+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-19T13:40:42.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.320+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.320+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-19T13:40:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.320+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-19T13:40:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.320+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.320+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-19T13:40:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.320+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-19T13:40:42.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.320+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.320+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-19T13:40:42.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.320+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-19T13:40:42.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.320+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.324+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-19T13:40:42.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.324+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-19T13:40:42.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.324+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.324+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-19T13:40:42.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.324+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-19T13:40:42.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.324+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.324+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-19T13:40:42.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.324+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-19T13:40:42.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.324+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.324+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-19T13:40:42.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.324+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-19T13:40:42.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.324+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.324+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-19T13:40:42.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.324+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-19T13:40:42.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.324+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.324+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-19T13:40:42.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.324+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-19T13:40:42.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.324+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.324+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-19T13:40:42.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.324+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-19T13:40:42.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.324+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.328+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-19T13:40:42.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.328+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-19T13:40:42.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.328+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.328+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-19T13:40:42.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.328+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-19T13:40:42.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.328+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.328+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-19T13:40:42.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.328+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-19T13:40:42.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.328+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.328+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-19T13:40:42.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.328+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-19T13:40:42.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.328+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.328+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-19T13:40:42.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.328+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-19T13:40:42.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.328+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.328+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-19T13:40:42.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.328+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-19T13:40:42.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.328+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.332+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-19T13:40:42.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.332+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-19T13:40:42.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.332+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.332+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-19T13:40:42.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.332+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-19T13:40:42.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.332+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.332+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-19T13:40:42.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.332+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-19T13:40:42.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.332+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.332+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-19T13:40:42.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.332+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-19T13:40:42.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.332+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.332+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-19T13:40:42.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.332+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-19T13:40:42.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.332+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.332+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-19T13:40:42.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.332+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-19T13:40:42.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.332+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.336+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-19T13:40:42.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.336+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-19T13:40:42.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.336+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.336+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-19T13:40:42.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.336+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-19T13:40:42.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.336+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.336+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-19T13:40:42.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.336+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-19T13:40:42.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.336+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.336+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-19T13:40:42.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.336+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-19T13:40:42.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.336+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.336+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-19T13:40:42.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.336+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-19T13:40:42.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.336+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.336+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-19T13:40:42.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.336+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-19T13:40:42.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.336+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.340+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-19T13:40:42.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.340+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-19T13:40:42.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.340+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.340+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-19T13:40:42.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.340+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-19T13:40:42.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.340+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.340+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-19T13:40:42.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.340+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-19T13:40:42.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.340+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.340+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-19T13:40:42.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.340+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-19T13:40:42.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.340+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.340+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-19T13:40:42.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.340+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-19T13:40:42.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.340+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.344+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-19T13:40:42.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.344+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-19T13:40:42.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.344+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.344+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-19T13:40:42.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.344+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-19T13:40:42.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.344+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.344+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-19T13:40:42.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.344+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-19T13:40:42.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.344+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.344+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-19T13:40:42.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.344+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-19T13:40:42.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.344+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.344+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-19T13:40:42.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.344+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-19T13:40:42.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.344+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.344+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-19T13:40:42.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.344+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-19T13:40:42.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.344+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.348+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-19T13:40:42.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.348+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-19T13:40:42.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.348+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.348+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-19T13:40:42.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.348+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-19T13:40:42.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.348+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.348+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-19T13:40:42.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.348+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-19T13:40:42.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.348+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.348+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-19T13:40:42.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.348+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-19T13:40:42.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.348+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.348+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-19T13:40:42.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.348+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-19T13:40:42.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.348+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.348+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-19T13:40:42.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.348+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-19T13:40:42.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.348+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.348+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-19T13:40:42.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.348+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-19T13:40:42.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.348+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.348+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-19T13:40:42.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.348+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-19T13:40:42.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.348+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.352+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-19T13:40:42.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.352+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-19T13:40:42.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.352+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.352+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-19T13:40:42.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.352+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-19T13:40:42.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.352+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.352+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-19T13:40:42.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.352+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-19T13:40:42.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.352+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.352+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-19T13:40:42.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.352+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-19T13:40:42.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.352+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.352+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-19T13:40:42.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.352+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-19T13:40:42.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.352+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.352+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-19T13:40:42.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.352+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-19T13:40:42.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.352+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.352+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-19T13:40:42.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.352+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-19T13:40:42.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.352+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.356+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-19T13:40:42.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.356+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-19T13:40:42.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.356+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.356+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-19T13:40:42.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.356+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-19T13:40:42.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.356+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.356+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-19T13:40:42.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.356+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-19T13:40:42.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.356+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.356+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-19T13:40:42.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.356+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-19T13:40:42.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.356+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.356+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-19T13:40:42.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.356+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-19T13:40:42.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.356+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.356+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-19T13:40:42.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.356+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-19T13:40:42.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.356+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.356+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-19T13:40:42.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.356+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-19T13:40:42.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.356+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.360+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-19T13:40:42.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.360+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-19T13:40:42.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.360+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.360+0000 7f804b3f59c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-19T13:40:42.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.360+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-19T13:40:42.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.364+0000 7f804b3f59c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-19T13:40:42.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.372+0000 7f7efafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:40:42.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.372+0000 7f804b3f59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:40:42.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:42.372+0000 7f804b3f59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:40:45.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.240+0000 7f804b3f59c0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-19T13:40:45.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.240+0000 7f804b3f59c0 5 note: GC not initialized 2024-09-19T13:40:45.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.248+0000 7f7ef9fe3640 20 reqs_thread_entry: start 2024-09-19T13:40:45.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.248+0000 7f804b3f59c0 20 init_complete bucket index max shards: 11 2024-09-19T13:40:45.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.248+0000 7f804b3f59c0 20 Filter name: none 2024-09-19T13:40:45.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.248+0000 7f7e5b7fe640 20 reqs_thread_entry: start 2024-09-19T13:40:45.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.292+0000 7f7efafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:40:45.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.300+0000 7f804b3f59c0 20 remove_watcher() i=0 2024-09-19T13:40:45.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.300+0000 7f804b3f59c0 2 removed watcher, disabling cache 2024-09-19T13:40:45.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.300+0000 7f804b3f59c0 20 remove_watcher() i=1 2024-09-19T13:40:45.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.304+0000 7f804b3f59c0 20 remove_watcher() i=2 2024-09-19T13:40:45.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.308+0000 7f804b3f59c0 20 remove_watcher() i=3 2024-09-19T13:40:45.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.312+0000 7f804b3f59c0 20 remove_watcher() i=4 2024-09-19T13:40:45.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.312+0000 7f804b3f59c0 20 remove_watcher() i=5 2024-09-19T13:40:45.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.316+0000 7f804b3f59c0 20 remove_watcher() i=6 2024-09-19T13:40:45.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.316+0000 7f804b3f59c0 20 remove_watcher() i=7 2024-09-19T13:40:45.340 INFO:teuthology.orchestra.run.smithi153.stdout:[] 2024-09-19T13:40:45.340 DEBUG:tasks.util.rgw: json result: [] 2024-09-19T13:40:45.340 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-19T13:40:45.340 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-19T13:40:45.340 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-19T13:40:45.383 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:40:45.383 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:40:45.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.408+0000 7f1e8cb729c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:40:45.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.408+0000 7f1e8cb729c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:40:45.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.412+0000 7f1d4d7e2640 20 reqs_thread_entry: start 2024-09-19T13:40:45.437 INFO:teuthology.orchestra.run.smithi153.stdout:{"id":"dbb1da81-49d0-421a-b677-974869a7f103","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-19T13:40:45.438 DEBUG:tasks.util.rgw: json result: {'id': 'dbb1da81-49d0-421a-b677-974869a7f103', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-19T13:40:45.438 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-19T13:40:45.438 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-19T13:40:45.438 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-19T13:40:45.511 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:40:45.511 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:40:45.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.548+0000 7fac0715d9c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:45.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.548+0000 7fac0715d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:40:45.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.548+0000 7fac0715d9c0 20 realm 2024-09-19T13:40:45.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.548+0000 7fac0715d9c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:45.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.548+0000 7fac0715d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:40:45.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.548+0000 7fac0715d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:40:45.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.548+0000 7fac0715d9c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:45.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.548+0000 7fac0715d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:40:45.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.548+0000 7fac0715d9c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:45.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.552+0000 7fac0715d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:40:45.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.552+0000 7fac0715d9c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:45.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.552+0000 7fac0715d9c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-19T13:40:45.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.552+0000 7fac0715d9c0 20 searching for the correct realm 2024-09-19T13:40:45.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.556+0000 7fac04462640 0 -- 172.21.15.153:0/2887494954 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x55b159eae3f0 msgr2=0x55b159eb07e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:40:45.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.564+0000 7fac04c63640 0 -- 172.21.15.153:0/2887494954 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fabec07f6d0 msgr2=0x7fabec082fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:40:45.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.572+0000 7fac0715d9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:40:45.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.572+0000 7fac0715d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:40:45.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.572+0000 7fac0715d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:40:45.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.572+0000 7fac0715d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:40:45.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.572+0000 7fac0715d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:40:45.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.572+0000 7fac0715d9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:40:45.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.572+0000 7fac0715d9c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:45.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.572+0000 7fac0715d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:40:45.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.572+0000 7fac0715d9c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:45.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.572+0000 7fac0715d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:40:45.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.572+0000 7fac0715d9c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:45.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.572+0000 7fac0715d9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T13:40:45.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.572+0000 7fac0715d9c0 20 zone default found 2024-09-19T13:40:45.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.572+0000 7fac0715d9c0 4 Realm: () 2024-09-19T13:40:45.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.572+0000 7fac0715d9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:40:45.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.572+0000 7fac0715d9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:40:45.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.572+0000 7fac0715d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:40:45.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.572+0000 7fac0715d9c0 20 zonegroup default 2024-09-19T13:40:45.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.572+0000 7fac0715d9c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:45.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.572+0000 7fac0715d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:40:45.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.572+0000 7fac0715d9c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:45.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.576+0000 7fac0715d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:40:45.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.576+0000 7fac0715d9c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:45.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.576+0000 7fac0715d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:40:45.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.576+0000 7fac0715d9c0 20 started sync module instance, tier type = 2024-09-19T13:40:45.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.576+0000 7fac0715d9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:40:45.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.592+0000 7fac0715d9c0 20 add_watcher() i=0 2024-09-19T13:40:45.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.592+0000 7fac0715d9c0 20 add_watcher() i=1 2024-09-19T13:40:45.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.592+0000 7fac0715d9c0 20 add_watcher() i=2 2024-09-19T13:40:45.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.592+0000 7fac0715d9c0 20 add_watcher() i=3 2024-09-19T13:40:45.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.592+0000 7fac0715d9c0 20 add_watcher() i=4 2024-09-19T13:40:45.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.592+0000 7fac0715d9c0 20 add_watcher() i=5 2024-09-19T13:40:45.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.592+0000 7fac0715d9c0 20 add_watcher() i=6 2024-09-19T13:40:45.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.592+0000 7fac0715d9c0 20 add_watcher() i=7 2024-09-19T13:40:45.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.592+0000 7fac0715d9c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:40:45.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.596+0000 7faabafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:40:45.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.596+0000 7fac0715d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:40:45.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.596+0000 7fac0715d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:40:45.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.596+0000 7fac0715d9c0 5 note: GC not initialized 2024-09-19T13:40:45.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.596+0000 7faab9fe3640 20 reqs_thread_entry: start 2024-09-19T13:40:45.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.596+0000 7fac0715d9c0 20 init_complete bucket index max shards: 11 2024-09-19T13:40:45.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.596+0000 7fac0715d9c0 20 Filter name: none 2024-09-19T13:40:45.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.596+0000 7faa2b7fe640 20 reqs_thread_entry: start 2024-09-19T13:40:45.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.612+0000 7faabafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:40:45.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.620+0000 7fac0715d9c0 20 remove_watcher() i=0 2024-09-19T13:40:45.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.620+0000 7fac0715d9c0 2 removed watcher, disabling cache 2024-09-19T13:40:45.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.620+0000 7fac0715d9c0 20 remove_watcher() i=1 2024-09-19T13:40:45.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.624+0000 7fac0715d9c0 20 remove_watcher() i=2 2024-09-19T13:40:45.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.624+0000 7fac0715d9c0 20 remove_watcher() i=3 2024-09-19T13:40:45.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.628+0000 7fac0715d9c0 20 remove_watcher() i=4 2024-09-19T13:40:45.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.628+0000 7fac0715d9c0 20 remove_watcher() i=5 2024-09-19T13:40:45.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.632+0000 7fac0715d9c0 20 remove_watcher() i=6 2024-09-19T13:40:45.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.632+0000 7fac0715d9c0 20 remove_watcher() i=7 2024-09-19T13:40:45.650 INFO:teuthology.orchestra.run.smithi153.stdout:[] 2024-09-19T13:40:45.650 DEBUG:tasks.util.rgw: json result: [] 2024-09-19T13:40:45.650 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-19T13:40:45.650 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-19T13:40:45.650 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-19T13:40:45.732 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:40:45.732 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:40:45.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.756+0000 7fa0298149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:40:45.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.756+0000 7fa0298149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:40:45.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.760+0000 7f9e85ffb640 20 reqs_thread_entry: start 2024-09-19T13:40:45.787 INFO:teuthology.orchestra.run.smithi153.stdout:{"id":"dbb1da81-49d0-421a-b677-974869a7f103","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-19T13:40:45.787 DEBUG:tasks.util.rgw: json result: {'id': 'dbb1da81-49d0-421a-b677-974869a7f103', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-19T13:40:45.787 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-19T13:40:45.787 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-19T13:40:45.787 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-19T13:40:45.860 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:40:45.861 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:40:45.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.896+0000 7f68efece9c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:45.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.900+0000 7f68efece9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:40:45.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.900+0000 7f68efece9c0 20 realm 2024-09-19T13:40:45.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.900+0000 7f68efece9c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:45.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.900+0000 7f68efece9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:40:45.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.900+0000 7f68efece9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:40:45.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.900+0000 7f68efece9c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:45.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.900+0000 7f68efece9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:40:45.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.900+0000 7f68efece9c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:45.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.900+0000 7f68efece9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:40:45.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.900+0000 7f68efece9c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:45.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.900+0000 7f68efece9c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-19T13:40:45.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.900+0000 7f68efece9c0 20 searching for the correct realm 2024-09-19T13:40:45.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.904+0000 7f68ed9d4640 0 -- 172.21.15.153:0/3119543498 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x5563a86606c0 msgr2=0x7f68e00fb780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:40:45.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.908+0000 7f68ee1d5640 0 -- 172.21.15.153:0/3119543498 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f68d8010040 msgr2=0x7f68d805ca20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:40:45.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:40:45.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:40:45.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:40:45.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:40:45.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:40:45.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:40:45.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:45.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:40:45.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:45.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:40:45.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:45.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T13:40:45.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 20 zone default found 2024-09-19T13:40:45.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 4 Realm: () 2024-09-19T13:40:45.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:40:45.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:40:45.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:40:45.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 20 zonegroup default 2024-09-19T13:40:45.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:45.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:40:45.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:45.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:40:45.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 20 rados->read ofs=0 len=0 2024-09-19T13:40:45.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:40:45.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 20 started sync module instance, tier type = 2024-09-19T13:40:45.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.920+0000 7f68efece9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:40:45.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.940+0000 7f68efece9c0 20 add_watcher() i=0 2024-09-19T13:40:45.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.940+0000 7f68efece9c0 20 add_watcher() i=1 2024-09-19T13:40:45.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.940+0000 7f68efece9c0 20 add_watcher() i=2 2024-09-19T13:40:45.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.940+0000 7f68efece9c0 20 add_watcher() i=3 2024-09-19T13:40:45.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.940+0000 7f68efece9c0 20 add_watcher() i=4 2024-09-19T13:40:45.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.940+0000 7f68efece9c0 20 add_watcher() i=5 2024-09-19T13:40:45.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.940+0000 7f68efece9c0 20 add_watcher() i=6 2024-09-19T13:40:45.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.940+0000 7f68efece9c0 20 add_watcher() i=7 2024-09-19T13:40:45.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.940+0000 7f68efece9c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:40:45.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.944+0000 7f679f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:40:45.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.944+0000 7f68efece9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:40:45.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.944+0000 7f68efece9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:40:45.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.944+0000 7f68efece9c0 5 note: GC not initialized 2024-09-19T13:40:45.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.944+0000 7f679e7fc640 20 reqs_thread_entry: start 2024-09-19T13:40:45.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.944+0000 7f68efece9c0 20 init_complete bucket index max shards: 11 2024-09-19T13:40:45.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.944+0000 7f68efece9c0 20 Filter name: none 2024-09-19T13:40:45.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.944+0000 7f670ffff640 20 reqs_thread_entry: start 2024-09-19T13:40:45.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.960+0000 7f679f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:40:45.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.964+0000 7f68efece9c0 20 remove_watcher() i=0 2024-09-19T13:40:45.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.964+0000 7f68efece9c0 2 removed watcher, disabling cache 2024-09-19T13:40:45.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.968+0000 7f68efece9c0 20 remove_watcher() i=1 2024-09-19T13:40:45.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.972+0000 7f68efece9c0 20 remove_watcher() i=2 2024-09-19T13:40:45.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.972+0000 7f68efece9c0 20 remove_watcher() i=3 2024-09-19T13:40:45.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.976+0000 7f68efece9c0 20 remove_watcher() i=4 2024-09-19T13:40:45.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.976+0000 7f68efece9c0 20 remove_watcher() i=5 2024-09-19T13:40:45.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.976+0000 7f68efece9c0 20 remove_watcher() i=6 2024-09-19T13:40:45.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:45.980+0000 7f68efece9c0 20 remove_watcher() i=7 2024-09-19T13:40:45.996 INFO:teuthology.orchestra.run.smithi153.stdout:[] 2024-09-19T13:40:45.996 DEBUG:tasks.util.rgw: json result: [] 2024-09-19T13:40:45.996 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-19T13:40:45.996 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-19T13:40:45.996 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-19T13:40:45.997 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-19T13:40:46.080 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:40:46.080 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:40:46.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:46.104+0000 7fe7b846f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:40:46.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:46.104+0000 7fe7b846f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:40:46.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:46.108+0000 7fe678fe1640 20 reqs_thread_entry: start 2024-09-19T13:40:46.134 INFO:teuthology.orchestra.run.smithi153.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-19T13:40:46.135 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-19T13:40:46.135 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-19T13:40:46.135 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-19T13:40:46.135 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-19T13:40:46.219 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:40:46.219 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:40:46.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:46.248+0000 7fb7c9a309c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:40:46.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:46.248+0000 7fb7c9a309c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:40:46.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:46.252+0000 7fb625ffb640 20 reqs_thread_entry: start 2024-09-19T13:40:46.277 INFO:teuthology.orchestra.run.smithi153.stdout:{"id":"dbb1da81-49d0-421a-b677-974869a7f103","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-19T13:40:46.277 DEBUG:tasks.util.rgw: json result: {'id': 'dbb1da81-49d0-421a-b677-974869a7f103', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-19T13:40:46.278 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-19T13:40:46.278 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-19T13:40:46.278 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-19T13:40:46.278 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-19T13:40:46.359 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:40:46.360 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:40:46.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:46.384+0000 7f1be31df9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:40:46.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:46.384+0000 7f1be31df9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:40:46.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:46.388+0000 7f1a26ffd640 20 reqs_thread_entry: start 2024-09-19T13:40:46.414 INFO:teuthology.orchestra.run.smithi153.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-19T13:40:46.414 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-19T13:40:46.414 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-19T13:40:46.414 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-19T13:40:46.414 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-19T13:40:46.496 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:40:46.496 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:40:46.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:46.520+0000 7f7d3ae5f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:40:46.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:46.520+0000 7f7d3ae5f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:40:46.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T13:40:46.524+0000 7f7bf77fe640 20 reqs_thread_entry: start 2024-09-19T13:40:46.548 INFO:teuthology.orchestra.run.smithi153.stdout:{"id":"dbb1da81-49d0-421a-b677-974869a7f103","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-19T13:40:46.548 DEBUG:tasks.util.rgw: json result: {'id': 'dbb1da81-49d0-421a-b677-974869a7f103', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-19T13:40:46.548 INFO:tasks.rgw:Starting rgw... 2024-09-19T13:40:46.548 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-09-19T13:40:46.548 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-19T13:40:46.549 DEBUG:teuthology.orchestra.run.smithi153:> sudo echo -n https://smithi153.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-19T13:40:46.608 INFO:teuthology.orchestra.run.smithi153.stdout:https://smithi153.front.sepia.ceph.com:443 2024-09-19T13:40:46.609 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-19T13:40:46.665 DEBUG:teuthology.orchestra.run.smithi153:> sudo keytool -import -alias smithi153.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-09-19T13:40:46.967 INFO:teuthology.orchestra.run.smithi153.stderr:Warning: use -cacerts option to access cacerts keystore 2024-09-19T13:40:47.327 INFO:teuthology.orchestra.run.smithi153.stderr:Certificate was added to keystore 2024-09-19T13:40:47.368 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-09-19T13:40:47.368 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-19T13:40:47.368 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-19T13:40:47.371 INFO:tasks.rgw.client.0:Started 2024-09-19T13:40:47.371 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi153.front.sepia.ceph.com:443/ 2024-09-19T13:40:47.371 DEBUG:teuthology.orchestra.run.smithi153:> curl https://smithi153.front.sepia.ceph.com:443/ 2024-09-19T13:40:47.401 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-19T13:40:47.402 INFO:teuthology.orchestra.run.smithi153.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-19T13:40:47.402 INFO:teuthology.orchestra.run.smithi153.stderr: Dload Upload Total Spent Left Speed 2024-09-19T13:40:47.402 INFO:teuthology.orchestra.run.smithi153.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-19T13:40:47.402 INFO:teuthology.orchestra.run.smithi153.stderr:curl: (7) Failed to connect to smithi153.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-19T13:40:48.403 DEBUG:teuthology.orchestra.run.smithi153:> curl https://smithi153.front.sepia.ceph.com:443/ 2024-09-19T13:40:48.413 INFO:teuthology.orchestra.run.smithi153.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-19T13:40:48.414 INFO:teuthology.orchestra.run.smithi153.stderr: Dload Upload Total Spent Left Speed 2024-09-19T13:40:48.414 INFO:teuthology.orchestra.run.smithi153.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-19T13:40:48.414 INFO:teuthology.orchestra.run.smithi153.stderr:curl: (7) Failed to connect to smithi153.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-19T13:40:48.414 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-19T13:40:50.416 DEBUG:teuthology.orchestra.run.smithi153:> curl https://smithi153.front.sepia.ceph.com:443/ 2024-09-19T13:40:50.426 INFO:teuthology.orchestra.run.smithi153.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-19T13:40:50.426 INFO:teuthology.orchestra.run.smithi153.stderr: Dload Upload Total Spent Left Speed 2024-09-19T13:40:50.426 INFO:teuthology.orchestra.run.smithi153.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-19T13:40:50.426 INFO:teuthology.orchestra.run.smithi153.stderr:curl: (7) Failed to connect to smithi153.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-19T13:40:50.427 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-19T13:40:54.428 DEBUG:teuthology.orchestra.run.smithi153:> curl https://smithi153.front.sepia.ceph.com:443/ 2024-09-19T13:40:54.440 INFO:teuthology.orchestra.run.smithi153.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-19T13:40:54.440 INFO:teuthology.orchestra.run.smithi153.stderr: Dload Upload Total Spent Left Speed 2024-09-19T13:40:54.440 INFO:teuthology.orchestra.run.smithi153.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-19T13:40:54.440 INFO:teuthology.orchestra.run.smithi153.stderr:curl: (7) Failed to connect to smithi153.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-19T13:40:54.440 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-19T13:41:02.444 DEBUG:teuthology.orchestra.run.smithi153:> curl https://smithi153.front.sepia.ceph.com:443/ 2024-09-19T13:41:02.455 INFO:teuthology.orchestra.run.smithi153.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-19T13:41:02.455 INFO:teuthology.orchestra.run.smithi153.stderr: Dload Upload Total Spent Left Speed 2024-09-19T13:41:02.457 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-19T13:41:02.457 INFO:teuthology.orchestra.run.smithi153.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-19T13:41:02.458 INFO:teuthology.orchestra.run.smithi153.stderr:curl: (7) Failed to connect to smithi153.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-19T13:41:12.110 INFO:tasks.rgw.client.0.smithi153.stdout:2024-09-19T13:41:11.731+0000 8edcf80 -1 ssl_private_key was not found: rgw/cert//default.key 2024-09-19T13:41:18.458 DEBUG:teuthology.orchestra.run.smithi153:> curl https://smithi153.front.sepia.ceph.com:443/ 2024-09-19T13:41:18.470 INFO:teuthology.orchestra.run.smithi153.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-19T13:41:18.470 INFO:teuthology.orchestra.run.smithi153.stderr: Dload Upload Total Spent Left Speed 2024-09-19T13:41:19.568 INFO:teuthology.orchestra.run.smithi153.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 38 0 38 0 0 35 0 --:--:-- 0:00:01 --:--:-- 35 100 187 0 187 0 0 170 0 --:--:-- 0:00:01 --:--:-- 170 2024-09-19T13:41:19.572 INFO:teuthology.orchestra.run.smithi153.stdout:anonymous 2024-09-19T13:41:19.573 INFO:teuthology.run_tasks:Running task tox... 2024-09-19T13:41:19.583 INFO:tasks.tox:Deploying tox from pip... 2024-09-19T13:41:19.584 DEBUG:teuthology.orchestra.run.smithi153:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-19T13:41:22.475 DEBUG:teuthology.orchestra.run.smithi153:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-19T13:41:23.118 INFO:teuthology.orchestra.run.smithi153.stdout:Collecting tox==3.15.0 2024-09-19T13:41:23.215 INFO:teuthology.orchestra.run.smithi153.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-19T13:41:23.274 INFO:teuthology.orchestra.run.smithi153.stdout: ---------------------------------------- 82.1/82.1 KB 1.4 MB/s eta 0:00:00 2024-09-19T13:41:23.416 INFO:teuthology.orchestra.run.smithi153.stdout:Collecting filelock<4,>=3.0.0 2024-09-19T13:41:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: Downloading filelock-3.16.1-py3-none-any.whl (16 kB) 2024-09-19T13:41:23.542 INFO:teuthology.orchestra.run.smithi153.stdout:Collecting packaging>=14 2024-09-19T13:41:23.556 INFO:teuthology.orchestra.run.smithi153.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-19T13:41:23.583 INFO:teuthology.orchestra.run.smithi153.stdout: ---------------------------------------- 54.0/54.0 KB 1.9 MB/s eta 0:00:00 2024-09-19T13:41:23.654 INFO:teuthology.orchestra.run.smithi153.stdout:Collecting toml>=0.9.4 2024-09-19T13:41:23.670 INFO:teuthology.orchestra.run.smithi153.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-19T13:41:23.964 INFO:teuthology.orchestra.run.smithi153.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-19T13:41:23.980 INFO:teuthology.orchestra.run.smithi153.stdout: Downloading virtualenv-20.26.5-py3-none-any.whl (6.0 MB) 2024-09-19T13:41:24.164 INFO:teuthology.orchestra.run.smithi153.stdout: ---------------------------------------- 6.0/6.0 MB 33.4 MB/s eta 0:00:00 2024-09-19T13:41:24.303 INFO:teuthology.orchestra.run.smithi153.stdout:Collecting py<2,>=1.4.17 2024-09-19T13:41:24.319 INFO:teuthology.orchestra.run.smithi153.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-19T13:41:24.361 INFO:teuthology.orchestra.run.smithi153.stdout: ---------------------------------------- 98.7/98.7 KB 2.3 MB/s eta 0:00:00 2024-09-19T13:41:24.453 INFO:teuthology.orchestra.run.smithi153.stdout:Collecting pluggy<1,>=0.12.0 2024-09-19T13:41:24.469 INFO:teuthology.orchestra.run.smithi153.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-19T13:41:24.572 INFO:teuthology.orchestra.run.smithi153.stdout:Collecting six<2,>=1.14.0 2024-09-19T13:41:24.588 INFO:teuthology.orchestra.run.smithi153.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-19T13:41:24.751 INFO:teuthology.orchestra.run.smithi153.stdout:Collecting distlib<1,>=0.3.7 2024-09-19T13:41:24.766 INFO:teuthology.orchestra.run.smithi153.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-19T13:41:24.814 INFO:teuthology.orchestra.run.smithi153.stdout: -------------------------------------- 468.9/468.9 KB 10.6 MB/s eta 0:00:00 2024-09-19T13:41:24.933 INFO:teuthology.orchestra.run.smithi153.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-19T13:41:24.946 INFO:teuthology.orchestra.run.smithi153.stdout: Downloading platformdirs-4.3.6-py3-none-any.whl (18 kB) 2024-09-19T13:41:25.120 INFO:teuthology.orchestra.run.smithi153.stdout:Installing collected packages: distlib, toml, six, py, pluggy, platformdirs, packaging, filelock, virtualenv, tox 2024-09-19T13:41:26.292 INFO:teuthology.orchestra.run.smithi153.stdout:Successfully installed distlib-0.3.8 filelock-3.16.1 packaging-24.1 platformdirs-4.3.6 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.5 2024-09-19T13:41:26.403 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T13:41:26.415 INFO:tasks.workunit:Pulling workunits from ref 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:41:26.415 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T13:41:26.415 DEBUG:teuthology.orchestra.run.smithi153:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T13:41:26.421 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T13:41:26.421 INFO:teuthology.orchestra.run.smithi153.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-19T13:41:26.422 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T13:41:26.468 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-19T13:41:26.468 DEBUG:teuthology.orchestra.run.smithi153:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-19T13:41:26.516 INFO:tasks.workunit:timeout=3h 2024-09-19T13:41:26.516 INFO:tasks.workunit:cleanup=True 2024-09-19T13:41:26.516 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:41:26.565 INFO:tasks.workunit.client.0.smithi153.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T13:42:24.912 INFO:tasks.workunit.client.0.smithi153.stderr:Note: switching to '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'. 2024-09-19T13:42:24.912 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:42:24.912 INFO:tasks.workunit.client.0.smithi153.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T13:42:24.912 INFO:tasks.workunit.client.0.smithi153.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T13:42:24.912 INFO:tasks.workunit.client.0.smithi153.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T13:42:24.912 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:42:24.912 INFO:tasks.workunit.client.0.smithi153.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T13:42:24.913 INFO:tasks.workunit.client.0.smithi153.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T13:42:24.913 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:42:24.913 INFO:tasks.workunit.client.0.smithi153.stderr: git switch -c 2024-09-19T13:42:24.913 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:42:24.913 INFO:tasks.workunit.client.0.smithi153.stderr:Or undo this operation with: 2024-09-19T13:42:24.913 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:42:24.913 INFO:tasks.workunit.client.0.smithi153.stderr: git switch - 2024-09-19T13:42:24.913 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:42:24.913 INFO:tasks.workunit.client.0.smithi153.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T13:42:24.913 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:42:24.913 INFO:tasks.workunit.client.0.smithi153.stderr:HEAD is now at 08af21e0d16 rgw_log_backing: error code not returned 2024-09-19T13:42:24.918 DEBUG:teuthology.orchestra.run.smithi153:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T13:42:24.965 INFO:tasks.workunit.client.0.smithi153.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T13:42:24.968 INFO:tasks.workunit.client.0.smithi153.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T13:42:24.968 INFO:tasks.workunit.client.0.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T13:42:25.794 INFO:tasks.workunit.client.0.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T13:42:25.867 INFO:tasks.workunit.client.0.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T13:42:25.917 INFO:tasks.workunit.client.0.smithi153.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T13:42:25.918 INFO:tasks.workunit.client.0.smithi153.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T13:42:25.918 INFO:tasks.workunit.client.0.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T13:42:25.962 INFO:tasks.workunit.client.0.smithi153.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T13:42:25.966 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:42:25.966 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T13:42:26.013 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-19T13:42:26.014 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-19T13:42:26.014 DEBUG:teuthology.orchestra.run.smithi153:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-19T13:42:26.065 INFO:tasks.workunit.client.0.smithi153.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-19T13:42:26.066 INFO:tasks.workunit.client.0.smithi153.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T13:42:26.066 INFO:tasks.workunit.client.0.smithi153.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T13:42:29.000 INFO:tasks.workunit.client.0.smithi153.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-19T13:42:29.000 INFO:tasks.workunit.client.0.smithi153.stderr:++ deactivate nondestructive 2024-09-19T13:42:29.000 INFO:tasks.workunit.client.0.smithi153.stderr:++ '[' -n '' ']' 2024-09-19T13:42:29.000 INFO:tasks.workunit.client.0.smithi153.stderr:++ '[' -n '' ']' 2024-09-19T13:42:29.000 INFO:tasks.workunit.client.0.smithi153.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T13:42:29.000 INFO:tasks.workunit.client.0.smithi153.stderr:++ hash -r 2024-09-19T13:42:29.000 INFO:tasks.workunit.client.0.smithi153.stderr:++ '[' -n '' ']' 2024-09-19T13:42:29.000 INFO:tasks.workunit.client.0.smithi153.stderr:++ unset VIRTUAL_ENV 2024-09-19T13:42:29.001 INFO:tasks.workunit.client.0.smithi153.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-19T13:42:29.001 INFO:tasks.workunit.client.0.smithi153.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-19T13:42:29.001 INFO:tasks.workunit.client.0.smithi153.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T13:42:29.001 INFO:tasks.workunit.client.0.smithi153.stderr:++ export VIRTUAL_ENV 2024-09-19T13:42:29.001 INFO:tasks.workunit.client.0.smithi153.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-19T13:42:29.001 INFO:tasks.workunit.client.0.smithi153.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-19T13:42:29.001 INFO:tasks.workunit.client.0.smithi153.stderr:++ export PATH 2024-09-19T13:42:29.001 INFO:tasks.workunit.client.0.smithi153.stderr:++ '[' -n '' ']' 2024-09-19T13:42:29.001 INFO:tasks.workunit.client.0.smithi153.stderr:++ '[' -z '' ']' 2024-09-19T13:42:29.001 INFO:tasks.workunit.client.0.smithi153.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-19T13:42:29.001 INFO:tasks.workunit.client.0.smithi153.stderr:++ PS1='(rgw) ' 2024-09-19T13:42:29.001 INFO:tasks.workunit.client.0.smithi153.stderr:++ export PS1 2024-09-19T13:42:29.001 INFO:tasks.workunit.client.0.smithi153.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-19T13:42:29.002 INFO:tasks.workunit.client.0.smithi153.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-19T13:42:29.002 INFO:tasks.workunit.client.0.smithi153.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T13:42:29.002 INFO:tasks.workunit.client.0.smithi153.stderr:++ hash -r 2024-09-19T13:42:29.002 INFO:tasks.workunit.client.0.smithi153.stderr:+ pip install pip --upgrade 2024-09-19T13:42:29.352 INFO:tasks.workunit.client.0.smithi153.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-19T13:42:29.591 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting pip 2024-09-19T13:42:29.694 INFO:tasks.workunit.client.0.smithi153.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-19T13:42:29.979 INFO:tasks.workunit.client.0.smithi153.stdout: ---------------------------------------- 1.8/1.8 MB 6.4 MB/s eta 0:00:00 2024-09-19T13:42:30.053 INFO:tasks.workunit.client.0.smithi153.stdout:Installing collected packages: pip 2024-09-19T13:42:30.053 INFO:tasks.workunit.client.0.smithi153.stdout: Attempting uninstall: pip 2024-09-19T13:42:30.054 INFO:tasks.workunit.client.0.smithi153.stdout: Found existing installation: pip 22.0.2 2024-09-19T13:42:30.351 INFO:tasks.workunit.client.0.smithi153.stdout: Uninstalling pip-22.0.2: 2024-09-19T13:42:30.358 INFO:tasks.workunit.client.0.smithi153.stdout: Successfully uninstalled pip-22.0.2 2024-09-19T13:42:31.358 INFO:tasks.workunit.client.0.smithi153.stdout:Successfully installed pip-24.2 2024-09-19T13:42:31.428 INFO:tasks.workunit.client.0.smithi153.stderr:+ pip install boto3 2024-09-19T13:42:32.518 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting boto3 2024-09-19T13:42:32.564 INFO:tasks.workunit.client.0.smithi153.stdout: Downloading boto3-1.35.22-py3-none-any.whl.metadata (6.6 kB) 2024-09-19T13:42:33.224 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting botocore<1.36.0,>=1.35.22 (from boto3) 2024-09-19T13:42:33.238 INFO:tasks.workunit.client.0.smithi153.stdout: Downloading botocore-1.35.22-py3-none-any.whl.metadata (5.7 kB) 2024-09-19T13:42:33.367 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-19T13:42:33.382 INFO:tasks.workunit.client.0.smithi153.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-19T13:42:33.528 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-19T13:42:33.545 INFO:tasks.workunit.client.0.smithi153.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-19T13:42:33.700 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T13:42:33.717 INFO:tasks.workunit.client.0.smithi153.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-19T13:42:33.891 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T13:42:33.906 INFO:tasks.workunit.client.0.smithi153.stdout: Downloading urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-19T13:42:34.166 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T13:42:34.180 INFO:tasks.workunit.client.0.smithi153.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-19T13:42:34.257 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading boto3-1.35.22-py3-none-any.whl (139 kB) 2024-09-19T13:42:34.357 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading botocore-1.35.22-py3-none-any.whl (12.6 MB) 2024-09-19T13:42:34.600 INFO:tasks.workunit.client.0.smithi153.stdout: ---------------------------------------- 12.6/12.6 MB 54.4 MB/s eta 0:00:00 2024-09-19T13:42:34.617 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-19T13:42:34.683 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-19T13:42:34.751 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-19T13:42:34.816 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-19T13:42:34.883 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-19T13:42:35.061 INFO:tasks.workunit.client.0.smithi153.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-19T13:42:36.281 INFO:tasks.workunit.client.0.smithi153.stdout:Successfully installed boto3-1.35.22 botocore-1.35.22 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-19T13:42:36.720 INFO:tasks.workunit.client.0.smithi153.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-19T13:42:36.867 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-19T13:42:36.907 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:36.908 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:36.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.945+0000 7f55ddbaa9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:36.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.949+0000 7f55ddbaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:36.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.949+0000 7f55ddbaa9c0 20 realm 2024-09-19T13:42:36.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.949+0000 7f55ddbaa9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:36.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.949+0000 7f55ddbaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:36.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.949+0000 7f55ddbaa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:36.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.949+0000 7f55ddbaa9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:36.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.949+0000 7f55ddbaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:36.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.949+0000 7f55ddbaa9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:36.956 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.949+0000 7f55ddbaa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:36.956 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.949+0000 7f55ddbaa9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:36.956 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.953+0000 7f55ddbaa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:36.956 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.953+0000 7f55ddbaa9c0 20 searching for the correct realm 2024-09-19T13:42:36.962 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.957+0000 7f55daeaf640 0 -- 172.21.15.153:0/246122401 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x5571448424c0 msgr2=0x557144844940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:36.967 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.965+0000 7f55db6b0640 0 -- 172.21.15.153:0/246122401 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f55d006fbd0 msgr2=0x7f55d006a8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:36.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:36.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:36.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:36.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:36.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:36.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:36.977 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:36.977 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:36.977 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:36.977 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:36.977 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:36.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:36.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 20 zone default found 2024-09-19T13:42:36.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 4 Realm: () 2024-09-19T13:42:36.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:36.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:36.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:36.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 20 zonegroup default 2024-09-19T13:42:36.979 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:36.979 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:36.979 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:36.979 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:36.979 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:36.979 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:36.980 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 20 started sync module instance, tier type = 2024-09-19T13:42:36.980 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.973+0000 7f55ddbaa9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:37.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.997+0000 7f55ddbaa9c0 20 add_watcher() i=0 2024-09-19T13:42:37.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.997+0000 7f55ddbaa9c0 20 add_watcher() i=1 2024-09-19T13:42:37.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.997+0000 7f55ddbaa9c0 20 add_watcher() i=2 2024-09-19T13:42:37.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.997+0000 7f55ddbaa9c0 20 add_watcher() i=3 2024-09-19T13:42:37.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.997+0000 7f55ddbaa9c0 20 add_watcher() i=4 2024-09-19T13:42:37.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.997+0000 7f55ddbaa9c0 20 add_watcher() i=5 2024-09-19T13:42:37.004 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:36.997+0000 7f55ddbaa9c0 20 add_watcher() i=6 2024-09-19T13:42:37.006 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.001+0000 7f55ddbaa9c0 20 add_watcher() i=7 2024-09-19T13:42:37.006 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.001+0000 7f55ddbaa9c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:37.009 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.005+0000 7f5491fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:37.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.005+0000 7f55ddbaa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:37.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.005+0000 7f55ddbaa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:37.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.005+0000 7f55ddbaa9c0 5 note: GC not initialized 2024-09-19T13:42:37.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.005+0000 7f5490fe1640 20 reqs_thread_entry: start 2024-09-19T13:42:37.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.005+0000 7f55ddbaa9c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:37.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.005+0000 7f55ddbaa9c0 20 Filter name: none 2024-09-19T13:42:37.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.005+0000 7f540a7fc640 20 reqs_thread_entry: start 2024-09-19T13:42:37.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.005+0000 7f55ddbaa9c0 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-19T13:42:37.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.005+0000 7f55ddbaa9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:37.011 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.005+0000 7f55ddbaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:37.011 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.005+0000 7f55ddbaa9c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-19T13:42:37.011 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.005+0000 7f55ddbaa9c0 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-19T13:42:37.011 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.005+0000 7f55ddbaa9c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-19T13:42:37.011 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.005+0000 7f55ddbaa9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:37.012 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.005+0000 7f55ddbaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:37.012 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.005+0000 7f55ddbaa9c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-19T13:42:37.012 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.005+0000 7f55ddbaa9c0 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-19T13:42:37.012 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.005+0000 7f55ddbaa9c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-19T13:42:37.012 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.005+0000 7f55ddbaa9c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-19T13:42:37.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.009+0000 7f55ddbaa9c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-19T13:42:37.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.009+0000 7f55ddbaa9c0 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-19T13:42:37.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.009+0000 7f55ddbaa9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-19T13:42:37.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.013+0000 7f54beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 176093659136 cookie 93944969194128 notifier 4638 bl.length()=593 2024-09-19T13:42:37.016 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.013+0000 7f54beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-19T13:42:37.016 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.013+0000 7f54beffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-19T13:42:37.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.041+0000 7f55ddbaa9c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-19T13:42:37.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.041+0000 7f55ddbaa9c0 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-19T13:42:37.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.041+0000 7f55ddbaa9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-19T13:42:37.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.041+0000 7f54beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 176093659136 cookie 93944969184832 notifier 4638 bl.length()=186 2024-09-19T13:42:37.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.041+0000 7f54beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-19T13:42:37.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.041+0000 7f54beffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-19T13:42:37.051 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.045+0000 7f5491fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:37.056 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.053+0000 7f55ddbaa9c0 20 remove_watcher() i=0 2024-09-19T13:42:37.057 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.053+0000 7f55ddbaa9c0 2 removed watcher, disabling cache 2024-09-19T13:42:37.059 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.053+0000 7f55ddbaa9c0 20 remove_watcher() i=1 2024-09-19T13:42:37.061 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.057+0000 7f55ddbaa9c0 20 remove_watcher() i=2 2024-09-19T13:42:37.063 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.061+0000 7f55ddbaa9c0 20 remove_watcher() i=3 2024-09-19T13:42:37.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.061+0000 7f55ddbaa9c0 20 remove_watcher() i=4 2024-09-19T13:42:37.067 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.065+0000 7f55ddbaa9c0 20 remove_watcher() i=5 2024-09-19T13:42:37.069 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.065+0000 7f55ddbaa9c0 20 remove_watcher() i=6 2024-09-19T13:42:37.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:37.065+0000 7f55ddbaa9c0 20 remove_watcher() i=7 2024-09-19T13:42:37.352 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:37.352 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:37.600 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:37.600 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:37.766 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:37.766 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:38.357 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:38.357 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:39.090 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:39.090 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:39.323 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:39.323 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:39.582 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:39.582 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:39.669 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:39.670 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:39.829 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:39.829 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:40.151 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:40.151 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:40.249 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:40.250 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:40.391 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:40.391 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:40.465 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:40.465 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:40.605 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:40.605 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:40.676 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:40.676 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:40.855 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:40.855 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:40.941 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: recalculated bucket check stats are correct 2024-09-19T13:42:40.941 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:42:40.942 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-19T13:42:40.974 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:40.974 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:41.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.012+0000 7f57479ab9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.016+0000 7f57479ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:41.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.016+0000 7f57479ab9c0 20 realm 2024-09-19T13:42:41.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.016+0000 7f57479ab9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.016+0000 7f57479ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:41.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.016+0000 7f57479ab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:41.022 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.016+0000 7f57479ab9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.022 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.016+0000 7f57479ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:41.022 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.016+0000 7f57479ab9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.016+0000 7f57479ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:41.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.016+0000 7f57479ab9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.016+0000 7f57479ab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:41.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.016+0000 7f57479ab9c0 20 searching for the correct realm 2024-09-19T13:42:41.029 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.024+0000 7f5744cb0640 0 -- 172.21.15.153:0/67510594 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f5738008040 msgr2=0x7f5738087260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:41.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.032+0000 7f5744cb0640 0 -- 172.21.15.153:0/67510594 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f561007f800 msgr2=0x7f5610081c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:41.043 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.036+0000 7f57479ab9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:41.044 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.036+0000 7f57479ab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:41.044 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.036+0000 7f57479ab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:41.044 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.036+0000 7f57479ab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:41.044 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.036+0000 7f57479ab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:41.044 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.036+0000 7f57479ab9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:41.044 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.036+0000 7f57479ab9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.044 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.036+0000 7f57479ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:41.044 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.036+0000 7f57479ab9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.044 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.040+0000 7f57479ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:41.045 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.040+0000 7f57479ab9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.045 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.040+0000 7f57479ab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:41.045 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.040+0000 7f57479ab9c0 20 zone default found 2024-09-19T13:42:41.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.040+0000 7f57479ab9c0 4 Realm: () 2024-09-19T13:42:41.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.040+0000 7f57479ab9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:41.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.040+0000 7f57479ab9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:41.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.040+0000 7f57479ab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:41.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.040+0000 7f57479ab9c0 20 zonegroup default 2024-09-19T13:42:41.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.040+0000 7f57479ab9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.040+0000 7f57479ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:41.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.040+0000 7f57479ab9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.040+0000 7f57479ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:41.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.040+0000 7f57479ab9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.040+0000 7f57479ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:41.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.040+0000 7f57479ab9c0 20 started sync module instance, tier type = 2024-09-19T13:42:41.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.040+0000 7f57479ab9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:41.065 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.060+0000 7f57479ab9c0 20 add_watcher() i=0 2024-09-19T13:42:41.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.060+0000 7f57479ab9c0 20 add_watcher() i=1 2024-09-19T13:42:41.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.060+0000 7f57479ab9c0 20 add_watcher() i=2 2024-09-19T13:42:41.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.060+0000 7f57479ab9c0 20 add_watcher() i=3 2024-09-19T13:42:41.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.060+0000 7f57479ab9c0 20 add_watcher() i=4 2024-09-19T13:42:41.067 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.060+0000 7f57479ab9c0 20 add_watcher() i=5 2024-09-19T13:42:41.069 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.064+0000 7f57479ab9c0 20 add_watcher() i=6 2024-09-19T13:42:41.069 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.064+0000 7f57479ab9c0 20 add_watcher() i=7 2024-09-19T13:42:41.069 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.064+0000 7f57479ab9c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:41.072 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.068+0000 7f55fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:41.072 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.068+0000 7f57479ab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:41.073 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.068+0000 7f57479ab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:41.073 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.068+0000 7f57479ab9c0 5 note: GC not initialized 2024-09-19T13:42:41.073 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.068+0000 7f55fa7e4640 20 reqs_thread_entry: start 2024-09-19T13:42:41.074 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.068+0000 7f57479ab9c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:41.074 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.068+0000 7f57479ab9c0 20 Filter name: none 2024-09-19T13:42:41.074 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.068+0000 7f556bfff640 20 reqs_thread_entry: start 2024-09-19T13:42:41.074 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.068+0000 7f57479ab9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T13:42:41.074 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.068+0000 7f57479ab9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.075 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.068+0000 7f57479ab9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:41.075 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.068+0000 7f57479ab9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T13:42:41.075 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.068+0000 7f57479ab9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T13:42:41.075 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.068+0000 7f57479ab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 : miss 2024-09-19T13:42:41.075 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.068+0000 7f57479ab9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.075 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.068+0000 7f57479ab9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:41.075 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.068+0000 7f57479ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 info.flags=0x17 2024-09-19T13:42:41.075 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.068+0000 7f57479ab9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 to cache LRU end 2024-09-19T13:42:41.076 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.068+0000 7f57479ab9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:42:41.076 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.068+0000 7f57479ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T13:42:41.076 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.068+0000 7f57479ab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 2024-09-19T13:42:41.076 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.068+0000 7f57479ab9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.0 2024-09-19T13:42:41.076 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.072+0000 7f57479ab9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:41.078 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.072+0000 7f57479ab9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.2 2024-09-19T13:42:41.079 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.072+0000 7f57479ab9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.3 2024-09-19T13:42:41.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.076+0000 7f57479ab9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.4 2024-09-19T13:42:41.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.076+0000 7f57479ab9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:41.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.076+0000 7f57479ab9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.6 2024-09-19T13:42:41.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.076+0000 7f57479ab9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.7 2024-09-19T13:42:41.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.080+0000 7f57479ab9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:41.085 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.080+0000 7f57479ab9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.9 2024-09-19T13:42:41.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.080+0000 7f57479ab9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:41.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.096+0000 7f55fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:41.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.100+0000 7f57479ab9c0 20 remove_watcher() i=0 2024-09-19T13:42:41.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.100+0000 7f57479ab9c0 2 removed watcher, disabling cache 2024-09-19T13:42:41.107 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.100+0000 7f57479ab9c0 20 remove_watcher() i=1 2024-09-19T13:42:41.109 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.104+0000 7f57479ab9c0 20 remove_watcher() i=2 2024-09-19T13:42:41.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.104+0000 7f57479ab9c0 20 remove_watcher() i=3 2024-09-19T13:42:41.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.108+0000 7f57479ab9c0 20 remove_watcher() i=4 2024-09-19T13:42:41.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.108+0000 7f57479ab9c0 20 remove_watcher() i=5 2024-09-19T13:42:41.116 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.112+0000 7f57479ab9c0 20 remove_watcher() i=6 2024-09-19T13:42:41.118 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.112+0000 7f57479ab9c0 20 remove_watcher() i=7 2024-09-19T13:42:41.134 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-19T13:42:41.162 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:41.162 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:41.205 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.200+0000 7fa67e9889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.208 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.200+0000 7fa67e9889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:41.208 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.200+0000 7fa67e9889c0 20 realm 2024-09-19T13:42:41.208 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.200+0000 7fa67e9889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.208 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.204+0000 7fa67e9889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:41.208 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.204+0000 7fa67e9889c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:41.208 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.204+0000 7fa67e9889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.208 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.204+0000 7fa67e9889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:41.208 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.204+0000 7fa67e9889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.209 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.204+0000 7fa67e9889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:41.209 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.204+0000 7fa67e9889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.210 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.204+0000 7fa67e9889c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:41.210 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.204+0000 7fa67e9889c0 20 searching for the correct realm 2024-09-19T13:42:41.216 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.212+0000 7fa67cc8f640 0 -- 172.21.15.153:0/2505499478 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x5596f18c64a0 msgr2=0x5596f18c8940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:41.222 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.216+0000 7fa67bc8d640 0 -- 172.21.15.153:0/2505499478 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fa66c0da060 msgr2=0x7fa66c0075b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:42:41.231 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.224+0000 7fa67e9889c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:41.231 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.224+0000 7fa67e9889c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:41.231 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.224+0000 7fa67e9889c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:41.231 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.224+0000 7fa67e9889c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:41.231 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.224+0000 7fa67e9889c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:41.231 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.224+0000 7fa67e9889c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:41.231 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.224+0000 7fa67e9889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.231 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.224+0000 7fa67e9889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:41.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.224+0000 7fa67e9889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.228+0000 7fa67e9889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:41.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.228+0000 7fa67e9889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.228+0000 7fa67e9889c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:41.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.228+0000 7fa67e9889c0 20 zone default found 2024-09-19T13:42:41.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.228+0000 7fa67e9889c0 4 Realm: () 2024-09-19T13:42:41.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.228+0000 7fa67e9889c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:41.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.228+0000 7fa67e9889c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:41.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.228+0000 7fa67e9889c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:41.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.228+0000 7fa67e9889c0 20 zonegroup default 2024-09-19T13:42:41.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.228+0000 7fa67e9889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.228+0000 7fa67e9889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:41.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.228+0000 7fa67e9889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.228+0000 7fa67e9889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:41.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.228+0000 7fa67e9889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.235 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.228+0000 7fa67e9889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:41.235 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.228+0000 7fa67e9889c0 20 started sync module instance, tier type = 2024-09-19T13:42:41.235 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.228+0000 7fa67e9889c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:41.252 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.248+0000 7fa67e9889c0 20 add_watcher() i=0 2024-09-19T13:42:41.252 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.248+0000 7fa67e9889c0 20 add_watcher() i=1 2024-09-19T13:42:41.252 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.248+0000 7fa67e9889c0 20 add_watcher() i=2 2024-09-19T13:42:41.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.248+0000 7fa67e9889c0 20 add_watcher() i=3 2024-09-19T13:42:41.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.248+0000 7fa67e9889c0 20 add_watcher() i=4 2024-09-19T13:42:41.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.248+0000 7fa67e9889c0 20 add_watcher() i=5 2024-09-19T13:42:41.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.248+0000 7fa67e9889c0 20 add_watcher() i=6 2024-09-19T13:42:41.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.248+0000 7fa67e9889c0 20 add_watcher() i=7 2024-09-19T13:42:41.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.248+0000 7fa67e9889c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:41.256 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.252+0000 7fa5327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:41.257 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.252+0000 7fa67e9889c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:41.257 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.252+0000 7fa67e9889c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:41.257 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.252+0000 7fa67e9889c0 5 note: GC not initialized 2024-09-19T13:42:41.258 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.252+0000 7fa5317e2640 20 reqs_thread_entry: start 2024-09-19T13:42:41.258 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.252+0000 7fa67e9889c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:41.258 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.252+0000 7fa67e9889c0 20 Filter name: none 2024-09-19T13:42:41.258 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.252+0000 7fa4a2ffd640 20 reqs_thread_entry: start 2024-09-19T13:42:41.258 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.252+0000 7fa67e9889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.258 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.252+0000 7fa67e9889c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:41.258 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.252+0000 7fa67e9889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.259 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.252+0000 7fa67e9889c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:41.259 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.252+0000 7fa67e9889c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:42:41.259 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.252+0000 7fa67e9889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.259 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.252+0000 7fa67e9889c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:41.259 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.252+0000 7fa67e9889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.259 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.252+0000 7fa67e9889c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:41.259 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.252+0000 7fa67e9889c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:42:41.261 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.256+0000 7fa5327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:41.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.260+0000 7fa67e9889c0 20 remove_watcher() i=0 2024-09-19T13:42:41.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.260+0000 7fa67e9889c0 2 removed watcher, disabling cache 2024-09-19T13:42:41.268 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.264+0000 7fa67e9889c0 20 remove_watcher() i=1 2024-09-19T13:42:41.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.264+0000 7fa67e9889c0 20 remove_watcher() i=2 2024-09-19T13:42:41.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.268+0000 7fa67e9889c0 20 remove_watcher() i=3 2024-09-19T13:42:41.274 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.268+0000 7fa67e9889c0 20 remove_watcher() i=4 2024-09-19T13:42:41.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.272+0000 7fa67e9889c0 20 remove_watcher() i=5 2024-09-19T13:42:41.277 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.272+0000 7fa67e9889c0 20 remove_watcher() i=6 2024-09-19T13:42:41.278 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.272+0000 7fa67e9889c0 20 remove_watcher() i=7 2024-09-19T13:42:41.292 INFO:tasks.workunit.client.0.smithi153.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 106, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-19T13:42:41.292 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-19T13:42:41.292 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:42:41.292 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-19T13:42:41.323 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:41.323 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:41.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.360+0000 7f710a1509c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.360+0000 7f710a1509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:41.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.360+0000 7f710a1509c0 20 realm 2024-09-19T13:42:41.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.360+0000 7f710a1509c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.364+0000 7f710a1509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:41.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.364+0000 7f710a1509c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:41.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.364+0000 7f710a1509c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.364+0000 7f710a1509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:41.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.364+0000 7f710a1509c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.364+0000 7f710a1509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:41.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.364+0000 7f710a1509c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.370 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.364+0000 7f710a1509c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:41.370 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.364+0000 7f710a1509c0 20 searching for the correct realm 2024-09-19T13:42:41.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.368+0000 7f7107c56640 0 -- 172.21.15.153:0/1522567579 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x7f70f0003cc0 msgr2=0x7f7100024400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:41.379 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.372+0000 7f7108457640 0 -- 172.21.15.153:0/1522567579 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f70fc12f030 msgr2=0x7f70fc0b7750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:41.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.384+0000 7f710a1509c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:41.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.384+0000 7f710a1509c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:41.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.384+0000 7f710a1509c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:41.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.384+0000 7f710a1509c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:41.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.384+0000 7f710a1509c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:41.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.384+0000 7f710a1509c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:41.390 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.384+0000 7f710a1509c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.390 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.384+0000 7f710a1509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:41.390 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.384+0000 7f710a1509c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.390 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.384+0000 7f710a1509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:41.390 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.384+0000 7f710a1509c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.384+0000 7f710a1509c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:41.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.384+0000 7f710a1509c0 20 zone default found 2024-09-19T13:42:41.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.384+0000 7f710a1509c0 4 Realm: () 2024-09-19T13:42:41.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.384+0000 7f710a1509c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:41.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.384+0000 7f710a1509c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:41.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.384+0000 7f710a1509c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:41.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.384+0000 7f710a1509c0 20 zonegroup default 2024-09-19T13:42:41.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.384+0000 7f710a1509c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.384+0000 7f710a1509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:41.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.384+0000 7f710a1509c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.388+0000 7f710a1509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:41.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.388+0000 7f710a1509c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.388+0000 7f710a1509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:41.393 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.388+0000 7f710a1509c0 20 started sync module instance, tier type = 2024-09-19T13:42:41.393 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.388+0000 7f710a1509c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:41.408 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.404+0000 7f710a1509c0 20 add_watcher() i=0 2024-09-19T13:42:41.408 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.404+0000 7f710a1509c0 20 add_watcher() i=1 2024-09-19T13:42:41.408 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.404+0000 7f710a1509c0 20 add_watcher() i=2 2024-09-19T13:42:41.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.404+0000 7f710a1509c0 20 add_watcher() i=3 2024-09-19T13:42:41.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.404+0000 7f710a1509c0 20 add_watcher() i=4 2024-09-19T13:42:41.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.404+0000 7f710a1509c0 20 add_watcher() i=5 2024-09-19T13:42:41.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.404+0000 7f710a1509c0 20 add_watcher() i=6 2024-09-19T13:42:41.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.404+0000 7f710a1509c0 20 add_watcher() i=7 2024-09-19T13:42:41.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.404+0000 7f710a1509c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:41.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.408+0000 7f6fbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:41.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.408+0000 7f710a1509c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:41.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.408+0000 7f710a1509c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:41.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.408+0000 7f710a1509c0 5 note: GC not initialized 2024-09-19T13:42:41.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.408+0000 7f6fbcfe1640 20 reqs_thread_entry: start 2024-09-19T13:42:41.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.408+0000 7f710a1509c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:41.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.408+0000 7f710a1509c0 20 Filter name: none 2024-09-19T13:42:41.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.408+0000 7f6f367fc640 20 reqs_thread_entry: start 2024-09-19T13:42:41.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.408+0000 7f710a1509c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T13:42:41.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.408+0000 7f710a1509c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.408+0000 7f710a1509c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:41.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.408+0000 7f710a1509c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T13:42:41.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.408+0000 7f710a1509c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T13:42:41.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.408+0000 7f710a1509c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 : miss 2024-09-19T13:42:41.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.408+0000 7f710a1509c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:41.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.408+0000 7f710a1509c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:41.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.408+0000 7f710a1509c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 info.flags=0x17 2024-09-19T13:42:41.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.408+0000 7f710a1509c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 to cache LRU end 2024-09-19T13:42:41.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.408+0000 7f710a1509c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:42:41.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.408+0000 7f710a1509c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T13:42:41.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.408+0000 7f710a1509c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 2024-09-19T13:42:41.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.408+0000 7f710a1509c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.0 2024-09-19T13:42:41.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.408+0000 7f710a1509c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-19T13:42:41.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.408+0000 7f710a1509c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:41.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.412+0000 7f710a1509c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-19T13:42:41.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.412+0000 7f710a1509c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.2 2024-09-19T13:42:41.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.412+0000 7f710a1509c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-19T13:42:41.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.412+0000 7f710a1509c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.3 2024-09-19T13:42:41.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.412+0000 7f710a1509c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-19T13:42:41.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.412+0000 7f710a1509c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.4 2024-09-19T13:42:41.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.412+0000 7f710a1509c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-19T13:42:41.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.412+0000 7f710a1509c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:41.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.412+0000 7f710a1509c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-19T13:42:41.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.412+0000 7f710a1509c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.6 2024-09-19T13:42:41.420 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.416+0000 7f710a1509c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-19T13:42:41.420 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.416+0000 7f710a1509c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.7 2024-09-19T13:42:41.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.416+0000 7f710a1509c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-19T13:42:41.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.416+0000 7f710a1509c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:41.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.416+0000 7f710a1509c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-19T13:42:41.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.416+0000 7f710a1509c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.9 2024-09-19T13:42:41.423 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.416+0000 7f710a1509c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-19T13:42:41.423 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.416+0000 7f710a1509c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:41.424 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.420+0000 7f710a1509c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-19T13:42:41.425 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.420+0000 7f710a1509c0 1 NOTICE: finished all shards (0 entries found) 2024-09-19T13:42:41.425 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.420+0000 7f6fbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:41.430 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.424+0000 7f710a1509c0 20 remove_watcher() i=0 2024-09-19T13:42:41.430 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.424+0000 7f710a1509c0 2 removed watcher, disabling cache 2024-09-19T13:42:41.432 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.428+0000 7f710a1509c0 20 remove_watcher() i=1 2024-09-19T13:42:41.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.428+0000 7f710a1509c0 20 remove_watcher() i=2 2024-09-19T13:42:41.436 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.432+0000 7f710a1509c0 20 remove_watcher() i=3 2024-09-19T13:42:41.438 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.432+0000 7f710a1509c0 20 remove_watcher() i=4 2024-09-19T13:42:41.440 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.436+0000 7f710a1509c0 20 remove_watcher() i=5 2024-09-19T13:42:41.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.436+0000 7f710a1509c0 20 remove_watcher() i=6 2024-09-19T13:42:41.442 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:41.436+0000 7f710a1509c0 20 remove_watcher() i=7 2024-09-19T13:42:41.457 INFO:tasks.workunit.client.0.smithi153.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-19T13:42:41.879 INFO:tasks.workunit.client.0.smithi153.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-19T13:42:43.316 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:43.316 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:43.529 INFO:tasks.workunit.client.0.smithi153.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T13:42:43.529 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-19T13:42:43.565 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:43.565 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:43.610 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:43.604+0000 7fcef15669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:43.612 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:43.608+0000 7fcef15669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:43.612 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:43.608+0000 7fcef15669c0 20 realm 2024-09-19T13:42:43.612 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:43.608+0000 7fcef15669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:43.612 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:43.608+0000 7fcef15669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:43.612 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:43.608+0000 7fcef15669c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:43.613 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:43.608+0000 7fcef15669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:43.613 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:43.608+0000 7fcef15669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:43.613 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:43.608+0000 7fcef15669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:43.614 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:43.608+0000 7fcef15669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:43.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:43.608+0000 7fcef15669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:43.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:43.608+0000 7fcef15669c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:43.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:43.608+0000 7fcef15669c0 20 searching for the correct realm 2024-09-19T13:42:43.618 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:43.612+0000 7fceee86b640 0 -- 172.21.15.153:0/2196066968 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fcee0069070 msgr2=0x7fcee0063c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:43.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:43.828+0000 7fceef06c640 0 -- 172.21.15.153:0/2196066968 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fcee40464b0 msgr2=0x7fcee4057920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:44.050 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.044+0000 7fcef15669c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:44.051 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.044+0000 7fcef15669c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:44.051 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.044+0000 7fcef15669c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:44.051 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.044+0000 7fcef15669c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:44.051 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.044+0000 7fcef15669c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:44.051 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.044+0000 7fcef15669c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:44.051 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.044+0000 7fcef15669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.052 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.044+0000 7fcef15669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:44.052 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.044+0000 7fcef15669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.052 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.048+0000 7fcef15669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:44.052 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.048+0000 7fcef15669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.048+0000 7fcef15669c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:44.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.048+0000 7fcef15669c0 20 zone default found 2024-09-19T13:42:44.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.048+0000 7fcef15669c0 4 Realm: () 2024-09-19T13:42:44.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.048+0000 7fcef15669c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:44.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.048+0000 7fcef15669c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:44.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.048+0000 7fcef15669c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:44.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.048+0000 7fcef15669c0 20 zonegroup default 2024-09-19T13:42:44.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.048+0000 7fcef15669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.048+0000 7fcef15669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:44.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.048+0000 7fcef15669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.048+0000 7fcef15669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:44.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.048+0000 7fcef15669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.048+0000 7fcef15669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:44.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.048+0000 7fcef15669c0 20 started sync module instance, tier type = 2024-09-19T13:42:44.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.048+0000 7fcef15669c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:44.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.076+0000 7fcef15669c0 20 add_watcher() i=0 2024-09-19T13:42:44.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.076+0000 7fcef15669c0 20 add_watcher() i=1 2024-09-19T13:42:44.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.076+0000 7fcef15669c0 20 add_watcher() i=2 2024-09-19T13:42:44.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.076+0000 7fcef15669c0 20 add_watcher() i=3 2024-09-19T13:42:44.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.076+0000 7fcef15669c0 20 add_watcher() i=4 2024-09-19T13:42:44.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.076+0000 7fcef15669c0 20 add_watcher() i=5 2024-09-19T13:42:44.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.076+0000 7fcef15669c0 20 add_watcher() i=6 2024-09-19T13:42:44.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.080+0000 7fcef15669c0 20 add_watcher() i=7 2024-09-19T13:42:44.085 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.080+0000 7fcef15669c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:44.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.084+0000 7fcda5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:44.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.084+0000 7fcef15669c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:44.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.084+0000 7fcef15669c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:44.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.084+0000 7fcef15669c0 5 note: GC not initialized 2024-09-19T13:42:44.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.084+0000 7fcda4fe1640 20 reqs_thread_entry: start 2024-09-19T13:42:44.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.084+0000 7fcef15669c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:44.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.084+0000 7fcef15669c0 20 Filter name: none 2024-09-19T13:42:44.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.084+0000 7fcd1e7fc640 20 reqs_thread_entry: start 2024-09-19T13:42:44.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.084+0000 7fcef15669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.084+0000 7fcef15669c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:44.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.084+0000 7fcef15669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.084+0000 7fcef15669c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:44.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.084+0000 7fcef15669c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:42:44.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.084+0000 7fcef15669c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T13:42:44.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.084+0000 7fcef15669c0 20 INFO: main: starting shard=0 2024-09-19T13:42:44.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.084+0000 7fcef15669c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.0 2024-09-19T13:42:44.092 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.088+0000 7fcef15669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.092 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.088+0000 7fcef15669c0 20 INFO: main: starting shard=1 2024-09-19T13:42:44.092 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.088+0000 7fcef15669c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:44.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.088+0000 7fcef15669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.088+0000 7fcef15669c0 20 INFO: main: starting shard=2 2024-09-19T13:42:44.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.088+0000 7fcef15669c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.2 2024-09-19T13:42:44.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.088+0000 7fcef15669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.088+0000 7fcef15669c0 20 INFO: main: starting shard=3 2024-09-19T13:42:44.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.088+0000 7fcef15669c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.3 2024-09-19T13:42:44.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.092+0000 7fcef15669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.092+0000 7fcef15669c0 20 INFO: main: starting shard=4 2024-09-19T13:42:44.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.092+0000 7fcef15669c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.4 2024-09-19T13:42:44.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.092+0000 7fcef15669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.092+0000 7fcef15669c0 20 INFO: main: starting shard=5 2024-09-19T13:42:44.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.092+0000 7fcef15669c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:44.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.092+0000 7fcef15669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.092+0000 7fcef15669c0 20 INFO: main: starting shard=6 2024-09-19T13:42:44.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.092+0000 7fcef15669c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.6 2024-09-19T13:42:44.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.092+0000 7fcef15669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.092+0000 7fcef15669c0 20 INFO: main: starting shard=7 2024-09-19T13:42:44.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.092+0000 7fcef15669c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.7 2024-09-19T13:42:44.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.096+0000 7fcef15669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.096+0000 7fcef15669c0 20 INFO: main: starting shard=8 2024-09-19T13:42:44.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.096+0000 7fcef15669c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:44.101 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.096+0000 7fcef15669c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-19T13:42:44.101 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.096+0000 7fcef15669c0 20 INFO: main: starting shard=9 2024-09-19T13:42:44.101 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.096+0000 7fcef15669c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.9 2024-09-19T13:42:44.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.096+0000 7fcef15669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.096+0000 7fcef15669c0 20 INFO: main: starting shard=10 2024-09-19T13:42:44.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.096+0000 7fcef15669c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:44.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.100+0000 7fcef15669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.100+0000 7fcef15669c0 20 INFO: main: done 2024-09-19T13:42:44.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.100+0000 7fcda5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:44.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.104+0000 7fcef15669c0 20 remove_watcher() i=0 2024-09-19T13:42:44.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.104+0000 7fcef15669c0 2 removed watcher, disabling cache 2024-09-19T13:42:44.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.108+0000 7fcef15669c0 20 remove_watcher() i=1 2024-09-19T13:42:44.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.108+0000 7fcef15669c0 20 remove_watcher() i=2 2024-09-19T13:42:44.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.112+0000 7fcef15669c0 20 remove_watcher() i=3 2024-09-19T13:42:44.119 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.112+0000 7fcef15669c0 20 remove_watcher() i=4 2024-09-19T13:42:44.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.116+0000 7fcef15669c0 20 remove_watcher() i=5 2024-09-19T13:42:44.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.116+0000 7fcef15669c0 20 remove_watcher() i=6 2024-09-19T13:42:44.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.120+0000 7fcef15669c0 20 remove_watcher() i=7 2024-09-19T13:42:44.140 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:44.140 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:44.171 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:44.172 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:44.214 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:44.214 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:44.369 INFO:tasks.workunit.client.0.smithi153.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T13:42:44.369 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-19T13:42:44.406 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:44.406 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:44.450 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.444+0000 7f56b81a39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.448+0000 7f56b81a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:44.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.448+0000 7f56b81a39c0 20 realm 2024-09-19T13:42:44.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.448+0000 7f56b81a39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.448+0000 7f56b81a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:44.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.448+0000 7f56b81a39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:44.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.448+0000 7f56b81a39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.448+0000 7f56b81a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:44.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.448+0000 7f56b81a39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.448+0000 7f56b81a39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:44.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.448+0000 7f56b81a39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.448+0000 7f56b81a39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:44.455 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.448+0000 7f56b81a39c0 20 searching for the correct realm 2024-09-19T13:42:44.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.456+0000 7f56b64aa640 0 -- 172.21.15.153:0/1114926861 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55a8dddc69f0 msgr2=0x55a8dddc8e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:44.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.460+0000 7f56b5ca9640 0 -- 172.21.15.153:0/1114926861 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f56a00fa9d0 msgr2=0x7f56a010e820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:44.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.468+0000 7f56b81a39c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:44.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.468+0000 7f56b81a39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:44.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.468+0000 7f56b81a39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:44.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.468+0000 7f56b81a39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:44.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.468+0000 7f56b81a39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:44.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.468+0000 7f56b81a39c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:44.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.468+0000 7f56b81a39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.468+0000 7f56b81a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:44.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.468+0000 7f56b81a39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.468+0000 7f56b81a39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:44.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.468+0000 7f56b81a39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.468+0000 7f56b81a39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:44.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.468+0000 7f56b81a39c0 20 zone default found 2024-09-19T13:42:44.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.468+0000 7f56b81a39c0 4 Realm: () 2024-09-19T13:42:44.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.468+0000 7f56b81a39c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:44.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.468+0000 7f56b81a39c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:44.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.468+0000 7f56b81a39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:44.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.468+0000 7f56b81a39c0 20 zonegroup default 2024-09-19T13:42:44.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.468+0000 7f56b81a39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.468+0000 7f56b81a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:44.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.468+0000 7f56b81a39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.472+0000 7f56b81a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:44.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.472+0000 7f56b81a39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.472+0000 7f56b81a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:44.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.472+0000 7f56b81a39c0 20 started sync module instance, tier type = 2024-09-19T13:42:44.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.472+0000 7f56b81a39c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:44.492 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.488+0000 7f56b81a39c0 20 add_watcher() i=0 2024-09-19T13:42:44.492 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.488+0000 7f56b81a39c0 20 add_watcher() i=1 2024-09-19T13:42:44.492 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.488+0000 7f56b81a39c0 20 add_watcher() i=2 2024-09-19T13:42:44.492 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.488+0000 7f56b81a39c0 20 add_watcher() i=3 2024-09-19T13:42:44.492 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.488+0000 7f56b81a39c0 20 add_watcher() i=4 2024-09-19T13:42:44.492 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.488+0000 7f56b81a39c0 20 add_watcher() i=5 2024-09-19T13:42:44.492 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.488+0000 7f56b81a39c0 20 add_watcher() i=6 2024-09-19T13:42:44.493 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.488+0000 7f56b81a39c0 20 add_watcher() i=7 2024-09-19T13:42:44.493 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.488+0000 7f56b81a39c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:44.496 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.492+0000 7f55677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:44.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.492+0000 7f56b81a39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:44.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.492+0000 7f56b81a39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:44.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.492+0000 7f56b81a39c0 5 note: GC not initialized 2024-09-19T13:42:44.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.492+0000 7f55667fc640 20 reqs_thread_entry: start 2024-09-19T13:42:44.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.492+0000 7f56b81a39c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:44.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.492+0000 7f56b81a39c0 20 Filter name: none 2024-09-19T13:42:44.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.492+0000 7f54d7fff640 20 reqs_thread_entry: start 2024-09-19T13:42:44.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.492+0000 7f56b81a39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.492+0000 7f56b81a39c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:44.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.492+0000 7f56b81a39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.492+0000 7f56b81a39c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:44.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.492+0000 7f56b81a39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:42:44.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.492+0000 7f56b81a39c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T13:42:44.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.492+0000 7f56b81a39c0 20 INFO: main: starting shard=0 2024-09-19T13:42:44.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.492+0000 7f56b81a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.0 2024-09-19T13:42:44.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.492+0000 7f56b81a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.492+0000 7f56b81a39c0 20 INFO: main: starting shard=1 2024-09-19T13:42:44.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.492+0000 7f56b81a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:44.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.496+0000 7f56b81a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.496+0000 7f56b81a39c0 20 INFO: main: starting shard=2 2024-09-19T13:42:44.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.496+0000 7f56b81a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.2 2024-09-19T13:42:44.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.496+0000 7f56b81a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.496+0000 7f56b81a39c0 20 INFO: main: starting shard=3 2024-09-19T13:42:44.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.496+0000 7f56b81a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.3 2024-09-19T13:42:44.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.496+0000 7f56b81a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.496+0000 7f56b81a39c0 20 INFO: main: starting shard=4 2024-09-19T13:42:44.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.496+0000 7f56b81a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.4 2024-09-19T13:42:44.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.496+0000 7f56b81a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.496+0000 7f56b81a39c0 20 INFO: main: starting shard=5 2024-09-19T13:42:44.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.496+0000 7f56b81a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:44.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.496+0000 7f56b81a39c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-19T13:42:44.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.496+0000 7f56b81a39c0 20 INFO: main: starting shard=6 2024-09-19T13:42:44.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.496+0000 7f56b81a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.6 2024-09-19T13:42:44.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.500+0000 7f56b81a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.500+0000 7f56b81a39c0 20 INFO: main: starting shard=7 2024-09-19T13:42:44.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.500+0000 7f56b81a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.7 2024-09-19T13:42:44.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.500+0000 7f56b81a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.500+0000 7f56b81a39c0 20 INFO: main: starting shard=8 2024-09-19T13:42:44.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.500+0000 7f56b81a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:44.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.500+0000 7f56b81a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.500+0000 7f56b81a39c0 20 INFO: main: starting shard=9 2024-09-19T13:42:44.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.500+0000 7f56b81a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.9 2024-09-19T13:42:44.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.500+0000 7f56b81a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.500+0000 7f56b81a39c0 20 INFO: main: starting shard=10 2024-09-19T13:42:44.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.500+0000 7f56b81a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:44.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.504+0000 7f56b81a39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.504+0000 7f56b81a39c0 20 INFO: main: done 2024-09-19T13:42:44.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.504+0000 7f55677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:44.516 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.512+0000 7f56b81a39c0 20 remove_watcher() i=0 2024-09-19T13:42:44.516 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.512+0000 7f56b81a39c0 2 removed watcher, disabling cache 2024-09-19T13:42:44.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.512+0000 7f56b81a39c0 20 remove_watcher() i=1 2024-09-19T13:42:44.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.516+0000 7f56b81a39c0 20 remove_watcher() i=2 2024-09-19T13:42:44.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.516+0000 7f56b81a39c0 20 remove_watcher() i=3 2024-09-19T13:42:44.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.520+0000 7f56b81a39c0 20 remove_watcher() i=4 2024-09-19T13:42:44.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.520+0000 7f56b81a39c0 20 remove_watcher() i=5 2024-09-19T13:42:44.528 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.524+0000 7f56b81a39c0 20 remove_watcher() i=6 2024-09-19T13:42:44.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.524+0000 7f56b81a39c0 20 remove_watcher() i=7 2024-09-19T13:42:44.544 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:44.545 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:44.574 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:44.574 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:44.625 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:44.626 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:44.797 INFO:tasks.workunit.client.0.smithi153.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T13:42:44.797 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-19T13:42:44.832 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:44.832 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:44.877 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.872+0000 7f8eb47769c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.879 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.872+0000 7f8eb47769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:44.879 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.872+0000 7f8eb47769c0 20 realm 2024-09-19T13:42:44.879 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.872+0000 7f8eb47769c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.879 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.872+0000 7f8eb47769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:44.879 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.872+0000 7f8eb47769c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:44.879 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.872+0000 7f8eb47769c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.879 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.872+0000 7f8eb47769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:44.879 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.872+0000 7f8eb47769c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.881 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.876+0000 7f8eb47769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:44.881 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.876+0000 7f8eb47769c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.881 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.876+0000 7f8eb47769c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:44.881 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.876+0000 7f8eb47769c0 20 searching for the correct realm 2024-09-19T13:42:44.887 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.880+0000 7f8eb1a7b640 0 -- 172.21.15.153:0/3772515573 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f8ea4040020 msgr2=0x7f8ea4071ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:44.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.888+0000 7f8eb2a7d640 0 -- 172.21.15.153:0/3772515573 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7f8ea806e1b0 msgr2=0x7f8ea8069100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:42:44.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.896+0000 7f8eb47769c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:44.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.896+0000 7f8eb47769c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:44.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.896+0000 7f8eb47769c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:44.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.896+0000 7f8eb47769c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:44.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.896+0000 7f8eb47769c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:44.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.896+0000 7f8eb47769c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:44.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.896+0000 7f8eb47769c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.896+0000 7f8eb47769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:44.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.896+0000 7f8eb47769c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.896+0000 7f8eb47769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:44.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.896+0000 7f8eb47769c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.903 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.896+0000 7f8eb47769c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:44.903 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.896+0000 7f8eb47769c0 20 zone default found 2024-09-19T13:42:44.903 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.896+0000 7f8eb47769c0 4 Realm: () 2024-09-19T13:42:44.903 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.896+0000 7f8eb47769c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:44.903 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.896+0000 7f8eb47769c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:44.903 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.896+0000 7f8eb47769c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:44.904 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.896+0000 7f8eb47769c0 20 zonegroup default 2024-09-19T13:42:44.904 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.896+0000 7f8eb47769c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.904 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.896+0000 7f8eb47769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:44.904 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.896+0000 7f8eb47769c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.904 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.900+0000 7f8eb47769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:44.904 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.900+0000 7f8eb47769c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.904 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.900+0000 7f8eb47769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:44.905 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.900+0000 7f8eb47769c0 20 started sync module instance, tier type = 2024-09-19T13:42:44.905 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.900+0000 7f8eb47769c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:44.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.916+0000 7f8eb47769c0 20 add_watcher() i=0 2024-09-19T13:42:44.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.916+0000 7f8eb47769c0 20 add_watcher() i=1 2024-09-19T13:42:44.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.916+0000 7f8eb47769c0 20 add_watcher() i=2 2024-09-19T13:42:44.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.916+0000 7f8eb47769c0 20 add_watcher() i=3 2024-09-19T13:42:44.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.916+0000 7f8eb47769c0 20 add_watcher() i=4 2024-09-19T13:42:44.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.916+0000 7f8eb47769c0 20 add_watcher() i=5 2024-09-19T13:42:44.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.916+0000 7f8eb47769c0 20 add_watcher() i=6 2024-09-19T13:42:44.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.916+0000 7f8eb47769c0 20 add_watcher() i=7 2024-09-19T13:42:44.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.916+0000 7f8eb47769c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:44.925 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.920+0000 7f8d68fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:44.925 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.920+0000 7f8eb47769c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:44.925 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.920+0000 7f8eb47769c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:44.925 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.920+0000 7f8eb47769c0 5 note: GC not initialized 2024-09-19T13:42:44.926 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.920+0000 7f8ce37fe640 20 reqs_thread_entry: start 2024-09-19T13:42:44.926 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.920+0000 7f8eb47769c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:44.926 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.920+0000 7f8eb47769c0 20 Filter name: none 2024-09-19T13:42:44.926 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.920+0000 7f8ce17fa640 20 reqs_thread_entry: start 2024-09-19T13:42:44.926 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.920+0000 7f8eb47769c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.920+0000 7f8eb47769c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:44.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.920+0000 7f8eb47769c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:44.928 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.920+0000 7f8eb47769c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:44.928 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.920+0000 7f8eb47769c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:42:44.928 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.920+0000 7f8eb47769c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T13:42:44.928 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.920+0000 7f8eb47769c0 20 INFO: main: starting shard=0 2024-09-19T13:42:44.928 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.920+0000 7f8eb47769c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.0 2024-09-19T13:42:44.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.924+0000 7f8eb47769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.924+0000 7f8eb47769c0 20 INFO: main: starting shard=1 2024-09-19T13:42:44.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.924+0000 7f8eb47769c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:44.930 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.924+0000 7f8eb47769c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-19T13:42:44.930 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.924+0000 7f8eb47769c0 20 INFO: main: starting shard=2 2024-09-19T13:42:44.930 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.924+0000 7f8eb47769c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.2 2024-09-19T13:42:44.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.924+0000 7f8eb47769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.924+0000 7f8eb47769c0 20 INFO: main: starting shard=3 2024-09-19T13:42:44.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.924+0000 7f8eb47769c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.3 2024-09-19T13:42:44.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.928+0000 7f8eb47769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.928+0000 7f8eb47769c0 20 INFO: main: starting shard=4 2024-09-19T13:42:44.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.928+0000 7f8eb47769c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.4 2024-09-19T13:42:44.933 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.928+0000 7f8eb47769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.934 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.928+0000 7f8eb47769c0 20 INFO: main: starting shard=5 2024-09-19T13:42:44.934 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.928+0000 7f8eb47769c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:44.934 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.928+0000 7f8eb47769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.934 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.928+0000 7f8eb47769c0 20 INFO: main: starting shard=6 2024-09-19T13:42:44.934 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.928+0000 7f8eb47769c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.6 2024-09-19T13:42:44.935 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.928+0000 7f8eb47769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.935 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.928+0000 7f8eb47769c0 20 INFO: main: starting shard=7 2024-09-19T13:42:44.935 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.928+0000 7f8eb47769c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.7 2024-09-19T13:42:44.936 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.932+0000 7f8eb47769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.936 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.932+0000 7f8eb47769c0 20 INFO: main: starting shard=8 2024-09-19T13:42:44.936 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.932+0000 7f8eb47769c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:44.938 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.932+0000 7f8eb47769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.938 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.932+0000 7f8eb47769c0 20 INFO: main: starting shard=9 2024-09-19T13:42:44.938 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.932+0000 7f8eb47769c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.9 2024-09-19T13:42:44.939 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.932+0000 7f8eb47769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.939 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.932+0000 7f8eb47769c0 20 INFO: main: starting shard=10 2024-09-19T13:42:44.939 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.932+0000 7f8eb47769c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:44.940 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.936+0000 7f8eb47769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:44.941 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.936+0000 7f8eb47769c0 20 INFO: main: done 2024-09-19T13:42:44.941 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.936+0000 7f8d68fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:44.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.940+0000 7f8eb47769c0 20 remove_watcher() i=0 2024-09-19T13:42:44.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.940+0000 7f8eb47769c0 2 removed watcher, disabling cache 2024-09-19T13:42:44.948 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.944+0000 7f8eb47769c0 20 remove_watcher() i=1 2024-09-19T13:42:44.950 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.944+0000 7f8eb47769c0 20 remove_watcher() i=2 2024-09-19T13:42:44.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.948+0000 7f8eb47769c0 20 remove_watcher() i=3 2024-09-19T13:42:44.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.948+0000 7f8eb47769c0 20 remove_watcher() i=4 2024-09-19T13:42:44.956 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.952+0000 7f8eb47769c0 20 remove_watcher() i=5 2024-09-19T13:42:44.957 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.952+0000 7f8eb47769c0 20 remove_watcher() i=6 2024-09-19T13:42:44.958 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:44.952+0000 7f8eb47769c0 20 remove_watcher() i=7 2024-09-19T13:42:44.974 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:44.974 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:45.000 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:45.000 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:45.117 INFO:tasks.workunit.client.0.smithi153.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T13:42:45.117 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-19T13:42:45.152 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:45.153 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:45.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.196+0000 7f9f04aa59c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:45.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.196+0000 7f9f04aa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:45.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.196+0000 7f9f04aa59c0 20 realm 2024-09-19T13:42:45.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.196+0000 7f9f04aa59c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:45.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.196+0000 7f9f04aa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:45.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.196+0000 7f9f04aa59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:45.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.196+0000 7f9f04aa59c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:45.204 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.196+0000 7f9f04aa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:45.204 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.196+0000 7f9f04aa59c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:45.205 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.200+0000 7f9f04aa59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:45.205 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.200+0000 7f9f04aa59c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:45.205 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.200+0000 7f9f04aa59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:45.205 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.200+0000 7f9f04aa59c0 20 searching for the correct realm 2024-09-19T13:42:45.211 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.208+0000 7f9f01daa640 0 -- 172.21.15.153:0/1291011265 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f9ef412c040 msgr2=0x7f9ef40ffb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:45.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.212+0000 7f9f01daa640 0 -- 172.21.15.153:0/1291011265 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f9dcc07f8d0 msgr2=0x7f9dcc081d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:45.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:45.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:45.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:45.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:45.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:45.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:45.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:45.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:45.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:45.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:45.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:45.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:45.227 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 20 zone default found 2024-09-19T13:42:45.227 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 4 Realm: () 2024-09-19T13:42:45.227 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:45.227 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:45.227 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:45.227 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 20 zonegroup default 2024-09-19T13:42:45.227 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:45.227 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:45.227 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:45.228 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:45.228 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:45.228 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:45.228 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 20 started sync module instance, tier type = 2024-09-19T13:42:45.228 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.220+0000 7f9f04aa59c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:45.245 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.240+0000 7f9f04aa59c0 20 add_watcher() i=0 2024-09-19T13:42:45.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.240+0000 7f9f04aa59c0 20 add_watcher() i=1 2024-09-19T13:42:45.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.240+0000 7f9f04aa59c0 20 add_watcher() i=2 2024-09-19T13:42:45.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.240+0000 7f9f04aa59c0 20 add_watcher() i=3 2024-09-19T13:42:45.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.240+0000 7f9f04aa59c0 20 add_watcher() i=4 2024-09-19T13:42:45.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.240+0000 7f9f04aa59c0 20 add_watcher() i=5 2024-09-19T13:42:45.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.240+0000 7f9f04aa59c0 20 add_watcher() i=6 2024-09-19T13:42:45.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.244+0000 7f9f04aa59c0 20 add_watcher() i=7 2024-09-19T13:42:45.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.244+0000 7f9f04aa59c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:45.252 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.244+0000 7f9db8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:45.252 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.244+0000 7f9f04aa59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:45.252 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.244+0000 7f9f04aa59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:45.252 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.244+0000 7f9f04aa59c0 5 note: GC not initialized 2024-09-19T13:42:45.252 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.244+0000 7f9d337fe640 20 reqs_thread_entry: start 2024-09-19T13:42:45.252 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.248+0000 7f9f04aa59c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:45.252 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.248+0000 7f9f04aa59c0 20 Filter name: none 2024-09-19T13:42:45.252 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.248+0000 7f9d317fa640 20 reqs_thread_entry: start 2024-09-19T13:42:45.252 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.248+0000 7f9f04aa59c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:45.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.248+0000 7f9f04aa59c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:45.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.248+0000 7f9f04aa59c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:45.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.248+0000 7f9f04aa59c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:45.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.248+0000 7f9f04aa59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:42:45.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.248+0000 7f9f04aa59c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T13:42:45.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.248+0000 7f9f04aa59c0 20 INFO: main: starting shard=0 2024-09-19T13:42:45.254 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.248+0000 7f9f04aa59c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.0 2024-09-19T13:42:45.254 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.248+0000 7f9f04aa59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:45.254 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.248+0000 7f9f04aa59c0 20 INFO: main: starting shard=1 2024-09-19T13:42:45.254 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.248+0000 7f9f04aa59c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:45.256 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.252+0000 7f9f04aa59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:45.256 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.252+0000 7f9f04aa59c0 20 INFO: main: starting shard=2 2024-09-19T13:42:45.256 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.252+0000 7f9f04aa59c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.2 2024-09-19T13:42:45.257 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.252+0000 7f9f04aa59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:45.257 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.252+0000 7f9f04aa59c0 20 INFO: main: starting shard=3 2024-09-19T13:42:45.257 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.252+0000 7f9f04aa59c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.3 2024-09-19T13:42:45.258 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.252+0000 7f9f04aa59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:45.258 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.252+0000 7f9f04aa59c0 20 INFO: main: starting shard=4 2024-09-19T13:42:45.258 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.252+0000 7f9f04aa59c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.4 2024-09-19T13:42:45.259 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.252+0000 7f9f04aa59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:45.259 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.252+0000 7f9f04aa59c0 20 INFO: main: starting shard=5 2024-09-19T13:42:45.260 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.252+0000 7f9f04aa59c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:45.260 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.252+0000 7f9f04aa59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:45.260 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.252+0000 7f9f04aa59c0 20 INFO: main: starting shard=6 2024-09-19T13:42:45.260 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.252+0000 7f9f04aa59c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.6 2024-09-19T13:42:45.260 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.256+0000 7f9f04aa59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:45.260 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.256+0000 7f9f04aa59c0 20 INFO: main: starting shard=7 2024-09-19T13:42:45.260 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.256+0000 7f9f04aa59c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.7 2024-09-19T13:42:45.261 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.256+0000 7f9f04aa59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:45.261 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.256+0000 7f9f04aa59c0 20 INFO: main: starting shard=8 2024-09-19T13:42:45.261 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.256+0000 7f9f04aa59c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:45.262 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.256+0000 7f9f04aa59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:45.262 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.256+0000 7f9f04aa59c0 20 INFO: main: starting shard=9 2024-09-19T13:42:45.262 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.256+0000 7f9f04aa59c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.9 2024-09-19T13:42:45.263 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.256+0000 7f9f04aa59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:45.263 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.256+0000 7f9f04aa59c0 20 INFO: main: starting shard=10 2024-09-19T13:42:45.263 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.256+0000 7f9f04aa59c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:45.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.260+0000 7f9f04aa59c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-19T13:42:45.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.260+0000 7f9f04aa59c0 20 INFO: main: done 2024-09-19T13:42:45.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.260+0000 7f9db8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:45.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.264+0000 7f9f04aa59c0 20 remove_watcher() i=0 2024-09-19T13:42:45.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.264+0000 7f9f04aa59c0 2 removed watcher, disabling cache 2024-09-19T13:42:45.274 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.268+0000 7f9f04aa59c0 20 remove_watcher() i=1 2024-09-19T13:42:45.276 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.272+0000 7f9f04aa59c0 20 remove_watcher() i=2 2024-09-19T13:42:45.279 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.272+0000 7f9f04aa59c0 20 remove_watcher() i=3 2024-09-19T13:42:45.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.276+0000 7f9f04aa59c0 20 remove_watcher() i=4 2024-09-19T13:42:45.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.276+0000 7f9f04aa59c0 20 remove_watcher() i=5 2024-09-19T13:42:45.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.276+0000 7f9f04aa59c0 20 remove_watcher() i=6 2024-09-19T13:42:45.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:45.280+0000 7f9f04aa59c0 20 remove_watcher() i=7 2024-09-19T13:42:45.301 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:45.301 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:45.325 INFO:tasks.workunit.client.0.smithi153.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-19T13:42:45.759 INFO:tasks.workunit.client.0.smithi153.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-19T13:42:46.170 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-19T13:42:46.170 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:42:46.171 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-19T13:42:46.204 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:46.204 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:46.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.240+0000 7fba228e39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:46.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.244+0000 7fba228e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:46.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.244+0000 7fba228e39c0 20 realm 2024-09-19T13:42:46.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.244+0000 7fba228e39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:46.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.244+0000 7fba228e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:46.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.244+0000 7fba228e39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:46.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.244+0000 7fba228e39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:46.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.244+0000 7fba228e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:46.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.244+0000 7fba228e39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:46.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.244+0000 7fba228e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:46.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.244+0000 7fba228e39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:46.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.244+0000 7fba228e39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:46.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.244+0000 7fba228e39c0 20 searching for the correct realm 2024-09-19T13:42:46.255 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.248+0000 7fba1fbe8640 0 -- 172.21.15.153:0/3602520553 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fba100a9070 msgr2=0x7fba100fea40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:46.261 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.256+0000 7fba203e9640 0 -- 172.21.15.153:0/3602520553 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fba08018910 msgr2=0x7fba080513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:46.477 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.472+0000 7fba228e39c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:46.477 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.472+0000 7fba228e39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:46.477 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.472+0000 7fba228e39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:46.478 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.472+0000 7fba228e39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:46.478 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.472+0000 7fba228e39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:46.478 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.472+0000 7fba228e39c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:46.478 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.472+0000 7fba228e39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:46.478 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.472+0000 7fba228e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:46.478 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.472+0000 7fba228e39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:46.478 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.472+0000 7fba228e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:46.479 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.472+0000 7fba228e39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:46.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.472+0000 7fba228e39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:46.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.472+0000 7fba228e39c0 20 zone default found 2024-09-19T13:42:46.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.472+0000 7fba228e39c0 4 Realm: () 2024-09-19T13:42:46.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.472+0000 7fba228e39c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:46.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.472+0000 7fba228e39c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:46.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.472+0000 7fba228e39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:46.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.472+0000 7fba228e39c0 20 zonegroup default 2024-09-19T13:42:46.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.472+0000 7fba228e39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:46.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.476+0000 7fba228e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:46.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.476+0000 7fba228e39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:46.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.476+0000 7fba228e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:46.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.476+0000 7fba228e39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:46.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.476+0000 7fba228e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:46.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.476+0000 7fba228e39c0 20 started sync module instance, tier type = 2024-09-19T13:42:46.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.476+0000 7fba228e39c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:46.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.504+0000 7fba228e39c0 20 add_watcher() i=0 2024-09-19T13:42:46.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.504+0000 7fba228e39c0 20 add_watcher() i=1 2024-09-19T13:42:46.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.504+0000 7fba228e39c0 20 add_watcher() i=2 2024-09-19T13:42:46.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.504+0000 7fba228e39c0 20 add_watcher() i=3 2024-09-19T13:42:46.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.504+0000 7fba228e39c0 20 add_watcher() i=4 2024-09-19T13:42:46.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.504+0000 7fba228e39c0 20 add_watcher() i=5 2024-09-19T13:42:46.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.504+0000 7fba228e39c0 20 add_watcher() i=6 2024-09-19T13:42:46.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.504+0000 7fba228e39c0 20 add_watcher() i=7 2024-09-19T13:42:46.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.504+0000 7fba228e39c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:46.515 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.508+0000 7fb8d6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:46.516 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.512+0000 7fba228e39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:46.516 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.512+0000 7fba228e39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:46.516 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.512+0000 7fba228e39c0 5 note: GC not initialized 2024-09-19T13:42:46.517 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.512+0000 7fb8d5fdb640 20 reqs_thread_entry: start 2024-09-19T13:42:46.517 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.512+0000 7fba228e39c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:46.517 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.512+0000 7fba228e39c0 20 Filter name: none 2024-09-19T13:42:46.518 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.512+0000 7fb8477fe640 20 reqs_thread_entry: start 2024-09-19T13:42:46.518 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.512+0000 7fba228e39c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T13:42:46.518 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.512+0000 7fba228e39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:46.518 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.512+0000 7fba228e39c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:46.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.512+0000 7fba228e39c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T13:42:46.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.512+0000 7fba228e39c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T13:42:46.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.512+0000 7fba228e39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 : miss 2024-09-19T13:42:46.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.512+0000 7fba228e39c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:46.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.512+0000 7fba228e39c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:46.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.512+0000 7fba228e39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 info.flags=0x17 2024-09-19T13:42:46.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.512+0000 7fba228e39c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 to cache LRU end 2024-09-19T13:42:46.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.512+0000 7fba228e39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:42:46.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.512+0000 7fba228e39c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T13:42:46.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.512+0000 7fba228e39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 2024-09-19T13:42:46.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.516+0000 7fba228e39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.0 2024-09-19T13:42:46.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.516+0000 7fba228e39c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-19T13:42:46.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.516+0000 7fba228e39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:46.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.516+0000 7fba228e39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.2 2024-09-19T13:42:46.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.520+0000 7fba228e39c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-19T13:42:46.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.520+0000 7fba228e39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.3 2024-09-19T13:42:46.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.520+0000 7fba228e39c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-19T13:42:46.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.520+0000 7fba228e39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.4 2024-09-19T13:42:46.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.520+0000 7fba228e39c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-19T13:42:46.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.520+0000 7fba228e39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:46.527 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.520+0000 7fba228e39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.6 2024-09-19T13:42:46.528 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.524+0000 7fba228e39c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-19T13:42:46.528 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.524+0000 7fba228e39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.7 2024-09-19T13:42:46.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.524+0000 7fba228e39c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-19T13:42:46.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.524+0000 7fba228e39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:46.530 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.524+0000 7fba228e39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.9 2024-09-19T13:42:46.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.528+0000 7fba228e39c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-19T13:42:46.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.528+0000 7fba228e39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:46.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.528+0000 7fba228e39c0 1 NOTICE: finished shard 1 (1 entries found) 2024-09-19T13:42:46.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.528+0000 7fba228e39c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-19T13:42:46.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.528+0000 7fba228e39c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-19T13:42:46.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.528+0000 7fba228e39c0 1 NOTICE: finished shard 10 (1 entries found) 2024-09-19T13:42:46.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.528+0000 7fba228e39c0 1 NOTICE: finished all shards (4 entries found) 2024-09-19T13:42:46.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.532+0000 7fb8d6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:46.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.536+0000 7fba228e39c0 20 remove_watcher() i=0 2024-09-19T13:42:46.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.536+0000 7fba228e39c0 2 removed watcher, disabling cache 2024-09-19T13:42:46.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.536+0000 7fba228e39c0 20 remove_watcher() i=1 2024-09-19T13:42:46.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.540+0000 7fba228e39c0 20 remove_watcher() i=2 2024-09-19T13:42:46.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.544+0000 7fba228e39c0 20 remove_watcher() i=3 2024-09-19T13:42:46.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.544+0000 7fba228e39c0 20 remove_watcher() i=4 2024-09-19T13:42:46.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.548+0000 7fba228e39c0 20 remove_watcher() i=5 2024-09-19T13:42:46.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.548+0000 7fba228e39c0 20 remove_watcher() i=6 2024-09-19T13:42:46.554 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:46.548+0000 7fba228e39c0 20 remove_watcher() i=7 2024-09-19T13:42:46.568 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: unlinked entries are not listable 2024-09-19T13:42:46.569 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:42:46.570 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:46.571 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:46.736 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-19T13:42:46.736 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:42:46.742 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:46.742 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:46.849 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:46.850 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:46.949 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-19T13:42:46.949 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:42:46.949 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-19T13:42:46.989 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:46.990 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:47.034 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.028+0000 7efe0719e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:47.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.028+0000 7efe0719e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:47.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.028+0000 7efe0719e9c0 20 realm 2024-09-19T13:42:47.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.032+0000 7efe0719e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:47.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.032+0000 7efe0719e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:47.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.032+0000 7efe0719e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:47.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.032+0000 7efe0719e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:47.037 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.032+0000 7efe0719e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:47.037 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.032+0000 7efe0719e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:47.038 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.032+0000 7efe0719e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:47.038 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.032+0000 7efe0719e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:47.038 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.032+0000 7efe0719e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:47.038 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.032+0000 7efe0719e9c0 20 searching for the correct realm 2024-09-19T13:42:47.044 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.040+0000 7efe054a5640 0 -- 172.21.15.153:0/715968787 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7efdf001a040 msgr2=0x7efdf0064350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:47.050 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.044+0000 7efe04ca4640 0 -- 172.21.15.153:0/715968787 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7efdf00658e0 msgr2=0x7efdf00669b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:47.268 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.264+0000 7efe0719e9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:47.268 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.264+0000 7efe0719e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:47.268 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.264+0000 7efe0719e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:47.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.264+0000 7efe0719e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:47.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.264+0000 7efe0719e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:47.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.264+0000 7efe0719e9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:47.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.264+0000 7efe0719e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:47.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.264+0000 7efe0719e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:47.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.264+0000 7efe0719e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:47.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.264+0000 7efe0719e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:47.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.264+0000 7efe0719e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:47.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.264+0000 7efe0719e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:47.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.264+0000 7efe0719e9c0 20 zone default found 2024-09-19T13:42:47.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.264+0000 7efe0719e9c0 4 Realm: () 2024-09-19T13:42:47.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.264+0000 7efe0719e9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:47.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.264+0000 7efe0719e9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:47.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.264+0000 7efe0719e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:47.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.264+0000 7efe0719e9c0 20 zonegroup default 2024-09-19T13:42:47.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.264+0000 7efe0719e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:47.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.268+0000 7efe0719e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:47.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.268+0000 7efe0719e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:47.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.268+0000 7efe0719e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:47.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.268+0000 7efe0719e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:47.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.268+0000 7efe0719e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:47.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.268+0000 7efe0719e9c0 20 started sync module instance, tier type = 2024-09-19T13:42:47.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.268+0000 7efe0719e9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:47.300 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.292+0000 7efe0719e9c0 20 add_watcher() i=0 2024-09-19T13:42:47.300 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.292+0000 7efe0719e9c0 20 add_watcher() i=1 2024-09-19T13:42:47.300 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.292+0000 7efe0719e9c0 20 add_watcher() i=2 2024-09-19T13:42:47.300 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.292+0000 7efe0719e9c0 20 add_watcher() i=3 2024-09-19T13:42:47.300 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.292+0000 7efe0719e9c0 20 add_watcher() i=4 2024-09-19T13:42:47.300 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.292+0000 7efe0719e9c0 20 add_watcher() i=5 2024-09-19T13:42:47.300 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.296+0000 7efe0719e9c0 20 add_watcher() i=6 2024-09-19T13:42:47.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.296+0000 7efe0719e9c0 20 add_watcher() i=7 2024-09-19T13:42:47.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.296+0000 7efe0719e9c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:47.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.300+0000 7efcbb7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:47.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.300+0000 7efe0719e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:47.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.300+0000 7efe0719e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:47.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.304+0000 7efe0719e9c0 5 note: GC not initialized 2024-09-19T13:42:47.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.304+0000 7efcba7dc640 20 reqs_thread_entry: start 2024-09-19T13:42:47.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.304+0000 7efe0719e9c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:47.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.304+0000 7efe0719e9c0 20 Filter name: none 2024-09-19T13:42:47.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.304+0000 7efcb37fe640 20 reqs_thread_entry: start 2024-09-19T13:42:47.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.304+0000 7efe0719e9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T13:42:47.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.304+0000 7efe0719e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:47.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.304+0000 7efe0719e9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:47.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.304+0000 7efe0719e9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T13:42:47.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.304+0000 7efe0719e9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T13:42:47.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.304+0000 7efe0719e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 : miss 2024-09-19T13:42:47.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.304+0000 7efe0719e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:47.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.304+0000 7efe0719e9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:47.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.304+0000 7efe0719e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 info.flags=0x17 2024-09-19T13:42:47.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.304+0000 7efe0719e9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 to cache LRU end 2024-09-19T13:42:47.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.304+0000 7efe0719e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:42:47.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.304+0000 7efe0719e9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T13:42:47.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.304+0000 7efe0719e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 2024-09-19T13:42:47.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.304+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.0 2024-09-19T13:42:47.312 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.304+0000 7efe0719e9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-19T13:42:47.312 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.304+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:47.313 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.308+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.2 2024-09-19T13:42:47.314 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.308+0000 7efe0719e9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-19T13:42:47.314 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.308+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.3 2024-09-19T13:42:47.315 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.308+0000 7efe0719e9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-19T13:42:47.315 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.308+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.4 2024-09-19T13:42:47.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.312+0000 7efe0719e9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-19T13:42:47.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.312+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:47.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.312+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.6 2024-09-19T13:42:47.318 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.312+0000 7efe0719e9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-19T13:42:47.318 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.312+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.7 2024-09-19T13:42:47.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.312+0000 7efe0719e9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-19T13:42:47.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.312+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:47.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.316+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.9 2024-09-19T13:42:47.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.316+0000 7efe0719e9c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-19T13:42:47.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.316+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:47.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.316+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:47.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.320+0000 7efe0719e9c0 20 get_obj_state: octx=0x55b86dd96510 obj=check-bucket:e state=0x55b86e03f028 s->prefetch_data=0 2024-09-19T13:42:47.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.320+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:47.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.320+0000 7efe0719e9c0 20 get_obj_state: octx=0x55b86dda7f70 obj=check-bucket:d state=0x55b86e046828 s->prefetch_data=0 2024-09-19T13:42:47.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.320+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:47.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.320+0000 7efe0719e9c0 20 get_obj_state: octx=0x55b86e047ae0 obj=check-bucket:c state=0x55b86e03fb88 s->prefetch_data=0 2024-09-19T13:42:47.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.320+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:47.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.320+0000 7efe0719e9c0 20 get_obj_state: octx=0x55b86e047580 obj=check-bucket:f state=0x55b86e042a38 s->prefetch_data=0 2024-09-19T13:42:47.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.320+0000 7efe0719e9c0 20 get_obj_state: setting s->obj_tag to vlyg8s1w0w0bx5ukrmb134b0n4619u9a 2024-09-19T13:42:47.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.320+0000 7efe0719e9c0 20 get_obj_state_impl: setting s->olh_tag to v1a99q2claz95vpp9vme5s241bg7qvzh 2024-09-19T13:42:47.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.320+0000 7efe0719e9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=v1a99q2claz95vpp9vme5s241bg7qvzh 2024-09-19T13:42:47.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.320+0000 7efe0719e9c0 20 get_obj_state: setting s->obj_tag to 0o665vclfwrhs26gy327d714ivcx486i 2024-09-19T13:42:47.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.320+0000 7efe0719e9c0 20 get_obj_state_impl: setting s->olh_tag to zjbx50v7hw8jpf6hzxw51olezromdn02 2024-09-19T13:42:47.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.320+0000 7efe0719e9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zjbx50v7hw8jpf6hzxw51olezromdn02 2024-09-19T13:42:47.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.320+0000 7efe0719e9c0 20 get_obj_state: setting s->obj_tag to er51sluf90kfz8wm4zurwd19qh36bkyd 2024-09-19T13:42:47.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.320+0000 7efe0719e9c0 20 get_obj_state_impl: setting s->olh_tag to b8xrrrdcustledtfigfc43356uf8xl0t 2024-09-19T13:42:47.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.320+0000 7efe0719e9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=b8xrrrdcustledtfigfc43356uf8xl0t 2024-09-19T13:42:47.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.324+0000 7efe0719e9c0 20 get_obj_state: setting s->obj_tag to m03gyray7j104fgovzhrtb6bxvek10c8 2024-09-19T13:42:47.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.324+0000 7efe0719e9c0 20 get_obj_state_impl: setting s->olh_tag to 33qd4fvf79kp4b0fukz5ud5a7cumzxtg 2024-09-19T13:42:47.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.324+0000 7efe0719e9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=33qd4fvf79kp4b0fukz5ud5a7cumzxtg 2024-09-19T13:42:47.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.324+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:47.331 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.324+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:47.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.328+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:47.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.328+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:47.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.328+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:47.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.328+0000 7efe0719e9c0 20 olh_log_entry: epoch=3 op=3 key=d[RgCjynHTyVu54NYiDoW7qgNJD1u1fMt] 2024-09-19T13:42:47.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.328+0000 7efe0719e9c0 20 get_obj_state: octx=0x55b86dda7f70 obj=check-bucket:_:RgCjynHTyVu54NYiDoW7qgNJD1u1fMt_d state=0x55b86e0eb188 s->prefetch_data=0 2024-09-19T13:42:47.336 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.332+0000 7efe0719e9c0 10 manifest: total_size = 9 2024-09-19T13:42:47.336 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.332+0000 7efe0719e9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.6646135989607373705 2024-09-19T13:42:47.337 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.332+0000 7efe0719e9c0 20 get_obj_state: octx=0x55b86dda7f70 obj=check-bucket:_:RgCjynHTyVu54NYiDoW7qgNJD1u1fMt_d state=0x55b86e0eb188 s->prefetch_data=0 2024-09-19T13:42:47.337 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.332+0000 7efe0719e9c0 20 prepare_atomic_modification: state is not atomic. state=0x55b86e0eb188 2024-09-19T13:42:47.337 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.332+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:47.338 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.332+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:47.338 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.332+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:47.339 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.332+0000 7efe0719e9c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-19T13:42:47.339 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.332+0000 7efe0719e9c0 20 olh_log_entry: epoch=2 op=3 key=f[.FrzGQ.-93v1.N0A5ky0LvrTUXWEfdY] 2024-09-19T13:42:47.339 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.332+0000 7efe0719e9c0 20 get_obj_state: octx=0x55b86e047580 obj=check-bucket:_:.FrzGQ.-93v1.N0A5ky0LvrTUXWEfdY_f state=0x55b86e0f3f08 s->prefetch_data=0 2024-09-19T13:42:47.339 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.332+0000 7efe0719e9c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-19T13:42:47.340 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.332+0000 7efe0719e9c0 20 olh_log_entry: epoch=2 op=3 key=e[BRwszSyr1R4DcHRCnBR-VOcqe3kFEJ6] 2024-09-19T13:42:47.340 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.332+0000 7efe0719e9c0 20 get_obj_state: octx=0x55b86dd96510 obj=check-bucket:_:BRwszSyr1R4DcHRCnBR-VOcqe3kFEJ6_e state=0x55b86e0faac8 s->prefetch_data=0 2024-09-19T13:42:47.340 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.336+0000 7efe0719e9c0 10 manifest: total_size = 9 2024-09-19T13:42:47.340 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.336+0000 7efe0719e9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.10681166551260621108 2024-09-19T13:42:47.340 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.336+0000 7efe0719e9c0 20 get_obj_state: octx=0x55b86e047580 obj=check-bucket:_:.FrzGQ.-93v1.N0A5ky0LvrTUXWEfdY_f state=0x55b86e0f3f08 s->prefetch_data=0 2024-09-19T13:42:47.340 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.336+0000 7efe0719e9c0 20 prepare_atomic_modification: state is not atomic. state=0x55b86e0f3f08 2024-09-19T13:42:47.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.336+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:47.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.336+0000 7efe0719e9c0 10 manifest: total_size = 22 2024-09-19T13:42:47.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.336+0000 7efe0719e9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.16101823865266898281 2024-09-19T13:42:47.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.336+0000 7efe0719e9c0 20 get_obj_state: octx=0x55b86dd96510 obj=check-bucket:_:BRwszSyr1R4DcHRCnBR-VOcqe3kFEJ6_e state=0x55b86e0faac8 s->prefetch_data=0 2024-09-19T13:42:47.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.336+0000 7efe0719e9c0 20 prepare_atomic_modification: state is not atomic. state=0x55b86e0faac8 2024-09-19T13:42:47.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.336+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:47.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.336+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:47.342 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.336+0000 7efe0719e9c0 20 olh_log_entry: epoch=3 op=3 key=c[ozAqKNk48IBhPBII--fpccQX0ZZRfw0] 2024-09-19T13:42:47.342 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.336+0000 7efe0719e9c0 20 get_obj_state: octx=0x55b86e047ae0 obj=check-bucket:_:ozAqKNk48IBhPBII--fpccQX0ZZRfw0_c state=0x55b86e0ef4f8 s->prefetch_data=0 2024-09-19T13:42:47.343 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.336+0000 7efe0719e9c0 10 manifest: total_size = 9 2024-09-19T13:42:47.343 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.336+0000 7efe0719e9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.17615858298369449801 2024-09-19T13:42:47.343 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.336+0000 7efe0719e9c0 20 get_obj_state: octx=0x55b86e047ae0 obj=check-bucket:_:ozAqKNk48IBhPBII--fpccQX0ZZRfw0_c state=0x55b86e0ef4f8 s->prefetch_data=0 2024-09-19T13:42:47.343 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.336+0000 7efe0719e9c0 20 prepare_atomic_modification: state is not atomic. state=0x55b86e0ef4f8 2024-09-19T13:42:47.343 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.336+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:47.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.340+0000 7efe0719e9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:42:47.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.340+0000 7efe0719e9c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-19T13:42:47.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.340+0000 7efe0719e9c0 0 deleting objects inline since gc isn't initialized 2024-09-19T13:42:47.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.340+0000 7efe0719e9c0 5 delete_objs_inline: removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.1__shadow:RgCjynHTyVu54NYiDoW7qgNJD1u1fMt_.9BC5nUaECi4D1jXQEjkvIJd8Da3xiFO_0 2024-09-19T13:42:47.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.340+0000 7efe0719e9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:42:47.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.340+0000 7efe0719e9c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-19T13:42:47.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.340+0000 7efe0719e9c0 0 deleting objects inline since gc isn't initialized 2024-09-19T13:42:47.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.340+0000 7efe0719e9c0 5 delete_objs_inline: removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.1__shadow:.FrzGQ.-93v1.N0A5ky0LvrTUXWEfdY_.grjZBsBBwSCuqn44_ItbWkHbr8DnWuQ_0 2024-09-19T13:42:47.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.344+0000 7efcdaffd640 20 handle_completion(): completion ok for obj=d[RgCjynHTyVu54NYiDoW7qgNJD1u1fMt] 2024-09-19T13:42:47.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.344+0000 7efe0719e9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-19T13:42:47.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.344+0000 7efe0719e9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:42:47.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.344+0000 7efe0719e9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-19T13:42:47.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.344+0000 7efe0719e9c0 0 deleting objects inline since gc isn't initialized 2024-09-19T13:42:47.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.344+0000 7efe0719e9c0 5 delete_objs_inline: removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.1__shadow:BRwszSyr1R4DcHRCnBR-VOcqe3kFEJ6_.Xt9DusOBxa01l2jtiNQ_SIX4F1BYWDb_0 2024-09-19T13:42:47.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.348+0000 7efe0719e9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-19T13:42:47.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.348+0000 7efe0719e9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:42:47.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.348+0000 7efe0719e9c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-19T13:42:47.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.348+0000 7efe0719e9c0 0 deleting objects inline since gc isn't initialized 2024-09-19T13:42:47.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.348+0000 7efe0719e9c0 5 delete_objs_inline: removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.1__shadow:ozAqKNk48IBhPBII--fpccQX0ZZRfw0_.1Sq7NPdPxY3mgDEnJ6TB8yB3-vnSFbz_0 2024-09-19T13:42:47.353 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.348+0000 7efcdaffd640 20 handle_completion(): completion ok for obj=f[.FrzGQ.-93v1.N0A5ky0LvrTUXWEfdY] 2024-09-19T13:42:47.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.348+0000 7efe0719e9c0 20 get_obj_state: octx=0x55b86e047580 obj=check-bucket:f state=0x55b86e042a38 s->prefetch_data=0 2024-09-19T13:42:47.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.348+0000 7efe0719e9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=33qd4fvf79kp4b0fukz5ud5a7cumzxtg 2024-09-19T13:42:47.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.348+0000 7efcdb7fe640 20 handle_completion(): completion ok for obj=e[BRwszSyr1R4DcHRCnBR-VOcqe3kFEJ6] 2024-09-19T13:42:47.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.348+0000 7efe0719e9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-19T13:42:47.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.352+0000 7efcdaffd640 20 handle_completion(): completion ok for obj=c[ozAqKNk48IBhPBII--fpccQX0ZZRfw0] 2024-09-19T13:42:47.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.352+0000 7efe0719e9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-19T13:42:47.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.352+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:47.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.352+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:47.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.356+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:47.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.356+0000 7efe0719e9c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-19T13:42:47.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.356+0000 7efe0719e9c0 20 get_obj_state: octx=0x55b86dd96510 obj=check-bucket:e state=0x55b86e03f028 s->prefetch_data=0 2024-09-19T13:42:47.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.356+0000 7efe0719e9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=v1a99q2claz95vpp9vme5s241bg7qvzh 2024-09-19T13:42:47.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.356+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:47.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.356+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:47.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.360+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:47.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.360+0000 7efe0719e9c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-19T13:42:47.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.364+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:47.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.364+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:47.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.368+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:47.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.368+0000 7efe0719e9c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-19T13:42:47.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.368+0000 7efe0719e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:47.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.368+0000 7efe0719e9c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-19T13:42:47.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.368+0000 7efe0719e9c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-19T13:42:47.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.368+0000 7efcbb7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:47.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.376+0000 7efe0719e9c0 20 remove_watcher() i=0 2024-09-19T13:42:47.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.376+0000 7efe0719e9c0 2 removed watcher, disabling cache 2024-09-19T13:42:47.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.376+0000 7efe0719e9c0 20 remove_watcher() i=1 2024-09-19T13:42:47.385 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.380+0000 7efe0719e9c0 20 remove_watcher() i=2 2024-09-19T13:42:47.387 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.380+0000 7efe0719e9c0 20 remove_watcher() i=3 2024-09-19T13:42:47.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.384+0000 7efe0719e9c0 20 remove_watcher() i=4 2024-09-19T13:42:47.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.384+0000 7efe0719e9c0 20 remove_watcher() i=5 2024-09-19T13:42:47.393 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.388+0000 7efe0719e9c0 20 remove_watcher() i=6 2024-09-19T13:42:47.395 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:47.388+0000 7efe0719e9c0 20 remove_watcher() i=7 2024-09-19T13:42:47.412 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:47.412 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:47.438 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:47.438 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:47.479 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:47.479 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:47.536 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:47.536 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:47.594 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-19T13:42:47.594 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:42:47.596 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:47.596 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:47.736 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:47.736 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:47.799 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:47.799 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:47.867 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:47.867 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:47.937 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:47.937 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:48.002 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-19T13:42:48.002 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:42:48.003 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-19T13:42:48.039 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:48.039 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:48.085 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.080+0000 7f4e4b2989c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.080+0000 7f4e4b2989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:48.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.080+0000 7f4e4b2989c0 20 realm 2024-09-19T13:42:48.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.080+0000 7f4e4b2989c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.080+0000 7f4e4b2989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:48.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.080+0000 7f4e4b2989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:48.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.080+0000 7f4e4b2989c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.080+0000 7f4e4b2989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:48.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.080+0000 7f4e4b2989c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.084+0000 7f4e4b2989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:48.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.084+0000 7f4e4b2989c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.084+0000 7f4e4b2989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:48.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.084+0000 7f4e4b2989c0 20 searching for the correct realm 2024-09-19T13:42:48.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.092+0000 7f4e4959f640 0 -- 172.21.15.153:0/4100260488 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7f4e300c1070 msgr2=0x7f4e300ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:48.314 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.308+0000 7f4e48d9e640 0 -- 172.21.15.153:0/4100260488 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x55b5a9860e20 msgr2=0x55b5a9863210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:48.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.316+0000 7f4e4b2989c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:48.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.316+0000 7f4e4b2989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:48.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.316+0000 7f4e4b2989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:48.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.316+0000 7f4e4b2989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:48.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.316+0000 7f4e4b2989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:48.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.316+0000 7f4e4b2989c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:48.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.316+0000 7f4e4b2989c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.316+0000 7f4e4b2989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:48.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.316+0000 7f4e4b2989c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.316+0000 7f4e4b2989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:48.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.316+0000 7f4e4b2989c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.320+0000 7f4e4b2989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:48.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.320+0000 7f4e4b2989c0 20 zone default found 2024-09-19T13:42:48.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.320+0000 7f4e4b2989c0 4 Realm: () 2024-09-19T13:42:48.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.320+0000 7f4e4b2989c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:48.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.320+0000 7f4e4b2989c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:48.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.320+0000 7f4e4b2989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:48.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.320+0000 7f4e4b2989c0 20 zonegroup default 2024-09-19T13:42:48.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.320+0000 7f4e4b2989c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.320+0000 7f4e4b2989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:48.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.320+0000 7f4e4b2989c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.320+0000 7f4e4b2989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:48.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.320+0000 7f4e4b2989c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.320+0000 7f4e4b2989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:48.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.320+0000 7f4e4b2989c0 20 started sync module instance, tier type = 2024-09-19T13:42:48.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.320+0000 7f4e4b2989c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:48.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.344+0000 7f4e4b2989c0 20 add_watcher() i=0 2024-09-19T13:42:48.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.344+0000 7f4e4b2989c0 20 add_watcher() i=1 2024-09-19T13:42:48.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.344+0000 7f4e4b2989c0 20 add_watcher() i=2 2024-09-19T13:42:48.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.344+0000 7f4e4b2989c0 20 add_watcher() i=3 2024-09-19T13:42:48.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.344+0000 7f4e4b2989c0 20 add_watcher() i=4 2024-09-19T13:42:48.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.344+0000 7f4e4b2989c0 20 add_watcher() i=5 2024-09-19T13:42:48.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.344+0000 7f4e4b2989c0 20 add_watcher() i=6 2024-09-19T13:42:48.354 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.348+0000 7f4e4b2989c0 20 add_watcher() i=7 2024-09-19T13:42:48.354 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.348+0000 7f4e4b2989c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:48.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.352+0000 7f4cfefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:48.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.352+0000 7f4e4b2989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:48.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.352+0000 7f4e4b2989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:48.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.352+0000 7f4e4b2989c0 5 note: GC not initialized 2024-09-19T13:42:48.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.356+0000 7f4cfdfe3640 20 reqs_thread_entry: start 2024-09-19T13:42:48.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.356+0000 7f4e4b2989c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:48.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.356+0000 7f4e4b2989c0 20 Filter name: none 2024-09-19T13:42:48.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.356+0000 7f4c6f7fe640 20 reqs_thread_entry: start 2024-09-19T13:42:48.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.356+0000 7f4e4b2989c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T13:42:48.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.356+0000 7f4e4b2989c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.356+0000 7f4e4b2989c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:48.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.356+0000 7f4e4b2989c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T13:42:48.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.356+0000 7f4e4b2989c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T13:42:48.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.356+0000 7f4e4b2989c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 : miss 2024-09-19T13:42:48.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.356+0000 7f4e4b2989c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.356+0000 7f4e4b2989c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:48.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.356+0000 7f4e4b2989c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 info.flags=0x17 2024-09-19T13:42:48.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.356+0000 7f4e4b2989c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 to cache LRU end 2024-09-19T13:42:48.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.356+0000 7f4e4b2989c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:42:48.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.356+0000 7f4e4b2989c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T13:42:48.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.356+0000 7f4e4b2989c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 2024-09-19T13:42:48.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.356+0000 7f4e4b2989c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.0 2024-09-19T13:42:48.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.360+0000 7f4e4b2989c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-19T13:42:48.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.360+0000 7f4e4b2989c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:48.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.360+0000 7f4e4b2989c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-19T13:42:48.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.360+0000 7f4e4b2989c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.2 2024-09-19T13:42:48.367 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.360+0000 7f4e4b2989c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-19T13:42:48.367 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.360+0000 7f4e4b2989c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.3 2024-09-19T13:42:48.367 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.360+0000 7f4e4b2989c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-19T13:42:48.367 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.360+0000 7f4e4b2989c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.4 2024-09-19T13:42:48.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.364+0000 7f4e4b2989c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-19T13:42:48.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.364+0000 7f4e4b2989c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:48.370 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.364+0000 7f4e4b2989c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-19T13:42:48.370 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.364+0000 7f4e4b2989c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.6 2024-09-19T13:42:48.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.364+0000 7f4e4b2989c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-19T13:42:48.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.364+0000 7f4e4b2989c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.7 2024-09-19T13:42:48.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.368+0000 7f4e4b2989c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-19T13:42:48.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.368+0000 7f4e4b2989c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:48.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.368+0000 7f4e4b2989c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-19T13:42:48.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.368+0000 7f4e4b2989c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.9 2024-09-19T13:42:48.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.368+0000 7f4e4b2989c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-19T13:42:48.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.368+0000 7f4e4b2989c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:48.376 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.372+0000 7f4e4b2989c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-19T13:42:48.377 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.372+0000 7f4e4b2989c0 1 NOTICE: finished all shards (0 entries found) 2024-09-19T13:42:48.378 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.372+0000 7f4cfefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:48.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.376+0000 7f4e4b2989c0 20 remove_watcher() i=0 2024-09-19T13:42:48.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.376+0000 7f4e4b2989c0 2 removed watcher, disabling cache 2024-09-19T13:42:48.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.380+0000 7f4e4b2989c0 20 remove_watcher() i=1 2024-09-19T13:42:48.388 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.384+0000 7f4e4b2989c0 20 remove_watcher() i=2 2024-09-19T13:42:48.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.384+0000 7f4e4b2989c0 20 remove_watcher() i=3 2024-09-19T13:42:48.393 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.388+0000 7f4e4b2989c0 20 remove_watcher() i=4 2024-09-19T13:42:48.395 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.388+0000 7f4e4b2989c0 20 remove_watcher() i=5 2024-09-19T13:42:48.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.392+0000 7f4e4b2989c0 20 remove_watcher() i=6 2024-09-19T13:42:48.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.392+0000 7f4e4b2989c0 20 remove_watcher() i=7 2024-09-19T13:42:48.416 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:48.416 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:48.734 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:48.734 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:48.867 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-19T13:42:48.903 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:48.903 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:48.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.940+0000 7f42f56669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.944+0000 7f42f56669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:48.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.944+0000 7f42f56669c0 20 realm 2024-09-19T13:42:48.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.944+0000 7f42f56669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.944+0000 7f42f56669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:48.950 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.944+0000 7f42f56669c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:48.950 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.944+0000 7f42f56669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.950 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.944+0000 7f42f56669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:48.950 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.944+0000 7f42f56669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.944+0000 7f42f56669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:48.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.944+0000 7f42f56669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.948+0000 7f42f56669c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:48.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.948+0000 7f42f56669c0 20 searching for the correct realm 2024-09-19T13:42:48.957 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.952+0000 7f42f396d640 0 -- 172.21.15.153:0/3838797438 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x563aadcb1170 msgr2=0x563aadcb35c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:48.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.956+0000 7f42f316c640 0 -- 172.21.15.153:0/3838797438 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f42e8071d10 msgr2=0x7f42e8066be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:48.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.964+0000 7f42f56669c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:48.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.964+0000 7f42f56669c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:48.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.964+0000 7f42f56669c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:48.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.964+0000 7f42f56669c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:48.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.964+0000 7f42f56669c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:48.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.964+0000 7f42f56669c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:48.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.964+0000 7f42f56669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.964+0000 7f42f56669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:48.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.964+0000 7f42f56669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.971 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.964+0000 7f42f56669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:48.971 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.964+0000 7f42f56669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.971 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.964+0000 7f42f56669c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:48.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.964+0000 7f42f56669c0 20 zone default found 2024-09-19T13:42:48.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.964+0000 7f42f56669c0 4 Realm: () 2024-09-19T13:42:48.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.964+0000 7f42f56669c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:48.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.964+0000 7f42f56669c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:48.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.964+0000 7f42f56669c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:48.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.964+0000 7f42f56669c0 20 zonegroup default 2024-09-19T13:42:48.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.964+0000 7f42f56669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.964+0000 7f42f56669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:48.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.964+0000 7f42f56669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.968+0000 7f42f56669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:48.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.968+0000 7f42f56669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.968+0000 7f42f56669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:48.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.968+0000 7f42f56669c0 20 started sync module instance, tier type = 2024-09-19T13:42:48.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.968+0000 7f42f56669c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:48.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.984+0000 7f42f56669c0 20 add_watcher() i=0 2024-09-19T13:42:48.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.984+0000 7f42f56669c0 20 add_watcher() i=1 2024-09-19T13:42:48.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.984+0000 7f42f56669c0 20 add_watcher() i=2 2024-09-19T13:42:48.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.984+0000 7f42f56669c0 20 add_watcher() i=3 2024-09-19T13:42:48.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.984+0000 7f42f56669c0 20 add_watcher() i=4 2024-09-19T13:42:48.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.984+0000 7f42f56669c0 20 add_watcher() i=5 2024-09-19T13:42:48.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.984+0000 7f42f56669c0 20 add_watcher() i=6 2024-09-19T13:42:48.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.984+0000 7f42f56669c0 20 add_watcher() i=7 2024-09-19T13:42:48.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.984+0000 7f42f56669c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:48.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.988+0000 7f41a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:48.994 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.988+0000 7f42f56669c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:48.994 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.988+0000 7f42f56669c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:48.994 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.988+0000 7f42f56669c0 5 note: GC not initialized 2024-09-19T13:42:48.994 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.988+0000 7f41a8fe1640 20 reqs_thread_entry: start 2024-09-19T13:42:48.994 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.988+0000 7f42f56669c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:48.994 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.988+0000 7f42f56669c0 20 Filter name: none 2024-09-19T13:42:48.994 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.988+0000 7f41227fc640 20 reqs_thread_entry: start 2024-09-19T13:42:48.994 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.988+0000 7f42f56669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.994 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.988+0000 7f42f56669c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:48.994 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.988+0000 7f42f56669c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:48.995 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.988+0000 7f42f56669c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:48.995 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.988+0000 7f42f56669c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:42:48.995 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.988+0000 7f42f56669c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T13:42:48.995 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.988+0000 7f42f56669c0 20 INFO: main: starting shard=0 2024-09-19T13:42:48.995 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.988+0000 7f42f56669c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.0 2024-09-19T13:42:48.996 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.988+0000 7f42f56669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:48.996 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.988+0000 7f42f56669c0 20 INFO: main: starting shard=1 2024-09-19T13:42:48.996 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.988+0000 7f42f56669c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:48.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.992+0000 7f42f56669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:48.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.992+0000 7f42f56669c0 20 INFO: main: starting shard=2 2024-09-19T13:42:48.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.992+0000 7f42f56669c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.2 2024-09-19T13:42:48.998 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.992+0000 7f42f56669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:48.998 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.992+0000 7f42f56669c0 20 INFO: main: starting shard=3 2024-09-19T13:42:48.998 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.992+0000 7f42f56669c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.3 2024-09-19T13:42:48.999 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.992+0000 7f42f56669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:48.999 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.992+0000 7f42f56669c0 20 INFO: main: starting shard=4 2024-09-19T13:42:48.999 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.992+0000 7f42f56669c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.4 2024-09-19T13:42:49.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.996+0000 7f42f56669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:49.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.996+0000 7f42f56669c0 20 INFO: main: starting shard=5 2024-09-19T13:42:49.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.996+0000 7f42f56669c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:49.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.996+0000 7f42f56669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:49.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.996+0000 7f42f56669c0 20 INFO: main: starting shard=6 2024-09-19T13:42:49.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.996+0000 7f42f56669c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.6 2024-09-19T13:42:49.001 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.996+0000 7f42f56669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:49.001 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.996+0000 7f42f56669c0 20 INFO: main: starting shard=7 2024-09-19T13:42:49.001 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.996+0000 7f42f56669c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.7 2024-09-19T13:42:49.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.996+0000 7f42f56669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:49.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.996+0000 7f42f56669c0 20 INFO: main: starting shard=8 2024-09-19T13:42:49.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.996+0000 7f42f56669c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:49.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.996+0000 7f42f56669c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-19T13:42:49.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.996+0000 7f42f56669c0 20 INFO: main: starting shard=9 2024-09-19T13:42:49.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:48.996+0000 7f42f56669c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.9 2024-09-19T13:42:49.004 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.000+0000 7f42f56669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:49.004 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.000+0000 7f42f56669c0 20 INFO: main: starting shard=10 2024-09-19T13:42:49.004 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.000+0000 7f42f56669c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:49.006 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.000+0000 7f42f56669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:49.006 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.000+0000 7f42f56669c0 20 INFO: main: done 2024-09-19T13:42:49.007 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.000+0000 7f41a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:49.012 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.008+0000 7f42f56669c0 20 remove_watcher() i=0 2024-09-19T13:42:49.012 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.008+0000 7f42f56669c0 2 removed watcher, disabling cache 2024-09-19T13:42:49.014 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.008+0000 7f42f56669c0 20 remove_watcher() i=1 2024-09-19T13:42:49.016 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.012+0000 7f42f56669c0 20 remove_watcher() i=2 2024-09-19T13:42:49.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.012+0000 7f42f56669c0 20 remove_watcher() i=3 2024-09-19T13:42:49.020 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.016+0000 7f42f56669c0 20 remove_watcher() i=4 2024-09-19T13:42:49.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.016+0000 7f42f56669c0 20 remove_watcher() i=5 2024-09-19T13:42:49.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.016+0000 7f42f56669c0 20 remove_watcher() i=6 2024-09-19T13:42:49.024 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.020+0000 7f42f56669c0 20 remove_watcher() i=7 2024-09-19T13:42:49.038 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-19T13:42:49.066 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:49.066 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:49.109 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.104+0000 7fb0787889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.104+0000 7fb0787889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:49.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.104+0000 7fb0787889c0 20 realm 2024-09-19T13:42:49.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.104+0000 7fb0787889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.104+0000 7fb0787889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:49.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.104+0000 7fb0787889c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:49.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.104+0000 7fb0787889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.104+0000 7fb0787889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:49.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.104+0000 7fb0787889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.112 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.108+0000 7fb0787889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:49.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.108+0000 7fb0787889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.108+0000 7fb0787889c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:49.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.108+0000 7fb0787889c0 20 searching for the correct realm 2024-09-19T13:42:49.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.116+0000 7fb076a8f640 0 -- 172.21.15.153:0/3394850503 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7fb06c0ed410 msgr2=0x7fb06c0ed890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:49.338 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.332+0000 7fb07628e640 0 -- 172.21.15.153:0/3394850503 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x557ec63ceb50 msgr2=0x557ec63d0f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:49.345 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.340+0000 7fb0787889c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:49.345 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.340+0000 7fb0787889c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:49.346 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.340+0000 7fb0787889c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:49.346 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.340+0000 7fb0787889c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:49.346 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.340+0000 7fb0787889c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:49.346 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.340+0000 7fb0787889c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:49.346 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.340+0000 7fb0787889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.346 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.340+0000 7fb0787889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:49.346 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.340+0000 7fb0787889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.340+0000 7fb0787889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:49.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.340+0000 7fb0787889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.344+0000 7fb0787889c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:49.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.344+0000 7fb0787889c0 20 zone default found 2024-09-19T13:42:49.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.344+0000 7fb0787889c0 4 Realm: () 2024-09-19T13:42:49.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.344+0000 7fb0787889c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:49.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.344+0000 7fb0787889c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:49.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.344+0000 7fb0787889c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:49.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.344+0000 7fb0787889c0 20 zonegroup default 2024-09-19T13:42:49.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.344+0000 7fb0787889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.344+0000 7fb0787889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:49.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.344+0000 7fb0787889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.344+0000 7fb0787889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:49.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.344+0000 7fb0787889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.344+0000 7fb0787889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:49.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.344+0000 7fb0787889c0 20 started sync module instance, tier type = 2024-09-19T13:42:49.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.344+0000 7fb0787889c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:49.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.368+0000 7fb0787889c0 20 add_watcher() i=0 2024-09-19T13:42:49.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.368+0000 7fb0787889c0 20 add_watcher() i=1 2024-09-19T13:42:49.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.368+0000 7fb0787889c0 20 add_watcher() i=2 2024-09-19T13:42:49.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.368+0000 7fb0787889c0 20 add_watcher() i=3 2024-09-19T13:42:49.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.368+0000 7fb0787889c0 20 add_watcher() i=4 2024-09-19T13:42:49.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.368+0000 7fb0787889c0 20 add_watcher() i=5 2024-09-19T13:42:49.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.368+0000 7fb0787889c0 20 add_watcher() i=6 2024-09-19T13:42:49.377 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.372+0000 7fb0787889c0 20 add_watcher() i=7 2024-09-19T13:42:49.377 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.372+0000 7fb0787889c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:49.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.376+0000 7faf2cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:49.382 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.376+0000 7fb0787889c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:49.382 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.376+0000 7fb0787889c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:49.382 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.376+0000 7fb0787889c0 5 note: GC not initialized 2024-09-19T13:42:49.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.376+0000 7faea77fe640 20 reqs_thread_entry: start 2024-09-19T13:42:49.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.376+0000 7fb0787889c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:49.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.376+0000 7fb0787889c0 20 Filter name: none 2024-09-19T13:42:49.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.376+0000 7faea57fa640 20 reqs_thread_entry: start 2024-09-19T13:42:49.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.376+0000 7fb0787889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.380+0000 7fb0787889c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:49.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.380+0000 7fb0787889c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.380+0000 7fb0787889c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:49.385 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.380+0000 7fb0787889c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:42:49.385 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.380+0000 7fb0787889c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T13:42:49.385 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.380+0000 7fb0787889c0 20 INFO: main: starting shard=0 2024-09-19T13:42:49.385 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.380+0000 7fb0787889c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.0 2024-09-19T13:42:49.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.380+0000 7fb0787889c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:49.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.380+0000 7fb0787889c0 20 INFO: main: starting shard=1 2024-09-19T13:42:49.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.380+0000 7fb0787889c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:49.387 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.380+0000 7fb0787889c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:49.387 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.380+0000 7fb0787889c0 20 INFO: main: starting shard=2 2024-09-19T13:42:49.387 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.380+0000 7fb0787889c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.2 2024-09-19T13:42:49.388 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.384+0000 7fb0787889c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:49.388 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.384+0000 7fb0787889c0 20 INFO: main: starting shard=3 2024-09-19T13:42:49.388 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.384+0000 7fb0787889c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.3 2024-09-19T13:42:49.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.384+0000 7fb0787889c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:49.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.384+0000 7fb0787889c0 20 INFO: main: starting shard=4 2024-09-19T13:42:49.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.384+0000 7fb0787889c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.4 2024-09-19T13:42:49.390 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.384+0000 7fb0787889c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:49.390 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.384+0000 7fb0787889c0 20 INFO: main: starting shard=5 2024-09-19T13:42:49.390 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.384+0000 7fb0787889c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:49.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.384+0000 7fb0787889c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-19T13:42:49.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.384+0000 7fb0787889c0 20 INFO: main: starting shard=6 2024-09-19T13:42:49.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.384+0000 7fb0787889c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.6 2024-09-19T13:42:49.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.388+0000 7fb0787889c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:49.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.388+0000 7fb0787889c0 20 INFO: main: starting shard=7 2024-09-19T13:42:49.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.388+0000 7fb0787889c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.7 2024-09-19T13:42:49.393 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.388+0000 7fb0787889c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:49.393 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.388+0000 7fb0787889c0 20 INFO: main: starting shard=8 2024-09-19T13:42:49.393 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.388+0000 7fb0787889c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:49.394 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.388+0000 7fb0787889c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:49.394 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.388+0000 7fb0787889c0 20 INFO: main: starting shard=9 2024-09-19T13:42:49.394 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.388+0000 7fb0787889c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.9 2024-09-19T13:42:49.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.392+0000 7fb0787889c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:49.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.392+0000 7fb0787889c0 20 INFO: main: starting shard=10 2024-09-19T13:42:49.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.392+0000 7fb0787889c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:49.397 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.392+0000 7fb0787889c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:49.397 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.392+0000 7fb0787889c0 20 INFO: main: done 2024-09-19T13:42:49.399 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.392+0000 7faf2cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:49.404 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.400+0000 7fb0787889c0 20 remove_watcher() i=0 2024-09-19T13:42:49.404 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.400+0000 7fb0787889c0 2 removed watcher, disabling cache 2024-09-19T13:42:49.406 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.400+0000 7fb0787889c0 20 remove_watcher() i=1 2024-09-19T13:42:49.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.404+0000 7fb0787889c0 20 remove_watcher() i=2 2024-09-19T13:42:49.411 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.404+0000 7fb0787889c0 20 remove_watcher() i=3 2024-09-19T13:42:49.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.408+0000 7fb0787889c0 20 remove_watcher() i=4 2024-09-19T13:42:49.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.412+0000 7fb0787889c0 20 remove_watcher() i=5 2024-09-19T13:42:49.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.412+0000 7fb0787889c0 20 remove_watcher() i=6 2024-09-19T13:42:49.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.412+0000 7fb0787889c0 20 remove_watcher() i=7 2024-09-19T13:42:49.436 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-19T13:42:49.436 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:42:49.436 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-19T13:42:49.468 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:49.468 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:49.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.508+0000 7f08fca809c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.513 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.508+0000 7f08fca809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:49.513 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.508+0000 7f08fca809c0 20 realm 2024-09-19T13:42:49.513 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.508+0000 7f08fca809c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.508+0000 7f08fca809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:49.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.508+0000 7f08fca809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:49.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.508+0000 7f08fca809c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.508+0000 7f08fca809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:49.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.508+0000 7f08fca809c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.516 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.508+0000 7f08fca809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:49.516 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.508+0000 7f08fca809c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.516 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.512+0000 7f08fca809c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:49.516 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.512+0000 7f08fca809c0 20 searching for the correct realm 2024-09-19T13:42:49.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.516+0000 7f08fad87640 0 -- 172.21.15.153:0/2641309975 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7f08f003cb60 msgr2=0x7f08f00093d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:49.737 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.732+0000 7f08fa586640 0 -- 172.21.15.153:0/2641309975 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x5609bb682f00 msgr2=0x5609bb6852f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:49.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.740+0000 7f08fca809c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:49.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.740+0000 7f08fca809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:49.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.740+0000 7f08fca809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:49.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.740+0000 7f08fca809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:49.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.740+0000 7f08fca809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:49.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.740+0000 7f08fca809c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:49.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.740+0000 7f08fca809c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.740+0000 7f08fca809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:49.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.740+0000 7f08fca809c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.746 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.740+0000 7f08fca809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:49.746 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.740+0000 7f08fca809c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.747 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.740+0000 7f08fca809c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:49.747 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.740+0000 7f08fca809c0 20 zone default found 2024-09-19T13:42:49.747 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.740+0000 7f08fca809c0 4 Realm: () 2024-09-19T13:42:49.748 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.740+0000 7f08fca809c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:49.748 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.740+0000 7f08fca809c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:49.748 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.740+0000 7f08fca809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:49.748 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.740+0000 7f08fca809c0 20 zonegroup default 2024-09-19T13:42:49.748 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.740+0000 7f08fca809c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.748 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.744+0000 7f08fca809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:49.748 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.744+0000 7f08fca809c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.749 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.744+0000 7f08fca809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:49.749 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.744+0000 7f08fca809c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.749 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.744+0000 7f08fca809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:49.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.744+0000 7f08fca809c0 20 started sync module instance, tier type = 2024-09-19T13:42:49.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.744+0000 7f08fca809c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:49.778 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.772+0000 7f08fca809c0 20 add_watcher() i=0 2024-09-19T13:42:49.779 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.772+0000 7f08fca809c0 20 add_watcher() i=1 2024-09-19T13:42:49.779 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.772+0000 7f08fca809c0 20 add_watcher() i=2 2024-09-19T13:42:49.779 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.772+0000 7f08fca809c0 20 add_watcher() i=3 2024-09-19T13:42:49.779 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.772+0000 7f08fca809c0 20 add_watcher() i=4 2024-09-19T13:42:49.779 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.772+0000 7f08fca809c0 20 add_watcher() i=5 2024-09-19T13:42:49.779 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.772+0000 7f08fca809c0 20 add_watcher() i=6 2024-09-19T13:42:49.781 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.776+0000 7f08fca809c0 20 add_watcher() i=7 2024-09-19T13:42:49.781 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.776+0000 7f08fca809c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:49.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.780+0000 7f07b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:49.786 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.780+0000 7f08fca809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:49.786 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.780+0000 7f08fca809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:49.786 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.780+0000 7f08fca809c0 5 note: GC not initialized 2024-09-19T13:42:49.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.780+0000 7f072b7fe640 20 reqs_thread_entry: start 2024-09-19T13:42:49.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.780+0000 7f08fca809c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:49.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.780+0000 7f08fca809c0 20 Filter name: none 2024-09-19T13:42:49.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.780+0000 7f07297fa640 20 reqs_thread_entry: start 2024-09-19T13:42:49.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.784+0000 7f08fca809c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T13:42:49.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.784+0000 7f08fca809c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.784+0000 7f08fca809c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:49.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.784+0000 7f08fca809c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T13:42:49.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.784+0000 7f08fca809c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T13:42:49.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.784+0000 7f08fca809c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 : miss 2024-09-19T13:42:49.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.784+0000 7f08fca809c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:49.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.784+0000 7f08fca809c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:49.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.784+0000 7f08fca809c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 info.flags=0x17 2024-09-19T13:42:49.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.784+0000 7f08fca809c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 to cache LRU end 2024-09-19T13:42:49.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.784+0000 7f08fca809c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:42:49.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.784+0000 7f08fca809c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T13:42:49.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.784+0000 7f08fca809c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 2024-09-19T13:42:49.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.784+0000 7f08fca809c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.0 2024-09-19T13:42:49.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.784+0000 7f08fca809c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-19T13:42:49.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.784+0000 7f08fca809c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:49.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.788+0000 7f08fca809c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-19T13:42:49.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.788+0000 7f08fca809c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.2 2024-09-19T13:42:49.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.788+0000 7f08fca809c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-19T13:42:49.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.788+0000 7f08fca809c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.3 2024-09-19T13:42:49.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.788+0000 7f08fca809c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-19T13:42:49.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.788+0000 7f08fca809c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.4 2024-09-19T13:42:49.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.788+0000 7f08fca809c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-19T13:42:49.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.788+0000 7f08fca809c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:49.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.792+0000 7f08fca809c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-19T13:42:49.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.792+0000 7f08fca809c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.6 2024-09-19T13:42:49.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.792+0000 7f08fca809c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-19T13:42:49.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.792+0000 7f08fca809c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.7 2024-09-19T13:42:49.799 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.792+0000 7f08fca809c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-19T13:42:49.799 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.792+0000 7f08fca809c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:49.800 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.796+0000 7f08fca809c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-19T13:42:49.800 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.796+0000 7f08fca809c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.9 2024-09-19T13:42:49.801 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.796+0000 7f08fca809c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-19T13:42:49.801 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.796+0000 7f08fca809c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:49.803 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.796+0000 7f08fca809c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-19T13:42:49.803 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.796+0000 7f08fca809c0 1 NOTICE: finished all shards (2 entries found) 2024-09-19T13:42:49.804 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.800+0000 7f07b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:49.809 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.804+0000 7f08fca809c0 20 remove_watcher() i=0 2024-09-19T13:42:49.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.804+0000 7f08fca809c0 2 removed watcher, disabling cache 2024-09-19T13:42:49.812 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.808+0000 7f08fca809c0 20 remove_watcher() i=1 2024-09-19T13:42:49.817 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.812+0000 7f08fca809c0 20 remove_watcher() i=2 2024-09-19T13:42:49.819 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.812+0000 7f08fca809c0 20 remove_watcher() i=3 2024-09-19T13:42:49.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.816+0000 7f08fca809c0 20 remove_watcher() i=4 2024-09-19T13:42:49.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.816+0000 7f08fca809c0 20 remove_watcher() i=5 2024-09-19T13:42:49.824 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.820+0000 7f08fca809c0 20 remove_watcher() i=6 2024-09-19T13:42:49.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.820+0000 7f08fca809c0 20 remove_watcher() i=7 2024-09-19T13:42:49.843 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-19T13:42:49.843 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:42:49.844 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-19T13:42:49.879 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:49.879 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:49.925 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:49.920+0000 7f084579a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.124+0000 7f084579a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:50.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.124+0000 7f084579a9c0 20 realm 2024-09-19T13:42:50.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.124+0000 7f084579a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.124+0000 7f084579a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:50.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.124+0000 7f084579a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:50.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.124+0000 7f084579a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.132 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.124+0000 7f084579a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:50.132 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.124+0000 7f084579a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.128+0000 7f084579a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:50.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.128+0000 7f084579a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.128+0000 7f084579a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:50.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.128+0000 7f084579a9c0 20 searching for the correct realm 2024-09-19T13:42:50.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.136+0000 7f0843aa1640 0 -- 172.21.15.153:0/2398688880 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f083805c610 msgr2=0x7f0838064510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:42:50.151 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.144+0000 7f08432a0640 0 -- 172.21.15.153:0/2398688880 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f0838066040 msgr2=0x7f0838093050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:50.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.360+0000 7f084579a9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:50.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.360+0000 7f084579a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:50.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.360+0000 7f084579a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:50.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.360+0000 7f084579a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:50.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.360+0000 7f084579a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:50.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.360+0000 7f084579a9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:50.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.360+0000 7f084579a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.364+0000 7f084579a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:50.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.364+0000 7f084579a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.364+0000 7f084579a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:50.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.364+0000 7f084579a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.370 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.364+0000 7f084579a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:50.370 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.364+0000 7f084579a9c0 20 zone default found 2024-09-19T13:42:50.370 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.364+0000 7f084579a9c0 4 Realm: () 2024-09-19T13:42:50.370 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.364+0000 7f084579a9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:50.370 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.364+0000 7f084579a9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:50.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.364+0000 7f084579a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:50.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.364+0000 7f084579a9c0 20 zonegroup default 2024-09-19T13:42:50.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.364+0000 7f084579a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.364+0000 7f084579a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:50.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.364+0000 7f084579a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.368+0000 7f084579a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:50.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.368+0000 7f084579a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.368+0000 7f084579a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:50.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.368+0000 7f084579a9c0 20 started sync module instance, tier type = 2024-09-19T13:42:50.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.368+0000 7f084579a9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:50.397 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.392+0000 7f084579a9c0 20 add_watcher() i=0 2024-09-19T13:42:50.397 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.392+0000 7f084579a9c0 20 add_watcher() i=1 2024-09-19T13:42:50.397 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.392+0000 7f084579a9c0 20 add_watcher() i=2 2024-09-19T13:42:50.397 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.392+0000 7f084579a9c0 20 add_watcher() i=3 2024-09-19T13:42:50.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.392+0000 7f084579a9c0 20 add_watcher() i=4 2024-09-19T13:42:50.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.392+0000 7f084579a9c0 20 add_watcher() i=5 2024-09-19T13:42:50.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.392+0000 7f084579a9c0 20 add_watcher() i=6 2024-09-19T13:42:50.400 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.396+0000 7f084579a9c0 20 add_watcher() i=7 2024-09-19T13:42:50.400 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.396+0000 7f084579a9c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:50.404 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.400+0000 7f06f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:50.405 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.400+0000 7f084579a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:50.405 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.400+0000 7f084579a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:50.405 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.400+0000 7f084579a9c0 5 note: GC not initialized 2024-09-19T13:42:50.406 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.400+0000 7f06f8fe1640 20 reqs_thread_entry: start 2024-09-19T13:42:50.406 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.400+0000 7f084579a9c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:50.407 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.400+0000 7f084579a9c0 20 Filter name: none 2024-09-19T13:42:50.407 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.400+0000 7f06727fc640 20 reqs_thread_entry: start 2024-09-19T13:42:50.407 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.400+0000 7f084579a9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T13:42:50.407 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.400+0000 7f084579a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.407 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.400+0000 7f084579a9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:50.407 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.400+0000 7f084579a9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T13:42:50.408 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.400+0000 7f084579a9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T13:42:50.408 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.400+0000 7f084579a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 : miss 2024-09-19T13:42:50.408 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.400+0000 7f084579a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.408 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.404+0000 7f084579a9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:50.408 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.404+0000 7f084579a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 info.flags=0x17 2024-09-19T13:42:50.408 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.404+0000 7f084579a9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 to cache LRU end 2024-09-19T13:42:50.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.404+0000 7f084579a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:42:50.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.404+0000 7f084579a9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T13:42:50.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.404+0000 7f084579a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 2024-09-19T13:42:50.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.404+0000 7f084579a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.0 2024-09-19T13:42:50.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.404+0000 7f084579a9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-19T13:42:50.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.404+0000 7f084579a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:50.411 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.404+0000 7f084579a9c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-19T13:42:50.411 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.404+0000 7f084579a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.2 2024-09-19T13:42:50.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.408+0000 7f084579a9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-19T13:42:50.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.408+0000 7f084579a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.3 2024-09-19T13:42:50.413 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.408+0000 7f084579a9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-19T13:42:50.413 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.408+0000 7f084579a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.4 2024-09-19T13:42:50.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.408+0000 7f084579a9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-19T13:42:50.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.408+0000 7f084579a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:50.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.408+0000 7f084579a9c0 20 get_obj_state: octx=0x55705b717500 obj=check-bucket:d state=0x55705b9c8b48 s->prefetch_data=0 2024-09-19T13:42:50.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.408+0000 7f084579a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.6 2024-09-19T13:42:50.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.412+0000 7f084579a9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-19T13:42:50.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.412+0000 7f084579a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.7 2024-09-19T13:42:50.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.412+0000 7f084579a9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-19T13:42:50.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.412+0000 7f084579a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:50.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.412+0000 7f084579a9c0 20 get_obj_state: octx=0x55705b728f60 obj=check-bucket:c state=0x55705b9c4458 s->prefetch_data=0 2024-09-19T13:42:50.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.412+0000 7f084579a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.9 2024-09-19T13:42:50.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.412+0000 7f084579a9c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-19T13:42:50.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.412+0000 7f084579a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:50.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.416+0000 7f084579a9c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-19T13:42:50.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.416+0000 7f084579a9c0 20 get_obj_state: setting s->obj_tag to 0o665vclfwrhs26gy327d714ivcx486i 2024-09-19T13:42:50.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.416+0000 7f084579a9c0 20 get_obj_state_impl: setting s->olh_tag to zjbx50v7hw8jpf6hzxw51olezromdn02 2024-09-19T13:42:50.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.416+0000 7f084579a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:50.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.416+0000 7f084579a9c0 20 get_obj_state: setting s->obj_tag to er51sluf90kfz8wm4zurwd19qh36bkyd 2024-09-19T13:42:50.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.416+0000 7f084579a9c0 20 get_obj_state_impl: setting s->olh_tag to b8xrrrdcustledtfigfc43356uf8xl0t 2024-09-19T13:42:50.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.416+0000 7f084579a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:50.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.416+0000 7f084579a9c0 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-19T13:42:50.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.416+0000 7f084579a9c0 20 olh_log_entry: epoch=4 op=3 key=d[HlXbtIQflOJhYp86Jq2cc88jtlxh7e-] 2024-09-19T13:42:50.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.416+0000 7f084579a9c0 20 get_obj_state: octx=0x55705b9f0da0 obj=check-bucket:_:HlXbtIQflOJhYp86Jq2cc88jtlxh7e-_d state=0x55705b9c3198 s->prefetch_data=0 2024-09-19T13:42:50.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.416+0000 7f084579a9c0 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-19T13:42:50.423 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.416+0000 7f084579a9c0 20 olh_log_entry: epoch=4 op=3 key=c[8u9LI1NrzriC7zuWZQ1waslhuTrqI8E] 2024-09-19T13:42:50.423 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.416+0000 7f084579a9c0 20 get_obj_state: octx=0x55705ba10da0 obj=check-bucket:_:8u9LI1NrzriC7zuWZQ1waslhuTrqI8E_c state=0x55705ba1c5b8 s->prefetch_data=0 2024-09-19T13:42:50.425 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.420+0000 7f084579a9c0 20 get_obj_state: octx=0x55705b9f0da0 obj=check-bucket:d state=0x55705ba1c588 s->prefetch_data=0 2024-09-19T13:42:50.427 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.420+0000 7f084579a9c0 20 get_obj_state: setting s->obj_tag to 0o665vclfwrhs26gy327d714ivcx486i 2024-09-19T13:42:50.427 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.420+0000 7f084579a9c0 20 get_obj_state_impl: setting s->olh_tag to zjbx50v7hw8jpf6hzxw51olezromdn02 2024-09-19T13:42:50.427 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.420+0000 7f084579a9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zjbx50v7hw8jpf6hzxw51olezromdn02 2024-09-19T13:42:50.427 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.420+0000 7f084579a9c0 20 get_obj_state: octx=0x55705ba10da0 obj=check-bucket:c state=0x55705ba1db28 s->prefetch_data=0 2024-09-19T13:42:50.429 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.424+0000 7f084579a9c0 20 get_obj_state: setting s->obj_tag to er51sluf90kfz8wm4zurwd19qh36bkyd 2024-09-19T13:42:50.429 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.424+0000 7f084579a9c0 20 get_obj_state_impl: setting s->olh_tag to b8xrrrdcustledtfigfc43356uf8xl0t 2024-09-19T13:42:50.429 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.424+0000 7f084579a9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=b8xrrrdcustledtfigfc43356uf8xl0t 2024-09-19T13:42:50.438 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.432+0000 7f084579a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:50.440 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.436+0000 7f084579a9c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-19T13:42:50.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.436+0000 7f084579a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:50.444 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.440+0000 7f084579a9c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-19T13:42:50.445 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.440+0000 7f084579a9c0 1 NOTICE: finished all shards (2 entries removed) 2024-09-19T13:42:50.446 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.440+0000 7f06f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:50.451 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.444+0000 7f084579a9c0 20 remove_watcher() i=0 2024-09-19T13:42:50.451 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.444+0000 7f084579a9c0 2 removed watcher, disabling cache 2024-09-19T13:42:50.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.448+0000 7f084579a9c0 20 remove_watcher() i=1 2024-09-19T13:42:50.455 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.448+0000 7f084579a9c0 20 remove_watcher() i=2 2024-09-19T13:42:50.457 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.452+0000 7f084579a9c0 20 remove_watcher() i=3 2024-09-19T13:42:50.459 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.452+0000 7f084579a9c0 20 remove_watcher() i=4 2024-09-19T13:42:50.461 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.456+0000 7f084579a9c0 20 remove_watcher() i=5 2024-09-19T13:42:50.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.456+0000 7f084579a9c0 20 remove_watcher() i=6 2024-09-19T13:42:50.464 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.460+0000 7f084579a9c0 20 remove_watcher() i=7 2024-09-19T13:42:50.481 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-19T13:42:50.514 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:50.514 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:50.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.552+0000 7f6336ff69c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.556+0000 7f6336ff69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:50.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.556+0000 7f6336ff69c0 20 realm 2024-09-19T13:42:50.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.556+0000 7f6336ff69c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.556+0000 7f6336ff69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:50.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.556+0000 7f6336ff69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:50.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.556+0000 7f6336ff69c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.556+0000 7f6336ff69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:50.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.556+0000 7f6336ff69c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.562 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.556+0000 7f6336ff69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:50.562 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.556+0000 7f6336ff69c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.562 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.556+0000 7f6336ff69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:50.562 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.556+0000 7f6336ff69c0 20 searching for the correct realm 2024-09-19T13:42:50.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.564+0000 7f63352fd640 0 -- 172.21.15.153:0/1555358571 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55a4bf7264b0 msgr2=0x55a4bf728970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:50.574 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.568+0000 7f6334afc640 0 -- 172.21.15.153:0/1555358571 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f6328101d60 msgr2=0x7f63280f4270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:50.581 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.576+0000 7f6336ff69c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:50.581 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.576+0000 7f6336ff69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:50.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.576+0000 7f6336ff69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:50.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.576+0000 7f6336ff69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:50.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.576+0000 7f6336ff69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:50.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.576+0000 7f6336ff69c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:50.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.576+0000 7f6336ff69c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.576+0000 7f6336ff69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:50.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.576+0000 7f6336ff69c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.576+0000 7f6336ff69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:50.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.576+0000 7f6336ff69c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.576+0000 7f6336ff69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:50.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.576+0000 7f6336ff69c0 20 zone default found 2024-09-19T13:42:50.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.576+0000 7f6336ff69c0 4 Realm: () 2024-09-19T13:42:50.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.576+0000 7f6336ff69c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:50.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.576+0000 7f6336ff69c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:50.584 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.576+0000 7f6336ff69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:50.584 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.576+0000 7f6336ff69c0 20 zonegroup default 2024-09-19T13:42:50.584 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.576+0000 7f6336ff69c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.584 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.576+0000 7f6336ff69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:50.584 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.576+0000 7f6336ff69c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.584 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.580+0000 7f6336ff69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:50.584 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.580+0000 7f6336ff69c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.585 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.580+0000 7f6336ff69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:50.585 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.580+0000 7f6336ff69c0 20 started sync module instance, tier type = 2024-09-19T13:42:50.585 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.580+0000 7f6336ff69c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:50.599 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.592+0000 7f6336ff69c0 20 add_watcher() i=0 2024-09-19T13:42:50.599 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.592+0000 7f6336ff69c0 20 add_watcher() i=1 2024-09-19T13:42:50.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.592+0000 7f6336ff69c0 20 add_watcher() i=2 2024-09-19T13:42:50.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.592+0000 7f6336ff69c0 20 add_watcher() i=3 2024-09-19T13:42:50.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.592+0000 7f6336ff69c0 20 add_watcher() i=4 2024-09-19T13:42:50.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.592+0000 7f6336ff69c0 20 add_watcher() i=5 2024-09-19T13:42:50.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.592+0000 7f6336ff69c0 20 add_watcher() i=6 2024-09-19T13:42:50.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.596+0000 7f6336ff69c0 20 add_watcher() i=7 2024-09-19T13:42:50.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.596+0000 7f6336ff69c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:50.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.596+0000 7f61eafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:50.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.600+0000 7f6336ff69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:50.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.600+0000 7f6336ff69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:50.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.600+0000 7f6336ff69c0 5 note: GC not initialized 2024-09-19T13:42:50.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.600+0000 7f61e9fe3640 20 reqs_thread_entry: start 2024-09-19T13:42:50.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.600+0000 7f6336ff69c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:50.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.600+0000 7f6336ff69c0 20 Filter name: none 2024-09-19T13:42:50.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.600+0000 7f615b7fe640 20 reqs_thread_entry: start 2024-09-19T13:42:50.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.600+0000 7f6336ff69c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.600+0000 7f6336ff69c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:50.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.600+0000 7f6336ff69c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.600+0000 7f6336ff69c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:50.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.600+0000 7f6336ff69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:42:50.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.600+0000 7f6336ff69c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T13:42:50.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.600+0000 7f6336ff69c0 20 INFO: main: starting shard=0 2024-09-19T13:42:50.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.600+0000 7f6336ff69c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.0 2024-09-19T13:42:50.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.600+0000 7f6336ff69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:50.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.600+0000 7f6336ff69c0 20 INFO: main: starting shard=1 2024-09-19T13:42:50.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.600+0000 7f6336ff69c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:50.608 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.604+0000 7f6336ff69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:50.608 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.604+0000 7f6336ff69c0 20 INFO: main: starting shard=2 2024-09-19T13:42:50.608 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.604+0000 7f6336ff69c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.2 2024-09-19T13:42:50.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.604+0000 7f6336ff69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:50.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.604+0000 7f6336ff69c0 20 INFO: main: starting shard=3 2024-09-19T13:42:50.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.604+0000 7f6336ff69c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.3 2024-09-19T13:42:50.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.604+0000 7f6336ff69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:50.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.604+0000 7f6336ff69c0 20 INFO: main: starting shard=4 2024-09-19T13:42:50.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.604+0000 7f6336ff69c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.4 2024-09-19T13:42:50.610 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.604+0000 7f6336ff69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:50.611 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.604+0000 7f6336ff69c0 20 INFO: main: starting shard=5 2024-09-19T13:42:50.611 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.604+0000 7f6336ff69c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:50.611 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.604+0000 7f6336ff69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:50.611 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.604+0000 7f6336ff69c0 20 INFO: main: starting shard=6 2024-09-19T13:42:50.611 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.604+0000 7f6336ff69c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.6 2024-09-19T13:42:50.611 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.604+0000 7f6336ff69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:50.612 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.604+0000 7f6336ff69c0 20 INFO: main: starting shard=7 2024-09-19T13:42:50.612 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.604+0000 7f6336ff69c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.7 2024-09-19T13:42:50.613 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.608+0000 7f6336ff69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:50.613 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.608+0000 7f6336ff69c0 20 INFO: main: starting shard=8 2024-09-19T13:42:50.613 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.608+0000 7f6336ff69c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:50.614 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.608+0000 7f6336ff69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:50.614 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.608+0000 7f6336ff69c0 20 INFO: main: starting shard=9 2024-09-19T13:42:50.614 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.608+0000 7f6336ff69c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.9 2024-09-19T13:42:50.614 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.608+0000 7f6336ff69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:50.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.608+0000 7f6336ff69c0 20 INFO: main: starting shard=10 2024-09-19T13:42:50.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.608+0000 7f6336ff69c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:50.616 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.612+0000 7f6336ff69c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:50.616 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.612+0000 7f6336ff69c0 20 INFO: main: done 2024-09-19T13:42:50.617 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.612+0000 7f61eafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:50.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.616+0000 7f6336ff69c0 20 remove_watcher() i=0 2024-09-19T13:42:50.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.616+0000 7f6336ff69c0 2 removed watcher, disabling cache 2024-09-19T13:42:50.624 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.620+0000 7f6336ff69c0 20 remove_watcher() i=1 2024-09-19T13:42:50.626 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.620+0000 7f6336ff69c0 20 remove_watcher() i=2 2024-09-19T13:42:50.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.624+0000 7f6336ff69c0 20 remove_watcher() i=3 2024-09-19T13:42:50.630 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.624+0000 7f6336ff69c0 20 remove_watcher() i=4 2024-09-19T13:42:50.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.628+0000 7f6336ff69c0 20 remove_watcher() i=5 2024-09-19T13:42:50.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.628+0000 7f6336ff69c0 20 remove_watcher() i=6 2024-09-19T13:42:50.634 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.628+0000 7f6336ff69c0 20 remove_watcher() i=7 2024-09-19T13:42:50.648 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-19T13:42:50.676 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:50.676 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:50.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.712+0000 7f9dc38299c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.716+0000 7f9dc38299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:50.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.716+0000 7f9dc38299c0 20 realm 2024-09-19T13:42:50.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.716+0000 7f9dc38299c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.716+0000 7f9dc38299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:50.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.716+0000 7f9dc38299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:50.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.716+0000 7f9dc38299c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.716+0000 7f9dc38299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:50.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.716+0000 7f9dc38299c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.716+0000 7f9dc38299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:50.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.716+0000 7f9dc38299c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.716+0000 7f9dc38299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:50.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.716+0000 7f9dc38299c0 20 searching for the correct realm 2024-09-19T13:42:50.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.724+0000 7f9dc0b2e640 0 -- 172.21.15.153:0/3226022774 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x557872da1dd0 msgr2=0x557872da41c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:50.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.728+0000 7f9dc132f640 0 -- 172.21.15.153:0/3226022774 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f9db812e0b0 msgr2=0x7f9db80f6ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:50.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.736+0000 7f9dc38299c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:50.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.736+0000 7f9dc38299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:50.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.736+0000 7f9dc38299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:50.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.736+0000 7f9dc38299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:50.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.736+0000 7f9dc38299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:50.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.736+0000 7f9dc38299c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:50.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.736+0000 7f9dc38299c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.736+0000 7f9dc38299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:50.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.736+0000 7f9dc38299c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.743 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.736+0000 7f9dc38299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:50.743 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.736+0000 7f9dc38299c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.743 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.736+0000 7f9dc38299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:50.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.736+0000 7f9dc38299c0 20 zone default found 2024-09-19T13:42:50.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.736+0000 7f9dc38299c0 4 Realm: () 2024-09-19T13:42:50.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.736+0000 7f9dc38299c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:50.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.736+0000 7f9dc38299c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:50.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.736+0000 7f9dc38299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:50.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.736+0000 7f9dc38299c0 20 zonegroup default 2024-09-19T13:42:50.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.736+0000 7f9dc38299c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.736+0000 7f9dc38299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:50.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.736+0000 7f9dc38299c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.740+0000 7f9dc38299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:50.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.740+0000 7f9dc38299c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.740+0000 7f9dc38299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:50.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.740+0000 7f9dc38299c0 20 started sync module instance, tier type = 2024-09-19T13:42:50.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.740+0000 7f9dc38299c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:50.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.756+0000 7f9dc38299c0 20 add_watcher() i=0 2024-09-19T13:42:50.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.756+0000 7f9dc38299c0 20 add_watcher() i=1 2024-09-19T13:42:50.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.756+0000 7f9dc38299c0 20 add_watcher() i=2 2024-09-19T13:42:50.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.756+0000 7f9dc38299c0 20 add_watcher() i=3 2024-09-19T13:42:50.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.756+0000 7f9dc38299c0 20 add_watcher() i=4 2024-09-19T13:42:50.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.756+0000 7f9dc38299c0 20 add_watcher() i=5 2024-09-19T13:42:50.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.756+0000 7f9dc38299c0 20 add_watcher() i=6 2024-09-19T13:42:50.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.756+0000 7f9dc38299c0 20 add_watcher() i=7 2024-09-19T13:42:50.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.756+0000 7f9dc38299c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:50.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.760+0000 7f9c77fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:50.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.760+0000 7f9dc38299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:50.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.760+0000 7f9dc38299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:50.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.760+0000 7f9dc38299c0 5 note: GC not initialized 2024-09-19T13:42:50.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.760+0000 7f9c76fe5640 20 reqs_thread_entry: start 2024-09-19T13:42:50.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.760+0000 7f9dc38299c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:50.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.760+0000 7f9dc38299c0 20 Filter name: none 2024-09-19T13:42:50.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.760+0000 7f9c74fe1640 20 reqs_thread_entry: start 2024-09-19T13:42:50.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.760+0000 7f9dc38299c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.766 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.760+0000 7f9dc38299c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:50.766 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.760+0000 7f9dc38299c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.766 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.760+0000 7f9dc38299c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:50.766 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.760+0000 7f9dc38299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:42:50.766 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.760+0000 7f9dc38299c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T13:42:50.766 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.760+0000 7f9dc38299c0 20 INFO: main: starting shard=0 2024-09-19T13:42:50.766 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.760+0000 7f9dc38299c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.0 2024-09-19T13:42:50.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.760+0000 7f9dc38299c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:50.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.760+0000 7f9dc38299c0 20 INFO: main: starting shard=1 2024-09-19T13:42:50.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.760+0000 7f9dc38299c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:50.768 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.764+0000 7f9dc38299c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:50.768 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.764+0000 7f9dc38299c0 20 INFO: main: starting shard=2 2024-09-19T13:42:50.768 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.764+0000 7f9dc38299c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.2 2024-09-19T13:42:50.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.764+0000 7f9dc38299c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:50.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.764+0000 7f9dc38299c0 20 INFO: main: starting shard=3 2024-09-19T13:42:50.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.764+0000 7f9dc38299c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.3 2024-09-19T13:42:50.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.764+0000 7f9dc38299c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:50.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.764+0000 7f9dc38299c0 20 INFO: main: starting shard=4 2024-09-19T13:42:50.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.764+0000 7f9dc38299c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.4 2024-09-19T13:42:50.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.764+0000 7f9dc38299c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:50.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.764+0000 7f9dc38299c0 20 INFO: main: starting shard=5 2024-09-19T13:42:50.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.764+0000 7f9dc38299c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:50.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.768+0000 7f9dc38299c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:50.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.768+0000 7f9dc38299c0 20 INFO: main: starting shard=6 2024-09-19T13:42:50.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.768+0000 7f9dc38299c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.6 2024-09-19T13:42:50.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.768+0000 7f9dc38299c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:50.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.768+0000 7f9dc38299c0 20 INFO: main: starting shard=7 2024-09-19T13:42:50.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.768+0000 7f9dc38299c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.7 2024-09-19T13:42:50.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.768+0000 7f9dc38299c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:50.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.768+0000 7f9dc38299c0 20 INFO: main: starting shard=8 2024-09-19T13:42:50.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.768+0000 7f9dc38299c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:50.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.768+0000 7f9dc38299c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:50.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.768+0000 7f9dc38299c0 20 INFO: main: starting shard=9 2024-09-19T13:42:50.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.768+0000 7f9dc38299c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.9 2024-09-19T13:42:50.776 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.772+0000 7f9dc38299c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:50.776 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.772+0000 7f9dc38299c0 20 INFO: main: starting shard=10 2024-09-19T13:42:50.776 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.772+0000 7f9dc38299c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:50.777 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.772+0000 7f9dc38299c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:50.777 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.772+0000 7f9dc38299c0 20 INFO: main: done 2024-09-19T13:42:50.778 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.772+0000 7f9c77fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:50.783 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.776+0000 7f9dc38299c0 20 remove_watcher() i=0 2024-09-19T13:42:50.783 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.776+0000 7f9dc38299c0 2 removed watcher, disabling cache 2024-09-19T13:42:50.786 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.780+0000 7f9dc38299c0 20 remove_watcher() i=1 2024-09-19T13:42:50.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.780+0000 7f9dc38299c0 20 remove_watcher() i=2 2024-09-19T13:42:50.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.784+0000 7f9dc38299c0 20 remove_watcher() i=3 2024-09-19T13:42:50.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.784+0000 7f9dc38299c0 20 remove_watcher() i=4 2024-09-19T13:42:50.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.788+0000 7f9dc38299c0 20 remove_watcher() i=5 2024-09-19T13:42:50.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.788+0000 7f9dc38299c0 20 remove_watcher() i=6 2024-09-19T13:42:50.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.788+0000 7f9dc38299c0 20 remove_watcher() i=7 2024-09-19T13:42:50.808 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-19T13:42:50.808 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:42:50.809 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-19T13:42:50.837 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:50.837 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:50.880 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.876+0000 7fd5b480f9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.876+0000 7fd5b480f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:50.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.876+0000 7fd5b480f9c0 20 realm 2024-09-19T13:42:50.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.876+0000 7fd5b480f9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.876+0000 7fd5b480f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:50.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.876+0000 7fd5b480f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:50.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.876+0000 7fd5b480f9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.876+0000 7fd5b480f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:50.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.876+0000 7fd5b480f9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.876+0000 7fd5b480f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:50.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.876+0000 7fd5b480f9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:50.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.880+0000 7fd5b480f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:50.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:50.880+0000 7fd5b480f9c0 20 searching for the correct realm 2024-09-19T13:42:51.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.092+0000 7fd5b2b16640 0 -- 172.21.15.153:0/2361974795 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7fd5a807aae0 msgr2=0x7fd5a80103d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:51.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.100+0000 7fd5b2315640 0 -- 172.21.15.153:0/2361974795 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fd5a8063cd0 msgr2=0x7fd5a807a470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:51.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.316+0000 7fd5b480f9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:51.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.316+0000 7fd5b480f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:51.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.316+0000 7fd5b480f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:51.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.316+0000 7fd5b480f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:51.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.316+0000 7fd5b480f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:51.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.316+0000 7fd5b480f9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:51.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.316+0000 7fd5b480f9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:51.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.316+0000 7fd5b480f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:51.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.316+0000 7fd5b480f9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:51.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.316+0000 7fd5b480f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:51.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.316+0000 7fd5b480f9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:51.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.320+0000 7fd5b480f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:51.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.320+0000 7fd5b480f9c0 20 zone default found 2024-09-19T13:42:51.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.320+0000 7fd5b480f9c0 4 Realm: () 2024-09-19T13:42:51.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.320+0000 7fd5b480f9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:51.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.320+0000 7fd5b480f9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:51.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.320+0000 7fd5b480f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:51.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.320+0000 7fd5b480f9c0 20 zonegroup default 2024-09-19T13:42:51.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.320+0000 7fd5b480f9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:51.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.320+0000 7fd5b480f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:51.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.320+0000 7fd5b480f9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:51.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.320+0000 7fd5b480f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:51.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.320+0000 7fd5b480f9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:51.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.320+0000 7fd5b480f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:51.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.320+0000 7fd5b480f9c0 20 started sync module instance, tier type = 2024-09-19T13:42:51.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.320+0000 7fd5b480f9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:51.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.348+0000 7fd5b480f9c0 20 add_watcher() i=0 2024-09-19T13:42:51.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.348+0000 7fd5b480f9c0 20 add_watcher() i=1 2024-09-19T13:42:51.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.348+0000 7fd5b480f9c0 20 add_watcher() i=2 2024-09-19T13:42:51.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.348+0000 7fd5b480f9c0 20 add_watcher() i=3 2024-09-19T13:42:51.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.348+0000 7fd5b480f9c0 20 add_watcher() i=4 2024-09-19T13:42:51.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.348+0000 7fd5b480f9c0 20 add_watcher() i=5 2024-09-19T13:42:51.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.348+0000 7fd5b480f9c0 20 add_watcher() i=6 2024-09-19T13:42:51.354 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.348+0000 7fd5b480f9c0 20 add_watcher() i=7 2024-09-19T13:42:51.354 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.348+0000 7fd5b480f9c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:51.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.352+0000 7fd468fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:51.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.352+0000 7fd5b480f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:51.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.352+0000 7fd5b480f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:51.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.356+0000 7fd5b480f9c0 5 note: GC not initialized 2024-09-19T13:42:51.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.356+0000 7fd3e37fe640 20 reqs_thread_entry: start 2024-09-19T13:42:51.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.356+0000 7fd5b480f9c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:51.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.356+0000 7fd5b480f9c0 20 Filter name: none 2024-09-19T13:42:51.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.356+0000 7fd3e17fa640 20 reqs_thread_entry: start 2024-09-19T13:42:51.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.356+0000 7fd5b480f9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T13:42:51.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.356+0000 7fd5b480f9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:51.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.356+0000 7fd5b480f9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:51.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.356+0000 7fd5b480f9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T13:42:51.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.356+0000 7fd5b480f9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T13:42:51.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.356+0000 7fd5b480f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 : miss 2024-09-19T13:42:51.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.356+0000 7fd5b480f9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:51.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.356+0000 7fd5b480f9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:51.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.356+0000 7fd5b480f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 info.flags=0x17 2024-09-19T13:42:51.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.356+0000 7fd5b480f9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 to cache LRU end 2024-09-19T13:42:51.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.356+0000 7fd5b480f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:42:51.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.356+0000 7fd5b480f9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T13:42:51.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.356+0000 7fd5b480f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 2024-09-19T13:42:51.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.356+0000 7fd5b480f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.0 2024-09-19T13:42:51.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.356+0000 7fd5b480f9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-19T13:42:51.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.356+0000 7fd5b480f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:51.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.360+0000 7fd5b480f9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-19T13:42:51.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.360+0000 7fd5b480f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.2 2024-09-19T13:42:51.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.360+0000 7fd5b480f9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-19T13:42:51.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.360+0000 7fd5b480f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.3 2024-09-19T13:42:51.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.360+0000 7fd5b480f9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-19T13:42:51.367 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.360+0000 7fd5b480f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.4 2024-09-19T13:42:51.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.364+0000 7fd5b480f9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-19T13:42:51.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.364+0000 7fd5b480f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:51.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.364+0000 7fd5b480f9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-19T13:42:51.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.364+0000 7fd5b480f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.6 2024-09-19T13:42:51.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.364+0000 7fd5b480f9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-19T13:42:51.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.364+0000 7fd5b480f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.7 2024-09-19T13:42:51.370 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.364+0000 7fd5b480f9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-19T13:42:51.370 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.364+0000 7fd5b480f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:51.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.364+0000 7fd5b480f9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-19T13:42:51.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.364+0000 7fd5b480f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.9 2024-09-19T13:42:51.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.368+0000 7fd5b480f9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-19T13:42:51.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.368+0000 7fd5b480f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:51.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.368+0000 7fd5b480f9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-19T13:42:51.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.368+0000 7fd5b480f9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-19T13:42:51.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.368+0000 7fd468fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:51.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.376+0000 7fd5b480f9c0 20 remove_watcher() i=0 2024-09-19T13:42:51.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.376+0000 7fd5b480f9c0 2 removed watcher, disabling cache 2024-09-19T13:42:51.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.376+0000 7fd5b480f9c0 20 remove_watcher() i=1 2024-09-19T13:42:51.385 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.380+0000 7fd5b480f9c0 20 remove_watcher() i=2 2024-09-19T13:42:51.387 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.380+0000 7fd5b480f9c0 20 remove_watcher() i=3 2024-09-19T13:42:51.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.384+0000 7fd5b480f9c0 20 remove_watcher() i=4 2024-09-19T13:42:51.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.384+0000 7fd5b480f9c0 20 remove_watcher() i=5 2024-09-19T13:42:51.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.388+0000 7fd5b480f9c0 20 remove_watcher() i=6 2024-09-19T13:42:51.394 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:51.388+0000 7fd5b480f9c0 20 remove_watcher() i=7 2024-09-19T13:42:51.410 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-19T13:42:51.410 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:42:51.411 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:51.411 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:51.447 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:51.447 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:51.486 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:51.486 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:51.616 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-19T13:42:51.616 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:42:51.618 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:51.618 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:51.748 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:51.748 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:52.260 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:52.261 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:52.405 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:52.405 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:52.475 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:52.476 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:52.615 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:52.615 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:52.685 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:52.685 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:52.872 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:52.872 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:52.942 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:52.942 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:53.077 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:53.077 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:53.147 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:53.147 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:53.379 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:53.379 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:53.450 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:53.450 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:53.598 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:53.598 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:53.677 INFO:tasks.workunit.client.0.smithi153.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-19T13:42:54.123 INFO:tasks.workunit.client.0.smithi153.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-19T13:42:55.556 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:55.556 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:55.721 INFO:tasks.workunit.client.0.smithi153.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T13:42:55.721 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-19T13:42:55.758 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:55.758 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:55.803 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.796+0000 7f8d04a8d9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:55.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.800+0000 7f8d04a8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:55.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.800+0000 7f8d04a8d9c0 20 realm 2024-09-19T13:42:55.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.800+0000 7f8d04a8d9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:55.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.800+0000 7f8d04a8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:55.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.800+0000 7f8d04a8d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:55.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.800+0000 7f8d04a8d9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:55.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.800+0000 7f8d04a8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:55.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.800+0000 7f8d04a8d9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:55.807 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.800+0000 7f8d04a8d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:55.807 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.800+0000 7f8d04a8d9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:55.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.804+0000 7f8d04a8d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:55.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.804+0000 7f8d04a8d9c0 20 searching for the correct realm 2024-09-19T13:42:55.814 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.808+0000 7f8d01d92640 0 -- 172.21.15.153:0/3541316604 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f8cf40c0020 msgr2=0x7f8cf40e1ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:55.820 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.816+0000 7f8d01d92640 0 -- 172.21.15.153:0/3541316604 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f8bcc07f880 msgr2=0x7f8bcc081cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:55.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.820+0000 7f8d04a8d9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:55.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.820+0000 7f8d04a8d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:55.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.820+0000 7f8d04a8d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:55.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.820+0000 7f8d04a8d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:55.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.820+0000 7f8d04a8d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:55.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.820+0000 7f8d04a8d9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:55.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.820+0000 7f8d04a8d9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:55.828 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.820+0000 7f8d04a8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:55.828 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.820+0000 7f8d04a8d9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:55.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.820+0000 7f8d04a8d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:55.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.820+0000 7f8d04a8d9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:55.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.824+0000 7f8d04a8d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:55.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.824+0000 7f8d04a8d9c0 20 zone default found 2024-09-19T13:42:55.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.824+0000 7f8d04a8d9c0 4 Realm: () 2024-09-19T13:42:55.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.824+0000 7f8d04a8d9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:55.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.824+0000 7f8d04a8d9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:55.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.824+0000 7f8d04a8d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:55.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.824+0000 7f8d04a8d9c0 20 zonegroup default 2024-09-19T13:42:55.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.824+0000 7f8d04a8d9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:55.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.824+0000 7f8d04a8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:55.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.824+0000 7f8d04a8d9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:55.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.824+0000 7f8d04a8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:55.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.824+0000 7f8d04a8d9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:55.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.824+0000 7f8d04a8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:55.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.824+0000 7f8d04a8d9c0 20 started sync module instance, tier type = 2024-09-19T13:42:55.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.824+0000 7f8d04a8d9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:55.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.840+0000 7f8d04a8d9c0 20 add_watcher() i=0 2024-09-19T13:42:55.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.840+0000 7f8d04a8d9c0 20 add_watcher() i=1 2024-09-19T13:42:55.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.840+0000 7f8d04a8d9c0 20 add_watcher() i=2 2024-09-19T13:42:55.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.840+0000 7f8d04a8d9c0 20 add_watcher() i=3 2024-09-19T13:42:55.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.840+0000 7f8d04a8d9c0 20 add_watcher() i=4 2024-09-19T13:42:55.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.840+0000 7f8d04a8d9c0 20 add_watcher() i=5 2024-09-19T13:42:55.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.840+0000 7f8d04a8d9c0 20 add_watcher() i=6 2024-09-19T13:42:55.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.844+0000 7f8d04a8d9c0 20 add_watcher() i=7 2024-09-19T13:42:55.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.844+0000 7f8d04a8d9c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:55.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.844+0000 7f8bb8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:55.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.844+0000 7f8d04a8d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:55.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.844+0000 7f8d04a8d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:55.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.844+0000 7f8d04a8d9c0 5 note: GC not initialized 2024-09-19T13:42:55.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.844+0000 7f8b337fe640 20 reqs_thread_entry: start 2024-09-19T13:42:55.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.844+0000 7f8d04a8d9c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:55.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.848+0000 7f8d04a8d9c0 20 Filter name: none 2024-09-19T13:42:55.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.848+0000 7f8b317fa640 20 reqs_thread_entry: start 2024-09-19T13:42:55.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.848+0000 7f8d04a8d9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:55.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.848+0000 7f8d04a8d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:55.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.848+0000 7f8d04a8d9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:55.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.848+0000 7f8d04a8d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:55.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.848+0000 7f8d04a8d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:42:55.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.848+0000 7f8d04a8d9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T13:42:55.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.848+0000 7f8d04a8d9c0 20 INFO: main: starting shard=0 2024-09-19T13:42:55.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.848+0000 7f8d04a8d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.0 2024-09-19T13:42:55.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.848+0000 7f8d04a8d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:55.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.848+0000 7f8d04a8d9c0 20 INFO: main: starting shard=1 2024-09-19T13:42:55.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.848+0000 7f8d04a8d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:55.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.848+0000 7f8d04a8d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:55.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.848+0000 7f8d04a8d9c0 20 INFO: main: starting shard=2 2024-09-19T13:42:55.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.848+0000 7f8d04a8d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.2 2024-09-19T13:42:55.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.852+0000 7f8d04a8d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:55.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.852+0000 7f8d04a8d9c0 20 INFO: main: starting shard=3 2024-09-19T13:42:55.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.852+0000 7f8d04a8d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.3 2024-09-19T13:42:55.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.852+0000 7f8d04a8d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:55.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.852+0000 7f8d04a8d9c0 20 INFO: main: starting shard=4 2024-09-19T13:42:55.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.852+0000 7f8d04a8d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.4 2024-09-19T13:42:55.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.852+0000 7f8d04a8d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:55.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.852+0000 7f8d04a8d9c0 20 INFO: main: starting shard=5 2024-09-19T13:42:55.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.852+0000 7f8d04a8d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:55.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.852+0000 7f8d04a8d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:55.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.852+0000 7f8d04a8d9c0 20 INFO: main: starting shard=6 2024-09-19T13:42:55.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.852+0000 7f8d04a8d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.6 2024-09-19T13:42:55.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.852+0000 7f8d04a8d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:55.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.852+0000 7f8d04a8d9c0 20 INFO: main: starting shard=7 2024-09-19T13:42:55.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.852+0000 7f8d04a8d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.7 2024-09-19T13:42:55.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.856+0000 7f8d04a8d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:55.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.856+0000 7f8d04a8d9c0 20 INFO: main: starting shard=8 2024-09-19T13:42:55.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.856+0000 7f8d04a8d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:55.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.856+0000 7f8d04a8d9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-19T13:42:55.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.856+0000 7f8d04a8d9c0 20 INFO: main: starting shard=9 2024-09-19T13:42:55.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.856+0000 7f8d04a8d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.9 2024-09-19T13:42:55.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.856+0000 7f8d04a8d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:55.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.856+0000 7f8d04a8d9c0 20 INFO: main: starting shard=10 2024-09-19T13:42:55.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.856+0000 7f8d04a8d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:55.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.860+0000 7f8d04a8d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:55.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.860+0000 7f8d04a8d9c0 20 INFO: main: done 2024-09-19T13:42:55.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.860+0000 7f8bb8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:55.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.864+0000 7f8d04a8d9c0 20 remove_watcher() i=0 2024-09-19T13:42:55.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.864+0000 7f8d04a8d9c0 2 removed watcher, disabling cache 2024-09-19T13:42:55.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.868+0000 7f8d04a8d9c0 20 remove_watcher() i=1 2024-09-19T13:42:55.874 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.868+0000 7f8d04a8d9c0 20 remove_watcher() i=2 2024-09-19T13:42:55.876 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.872+0000 7f8d04a8d9c0 20 remove_watcher() i=3 2024-09-19T13:42:55.878 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.872+0000 7f8d04a8d9c0 20 remove_watcher() i=4 2024-09-19T13:42:55.879 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.872+0000 7f8d04a8d9c0 20 remove_watcher() i=5 2024-09-19T13:42:55.881 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.876+0000 7f8d04a8d9c0 20 remove_watcher() i=6 2024-09-19T13:42:55.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:55.876+0000 7f8d04a8d9c0 20 remove_watcher() i=7 2024-09-19T13:42:55.898 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:55.898 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:55.925 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:55.925 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:55.954 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:55.954 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:56.093 INFO:tasks.workunit.client.0.smithi153.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T13:42:56.093 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-19T13:42:56.129 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:56.129 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:56.175 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.168+0000 7f97907359c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.172+0000 7f97907359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:56.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.172+0000 7f97907359c0 20 realm 2024-09-19T13:42:56.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.172+0000 7f97907359c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.172+0000 7f97907359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:56.178 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.172+0000 7f97907359c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:56.178 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.172+0000 7f97907359c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.178 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.172+0000 7f97907359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:56.178 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.172+0000 7f97907359c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.172+0000 7f97907359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:56.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.172+0000 7f97907359c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.172+0000 7f97907359c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:56.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.172+0000 7f97907359c0 20 searching for the correct realm 2024-09-19T13:42:56.186 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.180+0000 7f978da3a640 0 -- 172.21.15.153:0/941640164 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f97800158a0 msgr2=0x7f978005e8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:56.191 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.184+0000 7f978da3a640 0 -- 172.21.15.153:0/941640164 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f965807f880 msgr2=0x7f9658081cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:56.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.192+0000 7f97907359c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:56.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.192+0000 7f97907359c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:56.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.192+0000 7f97907359c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:56.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.192+0000 7f97907359c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:56.199 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.192+0000 7f97907359c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:56.199 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.192+0000 7f97907359c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:56.199 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.192+0000 7f97907359c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.199 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.192+0000 7f97907359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:56.199 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.192+0000 7f97907359c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.192+0000 7f97907359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:56.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.192+0000 7f97907359c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.192+0000 7f97907359c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:56.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.196+0000 7f97907359c0 20 zone default found 2024-09-19T13:42:56.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.196+0000 7f97907359c0 4 Realm: () 2024-09-19T13:42:56.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.196+0000 7f97907359c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:56.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.196+0000 7f97907359c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:56.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.196+0000 7f97907359c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:56.201 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.196+0000 7f97907359c0 20 zonegroup default 2024-09-19T13:42:56.201 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.196+0000 7f97907359c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.201 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.196+0000 7f97907359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:56.201 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.196+0000 7f97907359c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.201 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.196+0000 7f97907359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:56.202 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.196+0000 7f97907359c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.202 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.196+0000 7f97907359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:56.202 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.196+0000 7f97907359c0 20 started sync module instance, tier type = 2024-09-19T13:42:56.202 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.196+0000 7f97907359c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:56.220 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.212+0000 7f97907359c0 20 add_watcher() i=0 2024-09-19T13:42:56.220 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.212+0000 7f97907359c0 20 add_watcher() i=1 2024-09-19T13:42:56.220 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.212+0000 7f97907359c0 20 add_watcher() i=2 2024-09-19T13:42:56.220 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.212+0000 7f97907359c0 20 add_watcher() i=3 2024-09-19T13:42:56.220 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.212+0000 7f97907359c0 20 add_watcher() i=4 2024-09-19T13:42:56.220 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.212+0000 7f97907359c0 20 add_watcher() i=5 2024-09-19T13:42:56.220 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.212+0000 7f97907359c0 20 add_watcher() i=6 2024-09-19T13:42:56.221 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.216+0000 7f97907359c0 20 add_watcher() i=7 2024-09-19T13:42:56.221 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.216+0000 7f97907359c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:56.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.220+0000 7f9644fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:56.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.220+0000 7f97907359c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:56.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.220+0000 7f97907359c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:56.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.220+0000 7f97907359c0 5 note: GC not initialized 2024-09-19T13:42:56.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.220+0000 7f95bf7fe640 20 reqs_thread_entry: start 2024-09-19T13:42:56.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.220+0000 7f97907359c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:56.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.220+0000 7f97907359c0 20 Filter name: none 2024-09-19T13:42:56.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.220+0000 7f95bd7fa640 20 reqs_thread_entry: start 2024-09-19T13:42:56.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.220+0000 7f97907359c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.220+0000 7f97907359c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:56.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.220+0000 7f97907359c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.227 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.220+0000 7f97907359c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:56.227 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.220+0000 7f97907359c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:42:56.228 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.220+0000 7f97907359c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T13:42:56.228 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.220+0000 7f97907359c0 20 INFO: main: starting shard=0 2024-09-19T13:42:56.228 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.220+0000 7f97907359c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.0 2024-09-19T13:42:56.228 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.220+0000 7f97907359c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.228 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.220+0000 7f97907359c0 20 INFO: main: starting shard=1 2024-09-19T13:42:56.228 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.220+0000 7f97907359c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:56.228 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.224+0000 7f97907359c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.229 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.224+0000 7f97907359c0 20 INFO: main: starting shard=2 2024-09-19T13:42:56.229 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.224+0000 7f97907359c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.2 2024-09-19T13:42:56.229 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.224+0000 7f97907359c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.229 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.224+0000 7f97907359c0 20 INFO: main: starting shard=3 2024-09-19T13:42:56.229 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.224+0000 7f97907359c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.3 2024-09-19T13:42:56.230 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.224+0000 7f97907359c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.230 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.224+0000 7f97907359c0 20 INFO: main: starting shard=4 2024-09-19T13:42:56.230 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.224+0000 7f97907359c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.4 2024-09-19T13:42:56.231 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.224+0000 7f97907359c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.231 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.224+0000 7f97907359c0 20 INFO: main: starting shard=5 2024-09-19T13:42:56.231 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.224+0000 7f97907359c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:56.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.228+0000 7f97907359c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-19T13:42:56.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.228+0000 7f97907359c0 20 INFO: main: starting shard=6 2024-09-19T13:42:56.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.228+0000 7f97907359c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.6 2024-09-19T13:42:56.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.228+0000 7f97907359c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.228+0000 7f97907359c0 20 INFO: main: starting shard=7 2024-09-19T13:42:56.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.228+0000 7f97907359c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.7 2024-09-19T13:42:56.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.228+0000 7f97907359c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.228+0000 7f97907359c0 20 INFO: main: starting shard=8 2024-09-19T13:42:56.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.228+0000 7f97907359c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:56.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.228+0000 7f97907359c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.235 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.228+0000 7f97907359c0 20 INFO: main: starting shard=9 2024-09-19T13:42:56.235 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.228+0000 7f97907359c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.9 2024-09-19T13:42:56.236 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.232+0000 7f97907359c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.236 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.232+0000 7f97907359c0 20 INFO: main: starting shard=10 2024-09-19T13:42:56.236 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.232+0000 7f97907359c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:56.238 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.232+0000 7f97907359c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.238 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.232+0000 7f97907359c0 20 INFO: main: done 2024-09-19T13:42:56.239 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.232+0000 7f9644fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:56.244 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.236+0000 7f97907359c0 20 remove_watcher() i=0 2024-09-19T13:42:56.244 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.236+0000 7f97907359c0 2 removed watcher, disabling cache 2024-09-19T13:42:56.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.240+0000 7f97907359c0 20 remove_watcher() i=1 2024-09-19T13:42:56.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.244+0000 7f97907359c0 20 remove_watcher() i=2 2024-09-19T13:42:56.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.244+0000 7f97907359c0 20 remove_watcher() i=3 2024-09-19T13:42:56.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.248+0000 7f97907359c0 20 remove_watcher() i=4 2024-09-19T13:42:56.255 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.248+0000 7f97907359c0 20 remove_watcher() i=5 2024-09-19T13:42:56.256 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.252+0000 7f97907359c0 20 remove_watcher() i=6 2024-09-19T13:42:56.258 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.252+0000 7f97907359c0 20 remove_watcher() i=7 2024-09-19T13:42:56.273 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:56.274 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:56.299 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:56.299 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:56.413 INFO:tasks.workunit.client.0.smithi153.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T13:42:56.413 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-19T13:42:56.448 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:56.449 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:56.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.488+0000 7f41c98119c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.492+0000 7f41c98119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:56.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.492+0000 7f41c98119c0 20 realm 2024-09-19T13:42:56.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.492+0000 7f41c98119c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.492+0000 7f41c98119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:56.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.492+0000 7f41c98119c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:56.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.492+0000 7f41c98119c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.492+0000 7f41c98119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:56.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.492+0000 7f41c98119c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.492+0000 7f41c98119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:56.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.492+0000 7f41c98119c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.492+0000 7f41c98119c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:56.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.492+0000 7f41c98119c0 20 searching for the correct realm 2024-09-19T13:42:56.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.500+0000 7f41c7b18640 0 -- 172.21.15.153:0/3540693210 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55c1817c8290 msgr2=0x55c1817ca680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:56.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.504+0000 7f41c6b16640 0 -- 172.21.15.153:0/3540693210 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f41b8094c20 msgr2=0x7f41b805d700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:56.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.512+0000 7f41c98119c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:56.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.512+0000 7f41c98119c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:56.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.512+0000 7f41c98119c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:56.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.512+0000 7f41c98119c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:56.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.512+0000 7f41c98119c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:56.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.512+0000 7f41c98119c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:56.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.512+0000 7f41c98119c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.512+0000 7f41c98119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:56.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.512+0000 7f41c98119c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.516+0000 7f41c98119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:56.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.516+0000 7f41c98119c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.516+0000 7f41c98119c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:56.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.516+0000 7f41c98119c0 20 zone default found 2024-09-19T13:42:56.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.516+0000 7f41c98119c0 4 Realm: () 2024-09-19T13:42:56.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.516+0000 7f41c98119c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:56.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.516+0000 7f41c98119c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:56.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.516+0000 7f41c98119c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:56.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.516+0000 7f41c98119c0 20 zonegroup default 2024-09-19T13:42:56.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.516+0000 7f41c98119c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.516+0000 7f41c98119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:56.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.516+0000 7f41c98119c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.516+0000 7f41c98119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:56.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.516+0000 7f41c98119c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.516+0000 7f41c98119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:56.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.516+0000 7f41c98119c0 20 started sync module instance, tier type = 2024-09-19T13:42:56.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.516+0000 7f41c98119c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:56.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.536+0000 7f41c98119c0 20 add_watcher() i=0 2024-09-19T13:42:56.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.536+0000 7f41c98119c0 20 add_watcher() i=1 2024-09-19T13:42:56.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.536+0000 7f41c98119c0 20 add_watcher() i=2 2024-09-19T13:42:56.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.536+0000 7f41c98119c0 20 add_watcher() i=3 2024-09-19T13:42:56.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.536+0000 7f41c98119c0 20 add_watcher() i=4 2024-09-19T13:42:56.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.536+0000 7f41c98119c0 20 add_watcher() i=5 2024-09-19T13:42:56.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.536+0000 7f41c98119c0 20 add_watcher() i=6 2024-09-19T13:42:56.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.536+0000 7f41c98119c0 20 add_watcher() i=7 2024-09-19T13:42:56.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.536+0000 7f41c98119c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:56.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.540+0000 7f407dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:56.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.540+0000 7f41c98119c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:56.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.540+0000 7f41c98119c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:56.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.540+0000 7f41c98119c0 5 note: GC not initialized 2024-09-19T13:42:56.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.540+0000 7f407cfe1640 20 reqs_thread_entry: start 2024-09-19T13:42:56.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.540+0000 7f41c98119c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:56.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.540+0000 7f41c98119c0 20 Filter name: none 2024-09-19T13:42:56.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.540+0000 7f3ff67fc640 20 reqs_thread_entry: start 2024-09-19T13:42:56.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.540+0000 7f41c98119c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.540+0000 7f41c98119c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:56.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.540+0000 7f41c98119c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.540+0000 7f41c98119c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:56.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.540+0000 7f41c98119c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:42:56.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.540+0000 7f41c98119c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T13:42:56.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.540+0000 7f41c98119c0 20 INFO: main: starting shard=0 2024-09-19T13:42:56.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.540+0000 7f41c98119c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.0 2024-09-19T13:42:56.549 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.544+0000 7f41c98119c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.549 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.544+0000 7f41c98119c0 20 INFO: main: starting shard=1 2024-09-19T13:42:56.549 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.544+0000 7f41c98119c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:56.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.544+0000 7f41c98119c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-19T13:42:56.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.544+0000 7f41c98119c0 20 INFO: main: starting shard=2 2024-09-19T13:42:56.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.544+0000 7f41c98119c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.2 2024-09-19T13:42:56.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.544+0000 7f41c98119c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.544+0000 7f41c98119c0 20 INFO: main: starting shard=3 2024-09-19T13:42:56.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.544+0000 7f41c98119c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.3 2024-09-19T13:42:56.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.548+0000 7f41c98119c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.548+0000 7f41c98119c0 20 INFO: main: starting shard=4 2024-09-19T13:42:56.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.548+0000 7f41c98119c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.4 2024-09-19T13:42:56.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.548+0000 7f41c98119c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.548+0000 7f41c98119c0 20 INFO: main: starting shard=5 2024-09-19T13:42:56.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.548+0000 7f41c98119c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:56.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.548+0000 7f41c98119c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.554 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.548+0000 7f41c98119c0 20 INFO: main: starting shard=6 2024-09-19T13:42:56.554 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.548+0000 7f41c98119c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.6 2024-09-19T13:42:56.554 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.548+0000 7f41c98119c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.554 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.548+0000 7f41c98119c0 20 INFO: main: starting shard=7 2024-09-19T13:42:56.554 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.548+0000 7f41c98119c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.7 2024-09-19T13:42:56.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.548+0000 7f41c98119c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.548+0000 7f41c98119c0 20 INFO: main: starting shard=8 2024-09-19T13:42:56.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.548+0000 7f41c98119c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:56.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.552+0000 7f41c98119c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.552+0000 7f41c98119c0 20 INFO: main: starting shard=9 2024-09-19T13:42:56.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.552+0000 7f41c98119c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.9 2024-09-19T13:42:56.557 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.552+0000 7f41c98119c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.557 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.552+0000 7f41c98119c0 20 INFO: main: starting shard=10 2024-09-19T13:42:56.557 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.552+0000 7f41c98119c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:56.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.552+0000 7f41c98119c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.552+0000 7f41c98119c0 20 INFO: main: done 2024-09-19T13:42:56.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.552+0000 7f407dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:56.564 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.560+0000 7f41c98119c0 20 remove_watcher() i=0 2024-09-19T13:42:56.564 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.560+0000 7f41c98119c0 2 removed watcher, disabling cache 2024-09-19T13:42:56.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.560+0000 7f41c98119c0 20 remove_watcher() i=1 2024-09-19T13:42:56.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.564+0000 7f41c98119c0 20 remove_watcher() i=2 2024-09-19T13:42:56.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.564+0000 7f41c98119c0 20 remove_watcher() i=3 2024-09-19T13:42:56.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.568+0000 7f41c98119c0 20 remove_watcher() i=4 2024-09-19T13:42:56.574 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.568+0000 7f41c98119c0 20 remove_watcher() i=5 2024-09-19T13:42:56.575 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.568+0000 7f41c98119c0 20 remove_watcher() i=6 2024-09-19T13:42:56.576 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.572+0000 7f41c98119c0 20 remove_watcher() i=7 2024-09-19T13:42:56.592 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:56.592 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:56.619 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:56.619 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:56.728 INFO:tasks.workunit.client.0.smithi153.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T13:42:56.729 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-19T13:42:56.764 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:56.764 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:56.809 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.804+0000 7ffa4d8819c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.804+0000 7ffa4d8819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:56.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.804+0000 7ffa4d8819c0 20 realm 2024-09-19T13:42:56.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.804+0000 7ffa4d8819c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.804+0000 7ffa4d8819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:56.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.804+0000 7ffa4d8819c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:56.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.804+0000 7ffa4d8819c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.804+0000 7ffa4d8819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:56.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.804+0000 7ffa4d8819c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.808+0000 7ffa4d8819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:56.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.808+0000 7ffa4d8819c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.808+0000 7ffa4d8819c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:56.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.808+0000 7ffa4d8819c0 20 searching for the correct realm 2024-09-19T13:42:56.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.816+0000 7ffa4bb88640 0 -- 172.21.15.153:0/1744888741 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7ffa40017040 msgr2=0x7ffa40040920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:56.828 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.824+0000 7ffa4b387640 0 -- 172.21.15.153:0/1744888741 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x555d63636430 msgr2=0x555d636388f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:56.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:56.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:56.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:56.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:56.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:56.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:56.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:56.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:56.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:56.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 20 zone default found 2024-09-19T13:42:56.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 4 Realm: () 2024-09-19T13:42:56.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:56.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:56.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:56.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 20 zonegroup default 2024-09-19T13:42:56.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:56.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:56.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:56.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 20 started sync module instance, tier type = 2024-09-19T13:42:56.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.828+0000 7ffa4d8819c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:56.851 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.844+0000 7ffa4d8819c0 20 add_watcher() i=0 2024-09-19T13:42:56.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.844+0000 7ffa4d8819c0 20 add_watcher() i=1 2024-09-19T13:42:56.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.844+0000 7ffa4d8819c0 20 add_watcher() i=2 2024-09-19T13:42:56.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.844+0000 7ffa4d8819c0 20 add_watcher() i=3 2024-09-19T13:42:56.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.844+0000 7ffa4d8819c0 20 add_watcher() i=4 2024-09-19T13:42:56.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.844+0000 7ffa4d8819c0 20 add_watcher() i=5 2024-09-19T13:42:56.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.844+0000 7ffa4d8819c0 20 add_watcher() i=6 2024-09-19T13:42:56.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.848+0000 7ffa4d8819c0 20 add_watcher() i=7 2024-09-19T13:42:56.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.848+0000 7ffa4d8819c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:56.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.848+0000 7ff901fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:56.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.852+0000 7ffa4d8819c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:56.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.852+0000 7ffa4d8819c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:56.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.852+0000 7ffa4d8819c0 5 note: GC not initialized 2024-09-19T13:42:56.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.852+0000 7ff900fe1640 20 reqs_thread_entry: start 2024-09-19T13:42:56.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.852+0000 7ffa4d8819c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:56.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.852+0000 7ffa4d8819c0 20 Filter name: none 2024-09-19T13:42:56.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.852+0000 7ff87a7fc640 20 reqs_thread_entry: start 2024-09-19T13:42:56.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.852+0000 7ffa4d8819c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.852+0000 7ffa4d8819c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:56.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.852+0000 7ffa4d8819c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:56.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.852+0000 7ffa4d8819c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:56.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.852+0000 7ffa4d8819c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:42:56.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.852+0000 7ffa4d8819c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T13:42:56.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.852+0000 7ffa4d8819c0 20 INFO: main: starting shard=0 2024-09-19T13:42:56.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.852+0000 7ffa4d8819c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.0 2024-09-19T13:42:56.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.852+0000 7ffa4d8819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.852+0000 7ffa4d8819c0 20 INFO: main: starting shard=1 2024-09-19T13:42:56.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.852+0000 7ffa4d8819c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:56.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.856+0000 7ffa4d8819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.856+0000 7ffa4d8819c0 20 INFO: main: starting shard=2 2024-09-19T13:42:56.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.856+0000 7ffa4d8819c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.2 2024-09-19T13:42:56.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.856+0000 7ffa4d8819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.856+0000 7ffa4d8819c0 20 INFO: main: starting shard=3 2024-09-19T13:42:56.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.856+0000 7ffa4d8819c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.3 2024-09-19T13:42:56.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.856+0000 7ffa4d8819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.856+0000 7ffa4d8819c0 20 INFO: main: starting shard=4 2024-09-19T13:42:56.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.856+0000 7ffa4d8819c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.4 2024-09-19T13:42:56.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.860+0000 7ffa4d8819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.860+0000 7ffa4d8819c0 20 INFO: main: starting shard=5 2024-09-19T13:42:56.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.860+0000 7ffa4d8819c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:56.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.860+0000 7ffa4d8819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.860+0000 7ffa4d8819c0 20 INFO: main: starting shard=6 2024-09-19T13:42:56.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.860+0000 7ffa4d8819c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.6 2024-09-19T13:42:56.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.860+0000 7ffa4d8819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.860+0000 7ffa4d8819c0 20 INFO: main: starting shard=7 2024-09-19T13:42:56.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.860+0000 7ffa4d8819c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.7 2024-09-19T13:42:56.867 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.860+0000 7ffa4d8819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.867 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.860+0000 7ffa4d8819c0 20 INFO: main: starting shard=8 2024-09-19T13:42:56.867 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.860+0000 7ffa4d8819c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:56.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.864+0000 7ffa4d8819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.864+0000 7ffa4d8819c0 20 INFO: main: starting shard=9 2024-09-19T13:42:56.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.864+0000 7ffa4d8819c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.9 2024-09-19T13:42:56.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.864+0000 7ffa4d8819c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T13:42:56.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.864+0000 7ffa4d8819c0 20 INFO: main: starting shard=10 2024-09-19T13:42:56.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.864+0000 7ffa4d8819c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:56.871 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.864+0000 7ffa4d8819c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-19T13:42:56.871 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.864+0000 7ffa4d8819c0 20 INFO: main: done 2024-09-19T13:42:56.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.868+0000 7ff901fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:56.877 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.872+0000 7ffa4d8819c0 20 remove_watcher() i=0 2024-09-19T13:42:56.877 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.872+0000 7ffa4d8819c0 2 removed watcher, disabling cache 2024-09-19T13:42:56.879 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.872+0000 7ffa4d8819c0 20 remove_watcher() i=1 2024-09-19T13:42:56.881 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.876+0000 7ffa4d8819c0 20 remove_watcher() i=2 2024-09-19T13:42:56.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.876+0000 7ffa4d8819c0 20 remove_watcher() i=3 2024-09-19T13:42:56.885 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.880+0000 7ffa4d8819c0 20 remove_watcher() i=4 2024-09-19T13:42:56.887 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.880+0000 7ffa4d8819c0 20 remove_watcher() i=5 2024-09-19T13:42:56.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.884+0000 7ffa4d8819c0 20 remove_watcher() i=6 2024-09-19T13:42:56.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:56.884+0000 7ffa4d8819c0 20 remove_watcher() i=7 2024-09-19T13:42:56.905 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:56.905 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:56.930 INFO:tasks.workunit.client.0.smithi153.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-19T13:42:57.356 INFO:tasks.workunit.client.0.smithi153.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-19T13:42:57.795 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-19T13:42:57.824 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:57.824 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:57.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:57.860+0000 7fdb9a45e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:57.866 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:57.860+0000 7fdb9a45e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:57.866 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:57.860+0000 7fdb9a45e9c0 20 realm 2024-09-19T13:42:57.866 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:57.860+0000 7fdb9a45e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:57.866 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:57.860+0000 7fdb9a45e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:57.867 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:57.860+0000 7fdb9a45e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:57.867 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:57.860+0000 7fdb9a45e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:57.867 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:57.860+0000 7fdb9a45e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:57.867 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:57.860+0000 7fdb9a45e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:57.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:57.864+0000 7fdb9a45e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:57.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:57.864+0000 7fdb9a45e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:57.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:57.864+0000 7fdb9a45e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:57.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:57.864+0000 7fdb9a45e9c0 20 searching for the correct realm 2024-09-19T13:42:57.875 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:57.868+0000 7fdb98765640 0 -- 172.21.15.153:0/4240936755 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7fdb8001e040 msgr2=0x7fdb8004b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:58.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.084+0000 7fdb97f64640 0 -- 172.21.15.153:0/4240936755 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x562fa84d1be0 msgr2=0x562fa84d3fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:58.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.092+0000 7fdb9a45e9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:58.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.092+0000 7fdb9a45e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:58.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.092+0000 7fdb9a45e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:58.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.092+0000 7fdb9a45e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:58.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.092+0000 7fdb9a45e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:58.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.092+0000 7fdb9a45e9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:58.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.092+0000 7fdb9a45e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:58.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.092+0000 7fdb9a45e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:58.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.092+0000 7fdb9a45e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:58.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.092+0000 7fdb9a45e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:58.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.092+0000 7fdb9a45e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:58.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.092+0000 7fdb9a45e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:58.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.092+0000 7fdb9a45e9c0 20 zone default found 2024-09-19T13:42:58.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.092+0000 7fdb9a45e9c0 4 Realm: () 2024-09-19T13:42:58.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.092+0000 7fdb9a45e9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:58.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.092+0000 7fdb9a45e9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:58.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.092+0000 7fdb9a45e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:58.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.092+0000 7fdb9a45e9c0 20 zonegroup default 2024-09-19T13:42:58.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.092+0000 7fdb9a45e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:58.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.096+0000 7fdb9a45e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:58.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.096+0000 7fdb9a45e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:58.101 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.096+0000 7fdb9a45e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:58.101 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.096+0000 7fdb9a45e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:58.101 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.096+0000 7fdb9a45e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:58.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.096+0000 7fdb9a45e9c0 20 started sync module instance, tier type = 2024-09-19T13:42:58.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.096+0000 7fdb9a45e9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:58.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.120+0000 7fdb9a45e9c0 20 add_watcher() i=0 2024-09-19T13:42:58.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.120+0000 7fdb9a45e9c0 20 add_watcher() i=1 2024-09-19T13:42:58.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.120+0000 7fdb9a45e9c0 20 add_watcher() i=2 2024-09-19T13:42:58.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.120+0000 7fdb9a45e9c0 20 add_watcher() i=3 2024-09-19T13:42:58.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.120+0000 7fdb9a45e9c0 20 add_watcher() i=4 2024-09-19T13:42:58.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.120+0000 7fdb9a45e9c0 20 add_watcher() i=5 2024-09-19T13:42:58.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.120+0000 7fdb9a45e9c0 20 add_watcher() i=6 2024-09-19T13:42:58.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.124+0000 7fdb9a45e9c0 20 add_watcher() i=7 2024-09-19T13:42:58.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.124+0000 7fdb9a45e9c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:58.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.128+0000 7fda4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:58.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.128+0000 7fdb9a45e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:58.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.128+0000 7fdb9a45e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:58.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.128+0000 7fdb9a45e9c0 5 note: GC not initialized 2024-09-19T13:42:58.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.128+0000 7fda4cfe1640 20 reqs_thread_entry: start 2024-09-19T13:42:58.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.128+0000 7fdb9a45e9c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:58.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.128+0000 7fdb9a45e9c0 20 Filter name: none 2024-09-19T13:42:58.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.128+0000 7fd9c67fc640 20 reqs_thread_entry: start 2024-09-19T13:42:58.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.132+0000 7fdb9a45e9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T13:42:58.137 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.132+0000 7fdb9a45e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:58.137 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.132+0000 7fdb9a45e9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:58.137 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.132+0000 7fdb9a45e9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T13:42:58.137 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.132+0000 7fdb9a45e9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T13:42:58.137 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.132+0000 7fdb9a45e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 : miss 2024-09-19T13:42:58.137 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.132+0000 7fdb9a45e9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:58.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.132+0000 7fdb9a45e9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:58.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.132+0000 7fdb9a45e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 info.flags=0x17 2024-09-19T13:42:58.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.132+0000 7fdb9a45e9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 to cache LRU end 2024-09-19T13:42:58.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.132+0000 7fdb9a45e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:42:58.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.132+0000 7fdb9a45e9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T13:42:58.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.132+0000 7fdb9a45e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 2024-09-19T13:42:58.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.132+0000 7fdb9a45e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.0 2024-09-19T13:42:58.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.132+0000 7fdb9a45e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:58.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.136+0000 7fdb9a45e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.2 2024-09-19T13:42:58.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.136+0000 7fdb9a45e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.3 2024-09-19T13:42:58.144 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.136+0000 7fdb9a45e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.4 2024-09-19T13:42:58.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.140+0000 7fdb9a45e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:58.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.140+0000 7fdb9a45e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.6 2024-09-19T13:42:58.147 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.140+0000 7fdb9a45e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.7 2024-09-19T13:42:58.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.144+0000 7fdb9a45e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:58.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.144+0000 7fdb9a45e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.9 2024-09-19T13:42:58.151 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.144+0000 7fdb9a45e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:58.162 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.156+0000 7fda4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:58.167 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.160+0000 7fdb9a45e9c0 20 remove_watcher() i=0 2024-09-19T13:42:58.167 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.160+0000 7fdb9a45e9c0 2 removed watcher, disabling cache 2024-09-19T13:42:58.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.164+0000 7fdb9a45e9c0 20 remove_watcher() i=1 2024-09-19T13:42:58.171 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.164+0000 7fdb9a45e9c0 20 remove_watcher() i=2 2024-09-19T13:42:58.174 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.168+0000 7fdb9a45e9c0 20 remove_watcher() i=3 2024-09-19T13:42:58.175 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.168+0000 7fdb9a45e9c0 20 remove_watcher() i=4 2024-09-19T13:42:58.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.172+0000 7fdb9a45e9c0 20 remove_watcher() i=5 2024-09-19T13:42:58.178 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.172+0000 7fdb9a45e9c0 20 remove_watcher() i=6 2024-09-19T13:42:58.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.172+0000 7fdb9a45e9c0 20 remove_watcher() i=7 2024-09-19T13:42:58.193 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-19T13:42:58.226 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:58.226 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:58.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.264+0000 7f18bf5fb9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:58.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.264+0000 7f18bf5fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:58.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.264+0000 7f18bf5fb9c0 20 realm 2024-09-19T13:42:58.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.264+0000 7f18bf5fb9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:58.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.268+0000 7f18bf5fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:58.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.268+0000 7f18bf5fb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:58.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.268+0000 7f18bf5fb9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:58.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.268+0000 7f18bf5fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:58.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.268+0000 7f18bf5fb9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:58.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.268+0000 7f18bf5fb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:58.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.268+0000 7f18bf5fb9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:58.274 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.268+0000 7f18bf5fb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:58.274 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.268+0000 7f18bf5fb9c0 20 searching for the correct realm 2024-09-19T13:42:58.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.276+0000 7f18bd902640 0 -- 172.21.15.153:0/74070101 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7f18b401e040 msgr2=0x7f18b404e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:42:58.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.492+0000 7f18bd101640 0 -- 172.21.15.153:0/74070101 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x55d404e34070 msgr2=0x55d404e364a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:58.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.500+0000 7f18bf5fb9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:58.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.500+0000 7f18bf5fb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:58.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.500+0000 7f18bf5fb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:58.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.500+0000 7f18bf5fb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:58.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.500+0000 7f18bf5fb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:58.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.500+0000 7f18bf5fb9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:58.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.500+0000 7f18bf5fb9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:58.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.500+0000 7f18bf5fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:58.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.500+0000 7f18bf5fb9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:58.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.500+0000 7f18bf5fb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:58.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.500+0000 7f18bf5fb9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:58.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.500+0000 7f18bf5fb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:58.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.500+0000 7f18bf5fb9c0 20 zone default found 2024-09-19T13:42:58.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.500+0000 7f18bf5fb9c0 4 Realm: () 2024-09-19T13:42:58.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.500+0000 7f18bf5fb9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:58.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.500+0000 7f18bf5fb9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:58.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.500+0000 7f18bf5fb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:58.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.500+0000 7f18bf5fb9c0 20 zonegroup default 2024-09-19T13:42:58.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.500+0000 7f18bf5fb9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:58.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.500+0000 7f18bf5fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:58.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.500+0000 7f18bf5fb9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:58.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.504+0000 7f18bf5fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:58.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.504+0000 7f18bf5fb9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:58.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.504+0000 7f18bf5fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:58.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.504+0000 7f18bf5fb9c0 20 started sync module instance, tier type = 2024-09-19T13:42:58.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.504+0000 7f18bf5fb9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:58.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.524+0000 7f18bf5fb9c0 20 add_watcher() i=0 2024-09-19T13:42:58.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.524+0000 7f18bf5fb9c0 20 add_watcher() i=1 2024-09-19T13:42:58.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.524+0000 7f18bf5fb9c0 20 add_watcher() i=2 2024-09-19T13:42:58.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.524+0000 7f18bf5fb9c0 20 add_watcher() i=3 2024-09-19T13:42:58.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.524+0000 7f18bf5fb9c0 20 add_watcher() i=4 2024-09-19T13:42:58.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.524+0000 7f18bf5fb9c0 20 add_watcher() i=5 2024-09-19T13:42:58.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.524+0000 7f18bf5fb9c0 20 add_watcher() i=6 2024-09-19T13:42:58.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.528+0000 7f18bf5fb9c0 20 add_watcher() i=7 2024-09-19T13:42:58.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.528+0000 7f18bf5fb9c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:58.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.532+0000 7f1773fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:58.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.532+0000 7f18bf5fb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:58.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.532+0000 7f18bf5fb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:58.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.532+0000 7f18bf5fb9c0 5 note: GC not initialized 2024-09-19T13:42:58.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.532+0000 7f1772fe5640 20 reqs_thread_entry: start 2024-09-19T13:42:58.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.532+0000 7f18bf5fb9c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:58.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.532+0000 7f18bf5fb9c0 20 Filter name: none 2024-09-19T13:42:58.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.532+0000 7f1770fe1640 20 reqs_thread_entry: start 2024-09-19T13:42:58.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.532+0000 7f18bf5fb9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-19T13:42:58.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.532+0000 7f18bf5fb9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:58.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.536+0000 7f18bf5fb9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:58.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.536+0000 7f18bf5fb9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-19T13:42:58.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.536+0000 7f18bf5fb9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-19T13:42:58.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.536+0000 7f18bf5fb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 : miss 2024-09-19T13:42:58.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.536+0000 7f18bf5fb9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:58.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.536+0000 7f18bf5fb9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:58.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.536+0000 7f18bf5fb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 info.flags=0x17 2024-09-19T13:42:58.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.536+0000 7f18bf5fb9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 to cache LRU end 2024-09-19T13:42:58.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.536+0000 7f18bf5fb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T13:42:58.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.536+0000 7f18bf5fb9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-19T13:42:58.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.536+0000 7f18bf5fb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.1 2024-09-19T13:42:58.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.536+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.0 2024-09-19T13:42:58.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.536+0000 7f18bf5fb9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-19T13:42:58.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.536+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:58.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.540+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.2 2024-09-19T13:42:58.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.540+0000 7f18bf5fb9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-19T13:42:58.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.540+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.3 2024-09-19T13:42:58.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.540+0000 7f18bf5fb9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-19T13:42:58.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.540+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.4 2024-09-19T13:42:58.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.544+0000 7f18bf5fb9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-19T13:42:58.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.544+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:58.549 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.544+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.6 2024-09-19T13:42:58.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.544+0000 7f18bf5fb9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-19T13:42:58.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.544+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.7 2024-09-19T13:42:58.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.544+0000 7f18bf5fb9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-19T13:42:58.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.544+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:58.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.548+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.9 2024-09-19T13:42:58.554 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.548+0000 7f18bf5fb9c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-19T13:42:58.554 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.548+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:58.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.548+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:58.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.552+0000 7f18bf5fb9c0 20 get_obj_state: octx=0x55d404bc2510 obj=check-bucket:e state=0x55d404e6ffa8 s->prefetch_data=0 2024-09-19T13:42:58.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.552+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:58.557 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.552+0000 7f18bf5fb9c0 20 get_obj_state: octx=0x55d404bd3f70 obj=check-bucket:d state=0x55d404e65a08 s->prefetch_data=0 2024-09-19T13:42:58.557 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.552+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:58.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.552+0000 7f18bf5fb9c0 20 get_obj_state: octx=0x55d404e66760 obj=check-bucket:c state=0x55d404e68518 s->prefetch_data=0 2024-09-19T13:42:58.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.552+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:58.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.552+0000 7f18bf5fb9c0 20 get_obj_state: octx=0x55d404e67410 obj=check-bucket:f state=0x55d404e6b3a8 s->prefetch_data=0 2024-09-19T13:42:58.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.552+0000 7f18bf5fb9c0 20 get_obj_state: setting s->obj_tag to o8b9khglbjbu6916zs5hg7alcozgmlba 2024-09-19T13:42:58.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.552+0000 7f18bf5fb9c0 20 get_obj_state_impl: setting s->olh_tag to c5s3izo2psahglm2gzgqe3633rusdw25 2024-09-19T13:42:58.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.552+0000 7f18bf5fb9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=c5s3izo2psahglm2gzgqe3633rusdw25 2024-09-19T13:42:58.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.552+0000 7f18bf5fb9c0 20 get_obj_state: setting s->obj_tag to sh4ac3h9tc0opl6ep97qcqzc0mj4x08m 2024-09-19T13:42:58.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.552+0000 7f18bf5fb9c0 20 get_obj_state_impl: setting s->olh_tag to 4mhx1vhch3npz4up909ygky6qfcxaw55 2024-09-19T13:42:58.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.552+0000 7f18bf5fb9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4mhx1vhch3npz4up909ygky6qfcxaw55 2024-09-19T13:42:58.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.552+0000 7f18bf5fb9c0 20 get_obj_state: setting s->obj_tag to a5cltkyfn4itwdvha1erdxxb3wf7s21t 2024-09-19T13:42:58.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.552+0000 7f18bf5fb9c0 20 get_obj_state_impl: setting s->olh_tag to mpnwztw022depjk7yve9t061cdamv31y 2024-09-19T13:42:58.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.552+0000 7f18bf5fb9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mpnwztw022depjk7yve9t061cdamv31y 2024-09-19T13:42:58.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.556+0000 7f18bf5fb9c0 20 get_obj_state: setting s->obj_tag to 087l3h0neq3hl2filg4digks3dco88x9 2024-09-19T13:42:58.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.556+0000 7f18bf5fb9c0 20 get_obj_state_impl: setting s->olh_tag to oyca2545g6k8pcb3o13g850mtknvj77q 2024-09-19T13:42:58.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.556+0000 7f18bf5fb9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=oyca2545g6k8pcb3o13g850mtknvj77q 2024-09-19T13:42:58.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.556+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:58.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.560+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:58.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.560+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:58.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.564+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:58.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.564+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:58.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.564+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:58.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.564+0000 7f18bf5fb9c0 20 olh_log_entry: epoch=3 op=3 key=d[OdzHja8YKQMy.q6gUThvIg9rEZ-NMVY] 2024-09-19T13:42:58.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.564+0000 7f18bf5fb9c0 20 get_obj_state: octx=0x55d404bd3f70 obj=check-bucket:_:OdzHja8YKQMy.q6gUThvIg9rEZ-NMVY_d state=0x55d404f10b28 s->prefetch_data=0 2024-09-19T13:42:58.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.564+0000 7f18bf5fb9c0 10 manifest: total_size = 11 2024-09-19T13:42:58.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.564+0000 7f18bf5fb9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.4817103935163996441 2024-09-19T13:42:58.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.564+0000 7f18bf5fb9c0 20 get_obj_state: octx=0x55d404bd3f70 obj=check-bucket:_:OdzHja8YKQMy.q6gUThvIg9rEZ-NMVY_d state=0x55d404f10b28 s->prefetch_data=0 2024-09-19T13:42:58.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.564+0000 7f18bf5fb9c0 20 prepare_atomic_modification: state is not atomic. state=0x55d404f10b28 2024-09-19T13:42:58.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.564+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:58.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.564+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:58.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.564+0000 7f18bf5fb9c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-19T13:42:58.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.564+0000 7f18bf5fb9c0 20 olh_log_entry: epoch=2 op=3 key=e[3V0MqM4hNf2l08bZ1OfRBnxynmVLJCB] 2024-09-19T13:42:58.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.564+0000 7f18bf5fb9c0 20 get_obj_state: octx=0x55d404bc2510 obj=check-bucket:_:3V0MqM4hNf2l08bZ1OfRBnxynmVLJCB_e state=0x55d404f0b448 s->prefetch_data=0 2024-09-19T13:42:58.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.568+0000 7f18bf5fb9c0 20 olh_log_entry: epoch=3 op=3 key=c[AjAFt-ANll3JszuuDxwqvOcUTphOVZS] 2024-09-19T13:42:58.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.568+0000 7f18bf5fb9c0 20 get_obj_state: octx=0x55d404e66760 obj=check-bucket:_:AjAFt-ANll3JszuuDxwqvOcUTphOVZS_c state=0x55d404f1e618 s->prefetch_data=0 2024-09-19T13:42:58.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.568+0000 7f18bf5fb9c0 10 manifest: total_size = 22 2024-09-19T13:42:58.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.568+0000 7f18bf5fb9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.10444337351556176399 2024-09-19T13:42:58.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.568+0000 7f18bf5fb9c0 20 get_obj_state: octx=0x55d404bc2510 obj=check-bucket:_:3V0MqM4hNf2l08bZ1OfRBnxynmVLJCB_e state=0x55d404f0b448 s->prefetch_data=0 2024-09-19T13:42:58.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.568+0000 7f18bf5fb9c0 20 prepare_atomic_modification: state is not atomic. state=0x55d404f0b448 2024-09-19T13:42:58.573 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.568+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:58.573 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.568+0000 7f18bf5fb9c0 10 manifest: total_size = 22 2024-09-19T13:42:58.573 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.568+0000 7f18bf5fb9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.7861338171160094831 2024-09-19T13:42:58.573 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.568+0000 7f18bf5fb9c0 20 get_obj_state: octx=0x55d404e66760 obj=check-bucket:_:AjAFt-ANll3JszuuDxwqvOcUTphOVZS_c state=0x55d404f1e618 s->prefetch_data=0 2024-09-19T13:42:58.573 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.568+0000 7f18bf5fb9c0 20 prepare_atomic_modification: state is not atomic. state=0x55d404f1e618 2024-09-19T13:42:58.573 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.568+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:58.576 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.572+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:58.576 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.572+0000 7f18bf5fb9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:42:58.576 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.572+0000 7f18bf5fb9c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-19T13:42:58.576 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.572+0000 7f18bf5fb9c0 0 deleting objects inline since gc isn't initialized 2024-09-19T13:42:58.577 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.572+0000 7f18bf5fb9c0 5 delete_objs_inline: removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.1__shadow:OdzHja8YKQMy.q6gUThvIg9rEZ-NMVY_.h2AAilKvbPYsNIUJkhz9eppNXdj-2O0_0 2024-09-19T13:42:58.577 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.572+0000 7f18bf5fb9c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-19T13:42:58.577 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.572+0000 7f18bf5fb9c0 20 olh_log_entry: epoch=2 op=3 key=f[fdmDbXWIUsUbND6NsOTKubd8tEagExp] 2024-09-19T13:42:58.577 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.572+0000 7f18bf5fb9c0 20 get_obj_state: octx=0x55d404e67410 obj=check-bucket:_:fdmDbXWIUsUbND6NsOTKubd8tEagExp_f state=0x55d404f2f778 s->prefetch_data=0 2024-09-19T13:42:58.578 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.572+0000 7f18bf5fb9c0 10 manifest: total_size = 11 2024-09-19T13:42:58.578 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.572+0000 7f18bf5fb9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.13478975619217485071 2024-09-19T13:42:58.578 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.572+0000 7f18bf5fb9c0 20 get_obj_state: octx=0x55d404e67410 obj=check-bucket:_:fdmDbXWIUsUbND6NsOTKubd8tEagExp_f state=0x55d404f2f778 s->prefetch_data=0 2024-09-19T13:42:58.578 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.572+0000 7f18bf5fb9c0 20 prepare_atomic_modification: state is not atomic. state=0x55d404f2f778 2024-09-19T13:42:58.578 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.572+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:58.579 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.572+0000 7f17a0ff9640 20 handle_completion(): completion ok for obj=d[OdzHja8YKQMy.q6gUThvIg9rEZ-NMVY] 2024-09-19T13:42:58.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.576+0000 7f18bf5fb9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-19T13:42:58.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.576+0000 7f18bf5fb9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:42:58.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.576+0000 7f18bf5fb9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-19T13:42:58.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.576+0000 7f18bf5fb9c0 0 deleting objects inline since gc isn't initialized 2024-09-19T13:42:58.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.576+0000 7f18bf5fb9c0 5 delete_objs_inline: removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.1__shadow:3V0MqM4hNf2l08bZ1OfRBnxynmVLJCB_.VSS606oGcmToSChdQx-mIpo88Vg4ucs_0 2024-09-19T13:42:58.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.576+0000 7f18bf5fb9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:42:58.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.576+0000 7f18bf5fb9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-19T13:42:58.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.576+0000 7f18bf5fb9c0 0 deleting objects inline since gc isn't initialized 2024-09-19T13:42:58.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.576+0000 7f18bf5fb9c0 5 delete_objs_inline: removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.1__shadow:AjAFt-ANll3JszuuDxwqvOcUTphOVZS_.Hjr73RTwQWh7Cdg5zJCBlcNHYFUsUZL_0 2024-09-19T13:42:58.588 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.580+0000 7f18bf5fb9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T13:42:58.588 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.580+0000 7f18bf5fb9c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-19T13:42:58.588 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.580+0000 7f18bf5fb9c0 0 deleting objects inline since gc isn't initialized 2024-09-19T13:42:58.588 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.580+0000 7f18bf5fb9c0 5 delete_objs_inline: removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.1__shadow:fdmDbXWIUsUbND6NsOTKubd8tEagExp_.rFyYV4b3EJ9r3yA5oHrIVyDUiMzTkc3_0 2024-09-19T13:42:58.588 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.584+0000 7f18bf5fb9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-19T13:42:58.588 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.584+0000 7f18bf5fb9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-19T13:42:58.589 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.584+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:58.589 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.584+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:58.591 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.584+0000 7f17a0ff9640 20 handle_completion(): completion ok for obj=e[3V0MqM4hNf2l08bZ1OfRBnxynmVLJCB] 2024-09-19T13:42:58.591 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.584+0000 7f17a0ff9640 20 handle_completion(): completion ok for obj=c[AjAFt-ANll3JszuuDxwqvOcUTphOVZS] 2024-09-19T13:42:58.592 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.584+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.5 2024-09-19T13:42:58.592 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.584+0000 7f18bf5fb9c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-19T13:42:58.592 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.588+0000 7f17a0ff9640 20 handle_completion(): completion ok for obj=f[fdmDbXWIUsUbND6NsOTKubd8tEagExp] 2024-09-19T13:42:58.593 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.588+0000 7f18bf5fb9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-19T13:42:58.596 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.588+0000 7f18bf5fb9c0 20 get_obj_state: octx=0x55d404bc2510 obj=check-bucket:e state=0x55d404e6ffa8 s->prefetch_data=0 2024-09-19T13:42:58.596 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.592+0000 7f18bf5fb9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=c5s3izo2psahglm2gzgqe3633rusdw25 2024-09-19T13:42:58.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.592+0000 7f18bf5fb9c0 20 get_obj_state: octx=0x55d404e67410 obj=check-bucket:f state=0x55d404e6b3a8 s->prefetch_data=0 2024-09-19T13:42:58.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.592+0000 7f18bf5fb9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=oyca2545g6k8pcb3o13g850mtknvj77q 2024-09-19T13:42:58.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.592+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:58.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.592+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:58.603 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.596+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.8 2024-09-19T13:42:58.603 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.596+0000 7f18bf5fb9c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-19T13:42:58.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.604+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:58.611 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.604+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:58.614 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.608+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.1 2024-09-19T13:42:58.614 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.608+0000 7f18bf5fb9c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-19T13:42:58.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.612+0000 7f18bf5fb9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.1.10 2024-09-19T13:42:58.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.612+0000 7f18bf5fb9c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-19T13:42:58.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.612+0000 7f18bf5fb9c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-19T13:42:58.621 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.616+0000 7f1773fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:58.626 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.620+0000 7f18bf5fb9c0 20 remove_watcher() i=0 2024-09-19T13:42:58.626 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.620+0000 7f18bf5fb9c0 2 removed watcher, disabling cache 2024-09-19T13:42:58.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.624+0000 7f18bf5fb9c0 20 remove_watcher() i=1 2024-09-19T13:42:58.630 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.624+0000 7f18bf5fb9c0 20 remove_watcher() i=2 2024-09-19T13:42:58.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.628+0000 7f18bf5fb9c0 20 remove_watcher() i=3 2024-09-19T13:42:58.635 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.628+0000 7f18bf5fb9c0 20 remove_watcher() i=4 2024-09-19T13:42:58.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.632+0000 7f18bf5fb9c0 20 remove_watcher() i=5 2024-09-19T13:42:58.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.632+0000 7f18bf5fb9c0 20 remove_watcher() i=6 2024-09-19T13:42:58.640 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:58.636+0000 7f18bf5fb9c0 20 remove_watcher() i=7 2024-09-19T13:42:58.660 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:58.661 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:58.727 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:58.727 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:59.192 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-19T13:42:59.225 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:42:59.225 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:42:59.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.264+0000 7f5876a8c9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:59.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.268+0000 7f5876a8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:59.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.268+0000 7f5876a8c9c0 20 realm 2024-09-19T13:42:59.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.268+0000 7f5876a8c9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:59.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.268+0000 7f5876a8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:59.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.268+0000 7f5876a8c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:42:59.274 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.268+0000 7f5876a8c9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:59.274 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.268+0000 7f5876a8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:59.274 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.268+0000 7f5876a8c9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:59.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.268+0000 7f5876a8c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:59.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.268+0000 7f5876a8c9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:59.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.268+0000 7f5876a8c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:42:59.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.268+0000 7f5876a8c9c0 20 searching for the correct realm 2024-09-19T13:42:59.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.276+0000 7f5873d91640 0 -- 172.21.15.153:0/772228873 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x557e68141fa0 msgr2=0x557e68144460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:59.288 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.284+0000 7f5873d91640 0 -- 172.21.15.153:0/772228873 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f586404bc20 msgr2=0x7f586408aac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:42:59.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.288+0000 7f5876a8c9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:42:59.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.288+0000 7f5876a8c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:42:59.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.288+0000 7f5876a8c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:42:59.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.288+0000 7f5876a8c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:42:59.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.288+0000 7f5876a8c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:42:59.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.288+0000 7f5876a8c9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:42:59.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.288+0000 7f5876a8c9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:59.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.292+0000 7f5876a8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:59.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.292+0000 7f5876a8c9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:59.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.292+0000 7f5876a8c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:42:59.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.292+0000 7f5876a8c9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:59.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.292+0000 7f5876a8c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:42:59.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.292+0000 7f5876a8c9c0 20 zone default found 2024-09-19T13:42:59.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.292+0000 7f5876a8c9c0 4 Realm: () 2024-09-19T13:42:59.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.292+0000 7f5876a8c9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:42:59.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.292+0000 7f5876a8c9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:42:59.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.292+0000 7f5876a8c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:42:59.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.292+0000 7f5876a8c9c0 20 zonegroup default 2024-09-19T13:42:59.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.292+0000 7f5876a8c9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:59.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.292+0000 7f5876a8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:59.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.292+0000 7f5876a8c9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:59.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.292+0000 7f5876a8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:59.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.292+0000 7f5876a8c9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:59.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.292+0000 7f5876a8c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:42:59.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.292+0000 7f5876a8c9c0 20 started sync module instance, tier type = 2024-09-19T13:42:59.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.292+0000 7f5876a8c9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:42:59.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.312+0000 7f5876a8c9c0 20 add_watcher() i=0 2024-09-19T13:42:59.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.312+0000 7f5876a8c9c0 20 add_watcher() i=1 2024-09-19T13:42:59.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.312+0000 7f5876a8c9c0 20 add_watcher() i=2 2024-09-19T13:42:59.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.312+0000 7f5876a8c9c0 20 add_watcher() i=3 2024-09-19T13:42:59.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.312+0000 7f5876a8c9c0 20 add_watcher() i=4 2024-09-19T13:42:59.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.312+0000 7f5876a8c9c0 20 add_watcher() i=5 2024-09-19T13:42:59.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.312+0000 7f5876a8c9c0 20 add_watcher() i=6 2024-09-19T13:42:59.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.312+0000 7f5876a8c9c0 20 add_watcher() i=7 2024-09-19T13:42:59.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.312+0000 7f5876a8c9c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:42:59.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.316+0000 7f572afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:59.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.316+0000 7f5876a8c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:42:59.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.316+0000 7f5876a8c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:42:59.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.316+0000 7f5876a8c9c0 5 note: GC not initialized 2024-09-19T13:42:59.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.316+0000 7f5729fdb640 20 reqs_thread_entry: start 2024-09-19T13:42:59.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.316+0000 7f5876a8c9c0 20 init_complete bucket index max shards: 11 2024-09-19T13:42:59.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.316+0000 7f5876a8c9c0 20 Filter name: none 2024-09-19T13:42:59.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.316+0000 7f569b7fe640 20 reqs_thread_entry: start 2024-09-19T13:42:59.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.316+0000 7f5876a8c9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:59.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.316+0000 7f5876a8c9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:59.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.316+0000 7f5876a8c9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:59.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.316+0000 7f5876a8c9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:59.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.316+0000 7f5876a8c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:42:59.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.316+0000 7f5876a8c9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:59.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.316+0000 7f5876a8c9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-19T13:42:59.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.316+0000 7f5876a8c9c0 20 rados->read ofs=0 len=0 2024-09-19T13:42:59.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.320+0000 7f5876a8c9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-19T13:42:59.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.320+0000 7f5876a8c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T13:42:59.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.324+0000 7f572afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:42:59.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.328+0000 7f5876a8c9c0 20 remove_watcher() i=0 2024-09-19T13:42:59.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.328+0000 7f5876a8c9c0 2 removed watcher, disabling cache 2024-09-19T13:42:59.336 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.332+0000 7f5876a8c9c0 20 remove_watcher() i=1 2024-09-19T13:42:59.339 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.332+0000 7f5876a8c9c0 20 remove_watcher() i=2 2024-09-19T13:42:59.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.336+0000 7f5876a8c9c0 20 remove_watcher() i=3 2024-09-19T13:42:59.343 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.336+0000 7f5876a8c9c0 20 remove_watcher() i=4 2024-09-19T13:42:59.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.340+0000 7f5876a8c9c0 20 remove_watcher() i=5 2024-09-19T13:42:59.346 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.340+0000 7f5876a8c9c0 20 remove_watcher() i=6 2024-09-19T13:42:59.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:42:59.344+0000 7f5876a8c9c0 20 remove_watcher() i=7 2024-09-19T13:42:59.362 INFO:tasks.workunit.client.0.smithi153.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-19T13:42:59.362 INFO:tasks.workunit.client.0.smithi153.stderr:Deleting bucket check-bucket 2024-09-19T13:42:59.363 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:59.363 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:59.401 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T13:42:59.543 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T13:42:59.921 INFO:tasks.workunit.client.0.smithi153.stderr:Completed bucket check tests 2024-09-19T13:42:59.921 INFO:tasks.workunit.client.0.smithi153.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-19T13:42:59.922 INFO:tasks.workunit.client.0.smithi153.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-19T13:42:59.922 INFO:tasks.workunit.client.0.smithi153.stdout:connected to https://localhost:443 2024-09-19T13:43:00.024 INFO:tasks.workunit.client.0.smithi153.stderr:+ deactivate 2024-09-19T13:43:00.024 INFO:tasks.workunit.client.0.smithi153.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-19T13:43:00.024 INFO:tasks.workunit.client.0.smithi153.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-19T13:43:00.024 INFO:tasks.workunit.client.0.smithi153.stderr:+ export PATH 2024-09-19T13:43:00.024 INFO:tasks.workunit.client.0.smithi153.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-19T13:43:00.024 INFO:tasks.workunit.client.0.smithi153.stderr:+ '[' -n '' ']' 2024-09-19T13:43:00.024 INFO:tasks.workunit.client.0.smithi153.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T13:43:00.025 INFO:tasks.workunit.client.0.smithi153.stderr:+ hash -r 2024-09-19T13:43:00.025 INFO:tasks.workunit.client.0.smithi153.stderr:+ '[' -n '' ']' 2024-09-19T13:43:00.025 INFO:tasks.workunit.client.0.smithi153.stderr:+ unset VIRTUAL_ENV 2024-09-19T13:43:00.025 INFO:tasks.workunit.client.0.smithi153.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-19T13:43:00.025 INFO:tasks.workunit.client.0.smithi153.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-19T13:43:00.025 INFO:tasks.workunit.client.0.smithi153.stderr:+ unset -f deactivate 2024-09-19T13:43:00.025 INFO:tasks.workunit.client.0.smithi153.stderr:+ echo OK. 2024-09-19T13:43:00.030 INFO:tasks.workunit.client.0.smithi153.stdout:OK. 2024-09-19T13:43:00.030 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:43:00.030 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:43:00.043 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-19T13:43:00.043 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T13:43:00.457 DEBUG:teuthology.parallel:result is None 2024-09-19T13:43:00.457 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T13:43:00.467 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T13:43:00.467 DEBUG:teuthology.orchestra.run.smithi153:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T13:43:00.523 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T13:43:00.523 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T13:43:00.535 INFO:tasks.workunit:Pulling workunits from ref 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:43:00.535 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T13:43:00.535 DEBUG:teuthology.orchestra.run.smithi153:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T13:43:00.572 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T13:43:00.572 INFO:teuthology.orchestra.run.smithi153.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-19T13:43:00.573 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T13:43:00.620 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-19T13:43:00.620 DEBUG:teuthology.orchestra.run.smithi153:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-19T13:43:00.669 INFO:tasks.workunit:timeout=3h 2024-09-19T13:43:00.669 INFO:tasks.workunit:cleanup=True 2024-09-19T13:43:00.669 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:43:00.718 INFO:tasks.workunit.client.0.smithi153.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T13:43:59.410 INFO:tasks.workunit.client.0.smithi153.stderr:Note: switching to '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'. 2024-09-19T13:43:59.410 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:43:59.410 INFO:tasks.workunit.client.0.smithi153.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T13:43:59.410 INFO:tasks.workunit.client.0.smithi153.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T13:43:59.410 INFO:tasks.workunit.client.0.smithi153.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T13:43:59.410 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:43:59.410 INFO:tasks.workunit.client.0.smithi153.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T13:43:59.410 INFO:tasks.workunit.client.0.smithi153.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T13:43:59.410 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:43:59.411 INFO:tasks.workunit.client.0.smithi153.stderr: git switch -c 2024-09-19T13:43:59.411 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:43:59.411 INFO:tasks.workunit.client.0.smithi153.stderr:Or undo this operation with: 2024-09-19T13:43:59.411 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:43:59.411 INFO:tasks.workunit.client.0.smithi153.stderr: git switch - 2024-09-19T13:43:59.411 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:43:59.411 INFO:tasks.workunit.client.0.smithi153.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T13:43:59.411 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T13:43:59.411 INFO:tasks.workunit.client.0.smithi153.stderr:HEAD is now at 08af21e0d16 rgw_log_backing: error code not returned 2024-09-19T13:43:59.420 DEBUG:teuthology.orchestra.run.smithi153:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T13:43:59.469 INFO:tasks.workunit.client.0.smithi153.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T13:43:59.472 INFO:tasks.workunit.client.0.smithi153.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T13:43:59.472 INFO:tasks.workunit.client.0.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T13:43:59.526 INFO:tasks.workunit.client.0.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T13:43:59.579 INFO:tasks.workunit.client.0.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T13:43:59.619 INFO:tasks.workunit.client.0.smithi153.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T13:43:59.620 INFO:tasks.workunit.client.0.smithi153.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T13:43:59.621 INFO:tasks.workunit.client.0.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T13:43:59.664 INFO:tasks.workunit.client.0.smithi153.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T13:43:59.668 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T13:43:59.668 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T13:43:59.715 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-19T13:43:59.717 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-19T13:43:59.717 DEBUG:teuthology.orchestra.run.smithi153:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-19T13:43:59.780 INFO:tasks.workunit.client.0.smithi153.stdout:Running main() from gmock_main.cc 2024-09-19T13:43:59.780 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-19T13:43:59.781 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment set-up. 2024-09-19T13:43:59.781 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 11 tests from ClsLock 2024-09-19T13:43:59.781 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-19T13:44:01.449 INFO:tasks.workunit.client.0.smithi153.stdout:lock: mylock 2024-09-19T13:44:01.449 INFO:tasks.workunit.client.0.smithi153.stdout: lock_type: exclusive 2024-09-19T13:44:01.449 INFO:tasks.workunit.client.0.smithi153.stdout: tag: 2024-09-19T13:44:01.449 INFO:tasks.workunit.client.0.smithi153.stdout: lockers: 2024-09-19T13:44:01.449 INFO:tasks.workunit.client.0.smithi153.stdout: client.5148 expiration=2024-09-19T13:46:01.439689+0000 addr=v1:172.21.15.153:0/3877504046 cookie= 2024-09-19T13:44:01.457 INFO:tasks.workunit.client.0.smithi153.stdout:lock: mylock 2024-09-19T13:44:01.457 INFO:tasks.workunit.client.0.smithi153.stdout: lock_type: shared 2024-09-19T13:44:01.457 INFO:tasks.workunit.client.0.smithi153.stdout: tag: 2024-09-19T13:44:01.457 INFO:tasks.workunit.client.0.smithi153.stdout: lockers: 2024-09-19T13:44:01.457 INFO:tasks.workunit.client.0.smithi153.stdout: client.4943 expiration=0.000000 addr=v1:172.21.15.153:0/1270232645 cookie= 2024-09-19T13:44:01.457 INFO:tasks.workunit.client.0.smithi153.stdout: client.5148 expiration=2024-09-19T13:46:01.454554+0000 addr=v1:172.21.15.153:0/3877504046 cookie= 2024-09-19T13:44:01.459 INFO:tasks.workunit.client.0.smithi153.stdout:lock: mylock 2024-09-19T13:44:01.460 INFO:tasks.workunit.client.0.smithi153.stdout: lock_type: shared 2024-09-19T13:44:01.460 INFO:tasks.workunit.client.0.smithi153.stdout: tag: 2024-09-19T13:44:01.460 INFO:tasks.workunit.client.0.smithi153.stdout: lockers: 2024-09-19T13:44:01.460 INFO:tasks.workunit.client.0.smithi153.stdout: client.4943 expiration=0.000000 addr=v1:172.21.15.153:0/1270232645 cookie= 2024-09-19T13:44:02.367 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] ClsLock.TestMultiLocking (2587 ms) 2024-09-19T13:44:02.367 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] ClsLock.TestMeta 2024-09-19T13:44:04.461 INFO:tasks.workunit.client.0.smithi153.stdout:lock: mylock 2024-09-19T13:44:04.461 INFO:tasks.workunit.client.0.smithi153.stdout: lock_type: shared 2024-09-19T13:44:04.461 INFO:tasks.workunit.client.0.smithi153.stdout: tag: 2024-09-19T13:44:04.461 INFO:tasks.workunit.client.0.smithi153.stdout: lockers: 2024-09-19T13:44:04.461 INFO:tasks.workunit.client.0.smithi153.stdout: client.5163 expiration=0.000000 addr=v1:172.21.15.153:0/2877913679 cookie= 2024-09-19T13:44:04.466 INFO:tasks.workunit.client.0.smithi153.stdout:lock: mylock 2024-09-19T13:44:04.466 INFO:tasks.workunit.client.0.smithi153.stdout: lock_type: exclusive 2024-09-19T13:44:04.466 INFO:tasks.workunit.client.0.smithi153.stdout: tag: new_tag 2024-09-19T13:44:04.466 INFO:tasks.workunit.client.0.smithi153.stdout: lockers: 2024-09-19T13:44:04.466 INFO:tasks.workunit.client.0.smithi153.stdout: client.5157 expiration=0.000000 addr=v1:172.21.15.153:0/272082480 cookie= 2024-09-19T13:44:05.402 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] ClsLock.TestMeta (3034 ms) 2024-09-19T13:44:05.402 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] ClsLock.TestCookie 2024-09-19T13:44:07.501 INFO:tasks.workunit.client.0.smithi153.stdout:lock: mylock 2024-09-19T13:44:07.501 INFO:tasks.workunit.client.0.smithi153.stdout: lock_type: exclusive 2024-09-19T13:44:07.501 INFO:tasks.workunit.client.0.smithi153.stdout: tag: 2024-09-19T13:44:07.501 INFO:tasks.workunit.client.0.smithi153.stdout: lockers: 2024-09-19T13:44:07.505 INFO:tasks.workunit.client.0.smithi153.stdout:lock: mylock 2024-09-19T13:44:07.506 INFO:tasks.workunit.client.0.smithi153.stdout: lock_type: shared 2024-09-19T13:44:07.506 INFO:tasks.workunit.client.0.smithi153.stdout: tag: 2024-09-19T13:44:07.506 INFO:tasks.workunit.client.0.smithi153.stdout: lockers: 2024-09-19T13:44:07.506 INFO:tasks.workunit.client.0.smithi153.stdout: client.5166 expiration=0.000000 addr=v1:172.21.15.153:0/145534866 cookie= 2024-09-19T13:44:07.506 INFO:tasks.workunit.client.0.smithi153.stdout: client.5166 expiration=0.000000 addr=v1:172.21.15.153:0/145534866 cookie=new cookie 2024-09-19T13:44:08.467 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] ClsLock.TestCookie (3064 ms) 2024-09-19T13:44:08.468 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-19T13:44:11.531 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] ClsLock.TestMultipleLocks (3066 ms) 2024-09-19T13:44:11.531 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-19T13:44:19.282 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] ClsLock.TestLockDuration (7750 ms) 2024-09-19T13:44:19.282 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-19T13:44:22.331 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] ClsLock.TestAssertLocked (3050 ms) 2024-09-19T13:44:22.331 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-19T13:44:25.351 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] ClsLock.TestSetCookie (3020 ms) 2024-09-19T13:44:25.351 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] ClsLock.TestRenew 2024-09-19T13:44:46.439 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] ClsLock.TestRenew (21088 ms) 2024-09-19T13:44:46.439 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-19T13:44:52.533 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6094 ms) 2024-09-19T13:44:52.533 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-19T13:44:59.667 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7131 ms) 2024-09-19T13:44:59.667 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-19T13:45:07.321 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (7657 ms) 2024-09-19T13:45:07.322 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 11 tests from ClsLock (67541 ms total) 2024-09-19T13:45:07.322 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:45:07.322 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment tear-down 2024-09-19T13:45:07.322 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] 11 tests from 1 test suite ran. (67541 ms total) 2024-09-19T13:45:07.322 INFO:tasks.workunit.client.0.smithi153.stdout:[ PASSED ] 11 tests. 2024-09-19T13:45:07.327 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:45:07.328 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:45:07.384 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-19T13:45:07.386 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-19T13:45:07.386 DEBUG:teuthology.orchestra.run.smithi153:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-19T13:45:07.449 INFO:tasks.workunit.client.0.smithi153.stdout:Running main() from gmock_main.cc 2024-09-19T13:45:07.449 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-19T13:45:07.449 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment set-up. 2024-09-19T13:45:07.450 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 4 tests from cls_log 2024-09-19T13:45:07.450 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-19T13:45:10.373 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_log.test_log_add_same_time (2923 ms) 2024-09-19T13:45:10.373 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-19T13:45:13.387 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_log.test_log_add_different_time (3014 ms) 2024-09-19T13:45:13.387 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_log.trim_by_time 2024-09-19T13:45:16.415 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_log.trim_by_time (3028 ms) 2024-09-19T13:45:16.415 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-19T13:45:19.487 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_log.trim_by_marker (3072 ms) 2024-09-19T13:45:19.487 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 4 tests from cls_log (12037 ms total) 2024-09-19T13:45:19.487 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:45:19.487 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment tear-down 2024-09-19T13:45:19.487 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] 4 tests from 1 test suite ran. (12037 ms total) 2024-09-19T13:45:19.488 INFO:tasks.workunit.client.0.smithi153.stdout:[ PASSED ] 4 tests. 2024-09-19T13:45:19.491 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:45:19.491 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:45:19.552 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-19T13:45:19.553 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-19T13:45:19.553 DEBUG:teuthology.orchestra.run.smithi153:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-19T13:45:19.622 INFO:tasks.workunit.client.0.smithi153.stdout:Running main() from gmock_main.cc 2024-09-19T13:45:19.622 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-19T13:45:19.622 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment set-up. 2024-09-19T13:45:19.622 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 10 tests from cls_refcount 2024-09-19T13:45:19.622 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-19T13:45:22.518 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_refcount.test_implicit (2896 ms) 2024-09-19T13:45:22.518 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-19T13:45:25.533 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3015 ms) 2024-09-19T13:45:25.533 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-19T13:45:34.369 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_refcount.test_put_snap (8836 ms) 2024-09-19T13:45:34.369 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-19T13:45:37.385 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_refcount.test_explicit (3017 ms) 2024-09-19T13:45:37.385 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_refcount.set 2024-09-19T13:45:40.439 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_refcount.set (3052 ms) 2024-09-19T13:45:40.439 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-19T13:45:47.542 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_refcount.test_implicit_ec (7105 ms) 2024-09-19T13:45:47.543 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-19T13:45:54.585 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7043 ms) 2024-09-19T13:45:54.585 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-19T13:46:06.797 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_refcount.test_put_snap_ec (12212 ms) 2024-09-19T13:46:06.798 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-19T13:46:13.842 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_refcount.test_explicit_ec (7045 ms) 2024-09-19T13:46:13.843 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_refcount.set_ec 2024-09-19T13:46:20.913 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_refcount.set_ec (7071 ms) 2024-09-19T13:46:20.914 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 10 tests from cls_refcount (61292 ms total) 2024-09-19T13:46:20.914 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:46:20.914 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment tear-down 2024-09-19T13:46:20.914 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] 10 tests from 1 test suite ran. (61292 ms total) 2024-09-19T13:46:20.914 INFO:tasks.workunit.client.0.smithi153.stdout:[ PASSED ] 10 tests. 2024-09-19T13:46:20.918 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:46:20.918 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:46:20.972 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-19T13:46:20.973 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-19T13:46:20.973 DEBUG:teuthology.orchestra.run.smithi153:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-19T13:46:21.037 INFO:tasks.workunit.client.0.smithi153.stdout:Running main() from gmock_main.cc 2024-09-19T13:46:21.037 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-19T13:46:21.037 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment set-up. 2024-09-19T13:46:21.037 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 18 tests from cls_rgw 2024-09-19T13:46:22.934 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw.index_basic 2024-09-19T13:46:23.038 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw.index_basic (105 ms) 2024-09-19T13:46:23.039 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-19T13:46:23.120 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (82 ms) 2024-09-19T13:46:23.120 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-19T13:46:23.232 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw.index_remove_object (112 ms) 2024-09-19T13:46:23.232 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-19T13:46:25.640 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw.index_suggest (2407 ms) 2024-09-19T13:46:25.640 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-19T13:46:25.655 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw.index_suggest_complete (16 ms) 2024-09-19T13:46:25.655 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw.index_list 2024-09-19T13:46:25.725 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw.index_list (70 ms) 2024-09-19T13:46:25.725 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-19T13:47:10.516 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw.index_list_delimited (44790 ms) 2024-09-19T13:47:10.516 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw.bi_list 2024-09-19T13:47:10.666 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw.bi_list (151 ms) 2024-09-19T13:47:10.666 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw.gc_set 2024-09-19T13:47:10.688 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw.gc_set (22 ms) 2024-09-19T13:47:10.688 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw.gc_list 2024-09-19T13:47:10.711 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw.gc_list (23 ms) 2024-09-19T13:47:10.711 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-19T13:47:17.543 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw.gc_defer (6832 ms) 2024-09-19T13:47:17.543 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-19T13:47:17.771 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw.usage_basic (227 ms) 2024-09-19T13:47:17.771 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-19T13:47:17.773 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw.usage_clear_no_obj (2 ms) 2024-09-19T13:47:17.774 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-19T13:47:18.210 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw.usage_clear (436 ms) 2024-09-19T13:47:18.210 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-19T13:47:18.327 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw.bi_log_trim (117 ms) 2024-09-19T13:47:18.327 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-19T13:47:18.359 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw.index_racing_removes (32 ms) 2024-09-19T13:47:18.360 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-19T13:47:18.393 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw.reshardlog_list (34 ms) 2024-09-19T13:47:18.393 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-19T13:47:18.417 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw.reshardlog_num (24 ms) 2024-09-19T13:47:18.563 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 18 tests from cls_rgw (55484 ms total) 2024-09-19T13:47:18.564 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:47:18.564 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment tear-down 2024-09-19T13:47:18.564 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] 18 tests from 1 test suite ran. (57527 ms total) 2024-09-19T13:47:18.564 INFO:tasks.workunit.client.0.smithi153.stdout:[ PASSED ] 18 tests. 2024-09-19T13:47:18.571 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:47:18.571 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:47:18.627 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-19T13:47:18.628 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-19T13:47:18.629 DEBUG:teuthology.orchestra.run.smithi153:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-19T13:47:18.703 INFO:tasks.workunit.client.0.smithi153.stdout:Running main() from gmock_main.cc 2024-09-19T13:47:18.703 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-19T13:47:18.703 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment set-up. 2024-09-19T13:47:18.703 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-19T13:47:18.703 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw_gc.init 2024-09-19T13:47:20.565 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw_gc.init (1862 ms) 2024-09-19T13:47:20.874 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-19T13:47:20.875 INFO:tasks.workunit.client.0.smithi153.stderr:[ ] list info tag = chain-0 2024-09-19T13:47:20.875 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (57 ms) 2024-09-19T13:47:20.875 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-19T13:47:20.875 INFO:tasks.workunit.client.0.smithi153.stderr:[ ] next_marker is: = 0/4263 2024-09-19T13:47:20.876 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (17 ms) 2024-09-19T13:47:20.876 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-19T13:47:20.876 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (19 ms) 2024-09-19T13:47:20.876 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-19T13:47:20.876 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (18 ms) 2024-09-19T13:47:20.876 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-19T13:47:20.927 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (250 ms) 2024-09-19T13:47:20.927 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-19T13:47:20.944 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (18 ms) 2024-09-19T13:47:20.945 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-19T13:47:20.965 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (21 ms) 2024-09-19T13:47:20.965 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-19T13:47:21.595 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw_gc.finalize (630 ms) 2024-09-19T13:47:21.596 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 9 tests from cls_rgw_gc (2892 ms total) 2024-09-19T13:47:21.596 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:47:21.596 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment tear-down 2024-09-19T13:47:21.596 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] 9 tests from 1 test suite ran. (2892 ms total) 2024-09-19T13:47:21.596 INFO:tasks.workunit.client.0.smithi153.stdout:[ PASSED ] 9 tests. 2024-09-19T13:47:21.601 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:47:21.602 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:47:21.656 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-19T13:47:21.657 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-19T13:47:21.657 DEBUG:teuthology.orchestra.run.smithi153:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-19T13:47:21.732 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:47:21.733 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:47:21.733 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] Running 1 test from 1 test suite. 2024-09-19T13:47:21.733 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment set-up. 2024-09-19T13:47:23.633 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 1 test from cls_rgw_stats 2024-09-19T13:47:23.634 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-19T13:47:23.679 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.677+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~K32O45PZVLB4.0 size=653420 2024-09-19T13:47:23.679 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.677+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=K32O45PZVLB4 tag=2GQSVJKTKZK3 type=write size=1701996 2024-09-19T13:47:23.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.681+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~LCTBTR92EH8C.0 size=58523 2024-09-19T13:47:23.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.681+0000 7fcf3240c8c0 1 > prepared multipart upload key=A02RDP6BA9AC upload=LCTBTR92EH8C tag=OMMMZBLP2M42 type=write size=1107099 2024-09-19T13:47:23.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.685+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=NAB1QPDY73L6 type=del size=2890815 2024-09-19T13:47:23.690 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.689+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=K52L1VA7G6T1 type=del size=1366058 2024-09-19T13:47:23.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.689+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=L51U5334IDF1 type=del size=1097175 2024-09-19T13:47:23.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.697+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~95AAX06IM0RX.0 size=1048576 2024-09-19T13:47:23.702 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.697+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~95AAX06IM0RX.1 size=1048576 2024-09-19T13:47:23.704 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.701+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~95AAX06IM0RX.2 size=436573 2024-09-19T13:47:23.704 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.701+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=95AAX06IM0RX tag=7WHIGJ2Q2TUY type=write size=3582301 2024-09-19T13:47:23.707 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.705+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=IFRDNWE7FXOO type=write size=4986 2024-09-19T13:47:23.713 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.709+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~Q52VDND03GE9.0 size=345984 2024-09-19T13:47:23.713 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.709+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=Q52VDND03GE9 tag=P283BVFQNMAI type=write size=1394560 2024-09-19T13:47:23.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.717+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~FPPF1JX4FF4U.0 size=1048576 2024-09-19T13:47:23.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.717+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~FPPF1JX4FF4U.1 size=1048576 2024-09-19T13:47:23.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.721+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~FPPF1JX4FF4U.2 size=702260 2024-09-19T13:47:23.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.721+0000 7fcf3240c8c0 1 > prepared multipart upload key=6DFF2OCPT9W2 upload=FPPF1JX4FF4U tag=1QC8NWO5MXG3 type=write size=3847988 2024-09-19T13:47:23.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.725+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~0182W60Y3J58.0 size=1048576 2024-09-19T13:47:23.731 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.729+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~0182W60Y3J58.1 size=1048576 2024-09-19T13:47:23.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.729+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~0182W60Y3J58.2 size=441849 2024-09-19T13:47:23.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.729+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=0182W60Y3J58 tag=DCJ4LVO5RXS0 type=write size=3587577 2024-09-19T13:47:23.736 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.733+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=WE9M1FXJMMY8 type=del size=241441 2024-09-19T13:47:23.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.737+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=3WAHASBVOBLX type=del size=4080795 2024-09-19T13:47:23.743 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.741+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~N3VGAV3KRZXA.0 size=947731 2024-09-19T13:47:23.743 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.741+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=N3VGAV3KRZXA tag=YMBL1EV6D1X1 type=write size=1996307 2024-09-19T13:47:23.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.741+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=V9USAZIS8HA3 type=del size=141303 2024-09-19T13:47:23.748 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.745+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=P2GSA5WPL01S type=del size=3711731 2024-09-19T13:47:23.753 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.749+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~U5VS5Y20P7AA.0 size=1048576 2024-09-19T13:47:23.755 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.753+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~U5VS5Y20P7AA.1 size=1021907 2024-09-19T13:47:23.755 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.753+0000 7fcf3240c8c0 1 > prepared multipart upload key=6DFF2OCPT9W2 upload=U5VS5Y20P7AA tag=EWD0VRT6YOXJ type=write size=3119059 2024-09-19T13:47:23.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.753+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~K32O45PZVLB4.0 size=653420 2024-09-19T13:47:23.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.761+0000 7fcf3240c8c0 1 < completed multipart upload key=NP2L28YRVQ8L upload=K32O45PZVLB4 tag=2GQSVJKTKZK3 type=write size=1701996 2024-09-19T13:47:23.768 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.765+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~W26Z38KLC86W.0 size=1048576 2024-09-19T13:47:23.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.769+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~W26Z38KLC86W.1 size=1048576 2024-09-19T13:47:23.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.769+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~W26Z38KLC86W.2 size=797917 2024-09-19T13:47:23.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.769+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=W26Z38KLC86W tag=PVX5NRNMZPLV type=write size=3943645 2024-09-19T13:47:23.777 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.773+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~LCTBTR92EH8C.0 size=58523 2024-09-19T13:47:23.782 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.777+0000 7fcf3240c8c0 1 < completed multipart upload key=A02RDP6BA9AC upload=LCTBTR92EH8C tag=OMMMZBLP2M42 type=write size=1107099 2024-09-19T13:47:23.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.781+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=KWXR0L8JS3QO type=del size=142974 2024-09-19T13:47:23.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.785+0000 7fcf3240c8c0 1 < completed delete operation key=D20C6C2ZFX1W tag=NAB1QPDY73L6 type=del 2024-09-19T13:47:23.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.789+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~01R595QGPS19.0 size=1048576 2024-09-19T13:47:23.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.793+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~01R595QGPS19.1 size=10283 2024-09-19T13:47:23.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.793+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=01R595QGPS19 tag=HT1J2MSLWOS2 type=write size=2107435 2024-09-19T13:47:23.802 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.801+0000 7fcf3240c8c0 1 < suggested remove operation key=HXMZKP7H3HJE tag=K52L1VA7G6T1 type=del 2024-09-19T13:47:23.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.805+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~9OUWMAAKET7C.0 size=1048576 2024-09-19T13:47:23.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.809+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~9OUWMAAKET7C.1 size=1048576 2024-09-19T13:47:23.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.809+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~9OUWMAAKET7C.2 size=824981 2024-09-19T13:47:23.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.809+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=9OUWMAAKET7C tag=9INNXFFMR5V6 type=write size=3970709 2024-09-19T13:47:23.816 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.813+0000 7fcf3240c8c0 1 < completed delete operation key=6DFF2OCPT9W2 tag=L51U5334IDF1 type=del 2024-09-19T13:47:23.822 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.817+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~ETERELYB01EB.0 size=1048576 2024-09-19T13:47:23.824 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.821+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~ETERELYB01EB.1 size=1048576 2024-09-19T13:47:23.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.825+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~ETERELYB01EB.2 size=28901 2024-09-19T13:47:23.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.825+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=ETERELYB01EB tag=DVL8ILR5PPXG type=write size=3174629 2024-09-19T13:47:23.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.825+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~95AAX06IM0RX.0 size=1048576 2024-09-19T13:47:23.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.829+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~95AAX06IM0RX.1 size=1048576 2024-09-19T13:47:23.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.833+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~95AAX06IM0RX.2 size=436573 2024-09-19T13:47:23.839 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.837+0000 7fcf3240c8c0 1 < completed multipart upload key=QMSDNKYFFK1F upload=95AAX06IM0RX tag=7WHIGJ2Q2TUY type=write size=3582301 2024-09-19T13:47:23.842 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.837+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=OI41GVYTK4YS type=write size=668074 2024-09-19T13:47:23.845 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.841+0000 7fcf3240c8c0 1 < completed write operation key=D1RMXGXS3O7Z tag=IFRDNWE7FXOO type=write size=4986 2024-09-19T13:47:23.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.845+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=ELNVT5TJ4USF type=del size=2854540 2024-09-19T13:47:23.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.845+0000 7fcf3240c8c0 1 < canceled part key=_multipart_QAYJ5B1KZ08J.2~Q52VDND03GE9.0 size=345984 2024-09-19T13:47:23.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.849+0000 7fcf3240c8c0 1 < canceled multipart upload key=QAYJ5B1KZ08J upload=Q52VDND03GE9 tag=P283BVFQNMAI type=write size=1394560 2024-09-19T13:47:23.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.857+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~RPW5VMUIBRYM.0 size=1048576 2024-09-19T13:47:23.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.857+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~RPW5VMUIBRYM.1 size=1048576 2024-09-19T13:47:23.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.861+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~RPW5VMUIBRYM.2 size=456723 2024-09-19T13:47:23.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.861+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=RPW5VMUIBRYM tag=0T8SV53IEQ3M type=write size=3602451 2024-09-19T13:47:23.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.865+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~FPPF1JX4FF4U.0 size=1048576 2024-09-19T13:47:23.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.865+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~FPPF1JX4FF4U.1 size=1048576 2024-09-19T13:47:23.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.869+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~FPPF1JX4FF4U.2 size=702260 2024-09-19T13:47:23.877 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.873+0000 7fcf3240c8c0 1 < completed multipart upload key=6DFF2OCPT9W2 upload=FPPF1JX4FF4U tag=1QC8NWO5MXG3 type=write size=3847988 2024-09-19T13:47:23.880 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.877+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=S0ZL1CW5KBJA type=del size=2142723 2024-09-19T13:47:23.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.881+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~0182W60Y3J58.0 size=1048576 2024-09-19T13:47:23.885 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.881+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~0182W60Y3J58.1 size=1048576 2024-09-19T13:47:23.887 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.885+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~0182W60Y3J58.2 size=441849 2024-09-19T13:47:23.892 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.889+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=0182W60Y3J58 tag=DCJ4LVO5RXS0 type=write size=3587577 2024-09-19T13:47:23.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.893+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0U9BUX9DHTAK.2~UHXZ7AQ40WR7.0 size=356244 2024-09-19T13:47:23.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.893+0000 7fcf3240c8c0 1 > prepared multipart upload key=0U9BUX9DHTAK upload=UHXZ7AQ40WR7 tag=LD0CM41ZB3HH type=write size=1404820 2024-09-19T13:47:23.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.901+0000 7fcf3240c8c0 1 < suggested remove operation key=BXUPV5XSJBTH tag=WE9M1FXJMMY8 type=del 2024-09-19T13:47:23.907 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.905+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~74VLS06Q4KZR.0 size=838690 2024-09-19T13:47:23.907 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.905+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=74VLS06Q4KZR tag=6QYUNDW95VT6 type=write size=1887266 2024-09-19T13:47:23.909 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.905+0000 7fcf3240c8c0 1 < completed delete operation key=D20C6C2ZFX1W tag=3WAHASBVOBLX type=del 2024-09-19T13:47:23.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.909+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=VA7O9LPCI67U type=del size=873819 2024-09-19T13:47:23.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.913+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~N3VGAV3KRZXA.0 size=947731 2024-09-19T13:47:23.919 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.917+0000 7fcf3240c8c0 1 < completed multipart upload key=M2CO4A2DHJ05 upload=N3VGAV3KRZXA tag=YMBL1EV6D1X1 type=write size=1996307 2024-09-19T13:47:23.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.921+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~MXJO0NB6U1O6.0 size=1048576 2024-09-19T13:47:23.926 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.925+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~MXJO0NB6U1O6.1 size=1048576 2024-09-19T13:47:23.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.925+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~MXJO0NB6U1O6.2 size=78194 2024-09-19T13:47:23.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.925+0000 7fcf3240c8c0 1 > prepared multipart upload key=D1RMXGXS3O7Z upload=MXJO0NB6U1O6 tag=CIQVRFB5AJJF type=write size=3223922 2024-09-19T13:47:23.933 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.929+0000 7fcf3240c8c0 1 < completed delete operation key=0U9BUX9DHTAK tag=V9USAZIS8HA3 type=del 2024-09-19T13:47:23.939 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.937+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~BJ88G7Q2A4FJ.0 size=1048576 2024-09-19T13:47:23.941 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.937+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~BJ88G7Q2A4FJ.1 size=1048576 2024-09-19T13:47:23.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.941+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~BJ88G7Q2A4FJ.2 size=1026575 2024-09-19T13:47:23.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.941+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=BJ88G7Q2A4FJ tag=TKBY675UZXI8 type=write size=4172303 2024-09-19T13:47:23.950 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.949+0000 7fcf3240c8c0 1 < suggested update operation key=3TME221SA53E tag=P2GSA5WPL01S type=del size=3711731 2024-09-19T13:47:23.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.949+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=5D0XAP1CAEK2 type=del size=2135170 2024-09-19T13:47:23.956 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.953+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~U5VS5Y20P7AA.0 size=1048576 2024-09-19T13:47:23.959 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.957+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~U5VS5Y20P7AA.1 size=1021907 2024-09-19T13:47:23.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.961+0000 7fcf3240c8c0 1 < completed multipart upload key=6DFF2OCPT9W2 upload=U5VS5Y20P7AA tag=EWD0VRT6YOXJ type=write size=3119059 2024-09-19T13:47:23.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.965+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=1PF56UEZTM84 type=del size=3469594 2024-09-19T13:47:23.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.969+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~W26Z38KLC86W.0 size=1048576 2024-09-19T13:47:23.974 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.973+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~W26Z38KLC86W.1 size=1048576 2024-09-19T13:47:23.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.973+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~W26Z38KLC86W.2 size=797917 2024-09-19T13:47:23.981 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.977+0000 7fcf3240c8c0 1 < completed multipart upload key=AES54TJK7VH7 upload=W26Z38KLC86W tag=PVX5NRNMZPLV type=write size=3943645 2024-09-19T13:47:23.987 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.985+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~QPEQOWLT32Z1.0 size=1048576 2024-09-19T13:47:23.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.985+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~QPEQOWLT32Z1.1 size=709751 2024-09-19T13:47:23.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.985+0000 7fcf3240c8c0 1 > prepared multipart upload key=A02RDP6BA9AC upload=QPEQOWLT32Z1 tag=71MJ9UIUM1DZ type=write size=2806903 2024-09-19T13:47:23.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.989+0000 7fcf3240c8c0 -1 < failed to complete operation key=BXUPV5XSJBTH tag=KWXR0L8JS3QO type=del size=142974: (22) Invalid argument 2024-09-19T13:47:23.998 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.993+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~GRVVBXRELFK4.0 size=1048576 2024-09-19T13:47:24.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.997+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~GRVVBXRELFK4.1 size=549214 2024-09-19T13:47:24.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:23.997+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=GRVVBXRELFK4 tag=Z6B5D515H8JQ type=write size=2646366 2024-09-19T13:47:24.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.001+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~01R595QGPS19.0 size=1048576 2024-09-19T13:47:24.005 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.001+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~01R595QGPS19.1 size=10283 2024-09-19T13:47:24.009 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.005+0000 7fcf3240c8c0 1 < completed multipart upload key=XE42LV5M5X82 upload=01R595QGPS19 tag=HT1J2MSLWOS2 type=write size=2107435 2024-09-19T13:47:24.012 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.009+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=WXYJGDEUPTKN type=del size=898419 2024-09-19T13:47:24.012 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.009+0000 7fcf3240c8c0 1 < canceled part key=_multipart_D20C6C2ZFX1W.2~9OUWMAAKET7C.0 size=1048576 2024-09-19T13:47:24.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.013+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~9OUWMAAKET7C.1 size=1048576 2024-09-19T13:47:24.017 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.013+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~9OUWMAAKET7C.2 size=824981 2024-09-19T13:47:24.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.017+0000 7fcf3240c8c0 1 < canceled multipart upload key=D20C6C2ZFX1W upload=9OUWMAAKET7C tag=9INNXFFMR5V6 type=write size=3970709 2024-09-19T13:47:24.026 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.021+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~0030J9AG5Q9V.0 size=1048576 2024-09-19T13:47:24.028 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.025+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~0030J9AG5Q9V.1 size=1048576 2024-09-19T13:47:24.030 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.029+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~0030J9AG5Q9V.2 size=604543 2024-09-19T13:47:24.031 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.029+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=0030J9AG5Q9V tag=BBA0R0LHBEDU type=write size=3750271 2024-09-19T13:47:24.033 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.029+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~ETERELYB01EB.0 size=1048576 2024-09-19T13:47:24.035 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.033+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~ETERELYB01EB.1 size=1048576 2024-09-19T13:47:24.038 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.033+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~ETERELYB01EB.2 size=28901 2024-09-19T13:47:24.042 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.037+0000 7fcf3240c8c0 1 < completed multipart upload key=M2CO4A2DHJ05 upload=ETERELYB01EB tag=DVL8ILR5PPXG type=write size=3174629 2024-09-19T13:47:24.045 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.041+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=QSEJ7HVUK1MC type=del size=278821 2024-09-19T13:47:24.048 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.045+0000 7fcf3240c8c0 1 < canceled operation key=9ICCISYXT0IV tag=OI41GVYTK4YS type=write size=668074 2024-09-19T13:47:24.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.049+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~HSRAV4L44K6Y.0 size=1048576 2024-09-19T13:47:24.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.053+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~HSRAV4L44K6Y.1 size=1048576 2024-09-19T13:47:24.057 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.053+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~HSRAV4L44K6Y.2 size=853242 2024-09-19T13:47:24.057 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.053+0000 7fcf3240c8c0 1 > prepared multipart upload key=C8T6DB9V9FBT upload=HSRAV4L44K6Y tag=Z3O9YLDYGM3J type=write size=3998970 2024-09-19T13:47:24.061 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.057+0000 7fcf3240c8c0 1 < completed delete operation key=XE42LV5M5X82 tag=ELNVT5TJ4USF type=del 2024-09-19T13:47:24.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.061+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~W31ME6ACMYX9.0 size=1048576 2024-09-19T13:47:24.068 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.065+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~W31ME6ACMYX9.1 size=1048576 2024-09-19T13:47:24.070 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.065+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~W31ME6ACMYX9.2 size=156513 2024-09-19T13:47:24.070 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.065+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=W31ME6ACMYX9 tag=33CD07A62CDJ type=write size=3302241 2024-09-19T13:47:24.073 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.069+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~RPW5VMUIBRYM.0 size=1048576 2024-09-19T13:47:24.075 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.073+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~RPW5VMUIBRYM.1 size=1048576 2024-09-19T13:47:24.078 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.073+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~RPW5VMUIBRYM.2 size=456723 2024-09-19T13:47:24.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.081+0000 7fcf3240c8c0 1 < completed multipart upload key=QSM2Q8CW1Q86 upload=RPW5VMUIBRYM tag=0T8SV53IEQ3M type=write size=3602451 2024-09-19T13:47:24.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.085+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=IVBNNLX0NB6H type=del size=49039 2024-09-19T13:47:24.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.093+0000 7fcf3240c8c0 1 < suggested update operation key=QAYJ5B1KZ08J tag=S0ZL1CW5KBJA type=del size=2142723 2024-09-19T13:47:24.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.093+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=T014QK6HEURM type=del size=65890 2024-09-19T13:47:24.101 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.097+0000 7fcf3240c8c0 1 < completed part key=_multipart_0U9BUX9DHTAK.2~UHXZ7AQ40WR7.0 size=356244 2024-09-19T13:47:24.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.105+0000 7fcf3240c8c0 1 < completed multipart upload key=0U9BUX9DHTAK upload=UHXZ7AQ40WR7 tag=LD0CM41ZB3HH type=write size=1404820 2024-09-19T13:47:24.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.109+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~9T2XP012Q6D1.0 size=1048576 2024-09-19T13:47:24.116 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.113+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~9T2XP012Q6D1.1 size=1048576 2024-09-19T13:47:24.118 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.117+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~9T2XP012Q6D1.2 size=271235 2024-09-19T13:47:24.119 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.117+0000 7fcf3240c8c0 1 > prepared multipart upload key=71Z2VTW99W7J upload=9T2XP012Q6D1 tag=862W7TALFWJA type=write size=3416963 2024-09-19T13:47:24.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.117+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~74VLS06Q4KZR.0 size=838690 2024-09-19T13:47:24.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.125+0000 7fcf3240c8c0 1 < completed multipart upload key=N51Q6HKJSCCB upload=74VLS06Q4KZR tag=6QYUNDW95VT6 type=write size=1887266 2024-09-19T13:47:24.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.129+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~ZFV26GSI6MY2.0 size=334720 2024-09-19T13:47:24.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.129+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=ZFV26GSI6MY2 tag=2Q5ALRYPVDWP type=write size=1383296 2024-09-19T13:47:24.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.137+0000 7fcf3240c8c0 1 < suggested update operation key=OA9BMSXGYR9T tag=VA7O9LPCI67U type=del size=873819 2024-09-19T13:47:24.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.141+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0U9BUX9DHTAK.2~0C996V6HF8W5.0 size=666157 2024-09-19T13:47:24.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.141+0000 7fcf3240c8c0 1 > prepared multipart upload key=0U9BUX9DHTAK upload=0C996V6HF8W5 tag=0Z0RQZGK89BK type=write size=1714733 2024-09-19T13:47:24.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.145+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~MXJO0NB6U1O6.0 size=1048576 2024-09-19T13:47:24.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.149+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~MXJO0NB6U1O6.1 size=1048576 2024-09-19T13:47:24.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.153+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~MXJO0NB6U1O6.2 size=78194 2024-09-19T13:47:24.160 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.157+0000 7fcf3240c8c0 1 < completed multipart upload key=D1RMXGXS3O7Z upload=MXJO0NB6U1O6 tag=CIQVRFB5AJJF type=write size=3223922 2024-09-19T13:47:24.166 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.161+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~333JFXMZ61G9.0 size=1048576 2024-09-19T13:47:24.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.165+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~333JFXMZ61G9.1 size=1048576 2024-09-19T13:47:24.171 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.169+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~333JFXMZ61G9.2 size=269772 2024-09-19T13:47:24.171 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.169+0000 7fcf3240c8c0 1 > prepared multipart upload key=1BMF3S2BZLLI upload=333JFXMZ61G9 tag=P04VMFJDQJL2 type=write size=3415500 2024-09-19T13:47:24.174 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.169+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~BJ88G7Q2A4FJ.0 size=1048576 2024-09-19T13:47:24.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.173+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~BJ88G7Q2A4FJ.1 size=1048576 2024-09-19T13:47:24.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.177+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~BJ88G7Q2A4FJ.2 size=1026575 2024-09-19T13:47:24.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.181+0000 7fcf3240c8c0 1 < completed multipart upload key=QSM2Q8CW1Q86 upload=BJ88G7Q2A4FJ tag=TKBY675UZXI8 type=write size=4172303 2024-09-19T13:47:24.188 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.185+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=EZ2551GTNFER type=del size=3813569 2024-09-19T13:47:24.191 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.189+0000 7fcf3240c8c0 1 < completed delete operation key=71Z2VTW99W7J tag=5D0XAP1CAEK2 type=del 2024-09-19T13:47:24.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.193+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=N488UJLK7E7D type=del size=2659719 2024-09-19T13:47:24.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.193+0000 7fcf3240c8c0 1 < completed delete operation key=3TME221SA53E tag=1PF56UEZTM84 type=del 2024-09-19T13:47:24.204 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.201+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~YZWKIQTXLF2T.0 size=597754 2024-09-19T13:47:24.204 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.201+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=YZWKIQTXLF2T tag=IVXM6T32KBA5 type=write size=1646330 2024-09-19T13:47:24.207 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.205+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~QPEQOWLT32Z1.0 size=1048576 2024-09-19T13:47:24.209 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.205+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~QPEQOWLT32Z1.1 size=709751 2024-09-19T13:47:24.216 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.213+0000 7fcf3240c8c0 1 < completed multipart upload key=A02RDP6BA9AC upload=QPEQOWLT32Z1 tag=71MJ9UIUM1DZ type=write size=2806903 2024-09-19T13:47:24.222 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.217+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~JR2MJ15GH47V.0 size=1048576 2024-09-19T13:47:24.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.221+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~JR2MJ15GH47V.1 size=446072 2024-09-19T13:47:24.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.221+0000 7fcf3240c8c0 1 > prepared multipart upload key=C8T6DB9V9FBT upload=JR2MJ15GH47V tag=TJWV64AA671G type=write size=2543224 2024-09-19T13:47:24.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.221+0000 7fcf3240c8c0 1 < canceled part key=_multipart_7UC85R2HO9K2.2~GRVVBXRELFK4.0 size=1048576 2024-09-19T13:47:24.227 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.225+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~GRVVBXRELFK4.1 size=549214 2024-09-19T13:47:24.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.229+0000 7fcf3240c8c0 1 < canceled multipart upload key=7UC85R2HO9K2 upload=GRVVBXRELFK4 tag=Z6B5D515H8JQ type=write size=2646366 2024-09-19T13:47:24.238 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.233+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~IVJW67XSPTEW.0 size=1048576 2024-09-19T13:47:24.241 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.237+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~IVJW67XSPTEW.1 size=1048576 2024-09-19T13:47:24.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.241+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~IVJW67XSPTEW.2 size=785726 2024-09-19T13:47:24.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.241+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=IVJW67XSPTEW tag=WJBIRQGH069T type=write size=3931454 2024-09-19T13:47:24.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.245+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=WXYJGDEUPTKN type=del 2024-09-19T13:47:24.255 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.253+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~KRNE0PRLNQE1.0 size=1048576 2024-09-19T13:47:24.257 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.253+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~KRNE0PRLNQE1.1 size=803689 2024-09-19T13:47:24.257 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.253+0000 7fcf3240c8c0 1 > prepared multipart upload key=X9FGPMP30X47 upload=KRNE0PRLNQE1 tag=MGK46PBPEWP2 type=write size=2900841 2024-09-19T13:47:24.260 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.257+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~0030J9AG5Q9V.0 size=1048576 2024-09-19T13:47:24.263 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.261+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~0030J9AG5Q9V.1 size=1048576 2024-09-19T13:47:24.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.261+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~0030J9AG5Q9V.2 size=604543 2024-09-19T13:47:24.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.269+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=0030J9AG5Q9V tag=BBA0R0LHBEDU type=write size=3750271 2024-09-19T13:47:24.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.269+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=QB5A1CJPWJWW type=write size=636564 2024-09-19T13:47:24.276 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.273+0000 7fcf3240c8c0 1 < completed delete operation key=6DFF2OCPT9W2 tag=QSEJ7HVUK1MC type=del 2024-09-19T13:47:24.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.277+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~AAABGVZEWR5G.0 size=1048576 2024-09-19T13:47:24.284 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.281+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~AAABGVZEWR5G.1 size=628216 2024-09-19T13:47:24.284 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.281+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=AAABGVZEWR5G tag=RIJP41KCFQUR type=write size=2725368 2024-09-19T13:47:24.287 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.285+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~HSRAV4L44K6Y.0 size=1048576 2024-09-19T13:47:24.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.285+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~HSRAV4L44K6Y.1 size=1048576 2024-09-19T13:47:24.291 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.289+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~HSRAV4L44K6Y.2 size=853242 2024-09-19T13:47:24.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.293+0000 7fcf3240c8c0 1 < completed multipart upload key=C8T6DB9V9FBT upload=HSRAV4L44K6Y tag=Z3O9YLDYGM3J type=write size=3998970 2024-09-19T13:47:24.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.297+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=P3MWB9ZBNIR0 type=del size=513703 2024-09-19T13:47:24.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.297+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~W31ME6ACMYX9.0 size=1048576 2024-09-19T13:47:24.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.301+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~W31ME6ACMYX9.1 size=1048576 2024-09-19T13:47:24.305 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.301+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~W31ME6ACMYX9.2 size=156513 2024-09-19T13:47:24.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.305+0000 7fcf3240c8c0 1 < completed multipart upload key=ES62XJO5Q3FO upload=W31ME6ACMYX9 tag=33CD07A62CDJ type=write size=3302241 2024-09-19T13:47:24.314 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.309+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~B1EPVF80Q1G5.0 size=1048576 2024-09-19T13:47:24.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.313+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~B1EPVF80Q1G5.1 size=504485 2024-09-19T13:47:24.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.313+0000 7fcf3240c8c0 1 > prepared multipart upload key=71Z2VTW99W7J upload=B1EPVF80Q1G5 tag=D0CO3TZLTCE1 type=write size=2601637 2024-09-19T13:47:24.318 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.317+0000 7fcf3240c8c0 1 < completed delete operation key=X9FGPMP30X47 tag=IVBNNLX0NB6H type=del 2024-09-19T13:47:24.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.321+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~6CDMW1WRKGSI.0 size=988798 2024-09-19T13:47:24.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.321+0000 7fcf3240c8c0 1 > prepared multipart upload key=X16ENUFL40RN upload=6CDMW1WRKGSI tag=XTRV4614REFG type=write size=2037374 2024-09-19T13:47:24.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.321+0000 7fcf3240c8c0 1 < canceled operation key=V8X0VBBNK83J tag=T014QK6HEURM type=del size=65890 2024-09-19T13:47:24.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.325+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=O3RLJ2X2979E type=write size=855225 2024-09-19T13:47:24.331 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.329+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~9T2XP012Q6D1.0 size=1048576 2024-09-19T13:47:24.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.329+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~9T2XP012Q6D1.1 size=1048576 2024-09-19T13:47:24.336 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.333+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~9T2XP012Q6D1.2 size=271235 2024-09-19T13:47:24.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.337+0000 7fcf3240c8c0 1 < completed multipart upload key=71Z2VTW99W7J upload=9T2XP012Q6D1 tag=862W7TALFWJA type=write size=3416963 2024-09-19T13:47:24.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.341+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=QHCYFNI6O0K1 type=del size=3029834 2024-09-19T13:47:24.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.345+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~ZFV26GSI6MY2.0 size=334720 2024-09-19T13:47:24.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.349+0000 7fcf3240c8c0 1 < completed multipart upload key=D20C6C2ZFX1W upload=ZFV26GSI6MY2 tag=2Q5ALRYPVDWP type=write size=1383296 2024-09-19T13:47:24.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.353+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~LNNE6UKFXF8H.0 size=1048576 2024-09-19T13:47:24.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.357+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~LNNE6UKFXF8H.1 size=1048576 2024-09-19T13:47:24.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.357+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~LNNE6UKFXF8H.2 size=31332 2024-09-19T13:47:24.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.357+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=LNNE6UKFXF8H tag=0T1C3KZWI4YX type=write size=3177060 2024-09-19T13:47:24.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.361+0000 7fcf3240c8c0 1 < completed part key=_multipart_0U9BUX9DHTAK.2~0C996V6HF8W5.0 size=666157 2024-09-19T13:47:24.370 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.365+0000 7fcf3240c8c0 1 < completed multipart upload key=0U9BUX9DHTAK upload=0C996V6HF8W5 tag=0Z0RQZGK89BK type=write size=1714733 2024-09-19T13:47:24.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.369+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=L38K2V4386N2 type=del size=320916 2024-09-19T13:47:24.377 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.373+0000 7fcf3240c8c0 1 < completed part key=_multipart_1BMF3S2BZLLI.2~333JFXMZ61G9.0 size=1048576 2024-09-19T13:47:24.379 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.377+0000 7fcf3240c8c0 1 < completed part key=_multipart_1BMF3S2BZLLI.2~333JFXMZ61G9.1 size=1048576 2024-09-19T13:47:24.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.377+0000 7fcf3240c8c0 1 < completed part key=_multipart_1BMF3S2BZLLI.2~333JFXMZ61G9.2 size=269772 2024-09-19T13:47:24.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.381+0000 7fcf3240c8c0 1 < completed multipart upload key=1BMF3S2BZLLI upload=333JFXMZ61G9 tag=P04VMFJDQJL2 type=write size=3415500 2024-09-19T13:47:24.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.385+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=RZGMYIZGW8UN type=del size=2033925 2024-09-19T13:47:24.397 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.393+0000 7fcf3240c8c0 1 < suggested remove operation key=QSM2Q8CW1Q86 tag=EZ2551GTNFER type=del 2024-09-19T13:47:24.403 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.401+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~DLWD5A3GA36M.0 size=938810 2024-09-19T13:47:24.403 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.401+0000 7fcf3240c8c0 1 > prepared multipart upload key=1BMF3S2BZLLI upload=DLWD5A3GA36M tag=FTHVWMRGQWSU type=write size=1987386 2024-09-19T13:47:24.406 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.401+0000 7fcf3240c8c0 1 < canceled operation key=7UC85R2HO9K2 tag=N488UJLK7E7D type=del size=2659719 2024-09-19T13:47:24.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.405+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=JBRZZQ6LWMBD type=del size=3157162 2024-09-19T13:47:24.413 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.409+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~YZWKIQTXLF2T.0 size=597754 2024-09-19T13:47:24.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.413+0000 7fcf3240c8c0 1 < completed multipart upload key=0UCFTOF1YBBM upload=YZWKIQTXLF2T tag=IVXM6T32KBA5 type=write size=1646330 2024-09-19T13:47:24.423 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.421+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~O2XTMQXFO85R.0 size=1048576 2024-09-19T13:47:24.425 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.421+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~O2XTMQXFO85R.1 size=1048576 2024-09-19T13:47:24.428 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.425+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~O2XTMQXFO85R.2 size=300942 2024-09-19T13:47:24.428 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.425+0000 7fcf3240c8c0 1 > prepared multipart upload key=C3TFYNXH549T upload=O2XTMQXFO85R tag=70VKXZ2AMOU2 type=write size=3446670 2024-09-19T13:47:24.431 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.429+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~JR2MJ15GH47V.0 size=1048576 2024-09-19T13:47:24.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.429+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~JR2MJ15GH47V.1 size=446072 2024-09-19T13:47:24.438 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.433+0000 7fcf3240c8c0 1 < completed multipart upload key=C8T6DB9V9FBT upload=JR2MJ15GH47V tag=TJWV64AA671G type=write size=2543224 2024-09-19T13:47:24.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.437+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=PF6PD4H2X968 type=del size=2773265 2024-09-19T13:47:24.442 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.437+0000 7fcf3240c8c0 1 < canceled part key=_multipart_D20C6C2ZFX1W.2~IVJW67XSPTEW.0 size=1048576 2024-09-19T13:47:24.444 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.441+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~IVJW67XSPTEW.1 size=1048576 2024-09-19T13:47:24.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.445+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~IVJW67XSPTEW.2 size=785726 2024-09-19T13:47:24.451 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.449+0000 7fcf3240c8c0 1 < canceled multipart upload key=D20C6C2ZFX1W upload=IVJW67XSPTEW tag=WJBIRQGH069T type=write size=3931454 2024-09-19T13:47:24.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.449+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=IF9I5ZI3STZ2 type=del size=283562 2024-09-19T13:47:24.455 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.453+0000 7fcf3240c8c0 1 < canceled part key=_multipart_X9FGPMP30X47.2~KRNE0PRLNQE1.0 size=1048576 2024-09-19T13:47:24.457 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.453+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~KRNE0PRLNQE1.1 size=803689 2024-09-19T13:47:24.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.461+0000 7fcf3240c8c0 1 < canceled multipart upload key=X9FGPMP30X47 upload=KRNE0PRLNQE1 tag=MGK46PBPEWP2 type=write size=2900841 2024-09-19T13:47:24.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.461+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=QBZZS1T8EBV9 type=del size=1028267 2024-09-19T13:47:24.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.465+0000 7fcf3240c8c0 1 < completed write operation key=AES54TJK7VH7 tag=QB5A1CJPWJWW type=write size=636564 2024-09-19T13:47:24.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.469+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~JBAMMS42COGU.0 size=1048576 2024-09-19T13:47:24.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.473+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~JBAMMS42COGU.1 size=1048576 2024-09-19T13:47:24.479 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.477+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~JBAMMS42COGU.2 size=306274 2024-09-19T13:47:24.479 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.477+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=JBAMMS42COGU tag=373H0LU0EX9J type=write size=3452002 2024-09-19T13:47:24.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.477+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~AAABGVZEWR5G.0 size=1048576 2024-09-19T13:47:24.485 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.481+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~AAABGVZEWR5G.1 size=628216 2024-09-19T13:47:24.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.485+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=AAABGVZEWR5G tag=RIJP41KCFQUR type=write size=2725368 2024-09-19T13:47:24.492 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.489+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=MHVJMDJ2MXC2 type=del size=477499 2024-09-19T13:47:24.496 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.493+0000 7fcf3240c8c0 1 < completed delete operation key=C3TFYNXH549T tag=P3MWB9ZBNIR0 type=del 2024-09-19T13:47:24.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.497+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=OYGTO92Z8QMK type=write size=567516 2024-09-19T13:47:24.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.501+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~B1EPVF80Q1G5.0 size=1048576 2024-09-19T13:47:24.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.501+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~B1EPVF80Q1G5.1 size=504485 2024-09-19T13:47:24.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.509+0000 7fcf3240c8c0 1 < completed multipart upload key=71Z2VTW99W7J upload=B1EPVF80Q1G5 tag=D0CO3TZLTCE1 type=write size=2601637 2024-09-19T13:47:24.517 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.513+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=5LL9W8VIUPCU type=del size=1887479 2024-09-19T13:47:24.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.517+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~6CDMW1WRKGSI.0 size=988798 2024-09-19T13:47:24.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.521+0000 7fcf3240c8c0 1 < completed multipart upload key=X16ENUFL40RN upload=6CDMW1WRKGSI tag=XTRV4614REFG type=write size=2037374 2024-09-19T13:47:24.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.525+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=LSN5IYV412W7 type=write size=687301 2024-09-19T13:47:24.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.529+0000 7fcf3240c8c0 1 < completed write operation key=XE42LV5M5X82 tag=O3RLJ2X2979E type=write size=855225 2024-09-19T13:47:24.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.533+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=DM5SLQVS1BP9 type=del size=2245481 2024-09-19T13:47:24.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.541+0000 7fcf3240c8c0 1 < suggested remove operation key=9ICCISYXT0IV tag=QHCYFNI6O0K1 type=del 2024-09-19T13:47:24.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.541+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=DGX101XFRG5L type=del size=4073421 2024-09-19T13:47:24.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.545+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~LNNE6UKFXF8H.0 size=1048576 2024-09-19T13:47:24.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.549+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~LNNE6UKFXF8H.1 size=1048576 2024-09-19T13:47:24.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.553+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~LNNE6UKFXF8H.2 size=31332 2024-09-19T13:47:24.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.557+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=LNNE6UKFXF8H tag=0T1C3KZWI4YX type=write size=3177060 2024-09-19T13:47:24.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.561+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=ZEVARHRTHUUO type=del size=3892418 2024-09-19T13:47:24.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.565+0000 7fcf3240c8c0 1 < completed delete operation key=0UCFTOF1YBBM tag=L38K2V4386N2 type=del 2024-09-19T13:47:24.574 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.569+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~0TDALK7EHR0T.0 size=1048576 2024-09-19T13:47:24.577 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.573+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~0TDALK7EHR0T.1 size=1048576 2024-09-19T13:47:24.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.577+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~0TDALK7EHR0T.2 size=532578 2024-09-19T13:47:24.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.577+0000 7fcf3240c8c0 1 > prepared multipart upload key=X9FGPMP30X47 upload=0TDALK7EHR0T tag=M6D0VVMW2W8P type=write size=3678306 2024-09-19T13:47:24.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.581+0000 7fcf3240c8c0 1 < completed delete operation key=ZCKKQ1R8318S tag=RZGMYIZGW8UN type=del 2024-09-19T13:47:24.587 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.585+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=FXF90VOHJMNB type=del size=401655 2024-09-19T13:47:24.592 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.589+0000 7fcf3240c8c0 1 < completed part key=_multipart_1BMF3S2BZLLI.2~DLWD5A3GA36M.0 size=938810 2024-09-19T13:47:24.598 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.593+0000 7fcf3240c8c0 1 < completed multipart upload key=1BMF3S2BZLLI upload=DLWD5A3GA36M tag=FTHVWMRGQWSU type=write size=1987386 2024-09-19T13:47:24.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.597+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=ESA0VBE9OTDS type=del size=431772 2024-09-19T13:47:24.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.601+0000 7fcf3240c8c0 1 < completed delete operation key=3TME221SA53E tag=JBRZZQ6LWMBD type=del 2024-09-19T13:47:24.608 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.605+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=RE0QIPJWSMWT type=del size=2656442 2024-09-19T13:47:24.611 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.609+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~O2XTMQXFO85R.0 size=1048576 2024-09-19T13:47:24.614 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.613+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~O2XTMQXFO85R.1 size=1048576 2024-09-19T13:47:24.617 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.613+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~O2XTMQXFO85R.2 size=300942 2024-09-19T13:47:24.623 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.621+0000 7fcf3240c8c0 1 < completed multipart upload key=C3TFYNXH549T upload=O2XTMQXFO85R tag=70VKXZ2AMOU2 type=write size=3446670 2024-09-19T13:47:24.626 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.621+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=OPEKLU1YZEHZ type=del size=1328438 2024-09-19T13:47:24.630 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.625+0000 7fcf3240c8c0 1 < completed delete operation key=X16ENUFL40RN tag=PF6PD4H2X968 type=del 2024-09-19T13:47:24.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.633+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~DT0XHPG3H91D.0 size=1048576 2024-09-19T13:47:24.651 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.645+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~DT0XHPG3H91D.1 size=1048576 2024-09-19T13:47:24.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.649+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~DT0XHPG3H91D.2 size=640491 2024-09-19T13:47:24.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.649+0000 7fcf3240c8c0 1 > prepared multipart upload key=OA9BMSXGYR9T upload=DT0XHPG3H91D tag=L8RGTN815NJX type=write size=3786219 2024-09-19T13:47:24.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.653+0000 7fcf3240c8c0 1 < suggested update operation key=DHPONKOVS8CT tag=IF9I5ZI3STZ2 type=del size=283562 2024-09-19T13:47:24.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.657+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=O40I8DUIB0DK type=del size=3946217 2024-09-19T13:47:24.664 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.661+0000 7fcf3240c8c0 1 < canceled operation key=NP2L28YRVQ8L tag=QBZZS1T8EBV9 type=del size=1028267 2024-09-19T13:47:24.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.665+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~0A5ETL4HY4ET.0 size=215121 2024-09-19T13:47:24.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.665+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=0A5ETL4HY4ET tag=G3HYD81T3MRU type=write size=1263697 2024-09-19T13:47:24.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.669+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~JBAMMS42COGU.0 size=1048576 2024-09-19T13:47:24.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.673+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~JBAMMS42COGU.1 size=1048576 2024-09-19T13:47:24.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.673+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~JBAMMS42COGU.2 size=306274 2024-09-19T13:47:24.681 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.677+0000 7fcf3240c8c0 1 < completed multipart upload key=0UCFTOF1YBBM upload=JBAMMS42COGU tag=373H0LU0EX9J type=write size=3452002 2024-09-19T13:47:24.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.681+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=LPL5OW7M8LRY type=write size=940140 2024-09-19T13:47:24.686 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.685+0000 7fcf3240c8c0 1 < completed delete operation key=C35EUAOWLBR3 tag=MHVJMDJ2MXC2 type=del 2024-09-19T13:47:24.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.685+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=4U2WOE2DUDK9 type=del size=1301895 2024-09-19T13:47:24.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.689+0000 7fcf3240c8c0 1 < completed write operation key=XE42LV5M5X82 tag=OYGTO92Z8QMK type=write size=567516 2024-09-19T13:47:24.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.693+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=XMWPEZ16OW0W type=del size=3108292 2024-09-19T13:47:24.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.693+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=5LL9W8VIUPCU type=del 2024-09-19T13:47:24.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.697+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=6KGUPM0KBJLW type=del size=2950198 2024-09-19T13:47:24.703 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.701+0000 7fcf3240c8c0 1 < completed write operation key=QSM2Q8CW1Q86 tag=LSN5IYV412W7 type=write size=687301 2024-09-19T13:47:24.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.705+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~3H8SCXB7NCIJ.0 size=1048576 2024-09-19T13:47:24.710 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.709+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~3H8SCXB7NCIJ.1 size=465366 2024-09-19T13:47:24.710 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.709+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=3H8SCXB7NCIJ tag=ZLANAF4QB47R type=write size=2562518 2024-09-19T13:47:24.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.713+0000 7fcf3240c8c0 1 < suggested remove operation key=6DFF2OCPT9W2 tag=DM5SLQVS1BP9 type=del 2024-09-19T13:47:24.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.717+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~3KT9HEMDNOY1.0 size=1048576 2024-09-19T13:47:24.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.721+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~3KT9HEMDNOY1.1 size=1048576 2024-09-19T13:47:24.725 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.721+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~3KT9HEMDNOY1.2 size=999789 2024-09-19T13:47:24.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.721+0000 7fcf3240c8c0 1 > prepared multipart upload key=3TME221SA53E upload=3KT9HEMDNOY1 tag=WFZ9RB52AVN5 type=write size=4145517 2024-09-19T13:47:24.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.725+0000 7fcf3240c8c0 1 < canceled operation key=X16ENUFL40RN tag=DGX101XFRG5L type=del size=4073421 2024-09-19T13:47:24.735 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.733+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~MWMO2D1707TC.0 size=1048576 2024-09-19T13:47:24.737 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.733+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~MWMO2D1707TC.1 size=1048576 2024-09-19T13:47:24.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.737+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~MWMO2D1707TC.2 size=103698 2024-09-19T13:47:24.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.737+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=MWMO2D1707TC tag=R5MHP5089WF6 type=write size=3249426 2024-09-19T13:47:24.743 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.741+0000 7fcf3240c8c0 1 < completed delete operation key=ZCKKQ1R8318S tag=ZEVARHRTHUUO type=del 2024-09-19T13:47:24.746 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.741+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=T7XOUZYGFNQ9 type=del size=1246841 2024-09-19T13:47:24.749 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.745+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~0TDALK7EHR0T.0 size=1048576 2024-09-19T13:47:24.752 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.749+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~0TDALK7EHR0T.1 size=1048576 2024-09-19T13:47:24.755 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.753+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~0TDALK7EHR0T.2 size=532578 2024-09-19T13:47:24.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.757+0000 7fcf3240c8c0 1 < completed multipart upload key=X9FGPMP30X47 upload=0TDALK7EHR0T tag=M6D0VVMW2W8P type=write size=3678306 2024-09-19T13:47:24.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.761+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=X3BLQSLCO82Y type=del size=1412841 2024-09-19T13:47:24.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.765+0000 7fcf3240c8c0 1 < completed delete operation key=0U9BUX9DHTAK tag=FXF90VOHJMNB type=del 2024-09-19T13:47:24.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.765+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=BKP62VRMIP3L type=del size=505469 2024-09-19T13:47:24.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.769+0000 7fcf3240c8c0 1 < completed delete operation key=X16ENUFL40RN tag=ESA0VBE9OTDS type=del 2024-09-19T13:47:24.779 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.777+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~RDNG7649LH8G.0 size=1048576 2024-09-19T13:47:24.781 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.777+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~RDNG7649LH8G.1 size=1048576 2024-09-19T13:47:24.784 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.781+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~RDNG7649LH8G.2 size=92487 2024-09-19T13:47:24.784 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.781+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=RDNG7649LH8G tag=ABIZNOJ4S9Y8 type=write size=3238215 2024-09-19T13:47:24.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.785+0000 7fcf3240c8c0 1 < completed delete operation key=C8T6DB9V9FBT tag=RE0QIPJWSMWT type=del 2024-09-19T13:47:24.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.789+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=ZSBOZ28KP1ZK type=write size=534594 2024-09-19T13:47:24.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.793+0000 7fcf3240c8c0 1 < completed delete operation key=7UC85R2HO9K2 tag=OPEKLU1YZEHZ type=del 2024-09-19T13:47:24.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.793+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=XA492AZNSGSO type=del size=1320469 2024-09-19T13:47:24.801 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.797+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~DT0XHPG3H91D.0 size=1048576 2024-09-19T13:47:24.804 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.801+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~DT0XHPG3H91D.1 size=1048576 2024-09-19T13:47:24.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.801+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~DT0XHPG3H91D.2 size=640491 2024-09-19T13:47:24.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.809+0000 7fcf3240c8c0 1 < completed multipart upload key=OA9BMSXGYR9T upload=DT0XHPG3H91D tag=L8RGTN815NJX type=write size=3786219 2024-09-19T13:47:24.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.809+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=I1RJIQ64X043 type=del size=2700269 2024-09-19T13:47:24.819 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.817+0000 7fcf3240c8c0 1 < suggested update operation key=QAYJ5B1KZ08J tag=O40I8DUIB0DK type=del size=3946217 2024-09-19T13:47:24.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.825+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~NTJV0SB6FOW4.0 size=376187 2024-09-19T13:47:24.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.825+0000 7fcf3240c8c0 1 > prepared multipart upload key=1BMF3S2BZLLI upload=NTJV0SB6FOW4 tag=HMMHEUW8FY2M type=write size=1424763 2024-09-19T13:47:24.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.825+0000 7fcf3240c8c0 1 < canceled part key=_multipart_HXMZKP7H3HJE.2~0A5ETL4HY4ET.0 size=215121 2024-09-19T13:47:24.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.829+0000 7fcf3240c8c0 1 < canceled multipart upload key=HXMZKP7H3HJE upload=0A5ETL4HY4ET tag=G3HYD81T3MRU type=write size=1263697 2024-09-19T13:47:24.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.833+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~M420X1F3Y5ZX.0 size=1048576 2024-09-19T13:47:24.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.837+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~M420X1F3Y5ZX.1 size=1048576 2024-09-19T13:47:24.842 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.837+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~M420X1F3Y5ZX.2 size=375990 2024-09-19T13:47:24.842 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.837+0000 7fcf3240c8c0 1 > prepared multipart upload key=OA9BMSXGYR9T upload=M420X1F3Y5ZX tag=53FP0L3VNLDG type=write size=3521718 2024-09-19T13:47:24.845 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.841+0000 7fcf3240c8c0 1 < completed write operation key=AES54TJK7VH7 tag=LPL5OW7M8LRY type=write size=940140 2024-09-19T13:47:24.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.845+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=5RV1GKDMVFGZ type=write size=71453 2024-09-19T13:47:24.851 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.849+0000 7fcf3240c8c0 1 < completed delete operation key=0U9BUX9DHTAK tag=4U2WOE2DUDK9 type=del 2024-09-19T13:47:24.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.853+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~68WUHGTYI6I0.0 size=1048576 2024-09-19T13:47:24.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.857+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~68WUHGTYI6I0.1 size=658603 2024-09-19T13:47:24.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.857+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=68WUHGTYI6I0 tag=GW3AA021PFIW type=write size=2755755 2024-09-19T13:47:24.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.861+0000 7fcf3240c8c0 1 < canceled operation key=XE42LV5M5X82 tag=XMWPEZ16OW0W type=del size=3108292 2024-09-19T13:47:24.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.865+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~YB3XDAS07LKL.0 size=1048576 2024-09-19T13:47:24.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.865+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~YB3XDAS07LKL.1 size=357438 2024-09-19T13:47:24.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.865+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=YB3XDAS07LKL tag=6B3HJ5AJ7OKU type=write size=2454590 2024-09-19T13:47:24.874 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.869+0000 7fcf3240c8c0 1 < completed delete operation key=HXMZKP7H3HJE tag=6KGUPM0KBJLW type=del 2024-09-19T13:47:24.877 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.873+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=ZRSXA2RL7S8R type=del size=301173 2024-09-19T13:47:24.880 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.877+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~3H8SCXB7NCIJ.0 size=1048576 2024-09-19T13:47:24.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.881+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~3H8SCXB7NCIJ.1 size=465366 2024-09-19T13:47:24.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.885+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=3H8SCXB7NCIJ tag=ZLANAF4QB47R type=write size=2562518 2024-09-19T13:47:24.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.889+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=MWZX00QF9NE2 type=del size=1576323 2024-09-19T13:47:24.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.893+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~3KT9HEMDNOY1.0 size=1048576 2024-09-19T13:47:24.899 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.897+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~3KT9HEMDNOY1.1 size=1048576 2024-09-19T13:47:24.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.897+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~3KT9HEMDNOY1.2 size=999789 2024-09-19T13:47:24.907 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.905+0000 7fcf3240c8c0 1 < completed multipart upload key=3TME221SA53E upload=3KT9HEMDNOY1 tag=WFZ9RB52AVN5 type=write size=4145517 2024-09-19T13:47:24.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.909+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~MUYVQFITV0KH.0 size=1048576 2024-09-19T13:47:24.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.913+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~MUYVQFITV0KH.1 size=125863 2024-09-19T13:47:24.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.913+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=MUYVQFITV0KH tag=8M4BF6THQ0AT type=write size=2223015 2024-09-19T13:47:24.918 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.917+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~MWMO2D1707TC.0 size=1048576 2024-09-19T13:47:24.920 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.917+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~MWMO2D1707TC.1 size=1048576 2024-09-19T13:47:24.923 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.921+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~MWMO2D1707TC.2 size=103698 2024-09-19T13:47:24.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.925+0000 7fcf3240c8c0 1 < completed multipart upload key=D20C6C2ZFX1W upload=MWMO2D1707TC tag=R5MHP5089WF6 type=write size=3249426 2024-09-19T13:47:24.933 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.929+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=HGB3IBYWTCQQ type=del size=391232 2024-09-19T13:47:24.936 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.933+0000 7fcf3240c8c0 1 < completed delete operation key=BXUPV5XSJBTH tag=T7XOUZYGFNQ9 type=del 2024-09-19T13:47:24.939 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.937+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=AB6E323YAP1J type=write size=48421 2024-09-19T13:47:24.942 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.941+0000 7fcf3240c8c0 1 < completed delete operation key=M2CO4A2DHJ05 tag=X3BLQSLCO82Y type=del 2024-09-19T13:47:24.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.941+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=OIH9BLH8J7P7 type=del size=2476109 2024-09-19T13:47:24.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.945+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=BKP62VRMIP3L type=del 2024-09-19T13:47:24.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.949+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=2BG9C9WOBTZQ type=del size=622192 2024-09-19T13:47:24.956 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.953+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~RDNG7649LH8G.0 size=1048576 2024-09-19T13:47:24.958 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.957+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~RDNG7649LH8G.1 size=1048576 2024-09-19T13:47:24.958 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.957+0000 7fcf3240c8c0 1 < canceled part key=_multipart_NP2L28YRVQ8L.2~RDNG7649LH8G.2 size=92487 2024-09-19T13:47:24.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.961+0000 7fcf3240c8c0 1 < canceled multipart upload key=NP2L28YRVQ8L upload=RDNG7649LH8G tag=ABIZNOJ4S9Y8 type=write size=3238215 2024-09-19T13:47:24.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.965+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~0LWP45C76NJS.0 size=1048576 2024-09-19T13:47:24.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.969+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~0LWP45C76NJS.1 size=585379 2024-09-19T13:47:24.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.969+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=0LWP45C76NJS tag=IFQZPSMEEJA6 type=write size=2682531 2024-09-19T13:47:24.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.977+0000 7fcf3240c8c0 1 < suggested update operation key=QMSDNKYFFK1F tag=ZSBOZ28KP1ZK type=write size=534594 2024-09-19T13:47:24.982 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.977+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=RWD910M967EN type=del size=827053 2024-09-19T13:47:24.985 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.981+0000 7fcf3240c8c0 1 < completed delete operation key=D20C6C2ZFX1W tag=XA492AZNSGSO type=del 2024-09-19T13:47:24.988 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.985+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=IEA8V7S2E85Q type=del size=2524502 2024-09-19T13:47:24.995 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.993+0000 7fcf3240c8c0 1 < suggested update operation key=3TME221SA53E tag=I1RJIQ64X043 type=del size=2700269 2024-09-19T13:47:24.998 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.993+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=J9P1VW5BQRWO type=del size=678900 2024-09-19T13:47:25.001 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:24.997+0000 7fcf3240c8c0 1 < completed part key=_multipart_1BMF3S2BZLLI.2~NTJV0SB6FOW4.0 size=376187 2024-09-19T13:47:25.007 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.005+0000 7fcf3240c8c0 1 < completed multipart upload key=1BMF3S2BZLLI upload=NTJV0SB6FOW4 tag=HMMHEUW8FY2M type=write size=1424763 2024-09-19T13:47:25.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.009+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=JBLHKMLA575S type=del size=1955079 2024-09-19T13:47:25.014 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.009+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~M420X1F3Y5ZX.0 size=1048576 2024-09-19T13:47:25.016 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.013+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~M420X1F3Y5ZX.1 size=1048576 2024-09-19T13:47:25.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.017+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~M420X1F3Y5ZX.2 size=375990 2024-09-19T13:47:25.025 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.021+0000 7fcf3240c8c0 1 < completed multipart upload key=OA9BMSXGYR9T upload=M420X1F3Y5ZX tag=53FP0L3VNLDG type=write size=3521718 2024-09-19T13:47:25.029 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.025+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=I8ET1B3R3I1Q type=write size=552776 2024-09-19T13:47:25.032 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.029+0000 7fcf3240c8c0 1 < completed write operation key=D1RMXGXS3O7Z tag=5RV1GKDMVFGZ type=write size=71453 2024-09-19T13:47:25.038 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.037+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~H69VIOCKIJ2L.0 size=1048576 2024-09-19T13:47:25.041 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.037+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~H69VIOCKIJ2L.1 size=616384 2024-09-19T13:47:25.041 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.037+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=H69VIOCKIJ2L tag=07A2R6RBDMGX type=write size=2713536 2024-09-19T13:47:25.045 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.041+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~68WUHGTYI6I0.0 size=1048576 2024-09-19T13:47:25.048 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.045+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~68WUHGTYI6I0.1 size=658603 2024-09-19T13:47:25.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.049+0000 7fcf3240c8c0 1 < completed multipart upload key=0UCFTOF1YBBM upload=68WUHGTYI6I0 tag=GW3AA021PFIW type=write size=2755755 2024-09-19T13:47:25.060 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.057+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~8XIEWV0Q8VHK.0 size=1048576 2024-09-19T13:47:25.062 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.061+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~8XIEWV0Q8VHK.1 size=1036838 2024-09-19T13:47:25.062 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.061+0000 7fcf3240c8c0 1 > prepared multipart upload key=6DFF2OCPT9W2 upload=8XIEWV0Q8VHK tag=DUT61DBW732N type=write size=3133990 2024-09-19T13:47:25.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.061+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~YB3XDAS07LKL.0 size=1048576 2024-09-19T13:47:25.068 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.065+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~YB3XDAS07LKL.1 size=357438 2024-09-19T13:47:25.074 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.069+0000 7fcf3240c8c0 1 < completed multipart upload key=ES62XJO5Q3FO upload=YB3XDAS07LKL tag=6B3HJ5AJ7OKU type=write size=2454590 2024-09-19T13:47:25.077 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.073+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=V09KKULCH1A1 type=del size=2663659 2024-09-19T13:47:25.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.077+0000 7fcf3240c8c0 1 < completed delete operation key=X9FGPMP30X47 tag=ZRSXA2RL7S8R type=del 2024-09-19T13:47:25.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.085+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~AG252COR84XN.0 size=1048576 2024-09-19T13:47:25.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.089+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~AG252COR84XN.1 size=630817 2024-09-19T13:47:25.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.089+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=AG252COR84XN tag=ZOXZ8LS5ODQ6 type=write size=2727969 2024-09-19T13:47:25.094 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.089+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=MWZX00QF9NE2 type=del 2024-09-19T13:47:25.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.093+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=5L15RP3DL2SG type=del size=1742301 2024-09-19T13:47:25.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.101+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~MUYVQFITV0KH.0 size=1048576 2024-09-19T13:47:25.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.101+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~MUYVQFITV0KH.1 size=125863 2024-09-19T13:47:25.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.109+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=MUYVQFITV0KH tag=8M4BF6THQ0AT type=write size=2223015 2024-09-19T13:47:25.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.113+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~HZ281NSOF0EK.0 size=92921 2024-09-19T13:47:25.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.113+0000 7fcf3240c8c0 1 > prepared multipart upload key=DHPONKOVS8CT upload=HZ281NSOF0EK tag=368KPNL4MJZS type=write size=1141497 2024-09-19T13:47:25.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.121+0000 7fcf3240c8c0 1 < suggested update operation key=D20C6C2ZFX1W tag=HGB3IBYWTCQQ type=del size=391232 2024-09-19T13:47:25.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.129+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~IRDNDY6V006H.0 size=1048576 2024-09-19T13:47:25.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.133+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~IRDNDY6V006H.1 size=198304 2024-09-19T13:47:25.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.133+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=IRDNDY6V006H tag=8TCB1X9ZZMAU type=write size=2295456 2024-09-19T13:47:25.144 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.141+0000 7fcf3240c8c0 1 < suggested update operation key=DHPONKOVS8CT tag=AB6E323YAP1J type=write size=48421 2024-09-19T13:47:25.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.145+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=MHB7HTPU8B19 type=del size=4036267 2024-09-19T13:47:25.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.149+0000 7fcf3240c8c0 1 < suggested update operation key=QMSDNKYFFK1F tag=OIH9BLH8J7P7 type=del size=2476109 2024-09-19T13:47:25.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.153+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=VMZWIUB2RCBX type=del size=1843309 2024-09-19T13:47:25.161 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.157+0000 7fcf3240c8c0 -1 < failed to complete operation key=DHPONKOVS8CT tag=2BG9C9WOBTZQ type=del size=622192: (22) Invalid argument 2024-09-19T13:47:25.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.161+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=HI576K4NM1RB type=del size=466469 2024-09-19T13:47:25.167 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.165+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~0LWP45C76NJS.0 size=1048576 2024-09-19T13:47:25.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.165+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~0LWP45C76NJS.1 size=585379 2024-09-19T13:47:25.175 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.173+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=0LWP45C76NJS tag=IFQZPSMEEJA6 type=write size=2682531 2024-09-19T13:47:25.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.177+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~BFO9VFER085K.0 size=857878 2024-09-19T13:47:25.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.177+0000 7fcf3240c8c0 1 > prepared multipart upload key=V8X0VBBNK83J upload=BFO9VFER085K tag=RGB6U8N2BZRB type=write size=1906454 2024-09-19T13:47:25.184 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.181+0000 7fcf3240c8c0 -1 < failed to complete operation key=D20C6C2ZFX1W tag=RWD910M967EN type=del size=827053: (22) Invalid argument 2024-09-19T13:47:25.187 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.185+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=ESQT6DBRTQWN type=del size=1236335 2024-09-19T13:47:25.190 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.185+0000 7fcf3240c8c0 -1 < failed to complete operation key=QMSDNKYFFK1F tag=IEA8V7S2E85Q type=del size=2524502: (22) Invalid argument 2024-09-19T13:47:25.194 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.189+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=6Z5MNVV60Z3P type=del size=2118876 2024-09-19T13:47:25.197 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.193+0000 7fcf3240c8c0 1 < completed delete operation key=0UCFTOF1YBBM tag=J9P1VW5BQRWO type=del 2024-09-19T13:47:25.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.197+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=8CKZNYKTBDWK type=del size=1044972 2024-09-19T13:47:25.206 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.201+0000 7fcf3240c8c0 1 < suggested update operation key=QMSDNKYFFK1F tag=JBLHKMLA575S type=del size=1955079 2024-09-19T13:47:25.212 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.209+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~05LXXCGU9NM1.0 size=1048576 2024-09-19T13:47:25.214 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.209+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~05LXXCGU9NM1.1 size=947140 2024-09-19T13:47:25.214 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.209+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=05LXXCGU9NM1 tag=FLVMB4YCVK8G type=write size=3044292 2024-09-19T13:47:25.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.213+0000 7fcf3240c8c0 1 < completed write operation key=XE42LV5M5X82 tag=I8ET1B3R3I1Q type=write size=552776 2024-09-19T13:47:25.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.221+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~82BT969U1E12.0 size=961030 2024-09-19T13:47:25.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.221+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=82BT969U1E12 tag=DW0ZL7FX2C40 type=write size=2009606 2024-09-19T13:47:25.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.221+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~H69VIOCKIJ2L.0 size=1048576 2024-09-19T13:47:25.228 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.225+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~H69VIOCKIJ2L.1 size=616384 2024-09-19T13:47:25.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.229+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=H69VIOCKIJ2L tag=07A2R6RBDMGX type=write size=2713536 2024-09-19T13:47:25.239 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.237+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~W9OCX6ZKBQOJ.0 size=1048576 2024-09-19T13:47:25.242 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.237+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~W9OCX6ZKBQOJ.1 size=1048576 2024-09-19T13:47:25.245 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.241+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~W9OCX6ZKBQOJ.2 size=464798 2024-09-19T13:47:25.245 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.241+0000 7fcf3240c8c0 1 > prepared multipart upload key=OA9BMSXGYR9T upload=W9OCX6ZKBQOJ tag=LR82R68V6TEB type=write size=3610526 2024-09-19T13:47:25.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.245+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~8XIEWV0Q8VHK.0 size=1048576 2024-09-19T13:47:25.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.245+0000 7fcf3240c8c0 1 < canceled part key=_multipart_6DFF2OCPT9W2.2~8XIEWV0Q8VHK.1 size=1036838 2024-09-19T13:47:25.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.249+0000 7fcf3240c8c0 1 < canceled multipart upload key=6DFF2OCPT9W2 upload=8XIEWV0Q8VHK tag=DUT61DBW732N type=write size=3133990 2024-09-19T13:47:25.256 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.253+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=O281EHL9KE3X type=write size=997852 2024-09-19T13:47:25.260 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.257+0000 7fcf3240c8c0 1 < completed delete operation key=X9FGPMP30X47 tag=V09KKULCH1A1 type=del 2024-09-19T13:47:25.263 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.261+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=U7XZSAUBCOGC type=del size=3270034 2024-09-19T13:47:25.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.261+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~AG252COR84XN.0 size=1048576 2024-09-19T13:47:25.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.265+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~AG252COR84XN.1 size=630817 2024-09-19T13:47:25.274 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.273+0000 7fcf3240c8c0 1 < completed multipart upload key=NP2L28YRVQ8L upload=AG252COR84XN tag=ZOXZ8LS5ODQ6 type=write size=2727969 2024-09-19T13:47:25.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.277+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~5KVJ0Y6E1P50.0 size=369995 2024-09-19T13:47:25.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.277+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=5KVJ0Y6E1P50 tag=JALMPRLUKAZJ type=write size=1418571 2024-09-19T13:47:25.286 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.285+0000 7fcf3240c8c0 1 < suggested remove operation key=OA9BMSXGYR9T tag=5L15RP3DL2SG type=del 2024-09-19T13:47:25.290 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.285+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=TNK7W9IDYLFZ type=del size=889898 2024-09-19T13:47:25.293 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.289+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~HZ281NSOF0EK.0 size=92921 2024-09-19T13:47:25.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.297+0000 7fcf3240c8c0 1 < completed multipart upload key=DHPONKOVS8CT upload=HZ281NSOF0EK tag=368KPNL4MJZS type=write size=1141497 2024-09-19T13:47:25.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.301+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~FF6C4S9AIKNG.0 size=1048576 2024-09-19T13:47:25.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.305+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~FF6C4S9AIKNG.1 size=739257 2024-09-19T13:47:25.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.305+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=FF6C4S9AIKNG tag=S1KQT064U118 type=write size=2836409 2024-09-19T13:47:25.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.305+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~IRDNDY6V006H.0 size=1048576 2024-09-19T13:47:25.313 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.309+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~IRDNDY6V006H.1 size=198304 2024-09-19T13:47:25.318 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.313+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=IRDNDY6V006H tag=8TCB1X9ZZMAU type=write size=2295456 2024-09-19T13:47:25.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.317+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=V65W9ELAS7CL type=del size=187768 2024-09-19T13:47:25.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.321+0000 7fcf3240c8c0 1 < completed delete operation key=D20C6C2ZFX1W tag=MHB7HTPU8B19 type=del 2024-09-19T13:47:25.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.325+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=32TOEWI50TX0 type=write size=654404 2024-09-19T13:47:25.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.329+0000 7fcf3240c8c0 1 < suggested update operation key=3TME221SA53E tag=VMZWIUB2RCBX type=del size=1843309 2024-09-19T13:47:25.337 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.333+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=WIENZY93YD7X type=del size=581958 2024-09-19T13:47:25.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.337+0000 7fcf3240c8c0 1 < completed delete operation key=V8X0VBBNK83J tag=HI576K4NM1RB type=del 2024-09-19T13:47:25.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.345+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~MM0EHPSV19D9.0 size=1002388 2024-09-19T13:47:25.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.345+0000 7fcf3240c8c0 1 > prepared multipart upload key=X9FGPMP30X47 upload=MM0EHPSV19D9 tag=CVEXW3F0USCK type=write size=2050964 2024-09-19T13:47:25.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.345+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~BFO9VFER085K.0 size=857878 2024-09-19T13:47:25.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.353+0000 7fcf3240c8c0 1 < completed multipart upload key=V8X0VBBNK83J upload=BFO9VFER085K tag=RGB6U8N2BZRB type=write size=1906454 2024-09-19T13:47:25.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.357+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~0X57YK1RZATG.0 size=211675 2024-09-19T13:47:25.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.357+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=0X57YK1RZATG tag=3MPL3FRVWVNR type=write size=1260251 2024-09-19T13:47:25.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.361+0000 7fcf3240c8c0 1 < canceled operation key=6DFF2OCPT9W2 tag=ESQT6DBRTQWN type=del size=1236335 2024-09-19T13:47:25.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.365+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=X70X1ZG81LWW type=del size=1007839 2024-09-19T13:47:25.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.369+0000 7fcf3240c8c0 1 < completed delete operation key=D20C6C2ZFX1W tag=6Z5MNVV60Z3P type=del 2024-09-19T13:47:25.377 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.373+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~2VI8SJI5MFH8.0 size=1048576 2024-09-19T13:47:25.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.377+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~2VI8SJI5MFH8.1 size=1048576 2024-09-19T13:47:25.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.381+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~2VI8SJI5MFH8.2 size=757841 2024-09-19T13:47:25.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.381+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=2VI8SJI5MFH8 tag=MVMLLSVTICUF type=write size=3903569 2024-09-19T13:47:25.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.381+0000 7fcf3240c8c0 1 < completed delete operation key=6DFF2OCPT9W2 tag=8CKZNYKTBDWK type=del 2024-09-19T13:47:25.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.389+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~OHR8LZLRVC3O.0 size=1048576 2024-09-19T13:47:25.395 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.393+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~OHR8LZLRVC3O.1 size=325450 2024-09-19T13:47:25.395 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.393+0000 7fcf3240c8c0 1 > prepared multipart upload key=X9FGPMP30X47 upload=OHR8LZLRVC3O tag=ON2EP4B013A2 type=write size=2422602 2024-09-19T13:47:25.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.393+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~05LXXCGU9NM1.0 size=1048576 2024-09-19T13:47:25.401 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.397+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~05LXXCGU9NM1.1 size=947140 2024-09-19T13:47:25.406 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.401+0000 7fcf3240c8c0 1 < completed multipart upload key=NP2L28YRVQ8L upload=05LXXCGU9NM1 tag=FLVMB4YCVK8G type=write size=3044292 2024-09-19T13:47:25.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.405+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=AXR1LP078XU3 type=write size=886043 2024-09-19T13:47:25.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.409+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~82BT969U1E12.0 size=961030 2024-09-19T13:47:25.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.413+0000 7fcf3240c8c0 1 < completed multipart upload key=ZCKKQ1R8318S upload=82BT969U1E12 tag=DW0ZL7FX2C40 type=write size=2009606 2024-09-19T13:47:25.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.417+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=LD9E3JTKZ25T type=del size=3715703 2024-09-19T13:47:25.424 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.421+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~W9OCX6ZKBQOJ.0 size=1048576 2024-09-19T13:47:25.427 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.425+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~W9OCX6ZKBQOJ.1 size=1048576 2024-09-19T13:47:25.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.429+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~W9OCX6ZKBQOJ.2 size=464798 2024-09-19T13:47:25.440 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.437+0000 7fcf3240c8c0 1 < completed multipart upload key=OA9BMSXGYR9T upload=W9OCX6ZKBQOJ tag=LR82R68V6TEB type=write size=3610526 2024-09-19T13:47:25.444 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.441+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=R7CU17H40NG9 type=del size=3720271 2024-09-19T13:47:25.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.445+0000 7fcf3240c8c0 1 < completed write operation key=C3TFYNXH549T tag=O281EHL9KE3X type=write size=997852 2024-09-19T13:47:25.451 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.449+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=SGITG8CX8AUF type=write size=692290 2024-09-19T13:47:25.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.449+0000 7fcf3240c8c0 1 < completed delete operation key=C35EUAOWLBR3 tag=U7XZSAUBCOGC type=del 2024-09-19T13:47:25.457 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.453+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=0DN8WKP1LDSE type=write size=916957 2024-09-19T13:47:25.461 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.457+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~5KVJ0Y6E1P50.0 size=369995 2024-09-19T13:47:25.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.465+0000 7fcf3240c8c0 1 < completed multipart upload key=XE42LV5M5X82 upload=5KVJ0Y6E1P50 tag=JALMPRLUKAZJ type=write size=1418571 2024-09-19T13:47:25.470 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.465+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=M5STX5G5UXK6 type=del size=3585689 2024-09-19T13:47:25.478 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.473+0000 7fcf3240c8c0 1 < suggested update operation key=XE42LV5M5X82 tag=TNK7W9IDYLFZ type=del size=889898 2024-09-19T13:47:25.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.477+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=CHP3HE2LIVV1 type=del size=3065045 2024-09-19T13:47:25.485 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.481+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~FF6C4S9AIKNG.0 size=1048576 2024-09-19T13:47:25.488 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.485+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~FF6C4S9AIKNG.1 size=739257 2024-09-19T13:47:25.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.489+0000 7fcf3240c8c0 1 < completed multipart upload key=QMSDNKYFFK1F upload=FF6C4S9AIKNG tag=S1KQT064U118 type=write size=2836409 2024-09-19T13:47:25.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.493+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=85PDR5P0BBOL type=del size=2301301 2024-09-19T13:47:25.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.497+0000 7fcf3240c8c0 1 < completed delete operation key=HXMZKP7H3HJE tag=V65W9ELAS7CL type=del 2024-09-19T13:47:25.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.505+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~AB6FMVCMCPMD.0 size=1048576 2024-09-19T13:47:25.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.509+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~AB6FMVCMCPMD.1 size=1048576 2024-09-19T13:47:25.513 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.509+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~AB6FMVCMCPMD.2 size=747359 2024-09-19T13:47:25.513 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.509+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=AB6FMVCMCPMD tag=GM1C55MZHA22 type=write size=3893087 2024-09-19T13:47:25.517 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.513+0000 7fcf3240c8c0 1 < completed write operation key=9ICCISYXT0IV tag=32TOEWI50TX0 type=write size=654404 2024-09-19T13:47:25.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.517+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=GU7Q2EYHX3J6 type=del size=2723864 2024-09-19T13:47:25.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.521+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=WIENZY93YD7X type=del 2024-09-19T13:47:25.528 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.525+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=29XKPT0MHATU type=write size=199991 2024-09-19T13:47:25.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.529+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~MM0EHPSV19D9.0 size=1002388 2024-09-19T13:47:25.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.533+0000 7fcf3240c8c0 1 < completed multipart upload key=X9FGPMP30X47 upload=MM0EHPSV19D9 tag=CVEXW3F0USCK type=write size=2050964 2024-09-19T13:47:25.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.537+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=T7JX0RQ3S7QT type=write size=315423 2024-09-19T13:47:25.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.541+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~0X57YK1RZATG.0 size=211675 2024-09-19T13:47:25.549 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.545+0000 7fcf3240c8c0 1 < completed multipart upload key=AES54TJK7VH7 upload=0X57YK1RZATG tag=3MPL3FRVWVNR type=write size=1260251 2024-09-19T13:47:25.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.553+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~DO98BFPJUC1G.0 size=323900 2024-09-19T13:47:25.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.553+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=DO98BFPJUC1G tag=8JJVIUDKSMA8 type=write size=1372476 2024-09-19T13:47:25.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.557+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=X70X1ZG81LWW type=del 2024-09-19T13:47:25.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.561+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=DB11XIIQ5JZS type=del size=3580112 2024-09-19T13:47:25.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.565+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~2VI8SJI5MFH8.0 size=1048576 2024-09-19T13:47:25.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.565+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~2VI8SJI5MFH8.1 size=1048576 2024-09-19T13:47:25.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.569+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~2VI8SJI5MFH8.2 size=757841 2024-09-19T13:47:25.578 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.573+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=2VI8SJI5MFH8 tag=MVMLLSVTICUF type=write size=3903569 2024-09-19T13:47:25.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.577+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=7QT7E2FBBG2K type=del size=1694096 2024-09-19T13:47:25.585 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.581+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~OHR8LZLRVC3O.0 size=1048576 2024-09-19T13:47:25.588 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.585+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~OHR8LZLRVC3O.1 size=325450 2024-09-19T13:47:25.594 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.589+0000 7fcf3240c8c0 1 < completed multipart upload key=X9FGPMP30X47 upload=OHR8LZLRVC3O tag=ON2EP4B013A2 type=write size=2422602 2024-09-19T13:47:25.598 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.593+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=FYCQLGDUJZP8 type=write size=739166 2024-09-19T13:47:25.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.601+0000 7fcf3240c8c0 1 < suggested update operation key=ES62XJO5Q3FO tag=AXR1LP078XU3 type=write size=886043 2024-09-19T13:47:25.608 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.605+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=WW0QW7GLSHVL type=write size=204439 2024-09-19T13:47:25.612 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.609+0000 7fcf3240c8c0 -1 < failed to complete operation key=ES62XJO5Q3FO tag=LD9E3JTKZ25T type=del size=3715703: (22) Invalid argument 2024-09-19T13:47:25.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.613+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=KU74FRCWXURO type=del size=3808379 2024-09-19T13:47:25.618 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.617+0000 7fcf3240c8c0 1 < completed delete operation key=X9FGPMP30X47 tag=R7CU17H40NG9 type=del 2024-09-19T13:47:25.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.617+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=F0CU4H0IAK8M type=del size=2535270 2024-09-19T13:47:25.629 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.625+0000 7fcf3240c8c0 1 < suggested remove operation key=XE42LV5M5X82 tag=SGITG8CX8AUF type=write 2024-09-19T13:47:25.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.629+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=SLE4CX6EYGTS type=del size=4116963 2024-09-19T13:47:25.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.633+0000 7fcf3240c8c0 1 < completed write operation key=STMT6XU2EJQM tag=0DN8WKP1LDSE type=write size=916957 2024-09-19T13:47:25.640 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.637+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=OMFRGAVDYY7H type=write size=501852 2024-09-19T13:47:25.644 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.641+0000 7fcf3240c8c0 1 < canceled operation key=X9FGPMP30X47 tag=M5STX5G5UXK6 type=del size=3585689 2024-09-19T13:47:25.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.649+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~STH2B5ZT780W.0 size=1048576 2024-09-19T13:47:25.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.649+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~STH2B5ZT780W.1 size=915922 2024-09-19T13:47:25.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.649+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=STH2B5ZT780W tag=UKTO179OLFYE type=write size=3013074 2024-09-19T13:47:25.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.657+0000 7fcf3240c8c0 1 < suggested update operation key=QSM2Q8CW1Q86 tag=CHP3HE2LIVV1 type=del size=3065045 2024-09-19T13:47:25.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.657+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=G1I7EWZFGX1Q type=del size=733428 2024-09-19T13:47:25.666 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.665+0000 7fcf3240c8c0 1 < suggested update operation key=6DFF2OCPT9W2 tag=85PDR5P0BBOL type=del size=2301301 2024-09-19T13:47:25.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.665+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=72AOPI9EU1J8 type=write size=773716 2024-09-19T13:47:25.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.669+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~AB6FMVCMCPMD.0 size=1048576 2024-09-19T13:47:25.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.669+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~AB6FMVCMCPMD.1 size=1048576 2024-09-19T13:47:25.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.673+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~AB6FMVCMCPMD.2 size=747359 2024-09-19T13:47:25.681 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.677+0000 7fcf3240c8c0 1 < completed multipart upload key=NP2L28YRVQ8L upload=AB6FMVCMCPMD tag=GM1C55MZHA22 type=write size=3893087 2024-09-19T13:47:25.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.681+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~RROIEH9RH0L1.0 size=1048576 2024-09-19T13:47:25.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.685+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~RROIEH9RH0L1.1 size=1009801 2024-09-19T13:47:25.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.685+0000 7fcf3240c8c0 1 > prepared multipart upload key=C3TFYNXH549T upload=RROIEH9RH0L1 tag=UT3XYCCULZD2 type=write size=3106953 2024-09-19T13:47:25.690 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.685+0000 7fcf3240c8c0 1 < completed delete operation key=A02RDP6BA9AC tag=GU7Q2EYHX3J6 type=del 2024-09-19T13:47:25.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.693+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~LX8R343XU286.0 size=1048576 2024-09-19T13:47:25.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.693+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~LX8R343XU286.1 size=888528 2024-09-19T13:47:25.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.693+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=LX8R343XU286 tag=W7P2AJ7GJUD0 type=write size=2985680 2024-09-19T13:47:25.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.697+0000 7fcf3240c8c0 1 < completed write operation key=OA9BMSXGYR9T tag=29XKPT0MHATU type=write size=199991 2024-09-19T13:47:25.702 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.697+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=QA270QU12LT6 type=del size=703234 2024-09-19T13:47:25.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.701+0000 7fcf3240c8c0 1 < completed write operation key=QAYJ5B1KZ08J tag=T7JX0RQ3S7QT type=write size=315423 2024-09-19T13:47:25.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.705+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=EJ2MSDX2I65F type=del size=178569 2024-09-19T13:47:25.710 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.709+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~DO98BFPJUC1G.0 size=323900 2024-09-19T13:47:25.715 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.713+0000 7fcf3240c8c0 1 < completed multipart upload key=NP2L28YRVQ8L upload=DO98BFPJUC1G tag=8JJVIUDKSMA8 type=write size=1372476 2024-09-19T13:47:25.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.713+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=QRM3FSJLM847 type=del size=124133 2024-09-19T13:47:25.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.717+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=DB11XIIQ5JZS type=del 2024-09-19T13:47:25.725 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.721+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~J377O9V6WE1P.0 size=539067 2024-09-19T13:47:25.725 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.721+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=J377O9V6WE1P tag=RTQF1QKBG3PE type=write size=1587643 2024-09-19T13:47:25.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.725+0000 7fcf3240c8c0 -1 < failed to complete operation key=XE42LV5M5X82 tag=7QT7E2FBBG2K type=del size=1694096: (22) Invalid argument 2024-09-19T13:47:25.730 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.729+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=F9DZZ0W3BCQI type=del size=3758851 2024-09-19T13:47:25.733 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.729+0000 7fcf3240c8c0 1 < completed write operation key=QMSDNKYFFK1F tag=FYCQLGDUJZP8 type=write size=739166 2024-09-19T13:47:25.740 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.737+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~RITDK48C8SQZ.0 size=1048576 2024-09-19T13:47:25.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.741+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~RITDK48C8SQZ.1 size=1048576 2024-09-19T13:47:25.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.741+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~RITDK48C8SQZ.2 size=149774 2024-09-19T13:47:25.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.741+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=RITDK48C8SQZ tag=A0TKAF84KZVL type=write size=3295502 2024-09-19T13:47:25.748 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.745+0000 7fcf3240c8c0 1 < completed write operation key=71Z2VTW99W7J tag=WW0QW7GLSHVL type=write size=204439 2024-09-19T13:47:25.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.749+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=53JYJSF4WX65 type=del size=1980585 2024-09-19T13:47:25.753 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.749+0000 7fcf3240c8c0 1 < completed delete operation key=D20C6C2ZFX1W tag=KU74FRCWXURO type=del 2024-09-19T13:47:25.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.757+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~X60SRLLBMHI0.0 size=1044855 2024-09-19T13:47:25.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.757+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=X60SRLLBMHI0 tag=E934R8OZVS67 type=write size=2093431 2024-09-19T13:47:25.764 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.761+0000 7fcf3240c8c0 1 < suggested remove operation key=OA9BMSXGYR9T tag=F0CU4H0IAK8M type=del 2024-09-19T13:47:25.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.765+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=2RHPU079WHGH type=del size=3154083 2024-09-19T13:47:25.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.769+0000 7fcf3240c8c0 1 < canceled operation key=N51Q6HKJSCCB tag=SLE4CX6EYGTS type=del size=4116963 2024-09-19T13:47:25.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.773+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~CIUYXXSTDENZ.0 size=8481 2024-09-19T13:47:25.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.773+0000 7fcf3240c8c0 1 > prepared multipart upload key=A02RDP6BA9AC upload=CIUYXXSTDENZ tag=Y0IKYB7Q3UXU type=write size=1057057 2024-09-19T13:47:25.778 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.777+0000 7fcf3240c8c0 1 < completed write operation key=DHPONKOVS8CT tag=OMFRGAVDYY7H type=write size=501852 2024-09-19T13:47:25.784 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.781+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~C3C9BGYHMSJI.0 size=1048576 2024-09-19T13:47:25.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.785+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~C3C9BGYHMSJI.1 size=609419 2024-09-19T13:47:25.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.785+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=C3C9BGYHMSJI tag=3N4ZK4LS2OQM type=write size=2706571 2024-09-19T13:47:25.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.785+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~STH2B5ZT780W.0 size=1048576 2024-09-19T13:47:25.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.789+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~STH2B5ZT780W.1 size=915922 2024-09-19T13:47:25.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.793+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=STH2B5ZT780W tag=UKTO179OLFYE type=write size=3013074 2024-09-19T13:47:25.803 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.801+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~0RE6O5T0P3RB.0 size=1048576 2024-09-19T13:47:25.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.801+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~0RE6O5T0P3RB.1 size=1048576 2024-09-19T13:47:25.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.805+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~0RE6O5T0P3RB.2 size=152629 2024-09-19T13:47:25.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.805+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=0RE6O5T0P3RB tag=WJRNRWZT80RC type=write size=3298357 2024-09-19T13:47:25.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.809+0000 7fcf3240c8c0 -1 < failed to complete operation key=6DFF2OCPT9W2 tag=G1I7EWZFGX1Q type=del size=733428: (22) Invalid argument 2024-09-19T13:47:25.815 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.813+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=58S4G8QAJ7KD type=del size=2556533 2024-09-19T13:47:25.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.817+0000 7fcf3240c8c0 1 < suggested remove operation key=71Z2VTW99W7J tag=72AOPI9EU1J8 type=write 2024-09-19T13:47:25.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.825+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~PXSEZZK36CXE.0 size=1012574 2024-09-19T13:47:25.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.825+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=PXSEZZK36CXE tag=YSU0F0GAWUQ6 type=write size=2061150 2024-09-19T13:47:25.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.825+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~RROIEH9RH0L1.0 size=1048576 2024-09-19T13:47:25.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.829+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~RROIEH9RH0L1.1 size=1009801 2024-09-19T13:47:25.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.833+0000 7fcf3240c8c0 1 < completed multipart upload key=C3TFYNXH549T upload=RROIEH9RH0L1 tag=UT3XYCCULZD2 type=write size=3106953 2024-09-19T13:47:25.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.837+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=EJPE3SV814OY type=del size=1062000 2024-09-19T13:47:25.843 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.841+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~LX8R343XU286.0 size=1048576 2024-09-19T13:47:25.846 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.841+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~LX8R343XU286.1 size=888528 2024-09-19T13:47:25.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.849+0000 7fcf3240c8c0 1 < completed multipart upload key=AES54TJK7VH7 upload=LX8R343XU286 tag=W7P2AJ7GJUD0 type=write size=2985680 2024-09-19T13:47:25.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.849+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=1H6GHRA824JN type=write size=494743 2024-09-19T13:47:25.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.853+0000 7fcf3240c8c0 1 < completed delete operation key=HXMZKP7H3HJE tag=QA270QU12LT6 type=del 2024-09-19T13:47:25.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.861+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~NJR5996G4CFV.0 size=1048576 2024-09-19T13:47:25.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.861+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~NJR5996G4CFV.1 size=1048576 2024-09-19T13:47:25.867 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.865+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~NJR5996G4CFV.2 size=294331 2024-09-19T13:47:25.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.865+0000 7fcf3240c8c0 1 > prepared multipart upload key=C8T6DB9V9FBT upload=NJR5996G4CFV tag=22SZGNZF0GBI type=write size=3440059 2024-09-19T13:47:25.871 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.869+0000 7fcf3240c8c0 1 < completed delete operation key=0U9BUX9DHTAK tag=EJ2MSDX2I65F type=del 2024-09-19T13:47:25.874 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.869+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=COFUW9IKAULX type=del size=496564 2024-09-19T13:47:25.877 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.873+0000 7fcf3240c8c0 1 < completed delete operation key=C8T6DB9V9FBT tag=QRM3FSJLM847 type=del 2024-09-19T13:47:25.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.881+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~FDLMONK8UAWA.0 size=845640 2024-09-19T13:47:25.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.881+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=FDLMONK8UAWA tag=ZVLJKHOFX1BC type=write size=1894216 2024-09-19T13:47:25.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.881+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~J377O9V6WE1P.0 size=539067 2024-09-19T13:47:25.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.889+0000 7fcf3240c8c0 1 < completed multipart upload key=QAYJ5B1KZ08J upload=J377O9V6WE1P tag=RTQF1QKBG3PE type=write size=1587643 2024-09-19T13:47:25.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.893+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~7CH9PS7OKPJG.0 size=1048576 2024-09-19T13:47:25.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.893+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~7CH9PS7OKPJG.1 size=1048576 2024-09-19T13:47:25.900 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.897+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~7CH9PS7OKPJG.2 size=21407 2024-09-19T13:47:25.900 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.897+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=7CH9PS7OKPJG tag=MWODQ8USNVM3 type=write size=3167135 2024-09-19T13:47:25.908 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.905+0000 7fcf3240c8c0 1 < suggested remove operation key=ZCKKQ1R8318S tag=F9DZZ0W3BCQI type=del 2024-09-19T13:47:25.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.909+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~10FUI8LRWEAQ.0 size=936104 2024-09-19T13:47:25.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.909+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=10FUI8LRWEAQ tag=46N53058EDFE type=write size=1984680 2024-09-19T13:47:25.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.913+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~RITDK48C8SQZ.0 size=1048576 2024-09-19T13:47:25.918 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.913+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~RITDK48C8SQZ.1 size=1048576 2024-09-19T13:47:25.920 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.917+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~RITDK48C8SQZ.2 size=149774 2024-09-19T13:47:25.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.921+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=RITDK48C8SQZ tag=A0TKAF84KZVL type=write size=3295502 2024-09-19T13:47:25.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.925+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~E95IXC6FLE0R.0 size=1048576 2024-09-19T13:47:25.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.929+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~E95IXC6FLE0R.1 size=361553 2024-09-19T13:47:25.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.929+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=E95IXC6FLE0R tag=3MPIVXKUD4DP type=write size=2458705 2024-09-19T13:47:25.934 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.933+0000 7fcf3240c8c0 1 < canceled operation key=HXMZKP7H3HJE tag=53JYJSF4WX65 type=del size=1980585 2024-09-19T13:47:25.938 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.933+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=4UCK0RHNU7QA type=write size=779650 2024-09-19T13:47:25.939 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.937+0000 7fcf3240c8c0 1 < canceled part key=_multipart_QSM2Q8CW1Q86.2~X60SRLLBMHI0.0 size=1044855 2024-09-19T13:47:25.943 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.941+0000 7fcf3240c8c0 1 < canceled multipart upload key=QSM2Q8CW1Q86 upload=X60SRLLBMHI0 tag=E934R8OZVS67 type=write size=2093431 2024-09-19T13:47:25.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.945+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~P7KO52R8NRY7.0 size=298798 2024-09-19T13:47:25.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.945+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=P7KO52R8NRY7 tag=O08KNROVAL51 type=write size=1347374 2024-09-19T13:47:25.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.949+0000 7fcf3240c8c0 1 < completed delete operation key=1BMF3S2BZLLI tag=2RHPU079WHGH type=del 2024-09-19T13:47:25.958 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.953+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~6TG5G90UBD90.0 size=213539 2024-09-19T13:47:25.958 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.953+0000 7fcf3240c8c0 1 > prepared multipart upload key=71Z2VTW99W7J upload=6TG5G90UBD90 tag=A62KLA83TC7A type=write size=1262115 2024-09-19T13:47:25.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.957+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~CIUYXXSTDENZ.0 size=8481 2024-09-19T13:47:25.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.961+0000 7fcf3240c8c0 1 < completed multipart upload key=A02RDP6BA9AC upload=CIUYXXSTDENZ tag=Y0IKYB7Q3UXU type=write size=1057057 2024-09-19T13:47:25.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.969+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~RLB6ZV6QVZJG.0 size=1048576 2024-09-19T13:47:25.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.969+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~RLB6ZV6QVZJG.1 size=880871 2024-09-19T13:47:25.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.969+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=RLB6ZV6QVZJG tag=YY2U7S2SXPMQ type=write size=2978023 2024-09-19T13:47:25.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.973+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~C3C9BGYHMSJI.0 size=1048576 2024-09-19T13:47:25.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.973+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~C3C9BGYHMSJI.1 size=609419 2024-09-19T13:47:25.982 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.981+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=C3C9BGYHMSJI tag=3N4ZK4LS2OQM type=write size=2706571 2024-09-19T13:47:25.985 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.981+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=DU7PVB8UIFCB type=del size=1378691 2024-09-19T13:47:25.988 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.985+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~0RE6O5T0P3RB.0 size=1048576 2024-09-19T13:47:25.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.985+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~0RE6O5T0P3RB.1 size=1048576 2024-09-19T13:47:25.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.989+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~0RE6O5T0P3RB.2 size=152629 2024-09-19T13:47:25.996 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.993+0000 7fcf3240c8c0 1 < completed multipart upload key=N51Q6HKJSCCB upload=0RE6O5T0P3RB tag=WJRNRWZT80RC type=write size=3298357 2024-09-19T13:47:25.999 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.997+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=N62BM1R2B0GB type=write size=785118 2024-09-19T13:47:26.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:25.997+0000 7fcf3240c8c0 1 < completed delete operation key=0U9BUX9DHTAK tag=58S4G8QAJ7KD type=del 2024-09-19T13:47:26.007 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.005+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~T9OG84Z6QI7H.0 size=1048576 2024-09-19T13:47:26.011 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.009+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~T9OG84Z6QI7H.1 size=528331 2024-09-19T13:47:26.012 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.009+0000 7fcf3240c8c0 1 > prepared multipart upload key=X9FGPMP30X47 upload=T9OG84Z6QI7H tag=RRABFLV9QEYE type=write size=2625483 2024-09-19T13:47:26.012 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.009+0000 7fcf3240c8c0 1 < canceled part key=_multipart_QSM2Q8CW1Q86.2~PXSEZZK36CXE.0 size=1012574 2024-09-19T13:47:26.017 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.013+0000 7fcf3240c8c0 1 < canceled multipart upload key=QSM2Q8CW1Q86 upload=PXSEZZK36CXE tag=YSU0F0GAWUQ6 type=write size=2061150 2024-09-19T13:47:26.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.017+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~RJ64XV8RIHZL.0 size=1048576 2024-09-19T13:47:26.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.021+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~RJ64XV8RIHZL.1 size=477843 2024-09-19T13:47:26.024 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.021+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=RJ64XV8RIHZL tag=260W4DMQBJLE type=write size=2574995 2024-09-19T13:47:26.029 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.025+0000 7fcf3240c8c0 1 < suggested update operation key=N51Q6HKJSCCB tag=EJPE3SV814OY type=del size=1062000 2024-09-19T13:47:26.031 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.029+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=XCU7K1JG1XI0 type=del size=1238092 2024-09-19T13:47:26.034 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.029+0000 7fcf3240c8c0 1 < completed write operation key=9ICCISYXT0IV tag=1H6GHRA824JN type=write size=494743 2024-09-19T13:47:26.037 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.033+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=RV8HIVTRHIPX type=del size=4100473 2024-09-19T13:47:26.039 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.037+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~NJR5996G4CFV.0 size=1048576 2024-09-19T13:47:26.042 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.037+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~NJR5996G4CFV.1 size=1048576 2024-09-19T13:47:26.043 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.041+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~NJR5996G4CFV.2 size=294331 2024-09-19T13:47:26.048 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.045+0000 7fcf3240c8c0 1 < completed multipart upload key=C8T6DB9V9FBT upload=NJR5996G4CFV tag=22SZGNZF0GBI type=write size=3440059 2024-09-19T13:47:26.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.049+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~BOAYG0V0Y58G.0 size=1048576 2024-09-19T13:47:26.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.053+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~BOAYG0V0Y58G.1 size=589073 2024-09-19T13:47:26.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.053+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=BOAYG0V0Y58G tag=W6N1QE5YPNB0 type=write size=2686225 2024-09-19T13:47:26.057 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.053+0000 7fcf3240c8c0 1 < completed delete operation key=C8T6DB9V9FBT tag=COFUW9IKAULX type=del 2024-09-19T13:47:26.060 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.057+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=FV62RBHN0YBT type=del size=2364769 2024-09-19T13:47:26.065 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.061+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~FDLMONK8UAWA.0 size=845640 2024-09-19T13:47:26.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.069+0000 7fcf3240c8c0 1 < completed multipart upload key=QAYJ5B1KZ08J upload=FDLMONK8UAWA tag=ZVLJKHOFX1BC type=write size=1894216 2024-09-19T13:47:26.074 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.073+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=0ONODVDBDLBM type=del size=1071145 2024-09-19T13:47:26.078 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.073+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~7CH9PS7OKPJG.0 size=1048576 2024-09-19T13:47:26.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.077+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~7CH9PS7OKPJG.1 size=1048576 2024-09-19T13:47:26.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.081+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~7CH9PS7OKPJG.2 size=21407 2024-09-19T13:47:26.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.085+0000 7fcf3240c8c0 1 < completed multipart upload key=NP2L28YRVQ8L upload=7CH9PS7OKPJG tag=MWODQ8USNVM3 type=write size=3167135 2024-09-19T13:47:26.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.089+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=M94PAXXQL49S type=del size=2181957 2024-09-19T13:47:26.094 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.089+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~10FUI8LRWEAQ.0 size=936104 2024-09-19T13:47:26.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.097+0000 7fcf3240c8c0 1 < completed multipart upload key=XE42LV5M5X82 upload=10FUI8LRWEAQ tag=46N53058EDFE type=write size=1984680 2024-09-19T13:47:26.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.101+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~2EC3L30EJJOZ.0 size=1048576 2024-09-19T13:47:26.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.101+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~2EC3L30EJJOZ.1 size=1048576 2024-09-19T13:47:26.108 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.105+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~2EC3L30EJJOZ.2 size=237115 2024-09-19T13:47:26.108 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.105+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=2EC3L30EJJOZ tag=HCUBVTG31B05 type=write size=3382843 2024-09-19T13:47:26.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.109+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~E95IXC6FLE0R.0 size=1048576 2024-09-19T13:47:26.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.109+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~E95IXC6FLE0R.1 size=361553 2024-09-19T13:47:26.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.113+0000 7fcf3240c8c0 1 < completed multipart upload key=N51Q6HKJSCCB upload=E95IXC6FLE0R tag=3MPIVXKUD4DP type=write size=2458705 2024-09-19T13:47:26.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.121+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~2GK6A7OBFOKV.0 size=830248 2024-09-19T13:47:26.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.121+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=2GK6A7OBFOKV tag=ITPQDMBURILF type=write size=1878824 2024-09-19T13:47:26.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.121+0000 7fcf3240c8c0 1 < completed write operation key=QAYJ5B1KZ08J tag=4UCK0RHNU7QA type=write size=779650 2024-09-19T13:47:26.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.125+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~B60TD5JXU79T.0 size=1048576 2024-09-19T13:47:26.132 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.129+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~B60TD5JXU79T.1 size=1048576 2024-09-19T13:47:26.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.133+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~B60TD5JXU79T.2 size=390828 2024-09-19T13:47:26.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.133+0000 7fcf3240c8c0 1 > prepared multipart upload key=C8T6DB9V9FBT upload=B60TD5JXU79T tag=3NC8J3FQ3JXY type=write size=3536556 2024-09-19T13:47:26.137 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.133+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~P7KO52R8NRY7.0 size=298798 2024-09-19T13:47:26.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.137+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=P7KO52R8NRY7 tag=O08KNROVAL51 type=write size=1347374 2024-09-19T13:47:26.143 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.141+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=JCCCL2PTP872 type=write size=931604 2024-09-19T13:47:26.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.141+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~6TG5G90UBD90.0 size=213539 2024-09-19T13:47:26.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.149+0000 7fcf3240c8c0 1 < completed multipart upload key=71Z2VTW99W7J upload=6TG5G90UBD90 tag=A62KLA83TC7A type=write size=1262115 2024-09-19T13:47:26.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.149+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=V6X0F86ATFS2 type=del size=656833 2024-09-19T13:47:26.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.153+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~RLB6ZV6QVZJG.0 size=1048576 2024-09-19T13:47:26.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.153+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~RLB6ZV6QVZJG.1 size=880871 2024-09-19T13:47:26.162 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.157+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=RLB6ZV6QVZJG tag=YY2U7S2SXPMQ type=write size=2978023 2024-09-19T13:47:26.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.161+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=67JUDM4OS8AR type=write size=840891 2024-09-19T13:47:26.167 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.165+0000 7fcf3240c8c0 1 < completed delete operation key=C35EUAOWLBR3 tag=DU7PVB8UIFCB type=del 2024-09-19T13:47:26.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.169+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=DKUG5OD5FHG7 type=del size=2275327 2024-09-19T13:47:26.174 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.169+0000 7fcf3240c8c0 1 < completed write operation key=QMSDNKYFFK1F tag=N62BM1R2B0GB type=write size=785118 2024-09-19T13:47:26.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.177+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~MFHMYNKD8KSF.0 size=873014 2024-09-19T13:47:26.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.177+0000 7fcf3240c8c0 1 > prepared multipart upload key=C8T6DB9V9FBT upload=MFHMYNKD8KSF tag=95JMACQ8HVSE type=write size=1921590 2024-09-19T13:47:26.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.181+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~T9OG84Z6QI7H.0 size=1048576 2024-09-19T13:47:26.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.181+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~T9OG84Z6QI7H.1 size=528331 2024-09-19T13:47:26.190 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.185+0000 7fcf3240c8c0 1 < completed multipart upload key=X9FGPMP30X47 upload=T9OG84Z6QI7H tag=RRABFLV9QEYE type=write size=2625483 2024-09-19T13:47:26.196 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.193+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~CZ57QPW96HO7.0 size=1048576 2024-09-19T13:47:26.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.193+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~CZ57QPW96HO7.1 size=124066 2024-09-19T13:47:26.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.193+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=CZ57QPW96HO7 tag=AX3IL06VCJWE type=write size=2221218 2024-09-19T13:47:26.201 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.197+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~RJ64XV8RIHZL.0 size=1048576 2024-09-19T13:47:26.204 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.201+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~RJ64XV8RIHZL.1 size=477843 2024-09-19T13:47:26.209 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.205+0000 7fcf3240c8c0 1 < completed multipart upload key=M2CO4A2DHJ05 upload=RJ64XV8RIHZL tag=260W4DMQBJLE type=write size=2574995 2024-09-19T13:47:26.214 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.213+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0U9BUX9DHTAK.2~7FE7BQUQWVQJ.0 size=1048576 2024-09-19T13:47:26.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.213+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0U9BUX9DHTAK.2~7FE7BQUQWVQJ.1 size=488043 2024-09-19T13:47:26.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.213+0000 7fcf3240c8c0 1 > prepared multipart upload key=0U9BUX9DHTAK upload=7FE7BQUQWVQJ tag=CO2MMRVD1D52 type=write size=2585195 2024-09-19T13:47:26.220 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.217+0000 7fcf3240c8c0 1 < completed delete operation key=XE42LV5M5X82 tag=XCU7K1JG1XI0 type=del 2024-09-19T13:47:26.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.221+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=RYIND3XMS1Z5 type=del size=127302 2024-09-19T13:47:26.229 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.225+0000 7fcf3240c8c0 1 < suggested update operation key=C3TFYNXH549T tag=RV8HIVTRHIPX type=del size=4100473 2024-09-19T13:47:26.235 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.233+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~G8T4A90E5AVL.0 size=1048576 2024-09-19T13:47:26.237 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.233+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~G8T4A90E5AVL.1 size=1048576 2024-09-19T13:47:26.240 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.237+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~G8T4A90E5AVL.2 size=245065 2024-09-19T13:47:26.240 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.237+0000 7fcf3240c8c0 1 > prepared multipart upload key=6DFF2OCPT9W2 upload=G8T4A90E5AVL tag=XTWAJVH6OYOQ type=write size=3390793 2024-09-19T13:47:26.243 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.241+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~BOAYG0V0Y58G.0 size=1048576 2024-09-19T13:47:26.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.241+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~BOAYG0V0Y58G.1 size=589073 2024-09-19T13:47:26.252 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.249+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=BOAYG0V0Y58G tag=W6N1QE5YPNB0 type=write size=2686225 2024-09-19T13:47:26.257 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.253+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~BXPSRFZT2J3N.0 size=1048576 2024-09-19T13:47:26.259 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.257+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~BXPSRFZT2J3N.1 size=1048576 2024-09-19T13:47:26.262 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.261+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~BXPSRFZT2J3N.2 size=360726 2024-09-19T13:47:26.262 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.261+0000 7fcf3240c8c0 1 > prepared multipart upload key=3TME221SA53E upload=BXPSRFZT2J3N tag=QJ8VVVIHDXWI type=write size=3506454 2024-09-19T13:47:26.268 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.265+0000 7fcf3240c8c0 1 < suggested remove operation key=C35EUAOWLBR3 tag=FV62RBHN0YBT type=del 2024-09-19T13:47:26.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.269+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=RWIL1XT09H4O type=del size=524711 2024-09-19T13:47:26.277 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.273+0000 7fcf3240c8c0 1 < completed delete operation key=HXMZKP7H3HJE tag=0ONODVDBDLBM type=del 2024-09-19T13:47:26.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.277+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=DA2RSE48BNZ0 type=del size=561980 2024-09-19T13:47:26.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.281+0000 7fcf3240c8c0 1 < completed delete operation key=6DFF2OCPT9W2 tag=M94PAXXQL49S type=del 2024-09-19T13:47:26.286 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.285+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=WDDP8AV6MM26 type=del size=1133920 2024-09-19T13:47:26.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.285+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~2EC3L30EJJOZ.0 size=1048576 2024-09-19T13:47:26.292 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.289+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~2EC3L30EJJOZ.1 size=1048576 2024-09-19T13:47:26.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.289+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~2EC3L30EJJOZ.2 size=237115 2024-09-19T13:47:26.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.297+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=2EC3L30EJJOZ tag=HCUBVTG31B05 type=write size=3382843 2024-09-19T13:47:26.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.301+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~L7RP0SAZUTW0.0 size=1048576 2024-09-19T13:47:26.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.301+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~L7RP0SAZUTW0.1 size=918499 2024-09-19T13:47:26.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.301+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=L7RP0SAZUTW0 tag=Z3OJ5MGWGQG6 type=write size=3015651 2024-09-19T13:47:26.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.305+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~2GK6A7OBFOKV.0 size=830248 2024-09-19T13:47:26.314 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.309+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=2GK6A7OBFOKV tag=ITPQDMBURILF type=write size=1878824 2024-09-19T13:47:26.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.317+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~2NYK8Q5ELOIO.0 size=1048576 2024-09-19T13:47:26.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.321+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~2NYK8Q5ELOIO.1 size=743079 2024-09-19T13:47:26.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.321+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=2NYK8Q5ELOIO tag=CIVMDATRTDVI type=write size=2840231 2024-09-19T13:47:26.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.321+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~B60TD5JXU79T.0 size=1048576 2024-09-19T13:47:26.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.325+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~B60TD5JXU79T.1 size=1048576 2024-09-19T13:47:26.331 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.329+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~B60TD5JXU79T.2 size=390828 2024-09-19T13:47:26.337 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.333+0000 7fcf3240c8c0 1 < completed multipart upload key=C8T6DB9V9FBT upload=B60TD5JXU79T tag=3NC8J3FQ3JXY type=write size=3536556 2024-09-19T13:47:26.340 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.337+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=LGNFOK61FSL0 type=write size=130488 2024-09-19T13:47:26.343 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.341+0000 7fcf3240c8c0 1 < completed write operation key=V8X0VBBNK83J tag=JCCCL2PTP872 type=write size=931604 2024-09-19T13:47:26.346 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.341+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=8ZSB2Z4W3DOP type=write size=521876 2024-09-19T13:47:26.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.349+0000 7fcf3240c8c0 1 < suggested update operation key=D20C6C2ZFX1W tag=V6X0F86ATFS2 type=del size=656833 2024-09-19T13:47:26.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.353+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=SZN2G60B43HG type=del size=3642781 2024-09-19T13:47:26.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.357+0000 7fcf3240c8c0 1 < completed write operation key=ES62XJO5Q3FO tag=67JUDM4OS8AR type=write size=840891 2024-09-19T13:47:26.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.361+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~KTYVFAGTY6AC.0 size=1048576 2024-09-19T13:47:26.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.361+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~KTYVFAGTY6AC.1 size=1048576 2024-09-19T13:47:26.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.365+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~KTYVFAGTY6AC.2 size=878253 2024-09-19T13:47:26.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.365+0000 7fcf3240c8c0 1 > prepared multipart upload key=D1RMXGXS3O7Z upload=KTYVFAGTY6AC tag=32DYGEGU7XQ1 type=write size=4023981 2024-09-19T13:47:26.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.369+0000 7fcf3240c8c0 1 < canceled operation key=3TME221SA53E tag=DKUG5OD5FHG7 type=del size=2275327 2024-09-19T13:47:26.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.373+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=8L8U3ZDKM2W9 type=del size=2114314 2024-09-19T13:47:26.378 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.373+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~MFHMYNKD8KSF.0 size=873014 2024-09-19T13:47:26.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.381+0000 7fcf3240c8c0 1 < completed multipart upload key=C8T6DB9V9FBT upload=MFHMYNKD8KSF tag=95JMACQ8HVSE type=write size=1921590 2024-09-19T13:47:26.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.385+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=CW72NWXXPAKM type=del size=2659672 2024-09-19T13:47:26.390 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.385+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~CZ57QPW96HO7.0 size=1048576 2024-09-19T13:47:26.393 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.389+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~CZ57QPW96HO7.1 size=124066 2024-09-19T13:47:26.397 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.393+0000 7fcf3240c8c0 1 < completed multipart upload key=AES54TJK7VH7 upload=CZ57QPW96HO7 tag=AX3IL06VCJWE type=write size=2221218 2024-09-19T13:47:26.401 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.397+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=SU9RCLP9D4O9 type=del size=2977066 2024-09-19T13:47:26.404 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.401+0000 7fcf3240c8c0 1 < completed part key=_multipart_0U9BUX9DHTAK.2~7FE7BQUQWVQJ.0 size=1048576 2024-09-19T13:47:26.407 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.405+0000 7fcf3240c8c0 1 < completed part key=_multipart_0U9BUX9DHTAK.2~7FE7BQUQWVQJ.1 size=488043 2024-09-19T13:47:26.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.409+0000 7fcf3240c8c0 1 < completed multipart upload key=0U9BUX9DHTAK upload=7FE7BQUQWVQJ tag=CO2MMRVD1D52 type=write size=2585195 2024-09-19T13:47:26.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.413+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~JWEQNHSH57DK.0 size=714791 2024-09-19T13:47:26.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.413+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=JWEQNHSH57DK tag=8C7HEH8DYFTM type=write size=1763367 2024-09-19T13:47:26.424 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.421+0000 7fcf3240c8c0 1 < suggested update operation key=71Z2VTW99W7J tag=RYIND3XMS1Z5 type=del size=127302 2024-09-19T13:47:26.427 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.425+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=IUGWVZ7MQQ07 type=write size=860877 2024-09-19T13:47:26.430 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.429+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~G8T4A90E5AVL.0 size=1048576 2024-09-19T13:47:26.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.429+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~G8T4A90E5AVL.1 size=1048576 2024-09-19T13:47:26.435 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.433+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~G8T4A90E5AVL.2 size=245065 2024-09-19T13:47:26.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.437+0000 7fcf3240c8c0 1 < completed multipart upload key=6DFF2OCPT9W2 upload=G8T4A90E5AVL tag=XTWAJVH6OYOQ type=write size=3390793 2024-09-19T13:47:26.446 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.441+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~HA4WY7XYJEC6.0 size=1048576 2024-09-19T13:47:26.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.445+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~HA4WY7XYJEC6.1 size=50218 2024-09-19T13:47:26.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.445+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=HA4WY7XYJEC6 tag=EN3G4RMB7IG7 type=write size=2147370 2024-09-19T13:47:26.451 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.449+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~BXPSRFZT2J3N.0 size=1048576 2024-09-19T13:47:26.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.449+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~BXPSRFZT2J3N.1 size=1048576 2024-09-19T13:47:26.456 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.453+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~BXPSRFZT2J3N.2 size=360726 2024-09-19T13:47:26.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.461+0000 7fcf3240c8c0 1 < completed multipart upload key=3TME221SA53E upload=BXPSRFZT2J3N tag=QJ8VVVIHDXWI type=write size=3506454 2024-09-19T13:47:26.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.461+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=GWUP3YY5YTXB type=del size=1777547 2024-09-19T13:47:26.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.465+0000 7fcf3240c8c0 1 < completed delete operation key=C35EUAOWLBR3 tag=RWIL1XT09H4O type=del 2024-09-19T13:47:26.472 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.469+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=FVTIDVUJBRTM type=del size=3103576 2024-09-19T13:47:26.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.473+0000 7fcf3240c8c0 1 < canceled operation key=NP2L28YRVQ8L tag=DA2RSE48BNZ0 type=del size=561980 2024-09-19T13:47:26.479 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.477+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=VQGVO75UQD6T type=del size=4092860 2024-09-19T13:47:26.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.481+0000 7fcf3240c8c0 1 < completed delete operation key=V8X0VBBNK83J tag=WDDP8AV6MM26 type=del 2024-09-19T13:47:26.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.485+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0U9BUX9DHTAK.2~15QR6FK5LGW9.0 size=162262 2024-09-19T13:47:26.490 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.485+0000 7fcf3240c8c0 1 > prepared multipart upload key=0U9BUX9DHTAK upload=15QR6FK5LGW9 tag=Y7D6J7R476GJ type=write size=1210838 2024-09-19T13:47:26.493 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.489+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~L7RP0SAZUTW0.0 size=1048576 2024-09-19T13:47:26.496 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.493+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~L7RP0SAZUTW0.1 size=918499 2024-09-19T13:47:26.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.497+0000 7fcf3240c8c0 1 < completed multipart upload key=ZCKKQ1R8318S upload=L7RP0SAZUTW0 tag=Z3OJ5MGWGQG6 type=write size=3015651 2024-09-19T13:47:26.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.501+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=7TW3A1WJG713 type=del size=1418494 2024-09-19T13:47:26.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.505+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~2NYK8Q5ELOIO.0 size=1048576 2024-09-19T13:47:26.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.509+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~2NYK8Q5ELOIO.1 size=743079 2024-09-19T13:47:26.516 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.513+0000 7fcf3240c8c0 1 < completed multipart upload key=QSM2Q8CW1Q86 upload=2NYK8Q5ELOIO tag=CIVMDATRTDVI type=write size=2840231 2024-09-19T13:47:26.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.517+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=1N0MDDSPQ0DT type=del size=976737 2024-09-19T13:47:26.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.525+0000 7fcf3240c8c0 1 < suggested remove operation key=DHPONKOVS8CT tag=LGNFOK61FSL0 type=write 2024-09-19T13:47:26.530 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.525+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=0NI88R317AUP type=del size=3028365 2024-09-19T13:47:26.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.533+0000 7fcf3240c8c0 1 < suggested remove operation key=M2CO4A2DHJ05 tag=8ZSB2Z4W3DOP type=write 2024-09-19T13:47:26.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.537+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=IIA71NT0U8QI type=del size=2072312 2024-09-19T13:47:26.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.541+0000 7fcf3240c8c0 1 < completed delete operation key=STMT6XU2EJQM tag=SZN2G60B43HG type=del 2024-09-19T13:47:26.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.545+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=UT3XUWZ0F2HO type=del size=4015544 2024-09-19T13:47:26.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.545+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~KTYVFAGTY6AC.0 size=1048576 2024-09-19T13:47:26.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.549+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~KTYVFAGTY6AC.1 size=1048576 2024-09-19T13:47:26.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.553+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~KTYVFAGTY6AC.2 size=878253 2024-09-19T13:47:26.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.557+0000 7fcf3240c8c0 1 < completed multipart upload key=D1RMXGXS3O7Z upload=KTYVFAGTY6AC tag=32DYGEGU7XQ1 type=write size=4023981 2024-09-19T13:47:26.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.565+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~0UL3TL58NVI4.0 size=1048576 2024-09-19T13:47:26.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.569+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~0UL3TL58NVI4.1 size=1048576 2024-09-19T13:47:26.573 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.569+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~0UL3TL58NVI4.2 size=904582 2024-09-19T13:47:26.573 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.569+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=0UL3TL58NVI4 tag=E43ZZBB6FPN3 type=write size=4050310 2024-09-19T13:47:26.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.577+0000 7fcf3240c8c0 1 < suggested remove operation key=OA9BMSXGYR9T tag=8L8U3ZDKM2W9 type=del 2024-09-19T13:47:26.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.581+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=MITIC3XF1V0H type=del size=3518019 2024-09-19T13:47:26.586 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.581+0000 7fcf3240c8c0 1 < completed delete operation key=1BMF3S2BZLLI tag=CW72NWXXPAKM type=del 2024-09-19T13:47:26.591 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.589+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~AYS9HMSXTZ61.0 size=1048576 2024-09-19T13:47:26.593 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.589+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~AYS9HMSXTZ61.1 size=10387 2024-09-19T13:47:26.593 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.589+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=AYS9HMSXTZ61 tag=YZJK0S50K31S type=write size=2107539 2024-09-19T13:47:26.596 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.593+0000 7fcf3240c8c0 1 < completed delete operation key=0UCFTOF1YBBM tag=SU9RCLP9D4O9 type=del 2024-09-19T13:47:26.599 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.597+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=5O6O1M9UKV4E type=del size=1093405 2024-09-19T13:47:26.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.597+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~JWEQNHSH57DK.0 size=714791 2024-09-19T13:47:26.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.601+0000 7fcf3240c8c0 1 < completed multipart upload key=ZCKKQ1R8318S upload=JWEQNHSH57DK tag=8C7HEH8DYFTM type=write size=1763367 2024-09-19T13:47:26.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.605+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=KJ0Y9415PLXC type=del size=3181887 2024-09-19T13:47:26.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.613+0000 7fcf3240c8c0 1 < suggested remove operation key=D20C6C2ZFX1W tag=IUGWVZ7MQQ07 type=write 2024-09-19T13:47:26.617 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.613+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=591IMF4GKEY6 type=del size=11357 2024-09-19T13:47:26.620 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.617+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~HA4WY7XYJEC6.0 size=1048576 2024-09-19T13:47:26.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.617+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~HA4WY7XYJEC6.1 size=50218 2024-09-19T13:47:26.626 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.621+0000 7fcf3240c8c0 1 < completed multipart upload key=QAYJ5B1KZ08J upload=HA4WY7XYJEC6 tag=EN3G4RMB7IG7 type=write size=2147370 2024-09-19T13:47:26.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.629+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~BZIRXGCK56EM.0 size=592051 2024-09-19T13:47:26.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.629+0000 7fcf3240c8c0 1 > prepared multipart upload key=DHPONKOVS8CT upload=BZIRXGCK56EM tag=6KEIKT3ILI00 type=write size=1640627 2024-09-19T13:47:26.634 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.633+0000 7fcf3240c8c0 1 < completed delete operation key=C35EUAOWLBR3 tag=GWUP3YY5YTXB type=del 2024-09-19T13:47:26.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.633+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=TCIE7ATIS4UQ type=del size=55932 2024-09-19T13:47:26.641 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.637+0000 7fcf3240c8c0 -1 < failed to complete operation key=D20C6C2ZFX1W tag=FVTIDVUJBRTM type=del size=3103576: (22) Invalid argument 2024-09-19T13:47:26.647 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.645+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~9I14RUDR80UF.0 size=1048576 2024-09-19T13:47:26.650 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.645+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~9I14RUDR80UF.1 size=147343 2024-09-19T13:47:26.650 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.645+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=9I14RUDR80UF tag=ADUXX8WYONOA type=write size=2244495 2024-09-19T13:47:26.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.649+0000 7fcf3240c8c0 1 < completed delete operation key=V8X0VBBNK83J tag=VQGVO75UQD6T type=del 2024-09-19T13:47:26.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.653+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=0GXXXKQPWV84 type=del size=2416883 2024-09-19T13:47:26.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.653+0000 7fcf3240c8c0 1 < completed part key=_multipart_0U9BUX9DHTAK.2~15QR6FK5LGW9.0 size=162262 2024-09-19T13:47:26.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.657+0000 7fcf3240c8c0 1 < completed multipart upload key=0U9BUX9DHTAK upload=15QR6FK5LGW9 tag=Y7D6J7R476GJ type=write size=1210838 2024-09-19T13:47:26.664 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.661+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=N1EIF5NT5BJO type=del size=998478 2024-09-19T13:47:26.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.665+0000 7fcf3240c8c0 1 < suggested update operation key=A02RDP6BA9AC tag=7TW3A1WJG713 type=del size=1418494 2024-09-19T13:47:26.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.669+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~SQB6J46CCIAO.0 size=916755 2024-09-19T13:47:26.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.669+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=SQB6J46CCIAO tag=FZD857ENP47X type=write size=1965331 2024-09-19T13:47:26.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.673+0000 7fcf3240c8c0 1 < completed delete operation key=V8X0VBBNK83J tag=1N0MDDSPQ0DT type=del 2024-09-19T13:47:26.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.673+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=YSX7MVITK8QF type=del size=687977 2024-09-19T13:47:26.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.677+0000 7fcf3240c8c0 1 < completed delete operation key=X16ENUFL40RN tag=0NI88R317AUP type=del 2024-09-19T13:47:26.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.681+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~V3UPZYC2XR3R.0 size=1048576 2024-09-19T13:47:26.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.685+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~V3UPZYC2XR3R.1 size=697100 2024-09-19T13:47:26.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.685+0000 7fcf3240c8c0 1 > prepared multipart upload key=X9FGPMP30X47 upload=V3UPZYC2XR3R tag=FM0F3ILGSY8P type=write size=2794252 2024-09-19T13:47:26.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.685+0000 7fcf3240c8c0 1 < completed delete operation key=STMT6XU2EJQM tag=IIA71NT0U8QI type=del 2024-09-19T13:47:26.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.689+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~40Z3GHZPIDYG.0 size=216666 2024-09-19T13:47:26.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.689+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=40Z3GHZPIDYG tag=7L61ANPTY07N type=write size=1265242 2024-09-19T13:47:26.696 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.693+0000 7fcf3240c8c0 1 < canceled operation key=AES54TJK7VH7 tag=UT3XUWZ0F2HO type=del size=4015544 2024-09-19T13:47:26.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.693+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=S1XL3W71YPTN type=write size=803543 2024-09-19T13:47:26.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.697+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~0UL3TL58NVI4.0 size=1048576 2024-09-19T13:47:26.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.697+0000 7fcf3240c8c0 1 < canceled part key=_multipart_AES54TJK7VH7.2~0UL3TL58NVI4.1 size=1048576 2024-09-19T13:47:26.702 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.697+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~0UL3TL58NVI4.2 size=904582 2024-09-19T13:47:26.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.701+0000 7fcf3240c8c0 1 < canceled multipart upload key=AES54TJK7VH7 upload=0UL3TL58NVI4 tag=E43ZZBB6FPN3 type=write size=4050310 2024-09-19T13:47:26.707 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.705+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=LEIP48TR769S type=del size=3379484 2024-09-19T13:47:26.710 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.705+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=MITIC3XF1V0H type=del 2024-09-19T13:47:26.714 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.709+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~0RJW2ZS60AL8.0 size=1048576 2024-09-19T13:47:26.715 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.713+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~0RJW2ZS60AL8.1 size=1048576 2024-09-19T13:47:26.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.713+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~0RJW2ZS60AL8.2 size=86848 2024-09-19T13:47:26.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.713+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=0RJW2ZS60AL8 tag=4KKQA9OPKIJA type=write size=3232576 2024-09-19T13:47:26.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.717+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~AYS9HMSXTZ61.0 size=1048576 2024-09-19T13:47:26.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.717+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~AYS9HMSXTZ61.1 size=10387 2024-09-19T13:47:26.725 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.721+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=AYS9HMSXTZ61 tag=YZJK0S50K31S type=write size=2107539 2024-09-19T13:47:26.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.725+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=5LKLKT0TBB7E type=del size=1089016 2024-09-19T13:47:26.731 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.729+0000 7fcf3240c8c0 1 < suggested remove operation key=7UC85R2HO9K2 tag=5O6O1M9UKV4E type=del 2024-09-19T13:47:26.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.729+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=TIPRE7B9X61X type=write size=1011939 2024-09-19T13:47:26.736 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.733+0000 7fcf3240c8c0 1 < canceled operation key=QAYJ5B1KZ08J tag=KJ0Y9415PLXC type=del size=3181887 2024-09-19T13:47:26.738 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.733+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=1DV30VR056WR type=del size=3894480 2024-09-19T13:47:26.741 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.737+0000 7fcf3240c8c0 1 < canceled operation key=OA9BMSXGYR9T tag=591IMF4GKEY6 type=del size=11357 2024-09-19T13:47:26.743 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.741+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=6H7A6AN843KZ type=write size=602308 2024-09-19T13:47:26.746 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.741+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~BZIRXGCK56EM.0 size=592051 2024-09-19T13:47:26.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.745+0000 7fcf3240c8c0 1 < completed multipart upload key=DHPONKOVS8CT upload=BZIRXGCK56EM tag=6KEIKT3ILI00 type=write size=1640627 2024-09-19T13:47:26.755 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.753+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~1F7LPRJXOWQG.0 size=1048576 2024-09-19T13:47:26.756 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.753+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~1F7LPRJXOWQG.1 size=1048576 2024-09-19T13:47:26.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.757+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~1F7LPRJXOWQG.2 size=263119 2024-09-19T13:47:26.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.757+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=1F7LPRJXOWQG tag=A9NY4FL0FNJG type=write size=3408847 2024-09-19T13:47:26.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.757+0000 7fcf3240c8c0 1 < completed delete operation key=6DFF2OCPT9W2 tag=TCIE7ATIS4UQ type=del 2024-09-19T13:47:26.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.761+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=30H0RD419K23 type=del size=2419555 2024-09-19T13:47:26.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.761+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~9I14RUDR80UF.0 size=1048576 2024-09-19T13:47:26.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.765+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~9I14RUDR80UF.1 size=147343 2024-09-19T13:47:26.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.769+0000 7fcf3240c8c0 1 < completed multipart upload key=ZCKKQ1R8318S upload=9I14RUDR80UF tag=ADUXX8WYONOA type=write size=2244495 2024-09-19T13:47:26.776 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.773+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~HNRGWTG5ZGLW.0 size=1048576 2024-09-19T13:47:26.778 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.773+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~HNRGWTG5ZGLW.1 size=1048576 2024-09-19T13:47:26.779 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.777+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~HNRGWTG5ZGLW.2 size=774691 2024-09-19T13:47:26.780 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.777+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=HNRGWTG5ZGLW tag=R5XJ7DMUTJ6E type=write size=3920419 2024-09-19T13:47:26.782 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.777+0000 7fcf3240c8c0 1 < completed delete operation key=M2CO4A2DHJ05 tag=0GXXXKQPWV84 type=del 2024-09-19T13:47:26.784 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.781+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=4AXCE9U2LQTY type=del size=2320337 2024-09-19T13:47:26.786 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.785+0000 7fcf3240c8c0 1 < completed delete operation key=1BMF3S2BZLLI tag=N1EIF5NT5BJO type=del 2024-09-19T13:47:26.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.785+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=3FGAXQUWX8C6 type=del size=4148796 2024-09-19T13:47:26.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.789+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~SQB6J46CCIAO.0 size=916755 2024-09-19T13:47:26.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.793+0000 7fcf3240c8c0 1 < completed multipart upload key=ES62XJO5Q3FO upload=SQB6J46CCIAO tag=FZD857ENP47X type=write size=1965331 2024-09-19T13:47:26.797 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.793+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=R0XDP7WAUTWK type=write size=1020027 2024-09-19T13:47:26.800 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.797+0000 7fcf3240c8c0 1 < completed delete operation key=D1RMXGXS3O7Z tag=YSX7MVITK8QF type=del 2024-09-19T13:47:26.803 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.801+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=1J1HF4XS6GYB type=del size=4186139 2024-09-19T13:47:26.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.805+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~V3UPZYC2XR3R.0 size=1048576 2024-09-19T13:47:26.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.809+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~V3UPZYC2XR3R.1 size=697100 2024-09-19T13:47:26.816 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.813+0000 7fcf3240c8c0 1 < completed multipart upload key=X9FGPMP30X47 upload=V3UPZYC2XR3R tag=FM0F3ILGSY8P type=write size=2794252 2024-09-19T13:47:26.818 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.817+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=VYWZEHOM0799 type=del size=2036169 2024-09-19T13:47:26.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.817+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~40Z3GHZPIDYG.0 size=216666 2024-09-19T13:47:26.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.821+0000 7fcf3240c8c0 1 < completed multipart upload key=AES54TJK7VH7 upload=40Z3GHZPIDYG tag=7L61ANPTY07N type=write size=1265242 2024-09-19T13:47:26.828 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.825+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=6W99E61AVXLG type=write size=190937 2024-09-19T13:47:26.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.829+0000 7fcf3240c8c0 1 < completed write operation key=DHPONKOVS8CT tag=S1XL3W71YPTN type=write size=803543 2024-09-19T13:47:26.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.829+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=33MEZBA1HIKN type=del size=3755813 2024-09-19T13:47:26.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.833+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=LEIP48TR769S type=del 2024-09-19T13:47:26.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.837+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=P1IRZKME35MJ type=del size=2350905 2024-09-19T13:47:26.843 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.841+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~0RJW2ZS60AL8.0 size=1048576 2024-09-19T13:47:26.845 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.841+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~0RJW2ZS60AL8.1 size=1048576 2024-09-19T13:47:26.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.845+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~0RJW2ZS60AL8.2 size=86848 2024-09-19T13:47:26.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.849+0000 7fcf3240c8c0 1 < completed multipart upload key=0UCFTOF1YBBM upload=0RJW2ZS60AL8 tag=4KKQA9OPKIJA type=write size=3232576 2024-09-19T13:47:26.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.853+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~7ZB5ANUWFI0D.0 size=1048576 2024-09-19T13:47:26.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.857+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~7ZB5ANUWFI0D.1 size=1043447 2024-09-19T13:47:26.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.857+0000 7fcf3240c8c0 1 > prepared multipart upload key=6DFF2OCPT9W2 upload=7ZB5ANUWFI0D tag=451D6QRQ2XZO type=write size=3140599 2024-09-19T13:47:26.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.861+0000 7fcf3240c8c0 1 < suggested update operation key=C3TFYNXH549T tag=5LKLKT0TBB7E type=del size=1089016 2024-09-19T13:47:26.871 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.869+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~NB1U9X89JDNI.0 size=786584 2024-09-19T13:47:26.871 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.869+0000 7fcf3240c8c0 1 > prepared multipart upload key=OA9BMSXGYR9T upload=NB1U9X89JDNI tag=SBEZQ8TR4W9N type=write size=1835160 2024-09-19T13:47:26.874 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.869+0000 7fcf3240c8c0 1 < completed write operation key=N51Q6HKJSCCB tag=TIPRE7B9X61X type=write size=1011939 2024-09-19T13:47:26.878 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.877+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~V3M1CVDH8502.0 size=1048576 2024-09-19T13:47:26.881 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.877+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~V3M1CVDH8502.1 size=1048576 2024-09-19T13:47:26.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.881+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~V3M1CVDH8502.2 size=326447 2024-09-19T13:47:26.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.881+0000 7fcf3240c8c0 1 > prepared multipart upload key=1BMF3S2BZLLI upload=V3M1CVDH8502 tag=6LLUX1DTP45U type=write size=3472175 2024-09-19T13:47:26.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.885+0000 7fcf3240c8c0 1 < suggested update operation key=X16ENUFL40RN tag=1DV30VR056WR type=del size=3894480 2024-09-19T13:47:26.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.889+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~YRTIWFS8VMSG.0 size=110585 2024-09-19T13:47:26.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.889+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=YRTIWFS8VMSG tag=9L7CUKIMKXOQ type=write size=1159161 2024-09-19T13:47:26.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.893+0000 7fcf3240c8c0 1 < completed write operation key=0U9BUX9DHTAK tag=6H7A6AN843KZ type=write size=602308 2024-09-19T13:47:26.899 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.897+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=WGG65Q9XLILW type=del size=2590763 2024-09-19T13:47:26.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.897+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~1F7LPRJXOWQG.0 size=1048576 2024-09-19T13:47:26.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.897+0000 7fcf3240c8c0 1 < canceled part key=_multipart_ZCKKQ1R8318S.2~1F7LPRJXOWQG.1 size=1048576 2024-09-19T13:47:26.903 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.901+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~1F7LPRJXOWQG.2 size=263119 2024-09-19T13:47:26.908 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.905+0000 7fcf3240c8c0 1 < canceled multipart upload key=ZCKKQ1R8318S upload=1F7LPRJXOWQG tag=A9NY4FL0FNJG type=write size=3408847 2024-09-19T13:47:26.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.909+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~QEW0UYJHKEA6.0 size=899978 2024-09-19T13:47:26.914 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.909+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=QEW0UYJHKEA6 tag=D6VV0EQ7BNPI type=write size=1948554 2024-09-19T13:47:26.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.913+0000 7fcf3240c8c0 1 < completed delete operation key=HXMZKP7H3HJE tag=30H0RD419K23 type=del 2024-09-19T13:47:26.919 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.917+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=UYO0BKIMHSMC type=del size=3743244 2024-09-19T13:47:26.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.917+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~HNRGWTG5ZGLW.0 size=1048576 2024-09-19T13:47:26.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.921+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~HNRGWTG5ZGLW.1 size=1048576 2024-09-19T13:47:26.926 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.921+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~HNRGWTG5ZGLW.2 size=774691 2024-09-19T13:47:26.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.929+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=HNRGWTG5ZGLW tag=R5XJ7DMUTJ6E type=write size=3920419 2024-09-19T13:47:26.935 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.933+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=ZH250IKG61XB type=del size=137382 2024-09-19T13:47:26.938 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.937+0000 7fcf3240c8c0 1 < completed delete operation key=A02RDP6BA9AC tag=4AXCE9U2LQTY type=del 2024-09-19T13:47:26.941 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.937+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=ECGB4M01JU34 type=del size=339418 2024-09-19T13:47:26.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.941+0000 7fcf3240c8c0 1 < completed delete operation key=BXUPV5XSJBTH tag=3FGAXQUWX8C6 type=del 2024-09-19T13:47:26.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.949+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~TNW5IN33D1RN.0 size=1048576 2024-09-19T13:47:26.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.949+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~TNW5IN33D1RN.1 size=1048576 2024-09-19T13:47:26.956 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.953+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~TNW5IN33D1RN.2 size=529286 2024-09-19T13:47:26.956 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.953+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=TNW5IN33D1RN tag=909F1K29LG4X type=write size=3675014 2024-09-19T13:47:26.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.957+0000 7fcf3240c8c0 -1 < failed to complete operation key=C3TFYNXH549T tag=R0XDP7WAUTWK type=write size=1020027: (22) Invalid argument 2024-09-19T13:47:26.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.961+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=510EHVCON0DM type=del size=1677956 2024-09-19T13:47:26.966 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.961+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=1J1HF4XS6GYB type=del 2024-09-19T13:47:26.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.965+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=RFR7R85BJDDC type=write size=860055 2024-09-19T13:47:26.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.969+0000 7fcf3240c8c0 1 < completed delete operation key=0U9BUX9DHTAK tag=VYWZEHOM0799 type=del 2024-09-19T13:47:26.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.973+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=DEKE6M84HKET type=del size=2768741 2024-09-19T13:47:26.979 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.977+0000 7fcf3240c8c0 1 < completed write operation key=0UCFTOF1YBBM tag=6W99E61AVXLG type=write size=190937 2024-09-19T13:47:26.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.981+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=TLWTC91AMHRD type=del size=1584877 2024-09-19T13:47:26.987 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.985+0000 7fcf3240c8c0 -1 < failed to complete operation key=X16ENUFL40RN tag=33MEZBA1HIKN type=del size=3755813: (22) Invalid argument 2024-09-19T13:47:26.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.985+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=KBGUV8IRGGUX type=write size=830686 2024-09-19T13:47:26.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.993+0000 7fcf3240c8c0 1 < suggested update operation key=XE42LV5M5X82 tag=P1IRZKME35MJ type=del size=2350905 2024-09-19T13:47:27.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:26.997+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=CAQS7476RONY type=del size=3724354 2024-09-19T13:47:27.004 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.001+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~7ZB5ANUWFI0D.0 size=1048576 2024-09-19T13:47:27.006 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.005+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~7ZB5ANUWFI0D.1 size=1043447 2024-09-19T13:47:27.012 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.009+0000 7fcf3240c8c0 1 < completed multipart upload key=6DFF2OCPT9W2 upload=7ZB5ANUWFI0D tag=451D6QRQ2XZO type=write size=3140599 2024-09-19T13:47:27.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.013+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~AZQGOBKLW0Q1.0 size=1048576 2024-09-19T13:47:27.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.017+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~AZQGOBKLW0Q1.1 size=1048576 2024-09-19T13:47:27.024 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.021+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~AZQGOBKLW0Q1.2 size=393145 2024-09-19T13:47:27.024 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.021+0000 7fcf3240c8c0 1 > prepared multipart upload key=V8X0VBBNK83J upload=AZQGOBKLW0Q1 tag=4ORJISSTM8OX type=write size=3538873 2024-09-19T13:47:27.027 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.025+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~NB1U9X89JDNI.0 size=786584 2024-09-19T13:47:27.033 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.029+0000 7fcf3240c8c0 1 < completed multipart upload key=OA9BMSXGYR9T upload=NB1U9X89JDNI tag=SBEZQ8TR4W9N type=write size=1835160 2024-09-19T13:47:27.037 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.033+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=PDFV0W2LVNW7 type=del size=2208107 2024-09-19T13:47:27.041 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.037+0000 7fcf3240c8c0 1 < completed part key=_multipart_1BMF3S2BZLLI.2~V3M1CVDH8502.0 size=1048576 2024-09-19T13:47:27.043 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.041+0000 7fcf3240c8c0 1 < completed part key=_multipart_1BMF3S2BZLLI.2~V3M1CVDH8502.1 size=1048576 2024-09-19T13:47:27.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.041+0000 7fcf3240c8c0 1 < completed part key=_multipart_1BMF3S2BZLLI.2~V3M1CVDH8502.2 size=326447 2024-09-19T13:47:27.051 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.049+0000 7fcf3240c8c0 1 < completed multipart upload key=1BMF3S2BZLLI upload=V3M1CVDH8502 tag=6LLUX1DTP45U type=write size=3472175 2024-09-19T13:47:27.057 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.053+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~HZRZN55NCIS7.0 size=572116 2024-09-19T13:47:27.057 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.053+0000 7fcf3240c8c0 1 > prepared multipart upload key=A02RDP6BA9AC upload=HZRZN55NCIS7 tag=IHSTJW009AWO type=write size=1620692 2024-09-19T13:47:27.060 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.057+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~YRTIWFS8VMSG.0 size=110585 2024-09-19T13:47:27.065 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.061+0000 7fcf3240c8c0 1 < completed multipart upload key=N51Q6HKJSCCB upload=YRTIWFS8VMSG tag=9L7CUKIMKXOQ type=write size=1159161 2024-09-19T13:47:27.069 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.065+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=ZPRPLQ54RV7V type=del size=1386644 2024-09-19T13:47:27.073 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.069+0000 7fcf3240c8c0 1 < completed delete operation key=QSM2Q8CW1Q86 tag=WGG65Q9XLILW type=del 2024-09-19T13:47:27.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.077+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~26LOMNKC6NO7.0 size=697146 2024-09-19T13:47:27.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.077+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=26LOMNKC6NO7 tag=EWR7FB86GW7E type=write size=1745722 2024-09-19T13:47:27.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.081+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~QEW0UYJHKEA6.0 size=899978 2024-09-19T13:47:27.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.085+0000 7fcf3240c8c0 1 < completed multipart upload key=N51Q6HKJSCCB upload=QEW0UYJHKEA6 tag=D6VV0EQ7BNPI type=write size=1948554 2024-09-19T13:47:27.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.089+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=L7COKUCL3P3V type=del size=2642382 2024-09-19T13:47:27.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.097+0000 7fcf3240c8c0 1 < completed delete operation key=C8T6DB9V9FBT tag=UYO0BKIMHSMC type=del 2024-09-19T13:47:27.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.101+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=23H5CRBYVGT0 type=del size=319336 2024-09-19T13:47:27.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.105+0000 7fcf3240c8c0 1 < suggested update operation key=71Z2VTW99W7J tag=ZH250IKG61XB type=del size=137382 2024-09-19T13:47:27.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.109+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=9KOROGLL113M type=del size=260347 2024-09-19T13:47:27.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.117+0000 7fcf3240c8c0 1 < suggested update operation key=M2CO4A2DHJ05 tag=ECGB4M01JU34 type=del size=339418 2024-09-19T13:47:27.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.121+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=0VG1OFG6985S type=del size=441134 2024-09-19T13:47:27.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.125+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~TNW5IN33D1RN.0 size=1048576 2024-09-19T13:47:27.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.125+0000 7fcf3240c8c0 1 < canceled part key=_multipart_7UC85R2HO9K2.2~TNW5IN33D1RN.1 size=1048576 2024-09-19T13:47:27.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.125+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~TNW5IN33D1RN.2 size=529286 2024-09-19T13:47:27.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.133+0000 7fcf3240c8c0 1 < canceled multipart upload key=7UC85R2HO9K2 upload=TNW5IN33D1RN tag=909F1K29LG4X type=write size=3675014 2024-09-19T13:47:27.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.137+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0U9BUX9DHTAK.2~00GQE4RLTRKK.0 size=328797 2024-09-19T13:47:27.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.137+0000 7fcf3240c8c0 1 > prepared multipart upload key=0U9BUX9DHTAK upload=00GQE4RLTRKK tag=INRP7WLBSHXU type=write size=1377373 2024-09-19T13:47:27.144 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.141+0000 7fcf3240c8c0 1 < completed delete operation key=X16ENUFL40RN tag=510EHVCON0DM type=del 2024-09-19T13:47:27.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.145+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~0BAKIJVPIA3T.0 size=1048576 2024-09-19T13:47:27.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.149+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~0BAKIJVPIA3T.1 size=1048576 2024-09-19T13:47:27.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.153+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~0BAKIJVPIA3T.2 size=557517 2024-09-19T13:47:27.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.153+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=0BAKIJVPIA3T tag=EDVJE0LB1XEV type=write size=3703245 2024-09-19T13:47:27.163 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.161+0000 7fcf3240c8c0 1 < suggested remove operation key=XE42LV5M5X82 tag=RFR7R85BJDDC type=write 2024-09-19T13:47:27.166 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.165+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=ICK2MCG542BG type=del size=3005677 2024-09-19T13:47:27.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.165+0000 7fcf3240c8c0 1 < completed delete operation key=DHPONKOVS8CT tag=DEKE6M84HKET type=del 2024-09-19T13:47:27.176 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.173+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~64W12K9G3414.0 size=1048576 2024-09-19T13:47:27.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.177+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~64W12K9G3414.1 size=1048576 2024-09-19T13:47:27.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.177+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~64W12K9G3414.2 size=705230 2024-09-19T13:47:27.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.177+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=64W12K9G3414 tag=U8BZN992JDJX type=write size=3850958 2024-09-19T13:47:27.186 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.181+0000 7fcf3240c8c0 1 < canceled operation key=V8X0VBBNK83J tag=TLWTC91AMHRD type=del size=1584877 2024-09-19T13:47:27.189 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.185+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=0HUK24CR7IA4 type=write size=791771 2024-09-19T13:47:27.192 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.189+0000 7fcf3240c8c0 1 < completed write operation key=A02RDP6BA9AC tag=KBGUV8IRGGUX type=write size=830686 2024-09-19T13:47:27.196 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.193+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=DVV3J9P79JBE type=del size=3302180 2024-09-19T13:47:27.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.197+0000 7fcf3240c8c0 1 < completed delete operation key=N51Q6HKJSCCB tag=CAQS7476RONY type=del 2024-09-19T13:47:27.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.201+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=3322AGBGR7I4 type=del size=1649402 2024-09-19T13:47:27.207 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.205+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~AZQGOBKLW0Q1.0 size=1048576 2024-09-19T13:47:27.210 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.205+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~AZQGOBKLW0Q1.1 size=1048576 2024-09-19T13:47:27.213 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.209+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~AZQGOBKLW0Q1.2 size=393145 2024-09-19T13:47:27.219 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.217+0000 7fcf3240c8c0 1 < completed multipart upload key=V8X0VBBNK83J upload=AZQGOBKLW0Q1 tag=4ORJISSTM8OX type=write size=3538873 2024-09-19T13:47:27.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.221+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~6O5AO5S06NVH.0 size=1048576 2024-09-19T13:47:27.228 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.225+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~6O5AO5S06NVH.1 size=892652 2024-09-19T13:47:27.228 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.225+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=6O5AO5S06NVH tag=G1AH0TDF60I8 type=write size=2989804 2024-09-19T13:47:27.231 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.229+0000 7fcf3240c8c0 1 < canceled operation key=X9FGPMP30X47 tag=PDFV0W2LVNW7 type=del size=2208107 2024-09-19T13:47:27.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.233+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=F3JDHD9XAT45 type=del size=1913622 2024-09-19T13:47:27.235 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.233+0000 7fcf3240c8c0 1 < canceled part key=_multipart_A02RDP6BA9AC.2~HZRZN55NCIS7.0 size=572116 2024-09-19T13:47:27.241 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.237+0000 7fcf3240c8c0 1 < canceled multipart upload key=A02RDP6BA9AC upload=HZRZN55NCIS7 tag=IHSTJW009AWO type=write size=1620692 2024-09-19T13:47:27.244 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.241+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=88MIDPZWZNFW type=del size=2298015 2024-09-19T13:47:27.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.245+0000 7fcf3240c8c0 1 < completed delete operation key=A02RDP6BA9AC tag=ZPRPLQ54RV7V type=del 2024-09-19T13:47:27.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.249+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=85Z23RFICHEW type=del size=386773 2024-09-19T13:47:27.255 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.253+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~26LOMNKC6NO7.0 size=697146 2024-09-19T13:47:27.261 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.257+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=26LOMNKC6NO7 tag=EWR7FB86GW7E type=write size=1745722 2024-09-19T13:47:27.267 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.265+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~0VWC124CUC5A.0 size=1048576 2024-09-19T13:47:27.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.265+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~0VWC124CUC5A.1 size=278186 2024-09-19T13:47:27.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.265+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=0VWC124CUC5A tag=652GT8NTUTLE type=write size=2375338 2024-09-19T13:47:27.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.269+0000 7fcf3240c8c0 1 < completed delete operation key=6DFF2OCPT9W2 tag=L7COKUCL3P3V type=del 2024-09-19T13:47:27.277 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.273+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=P63T6NQ4XOVL type=write size=948828 2024-09-19T13:47:27.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.277+0000 7fcf3240c8c0 -1 < failed to complete operation key=XE42LV5M5X82 tag=23H5CRBYVGT0 type=del size=319336: (22) Invalid argument 2024-09-19T13:47:27.284 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.281+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=5Q9FA5K1SVT3 type=del size=2744928 2024-09-19T13:47:27.287 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.285+0000 7fcf3240c8c0 -1 < failed to complete operation key=XE42LV5M5X82 tag=9KOROGLL113M type=del size=260347: (22) Invalid argument 2024-09-19T13:47:27.293 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.289+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~PIC3BS0D5A6L.0 size=180384 2024-09-19T13:47:27.293 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.289+0000 7fcf3240c8c0 1 > prepared multipart upload key=OA9BMSXGYR9T upload=PIC3BS0D5A6L tag=AITIEQSUU29E type=write size=1228960 2024-09-19T13:47:27.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.293+0000 7fcf3240c8c0 1 < completed delete operation key=X9FGPMP30X47 tag=0VG1OFG6985S type=del 2024-09-19T13:47:27.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.301+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~NK2EYLZV9SL8.0 size=1048576 2024-09-19T13:47:27.305 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.301+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~NK2EYLZV9SL8.1 size=621752 2024-09-19T13:47:27.305 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.301+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=NK2EYLZV9SL8 tag=93W2TS734L3P type=write size=2718904 2024-09-19T13:47:27.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.305+0000 7fcf3240c8c0 1 < completed part key=_multipart_0U9BUX9DHTAK.2~00GQE4RLTRKK.0 size=328797 2024-09-19T13:47:27.314 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.309+0000 7fcf3240c8c0 1 < completed multipart upload key=0U9BUX9DHTAK upload=00GQE4RLTRKK tag=INRP7WLBSHXU type=write size=1377373 2024-09-19T13:47:27.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.313+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=3QS2ZO4BC5D3 type=del size=2347816 2024-09-19T13:47:27.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.317+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~0BAKIJVPIA3T.0 size=1048576 2024-09-19T13:47:27.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.321+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~0BAKIJVPIA3T.1 size=1048576 2024-09-19T13:47:27.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.325+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~0BAKIJVPIA3T.2 size=557517 2024-09-19T13:47:27.332 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.329+0000 7fcf3240c8c0 1 < completed multipart upload key=M2CO4A2DHJ05 upload=0BAKIJVPIA3T tag=EDVJE0LB1XEV type=write size=3703245 2024-09-19T13:47:27.339 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.337+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~ZPMOHT6FDMPI.0 size=1048576 2024-09-19T13:47:27.342 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.337+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~ZPMOHT6FDMPI.1 size=641264 2024-09-19T13:47:27.342 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.337+0000 7fcf3240c8c0 1 > prepared multipart upload key=STMT6XU2EJQM upload=ZPMOHT6FDMPI tag=IBKA2OT511JO type=write size=2738416 2024-09-19T13:47:27.345 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.341+0000 7fcf3240c8c0 1 < completed delete operation key=NP2L28YRVQ8L tag=ICK2MCG542BG type=del 2024-09-19T13:47:27.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.345+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=72XUBEFU1YYN type=del size=4076105 2024-09-19T13:47:27.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.349+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~64W12K9G3414.0 size=1048576 2024-09-19T13:47:27.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.353+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~64W12K9G3414.1 size=1048576 2024-09-19T13:47:27.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.353+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~64W12K9G3414.2 size=705230 2024-09-19T13:47:27.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.361+0000 7fcf3240c8c0 1 < completed multipart upload key=N51Q6HKJSCCB upload=64W12K9G3414 tag=U8BZN992JDJX type=write size=3850958 2024-09-19T13:47:27.367 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.365+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=S6FPLTFFTX83 type=del size=3615519 2024-09-19T13:47:27.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.369+0000 7fcf3240c8c0 1 < completed write operation key=OA9BMSXGYR9T tag=0HUK24CR7IA4 type=write size=791771 2024-09-19T13:47:27.377 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.373+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~2XB329Z1OAFN.0 size=967346 2024-09-19T13:47:27.377 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.373+0000 7fcf3240c8c0 1 > prepared multipart upload key=STMT6XU2EJQM upload=2XB329Z1OAFN tag=2IXNW2C6T434 type=write size=2015922 2024-09-19T13:47:27.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.381+0000 7fcf3240c8c0 1 < suggested remove operation key=X9FGPMP30X47 tag=DVV3J9P79JBE type=del 2024-09-19T13:47:27.388 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.385+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=BYZ4MRICDGVD type=del size=2960764 2024-09-19T13:47:27.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.389+0000 7fcf3240c8c0 1 < completed delete operation key=3TME221SA53E tag=3322AGBGR7I4 type=del 2024-09-19T13:47:27.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.393+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=A0AX49SE9NZ7 type=del size=2544432 2024-09-19T13:47:27.400 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.397+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~6O5AO5S06NVH.0 size=1048576 2024-09-19T13:47:27.403 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.401+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~6O5AO5S06NVH.1 size=892652 2024-09-19T13:47:27.408 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.405+0000 7fcf3240c8c0 1 < completed multipart upload key=0UCFTOF1YBBM upload=6O5AO5S06NVH tag=G1AH0TDF60I8 type=write size=2989804 2024-09-19T13:47:27.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.409+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=LS8F0E3U9GC1 type=write size=48729 2024-09-19T13:47:27.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.413+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=F3JDHD9XAT45 type=del 2024-09-19T13:47:27.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.413+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=DNN82DZGSVA2 type=del size=3504252 2024-09-19T13:47:27.424 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.421+0000 7fcf3240c8c0 1 < completed delete operation key=QSM2Q8CW1Q86 tag=88MIDPZWZNFW type=del 2024-09-19T13:47:27.427 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.425+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=1MQYURFYMAF5 type=write size=268581 2024-09-19T13:47:27.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.429+0000 7fcf3240c8c0 1 < suggested update operation key=N51Q6HKJSCCB tag=85Z23RFICHEW type=del size=386773 2024-09-19T13:47:27.437 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.433+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=BTOLL3ZXA6H2 type=del size=2568024 2024-09-19T13:47:27.440 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.437+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~0VWC124CUC5A.0 size=1048576 2024-09-19T13:47:27.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.441+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~0VWC124CUC5A.1 size=278186 2024-09-19T13:47:27.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.445+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=0VWC124CUC5A tag=652GT8NTUTLE type=write size=2375338 2024-09-19T13:47:27.451 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.449+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=P5KVI8FLK4WE type=del size=420080 2024-09-19T13:47:27.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.449+0000 7fcf3240c8c0 1 < canceled operation key=DHPONKOVS8CT tag=P63T6NQ4XOVL type=write size=948828 2024-09-19T13:47:27.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.457+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~ILOKVKW90MMN.0 size=490287 2024-09-19T13:47:27.461 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.457+0000 7fcf3240c8c0 1 > prepared multipart upload key=V8X0VBBNK83J upload=ILOKVKW90MMN tag=CKLGJ7LZL1HO type=write size=1538863 2024-09-19T13:47:27.464 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.461+0000 7fcf3240c8c0 1 < completed delete operation key=V8X0VBBNK83J tag=5Q9FA5K1SVT3 type=del 2024-09-19T13:47:27.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.465+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=L0ARUL497UHZ type=write size=149198 2024-09-19T13:47:27.471 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.469+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~PIC3BS0D5A6L.0 size=180384 2024-09-19T13:47:27.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.473+0000 7fcf3240c8c0 1 < completed multipart upload key=OA9BMSXGYR9T upload=PIC3BS0D5A6L tag=AITIEQSUU29E type=write size=1228960 2024-09-19T13:47:27.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.481+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~3SRMWFUNBJU4.0 size=1048576 2024-09-19T13:47:27.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.481+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~3SRMWFUNBJU4.1 size=229253 2024-09-19T13:47:27.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.481+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=3SRMWFUNBJU4 tag=XWFSMGDFEOTJ type=write size=2326405 2024-09-19T13:47:27.490 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.485+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~NK2EYLZV9SL8.0 size=1048576 2024-09-19T13:47:27.492 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.489+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~NK2EYLZV9SL8.1 size=621752 2024-09-19T13:47:27.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.497+0000 7fcf3240c8c0 1 < completed multipart upload key=NP2L28YRVQ8L upload=NK2EYLZV9SL8 tag=93W2TS734L3P type=write size=2718904 2024-09-19T13:47:27.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.497+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=FRCSH0FTHAJD type=del size=2029833 2024-09-19T13:47:27.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.501+0000 7fcf3240c8c0 1 < completed delete operation key=DHPONKOVS8CT tag=3QS2ZO4BC5D3 type=del 2024-09-19T13:47:27.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.505+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=XJMR6J7CMZ3M type=del size=2091303 2024-09-19T13:47:27.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.509+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~ZPMOHT6FDMPI.0 size=1048576 2024-09-19T13:47:27.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.513+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~ZPMOHT6FDMPI.1 size=641264 2024-09-19T13:47:27.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.517+0000 7fcf3240c8c0 1 < completed multipart upload key=STMT6XU2EJQM upload=ZPMOHT6FDMPI tag=IBKA2OT511JO type=write size=2738416 2024-09-19T13:47:27.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.521+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=V860RAVB0QM9 type=del size=2523613 2024-09-19T13:47:27.527 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.525+0000 7fcf3240c8c0 1 < completed delete operation key=A02RDP6BA9AC tag=72XUBEFU1YYN type=del 2024-09-19T13:47:27.530 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.525+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=IRIDPBO5MPA3 type=write size=34969 2024-09-19T13:47:27.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.529+0000 7fcf3240c8c0 1 < completed delete operation key=NP2L28YRVQ8L tag=S6FPLTFFTX83 type=del 2024-09-19T13:47:27.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.537+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~BIZWC8JXJWP6.0 size=1048576 2024-09-19T13:47:27.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.541+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~BIZWC8JXJWP6.1 size=418039 2024-09-19T13:47:27.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.541+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=BIZWC8JXJWP6 tag=8WDW6YPW1FVU type=write size=2515191 2024-09-19T13:47:27.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.545+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~2XB329Z1OAFN.0 size=967346 2024-09-19T13:47:27.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.549+0000 7fcf3240c8c0 1 < completed multipart upload key=STMT6XU2EJQM upload=2XB329Z1OAFN tag=2IXNW2C6T434 type=write size=2015922 2024-09-19T13:47:27.557 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.553+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=2WG71C998MJS type=del size=1041469 2024-09-19T13:47:27.564 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.561+0000 7fcf3240c8c0 1 < suggested update operation key=STMT6XU2EJQM tag=BYZ4MRICDGVD type=del size=2960764 2024-09-19T13:47:27.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.569+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~GA9E90ADJNES.0 size=1048576 2024-09-19T13:47:27.573 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.569+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~GA9E90ADJNES.1 size=603875 2024-09-19T13:47:27.573 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.569+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=GA9E90ADJNES tag=R6I8LXNMW7DX type=write size=2701027 2024-09-19T13:47:27.579 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.577+0000 7fcf3240c8c0 1 < suggested update operation key=X9FGPMP30X47 tag=A0AX49SE9NZ7 type=del size=2544432 2024-09-19T13:47:27.581 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.577+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=U3YTNG9PO1KZ type=del size=3233480 2024-09-19T13:47:27.584 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.581+0000 7fcf3240c8c0 1 < completed write operation key=7UC85R2HO9K2 tag=LS8F0E3U9GC1 type=write size=48729 2024-09-19T13:47:27.587 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.585+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=2X84W1TP2VNE type=del size=1475810 2024-09-19T13:47:27.594 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.589+0000 7fcf3240c8c0 1 < suggested update operation key=STMT6XU2EJQM tag=DNN82DZGSVA2 type=del size=3504252 2024-09-19T13:47:27.596 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.593+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=W3BRSU0D5D02 type=del size=741965 2024-09-19T13:47:27.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.597+0000 7fcf3240c8c0 1 < completed write operation key=0U9BUX9DHTAK tag=1MQYURFYMAF5 type=write size=268581 2024-09-19T13:47:27.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.601+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~8VMFIQXFBBU4.0 size=158324 2024-09-19T13:47:27.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.601+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=8VMFIQXFBBU4 tag=Z8Y7QTZDL1FS type=write size=1206900 2024-09-19T13:47:27.608 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.605+0000 7fcf3240c8c0 1 < completed delete operation key=D1RMXGXS3O7Z tag=BTOLL3ZXA6H2 type=del 2024-09-19T13:47:27.614 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.609+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~ZMUWQE80KPD4.0 size=1048576 2024-09-19T13:47:27.616 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.613+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~ZMUWQE80KPD4.1 size=606071 2024-09-19T13:47:27.616 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.613+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=ZMUWQE80KPD4 tag=9GMIGL0DCNDD type=write size=2703223 2024-09-19T13:47:27.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.617+0000 7fcf3240c8c0 -1 < failed to complete operation key=STMT6XU2EJQM tag=P5KVI8FLK4WE type=del size=420080: (22) Invalid argument 2024-09-19T13:47:27.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.617+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=0W3U82A3WJKW type=del size=532306 2024-09-19T13:47:27.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.621+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~ILOKVKW90MMN.0 size=490287 2024-09-19T13:47:27.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.629+0000 7fcf3240c8c0 1 < completed multipart upload key=V8X0VBBNK83J upload=ILOKVKW90MMN tag=CKLGJ7LZL1HO type=write size=1538863 2024-09-19T13:47:27.634 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.629+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=07JB87R2NDJG type=del size=1426621 2024-09-19T13:47:27.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.633+0000 7fcf3240c8c0 -1 < failed to complete operation key=STMT6XU2EJQM tag=L0ARUL497UHZ type=write size=149198: (22) Invalid argument 2024-09-19T13:47:27.640 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.637+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=ZHXETOCWY1SL type=del size=3515298 2024-09-19T13:47:27.644 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.641+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~3SRMWFUNBJU4.0 size=1048576 2024-09-19T13:47:27.646 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.641+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~3SRMWFUNBJU4.1 size=229253 2024-09-19T13:47:27.651 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.649+0000 7fcf3240c8c0 1 < completed multipart upload key=QMSDNKYFFK1F upload=3SRMWFUNBJU4 tag=XWFSMGDFEOTJ type=write size=2326405 2024-09-19T13:47:27.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.649+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=1TC8MU1BRSVF type=del size=1278899 2024-09-19T13:47:27.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.653+0000 7fcf3240c8c0 1 < completed delete operation key=BXUPV5XSJBTH tag=FRCSH0FTHAJD type=del 2024-09-19T13:47:27.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.661+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~I0VCCY19OM9D.0 size=976629 2024-09-19T13:47:27.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.661+0000 7fcf3240c8c0 1 > prepared multipart upload key=C3TFYNXH549T upload=I0VCCY19OM9D tag=OW7DW1WLWUTB type=write size=2025205 2024-09-19T13:47:27.667 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.665+0000 7fcf3240c8c0 1 < completed delete operation key=0U9BUX9DHTAK tag=XJMR6J7CMZ3M type=del 2024-09-19T13:47:27.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.665+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=FFEHI0QU807A type=del size=3905950 2024-09-19T13:47:27.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.669+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=V860RAVB0QM9 type=del 2024-09-19T13:47:27.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.673+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=3L11H3T6CAEP type=write size=1026521 2024-09-19T13:47:27.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.677+0000 7fcf3240c8c0 1 < completed write operation key=0UCFTOF1YBBM tag=IRIDPBO5MPA3 type=write size=34969 2024-09-19T13:47:27.683 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.681+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=OL9CCT4ICZ6X type=del size=917811 2024-09-19T13:47:27.686 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.681+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~BIZWC8JXJWP6.0 size=1048576 2024-09-19T13:47:27.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.685+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~BIZWC8JXJWP6.1 size=418039 2024-09-19T13:47:27.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.693+0000 7fcf3240c8c0 1 < completed multipart upload key=N51Q6HKJSCCB upload=BIZWC8JXJWP6 tag=8WDW6YPW1FVU type=write size=2515191 2024-09-19T13:47:27.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.693+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=WW3NI295926P type=del size=4144405 2024-09-19T13:47:27.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.697+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=2WG71C998MJS type=del 2024-09-19T13:47:27.704 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.701+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=N4HAH0NJOBBK type=del size=1998162 2024-09-19T13:47:27.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.705+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~GA9E90ADJNES.0 size=1048576 2024-09-19T13:47:27.710 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.709+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~GA9E90ADJNES.1 size=603875 2024-09-19T13:47:27.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.713+0000 7fcf3240c8c0 1 < completed multipart upload key=AES54TJK7VH7 upload=GA9E90ADJNES tag=R6I8LXNMW7DX type=write size=2701027 2024-09-19T13:47:27.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.717+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=VSAVKNHRL3VD type=write size=790976 2024-09-19T13:47:27.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.721+0000 7fcf3240c8c0 1 < completed delete operation key=X9FGPMP30X47 tag=U3YTNG9PO1KZ type=del 2024-09-19T13:47:27.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.725+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~VS12QVMMQN1V.0 size=1048576 2024-09-19T13:47:27.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.733+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~VS12QVMMQN1V.1 size=1048576 2024-09-19T13:47:27.737 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.733+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~VS12QVMMQN1V.2 size=62076 2024-09-19T13:47:27.737 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.733+0000 7fcf3240c8c0 1 > prepared multipart upload key=DHPONKOVS8CT upload=VS12QVMMQN1V tag=DFD6Z6F9O8FH type=write size=3207804 2024-09-19T13:47:27.741 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.737+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=2X84W1TP2VNE type=del 2024-09-19T13:47:27.747 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.745+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~GKL8O2V1DIO0.0 size=605724 2024-09-19T13:47:27.748 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.745+0000 7fcf3240c8c0 1 > prepared multipart upload key=C3TFYNXH549T upload=GKL8O2V1DIO0 tag=HRUHTVA6O37B type=write size=1654300 2024-09-19T13:47:27.751 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.749+0000 7fcf3240c8c0 1 < completed delete operation key=D1RMXGXS3O7Z tag=W3BRSU0D5D02 type=del 2024-09-19T13:47:27.755 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.753+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=UHK761A75KI7 type=write size=738240 2024-09-19T13:47:27.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.757+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~8VMFIQXFBBU4.0 size=158324 2024-09-19T13:47:27.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.761+0000 7fcf3240c8c0 1 < completed multipart upload key=M2CO4A2DHJ05 upload=8VMFIQXFBBU4 tag=Z8Y7QTZDL1FS type=write size=1206900 2024-09-19T13:47:27.768 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.765+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=TDIEIJE0UAUH type=del size=3164485 2024-09-19T13:47:27.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.769+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~ZMUWQE80KPD4.0 size=1048576 2024-09-19T13:47:27.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.773+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~ZMUWQE80KPD4.1 size=606071 2024-09-19T13:47:27.780 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.777+0000 7fcf3240c8c0 1 < completed multipart upload key=0UCFTOF1YBBM upload=ZMUWQE80KPD4 tag=9GMIGL0DCNDD type=write size=2703223 2024-09-19T13:47:27.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.785+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~W7KGPJNWRS9Z.0 size=1048576 2024-09-19T13:47:27.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.785+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~W7KGPJNWRS9Z.1 size=301819 2024-09-19T13:47:27.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.785+0000 7fcf3240c8c0 1 > prepared multipart upload key=DHPONKOVS8CT upload=W7KGPJNWRS9Z tag=K638CHS4NFHU type=write size=2398971 2024-09-19T13:47:27.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.793+0000 7fcf3240c8c0 1 < suggested update operation key=1BMF3S2BZLLI tag=0W3U82A3WJKW type=del size=532306 2024-09-19T13:47:27.799 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.797+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=JTSNV5178HMN type=del size=3514415 2024-09-19T13:47:27.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.801+0000 7fcf3240c8c0 1 < suggested update operation key=DHPONKOVS8CT tag=07JB87R2NDJG type=del size=1426621 2024-09-19T13:47:27.809 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.805+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=DAY5TCLI4LSD type=del size=936037 2024-09-19T13:47:27.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.809+0000 7fcf3240c8c0 1 < completed delete operation key=HXMZKP7H3HJE tag=ZHXETOCWY1SL type=del 2024-09-19T13:47:27.819 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.817+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~OLPT5662WAY6.0 size=1048576 2024-09-19T13:47:27.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.817+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~OLPT5662WAY6.1 size=180779 2024-09-19T13:47:27.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.817+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=OLPT5662WAY6 tag=3B6IESLCJ80F type=write size=2277931 2024-09-19T13:47:27.825 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.821+0000 7fcf3240c8c0 1 < canceled operation key=XE42LV5M5X82 tag=1TC8MU1BRSVF type=del size=1278899 2024-09-19T13:47:27.828 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.825+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=ER14WN8S3IBL type=del size=3278097 2024-09-19T13:47:27.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.825+0000 7fcf3240c8c0 1 < canceled part key=_multipart_C3TFYNXH549T.2~I0VCCY19OM9D.0 size=976629 2024-09-19T13:47:27.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.829+0000 7fcf3240c8c0 1 < canceled multipart upload key=C3TFYNXH549T upload=I0VCCY19OM9D tag=OW7DW1WLWUTB type=write size=2025205 2024-09-19T13:47:27.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.833+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=6LZVM72O5D0L type=del size=1656792 2024-09-19T13:47:27.841 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.837+0000 7fcf3240c8c0 1 < completed delete operation key=6DFF2OCPT9W2 tag=FFEHI0QU807A type=del 2024-09-19T13:47:27.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.845+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~W5Q71A3VZ4DZ.0 size=846221 2024-09-19T13:47:27.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.845+0000 7fcf3240c8c0 1 > prepared multipart upload key=D1RMXGXS3O7Z upload=W5Q71A3VZ4DZ tag=W208NJYSQMYC type=write size=1894797 2024-09-19T13:47:27.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.849+0000 7fcf3240c8c0 1 < completed write operation key=STMT6XU2EJQM tag=3L11H3T6CAEP type=write size=1026521 2024-09-19T13:47:27.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.849+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=1ZO94SQ9LL6O type=del size=1706365 2024-09-19T13:47:27.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.857+0000 7fcf3240c8c0 1 < suggested remove operation key=NP2L28YRVQ8L tag=OL9CCT4ICZ6X type=del 2024-09-19T13:47:27.866 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.861+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~NN6IZQXRC52T.0 size=1048576 2024-09-19T13:47:27.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.865+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~NN6IZQXRC52T.1 size=1048576 2024-09-19T13:47:27.871 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.869+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~NN6IZQXRC52T.2 size=697681 2024-09-19T13:47:27.871 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.869+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=NN6IZQXRC52T tag=R88E772LFXIF type=write size=3843409 2024-09-19T13:47:27.874 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.869+0000 7fcf3240c8c0 1 < completed delete operation key=A02RDP6BA9AC tag=WW3NI295926P type=del 2024-09-19T13:47:27.877 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.873+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=YKTNZ5704QC2 type=del size=3458877 2024-09-19T13:47:27.881 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.877+0000 7fcf3240c8c0 1 < completed delete operation key=C8T6DB9V9FBT tag=N4HAH0NJOBBK type=del 2024-09-19T13:47:27.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.881+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=7SMRUO7H4AU7 type=del size=2451407 2024-09-19T13:47:27.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.885+0000 7fcf3240c8c0 1 < completed write operation key=X9FGPMP30X47 tag=VSAVKNHRL3VD type=write size=790976 2024-09-19T13:47:27.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.889+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=I5BIZJ3AMLDM type=del size=3445357 2024-09-19T13:47:27.894 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.889+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~VS12QVMMQN1V.0 size=1048576 2024-09-19T13:47:27.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.893+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~VS12QVMMQN1V.1 size=1048576 2024-09-19T13:47:27.899 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.897+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~VS12QVMMQN1V.2 size=62076 2024-09-19T13:47:27.904 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.901+0000 7fcf3240c8c0 1 < completed multipart upload key=DHPONKOVS8CT upload=VS12QVMMQN1V tag=DFD6Z6F9O8FH type=write size=3207804 2024-09-19T13:47:27.908 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.905+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=6KLIGJNI39V2 type=del size=1664848 2024-09-19T13:47:27.911 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.909+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~GKL8O2V1DIO0.0 size=605724 2024-09-19T13:47:27.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.913+0000 7fcf3240c8c0 1 < completed multipart upload key=C3TFYNXH549T upload=GKL8O2V1DIO0 tag=HRUHTVA6O37B type=write size=1654300 2024-09-19T13:47:27.919 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.917+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=ZKCUIT09652S type=del size=2450121 2024-09-19T13:47:27.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.921+0000 7fcf3240c8c0 1 < completed write operation key=X9FGPMP30X47 tag=UHK761A75KI7 type=write size=738240 2024-09-19T13:47:27.928 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.925+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~COBIHX0CWXSK.0 size=302447 2024-09-19T13:47:27.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.925+0000 7fcf3240c8c0 1 > prepared multipart upload key=C8T6DB9V9FBT upload=COBIHX0CWXSK tag=OAAD1ICEQ8TJ type=write size=1351023 2024-09-19T13:47:27.935 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.933+0000 7fcf3240c8c0 1 < suggested update operation key=QSM2Q8CW1Q86 tag=TDIEIJE0UAUH type=del size=3164485 2024-09-19T13:47:27.938 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.933+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=KVM72TL11QEM type=write size=786081 2024-09-19T13:47:27.941 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.937+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~W7KGPJNWRS9Z.0 size=1048576 2024-09-19T13:47:27.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.941+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~W7KGPJNWRS9Z.1 size=301819 2024-09-19T13:47:27.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.945+0000 7fcf3240c8c0 1 < completed multipart upload key=DHPONKOVS8CT upload=W7KGPJNWRS9Z tag=K638CHS4NFHU type=write size=2398971 2024-09-19T13:47:27.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.949+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=KUYVVL9M0U5O type=del size=105286 2024-09-19T13:47:27.955 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.953+0000 7fcf3240c8c0 1 < canceled operation key=ES62XJO5Q3FO tag=JTSNV5178HMN type=del size=3514415 2024-09-19T13:47:27.958 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.957+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=3D07P3D8VVN4 type=del size=2350905 2024-09-19T13:47:27.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.957+0000 7fcf3240c8c0 1 < completed delete operation key=XE42LV5M5X82 tag=DAY5TCLI4LSD type=del 2024-09-19T13:47:27.967 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.965+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~YX0HJZI3HHZ8.0 size=924217 2024-09-19T13:47:27.967 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.965+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=YX0HJZI3HHZ8 tag=A3LNOPA05VLO type=write size=1972793 2024-09-19T13:47:27.971 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.969+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~OLPT5662WAY6.0 size=1048576 2024-09-19T13:47:27.974 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.969+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~OLPT5662WAY6.1 size=180779 2024-09-19T13:47:27.979 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.977+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=OLPT5662WAY6 tag=3B6IESLCJ80F type=write size=2277931 2024-09-19T13:47:27.982 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.981+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=EG1246KMWX40 type=del size=338504 2024-09-19T13:47:27.985 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.981+0000 7fcf3240c8c0 1 < completed delete operation key=0UCFTOF1YBBM tag=ER14WN8S3IBL type=del 2024-09-19T13:47:27.991 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.989+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~NMWL8X9IXG6S.0 size=525608 2024-09-19T13:47:27.991 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.989+0000 7fcf3240c8c0 1 > prepared multipart upload key=X9FGPMP30X47 upload=NMWL8X9IXG6S tag=SUFTWCKD891T type=write size=1574184 2024-09-19T13:47:27.994 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.989+0000 7fcf3240c8c0 1 < completed delete operation key=C35EUAOWLBR3 tag=6LZVM72O5D0L type=del 2024-09-19T13:47:27.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.993+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=G316TBUSET8M type=del size=2196898 2024-09-19T13:47:28.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:27.997+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~W5Q71A3VZ4DZ.0 size=846221 2024-09-19T13:47:28.006 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.001+0000 7fcf3240c8c0 1 < completed multipart upload key=D1RMXGXS3O7Z upload=W5Q71A3VZ4DZ tag=W208NJYSQMYC type=write size=1894797 2024-09-19T13:47:28.009 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.005+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=J6FAQVUU1JJ5 type=del size=1415840 2024-09-19T13:47:28.012 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.009+0000 7fcf3240c8c0 1 < completed delete operation key=V8X0VBBNK83J tag=1ZO94SQ9LL6O type=del 2024-09-19T13:47:28.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.013+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=UOKPGN166N6R type=del size=462207 2024-09-19T13:47:28.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.013+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~NN6IZQXRC52T.0 size=1048576 2024-09-19T13:47:28.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.013+0000 7fcf3240c8c0 1 < canceled part key=_multipart_HXMZKP7H3HJE.2~NN6IZQXRC52T.1 size=1048576 2024-09-19T13:47:28.020 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.017+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~NN6IZQXRC52T.2 size=697681 2024-09-19T13:47:28.025 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.021+0000 7fcf3240c8c0 1 < canceled multipart upload key=HXMZKP7H3HJE upload=NN6IZQXRC52T tag=R88E772LFXIF type=write size=3843409 2024-09-19T13:47:28.030 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.025+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~WZLJ2JUK8CU1.0 size=712314 2024-09-19T13:47:28.030 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.025+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=WZLJ2JUK8CU1 tag=IWFAED4BQ218 type=write size=1760890 2024-09-19T13:47:28.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.033+0000 7fcf3240c8c0 1 < suggested remove operation key=6DFF2OCPT9W2 tag=YKTNZ5704QC2 type=del 2024-09-19T13:47:28.045 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.041+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~HHTLKNRRCLKW.0 size=1048576 2024-09-19T13:47:28.048 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.045+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~HHTLKNRRCLKW.1 size=1048576 2024-09-19T13:47:28.051 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.049+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~HHTLKNRRCLKW.2 size=1008771 2024-09-19T13:47:28.051 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.049+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=HHTLKNRRCLKW tag=L677HORNGG3M type=write size=4154499 2024-09-19T13:47:28.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.053+0000 7fcf3240c8c0 1 < completed delete operation key=0U9BUX9DHTAK tag=7SMRUO7H4AU7 type=del 2024-09-19T13:47:28.057 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.053+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=0IO9UU2SKEP7 type=write size=341325 2024-09-19T13:47:28.061 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.057+0000 7fcf3240c8c0 1 < canceled operation key=7UC85R2HO9K2 tag=I5BIZJ3AMLDM type=del size=3445357 2024-09-19T13:47:28.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.061+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~SM3PZBAI0KJY.0 size=1048576 2024-09-19T13:47:28.068 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.065+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~SM3PZBAI0KJY.1 size=77259 2024-09-19T13:47:28.068 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.065+0000 7fcf3240c8c0 1 > prepared multipart upload key=DHPONKOVS8CT upload=SM3PZBAI0KJY tag=RHUJGPFZH3EH type=write size=2174411 2024-09-19T13:47:28.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.069+0000 7fcf3240c8c0 1 < canceled operation key=ES62XJO5Q3FO tag=6KLIGJNI39V2 type=del size=1664848 2024-09-19T13:47:28.076 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.073+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~FHDXLAGCG7PL.0 size=728548 2024-09-19T13:47:28.076 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.073+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=FHDXLAGCG7PL tag=VFKNL3W2521C type=write size=1777124 2024-09-19T13:47:28.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.077+0000 7fcf3240c8c0 1 < suggested remove operation key=X16ENUFL40RN tag=ZKCUIT09652S type=del 2024-09-19T13:47:28.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.085+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~QWJKD8CNVH3Z.0 size=1048576 2024-09-19T13:47:28.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.085+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~QWJKD8CNVH3Z.1 size=935540 2024-09-19T13:47:28.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.085+0000 7fcf3240c8c0 1 > prepared multipart upload key=71Z2VTW99W7J upload=QWJKD8CNVH3Z tag=YAM3PPQMSU5Z type=write size=3032692 2024-09-19T13:47:28.092 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.089+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~COBIHX0CWXSK.0 size=302447 2024-09-19T13:47:28.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.093+0000 7fcf3240c8c0 1 < completed multipart upload key=C8T6DB9V9FBT upload=COBIHX0CWXSK tag=OAAD1ICEQ8TJ type=write size=1351023 2024-09-19T13:47:28.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.097+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=1PC6HK36W7SC type=del size=1052258 2024-09-19T13:47:28.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.101+0000 7fcf3240c8c0 1 < suggested remove operation key=ES62XJO5Q3FO tag=KVM72TL11QEM type=write 2024-09-19T13:47:28.109 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.105+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=1CS140EOZFMP type=del size=3480025 2024-09-19T13:47:28.112 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.109+0000 7fcf3240c8c0 1 < completed delete operation key=D20C6C2ZFX1W tag=KUYVVL9M0U5O type=del 2024-09-19T13:47:28.118 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.113+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~ZVSAQSMJPOPV.0 size=1048576 2024-09-19T13:47:28.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.117+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~ZVSAQSMJPOPV.1 size=152333 2024-09-19T13:47:28.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.117+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=ZVSAQSMJPOPV tag=15CJ1T2NWSDM type=write size=2249485 2024-09-19T13:47:28.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.121+0000 7fcf3240c8c0 1 < completed delete operation key=D1RMXGXS3O7Z tag=3D07P3D8VVN4 type=del 2024-09-19T13:47:28.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.121+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=NPEUEJKLP5AP type=del size=1507670 2024-09-19T13:47:28.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.125+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~YX0HJZI3HHZ8.0 size=924217 2024-09-19T13:47:28.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.129+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=YX0HJZI3HHZ8 tag=A3LNOPA05VLO type=write size=1972793 2024-09-19T13:47:28.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.137+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~6NFU44TNI2NR.0 size=1048576 2024-09-19T13:47:28.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.141+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~6NFU44TNI2NR.1 size=26545 2024-09-19T13:47:28.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.141+0000 7fcf3240c8c0 1 > prepared multipart upload key=3TME221SA53E upload=6NFU44TNI2NR tag=QRYMSN3JBRIK type=write size=2123697 2024-09-19T13:47:28.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.145+0000 7fcf3240c8c0 1 < suggested remove operation key=M2CO4A2DHJ05 tag=EG1246KMWX40 type=del 2024-09-19T13:47:28.151 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.149+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=N1Q17KYEH9Z7 type=write size=154890 2024-09-19T13:47:28.155 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.153+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~NMWL8X9IXG6S.0 size=525608 2024-09-19T13:47:28.160 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.157+0000 7fcf3240c8c0 1 < completed multipart upload key=X9FGPMP30X47 upload=NMWL8X9IXG6S tag=SUFTWCKD891T type=write size=1574184 2024-09-19T13:47:28.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.161+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=4VY76CZZZQ4N type=write size=492551 2024-09-19T13:47:28.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.165+0000 7fcf3240c8c0 1 < completed delete operation key=QSM2Q8CW1Q86 tag=G316TBUSET8M type=del 2024-09-19T13:47:28.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.165+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=IBBFFARB7764 type=del size=130674 2024-09-19T13:47:28.174 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.169+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=J6FAQVUU1JJ5 type=del 2024-09-19T13:47:28.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.177+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~UCAMKG2NZ6UV.0 size=1048576 2024-09-19T13:47:28.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.181+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~UCAMKG2NZ6UV.1 size=1048576 2024-09-19T13:47:28.186 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.181+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~UCAMKG2NZ6UV.2 size=205131 2024-09-19T13:47:28.186 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.181+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=UCAMKG2NZ6UV tag=RGY0KKI3N5ZL type=write size=3350859 2024-09-19T13:47:28.190 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.185+0000 7fcf3240c8c0 1 < canceled operation key=1BMF3S2BZLLI tag=UOKPGN166N6R type=del size=462207 2024-09-19T13:47:28.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.189+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=P3X09TBAWOCQ type=del size=2764849 2024-09-19T13:47:28.197 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.193+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~WZLJ2JUK8CU1.0 size=712314 2024-09-19T13:47:28.202 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.197+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=WZLJ2JUK8CU1 tag=IWFAED4BQ218 type=write size=1760890 2024-09-19T13:47:28.205 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.201+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=0L0R9BA1DQKI type=del size=1052558 2024-09-19T13:47:28.207 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.205+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~HHTLKNRRCLKW.0 size=1048576 2024-09-19T13:47:28.209 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.205+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~HHTLKNRRCLKW.1 size=1048576 2024-09-19T13:47:28.212 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.209+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~HHTLKNRRCLKW.2 size=1008771 2024-09-19T13:47:28.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.213+0000 7fcf3240c8c0 1 < completed multipart upload key=D20C6C2ZFX1W upload=HHTLKNRRCLKW tag=L677HORNGG3M type=write size=4154499 2024-09-19T13:47:28.221 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.217+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=8JT48FTN1ENV type=del size=142928 2024-09-19T13:47:28.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.221+0000 7fcf3240c8c0 1 < completed write operation key=9ICCISYXT0IV tag=0IO9UU2SKEP7 type=write size=341325 2024-09-19T13:47:28.228 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.225+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=WBAIWPN62CHA type=del size=2356925 2024-09-19T13:47:28.231 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.229+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~SM3PZBAI0KJY.0 size=1048576 2024-09-19T13:47:28.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.229+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~SM3PZBAI0KJY.1 size=77259 2024-09-19T13:47:28.237 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.233+0000 7fcf3240c8c0 1 < completed multipart upload key=DHPONKOVS8CT upload=SM3PZBAI0KJY tag=RHUJGPFZH3EH type=write size=2174411 2024-09-19T13:47:28.240 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.237+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=EH7KF7QJ3W0X type=del size=2793566 2024-09-19T13:47:28.242 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.241+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~FHDXLAGCG7PL.0 size=728548 2024-09-19T13:47:28.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.245+0000 7fcf3240c8c0 1 < completed multipart upload key=ZCKKQ1R8318S upload=FHDXLAGCG7PL tag=VFKNL3W2521C type=write size=1777124 2024-09-19T13:47:28.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.245+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=FWY76H5M2HG2 type=del size=3290440 2024-09-19T13:47:28.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.249+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~QWJKD8CNVH3Z.0 size=1048576 2024-09-19T13:47:28.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.249+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~QWJKD8CNVH3Z.1 size=935540 2024-09-19T13:47:28.258 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.253+0000 7fcf3240c8c0 1 < completed multipart upload key=71Z2VTW99W7J upload=QWJKD8CNVH3Z tag=YAM3PPQMSU5Z type=write size=3032692 2024-09-19T13:47:28.262 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.261+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~Y6KYHS12AV0R.0 size=325845 2024-09-19T13:47:28.263 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.261+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=Y6KYHS12AV0R tag=1PFKW20T9RG1 type=write size=1374421 2024-09-19T13:47:28.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.261+0000 7fcf3240c8c0 1 < completed delete operation key=C8T6DB9V9FBT tag=1PC6HK36W7SC type=del 2024-09-19T13:47:28.268 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.265+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=T21GPE2SIV1G type=del size=3476854 2024-09-19T13:47:28.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.269+0000 7fcf3240c8c0 1 < completed delete operation key=V8X0VBBNK83J tag=1CS140EOZFMP type=del 2024-09-19T13:47:28.276 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.273+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~E5UEDSWPQK5I.0 size=206908 2024-09-19T13:47:28.276 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.273+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=E5UEDSWPQK5I tag=LLO130ZN2LYX type=write size=1255484 2024-09-19T13:47:28.276 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.273+0000 7fcf3240c8c0 1 < canceled part key=_multipart_HXMZKP7H3HJE.2~ZVSAQSMJPOPV.0 size=1048576 2024-09-19T13:47:28.278 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.277+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~ZVSAQSMJPOPV.1 size=152333 2024-09-19T13:47:28.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.281+0000 7fcf3240c8c0 1 < canceled multipart upload key=HXMZKP7H3HJE upload=ZVSAQSMJPOPV tag=15CJ1T2NWSDM type=write size=2249485 2024-09-19T13:47:28.286 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.281+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=PWD2HRNGB5L3 type=del size=2089706 2024-09-19T13:47:28.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.285+0000 7fcf3240c8c0 1 < completed delete operation key=STMT6XU2EJQM tag=NPEUEJKLP5AP type=del 2024-09-19T13:47:28.292 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.289+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=ZAGM2C2Z0JYT type=del size=2335224 2024-09-19T13:47:28.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.293+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~6NFU44TNI2NR.0 size=1048576 2024-09-19T13:47:28.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.293+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~6NFU44TNI2NR.1 size=26545 2024-09-19T13:47:28.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.297+0000 7fcf3240c8c0 1 < completed multipart upload key=3TME221SA53E upload=6NFU44TNI2NR tag=QRYMSN3JBRIK type=write size=2123697 2024-09-19T13:47:28.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.305+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~3UMGKKA6XB42.0 size=1048576 2024-09-19T13:47:28.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.309+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~3UMGKKA6XB42.1 size=691126 2024-09-19T13:47:28.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.309+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=3UMGKKA6XB42 tag=AD0DRN29YF9L type=write size=2788278 2024-09-19T13:47:28.314 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.309+0000 7fcf3240c8c0 1 < canceled operation key=V8X0VBBNK83J tag=N1Q17KYEH9Z7 type=write size=154890 2024-09-19T13:47:28.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.313+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=ENX3AIHMWT18 type=del size=2744761 2024-09-19T13:47:28.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.321+0000 7fcf3240c8c0 1 < canceled operation key=C3TFYNXH549T tag=4VY76CZZZQ4N type=write size=492551 2024-09-19T13:47:28.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.325+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~RAY114NDH7AX.0 size=1048576 2024-09-19T13:47:28.331 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.329+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~RAY114NDH7AX.1 size=1048576 2024-09-19T13:47:28.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.333+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~RAY114NDH7AX.2 size=325277 2024-09-19T13:47:28.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.333+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=RAY114NDH7AX tag=JQ6QM47DZXNS type=write size=3471005 2024-09-19T13:47:28.337 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.333+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=IBBFFARB7764 type=del 2024-09-19T13:47:28.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.337+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=9JVOMLXA73NW type=write size=1015750 2024-09-19T13:47:28.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.341+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~UCAMKG2NZ6UV.0 size=1048576 2024-09-19T13:47:28.346 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.345+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~UCAMKG2NZ6UV.1 size=1048576 2024-09-19T13:47:28.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.345+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~UCAMKG2NZ6UV.2 size=205131 2024-09-19T13:47:28.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.349+0000 7fcf3240c8c0 1 < completed multipart upload key=ZCKKQ1R8318S upload=UCAMKG2NZ6UV tag=RGY0KKI3N5ZL type=write size=3350859 2024-09-19T13:47:28.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.353+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=ZMAY1Y2GQDDM type=write size=719740 2024-09-19T13:47:28.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.357+0000 7fcf3240c8c0 1 < completed delete operation key=0UCFTOF1YBBM tag=P3X09TBAWOCQ type=del 2024-09-19T13:47:28.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.361+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=06N2FVCFF0X2 type=del size=1333715 2024-09-19T13:47:28.367 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.365+0000 7fcf3240c8c0 1 < completed delete operation key=V8X0VBBNK83J tag=0L0R9BA1DQKI type=del 2024-09-19T13:47:28.370 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.369+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=MWE562G2W437 type=del size=1095397 2024-09-19T13:47:28.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.369+0000 7fcf3240c8c0 1 < completed delete operation key=C3TFYNXH549T tag=8JT48FTN1ENV type=del 2024-09-19T13:47:28.377 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.373+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=MQ047JF757BB type=write size=146589 2024-09-19T13:47:28.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.381+0000 7fcf3240c8c0 1 < suggested remove operation key=STMT6XU2EJQM tag=WBAIWPN62CHA type=del 2024-09-19T13:47:28.387 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.385+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=L1G15BA53B4K type=del size=1587846 2024-09-19T13:47:28.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.389+0000 7fcf3240c8c0 1 < suggested remove operation key=AES54TJK7VH7 tag=EH7KF7QJ3W0X type=del 2024-09-19T13:47:28.395 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.393+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=NSJ1CZVMVRDV type=del size=3022313 2024-09-19T13:47:28.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.393+0000 7fcf3240c8c0 1 < canceled operation key=QAYJ5B1KZ08J tag=FWY76H5M2HG2 type=del size=3290440 2024-09-19T13:47:28.401 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.397+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=2NBQ9LO34VD3 type=del size=3176212 2024-09-19T13:47:28.405 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.401+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~Y6KYHS12AV0R.0 size=325845 2024-09-19T13:47:28.410 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.405+0000 7fcf3240c8c0 1 < completed multipart upload key=QAYJ5B1KZ08J upload=Y6KYHS12AV0R tag=1PFKW20T9RG1 type=write size=1374421 2024-09-19T13:47:28.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.413+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~HDO2HGO1M1R8.0 size=1020208 2024-09-19T13:47:28.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.413+0000 7fcf3240c8c0 1 > prepared multipart upload key=X16ENUFL40RN upload=HDO2HGO1M1R8 tag=ZE7XDRE4HA1E type=write size=2068784 2024-09-19T13:47:28.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.417+0000 7fcf3240c8c0 1 < completed delete operation key=0UCFTOF1YBBM tag=T21GPE2SIV1G type=del 2024-09-19T13:47:28.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.421+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=WC4LNFN6HZDO type=del size=2001538 2024-09-19T13:47:28.426 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.421+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~E5UEDSWPQK5I.0 size=206908 2024-09-19T13:47:28.431 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.429+0000 7fcf3240c8c0 1 < completed multipart upload key=0UCFTOF1YBBM upload=E5UEDSWPQK5I tag=LLO130ZN2LYX type=write size=1255484 2024-09-19T13:47:28.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.429+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=JD5Z864ABCZ0 type=del size=2946543 2024-09-19T13:47:28.437 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.433+0000 7fcf3240c8c0 1 < canceled operation key=ES62XJO5Q3FO tag=PWD2HRNGB5L3 type=del size=2089706 2024-09-19T13:47:28.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.441+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~CY1V3PV5T25U.0 size=1048576 2024-09-19T13:47:28.446 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.441+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~CY1V3PV5T25U.1 size=1048576 2024-09-19T13:47:28.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.445+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~CY1V3PV5T25U.2 size=670534 2024-09-19T13:47:28.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.445+0000 7fcf3240c8c0 1 > prepared multipart upload key=C3TFYNXH549T upload=CY1V3PV5T25U tag=TQYCN8MGL4IO type=write size=3816262 2024-09-19T13:47:28.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.453+0000 7fcf3240c8c0 1 < suggested remove operation key=X16ENUFL40RN tag=ZAGM2C2Z0JYT type=del 2024-09-19T13:47:28.459 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.457+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~1R58GEY0W967.0 size=1048576 2024-09-19T13:47:28.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.457+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~1R58GEY0W967.1 size=1048576 2024-09-19T13:47:28.464 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.461+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~1R58GEY0W967.2 size=68228 2024-09-19T13:47:28.464 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.461+0000 7fcf3240c8c0 1 > prepared multipart upload key=DHPONKOVS8CT upload=1R58GEY0W967 tag=YH9ZXK8GPZAP type=write size=3213956 2024-09-19T13:47:28.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.465+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~3UMGKKA6XB42.0 size=1048576 2024-09-19T13:47:28.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.465+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~3UMGKKA6XB42.1 size=691126 2024-09-19T13:47:28.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.469+0000 7fcf3240c8c0 1 < completed multipart upload key=D20C6C2ZFX1W upload=3UMGKKA6XB42 tag=AD0DRN29YF9L type=write size=2788278 2024-09-19T13:47:28.477 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.473+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=W1TL76L25NWT type=del size=2687985 2024-09-19T13:47:28.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.477+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=ENX3AIHMWT18 type=del 2024-09-19T13:47:28.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.485+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~6BVISY910ZR2.0 size=1048576 2024-09-19T13:47:28.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.485+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~6BVISY910ZR2.1 size=377263 2024-09-19T13:47:28.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.485+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=6BVISY910ZR2 tag=X6X5GTWGO32R type=write size=2474415 2024-09-19T13:47:28.493 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.489+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~RAY114NDH7AX.0 size=1048576 2024-09-19T13:47:28.493 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.489+0000 7fcf3240c8c0 1 < canceled part key=_multipart_QAYJ5B1KZ08J.2~RAY114NDH7AX.1 size=1048576 2024-09-19T13:47:28.495 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.493+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~RAY114NDH7AX.2 size=325277 2024-09-19T13:47:28.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.497+0000 7fcf3240c8c0 1 < canceled multipart upload key=QAYJ5B1KZ08J upload=RAY114NDH7AX tag=JQ6QM47DZXNS type=write size=3471005 2024-09-19T13:47:28.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.501+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=P6R0ZFYPNQ31 type=del size=2939013 2024-09-19T13:47:28.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.505+0000 7fcf3240c8c0 1 < completed write operation key=XE42LV5M5X82 tag=9JVOMLXA73NW type=write size=1015750 2024-09-19T13:47:28.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.505+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=N1HV21VG8EVH type=del size=2805756 2024-09-19T13:47:28.513 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.509+0000 7fcf3240c8c0 1 < completed write operation key=D20C6C2ZFX1W tag=ZMAY1Y2GQDDM type=write size=719740 2024-09-19T13:47:28.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.517+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~FMHM2KLY9SU2.0 size=1048576 2024-09-19T13:47:28.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.517+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~FMHM2KLY9SU2.1 size=1048576 2024-09-19T13:47:28.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.521+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~FMHM2KLY9SU2.2 size=568845 2024-09-19T13:47:28.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.521+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=FMHM2KLY9SU2 tag=91PBKRKEAL2R type=write size=3714573 2024-09-19T13:47:28.527 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.525+0000 7fcf3240c8c0 1 < completed delete operation key=M2CO4A2DHJ05 tag=06N2FVCFF0X2 type=del 2024-09-19T13:47:28.530 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.529+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=NWYD4UIU1V3E type=del size=2830463 2024-09-19T13:47:28.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.529+0000 7fcf3240c8c0 1 < completed delete operation key=1BMF3S2BZLLI tag=MWE562G2W437 type=del 2024-09-19T13:47:28.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.533+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=F0KMD2FLHF73 type=del size=209554 2024-09-19T13:47:28.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.537+0000 7fcf3240c8c0 1 < canceled operation key=M2CO4A2DHJ05 tag=MQ047JF757BB type=write size=146589 2024-09-19T13:47:28.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.541+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=DWQCIMP2R5E6 type=write size=402718 2024-09-19T13:47:28.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.541+0000 7fcf3240c8c0 -1 < failed to complete operation key=AES54TJK7VH7 tag=L1G15BA53B4K type=del size=1587846: (22) Invalid argument 2024-09-19T13:47:28.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.545+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=DU8PKXQU0KYN type=del size=179074 2024-09-19T13:47:28.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.549+0000 7fcf3240c8c0 1 < suggested update operation key=A02RDP6BA9AC tag=NSJ1CZVMVRDV type=del size=3022313 2024-09-19T13:47:28.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.553+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=0SLSG1ZFPFH0 type=del size=458544 2024-09-19T13:47:28.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.557+0000 7fcf3240c8c0 1 < completed delete operation key=3TME221SA53E tag=2NBQ9LO34VD3 type=del 2024-09-19T13:47:28.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.561+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~U5VQ008QJGTC.0 size=381613 2024-09-19T13:47:28.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.561+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=U5VQ008QJGTC tag=OR11BUWVL2RW type=write size=1430189 2024-09-19T13:47:28.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.565+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~HDO2HGO1M1R8.0 size=1020208 2024-09-19T13:47:28.574 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.569+0000 7fcf3240c8c0 1 < completed multipart upload key=X16ENUFL40RN upload=HDO2HGO1M1R8 tag=ZE7XDRE4HA1E type=write size=2068784 2024-09-19T13:47:28.577 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.573+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=KX1QRRCB04PA type=del size=53374 2024-09-19T13:47:28.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.577+0000 7fcf3240c8c0 1 < completed delete operation key=BXUPV5XSJBTH tag=WC4LNFN6HZDO type=del 2024-09-19T13:47:28.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.581+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=ZJ2V9AMWNPAE type=del size=722566 2024-09-19T13:47:28.587 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.585+0000 7fcf3240c8c0 1 < completed delete operation key=V8X0VBBNK83J tag=JD5Z864ABCZ0 type=del 2024-09-19T13:47:28.593 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.589+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~J10LER8T9CU9.0 size=1048576 2024-09-19T13:47:28.595 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.593+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~J10LER8T9CU9.1 size=223634 2024-09-19T13:47:28.595 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.593+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=J10LER8T9CU9 tag=S6U9KTWEIR8L type=write size=2320786 2024-09-19T13:47:28.599 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.597+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~CY1V3PV5T25U.0 size=1048576 2024-09-19T13:47:28.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.597+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~CY1V3PV5T25U.1 size=1048576 2024-09-19T13:47:28.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.601+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~CY1V3PV5T25U.2 size=670534 2024-09-19T13:47:28.611 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.609+0000 7fcf3240c8c0 1 < completed multipart upload key=C3TFYNXH549T upload=CY1V3PV5T25U tag=TQYCN8MGL4IO type=write size=3816262 2024-09-19T13:47:28.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.613+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=RB62BRD3N16C type=del size=1834647 2024-09-19T13:47:28.621 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.617+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~1R58GEY0W967.0 size=1048576 2024-09-19T13:47:28.621 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.617+0000 7fcf3240c8c0 1 < canceled part key=_multipart_DHPONKOVS8CT.2~1R58GEY0W967.1 size=1048576 2024-09-19T13:47:28.624 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.621+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~1R58GEY0W967.2 size=68228 2024-09-19T13:47:28.630 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.625+0000 7fcf3240c8c0 1 < canceled multipart upload key=DHPONKOVS8CT upload=1R58GEY0W967 tag=YH9ZXK8GPZAP type=write size=3213956 2024-09-19T13:47:28.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.633+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~W9A6LENDA2IX.0 size=890257 2024-09-19T13:47:28.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.633+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=W9A6LENDA2IX tag=9ETTMWDLLQ88 type=write size=1938833 2024-09-19T13:47:28.640 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.637+0000 7fcf3240c8c0 1 < completed delete operation key=C3TFYNXH549T tag=W1TL76L25NWT type=del 2024-09-19T13:47:28.643 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.641+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=NCA6ROAZPVXT type=del size=2305477 2024-09-19T13:47:28.646 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.641+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~6BVISY910ZR2.0 size=1048576 2024-09-19T13:47:28.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.645+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~6BVISY910ZR2.1 size=377263 2024-09-19T13:47:28.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.649+0000 7fcf3240c8c0 1 < completed multipart upload key=ES62XJO5Q3FO upload=6BVISY910ZR2 tag=X6X5GTWGO32R type=write size=2474415 2024-09-19T13:47:28.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.653+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=VX7YAQWNWDKG type=del size=3541550 2024-09-19T13:47:28.660 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.657+0000 7fcf3240c8c0 1 < completed delete operation key=3TME221SA53E tag=P6R0ZFYPNQ31 type=del 2024-09-19T13:47:28.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.661+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=40R1FH2FB99E type=del size=3401485 2024-09-19T13:47:28.666 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.661+0000 7fcf3240c8c0 1 < completed delete operation key=3TME221SA53E tag=N1HV21VG8EVH type=del 2024-09-19T13:47:28.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.669+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~VHSQ1N7WFYRB.0 size=211567 2024-09-19T13:47:28.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.669+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=VHSQ1N7WFYRB tag=LQ9IOKX9LT5I type=write size=1260143 2024-09-19T13:47:28.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.673+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~FMHM2KLY9SU2.0 size=1048576 2024-09-19T13:47:28.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.673+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~FMHM2KLY9SU2.1 size=1048576 2024-09-19T13:47:28.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.677+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~FMHM2KLY9SU2.2 size=568845 2024-09-19T13:47:28.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.681+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=FMHM2KLY9SU2 tag=91PBKRKEAL2R type=write size=3714573 2024-09-19T13:47:28.688 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.685+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=QI2OK51GECW9 type=del size=761128 2024-09-19T13:47:28.691 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.689+0000 7fcf3240c8c0 1 < completed delete operation key=N51Q6HKJSCCB tag=NWYD4UIU1V3E type=del 2024-09-19T13:47:28.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.693+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~WU8I6FB0K9UU.0 size=8760 2024-09-19T13:47:28.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.693+0000 7fcf3240c8c0 1 > prepared multipart upload key=DHPONKOVS8CT upload=WU8I6FB0K9UU tag=SYLWG9LKZJZS type=write size=1057336 2024-09-19T13:47:28.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.697+0000 7fcf3240c8c0 1 < completed delete operation key=D20C6C2ZFX1W tag=F0KMD2FLHF73 type=del 2024-09-19T13:47:28.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.701+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=02ALVF0T9UZE type=write size=546491 2024-09-19T13:47:28.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.705+0000 7fcf3240c8c0 1 < completed write operation key=0UCFTOF1YBBM tag=DWQCIMP2R5E6 type=write size=402718 2024-09-19T13:47:28.711 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.709+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=TE77NIHM8YGQ type=del size=2729881 2024-09-19T13:47:28.714 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.713+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=DU8PKXQU0KYN type=del 2024-09-19T13:47:28.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.713+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=X3KGL6330ADW type=del size=1325600 2024-09-19T13:47:28.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.717+0000 7fcf3240c8c0 1 < completed delete operation key=HXMZKP7H3HJE tag=0SLSG1ZFPFH0 type=del 2024-09-19T13:47:28.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.725+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0U9BUX9DHTAK.2~9ICV6F9W6NG5.0 size=273932 2024-09-19T13:47:28.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.725+0000 7fcf3240c8c0 1 > prepared multipart upload key=0U9BUX9DHTAK upload=9ICV6F9W6NG5 tag=Q0W0K89H8YCI type=write size=1322508 2024-09-19T13:47:28.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.725+0000 7fcf3240c8c0 1 < canceled part key=_multipart_AES54TJK7VH7.2~U5VQ008QJGTC.0 size=381613 2024-09-19T13:47:28.733 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.729+0000 7fcf3240c8c0 1 < canceled multipart upload key=AES54TJK7VH7 upload=U5VQ008QJGTC tag=OR11BUWVL2RW type=write size=1430189 2024-09-19T13:47:28.738 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.737+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~Y054C122BE0N.0 size=342782 2024-09-19T13:47:28.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.737+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=Y054C122BE0N tag=KP8AOUEZ4ZC6 type=write size=1391358 2024-09-19T13:47:28.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.737+0000 7fcf3240c8c0 1 < completed delete operation key=6DFF2OCPT9W2 tag=KX1QRRCB04PA type=del 2024-09-19T13:47:28.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.741+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=9RYXSUB855MM type=del size=3521581 2024-09-19T13:47:28.748 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.745+0000 7fcf3240c8c0 1 < completed delete operation key=X16ENUFL40RN tag=ZJ2V9AMWNPAE type=del 2024-09-19T13:47:28.751 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.749+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=ZF5MODF1L8UM type=del size=1568582 2024-09-19T13:47:28.754 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.753+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~J10LER8T9CU9.0 size=1048576 2024-09-19T13:47:28.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.753+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~J10LER8T9CU9.1 size=223634 2024-09-19T13:47:28.762 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.757+0000 7fcf3240c8c0 1 < completed multipart upload key=D20C6C2ZFX1W upload=J10LER8T9CU9 tag=S6U9KTWEIR8L type=write size=2320786 2024-09-19T13:47:28.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.765+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~88RFBX702Z05.0 size=1048576 2024-09-19T13:47:28.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.765+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~88RFBX702Z05.1 size=206669 2024-09-19T13:47:28.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.765+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=88RFBX702Z05 tag=0G41ZV6ZE795 type=write size=2303821 2024-09-19T13:47:28.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.769+0000 7fcf3240c8c0 1 < completed delete operation key=D20C6C2ZFX1W tag=RB62BRD3N16C type=del 2024-09-19T13:47:28.778 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.773+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~RGHTEM7X2U22.0 size=1048576 2024-09-19T13:47:28.780 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.777+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~RGHTEM7X2U22.1 size=504274 2024-09-19T13:47:28.780 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.777+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=RGHTEM7X2U22 tag=3CTCRK5Q9N7D type=write size=2601426 2024-09-19T13:47:28.783 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.781+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~W9A6LENDA2IX.0 size=890257 2024-09-19T13:47:28.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.785+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=W9A6LENDA2IX tag=9ETTMWDLLQ88 type=write size=1938833 2024-09-19T13:47:28.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.789+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~Z5R62PSO6DTT.0 size=593764 2024-09-19T13:47:28.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.789+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=Z5R62PSO6DTT tag=A458VAFMT259 type=write size=1642340 2024-09-19T13:47:28.799 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.797+0000 7fcf3240c8c0 1 < suggested update operation key=D1RMXGXS3O7Z tag=NCA6ROAZPVXT type=del size=2305477 2024-09-19T13:47:28.802 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.801+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=9Y1K07J4H7TP type=del size=2652250 2024-09-19T13:47:28.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.801+0000 7fcf3240c8c0 1 < canceled operation key=QAYJ5B1KZ08J tag=VX7YAQWNWDKG type=del size=3541550 2024-09-19T13:47:28.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.805+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=4F0NBYRZD74B type=del size=2200181 2024-09-19T13:47:28.814 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.809+0000 7fcf3240c8c0 1 < suggested update operation key=QAYJ5B1KZ08J tag=40R1FH2FB99E type=del size=3401485 2024-09-19T13:47:28.817 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.813+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=XYBPFJ0T7SRR type=write size=418316 2024-09-19T13:47:28.820 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.817+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~VHSQ1N7WFYRB.0 size=211567 2024-09-19T13:47:28.825 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.821+0000 7fcf3240c8c0 1 < completed multipart upload key=ZCKKQ1R8318S upload=VHSQ1N7WFYRB tag=LQ9IOKX9LT5I type=write size=1260143 2024-09-19T13:47:28.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.825+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~URR1KEMAZTNL.0 size=1048576 2024-09-19T13:47:28.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.829+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~URR1KEMAZTNL.1 size=151553 2024-09-19T13:47:28.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.829+0000 7fcf3240c8c0 1 > prepared multipart upload key=6DFF2OCPT9W2 upload=URR1KEMAZTNL tag=N7KY0K6I0BV9 type=write size=2248705 2024-09-19T13:47:28.838 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.833+0000 7fcf3240c8c0 1 < suggested update operation key=C35EUAOWLBR3 tag=QI2OK51GECW9 type=del size=761128 2024-09-19T13:47:28.843 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.841+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~X8TKVGK76TUU.0 size=1048576 2024-09-19T13:47:28.846 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.841+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~X8TKVGK76TUU.1 size=914183 2024-09-19T13:47:28.846 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.841+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=X8TKVGK76TUU tag=0Y6NDUC4IYPG type=write size=3011335 2024-09-19T13:47:28.849 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.845+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~WU8I6FB0K9UU.0 size=8760 2024-09-19T13:47:28.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.849+0000 7fcf3240c8c0 1 < completed multipart upload key=DHPONKOVS8CT upload=WU8I6FB0K9UU tag=SYLWG9LKZJZS type=write size=1057336 2024-09-19T13:47:28.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.857+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~JFW7WIPOQ5X4.0 size=747013 2024-09-19T13:47:28.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.857+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=JFW7WIPOQ5X4 tag=7HJU1W65MWUM type=write size=1795589 2024-09-19T13:47:28.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.861+0000 7fcf3240c8c0 1 < canceled operation key=XE42LV5M5X82 tag=02ALVF0T9UZE type=write size=546491 2024-09-19T13:47:28.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.865+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~5EVDOXSUS6J4.0 size=1048576 2024-09-19T13:47:28.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.869+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~5EVDOXSUS6J4.1 size=641405 2024-09-19T13:47:28.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.869+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=5EVDOXSUS6J4 tag=78H33RZJI5JJ type=write size=2738557 2024-09-19T13:47:28.877 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.873+0000 7fcf3240c8c0 1 < suggested remove operation key=DHPONKOVS8CT tag=TE77NIHM8YGQ type=del 2024-09-19T13:47:28.880 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.877+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=0VX13YY26APL type=del size=2232880 2024-09-19T13:47:28.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.881+0000 7fcf3240c8c0 1 < completed delete operation key=STMT6XU2EJQM tag=X3KGL6330ADW type=del 2024-09-19T13:47:28.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.885+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~F9YXOF2KL5UQ.0 size=1048576 2024-09-19T13:47:28.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.889+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~F9YXOF2KL5UQ.1 size=1048576 2024-09-19T13:47:28.895 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.893+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~F9YXOF2KL5UQ.2 size=63423 2024-09-19T13:47:28.895 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.893+0000 7fcf3240c8c0 1 > prepared multipart upload key=D1RMXGXS3O7Z upload=F9YXOF2KL5UQ tag=E1HXMXJMVZCZ type=write size=3209151 2024-09-19T13:47:28.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.893+0000 7fcf3240c8c0 1 < completed part key=_multipart_0U9BUX9DHTAK.2~9ICV6F9W6NG5.0 size=273932 2024-09-19T13:47:28.903 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.901+0000 7fcf3240c8c0 1 < completed multipart upload key=0U9BUX9DHTAK upload=9ICV6F9W6NG5 tag=Q0W0K89H8YCI type=write size=1322508 2024-09-19T13:47:28.906 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.901+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=ML44L7QNRIRQ type=del size=189755 2024-09-19T13:47:28.911 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.909+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~Y054C122BE0N.0 size=342782 2024-09-19T13:47:28.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.913+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=Y054C122BE0N tag=KP8AOUEZ4ZC6 type=write size=1391358 2024-09-19T13:47:28.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.917+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=H1Y266LZCWDQ type=del size=2319616 2024-09-19T13:47:28.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.921+0000 7fcf3240c8c0 -1 < failed to complete operation key=D1RMXGXS3O7Z tag=9RYXSUB855MM type=del size=3521581: (22) Invalid argument 2024-09-19T13:47:28.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.925+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~IG6B5J42QEAO.0 size=1048576 2024-09-19T13:47:28.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.929+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~IG6B5J42QEAO.1 size=1048576 2024-09-19T13:47:28.934 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.933+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~IG6B5J42QEAO.2 size=398017 2024-09-19T13:47:28.934 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.933+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=IG6B5J42QEAO tag=EI1LBOK4WJRC type=write size=3543745 2024-09-19T13:47:28.937 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.933+0000 7fcf3240c8c0 -1 < failed to complete operation key=D1RMXGXS3O7Z tag=ZF5MODF1L8UM type=del size=1568582: (22) Invalid argument 2024-09-19T13:47:28.940 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.937+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=SR9ODPE8SA5B type=del size=4074026 2024-09-19T13:47:28.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.941+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~88RFBX702Z05.0 size=1048576 2024-09-19T13:47:28.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.945+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~88RFBX702Z05.1 size=206669 2024-09-19T13:47:28.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.949+0000 7fcf3240c8c0 1 < completed multipart upload key=AES54TJK7VH7 upload=88RFBX702Z05 tag=0G41ZV6ZE795 type=write size=2303821 2024-09-19T13:47:28.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.949+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=QNH0EB7JGHMI type=del size=1680263 2024-09-19T13:47:28.957 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.953+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~RGHTEM7X2U22.0 size=1048576 2024-09-19T13:47:28.959 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.957+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~RGHTEM7X2U22.1 size=504274 2024-09-19T13:47:28.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.961+0000 7fcf3240c8c0 1 < completed multipart upload key=ZCKKQ1R8318S upload=RGHTEM7X2U22 tag=3CTCRK5Q9N7D type=write size=2601426 2024-09-19T13:47:28.967 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.965+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=ZO1T93QCUH8C type=del size=3175170 2024-09-19T13:47:28.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.965+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~Z5R62PSO6DTT.0 size=593764 2024-09-19T13:47:28.974 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.969+0000 7fcf3240c8c0 1 < completed multipart upload key=AES54TJK7VH7 upload=Z5R62PSO6DTT tag=A458VAFMT259 type=write size=1642340 2024-09-19T13:47:28.979 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.977+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~EFWC307W817O.0 size=1048576 2024-09-19T13:47:28.982 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.977+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~EFWC307W817O.1 size=607151 2024-09-19T13:47:28.982 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.977+0000 7fcf3240c8c0 1 > prepared multipart upload key=STMT6XU2EJQM upload=EFWC307W817O tag=XEL98O87EQMA type=write size=2704303 2024-09-19T13:47:28.987 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.985+0000 7fcf3240c8c0 1 < suggested remove operation key=3TME221SA53E tag=9Y1K07J4H7TP type=del 2024-09-19T13:47:28.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.985+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=AL0GNNKD2KLW type=del size=1925320 2024-09-19T13:47:28.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.989+0000 7fcf3240c8c0 -1 < failed to complete operation key=3TME221SA53E tag=4F0NBYRZD74B type=del size=2200181: (22) Invalid argument 2024-09-19T13:47:28.998 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.993+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~V0IRLWEZ2XRB.0 size=388870 2024-09-19T13:47:28.998 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.993+0000 7fcf3240c8c0 1 > prepared multipart upload key=6DFF2OCPT9W2 upload=V0IRLWEZ2XRB tag=HOKIU844Z6A9 type=write size=1437446 2024-09-19T13:47:29.001 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:28.997+0000 7fcf3240c8c0 1 < completed write operation key=NP2L28YRVQ8L tag=XYBPFJ0T7SRR type=write size=418316 2024-09-19T13:47:29.005 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.001+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=WZ4YBMFXJE19 type=write size=812233 2024-09-19T13:47:29.008 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.005+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~URR1KEMAZTNL.0 size=1048576 2024-09-19T13:47:29.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.009+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~URR1KEMAZTNL.1 size=151553 2024-09-19T13:47:29.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.013+0000 7fcf3240c8c0 1 < completed multipart upload key=6DFF2OCPT9W2 upload=URR1KEMAZTNL tag=N7KY0K6I0BV9 type=write size=2248705 2024-09-19T13:47:29.017 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.013+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=V38MROIB9VNO type=del size=1830100 2024-09-19T13:47:29.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.013+0000 7fcf3240c8c0 1 < canceled part key=_multipart_ES62XJO5Q3FO.2~X8TKVGK76TUU.0 size=1048576 2024-09-19T13:47:29.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.013+0000 7fcf3240c8c0 1 < canceled part key=_multipart_ES62XJO5Q3FO.2~X8TKVGK76TUU.1 size=914183 2024-09-19T13:47:29.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.021+0000 7fcf3240c8c0 1 < canceled multipart upload key=ES62XJO5Q3FO upload=X8TKVGK76TUU tag=0Y6NDUC4IYPG type=write size=3011335 2024-09-19T13:47:29.028 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.025+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~013Q2ZQ946JP.0 size=1048576 2024-09-19T13:47:29.030 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.025+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~013Q2ZQ946JP.1 size=313519 2024-09-19T13:47:29.030 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.025+0000 7fcf3240c8c0 1 > prepared multipart upload key=C3TFYNXH549T upload=013Q2ZQ946JP tag=5ZIXQMWAEJ79 type=write size=2410671 2024-09-19T13:47:29.033 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.029+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~JFW7WIPOQ5X4.0 size=747013 2024-09-19T13:47:29.038 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.033+0000 7fcf3240c8c0 1 < completed multipart upload key=M2CO4A2DHJ05 upload=JFW7WIPOQ5X4 tag=7HJU1W65MWUM type=write size=1795589 2024-09-19T13:47:29.041 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.037+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=KFETWEQVJG5O type=del size=744048 2024-09-19T13:47:29.044 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.041+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~5EVDOXSUS6J4.0 size=1048576 2024-09-19T13:47:29.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.045+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~5EVDOXSUS6J4.1 size=641405 2024-09-19T13:47:29.051 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.049+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=5EVDOXSUS6J4 tag=78H33RZJI5JJ type=write size=2738557 2024-09-19T13:47:29.057 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.053+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~F1CW82SLKVGK.0 size=792002 2024-09-19T13:47:29.057 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.053+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=F1CW82SLKVGK tag=XTELKOQZRSHX type=write size=1840578 2024-09-19T13:47:29.059 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.057+0000 7fcf3240c8c0 1 < completed delete operation key=6DFF2OCPT9W2 tag=0VX13YY26APL type=del 2024-09-19T13:47:29.065 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.061+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~S00FUT6L4RXS.0 size=1048576 2024-09-19T13:47:29.067 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.065+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~S00FUT6L4RXS.1 size=883726 2024-09-19T13:47:29.067 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.065+0000 7fcf3240c8c0 1 > prepared multipart upload key=DHPONKOVS8CT upload=S00FUT6L4RXS tag=SDA2SXQA6C1E type=write size=2980878 2024-09-19T13:47:29.070 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.065+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~F9YXOF2KL5UQ.0 size=1048576 2024-09-19T13:47:29.073 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.069+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~F9YXOF2KL5UQ.1 size=1048576 2024-09-19T13:47:29.075 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.073+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~F9YXOF2KL5UQ.2 size=63423 2024-09-19T13:47:29.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.077+0000 7fcf3240c8c0 1 < completed multipart upload key=D1RMXGXS3O7Z upload=F9YXOF2KL5UQ tag=E1HXMXJMVZCZ type=write size=3209151 2024-09-19T13:47:29.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.081+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=A4ZXE9XLVIR1 type=del size=2237460 2024-09-19T13:47:29.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.085+0000 7fcf3240c8c0 1 < suggested remove operation key=QSM2Q8CW1Q86 tag=ML44L7QNRIRQ type=del 2024-09-19T13:47:29.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.093+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~GR7GQPSHSTXX.0 size=1048576 2024-09-19T13:47:29.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.093+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~GR7GQPSHSTXX.1 size=801359 2024-09-19T13:47:29.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.093+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=GR7GQPSHSTXX tag=L07OO610CI9P type=write size=2898511 2024-09-19T13:47:29.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.097+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=H1Y266LZCWDQ type=del 2024-09-19T13:47:29.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.101+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=RXM23CM6FZNX type=del size=3073263 2024-09-19T13:47:29.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.105+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~IG6B5J42QEAO.0 size=1048576 2024-09-19T13:47:29.109 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.105+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~IG6B5J42QEAO.1 size=1048576 2024-09-19T13:47:29.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.109+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~IG6B5J42QEAO.2 size=398017 2024-09-19T13:47:29.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.113+0000 7fcf3240c8c0 1 < completed multipart upload key=AES54TJK7VH7 upload=IG6B5J42QEAO tag=EI1LBOK4WJRC type=write size=3543745 2024-09-19T13:47:29.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.117+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=ZX2LOHJ6BSQF type=write size=90301 2024-09-19T13:47:29.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.117+0000 7fcf3240c8c0 -1 < no bi entry to suggest for operation key=QSM2Q8CW1Q86 tag=SR9ODPE8SA5B type=del size=4074026: (2) No such file or directory 2024-09-19T13:47:29.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.125+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~Q7LEI2YZVQ2C.0 size=1048576 2024-09-19T13:47:29.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.125+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~Q7LEI2YZVQ2C.1 size=1048576 2024-09-19T13:47:29.132 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.129+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~Q7LEI2YZVQ2C.2 size=876000 2024-09-19T13:47:29.132 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.129+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=Q7LEI2YZVQ2C tag=QQTW83DILUD8 type=write size=4021728 2024-09-19T13:47:29.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.133+0000 7fcf3240c8c0 1 < completed delete operation key=7UC85R2HO9K2 tag=QNH0EB7JGHMI type=del 2024-09-19T13:47:29.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.137+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0U9BUX9DHTAK.2~OFPPNPR4LZ9T.0 size=772041 2024-09-19T13:47:29.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.137+0000 7fcf3240c8c0 1 > prepared multipart upload key=0U9BUX9DHTAK upload=OFPPNPR4LZ9T tag=DFCVVPT4TSIN type=write size=1820617 2024-09-19T13:47:29.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.145+0000 7fcf3240c8c0 1 < suggested update operation key=9ICCISYXT0IV tag=ZO1T93QCUH8C type=del size=3175170 2024-09-19T13:47:29.151 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.149+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=FYLI9QD2GM0Z type=write size=449887 2024-09-19T13:47:29.155 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.153+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~EFWC307W817O.0 size=1048576 2024-09-19T13:47:29.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.153+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~EFWC307W817O.1 size=607151 2024-09-19T13:47:29.163 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.161+0000 7fcf3240c8c0 1 < completed multipart upload key=STMT6XU2EJQM upload=EFWC307W817O tag=XEL98O87EQMA type=write size=2704303 2024-09-19T13:47:29.169 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.165+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~4PM4UT8E8YXT.0 size=1048576 2024-09-19T13:47:29.172 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.169+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~4PM4UT8E8YXT.1 size=786257 2024-09-19T13:47:29.172 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.169+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=4PM4UT8E8YXT tag=AMR9WEWNMP44 type=write size=2883409 2024-09-19T13:47:29.176 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.173+0000 7fcf3240c8c0 1 < completed delete operation key=X9FGPMP30X47 tag=AL0GNNKD2KLW type=del 2024-09-19T13:47:29.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.177+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=MKE3T1VXY3RF type=del size=3288683 2024-09-19T13:47:29.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.177+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~V0IRLWEZ2XRB.0 size=388870 2024-09-19T13:47:29.188 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.185+0000 7fcf3240c8c0 1 < completed multipart upload key=6DFF2OCPT9W2 upload=V0IRLWEZ2XRB tag=HOKIU844Z6A9 type=write size=1437446 2024-09-19T13:47:29.196 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.189+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=1647YK53UCGB type=del size=933181 2024-09-19T13:47:29.197 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.193+0000 7fcf3240c8c0 1 < canceled operation key=D20C6C2ZFX1W tag=WZ4YBMFXJE19 type=write size=812233 2024-09-19T13:47:29.201 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.197+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=HD29O29P7K7U type=del size=3339930 2024-09-19T13:47:29.207 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.205+0000 7fcf3240c8c0 1 < suggested remove operation key=OA9BMSXGYR9T tag=V38MROIB9VNO type=del 2024-09-19T13:47:29.211 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.209+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=75CZMMEJD49H type=del size=2281093 2024-09-19T13:47:29.214 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.213+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~013Q2ZQ946JP.0 size=1048576 2024-09-19T13:47:29.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.213+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~013Q2ZQ946JP.1 size=313519 2024-09-19T13:47:29.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.221+0000 7fcf3240c8c0 1 < completed multipart upload key=C3TFYNXH549T upload=013Q2ZQ946JP tag=5ZIXQMWAEJ79 type=write size=2410671 2024-09-19T13:47:29.229 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.225+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~Z4JOKQISY63B.0 size=1048576 2024-09-19T13:47:29.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.229+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~Z4JOKQISY63B.1 size=336315 2024-09-19T13:47:29.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.229+0000 7fcf3240c8c0 1 > prepared multipart upload key=1BMF3S2BZLLI upload=Z4JOKQISY63B tag=3LXEG7CQFR3J type=write size=2433467 2024-09-19T13:47:29.239 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.237+0000 7fcf3240c8c0 1 < suggested update operation key=DHPONKOVS8CT tag=KFETWEQVJG5O type=del size=744048 2024-09-19T13:47:29.242 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.237+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=U9J6XGEFM286 type=write size=915388 2024-09-19T13:47:29.245 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.241+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~F1CW82SLKVGK.0 size=792002 2024-09-19T13:47:29.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.249+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=F1CW82SLKVGK tag=XTELKOQZRSHX type=write size=1840578 2024-09-19T13:47:29.254 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.249+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=GMKWUF10AGQE type=write size=749661 2024-09-19T13:47:29.255 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.253+0000 7fcf3240c8c0 1 < canceled part key=_multipart_DHPONKOVS8CT.2~S00FUT6L4RXS.0 size=1048576 2024-09-19T13:47:29.257 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.253+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~S00FUT6L4RXS.1 size=883726 2024-09-19T13:47:29.262 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.261+0000 7fcf3240c8c0 1 < canceled multipart upload key=DHPONKOVS8CT upload=S00FUT6L4RXS tag=SDA2SXQA6C1E type=write size=2980878 2024-09-19T13:47:29.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.261+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=AQSL3T8203N0 type=del size=3309721 2024-09-19T13:47:29.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.265+0000 7fcf3240c8c0 1 < completed delete operation key=6DFF2OCPT9W2 tag=A4ZXE9XLVIR1 type=del 2024-09-19T13:47:29.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.269+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=GYKOD2QFB5M6 type=del size=2394887 2024-09-19T13:47:29.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.273+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~GR7GQPSHSTXX.0 size=1048576 2024-09-19T13:47:29.278 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.273+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~GR7GQPSHSTXX.1 size=801359 2024-09-19T13:47:29.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.281+0000 7fcf3240c8c0 1 < completed multipart upload key=N51Q6HKJSCCB upload=GR7GQPSHSTXX tag=L07OO610CI9P type=write size=2898511 2024-09-19T13:47:29.286 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.281+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=FYHNN90V2GLW type=del size=682635 2024-09-19T13:47:29.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.285+0000 7fcf3240c8c0 1 < canceled operation key=HXMZKP7H3HJE tag=RXM23CM6FZNX type=del size=3073263 2024-09-19T13:47:29.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.293+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~ML3HD9J2G7CR.0 size=1048576 2024-09-19T13:47:29.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.297+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~ML3HD9J2G7CR.1 size=1048576 2024-09-19T13:47:29.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.297+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~ML3HD9J2G7CR.2 size=212148 2024-09-19T13:47:29.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.297+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=ML3HD9J2G7CR tag=2MGOAN6Y5209 type=write size=3357876 2024-09-19T13:47:29.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.301+0000 7fcf3240c8c0 1 < canceled operation key=AES54TJK7VH7 tag=ZX2LOHJ6BSQF type=write size=90301 2024-09-19T13:47:29.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.305+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=HYNE6X5NSSY0 type=del size=2047858 2024-09-19T13:47:29.312 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.309+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~Q7LEI2YZVQ2C.0 size=1048576 2024-09-19T13:47:29.315 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.313+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~Q7LEI2YZVQ2C.1 size=1048576 2024-09-19T13:47:29.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.313+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~Q7LEI2YZVQ2C.2 size=876000 2024-09-19T13:47:29.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.321+0000 7fcf3240c8c0 1 < completed multipart upload key=QMSDNKYFFK1F upload=Q7LEI2YZVQ2C tag=QQTW83DILUD8 type=write size=4021728 2024-09-19T13:47:29.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.325+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~M4DJ24FEBC5O.0 size=1048576 2024-09-19T13:47:29.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.329+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~M4DJ24FEBC5O.1 size=1019496 2024-09-19T13:47:29.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.329+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=M4DJ24FEBC5O tag=0502K4ENLEA2 type=write size=3116648 2024-09-19T13:47:29.336 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.333+0000 7fcf3240c8c0 1 < completed part key=_multipart_0U9BUX9DHTAK.2~OFPPNPR4LZ9T.0 size=772041 2024-09-19T13:47:29.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.337+0000 7fcf3240c8c0 1 < completed multipart upload key=0U9BUX9DHTAK upload=OFPPNPR4LZ9T tag=DFCVVPT4TSIN type=write size=1820617 2024-09-19T13:47:29.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.341+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=VXAG23PROUSE type=del size=2800891 2024-09-19T13:47:29.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.345+0000 7fcf3240c8c0 1 < completed write operation key=A02RDP6BA9AC tag=FYLI9QD2GM0Z type=write size=449887 2024-09-19T13:47:29.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.349+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=D9MBVZ8T9948 type=del size=609342 2024-09-19T13:47:29.354 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.349+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~4PM4UT8E8YXT.0 size=1048576 2024-09-19T13:47:29.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.353+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~4PM4UT8E8YXT.1 size=786257 2024-09-19T13:47:29.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.357+0000 7fcf3240c8c0 1 < completed multipart upload key=QMSDNKYFFK1F upload=4PM4UT8E8YXT tag=AMR9WEWNMP44 type=write size=2883409 2024-09-19T13:47:29.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.361+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=9IK9D3T6BX0J type=del size=3469303 2024-09-19T13:47:29.367 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.365+0000 7fcf3240c8c0 1 < completed delete operation key=3TME221SA53E tag=MKE3T1VXY3RF type=del 2024-09-19T13:47:29.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.369+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~B14LCESF8RRV.0 size=1048576 2024-09-19T13:47:29.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.373+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~B14LCESF8RRV.1 size=1048576 2024-09-19T13:47:29.378 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.373+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~B14LCESF8RRV.2 size=285787 2024-09-19T13:47:29.378 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.373+0000 7fcf3240c8c0 1 > prepared multipart upload key=DHPONKOVS8CT upload=B14LCESF8RRV tag=IFMFN9E01Z3T type=write size=3431515 2024-09-19T13:47:29.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.377+0000 7fcf3240c8c0 1 < completed delete operation key=X16ENUFL40RN tag=1647YK53UCGB type=del 2024-09-19T13:47:29.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.381+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=CIYT0GB1BPIN type=del size=1308587 2024-09-19T13:47:29.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.385+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=HD29O29P7K7U type=del 2024-09-19T13:47:29.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.385+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=1VLAMLKUWGFF type=del size=2218106 2024-09-19T13:47:29.393 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.389+0000 7fcf3240c8c0 1 < completed delete operation key=C3TFYNXH549T tag=75CZMMEJD49H type=del 2024-09-19T13:47:29.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.393+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=8IVFVG7SUWU9 type=write size=119819 2024-09-19T13:47:29.400 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.397+0000 7fcf3240c8c0 1 < completed part key=_multipart_1BMF3S2BZLLI.2~Z4JOKQISY63B.0 size=1048576 2024-09-19T13:47:29.401 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.397+0000 7fcf3240c8c0 1 < completed part key=_multipart_1BMF3S2BZLLI.2~Z4JOKQISY63B.1 size=336315 2024-09-19T13:47:29.406 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.401+0000 7fcf3240c8c0 1 < completed multipart upload key=1BMF3S2BZLLI upload=Z4JOKQISY63B tag=3LXEG7CQFR3J type=write size=2433467 2024-09-19T13:47:29.408 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.405+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=GL6PW0441PSS type=del size=1828707 2024-09-19T13:47:29.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.409+0000 7fcf3240c8c0 1 < completed write operation key=STMT6XU2EJQM tag=U9J6XGEFM286 type=write size=915388 2024-09-19T13:47:29.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.413+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=NXL0MC7D55EI type=del size=3791292 2024-09-19T13:47:29.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.413+0000 7fcf3240c8c0 1 < completed write operation key=X9FGPMP30X47 tag=GMKWUF10AGQE type=write size=749661 2024-09-19T13:47:29.420 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.417+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=GXGSHFOU15A5 type=del size=2019956 2024-09-19T13:47:29.423 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.421+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=AQSL3T8203N0 type=del 2024-09-19T13:47:29.426 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.421+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=1111UURS589G type=del size=587056 2024-09-19T13:47:29.428 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.425+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=GYKOD2QFB5M6 type=del 2024-09-19T13:47:29.431 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.429+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=5255W9MSO7RH type=del size=1605695 2024-09-19T13:47:29.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.429+0000 7fcf3240c8c0 1 < completed delete operation key=0U9BUX9DHTAK tag=FYHNN90V2GLW type=del 2024-09-19T13:47:29.436 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.433+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=T1E2GWF8JF0U type=del size=1199363 2024-09-19T13:47:29.439 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.437+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~ML3HD9J2G7CR.0 size=1048576 2024-09-19T13:47:29.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.437+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~ML3HD9J2G7CR.1 size=1048576 2024-09-19T13:47:29.444 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.441+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~ML3HD9J2G7CR.2 size=212148 2024-09-19T13:47:29.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.445+0000 7fcf3240c8c0 1 < completed multipart upload key=N51Q6HKJSCCB upload=ML3HD9J2G7CR tag=2MGOAN6Y5209 type=write size=3357876 2024-09-19T13:47:29.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.449+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=YSJQPRPRYCDI type=del size=3360163 2024-09-19T13:47:29.456 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.453+0000 7fcf3240c8c0 1 < suggested remove operation key=C35EUAOWLBR3 tag=HYNE6X5NSSY0 type=del 2024-09-19T13:47:29.458 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.457+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=6SQ1T7MJCYDH type=del size=3262094 2024-09-19T13:47:29.459 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.457+0000 7fcf3240c8c0 1 < canceled part key=_multipart_QSM2Q8CW1Q86.2~M4DJ24FEBC5O.0 size=1048576 2024-09-19T13:47:29.461 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.457+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~M4DJ24FEBC5O.1 size=1019496 2024-09-19T13:47:29.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.461+0000 7fcf3240c8c0 1 < canceled multipart upload key=QSM2Q8CW1Q86 upload=M4DJ24FEBC5O tag=0502K4ENLEA2 type=write size=3116648 2024-09-19T13:47:29.468 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.465+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=O02VH1Z6NKNE type=del size=938008 2024-09-19T13:47:29.471 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.469+0000 7fcf3240c8c0 1 < completed delete operation key=0UCFTOF1YBBM tag=VXAG23PROUSE type=del 2024-09-19T13:47:29.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.473+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~TYK5L6JUA4CS.0 size=244062 2024-09-19T13:47:29.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.473+0000 7fcf3240c8c0 1 > prepared multipart upload key=STMT6XU2EJQM upload=TYK5L6JUA4CS tag=YH5XSUJ043MI type=write size=1292638 2024-09-19T13:47:29.478 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.473+0000 7fcf3240c8c0 1 < completed delete operation key=71Z2VTW99W7J tag=D9MBVZ8T9948 type=del 2024-09-19T13:47:29.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.481+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=Z2BN7Y4WNS5J type=del size=807680 2024-09-19T13:47:29.488 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.485+0000 7fcf3240c8c0 1 < suggested update operation key=V8X0VBBNK83J tag=9IK9D3T6BX0J type=del size=3469303 2024-09-19T13:47:29.491 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.489+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=TDMZP1MIA0T2 type=del size=2698342 2024-09-19T13:47:29.495 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.493+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~B14LCESF8RRV.0 size=1048576 2024-09-19T13:47:29.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.493+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~B14LCESF8RRV.1 size=1048576 2024-09-19T13:47:29.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.497+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~B14LCESF8RRV.2 size=285787 2024-09-19T13:47:29.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.501+0000 7fcf3240c8c0 1 < completed multipart upload key=DHPONKOVS8CT upload=B14LCESF8RRV tag=IFMFN9E01Z3T type=write size=3431515 2024-09-19T13:47:29.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.505+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=ANDOBDFW4N9O type=del size=2369547 2024-09-19T13:47:29.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.509+0000 7fcf3240c8c0 1 < completed delete operation key=BXUPV5XSJBTH tag=CIYT0GB1BPIN type=del 2024-09-19T13:47:29.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.509+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=HBOUL9AQ3U6Y type=del size=3869622 2024-09-19T13:47:29.517 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.513+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=1VLAMLKUWGFF type=del 2024-09-19T13:47:29.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.517+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~0K88Z4LZ82T9.0 size=916300 2024-09-19T13:47:29.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.517+0000 7fcf3240c8c0 1 > prepared multipart upload key=D1RMXGXS3O7Z upload=0K88Z4LZ82T9 tag=U11U60402Y77 type=write size=1964876 2024-09-19T13:47:29.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.521+0000 7fcf3240c8c0 1 < canceled operation key=A02RDP6BA9AC tag=8IVFVG7SUWU9 type=write size=119819 2024-09-19T13:47:29.528 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.525+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=Y12EID30LV30 type=del size=1204212 2024-09-19T13:47:29.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.529+0000 7fcf3240c8c0 1 < completed delete operation key=6DFF2OCPT9W2 tag=GL6PW0441PSS type=del 2024-09-19T13:47:29.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.533+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~IFIFSNGVNBNK.0 size=1048576 2024-09-19T13:47:29.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.537+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~IFIFSNGVNBNK.1 size=912069 2024-09-19T13:47:29.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.537+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=IFIFSNGVNBNK tag=HZ1QA383NNRE type=write size=3009221 2024-09-19T13:47:29.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.537+0000 7fcf3240c8c0 1 < completed delete operation key=D1RMXGXS3O7Z tag=NXL0MC7D55EI type=del 2024-09-19T13:47:29.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.541+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=DDCOQ9C3GCAV type=del size=3118414 2024-09-19T13:47:29.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.545+0000 7fcf3240c8c0 1 < completed delete operation key=A02RDP6BA9AC tag=GXGSHFOU15A5 type=del 2024-09-19T13:47:29.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.549+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~F25D7RXVFZ9C.0 size=1048576 2024-09-19T13:47:29.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.553+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~F25D7RXVFZ9C.1 size=295222 2024-09-19T13:47:29.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.553+0000 7fcf3240c8c0 1 > prepared multipart upload key=C8T6DB9V9FBT upload=F25D7RXVFZ9C tag=KE85NNRY1NGL type=write size=2392374 2024-09-19T13:47:29.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.553+0000 7fcf3240c8c0 1 < completed delete operation key=7UC85R2HO9K2 tag=1111UURS589G type=del 2024-09-19T13:47:29.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.557+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=54PVBXYRU0AG type=del size=511744 2024-09-19T13:47:29.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.561+0000 7fcf3240c8c0 1 < completed delete operation key=7UC85R2HO9K2 tag=5255W9MSO7RH type=del 2024-09-19T13:47:29.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.565+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~SRLQ8Y3P3V87.0 size=1048576 2024-09-19T13:47:29.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.569+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~SRLQ8Y3P3V87.1 size=988113 2024-09-19T13:47:29.573 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.569+0000 7fcf3240c8c0 1 > prepared multipart upload key=STMT6XU2EJQM upload=SRLQ8Y3P3V87 tag=81SRG9IMHNGA type=write size=3085265 2024-09-19T13:47:29.576 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.573+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=T1E2GWF8JF0U type=del 2024-09-19T13:47:29.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.577+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~AENZ83WJTNJP.0 size=1048576 2024-09-19T13:47:29.585 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.581+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~AENZ83WJTNJP.1 size=1048576 2024-09-19T13:47:29.587 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.585+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~AENZ83WJTNJP.2 size=323119 2024-09-19T13:47:29.587 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.585+0000 7fcf3240c8c0 1 > prepared multipart upload key=C3TFYNXH549T upload=AENZ83WJTNJP tag=PCFV4CESXSX0 type=write size=3468847 2024-09-19T13:47:29.591 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.589+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=YSJQPRPRYCDI type=del 2024-09-19T13:47:29.594 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.593+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=1BIOJ8XZJ8B8 type=del size=3462570 2024-09-19T13:47:29.597 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.593+0000 7fcf3240c8c0 1 < completed delete operation key=1BMF3S2BZLLI tag=6SQ1T7MJCYDH type=del 2024-09-19T13:47:29.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.597+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=AY06J1ITCVJQ type=write size=437963 2024-09-19T13:47:29.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.601+0000 7fcf3240c8c0 1 < completed delete operation key=M2CO4A2DHJ05 tag=O02VH1Z6NKNE type=del 2024-09-19T13:47:29.608 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.605+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=H1KMYR3V6CQ6 type=del size=3075172 2024-09-19T13:47:29.611 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.609+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~TYK5L6JUA4CS.0 size=244062 2024-09-19T13:47:29.616 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.613+0000 7fcf3240c8c0 1 < completed multipart upload key=STMT6XU2EJQM upload=TYK5L6JUA4CS tag=YH5XSUJ043MI type=write size=1292638 2024-09-19T13:47:29.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.617+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=8H646OFXPG46 type=del size=1530267 2024-09-19T13:47:29.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.621+0000 7fcf3240c8c0 1 < completed delete operation key=STMT6XU2EJQM tag=Z2BN7Y4WNS5J type=del 2024-09-19T13:47:29.626 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.621+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=1PVU7H59L5EY type=del size=538260 2024-09-19T13:47:29.629 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.625+0000 7fcf3240c8c0 1 < completed delete operation key=DHPONKOVS8CT tag=TDMZP1MIA0T2 type=del 2024-09-19T13:47:29.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.629+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=G0DJ903OZY34 type=del size=3468883 2024-09-19T13:47:29.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.633+0000 7fcf3240c8c0 1 < canceled operation key=0UCFTOF1YBBM tag=ANDOBDFW4N9O type=del size=2369547 2024-09-19T13:47:29.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.637+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~K8YZ6XXK9GW8.0 size=1048576 2024-09-19T13:47:29.644 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.641+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~K8YZ6XXK9GW8.1 size=1048576 2024-09-19T13:47:29.647 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.645+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~K8YZ6XXK9GW8.2 size=1033362 2024-09-19T13:47:29.647 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.645+0000 7fcf3240c8c0 1 > prepared multipart upload key=STMT6XU2EJQM upload=K8YZ6XXK9GW8 tag=WWZLD79HX7TP type=write size=4179090 2024-09-19T13:47:29.651 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.649+0000 7fcf3240c8c0 1 < completed delete operation key=ZCKKQ1R8318S tag=HBOUL9AQ3U6Y type=del 2024-09-19T13:47:29.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.653+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~IE3Z3UX0GP4I.0 size=1048576 2024-09-19T13:47:29.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.657+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~IE3Z3UX0GP4I.1 size=1048576 2024-09-19T13:47:29.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.657+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~IE3Z3UX0GP4I.2 size=202689 2024-09-19T13:47:29.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.657+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=IE3Z3UX0GP4I tag=PHI5B3W2LN5H type=write size=3348417 2024-09-19T13:47:29.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.661+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~0K88Z4LZ82T9.0 size=916300 2024-09-19T13:47:29.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.669+0000 7fcf3240c8c0 1 < completed multipart upload key=D1RMXGXS3O7Z upload=0K88Z4LZ82T9 tag=U11U60402Y77 type=write size=1964876 2024-09-19T13:47:29.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.669+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=TJYS5X2X62GA type=del size=2275083 2024-09-19T13:47:29.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.673+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=Y12EID30LV30 type=del 2024-09-19T13:47:29.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.677+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=XLX7OL2F2FPX type=del size=44627 2024-09-19T13:47:29.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.681+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~IFIFSNGVNBNK.0 size=1048576 2024-09-19T13:47:29.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.685+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~IFIFSNGVNBNK.1 size=912069 2024-09-19T13:47:29.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.689+0000 7fcf3240c8c0 1 < completed multipart upload key=0UCFTOF1YBBM upload=IFIFSNGVNBNK tag=HZ1QA383NNRE type=write size=3009221 2024-09-19T13:47:29.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.693+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=KFDGNQGF1C7G type=del size=3930171 2024-09-19T13:47:29.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.697+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=DDCOQ9C3GCAV type=del 2024-09-19T13:47:29.704 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.701+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=EQL1I2LBZG0J type=del size=1401299 2024-09-19T13:47:29.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.705+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~F25D7RXVFZ9C.0 size=1048576 2024-09-19T13:47:29.710 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.709+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~F25D7RXVFZ9C.1 size=295222 2024-09-19T13:47:29.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.713+0000 7fcf3240c8c0 1 < completed multipart upload key=C8T6DB9V9FBT upload=F25D7RXVFZ9C tag=KE85NNRY1NGL type=write size=2392374 2024-09-19T13:47:29.722 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.717+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0U9BUX9DHTAK.2~59X3PANHPSFI.0 size=809582 2024-09-19T13:47:29.722 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.717+0000 7fcf3240c8c0 1 > prepared multipart upload key=0U9BUX9DHTAK upload=59X3PANHPSFI tag=DZX6O47SRNDO type=write size=1858158 2024-09-19T13:47:29.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.725+0000 7fcf3240c8c0 1 < suggested remove operation key=QMSDNKYFFK1F tag=54PVBXYRU0AG type=del 2024-09-19T13:47:29.730 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.729+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=JIVBY4QSUIKR type=del size=1431272 2024-09-19T13:47:29.731 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.729+0000 7fcf3240c8c0 1 < canceled part key=_multipart_STMT6XU2EJQM.2~SRLQ8Y3P3V87.0 size=1048576 2024-09-19T13:47:29.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.729+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~SRLQ8Y3P3V87.1 size=988113 2024-09-19T13:47:29.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.737+0000 7fcf3240c8c0 1 < canceled multipart upload key=STMT6XU2EJQM upload=SRLQ8Y3P3V87 tag=81SRG9IMHNGA type=write size=3085265 2024-09-19T13:47:29.743 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.741+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=CHXYBYQS5PM2 type=del size=1714211 2024-09-19T13:47:29.746 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.745+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~AENZ83WJTNJP.0 size=1048576 2024-09-19T13:47:29.749 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.745+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~AENZ83WJTNJP.1 size=1048576 2024-09-19T13:47:29.752 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.749+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~AENZ83WJTNJP.2 size=323119 2024-09-19T13:47:29.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.753+0000 7fcf3240c8c0 1 < completed multipart upload key=C3TFYNXH549T upload=AENZ83WJTNJP tag=PCFV4CESXSX0 type=write size=3468847 2024-09-19T13:47:29.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.757+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=BYB0LFA6BYQ8 type=del size=695043 2024-09-19T13:47:29.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.761+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=1BIOJ8XZJ8B8 type=del 2024-09-19T13:47:29.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.765+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=PN8O4ZI1V7D1 type=write size=51676 2024-09-19T13:47:29.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.769+0000 7fcf3240c8c0 1 < completed write operation key=6DFF2OCPT9W2 tag=AY06J1ITCVJQ type=write size=437963 2024-09-19T13:47:29.780 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.777+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~D45IAVJFR99Z.0 size=661207 2024-09-19T13:47:29.780 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.777+0000 7fcf3240c8c0 1 > prepared multipart upload key=X9FGPMP30X47 upload=D45IAVJFR99Z tag=DU26BFHMLF44 type=write size=1709783 2024-09-19T13:47:29.783 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.781+0000 7fcf3240c8c0 1 < completed delete operation key=N51Q6HKJSCCB tag=H1KMYR3V6CQ6 type=del 2024-09-19T13:47:29.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.785+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=EGVEKY542K83 type=del size=3701959 2024-09-19T13:47:29.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.793+0000 7fcf3240c8c0 1 < suggested update operation key=D20C6C2ZFX1W tag=8H646OFXPG46 type=del size=1530267 2024-09-19T13:47:29.800 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.797+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=FVG0CF8X353D type=write size=845473 2024-09-19T13:47:29.807 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.805+0000 7fcf3240c8c0 1 < suggested remove operation key=N51Q6HKJSCCB tag=1PVU7H59L5EY type=del 2024-09-19T13:47:29.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.805+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=QVPBIJ8YJXQJ type=del size=3755987 2024-09-19T13:47:29.817 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.813+0000 7fcf3240c8c0 1 < suggested remove operation key=ZCKKQ1R8318S tag=G0DJ903OZY34 type=del 2024-09-19T13:47:29.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.821+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~20NLN2P0Y23F.0 size=1048576 2024-09-19T13:47:29.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.821+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~20NLN2P0Y23F.1 size=1048576 2024-09-19T13:47:29.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.825+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~20NLN2P0Y23F.2 size=327959 2024-09-19T13:47:29.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.825+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=20NLN2P0Y23F tag=FGOEUL382OK6 type=write size=3473687 2024-09-19T13:47:29.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.829+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~K8YZ6XXK9GW8.0 size=1048576 2024-09-19T13:47:29.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.829+0000 7fcf3240c8c0 1 < canceled part key=_multipart_STMT6XU2EJQM.2~K8YZ6XXK9GW8.1 size=1048576 2024-09-19T13:47:29.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.833+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~K8YZ6XXK9GW8.2 size=1033362 2024-09-19T13:47:29.842 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.841+0000 7fcf3240c8c0 1 < canceled multipart upload key=STMT6XU2EJQM upload=K8YZ6XXK9GW8 tag=WWZLD79HX7TP type=write size=4179090 2024-09-19T13:47:29.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.845+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~3AASFPYCMS2W.0 size=301859 2024-09-19T13:47:29.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.845+0000 7fcf3240c8c0 1 > prepared multipart upload key=1BMF3S2BZLLI upload=3AASFPYCMS2W tag=01MCVPONXW8H type=write size=1350435 2024-09-19T13:47:29.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.849+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~IE3Z3UX0GP4I.0 size=1048576 2024-09-19T13:47:29.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.853+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~IE3Z3UX0GP4I.1 size=1048576 2024-09-19T13:47:29.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.857+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~IE3Z3UX0GP4I.2 size=202689 2024-09-19T13:47:29.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.861+0000 7fcf3240c8c0 1 < completed multipart upload key=N51Q6HKJSCCB upload=IE3Z3UX0GP4I tag=PHI5B3W2LN5H type=write size=3348417 2024-09-19T13:47:29.871 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.869+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~URT6OMV9ZBC2.0 size=1048576 2024-09-19T13:47:29.874 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.873+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~URT6OMV9ZBC2.1 size=788010 2024-09-19T13:47:29.874 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.873+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=URT6OMV9ZBC2 tag=CP2KZ62LPXRQ type=write size=2885162 2024-09-19T13:47:29.878 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.873+0000 7fcf3240c8c0 1 < completed delete operation key=DHPONKOVS8CT tag=TJYS5X2X62GA type=del 2024-09-19T13:47:29.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.881+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~Y9D5QH4EQV57.0 size=57554 2024-09-19T13:47:29.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.881+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=Y9D5QH4EQV57 tag=RNQUS3VODXG3 type=write size=1106130 2024-09-19T13:47:29.887 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.885+0000 7fcf3240c8c0 1 < completed delete operation key=71Z2VTW99W7J tag=XLX7OL2F2FPX type=del 2024-09-19T13:47:29.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.889+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~039BAP5OI4LE.0 size=1048576 2024-09-19T13:47:29.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.893+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~039BAP5OI4LE.1 size=1048576 2024-09-19T13:47:29.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.897+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~039BAP5OI4LE.2 size=357522 2024-09-19T13:47:29.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.897+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=039BAP5OI4LE tag=HL5IRE113QSM type=write size=3503250 2024-09-19T13:47:29.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.897+0000 7fcf3240c8c0 1 < completed delete operation key=C8T6DB9V9FBT tag=KFDGNQGF1C7G type=del 2024-09-19T13:47:29.906 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.901+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=G5CQ76BKX76Y type=del size=2590982 2024-09-19T13:47:29.909 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.905+0000 7fcf3240c8c0 1 < canceled operation key=HXMZKP7H3HJE tag=EQL1I2LBZG0J type=del size=1401299 2024-09-19T13:47:29.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.909+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=QRSIW17V68ZP type=del size=3370934 2024-09-19T13:47:29.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.913+0000 7fcf3240c8c0 1 < completed part key=_multipart_0U9BUX9DHTAK.2~59X3PANHPSFI.0 size=809582 2024-09-19T13:47:29.920 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.917+0000 7fcf3240c8c0 1 < completed multipart upload key=0U9BUX9DHTAK upload=59X3PANHPSFI tag=DZX6O47SRNDO type=write size=1858158 2024-09-19T13:47:29.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.925+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~2JMTK4JKTIR8.0 size=1048576 2024-09-19T13:47:29.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.925+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~2JMTK4JKTIR8.1 size=1048576 2024-09-19T13:47:29.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.929+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~2JMTK4JKTIR8.2 size=727835 2024-09-19T13:47:29.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.929+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=2JMTK4JKTIR8 tag=DLILYYZ56PMU type=write size=3873563 2024-09-19T13:47:29.935 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.933+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=JIVBY4QSUIKR type=del 2024-09-19T13:47:29.939 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.937+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=IJD5RJMZ44H9 type=del size=1126893 2024-09-19T13:47:29.942 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.937+0000 7fcf3240c8c0 1 < completed delete operation key=DHPONKOVS8CT tag=CHXYBYQS5PM2 type=del 2024-09-19T13:47:29.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.941+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=62P1ERZFLPC2 type=del size=205540 2024-09-19T13:47:29.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.945+0000 7fcf3240c8c0 1 < canceled operation key=7UC85R2HO9K2 tag=BYB0LFA6BYQ8 type=del size=695043 2024-09-19T13:47:29.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.949+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=QDQEDQDWGL88 type=write size=1034156 2024-09-19T13:47:29.955 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.953+0000 7fcf3240c8c0 1 < completed write operation key=NP2L28YRVQ8L tag=PN8O4ZI1V7D1 type=write size=51676 2024-09-19T13:47:29.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.957+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~6CLKA6QKCX32.0 size=726765 2024-09-19T13:47:29.962 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.957+0000 7fcf3240c8c0 1 > prepared multipart upload key=D1RMXGXS3O7Z upload=6CLKA6QKCX32 tag=ZG3IIVF2SWJM type=write size=1775341 2024-09-19T13:47:29.962 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.961+0000 7fcf3240c8c0 1 < canceled part key=_multipart_X9FGPMP30X47.2~D45IAVJFR99Z.0 size=661207 2024-09-19T13:47:29.967 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.965+0000 7fcf3240c8c0 1 < canceled multipart upload key=X9FGPMP30X47 upload=D45IAVJFR99Z tag=DU26BFHMLF44 type=write size=1709783 2024-09-19T13:47:29.974 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.969+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~4DCCLVTN0HNX.0 size=253366 2024-09-19T13:47:29.974 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.969+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=4DCCLVTN0HNX tag=91W3THR1Y3CO type=write size=1301942 2024-09-19T13:47:29.977 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.973+0000 7fcf3240c8c0 1 < completed delete operation key=HXMZKP7H3HJE tag=EGVEKY542K83 type=del 2024-09-19T13:47:29.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.981+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~2R8ORQIN5JAI.0 size=1048576 2024-09-19T13:47:29.986 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.981+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~2R8ORQIN5JAI.1 size=697746 2024-09-19T13:47:29.986 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.981+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=2R8ORQIN5JAI tag=GCPMMHD1KXVZ type=write size=2794898 2024-09-19T13:47:29.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.985+0000 7fcf3240c8c0 1 < completed write operation key=6DFF2OCPT9W2 tag=FVG0CF8X353D type=write size=845473 2024-09-19T13:47:29.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.989+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=Z1NKZ356GVPS type=del size=645201 2024-09-19T13:47:29.996 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.993+0000 7fcf3240c8c0 1 < completed delete operation key=6DFF2OCPT9W2 tag=QVPBIJ8YJXQJ type=del 2024-09-19T13:47:29.999 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:29.997+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=326QOT5YFZ7X type=del size=3431811 2024-09-19T13:47:30.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.001+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~20NLN2P0Y23F.0 size=1048576 2024-09-19T13:47:30.005 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.001+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~20NLN2P0Y23F.1 size=1048576 2024-09-19T13:47:30.008 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.005+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~20NLN2P0Y23F.2 size=327959 2024-09-19T13:47:30.013 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.009+0000 7fcf3240c8c0 1 < completed multipart upload key=QMSDNKYFFK1F upload=20NLN2P0Y23F tag=FGOEUL382OK6 type=write size=3473687 2024-09-19T13:47:30.016 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.013+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=3F0B3ATOJZ72 type=del size=130465 2024-09-19T13:47:30.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.017+0000 7fcf3240c8c0 1 < completed part key=_multipart_1BMF3S2BZLLI.2~3AASFPYCMS2W.0 size=301859 2024-09-19T13:47:30.024 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.021+0000 7fcf3240c8c0 1 < completed multipart upload key=1BMF3S2BZLLI upload=3AASFPYCMS2W tag=01MCVPONXW8H type=write size=1350435 2024-09-19T13:47:30.026 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.025+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=OKVZ1DZGS84O type=del size=2532069 2024-09-19T13:47:30.030 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.025+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~URT6OMV9ZBC2.0 size=1048576 2024-09-19T13:47:30.032 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.029+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~URT6OMV9ZBC2.1 size=788010 2024-09-19T13:47:30.037 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.033+0000 7fcf3240c8c0 1 < completed multipart upload key=D20C6C2ZFX1W upload=URT6OMV9ZBC2 tag=CP2KZ62LPXRQ type=write size=2885162 2024-09-19T13:47:30.040 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.037+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=SGMS6HYTTW0U type=write size=424171 2024-09-19T13:47:30.043 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.041+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~Y9D5QH4EQV57.0 size=57554 2024-09-19T13:47:30.049 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.045+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=Y9D5QH4EQV57 tag=RNQUS3VODXG3 type=write size=1106130 2024-09-19T13:47:30.052 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.049+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=Y0Q02AUNP7BB type=del size=3194807 2024-09-19T13:47:30.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.053+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~039BAP5OI4LE.0 size=1048576 2024-09-19T13:47:30.057 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.053+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~039BAP5OI4LE.1 size=1048576 2024-09-19T13:47:30.060 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.057+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~039BAP5OI4LE.2 size=357522 2024-09-19T13:47:30.065 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.061+0000 7fcf3240c8c0 1 < completed multipart upload key=QSM2Q8CW1Q86 upload=039BAP5OI4LE tag=HL5IRE113QSM type=write size=3503250 2024-09-19T13:47:30.068 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.065+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=UQWSJMJU7AGG type=write size=283605 2024-09-19T13:47:30.075 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.073+0000 7fcf3240c8c0 1 < suggested remove operation key=C3TFYNXH549T tag=G5CQ76BKX76Y type=del 2024-09-19T13:47:30.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.077+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~Q58NECFQ5OKN.0 size=1048576 2024-09-19T13:47:30.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.081+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~Q58NECFQ5OKN.1 size=1048576 2024-09-19T13:47:30.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.085+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~Q58NECFQ5OKN.2 size=159505 2024-09-19T13:47:30.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.085+0000 7fcf3240c8c0 1 > prepared multipart upload key=X16ENUFL40RN upload=Q58NECFQ5OKN tag=OH9QIHZRBATI type=write size=3305233 2024-09-19T13:47:30.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.085+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=QRSIW17V68ZP type=del 2024-09-19T13:47:30.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.089+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=X0Z39SZCLBOB type=del size=4004255 2024-09-19T13:47:30.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.097+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~2JMTK4JKTIR8.0 size=1048576 2024-09-19T13:47:30.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.101+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~2JMTK4JKTIR8.1 size=1048576 2024-09-19T13:47:30.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.101+0000 7fcf3240c8c0 1 < canceled part key=_multipart_7UC85R2HO9K2.2~2JMTK4JKTIR8.2 size=727835 2024-09-19T13:47:30.109 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.105+0000 7fcf3240c8c0 1 < canceled multipart upload key=7UC85R2HO9K2 upload=2JMTK4JKTIR8 tag=DLILYYZ56PMU type=write size=3873563 2024-09-19T13:47:30.112 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.109+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=UWLEIEZ71XBF type=del size=326770 2024-09-19T13:47:30.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.113+0000 7fcf3240c8c0 1 < completed delete operation key=ZCKKQ1R8318S tag=IJD5RJMZ44H9 type=del 2024-09-19T13:47:30.118 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.113+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=XOE577CNV53R type=del size=1498495 2024-09-19T13:47:30.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.117+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=62P1ERZFLPC2 type=del 2024-09-19T13:47:30.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.125+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~B118O1SHGLUX.0 size=34454 2024-09-19T13:47:30.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.125+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=B118O1SHGLUX tag=ORQI0EAR61QF type=write size=1083030 2024-09-19T13:47:30.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.125+0000 7fcf3240c8c0 1 < completed write operation key=XE42LV5M5X82 tag=QDQEDQDWGL88 type=write size=1034156 2024-09-19T13:47:30.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.129+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=7NO24PP3GP2D type=del size=665305 2024-09-19T13:47:30.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.133+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~6CLKA6QKCX32.0 size=726765 2024-09-19T13:47:30.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.137+0000 7fcf3240c8c0 1 < completed multipart upload key=D1RMXGXS3O7Z upload=6CLKA6QKCX32 tag=ZG3IIVF2SWJM type=write size=1775341 2024-09-19T13:47:30.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.141+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=5ZOXUI62GG4M type=del size=1448815 2024-09-19T13:47:30.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.141+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~4DCCLVTN0HNX.0 size=253366 2024-09-19T13:47:30.151 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.149+0000 7fcf3240c8c0 1 < completed multipart upload key=M2CO4A2DHJ05 upload=4DCCLVTN0HNX tag=91W3THR1Y3CO type=write size=1301942 2024-09-19T13:47:30.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.153+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~EHPEXZTLR84A.0 size=1048576 2024-09-19T13:47:30.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.157+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~EHPEXZTLR84A.1 size=1048576 2024-09-19T13:47:30.161 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.157+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~EHPEXZTLR84A.2 size=829874 2024-09-19T13:47:30.161 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.157+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=EHPEXZTLR84A tag=E8C82NL089IQ type=write size=3975602 2024-09-19T13:47:30.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.161+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~2R8ORQIN5JAI.0 size=1048576 2024-09-19T13:47:30.166 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.161+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~2R8ORQIN5JAI.1 size=697746 2024-09-19T13:47:30.171 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.169+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=2R8ORQIN5JAI tag=GCPMMHD1KXVZ type=write size=2794898 2024-09-19T13:47:30.175 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.173+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=RTUXK0DC1K8D type=del size=1540674 2024-09-19T13:47:30.178 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.173+0000 7fcf3240c8c0 1 < completed delete operation key=STMT6XU2EJQM tag=Z1NKZ356GVPS type=del 2024-09-19T13:47:30.184 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.181+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~TCRT3DF8DCR2.0 size=260487 2024-09-19T13:47:30.184 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.181+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=TCRT3DF8DCR2 tag=OFDN4M6L0XCK type=write size=1309063 2024-09-19T13:47:30.187 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.185+0000 7fcf3240c8c0 1 < completed delete operation key=X9FGPMP30X47 tag=326QOT5YFZ7X type=del 2024-09-19T13:47:30.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.189+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~D7J9657G816J.0 size=400998 2024-09-19T13:47:30.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.189+0000 7fcf3240c8c0 1 > prepared multipart upload key=DHPONKOVS8CT upload=D7J9657G816J tag=WM1UXHOKOSPJ type=write size=1449574 2024-09-19T13:47:30.199 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.197+0000 7fcf3240c8c0 1 < suggested remove operation key=STMT6XU2EJQM tag=3F0B3ATOJZ72 type=del 2024-09-19T13:47:30.202 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.201+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=DLO5F0UY9KVI type=del size=668941 2024-09-19T13:47:30.209 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.205+0000 7fcf3240c8c0 1 < suggested remove operation key=X16ENUFL40RN tag=OKVZ1DZGS84O type=del 2024-09-19T13:47:30.212 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.209+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=FAPDLLRJQ7GS type=del size=17718 2024-09-19T13:47:30.216 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.213+0000 7fcf3240c8c0 1 < completed write operation key=9ICCISYXT0IV tag=SGMS6HYTTW0U type=write size=424171 2024-09-19T13:47:30.222 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.217+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~YVQHPHLTY9B3.0 size=1003834 2024-09-19T13:47:30.222 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.217+0000 7fcf3240c8c0 1 > prepared multipart upload key=C3TFYNXH549T upload=YVQHPHLTY9B3 tag=6BUFJ0QBY2OF type=write size=2052410 2024-09-19T13:47:30.229 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.225+0000 7fcf3240c8c0 1 < suggested update operation key=QAYJ5B1KZ08J tag=Y0Q02AUNP7BB type=del size=3194807 2024-09-19T13:47:30.235 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.233+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~GLQ49DPUBGGQ.0 size=825956 2024-09-19T13:47:30.235 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.233+0000 7fcf3240c8c0 1 > prepared multipart upload key=71Z2VTW99W7J upload=GLQ49DPUBGGQ tag=77LGS6DXTXYN type=write size=1874532 2024-09-19T13:47:30.238 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.233+0000 7fcf3240c8c0 1 < completed write operation key=3TME221SA53E tag=UQWSJMJU7AGG type=write size=283605 2024-09-19T13:47:30.243 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.241+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~OM2V393YTW74.0 size=168050 2024-09-19T13:47:30.243 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.241+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=OM2V393YTW74 tag=N1QMTWXXYSKD type=write size=1216626 2024-09-19T13:47:30.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.241+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~Q58NECFQ5OKN.0 size=1048576 2024-09-19T13:47:30.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.245+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~Q58NECFQ5OKN.1 size=1048576 2024-09-19T13:47:30.250 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.245+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~Q58NECFQ5OKN.2 size=159505 2024-09-19T13:47:30.254 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.253+0000 7fcf3240c8c0 1 < completed multipart upload key=X16ENUFL40RN upload=Q58NECFQ5OKN tag=OH9QIHZRBATI type=write size=3305233 2024-09-19T13:47:30.260 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.257+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~I3LSJEP3YP8A.0 size=1048576 2024-09-19T13:47:30.262 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.257+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~I3LSJEP3YP8A.1 size=1048576 2024-09-19T13:47:30.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.261+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~I3LSJEP3YP8A.2 size=1017927 2024-09-19T13:47:30.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.261+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=I3LSJEP3YP8A tag=SI1Y9LYD9JCN type=write size=4163655 2024-09-19T13:47:30.267 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.265+0000 7fcf3240c8c0 1 < completed delete operation key=0UCFTOF1YBBM tag=X0Z39SZCLBOB type=del 2024-09-19T13:47:30.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.269+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~R48ZCH1RAARP.0 size=1048576 2024-09-19T13:47:30.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.269+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~R48ZCH1RAARP.1 size=1048576 2024-09-19T13:47:30.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.273+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~R48ZCH1RAARP.2 size=879096 2024-09-19T13:47:30.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.273+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=R48ZCH1RAARP tag=ADQW6KIBXLDE type=write size=4024824 2024-09-19T13:47:30.278 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.273+0000 7fcf3240c8c0 1 < completed delete operation key=0UCFTOF1YBBM tag=UWLEIEZ71XBF type=del 2024-09-19T13:47:30.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.277+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=AFMNBGVR1F9U type=del size=1275896 2024-09-19T13:47:30.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.281+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=XOE577CNV53R type=del 2024-09-19T13:47:30.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.281+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=CVPILR0PMMKV type=write size=496905 2024-09-19T13:47:30.287 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.285+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~B118O1SHGLUX.0 size=34454 2024-09-19T13:47:30.291 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.289+0000 7fcf3240c8c0 1 < completed multipart upload key=N51Q6HKJSCCB upload=B118O1SHGLUX tag=ORQI0EAR61QF type=write size=1083030 2024-09-19T13:47:30.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.289+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=H02S6W26J2IF type=del size=3457504 2024-09-19T13:47:30.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.293+0000 7fcf3240c8c0 1 < completed delete operation key=ZCKKQ1R8318S tag=7NO24PP3GP2D type=del 2024-09-19T13:47:30.300 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.297+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~BFU3J7L8D6DS.0 size=1048576 2024-09-19T13:47:30.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.301+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~BFU3J7L8D6DS.1 size=925255 2024-09-19T13:47:30.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.301+0000 7fcf3240c8c0 1 > prepared multipart upload key=C3TFYNXH549T upload=BFU3J7L8D6DS tag=QB2GPIP7WYS7 type=write size=3022407 2024-09-19T13:47:30.305 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.301+0000 7fcf3240c8c0 1 < completed delete operation key=71Z2VTW99W7J tag=5ZOXUI62GG4M type=del 2024-09-19T13:47:30.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.305+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~8ZKBNXYAVBIZ.0 size=1048576 2024-09-19T13:47:30.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.309+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~8ZKBNXYAVBIZ.1 size=1048576 2024-09-19T13:47:30.313 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.309+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~8ZKBNXYAVBIZ.2 size=927586 2024-09-19T13:47:30.313 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.309+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=8ZKBNXYAVBIZ tag=JAI4CM0H7HO7 type=write size=4073314 2024-09-19T13:47:30.315 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.313+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~EHPEXZTLR84A.0 size=1048576 2024-09-19T13:47:30.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.313+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~EHPEXZTLR84A.1 size=1048576 2024-09-19T13:47:30.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.317+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~EHPEXZTLR84A.2 size=829874 2024-09-19T13:47:30.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.321+0000 7fcf3240c8c0 1 < completed multipart upload key=QAYJ5B1KZ08J upload=EHPEXZTLR84A tag=E8C82NL089IQ type=write size=3975602 2024-09-19T13:47:30.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.321+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=UZ87S01LB2HY type=del size=298316 2024-09-19T13:47:30.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.325+0000 7fcf3240c8c0 1 < canceled operation key=3TME221SA53E tag=RTUXK0DC1K8D type=del size=1540674 2024-09-19T13:47:30.331 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.329+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=9UCZBZ7RSORI type=write size=833677 2024-09-19T13:47:30.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.329+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~TCRT3DF8DCR2.0 size=260487 2024-09-19T13:47:30.337 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.333+0000 7fcf3240c8c0 1 < completed multipart upload key=ES62XJO5Q3FO upload=TCRT3DF8DCR2 tag=OFDN4M6L0XCK type=write size=1309063 2024-09-19T13:47:30.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.337+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~LIQ010G96UJG.0 size=1048576 2024-09-19T13:47:30.343 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.341+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~LIQ010G96UJG.1 size=1048576 2024-09-19T13:47:30.345 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.341+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~LIQ010G96UJG.2 size=760060 2024-09-19T13:47:30.345 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.341+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=LIQ010G96UJG tag=L70DRTFKV5BQ type=write size=3905788 2024-09-19T13:47:30.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.345+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~D7J9657G816J.0 size=400998 2024-09-19T13:47:30.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.349+0000 7fcf3240c8c0 1 < completed multipart upload key=DHPONKOVS8CT upload=D7J9657G816J tag=WM1UXHOKOSPJ type=write size=1449574 2024-09-19T13:47:30.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.353+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~2BXMG6FR3HFM.0 size=1048576 2024-09-19T13:47:30.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.353+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~2BXMG6FR3HFM.1 size=1048576 2024-09-19T13:47:30.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.357+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~2BXMG6FR3HFM.2 size=104124 2024-09-19T13:47:30.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.357+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=2BXMG6FR3HFM tag=BMEXDED5LLUS type=write size=3249852 2024-09-19T13:47:30.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.357+0000 7fcf3240c8c0 1 < canceled operation key=X9FGPMP30X47 tag=DLO5F0UY9KVI type=del size=668941 2024-09-19T13:47:30.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.361+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~C6K435TTAAJQ.0 size=1048576 2024-09-19T13:47:30.367 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.365+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~C6K435TTAAJQ.1 size=1048576 2024-09-19T13:47:30.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.365+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~C6K435TTAAJQ.2 size=530579 2024-09-19T13:47:30.370 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.365+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=C6K435TTAAJQ tag=AKK6GOB1D0E4 type=write size=3676307 2024-09-19T13:47:30.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.369+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=FAPDLLRJQ7GS type=del 2024-09-19T13:47:30.376 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.373+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~P2QUJT1EN9LG.0 size=1048576 2024-09-19T13:47:30.377 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.373+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~P2QUJT1EN9LG.1 size=877264 2024-09-19T13:47:30.378 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.373+0000 7fcf3240c8c0 1 > prepared multipart upload key=DHPONKOVS8CT upload=P2QUJT1EN9LG tag=1J7MDU3MM6K7 type=write size=2974416 2024-09-19T13:47:30.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.377+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~YVQHPHLTY9B3.0 size=1003834 2024-09-19T13:47:30.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.381+0000 7fcf3240c8c0 1 < completed multipart upload key=C3TFYNXH549T upload=YVQHPHLTY9B3 tag=6BUFJ0QBY2OF type=write size=2052410 2024-09-19T13:47:30.385 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.381+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=X2UZYGTC34ZL type=del size=4142178 2024-09-19T13:47:30.388 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.385+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~GLQ49DPUBGGQ.0 size=825956 2024-09-19T13:47:30.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.389+0000 7fcf3240c8c0 1 < completed multipart upload key=71Z2VTW99W7J upload=GLQ49DPUBGGQ tag=77LGS6DXTXYN type=write size=1874532 2024-09-19T13:47:30.393 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.389+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=4V14RXDNPYS4 type=del size=600727 2024-09-19T13:47:30.395 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.393+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~OM2V393YTW74.0 size=168050 2024-09-19T13:47:30.399 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.397+0000 7fcf3240c8c0 1 < completed multipart upload key=M2CO4A2DHJ05 upload=OM2V393YTW74 tag=N1QMTWXXYSKD type=write size=1216626 2024-09-19T13:47:30.401 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.397+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=GTY9MW2XG3QQ type=write size=320708 2024-09-19T13:47:30.404 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.401+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~I3LSJEP3YP8A.0 size=1048576 2024-09-19T13:47:30.405 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.401+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~I3LSJEP3YP8A.1 size=1048576 2024-09-19T13:47:30.407 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.405+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~I3LSJEP3YP8A.2 size=1017927 2024-09-19T13:47:30.411 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.409+0000 7fcf3240c8c0 1 < completed multipart upload key=0UCFTOF1YBBM upload=I3LSJEP3YP8A tag=SI1Y9LYD9JCN type=write size=4163655 2024-09-19T13:47:30.413 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.409+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=6IHR0S2LQFNV type=del size=447535 2024-09-19T13:47:30.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.413+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~R48ZCH1RAARP.0 size=1048576 2024-09-19T13:47:30.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.413+0000 7fcf3240c8c0 1 < canceled part key=_multipart_M2CO4A2DHJ05.2~R48ZCH1RAARP.1 size=1048576 2024-09-19T13:47:30.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.413+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~R48ZCH1RAARP.2 size=879096 2024-09-19T13:47:30.424 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.417+0000 7fcf3240c8c0 1 < canceled multipart upload key=M2CO4A2DHJ05 upload=R48ZCH1RAARP tag=ADQW6KIBXLDE type=write size=4024824 2024-09-19T13:47:30.424 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.421+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=374G9XJI57FV type=del size=324212 2024-09-19T13:47:30.427 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.425+0000 7fcf3240c8c0 1 < completed delete operation key=C8T6DB9V9FBT tag=AFMNBGVR1F9U type=del 2024-09-19T13:47:30.431 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.429+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~U3LG0L86ZBVJ.0 size=1048576 2024-09-19T13:47:30.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.429+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~U3LG0L86ZBVJ.1 size=1048576 2024-09-19T13:47:30.435 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.433+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~U3LG0L86ZBVJ.2 size=272388 2024-09-19T13:47:30.435 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.433+0000 7fcf3240c8c0 1 > prepared multipart upload key=C3TFYNXH549T upload=U3LG0L86ZBVJ tag=VVU7FORQ2VYW type=write size=3418116 2024-09-19T13:47:30.437 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.433+0000 7fcf3240c8c0 1 < completed write operation key=DHPONKOVS8CT tag=CVPILR0PMMKV type=write size=496905 2024-09-19T13:47:30.440 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.437+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=FJA6QM107SET type=write size=318504 2024-09-19T13:47:30.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.441+0000 7fcf3240c8c0 1 < completed delete operation key=C35EUAOWLBR3 tag=H02S6W26J2IF type=del 2024-09-19T13:47:30.447 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.445+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~WN3JJHUW3DQL.0 size=1048576 2024-09-19T13:47:30.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.445+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~WN3JJHUW3DQL.1 size=286540 2024-09-19T13:47:30.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.445+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=WN3JJHUW3DQL tag=A38E2QLXCAX5 type=write size=2383692 2024-09-19T13:47:30.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.445+0000 7fcf3240c8c0 1 < canceled part key=_multipart_C3TFYNXH549T.2~BFU3J7L8D6DS.0 size=1048576 2024-09-19T13:47:30.450 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.449+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~BFU3J7L8D6DS.1 size=925255 2024-09-19T13:47:30.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.453+0000 7fcf3240c8c0 1 < canceled multipart upload key=C3TFYNXH549T upload=BFU3J7L8D6DS tag=QB2GPIP7WYS7 type=write size=3022407 2024-09-19T13:47:30.458 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.457+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~8B1314ZDYRJY.0 size=1048576 2024-09-19T13:47:30.461 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.457+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~8B1314ZDYRJY.1 size=860551 2024-09-19T13:47:30.461 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.457+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=8B1314ZDYRJY tag=I7B21FND1QNZ type=write size=2957703 2024-09-19T13:47:30.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.461+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~8ZKBNXYAVBIZ.0 size=1048576 2024-09-19T13:47:30.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.461+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~8ZKBNXYAVBIZ.1 size=1048576 2024-09-19T13:47:30.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.465+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~8ZKBNXYAVBIZ.2 size=927586 2024-09-19T13:47:30.471 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.469+0000 7fcf3240c8c0 1 < completed multipart upload key=D20C6C2ZFX1W upload=8ZKBNXYAVBIZ tag=JAI4CM0H7HO7 type=write size=4073314 2024-09-19T13:47:30.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.473+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~JOJ6G06O0XSO.0 size=1048576 2024-09-19T13:47:30.477 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.473+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~JOJ6G06O0XSO.1 size=214806 2024-09-19T13:47:30.478 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.473+0000 7fcf3240c8c0 1 > prepared multipart upload key=71Z2VTW99W7J upload=JOJ6G06O0XSO tag=T6QZHF373W07 type=write size=2311958 2024-09-19T13:47:30.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.481+0000 7fcf3240c8c0 1 < suggested update operation key=AES54TJK7VH7 tag=UZ87S01LB2HY type=del size=298316 2024-09-19T13:47:30.485 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.481+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=6JDBN8STEDV4 type=del size=2417449 2024-09-19T13:47:30.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.485+0000 7fcf3240c8c0 1 < canceled operation key=OA9BMSXGYR9T tag=9UCZBZ7RSORI type=write size=833677 2024-09-19T13:47:30.490 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.485+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=1T9CIRCX28I4 type=write size=282531 2024-09-19T13:47:30.493 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.489+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~LIQ010G96UJG.0 size=1048576 2024-09-19T13:47:30.495 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.493+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~LIQ010G96UJG.1 size=1048576 2024-09-19T13:47:30.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.493+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~LIQ010G96UJG.2 size=760060 2024-09-19T13:47:30.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.497+0000 7fcf3240c8c0 1 < completed multipart upload key=D20C6C2ZFX1W upload=LIQ010G96UJG tag=L70DRTFKV5BQ type=write size=3905788 2024-09-19T13:47:30.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.501+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=ZZLVHJ6OEP8D type=del size=4052297 2024-09-19T13:47:30.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.501+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~2BXMG6FR3HFM.0 size=1048576 2024-09-19T13:47:30.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.505+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~2BXMG6FR3HFM.1 size=1048576 2024-09-19T13:47:30.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.505+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~2BXMG6FR3HFM.2 size=104124 2024-09-19T13:47:30.513 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.509+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=2BXMG6FR3HFM tag=BMEXDED5LLUS type=write size=3249852 2024-09-19T13:47:30.516 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.513+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=9ESYB8MO2HL3 type=del size=2391085 2024-09-19T13:47:30.518 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.517+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~C6K435TTAAJQ.0 size=1048576 2024-09-19T13:47:30.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.517+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~C6K435TTAAJQ.1 size=1048576 2024-09-19T13:47:30.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.521+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~C6K435TTAAJQ.2 size=530579 2024-09-19T13:47:30.527 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.525+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=C6K435TTAAJQ tag=AKK6GOB1D0E4 type=write size=3676307 2024-09-19T13:47:30.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.525+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=BDAO9XL2LSE6 type=del size=2973073 2024-09-19T13:47:30.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.529+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~P2QUJT1EN9LG.0 size=1048576 2024-09-19T13:47:30.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.529+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~P2QUJT1EN9LG.1 size=877264 2024-09-19T13:47:30.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.533+0000 7fcf3240c8c0 1 < completed multipart upload key=DHPONKOVS8CT upload=P2QUJT1EN9LG tag=1J7MDU3MM6K7 type=write size=2974416 2024-09-19T13:47:30.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.537+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=955IQLR5OPUN type=del size=3306303 2024-09-19T13:47:30.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.537+0000 7fcf3240c8c0 1 < completed delete operation key=C35EUAOWLBR3 tag=X2UZYGTC34ZL type=del 2024-09-19T13:47:30.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.541+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=W82VK3TZC5HV type=del size=3291406 2024-09-19T13:47:30.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.545+0000 7fcf3240c8c0 1 < suggested remove operation key=7UC85R2HO9K2 tag=4V14RXDNPYS4 type=del 2024-09-19T13:47:30.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.549+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~EUSMTAX408KA.0 size=1048576 2024-09-19T13:47:30.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.549+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~EUSMTAX408KA.1 size=1048576 2024-09-19T13:47:30.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.553+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~EUSMTAX408KA.2 size=173644 2024-09-19T13:47:30.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.553+0000 7fcf3240c8c0 1 > prepared multipart upload key=V8X0VBBNK83J upload=EUSMTAX408KA tag=360D1TYC3FKV type=write size=3319372 2024-09-19T13:47:30.557 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.553+0000 7fcf3240c8c0 1 < canceled operation key=QSM2Q8CW1Q86 tag=GTY9MW2XG3QQ type=write size=320708 2024-09-19T13:47:30.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.557+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~ZJYA3JJKUX68.0 size=1048576 2024-09-19T13:47:30.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.561+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~ZJYA3JJKUX68.1 size=1048576 2024-09-19T13:47:30.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.565+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~ZJYA3JJKUX68.2 size=318138 2024-09-19T13:47:30.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.565+0000 7fcf3240c8c0 1 > prepared multipart upload key=X16ENUFL40RN upload=ZJYA3JJKUX68 tag=OMXKC34GPCXM type=write size=3463866 2024-09-19T13:47:30.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.565+0000 7fcf3240c8c0 1 < completed delete operation key=ZCKKQ1R8318S tag=6IHR0S2LQFNV type=del 2024-09-19T13:47:30.573 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.569+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~4L7M2VSU4P8O.0 size=1048576 2024-09-19T13:47:30.575 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.573+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~4L7M2VSU4P8O.1 size=1048576 2024-09-19T13:47:30.577 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.573+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~4L7M2VSU4P8O.2 size=699518 2024-09-19T13:47:30.577 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.573+0000 7fcf3240c8c0 1 > prepared multipart upload key=DHPONKOVS8CT upload=4L7M2VSU4P8O tag=T2QALGCV62MO type=write size=3845246 2024-09-19T13:47:30.581 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.577+0000 7fcf3240c8c0 1 < suggested update operation key=OA9BMSXGYR9T tag=374G9XJI57FV type=del size=324212 2024-09-19T13:47:30.584 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.581+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=GIGHN8Y3LS6O type=write size=518824 2024-09-19T13:47:30.586 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.581+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~U3LG0L86ZBVJ.0 size=1048576 2024-09-19T13:47:30.588 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.585+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~U3LG0L86ZBVJ.1 size=1048576 2024-09-19T13:47:30.590 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.585+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~U3LG0L86ZBVJ.2 size=272388 2024-09-19T13:47:30.594 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.593+0000 7fcf3240c8c0 1 < completed multipart upload key=C3TFYNXH549T upload=U3LG0L86ZBVJ tag=VVU7FORQ2VYW type=write size=3418116 2024-09-19T13:47:30.599 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.597+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~AWQ77AVYFRWA.0 size=1048576 2024-09-19T13:47:30.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.597+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~AWQ77AVYFRWA.1 size=705729 2024-09-19T13:47:30.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.597+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=AWQ77AVYFRWA tag=ONRVH3PJTWUA type=write size=2802881 2024-09-19T13:47:30.603 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.601+0000 7fcf3240c8c0 1 < completed write operation key=X16ENUFL40RN tag=FJA6QM107SET type=write size=318504 2024-09-19T13:47:30.608 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.605+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~QPC341KO87NU.0 size=1048576 2024-09-19T13:47:30.610 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.609+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~QPC341KO87NU.1 size=1048576 2024-09-19T13:47:30.612 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.609+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~QPC341KO87NU.2 size=290902 2024-09-19T13:47:30.612 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.609+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=QPC341KO87NU tag=67HFRK802ERE type=write size=3436630 2024-09-19T13:47:30.613 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.609+0000 7fcf3240c8c0 1 < canceled part key=_multipart_XE42LV5M5X82.2~WN3JJHUW3DQL.0 size=1048576 2024-09-19T13:47:30.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.613+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~WN3JJHUW3DQL.1 size=286540 2024-09-19T13:47:30.618 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.617+0000 7fcf3240c8c0 1 < canceled multipart upload key=XE42LV5M5X82 upload=WN3JJHUW3DQL tag=A38E2QLXCAX5 type=write size=2383692 2024-09-19T13:47:30.621 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.617+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=JUM1Q4GBRNHS type=del size=3427552 2024-09-19T13:47:30.623 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.621+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~8B1314ZDYRJY.0 size=1048576 2024-09-19T13:47:30.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.621+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~8B1314ZDYRJY.1 size=860551 2024-09-19T13:47:30.629 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.625+0000 7fcf3240c8c0 1 < completed multipart upload key=ZCKKQ1R8318S upload=8B1314ZDYRJY tag=I7B21FND1QNZ type=write size=2957703 2024-09-19T13:47:30.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.629+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=MRNRCRR2G847 type=del size=675692 2024-09-19T13:47:30.634 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.629+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~JOJ6G06O0XSO.0 size=1048576 2024-09-19T13:47:30.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.633+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~JOJ6G06O0XSO.1 size=214806 2024-09-19T13:47:30.640 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.637+0000 7fcf3240c8c0 1 < completed multipart upload key=71Z2VTW99W7J upload=JOJ6G06O0XSO tag=T6QZHF373W07 type=write size=2311958 2024-09-19T13:47:30.644 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.641+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~XCCI6SETNFLT.0 size=1048576 2024-09-19T13:47:30.646 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.641+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~XCCI6SETNFLT.1 size=1048576 2024-09-19T13:47:30.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.645+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~XCCI6SETNFLT.2 size=78575 2024-09-19T13:47:30.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.645+0000 7fcf3240c8c0 1 > prepared multipart upload key=X16ENUFL40RN upload=XCCI6SETNFLT tag=CZPD80X6H3NP type=write size=3224303 2024-09-19T13:47:30.651 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.649+0000 7fcf3240c8c0 -1 < failed to complete operation key=OA9BMSXGYR9T tag=6JDBN8STEDV4 type=del size=2417449: (22) Invalid argument 2024-09-19T13:47:30.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.649+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=F3NT8CLNNZEE type=del size=3231750 2024-09-19T13:47:30.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.653+0000 7fcf3240c8c0 1 < completed write operation key=0UCFTOF1YBBM tag=1T9CIRCX28I4 type=write size=282531 2024-09-19T13:47:30.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.657+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=ZY3HFZWHSFGL type=del size=1751887 2024-09-19T13:47:30.664 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.661+0000 7fcf3240c8c0 1 < suggested remove operation key=0UCFTOF1YBBM tag=ZZLVHJ6OEP8D type=del 2024-09-19T13:47:30.667 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.665+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=6ISRNVSEKPV1 type=write size=46406 2024-09-19T13:47:30.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.665+0000 7fcf3240c8c0 -1 < failed to complete operation key=0UCFTOF1YBBM tag=9ESYB8MO2HL3 type=del size=2391085: (22) Invalid argument 2024-09-19T13:47:30.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.669+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=B1KTDN42FTRO type=del size=818428 2024-09-19T13:47:30.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.673+0000 7fcf3240c8c0 1 < suggested update operation key=ES62XJO5Q3FO tag=BDAO9XL2LSE6 type=del size=2973073 2024-09-19T13:47:30.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.677+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=T8Y0S1CI6KB2 type=del size=2949118 2024-09-19T13:47:30.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.681+0000 7fcf3240c8c0 -1 < failed to complete operation key=7UC85R2HO9K2 tag=955IQLR5OPUN type=del size=3306303: (22) Invalid argument 2024-09-19T13:47:30.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.685+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~XJ1P2TY13FDG.0 size=660188 2024-09-19T13:47:30.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.685+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=XJ1P2TY13FDG tag=BQPYK88R0Y7B type=write size=1708764 2024-09-19T13:47:30.691 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.689+0000 7fcf3240c8c0 1 < completed delete operation key=3TME221SA53E tag=W82VK3TZC5HV type=del 2024-09-19T13:47:30.696 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.693+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~OYXE5GYVBDHV.0 size=559522 2024-09-19T13:47:30.696 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.693+0000 7fcf3240c8c0 1 > prepared multipart upload key=V8X0VBBNK83J upload=OYXE5GYVBDHV tag=1TWES6L4MSI9 type=write size=1608098 2024-09-19T13:47:30.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.697+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~EUSMTAX408KA.0 size=1048576 2024-09-19T13:47:30.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.697+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~EUSMTAX408KA.1 size=1048576 2024-09-19T13:47:30.704 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.701+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~EUSMTAX408KA.2 size=173644 2024-09-19T13:47:30.709 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.705+0000 7fcf3240c8c0 1 < completed multipart upload key=V8X0VBBNK83J upload=EUSMTAX408KA tag=360D1TYC3FKV type=write size=3319372 2024-09-19T13:47:30.711 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.709+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=YII2QH3FFAVW type=del size=3300406 2024-09-19T13:47:30.714 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.713+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~ZJYA3JJKUX68.0 size=1048576 2024-09-19T13:47:30.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.713+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~ZJYA3JJKUX68.1 size=1048576 2024-09-19T13:47:30.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.717+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~ZJYA3JJKUX68.2 size=318138 2024-09-19T13:47:30.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.721+0000 7fcf3240c8c0 1 < completed multipart upload key=X16ENUFL40RN upload=ZJYA3JJKUX68 tag=OMXKC34GPCXM type=write size=3463866 2024-09-19T13:47:30.725 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.721+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=2WUP2SME2SUJ type=del size=2929911 2024-09-19T13:47:30.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.725+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~4L7M2VSU4P8O.0 size=1048576 2024-09-19T13:47:30.730 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.725+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~4L7M2VSU4P8O.1 size=1048576 2024-09-19T13:47:30.732 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.729+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~4L7M2VSU4P8O.2 size=699518 2024-09-19T13:47:30.736 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.733+0000 7fcf3240c8c0 1 < completed multipart upload key=DHPONKOVS8CT upload=4L7M2VSU4P8O tag=T2QALGCV62MO type=write size=3845246 2024-09-19T13:47:30.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.737+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=RXAZD82PZNTV type=del size=3076272 2024-09-19T13:47:30.741 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.737+0000 7fcf3240c8c0 1 < completed write operation key=3TME221SA53E tag=GIGHN8Y3LS6O type=write size=518824 2024-09-19T13:47:30.746 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.741+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~10K1IN18DHUB.0 size=759694 2024-09-19T13:47:30.746 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.741+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=10K1IN18DHUB tag=93CXOFP7ASGF type=write size=1808270 2024-09-19T13:47:30.749 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.745+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~AWQ77AVYFRWA.0 size=1048576 2024-09-19T13:47:30.749 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.745+0000 7fcf3240c8c0 1 < canceled part key=_multipart_C35EUAOWLBR3.2~AWQ77AVYFRWA.1 size=705729 2024-09-19T13:47:30.753 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.749+0000 7fcf3240c8c0 1 < canceled multipart upload key=C35EUAOWLBR3 upload=AWQ77AVYFRWA tag=ONRVH3PJTWUA type=write size=2802881 2024-09-19T13:47:30.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.757+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~LKA8E48LC4HT.0 size=1048576 2024-09-19T13:47:30.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.757+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~LKA8E48LC4HT.1 size=305678 2024-09-19T13:47:30.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.757+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=LKA8E48LC4HT tag=75LLO3HDAI9K type=write size=2402830 2024-09-19T13:47:30.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.761+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~QPC341KO87NU.0 size=1048576 2024-09-19T13:47:30.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.761+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~QPC341KO87NU.1 size=1048576 2024-09-19T13:47:30.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.765+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~QPC341KO87NU.2 size=290902 2024-09-19T13:47:30.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.769+0000 7fcf3240c8c0 1 < completed multipart upload key=ES62XJO5Q3FO upload=QPC341KO87NU tag=67HFRK802ERE type=write size=3436630 2024-09-19T13:47:30.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.769+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=133MCDDGQCOR type=write size=330780 2024-09-19T13:47:30.776 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.773+0000 7fcf3240c8c0 1 < completed delete operation key=M2CO4A2DHJ05 tag=JUM1Q4GBRNHS type=del 2024-09-19T13:47:30.780 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.777+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~QZV5N4W7W8MD.0 size=1048576 2024-09-19T13:47:30.782 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.777+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~QZV5N4W7W8MD.1 size=953522 2024-09-19T13:47:30.782 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.777+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=QZV5N4W7W8MD tag=P4LTMMKC0ZVU type=write size=3050674 2024-09-19T13:47:30.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.781+0000 7fcf3240c8c0 1 < completed delete operation key=X16ENUFL40RN tag=MRNRCRR2G847 type=del 2024-09-19T13:47:30.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.785+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=JJSCE3ROTJN3 type=del size=2384504 2024-09-19T13:47:30.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.785+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~XCCI6SETNFLT.0 size=1048576 2024-09-19T13:47:30.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.789+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~XCCI6SETNFLT.1 size=1048576 2024-09-19T13:47:30.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.789+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~XCCI6SETNFLT.2 size=78575 2024-09-19T13:47:30.800 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.797+0000 7fcf3240c8c0 1 < completed multipart upload key=X16ENUFL40RN upload=XCCI6SETNFLT tag=CZPD80X6H3NP type=write size=3224303 2024-09-19T13:47:30.803 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.801+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=ROFZM7DZCCAM type=del size=1655681 2024-09-19T13:47:30.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.801+0000 7fcf3240c8c0 1 < completed delete operation key=A02RDP6BA9AC tag=F3NT8CLNNZEE type=del 2024-09-19T13:47:30.807 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.805+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=3XXA8R4VU1P3 type=del size=2159564 2024-09-19T13:47:30.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.805+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=ZY3HFZWHSFGL type=del 2024-09-19T13:47:30.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.809+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=M5OFWNY0IVOA type=del size=3444721 2024-09-19T13:47:30.815 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.813+0000 7fcf3240c8c0 1 < completed write operation key=7UC85R2HO9K2 tag=6ISRNVSEKPV1 type=write size=46406 2024-09-19T13:47:30.819 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.817+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~8PA0XPRDGX83.0 size=1048576 2024-09-19T13:47:30.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.817+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~8PA0XPRDGX83.1 size=607166 2024-09-19T13:47:30.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.817+0000 7fcf3240c8c0 1 > prepared multipart upload key=6DFF2OCPT9W2 upload=8PA0XPRDGX83 tag=VS2USYS3I8BX type=write size=2704318 2024-09-19T13:47:30.824 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.821+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=B1KTDN42FTRO type=del 2024-09-19T13:47:30.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.821+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=JT7KXOG9VMVB type=write size=581261 2024-09-19T13:47:30.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.825+0000 7fcf3240c8c0 1 < completed delete operation key=C3TFYNXH549T tag=T8Y0S1CI6KB2 type=del 2024-09-19T13:47:30.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.829+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=1X6SF2T1JF83 type=del size=1562776 2024-09-19T13:47:30.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.829+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~XJ1P2TY13FDG.0 size=660188 2024-09-19T13:47:30.838 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.833+0000 7fcf3240c8c0 1 < completed multipart upload key=ZCKKQ1R8318S upload=XJ1P2TY13FDG tag=BQPYK88R0Y7B type=write size=1708764 2024-09-19T13:47:30.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.837+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=Q55N9AH5DBJE type=write size=125056 2024-09-19T13:47:30.843 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.841+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~OYXE5GYVBDHV.0 size=559522 2024-09-19T13:47:30.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.845+0000 7fcf3240c8c0 1 < completed multipart upload key=V8X0VBBNK83J upload=OYXE5GYVBDHV tag=1TWES6L4MSI9 type=write size=1608098 2024-09-19T13:47:30.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.845+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=9F39RVXGKNDQ type=del size=3597480 2024-09-19T13:47:30.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.849+0000 7fcf3240c8c0 1 < completed delete operation key=HXMZKP7H3HJE tag=YII2QH3FFAVW type=del 2024-09-19T13:47:30.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.857+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~QXQ2KAK4NPN4.0 size=726720 2024-09-19T13:47:30.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.857+0000 7fcf3240c8c0 1 > prepared multipart upload key=3TME221SA53E upload=QXQ2KAK4NPN4 tag=1SDRECA5BHXP type=write size=1775296 2024-09-19T13:47:30.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.857+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=2WUP2SME2SUJ type=del 2024-09-19T13:47:30.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.861+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=CZUAYS1ONZKM type=write size=862233 2024-09-19T13:47:30.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.865+0000 7fcf3240c8c0 1 < completed delete operation key=DHPONKOVS8CT tag=RXAZD82PZNTV type=del 2024-09-19T13:47:30.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.869+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=VFLN50GN0077 type=del size=884668 2024-09-19T13:47:30.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.869+0000 7fcf3240c8c0 1 < canceled part key=_multipart_ES62XJO5Q3FO.2~10K1IN18DHUB.0 size=759694 2024-09-19T13:47:30.877 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.873+0000 7fcf3240c8c0 1 < canceled multipart upload key=ES62XJO5Q3FO upload=10K1IN18DHUB tag=93CXOFP7ASGF type=write size=1808270 2024-09-19T13:47:30.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.877+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~2478T3JJ7667.0 size=378129 2024-09-19T13:47:30.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.877+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=2478T3JJ7667 tag=1KPLKTNJX6TK type=write size=1426705 2024-09-19T13:47:30.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.881+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~LKA8E48LC4HT.0 size=1048576 2024-09-19T13:47:30.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.885+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~LKA8E48LC4HT.1 size=305678 2024-09-19T13:47:30.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.889+0000 7fcf3240c8c0 1 < completed multipart upload key=NP2L28YRVQ8L upload=LKA8E48LC4HT tag=75LLO3HDAI9K type=write size=2402830 2024-09-19T13:47:30.894 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.889+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=8OMI08FEWY8E type=del size=1795031 2024-09-19T13:47:30.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.893+0000 7fcf3240c8c0 1 < completed write operation key=AES54TJK7VH7 tag=133MCDDGQCOR type=write size=330780 2024-09-19T13:47:30.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.897+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~7RNGFND8SOFB.0 size=1048576 2024-09-19T13:47:30.903 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.901+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~7RNGFND8SOFB.1 size=409540 2024-09-19T13:47:30.903 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.901+0000 7fcf3240c8c0 1 > prepared multipart upload key=OA9BMSXGYR9T upload=7RNGFND8SOFB tag=S5P400ZIFABE type=write size=2506692 2024-09-19T13:47:30.905 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.901+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~QZV5N4W7W8MD.0 size=1048576 2024-09-19T13:47:30.907 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.905+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~QZV5N4W7W8MD.1 size=953522 2024-09-19T13:47:30.911 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.909+0000 7fcf3240c8c0 1 < completed multipart upload key=XE42LV5M5X82 upload=QZV5N4W7W8MD tag=P4LTMMKC0ZVU type=write size=3050674 2024-09-19T13:47:30.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.913+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~WIILKKQRGO8V.0 size=617060 2024-09-19T13:47:30.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.913+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=WIILKKQRGO8V tag=D9Y5BST1RW0M type=write size=1665636 2024-09-19T13:47:30.918 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.913+0000 7fcf3240c8c0 1 < completed delete operation key=0U9BUX9DHTAK tag=JJSCE3ROTJN3 type=del 2024-09-19T13:47:30.920 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.917+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=HA54G2GQOY4U type=del size=3186538 2024-09-19T13:47:30.923 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.921+0000 7fcf3240c8c0 1 < completed delete operation key=QSM2Q8CW1Q86 tag=ROFZM7DZCCAM type=del 2024-09-19T13:47:30.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.925+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~NFO6DB03MW6F.0 size=1048576 2024-09-19T13:47:30.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.925+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~NFO6DB03MW6F.1 size=1048576 2024-09-19T13:47:30.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.929+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~NFO6DB03MW6F.2 size=223247 2024-09-19T13:47:30.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.929+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=NFO6DB03MW6F tag=K16H12LCVRIK type=write size=3368975 2024-09-19T13:47:30.934 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.929+0000 7fcf3240c8c0 1 < completed delete operation key=0U9BUX9DHTAK tag=3XXA8R4VU1P3 type=del 2024-09-19T13:47:30.937 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.933+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=5D1B6EHBHMF5 type=write size=876502 2024-09-19T13:47:30.939 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.937+0000 7fcf3240c8c0 1 < completed delete operation key=X16ENUFL40RN tag=M5OFWNY0IVOA type=del 2024-09-19T13:47:30.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.941+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~QIUIYJLMLMBN.0 size=1048576 2024-09-19T13:47:30.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.941+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~QIUIYJLMLMBN.1 size=467845 2024-09-19T13:47:30.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.941+0000 7fcf3240c8c0 1 > prepared multipart upload key=C8T6DB9V9FBT upload=QIUIYJLMLMBN tag=DY89U2FVIKL4 type=write size=2564997 2024-09-19T13:47:30.948 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.945+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~8PA0XPRDGX83.0 size=1048576 2024-09-19T13:47:30.950 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.949+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~8PA0XPRDGX83.1 size=607166 2024-09-19T13:47:30.955 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.953+0000 7fcf3240c8c0 1 < completed multipart upload key=6DFF2OCPT9W2 upload=8PA0XPRDGX83 tag=VS2USYS3I8BX type=write size=2704318 2024-09-19T13:47:30.957 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.953+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=LPXIPVNYW8FA type=del size=2965130 2024-09-19T13:47:30.959 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.957+0000 7fcf3240c8c0 1 < completed write operation key=6DFF2OCPT9W2 tag=JT7KXOG9VMVB type=write size=581261 2024-09-19T13:47:30.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.961+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~L832TYHCU40L.0 size=1048576 2024-09-19T13:47:30.966 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.961+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~L832TYHCU40L.1 size=295135 2024-09-19T13:47:30.966 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.961+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=L832TYHCU40L tag=YF3V2JLYNWQY type=write size=2392287 2024-09-19T13:47:30.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.965+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=1X6SF2T1JF83 type=del 2024-09-19T13:47:30.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.969+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=IXFFKE18UPNQ type=del size=1337592 2024-09-19T13:47:30.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.969+0000 7fcf3240c8c0 1 < completed write operation key=X9FGPMP30X47 tag=Q55N9AH5DBJE type=write size=125056 2024-09-19T13:47:30.975 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.973+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=09BS3KH21IL5 type=write size=315282 2024-09-19T13:47:30.977 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.973+0000 7fcf3240c8c0 1 < completed delete operation key=BXUPV5XSJBTH tag=9F39RVXGKNDQ type=del 2024-09-19T13:47:30.981 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.977+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~TBQXDXX9JO8O.0 size=587189 2024-09-19T13:47:30.981 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.977+0000 7fcf3240c8c0 1 > prepared multipart upload key=V8X0VBBNK83J upload=TBQXDXX9JO8O tag=Q3YPOF63F0LE type=write size=1635765 2024-09-19T13:47:30.984 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.981+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~QXQ2KAK4NPN4.0 size=726720 2024-09-19T13:47:30.988 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.985+0000 7fcf3240c8c0 1 < completed multipart upload key=3TME221SA53E upload=QXQ2KAK4NPN4 tag=1SDRECA5BHXP type=write size=1775296 2024-09-19T13:47:30.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.985+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=MN3CQ17KJTQB type=del size=2027717 2024-09-19T13:47:30.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.989+0000 7fcf3240c8c0 1 < completed write operation key=HXMZKP7H3HJE tag=CZUAYS1ONZKM type=write size=862233 2024-09-19T13:47:30.995 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.993+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=3BD3IHWSLSN0 type=del size=1412917 2024-09-19T13:47:30.998 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:30.993+0000 7fcf3240c8c0 1 < completed delete operation key=C35EUAOWLBR3 tag=VFLN50GN0077 type=del 2024-09-19T13:47:31.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.001+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~8RNHR6I7V018.0 size=1048576 2024-09-19T13:47:31.005 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.001+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~8RNHR6I7V018.1 size=1048576 2024-09-19T13:47:31.007 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.005+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~8RNHR6I7V018.2 size=777760 2024-09-19T13:47:31.007 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.005+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=8RNHR6I7V018 tag=29TLO6ZRH8ML type=write size=3923488 2024-09-19T13:47:31.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.009+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~2478T3JJ7667.0 size=378129 2024-09-19T13:47:31.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.013+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=2478T3JJ7667 tag=1KPLKTNJX6TK type=write size=1426705 2024-09-19T13:47:31.017 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.013+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=F3UZVQ4B35FE type=del size=3716525 2024-09-19T13:47:31.020 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.017+0000 7fcf3240c8c0 1 < completed delete operation key=D1RMXGXS3O7Z tag=8OMI08FEWY8E type=del 2024-09-19T13:47:31.025 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.021+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~F6MZ2RNADHGS.0 size=1048576 2024-09-19T13:47:31.027 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.025+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~F6MZ2RNADHGS.1 size=1048576 2024-09-19T13:47:31.029 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.025+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~F6MZ2RNADHGS.2 size=227871 2024-09-19T13:47:31.029 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.025+0000 7fcf3240c8c0 1 > prepared multipart upload key=V8X0VBBNK83J upload=F6MZ2RNADHGS tag=F2KDBF2D20VO type=write size=3373599 2024-09-19T13:47:31.031 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.029+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~7RNGFND8SOFB.0 size=1048576 2024-09-19T13:47:31.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.029+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~7RNGFND8SOFB.1 size=409540 2024-09-19T13:47:31.039 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.037+0000 7fcf3240c8c0 1 < completed multipart upload key=OA9BMSXGYR9T upload=7RNGFND8SOFB tag=S5P400ZIFABE type=write size=2506692 2024-09-19T13:47:31.042 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.037+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=C749NVL4JQPB type=del size=634590 2024-09-19T13:47:31.044 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.041+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~WIILKKQRGO8V.0 size=617060 2024-09-19T13:47:31.048 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.045+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=WIILKKQRGO8V tag=D9Y5BST1RW0M type=write size=1665636 2024-09-19T13:47:31.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.049+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~ITB7I4Q5BK77.0 size=898809 2024-09-19T13:47:31.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.049+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=ITB7I4Q5BK77 tag=FJY3P3WAAND4 type=write size=1947385 2024-09-19T13:47:31.058 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.057+0000 7fcf3240c8c0 1 < suggested update operation key=N51Q6HKJSCCB tag=HA54G2GQOY4U type=del size=3186538 2024-09-19T13:47:31.063 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.061+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~XRCN3D5G5OTY.0 size=1048576 2024-09-19T13:47:31.065 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.061+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~XRCN3D5G5OTY.1 size=1048576 2024-09-19T13:47:31.068 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.065+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~XRCN3D5G5OTY.2 size=521939 2024-09-19T13:47:31.068 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.065+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=XRCN3D5G5OTY tag=RG7C2R1L4DCO type=write size=3667667 2024-09-19T13:47:31.068 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.065+0000 7fcf3240c8c0 1 < canceled part key=_multipart_ES62XJO5Q3FO.2~NFO6DB03MW6F.0 size=1048576 2024-09-19T13:47:31.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.069+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~NFO6DB03MW6F.1 size=1048576 2024-09-19T13:47:31.073 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.069+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~NFO6DB03MW6F.2 size=223247 2024-09-19T13:47:31.077 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.073+0000 7fcf3240c8c0 1 < canceled multipart upload key=ES62XJO5Q3FO upload=NFO6DB03MW6F tag=K16H12LCVRIK type=write size=3368975 2024-09-19T13:47:31.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.077+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=QI2PBMMJBRTE type=del size=2791184 2024-09-19T13:47:31.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.081+0000 7fcf3240c8c0 1 < completed write operation key=D1RMXGXS3O7Z tag=5D1B6EHBHMF5 type=write size=876502 2024-09-19T13:47:31.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.081+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=142PDRRZ9X9J type=del size=3320428 2024-09-19T13:47:31.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.085+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~QIUIYJLMLMBN.0 size=1048576 2024-09-19T13:47:31.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.089+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~QIUIYJLMLMBN.1 size=467845 2024-09-19T13:47:31.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.093+0000 7fcf3240c8c0 1 < completed multipart upload key=C8T6DB9V9FBT upload=QIUIYJLMLMBN tag=DY89U2FVIKL4 type=write size=2564997 2024-09-19T13:47:31.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.093+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=PILXRJF01066 type=del size=1315012 2024-09-19T13:47:31.101 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.097+0000 7fcf3240c8c0 1 < canceled operation key=X9FGPMP30X47 tag=LPXIPVNYW8FA type=del size=2965130 2024-09-19T13:47:31.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.101+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=VK7BQUYD5BEF type=del size=1019713 2024-09-19T13:47:31.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.105+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~L832TYHCU40L.0 size=1048576 2024-09-19T13:47:31.109 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.105+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~L832TYHCU40L.1 size=295135 2024-09-19T13:47:31.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.109+0000 7fcf3240c8c0 1 < completed multipart upload key=XE42LV5M5X82 upload=L832TYHCU40L tag=YF3V2JLYNWQY type=write size=2392287 2024-09-19T13:47:31.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.117+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~S6Q9Q6YB0F7R.0 size=1048576 2024-09-19T13:47:31.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.121+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~S6Q9Q6YB0F7R.1 size=197105 2024-09-19T13:47:31.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.121+0000 7fcf3240c8c0 1 > prepared multipart upload key=OA9BMSXGYR9T upload=S6Q9Q6YB0F7R tag=QNZ2DSOOQ3SV type=write size=2294257 2024-09-19T13:47:31.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.121+0000 7fcf3240c8c0 1 < completed delete operation key=HXMZKP7H3HJE tag=IXFFKE18UPNQ type=del 2024-09-19T13:47:31.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.125+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=AO7OSYGO01AX type=del size=233207 2024-09-19T13:47:31.132 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.129+0000 7fcf3240c8c0 1 < completed write operation key=3TME221SA53E tag=09BS3KH21IL5 type=write size=315282 2024-09-19T13:47:31.137 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.133+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~IJYZRDU7UPHX.0 size=996432 2024-09-19T13:47:31.137 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.133+0000 7fcf3240c8c0 1 > prepared multipart upload key=STMT6XU2EJQM upload=IJYZRDU7UPHX tag=ZOUZPBVJKL3Z type=write size=2045008 2024-09-19T13:47:31.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.137+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~TBQXDXX9JO8O.0 size=587189 2024-09-19T13:47:31.144 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.141+0000 7fcf3240c8c0 1 < completed multipart upload key=V8X0VBBNK83J upload=TBQXDXX9JO8O tag=Q3YPOF63F0LE type=write size=1635765 2024-09-19T13:47:31.147 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.145+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=9EYY7AD3D3DB type=del size=2715583 2024-09-19T13:47:31.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.145+0000 7fcf3240c8c0 1 < completed delete operation key=C3TFYNXH549T tag=MN3CQ17KJTQB type=del 2024-09-19T13:47:31.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.149+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=5BN0NQLJPC36 type=del size=1480499 2024-09-19T13:47:31.155 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.153+0000 7fcf3240c8c0 1 < completed delete operation key=BXUPV5XSJBTH tag=3BD3IHWSLSN0 type=del 2024-09-19T13:47:31.160 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.157+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~7FWXWU4QPJQP.0 size=1048576 2024-09-19T13:47:31.162 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.157+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~7FWXWU4QPJQP.1 size=417865 2024-09-19T13:47:31.162 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.157+0000 7fcf3240c8c0 1 > prepared multipart upload key=V8X0VBBNK83J upload=7FWXWU4QPJQP tag=X03DY5UD8JSB type=write size=2515017 2024-09-19T13:47:31.165 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.161+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~8RNHR6I7V018.0 size=1048576 2024-09-19T13:47:31.165 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.161+0000 7fcf3240c8c0 1 < canceled part key=_multipart_QMSDNKYFFK1F.2~8RNHR6I7V018.1 size=1048576 2024-09-19T13:47:31.167 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.165+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~8RNHR6I7V018.2 size=777760 2024-09-19T13:47:31.172 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.169+0000 7fcf3240c8c0 1 < canceled multipart upload key=QMSDNKYFFK1F upload=8RNHR6I7V018 tag=29TLO6ZRH8ML type=write size=3923488 2024-09-19T13:47:31.175 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.173+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=X343W346S5OT type=del size=1553881 2024-09-19T13:47:31.178 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.173+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=F3UZVQ4B35FE type=del 2024-09-19T13:47:31.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.177+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=J2EKF0B1GORI type=del size=941002 2024-09-19T13:47:31.184 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.181+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~F6MZ2RNADHGS.0 size=1048576 2024-09-19T13:47:31.186 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.185+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~F6MZ2RNADHGS.1 size=1048576 2024-09-19T13:47:31.188 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.185+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~F6MZ2RNADHGS.2 size=227871 2024-09-19T13:47:31.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.189+0000 7fcf3240c8c0 1 < completed multipart upload key=V8X0VBBNK83J upload=F6MZ2RNADHGS tag=F2KDBF2D20VO type=write size=3373599 2024-09-19T13:47:31.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.193+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=2C7LFI8BN65F type=del size=951098 2024-09-19T13:47:31.199 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.197+0000 7fcf3240c8c0 1 < completed delete operation key=D1RMXGXS3O7Z tag=C749NVL4JQPB type=del 2024-09-19T13:47:31.202 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.201+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=AQVLMXSJV2X7 type=del size=2225454 2024-09-19T13:47:31.205 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.201+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~ITB7I4Q5BK77.0 size=898809 2024-09-19T13:47:31.210 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.209+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=ITB7I4Q5BK77 tag=FJY3P3WAAND4 type=write size=1947385 2024-09-19T13:47:31.213 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.209+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=4KT6865J3ZIM type=del size=1774329 2024-09-19T13:47:31.214 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.209+0000 7fcf3240c8c0 1 < canceled part key=_multipart_N51Q6HKJSCCB.2~XRCN3D5G5OTY.0 size=1048576 2024-09-19T13:47:31.216 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.213+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~XRCN3D5G5OTY.1 size=1048576 2024-09-19T13:47:31.218 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.213+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~XRCN3D5G5OTY.2 size=521939 2024-09-19T13:47:31.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.221+0000 7fcf3240c8c0 1 < canceled multipart upload key=N51Q6HKJSCCB upload=XRCN3D5G5OTY tag=RG7C2R1L4DCO type=write size=3667667 2024-09-19T13:47:31.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.221+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=APSGT7CHYGEZ type=del size=1939841 2024-09-19T13:47:31.228 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.225+0000 7fcf3240c8c0 1 < completed delete operation key=C3TFYNXH549T tag=QI2PBMMJBRTE type=del 2024-09-19T13:47:31.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.229+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~WBH607J1QEHK.0 size=1048576 2024-09-19T13:47:31.236 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.233+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~WBH607J1QEHK.1 size=12467 2024-09-19T13:47:31.236 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.233+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=WBH607J1QEHK tag=X8U9PDRRE68T type=write size=2109619 2024-09-19T13:47:31.239 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.237+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=142PDRRZ9X9J type=del 2024-09-19T13:47:31.245 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.241+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~PMSITOB5P04V.0 size=1048576 2024-09-19T13:47:31.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.245+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~PMSITOB5P04V.1 size=220496 2024-09-19T13:47:31.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.245+0000 7fcf3240c8c0 1 > prepared multipart upload key=V8X0VBBNK83J upload=PMSITOB5P04V tag=21ZM8JI6WO5J type=write size=2317648 2024-09-19T13:47:31.252 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.249+0000 7fcf3240c8c0 1 < completed delete operation key=1BMF3S2BZLLI tag=PILXRJF01066 type=del 2024-09-19T13:47:31.257 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.253+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~FO4SHZER2ZS3.0 size=20715 2024-09-19T13:47:31.257 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.253+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=FO4SHZER2ZS3 tag=NWIG1EKN1L9C type=write size=1069291 2024-09-19T13:47:31.260 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.257+0000 7fcf3240c8c0 1 < completed delete operation key=QSM2Q8CW1Q86 tag=VK7BQUYD5BEF type=del 2024-09-19T13:47:31.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.261+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=W0NZONWAAQ6S type=del size=1876936 2024-09-19T13:47:31.268 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.265+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~S6Q9Q6YB0F7R.0 size=1048576 2024-09-19T13:47:31.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.265+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~S6Q9Q6YB0F7R.1 size=197105 2024-09-19T13:47:31.274 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.273+0000 7fcf3240c8c0 1 < completed multipart upload key=OA9BMSXGYR9T upload=S6Q9Q6YB0F7R tag=QNZ2DSOOQ3SV type=write size=2294257 2024-09-19T13:47:31.277 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.273+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=KUB50HH1GOM3 type=del size=3045368 2024-09-19T13:47:31.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.281+0000 7fcf3240c8c0 1 < suggested remove operation key=0UCFTOF1YBBM tag=AO7OSYGO01AX type=del 2024-09-19T13:47:31.287 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.285+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~S229XBC3LTHN.0 size=650743 2024-09-19T13:47:31.288 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.285+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=S229XBC3LTHN tag=W4ZX1P9MO768 type=write size=1699319 2024-09-19T13:47:31.288 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.285+0000 7fcf3240c8c0 1 < canceled part key=_multipart_STMT6XU2EJQM.2~IJYZRDU7UPHX.0 size=996432 2024-09-19T13:47:31.292 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.289+0000 7fcf3240c8c0 1 < canceled multipart upload key=STMT6XU2EJQM upload=IJYZRDU7UPHX tag=ZOUZPBVJKL3Z type=write size=2045008 2024-09-19T13:47:31.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.293+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~01EPPSBLI5SJ.0 size=603313 2024-09-19T13:47:31.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.293+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=01EPPSBLI5SJ tag=8LF8L93ZMXRC type=write size=1651889 2024-09-19T13:47:31.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.297+0000 7fcf3240c8c0 1 < completed delete operation key=6DFF2OCPT9W2 tag=9EYY7AD3D3DB type=del 2024-09-19T13:47:31.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.301+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=59TBWM45FGRB type=del size=2133993 2024-09-19T13:47:31.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.305+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=5BN0NQLJPC36 type=del 2024-09-19T13:47:31.314 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.309+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~DZABB4IMFFC3.0 size=1048576 2024-09-19T13:47:31.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.313+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~DZABB4IMFFC3.1 size=773846 2024-09-19T13:47:31.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.313+0000 7fcf3240c8c0 1 > prepared multipart upload key=3TME221SA53E upload=DZABB4IMFFC3 tag=GDK02XWLNBP5 type=write size=2870998 2024-09-19T13:47:31.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.317+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~7FWXWU4QPJQP.0 size=1048576 2024-09-19T13:47:31.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.317+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~7FWXWU4QPJQP.1 size=417865 2024-09-19T13:47:31.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.321+0000 7fcf3240c8c0 1 < completed multipart upload key=V8X0VBBNK83J upload=7FWXWU4QPJQP tag=X03DY5UD8JSB type=write size=2515017 2024-09-19T13:47:31.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.325+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=JORFJGOS7GSG type=del size=4095060 2024-09-19T13:47:31.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.329+0000 7fcf3240c8c0 1 < suggested remove operation key=HXMZKP7H3HJE tag=X343W346S5OT type=del 2024-09-19T13:47:31.336 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.333+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=0I2V9PCDYP1U type=del size=3947980 2024-09-19T13:47:31.339 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.337+0000 7fcf3240c8c0 1 < canceled operation key=V8X0VBBNK83J tag=J2EKF0B1GORI type=del size=941002 2024-09-19T13:47:31.343 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.341+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=7S59B0MV67KQ type=write size=699863 2024-09-19T13:47:31.346 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.341+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=2C7LFI8BN65F type=del 2024-09-19T13:47:31.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.349+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~H2N18NSVAWB2.0 size=1048576 2024-09-19T13:47:31.354 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.349+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~H2N18NSVAWB2.1 size=1048576 2024-09-19T13:47:31.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.353+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~H2N18NSVAWB2.2 size=150544 2024-09-19T13:47:31.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.353+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=H2N18NSVAWB2 tag=24BVQSS8IXN6 type=write size=3296272 2024-09-19T13:47:31.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.357+0000 7fcf3240c8c0 -1 < failed to complete operation key=0UCFTOF1YBBM tag=AQVLMXSJV2X7 type=del size=2225454: (22) Invalid argument 2024-09-19T13:47:31.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.361+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=QSKMTYR70VEI type=del size=2673355 2024-09-19T13:47:31.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.361+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=4KT6865J3ZIM type=del 2024-09-19T13:47:31.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.365+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=65LV0ZEK9689 type=del size=1416473 2024-09-19T13:47:31.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.369+0000 7fcf3240c8c0 1 < completed delete operation key=6DFF2OCPT9W2 tag=APSGT7CHYGEZ type=del 2024-09-19T13:47:31.377 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.373+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~LG0RL763TC7G.0 size=301340 2024-09-19T13:47:31.377 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.373+0000 7fcf3240c8c0 1 > prepared multipart upload key=3TME221SA53E upload=LG0RL763TC7G tag=1H5RKM92U72T type=write size=1349916 2024-09-19T13:47:31.379 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.377+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~WBH607J1QEHK.0 size=1048576 2024-09-19T13:47:31.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.377+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~WBH607J1QEHK.1 size=12467 2024-09-19T13:47:31.385 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.381+0000 7fcf3240c8c0 1 < completed multipart upload key=QAYJ5B1KZ08J upload=WBH607J1QEHK tag=X8U9PDRRE68T type=write size=2109619 2024-09-19T13:47:31.388 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.385+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=GZBSO2YZZEIR type=write size=916545 2024-09-19T13:47:31.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.389+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~PMSITOB5P04V.0 size=1048576 2024-09-19T13:47:31.393 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.389+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~PMSITOB5P04V.1 size=220496 2024-09-19T13:47:31.397 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.393+0000 7fcf3240c8c0 1 < completed multipart upload key=V8X0VBBNK83J upload=PMSITOB5P04V tag=21ZM8JI6WO5J type=write size=2317648 2024-09-19T13:47:31.402 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.397+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~A4D8MPLCVIN3.0 size=842982 2024-09-19T13:47:31.402 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.397+0000 7fcf3240c8c0 1 > prepared multipart upload key=6DFF2OCPT9W2 upload=A4D8MPLCVIN3 tag=FE2TSEH8YYPT type=write size=1891558 2024-09-19T13:47:31.405 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.401+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~FO4SHZER2ZS3.0 size=20715 2024-09-19T13:47:31.410 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.405+0000 7fcf3240c8c0 1 < completed multipart upload key=ES62XJO5Q3FO upload=FO4SHZER2ZS3 tag=NWIG1EKN1L9C type=write size=1069291 2024-09-19T13:47:31.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.413+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~P1KH73LZNMPO.0 size=1048576 2024-09-19T13:47:31.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.413+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~P1KH73LZNMPO.1 size=1048576 2024-09-19T13:47:31.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.413+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~P1KH73LZNMPO.2 size=459473 2024-09-19T13:47:31.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.413+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=P1KH73LZNMPO tag=GGS6M1MC0AQC type=write size=3605201 2024-09-19T13:47:31.423 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.421+0000 7fcf3240c8c0 1 < suggested update operation key=C3TFYNXH549T tag=W0NZONWAAQ6S type=del size=1876936 2024-09-19T13:47:31.425 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.421+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=0SAWTPBBMNER type=del size=3085588 2024-09-19T13:47:31.430 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.425+0000 7fcf3240c8c0 1 < suggested update operation key=QAYJ5B1KZ08J tag=KUB50HH1GOM3 type=del size=3045368 2024-09-19T13:47:31.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.429+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~FI0I4VBZL8D6.0 size=1048576 2024-09-19T13:47:31.436 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.433+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~FI0I4VBZL8D6.1 size=1048576 2024-09-19T13:47:31.438 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.433+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~FI0I4VBZL8D6.2 size=360645 2024-09-19T13:47:31.438 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.433+0000 7fcf3240c8c0 1 > prepared multipart upload key=STMT6XU2EJQM upload=FI0I4VBZL8D6 tag=NAVGMSI7C2UT type=write size=3506373 2024-09-19T13:47:31.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.437+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~S229XBC3LTHN.0 size=650743 2024-09-19T13:47:31.445 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.441+0000 7fcf3240c8c0 1 < completed multipart upload key=D20C6C2ZFX1W upload=S229XBC3LTHN tag=W4ZX1P9MO768 type=write size=1699319 2024-09-19T13:47:31.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.445+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~4TQM18T8WMNV.0 size=123509 2024-09-19T13:47:31.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.445+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=4TQM18T8WMNV tag=EK8PNX1KGISG type=write size=1172085 2024-09-19T13:47:31.451 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.449+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~01EPPSBLI5SJ.0 size=603313 2024-09-19T13:47:31.455 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.453+0000 7fcf3240c8c0 1 < completed multipart upload key=M2CO4A2DHJ05 upload=01EPPSBLI5SJ tag=8LF8L93ZMXRC type=write size=1651889 2024-09-19T13:47:31.458 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.453+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=6V36I5I0YBZ0 type=write size=304664 2024-09-19T13:47:31.461 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.457+0000 7fcf3240c8c0 1 < completed delete operation key=ZCKKQ1R8318S tag=59TBWM45FGRB type=del 2024-09-19T13:47:31.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.461+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=W3CCNX4O33EO type=del size=1959901 2024-09-19T13:47:31.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.461+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~DZABB4IMFFC3.0 size=1048576 2024-09-19T13:47:31.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.465+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~DZABB4IMFFC3.1 size=773846 2024-09-19T13:47:31.471 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.469+0000 7fcf3240c8c0 1 < completed multipart upload key=3TME221SA53E upload=DZABB4IMFFC3 tag=GDK02XWLNBP5 type=write size=2870998 2024-09-19T13:47:31.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.469+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=FK32VBF7FEJL type=write size=560464 2024-09-19T13:47:31.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.473+0000 7fcf3240c8c0 -1 < failed to complete operation key=QAYJ5B1KZ08J tag=JORFJGOS7GSG type=del size=4095060: (22) Invalid argument 2024-09-19T13:47:31.478 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.477+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=YFYAIGGZZ9PP type=del size=782040 2024-09-19T13:47:31.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.477+0000 7fcf3240c8c0 1 < completed delete operation key=HXMZKP7H3HJE tag=0I2V9PCDYP1U type=del 2024-09-19T13:47:31.485 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.481+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=BWO0GKK0YXP6 type=del size=3211887 2024-09-19T13:47:31.490 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.489+0000 7fcf3240c8c0 1 < suggested remove operation key=X9FGPMP30X47 tag=7S59B0MV67KQ type=write 2024-09-19T13:47:31.495 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.493+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~Y0GEDZA4ONU9.0 size=1048576 2024-09-19T13:47:31.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.493+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~Y0GEDZA4ONU9.1 size=1048576 2024-09-19T13:47:31.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.497+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~Y0GEDZA4ONU9.2 size=862602 2024-09-19T13:47:31.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.497+0000 7fcf3240c8c0 1 > prepared multipart upload key=71Z2VTW99W7J upload=Y0GEDZA4ONU9 tag=3211QYM0H23K type=write size=4008330 2024-09-19T13:47:31.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.501+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~H2N18NSVAWB2.0 size=1048576 2024-09-19T13:47:31.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.501+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~H2N18NSVAWB2.1 size=1048576 2024-09-19T13:47:31.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.505+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~H2N18NSVAWB2.2 size=150544 2024-09-19T13:47:31.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.509+0000 7fcf3240c8c0 1 < completed multipart upload key=ZCKKQ1R8318S upload=H2N18NSVAWB2 tag=24BVQSS8IXN6 type=write size=3296272 2024-09-19T13:47:31.516 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.513+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~2SWTSP7VZP0L.0 size=1048576 2024-09-19T13:47:31.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.517+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~2SWTSP7VZP0L.1 size=1048576 2024-09-19T13:47:31.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.517+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~2SWTSP7VZP0L.2 size=758397 2024-09-19T13:47:31.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.517+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=2SWTSP7VZP0L tag=ZCRZOB1GRBSV type=write size=3904125 2024-09-19T13:47:31.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.521+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=QSKMTYR70VEI type=del 2024-09-19T13:47:31.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.525+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~QL8RI6PM26XL.0 size=865091 2024-09-19T13:47:31.530 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.525+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=QL8RI6PM26XL tag=79JDQQFKNWW3 type=write size=1913667 2024-09-19T13:47:31.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.533+0000 7fcf3240c8c0 1 < suggested remove operation key=HXMZKP7H3HJE tag=65LV0ZEK9689 type=del 2024-09-19T13:47:31.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.537+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~A1KTLFX6KXD6.0 size=1048576 2024-09-19T13:47:31.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.537+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~A1KTLFX6KXD6.1 size=1048576 2024-09-19T13:47:31.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.541+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~A1KTLFX6KXD6.2 size=375087 2024-09-19T13:47:31.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.541+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=A1KTLFX6KXD6 tag=1JQSVD0SIL4I type=write size=3520815 2024-09-19T13:47:31.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.541+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~LG0RL763TC7G.0 size=301340 2024-09-19T13:47:31.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.549+0000 7fcf3240c8c0 1 < completed multipart upload key=3TME221SA53E upload=LG0RL763TC7G tag=1H5RKM92U72T type=write size=1349916 2024-09-19T13:47:31.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.553+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~XITKU7J733M6.0 size=1048576 2024-09-19T13:47:31.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.557+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~XITKU7J733M6.1 size=228308 2024-09-19T13:47:31.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.557+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=XITKU7J733M6 tag=FFIA5OUI2HQJ type=write size=2325460 2024-09-19T13:47:31.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.561+0000 7fcf3240c8c0 1 < suggested update operation key=AES54TJK7VH7 tag=GZBSO2YZZEIR type=write size=916545 2024-09-19T13:47:31.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.561+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=DD7202M8VGKD type=del size=1555185 2024-09-19T13:47:31.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.565+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~A4D8MPLCVIN3.0 size=842982 2024-09-19T13:47:31.573 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.569+0000 7fcf3240c8c0 1 < completed multipart upload key=6DFF2OCPT9W2 upload=A4D8MPLCVIN3 tag=FE2TSEH8YYPT type=write size=1891558 2024-09-19T13:47:31.577 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.573+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~SPQQ7KW5R5MB.0 size=444578 2024-09-19T13:47:31.577 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.573+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=SPQQ7KW5R5MB tag=GIJNTNOP8LEK type=write size=1493154 2024-09-19T13:47:31.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.577+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~P1KH73LZNMPO.0 size=1048576 2024-09-19T13:47:31.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.577+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~P1KH73LZNMPO.1 size=1048576 2024-09-19T13:47:31.584 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.581+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~P1KH73LZNMPO.2 size=459473 2024-09-19T13:47:31.589 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.585+0000 7fcf3240c8c0 1 < completed multipart upload key=ES62XJO5Q3FO upload=P1KH73LZNMPO tag=GGS6M1MC0AQC type=write size=3605201 2024-09-19T13:47:31.595 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.593+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~9PAMREYUB5O0.0 size=156131 2024-09-19T13:47:31.595 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.593+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=9PAMREYUB5O0 tag=8387HAVVXJ53 type=write size=1204707 2024-09-19T13:47:31.598 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.597+0000 7fcf3240c8c0 1 < completed delete operation key=DHPONKOVS8CT tag=0SAWTPBBMNER type=del 2024-09-19T13:47:31.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.597+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=91FZJ6IUSU5K type=del size=520546 2024-09-19T13:47:31.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.601+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~FI0I4VBZL8D6.0 size=1048576 2024-09-19T13:47:31.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.605+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~FI0I4VBZL8D6.1 size=1048576 2024-09-19T13:47:31.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.605+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~FI0I4VBZL8D6.2 size=360645 2024-09-19T13:47:31.613 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.609+0000 7fcf3240c8c0 1 < completed multipart upload key=STMT6XU2EJQM upload=FI0I4VBZL8D6 tag=NAVGMSI7C2UT type=write size=3506373 2024-09-19T13:47:31.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.613+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=R9Z0T4VHLZC8 type=del size=3935282 2024-09-19T13:47:31.618 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.613+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~4TQM18T8WMNV.0 size=123509 2024-09-19T13:47:31.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.621+0000 7fcf3240c8c0 1 < completed multipart upload key=M2CO4A2DHJ05 upload=4TQM18T8WMNV tag=EK8PNX1KGISG type=write size=1172085 2024-09-19T13:47:31.627 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.625+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~W4L6JQPNJ1GG.0 size=1048576 2024-09-19T13:47:31.629 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.625+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~W4L6JQPNJ1GG.1 size=1048576 2024-09-19T13:47:31.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.629+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~W4L6JQPNJ1GG.2 size=846715 2024-09-19T13:47:31.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.629+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=W4L6JQPNJ1GG tag=RWA7TS7OOPX9 type=write size=3992443 2024-09-19T13:47:31.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.629+0000 7fcf3240c8c0 1 < completed write operation key=D1RMXGXS3O7Z tag=6V36I5I0YBZ0 type=write size=304664 2024-09-19T13:47:31.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.633+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=XOSVYG6M6CVE type=del size=3258980 2024-09-19T13:47:31.640 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.637+0000 7fcf3240c8c0 1 < completed delete operation key=XE42LV5M5X82 tag=W3CCNX4O33EO type=del 2024-09-19T13:47:31.646 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.641+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~GCXC3K6YUOFF.0 size=58992 2024-09-19T13:47:31.646 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.641+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=GCXC3K6YUOFF tag=LXJIM8MB4LIA type=write size=1107568 2024-09-19T13:47:31.649 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.645+0000 7fcf3240c8c0 1 < completed write operation key=3TME221SA53E tag=FK32VBF7FEJL type=write size=560464 2024-09-19T13:47:31.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.649+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=WO2LQAQSL3SR type=del size=2578436 2024-09-19T13:47:31.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.653+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=YFYAIGGZZ9PP type=del 2024-09-19T13:47:31.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.657+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~4SRUNMOBGF20.0 size=698295 2024-09-19T13:47:31.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.657+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=4SRUNMOBGF20 tag=AB3MSQ7FY7P9 type=write size=1746871 2024-09-19T13:47:31.668 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.665+0000 7fcf3240c8c0 1 < suggested remove operation key=3TME221SA53E tag=BWO0GKK0YXP6 type=del 2024-09-19T13:47:31.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.669+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~7TUGKZM2RSVO.0 size=1048576 2024-09-19T13:47:31.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.673+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~7TUGKZM2RSVO.1 size=1048576 2024-09-19T13:47:31.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.673+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~7TUGKZM2RSVO.2 size=589421 2024-09-19T13:47:31.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.673+0000 7fcf3240c8c0 1 > prepared multipart upload key=C8T6DB9V9FBT upload=7TUGKZM2RSVO tag=T5S7O0T5O6UL type=write size=3735149 2024-09-19T13:47:31.681 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.677+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~Y0GEDZA4ONU9.0 size=1048576 2024-09-19T13:47:31.683 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.681+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~Y0GEDZA4ONU9.1 size=1048576 2024-09-19T13:47:31.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.681+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~Y0GEDZA4ONU9.2 size=862602 2024-09-19T13:47:31.690 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.689+0000 7fcf3240c8c0 1 < completed multipart upload key=71Z2VTW99W7J upload=Y0GEDZA4ONU9 tag=3211QYM0H23K type=write size=4008330 2024-09-19T13:47:31.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.693+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~Q9RU0HBSPRVL.0 size=1048576 2024-09-19T13:47:31.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.693+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~Q9RU0HBSPRVL.1 size=1048576 2024-09-19T13:47:31.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.697+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~Q9RU0HBSPRVL.2 size=874342 2024-09-19T13:47:31.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.697+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=Q9RU0HBSPRVL tag=DFAD34P7IHUP type=write size=4020070 2024-09-19T13:47:31.703 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.701+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~2SWTSP7VZP0L.0 size=1048576 2024-09-19T13:47:31.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.701+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~2SWTSP7VZP0L.1 size=1048576 2024-09-19T13:47:31.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.705+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~2SWTSP7VZP0L.2 size=758397 2024-09-19T13:47:31.713 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.709+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=2SWTSP7VZP0L tag=ZCRZOB1GRBSV type=write size=3904125 2024-09-19T13:47:31.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.713+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=2DOI2IS4XHC9 type=write size=598490 2024-09-19T13:47:31.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.717+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~QL8RI6PM26XL.0 size=865091 2024-09-19T13:47:31.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.721+0000 7fcf3240c8c0 1 < completed multipart upload key=D20C6C2ZFX1W upload=QL8RI6PM26XL tag=79JDQQFKNWW3 type=write size=1913667 2024-09-19T13:47:31.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.725+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~JA5D4Y22CLHF.0 size=424573 2024-09-19T13:47:31.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.725+0000 7fcf3240c8c0 1 > prepared multipart upload key=X16ENUFL40RN upload=JA5D4Y22CLHF tag=VVBNEHENUTZX type=write size=1473149 2024-09-19T13:47:31.732 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.729+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~A1KTLFX6KXD6.0 size=1048576 2024-09-19T13:47:31.732 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.729+0000 7fcf3240c8c0 1 < canceled part key=_multipart_ES62XJO5Q3FO.2~A1KTLFX6KXD6.1 size=1048576 2024-09-19T13:47:31.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.733+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~A1KTLFX6KXD6.2 size=375087 2024-09-19T13:47:31.740 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.737+0000 7fcf3240c8c0 1 < canceled multipart upload key=ES62XJO5Q3FO upload=A1KTLFX6KXD6 tag=1JQSVD0SIL4I type=write size=3520815 2024-09-19T13:47:31.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.741+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~FMYYKFJPRF9Q.0 size=221424 2024-09-19T13:47:31.746 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.741+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=FMYYKFJPRF9Q tag=3CF4G705ETMP type=write size=1270000 2024-09-19T13:47:31.746 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.741+0000 7fcf3240c8c0 1 < canceled part key=_multipart_QMSDNKYFFK1F.2~XITKU7J733M6.0 size=1048576 2024-09-19T13:47:31.749 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.745+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~XITKU7J733M6.1 size=228308 2024-09-19T13:47:31.754 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.749+0000 7fcf3240c8c0 1 < canceled multipart upload key=QMSDNKYFFK1F upload=XITKU7J733M6 tag=FFIA5OUI2HQJ type=write size=2325460 2024-09-19T13:47:31.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.753+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=N6UTZF2Z8ZKE type=del size=480449 2024-09-19T13:47:31.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.757+0000 7fcf3240c8c0 1 < completed delete operation key=0U9BUX9DHTAK tag=DD7202M8VGKD type=del 2024-09-19T13:47:31.766 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.761+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~O0RC1WY2ZSCC.0 size=460587 2024-09-19T13:47:31.766 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.761+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=O0RC1WY2ZSCC tag=2X8WAY9WA3M7 type=write size=1509163 2024-09-19T13:47:31.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.765+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~SPQQ7KW5R5MB.0 size=444578 2024-09-19T13:47:31.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.769+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=SPQQ7KW5R5MB tag=GIJNTNOP8LEK type=write size=1493154 2024-09-19T13:47:31.780 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.777+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~IP367DAHTJEH.0 size=1048576 2024-09-19T13:47:31.782 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.781+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~IP367DAHTJEH.1 size=1048576 2024-09-19T13:47:31.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.781+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~IP367DAHTJEH.2 size=551057 2024-09-19T13:47:31.786 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.781+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=IP367DAHTJEH tag=4VO1BBEJTEUO type=write size=3696785 2024-09-19T13:47:31.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.785+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~9PAMREYUB5O0.0 size=156131 2024-09-19T13:47:31.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.789+0000 7fcf3240c8c0 1 < completed multipart upload key=M2CO4A2DHJ05 upload=9PAMREYUB5O0 tag=8387HAVVXJ53 type=write size=1204707 2024-09-19T13:47:31.797 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.793+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=CLZ8AUB6YJ7Y type=del size=1601844 2024-09-19T13:47:31.804 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.801+0000 7fcf3240c8c0 1 < suggested remove operation key=0UCFTOF1YBBM tag=91FZJ6IUSU5K type=del 2024-09-19T13:47:31.807 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.805+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=FKODFWK9XZBO type=del size=1135289 2024-09-19T13:47:31.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.809+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=R9Z0T4VHLZC8 type=del 2024-09-19T13:47:31.816 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.813+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~V3KYO2MVDYHY.0 size=1048576 2024-09-19T13:47:31.822 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.817+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~V3KYO2MVDYHY.1 size=1048576 2024-09-19T13:47:31.825 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.821+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~V3KYO2MVDYHY.2 size=125207 2024-09-19T13:47:31.825 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.821+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=V3KYO2MVDYHY tag=SCEW0K28A4SU type=write size=3270935 2024-09-19T13:47:31.828 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.825+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~W4L6JQPNJ1GG.0 size=1048576 2024-09-19T13:47:31.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.829+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~W4L6JQPNJ1GG.1 size=1048576 2024-09-19T13:47:31.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.829+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~W4L6JQPNJ1GG.2 size=846715 2024-09-19T13:47:31.838 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.833+0000 7fcf3240c8c0 1 < completed multipart upload key=ES62XJO5Q3FO upload=W4L6JQPNJ1GG tag=RWA7TS7OOPX9 type=write size=3992443 2024-09-19T13:47:31.841 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.837+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=Q12XTE20JDE3 type=del size=1823885 2024-09-19T13:47:31.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.845+0000 7fcf3240c8c0 1 < suggested remove operation key=D20C6C2ZFX1W tag=XOSVYG6M6CVE type=del 2024-09-19T13:47:31.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.849+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~ECR6NTRRWASQ.0 size=598771 2024-09-19T13:47:31.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.849+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=ECR6NTRRWASQ tag=X6CFBKSTRGBK type=write size=1647347 2024-09-19T13:47:31.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.853+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~GCXC3K6YUOFF.0 size=58992 2024-09-19T13:47:31.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.857+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=GCXC3K6YUOFF tag=LXJIM8MB4LIA type=write size=1107568 2024-09-19T13:47:31.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.861+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=7CHCMLMFV3I1 type=del size=3768249 2024-09-19T13:47:31.871 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.869+0000 7fcf3240c8c0 1 < suggested remove operation key=BXUPV5XSJBTH tag=WO2LQAQSL3SR type=del 2024-09-19T13:47:31.874 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.869+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=QAAF4D7U5YLU type=del size=1058549 2024-09-19T13:47:31.877 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.873+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~4SRUNMOBGF20.0 size=698295 2024-09-19T13:47:31.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.877+0000 7fcf3240c8c0 1 < completed multipart upload key=QSM2Q8CW1Q86 upload=4SRUNMOBGF20 tag=AB3MSQ7FY7P9 type=write size=1746871 2024-09-19T13:47:31.885 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.881+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=C7G6OF5DHBCD type=del size=668524 2024-09-19T13:47:31.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.885+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~7TUGKZM2RSVO.0 size=1048576 2024-09-19T13:47:31.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.889+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~7TUGKZM2RSVO.1 size=1048576 2024-09-19T13:47:31.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.889+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~7TUGKZM2RSVO.2 size=589421 2024-09-19T13:47:31.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.893+0000 7fcf3240c8c0 1 < completed multipart upload key=C8T6DB9V9FBT upload=7TUGKZM2RSVO tag=T5S7O0T5O6UL type=write size=3735149 2024-09-19T13:47:31.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.897+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=VTNAAVHUX0U5 type=del size=3466482 2024-09-19T13:47:31.904 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.901+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~Q9RU0HBSPRVL.0 size=1048576 2024-09-19T13:47:31.906 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.905+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~Q9RU0HBSPRVL.1 size=1048576 2024-09-19T13:47:31.909 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.905+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~Q9RU0HBSPRVL.2 size=874342 2024-09-19T13:47:31.914 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.909+0000 7fcf3240c8c0 1 < completed multipart upload key=0UCFTOF1YBBM upload=Q9RU0HBSPRVL tag=DFAD34P7IHUP type=write size=4020070 2024-09-19T13:47:31.919 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.917+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~V6CKGF5OZ3ZU.0 size=1048576 2024-09-19T13:47:31.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.917+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~V6CKGF5OZ3ZU.1 size=1048576 2024-09-19T13:47:31.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.921+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~V6CKGF5OZ3ZU.2 size=615754 2024-09-19T13:47:31.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.921+0000 7fcf3240c8c0 1 > prepared multipart upload key=C3TFYNXH549T upload=V6CKGF5OZ3ZU tag=NO0PMCGJ3I6R type=write size=3761482 2024-09-19T13:47:31.930 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.925+0000 7fcf3240c8c0 1 < suggested update operation key=DHPONKOVS8CT tag=2DOI2IS4XHC9 type=write size=598490 2024-09-19T13:47:31.933 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.929+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=M5GJ9CLI1GY2 type=del size=751665 2024-09-19T13:47:31.936 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.933+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~JA5D4Y22CLHF.0 size=424573 2024-09-19T13:47:31.941 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.937+0000 7fcf3240c8c0 1 < completed multipart upload key=X16ENUFL40RN upload=JA5D4Y22CLHF tag=VVBNEHENUTZX type=write size=1473149 2024-09-19T13:47:31.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.941+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=1MFB5VU7QABH type=del size=3779842 2024-09-19T13:47:31.948 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.945+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~FMYYKFJPRF9Q.0 size=221424 2024-09-19T13:47:31.955 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.953+0000 7fcf3240c8c0 1 < completed multipart upload key=N51Q6HKJSCCB upload=FMYYKFJPRF9Q tag=3CF4G705ETMP type=write size=1270000 2024-09-19T13:47:31.959 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.957+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=ZJ0OB04X8VXN type=del size=1019993 2024-09-19T13:47:31.966 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.961+0000 7fcf3240c8c0 1 < suggested remove operation key=STMT6XU2EJQM tag=N6UTZF2Z8ZKE type=del 2024-09-19T13:47:31.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.969+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~QFM8L91JNVUF.0 size=669041 2024-09-19T13:47:31.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.969+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=QFM8L91JNVUF tag=J6K4AMJRH01R type=write size=1717617 2024-09-19T13:47:31.975 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.973+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~O0RC1WY2ZSCC.0 size=460587 2024-09-19T13:47:31.980 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.977+0000 7fcf3240c8c0 1 < completed multipart upload key=QSM2Q8CW1Q86 upload=O0RC1WY2ZSCC tag=2X8WAY9WA3M7 type=write size=1509163 2024-09-19T13:47:31.984 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.981+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=T4A5TUFC7Y1S type=write size=815496 2024-09-19T13:47:31.987 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.985+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~IP367DAHTJEH.0 size=1048576 2024-09-19T13:47:31.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.989+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~IP367DAHTJEH.1 size=1048576 2024-09-19T13:47:31.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.989+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~IP367DAHTJEH.2 size=551057 2024-09-19T13:47:31.998 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.997+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=IP367DAHTJEH tag=4VO1BBEJTEUO type=write size=3696785 2024-09-19T13:47:32.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:31.997+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=NCKUCRS6FQN6 type=del size=4006040 2024-09-19T13:47:32.009 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.005+0000 7fcf3240c8c0 1 < suggested remove operation key=0UCFTOF1YBBM tag=CLZ8AUB6YJ7Y type=del 2024-09-19T13:47:32.014 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.013+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~JSUYI6VJVPK4.0 size=1048576 2024-09-19T13:47:32.017 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.013+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~JSUYI6VJVPK4.1 size=1048576 2024-09-19T13:47:32.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.017+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~JSUYI6VJVPK4.2 size=123996 2024-09-19T13:47:32.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.017+0000 7fcf3240c8c0 1 > prepared multipart upload key=X9FGPMP30X47 upload=JSUYI6VJVPK4 tag=WUP0S2E9W21J type=write size=3269724 2024-09-19T13:47:32.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.021+0000 7fcf3240c8c0 1 < completed delete operation key=QSM2Q8CW1Q86 tag=FKODFWK9XZBO type=del 2024-09-19T13:47:32.029 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.025+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~WW4AO36ZZZDE.0 size=1048576 2024-09-19T13:47:32.031 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.029+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~WW4AO36ZZZDE.1 size=1048576 2024-09-19T13:47:32.034 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.029+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~WW4AO36ZZZDE.2 size=741815 2024-09-19T13:47:32.034 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.029+0000 7fcf3240c8c0 1 > prepared multipart upload key=C3TFYNXH549T upload=WW4AO36ZZZDE tag=RWF6J762VRNN type=write size=3887543 2024-09-19T13:47:32.038 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.033+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~V3KYO2MVDYHY.0 size=1048576 2024-09-19T13:47:32.040 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.037+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~V3KYO2MVDYHY.1 size=1048576 2024-09-19T13:47:32.043 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.041+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~V3KYO2MVDYHY.2 size=125207 2024-09-19T13:47:32.049 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.045+0000 7fcf3240c8c0 1 < completed multipart upload key=QAYJ5B1KZ08J upload=V3KYO2MVDYHY tag=SCEW0K28A4SU type=write size=3270935 2024-09-19T13:47:32.052 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.049+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=PDZEZ8JUGCFZ type=del size=3908530 2024-09-19T13:47:32.059 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.057+0000 7fcf3240c8c0 1 < suggested remove operation key=HXMZKP7H3HJE tag=Q12XTE20JDE3 type=del 2024-09-19T13:47:32.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.057+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=YDPYDGK1VVS7 type=del size=3696163 2024-09-19T13:47:32.065 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.061+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~ECR6NTRRWASQ.0 size=598771 2024-09-19T13:47:32.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.069+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=ECR6NTRRWASQ tag=X6CFBKSTRGBK type=write size=1647347 2024-09-19T13:47:32.077 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.073+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~FP5APVCA5U8G.0 size=788759 2024-09-19T13:47:32.077 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.073+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=FP5APVCA5U8G tag=TCH5RHDEGIZR type=write size=1837335 2024-09-19T13:47:32.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.077+0000 7fcf3240c8c0 1 < canceled operation key=N51Q6HKJSCCB tag=7CHCMLMFV3I1 type=del size=3768249 2024-09-19T13:47:32.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.081+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=EFGKUE1AWQ2M type=del size=1718391 2024-09-19T13:47:32.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.085+0000 7fcf3240c8c0 1 < completed delete operation key=QSM2Q8CW1Q86 tag=QAAF4D7U5YLU type=del 2024-09-19T13:47:32.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.089+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~0RNBIDLPSZRT.0 size=493091 2024-09-19T13:47:32.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.089+0000 7fcf3240c8c0 1 > prepared multipart upload key=X16ENUFL40RN upload=0RNBIDLPSZRT tag=MD68GORTT1K7 type=write size=1541667 2024-09-19T13:47:32.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.093+0000 7fcf3240c8c0 1 < completed delete operation key=1BMF3S2BZLLI tag=C7G6OF5DHBCD type=del 2024-09-19T13:47:32.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.101+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~KI367IU3P6FO.0 size=713594 2024-09-19T13:47:32.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.101+0000 7fcf3240c8c0 1 > prepared multipart upload key=A02RDP6BA9AC upload=KI367IU3P6FO tag=AE4MBG9XDMA8 type=write size=1762170 2024-09-19T13:47:32.107 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.105+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=VTNAAVHUX0U5 type=del 2024-09-19T13:47:32.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.109+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=BE4NIIDSOG4G type=del size=3203531 2024-09-19T13:47:32.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.109+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~V6CKGF5OZ3ZU.0 size=1048576 2024-09-19T13:47:32.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.109+0000 7fcf3240c8c0 1 < canceled part key=_multipart_C3TFYNXH549T.2~V6CKGF5OZ3ZU.1 size=1048576 2024-09-19T13:47:32.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.113+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~V6CKGF5OZ3ZU.2 size=615754 2024-09-19T13:47:32.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.121+0000 7fcf3240c8c0 1 < canceled multipart upload key=C3TFYNXH549T upload=V6CKGF5OZ3ZU tag=NO0PMCGJ3I6R type=write size=3761482 2024-09-19T13:47:32.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.125+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~XEWMVEU057WP.0 size=1048576 2024-09-19T13:47:32.132 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.129+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~XEWMVEU057WP.1 size=702719 2024-09-19T13:47:32.132 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.129+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=XEWMVEU057WP tag=VNRNQT7Y1R9F type=write size=2799871 2024-09-19T13:47:32.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.133+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=M5GJ9CLI1GY2 type=del 2024-09-19T13:47:32.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.133+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=5C4B0I4EX693 type=del size=335317 2024-09-19T13:47:32.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.137+0000 7fcf3240c8c0 1 < canceled operation key=C8T6DB9V9FBT tag=1MFB5VU7QABH type=del size=3779842 2024-09-19T13:47:32.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.145+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~M0377VMRAR1L.0 size=1048576 2024-09-19T13:47:32.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.149+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~M0377VMRAR1L.1 size=1048576 2024-09-19T13:47:32.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.149+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~M0377VMRAR1L.2 size=536410 2024-09-19T13:47:32.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.149+0000 7fcf3240c8c0 1 > prepared multipart upload key=DHPONKOVS8CT upload=M0377VMRAR1L tag=TCBE5S5B79G8 type=write size=3682138 2024-09-19T13:47:32.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.153+0000 7fcf3240c8c0 1 < completed delete operation key=XE42LV5M5X82 tag=ZJ0OB04X8VXN type=del 2024-09-19T13:47:32.159 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.157+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=3EM3R7B2JBGG type=del size=2283693 2024-09-19T13:47:32.162 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.161+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~QFM8L91JNVUF.0 size=669041 2024-09-19T13:47:32.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.165+0000 7fcf3240c8c0 1 < completed multipart upload key=XE42LV5M5X82 upload=QFM8L91JNVUF tag=J6K4AMJRH01R type=write size=1717617 2024-09-19T13:47:32.171 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.169+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=HYAMZ2M9DB4N type=del size=1501366 2024-09-19T13:47:32.174 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.169+0000 7fcf3240c8c0 1 < completed write operation key=STMT6XU2EJQM tag=T4A5TUFC7Y1S type=write size=815496 2024-09-19T13:47:32.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.173+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=CK2L4061WIWX type=del size=1489298 2024-09-19T13:47:32.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.181+0000 7fcf3240c8c0 1 < suggested update operation key=C35EUAOWLBR3 tag=NCKUCRS6FQN6 type=del size=4006040 2024-09-19T13:47:32.188 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.185+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~BWKASAPT6XFJ.0 size=1048576 2024-09-19T13:47:32.191 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.189+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~BWKASAPT6XFJ.1 size=1048576 2024-09-19T13:47:32.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.189+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~BWKASAPT6XFJ.2 size=452848 2024-09-19T13:47:32.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.189+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=BWKASAPT6XFJ tag=2BY9PN72CT1H type=write size=3598576 2024-09-19T13:47:32.196 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.193+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~JSUYI6VJVPK4.0 size=1048576 2024-09-19T13:47:32.199 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.197+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~JSUYI6VJVPK4.1 size=1048576 2024-09-19T13:47:32.202 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.197+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~JSUYI6VJVPK4.2 size=123996 2024-09-19T13:47:32.207 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.205+0000 7fcf3240c8c0 1 < completed multipart upload key=X9FGPMP30X47 upload=JSUYI6VJVPK4 tag=WUP0S2E9W21J type=write size=3269724 2024-09-19T13:47:32.212 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.209+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~PZ3XZ2O20T27.0 size=1048576 2024-09-19T13:47:32.215 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.213+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~PZ3XZ2O20T27.1 size=1048576 2024-09-19T13:47:32.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.213+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~PZ3XZ2O20T27.2 size=340120 2024-09-19T13:47:32.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.213+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=PZ3XZ2O20T27 tag=FMEE4JEYXWHC type=write size=3485848 2024-09-19T13:47:32.220 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.217+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~WW4AO36ZZZDE.0 size=1048576 2024-09-19T13:47:32.222 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.221+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~WW4AO36ZZZDE.1 size=1048576 2024-09-19T13:47:32.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.221+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~WW4AO36ZZZDE.2 size=741815 2024-09-19T13:47:32.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.229+0000 7fcf3240c8c0 1 < completed multipart upload key=C3TFYNXH549T upload=WW4AO36ZZZDE tag=RWF6J762VRNN type=write size=3887543 2024-09-19T13:47:32.238 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.233+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~063JORWHBPY5.0 size=1048576 2024-09-19T13:47:32.240 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.237+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~063JORWHBPY5.1 size=1048576 2024-09-19T13:47:32.242 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.241+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~063JORWHBPY5.2 size=670836 2024-09-19T13:47:32.242 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.241+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=063JORWHBPY5 tag=C2EYRHB2B1L3 type=write size=3816564 2024-09-19T13:47:32.245 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.241+0000 7fcf3240c8c0 1 < completed delete operation key=D20C6C2ZFX1W tag=PDZEZ8JUGCFZ type=del 2024-09-19T13:47:32.250 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.245+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0U9BUX9DHTAK.2~0SP9JPM852N0.0 size=647671 2024-09-19T13:47:32.250 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.245+0000 7fcf3240c8c0 1 > prepared multipart upload key=0U9BUX9DHTAK upload=0SP9JPM852N0 tag=G376N581XEFZ type=write size=1696247 2024-09-19T13:47:32.252 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.249+0000 7fcf3240c8c0 -1 < failed to complete operation key=C35EUAOWLBR3 tag=YDPYDGK1VVS7 type=del size=3696163: (22) Invalid argument 2024-09-19T13:47:32.255 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.253+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=97KN56QFS67W type=del size=1396678 2024-09-19T13:47:32.257 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.253+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~FP5APVCA5U8G.0 size=788759 2024-09-19T13:47:32.261 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.257+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=FP5APVCA5U8G tag=TCH5RHDEGIZR type=write size=1837335 2024-09-19T13:47:32.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.261+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=18LMLNYITWJT type=del size=1911995 2024-09-19T13:47:32.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.265+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=EFGKUE1AWQ2M type=del 2024-09-19T13:47:32.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.269+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~4SF78UVTQ469.0 size=1048576 2024-09-19T13:47:32.274 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.269+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~4SF78UVTQ469.1 size=997442 2024-09-19T13:47:32.274 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.269+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=4SF78UVTQ469 tag=FX2DG4DCAP0O type=write size=3094594 2024-09-19T13:47:32.276 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.273+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~0RNBIDLPSZRT.0 size=493091 2024-09-19T13:47:32.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.277+0000 7fcf3240c8c0 1 < completed multipart upload key=X16ENUFL40RN upload=0RNBIDLPSZRT tag=MD68GORTT1K7 type=write size=1541667 2024-09-19T13:47:32.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.281+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=B0EDP8Z2APIQ type=del size=3119938 2024-09-19T13:47:32.286 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.281+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~KI367IU3P6FO.0 size=713594 2024-09-19T13:47:32.290 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.289+0000 7fcf3240c8c0 1 < completed multipart upload key=A02RDP6BA9AC upload=KI367IU3P6FO tag=AE4MBG9XDMA8 type=write size=1762170 2024-09-19T13:47:32.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.293+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~Y3E6U1A1F5XB.0 size=144701 2024-09-19T13:47:32.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.293+0000 7fcf3240c8c0 1 > prepared multipart upload key=D1RMXGXS3O7Z upload=Y3E6U1A1F5XB tag=L6GS0T0LIFOO type=write size=1193277 2024-09-19T13:47:32.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.297+0000 7fcf3240c8c0 1 < suggested remove operation key=D20C6C2ZFX1W tag=BE4NIIDSOG4G type=del 2024-09-19T13:47:32.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.301+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=YUL4CWP8JFIP type=del size=1603290 2024-09-19T13:47:32.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.301+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~XEWMVEU057WP.0 size=1048576 2024-09-19T13:47:32.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.301+0000 7fcf3240c8c0 1 < canceled part key=_multipart_XE42LV5M5X82.2~XEWMVEU057WP.1 size=702719 2024-09-19T13:47:32.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.309+0000 7fcf3240c8c0 1 < canceled multipart upload key=XE42LV5M5X82 upload=XEWMVEU057WP tag=VNRNQT7Y1R9F type=write size=2799871 2024-09-19T13:47:32.313 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.309+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=J8U5YVL7ED9D type=del size=715026 2024-09-19T13:47:32.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.313+0000 7fcf3240c8c0 1 < completed delete operation key=HXMZKP7H3HJE tag=5C4B0I4EX693 type=del 2024-09-19T13:47:32.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.317+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~ESM0OG97BKXF.0 size=1048576 2024-09-19T13:47:32.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.321+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~ESM0OG97BKXF.1 size=588624 2024-09-19T13:47:32.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.321+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=ESM0OG97BKXF tag=TXNPT7028TS0 type=write size=2685776 2024-09-19T13:47:32.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.325+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~M0377VMRAR1L.0 size=1048576 2024-09-19T13:47:32.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.325+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~M0377VMRAR1L.1 size=1048576 2024-09-19T13:47:32.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.325+0000 7fcf3240c8c0 1 < canceled part key=_multipart_DHPONKOVS8CT.2~M0377VMRAR1L.2 size=536410 2024-09-19T13:47:32.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.329+0000 7fcf3240c8c0 1 < canceled multipart upload key=DHPONKOVS8CT upload=M0377VMRAR1L tag=TCBE5S5B79G8 type=write size=3682138 2024-09-19T13:47:32.336 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.333+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=BWCT0KAAVSZ9 type=del size=4160997 2024-09-19T13:47:32.339 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.337+0000 7fcf3240c8c0 1 < completed delete operation key=XE42LV5M5X82 tag=3EM3R7B2JBGG type=del 2024-09-19T13:47:32.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.337+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=9BPUM3IO5NB0 type=del size=3136608 2024-09-19T13:47:32.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.345+0000 7fcf3240c8c0 1 < suggested update operation key=V8X0VBBNK83J tag=HYAMZ2M9DB4N type=del size=1501366 2024-09-19T13:47:32.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.345+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=X4FVX5M2Y3FW type=del size=2445827 2024-09-19T13:47:32.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.349+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=CK2L4061WIWX type=del 2024-09-19T13:47:32.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.353+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~YUAAYQZTFU0H.0 size=1048576 2024-09-19T13:47:32.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.357+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~YUAAYQZTFU0H.1 size=395653 2024-09-19T13:47:32.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.357+0000 7fcf3240c8c0 1 > prepared multipart upload key=71Z2VTW99W7J upload=YUAAYQZTFU0H tag=N90WT6AWPDHK type=write size=2492805 2024-09-19T13:47:32.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.357+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~BWKASAPT6XFJ.0 size=1048576 2024-09-19T13:47:32.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.361+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~BWKASAPT6XFJ.1 size=1048576 2024-09-19T13:47:32.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.361+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~BWKASAPT6XFJ.2 size=452848 2024-09-19T13:47:32.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.365+0000 7fcf3240c8c0 1 < completed multipart upload key=NP2L28YRVQ8L upload=BWKASAPT6XFJ tag=2BY9PN72CT1H type=write size=3598576 2024-09-19T13:47:32.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.369+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=0IVQOGMV0TD6 type=write size=476803 2024-09-19T13:47:32.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.373+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~PZ3XZ2O20T27.0 size=1048576 2024-09-19T13:47:32.377 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.373+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~PZ3XZ2O20T27.1 size=1048576 2024-09-19T13:47:32.379 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.377+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~PZ3XZ2O20T27.2 size=340120 2024-09-19T13:47:32.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.385+0000 7fcf3240c8c0 1 < completed multipart upload key=ES62XJO5Q3FO upload=PZ3XZ2O20T27 tag=FMEE4JEYXWHC type=write size=3485848 2024-09-19T13:47:32.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.385+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=7VSG0PTGD9JO type=del size=1717764 2024-09-19T13:47:32.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.389+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~063JORWHBPY5.0 size=1048576 2024-09-19T13:47:32.394 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.393+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~063JORWHBPY5.1 size=1048576 2024-09-19T13:47:32.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.393+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~063JORWHBPY5.2 size=670836 2024-09-19T13:47:32.401 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.397+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=063JORWHBPY5 tag=C2EYRHB2B1L3 type=write size=3816564 2024-09-19T13:47:32.404 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.401+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=BP04A1NKHK05 type=write size=328666 2024-09-19T13:47:32.407 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.405+0000 7fcf3240c8c0 1 < completed part key=_multipart_0U9BUX9DHTAK.2~0SP9JPM852N0.0 size=647671 2024-09-19T13:47:32.411 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.409+0000 7fcf3240c8c0 1 < completed multipart upload key=0U9BUX9DHTAK upload=0SP9JPM852N0 tag=G376N581XEFZ type=write size=1696247 2024-09-19T13:47:32.413 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.409+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=CNB0Y2QUWTJE type=del size=3488657 2024-09-19T13:47:32.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.413+0000 7fcf3240c8c0 1 < canceled operation key=N51Q6HKJSCCB tag=97KN56QFS67W type=del size=1396678 2024-09-19T13:47:32.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.413+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=EPTHDULFA10J type=del size=3080322 2024-09-19T13:47:32.420 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.417+0000 7fcf3240c8c0 1 < canceled operation key=N51Q6HKJSCCB tag=18LMLNYITWJT type=del size=1911995 2024-09-19T13:47:32.423 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.421+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=NBR3VQI0TBOM type=del size=1292151 2024-09-19T13:47:32.427 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.425+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~4SF78UVTQ469.0 size=1048576 2024-09-19T13:47:32.429 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.425+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~4SF78UVTQ469.1 size=997442 2024-09-19T13:47:32.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.429+0000 7fcf3240c8c0 1 < completed multipart upload key=N51Q6HKJSCCB upload=4SF78UVTQ469 tag=FX2DG4DCAP0O type=write size=3094594 2024-09-19T13:47:32.438 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.433+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~VWCA1EPO3L5D.0 size=1048576 2024-09-19T13:47:32.439 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.437+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~VWCA1EPO3L5D.1 size=606427 2024-09-19T13:47:32.440 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.437+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=VWCA1EPO3L5D tag=0K8717DIPG6E type=write size=2703579 2024-09-19T13:47:32.442 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.437+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=B0EDP8Z2APIQ type=del 2024-09-19T13:47:32.447 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.445+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~ZC58X8BK9XOW.0 size=1048576 2024-09-19T13:47:32.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.445+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~ZC58X8BK9XOW.1 size=1048576 2024-09-19T13:47:32.450 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.449+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~ZC58X8BK9XOW.2 size=615741 2024-09-19T13:47:32.451 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.449+0000 7fcf3240c8c0 1 > prepared multipart upload key=V8X0VBBNK83J upload=ZC58X8BK9XOW tag=91SRXH4JKSUB type=write size=3761469 2024-09-19T13:47:32.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.449+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~Y3E6U1A1F5XB.0 size=144701 2024-09-19T13:47:32.457 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.453+0000 7fcf3240c8c0 1 < completed multipart upload key=D1RMXGXS3O7Z upload=Y3E6U1A1F5XB tag=L6GS0T0LIFOO type=write size=1193277 2024-09-19T13:47:32.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.457+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~G7EGZF3W20MU.0 size=587511 2024-09-19T13:47:32.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.457+0000 7fcf3240c8c0 1 > prepared multipart upload key=X16ENUFL40RN upload=G7EGZF3W20MU tag=J6UA476IDOC7 type=write size=1636087 2024-09-19T13:47:32.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.465+0000 7fcf3240c8c0 1 < suggested update operation key=STMT6XU2EJQM tag=YUL4CWP8JFIP type=del size=1603290 2024-09-19T13:47:32.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.465+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=6BCF0SYML5ON type=del size=1548110 2024-09-19T13:47:32.472 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.469+0000 7fcf3240c8c0 1 < completed delete operation key=C8T6DB9V9FBT tag=J8U5YVL7ED9D type=del 2024-09-19T13:47:32.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.473+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=E4B8YS2614O1 type=del size=1009052 2024-09-19T13:47:32.477 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.473+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~ESM0OG97BKXF.0 size=1048576 2024-09-19T13:47:32.479 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.477+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~ESM0OG97BKXF.1 size=588624 2024-09-19T13:47:32.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.481+0000 7fcf3240c8c0 1 < completed multipart upload key=QAYJ5B1KZ08J upload=ESM0OG97BKXF tag=TXNPT7028TS0 type=write size=2685776 2024-09-19T13:47:32.488 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.485+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~PGM1D9NOWAX2.0 size=458794 2024-09-19T13:47:32.488 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.485+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=PGM1D9NOWAX2 tag=9GPJMBSPHLNW type=write size=1507370 2024-09-19T13:47:32.491 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.489+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=BWCT0KAAVSZ9 type=del 2024-09-19T13:47:32.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.489+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=XE1QYNH8VSTY type=del size=2580568 2024-09-19T13:47:32.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.493+0000 7fcf3240c8c0 1 < completed delete operation key=N51Q6HKJSCCB tag=9BPUM3IO5NB0 type=del 2024-09-19T13:47:32.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.497+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=3KBFHKRDL4LM type=del size=971073 2024-09-19T13:47:32.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.501+0000 7fcf3240c8c0 1 < completed delete operation key=N51Q6HKJSCCB tag=X4FVX5M2Y3FW type=del 2024-09-19T13:47:32.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.501+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=ERWXU8XMSFQP type=del size=590236 2024-09-19T13:47:32.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.505+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~YUAAYQZTFU0H.0 size=1048576 2024-09-19T13:47:32.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.509+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~YUAAYQZTFU0H.1 size=395653 2024-09-19T13:47:32.516 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.513+0000 7fcf3240c8c0 1 < completed multipart upload key=71Z2VTW99W7J upload=YUAAYQZTFU0H tag=N90WT6AWPDHK type=write size=2492805 2024-09-19T13:47:32.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.517+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~XHEW4SL2LQL4.0 size=416054 2024-09-19T13:47:32.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.517+0000 7fcf3240c8c0 1 > prepared multipart upload key=6DFF2OCPT9W2 upload=XHEW4SL2LQL4 tag=N5DAG6YE4MLO type=write size=1464630 2024-09-19T13:47:32.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.521+0000 7fcf3240c8c0 1 < completed write operation key=OA9BMSXGYR9T tag=0IVQOGMV0TD6 type=write size=476803 2024-09-19T13:47:32.527 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.525+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=B360M479O9NU type=del size=3387527 2024-09-19T13:47:32.530 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.525+0000 7fcf3240c8c0 1 < completed delete operation key=BXUPV5XSJBTH tag=7VSG0PTGD9JO type=del 2024-09-19T13:47:32.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.529+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=FRMY7YEEW8G1 type=del size=34265 2024-09-19T13:47:32.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.533+0000 7fcf3240c8c0 1 < canceled operation key=QSM2Q8CW1Q86 tag=BP04A1NKHK05 type=write size=328666 2024-09-19T13:47:32.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.537+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0U9BUX9DHTAK.2~DURPAQ6D0XT5.0 size=1048576 2024-09-19T13:47:32.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.541+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0U9BUX9DHTAK.2~DURPAQ6D0XT5.1 size=1013331 2024-09-19T13:47:32.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.541+0000 7fcf3240c8c0 1 > prepared multipart upload key=0U9BUX9DHTAK upload=DURPAQ6D0XT5 tag=WCCDLRUGOCEA type=write size=3110483 2024-09-19T13:47:32.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.541+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=CNB0Y2QUWTJE type=del 2024-09-19T13:47:32.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.549+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~W8DUSWRNJWLD.0 size=1048576 2024-09-19T13:47:32.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.553+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~W8DUSWRNJWLD.1 size=804949 2024-09-19T13:47:32.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.553+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=W8DUSWRNJWLD tag=36A9DRTTE8AH type=write size=2902101 2024-09-19T13:47:32.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.557+0000 7fcf3240c8c0 1 < suggested remove operation key=71Z2VTW99W7J tag=EPTHDULFA10J type=del 2024-09-19T13:47:32.564 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.561+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=35IQUF97YL2U type=del size=982720 2024-09-19T13:47:32.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.565+0000 7fcf3240c8c0 1 < suggested update operation key=9ICCISYXT0IV tag=NBR3VQI0TBOM type=del size=1292151 2024-09-19T13:47:32.575 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.573+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~9YJ7D73X2TF7.0 size=1048576 2024-09-19T13:47:32.577 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.573+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~9YJ7D73X2TF7.1 size=507060 2024-09-19T13:47:32.577 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.573+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=9YJ7D73X2TF7 tag=NRT1KYN2WZQU type=write size=2604212 2024-09-19T13:47:32.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.577+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~VWCA1EPO3L5D.0 size=1048576 2024-09-19T13:47:32.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.581+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~VWCA1EPO3L5D.1 size=606427 2024-09-19T13:47:32.587 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.585+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=VWCA1EPO3L5D tag=0K8717DIPG6E type=write size=2703579 2024-09-19T13:47:32.591 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.589+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~8FCTD1VMMFFC.0 size=1048576 2024-09-19T13:47:32.593 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.589+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~8FCTD1VMMFFC.1 size=671808 2024-09-19T13:47:32.593 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.589+0000 7fcf3240c8c0 1 > prepared multipart upload key=6DFF2OCPT9W2 upload=8FCTD1VMMFFC tag=BDPZS2PST85Y type=write size=2768960 2024-09-19T13:47:32.596 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.593+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~ZC58X8BK9XOW.0 size=1048576 2024-09-19T13:47:32.599 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.597+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~ZC58X8BK9XOW.1 size=1048576 2024-09-19T13:47:32.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.597+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~ZC58X8BK9XOW.2 size=615741 2024-09-19T13:47:32.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.601+0000 7fcf3240c8c0 1 < completed multipart upload key=V8X0VBBNK83J upload=ZC58X8BK9XOW tag=91SRXH4JKSUB type=write size=3761469 2024-09-19T13:47:32.608 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.605+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=AOYGJN2MFABJ type=del size=2852485 2024-09-19T13:47:32.611 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.609+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~G7EGZF3W20MU.0 size=587511 2024-09-19T13:47:32.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.613+0000 7fcf3240c8c0 1 < completed multipart upload key=X16ENUFL40RN upload=G7EGZF3W20MU tag=J6UA476IDOC7 type=write size=1636087 2024-09-19T13:47:32.620 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.617+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~SJBITCCA6A9L.0 size=1048576 2024-09-19T13:47:32.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.621+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~SJBITCCA6A9L.1 size=1048576 2024-09-19T13:47:32.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.621+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~SJBITCCA6A9L.2 size=613685 2024-09-19T13:47:32.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.621+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=SJBITCCA6A9L tag=ZS33P7XXWHFA type=write size=3759413 2024-09-19T13:47:32.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.625+0000 7fcf3240c8c0 1 < completed delete operation key=XE42LV5M5X82 tag=6BCF0SYML5ON type=del 2024-09-19T13:47:32.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.629+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=0BD6HZYJIK1G type=write size=456942 2024-09-19T13:47:32.634 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.629+0000 7fcf3240c8c0 1 < completed delete operation key=N51Q6HKJSCCB tag=E4B8YS2614O1 type=del 2024-09-19T13:47:32.639 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.637+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=1ICXGARWNDZU type=write size=557712 2024-09-19T13:47:32.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.641+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~PGM1D9NOWAX2.0 size=458794 2024-09-19T13:47:32.647 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.645+0000 7fcf3240c8c0 1 < completed multipart upload key=QMSDNKYFFK1F upload=PGM1D9NOWAX2 tag=9GPJMBSPHLNW type=write size=1507370 2024-09-19T13:47:32.650 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.645+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=PB5K709X2G99 type=write size=762478 2024-09-19T13:47:32.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.649+0000 7fcf3240c8c0 1 < completed delete operation key=XE42LV5M5X82 tag=XE1QYNH8VSTY type=del 2024-09-19T13:47:32.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.653+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~7D3Y2BOQGAMC.0 size=878706 2024-09-19T13:47:32.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.653+0000 7fcf3240c8c0 1 > prepared multipart upload key=DHPONKOVS8CT upload=7D3Y2BOQGAMC tag=QTL0UX0ISY9U type=write size=1927282 2024-09-19T13:47:32.660 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.657+0000 7fcf3240c8c0 1 < completed delete operation key=BXUPV5XSJBTH tag=3KBFHKRDL4LM type=del 2024-09-19T13:47:32.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.661+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=VJEP5GTWY7T0 type=write size=698977 2024-09-19T13:47:32.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.661+0000 7fcf3240c8c0 1 < completed delete operation key=HXMZKP7H3HJE tag=ERWXU8XMSFQP type=del 2024-09-19T13:47:32.667 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.665+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=HTBHE1RW3B1R type=del size=3528810 2024-09-19T13:47:32.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.665+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~XHEW4SL2LQL4.0 size=416054 2024-09-19T13:47:32.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.669+0000 7fcf3240c8c0 1 < completed multipart upload key=6DFF2OCPT9W2 upload=XHEW4SL2LQL4 tag=N5DAG6YE4MLO type=write size=1464630 2024-09-19T13:47:32.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.673+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=GQ3ZXIM22GVA type=del size=2928314 2024-09-19T13:47:32.682 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.677+0000 7fcf3240c8c0 1 < suggested update operation key=9ICCISYXT0IV tag=B360M479O9NU type=del size=3387527 2024-09-19T13:47:32.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.681+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=N7Y8WNVAH1YY type=del size=3209981 2024-09-19T13:47:32.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.685+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=FRMY7YEEW8G1 type=del 2024-09-19T13:47:32.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.685+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=8HSCP7NG4K0X type=del size=2700537 2024-09-19T13:47:32.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.689+0000 7fcf3240c8c0 1 < completed part key=_multipart_0U9BUX9DHTAK.2~DURPAQ6D0XT5.0 size=1048576 2024-09-19T13:47:32.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.693+0000 7fcf3240c8c0 1 < completed part key=_multipart_0U9BUX9DHTAK.2~DURPAQ6D0XT5.1 size=1013331 2024-09-19T13:47:32.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.697+0000 7fcf3240c8c0 1 < completed multipart upload key=0U9BUX9DHTAK upload=DURPAQ6D0XT5 tag=WCCDLRUGOCEA type=write size=3110483 2024-09-19T13:47:32.704 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.701+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~5JI9F7LCXJU2.0 size=1048576 2024-09-19T13:47:32.707 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.705+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~5JI9F7LCXJU2.1 size=1048576 2024-09-19T13:47:32.709 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.705+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~5JI9F7LCXJU2.2 size=66834 2024-09-19T13:47:32.709 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.705+0000 7fcf3240c8c0 1 > prepared multipart upload key=STMT6XU2EJQM upload=5JI9F7LCXJU2 tag=B52QWPS6SVVF type=write size=3212562 2024-09-19T13:47:32.713 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.709+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~W8DUSWRNJWLD.0 size=1048576 2024-09-19T13:47:32.715 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.713+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~W8DUSWRNJWLD.1 size=804949 2024-09-19T13:47:32.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.717+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=W8DUSWRNJWLD tag=36A9DRTTE8AH type=write size=2902101 2024-09-19T13:47:32.722 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.717+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=WG47N7FR1NPE type=del size=1213909 2024-09-19T13:47:32.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.721+0000 7fcf3240c8c0 1 < completed delete operation key=0U9BUX9DHTAK tag=35IQUF97YL2U type=del 2024-09-19T13:47:32.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.725+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=HVHDJJYXWGQ9 type=del size=3445282 2024-09-19T13:47:32.730 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.729+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~9YJ7D73X2TF7.0 size=1048576 2024-09-19T13:47:32.733 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.729+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~9YJ7D73X2TF7.1 size=507060 2024-09-19T13:47:32.737 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.733+0000 7fcf3240c8c0 1 < completed multipart upload key=ZCKKQ1R8318S upload=9YJ7D73X2TF7 tag=NRT1KYN2WZQU type=write size=2604212 2024-09-19T13:47:32.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.737+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=TW9S6KW10RC5 type=write size=328177 2024-09-19T13:47:32.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.737+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~8FCTD1VMMFFC.0 size=1048576 2024-09-19T13:47:32.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.741+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~8FCTD1VMMFFC.1 size=671808 2024-09-19T13:47:32.748 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.745+0000 7fcf3240c8c0 1 < completed multipart upload key=6DFF2OCPT9W2 upload=8FCTD1VMMFFC tag=BDPZS2PST85Y type=write size=2768960 2024-09-19T13:47:32.751 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.749+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=ZBU8WCUY2RSS type=del size=3809660 2024-09-19T13:47:32.754 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.749+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=AOYGJN2MFABJ type=del 2024-09-19T13:47:32.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.753+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=8UUP0HO39C0G type=del size=1240685 2024-09-19T13:47:32.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.757+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~SJBITCCA6A9L.0 size=1048576 2024-09-19T13:47:32.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.757+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~SJBITCCA6A9L.1 size=1048576 2024-09-19T13:47:32.764 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.761+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~SJBITCCA6A9L.2 size=613685 2024-09-19T13:47:32.768 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.765+0000 7fcf3240c8c0 1 < completed multipart upload key=QMSDNKYFFK1F upload=SJBITCCA6A9L tag=ZS33P7XXWHFA type=write size=3759413 2024-09-19T13:47:32.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.769+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=N2KRBDSH19HE type=write size=715469 2024-09-19T13:47:32.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.769+0000 7fcf3240c8c0 1 < completed write operation key=V8X0VBBNK83J tag=0BD6HZYJIK1G type=write size=456942 2024-09-19T13:47:32.778 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.777+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~LMR1WJRWMI4H.0 size=47916 2024-09-19T13:47:32.778 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.777+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=LMR1WJRWMI4H tag=HW3I6YQVBOMM type=write size=1096492 2024-09-19T13:47:32.784 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.781+0000 7fcf3240c8c0 1 < suggested update operation key=C3TFYNXH549T tag=1ICXGARWNDZU type=write size=557712 2024-09-19T13:47:32.786 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.785+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=8EBH326EYHGB type=del size=133605 2024-09-19T13:47:32.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.785+0000 7fcf3240c8c0 1 < completed write operation key=STMT6XU2EJQM tag=PB5K709X2G99 type=write size=762478 2024-09-19T13:47:32.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.789+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=FS7GVKYB0CYN type=write size=477961 2024-09-19T13:47:32.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.793+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~7D3Y2BOQGAMC.0 size=878706 2024-09-19T13:47:32.799 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.797+0000 7fcf3240c8c0 1 < completed multipart upload key=DHPONKOVS8CT upload=7D3Y2BOQGAMC tag=QTL0UX0ISY9U type=write size=1927282 2024-09-19T13:47:32.802 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.797+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=D4VERX3QOPSE type=del size=264094 2024-09-19T13:47:32.807 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.805+0000 7fcf3240c8c0 1 < suggested update operation key=X9FGPMP30X47 tag=VJEP5GTWY7T0 type=write size=698977 2024-09-19T13:47:32.812 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.809+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~KAYAEYZFXCS3.0 size=1048576 2024-09-19T13:47:32.814 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.809+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~KAYAEYZFXCS3.1 size=1048576 2024-09-19T13:47:32.816 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.813+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~KAYAEYZFXCS3.2 size=366558 2024-09-19T13:47:32.816 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.813+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=KAYAEYZFXCS3 tag=THKB0ABXKZD3 type=write size=3512286 2024-09-19T13:47:32.819 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.817+0000 7fcf3240c8c0 1 < completed delete operation key=3TME221SA53E tag=HTBHE1RW3B1R type=del 2024-09-19T13:47:32.824 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.821+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~HMMXGTDK8IV2.0 size=309304 2024-09-19T13:47:32.824 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.821+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=HMMXGTDK8IV2 tag=BAMAFQJ7WZ4O type=write size=1357880 2024-09-19T13:47:32.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.825+0000 7fcf3240c8c0 1 < completed delete operation key=HXMZKP7H3HJE tag=GQ3ZXIM22GVA type=del 2024-09-19T13:47:32.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.825+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=TSJ2X219MB95 type=del size=472586 2024-09-19T13:47:32.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.829+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=N7Y8WNVAH1YY type=del 2024-09-19T13:47:32.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.833+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=F5PE6O3DQ0AP type=del size=1836627 2024-09-19T13:47:32.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.837+0000 7fcf3240c8c0 1 < suggested update operation key=D1RMXGXS3O7Z tag=8HSCP7NG4K0X type=del size=2700537 2024-09-19T13:47:32.843 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.841+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=D2ZZCISFWH1J type=write size=580395 2024-09-19T13:47:32.846 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.841+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~5JI9F7LCXJU2.0 size=1048576 2024-09-19T13:47:32.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.845+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~5JI9F7LCXJU2.1 size=1048576 2024-09-19T13:47:32.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.845+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~5JI9F7LCXJU2.2 size=66834 2024-09-19T13:47:32.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.853+0000 7fcf3240c8c0 1 < completed multipart upload key=STMT6XU2EJQM upload=5JI9F7LCXJU2 tag=B52QWPS6SVVF type=write size=3212562 2024-09-19T13:47:32.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.853+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=YRQD9NOTQBP9 type=del size=3602089 2024-09-19T13:47:32.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.857+0000 7fcf3240c8c0 1 < completed delete operation key=X16ENUFL40RN tag=WG47N7FR1NPE type=del 2024-09-19T13:47:32.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.861+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~X7U62EX6EOJ1.0 size=1048576 2024-09-19T13:47:32.866 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.865+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~X7U62EX6EOJ1.1 size=1048576 2024-09-19T13:47:32.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.865+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~X7U62EX6EOJ1.2 size=967890 2024-09-19T13:47:32.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.865+0000 7fcf3240c8c0 1 > prepared multipart upload key=V8X0VBBNK83J upload=X7U62EX6EOJ1 tag=RJY8G4Q5P4S4 type=write size=4113618 2024-09-19T13:47:32.871 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.869+0000 7fcf3240c8c0 1 < completed delete operation key=ZCKKQ1R8318S tag=HVHDJJYXWGQ9 type=del 2024-09-19T13:47:32.874 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.869+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=DDLCIEKI4PKC type=write size=748096 2024-09-19T13:47:32.877 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.873+0000 7fcf3240c8c0 1 < completed write operation key=QAYJ5B1KZ08J tag=TW9S6KW10RC5 type=write size=328177 2024-09-19T13:47:32.879 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.877+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=55DZA4GQR8SN type=del size=1896827 2024-09-19T13:47:32.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.881+0000 7fcf3240c8c0 -1 < failed to complete operation key=X9FGPMP30X47 tag=ZBU8WCUY2RSS type=del size=3809660: (22) Invalid argument 2024-09-19T13:47:32.887 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.885+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~X929HXQ07DNN.0 size=1003364 2024-09-19T13:47:32.887 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.885+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=X929HXQ07DNN tag=0AFN0V3GXT8Q type=write size=2051940 2024-09-19T13:47:32.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.893+0000 7fcf3240c8c0 1 < suggested remove operation key=3TME221SA53E tag=8UUP0HO39C0G type=del 2024-09-19T13:47:32.899 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.897+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=TSDPFRRHY0XM type=del size=2872112 2024-09-19T13:47:32.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.897+0000 7fcf3240c8c0 -1 < failed to complete operation key=X9FGPMP30X47 tag=N2KRBDSH19HE type=write size=715469: (22) Invalid argument 2024-09-19T13:47:32.906 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.901+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~SEQ8QI18GZ2H.0 size=659717 2024-09-19T13:47:32.906 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.901+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=SEQ8QI18GZ2H tag=6KLMJ47QQPPL type=write size=1708293 2024-09-19T13:47:32.909 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.905+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~LMR1WJRWMI4H.0 size=47916 2024-09-19T13:47:32.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.909+0000 7fcf3240c8c0 1 < completed multipart upload key=XE42LV5M5X82 upload=LMR1WJRWMI4H tag=HW3I6YQVBOMM type=write size=1096492 2024-09-19T13:47:32.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.913+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=LKQRN38M2XK6 type=del size=2122462 2024-09-19T13:47:32.919 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.917+0000 7fcf3240c8c0 -1 < failed to complete operation key=X9FGPMP30X47 tag=8EBH326EYHGB type=del size=133605: (22) Invalid argument 2024-09-19T13:47:32.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.917+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=XBBVJHZUIVMD type=del size=1349923 2024-09-19T13:47:32.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.921+0000 7fcf3240c8c0 1 < completed write operation key=QSM2Q8CW1Q86 tag=FS7GVKYB0CYN type=write size=477961 2024-09-19T13:47:32.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.925+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=3N1A3G2LT4CL type=del size=1452897 2024-09-19T13:47:32.930 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.925+0000 7fcf3240c8c0 -1 < failed to complete operation key=X9FGPMP30X47 tag=D4VERX3QOPSE type=del size=264094: (22) Invalid argument 2024-09-19T13:47:32.933 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.929+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=93YDYSPWYNMY type=del size=916859 2024-09-19T13:47:32.936 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.933+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~KAYAEYZFXCS3.0 size=1048576 2024-09-19T13:47:32.938 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.933+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~KAYAEYZFXCS3.1 size=1048576 2024-09-19T13:47:32.940 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.937+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~KAYAEYZFXCS3.2 size=366558 2024-09-19T13:47:32.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.941+0000 7fcf3240c8c0 1 < completed multipart upload key=XE42LV5M5X82 upload=KAYAEYZFXCS3 tag=THKB0ABXKZD3 type=write size=3512286 2024-09-19T13:47:32.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.949+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~4UHXLJ0LVUNB.0 size=318247 2024-09-19T13:47:32.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.949+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=4UHXLJ0LVUNB tag=J6THV2XK2390 type=write size=1366823 2024-09-19T13:47:32.955 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.953+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~HMMXGTDK8IV2.0 size=309304 2024-09-19T13:47:32.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.957+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=HMMXGTDK8IV2 tag=BAMAFQJ7WZ4O type=write size=1357880 2024-09-19T13:47:32.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.961+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=OAXJPH4S22D7 type=write size=493531 2024-09-19T13:47:32.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.965+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=TSJ2X219MB95 type=del 2024-09-19T13:47:32.975 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.973+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~SCHIIPA3FSOC.0 size=1048576 2024-09-19T13:47:32.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.973+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~SCHIIPA3FSOC.1 size=1048576 2024-09-19T13:47:32.981 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.977+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~SCHIIPA3FSOC.2 size=911134 2024-09-19T13:47:32.981 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.977+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=SCHIIPA3FSOC tag=P4TYXQZQL9AQ type=write size=4056862 2024-09-19T13:47:32.985 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.981+0000 7fcf3240c8c0 1 < completed delete operation key=XE42LV5M5X82 tag=F5PE6O3DQ0AP type=del 2024-09-19T13:47:32.988 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.985+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=0QIUM3JZVTNN type=write size=274441 2024-09-19T13:47:32.991 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.989+0000 7fcf3240c8c0 1 < completed write operation key=HXMZKP7H3HJE tag=D2ZZCISFWH1J type=write size=580395 2024-09-19T13:47:32.995 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.993+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=100W92H7C2CI type=del size=1522223 2024-09-19T13:47:32.999 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:32.997+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=YRQD9NOTQBP9 type=del 2024-09-19T13:47:33.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.001+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=FIIDKOVMGPZ1 type=del size=1966885 2024-09-19T13:47:33.006 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.001+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~X7U62EX6EOJ1.0 size=1048576 2024-09-19T13:47:33.009 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.005+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~X7U62EX6EOJ1.1 size=1048576 2024-09-19T13:47:33.011 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.009+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~X7U62EX6EOJ1.2 size=967890 2024-09-19T13:47:33.017 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.013+0000 7fcf3240c8c0 1 < completed multipart upload key=V8X0VBBNK83J upload=X7U62EX6EOJ1 tag=RJY8G4Q5P4S4 type=write size=4113618 2024-09-19T13:47:33.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.021+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~62XYGYOU9DE2.0 size=854560 2024-09-19T13:47:33.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.021+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=62XYGYOU9DE2 tag=HD0FGBVSPP0M type=write size=1903136 2024-09-19T13:47:33.030 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.025+0000 7fcf3240c8c0 1 < suggested update operation key=ES62XJO5Q3FO tag=DDLCIEKI4PKC type=write size=748096 2024-09-19T13:47:33.033 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.029+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=MN429ZQF7NOG type=del size=895975 2024-09-19T13:47:33.040 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.037+0000 7fcf3240c8c0 1 < suggested remove operation key=QMSDNKYFFK1F tag=55DZA4GQR8SN type=del 2024-09-19T13:47:33.044 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.041+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=F47UJSQPJKY3 type=del size=557007 2024-09-19T13:47:33.048 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.045+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~X929HXQ07DNN.0 size=1003364 2024-09-19T13:47:33.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.049+0000 7fcf3240c8c0 1 < completed multipart upload key=XE42LV5M5X82 upload=X929HXQ07DNN tag=0AFN0V3GXT8Q type=write size=2051940 2024-09-19T13:47:33.061 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.057+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~7VMJ3KZM2JN6.0 size=1048576 2024-09-19T13:47:33.063 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.061+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~7VMJ3KZM2JN6.1 size=1048576 2024-09-19T13:47:33.065 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.061+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~7VMJ3KZM2JN6.2 size=255546 2024-09-19T13:47:33.065 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.061+0000 7fcf3240c8c0 1 > prepared multipart upload key=X16ENUFL40RN upload=7VMJ3KZM2JN6 tag=XOHKTPD08C72 type=write size=3401274 2024-09-19T13:47:33.068 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.065+0000 7fcf3240c8c0 1 < completed delete operation key=0U9BUX9DHTAK tag=TSDPFRRHY0XM type=del 2024-09-19T13:47:33.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.069+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=DM67ZUX2LN6B type=del size=72193 2024-09-19T13:47:33.074 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.069+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~SEQ8QI18GZ2H.0 size=659717 2024-09-19T13:47:33.079 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.077+0000 7fcf3240c8c0 1 < completed multipart upload key=XE42LV5M5X82 upload=SEQ8QI18GZ2H tag=6KLMJ47QQPPL type=write size=1708293 2024-09-19T13:47:33.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.077+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=RQVK8EI4JGSH type=del size=2717221 2024-09-19T13:47:33.085 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.081+0000 7fcf3240c8c0 1 < completed delete operation key=1BMF3S2BZLLI tag=LKQRN38M2XK6 type=del 2024-09-19T13:47:33.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.085+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=OUW0Y0KJPYV0 type=del size=1555429 2024-09-19T13:47:33.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.089+0000 7fcf3240c8c0 1 < completed delete operation key=D20C6C2ZFX1W tag=XBBVJHZUIVMD type=del 2024-09-19T13:47:33.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.093+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~OMETZAUNYO36.0 size=1048576 2024-09-19T13:47:33.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.097+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~OMETZAUNYO36.1 size=1048576 2024-09-19T13:47:33.101 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.097+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~OMETZAUNYO36.2 size=889494 2024-09-19T13:47:33.101 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.097+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=OMETZAUNYO36 tag=CCQOTJAUYCEJ type=write size=4035222 2024-09-19T13:47:33.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.101+0000 7fcf3240c8c0 1 < completed delete operation key=X9FGPMP30X47 tag=3N1A3G2LT4CL type=del 2024-09-19T13:47:33.107 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.105+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=29UNAO6V0YAZ type=del size=653612 2024-09-19T13:47:33.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.109+0000 7fcf3240c8c0 1 < completed delete operation key=1BMF3S2BZLLI tag=93YDYSPWYNMY type=del 2024-09-19T13:47:33.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.109+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=ECLEK3IGLAEQ type=del size=3479318 2024-09-19T13:47:33.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.113+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~4UHXLJ0LVUNB.0 size=318247 2024-09-19T13:47:33.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.117+0000 7fcf3240c8c0 1 < completed multipart upload key=NP2L28YRVQ8L upload=4UHXLJ0LVUNB tag=J6THV2XK2390 type=write size=1366823 2024-09-19T13:47:33.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.121+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~PC1JJ32XD24O.0 size=102725 2024-09-19T13:47:33.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.121+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=PC1JJ32XD24O tag=K040GM2AAR8H type=write size=1151301 2024-09-19T13:47:33.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.125+0000 7fcf3240c8c0 1 < completed write operation key=DHPONKOVS8CT tag=OAXJPH4S22D7 type=write size=493531 2024-09-19T13:47:33.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.129+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=3QUH7U69MZ85 type=del size=1200143 2024-09-19T13:47:33.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.129+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~SCHIIPA3FSOC.0 size=1048576 2024-09-19T13:47:33.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.133+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~SCHIIPA3FSOC.1 size=1048576 2024-09-19T13:47:33.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.133+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~SCHIIPA3FSOC.2 size=911134 2024-09-19T13:47:33.143 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.141+0000 7fcf3240c8c0 1 < completed multipart upload key=ZCKKQ1R8318S upload=SCHIIPA3FSOC tag=P4TYXQZQL9AQ type=write size=4056862 2024-09-19T13:47:33.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.141+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=Y3VCZLKUTUAI type=write size=507759 2024-09-19T13:47:33.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.145+0000 7fcf3240c8c0 1 < completed write operation key=A02RDP6BA9AC tag=0QIUM3JZVTNN type=write size=274441 2024-09-19T13:47:33.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.153+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~EU4P6DQVLYJB.0 size=1048576 2024-09-19T13:47:33.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.153+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~EU4P6DQVLYJB.1 size=892833 2024-09-19T13:47:33.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.153+0000 7fcf3240c8c0 1 > prepared multipart upload key=3TME221SA53E upload=EU4P6DQVLYJB tag=51KC4EKOA7PV type=write size=2989985 2024-09-19T13:47:33.160 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.157+0000 7fcf3240c8c0 1 < completed delete operation key=D1RMXGXS3O7Z tag=100W92H7C2CI type=del 2024-09-19T13:47:33.165 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.161+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~PX6XNTEM3XKH.0 size=1048576 2024-09-19T13:47:33.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.165+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~PX6XNTEM3XKH.1 size=111390 2024-09-19T13:47:33.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.165+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=PX6XNTEM3XKH tag=QPXEAFZJ3CTG type=write size=2208542 2024-09-19T13:47:33.171 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.169+0000 7fcf3240c8c0 1 < completed delete operation key=M2CO4A2DHJ05 tag=FIIDKOVMGPZ1 type=del 2024-09-19T13:47:33.174 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.173+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=M5FEEJ2S3C91 type=del size=3216489 2024-09-19T13:47:33.178 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.173+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~62XYGYOU9DE2.0 size=854560 2024-09-19T13:47:33.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.181+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=62XYGYOU9DE2 tag=HD0FGBVSPP0M type=write size=1903136 2024-09-19T13:47:33.188 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.185+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=JU0GKLVYB270 type=write size=670915 2024-09-19T13:47:33.194 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.193+0000 7fcf3240c8c0 1 < suggested update operation key=0UCFTOF1YBBM tag=MN429ZQF7NOG type=del size=895975 2024-09-19T13:47:33.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.197+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~33E6XMO0ZYXB.0 size=1048576 2024-09-19T13:47:33.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.201+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~33E6XMO0ZYXB.1 size=1048576 2024-09-19T13:47:33.206 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.201+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~33E6XMO0ZYXB.2 size=82800 2024-09-19T13:47:33.206 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.201+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=33E6XMO0ZYXB tag=56H3UU2R91TK type=write size=3228528 2024-09-19T13:47:33.210 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.205+0000 7fcf3240c8c0 1 < completed delete operation key=STMT6XU2EJQM tag=F47UJSQPJKY3 type=del 2024-09-19T13:47:33.215 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.213+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~BYP0PDGQUELP.0 size=484821 2024-09-19T13:47:33.216 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.213+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=BYP0PDGQUELP tag=37M6SG1FJ6EM type=write size=1533397 2024-09-19T13:47:33.218 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.217+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~7VMJ3KZM2JN6.0 size=1048576 2024-09-19T13:47:33.221 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.217+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~7VMJ3KZM2JN6.1 size=1048576 2024-09-19T13:47:33.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.221+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~7VMJ3KZM2JN6.2 size=255546 2024-09-19T13:47:33.228 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.225+0000 7fcf3240c8c0 1 < completed multipart upload key=X16ENUFL40RN upload=7VMJ3KZM2JN6 tag=XOHKTPD08C72 type=write size=3401274 2024-09-19T13:47:33.231 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.229+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=RQYXOPSDPS5O type=write size=868153 2024-09-19T13:47:33.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.229+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=DM67ZUX2LN6B type=del 2024-09-19T13:47:33.239 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.237+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~1KWGBAO3YYY7.0 size=1048576 2024-09-19T13:47:33.242 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.237+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~1KWGBAO3YYY7.1 size=1048576 2024-09-19T13:47:33.244 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.241+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~1KWGBAO3YYY7.2 size=470588 2024-09-19T13:47:33.244 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.241+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=1KWGBAO3YYY7 tag=QKUTG8PHYWMJ type=write size=3616316 2024-09-19T13:47:33.247 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.245+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=RQVK8EI4JGSH type=del 2024-09-19T13:47:33.250 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.245+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=8ZEXJSJN56W4 type=del size=2883050 2024-09-19T13:47:33.256 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.253+0000 7fcf3240c8c0 1 < suggested update operation key=N51Q6HKJSCCB tag=OUW0Y0KJPYV0 type=del size=1555429 2024-09-19T13:47:33.262 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.257+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~81SEC6DZ6LYP.0 size=1048576 2024-09-19T13:47:33.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.261+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~81SEC6DZ6LYP.1 size=409462 2024-09-19T13:47:33.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.261+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=81SEC6DZ6LYP tag=EPTEWB4J8H4M type=write size=2506614 2024-09-19T13:47:33.267 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.265+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~OMETZAUNYO36.0 size=1048576 2024-09-19T13:47:33.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.265+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~OMETZAUNYO36.1 size=1048576 2024-09-19T13:47:33.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.269+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~OMETZAUNYO36.2 size=889494 2024-09-19T13:47:33.278 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.273+0000 7fcf3240c8c0 1 < completed multipart upload key=XE42LV5M5X82 upload=OMETZAUNYO36 tag=CCQOTJAUYCEJ type=write size=4035222 2024-09-19T13:47:33.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.277+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=7G4VE5EOL4Q9 type=write size=40073 2024-09-19T13:47:33.288 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.285+0000 7fcf3240c8c0 1 < suggested remove operation key=X16ENUFL40RN tag=29UNAO6V0YAZ type=del 2024-09-19T13:47:33.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.289+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~P6OL24LLB1OS.0 size=1048576 2024-09-19T13:47:33.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.293+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~P6OL24LLB1OS.1 size=141841 2024-09-19T13:47:33.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.293+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=P6OL24LLB1OS tag=O9OHP6D0VFE3 type=write size=2238993 2024-09-19T13:47:33.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.297+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=ECLEK3IGLAEQ type=del 2024-09-19T13:47:33.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.301+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=2XZIMXQ8LY2Q type=del size=1989886 2024-09-19T13:47:33.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.301+0000 7fcf3240c8c0 1 < canceled part key=_multipart_M2CO4A2DHJ05.2~PC1JJ32XD24O.0 size=102725 2024-09-19T13:47:33.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.305+0000 7fcf3240c8c0 1 < canceled multipart upload key=M2CO4A2DHJ05 upload=PC1JJ32XD24O tag=K040GM2AAR8H type=write size=1151301 2024-09-19T13:47:33.315 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.313+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~ZEBMNM85HLYY.0 size=1048576 2024-09-19T13:47:33.318 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.313+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~ZEBMNM85HLYY.1 size=1048576 2024-09-19T13:47:33.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.317+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~ZEBMNM85HLYY.2 size=495961 2024-09-19T13:47:33.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.317+0000 7fcf3240c8c0 1 > prepared multipart upload key=71Z2VTW99W7J upload=ZEBMNM85HLYY tag=MYPQWOQWXSO0 type=write size=3641689 2024-09-19T13:47:33.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.321+0000 7fcf3240c8c0 1 < suggested update operation key=C3TFYNXH549T tag=3QUH7U69MZ85 type=del size=1200143 2024-09-19T13:47:33.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.329+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~IKL8ML9AMUZ1.0 size=1048576 2024-09-19T13:47:33.332 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.329+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~IKL8ML9AMUZ1.1 size=1048576 2024-09-19T13:47:33.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.333+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~IKL8ML9AMUZ1.2 size=1006743 2024-09-19T13:47:33.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.333+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=IKL8ML9AMUZ1 tag=SL8IV5KQTP1X type=write size=4152471 2024-09-19T13:47:33.337 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.333+0000 7fcf3240c8c0 1 < completed write operation key=ZCKKQ1R8318S tag=Y3VCZLKUTUAI type=write size=507759 2024-09-19T13:47:33.342 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.341+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~FR2FKIE1N57C.0 size=1048576 2024-09-19T13:47:33.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.341+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~FR2FKIE1N57C.1 size=153464 2024-09-19T13:47:33.345 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.341+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=FR2FKIE1N57C tag=NE8I00U1627B type=write size=2250616 2024-09-19T13:47:33.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.345+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~EU4P6DQVLYJB.0 size=1048576 2024-09-19T13:47:33.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.345+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~EU4P6DQVLYJB.1 size=892833 2024-09-19T13:47:33.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.353+0000 7fcf3240c8c0 1 < completed multipart upload key=3TME221SA53E upload=EU4P6DQVLYJB tag=51KC4EKOA7PV type=write size=2989985 2024-09-19T13:47:33.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.353+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=B740JZAF2PCT type=del size=2713033 2024-09-19T13:47:33.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.357+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~PX6XNTEM3XKH.0 size=1048576 2024-09-19T13:47:33.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.361+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~PX6XNTEM3XKH.1 size=111390 2024-09-19T13:47:33.367 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.365+0000 7fcf3240c8c0 1 < completed multipart upload key=M2CO4A2DHJ05 upload=PX6XNTEM3XKH tag=QPXEAFZJ3CTG type=write size=2208542 2024-09-19T13:47:33.370 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.365+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=MMMGMDX30E5A type=del size=3392204 2024-09-19T13:47:33.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.369+0000 7fcf3240c8c0 1 < completed delete operation key=71Z2VTW99W7J tag=M5FEEJ2S3C91 type=del 2024-09-19T13:47:33.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.377+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=7ZOMQMLR6HFG type=del size=264807 2024-09-19T13:47:33.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.381+0000 7fcf3240c8c0 1 < canceled operation key=D1RMXGXS3O7Z tag=JU0GKLVYB270 type=write size=670915 2024-09-19T13:47:33.388 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.385+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~KFWHSCP249H4.0 size=924536 2024-09-19T13:47:33.388 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.385+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=KFWHSCP249H4 tag=HJ1XA4NTBCWP type=write size=1973112 2024-09-19T13:47:33.388 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.385+0000 7fcf3240c8c0 1 < canceled part key=_multipart_NP2L28YRVQ8L.2~33E6XMO0ZYXB.0 size=1048576 2024-09-19T13:47:33.388 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.385+0000 7fcf3240c8c0 1 < canceled part key=_multipart_NP2L28YRVQ8L.2~33E6XMO0ZYXB.1 size=1048576 2024-09-19T13:47:33.390 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.389+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~33E6XMO0ZYXB.2 size=82800 2024-09-19T13:47:33.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.393+0000 7fcf3240c8c0 1 < canceled multipart upload key=NP2L28YRVQ8L upload=33E6XMO0ZYXB tag=56H3UU2R91TK type=write size=3228528 2024-09-19T13:47:33.399 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.397+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=8MT90DV27V86 type=del size=3709175 2024-09-19T13:47:33.399 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.397+0000 7fcf3240c8c0 1 < canceled part key=_multipart_7UC85R2HO9K2.2~BYP0PDGQUELP.0 size=484821 2024-09-19T13:47:33.404 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.401+0000 7fcf3240c8c0 1 < canceled multipart upload key=7UC85R2HO9K2 upload=BYP0PDGQUELP tag=37M6SG1FJ6EM type=write size=1533397 2024-09-19T13:47:33.407 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.405+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=Z3N3AG6MZZF7 type=del size=3277411 2024-09-19T13:47:33.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.409+0000 7fcf3240c8c0 1 < suggested remove operation key=9ICCISYXT0IV tag=RQYXOPSDPS5O type=write 2024-09-19T13:47:33.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.413+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=MFMJRHMNL81K type=del size=16774 2024-09-19T13:47:33.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.413+0000 7fcf3240c8c0 1 < canceled part key=_multipart_N51Q6HKJSCCB.2~1KWGBAO3YYY7.0 size=1048576 2024-09-19T13:47:33.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.413+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~1KWGBAO3YYY7.1 size=1048576 2024-09-19T13:47:33.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.413+0000 7fcf3240c8c0 1 < canceled part key=_multipart_N51Q6HKJSCCB.2~1KWGBAO3YYY7.2 size=470588 2024-09-19T13:47:33.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.417+0000 7fcf3240c8c0 1 < canceled multipart upload key=N51Q6HKJSCCB upload=1KWGBAO3YYY7 tag=QKUTG8PHYWMJ type=write size=3616316 2024-09-19T13:47:33.424 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.421+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=X82G6N25FY45 type=del size=2370727 2024-09-19T13:47:33.429 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.425+0000 7fcf3240c8c0 1 < suggested update operation key=N51Q6HKJSCCB tag=8ZEXJSJN56W4 type=del size=2883050 2024-09-19T13:47:33.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.429+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~ISUH6UHXW6SU.0 size=1048576 2024-09-19T13:47:33.436 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.433+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~ISUH6UHXW6SU.1 size=314753 2024-09-19T13:47:33.436 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.433+0000 7fcf3240c8c0 1 > prepared multipart upload key=X9FGPMP30X47 upload=ISUH6UHXW6SU tag=SPM87IQPE7MB type=write size=2411905 2024-09-19T13:47:33.439 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.437+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~81SEC6DZ6LYP.0 size=1048576 2024-09-19T13:47:33.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.437+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~81SEC6DZ6LYP.1 size=409462 2024-09-19T13:47:33.445 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.441+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=81SEC6DZ6LYP tag=EPTEWB4J8H4M type=write size=2506614 2024-09-19T13:47:33.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.445+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=QWVB6NHYK4OV type=del size=1793228 2024-09-19T13:47:33.450 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.449+0000 7fcf3240c8c0 1 < completed write operation key=QSM2Q8CW1Q86 tag=7G4VE5EOL4Q9 type=write size=40073 2024-09-19T13:47:33.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.449+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=WXZA8N826AMW type=del size=269241 2024-09-19T13:47:33.455 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.453+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~P6OL24LLB1OS.0 size=1048576 2024-09-19T13:47:33.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.457+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~P6OL24LLB1OS.1 size=141841 2024-09-19T13:47:33.464 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.461+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=P6OL24LLB1OS tag=O9OHP6D0VFE3 type=write size=2238993 2024-09-19T13:47:33.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.465+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=5H8A8F5CBS93 type=del size=4153802 2024-09-19T13:47:33.471 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.469+0000 7fcf3240c8c0 1 < suggested update operation key=QSM2Q8CW1Q86 tag=2XZIMXQ8LY2Q type=del size=1989886 2024-09-19T13:47:33.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.469+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=JJO5QQYB4F89 type=del size=799919 2024-09-19T13:47:33.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.473+0000 7fcf3240c8c0 1 < canceled part key=_multipart_71Z2VTW99W7J.2~ZEBMNM85HLYY.0 size=1048576 2024-09-19T13:47:33.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.473+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~ZEBMNM85HLYY.1 size=1048576 2024-09-19T13:47:33.478 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.473+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~ZEBMNM85HLYY.2 size=495961 2024-09-19T13:47:33.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.477+0000 7fcf3240c8c0 1 < canceled multipart upload key=71Z2VTW99W7J upload=ZEBMNM85HLYY tag=MYPQWOQWXSO0 type=write size=3641689 2024-09-19T13:47:33.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.485+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~FF1SNLLB0OC0.0 size=309080 2024-09-19T13:47:33.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.485+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=FF1SNLLB0OC0 tag=N8YXYRP6DL1Q type=write size=1357656 2024-09-19T13:47:33.490 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.485+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~IKL8ML9AMUZ1.0 size=1048576 2024-09-19T13:47:33.492 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.489+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~IKL8ML9AMUZ1.1 size=1048576 2024-09-19T13:47:33.492 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.489+0000 7fcf3240c8c0 1 < canceled part key=_multipart_NP2L28YRVQ8L.2~IKL8ML9AMUZ1.2 size=1006743 2024-09-19T13:47:33.496 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.493+0000 7fcf3240c8c0 1 < canceled multipart upload key=NP2L28YRVQ8L upload=IKL8ML9AMUZ1 tag=SL8IV5KQTP1X type=write size=4152471 2024-09-19T13:47:33.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.497+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~ZVM4REW7GQRW.0 size=1048576 2024-09-19T13:47:33.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.501+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~ZVM4REW7GQRW.1 size=1048576 2024-09-19T13:47:33.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.501+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~ZVM4REW7GQRW.2 size=630624 2024-09-19T13:47:33.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.501+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=ZVM4REW7GQRW tag=YCYUOD91LAL2 type=write size=3776352 2024-09-19T13:47:33.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.505+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~FR2FKIE1N57C.0 size=1048576 2024-09-19T13:47:33.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.505+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~FR2FKIE1N57C.1 size=153464 2024-09-19T13:47:33.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.509+0000 7fcf3240c8c0 1 < completed multipart upload key=0UCFTOF1YBBM upload=FR2FKIE1N57C tag=NE8I00U1627B type=write size=2250616 2024-09-19T13:47:33.516 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.513+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=XAHDJWH46NMY type=del size=1501612 2024-09-19T13:47:33.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.517+0000 7fcf3240c8c0 1 < completed delete operation key=3TME221SA53E tag=B740JZAF2PCT type=del 2024-09-19T13:47:33.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.521+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~SY2THMM9MN9H.0 size=589776 2024-09-19T13:47:33.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.521+0000 7fcf3240c8c0 1 > prepared multipart upload key=D1RMXGXS3O7Z upload=SY2THMM9MN9H tag=SKEGIELJJUKN type=write size=1638352 2024-09-19T13:47:33.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.525+0000 7fcf3240c8c0 1 < suggested remove operation key=QSM2Q8CW1Q86 tag=MMMGMDX30E5A type=del 2024-09-19T13:47:33.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.529+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~2UWPB8TY55VE.0 size=1048576 2024-09-19T13:47:33.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.533+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~2UWPB8TY55VE.1 size=1048576 2024-09-19T13:47:33.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.533+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~2UWPB8TY55VE.2 size=50805 2024-09-19T13:47:33.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.533+0000 7fcf3240c8c0 1 > prepared multipart upload key=C8T6DB9V9FBT upload=2UWPB8TY55VE tag=O3EAJKS3BFIL type=write size=3196533 2024-09-19T13:47:33.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.537+0000 7fcf3240c8c0 1 < completed delete operation key=C3TFYNXH549T tag=7ZOMQMLR6HFG type=del 2024-09-19T13:47:33.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.541+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~JRZHDMNSXILI.0 size=1048576 2024-09-19T13:47:33.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.545+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~JRZHDMNSXILI.1 size=1043580 2024-09-19T13:47:33.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.545+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=JRZHDMNSXILI tag=EGNK5AMJE4YB type=write size=3140732 2024-09-19T13:47:33.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.545+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~KFWHSCP249H4.0 size=924536 2024-09-19T13:47:33.554 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.549+0000 7fcf3240c8c0 1 < completed multipart upload key=NP2L28YRVQ8L upload=KFWHSCP249H4 tag=HJ1XA4NTBCWP type=write size=1973112 2024-09-19T13:47:33.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.553+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=SVG8GQEX3NIE type=del size=2138219 2024-09-19T13:47:33.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.557+0000 7fcf3240c8c0 1 < completed delete operation key=X16ENUFL40RN tag=8MT90DV27V86 type=del 2024-09-19T13:47:33.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.561+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~XI5BFS9HR265.0 size=453416 2024-09-19T13:47:33.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.561+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=XI5BFS9HR265 tag=34DGJ7CVC6RW type=write size=1501992 2024-09-19T13:47:33.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.561+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=Z3N3AG6MZZF7 type=del 2024-09-19T13:47:33.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.565+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=9O1M7YAY8LAD type=del size=845771 2024-09-19T13:47:33.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.569+0000 7fcf3240c8c0 1 < completed delete operation key=X9FGPMP30X47 tag=MFMJRHMNL81K type=del 2024-09-19T13:47:33.575 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.573+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~LFH63H5KIMMF.0 size=628827 2024-09-19T13:47:33.575 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.573+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=LFH63H5KIMMF tag=8S2VT74KSIDC type=write size=1677403 2024-09-19T13:47:33.578 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.573+0000 7fcf3240c8c0 1 < completed delete operation key=C8T6DB9V9FBT tag=X82G6N25FY45 type=del 2024-09-19T13:47:33.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.577+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~0FTK5EF1W2RA.0 size=1048576 2024-09-19T13:47:33.584 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.581+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~0FTK5EF1W2RA.1 size=1048576 2024-09-19T13:47:33.586 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.581+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~0FTK5EF1W2RA.2 size=459930 2024-09-19T13:47:33.587 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.581+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=0FTK5EF1W2RA tag=C908XV6D8YWY type=write size=3605658 2024-09-19T13:47:33.587 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.585+0000 7fcf3240c8c0 1 < canceled part key=_multipart_X9FGPMP30X47.2~ISUH6UHXW6SU.0 size=1048576 2024-09-19T13:47:33.589 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.585+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~ISUH6UHXW6SU.1 size=314753 2024-09-19T13:47:33.593 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.589+0000 7fcf3240c8c0 1 < canceled multipart upload key=X9FGPMP30X47 upload=ISUH6UHXW6SU tag=SPM87IQPE7MB type=write size=2411905 2024-09-19T13:47:33.597 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.593+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0U9BUX9DHTAK.2~O4WH7A05PSB1.0 size=1048576 2024-09-19T13:47:33.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.597+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0U9BUX9DHTAK.2~O4WH7A05PSB1.1 size=753969 2024-09-19T13:47:33.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.597+0000 7fcf3240c8c0 1 > prepared multipart upload key=0U9BUX9DHTAK upload=O4WH7A05PSB1 tag=HWRW6PNMS3KM type=write size=2851121 2024-09-19T13:47:33.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.597+0000 7fcf3240c8c0 1 < completed delete operation key=BXUPV5XSJBTH tag=QWVB6NHYK4OV type=del 2024-09-19T13:47:33.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.601+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=NGND2H9SMMSW type=write size=476383 2024-09-19T13:47:33.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.605+0000 7fcf3240c8c0 1 < suggested update operation key=3TME221SA53E tag=WXZA8N826AMW type=del size=269241 2024-09-19T13:47:33.613 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.609+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~3YF8G8NNVQR9.0 size=1048576 2024-09-19T13:47:33.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.613+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~3YF8G8NNVQR9.1 size=1048576 2024-09-19T13:47:33.617 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.613+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~3YF8G8NNVQR9.2 size=435490 2024-09-19T13:47:33.617 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.613+0000 7fcf3240c8c0 1 > prepared multipart upload key=3TME221SA53E upload=3YF8G8NNVQR9 tag=XPLEN95BX62B type=write size=3581218 2024-09-19T13:47:33.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.617+0000 7fcf3240c8c0 1 < suggested remove operation key=QMSDNKYFFK1F tag=5H8A8F5CBS93 type=del 2024-09-19T13:47:33.626 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.621+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~DZ4KOQSK4D5S.0 size=1048576 2024-09-19T13:47:33.627 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.625+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~DZ4KOQSK4D5S.1 size=204316 2024-09-19T13:47:33.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.625+0000 7fcf3240c8c0 1 > prepared multipart upload key=6DFF2OCPT9W2 upload=DZ4KOQSK4D5S tag=W0VNPZ67TJW0 type=write size=2301468 2024-09-19T13:47:33.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.629+0000 7fcf3240c8c0 1 < suggested remove operation key=V8X0VBBNK83J tag=JJO5QQYB4F89 type=del 2024-09-19T13:47:33.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.633+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~GQ1SRCX2166S.0 size=254919 2024-09-19T13:47:33.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.633+0000 7fcf3240c8c0 1 > prepared multipart upload key=C8T6DB9V9FBT upload=GQ1SRCX2166S tag=3P2EGLL43PWP type=write size=1303495 2024-09-19T13:47:33.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.633+0000 7fcf3240c8c0 1 < canceled part key=_multipart_9ICCISYXT0IV.2~FF1SNLLB0OC0.0 size=309080 2024-09-19T13:47:33.641 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.637+0000 7fcf3240c8c0 1 < canceled multipart upload key=9ICCISYXT0IV upload=FF1SNLLB0OC0 tag=N8YXYRP6DL1Q type=write size=1357656 2024-09-19T13:47:33.646 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.645+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~OUGS1T6H6FYY.0 size=679292 2024-09-19T13:47:33.646 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.645+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=OUGS1T6H6FYY tag=5U779461FN4Z type=write size=1727868 2024-09-19T13:47:33.649 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.645+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~ZVM4REW7GQRW.0 size=1048576 2024-09-19T13:47:33.651 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.649+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~ZVM4REW7GQRW.1 size=1048576 2024-09-19T13:47:33.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.649+0000 7fcf3240c8c0 1 < canceled part key=_multipart_0UCFTOF1YBBM.2~ZVM4REW7GQRW.2 size=630624 2024-09-19T13:47:33.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.653+0000 7fcf3240c8c0 1 < canceled multipart upload key=0UCFTOF1YBBM upload=ZVM4REW7GQRW tag=YCYUOD91LAL2 type=write size=3776352 2024-09-19T13:47:33.660 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.657+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=HQKHQ680COBD type=write size=137285 2024-09-19T13:47:33.664 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.661+0000 7fcf3240c8c0 -1 < failed to complete operation key=QMSDNKYFFK1F tag=XAHDJWH46NMY type=del size=1501612: (22) Invalid argument 2024-09-19T13:47:33.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.665+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~32A0S2RX8ZHO.0 size=1048576 2024-09-19T13:47:33.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.669+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~32A0S2RX8ZHO.1 size=1048576 2024-09-19T13:47:33.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.673+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~32A0S2RX8ZHO.2 size=92094 2024-09-19T13:47:33.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.673+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=32A0S2RX8ZHO tag=QSUG95NUQWOG type=write size=3237822 2024-09-19T13:47:33.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.673+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~SY2THMM9MN9H.0 size=589776 2024-09-19T13:47:33.683 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.681+0000 7fcf3240c8c0 1 < completed multipart upload key=D1RMXGXS3O7Z upload=SY2THMM9MN9H tag=SKEGIELJJUKN type=write size=1638352 2024-09-19T13:47:33.686 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.685+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=NFYMCQ407GR0 type=del size=1610395 2024-09-19T13:47:33.690 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.685+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~2UWPB8TY55VE.0 size=1048576 2024-09-19T13:47:33.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.689+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~2UWPB8TY55VE.1 size=1048576 2024-09-19T13:47:33.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.689+0000 7fcf3240c8c0 1 < canceled part key=_multipart_C8T6DB9V9FBT.2~2UWPB8TY55VE.2 size=50805 2024-09-19T13:47:33.702 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.697+0000 7fcf3240c8c0 1 < canceled multipart upload key=C8T6DB9V9FBT upload=2UWPB8TY55VE tag=O3EAJKS3BFIL type=write size=3196533 2024-09-19T13:47:33.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.701+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=DF7GWXMWG2TW type=write size=625606 2024-09-19T13:47:33.709 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.705+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~JRZHDMNSXILI.0 size=1048576 2024-09-19T13:47:33.711 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.709+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~JRZHDMNSXILI.1 size=1043580 2024-09-19T13:47:33.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.713+0000 7fcf3240c8c0 1 < completed multipart upload key=0UCFTOF1YBBM upload=JRZHDMNSXILI tag=EGNK5AMJE4YB type=write size=3140732 2024-09-19T13:47:33.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.721+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~U7Z0JS7EKM8H.0 size=1048576 2024-09-19T13:47:33.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.725+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~U7Z0JS7EKM8H.1 size=367443 2024-09-19T13:47:33.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.725+0000 7fcf3240c8c0 1 > prepared multipart upload key=71Z2VTW99W7J upload=U7Z0JS7EKM8H tag=PXZ3RM3WY1RG type=write size=2464595 2024-09-19T13:47:33.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.725+0000 7fcf3240c8c0 1 < completed delete operation key=D1RMXGXS3O7Z tag=SVG8GQEX3NIE type=del 2024-09-19T13:47:33.732 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.729+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=8HMA06KJL0HN type=del size=3784787 2024-09-19T13:47:33.735 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.733+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~XI5BFS9HR265.0 size=453416 2024-09-19T13:47:33.741 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.737+0000 7fcf3240c8c0 1 < completed multipart upload key=N51Q6HKJSCCB upload=XI5BFS9HR265 tag=34DGJ7CVC6RW type=write size=1501992 2024-09-19T13:47:33.747 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.745+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~RAHVJ34GFM84.0 size=553907 2024-09-19T13:47:33.747 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.745+0000 7fcf3240c8c0 1 > prepared multipart upload key=OA9BMSXGYR9T upload=RAHVJ34GFM84 tag=IRDR6TEE5N28 type=write size=1602483 2024-09-19T13:47:33.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.745+0000 7fcf3240c8c0 1 < completed delete operation key=X9FGPMP30X47 tag=9O1M7YAY8LAD type=del 2024-09-19T13:47:33.755 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.753+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~AWFZ3X5T2MK8.0 size=963569 2024-09-19T13:47:33.755 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.753+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=AWFZ3X5T2MK8 tag=56SV7MUF6GCI type=write size=2012145 2024-09-19T13:47:33.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.753+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~LFH63H5KIMMF.0 size=628827 2024-09-19T13:47:33.762 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.761+0000 7fcf3240c8c0 1 < completed multipart upload key=ES62XJO5Q3FO upload=LFH63H5KIMMF tag=8S2VT74KSIDC type=write size=1677403 2024-09-19T13:47:33.768 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.765+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~7G92WMIYXMRR.0 size=1048576 2024-09-19T13:47:33.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.765+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~7G92WMIYXMRR.1 size=564645 2024-09-19T13:47:33.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.765+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=7G92WMIYXMRR tag=CVNQL8YJRTO7 type=write size=2661797 2024-09-19T13:47:33.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.769+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~0FTK5EF1W2RA.0 size=1048576 2024-09-19T13:47:33.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.773+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~0FTK5EF1W2RA.1 size=1048576 2024-09-19T13:47:33.778 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.773+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~0FTK5EF1W2RA.2 size=459930 2024-09-19T13:47:33.784 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.781+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=0FTK5EF1W2RA tag=C908XV6D8YWY type=write size=3605658 2024-09-19T13:47:33.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.789+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~QWPD9K5CQHU0.0 size=567344 2024-09-19T13:47:33.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.789+0000 7fcf3240c8c0 1 > prepared multipart upload key=71Z2VTW99W7J upload=QWPD9K5CQHU0 tag=KOBPYX0C0GU3 type=write size=1615920 2024-09-19T13:47:33.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.793+0000 7fcf3240c8c0 1 < completed part key=_multipart_0U9BUX9DHTAK.2~O4WH7A05PSB1.0 size=1048576 2024-09-19T13:47:33.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.793+0000 7fcf3240c8c0 1 < completed part key=_multipart_0U9BUX9DHTAK.2~O4WH7A05PSB1.1 size=753969 2024-09-19T13:47:33.804 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.801+0000 7fcf3240c8c0 1 < completed multipart upload key=0U9BUX9DHTAK upload=O4WH7A05PSB1 tag=HWRW6PNMS3KM type=write size=2851121 2024-09-19T13:47:33.809 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.805+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~6MNH66OV4U9G.0 size=1048576 2024-09-19T13:47:33.812 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.809+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~6MNH66OV4U9G.1 size=1048576 2024-09-19T13:47:33.814 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.813+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~6MNH66OV4U9G.2 size=79930 2024-09-19T13:47:33.815 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.813+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=6MNH66OV4U9G tag=1NHN745P5L5D type=write size=3225658 2024-09-19T13:47:33.820 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.817+0000 7fcf3240c8c0 1 < suggested remove operation key=71Z2VTW99W7J tag=NGND2H9SMMSW type=write 2024-09-19T13:47:33.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.821+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=IJUILLGUTD41 type=write size=220158 2024-09-19T13:47:33.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.825+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~3YF8G8NNVQR9.0 size=1048576 2024-09-19T13:47:33.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.825+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~3YF8G8NNVQR9.1 size=1048576 2024-09-19T13:47:33.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.829+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~3YF8G8NNVQR9.2 size=435490 2024-09-19T13:47:33.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.833+0000 7fcf3240c8c0 1 < completed multipart upload key=3TME221SA53E upload=3YF8G8NNVQR9 tag=XPLEN95BX62B type=write size=3581218 2024-09-19T13:47:33.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.837+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=7FRKA0C33XDS type=del size=3434882 2024-09-19T13:47:33.841 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.837+0000 7fcf3240c8c0 1 < canceled part key=_multipart_6DFF2OCPT9W2.2~DZ4KOQSK4D5S.0 size=1048576 2024-09-19T13:47:33.843 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.841+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~DZ4KOQSK4D5S.1 size=204316 2024-09-19T13:47:33.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.845+0000 7fcf3240c8c0 1 < canceled multipart upload key=6DFF2OCPT9W2 upload=DZ4KOQSK4D5S tag=W0VNPZ67TJW0 type=write size=2301468 2024-09-19T13:47:33.851 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.849+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=KHP26FZ1XLFE type=del size=11163 2024-09-19T13:47:33.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.853+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~GQ1SRCX2166S.0 size=254919 2024-09-19T13:47:33.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.857+0000 7fcf3240c8c0 1 < completed multipart upload key=C8T6DB9V9FBT upload=GQ1SRCX2166S tag=3P2EGLL43PWP type=write size=1303495 2024-09-19T13:47:33.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.861+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=TTDPGY2NPVS2 type=del size=3728356 2024-09-19T13:47:33.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.861+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~OUGS1T6H6FYY.0 size=679292 2024-09-19T13:47:33.871 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.869+0000 7fcf3240c8c0 1 < completed multipart upload key=D20C6C2ZFX1W upload=OUGS1T6H6FYY tag=5U779461FN4Z type=write size=1727868 2024-09-19T13:47:33.874 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.869+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=I6C2J9UFXUCC type=del size=3998328 2024-09-19T13:47:33.877 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.873+0000 7fcf3240c8c0 1 < completed write operation key=7UC85R2HO9K2 tag=HQKHQ680COBD type=write size=137285 2024-09-19T13:47:33.880 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.877+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=FSGDJNEBDAAY type=write size=696026 2024-09-19T13:47:33.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.881+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~32A0S2RX8ZHO.0 size=1048576 2024-09-19T13:47:33.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.881+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~32A0S2RX8ZHO.1 size=1048576 2024-09-19T13:47:33.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.881+0000 7fcf3240c8c0 1 < canceled part key=_multipart_QMSDNKYFFK1F.2~32A0S2RX8ZHO.2 size=92094 2024-09-19T13:47:33.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.889+0000 7fcf3240c8c0 1 < canceled multipart upload key=QMSDNKYFFK1F upload=32A0S2RX8ZHO tag=QSUG95NUQWOG type=write size=3237822 2024-09-19T13:47:33.894 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.889+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=NIZCIKDVSDET type=del size=1300305 2024-09-19T13:47:33.900 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.897+0000 7fcf3240c8c0 1 < suggested remove operation key=QSM2Q8CW1Q86 tag=NFYMCQ407GR0 type=del 2024-09-19T13:47:33.904 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.901+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=3OC3CS1Q1JY0 type=del size=266977 2024-09-19T13:47:33.905 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.901+0000 7fcf3240c8c0 1 < completed write operation key=N51Q6HKJSCCB tag=DF7GWXMWG2TW type=write size=625606 2024-09-19T13:47:33.908 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.905+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=8JV49ONS66RV type=del size=3098037 2024-09-19T13:47:33.911 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.909+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~U7Z0JS7EKM8H.0 size=1048576 2024-09-19T13:47:33.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.909+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~U7Z0JS7EKM8H.1 size=367443 2024-09-19T13:47:33.918 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.913+0000 7fcf3240c8c0 1 < completed multipart upload key=71Z2VTW99W7J upload=U7Z0JS7EKM8H tag=PXZ3RM3WY1RG type=write size=2464595 2024-09-19T13:47:33.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.921+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~L252SBH03CLV.0 size=651060 2024-09-19T13:47:33.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.921+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=L252SBH03CLV tag=7NG1V4BA14CB type=write size=1699636 2024-09-19T13:47:33.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.925+0000 7fcf3240c8c0 1 < completed delete operation key=ZCKKQ1R8318S tag=8HMA06KJL0HN type=del 2024-09-19T13:47:33.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.929+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~16NSS9LSPH38.0 size=907312 2024-09-19T13:47:33.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.929+0000 7fcf3240c8c0 1 > prepared multipart upload key=71Z2VTW99W7J upload=16NSS9LSPH38 tag=VG1V6DX4PKIO type=write size=1955888 2024-09-19T13:47:33.934 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.933+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~RAHVJ34GFM84.0 size=553907 2024-09-19T13:47:33.939 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.937+0000 7fcf3240c8c0 1 < completed multipart upload key=OA9BMSXGYR9T upload=RAHVJ34GFM84 tag=IRDR6TEE5N28 type=write size=1602483 2024-09-19T13:47:33.942 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.941+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=WS39YR0O9U62 type=del size=366023 2024-09-19T13:47:33.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.941+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~AWFZ3X5T2MK8.0 size=963569 2024-09-19T13:47:33.950 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.949+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=AWFZ3X5T2MK8 tag=56SV7MUF6GCI type=write size=2012145 2024-09-19T13:47:33.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.949+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=XI7EZP7E6POB type=del size=366377 2024-09-19T13:47:33.956 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.953+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~7G92WMIYXMRR.0 size=1048576 2024-09-19T13:47:33.959 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.957+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~7G92WMIYXMRR.1 size=564645 2024-09-19T13:47:33.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.961+0000 7fcf3240c8c0 1 < completed multipart upload key=ZCKKQ1R8318S upload=7G92WMIYXMRR tag=CVNQL8YJRTO7 type=write size=2661797 2024-09-19T13:47:33.967 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.965+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=9DJICLB6BHXX type=del size=2840109 2024-09-19T13:47:33.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.969+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~QWPD9K5CQHU0.0 size=567344 2024-09-19T13:47:33.975 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.973+0000 7fcf3240c8c0 1 < completed multipart upload key=71Z2VTW99W7J upload=QWPD9K5CQHU0 tag=KOBPYX0C0GU3 type=write size=1615920 2024-09-19T13:47:33.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.977+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=UEPDBRESMXAY type=del size=508261 2024-09-19T13:47:33.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.981+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~6MNH66OV4U9G.0 size=1048576 2024-09-19T13:47:33.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.985+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~6MNH66OV4U9G.1 size=1048576 2024-09-19T13:47:33.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.985+0000 7fcf3240c8c0 1 < canceled part key=_multipart_ZCKKQ1R8318S.2~6MNH66OV4U9G.2 size=79930 2024-09-19T13:47:33.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.989+0000 7fcf3240c8c0 1 < canceled multipart upload key=ZCKKQ1R8318S upload=6MNH66OV4U9G tag=1NHN745P5L5D type=write size=3225658 2024-09-19T13:47:33.998 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.993+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~V2UQ09L6RHC1.0 size=1048576 2024-09-19T13:47:34.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.997+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~V2UQ09L6RHC1.1 size=1048576 2024-09-19T13:47:34.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.997+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~V2UQ09L6RHC1.2 size=189660 2024-09-19T13:47:34.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:33.997+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=V2UQ09L6RHC1 tag=85JL0XTYV07G type=write size=3335388 2024-09-19T13:47:34.007 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.005+0000 7fcf3240c8c0 1 < suggested update operation key=D20C6C2ZFX1W tag=IJUILLGUTD41 type=write size=220158 2024-09-19T13:47:34.009 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.005+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=04O6U9673EF6 type=write size=763336 2024-09-19T13:47:34.012 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.009+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=7FRKA0C33XDS type=del 2024-09-19T13:47:34.014 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.013+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=61WJDUNGI193 type=write size=250148 2024-09-19T13:47:34.017 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.013+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=KHP26FZ1XLFE type=del 2024-09-19T13:47:34.020 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.017+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=PF78N504EITM type=del size=2095115 2024-09-19T13:47:34.022 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.021+0000 7fcf3240c8c0 1 < completed delete operation key=6DFF2OCPT9W2 tag=TTDPGY2NPVS2 type=del 2024-09-19T13:47:34.027 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.025+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~EU16RV6O33O3.0 size=1048576 2024-09-19T13:47:34.029 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.025+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~EU16RV6O33O3.1 size=1048576 2024-09-19T13:47:34.032 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.029+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~EU16RV6O33O3.2 size=716674 2024-09-19T13:47:34.032 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.029+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=EU16RV6O33O3 tag=VOT90BYMRFWF type=write size=3862402 2024-09-19T13:47:34.034 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.033+0000 7fcf3240c8c0 1 < completed delete operation key=STMT6XU2EJQM tag=I6C2J9UFXUCC type=del 2024-09-19T13:47:34.038 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.033+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=F31FP3OEIX9T type=write size=476306 2024-09-19T13:47:34.041 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.037+0000 7fcf3240c8c0 1 < completed write operation key=DHPONKOVS8CT tag=FSGDJNEBDAAY type=write size=696026 2024-09-19T13:47:34.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.045+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~Z51ICIO06N9Q.0 size=277213 2024-09-19T13:47:34.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.045+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=Z51ICIO06N9Q tag=98XNCVO1UEQK type=write size=1325789 2024-09-19T13:47:34.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.049+0000 7fcf3240c8c0 1 < suggested update operation key=DHPONKOVS8CT tag=NIZCIKDVSDET type=del size=1300305 2024-09-19T13:47:34.056 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.053+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=TT1KWQHE592F type=del size=1578552 2024-09-19T13:47:34.059 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.057+0000 7fcf3240c8c0 1 < canceled operation key=6DFF2OCPT9W2 tag=3OC3CS1Q1JY0 type=del size=266977 2024-09-19T13:47:34.063 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.061+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=G9TNEX4MG6F6 type=del size=220987 2024-09-19T13:47:34.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.061+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=8JV49ONS66RV type=del 2024-09-19T13:47:34.069 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.065+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=OS3FO3LLRJWI type=del size=3767767 2024-09-19T13:47:34.073 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.069+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~L252SBH03CLV.0 size=651060 2024-09-19T13:47:34.078 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.073+0000 7fcf3240c8c0 1 < completed multipart upload key=D20C6C2ZFX1W upload=L252SBH03CLV tag=7NG1V4BA14CB type=write size=1699636 2024-09-19T13:47:34.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.081+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~X019IV47S65S.0 size=1016956 2024-09-19T13:47:34.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.081+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=X019IV47S65S tag=WZSW3FJVYS1W type=write size=2065532 2024-09-19T13:47:34.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.085+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~16NSS9LSPH38.0 size=907312 2024-09-19T13:47:34.092 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.089+0000 7fcf3240c8c0 1 < completed multipart upload key=71Z2VTW99W7J upload=16NSS9LSPH38 tag=VG1V6DX4PKIO type=write size=1955888 2024-09-19T13:47:34.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.093+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~6UXBO78IEDKO.0 size=792155 2024-09-19T13:47:34.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.093+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=6UXBO78IEDKO tag=F3YKQOD8XDRF type=write size=1840731 2024-09-19T13:47:34.101 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.097+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=WS39YR0O9U62 type=del 2024-09-19T13:47:34.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.101+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=IWVMAGNY16UO type=del size=3403279 2024-09-19T13:47:34.109 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.105+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=XI7EZP7E6POB type=del 2024-09-19T13:47:34.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.109+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=990JCLFYDLAM type=del size=3079313 2024-09-19T13:47:34.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.113+0000 7fcf3240c8c0 1 < canceled operation key=X9FGPMP30X47 tag=9DJICLB6BHXX type=del size=2840109 2024-09-19T13:47:34.119 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.117+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=X7FCCOY3MP8F type=del size=1098686 2024-09-19T13:47:34.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.121+0000 7fcf3240c8c0 1 < completed delete operation key=1BMF3S2BZLLI tag=UEPDBRESMXAY type=del 2024-09-19T13:47:34.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.125+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~39KRGRPZ9H1X.0 size=1048576 2024-09-19T13:47:34.132 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.129+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~39KRGRPZ9H1X.1 size=1048576 2024-09-19T13:47:34.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.133+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~39KRGRPZ9H1X.2 size=694444 2024-09-19T13:47:34.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.133+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=39KRGRPZ9H1X tag=UPZX393DRU01 type=write size=3840172 2024-09-19T13:47:34.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.137+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~V2UQ09L6RHC1.0 size=1048576 2024-09-19T13:47:34.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.137+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~V2UQ09L6RHC1.1 size=1048576 2024-09-19T13:47:34.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.141+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~V2UQ09L6RHC1.2 size=189660 2024-09-19T13:47:34.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.145+0000 7fcf3240c8c0 1 < completed multipart upload key=M2CO4A2DHJ05 upload=V2UQ09L6RHC1 tag=85JL0XTYV07G type=write size=3335388 2024-09-19T13:47:34.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.153+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~2Q6WL3V5ZQ9B.0 size=1048576 2024-09-19T13:47:34.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.157+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~2Q6WL3V5ZQ9B.1 size=502280 2024-09-19T13:47:34.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.157+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=2Q6WL3V5ZQ9B tag=HI5S8BWLQPUO type=write size=2599432 2024-09-19T13:47:34.161 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.157+0000 7fcf3240c8c0 1 < completed write operation key=V8X0VBBNK83J tag=04O6U9673EF6 type=write size=763336 2024-09-19T13:47:34.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.161+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=1U7WUHQOQS34 type=write size=205753 2024-09-19T13:47:34.167 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.165+0000 7fcf3240c8c0 1 < completed write operation key=X9FGPMP30X47 tag=61WJDUNGI193 type=write size=250148 2024-09-19T13:47:34.171 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.169+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=H3JD6BE8P7VT type=del size=3744032 2024-09-19T13:47:34.174 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.169+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=PF78N504EITM type=del 2024-09-19T13:47:34.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.177+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~7TXV1VJHNC6T.0 size=1048576 2024-09-19T13:47:34.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.181+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~7TXV1VJHNC6T.1 size=1048576 2024-09-19T13:47:34.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.181+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~7TXV1VJHNC6T.2 size=68177 2024-09-19T13:47:34.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.181+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=7TXV1VJHNC6T tag=0ZAEJPXEFW3C type=write size=3213905 2024-09-19T13:47:34.188 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.185+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~EU16RV6O33O3.0 size=1048576 2024-09-19T13:47:34.190 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.189+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~EU16RV6O33O3.1 size=1048576 2024-09-19T13:47:34.191 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.189+0000 7fcf3240c8c0 1 < canceled part key=_multipart_ZCKKQ1R8318S.2~EU16RV6O33O3.2 size=716674 2024-09-19T13:47:34.197 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.193+0000 7fcf3240c8c0 1 < canceled multipart upload key=ZCKKQ1R8318S upload=EU16RV6O33O3 tag=VOT90BYMRFWF type=write size=3862402 2024-09-19T13:47:34.201 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.197+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=K7SB19TLRT9J type=del size=838804 2024-09-19T13:47:34.205 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.201+0000 7fcf3240c8c0 1 < completed write operation key=QAYJ5B1KZ08J tag=F31FP3OEIX9T type=write size=476306 2024-09-19T13:47:34.211 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.209+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~1VVGUVRRD0C9.0 size=1048576 2024-09-19T13:47:34.214 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.209+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~1VVGUVRRD0C9.1 size=984196 2024-09-19T13:47:34.214 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.209+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=1VVGUVRRD0C9 tag=E1JO69C22HVA type=write size=3081348 2024-09-19T13:47:34.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.213+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~Z51ICIO06N9Q.0 size=277213 2024-09-19T13:47:34.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.221+0000 7fcf3240c8c0 1 < completed multipart upload key=QSM2Q8CW1Q86 upload=Z51ICIO06N9Q tag=98XNCVO1UEQK type=write size=1325789 2024-09-19T13:47:34.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.225+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=LQKXZZ9C3Z3G type=del size=3031542 2024-09-19T13:47:34.230 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.225+0000 7fcf3240c8c0 1 < completed delete operation key=STMT6XU2EJQM tag=TT1KWQHE592F type=del 2024-09-19T13:47:34.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.229+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=7099HTUNBLKH type=write size=868428 2024-09-19T13:47:34.238 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.233+0000 7fcf3240c8c0 1 < canceled operation key=OA9BMSXGYR9T tag=G9TNEX4MG6F6 type=del size=220987 2024-09-19T13:47:34.241 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.237+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=96LRUD12QSMX type=del size=1235049 2024-09-19T13:47:34.247 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.245+0000 7fcf3240c8c0 1 < suggested remove operation key=DHPONKOVS8CT tag=OS3FO3LLRJWI type=del 2024-09-19T13:47:34.254 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.249+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~MHRTYYDMVW80.0 size=1048576 2024-09-19T13:47:34.256 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.253+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~MHRTYYDMVW80.1 size=1048576 2024-09-19T13:47:34.259 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.257+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~MHRTYYDMVW80.2 size=320363 2024-09-19T13:47:34.259 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.257+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=MHRTYYDMVW80 tag=N3OOLKVC5BT6 type=write size=3466091 2024-09-19T13:47:34.262 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.257+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~X019IV47S65S.0 size=1016956 2024-09-19T13:47:34.267 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.265+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=X019IV47S65S tag=WZSW3FJVYS1W type=write size=2065532 2024-09-19T13:47:34.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.265+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=WOVSUTVPW45B type=del size=3956725 2024-09-19T13:47:34.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.269+0000 7fcf3240c8c0 1 < canceled part key=_multipart_XE42LV5M5X82.2~6UXBO78IEDKO.0 size=792155 2024-09-19T13:47:34.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.273+0000 7fcf3240c8c0 1 < canceled multipart upload key=XE42LV5M5X82 upload=6UXBO78IEDKO tag=F3YKQOD8XDRF type=write size=1840731 2024-09-19T13:47:34.278 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.273+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=R8W06DJDKV4B type=del size=1850086 2024-09-19T13:47:34.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.277+0000 7fcf3240c8c0 1 < completed delete operation key=M2CO4A2DHJ05 tag=IWVMAGNY16UO type=del 2024-09-19T13:47:34.287 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.285+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=C6X1G8JBDWIL type=del size=2649656 2024-09-19T13:47:34.290 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.289+0000 7fcf3240c8c0 1 < completed delete operation key=D20C6C2ZFX1W tag=990JCLFYDLAM type=del 2024-09-19T13:47:34.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.293+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~ABLJ4HP6A65N.0 size=624832 2024-09-19T13:47:34.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.293+0000 7fcf3240c8c0 1 > prepared multipart upload key=OA9BMSXGYR9T upload=ABLJ4HP6A65N tag=5PP8BDQ3E8EK type=write size=1673408 2024-09-19T13:47:34.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.297+0000 7fcf3240c8c0 1 < completed delete operation key=D1RMXGXS3O7Z tag=X7FCCOY3MP8F type=del 2024-09-19T13:47:34.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.297+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=2SKX64MUFCM1 type=del size=713350 2024-09-19T13:47:34.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.301+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~39KRGRPZ9H1X.0 size=1048576 2024-09-19T13:47:34.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.305+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~39KRGRPZ9H1X.1 size=1048576 2024-09-19T13:47:34.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.305+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~39KRGRPZ9H1X.2 size=694444 2024-09-19T13:47:34.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.313+0000 7fcf3240c8c0 1 < completed multipart upload key=QMSDNKYFFK1F upload=39KRGRPZ9H1X tag=UPZX393DRU01 type=write size=3840172 2024-09-19T13:47:34.318 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.313+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=3BG7KXB8DEEE type=del size=2032786 2024-09-19T13:47:34.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.317+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~2Q6WL3V5ZQ9B.0 size=1048576 2024-09-19T13:47:34.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.321+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~2Q6WL3V5ZQ9B.1 size=502280 2024-09-19T13:47:34.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.325+0000 7fcf3240c8c0 1 < completed multipart upload key=XE42LV5M5X82 upload=2Q6WL3V5ZQ9B tag=HI5S8BWLQPUO type=write size=2599432 2024-09-19T13:47:34.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.333+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~3MNE6MY5P37Z.0 size=1048576 2024-09-19T13:47:34.337 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.333+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~3MNE6MY5P37Z.1 size=335222 2024-09-19T13:47:34.337 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.333+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=3MNE6MY5P37Z tag=0X6E71U21MD1 type=write size=2432374 2024-09-19T13:47:34.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.337+0000 7fcf3240c8c0 1 < completed write operation key=AES54TJK7VH7 tag=1U7WUHQOQS34 type=write size=205753 2024-09-19T13:47:34.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.341+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=4GTO380LX6RZ type=del size=910174 2024-09-19T13:47:34.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.345+0000 7fcf3240c8c0 1 < canceled operation key=7UC85R2HO9K2 tag=H3JD6BE8P7VT type=del size=3744032 2024-09-19T13:47:34.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.349+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=PUZU9226IGKY type=del size=726121 2024-09-19T13:47:34.354 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.349+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~7TXV1VJHNC6T.0 size=1048576 2024-09-19T13:47:34.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.353+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~7TXV1VJHNC6T.1 size=1048576 2024-09-19T13:47:34.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.357+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~7TXV1VJHNC6T.2 size=68177 2024-09-19T13:47:34.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.361+0000 7fcf3240c8c0 1 < completed multipart upload key=AES54TJK7VH7 upload=7TXV1VJHNC6T tag=0ZAEJPXEFW3C type=write size=3213905 2024-09-19T13:47:34.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.365+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~FTYDGYN6F7D2.0 size=1048576 2024-09-19T13:47:34.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.369+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~FTYDGYN6F7D2.1 size=1048576 2024-09-19T13:47:34.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.373+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~FTYDGYN6F7D2.2 size=839074 2024-09-19T13:47:34.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.373+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=FTYDGYN6F7D2 tag=HPQBLUZLHCVT type=write size=3984802 2024-09-19T13:47:34.378 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.377+0000 7fcf3240c8c0 1 < completed delete operation key=QSM2Q8CW1Q86 tag=K7SB19TLRT9J type=del 2024-09-19T13:47:34.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.381+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~LJ1FBUKP22YB.0 size=1048576 2024-09-19T13:47:34.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.381+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~LJ1FBUKP22YB.1 size=854412 2024-09-19T13:47:34.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.381+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=LJ1FBUKP22YB tag=6P42T6QULNHO type=write size=2951564 2024-09-19T13:47:34.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.385+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~1VVGUVRRD0C9.0 size=1048576 2024-09-19T13:47:34.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.389+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~1VVGUVRRD0C9.1 size=984196 2024-09-19T13:47:34.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.393+0000 7fcf3240c8c0 1 < completed multipart upload key=M2CO4A2DHJ05 upload=1VVGUVRRD0C9 tag=E1JO69C22HVA type=write size=3081348 2024-09-19T13:47:34.399 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.397+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=9OZF0IWBOOZP type=del size=1459445 2024-09-19T13:47:34.402 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.397+0000 7fcf3240c8c0 1 < completed delete operation key=M2CO4A2DHJ05 tag=LQKXZZ9C3Z3G type=del 2024-09-19T13:47:34.408 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.405+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~MM7PHCNSJBOH.0 size=1048576 2024-09-19T13:47:34.410 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.409+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~MM7PHCNSJBOH.1 size=729868 2024-09-19T13:47:34.411 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.409+0000 7fcf3240c8c0 1 > prepared multipart upload key=D1RMXGXS3O7Z upload=MM7PHCNSJBOH tag=2K2BB13HY6PI type=write size=2827020 2024-09-19T13:47:34.413 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.409+0000 7fcf3240c8c0 1 < canceled operation key=9ICCISYXT0IV tag=7099HTUNBLKH type=write size=868428 2024-09-19T13:47:34.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.413+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=TBHG5IMAGSFC type=del size=2365642 2024-09-19T13:47:34.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.417+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=96LRUD12QSMX type=del 2024-09-19T13:47:34.423 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.421+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~3CP8VES70318.0 size=1048576 2024-09-19T13:47:34.426 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.421+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~3CP8VES70318.1 size=225112 2024-09-19T13:47:34.426 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.421+0000 7fcf3240c8c0 1 > prepared multipart upload key=D1RMXGXS3O7Z upload=3CP8VES70318 tag=RPK6XVYKN371 type=write size=2322264 2024-09-19T13:47:34.428 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.425+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~MHRTYYDMVW80.0 size=1048576 2024-09-19T13:47:34.430 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.429+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~MHRTYYDMVW80.1 size=1048576 2024-09-19T13:47:34.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.429+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~MHRTYYDMVW80.2 size=320363 2024-09-19T13:47:34.438 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.433+0000 7fcf3240c8c0 1 < completed multipart upload key=QAYJ5B1KZ08J upload=MHRTYYDMVW80 tag=N3OOLKVC5BT6 type=write size=3466091 2024-09-19T13:47:34.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.441+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~9NPOYABW23DI.0 size=1048576 2024-09-19T13:47:34.445 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.441+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~9NPOYABW23DI.1 size=1048576 2024-09-19T13:47:34.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.445+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~9NPOYABW23DI.2 size=300475 2024-09-19T13:47:34.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.445+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=9NPOYABW23DI tag=7N5KBUB6L0XN type=write size=3446203 2024-09-19T13:47:34.451 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.449+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=WOVSUTVPW45B type=del 2024-09-19T13:47:34.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.449+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=P1MZ3F1L3NRU type=write size=493783 2024-09-19T13:47:34.457 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.453+0000 7fcf3240c8c0 1 < completed delete operation key=M2CO4A2DHJ05 tag=R8W06DJDKV4B type=del 2024-09-19T13:47:34.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.457+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=7B0VNQ93XPQI type=del size=2451434 2024-09-19T13:47:34.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.461+0000 7fcf3240c8c0 1 < completed delete operation key=0U9BUX9DHTAK tag=C6X1G8JBDWIL type=del 2024-09-19T13:47:34.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.461+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=KNBKPD4JK2RB type=del size=457879 2024-09-19T13:47:34.470 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.465+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~ABLJ4HP6A65N.0 size=624832 2024-09-19T13:47:34.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.473+0000 7fcf3240c8c0 1 < completed multipart upload key=OA9BMSXGYR9T upload=ABLJ4HP6A65N tag=5PP8BDQ3E8EK type=write size=1673408 2024-09-19T13:47:34.477 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.473+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=VQYGHUQLA93G type=write size=109087 2024-09-19T13:47:34.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.481+0000 7fcf3240c8c0 1 < suggested remove operation key=0UCFTOF1YBBM tag=2SKX64MUFCM1 type=del 2024-09-19T13:47:34.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.481+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=IYHX6YG9N3ZB type=write size=298026 2024-09-19T13:47:34.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.485+0000 7fcf3240c8c0 1 < completed delete operation key=C35EUAOWLBR3 tag=3BG7KXB8DEEE type=del 2024-09-19T13:47:34.493 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.489+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=B4TRJZZGMSBB type=del size=2399994 2024-09-19T13:47:34.495 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.493+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~3MNE6MY5P37Z.0 size=1048576 2024-09-19T13:47:34.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.493+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~3MNE6MY5P37Z.1 size=335222 2024-09-19T13:47:34.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.501+0000 7fcf3240c8c0 1 < completed multipart upload key=QMSDNKYFFK1F upload=3MNE6MY5P37Z tag=0X6E71U21MD1 type=write size=2432374 2024-09-19T13:47:34.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.501+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=VCP1RKOFY1D2 type=del size=674379 2024-09-19T13:47:34.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.505+0000 7fcf3240c8c0 1 < canceled operation key=C35EUAOWLBR3 tag=4GTO380LX6RZ type=del size=910174 2024-09-19T13:47:34.513 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.509+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~EE3HTKW5SJP3.0 size=458800 2024-09-19T13:47:34.513 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.509+0000 7fcf3240c8c0 1 > prepared multipart upload key=X9FGPMP30X47 upload=EE3HTKW5SJP3 tag=3V5KIHXH4RHI type=write size=1507376 2024-09-19T13:47:34.516 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.513+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=PUZU9226IGKY type=del 2024-09-19T13:47:34.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.517+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=45GIMQNIKCNF type=write size=918015 2024-09-19T13:47:34.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.517+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~FTYDGYN6F7D2.0 size=1048576 2024-09-19T13:47:34.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.521+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~FTYDGYN6F7D2.1 size=1048576 2024-09-19T13:47:34.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.521+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~FTYDGYN6F7D2.2 size=839074 2024-09-19T13:47:34.530 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.525+0000 7fcf3240c8c0 1 < completed multipart upload key=QSM2Q8CW1Q86 upload=FTYDGYN6F7D2 tag=HPQBLUZLHCVT type=write size=3984802 2024-09-19T13:47:34.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.533+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~IXR314Y8VPYT.0 size=1048576 2024-09-19T13:47:34.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.533+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~IXR314Y8VPYT.1 size=1048576 2024-09-19T13:47:34.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.537+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~IXR314Y8VPYT.2 size=517193 2024-09-19T13:47:34.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.537+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=IXR314Y8VPYT tag=4P7XE9D1ADJW type=write size=3662921 2024-09-19T13:47:34.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.537+0000 7fcf3240c8c0 1 < canceled part key=_multipart_7UC85R2HO9K2.2~LJ1FBUKP22YB.0 size=1048576 2024-09-19T13:47:34.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.537+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~LJ1FBUKP22YB.1 size=854412 2024-09-19T13:47:34.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.545+0000 7fcf3240c8c0 1 < canceled multipart upload key=7UC85R2HO9K2 upload=LJ1FBUKP22YB tag=6P42T6QULNHO type=write size=2951564 2024-09-19T13:47:34.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.549+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~RIGTO0GEOIBV.0 size=989144 2024-09-19T13:47:34.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.549+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=RIGTO0GEOIBV tag=TSV5A41EQX79 type=write size=2037720 2024-09-19T13:47:34.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.553+0000 7fcf3240c8c0 1 < completed delete operation key=C8T6DB9V9FBT tag=9OZF0IWBOOZP type=del 2024-09-19T13:47:34.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.561+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=L5I2MDZJJD4L type=write size=806110 2024-09-19T13:47:34.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.561+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~MM7PHCNSJBOH.0 size=1048576 2024-09-19T13:47:34.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.565+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~MM7PHCNSJBOH.1 size=729868 2024-09-19T13:47:34.573 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.569+0000 7fcf3240c8c0 1 < completed multipart upload key=D1RMXGXS3O7Z upload=MM7PHCNSJBOH tag=2K2BB13HY6PI type=write size=2827020 2024-09-19T13:47:34.578 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.577+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~V2AG0OE4K849.0 size=1048576 2024-09-19T13:47:34.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.577+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~V2AG0OE4K849.1 size=1048576 2024-09-19T13:47:34.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.581+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~V2AG0OE4K849.2 size=805154 2024-09-19T13:47:34.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.581+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=V2AG0OE4K849 tag=8A44QXF0WCWL type=write size=3950882 2024-09-19T13:47:34.584 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.581+0000 7fcf3240c8c0 1 < completed delete operation key=C35EUAOWLBR3 tag=TBHG5IMAGSFC type=del 2024-09-19T13:47:34.587 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.585+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=A3AN4R3LUL7K type=del size=397097 2024-09-19T13:47:34.588 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.585+0000 7fcf3240c8c0 1 < canceled part key=_multipart_D1RMXGXS3O7Z.2~3CP8VES70318.0 size=1048576 2024-09-19T13:47:34.590 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.585+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~3CP8VES70318.1 size=225112 2024-09-19T13:47:34.595 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.593+0000 7fcf3240c8c0 1 < canceled multipart upload key=D1RMXGXS3O7Z upload=3CP8VES70318 tag=RPK6XVYKN371 type=write size=2322264 2024-09-19T13:47:34.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.597+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~TL3H1EEMPKVE.0 size=1048576 2024-09-19T13:47:34.603 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.601+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~TL3H1EEMPKVE.1 size=220217 2024-09-19T13:47:34.603 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.601+0000 7fcf3240c8c0 1 > prepared multipart upload key=6DFF2OCPT9W2 upload=TL3H1EEMPKVE tag=DRIBKE3BDX5J type=write size=2317369 2024-09-19T13:47:34.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.601+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~9NPOYABW23DI.0 size=1048576 2024-09-19T13:47:34.608 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.605+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~9NPOYABW23DI.1 size=1048576 2024-09-19T13:47:34.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.605+0000 7fcf3240c8c0 1 < canceled part key=_multipart_7UC85R2HO9K2.2~9NPOYABW23DI.2 size=300475 2024-09-19T13:47:34.614 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.609+0000 7fcf3240c8c0 1 < canceled multipart upload key=7UC85R2HO9K2 upload=9NPOYABW23DI tag=7N5KBUB6L0XN type=write size=3446203 2024-09-19T13:47:34.620 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.617+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~66N8AY6UXFHN.0 size=1048576 2024-09-19T13:47:34.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.621+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~66N8AY6UXFHN.1 size=1048576 2024-09-19T13:47:34.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.621+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~66N8AY6UXFHN.2 size=485869 2024-09-19T13:47:34.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.621+0000 7fcf3240c8c0 1 > prepared multipart upload key=OA9BMSXGYR9T upload=66N8AY6UXFHN tag=UQ3IH0XYNND1 type=write size=3631597 2024-09-19T13:47:34.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.625+0000 7fcf3240c8c0 1 < completed write operation key=71Z2VTW99W7J tag=P1MZ3F1L3NRU type=write size=493783 2024-09-19T13:47:34.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.629+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~S0ME2EPFW6NN.0 size=1048576 2024-09-19T13:47:34.635 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.633+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~S0ME2EPFW6NN.1 size=344336 2024-09-19T13:47:34.635 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.633+0000 7fcf3240c8c0 1 > prepared multipart upload key=OA9BMSXGYR9T upload=S0ME2EPFW6NN tag=EF8KFO8O5W6K type=write size=2441488 2024-09-19T13:47:34.640 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.637+0000 7fcf3240c8c0 1 < suggested update operation key=D20C6C2ZFX1W tag=7B0VNQ93XPQI type=del size=2451434 2024-09-19T13:47:34.643 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.641+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=0YG6WO2TJSKS type=del size=1962489 2024-09-19T13:47:34.646 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.641+0000 7fcf3240c8c0 1 < completed delete operation key=V8X0VBBNK83J tag=KNBKPD4JK2RB type=del 2024-09-19T13:47:34.649 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.645+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=JX1MJA5KD0GH type=del size=2768944 2024-09-19T13:47:34.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.649+0000 7fcf3240c8c0 1 < completed write operation key=XE42LV5M5X82 tag=VQYGHUQLA93G type=write size=109087 2024-09-19T13:47:34.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.653+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=QE144VS2E2T8 type=del size=2104821 2024-09-19T13:47:34.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.653+0000 7fcf3240c8c0 1 < completed write operation key=AES54TJK7VH7 tag=IYHX6YG9N3ZB type=write size=298026 2024-09-19T13:47:34.660 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.657+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=YJ19P2NCETQR type=del size=2943129 2024-09-19T13:47:34.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.661+0000 7fcf3240c8c0 1 < completed delete operation key=A02RDP6BA9AC tag=B4TRJZZGMSBB type=del 2024-09-19T13:47:34.666 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.661+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=VCY9AEJ05MX3 type=del size=2692856 2024-09-19T13:47:34.668 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.665+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=VCP1RKOFY1D2 type=del 2024-09-19T13:47:34.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.669+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=H0CT9V8XPMOJ type=write size=129962 2024-09-19T13:47:34.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.669+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~EE3HTKW5SJP3.0 size=458800 2024-09-19T13:47:34.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.673+0000 7fcf3240c8c0 1 < completed multipart upload key=X9FGPMP30X47 upload=EE3HTKW5SJP3 tag=3V5KIHXH4RHI type=write size=1507376 2024-09-19T13:47:34.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.677+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=07UTOHLZ5BYQ type=del size=847284 2024-09-19T13:47:34.683 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.681+0000 7fcf3240c8c0 1 < completed write operation key=ES62XJO5Q3FO tag=45GIMQNIKCNF type=write size=918015 2024-09-19T13:47:34.686 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.681+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=KC4K7VHK9G7U type=del size=1564266 2024-09-19T13:47:34.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.685+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~IXR314Y8VPYT.0 size=1048576 2024-09-19T13:47:34.691 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.689+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~IXR314Y8VPYT.1 size=1048576 2024-09-19T13:47:34.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.689+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~IXR314Y8VPYT.2 size=517193 2024-09-19T13:47:34.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.693+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=IXR314Y8VPYT tag=4P7XE9D1ADJW type=write size=3662921 2024-09-19T13:47:34.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.697+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=ID5HPRVS7IRS type=del size=69576 2024-09-19T13:47:34.703 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.701+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~RIGTO0GEOIBV.0 size=989144 2024-09-19T13:47:34.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.705+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=RIGTO0GEOIBV tag=TSV5A41EQX79 type=write size=2037720 2024-09-19T13:47:34.711 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.709+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=T102ADAEB9GE type=del size=587540 2024-09-19T13:47:34.713 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.709+0000 7fcf3240c8c0 1 < completed write operation key=STMT6XU2EJQM tag=L5I2MDZJJD4L type=write size=806110 2024-09-19T13:47:34.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.713+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=DOY19T620UPU type=del size=4159697 2024-09-19T13:47:34.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.717+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~V2AG0OE4K849.0 size=1048576 2024-09-19T13:47:34.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.717+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~V2AG0OE4K849.1 size=1048576 2024-09-19T13:47:34.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.721+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~V2AG0OE4K849.2 size=805154 2024-09-19T13:47:34.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.725+0000 7fcf3240c8c0 1 < completed multipart upload key=0UCFTOF1YBBM upload=V2AG0OE4K849 tag=8A44QXF0WCWL type=write size=3950882 2024-09-19T13:47:34.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.733+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~9M6N016BFE8O.0 size=1048576 2024-09-19T13:47:34.737 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.733+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~9M6N016BFE8O.1 size=623942 2024-09-19T13:47:34.737 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.733+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=9M6N016BFE8O tag=352YXJOOVKLL type=write size=2721094 2024-09-19T13:47:34.740 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.737+0000 7fcf3240c8c0 1 < completed delete operation key=A02RDP6BA9AC tag=A3AN4R3LUL7K type=del 2024-09-19T13:47:34.743 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.741+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=WSFEEHIDTYF5 type=del size=2481610 2024-09-19T13:47:34.746 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.745+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~TL3H1EEMPKVE.0 size=1048576 2024-09-19T13:47:34.749 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.745+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~TL3H1EEMPKVE.1 size=220217 2024-09-19T13:47:34.754 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.749+0000 7fcf3240c8c0 1 < completed multipart upload key=6DFF2OCPT9W2 upload=TL3H1EEMPKVE tag=DRIBKE3BDX5J type=write size=2317369 2024-09-19T13:47:34.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.753+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=7V1I1MS6F6SQ type=del size=1048928 2024-09-19T13:47:34.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.757+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~66N8AY6UXFHN.0 size=1048576 2024-09-19T13:47:34.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.761+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~66N8AY6UXFHN.1 size=1048576 2024-09-19T13:47:34.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.761+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~66N8AY6UXFHN.2 size=485869 2024-09-19T13:47:34.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.769+0000 7fcf3240c8c0 1 < completed multipart upload key=OA9BMSXGYR9T upload=66N8AY6UXFHN tag=UQ3IH0XYNND1 type=write size=3631597 2024-09-19T13:47:34.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.769+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=TVRTJWYHJD1I type=del size=3388101 2024-09-19T13:47:34.777 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.773+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~S0ME2EPFW6NN.0 size=1048576 2024-09-19T13:47:34.780 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.777+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~S0ME2EPFW6NN.1 size=344336 2024-09-19T13:47:34.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.781+0000 7fcf3240c8c0 1 < completed multipart upload key=OA9BMSXGYR9T upload=S0ME2EPFW6NN tag=EF8KFO8O5W6K type=write size=2441488 2024-09-19T13:47:34.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.789+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~9AKZ74PPZJL5.0 size=1048576 2024-09-19T13:47:34.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.789+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~9AKZ74PPZJL5.1 size=185098 2024-09-19T13:47:34.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.789+0000 7fcf3240c8c0 1 > prepared multipart upload key=DHPONKOVS8CT upload=9AKZ74PPZJL5 tag=04RVGRQ6CRN3 type=write size=2282250 2024-09-19T13:47:34.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.793+0000 7fcf3240c8c0 1 < completed delete operation key=STMT6XU2EJQM tag=0YG6WO2TJSKS type=del 2024-09-19T13:47:34.801 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.797+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=U606ZNTCBAB4 type=del size=1699649 2024-09-19T13:47:34.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.801+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=JX1MJA5KD0GH type=del 2024-09-19T13:47:34.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.805+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=LL9PZ2TYWUPO type=del size=2717272 2024-09-19T13:47:34.814 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.809+0000 7fcf3240c8c0 1 < suggested update operation key=C35EUAOWLBR3 tag=QE144VS2E2T8 type=del size=2104821 2024-09-19T13:47:34.818 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.817+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~TAZJSN2Y68IU.0 size=1048576 2024-09-19T13:47:34.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.817+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~TAZJSN2Y68IU.1 size=127033 2024-09-19T13:47:34.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.817+0000 7fcf3240c8c0 1 > prepared multipart upload key=X9FGPMP30X47 upload=TAZJSN2Y68IU tag=SQKN7GD1LLGC type=write size=2224185 2024-09-19T13:47:34.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.821+0000 7fcf3240c8c0 1 < suggested update operation key=AES54TJK7VH7 tag=YJ19P2NCETQR type=del size=2943129 2024-09-19T13:47:34.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.829+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~YZ13ACDNCY5A.0 size=1048576 2024-09-19T13:47:34.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.833+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~YZ13ACDNCY5A.1 size=686577 2024-09-19T13:47:34.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.833+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=YZ13ACDNCY5A tag=EPL9GTK83ODC type=write size=2783729 2024-09-19T13:47:34.839 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.837+0000 7fcf3240c8c0 1 < completed delete operation key=M2CO4A2DHJ05 tag=VCY9AEJ05MX3 type=del 2024-09-19T13:47:34.841 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.837+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=7MI4P33A5II5 type=del size=1389759 2024-09-19T13:47:34.845 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.841+0000 7fcf3240c8c0 1 < canceled operation key=QMSDNKYFFK1F tag=H0CT9V8XPMOJ type=write size=129962 2024-09-19T13:47:34.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.845+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=TKSZQS4VGPAH type=del size=2385111 2024-09-19T13:47:34.851 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.849+0000 7fcf3240c8c0 1 < completed delete operation key=A02RDP6BA9AC tag=07UTOHLZ5BYQ type=del 2024-09-19T13:47:34.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.853+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~N39GSEMUDSZK.0 size=528590 2024-09-19T13:47:34.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.853+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=N39GSEMUDSZK tag=TQLN4RVVV6GO type=write size=1577166 2024-09-19T13:47:34.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.857+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=KC4K7VHK9G7U type=del 2024-09-19T13:47:34.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.861+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=EBTFTJHCIQ7E type=del size=1606609 2024-09-19T13:47:34.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.865+0000 7fcf3240c8c0 1 < suggested remove operation key=X9FGPMP30X47 tag=ID5HPRVS7IRS type=del 2024-09-19T13:47:34.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.869+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=GRXJ0FP967AA type=write size=262235 2024-09-19T13:47:34.875 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.873+0000 7fcf3240c8c0 1 < completed delete operation key=0UCFTOF1YBBM tag=T102ADAEB9GE type=del 2024-09-19T13:47:34.879 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.877+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~RV8GM10V9G3X.0 size=1048576 2024-09-19T13:47:34.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.877+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~RV8GM10V9G3X.1 size=1048576 2024-09-19T13:47:34.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.881+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~RV8GM10V9G3X.2 size=960425 2024-09-19T13:47:34.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.881+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=RV8GM10V9G3X tag=LHXYXYNU5J4A type=write size=4106153 2024-09-19T13:47:34.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.885+0000 7fcf3240c8c0 1 < completed delete operation key=1BMF3S2BZLLI tag=DOY19T620UPU type=del 2024-09-19T13:47:34.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.885+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=50PBWAACH35A type=write size=889982 2024-09-19T13:47:34.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.889+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~9M6N016BFE8O.0 size=1048576 2024-09-19T13:47:34.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.889+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~9M6N016BFE8O.1 size=623942 2024-09-19T13:47:34.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.893+0000 7fcf3240c8c0 1 < completed multipart upload key=M2CO4A2DHJ05 upload=9M6N016BFE8O tag=352YXJOOVKLL type=write size=2721094 2024-09-19T13:47:34.900 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.897+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=7R6UOY28JYUE type=del size=1147148 2024-09-19T13:47:34.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.901+0000 7fcf3240c8c0 1 < completed delete operation key=V8X0VBBNK83J tag=WSFEEHIDTYF5 type=del 2024-09-19T13:47:34.905 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.901+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=M41MAKM2W8XD type=write size=1006008 2024-09-19T13:47:34.908 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.905+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=7V1I1MS6F6SQ type=del 2024-09-19T13:47:34.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.909+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=WRM0J2ZX1T5F type=del size=2092960 2024-09-19T13:47:34.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.913+0000 7fcf3240c8c0 1 < completed delete operation key=V8X0VBBNK83J tag=TVRTJWYHJD1I type=del 2024-09-19T13:47:34.918 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.917+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=GKCAYKPWC3FZ type=del size=2443916 2024-09-19T13:47:34.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.917+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~9AKZ74PPZJL5.0 size=1048576 2024-09-19T13:47:34.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.921+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~9AKZ74PPZJL5.1 size=185098 2024-09-19T13:47:34.928 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.925+0000 7fcf3240c8c0 1 < completed multipart upload key=DHPONKOVS8CT upload=9AKZ74PPZJL5 tag=04RVGRQ6CRN3 type=write size=2282250 2024-09-19T13:47:34.934 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.929+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~R0899NCJZHQ5.0 size=1048576 2024-09-19T13:47:34.936 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.933+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~R0899NCJZHQ5.1 size=88440 2024-09-19T13:47:34.936 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.933+0000 7fcf3240c8c0 1 > prepared multipart upload key=1BMF3S2BZLLI upload=R0899NCJZHQ5 tag=0AZLWXAMN12S type=write size=2185592 2024-09-19T13:47:34.939 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.937+0000 7fcf3240c8c0 -1 < failed to complete operation key=X9FGPMP30X47 tag=U606ZNTCBAB4 type=del size=1699649: (22) Invalid argument 2024-09-19T13:47:34.942 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.937+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=8FE7WIIBLY0D type=write size=589583 2024-09-19T13:47:34.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.941+0000 7fcf3240c8c0 1 < completed delete operation key=HXMZKP7H3HJE tag=LL9PZ2TYWUPO type=del 2024-09-19T13:47:34.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.945+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~U2DUTW4GPQR9.0 size=1048576 2024-09-19T13:47:34.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.949+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~U2DUTW4GPQR9.1 size=984437 2024-09-19T13:47:34.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.949+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=U2DUTW4GPQR9 tag=9498GNSETZE6 type=write size=3081589 2024-09-19T13:47:34.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.953+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~TAZJSN2Y68IU.0 size=1048576 2024-09-19T13:47:34.956 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.953+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~TAZJSN2Y68IU.1 size=127033 2024-09-19T13:47:34.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.957+0000 7fcf3240c8c0 1 < completed multipart upload key=X9FGPMP30X47 upload=TAZJSN2Y68IU tag=SQKN7GD1LLGC type=write size=2224185 2024-09-19T13:47:34.967 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.965+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~B737EZWC110W.0 size=1048576 2024-09-19T13:47:34.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.965+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~B737EZWC110W.1 size=1048576 2024-09-19T13:47:34.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.969+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~B737EZWC110W.2 size=203932 2024-09-19T13:47:34.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.969+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=B737EZWC110W tag=1Y7XGY448MS9 type=write size=3349660 2024-09-19T13:47:34.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.973+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~YZ13ACDNCY5A.0 size=1048576 2024-09-19T13:47:34.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.973+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~YZ13ACDNCY5A.1 size=686577 2024-09-19T13:47:34.984 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.981+0000 7fcf3240c8c0 1 < completed multipart upload key=QMSDNKYFFK1F upload=YZ13ACDNCY5A tag=EPL9GTK83ODC type=write size=2783729 2024-09-19T13:47:34.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.985+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~LPMSOYGPXX9X.0 size=259518 2024-09-19T13:47:34.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.985+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=LPMSOYGPXX9X tag=170E50VLI4ST type=write size=1308094 2024-09-19T13:47:34.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.989+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=7MI4P33A5II5 type=del 2024-09-19T13:47:34.998 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.993+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~K30F78U36X7I.0 size=1048576 2024-09-19T13:47:35.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:34.997+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~K30F78U36X7I.1 size=1048576 2024-09-19T13:47:35.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.001+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~K30F78U36X7I.2 size=626060 2024-09-19T13:47:35.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.001+0000 7fcf3240c8c0 1 > prepared multipart upload key=3TME221SA53E upload=K30F78U36X7I tag=XWCVY8TFKRAC type=write size=3771788 2024-09-19T13:47:35.005 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.001+0000 7fcf3240c8c0 1 < completed delete operation key=QSM2Q8CW1Q86 tag=TKSZQS4VGPAH type=del 2024-09-19T13:47:35.009 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.005+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~Z4Q61ZK32TNQ.0 size=1048576 2024-09-19T13:47:35.011 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.009+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~Z4Q61ZK32TNQ.1 size=336776 2024-09-19T13:47:35.011 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.009+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=Z4Q61ZK32TNQ tag=JNJIWJ4I0MXC type=write size=2433928 2024-09-19T13:47:35.014 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.009+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~N39GSEMUDSZK.0 size=528590 2024-09-19T13:47:35.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.017+0000 7fcf3240c8c0 1 < completed multipart upload key=0UCFTOF1YBBM upload=N39GSEMUDSZK tag=TQLN4RVVV6GO type=write size=1577166 2024-09-19T13:47:35.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.021+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~WN5YLZ3M09PO.0 size=1048576 2024-09-19T13:47:35.026 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.025+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~WN5YLZ3M09PO.1 size=1048576 2024-09-19T13:47:35.029 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.025+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~WN5YLZ3M09PO.2 size=678226 2024-09-19T13:47:35.029 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.025+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=WN5YLZ3M09PO tag=WC8O2Z7N197G type=write size=3823954 2024-09-19T13:47:35.031 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.029+0000 7fcf3240c8c0 1 < canceled operation key=A02RDP6BA9AC tag=EBTFTJHCIQ7E type=del size=1606609 2024-09-19T13:47:35.038 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.033+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~EO8V1KQ163FX.0 size=291379 2024-09-19T13:47:35.038 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.033+0000 7fcf3240c8c0 1 > prepared multipart upload key=A02RDP6BA9AC upload=EO8V1KQ163FX tag=RTOFNX6L02D3 type=write size=1339955 2024-09-19T13:47:35.041 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.037+0000 7fcf3240c8c0 1 < completed write operation key=DHPONKOVS8CT tag=GRXJ0FP967AA type=write size=262235 2024-09-19T13:47:35.044 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.041+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=01KPXCLI1IQA type=write size=1028666 2024-09-19T13:47:35.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.045+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~RV8GM10V9G3X.0 size=1048576 2024-09-19T13:47:35.049 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.045+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~RV8GM10V9G3X.1 size=1048576 2024-09-19T13:47:35.052 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.049+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~RV8GM10V9G3X.2 size=960425 2024-09-19T13:47:35.056 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.053+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=RV8GM10V9G3X tag=LHXYXYNU5J4A type=write size=4106153 2024-09-19T13:47:35.059 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.057+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=3LK0SBXLT5AE type=del size=3299183 2024-09-19T13:47:35.062 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.057+0000 7fcf3240c8c0 1 < completed write operation key=C8T6DB9V9FBT tag=50PBWAACH35A type=write size=889982 2024-09-19T13:47:35.067 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.065+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~V6F8YM0JEPP2.0 size=1048576 2024-09-19T13:47:35.069 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.065+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~V6F8YM0JEPP2.1 size=689753 2024-09-19T13:47:35.069 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.065+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=V6F8YM0JEPP2 tag=BKS5BI1YYLYL type=write size=2786905 2024-09-19T13:47:35.072 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.069+0000 7fcf3240c8c0 1 < completed delete operation key=ZCKKQ1R8318S tag=7R6UOY28JYUE type=del 2024-09-19T13:47:35.075 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.073+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=FSTGWM5W1LPW type=del size=3000166 2024-09-19T13:47:35.078 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.073+0000 7fcf3240c8c0 1 < completed write operation key=X9FGPMP30X47 tag=M41MAKM2W8XD type=write size=1006008 2024-09-19T13:47:35.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.081+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~443YE5LAGF11.0 size=1048576 2024-09-19T13:47:35.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.085+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~443YE5LAGF11.1 size=532958 2024-09-19T13:47:35.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.085+0000 7fcf3240c8c0 1 > prepared multipart upload key=71Z2VTW99W7J upload=443YE5LAGF11 tag=NEC9OVC2JGHS type=write size=2630110 2024-09-19T13:47:35.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.089+0000 7fcf3240c8c0 1 < completed delete operation key=7UC85R2HO9K2 tag=WRM0J2ZX1T5F type=del 2024-09-19T13:47:35.094 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.089+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=9PTQEUJKE4O0 type=del size=1739083 2024-09-19T13:47:35.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.093+0000 7fcf3240c8c0 1 < canceled operation key=NP2L28YRVQ8L tag=GKCAYKPWC3FZ type=del size=2443916 2024-09-19T13:47:35.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.097+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=ZKNS14FP3JB9 type=del size=491852 2024-09-19T13:47:35.101 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.097+0000 7fcf3240c8c0 1 < canceled part key=_multipart_1BMF3S2BZLLI.2~R0899NCJZHQ5.0 size=1048576 2024-09-19T13:47:35.107 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.105+0000 7fcf3240c8c0 1 < completed part key=_multipart_1BMF3S2BZLLI.2~R0899NCJZHQ5.1 size=88440 2024-09-19T13:47:35.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.109+0000 7fcf3240c8c0 1 < canceled multipart upload key=1BMF3S2BZLLI upload=R0899NCJZHQ5 tag=0AZLWXAMN12S type=write size=2185592 2024-09-19T13:47:35.116 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.113+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=Z0F3VVH2CZ19 type=del size=2004309 2024-09-19T13:47:35.119 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.117+0000 7fcf3240c8c0 1 < completed write operation key=XE42LV5M5X82 tag=8FE7WIIBLY0D type=write size=589583 2024-09-19T13:47:35.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.121+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=HKP7MCLTTN03 type=del size=3389252 2024-09-19T13:47:35.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.121+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~U2DUTW4GPQR9.0 size=1048576 2024-09-19T13:47:35.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.125+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~U2DUTW4GPQR9.1 size=984437 2024-09-19T13:47:35.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.129+0000 7fcf3240c8c0 1 < completed multipart upload key=N51Q6HKJSCCB upload=U2DUTW4GPQR9 tag=9498GNSETZE6 type=write size=3081589 2024-09-19T13:47:35.137 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.133+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=EAJ80CSVF7I3 type=del size=1689169 2024-09-19T13:47:35.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.137+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~B737EZWC110W.0 size=1048576 2024-09-19T13:47:35.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.141+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~B737EZWC110W.1 size=1048576 2024-09-19T13:47:35.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.141+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~B737EZWC110W.2 size=203932 2024-09-19T13:47:35.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.145+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=B737EZWC110W tag=1Y7XGY448MS9 type=write size=3349660 2024-09-19T13:47:35.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.149+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=5P7FNB46XHOE type=write size=174914 2024-09-19T13:47:35.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.153+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~LPMSOYGPXX9X.0 size=259518 2024-09-19T13:47:35.161 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.157+0000 7fcf3240c8c0 1 < completed multipart upload key=QSM2Q8CW1Q86 upload=LPMSOYGPXX9X tag=170E50VLI4ST type=write size=1308094 2024-09-19T13:47:35.167 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.165+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~Z41EK7YMM2BO.0 size=1048576 2024-09-19T13:47:35.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.165+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~Z41EK7YMM2BO.1 size=1048576 2024-09-19T13:47:35.173 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.169+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~Z41EK7YMM2BO.2 size=636953 2024-09-19T13:47:35.173 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.169+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=Z41EK7YMM2BO tag=JX7G68X4P8SJ type=write size=3782681 2024-09-19T13:47:35.176 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.173+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~K30F78U36X7I.0 size=1048576 2024-09-19T13:47:35.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.177+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~K30F78U36X7I.1 size=1048576 2024-09-19T13:47:35.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.177+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~K30F78U36X7I.2 size=626060 2024-09-19T13:47:35.186 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.185+0000 7fcf3240c8c0 1 < completed multipart upload key=3TME221SA53E upload=K30F78U36X7I tag=XWCVY8TFKRAC type=write size=3771788 2024-09-19T13:47:35.189 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.185+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=O1N9B8J2H1F7 type=del size=2802152 2024-09-19T13:47:35.192 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.189+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~Z4Q61ZK32TNQ.0 size=1048576 2024-09-19T13:47:35.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.193+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~Z4Q61ZK32TNQ.1 size=336776 2024-09-19T13:47:35.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.197+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=Z4Q61ZK32TNQ tag=JNJIWJ4I0MXC type=write size=2433928 2024-09-19T13:47:35.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.201+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=LCK7BKF9RSZF type=del size=1913725 2024-09-19T13:47:35.206 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.205+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~WN5YLZ3M09PO.0 size=1048576 2024-09-19T13:47:35.209 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.205+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~WN5YLZ3M09PO.1 size=1048576 2024-09-19T13:47:35.212 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.209+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~WN5YLZ3M09PO.2 size=678226 2024-09-19T13:47:35.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.213+0000 7fcf3240c8c0 1 < completed multipart upload key=QAYJ5B1KZ08J upload=WN5YLZ3M09PO tag=WC8O2Z7N197G type=write size=3823954 2024-09-19T13:47:35.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.221+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~LYNQIWK232NC.0 size=214276 2024-09-19T13:47:35.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.221+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=LYNQIWK232NC tag=RWKZ01OOY8DB type=write size=1262852 2024-09-19T13:47:35.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.225+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~EO8V1KQ163FX.0 size=291379 2024-09-19T13:47:35.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.229+0000 7fcf3240c8c0 1 < completed multipart upload key=A02RDP6BA9AC upload=EO8V1KQ163FX tag=RTOFNX6L02D3 type=write size=1339955 2024-09-19T13:47:35.238 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.237+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~74GIHSD9224T.0 size=1048576 2024-09-19T13:47:35.241 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.237+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~74GIHSD9224T.1 size=788771 2024-09-19T13:47:35.241 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.237+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=74GIHSD9224T tag=YAQGUJAF8EDO type=write size=2885923 2024-09-19T13:47:35.244 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.241+0000 7fcf3240c8c0 1 < completed write operation key=ES62XJO5Q3FO tag=01KPXCLI1IQA type=write size=1028666 2024-09-19T13:47:35.250 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.249+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~7RTZZXE6QSLB.0 size=1048576 2024-09-19T13:47:35.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.249+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~7RTZZXE6QSLB.1 size=1048576 2024-09-19T13:47:35.255 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.253+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~7RTZZXE6QSLB.2 size=765538 2024-09-19T13:47:35.255 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.253+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=7RTZZXE6QSLB tag=XKQOTUQE3UHO type=write size=3911266 2024-09-19T13:47:35.261 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.257+0000 7fcf3240c8c0 1 < suggested remove operation key=QAYJ5B1KZ08J tag=3LK0SBXLT5AE type=del 2024-09-19T13:47:35.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.261+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=3U44S7RN9CLN type=del size=1215158 2024-09-19T13:47:35.267 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.265+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~V6F8YM0JEPP2.0 size=1048576 2024-09-19T13:47:35.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.265+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~V6F8YM0JEPP2.1 size=689753 2024-09-19T13:47:35.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.273+0000 7fcf3240c8c0 1 < completed multipart upload key=QMSDNKYFFK1F upload=V6F8YM0JEPP2 tag=BKS5BI1YYLYL type=write size=2786905 2024-09-19T13:47:35.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.277+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~W5JKVWF3R4CI.0 size=637617 2024-09-19T13:47:35.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.277+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=W5JKVWF3R4CI tag=KOSRN1NQYU2P type=write size=1686193 2024-09-19T13:47:35.284 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.281+0000 7fcf3240c8c0 1 < completed delete operation key=X9FGPMP30X47 tag=FSTGWM5W1LPW type=del 2024-09-19T13:47:35.286 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.285+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=J7BJ1VO3Q8CS type=del size=481839 2024-09-19T13:47:35.287 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.285+0000 7fcf3240c8c0 1 < canceled part key=_multipart_71Z2VTW99W7J.2~443YE5LAGF11.0 size=1048576 2024-09-19T13:47:35.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.285+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~443YE5LAGF11.1 size=532958 2024-09-19T13:47:35.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.289+0000 7fcf3240c8c0 1 < canceled multipart upload key=71Z2VTW99W7J upload=443YE5LAGF11 tag=NEC9OVC2JGHS type=write size=2630110 2024-09-19T13:47:35.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.293+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=PR8G7Q65ZZKC type=del size=1555969 2024-09-19T13:47:35.300 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.297+0000 7fcf3240c8c0 1 < completed delete operation key=C8T6DB9V9FBT tag=9PTQEUJKE4O0 type=del 2024-09-19T13:47:35.305 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.301+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~97DLVFLLRJ69.0 size=1048576 2024-09-19T13:47:35.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.305+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~97DLVFLLRJ69.1 size=37077 2024-09-19T13:47:35.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.305+0000 7fcf3240c8c0 1 > prepared multipart upload key=X9FGPMP30X47 upload=97DLVFLLRJ69 tag=22Z6KFVS2MIG type=write size=2134229 2024-09-19T13:47:35.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.309+0000 7fcf3240c8c0 1 < completed delete operation key=V8X0VBBNK83J tag=ZKNS14FP3JB9 type=del 2024-09-19T13:47:35.313 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.309+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=J837UES5WJV3 type=del size=1994674 2024-09-19T13:47:35.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.317+0000 7fcf3240c8c0 1 < suggested remove operation key=X9FGPMP30X47 tag=Z0F3VVH2CZ19 type=del 2024-09-19T13:47:35.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.317+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=3LDR8GJI3KTC type=write size=1017990 2024-09-19T13:47:35.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.325+0000 7fcf3240c8c0 1 < suggested remove operation key=NP2L28YRVQ8L tag=HKP7MCLTTN03 type=del 2024-09-19T13:47:35.332 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.329+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~DU7JUQYUTR6N.0 size=1048576 2024-09-19T13:47:35.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.333+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~DU7JUQYUTR6N.1 size=82402 2024-09-19T13:47:35.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.333+0000 7fcf3240c8c0 1 > prepared multipart upload key=STMT6XU2EJQM upload=DU7JUQYUTR6N tag=G2YPZHEFF6T7 type=write size=2179554 2024-09-19T13:47:35.337 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.333+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=EAJ80CSVF7I3 type=del 2024-09-19T13:47:35.340 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.337+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=YXM0W5950OOG type=del size=1959348 2024-09-19T13:47:35.342 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.341+0000 7fcf3240c8c0 1 < completed write operation key=0U9BUX9DHTAK tag=5P7FNB46XHOE type=write size=174914 2024-09-19T13:47:35.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.345+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~PR3YVWW18B5Q.0 size=381113 2024-09-19T13:47:35.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.345+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=PR3YVWW18B5Q tag=OYTZKRS1902L type=write size=1429689 2024-09-19T13:47:35.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.345+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~Z41EK7YMM2BO.0 size=1048576 2024-09-19T13:47:35.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.349+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~Z41EK7YMM2BO.1 size=1048576 2024-09-19T13:47:35.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.353+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~Z41EK7YMM2BO.2 size=636953 2024-09-19T13:47:35.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.357+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=Z41EK7YMM2BO tag=JX7G68X4P8SJ type=write size=3782681 2024-09-19T13:47:35.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.357+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=MZB26JWLNNJH type=del size=815548 2024-09-19T13:47:35.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.361+0000 7fcf3240c8c0 -1 < failed to complete operation key=QAYJ5B1KZ08J tag=O1N9B8J2H1F7 type=del size=2802152: (22) Invalid argument 2024-09-19T13:47:35.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.369+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~IFSKTQK15N34.0 size=1048576 2024-09-19T13:47:35.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.373+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~IFSKTQK15N34.1 size=1048576 2024-09-19T13:47:35.378 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.373+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~IFSKTQK15N34.2 size=812431 2024-09-19T13:47:35.378 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.373+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=IFSKTQK15N34 tag=JTHEIJ9UP4JX type=write size=3958159 2024-09-19T13:47:35.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.377+0000 7fcf3240c8c0 -1 < failed to complete operation key=NP2L28YRVQ8L tag=LCK7BKF9RSZF type=del size=1913725: (22) Invalid argument 2024-09-19T13:47:35.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.381+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=UCPSDYAAQ9PY type=del size=3159039 2024-09-19T13:47:35.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.389+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~LYNQIWK232NC.0 size=214276 2024-09-19T13:47:35.395 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.393+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=LYNQIWK232NC tag=RWKZ01OOY8DB type=write size=1262852 2024-09-19T13:47:35.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.393+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=EQF91965DKVO type=del size=2864499 2024-09-19T13:47:35.400 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.397+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~74GIHSD9224T.0 size=1048576 2024-09-19T13:47:35.402 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.401+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~74GIHSD9224T.1 size=788771 2024-09-19T13:47:35.407 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.405+0000 7fcf3240c8c0 1 < completed multipart upload key=QMSDNKYFFK1F upload=74GIHSD9224T tag=YAQGUJAF8EDO type=write size=2885923 2024-09-19T13:47:35.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.409+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~F89M23RMJCHG.0 size=184326 2024-09-19T13:47:35.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.409+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=F89M23RMJCHG tag=KJW8JLMB2BWN type=write size=1232902 2024-09-19T13:47:35.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.413+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~7RTZZXE6QSLB.0 size=1048576 2024-09-19T13:47:35.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.413+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~7RTZZXE6QSLB.1 size=1048576 2024-09-19T13:47:35.420 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.417+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~7RTZZXE6QSLB.2 size=765538 2024-09-19T13:47:35.424 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.421+0000 7fcf3240c8c0 1 < completed multipart upload key=XE42LV5M5X82 upload=7RTZZXE6QSLB tag=XKQOTUQE3UHO type=write size=3911266 2024-09-19T13:47:35.430 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.429+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~LNTLZNXN2BZD.0 size=1048576 2024-09-19T13:47:35.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.429+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~LNTLZNXN2BZD.1 size=214812 2024-09-19T13:47:35.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.429+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=LNTLZNXN2BZD tag=DK7SPSLRUJ67 type=write size=2311964 2024-09-19T13:47:35.438 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.437+0000 7fcf3240c8c0 1 < suggested update operation key=7UC85R2HO9K2 tag=3U44S7RN9CLN type=del size=1215158 2024-09-19T13:47:35.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.441+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~S1G16YZ1SWRM.0 size=1048576 2024-09-19T13:47:35.445 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.441+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~S1G16YZ1SWRM.1 size=774976 2024-09-19T13:47:35.445 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.441+0000 7fcf3240c8c0 1 > prepared multipart upload key=X9FGPMP30X47 upload=S1G16YZ1SWRM tag=F4JJ0MPSCMUY type=write size=2872128 2024-09-19T13:47:35.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.445+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~W5JKVWF3R4CI.0 size=637617 2024-09-19T13:47:35.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.449+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=W5JKVWF3R4CI tag=KOSRN1NQYU2P type=write size=1686193 2024-09-19T13:47:35.458 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.457+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~MTMM28BW41ZL.0 size=1048576 2024-09-19T13:47:35.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.457+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~MTMM28BW41ZL.1 size=647793 2024-09-19T13:47:35.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.457+0000 7fcf3240c8c0 1 > prepared multipart upload key=6DFF2OCPT9W2 upload=MTMM28BW41ZL tag=QTEHPHDN7TYC type=write size=2744945 2024-09-19T13:47:35.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.461+0000 7fcf3240c8c0 1 < completed delete operation key=X16ENUFL40RN tag=J7BJ1VO3Q8CS type=del 2024-09-19T13:47:35.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.461+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=XNUSLKESS19L type=write size=753511 2024-09-19T13:47:35.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.465+0000 7fcf3240c8c0 1 < completed delete operation key=ZCKKQ1R8318S tag=PR8G7Q65ZZKC type=del 2024-09-19T13:47:35.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.469+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~JMM17A4J35Y5.0 size=834789 2024-09-19T13:47:35.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.469+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=JMM17A4J35Y5 tag=MFC5E5QK60VX type=write size=1883365 2024-09-19T13:47:35.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.469+0000 7fcf3240c8c0 1 < canceled part key=_multipart_X9FGPMP30X47.2~97DLVFLLRJ69.0 size=1048576 2024-09-19T13:47:35.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.473+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~97DLVFLLRJ69.1 size=37077 2024-09-19T13:47:35.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.477+0000 7fcf3240c8c0 1 < canceled multipart upload key=X9FGPMP30X47 upload=97DLVFLLRJ69 tag=22Z6KFVS2MIG type=write size=2134229 2024-09-19T13:47:35.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.481+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~TEVUVNEDC6ZF.0 size=512585 2024-09-19T13:47:35.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.481+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=TEVUVNEDC6ZF tag=8ER5012UD8Z2 type=write size=1561161 2024-09-19T13:47:35.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.485+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=J837UES5WJV3 type=del 2024-09-19T13:47:35.492 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.489+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=SRL3VJ411NES type=del size=3259026 2024-09-19T13:47:35.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.493+0000 7fcf3240c8c0 1 < completed write operation key=BXUPV5XSJBTH tag=3LDR8GJI3KTC type=write size=1017990 2024-09-19T13:47:35.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.493+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=E7H139OWG61K type=del size=1710969 2024-09-19T13:47:35.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.497+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~DU7JUQYUTR6N.0 size=1048576 2024-09-19T13:47:35.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.501+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~DU7JUQYUTR6N.1 size=82402 2024-09-19T13:47:35.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.505+0000 7fcf3240c8c0 1 < completed multipart upload key=STMT6XU2EJQM upload=DU7JUQYUTR6N tag=G2YPZHEFF6T7 type=write size=2179554 2024-09-19T13:47:35.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.509+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~K1RYO1PM21XO.0 size=1048576 2024-09-19T13:47:35.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.509+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~K1RYO1PM21XO.1 size=481671 2024-09-19T13:47:35.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.509+0000 7fcf3240c8c0 1 > prepared multipart upload key=X16ENUFL40RN upload=K1RYO1PM21XO tag=BHTB6YY3D0ZH type=write size=2578823 2024-09-19T13:47:35.517 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.513+0000 7fcf3240c8c0 1 < completed delete operation key=D1RMXGXS3O7Z tag=YXM0W5950OOG type=del 2024-09-19T13:47:35.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.517+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=I3VN708H9XTT type=del size=2169932 2024-09-19T13:47:35.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.521+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~PR3YVWW18B5Q.0 size=381113 2024-09-19T13:47:35.527 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.525+0000 7fcf3240c8c0 1 < completed multipart upload key=QSM2Q8CW1Q86 upload=PR3YVWW18B5Q tag=OYTZKRS1902L type=write size=1429689 2024-09-19T13:47:35.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.529+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~92UXZYZZV1VI.0 size=95775 2024-09-19T13:47:35.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.529+0000 7fcf3240c8c0 1 > prepared multipart upload key=OA9BMSXGYR9T upload=92UXZYZZV1VI tag=E83S5I6Y5DET type=write size=1144351 2024-09-19T13:47:35.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.533+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=MZB26JWLNNJH type=del 2024-09-19T13:47:35.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.533+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=KK8M6H7SDEOQ type=del size=1057976 2024-09-19T13:47:35.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.537+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~IFSKTQK15N34.0 size=1048576 2024-09-19T13:47:35.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.541+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~IFSKTQK15N34.1 size=1048576 2024-09-19T13:47:35.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.541+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~IFSKTQK15N34.2 size=812431 2024-09-19T13:47:35.549 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.545+0000 7fcf3240c8c0 1 < completed multipart upload key=AES54TJK7VH7 upload=IFSKTQK15N34 tag=JTHEIJ9UP4JX type=write size=3958159 2024-09-19T13:47:35.554 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.549+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~X6WFTKF4PL1L.0 size=1048576 2024-09-19T13:47:35.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.553+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~X6WFTKF4PL1L.1 size=1002811 2024-09-19T13:47:35.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.553+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=X6WFTKF4PL1L tag=G8X22EEEWTQ7 type=write size=3099963 2024-09-19T13:47:35.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.557+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=UCPSDYAAQ9PY type=del 2024-09-19T13:47:35.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.561+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=JONA99OD5FXY type=write size=421726 2024-09-19T13:47:35.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.561+0000 7fcf3240c8c0 -1 < failed to complete operation key=7UC85R2HO9K2 tag=EQF91965DKVO type=del size=2864499: (22) Invalid argument 2024-09-19T13:47:35.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.565+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=G7AUH5TOO08K type=write size=1041551 2024-09-19T13:47:35.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.569+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~F89M23RMJCHG.0 size=184326 2024-09-19T13:47:35.575 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.573+0000 7fcf3240c8c0 1 < completed multipart upload key=QMSDNKYFFK1F upload=F89M23RMJCHG tag=KJW8JLMB2BWN type=write size=1232902 2024-09-19T13:47:35.579 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.577+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~N6UID7B2RZOD.0 size=499734 2024-09-19T13:47:35.579 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.577+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=N6UID7B2RZOD tag=JSL2D7X816LM type=write size=1548310 2024-09-19T13:47:35.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.577+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~LNTLZNXN2BZD.0 size=1048576 2024-09-19T13:47:35.590 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.589+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~LNTLZNXN2BZD.1 size=214812 2024-09-19T13:47:35.595 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.593+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=LNTLZNXN2BZD tag=DK7SPSLRUJ67 type=write size=2311964 2024-09-19T13:47:35.599 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.597+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~P7FDSQWCQDP4.0 size=1048576 2024-09-19T13:47:35.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.597+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~P7FDSQWCQDP4.1 size=1048576 2024-09-19T13:47:35.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.601+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~P7FDSQWCQDP4.2 size=380372 2024-09-19T13:47:35.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.601+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=P7FDSQWCQDP4 tag=7NHMTS08SOV1 type=write size=3526100 2024-09-19T13:47:35.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.605+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~S1G16YZ1SWRM.0 size=1048576 2024-09-19T13:47:35.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.605+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~S1G16YZ1SWRM.1 size=774976 2024-09-19T13:47:35.613 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.609+0000 7fcf3240c8c0 1 < completed multipart upload key=X9FGPMP30X47 upload=S1G16YZ1SWRM tag=F4JJ0MPSCMUY type=write size=2872128 2024-09-19T13:47:35.618 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.617+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~KVFGQME9GW6E.0 size=1048576 2024-09-19T13:47:35.620 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.617+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~KVFGQME9GW6E.1 size=1048576 2024-09-19T13:47:35.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.621+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~KVFGQME9GW6E.2 size=800634 2024-09-19T13:47:35.623 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.621+0000 7fcf3240c8c0 1 > prepared multipart upload key=STMT6XU2EJQM upload=KVFGQME9GW6E tag=YBNO142UQ2ZU type=write size=3946362 2024-09-19T13:47:35.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.621+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~MTMM28BW41ZL.0 size=1048576 2024-09-19T13:47:35.627 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.625+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~MTMM28BW41ZL.1 size=647793 2024-09-19T13:47:35.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.629+0000 7fcf3240c8c0 1 < completed multipart upload key=6DFF2OCPT9W2 upload=MTMM28BW41ZL tag=QTEHPHDN7TYC type=write size=2744945 2024-09-19T13:47:35.635 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.633+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=YXXFHS71T04K type=del size=671326 2024-09-19T13:47:35.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.633+0000 7fcf3240c8c0 1 < completed write operation key=AES54TJK7VH7 tag=XNUSLKESS19L type=write size=753511 2024-09-19T13:47:35.640 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.637+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=NA2KXJI0HV5B type=del size=3964096 2024-09-19T13:47:35.644 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.641+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~JMM17A4J35Y5.0 size=834789 2024-09-19T13:47:35.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.649+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=JMM17A4J35Y5 tag=MFC5E5QK60VX type=write size=1883365 2024-09-19T13:47:35.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.653+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=RXXJUEUDPP7Q type=write size=361800 2024-09-19T13:47:35.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.657+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~TEVUVNEDC6ZF.0 size=512585 2024-09-19T13:47:35.664 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.661+0000 7fcf3240c8c0 1 < completed multipart upload key=ES62XJO5Q3FO upload=TEVUVNEDC6ZF tag=8ER5012UD8Z2 type=write size=1561161 2024-09-19T13:47:35.667 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.665+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=YZ02UHCLFXLC type=del size=2769649 2024-09-19T13:47:35.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.665+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=SRL3VJ411NES type=del 2024-09-19T13:47:35.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.669+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=VTWDJYJT7WMN type=del size=2116624 2024-09-19T13:47:35.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.673+0000 7fcf3240c8c0 1 < completed delete operation key=N51Q6HKJSCCB tag=E7H139OWG61K type=del 2024-09-19T13:47:35.681 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.677+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~ZYY0Y8VTDZRY.0 size=1048576 2024-09-19T13:47:35.683 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.681+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~ZYY0Y8VTDZRY.1 size=1048576 2024-09-19T13:47:35.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.681+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~ZYY0Y8VTDZRY.2 size=299887 2024-09-19T13:47:35.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.681+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=ZYY0Y8VTDZRY tag=14AAWQPHUVPJ type=write size=3445615 2024-09-19T13:47:35.688 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.685+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~K1RYO1PM21XO.0 size=1048576 2024-09-19T13:47:35.690 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.689+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~K1RYO1PM21XO.1 size=481671 2024-09-19T13:47:35.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.693+0000 7fcf3240c8c0 1 < completed multipart upload key=X16ENUFL40RN upload=K1RYO1PM21XO tag=BHTB6YY3D0ZH type=write size=2578823 2024-09-19T13:47:35.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.697+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=BU7XPMQXPOVO type=del size=1565804 2024-09-19T13:47:35.702 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.697+0000 7fcf3240c8c0 1 < canceled operation key=A02RDP6BA9AC tag=I3VN708H9XTT type=del size=2169932 2024-09-19T13:47:35.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.701+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=42Y0OUJDZ7VO type=del size=1720069 2024-09-19T13:47:35.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.701+0000 7fcf3240c8c0 1 < canceled part key=_multipart_OA9BMSXGYR9T.2~92UXZYZZV1VI.0 size=95775 2024-09-19T13:47:35.710 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.705+0000 7fcf3240c8c0 1 < canceled multipart upload key=OA9BMSXGYR9T upload=92UXZYZZV1VI tag=E83S5I6Y5DET type=write size=1144351 2024-09-19T13:47:35.713 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.709+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=0CF2ATQJE7X7 type=del size=1695521 2024-09-19T13:47:35.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.713+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=KK8M6H7SDEOQ type=del 2024-09-19T13:47:35.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.717+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=HCVQR0V0P7JC type=write size=1004019 2024-09-19T13:47:35.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.721+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~X6WFTKF4PL1L.0 size=1048576 2024-09-19T13:47:35.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.725+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~X6WFTKF4PL1L.1 size=1002811 2024-09-19T13:47:35.732 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.729+0000 7fcf3240c8c0 1 < completed multipart upload key=NP2L28YRVQ8L upload=X6WFTKF4PL1L tag=G8X22EEEWTQ7 type=write size=3099963 2024-09-19T13:47:35.735 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.733+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=8C1QTRL6E6XC type=write size=738836 2024-09-19T13:47:35.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.737+0000 7fcf3240c8c0 1 < completed write operation key=NP2L28YRVQ8L tag=JONA99OD5FXY type=write size=421726 2024-09-19T13:47:35.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.741+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=HDOLDOSHGSFU type=del size=653122 2024-09-19T13:47:35.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.741+0000 7fcf3240c8c0 1 < canceled operation key=ES62XJO5Q3FO tag=G7AUH5TOO08K type=write size=1041551 2024-09-19T13:47:35.748 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.745+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=O0CQ2UYP0ELT type=write size=196820 2024-09-19T13:47:35.751 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.749+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~N6UID7B2RZOD.0 size=499734 2024-09-19T13:47:35.755 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.753+0000 7fcf3240c8c0 1 < completed multipart upload key=N51Q6HKJSCCB upload=N6UID7B2RZOD tag=JSL2D7X816LM type=write size=1548310 2024-09-19T13:47:35.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.757+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=G4OIC1TSOA3T type=write size=705714 2024-09-19T13:47:35.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.757+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~P7FDSQWCQDP4.0 size=1048576 2024-09-19T13:47:35.764 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.761+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~P7FDSQWCQDP4.1 size=1048576 2024-09-19T13:47:35.766 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.761+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~P7FDSQWCQDP4.2 size=380372 2024-09-19T13:47:35.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.769+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=P7FDSQWCQDP4 tag=7NHMTS08SOV1 type=write size=3526100 2024-09-19T13:47:35.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.769+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=8UZW5UF38F97 type=write size=382694 2024-09-19T13:47:35.776 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.773+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~KVFGQME9GW6E.0 size=1048576 2024-09-19T13:47:35.778 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.777+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~KVFGQME9GW6E.1 size=1048576 2024-09-19T13:47:35.781 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.777+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~KVFGQME9GW6E.2 size=800634 2024-09-19T13:47:35.786 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.781+0000 7fcf3240c8c0 1 < completed multipart upload key=STMT6XU2EJQM upload=KVFGQME9GW6E tag=YBNO142UQ2ZU type=write size=3946362 2024-09-19T13:47:35.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.789+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~BT42Q066FOQZ.0 size=1048576 2024-09-19T13:47:35.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.789+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~BT42Q066FOQZ.1 size=1048576 2024-09-19T13:47:35.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.793+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~BT42Q066FOQZ.2 size=847282 2024-09-19T13:47:35.797 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.793+0000 7fcf3240c8c0 1 > prepared multipart upload key=D1RMXGXS3O7Z upload=BT42Q066FOQZ tag=AUFAFKYHZ2LG type=write size=3993010 2024-09-19T13:47:35.802 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.797+0000 7fcf3240c8c0 1 < suggested update operation key=N51Q6HKJSCCB tag=YXXFHS71T04K type=del size=671326 2024-09-19T13:47:35.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.805+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~PKF1JD5OUINS.0 size=1048576 2024-09-19T13:47:35.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.809+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~PKF1JD5OUINS.1 size=729523 2024-09-19T13:47:35.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.809+0000 7fcf3240c8c0 1 > prepared multipart upload key=C8T6DB9V9FBT upload=PKF1JD5OUINS tag=PUU7P5QWB6IW type=write size=2826675 2024-09-19T13:47:35.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.809+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=NA2KXJI0HV5B type=del 2024-09-19T13:47:35.817 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.813+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=T0JNC4YKI7EZ type=del size=1372117 2024-09-19T13:47:35.820 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.817+0000 7fcf3240c8c0 1 < completed write operation key=BXUPV5XSJBTH tag=RXXJUEUDPP7Q type=write size=361800 2024-09-19T13:47:35.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.821+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=NVSEB6NI0L95 type=del size=2766091 2024-09-19T13:47:35.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.825+0000 7fcf3240c8c0 1 < completed delete operation key=XE42LV5M5X82 tag=YZ02UHCLFXLC type=del 2024-09-19T13:47:35.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.829+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~94F6BX4AQ0RC.0 size=1048576 2024-09-19T13:47:35.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.833+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~94F6BX4AQ0RC.1 size=1048576 2024-09-19T13:47:35.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.833+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~94F6BX4AQ0RC.2 size=362230 2024-09-19T13:47:35.838 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.833+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=94F6BX4AQ0RC tag=TR7HY90FK4PX type=write size=3507958 2024-09-19T13:47:35.844 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.841+0000 7fcf3240c8c0 1 < suggested remove operation key=ES62XJO5Q3FO tag=VTWDJYJT7WMN type=del 2024-09-19T13:47:35.851 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.849+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~KOF1JTDJ19X4.0 size=1048576 2024-09-19T13:47:35.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.849+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~KOF1JTDJ19X4.1 size=297014 2024-09-19T13:47:35.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.849+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=KOF1JTDJ19X4 tag=Q1FSV3BTUNMT type=write size=2394166 2024-09-19T13:47:35.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.853+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~ZYY0Y8VTDZRY.0 size=1048576 2024-09-19T13:47:35.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.857+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~ZYY0Y8VTDZRY.1 size=1048576 2024-09-19T13:47:35.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.861+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~ZYY0Y8VTDZRY.2 size=299887 2024-09-19T13:47:35.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.865+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=ZYY0Y8VTDZRY tag=14AAWQPHUVPJ type=write size=3445615 2024-09-19T13:47:35.876 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.873+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~XR2O2VJ3OFP2.0 size=61655 2024-09-19T13:47:35.876 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.873+0000 7fcf3240c8c0 1 > prepared multipart upload key=6DFF2OCPT9W2 upload=XR2O2VJ3OFP2 tag=0T0690D9Y24Y type=write size=1110231 2024-09-19T13:47:35.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.881+0000 7fcf3240c8c0 1 < suggested update operation key=HXMZKP7H3HJE tag=BU7XPMQXPOVO type=del size=1565804 2024-09-19T13:47:35.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.885+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=T2C41VTTUHT0 type=write size=969406 2024-09-19T13:47:35.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.885+0000 7fcf3240c8c0 1 < completed delete operation key=1BMF3S2BZLLI tag=42Y0OUJDZ7VO type=del 2024-09-19T13:47:35.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.893+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~XOCYWE73VFSF.0 size=578840 2024-09-19T13:47:35.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.893+0000 7fcf3240c8c0 1 > prepared multipart upload key=X9FGPMP30X47 upload=XOCYWE73VFSF tag=S1YMAFNJSZW4 type=write size=1627416 2024-09-19T13:47:35.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.897+0000 7fcf3240c8c0 1 < completed delete operation key=C3TFYNXH549T tag=0CF2ATQJE7X7 type=del 2024-09-19T13:47:35.906 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.901+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=CSUDE8AAR801 type=del size=2545670 2024-09-19T13:47:35.909 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.905+0000 7fcf3240c8c0 1 < completed write operation key=71Z2VTW99W7J tag=HCVQR0V0P7JC type=write size=1004019 2024-09-19T13:47:35.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.909+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=YP4PL9EDIVZ8 type=del size=4007882 2024-09-19T13:47:35.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.913+0000 7fcf3240c8c0 1 < completed write operation key=ZCKKQ1R8318S tag=8C1QTRL6E6XC type=write size=738836 2024-09-19T13:47:35.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.921+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~6PZBPE35I9RG.0 size=1048576 2024-09-19T13:47:35.926 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.925+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~6PZBPE35I9RG.1 size=1048576 2024-09-19T13:47:35.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.925+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~6PZBPE35I9RG.2 size=225316 2024-09-19T13:47:35.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.925+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=6PZBPE35I9RG tag=O2NESRDAFS06 type=write size=3371044 2024-09-19T13:47:35.933 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.929+0000 7fcf3240c8c0 1 < completed delete operation key=0U9BUX9DHTAK tag=HDOLDOSHGSFU type=del 2024-09-19T13:47:35.936 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.933+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=GQO7TFLZZR42 type=del size=2968933 2024-09-19T13:47:35.940 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.937+0000 7fcf3240c8c0 1 < completed write operation key=M2CO4A2DHJ05 tag=O0CQ2UYP0ELT type=write size=196820 2024-09-19T13:47:35.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.941+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~43R6MMWQUB10.0 size=1048576 2024-09-19T13:47:35.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.949+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~43R6MMWQUB10.1 size=407160 2024-09-19T13:47:35.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.949+0000 7fcf3240c8c0 1 > prepared multipart upload key=3TME221SA53E upload=43R6MMWQUB10 tag=592DZ0FB3SQZ type=write size=2504312 2024-09-19T13:47:35.957 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.953+0000 7fcf3240c8c0 1 < completed write operation key=BXUPV5XSJBTH tag=G4OIC1TSOA3T type=write size=705714 2024-09-19T13:47:35.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.957+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=DQXEG00WA0E6 type=del size=719160 2024-09-19T13:47:35.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.965+0000 7fcf3240c8c0 1 < suggested update operation key=9ICCISYXT0IV tag=8UZW5UF38F97 type=write size=382694 2024-09-19T13:47:35.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.969+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=JKL009URH23V type=del size=1665812 2024-09-19T13:47:35.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.969+0000 7fcf3240c8c0 1 < canceled part key=_multipart_D1RMXGXS3O7Z.2~BT42Q066FOQZ.0 size=1048576 2024-09-19T13:47:35.975 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.973+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~BT42Q066FOQZ.1 size=1048576 2024-09-19T13:47:35.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.973+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~BT42Q066FOQZ.2 size=847282 2024-09-19T13:47:35.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.981+0000 7fcf3240c8c0 1 < canceled multipart upload key=D1RMXGXS3O7Z upload=BT42Q066FOQZ tag=AUFAFKYHZ2LG type=write size=3993010 2024-09-19T13:47:35.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.985+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~VE2X82TSRJJY.0 size=1048576 2024-09-19T13:47:35.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.989+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~VE2X82TSRJJY.1 size=227433 2024-09-19T13:47:35.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.989+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=VE2X82TSRJJY tag=IFE1SUK0E8HG type=write size=2324585 2024-09-19T13:47:35.995 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.993+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~PKF1JD5OUINS.0 size=1048576 2024-09-19T13:47:35.998 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:35.993+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~PKF1JD5OUINS.1 size=729523 2024-09-19T13:47:36.004 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.001+0000 7fcf3240c8c0 1 < completed multipart upload key=C8T6DB9V9FBT upload=PKF1JD5OUINS tag=PUU7P5QWB6IW type=write size=2826675 2024-09-19T13:47:36.007 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.005+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=Q5OJRMPATT42 type=del size=1176214 2024-09-19T13:47:36.011 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.009+0000 7fcf3240c8c0 1 < canceled operation key=0UCFTOF1YBBM tag=T0JNC4YKI7EZ type=del size=1372117 2024-09-19T13:47:36.017 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.013+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0U9BUX9DHTAK.2~AB3IKSRUAGX6.0 size=1048576 2024-09-19T13:47:36.020 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.017+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0U9BUX9DHTAK.2~AB3IKSRUAGX6.1 size=563743 2024-09-19T13:47:36.020 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.017+0000 7fcf3240c8c0 1 > prepared multipart upload key=0U9BUX9DHTAK upload=AB3IKSRUAGX6 tag=DQ23ZN3R1SUI type=write size=2660895 2024-09-19T13:47:36.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.021+0000 7fcf3240c8c0 -1 < failed to complete operation key=ES62XJO5Q3FO tag=NVSEB6NI0L95 type=del size=2766091: (22) Invalid argument 2024-09-19T13:47:36.026 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.025+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=90DG7M8DZKWC type=del size=1105922 2024-09-19T13:47:36.030 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.025+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~94F6BX4AQ0RC.0 size=1048576 2024-09-19T13:47:36.033 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.029+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~94F6BX4AQ0RC.1 size=1048576 2024-09-19T13:47:36.035 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.033+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~94F6BX4AQ0RC.2 size=362230 2024-09-19T13:47:36.042 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.037+0000 7fcf3240c8c0 1 < completed multipart upload key=ES62XJO5Q3FO upload=94F6BX4AQ0RC tag=TR7HY90FK4PX type=write size=3507958 2024-09-19T13:47:36.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.041+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=QADMR69ZBY04 type=del size=541057 2024-09-19T13:47:36.050 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.045+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~KOF1JTDJ19X4.0 size=1048576 2024-09-19T13:47:36.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.049+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~KOF1JTDJ19X4.1 size=297014 2024-09-19T13:47:36.059 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.057+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=KOF1JTDJ19X4 tag=Q1FSV3BTUNMT type=write size=2394166 2024-09-19T13:47:36.062 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.061+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=8KCXHE53TCT2 type=del size=973652 2024-09-19T13:47:36.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.065+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~XR2O2VJ3OFP2.0 size=61655 2024-09-19T13:47:36.073 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.069+0000 7fcf3240c8c0 1 < completed multipart upload key=6DFF2OCPT9W2 upload=XR2O2VJ3OFP2 tag=0T0690D9Y24Y type=write size=1110231 2024-09-19T13:47:36.077 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.073+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=6EHFI9LN1UPY type=del size=3913195 2024-09-19T13:47:36.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.077+0000 7fcf3240c8c0 1 < completed write operation key=A02RDP6BA9AC tag=T2C41VTTUHT0 type=write size=969406 2024-09-19T13:47:36.085 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.081+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=KFRV8RF2WXPN type=del size=1055948 2024-09-19T13:47:36.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.081+0000 7fcf3240c8c0 1 < canceled part key=_multipart_X9FGPMP30X47.2~XOCYWE73VFSF.0 size=578840 2024-09-19T13:47:36.092 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.089+0000 7fcf3240c8c0 1 < canceled multipart upload key=X9FGPMP30X47 upload=XOCYWE73VFSF tag=S1YMAFNJSZW4 type=write size=1627416 2024-09-19T13:47:36.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.093+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=B7G5YBFFKPJ0 type=del size=3084879 2024-09-19T13:47:36.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.101+0000 7fcf3240c8c0 1 < suggested remove operation key=QMSDNKYFFK1F tag=CSUDE8AAR801 type=del 2024-09-19T13:47:36.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.109+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~VWWVJXOALU7E.0 size=263406 2024-09-19T13:47:36.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.109+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=VWWVJXOALU7E tag=0CWJY8E6APF9 type=write size=1311982 2024-09-19T13:47:36.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.113+0000 7fcf3240c8c0 -1 < failed to complete operation key=QMSDNKYFFK1F tag=YP4PL9EDIVZ8 type=del size=4007882: (22) Invalid argument 2024-09-19T13:47:36.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.117+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~61EHSLI13OAL.0 size=1048576 2024-09-19T13:47:36.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.121+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~61EHSLI13OAL.1 size=1048576 2024-09-19T13:47:36.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.125+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~61EHSLI13OAL.2 size=246028 2024-09-19T13:47:36.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.125+0000 7fcf3240c8c0 1 > prepared multipart upload key=6DFF2OCPT9W2 upload=61EHSLI13OAL tag=JX9N7VKIK3U1 type=write size=3391756 2024-09-19T13:47:36.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.129+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~6PZBPE35I9RG.0 size=1048576 2024-09-19T13:47:36.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.129+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~6PZBPE35I9RG.1 size=1048576 2024-09-19T13:47:36.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.133+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~6PZBPE35I9RG.2 size=225316 2024-09-19T13:47:36.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.137+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=6PZBPE35I9RG tag=O2NESRDAFS06 type=write size=3371044 2024-09-19T13:47:36.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.141+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=QP25M2NO3UVV type=del size=1681418 2024-09-19T13:47:36.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.145+0000 7fcf3240c8c0 1 < completed delete operation key=7UC85R2HO9K2 tag=GQO7TFLZZR42 type=del 2024-09-19T13:47:36.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.149+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=0I9FAWBV8LJC type=del size=2161141 2024-09-19T13:47:36.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.153+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~43R6MMWQUB10.0 size=1048576 2024-09-19T13:47:36.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.157+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~43R6MMWQUB10.1 size=407160 2024-09-19T13:47:36.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.161+0000 7fcf3240c8c0 1 < completed multipart upload key=3TME221SA53E upload=43R6MMWQUB10 tag=592DZ0FB3SQZ type=write size=2504312 2024-09-19T13:47:36.167 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.165+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=1Q98LLGRJRO3 type=del size=13992 2024-09-19T13:47:36.171 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.169+0000 7fcf3240c8c0 1 < completed delete operation key=0UCFTOF1YBBM tag=DQXEG00WA0E6 type=del 2024-09-19T13:47:36.174 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.173+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=LJW9VR2H1NPM type=del size=1161787 2024-09-19T13:47:36.178 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.173+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=JKL009URH23V type=del 2024-09-19T13:47:36.184 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.181+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~ZIP7ZVUJY1FX.0 size=1048576 2024-09-19T13:47:36.187 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.185+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~ZIP7ZVUJY1FX.1 size=315281 2024-09-19T13:47:36.188 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.185+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=ZIP7ZVUJY1FX tag=3IK1F1KNE5RO type=write size=2412433 2024-09-19T13:47:36.191 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.189+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~VE2X82TSRJJY.0 size=1048576 2024-09-19T13:47:36.191 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.189+0000 7fcf3240c8c0 1 < canceled part key=_multipart_N51Q6HKJSCCB.2~VE2X82TSRJJY.1 size=227433 2024-09-19T13:47:36.197 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.193+0000 7fcf3240c8c0 1 < canceled multipart upload key=N51Q6HKJSCCB upload=VE2X82TSRJJY tag=IFE1SUK0E8HG type=write size=2324585 2024-09-19T13:47:36.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.197+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=Z8AQP0ISQV32 type=del size=4174741 2024-09-19T13:47:36.204 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.201+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=Q5OJRMPATT42 type=del 2024-09-19T13:47:36.210 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.209+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~JZ7TCGZ8N84U.0 size=1048576 2024-09-19T13:47:36.213 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.209+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~JZ7TCGZ8N84U.1 size=1048576 2024-09-19T13:47:36.216 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.213+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~JZ7TCGZ8N84U.2 size=1023776 2024-09-19T13:47:36.216 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.213+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=JZ7TCGZ8N84U tag=J2RNIPNABL5T type=write size=4169504 2024-09-19T13:47:36.219 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.217+0000 7fcf3240c8c0 1 < completed part key=_multipart_0U9BUX9DHTAK.2~AB3IKSRUAGX6.0 size=1048576 2024-09-19T13:47:36.222 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.217+0000 7fcf3240c8c0 1 < completed part key=_multipart_0U9BUX9DHTAK.2~AB3IKSRUAGX6.1 size=563743 2024-09-19T13:47:36.228 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.225+0000 7fcf3240c8c0 1 < completed multipart upload key=0U9BUX9DHTAK upload=AB3IKSRUAGX6 tag=DQ23ZN3R1SUI type=write size=2660895 2024-09-19T13:47:36.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.229+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=DP6X0VBV5VOF type=del size=2597809 2024-09-19T13:47:36.236 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.233+0000 7fcf3240c8c0 1 < completed delete operation key=M2CO4A2DHJ05 tag=90DG7M8DZKWC type=del 2024-09-19T13:47:36.242 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.241+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~HTOX0BC1T4AD.0 size=1048576 2024-09-19T13:47:36.245 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.241+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~HTOX0BC1T4AD.1 size=520484 2024-09-19T13:47:36.245 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.241+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=HTOX0BC1T4AD tag=32Y09A6G0GYO type=write size=2617636 2024-09-19T13:47:36.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.245+0000 7fcf3240c8c0 1 < completed delete operation key=STMT6XU2EJQM tag=QADMR69ZBY04 type=del 2024-09-19T13:47:36.254 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.249+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~YYLCI7394R0W.0 size=1048576 2024-09-19T13:47:36.256 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.253+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~YYLCI7394R0W.1 size=1048576 2024-09-19T13:47:36.258 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.257+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~YYLCI7394R0W.2 size=132207 2024-09-19T13:47:36.258 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.257+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=YYLCI7394R0W tag=097MXFLDSKRT type=write size=3277935 2024-09-19T13:47:36.261 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.257+0000 7fcf3240c8c0 1 < completed delete operation key=1BMF3S2BZLLI tag=8KCXHE53TCT2 type=del 2024-09-19T13:47:36.267 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.265+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~7NOHMV3KUL71.0 size=1048576 2024-09-19T13:47:36.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.265+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~7NOHMV3KUL71.1 size=107179 2024-09-19T13:47:36.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.265+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=7NOHMV3KUL71 tag=QCLKYITODCDH type=write size=2204331 2024-09-19T13:47:36.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.269+0000 7fcf3240c8c0 1 < completed delete operation key=0U9BUX9DHTAK tag=6EHFI9LN1UPY type=del 2024-09-19T13:47:36.278 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.273+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=6MCXL0EEWRI2 type=del size=808609 2024-09-19T13:47:36.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.281+0000 7fcf3240c8c0 1 < completed delete operation key=ZCKKQ1R8318S tag=KFRV8RF2WXPN type=del 2024-09-19T13:47:36.288 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.285+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~BMJDQPRR8Q3N.0 size=796613 2024-09-19T13:47:36.288 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.285+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=BMJDQPRR8Q3N tag=VRSNEEBLO8EE type=write size=1845189 2024-09-19T13:47:36.291 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.289+0000 7fcf3240c8c0 1 < completed delete operation key=6DFF2OCPT9W2 tag=B7G5YBFFKPJ0 type=del 2024-09-19T13:47:36.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.293+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~KZ0P2FZ5DJKG.0 size=431378 2024-09-19T13:47:36.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.293+0000 7fcf3240c8c0 1 > prepared multipart upload key=C8T6DB9V9FBT upload=KZ0P2FZ5DJKG tag=WSZX9GX4G0XE type=write size=1479954 2024-09-19T13:47:36.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.297+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~VWWVJXOALU7E.0 size=263406 2024-09-19T13:47:36.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.301+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=VWWVJXOALU7E tag=0CWJY8E6APF9 type=write size=1311982 2024-09-19T13:47:36.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.305+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=O7HAFG228JC5 type=del size=705603 2024-09-19T13:47:36.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.305+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~61EHSLI13OAL.0 size=1048576 2024-09-19T13:47:36.312 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.309+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~61EHSLI13OAL.1 size=1048576 2024-09-19T13:47:36.314 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.313+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~61EHSLI13OAL.2 size=246028 2024-09-19T13:47:36.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.317+0000 7fcf3240c8c0 1 < completed multipart upload key=6DFF2OCPT9W2 upload=61EHSLI13OAL tag=JX9N7VKIK3U1 type=write size=3391756 2024-09-19T13:47:36.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.321+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=4NW2I3M2I89T type=del size=2994822 2024-09-19T13:47:36.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.325+0000 7fcf3240c8c0 1 < suggested update operation key=BXUPV5XSJBTH tag=QP25M2NO3UVV type=del size=1681418 2024-09-19T13:47:36.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.329+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=DJ2ITEMERZ0M type=del size=80083 2024-09-19T13:47:36.338 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.333+0000 7fcf3240c8c0 1 < suggested remove operation key=7UC85R2HO9K2 tag=0I9FAWBV8LJC type=del 2024-09-19T13:47:36.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.337+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=VCQYFR5F4SL6 type=del size=2148734 2024-09-19T13:47:36.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.341+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=1Q98LLGRJRO3 type=del 2024-09-19T13:47:36.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.345+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~6P8LO3T73RS5.0 size=459703 2024-09-19T13:47:36.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.345+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=6P8LO3T73RS5 tag=X1EVGIHEUDBS type=write size=1508279 2024-09-19T13:47:36.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.349+0000 7fcf3240c8c0 1 < canceled operation key=6DFF2OCPT9W2 tag=LJW9VR2H1NPM type=del size=1161787 2024-09-19T13:47:36.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.353+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=N1654XLSQWIW type=del size=2614831 2024-09-19T13:47:36.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.353+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~ZIP7ZVUJY1FX.0 size=1048576 2024-09-19T13:47:36.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.357+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~ZIP7ZVUJY1FX.1 size=315281 2024-09-19T13:47:36.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.361+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=ZIP7ZVUJY1FX tag=3IK1F1KNE5RO type=write size=2412433 2024-09-19T13:47:36.370 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.365+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~OZ5RFLWX4IYX.0 size=1048576 2024-09-19T13:47:36.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.369+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~OZ5RFLWX4IYX.1 size=1048576 2024-09-19T13:47:36.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.369+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~OZ5RFLWX4IYX.2 size=984447 2024-09-19T13:47:36.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.369+0000 7fcf3240c8c0 1 > prepared multipart upload key=D1RMXGXS3O7Z upload=OZ5RFLWX4IYX tag=T0DS5F1MOKOI type=write size=4130175 2024-09-19T13:47:36.377 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.373+0000 7fcf3240c8c0 1 < completed delete operation key=QSM2Q8CW1Q86 tag=Z8AQP0ISQV32 type=del 2024-09-19T13:47:36.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.381+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~X5P1VUP6J2TZ.0 size=1048576 2024-09-19T13:47:36.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.381+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~X5P1VUP6J2TZ.1 size=882368 2024-09-19T13:47:36.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.381+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=X5P1VUP6J2TZ tag=6QJP1RP98C5B type=write size=2979520 2024-09-19T13:47:36.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.385+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~JZ7TCGZ8N84U.0 size=1048576 2024-09-19T13:47:36.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.389+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~JZ7TCGZ8N84U.1 size=1048576 2024-09-19T13:47:36.394 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.389+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~JZ7TCGZ8N84U.2 size=1023776 2024-09-19T13:47:36.399 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.397+0000 7fcf3240c8c0 1 < completed multipart upload key=D20C6C2ZFX1W upload=JZ7TCGZ8N84U tag=J2RNIPNABL5T type=write size=4169504 2024-09-19T13:47:36.402 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.397+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=XWEPR6YOOWVK type=del size=1969420 2024-09-19T13:47:36.407 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.405+0000 7fcf3240c8c0 1 < suggested remove operation key=D1RMXGXS3O7Z tag=DP6X0VBV5VOF type=del 2024-09-19T13:47:36.413 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.409+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~T7PI9H6O89HZ.0 size=81153 2024-09-19T13:47:36.413 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.409+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=T7PI9H6O89HZ tag=6WEQ5MIIKRR1 type=write size=1129729 2024-09-19T13:47:36.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.409+0000 7fcf3240c8c0 1 < canceled part key=_multipart_NP2L28YRVQ8L.2~HTOX0BC1T4AD.0 size=1048576 2024-09-19T13:47:36.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.413+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~HTOX0BC1T4AD.1 size=520484 2024-09-19T13:47:36.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.417+0000 7fcf3240c8c0 1 < canceled multipart upload key=NP2L28YRVQ8L upload=HTOX0BC1T4AD tag=32Y09A6G0GYO type=write size=2617636 2024-09-19T13:47:36.423 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.421+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=P2PEPREX8CL9 type=del size=4169191 2024-09-19T13:47:36.426 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.421+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~YYLCI7394R0W.0 size=1048576 2024-09-19T13:47:36.428 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.425+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~YYLCI7394R0W.1 size=1048576 2024-09-19T13:47:36.430 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.429+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~YYLCI7394R0W.2 size=132207 2024-09-19T13:47:36.436 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.433+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=YYLCI7394R0W tag=097MXFLDSKRT type=write size=3277935 2024-09-19T13:47:36.440 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.437+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~X07Q1U9OX66R.0 size=453449 2024-09-19T13:47:36.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.437+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=X07Q1U9OX66R tag=ABMJYW1X27ZY type=write size=1502025 2024-09-19T13:47:36.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.437+0000 7fcf3240c8c0 1 < canceled part key=_multipart_QAYJ5B1KZ08J.2~7NOHMV3KUL71.0 size=1048576 2024-09-19T13:47:36.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.441+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~7NOHMV3KUL71.1 size=107179 2024-09-19T13:47:36.447 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.445+0000 7fcf3240c8c0 1 < canceled multipart upload key=QAYJ5B1KZ08J upload=7NOHMV3KUL71 tag=QCLKYITODCDH type=write size=2204331 2024-09-19T13:47:36.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.449+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~ABO6BQ5A9XAP.0 size=1048576 2024-09-19T13:47:36.455 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.453+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~ABO6BQ5A9XAP.1 size=1048576 2024-09-19T13:47:36.458 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.453+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~ABO6BQ5A9XAP.2 size=1047605 2024-09-19T13:47:36.458 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.453+0000 7fcf3240c8c0 1 > prepared multipart upload key=3TME221SA53E upload=ABO6BQ5A9XAP tag=6MTAFXCNUWA9 type=write size=4193333 2024-09-19T13:47:36.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.461+0000 7fcf3240c8c0 1 < suggested remove operation key=X16ENUFL40RN tag=6MCXL0EEWRI2 type=del 2024-09-19T13:47:36.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.465+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=HOUZ2RIJ9EMF type=del size=278271 2024-09-19T13:47:36.470 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.469+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~BMJDQPRR8Q3N.0 size=796613 2024-09-19T13:47:36.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.473+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=BMJDQPRR8Q3N tag=VRSNEEBLO8EE type=write size=1845189 2024-09-19T13:47:36.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.477+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~BQGI9EZRPHON.0 size=1048576 2024-09-19T13:47:36.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.481+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~BQGI9EZRPHON.1 size=498475 2024-09-19T13:47:36.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.481+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=BQGI9EZRPHON tag=O2AVK27PNDLS type=write size=2595627 2024-09-19T13:47:36.485 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.481+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~KZ0P2FZ5DJKG.0 size=431378 2024-09-19T13:47:36.490 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.485+0000 7fcf3240c8c0 1 < completed multipart upload key=C8T6DB9V9FBT upload=KZ0P2FZ5DJKG tag=WSZX9GX4G0XE type=write size=1479954 2024-09-19T13:47:36.495 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.493+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~FJP3T3FT5PSD.0 size=1048576 2024-09-19T13:47:36.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.497+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~FJP3T3FT5PSD.1 size=1048576 2024-09-19T13:47:36.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.497+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~FJP3T3FT5PSD.2 size=883104 2024-09-19T13:47:36.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.497+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=FJP3T3FT5PSD tag=MND17FZAEZLY type=write size=4028832 2024-09-19T13:47:36.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.501+0000 7fcf3240c8c0 1 < completed delete operation key=V8X0VBBNK83J tag=O7HAFG228JC5 type=del 2024-09-19T13:47:36.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.505+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=R1PES8EUQTEV type=del size=4042780 2024-09-19T13:47:36.513 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.509+0000 7fcf3240c8c0 1 < suggested update operation key=ES62XJO5Q3FO tag=4NW2I3M2I89T type=del size=2994822 2024-09-19T13:47:36.516 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.513+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=G7T53DKWVVCK type=del size=929541 2024-09-19T13:47:36.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.517+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=DJ2ITEMERZ0M type=del 2024-09-19T13:47:36.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.521+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~N2RNA26QAA3Q.0 size=1048576 2024-09-19T13:47:36.527 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.525+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~N2RNA26QAA3Q.1 size=1048576 2024-09-19T13:47:36.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.525+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~N2RNA26QAA3Q.2 size=523198 2024-09-19T13:47:36.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.525+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=N2RNA26QAA3Q tag=6JDX2PS7PZ25 type=write size=3668926 2024-09-19T13:47:36.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.529+0000 7fcf3240c8c0 1 < canceled operation key=NP2L28YRVQ8L tag=VCQYFR5F4SL6 type=del size=2148734 2024-09-19T13:47:36.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.533+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~8C88Y2TV8Z0V.0 size=1048576 2024-09-19T13:47:36.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.537+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~8C88Y2TV8Z0V.1 size=990661 2024-09-19T13:47:36.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.537+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=8C88Y2TV8Z0V tag=NVOWPQDQT1I4 type=write size=3087813 2024-09-19T13:47:36.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.537+0000 7fcf3240c8c0 1 < canceled part key=_multipart_HXMZKP7H3HJE.2~6P8LO3T73RS5.0 size=459703 2024-09-19T13:47:36.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.541+0000 7fcf3240c8c0 1 < canceled multipart upload key=HXMZKP7H3HJE upload=6P8LO3T73RS5 tag=X1EVGIHEUDBS type=write size=1508279 2024-09-19T13:47:36.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.549+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=P1VRINJY33K3 type=del size=1752309 2024-09-19T13:47:36.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.553+0000 7fcf3240c8c0 1 < completed delete operation key=0U9BUX9DHTAK tag=N1654XLSQWIW type=del 2024-09-19T13:47:36.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.553+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=R6ZOK0FSOJGA type=del size=896450 2024-09-19T13:47:36.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.557+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~OZ5RFLWX4IYX.0 size=1048576 2024-09-19T13:47:36.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.557+0000 7fcf3240c8c0 1 < canceled part key=_multipart_D1RMXGXS3O7Z.2~OZ5RFLWX4IYX.1 size=1048576 2024-09-19T13:47:36.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.561+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~OZ5RFLWX4IYX.2 size=984447 2024-09-19T13:47:36.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.565+0000 7fcf3240c8c0 1 < canceled multipart upload key=D1RMXGXS3O7Z upload=OZ5RFLWX4IYX tag=T0DS5F1MOKOI type=write size=4130175 2024-09-19T13:47:36.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.569+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=1KTGW658LWNA type=write size=910932 2024-09-19T13:47:36.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.569+0000 7fcf3240c8c0 1 < canceled part key=_multipart_HXMZKP7H3HJE.2~X5P1VUP6J2TZ.0 size=1048576 2024-09-19T13:47:36.573 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.569+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~X5P1VUP6J2TZ.1 size=882368 2024-09-19T13:47:36.578 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.577+0000 7fcf3240c8c0 1 < canceled multipart upload key=HXMZKP7H3HJE upload=X5P1VUP6J2TZ tag=6QJP1RP98C5B type=write size=2979520 2024-09-19T13:47:36.581 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.577+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=ZX0J5HHYWZTF type=write size=299821 2024-09-19T13:47:36.584 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.581+0000 7fcf3240c8c0 1 < canceled operation key=7UC85R2HO9K2 tag=XWEPR6YOOWVK type=del size=1969420 2024-09-19T13:47:36.586 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.585+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=5SB93RH8O0GG type=del size=28441 2024-09-19T13:47:36.589 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.585+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~T7PI9H6O89HZ.0 size=81153 2024-09-19T13:47:36.594 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.589+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=T7PI9H6O89HZ tag=6WEQ5MIIKRR1 type=write size=1129729 2024-09-19T13:47:36.596 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.593+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=SRVEMLJ7RP7Y type=del size=846288 2024-09-19T13:47:36.599 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.597+0000 7fcf3240c8c0 1 < completed delete operation key=6DFF2OCPT9W2 tag=P2PEPREX8CL9 type=del 2024-09-19T13:47:36.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.601+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~LBWD24YYU9TT.0 size=450456 2024-09-19T13:47:36.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.601+0000 7fcf3240c8c0 1 > prepared multipart upload key=D1RMXGXS3O7Z upload=LBWD24YYU9TT tag=I0XHE5BC9FWC type=write size=1499032 2024-09-19T13:47:36.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.601+0000 7fcf3240c8c0 1 < canceled part key=_multipart_NP2L28YRVQ8L.2~X07Q1U9OX66R.0 size=453449 2024-09-19T13:47:36.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.605+0000 7fcf3240c8c0 1 < canceled multipart upload key=NP2L28YRVQ8L upload=X07Q1U9OX66R tag=ABMJYW1X27ZY type=write size=1502025 2024-09-19T13:47:36.611 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.609+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=XC9PK3MOB1GN type=write size=548645 2024-09-19T13:47:36.614 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.609+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~ABO6BQ5A9XAP.0 size=1048576 2024-09-19T13:47:36.614 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.609+0000 7fcf3240c8c0 1 < canceled part key=_multipart_3TME221SA53E.2~ABO6BQ5A9XAP.1 size=1048576 2024-09-19T13:47:36.614 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.609+0000 7fcf3240c8c0 1 < canceled part key=_multipart_3TME221SA53E.2~ABO6BQ5A9XAP.2 size=1047605 2024-09-19T13:47:36.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.617+0000 7fcf3240c8c0 1 < canceled multipart upload key=3TME221SA53E upload=ABO6BQ5A9XAP tag=6MTAFXCNUWA9 type=write size=4193333 2024-09-19T13:47:36.623 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.621+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~R2T0U5SH16CW.0 size=1048576 2024-09-19T13:47:36.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.621+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~R2T0U5SH16CW.1 size=1042716 2024-09-19T13:47:36.626 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.621+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=R2T0U5SH16CW tag=VKHZAWTJ3Y3V type=write size=3139868 2024-09-19T13:47:36.630 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.629+0000 7fcf3240c8c0 1 < suggested update operation key=C3TFYNXH549T tag=HOUZ2RIJ9EMF type=del size=278271 2024-09-19T13:47:36.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.629+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=D7403S21GRKH type=del size=987823 2024-09-19T13:47:36.635 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.633+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~BQGI9EZRPHON.0 size=1048576 2024-09-19T13:47:36.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.633+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~BQGI9EZRPHON.1 size=498475 2024-09-19T13:47:36.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.637+0000 7fcf3240c8c0 1 < completed multipart upload key=N51Q6HKJSCCB upload=BQGI9EZRPHON tag=O2AVK27PNDLS type=write size=2595627 2024-09-19T13:47:36.644 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.641+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=IYSKU8HGDEKU type=del size=3756663 2024-09-19T13:47:36.647 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.645+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~FJP3T3FT5PSD.0 size=1048576 2024-09-19T13:47:36.649 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.645+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~FJP3T3FT5PSD.1 size=1048576 2024-09-19T13:47:36.651 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.649+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~FJP3T3FT5PSD.2 size=883104 2024-09-19T13:47:36.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.653+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=FJP3T3FT5PSD tag=MND17FZAEZLY type=write size=4028832 2024-09-19T13:47:36.660 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.653+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=XXJDRFU5XZ1R type=del size=2103296 2024-09-19T13:47:36.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.657+0000 7fcf3240c8c0 1 < completed delete operation key=STMT6XU2EJQM tag=R1PES8EUQTEV type=del 2024-09-19T13:47:36.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.661+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=Z4BGSDEPAUJ9 type=del size=2928035 2024-09-19T13:47:36.667 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.665+0000 7fcf3240c8c0 1 < canceled operation key=OA9BMSXGYR9T tag=G7T53DKWVVCK type=del size=929541 2024-09-19T13:47:36.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.669+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=8VNOL57XC4DD type=del size=1077586 2024-09-19T13:47:36.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.669+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~N2RNA26QAA3Q.0 size=1048576 2024-09-19T13:47:36.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.673+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~N2RNA26QAA3Q.1 size=1048576 2024-09-19T13:47:36.679 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.677+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~N2RNA26QAA3Q.2 size=523198 2024-09-19T13:47:36.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.681+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=N2RNA26QAA3Q tag=6JDX2PS7PZ25 type=write size=3668926 2024-09-19T13:47:36.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.685+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=NIKZW19G7BZG type=del size=3686812 2024-09-19T13:47:36.691 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.689+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~8C88Y2TV8Z0V.0 size=1048576 2024-09-19T13:47:36.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.689+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~8C88Y2TV8Z0V.1 size=990661 2024-09-19T13:47:36.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.693+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=8C88Y2TV8Z0V tag=NVOWPQDQT1I4 type=write size=3087813 2024-09-19T13:47:36.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.697+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=4W9XNGL0RNTE type=del size=476630 2024-09-19T13:47:36.706 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.701+0000 7fcf3240c8c0 1 < suggested update operation key=XE42LV5M5X82 tag=P1VRINJY33K3 type=del size=1752309 2024-09-19T13:47:36.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.705+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=98E722LL7VW0 type=del size=2791348 2024-09-19T13:47:36.711 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.709+0000 7fcf3240c8c0 1 < completed delete operation key=0UCFTOF1YBBM tag=R6ZOK0FSOJGA type=del 2024-09-19T13:47:36.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.713+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~EOUKIK02FI30.0 size=1048576 2024-09-19T13:47:36.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.717+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~EOUKIK02FI30.1 size=253947 2024-09-19T13:47:36.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.717+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=EOUKIK02FI30 tag=HCF6DDBVAG85 type=write size=2351099 2024-09-19T13:47:36.722 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.717+0000 7fcf3240c8c0 1 < completed write operation key=QSM2Q8CW1Q86 tag=1KTGW658LWNA type=write size=910932 2024-09-19T13:47:36.725 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.721+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=9JXSAAYC3BQ9 type=del size=2431826 2024-09-19T13:47:36.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.725+0000 7fcf3240c8c0 1 < completed write operation key=D1RMXGXS3O7Z tag=ZX0J5HHYWZTF type=write size=299821 2024-09-19T13:47:36.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.725+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=2D2P444DZK88 type=del size=1919494 2024-09-19T13:47:36.732 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.729+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=5SB93RH8O0GG type=del 2024-09-19T13:47:36.735 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.733+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=6XTLFTOS1IQY type=del size=1188731 2024-09-19T13:47:36.738 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.733+0000 7fcf3240c8c0 1 < canceled operation key=BXUPV5XSJBTH tag=SRVEMLJ7RP7Y type=del size=846288 2024-09-19T13:47:36.740 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.737+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=V40PFSL3S7IH type=del size=1094770 2024-09-19T13:47:36.743 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.741+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~LBWD24YYU9TT.0 size=450456 2024-09-19T13:47:36.747 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.745+0000 7fcf3240c8c0 1 < completed multipart upload key=D1RMXGXS3O7Z upload=LBWD24YYU9TT tag=I0XHE5BC9FWC type=write size=1499032 2024-09-19T13:47:36.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.745+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=L8QWTD58EC3L type=del size=1351505 2024-09-19T13:47:36.753 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.749+0000 7fcf3240c8c0 1 < canceled operation key=9ICCISYXT0IV tag=XC9PK3MOB1GN type=write size=548645 2024-09-19T13:47:36.756 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.753+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=OZ27O1D4F3F5 type=write size=342453 2024-09-19T13:47:36.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.757+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~R2T0U5SH16CW.0 size=1048576 2024-09-19T13:47:36.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.757+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~R2T0U5SH16CW.1 size=1042716 2024-09-19T13:47:36.766 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.761+0000 7fcf3240c8c0 1 < completed multipart upload key=D20C6C2ZFX1W upload=R2T0U5SH16CW tag=VKHZAWTJ3Y3V type=write size=3139868 2024-09-19T13:47:36.768 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.765+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=QNLGCN9FWXH0 type=del size=1787413 2024-09-19T13:47:36.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.769+0000 7fcf3240c8c0 1 < completed delete operation key=D1RMXGXS3O7Z tag=D7403S21GRKH type=del 2024-09-19T13:47:36.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.773+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=ILAEHPDTIK8Q type=del size=1339369 2024-09-19T13:47:36.777 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.773+0000 7fcf3240c8c0 1 < completed delete operation key=C3TFYNXH549T tag=IYSKU8HGDEKU type=del 2024-09-19T13:47:36.780 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.777+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=A9D0W8G470L4 type=del size=2857661 2024-09-19T13:47:36.783 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.781+0000 7fcf3240c8c0 1 < completed delete operation key=M2CO4A2DHJ05 tag=XXJDRFU5XZ1R type=del 2024-09-19T13:47:36.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.785+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~UOL249E2OFAM.0 size=484141 2024-09-19T13:47:36.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.785+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=UOL249E2OFAM tag=NVMNIQTTZFZB type=write size=1532717 2024-09-19T13:47:36.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.785+0000 7fcf3240c8c0 1 < completed delete operation key=X16ENUFL40RN tag=Z4BGSDEPAUJ9 type=del 2024-09-19T13:47:36.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.789+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=CUL7X5MK3T8W type=del size=2509111 2024-09-19T13:47:36.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.793+0000 7fcf3240c8c0 1 < completed delete operation key=0UCFTOF1YBBM tag=8VNOL57XC4DD type=del 2024-09-19T13:47:36.797 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.793+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=ARBICSU0L0NX type=del size=2510272 2024-09-19T13:47:36.803 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.801+0000 7fcf3240c8c0 1 < suggested remove operation key=ZCKKQ1R8318S tag=NIKZW19G7BZG type=del 2024-09-19T13:47:36.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.801+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=J055RABVEFJP type=del size=2207379 2024-09-19T13:47:36.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.805+0000 7fcf3240c8c0 1 < completed delete operation key=C35EUAOWLBR3 tag=4W9XNGL0RNTE type=del 2024-09-19T13:47:36.814 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.813+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~DWGFKDECY445.0 size=1048576 2024-09-19T13:47:36.816 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.813+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~DWGFKDECY445.1 size=1048576 2024-09-19T13:47:36.818 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.817+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~DWGFKDECY445.2 size=196209 2024-09-19T13:47:36.818 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.817+0000 7fcf3240c8c0 1 > prepared multipart upload key=71Z2VTW99W7J upload=DWGFKDECY445 tag=OF6SPF14B8JZ type=write size=3341937 2024-09-19T13:47:36.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.817+0000 7fcf3240c8c0 1 < completed delete operation key=C8T6DB9V9FBT tag=98E722LL7VW0 type=del 2024-09-19T13:47:36.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.821+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=B0YFNEOMM90I type=del size=3466411 2024-09-19T13:47:36.825 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.821+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~EOUKIK02FI30.0 size=1048576 2024-09-19T13:47:36.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.825+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~EOUKIK02FI30.1 size=253947 2024-09-19T13:47:36.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.829+0000 7fcf3240c8c0 1 < completed multipart upload key=AES54TJK7VH7 upload=EOUKIK02FI30 tag=HCF6DDBVAG85 type=write size=2351099 2024-09-19T13:47:36.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.829+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=89OMR90GI9AN type=del size=2422306 2024-09-19T13:47:36.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.833+0000 7fcf3240c8c0 1 < completed delete operation key=71Z2VTW99W7J tag=9JXSAAYC3BQ9 type=del 2024-09-19T13:47:36.838 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.833+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=8QZ6IJQM6RBM type=del size=512561 2024-09-19T13:47:36.841 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.837+0000 7fcf3240c8c0 1 < completed delete operation key=N51Q6HKJSCCB tag=2D2P444DZK88 type=del 2024-09-19T13:47:36.845 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.841+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0U9BUX9DHTAK.2~1R37LKRZ22PU.0 size=1048576 2024-09-19T13:47:36.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.845+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0U9BUX9DHTAK.2~1R37LKRZ22PU.1 size=554409 2024-09-19T13:47:36.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.845+0000 7fcf3240c8c0 1 > prepared multipart upload key=0U9BUX9DHTAK upload=1R37LKRZ22PU tag=KM7TI289J9MV type=write size=2651561 2024-09-19T13:47:36.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.849+0000 7fcf3240c8c0 1 < completed delete operation key=X9FGPMP30X47 tag=6XTLFTOS1IQY type=del 2024-09-19T13:47:36.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.849+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=JTFFUAH5A0VB type=del size=442693 2024-09-19T13:47:36.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.853+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=V40PFSL3S7IH type=del 2024-09-19T13:47:36.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.857+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=3DCPK31DA3ZF type=write size=954196 2024-09-19T13:47:36.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.861+0000 7fcf3240c8c0 1 < canceled operation key=X16ENUFL40RN tag=L8QWTD58EC3L type=del size=1351505 2024-09-19T13:47:36.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.865+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~T6JG0C4BMNWD.0 size=1048576 2024-09-19T13:47:36.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.865+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~T6JG0C4BMNWD.1 size=540188 2024-09-19T13:47:36.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.865+0000 7fcf3240c8c0 1 > prepared multipart upload key=DHPONKOVS8CT upload=T6JG0C4BMNWD tag=M2O0A63T22TH type=write size=2637340 2024-09-19T13:47:36.873 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.869+0000 7fcf3240c8c0 1 < completed write operation key=1BMF3S2BZLLI tag=OZ27O1D4F3F5 type=write size=342453 2024-09-19T13:47:36.876 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.873+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=9HIPGLUG3ZJ3 type=del size=3895660 2024-09-19T13:47:36.879 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.877+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=QNLGCN9FWXH0 type=del 2024-09-19T13:47:36.885 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.881+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~98B9P00GMAEQ.0 size=1048576 2024-09-19T13:47:36.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.885+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~98B9P00GMAEQ.1 size=464895 2024-09-19T13:47:36.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.885+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=98B9P00GMAEQ tag=KR0ED4YHB89J type=write size=2562047 2024-09-19T13:47:36.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.889+0000 7fcf3240c8c0 1 < completed delete operation key=X16ENUFL40RN tag=ILAEHPDTIK8Q type=del 2024-09-19T13:47:36.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.893+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~BADHWIUF8EUS.0 size=1048576 2024-09-19T13:47:36.900 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.897+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~BADHWIUF8EUS.1 size=483343 2024-09-19T13:47:36.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.897+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=BADHWIUF8EUS tag=NTSGLAWZCUVX type=write size=2580495 2024-09-19T13:47:36.907 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.905+0000 7fcf3240c8c0 1 < suggested update operation key=N51Q6HKJSCCB tag=A9D0W8G470L4 type=del size=2857661 2024-09-19T13:47:36.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.909+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~LKEDU458YZSF.0 size=1048576 2024-09-19T13:47:36.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.913+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~LKEDU458YZSF.1 size=1048576 2024-09-19T13:47:36.918 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.917+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~LKEDU458YZSF.2 size=780636 2024-09-19T13:47:36.918 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.917+0000 7fcf3240c8c0 1 > prepared multipart upload key=C3TFYNXH549T upload=LKEDU458YZSF tag=RWXWLRW43FWT type=write size=3926364 2024-09-19T13:47:36.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.917+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~UOL249E2OFAM.0 size=484141 2024-09-19T13:47:36.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.925+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=UOL249E2OFAM tag=NVMNIQTTZFZB type=write size=1532717 2024-09-19T13:47:36.930 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.929+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=BLCXJKW19A8R type=del size=2709963 2024-09-19T13:47:36.933 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.929+0000 7fcf3240c8c0 1 < completed delete operation key=QSM2Q8CW1Q86 tag=CUL7X5MK3T8W type=del 2024-09-19T13:47:36.939 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.937+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~62DRZPFSOID6.0 size=696742 2024-09-19T13:47:36.939 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.937+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=62DRZPFSOID6 tag=4GQ977IPWJ5Y type=write size=1745318 2024-09-19T13:47:36.942 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.937+0000 7fcf3240c8c0 1 < canceled operation key=QAYJ5B1KZ08J tag=ARBICSU0L0NX type=del size=2510272 2024-09-19T13:47:36.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.945+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~XZ4HSCEMOE6Q.0 size=1048576 2024-09-19T13:47:36.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.945+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~XZ4HSCEMOE6Q.1 size=561737 2024-09-19T13:47:36.950 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.945+0000 7fcf3240c8c0 1 > prepared multipart upload key=V8X0VBBNK83J upload=XZ4HSCEMOE6Q tag=ICT203J71VNF type=write size=2658889 2024-09-19T13:47:36.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.949+0000 7fcf3240c8c0 1 < completed delete operation key=C35EUAOWLBR3 tag=J055RABVEFJP type=del 2024-09-19T13:47:36.956 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.953+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=68YOC3I3SQ42 type=write size=86260 2024-09-19T13:47:36.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.957+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~DWGFKDECY445.0 size=1048576 2024-09-19T13:47:36.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.957+0000 7fcf3240c8c0 1 < canceled part key=_multipart_71Z2VTW99W7J.2~DWGFKDECY445.1 size=1048576 2024-09-19T13:47:36.962 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.961+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~DWGFKDECY445.2 size=196209 2024-09-19T13:47:36.967 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.965+0000 7fcf3240c8c0 1 < canceled multipart upload key=71Z2VTW99W7J upload=DWGFKDECY445 tag=OF6SPF14B8JZ type=write size=3341937 2024-09-19T13:47:36.974 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.969+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~G1DJKQZFE29I.0 size=1048576 2024-09-19T13:47:36.977 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.973+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~G1DJKQZFE29I.1 size=1048576 2024-09-19T13:47:36.980 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.977+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~G1DJKQZFE29I.2 size=526202 2024-09-19T13:47:36.980 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.977+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=G1DJKQZFE29I tag=QZN4TJNKX8IN type=write size=3671930 2024-09-19T13:47:36.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.981+0000 7fcf3240c8c0 1 < canceled operation key=0U9BUX9DHTAK tag=B0YFNEOMM90I type=del size=3466411 2024-09-19T13:47:36.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.985+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~1XJYWNCCGIRW.0 size=1048576 2024-09-19T13:47:36.991 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.989+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~1XJYWNCCGIRW.1 size=35983 2024-09-19T13:47:36.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.989+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=1XJYWNCCGIRW tag=N6ITTKV7IOQW type=write size=2133135 2024-09-19T13:47:36.995 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.993+0000 7fcf3240c8c0 1 < completed delete operation key=DHPONKOVS8CT tag=89OMR90GI9AN type=del 2024-09-19T13:47:36.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.993+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=ZL0ZU923HQCU type=del size=1955542 2024-09-19T13:47:37.001 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:36.997+0000 7fcf3240c8c0 1 < completed delete operation key=0U9BUX9DHTAK tag=8QZ6IJQM6RBM type=del 2024-09-19T13:47:37.004 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.001+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=E37FRQRSG1GE type=del size=2752107 2024-09-19T13:47:37.007 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.005+0000 7fcf3240c8c0 1 < completed part key=_multipart_0U9BUX9DHTAK.2~1R37LKRZ22PU.0 size=1048576 2024-09-19T13:47:37.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.005+0000 7fcf3240c8c0 1 < completed part key=_multipart_0U9BUX9DHTAK.2~1R37LKRZ22PU.1 size=554409 2024-09-19T13:47:37.016 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.013+0000 7fcf3240c8c0 1 < completed multipart upload key=0U9BUX9DHTAK upload=1R37LKRZ22PU tag=KM7TI289J9MV type=write size=2651561 2024-09-19T13:47:37.020 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.017+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=E2XL4T69AF69 type=del size=3074968 2024-09-19T13:47:37.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.021+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=JTFFUAH5A0VB type=del 2024-09-19T13:47:37.027 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.025+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=3KGFUBOOH01E type=del size=1162226 2024-09-19T13:47:37.031 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.029+0000 7fcf3240c8c0 1 < canceled operation key=XE42LV5M5X82 tag=3DCPK31DA3ZF type=write size=954196 2024-09-19T13:47:37.035 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.033+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=OX07N0G5IBJL type=del size=3921596 2024-09-19T13:47:37.039 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.037+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~T6JG0C4BMNWD.0 size=1048576 2024-09-19T13:47:37.042 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.037+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~T6JG0C4BMNWD.1 size=540188 2024-09-19T13:47:37.048 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.045+0000 7fcf3240c8c0 1 < completed multipart upload key=DHPONKOVS8CT upload=T6JG0C4BMNWD tag=M2O0A63T22TH type=write size=2637340 2024-09-19T13:47:37.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.053+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~MDPE0MKHN76U.0 size=1048576 2024-09-19T13:47:37.058 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.053+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~MDPE0MKHN76U.1 size=1048576 2024-09-19T13:47:37.061 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.057+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~MDPE0MKHN76U.2 size=641401 2024-09-19T13:47:37.061 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.057+0000 7fcf3240c8c0 1 > prepared multipart upload key=V8X0VBBNK83J upload=MDPE0MKHN76U tag=OLF3PN1V9V75 type=write size=3787129 2024-09-19T13:47:37.065 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.061+0000 7fcf3240c8c0 1 < completed delete operation key=C8T6DB9V9FBT tag=9HIPGLUG3ZJ3 type=del 2024-09-19T13:47:37.070 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.065+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~HF5UO4M7KI6S.0 size=1048576 2024-09-19T13:47:37.072 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.069+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~HF5UO4M7KI6S.1 size=1048576 2024-09-19T13:47:37.074 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.073+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~HF5UO4M7KI6S.2 size=654827 2024-09-19T13:47:37.074 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.073+0000 7fcf3240c8c0 1 > prepared multipart upload key=A02RDP6BA9AC upload=HF5UO4M7KI6S tag=LJOKXD5NVFH0 type=write size=3800555 2024-09-19T13:47:37.077 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.073+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~98B9P00GMAEQ.0 size=1048576 2024-09-19T13:47:37.079 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.077+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~98B9P00GMAEQ.1 size=464895 2024-09-19T13:47:37.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.081+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=98B9P00GMAEQ tag=KR0ED4YHB89J type=write size=2562047 2024-09-19T13:47:37.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.085+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~1T5RRP0REVEM.0 size=1048576 2024-09-19T13:47:37.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.089+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~1T5RRP0REVEM.1 size=120287 2024-09-19T13:47:37.092 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.089+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=1T5RRP0REVEM tag=923MF83QA2CU type=write size=2217439 2024-09-19T13:47:37.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.093+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~BADHWIUF8EUS.0 size=1048576 2024-09-19T13:47:37.101 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.097+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~BADHWIUF8EUS.1 size=483343 2024-09-19T13:47:37.108 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.105+0000 7fcf3240c8c0 1 < completed multipart upload key=0UCFTOF1YBBM upload=BADHWIUF8EUS tag=NTSGLAWZCUVX type=write size=2580495 2024-09-19T13:47:37.112 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.109+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=MZ0GB6M98M0J type=del size=3665514 2024-09-19T13:47:37.116 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.113+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~LKEDU458YZSF.0 size=1048576 2024-09-19T13:47:37.119 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.117+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~LKEDU458YZSF.1 size=1048576 2024-09-19T13:47:37.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.117+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~LKEDU458YZSF.2 size=780636 2024-09-19T13:47:37.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.125+0000 7fcf3240c8c0 1 < completed multipart upload key=C3TFYNXH549T upload=LKEDU458YZSF tag=RWXWLRW43FWT type=write size=3926364 2024-09-19T13:47:37.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.129+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=VXLH7CTISZUG type=del size=4049784 2024-09-19T13:47:37.139 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.137+0000 7fcf3240c8c0 1 < suggested update operation key=QMSDNKYFFK1F tag=BLCXJKW19A8R type=del size=2709963 2024-09-19T13:47:37.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.141+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~TTLLLM3O5CSA.0 size=1048576 2024-09-19T13:47:37.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.145+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~TTLLLM3O5CSA.1 size=1048576 2024-09-19T13:47:37.151 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.149+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~TTLLLM3O5CSA.2 size=733582 2024-09-19T13:47:37.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.149+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=TTLLLM3O5CSA tag=LT8M9DUUZ92N type=write size=3879310 2024-09-19T13:47:37.155 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.153+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~62DRZPFSOID6.0 size=696742 2024-09-19T13:47:37.161 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.157+0000 7fcf3240c8c0 1 < completed multipart upload key=ES62XJO5Q3FO upload=62DRZPFSOID6 tag=4GQ977IPWJ5Y type=write size=1745318 2024-09-19T13:47:37.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.161+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=U52W9BE0GJPS type=del size=3688436 2024-09-19T13:47:37.165 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.161+0000 7fcf3240c8c0 1 < canceled part key=_multipart_V8X0VBBNK83J.2~XZ4HSCEMOE6Q.0 size=1048576 2024-09-19T13:47:37.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.165+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~XZ4HSCEMOE6Q.1 size=561737 2024-09-19T13:47:37.174 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.169+0000 7fcf3240c8c0 1 < canceled multipart upload key=V8X0VBBNK83J upload=XZ4HSCEMOE6Q tag=ICT203J71VNF type=write size=2658889 2024-09-19T13:47:37.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.173+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=682HTPHC79QD type=del size=1879113 2024-09-19T13:47:37.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.177+0000 7fcf3240c8c0 1 < canceled operation key=XE42LV5M5X82 tag=68YOC3I3SQ42 type=write size=86260 2024-09-19T13:47:37.186 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.185+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~QEFFHNENV0N0.0 size=1048576 2024-09-19T13:47:37.189 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.185+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~QEFFHNENV0N0.1 size=742212 2024-09-19T13:47:37.189 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.185+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=QEFFHNENV0N0 tag=CN1984K8Y92V type=write size=2839364 2024-09-19T13:47:37.192 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.189+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~G1DJKQZFE29I.0 size=1048576 2024-09-19T13:47:37.192 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.189+0000 7fcf3240c8c0 1 < canceled part key=_multipart_AES54TJK7VH7.2~G1DJKQZFE29I.1 size=1048576 2024-09-19T13:47:37.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.193+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~G1DJKQZFE29I.2 size=526202 2024-09-19T13:47:37.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.197+0000 7fcf3240c8c0 1 < canceled multipart upload key=AES54TJK7VH7 upload=G1DJKQZFE29I tag=QZN4TJNKX8IN type=write size=3671930 2024-09-19T13:47:37.204 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.201+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=2IMUP9HRAJNQ type=del size=2672865 2024-09-19T13:47:37.207 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.205+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~1XJYWNCCGIRW.0 size=1048576 2024-09-19T13:47:37.209 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.205+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~1XJYWNCCGIRW.1 size=35983 2024-09-19T13:47:37.213 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.209+0000 7fcf3240c8c0 1 < completed multipart upload key=XE42LV5M5X82 upload=1XJYWNCCGIRW tag=N6ITTKV7IOQW type=write size=2133135 2024-09-19T13:47:37.216 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.213+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=7EXM32U8E5T3 type=del size=3205222 2024-09-19T13:47:37.219 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.217+0000 7fcf3240c8c0 1 < completed delete operation key=STMT6XU2EJQM tag=ZL0ZU923HQCU type=del 2024-09-19T13:47:37.221 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.217+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=ZLPKKTBX9S3D type=del size=1183992 2024-09-19T13:47:37.227 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.225+0000 7fcf3240c8c0 1 < suggested update operation key=D20C6C2ZFX1W tag=E37FRQRSG1GE type=del size=2752107 2024-09-19T13:47:37.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.229+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~JFOLJP3CD2RV.0 size=1048576 2024-09-19T13:47:37.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.229+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~JFOLJP3CD2RV.1 size=1048576 2024-09-19T13:47:37.236 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.233+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~JFOLJP3CD2RV.2 size=882161 2024-09-19T13:47:37.236 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.233+0000 7fcf3240c8c0 1 > prepared multipart upload key=X16ENUFL40RN upload=JFOLJP3CD2RV tag=0YPANF6B65TF type=write size=4027889 2024-09-19T13:47:37.238 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.237+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=E2XL4T69AF69 type=del 2024-09-19T13:47:37.241 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.237+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=9JZLP19VFAOH type=del size=491461 2024-09-19T13:47:37.244 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.241+0000 7fcf3240c8c0 1 < completed delete operation key=M2CO4A2DHJ05 tag=3KGFUBOOH01E type=del 2024-09-19T13:47:37.247 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.245+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=5IYKPBG9MCEG type=del size=3658422 2024-09-19T13:47:37.250 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.245+0000 7fcf3240c8c0 1 < canceled operation key=XE42LV5M5X82 tag=OX07N0G5IBJL type=del size=3921596 2024-09-19T13:47:37.256 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.253+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~KHLQ3U3LI30I.0 size=62147 2024-09-19T13:47:37.256 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.253+0000 7fcf3240c8c0 1 > prepared multipart upload key=X16ENUFL40RN upload=KHLQ3U3LI30I tag=JEQA5TMCW17F type=write size=1110723 2024-09-19T13:47:37.256 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.253+0000 7fcf3240c8c0 1 < canceled part key=_multipart_V8X0VBBNK83J.2~MDPE0MKHN76U.0 size=1048576 2024-09-19T13:47:37.256 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.253+0000 7fcf3240c8c0 1 < canceled part key=_multipart_V8X0VBBNK83J.2~MDPE0MKHN76U.1 size=1048576 2024-09-19T13:47:37.259 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.257+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~MDPE0MKHN76U.2 size=641401 2024-09-19T13:47:37.263 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.261+0000 7fcf3240c8c0 1 < canceled multipart upload key=V8X0VBBNK83J upload=MDPE0MKHN76U tag=OLF3PN1V9V75 type=write size=3787129 2024-09-19T13:47:37.268 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.265+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~YT5K838DFY2M.0 size=1048576 2024-09-19T13:47:37.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.269+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~YT5K838DFY2M.1 size=1048576 2024-09-19T13:47:37.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.269+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~YT5K838DFY2M.2 size=623297 2024-09-19T13:47:37.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.269+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=YT5K838DFY2M tag=QYU6XDBJPQTW type=write size=3769025 2024-09-19T13:47:37.276 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.273+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~HF5UO4M7KI6S.0 size=1048576 2024-09-19T13:47:37.279 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.277+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~HF5UO4M7KI6S.1 size=1048576 2024-09-19T13:47:37.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.277+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~HF5UO4M7KI6S.2 size=654827 2024-09-19T13:47:37.286 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.285+0000 7fcf3240c8c0 1 < completed multipart upload key=A02RDP6BA9AC upload=HF5UO4M7KI6S tag=LJOKXD5NVFH0 type=write size=3800555 2024-09-19T13:47:37.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.285+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=HCK1GU9D91QZ type=del size=3786422 2024-09-19T13:47:37.293 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.289+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~1T5RRP0REVEM.0 size=1048576 2024-09-19T13:47:37.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.293+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~1T5RRP0REVEM.1 size=120287 2024-09-19T13:47:37.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.297+0000 7fcf3240c8c0 1 < completed multipart upload key=QAYJ5B1KZ08J upload=1T5RRP0REVEM tag=923MF83QA2CU type=write size=2217439 2024-09-19T13:47:37.305 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.301+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=3AMGTC3SL998 type=del size=1571826 2024-09-19T13:47:37.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.309+0000 7fcf3240c8c0 1 < suggested update operation key=OA9BMSXGYR9T tag=MZ0GB6M98M0J type=del size=3665514 2024-09-19T13:47:37.314 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.313+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=N1N2EES25E01 type=del size=512123 2024-09-19T13:47:37.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.317+0000 7fcf3240c8c0 1 < suggested update operation key=C35EUAOWLBR3 tag=VXLH7CTISZUG type=del size=4049784 2024-09-19T13:47:37.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.325+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~553F27AC0DU0.0 size=1048576 2024-09-19T13:47:37.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.325+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~553F27AC0DU0.1 size=1048576 2024-09-19T13:47:37.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.329+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~553F27AC0DU0.2 size=782938 2024-09-19T13:47:37.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.329+0000 7fcf3240c8c0 1 > prepared multipart upload key=OA9BMSXGYR9T upload=553F27AC0DU0 tag=VJVYK0JJU7IF type=write size=3928666 2024-09-19T13:47:37.336 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.333+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~TTLLLM3O5CSA.0 size=1048576 2024-09-19T13:47:37.338 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.333+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~TTLLLM3O5CSA.1 size=1048576 2024-09-19T13:47:37.340 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.337+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~TTLLLM3O5CSA.2 size=733582 2024-09-19T13:47:37.345 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.341+0000 7fcf3240c8c0 1 < completed multipart upload key=D20C6C2ZFX1W upload=TTLLLM3O5CSA tag=LT8M9DUUZ92N type=write size=3879310 2024-09-19T13:47:37.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.345+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=3MRT5D04829T type=del size=563109 2024-09-19T13:47:37.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.349+0000 7fcf3240c8c0 1 < canceled operation key=V8X0VBBNK83J tag=U52W9BE0GJPS type=del size=3688436 2024-09-19T13:47:37.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.353+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~V7U2ZWEXMASG.0 size=267817 2024-09-19T13:47:37.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.353+0000 7fcf3240c8c0 1 > prepared multipart upload key=3TME221SA53E upload=V7U2ZWEXMASG tag=6NHTFST3FPDI type=write size=1316393 2024-09-19T13:47:37.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.357+0000 7fcf3240c8c0 1 < completed delete operation key=XE42LV5M5X82 tag=682HTPHC79QD type=del 2024-09-19T13:47:37.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.361+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~2ZXOFA8XWXBB.0 size=1048576 2024-09-19T13:47:37.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.361+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~2ZXOFA8XWXBB.1 size=817276 2024-09-19T13:47:37.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.361+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=2ZXOFA8XWXBB tag=J84HEH880FGL type=write size=2914428 2024-09-19T13:47:37.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.365+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~QEFFHNENV0N0.0 size=1048576 2024-09-19T13:47:37.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.369+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~QEFFHNENV0N0.1 size=742212 2024-09-19T13:47:37.376 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.373+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=QEFFHNENV0N0 tag=CN1984K8Y92V type=write size=2839364 2024-09-19T13:47:37.379 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.377+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=R6JW2YX6DW4X type=del size=3340569 2024-09-19T13:47:37.382 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.377+0000 7fcf3240c8c0 1 < completed delete operation key=BXUPV5XSJBTH tag=2IMUP9HRAJNQ type=del 2024-09-19T13:47:37.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.381+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=FPPYJ1NOZPJE type=del size=1613894 2024-09-19T13:47:37.393 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.389+0000 7fcf3240c8c0 1 < completed delete operation key=M2CO4A2DHJ05 tag=7EXM32U8E5T3 type=del 2024-09-19T13:47:37.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.393+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=0MXBFGCLCFY1 type=write size=408432 2024-09-19T13:47:37.399 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.397+0000 7fcf3240c8c0 1 < completed delete operation key=71Z2VTW99W7J tag=ZLPKKTBX9S3D type=del 2024-09-19T13:47:37.402 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.397+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=XV1F3S09ZKX0 type=del size=463810 2024-09-19T13:47:37.405 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.401+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~JFOLJP3CD2RV.0 size=1048576 2024-09-19T13:47:37.408 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.405+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~JFOLJP3CD2RV.1 size=1048576 2024-09-19T13:47:37.410 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.405+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~JFOLJP3CD2RV.2 size=882161 2024-09-19T13:47:37.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.413+0000 7fcf3240c8c0 1 < completed multipart upload key=X16ENUFL40RN upload=JFOLJP3CD2RV tag=0YPANF6B65TF type=write size=4027889 2024-09-19T13:47:37.420 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.417+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~C4I28ALETIQE.0 size=457635 2024-09-19T13:47:37.420 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.417+0000 7fcf3240c8c0 1 > prepared multipart upload key=STMT6XU2EJQM upload=C4I28ALETIQE tag=HPZXMT102XI7 type=write size=1506211 2024-09-19T13:47:37.423 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.421+0000 7fcf3240c8c0 1 < completed delete operation key=71Z2VTW99W7J tag=9JZLP19VFAOH type=del 2024-09-19T13:47:37.426 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.421+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=1NJ1RIKHKCHU type=del size=1445090 2024-09-19T13:47:37.428 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.425+0000 7fcf3240c8c0 1 < completed delete operation key=DHPONKOVS8CT tag=5IYKPBG9MCEG type=del 2024-09-19T13:47:37.431 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.429+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=36HN7VT6O4LU type=write size=498285 2024-09-19T13:47:37.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.429+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~KHLQ3U3LI30I.0 size=62147 2024-09-19T13:47:37.438 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.433+0000 7fcf3240c8c0 1 < completed multipart upload key=X16ENUFL40RN upload=KHLQ3U3LI30I tag=JEQA5TMCW17F type=write size=1110723 2024-09-19T13:47:37.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.441+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~IO151VYENJ5A.0 size=1048576 2024-09-19T13:47:37.444 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.441+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~IO151VYENJ5A.1 size=1048576 2024-09-19T13:47:37.446 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.445+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~IO151VYENJ5A.2 size=1028182 2024-09-19T13:47:37.447 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.445+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=IO151VYENJ5A tag=JMHRZY8F71GS type=write size=4173910 2024-09-19T13:47:37.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.445+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~YT5K838DFY2M.0 size=1048576 2024-09-19T13:47:37.451 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.449+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~YT5K838DFY2M.1 size=1048576 2024-09-19T13:47:37.451 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.449+0000 7fcf3240c8c0 1 < canceled part key=_multipart_D20C6C2ZFX1W.2~YT5K838DFY2M.2 size=623297 2024-09-19T13:47:37.456 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.453+0000 7fcf3240c8c0 1 < canceled multipart upload key=D20C6C2ZFX1W upload=YT5K838DFY2M tag=QYU6XDBJPQTW type=write size=3769025 2024-09-19T13:47:37.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.457+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~GEF0Q013IOW3.0 size=1048576 2024-09-19T13:47:37.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.461+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~GEF0Q013IOW3.1 size=792791 2024-09-19T13:47:37.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.461+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=GEF0Q013IOW3 tag=A1R2JG52BGBR type=write size=2889943 2024-09-19T13:47:37.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.461+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=HCK1GU9D91QZ type=del 2024-09-19T13:47:37.468 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.465+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=SY5V9NN03AS8 type=del size=2092630 2024-09-19T13:47:37.471 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.469+0000 7fcf3240c8c0 1 < canceled operation key=D1RMXGXS3O7Z tag=3AMGTC3SL998 type=del size=1571826 2024-09-19T13:47:37.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.469+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=G713VVLKEATU type=del size=681476 2024-09-19T13:47:37.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.473+0000 7fcf3240c8c0 1 < completed delete operation key=XE42LV5M5X82 tag=N1N2EES25E01 type=del 2024-09-19T13:47:37.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.477+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~7BUUF7ZUF81I.0 size=1048576 2024-09-19T13:47:37.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.481+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~7BUUF7ZUF81I.1 size=281077 2024-09-19T13:47:37.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.481+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=7BUUF7ZUF81I tag=LFOHUVQ27CR3 type=write size=2378229 2024-09-19T13:47:37.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.485+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~553F27AC0DU0.0 size=1048576 2024-09-19T13:47:37.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.485+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~553F27AC0DU0.1 size=1048576 2024-09-19T13:47:37.491 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.489+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~553F27AC0DU0.2 size=782938 2024-09-19T13:47:37.496 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.493+0000 7fcf3240c8c0 1 < completed multipart upload key=OA9BMSXGYR9T upload=553F27AC0DU0 tag=VJVYK0JJU7IF type=write size=3928666 2024-09-19T13:47:37.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.497+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=GO31GW4O299D type=del size=3408032 2024-09-19T13:47:37.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.497+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=3MRT5D04829T type=del 2024-09-19T13:47:37.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.501+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=07CJW8QT9LUW type=write size=190357 2024-09-19T13:47:37.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.505+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~V7U2ZWEXMASG.0 size=267817 2024-09-19T13:47:37.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.509+0000 7fcf3240c8c0 1 < completed multipart upload key=3TME221SA53E upload=V7U2ZWEXMASG tag=6NHTFST3FPDI type=write size=1316393 2024-09-19T13:47:37.516 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.513+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~HXDR1IZ0PSGL.0 size=1048576 2024-09-19T13:47:37.518 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.513+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~HXDR1IZ0PSGL.1 size=1048576 2024-09-19T13:47:37.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.517+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~HXDR1IZ0PSGL.2 size=115350 2024-09-19T13:47:37.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.517+0000 7fcf3240c8c0 1 > prepared multipart upload key=A02RDP6BA9AC upload=HXDR1IZ0PSGL tag=KR074O3RGJVF type=write size=3261078 2024-09-19T13:47:37.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.521+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~2ZXOFA8XWXBB.0 size=1048576 2024-09-19T13:47:37.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.521+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~2ZXOFA8XWXBB.1 size=817276 2024-09-19T13:47:37.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.525+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=2ZXOFA8XWXBB tag=J84HEH880FGL type=write size=2914428 2024-09-19T13:47:37.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.529+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=BBAM1B2Z8IS8 type=del size=230534 2024-09-19T13:47:37.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.533+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=R6JW2YX6DW4X type=del 2024-09-19T13:47:37.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.533+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=POY8XJ48R2UO type=write size=128000 2024-09-19T13:47:37.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.537+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=FPPYJ1NOZPJE type=del 2024-09-19T13:47:37.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.541+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=GZDA4UMO3IGK type=del size=1707668 2024-09-19T13:47:37.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.541+0000 7fcf3240c8c0 1 < completed write operation key=BXUPV5XSJBTH tag=0MXBFGCLCFY1 type=write size=408432 2024-09-19T13:47:37.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.545+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=5OLVK0LWO0E9 type=del size=125214 2024-09-19T13:47:37.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.549+0000 7fcf3240c8c0 1 < completed delete operation key=X16ENUFL40RN tag=XV1F3S09ZKX0 type=del 2024-09-19T13:47:37.557 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.553+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~Q2XF45L4J3R1.0 size=1048576 2024-09-19T13:47:37.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.557+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~Q2XF45L4J3R1.1 size=194306 2024-09-19T13:47:37.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.557+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=Q2XF45L4J3R1 tag=381RA2L4XWJC type=write size=2291458 2024-09-19T13:47:37.562 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.557+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~C4I28ALETIQE.0 size=457635 2024-09-19T13:47:37.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.565+0000 7fcf3240c8c0 1 < completed multipart upload key=STMT6XU2EJQM upload=C4I28ALETIQE tag=HPZXMT102XI7 type=write size=1506211 2024-09-19T13:47:37.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.565+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=UAL0H16FNSH1 type=del size=2015048 2024-09-19T13:47:37.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.569+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=1NJ1RIKHKCHU type=del 2024-09-19T13:47:37.575 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.573+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=1ECD8Q3W3JBF type=del size=1957404 2024-09-19T13:47:37.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.577+0000 7fcf3240c8c0 1 < suggested update operation key=N51Q6HKJSCCB tag=36HN7VT6O4LU type=write size=498285 2024-09-19T13:47:37.585 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.581+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~D06KD9D3ANKE.0 size=1048576 2024-09-19T13:47:37.587 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.585+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~D06KD9D3ANKE.1 size=1048576 2024-09-19T13:47:37.589 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.585+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~D06KD9D3ANKE.2 size=959644 2024-09-19T13:47:37.589 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.585+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=D06KD9D3ANKE tag=Z55RXXVLR57L type=write size=4105372 2024-09-19T13:47:37.592 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.589+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~IO151VYENJ5A.0 size=1048576 2024-09-19T13:47:37.594 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.589+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~IO151VYENJ5A.1 size=1048576 2024-09-19T13:47:37.596 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.593+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~IO151VYENJ5A.2 size=1028182 2024-09-19T13:47:37.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.597+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=IO151VYENJ5A tag=JMHRZY8F71GS type=write size=4173910 2024-09-19T13:47:37.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.601+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~926RYL3FYTOZ.0 size=1048576 2024-09-19T13:47:37.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.605+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~926RYL3FYTOZ.1 size=1048576 2024-09-19T13:47:37.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.605+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~926RYL3FYTOZ.2 size=257119 2024-09-19T13:47:37.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.605+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=926RYL3FYTOZ tag=L1IULR7K3K6R type=write size=3402847 2024-09-19T13:47:37.612 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.609+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~GEF0Q013IOW3.0 size=1048576 2024-09-19T13:47:37.614 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.613+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~GEF0Q013IOW3.1 size=792791 2024-09-19T13:47:37.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.617+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=GEF0Q013IOW3 tag=A1R2JG52BGBR type=write size=2889943 2024-09-19T13:47:37.624 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.621+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~4ZM6SDY47GI3.0 size=1048576 2024-09-19T13:47:37.626 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.625+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~4ZM6SDY47GI3.1 size=1048576 2024-09-19T13:47:37.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.625+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~4ZM6SDY47GI3.2 size=658138 2024-09-19T13:47:37.629 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.625+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=4ZM6SDY47GI3 tag=8EZW25ERX3F7 type=write size=3803866 2024-09-19T13:47:37.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.629+0000 7fcf3240c8c0 1 < completed delete operation key=M2CO4A2DHJ05 tag=SY5V9NN03AS8 type=del 2024-09-19T13:47:37.634 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.629+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=K0QY22NJMBBW type=del size=61234 2024-09-19T13:47:37.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.633+0000 7fcf3240c8c0 1 < completed delete operation key=0UCFTOF1YBBM tag=G713VVLKEATU type=del 2024-09-19T13:47:37.639 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.637+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=NFFCABW4S1YX type=write size=147857 2024-09-19T13:47:37.644 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.641+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~7BUUF7ZUF81I.0 size=1048576 2024-09-19T13:47:37.646 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.645+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~7BUUF7ZUF81I.1 size=281077 2024-09-19T13:47:37.651 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.649+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=7BUUF7ZUF81I tag=LFOHUVQ27CR3 type=write size=2378229 2024-09-19T13:47:37.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.649+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=CQ5VAR44HMZO type=del size=2024837 2024-09-19T13:47:37.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.653+0000 7fcf3240c8c0 1 < completed delete operation key=C3TFYNXH549T tag=GO31GW4O299D type=del 2024-09-19T13:47:37.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.657+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=83TTY56SKR8N type=del size=4127738 2024-09-19T13:47:37.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.657+0000 7fcf3240c8c0 1 < completed write operation key=ZCKKQ1R8318S tag=07CJW8QT9LUW type=write size=190357 2024-09-19T13:47:37.664 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.661+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=NUL87NDJ4UTT type=write size=829165 2024-09-19T13:47:37.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.661+0000 7fcf3240c8c0 1 < canceled part key=_multipart_A02RDP6BA9AC.2~HXDR1IZ0PSGL.0 size=1048576 2024-09-19T13:47:37.667 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.665+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~HXDR1IZ0PSGL.1 size=1048576 2024-09-19T13:47:37.667 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.665+0000 7fcf3240c8c0 1 < canceled part key=_multipart_A02RDP6BA9AC.2~HXDR1IZ0PSGL.2 size=115350 2024-09-19T13:47:37.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.669+0000 7fcf3240c8c0 1 < canceled multipart upload key=A02RDP6BA9AC upload=HXDR1IZ0PSGL tag=KR074O3RGJVF type=write size=3261078 2024-09-19T13:47:37.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.673+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=3UPRM459TUWA type=del size=552483 2024-09-19T13:47:37.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.673+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=BBAM1B2Z8IS8 type=del 2024-09-19T13:47:37.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.677+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=RV9F59XOIDQ0 type=del size=45188 2024-09-19T13:47:37.683 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.681+0000 7fcf3240c8c0 1 < completed write operation key=STMT6XU2EJQM tag=POY8XJ48R2UO type=write size=128000 2024-09-19T13:47:37.688 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.685+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~810486XTF7BZ.0 size=1048576 2024-09-19T13:47:37.691 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.689+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~810486XTF7BZ.1 size=1048576 2024-09-19T13:47:37.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.689+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~810486XTF7BZ.2 size=485423 2024-09-19T13:47:37.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.689+0000 7fcf3240c8c0 1 > prepared multipart upload key=C8T6DB9V9FBT upload=810486XTF7BZ tag=3EHXY00UNNJM type=write size=3631151 2024-09-19T13:47:37.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.693+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=GZDA4UMO3IGK type=del 2024-09-19T13:47:37.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.693+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=9JM17VDWY89Y type=del size=3114491 2024-09-19T13:47:37.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.697+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=5OLVK0LWO0E9 type=del 2024-09-19T13:47:37.703 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.701+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=23M5AS1ETVQW type=del size=1494496 2024-09-19T13:47:37.706 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.701+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~Q2XF45L4J3R1.0 size=1048576 2024-09-19T13:47:37.706 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.701+0000 7fcf3240c8c0 1 < canceled part key=_multipart_QAYJ5B1KZ08J.2~Q2XF45L4J3R1.1 size=194306 2024-09-19T13:47:37.710 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.709+0000 7fcf3240c8c0 1 < canceled multipart upload key=QAYJ5B1KZ08J upload=Q2XF45L4J3R1 tag=381RA2L4XWJC type=write size=2291458 2024-09-19T13:47:37.713 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.709+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=80RW6EJOO70J type=write size=34959 2024-09-19T13:47:37.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.713+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=UAL0H16FNSH1 type=del 2024-09-19T13:47:37.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.717+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=11GZZ3XX34XR type=del size=1677598 2024-09-19T13:47:37.725 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.721+0000 7fcf3240c8c0 1 < suggested update operation key=X9FGPMP30X47 tag=1ECD8Q3W3JBF type=del size=1957404 2024-09-19T13:47:37.730 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.729+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~HL2BV6XFLX61.0 size=1048576 2024-09-19T13:47:37.733 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.729+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~HL2BV6XFLX61.1 size=1048576 2024-09-19T13:47:37.735 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.733+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~HL2BV6XFLX61.2 size=289739 2024-09-19T13:47:37.735 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.733+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=HL2BV6XFLX61 tag=YLQCOIV2WXJ9 type=write size=3435467 2024-09-19T13:47:37.738 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.733+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~D06KD9D3ANKE.0 size=1048576 2024-09-19T13:47:37.740 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.737+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~D06KD9D3ANKE.1 size=1048576 2024-09-19T13:47:37.740 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.737+0000 7fcf3240c8c0 1 < canceled part key=_multipart_QAYJ5B1KZ08J.2~D06KD9D3ANKE.2 size=959644 2024-09-19T13:47:37.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.741+0000 7fcf3240c8c0 1 < canceled multipart upload key=QAYJ5B1KZ08J upload=D06KD9D3ANKE tag=Z55RXXVLR57L type=write size=4105372 2024-09-19T13:47:37.749 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.745+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=H5XBWS19P0YT type=del size=1518755 2024-09-19T13:47:37.752 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.749+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~926RYL3FYTOZ.0 size=1048576 2024-09-19T13:47:37.754 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.749+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~926RYL3FYTOZ.1 size=1048576 2024-09-19T13:47:37.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.753+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~926RYL3FYTOZ.2 size=257119 2024-09-19T13:47:37.762 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.757+0000 7fcf3240c8c0 1 < completed multipart upload key=NP2L28YRVQ8L upload=926RYL3FYTOZ tag=L1IULR7K3K6R type=write size=3402847 2024-09-19T13:47:37.768 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.765+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~IN9P0XG88ULD.0 size=1048576 2024-09-19T13:47:37.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.765+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~IN9P0XG88ULD.1 size=1048576 2024-09-19T13:47:37.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.769+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~IN9P0XG88ULD.2 size=255833 2024-09-19T13:47:37.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.769+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=IN9P0XG88ULD tag=XADYLUGX4OOA type=write size=3401561 2024-09-19T13:47:37.776 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.773+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~4ZM6SDY47GI3.0 size=1048576 2024-09-19T13:47:37.778 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.777+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~4ZM6SDY47GI3.1 size=1048576 2024-09-19T13:47:37.780 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.777+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~4ZM6SDY47GI3.2 size=658138 2024-09-19T13:47:37.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.781+0000 7fcf3240c8c0 1 < completed multipart upload key=AES54TJK7VH7 upload=4ZM6SDY47GI3 tag=8EZW25ERX3F7 type=write size=3803866 2024-09-19T13:47:37.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.789+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~FLJKU9O3HQ6U.0 size=1048576 2024-09-19T13:47:37.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.789+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~FLJKU9O3HQ6U.1 size=1048576 2024-09-19T13:47:37.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.793+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~FLJKU9O3HQ6U.2 size=23353 2024-09-19T13:47:37.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.793+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=FLJKU9O3HQ6U tag=VRQF4BTX0XSF type=write size=3169081 2024-09-19T13:47:37.800 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.797+0000 7fcf3240c8c0 1 < canceled operation key=HXMZKP7H3HJE tag=K0QY22NJMBBW type=del size=61234 2024-09-19T13:47:37.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.801+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~TY3IXGRLPB4Y.0 size=239504 2024-09-19T13:47:37.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.801+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=TY3IXGRLPB4Y tag=ABLHLE3VK13B type=write size=1288080 2024-09-19T13:47:37.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.805+0000 7fcf3240c8c0 1 < completed write operation key=ZCKKQ1R8318S tag=NFFCABW4S1YX type=write size=147857 2024-09-19T13:47:37.812 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.809+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=7DAD3EUR12MY type=write size=909764 2024-09-19T13:47:37.815 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.813+0000 7fcf3240c8c0 1 < completed delete operation key=M2CO4A2DHJ05 tag=CQ5VAR44HMZO type=del 2024-09-19T13:47:37.819 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.817+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=KW3F5PMZWC8I type=write size=691541 2024-09-19T13:47:37.822 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.817+0000 7fcf3240c8c0 1 < completed delete operation key=XE42LV5M5X82 tag=83TTY56SKR8N type=del 2024-09-19T13:47:37.828 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.825+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~WDW0IJJI3L24.0 size=1048576 2024-09-19T13:47:37.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.829+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~WDW0IJJI3L24.1 size=1048576 2024-09-19T13:47:37.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.829+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~WDW0IJJI3L24.2 size=109915 2024-09-19T13:47:37.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.829+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=WDW0IJJI3L24 tag=J57KOFNKOCH6 type=write size=3255643 2024-09-19T13:47:37.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.837+0000 7fcf3240c8c0 1 < suggested remove operation key=X16ENUFL40RN tag=NUL87NDJ4UTT type=write 2024-09-19T13:47:37.843 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.841+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=YYMLP9RXB25Q type=del size=3623883 2024-09-19T13:47:37.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.845+0000 7fcf3240c8c0 1 < completed delete operation key=V8X0VBBNK83J tag=3UPRM459TUWA type=del 2024-09-19T13:47:37.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.849+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~UMLB6GQBRZ1Z.0 size=1048576 2024-09-19T13:47:37.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.853+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~UMLB6GQBRZ1Z.1 size=1048576 2024-09-19T13:47:37.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.853+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~UMLB6GQBRZ1Z.2 size=22047 2024-09-19T13:47:37.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.853+0000 7fcf3240c8c0 1 > prepared multipart upload key=6DFF2OCPT9W2 upload=UMLB6GQBRZ1Z tag=NBFSQSOJKLPS type=write size=3167775 2024-09-19T13:47:37.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.857+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=RV9F59XOIDQ0 type=del 2024-09-19T13:47:37.867 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.865+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~6Z7NYE31JYVI.0 size=1048576 2024-09-19T13:47:37.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.865+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~6Z7NYE31JYVI.1 size=1048576 2024-09-19T13:47:37.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.869+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~6Z7NYE31JYVI.2 size=3379 2024-09-19T13:47:37.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.869+0000 7fcf3240c8c0 1 > prepared multipart upload key=A02RDP6BA9AC upload=6Z7NYE31JYVI tag=14U58JG1Q9H4 type=write size=3149107 2024-09-19T13:47:37.875 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.873+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~810486XTF7BZ.0 size=1048576 2024-09-19T13:47:37.878 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.873+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~810486XTF7BZ.1 size=1048576 2024-09-19T13:47:37.880 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.877+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~810486XTF7BZ.2 size=485423 2024-09-19T13:47:37.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.881+0000 7fcf3240c8c0 1 < completed multipart upload key=C8T6DB9V9FBT upload=810486XTF7BZ tag=3EHXY00UNNJM type=write size=3631151 2024-09-19T13:47:37.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.885+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=SIX2WNFFBXIS type=del size=801317 2024-09-19T13:47:37.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.889+0000 7fcf3240c8c0 1 < completed delete operation key=STMT6XU2EJQM tag=9JM17VDWY89Y type=del 2024-09-19T13:47:37.900 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.897+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~QEWBWQPCCJ72.0 size=1048576 2024-09-19T13:47:37.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.901+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~QEWBWQPCCJ72.1 size=439526 2024-09-19T13:47:37.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.901+0000 7fcf3240c8c0 1 > prepared multipart upload key=X16ENUFL40RN upload=QEWBWQPCCJ72 tag=JUPYF9UWYNMI type=write size=2536678 2024-09-19T13:47:37.906 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.905+0000 7fcf3240c8c0 1 < completed delete operation key=M2CO4A2DHJ05 tag=23M5AS1ETVQW type=del 2024-09-19T13:47:37.910 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.905+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=Z6GJU62URWNX type=write size=146005 2024-09-19T13:47:37.914 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.909+0000 7fcf3240c8c0 1 < completed write operation key=BXUPV5XSJBTH tag=80RW6EJOO70J type=write size=34959 2024-09-19T13:47:37.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.913+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=7SWNCF62XHGZ type=del size=402462 2024-09-19T13:47:37.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.917+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=11GZZ3XX34XR type=del 2024-09-19T13:47:37.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.921+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=HLA48LLIWD5H type=del size=3552737 2024-09-19T13:47:37.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.928+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~HL2BV6XFLX61.0 size=1048576 2024-09-19T13:47:37.935 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.932+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~HL2BV6XFLX61.1 size=1048576 2024-09-19T13:47:37.938 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.936+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~HL2BV6XFLX61.2 size=289739 2024-09-19T13:47:37.943 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.940+0000 7fcf3240c8c0 1 < completed multipart upload key=QSM2Q8CW1Q86 upload=HL2BV6XFLX61 tag=YLQCOIV2WXJ9 type=write size=3435467 2024-09-19T13:47:37.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.944+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~9N8BAEAHBXLM.0 size=1048576 2024-09-19T13:47:37.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.948+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~9N8BAEAHBXLM.1 size=1048576 2024-09-19T13:47:37.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.948+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~9N8BAEAHBXLM.2 size=343817 2024-09-19T13:47:37.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.948+0000 7fcf3240c8c0 1 > prepared multipart upload key=STMT6XU2EJQM upload=9N8BAEAHBXLM tag=8QR9LTV5B2B9 type=write size=3489545 2024-09-19T13:47:37.957 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.952+0000 7fcf3240c8c0 1 < completed delete operation key=0UCFTOF1YBBM tag=H5XBWS19P0YT type=del 2024-09-19T13:47:37.962 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.956+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~KMUBOYCILRIF.0 size=1048576 2024-09-19T13:47:37.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.960+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~KMUBOYCILRIF.1 size=298854 2024-09-19T13:47:37.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.960+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=KMUBOYCILRIF tag=1NBF24ZC5WWT type=write size=2396006 2024-09-19T13:47:37.967 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.964+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~IN9P0XG88ULD.0 size=1048576 2024-09-19T13:47:37.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.964+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~IN9P0XG88ULD.1 size=1048576 2024-09-19T13:47:37.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.968+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~IN9P0XG88ULD.2 size=255833 2024-09-19T13:47:37.977 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.972+0000 7fcf3240c8c0 1 < completed multipart upload key=XE42LV5M5X82 upload=IN9P0XG88ULD tag=XADYLUGX4OOA type=write size=3401561 2024-09-19T13:47:37.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.980+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~L1S0UHB0NVNT.0 size=262543 2024-09-19T13:47:37.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.980+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=L1S0UHB0NVNT tag=QYLVN1T23GIB type=write size=1311119 2024-09-19T13:47:37.986 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.984+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~FLJKU9O3HQ6U.0 size=1048576 2024-09-19T13:47:37.994 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.988+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~FLJKU9O3HQ6U.1 size=1048576 2024-09-19T13:47:37.994 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.988+0000 7fcf3240c8c0 1 < canceled part key=_multipart_ES62XJO5Q3FO.2~FLJKU9O3HQ6U.2 size=23353 2024-09-19T13:47:38.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:37.996+0000 7fcf3240c8c0 1 < canceled multipart upload key=ES62XJO5Q3FO upload=FLJKU9O3HQ6U tag=VRQF4BTX0XSF type=write size=3169081 2024-09-19T13:47:38.005 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.000+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=SZ75KM9KXZ4L type=del size=2817125 2024-09-19T13:47:38.007 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.000+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~TY3IXGRLPB4Y.0 size=239504 2024-09-19T13:47:38.011 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.008+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=TY3IXGRLPB4Y tag=ABLHLE3VK13B type=write size=1288080 2024-09-19T13:47:38.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.012+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~2MK9VZI692NH.0 size=685966 2024-09-19T13:47:38.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.012+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=2MK9VZI692NH tag=U96C85C97BK7 type=write size=1734542 2024-09-19T13:47:38.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.016+0000 7fcf3240c8c0 1 < completed write operation key=M2CO4A2DHJ05 tag=7DAD3EUR12MY type=write size=909764 2024-09-19T13:47:38.025 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.020+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=1LDBBQI805K8 type=del size=2575406 2024-09-19T13:47:38.028 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.024+0000 7fcf3240c8c0 1 < completed write operation key=0UCFTOF1YBBM tag=KW3F5PMZWC8I type=write size=691541 2024-09-19T13:47:38.031 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.028+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=UP57KOLJ2X3V type=del size=3455774 2024-09-19T13:47:38.034 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.032+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~WDW0IJJI3L24.0 size=1048576 2024-09-19T13:47:38.037 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.032+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~WDW0IJJI3L24.1 size=1048576 2024-09-19T13:47:38.040 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.036+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~WDW0IJJI3L24.2 size=109915 2024-09-19T13:47:38.045 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.040+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=WDW0IJJI3L24 tag=J57KOFNKOCH6 type=write size=3255643 2024-09-19T13:47:38.048 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.044+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=U0ZOWTA72VTX type=write size=334315 2024-09-19T13:47:38.052 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.048+0000 7fcf3240c8c0 1 < canceled operation key=1BMF3S2BZLLI tag=YYMLP9RXB25Q type=del size=3623883 2024-09-19T13:47:38.059 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.056+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~P0O3MH1QZFO8.0 size=1048576 2024-09-19T13:47:38.061 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.056+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~P0O3MH1QZFO8.1 size=1048576 2024-09-19T13:47:38.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.060+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~P0O3MH1QZFO8.2 size=142342 2024-09-19T13:47:38.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.060+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=P0O3MH1QZFO8 tag=PTIGSROD4N5P type=write size=3288070 2024-09-19T13:47:38.067 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.064+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~UMLB6GQBRZ1Z.0 size=1048576 2024-09-19T13:47:38.069 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.064+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~UMLB6GQBRZ1Z.1 size=1048576 2024-09-19T13:47:38.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.068+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~UMLB6GQBRZ1Z.2 size=22047 2024-09-19T13:47:38.076 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.072+0000 7fcf3240c8c0 1 < completed multipart upload key=6DFF2OCPT9W2 upload=UMLB6GQBRZ1Z tag=NBFSQSOJKLPS type=write size=3167775 2024-09-19T13:47:38.078 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.076+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=QM39PNQQ195W type=del size=140475 2024-09-19T13:47:38.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.076+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~6Z7NYE31JYVI.0 size=1048576 2024-09-19T13:47:38.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.080+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~6Z7NYE31JYVI.1 size=1048576 2024-09-19T13:47:38.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.080+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~6Z7NYE31JYVI.2 size=3379 2024-09-19T13:47:38.092 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.088+0000 7fcf3240c8c0 1 < completed multipart upload key=A02RDP6BA9AC upload=6Z7NYE31JYVI tag=14U58JG1Q9H4 type=write size=3149107 2024-09-19T13:47:38.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.092+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=FIBXNPSJ3LX9 type=del size=1142070 2024-09-19T13:47:38.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.092+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=SIX2WNFFBXIS type=del 2024-09-19T13:47:38.101 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.096+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=85RFVX4Q1FCO type=write size=270396 2024-09-19T13:47:38.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.100+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~QEWBWQPCCJ72.0 size=1048576 2024-09-19T13:47:38.107 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.104+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~QEWBWQPCCJ72.1 size=439526 2024-09-19T13:47:38.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.108+0000 7fcf3240c8c0 1 < completed multipart upload key=X16ENUFL40RN upload=QEWBWQPCCJ72 tag=JUPYF9UWYNMI type=write size=2536678 2024-09-19T13:47:38.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.112+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=R1EF1VQ8R4WC type=del size=2124944 2024-09-19T13:47:38.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.120+0000 7fcf3240c8c0 1 < suggested remove operation key=QMSDNKYFFK1F tag=Z6GJU62URWNX type=write 2024-09-19T13:47:38.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.124+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~XLZCVM34ZL57.0 size=967858 2024-09-19T13:47:38.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.124+0000 7fcf3240c8c0 1 > prepared multipart upload key=DHPONKOVS8CT upload=XLZCVM34ZL57 tag=YQC9RCM3443F type=write size=2016434 2024-09-19T13:47:38.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.132+0000 7fcf3240c8c0 1 < suggested remove operation key=ZCKKQ1R8318S tag=7SWNCF62XHGZ type=del 2024-09-19T13:47:38.139 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.136+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=KA86JWDWPNUM type=write size=885412 2024-09-19T13:47:38.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.136+0000 7fcf3240c8c0 1 < canceled operation key=0U9BUX9DHTAK tag=HLA48LLIWD5H type=del size=3552737 2024-09-19T13:47:38.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.140+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=1F493H2L383R type=del size=3662686 2024-09-19T13:47:38.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.140+0000 7fcf3240c8c0 1 < canceled part key=_multipart_STMT6XU2EJQM.2~9N8BAEAHBXLM.0 size=1048576 2024-09-19T13:47:38.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.144+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~9N8BAEAHBXLM.1 size=1048576 2024-09-19T13:47:38.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.148+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~9N8BAEAHBXLM.2 size=343817 2024-09-19T13:47:38.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.152+0000 7fcf3240c8c0 1 < canceled multipart upload key=STMT6XU2EJQM upload=9N8BAEAHBXLM tag=8QR9LTV5B2B9 type=write size=3489545 2024-09-19T13:47:38.159 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.156+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=JXN33SXLQ0EV type=del size=2802668 2024-09-19T13:47:38.162 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.160+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~KMUBOYCILRIF.0 size=1048576 2024-09-19T13:47:38.165 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.160+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~KMUBOYCILRIF.1 size=298854 2024-09-19T13:47:38.171 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.168+0000 7fcf3240c8c0 1 < completed multipart upload key=AES54TJK7VH7 upload=KMUBOYCILRIF tag=1NBF24ZC5WWT type=write size=2396006 2024-09-19T13:47:38.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.172+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~S2YFRR4KQVJV.0 size=471040 2024-09-19T13:47:38.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.172+0000 7fcf3240c8c0 1 > prepared multipart upload key=D1RMXGXS3O7Z upload=S2YFRR4KQVJV tag=KOFJU64UW94K type=write size=1519616 2024-09-19T13:47:38.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.176+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~L1S0UHB0NVNT.0 size=262543 2024-09-19T13:47:38.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.180+0000 7fcf3240c8c0 1 < completed multipart upload key=QMSDNKYFFK1F upload=L1S0UHB0NVNT tag=QYLVN1T23GIB type=write size=1311119 2024-09-19T13:47:38.191 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.188+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~69A8DUQ9WLSJ.0 size=65696 2024-09-19T13:47:38.192 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.188+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=69A8DUQ9WLSJ tag=R61YPU76DP3G type=write size=1114272 2024-09-19T13:47:38.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.196+0000 7fcf3240c8c0 1 < suggested remove operation key=X9FGPMP30X47 tag=SZ75KM9KXZ4L type=del 2024-09-19T13:47:38.202 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.196+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=1H6DK6K7P6YY type=del size=1235443 2024-09-19T13:47:38.208 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.200+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~2MK9VZI692NH.0 size=685966 2024-09-19T13:47:38.211 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.208+0000 7fcf3240c8c0 1 < completed multipart upload key=ZCKKQ1R8318S upload=2MK9VZI692NH tag=U96C85C97BK7 type=write size=1734542 2024-09-19T13:47:38.214 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.208+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=K7LOX0XW61EG type=write size=250930 2024-09-19T13:47:38.218 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.212+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=1LDBBQI805K8 type=del 2024-09-19T13:47:38.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.220+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~KMGPGCN3NCAX.0 size=1048576 2024-09-19T13:47:38.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.220+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~KMGPGCN3NCAX.1 size=1048576 2024-09-19T13:47:38.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.228+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~KMGPGCN3NCAX.2 size=267871 2024-09-19T13:47:38.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.228+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=KMGPGCN3NCAX tag=164UCIM12VVR type=write size=3413599 2024-09-19T13:47:38.235 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.232+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=UP57KOLJ2X3V type=del 2024-09-19T13:47:38.238 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.236+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=DTLRF86BLKD6 type=del size=3669207 2024-09-19T13:47:38.244 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.240+0000 7fcf3240c8c0 1 < suggested update operation key=D20C6C2ZFX1W tag=U0ZOWTA72VTX type=write size=334315 2024-09-19T13:47:38.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.244+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=IM2OC8Z8YF48 type=write size=276381 2024-09-19T13:47:38.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.248+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~P0O3MH1QZFO8.0 size=1048576 2024-09-19T13:47:38.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.248+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~P0O3MH1QZFO8.1 size=1048576 2024-09-19T13:47:38.256 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.252+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~P0O3MH1QZFO8.2 size=142342 2024-09-19T13:47:38.260 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.256+0000 7fcf3240c8c0 1 < completed multipart upload key=0UCFTOF1YBBM upload=P0O3MH1QZFO8 tag=PTIGSROD4N5P type=write size=3288070 2024-09-19T13:47:38.263 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.260+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=1GTJGA01EHCB type=del size=1824901 2024-09-19T13:47:38.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.264+0000 7fcf3240c8c0 1 < suggested remove operation key=HXMZKP7H3HJE tag=QM39PNQQ195W type=del 2024-09-19T13:47:38.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.268+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=O7MC9ABK003A type=write size=373902 2024-09-19T13:47:38.274 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.272+0000 7fcf3240c8c0 -1 < failed to complete operation key=QMSDNKYFFK1F tag=FIBXNPSJ3LX9 type=del size=1142070: (22) Invalid argument 2024-09-19T13:47:38.279 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.276+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~J4LP8O0C8XI9.0 size=1048576 2024-09-19T13:47:38.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.276+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~J4LP8O0C8XI9.1 size=1048576 2024-09-19T13:47:38.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.280+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~J4LP8O0C8XI9.2 size=142927 2024-09-19T13:47:38.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.280+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=J4LP8O0C8XI9 tag=5Y3V1W0NZYQW type=write size=3288655 2024-09-19T13:47:38.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.284+0000 7fcf3240c8c0 1 < suggested remove operation key=V8X0VBBNK83J tag=85RFVX4Q1FCO type=write 2024-09-19T13:47:38.291 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.288+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=ZO9QHQ365K2C type=del size=405381 2024-09-19T13:47:38.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.292+0000 7fcf3240c8c0 1 < suggested remove operation key=7UC85R2HO9K2 tag=R1EF1VQ8R4WC type=del 2024-09-19T13:47:38.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.296+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=G8K468T098KD type=write size=976813 2024-09-19T13:47:38.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.296+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~XLZCVM34ZL57.0 size=967858 2024-09-19T13:47:38.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.304+0000 7fcf3240c8c0 1 < completed multipart upload key=DHPONKOVS8CT upload=XLZCVM34ZL57 tag=YQC9RCM3443F type=write size=2016434 2024-09-19T13:47:38.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.304+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=BMJQOWMELPTI type=del size=633949 2024-09-19T13:47:38.312 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.308+0000 7fcf3240c8c0 1 < completed write operation key=AES54TJK7VH7 tag=KA86JWDWPNUM type=write size=885412 2024-09-19T13:47:38.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.312+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~QMYZ3AO3VMI5.0 size=1048576 2024-09-19T13:47:38.318 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.316+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~QMYZ3AO3VMI5.1 size=283940 2024-09-19T13:47:38.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.316+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=QMYZ3AO3VMI5 tag=4W7ESM975DM7 type=write size=2381092 2024-09-19T13:47:38.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.316+0000 7fcf3240c8c0 1 < completed delete operation key=3TME221SA53E tag=1F493H2L383R type=del 2024-09-19T13:47:38.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.320+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=A23W48TVNJ9T type=del size=2896352 2024-09-19T13:47:38.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.324+0000 7fcf3240c8c0 1 < completed delete operation key=QSM2Q8CW1Q86 tag=JXN33SXLQ0EV type=del 2024-09-19T13:47:38.332 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.328+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~JI9KGZOAW57Y.0 size=1048576 2024-09-19T13:47:38.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.332+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~JI9KGZOAW57Y.1 size=253234 2024-09-19T13:47:38.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.332+0000 7fcf3240c8c0 1 > prepared multipart upload key=STMT6XU2EJQM upload=JI9KGZOAW57Y tag=93E8E8HY6MNL type=write size=2350386 2024-09-19T13:47:38.338 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.332+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~S2YFRR4KQVJV.0 size=471040 2024-09-19T13:47:38.343 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.340+0000 7fcf3240c8c0 1 < completed multipart upload key=D1RMXGXS3O7Z upload=S2YFRR4KQVJV tag=KOFJU64UW94K type=write size=1519616 2024-09-19T13:47:38.346 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.340+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=8JA3I8TYA0QW type=del size=16248 2024-09-19T13:47:38.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.344+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~69A8DUQ9WLSJ.0 size=65696 2024-09-19T13:47:38.354 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.348+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=69A8DUQ9WLSJ tag=R61YPU76DP3G type=write size=1114272 2024-09-19T13:47:38.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.356+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~MK4LDD8ZK143.0 size=1048576 2024-09-19T13:47:38.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.356+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~MK4LDD8ZK143.1 size=1048576 2024-09-19T13:47:38.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.360+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~MK4LDD8ZK143.2 size=608364 2024-09-19T13:47:38.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.360+0000 7fcf3240c8c0 1 > prepared multipart upload key=3TME221SA53E upload=MK4LDD8ZK143 tag=OBCUO6FL4AIC type=write size=3754092 2024-09-19T13:47:38.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.364+0000 7fcf3240c8c0 1 < completed delete operation key=C8T6DB9V9FBT tag=1H6DK6K7P6YY type=del 2024-09-19T13:47:38.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.364+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=U53L8B8H8HUD type=del size=3736427 2024-09-19T13:47:38.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.368+0000 7fcf3240c8c0 -1 < failed to complete operation key=HXMZKP7H3HJE tag=K7LOX0XW61EG type=write size=250930: (22) Invalid argument 2024-09-19T13:47:38.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.372+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=9GNBP8Q674E8 type=del size=3435225 2024-09-19T13:47:38.378 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.372+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~KMGPGCN3NCAX.0 size=1048576 2024-09-19T13:47:38.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.376+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~KMGPGCN3NCAX.1 size=1048576 2024-09-19T13:47:38.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.380+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~KMGPGCN3NCAX.2 size=267871 2024-09-19T13:47:38.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.388+0000 7fcf3240c8c0 1 < completed multipart upload key=N51Q6HKJSCCB upload=KMGPGCN3NCAX tag=164UCIM12VVR type=write size=3413599 2024-09-19T13:47:38.397 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.392+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~1SMJM43CV8UO.0 size=401215 2024-09-19T13:47:38.397 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.392+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=1SMJM43CV8UO tag=9JCFANKTUE7P type=write size=1449791 2024-09-19T13:47:38.403 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.400+0000 7fcf3240c8c0 1 < suggested update operation key=C8T6DB9V9FBT tag=DTLRF86BLKD6 type=del size=3669207 2024-09-19T13:47:38.405 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.400+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=MQ6F97JU81OS type=del size=755727 2024-09-19T13:47:38.408 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.404+0000 7fcf3240c8c0 1 < completed write operation key=0U9BUX9DHTAK tag=IM2OC8Z8YF48 type=write size=276381 2024-09-19T13:47:38.411 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.408+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=2ZWUUPI5Y9VA type=del size=3002631 2024-09-19T13:47:38.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.408+0000 7fcf3240c8c0 1 < completed delete operation key=ZCKKQ1R8318S tag=1GTJGA01EHCB type=del 2024-09-19T13:47:38.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.412+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=VFWKI6WKZC8O type=del size=3925938 2024-09-19T13:47:38.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.416+0000 7fcf3240c8c0 -1 < failed to complete operation key=C8T6DB9V9FBT tag=O7MC9ABK003A type=write size=373902: (22) Invalid argument 2024-09-19T13:47:38.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.416+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=BTA7ACSHRDHZ type=write size=312449 2024-09-19T13:47:38.425 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.420+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~J4LP8O0C8XI9.0 size=1048576 2024-09-19T13:47:38.427 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.424+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~J4LP8O0C8XI9.1 size=1048576 2024-09-19T13:47:38.430 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.428+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~J4LP8O0C8XI9.2 size=142927 2024-09-19T13:47:38.437 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.432+0000 7fcf3240c8c0 1 < completed multipart upload key=XE42LV5M5X82 upload=J4LP8O0C8XI9 tag=5Y3V1W0NZYQW type=write size=3288655 2024-09-19T13:47:38.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.436+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=ETKZWQ0CFPM4 type=del size=2607545 2024-09-19T13:47:38.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.444+0000 7fcf3240c8c0 1 < suggested remove operation key=X16ENUFL40RN tag=ZO9QHQ365K2C type=del 2024-09-19T13:47:38.455 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.452+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~KF9CN9UABSOI.0 size=1048576 2024-09-19T13:47:38.457 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.452+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~KF9CN9UABSOI.1 size=1048576 2024-09-19T13:47:38.459 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.456+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~KF9CN9UABSOI.2 size=582198 2024-09-19T13:47:38.459 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.456+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=KF9CN9UABSOI tag=69EJT3M8IT5G type=write size=3727926 2024-09-19T13:47:38.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.456+0000 7fcf3240c8c0 1 < completed write operation key=OA9BMSXGYR9T tag=G8K468T098KD type=write size=976813 2024-09-19T13:47:38.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.460+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=AQMC2PCYU5TM type=del size=2643968 2024-09-19T13:47:38.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.464+0000 7fcf3240c8c0 -1 < failed to complete operation key=C8T6DB9V9FBT tag=BMJQOWMELPTI type=del size=633949: (22) Invalid argument 2024-09-19T13:47:38.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.472+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~9HGR9Y2RX1OG.0 size=1048576 2024-09-19T13:47:38.478 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.472+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~9HGR9Y2RX1OG.1 size=145253 2024-09-19T13:47:38.478 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.472+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=9HGR9Y2RX1OG tag=6NYRTZ7W6EGF type=write size=2242405 2024-09-19T13:47:38.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.476+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~QMYZ3AO3VMI5.0 size=1048576 2024-09-19T13:47:38.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.480+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~QMYZ3AO3VMI5.1 size=283940 2024-09-19T13:47:38.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.484+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=QMYZ3AO3VMI5 tag=4W7ESM975DM7 type=write size=2381092 2024-09-19T13:47:38.496 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.492+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~UFXTLZT8L32S.0 size=223973 2024-09-19T13:47:38.496 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.492+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=UFXTLZT8L32S tag=49UD3S4JQ07C type=write size=1272549 2024-09-19T13:47:38.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.496+0000 7fcf3240c8c0 1 < suggested remove operation key=A02RDP6BA9AC tag=A23W48TVNJ9T type=del 2024-09-19T13:47:38.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.500+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=K3PKOORORP7D type=del size=1648155 2024-09-19T13:47:38.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.504+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~JI9KGZOAW57Y.0 size=1048576 2024-09-19T13:47:38.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.508+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~JI9KGZOAW57Y.1 size=253234 2024-09-19T13:47:38.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.516+0000 7fcf3240c8c0 1 < completed multipart upload key=STMT6XU2EJQM upload=JI9KGZOAW57Y tag=93E8E8HY6MNL type=write size=2350386 2024-09-19T13:47:38.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.520+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=IMQNCNOVW2EO type=del size=1288508 2024-09-19T13:47:38.528 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.524+0000 7fcf3240c8c0 1 < canceled operation key=XE42LV5M5X82 tag=8JA3I8TYA0QW type=del size=16248 2024-09-19T13:47:38.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.528+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=SV9MSXGPMWLA type=del size=722549 2024-09-19T13:47:38.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.532+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~MK4LDD8ZK143.0 size=1048576 2024-09-19T13:47:38.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.532+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~MK4LDD8ZK143.1 size=1048576 2024-09-19T13:47:38.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.536+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~MK4LDD8ZK143.2 size=608364 2024-09-19T13:47:38.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.540+0000 7fcf3240c8c0 1 < completed multipart upload key=3TME221SA53E upload=MK4LDD8ZK143 tag=OBCUO6FL4AIC type=write size=3754092 2024-09-19T13:47:38.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.548+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~RYPQE1S25SG9.0 size=1048576 2024-09-19T13:47:38.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.548+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~RYPQE1S25SG9.1 size=1048576 2024-09-19T13:47:38.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.552+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~RYPQE1S25SG9.2 size=8566 2024-09-19T13:47:38.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.552+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=RYPQE1S25SG9 tag=9VP28C1HF7Q8 type=write size=3154294 2024-09-19T13:47:38.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.556+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=U53L8B8H8HUD type=del 2024-09-19T13:47:38.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.560+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~3N3BCOH7BKTF.0 size=1048576 2024-09-19T13:47:38.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.564+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~3N3BCOH7BKTF.1 size=649269 2024-09-19T13:47:38.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.564+0000 7fcf3240c8c0 1 > prepared multipart upload key=C3TFYNXH549T upload=3N3BCOH7BKTF tag=C030X5X21IDC type=write size=2746421 2024-09-19T13:47:38.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.568+0000 7fcf3240c8c0 1 < completed delete operation key=N51Q6HKJSCCB tag=9GNBP8Q674E8 type=del 2024-09-19T13:47:38.575 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.572+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=EY4I8V375DUO type=del size=3812736 2024-09-19T13:47:38.578 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.572+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~1SMJM43CV8UO.0 size=401215 2024-09-19T13:47:38.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.580+0000 7fcf3240c8c0 1 < completed multipart upload key=N51Q6HKJSCCB upload=1SMJM43CV8UO tag=9JCFANKTUE7P type=write size=1449791 2024-09-19T13:47:38.587 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.584+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=HEKM8XWKRG3Y type=del size=2627984 2024-09-19T13:47:38.590 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.588+0000 7fcf3240c8c0 1 < canceled operation key=AES54TJK7VH7 tag=MQ6F97JU81OS type=del size=755727 2024-09-19T13:47:38.593 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.588+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=HT21STYBWNAN type=write size=542628 2024-09-19T13:47:38.599 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.596+0000 7fcf3240c8c0 1 < suggested update operation key=D1RMXGXS3O7Z tag=2ZWUUPI5Y9VA type=del size=3002631 2024-09-19T13:47:38.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.600+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~19OGWDVTUZ2N.0 size=1048576 2024-09-19T13:47:38.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.604+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~19OGWDVTUZ2N.1 size=1048576 2024-09-19T13:47:38.610 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.604+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~19OGWDVTUZ2N.2 size=310609 2024-09-19T13:47:38.610 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.604+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=19OGWDVTUZ2N tag=LLPJEFMMJFLT type=write size=3456337 2024-09-19T13:47:38.613 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.608+0000 7fcf3240c8c0 1 < completed delete operation key=C3TFYNXH549T tag=VFWKI6WKZC8O type=del 2024-09-19T13:47:38.616 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.612+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=OX4YTM78I0S4 type=write size=435830 2024-09-19T13:47:38.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.616+0000 7fcf3240c8c0 1 < canceled operation key=N51Q6HKJSCCB tag=BTA7ACSHRDHZ type=write size=312449 2024-09-19T13:47:38.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.620+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~Z0BJ1EJALSER.0 size=331721 2024-09-19T13:47:38.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.620+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=Z0BJ1EJALSER tag=OIAQXY5ROB9J type=write size=1380297 2024-09-19T13:47:38.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.628+0000 7fcf3240c8c0 1 < suggested update operation key=M2CO4A2DHJ05 tag=ETKZWQ0CFPM4 type=del size=2607545 2024-09-19T13:47:38.634 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.628+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=U4CC5YX11IRF type=del size=1919722 2024-09-19T13:47:38.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.632+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~KF9CN9UABSOI.0 size=1048576 2024-09-19T13:47:38.639 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.636+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~KF9CN9UABSOI.1 size=1048576 2024-09-19T13:47:38.641 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.636+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~KF9CN9UABSOI.2 size=582198 2024-09-19T13:47:38.647 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.644+0000 7fcf3240c8c0 1 < completed multipart upload key=ZCKKQ1R8318S upload=KF9CN9UABSOI tag=69EJT3M8IT5G type=write size=3727926 2024-09-19T13:47:38.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.648+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~DXGTTTX1V83I.0 size=1048576 2024-09-19T13:47:38.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.652+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~DXGTTTX1V83I.1 size=1048576 2024-09-19T13:47:38.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.652+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~DXGTTTX1V83I.2 size=22031 2024-09-19T13:47:38.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.652+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=DXGTTTX1V83I tag=WOM3OY0U9VNX type=write size=3167759 2024-09-19T13:47:38.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.656+0000 7fcf3240c8c0 1 < completed delete operation key=XE42LV5M5X82 tag=AQMC2PCYU5TM type=del 2024-09-19T13:47:38.667 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.664+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~29K4A383Q1KS.0 size=1048576 2024-09-19T13:47:38.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.668+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~29K4A383Q1KS.1 size=874088 2024-09-19T13:47:38.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.668+0000 7fcf3240c8c0 1 > prepared multipart upload key=A02RDP6BA9AC upload=29K4A383Q1KS tag=7OXI793OY61X type=write size=2971240 2024-09-19T13:47:38.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.668+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~9HGR9Y2RX1OG.0 size=1048576 2024-09-19T13:47:38.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.672+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~9HGR9Y2RX1OG.1 size=145253 2024-09-19T13:47:38.683 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.680+0000 7fcf3240c8c0 1 < completed multipart upload key=NP2L28YRVQ8L upload=9HGR9Y2RX1OG tag=6NYRTZ7W6EGF type=write size=2242405 2024-09-19T13:47:38.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.684+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=8J7370GWMEIJ type=del size=1037715 2024-09-19T13:47:38.691 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.688+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~UFXTLZT8L32S.0 size=223973 2024-09-19T13:47:38.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.692+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=UFXTLZT8L32S tag=49UD3S4JQ07C type=write size=1272549 2024-09-19T13:47:38.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.696+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=MV7F36WOQ311 type=write size=361880 2024-09-19T13:47:38.709 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.704+0000 7fcf3240c8c0 1 < suggested remove operation key=N51Q6HKJSCCB tag=K3PKOORORP7D type=del 2024-09-19T13:47:38.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.712+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~M1XMCCUTVGQ9.0 size=1048576 2024-09-19T13:47:38.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.716+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~M1XMCCUTVGQ9.1 size=896212 2024-09-19T13:47:38.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.716+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=M1XMCCUTVGQ9 tag=UJM2C2C1TMOS type=write size=2993364 2024-09-19T13:47:38.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.724+0000 7fcf3240c8c0 1 < suggested remove operation key=QSM2Q8CW1Q86 tag=IMQNCNOVW2EO type=del 2024-09-19T13:47:38.731 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.728+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=U6X9VK9XYK5P type=del size=1235066 2024-09-19T13:47:38.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.732+0000 7fcf3240c8c0 1 < completed delete operation key=C35EUAOWLBR3 tag=SV9MSXGPMWLA type=del 2024-09-19T13:47:38.738 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.736+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=KN2NH5T7XEYE type=del size=2868727 2024-09-19T13:47:38.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.736+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~RYPQE1S25SG9.0 size=1048576 2024-09-19T13:47:38.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.740+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~RYPQE1S25SG9.1 size=1048576 2024-09-19T13:47:38.747 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.744+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~RYPQE1S25SG9.2 size=8566 2024-09-19T13:47:38.752 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.748+0000 7fcf3240c8c0 1 < completed multipart upload key=D20C6C2ZFX1W upload=RYPQE1S25SG9 tag=9VP28C1HF7Q8 type=write size=3154294 2024-09-19T13:47:38.755 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.752+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=Q8ZQNGILVZ81 type=write size=986092 2024-09-19T13:47:38.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.756+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~3N3BCOH7BKTF.0 size=1048576 2024-09-19T13:47:38.762 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.756+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~3N3BCOH7BKTF.1 size=649269 2024-09-19T13:47:38.768 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.764+0000 7fcf3240c8c0 1 < completed multipart upload key=C3TFYNXH549T upload=3N3BCOH7BKTF tag=C030X5X21IDC type=write size=2746421 2024-09-19T13:47:38.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.768+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=ZBDNO6U048NY type=del size=3429559 2024-09-19T13:47:38.776 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.772+0000 7fcf3240c8c0 1 < completed delete operation key=DHPONKOVS8CT tag=EY4I8V375DUO type=del 2024-09-19T13:47:38.779 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.776+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=QPL3EDBT98J4 type=write size=600310 2024-09-19T13:47:38.782 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.780+0000 7fcf3240c8c0 1 < completed delete operation key=1BMF3S2BZLLI tag=HEKM8XWKRG3Y type=del 2024-09-19T13:47:38.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.780+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=E62PNGRM74B4 type=write size=900147 2024-09-19T13:47:38.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.784+0000 7fcf3240c8c0 1 < completed write operation key=D20C6C2ZFX1W tag=HT21STYBWNAN type=write size=542628 2024-09-19T13:47:38.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.788+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~0C5BRN1ZNGD2.0 size=1048576 2024-09-19T13:47:38.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.792+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~0C5BRN1ZNGD2.1 size=313456 2024-09-19T13:47:38.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.792+0000 7fcf3240c8c0 1 > prepared multipart upload key=D1RMXGXS3O7Z upload=0C5BRN1ZNGD2 tag=5OBAL4PP0NEL type=write size=2410608 2024-09-19T13:47:38.799 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.796+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~19OGWDVTUZ2N.0 size=1048576 2024-09-19T13:47:38.801 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.796+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~19OGWDVTUZ2N.1 size=1048576 2024-09-19T13:47:38.804 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.800+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~19OGWDVTUZ2N.2 size=310609 2024-09-19T13:47:38.809 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.804+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=19OGWDVTUZ2N tag=LLPJEFMMJFLT type=write size=3456337 2024-09-19T13:47:38.814 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.812+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~KZUQELKKAN1T.0 size=882760 2024-09-19T13:47:38.814 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.812+0000 7fcf3240c8c0 1 > prepared multipart upload key=C3TFYNXH549T upload=KZUQELKKAN1T tag=L3S1R28ATQN2 type=write size=1931336 2024-09-19T13:47:38.817 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.812+0000 7fcf3240c8c0 1 < completed write operation key=QAYJ5B1KZ08J tag=OX4YTM78I0S4 type=write size=435830 2024-09-19T13:47:38.828 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.824+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~1IXS9EGODRER.0 size=272266 2024-09-19T13:47:38.828 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.824+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=1IXS9EGODRER tag=001AKXYGX6W0 type=write size=1320842 2024-09-19T13:47:38.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.828+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~Z0BJ1EJALSER.0 size=331721 2024-09-19T13:47:38.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.832+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=Z0BJ1EJALSER tag=OIAQXY5ROB9J type=write size=1380297 2024-09-19T13:47:38.839 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.836+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=DNTPAZ18BRN9 type=del size=2494408 2024-09-19T13:47:38.842 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.836+0000 7fcf3240c8c0 1 < completed delete operation key=V8X0VBBNK83J tag=U4CC5YX11IRF type=del 2024-09-19T13:47:38.845 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.840+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=3I63BUYVZKH8 type=del size=3498685 2024-09-19T13:47:38.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.844+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~DXGTTTX1V83I.0 size=1048576 2024-09-19T13:47:38.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.844+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~DXGTTTX1V83I.1 size=1048576 2024-09-19T13:47:38.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.848+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~DXGTTTX1V83I.2 size=22031 2024-09-19T13:47:38.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.852+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=DXGTTTX1V83I tag=WOM3OY0U9VNX type=write size=3167759 2024-09-19T13:47:38.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.856+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=YDR56W0M28XJ type=write size=60317 2024-09-19T13:47:38.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.860+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~29K4A383Q1KS.0 size=1048576 2024-09-19T13:47:38.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.860+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~29K4A383Q1KS.1 size=874088 2024-09-19T13:47:38.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.864+0000 7fcf3240c8c0 1 < completed multipart upload key=A02RDP6BA9AC upload=29K4A383Q1KS tag=7OXI793OY61X type=write size=2971240 2024-09-19T13:47:38.873 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.868+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~H5NVK0R80V16.0 size=1048576 2024-09-19T13:47:38.876 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.872+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~H5NVK0R80V16.1 size=1048576 2024-09-19T13:47:38.878 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.872+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~H5NVK0R80V16.2 size=670158 2024-09-19T13:47:38.878 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.872+0000 7fcf3240c8c0 1 > prepared multipart upload key=A02RDP6BA9AC upload=H5NVK0R80V16 tag=PKBDM5BLM95W type=write size=3815886 2024-09-19T13:47:38.881 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.876+0000 7fcf3240c8c0 1 < completed delete operation key=X16ENUFL40RN tag=8J7370GWMEIJ type=del 2024-09-19T13:47:38.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.880+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=XDNQNFQE495T type=del size=179079 2024-09-19T13:47:38.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.884+0000 7fcf3240c8c0 1 < suggested update operation key=STMT6XU2EJQM tag=MV7F36WOQ311 type=write size=361880 2024-09-19T13:47:38.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.888+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=HW00Y6ZUVZ1O type=del size=3248227 2024-09-19T13:47:38.894 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.892+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~M1XMCCUTVGQ9.0 size=1048576 2024-09-19T13:47:38.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.892+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~M1XMCCUTVGQ9.1 size=896212 2024-09-19T13:47:38.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.896+0000 7fcf3240c8c0 1 < completed multipart upload key=QMSDNKYFFK1F upload=M1XMCCUTVGQ9 tag=UJM2C2C1TMOS type=write size=2993364 2024-09-19T13:47:38.906 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.900+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~SBT6T2V4UH5U.0 size=1048576 2024-09-19T13:47:38.909 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.904+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~SBT6T2V4UH5U.1 size=1048576 2024-09-19T13:47:38.911 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.908+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~SBT6T2V4UH5U.2 size=291758 2024-09-19T13:47:38.911 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.908+0000 7fcf3240c8c0 1 > prepared multipart upload key=A02RDP6BA9AC upload=SBT6T2V4UH5U tag=T1WXJ4NL121F type=write size=3437486 2024-09-19T13:47:38.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.912+0000 7fcf3240c8c0 1 < completed delete operation key=1BMF3S2BZLLI tag=U6X9VK9XYK5P type=del 2024-09-19T13:47:38.918 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.912+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=MR26I9UAW4BK type=del size=438644 2024-09-19T13:47:38.925 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.920+0000 7fcf3240c8c0 1 < suggested remove operation key=QAYJ5B1KZ08J tag=KN2NH5T7XEYE type=del 2024-09-19T13:47:38.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.928+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0U9BUX9DHTAK.2~EVD0S1O2IOJF.0 size=687182 2024-09-19T13:47:38.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.928+0000 7fcf3240c8c0 1 > prepared multipart upload key=0U9BUX9DHTAK upload=EVD0S1O2IOJF tag=BFID1V9QU98G type=write size=1735758 2024-09-19T13:47:38.934 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.932+0000 7fcf3240c8c0 1 < completed write operation key=N51Q6HKJSCCB tag=Q8ZQNGILVZ81 type=write size=986092 2024-09-19T13:47:38.937 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.932+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=F48KU07UQLBD type=del size=3350240 2024-09-19T13:47:38.941 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.936+0000 7fcf3240c8c0 1 < completed delete operation key=D1RMXGXS3O7Z tag=ZBDNO6U048NY type=del 2024-09-19T13:47:38.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.940+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=N4FV6904HPBC type=write size=271568 2024-09-19T13:47:38.948 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.944+0000 7fcf3240c8c0 1 < canceled operation key=C8T6DB9V9FBT tag=QPL3EDBT98J4 type=write size=600310 2024-09-19T13:47:38.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.948+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~QDPP86ORUVPJ.0 size=774777 2024-09-19T13:47:38.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.948+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=QDPP86ORUVPJ tag=ROJ4Z390I6PT type=write size=1823353 2024-09-19T13:47:38.957 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.952+0000 7fcf3240c8c0 1 < canceled operation key=0U9BUX9DHTAK tag=E62PNGRM74B4 type=write size=900147 2024-09-19T13:47:38.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.956+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=AMAYUMWKY8E6 type=del size=1921669 2024-09-19T13:47:38.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.960+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~0C5BRN1ZNGD2.0 size=1048576 2024-09-19T13:47:38.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.960+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~0C5BRN1ZNGD2.1 size=313456 2024-09-19T13:47:38.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.964+0000 7fcf3240c8c0 1 < completed multipart upload key=D1RMXGXS3O7Z upload=0C5BRN1ZNGD2 tag=5OBAL4PP0NEL type=write size=2410608 2024-09-19T13:47:38.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.968+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=H5XTCM9ZI6KE type=del size=2931098 2024-09-19T13:47:38.977 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.972+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~KZUQELKKAN1T.0 size=882760 2024-09-19T13:47:38.981 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.976+0000 7fcf3240c8c0 1 < completed multipart upload key=C3TFYNXH549T upload=KZUQELKKAN1T tag=L3S1R28ATQN2 type=write size=1931336 2024-09-19T13:47:38.984 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.980+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=D1WX0X5U79RT type=del size=2488557 2024-09-19T13:47:38.987 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.984+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~1IXS9EGODRER.0 size=272266 2024-09-19T13:47:38.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.988+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=1IXS9EGODRER tag=001AKXYGX6W0 type=write size=1320842 2024-09-19T13:47:38.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.992+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~YLVTR5Z6XYEV.0 size=1048576 2024-09-19T13:47:38.999 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.996+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~YLVTR5Z6XYEV.1 size=327108 2024-09-19T13:47:38.999 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:38.996+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=YLVTR5Z6XYEV tag=SSEDRHH36JA2 type=write size=2424260 2024-09-19T13:47:39.004 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.000+0000 7fcf3240c8c0 1 < suggested remove operation key=A02RDP6BA9AC tag=DNTPAZ18BRN9 type=del 2024-09-19T13:47:39.007 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.004+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=YDJMMMB03H99 type=write size=414169 2024-09-19T13:47:39.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.004+0000 7fcf3240c8c0 1 < completed delete operation key=6DFF2OCPT9W2 tag=3I63BUYVZKH8 type=del 2024-09-19T13:47:39.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.012+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~A222RHQ4E950.0 size=925342 2024-09-19T13:47:39.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.012+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=A222RHQ4E950 tag=F1D2XF0WVDXR type=write size=1973918 2024-09-19T13:47:39.020 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.016+0000 7fcf3240c8c0 1 < suggested remove operation key=ES62XJO5Q3FO tag=YDR56W0M28XJ type=write 2024-09-19T13:47:39.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.020+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=WTRUHU8IBTDN type=del size=2441269 2024-09-19T13:47:39.028 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.024+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~H5NVK0R80V16.0 size=1048576 2024-09-19T13:47:39.029 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.024+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~H5NVK0R80V16.1 size=1048576 2024-09-19T13:47:39.031 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.028+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~H5NVK0R80V16.2 size=670158 2024-09-19T13:47:39.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.032+0000 7fcf3240c8c0 1 < completed multipart upload key=A02RDP6BA9AC upload=H5NVK0R80V16 tag=PKBDM5BLM95W type=write size=3815886 2024-09-19T13:47:39.041 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.036+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~FDK25AFWSF2S.0 size=1048576 2024-09-19T13:47:39.043 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.040+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~FDK25AFWSF2S.1 size=1048576 2024-09-19T13:47:39.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.040+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~FDK25AFWSF2S.2 size=490627 2024-09-19T13:47:39.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.040+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=FDK25AFWSF2S tag=807226EKLB5R type=write size=3636355 2024-09-19T13:47:39.049 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.044+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=XDNQNFQE495T type=del 2024-09-19T13:47:39.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.048+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~LIN2R1R8XP6W.0 size=340961 2024-09-19T13:47:39.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.048+0000 7fcf3240c8c0 1 > prepared multipart upload key=DHPONKOVS8CT upload=LIN2R1R8XP6W tag=VCTAMN16J835 type=write size=1389537 2024-09-19T13:47:39.059 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.056+0000 7fcf3240c8c0 1 < suggested update operation key=9ICCISYXT0IV tag=HW00Y6ZUVZ1O type=del size=3248227 2024-09-19T13:47:39.062 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.060+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=PF8AYA46R5OE type=del size=4120641 2024-09-19T13:47:39.065 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.060+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~SBT6T2V4UH5U.0 size=1048576 2024-09-19T13:47:39.068 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.064+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~SBT6T2V4UH5U.1 size=1048576 2024-09-19T13:47:39.070 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.068+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~SBT6T2V4UH5U.2 size=291758 2024-09-19T13:47:39.076 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.072+0000 7fcf3240c8c0 1 < completed multipart upload key=A02RDP6BA9AC upload=SBT6T2V4UH5U tag=T1WXJ4NL121F type=write size=3437486 2024-09-19T13:47:39.079 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.076+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=8V0922BQ0EXZ type=del size=808092 2024-09-19T13:47:39.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.080+0000 7fcf3240c8c0 1 < completed delete operation key=D20C6C2ZFX1W tag=MR26I9UAW4BK type=del 2024-09-19T13:47:39.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.080+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=NGUB1OBPNBEO type=del size=92148 2024-09-19T13:47:39.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.084+0000 7fcf3240c8c0 1 < completed part key=_multipart_0U9BUX9DHTAK.2~EVD0S1O2IOJF.0 size=687182 2024-09-19T13:47:39.094 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.088+0000 7fcf3240c8c0 1 < completed multipart upload key=0U9BUX9DHTAK upload=EVD0S1O2IOJF tag=BFID1V9QU98G type=write size=1735758 2024-09-19T13:47:39.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.092+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=DDFW0BP0392O type=del size=3457427 2024-09-19T13:47:39.107 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.104+0000 7fcf3240c8c0 1 < suggested update operation key=BXUPV5XSJBTH tag=F48KU07UQLBD type=del size=3350240 2024-09-19T13:47:39.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.108+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=HK0MDDN8J0ZL type=del size=1114524 2024-09-19T13:47:39.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.112+0000 7fcf3240c8c0 1 < suggested remove operation key=QMSDNKYFFK1F tag=N4FV6904HPBC type=write 2024-09-19T13:47:39.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.116+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=MFNXQGZXTPIQ type=del size=1847035 2024-09-19T13:47:39.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.120+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~QDPP86ORUVPJ.0 size=774777 2024-09-19T13:47:39.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.124+0000 7fcf3240c8c0 1 < completed multipart upload key=NP2L28YRVQ8L upload=QDPP86ORUVPJ tag=ROJ4Z390I6PT type=write size=1823353 2024-09-19T13:47:39.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.132+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~PMI876L7YRT1.0 size=1048576 2024-09-19T13:47:39.137 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.132+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~PMI876L7YRT1.1 size=869864 2024-09-19T13:47:39.137 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.132+0000 7fcf3240c8c0 1 > prepared multipart upload key=D1RMXGXS3O7Z upload=PMI876L7YRT1 tag=J4PJ9K289IXE type=write size=2967016 2024-09-19T13:47:39.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.136+0000 7fcf3240c8c0 1 < completed delete operation key=QSM2Q8CW1Q86 tag=AMAYUMWKY8E6 type=del 2024-09-19T13:47:39.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.140+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~R0ITFRNKIFJ7.0 size=93441 2024-09-19T13:47:39.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.140+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=R0ITFRNKIFJ7 tag=R3CWEWWUBDKN type=write size=1142017 2024-09-19T13:47:39.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.148+0000 7fcf3240c8c0 1 < suggested remove operation key=HXMZKP7H3HJE tag=H5XTCM9ZI6KE type=del 2024-09-19T13:47:39.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.152+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~VYGEB0KU2W8R.0 size=1048576 2024-09-19T13:47:39.160 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.156+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~VYGEB0KU2W8R.1 size=1048576 2024-09-19T13:47:39.163 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.160+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~VYGEB0KU2W8R.2 size=514896 2024-09-19T13:47:39.163 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.160+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=VYGEB0KU2W8R tag=64S58EGSUAER type=write size=3660624 2024-09-19T13:47:39.166 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.164+0000 7fcf3240c8c0 1 < completed delete operation key=D1RMXGXS3O7Z tag=D1WX0X5U79RT type=del 2024-09-19T13:47:39.173 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.168+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~CKIHJBQSZKPG.0 size=1048576 2024-09-19T13:47:39.175 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.172+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~CKIHJBQSZKPG.1 size=971552 2024-09-19T13:47:39.175 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.172+0000 7fcf3240c8c0 1 > prepared multipart upload key=V8X0VBBNK83J upload=CKIHJBQSZKPG tag=SAH0MLVWL89Z type=write size=3068704 2024-09-19T13:47:39.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.176+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~YLVTR5Z6XYEV.0 size=1048576 2024-09-19T13:47:39.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.176+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~YLVTR5Z6XYEV.1 size=327108 2024-09-19T13:47:39.186 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.180+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=YLVTR5Z6XYEV tag=SSEDRHH36JA2 type=write size=2424260 2024-09-19T13:47:39.192 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.188+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~UV7VF1I0F0V8.0 size=1048576 2024-09-19T13:47:39.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.192+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~UV7VF1I0F0V8.1 size=19400 2024-09-19T13:47:39.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.192+0000 7fcf3240c8c0 1 > prepared multipart upload key=A02RDP6BA9AC upload=UV7VF1I0F0V8 tag=B1OJIA5FVE7O type=write size=2116552 2024-09-19T13:47:39.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.192+0000 7fcf3240c8c0 1 < completed write operation key=STMT6XU2EJQM tag=YDJMMMB03H99 type=write size=414169 2024-09-19T13:47:39.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.200+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~BCH048FBWUXE.0 size=1048576 2024-09-19T13:47:39.206 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.200+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~BCH048FBWUXE.1 size=898087 2024-09-19T13:47:39.206 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.200+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=BCH048FBWUXE tag=XZEQH18LLR8U type=write size=2995239 2024-09-19T13:47:39.209 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.204+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~A222RHQ4E950.0 size=925342 2024-09-19T13:47:39.214 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.208+0000 7fcf3240c8c0 1 < completed multipart upload key=AES54TJK7VH7 upload=A222RHQ4E950 tag=F1D2XF0WVDXR type=write size=1973918 2024-09-19T13:47:39.220 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.216+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~YN5S3KN3EECM.0 size=791002 2024-09-19T13:47:39.220 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.216+0000 7fcf3240c8c0 1 > prepared multipart upload key=C8T6DB9V9FBT upload=YN5S3KN3EECM tag=2JNRAURCMU5W type=write size=1839578 2024-09-19T13:47:39.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.220+0000 7fcf3240c8c0 1 < completed delete operation key=QSM2Q8CW1Q86 tag=WTRUHU8IBTDN type=del 2024-09-19T13:47:39.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.224+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=QW8OYP8T83RX type=del size=928700 2024-09-19T13:47:39.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.224+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~FDK25AFWSF2S.0 size=1048576 2024-09-19T13:47:39.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.228+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~FDK25AFWSF2S.1 size=1048576 2024-09-19T13:47:39.235 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.232+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~FDK25AFWSF2S.2 size=490627 2024-09-19T13:47:39.240 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.236+0000 7fcf3240c8c0 1 < completed multipart upload key=AES54TJK7VH7 upload=FDK25AFWSF2S tag=807226EKLB5R type=write size=3636355 2024-09-19T13:47:39.244 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.240+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=XX07C6AAMIXL type=del size=3247925 2024-09-19T13:47:39.247 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.244+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~LIN2R1R8XP6W.0 size=340961 2024-09-19T13:47:39.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.248+0000 7fcf3240c8c0 1 < completed multipart upload key=DHPONKOVS8CT upload=LIN2R1R8XP6W tag=VCTAMN16J835 type=write size=1389537 2024-09-19T13:47:39.257 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.252+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=AQ62VL8V0WQC type=write size=249925 2024-09-19T13:47:39.260 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.256+0000 7fcf3240c8c0 1 < completed delete operation key=D20C6C2ZFX1W tag=PF8AYA46R5OE type=del 2024-09-19T13:47:39.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.260+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=BRO6XBVGYAEB type=del size=1891373 2024-09-19T13:47:39.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.268+0000 7fcf3240c8c0 1 < suggested update operation key=BXUPV5XSJBTH tag=8V0922BQ0EXZ type=del size=808092 2024-09-19T13:47:39.277 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.272+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~COZJC76UBB54.0 size=1048576 2024-09-19T13:47:39.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.276+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~COZJC76UBB54.1 size=1048576 2024-09-19T13:47:39.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.280+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~COZJC76UBB54.2 size=300736 2024-09-19T13:47:39.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.280+0000 7fcf3240c8c0 1 > prepared multipart upload key=OA9BMSXGYR9T upload=COZJC76UBB54 tag=BE02SW7LU9K9 type=write size=3446464 2024-09-19T13:47:39.287 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.284+0000 7fcf3240c8c0 1 < completed delete operation key=X9FGPMP30X47 tag=NGUB1OBPNBEO type=del 2024-09-19T13:47:39.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.288+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~9VVEATQVCQ39.0 size=1048576 2024-09-19T13:47:39.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.292+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~9VVEATQVCQ39.1 size=51799 2024-09-19T13:47:39.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.292+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=9VVEATQVCQ39 tag=USZM9D7ZKNB3 type=write size=2148951 2024-09-19T13:47:39.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.300+0000 7fcf3240c8c0 1 < suggested remove operation key=X16ENUFL40RN tag=DDFW0BP0392O type=del 2024-09-19T13:47:39.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.304+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=HZXVDCTPWNSL type=del size=454603 2024-09-19T13:47:39.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.308+0000 7fcf3240c8c0 1 < canceled operation key=6DFF2OCPT9W2 tag=HK0MDDN8J0ZL type=del size=1114524 2024-09-19T13:47:39.314 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.308+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=TSHSH21W9O03 type=write size=1001865 2024-09-19T13:47:39.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.312+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=MFNXQGZXTPIQ type=del 2024-09-19T13:47:39.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.320+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0U9BUX9DHTAK.2~M2FSH9T2ZJWG.0 size=103977 2024-09-19T13:47:39.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.320+0000 7fcf3240c8c0 1 > prepared multipart upload key=0U9BUX9DHTAK upload=M2FSH9T2ZJWG tag=SBSBEU53Q4WK type=write size=1152553 2024-09-19T13:47:39.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.324+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~PMI876L7YRT1.0 size=1048576 2024-09-19T13:47:39.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.324+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~PMI876L7YRT1.1 size=869864 2024-09-19T13:47:39.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.332+0000 7fcf3240c8c0 1 < completed multipart upload key=D1RMXGXS3O7Z upload=PMI876L7YRT1 tag=J4PJ9K289IXE type=write size=2967016 2024-09-19T13:47:39.342 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.336+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~9H9C3QLO7ABU.0 size=1048576 2024-09-19T13:47:39.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.340+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~9H9C3QLO7ABU.1 size=1048576 2024-09-19T13:47:39.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.344+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~9H9C3QLO7ABU.2 size=849346 2024-09-19T13:47:39.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.344+0000 7fcf3240c8c0 1 > prepared multipart upload key=V8X0VBBNK83J upload=9H9C3QLO7ABU tag=M2PTL91IY6FF type=write size=3995074 2024-09-19T13:47:39.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.348+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~R0ITFRNKIFJ7.0 size=93441 2024-09-19T13:47:39.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.352+0000 7fcf3240c8c0 1 < completed multipart upload key=XE42LV5M5X82 upload=R0ITFRNKIFJ7 tag=R3CWEWWUBDKN type=write size=1142017 2024-09-19T13:47:39.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.356+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=JB51UQPNE842 type=write size=209800 2024-09-19T13:47:39.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.356+0000 7fcf3240c8c0 1 < canceled part key=_multipart_D20C6C2ZFX1W.2~VYGEB0KU2W8R.0 size=1048576 2024-09-19T13:47:39.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.360+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~VYGEB0KU2W8R.1 size=1048576 2024-09-19T13:47:39.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.360+0000 7fcf3240c8c0 1 < canceled part key=_multipart_D20C6C2ZFX1W.2~VYGEB0KU2W8R.2 size=514896 2024-09-19T13:47:39.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.364+0000 7fcf3240c8c0 1 < canceled multipart upload key=D20C6C2ZFX1W upload=VYGEB0KU2W8R tag=64S58EGSUAER type=write size=3660624 2024-09-19T13:47:39.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.368+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~JRNMH7DAZIP5.0 size=489642 2024-09-19T13:47:39.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.368+0000 7fcf3240c8c0 1 > prepared multipart upload key=OA9BMSXGYR9T upload=JRNMH7DAZIP5 tag=22YDDQ2XU6XQ type=write size=1538218 2024-09-19T13:47:39.377 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.372+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~CKIHJBQSZKPG.0 size=1048576 2024-09-19T13:47:39.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.376+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~CKIHJBQSZKPG.1 size=971552 2024-09-19T13:47:39.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.384+0000 7fcf3240c8c0 1 < completed multipart upload key=V8X0VBBNK83J upload=CKIHJBQSZKPG tag=SAH0MLVWL89Z type=write size=3068704 2024-09-19T13:47:39.390 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.384+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=ELXUJFTBV97O type=write size=450087 2024-09-19T13:47:39.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.388+0000 7fcf3240c8c0 1 < canceled part key=_multipart_A02RDP6BA9AC.2~UV7VF1I0F0V8.0 size=1048576 2024-09-19T13:47:39.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.392+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~UV7VF1I0F0V8.1 size=19400 2024-09-19T13:47:39.401 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.396+0000 7fcf3240c8c0 1 < canceled multipart upload key=A02RDP6BA9AC upload=UV7VF1I0F0V8 tag=B1OJIA5FVE7O type=write size=2116552 2024-09-19T13:47:39.407 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.404+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~GA1TH5Q7AJZP.0 size=1048576 2024-09-19T13:47:39.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.408+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~GA1TH5Q7AJZP.1 size=1048576 2024-09-19T13:47:39.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.412+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~GA1TH5Q7AJZP.2 size=358927 2024-09-19T13:47:39.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.412+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=GA1TH5Q7AJZP tag=7EELT52A1ZZH type=write size=3504655 2024-09-19T13:47:39.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.412+0000 7fcf3240c8c0 1 < canceled part key=_multipart_AES54TJK7VH7.2~BCH048FBWUXE.0 size=1048576 2024-09-19T13:47:39.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.416+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~BCH048FBWUXE.1 size=898087 2024-09-19T13:47:39.425 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.420+0000 7fcf3240c8c0 1 < canceled multipart upload key=AES54TJK7VH7 upload=BCH048FBWUXE tag=XZEQH18LLR8U type=write size=2995239 2024-09-19T13:47:39.430 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.424+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~NI0SQ7S0F713.0 size=146410 2024-09-19T13:47:39.430 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.424+0000 7fcf3240c8c0 1 > prepared multipart upload key=V8X0VBBNK83J upload=NI0SQ7S0F713 tag=2N0P598B43LI type=write size=1194986 2024-09-19T13:47:39.431 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.428+0000 7fcf3240c8c0 1 < canceled part key=_multipart_C8T6DB9V9FBT.2~YN5S3KN3EECM.0 size=791002 2024-09-19T13:47:39.436 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.432+0000 7fcf3240c8c0 1 < canceled multipart upload key=C8T6DB9V9FBT upload=YN5S3KN3EECM tag=2JNRAURCMU5W type=write size=1839578 2024-09-19T13:47:39.438 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.432+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=IUNMJTQ79RGD type=del size=598811 2024-09-19T13:47:39.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.436+0000 7fcf3240c8c0 1 < completed delete operation key=7UC85R2HO9K2 tag=QW8OYP8T83RX type=del 2024-09-19T13:47:39.444 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.440+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=JU3BR2P17Z1M type=del size=40865 2024-09-19T13:47:39.447 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.444+0000 7fcf3240c8c0 1 < completed delete operation key=D20C6C2ZFX1W tag=XX07C6AAMIXL type=del 2024-09-19T13:47:39.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.444+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=9JVUG9YXCNKT type=del size=1900304 2024-09-19T13:47:39.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.448+0000 7fcf3240c8c0 1 < completed write operation key=NP2L28YRVQ8L tag=AQ62VL8V0WQC type=write size=249925 2024-09-19T13:47:39.455 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.452+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=PBTYGYGDSFLG type=write size=275164 2024-09-19T13:47:39.458 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.452+0000 7fcf3240c8c0 1 < completed delete operation key=NP2L28YRVQ8L tag=BRO6XBVGYAEB type=del 2024-09-19T13:47:39.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.460+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~1X8K8UMSU4YI.0 size=593003 2024-09-19T13:47:39.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.460+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=1X8K8UMSU4YI tag=6CK8CSN0GADR type=write size=1641579 2024-09-19T13:47:39.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.460+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~COZJC76UBB54.0 size=1048576 2024-09-19T13:47:39.468 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.464+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~COZJC76UBB54.1 size=1048576 2024-09-19T13:47:39.470 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.468+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~COZJC76UBB54.2 size=300736 2024-09-19T13:47:39.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.472+0000 7fcf3240c8c0 1 < completed multipart upload key=OA9BMSXGYR9T upload=COZJC76UBB54 tag=BE02SW7LU9K9 type=write size=3446464 2024-09-19T13:47:39.478 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.472+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=OHV41TH99XO1 type=del size=127122 2024-09-19T13:47:39.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.476+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~9VVEATQVCQ39.0 size=1048576 2024-09-19T13:47:39.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.480+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~9VVEATQVCQ39.1 size=51799 2024-09-19T13:47:39.488 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.484+0000 7fcf3240c8c0 1 < completed multipart upload key=D20C6C2ZFX1W upload=9VVEATQVCQ39 tag=USZM9D7ZKNB3 type=write size=2148951 2024-09-19T13:47:39.493 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.488+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~8JW1T7VBBF8M.0 size=748856 2024-09-19T13:47:39.493 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.488+0000 7fcf3240c8c0 1 > prepared multipart upload key=OA9BMSXGYR9T upload=8JW1T7VBBF8M tag=6HU34BVT86UR type=write size=1797432 2024-09-19T13:47:39.496 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.492+0000 7fcf3240c8c0 1 < completed delete operation key=M2CO4A2DHJ05 tag=HZXVDCTPWNSL type=del 2024-09-19T13:47:39.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.496+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=GD7KR1IXL5M1 type=write size=219266 2024-09-19T13:47:39.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.500+0000 7fcf3240c8c0 1 < completed write operation key=QAYJ5B1KZ08J tag=TSHSH21W9O03 type=write size=1001865 2024-09-19T13:47:39.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.500+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=XWBK9QITF6MU type=del size=2682615 2024-09-19T13:47:39.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.504+0000 7fcf3240c8c0 1 < completed part key=_multipart_0U9BUX9DHTAK.2~M2FSH9T2ZJWG.0 size=103977 2024-09-19T13:47:39.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.512+0000 7fcf3240c8c0 1 < completed multipart upload key=0U9BUX9DHTAK upload=M2FSH9T2ZJWG tag=SBSBEU53Q4WK type=write size=1152553 2024-09-19T13:47:39.518 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.512+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=4612EJU2K5HL type=del size=1779264 2024-09-19T13:47:39.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.516+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~9H9C3QLO7ABU.0 size=1048576 2024-09-19T13:47:39.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.520+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~9H9C3QLO7ABU.1 size=1048576 2024-09-19T13:47:39.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.520+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~9H9C3QLO7ABU.2 size=849346 2024-09-19T13:47:39.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.528+0000 7fcf3240c8c0 1 < completed multipart upload key=V8X0VBBNK83J upload=9H9C3QLO7ABU tag=M2PTL91IY6FF type=write size=3995074 2024-09-19T13:47:39.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.528+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=11QSGWZYD93P type=del size=4070171 2024-09-19T13:47:39.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.532+0000 7fcf3240c8c0 1 < completed write operation key=X9FGPMP30X47 tag=JB51UQPNE842 type=write size=209800 2024-09-19T13:47:39.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.540+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~6X285EZWDXKS.0 size=1048576 2024-09-19T13:47:39.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.540+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~6X285EZWDXKS.1 size=1048576 2024-09-19T13:47:39.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.544+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~6X285EZWDXKS.2 size=157386 2024-09-19T13:47:39.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.544+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=6X285EZWDXKS tag=8I5X33IHT85R type=write size=3303114 2024-09-19T13:47:39.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.544+0000 7fcf3240c8c0 1 < canceled part key=_multipart_OA9BMSXGYR9T.2~JRNMH7DAZIP5.0 size=489642 2024-09-19T13:47:39.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.548+0000 7fcf3240c8c0 1 < canceled multipart upload key=OA9BMSXGYR9T upload=JRNMH7DAZIP5 tag=22YDDQ2XU6XQ type=write size=1538218 2024-09-19T13:47:39.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.552+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=3E472UU80GQL type=del size=705772 2024-09-19T13:47:39.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.556+0000 7fcf3240c8c0 1 < completed write operation key=QSM2Q8CW1Q86 tag=ELXUJFTBV97O type=write size=450087 2024-09-19T13:47:39.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.560+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=IJ8JN8G2EQEC type=del size=2879415 2024-09-19T13:47:39.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.564+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~GA1TH5Q7AJZP.0 size=1048576 2024-09-19T13:47:39.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.564+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~GA1TH5Q7AJZP.1 size=1048576 2024-09-19T13:47:39.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.568+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~GA1TH5Q7AJZP.2 size=358927 2024-09-19T13:47:39.578 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.576+0000 7fcf3240c8c0 1 < completed multipart upload key=XE42LV5M5X82 upload=GA1TH5Q7AJZP tag=7EELT52A1ZZH type=write size=3504655 2024-09-19T13:47:39.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.576+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=J4VL4MDOEV93 type=del size=4181925 2024-09-19T13:47:39.585 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.580+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~NI0SQ7S0F713.0 size=146410 2024-09-19T13:47:39.591 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.588+0000 7fcf3240c8c0 1 < completed multipart upload key=V8X0VBBNK83J upload=NI0SQ7S0F713 tag=2N0P598B43LI type=write size=1194986 2024-09-19T13:47:39.594 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.592+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=RDUEXBUDZTBD type=del size=2127264 2024-09-19T13:47:39.598 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.592+0000 7fcf3240c8c0 1 < completed delete operation key=DHPONKOVS8CT tag=IUNMJTQ79RGD type=del 2024-09-19T13:47:39.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.600+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~6TN9TZ302R1F.0 size=502184 2024-09-19T13:47:39.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.600+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=6TN9TZ302R1F tag=0R4FNLH0QWAW type=write size=1550760 2024-09-19T13:47:39.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.604+0000 7fcf3240c8c0 1 < completed delete operation key=DHPONKOVS8CT tag=JU3BR2P17Z1M type=del 2024-09-19T13:47:39.613 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.608+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~IUVCNN0AR6K5.0 size=314390 2024-09-19T13:47:39.613 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.608+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=IUVCNN0AR6K5 tag=S16PV32EG28C type=write size=1362966 2024-09-19T13:47:39.617 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.612+0000 7fcf3240c8c0 1 < completed delete operation key=0UCFTOF1YBBM tag=9JVUG9YXCNKT type=del 2024-09-19T13:47:39.620 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.616+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=0R6FZJVHAI9X type=del size=1836393 2024-09-19T13:47:39.626 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.624+0000 7fcf3240c8c0 1 < suggested remove operation key=X9FGPMP30X47 tag=PBTYGYGDSFLG type=write 2024-09-19T13:47:39.630 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.624+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=143OP6NONWD2 type=del size=388021 2024-09-19T13:47:39.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.628+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~1X8K8UMSU4YI.0 size=593003 2024-09-19T13:47:39.640 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.636+0000 7fcf3240c8c0 1 < completed multipart upload key=M2CO4A2DHJ05 upload=1X8K8UMSU4YI tag=6CK8CSN0GADR type=write size=1641579 2024-09-19T13:47:39.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.636+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=T1UI8C8TW7PF type=write size=827286 2024-09-19T13:47:39.645 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.640+0000 7fcf3240c8c0 1 < completed delete operation key=1BMF3S2BZLLI tag=OHV41TH99XO1 type=del 2024-09-19T13:47:39.649 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.644+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=VM9V5UUD8TI9 type=del size=3240418 2024-09-19T13:47:39.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.648+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~8JW1T7VBBF8M.0 size=748856 2024-09-19T13:47:39.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.652+0000 7fcf3240c8c0 1 < completed multipart upload key=OA9BMSXGYR9T upload=8JW1T7VBBF8M tag=6HU34BVT86UR type=write size=1797432 2024-09-19T13:47:39.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.660+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~E050WE7YMQ6S.0 size=1048576 2024-09-19T13:47:39.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.660+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~E050WE7YMQ6S.1 size=1048576 2024-09-19T13:47:39.668 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.664+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~E050WE7YMQ6S.2 size=621013 2024-09-19T13:47:39.668 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.664+0000 7fcf3240c8c0 1 > prepared multipart upload key=D1RMXGXS3O7Z upload=E050WE7YMQ6S tag=1WYY4CKUA834 type=write size=3766741 2024-09-19T13:47:39.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.668+0000 7fcf3240c8c0 1 < suggested remove operation key=OA9BMSXGYR9T tag=GD7KR1IXL5M1 type=write 2024-09-19T13:47:39.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.676+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~XJXEDC8A2GKL.0 size=252370 2024-09-19T13:47:39.679 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.676+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=XJXEDC8A2GKL tag=FAC9MEPMO2YA type=write size=1300946 2024-09-19T13:47:39.681 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.676+0000 7fcf3240c8c0 -1 < failed to complete operation key=X9FGPMP30X47 tag=XWBK9QITF6MU type=del size=2682615: (22) Invalid argument 2024-09-19T13:47:39.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.680+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=3B0KE9AS6RML type=del size=84960 2024-09-19T13:47:39.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.684+0000 7fcf3240c8c0 1 < completed delete operation key=ZCKKQ1R8318S tag=4612EJU2K5HL type=del 2024-09-19T13:47:39.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.684+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=20VFX94BMIUD type=del size=2877606 2024-09-19T13:47:39.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.688+0000 7fcf3240c8c0 1 < completed delete operation key=D20C6C2ZFX1W tag=11QSGWZYD93P type=del 2024-09-19T13:47:39.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.692+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=L89W2Q0VC5NR type=del size=1730762 2024-09-19T13:47:39.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.692+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~6X285EZWDXKS.0 size=1048576 2024-09-19T13:47:39.703 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.700+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~6X285EZWDXKS.1 size=1048576 2024-09-19T13:47:39.706 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.700+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~6X285EZWDXKS.2 size=157386 2024-09-19T13:47:39.711 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.708+0000 7fcf3240c8c0 1 < completed multipart upload key=QSM2Q8CW1Q86 upload=6X285EZWDXKS tag=8I5X33IHT85R type=write size=3303114 2024-09-19T13:47:39.714 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.708+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=261I389V8XRW type=del size=983050 2024-09-19T13:47:39.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.712+0000 7fcf3240c8c0 1 < completed delete operation key=DHPONKOVS8CT tag=3E472UU80GQL type=del 2024-09-19T13:47:39.722 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.716+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~A87ZI02NK4PB.0 size=1048576 2024-09-19T13:47:39.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.720+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~A87ZI02NK4PB.1 size=597638 2024-09-19T13:47:39.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.720+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=A87ZI02NK4PB tag=0YJICRV1IHOV type=write size=2694790 2024-09-19T13:47:39.730 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.728+0000 7fcf3240c8c0 1 < suggested remove operation key=D1RMXGXS3O7Z tag=IJ8JN8G2EQEC type=del 2024-09-19T13:47:39.733 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.728+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=FDLIIPRFBS7H type=del size=3064240 2024-09-19T13:47:39.737 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.732+0000 7fcf3240c8c0 1 < completed delete operation key=QSM2Q8CW1Q86 tag=J4VL4MDOEV93 type=del 2024-09-19T13:47:39.740 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.736+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=255Y3XEG0RU1 type=del size=4188699 2024-09-19T13:47:39.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.740+0000 7fcf3240c8c0 1 < completed delete operation key=0U9BUX9DHTAK tag=RDUEXBUDZTBD type=del 2024-09-19T13:47:39.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.740+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=FA3S642AHNXN type=del size=3184258 2024-09-19T13:47:39.748 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.744+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~6TN9TZ302R1F.0 size=502184 2024-09-19T13:47:39.753 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.748+0000 7fcf3240c8c0 1 < completed multipart upload key=QAYJ5B1KZ08J upload=6TN9TZ302R1F tag=0R4FNLH0QWAW type=write size=1550760 2024-09-19T13:47:39.756 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.752+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=HRMCBZH53U39 type=write size=22725 2024-09-19T13:47:39.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.756+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~IUVCNN0AR6K5.0 size=314390 2024-09-19T13:47:39.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.760+0000 7fcf3240c8c0 1 < completed multipart upload key=XE42LV5M5X82 upload=IUVCNN0AR6K5 tag=S16PV32EG28C type=write size=1362966 2024-09-19T13:47:39.766 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.760+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=PVBPXX1FMCCC type=del size=1362841 2024-09-19T13:47:39.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.764+0000 7fcf3240c8c0 1 < completed delete operation key=ZCKKQ1R8318S tag=0R6FZJVHAI9X type=del 2024-09-19T13:47:39.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.768+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=3MR0WH7T63A8 type=del size=3360000 2024-09-19T13:47:39.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.772+0000 7fcf3240c8c0 1 < completed delete operation key=V8X0VBBNK83J tag=143OP6NONWD2 type=del 2024-09-19T13:47:39.778 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.772+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=W31J2VF72T0T type=del size=1876255 2024-09-19T13:47:39.781 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.776+0000 7fcf3240c8c0 1 < completed write operation key=C8T6DB9V9FBT tag=T1UI8C8TW7PF type=write size=827286 2024-09-19T13:47:39.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.784+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~T3TR6GSREYUT.0 size=1048576 2024-09-19T13:47:39.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.784+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~T3TR6GSREYUT.1 size=1048576 2024-09-19T13:47:39.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.788+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~T3TR6GSREYUT.2 size=771868 2024-09-19T13:47:39.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.788+0000 7fcf3240c8c0 1 > prepared multipart upload key=V8X0VBBNK83J upload=T3TR6GSREYUT tag=D0HYUTUNVKE9 type=write size=3917596 2024-09-19T13:47:39.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.792+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=VM9V5UUD8TI9 type=del 2024-09-19T13:47:39.801 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.796+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~6UQ7IC3Z0871.0 size=875552 2024-09-19T13:47:39.801 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.796+0000 7fcf3240c8c0 1 > prepared multipart upload key=71Z2VTW99W7J upload=6UQ7IC3Z0871 tag=DC2LZOEIXW4M type=write size=1924128 2024-09-19T13:47:39.804 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.800+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~E050WE7YMQ6S.0 size=1048576 2024-09-19T13:47:39.807 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.804+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~E050WE7YMQ6S.1 size=1048576 2024-09-19T13:47:39.809 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.804+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~E050WE7YMQ6S.2 size=621013 2024-09-19T13:47:39.814 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.812+0000 7fcf3240c8c0 1 < completed multipart upload key=D1RMXGXS3O7Z upload=E050WE7YMQ6S tag=1WYY4CKUA834 type=write size=3766741 2024-09-19T13:47:39.817 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.812+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=HTPFNMX3Q5P0 type=del size=1340770 2024-09-19T13:47:39.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.816+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~XJXEDC8A2GKL.0 size=252370 2024-09-19T13:47:39.825 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.820+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=XJXEDC8A2GKL tag=FAC9MEPMO2YA type=write size=1300946 2024-09-19T13:47:39.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.824+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=3H5C6T4M5P1H type=del size=1488179 2024-09-19T13:47:39.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.828+0000 7fcf3240c8c0 1 < completed delete operation key=71Z2VTW99W7J tag=3B0KE9AS6RML type=del 2024-09-19T13:47:39.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.832+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=0AMG44RY4I4F type=del size=3336900 2024-09-19T13:47:39.844 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.836+0000 7fcf3240c8c0 1 < suggested update operation key=DHPONKOVS8CT tag=20VFX94BMIUD type=del size=2877606 2024-09-19T13:47:39.844 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.840+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=7084K6O8A9S2 type=del size=1718896 2024-09-19T13:47:39.846 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.844+0000 7fcf3240c8c0 1 < completed delete operation key=0U9BUX9DHTAK tag=L89W2Q0VC5NR type=del 2024-09-19T13:47:39.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.844+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=L1JJV59QFPX4 type=del size=1438569 2024-09-19T13:47:39.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.852+0000 7fcf3240c8c0 1 < suggested remove operation key=OA9BMSXGYR9T tag=261I389V8XRW type=del 2024-09-19T13:47:39.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.856+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~C6CRWV101ZKX.0 size=1048576 2024-09-19T13:47:39.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.856+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~C6CRWV101ZKX.1 size=963700 2024-09-19T13:47:39.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.856+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=C6CRWV101ZKX tag=YZ4VY1ZDKUPZ type=write size=3060852 2024-09-19T13:47:39.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.860+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~A87ZI02NK4PB.0 size=1048576 2024-09-19T13:47:39.866 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.860+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~A87ZI02NK4PB.1 size=597638 2024-09-19T13:47:39.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.864+0000 7fcf3240c8c0 1 < completed multipart upload key=N51Q6HKJSCCB upload=A87ZI02NK4PB tag=0YJICRV1IHOV type=write size=2694790 2024-09-19T13:47:39.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.868+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=EMHK6E5Y79WJ type=del size=4054683 2024-09-19T13:47:39.875 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.872+0000 7fcf3240c8c0 1 < completed delete operation key=XE42LV5M5X82 tag=FDLIIPRFBS7H type=del 2024-09-19T13:47:39.877 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.872+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=MVXOQJ32LZGT type=del size=1333646 2024-09-19T13:47:39.880 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.876+0000 7fcf3240c8c0 1 < completed delete operation key=BXUPV5XSJBTH tag=255Y3XEG0RU1 type=del 2024-09-19T13:47:39.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.880+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~JOFPLABB37X2.0 size=1048576 2024-09-19T13:47:39.887 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.884+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~JOFPLABB37X2.1 size=656727 2024-09-19T13:47:39.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.884+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=JOFPLABB37X2 tag=2CIZGHUZV2IG type=write size=2753879 2024-09-19T13:47:39.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.888+0000 7fcf3240c8c0 1 < completed delete operation key=V8X0VBBNK83J tag=FA3S642AHNXN type=del 2024-09-19T13:47:39.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.888+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=O58TT9YW3N9X type=del size=3743643 2024-09-19T13:47:39.895 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.892+0000 7fcf3240c8c0 1 < completed write operation key=D1RMXGXS3O7Z tag=HRMCBZH53U39 type=write size=22725 2024-09-19T13:47:39.900 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.896+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~H7GO54D7AA35.0 size=1048576 2024-09-19T13:47:39.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.896+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~H7GO54D7AA35.1 size=552128 2024-09-19T13:47:39.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.896+0000 7fcf3240c8c0 1 > prepared multipart upload key=V8X0VBBNK83J upload=H7GO54D7AA35 tag=06ZQM99XEUBA type=write size=2649280 2024-09-19T13:47:39.906 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.904+0000 7fcf3240c8c0 1 < suggested update operation key=C8T6DB9V9FBT tag=PVBPXX1FMCCC type=del size=1362841 2024-09-19T13:47:39.911 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.908+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~96RV123OLCZP.0 size=1048576 2024-09-19T13:47:39.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.908+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~96RV123OLCZP.1 size=1048576 2024-09-19T13:47:39.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.912+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~96RV123OLCZP.2 size=80708 2024-09-19T13:47:39.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.912+0000 7fcf3240c8c0 1 > prepared multipart upload key=A02RDP6BA9AC upload=96RV123OLCZP tag=QSAAFAIGMY0E type=write size=3226436 2024-09-19T13:47:39.918 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.916+0000 7fcf3240c8c0 1 < completed delete operation key=1BMF3S2BZLLI tag=3MR0WH7T63A8 type=del 2024-09-19T13:47:39.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.916+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=VGOBIN5O71PK type=write size=90960 2024-09-19T13:47:39.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.920+0000 7fcf3240c8c0 1 < completed delete operation key=0UCFTOF1YBBM tag=W31J2VF72T0T type=del 2024-09-19T13:47:39.930 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.924+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~0G1R4OBLV9GY.0 size=364109 2024-09-19T13:47:39.930 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.924+0000 7fcf3240c8c0 1 > prepared multipart upload key=C8T6DB9V9FBT upload=0G1R4OBLV9GY tag=78HP9KBNKJJX type=write size=1412685 2024-09-19T13:47:39.933 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.928+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~T3TR6GSREYUT.0 size=1048576 2024-09-19T13:47:39.936 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.932+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~T3TR6GSREYUT.1 size=1048576 2024-09-19T13:47:39.939 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.936+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~T3TR6GSREYUT.2 size=771868 2024-09-19T13:47:39.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.940+0000 7fcf3240c8c0 1 < completed multipart upload key=V8X0VBBNK83J upload=T3TR6GSREYUT tag=D0HYUTUNVKE9 type=write size=3917596 2024-09-19T13:47:39.950 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.948+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~XH9UZT7H1JBM.0 size=1048576 2024-09-19T13:47:39.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.948+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~XH9UZT7H1JBM.1 size=1048576 2024-09-19T13:47:39.956 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.952+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~XH9UZT7H1JBM.2 size=451690 2024-09-19T13:47:39.956 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.952+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=XH9UZT7H1JBM tag=Q3WLXOKDZQ9G type=write size=3597418 2024-09-19T13:47:39.957 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.952+0000 7fcf3240c8c0 1 < canceled part key=_multipart_71Z2VTW99W7J.2~6UQ7IC3Z0871.0 size=875552 2024-09-19T13:47:39.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.960+0000 7fcf3240c8c0 1 < canceled multipart upload key=71Z2VTW99W7J upload=6UQ7IC3Z0871 tag=DC2LZOEIXW4M type=write size=1924128 2024-09-19T13:47:39.967 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.964+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=QGM1ZSWE3AZW type=del size=3798494 2024-09-19T13:47:39.974 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.968+0000 7fcf3240c8c0 1 < suggested remove operation key=6DFF2OCPT9W2 tag=HTPFNMX3Q5P0 type=del 2024-09-19T13:47:39.982 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.976+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=U30FC5SWVTDE type=del size=2671963 2024-09-19T13:47:39.985 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.980+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=3H5C6T4M5P1H type=del 2024-09-19T13:47:39.988 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.984+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=DNGZX3ZWDBLL type=del size=74351 2024-09-19T13:47:39.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.988+0000 7fcf3240c8c0 1 < completed delete operation key=QSM2Q8CW1Q86 tag=0AMG44RY4I4F type=del 2024-09-19T13:47:39.998 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.992+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~A98WXZ7E16AL.0 size=1048576 2024-09-19T13:47:40.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:39.996+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~A98WXZ7E16AL.1 size=1048576 2024-09-19T13:47:40.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.000+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~A98WXZ7E16AL.2 size=506248 2024-09-19T13:47:40.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.000+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=A98WXZ7E16AL tag=56VN0IXCAKU9 type=write size=3651976 2024-09-19T13:47:40.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.004+0000 7fcf3240c8c0 1 < suggested remove operation key=STMT6XU2EJQM tag=7084K6O8A9S2 type=del 2024-09-19T13:47:40.016 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.012+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~HZ2TGI9WMFN2.0 size=1048576 2024-09-19T13:47:40.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.016+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~HZ2TGI9WMFN2.1 size=779856 2024-09-19T13:47:40.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.016+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=HZ2TGI9WMFN2 tag=SKU7WNXJPF6X type=write size=2877008 2024-09-19T13:47:40.022 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.016+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=L1JJV59QFPX4 type=del 2024-09-19T13:47:40.027 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.024+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~DY8KKZ1T9CQO.0 size=1048576 2024-09-19T13:47:40.030 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.024+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~DY8KKZ1T9CQO.1 size=964698 2024-09-19T13:47:40.030 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.024+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=DY8KKZ1T9CQO tag=ZB8Z6RWAHB45 type=write size=3061850 2024-09-19T13:47:40.033 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.028+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~C6CRWV101ZKX.0 size=1048576 2024-09-19T13:47:40.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.032+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~C6CRWV101ZKX.1 size=963700 2024-09-19T13:47:40.041 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.036+0000 7fcf3240c8c0 1 < completed multipart upload key=QMSDNKYFFK1F upload=C6CRWV101ZKX tag=YZ4VY1ZDKUPZ type=write size=3060852 2024-09-19T13:47:40.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.044+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~16025E3LN9BH.0 size=26863 2024-09-19T13:47:40.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.044+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=16025E3LN9BH tag=OK7EQI07ARQG type=write size=1075439 2024-09-19T13:47:40.049 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.044+0000 7fcf3240c8c0 1 < completed delete operation key=D20C6C2ZFX1W tag=EMHK6E5Y79WJ type=del 2024-09-19T13:47:40.052 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.048+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=28SFBPC9QQS6 type=del size=2035368 2024-09-19T13:47:40.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.052+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=MVXOQJ32LZGT type=del 2024-09-19T13:47:40.058 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.052+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=K513JL3VANJN type=del size=4126072 2024-09-19T13:47:40.061 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.056+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~JOFPLABB37X2.0 size=1048576 2024-09-19T13:47:40.063 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.060+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~JOFPLABB37X2.1 size=656727 2024-09-19T13:47:40.068 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.064+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=JOFPLABB37X2 tag=2CIZGHUZV2IG type=write size=2753879 2024-09-19T13:47:40.074 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.068+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~GQTKNQXP97G4.0 size=1048576 2024-09-19T13:47:40.076 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.072+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~GQTKNQXP97G4.1 size=1048576 2024-09-19T13:47:40.078 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.076+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~GQTKNQXP97G4.2 size=766609 2024-09-19T13:47:40.078 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.076+0000 7fcf3240c8c0 1 > prepared multipart upload key=OA9BMSXGYR9T upload=GQTKNQXP97G4 tag=OSN1O2UZML7X type=write size=3912337 2024-09-19T13:47:40.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.076+0000 7fcf3240c8c0 1 < completed delete operation key=XE42LV5M5X82 tag=O58TT9YW3N9X type=del 2024-09-19T13:47:40.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.084+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~180RNWGMINN5.0 size=132592 2024-09-19T13:47:40.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.084+0000 7fcf3240c8c0 1 > prepared multipart upload key=STMT6XU2EJQM upload=180RNWGMINN5 tag=I3EWU1GBNUU2 type=write size=1181168 2024-09-19T13:47:40.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.084+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~H7GO54D7AA35.0 size=1048576 2024-09-19T13:47:40.092 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.088+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~H7GO54D7AA35.1 size=552128 2024-09-19T13:47:40.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.092+0000 7fcf3240c8c0 1 < completed multipart upload key=V8X0VBBNK83J upload=H7GO54D7AA35 tag=06ZQM99XEUBA type=write size=2649280 2024-09-19T13:47:40.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.100+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~ST332HCWABHI.0 size=251129 2024-09-19T13:47:40.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.100+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=ST332HCWABHI tag=LG8LWBM9XNXT type=write size=1299705 2024-09-19T13:47:40.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.100+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~96RV123OLCZP.0 size=1048576 2024-09-19T13:47:40.108 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.104+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~96RV123OLCZP.1 size=1048576 2024-09-19T13:47:40.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.108+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~96RV123OLCZP.2 size=80708 2024-09-19T13:47:40.116 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.112+0000 7fcf3240c8c0 1 < completed multipart upload key=A02RDP6BA9AC upload=96RV123OLCZP tag=QSAAFAIGMY0E type=write size=3226436 2024-09-19T13:47:40.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.116+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~XG8UZAW2UPKS.0 size=476605 2024-09-19T13:47:40.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.116+0000 7fcf3240c8c0 1 > prepared multipart upload key=C3TFYNXH549T upload=XG8UZAW2UPKS tag=BDL2M9Y11XDB type=write size=1525181 2024-09-19T13:47:40.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.120+0000 7fcf3240c8c0 1 < completed write operation key=M2CO4A2DHJ05 tag=VGOBIN5O71PK type=write size=90960 2024-09-19T13:47:40.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.124+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=2E2F5K2O26BR type=write size=151224 2024-09-19T13:47:40.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.128+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~0G1R4OBLV9GY.0 size=364109 2024-09-19T13:47:40.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.132+0000 7fcf3240c8c0 1 < completed multipart upload key=C8T6DB9V9FBT upload=0G1R4OBLV9GY tag=78HP9KBNKJJX type=write size=1412685 2024-09-19T13:47:40.139 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.136+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=Q02L1V2P0ARL type=del size=934761 2024-09-19T13:47:40.143 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.140+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~XH9UZT7H1JBM.0 size=1048576 2024-09-19T13:47:40.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.140+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~XH9UZT7H1JBM.1 size=1048576 2024-09-19T13:47:40.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.144+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~XH9UZT7H1JBM.2 size=451690 2024-09-19T13:47:40.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.148+0000 7fcf3240c8c0 1 < completed multipart upload key=QSM2Q8CW1Q86 upload=XH9UZT7H1JBM tag=Q3WLXOKDZQ9G type=write size=3597418 2024-09-19T13:47:40.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.152+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=EVXS6UVNR0GN type=del size=1437398 2024-09-19T13:47:40.159 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.156+0000 7fcf3240c8c0 1 < completed delete operation key=ZCKKQ1R8318S tag=QGM1ZSWE3AZW type=del 2024-09-19T13:47:40.165 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.160+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~KOBYPXN73FS0.0 size=440832 2024-09-19T13:47:40.165 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.160+0000 7fcf3240c8c0 1 > prepared multipart upload key=1BMF3S2BZLLI upload=KOBYPXN73FS0 tag=0K5619VG39DB type=write size=1489408 2024-09-19T13:47:40.169 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.164+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=U30FC5SWVTDE type=del 2024-09-19T13:47:40.171 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.168+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=3ZSGP37OLD5U type=del size=35488 2024-09-19T13:47:40.174 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.172+0000 7fcf3240c8c0 1 < completed delete operation key=A02RDP6BA9AC tag=DNGZX3ZWDBLL type=del 2024-09-19T13:47:40.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.172+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=7YNRN9IIWU3D type=del size=3431060 2024-09-19T13:47:40.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.176+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~A98WXZ7E16AL.0 size=1048576 2024-09-19T13:47:40.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.176+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~A98WXZ7E16AL.1 size=1048576 2024-09-19T13:47:40.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.176+0000 7fcf3240c8c0 1 < canceled part key=_multipart_BXUPV5XSJBTH.2~A98WXZ7E16AL.2 size=506248 2024-09-19T13:47:40.187 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.184+0000 7fcf3240c8c0 1 < canceled multipart upload key=BXUPV5XSJBTH upload=A98WXZ7E16AL tag=56VN0IXCAKU9 type=write size=3651976 2024-09-19T13:47:40.190 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.184+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=KZLD2D1J7PEB type=del size=2912882 2024-09-19T13:47:40.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.188+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~HZ2TGI9WMFN2.0 size=1048576 2024-09-19T13:47:40.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.188+0000 7fcf3240c8c0 1 < canceled part key=_multipart_HXMZKP7H3HJE.2~HZ2TGI9WMFN2.1 size=779856 2024-09-19T13:47:40.197 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.192+0000 7fcf3240c8c0 1 < canceled multipart upload key=HXMZKP7H3HJE upload=HZ2TGI9WMFN2 tag=SKU7WNXJPF6X type=write size=2877008 2024-09-19T13:47:40.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.196+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=JLV0R1M81G4S type=del size=3361674 2024-09-19T13:47:40.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.200+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~DY8KKZ1T9CQO.0 size=1048576 2024-09-19T13:47:40.205 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.200+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~DY8KKZ1T9CQO.1 size=964698 2024-09-19T13:47:40.211 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.208+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=DY8KKZ1T9CQO tag=ZB8Z6RWAHB45 type=write size=3061850 2024-09-19T13:47:40.216 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.212+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~UJMSGBQ3N2HU.0 size=1048576 2024-09-19T13:47:40.219 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.216+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~UJMSGBQ3N2HU.1 size=1048576 2024-09-19T13:47:40.221 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.216+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~UJMSGBQ3N2HU.2 size=116452 2024-09-19T13:47:40.221 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.216+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=UJMSGBQ3N2HU tag=CY0C32A0XXDV type=write size=3262180 2024-09-19T13:47:40.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.220+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~16025E3LN9BH.0 size=26863 2024-09-19T13:47:40.229 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.224+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=16025E3LN9BH tag=OK7EQI07ARQG type=write size=1075439 2024-09-19T13:47:40.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.228+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=15AV1SUEHNLB type=write size=493939 2024-09-19T13:47:40.235 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.232+0000 7fcf3240c8c0 1 < completed delete operation key=0U9BUX9DHTAK tag=28SFBPC9QQS6 type=del 2024-09-19T13:47:40.239 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.236+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=23GWLU031MMS type=del size=2014536 2024-09-19T13:47:40.241 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.236+0000 7fcf3240c8c0 1 < completed delete operation key=6DFF2OCPT9W2 tag=K513JL3VANJN type=del 2024-09-19T13:47:40.244 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.240+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=OQZAQ3NHO0RB type=del size=2546713 2024-09-19T13:47:40.245 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.240+0000 7fcf3240c8c0 1 < canceled part key=_multipart_OA9BMSXGYR9T.2~GQTKNQXP97G4.0 size=1048576 2024-09-19T13:47:40.247 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.244+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~GQTKNQXP97G4.1 size=1048576 2024-09-19T13:47:40.250 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.244+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~GQTKNQXP97G4.2 size=766609 2024-09-19T13:47:40.256 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.252+0000 7fcf3240c8c0 1 < canceled multipart upload key=OA9BMSXGYR9T upload=GQTKNQXP97G4 tag=OSN1O2UZML7X type=write size=3912337 2024-09-19T13:47:40.258 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.252+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=XNBS9NT258EF type=del size=3161537 2024-09-19T13:47:40.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.260+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~180RNWGMINN5.0 size=132592 2024-09-19T13:47:40.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.264+0000 7fcf3240c8c0 1 < completed multipart upload key=STMT6XU2EJQM upload=180RNWGMINN5 tag=I3EWU1GBNUU2 type=write size=1181168 2024-09-19T13:47:40.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.268+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=Y5R64417KNOS type=del size=3391318 2024-09-19T13:47:40.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.272+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~ST332HCWABHI.0 size=251129 2024-09-19T13:47:40.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.276+0000 7fcf3240c8c0 1 < completed multipart upload key=QMSDNKYFFK1F upload=ST332HCWABHI tag=LG8LWBM9XNXT type=write size=1299705 2024-09-19T13:47:40.286 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.280+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~AKJF66EI6A5U.0 size=1048576 2024-09-19T13:47:40.288 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.284+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~AKJF66EI6A5U.1 size=1048576 2024-09-19T13:47:40.291 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.288+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~AKJF66EI6A5U.2 size=257835 2024-09-19T13:47:40.291 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.288+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=AKJF66EI6A5U tag=8YLJG2GWRJG4 type=write size=3403563 2024-09-19T13:47:40.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.288+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~XG8UZAW2UPKS.0 size=476605 2024-09-19T13:47:40.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.296+0000 7fcf3240c8c0 1 < completed multipart upload key=C3TFYNXH549T upload=XG8UZAW2UPKS tag=BDL2M9Y11XDB type=write size=1525181 2024-09-19T13:47:40.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.300+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~Y9S1EE5N746W.0 size=1048576 2024-09-19T13:47:40.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.300+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~Y9S1EE5N746W.1 size=215683 2024-09-19T13:47:40.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.300+0000 7fcf3240c8c0 1 > prepared multipart upload key=X16ENUFL40RN upload=Y9S1EE5N746W tag=HDZ2RT2UNS0D type=write size=2312835 2024-09-19T13:47:40.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.304+0000 7fcf3240c8c0 1 < completed write operation key=ZCKKQ1R8318S tag=2E2F5K2O26BR type=write size=151224 2024-09-19T13:47:40.314 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.308+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~GLT0SIW03EG2.0 size=1048576 2024-09-19T13:47:40.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.312+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~GLT0SIW03EG2.1 size=1048576 2024-09-19T13:47:40.318 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.316+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~GLT0SIW03EG2.2 size=931813 2024-09-19T13:47:40.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.316+0000 7fcf3240c8c0 1 > prepared multipart upload key=D1RMXGXS3O7Z upload=GLT0SIW03EG2 tag=12S7ZWYYR35L type=write size=4077541 2024-09-19T13:47:40.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.320+0000 7fcf3240c8c0 1 < suggested remove operation key=QAYJ5B1KZ08J tag=Q02L1V2P0ARL type=del 2024-09-19T13:47:40.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.324+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=UNYMVB75C7JN type=write size=638484 2024-09-19T13:47:40.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.324+0000 7fcf3240c8c0 1 < completed delete operation key=X9FGPMP30X47 tag=EVXS6UVNR0GN type=del 2024-09-19T13:47:40.332 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.328+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=VWOK8VEOSG6F type=del size=973497 2024-09-19T13:47:40.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.332+0000 7fcf3240c8c0 1 < completed part key=_multipart_1BMF3S2BZLLI.2~KOBYPXN73FS0.0 size=440832 2024-09-19T13:47:40.340 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.336+0000 7fcf3240c8c0 1 < completed multipart upload key=1BMF3S2BZLLI upload=KOBYPXN73FS0 tag=0K5619VG39DB type=write size=1489408 2024-09-19T13:47:40.343 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.340+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=LT8OKF9M7D9E type=del size=3345300 2024-09-19T13:47:40.345 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.340+0000 7fcf3240c8c0 1 < completed delete operation key=C35EUAOWLBR3 tag=3ZSGP37OLD5U type=del 2024-09-19T13:47:40.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.344+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=4K9XZ74RNIVI type=del size=4148658 2024-09-19T13:47:40.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.348+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=7YNRN9IIWU3D type=del 2024-09-19T13:47:40.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.352+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~APIIBYT3MH3L.0 size=322223 2024-09-19T13:47:40.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.352+0000 7fcf3240c8c0 1 > prepared multipart upload key=D1RMXGXS3O7Z upload=APIIBYT3MH3L tag=WKVO1O76VXQI type=write size=1370799 2024-09-19T13:47:40.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.356+0000 7fcf3240c8c0 1 < suggested update operation key=C8T6DB9V9FBT tag=KZLD2D1J7PEB type=del size=2912882 2024-09-19T13:47:40.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.360+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=JOK5W1VX9V4Z type=del size=2858975 2024-09-19T13:47:40.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.360+0000 7fcf3240c8c0 1 < completed delete operation key=7UC85R2HO9K2 tag=JLV0R1M81G4S type=del 2024-09-19T13:47:40.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.364+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=JEEF0H8IIQEV type=del size=237946 2024-09-19T13:47:40.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.368+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~UJMSGBQ3N2HU.0 size=1048576 2024-09-19T13:47:40.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.368+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~UJMSGBQ3N2HU.1 size=1048576 2024-09-19T13:47:40.376 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.372+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~UJMSGBQ3N2HU.2 size=116452 2024-09-19T13:47:40.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.376+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=UJMSGBQ3N2HU tag=CY0C32A0XXDV type=write size=3262180 2024-09-19T13:47:40.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.380+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=3ZRCDSJ1HZQ4 type=del size=3892469 2024-09-19T13:47:40.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.380+0000 7fcf3240c8c0 1 < canceled operation key=X16ENUFL40RN tag=15AV1SUEHNLB type=write size=493939 2024-09-19T13:47:40.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.388+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~KQPSUO5SVA8U.0 size=1048576 2024-09-19T13:47:40.393 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.388+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~KQPSUO5SVA8U.1 size=1048576 2024-09-19T13:47:40.395 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.392+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~KQPSUO5SVA8U.2 size=66766 2024-09-19T13:47:40.395 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.392+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=KQPSUO5SVA8U tag=NCFG3Z94UQ8V type=write size=3212494 2024-09-19T13:47:40.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.396+0000 7fcf3240c8c0 1 < completed delete operation key=0U9BUX9DHTAK tag=23GWLU031MMS type=del 2024-09-19T13:47:40.403 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.400+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~4T79VI3GNPG3.0 size=1048576 2024-09-19T13:47:40.405 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.400+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~4T79VI3GNPG3.1 size=301313 2024-09-19T13:47:40.405 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.400+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=4T79VI3GNPG3 tag=QWHGQPUUOO9C type=write size=2398465 2024-09-19T13:47:40.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.404+0000 7fcf3240c8c0 1 < suggested update operation key=ES62XJO5Q3FO tag=OQZAQ3NHO0RB type=del size=2546713 2024-09-19T13:47:40.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.408+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=900PYD31IR1B type=write size=677379 2024-09-19T13:47:40.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.412+0000 7fcf3240c8c0 1 < canceled operation key=C3TFYNXH549T tag=XNBS9NT258EF type=del size=3161537 2024-09-19T13:47:40.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.416+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~RYRUJO1BZOXB.0 size=261671 2024-09-19T13:47:40.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.416+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=RYRUJO1BZOXB tag=ZY5GNTCV5TQX type=write size=1310247 2024-09-19T13:47:40.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.416+0000 7fcf3240c8c0 1 < canceled operation key=STMT6XU2EJQM tag=Y5R64417KNOS type=del size=3391318 2024-09-19T13:47:40.426 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.424+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~EMMGEORP0I2Q.0 size=1048576 2024-09-19T13:47:40.428 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.424+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~EMMGEORP0I2Q.1 size=73362 2024-09-19T13:47:40.429 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.424+0000 7fcf3240c8c0 1 > prepared multipart upload key=3TME221SA53E upload=EMMGEORP0I2Q tag=MQRKW8JNSRWC type=write size=2170514 2024-09-19T13:47:40.431 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.428+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~AKJF66EI6A5U.0 size=1048576 2024-09-19T13:47:40.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.428+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~AKJF66EI6A5U.1 size=1048576 2024-09-19T13:47:40.435 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.432+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~AKJF66EI6A5U.2 size=257835 2024-09-19T13:47:40.439 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.436+0000 7fcf3240c8c0 1 < completed multipart upload key=XE42LV5M5X82 upload=AKJF66EI6A5U tag=8YLJG2GWRJG4 type=write size=3403563 2024-09-19T13:47:40.444 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.440+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~Z4SXFAWZ5VUL.0 size=1048576 2024-09-19T13:47:40.446 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.444+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~Z4SXFAWZ5VUL.1 size=1048576 2024-09-19T13:47:40.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.444+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~Z4SXFAWZ5VUL.2 size=719039 2024-09-19T13:47:40.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.444+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=Z4SXFAWZ5VUL tag=JSSF8UTCTG2W type=write size=3864767 2024-09-19T13:47:40.451 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.448+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~Y9S1EE5N746W.0 size=1048576 2024-09-19T13:47:40.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.448+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~Y9S1EE5N746W.1 size=215683 2024-09-19T13:47:40.459 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.456+0000 7fcf3240c8c0 1 < completed multipart upload key=X16ENUFL40RN upload=Y9S1EE5N746W tag=HDZ2RT2UNS0D type=write size=2312835 2024-09-19T13:47:40.464 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.456+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=C2F9EXKOUBLJ type=del size=3347479 2024-09-19T13:47:40.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.460+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~GLT0SIW03EG2.0 size=1048576 2024-09-19T13:47:40.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.460+0000 7fcf3240c8c0 1 < canceled part key=_multipart_D1RMXGXS3O7Z.2~GLT0SIW03EG2.1 size=1048576 2024-09-19T13:47:40.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.464+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~GLT0SIW03EG2.2 size=931813 2024-09-19T13:47:40.472 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.468+0000 7fcf3240c8c0 1 < canceled multipart upload key=D1RMXGXS3O7Z upload=GLT0SIW03EG2 tag=12S7ZWYYR35L type=write size=4077541 2024-09-19T13:47:40.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.472+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=3Y07WL8NWK40 type=del size=3977870 2024-09-19T13:47:40.478 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.476+0000 7fcf3240c8c0 1 < completed write operation key=DHPONKOVS8CT tag=UNYMVB75C7JN type=write size=638484 2024-09-19T13:47:40.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.476+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=V0BSABUBI84P type=del size=3110630 2024-09-19T13:47:40.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.480+0000 7fcf3240c8c0 1 < suggested remove operation key=BXUPV5XSJBTH tag=VWOK8VEOSG6F type=del 2024-09-19T13:47:40.488 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.484+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=13A89ETLM003 type=del size=624783 2024-09-19T13:47:40.491 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.488+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=LT8OKF9M7D9E type=del 2024-09-19T13:47:40.493 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.488+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=ZX20JAUGN5EN type=del size=3456628 2024-09-19T13:47:40.495 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.492+0000 7fcf3240c8c0 1 < canceled operation key=DHPONKOVS8CT tag=4K9XZ74RNIVI type=del size=4148658 2024-09-19T13:47:40.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.492+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=HA83EBYURZ5X type=del size=2604529 2024-09-19T13:47:40.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.496+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~APIIBYT3MH3L.0 size=322223 2024-09-19T13:47:40.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.500+0000 7fcf3240c8c0 1 < completed multipart upload key=D1RMXGXS3O7Z upload=APIIBYT3MH3L tag=WKVO1O76VXQI type=write size=1370799 2024-09-19T13:47:40.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.504+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~YEXN2DB1XTPG.0 size=1048576 2024-09-19T13:47:40.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.508+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~YEXN2DB1XTPG.1 size=945119 2024-09-19T13:47:40.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.508+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=YEXN2DB1XTPG tag=L03N48H734VT type=write size=3042271 2024-09-19T13:47:40.517 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.512+0000 7fcf3240c8c0 1 < completed delete operation key=C3TFYNXH549T tag=JOK5W1VX9V4Z type=del 2024-09-19T13:47:40.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.516+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=86AWC1JQS9FY type=del size=1065731 2024-09-19T13:47:40.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.520+0000 7fcf3240c8c0 1 < suggested update operation key=0UCFTOF1YBBM tag=JEEF0H8IIQEV type=del size=237946 2024-09-19T13:47:40.527 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.524+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=HSM9JIJU1R38 type=write size=538047 2024-09-19T13:47:40.530 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.524+0000 7fcf3240c8c0 1 < completed delete operation key=C8T6DB9V9FBT tag=3ZRCDSJ1HZQ4 type=del 2024-09-19T13:47:40.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.532+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~LWOT1KCTRPX8.0 size=1048576 2024-09-19T13:47:40.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.532+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~LWOT1KCTRPX8.1 size=1048576 2024-09-19T13:47:40.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.536+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~LWOT1KCTRPX8.2 size=801174 2024-09-19T13:47:40.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.536+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=LWOT1KCTRPX8 tag=I7TDJB50YTCY type=write size=3946902 2024-09-19T13:47:40.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.536+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~KQPSUO5SVA8U.0 size=1048576 2024-09-19T13:47:40.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.540+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~KQPSUO5SVA8U.1 size=1048576 2024-09-19T13:47:40.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.540+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~KQPSUO5SVA8U.2 size=66766 2024-09-19T13:47:40.549 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.544+0000 7fcf3240c8c0 1 < completed multipart upload key=N51Q6HKJSCCB upload=KQPSUO5SVA8U tag=NCFG3Z94UQ8V type=write size=3212494 2024-09-19T13:47:40.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.548+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=UJ14US7AB1C3 type=del size=1063476 2024-09-19T13:47:40.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.548+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~4T79VI3GNPG3.0 size=1048576 2024-09-19T13:47:40.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.552+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~4T79VI3GNPG3.1 size=301313 2024-09-19T13:47:40.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.556+0000 7fcf3240c8c0 1 < completed multipart upload key=NP2L28YRVQ8L upload=4T79VI3GNPG3 tag=QWHGQPUUOO9C type=write size=2398465 2024-09-19T13:47:40.562 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.560+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=V3NHN9F22EB2 type=del size=2644726 2024-09-19T13:47:40.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.560+0000 7fcf3240c8c0 1 < completed write operation key=OA9BMSXGYR9T tag=900PYD31IR1B type=write size=677379 2024-09-19T13:47:40.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.564+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=XFZZARJWLCFC type=del size=3378157 2024-09-19T13:47:40.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.564+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~RYRUJO1BZOXB.0 size=261671 2024-09-19T13:47:40.576 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.568+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=RYRUJO1BZOXB tag=ZY5GNTCV5TQX type=write size=1310247 2024-09-19T13:47:40.577 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.572+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~DZEFKT6X1WXW.0 size=791870 2024-09-19T13:47:40.578 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.572+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=DZEFKT6X1WXW tag=P0DV27Z0JUK8 type=write size=1840446 2024-09-19T13:47:40.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.576+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~EMMGEORP0I2Q.0 size=1048576 2024-09-19T13:47:40.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.576+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~EMMGEORP0I2Q.1 size=73362 2024-09-19T13:47:40.587 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.584+0000 7fcf3240c8c0 1 < completed multipart upload key=3TME221SA53E upload=EMMGEORP0I2Q tag=MQRKW8JNSRWC type=write size=2170514 2024-09-19T13:47:40.589 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.584+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=SRA9Y2T0I7FX type=del size=2642757 2024-09-19T13:47:40.592 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.588+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~Z4SXFAWZ5VUL.0 size=1048576 2024-09-19T13:47:40.593 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.588+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~Z4SXFAWZ5VUL.1 size=1048576 2024-09-19T13:47:40.595 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.592+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~Z4SXFAWZ5VUL.2 size=719039 2024-09-19T13:47:40.598 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.596+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=Z4SXFAWZ5VUL tag=JSSF8UTCTG2W type=write size=3864767 2024-09-19T13:47:40.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.596+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=QZC5BY8XLIBM type=del size=76803 2024-09-19T13:47:40.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.600+0000 7fcf3240c8c0 1 < suggested update operation key=C8T6DB9V9FBT tag=C2F9EXKOUBLJ type=del size=3347479 2024-09-19T13:47:40.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.604+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=MTIXPV629QH7 type=del size=1434069 2024-09-19T13:47:40.612 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.608+0000 7fcf3240c8c0 1 < suggested remove operation key=N51Q6HKJSCCB tag=3Y07WL8NWK40 type=del 2024-09-19T13:47:40.617 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.612+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~N7ACPPBX9538.0 size=966695 2024-09-19T13:47:40.617 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.612+0000 7fcf3240c8c0 1 > prepared multipart upload key=DHPONKOVS8CT upload=N7ACPPBX9538 tag=PLM8XW5UJIO6 type=write size=2015271 2024-09-19T13:47:40.620 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.616+0000 7fcf3240c8c0 1 < completed delete operation key=3TME221SA53E tag=V0BSABUBI84P type=del 2024-09-19T13:47:40.623 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.620+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=Z295LE4A2PJ4 type=del size=3513486 2024-09-19T13:47:40.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.620+0000 7fcf3240c8c0 1 < completed delete operation key=6DFF2OCPT9W2 tag=13A89ETLM003 type=del 2024-09-19T13:47:40.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.624+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=1PBX8K8IQEW9 type=del size=2038915 2024-09-19T13:47:40.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.628+0000 7fcf3240c8c0 1 < suggested update operation key=3TME221SA53E tag=ZX20JAUGN5EN type=del size=3456628 2024-09-19T13:47:40.635 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.632+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=QMERSY3NEREA type=del size=634769 2024-09-19T13:47:40.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.632+0000 7fcf3240c8c0 -1 < failed to complete operation key=C8T6DB9V9FBT tag=HA83EBYURZ5X type=del size=2604529: (22) Invalid argument 2024-09-19T13:47:40.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.636+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~AYIWVFXBTR9N.0 size=1046270 2024-09-19T13:47:40.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.640+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=AYIWVFXBTR9N tag=1BM036VAML3Q type=write size=2094846 2024-09-19T13:47:40.644 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.640+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~YEXN2DB1XTPG.0 size=1048576 2024-09-19T13:47:40.645 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.640+0000 7fcf3240c8c0 1 < canceled part key=_multipart_M2CO4A2DHJ05.2~YEXN2DB1XTPG.1 size=945119 2024-09-19T13:47:40.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.644+0000 7fcf3240c8c0 1 < canceled multipart upload key=M2CO4A2DHJ05 upload=YEXN2DB1XTPG tag=L03N48H734VT type=write size=3042271 2024-09-19T13:47:40.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.648+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~VQVMTEA486E3.0 size=1048576 2024-09-19T13:47:40.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.652+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~VQVMTEA486E3.1 size=251469 2024-09-19T13:47:40.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.652+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=VQVMTEA486E3 tag=DPDSD5MUTBNK type=write size=2348621 2024-09-19T13:47:40.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.652+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=86AWC1JQS9FY type=del 2024-09-19T13:47:40.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.656+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=N4B24DOJWAJM type=del size=498494 2024-09-19T13:47:40.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.656+0000 7fcf3240c8c0 1 < completed write operation key=M2CO4A2DHJ05 tag=HSM9JIJU1R38 type=write size=538047 2024-09-19T13:47:40.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.660+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=LGZIOEJWLLCT type=del size=3980048 2024-09-19T13:47:40.667 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.664+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~LWOT1KCTRPX8.0 size=1048576 2024-09-19T13:47:40.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.664+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~LWOT1KCTRPX8.1 size=1048576 2024-09-19T13:47:40.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.668+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~LWOT1KCTRPX8.2 size=801174 2024-09-19T13:47:40.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.672+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=LWOT1KCTRPX8 tag=I7TDJB50YTCY type=write size=3946902 2024-09-19T13:47:40.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.676+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~A7WYLPO7BRRZ.0 size=1048576 2024-09-19T13:47:40.682 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.676+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~A7WYLPO7BRRZ.1 size=232755 2024-09-19T13:47:40.682 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.676+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=A7WYLPO7BRRZ tag=RR9ADTJJMES9 type=write size=2329907 2024-09-19T13:47:40.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.680+0000 7fcf3240c8c0 -1 < failed to complete operation key=N51Q6HKJSCCB tag=UJ14US7AB1C3 type=del size=1063476: (22) Invalid argument 2024-09-19T13:47:40.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.684+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=XAL8099THTU5 type=del size=2868969 2024-09-19T13:47:40.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.684+0000 7fcf3240c8c0 1 < completed delete operation key=6DFF2OCPT9W2 tag=V3NHN9F22EB2 type=del 2024-09-19T13:47:40.691 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.688+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=GAQRPVWDSVDU type=write size=794758 2024-09-19T13:47:40.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.688+0000 7fcf3240c8c0 1 < completed delete operation key=D1RMXGXS3O7Z tag=XFZZARJWLCFC type=del 2024-09-19T13:47:40.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.692+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=Z4AMMOKNU3CR type=del size=1047372 2024-09-19T13:47:40.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.692+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~DZEFKT6X1WXW.0 size=791870 2024-09-19T13:47:40.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.696+0000 7fcf3240c8c0 1 < completed multipart upload key=0UCFTOF1YBBM upload=DZEFKT6X1WXW tag=P0DV27Z0JUK8 type=write size=1840446 2024-09-19T13:47:40.704 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.700+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=QAU1TPWRY69P type=del size=1128505 2024-09-19T13:47:40.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.704+0000 7fcf3240c8c0 1 < suggested update operation key=1BMF3S2BZLLI tag=SRA9Y2T0I7FX type=del size=2642757 2024-09-19T13:47:40.711 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.708+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=6HQ6YYE51ZKY type=del size=3177987 2024-09-19T13:47:40.714 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.708+0000 7fcf3240c8c0 1 < completed delete operation key=7UC85R2HO9K2 tag=QZC5BY8XLIBM type=del 2024-09-19T13:47:40.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.712+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~8420RC72SZIU.0 size=1048576 2024-09-19T13:47:40.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.716+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~8420RC72SZIU.1 size=1048576 2024-09-19T13:47:40.722 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.716+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~8420RC72SZIU.2 size=660730 2024-09-19T13:47:40.722 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.716+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=8420RC72SZIU tag=M5IS0ID1TCAI type=write size=3806458 2024-09-19T13:47:40.725 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.720+0000 7fcf3240c8c0 1 < canceled operation key=7UC85R2HO9K2 tag=MTIXPV629QH7 type=del size=1434069 2024-09-19T13:47:40.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.724+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~K9GW3WCNHFS0.0 size=68869 2024-09-19T13:47:40.730 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.724+0000 7fcf3240c8c0 1 > prepared multipart upload key=D1RMXGXS3O7Z upload=K9GW3WCNHFS0 tag=073DCFJJ9KK7 type=write size=1117445 2024-09-19T13:47:40.732 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.728+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~N7ACPPBX9538.0 size=966695 2024-09-19T13:47:40.737 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.732+0000 7fcf3240c8c0 1 < completed multipart upload key=DHPONKOVS8CT upload=N7ACPPBX9538 tag=PLM8XW5UJIO6 type=write size=2015271 2024-09-19T13:47:40.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.736+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~AMKPO8U883GI.0 size=1048576 2024-09-19T13:47:40.747 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.744+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~AMKPO8U883GI.1 size=1048576 2024-09-19T13:47:40.748 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.744+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~AMKPO8U883GI.2 size=715254 2024-09-19T13:47:40.749 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.744+0000 7fcf3240c8c0 1 > prepared multipart upload key=1BMF3S2BZLLI upload=AMKPO8U883GI tag=LBD5J2YMTPLZ type=write size=3860982 2024-09-19T13:47:40.753 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.748+0000 7fcf3240c8c0 1 < suggested update operation key=STMT6XU2EJQM tag=Z295LE4A2PJ4 type=del size=3513486 2024-09-19T13:47:40.755 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.752+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=V34Z3NIUKXOT type=del size=1797485 2024-09-19T13:47:40.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.752+0000 7fcf3240c8c0 -1 < failed to complete operation key=3TME221SA53E tag=1PBX8K8IQEW9 type=del size=2038915: (22) Invalid argument 2024-09-19T13:47:40.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.756+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=1SQ886L12J2R type=del size=967645 2024-09-19T13:47:40.762 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.760+0000 7fcf3240c8c0 1 < completed delete operation key=QSM2Q8CW1Q86 tag=QMERSY3NEREA type=del 2024-09-19T13:47:40.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.760+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=QKF4G5ZLQLP0 type=write size=1000638 2024-09-19T13:47:40.768 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.764+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~AYIWVFXBTR9N.0 size=1046270 2024-09-19T13:47:40.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.768+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=AYIWVFXBTR9N tag=1BM036VAML3Q type=write size=2094846 2024-09-19T13:47:40.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.772+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=ATKNIGF2T9JC type=write size=796608 2024-09-19T13:47:40.778 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.772+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~VQVMTEA486E3.0 size=1048576 2024-09-19T13:47:40.780 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.776+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~VQVMTEA486E3.1 size=251469 2024-09-19T13:47:40.784 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.780+0000 7fcf3240c8c0 1 < completed multipart upload key=M2CO4A2DHJ05 upload=VQVMTEA486E3 tag=DPDSD5MUTBNK type=write size=2348621 2024-09-19T13:47:40.786 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.784+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=IBCTOQDA7IHC type=write size=147732 2024-09-19T13:47:40.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.784+0000 7fcf3240c8c0 1 < completed delete operation key=D1RMXGXS3O7Z tag=N4B24DOJWAJM type=del 2024-09-19T13:47:40.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.788+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=ISDYV6KM0WSP type=del size=3586133 2024-09-19T13:47:40.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.788+0000 7fcf3240c8c0 1 < completed delete operation key=N51Q6HKJSCCB tag=LGZIOEJWLLCT type=del 2024-09-19T13:47:40.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.792+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=F77C53KZZXKB type=write size=510780 2024-09-19T13:47:40.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.792+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~A7WYLPO7BRRZ.0 size=1048576 2024-09-19T13:47:40.800 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.796+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~A7WYLPO7BRRZ.1 size=232755 2024-09-19T13:47:40.804 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.800+0000 7fcf3240c8c0 1 < completed multipart upload key=ES62XJO5Q3FO upload=A7WYLPO7BRRZ tag=RR9ADTJJMES9 type=write size=2329907 2024-09-19T13:47:40.807 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.804+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=SECNH4K38XFH type=del size=4143645 2024-09-19T13:47:40.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.804+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=XAL8099THTU5 type=del 2024-09-19T13:47:40.812 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.808+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=LOC21YI9PHEX type=del size=305465 2024-09-19T13:47:40.814 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.812+0000 7fcf3240c8c0 1 < completed write operation key=X16ENUFL40RN tag=GAQRPVWDSVDU type=write size=794758 2024-09-19T13:47:40.817 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.812+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=5RTMKJPBVJ5Z type=write size=769257 2024-09-19T13:47:40.820 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.816+0000 7fcf3240c8c0 1 < completed delete operation key=7UC85R2HO9K2 tag=Z4AMMOKNU3CR type=del 2024-09-19T13:47:40.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.820+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=A0U3TSLYP273 type=del size=2102848 2024-09-19T13:47:40.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.820+0000 7fcf3240c8c0 1 < completed delete operation key=QSM2Q8CW1Q86 tag=QAU1TPWRY69P type=del 2024-09-19T13:47:40.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.824+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=IUN9DCZ52CPC type=del size=4034618 2024-09-19T13:47:40.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.828+0000 7fcf3240c8c0 1 < completed delete operation key=D20C6C2ZFX1W tag=6HQ6YYE51ZKY type=del 2024-09-19T13:47:40.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.828+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=T80CN7XD1WF7 type=write size=926856 2024-09-19T13:47:40.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.832+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~8420RC72SZIU.0 size=1048576 2024-09-19T13:47:40.838 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.836+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~8420RC72SZIU.1 size=1048576 2024-09-19T13:47:40.839 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.836+0000 7fcf3240c8c0 1 < canceled part key=_multipart_XE42LV5M5X82.2~8420RC72SZIU.2 size=660730 2024-09-19T13:47:40.842 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.840+0000 7fcf3240c8c0 1 < canceled multipart upload key=XE42LV5M5X82 upload=8420RC72SZIU tag=M5IS0ID1TCAI type=write size=3806458 2024-09-19T13:47:40.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.844+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~43G4MXFXLOY2.0 size=769758 2024-09-19T13:47:40.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.844+0000 7fcf3240c8c0 1 > prepared multipart upload key=A02RDP6BA9AC upload=43G4MXFXLOY2 tag=V4X7UEI5MXPM type=write size=1818334 2024-09-19T13:47:40.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.844+0000 7fcf3240c8c0 1 < canceled part key=_multipart_D1RMXGXS3O7Z.2~K9GW3WCNHFS0.0 size=68869 2024-09-19T13:47:40.851 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.848+0000 7fcf3240c8c0 1 < canceled multipart upload key=D1RMXGXS3O7Z upload=K9GW3WCNHFS0 tag=073DCFJJ9KK7 type=write size=1117445 2024-09-19T13:47:40.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.848+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=4O3QZ1VMXNCH type=del size=1290429 2024-09-19T13:47:40.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.852+0000 7fcf3240c8c0 1 < completed part key=_multipart_1BMF3S2BZLLI.2~AMKPO8U883GI.0 size=1048576 2024-09-19T13:47:40.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.852+0000 7fcf3240c8c0 1 < completed part key=_multipart_1BMF3S2BZLLI.2~AMKPO8U883GI.1 size=1048576 2024-09-19T13:47:40.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.856+0000 7fcf3240c8c0 1 < completed part key=_multipart_1BMF3S2BZLLI.2~AMKPO8U883GI.2 size=715254 2024-09-19T13:47:40.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.860+0000 7fcf3240c8c0 1 < completed multipart upload key=1BMF3S2BZLLI upload=AMKPO8U883GI tag=LBD5J2YMTPLZ type=write size=3860982 2024-09-19T13:47:40.867 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.864+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=TFNB390XUJ3K type=del size=807789 2024-09-19T13:47:40.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.864+0000 7fcf3240c8c0 1 < completed delete operation key=STMT6XU2EJQM tag=V34Z3NIUKXOT type=del 2024-09-19T13:47:40.875 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.872+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~XNO82S9WYDS5.0 size=1022883 2024-09-19T13:47:40.875 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.872+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=XNO82S9WYDS5 tag=EGCZ2R6R0W82 type=write size=2071459 2024-09-19T13:47:40.878 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.872+0000 7fcf3240c8c0 1 < completed delete operation key=0UCFTOF1YBBM tag=1SQ886L12J2R type=del 2024-09-19T13:47:40.880 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.876+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=NUQ0TWT69U6H type=write size=15396 2024-09-19T13:47:40.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.880+0000 7fcf3240c8c0 1 < completed write operation key=71Z2VTW99W7J tag=QKF4G5ZLQLP0 type=write size=1000638 2024-09-19T13:47:40.885 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.880+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=1WRX48ZOUL0G type=del size=1301928 2024-09-19T13:47:40.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.884+0000 7fcf3240c8c0 1 < completed write operation key=D1RMXGXS3O7Z tag=ATKNIGF2T9JC type=write size=796608 2024-09-19T13:47:40.892 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.888+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~046AJNW1I7DC.0 size=1048576 2024-09-19T13:47:40.894 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.892+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~046AJNW1I7DC.1 size=1048576 2024-09-19T13:47:40.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.892+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~046AJNW1I7DC.2 size=715481 2024-09-19T13:47:40.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.892+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=046AJNW1I7DC tag=SLWIL4EZH5ZU type=write size=3861209 2024-09-19T13:47:40.899 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.896+0000 7fcf3240c8c0 1 < canceled operation key=3TME221SA53E tag=IBCTOQDA7IHC type=write size=147732 2024-09-19T13:47:40.905 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.900+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~KUFZEQFGZL0C.0 size=1048576 2024-09-19T13:47:40.907 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.904+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~KUFZEQFGZL0C.1 size=1048576 2024-09-19T13:47:40.909 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.904+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~KUFZEQFGZL0C.2 size=779262 2024-09-19T13:47:40.910 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.904+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=KUFZEQFGZL0C tag=4XK5OI5U4Q18 type=write size=3924990 2024-09-19T13:47:40.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.912+0000 7fcf3240c8c0 1 < suggested update operation key=X9FGPMP30X47 tag=ISDYV6KM0WSP type=del size=3586133 2024-09-19T13:47:40.919 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.916+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=58CEUGDC1PC3 type=del size=832417 2024-09-19T13:47:40.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.916+0000 7fcf3240c8c0 1 < canceled operation key=XE42LV5M5X82 tag=F77C53KZZXKB type=write size=510780 2024-09-19T13:47:40.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.924+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~8YKMVAQH3T3F.0 size=1048576 2024-09-19T13:47:40.928 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.924+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~8YKMVAQH3T3F.1 size=1048576 2024-09-19T13:47:40.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.928+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~8YKMVAQH3T3F.2 size=34627 2024-09-19T13:47:40.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.928+0000 7fcf3240c8c0 1 > prepared multipart upload key=STMT6XU2EJQM upload=8YKMVAQH3T3F tag=AG1G2Y9MDBMY type=write size=3180355 2024-09-19T13:47:40.937 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.932+0000 7fcf3240c8c0 1 < suggested update operation key=NP2L28YRVQ8L tag=SECNH4K38XFH type=del size=4143645 2024-09-19T13:47:40.939 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.936+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=6IBQ630NRIKG type=del size=3836024 2024-09-19T13:47:40.942 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.940+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=LOC21YI9PHEX type=del 2024-09-19T13:47:40.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.940+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=FWC05K3Z6DID type=del size=2500161 2024-09-19T13:47:40.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.944+0000 7fcf3240c8c0 1 < completed write operation key=XE42LV5M5X82 tag=5RTMKJPBVJ5Z type=write size=769257 2024-09-19T13:47:40.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.948+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~HGQHMY2UJTE8.0 size=1048576 2024-09-19T13:47:40.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.948+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~HGQHMY2UJTE8.1 size=1048576 2024-09-19T13:47:40.956 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.952+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~HGQHMY2UJTE8.2 size=17593 2024-09-19T13:47:40.956 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.952+0000 7fcf3240c8c0 1 > prepared multipart upload key=DHPONKOVS8CT upload=HGQHMY2UJTE8 tag=6XURW1199Y21 type=write size=3163321 2024-09-19T13:47:40.959 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.956+0000 7fcf3240c8c0 1 < completed delete operation key=71Z2VTW99W7J tag=A0U3TSLYP273 type=del 2024-09-19T13:47:40.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.956+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=YFBDGHLUVIPG type=del size=3240292 2024-09-19T13:47:40.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.960+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=IUN9DCZ52CPC type=del 2024-09-19T13:47:40.967 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.964+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=KWYLLYT55QKP type=del size=135159 2024-09-19T13:47:40.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.964+0000 7fcf3240c8c0 -1 < failed to complete operation key=NP2L28YRVQ8L tag=T80CN7XD1WF7 type=write size=926856: (22) Invalid argument 2024-09-19T13:47:40.974 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.968+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~0Q25YF03ZSI0.0 size=1048576 2024-09-19T13:47:40.975 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.972+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~0Q25YF03ZSI0.1 size=1046829 2024-09-19T13:47:40.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.972+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=0Q25YF03ZSI0 tag=IY7Z7OT1I7YU type=write size=3143981 2024-09-19T13:47:40.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.972+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~43G4MXFXLOY2.0 size=769758 2024-09-19T13:47:40.982 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.980+0000 7fcf3240c8c0 1 < completed multipart upload key=A02RDP6BA9AC upload=43G4MXFXLOY2 tag=V4X7UEI5MXPM type=write size=1818334 2024-09-19T13:47:40.985 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.980+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=Z2AID5S46VVX type=write size=96277 2024-09-19T13:47:40.988 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.984+0000 7fcf3240c8c0 1 < canceled operation key=X16ENUFL40RN tag=4O3QZ1VMXNCH type=del size=1290429 2024-09-19T13:47:40.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.992+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~CO0NLDUYZAZE.0 size=370855 2024-09-19T13:47:40.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.992+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=CO0NLDUYZAZE tag=007EOZQ578V9 type=write size=1419431 2024-09-19T13:47:40.999 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:40.996+0000 7fcf3240c8c0 1 < completed delete operation key=71Z2VTW99W7J tag=TFNB390XUJ3K type=del 2024-09-19T13:47:41.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.000+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~XXE62WW14WTT.0 size=235200 2024-09-19T13:47:41.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.000+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=XXE62WW14WTT tag=PNJKBJ8XBG8O type=write size=1283776 2024-09-19T13:47:41.005 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.000+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~XNO82S9WYDS5.0 size=1022883 2024-09-19T13:47:41.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.004+0000 7fcf3240c8c0 1 < completed multipart upload key=0UCFTOF1YBBM upload=XNO82S9WYDS5 tag=EGCZ2R6R0W82 type=write size=2071459 2024-09-19T13:47:41.013 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.008+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=PQP3VD67SNUX type=write size=710574 2024-09-19T13:47:41.016 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.012+0000 7fcf3240c8c0 1 < completed write operation key=X16ENUFL40RN tag=NUQ0TWT69U6H type=write size=15396 2024-09-19T13:47:41.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.016+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~H68G4B9IYBA8.0 size=1048576 2024-09-19T13:47:41.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.020+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~H68G4B9IYBA8.1 size=1048576 2024-09-19T13:47:41.025 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.020+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~H68G4B9IYBA8.2 size=495913 2024-09-19T13:47:41.026 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.020+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=H68G4B9IYBA8 tag=5OO8PG579KYR type=write size=3641641 2024-09-19T13:47:41.028 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.024+0000 7fcf3240c8c0 -1 < failed to complete operation key=NP2L28YRVQ8L tag=1WRX48ZOUL0G type=del size=1301928: (22) Invalid argument 2024-09-19T13:47:41.033 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.028+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~IUK2B1WGKXUZ.0 size=1048576 2024-09-19T13:47:41.034 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.032+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~IUK2B1WGKXUZ.1 size=363572 2024-09-19T13:47:41.035 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.032+0000 7fcf3240c8c0 1 > prepared multipart upload key=1BMF3S2BZLLI upload=IUK2B1WGKXUZ tag=BV0UN70GZU2S type=write size=2460724 2024-09-19T13:47:41.037 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.032+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~046AJNW1I7DC.0 size=1048576 2024-09-19T13:47:41.039 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.036+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~046AJNW1I7DC.1 size=1048576 2024-09-19T13:47:41.041 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.036+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~046AJNW1I7DC.2 size=715481 2024-09-19T13:47:41.045 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.040+0000 7fcf3240c8c0 1 < completed multipart upload key=ES62XJO5Q3FO upload=046AJNW1I7DC tag=SLWIL4EZH5ZU type=write size=3861209 2024-09-19T13:47:41.048 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.044+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=BGB8XHDIKCGT type=write size=463216 2024-09-19T13:47:41.050 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.048+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~KUFZEQFGZL0C.0 size=1048576 2024-09-19T13:47:41.052 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.048+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~KUFZEQFGZL0C.1 size=1048576 2024-09-19T13:47:41.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.052+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~KUFZEQFGZL0C.2 size=779262 2024-09-19T13:47:41.058 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.056+0000 7fcf3240c8c0 1 < completed multipart upload key=M2CO4A2DHJ05 upload=KUFZEQFGZL0C tag=4XK5OI5U4Q18 type=write size=3924990 2024-09-19T13:47:41.063 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.060+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~VPPD8UXOM7H4.0 size=162218 2024-09-19T13:47:41.063 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.060+0000 7fcf3240c8c0 1 > prepared multipart upload key=OA9BMSXGYR9T upload=VPPD8UXOM7H4 tag=FG2J53EDTH7K type=write size=1210794 2024-09-19T13:47:41.068 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.064+0000 7fcf3240c8c0 1 < suggested remove operation key=C3TFYNXH549T tag=58CEUGDC1PC3 type=del 2024-09-19T13:47:41.070 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.068+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=J3M375LWH4KN type=del size=1924980 2024-09-19T13:47:41.073 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.068+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~8YKMVAQH3T3F.0 size=1048576 2024-09-19T13:47:41.075 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.072+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~8YKMVAQH3T3F.1 size=1048576 2024-09-19T13:47:41.077 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.072+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~8YKMVAQH3T3F.2 size=34627 2024-09-19T13:47:41.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.076+0000 7fcf3240c8c0 1 < completed multipart upload key=STMT6XU2EJQM upload=8YKMVAQH3T3F tag=AG1G2Y9MDBMY type=write size=3180355 2024-09-19T13:47:41.085 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.080+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~VFPJOUYB541X.0 size=1048576 2024-09-19T13:47:41.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.084+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~VFPJOUYB541X.1 size=1048576 2024-09-19T13:47:41.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.084+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~VFPJOUYB541X.2 size=272676 2024-09-19T13:47:41.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.084+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=VFPJOUYB541X tag=G8TLZI3LLFZI type=write size=3418404 2024-09-19T13:47:41.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.092+0000 7fcf3240c8c0 1 < suggested update operation key=N51Q6HKJSCCB tag=6IBQ630NRIKG type=del size=3836024 2024-09-19T13:47:41.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.096+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~M3DLJ3T5LMPH.0 size=154636 2024-09-19T13:47:41.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.096+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=M3DLJ3T5LMPH tag=ZSP1EVQ50GGP type=write size=1203212 2024-09-19T13:47:41.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.100+0000 7fcf3240c8c0 1 < completed delete operation key=QSM2Q8CW1Q86 tag=FWC05K3Z6DID type=del 2024-09-19T13:47:41.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.104+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~OSYSC8NPBMZ0.0 size=571609 2024-09-19T13:47:41.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.104+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=OSYSC8NPBMZ0 tag=GIKIDELGFE3Q type=write size=1620185 2024-09-19T13:47:41.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.108+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~HGQHMY2UJTE8.0 size=1048576 2024-09-19T13:47:41.116 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.112+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~HGQHMY2UJTE8.1 size=1048576 2024-09-19T13:47:41.119 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.116+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~HGQHMY2UJTE8.2 size=17593 2024-09-19T13:47:41.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.120+0000 7fcf3240c8c0 1 < completed multipart upload key=DHPONKOVS8CT upload=HGQHMY2UJTE8 tag=6XURW1199Y21 type=write size=3163321 2024-09-19T13:47:41.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.128+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~VJTV4OMXGRN8.0 size=1048576 2024-09-19T13:47:41.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.128+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~VJTV4OMXGRN8.1 size=907311 2024-09-19T13:47:41.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.128+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=VJTV4OMXGRN8 tag=46L3RPFDI36Z type=write size=3004463 2024-09-19T13:47:41.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.132+0000 7fcf3240c8c0 1 < completed delete operation key=QSM2Q8CW1Q86 tag=YFBDGHLUVIPG type=del 2024-09-19T13:47:41.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.136+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~TRCT7M7CLXDE.0 size=241629 2024-09-19T13:47:41.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.136+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=TRCT7M7CLXDE tag=G8MZBHV5RAE1 type=write size=1290205 2024-09-19T13:47:41.144 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.140+0000 7fcf3240c8c0 1 < completed delete operation key=1BMF3S2BZLLI tag=KWYLLYT55QKP type=del 2024-09-19T13:47:41.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.144+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~KVB45LWRR4CV.0 size=890021 2024-09-19T13:47:41.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.144+0000 7fcf3240c8c0 1 > prepared multipart upload key=V8X0VBBNK83J upload=KVB45LWRR4CV tag=6ZXAXV1O3ULD type=write size=1938597 2024-09-19T13:47:41.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.148+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~0Q25YF03ZSI0.0 size=1048576 2024-09-19T13:47:41.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.148+0000 7fcf3240c8c0 1 < canceled part key=_multipart_QSM2Q8CW1Q86.2~0Q25YF03ZSI0.1 size=1046829 2024-09-19T13:47:41.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.152+0000 7fcf3240c8c0 1 < canceled multipart upload key=QSM2Q8CW1Q86 upload=0Q25YF03ZSI0 tag=IY7Z7OT1I7YU type=write size=3143981 2024-09-19T13:47:41.159 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.156+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=RJPO43DKVN8Y type=del size=4076068 2024-09-19T13:47:41.162 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.156+0000 7fcf3240c8c0 1 < completed write operation key=STMT6XU2EJQM tag=Z2AID5S46VVX type=write size=96277 2024-09-19T13:47:41.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.160+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=0JEG50S28VHF type=del size=3744621 2024-09-19T13:47:41.167 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.164+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~CO0NLDUYZAZE.0 size=370855 2024-09-19T13:47:41.171 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.168+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=CO0NLDUYZAZE tag=007EOZQ578V9 type=write size=1419431 2024-09-19T13:47:41.174 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.168+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=EEV3UKGYENQY type=del size=3931278 2024-09-19T13:47:41.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.172+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~XXE62WW14WTT.0 size=235200 2024-09-19T13:47:41.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.176+0000 7fcf3240c8c0 1 < completed multipart upload key=QAYJ5B1KZ08J upload=XXE62WW14WTT tag=PNJKBJ8XBG8O type=write size=1283776 2024-09-19T13:47:41.184 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.180+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=TRXZNNJUVB2N type=del size=3753728 2024-09-19T13:47:41.189 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.184+0000 7fcf3240c8c0 1 < suggested update operation key=D1RMXGXS3O7Z tag=PQP3VD67SNUX type=write size=710574 2024-09-19T13:47:41.191 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.188+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=9KQ8I1SP7J9W type=del size=1588779 2024-09-19T13:47:41.194 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.188+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~H68G4B9IYBA8.0 size=1048576 2024-09-19T13:47:41.196 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.192+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~H68G4B9IYBA8.1 size=1048576 2024-09-19T13:47:41.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.192+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~H68G4B9IYBA8.2 size=495913 2024-09-19T13:47:41.202 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.196+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=H68G4B9IYBA8 tag=5OO8PG579KYR type=write size=3641641 2024-09-19T13:47:41.207 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.204+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~T2SIM8UZ8BC9.0 size=689258 2024-09-19T13:47:41.207 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.204+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=T2SIM8UZ8BC9 tag=6LEBO1V8ZO8V type=write size=1737834 2024-09-19T13:47:41.207 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.204+0000 7fcf3240c8c0 1 < canceled part key=_multipart_1BMF3S2BZLLI.2~IUK2B1WGKXUZ.0 size=1048576 2024-09-19T13:47:41.209 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.204+0000 7fcf3240c8c0 1 < completed part key=_multipart_1BMF3S2BZLLI.2~IUK2B1WGKXUZ.1 size=363572 2024-09-19T13:47:41.213 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.208+0000 7fcf3240c8c0 1 < canceled multipart upload key=1BMF3S2BZLLI upload=IUK2B1WGKXUZ tag=BV0UN70GZU2S type=write size=2460724 2024-09-19T13:47:41.216 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.212+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=DB139E1ULVGN type=del size=2983662 2024-09-19T13:47:41.219 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.216+0000 7fcf3240c8c0 1 < completed write operation key=X9FGPMP30X47 tag=BGB8XHDIKCGT type=write size=463216 2024-09-19T13:47:41.221 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.216+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=IPMDTLSS4ACW type=write size=889482 2024-09-19T13:47:41.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.220+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~VPPD8UXOM7H4.0 size=162218 2024-09-19T13:47:41.228 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.224+0000 7fcf3240c8c0 1 < completed multipart upload key=OA9BMSXGYR9T upload=VPPD8UXOM7H4 tag=FG2J53EDTH7K type=write size=1210794 2024-09-19T13:47:41.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.228+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~CIMJGE3L1RKR.0 size=1048576 2024-09-19T13:47:41.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.228+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~CIMJGE3L1RKR.1 size=1048576 2024-09-19T13:47:41.239 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.236+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~CIMJGE3L1RKR.2 size=214074 2024-09-19T13:47:41.239 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.236+0000 7fcf3240c8c0 1 > prepared multipart upload key=STMT6XU2EJQM upload=CIMJGE3L1RKR tag=MYGQRBS1C0T1 type=write size=3359802 2024-09-19T13:47:41.241 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.236+0000 7fcf3240c8c0 1 < completed delete operation key=X9FGPMP30X47 tag=J3M375LWH4KN type=del 2024-09-19T13:47:41.244 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.240+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=HC1IC4BQREMA type=del size=2152641 2024-09-19T13:47:41.245 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.240+0000 7fcf3240c8c0 1 < canceled part key=_multipart_ZCKKQ1R8318S.2~VFPJOUYB541X.0 size=1048576 2024-09-19T13:47:41.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.244+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~VFPJOUYB541X.1 size=1048576 2024-09-19T13:47:41.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.244+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~VFPJOUYB541X.2 size=272676 2024-09-19T13:47:41.252 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.248+0000 7fcf3240c8c0 1 < canceled multipart upload key=ZCKKQ1R8318S upload=VFPJOUYB541X tag=G8TLZI3LLFZI type=write size=3418404 2024-09-19T13:47:41.254 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.252+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=0TG32HZ8HZZS type=del size=2022696 2024-09-19T13:47:41.256 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.252+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~M3DLJ3T5LMPH.0 size=154636 2024-09-19T13:47:41.260 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.256+0000 7fcf3240c8c0 1 < completed multipart upload key=AES54TJK7VH7 upload=M3DLJ3T5LMPH tag=ZSP1EVQ50GGP type=write size=1203212 2024-09-19T13:47:41.263 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.260+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=1WNL6Z31OZRF type=del size=792016 2024-09-19T13:47:41.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.260+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~OSYSC8NPBMZ0.0 size=571609 2024-09-19T13:47:41.268 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.264+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=OSYSC8NPBMZ0 tag=GIKIDELGFE3Q type=write size=1620185 2024-09-19T13:47:41.274 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.268+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~BYHNZK7CNYUV.0 size=187603 2024-09-19T13:47:41.274 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.268+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=BYHNZK7CNYUV tag=NW22LAQ6W996 type=write size=1236179 2024-09-19T13:47:41.276 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.272+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~VJTV4OMXGRN8.0 size=1048576 2024-09-19T13:47:41.278 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.272+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~VJTV4OMXGRN8.1 size=907311 2024-09-19T13:47:41.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.280+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=VJTV4OMXGRN8 tag=46L3RPFDI36Z type=write size=3004463 2024-09-19T13:47:41.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.280+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=4M1J4BTQK5QJ type=del size=515056 2024-09-19T13:47:41.287 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.284+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~TRCT7M7CLXDE.0 size=241629 2024-09-19T13:47:41.291 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.288+0000 7fcf3240c8c0 1 < completed multipart upload key=XE42LV5M5X82 upload=TRCT7M7CLXDE tag=G8MZBHV5RAE1 type=write size=1290205 2024-09-19T13:47:41.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.292+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~RFJSHRBAYE6O.0 size=1048576 2024-09-19T13:47:41.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.292+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~RFJSHRBAYE6O.1 size=652093 2024-09-19T13:47:41.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.292+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=RFJSHRBAYE6O tag=9UCDRP4G11SM type=write size=2749245 2024-09-19T13:47:41.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.296+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~KVB45LWRR4CV.0 size=890021 2024-09-19T13:47:41.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.300+0000 7fcf3240c8c0 1 < completed multipart upload key=V8X0VBBNK83J upload=KVB45LWRR4CV tag=6ZXAXV1O3ULD type=write size=1938597 2024-09-19T13:47:41.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.300+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=7NT28SHYEODC type=del size=3575791 2024-09-19T13:47:41.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.304+0000 7fcf3240c8c0 1 < completed delete operation key=6DFF2OCPT9W2 tag=RJPO43DKVN8Y type=del 2024-09-19T13:47:41.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.312+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~XOR8GW7JFIC3.0 size=540851 2024-09-19T13:47:41.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.312+0000 7fcf3240c8c0 1 > prepared multipart upload key=DHPONKOVS8CT upload=XOR8GW7JFIC3 tag=K6BF3FV3YZFO type=write size=1589427 2024-09-19T13:47:41.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.316+0000 7fcf3240c8c0 1 < completed delete operation key=7UC85R2HO9K2 tag=0JEG50S28VHF type=del 2024-09-19T13:47:41.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.320+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=IRG38DZ2VKKS type=write size=12409 2024-09-19T13:47:41.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.324+0000 7fcf3240c8c0 1 < completed delete operation key=XE42LV5M5X82 tag=EEV3UKGYENQY type=del 2024-09-19T13:47:41.332 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.328+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~T19820USF0Z1.0 size=1048576 2024-09-19T13:47:41.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.332+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~T19820USF0Z1.1 size=293064 2024-09-19T13:47:41.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.332+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=T19820USF0Z1 tag=IB349Q2T11U2 type=write size=2390216 2024-09-19T13:47:41.342 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.340+0000 7fcf3240c8c0 1 < suggested update operation key=ZCKKQ1R8318S tag=TRXZNNJUVB2N type=del size=3753728 2024-09-19T13:47:41.346 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.340+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=DZ2VFE0XQWWM type=del size=2197600 2024-09-19T13:47:41.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.344+0000 7fcf3240c8c0 1 < completed delete operation key=C35EUAOWLBR3 tag=9KQ8I1SP7J9W type=del 2024-09-19T13:47:41.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.348+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=PPW11MOMYR6M type=del size=395342 2024-09-19T13:47:41.353 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.348+0000 7fcf3240c8c0 1 < canceled part key=_multipart_M2CO4A2DHJ05.2~T2SIM8UZ8BC9.0 size=689258 2024-09-19T13:47:41.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.356+0000 7fcf3240c8c0 1 < canceled multipart upload key=M2CO4A2DHJ05 upload=T2SIM8UZ8BC9 tag=6LEBO1V8ZO8V type=write size=1737834 2024-09-19T13:47:41.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.360+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~H5HVKMD6L7HV.0 size=701402 2024-09-19T13:47:41.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.360+0000 7fcf3240c8c0 1 > prepared multipart upload key=X16ENUFL40RN upload=H5HVKMD6L7HV tag=GPER76A2QZG1 type=write size=1749978 2024-09-19T13:47:41.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.364+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=DB139E1ULVGN type=del 2024-09-19T13:47:41.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.368+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=T46BGH1EXCTY type=del size=2540012 2024-09-19T13:47:41.377 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.372+0000 7fcf3240c8c0 1 < suggested remove operation key=71Z2VTW99W7J tag=IPMDTLSS4ACW type=write 2024-09-19T13:47:41.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.376+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=2INFVBKNXRAE type=write size=857911 2024-09-19T13:47:41.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.376+0000 7fcf3240c8c0 1 < canceled part key=_multipart_STMT6XU2EJQM.2~CIMJGE3L1RKR.0 size=1048576 2024-09-19T13:47:41.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.380+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~CIMJGE3L1RKR.1 size=1048576 2024-09-19T13:47:41.387 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.384+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~CIMJGE3L1RKR.2 size=214074 2024-09-19T13:47:41.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.388+0000 7fcf3240c8c0 1 < canceled multipart upload key=STMT6XU2EJQM upload=CIMJGE3L1RKR tag=MYGQRBS1C0T1 type=write size=3359802 2024-09-19T13:47:41.395 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.392+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=91LADWQYWVCR type=del size=3776558 2024-09-19T13:47:41.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.396+0000 7fcf3240c8c0 1 < completed delete operation key=0UCFTOF1YBBM tag=HC1IC4BQREMA type=del 2024-09-19T13:47:41.402 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.400+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=ORFT95VVAALK type=write size=309771 2024-09-19T13:47:41.405 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.400+0000 7fcf3240c8c0 1 < completed delete operation key=X9FGPMP30X47 tag=0TG32HZ8HZZS type=del 2024-09-19T13:47:41.408 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.404+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=SP9Q3X6AYBYP type=del size=3261160 2024-09-19T13:47:41.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.408+0000 7fcf3240c8c0 1 < suggested remove operation key=3TME221SA53E tag=1WNL6Z31OZRF type=del 2024-09-19T13:47:41.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.416+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~REAKTVI8Z1HK.0 size=1048576 2024-09-19T13:47:41.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.416+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~REAKTVI8Z1HK.1 size=931158 2024-09-19T13:47:41.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.416+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=REAKTVI8Z1HK tag=N5AMXLDS8VNA type=write size=3028310 2024-09-19T13:47:41.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.416+0000 7fcf3240c8c0 1 < canceled part key=_multipart_D20C6C2ZFX1W.2~BYHNZK7CNYUV.0 size=187603 2024-09-19T13:47:41.427 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.424+0000 7fcf3240c8c0 1 < canceled multipart upload key=D20C6C2ZFX1W upload=BYHNZK7CNYUV tag=NW22LAQ6W996 type=write size=1236179 2024-09-19T13:47:41.432 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.428+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~MUTYY02YIVPX.0 size=511327 2024-09-19T13:47:41.432 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.428+0000 7fcf3240c8c0 1 > prepared multipart upload key=C8T6DB9V9FBT upload=MUTYY02YIVPX tag=IVKV5CIJ0XBP type=write size=1559903 2024-09-19T13:47:41.436 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.432+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=4M1J4BTQK5QJ type=del 2024-09-19T13:47:41.440 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.436+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~ZJJWCHLAJXYY.0 size=1048576 2024-09-19T13:47:41.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.440+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~ZJJWCHLAJXYY.1 size=1048576 2024-09-19T13:47:41.445 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.440+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~ZJJWCHLAJXYY.2 size=248615 2024-09-19T13:47:41.445 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.440+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=ZJJWCHLAJXYY tag=JLG64G2VEGNI type=write size=3394343 2024-09-19T13:47:41.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.444+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~RFJSHRBAYE6O.0 size=1048576 2024-09-19T13:47:41.450 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.444+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~RFJSHRBAYE6O.1 size=652093 2024-09-19T13:47:41.455 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.452+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=RFJSHRBAYE6O tag=9UCDRP4G11SM type=write size=2749245 2024-09-19T13:47:41.459 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.456+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~AV4HD7GKD3WP.0 size=1048576 2024-09-19T13:47:41.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.456+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~AV4HD7GKD3WP.1 size=983327 2024-09-19T13:47:41.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.456+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=AV4HD7GKD3WP tag=KYU2P41ZMUED type=write size=3080479 2024-09-19T13:47:41.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.460+0000 7fcf3240c8c0 1 < completed delete operation key=0UCFTOF1YBBM tag=7NT28SHYEODC type=del 2024-09-19T13:47:41.470 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.468+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~WKRP61QGD3ZM.0 size=1048576 2024-09-19T13:47:41.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.468+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~WKRP61QGD3ZM.1 size=1048576 2024-09-19T13:47:41.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.472+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~WKRP61QGD3ZM.2 size=339961 2024-09-19T13:47:41.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.472+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=WKRP61QGD3ZM tag=DP01GKE4Q3RD type=write size=3485689 2024-09-19T13:47:41.479 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.476+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~XOR8GW7JFIC3.0 size=540851 2024-09-19T13:47:41.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.480+0000 7fcf3240c8c0 1 < completed multipart upload key=DHPONKOVS8CT upload=XOR8GW7JFIC3 tag=K6BF3FV3YZFO type=write size=1589427 2024-09-19T13:47:41.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.484+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=0GIHH2FPAL64 type=del size=2698192 2024-09-19T13:47:41.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.484+0000 7fcf3240c8c0 1 < completed write operation key=X9FGPMP30X47 tag=IRG38DZ2VKKS type=write size=12409 2024-09-19T13:47:41.495 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.492+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~UCEPLDV1W3JK.0 size=593732 2024-09-19T13:47:41.495 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.492+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=UCEPLDV1W3JK tag=SYLLGZ7N2QLT type=write size=1642308 2024-09-19T13:47:41.495 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.492+0000 7fcf3240c8c0 1 < canceled part key=_multipart_QSM2Q8CW1Q86.2~T19820USF0Z1.0 size=1048576 2024-09-19T13:47:41.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.492+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~T19820USF0Z1.1 size=293064 2024-09-19T13:47:41.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.496+0000 7fcf3240c8c0 1 < canceled multipart upload key=QSM2Q8CW1Q86 upload=T19820USF0Z1 tag=IB349Q2T11U2 type=write size=2390216 2024-09-19T13:47:41.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.504+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~CMNIP0L0XM2D.0 size=1048576 2024-09-19T13:47:41.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.508+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~CMNIP0L0XM2D.1 size=10053 2024-09-19T13:47:41.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.508+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=CMNIP0L0XM2D tag=6H2L59IP4K6S type=write size=2107205 2024-09-19T13:47:41.518 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.512+0000 7fcf3240c8c0 1 < suggested remove operation key=C8T6DB9V9FBT tag=DZ2VFE0XQWWM type=del 2024-09-19T13:47:41.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.516+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=B4HCOT2XWRQT type=del size=1159174 2024-09-19T13:47:41.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.520+0000 7fcf3240c8c0 1 < completed delete operation key=0UCFTOF1YBBM tag=PPW11MOMYR6M type=del 2024-09-19T13:47:41.527 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.524+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=T1UVU36X8I1L type=write size=224228 2024-09-19T13:47:41.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.524+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~H5HVKMD6L7HV.0 size=701402 2024-09-19T13:47:41.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.528+0000 7fcf3240c8c0 1 < completed multipart upload key=X16ENUFL40RN upload=H5HVKMD6L7HV tag=GPER76A2QZG1 type=write size=1749978 2024-09-19T13:47:41.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.532+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=B0GQNP9F0ON1 type=del size=518557 2024-09-19T13:47:41.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.536+0000 7fcf3240c8c0 1 < completed delete operation key=HXMZKP7H3HJE tag=T46BGH1EXCTY type=del 2024-09-19T13:47:41.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.540+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~63VG92WJN4YG.0 size=1048576 2024-09-19T13:47:41.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.544+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~63VG92WJN4YG.1 size=220640 2024-09-19T13:47:41.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.544+0000 7fcf3240c8c0 1 > prepared multipart upload key=1BMF3S2BZLLI upload=63VG92WJN4YG tag=SATIX6U90RN7 type=write size=2317792 2024-09-19T13:47:41.549 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.544+0000 7fcf3240c8c0 1 < completed write operation key=7UC85R2HO9K2 tag=2INFVBKNXRAE type=write size=857911 2024-09-19T13:47:41.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.552+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~9OXFMOWXKN8L.0 size=538037 2024-09-19T13:47:41.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.552+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=9OXFMOWXKN8L tag=SAUDL7JJ24BC type=write size=1586613 2024-09-19T13:47:41.557 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.552+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=91LADWQYWVCR type=del 2024-09-19T13:47:41.562 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.560+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~DKHBL0I8HD90.0 size=1048576 2024-09-19T13:47:41.564 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.560+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~DKHBL0I8HD90.1 size=1048576 2024-09-19T13:47:41.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.560+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~DKHBL0I8HD90.2 size=490066 2024-09-19T13:47:41.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.560+0000 7fcf3240c8c0 1 > prepared multipart upload key=C3TFYNXH549T upload=DKHBL0I8HD90 tag=EE0ECM5Y0ZZ0 type=write size=3635794 2024-09-19T13:47:41.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.564+0000 7fcf3240c8c0 1 < completed write operation key=OA9BMSXGYR9T tag=ORFT95VVAALK type=write size=309771 2024-09-19T13:47:41.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.568+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=HYY6ND05CPNX type=write size=752630 2024-09-19T13:47:41.574 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.568+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=SP9Q3X6AYBYP type=del 2024-09-19T13:47:41.577 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.572+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=GT3I1N71MZ8C type=del size=3767089 2024-09-19T13:47:41.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.576+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~REAKTVI8Z1HK.0 size=1048576 2024-09-19T13:47:41.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.576+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~REAKTVI8Z1HK.1 size=931158 2024-09-19T13:47:41.586 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.584+0000 7fcf3240c8c0 1 < completed multipart upload key=M2CO4A2DHJ05 upload=REAKTVI8Z1HK tag=N5AMXLDS8VNA type=write size=3028310 2024-09-19T13:47:41.591 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.588+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~K6NISFDQ0IUG.0 size=178432 2024-09-19T13:47:41.591 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.588+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=K6NISFDQ0IUG tag=GAMC3VJ7ME2C type=write size=1227008 2024-09-19T13:47:41.594 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.588+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~MUTYY02YIVPX.0 size=511327 2024-09-19T13:47:41.598 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.596+0000 7fcf3240c8c0 1 < completed multipart upload key=C8T6DB9V9FBT upload=MUTYY02YIVPX tag=IVKV5CIJ0XBP type=write size=1559903 2024-09-19T13:47:41.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.596+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=6V3OCD80QPQ7 type=del size=1315019 2024-09-19T13:47:41.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.600+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~ZJJWCHLAJXYY.0 size=1048576 2024-09-19T13:47:41.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.600+0000 7fcf3240c8c0 1 < canceled part key=_multipart_N51Q6HKJSCCB.2~ZJJWCHLAJXYY.1 size=1048576 2024-09-19T13:47:41.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.604+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~ZJJWCHLAJXYY.2 size=248615 2024-09-19T13:47:41.611 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.608+0000 7fcf3240c8c0 1 < canceled multipart upload key=N51Q6HKJSCCB upload=ZJJWCHLAJXYY tag=JLG64G2VEGNI type=write size=3394343 2024-09-19T13:47:41.614 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.608+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=ANB21FOZQPSW type=del size=1762485 2024-09-19T13:47:41.616 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.612+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~AV4HD7GKD3WP.0 size=1048576 2024-09-19T13:47:41.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.616+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~AV4HD7GKD3WP.1 size=983327 2024-09-19T13:47:41.624 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.620+0000 7fcf3240c8c0 1 < completed multipart upload key=D20C6C2ZFX1W upload=AV4HD7GKD3WP tag=KYU2P41ZMUED type=write size=3080479 2024-09-19T13:47:41.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.624+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~CAW5NDVDC215.0 size=1048576 2024-09-19T13:47:41.630 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.628+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~CAW5NDVDC215.1 size=647079 2024-09-19T13:47:41.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.628+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=CAW5NDVDC215 tag=71A1JEJCP9MB type=write size=2744231 2024-09-19T13:47:41.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.628+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~WKRP61QGD3ZM.0 size=1048576 2024-09-19T13:47:41.635 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.632+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~WKRP61QGD3ZM.1 size=1048576 2024-09-19T13:47:41.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.632+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~WKRP61QGD3ZM.2 size=339961 2024-09-19T13:47:41.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.636+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=WKRP61QGD3ZM tag=DP01GKE4Q3RD type=write size=3485689 2024-09-19T13:47:41.645 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.640+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=O30TPKQA13PH type=del size=1401016 2024-09-19T13:47:41.647 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.644+0000 7fcf3240c8c0 1 < canceled operation key=71Z2VTW99W7J tag=0GIHH2FPAL64 type=del size=2698192 2024-09-19T13:47:41.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.648+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~4NGEF2FAHVU7.0 size=463186 2024-09-19T13:47:41.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.648+0000 7fcf3240c8c0 1 > prepared multipart upload key=3TME221SA53E upload=4NGEF2FAHVU7 tag=GGS6Y7CD31OV type=write size=1511762 2024-09-19T13:47:41.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.652+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~UCEPLDV1W3JK.0 size=593732 2024-09-19T13:47:41.660 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.656+0000 7fcf3240c8c0 1 < completed multipart upload key=NP2L28YRVQ8L upload=UCEPLDV1W3JK tag=SYLLGZ7N2QLT type=write size=1642308 2024-09-19T13:47:41.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.660+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~YI0TGUDN2A59.0 size=1048576 2024-09-19T13:47:41.666 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.664+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~YI0TGUDN2A59.1 size=1048576 2024-09-19T13:47:41.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.664+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~YI0TGUDN2A59.2 size=455952 2024-09-19T13:47:41.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.664+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=YI0TGUDN2A59 tag=4OPV5AX40WA5 type=write size=3601680 2024-09-19T13:47:41.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.668+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~CMNIP0L0XM2D.0 size=1048576 2024-09-19T13:47:41.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.668+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~CMNIP0L0XM2D.1 size=10053 2024-09-19T13:47:41.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.672+0000 7fcf3240c8c0 1 < completed multipart upload key=QAYJ5B1KZ08J upload=CMNIP0L0XM2D tag=6H2L59IP4K6S type=write size=2107205 2024-09-19T13:47:41.682 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.680+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~KL5BPITOTSUC.0 size=1048576 2024-09-19T13:47:41.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.680+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~KL5BPITOTSUC.1 size=362058 2024-09-19T13:47:41.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.680+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=KL5BPITOTSUC tag=TB8VI44MRM2U type=write size=2459210 2024-09-19T13:47:41.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.684+0000 7fcf3240c8c0 1 < canceled operation key=7UC85R2HO9K2 tag=B4HCOT2XWRQT type=del size=1159174 2024-09-19T13:47:41.690 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.684+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=FS9ODM2LZ8R0 type=write size=105338 2024-09-19T13:47:41.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.692+0000 7fcf3240c8c0 1 < suggested remove operation key=0U9BUX9DHTAK tag=T1UVU36X8I1L type=write 2024-09-19T13:47:41.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.692+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=K2KKNELQVLHI type=del size=3942350 2024-09-19T13:47:41.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.696+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=B0GQNP9F0ON1 type=del 2024-09-19T13:47:41.704 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.700+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=6YSARKJ7QI52 type=write size=350757 2024-09-19T13:47:41.707 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.704+0000 7fcf3240c8c0 1 < completed part key=_multipart_1BMF3S2BZLLI.2~63VG92WJN4YG.0 size=1048576 2024-09-19T13:47:41.709 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.704+0000 7fcf3240c8c0 1 < completed part key=_multipart_1BMF3S2BZLLI.2~63VG92WJN4YG.1 size=220640 2024-09-19T13:47:41.714 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.712+0000 7fcf3240c8c0 1 < completed multipart upload key=1BMF3S2BZLLI upload=63VG92WJN4YG tag=SATIX6U90RN7 type=write size=2317792 2024-09-19T13:47:41.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.716+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~55R84ERVW1J1.0 size=851052 2024-09-19T13:47:41.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.716+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=55R84ERVW1J1 tag=QY7D0WCTW92G type=write size=1899628 2024-09-19T13:47:41.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.720+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~9OXFMOWXKN8L.0 size=538037 2024-09-19T13:47:41.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.724+0000 7fcf3240c8c0 1 < completed multipart upload key=N51Q6HKJSCCB upload=9OXFMOWXKN8L tag=SAUDL7JJ24BC type=write size=1586613 2024-09-19T13:47:41.732 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.728+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=5F6VSGR3D0F3 type=del size=3923010 2024-09-19T13:47:41.735 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.732+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~DKHBL0I8HD90.0 size=1048576 2024-09-19T13:47:41.737 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.732+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~DKHBL0I8HD90.1 size=1048576 2024-09-19T13:47:41.740 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.736+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~DKHBL0I8HD90.2 size=490066 2024-09-19T13:47:41.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.740+0000 7fcf3240c8c0 1 < completed multipart upload key=C3TFYNXH549T upload=DKHBL0I8HD90 tag=EE0ECM5Y0ZZ0 type=write size=3635794 2024-09-19T13:47:41.748 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.744+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=RD74A1R0L2LO type=del size=2379374 2024-09-19T13:47:41.751 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.748+0000 7fcf3240c8c0 1 < completed write operation key=QSM2Q8CW1Q86 tag=HYY6ND05CPNX type=write size=752630 2024-09-19T13:47:41.754 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.752+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=JGC6YLP2Z6E3 type=del size=510461 2024-09-19T13:47:41.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.752+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=GT3I1N71MZ8C type=del 2024-09-19T13:47:41.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.756+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=3P15Y57DUW4Z type=del size=1112332 2024-09-19T13:47:41.768 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.764+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~K6NISFDQ0IUG.0 size=178432 2024-09-19T13:47:41.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.768+0000 7fcf3240c8c0 1 < completed multipart upload key=ZCKKQ1R8318S upload=K6NISFDQ0IUG tag=GAMC3VJ7ME2C type=write size=1227008 2024-09-19T13:47:41.779 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.776+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~Z9GKKMTFSTF1.0 size=265518 2024-09-19T13:47:41.779 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.776+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=Z9GKKMTFSTF1 tag=WUMX8N82B22L type=write size=1314094 2024-09-19T13:47:41.782 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.776+0000 7fcf3240c8c0 1 < completed delete operation key=D1RMXGXS3O7Z tag=6V3OCD80QPQ7 type=del 2024-09-19T13:47:41.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.780+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=2KFCZQ8XUEQ3 type=del size=3972835 2024-09-19T13:47:41.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.784+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=ANB21FOZQPSW type=del 2024-09-19T13:47:41.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.788+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=VCGQKJMOBAK0 type=del size=14704 2024-09-19T13:47:41.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.792+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~CAW5NDVDC215.0 size=1048576 2024-09-19T13:47:41.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.792+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~CAW5NDVDC215.1 size=647079 2024-09-19T13:47:41.803 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.800+0000 7fcf3240c8c0 1 < completed multipart upload key=ZCKKQ1R8318S upload=CAW5NDVDC215 tag=71A1JEJCP9MB type=write size=2744231 2024-09-19T13:47:41.807 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.804+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=20F4UYQCPL6J type=del size=3355862 2024-09-19T13:47:41.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.804+0000 7fcf3240c8c0 1 < canceled operation key=AES54TJK7VH7 tag=O30TPKQA13PH type=del size=1401016 2024-09-19T13:47:41.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.808+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=0Z3M6AFP3DJF type=del size=1063142 2024-09-19T13:47:41.817 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.812+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~4NGEF2FAHVU7.0 size=463186 2024-09-19T13:47:41.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.820+0000 7fcf3240c8c0 1 < completed multipart upload key=3TME221SA53E upload=4NGEF2FAHVU7 tag=GGS6Y7CD31OV type=write size=1511762 2024-09-19T13:47:41.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.820+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=0DJYL5NQY5C9 type=del size=1468780 2024-09-19T13:47:41.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.824+0000 7fcf3240c8c0 1 < canceled part key=_multipart_AES54TJK7VH7.2~YI0TGUDN2A59.0 size=1048576 2024-09-19T13:47:41.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.824+0000 7fcf3240c8c0 1 < canceled part key=_multipart_AES54TJK7VH7.2~YI0TGUDN2A59.1 size=1048576 2024-09-19T13:47:41.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.824+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~YI0TGUDN2A59.2 size=455952 2024-09-19T13:47:41.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.832+0000 7fcf3240c8c0 1 < canceled multipart upload key=AES54TJK7VH7 upload=YI0TGUDN2A59 tag=4OPV5AX40WA5 type=write size=3601680 2024-09-19T13:47:41.838 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.832+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=SXTZBE1GN0JX type=del size=2412617 2024-09-19T13:47:41.841 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.836+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~KL5BPITOTSUC.0 size=1048576 2024-09-19T13:47:41.844 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.840+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~KL5BPITOTSUC.1 size=362058 2024-09-19T13:47:41.849 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.844+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=KL5BPITOTSUC tag=TB8VI44MRM2U type=write size=2459210 2024-09-19T13:47:41.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.848+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=UZIT01XEKRJB type=del size=2207154 2024-09-19T13:47:41.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.852+0000 7fcf3240c8c0 1 < canceled operation key=OA9BMSXGYR9T tag=FS9ODM2LZ8R0 type=write size=105338 2024-09-19T13:47:41.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.856+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=99I8LNLUL1SE type=write size=252140 2024-09-19T13:47:41.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.856+0000 7fcf3240c8c0 1 < completed delete operation key=V8X0VBBNK83J tag=K2KKNELQVLHI type=del 2024-09-19T13:47:41.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.860+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=65JVE5ICVYNJ type=del size=1111179 2024-09-19T13:47:41.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.864+0000 7fcf3240c8c0 1 < completed write operation key=ES62XJO5Q3FO tag=6YSARKJ7QI52 type=write size=350757 2024-09-19T13:47:41.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.868+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=BQXZHGLW4I36 type=del size=2378886 2024-09-19T13:47:41.875 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.872+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~55R84ERVW1J1.0 size=851052 2024-09-19T13:47:41.880 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.876+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=55R84ERVW1J1 tag=QY7D0WCTW92G type=write size=1899628 2024-09-19T13:47:41.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.880+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=W7ZONRUSIHFG type=del size=3303877 2024-09-19T13:47:41.892 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.884+0000 7fcf3240c8c0 1 < suggested update operation key=A02RDP6BA9AC tag=5F6VSGR3D0F3 type=del size=3923010 2024-09-19T13:47:41.892 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.888+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=8GOVMJG6CPXW type=del size=2929356 2024-09-19T13:47:41.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.896+0000 7fcf3240c8c0 1 < suggested remove operation key=M2CO4A2DHJ05 tag=RD74A1R0L2LO type=del 2024-09-19T13:47:41.904 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.900+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~8O1VAYA8KC0D.0 size=361331 2024-09-19T13:47:41.904 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.900+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=8O1VAYA8KC0D tag=EUXFUP6I05PT type=write size=1409907 2024-09-19T13:47:41.907 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.904+0000 7fcf3240c8c0 1 < completed delete operation key=0U9BUX9DHTAK tag=JGC6YLP2Z6E3 type=del 2024-09-19T13:47:41.910 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.904+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=W78O9KBVJN2B type=del size=1806805 2024-09-19T13:47:41.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.908+0000 7fcf3240c8c0 1 < completed delete operation key=N51Q6HKJSCCB tag=3P15Y57DUW4Z type=del 2024-09-19T13:47:41.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.912+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=82V0ZI4EYLAS type=del size=645823 2024-09-19T13:47:41.920 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.916+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~Z9GKKMTFSTF1.0 size=265518 2024-09-19T13:47:41.926 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.920+0000 7fcf3240c8c0 1 < completed multipart upload key=AES54TJK7VH7 upload=Z9GKKMTFSTF1 tag=WUMX8N82B22L type=write size=1314094 2024-09-19T13:47:41.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.928+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~2N9ZGF01CH3T.0 size=889297 2024-09-19T13:47:41.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.928+0000 7fcf3240c8c0 1 > prepared multipart upload key=C3TFYNXH549T upload=2N9ZGF01CH3T tag=5GUTB7MYHNAG type=write size=1937873 2024-09-19T13:47:41.935 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.932+0000 7fcf3240c8c0 1 < canceled operation key=D1RMXGXS3O7Z tag=2KFCZQ8XUEQ3 type=del size=3972835 2024-09-19T13:47:41.938 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.936+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=ZFMISXW3CHFU type=del size=4125248 2024-09-19T13:47:41.941 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.936+0000 7fcf3240c8c0 1 < completed delete operation key=XE42LV5M5X82 tag=VCGQKJMOBAK0 type=del 2024-09-19T13:47:41.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.940+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=QFH144EAB98I type=del size=2788224 2024-09-19T13:47:41.948 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.944+0000 7fcf3240c8c0 1 < completed delete operation key=C8T6DB9V9FBT tag=20F4UYQCPL6J type=del 2024-09-19T13:47:41.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.948+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=AJ958B0PVBAG type=del size=1041739 2024-09-19T13:47:41.958 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.952+0000 7fcf3240c8c0 1 < suggested update operation key=D20C6C2ZFX1W tag=0Z3M6AFP3DJF type=del size=1063142 2024-09-19T13:47:41.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.956+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=3KI0UMYWEOX3 type=del size=90714 2024-09-19T13:47:41.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.960+0000 7fcf3240c8c0 1 < completed delete operation key=STMT6XU2EJQM tag=0DJYL5NQY5C9 type=del 2024-09-19T13:47:41.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.964+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=L3HYBQMG1Q8L type=del size=2775733 2024-09-19T13:47:41.971 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.968+0000 7fcf3240c8c0 1 < completed delete operation key=X16ENUFL40RN tag=SXTZBE1GN0JX type=del 2024-09-19T13:47:41.974 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.968+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=IBZIGLVN7DDS type=del size=1408270 2024-09-19T13:47:41.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.972+0000 7fcf3240c8c0 1 < canceled operation key=QMSDNKYFFK1F tag=UZIT01XEKRJB type=del size=2207154 2024-09-19T13:47:41.982 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.976+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~0E1RNSG41OGL.0 size=749168 2024-09-19T13:47:41.982 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.976+0000 7fcf3240c8c0 1 > prepared multipart upload key=1BMF3S2BZLLI upload=0E1RNSG41OGL tag=IPTTN57LV0SI type=write size=1797744 2024-09-19T13:47:41.985 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.980+0000 7fcf3240c8c0 1 < completed write operation key=NP2L28YRVQ8L tag=99I8LNLUL1SE type=write size=252140 2024-09-19T13:47:41.988 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.984+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=GX7G26IPC1OT type=del size=2800773 2024-09-19T13:47:41.991 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.988+0000 7fcf3240c8c0 1 < canceled operation key=QSM2Q8CW1Q86 tag=65JVE5ICVYNJ type=del size=1111179 2024-09-19T13:47:41.996 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.992+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~TEK9DIABXX25.0 size=1037638 2024-09-19T13:47:41.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.992+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=TEK9DIABXX25 tag=I3QY60QMRMSN type=write size=2086214 2024-09-19T13:47:42.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:41.996+0000 7fcf3240c8c0 1 < completed delete operation key=DHPONKOVS8CT tag=BQXZHGLW4I36 type=del 2024-09-19T13:47:42.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.000+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=UOVTFJ3FSY5V type=del size=2262269 2024-09-19T13:47:42.006 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.004+0000 7fcf3240c8c0 1 < completed delete operation key=ZCKKQ1R8318S tag=W7ZONRUSIHFG type=del 2024-09-19T13:47:42.012 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.008+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~VYB8LGZ6LYW3.0 size=1048576 2024-09-19T13:47:42.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.012+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~VYB8LGZ6LYW3.1 size=966891 2024-09-19T13:47:42.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.012+0000 7fcf3240c8c0 1 > prepared multipart upload key=3TME221SA53E upload=VYB8LGZ6LYW3 tag=B1SUU09EON3M type=write size=3064043 2024-09-19T13:47:42.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.016+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=8GOVMJG6CPXW type=del 2024-09-19T13:47:42.024 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.020+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~XZ6QGFDH45QP.0 size=1048576 2024-09-19T13:47:42.027 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.024+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~XZ6QGFDH45QP.1 size=414393 2024-09-19T13:47:42.027 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.024+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=XZ6QGFDH45QP tag=076HSD9NMJI6 type=write size=2511545 2024-09-19T13:47:42.030 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.028+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~8O1VAYA8KC0D.0 size=361331 2024-09-19T13:47:42.035 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.032+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=8O1VAYA8KC0D tag=EUXFUP6I05PT type=write size=1409907 2024-09-19T13:47:42.039 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.036+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=MJ017PW7C3Z3 type=del size=2150142 2024-09-19T13:47:42.042 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.036+0000 7fcf3240c8c0 1 < canceled operation key=71Z2VTW99W7J tag=W78O9KBVJN2B type=del size=1806805 2024-09-19T13:47:42.045 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.040+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=X4MA75SRDVFM type=del size=3917040 2024-09-19T13:47:42.048 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.044+0000 7fcf3240c8c0 1 < completed delete operation key=6DFF2OCPT9W2 tag=82V0ZI4EYLAS type=del 2024-09-19T13:47:42.051 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.048+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=PIDMG1Y3VMZC type=del size=3162074 2024-09-19T13:47:42.052 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.048+0000 7fcf3240c8c0 1 < canceled part key=_multipart_C3TFYNXH549T.2~2N9ZGF01CH3T.0 size=889297 2024-09-19T13:47:42.057 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.052+0000 7fcf3240c8c0 1 < canceled multipart upload key=C3TFYNXH549T upload=2N9ZGF01CH3T tag=5GUTB7MYHNAG type=write size=1937873 2024-09-19T13:47:42.063 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.060+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~C5CINHRUEBI1.0 size=300185 2024-09-19T13:47:42.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.060+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=C5CINHRUEBI1 tag=CBZRVHLE5YLA type=write size=1348761 2024-09-19T13:47:42.067 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.064+0000 7fcf3240c8c0 1 < canceled operation key=D1RMXGXS3O7Z tag=ZFMISXW3CHFU type=del size=4125248 2024-09-19T13:47:42.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.068+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=DSZTPHA3DRSC type=del size=3929068 2024-09-19T13:47:42.079 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.076+0000 7fcf3240c8c0 1 < completed delete operation key=BXUPV5XSJBTH tag=QFH144EAB98I type=del 2024-09-19T13:47:42.085 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.080+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~TDYBNW5MTOHN.0 size=1048576 2024-09-19T13:47:42.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.084+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~TDYBNW5MTOHN.1 size=105181 2024-09-19T13:47:42.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.084+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=TDYBNW5MTOHN tag=C0GJPDZHK92L type=write size=2202333 2024-09-19T13:47:42.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.088+0000 7fcf3240c8c0 1 < completed delete operation key=DHPONKOVS8CT tag=AJ958B0PVBAG type=del 2024-09-19T13:47:42.094 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.088+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=Q3Y23NP5XWTA type=write size=894462 2024-09-19T13:47:42.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.096+0000 7fcf3240c8c0 1 < suggested update operation key=71Z2VTW99W7J tag=3KI0UMYWEOX3 type=del size=90714 2024-09-19T13:47:42.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.100+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~3C952Y7QD3N2.0 size=1048576 2024-09-19T13:47:42.108 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.104+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~3C952Y7QD3N2.1 size=784116 2024-09-19T13:47:42.108 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.104+0000 7fcf3240c8c0 1 > prepared multipart upload key=STMT6XU2EJQM upload=3C952Y7QD3N2 tag=D45001D0NPED type=write size=2881268 2024-09-19T13:47:42.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.108+0000 7fcf3240c8c0 1 < completed delete operation key=NP2L28YRVQ8L tag=L3HYBQMG1Q8L type=del 2024-09-19T13:47:42.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.112+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=NVGV7OY4SBQI type=del size=2583396 2024-09-19T13:47:42.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.112+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=IBZIGLVN7DDS type=del 2024-09-19T13:47:42.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.116+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=NO8F5A15K50H type=del size=1842123 2024-09-19T13:47:42.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.120+0000 7fcf3240c8c0 1 < completed part key=_multipart_1BMF3S2BZLLI.2~0E1RNSG41OGL.0 size=749168 2024-09-19T13:47:42.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.124+0000 7fcf3240c8c0 1 < completed multipart upload key=1BMF3S2BZLLI upload=0E1RNSG41OGL tag=IPTTN57LV0SI type=write size=1797744 2024-09-19T13:47:42.132 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.128+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=DBF3RP0PZI14 type=del size=109309 2024-09-19T13:47:42.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.132+0000 7fcf3240c8c0 1 < suggested update operation key=ZCKKQ1R8318S tag=GX7G26IPC1OT type=del size=2800773 2024-09-19T13:47:42.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.136+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=LOGA3SLR2VL0 type=write size=459991 2024-09-19T13:47:42.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.140+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~TEK9DIABXX25.0 size=1037638 2024-09-19T13:47:42.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.144+0000 7fcf3240c8c0 1 < completed multipart upload key=N51Q6HKJSCCB upload=TEK9DIABXX25 tag=I3QY60QMRMSN type=write size=2086214 2024-09-19T13:47:42.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.152+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~RMILD4P33OKU.0 size=1048576 2024-09-19T13:47:42.159 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.156+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~RMILD4P33OKU.1 size=1048576 2024-09-19T13:47:42.161 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.156+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~RMILD4P33OKU.2 size=772144 2024-09-19T13:47:42.161 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.156+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=RMILD4P33OKU tag=QIBKOXUTQT5V type=write size=3917872 2024-09-19T13:47:42.165 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.160+0000 7fcf3240c8c0 -1 < failed to complete operation key=ZCKKQ1R8318S tag=UOVTFJ3FSY5V type=del size=2262269: (22) Invalid argument 2024-09-19T13:47:42.171 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.168+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~AK6HIVJVZYDQ.0 size=1048576 2024-09-19T13:47:42.173 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.168+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~AK6HIVJVZYDQ.1 size=427621 2024-09-19T13:47:42.173 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.168+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=AK6HIVJVZYDQ tag=NVRU0WORN14G type=write size=2524773 2024-09-19T13:47:42.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.172+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~VYB8LGZ6LYW3.0 size=1048576 2024-09-19T13:47:42.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.176+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~VYB8LGZ6LYW3.1 size=966891 2024-09-19T13:47:42.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.180+0000 7fcf3240c8c0 1 < completed multipart upload key=3TME221SA53E upload=VYB8LGZ6LYW3 tag=B1SUU09EON3M type=write size=3064043 2024-09-19T13:47:42.189 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.184+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=AYP0QGT69QQC type=del size=209071 2024-09-19T13:47:42.192 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.188+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~XZ6QGFDH45QP.0 size=1048576 2024-09-19T13:47:42.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.192+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~XZ6QGFDH45QP.1 size=414393 2024-09-19T13:47:42.201 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.196+0000 7fcf3240c8c0 1 < completed multipart upload key=QMSDNKYFFK1F upload=XZ6QGFDH45QP tag=076HSD9NMJI6 type=write size=2511545 2024-09-19T13:47:42.205 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.200+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=GNYG3UNLEB0V type=del size=1318854 2024-09-19T13:47:42.208 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.204+0000 7fcf3240c8c0 1 < completed delete operation key=X16ENUFL40RN tag=MJ017PW7C3Z3 type=del 2024-09-19T13:47:42.214 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.212+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~TDH3RMC1V948.0 size=1048576 2024-09-19T13:47:42.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.212+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~TDH3RMC1V948.1 size=589727 2024-09-19T13:47:42.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.212+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=TDH3RMC1V948 tag=HN9BDW9UNZF2 type=write size=2686879 2024-09-19T13:47:42.221 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.216+0000 7fcf3240c8c0 1 < completed delete operation key=V8X0VBBNK83J tag=X4MA75SRDVFM type=del 2024-09-19T13:47:42.227 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.224+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~1K57NWWULOOG.0 size=439503 2024-09-19T13:47:42.227 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.224+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=1K57NWWULOOG tag=LQ94B2RHLY9T type=write size=1488079 2024-09-19T13:47:42.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.228+0000 7fcf3240c8c0 1 < suggested remove operation key=V8X0VBBNK83J tag=PIDMG1Y3VMZC type=del 2024-09-19T13:47:42.237 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.232+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=NVDK8EEQSO59 type=write size=844658 2024-09-19T13:47:42.238 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.232+0000 7fcf3240c8c0 1 < canceled part key=_multipart_C35EUAOWLBR3.2~C5CINHRUEBI1.0 size=300185 2024-09-19T13:47:42.243 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.240+0000 7fcf3240c8c0 1 < canceled multipart upload key=C35EUAOWLBR3 upload=C5CINHRUEBI1 tag=CBZRVHLE5YLA type=write size=1348761 2024-09-19T13:47:42.247 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.244+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=3C1M4ZME3LU5 type=del size=919693 2024-09-19T13:47:42.254 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.248+0000 7fcf3240c8c0 1 < suggested update operation key=STMT6XU2EJQM tag=DSZTPHA3DRSC type=del size=3929068 2024-09-19T13:47:42.260 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.256+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~HHJ15FC2T895.0 size=1048576 2024-09-19T13:47:42.262 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.260+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~HHJ15FC2T895.1 size=1048576 2024-09-19T13:47:42.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.260+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~HHJ15FC2T895.2 size=651330 2024-09-19T13:47:42.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.260+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=HHJ15FC2T895 tag=M8R72T1FO3T5 type=write size=3797058 2024-09-19T13:47:42.268 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.264+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~TDYBNW5MTOHN.0 size=1048576 2024-09-19T13:47:42.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.268+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~TDYBNW5MTOHN.1 size=105181 2024-09-19T13:47:42.276 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.272+0000 7fcf3240c8c0 1 < completed multipart upload key=AES54TJK7VH7 upload=TDYBNW5MTOHN tag=C0GJPDZHK92L type=write size=2202333 2024-09-19T13:47:42.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.276+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~N4V20AYMMCF6.0 size=1048576 2024-09-19T13:47:42.284 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.280+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~N4V20AYMMCF6.1 size=1048576 2024-09-19T13:47:42.286 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.280+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~N4V20AYMMCF6.2 size=878217 2024-09-19T13:47:42.286 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.280+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=N4V20AYMMCF6 tag=NRA7R5LXV59O type=write size=4023945 2024-09-19T13:47:42.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.284+0000 7fcf3240c8c0 1 < completed write operation key=OA9BMSXGYR9T tag=Q3Y23NP5XWTA type=write size=894462 2024-09-19T13:47:42.292 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.288+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=BTPTM2TDHDSM type=del size=1243926 2024-09-19T13:47:42.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.292+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~3C952Y7QD3N2.0 size=1048576 2024-09-19T13:47:42.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.292+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~3C952Y7QD3N2.1 size=784116 2024-09-19T13:47:42.305 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.300+0000 7fcf3240c8c0 1 < completed multipart upload key=STMT6XU2EJQM upload=3C952Y7QD3N2 tag=D45001D0NPED type=write size=2881268 2024-09-19T13:47:42.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.304+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~ZCZLV1YS9DEV.0 size=1048576 2024-09-19T13:47:42.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.308+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~ZCZLV1YS9DEV.1 size=331105 2024-09-19T13:47:42.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.308+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=ZCZLV1YS9DEV tag=MRST7PNYFAWE type=write size=2428257 2024-09-19T13:47:42.318 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.312+0000 7fcf3240c8c0 1 < suggested remove operation key=1BMF3S2BZLLI tag=NVGV7OY4SBQI type=del 2024-09-19T13:47:42.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.316+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=NUP5C395E1VS type=del size=1360796 2024-09-19T13:47:42.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.324+0000 7fcf3240c8c0 1 < suggested update operation key=ZCKKQ1R8318S tag=NO8F5A15K50H type=del size=1842123 2024-09-19T13:47:42.331 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.328+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=E6BUC73EUG4O type=del size=937098 2024-09-19T13:47:42.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.332+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=DBF3RP0PZI14 type=del 2024-09-19T13:47:42.337 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.332+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=AV8A4XI2FMI6 type=del size=1536122 2024-09-19T13:47:42.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.336+0000 7fcf3240c8c0 1 < completed write operation key=C3TFYNXH549T tag=LOGA3SLR2VL0 type=write size=459991 2024-09-19T13:47:42.346 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.344+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~9075AUYR4SGB.0 size=719427 2024-09-19T13:47:42.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.344+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=9075AUYR4SGB tag=Z7QRDUL72A4T type=write size=1768003 2024-09-19T13:47:42.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.344+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~RMILD4P33OKU.0 size=1048576 2024-09-19T13:47:42.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.348+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~RMILD4P33OKU.1 size=1048576 2024-09-19T13:47:42.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.352+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~RMILD4P33OKU.2 size=772144 2024-09-19T13:47:42.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.356+0000 7fcf3240c8c0 1 < completed multipart upload key=NP2L28YRVQ8L upload=RMILD4P33OKU tag=QIBKOXUTQT5V type=write size=3917872 2024-09-19T13:47:42.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.360+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=R1ZI7R7759WF type=write size=426383 2024-09-19T13:47:42.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.360+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~AK6HIVJVZYDQ.0 size=1048576 2024-09-19T13:47:42.367 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.364+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~AK6HIVJVZYDQ.1 size=427621 2024-09-19T13:47:42.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.368+0000 7fcf3240c8c0 1 < completed multipart upload key=QAYJ5B1KZ08J upload=AK6HIVJVZYDQ tag=NVRU0WORN14G type=write size=2524773 2024-09-19T13:47:42.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.376+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=XNKTAZDN7GFJ type=del size=538884 2024-09-19T13:47:42.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.380+0000 7fcf3240c8c0 1 < suggested update operation key=0UCFTOF1YBBM tag=AYP0QGT69QQC type=del size=209071 2024-09-19T13:47:42.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.384+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=4EP82Y4RQUS0 type=del size=3530788 2024-09-19T13:47:42.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.388+0000 7fcf3240c8c0 1 < completed delete operation key=DHPONKOVS8CT tag=GNYG3UNLEB0V type=del 2024-09-19T13:47:42.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.392+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=T1J02L5NORBF type=del size=3931414 2024-09-19T13:47:42.400 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.396+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~TDH3RMC1V948.0 size=1048576 2024-09-19T13:47:42.403 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.400+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~TDH3RMC1V948.1 size=589727 2024-09-19T13:47:42.408 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.404+0000 7fcf3240c8c0 1 < completed multipart upload key=0UCFTOF1YBBM upload=TDH3RMC1V948 tag=HN9BDW9UNZF2 type=write size=2686879 2024-09-19T13:47:42.411 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.408+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=VO2KQFJXNVBL type=del size=567140 2024-09-19T13:47:42.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.408+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~1K57NWWULOOG.0 size=439503 2024-09-19T13:47:42.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.416+0000 7fcf3240c8c0 1 < completed multipart upload key=QMSDNKYFFK1F upload=1K57NWWULOOG tag=LQ94B2RHLY9T type=write size=1488079 2024-09-19T13:47:42.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.416+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=BCQO6VI46TKP type=del size=2232846 2024-09-19T13:47:42.425 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.420+0000 7fcf3240c8c0 1 < completed write operation key=0U9BUX9DHTAK tag=NVDK8EEQSO59 type=write size=844658 2024-09-19T13:47:42.428 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.424+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=C86JARLD2HVC type=del size=2823943 2024-09-19T13:47:42.432 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.428+0000 7fcf3240c8c0 1 < completed delete operation key=N51Q6HKJSCCB tag=3C1M4ZME3LU5 type=del 2024-09-19T13:47:42.435 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.432+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=JGKL10LGWWOY type=del size=59583 2024-09-19T13:47:42.438 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.432+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~HHJ15FC2T895.0 size=1048576 2024-09-19T13:47:42.440 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.436+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~HHJ15FC2T895.1 size=1048576 2024-09-19T13:47:42.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.440+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~HHJ15FC2T895.2 size=651330 2024-09-19T13:47:42.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.444+0000 7fcf3240c8c0 1 < completed multipart upload key=D20C6C2ZFX1W upload=HHJ15FC2T895 tag=M8R72T1FO3T5 type=write size=3797058 2024-09-19T13:47:42.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.448+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~HB2JK1QZE20U.0 size=427827 2024-09-19T13:47:42.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.448+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=HB2JK1QZE20U tag=HO3QD38SZ8EZ type=write size=1476403 2024-09-19T13:47:42.456 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.452+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~N4V20AYMMCF6.0 size=1048576 2024-09-19T13:47:42.456 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.452+0000 7fcf3240c8c0 1 < canceled part key=_multipart_M2CO4A2DHJ05.2~N4V20AYMMCF6.1 size=1048576 2024-09-19T13:47:42.459 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.456+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~N4V20AYMMCF6.2 size=878217 2024-09-19T13:47:42.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.460+0000 7fcf3240c8c0 1 < canceled multipart upload key=M2CO4A2DHJ05 upload=N4V20AYMMCF6 tag=NRA7R5LXV59O type=write size=4023945 2024-09-19T13:47:42.468 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.464+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=MKQTJSH42D1Y type=del size=4035534 2024-09-19T13:47:42.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.468+0000 7fcf3240c8c0 1 < suggested remove operation key=D1RMXGXS3O7Z tag=BTPTM2TDHDSM type=del 2024-09-19T13:47:42.477 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.472+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=DXU25HVUE0GJ type=del size=2725845 2024-09-19T13:47:42.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.476+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~ZCZLV1YS9DEV.0 size=1048576 2024-09-19T13:47:42.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.476+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~ZCZLV1YS9DEV.1 size=331105 2024-09-19T13:47:42.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.484+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=ZCZLV1YS9DEV tag=MRST7PNYFAWE type=write size=2428257 2024-09-19T13:47:42.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.484+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=X9V7TW8628HY type=write size=307456 2024-09-19T13:47:42.492 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.488+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=NUP5C395E1VS type=del 2024-09-19T13:47:42.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.492+0000 7fcf3240c8c0 1 > prepared part key=_multipart_N51Q6HKJSCCB.2~505S0KWGWAGU.0 size=908057 2024-09-19T13:47:42.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.492+0000 7fcf3240c8c0 1 > prepared multipart upload key=N51Q6HKJSCCB upload=505S0KWGWAGU tag=B204FKC7SHJR type=write size=1956633 2024-09-19T13:47:42.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.500+0000 7fcf3240c8c0 1 < suggested update operation key=ZCKKQ1R8318S tag=E6BUC73EUG4O type=del size=937098 2024-09-19T13:47:42.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.504+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~ZXUYNFCVC6NK.0 size=776231 2024-09-19T13:47:42.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.504+0000 7fcf3240c8c0 1 > prepared multipart upload key=1BMF3S2BZLLI upload=ZXUYNFCVC6NK tag=K3BOBMJK6T4N type=write size=1824807 2024-09-19T13:47:42.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.508+0000 7fcf3240c8c0 1 < completed delete operation key=3TME221SA53E tag=AV8A4XI2FMI6 type=del 2024-09-19T13:47:42.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.508+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=X2YTD1112DPX type=del size=1622056 2024-09-19T13:47:42.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.508+0000 7fcf3240c8c0 1 < canceled part key=_multipart_D20C6C2ZFX1W.2~9075AUYR4SGB.0 size=719427 2024-09-19T13:47:42.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.516+0000 7fcf3240c8c0 1 < canceled multipart upload key=D20C6C2ZFX1W upload=9075AUYR4SGB tag=Z7QRDUL72A4T type=write size=1768003 2024-09-19T13:47:42.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.516+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=JWRIIIPYNV4R type=del size=561055 2024-09-19T13:47:42.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.520+0000 7fcf3240c8c0 1 < completed write operation key=9ICCISYXT0IV tag=R1ZI7R7759WF type=write size=426383 2024-09-19T13:47:42.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.528+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~IMGSU4FYSNFX.0 size=49210 2024-09-19T13:47:42.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.528+0000 7fcf3240c8c0 1 > prepared multipart upload key=A02RDP6BA9AC upload=IMGSU4FYSNFX tag=04EGN14GR3PR type=write size=1097786 2024-09-19T13:47:42.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.528+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=XNKTAZDN7GFJ type=del 2024-09-19T13:47:42.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.532+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=0DFAL39SWL91 type=del size=2224944 2024-09-19T13:47:42.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.540+0000 7fcf3240c8c0 1 < suggested update operation key=X16ENUFL40RN tag=4EP82Y4RQUS0 type=del size=3530788 2024-09-19T13:47:42.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.540+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=KK4OJFZ5ZYOL type=del size=2670858 2024-09-19T13:47:42.549 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.544+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=T1J02L5NORBF type=del 2024-09-19T13:47:42.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.548+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=UZVIFQ32WR9N type=write size=134585 2024-09-19T13:47:42.557 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.552+0000 7fcf3240c8c0 1 < suggested remove operation key=N51Q6HKJSCCB tag=VO2KQFJXNVBL type=del 2024-09-19T13:47:42.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.560+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~U9AULVV3PJLV.0 size=862771 2024-09-19T13:47:42.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.560+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=U9AULVV3PJLV tag=B4W626A3A69O type=write size=1911347 2024-09-19T13:47:42.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.560+0000 7fcf3240c8c0 1 < completed delete operation key=QSM2Q8CW1Q86 tag=BCQO6VI46TKP type=del 2024-09-19T13:47:42.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.568+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~P9FPVDFN6WNW.0 size=1048576 2024-09-19T13:47:42.573 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.568+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~P9FPVDFN6WNW.1 size=1048576 2024-09-19T13:47:42.575 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.572+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~P9FPVDFN6WNW.2 size=331487 2024-09-19T13:47:42.575 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.572+0000 7fcf3240c8c0 1 > prepared multipart upload key=STMT6XU2EJQM upload=P9FPVDFN6WNW tag=M8F7PZS3PFH9 type=write size=3477215 2024-09-19T13:47:42.578 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.572+0000 7fcf3240c8c0 1 < completed delete operation key=HXMZKP7H3HJE tag=C86JARLD2HVC type=del 2024-09-19T13:47:42.581 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.576+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=YEPSYNCC1UP3 type=del size=187729 2024-09-19T13:47:42.584 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.580+0000 7fcf3240c8c0 1 < completed delete operation key=NP2L28YRVQ8L tag=JGKL10LGWWOY type=del 2024-09-19T13:47:42.587 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.584+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=Q3T03N5D9FJ6 type=del size=1811800 2024-09-19T13:47:42.590 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.584+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~HB2JK1QZE20U.0 size=427827 2024-09-19T13:47:42.594 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.592+0000 7fcf3240c8c0 1 < completed multipart upload key=QMSDNKYFFK1F upload=HB2JK1QZE20U tag=HO3QD38SZ8EZ type=write size=1476403 2024-09-19T13:47:42.597 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.592+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=C58TZX794BXP type=del size=2744066 2024-09-19T13:47:42.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.600+0000 7fcf3240c8c0 1 < suggested remove operation key=0UCFTOF1YBBM tag=MKQTJSH42D1Y type=del 2024-09-19T13:47:42.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.604+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=E1C56ZENKYGE type=del size=3469962 2024-09-19T13:47:42.610 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.604+0000 7fcf3240c8c0 1 < completed delete operation key=D20C6C2ZFX1W tag=DXU25HVUE0GJ type=del 2024-09-19T13:47:42.613 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.608+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=TXVFDQNXR18Q type=del size=2180706 2024-09-19T13:47:42.618 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.616+0000 7fcf3240c8c0 1 < suggested remove operation key=C3TFYNXH549T tag=X9V7TW8628HY type=write 2024-09-19T13:47:42.621 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.616+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=IV73NGNQTKFB type=del size=2188885 2024-09-19T13:47:42.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.620+0000 7fcf3240c8c0 1 < completed part key=_multipart_N51Q6HKJSCCB.2~505S0KWGWAGU.0 size=908057 2024-09-19T13:47:42.630 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.624+0000 7fcf3240c8c0 1 < completed multipart upload key=N51Q6HKJSCCB upload=505S0KWGWAGU tag=B204FKC7SHJR type=write size=1956633 2024-09-19T13:47:42.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.628+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=L9ZPX7VUQR8M type=write size=799326 2024-09-19T13:47:42.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.632+0000 7fcf3240c8c0 1 < completed part key=_multipart_1BMF3S2BZLLI.2~ZXUYNFCVC6NK.0 size=776231 2024-09-19T13:47:42.641 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.636+0000 7fcf3240c8c0 1 < completed multipart upload key=1BMF3S2BZLLI upload=ZXUYNFCVC6NK tag=K3BOBMJK6T4N type=write size=1824807 2024-09-19T13:47:42.644 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.640+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=1LO02KA0B2HZ type=del size=330754 2024-09-19T13:47:42.646 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.644+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=X2YTD1112DPX type=del 2024-09-19T13:47:42.649 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.644+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=G37D3Y31O3Y0 type=del size=1306204 2024-09-19T13:47:42.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.648+0000 7fcf3240c8c0 -1 < failed to complete operation key=N51Q6HKJSCCB tag=JWRIIIPYNV4R type=del size=561055: (22) Invalid argument 2024-09-19T13:47:42.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.652+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~ZTEMMU3IJ7QK.0 size=1048576 2024-09-19T13:47:42.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.656+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~ZTEMMU3IJ7QK.1 size=1048576 2024-09-19T13:47:42.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.660+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~ZTEMMU3IJ7QK.2 size=732453 2024-09-19T13:47:42.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.660+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=ZTEMMU3IJ7QK tag=11BBP59R14NY type=write size=3878181 2024-09-19T13:47:42.666 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.660+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~IMGSU4FYSNFX.0 size=49210 2024-09-19T13:47:42.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.664+0000 7fcf3240c8c0 1 < completed multipart upload key=A02RDP6BA9AC upload=IMGSU4FYSNFX tag=04EGN14GR3PR type=write size=1097786 2024-09-19T13:47:42.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.668+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=0VP241E6DCKP type=del size=96366 2024-09-19T13:47:42.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.672+0000 7fcf3240c8c0 1 < completed delete operation key=M2CO4A2DHJ05 tag=0DFAL39SWL91 type=del 2024-09-19T13:47:42.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.672+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=SH4DR4VV4W6N type=del size=3673317 2024-09-19T13:47:42.681 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.676+0000 7fcf3240c8c0 1 < completed delete operation key=M2CO4A2DHJ05 tag=KK4OJFZ5ZYOL type=del 2024-09-19T13:47:42.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.680+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~XGK7O1NI8VXP.0 size=933292 2024-09-19T13:47:42.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.680+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=XGK7O1NI8VXP tag=LWKVQBJYL71I type=write size=1981868 2024-09-19T13:47:42.688 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.684+0000 7fcf3240c8c0 -1 < failed to complete operation key=0UCFTOF1YBBM tag=UZVIFQ32WR9N type=write size=134585: (22) Invalid argument 2024-09-19T13:47:42.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.688+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~YQ8NQETUJDMU.0 size=1048576 2024-09-19T13:47:42.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.692+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~YQ8NQETUJDMU.1 size=1048576 2024-09-19T13:47:42.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.692+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~YQ8NQETUJDMU.2 size=984541 2024-09-19T13:47:42.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.692+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=YQ8NQETUJDMU tag=GX6XM7ZY6JL0 type=write size=4130269 2024-09-19T13:47:42.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.692+0000 7fcf3240c8c0 1 < canceled part key=_multipart_ZCKKQ1R8318S.2~U9AULVV3PJLV.0 size=862771 2024-09-19T13:47:42.702 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.696+0000 7fcf3240c8c0 1 < canceled multipart upload key=ZCKKQ1R8318S upload=U9AULVV3PJLV tag=B4W626A3A69O type=write size=1911347 2024-09-19T13:47:42.707 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.704+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~M81GUX6KNVXP.0 size=1048576 2024-09-19T13:47:42.709 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.704+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~M81GUX6KNVXP.1 size=1048576 2024-09-19T13:47:42.712 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.708+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~M81GUX6KNVXP.2 size=421194 2024-09-19T13:47:42.712 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.708+0000 7fcf3240c8c0 1 > prepared multipart upload key=DHPONKOVS8CT upload=M81GUX6KNVXP tag=VLDDN37HF1JX type=write size=3566922 2024-09-19T13:47:42.712 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.708+0000 7fcf3240c8c0 1 < canceled part key=_multipart_STMT6XU2EJQM.2~P9FPVDFN6WNW.0 size=1048576 2024-09-19T13:47:42.713 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.708+0000 7fcf3240c8c0 1 < canceled part key=_multipart_STMT6XU2EJQM.2~P9FPVDFN6WNW.1 size=1048576 2024-09-19T13:47:42.714 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.712+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~P9FPVDFN6WNW.2 size=331487 2024-09-19T13:47:42.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.716+0000 7fcf3240c8c0 1 < canceled multipart upload key=STMT6XU2EJQM upload=P9FPVDFN6WNW tag=M8F7PZS3PFH9 type=write size=3477215 2024-09-19T13:47:42.722 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.716+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=WXHGPX08M0FS type=del size=380704 2024-09-19T13:47:42.725 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.720+0000 7fcf3240c8c0 1 < completed delete operation key=STMT6XU2EJQM tag=YEPSYNCC1UP3 type=del 2024-09-19T13:47:42.731 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.728+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~FKHR5SEP2C7P.0 size=1048576 2024-09-19T13:47:42.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.728+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~FKHR5SEP2C7P.1 size=655134 2024-09-19T13:47:42.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.728+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=FKHR5SEP2C7P tag=UW9REHDIT27M type=write size=2752286 2024-09-19T13:47:42.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.736+0000 7fcf3240c8c0 1 < suggested update operation key=QMSDNKYFFK1F tag=Q3T03N5D9FJ6 type=del size=1811800 2024-09-19T13:47:42.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.740+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~53854C5T08U0.0 size=1048576 2024-09-19T13:47:42.747 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.744+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~53854C5T08U0.1 size=301559 2024-09-19T13:47:42.747 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.744+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=53854C5T08U0 tag=DJOLTQD6G1HN type=write size=2398711 2024-09-19T13:47:42.753 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.748+0000 7fcf3240c8c0 1 < suggested update operation key=A02RDP6BA9AC tag=C58TZX794BXP type=del size=2744066 2024-09-19T13:47:42.755 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.752+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=VR6FZK1HLKXJ type=del size=952277 2024-09-19T13:47:42.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.752+0000 7fcf3240c8c0 -1 < failed to complete operation key=A02RDP6BA9AC tag=E1C56ZENKYGE type=del size=3469962: (22) Invalid argument 2024-09-19T13:47:42.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.756+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=K76RJOSCCE3M type=del size=412330 2024-09-19T13:47:42.764 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.760+0000 7fcf3240c8c0 1 < canceled operation key=X16ENUFL40RN tag=TXVFDQNXR18Q type=del size=2180706 2024-09-19T13:47:42.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.764+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=XM2UMC98E46W type=del size=3036638 2024-09-19T13:47:42.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.768+0000 7fcf3240c8c0 1 < completed delete operation key=DHPONKOVS8CT tag=IV73NGNQTKFB type=del 2024-09-19T13:47:42.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.768+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=1AN5L368BG2U type=del size=1519879 2024-09-19T13:47:42.777 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.772+0000 7fcf3240c8c0 1 < completed write operation key=7UC85R2HO9K2 tag=L9ZPX7VUQR8M type=write size=799326 2024-09-19T13:47:42.780 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.776+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=75LED9FRM7RC type=del size=1456911 2024-09-19T13:47:42.783 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.780+0000 7fcf3240c8c0 1 < completed delete operation key=D20C6C2ZFX1W tag=1LO02KA0B2HZ type=del 2024-09-19T13:47:42.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.784+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~U8QKM2Z6APCP.0 size=1048576 2024-09-19T13:47:42.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.788+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~U8QKM2Z6APCP.1 size=1048576 2024-09-19T13:47:42.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.788+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~U8QKM2Z6APCP.2 size=461292 2024-09-19T13:47:42.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.788+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=U8QKM2Z6APCP tag=ER1T7VQXV1O7 type=write size=3607020 2024-09-19T13:47:42.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.792+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=G37D3Y31O3Y0 type=del 2024-09-19T13:47:42.799 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.796+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=SFTF24537IOP type=del size=3585213 2024-09-19T13:47:42.803 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.796+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~ZTEMMU3IJ7QK.0 size=1048576 2024-09-19T13:47:42.804 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.800+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~ZTEMMU3IJ7QK.1 size=1048576 2024-09-19T13:47:42.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.804+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~ZTEMMU3IJ7QK.2 size=732453 2024-09-19T13:47:42.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.808+0000 7fcf3240c8c0 1 < completed multipart upload key=M2CO4A2DHJ05 upload=ZTEMMU3IJ7QK tag=11BBP59R14NY type=write size=3878181 2024-09-19T13:47:42.818 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.816+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~7JIN7Z2HICDW.0 size=557358 2024-09-19T13:47:42.818 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.816+0000 7fcf3240c8c0 1 > prepared multipart upload key=OA9BMSXGYR9T upload=7JIN7Z2HICDW tag=H3G852TSPS33 type=write size=1605934 2024-09-19T13:47:42.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.816+0000 7fcf3240c8c0 1 < completed delete operation key=ZCKKQ1R8318S tag=0VP241E6DCKP type=del 2024-09-19T13:47:42.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.820+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~XO2GTQZ83YFH.0 size=25087 2024-09-19T13:47:42.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.820+0000 7fcf3240c8c0 1 > prepared multipart upload key=C3TFYNXH549T upload=XO2GTQZ83YFH tag=S2TCF0MQD2EH type=write size=1073663 2024-09-19T13:47:42.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.824+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=SH4DR4VV4W6N type=del 2024-09-19T13:47:42.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.828+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=QU3CHKHYGAFU type=write size=885140 2024-09-19T13:47:42.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.828+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~XGK7O1NI8VXP.0 size=933292 2024-09-19T13:47:42.838 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.832+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=XGK7O1NI8VXP tag=LWKVQBJYL71I type=write size=1981868 2024-09-19T13:47:42.843 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.840+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~HZUKM1VDKRAW.0 size=1048576 2024-09-19T13:47:42.846 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.840+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~HZUKM1VDKRAW.1 size=1048576 2024-09-19T13:47:42.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.844+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~HZUKM1VDKRAW.2 size=487012 2024-09-19T13:47:42.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.844+0000 7fcf3240c8c0 1 > prepared multipart upload key=STMT6XU2EJQM upload=HZUKM1VDKRAW tag=FCN0QBCOUTRA type=write size=3632740 2024-09-19T13:47:42.851 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.848+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~YQ8NQETUJDMU.0 size=1048576 2024-09-19T13:47:42.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.848+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~YQ8NQETUJDMU.1 size=1048576 2024-09-19T13:47:42.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.852+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~YQ8NQETUJDMU.2 size=984541 2024-09-19T13:47:42.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.856+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=YQ8NQETUJDMU tag=GX6XM7ZY6JL0 type=write size=4130269 2024-09-19T13:47:42.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.860+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=JR0P8QTZJSPN type=del size=2552362 2024-09-19T13:47:42.866 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.860+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~M81GUX6KNVXP.0 size=1048576 2024-09-19T13:47:42.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.864+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~M81GUX6KNVXP.1 size=1048576 2024-09-19T13:47:42.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.868+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~M81GUX6KNVXP.2 size=421194 2024-09-19T13:47:42.875 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.872+0000 7fcf3240c8c0 1 < completed multipart upload key=DHPONKOVS8CT upload=M81GUX6KNVXP tag=VLDDN37HF1JX type=write size=3566922 2024-09-19T13:47:42.878 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.872+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=6U96DSYGH00B type=del size=2712857 2024-09-19T13:47:42.881 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.876+0000 7fcf3240c8c0 1 < completed delete operation key=7UC85R2HO9K2 tag=WXHGPX08M0FS type=del 2024-09-19T13:47:42.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.880+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=X3HRWC4FSAR9 type=write size=367024 2024-09-19T13:47:42.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.884+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~FKHR5SEP2C7P.0 size=1048576 2024-09-19T13:47:42.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.884+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~FKHR5SEP2C7P.1 size=655134 2024-09-19T13:47:42.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.888+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=FKHR5SEP2C7P tag=UW9REHDIT27M type=write size=2752286 2024-09-19T13:47:42.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.896+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~LCCYHXHJST13.0 size=757641 2024-09-19T13:47:42.899 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.896+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=LCCYHXHJST13 tag=6U86NN95PXJ9 type=write size=1806217 2024-09-19T13:47:42.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.896+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~53854C5T08U0.0 size=1048576 2024-09-19T13:47:42.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.896+0000 7fcf3240c8c0 1 < canceled part key=_multipart_QSM2Q8CW1Q86.2~53854C5T08U0.1 size=301559 2024-09-19T13:47:42.906 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.904+0000 7fcf3240c8c0 1 < canceled multipart upload key=QSM2Q8CW1Q86 upload=53854C5T08U0 tag=DJOLTQD6G1HN type=write size=2398711 2024-09-19T13:47:42.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.908+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~JLA33UWGF43D.0 size=177978 2024-09-19T13:47:42.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.908+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=JLA33UWGF43D tag=T9MDD7JI8KGA type=write size=1226554 2024-09-19T13:47:42.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.912+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=VR6FZK1HLKXJ type=del 2024-09-19T13:47:42.919 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.916+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=9GFWVNHZC200 type=del size=2154708 2024-09-19T13:47:42.925 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.920+0000 7fcf3240c8c0 1 < suggested remove operation key=HXMZKP7H3HJE tag=K76RJOSCCE3M type=del 2024-09-19T13:47:42.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.928+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=WA76OPXCNBLT type=del size=3566167 2024-09-19T13:47:42.935 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.932+0000 7fcf3240c8c0 1 < canceled operation key=OA9BMSXGYR9T tag=XM2UMC98E46W type=del size=3036638 2024-09-19T13:47:42.938 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.932+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=9KE52VK4X21U type=del size=2969836 2024-09-19T13:47:42.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.940+0000 7fcf3240c8c0 1 < suggested update operation key=D1RMXGXS3O7Z tag=1AN5L368BG2U type=del size=1519879 2024-09-19T13:47:42.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.944+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=ZKV2JVG4ZPU9 type=del size=1420755 2024-09-19T13:47:42.950 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.944+0000 7fcf3240c8c0 1 < completed delete operation key=NP2L28YRVQ8L tag=75LED9FRM7RC type=del 2024-09-19T13:47:42.956 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.952+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~IQZ9HRTRV9N5.0 size=1048576 2024-09-19T13:47:42.959 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.956+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~IQZ9HRTRV9N5.1 size=233688 2024-09-19T13:47:42.959 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.956+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=IQZ9HRTRV9N5 tag=2ZG8MF6DQ0KH type=write size=2330840 2024-09-19T13:47:42.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.956+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~U8QKM2Z6APCP.0 size=1048576 2024-09-19T13:47:42.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.960+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~U8QKM2Z6APCP.1 size=1048576 2024-09-19T13:47:42.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.960+0000 7fcf3240c8c0 1 < canceled part key=_multipart_ZCKKQ1R8318S.2~U8QKM2Z6APCP.2 size=461292 2024-09-19T13:47:42.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.964+0000 7fcf3240c8c0 1 < canceled multipart upload key=ZCKKQ1R8318S upload=U8QKM2Z6APCP tag=ER1T7VQXV1O7 type=write size=3607020 2024-09-19T13:47:42.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.968+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=TARZXK7F02QZ type=del size=252295 2024-09-19T13:47:42.975 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.972+0000 7fcf3240c8c0 1 < completed delete operation key=3TME221SA53E tag=SFTF24537IOP type=del 2024-09-19T13:47:42.979 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.976+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=V7JMU27DFGGK type=del size=856171 2024-09-19T13:47:42.979 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.976+0000 7fcf3240c8c0 1 < canceled part key=_multipart_OA9BMSXGYR9T.2~7JIN7Z2HICDW.0 size=557358 2024-09-19T13:47:42.984 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.980+0000 7fcf3240c8c0 1 < canceled multipart upload key=OA9BMSXGYR9T upload=7JIN7Z2HICDW tag=H3G852TSPS33 type=write size=1605934 2024-09-19T13:47:42.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.984+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~C8QRHQ082L7L.0 size=525640 2024-09-19T13:47:42.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.984+0000 7fcf3240c8c0 1 > prepared multipart upload key=C3TFYNXH549T upload=C8QRHQ082L7L tag=XS3YK2UZ7SFG type=write size=1574216 2024-09-19T13:47:42.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.988+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~XO2GTQZ83YFH.0 size=25087 2024-09-19T13:47:42.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:42.992+0000 7fcf3240c8c0 1 < completed multipart upload key=C3TFYNXH549T upload=XO2GTQZ83YFH tag=S2TCF0MQD2EH type=write size=1073663 2024-09-19T13:47:43.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.000+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~XDZU81YXJ4PI.0 size=664920 2024-09-19T13:47:43.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.000+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=XDZU81YXJ4PI tag=5E0GD8H36FQJ type=write size=1713496 2024-09-19T13:47:43.005 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.000+0000 7fcf3240c8c0 1 < completed write operation key=QMSDNKYFFK1F tag=QU3CHKHYGAFU type=write size=885140 2024-09-19T13:47:43.008 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.004+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=DIB77PER2F6T type=del size=2506881 2024-09-19T13:47:43.011 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.008+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~HZUKM1VDKRAW.0 size=1048576 2024-09-19T13:47:43.011 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.008+0000 7fcf3240c8c0 1 < canceled part key=_multipart_STMT6XU2EJQM.2~HZUKM1VDKRAW.1 size=1048576 2024-09-19T13:47:43.014 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.008+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~HZUKM1VDKRAW.2 size=487012 2024-09-19T13:47:43.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.016+0000 7fcf3240c8c0 1 < canceled multipart upload key=STMT6XU2EJQM upload=HZUKM1VDKRAW tag=FCN0QBCOUTRA type=write size=3632740 2024-09-19T13:47:43.025 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.020+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~M8RWFJ113FCQ.0 size=1048576 2024-09-19T13:47:43.027 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.024+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~M8RWFJ113FCQ.1 size=303165 2024-09-19T13:47:43.027 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.024+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=M8RWFJ113FCQ tag=762R8NOQE82U type=write size=2400317 2024-09-19T13:47:43.032 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.028+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=JR0P8QTZJSPN type=del 2024-09-19T13:47:43.035 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.032+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=HD4P6QPIWI2P type=write size=939397 2024-09-19T13:47:43.039 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.036+0000 7fcf3240c8c0 1 < completed delete operation key=XE42LV5M5X82 tag=6U96DSYGH00B type=del 2024-09-19T13:47:43.042 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.040+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=5ZQZKV3X22E7 type=del size=2137789 2024-09-19T13:47:43.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.040+0000 7fcf3240c8c0 1 < completed write operation key=QAYJ5B1KZ08J tag=X3HRWC4FSAR9 type=write size=367024 2024-09-19T13:47:43.051 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.048+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~DW25CGBV8RSN.0 size=1048576 2024-09-19T13:47:43.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.048+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~DW25CGBV8RSN.1 size=643069 2024-09-19T13:47:43.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.048+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=DW25CGBV8RSN tag=NH6MQO8XLAZW type=write size=2740221 2024-09-19T13:47:43.057 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.052+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~LCCYHXHJST13.0 size=757641 2024-09-19T13:47:43.063 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.060+0000 7fcf3240c8c0 1 < completed multipart upload key=QSM2Q8CW1Q86 upload=LCCYHXHJST13 tag=6U86NN95PXJ9 type=write size=1806217 2024-09-19T13:47:43.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.060+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=IE196F2E2M0K type=del size=2222621 2024-09-19T13:47:43.069 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.064+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~JLA33UWGF43D.0 size=177978 2024-09-19T13:47:43.074 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.068+0000 7fcf3240c8c0 1 < completed multipart upload key=QSM2Q8CW1Q86 upload=JLA33UWGF43D tag=T9MDD7JI8KGA type=write size=1226554 2024-09-19T13:47:43.079 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.076+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~0393K6512D7I.0 size=37107 2024-09-19T13:47:43.079 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.076+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=0393K6512D7I tag=XPXI8SCEAFZY type=write size=1085683 2024-09-19T13:47:43.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.080+0000 7fcf3240c8c0 1 < completed delete operation key=N51Q6HKJSCCB tag=9GFWVNHZC200 type=del 2024-09-19T13:47:43.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.084+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~2WT6USQ3WRH9.0 size=275898 2024-09-19T13:47:43.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.084+0000 7fcf3240c8c0 1 > prepared multipart upload key=X9FGPMP30X47 upload=2WT6USQ3WRH9 tag=QNCMESG75GYK type=write size=1324474 2024-09-19T13:47:43.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.088+0000 7fcf3240c8c0 1 < completed delete operation key=0UCFTOF1YBBM tag=WA76OPXCNBLT type=del 2024-09-19T13:47:43.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.092+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~7G73CCGKPQ9V.0 size=1048576 2024-09-19T13:47:43.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.096+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~7G73CCGKPQ9V.1 size=1048576 2024-09-19T13:47:43.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.096+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~7G73CCGKPQ9V.2 size=294879 2024-09-19T13:47:43.101 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.096+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=7G73CCGKPQ9V tag=HHTFDXNR71OU type=write size=3440607 2024-09-19T13:47:43.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.100+0000 7fcf3240c8c0 1 < completed delete operation key=ZCKKQ1R8318S tag=9KE52VK4X21U type=del 2024-09-19T13:47:43.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.104+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=J5OVR0IBQYYB type=del size=462049 2024-09-19T13:47:43.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.104+0000 7fcf3240c8c0 1 < completed delete operation key=C8T6DB9V9FBT tag=ZKV2JVG4ZPU9 type=del 2024-09-19T13:47:43.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.108+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=EIRZHGZJNITR type=write size=436832 2024-09-19T13:47:43.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.108+0000 7fcf3240c8c0 1 < canceled part key=_multipart_QAYJ5B1KZ08J.2~IQZ9HRTRV9N5.0 size=1048576 2024-09-19T13:47:43.116 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.112+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~IQZ9HRTRV9N5.1 size=233688 2024-09-19T13:47:43.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.116+0000 7fcf3240c8c0 1 < canceled multipart upload key=QAYJ5B1KZ08J upload=IQZ9HRTRV9N5 tag=2ZG8MF6DQ0KH type=write size=2330840 2024-09-19T13:47:43.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.120+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=9AR7EQ9YBG1O type=del size=1667503 2024-09-19T13:47:43.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.124+0000 7fcf3240c8c0 1 < completed delete operation key=QSM2Q8CW1Q86 tag=TARZXK7F02QZ type=del 2024-09-19T13:47:43.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.128+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=676VDR72QTCX type=del size=3033082 2024-09-19T13:47:43.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.132+0000 7fcf3240c8c0 1 < suggested update operation key=XE42LV5M5X82 tag=V7JMU27DFGGK type=del size=856171 2024-09-19T13:47:43.139 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.136+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=HO89B3NHCSBJ type=del size=3392463 2024-09-19T13:47:43.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.136+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~C8QRHQ082L7L.0 size=525640 2024-09-19T13:47:43.147 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.144+0000 7fcf3240c8c0 1 < completed multipart upload key=C3TFYNXH549T upload=C8QRHQ082L7L tag=XS3YK2UZ7SFG type=write size=1574216 2024-09-19T13:47:43.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.144+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=JABBQ5JH0536 type=del size=3264454 2024-09-19T13:47:43.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.148+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~XDZU81YXJ4PI.0 size=664920 2024-09-19T13:47:43.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.152+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=XDZU81YXJ4PI tag=5E0GD8H36FQJ type=write size=1713496 2024-09-19T13:47:43.160 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.156+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=XCX2G2P63REG type=del size=1040683 2024-09-19T13:47:43.162 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.160+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=DIB77PER2F6T type=del 2024-09-19T13:47:43.166 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.160+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=8DAUYEETSE3L type=write size=16964 2024-09-19T13:47:43.169 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.164+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~M8RWFJ113FCQ.0 size=1048576 2024-09-19T13:47:43.171 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.168+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~M8RWFJ113FCQ.1 size=303165 2024-09-19T13:47:43.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.172+0000 7fcf3240c8c0 1 < completed multipart upload key=QAYJ5B1KZ08J upload=M8RWFJ113FCQ tag=762R8NOQE82U type=write size=2400317 2024-09-19T13:47:43.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.180+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~0IYF5O6DZ9YL.0 size=313796 2024-09-19T13:47:43.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.180+0000 7fcf3240c8c0 1 > prepared multipart upload key=C8T6DB9V9FBT upload=0IYF5O6DZ9YL tag=EDGJEJAPAAWY type=write size=1362372 2024-09-19T13:47:43.186 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.180+0000 7fcf3240c8c0 1 < completed write operation key=QMSDNKYFFK1F tag=HD4P6QPIWI2P type=write size=939397 2024-09-19T13:47:43.189 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.184+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=RHM87SVR3I2T type=del size=3734250 2024-09-19T13:47:43.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.192+0000 7fcf3240c8c0 1 < suggested remove operation key=D1RMXGXS3O7Z tag=5ZQZKV3X22E7 type=del 2024-09-19T13:47:43.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.196+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=01YS143W5YD7 type=del size=85935 2024-09-19T13:47:43.202 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.196+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~DW25CGBV8RSN.0 size=1048576 2024-09-19T13:47:43.204 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.200+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~DW25CGBV8RSN.1 size=643069 2024-09-19T13:47:43.209 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.204+0000 7fcf3240c8c0 1 < completed multipart upload key=NP2L28YRVQ8L upload=DW25CGBV8RSN tag=NH6MQO8XLAZW type=write size=2740221 2024-09-19T13:47:43.215 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.212+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~M20W54Q92DXB.0 size=1048576 2024-09-19T13:47:43.221 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.216+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~M20W54Q92DXB.1 size=1048576 2024-09-19T13:47:43.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.220+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~M20W54Q92DXB.2 size=683448 2024-09-19T13:47:43.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.220+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=M20W54Q92DXB tag=51UKV77JT400 type=write size=3829176 2024-09-19T13:47:43.227 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.224+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=IE196F2E2M0K type=del 2024-09-19T13:47:43.230 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.224+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=05QIXSMYNKMV type=del size=1929750 2024-09-19T13:47:43.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.228+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~0393K6512D7I.0 size=37107 2024-09-19T13:47:43.238 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.232+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=0393K6512D7I tag=XPXI8SCEAFZY type=write size=1085683 2024-09-19T13:47:43.241 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.236+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=UHDH8USYJ05I type=del size=1067671 2024-09-19T13:47:43.244 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.240+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~2WT6USQ3WRH9.0 size=275898 2024-09-19T13:47:43.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.244+0000 7fcf3240c8c0 1 < completed multipart upload key=X9FGPMP30X47 upload=2WT6USQ3WRH9 tag=QNCMESG75GYK type=write size=1324474 2024-09-19T13:47:43.254 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.252+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~IKN0RM79N9G4.0 size=387591 2024-09-19T13:47:43.254 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.252+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=IKN0RM79N9G4 tag=P0Q2ZRYH090D type=write size=1436167 2024-09-19T13:47:43.258 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.252+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~7G73CCGKPQ9V.0 size=1048576 2024-09-19T13:47:43.261 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.256+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~7G73CCGKPQ9V.1 size=1048576 2024-09-19T13:47:43.263 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.260+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~7G73CCGKPQ9V.2 size=294879 2024-09-19T13:47:43.268 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.264+0000 7fcf3240c8c0 1 < completed multipart upload key=0UCFTOF1YBBM upload=7G73CCGKPQ9V tag=HHTFDXNR71OU type=write size=3440607 2024-09-19T13:47:43.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.268+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=SBRQHGUEHPHM type=del size=2506296 2024-09-19T13:47:43.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.272+0000 7fcf3240c8c0 1 < completed delete operation key=X9FGPMP30X47 tag=J5OVR0IBQYYB type=del 2024-09-19T13:47:43.279 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.276+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=5S2S8R8CDC1S type=del size=2274761 2024-09-19T13:47:43.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.280+0000 7fcf3240c8c0 1 < completed write operation key=X16ENUFL40RN tag=EIRZHGZJNITR type=write size=436832 2024-09-19T13:47:43.287 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.284+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=PI459Q7JPSTQ type=write size=839829 2024-09-19T13:47:43.290 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.284+0000 7fcf3240c8c0 -1 < failed to complete operation key=D1RMXGXS3O7Z tag=9AR7EQ9YBG1O type=del size=1667503: (22) Invalid argument 2024-09-19T13:47:43.293 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.288+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=QX2BBMB1RKGZ type=del size=4055846 2024-09-19T13:47:43.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.292+0000 7fcf3240c8c0 -1 < failed to complete operation key=XE42LV5M5X82 tag=676VDR72QTCX type=del size=3033082: (22) Invalid argument 2024-09-19T13:47:43.300 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.296+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=5ZFI63S6291D type=del size=694995 2024-09-19T13:47:43.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.300+0000 7fcf3240c8c0 1 < completed delete operation key=N51Q6HKJSCCB tag=HO89B3NHCSBJ type=del 2024-09-19T13:47:43.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.304+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=9H3U259USENQ type=write size=71604 2024-09-19T13:47:43.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.308+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=JABBQ5JH0536 type=del 2024-09-19T13:47:43.318 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.312+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~0BIXNDIQ019E.0 size=857380 2024-09-19T13:47:43.318 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.312+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=0BIXNDIQ019E tag=G2CZXADH9EAO type=write size=1905956 2024-09-19T13:47:43.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.316+0000 7fcf3240c8c0 1 < completed delete operation key=M2CO4A2DHJ05 tag=XCX2G2P63REG type=del 2024-09-19T13:47:43.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.320+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=1VEGWBII62OZ type=write size=979069 2024-09-19T13:47:43.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.324+0000 7fcf3240c8c0 1 < completed write operation key=ES62XJO5Q3FO tag=8DAUYEETSE3L type=write size=16964 2024-09-19T13:47:43.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.332+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~GRKIY31RKMXY.0 size=975276 2024-09-19T13:47:43.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.332+0000 7fcf3240c8c0 1 > prepared multipart upload key=DHPONKOVS8CT upload=GRKIY31RKMXY tag=IKNXWW25LAHI type=write size=2023852 2024-09-19T13:47:43.338 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.332+0000 7fcf3240c8c0 1 < completed part key=_multipart_C8T6DB9V9FBT.2~0IYF5O6DZ9YL.0 size=313796 2024-09-19T13:47:43.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.340+0000 7fcf3240c8c0 1 < completed multipart upload key=C8T6DB9V9FBT upload=0IYF5O6DZ9YL tag=EDGJEJAPAAWY type=write size=1362372 2024-09-19T13:47:43.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.344+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~D24HVUGH98QD.0 size=1015102 2024-09-19T13:47:43.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.344+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=D24HVUGH98QD tag=UF32FVLHY8RD type=write size=2063678 2024-09-19T13:47:43.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.352+0000 7fcf3240c8c0 1 < suggested remove operation key=C3TFYNXH549T tag=RHM87SVR3I2T type=del 2024-09-19T13:47:43.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.360+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C8T6DB9V9FBT.2~RQAUXUI60XUH.0 size=642228 2024-09-19T13:47:43.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.360+0000 7fcf3240c8c0 1 > prepared multipart upload key=C8T6DB9V9FBT upload=RQAUXUI60XUH tag=R5U1RQ1IGBJE type=write size=1690804 2024-09-19T13:47:43.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.364+0000 7fcf3240c8c0 1 < completed delete operation key=3TME221SA53E tag=01YS143W5YD7 type=del 2024-09-19T13:47:43.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.368+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=C34BEEW2PYSO type=del size=1982990 2024-09-19T13:47:43.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.372+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~M20W54Q92DXB.0 size=1048576 2024-09-19T13:47:43.378 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.372+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~M20W54Q92DXB.1 size=1048576 2024-09-19T13:47:43.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.376+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~M20W54Q92DXB.2 size=683448 2024-09-19T13:47:43.387 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.384+0000 7fcf3240c8c0 1 < completed multipart upload key=XE42LV5M5X82 upload=M20W54Q92DXB tag=51UKV77JT400 type=write size=3829176 2024-09-19T13:47:43.393 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.388+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~ZNMU8OEWQ740.0 size=575260 2024-09-19T13:47:43.394 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.388+0000 7fcf3240c8c0 1 > prepared multipart upload key=X9FGPMP30X47 upload=ZNMU8OEWQ740 tag=36J4XNF1SMU9 type=write size=1623836 2024-09-19T13:47:43.401 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.396+0000 7fcf3240c8c0 1 < suggested update operation key=OA9BMSXGYR9T tag=05QIXSMYNKMV type=del size=1929750 2024-09-19T13:47:43.404 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.400+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=QUXGTKWWHPND type=del size=190806 2024-09-19T13:47:43.407 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.404+0000 7fcf3240c8c0 1 < canceled operation key=71Z2VTW99W7J tag=UHDH8USYJ05I type=del size=1067671 2024-09-19T13:47:43.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.408+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~VCT8HJVZ13Q4.0 size=1048576 2024-09-19T13:47:43.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.412+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~VCT8HJVZ13Q4.1 size=764225 2024-09-19T13:47:43.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.412+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=VCT8HJVZ13Q4 tag=QHF5OCU2HSGY type=write size=2861377 2024-09-19T13:47:43.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.412+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~IKN0RM79N9G4.0 size=387591 2024-09-19T13:47:43.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.416+0000 7fcf3240c8c0 1 < completed multipart upload key=M2CO4A2DHJ05 upload=IKN0RM79N9G4 tag=P0Q2ZRYH090D type=write size=1436167 2024-09-19T13:47:43.427 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.424+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~KXBPAA8P2AOT.0 size=1048576 2024-09-19T13:47:43.429 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.424+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~KXBPAA8P2AOT.1 size=1048576 2024-09-19T13:47:43.432 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.428+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~KXBPAA8P2AOT.2 size=123672 2024-09-19T13:47:43.432 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.428+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=KXBPAA8P2AOT tag=OD9EDGEJZD1J type=write size=3269400 2024-09-19T13:47:43.437 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.432+0000 7fcf3240c8c0 1 < suggested remove operation key=3TME221SA53E tag=SBRQHGUEHPHM type=del 2024-09-19T13:47:43.440 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.436+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=NO7PI0N1ZXIY type=del size=460583 2024-09-19T13:47:43.442 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.440+0000 7fcf3240c8c0 -1 < failed to complete operation key=3TME221SA53E tag=5S2S8R8CDC1S type=del size=2274761: (22) Invalid argument 2024-09-19T13:47:43.445 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.440+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=JXV2TU21M495 type=write size=556099 2024-09-19T13:47:43.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.444+0000 7fcf3240c8c0 1 < completed write operation key=AES54TJK7VH7 tag=PI459Q7JPSTQ type=write size=839829 2024-09-19T13:47:43.451 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.448+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=HTC4YSSUZ4R1 type=del size=306926 2024-09-19T13:47:43.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.448+0000 7fcf3240c8c0 -1 < failed to complete operation key=OA9BMSXGYR9T tag=QX2BBMB1RKGZ type=del size=4055846: (22) Invalid argument 2024-09-19T13:47:43.458 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.456+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~6G09E0S1DKHO.0 size=796471 2024-09-19T13:47:43.458 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.456+0000 7fcf3240c8c0 1 > prepared multipart upload key=V8X0VBBNK83J upload=6G09E0S1DKHO tag=PV230Q2OYCHE type=write size=1845047 2024-09-19T13:47:43.461 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.456+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=5ZFI63S6291D type=del 2024-09-19T13:47:43.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.460+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=M1QYU573XF9F type=del size=4012377 2024-09-19T13:47:43.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.464+0000 7fcf3240c8c0 1 < completed write operation key=X9FGPMP30X47 tag=9H3U259USENQ type=write size=71604 2024-09-19T13:47:43.472 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.468+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~4IMO5LEJUJ8B.0 size=13048 2024-09-19T13:47:43.472 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.468+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=4IMO5LEJUJ8B tag=2JJ3YY9PP6Z8 type=write size=1061624 2024-09-19T13:47:43.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.472+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~0BIXNDIQ019E.0 size=857380 2024-09-19T13:47:43.479 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.476+0000 7fcf3240c8c0 1 < completed multipart upload key=QSM2Q8CW1Q86 upload=0BIXNDIQ019E tag=G2CZXADH9EAO type=write size=1905956 2024-09-19T13:47:43.485 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.480+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~D9BLCH0RRN2T.0 size=1048576 2024-09-19T13:47:43.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.484+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~D9BLCH0RRN2T.1 size=1048576 2024-09-19T13:47:43.490 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.484+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~D9BLCH0RRN2T.2 size=636039 2024-09-19T13:47:43.490 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.484+0000 7fcf3240c8c0 1 > prepared multipart upload key=6DFF2OCPT9W2 upload=D9BLCH0RRN2T tag=IUVYRH1WQXZX type=write size=3781767 2024-09-19T13:47:43.493 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.488+0000 7fcf3240c8c0 1 < completed write operation key=6DFF2OCPT9W2 tag=1VEGWBII62OZ type=write size=979069 2024-09-19T13:47:43.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.492+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~9DEW0O01YO2K.0 size=1048576 2024-09-19T13:47:43.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.496+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~9DEW0O01YO2K.1 size=1048576 2024-09-19T13:47:43.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.500+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~9DEW0O01YO2K.2 size=272276 2024-09-19T13:47:43.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.500+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=9DEW0O01YO2K tag=SH1HOTB37Z7Z type=write size=3418004 2024-09-19T13:47:43.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.504+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~GRKIY31RKMXY.0 size=975276 2024-09-19T13:47:43.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.508+0000 7fcf3240c8c0 1 < completed multipart upload key=DHPONKOVS8CT upload=GRKIY31RKMXY tag=IKNXWW25LAHI type=write size=2023852 2024-09-19T13:47:43.515 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.512+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=ZZNRP3CUZ9DO type=del size=1812545 2024-09-19T13:47:43.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.520+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~D24HVUGH98QD.0 size=1015102 2024-09-19T13:47:43.527 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.524+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=D24HVUGH98QD tag=UF32FVLHY8RD type=write size=2063678 2024-09-19T13:47:43.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.528+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=AB9JUA8IWQE8 type=write size=843404 2024-09-19T13:47:43.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.528+0000 7fcf3240c8c0 1 < canceled part key=_multipart_C8T6DB9V9FBT.2~RQAUXUI60XUH.0 size=642228 2024-09-19T13:47:43.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.532+0000 7fcf3240c8c0 1 < canceled multipart upload key=C8T6DB9V9FBT upload=RQAUXUI60XUH tag=R5U1RQ1IGBJE type=write size=1690804 2024-09-19T13:47:43.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.532+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=WW6KIYRAA2JT type=del size=583069 2024-09-19T13:47:43.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.536+0000 7fcf3240c8c0 1 < completed delete operation key=BXUPV5XSJBTH tag=C34BEEW2PYSO type=del 2024-09-19T13:47:43.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.544+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~PPUCUZUJEYZ2.0 size=1048576 2024-09-19T13:47:43.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.544+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~PPUCUZUJEYZ2.1 size=1048576 2024-09-19T13:47:43.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.548+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~PPUCUZUJEYZ2.2 size=24761 2024-09-19T13:47:43.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.548+0000 7fcf3240c8c0 1 > prepared multipart upload key=3TME221SA53E upload=PPUCUZUJEYZ2 tag=9ON3MMO8UHP8 type=write size=3170489 2024-09-19T13:47:43.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.548+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~ZNMU8OEWQ740.0 size=575260 2024-09-19T13:47:43.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.552+0000 7fcf3240c8c0 1 < completed multipart upload key=X9FGPMP30X47 upload=ZNMU8OEWQ740 tag=36J4XNF1SMU9 type=write size=1623836 2024-09-19T13:47:43.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.560+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~AWPVXLTNISKK.0 size=1048576 2024-09-19T13:47:43.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.560+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~AWPVXLTNISKK.1 size=375159 2024-09-19T13:47:43.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.560+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=AWPVXLTNISKK tag=EB8J291PKZNT type=write size=2472311 2024-09-19T13:47:43.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.564+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=QUXGTKWWHPND type=del 2024-09-19T13:47:43.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.568+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=C1F0XQ8X8XKD type=del size=455573 2024-09-19T13:47:43.574 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.568+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~VCT8HJVZ13Q4.0 size=1048576 2024-09-19T13:47:43.576 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.572+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~VCT8HJVZ13Q4.1 size=764225 2024-09-19T13:47:43.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.576+0000 7fcf3240c8c0 1 < completed multipart upload key=ES62XJO5Q3FO upload=VCT8HJVZ13Q4 tag=QHF5OCU2HSGY type=write size=2861377 2024-09-19T13:47:43.586 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.580+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~67B3LT4HFVL9.0 size=1048576 2024-09-19T13:47:43.589 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.584+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~67B3LT4HFVL9.1 size=677136 2024-09-19T13:47:43.589 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.584+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=67B3LT4HFVL9 tag=46YYUB9M89QF type=write size=2774288 2024-09-19T13:47:43.592 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.588+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~KXBPAA8P2AOT.0 size=1048576 2024-09-19T13:47:43.592 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.588+0000 7fcf3240c8c0 1 < canceled part key=_multipart_0UCFTOF1YBBM.2~KXBPAA8P2AOT.1 size=1048576 2024-09-19T13:47:43.594 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.588+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~KXBPAA8P2AOT.2 size=123672 2024-09-19T13:47:43.599 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.596+0000 7fcf3240c8c0 1 < canceled multipart upload key=0UCFTOF1YBBM upload=KXBPAA8P2AOT tag=OD9EDGEJZD1J type=write size=3269400 2024-09-19T13:47:43.603 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.600+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=Q5I8LGPRVQJ7 type=del size=1059230 2024-09-19T13:47:43.608 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.604+0000 7fcf3240c8c0 1 < suggested update operation key=M2CO4A2DHJ05 tag=NO7PI0N1ZXIY type=del size=460583 2024-09-19T13:47:43.614 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.608+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~8C59KE1BC0QK.0 size=1048576 2024-09-19T13:47:43.616 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.612+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~8C59KE1BC0QK.1 size=927161 2024-09-19T13:47:43.616 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.612+0000 7fcf3240c8c0 1 > prepared multipart upload key=D1RMXGXS3O7Z upload=8C59KE1BC0QK tag=JJIBZ1M34FZL type=write size=3024313 2024-09-19T13:47:43.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.616+0000 7fcf3240c8c0 1 < canceled operation key=X9FGPMP30X47 tag=JXV2TU21M495 type=write size=556099 2024-09-19T13:47:43.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.620+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~WU6N9N5DR830.0 size=383673 2024-09-19T13:47:43.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.620+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=WU6N9N5DR830 tag=V2HMYGBFNJ2U type=write size=1432249 2024-09-19T13:47:43.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.624+0000 7fcf3240c8c0 1 < completed delete operation key=STMT6XU2EJQM tag=HTC4YSSUZ4R1 type=del 2024-09-19T13:47:43.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.628+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=E6DBTJ78XM6Z type=del size=3916520 2024-09-19T13:47:43.634 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.628+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~6G09E0S1DKHO.0 size=796471 2024-09-19T13:47:43.639 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.636+0000 7fcf3240c8c0 1 < completed multipart upload key=V8X0VBBNK83J upload=6G09E0S1DKHO tag=PV230Q2OYCHE type=write size=1845047 2024-09-19T13:47:43.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.636+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=0AEK90W173PW type=del size=308158 2024-09-19T13:47:43.645 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.640+0000 7fcf3240c8c0 1 < completed delete operation key=3TME221SA53E tag=M1QYU573XF9F type=del 2024-09-19T13:47:43.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.644+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=1KCFE8TEJ2TB type=del size=3368962 2024-09-19T13:47:43.651 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.648+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~4IMO5LEJUJ8B.0 size=13048 2024-09-19T13:47:43.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.652+0000 7fcf3240c8c0 1 < completed multipart upload key=QMSDNKYFFK1F upload=4IMO5LEJUJ8B tag=2JJ3YY9PP6Z8 type=write size=1061624 2024-09-19T13:47:43.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.652+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=EA33PW93ICZH type=write size=994066 2024-09-19T13:47:43.660 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.656+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~D9BLCH0RRN2T.0 size=1048576 2024-09-19T13:47:43.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.660+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~D9BLCH0RRN2T.1 size=1048576 2024-09-19T13:47:43.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.660+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~D9BLCH0RRN2T.2 size=636039 2024-09-19T13:47:43.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.664+0000 7fcf3240c8c0 1 < completed multipart upload key=6DFF2OCPT9W2 upload=D9BLCH0RRN2T tag=IUVYRH1WQXZX type=write size=3781767 2024-09-19T13:47:43.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.668+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=8BP3Q59AP3FE type=del size=2543686 2024-09-19T13:47:43.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.672+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~9DEW0O01YO2K.0 size=1048576 2024-09-19T13:47:43.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.672+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~9DEW0O01YO2K.1 size=1048576 2024-09-19T13:47:43.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.676+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~9DEW0O01YO2K.2 size=272276 2024-09-19T13:47:43.683 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.680+0000 7fcf3240c8c0 1 < completed multipart upload key=ZCKKQ1R8318S upload=9DEW0O01YO2K tag=SH1HOTB37Z7Z type=write size=3418004 2024-09-19T13:47:43.688 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.684+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~4D4A4TV4ED4J.0 size=1048576 2024-09-19T13:47:43.690 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.684+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~4D4A4TV4ED4J.1 size=1048576 2024-09-19T13:47:43.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.688+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~4D4A4TV4ED4J.2 size=639741 2024-09-19T13:47:43.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.688+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=4D4A4TV4ED4J tag=6012VN7EO89W type=write size=3785469 2024-09-19T13:47:43.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.692+0000 7fcf3240c8c0 1 < suggested update operation key=D1RMXGXS3O7Z tag=ZZNRP3CUZ9DO type=del size=1812545 2024-09-19T13:47:43.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.696+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=WZDGQJ7VSLS9 type=del size=3526658 2024-09-19T13:47:43.702 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.696+0000 7fcf3240c8c0 1 < canceled operation key=XE42LV5M5X82 tag=AB9JUA8IWQE8 type=write size=843404 2024-09-19T13:47:43.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.700+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=J5BS4KEL0HQV type=write size=81280 2024-09-19T13:47:43.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.704+0000 7fcf3240c8c0 1 < canceled operation key=XE42LV5M5X82 tag=WW6KIYRAA2JT type=del size=583069 2024-09-19T13:47:43.712 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.708+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~0T6EG0ND4KLF.0 size=690882 2024-09-19T13:47:43.713 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.708+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=0T6EG0ND4KLF tag=1M3GWGV0R6G5 type=write size=1739458 2024-09-19T13:47:43.715 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.712+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~PPUCUZUJEYZ2.0 size=1048576 2024-09-19T13:47:43.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.712+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~PPUCUZUJEYZ2.1 size=1048576 2024-09-19T13:47:43.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.716+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~PPUCUZUJEYZ2.2 size=24761 2024-09-19T13:47:43.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.720+0000 7fcf3240c8c0 1 < completed multipart upload key=3TME221SA53E upload=PPUCUZUJEYZ2 tag=9ON3MMO8UHP8 type=write size=3170489 2024-09-19T13:47:43.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.724+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=QTXG8VDOTAXF type=del size=2012070 2024-09-19T13:47:43.730 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.724+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~AWPVXLTNISKK.0 size=1048576 2024-09-19T13:47:43.732 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.728+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~AWPVXLTNISKK.1 size=375159 2024-09-19T13:47:43.736 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.732+0000 7fcf3240c8c0 1 < completed multipart upload key=ES62XJO5Q3FO upload=AWPVXLTNISKK tag=EB8J291PKZNT type=write size=2472311 2024-09-19T13:47:43.741 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.736+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~HNBFC9XNFRON.0 size=1048576 2024-09-19T13:47:43.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.740+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~HNBFC9XNFRON.1 size=1048576 2024-09-19T13:47:43.746 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.740+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~HNBFC9XNFRON.2 size=64092 2024-09-19T13:47:43.746 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.740+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=HNBFC9XNFRON tag=1M1OFSBWCQVW type=write size=3209820 2024-09-19T13:47:43.749 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.744+0000 7fcf3240c8c0 1 < completed delete operation key=QSM2Q8CW1Q86 tag=C1F0XQ8X8XKD type=del 2024-09-19T13:47:43.752 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.748+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=OHB8I8RZKMTL type=write size=723322 2024-09-19T13:47:43.756 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.752+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~67B3LT4HFVL9.0 size=1048576 2024-09-19T13:47:43.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.756+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~67B3LT4HFVL9.1 size=677136 2024-09-19T13:47:43.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.760+0000 7fcf3240c8c0 1 < completed multipart upload key=QAYJ5B1KZ08J upload=67B3LT4HFVL9 tag=46YYUB9M89QF type=write size=2774288 2024-09-19T13:47:43.766 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.760+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=TU4A2IB9C865 type=write size=394076 2024-09-19T13:47:43.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.764+0000 7fcf3240c8c0 -1 < failed to complete operation key=D1RMXGXS3O7Z tag=Q5I8LGPRVQJ7 type=del size=1059230: (22) Invalid argument 2024-09-19T13:47:43.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.772+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~HI3DMCEHZ48V.0 size=1048576 2024-09-19T13:47:43.777 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.772+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~HI3DMCEHZ48V.1 size=1048576 2024-09-19T13:47:43.783 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.780+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~HI3DMCEHZ48V.2 size=198617 2024-09-19T13:47:43.783 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.780+0000 7fcf3240c8c0 1 > prepared multipart upload key=STMT6XU2EJQM upload=HI3DMCEHZ48V tag=VA7YMEHDTTA5 type=write size=3344345 2024-09-19T13:47:43.786 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.784+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~8C59KE1BC0QK.0 size=1048576 2024-09-19T13:47:43.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.784+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~8C59KE1BC0QK.1 size=927161 2024-09-19T13:47:43.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.788+0000 7fcf3240c8c0 1 < completed multipart upload key=D1RMXGXS3O7Z upload=8C59KE1BC0QK tag=JJIBZ1M34FZL type=write size=3024313 2024-09-19T13:47:43.799 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.796+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~AO6NNFZIYFFK.0 size=1048576 2024-09-19T13:47:43.802 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.796+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~AO6NNFZIYFFK.1 size=796949 2024-09-19T13:47:43.802 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.796+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=AO6NNFZIYFFK tag=6BFJDPBTCTV9 type=write size=2894101 2024-09-19T13:47:43.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.800+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~WU6N9N5DR830.0 size=383673 2024-09-19T13:47:43.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.808+0000 7fcf3240c8c0 1 < completed multipart upload key=QMSDNKYFFK1F upload=WU6N9N5DR830 tag=V2HMYGBFNJ2U type=write size=1432249 2024-09-19T13:47:43.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.808+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=UDP9UGSG79X3 type=del size=3400654 2024-09-19T13:47:43.820 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.816+0000 7fcf3240c8c0 1 < suggested update operation key=XE42LV5M5X82 tag=E6DBTJ78XM6Z type=del size=3916520 2024-09-19T13:47:43.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.820+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=VFJ94LX4FX74 type=del size=263428 2024-09-19T13:47:43.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.820+0000 7fcf3240c8c0 1 < completed delete operation key=6DFF2OCPT9W2 tag=0AEK90W173PW type=del 2024-09-19T13:47:43.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.824+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=GQSXGLONEU4R type=write size=377757 2024-09-19T13:47:43.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.828+0000 7fcf3240c8c0 1 < completed delete operation key=X9FGPMP30X47 tag=1KCFE8TEJ2TB type=del 2024-09-19T13:47:43.838 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.832+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~96RGOL342MRX.0 size=1048576 2024-09-19T13:47:43.841 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.836+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~96RGOL342MRX.1 size=1048576 2024-09-19T13:47:43.843 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.840+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~96RGOL342MRX.2 size=428188 2024-09-19T13:47:43.843 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.840+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=96RGOL342MRX tag=Y0A08TWYXQHA type=write size=3573916 2024-09-19T13:47:43.846 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.840+0000 7fcf3240c8c0 1 < canceled operation key=AES54TJK7VH7 tag=EA33PW93ICZH type=write size=994066 2024-09-19T13:47:43.851 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.848+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~CA132I48URDW.0 size=126089 2024-09-19T13:47:43.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.848+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=CA132I48URDW tag=76942LBTGN4L type=write size=1174665 2024-09-19T13:47:43.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.852+0000 7fcf3240c8c0 1 < completed delete operation key=7UC85R2HO9K2 tag=8BP3Q59AP3FE type=del 2024-09-19T13:47:43.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.852+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=ZN22ZIFUKL5L type=del size=3917160 2024-09-19T13:47:43.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.856+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~4D4A4TV4ED4J.0 size=1048576 2024-09-19T13:47:43.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.860+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~4D4A4TV4ED4J.1 size=1048576 2024-09-19T13:47:43.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.860+0000 7fcf3240c8c0 1 < canceled part key=_multipart_QMSDNKYFFK1F.2~4D4A4TV4ED4J.2 size=639741 2024-09-19T13:47:43.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.864+0000 7fcf3240c8c0 1 < canceled multipart upload key=QMSDNKYFFK1F upload=4D4A4TV4ED4J tag=6012VN7EO89W type=write size=3785469 2024-09-19T13:47:43.874 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.868+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=LDWVP01HRRX4 type=del size=2030232 2024-09-19T13:47:43.877 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.872+0000 7fcf3240c8c0 1 < completed delete operation key=NP2L28YRVQ8L tag=WZDGQJ7VSLS9 type=del 2024-09-19T13:47:43.881 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.876+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=3YNFB5VTNYKG type=del size=115876 2024-09-19T13:47:43.885 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.880+0000 7fcf3240c8c0 1 < completed write operation key=QSM2Q8CW1Q86 tag=J5BS4KEL0HQV type=write size=81280 2024-09-19T13:47:43.892 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.888+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~KYLJZTX85304.0 size=959667 2024-09-19T13:47:43.892 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.888+0000 7fcf3240c8c0 1 > prepared multipart upload key=71Z2VTW99W7J upload=KYLJZTX85304 tag=AD9AO1YGZ1CW type=write size=2008243 2024-09-19T13:47:43.895 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.892+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~0T6EG0ND4KLF.0 size=690882 2024-09-19T13:47:43.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.896+0000 7fcf3240c8c0 1 < completed multipart upload key=AES54TJK7VH7 upload=0T6EG0ND4KLF tag=1M3GWGV0R6G5 type=write size=1739458 2024-09-19T13:47:43.907 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.904+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D1RMXGXS3O7Z.2~VLUOTBOUCW7P.0 size=500893 2024-09-19T13:47:43.907 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.904+0000 7fcf3240c8c0 1 > prepared multipart upload key=D1RMXGXS3O7Z upload=VLUOTBOUCW7P tag=7U9IQ1PCJ4V8 type=write size=1549469 2024-09-19T13:47:43.910 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.908+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=QTXG8VDOTAXF type=del 2024-09-19T13:47:43.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.912+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~GNL4ZU060S9D.0 size=681420 2024-09-19T13:47:43.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.912+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=GNL4ZU060S9D tag=UZ0SVST3G3RG type=write size=1729996 2024-09-19T13:47:43.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.916+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~HNBFC9XNFRON.0 size=1048576 2024-09-19T13:47:43.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.916+0000 7fcf3240c8c0 1 < canceled part key=_multipart_AES54TJK7VH7.2~HNBFC9XNFRON.1 size=1048576 2024-09-19T13:47:43.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.916+0000 7fcf3240c8c0 1 < canceled part key=_multipart_AES54TJK7VH7.2~HNBFC9XNFRON.2 size=64092 2024-09-19T13:47:43.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.924+0000 7fcf3240c8c0 1 < canceled multipart upload key=AES54TJK7VH7 upload=HNBFC9XNFRON tag=1M1OFSBWCQVW type=write size=3209820 2024-09-19T13:47:43.933 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.928+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~1NYFCCCMXCHJ.0 size=1048576 2024-09-19T13:47:43.936 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.932+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~1NYFCCCMXCHJ.1 size=1048576 2024-09-19T13:47:43.938 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.936+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~1NYFCCCMXCHJ.2 size=398374 2024-09-19T13:47:43.938 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.936+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=1NYFCCCMXCHJ tag=F81WO0AIUV9W type=write size=3544102 2024-09-19T13:47:43.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.936+0000 7fcf3240c8c0 1 < completed write operation key=M2CO4A2DHJ05 tag=OHB8I8RZKMTL type=write size=723322 2024-09-19T13:47:43.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.940+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=EAJSB5KST4BW type=del size=2285634 2024-09-19T13:47:43.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.944+0000 7fcf3240c8c0 1 < completed write operation key=D20C6C2ZFX1W tag=TU4A2IB9C865 type=write size=394076 2024-09-19T13:47:43.955 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.952+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~51JR1NQWUMDR.0 size=1048576 2024-09-19T13:47:43.957 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.952+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~51JR1NQWUMDR.1 size=911395 2024-09-19T13:47:43.957 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.952+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=51JR1NQWUMDR tag=LIWGFWBW0ODY type=write size=3008547 2024-09-19T13:47:43.958 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.956+0000 7fcf3240c8c0 1 < canceled part key=_multipart_STMT6XU2EJQM.2~HI3DMCEHZ48V.0 size=1048576 2024-09-19T13:47:43.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.956+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~HI3DMCEHZ48V.1 size=1048576 2024-09-19T13:47:43.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.960+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~HI3DMCEHZ48V.2 size=198617 2024-09-19T13:47:43.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.964+0000 7fcf3240c8c0 1 < canceled multipart upload key=STMT6XU2EJQM upload=HI3DMCEHZ48V tag=VA7YMEHDTTA5 type=write size=3344345 2024-09-19T13:47:43.975 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.972+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~C2CILZQ5G5UG.0 size=1048576 2024-09-19T13:47:43.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.972+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~C2CILZQ5G5UG.1 size=687760 2024-09-19T13:47:43.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.972+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=C2CILZQ5G5UG tag=E9YXAU3TOQQZ type=write size=2784912 2024-09-19T13:47:43.981 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.976+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~AO6NNFZIYFFK.0 size=1048576 2024-09-19T13:47:43.984 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.980+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~AO6NNFZIYFFK.1 size=796949 2024-09-19T13:47:43.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.984+0000 7fcf3240c8c0 1 < completed multipart upload key=AES54TJK7VH7 upload=AO6NNFZIYFFK tag=6BFJDPBTCTV9 type=write size=2894101 2024-09-19T13:47:43.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.988+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=NX8Y79SJ577Q type=del size=2388719 2024-09-19T13:47:44.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:43.996+0000 7fcf3240c8c0 1 < suggested update operation key=STMT6XU2EJQM tag=UDP9UGSG79X3 type=del size=3400654 2024-09-19T13:47:44.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.000+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=IXXQO3770RBQ type=del size=3221545 2024-09-19T13:47:44.006 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.000+0000 7fcf3240c8c0 1 < completed delete operation key=A02RDP6BA9AC tag=VFJ94LX4FX74 type=del 2024-09-19T13:47:44.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.004+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=U6QFCNZYLXQP type=del size=4017922 2024-09-19T13:47:44.013 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.008+0000 7fcf3240c8c0 1 < completed write operation key=XE42LV5M5X82 tag=GQSXGLONEU4R type=write size=377757 2024-09-19T13:47:44.016 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.012+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=QU5SAKIN3YEI type=del size=2665714 2024-09-19T13:47:44.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.016+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~96RGOL342MRX.0 size=1048576 2024-09-19T13:47:44.022 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.016+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~96RGOL342MRX.1 size=1048576 2024-09-19T13:47:44.024 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.020+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~96RGOL342MRX.2 size=428188 2024-09-19T13:47:44.029 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.024+0000 7fcf3240c8c0 1 < completed multipart upload key=QAYJ5B1KZ08J upload=96RGOL342MRX tag=Y0A08TWYXQHA type=write size=3573916 2024-09-19T13:47:44.033 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.028+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=00ZYZX0K1NY0 type=write size=957784 2024-09-19T13:47:44.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.032+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~CA132I48URDW.0 size=126089 2024-09-19T13:47:44.040 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.036+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=CA132I48URDW tag=76942LBTGN4L type=write size=1174665 2024-09-19T13:47:44.043 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.040+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=6A6K2DD4U3WS type=del size=3401413 2024-09-19T13:47:44.048 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.044+0000 7fcf3240c8c0 1 < suggested update operation key=X16ENUFL40RN tag=ZN22ZIFUKL5L type=del size=3917160 2024-09-19T13:47:44.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.048+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~011UAFNVFNX4.0 size=552142 2024-09-19T13:47:44.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.048+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=011UAFNVFNX4 tag=BYUHU1N5F4G8 type=write size=1600718 2024-09-19T13:47:44.057 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.052+0000 7fcf3240c8c0 1 < completed delete operation key=71Z2VTW99W7J tag=LDWVP01HRRX4 type=del 2024-09-19T13:47:44.060 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.056+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=JV14KJ1NM5BA type=del size=1545643 2024-09-19T13:47:44.063 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.060+0000 7fcf3240c8c0 1 < completed delete operation key=NP2L28YRVQ8L tag=3YNFB5VTNYKG type=del 2024-09-19T13:47:44.069 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.064+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~AZW0RI6A4X3S.0 size=420580 2024-09-19T13:47:44.069 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.064+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=AZW0RI6A4X3S tag=YS6JLQM3AZUG type=write size=1469156 2024-09-19T13:47:44.073 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.068+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~KYLJZTX85304.0 size=959667 2024-09-19T13:47:44.077 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.072+0000 7fcf3240c8c0 1 < completed multipart upload key=71Z2VTW99W7J upload=KYLJZTX85304 tag=AD9AO1YGZ1CW type=write size=2008243 2024-09-19T13:47:44.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.076+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=V2LBVUU2V1V1 type=write size=81502 2024-09-19T13:47:44.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.084+0000 7fcf3240c8c0 1 < completed part key=_multipart_D1RMXGXS3O7Z.2~VLUOTBOUCW7P.0 size=500893 2024-09-19T13:47:44.092 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.088+0000 7fcf3240c8c0 1 < completed multipart upload key=D1RMXGXS3O7Z upload=VLUOTBOUCW7P tag=7U9IQ1PCJ4V8 type=write size=1549469 2024-09-19T13:47:44.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.092+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=F0FPVV08P3T2 type=del size=2051361 2024-09-19T13:47:44.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.096+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~GNL4ZU060S9D.0 size=681420 2024-09-19T13:47:44.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.100+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=GNL4ZU060S9D tag=UZ0SVST3G3RG type=write size=1729996 2024-09-19T13:47:44.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.100+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=8WKMIWZCO0Y3 type=write size=1032896 2024-09-19T13:47:44.108 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.104+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~1NYFCCCMXCHJ.0 size=1048576 2024-09-19T13:47:44.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.108+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~1NYFCCCMXCHJ.1 size=1048576 2024-09-19T13:47:44.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.108+0000 7fcf3240c8c0 1 < canceled part key=_multipart_HXMZKP7H3HJE.2~1NYFCCCMXCHJ.2 size=398374 2024-09-19T13:47:44.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.112+0000 7fcf3240c8c0 1 < canceled multipart upload key=HXMZKP7H3HJE upload=1NYFCCCMXCHJ tag=F81WO0AIUV9W type=write size=3544102 2024-09-19T13:47:44.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.116+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~FGQ08VU4FYPI.0 size=1048576 2024-09-19T13:47:44.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.120+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~FGQ08VU4FYPI.1 size=677930 2024-09-19T13:47:44.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.120+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=FGQ08VU4FYPI tag=OL8W7H5H3B6O type=write size=2775082 2024-09-19T13:47:44.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.120+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=EAJSB5KST4BW type=del 2024-09-19T13:47:44.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.124+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=CQK8OKIJAK2H type=write size=97413 2024-09-19T13:47:44.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.128+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~51JR1NQWUMDR.0 size=1048576 2024-09-19T13:47:44.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.128+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~51JR1NQWUMDR.1 size=911395 2024-09-19T13:47:44.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.132+0000 7fcf3240c8c0 1 < completed multipart upload key=AES54TJK7VH7 upload=51JR1NQWUMDR tag=LIWGFWBW0ODY type=write size=3008547 2024-09-19T13:47:44.143 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.140+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~3R7V93SBPHG7.0 size=1048576 2024-09-19T13:47:44.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.140+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~3R7V93SBPHG7.1 size=1048576 2024-09-19T13:47:44.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.144+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~3R7V93SBPHG7.2 size=624134 2024-09-19T13:47:44.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.144+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=3R7V93SBPHG7 tag=5DKXLLUEGWOE type=write size=3769862 2024-09-19T13:47:44.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.144+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~C2CILZQ5G5UG.0 size=1048576 2024-09-19T13:47:44.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.148+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~C2CILZQ5G5UG.1 size=687760 2024-09-19T13:47:44.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.152+0000 7fcf3240c8c0 1 < completed multipart upload key=QSM2Q8CW1Q86 upload=C2CILZQ5G5UG tag=E9YXAU3TOQQZ type=write size=2784912 2024-09-19T13:47:44.159 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.156+0000 7fcf3240c8c0 1 > prepared operation key=3TME221SA53E tag=RZ6YY6U7R6BA type=del size=1092196 2024-09-19T13:47:44.162 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.156+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=NX8Y79SJ577Q type=del 2024-09-19T13:47:44.165 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.160+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=1EC7NQSPZL0A type=del size=1293585 2024-09-19T13:47:44.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.164+0000 7fcf3240c8c0 1 < completed delete operation key=M2CO4A2DHJ05 tag=IXXQO3770RBQ type=del 2024-09-19T13:47:44.171 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.168+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=N4SDS8OFHYEO type=del size=183995 2024-09-19T13:47:44.174 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.168+0000 7fcf3240c8c0 1 < completed delete operation key=C3TFYNXH549T tag=U6QFCNZYLXQP type=del 2024-09-19T13:47:44.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.172+0000 7fcf3240c8c0 1 > prepared operation key=DHPONKOVS8CT tag=EZTTKYXTOB8E type=write size=163209 2024-09-19T13:47:44.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.176+0000 7fcf3240c8c0 1 < completed delete operation key=3TME221SA53E tag=QU5SAKIN3YEI type=del 2024-09-19T13:47:44.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.180+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=BA2V97QBXE8D type=del size=1042968 2024-09-19T13:47:44.189 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.184+0000 7fcf3240c8c0 1 < suggested update operation key=NP2L28YRVQ8L tag=00ZYZX0K1NY0 type=write size=957784 2024-09-19T13:47:44.196 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.192+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~KLOZS0231L9Y.0 size=1048576 2024-09-19T13:47:44.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.196+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~KLOZS0231L9Y.1 size=1048576 2024-09-19T13:47:44.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.196+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~KLOZS0231L9Y.2 size=504544 2024-09-19T13:47:44.201 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.196+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=KLOZS0231L9Y tag=OFKNQED9DJ4T type=write size=3650272 2024-09-19T13:47:44.204 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.200+0000 7fcf3240c8c0 1 < completed delete operation key=7UC85R2HO9K2 tag=6A6K2DD4U3WS type=del 2024-09-19T13:47:44.207 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.204+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=U14IOSYT5N5D type=del size=3791010 2024-09-19T13:47:44.210 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.208+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~011UAFNVFNX4.0 size=552142 2024-09-19T13:47:44.215 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.212+0000 7fcf3240c8c0 1 < completed multipart upload key=ES62XJO5Q3FO upload=011UAFNVFNX4 tag=BYUHU1N5F4G8 type=write size=1600718 2024-09-19T13:47:44.221 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.216+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~1J04PGMEXHA7.0 size=1048576 2024-09-19T13:47:44.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.220+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~1J04PGMEXHA7.1 size=824951 2024-09-19T13:47:44.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.220+0000 7fcf3240c8c0 1 > prepared multipart upload key=1BMF3S2BZLLI upload=1J04PGMEXHA7 tag=XC90YD93YSIG type=write size=2922103 2024-09-19T13:47:44.230 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.224+0000 7fcf3240c8c0 1 < suggested remove operation key=X16ENUFL40RN tag=JV14KJ1NM5BA type=del 2024-09-19T13:47:44.237 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.232+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~P04OC6DDB5L4.0 size=1048576 2024-09-19T13:47:44.240 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.236+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~P04OC6DDB5L4.1 size=1048576 2024-09-19T13:47:44.242 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.240+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~P04OC6DDB5L4.2 size=39384 2024-09-19T13:47:44.242 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.240+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=P04OC6DDB5L4 tag=S52LE4BY0GN0 type=write size=3185112 2024-09-19T13:47:44.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.240+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~AZW0RI6A4X3S.0 size=420580 2024-09-19T13:47:44.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.248+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=AZW0RI6A4X3S tag=YS6JLQM3AZUG type=write size=1469156 2024-09-19T13:47:44.255 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.252+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=QV0FOSCCARM3 type=del size=1417980 2024-09-19T13:47:44.258 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.256+0000 7fcf3240c8c0 1 < completed write operation key=1BMF3S2BZLLI tag=V2LBVUU2V1V1 type=write size=81502 2024-09-19T13:47:44.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.260+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~HKX78X5JFG9A.0 size=1048576 2024-09-19T13:47:44.268 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.264+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~HKX78X5JFG9A.1 size=744170 2024-09-19T13:47:44.268 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.264+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=HKX78X5JFG9A tag=OQIP4HDBPAKP type=write size=2841322 2024-09-19T13:47:44.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.272+0000 7fcf3240c8c0 1 < suggested remove operation key=D20C6C2ZFX1W tag=F0FPVV08P3T2 type=del 2024-09-19T13:47:44.278 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.272+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=0JYTDWM8GZ3X type=write size=314699 2024-09-19T13:47:44.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.276+0000 7fcf3240c8c0 -1 < failed to complete operation key=X16ENUFL40RN tag=8WKMIWZCO0Y3 type=write size=1032896: (22) Invalid argument 2024-09-19T13:47:44.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.280+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=HK6WLU2XMXVD type=write size=899679 2024-09-19T13:47:44.286 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.280+0000 7fcf3240c8c0 1 < canceled part key=_multipart_ES62XJO5Q3FO.2~FGQ08VU4FYPI.0 size=1048576 2024-09-19T13:47:44.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.284+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~FGQ08VU4FYPI.1 size=677930 2024-09-19T13:47:44.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.292+0000 7fcf3240c8c0 1 < canceled multipart upload key=ES62XJO5Q3FO upload=FGQ08VU4FYPI tag=OL8W7H5H3B6O type=write size=2775082 2024-09-19T13:47:44.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.296+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=12DSRKL6Z1GL type=del size=1243871 2024-09-19T13:47:44.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.296+0000 7fcf3240c8c0 1 < completed write operation key=V8X0VBBNK83J tag=CQK8OKIJAK2H type=write size=97413 2024-09-19T13:47:44.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.304+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~D1G2A0MEIP22.0 size=1048576 2024-09-19T13:47:44.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.308+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~D1G2A0MEIP22.1 size=1048576 2024-09-19T13:47:44.314 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.308+0000 7fcf3240c8c0 1 > prepared part key=_multipart_V8X0VBBNK83J.2~D1G2A0MEIP22.2 size=911725 2024-09-19T13:47:44.314 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.308+0000 7fcf3240c8c0 1 > prepared multipart upload key=V8X0VBBNK83J upload=D1G2A0MEIP22 tag=YQ1J1Y0QTM8D type=write size=4057453 2024-09-19T13:47:44.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.312+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~3R7V93SBPHG7.0 size=1048576 2024-09-19T13:47:44.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.316+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~3R7V93SBPHG7.1 size=1048576 2024-09-19T13:47:44.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.320+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~3R7V93SBPHG7.2 size=624134 2024-09-19T13:47:44.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.324+0000 7fcf3240c8c0 1 < completed multipart upload key=9ICCISYXT0IV upload=3R7V93SBPHG7 tag=5DKXLLUEGWOE type=write size=3769862 2024-09-19T13:47:44.332 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.328+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=WBV8RHGYJX9P type=write size=659281 2024-09-19T13:47:44.336 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.332+0000 7fcf3240c8c0 1 < completed delete operation key=3TME221SA53E tag=RZ6YY6U7R6BA type=del 2024-09-19T13:47:44.339 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.336+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=P1J3EXAMPGBY type=write size=871356 2024-09-19T13:47:44.343 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.340+0000 7fcf3240c8c0 1 < completed delete operation key=XE42LV5M5X82 tag=1EC7NQSPZL0A type=del 2024-09-19T13:47:44.346 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.340+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=LBP53RH6PXM9 type=del size=2515026 2024-09-19T13:47:44.353 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.348+0000 7fcf3240c8c0 1 < suggested remove operation key=C35EUAOWLBR3 tag=N4SDS8OFHYEO type=del 2024-09-19T13:47:44.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.352+0000 7fcf3240c8c0 1 > prepared operation key=QMSDNKYFFK1F tag=IEVHPCHWQ5VN type=del size=1411562 2024-09-19T13:47:44.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.360+0000 7fcf3240c8c0 1 < suggested remove operation key=DHPONKOVS8CT tag=EZTTKYXTOB8E type=write 2024-09-19T13:47:44.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.364+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~W5OI1ZZN9TKD.0 size=293806 2024-09-19T13:47:44.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.364+0000 7fcf3240c8c0 1 > prepared multipart upload key=3TME221SA53E upload=W5OI1ZZN9TKD tag=AWGUL9AUYKTA type=write size=1342382 2024-09-19T13:47:44.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.368+0000 7fcf3240c8c0 1 < completed delete operation key=C3TFYNXH549T tag=BA2V97QBXE8D type=del 2024-09-19T13:47:44.379 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.376+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~VVU58QNK3YL4.0 size=1048576 2024-09-19T13:47:44.385 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.380+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~VVU58QNK3YL4.1 size=975252 2024-09-19T13:47:44.385 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.380+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=VVU58QNK3YL4 tag=SGPTEVQ3TADL type=write size=3072404 2024-09-19T13:47:44.388 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.384+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~KLOZS0231L9Y.0 size=1048576 2024-09-19T13:47:44.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.388+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~KLOZS0231L9Y.1 size=1048576 2024-09-19T13:47:44.394 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.388+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~KLOZS0231L9Y.2 size=504544 2024-09-19T13:47:44.400 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.396+0000 7fcf3240c8c0 1 < completed multipart upload key=M2CO4A2DHJ05 upload=KLOZS0231L9Y tag=OFKNQED9DJ4T type=write size=3650272 2024-09-19T13:47:44.407 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.404+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~7IYH4TPYST6U.0 size=1048576 2024-09-19T13:47:44.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.404+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~7IYH4TPYST6U.1 size=1048576 2024-09-19T13:47:44.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.408+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~7IYH4TPYST6U.2 size=13254 2024-09-19T13:47:44.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.408+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=7IYH4TPYST6U tag=IIW049TQW1T6 type=write size=3158982 2024-09-19T13:47:44.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.412+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=U14IOSYT5N5D type=del 2024-09-19T13:47:44.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.416+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~RR1IM9QPWOAZ.0 size=530762 2024-09-19T13:47:44.420 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.416+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=RR1IM9QPWOAZ tag=QFOJSZTD0GAU type=write size=1579338 2024-09-19T13:47:44.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.420+0000 7fcf3240c8c0 1 < completed part key=_multipart_1BMF3S2BZLLI.2~1J04PGMEXHA7.0 size=1048576 2024-09-19T13:47:44.425 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.420+0000 7fcf3240c8c0 1 < completed part key=_multipart_1BMF3S2BZLLI.2~1J04PGMEXHA7.1 size=824951 2024-09-19T13:47:44.429 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.424+0000 7fcf3240c8c0 1 < completed multipart upload key=1BMF3S2BZLLI upload=1J04PGMEXHA7 tag=XC90YD93YSIG type=write size=2922103 2024-09-19T13:47:44.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.432+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~8R7OXLZ96C4K.0 size=1048576 2024-09-19T13:47:44.436 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.432+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~8R7OXLZ96C4K.1 size=544449 2024-09-19T13:47:44.436 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.432+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=8R7OXLZ96C4K tag=TY15CJLZG1DV type=write size=2641601 2024-09-19T13:47:44.439 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.436+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~P04OC6DDB5L4.0 size=1048576 2024-09-19T13:47:44.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.436+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~P04OC6DDB5L4.1 size=1048576 2024-09-19T13:47:44.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.440+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~P04OC6DDB5L4.2 size=39384 2024-09-19T13:47:44.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.444+0000 7fcf3240c8c0 1 < completed multipart upload key=D20C6C2ZFX1W upload=P04OC6DDB5L4 tag=S52LE4BY0GN0 type=write size=3185112 2024-09-19T13:47:44.451 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.448+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=IX372T5NJAMS type=write size=720920 2024-09-19T13:47:44.456 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.452+0000 7fcf3240c8c0 1 < suggested update operation key=ZCKKQ1R8318S tag=QV0FOSCCARM3 type=del size=1417980 2024-09-19T13:47:44.461 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.456+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~IL35NBUPOIDX.0 size=882714 2024-09-19T13:47:44.461 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.456+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=IL35NBUPOIDX tag=87O29DEC6X28 type=write size=1931290 2024-09-19T13:47:44.464 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.460+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~HKX78X5JFG9A.0 size=1048576 2024-09-19T13:47:44.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.464+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~HKX78X5JFG9A.1 size=744170 2024-09-19T13:47:44.471 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.468+0000 7fcf3240c8c0 1 < completed multipart upload key=0UCFTOF1YBBM upload=HKX78X5JFG9A tag=OQIP4HDBPAKP type=write size=2841322 2024-09-19T13:47:44.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.472+0000 7fcf3240c8c0 1 > prepared operation key=X9FGPMP30X47 tag=UB9BG6UG448A type=write size=131914 2024-09-19T13:47:44.477 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.472+0000 7fcf3240c8c0 1 < completed write operation key=X16ENUFL40RN tag=0JYTDWM8GZ3X type=write size=314699 2024-09-19T13:47:44.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.476+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=SMQRPM5WGE0U type=del size=3960880 2024-09-19T13:47:44.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.480+0000 7fcf3240c8c0 1 < completed write operation key=D1RMXGXS3O7Z tag=HK6WLU2XMXVD type=write size=899679 2024-09-19T13:47:44.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.480+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=UW1D0FFEKK4O type=del size=569966 2024-09-19T13:47:44.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.484+0000 7fcf3240c8c0 1 < completed delete operation key=STMT6XU2EJQM tag=12DSRKL6Z1GL type=del 2024-09-19T13:47:44.491 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.488+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=4QBXOVFX92O3 type=del size=3437689 2024-09-19T13:47:44.495 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.492+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~D1G2A0MEIP22.0 size=1048576 2024-09-19T13:47:44.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.492+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~D1G2A0MEIP22.1 size=1048576 2024-09-19T13:47:44.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.496+0000 7fcf3240c8c0 1 < completed part key=_multipart_V8X0VBBNK83J.2~D1G2A0MEIP22.2 size=911725 2024-09-19T13:47:44.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.500+0000 7fcf3240c8c0 1 < completed multipart upload key=V8X0VBBNK83J upload=D1G2A0MEIP22 tag=YQ1J1Y0QTM8D type=write size=4057453 2024-09-19T13:47:44.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.504+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=2QTLFAJCE4P0 type=del size=3094843 2024-09-19T13:47:44.515 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.512+0000 7fcf3240c8c0 1 < suggested update operation key=6DFF2OCPT9W2 tag=WBV8RHGYJX9P type=write size=659281 2024-09-19T13:47:44.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.516+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~9KUQXUEFGJT1.0 size=1048576 2024-09-19T13:47:44.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.516+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~9KUQXUEFGJT1.1 size=873929 2024-09-19T13:47:44.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.516+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=9KUQXUEFGJT1 tag=GIWDQ3A6E0DE type=write size=2971081 2024-09-19T13:47:44.527 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.524+0000 7fcf3240c8c0 1 < suggested update operation key=6DFF2OCPT9W2 tag=P1J3EXAMPGBY type=write size=871356 2024-09-19T13:47:44.530 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.524+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=SV14E00TUWMP type=del size=1848370 2024-09-19T13:47:44.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.532+0000 7fcf3240c8c0 1 < suggested update operation key=9ICCISYXT0IV tag=LBP53RH6PXM9 type=del size=2515026 2024-09-19T13:47:44.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.532+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=WJMHUAPEFXTP type=write size=219510 2024-09-19T13:47:44.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.536+0000 7fcf3240c8c0 1 < completed delete operation key=QMSDNKYFFK1F tag=IEVHPCHWQ5VN type=del 2024-09-19T13:47:44.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.540+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~WJNMM1J9N8WT.0 size=666724 2024-09-19T13:47:44.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.540+0000 7fcf3240c8c0 1 > prepared multipart upload key=X16ENUFL40RN upload=WJNMM1J9N8WT tag=XO8CEVX29CGO type=write size=1715300 2024-09-19T13:47:44.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.544+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~W5OI1ZZN9TKD.0 size=293806 2024-09-19T13:47:44.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.548+0000 7fcf3240c8c0 1 < completed multipart upload key=3TME221SA53E upload=W5OI1ZZN9TKD tag=AWGUL9AUYKTA type=write size=1342382 2024-09-19T13:47:44.557 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.552+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X9FGPMP30X47.2~WT2TB0Q4Y8WD.0 size=507861 2024-09-19T13:47:44.557 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.552+0000 7fcf3240c8c0 1 > prepared multipart upload key=X9FGPMP30X47 upload=WT2TB0Q4Y8WD tag=HBD0YNNVRJDK type=write size=1556437 2024-09-19T13:47:44.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.556+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~VVU58QNK3YL4.0 size=1048576 2024-09-19T13:47:44.562 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.556+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~VVU58QNK3YL4.1 size=975252 2024-09-19T13:47:44.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.564+0000 7fcf3240c8c0 1 < completed multipart upload key=0UCFTOF1YBBM upload=VVU58QNK3YL4 tag=SGPTEVQ3TADL type=write size=3072404 2024-09-19T13:47:44.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.564+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=6ALYNNB1BY47 type=del size=3672241 2024-09-19T13:47:44.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.568+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~7IYH4TPYST6U.0 size=1048576 2024-09-19T13:47:44.574 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.568+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~7IYH4TPYST6U.1 size=1048576 2024-09-19T13:47:44.576 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.572+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~7IYH4TPYST6U.2 size=13254 2024-09-19T13:47:44.581 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.576+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=7IYH4TPYST6U tag=IIW049TQW1T6 type=write size=3158982 2024-09-19T13:47:44.585 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.580+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~0A0ZDYTSOWK8.0 size=1048576 2024-09-19T13:47:44.587 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.584+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~0A0ZDYTSOWK8.1 size=510753 2024-09-19T13:47:44.587 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.584+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=0A0ZDYTSOWK8 tag=GPTU27EU16NX type=write size=2607905 2024-09-19T13:47:44.590 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.584+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~RR1IM9QPWOAZ.0 size=530762 2024-09-19T13:47:44.594 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.592+0000 7fcf3240c8c0 1 < completed multipart upload key=0UCFTOF1YBBM upload=RR1IM9QPWOAZ tag=QFOJSZTD0GAU type=write size=1579338 2024-09-19T13:47:44.597 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.592+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=2EH3ZLZ4GJAH type=del size=1637694 2024-09-19T13:47:44.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.596+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~8R7OXLZ96C4K.0 size=1048576 2024-09-19T13:47:44.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.596+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~8R7OXLZ96C4K.1 size=544449 2024-09-19T13:47:44.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.604+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=8R7OXLZ96C4K tag=TY15CJLZG1DV type=write size=2641601 2024-09-19T13:47:44.611 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.608+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~2ALM3FN3LSSK.0 size=1048576 2024-09-19T13:47:44.613 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.608+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~2ALM3FN3LSSK.1 size=601336 2024-09-19T13:47:44.613 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.608+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=2ALM3FN3LSSK tag=M428GB7BRKN2 type=write size=2698488 2024-09-19T13:47:44.616 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.612+0000 7fcf3240c8c0 -1 < failed to complete operation key=ZCKKQ1R8318S tag=IX372T5NJAMS type=write size=720920: (22) Invalid argument 2024-09-19T13:47:44.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.616+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=UR4ELCVBKSFC type=del size=2202533 2024-09-19T13:47:44.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.616+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~IL35NBUPOIDX.0 size=882714 2024-09-19T13:47:44.626 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.620+0000 7fcf3240c8c0 1 < completed multipart upload key=QSM2Q8CW1Q86 upload=IL35NBUPOIDX tag=87O29DEC6X28 type=write size=1931290 2024-09-19T13:47:44.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.624+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=08K2M59R0D0P type=del size=286248 2024-09-19T13:47:44.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.628+0000 7fcf3240c8c0 1 < completed write operation key=X9FGPMP30X47 tag=UB9BG6UG448A type=write size=131914 2024-09-19T13:47:44.634 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.628+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=KTF1STEOHSH2 type=del size=2088100 2024-09-19T13:47:44.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.632+0000 7fcf3240c8c0 1 < completed delete operation key=X16ENUFL40RN tag=SMQRPM5WGE0U type=del 2024-09-19T13:47:44.645 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.640+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~SZ78NK8H29ZW.0 size=1048576 2024-09-19T13:47:44.647 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.644+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~SZ78NK8H29ZW.1 size=624557 2024-09-19T13:47:44.647 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.644+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=SZ78NK8H29ZW tag=53AVPKGF011Y type=write size=2721709 2024-09-19T13:47:44.649 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.644+0000 7fcf3240c8c0 1 < completed delete operation key=M2CO4A2DHJ05 tag=UW1D0FFEKK4O type=del 2024-09-19T13:47:44.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.648+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=6QDUYRUIV9Y9 type=del size=3271590 2024-09-19T13:47:44.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.652+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=4QBXOVFX92O3 type=del 2024-09-19T13:47:44.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.652+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=9ZXBIS9VA3YJ type=del size=3183036 2024-09-19T13:47:44.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.656+0000 7fcf3240c8c0 1 < completed delete operation key=HXMZKP7H3HJE tag=2QTLFAJCE4P0 type=del 2024-09-19T13:47:44.664 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.660+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=PX1GCI2ATG7W type=del size=1889179 2024-09-19T13:47:44.668 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.664+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~9KUQXUEFGJT1.0 size=1048576 2024-09-19T13:47:44.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.664+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~9KUQXUEFGJT1.1 size=873929 2024-09-19T13:47:44.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.672+0000 7fcf3240c8c0 1 < completed multipart upload key=AES54TJK7VH7 upload=9KUQXUEFGJT1 tag=GIWDQ3A6E0DE type=write size=2971081 2024-09-19T13:47:44.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.676+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=B0Q08WLDDEBE type=del size=2065855 2024-09-19T13:47:44.682 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.676+0000 7fcf3240c8c0 1 < completed delete operation key=D1RMXGXS3O7Z tag=SV14E00TUWMP type=del 2024-09-19T13:47:44.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.680+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=WNX80ZVZGX9G type=write size=458082 2024-09-19T13:47:44.688 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.684+0000 7fcf3240c8c0 1 < completed write operation key=NP2L28YRVQ8L tag=WJMHUAPEFXTP type=write size=219510 2024-09-19T13:47:44.691 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.688+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=NO02HKIOKU44 type=del size=2907990 2024-09-19T13:47:44.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.692+0000 7fcf3240c8c0 1 < completed part key=_multipart_X16ENUFL40RN.2~WJNMM1J9N8WT.0 size=666724 2024-09-19T13:47:44.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.696+0000 7fcf3240c8c0 1 < completed multipart upload key=X16ENUFL40RN upload=WJNMM1J9N8WT tag=XO8CEVX29CGO type=write size=1715300 2024-09-19T13:47:44.704 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.700+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~I6Q8VZPV4TGY.0 size=938070 2024-09-19T13:47:44.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.700+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=I6Q8VZPV4TGY tag=X5K3M8FF2UA2 type=write size=1986646 2024-09-19T13:47:44.707 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.704+0000 7fcf3240c8c0 1 < completed part key=_multipart_X9FGPMP30X47.2~WT2TB0Q4Y8WD.0 size=507861 2024-09-19T13:47:44.712 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.708+0000 7fcf3240c8c0 1 < completed multipart upload key=X9FGPMP30X47 upload=WT2TB0Q4Y8WD tag=HBD0YNNVRJDK type=write size=1556437 2024-09-19T13:47:44.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.712+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~6WF3I1KOKQEN.0 size=1048576 2024-09-19T13:47:44.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.716+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~6WF3I1KOKQEN.1 size=1048576 2024-09-19T13:47:44.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.720+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~6WF3I1KOKQEN.2 size=934811 2024-09-19T13:47:44.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.720+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=6WF3I1KOKQEN tag=T1BGFE18VSIN type=write size=4080539 2024-09-19T13:47:44.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.724+0000 7fcf3240c8c0 1 < suggested update operation key=7UC85R2HO9K2 tag=6ALYNNB1BY47 type=del size=3672241 2024-09-19T13:47:44.732 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.728+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=PUWF13726ADR type=del size=3303831 2024-09-19T13:47:44.736 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.732+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~0A0ZDYTSOWK8.0 size=1048576 2024-09-19T13:47:44.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.736+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~0A0ZDYTSOWK8.1 size=510753 2024-09-19T13:47:44.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.740+0000 7fcf3240c8c0 1 < completed multipart upload key=QAYJ5B1KZ08J upload=0A0ZDYTSOWK8 tag=GPTU27EU16NX type=write size=2607905 2024-09-19T13:47:44.747 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.744+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=OHUYIGOWFJ0S type=del size=4145369 2024-09-19T13:47:44.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.748+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=2EH3ZLZ4GJAH type=del 2024-09-19T13:47:44.754 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.748+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=PWU0I3RXHS42 type=del size=2734583 2024-09-19T13:47:44.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.752+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~2ALM3FN3LSSK.0 size=1048576 2024-09-19T13:47:44.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.756+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~2ALM3FN3LSSK.1 size=601336 2024-09-19T13:47:44.764 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.760+0000 7fcf3240c8c0 1 < completed multipart upload key=AES54TJK7VH7 upload=2ALM3FN3LSSK tag=M428GB7BRKN2 type=write size=2698488 2024-09-19T13:47:44.766 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.760+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=L23TSH87WDFO type=del size=1715818 2024-09-19T13:47:44.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.764+0000 7fcf3240c8c0 1 < canceled operation key=ES62XJO5Q3FO tag=UR4ELCVBKSFC type=del size=2202533 2024-09-19T13:47:44.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.768+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~PZEFNXUDCTAW.0 size=1048576 2024-09-19T13:47:44.776 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.772+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~PZEFNXUDCTAW.1 size=1048576 2024-09-19T13:47:44.778 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.772+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~PZEFNXUDCTAW.2 size=335302 2024-09-19T13:47:44.778 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.772+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=PZEFNXUDCTAW tag=KV99XJJCX6IC type=write size=3481030 2024-09-19T13:47:44.781 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.776+0000 7fcf3240c8c0 1 < completed delete operation key=X16ENUFL40RN tag=08K2M59R0D0P type=del 2024-09-19T13:47:44.784 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.780+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=I8B2RP66KZWK type=del size=2155893 2024-09-19T13:47:44.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.784+0000 7fcf3240c8c0 1 < canceled operation key=BXUPV5XSJBTH tag=KTF1STEOHSH2 type=del size=2088100 2024-09-19T13:47:44.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.788+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=1ZVN89BWGM6E type=del size=2119725 2024-09-19T13:47:44.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.788+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~SZ78NK8H29ZW.0 size=1048576 2024-09-19T13:47:44.797 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.792+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~SZ78NK8H29ZW.1 size=624557 2024-09-19T13:47:44.802 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.796+0000 7fcf3240c8c0 1 < completed multipart upload key=QMSDNKYFFK1F upload=SZ78NK8H29ZW tag=53AVPKGF011Y type=write size=2721709 2024-09-19T13:47:44.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.800+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=IC4SBO38G4Z4 type=del size=3591359 2024-09-19T13:47:44.809 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.804+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=6QDUYRUIV9Y9 type=del 2024-09-19T13:47:44.814 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.808+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~8D63EY36TNS8.0 size=1048576 2024-09-19T13:47:44.817 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.812+0000 7fcf3240c8c0 1 > prepared part key=_multipart_M2CO4A2DHJ05.2~8D63EY36TNS8.1 size=171392 2024-09-19T13:47:44.817 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.812+0000 7fcf3240c8c0 1 > prepared multipart upload key=M2CO4A2DHJ05 upload=8D63EY36TNS8 tag=3AZTDAC4AQYS type=write size=2268544 2024-09-19T13:47:44.819 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.816+0000 7fcf3240c8c0 1 < completed delete operation key=71Z2VTW99W7J tag=9ZXBIS9VA3YJ type=del 2024-09-19T13:47:44.822 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.816+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=ZT1FRPBAQH7X type=del size=604111 2024-09-19T13:47:44.824 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.820+0000 7fcf3240c8c0 1 < canceled operation key=A02RDP6BA9AC tag=PX1GCI2ATG7W type=del size=1889179 2024-09-19T13:47:44.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.824+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~JT8OZZJVGEQ3.0 size=1048576 2024-09-19T13:47:44.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.828+0000 7fcf3240c8c0 1 > prepared part key=_multipart_6DFF2OCPT9W2.2~JT8OZZJVGEQ3.1 size=768773 2024-09-19T13:47:44.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.828+0000 7fcf3240c8c0 1 > prepared multipart upload key=6DFF2OCPT9W2 upload=JT8OZZJVGEQ3 tag=PSRDED3I22QM type=write size=2865925 2024-09-19T13:47:44.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.828+0000 7fcf3240c8c0 1 < completed delete operation key=C35EUAOWLBR3 tag=B0Q08WLDDEBE type=del 2024-09-19T13:47:44.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.832+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=ZHY1Q0ONMU33 type=del size=314243 2024-09-19T13:47:44.841 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.836+0000 7fcf3240c8c0 1 < completed write operation key=X16ENUFL40RN tag=WNX80ZVZGX9G type=write size=458082 2024-09-19T13:47:44.845 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.840+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~O62G0BU2LC10.0 size=1048576 2024-09-19T13:47:44.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.844+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~O62G0BU2LC10.1 size=1048576 2024-09-19T13:47:44.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.844+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C3TFYNXH549T.2~O62G0BU2LC10.2 size=30047 2024-09-19T13:47:44.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.844+0000 7fcf3240c8c0 1 > prepared multipart upload key=C3TFYNXH549T upload=O62G0BU2LC10 tag=F4PTNK1TBCDD type=write size=3175775 2024-09-19T13:47:44.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.848+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=NO02HKIOKU44 type=del 2024-09-19T13:47:44.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.852+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=XZX0V5S8PCPY type=del size=447531 2024-09-19T13:47:44.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.852+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~I6Q8VZPV4TGY.0 size=938070 2024-09-19T13:47:44.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.860+0000 7fcf3240c8c0 1 < completed multipart upload key=ES62XJO5Q3FO upload=I6Q8VZPV4TGY tag=X5K3M8FF2UA2 type=write size=1986646 2024-09-19T13:47:44.867 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.864+0000 7fcf3240c8c0 1 > prepared part key=_multipart_3TME221SA53E.2~WIAVYQ06BWH5.0 size=787095 2024-09-19T13:47:44.867 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.864+0000 7fcf3240c8c0 1 > prepared multipart upload key=3TME221SA53E upload=WIAVYQ06BWH5 tag=H6XN972U3KH7 type=write size=1835671 2024-09-19T13:47:44.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.864+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~6WF3I1KOKQEN.0 size=1048576 2024-09-19T13:47:44.871 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.868+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~6WF3I1KOKQEN.1 size=1048576 2024-09-19T13:47:44.873 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.868+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~6WF3I1KOKQEN.2 size=934811 2024-09-19T13:47:44.877 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.872+0000 7fcf3240c8c0 1 < completed multipart upload key=M2CO4A2DHJ05 upload=6WF3I1KOKQEN tag=T1BGFE18VSIN type=write size=4080539 2024-09-19T13:47:44.881 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.876+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~M116U8P3NUEA.0 size=11597 2024-09-19T13:47:44.881 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.876+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=M116U8P3NUEA tag=C9K4DXHZFVGM type=write size=1060173 2024-09-19T13:47:44.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.880+0000 7fcf3240c8c0 1 < completed delete operation key=C35EUAOWLBR3 tag=PUWF13726ADR type=del 2024-09-19T13:47:44.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.884+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=WF3X12HSRXLU type=del size=351745 2024-09-19T13:47:44.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.884+0000 7fcf3240c8c0 1 < completed delete operation key=N51Q6HKJSCCB tag=OHUYIGOWFJ0S type=del 2024-09-19T13:47:44.892 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.888+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=3LSAI6NCN0T2 type=del size=1779115 2024-09-19T13:47:44.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.892+0000 7fcf3240c8c0 1 < suggested update operation key=HXMZKP7H3HJE tag=PWU0I3RXHS42 type=del size=2734583 2024-09-19T13:47:44.900 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.896+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=723F3K7RE5XY type=del size=2965551 2024-09-19T13:47:44.903 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.900+0000 7fcf3240c8c0 1 < canceled operation key=C3TFYNXH549T tag=L23TSH87WDFO type=del size=1715818 2024-09-19T13:47:44.906 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.900+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=31HMTHV0CPRW type=del size=3959553 2024-09-19T13:47:44.908 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.904+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~PZEFNXUDCTAW.0 size=1048576 2024-09-19T13:47:44.911 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.908+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~PZEFNXUDCTAW.1 size=1048576 2024-09-19T13:47:44.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.912+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~PZEFNXUDCTAW.2 size=335302 2024-09-19T13:47:44.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.916+0000 7fcf3240c8c0 1 < completed multipart upload key=QAYJ5B1KZ08J upload=PZEFNXUDCTAW tag=KV99XJJCX6IC type=write size=3481030 2024-09-19T13:47:44.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.920+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=1Z2DAUFSEHXD type=del size=797168 2024-09-19T13:47:44.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.924+0000 7fcf3240c8c0 1 < canceled operation key=C35EUAOWLBR3 tag=I8B2RP66KZWK type=del size=2155893 2024-09-19T13:47:44.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.928+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ES62XJO5Q3FO.2~G7KS1IIQGMPJ.0 size=184943 2024-09-19T13:47:44.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.928+0000 7fcf3240c8c0 1 > prepared multipart upload key=ES62XJO5Q3FO upload=G7KS1IIQGMPJ tag=UVG6AVOBKPMA type=write size=1233519 2024-09-19T13:47:44.937 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.932+0000 7fcf3240c8c0 1 < suggested update operation key=D1RMXGXS3O7Z tag=1ZVN89BWGM6E type=del size=2119725 2024-09-19T13:47:44.941 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.936+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~S6F62OAGIP2X.0 size=1048576 2024-09-19T13:47:44.943 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.940+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~S6F62OAGIP2X.1 size=693184 2024-09-19T13:47:44.943 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.940+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=S6F62OAGIP2X tag=JVP6A260L0MH type=write size=2790336 2024-09-19T13:47:44.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.940+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=IC4SBO38G4Z4 type=del 2024-09-19T13:47:44.948 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.944+0000 7fcf3240c8c0 1 > prepared operation key=A02RDP6BA9AC tag=XIR6FMGY9OXW type=del size=2197961 2024-09-19T13:47:44.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.948+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~8D63EY36TNS8.0 size=1048576 2024-09-19T13:47:44.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.948+0000 7fcf3240c8c0 1 < completed part key=_multipart_M2CO4A2DHJ05.2~8D63EY36TNS8.1 size=171392 2024-09-19T13:47:44.957 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.952+0000 7fcf3240c8c0 1 < completed multipart upload key=M2CO4A2DHJ05 upload=8D63EY36TNS8 tag=3AZTDAC4AQYS type=write size=2268544 2024-09-19T13:47:44.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.956+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=IG7V1140S56K type=del size=1024865 2024-09-19T13:47:44.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.960+0000 7fcf3240c8c0 1 < completed delete operation key=C8T6DB9V9FBT tag=ZT1FRPBAQH7X type=del 2024-09-19T13:47:44.966 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.960+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=67SOVL71OSFS type=del size=3363798 2024-09-19T13:47:44.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.964+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~JT8OZZJVGEQ3.0 size=1048576 2024-09-19T13:47:44.971 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.968+0000 7fcf3240c8c0 1 < completed part key=_multipart_6DFF2OCPT9W2.2~JT8OZZJVGEQ3.1 size=768773 2024-09-19T13:47:44.975 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.972+0000 7fcf3240c8c0 1 < completed multipart upload key=6DFF2OCPT9W2 upload=JT8OZZJVGEQ3 tag=PSRDED3I22QM type=write size=2865925 2024-09-19T13:47:44.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.972+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=XE7FXBM8WUFF type=del size=4103717 2024-09-19T13:47:44.981 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.976+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=ZHY1Q0ONMU33 type=del 2024-09-19T13:47:44.985 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.980+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~72MMG1PKREZV.0 size=1048576 2024-09-19T13:47:44.987 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.984+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~72MMG1PKREZV.1 size=117942 2024-09-19T13:47:44.987 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.984+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=72MMG1PKREZV tag=8279UMW7266U type=write size=2215094 2024-09-19T13:47:44.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.984+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~O62G0BU2LC10.0 size=1048576 2024-09-19T13:47:44.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.988+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~O62G0BU2LC10.1 size=1048576 2024-09-19T13:47:44.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.988+0000 7fcf3240c8c0 1 < completed part key=_multipart_C3TFYNXH549T.2~O62G0BU2LC10.2 size=30047 2024-09-19T13:47:44.998 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.992+0000 7fcf3240c8c0 1 < completed multipart upload key=C3TFYNXH549T upload=O62G0BU2LC10 tag=F4PTNK1TBCDD type=write size=3175775 2024-09-19T13:47:45.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:44.996+0000 7fcf3240c8c0 1 > prepared operation key=NP2L28YRVQ8L tag=CD4I4LFI9XGM type=del size=3058157 2024-09-19T13:47:45.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.000+0000 7fcf3240c8c0 1 < completed delete operation key=71Z2VTW99W7J tag=XZX0V5S8PCPY type=del 2024-09-19T13:47:45.008 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.004+0000 7fcf3240c8c0 1 > prepared part key=_multipart_1BMF3S2BZLLI.2~DC7HAVZ3DKL7.0 size=378906 2024-09-19T13:47:45.008 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.004+0000 7fcf3240c8c0 1 > prepared multipart upload key=1BMF3S2BZLLI upload=DC7HAVZ3DKL7 tag=ZUYATB6L6OAT type=write size=1427482 2024-09-19T13:47:45.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.008+0000 7fcf3240c8c0 1 < completed part key=_multipart_3TME221SA53E.2~WIAVYQ06BWH5.0 size=787095 2024-09-19T13:47:45.014 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.012+0000 7fcf3240c8c0 1 < completed multipart upload key=3TME221SA53E upload=WIAVYQ06BWH5 tag=H6XN972U3KH7 type=write size=1835671 2024-09-19T13:47:45.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.016+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~9S1Z78YAFDXS.0 size=1048576 2024-09-19T13:47:45.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.016+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0UCFTOF1YBBM.2~9S1Z78YAFDXS.1 size=399709 2024-09-19T13:47:45.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.016+0000 7fcf3240c8c0 1 > prepared multipart upload key=0UCFTOF1YBBM upload=9S1Z78YAFDXS tag=SSN6A8C6VZ0N type=write size=2496861 2024-09-19T13:47:45.024 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.020+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~M116U8P3NUEA.0 size=11597 2024-09-19T13:47:45.028 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.024+0000 7fcf3240c8c0 1 < completed multipart upload key=NP2L28YRVQ8L upload=M116U8P3NUEA tag=C9K4DXHZFVGM type=write size=1060173 2024-09-19T13:47:45.031 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.028+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=OJFSR0KMT83J type=del size=3689512 2024-09-19T13:47:45.033 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.028+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=WF3X12HSRXLU type=del 2024-09-19T13:47:45.039 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.036+0000 7fcf3240c8c0 1 > prepared part key=_multipart_A02RDP6BA9AC.2~1WEBIPTI3627.0 size=1036716 2024-09-19T13:47:45.039 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.036+0000 7fcf3240c8c0 1 > prepared multipart upload key=A02RDP6BA9AC upload=1WEBIPTI3627 tag=JSPOSD7NJB5X type=write size=2085292 2024-09-19T13:47:45.041 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.036+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=3LSAI6NCN0T2 type=del 2024-09-19T13:47:45.044 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.040+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=C57M1I4MJ2O3 type=del size=3487997 2024-09-19T13:47:45.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.044+0000 7fcf3240c8c0 1 < completed delete operation key=C3TFYNXH549T tag=723F3K7RE5XY type=del 2024-09-19T13:47:45.049 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.044+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=9DGXE0ZEXDJ7 type=del size=2495576 2024-09-19T13:47:45.051 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.048+0000 7fcf3240c8c0 1 < completed delete operation key=D20C6C2ZFX1W tag=31HMTHV0CPRW type=del 2024-09-19T13:47:45.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.052+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0U9BUX9DHTAK.2~QXGQPB0CWHGA.0 size=1048576 2024-09-19T13:47:45.057 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.052+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0U9BUX9DHTAK.2~QXGQPB0CWHGA.1 size=926060 2024-09-19T13:47:45.057 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.052+0000 7fcf3240c8c0 1 > prepared multipart upload key=0U9BUX9DHTAK upload=QXGQPB0CWHGA tag=6TURWG52UVCA type=write size=3023212 2024-09-19T13:47:45.060 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.056+0000 7fcf3240c8c0 -1 < failed to complete operation key=D1RMXGXS3O7Z tag=1Z2DAUFSEHXD type=del size=797168: (22) Invalid argument 2024-09-19T13:47:45.062 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.060+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=JO6HVEIOUDE8 type=del size=323484 2024-09-19T13:47:45.065 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.060+0000 7fcf3240c8c0 1 < completed part key=_multipart_ES62XJO5Q3FO.2~G7KS1IIQGMPJ.0 size=184943 2024-09-19T13:47:45.068 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.064+0000 7fcf3240c8c0 1 < completed multipart upload key=ES62XJO5Q3FO upload=G7KS1IIQGMPJ tag=UVG6AVOBKPMA type=write size=1233519 2024-09-19T13:47:45.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.068+0000 7fcf3240c8c0 1 > prepared operation key=0U9BUX9DHTAK tag=4PAUFM7JEJ9A type=write size=169389 2024-09-19T13:47:45.073 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.068+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~S6F62OAGIP2X.0 size=1048576 2024-09-19T13:47:45.075 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.072+0000 7fcf3240c8c0 1 < completed part key=_multipart_ZCKKQ1R8318S.2~S6F62OAGIP2X.1 size=693184 2024-09-19T13:47:45.079 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.076+0000 7fcf3240c8c0 1 < completed multipart upload key=ZCKKQ1R8318S upload=S6F62OAGIP2X tag=JVP6A260L0MH type=write size=2790336 2024-09-19T13:47:45.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.080+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0U9BUX9DHTAK.2~KRAOQC1M5GDQ.0 size=1048576 2024-09-19T13:47:45.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.080+0000 7fcf3240c8c0 1 > prepared part key=_multipart_0U9BUX9DHTAK.2~KRAOQC1M5GDQ.1 size=210902 2024-09-19T13:47:45.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.080+0000 7fcf3240c8c0 1 > prepared multipart upload key=0U9BUX9DHTAK upload=KRAOQC1M5GDQ tag=6OTAM0U1D67T type=write size=2308054 2024-09-19T13:47:45.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.084+0000 7fcf3240c8c0 1 < completed delete operation key=A02RDP6BA9AC tag=XIR6FMGY9OXW type=del 2024-09-19T13:47:45.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.088+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~W7UJ223DJSPT.0 size=458598 2024-09-19T13:47:45.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.088+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=W7UJ223DJSPT tag=I94M2HAKHI3K type=write size=1507174 2024-09-19T13:47:45.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.092+0000 7fcf3240c8c0 1 < completed delete operation key=1BMF3S2BZLLI tag=IG7V1140S56K type=del 2024-09-19T13:47:45.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.092+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=GU0EQSF8668A type=del size=877357 2024-09-19T13:47:45.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.096+0000 7fcf3240c8c0 1 < completed delete operation key=N51Q6HKJSCCB tag=67SOVL71OSFS type=del 2024-09-19T13:47:45.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.100+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~2WJASYFRE7KV.0 size=1048576 2024-09-19T13:47:45.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.104+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~2WJASYFRE7KV.1 size=253177 2024-09-19T13:47:45.107 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.104+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=2WJASYFRE7KV tag=DI7DHLM5XQV0 type=write size=2350329 2024-09-19T13:47:45.109 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.104+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=XE7FXBM8WUFF type=del 2024-09-19T13:47:45.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.112+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~YJ79V8WONHIF.0 size=1048576 2024-09-19T13:47:45.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.112+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~YJ79V8WONHIF.1 size=1048576 2024-09-19T13:47:45.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.116+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~YJ79V8WONHIF.2 size=419059 2024-09-19T13:47:45.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.116+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=YJ79V8WONHIF tag=FL4DTOU4D4BY type=write size=3564787 2024-09-19T13:47:45.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.120+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~72MMG1PKREZV.0 size=1048576 2024-09-19T13:47:45.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.124+0000 7fcf3240c8c0 1 < completed part key=_multipart_QAYJ5B1KZ08J.2~72MMG1PKREZV.1 size=117942 2024-09-19T13:47:45.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.128+0000 7fcf3240c8c0 1 < completed multipart upload key=QAYJ5B1KZ08J upload=72MMG1PKREZV tag=8279UMW7266U type=write size=2215094 2024-09-19T13:47:45.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.132+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=7V4KGRJDA2CV type=del size=2755799 2024-09-19T13:47:45.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.136+0000 7fcf3240c8c0 1 < suggested update operation key=NP2L28YRVQ8L tag=CD4I4LFI9XGM type=del size=3058157 2024-09-19T13:47:45.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.140+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=X32FF93XQBQ4 type=del size=3637578 2024-09-19T13:47:45.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.140+0000 7fcf3240c8c0 1 < completed part key=_multipart_1BMF3S2BZLLI.2~DC7HAVZ3DKL7.0 size=378906 2024-09-19T13:47:45.151 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.148+0000 7fcf3240c8c0 1 < completed multipart upload key=1BMF3S2BZLLI upload=DC7HAVZ3DKL7 tag=ZUYATB6L6OAT type=write size=1427482 2024-09-19T13:47:45.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.148+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=JVWWZX5D38M1 type=write size=353845 2024-09-19T13:47:45.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.152+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~9S1Z78YAFDXS.0 size=1048576 2024-09-19T13:47:45.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.160+0000 7fcf3240c8c0 1 < completed part key=_multipart_0UCFTOF1YBBM.2~9S1Z78YAFDXS.1 size=399709 2024-09-19T13:47:45.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.168+0000 7fcf3240c8c0 1 < completed multipart upload key=0UCFTOF1YBBM upload=9S1Z78YAFDXS tag=SSN6A8C6VZ0N type=write size=2496861 2024-09-19T13:47:45.173 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.168+0000 7fcf3240c8c0 1 > prepared operation key=9ICCISYXT0IV tag=T7YVVP94B0G1 type=del size=1422018 2024-09-19T13:47:45.176 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.172+0000 7fcf3240c8c0 1 < canceled operation key=D20C6C2ZFX1W tag=OJFSR0KMT83J type=del size=3689512 2024-09-19T13:47:45.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.176+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~7RBEFRA0W9E9.0 size=1048576 2024-09-19T13:47:45.184 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.180+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~7RBEFRA0W9E9.1 size=1048576 2024-09-19T13:47:45.187 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.184+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QMSDNKYFFK1F.2~7RBEFRA0W9E9.2 size=221694 2024-09-19T13:47:45.187 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.184+0000 7fcf3240c8c0 1 > prepared multipart upload key=QMSDNKYFFK1F upload=7RBEFRA0W9E9 tag=G9A9FYKOGQIQ type=write size=3367422 2024-09-19T13:47:45.190 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.188+0000 7fcf3240c8c0 1 < completed part key=_multipart_A02RDP6BA9AC.2~1WEBIPTI3627.0 size=1036716 2024-09-19T13:47:45.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.192+0000 7fcf3240c8c0 1 < completed multipart upload key=A02RDP6BA9AC upload=1WEBIPTI3627 tag=JSPOSD7NJB5X type=write size=2085292 2024-09-19T13:47:45.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.196+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=P4AWH22LV8XO type=del size=1412131 2024-09-19T13:47:45.201 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.196+0000 7fcf3240c8c0 1 < completed delete operation key=C35EUAOWLBR3 tag=C57M1I4MJ2O3 type=del 2024-09-19T13:47:45.207 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.204+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~Q1GOBHDD4OV5.0 size=889872 2024-09-19T13:47:45.207 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.204+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=Q1GOBHDD4OV5 tag=MUTLZUQ291UB type=write size=1938448 2024-09-19T13:47:45.210 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.208+0000 7fcf3240c8c0 1 < completed delete operation key=STMT6XU2EJQM tag=9DGXE0ZEXDJ7 type=del 2024-09-19T13:47:45.214 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.208+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=SAVBVV98YNIF type=write size=122555 2024-09-19T13:47:45.218 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.212+0000 7fcf3240c8c0 1 < completed part key=_multipart_0U9BUX9DHTAK.2~QXGQPB0CWHGA.0 size=1048576 2024-09-19T13:47:45.221 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.216+0000 7fcf3240c8c0 1 < completed part key=_multipart_0U9BUX9DHTAK.2~QXGQPB0CWHGA.1 size=926060 2024-09-19T13:47:45.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.220+0000 7fcf3240c8c0 1 < completed multipart upload key=0U9BUX9DHTAK upload=QXGQPB0CWHGA tag=6TURWG52UVCA type=write size=3023212 2024-09-19T13:47:45.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.228+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~XCKU681VFL13.0 size=538728 2024-09-19T13:47:45.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.228+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=XCKU681VFL13 tag=QBI8NRAOJ0EF type=write size=1587304 2024-09-19T13:47:45.236 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.232+0000 7fcf3240c8c0 1 < canceled operation key=7UC85R2HO9K2 tag=JO6HVEIOUDE8 type=del size=323484 2024-09-19T13:47:45.242 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.236+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~12Y6RQNSH24L.0 size=1048576 2024-09-19T13:47:45.244 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.240+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~12Y6RQNSH24L.1 size=809223 2024-09-19T13:47:45.244 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.240+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=12Y6RQNSH24L tag=LLJPH3M0SY1D type=write size=2906375 2024-09-19T13:47:45.247 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.244+0000 7fcf3240c8c0 1 < completed write operation key=0U9BUX9DHTAK tag=4PAUFM7JEJ9A type=write size=169389 2024-09-19T13:47:45.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.248+0000 7fcf3240c8c0 1 > prepared part key=_multipart_STMT6XU2EJQM.2~EHQBEKW8GEVZ.0 size=696360 2024-09-19T13:47:45.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.248+0000 7fcf3240c8c0 1 > prepared multipart upload key=STMT6XU2EJQM upload=EHQBEKW8GEVZ tag=OU2VIFT26CES type=write size=1744936 2024-09-19T13:47:45.257 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.252+0000 7fcf3240c8c0 1 < completed part key=_multipart_0U9BUX9DHTAK.2~KRAOQC1M5GDQ.0 size=1048576 2024-09-19T13:47:45.259 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.256+0000 7fcf3240c8c0 1 < completed part key=_multipart_0U9BUX9DHTAK.2~KRAOQC1M5GDQ.1 size=210902 2024-09-19T13:47:45.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.260+0000 7fcf3240c8c0 1 < completed multipart upload key=0U9BUX9DHTAK upload=KRAOQC1M5GDQ tag=6OTAM0U1D67T type=write size=2308054 2024-09-19T13:47:45.267 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.264+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=OU9PIW39XGDG type=del size=2963404 2024-09-19T13:47:45.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.268+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~W7UJ223DJSPT.0 size=458598 2024-09-19T13:47:45.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.272+0000 7fcf3240c8c0 1 < completed multipart upload key=BXUPV5XSJBTH upload=W7UJ223DJSPT tag=I94M2HAKHI3K type=write size=1507174 2024-09-19T13:47:45.278 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.272+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=SXHX6D8BZPIW type=write size=544722 2024-09-19T13:47:45.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.276+0000 7fcf3240c8c0 1 < completed delete operation key=0UCFTOF1YBBM tag=GU0EQSF8668A type=del 2024-09-19T13:47:45.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.280+0000 7fcf3240c8c0 1 > prepared operation key=C3TFYNXH549T tag=4RB83Q9U6UTC type=del size=1978287 2024-09-19T13:47:45.288 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.284+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~2WJASYFRE7KV.0 size=1048576 2024-09-19T13:47:45.290 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.288+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~2WJASYFRE7KV.1 size=253177 2024-09-19T13:47:45.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.292+0000 7fcf3240c8c0 1 < completed multipart upload key=QSM2Q8CW1Q86 upload=2WJASYFRE7KV tag=DI7DHLM5XQV0 type=write size=2350329 2024-09-19T13:47:45.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.296+0000 7fcf3240c8c0 1 > prepared operation key=C8T6DB9V9FBT tag=MF1DR543JH3I type=write size=479794 2024-09-19T13:47:45.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.300+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~YJ79V8WONHIF.0 size=1048576 2024-09-19T13:47:45.305 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.300+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~YJ79V8WONHIF.1 size=1048576 2024-09-19T13:47:45.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.304+0000 7fcf3240c8c0 1 < completed part key=_multipart_D20C6C2ZFX1W.2~YJ79V8WONHIF.2 size=419059 2024-09-19T13:47:45.314 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.308+0000 7fcf3240c8c0 1 < completed multipart upload key=D20C6C2ZFX1W upload=YJ79V8WONHIF tag=FL4DTOU4D4BY type=write size=3564787 2024-09-19T13:47:45.318 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.312+0000 7fcf3240c8c0 1 > prepared operation key=V8X0VBBNK83J tag=0KLPOKSAM54L type=del size=3020530 2024-09-19T13:47:45.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.316+0000 7fcf3240c8c0 1 < completed delete operation key=71Z2VTW99W7J tag=7V4KGRJDA2CV type=del 2024-09-19T13:47:45.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.320+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~4E0FT11210YK.0 size=1048576 2024-09-19T13:47:45.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.324+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~4E0FT11210YK.1 size=1048576 2024-09-19T13:47:45.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.328+0000 7fcf3240c8c0 1 > prepared part key=_multipart_HXMZKP7H3HJE.2~4E0FT11210YK.2 size=93512 2024-09-19T13:47:45.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.328+0000 7fcf3240c8c0 1 > prepared multipart upload key=HXMZKP7H3HJE upload=4E0FT11210YK tag=HQ4W4EVV20KM type=write size=3239240 2024-09-19T13:47:45.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.328+0000 7fcf3240c8c0 1 < completed delete operation key=HXMZKP7H3HJE tag=X32FF93XQBQ4 type=del 2024-09-19T13:47:45.336 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.332+0000 7fcf3240c8c0 1 > prepared operation key=XE42LV5M5X82 tag=0L8QUSZOAOIF type=del size=2302007 2024-09-19T13:47:45.339 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.336+0000 7fcf3240c8c0 1 < completed write operation key=V8X0VBBNK83J tag=JVWWZX5D38M1 type=write size=353845 2024-09-19T13:47:45.342 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.336+0000 7fcf3240c8c0 1 > prepared operation key=ZCKKQ1R8318S tag=122TRG8EREUE type=write size=882651 2024-09-19T13:47:45.345 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.340+0000 7fcf3240c8c0 1 < completed delete operation key=9ICCISYXT0IV tag=T7YVVP94B0G1 type=del 2024-09-19T13:47:45.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.348+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~9VA5CFICNHNP.0 size=256643 2024-09-19T13:47:45.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.348+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=9VA5CFICNHNP tag=HBOKU4XGN516 type=write size=1305219 2024-09-19T13:47:45.353 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.348+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~7RBEFRA0W9E9.0 size=1048576 2024-09-19T13:47:45.353 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.348+0000 7fcf3240c8c0 1 < canceled part key=_multipart_QMSDNKYFFK1F.2~7RBEFRA0W9E9.1 size=1048576 2024-09-19T13:47:45.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.352+0000 7fcf3240c8c0 1 < completed part key=_multipart_QMSDNKYFFK1F.2~7RBEFRA0W9E9.2 size=221694 2024-09-19T13:47:45.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.356+0000 7fcf3240c8c0 1 < canceled multipart upload key=QMSDNKYFFK1F upload=7RBEFRA0W9E9 tag=G9A9FYKOGQIQ type=write size=3367422 2024-09-19T13:47:45.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.360+0000 7fcf3240c8c0 1 > prepared operation key=0UCFTOF1YBBM tag=0NOQHFFO6GE2 type=write size=886442 2024-09-19T13:47:45.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.364+0000 7fcf3240c8c0 1 < suggested update operation key=7UC85R2HO9K2 tag=P4AWH22LV8XO type=del size=1412131 2024-09-19T13:47:45.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.368+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=930RLGVU4SG5 type=del size=2181715 2024-09-19T13:47:45.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.372+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~Q1GOBHDD4OV5.0 size=889872 2024-09-19T13:47:45.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.376+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=Q1GOBHDD4OV5 tag=MUTLZUQ291UB type=write size=1938448 2024-09-19T13:47:45.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.380+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=J7BYKMYRNJHU type=del size=3263263 2024-09-19T13:47:45.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.380+0000 7fcf3240c8c0 1 < completed write operation key=OA9BMSXGYR9T tag=SAVBVV98YNIF type=write size=122555 2024-09-19T13:47:45.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.388+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~NF4YHDL7K57M.0 size=951918 2024-09-19T13:47:45.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.388+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=NF4YHDL7K57M tag=NDZQLBYNVJES type=write size=2000494 2024-09-19T13:47:45.395 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.392+0000 7fcf3240c8c0 1 < completed part key=_multipart_QSM2Q8CW1Q86.2~XCKU681VFL13.0 size=538728 2024-09-19T13:47:45.399 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.396+0000 7fcf3240c8c0 1 < completed multipart upload key=QSM2Q8CW1Q86 upload=XCKU681VFL13 tag=QBI8NRAOJ0EF type=write size=1587304 2024-09-19T13:47:45.405 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.400+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~LWYQIA2L1S60.0 size=1048576 2024-09-19T13:47:45.407 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.404+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~LWYQIA2L1S60.1 size=1048576 2024-09-19T13:47:45.410 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.404+0000 7fcf3240c8c0 1 > prepared part key=_multipart_9ICCISYXT0IV.2~LWYQIA2L1S60.2 size=894006 2024-09-19T13:47:45.410 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.404+0000 7fcf3240c8c0 1 > prepared multipart upload key=9ICCISYXT0IV upload=LWYQIA2L1S60 tag=DX1RQPE7HU7P type=write size=4039734 2024-09-19T13:47:45.410 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.408+0000 7fcf3240c8c0 1 < canceled part key=_multipart_7UC85R2HO9K2.2~12Y6RQNSH24L.0 size=1048576 2024-09-19T13:47:45.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.408+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~12Y6RQNSH24L.1 size=809223 2024-09-19T13:47:45.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.412+0000 7fcf3240c8c0 1 < canceled multipart upload key=7UC85R2HO9K2 upload=12Y6RQNSH24L tag=LLJPH3M0SY1D type=write size=2906375 2024-09-19T13:47:45.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.416+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=LDOQYNCQ9G29 type=write size=832729 2024-09-19T13:47:45.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.416+0000 7fcf3240c8c0 1 < completed part key=_multipart_STMT6XU2EJQM.2~EHQBEKW8GEVZ.0 size=696360 2024-09-19T13:47:45.426 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.420+0000 7fcf3240c8c0 1 < completed multipart upload key=STMT6XU2EJQM upload=EHQBEKW8GEVZ tag=OU2VIFT26CES type=write size=1744936 2024-09-19T13:47:45.430 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.428+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~RPGYBBW5QO8K.0 size=1048576 2024-09-19T13:47:45.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.428+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~RPGYBBW5QO8K.1 size=622824 2024-09-19T13:47:45.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.428+0000 7fcf3240c8c0 1 > prepared multipart upload key=OA9BMSXGYR9T upload=RPGYBBW5QO8K tag=YJLIC6I3Y763 type=write size=2719976 2024-09-19T13:47:45.435 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.432+0000 7fcf3240c8c0 1 < completed delete operation key=AES54TJK7VH7 tag=OU9PIW39XGDG type=del 2024-09-19T13:47:45.438 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.432+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=7PI1RHFBXG6K type=del size=1780460 2024-09-19T13:47:45.440 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.436+0000 7fcf3240c8c0 1 < completed write operation key=BXUPV5XSJBTH tag=SXHX6D8BZPIW type=write size=544722 2024-09-19T13:47:45.446 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.440+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=MRYG76A1FQ2V type=del size=190959 2024-09-19T13:47:45.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.444+0000 7fcf3240c8c0 1 < completed delete operation key=C3TFYNXH549T tag=4RB83Q9U6UTC type=del 2024-09-19T13:47:45.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.448+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=187NMZD3YYQ1 type=del size=1326309 2024-09-19T13:47:45.457 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.452+0000 7fcf3240c8c0 1 < suggested remove operation key=C8T6DB9V9FBT tag=MF1DR543JH3I type=write 2024-09-19T13:47:45.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.456+0000 7fcf3240c8c0 1 > prepared operation key=OA9BMSXGYR9T tag=5BBMDH31XW5I type=del size=2468364 2024-09-19T13:47:45.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.460+0000 7fcf3240c8c0 1 < completed delete operation key=V8X0VBBNK83J tag=0KLPOKSAM54L type=del 2024-09-19T13:47:45.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.460+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=805CTIVAVXDZ type=del size=38103 2024-09-19T13:47:45.468 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.464+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~4E0FT11210YK.0 size=1048576 2024-09-19T13:47:45.470 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.468+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~4E0FT11210YK.1 size=1048576 2024-09-19T13:47:45.472 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.468+0000 7fcf3240c8c0 1 < completed part key=_multipart_HXMZKP7H3HJE.2~4E0FT11210YK.2 size=93512 2024-09-19T13:47:45.477 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.472+0000 7fcf3240c8c0 1 < completed multipart upload key=HXMZKP7H3HJE upload=4E0FT11210YK tag=HQ4W4EVV20KM type=write size=3239240 2024-09-19T13:47:45.479 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.476+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=0G1VA50VXI7Z type=del size=2525506 2024-09-19T13:47:45.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.480+0000 7fcf3240c8c0 1 < suggested update operation key=XE42LV5M5X82 tag=0L8QUSZOAOIF type=del size=2302007 2024-09-19T13:47:45.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.484+0000 7fcf3240c8c0 1 > prepared operation key=D1RMXGXS3O7Z tag=TX7P8SP45FPT type=del size=1312354 2024-09-19T13:47:45.490 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.484+0000 7fcf3240c8c0 1 < completed write operation key=ZCKKQ1R8318S tag=122TRG8EREUE type=write size=882651 2024-09-19T13:47:45.493 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.488+0000 7fcf3240c8c0 1 > prepared operation key=QAYJ5B1KZ08J tag=N37Z93Z30HHC type=write size=790708 2024-09-19T13:47:45.495 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.492+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~9VA5CFICNHNP.0 size=256643 2024-09-19T13:47:45.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.496+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=9VA5CFICNHNP tag=HBOKU4XGN516 type=write size=1305219 2024-09-19T13:47:45.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.500+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~3UVH4XD38IJ7.0 size=1048576 2024-09-19T13:47:45.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.504+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~3UVH4XD38IJ7.1 size=984334 2024-09-19T13:47:45.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.504+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=3UVH4XD38IJ7 tag=ZY17XTPA0XGS type=write size=3081486 2024-09-19T13:47:45.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.504+0000 7fcf3240c8c0 1 < completed write operation key=0UCFTOF1YBBM tag=0NOQHFFO6GE2 type=write size=886442 2024-09-19T13:47:45.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.508+0000 7fcf3240c8c0 1 > prepared operation key=71Z2VTW99W7J tag=ZZOMC8QTSLMG type=del size=1644025 2024-09-19T13:47:45.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.512+0000 7fcf3240c8c0 1 < completed delete operation key=BXUPV5XSJBTH tag=930RLGVU4SG5 type=del 2024-09-19T13:47:45.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.516+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~ICB1MDZR6U1K.0 size=895748 2024-09-19T13:47:45.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.516+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=ICB1MDZR6U1K tag=39R1JKJATBTS type=write size=1944324 2024-09-19T13:47:45.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.516+0000 7fcf3240c8c0 1 < completed delete operation key=71Z2VTW99W7J tag=J7BYKMYRNJHU type=del 2024-09-19T13:47:45.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.520+0000 7fcf3240c8c0 1 > prepared part key=_multipart_71Z2VTW99W7J.2~35FVE6MP4HEP.0 size=592651 2024-09-19T13:47:45.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.520+0000 7fcf3240c8c0 1 > prepared multipart upload key=71Z2VTW99W7J upload=35FVE6MP4HEP tag=UKAVKKNMC8NB type=write size=1641227 2024-09-19T13:47:45.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.524+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~NF4YHDL7K57M.0 size=951918 2024-09-19T13:47:45.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.528+0000 7fcf3240c8c0 1 < completed multipart upload key=XE42LV5M5X82 upload=NF4YHDL7K57M tag=NDZQLBYNVJES type=write size=2000494 2024-09-19T13:47:45.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.532+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=2G02BCR4GWD2 type=del size=2973062 2024-09-19T13:47:45.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.532+0000 7fcf3240c8c0 1 < canceled part key=_multipart_9ICCISYXT0IV.2~LWYQIA2L1S60.0 size=1048576 2024-09-19T13:47:45.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.536+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~LWYQIA2L1S60.1 size=1048576 2024-09-19T13:47:45.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.536+0000 7fcf3240c8c0 1 < completed part key=_multipart_9ICCISYXT0IV.2~LWYQIA2L1S60.2 size=894006 2024-09-19T13:47:45.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.540+0000 7fcf3240c8c0 1 < canceled multipart upload key=9ICCISYXT0IV upload=LWYQIA2L1S60 tag=DX1RQPE7HU7P type=write size=4039734 2024-09-19T13:47:45.549 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.544+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=E13PC8HBH52G type=del size=416530 2024-09-19T13:47:45.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.548+0000 7fcf3240c8c0 1 < completed write operation key=71Z2VTW99W7J tag=LDOQYNCQ9G29 type=write size=832729 2024-09-19T13:47:45.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.552+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~31ECDUY286I6.0 size=1048576 2024-09-19T13:47:45.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.556+0000 7fcf3240c8c0 1 > prepared part key=_multipart_NP2L28YRVQ8L.2~31ECDUY286I6.1 size=3218 2024-09-19T13:47:45.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.556+0000 7fcf3240c8c0 1 > prepared multipart upload key=NP2L28YRVQ8L upload=31ECDUY286I6 tag=PQVO2JGA0PU7 type=write size=2100370 2024-09-19T13:47:45.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.556+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~RPGYBBW5QO8K.0 size=1048576 2024-09-19T13:47:45.564 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.560+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~RPGYBBW5QO8K.1 size=622824 2024-09-19T13:47:45.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.564+0000 7fcf3240c8c0 1 < completed multipart upload key=OA9BMSXGYR9T upload=RPGYBBW5QO8K tag=YJLIC6I3Y763 type=write size=2719976 2024-09-19T13:47:45.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.568+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~EVA0PUOFAZUD.0 size=1048576 2024-09-19T13:47:45.576 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.572+0000 7fcf3240c8c0 1 > prepared part key=_multipart_XE42LV5M5X82.2~EVA0PUOFAZUD.1 size=398089 2024-09-19T13:47:45.577 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.572+0000 7fcf3240c8c0 1 > prepared multipart upload key=XE42LV5M5X82 upload=EVA0PUOFAZUD tag=FOBA0953TZRL type=write size=2495241 2024-09-19T13:47:45.579 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.576+0000 7fcf3240c8c0 1 < suggested update operation key=6DFF2OCPT9W2 tag=7PI1RHFBXG6K type=del size=1780460 2024-09-19T13:47:45.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.576+0000 7fcf3240c8c0 1 > prepared operation key=M2CO4A2DHJ05 tag=2JMYC8HYUHN8 type=del size=1982436 2024-09-19T13:47:45.585 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.580+0000 7fcf3240c8c0 1 < completed delete operation key=QAYJ5B1KZ08J tag=MRYG76A1FQ2V type=del 2024-09-19T13:47:45.589 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.584+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~B7EKW6UZFFGY.0 size=1048576 2024-09-19T13:47:45.592 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.588+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~B7EKW6UZFFGY.1 size=1048576 2024-09-19T13:47:45.594 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.588+0000 7fcf3240c8c0 1 > prepared part key=_multipart_BXUPV5XSJBTH.2~B7EKW6UZFFGY.2 size=472097 2024-09-19T13:47:45.594 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.588+0000 7fcf3240c8c0 1 > prepared multipart upload key=BXUPV5XSJBTH upload=B7EKW6UZFFGY tag=WAW9FWPMBOT4 type=write size=3617825 2024-09-19T13:47:45.596 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.592+0000 7fcf3240c8c0 1 < completed delete operation key=M2CO4A2DHJ05 tag=187NMZD3YYQ1 type=del 2024-09-19T13:47:45.599 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.596+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=0BLK1S2Z8GSE type=del size=1452005 2024-09-19T13:47:45.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.596+0000 7fcf3240c8c0 1 < completed delete operation key=OA9BMSXGYR9T tag=5BBMDH31XW5I type=del 2024-09-19T13:47:45.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.600+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~HZMP8XM8E4AP.0 size=497068 2024-09-19T13:47:45.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.600+0000 7fcf3240c8c0 1 > prepared multipart upload key=OA9BMSXGYR9T upload=HZMP8XM8E4AP tag=J2LOKV43N1PR type=write size=1545644 2024-09-19T13:47:45.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.604+0000 7fcf3240c8c0 -1 < failed to complete operation key=6DFF2OCPT9W2 tag=805CTIVAVXDZ type=del size=38103: (22) Invalid argument 2024-09-19T13:47:45.611 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.608+0000 7fcf3240c8c0 1 > prepared operation key=QSM2Q8CW1Q86 tag=GKSDLI6ES927 type=del size=218568 2024-09-19T13:47:45.617 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.612+0000 7fcf3240c8c0 1 < suggested update operation key=X16ENUFL40RN tag=0G1VA50VXI7Z type=del size=2525506 2024-09-19T13:47:45.620 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.616+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=XTLP9OPH8O1Z type=del size=1493439 2024-09-19T13:47:45.623 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.620+0000 7fcf3240c8c0 1 < completed delete operation key=D1RMXGXS3O7Z tag=TX7P8SP45FPT type=del 2024-09-19T13:47:45.626 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.620+0000 7fcf3240c8c0 1 > prepared operation key=C35EUAOWLBR3 tag=KPJYIB0K3EGI type=del size=7123 2024-09-19T13:47:45.629 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.624+0000 7fcf3240c8c0 1 < completed write operation key=QAYJ5B1KZ08J tag=N37Z93Z30HHC type=write size=790708 2024-09-19T13:47:45.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.628+0000 7fcf3240c8c0 1 > prepared operation key=6DFF2OCPT9W2 tag=PJSVBAV2K9IQ type=write size=148580 2024-09-19T13:47:45.634 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.632+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~3UVH4XD38IJ7.0 size=1048576 2024-09-19T13:47:45.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.632+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~3UVH4XD38IJ7.1 size=984334 2024-09-19T13:47:45.640 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.636+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=3UVH4XD38IJ7 tag=ZY17XTPA0XGS type=write size=3081486 2024-09-19T13:47:45.643 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.640+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=F134XWTJNYIM type=del size=3382646 2024-09-19T13:47:45.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.644+0000 7fcf3240c8c0 1 < suggested update operation key=71Z2VTW99W7J tag=ZZOMC8QTSLMG type=del size=1644025 2024-09-19T13:47:45.651 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.648+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=CP4TCGM4N9TR type=del size=1513103 2024-09-19T13:47:45.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.648+0000 7fcf3240c8c0 1 < completed part key=_multipart_7UC85R2HO9K2.2~ICB1MDZR6U1K.0 size=895748 2024-09-19T13:47:45.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.652+0000 7fcf3240c8c0 1 < completed multipart upload key=7UC85R2HO9K2 upload=ICB1MDZR6U1K tag=39R1JKJATBTS type=write size=1944324 2024-09-19T13:47:45.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.660+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~4YX8TLCC4NAP.0 size=1048576 2024-09-19T13:47:45.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.660+0000 7fcf3240c8c0 1 > prepared part key=_multipart_DHPONKOVS8CT.2~4YX8TLCC4NAP.1 size=60662 2024-09-19T13:47:45.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.660+0000 7fcf3240c8c0 1 > prepared multipart upload key=DHPONKOVS8CT upload=4YX8TLCC4NAP tag=BLJAMD0T86TU type=write size=2157814 2024-09-19T13:47:45.668 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.664+0000 7fcf3240c8c0 1 < completed part key=_multipart_71Z2VTW99W7J.2~35FVE6MP4HEP.0 size=592651 2024-09-19T13:47:45.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.668+0000 7fcf3240c8c0 1 < completed multipart upload key=71Z2VTW99W7J upload=35FVE6MP4HEP tag=UKAVKKNMC8NB type=write size=1641227 2024-09-19T13:47:45.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.672+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~HMVT0TY0OSGL.0 size=1048576 2024-09-19T13:47:45.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.676+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~HMVT0TY0OSGL.1 size=1048576 2024-09-19T13:47:45.683 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.680+0000 7fcf3240c8c0 1 > prepared part key=_multipart_AES54TJK7VH7.2~HMVT0TY0OSGL.2 size=1023011 2024-09-19T13:47:45.683 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.680+0000 7fcf3240c8c0 1 > prepared multipart upload key=AES54TJK7VH7 upload=HMVT0TY0OSGL tag=MS146ZL74PZT type=write size=4168739 2024-09-19T13:47:45.686 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.680+0000 7fcf3240c8c0 1 < completed delete operation key=D20C6C2ZFX1W tag=2G02BCR4GWD2 type=del 2024-09-19T13:47:45.691 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.688+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~11H9SZTSIQ31.0 size=1048576 2024-09-19T13:47:45.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.688+0000 7fcf3240c8c0 1 > prepared part key=_multipart_C35EUAOWLBR3.2~11H9SZTSIQ31.1 size=553397 2024-09-19T13:47:45.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.688+0000 7fcf3240c8c0 1 > prepared multipart upload key=C35EUAOWLBR3 upload=11H9SZTSIQ31 tag=VHL4KGXO2UK7 type=write size=2650549 2024-09-19T13:47:45.704 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.700+0000 7fcf3240c8c0 1 < suggested remove operation key=QSM2Q8CW1Q86 tag=E13PC8HBH52G type=del 2024-09-19T13:47:45.707 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.704+0000 7fcf3240c8c0 1 > prepared operation key=1BMF3S2BZLLI tag=1USM6ID359DM type=del size=954660 2024-09-19T13:47:45.710 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.708+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~31ECDUY286I6.0 size=1048576 2024-09-19T13:47:45.712 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.708+0000 7fcf3240c8c0 1 < completed part key=_multipart_NP2L28YRVQ8L.2~31ECDUY286I6.1 size=3218 2024-09-19T13:47:45.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.712+0000 7fcf3240c8c0 1 < completed multipart upload key=NP2L28YRVQ8L upload=31ECDUY286I6 tag=PQVO2JGA0PU7 type=write size=2100370 2024-09-19T13:47:45.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.716+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=NLBHBDOPJWUE type=del size=514334 2024-09-19T13:47:45.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.720+0000 7fcf3240c8c0 1 < completed part key=_multipart_XE42LV5M5X82.2~EVA0PUOFAZUD.0 size=1048576 2024-09-19T13:47:45.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.720+0000 7fcf3240c8c0 1 < canceled part key=_multipart_XE42LV5M5X82.2~EVA0PUOFAZUD.1 size=398089 2024-09-19T13:47:45.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.724+0000 7fcf3240c8c0 1 < canceled multipart upload key=XE42LV5M5X82 upload=EVA0PUOFAZUD tag=FOBA0953TZRL type=write size=2495241 2024-09-19T13:47:45.731 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.728+0000 7fcf3240c8c0 1 > prepared operation key=BXUPV5XSJBTH tag=963JVSDGTANG type=del size=1000973 2024-09-19T13:47:45.738 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.732+0000 7fcf3240c8c0 1 < suggested update operation key=M2CO4A2DHJ05 tag=2JMYC8HYUHN8 type=del size=1982436 2024-09-19T13:47:45.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.740+0000 7fcf3240c8c0 1 > prepared part key=_multipart_D20C6C2ZFX1W.2~46F7U8GA3DLV.0 size=978557 2024-09-19T13:47:45.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.740+0000 7fcf3240c8c0 1 > prepared multipart upload key=D20C6C2ZFX1W upload=46F7U8GA3DLV tag=GDQW9APIDWIL type=write size=2027133 2024-09-19T13:47:45.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.740+0000 7fcf3240c8c0 1 < canceled part key=_multipart_BXUPV5XSJBTH.2~B7EKW6UZFFGY.0 size=1048576 2024-09-19T13:47:45.747 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.744+0000 7fcf3240c8c0 1 < completed part key=_multipart_BXUPV5XSJBTH.2~B7EKW6UZFFGY.1 size=1048576 2024-09-19T13:47:45.747 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.744+0000 7fcf3240c8c0 1 < canceled part key=_multipart_BXUPV5XSJBTH.2~B7EKW6UZFFGY.2 size=472097 2024-09-19T13:47:45.752 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.748+0000 7fcf3240c8c0 1 < canceled multipart upload key=BXUPV5XSJBTH upload=B7EKW6UZFFGY tag=WAW9FWPMBOT4 type=write size=3617825 2024-09-19T13:47:45.755 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.752+0000 7fcf3240c8c0 1 > prepared operation key=7UC85R2HO9K2 tag=5V9VLVP8Y4Q1 type=del size=1198193 2024-09-19T13:47:45.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.752+0000 7fcf3240c8c0 1 < completed delete operation key=D20C6C2ZFX1W tag=0BLK1S2Z8GSE type=del 2024-09-19T13:47:45.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.756+0000 7fcf3240c8c0 1 > prepared operation key=HXMZKP7H3HJE tag=060QGJVPSXE9 type=write size=1016968 2024-09-19T13:47:45.762 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.760+0000 7fcf3240c8c0 1 < completed part key=_multipart_OA9BMSXGYR9T.2~HZMP8XM8E4AP.0 size=497068 2024-09-19T13:47:45.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.764+0000 7fcf3240c8c0 1 < completed multipart upload key=OA9BMSXGYR9T upload=HZMP8XM8E4AP tag=J2LOKV43N1PR type=write size=1545644 2024-09-19T13:47:45.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.764+0000 7fcf3240c8c0 1 > prepared operation key=X16ENUFL40RN tag=7933FWDMO2LN type=del size=84243 2024-09-19T13:47:45.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.768+0000 7fcf3240c8c0 -1 < failed to complete operation key=QSM2Q8CW1Q86 tag=GKSDLI6ES927 type=del size=218568: (22) Invalid argument 2024-09-19T13:47:45.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.772+0000 7fcf3240c8c0 1 > prepared operation key=N51Q6HKJSCCB tag=TL057UEO19VA type=del size=3438560 2024-09-19T13:47:45.777 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.772+0000 7fcf3240c8c0 1 < completed delete operation key=ES62XJO5Q3FO tag=XTLP9OPH8O1Z type=del 2024-09-19T13:47:45.780 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.776+0000 7fcf3240c8c0 1 > prepared operation key=AES54TJK7VH7 tag=F72PCRIC8RIM type=del size=4159318 2024-09-19T13:47:45.784 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.780+0000 7fcf3240c8c0 1 < suggested remove operation key=C35EUAOWLBR3 tag=KPJYIB0K3EGI type=del 2024-09-19T13:47:45.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.784+0000 7fcf3240c8c0 1 > prepared operation key=ES62XJO5Q3FO tag=I0SQPGA1NZBW type=del size=1079365 2024-09-19T13:47:45.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.788+0000 7fcf3240c8c0 1 < completed write operation key=6DFF2OCPT9W2 tag=PJSVBAV2K9IQ type=write size=148580 2024-09-19T13:47:45.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.788+0000 7fcf3240c8c0 1 > prepared operation key=D20C6C2ZFX1W tag=6VJJRLP4USN0 type=write size=925625 2024-09-19T13:47:45.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.792+0000 7fcf3240c8c0 1 < completed delete operation key=1BMF3S2BZLLI tag=F134XWTJNYIM type=del 2024-09-19T13:47:45.800 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.796+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~0FZPERBAAIWG.0 size=1048576 2024-09-19T13:47:45.802 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.800+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~0FZPERBAAIWG.1 size=1048576 2024-09-19T13:47:45.804 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.800+0000 7fcf3240c8c0 1 > prepared part key=_multipart_7UC85R2HO9K2.2~0FZPERBAAIWG.2 size=245655 2024-09-19T13:47:45.804 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.800+0000 7fcf3240c8c0 1 > prepared multipart upload key=7UC85R2HO9K2 upload=0FZPERBAAIWG tag=90NVUBUIEEZC type=write size=3391383 2024-09-19T13:47:45.807 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.804+0000 7fcf3240c8c0 1 < canceled operation key=D20C6C2ZFX1W tag=CP4TCGM4N9TR type=del size=1513103 2024-09-19T13:47:45.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.808+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~6ND17IOQPJQW.0 size=1048576 2024-09-19T13:47:45.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.808+0000 7fcf3240c8c0 1 > prepared part key=_multipart_OA9BMSXGYR9T.2~6ND17IOQPJQW.1 size=345501 2024-09-19T13:47:45.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.808+0000 7fcf3240c8c0 1 > prepared multipart upload key=OA9BMSXGYR9T upload=6ND17IOQPJQW tag=DUBNYCMO4VTF type=write size=2442653 2024-09-19T13:47:45.816 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.812+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~4YX8TLCC4NAP.0 size=1048576 2024-09-19T13:47:45.818 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.812+0000 7fcf3240c8c0 1 < completed part key=_multipart_DHPONKOVS8CT.2~4YX8TLCC4NAP.1 size=60662 2024-09-19T13:47:45.822 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.820+0000 7fcf3240c8c0 1 < completed multipart upload key=DHPONKOVS8CT upload=4YX8TLCC4NAP tag=BLJAMD0T86TU type=write size=2157814 2024-09-19T13:47:45.825 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.820+0000 7fcf3240c8c0 1 > prepared operation key=STMT6XU2EJQM tag=W77Z6SOH7T0Y type=del size=1856857 2024-09-19T13:47:45.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.820+0000 7fcf3240c8c0 1 < canceled part key=_multipart_AES54TJK7VH7.2~HMVT0TY0OSGL.0 size=1048576 2024-09-19T13:47:45.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.824+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~HMVT0TY0OSGL.1 size=1048576 2024-09-19T13:47:45.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.824+0000 7fcf3240c8c0 1 < completed part key=_multipart_AES54TJK7VH7.2~HMVT0TY0OSGL.2 size=1023011 2024-09-19T13:47:45.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.828+0000 7fcf3240c8c0 1 < canceled multipart upload key=AES54TJK7VH7 upload=HMVT0TY0OSGL tag=MS146ZL74PZT type=write size=4168739 2024-09-19T13:47:45.838 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.832+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~X2KX3AAHRZUT.0 size=1048576 2024-09-19T13:47:45.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.836+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~X2KX3AAHRZUT.1 size=592072 2024-09-19T13:47:45.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.836+0000 7fcf3240c8c0 1 > prepared multipart upload key=X16ENUFL40RN upload=X2KX3AAHRZUT tag=4I1L4834IDG6 type=write size=2689224 2024-09-19T13:47:45.842 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.840+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~11H9SZTSIQ31.0 size=1048576 2024-09-19T13:47:45.844 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.840+0000 7fcf3240c8c0 1 < completed part key=_multipart_C35EUAOWLBR3.2~11H9SZTSIQ31.1 size=553397 2024-09-19T13:47:45.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.844+0000 7fcf3240c8c0 1 < completed multipart upload key=C35EUAOWLBR3 upload=11H9SZTSIQ31 tag=VHL4KGXO2UK7 type=write size=2650549 2024-09-19T13:47:45.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.848+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~TZDB6X229TBF.0 size=1048576 2024-09-19T13:47:45.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.852+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~TZDB6X229TBF.1 size=1048576 2024-09-19T13:47:45.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.852+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QSM2Q8CW1Q86.2~TZDB6X229TBF.2 size=856627 2024-09-19T13:47:45.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.852+0000 7fcf3240c8c0 1 > prepared multipart upload key=QSM2Q8CW1Q86 upload=TZDB6X229TBF tag=9YQREA1B6U0U type=write size=4002355 2024-09-19T13:47:45.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.856+0000 7fcf3240c8c0 1 < completed delete operation key=1BMF3S2BZLLI tag=1USM6ID359DM type=del 2024-09-19T13:47:45.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.860+0000 7fcf3240c8c0 1 > prepared part key=_multipart_X16ENUFL40RN.2~QTFQU5APTI1X.0 size=380562 2024-09-19T13:47:45.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.860+0000 7fcf3240c8c0 1 > prepared multipart upload key=X16ENUFL40RN upload=QTFQU5APTI1X tag=12Q0D912B6VA type=write size=1429138 2024-09-19T13:47:45.866 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.860+0000 7fcf3240c8c0 1 < completed delete operation key=D20C6C2ZFX1W tag=NLBHBDOPJWUE type=del 2024-09-19T13:47:45.871 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.868+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~3SDESOTG88MO.0 size=1048576 2024-09-19T13:47:45.873 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.868+0000 7fcf3240c8c0 1 > prepared part key=_multipart_QAYJ5B1KZ08J.2~3SDESOTG88MO.1 size=454383 2024-09-19T13:47:45.873 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.868+0000 7fcf3240c8c0 1 > prepared multipart upload key=QAYJ5B1KZ08J upload=3SDESOTG88MO tag=BH9IV27D5AQE type=write size=2551535 2024-09-19T13:47:45.878 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.872+0000 7fcf3240c8c0 1 < suggested remove operation key=BXUPV5XSJBTH tag=963JVSDGTANG type=del 2024-09-19T13:47:45.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.880+0000 7fcf3240c8c0 1 > prepared part key=_multipart_ZCKKQ1R8318S.2~7NNTF2BT2IOI.0 size=192942 2024-09-19T13:47:45.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:47:45.880+0000 7fcf3240c8c0 1 > prepared multipart upload key=ZCKKQ1R8318S upload=7NNTF2BT2IOI tag=K233RIST8AC9 type=write size=1241518 2024-09-19T13:47:45.883 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] cls_rgw_stats.simulate (22250 ms) 2024-09-19T13:47:45.883 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 1 test from cls_rgw_stats (22250 ms total) 2024-09-19T13:47:45.883 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:47:45.883 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment tear-down 2024-09-19T13:47:46.427 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] 1 test from 1 test suite ran. (24694 ms total) 2024-09-19T13:47:46.427 INFO:tasks.workunit.client.0.smithi153.stdout:[ PASSED ] 1 test. 2024-09-19T13:47:46.436 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:47:46.436 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:47:46.490 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-19T13:47:46.491 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-19T13:47:46.491 DEBUG:teuthology.orchestra.run.smithi153:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-19T13:47:46.553 INFO:tasks.workunit.client.0.smithi153.stdout:Running main() from gmock_main.cc 2024-09-19T13:47:46.553 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-19T13:47:46.553 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment set-up. 2024-09-19T13:47:48.451 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 31 tests from CmpOmap 2024-09-19T13:47:48.453 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-19T13:47:48.484 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (31 ms) 2024-09-19T13:47:48.484 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-19T13:47:48.496 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (12 ms) 2024-09-19T13:47:48.497 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-19T13:47:48.501 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (5 ms) 2024-09-19T13:47:48.501 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-19T13:47:48.507 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (6 ms) 2024-09-19T13:47:48.507 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-19T13:47:48.519 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_vals_str (12 ms) 2024-09-19T13:47:48.519 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-19T13:47:48.527 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_vals_u64 (9 ms) 2024-09-19T13:47:48.527 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-19T13:47:48.533 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (6 ms) 2024-09-19T13:47:48.534 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-19T13:47:48.543 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (9 ms) 2024-09-19T13:47:48.543 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-19T13:47:48.550 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (7 ms) 2024-09-19T13:47:48.550 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-19T13:47:48.561 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (11 ms) 2024-09-19T13:47:48.561 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-19T13:47:48.562 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-19T13:47:48.562 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-19T13:47:48.563 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-19T13:47:48.563 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-19T13:47:48.579 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (16 ms) 2024-09-19T13:47:48.579 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-19T13:47:48.593 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (14 ms) 2024-09-19T13:47:48.593 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-19T13:47:48.611 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (18 ms) 2024-09-19T13:47:48.611 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-19T13:47:48.627 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (16 ms) 2024-09-19T13:47:48.627 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-19T13:47:48.646 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_set_vals_str (19 ms) 2024-09-19T13:47:48.646 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-19T13:47:48.667 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (21 ms) 2024-09-19T13:47:48.668 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-19T13:47:48.675 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (7 ms) 2024-09-19T13:47:48.675 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-19T13:47:48.681 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (7 ms) 2024-09-19T13:47:48.681 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-19T13:47:48.684 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (2 ms) 2024-09-19T13:47:48.684 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-19T13:47:48.686 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (2 ms) 2024-09-19T13:47:48.686 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-19T13:47:48.701 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (15 ms) 2024-09-19T13:47:48.701 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-19T13:47:48.720 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (19 ms) 2024-09-19T13:47:48.721 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-19T13:47:48.738 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (19 ms) 2024-09-19T13:47:48.739 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-19T13:47:48.760 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (21 ms) 2024-09-19T13:47:48.760 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-19T13:47:48.766 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (6 ms) 2024-09-19T13:47:48.766 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-19T13:47:48.773 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (7 ms) 2024-09-19T13:47:48.773 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-19T13:47:48.776 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (3 ms) 2024-09-19T13:47:48.776 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-19T13:47:48.778 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (2 ms) 2024-09-19T13:47:48.778 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-19T13:47:48.797 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (19 ms) 2024-09-19T13:47:48.797 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 31 tests from CmpOmap (346 ms total) 2024-09-19T13:47:48.797 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:47:48.797 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment tear-down 2024-09-19T13:47:49.465 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] 31 tests from 1 test suite ran. (2912 ms total) 2024-09-19T13:47:49.465 INFO:tasks.workunit.client.0.smithi153.stdout:[ PASSED ] 31 tests. 2024-09-19T13:47:49.471 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:47:49.471 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:47:49.531 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-19T13:47:49.533 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-19T13:47:49.533 DEBUG:teuthology.orchestra.run.smithi153:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-19T13:47:49.597 INFO:tasks.workunit.client.0.smithi153.stdout:Running main() from gmock_main.cc 2024-09-19T13:47:49.598 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-19T13:47:49.598 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment set-up. 2024-09-19T13:47:49.598 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-19T13:47:49.598 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-19T13:47:52.480 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2883 ms) 2024-09-19T13:47:52.480 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-19T13:47:55.525 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3045 ms) 2024-09-19T13:47:55.525 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-19T13:47:58.553 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestCls2PCQueue.Reserve (3028 ms) 2024-09-19T13:47:58.554 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-19T13:48:01.606 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3052 ms) 2024-09-19T13:48:01.606 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-19T13:48:06.676 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestCls2PCQueue.Commit (5068 ms) 2024-09-19T13:48:06.676 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-19T13:48:10.724 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestCls2PCQueue.Stats (4050 ms) 2024-09-19T13:48:10.725 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-19T13:48:14.778 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4054 ms) 2024-09-19T13:48:14.778 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-19T13:48:17.790 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestCls2PCQueue.Abort (3008 ms) 2024-09-19T13:48:17.790 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-19T13:48:20.795 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestCls2PCQueue.ReserveError (3009 ms) 2024-09-19T13:48:20.795 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-19T13:48:23.866 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestCls2PCQueue.CommitError (3071 ms) 2024-09-19T13:48:23.866 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-19T13:48:26.923 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestCls2PCQueue.AbortError (3057 ms) 2024-09-19T13:48:26.923 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-19T13:48:29.927 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3004 ms) 2024-09-19T13:48:29.927 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-19T13:48:33.002 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3071 ms) 2024-09-19T13:48:33.002 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-19T13:48:36.009 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3010 ms) 2024-09-19T13:48:36.009 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-19T13:48:39.021 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3012 ms) 2024-09-19T13:48:39.021 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-19T13:48:42.092 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3070 ms) 2024-09-19T13:48:42.092 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-19T13:48:45.128 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3037 ms) 2024-09-19T13:48:45.129 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-19T13:48:48.174 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestCls2PCQueue.Cleanup (3044 ms) 2024-09-19T13:48:48.174 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-19T13:49:00.426 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestCls2PCQueue.MultiProducer (12253 ms) 2024-09-19T13:49:00.426 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-19T13:49:05.485 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (5059 ms) 2024-09-19T13:49:05.485 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-19T13:49:19.534 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (14047 ms) 2024-09-19T13:49:19.535 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-19T13:49:25.607 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (6076 ms) 2024-09-19T13:49:25.607 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-19T13:49:35.446 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (9838 ms) 2024-09-19T13:49:35.446 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-19T13:49:45.487 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (10041 ms) 2024-09-19T13:49:45.487 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 24 tests from TestCls2PCQueue (115890 ms total) 2024-09-19T13:49:45.487 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:49:45.487 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment tear-down 2024-09-19T13:49:45.487 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] 24 tests from 1 test suite ran. (115891 ms total) 2024-09-19T13:49:45.487 INFO:tasks.workunit.client.0.smithi153.stdout:[ PASSED ] 24 tests. 2024-09-19T13:49:45.505 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:49:45.505 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:49:45.562 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-19T13:49:45.563 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-19T13:49:45.564 DEBUG:teuthology.orchestra.run.smithi153:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-19T13:49:45.643 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:49:45.643 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:49:45.644 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-19T13:49:45.644 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment set-up. 2024-09-19T13:49:47.505 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 4 tests from ClsAccount 2024-09-19T13:49:47.505 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] ClsAccount.add 2024-09-19T13:49:47.554 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] ClsAccount.add (49 ms) 2024-09-19T13:49:47.554 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] ClsAccount.get 2024-09-19T13:49:47.562 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] ClsAccount.get (9 ms) 2024-09-19T13:49:47.562 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] ClsAccount.rm 2024-09-19T13:49:47.574 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] ClsAccount.rm (12 ms) 2024-09-19T13:49:47.574 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] ClsAccount.list 2024-09-19T13:49:47.616 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] ClsAccount.list (42 ms) 2024-09-19T13:49:47.616 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 4 tests from ClsAccount (112 ms total) 2024-09-19T13:49:47.617 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:49:47.617 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment tear-down 2024-09-19T13:49:48.503 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] 4 tests from 1 test suite ran. (2860 ms total) 2024-09-19T13:49:48.503 INFO:tasks.workunit.client.0.smithi153.stdout:[ PASSED ] 4 tests. 2024-09-19T13:49:48.509 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:49:48.509 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:49:48.563 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-19T13:49:48.564 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-19T13:49:48.565 DEBUG:teuthology.orchestra.run.smithi153:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-19T13:49:48.638 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:49:48.638 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:49:48.639 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-19T13:49:48.639 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment set-up. 2024-09-19T13:49:50.552 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 6 tests from rgw_gc_log 2024-09-19T13:49:50.553 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-19T13:49:50.584 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] rgw_gc_log.init_existing_queue (30 ms) 2024-09-19T13:49:50.584 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-19T13:49:50.587 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] rgw_gc_log.init_existing_omap (5 ms) 2024-09-19T13:49:50.587 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-19T13:49:50.593 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (6 ms) 2024-09-19T13:49:50.594 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-19T13:49:50.596 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (3 ms) 2024-09-19T13:49:50.596 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-19T13:49:50.600 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] rgw_gc_log.defer1_after_init (4 ms) 2024-09-19T13:49:50.601 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-19T13:49:50.603 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] rgw_gc_log.defer2_before_init (3 ms) 2024-09-19T13:49:50.604 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 6 tests from rgw_gc_log (51 ms total) 2024-09-19T13:49:50.604 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:49:50.604 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment tear-down 2024-09-19T13:49:51.552 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] 6 tests from 1 test suite ran. (2914 ms total) 2024-09-19T13:49:51.553 INFO:tasks.workunit.client.0.smithi153.stdout:[ PASSED ] 6 tests. 2024-09-19T13:49:51.559 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:49:51.560 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:49:51.617 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-19T13:49:51.618 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-19T13:49:51.618 DEBUG:teuthology.orchestra.run.smithi153:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-19T13:49:51.689 INFO:tasks.workunit.client.0.smithi153.stdout:Running main() from gmock_main.cc 2024-09-19T13:49:51.689 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-19T13:49:51.689 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment set-up. 2024-09-19T13:49:51.689 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 4 tests from TestRGWObj 2024-09-19T13:49:51.689 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestRGWObj.underscore 2024-09-19T13:49:51.690 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: _obj 2024-09-19T13:49:51.690 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: _obj 2024-09-19T13:49:51.690 INFO:tasks.workunit.client.0.smithi153.stdout:stripped: _obj ns= i= 2024-09-19T13:49:51.690 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: _obj 2024-09-19T13:49:51.690 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: _obj 2024-09-19T13:49:51.690 INFO:tasks.workunit.client.0.smithi153.stdout:stripped: _obj ns= i= 2024-09-19T13:49:51.690 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: _obj 2024-09-19T13:49:51.690 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: _obj 2024-09-19T13:49:51.690 INFO:tasks.workunit.client.0.smithi153.stdout:stripped: _obj ns= i= 2024-09-19T13:49:51.690 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.690 INFO:tasks.workunit.client.0.smithi153.stdout: "obj1": { 2024-09-19T13:49:51.690 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.690 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.690 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.691 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.691 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.691 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.691 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.691 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.691 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.691 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.691 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.691 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.691 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_obj", 2024-09-19T13:49:51.691 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.691 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.691 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.691 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.691 INFO:tasks.workunit.client.0.smithi153.stdout: "obj2": { 2024-09-19T13:49:51.692 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.692 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.692 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.692 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.692 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.692 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.692 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.692 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.692 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.692 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.692 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.692 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.692 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_obj", 2024-09-19T13:49:51.692 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.693 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.693 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.693 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.693 INFO:tasks.workunit.client.0.smithi153.stdout: "obj3": { 2024-09-19T13:49:51.693 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.693 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.693 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.693 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.693 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.694 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.694 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.694 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.694 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.694 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.694 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.694 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.694 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_obj", 2024-09-19T13:49:51.694 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.695 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.695 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.695 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.695 INFO:tasks.workunit.client.0.smithi153.stdout: "obj3-2": { 2024-09-19T13:49:51.695 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.695 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.695 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.695 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.695 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.695 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.695 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.695 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.695 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.695 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.696 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.696 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.696 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_obj", 2024-09-19T13:49:51.696 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.696 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.696 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.696 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.696 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.696 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: _obj 2024-09-19T13:49:51.696 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: _obj 2024-09-19T13:49:51.696 INFO:tasks.workunit.client.0.smithi153.stdout:stripped: _obj ns=ns i= 2024-09-19T13:49:51.696 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: _obj 2024-09-19T13:49:51.696 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: _obj 2024-09-19T13:49:51.697 INFO:tasks.workunit.client.0.smithi153.stdout:stripped: _obj ns=ns i= 2024-09-19T13:49:51.697 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: _obj 2024-09-19T13:49:51.697 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: _obj 2024-09-19T13:49:51.697 INFO:tasks.workunit.client.0.smithi153.stdout:stripped: _obj ns=ns i= 2024-09-19T13:49:51.697 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.697 INFO:tasks.workunit.client.0.smithi153.stdout: "obj1": { 2024-09-19T13:49:51.697 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.697 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.697 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.697 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.697 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.697 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.697 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.698 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.698 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.698 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.698 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.698 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.698 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_obj", 2024-09-19T13:49:51.698 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.698 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.698 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.698 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.698 INFO:tasks.workunit.client.0.smithi153.stdout: "obj2": { 2024-09-19T13:49:51.698 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.698 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.699 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.699 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.699 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.699 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.699 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.699 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.699 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.699 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.699 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.699 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.699 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_obj", 2024-09-19T13:49:51.699 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.699 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.699 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.699 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.700 INFO:tasks.workunit.client.0.smithi153.stdout: "obj3": { 2024-09-19T13:49:51.700 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.700 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.700 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.700 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.700 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.700 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.700 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.700 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.700 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.700 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.700 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.700 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.701 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_obj", 2024-09-19T13:49:51.701 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.701 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.701 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.701 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.701 INFO:tasks.workunit.client.0.smithi153.stdout: "obj3-2": { 2024-09-19T13:49:51.701 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.701 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.701 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.701 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.701 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.701 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.701 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.701 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.701 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.702 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.702 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.702 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.702 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_obj", 2024-09-19T13:49:51.702 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.702 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.702 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.702 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.702 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.702 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: _obj[v1] 2024-09-19T13:49:51.702 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: _obj[v1] 2024-09-19T13:49:51.702 INFO:tasks.workunit.client.0.smithi153.stdout:stripped: _obj ns= i=v1 2024-09-19T13:49:51.702 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: _obj[v1] 2024-09-19T13:49:51.702 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: _obj[v1] 2024-09-19T13:49:51.702 INFO:tasks.workunit.client.0.smithi153.stdout:stripped: _obj ns= i=v1 2024-09-19T13:49:51.703 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: _obj[v1] 2024-09-19T13:49:51.703 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: _obj[v1] 2024-09-19T13:49:51.703 INFO:tasks.workunit.client.0.smithi153.stdout:stripped: _obj ns= i=v1 2024-09-19T13:49:51.703 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.703 INFO:tasks.workunit.client.0.smithi153.stdout: "obj1": { 2024-09-19T13:49:51.703 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.703 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.703 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.703 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.703 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.703 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.703 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.703 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.703 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.704 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.704 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.704 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.704 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_obj", 2024-09-19T13:49:51.704 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "v1", 2024-09-19T13:49:51.704 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.704 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.704 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.704 INFO:tasks.workunit.client.0.smithi153.stdout: "obj2": { 2024-09-19T13:49:51.704 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.704 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.704 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.704 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.704 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.705 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.705 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.705 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.705 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.705 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.705 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.705 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.705 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_obj", 2024-09-19T13:49:51.705 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "v1", 2024-09-19T13:49:51.705 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.705 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.705 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.705 INFO:tasks.workunit.client.0.smithi153.stdout: "obj3": { 2024-09-19T13:49:51.705 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.705 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.706 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.706 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.706 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.706 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.706 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.706 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.706 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.706 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.706 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.706 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.706 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_obj", 2024-09-19T13:49:51.706 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.706 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.706 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.707 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.707 INFO:tasks.workunit.client.0.smithi153.stdout: "obj3-2": { 2024-09-19T13:49:51.707 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.707 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.707 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.707 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.707 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.707 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.707 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.707 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.707 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.707 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.707 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.707 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.708 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_obj", 2024-09-19T13:49:51.708 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "v1", 2024-09-19T13:49:51.708 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.708 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.708 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.708 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.708 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: _obj[v1] 2024-09-19T13:49:51.708 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: _obj[v1] 2024-09-19T13:49:51.708 INFO:tasks.workunit.client.0.smithi153.stdout:stripped: _obj ns=ns i=v1 2024-09-19T13:49:51.708 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: _obj[v1] 2024-09-19T13:49:51.708 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: _obj[v1] 2024-09-19T13:49:51.708 INFO:tasks.workunit.client.0.smithi153.stdout:stripped: _obj ns=ns i=v1 2024-09-19T13:49:51.708 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: _obj[v1] 2024-09-19T13:49:51.709 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: _obj[v1] 2024-09-19T13:49:51.709 INFO:tasks.workunit.client.0.smithi153.stdout:stripped: _obj ns=ns i=v1 2024-09-19T13:49:51.709 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.709 INFO:tasks.workunit.client.0.smithi153.stdout: "obj1": { 2024-09-19T13:49:51.709 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.709 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.709 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.709 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.709 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.709 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.709 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.709 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.709 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.710 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.710 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.710 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.710 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_obj", 2024-09-19T13:49:51.710 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "v1", 2024-09-19T13:49:51.710 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.710 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.710 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.710 INFO:tasks.workunit.client.0.smithi153.stdout: "obj2": { 2024-09-19T13:49:51.710 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.710 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.710 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.710 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.710 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.710 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.710 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.711 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.711 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.711 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.711 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.711 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.711 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_obj", 2024-09-19T13:49:51.711 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "v1", 2024-09-19T13:49:51.711 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.711 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.711 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.711 INFO:tasks.workunit.client.0.smithi153.stdout: "obj3": { 2024-09-19T13:49:51.711 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.711 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.712 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.712 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.712 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.712 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.712 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.712 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.712 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.712 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.712 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.712 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.712 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_obj", 2024-09-19T13:49:51.712 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.712 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.712 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.713 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.713 INFO:tasks.workunit.client.0.smithi153.stdout: "obj3-2": { 2024-09-19T13:49:51.713 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.713 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.713 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.713 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.713 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.713 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.713 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.713 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.713 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.713 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.713 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.714 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.714 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_obj", 2024-09-19T13:49:51.714 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "v1", 2024-09-19T13:49:51.714 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.714 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.714 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.714 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.714 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-19T13:49:51.714 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-19T13:49:51.714 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: obj 2024-09-19T13:49:51.715 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: obj 2024-09-19T13:49:51.715 INFO:tasks.workunit.client.0.smithi153.stdout:stripped: obj ns= i= 2024-09-19T13:49:51.715 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: obj 2024-09-19T13:49:51.715 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: obj 2024-09-19T13:49:51.715 INFO:tasks.workunit.client.0.smithi153.stdout:stripped: obj ns= i= 2024-09-19T13:49:51.715 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: obj 2024-09-19T13:49:51.715 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: obj 2024-09-19T13:49:51.715 INFO:tasks.workunit.client.0.smithi153.stdout:stripped: obj ns= i= 2024-09-19T13:49:51.715 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.715 INFO:tasks.workunit.client.0.smithi153.stdout: "obj1": { 2024-09-19T13:49:51.715 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.715 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.715 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.716 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.716 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.716 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.716 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.716 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.716 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.716 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.716 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.716 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.716 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "obj", 2024-09-19T13:49:51.716 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.716 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.716 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.716 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.717 INFO:tasks.workunit.client.0.smithi153.stdout: "obj2": { 2024-09-19T13:49:51.717 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.717 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.717 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.717 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.717 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.717 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.717 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.717 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.717 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.717 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.717 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.717 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.718 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "obj", 2024-09-19T13:49:51.718 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.718 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.718 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.718 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.718 INFO:tasks.workunit.client.0.smithi153.stdout: "obj3": { 2024-09-19T13:49:51.718 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.718 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.718 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.718 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.718 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.718 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.719 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.719 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.719 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.719 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.719 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.719 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.719 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "obj", 2024-09-19T13:49:51.719 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.719 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.719 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.719 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.719 INFO:tasks.workunit.client.0.smithi153.stdout: "obj3-2": { 2024-09-19T13:49:51.719 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.719 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.719 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.720 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.720 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.720 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.720 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.720 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.720 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.720 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.720 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.720 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.720 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "obj", 2024-09-19T13:49:51.720 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.720 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.720 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.720 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.721 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.721 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: obj 2024-09-19T13:49:51.721 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: obj 2024-09-19T13:49:51.721 INFO:tasks.workunit.client.0.smithi153.stdout:stripped: obj ns=ns i= 2024-09-19T13:49:51.721 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: obj 2024-09-19T13:49:51.721 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: obj 2024-09-19T13:49:51.721 INFO:tasks.workunit.client.0.smithi153.stdout:stripped: obj ns=ns i= 2024-09-19T13:49:51.721 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: obj 2024-09-19T13:49:51.721 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: obj 2024-09-19T13:49:51.721 INFO:tasks.workunit.client.0.smithi153.stdout:stripped: obj ns=ns i= 2024-09-19T13:49:51.721 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.721 INFO:tasks.workunit.client.0.smithi153.stdout: "obj1": { 2024-09-19T13:49:51.721 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.721 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.721 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.722 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.722 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.722 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.722 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.722 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.722 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.722 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.722 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.722 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.722 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "obj", 2024-09-19T13:49:51.722 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.722 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.722 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.722 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.723 INFO:tasks.workunit.client.0.smithi153.stdout: "obj2": { 2024-09-19T13:49:51.723 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.723 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.723 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.723 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.723 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.723 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.723 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.723 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.723 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.723 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.723 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.723 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.723 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "obj", 2024-09-19T13:49:51.723 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.724 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.724 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.724 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.724 INFO:tasks.workunit.client.0.smithi153.stdout: "obj3": { 2024-09-19T13:49:51.724 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.724 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.724 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.724 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.724 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.724 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.724 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.724 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.724 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.724 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.725 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.725 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.725 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "obj", 2024-09-19T13:49:51.725 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.725 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.725 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.725 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.725 INFO:tasks.workunit.client.0.smithi153.stdout: "obj3-2": { 2024-09-19T13:49:51.725 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.725 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.725 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.725 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.725 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.725 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.726 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.726 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.726 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.726 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.726 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.726 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.726 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "obj", 2024-09-19T13:49:51.726 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.726 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.726 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.726 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.726 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.726 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: obj[v1] 2024-09-19T13:49:51.726 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: obj[v1] 2024-09-19T13:49:51.727 INFO:tasks.workunit.client.0.smithi153.stdout:stripped: obj ns= i=v1 2024-09-19T13:49:51.727 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: obj[v1] 2024-09-19T13:49:51.727 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: obj[v1] 2024-09-19T13:49:51.727 INFO:tasks.workunit.client.0.smithi153.stdout:stripped: obj ns= i=v1 2024-09-19T13:49:51.727 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: obj[v1] 2024-09-19T13:49:51.727 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: obj[v1] 2024-09-19T13:49:51.727 INFO:tasks.workunit.client.0.smithi153.stdout:stripped: obj ns= i=v1 2024-09-19T13:49:51.727 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.727 INFO:tasks.workunit.client.0.smithi153.stdout: "obj1": { 2024-09-19T13:49:51.727 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.727 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.727 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.727 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.727 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.728 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.728 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.728 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.728 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.728 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.728 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.728 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.728 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "obj", 2024-09-19T13:49:51.728 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "v1", 2024-09-19T13:49:51.728 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.728 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.728 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.728 INFO:tasks.workunit.client.0.smithi153.stdout: "obj2": { 2024-09-19T13:49:51.728 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.729 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.729 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.729 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.729 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.729 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.729 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.729 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.729 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.729 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.729 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.729 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.729 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "obj", 2024-09-19T13:49:51.729 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "v1", 2024-09-19T13:49:51.729 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.729 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.730 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.730 INFO:tasks.workunit.client.0.smithi153.stdout: "obj3": { 2024-09-19T13:49:51.730 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.730 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.730 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.730 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.730 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.730 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.730 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.730 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.730 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.730 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.730 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.731 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.731 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "obj", 2024-09-19T13:49:51.731 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.731 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.731 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.731 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.731 INFO:tasks.workunit.client.0.smithi153.stdout: "obj3-2": { 2024-09-19T13:49:51.731 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.731 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.731 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.731 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.731 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.731 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.731 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.731 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.732 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.732 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.732 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.732 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.732 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "obj", 2024-09-19T13:49:51.732 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "v1", 2024-09-19T13:49:51.732 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.732 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.732 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.732 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.732 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: obj[v1] 2024-09-19T13:49:51.732 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: obj[v1] 2024-09-19T13:49:51.732 INFO:tasks.workunit.client.0.smithi153.stdout:stripped: obj ns=ns i=v1 2024-09-19T13:49:51.732 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: obj[v1] 2024-09-19T13:49:51.733 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: obj[v1] 2024-09-19T13:49:51.733 INFO:tasks.workunit.client.0.smithi153.stdout:stripped: obj ns=ns i=v1 2024-09-19T13:49:51.733 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: obj[v1] 2024-09-19T13:49:51.733 INFO:tasks.workunit.client.0.smithi153.stdout:parsed: obj[v1] 2024-09-19T13:49:51.733 INFO:tasks.workunit.client.0.smithi153.stdout:stripped: obj ns=ns i=v1 2024-09-19T13:49:51.733 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.733 INFO:tasks.workunit.client.0.smithi153.stdout: "obj1": { 2024-09-19T13:49:51.733 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.733 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.733 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.733 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.733 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.733 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.734 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.734 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.734 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.734 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.734 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.734 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.734 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "obj", 2024-09-19T13:49:51.734 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "v1", 2024-09-19T13:49:51.734 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.734 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.734 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.734 INFO:tasks.workunit.client.0.smithi153.stdout: "obj2": { 2024-09-19T13:49:51.734 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.734 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.735 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.735 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.735 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.735 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.735 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.735 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.735 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.735 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.735 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.735 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.735 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "obj", 2024-09-19T13:49:51.735 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "v1", 2024-09-19T13:49:51.735 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.735 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.735 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.736 INFO:tasks.workunit.client.0.smithi153.stdout: "obj3": { 2024-09-19T13:49:51.736 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.736 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.736 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.736 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.736 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.736 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.736 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.736 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.736 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.736 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.736 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.736 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.736 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "obj", 2024-09-19T13:49:51.737 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.737 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.737 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.737 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.737 INFO:tasks.workunit.client.0.smithi153.stdout: "obj3-2": { 2024-09-19T13:49:51.737 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.737 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.737 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.737 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.737 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.737 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.737 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.737 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.737 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.738 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.738 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.738 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.738 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "obj", 2024-09-19T13:49:51.738 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "v1", 2024-09-19T13:49:51.738 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.738 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.738 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.738 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.738 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-19T13:49:51.738 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-19T13:49:51.738 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.738 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.738 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.738 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.739 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.739 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.739 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.739 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.739 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.739 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.739 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.739 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.739 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.739 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.739 INFO:tasks.workunit.client.0.smithi153.stdout: "obj": { 2024-09-19T13:49:51.739 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.739 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.739 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.739 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.740 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.740 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.740 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.740 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.740 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.740 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.740 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.740 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.740 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "myobj", 2024-09-19T13:49:51.740 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.740 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.740 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.740 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.740 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.741 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.741 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.741 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": "default-placement.data", 2024-09-19T13:49:51.741 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker_myobj", 2024-09-19T13:49:51.741 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.741 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.741 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.741 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.741 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.741 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.741 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.741 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.741 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.742 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.742 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.742 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.742 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.742 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.742 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.742 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.742 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.742 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "myobj", 2024-09-19T13:49:51.742 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.742 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.742 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.742 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.742 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.742 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.743 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.743 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.743 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.743 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.743 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.743 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.743 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.743 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.743 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.743 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.743 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.743 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.743 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.743 INFO:tasks.workunit.client.0.smithi153.stdout: "obj": { 2024-09-19T13:49:51.744 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.744 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.744 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.744 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.744 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.744 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.744 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.744 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.744 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.744 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.744 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.744 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.744 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "myobj", 2024-09-19T13:49:51.745 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.745 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.745 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.745 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.745 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.745 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.745 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.745 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.745 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker_myobj", 2024-09-19T13:49:51.745 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.745 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.745 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.745 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.745 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.745 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.746 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.746 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.746 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.746 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.746 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.746 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.746 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.746 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.746 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.746 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.746 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.746 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "myobj", 2024-09-19T13:49:51.746 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.746 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.747 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.747 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.747 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.747 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.747 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.747 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.747 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.747 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.747 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.747 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.747 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.747 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.747 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.747 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.748 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.748 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.748 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.748 INFO:tasks.workunit.client.0.smithi153.stdout: "obj": { 2024-09-19T13:49:51.748 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.748 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.748 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.748 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.748 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.748 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.748 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.748 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.748 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.748 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.749 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.749 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.749 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "myobj", 2024-09-19T13:49:51.749 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.749 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.749 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.749 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.749 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.749 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.749 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.749 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": "default-placement.data", 2024-09-19T13:49:51.749 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__ns_myobj", 2024-09-19T13:49:51.749 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.749 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.750 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.750 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.750 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.750 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.750 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.750 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.750 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.750 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.750 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.750 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.750 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.750 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.750 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.750 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.751 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.751 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "myobj", 2024-09-19T13:49:51.751 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.751 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.751 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.751 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.751 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.751 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.751 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.751 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.751 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.751 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.751 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.751 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.752 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.752 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.752 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.752 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.752 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.752 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.752 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.752 INFO:tasks.workunit.client.0.smithi153.stdout: "obj": { 2024-09-19T13:49:51.752 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.752 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.752 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.752 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.752 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.752 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.753 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.753 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.753 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.753 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.753 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.753 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.753 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "myobj", 2024-09-19T13:49:51.753 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.753 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.753 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.753 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.753 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.753 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.753 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.754 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.754 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__ns_myobj", 2024-09-19T13:49:51.754 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.754 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.754 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.754 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.754 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.754 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.754 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.754 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.754 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.754 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.754 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.754 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.755 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.755 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.755 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.755 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.755 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.755 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "myobj", 2024-09-19T13:49:51.755 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.755 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.755 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.755 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.755 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.755 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.755 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.755 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.755 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.756 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.756 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.756 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.756 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.756 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.756 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.756 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.756 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.756 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.756 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.756 INFO:tasks.workunit.client.0.smithi153.stdout: "obj": { 2024-09-19T13:49:51.756 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.756 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.757 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.757 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.757 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.757 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.757 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.757 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.757 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.757 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.757 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.757 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.757 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "myobj", 2024-09-19T13:49:51.757 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.757 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.757 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.757 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.758 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.758 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.758 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.758 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": "default-placement.data", 2024-09-19T13:49:51.758 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__:inst_myobj", 2024-09-19T13:49:51.758 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.758 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.758 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.758 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.758 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.758 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.758 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.758 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.758 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.759 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.759 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.759 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.759 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.759 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.759 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.759 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.759 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.759 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "myobj", 2024-09-19T13:49:51.759 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.759 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.759 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.759 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.759 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.759 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.760 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.760 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.760 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.760 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.760 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.760 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.760 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.760 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.760 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.760 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.760 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.760 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.760 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.760 INFO:tasks.workunit.client.0.smithi153.stdout: "obj": { 2024-09-19T13:49:51.761 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.761 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.761 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.761 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.761 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.761 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.761 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.761 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.761 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.761 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.761 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.761 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.761 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "myobj", 2024-09-19T13:49:51.761 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.762 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.762 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.762 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.762 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.762 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.762 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.762 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.762 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__:inst_myobj", 2024-09-19T13:49:51.762 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.762 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.762 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.762 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.762 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.762 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.762 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.763 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.763 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.763 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.763 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.763 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.763 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.763 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.763 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.763 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.763 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.763 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "myobj", 2024-09-19T13:49:51.763 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.763 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.763 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.764 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.764 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.764 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.764 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.764 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.764 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.764 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.764 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.764 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.764 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.764 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.764 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.764 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.764 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.764 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.765 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.765 INFO:tasks.workunit.client.0.smithi153.stdout: "obj": { 2024-09-19T13:49:51.765 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.765 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.765 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.765 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.765 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.765 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.765 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.765 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.765 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.765 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.765 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.765 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.766 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "myobj", 2024-09-19T13:49:51.766 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.766 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.766 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.766 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.766 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.766 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.766 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.766 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": "default-placement.data", 2024-09-19T13:49:51.766 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__ns:inst_myobj", 2024-09-19T13:49:51.766 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.766 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.766 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.766 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.767 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.767 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.767 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.767 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.767 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.767 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.767 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.767 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.767 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.767 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.767 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.767 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.767 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.767 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "myobj", 2024-09-19T13:49:51.768 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.768 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.768 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.768 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.768 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.768 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.768 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.768 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.768 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.768 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.768 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.768 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.768 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.769 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.769 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.769 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.769 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.769 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.769 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.769 INFO:tasks.workunit.client.0.smithi153.stdout: "obj": { 2024-09-19T13:49:51.769 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.769 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.769 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.769 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.769 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.769 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.769 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.770 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.770 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.770 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.770 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.770 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.770 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "myobj", 2024-09-19T13:49:51.770 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.770 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.770 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.770 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.770 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.770 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.770 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.770 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.771 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__ns:inst_myobj", 2024-09-19T13:49:51.771 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.771 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.771 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.771 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.771 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.771 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.771 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.771 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.771 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.771 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.771 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.771 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.771 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.772 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.772 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.772 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.772 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.772 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "myobj", 2024-09-19T13:49:51.772 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.772 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.772 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.772 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.772 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.772 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.772 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.772 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.772 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.773 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.773 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.773 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.773 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.773 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.773 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.773 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.773 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.773 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.773 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.773 INFO:tasks.workunit.client.0.smithi153.stdout: "obj": { 2024-09-19T13:49:51.773 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.773 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.774 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.774 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.774 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.774 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.774 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.774 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.774 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.774 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.774 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.774 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.774 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj", 2024-09-19T13:49:51.774 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.774 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.774 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.774 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.775 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.775 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.775 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.775 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": "default-placement.data", 2024-09-19T13:49:51.775 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker___myobj", 2024-09-19T13:49:51.775 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "marker__myobj" 2024-09-19T13:49:51.775 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.775 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.775 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.775 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.775 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.775 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.775 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.775 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.776 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.776 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.776 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.776 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.776 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.776 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.776 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.776 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.776 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj", 2024-09-19T13:49:51.776 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.776 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.776 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.776 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.776 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.777 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.777 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.777 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.777 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.777 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.777 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.777 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.777 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.777 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.777 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.777 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.777 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.777 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.777 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.777 INFO:tasks.workunit.client.0.smithi153.stdout: "obj": { 2024-09-19T13:49:51.778 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.778 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.778 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.778 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.778 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.778 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.778 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.778 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.778 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.778 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.778 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.778 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.778 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj", 2024-09-19T13:49:51.778 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.779 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.779 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.779 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.779 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.779 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.779 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.779 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.779 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker___myobj", 2024-09-19T13:49:51.779 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "marker__myobj" 2024-09-19T13:49:51.779 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.779 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.779 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.779 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.779 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.779 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.780 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.780 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.780 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.780 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.780 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.780 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.780 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.780 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.780 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.780 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.780 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj", 2024-09-19T13:49:51.780 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.780 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.780 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.781 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.781 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.781 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.781 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.781 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.781 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.781 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.781 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.781 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.781 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.781 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.781 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.781 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.782 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.782 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.782 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.782 INFO:tasks.workunit.client.0.smithi153.stdout: "obj": { 2024-09-19T13:49:51.782 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.782 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.782 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.782 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.782 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.782 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.782 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.782 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.782 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.782 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.783 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.783 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.783 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj", 2024-09-19T13:49:51.783 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.783 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.783 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.783 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.783 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.783 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.783 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.783 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": "default-placement.data", 2024-09-19T13:49:51.783 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__ns__myobj", 2024-09-19T13:49:51.783 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.783 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.784 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.784 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.784 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.784 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.784 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.784 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.784 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.784 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.784 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.784 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.784 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.784 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.785 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.785 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.785 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.785 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj", 2024-09-19T13:49:51.785 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.785 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.785 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.785 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.785 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.785 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.785 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.785 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.785 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.786 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.786 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.786 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.786 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.786 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.786 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.786 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.786 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.786 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.786 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.786 INFO:tasks.workunit.client.0.smithi153.stdout: "obj": { 2024-09-19T13:49:51.786 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.787 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.787 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.787 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.787 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.787 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.787 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.787 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.787 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.787 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.787 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.787 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.787 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj", 2024-09-19T13:49:51.787 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.787 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.788 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.788 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.788 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.788 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.788 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.788 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.788 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__ns__myobj", 2024-09-19T13:49:51.788 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.788 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.788 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.788 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.788 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.789 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.789 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.789 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.789 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.789 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.789 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.789 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.789 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.789 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.789 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.789 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.790 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.790 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj", 2024-09-19T13:49:51.790 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.790 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.790 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.790 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.790 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.790 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.790 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.790 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.790 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.790 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.791 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.791 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.791 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.791 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.791 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.791 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.791 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.791 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.791 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.791 INFO:tasks.workunit.client.0.smithi153.stdout: "obj": { 2024-09-19T13:49:51.791 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.791 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.791 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.791 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.791 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.792 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.792 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.792 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.792 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.792 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.792 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.792 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.792 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj", 2024-09-19T13:49:51.792 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.792 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.792 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.792 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.792 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.792 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.793 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.793 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": "default-placement.data", 2024-09-19T13:49:51.793 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__:inst__myobj", 2024-09-19T13:49:51.793 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "marker__myobj" 2024-09-19T13:49:51.793 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.793 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.793 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.793 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.793 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.793 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.793 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.793 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.793 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.793 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.793 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.794 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.794 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.794 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.794 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.794 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.794 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj", 2024-09-19T13:49:51.794 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.794 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.794 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.794 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.794 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.794 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.794 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.794 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.794 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.795 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.795 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.795 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.795 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.795 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.795 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.795 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.795 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.795 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.795 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.795 INFO:tasks.workunit.client.0.smithi153.stdout: "obj": { 2024-09-19T13:49:51.795 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.795 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.795 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.796 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.796 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.796 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.796 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.796 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.796 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.796 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.796 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.796 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.796 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj", 2024-09-19T13:49:51.796 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.796 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.796 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.796 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.797 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.797 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.797 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.797 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.797 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__:inst__myobj", 2024-09-19T13:49:51.797 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "marker__myobj" 2024-09-19T13:49:51.797 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.797 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.797 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.797 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.797 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.797 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.797 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.797 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.797 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.798 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.798 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.798 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.798 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.798 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.798 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.798 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.798 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj", 2024-09-19T13:49:51.798 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.798 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.798 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.798 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.798 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.798 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.799 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.799 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.799 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.799 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.799 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.799 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.799 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.799 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.799 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.799 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.799 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.799 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.799 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.799 INFO:tasks.workunit.client.0.smithi153.stdout: "obj": { 2024-09-19T13:49:51.800 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.800 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.800 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.800 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.800 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.800 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.800 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.800 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.800 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.800 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.800 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.800 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.800 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj", 2024-09-19T13:49:51.800 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.801 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.801 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.801 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.801 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.801 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.801 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.801 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": "default-placement.data", 2024-09-19T13:49:51.801 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__ns:inst__myobj", 2024-09-19T13:49:51.801 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.801 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.801 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.801 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.801 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.801 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.802 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.802 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.802 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.802 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.802 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.802 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.802 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.802 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.802 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.802 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.802 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.802 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj", 2024-09-19T13:49:51.802 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.802 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.802 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.803 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.803 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.803 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.803 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.803 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.803 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.803 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.803 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.803 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.803 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.803 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.803 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.803 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.803 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.803 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.804 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.804 INFO:tasks.workunit.client.0.smithi153.stdout: "obj": { 2024-09-19T13:49:51.804 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.804 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.804 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.804 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.804 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.804 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.804 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.804 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.804 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.804 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.804 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.805 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.805 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj", 2024-09-19T13:49:51.805 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.805 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.805 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.808 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.808 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.808 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.808 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.808 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.808 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__ns:inst__myobj", 2024-09-19T13:49:51.808 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.808 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.808 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.808 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.809 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.809 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.809 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.809 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.809 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.809 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.809 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.809 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.809 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.809 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.809 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.809 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.809 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.810 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj", 2024-09-19T13:49:51.810 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.810 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.810 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.810 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.810 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.810 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.810 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.810 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.810 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.810 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.810 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.810 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.810 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.811 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.811 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.811 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.811 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.811 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.811 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.811 INFO:tasks.workunit.client.0.smithi153.stdout: "obj": { 2024-09-19T13:49:51.811 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.811 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.811 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.811 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.811 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.811 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.811 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.812 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.812 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.812 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.812 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.812 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.812 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj_", 2024-09-19T13:49:51.812 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.812 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.812 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.812 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.812 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.812 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.812 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.812 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": "default-placement.data", 2024-09-19T13:49:51.813 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker___myobj_", 2024-09-19T13:49:51.813 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "marker__myobj_" 2024-09-19T13:49:51.813 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.813 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.813 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.813 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.813 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.813 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.813 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.813 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.813 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.813 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.814 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.814 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.814 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.814 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.814 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.814 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.814 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj_", 2024-09-19T13:49:51.814 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.814 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.814 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.814 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.814 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.814 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.814 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.815 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.815 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.815 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.815 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.815 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.815 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.815 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.815 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.815 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.815 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.815 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.815 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.815 INFO:tasks.workunit.client.0.smithi153.stdout: "obj": { 2024-09-19T13:49:51.815 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.815 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.816 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.816 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.816 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.816 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.816 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.816 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.816 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.816 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.816 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.816 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.816 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj_", 2024-09-19T13:49:51.816 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.816 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.817 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.817 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.817 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.817 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.817 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.817 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.817 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker___myobj_", 2024-09-19T13:49:51.817 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "marker__myobj_" 2024-09-19T13:49:51.817 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.817 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.817 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.817 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.817 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.817 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.818 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.818 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.818 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.818 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.818 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.818 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.818 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.818 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.818 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.818 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.818 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj_", 2024-09-19T13:49:51.819 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.819 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.819 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.819 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.819 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.819 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.819 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.819 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.819 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.819 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.819 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.819 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.819 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.819 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.819 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.820 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.820 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.820 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.820 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.820 INFO:tasks.workunit.client.0.smithi153.stdout: "obj": { 2024-09-19T13:49:51.820 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.820 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.820 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.820 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.820 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.820 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.820 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.820 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.820 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.821 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.821 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.821 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.821 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj_", 2024-09-19T13:49:51.821 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.821 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.821 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.821 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.821 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.821 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.821 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.821 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": "default-placement.data", 2024-09-19T13:49:51.821 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__ns__myobj_", 2024-09-19T13:49:51.821 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.822 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.822 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.822 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.822 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.822 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.822 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.822 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.822 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.822 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.822 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.822 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.822 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.822 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.822 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.822 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.823 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.823 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj_", 2024-09-19T13:49:51.823 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.823 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.823 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.823 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.823 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.823 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.823 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.823 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.823 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.823 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.823 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.823 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.823 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.824 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.824 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.824 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.824 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.824 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.824 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.824 INFO:tasks.workunit.client.0.smithi153.stdout: "obj": { 2024-09-19T13:49:51.824 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.824 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.824 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.824 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.824 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.824 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.825 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.825 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.825 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.825 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.825 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.825 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.825 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj_", 2024-09-19T13:49:51.825 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.825 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.825 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.825 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.825 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.825 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.825 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.825 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.826 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__ns__myobj_", 2024-09-19T13:49:51.826 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.826 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.826 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.826 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.826 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.826 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.826 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.826 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.826 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.826 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.826 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.826 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.826 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.827 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.827 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.827 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.827 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.827 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj_", 2024-09-19T13:49:51.827 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.827 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.827 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.827 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.827 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.827 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.827 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.827 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.827 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.827 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.828 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.828 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.828 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.828 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.828 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.828 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.828 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.828 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.828 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.828 INFO:tasks.workunit.client.0.smithi153.stdout: "obj": { 2024-09-19T13:49:51.828 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.828 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.828 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.828 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.829 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.829 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.829 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.829 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.829 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.829 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.829 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.829 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.829 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj_", 2024-09-19T13:49:51.829 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.829 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.829 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.829 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.829 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.830 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.830 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.830 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": "default-placement.data", 2024-09-19T13:49:51.830 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__:inst__myobj_", 2024-09-19T13:49:51.830 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "marker__myobj_" 2024-09-19T13:49:51.830 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.830 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.830 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.830 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.830 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.830 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.830 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.830 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.830 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.831 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.831 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.831 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.831 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.831 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.831 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.831 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.831 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj_", 2024-09-19T13:49:51.831 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.831 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.831 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.831 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.831 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.831 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.832 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.832 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.832 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.832 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.832 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.832 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.832 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.832 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.832 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.832 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.832 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.832 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.832 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.832 INFO:tasks.workunit.client.0.smithi153.stdout: "obj": { 2024-09-19T13:49:51.833 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.833 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.833 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.833 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.833 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.833 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.833 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.833 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.833 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.833 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.833 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.833 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.833 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj_", 2024-09-19T13:49:51.834 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.834 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.834 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.834 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.834 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.834 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.834 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.834 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.834 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__:inst__myobj_", 2024-09-19T13:49:51.834 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "marker__myobj_" 2024-09-19T13:49:51.834 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.834 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.834 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.834 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.834 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.835 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.835 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.835 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.835 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.835 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.835 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.835 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.835 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.835 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.835 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.835 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.835 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj_", 2024-09-19T13:49:51.835 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.835 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.836 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.836 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.836 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.836 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.836 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.836 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.836 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.836 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.836 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.836 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.836 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.836 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.836 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.836 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.837 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.837 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.837 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.837 INFO:tasks.workunit.client.0.smithi153.stdout: "obj": { 2024-09-19T13:49:51.837 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.837 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.837 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.837 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.837 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.837 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.837 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.837 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.837 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.837 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.838 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.838 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.838 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj_", 2024-09-19T13:49:51.838 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.838 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.838 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.838 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.838 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.838 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.838 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.838 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": "default-placement.data", 2024-09-19T13:49:51.838 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-19T13:49:51.838 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.838 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.839 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.839 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.839 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.839 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.839 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "test", 2024-09-19T13:49:51.839 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.839 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.839 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.839 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.839 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": "", 2024-09-19T13:49:51.839 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.839 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": "" 2024-09-19T13:49:51.839 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.840 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.840 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.840 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj_", 2024-09-19T13:49:51.840 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.840 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.840 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.840 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.840 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.840 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.840 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.840 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.840 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.840 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.840 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.840 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.841 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.841 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.841 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.841 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.841 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.841 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.841 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.841 INFO:tasks.workunit.client.0.smithi153.stdout: "obj": { 2024-09-19T13:49:51.841 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.841 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.841 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.841 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.841 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.841 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.841 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.842 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.842 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.842 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.842 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.842 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.842 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj_", 2024-09-19T13:49:51.842 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.842 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.842 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.842 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.842 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.842 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.842 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.842 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.843 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-19T13:49:51.843 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.843 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.843 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.843 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.843 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.843 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.843 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.843 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.843 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.843 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.843 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.843 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.843 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.843 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.844 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.844 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.844 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.844 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj_", 2024-09-19T13:49:51.844 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.844 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.844 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.844 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.844 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.844 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-09-19T13:49:51.844 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-19T13:49:51.844 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.844 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.844 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.845 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker_myobj", 2024-09-19T13:49:51.845 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.845 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.845 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.845 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.845 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.845 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.845 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.845 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.845 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.845 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.845 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.845 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.845 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.845 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.846 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.846 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.846 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.846 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "myobj", 2024-09-19T13:49:51.846 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.846 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.846 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.846 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.846 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.846 INFO:tasks.workunit.client.0.smithi153.stdout:raw=.data-pool:marker_myobj 2024-09-19T13:49:51.846 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.846 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj2": { 2024-09-19T13:49:51.846 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.846 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker_myobj", 2024-09-19T13:49:51.846 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.847 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.847 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.847 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.847 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj2": { 2024-09-19T13:49:51.847 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.847 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.847 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.847 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.847 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.847 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.847 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.847 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.847 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.847 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.848 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.848 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.848 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "myobj", 2024-09-19T13:49:51.848 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.848 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.848 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.848 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.848 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.848 INFO:tasks.workunit.client.0.smithi153.stdout:raw2=.data-pool:marker_myobj 2024-09-19T13:49:51.848 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.848 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.848 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.848 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__ns_myobj", 2024-09-19T13:49:51.848 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.849 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.849 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.849 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.849 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.849 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.849 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.849 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.849 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.849 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.849 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.849 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.849 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.850 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.850 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.850 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.850 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.850 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "myobj", 2024-09-19T13:49:51.850 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.850 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.850 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.850 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.850 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.850 INFO:tasks.workunit.client.0.smithi153.stdout:raw=.data-pool:marker__ns_myobj 2024-09-19T13:49:51.850 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.850 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj2": { 2024-09-19T13:49:51.850 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.850 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__ns_myobj", 2024-09-19T13:49:51.851 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.851 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.851 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.851 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.851 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj2": { 2024-09-19T13:49:51.851 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.851 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.851 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.851 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.851 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.851 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.851 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.851 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.851 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.852 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.852 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.852 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.852 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "myobj", 2024-09-19T13:49:51.852 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.852 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.852 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.852 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.852 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.852 INFO:tasks.workunit.client.0.smithi153.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-19T13:49:51.852 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.852 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.852 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.853 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__:inst_myobj", 2024-09-19T13:49:51.853 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.853 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.853 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.853 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.853 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.853 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.853 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.853 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.853 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.853 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.853 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.853 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.853 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.854 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.854 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.854 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.854 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.854 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "myobj", 2024-09-19T13:49:51.854 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.854 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.854 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.854 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.854 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.854 INFO:tasks.workunit.client.0.smithi153.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-19T13:49:51.854 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.854 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj2": { 2024-09-19T13:49:51.854 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.855 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__:inst_myobj", 2024-09-19T13:49:51.855 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.855 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.855 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.855 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.855 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj2": { 2024-09-19T13:49:51.855 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.855 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.855 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.855 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.855 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.855 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.855 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.855 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.856 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.856 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.856 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.856 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.856 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "myobj", 2024-09-19T13:49:51.856 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.856 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.856 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.856 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.856 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.856 INFO:tasks.workunit.client.0.smithi153.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-19T13:49:51.856 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.856 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.856 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.856 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__ns:inst_myobj", 2024-09-19T13:49:51.857 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.857 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.857 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.857 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.857 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.857 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.857 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.857 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.857 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.857 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.857 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.857 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.857 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.857 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.858 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.858 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.858 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.858 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "myobj", 2024-09-19T13:49:51.858 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.858 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.858 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.858 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.858 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.858 INFO:tasks.workunit.client.0.smithi153.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-19T13:49:51.858 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.858 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj2": { 2024-09-19T13:49:51.858 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.858 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__ns:inst_myobj", 2024-09-19T13:49:51.858 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.859 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.859 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.859 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.859 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj2": { 2024-09-19T13:49:51.859 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.859 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.859 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.859 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.859 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.859 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.859 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.859 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.859 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.859 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.860 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.860 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.860 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "myobj", 2024-09-19T13:49:51.860 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.860 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.860 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.860 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.860 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.860 INFO:tasks.workunit.client.0.smithi153.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-19T13:49:51.860 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.860 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.860 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.860 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker___myobj", 2024-09-19T13:49:51.860 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "marker__myobj" 2024-09-19T13:49:51.861 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.861 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.861 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.861 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.861 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.861 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.861 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.861 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.861 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.861 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.861 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.861 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.861 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.861 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.862 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.862 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.862 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj", 2024-09-19T13:49:51.862 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.862 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.862 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.862 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.862 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.862 INFO:tasks.workunit.client.0.smithi153.stdout:raw=.data-pool:marker___myobj 2024-09-19T13:49:51.862 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.862 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj2": { 2024-09-19T13:49:51.862 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.862 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker___myobj", 2024-09-19T13:49:51.862 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "marker__myobj" 2024-09-19T13:49:51.863 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.863 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.863 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.863 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj2": { 2024-09-19T13:49:51.863 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.863 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.863 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.863 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.863 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.863 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.863 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.863 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.863 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.863 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.864 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.864 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.864 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj", 2024-09-19T13:49:51.864 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.864 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.864 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.864 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.864 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.864 INFO:tasks.workunit.client.0.smithi153.stdout:raw2=.data-pool:marker___myobj 2024-09-19T13:49:51.864 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.864 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.864 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.864 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__ns__myobj", 2024-09-19T13:49:51.865 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.865 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.865 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.865 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.865 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.865 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.865 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.865 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.865 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.865 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.865 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.865 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.865 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.865 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.866 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.866 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.866 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.866 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj", 2024-09-19T13:49:51.866 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.866 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.866 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.866 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.866 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.866 INFO:tasks.workunit.client.0.smithi153.stdout:raw=.data-pool:marker__ns__myobj 2024-09-19T13:49:51.866 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.866 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj2": { 2024-09-19T13:49:51.866 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.866 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__ns__myobj", 2024-09-19T13:49:51.867 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.867 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.867 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.867 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.867 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj2": { 2024-09-19T13:49:51.867 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.867 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.867 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.867 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.867 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.867 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.867 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.867 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.867 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.868 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.868 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.868 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.868 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj", 2024-09-19T13:49:51.868 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.868 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.868 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.868 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.868 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.868 INFO:tasks.workunit.client.0.smithi153.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-19T13:49:51.868 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.868 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.868 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.868 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__:inst__myobj", 2024-09-19T13:49:51.869 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "marker__myobj" 2024-09-19T13:49:51.869 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.869 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.869 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.869 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.869 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.869 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.869 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.869 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.869 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.869 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.869 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.869 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.869 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.869 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.870 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.870 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.870 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj", 2024-09-19T13:49:51.870 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.870 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.870 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.870 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.870 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.870 INFO:tasks.workunit.client.0.smithi153.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-19T13:49:51.870 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.870 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj2": { 2024-09-19T13:49:51.870 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.870 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__:inst__myobj", 2024-09-19T13:49:51.870 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "marker__myobj" 2024-09-19T13:49:51.871 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.871 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.871 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.871 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj2": { 2024-09-19T13:49:51.871 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.871 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.871 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.871 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.871 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.871 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.871 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.871 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.871 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.871 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.871 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.872 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.872 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj", 2024-09-19T13:49:51.872 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.872 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.872 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.872 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.872 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.872 INFO:tasks.workunit.client.0.smithi153.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-19T13:49:51.872 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.872 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.872 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.872 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__ns:inst__myobj", 2024-09-19T13:49:51.872 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.872 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.873 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.873 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.873 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.873 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.873 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.873 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.873 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.873 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.873 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.873 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.873 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.873 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.873 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.873 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.873 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.874 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj", 2024-09-19T13:49:51.874 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.874 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.874 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.874 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.874 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.874 INFO:tasks.workunit.client.0.smithi153.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-19T13:49:51.874 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.874 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj2": { 2024-09-19T13:49:51.874 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.874 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__ns:inst__myobj", 2024-09-19T13:49:51.874 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.874 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.874 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.875 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.875 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj2": { 2024-09-19T13:49:51.875 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.875 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.875 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.875 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.875 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.875 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.875 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.875 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.875 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.875 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.875 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.875 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.875 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj", 2024-09-19T13:49:51.876 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.876 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.876 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.876 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.876 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.876 INFO:tasks.workunit.client.0.smithi153.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-19T13:49:51.876 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.876 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.876 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.876 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker___myobj_", 2024-09-19T13:49:51.876 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "marker__myobj_" 2024-09-19T13:49:51.876 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.876 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.876 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.877 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.877 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.877 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.877 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.877 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.877 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.877 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.877 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.877 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.877 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.877 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.877 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.877 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.878 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj_", 2024-09-19T13:49:51.878 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.878 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.878 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.878 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.878 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.878 INFO:tasks.workunit.client.0.smithi153.stdout:raw=.data-pool:marker___myobj_ 2024-09-19T13:49:51.878 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.878 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj2": { 2024-09-19T13:49:51.878 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.878 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker___myobj_", 2024-09-19T13:49:51.878 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "marker__myobj_" 2024-09-19T13:49:51.878 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.878 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.879 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.879 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj2": { 2024-09-19T13:49:51.879 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.879 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.879 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.879 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.879 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.879 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.879 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.879 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.879 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.879 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.879 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.879 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.880 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj_", 2024-09-19T13:49:51.880 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.880 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.880 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.880 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.880 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.880 INFO:tasks.workunit.client.0.smithi153.stdout:raw2=.data-pool:marker___myobj_ 2024-09-19T13:49:51.880 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.880 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.880 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.880 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__ns__myobj_", 2024-09-19T13:49:51.880 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.880 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.881 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.881 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.881 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.881 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.881 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.881 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.881 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.881 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.881 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.881 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.881 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.881 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.881 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.881 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.882 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.882 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj_", 2024-09-19T13:49:51.882 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.882 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.882 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.882 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.882 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.882 INFO:tasks.workunit.client.0.smithi153.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-19T13:49:51.882 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.882 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj2": { 2024-09-19T13:49:51.882 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.882 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__ns__myobj_", 2024-09-19T13:49:51.882 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.882 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.883 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.883 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.883 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj2": { 2024-09-19T13:49:51.883 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.883 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.883 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.883 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.883 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.883 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.883 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.883 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.883 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.883 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.883 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.884 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.884 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj_", 2024-09-19T13:49:51.884 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "", 2024-09-19T13:49:51.884 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.884 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.884 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.884 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.884 INFO:tasks.workunit.client.0.smithi153.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-19T13:49:51.884 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.884 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.884 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.884 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__:inst__myobj_", 2024-09-19T13:49:51.884 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "marker__myobj_" 2024-09-19T13:49:51.884 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.885 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.885 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.885 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.885 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.885 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.885 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.885 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.885 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.885 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.885 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.885 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.885 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.885 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.885 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.885 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.886 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj_", 2024-09-19T13:49:51.886 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.886 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.886 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.886 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.886 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.886 INFO:tasks.workunit.client.0.smithi153.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-19T13:49:51.886 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.886 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj2": { 2024-09-19T13:49:51.886 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.886 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__:inst__myobj_", 2024-09-19T13:49:51.886 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "marker__myobj_" 2024-09-19T13:49:51.886 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.886 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.887 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.887 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj2": { 2024-09-19T13:49:51.887 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.887 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.887 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.887 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.887 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.887 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.887 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.887 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.887 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.887 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.887 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.887 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.887 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj_", 2024-09-19T13:49:51.888 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.888 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "" 2024-09-19T13:49:51.888 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.888 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.888 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.888 INFO:tasks.workunit.client.0.smithi153.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-19T13:49:51.888 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.888 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj": { 2024-09-19T13:49:51.888 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.888 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-19T13:49:51.888 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.888 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.888 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.888 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.888 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj": { 2024-09-19T13:49:51.889 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.889 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.889 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.889 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.889 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.889 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.889 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.889 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.889 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.889 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.889 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.889 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.889 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj_", 2024-09-19T13:49:51.889 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.890 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.890 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.890 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.890 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.890 INFO:tasks.workunit.client.0.smithi153.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-19T13:49:51.890 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.890 INFO:tasks.workunit.client.0.smithi153.stdout: "raw_obj2": { 2024-09-19T13:49:51.890 INFO:tasks.workunit.client.0.smithi153.stdout: "pool": ".data-pool", 2024-09-19T13:49:51.890 INFO:tasks.workunit.client.0.smithi153.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-19T13:49:51.890 INFO:tasks.workunit.client.0.smithi153.stdout: "loc": "" 2024-09-19T13:49:51.890 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.890 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.890 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:51.890 INFO:tasks.workunit.client.0.smithi153.stdout: "new_obj2": { 2024-09-19T13:49:51.890 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket": { 2024-09-19T13:49:51.891 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "ebtest", 2024-09-19T13:49:51.891 INFO:tasks.workunit.client.0.smithi153.stdout: "marker": "marker", 2024-09-19T13:49:51.891 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_id": "bucket-id", 2024-09-19T13:49:51.891 INFO:tasks.workunit.client.0.smithi153.stdout: "tenant": "", 2024-09-19T13:49:51.891 INFO:tasks.workunit.client.0.smithi153.stdout: "explicit_placement": { 2024-09-19T13:49:51.891 INFO:tasks.workunit.client.0.smithi153.stdout: "data_pool": ".data-pool", 2024-09-19T13:49:51.891 INFO:tasks.workunit.client.0.smithi153.stdout: "data_extra_pool": "", 2024-09-19T13:49:51.891 INFO:tasks.workunit.client.0.smithi153.stdout: "index_pool": ".index-pool" 2024-09-19T13:49:51.891 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.891 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:51.891 INFO:tasks.workunit.client.0.smithi153.stdout: "key": { 2024-09-19T13:49:51.891 INFO:tasks.workunit.client.0.smithi153.stdout: "name": "_myobj_", 2024-09-19T13:49:51.891 INFO:tasks.workunit.client.0.smithi153.stdout: "instance": "inst", 2024-09-19T13:49:51.891 INFO:tasks.workunit.client.0.smithi153.stdout: "ns": "ns" 2024-09-19T13:49:51.891 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.891 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:51.892 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:51.892 INFO:tasks.workunit.client.0.smithi153.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-19T13:49:51.892 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-19T13:49:51.892 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-19T13:49:51.892 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:49:51.892 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment tear-down 2024-09-19T13:49:51.892 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-19T13:49:51.892 INFO:tasks.workunit.client.0.smithi153.stdout:[ PASSED ] 4 tests. 2024-09-19T13:49:51.892 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:49:51.892 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:49:51.907 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-19T13:49:51.908 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-19T13:49:51.909 DEBUG:teuthology.orchestra.run.smithi153:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-19T13:49:52.011 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:49:52.011 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:49:52.065 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.063+0000 7fdc7341a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:49:52.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.067+0000 7fdc7341a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:49:52.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.067+0000 7fdc7341a9c0 20 realm 2024-09-19T13:49:52.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.067+0000 7fdc7341a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:49:52.067 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.067+0000 7fdc7341a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:49:52.067 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.067+0000 7fdc7341a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:49:52.067 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.067+0000 7fdc7341a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:49:52.067 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.067+0000 7fdc7341a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:49:52.067 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.067+0000 7fdc7341a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:49:52.068 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.067+0000 7fdc7341a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:49:52.068 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.067+0000 7fdc7341a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:49:52.069 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.067+0000 7fdc7341a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:49:52.069 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.067+0000 7fdc7341a9c0 20 searching for the correct realm 2024-09-19T13:49:52.078 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.079+0000 7fdc7071f640 0 -- 172.21.15.153:0/1994510991 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55960c9a5240 msgr2=0x55960c9a76d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:49:52.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.087+0000 7fdc7071f640 0 -- 172.21.15.153:0/1994510991 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fdc60008050 msgr2=0x7fdc6006f270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:49:52.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.095+0000 7fdc7341a9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:49:52.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.095+0000 7fdc7341a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:49:52.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.095+0000 7fdc7341a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:49:52.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.095+0000 7fdc7341a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:49:52.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.095+0000 7fdc7341a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:49:52.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.095+0000 7fdc7341a9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:49:52.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.095+0000 7fdc7341a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:49:52.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.095+0000 7fdc7341a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:49:52.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.095+0000 7fdc7341a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:49:52.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.095+0000 7fdc7341a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:49:52.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.095+0000 7fdc7341a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:49:52.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.095+0000 7fdc7341a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:49:52.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.095+0000 7fdc7341a9c0 20 zone default found 2024-09-19T13:49:52.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.095+0000 7fdc7341a9c0 4 Realm: () 2024-09-19T13:49:52.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.095+0000 7fdc7341a9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:49:52.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.095+0000 7fdc7341a9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:49:52.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.095+0000 7fdc7341a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:49:52.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.095+0000 7fdc7341a9c0 20 zonegroup default 2024-09-19T13:49:52.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.095+0000 7fdc7341a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:49:52.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.099+0000 7fdc7341a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:49:52.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.099+0000 7fdc7341a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:49:52.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.099+0000 7fdc7341a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:49:52.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.099+0000 7fdc7341a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:49:52.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.099+0000 7fdc7341a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:49:52.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.099+0000 7fdc7341a9c0 20 started sync module instance, tier type = 2024-09-19T13:49:52.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.099+0000 7fdc7341a9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:49:52.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.115+0000 7fdc7341a9c0 20 add_watcher() i=0 2024-09-19T13:49:52.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.115+0000 7fdc7341a9c0 20 add_watcher() i=1 2024-09-19T13:49:52.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.115+0000 7fdc7341a9c0 20 add_watcher() i=2 2024-09-19T13:49:52.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.115+0000 7fdc7341a9c0 20 add_watcher() i=3 2024-09-19T13:49:52.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.115+0000 7fdc7341a9c0 20 add_watcher() i=4 2024-09-19T13:49:52.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.115+0000 7fdc7341a9c0 20 add_watcher() i=5 2024-09-19T13:49:52.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.115+0000 7fdc7341a9c0 20 add_watcher() i=6 2024-09-19T13:49:52.116 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.115+0000 7fdc7341a9c0 20 add_watcher() i=7 2024-09-19T13:49:52.116 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.115+0000 7fdc7341a9c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:49:52.119 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdb277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:49:52.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdc7341a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:49:52.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdc7341a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:49:52.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdc7341a9c0 5 note: GC not initialized 2024-09-19T13:49:52.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdb267e4640 20 reqs_thread_entry: start 2024-09-19T13:49:52.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdc7341a9c0 20 init_complete bucket index max shards: 11 2024-09-19T13:49:52.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdc7341a9c0 20 Filter name: none 2024-09-19T13:49:52.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdb1f7fe640 20 reqs_thread_entry: start 2024-09-19T13:49:52.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdc7341a9c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-19T13:49:52.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdc7341a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:49:52.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdc7341a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:49:52.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdc7341a9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-19T13:49:52.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdc7341a9c0 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-19T13:49:52.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdc7341a9c0 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-19T13:49:52.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdc7341a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:49:52.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdc7341a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:49:52.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdc7341a9c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-19T13:49:52.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdc7341a9c0 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-19T13:49:52.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdc7341a9c0 10 cache get: name=default.rgw.meta+users.keys+UkTaSa7vQ1PGkN2eLBwrH6Op+9E= : miss 2024-09-19T13:49:52.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdc7341a9c0 20 rados->read ofs=0 len=0 2024-09-19T13:49:52.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdc7341a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:49:52.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdc7341a9c0 10 cache put: name=default.rgw.meta+users.keys+UkTaSa7vQ1PGkN2eLBwrH6Op+9E= info.flags=0x0 2024-09-19T13:49:52.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdc7341a9c0 10 adding default.rgw.meta+users.keys+UkTaSa7vQ1PGkN2eLBwrH6Op+9E= to cache LRU end 2024-09-19T13:49:52.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdc7341a9c0 10 cache get: name=default.rgw.meta+users.keys+UkTaSa7vQ1PGkN2eLBwrH6Op+9E= : hit (negative entry) 2024-09-19T13:49:52.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.119+0000 7fdc7341a9c0 10 cache get: name=default.rgw.meta+users.keys+UkTaSa7vQ1PGkN2eLBwrH6Op+9E= : hit (negative entry) 2024-09-19T13:49:52.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.123+0000 7fdc7341a9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-19T13:49:52.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.123+0000 7fdc7341a9c0 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-19T13:49:52.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.123+0000 7fdc7341a9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-19T13:49:52.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.123+0000 7fdb47fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693185 cookie 94102944945792 notifier 5228 bl.length()=697 2024-09-19T13:49:52.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.123+0000 7fdb47fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-19T13:49:52.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.123+0000 7fdb47fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-19T13:49:52.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.127+0000 7fdc7341a9c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-19T13:49:52.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.131+0000 7fdc7341a9c0 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-19T13:49:52.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.131+0000 7fdc7341a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-19T13:49:52.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.131+0000 7fdb477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693184 cookie 94102944950048 notifier 5228 bl.length()=194 2024-09-19T13:49:52.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.131+0000 7fdb477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-19T13:49:52.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.131+0000 7fdb477fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-19T13:49:52.137 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.139+0000 7fdc7341a9c0 10 cache put: name=default.rgw.meta+users.keys+UkTaSa7vQ1PGkN2eLBwrH6Op+9E= info.flags=0x7 2024-09-19T13:49:52.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.139+0000 7fdc7341a9c0 10 moving default.rgw.meta+users.keys+UkTaSa7vQ1PGkN2eLBwrH6Op+9E= to cache LRU end 2024-09-19T13:49:52.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.139+0000 7fdc7341a9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:UkTaSa7vQ1PGkN2eLBwrH6Op+9E=, ofs0, ns] 2024-09-19T13:49:52.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.139+0000 7fdb477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693186 cookie 94102944945792 notifier 5228 bl.length()=203 2024-09-19T13:49:52.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.139+0000 7fdb477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+UkTaSa7vQ1PGkN2eLBwrH6Op+9E= info.flags=0x7 2024-09-19T13:49:52.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.139+0000 7fdb477fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+UkTaSa7vQ1PGkN2eLBwrH6Op+9E= to cache LRU end 2024-09-19T13:49:52.140 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:49:52.140 INFO:tasks.workunit.client.0.smithi153.stdout: "user_id": "ceph-test-librgw-file", 2024-09-19T13:49:52.140 INFO:tasks.workunit.client.0.smithi153.stdout: "display_name": "librgw test user", 2024-09-19T13:49:52.140 INFO:tasks.workunit.client.0.smithi153.stdout: "email": "librgw@example.com", 2024-09-19T13:49:52.140 INFO:tasks.workunit.client.0.smithi153.stdout: "suspended": 0, 2024-09-19T13:49:52.140 INFO:tasks.workunit.client.0.smithi153.stdout: "max_buckets": 1000, 2024-09-19T13:49:52.140 INFO:tasks.workunit.client.0.smithi153.stdout: "subusers": [], 2024-09-19T13:49:52.141 INFO:tasks.workunit.client.0.smithi153.stdout: "keys": [ 2024-09-19T13:49:52.141 INFO:tasks.workunit.client.0.smithi153.stdout: { 2024-09-19T13:49:52.141 INFO:tasks.workunit.client.0.smithi153.stdout: "user": "ceph-test-librgw-file", 2024-09-19T13:49:52.141 INFO:tasks.workunit.client.0.smithi153.stdout: "access_key": "UkTaSa7vQ1PGkN2eLBwrH6Op+9E=", 2024-09-19T13:49:52.141 INFO:tasks.workunit.client.0.smithi153.stdout: "secret_key": "cD73r3GCfycAa9n+uQYMt48CZzKgWG3S5yXzY1ljYWGrzEeRaYMxvw==", 2024-09-19T13:49:52.141 INFO:tasks.workunit.client.0.smithi153.stdout: "active": true, 2024-09-19T13:49:52.141 INFO:tasks.workunit.client.0.smithi153.stdout: "create_date": "2024-09-19T13:49:52.123694Z" 2024-09-19T13:49:52.141 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:49:52.141 INFO:tasks.workunit.client.0.smithi153.stdout: ], 2024-09-19T13:49:52.141 INFO:tasks.workunit.client.0.smithi153.stdout: "swift_keys": [], 2024-09-19T13:49:52.141 INFO:tasks.workunit.client.0.smithi153.stdout: "caps": [], 2024-09-19T13:49:52.141 INFO:tasks.workunit.client.0.smithi153.stdout: "op_mask": "read, write, delete", 2024-09-19T13:49:52.141 INFO:tasks.workunit.client.0.smithi153.stdout: "default_placement": "", 2024-09-19T13:49:52.141 INFO:tasks.workunit.client.0.smithi153.stdout: "default_storage_class": "", 2024-09-19T13:49:52.142 INFO:tasks.workunit.client.0.smithi153.stdout: "placement_tags": [], 2024-09-19T13:49:52.142 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_quota": { 2024-09-19T13:49:52.142 INFO:tasks.workunit.client.0.smithi153.stdout: "enabled": false, 2024-09-19T13:49:52.142 INFO:tasks.workunit.client.0.smithi153.stdout: "check_on_raw": false, 2024-09-19T13:49:52.142 INFO:tasks.workunit.client.0.smithi153.stdout: "max_size": -1, 2024-09-19T13:49:52.142 INFO:tasks.workunit.client.0.smithi153.stdout: "max_size_kb": 0, 2024-09-19T13:49:52.142 INFO:tasks.workunit.client.0.smithi153.stdout: "max_objects": -1 2024-09-19T13:49:52.142 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:52.142 INFO:tasks.workunit.client.0.smithi153.stdout: "user_quota": { 2024-09-19T13:49:52.142 INFO:tasks.workunit.client.0.smithi153.stdout: "enabled": false, 2024-09-19T13:49:52.142 INFO:tasks.workunit.client.0.smithi153.stdout: "check_on_raw": false, 2024-09-19T13:49:52.142 INFO:tasks.workunit.client.0.smithi153.stdout: "max_size": -1, 2024-09-19T13:49:52.142 INFO:tasks.workunit.client.0.smithi153.stdout: "max_size_kb": 0, 2024-09-19T13:49:52.142 INFO:tasks.workunit.client.0.smithi153.stdout: "max_objects": -1 2024-09-19T13:49:52.143 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:49:52.143 INFO:tasks.workunit.client.0.smithi153.stdout: "temp_url_keys": [], 2024-09-19T13:49:52.143 INFO:tasks.workunit.client.0.smithi153.stdout: "type": "rgw", 2024-09-19T13:49:52.143 INFO:tasks.workunit.client.0.smithi153.stdout: "mfa_ids": [], 2024-09-19T13:49:52.143 INFO:tasks.workunit.client.0.smithi153.stdout: "account_id": "", 2024-09-19T13:49:52.143 INFO:tasks.workunit.client.0.smithi153.stdout: "path": "/", 2024-09-19T13:49:52.143 INFO:tasks.workunit.client.0.smithi153.stdout: "create_date": "2024-09-19T13:49:52.123680Z", 2024-09-19T13:49:52.143 INFO:tasks.workunit.client.0.smithi153.stdout: "tags": [], 2024-09-19T13:49:52.143 INFO:tasks.workunit.client.0.smithi153.stdout: "group_ids": [] 2024-09-19T13:49:52.143 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:49:52.143 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:49:52.143 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.139+0000 7fdb277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:49:52.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.147+0000 7fdc7341a9c0 20 remove_watcher() i=0 2024-09-19T13:49:52.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.147+0000 7fdc7341a9c0 2 removed watcher, disabling cache 2024-09-19T13:49:52.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.147+0000 7fdc7341a9c0 20 remove_watcher() i=1 2024-09-19T13:49:52.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.151+0000 7fdc7341a9c0 20 remove_watcher() i=2 2024-09-19T13:49:52.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.151+0000 7fdc7341a9c0 20 remove_watcher() i=3 2024-09-19T13:49:52.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.155+0000 7fdc7341a9c0 20 remove_watcher() i=4 2024-09-19T13:49:52.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.155+0000 7fdc7341a9c0 20 remove_watcher() i=5 2024-09-19T13:49:52.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.155+0000 7fdc7341a9c0 20 remove_watcher() i=6 2024-09-19T13:49:52.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:52.159+0000 7fdc7341a9c0 20 remove_watcher() i=7 2024-09-19T13:49:52.170 INFO:tasks.workunit.client.0.smithi153.stdout:phase 1.1 2024-09-19T13:49:52.190 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-19T13:49:52.191 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment set-up. 2024-09-19T13:49:52.191 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 24 tests from LibRGW 2024-09-19T13:49:52.191 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.INIT 2024-09-19T13:49:52.203 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:49:52.203 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:49:52.960 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.INIT (769 ms) 2024-09-19T13:49:52.960 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-19T13:49:52.962 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MOUNT_NOROOT (3 ms) 2024-09-19T13:49:52.962 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T13:49:52.962 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-19T13:49:52.962 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-19T13:49:52.981 INFO:tasks.workunit.client.0.smithi153.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-19T13:49:52.989 INFO:tasks.workunit.client.0.smithi153.stdout:creating: nfsroot:foo/f1 2024-09-19T13:49:52.995 INFO:tasks.workunit.client.0.smithi153.stdout:creating: nfsroot:foo/f2 2024-09-19T13:49:53.000 INFO:tasks.workunit.client.0.smithi153.stdout:creating: nfsroot:foo/bar/f1 2024-09-19T13:49:53.005 INFO:tasks.workunit.client.0.smithi153.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-19T13:49:53.010 INFO:tasks.workunit.client.0.smithi153.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-19T13:49:53.016 INFO:tasks.workunit.client.0.smithi153.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-19T13:49:53.022 INFO:tasks.workunit.client.0.smithi153.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-19T13:49:53.027 INFO:tasks.workunit.client.0.smithi153.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-19T13:49:53.033 INFO:tasks.workunit.client.0.smithi153.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-19T13:49:53.039 INFO:tasks.workunit.client.0.smithi153.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-19T13:49:53.045 INFO:tasks.workunit.client.0.smithi153.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-19T13:49:53.052 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.SETUP_HIER1 (90 ms) 2024-09-19T13:49:53.053 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-19T13:49:53.293 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.SETUP_DIRS1 (240 ms) 2024-09-19T13:49:53.293 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.SETATTR 2024-09-19T13:49:53.293 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-19T13:49:53.293 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-19T13:49:53.334 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (42 ms) 2024-09-19T13:49:53.334 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-19T13:49:53.443 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (109 ms) 2024-09-19T13:49:53.444 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-19T13:49:53.444 INFO:tasks.workunit.client.0.smithi153.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-19T13:49:53.458 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (15 ms) 2024-09-19T13:49:53.458 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-19T13:49:53.458 INFO:tasks.workunit.client.0.smithi153.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-19T13:49:53.475 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (16 ms) 2024-09-19T13:49:53.475 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-19T13:49:53.475 INFO:tasks.workunit.client.0.smithi153.stdout:scanning objects in /bdirs1/dir_0 2024-09-19T13:49:53.475 INFO:tasks.workunit.client.0.smithi153.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-19T13:49:53.475 INFO:tasks.workunit.client.0.smithi153.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-19T13:49:53.475 INFO:tasks.workunit.client.0.smithi153.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-19T13:49:53.475 INFO:tasks.workunit.client.0.smithi153.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-19T13:49:53.475 INFO:tasks.workunit.client.0.smithi153.stdout:scanning objects in /bdirs1/dir_1 2024-09-19T13:49:53.475 INFO:tasks.workunit.client.0.smithi153.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-19T13:49:53.476 INFO:tasks.workunit.client.0.smithi153.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-19T13:49:53.476 INFO:tasks.workunit.client.0.smithi153.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-19T13:49:53.476 INFO:tasks.workunit.client.0.smithi153.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-19T13:49:53.476 INFO:tasks.workunit.client.0.smithi153.stdout:scanning objects in /bdirs1/dir_2 2024-09-19T13:49:53.476 INFO:tasks.workunit.client.0.smithi153.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-19T13:49:53.476 INFO:tasks.workunit.client.0.smithi153.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-19T13:49:53.476 INFO:tasks.workunit.client.0.smithi153.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-19T13:49:53.476 INFO:tasks.workunit.client.0.smithi153.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-19T13:49:53.476 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-19T13:49:53.476 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-19T13:49:53.476 INFO:tasks.workunit.client.0.smithi153.stdout:read back objects in /bdirs1/dir_0 2024-09-19T13:49:53.476 INFO:tasks.workunit.client.0.smithi153.stdout:reading 0,256 dir_0/sfile_0 2024-09-19T13:49:53.478 INFO:tasks.workunit.client.0.smithi153.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-19T13:49:53.478 INFO:tasks.workunit.client.0.smithi153.stdout:reading 0,256 dir_0/sfile_1 2024-09-19T13:49:53.480 INFO:tasks.workunit.client.0.smithi153.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-19T13:49:53.481 INFO:tasks.workunit.client.0.smithi153.stdout:read back objects in /bdirs1/dir_1 2024-09-19T13:49:53.481 INFO:tasks.workunit.client.0.smithi153.stdout:reading 0,256 dir_1/sfile_0 2024-09-19T13:49:53.483 INFO:tasks.workunit.client.0.smithi153.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-19T13:49:53.483 INFO:tasks.workunit.client.0.smithi153.stdout:reading 0,256 dir_1/sfile_1 2024-09-19T13:49:53.485 INFO:tasks.workunit.client.0.smithi153.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-19T13:49:53.485 INFO:tasks.workunit.client.0.smithi153.stdout:read back objects in /bdirs1/dir_2 2024-09-19T13:49:53.485 INFO:tasks.workunit.client.0.smithi153.stdout:reading 0,256 dir_2/sfile_0 2024-09-19T13:49:53.489 INFO:tasks.workunit.client.0.smithi153.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-19T13:49:53.489 INFO:tasks.workunit.client.0.smithi153.stdout:reading 0,256 dir_2/sfile_1 2024-09-19T13:49:53.492 INFO:tasks.workunit.client.0.smithi153.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-19T13:49:53.492 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.READ_DIRS1 (17 ms) 2024-09-19T13:49:53.492 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-19T13:49:53.703 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.READF_SETUP1 (212 ms) 2024-09-19T13:49:53.704 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-19T13:49:53.704 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-19T13:49:53.704 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-19T13:49:53.704 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-19T13:49:53.704 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-19T13:49:53.704 INFO:tasks.workunit.client.0.smithi153.stdout:release sdir_0 type: DIR refs: 2 2024-09-19T13:49:53.704 INFO:tasks.workunit.client.0.smithi153.stdout:release sfile_0 type: FILE refs: 2 2024-09-19T13:49:53.704 INFO:tasks.workunit.client.0.smithi153.stdout:release sdir_1 type: DIR refs: 2 2024-09-19T13:49:53.704 INFO:tasks.workunit.client.0.smithi153.stdout:release sfile_1 type: FILE refs: 2 2024-09-19T13:49:53.704 INFO:tasks.workunit.client.0.smithi153.stdout:release sdir_0 type: DIR refs: 2 2024-09-19T13:49:53.704 INFO:tasks.workunit.client.0.smithi153.stdout:release sfile_0 type: FILE refs: 2 2024-09-19T13:49:53.704 INFO:tasks.workunit.client.0.smithi153.stdout:release sdir_1 type: DIR refs: 2 2024-09-19T13:49:53.704 INFO:tasks.workunit.client.0.smithi153.stdout:release sfile_1 type: FILE refs: 2 2024-09-19T13:49:53.705 INFO:tasks.workunit.client.0.smithi153.stdout:release sdir_0 type: DIR refs: 2 2024-09-19T13:49:53.705 INFO:tasks.workunit.client.0.smithi153.stdout:release sfile_0 type: FILE refs: 2 2024-09-19T13:49:53.705 INFO:tasks.workunit.client.0.smithi153.stdout:release sdir_1 type: DIR refs: 2 2024-09-19T13:49:53.705 INFO:tasks.workunit.client.0.smithi153.stdout:release sfile_1 type: FILE refs: 2 2024-09-19T13:49:53.705 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-19T13:49:53.705 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.HIER1 2024-09-19T13:49:53.721 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-19T13:49:53.721 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-19T13:49:53.728 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-19T13:49:53.731 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-19T13:49:53.738 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-19T13:49:53.739 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-19T13:49:53.740 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-19T13:49:53.741 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-19T13:49:53.742 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-19T13:49:53.743 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-19T13:49:53.744 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-19T13:49:53.748 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-19T13:49:53.748 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-19T13:49:53.748 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-19T13:49:53.748 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo (foo): DIR 2024-09-19T13:49:53.749 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot (nfsroot): DIR 2024-09-19T13:49:53.749 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.HIER1 (45 ms) 2024-09-19T13:49:53.749 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-19T13:49:53.749 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-19T13:49:53.749 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-19T13:49:53.749 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-19T13:49:53.749 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-19T13:49:53.749 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-19T13:49:53.749 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-19T13:49:53.749 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-19T13:49:53.749 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T13:49:53.749 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T13:49:53.749 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T13:49:53.749 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T13:49:53.750 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T13:49:53.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:53.747+0000 7f5b55a76a80 -1 shutting down 2024-09-19T13:49:53.751 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:49:53.751+0000 7f5a2f7c8640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 56744, si_uid : 1000, si_addr0x3e80000dda8, si_status0 2024-09-19T13:50:22.986 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.SHUTDOWN (29237 ms) 2024-09-19T13:50:22.986 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 24 tests from LibRGW (30795 ms total) 2024-09-19T13:50:22.986 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:50:22.986 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment tear-down 2024-09-19T13:50:22.986 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] 24 tests from 1 test suite ran. (30795 ms total) 2024-09-19T13:50:22.986 INFO:tasks.workunit.client.0.smithi153.stdout:[ PASSED ] 24 tests. 2024-09-19T13:50:23.001 INFO:tasks.workunit.client.0.smithi153.stdout:phase 1.2 2024-09-19T13:50:23.025 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-19T13:50:23.025 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment set-up. 2024-09-19T13:50:23.025 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 24 tests from LibRGW 2024-09-19T13:50:23.025 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.INIT 2024-09-19T13:50:23.035 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:50:23.035 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:50:23.583 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.INIT (558 ms) 2024-09-19T13:50:23.583 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-19T13:50:23.586 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MOUNT_NOROOT (3 ms) 2024-09-19T13:50:23.586 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T13:50:23.586 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-19T13:50:23.587 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-19T13:50:23.587 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-19T13:50:23.587 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-19T13:50:23.587 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-19T13:50:23.587 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.SETATTR 2024-09-19T13:50:23.587 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-19T13:50:23.587 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-19T13:50:23.587 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-19T13:50:23.587 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-19T13:50:23.587 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-19T13:50:23.587 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-19T13:50:23.587 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-19T13:50:23.588 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-19T13:50:23.588 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-19T13:50:23.588 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-19T13:50:23.588 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-19T13:50:23.588 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-19T13:50:23.588 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-19T13:50:23.588 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-19T13:50:23.588 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-19T13:50:23.588 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-19T13:50:23.588 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-19T13:50:23.588 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-19T13:50:23.588 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-19T13:50:23.589 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-19T13:50:23.589 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-19T13:50:23.589 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.HIER1 2024-09-19T13:50:23.589 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-19T13:50:23.589 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-19T13:50:23.589 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-19T13:50:23.589 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-19T13:50:23.589 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-19T13:50:23.589 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-19T13:50:23.589 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-19T13:50:23.589 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-19T13:50:23.589 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-19T13:50:23.589 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T13:50:23.590 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T13:50:23.590 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T13:50:23.590 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T13:50:23.590 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T13:50:23.590 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:50:23.586+0000 7f90f009da80 -1 shutting down 2024-09-19T13:50:23.590 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:50:23.586+0000 7f8fc9def640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57391, si_uid : 1000, si_addr0x3e80000e02f, si_status0 2024-09-19T13:50:53.889 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.SHUTDOWN (30303 ms) 2024-09-19T13:50:53.889 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 24 tests from LibRGW (30864 ms total) 2024-09-19T13:50:53.890 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:50:53.890 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment tear-down 2024-09-19T13:50:53.890 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] 24 tests from 1 test suite ran. (30864 ms total) 2024-09-19T13:50:53.890 INFO:tasks.workunit.client.0.smithi153.stdout:[ PASSED ] 24 tests. 2024-09-19T13:50:53.898 INFO:tasks.workunit.client.0.smithi153.stdout:phase 1.3 2024-09-19T13:50:53.921 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-19T13:50:53.922 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment set-up. 2024-09-19T13:50:53.922 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 24 tests from LibRGW 2024-09-19T13:50:53.922 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.INIT 2024-09-19T13:50:53.933 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:50:53.934 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:50:54.292 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.INIT (371 ms) 2024-09-19T13:50:54.292 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-19T13:50:54.293 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-19T13:50:54.294 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T13:50:54.294 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-19T13:50:54.294 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-19T13:50:54.302 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.SETUP_HIER1 (8 ms) 2024-09-19T13:50:54.302 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-19T13:50:54.430 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.SETUP_DIRS1 (128 ms) 2024-09-19T13:50:54.431 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.SETATTR 2024-09-19T13:50:54.431 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-19T13:50:54.431 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-19T13:50:54.431 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-19T13:50:54.431 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-19T13:50:54.431 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-19T13:50:54.431 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-19T13:50:54.431 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-19T13:50:54.431 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-19T13:50:54.431 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-19T13:50:54.431 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-19T13:50:54.431 INFO:tasks.workunit.client.0.smithi153.stdout:scanning objects in /bdirs1/dir_0 2024-09-19T13:50:54.431 INFO:tasks.workunit.client.0.smithi153.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-19T13:50:54.432 INFO:tasks.workunit.client.0.smithi153.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-19T13:50:54.432 INFO:tasks.workunit.client.0.smithi153.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-19T13:50:54.432 INFO:tasks.workunit.client.0.smithi153.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-19T13:50:54.432 INFO:tasks.workunit.client.0.smithi153.stdout:scanning objects in /bdirs1/dir_1 2024-09-19T13:50:54.432 INFO:tasks.workunit.client.0.smithi153.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-19T13:50:54.432 INFO:tasks.workunit.client.0.smithi153.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-19T13:50:54.432 INFO:tasks.workunit.client.0.smithi153.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-19T13:50:54.432 INFO:tasks.workunit.client.0.smithi153.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-19T13:50:54.432 INFO:tasks.workunit.client.0.smithi153.stdout:scanning objects in /bdirs1/dir_2 2024-09-19T13:50:54.432 INFO:tasks.workunit.client.0.smithi153.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-19T13:50:54.432 INFO:tasks.workunit.client.0.smithi153.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-19T13:50:54.432 INFO:tasks.workunit.client.0.smithi153.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-19T13:50:54.432 INFO:tasks.workunit.client.0.smithi153.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-19T13:50:54.432 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-19T13:50:54.433 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-19T13:50:54.433 INFO:tasks.workunit.client.0.smithi153.stdout:read back objects in /bdirs1/dir_0 2024-09-19T13:50:54.433 INFO:tasks.workunit.client.0.smithi153.stdout:reading 0,256 dir_0/sfile_0 2024-09-19T13:50:54.433 INFO:tasks.workunit.client.0.smithi153.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-19T13:50:54.433 INFO:tasks.workunit.client.0.smithi153.stdout:reading 0,256 dir_0/sfile_1 2024-09-19T13:50:54.435 INFO:tasks.workunit.client.0.smithi153.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-19T13:50:54.435 INFO:tasks.workunit.client.0.smithi153.stdout:read back objects in /bdirs1/dir_1 2024-09-19T13:50:54.435 INFO:tasks.workunit.client.0.smithi153.stdout:reading 0,256 dir_1/sfile_0 2024-09-19T13:50:54.437 INFO:tasks.workunit.client.0.smithi153.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-19T13:50:54.438 INFO:tasks.workunit.client.0.smithi153.stdout:reading 0,256 dir_1/sfile_1 2024-09-19T13:50:54.441 INFO:tasks.workunit.client.0.smithi153.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-19T13:50:54.441 INFO:tasks.workunit.client.0.smithi153.stdout:read back objects in /bdirs1/dir_2 2024-09-19T13:50:54.441 INFO:tasks.workunit.client.0.smithi153.stdout:reading 0,256 dir_2/sfile_0 2024-09-19T13:50:54.444 INFO:tasks.workunit.client.0.smithi153.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-19T13:50:54.445 INFO:tasks.workunit.client.0.smithi153.stdout:reading 0,256 dir_2/sfile_1 2024-09-19T13:50:54.447 INFO:tasks.workunit.client.0.smithi153.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-19T13:50:54.447 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.READ_DIRS1 (17 ms) 2024-09-19T13:50:54.447 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-19T13:50:54.447 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-19T13:50:54.447 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-19T13:50:54.447 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-19T13:50:54.447 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-19T13:50:54.447 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-19T13:50:54.448 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-19T13:50:54.448 INFO:tasks.workunit.client.0.smithi153.stdout:release sdir_0 type: DIR refs: 2 2024-09-19T13:50:54.448 INFO:tasks.workunit.client.0.smithi153.stdout:release sfile_0 type: FILE refs: 2 2024-09-19T13:50:54.448 INFO:tasks.workunit.client.0.smithi153.stdout:release sdir_1 type: DIR refs: 2 2024-09-19T13:50:54.448 INFO:tasks.workunit.client.0.smithi153.stdout:release sfile_1 type: FILE refs: 2 2024-09-19T13:50:54.448 INFO:tasks.workunit.client.0.smithi153.stdout:release sdir_0 type: DIR refs: 2 2024-09-19T13:50:54.448 INFO:tasks.workunit.client.0.smithi153.stdout:release sfile_0 type: FILE refs: 2 2024-09-19T13:50:54.448 INFO:tasks.workunit.client.0.smithi153.stdout:release sdir_1 type: DIR refs: 2 2024-09-19T13:50:54.448 INFO:tasks.workunit.client.0.smithi153.stdout:release sfile_1 type: FILE refs: 2 2024-09-19T13:50:54.448 INFO:tasks.workunit.client.0.smithi153.stdout:release sdir_0 type: DIR refs: 2 2024-09-19T13:50:54.448 INFO:tasks.workunit.client.0.smithi153.stdout:release sfile_0 type: FILE refs: 2 2024-09-19T13:50:54.448 INFO:tasks.workunit.client.0.smithi153.stdout:release sdir_1 type: DIR refs: 2 2024-09-19T13:50:54.448 INFO:tasks.workunit.client.0.smithi153.stdout:release sfile_1 type: FILE refs: 2 2024-09-19T13:50:54.449 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-19T13:50:54.449 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.HIER1 2024-09-19T13:50:54.465 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-19T13:50:54.466 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-19T13:50:54.474 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-19T13:50:54.479 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-19T13:50:54.486 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-19T13:50:54.488 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-19T13:50:54.489 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-19T13:50:54.490 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-19T13:50:54.491 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-19T13:50:54.493 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-19T13:50:54.494 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-19T13:50:54.499 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-19T13:50:54.500 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-19T13:50:54.500 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-19T13:50:54.500 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot/foo (foo): DIR 2024-09-19T13:50:54.500 INFO:tasks.workunit.client.0.smithi153.stdout:/nfsroot (nfsroot): DIR 2024-09-19T13:50:54.500 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.HIER1 (52 ms) 2024-09-19T13:50:54.500 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-19T13:50:54.500 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-19T13:50:54.500 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-19T13:50:54.500 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-19T13:50:54.500 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-19T13:50:54.500 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-19T13:50:54.500 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-19T13:50:54.500 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-19T13:50:54.501 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T13:50:54.501 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T13:50:54.501 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T13:50:54.501 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T13:50:54.501 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T13:50:54.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:50:54.498+0000 7efff69c4a80 -1 shutting down 2024-09-19T13:50:54.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:50:54.502+0000 7efed0716640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58036, si_uid : 1000, si_addr0x3e80000e2b4, si_status0 2024-09-19T13:51:24.605 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.SHUTDOWN (30106 ms) 2024-09-19T13:51:24.605 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 24 tests from LibRGW (30684 ms total) 2024-09-19T13:51:24.606 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:51:24.606 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment tear-down 2024-09-19T13:51:24.606 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] 24 tests from 1 test suite ran. (30684 ms total) 2024-09-19T13:51:24.606 INFO:tasks.workunit.client.0.smithi153.stdout:[ PASSED ] 24 tests. 2024-09-19T13:51:24.620 INFO:tasks.workunit.client.0.smithi153.stdout:phase 2.1 2024-09-19T13:51:24.642 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-19T13:51:24.642 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment set-up. 2024-09-19T13:51:24.642 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 9 tests from LibRGW 2024-09-19T13:51:24.643 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.INIT 2024-09-19T13:51:24.654 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:51:24.654 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:51:25.618 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.INIT (975 ms) 2024-09-19T13:51:25.618 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T13:51:25.620 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MOUNT (3 ms) 2024-09-19T13:51:25.620 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-19T13:51:25.638 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.CREATE_BUCKET (17 ms) 2024-09-19T13:51:25.638 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-19T13:51:25.638 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-19T13:51:25.638 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-19T13:51:25.655 INFO:tasks.workunit.client.0.smithi153.stdout:created: sorrydave0 2024-09-19T13:51:25.677 INFO:tasks.workunit.client.0.smithi153.stdout:created: sorrydave1 2024-09-19T13:51:25.698 INFO:tasks.workunit.client.0.smithi153.stdout:created: sorrydave2 2024-09-19T13:51:25.720 INFO:tasks.workunit.client.0.smithi153.stdout:created: sorrydave3 2024-09-19T13:51:25.744 INFO:tasks.workunit.client.0.smithi153.stdout:created: sorrydave4 2024-09-19T13:51:25.766 INFO:tasks.workunit.client.0.smithi153.stdout:created: sorrydave5 2024-09-19T13:51:25.788 INFO:tasks.workunit.client.0.smithi153.stdout:created: sorrydave6 2024-09-19T13:51:25.812 INFO:tasks.workunit.client.0.smithi153.stdout:created: sorrydave7 2024-09-19T13:51:25.838 INFO:tasks.workunit.client.0.smithi153.stdout:created: sorrydave8 2024-09-19T13:51:25.862 INFO:tasks.workunit.client.0.smithi153.stdout:created: sorrydave9 2024-09-19T13:51:25.862 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (225 ms) 2024-09-19T13:51:25.863 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-19T13:51:26.679 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (816 ms) 2024-09-19T13:51:26.679 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T13:51:26.679 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T13:51:26.679 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T13:51:26.679 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T13:51:26.679 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T13:51:26.679 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:51:26.678+0000 7fce8e93ea80 -1 shutting down 2024-09-19T13:51:26.681 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:51:26.682+0000 7fcd68690640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58681, si_uid : 1000, si_addr0x3e80000e539, si_status0 2024-09-19T13:51:55.835 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.SHUTDOWN (29156 ms) 2024-09-19T13:51:55.835 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 9 tests from LibRGW (31192 ms total) 2024-09-19T13:51:55.835 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:51:55.835 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment tear-down 2024-09-19T13:51:55.835 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] 9 tests from 1 test suite ran. (31192 ms total) 2024-09-19T13:51:55.835 INFO:tasks.workunit.client.0.smithi153.stdout:[ PASSED ] 9 tests. 2024-09-19T13:51:55.849 INFO:tasks.workunit.client.0.smithi153.stdout:phase 2.2 2024-09-19T13:51:55.874 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-19T13:51:55.874 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment set-up. 2024-09-19T13:51:55.874 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 9 tests from LibRGW 2024-09-19T13:51:55.874 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.INIT 2024-09-19T13:51:55.885 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:51:55.885 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:51:56.180 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.INIT (307 ms) 2024-09-19T13:51:56.181 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T13:51:56.182 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-19T13:51:56.182 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-19T13:51:56.182 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-19T13:51:56.182 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-19T13:51:56.236 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.DELETE_BUCKET (53 ms) 2024-09-19T13:51:56.236 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-19T13:51:56.257 INFO:tasks.workunit.client.0.smithi153.stdout:created: sorrydave0 2024-09-19T13:51:56.279 INFO:tasks.workunit.client.0.smithi153.stdout:created: sorrydave1 2024-09-19T13:51:56.298 INFO:tasks.workunit.client.0.smithi153.stdout:created: sorrydave2 2024-09-19T13:51:56.317 INFO:tasks.workunit.client.0.smithi153.stdout:created: sorrydave3 2024-09-19T13:51:56.337 INFO:tasks.workunit.client.0.smithi153.stdout:created: sorrydave4 2024-09-19T13:51:56.355 INFO:tasks.workunit.client.0.smithi153.stdout:created: sorrydave5 2024-09-19T13:51:56.377 INFO:tasks.workunit.client.0.smithi153.stdout:created: sorrydave6 2024-09-19T13:51:56.398 INFO:tasks.workunit.client.0.smithi153.stdout:created: sorrydave7 2024-09-19T13:51:56.419 INFO:tasks.workunit.client.0.smithi153.stdout:created: sorrydave8 2024-09-19T13:51:56.438 INFO:tasks.workunit.client.0.smithi153.stdout:created: sorrydave9 2024-09-19T13:51:56.438 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (202 ms) 2024-09-19T13:51:56.438 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-19T13:51:57.158 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (721 ms) 2024-09-19T13:51:57.158 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T13:51:57.158 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T13:51:57.158 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T13:51:57.159 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T13:51:57.159 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T13:51:57.159 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:51:57.157+0000 7f138102ea80 -1 shutting down 2024-09-19T13:51:57.161 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:51:57.161+0000 7f125ad80640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59326, si_uid : 1000, si_addr0x3e80000e7be, si_status0 2024-09-19T13:52:26.426 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.SHUTDOWN (29267 ms) 2024-09-19T13:52:26.426 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 9 tests from LibRGW (30552 ms total) 2024-09-19T13:52:26.427 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:52:26.427 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment tear-down 2024-09-19T13:52:26.427 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] 9 tests from 1 test suite ran. (30552 ms total) 2024-09-19T13:52:26.427 INFO:tasks.workunit.client.0.smithi153.stdout:[ PASSED ] 9 tests. 2024-09-19T13:52:26.440 INFO:tasks.workunit.client.0.smithi153.stdout:phase 3.1 2024-09-19T13:52:26.782 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-19T13:52:26.782 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment set-up. 2024-09-19T13:52:26.782 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 13 tests from LibRGW 2024-09-19T13:52:26.782 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.INIT 2024-09-19T13:52:26.792 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:52:26.792 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:52:27.091 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.INIT (309 ms) 2024-09-19T13:52:27.091 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T13:52:27.093 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MOUNT (3 ms) 2024-09-19T13:52:27.093 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-19T13:52:27.109 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.CREATE_BUCKET (16 ms) 2024-09-19T13:52:27.110 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-19T13:52:27.115 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-19T13:52:27.115 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-19T13:52:27.117 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-19T13:52:27.117 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.LARGE1 2024-09-19T13:52:27.180 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.LARGE1 (63 ms) 2024-09-19T13:52:27.181 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.LARGE2 2024-09-19T13:52:27.260 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.LARGE2 (79 ms) 2024-09-19T13:52:27.260 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-19T13:52:27.260 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-19T13:52:27.260 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-19T13:52:27.260 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-19T13:52:27.261 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-19T13:52:27.261 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-19T13:52:27.261 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T13:52:27.261 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T13:52:27.261 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T13:52:27.261 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T13:52:27.261 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T13:52:27.261 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:52:27.257+0000 7f8cefc71a80 -1 shutting down 2024-09-19T13:52:27.263 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:52:27.261+0000 7f8bc99c3640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59971, si_uid : 1000, si_addr0x3e80000ea43, si_status0 2024-09-19T13:52:57.095 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.SHUTDOWN (29834 ms) 2024-09-19T13:52:57.095 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 13 tests from LibRGW (30314 ms total) 2024-09-19T13:52:57.096 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:52:57.096 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment tear-down 2024-09-19T13:52:57.096 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] 13 tests from 1 test suite ran. (30314 ms total) 2024-09-19T13:52:57.096 INFO:tasks.workunit.client.0.smithi153.stdout:[ PASSED ] 13 tests. 2024-09-19T13:52:57.114 INFO:tasks.workunit.client.0.smithi153.stdout:phase 3.2 2024-09-19T13:52:57.456 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-19T13:52:57.456 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment set-up. 2024-09-19T13:52:57.456 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 13 tests from LibRGW 2024-09-19T13:52:57.456 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.INIT 2024-09-19T13:52:57.465 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:52:57.465 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:52:58.213 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.INIT (756 ms) 2024-09-19T13:52:58.213 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T13:52:58.215 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-19T13:52:58.215 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-19T13:52:58.215 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-19T13:52:58.215 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-19T13:52:58.222 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (7 ms) 2024-09-19T13:52:58.222 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-19T13:52:58.227 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (5 ms) 2024-09-19T13:52:58.227 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.LARGE1 2024-09-19T13:52:58.303 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.LARGE1 (76 ms) 2024-09-19T13:52:58.303 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.LARGE2 2024-09-19T13:52:58.304 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-19T13:52:58.304 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-19T13:52:58.304 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-19T13:52:58.304 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-19T13:52:58.311 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.DELETE_OBJECT (8 ms) 2024-09-19T13:52:58.311 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-19T13:52:58.368 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.DELETE_BUCKET (57 ms) 2024-09-19T13:52:58.368 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T13:52:58.368 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T13:52:58.368 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T13:52:58.368 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T13:52:58.368 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T13:52:58.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:52:58.364+0000 7f19fc18ca80 -1 shutting down 2024-09-19T13:52:58.370 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:52:58.368+0000 7f18d5ede640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60616, si_uid : 1000, si_addr0x3e80000ecc8, si_status0 2024-09-19T13:53:28.377 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.SHUTDOWN (30008 ms) 2024-09-19T13:53:28.377 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 13 tests from LibRGW (30920 ms total) 2024-09-19T13:53:28.377 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:53:28.377 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment tear-down 2024-09-19T13:53:28.377 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] 13 tests from 1 test suite ran. (30920 ms total) 2024-09-19T13:53:28.377 INFO:tasks.workunit.client.0.smithi153.stdout:[ PASSED ] 13 tests. 2024-09-19T13:53:28.396 INFO:tasks.workunit.client.0.smithi153.stdout:phase 4.1 2024-09-19T13:53:28.419 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-19T13:53:28.419 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment set-up. 2024-09-19T13:53:28.419 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 11 tests from LibRGW 2024-09-19T13:53:28.419 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.TVAR 2024-09-19T13:53:28.419 INFO:tasks.workunit.client.0.smithi153.stdout:read i1: 64001 2024-09-19T13:53:28.419 INFO:tasks.workunit.client.0.smithi153.stdout:read s1: blunderbuss 2024-09-19T13:53:28.420 INFO:tasks.workunit.client.0.smithi153.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-19T13:53:28.420 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.INIT 2024-09-19T13:53:28.432 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:53:28.433 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:53:28.724 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.INIT (306 ms) 2024-09-19T13:53:28.725 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T13:53:28.727 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MOUNT (3 ms) 2024-09-19T13:53:28.727 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-19T13:53:28.762 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (35 ms) 2024-09-19T13:53:28.763 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-19T13:53:30.298 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_0 2024-09-19T13:53:30.298 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_1 2024-09-19T13:53:30.298 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_2 2024-09-19T13:53:30.298 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_3 2024-09-19T13:53:30.298 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_4 2024-09-19T13:53:30.298 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_5 2024-09-19T13:53:30.298 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_6 2024-09-19T13:53:30.299 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_7 2024-09-19T13:53:30.299 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_8 2024-09-19T13:53:30.299 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_9 2024-09-19T13:53:30.299 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_10 2024-09-19T13:53:30.299 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_11 2024-09-19T13:53:30.299 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_12 2024-09-19T13:53:30.299 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_13 2024-09-19T13:53:30.299 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_14 2024-09-19T13:53:30.299 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_15 2024-09-19T13:53:30.299 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_16 2024-09-19T13:53:30.299 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_17 2024-09-19T13:53:30.299 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_18 2024-09-19T13:53:30.299 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_19 2024-09-19T13:53:30.299 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_20 2024-09-19T13:53:30.299 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_21 2024-09-19T13:53:30.300 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_22 2024-09-19T13:53:30.300 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_23 2024-09-19T13:53:30.300 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_24 2024-09-19T13:53:30.300 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_25 2024-09-19T13:53:30.300 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_26 2024-09-19T13:53:30.300 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_27 2024-09-19T13:53:30.300 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_28 2024-09-19T13:53:30.300 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_29 2024-09-19T13:53:30.300 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_30 2024-09-19T13:53:30.300 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_31 2024-09-19T13:53:30.300 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_32 2024-09-19T13:53:30.300 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_33 2024-09-19T13:53:30.300 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_34 2024-09-19T13:53:30.301 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_35 2024-09-19T13:53:30.301 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_36 2024-09-19T13:53:30.301 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_37 2024-09-19T13:53:30.301 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_38 2024-09-19T13:53:30.301 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_39 2024-09-19T13:53:30.301 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_40 2024-09-19T13:53:30.301 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_41 2024-09-19T13:53:30.301 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_42 2024-09-19T13:53:30.301 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_43 2024-09-19T13:53:30.301 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_44 2024-09-19T13:53:30.301 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_45 2024-09-19T13:53:30.301 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_46 2024-09-19T13:53:30.301 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_47 2024-09-19T13:53:30.301 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_48 2024-09-19T13:53:30.302 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_49 2024-09-19T13:53:30.302 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_50 2024-09-19T13:53:30.302 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_51 2024-09-19T13:53:30.302 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_52 2024-09-19T13:53:30.302 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_53 2024-09-19T13:53:30.302 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_54 2024-09-19T13:53:30.302 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_55 2024-09-19T13:53:30.302 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_56 2024-09-19T13:53:30.302 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_57 2024-09-19T13:53:30.302 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_58 2024-09-19T13:53:30.302 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_59 2024-09-19T13:53:30.302 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_60 2024-09-19T13:53:30.302 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_61 2024-09-19T13:53:30.303 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_62 2024-09-19T13:53:30.303 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_63 2024-09-19T13:53:30.303 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_64 2024-09-19T13:53:30.303 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_65 2024-09-19T13:53:30.303 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_66 2024-09-19T13:53:30.303 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_67 2024-09-19T13:53:30.303 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_68 2024-09-19T13:53:30.303 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_69 2024-09-19T13:53:30.303 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_70 2024-09-19T13:53:30.303 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_71 2024-09-19T13:53:30.303 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_72 2024-09-19T13:53:30.303 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_73 2024-09-19T13:53:30.303 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_74 2024-09-19T13:53:30.304 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_75 2024-09-19T13:53:30.304 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_76 2024-09-19T13:53:30.304 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_77 2024-09-19T13:53:30.304 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_78 2024-09-19T13:53:30.304 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_79 2024-09-19T13:53:30.304 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_80 2024-09-19T13:53:30.304 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_81 2024-09-19T13:53:30.304 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_82 2024-09-19T13:53:30.304 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_83 2024-09-19T13:53:30.304 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_84 2024-09-19T13:53:30.304 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_85 2024-09-19T13:53:30.305 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_86 2024-09-19T13:53:30.305 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_87 2024-09-19T13:53:30.305 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_88 2024-09-19T13:53:30.305 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_89 2024-09-19T13:53:30.305 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_90 2024-09-19T13:53:30.305 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_91 2024-09-19T13:53:30.305 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_92 2024-09-19T13:53:30.305 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_93 2024-09-19T13:53:30.305 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_94 2024-09-19T13:53:30.305 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_95 2024-09-19T13:53:30.305 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_96 2024-09-19T13:53:30.306 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_97 2024-09-19T13:53:30.306 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_98 2024-09-19T13:53:30.306 INFO:tasks.workunit.client.0.smithi153.stdout:created: dmarker:f_99 2024-09-19T13:53:30.306 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (1535 ms) 2024-09-19T13:53:30.306 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-19T13:53:30.307 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-19T13:53:30.307 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-19T13:53:30.307 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-19T13:53:30.307 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-19T13:53:30.307 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-19T13:53:30.307 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-19T13:53:30.307 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-19T13:53:30.307 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-19T13:53:30.308 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-19T13:53:30.308 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-19T13:53:30.308 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-19T13:53:30.308 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-19T13:53:30.308 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-19T13:53:30.308 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-19T13:53:30.308 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-19T13:53:30.308 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-19T13:53:30.308 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-19T13:53:30.308 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-19T13:53:30.308 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-19T13:53:30.309 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-19T13:53:30.309 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-19T13:53:30.309 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-19T13:53:30.309 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-19T13:53:30.309 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-19T13:53:30.309 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-19T13:53:30.309 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-19T13:53:30.309 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-19T13:53:30.309 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-19T13:53:30.309 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-19T13:53:30.309 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-19T13:53:30.310 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-19T13:53:30.310 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-19T13:53:30.310 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-19T13:53:30.310 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-19T13:53:30.310 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-19T13:53:30.310 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-19T13:53:30.310 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-19T13:53:30.310 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-19T13:53:30.310 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-19T13:53:30.310 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-19T13:53:30.310 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-19T13:53:30.310 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-19T13:53:30.311 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-19T13:53:30.311 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-19T13:53:30.311 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-19T13:53:30.311 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-19T13:53:30.311 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-19T13:53:30.311 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-19T13:53:30.311 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-19T13:53:30.311 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-19T13:53:30.311 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-19T13:53:30.311 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-19T13:53:30.311 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-19T13:53:30.311 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-19T13:53:30.311 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-19T13:53:30.311 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-19T13:53:30.312 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-19T13:53:30.312 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-19T13:53:30.312 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-19T13:53:30.312 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-19T13:53:30.312 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-19T13:53:30.312 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-19T13:53:30.312 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-19T13:53:30.312 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-19T13:53:30.312 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-19T13:53:30.312 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-19T13:53:30.312 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-19T13:53:30.312 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-19T13:53:30.312 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-19T13:53:30.313 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-19T13:53:30.313 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-19T13:53:30.313 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-19T13:53:30.313 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-19T13:53:30.313 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-19T13:53:30.313 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-19T13:53:30.313 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-19T13:53:30.313 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-19T13:53:30.313 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-19T13:53:30.313 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-19T13:53:30.313 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-19T13:53:30.313 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-19T13:53:30.313 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-19T13:53:30.314 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-19T13:53:30.314 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-19T13:53:30.314 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-19T13:53:30.314 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-19T13:53:30.314 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-19T13:53:30.314 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-19T13:53:30.314 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-19T13:53:30.314 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-19T13:53:30.314 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-19T13:53:30.314 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-19T13:53:30.314 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-19T13:53:30.314 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-19T13:53:30.314 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-19T13:53:30.315 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-19T13:53:30.315 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-19T13:53:30.315 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-19T13:53:30.315 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-19T13:53:30.315 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-19T13:53:30.315 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-19T13:53:30.315 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-19T13:53:30.315 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MARKER1_READDIR (7 ms) 2024-09-19T13:53:30.315 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-19T13:53:30.316 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-19T13:53:30.316 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-19T13:53:30.316 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-19T13:53:30.316 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-19T13:53:30.316 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-19T13:53:30.316 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-19T13:53:30.316 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-19T13:53:30.317 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-19T13:53:30.317 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-19T13:53:30.317 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-19T13:53:30.317 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-19T13:53:30.317 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-19T13:53:30.317 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-19T13:53:30.317 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-19T13:53:30.317 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-19T13:53:30.317 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-19T13:53:30.317 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-19T13:53:30.317 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-19T13:53:30.317 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-19T13:53:30.317 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-19T13:53:30.318 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-19T13:53:30.318 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-19T13:53:30.318 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-19T13:53:30.318 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-19T13:53:30.318 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-19T13:53:30.318 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-19T13:53:30.318 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-19T13:53:30.318 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-19T13:53:30.318 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-19T13:53:30.318 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-19T13:53:30.318 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-19T13:53:30.318 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-19T13:53:30.319 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-19T13:53:30.319 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-19T13:53:30.319 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-19T13:53:30.319 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-19T13:53:30.319 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-19T13:53:30.319 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-19T13:53:30.319 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-19T13:53:30.319 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-19T13:53:30.319 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-19T13:53:30.319 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-19T13:53:30.319 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-19T13:53:30.319 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-19T13:53:30.319 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-19T13:53:30.320 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-19T13:53:30.320 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-19T13:53:30.320 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-19T13:53:30.320 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-19T13:53:30.320 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-19T13:53:30.320 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-19T13:53:30.320 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-19T13:53:30.320 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-19T13:53:30.320 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-19T13:53:30.320 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-19T13:53:30.320 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-19T13:53:30.320 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-19T13:53:30.320 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-19T13:53:30.320 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-19T13:53:30.321 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-19T13:53:30.321 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-19T13:53:30.321 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-19T13:53:30.321 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-19T13:53:30.321 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-19T13:53:30.321 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-19T13:53:30.321 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-19T13:53:30.321 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-19T13:53:30.321 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-19T13:53:30.321 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-19T13:53:30.321 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-19T13:53:30.321 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-19T13:53:30.321 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-19T13:53:30.321 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-19T13:53:30.321 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-19T13:53:30.322 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-19T13:53:30.322 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-19T13:53:30.322 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-19T13:53:30.322 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-19T13:53:30.322 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-19T13:53:30.322 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-19T13:53:30.322 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-19T13:53:30.322 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-19T13:53:30.322 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-19T13:53:30.322 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-19T13:53:30.322 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-19T13:53:30.322 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-19T13:53:30.322 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-19T13:53:30.322 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-19T13:53:30.322 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-19T13:53:30.323 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-19T13:53:30.323 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-19T13:53:30.323 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-19T13:53:30.323 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-19T13:53:30.323 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-19T13:53:30.323 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-19T13:53:30.323 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-19T13:53:30.323 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-19T13:53:30.323 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-19T13:53:30.324 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-19T13:53:30.324 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-19T13:53:30.324 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MARKER2_READDIR (5 ms) 2024-09-19T13:53:30.324 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-19T13:53:30.324 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-19T13:53:30.324 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T13:53:30.324 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T13:53:30.324 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T13:53:30.324 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.UMOUNT (1 ms) 2024-09-19T13:53:30.324 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T13:53:30.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:53:30.308+0000 7f5bdb485a80 -1 shutting down 2024-09-19T13:53:30.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:53:30.312+0000 7f5ab51d7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61267, si_uid : 1000, si_addr0x3e80000ef53, si_status0 2024-09-19T13:53:59.037 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.SHUTDOWN (28727 ms) 2024-09-19T13:53:59.037 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 11 tests from LibRGW (30619 ms total) 2024-09-19T13:53:59.037 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:53:59.038 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment tear-down 2024-09-19T13:53:59.038 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] 11 tests from 1 test suite ran. (30619 ms total) 2024-09-19T13:53:59.038 INFO:tasks.workunit.client.0.smithi153.stdout:[ PASSED ] 11 tests. 2024-09-19T13:53:59.052 INFO:tasks.workunit.client.0.smithi153.stdout:phase 4.2 2024-09-19T13:53:59.074 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-19T13:53:59.074 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment set-up. 2024-09-19T13:53:59.074 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 11 tests from LibRGW 2024-09-19T13:53:59.074 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.TVAR 2024-09-19T13:53:59.075 INFO:tasks.workunit.client.0.smithi153.stdout:read i1: 64001 2024-09-19T13:53:59.075 INFO:tasks.workunit.client.0.smithi153.stdout:read s1: blunderbuss 2024-09-19T13:53:59.075 INFO:tasks.workunit.client.0.smithi153.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-19T13:53:59.075 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.INIT 2024-09-19T13:53:59.084 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:53:59.084 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:53:59.371 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.INIT (296 ms) 2024-09-19T13:53:59.371 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T13:53:59.373 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-19T13:53:59.373 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-19T13:53:59.391 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (19 ms) 2024-09-19T13:53:59.391 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-19T13:53:59.391 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-19T13:53:59.391 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-19T13:53:59.391 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-19T13:53:59.391 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-19T13:53:59.395 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-19T13:53:59.395 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-19T13:53:59.395 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-19T13:53:59.395 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-19T13:53:59.395 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-19T13:53:59.395 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-19T13:53:59.395 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-19T13:53:59.395 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-19T13:53:59.396 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-19T13:53:59.396 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-19T13:53:59.396 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-19T13:53:59.396 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-19T13:53:59.396 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-19T13:53:59.396 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-19T13:53:59.396 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-19T13:53:59.396 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-19T13:53:59.396 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-19T13:53:59.396 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-19T13:53:59.396 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-19T13:53:59.396 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-19T13:53:59.396 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-19T13:53:59.397 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-19T13:53:59.397 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-19T13:53:59.397 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-19T13:53:59.397 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-19T13:53:59.397 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-19T13:53:59.397 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-19T13:53:59.397 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-19T13:53:59.397 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-19T13:53:59.397 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-19T13:53:59.397 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-19T13:53:59.397 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-19T13:53:59.397 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-19T13:53:59.397 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-19T13:53:59.397 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-19T13:53:59.398 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-19T13:53:59.398 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-19T13:53:59.398 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-19T13:53:59.398 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-19T13:53:59.398 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-19T13:53:59.398 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-19T13:53:59.398 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-19T13:53:59.398 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-19T13:53:59.398 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-19T13:53:59.398 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-19T13:53:59.398 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-19T13:53:59.398 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-19T13:53:59.398 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-19T13:53:59.398 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-19T13:53:59.398 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-19T13:53:59.399 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-19T13:53:59.399 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-19T13:53:59.399 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-19T13:53:59.399 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-19T13:53:59.399 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-19T13:53:59.399 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-19T13:53:59.399 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-19T13:53:59.399 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-19T13:53:59.399 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-19T13:53:59.399 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-19T13:53:59.399 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-19T13:53:59.399 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-19T13:53:59.399 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-19T13:53:59.399 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-19T13:53:59.399 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-19T13:53:59.400 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-19T13:53:59.400 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-19T13:53:59.400 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-19T13:53:59.400 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-19T13:53:59.400 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-19T13:53:59.400 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-19T13:53:59.400 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-19T13:53:59.400 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-19T13:53:59.400 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-19T13:53:59.400 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-19T13:53:59.400 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-19T13:53:59.400 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-19T13:53:59.400 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-19T13:53:59.401 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-19T13:53:59.401 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-19T13:53:59.401 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-19T13:53:59.401 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-19T13:53:59.401 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-19T13:53:59.401 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-19T13:53:59.401 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-19T13:53:59.401 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-19T13:53:59.401 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-19T13:53:59.401 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-19T13:53:59.401 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-19T13:53:59.401 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-19T13:53:59.401 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-19T13:53:59.401 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-19T13:53:59.402 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-19T13:53:59.402 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-19T13:53:59.402 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-19T13:53:59.402 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-19T13:53:59.402 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-19T13:53:59.402 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-19T13:53:59.402 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-19T13:53:59.402 INFO:tasks.workunit.client.0.smithi153.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-19T13:53:59.402 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MARKER2_READDIR (4 ms) 2024-09-19T13:53:59.402 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-19T13:53:59.402 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-19T13:53:59.402 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T13:53:59.402 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T13:53:59.402 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T13:53:59.402 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T13:53:59.403 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T13:53:59.403 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:53:59.391+0000 7f0419764a80 -1 shutting down 2024-09-19T13:53:59.403 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:53:59.395+0000 7f02f34b6640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61913, si_uid : 1000, si_addr0x3e80000f1d9, si_status0 2024-09-19T13:54:29.427 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.SHUTDOWN (30032 ms) 2024-09-19T13:54:29.428 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 11 tests from LibRGW (30353 ms total) 2024-09-19T13:54:29.428 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:54:29.428 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment tear-down 2024-09-19T13:54:29.428 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] 11 tests from 1 test suite ran. (30353 ms total) 2024-09-19T13:54:29.428 INFO:tasks.workunit.client.0.smithi153.stdout:[ PASSED ] 11 tests. 2024-09-19T13:54:29.441 INFO:tasks.workunit.client.0.smithi153.stdout:phase 5.1 2024-09-19T13:54:29.475 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-19T13:54:29.475 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment set-up. 2024-09-19T13:54:29.475 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 19 tests from LibRGW 2024-09-19T13:54:29.475 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.INIT 2024-09-19T13:54:29.486 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:54:29.486 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:54:29.775 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.INIT (300 ms) 2024-09-19T13:54:29.775 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T13:54:29.777 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-19T13:54:29.777 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-19T13:54:29.795 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.CREATE_BUCKET (18 ms) 2024-09-19T13:54:29.795 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-19T13:54:29.802 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (7 ms) 2024-09-19T13:54:29.802 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-19T13:54:29.802 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-19T13:54:29.802 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-19T13:54:29.805 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-19T13:54:29.805 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-19T13:54:29.805 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-19T13:54:29.805 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-19T13:54:29.813 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.PUT_OBJECT (9 ms) 2024-09-19T13:54:29.814 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-19T13:54:29.819 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.GET_OBJECT (5 ms) 2024-09-19T13:54:29.820 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-19T13:54:29.820 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-19T13:54:29.820 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-19T13:54:29.820 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-19T13:54:29.820 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.WRITEV 2024-09-19T13:54:29.820 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-19T13:54:29.820 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.READV 2024-09-19T13:54:29.820 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-19T13:54:29.820 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-19T13:54:29.820 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-19T13:54:29.820 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-19T13:54:29.821 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-19T13:54:29.821 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-19T13:54:29.821 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-19T13:54:29.821 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T13:54:29.821 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T13:54:29.821 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T13:54:29.821 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T13:54:29.821 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T13:54:29.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:54:29.819+0000 7fcf582aca80 -1 shutting down 2024-09-19T13:54:29.822 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:54:29.823+0000 7fce31ffe640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62558, si_uid : 1000, si_addr0x3e80000f45e, si_status0 2024-09-19T13:55:00.158 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.SHUTDOWN (30339 ms) 2024-09-19T13:55:00.158 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 19 tests from LibRGW (30683 ms total) 2024-09-19T13:55:00.158 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:55:00.158 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment tear-down 2024-09-19T13:55:00.158 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] 19 tests from 1 test suite ran. (30683 ms total) 2024-09-19T13:55:00.158 INFO:tasks.workunit.client.0.smithi153.stdout:[ PASSED ] 19 tests. 2024-09-19T13:55:00.172 INFO:tasks.workunit.client.0.smithi153.stdout:phase 5.2 2024-09-19T13:55:00.205 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-19T13:55:00.205 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment set-up. 2024-09-19T13:55:00.205 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 19 tests from LibRGW 2024-09-19T13:55:00.205 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.INIT 2024-09-19T13:55:00.213 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:55:00.214 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:55:00.544 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.INIT (339 ms) 2024-09-19T13:55:00.544 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T13:55:00.546 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-19T13:55:00.546 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-19T13:55:00.546 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-19T13:55:00.546 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-19T13:55:00.557 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (11 ms) 2024-09-19T13:55:00.557 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-19T13:55:00.557 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-19T13:55:00.557 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-19T13:55:00.557 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-19T13:55:00.557 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-19T13:55:00.557 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-19T13:55:00.558 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-19T13:55:00.558 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-19T13:55:00.558 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-19T13:55:00.558 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-19T13:55:00.558 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-19T13:55:00.558 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-19T13:55:00.558 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-19T13:55:00.558 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-19T13:55:00.558 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.WRITEV 2024-09-19T13:55:00.558 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-19T13:55:00.558 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.READV 2024-09-19T13:55:00.558 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-19T13:55:00.558 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-19T13:55:00.558 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-19T13:55:00.558 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-19T13:55:00.568 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.DELETE_OBJECT (11 ms) 2024-09-19T13:55:00.568 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-19T13:55:00.621 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.DELETE_BUCKET (53 ms) 2024-09-19T13:55:00.621 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T13:55:00.621 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T13:55:00.621 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T13:55:00.621 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T13:55:00.622 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T13:55:00.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:55:00.622+0000 7f677eb51a80 -1 shutting down 2024-09-19T13:55:00.624 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:55:00.622+0000 7f66588a3640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63204, si_uid : 1000, si_addr0x3e80000f6e4, si_status0 2024-09-19T13:55:30.829 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.SHUTDOWN (30207 ms) 2024-09-19T13:55:30.829 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 19 tests from LibRGW (30623 ms total) 2024-09-19T13:55:30.829 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:55:30.829 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment tear-down 2024-09-19T13:55:30.829 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] 19 tests from 1 test suite ran. (30623 ms total) 2024-09-19T13:55:30.830 INFO:tasks.workunit.client.0.smithi153.stdout:[ PASSED ] 19 tests. 2024-09-19T13:55:30.843 INFO:tasks.workunit.client.0.smithi153.stdout:phase 6.1 2024-09-19T13:55:30.866 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-19T13:55:30.866 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment set-up. 2024-09-19T13:55:30.866 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 10 tests from LibRGW 2024-09-19T13:55:30.866 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.INIT 2024-09-19T13:55:30.875 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:55:30.875 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:55:31.178 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.INIT (311 ms) 2024-09-19T13:55:31.178 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.MOUNT 2024-09-19T13:55:31.179 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-19T13:55:31.180 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-19T13:55:31.219 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.CREATE_BUCKETS (40 ms) 2024-09-19T13:55:31.219 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-19T13:55:31.235 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (16 ms) 2024-09-19T13:55:31.235 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-19T13:55:31.272 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.TOPDIR_RENAME (37 ms) 2024-09-19T13:55:31.272 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-19T13:55:31.326 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.SUBDIR_RENAME (53 ms) 2024-09-19T13:55:31.326 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-19T13:55:31.379 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (54 ms) 2024-09-19T13:55:31.380 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-19T13:55:31.380 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-19T13:55:31.380 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-19T13:55:31.380 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-19T13:55:31.380 INFO:tasks.workunit.client.0.smithi153.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-19T13:55:31.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:55:31.378+0000 7f1ca893da80 -1 shutting down 2024-09-19T13:55:31.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:55:31.382+0000 7f1b8268f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63852, si_uid : 1000, si_addr0x3e80000f96c, si_status0 2024-09-19T13:56:01.331 INFO:tasks.workunit.client.0.smithi153.stdout:[ OK ] LibRGW.SHUTDOWN (29951 ms) 2024-09-19T13:56:01.331 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] 10 tests from LibRGW (30464 ms total) 2024-09-19T13:56:01.331 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:56:01.331 INFO:tasks.workunit.client.0.smithi153.stdout:[----------] Global test environment tear-down 2024-09-19T13:56:01.331 INFO:tasks.workunit.client.0.smithi153.stdout:[==========] 10 tests from 1 test suite ran. (30465 ms total) 2024-09-19T13:56:01.331 INFO:tasks.workunit.client.0.smithi153.stdout:[ PASSED ] 10 tests. 2024-09-19T13:56:01.341 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:56:01.341 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:56:01.358 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-19T13:56:01.359 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-19T13:56:01.359 DEBUG:teuthology.orchestra.run.smithi153:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-19T13:56:01.409 INFO:tasks.workunit.client.0.smithi153.stderr:+ [ -z ] 2024-09-19T13:56:01.409 INFO:tasks.workunit.client.0.smithi153.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-19T13:56:01.409 INFO:tasks.workunit.client.0.smithi153.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-19T13:56:01.410 INFO:tasks.workunit.client.0.smithi153.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name maven test user --email sigv4@example.com 2024-09-19T13:56:01.450 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T13:56:01.450 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T13:56:01.495 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.493+0000 7fd8106ee9c0 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.497+0000 7fd8106ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.497+0000 7fd8106ee9c0 20 realm 2024-09-19T13:56:01.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.497+0000 7fd8106ee9c0 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.497+0000 7fd8106ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.497+0000 7fd8106ee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T13:56:01.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.497+0000 7fd8106ee9c0 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.497+0000 7fd8106ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.497+0000 7fd8106ee9c0 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.497+0000 7fd8106ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:01.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.497+0000 7fd8106ee9c0 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.497+0000 7fd8106ee9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T13:56:01.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.497+0000 7fd8106ee9c0 20 searching for the correct realm 2024-09-19T13:56:01.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.505+0000 7fd80d9f3640 0 -- 172.21.15.153:0/2307203846 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fd80001a040 msgr2=0x7fd80006a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T13:56:01.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.509+0000 7fd80e9f5640 0 -- 172.21.15.153:0/2307203846 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7fd80403f930 msgr2=0x7fd80403d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T13:56:01.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.517+0000 7fd8106ee9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T13:56:01.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.517+0000 7fd8106ee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T13:56:01.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.517+0000 7fd8106ee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T13:56:01.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.517+0000 7fd8106ee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T13:56:01.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.517+0000 7fd8106ee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T13:56:01.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.517+0000 7fd8106ee9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T13:56:01.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.517+0000 7fd8106ee9c0 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.517+0000 7fd8106ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.517+0000 7fd8106ee9c0 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.521+0000 7fd8106ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T13:56:01.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.521+0000 7fd8106ee9c0 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.521+0000 7fd8106ee9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T13:56:01.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.521+0000 7fd8106ee9c0 20 zone default found 2024-09-19T13:56:01.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.521+0000 7fd8106ee9c0 4 Realm: () 2024-09-19T13:56:01.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.521+0000 7fd8106ee9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T13:56:01.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.521+0000 7fd8106ee9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T13:56:01.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.521+0000 7fd8106ee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T13:56:01.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.521+0000 7fd8106ee9c0 20 zonegroup default 2024-09-19T13:56:01.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.521+0000 7fd8106ee9c0 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.521+0000 7fd8106ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.521+0000 7fd8106ee9c0 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.521+0000 7fd8106ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.521+0000 7fd8106ee9c0 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.521+0000 7fd8106ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.521+0000 7fd8106ee9c0 20 started sync module instance, tier type = 2024-09-19T13:56:01.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.521+0000 7fd8106ee9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T13:56:01.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.537+0000 7fd8106ee9c0 20 add_watcher() i=0 2024-09-19T13:56:01.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.537+0000 7fd8106ee9c0 20 add_watcher() i=1 2024-09-19T13:56:01.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.537+0000 7fd8106ee9c0 20 add_watcher() i=2 2024-09-19T13:56:01.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.537+0000 7fd8106ee9c0 20 add_watcher() i=3 2024-09-19T13:56:01.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.537+0000 7fd8106ee9c0 20 add_watcher() i=4 2024-09-19T13:56:01.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.537+0000 7fd8106ee9c0 20 add_watcher() i=5 2024-09-19T13:56:01.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.537+0000 7fd8106ee9c0 20 add_watcher() i=6 2024-09-19T13:56:01.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.537+0000 7fd8106ee9c0 20 add_watcher() i=7 2024-09-19T13:56:01.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.537+0000 7fd8106ee9c0 2 all 8 watchers are set, enabling cache 2024-09-19T13:56:01.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd6c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:01.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd8106ee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T13:56:01.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd8106ee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T13:56:01.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd8106ee9c0 5 note: GC not initialized 2024-09-19T13:56:01.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd63f7fe640 20 reqs_thread_entry: start 2024-09-19T13:56:01.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd8106ee9c0 20 init_complete bucket index max shards: 11 2024-09-19T13:56:01.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd8106ee9c0 20 Filter name: none 2024-09-19T13:56:01.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd8106ee9c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-19T13:56:01.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd8106ee9c0 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd63d7fa640 20 reqs_thread_entry: start 2024-09-19T13:56:01.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd8106ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd8106ee9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-19T13:56:01.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd8106ee9c0 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-19T13:56:01.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd8106ee9c0 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-19T13:56:01.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd8106ee9c0 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd8106ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd8106ee9c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-19T13:56:01.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd8106ee9c0 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-19T13:56:01.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd8106ee9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-19T13:56:01.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd8106ee9c0 20 rados->read ofs=0 len=0 2024-09-19T13:56:01.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd8106ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T13:56:01.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd8106ee9c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-19T13:56:01.549 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd8106ee9c0 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-19T13:56:01.549 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd8106ee9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-19T13:56:01.549 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.541+0000 7fd8106ee9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-19T13:56:01.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.545+0000 7fd8106ee9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-19T13:56:01.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.545+0000 7fd8106ee9c0 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-19T13:56:01.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.545+0000 7fd8106ee9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-19T13:56:01.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.545+0000 7fd6f1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693197 cookie 94132641452768 notifier 5745 bl.length()=677 2024-09-19T13:56:01.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.545+0000 7fd6f1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-19T13:56:01.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.545+0000 7fd6f1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-19T13:56:01.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.549+0000 7fd8106ee9c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-19T13:56:01.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.549+0000 7fd8106ee9c0 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-19T13:56:01.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.549+0000 7fd8106ee9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-19T13:56:01.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.549+0000 7fd6f1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693239 cookie 94132641429104 notifier 5745 bl.length()=187 2024-09-19T13:56:01.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.549+0000 7fd6f1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-19T13:56:01.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.549+0000 7fd6f1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-19T13:56:01.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.553+0000 7fd8106ee9c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-19T13:56:01.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.553+0000 7fd8106ee9c0 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-19T13:56:01.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.553+0000 7fd8106ee9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-19T13:56:01.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.553+0000 7fd6f17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693240 cookie 94132641429104 notifier 5745 bl.length()=197 2024-09-19T13:56:01.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.553+0000 7fd6f17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-19T13:56:01.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.553+0000 7fd6f17fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-19T13:56:01.558 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T13:56:01.558 INFO:tasks.workunit.client.0.smithi153.stdout: "user_id": "ceph-test-maven", 2024-09-19T13:56:01.558 INFO:tasks.workunit.client.0.smithi153.stdout: "display_name": "maven test user", 2024-09-19T13:56:01.558 INFO:tasks.workunit.client.0.smithi153.stdout: "email": "sigv4@example.com", 2024-09-19T13:56:01.558 INFO:tasks.workunit.client.0.smithi153.stdout: "suspended": 0, 2024-09-19T13:56:01.558 INFO:tasks.workunit.client.0.smithi153.stdout: "max_buckets": 1000, 2024-09-19T13:56:01.558 INFO:tasks.workunit.client.0.smithi153.stdout: "subusers": [], 2024-09-19T13:56:01.559 INFO:tasks.workunit.client.0.smithi153.stdout: "keys": [ 2024-09-19T13:56:01.559 INFO:tasks.workunit.client.0.smithi153.stdout: { 2024-09-19T13:56:01.559 INFO:tasks.workunit.client.0.smithi153.stdout: "user": "ceph-test-maven", 2024-09-19T13:56:01.559 INFO:tasks.workunit.client.0.smithi153.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-19T13:56:01.559 INFO:tasks.workunit.client.0.smithi153.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-19T13:56:01.559 INFO:tasks.workunit.client.0.smithi153.stdout: "active": true, 2024-09-19T13:56:01.559 INFO:tasks.workunit.client.0.smithi153.stdout: "create_date": "2024-09-19T13:56:01.547098Z" 2024-09-19T13:56:01.559 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T13:56:01.559 INFO:tasks.workunit.client.0.smithi153.stdout: ], 2024-09-19T13:56:01.559 INFO:tasks.workunit.client.0.smithi153.stdout: "swift_keys": [], 2024-09-19T13:56:01.559 INFO:tasks.workunit.client.0.smithi153.stdout: "caps": [], 2024-09-19T13:56:01.559 INFO:tasks.workunit.client.0.smithi153.stdout: "op_mask": "read, write, delete", 2024-09-19T13:56:01.559 INFO:tasks.workunit.client.0.smithi153.stdout: "default_placement": "", 2024-09-19T13:56:01.560 INFO:tasks.workunit.client.0.smithi153.stdout: "default_storage_class": "", 2024-09-19T13:56:01.560 INFO:tasks.workunit.client.0.smithi153.stdout: "placement_tags": [], 2024-09-19T13:56:01.560 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_quota": { 2024-09-19T13:56:01.560 INFO:tasks.workunit.client.0.smithi153.stdout: "enabled": false, 2024-09-19T13:56:01.560 INFO:tasks.workunit.client.0.smithi153.stdout: "check_on_raw": false, 2024-09-19T13:56:01.560 INFO:tasks.workunit.client.0.smithi153.stdout: "max_size": -1, 2024-09-19T13:56:01.560 INFO:tasks.workunit.client.0.smithi153.stdout: "max_size_kb": 0, 2024-09-19T13:56:01.560 INFO:tasks.workunit.client.0.smithi153.stdout: "max_objects": -1 2024-09-19T13:56:01.560 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:56:01.560 INFO:tasks.workunit.client.0.smithi153.stdout: "user_quota": { 2024-09-19T13:56:01.560 INFO:tasks.workunit.client.0.smithi153.stdout: "enabled": false, 2024-09-19T13:56:01.560 INFO:tasks.workunit.client.0.smithi153.stdout: "check_on_raw": false, 2024-09-19T13:56:01.560 INFO:tasks.workunit.client.0.smithi153.stdout: "max_size": -1, 2024-09-19T13:56:01.561 INFO:tasks.workunit.client.0.smithi153.stdout: "max_size_kb": 0, 2024-09-19T13:56:01.561 INFO:tasks.workunit.client.0.smithi153.stdout: "max_objects": -1 2024-09-19T13:56:01.561 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T13:56:01.561 INFO:tasks.workunit.client.0.smithi153.stdout: "temp_url_keys": [], 2024-09-19T13:56:01.561 INFO:tasks.workunit.client.0.smithi153.stdout: "type": "rgw", 2024-09-19T13:56:01.561 INFO:tasks.workunit.client.0.smithi153.stdout: "mfa_ids": [], 2024-09-19T13:56:01.561 INFO:tasks.workunit.client.0.smithi153.stdout: "account_id": "", 2024-09-19T13:56:01.561 INFO:tasks.workunit.client.0.smithi153.stdout: "path": "/", 2024-09-19T13:56:01.561 INFO:tasks.workunit.client.0.smithi153.stdout: "create_date": "2024-09-19T13:56:01.547075Z", 2024-09-19T13:56:01.561 INFO:tasks.workunit.client.0.smithi153.stdout: "tags": [], 2024-09-19T13:56:01.561 INFO:tasks.workunit.client.0.smithi153.stdout: "group_ids": [] 2024-09-19T13:56:01.561 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T13:56:01.561 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T13:56:01.562 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.557+0000 7fd6c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T13:56:01.564 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.561+0000 7fd8106ee9c0 20 remove_watcher() i=0 2024-09-19T13:56:01.564 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.561+0000 7fd8106ee9c0 2 removed watcher, disabling cache 2024-09-19T13:56:01.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.565+0000 7fd8106ee9c0 20 remove_watcher() i=1 2024-09-19T13:56:01.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.565+0000 7fd8106ee9c0 20 remove_watcher() i=2 2024-09-19T13:56:01.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.569+0000 7fd8106ee9c0 20 remove_watcher() i=3 2024-09-19T13:56:01.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.569+0000 7fd8106ee9c0 20 remove_watcher() i=4 2024-09-19T13:56:01.573 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.573+0000 7fd8106ee9c0 20 remove_watcher() i=5 2024-09-19T13:56:01.574 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.573+0000 7fd8106ee9c0 20 remove_watcher() i=6 2024-09-19T13:56:01.576 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T13:56:01.573+0000 7fd8106ee9c0 20 remove_watcher() i=7 2024-09-19T13:56:01.590 INFO:tasks.workunit.client.0.smithi153.stderr:+ [ -z ] 2024-09-19T13:56:01.590 INFO:tasks.workunit.client.0.smithi153.stderr:+ [ -z /home/ubuntu/cephtest ] 2024-09-19T13:56:01.590 INFO:tasks.workunit.client.0.smithi153.stderr:+ cat /home/ubuntu/cephtest/url_file 2024-09-19T13:56:01.591 INFO:tasks.workunit.client.0.smithi153.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi153.front.sepia.ceph.com:443 2024-09-19T13:56:01.591 INFO:tasks.workunit.client.0.smithi153.stderr:+ [ -z /home/ubuntu/cephtest/clone.client.0 ] 2024-09-19T13:56:01.591 INFO:tasks.workunit.client.0.smithi153.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-19T13:56:01.591 INFO:tasks.workunit.client.0.smithi153.stderr:+ ./mvnw clean package 2024-09-19T13:56:01.596 INFO:tasks.workunit.client.0.smithi153.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-19T13:56:04.550 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] Scanning for projects... 2024-09-19T13:56:04.686 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-19T13:56:04.789 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 53 kB/s) 2024-09-19T13:56:04.826 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-19T13:56:04.859 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 17/83 kB Progress (1): 18/83 kB Progress (1): 19/83 kB Progress (1): 21/83 kB Progress (1): 22/83 kB Progress (1): 23/83 kB Progress (1): 25/83 kB Progress (1): 26/83 kB Progress (1): 28/83 kB Progress (1): 29/83 kB Progress (1): 30/83 kB Progress (1): 32/83 kB Progress (1): 33/83 kB Progress (1): 34/83 kB Progress (1): 36/83 kB Progress (1): 37/83 kB Progress (1): 39/83 kB Progress (1): 40/83 kB Progress (1): 41/83 kB Progress (1): 43/83 kB Progress (1): 44/83 kB Progress (1): 46/83 kB Progress (1): 47/83 kB Progress (1): 48/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.5 MB/s) 2024-09-19T13:56:04.868 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-19T13:56:04.890 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 2.7/77 kB Progress (1): 8.2/77 kB Progress (1): 9.6/77 kB Progress (1): 11/77 kB Progress (1): 12/77 kB Progress (1): 14/77 kB Progress (1): 18/77 kB Progress (1): 22/77 kB Progress (1): 23/77 kB Progress (1): 25/77 kB Progress (1): 26/77 kB Progress (1): 29/77 kB Progress (1): 33/77 kB Progress (1): 38/77 kB Progress (1): 43/77 kB Progress (1): 45/77 kB Progress (1): 49/77 kB Progress (1): 52/77 kB Progress (1): 58/77 kB Progress (1): 64/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.3 MB/s) 2024-09-19T13:56:04.917 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] 2024-09-19T13:56:04.917 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-19T13:56:04.917 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] Building jcksum 1.0 2024-09-19T13:56:04.917 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] from pom.xml 2024-09-19T13:56:04.917 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-19T13:56:04.920 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-19T13:56:04.936 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 332 kB/s) 2024-09-19T13:56:04.943 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-19T13:56:04.958 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 660 kB/s) 2024-09-19T13:56:04.962 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-19T13:56:04.978 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.8 MB/s) 2024-09-19T13:56:04.984 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-19T13:56:05.000 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.3 MB/s) 2024-09-19T13:56:05.013 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-19T13:56:05.029 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.1 MB/s) 2024-09-19T13:56:05.037 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-19T13:56:05.052 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 544 kB/s) 2024-09-19T13:56:05.055 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-19T13:56:05.071 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 506 kB/s) 2024-09-19T13:56:05.073 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-19T13:56:05.089 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.0 MB/s) 2024-09-19T13:56:05.094 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-19T13:56:05.110 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.3 MB/s) 2024-09-19T13:56:05.119 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-19T13:56:05.136 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.8 MB/s) 2024-09-19T13:56:05.145 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-19T13:56:05.161 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 613 kB/s) 2024-09-19T13:56:05.171 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-19T13:56:05.189 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.6 MB/s) 2024-09-19T13:56:05.199 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-19T13:56:05.215 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 332 kB/s) 2024-09-19T13:56:05.220 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-19T13:56:05.237 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.3 MB/s) 2024-09-19T13:56:05.241 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-19T13:56:05.258 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.9 MB/s) 2024-09-19T13:56:05.265 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-19T13:56:05.281 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.5 MB/s) 2024-09-19T13:56:05.290 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-19T13:56:05.306 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 352 kB/s) 2024-09-19T13:56:05.312 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-19T13:56:05.329 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.5 MB/s) 2024-09-19T13:56:05.342 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-19T13:56:05.359 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 398 kB/s) 2024-09-19T13:56:05.363 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-19T13:56:05.380 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 582 kB/s) 2024-09-19T13:56:05.384 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-19T13:56:05.401 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.7 MB/s) 2024-09-19T13:56:05.407 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-19T13:56:05.423 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.2 MB/s) 2024-09-19T13:56:05.433 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-19T13:56:05.450 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.5 MB/s) 2024-09-19T13:56:05.479 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-19T13:56:05.497 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 358 kB/s) 2024-09-19T13:56:05.501 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-19T13:56:05.518 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.2 MB/s) 2024-09-19T13:56:05.528 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-19T13:56:05.545 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.2 MB/s) 2024-09-19T13:56:05.561 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-19T13:56:05.578 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 236 kB/s) 2024-09-19T13:56:05.582 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-19T13:56:05.600 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 91 kB/s) 2024-09-19T13:56:05.603 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-19T13:56:05.620 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 131 kB/s) 2024-09-19T13:56:05.629 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-19T13:56:05.645 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 214 kB/s) 2024-09-19T13:56:05.653 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-19T13:56:05.670 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 190 kB/s) 2024-09-19T13:56:05.678 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-19T13:56:05.694 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 645 kB/s) 2024-09-19T13:56:05.702 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-19T13:56:05.718 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 105 kB/s) 2024-09-19T13:56:05.726 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-19T13:56:05.745 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 201 kB/s) 2024-09-19T13:56:05.753 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-19T13:56:05.770 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 289 kB/s) 2024-09-19T13:56:05.779 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-19T13:56:05.795 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 68 kB/s) 2024-09-19T13:56:05.800 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-19T13:56:05.817 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 226 kB/s) 2024-09-19T13:56:05.821 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-19T13:56:05.838 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 812 kB/s) 2024-09-19T13:56:05.845 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-19T13:56:05.861 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 230 kB/s) 2024-09-19T13:56:05.870 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-19T13:56:05.887 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 144 kB/s) 2024-09-19T13:56:05.896 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-19T13:56:05.913 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 162 kB/s) 2024-09-19T13:56:05.922 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-19T13:56:05.939 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 436 kB/s) 2024-09-19T13:56:05.948 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-19T13:56:05.965 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 321 kB/s) 2024-09-19T13:56:05.974 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-19T13:56:05.992 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 194 kB/s) 2024-09-19T13:56:06.005 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-19T13:56:06.025 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 231 kB/s) 2024-09-19T13:56:06.030 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-19T13:56:06.047 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 134 kB/s) 2024-09-19T13:56:06.056 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-19T13:56:06.073 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 379 kB/s) 2024-09-19T13:56:06.083 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-19T13:56:06.100 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 357 kB/s) 2024-09-19T13:56:06.110 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-19T13:56:06.128 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 175 kB/s) 2024-09-19T13:56:06.136 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-19T13:56:06.153 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 204 kB/s) 2024-09-19T13:56:06.165 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-19T13:56:06.182 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 227 kB/s) 2024-09-19T13:56:06.186 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-19T13:56:06.203 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 105 kB/s) 2024-09-19T13:56:06.215 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-19T13:56:06.231 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 389 kB/s) 2024-09-19T13:56:06.239 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-19T13:56:06.258 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 819 kB/s) 2024-09-19T13:56:06.265 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-19T13:56:06.283 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.8 MB/s) 2024-09-19T13:56:06.292 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-19T13:56:06.309 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 950 kB/s) 2024-09-19T13:56:06.319 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-19T13:56:06.336 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 292 kB/s) 2024-09-19T13:56:06.341 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-19T13:56:06.401 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 223 kB/s) 2024-09-19T13:56:06.412 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-19T13:56:06.429 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 776 kB/s) 2024-09-19T13:56:06.435 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-19T13:56:06.455 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.2 MB/s) 2024-09-19T13:56:06.482 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-19T13:56:06.501 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 783 kB/s) 2024-09-19T13:56:06.517 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-19T13:56:06.535 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 858 kB/s) 2024-09-19T13:56:06.540 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-19T13:56:06.560 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 4.0 MB/s) 2024-09-19T13:56:06.577 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-19T13:56:06.596 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 970 kB/s) 2024-09-19T13:56:06.609 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-19T13:56:06.627 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.1 MB/s) 2024-09-19T13:56:06.634 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-19T13:56:06.653 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 3.9 MB/s) 2024-09-19T13:56:06.670 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-19T13:56:06.687 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 226 kB/s) 2024-09-19T13:56:06.691 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-19T13:56:06.707 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 863 kB/s) 2024-09-19T13:56:06.714 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-19T13:56:06.730 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 200 kB/s) 2024-09-19T13:56:06.735 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-19T13:56:06.751 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 199 kB/s) 2024-09-19T13:56:06.756 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-19T13:56:06.773 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 127 kB/s) 2024-09-19T13:56:06.777 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-19T13:56:06.794 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 167 kB/s) 2024-09-19T13:56:06.800 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-19T13:56:06.817 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 90 kB/s) 2024-09-19T13:56:06.822 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-19T13:56:06.839 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 177 kB/s) 2024-09-19T13:56:06.846 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-19T13:56:06.862 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 188 kB/s) 2024-09-19T13:56:06.868 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-19T13:56:06.885 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 189 kB/s) 2024-09-19T13:56:06.893 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-19T13:56:06.909 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 64 kB/s) 2024-09-19T13:56:06.918 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-19T13:56:06.934 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 60 kB/s) 2024-09-19T13:56:06.941 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-19T13:56:06.957 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 191 kB/s) 2024-09-19T13:56:06.962 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-19T13:56:06.978 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 190 kB/s) 2024-09-19T13:56:06.984 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-19T13:56:07.002 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 191 kB/s) 2024-09-19T13:56:07.007 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-19T13:56:07.024 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 202 kB/s) 2024-09-19T13:56:07.028 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-19T13:56:07.044 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 189 kB/s) 2024-09-19T13:56:07.083 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-19T13:56:07.190 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 31 MB/s) 2024-09-19T13:56:07.192 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-19T13:56:07.193 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-19T13:56:07.193 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-19T13:56:07.193 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-19T13:56:07.194 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-19T13:56:07.233 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/98 kB Progress (1): 33/98 kB Progress (1): 49/98 kB Progress (1): 66/98 kB Progress (1): 82/98 kB Progress (1): 95/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 2.3 MB/s) 2024-09-19T13:56:07.233 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-19T13:56:07.248 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 292 kB/s) 2024-09-19T13:56:07.248 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-19T13:56:07.266 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.4/16 kB Progress (1): 2.8/16 kB Progress (2): 2.8/16 kB | 1.4/71 kB Progress (2): 4.1/16 kB | 1.4/71 kB Progress (3): 4.1/16 kB | 1.4/71 kB | 15/782 kB Progress (3): 5.5/16 kB | 1.4/71 kB | 15/782 kB Progress (3): 5.5/16 kB | 2.8/71 kB | 15/782 kB Progress (3): 6.9/16 kB | 2.8/71 kB | 15/782 kB Progress (3): 6.9/16 kB | 2.8/71 kB | 31/782 kB Progress (3): 6.9/16 kB | 4.1/71 kB | 31/782 kB Progress (3): 8.3/16 kB | 4.1/71 kB | 31/782 kB Progress (3): 8.3/16 kB | 4.1/71 kB | 48/782 kB Progress (3): 8.3/16 kB | 5.5/71 kB | 48/782 kB Progress (3): 9.7/16 kB | 5.5/71 kB | 48/782 kB Progress (3): 9.7/16 kB | 6.9/71 kB | 48/782 kB Progress (3): 11/16 kB | 6.9/71 kB | 48/782 kB Progress (3): 11/16 kB | 6.9/71 kB | 64/782 kB Progress (3): 11/16 kB | 8.3/71 kB | 64/782 kB Progress (3): 12/16 kB | 8.3/71 kB | 64/782 kB Progress (3): 12/16 kB | 9.7/71 kB | 64/782 kB Progress (3): 12/16 kB | 9.7/71 kB | 78/782 kB Progress (3): 14/16 kB | 9.7/71 kB | 78/782 kB Progress (3): 14/16 kB | 11/71 kB | 78/782 kB Progress (3): 15/16 kB | 11/71 kB | 78/782 kB Progress (3): 15/16 kB | 11/71 kB | 94/782 kB Progress (3): 15/16 kB | 12/71 kB | 94/782 kB Progress (3): 16 kB | 12/71 kB | 94/782 kB Progress (3): 16 kB | 12/71 kB | 110/782 kB Progress (3): 16 kB | 14/71 kB | 110/782 kB Progress (3): 16 kB | 14/71 kB | 127/782 kB Progress (3): 16 kB | 15/71 kB | 127/782 kB Progress (3): 16 kB | 15/71 kB | 143/782 kB Progress (3): 16 kB | 16/71 kB | 143/782 kB Progress (3): 16 kB | 16/71 kB | 160/782 kB Progress (3): 16 kB | 16/71 kB | 176/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 216 kB/s) 2024-09-19T13:56:07.266 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-19T13:56:07.279 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 16/71 kB | 192/782 kB Progress (2): 16/71 kB | 209/782 kB Progress (2): 16/71 kB | 225/782 kB Progress (2): 16/71 kB | 241/782 kB Progress (2): 16/71 kB | 258/782 kB Progress (2): 16/71 kB | 274/782 kB Progress (2): 16/71 kB | 278/782 kB Progress (2): 16/71 kB | 295/782 kB Progress (2): 16/71 kB | 311/782 kB Progress (3): 16/71 kB | 311/782 kB | 1.4/35 kB Progress (3): 16/71 kB | 328/782 kB | 1.4/35 kB Progress (3): 16/71 kB | 328/782 kB | 2.8/35 kB Progress (3): 16/71 kB | 344/782 kB | 2.8/35 kB Progress (3): 16/71 kB | 344/782 kB | 4.1/35 kB Progress (3): 16/71 kB | 360/782 kB | 4.1/35 kB Progress (3): 16/71 kB | 360/782 kB | 5.5/35 kB Progress (3): 16/71 kB | 377/782 kB | 5.5/35 kB Progress (3): 16/71 kB | 377/782 kB | 6.9/35 kB Progress (3): 16/71 kB | 393/782 kB | 6.9/35 kB Progress (3): 16/71 kB | 393/782 kB | 8.3/35 kB Progress (3): 16/71 kB | 409/782 kB | 8.3/35 kB Progress (3): 16/71 kB | 409/782 kB | 9.7/35 kB Progress (3): 16/71 kB | 426/782 kB | 9.7/35 kB Progress (3): 16/71 kB | 426/782 kB | 11/35 kB Progress (3): 16/71 kB | 426/782 kB | 12/35 kB Progress (3): 33/71 kB | 426/782 kB | 12/35 kB Progress (3): 33/71 kB | 442/782 kB | 12/35 kB Progress (3): 33/71 kB | 442/782 kB | 14/35 kB Progress (3): 33/71 kB | 459/782 kB | 14/35 kB Progress (3): 33/71 kB | 459/782 kB | 15/35 kB Progress (3): 33/71 kB | 459/782 kB | 17/35 kB Progress (3): 33/71 kB | 475/782 kB | 17/35 kB Progress (3): 33/71 kB | 475/782 kB | 18/35 kB Progress (4): 33/71 kB | 475/782 kB | 18/35 kB | 1.4/49 kB Progress (4): 33/71 kB | 475/782 kB | 19/35 kB | 1.4/49 kB Progress (4): 33/71 kB | 491/782 kB | 19/35 kB | 1.4/49 kB Progress (4): 33/71 kB | 491/782 kB | 19/35 kB | 2.8/49 kB Progress (4): 33/71 kB | 491/782 kB | 21/35 kB | 2.8/49 kB Progress (4): 33/71 kB | 491/782 kB | 21/35 kB | 4.1/49 kB Progress (4): 33/71 kB | 508/782 kB | 21/35 kB | 4.1/49 kB Progress (4): 33/71 kB | 508/782 kB | 22/35 kB | 4.1/49 kB Progress (4): 33/71 kB | 508/782 kB | 22/35 kB | 5.5/49 kB Progress (4): 33/71 kB | 508/782 kB | 23/35 kB | 5.5/49 kB Progress (4): 33/71 kB | 508/782 kB | 23/35 kB | 6.9/49 kB Progress (4): 33/71 kB | 524/782 kB | 23/35 kB | 6.9/49 kB Progress (4): 33/71 kB | 524/782 kB | 25/35 kB | 6.9/49 kB Progress (4): 33/71 kB | 524/782 kB | 25/35 kB | 8.3/49 kB Progress (4): 33/71 kB | 524/782 kB | 26/35 kB | 8.3/49 kB Progress (4): 33/71 kB | 524/782 kB | 26/35 kB | 9.7/49 kB Progress (4): 33/71 kB | 524/782 kB | 28/35 kB | 9.7/49 kB Progress (4): 33/71 kB | 541/782 kB | 28/35 kB | 9.7/49 kB Progress (4): 33/71 kB | 541/782 kB | 28/35 kB | 11/49 kB Progress (4): 33/71 kB | 541/782 kB | 29/35 kB | 11/49 kB Progress (4): 33/71 kB | 541/782 kB | 29/35 kB | 12/49 kB Progress (4): 33/71 kB | 557/782 kB | 29/35 kB | 12/49 kB Progress (4): 33/71 kB | 557/782 kB | 30/35 kB | 12/49 kB Progress (4): 33/71 kB | 557/782 kB | 30/35 kB | 14/49 kB Progress (4): 33/71 kB | 557/782 kB | 32/35 kB | 14/49 kB Progress (4): 33/71 kB | 557/782 kB | 32/35 kB | 15/49 kB Progress (4): 33/71 kB | 573/782 kB | 32/35 kB | 15/49 kB Progress (4): 33/71 kB | 573/782 kB | 32/35 kB | 17/49 kB Progress (4): 33/71 kB | 573/782 kB | 33/35 kB | 17/49 kB Progress (4): 33/71 kB | 573/782 kB | 33/35 kB | 18/49 kB Progress (4): 33/71 kB | 590/782 kB | 33/35 kB | 18/49 kB Progress (4): 33/71 kB | 590/782 kB | 33/35 kB | 19/49 kB Progress (4): 33/71 kB | 590/782 kB | 34/35 kB | 19/49 kB Progress (4): 33/71 kB | 606/782 kB | 34/35 kB | 19/49 kB Progress (4): 33/71 kB | 606/782 kB | 34/35 kB | 21/49 kB Progress (4): 33/71 kB | 606/782 kB | 35 kB | 21/49 kB Progress (4): 33/71 kB | 622/782 kB | 35 kB | 21/49 kB Progress (4): 33/71 kB | 622/782 kB | 35 kB | 22/49 kB Progress (4): 33/71 kB | 622/782 kB | 35 kB | 23/49 kB Progress (4): 33/71 kB | 639/782 kB | 35 kB | 23/49 kB Progress (4): 33/71 kB | 639/782 kB | 35 kB | 25/49 kB Progress (4): 33/71 kB | 639/782 kB | 35 kB | 26/49 kB Progress (4): 33/71 kB | 655/782 kB | 35 kB | 26/49 kB Progress (4): 33/71 kB | 655/782 kB | 35 kB | 28/49 kB Progress (4): 33/71 kB | 655/782 kB | 35 kB | 29/49 kB Progress (4): 33/71 kB | 672/782 kB | 35 kB | 29/49 kB Progress (4): 49/71 kB | 672/782 kB | 35 kB | 29/49 kB Progress (4): 49/71 kB | 672/782 kB | 35 kB | 30/49 kB Progress (4): 49/71 kB | 688/782 kB | 35 kB | 30/49 kB Progress (4): 49/71 kB | 688/782 kB | 35 kB | 32/49 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 409 kB/s) 2024-09-19T13:56:07.279 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (3): 49/71 kB | 688/782 kB | 33/49 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-19T13:56:07.281 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (3): 49/71 kB | 704/782 kB | 33/49 kB Progress (3): 49/71 kB | 704/782 kB | 34/49 kB Progress (3): 49/71 kB | 704/782 kB | 36/49 kB Progress (3): 49/71 kB | 721/782 kB | 36/49 kB Progress (3): 49/71 kB | 721/782 kB | 37/49 kB Progress (3): 49/71 kB | 721/782 kB | 39/49 kB Progress (3): 49/71 kB | 737/782 kB | 39/49 kB Progress (3): 49/71 kB | 753/782 kB | 39/49 kB Progress (3): 49/71 kB | 770/782 kB | 39/49 kB Progress (3): 49/71 kB | 782 kB | 39/49 kB Progress (3): 66/71 kB | 782 kB | 39/49 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 9.1 MB/s) 2024-09-19T13:56:07.281 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-19T13:56:07.283 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 71 kB | 39/49 kB Progress (3): 71 kB | 39/49 kB | 1.4/11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 767 kB/s) 2024-09-19T13:56:07.283 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 39/49 kB | 2.8/11 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-19T13:56:07.287 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 39/49 kB | 4.1/11 kB Progress (2): 39/49 kB | 5.5/11 kB Progress (2): 39/49 kB | 6.9/11 kB Progress (2): 40/49 kB | 6.9/11 kB Progress (2): 41/49 kB | 6.9/11 kB Progress (2): 43/49 kB | 6.9/11 kB Progress (2): 44/49 kB | 6.9/11 kB Progress (2): 44/49 kB | 8.3/11 kB Progress (2): 46/49 kB | 8.3/11 kB Progress (2): 46/49 kB | 9.7/11 kB Progress (2): 47/49 kB | 9.7/11 kB Progress (2): 48/49 kB | 9.7/11 kB Progress (2): 49 kB | 9.7/11 kB Progress (2): 49 kB | 11/11 kB Progress (2): 49 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 124 kB/s) 2024-09-19T13:56:07.287 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-19T13:56:07.287 INFO:tasks.workunit.client.0.smithi153.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 524 kB/s) 2024-09-19T13:56:07.288 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-19T13:56:07.296 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/205 kB Progress (1): 33/205 kB Progress (2): 33/205 kB | 16/30 kB Progress (2): 33/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 296 kB/s) 2024-09-19T13:56:07.296 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-19T13:56:07.302 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 49/205 kB Progress (2): 49/205 kB | 15/81 kB Progress (2): 49/205 kB | 31/81 kB Progress (2): 49/205 kB | 48/81 kB Progress (2): 49/205 kB | 64/81 kB Progress (2): 49/205 kB | 81/81 kB Progress (2): 49/205 kB | 81 kB Progress (3): 49/205 kB | 81 kB | 1.4/798 kB Progress (3): 49/205 kB | 81 kB | 2.8/798 kB Progress (3): 49/205 kB | 81 kB | 4.1/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 759 kB/s) 2024-09-19T13:56:07.302 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-19T13:56:07.307 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 49/205 kB | 5.5/798 kB Progress (2): 49/205 kB | 6.9/798 kB Progress (2): 49/205 kB | 8.3/798 kB Progress (3): 49/205 kB | 8.3/798 kB | 1.4/13 kB Progress (3): 49/205 kB | 9.7/798 kB | 1.4/13 kB Progress (3): 49/205 kB | 9.7/798 kB | 2.8/13 kB Progress (3): 49/205 kB | 11/798 kB | 2.8/13 kB Progress (3): 49/205 kB | 12/798 kB | 2.8/13 kB Progress (3): 49/205 kB | 12/798 kB | 4.1/13 kB Progress (3): 49/205 kB | 12/798 kB | 5.5/13 kB Progress (3): 49/205 kB | 14/798 kB | 5.5/13 kB Progress (3): 49/205 kB | 15/798 kB | 5.5/13 kB Progress (3): 49/205 kB | 15/798 kB | 6.9/13 kB Progress (3): 49/205 kB | 16/798 kB | 6.9/13 kB Progress (3): 49/205 kB | 16/798 kB | 8.3/13 kB Progress (3): 49/205 kB | 16/798 kB | 9.7/13 kB Progress (3): 66/205 kB | 16/798 kB | 9.7/13 kB Progress (3): 66/205 kB | 16/798 kB | 11/13 kB Progress (3): 66/205 kB | 16/798 kB | 12/13 kB Progress (3): 66/205 kB | 16/798 kB | 13 kB Progress (3): 81/205 kB | 16/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 118 kB/s) 2024-09-19T13:56:07.307 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-19T13:56:07.314 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 98/205 kB | 16/798 kB Progress (2): 114/205 kB | 16/798 kB Progress (2): 114/205 kB | 33/798 kB Progress (2): 131/205 kB | 33/798 kB Progress (2): 147/205 kB | 33/798 kB Progress (2): 163/205 kB | 33/798 kB Progress (3): 163/205 kB | 33/798 kB | 16/182 kB Progress (3): 163/205 kB | 33/798 kB | 33/182 kB Progress (3): 180/205 kB | 33/798 kB | 33/182 kB Progress (3): 180/205 kB | 33/798 kB | 49/182 kB Progress (3): 180/205 kB | 33/798 kB | 63/182 kB Progress (3): 180/205 kB | 33/798 kB | 79/182 kB Progress (3): 180/205 kB | 33/798 kB | 96/182 kB Progress (3): 180/205 kB | 33/798 kB | 112/182 kB Progress (3): 180/205 kB | 33/798 kB | 128/182 kB Progress (3): 180/205 kB | 33/798 kB | 145/182 kB Progress (3): 180/205 kB | 33/798 kB | 161/182 kB Progress (3): 180/205 kB | 33/798 kB | 178/182 kB Progress (3): 180/205 kB | 33/798 kB | 182 kB Progress (3): 180/205 kB | 49/798 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.5 MB/s) 2024-09-19T13:56:07.314 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-19T13:56:07.319 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 180/205 kB | 62/798 kB Progress (3): 180/205 kB | 62/798 kB | 16/151 kB Progress (3): 180/205 kB | 62/798 kB | 33/151 kB Progress (3): 196/205 kB | 62/798 kB | 33/151 kB Progress (3): 196/205 kB | 62/798 kB | 49/151 kB Progress (3): 196/205 kB | 62/798 kB | 66/151 kB Progress (3): 205 kB | 62/798 kB | 66/151 kB Progress (3): 205 kB | 78/798 kB | 66/151 kB Progress (3): 205 kB | 78/798 kB | 82/151 kB Progress (3): 205 kB | 78/798 kB | 98/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 1.7 MB/s) 2024-09-19T13:56:07.319 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-19T13:56:07.321 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 78/798 kB | 111/151 kB Progress (2): 78/798 kB | 128/151 kB Progress (2): 78/798 kB | 144/151 kB Progress (2): 78/798 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.2 MB/s) 2024-09-19T13:56:07.321 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-19T13:56:07.328 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 95/798 kB Progress (1): 111/798 kB Progress (2): 111/798 kB | 8.2/27 kB Progress (2): 128/798 kB | 8.2/27 kB Progress (2): 128/798 kB | 25/27 kB Progress (2): 144/798 kB | 25/27 kB Progress (2): 144/798 kB | 27 kB Progress (2): 160/798 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 205 kB/s) 2024-09-19T13:56:07.328 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 160/798 kB | 16/30 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-19T13:56:07.329 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 160/798 kB | 30 kB Progress (2): 177/798 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 224 kB/s) 2024-09-19T13:56:07.329 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-19T13:56:07.336 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 193/798 kB Progress (1): 210/798 kB Progress (1): 226/798 kB Progress (1): 242/798 kB Progress (2): 242/798 kB | 16/385 kB Progress (2): 242/798 kB | 33/385 kB Progress (2): 242/798 kB | 49/385 kB Progress (2): 242/798 kB | 66/385 kB Progress (3): 242/798 kB | 66/385 kB | 13 kB Progress (3): 242/798 kB | 82/385 kB | 13 kB Progress (3): 242/798 kB | 96/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 94 kB/s) 2024-09-19T13:56:07.336 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-19T13:56:07.349 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 259/798 kB | 96/385 kB Progress (2): 259/798 kB | 113/385 kB Progress (2): 275/798 kB | 113/385 kB Progress (2): 275/798 kB | 129/385 kB Progress (2): 291/798 kB | 129/385 kB Progress (2): 291/798 kB | 145/385 kB Progress (2): 291/798 kB | 162/385 kB Progress (2): 291/798 kB | 178/385 kB Progress (2): 308/798 kB | 178/385 kB Progress (2): 308/798 kB | 194/385 kB Progress (2): 324/798 kB | 194/385 kB Progress (2): 324/798 kB | 211/385 kB Progress (2): 324/798 kB | 227/385 kB Progress (2): 324/798 kB | 244/385 kB Progress (2): 341/798 kB | 244/385 kB Progress (2): 341/798 kB | 260/385 kB Progress (2): 357/798 kB | 260/385 kB Progress (2): 373/798 kB | 260/385 kB Progress (2): 390/798 kB | 260/385 kB Progress (2): 406/798 kB | 260/385 kB Progress (2): 423/798 kB | 260/385 kB Progress (2): 439/798 kB | 260/385 kB Progress (2): 455/798 kB | 260/385 kB Progress (3): 455/798 kB | 260/385 kB | 16/780 kB Progress (3): 455/798 kB | 260/385 kB | 33/780 kB Progress (3): 455/798 kB | 260/385 kB | 49/780 kB Progress (3): 455/798 kB | 260/385 kB | 66/780 kB Progress (3): 472/798 kB | 260/385 kB | 66/780 kB Progress (3): 472/798 kB | 260/385 kB | 82/780 kB Progress (3): 488/798 kB | 260/385 kB | 82/780 kB Progress (3): 488/798 kB | 276/385 kB | 82/780 kB Progress (3): 488/798 kB | 276/385 kB | 98/780 kB Progress (3): 504/798 kB | 276/385 kB | 98/780 kB Progress (3): 504/798 kB | 293/385 kB | 98/780 kB Progress (3): 504/798 kB | 293/385 kB | 115/780 kB Progress (3): 521/798 kB | 293/385 kB | 115/780 kB Progress (4): 521/798 kB | 293/385 kB | 115/780 kB | 2.7/75 kB Progress (4): 537/798 kB | 293/385 kB | 115/780 kB | 2.7/75 kB Progress (4): 537/798 kB | 293/385 kB | 131/780 kB | 2.7/75 kB Progress (4): 537/798 kB | 309/385 kB | 131/780 kB | 2.7/75 kB Progress (4): 537/798 kB | 309/385 kB | 131/780 kB | 8.2/75 kB Progress (4): 537/798 kB | 309/385 kB | 147/780 kB | 8.2/75 kB Progress (4): 537/798 kB | 325/385 kB | 147/780 kB | 8.2/75 kB Progress (4): 537/798 kB | 325/385 kB | 147/780 kB | 14/75 kB Progress (4): 537/798 kB | 342/385 kB | 147/780 kB | 14/75 kB Progress (4): 537/798 kB | 342/385 kB | 164/780 kB | 14/75 kB Progress (4): 537/798 kB | 342/385 kB | 164/780 kB | 16/75 kB Progress (4): 537/798 kB | 358/385 kB | 164/780 kB | 16/75 kB Progress (4): 554/798 kB | 358/385 kB | 164/780 kB | 16/75 kB Progress (4): 554/798 kB | 358/385 kB | 180/780 kB | 16/75 kB Progress (4): 554/798 kB | 358/385 kB | 180/780 kB | 21/75 kB Progress (4): 554/798 kB | 375/385 kB | 180/780 kB | 21/75 kB Progress (4): 554/798 kB | 375/385 kB | 197/780 kB | 21/75 kB Progress (4): 554/798 kB | 375/385 kB | 197/780 kB | 22/75 kB Progress (4): 554/798 kB | 385 kB | 197/780 kB | 22/75 kB Progress (4): 570/798 kB | 385 kB | 197/780 kB | 22/75 kB Progress (4): 570/798 kB | 385 kB | 197/780 kB | 23/75 kB Progress (4): 570/798 kB | 385 kB | 213/780 kB | 23/75 kB Progress (4): 586/798 kB | 385 kB | 213/780 kB | 23/75 kB Progress (4): 603/798 kB | 385 kB | 213/780 kB | 23/75 kB Progress (4): 603/798 kB | 385 kB | 229/780 kB | 23/75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.5 MB/s) 2024-09-19T13:56:07.350 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-19T13:56:07.355 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (3): 619/798 kB | 229/780 kB | 23/75 kB Progress (3): 619/798 kB | 246/780 kB | 23/75 kB Progress (3): 619/798 kB | 246/780 kB | 40/75 kB Progress (3): 636/798 kB | 246/780 kB | 40/75 kB Progress (3): 636/798 kB | 256/780 kB | 40/75 kB Progress (3): 636/798 kB | 256/780 kB | 41/75 kB Progress (4): 636/798 kB | 256/780 kB | 41/75 kB | 16/329 kB Progress (4): 652/798 kB | 256/780 kB | 41/75 kB | 16/329 kB Progress (4): 652/798 kB | 272/780 kB | 41/75 kB | 16/329 kB Progress (4): 652/798 kB | 272/780 kB | 41/75 kB | 33/329 kB Progress (4): 668/798 kB | 272/780 kB | 41/75 kB | 33/329 kB Progress (4): 668/798 kB | 289/780 kB | 41/75 kB | 33/329 kB Progress (4): 668/798 kB | 289/780 kB | 41/75 kB | 49/329 kB Progress (4): 668/798 kB | 289/780 kB | 58/75 kB | 49/329 kB Progress (4): 668/798 kB | 305/780 kB | 58/75 kB | 49/329 kB Progress (4): 685/798 kB | 305/780 kB | 58/75 kB | 49/329 kB Progress (4): 685/798 kB | 305/780 kB | 58/75 kB | 49/329 kB Progress (4): 685/798 kB | 321/780 kB | 58/75 kB | 49/329 kB Progress (4): 685/798 kB | 321/780 kB | 58/75 kB | 66/329 kB Progress (4): 685/798 kB | 321/780 kB | 61/75 kB | 66/329 kB Progress (4): 685/798 kB | 338/780 kB | 61/75 kB | 66/329 kB Progress (4): 701/798 kB | 338/780 kB | 61/75 kB | 66/329 kB Progress (4): 701/798 kB | 354/780 kB | 61/75 kB | 66/329 kB Progress (4): 701/798 kB | 354/780 kB | 61/75 kB | 82/329 kB Progress (4): 717/798 kB | 354/780 kB | 61/75 kB | 82/329 kB Progress (4): 717/798 kB | 354/780 kB | 75 kB | 82/329 kB Progress (4): 717/798 kB | 370/780 kB | 75 kB | 82/329 kB Progress (4): 734/798 kB | 370/780 kB | 75 kB | 82/329 kB Progress (4): 734/798 kB | 370/780 kB | 75 kB | 98/329 kB Progress (4): 750/798 kB | 370/780 kB | 75 kB | 98/329 kB Progress (4): 750/798 kB | 387/780 kB | 75 kB | 98/329 kB Progress (4): 767/798 kB | 387/780 kB | 75 kB | 98/329 kB Progress (4): 767/798 kB | 403/780 kB | 75 kB | 98/329 kB Progress (4): 783/798 kB | 403/780 kB | 75 kB | 98/329 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 469 kB/s) 2024-09-19T13:56:07.356 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (3): 798 kB | 403/780 kB | 98/329 kB Progress (3): 798 kB | 403/780 kB | 115/329 kB Progress (3): 798 kB | 420/780 kB | 115/329 kB Progress (3): 798 kB | 436/780 kB | 115/329 kB Progress (3): 798 kB | 436/780 kB | 131/329 kB Progress (3): 798 kB | 452/780 kB | 131/329 kB Progress (3): 798 kB | 469/780 kB | 131/329 kB Progress (3): 798 kB | 469/780 kB | 147/329 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-19T13:56:07.357 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (3): 798 kB | 485/780 kB | 147/329 kB Progress (3): 798 kB | 485/780 kB | 164/329 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 4.9 MB/s) 2024-09-19T13:56:07.358 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 502/780 kB | 164/329 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-19T13:56:07.366 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 502/780 kB | 180/329 kB Progress (2): 518/780 kB | 180/329 kB Progress (2): 518/780 kB | 197/329 kB Progress (2): 534/780 kB | 197/329 kB Progress (2): 551/780 kB | 197/329 kB Progress (2): 551/780 kB | 213/329 kB Progress (2): 567/780 kB | 213/329 kB Progress (2): 567/780 kB | 229/329 kB Progress (2): 583/780 kB | 229/329 kB Progress (2): 583/780 kB | 246/329 kB Progress (2): 600/780 kB | 246/329 kB Progress (2): 600/780 kB | 256/329 kB Progress (2): 616/780 kB | 256/329 kB Progress (2): 633/780 kB | 256/329 kB Progress (2): 633/780 kB | 272/329 kB Progress (2): 649/780 kB | 272/329 kB Progress (2): 649/780 kB | 289/329 kB Progress (2): 665/780 kB | 289/329 kB Progress (2): 682/780 kB | 289/329 kB Progress (2): 682/780 kB | 305/329 kB Progress (2): 698/780 kB | 305/329 kB Progress (2): 698/780 kB | 321/329 kB Progress (2): 715/780 kB | 321/329 kB Progress (2): 715/780 kB | 329 kB Progress (3): 715/780 kB | 329 kB | 15/501 kB Progress (3): 731/780 kB | 329 kB | 15/501 kB Progress (3): 731/780 kB | 329 kB | 31/501 kB Progress (3): 747/780 kB | 329 kB | 31/501 kB Progress (3): 747/780 kB | 329 kB | 48/501 kB Progress (3): 764/780 kB | 329 kB | 48/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 1.9 MB/s) 2024-09-19T13:56:07.366 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-19T13:56:07.366 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 780/780 kB | 48/501 kB Progress (2): 780/780 kB | 64/501 kB Progress (2): 780 kB | 64/501 kB Progress (2): 780 kB | 79/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.6 MB/s) 2024-09-19T13:56:07.366 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-19T13:56:07.375 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 96/501 kB Progress (1): 112/501 kB Progress (1): 128/501 kB Progress (1): 145/501 kB Progress (1): 161/501 kB Progress (1): 177/501 kB Progress (1): 194/501 kB Progress (1): 210/501 kB Progress (1): 227/501 kB Progress (1): 243/501 kB Progress (1): 259/501 kB Progress (1): 276/501 kB Progress (1): 292/501 kB Progress (1): 309/501 kB Progress (1): 325/501 kB Progress (2): 325/501 kB | 16/354 kB Progress (2): 341/501 kB | 16/354 kB Progress (3): 341/501 kB | 16/354 kB | 16/41 kB Progress (3): 341/501 kB | 33/354 kB | 16/41 kB Progress (3): 358/501 kB | 33/354 kB | 16/41 kB Progress (3): 358/501 kB | 33/354 kB | 33/41 kB Progress (3): 358/501 kB | 33/354 kB | 41 kB Progress (3): 358/501 kB | 49/354 kB | 41 kB Progress (3): 374/501 kB | 49/354 kB | 41 kB Progress (3): 374/501 kB | 66/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 232 kB/s) 2024-09-19T13:56:07.376 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 390/501 kB | 66/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-19T13:56:07.378 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 390/501 kB | 82/354 kB Progress (2): 407/501 kB | 82/354 kB Progress (2): 407/501 kB | 98/354 kB Progress (2): 423/501 kB | 98/354 kB Progress (2): 423/501 kB | 115/354 kB Progress (2): 440/501 kB | 115/354 kB Progress (2): 440/501 kB | 131/354 kB Progress (2): 456/501 kB | 131/354 kB Progress (2): 456/501 kB | 147/354 kB Progress (2): 472/501 kB | 147/354 kB Progress (2): 472/501 kB | 164/354 kB Progress (2): 489/501 kB | 164/354 kB Progress (2): 489/501 kB | 180/354 kB Progress (2): 501 kB | 180/354 kB Progress (2): 501 kB | 197/354 kB Progress (2): 501 kB | 213/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.8 MB/s) 2024-09-19T13:56:07.378 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 229/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-19T13:56:07.403 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 246/354 kB Progress (1): 262/354 kB Progress (1): 279/354 kB Progress (1): 295/354 kB Progress (1): 311/354 kB Progress (1): 328/354 kB Progress (1): 344/354 kB Progress (1): 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 1.7 MB/s) 2024-09-19T13:56:07.403 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-19T13:56:07.403 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 16/211 kB | 14 kB Progress (3): 16/211 kB | 14 kB | 6.4 kB Progress (4): 16/211 kB | 14 kB | 6.4 kB | 16/586 kB Progress (4): 33/211 kB | 14 kB | 6.4 kB | 16/586 kB Progress (4): 33/211 kB | 14 kB | 6.4 kB | 33/586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 69 kB/s) 2024-09-19T13:56:07.404 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-19T13:56:07.405 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (3): 33/211 kB | 6.4 kB | 49/586 kB Progress (3): 33/211 kB | 6.4 kB | 66/586 kB Progress (3): 33/211 kB | 6.4 kB | 82/586 kB Progress (3): 33/211 kB | 6.4 kB | 98/586 kB Progress (3): 49/211 kB | 6.4 kB | 98/586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 31 kB/s) 2024-09-19T13:56:07.405 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 49/211 kB | 113/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-19T13:56:07.408 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 66/211 kB | 113/586 kB Progress (2): 66/211 kB | 130/586 kB Progress (2): 82/211 kB | 130/586 kB Progress (2): 98/211 kB | 130/586 kB Progress (2): 98/211 kB | 146/586 kB Progress (2): 114/211 kB | 146/586 kB Progress (2): 114/211 kB | 163/586 kB Progress (2): 131/211 kB | 163/586 kB Progress (2): 131/211 kB | 179/586 kB Progress (2): 147/211 kB | 179/586 kB Progress (2): 147/211 kB | 195/586 kB Progress (2): 164/211 kB | 195/586 kB Progress (2): 164/211 kB | 212/586 kB Progress (2): 180/211 kB | 212/586 kB Progress (2): 180/211 kB | 228/586 kB Progress (2): 196/211 kB | 228/586 kB Progress (2): 196/211 kB | 245/586 kB Progress (2): 211 kB | 245/586 kB Progress (2): 211 kB | 261/586 kB Progress (2): 211 kB | 277/586 kB Progress (2): 211 kB | 294/586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 995 kB/s) 2024-09-19T13:56:07.408 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-19T13:56:07.413 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 310/586 kB Progress (1): 326/586 kB Progress (1): 343/586 kB Progress (1): 359/586 kB Progress (1): 376/586 kB Progress (1): 392/586 kB Progress (1): 408/586 kB Progress (1): 425/586 kB Progress (1): 441/586 kB Progress (1): 458/586 kB Progress (1): 474/586 kB Progress (1): 490/586 kB Progress (1): 507/586 kB Progress (1): 523/586 kB Progress (1): 539/586 kB Progress (1): 556/586 kB Progress (1): 572/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 2.7 MB/s) 2024-09-19T13:56:07.414 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-19T13:56:07.418 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/106 kB Progress (2): 16/106 kB | 6.8 kB Progress (2): 33/106 kB | 6.8 kB Progress (2): 49/106 kB | 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 31 kB/s) 2024-09-19T13:56:07.418 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-19T13:56:07.419 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 66/106 kB Progress (1): 81/106 kB Progress (1): 98/106 kB Progress (1): 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 477 kB/s) 2024-09-19T13:56:07.420 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-19T13:56:07.425 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 62/245 kB Progress (1): 78/245 kB Progress (1): 95/245 kB Progress (1): 111/245 kB Progress (1): 127/245 kB Progress (2): 127/245 kB | 16/205 kB Progress (2): 144/245 kB | 16/205 kB Progress (2): 144/245 kB | 33/205 kB Progress (2): 160/245 kB | 33/205 kB Progress (2): 177/245 kB | 33/205 kB Progress (2): 177/245 kB | 49/205 kB Progress (2): 193/245 kB | 49/205 kB Progress (2): 193/245 kB | 65/205 kB Progress (2): 209/245 kB | 65/205 kB Progress (2): 226/245 kB | 65/205 kB Progress (2): 226/245 kB | 81/205 kB Progress (2): 242/245 kB | 81/205 kB Progress (2): 245 kB | 81/205 kB Progress (2): 245 kB | 98/205 kB Progress (2): 245 kB | 114/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.1 MB/s) 2024-09-19T13:56:07.425 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-19T13:56:07.427 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 130/205 kB Progress (1): 147/205 kB Progress (1): 163/205 kB Progress (1): 180/205 kB Progress (1): 196/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 887 kB/s) 2024-09-19T13:56:07.427 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-19T13:56:07.428 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 66 kB/s) 2024-09-19T13:56:07.428 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-19T13:56:07.434 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Progress (2): 16 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 69 kB/s) 2024-09-19T13:56:07.434 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-19T13:56:07.434 INFO:tasks.workunit.client.0.smithi153.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 27 kB/s) 2024-09-19T13:56:07.439 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 93 kB/s) 2024-09-19T13:56:07.441 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 2.5/24 kB Progress (1): 19/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 98 kB/s) 2024-09-19T13:56:07.442 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 70 kB/s) 2024-09-19T13:56:07.452 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 65/184 kB Progress (1): 82/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 131/184 kB Progress (1): 147/184 kB Progress (1): 164/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 718 kB/s) 2024-09-19T13:56:07.476 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] 2024-09-19T13:56:07.476 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-19T13:56:07.483 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-19T13:56:07.498 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 389 kB/s) 2024-09-19T13:56:07.501 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-19T13:56:07.516 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 340 kB/s) 2024-09-19T13:56:07.518 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-19T13:56:07.533 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.9 MB/s) 2024-09-19T13:56:07.538 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-19T13:56:07.554 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 891 kB/s) 2024-09-19T13:56:07.567 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-19T13:56:07.587 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 66/153 kB Progress (1): 82/153 kB Progress (1): 98/153 kB Progress (1): 115/153 kB Progress (1): 131/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 7.3 MB/s) 2024-09-19T13:56:07.587 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-19T13:56:07.605 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 64/215 kB Progress (1): 81/215 kB Progress (1): 97/215 kB Progress (1): 113/215 kB Progress (1): 130/215 kB Progress (1): 146/215 kB Progress (1): 162/215 kB Progress (1): 179/215 kB Progress (1): 195/215 kB Progress (1): 212/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 12 MB/s) 2024-09-19T13:56:07.704 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] 2024-09-19T13:56:07.704 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-19T13:56:07.710 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-19T13:56:07.724 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 177 kB/s) 2024-09-19T13:56:07.727 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-19T13:56:07.743 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.4 MB/s) 2024-09-19T13:56:07.748 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-19T13:56:07.764 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 548 kB/s) 2024-09-19T13:56:07.767 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-19T13:56:07.782 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.7 MB/s) 2024-09-19T13:56:07.787 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-19T13:56:07.802 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 402 kB/s) 2024-09-19T13:56:07.805 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-19T13:56:07.819 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 230 kB/s) 2024-09-19T13:56:07.824 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-19T13:56:07.839 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 41 kB/s) 2024-09-19T13:56:07.842 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-19T13:56:07.856 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-19T13:56:07.859 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-19T13:56:07.873 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.0 MB/s) 2024-09-19T13:56:07.877 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-19T13:56:07.892 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 214 kB/s) 2024-09-19T13:56:07.894 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-19T13:56:07.909 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 557 kB/s) 2024-09-19T13:56:07.911 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-19T13:56:07.926 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 558 kB/s) 2024-09-19T13:56:07.929 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-19T13:56:07.944 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 534 kB/s) 2024-09-19T13:56:07.948 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-19T13:56:07.963 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.3 MB/s) 2024-09-19T13:56:07.969 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-19T13:56:07.984 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 340 kB/s) 2024-09-19T13:56:07.988 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-19T13:56:08.002 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.0 MB/s) 2024-09-19T13:56:08.009 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-19T13:56:08.024 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 340 kB/s) 2024-09-19T13:56:08.030 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-19T13:56:08.047 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.0 MB/s) 2024-09-19T13:56:08.047 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-19T13:56:08.048 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-19T13:56:08.048 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-19T13:56:08.049 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-19T13:56:08.049 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-19T13:56:08.063 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 16/55 kB Progress (3): 2.5 kB | 16/55 kB | 16/41 kB Progress (3): 2.5 kB | 33/55 kB | 16/41 kB Progress (3): 2.5 kB | 33/55 kB | 33/41 kB Progress (3): 2.5 kB | 33/55 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 166 kB/s) 2024-09-19T13:56:08.064 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-19T13:56:08.064 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 49/55 kB | 41 kB Progress (3): 49/55 kB | 41 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.6 MB/s) 2024-09-19T13:56:08.065 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-19T13:56:08.065 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 55 kB | 8.5 kB Progress (3): 55 kB | 8.5 kB | 16/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 499 kB/s) 2024-09-19T13:56:08.066 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 55 kB | 33/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.1 MB/s) 2024-09-19T13:56:08.070 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 49/269 kB Progress (1): 66/269 kB Progress (1): 82/269 kB Progress (1): 98/269 kB Progress (1): 115/269 kB Progress (1): 131/269 kB Progress (1): 147/269 kB Progress (1): 164/269 kB Progress (1): 180/269 kB Progress (1): 197/269 kB Progress (1): 213/269 kB Progress (1): 229/269 kB Progress (1): 246/269 kB Progress (1): 256/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 12 MB/s) 2024-09-19T13:56:08.087 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/327 kB Progress (1): 33/327 kB Progress (1): 49/327 kB Progress (1): 66/327 kB Progress (1): 82/327 kB Progress (1): 98/327 kB Progress (2): 98/327 kB | 16/587 kB Progress (2): 115/327 kB | 16/587 kB Progress (2): 115/327 kB | 32/587 kB Progress (2): 131/327 kB | 32/587 kB Progress (2): 131/327 kB | 49/587 kB Progress (2): 147/327 kB | 49/587 kB Progress (2): 147/327 kB | 65/587 kB Progress (2): 147/327 kB | 79/587 kB Progress (2): 164/327 kB | 79/587 kB Progress (2): 164/327 kB | 95/587 kB Progress (2): 180/327 kB | 95/587 kB Progress (2): 180/327 kB | 112/587 kB Progress (2): 197/327 kB | 112/587 kB Progress (2): 197/327 kB | 128/587 kB Progress (2): 213/327 kB | 128/587 kB Progress (2): 213/327 kB | 145/587 kB Progress (2): 213/327 kB | 161/587 kB Progress (2): 229/327 kB | 161/587 kB Progress (2): 229/327 kB | 177/587 kB Progress (2): 246/327 kB | 177/587 kB Progress (2): 246/327 kB | 194/587 kB Progress (2): 262/327 kB | 194/587 kB Progress (2): 262/327 kB | 210/587 kB Progress (2): 262/327 kB | 226/587 kB Progress (2): 279/327 kB | 226/587 kB Progress (2): 279/327 kB | 243/587 kB Progress (2): 295/327 kB | 243/587 kB Progress (2): 295/327 kB | 259/587 kB Progress (2): 311/327 kB | 259/587 kB Progress (2): 311/327 kB | 276/587 kB Progress (2): 311/327 kB | 292/587 kB Progress (2): 327 kB | 292/587 kB Progress (2): 327 kB | 308/587 kB Progress (2): 327 kB | 325/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 8.6 MB/s) 2024-09-19T13:56:08.095 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 341/587 kB Progress (1): 357/587 kB Progress (1): 374/587 kB Progress (1): 390/587 kB Progress (1): 407/587 kB Progress (1): 423/587 kB Progress (1): 439/587 kB Progress (1): 456/587 kB Progress (1): 472/587 kB Progress (1): 489/587 kB Progress (1): 505/587 kB Progress (1): 521/587 kB Progress (1): 538/587 kB Progress (1): 554/587 kB Progress (1): 570/587 kB Progress (1): 587/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 13 MB/s) 2024-09-19T13:56:08.158 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-19T13:56:08.175 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] 2024-09-19T13:56:08.175 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-19T13:56:08.175 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-19T13:56:08.179 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 316 kB/s) 2024-09-19T13:56:08.181 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-19T13:56:08.196 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 424 kB/s) 2024-09-19T13:56:08.199 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-19T13:56:08.213 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/33 kB Progress (1): 32/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-19T13:56:08.216 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-19T13:56:08.229 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 1.1 MB/s) 2024-09-19T13:56:08.234 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-19T13:56:08.249 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 54 kB/s) 2024-09-19T13:56:08.253 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-19T13:56:08.268 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 283 kB/s) 2024-09-19T13:56:08.271 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-19T13:56:08.286 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-19T13:56:08.290 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-19T13:56:08.305 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 331 kB/s) 2024-09-19T13:56:08.308 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-19T13:56:08.322 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 296 kB/s) 2024-09-19T13:56:08.326 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-19T13:56:08.341 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 158 kB/s) 2024-09-19T13:56:08.345 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-19T13:56:08.359 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 753 kB/s) 2024-09-19T13:56:08.363 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-19T13:56:08.378 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-19T13:56:08.382 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-19T13:56:08.399 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 411 kB/s) 2024-09-19T13:56:08.401 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-19T13:56:08.415 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 70 kB/s) 2024-09-19T13:56:08.418 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-19T13:56:08.433 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 599 kB/s) 2024-09-19T13:56:08.435 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-19T13:56:08.450 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 179 kB/s) 2024-09-19T13:56:08.454 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-19T13:56:08.469 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 375 kB/s) 2024-09-19T13:56:08.472 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-19T13:56:08.487 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 76 kB/s) 2024-09-19T13:56:08.493 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-19T13:56:08.509 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 48 kB/s) 2024-09-19T13:56:08.512 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-19T13:56:08.528 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 377 kB/s) 2024-09-19T13:56:08.532 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-19T13:56:08.548 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.6 MB/s) 2024-09-19T13:56:08.553 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-19T13:56:08.568 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 80 kB/s) 2024-09-19T13:56:08.571 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-19T13:56:08.585 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 88 kB/s) 2024-09-19T13:56:08.594 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-19T13:56:08.609 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 903 kB/s) 2024-09-19T13:56:08.610 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-19T13:56:08.610 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-19T13:56:08.610 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-19T13:56:08.611 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-19T13:56:08.611 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-19T13:56:08.624 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 281 kB/s) 2024-09-19T13:56:08.624 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-19T13:56:08.628 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/55 kB Progress (2): 16/55 kB | 16/27 kB Progress (3): 16/55 kB | 16/27 kB | 16/122 kB Progress (3): 16/55 kB | 27 kB | 16/122 kB Progress (3): 33/55 kB | 27 kB | 16/122 kB Progress (4): 33/55 kB | 27 kB | 16/122 kB | 16/334 kB Progress (4): 33/55 kB | 27 kB | 32/122 kB | 16/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.8 MB/s) 2024-09-19T13:56:08.628 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-19T13:56:08.628 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (3): 49/55 kB | 32/122 kB | 16/334 kB Progress (3): 49/55 kB | 32/122 kB | 33/334 kB Progress (3): 55 kB | 32/122 kB | 33/334 kB Progress (3): 55 kB | 49/122 kB | 33/334 kB Progress (3): 55 kB | 49/122 kB | 49/334 kB Progress (3): 55 kB | 49/122 kB | 66/334 kB Progress (3): 55 kB | 65/122 kB | 66/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.2 MB/s) 2024-09-19T13:56:08.628 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-19T13:56:08.629 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 65/122 kB | 82/334 kB Progress (2): 81/122 kB | 82/334 kB Progress (2): 81/122 kB | 98/334 kB Progress (2): 81/122 kB | 115/334 kB Progress (2): 98/122 kB | 115/334 kB Progress (2): 98/122 kB | 131/334 kB Progress (2): 114/122 kB | 131/334 kB Progress (2): 122 kB | 131/334 kB Progress (2): 122 kB | 147/334 kB Progress (2): 122 kB | 164/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 6.4 MB/s) 2024-09-19T13:56:08.633 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 180/334 kB Progress (1): 197/334 kB Progress (1): 213/334 kB Progress (1): 229/334 kB Progress (1): 246/334 kB Progress (1): 256/334 kB Progress (1): 272/334 kB Progress (1): 289/334 kB Progress (1): 305/334 kB Progress (1): 321/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 15 MB/s) 2024-09-19T13:56:08.640 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/267 kB Progress (1): 33/267 kB Progress (2): 33/267 kB | 4.7 kB Progress (2): 49/267 kB | 4.7 kB Progress (2): 66/267 kB | 4.7 kB Progress (2): 82/267 kB | 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 161 kB/s) 2024-09-19T13:56:08.641 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 98/267 kB Progress (1): 115/267 kB Progress (1): 131/267 kB Progress (1): 147/267 kB Progress (2): 147/267 kB | 16/23 kB Progress (2): 164/267 kB | 16/23 kB Progress (2): 164/267 kB | 23 kB Progress (2): 180/267 kB | 23 kB Progress (2): 197/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 735 kB/s) 2024-09-19T13:56:08.642 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.4 MB/s) 2024-09-19T13:56:09.036 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-19T13:56:09.038 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-19T13:56:10.201 INFO:tasks.workunit.client.0.smithi153.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-19T13:56:10.201 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] 2024-09-19T13:56:10.201 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-19T13:56:10.204 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-19T13:56:10.204 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] 2024-09-19T13:56:10.204 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-19T13:56:10.209 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-19T13:56:10.209 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-19T13:56:10.377 INFO:tasks.workunit.client.0.smithi153.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-19T13:56:10.377 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] 2024-09-19T13:56:10.378 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-19T13:56:10.382 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-19T13:56:10.397 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 416 kB/s) 2024-09-19T13:56:10.401 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-19T13:56:10.416 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 235 kB/s) 2024-09-19T13:56:10.419 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-19T13:56:10.434 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 217 kB/s) 2024-09-19T13:56:10.438 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-19T13:56:10.452 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 290 kB/s) 2024-09-19T13:56:10.456 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-19T13:56:10.471 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 220 kB/s) 2024-09-19T13:56:10.475 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-19T13:56:10.489 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 297 kB/s) 2024-09-19T13:56:10.493 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-19T13:56:10.507 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 126 kB/s) 2024-09-19T13:56:10.511 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-19T13:56:10.525 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 157 kB/s) 2024-09-19T13:56:10.527 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-19T13:56:10.541 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.0 MB/s) 2024-09-19T13:56:10.544 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-19T13:56:10.558 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 135 kB/s) 2024-09-19T13:56:10.561 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-19T13:56:10.574 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-19T13:56:10.578 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-19T13:56:10.591 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 181 kB/s) 2024-09-19T13:56:10.593 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-19T13:56:10.607 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.6 MB/s) 2024-09-19T13:56:10.610 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-19T13:56:10.624 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/37 kB Progress (1): 32/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.7 MB/s) 2024-09-19T13:56:10.629 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-19T13:56:10.640 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.1 MB/s) 2024-09-19T13:56:10.644 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-19T13:56:10.658 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-19T13:56:10.661 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-19T13:56:10.676 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 15/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.7 MB/s) 2024-09-19T13:56:10.679 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-19T13:56:10.693 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 576 kB/s) 2024-09-19T13:56:10.696 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-19T13:56:10.710 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 155 kB/s) 2024-09-19T13:56:10.713 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-19T13:56:10.726 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 200 kB/s) 2024-09-19T13:56:10.729 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-19T13:56:10.743 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 110 kB/s) 2024-09-19T13:56:10.744 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-19T13:56:10.758 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-19T13:56:10.759 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-19T13:56:10.773 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.5 MB/s) 2024-09-19T13:56:10.774 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-19T13:56:10.788 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 483 kB/s) 2024-09-19T13:56:10.790 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-19T13:56:10.803 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 1.0 MB/s) 2024-09-19T13:56:10.807 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-19T13:56:10.823 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 174 kB/s) 2024-09-19T13:56:10.825 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-19T13:56:10.839 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 486 kB/s) 2024-09-19T13:56:10.841 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-19T13:56:10.855 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 600 kB/s) 2024-09-19T13:56:10.858 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-19T13:56:10.873 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 138 kB/s) 2024-09-19T13:56:10.876 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-19T13:56:10.890 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 159 kB/s) 2024-09-19T13:56:10.894 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-19T13:56:10.909 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 216 kB/s) 2024-09-19T13:56:10.914 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-19T13:56:10.929 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 998 kB/s) 2024-09-19T13:56:10.932 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-19T13:56:10.946 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 967 kB/s) 2024-09-19T13:56:10.951 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-19T13:56:10.965 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 895 kB/s) 2024-09-19T13:56:10.968 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-19T13:56:10.982 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 342 kB/s) 2024-09-19T13:56:10.986 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-19T13:56:11.000 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 448 kB/s) 2024-09-19T13:56:11.003 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-19T13:56:11.018 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.2 MB/s) 2024-09-19T13:56:11.023 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-19T13:56:11.038 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-19T13:56:11.041 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-19T13:56:11.056 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 987 kB/s) 2024-09-19T13:56:11.061 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-19T13:56:11.076 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 54 kB/s) 2024-09-19T13:56:11.078 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-19T13:56:11.093 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 320 kB/s) 2024-09-19T13:56:11.098 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-19T13:56:11.114 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 494 kB/s) 2024-09-19T13:56:11.119 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-19T13:56:11.134 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 200 kB/s) 2024-09-19T13:56:11.142 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-19T13:56:11.157 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 266 kB/s) 2024-09-19T13:56:11.164 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-19T13:56:11.179 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 137 kB/s) 2024-09-19T13:56:11.185 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-19T13:56:11.200 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 217 kB/s) 2024-09-19T13:56:11.206 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-19T13:56:11.221 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 729 kB/s) 2024-09-19T13:56:11.225 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-19T13:56:11.240 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 898 kB/s) 2024-09-19T13:56:11.244 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-19T13:56:11.259 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.2 MB/s) 2024-09-19T13:56:11.265 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-19T13:56:11.280 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 26 kB/s) 2024-09-19T13:56:11.283 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-19T13:56:11.298 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 407 kB/s) 2024-09-19T13:56:11.302 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-19T13:56:11.318 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 458 kB/s) 2024-09-19T13:56:11.322 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-19T13:56:11.337 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 322 kB/s) 2024-09-19T13:56:11.342 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-19T13:56:11.357 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 487 kB/s) 2024-09-19T13:56:11.365 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-19T13:56:11.381 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.4 MB/s) 2024-09-19T13:56:11.385 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-19T13:56:11.403 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.3 MB/s) 2024-09-19T13:56:11.416 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-19T13:56:11.432 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.5 MB/s) 2024-09-19T13:56:11.442 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-19T13:56:11.458 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 353 kB/s) 2024-09-19T13:56:11.465 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-19T13:56:11.481 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 267 kB/s) 2024-09-19T13:56:11.484 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-19T13:56:11.499 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 213 kB/s) 2024-09-19T13:56:11.502 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-19T13:56:11.518 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.7 MB/s) 2024-09-19T13:56:11.524 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-19T13:56:11.539 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 158 kB/s) 2024-09-19T13:56:11.558 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-19T13:56:11.589 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 9.6 MB/s) 2024-09-19T13:56:11.589 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-19T13:56:11.590 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-19T13:56:11.590 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-19T13:56:11.591 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-19T13:56:11.591 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-19T13:56:11.607 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/171 kB Progress (2): 16/171 kB | 14 kB Progress (2): 32/171 kB | 14 kB Progress (3): 32/171 kB | 14 kB | 16/26 kB Progress (4): 32/171 kB | 14 kB | 16/26 kB | 8.2 kB Progress (4): 32/171 kB | 14 kB | 26 kB | 8.2 kB Progress (4): 49/171 kB | 14 kB | 26 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 799 kB/s) 2024-09-19T13:56:11.607 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-19T13:56:11.607 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (3): 65/171 kB | 26 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 481 kB/s) 2024-09-19T13:56:11.607 INFO:tasks.workunit.client.0.smithi153.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.5 MB/s) 2024-09-19T13:56:11.608 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-19T13:56:11.608 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-19T13:56:11.610 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 65/171 kB | 16/118 kB Progress (2): 81/171 kB | 16/118 kB Progress (2): 98/171 kB | 16/118 kB Progress (2): 98/171 kB | 33/118 kB Progress (2): 114/171 kB | 33/118 kB Progress (2): 114/171 kB | 49/118 kB Progress (2): 130/171 kB | 49/118 kB Progress (2): 147/171 kB | 49/118 kB Progress (2): 147/171 kB | 64/118 kB Progress (2): 163/171 kB | 64/118 kB Progress (2): 171 kB | 64/118 kB Progress (2): 171 kB | 80/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 8.1 MB/s) 2024-09-19T13:56:11.610 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-19T13:56:11.612 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 97/118 kB Progress (1): 113/118 kB Progress (1): 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 5.3 MB/s) 2024-09-19T13:56:11.612 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-19T13:56:11.623 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/61 kB Progress (1): 33/61 kB Progress (2): 33/61 kB | 16/146 kB Progress (2): 49/61 kB | 16/146 kB Progress (2): 49/61 kB | 32/146 kB Progress (2): 61 kB | 32/146 kB Progress (2): 61 kB | 49/146 kB Progress (3): 61 kB | 49/146 kB | 16/136 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.9 MB/s) 2024-09-19T13:56:11.623 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-19T13:56:11.626 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 65/146 kB | 16/136 kB Progress (2): 65/146 kB | 33/136 kB Progress (2): 81/146 kB | 33/136 kB Progress (2): 81/146 kB | 49/136 kB Progress (2): 98/146 kB | 49/136 kB Progress (2): 98/146 kB | 66/136 kB Progress (2): 114/146 kB | 66/136 kB Progress (3): 114/146 kB | 66/136 kB | 16/501 kB Progress (3): 130/146 kB | 66/136 kB | 16/501 kB Progress (3): 130/146 kB | 82/136 kB | 16/501 kB Progress (3): 146 kB | 82/136 kB | 16/501 kB Progress (3): 146 kB | 82/136 kB | 33/501 kB Progress (3): 146 kB | 98/136 kB | 33/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.3 MB/s) 2024-09-19T13:56:11.626 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 98/136 kB | 49/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-19T13:56:11.627 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 115/136 kB | 49/501 kB Progress (2): 115/136 kB | 65/501 kB Progress (2): 131/136 kB | 65/501 kB Progress (2): 136 kB | 65/501 kB Progress (2): 136 kB | 82/501 kB Progress (3): 136 kB | 82/501 kB | 15/58 kB Progress (3): 136 kB | 98/501 kB | 15/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.8 MB/s) 2024-09-19T13:56:11.629 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 114/501 kB | 15/58 kB Progress (2): 114/501 kB | 31/58 kB Progress (2): 131/501 kB | 31/58 kB Progress (2): 147/501 kB | 31/58 kB Progress (2): 147/501 kB | 48/58 kB Progress (2): 164/501 kB | 48/58 kB Progress (2): 164/501 kB | 58 kB Progress (2): 180/501 kB | 58 kB Progress (2): 196/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.5 MB/s) 2024-09-19T13:56:11.636 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 213/501 kB Progress (1): 229/501 kB Progress (1): 246/501 kB Progress (1): 262/501 kB Progress (1): 278/501 kB Progress (1): 295/501 kB Progress (1): 311/501 kB Progress (1): 327/501 kB Progress (1): 344/501 kB Progress (1): 360/501 kB Progress (1): 377/501 kB Progress (1): 393/501 kB Progress (1): 409/501 kB Progress (1): 426/501 kB Progress (1): 442/501 kB Progress (1): 459/501 kB Progress (1): 475/501 kB Progress (1): 491/501 kB Progress (1): 501 kB Progress (2): 501 kB | 16/124 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 11 MB/s) 2024-09-19T13:56:11.638 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (1): 115/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.6 MB/s) 2024-09-19T13:56:11.682 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 27 MB/s) 2024-09-19T13:56:11.778 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] 2024-09-19T13:56:11.779 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-19T13:56:11.783 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-19T13:56:11.798 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 299 kB/s) 2024-09-19T13:56:11.800 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-19T13:56:11.814 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 350 kB/s) 2024-09-19T13:56:11.816 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-19T13:56:11.830 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.2 MB/s) 2024-09-19T13:56:11.834 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-19T13:56:11.849 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.4 MB/s) 2024-09-19T13:56:11.853 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-19T13:56:11.867 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 370 kB/s) 2024-09-19T13:56:11.869 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-19T13:56:11.884 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 261 kB/s) 2024-09-19T13:56:11.887 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-19T13:56:11.902 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 401 kB/s) 2024-09-19T13:56:11.906 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-19T13:56:11.921 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 417 kB/s) 2024-09-19T13:56:11.924 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-19T13:56:11.938 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-19T13:56:11.943 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-19T13:56:11.959 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 909 kB/s) 2024-09-19T13:56:11.964 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-19T13:56:11.978 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 136 kB/s) 2024-09-19T13:56:11.982 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-19T13:56:11.997 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 587 kB/s) 2024-09-19T13:56:12.000 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-19T13:56:12.014 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.7 MB/s) 2024-09-19T13:56:12.023 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-19T13:56:12.038 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.4 MB/s) 2024-09-19T13:56:12.039 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-19T13:56:12.039 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-19T13:56:12.040 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-19T13:56:12.040 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-19T13:56:12.040 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-19T13:56:12.059 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 0/1.0 MB Progress (2): 0/1.0 MB | 16/58 kB Progress (2): 0/1.0 MB | 16/58 kB Progress (3): 0/1.0 MB | 16/58 kB | 16/79 kB Progress (4): 0/1.0 MB | 16/58 kB | 16/79 kB | 16/26 kB Progress (4): 0/1.0 MB | 33/58 kB | 16/79 kB | 16/26 kB Progress (4): 0/1.0 MB | 33/58 kB | 16/79 kB | 16/26 kB Progress (5): 0/1.0 MB | 33/58 kB | 16/79 kB | 16/26 kB | 15/211 kB Progress (5): 0/1.0 MB | 33/58 kB | 16/79 kB | 26 kB | 15/211 kB Progress (5): 0/1.0 MB | 33/58 kB | 33/79 kB | 26 kB | 15/211 kB Progress (5): 0.1/1.0 MB | 33/58 kB | 33/79 kB | 26 kB | 15/211 kB Progress (5): 0.1/1.0 MB | 49/58 kB | 33/79 kB | 26 kB | 15/211 kB Progress (5): 0.1/1.0 MB | 49/58 kB | 33/79 kB | 26 kB | 31/211 kB Progress (5): 0.1/1.0 MB | 49/58 kB | 33/79 kB | 26 kB | 31/211 kB Progress (5): 0.1/1.0 MB | 49/58 kB | 49/79 kB | 26 kB | 31/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.5 MB/s) 2024-09-19T13:56:12.059 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (4): 0.1/1.0 MB | 58 kB | 49/79 kB | 31/211 kB Progress (4): 0.1/1.0 MB | 58 kB | 49/79 kB | 48/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-19T13:56:12.059 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (4): 0.1/1.0 MB | 58 kB | 49/79 kB | 48/211 kB Progress (4): 0.1/1.0 MB | 58 kB | 63/79 kB | 48/211 kB Progress (4): 0.1/1.0 MB | 58 kB | 63/79 kB | 48/211 kB Progress (4): 0.1/1.0 MB | 58 kB | 63/79 kB | 64/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.4 MB/s) 2024-09-19T13:56:12.059 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (3): 0.1/1.0 MB | 63/79 kB | 64/211 kB Progress (3): 0.1/1.0 MB | 79 kB | 64/211 kB Progress (3): 0.1/1.0 MB | 79 kB | 79/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-19T13:56:12.060 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (3): 0.1/1.0 MB | 79 kB | 79/211 kB Progress (3): 0.2/1.0 MB | 79 kB | 79/211 kB Progress (3): 0.2/1.0 MB | 79 kB | 95/211 kB Progress (3): 0.2/1.0 MB | 79 kB | 95/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.2 MB/s) 2024-09-19T13:56:12.060 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 0.2/1.0 MB | 112/211 kB Progress (2): 0.2/1.0 MB | 112/211 kB Progress (2): 0.2/1.0 MB | 112/211 kB Progress (2): 0.2/1.0 MB | 128/211 kB Progress (2): 0.2/1.0 MB | 128/211 kB Progress (2): 0.2/1.0 MB | 145/211 kB Progress (2): 0.2/1.0 MB | 145/211 kB Progress (2): 0.2/1.0 MB | 161/211 kB Progress (2): 0.3/1.0 MB | 161/211 kB Progress (2): 0.3/1.0 MB | 177/211 kB Progress (2): 0.3/1.0 MB | 177/211 kB Progress (2): 0.3/1.0 MB | 194/211 kB Progress (2): 0.3/1.0 MB | 194/211 kB Progress (2): 0.3/1.0 MB | 194/211 kB Progress (2): 0.3/1.0 MB | 210/211 kB Progress (2): 0.3/1.0 MB | 211 kB Progress (2): 0.3/1.0 MB | 211 kB Progress (2): 0.3/1.0 MB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 10 MB/s) 2024-09-19T13:56:12.071 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 1.0/1.0 MB Progress (2): 1.0/1.0 MB | 16/116 kB Progress (2): 1.0/1.0 MB | 16/116 kB Progress (2): 1.0/1.0 MB | 32/116 kB Progress (2): 1.0/1.0 MB | 32/116 kB Progress (2): 1.0/1.0 MB | 49/116 kB Progress (2): 1.0/1.0 MB | 49/116 kB Progress (2): 1.0 MB | 49/116 kB Progress (2): 1.0 MB | 65/116 kB Progress (3): 1.0 MB | 65/116 kB | 16/267 kB Progress (3): 1.0 MB | 81/116 kB | 16/267 kB Progress (3): 1.0 MB | 81/116 kB | 33/267 kB Progress (3): 1.0 MB | 98/116 kB | 33/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 32 MB/s) 2024-09-19T13:56:12.072 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 114/116 kB | 33/267 kB Progress (2): 114/116 kB | 49/267 kB Progress (2): 116 kB | 49/267 kB Progress (2): 116 kB | 62/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.5 MB/s) 2024-09-19T13:56:12.075 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 78/267 kB Progress (1): 95/267 kB Progress (1): 111/267 kB Progress (1): 128/267 kB Progress (1): 144/267 kB Progress (1): 160/267 kB Progress (1): 177/267 kB Progress (1): 193/267 kB Progress (1): 209/267 kB Progress (1): 226/267 kB Progress (1): 242/267 kB Progress (1): 259/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.4 MB/s) 2024-09-19T13:56:12.251 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-19T13:56:12.280 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-19T13:56:12.280 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] BUILD SUCCESS 2024-09-19T13:56:12.280 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-19T13:56:12.281 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] Total time: 7.759 s 2024-09-19T13:56:12.281 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] Finished at: 2024-09-19T13:56:12Z 2024-09-19T13:56:12.281 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-19T13:56:12.312 INFO:tasks.workunit.client.0.smithi153.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-19T13:56:12.317 INFO:tasks.workunit.client.0.smithi153.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-19T13:56:13.581 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] Scanning for projects... 2024-09-19T13:56:13.663 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] 2024-09-19T13:56:13.664 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-19T13:56:13.664 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] Building jcksum 1.0 2024-09-19T13:56:13.664 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] from pom.xml 2024-09-19T13:56:13.664 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-19T13:56:13.956 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] 2024-09-19T13:56:13.956 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-19T13:56:14.115 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-19T13:56:14.116 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] 2024-09-19T13:56:14.116 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-19T13:56:14.213 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-19T13:56:14.214 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] 2024-09-19T13:56:14.214 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-19T13:56:14.216 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-19T13:56:14.216 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] 2024-09-19T13:56:14.216 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-19T13:56:14.221 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-19T13:56:14.221 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] 2024-09-19T13:56:14.221 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-19T13:56:14.414 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-19T13:56:14.642 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-19T13:56:14.842 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 23 kB/s) 2024-09-19T13:56:14.851 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-19T13:56:14.868 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 154 kB/s) 2024-09-19T13:56:14.874 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-19T13:56:14.891 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 166 kB/s) 2024-09-19T13:56:14.895 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-19T13:56:14.912 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 178 kB/s) 2024-09-19T13:56:14.914 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-19T13:56:14.930 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 200 kB/s) 2024-09-19T13:56:14.933 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-19T13:56:14.952 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 105 kB/s) 2024-09-19T13:56:14.952 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-19T13:56:14.967 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 177 kB/s) 2024-09-19T13:56:14.973 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-19T13:56:14.994 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.2 MB/s) 2024-09-19T13:56:14.995 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-19T13:56:14.996 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-19T13:56:14.997 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-19T13:56:14.997 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-19T13:56:14.997 INFO:tasks.workunit.client.0.smithi153.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-19T13:56:15.015 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 836 kB/s) 2024-09-19T13:56:15.053 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 1.4/7.7 kB Progress (1): 2.8/7.7 kB Progress (2): 2.8/7.7 kB | 1.4/189 kB Progress (2): 4.1/7.7 kB | 1.4/189 kB Progress (2): 4.1/7.7 kB | 2.8/189 kB Progress (2): 5.5/7.7 kB | 2.8/189 kB Progress (3): 5.5/7.7 kB | 2.8/189 kB | 16/103 kB Progress (3): 6.9/7.7 kB | 2.8/189 kB | 16/103 kB Progress (3): 6.9/7.7 kB | 4.1/189 kB | 16/103 kB Progress (3): 7.7 kB | 4.1/189 kB | 16/103 kB Progress (4): 7.7 kB | 4.1/189 kB | 16/103 kB | 16/169 kB Progress (4): 7.7 kB | 5.5/189 kB | 16/103 kB | 16/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 134 kB/s) 2024-09-19T13:56:15.078 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (3): 5.5/189 kB | 33/103 kB | 16/169 kB Progress (3): 6.9/189 kB | 33/103 kB | 16/169 kB Progress (3): 8.3/189 kB | 33/103 kB | 16/169 kB Progress (3): 8.3/189 kB | 33/103 kB | 33/169 kB Progress (3): 9.7/189 kB | 33/103 kB | 33/169 kB Progress (3): 11/189 kB | 33/103 kB | 33/169 kB Progress (3): 12/189 kB | 33/103 kB | 33/169 kB Progress (3): 14/189 kB | 33/103 kB | 33/169 kB Progress (3): 15/189 kB | 33/103 kB | 33/169 kB Progress (3): 16/189 kB | 33/103 kB | 33/169 kB Progress (3): 16/189 kB | 49/103 kB | 33/169 kB Progress (3): 32/189 kB | 49/103 kB | 33/169 kB Progress (3): 32/189 kB | 49/103 kB | 49/169 kB Progress (3): 32/189 kB | 66/103 kB | 49/169 kB Progress (3): 49/189 kB | 66/103 kB | 49/169 kB Progress (3): 49/189 kB | 66/103 kB | 66/169 kB Progress (3): 49/189 kB | 82/103 kB | 66/169 kB Progress (3): 49/189 kB | 82/103 kB | 82/169 kB Progress (3): 65/189 kB | 82/103 kB | 82/169 kB Progress (3): 65/189 kB | 98/103 kB | 82/169 kB Progress (3): 81/189 kB | 98/103 kB | 82/169 kB Progress (3): 81/189 kB | 103 kB | 82/169 kB Progress (3): 81/189 kB | 103 kB | 98/169 kB Progress (3): 98/189 kB | 103 kB | 98/169 kB Progress (3): 114/189 kB | 103 kB | 98/169 kB Progress (3): 114/189 kB | 103 kB | 115/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.3 MB/s) 2024-09-19T13:56:15.082 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (2): 114/189 kB | 131/169 kB Progress (2): 114/189 kB | 147/169 kB Progress (2): 114/189 kB | 164/169 kB Progress (2): 114/189 kB | 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.9 MB/s) 2024-09-19T13:56:15.089 INFO:tasks.workunit.client.0.smithi153.stdout:Progress (1): 130/189 kB Progress (1): 147/189 kB Progress (1): 163/189 kB Progress (1): 180/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.0 MB/s) 2024-09-19T13:56:15.105 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] 2024-09-19T13:56:15.105 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] ------------------------------------------------------- 2024-09-19T13:56:15.105 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] T E S T S 2024-09-19T13:56:15.106 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] ------------------------------------------------------- 2024-09-19T13:56:15.682 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-19T13:56:15.762 INFO:tasks.workunit.client.0.smithi153.stdout:PutObjects.java: starting test run: 2024-09-19T13:56:15.762 INFO:tasks.workunit.client.0.smithi153.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-19T13:56:15.762 INFO:tasks.workunit.client.0.smithi153.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-19T13:56:15.762 INFO:tasks.workunit.client.0.smithi153.stdout: EndpointUrl=https://smithi153.front.sepia.ceph.com:443 2024-09-19T13:56:15.763 INFO:tasks.workunit.client.0.smithi153.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-19T13:56:15.958 INFO:tasks.workunit.client.0.smithi153.stdout:DEBUG: Environment Variables Read 2024-09-19T13:56:16.359 INFO:tasks.workunit.client.0.smithi153.stdout:DEBUG: S3 Client Initialized 2024-09-19T13:56:16.359 INFO:tasks.workunit.client.0.smithi153.stdout:DEBUG: Generating File 2024-09-19T13:56:16.360 INFO:tasks.workunit.client.0.smithi153.stdout:DEBUG: File Generated 2024-09-19T13:56:16.360 INFO:tasks.workunit.client.0.smithi153.stdout:DEBUG: Generating File 2024-09-19T13:56:16.360 INFO:tasks.workunit.client.0.smithi153.stdout:DEBUG: File Generated 2024-09-19T13:56:16.360 INFO:tasks.workunit.client.0.smithi153.stdout:DEBUG: Generating File 2024-09-19T13:56:16.460 INFO:tasks.workunit.client.0.smithi153.stdout:DEBUG: File Generated 2024-09-19T13:56:16.460 INFO:tasks.workunit.client.0.smithi153.stdout:DEBUG: Generating File 2024-09-19T13:56:16.460 INFO:tasks.workunit.client.0.smithi153.stdout:DEBUG: File Generated 2024-09-19T13:56:16.460 INFO:tasks.workunit.client.0.smithi153.stdout:DEBUG: Generating File 2024-09-19T13:56:16.460 INFO:tasks.workunit.client.0.smithi153.stdout:DEBUG: File Generated 2024-09-19T13:56:16.460 INFO:tasks.workunit.client.0.smithi153.stdout:DEBUG: Generating File 2024-09-19T13:56:16.461 INFO:tasks.workunit.client.0.smithi153.stdout:DEBUG: File Generated 2024-09-19T13:56:16.461 INFO:tasks.workunit.client.0.smithi153.stdout:DEBUG: Generated Big Files 2024-09-19T13:56:17.161 INFO:tasks.workunit.client.0.smithi153.stdout:HeadBucketResponse() 2024-09-19T13:56:17.161 INFO:tasks.workunit.client.0.smithi153.stdout:sheik is ready 2024-09-19T13:56:17.161 INFO:tasks.workunit.client.0.smithi153.stdout:DEBUG: Test Bucket Created 2024-09-19T13:56:17.261 INFO:tasks.workunit.client.0.smithi153.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-19T13:56:17.662 INFO:tasks.workunit.client.0.smithi153.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-19T13:56:17.963 INFO:tasks.workunit.client.0.smithi153.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-19T13:56:18.264 INFO:tasks.workunit.client.0.smithi153.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-19T13:56:18.765 INFO:tasks.workunit.client.0.smithi153.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-19T13:56:18.965 INFO:tasks.workunit.client.0.smithi153.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-19T13:56:19.567 INFO:tasks.workunit.client.0.smithi153.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-19T13:56:20.068 INFO:tasks.workunit.client.0.smithi153.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-19T13:56:20.970 INFO:tasks.workunit.client.0.smithi153.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-19T13:56:21.972 INFO:tasks.workunit.client.0.smithi153.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-19T13:56:27.586 INFO:tasks.workunit.client.0.smithi153.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-19T13:56:34.299 INFO:tasks.workunit.client.0.smithi153.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-19T13:57:40.597 INFO:tasks.workunit.client.0.smithi153.stdout:arg: file-0b 2024-09-19T13:57:40.598 INFO:tasks.workunit.client.0.smithi153.stdout:arg: file-8b 2024-09-19T13:57:40.599 INFO:tasks.workunit.client.0.smithi153.stdout:arg: file-200b 2024-09-19T13:57:40.601 INFO:tasks.workunit.client.0.smithi153.stdout:arg: file-21983b 2024-09-19T13:57:40.602 INFO:tasks.workunit.client.0.smithi153.stdout:arg: file-5519b 2024-09-19T13:57:40.603 INFO:tasks.workunit.client.0.smithi153.stdout:arg: file-204329b 2024-09-19T13:57:40.604 INFO:tasks.workunit.client.0.smithi153.stdout:arg: file-256k 2024-09-19T13:57:40.605 INFO:tasks.workunit.client.0.smithi153.stdout:arg: file-1m 2024-09-19T13:57:40.606 INFO:tasks.workunit.client.0.smithi153.stdout:arg: file-1038757b 2024-09-19T13:57:40.696 INFO:tasks.workunit.client.0.smithi153.stdout:putObjectFromFileCksum called with file-0b 2024-09-19T13:57:40.896 INFO:tasks.workunit.client.0.smithi153.stdout:PutObjectResponse 2024-09-19T13:57:40.997 INFO:tasks.workunit.client.0.smithi153.stdout:putObjectFromFileCksum called with file-8b 2024-09-19T13:57:41.097 INFO:tasks.workunit.client.0.smithi153.stdout:PutObjectResponse 2024-09-19T13:57:41.197 INFO:tasks.workunit.client.0.smithi153.stdout:putObjectFromFileCksum called with file-200b 2024-09-19T13:57:41.397 INFO:tasks.workunit.client.0.smithi153.stdout:PutObjectResponse 2024-09-19T13:57:41.497 INFO:tasks.workunit.client.0.smithi153.stdout:putObjectFromFileCksum called with file-21983b 2024-09-19T13:57:41.697 INFO:tasks.workunit.client.0.smithi153.stdout:PutObjectResponse 2024-09-19T13:57:41.798 INFO:tasks.workunit.client.0.smithi153.stdout:putObjectFromFileCksum called with file-5519b 2024-09-19T13:57:41.898 INFO:tasks.workunit.client.0.smithi153.stdout:PutObjectResponse 2024-09-19T13:57:42.098 INFO:tasks.workunit.client.0.smithi153.stdout:putObjectFromFileCksum called with file-204329b 2024-09-19T13:57:42.398 INFO:tasks.workunit.client.0.smithi153.stdout:PutObjectResponse 2024-09-19T13:57:42.599 INFO:tasks.workunit.client.0.smithi153.stdout:putObjectFromFileCksum called with file-256k 2024-09-19T13:57:42.899 INFO:tasks.workunit.client.0.smithi153.stdout:PutObjectResponse 2024-09-19T13:57:43.100 INFO:tasks.workunit.client.0.smithi153.stdout:putObjectFromFileCksum called with file-1m 2024-09-19T13:57:44.101 INFO:tasks.workunit.client.0.smithi153.stdout:PutObjectResponse 2024-09-19T13:57:44.401 INFO:tasks.workunit.client.0.smithi153.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-19T13:57:45.302 INFO:tasks.workunit.client.0.smithi153.stdout:PutObjectResponse 2024-09-19T13:57:45.603 INFO:tasks.workunit.client.0.smithi153.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-19T13:57:50.610 INFO:tasks.workunit.client.0.smithi153.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-19T13:58:00.021 INFO:tasks.workunit.client.0.smithi153.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-19T13:59:30.879 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 195.2 s -- in io.ceph.jcksum.PutObjects 2024-09-19T13:59:30.904 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] 2024-09-19T13:59:30.904 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] Results: 2024-09-19T13:59:30.904 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] 2024-09-19T13:59:30.904 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-19T13:59:30.905 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] 2024-09-19T13:59:30.905 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-19T13:59:30.905 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] BUILD SUCCESS 2024-09-19T13:59:30.905 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-19T13:59:30.906 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] Total time: 03:17 min 2024-09-19T13:59:30.906 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] Finished at: 2024-09-19T13:59:30Z 2024-09-19T13:59:30.906 INFO:tasks.workunit.client.0.smithi153.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-19T13:59:30.925 INFO:tasks.workunit.client.0.smithi153.stderr:+ exit 2024-09-19T13:59:30.925 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T13:59:30.925 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T13:59:30.978 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-19T13:59:30.978 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T13:59:31.324 DEBUG:teuthology.parallel:result is None 2024-09-19T13:59:31.324 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T13:59:31.337 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T13:59:31.337 DEBUG:teuthology.orchestra.run.smithi153:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T13:59:31.385 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T13:59:31.385 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T13:59:31.395 INFO:tasks.workunit:Pulling workunits from ref 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:59:31.395 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T13:59:31.395 DEBUG:teuthology.orchestra.run.smithi153:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T13:59:31.433 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T13:59:31.433 INFO:teuthology.orchestra.run.smithi153.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-19T13:59:31.434 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T13:59:31.481 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-19T13:59:31.482 DEBUG:teuthology.orchestra.run.smithi153:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-19T13:59:31.529 INFO:tasks.workunit:timeout=3h 2024-09-19T13:59:31.530 INFO:tasks.workunit:cleanup=True 2024-09-19T13:59:31.530 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T13:59:31.580 INFO:tasks.workunit.client.0.smithi153.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T14:00:29.020 INFO:tasks.workunit.client.0.smithi153.stderr:Updating files: 98% (12467/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-19T14:00:29.349 INFO:tasks.workunit.client.0.smithi153.stderr:Note: switching to '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'. 2024-09-19T14:00:29.349 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:00:29.349 INFO:tasks.workunit.client.0.smithi153.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T14:00:29.349 INFO:tasks.workunit.client.0.smithi153.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T14:00:29.349 INFO:tasks.workunit.client.0.smithi153.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T14:00:29.349 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:00:29.349 INFO:tasks.workunit.client.0.smithi153.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T14:00:29.349 INFO:tasks.workunit.client.0.smithi153.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T14:00:29.349 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:00:29.349 INFO:tasks.workunit.client.0.smithi153.stderr: git switch -c 2024-09-19T14:00:29.350 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:00:29.350 INFO:tasks.workunit.client.0.smithi153.stderr:Or undo this operation with: 2024-09-19T14:00:29.350 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:00:29.350 INFO:tasks.workunit.client.0.smithi153.stderr: git switch - 2024-09-19T14:00:29.350 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:00:29.350 INFO:tasks.workunit.client.0.smithi153.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T14:00:29.350 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:00:29.350 INFO:tasks.workunit.client.0.smithi153.stderr:HEAD is now at 08af21e0d16 rgw_log_backing: error code not returned 2024-09-19T14:00:29.357 DEBUG:teuthology.orchestra.run.smithi153:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T14:00:29.406 INFO:tasks.workunit.client.0.smithi153.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T14:00:29.409 INFO:tasks.workunit.client.0.smithi153.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T14:00:29.409 INFO:tasks.workunit.client.0.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T14:00:29.463 INFO:tasks.workunit.client.0.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T14:00:29.516 INFO:tasks.workunit.client.0.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T14:00:29.555 INFO:tasks.workunit.client.0.smithi153.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T14:00:29.556 INFO:tasks.workunit.client.0.smithi153.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T14:00:29.556 INFO:tasks.workunit.client.0.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T14:00:29.596 INFO:tasks.workunit.client.0.smithi153.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T14:00:29.599 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T14:00:29.599 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T14:00:29.645 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-19T14:00:29.647 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-19T14:00:29.647 DEBUG:teuthology.orchestra.run.smithi153:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-19T14:00:29.706 INFO:tasks.workunit.client.0.smithi153.stdout:INFO: fully qualified domain name: smithi153.front.sepia.ceph.com 2024-09-19T14:00:29.706 INFO:tasks.workunit.client.0.smithi153.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-19T14:00:29.707 INFO:tasks.workunit.client.0.smithi153.stdout:== TESTING VERSIONED BUCKET == 2024-09-19T14:00:32.942 INFO:tasks.workunit.client.0.smithi153.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-19T14:00:33.147 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting pip 2024-09-19T14:00:33.153 INFO:tasks.workunit.client.0.smithi153.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-19T14:00:33.186 INFO:tasks.workunit.client.0.smithi153.stdout:Installing collected packages: pip 2024-09-19T14:00:33.187 INFO:tasks.workunit.client.0.smithi153.stdout: Attempting uninstall: pip 2024-09-19T14:00:33.187 INFO:tasks.workunit.client.0.smithi153.stdout: Found existing installation: pip 22.0.2 2024-09-19T14:00:33.445 INFO:tasks.workunit.client.0.smithi153.stdout: Uninstalling pip-22.0.2: 2024-09-19T14:00:33.452 INFO:tasks.workunit.client.0.smithi153.stdout: Successfully uninstalled pip-22.0.2 2024-09-19T14:00:34.195 INFO:tasks.workunit.client.0.smithi153.stdout:Successfully installed pip-24.2 2024-09-19T14:00:35.224 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting boto3 2024-09-19T14:00:35.226 INFO:tasks.workunit.client.0.smithi153.stdout: Using cached boto3-1.35.22-py3-none-any.whl.metadata (6.6 kB) 2024-09-19T14:00:35.772 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting botocore<1.36.0,>=1.35.22 (from boto3) 2024-09-19T14:00:35.773 INFO:tasks.workunit.client.0.smithi153.stdout: Using cached botocore-1.35.22-py3-none-any.whl.metadata (5.7 kB) 2024-09-19T14:00:35.827 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-19T14:00:35.828 INFO:tasks.workunit.client.0.smithi153.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-19T14:00:35.874 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-19T14:00:35.875 INFO:tasks.workunit.client.0.smithi153.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-19T14:00:35.939 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T14:00:35.941 INFO:tasks.workunit.client.0.smithi153.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-19T14:00:36.047 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T14:00:36.048 INFO:tasks.workunit.client.0.smithi153.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-19T14:00:36.305 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T14:00:36.306 INFO:tasks.workunit.client.0.smithi153.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-19T14:00:36.309 INFO:tasks.workunit.client.0.smithi153.stdout:Using cached boto3-1.35.22-py3-none-any.whl (139 kB) 2024-09-19T14:00:36.310 INFO:tasks.workunit.client.0.smithi153.stdout:Using cached botocore-1.35.22-py3-none-any.whl (12.6 MB) 2024-09-19T14:00:36.320 INFO:tasks.workunit.client.0.smithi153.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-19T14:00:36.321 INFO:tasks.workunit.client.0.smithi153.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-19T14:00:36.322 INFO:tasks.workunit.client.0.smithi153.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-19T14:00:36.324 INFO:tasks.workunit.client.0.smithi153.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-19T14:00:36.325 INFO:tasks.workunit.client.0.smithi153.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-19T14:00:36.394 INFO:tasks.workunit.client.0.smithi153.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-19T14:00:37.443 INFO:tasks.workunit.client.0.smithi153.stdout:Successfully installed boto3-1.35.22 botocore-1.35.22 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-19T14:00:37.791 INFO:tasks.workunit.client.0.smithi153.stdout:INFO: creating user 2024-09-19T14:00:37.929 INFO:tasks.workunit.client.0.smithi153.stdout:{ 2024-09-19T14:00:37.930 INFO:tasks.workunit.client.0.smithi153.stdout: "user_id": "testid", 2024-09-19T14:00:37.930 INFO:tasks.workunit.client.0.smithi153.stdout: "display_name": "M. Tester", 2024-09-19T14:00:37.930 INFO:tasks.workunit.client.0.smithi153.stdout: "email": "tester@ceph.com", 2024-09-19T14:00:37.930 INFO:tasks.workunit.client.0.smithi153.stdout: "suspended": 0, 2024-09-19T14:00:37.930 INFO:tasks.workunit.client.0.smithi153.stdout: "max_buckets": 1000, 2024-09-19T14:00:37.930 INFO:tasks.workunit.client.0.smithi153.stdout: "subusers": [], 2024-09-19T14:00:37.930 INFO:tasks.workunit.client.0.smithi153.stdout: "keys": [ 2024-09-19T14:00:37.930 INFO:tasks.workunit.client.0.smithi153.stdout: { 2024-09-19T14:00:37.930 INFO:tasks.workunit.client.0.smithi153.stdout: "user": "testid", 2024-09-19T14:00:37.931 INFO:tasks.workunit.client.0.smithi153.stdout: "access_key": "0555b35654ad1656d804", 2024-09-19T14:00:37.931 INFO:tasks.workunit.client.0.smithi153.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-19T14:00:37.931 INFO:tasks.workunit.client.0.smithi153.stdout: "active": true, 2024-09-19T14:00:37.931 INFO:tasks.workunit.client.0.smithi153.stdout: "create_date": "2024-09-19T14:00:37.918564Z" 2024-09-19T14:00:37.931 INFO:tasks.workunit.client.0.smithi153.stdout: } 2024-09-19T14:00:37.931 INFO:tasks.workunit.client.0.smithi153.stdout: ], 2024-09-19T14:00:37.931 INFO:tasks.workunit.client.0.smithi153.stdout: "swift_keys": [], 2024-09-19T14:00:37.931 INFO:tasks.workunit.client.0.smithi153.stdout: "caps": [], 2024-09-19T14:00:37.931 INFO:tasks.workunit.client.0.smithi153.stdout: "op_mask": "read, write, delete", 2024-09-19T14:00:37.931 INFO:tasks.workunit.client.0.smithi153.stdout: "default_placement": "", 2024-09-19T14:00:37.931 INFO:tasks.workunit.client.0.smithi153.stdout: "default_storage_class": "", 2024-09-19T14:00:37.931 INFO:tasks.workunit.client.0.smithi153.stdout: "placement_tags": [], 2024-09-19T14:00:37.931 INFO:tasks.workunit.client.0.smithi153.stdout: "bucket_quota": { 2024-09-19T14:00:37.932 INFO:tasks.workunit.client.0.smithi153.stdout: "enabled": false, 2024-09-19T14:00:37.932 INFO:tasks.workunit.client.0.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:00:37.932 INFO:tasks.workunit.client.0.smithi153.stdout: "max_size": -1, 2024-09-19T14:00:37.932 INFO:tasks.workunit.client.0.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:00:37.932 INFO:tasks.workunit.client.0.smithi153.stdout: "max_objects": -1 2024-09-19T14:00:37.932 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T14:00:37.932 INFO:tasks.workunit.client.0.smithi153.stdout: "user_quota": { 2024-09-19T14:00:37.932 INFO:tasks.workunit.client.0.smithi153.stdout: "enabled": false, 2024-09-19T14:00:37.932 INFO:tasks.workunit.client.0.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:00:37.932 INFO:tasks.workunit.client.0.smithi153.stdout: "max_size": -1, 2024-09-19T14:00:37.932 INFO:tasks.workunit.client.0.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:00:37.933 INFO:tasks.workunit.client.0.smithi153.stdout: "max_objects": -1 2024-09-19T14:00:37.933 INFO:tasks.workunit.client.0.smithi153.stdout: }, 2024-09-19T14:00:37.933 INFO:tasks.workunit.client.0.smithi153.stdout: "temp_url_keys": [], 2024-09-19T14:00:37.933 INFO:tasks.workunit.client.0.smithi153.stdout: "type": "rgw", 2024-09-19T14:00:37.933 INFO:tasks.workunit.client.0.smithi153.stdout: "mfa_ids": [], 2024-09-19T14:00:37.933 INFO:tasks.workunit.client.0.smithi153.stdout: "account_id": "", 2024-09-19T14:00:37.933 INFO:tasks.workunit.client.0.smithi153.stdout: "path": "/", 2024-09-19T14:00:37.933 INFO:tasks.workunit.client.0.smithi153.stdout: "create_date": "2024-09-19T14:00:37.918550Z", 2024-09-19T14:00:37.933 INFO:tasks.workunit.client.0.smithi153.stdout: "tags": [], 2024-09-19T14:00:37.933 INFO:tasks.workunit.client.0.smithi153.stdout: "group_ids": [] 2024-09-19T14:00:37.933 INFO:tasks.workunit.client.0.smithi153.stdout:} 2024-09-19T14:00:37.933 INFO:tasks.workunit.client.0.smithi153.stdout: 2024-09-19T14:00:48.085 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi153.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:00:48.085 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:00:48.232 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi153.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:00:48.232 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:00:48.335 INFO:tasks.workunit.client.0.smithi153.stderr:5+0 records in 2024-09-19T14:00:48.335 INFO:tasks.workunit.client.0.smithi153.stderr:5+0 records out 2024-09-19T14:00:48.335 INFO:tasks.workunit.client.0.smithi153.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0218291 s, 240 MB/s 2024-09-19T14:00:48.340 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi153.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:00:48.341 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:00:48.492 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi153.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:00:48.492 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:00:50.617 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi153.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:00:50.618 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:00:52.730 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi153.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:00:52.730 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:00:55.069 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi153.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:00:55.069 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:00:57.198 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi153.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:00:57.198 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:00:59.396 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi153.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:00:59.397 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:01:01.682 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi153.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:01:01.683 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:01:03.941 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi153.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:01:03.941 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:01:06.039 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi153.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:01:06.039 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:01:08.214 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi153.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:01:08.214 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:01:10.371 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi153.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:01:10.371 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:01:12.838 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi153.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:01:12.838 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:01:15.196 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi153.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:01:15.196 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:01:17.561 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi153.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:01:17.562 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:01:17.767 INFO:tasks.workunit.client.0.smithi153.stdout:bucket nams is reupload-bkt-132040 2024-09-19T14:01:17.767 INFO:tasks.workunit.client.0.smithi153.stdout:endpoint is https://smithi153.front.sepia.ceph.com:443 2024-09-19T14:01:17.767 INFO:tasks.workunit.client.0.smithi153.stdout:start UploadId=2~GRBAR5YCEjYEZxm2slDxLbxKsXv5IYO 2024-09-19T14:01:17.767 INFO:tasks.workunit.client.0.smithi153.stdout:phase 1 uploaded part {'ETag': '"33e734ec535230a1cd170e5b3b961ed4"', 'PartNumber': 1} 2024-09-19T14:01:17.767 INFO:tasks.workunit.client.0.smithi153.stdout:phase 1 uploaded part {'ETag': '"33e734ec535230a1cd170e5b3b961ed4"', 'PartNumber': 2} 2024-09-19T14:01:17.767 INFO:tasks.workunit.client.0.smithi153.stdout:phase 2 uploaded part {'ETag': '"33e734ec535230a1cd170e5b3b961ed4"', 'PartNumber': 1} 2024-09-19T14:01:17.767 INFO:tasks.workunit.client.0.smithi153.stdout:phase 2 uploaded part {'ETag': '"33e734ec535230a1cd170e5b3b961ed4"', 'PartNumber': 1} 2024-09-19T14:01:17.768 INFO:tasks.workunit.client.0.smithi153.stdout:phase 2 uploaded part {'ETag': '"33e734ec535230a1cd170e5b3b961ed4"', 'PartNumber': 1} 2024-09-19T14:01:17.768 INFO:tasks.workunit.client.0.smithi153.stdout:phase 2 uploaded part {'ETag': '"33e734ec535230a1cd170e5b3b961ed4"', 'PartNumber': 1} 2024-09-19T14:01:17.768 INFO:tasks.workunit.client.0.smithi153.stdout:phase 2 uploaded part {'ETag': '"33e734ec535230a1cd170e5b3b961ed4"', 'PartNumber': 1} 2024-09-19T14:01:17.768 INFO:tasks.workunit.client.0.smithi153.stdout:phase 2 uploaded part {'ETag': '"33e734ec535230a1cd170e5b3b961ed4"', 'PartNumber': 1} 2024-09-19T14:01:17.768 INFO:tasks.workunit.client.0.smithi153.stdout:phase 2 uploaded part {'ETag': '"33e734ec535230a1cd170e5b3b961ed4"', 'PartNumber': 1} 2024-09-19T14:01:17.768 INFO:tasks.workunit.client.0.smithi153.stdout:phase 2 uploaded part {'ETag': '"33e734ec535230a1cd170e5b3b961ed4"', 'PartNumber': 1} 2024-09-19T14:01:17.768 INFO:tasks.workunit.client.0.smithi153.stdout:phase 2 uploaded part {'ETag': '"33e734ec535230a1cd170e5b3b961ed4"', 'PartNumber': 1} 2024-09-19T14:01:17.768 INFO:tasks.workunit.client.0.smithi153.stdout:phase 2 uploaded part {'ETag': '"33e734ec535230a1cd170e5b3b961ed4"', 'PartNumber': 1} 2024-09-19T14:01:17.768 INFO:tasks.workunit.client.0.smithi153.stdout:phase 2 uploaded part {'ETag': '"33e734ec535230a1cd170e5b3b961ed4"', 'PartNumber': 1} 2024-09-19T14:01:17.768 INFO:tasks.workunit.client.0.smithi153.stdout:aborting multipart upload, parts=[{'ETag': '"33e734ec535230a1cd170e5b3b961ed4"', 'PartNumber': 1}, {'ETag': '"33e734ec535230a1cd170e5b3b961ed4"', 'PartNumber': 2}] 2024-09-19T14:01:18.979 INFO:tasks.workunit.client.0.smithi153.stdout:radosgw-admin bucket radoslist: 2024-09-19T14:01:19.063 INFO:tasks.workunit.client.0.smithi153.stdout:rados ls: 2024-09-19T14:01:19.151 INFO:tasks.workunit.client.0.smithi153.stdout:== PASSED == 2024-09-19T14:01:19.152 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T14:01:19.153 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T14:01:19.205 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-19T14:01:19.205 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T14:01:19.637 DEBUG:teuthology.parallel:result is None 2024-09-19T14:01:19.637 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T14:01:19.650 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T14:01:19.651 DEBUG:teuthology.orchestra.run.smithi153:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T14:01:19.697 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T14:01:19.697 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-19T14:01:19.711 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-19T14:01:19.711 INFO:tasks.ragweed:Downloading ragweed... 2024-09-19T14:01:19.711 INFO:tasks.ragweed:Using branch 'wip-yuval-test' for ragweed 2024-09-19T14:01:19.711 DEBUG:teuthology.orchestra.run.smithi153:> git clone -b wip-yuval-test https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-19T14:01:19.746 INFO:teuthology.orchestra.run.smithi153.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-19T14:01:19.805 INFO:teuthology.orchestra.run.smithi153.stderr:fatal: Remote branch wip-yuval-test not found in upstream origin 2024-09-19T14:01:19.805 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-19T14:01:19.807 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-19T14:01:19.807 DEBUG:teuthology.orchestra.run.smithi153:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-19T14:01:19.853 INFO:teuthology.orchestra.run.smithi153.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-19T14:01:20.041 INFO:tasks.ragweed:Creating rgw users... 2024-09-19T14:01:20.042 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-19T14:01:20.042 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key TAWPMJWNCNLCGOMQPMSW --secret j4dg50P+debNNFsTXRP9LaCQ2UWa6jMmUyMVO+zd4bSRnlyAmzzhNw== --email ragweed.client.0+test@test.test --system false 2024-09-19T14:01:20.132 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:01:20.132 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:01:20.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.175+0000 7efdce2f49c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.175+0000 7efdce2f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:20.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.175+0000 7efdce2f49c0 20 realm 2024-09-19T14:01:20.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.175+0000 7efdce2f49c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.175+0000 7efdce2f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:20.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.175+0000 7efdce2f49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:01:20.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.175+0000 7efdce2f49c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.175+0000 7efdce2f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:20.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.175+0000 7efdce2f49c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.179+0000 7efdce2f49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:01:20.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.179+0000 7efdce2f49c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.179+0000 7efdce2f49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:01:20.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.179+0000 7efdce2f49c0 20 searching for the correct realm 2024-09-19T14:01:20.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.179+0000 7efdcbdfa640 0 -- 172.21.15.153:0/1254930076 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x557979552cf0 msgr2=0x7efdc406f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:01:20.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.187+0000 7efdcc5fb640 0 -- 172.21.15.153:0/1254930076 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7efdc00d2030 msgr2=0x7efdc00d2920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:01:20.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.195+0000 7efdce2f49c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:01:20.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.195+0000 7efdce2f49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:01:20.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.195+0000 7efdce2f49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:01:20.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.195+0000 7efdce2f49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:01:20.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.195+0000 7efdce2f49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:01:20.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.195+0000 7efdce2f49c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:01:20.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.195+0000 7efdce2f49c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.199+0000 7efdce2f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:20.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.199+0000 7efdce2f49c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.199+0000 7efdce2f49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:01:20.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.199+0000 7efdce2f49c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.199+0000 7efdce2f49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:01:20.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.199+0000 7efdce2f49c0 20 zone default found 2024-09-19T14:01:20.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.199+0000 7efdce2f49c0 4 Realm: () 2024-09-19T14:01:20.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.199+0000 7efdce2f49c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:01:20.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.199+0000 7efdce2f49c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:01:20.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.199+0000 7efdce2f49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:01:20.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.199+0000 7efdce2f49c0 20 zonegroup default 2024-09-19T14:01:20.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.199+0000 7efdce2f49c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.199+0000 7efdce2f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:20.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.199+0000 7efdce2f49c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.199+0000 7efdce2f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:20.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.199+0000 7efdce2f49c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.199+0000 7efdce2f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:20.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.199+0000 7efdce2f49c0 20 started sync module instance, tier type = 2024-09-19T14:01:20.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.199+0000 7efdce2f49c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:01:20.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.215+0000 7efdce2f49c0 20 add_watcher() i=0 2024-09-19T14:01:20.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.215+0000 7efdce2f49c0 20 add_watcher() i=1 2024-09-19T14:01:20.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.215+0000 7efdce2f49c0 20 add_watcher() i=2 2024-09-19T14:01:20.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.215+0000 7efdce2f49c0 20 add_watcher() i=3 2024-09-19T14:01:20.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.215+0000 7efdce2f49c0 20 add_watcher() i=4 2024-09-19T14:01:20.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.215+0000 7efdce2f49c0 20 add_watcher() i=5 2024-09-19T14:01:20.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.215+0000 7efdce2f49c0 20 add_watcher() i=6 2024-09-19T14:01:20.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.215+0000 7efdce2f49c0 20 add_watcher() i=7 2024-09-19T14:01:20.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.215+0000 7efdce2f49c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:01:20.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.219+0000 7efc81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:01:20.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.219+0000 7efdce2f49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:01:20.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.219+0000 7efdce2f49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:01:20.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.219+0000 7efdce2f49c0 5 note: GC not initialized 2024-09-19T14:01:20.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.219+0000 7efc80fe1640 20 reqs_thread_entry: start 2024-09-19T14:01:20.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.219+0000 7efdce2f49c0 20 init_complete bucket index max shards: 11 2024-09-19T14:01:20.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.219+0000 7efdce2f49c0 20 Filter name: none 2024-09-19T14:01:20.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.219+0000 7efbfa7fc640 20 reqs_thread_entry: start 2024-09-19T14:01:20.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.219+0000 7efdce2f49c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-19T14:01:20.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.219+0000 7efdce2f49c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.219+0000 7efdce2f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:20.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.219+0000 7efdce2f49c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-19T14:01:20.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.219+0000 7efdce2f49c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-19T14:01:20.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.219+0000 7efdce2f49c0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-19T14:01:20.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.219+0000 7efdce2f49c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.223+0000 7efdce2f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:20.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.223+0000 7efdce2f49c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-19T14:01:20.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.223+0000 7efdce2f49c0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-19T14:01:20.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.223+0000 7efdce2f49c0 10 cache get: name=default.rgw.meta+users.keys+TAWPMJWNCNLCGOMQPMSW : miss 2024-09-19T14:01:20.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.223+0000 7efdce2f49c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.223+0000 7efdce2f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:20.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.223+0000 7efdce2f49c0 10 cache put: name=default.rgw.meta+users.keys+TAWPMJWNCNLCGOMQPMSW info.flags=0x0 2024-09-19T14:01:20.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.223+0000 7efdce2f49c0 10 adding default.rgw.meta+users.keys+TAWPMJWNCNLCGOMQPMSW to cache LRU end 2024-09-19T14:01:20.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.223+0000 7efdce2f49c0 10 cache get: name=default.rgw.meta+users.keys+TAWPMJWNCNLCGOMQPMSW : hit (negative entry) 2024-09-19T14:01:20.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.223+0000 7efdce2f49c0 10 cache get: name=default.rgw.meta+users.keys+TAWPMJWNCNLCGOMQPMSW : hit (negative entry) 2024-09-19T14:01:20.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.223+0000 7efdce2f49c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-19T14:01:20.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.223+0000 7efdce2f49c0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-19T14:01:20.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.223+0000 7efdce2f49c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-19T14:01:20.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.223+0000 7efcaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595092 cookie 93980216418832 notifier 5865 bl.length()=675 2024-09-19T14:01:20.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.223+0000 7efcaaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-19T14:01:20.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.223+0000 7efcaaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-19T14:01:20.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.231+0000 7efdce2f49c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-19T14:01:20.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.231+0000 7efdce2f49c0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-19T14:01:20.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.231+0000 7efdce2f49c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-19T14:01:20.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.231+0000 7efcaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595129 cookie 93980216406288 notifier 5865 bl.length()=202 2024-09-19T14:01:20.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.231+0000 7efcaaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-19T14:01:20.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.231+0000 7efcaaffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-19T14:01:20.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.235+0000 7efdce2f49c0 10 cache put: name=default.rgw.meta+users.keys+TAWPMJWNCNLCGOMQPMSW info.flags=0x7 2024-09-19T14:01:20.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.235+0000 7efdce2f49c0 10 moving default.rgw.meta+users.keys+TAWPMJWNCNLCGOMQPMSW to cache LRU end 2024-09-19T14:01:20.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.235+0000 7efdce2f49c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:TAWPMJWNCNLCGOMQPMSW, ofs0, ns] 2024-09-19T14:01:20.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.235+0000 7efcaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595086 cookie 93980216411808 notifier 5865 bl.length()=190 2024-09-19T14:01:20.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.235+0000 7efcaaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+TAWPMJWNCNLCGOMQPMSW info.flags=0x7 2024-09-19T14:01:20.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.235+0000 7efcaaffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+TAWPMJWNCNLCGOMQPMSW to cache LRU end 2024-09-19T14:01:20.236 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-19T14:01:20.237 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "ragweed.client.0", 2024-09-19T14:01:20.237 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-19T14:01:20.237 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-19T14:01:20.237 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2024-09-19T14:01:20.237 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 1000, 2024-09-19T14:01:20.237 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2024-09-19T14:01:20.237 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2024-09-19T14:01:20.237 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-19T14:01:20.237 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "ragweed.client.0", 2024-09-19T14:01:20.237 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "TAWPMJWNCNLCGOMQPMSW", 2024-09-19T14:01:20.237 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "j4dg50P+debNNFsTXRP9LaCQ2UWa6jMmUyMVO+zd4bSRnlyAmzzhNw==", 2024-09-19T14:01:20.237 INFO:teuthology.orchestra.run.smithi153.stdout: "active": true, 2024-09-19T14:01:20.237 INFO:teuthology.orchestra.run.smithi153.stdout: "create_date": "2024-09-19T14:01:20.224166Z" 2024-09-19T14:01:20.238 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-19T14:01:20.238 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-19T14:01:20.238 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2024-09-19T14:01:20.238 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2024-09-19T14:01:20.238 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2024-09-19T14:01:20.238 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2024-09-19T14:01:20.238 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2024-09-19T14:01:20.238 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2024-09-19T14:01:20.238 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2024-09-19T14:01:20.238 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2024-09-19T14:01:20.238 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:01:20.238 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2024-09-19T14:01:20.239 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:01:20.239 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2024-09-19T14:01:20.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:01:20.239 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2024-09-19T14:01:20.239 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2024-09-19T14:01:20.239 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:01:20.239 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2024-09-19T14:01:20.239 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:01:20.239 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2024-09-19T14:01:20.239 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:01:20.239 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2024-09-19T14:01:20.239 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2024-09-19T14:01:20.239 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [], 2024-09-19T14:01:20.239 INFO:teuthology.orchestra.run.smithi153.stdout: "account_id": "", 2024-09-19T14:01:20.239 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "/", 2024-09-19T14:01:20.240 INFO:teuthology.orchestra.run.smithi153.stdout: "create_date": "2024-09-19T14:01:20.224149Z", 2024-09-19T14:01:20.240 INFO:teuthology.orchestra.run.smithi153.stdout: "tags": [], 2024-09-19T14:01:20.240 INFO:teuthology.orchestra.run.smithi153.stdout: "group_ids": [] 2024-09-19T14:01:20.240 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-19T14:01:20.240 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:01:20.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.239+0000 7efc81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:01:20.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.243+0000 7efdce2f49c0 20 remove_watcher() i=0 2024-09-19T14:01:20.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.243+0000 7efdce2f49c0 2 removed watcher, disabling cache 2024-09-19T14:01:20.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.247+0000 7efdce2f49c0 20 remove_watcher() i=1 2024-09-19T14:01:20.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.247+0000 7efdce2f49c0 20 remove_watcher() i=2 2024-09-19T14:01:20.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.251+0000 7efdce2f49c0 20 remove_watcher() i=3 2024-09-19T14:01:20.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.251+0000 7efdce2f49c0 20 remove_watcher() i=4 2024-09-19T14:01:20.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.251+0000 7efdce2f49c0 20 remove_watcher() i=5 2024-09-19T14:01:20.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.255+0000 7efdce2f49c0 20 remove_watcher() i=6 2024-09-19T14:01:20.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.255+0000 7efdce2f49c0 20 remove_watcher() i=7 2024-09-19T14:01:20.269 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-19T14:01:20.269 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key PSRPDLFZLMXOABCIINUV --secret QhIOAZb6XdFtXiZilV/yEZ0uJkgtcD3pWOE6NkCTWNHmRXklUKGe0w== --email sysuser.client.0+test@test.test --system true 2024-09-19T14:01:20.311 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:01:20.311 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:01:20.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.351+0000 7f47ac5679c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.351+0000 7f47ac5679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:20.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.351+0000 7f47ac5679c0 20 realm 2024-09-19T14:01:20.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.351+0000 7f47ac5679c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.355+0000 7f47ac5679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:20.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.355+0000 7f47ac5679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:01:20.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.355+0000 7f47ac5679c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.355+0000 7f47ac5679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:20.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.355+0000 7f47ac5679c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.355+0000 7f47ac5679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:01:20.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.355+0000 7f47ac5679c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.355+0000 7f47ac5679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:01:20.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.355+0000 7f47ac5679c0 20 searching for the correct realm 2024-09-19T14:01:20.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.359+0000 7f47a986c640 0 -- 172.21.15.153:0/1016498045 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x55a97dd76c10 msgr2=0x55a97dd790a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:01:20.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.367+0000 7f47aa06d640 0 -- 172.21.15.153:0/1016498045 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f47a00ee930 msgr2=0x7f47a00cd440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:01:20.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.375+0000 7f47ac5679c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:01:20.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.375+0000 7f47ac5679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:01:20.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.375+0000 7f47ac5679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:01:20.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.375+0000 7f47ac5679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:01:20.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.375+0000 7f47ac5679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:01:20.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.375+0000 7f47ac5679c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:01:20.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.375+0000 7f47ac5679c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.375+0000 7f47ac5679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:20.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.375+0000 7f47ac5679c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.375+0000 7f47ac5679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:01:20.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.375+0000 7f47ac5679c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.375+0000 7f47ac5679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:01:20.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.375+0000 7f47ac5679c0 20 zone default found 2024-09-19T14:01:20.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.375+0000 7f47ac5679c0 4 Realm: () 2024-09-19T14:01:20.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.375+0000 7f47ac5679c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:01:20.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.375+0000 7f47ac5679c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:01:20.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.375+0000 7f47ac5679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:01:20.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.375+0000 7f47ac5679c0 20 zonegroup default 2024-09-19T14:01:20.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.375+0000 7f47ac5679c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.375+0000 7f47ac5679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:20.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.375+0000 7f47ac5679c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.379+0000 7f47ac5679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:20.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.379+0000 7f47ac5679c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.379+0000 7f47ac5679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:20.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.379+0000 7f47ac5679c0 20 started sync module instance, tier type = 2024-09-19T14:01:20.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.379+0000 7f47ac5679c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:01:20.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.395+0000 7f47ac5679c0 20 add_watcher() i=0 2024-09-19T14:01:20.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.395+0000 7f47ac5679c0 20 add_watcher() i=1 2024-09-19T14:01:20.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.395+0000 7f47ac5679c0 20 add_watcher() i=2 2024-09-19T14:01:20.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.395+0000 7f47ac5679c0 20 add_watcher() i=3 2024-09-19T14:01:20.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.395+0000 7f47ac5679c0 20 add_watcher() i=4 2024-09-19T14:01:20.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.395+0000 7f47ac5679c0 20 add_watcher() i=5 2024-09-19T14:01:20.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.395+0000 7f47ac5679c0 20 add_watcher() i=6 2024-09-19T14:01:20.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.395+0000 7f47ac5679c0 20 add_watcher() i=7 2024-09-19T14:01:20.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.395+0000 7f47ac5679c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:01:20.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f4660fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:01:20.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f47ac5679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:01:20.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f47ac5679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:01:20.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f47ac5679c0 5 note: GC not initialized 2024-09-19T14:01:20.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f45db7fe640 20 reqs_thread_entry: start 2024-09-19T14:01:20.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f47ac5679c0 20 init_complete bucket index max shards: 11 2024-09-19T14:01:20.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f47ac5679c0 20 Filter name: none 2024-09-19T14:01:20.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f45d97fa640 20 reqs_thread_entry: start 2024-09-19T14:01:20.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f47ac5679c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-19T14:01:20.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f47ac5679c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f47ac5679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:20.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f47ac5679c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-19T14:01:20.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f47ac5679c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-19T14:01:20.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f47ac5679c0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-19T14:01:20.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f47ac5679c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f47ac5679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:20.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f47ac5679c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-19T14:01:20.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f47ac5679c0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-19T14:01:20.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f47ac5679c0 10 cache get: name=default.rgw.meta+users.keys+PSRPDLFZLMXOABCIINUV : miss 2024-09-19T14:01:20.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f47ac5679c0 20 rados->read ofs=0 len=0 2024-09-19T14:01:20.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f47ac5679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:01:20.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f47ac5679c0 10 cache put: name=default.rgw.meta+users.keys+PSRPDLFZLMXOABCIINUV info.flags=0x0 2024-09-19T14:01:20.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f47ac5679c0 10 adding default.rgw.meta+users.keys+PSRPDLFZLMXOABCIINUV to cache LRU end 2024-09-19T14:01:20.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f47ac5679c0 10 cache get: name=default.rgw.meta+users.keys+PSRPDLFZLMXOABCIINUV : hit (negative entry) 2024-09-19T14:01:20.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.399+0000 7f47ac5679c0 10 cache get: name=default.rgw.meta+users.keys+PSRPDLFZLMXOABCIINUV : hit (negative entry) 2024-09-19T14:01:20.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.403+0000 7f47ac5679c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-19T14:01:20.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.403+0000 7f47ac5679c0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-19T14:01:20.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.403+0000 7f47ac5679c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-19T14:01:20.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.403+0000 7f468dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595130 cookie 94186449109680 notifier 5886 bl.length()=675 2024-09-19T14:01:20.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.403+0000 7f468dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-19T14:01:20.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.403+0000 7f468dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-19T14:01:20.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.407+0000 7f47ac5679c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-19T14:01:20.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.407+0000 7f47ac5679c0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-19T14:01:20.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.407+0000 7f47ac5679c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-19T14:01:20.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.407+0000 7f468d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595093 cookie 94186449124192 notifier 5886 bl.length()=202 2024-09-19T14:01:20.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.407+0000 7f468d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-19T14:01:20.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.407+0000 7f468d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-19T14:01:20.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.411+0000 7f47ac5679c0 10 cache put: name=default.rgw.meta+users.keys+PSRPDLFZLMXOABCIINUV info.flags=0x7 2024-09-19T14:01:20.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.411+0000 7f47ac5679c0 10 moving default.rgw.meta+users.keys+PSRPDLFZLMXOABCIINUV to cache LRU end 2024-09-19T14:01:20.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.411+0000 7f47ac5679c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:PSRPDLFZLMXOABCIINUV, ofs0, ns] 2024-09-19T14:01:20.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.415+0000 7f468dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595084 cookie 94186449127264 notifier 5886 bl.length()=190 2024-09-19T14:01:20.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.415+0000 7f468dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PSRPDLFZLMXOABCIINUV info.flags=0x7 2024-09-19T14:01:20.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.415+0000 7f468dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PSRPDLFZLMXOABCIINUV to cache LRU end 2024-09-19T14:01:20.416 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-19T14:01:20.416 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "sysuser.client.0", 2024-09-19T14:01:20.416 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-19T14:01:20.417 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-19T14:01:20.417 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2024-09-19T14:01:20.417 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 1000, 2024-09-19T14:01:20.417 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2024-09-19T14:01:20.417 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2024-09-19T14:01:20.417 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-19T14:01:20.417 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "sysuser.client.0", 2024-09-19T14:01:20.417 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "PSRPDLFZLMXOABCIINUV", 2024-09-19T14:01:20.417 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "QhIOAZb6XdFtXiZilV/yEZ0uJkgtcD3pWOE6NkCTWNHmRXklUKGe0w==", 2024-09-19T14:01:20.417 INFO:teuthology.orchestra.run.smithi153.stdout: "active": true, 2024-09-19T14:01:20.417 INFO:teuthology.orchestra.run.smithi153.stdout: "create_date": "2024-09-19T14:01:20.402650Z" 2024-09-19T14:01:20.417 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-19T14:01:20.417 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-19T14:01:20.418 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2024-09-19T14:01:20.418 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2024-09-19T14:01:20.418 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2024-09-19T14:01:20.418 INFO:teuthology.orchestra.run.smithi153.stdout: "system": true, 2024-09-19T14:01:20.418 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2024-09-19T14:01:20.418 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2024-09-19T14:01:20.418 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2024-09-19T14:01:20.418 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2024-09-19T14:01:20.418 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2024-09-19T14:01:20.418 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:01:20.418 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2024-09-19T14:01:20.418 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:01:20.418 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2024-09-19T14:01:20.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:01:20.419 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2024-09-19T14:01:20.419 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2024-09-19T14:01:20.419 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:01:20.419 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2024-09-19T14:01:20.419 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:01:20.419 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2024-09-19T14:01:20.419 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:01:20.419 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2024-09-19T14:01:20.419 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2024-09-19T14:01:20.419 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [], 2024-09-19T14:01:20.419 INFO:teuthology.orchestra.run.smithi153.stdout: "account_id": "", 2024-09-19T14:01:20.419 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "/", 2024-09-19T14:01:20.419 INFO:teuthology.orchestra.run.smithi153.stdout: "create_date": "2024-09-19T14:01:20.402629Z", 2024-09-19T14:01:20.419 INFO:teuthology.orchestra.run.smithi153.stdout: "tags": [], 2024-09-19T14:01:20.420 INFO:teuthology.orchestra.run.smithi153.stdout: "group_ids": [] 2024-09-19T14:01:20.420 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-19T14:01:20.420 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:01:20.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.415+0000 7f4660fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:01:20.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.419+0000 7f47ac5679c0 20 remove_watcher() i=0 2024-09-19T14:01:20.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.419+0000 7f47ac5679c0 2 removed watcher, disabling cache 2024-09-19T14:01:20.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.423+0000 7f47ac5679c0 20 remove_watcher() i=1 2024-09-19T14:01:20.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.427+0000 7f47ac5679c0 20 remove_watcher() i=2 2024-09-19T14:01:20.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.427+0000 7f47ac5679c0 20 remove_watcher() i=3 2024-09-19T14:01:20.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.431+0000 7f47ac5679c0 20 remove_watcher() i=4 2024-09-19T14:01:20.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.431+0000 7f47ac5679c0 20 remove_watcher() i=5 2024-09-19T14:01:20.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.431+0000 7f47ac5679c0 20 remove_watcher() i=6 2024-09-19T14:01:20.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:01:20.435+0000 7f47ac5679c0 20 remove_watcher() i=7 2024-09-19T14:01:20.447 INFO:tasks.ragweed:Configuring ragweed... 2024-09-19T14:01:20.447 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T14:01:20.448 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-19T14:01:20.493 INFO:tasks.ragweed:Configuring boto... 2024-09-19T14:01:20.494 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T14:01:20.494 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-19T14:01:20.542 DEBUG:teuthology.orchestra.run.smithi153:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-19T14:01:20.730 INFO:teuthology.orchestra.run.smithi153.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-19T14:01:20.908 INFO:teuthology.orchestra.run.smithi153.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-19T14:01:21.522 INFO:teuthology.orchestra.run.smithi153.stdout:py installdeps: -rrequirements.txt 2024-09-19T14:01:24.074 INFO:teuthology.orchestra.run.smithi153.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-19T14:01:28.504 INFO:teuthology.orchestra.run.smithi153.stdout:py installed: appdirs==1.4.4,asyncssh==2.5.0,attrs==21.2.0,Babel==2.8.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,beniget==0.4.1,blinker==1.4,boto==2.49.0,Brotli==1.0.9,cachetools==5.0.0,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2020.6.20,chardet==4.0.0,cheroot==8.5.2+ds1,CherryPy==18.6.1,command-not-found==0.3,configobj==5.0.6,cryptography==3.4.8,cycler==0.11.0,dbus-python==1.2.18,decorator==4.4.2,distlib==0.3.4,distro==1.7.0,distro-info===1.1build1,docopt==0.6.2,execnet==1.9.0,filelock==3.6.0,fonttools==4.29.1,fs==2.4.12,gast==0.5.2,gevent==21.8.0,google-auth==1.5.1,greenlet==1.1.2,html5lib==1.1,httplib2==0.20.2,idna==3.3,importlib-metadata==4.6.4,iniconfig==1.1.1,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.4.0,jaraco.functools==3.4.0,jaraco.text==3.6.0,jeepney==0.7.1,Jinja2==3.0.3,joblib==0.17.0,keyring==23.5.0,kiwisolver==1.3.2,kubernetes==12.0.1,language-selector==0.1,launchpadlib==1.10.16,lazr.restfulclient==0.14.4,lazr.uri==1.0.6,logutils==0.3.3,lxml==4.8.0,lz4==3.1.3+dfsg,Mako==1.1.3,MarkupSafe==2.0.1,matplotlib==3.5.1,more-itertools==8.10.0,mpmath==0.0.0,munch==4.0.0,natsort==8.0.2,netifaces==0.11.0,nose==1.3.7,numpy==1.21.5,oauthlib==3.2.0,olefile==0.46,packaging==21.3,Paste==3.5.0,PasteDeploy==2.1.1,PasteScript==2.0.2,pecan==1.3.3,Pillow==9.0.1,platformdirs==2.5.1,pluggy==0.13.0,ply==3.11,portend==3.0.0,prettytable==2.5.0,psutil==5.9.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.1,Pygments==2.11.2,PyGObject==3.42.1,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyNaCl==1.5.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,pytest==6.2.5,python-apt==2.3.0+ubuntu2.1,python-dateutil==2.8.1,python-magic==0.4.24,pythran==0.10.0,pytz==2022.1,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=8a8e449d462d8b7beef2e67e9ceed7acf09696785464490f7a8c4a8f238e9327,rbd==2.0.0,registries-conf-ctl @ git+https://github.com/sebastian-philipp/registries-conf-ctl@0e9bf2dc202aa9be9b0bf8e8265aac3f2308f9db,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rsa==4.8,s3cmd==2.2.0,scikit-learn==0.23.2,scipy==1.8.0,SecretStorage==3.3.1,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,soupsieve==2.3.1,ssh-import-id==5.11,sympy==1.9,Tempita==0.5.2,tempora==4.1.2,threadpoolctl==3.1.0,toml==0.10.2,ubuntu-advantage-tools==27.12,ufoLib2==0.13.1,ufw==0.36.1,unattended-upgrades==0.1,unicodedata2==14.0.0,urllib3==1.26.5,virtualenv==20.13.0+ds,wadllib==1.3.6,waitress==1.4.4,wcwidth==0.2.5,webencodings==0.5.1,WebOb==1.8.6,websocket-client==1.2.3,WebTest==2.0.35,Werkzeug==2.0.2,zc.lockfile==2.0,zipp==1.0.0,zope.event==4.4,zope.interface==5.4.0 2024-09-19T14:01:28.505 INFO:teuthology.orchestra.run.smithi153.stdout:py run-test-pre: PYTHONHASHSEED='558366832' 2024-09-19T14:01:28.505 INFO:teuthology.orchestra.run.smithi153.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-19T14:01:28.676 INFO:teuthology.orchestra.run.smithi153.stdout:============================= test session starts ============================== 2024-09-19T14:01:28.677 INFO:teuthology.orchestra.run.smithi153.stdout:platform linux -- Python 3.10.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-19T14:01:28.677 INFO:teuthology.orchestra.run.smithi153.stdout:cachedir: .tox/py/.pytest_cache 2024-09-19T14:01:28.677 INFO:teuthology.orchestra.run.smithi153.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0, configfile: pytest.ini 2024-09-19T14:01:28.844 INFO:teuthology.orchestra.run.smithi153.stdout:collecting ... collected 9 items 2024-09-19T14:01:28.844 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:01:39.891 INFO:teuthology.orchestra.run.smithi153.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-19T14:01:52.193 INFO:teuthology.orchestra.run.smithi153.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-19T14:02:02.178 INFO:teuthology.orchestra.run.smithi153.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-19T14:02:16.190 INFO:teuthology.orchestra.run.smithi153.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-19T14:02:28.114 INFO:teuthology.orchestra.run.smithi153.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-19T14:02:52.375 INFO:teuthology.orchestra.run.smithi153.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-19T14:03:16.671 INFO:teuthology.orchestra.run.smithi153.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-19T14:03:39.860 INFO:teuthology.orchestra.run.smithi153.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-19T14:04:22.858 INFO:teuthology.orchestra.run.smithi153.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-19T14:04:22.858 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:04:22.858 INFO:teuthology.orchestra.run.smithi153.stdout:=============================== warnings summary =============================== 2024-09-19T14:04:22.859 INFO:teuthology.orchestra.run.smithi153.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-19T14:04:22.859 INFO:teuthology.orchestra.run.smithi153.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-19T14:04:22.859 INFO:teuthology.orchestra.run.smithi153.stdout: import imp 2024-09-19T14:04:22.859 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:04:22.859 INFO:teuthology.orchestra.run.smithi153.stdout:-- Docs: https://docs.pytest.org/en/stable/warnings.html 2024-09-19T14:04:22.859 INFO:teuthology.orchestra.run.smithi153.stdout:=================== 9 passed, 1 warning in 174.18s (0:02:54) =================== 2024-09-19T14:04:22.910 INFO:teuthology.orchestra.run.smithi153.stdout:___________________________________ summary ____________________________________ 2024-09-19T14:04:22.910 INFO:teuthology.orchestra.run.smithi153.stdout: py: commands succeeded 2024-09-19T14:04:22.910 INFO:teuthology.orchestra.run.smithi153.stdout: congratulations :) 2024-09-19T14:04:22.941 INFO:tasks.ragweed:Cleaning up boto... 2024-09-19T14:04:22.941 DEBUG:teuthology.orchestra.run.smithi153:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-19T14:04:22.947 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-19T14:04:23.023 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:04:23.023 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:04:23.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.060+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.064+0000 7f974349f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:23.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.064+0000 7f974349f9c0 20 realm 2024-09-19T14:04:23.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.064+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.064+0000 7f974349f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:23.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.064+0000 7f974349f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:04:23.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.064+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.064+0000 7f974349f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:23.066 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.064+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.064+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:04:23.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.064+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.064+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:04:23.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.064+0000 7f974349f9c0 20 searching for the correct realm 2024-09-19T14:04:23.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.072+0000 7f97407a4640 0 -- 172.21.15.153:0/1854845865 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55dcda281aa0 msgr2=0x55dcda283f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:04:23.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.076+0000 7f9740fa5640 0 -- 172.21.15.153:0/1854845865 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f972800e920 msgr2=0x7f972802b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:04:23.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.084+0000 7f974349f9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:04:23.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.084+0000 7f974349f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:04:23.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.084+0000 7f974349f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:04:23.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.084+0000 7f974349f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:04:23.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.084+0000 7f974349f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:04:23.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.084+0000 7f974349f9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:04:23.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.084+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.084+0000 7f974349f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:23.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.084+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.084+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:04:23.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.084+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.084+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:04:23.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.084+0000 7f974349f9c0 20 zone default found 2024-09-19T14:04:23.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.084+0000 7f974349f9c0 4 Realm: () 2024-09-19T14:04:23.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.084+0000 7f974349f9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:04:23.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.084+0000 7f974349f9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:04:23.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.084+0000 7f974349f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:04:23.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.084+0000 7f974349f9c0 20 zonegroup default 2024-09-19T14:04:23.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.084+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.088+0000 7f974349f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:23.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.088+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.088+0000 7f974349f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:23.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.088+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.088+0000 7f974349f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:23.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.088+0000 7f974349f9c0 20 started sync module instance, tier type = 2024-09-19T14:04:23.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.088+0000 7f974349f9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:04:23.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.104+0000 7f974349f9c0 20 add_watcher() i=0 2024-09-19T14:04:23.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.104+0000 7f974349f9c0 20 add_watcher() i=1 2024-09-19T14:04:23.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.104+0000 7f974349f9c0 20 add_watcher() i=2 2024-09-19T14:04:23.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.104+0000 7f974349f9c0 20 add_watcher() i=3 2024-09-19T14:04:23.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.104+0000 7f974349f9c0 20 add_watcher() i=4 2024-09-19T14:04:23.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.104+0000 7f974349f9c0 20 add_watcher() i=5 2024-09-19T14:04:23.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.104+0000 7f974349f9c0 20 add_watcher() i=6 2024-09-19T14:04:23.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.104+0000 7f974349f9c0 20 add_watcher() i=7 2024-09-19T14:04:23.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.104+0000 7f974349f9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:04:23.108 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.108+0000 7f95f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:04:23.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.108+0000 7f974349f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:04:23.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.108+0000 7f974349f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:04:23.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.184+0000 7f95f5fe3640 20 reqs_thread_entry: start 2024-09-19T14:04:23.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.184+0000 7f974349f9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:04:23.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.184+0000 7f974349f9c0 20 Filter name: none 2024-09-19T14:04:23.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.184+0000 7f95677fe640 20 reqs_thread_entry: start 2024-09-19T14:04:23.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.184+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-19T14:04:23.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.184+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.184+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-19T14:04:23.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.184+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-19T14:04:23.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.184+0000 7f974349f9c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-19T14:04:23.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.184+0000 7f974349f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:04:23.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.184+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:dbb1da81-49d0-421a-b677-974869a7f103.4620.4 : miss 2024-09-19T14:04:23.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.184+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.184+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=426 2024-09-19T14:04:23.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.184+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:dbb1da81-49d0-421a-b677-974869a7f103.4620.4 info.flags=0x17 2024-09-19T14:04:23.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.184+0000 7f974349f9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:dbb1da81-49d0-421a-b677-974869a7f103.4620.4 to cache LRU end 2024-09-19T14:04:23.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.184+0000 7f974349f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:04:23.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.184+0000 7f974349f9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T14:04:23.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.184+0000 7f974349f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:dbb1da81-49d0-421a-b677-974869a7f103.4620.4 2024-09-19T14:04:23.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.188+0000 7f974349f9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-19T14:04:23.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.188+0000 7f974349f9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-19T14:04:23.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.188+0000 7f974349f9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-19T14:04:23.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.188+0000 7f974349f9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-19T14:04:23.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.192+0000 7f974349f9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-19T14:04:23.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.192+0000 7f974349f9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-19T14:04:23.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.192+0000 7f974349f9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-19T14:04:23.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.192+0000 7f974349f9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-19T14:04:23.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.192+0000 7f974349f9c0 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-19T14:04:23.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.196+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda09f480 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55dcda33c118 s->prefetch_data=0 2024-09-19T14:04:23.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.196+0000 7f974349f9c0 10 manifest: total_size = 7822 2024-09-19T14:04:23.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.196+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.17827615660066138635 2024-09-19T14:04:23.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.196+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda09f480 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55dcda33c118 s->prefetch_data=0 2024-09-19T14:04:23.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.196+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda33c118 2024-09-19T14:04:23.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.196+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.4.1 2024-09-19T14:04:23.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.200+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.200+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=7822 stripe_ofs=7822 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.200+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.17827615660066138635 2024-09-19T14:04:23.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.200+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.200+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.4__shadow_.foVxOdlrfeIn-uH3JsxqyOVgKyICnGW_0 2024-09-19T14:04:23.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.200+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-19T14:04:23.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.200+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.200+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.17827615660066138635 2024-09-19T14:04:23.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.204+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda09f480 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55dcda2c6d48 s->prefetch_data=0 2024-09-19T14:04:23.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.204+0000 7f9617fff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-19T14:04:23.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.204+0000 7f974349f9c0 10 manifest: total_size = 4894 2024-09-19T14:04:23.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.204+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.422249476256398722 2024-09-19T14:04:23.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.204+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda09f480 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55dcda2c6d48 s->prefetch_data=0 2024-09-19T14:04:23.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.204+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2c6d48 2024-09-19T14:04:23.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.204+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.4.2 2024-09-19T14:04:23.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.208+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.208+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=4894 stripe_ofs=4894 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.208+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.422249476256398722 2024-09-19T14:04:23.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.208+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.208+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.4__shadow_.8MI1i38uRC7vo0S56CRoSniIUD_dIyJ_0 2024-09-19T14:04:23.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.208+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-09-19T14:04:23.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.208+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.208+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.422249476256398722 2024-09-19T14:04:23.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.208+0000 7f96177fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-19T14:04:23.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.212+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda09f480 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55dcda2c6728 s->prefetch_data=0 2024-09-19T14:04:23.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.212+0000 7f974349f9c0 10 manifest: total_size = 5244 2024-09-19T14:04:23.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.212+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.8653622387482853806 2024-09-19T14:04:23.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.212+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda09f480 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55dcda2c6728 s->prefetch_data=0 2024-09-19T14:04:23.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.212+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2c6728 2024-09-19T14:04:23.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.212+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.4.2 2024-09-19T14:04:23.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.216+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.216+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=5244 stripe_ofs=5244 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.216+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.8653622387482853806 2024-09-19T14:04:23.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.216+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.216+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.4__shadow_.oYYWuqu75os4UolXPPP1wLLsM_nrSvl_0 2024-09-19T14:04:23.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.216+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-19T14:04:23.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.216+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.216+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.8653622387482853806 2024-09-19T14:04:23.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.216+0000 7f9617fff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-19T14:04:23.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.220+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda09f480 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55dcda2c6728 s->prefetch_data=0 2024-09-19T14:04:23.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.220+0000 7f974349f9c0 10 manifest: total_size = 5009 2024-09-19T14:04:23.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.220+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.6649574451367894515 2024-09-19T14:04:23.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.220+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda09f480 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55dcda2c6728 s->prefetch_data=0 2024-09-19T14:04:23.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.220+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2c6728 2024-09-19T14:04:23.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.220+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.4.3 2024-09-19T14:04:23.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.224+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.224+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=5009 stripe_ofs=5009 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.224+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.6649574451367894515 2024-09-19T14:04:23.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.224+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.224+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.4__shadow_.F5Shp80EjVR2IDfckPv_OS_-sSNTHQL_0 2024-09-19T14:04:23.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.224+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-19T14:04:23.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.224+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.224+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.6649574451367894515 2024-09-19T14:04:23.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.228+0000 7f96177fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-19T14:04:23.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.228+0000 7f974349f9c0 20 get_obj_state: octx=0x7f97380614a0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55dcda2c6728 s->prefetch_data=0 2024-09-19T14:04:23.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.228+0000 7f974349f9c0 10 manifest: total_size = 13113 2024-09-19T14:04:23.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.228+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.4178344867688157240 2024-09-19T14:04:23.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.228+0000 7f974349f9c0 20 get_obj_state: octx=0x7f97380614a0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55dcda2c6728 s->prefetch_data=0 2024-09-19T14:04:23.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.228+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2c6728 2024-09-19T14:04:23.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.228+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.4.4 2024-09-19T14:04:23.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.236+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.236+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=13113 stripe_ofs=13113 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.236+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.4178344867688157240 2024-09-19T14:04:23.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.236+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.236+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.4__shadow_.32O873Awlq-uHJCb-Df06YqN8YfFVi6_0 2024-09-19T14:04:23.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.236+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-19T14:04:23.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.236+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.236+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.4178344867688157240 2024-09-19T14:04:23.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.240+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2bdd20 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55dcda2c6728 s->prefetch_data=0 2024-09-19T14:04:23.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.240+0000 7f974349f9c0 10 manifest: total_size = 13593 2024-09-19T14:04:23.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.240+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.15913883814763264558 2024-09-19T14:04:23.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.240+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2bdd20 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55dcda2c6728 s->prefetch_data=0 2024-09-19T14:04:23.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.240+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2c6728 2024-09-19T14:04:23.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.240+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.4.4 2024-09-19T14:04:23.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.240+0000 7f9617fff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-19T14:04:23.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.244+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.244+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=13593 stripe_ofs=13593 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.244+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.15913883814763264558 2024-09-19T14:04:23.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.244+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.244+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.4__shadow_.BNgTuocLWablOeVrDysMgA7OfcavrLv_0 2024-09-19T14:04:23.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.244+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-19T14:04:23.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.244+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.244+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.15913883814763264558 2024-09-19T14:04:23.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.248+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2be1f0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55dcda2c6728 s->prefetch_data=0 2024-09-19T14:04:23.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.248+0000 7f974349f9c0 10 manifest: total_size = 7530 2024-09-19T14:04:23.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.248+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.3490275289947623924 2024-09-19T14:04:23.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.248+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2be1f0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55dcda2c6728 s->prefetch_data=0 2024-09-19T14:04:23.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.248+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2c6728 2024-09-19T14:04:23.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.248+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.4.5 2024-09-19T14:04:23.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.248+0000 7f96177fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-19T14:04:23.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.252+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.252+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=7530 stripe_ofs=7530 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.252+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.3490275289947623924 2024-09-19T14:04:23.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.252+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.252+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.4__shadow_.gdG2oG44r7k5gdAOZr4fLvYvb--elMF_0 2024-09-19T14:04:23.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.252+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-19T14:04:23.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.252+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.252+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.3490275289947623924 2024-09-19T14:04:23.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.252+0000 7f9617fff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-19T14:04:23.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.256+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2bdd20 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55dcda2c9fa8 s->prefetch_data=0 2024-09-19T14:04:23.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.256+0000 7f974349f9c0 10 manifest: total_size = 5180 2024-09-19T14:04:23.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.256+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.13606628105662687129 2024-09-19T14:04:23.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.256+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2bdd20 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55dcda2c9fa8 s->prefetch_data=0 2024-09-19T14:04:23.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.256+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2c9fa8 2024-09-19T14:04:23.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.256+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.4.7 2024-09-19T14:04:23.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.260+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.260+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=5180 stripe_ofs=5180 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.260+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.13606628105662687129 2024-09-19T14:04:23.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.260+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.260+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.4__shadow_.-6iBglF2QHoSR8PMSVCLwZqQHiK1KwP_0 2024-09-19T14:04:23.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.260+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-19T14:04:23.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.260+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.260+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.13606628105662687129 2024-09-19T14:04:23.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.264+0000 7f96177fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-19T14:04:23.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.264+0000 7f974349f9c0 20 get_obj_state: octx=0x7f97380614a0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55dcda2c9fa8 s->prefetch_data=0 2024-09-19T14:04:23.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.264+0000 7f974349f9c0 10 manifest: total_size = 7786 2024-09-19T14:04:23.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.264+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.4766458164952537867 2024-09-19T14:04:23.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.264+0000 7f974349f9c0 20 get_obj_state: octx=0x7f97380614a0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55dcda2c9fa8 s->prefetch_data=0 2024-09-19T14:04:23.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.264+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2c9fa8 2024-09-19T14:04:23.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.264+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.4.8 2024-09-19T14:04:23.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.268+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.268+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=7786 stripe_ofs=7786 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.268+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.4766458164952537867 2024-09-19T14:04:23.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.268+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.268+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.4__shadow_.ungRs7FWqQ-6Pa_M91RDr_Icma6cME-_0 2024-09-19T14:04:23.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.268+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-19T14:04:23.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.268+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.268+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.4766458164952537867 2024-09-19T14:04:23.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.272+0000 7f9617fff640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-19T14:04:23.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.272+0000 7f974349f9c0 20 list_objects_ordered: starting attempt 1 2024-09-19T14:04:23.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.272+0000 7f974349f9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T14:04:23.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.276+0000 7f974349f9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T14:04:23.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.276+0000 7f974349f9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T14:04:23.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.276+0000 7f974349f9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T14:04:23.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.276+0000 7f974349f9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T14:04:23.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.276+0000 7f974349f9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[dbb1da81-49d0-421a-b677-974869a7f103.4620.4])"; uploads.size()=0; is_truncated=0 2024-09-19T14:04:23.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.280+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-19T14:04:23.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.280+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.280+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=204 2024-09-19T14:04:23.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.280+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-19T14:04:23.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.280+0000 7f974349f9c0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-19T14:04:23.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.280+0000 7f974349f9c0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-19T14:04:23.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.280+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-19T14:04:23.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.284+0000 7f96177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333470 cookie 94407041235520 notifier 5916 bl.length()=162 2024-09-19T14:04:23.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.288+0000 7f974349f9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:dbb1da81-49d0-421a-b677-974869a7f103.4620.4 from cache 2024-09-19T14:04:23.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.288+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:dbb1da81-49d0-421a-b677-974869a7f103.4620.4, ofs0, ns] 2024-09-19T14:04:23.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.288+0000 7f96177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333491 cookie 94407041281760 notifier 5916 bl.length()=219 2024-09-19T14:04:23.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.296+0000 7f974349f9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/dbb1da81-49d0-421a-b677-974869a7f103.4620.4 : miss 2024-09-19T14:04:23.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.296+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.296+0000 7f974349f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:23.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.296+0000 7f974349f9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/dbb1da81-49d0-421a-b677-974869a7f103.4620.4 info.flags=0x0 2024-09-19T14:04:23.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.296+0000 7f974349f9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/dbb1da81-49d0-421a-b677-974869a7f103.4620.4 to cache LRU end 2024-09-19T14:04:23.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.304+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.11 : miss 2024-09-19T14:04:23.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.304+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.304+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=457 2024-09-19T14:04:23.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.304+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.11 info.flags=0x17 2024-09-19T14:04:23.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.304+0000 7f974349f9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.11 to cache LRU end 2024-09-19T14:04:23.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.304+0000 7f974349f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:04:23.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.304+0000 7f974349f9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T14:04:23.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.304+0000 7f974349f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.11 2024-09-19T14:04:23.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.312+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo 2024-09-19T14:04:23.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.312+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda33e530 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55dcda2bc598 s->prefetch_data=0 2024-09-19T14:04:23.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.316+0000 7f974349f9c0 10 manifest: total_size = 26080 2024-09-19T14:04:23.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.316+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.9795390011498088292 2024-09-19T14:04:23.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.316+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda33e530 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55dcda2bc598 s->prefetch_data=0 2024-09-19T14:04:23.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.316+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2bc598 2024-09-19T14:04:23.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.316+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.11.10 2024-09-19T14:04:23.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.320+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2024-09-19T14:04:23.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.320+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7672 2024-09-19T14:04:23.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.320+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7670 2024-09-19T14:04:23.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.320+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2024-09-19T14:04:23.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.320+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6299128 part_ofs=7672 rule->part_size=7670 2024-09-19T14:04:23.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.320+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=7671 2024-09-19T14:04:23.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.320+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=4 2024-09-19T14:04:23.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.320+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6306798 part_ofs=15342 rule->part_size=7671 2024-09-19T14:04:23.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.320+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=23013 stripe_ofs=23013 part_ofs=23013 rule->part_size=3067 2024-09-19T14:04:23.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.320+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2024-09-19T14:04:23.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.320+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6314469 part_ofs=23013 rule->part_size=3067 2024-09-19T14:04:23.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.320+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=26080 stripe_ofs=26080 part_ofs=26080 rule->part_size=3067 2024-09-19T14:04:23.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.320+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.9795390011498088292 2024-09-19T14:04:23.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.320+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.320+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.11__multipart_foo.2~u1x7piUIbzltodLQxlcFMYVShpwBwb1.1 2024-09-19T14:04:23.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.320+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-19T14:04:23.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.320+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.11__multipart_foo.2~u1x7piUIbzltodLQxlcFMYVShpwBwb1.2 2024-09-19T14:04:23.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.320+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-19T14:04:23.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.320+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.11__multipart_foo.2~u1x7piUIbzltodLQxlcFMYVShpwBwb1.3 2024-09-19T14:04:23.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.320+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-19T14:04:23.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.320+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.11__multipart_foo.2~u1x7piUIbzltodLQxlcFMYVShpwBwb1.4 2024-09-19T14:04:23.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.320+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-19T14:04:23.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.320+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.320+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.9795390011498088292 2024-09-19T14:04:23.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.324+0000 7f9617fff640 20 handle_completion(): completion ok for obj=foo 2024-09-19T14:04:23.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.324+0000 7f974349f9c0 20 list_objects_ordered: starting attempt 1 2024-09-19T14:04:23.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.324+0000 7f974349f9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T14:04:23.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.324+0000 7f974349f9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T14:04:23.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.324+0000 7f974349f9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T14:04:23.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.324+0000 7f974349f9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T14:04:23.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.324+0000 7f974349f9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T14:04:23.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.324+0000 7f974349f9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[dbb1da81-49d0-421a-b677-974869a7f103.4620.11])"; uploads.size()=0; is_truncated=0 2024-09-19T14:04:23.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.328+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-19T14:04:23.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.328+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.332+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=235 2024-09-19T14:04:23.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.332+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-19T14:04:23.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.332+0000 7f974349f9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-19T14:04:23.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.336+0000 7f974349f9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-19T14:04:23.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.336+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-19T14:04:23.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.336+0000 7f9617fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333492 cookie 94407041281760 notifier 5916 bl.length()=191 2024-09-19T14:04:23.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.340+0000 7f974349f9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.11 from cache 2024-09-19T14:04:23.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.340+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.11, ofs0, ns] 2024-09-19T14:04:23.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.340+0000 7f9617fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333455 cookie 94407041292512 notifier 5916 bl.length()=249 2024-09-19T14:04:23.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.352+0000 7f974349f9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.11 : miss 2024-09-19T14:04:23.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.352+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.352+0000 7f974349f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:23.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.352+0000 7f974349f9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.11 info.flags=0x0 2024-09-19T14:04:23.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.352+0000 7f974349f9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.11 to cache LRU end 2024-09-19T14:04:23.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.356+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.12 : miss 2024-09-19T14:04:23.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.356+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.356+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=464 2024-09-19T14:04:23.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.356+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.12 info.flags=0x17 2024-09-19T14:04:23.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.356+0000 7f974349f9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.12 to cache LRU end 2024-09-19T14:04:23.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.356+0000 7f974349f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:04:23.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.356+0000 7f974349f9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T14:04:23.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.356+0000 7f974349f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.12 2024-09-19T14:04:23.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.368+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo 2024-09-19T14:04:23.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.368+0000 7f974349f9c0 20 get_obj_state: octx=0x7f97300b3160 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55dcda2c1e48 s->prefetch_data=0 2024-09-19T14:04:23.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.368+0000 7f974349f9c0 10 manifest: total_size = 74198 2024-09-19T14:04:23.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.368+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.10064598267397148524 2024-09-19T14:04:23.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.368+0000 7f974349f9c0 20 get_obj_state: octx=0x7f97300b3160 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55dcda2c1e48 s->prefetch_data=0 2024-09-19T14:04:23.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.368+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2c1e48 2024-09-19T14:04:23.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.368+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.12.10 2024-09-19T14:04:23.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.376+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-19T14:04:23.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.376+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-19T14:04:23.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.376+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-19T14:04:23.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.376+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-19T14:04:23.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.376+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-19T14:04:23.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.376+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-19T14:04:23.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.376+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-19T14:04:23.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.376+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=20613 2024-09-19T14:04:23.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.376+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-19T14:04:23.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.376+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-19T14:04:23.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.376+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6353295 part_ofs=61839 rule->part_size=12359 2024-09-19T14:04:23.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.376+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-19T14:04:23.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.376+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.10064598267397148524 2024-09-19T14:04:23.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.376+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.376+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.12__multipart_foo.2~_4ig7ItERt0z7_fG9W5LmIoC59khzWQ.1 2024-09-19T14:04:23.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.376+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-19T14:04:23.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.376+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.12__multipart_foo.2~_4ig7ItERt0z7_fG9W5LmIoC59khzWQ.2 2024-09-19T14:04:23.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.376+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-19T14:04:23.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.376+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.12__multipart_foo.2~_4ig7ItERt0z7_fG9W5LmIoC59khzWQ.3 2024-09-19T14:04:23.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.376+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-19T14:04:23.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.376+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.12__multipart_foo.2~_4ig7ItERt0z7_fG9W5LmIoC59khzWQ.4 2024-09-19T14:04:23.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.376+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-19T14:04:23.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.376+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.376+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.10064598267397148524 2024-09-19T14:04:23.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.380+0000 7f9617fff640 20 handle_completion(): completion ok for obj=foo 2024-09-19T14:04:23.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.380+0000 7f974349f9c0 20 list_objects_ordered: starting attempt 1 2024-09-19T14:04:23.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.380+0000 7f974349f9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T14:04:23.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.384+0000 7f974349f9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T14:04:23.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.384+0000 7f974349f9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T14:04:23.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.384+0000 7f974349f9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T14:04:23.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.384+0000 7f974349f9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T14:04:23.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.384+0000 7f974349f9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[dbb1da81-49d0-421a-b677-974869a7f103.4620.12])"; uploads.size()=0; is_truncated=0 2024-09-19T14:04:23.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.388+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-19T14:04:23.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.388+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.388+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=242 2024-09-19T14:04:23.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.388+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-19T14:04:23.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.388+0000 7f974349f9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-19T14:04:23.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.392+0000 7f974349f9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-19T14:04:23.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.392+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-19T14:04:23.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.392+0000 7f96177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333505 cookie 94407041278352 notifier 5916 bl.length()=198 2024-09-19T14:04:23.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.400+0000 7f974349f9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.12 from cache 2024-09-19T14:04:23.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.400+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.12, ofs0, ns] 2024-09-19T14:04:23.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.400+0000 7f9617fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333506 cookie 94407041278352 notifier 5916 bl.length()=256 2024-09-19T14:04:23.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.408+0000 7f974349f9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.12 : miss 2024-09-19T14:04:23.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.408+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.408+0000 7f974349f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:23.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.408+0000 7f974349f9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.12 info.flags=0x0 2024-09-19T14:04:23.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.408+0000 7f974349f9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.12 to cache LRU end 2024-09-19T14:04:23.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.416+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.10 : miss 2024-09-19T14:04:23.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.416+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.416+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=459 2024-09-19T14:04:23.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.416+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.10 info.flags=0x17 2024-09-19T14:04:23.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.416+0000 7f974349f9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.10 to cache LRU end 2024-09-19T14:04:23.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.416+0000 7f974349f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:04:23.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.416+0000 7f974349f9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T14:04:23.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.416+0000 7f974349f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.10 2024-09-19T14:04:23.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.428+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo[xFwvOwm38D3YqUTW-scSVPdRA6qQBqn] 2024-09-19T14:04:23.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.428+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.10.10 2024-09-19T14:04:23.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.428+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2be2c0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.428+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to kzmbvaw4qg0vncwex1fbs00mdh9aq5oe 2024-09-19T14:04:23.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.428+0000 7f974349f9c0 20 get_obj_state_impl: setting s->olh_tag to it9b9siwfvgak4edp2dl1ixaq27wg8zh 2024-09-19T14:04:23.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.428+0000 7f974349f9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=it9b9siwfvgak4edp2dl1ixaq27wg8zh 2024-09-19T14:04:23.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.432+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.10.10 2024-09-19T14:04:23.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.436+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.10.10 2024-09-19T14:04:23.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.436+0000 7f974349f9c0 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-19T14:04:23.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.436+0000 7f974349f9c0 20 olh_log_entry: epoch=3 op=3 key=foo[xFwvOwm38D3YqUTW-scSVPdRA6qQBqn] 2024-09-19T14:04:23.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.436+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2be2c0 obj=test-client.0-r-test-multipart-index-versioning.1:_:xFwvOwm38D3YqUTW-scSVPdRA6qQBqn_foo state=0x55dcda2c1e48 s->prefetch_data=0 2024-09-19T14:04:23.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.440+0000 7f974349f9c0 10 manifest: total_size = 886297 2024-09-19T14:04:23.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.440+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.1352903799730838121 2024-09-19T14:04:23.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.440+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2be2c0 obj=test-client.0-r-test-multipart-index-versioning.1:_:xFwvOwm38D3YqUTW-scSVPdRA6qQBqn_foo state=0x55dcda2c1e48 s->prefetch_data=0 2024-09-19T14:04:23.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.440+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2c1e48 2024-09-19T14:04:23.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.440+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.10.10 2024-09-19T14:04:23.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.444+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-19T14:04:23.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.444+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-19T14:04:23.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.444+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-19T14:04:23.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.444+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-19T14:04:23.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.444+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-19T14:04:23.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.444+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-19T14:04:23.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.444+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-19T14:04:23.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.444+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2024-09-19T14:04:23.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.444+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-19T14:04:23.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.444+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-19T14:04:23.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.444+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2024-09-19T14:04:23.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.444+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-19T14:04:23.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.444+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.1352903799730838121 2024-09-19T14:04:23.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.444+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.444+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.10__multipart_foo.2~KjLH4T3u1TLtO0Ki4dLyZVrkJ3Akqhb.1 2024-09-19T14:04:23.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.444+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-19T14:04:23.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.444+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.10__multipart_foo.2~KjLH4T3u1TLtO0Ki4dLyZVrkJ3Akqhb.2 2024-09-19T14:04:23.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.444+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-19T14:04:23.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.444+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.10__multipart_foo.2~KjLH4T3u1TLtO0Ki4dLyZVrkJ3Akqhb.3 2024-09-19T14:04:23.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.444+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-19T14:04:23.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.444+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.10__multipart_foo.2~KjLH4T3u1TLtO0Ki4dLyZVrkJ3Akqhb.4 2024-09-19T14:04:23.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.444+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-19T14:04:23.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.444+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.444+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.1352903799730838121 2024-09-19T14:04:23.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.448+0000 7f96177fe640 20 handle_completion(): completion ok for obj=foo[xFwvOwm38D3YqUTW-scSVPdRA6qQBqn] 2024-09-19T14:04:23.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.452+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2be2c0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.456+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.10.10 2024-09-19T14:04:23.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.460+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.10.10 2024-09-19T14:04:23.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.460+0000 7f974349f9c0 20 list_objects_ordered: starting attempt 1 2024-09-19T14:04:23.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.460+0000 7f974349f9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T14:04:23.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.460+0000 7f974349f9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T14:04:23.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.460+0000 7f974349f9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T14:04:23.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.460+0000 7f974349f9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T14:04:23.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.460+0000 7f974349f9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T14:04:23.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.460+0000 7f974349f9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[dbb1da81-49d0-421a-b677-974869a7f103.4620.10])"; uploads.size()=0; is_truncated=0 2024-09-19T14:04:23.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.464+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-19T14:04:23.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.464+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.464+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=237 2024-09-19T14:04:23.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.464+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-19T14:04:23.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.464+0000 7f974349f9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-19T14:04:23.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.468+0000 7f974349f9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-19T14:04:23.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.468+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-19T14:04:23.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.468+0000 7f9617fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333507 cookie 94407041278352 notifier 5916 bl.length()=193 2024-09-19T14:04:23.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.476+0000 7f974349f9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.10 from cache 2024-09-19T14:04:23.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.476+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.10, ofs0, ns] 2024-09-19T14:04:23.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.476+0000 7f9617fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333471 cookie 94407041235520 notifier 5916 bl.length()=251 2024-09-19T14:04:23.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.488+0000 7f974349f9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.10 : miss 2024-09-19T14:04:23.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.488+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.488+0000 7f974349f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:23.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.488+0000 7f974349f9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.10 info.flags=0x0 2024-09-19T14:04:23.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.488+0000 7f974349f9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.10 to cache LRU end 2024-09-19T14:04:23.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.492+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.9 : miss 2024-09-19T14:04:23.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.492+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.496+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T14:04:23.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.496+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.9 info.flags=0x17 2024-09-19T14:04:23.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.496+0000 7f974349f9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.9 to cache LRU end 2024-09-19T14:04:23.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.496+0000 7f974349f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:04:23.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.496+0000 7f974349f9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T14:04:23.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.496+0000 7f974349f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.9 2024-09-19T14:04:23.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.504+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo 2024-09-19T14:04:23.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.504+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2e99d0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.504+0000 7f974349f9c0 10 manifest: total_size = 74198 2024-09-19T14:04:23.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.504+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.16035617935989659688 2024-09-19T14:04:23.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.504+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2e99d0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.504+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.504+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.9.10 2024-09-19T14:04:23.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.512+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-19T14:04:23.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.512+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-19T14:04:23.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.512+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-19T14:04:23.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.512+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-19T14:04:23.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.512+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-19T14:04:23.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.512+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-19T14:04:23.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.512+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-19T14:04:23.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.512+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=20613 2024-09-19T14:04:23.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.512+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-19T14:04:23.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.512+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-19T14:04:23.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.512+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6353295 part_ofs=61839 rule->part_size=12359 2024-09-19T14:04:23.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.512+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-19T14:04:23.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.512+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.16035617935989659688 2024-09-19T14:04:23.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.512+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.512+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.9__multipart_foo.2~4HLHgNSjQr0ts2lY2GB8ozQb6QuyqEb.1 2024-09-19T14:04:23.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.512+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2024-09-19T14:04:23.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.512+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.9__multipart_foo.2~4HLHgNSjQr0ts2lY2GB8ozQb6QuyqEb.2 2024-09-19T14:04:23.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.512+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 589 2024-09-19T14:04:23.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.512+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.9__multipart_foo.2~4HLHgNSjQr0ts2lY2GB8ozQb6QuyqEb.3 2024-09-19T14:04:23.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.512+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 833 2024-09-19T14:04:23.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.512+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.9__multipart_foo.2~4HLHgNSjQr0ts2lY2GB8ozQb6QuyqEb.4 2024-09-19T14:04:23.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.512+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1077 2024-09-19T14:04:23.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.512+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.512+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.16035617935989659688 2024-09-19T14:04:23.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.516+0000 7f96177fe640 20 handle_completion(): completion ok for obj=foo 2024-09-19T14:04:23.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.516+0000 7f974349f9c0 20 list_objects_ordered: starting attempt 1 2024-09-19T14:04:23.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.516+0000 7f974349f9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T14:04:23.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.516+0000 7f974349f9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T14:04:23.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.516+0000 7f974349f9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T14:04:23.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.516+0000 7f974349f9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T14:04:23.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.516+0000 7f974349f9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T14:04:23.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.516+0000 7f974349f9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[dbb1da81-49d0-421a-b677-974869a7f103.4620.9])"; uploads.size()=0; is_truncated=0 2024-09-19T14:04:23.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.524+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-19T14:04:23.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.524+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.524+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-19T14:04:23.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.524+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-19T14:04:23.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.524+0000 7f974349f9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-19T14:04:23.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.528+0000 7f974349f9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-19T14:04:23.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.528+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-19T14:04:23.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.528+0000 7f9617fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333472 cookie 94407041287792 notifier 5916 bl.length()=183 2024-09-19T14:04:23.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.532+0000 7f974349f9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.9 from cache 2024-09-19T14:04:23.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.532+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.9, ofs0, ns] 2024-09-19T14:04:23.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.532+0000 7f9617fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333456 cookie 94407041290016 notifier 5916 bl.length()=240 2024-09-19T14:04:23.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.544+0000 7f974349f9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.9 : miss 2024-09-19T14:04:23.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.544+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.544+0000 7f974349f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:23.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.544+0000 7f974349f9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.9 info.flags=0x0 2024-09-19T14:04:23.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.544+0000 7f974349f9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.9 to cache LRU end 2024-09-19T14:04:23.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.548+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.15 : miss 2024-09-19T14:04:23.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.548+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.548+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-19T14:04:23.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.548+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.15 info.flags=0x17 2024-09-19T14:04:23.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.548+0000 7f974349f9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.15 to cache LRU end 2024-09-19T14:04:23.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.548+0000 7f974349f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:04:23.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.548+0000 7f974349f9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T14:04:23.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.548+0000 7f974349f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.15 2024-09-19T14:04:23.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.552+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-19T14:04:23.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.552+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-19T14:04:23.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.552+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-19T14:04:23.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.556+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-19T14:04:23.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.556+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-19T14:04:23.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.556+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-19T14:04:23.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.556+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-19T14:04:23.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.556+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-19T14:04:23.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.556+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-19T14:04:23.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.560+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-19T14:04:23.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.560+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-19T14:04:23.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.560+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-19T14:04:23.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.560+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2bc6d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.560+0000 7f974349f9c0 10 manifest: total_size = 27196 2024-09-19T14:04:23.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.560+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to _yrz33Dcw5nSjxu2hXq6h4kFB9xpukRu 2024-09-19T14:04:23.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.560+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2bc6d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.560+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.560+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.15.0 2024-09-19T14:04:23.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.568+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.568+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=27196 stripe_ofs=27196 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.568+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _yrz33Dcw5nSjxu2hXq6h4kFB9xpukRu 2024-09-19T14:04:23.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.568+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.568+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.15__shadow_.JShZudM-p6IvYxoB-3CR0wtIVTSKySO_0 2024-09-19T14:04:23.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.568+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-19T14:04:23.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.568+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.568+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: _yrz33Dcw5nSjxu2hXq6h4kFB9xpukRu 2024-09-19T14:04:23.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.572+0000 7f96177fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-19T14:04:23.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.572+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2bc6d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.572+0000 7f974349f9c0 10 manifest: total_size = 5242880 2024-09-19T14:04:23.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.572+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to _yjWzopCcb_nwM_lt0gPc1TAj3wFj6GR 2024-09-19T14:04:23.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.572+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2bc6d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.572+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.572+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.15.2 2024-09-19T14:04:23.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.580+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.580+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.580+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _yjWzopCcb_nwM_lt0gPc1TAj3wFj6GR 2024-09-19T14:04:23.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.580+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.580+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.15__shadow_.f90KQDYtvCJ2CnPBw13R_Eo2PfTyHCW_0 2024-09-19T14:04:23.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.580+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-19T14:04:23.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.580+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.580+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: _yjWzopCcb_nwM_lt0gPc1TAj3wFj6GR 2024-09-19T14:04:23.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.584+0000 7f9617fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-19T14:04:23.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.584+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2c2a50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.584+0000 7f974349f9c0 10 manifest: total_size = 5242880 2024-09-19T14:04:23.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.584+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.3832944856944814271 2024-09-19T14:04:23.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.584+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2c2a50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.584+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.584+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.15.3 2024-09-19T14:04:23.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.592+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.592+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.592+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.3832944856944814271 2024-09-19T14:04:23.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.592+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.592+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.15__shadow_.II241UZMDUfUVydqDso3Pr7AkHHtThe_0 2024-09-19T14:04:23.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.592+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-19T14:04:23.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.592+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.592+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.3832944856944814271 2024-09-19T14:04:23.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.592+0000 7f96177fe640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-19T14:04:23.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.596+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2c14c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.596+0000 7f974349f9c0 10 manifest: total_size = 5242880 2024-09-19T14:04:23.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.596+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to _rxaSZkGLR4OtZyoeClZ4C88yts-KM86 2024-09-19T14:04:23.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.596+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2c14c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.596+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.596+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.15.5 2024-09-19T14:04:23.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.604+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.604+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.604+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _rxaSZkGLR4OtZyoeClZ4C88yts-KM86 2024-09-19T14:04:23.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.604+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.604+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.15__shadow_.W3vTGh9laMCueUC3fvKBDOoD2aYRDXP_0 2024-09-19T14:04:23.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.604+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-19T14:04:23.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.604+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.604+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: _rxaSZkGLR4OtZyoeClZ4C88yts-KM86 2024-09-19T14:04:23.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.604+0000 7f9617fff640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-19T14:04:23.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.608+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2d28f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.608+0000 7f974349f9c0 10 manifest: total_size = 5242880 2024-09-19T14:04:23.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.608+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to _X_RZ0V85I-VsmZEdc1OPWFuuzcCFUck 2024-09-19T14:04:23.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.608+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2d28f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.608+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.608+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.15.5 2024-09-19T14:04:23.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.612+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.612+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.612+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _X_RZ0V85I-VsmZEdc1OPWFuuzcCFUck 2024-09-19T14:04:23.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.612+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.612+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.15__shadow_.OqLjgMi5vpSKiPoyhQ84gx4uo3r_mwH_0 2024-09-19T14:04:23.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.612+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-19T14:04:23.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.612+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.612+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: _X_RZ0V85I-VsmZEdc1OPWFuuzcCFUck 2024-09-19T14:04:23.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.616+0000 7f96177fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-19T14:04:23.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.616+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2c14c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.620+0000 7f974349f9c0 10 manifest: total_size = 27196 2024-09-19T14:04:23.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.620+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.7058007794479037573 2024-09-19T14:04:23.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.620+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2c14c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.620+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.620+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.15.5 2024-09-19T14:04:23.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.624+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.624+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=27196 stripe_ofs=27196 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.624+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.7058007794479037573 2024-09-19T14:04:23.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.624+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.624+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.15__shadow_.UuB97-xnlolQi464p3aH_ShFoTd6SMO_0 2024-09-19T14:04:23.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.624+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-19T14:04:23.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.624+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.624+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.7058007794479037573 2024-09-19T14:04:23.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.628+0000 7f9617fff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-19T14:04:23.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.628+0000 7f974349f9c0 20 get_obj_state: octx=0x7f972804eba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.628+0000 7f974349f9c0 10 manifest: total_size = 5242880 2024-09-19T14:04:23.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.628+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to _jWQmW-Ex7G4WEFdD-PtpJsFWQltv8N8 2024-09-19T14:04:23.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.628+0000 7f974349f9c0 20 get_obj_state: octx=0x7f972804eba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.628+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.628+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.15.7 2024-09-19T14:04:23.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.636+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.636+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.636+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _jWQmW-Ex7G4WEFdD-PtpJsFWQltv8N8 2024-09-19T14:04:23.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.636+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.636+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.15__shadow_.md40X0lwf3bpMJ0udrwTITixRe3NvYC_0 2024-09-19T14:04:23.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.636+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-19T14:04:23.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.636+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.636+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _jWQmW-Ex7G4WEFdD-PtpJsFWQltv8N8 2024-09-19T14:04:23.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.636+0000 7f96177fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-19T14:04:23.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.636+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2c6210 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.640+0000 7f974349f9c0 10 manifest: total_size = 5242880 2024-09-19T14:04:23.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.640+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.1190598363351224324 2024-09-19T14:04:23.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.640+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2c6210 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.640+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.640+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.15.7 2024-09-19T14:04:23.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.644+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.644+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.644+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.1190598363351224324 2024-09-19T14:04:23.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.644+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.644+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.15__shadow_.O6aUo8iWv9ZHXZ9eQ78caatLsx9I3oP_0 2024-09-19T14:04:23.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.644+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-19T14:04:23.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.644+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.644+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.1190598363351224324 2024-09-19T14:04:23.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.648+0000 7f9617fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-19T14:04:23.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.652+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2c14c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.652+0000 7f974349f9c0 10 manifest: total_size = 27196 2024-09-19T14:04:23.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.652+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.5953696540504761295 2024-09-19T14:04:23.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.652+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2c14c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.652+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.652+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.15.7 2024-09-19T14:04:23.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.660+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.660+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=27196 stripe_ofs=27196 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.660+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.5953696540504761295 2024-09-19T14:04:23.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.660+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.660+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.15__shadow_.UuB97-xnlolQi464p3aH_ShFoTd6SMO_0 2024-09-19T14:04:23.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.660+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-19T14:04:23.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.660+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.660+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.5953696540504761295 2024-09-19T14:04:23.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.660+0000 7f974349f9c0 20 get_obj_state: octx=0x7f973805db90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.660+0000 7f96177fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-19T14:04:23.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.664+0000 7f974349f9c0 10 manifest: total_size = 5242880 2024-09-19T14:04:23.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.664+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.16690996911054858959 2024-09-19T14:04:23.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.664+0000 7f974349f9c0 20 get_obj_state: octx=0x7f973805db90 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.664+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.664+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.15.8 2024-09-19T14:04:23.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.668+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.668+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.668+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.16690996911054858959 2024-09-19T14:04:23.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.668+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.668+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.15__shadow_.O6aUo8iWv9ZHXZ9eQ78caatLsx9I3oP_0 2024-09-19T14:04:23.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.668+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-19T14:04:23.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.668+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.668+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.16690996911054858959 2024-09-19T14:04:23.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.672+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2c0d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.672+0000 7f9617fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-19T14:04:23.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.672+0000 7f974349f9c0 10 manifest: total_size = 27196 2024-09-19T14:04:23.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.672+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to _CD9XUJKmV65ekQVR3R1LWhMAlJ_0Jr3 2024-09-19T14:04:23.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.672+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2c0d30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.672+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.672+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.15.8 2024-09-19T14:04:23.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.680+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.680+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=27196 stripe_ofs=27196 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.680+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _CD9XUJKmV65ekQVR3R1LWhMAlJ_0Jr3 2024-09-19T14:04:23.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.680+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.680+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.15__shadow_.LaAyIMbiFzi3xEw5ARAWdLxLekfR3Tz_0 2024-09-19T14:04:23.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.680+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-19T14:04:23.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.680+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.680+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _CD9XUJKmV65ekQVR3R1LWhMAlJ_0Jr3 2024-09-19T14:04:23.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.684+0000 7f96177fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-19T14:04:23.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.684+0000 7f974349f9c0 20 get_obj_state: octx=0x7f97300b46d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.684+0000 7f974349f9c0 10 manifest: total_size = 5242880 2024-09-19T14:04:23.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.684+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.8553580146858518014 2024-09-19T14:04:23.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.684+0000 7f974349f9c0 20 get_obj_state: octx=0x7f97300b46d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.684+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.684+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.15.9 2024-09-19T14:04:23.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.692+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.692+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.692+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.8553580146858518014 2024-09-19T14:04:23.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.692+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.692+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.15__shadow_.II241UZMDUfUVydqDso3Pr7AkHHtThe_0 2024-09-19T14:04:23.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.692+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-19T14:04:23.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.692+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.692+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.8553580146858518014 2024-09-19T14:04:23.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.696+0000 7f974349f9c0 20 list_objects_ordered: starting attempt 1 2024-09-19T14:04:23.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.696+0000 7f9617fff640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-19T14:04:23.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.696+0000 7f974349f9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T14:04:23.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.696+0000 7f974349f9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T14:04:23.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.696+0000 7f974349f9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T14:04:23.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.696+0000 7f974349f9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T14:04:23.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.696+0000 7f974349f9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T14:04:23.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.696+0000 7f974349f9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[dbb1da81-49d0-421a-b677-974869a7f103.4620.15])"; uploads.size()=0; is_truncated=0 2024-09-19T14:04:23.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.700+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-19T14:04:23.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.700+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.704+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=233 2024-09-19T14:04:23.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.704+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-19T14:04:23.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.704+0000 7f974349f9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-19T14:04:23.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.704+0000 7f974349f9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-19T14:04:23.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.704+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-19T14:04:23.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.708+0000 7f96177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333508 cookie 94407041278352 notifier 5916 bl.length()=189 2024-09-19T14:04:23.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.712+0000 7f974349f9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.15 from cache 2024-09-19T14:04:23.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.712+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.15, ofs0, ns] 2024-09-19T14:04:23.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.712+0000 7f96177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333473 cookie 94407041235520 notifier 5916 bl.length()=247 2024-09-19T14:04:23.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.724+0000 7f974349f9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.15 : miss 2024-09-19T14:04:23.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.724+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.724+0000 7f974349f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:23.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.724+0000 7f974349f9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.15 info.flags=0x0 2024-09-19T14:04:23.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.724+0000 7f974349f9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.15 to cache LRU end 2024-09-19T14:04:23.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.728+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.16 : miss 2024-09-19T14:04:23.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.728+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.732+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-19T14:04:23.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.732+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.16 info.flags=0x17 2024-09-19T14:04:23.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.732+0000 7f974349f9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.16 to cache LRU end 2024-09-19T14:04:23.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.732+0000 7f974349f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:04:23.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.732+0000 7f974349f9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T14:04:23.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.732+0000 7f974349f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.16 2024-09-19T14:04:23.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.732+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-19T14:04:23.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.732+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-19T14:04:23.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.736+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-19T14:04:23.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.736+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-19T14:04:23.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.736+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-19T14:04:23.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.736+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-19T14:04:23.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.740+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-19T14:04:23.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.740+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-19T14:04:23.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.740+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-19T14:04:23.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.740+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-19T14:04:23.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.740+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-19T14:04:23.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.740+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-19T14:04:23.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.740+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2be1f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.744+0000 7f974349f9c0 10 manifest: total_size = 45360 2024-09-19T14:04:23.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.744+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to _YDuyuca_-DqspIs-865M1BXHBrNcSqD 2024-09-19T14:04:23.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.744+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2be1f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.744+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.744+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.16.0 2024-09-19T14:04:23.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.748+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.748+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.748+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _YDuyuca_-DqspIs-865M1BXHBrNcSqD 2024-09-19T14:04:23.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.748+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.748+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__shadow_.uWumSjRdaScGQrsFAV3Tv6zAZUDokwS_0 2024-09-19T14:04:23.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.748+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-19T14:04:23.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.748+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.748+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: _YDuyuca_-DqspIs-865M1BXHBrNcSqD 2024-09-19T14:04:23.756 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.752+0000 7f96177fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-19T14:04:23.756 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.752+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2bd0e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.756+0000 7f974349f9c0 10 manifest: total_size = 11534336 2024-09-19T14:04:23.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.756+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to _FEOgOSUtqc6U6EsHypUZOU2lTrSzK00 2024-09-19T14:04:23.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.756+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2bd0e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.756+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.756+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.16.2 2024-09-19T14:04:23.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.760+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.760+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.760+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.760+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.760+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _FEOgOSUtqc6U6EsHypUZOU2lTrSzK00 2024-09-19T14:04:23.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.760+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.760+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__shadow_.vq_4kcHnDyOXnLdCsQkJYlBhyCP7A64_0 2024-09-19T14:04:23.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.760+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-19T14:04:23.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.760+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__shadow_.vq_4kcHnDyOXnLdCsQkJYlBhyCP7A64_1 2024-09-19T14:04:23.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.760+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-19T14:04:23.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.760+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.760+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _FEOgOSUtqc6U6EsHypUZOU2lTrSzK00 2024-09-19T14:04:23.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.764+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2be1f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.764+0000 7f9617fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-19T14:04:23.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.764+0000 7f974349f9c0 10 manifest: total_size = 11534336 2024-09-19T14:04:23.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.764+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.10524623683236933189 2024-09-19T14:04:23.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.764+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2be1f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.764+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.764+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.16.3 2024-09-19T14:04:23.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.772+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T14:04:23.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.772+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-19T14:04:23.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.772+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-19T14:04:23.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.772+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T14:04:23.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.772+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-19T14:04:23.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.772+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-19T14:04:23.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.772+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-19T14:04:23.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.772+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-19T14:04:23.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.772+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-19T14:04:23.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.772+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.10524623683236933189 2024-09-19T14:04:23.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.772+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.772+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-FROZEN.2~aNp3UJLE-ddNB0MK-NwhIY1m03unpN0.1 2024-09-19T14:04:23.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.772+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-19T14:04:23.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.772+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-FROZEN.2~aNp3UJLE-ddNB0MK-NwhIY1m03unpN0.2 2024-09-19T14:04:23.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.772+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-19T14:04:23.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.772+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-FROZEN.2~aNp3UJLE-ddNB0MK-NwhIY1m03unpN0.3 2024-09-19T14:04:23.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.772+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-19T14:04:23.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.772+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.772+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.10524623683236933189 2024-09-19T14:04:23.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.776+0000 7f96177fe640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-19T14:04:23.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.776+0000 7f974349f9c0 20 get_obj_state: octx=0x7f9730115f70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.776+0000 7f974349f9c0 10 manifest: total_size = 11534336 2024-09-19T14:04:23.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.776+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to _haeBKhhDH9oevNwKbx-HPwYet0k6yas 2024-09-19T14:04:23.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.776+0000 7f974349f9c0 20 get_obj_state: octx=0x7f9730115f70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.776+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.776+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.16.5 2024-09-19T14:04:23.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.784+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.784+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.784+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.784+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.784+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _haeBKhhDH9oevNwKbx-HPwYet0k6yas 2024-09-19T14:04:23.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.784+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.784+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__shadow_.zJFJTBE2lTIKUrmJmHJu2X9Yzdbt6ZY_0 2024-09-19T14:04:23.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.784+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-19T14:04:23.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.784+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__shadow_.zJFJTBE2lTIKUrmJmHJu2X9Yzdbt6ZY_1 2024-09-19T14:04:23.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.784+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-19T14:04:23.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.784+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.784+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: _haeBKhhDH9oevNwKbx-HPwYet0k6yas 2024-09-19T14:04:23.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.788+0000 7f9617fff640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-19T14:04:23.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.788+0000 7f974349f9c0 20 get_obj_state: octx=0x7f9730115f70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.788+0000 7f974349f9c0 10 manifest: total_size = 11534336 2024-09-19T14:04:23.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.788+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to _o9-waX3UtRdxCavWAcOqN6rbtOZY22L 2024-09-19T14:04:23.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.788+0000 7f974349f9c0 20 get_obj_state: octx=0x7f9730115f70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.788+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.788+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.16.5 2024-09-19T14:04:23.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.796+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.796+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.796+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.796+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.796+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _o9-waX3UtRdxCavWAcOqN6rbtOZY22L 2024-09-19T14:04:23.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.796+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.796+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__shadow_.b3WIX43Km5Ep9sylj9caA-GDUsDRg3j_0 2024-09-19T14:04:23.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.796+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-19T14:04:23.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.796+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__shadow_.b3WIX43Km5Ep9sylj9caA-GDUsDRg3j_1 2024-09-19T14:04:23.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.796+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-19T14:04:23.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.796+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.796+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _o9-waX3UtRdxCavWAcOqN6rbtOZY22L 2024-09-19T14:04:23.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.800+0000 7f96177fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-19T14:04:23.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.800+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda0b98b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.800+0000 7f974349f9c0 10 manifest: total_size = 45360 2024-09-19T14:04:23.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.800+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.14041222050183837016 2024-09-19T14:04:23.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.800+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda0b98b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.800+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.800+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.16.5 2024-09-19T14:04:23.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.808+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-19T14:04:23.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.808+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-19T14:04:23.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.808+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-19T14:04:23.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.808+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-19T14:04:23.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.808+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-19T14:04:23.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.808+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-19T14:04:23.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.808+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-19T14:04:23.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.808+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=4134 2024-09-19T14:04:23.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.808+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-19T14:04:23.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.808+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.14041222050183837016 2024-09-19T14:04:23.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.808+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.808+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-STANDARD.2~gdE6JUtwpyru8uk8HI9hGMJGNYHW-Gl.1 2024-09-19T14:04:23.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.808+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-19T14:04:23.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.808+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-STANDARD.2~gdE6JUtwpyru8uk8HI9hGMJGNYHW-Gl.2 2024-09-19T14:04:23.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.808+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-19T14:04:23.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.808+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-STANDARD.2~gdE6JUtwpyru8uk8HI9hGMJGNYHW-Gl.3 2024-09-19T14:04:23.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.808+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-19T14:04:23.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.808+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.808+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.14041222050183837016 2024-09-19T14:04:23.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.808+0000 7f9617fff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-19T14:04:23.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.812+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda272b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.812+0000 7f974349f9c0 10 manifest: total_size = 11534336 2024-09-19T14:04:23.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.812+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to _ZStxhGynjSJ0z0GIC14XU-uEhnHGtnx 2024-09-19T14:04:23.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.812+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda272b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.812+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.812+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.16.7 2024-09-19T14:04:23.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.816+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.816+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.816+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.816+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.816+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _ZStxhGynjSJ0z0GIC14XU-uEhnHGtnx 2024-09-19T14:04:23.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.816+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.816+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__shadow_.BH1J5u-QHCV16PU1xTD0BL6wzgSDflk_0 2024-09-19T14:04:23.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.816+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-19T14:04:23.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.816+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__shadow_.BH1J5u-QHCV16PU1xTD0BL6wzgSDflk_1 2024-09-19T14:04:23.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.816+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-19T14:04:23.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.816+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.816+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _ZStxhGynjSJ0z0GIC14XU-uEhnHGtnx 2024-09-19T14:04:23.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.820+0000 7f974349f9c0 20 get_obj_state: octx=0x7f973805db90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.824+0000 7f96177fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-19T14:04:23.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.824+0000 7f974349f9c0 10 manifest: total_size = 11534336 2024-09-19T14:04:23.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.824+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.9056505395412840070 2024-09-19T14:04:23.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.824+0000 7f974349f9c0 20 get_obj_state: octx=0x7f973805db90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.824+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.824+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.16.7 2024-09-19T14:04:23.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.832+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T14:04:23.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.832+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-19T14:04:23.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.832+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-19T14:04:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.832+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T14:04:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.832+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-19T14:04:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.832+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-19T14:04:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.832+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-19T14:04:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.832+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-19T14:04:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.832+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-19T14:04:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.832+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.9056505395412840070 2024-09-19T14:04:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.832+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.832+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-LUKEWARM.2~TFTCNQOpN5N-SocSR7HizO4F2TDXQ8_.1 2024-09-19T14:04:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.832+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-19T14:04:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.832+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-LUKEWARM.2~TFTCNQOpN5N-SocSR7HizO4F2TDXQ8_.2 2024-09-19T14:04:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.832+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-19T14:04:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.832+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-LUKEWARM.2~TFTCNQOpN5N-SocSR7HizO4F2TDXQ8_.3 2024-09-19T14:04:23.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.832+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-19T14:04:23.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.832+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.832+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.9056505395412840070 2024-09-19T14:04:23.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.832+0000 7f9617fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-19T14:04:23.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.836+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2e99d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.836+0000 7f974349f9c0 10 manifest: total_size = 45360 2024-09-19T14:04:23.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.836+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.14420163408792039922 2024-09-19T14:04:23.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.836+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2e99d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.836+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.836+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.16.7 2024-09-19T14:04:23.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.844+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-19T14:04:23.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.844+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-19T14:04:23.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.844+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-19T14:04:23.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.844+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-19T14:04:23.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.844+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-19T14:04:23.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.844+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-19T14:04:23.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.844+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-19T14:04:23.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.844+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=4134 2024-09-19T14:04:23.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.844+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-19T14:04:23.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.844+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.14420163408792039922 2024-09-19T14:04:23.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.844+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.844+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-STANDARD.2~gdE6JUtwpyru8uk8HI9hGMJGNYHW-Gl.1 2024-09-19T14:04:23.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.844+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-19T14:04:23.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.844+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-STANDARD.2~gdE6JUtwpyru8uk8HI9hGMJGNYHW-Gl.2 2024-09-19T14:04:23.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.844+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-19T14:04:23.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.844+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-STANDARD.2~gdE6JUtwpyru8uk8HI9hGMJGNYHW-Gl.3 2024-09-19T14:04:23.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.844+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-19T14:04:23.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.844+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.844+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.14420163408792039922 2024-09-19T14:04:23.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.848+0000 7f96177fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-19T14:04:23.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.848+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2daf50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.848+0000 7f974349f9c0 10 manifest: total_size = 11534336 2024-09-19T14:04:23.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.848+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.8105432631187531668 2024-09-19T14:04:23.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.848+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2daf50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.848+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.848+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.16.8 2024-09-19T14:04:23.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.856+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T14:04:23.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.856+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-19T14:04:23.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.856+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-19T14:04:23.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.856+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T14:04:23.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.856+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-19T14:04:23.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.856+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-19T14:04:23.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.856+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-19T14:04:23.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.856+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-19T14:04:23.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.856+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-19T14:04:23.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.856+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.8105432631187531668 2024-09-19T14:04:23.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.856+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.856+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-LUKEWARM.2~TFTCNQOpN5N-SocSR7HizO4F2TDXQ8_.1 2024-09-19T14:04:23.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.856+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-19T14:04:23.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.856+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-LUKEWARM.2~TFTCNQOpN5N-SocSR7HizO4F2TDXQ8_.2 2024-09-19T14:04:23.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.856+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-19T14:04:23.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.856+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-LUKEWARM.2~TFTCNQOpN5N-SocSR7HizO4F2TDXQ8_.3 2024-09-19T14:04:23.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.856+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-19T14:04:23.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.856+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.856+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.8105432631187531668 2024-09-19T14:04:23.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.860+0000 7f9617fff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-19T14:04:23.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.860+0000 7f974349f9c0 20 get_obj_state: octx=0x7f9730115f70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.860+0000 7f974349f9c0 10 manifest: total_size = 45360 2024-09-19T14:04:23.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.860+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to _zSMA_wKPHNnahRuC98JWrDsiNbGNmAF 2024-09-19T14:04:23.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.860+0000 7f974349f9c0 20 get_obj_state: octx=0x7f9730115f70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.860+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.860+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.16.8 2024-09-19T14:04:23.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.868+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:23.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.868+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-09-19T14:04:23.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.868+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _zSMA_wKPHNnahRuC98JWrDsiNbGNmAF 2024-09-19T14:04:23.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.868+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.868+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__shadow_.hFiCNPVeqi4YHzYJQ6ZUdjlRuvYfzbU_0 2024-09-19T14:04:23.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.868+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-19T14:04:23.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.868+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.868+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _zSMA_wKPHNnahRuC98JWrDsiNbGNmAF 2024-09-19T14:04:23.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.868+0000 7f96177fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-19T14:04:23.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.872+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda272b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.872+0000 7f974349f9c0 10 manifest: total_size = 11534336 2024-09-19T14:04:23.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.872+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.16737895103995574191 2024-09-19T14:04:23.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.872+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda272b50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55dcda2de858 s->prefetch_data=0 2024-09-19T14:04:23.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.872+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2de858 2024-09-19T14:04:23.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.872+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.16.9 2024-09-19T14:04:23.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.880+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T14:04:23.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.880+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-19T14:04:23.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.880+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-19T14:04:23.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.880+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T14:04:23.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.880+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-19T14:04:23.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.880+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-19T14:04:23.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.880+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-19T14:04:23.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.880+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-19T14:04:23.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.880+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-19T14:04:23.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.880+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.16737895103995574191 2024-09-19T14:04:23.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.880+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.880+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-FROZEN.2~aNp3UJLE-ddNB0MK-NwhIY1m03unpN0.1 2024-09-19T14:04:23.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.880+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-19T14:04:23.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.880+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-FROZEN.2~aNp3UJLE-ddNB0MK-NwhIY1m03unpN0.2 2024-09-19T14:04:23.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.880+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-19T14:04:23.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.880+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-FROZEN.2~aNp3UJLE-ddNB0MK-NwhIY1m03unpN0.3 2024-09-19T14:04:23.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.880+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-19T14:04:23.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.880+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.880+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.16737895103995574191 2024-09-19T14:04:23.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.884+0000 7f9617fff640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-19T14:04:23.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.884+0000 7f974349f9c0 20 list_objects_ordered: starting attempt 1 2024-09-19T14:04:23.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.884+0000 7f974349f9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T14:04:23.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.884+0000 7f974349f9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T14:04:23.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.884+0000 7f974349f9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T14:04:23.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.884+0000 7f974349f9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T14:04:23.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.884+0000 7f974349f9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T14:04:23.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.884+0000 7f974349f9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[dbb1da81-49d0-421a-b677-974869a7f103.4620.16])"; uploads.size()=0; is_truncated=0 2024-09-19T14:04:23.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.888+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-19T14:04:23.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.888+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.892+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=243 2024-09-19T14:04:23.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.892+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-19T14:04:23.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.892+0000 7f974349f9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-19T14:04:23.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.892+0000 7f974349f9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-19T14:04:23.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.892+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-19T14:04:23.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.896+0000 7f9617fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333458 cookie 94407041283088 notifier 5916 bl.length()=199 2024-09-19T14:04:23.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.900+0000 7f974349f9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.16 from cache 2024-09-19T14:04:23.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.900+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.16, ofs0, ns] 2024-09-19T14:04:23.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.900+0000 7f96177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333459 cookie 94407041283088 notifier 5916 bl.length()=257 2024-09-19T14:04:23.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.912+0000 7f974349f9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.16 : miss 2024-09-19T14:04:23.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.912+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.912+0000 7f974349f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:23.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.912+0000 7f974349f9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.16 info.flags=0x0 2024-09-19T14:04:23.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.912+0000 7f974349f9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.16 to cache LRU end 2024-09-19T14:04:23.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.916+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.14 : miss 2024-09-19T14:04:23.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.916+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.920+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-19T14:04:23.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.920+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.14 info.flags=0x17 2024-09-19T14:04:23.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.920+0000 7f974349f9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.14 to cache LRU end 2024-09-19T14:04:23.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.920+0000 7f974349f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:04:23.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.920+0000 7f974349f9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T14:04:23.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.920+0000 7f974349f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.14 2024-09-19T14:04:23.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.924+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-19T14:04:23.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.928+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-19T14:04:23.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.928+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-19T14:04:23.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.932+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2c0d30 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55dcda2d4358 s->prefetch_data=0 2024-09-19T14:04:23.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.932+0000 7f974349f9c0 10 manifest: total_size = 11534336 2024-09-19T14:04:23.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.932+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.10245400797347235918 2024-09-19T14:04:23.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.932+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2c0d30 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55dcda2d4358 s->prefetch_data=0 2024-09-19T14:04:23.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.932+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2d4358 2024-09-19T14:04:23.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.932+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.14.3 2024-09-19T14:04:23.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.940+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T14:04:23.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.940+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-19T14:04:23.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.940+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-19T14:04:23.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.940+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T14:04:23.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.940+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-19T14:04:23.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.940+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-19T14:04:23.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.940+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-19T14:04:23.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.940+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-19T14:04:23.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.940+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-19T14:04:23.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.940+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.10245400797347235918 2024-09-19T14:04:23.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.940+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.940+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.14__multipart_foo-FROZEN.2~SlHG5aw_nWTzoNJau2m2IdAarGjxCtF.1 2024-09-19T14:04:23.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.940+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-19T14:04:23.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.940+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.14__multipart_foo-FROZEN.2~SlHG5aw_nWTzoNJau2m2IdAarGjxCtF.2 2024-09-19T14:04:23.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.940+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-19T14:04:23.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.940+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.14__multipart_foo-FROZEN.2~SlHG5aw_nWTzoNJau2m2IdAarGjxCtF.3 2024-09-19T14:04:23.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.940+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-19T14:04:23.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.940+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.940+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.10245400797347235918 2024-09-19T14:04:23.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.944+0000 7f96177fe640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-19T14:04:23.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.944+0000 7f974349f9c0 20 get_obj_state: octx=0x7f9730115f70 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55dcda2d4358 s->prefetch_data=0 2024-09-19T14:04:23.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.944+0000 7f974349f9c0 10 manifest: total_size = 16377 2024-09-19T14:04:23.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.944+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.77841423889869566 2024-09-19T14:04:23.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.944+0000 7f974349f9c0 20 get_obj_state: octx=0x7f9730115f70 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55dcda2d4358 s->prefetch_data=0 2024-09-19T14:04:23.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.944+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2d4358 2024-09-19T14:04:23.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.944+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.14.5 2024-09-19T14:04:23.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.952+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2024-09-19T14:04:23.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.952+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7670 2024-09-19T14:04:23.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.952+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=7670 stripe_ofs=7670 part_ofs=7670 rule->part_size=7672 2024-09-19T14:04:23.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.952+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-19T14:04:23.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.952+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6299126 part_ofs=7670 rule->part_size=7672 2024-09-19T14:04:23.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.952+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=1035 2024-09-19T14:04:23.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.952+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-19T14:04:23.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.952+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6306798 part_ofs=15342 rule->part_size=1035 2024-09-19T14:04:23.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.952+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=16377 stripe_ofs=16377 part_ofs=16377 rule->part_size=1035 2024-09-19T14:04:23.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.952+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.77841423889869566 2024-09-19T14:04:23.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.952+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.952+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.14__multipart_foo-STANDARD.2~CMEEgGQhoOEmqp8vbXSEZRgCDE0sXZj.1 2024-09-19T14:04:23.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.952+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 362 2024-09-19T14:04:23.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.952+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.14__multipart_foo-STANDARD.2~CMEEgGQhoOEmqp8vbXSEZRgCDE0sXZj.2 2024-09-19T14:04:23.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.952+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 626 2024-09-19T14:04:23.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.952+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.14__multipart_foo-STANDARD.2~CMEEgGQhoOEmqp8vbXSEZRgCDE0sXZj.3 2024-09-19T14:04:23.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.952+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 890 2024-09-19T14:04:23.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.952+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.952+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.77841423889869566 2024-09-19T14:04:23.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.956+0000 7f9617fff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-19T14:04:23.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.956+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2c43b0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55dcda2d4358 s->prefetch_data=0 2024-09-19T14:04:23.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.956+0000 7f974349f9c0 10 manifest: total_size = 11534336 2024-09-19T14:04:23.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.956+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.9584243089690217844 2024-09-19T14:04:23.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.956+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2c43b0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55dcda2d4358 s->prefetch_data=0 2024-09-19T14:04:23.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.956+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2d4358 2024-09-19T14:04:23.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.956+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.14.7 2024-09-19T14:04:23.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.964+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T14:04:23.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.964+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-19T14:04:23.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.964+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-19T14:04:23.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.964+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-19T14:04:23.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.964+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-19T14:04:23.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.964+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-19T14:04:23.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.964+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-19T14:04:23.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.964+0000 7f974349f9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-19T14:04:23.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.964+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-19T14:04:23.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.964+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.9584243089690217844 2024-09-19T14:04:23.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.964+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:23.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.964+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.14__multipart_foo-LUKEWARM.2~KKUr_aEY_XhDUpVNtuu4-YsWy7tdDpM.1 2024-09-19T14:04:23.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.964+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-19T14:04:23.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.964+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.14__multipart_foo-LUKEWARM.2~KKUr_aEY_XhDUpVNtuu4-YsWy7tdDpM.2 2024-09-19T14:04:23.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.964+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-19T14:04:23.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.964+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.14__multipart_foo-LUKEWARM.2~KKUr_aEY_XhDUpVNtuu4-YsWy7tdDpM.3 2024-09-19T14:04:23.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.964+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-19T14:04:23.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.964+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:23.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.964+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.9584243089690217844 2024-09-19T14:04:23.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.968+0000 7f96177fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-19T14:04:23.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.968+0000 7f974349f9c0 20 list_objects_ordered: starting attempt 1 2024-09-19T14:04:23.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.968+0000 7f974349f9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T14:04:23.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.972+0000 7f974349f9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T14:04:23.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.972+0000 7f974349f9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T14:04:23.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.972+0000 7f974349f9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T14:04:23.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.972+0000 7f974349f9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T14:04:23.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.972+0000 7f974349f9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[dbb1da81-49d0-421a-b677-974869a7f103.4620.14])"; uploads.size()=0; is_truncated=0 2024-09-19T14:04:23.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.976+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-19T14:04:23.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.976+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:23.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.976+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=238 2024-09-19T14:04:23.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.976+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-19T14:04:23.979 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.976+0000 7f974349f9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-19T14:04:23.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.980+0000 7f974349f9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-19T14:04:23.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.980+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-19T14:04:23.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.980+0000 7f96177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333456 cookie 94407041292512 notifier 5916 bl.length()=194 2024-09-19T14:04:23.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.988+0000 7f974349f9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.14 from cache 2024-09-19T14:04:23.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.988+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.14, ofs0, ns] 2024-09-19T14:04:23.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:23.988+0000 7f9617fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333460 cookie 94407041283088 notifier 5916 bl.length()=252 2024-09-19T14:04:24.001 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.000+0000 7f974349f9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.14 : miss 2024-09-19T14:04:24.001 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.000+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.000+0000 7f974349f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:24.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.000+0000 7f974349f9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.14 info.flags=0x0 2024-09-19T14:04:24.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.000+0000 7f974349f9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.14 to cache LRU end 2024-09-19T14:04:24.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.004+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.13 : miss 2024-09-19T14:04:24.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.004+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.008+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=450 2024-09-19T14:04:24.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.008+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.13 info.flags=0x17 2024-09-19T14:04:24.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.008+0000 7f974349f9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.13 to cache LRU end 2024-09-19T14:04:24.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.008+0000 7f974349f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:04:24.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.008+0000 7f974349f9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T14:04:24.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.008+0000 7f974349f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.13 2024-09-19T14:04:24.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.008+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-19T14:04:24.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.012+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-19T14:04:24.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.012+0000 7f974349f9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-19T14:04:24.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.016+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2df2a0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55dcda2d4358 s->prefetch_data=0 2024-09-19T14:04:24.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.016+0000 7f974349f9c0 10 manifest: total_size = 10485760 2024-09-19T14:04:24.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.016+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.10669439981153778405 2024-09-19T14:04:24.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.016+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2df2a0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55dcda2d4358 s->prefetch_data=0 2024-09-19T14:04:24.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.016+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2d4358 2024-09-19T14:04:24.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.016+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.13.3 2024-09-19T14:04:24.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.024+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:24.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.024+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-19T14:04:24.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.024+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:24.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.024+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-19T14:04:24.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.024+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.10669439981153778405 2024-09-19T14:04:24.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.024+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:24.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.024+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.13__shadow_.v_ROaMStbxv22YtJjTCrk3JIbzpvQNE_0 2024-09-19T14:04:24.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.024+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-19T14:04:24.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.024+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.13__shadow_.v_ROaMStbxv22YtJjTCrk3JIbzpvQNE_1 2024-09-19T14:04:24.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.024+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-19T14:04:24.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.024+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:24.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.024+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.10669439981153778405 2024-09-19T14:04:24.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.028+0000 7f96177fe640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-19T14:04:24.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.028+0000 7f974349f9c0 20 get_obj_state: octx=0x7f973800cfa0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55dcda2d4358 s->prefetch_data=0 2024-09-19T14:04:24.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.028+0000 7f974349f9c0 10 manifest: total_size = 649292 2024-09-19T14:04:24.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.028+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.1664484185205603701 2024-09-19T14:04:24.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.028+0000 7f974349f9c0 20 get_obj_state: octx=0x7f973800cfa0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55dcda2d4358 s->prefetch_data=0 2024-09-19T14:04:24.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.028+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2d4358 2024-09-19T14:04:24.032 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.028+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.13.5 2024-09-19T14:04:24.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.036+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:24.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.036+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=649292 stripe_ofs=649292 part_ofs=0 rule->part_size=0 2024-09-19T14:04:24.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.036+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.1664484185205603701 2024-09-19T14:04:24.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.036+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:24.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.036+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.13__shadow_.B9FNgk0S2dkX-ZWKcMjj7tFY21P1Cxi_0 2024-09-19T14:04:24.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.036+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-19T14:04:24.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.036+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:24.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.036+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.1664484185205603701 2024-09-19T14:04:24.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.040+0000 7f9617fff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-19T14:04:24.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.040+0000 7f974349f9c0 20 get_obj_state: octx=0x7f972801cf20 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55dcda2d4358 s->prefetch_data=0 2024-09-19T14:04:24.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.040+0000 7f974349f9c0 10 manifest: total_size = 10485760 2024-09-19T14:04:24.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.040+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.2099809046538452114 2024-09-19T14:04:24.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.040+0000 7f974349f9c0 20 get_obj_state: octx=0x7f972801cf20 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55dcda2d4358 s->prefetch_data=0 2024-09-19T14:04:24.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.040+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2d4358 2024-09-19T14:04:24.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.040+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.13.7 2024-09-19T14:04:24.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.048+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:24.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.048+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-19T14:04:24.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.048+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:24.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.048+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-19T14:04:24.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.048+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.2099809046538452114 2024-09-19T14:04:24.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.048+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:24.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.048+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.13__shadow_.FHOOy68yFN6XB2dISjQQc77sqEP47zB_0 2024-09-19T14:04:24.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.048+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-19T14:04:24.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.048+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.13__shadow_.FHOOy68yFN6XB2dISjQQc77sqEP47zB_1 2024-09-19T14:04:24.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.048+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-19T14:04:24.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.048+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:24.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.048+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.2099809046538452114 2024-09-19T14:04:24.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.052+0000 7f96177fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-19T14:04:24.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.052+0000 7f974349f9c0 20 list_objects_ordered: starting attempt 1 2024-09-19T14:04:24.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.052+0000 7f974349f9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T14:04:24.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.052+0000 7f974349f9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T14:04:24.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.052+0000 7f974349f9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T14:04:24.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.052+0000 7f974349f9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T14:04:24.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.052+0000 7f974349f9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T14:04:24.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.052+0000 7f974349f9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[dbb1da81-49d0-421a-b677-974869a7f103.4620.13])"; uploads.size()=0; is_truncated=0 2024-09-19T14:04:24.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.056+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-19T14:04:24.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.056+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.060+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=228 2024-09-19T14:04:24.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.060+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-19T14:04:24.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.060+0000 7f974349f9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-19T14:04:24.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.060+0000 7f974349f9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-19T14:04:24.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.060+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-19T14:04:24.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.064+0000 7f9617fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333509 cookie 94407041278352 notifier 5916 bl.length()=184 2024-09-19T14:04:24.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.068+0000 7f974349f9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.13 from cache 2024-09-19T14:04:24.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.068+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.13, ofs0, ns] 2024-09-19T14:04:24.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.072+0000 7f96177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333510 cookie 94407041278352 notifier 5916 bl.length()=242 2024-09-19T14:04:24.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.080+0000 7f974349f9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.13 : miss 2024-09-19T14:04:24.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.080+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.080+0000 7f974349f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:24.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.080+0000 7f974349f9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.13 info.flags=0x0 2024-09-19T14:04:24.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.080+0000 7f974349f9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.13 to cache LRU end 2024-09-19T14:04:24.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.088+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.6 : miss 2024-09-19T14:04:24.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.088+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.088+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-19T14:04:24.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.088+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.6 info.flags=0x17 2024-09-19T14:04:24.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.088+0000 7f974349f9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.6 to cache LRU end 2024-09-19T14:04:24.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.088+0000 7f974349f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:04:24.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.088+0000 7f974349f9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T14:04:24.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.088+0000 7f974349f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.6 2024-09-19T14:04:24.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.092+0000 7f974349f9c0 10 cls_bucket_list_unordered: got ___ 2024-09-19T14:04:24.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.092+0000 7f974349f9c0 10 cls_bucket_list_unordered: got __ _ 2024-09-19T14:04:24.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.096+0000 7f974349f9c0 10 cls_bucket_list_unordered: got __ 2024-09-19T14:04:24.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.096+0000 7f974349f9c0 10 cls_bucket_list_unordered: got obj 2024-09-19T14:04:24.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.100+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2be1f0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55dcda2db298 s->prefetch_data=0 2024-09-19T14:04:24.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.100+0000 7f974349f9c0 10 manifest: total_size = 0 2024-09-19T14:04:24.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.100+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.3490955280933596815 2024-09-19T14:04:24.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.100+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2be1f0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55dcda2db298 s->prefetch_data=0 2024-09-19T14:04:24.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.100+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2db298 2024-09-19T14:04:24.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.100+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.6.2 2024-09-19T14:04:24.108 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.108+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2be1f0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55dcda2db298 s->prefetch_data=0 2024-09-19T14:04:24.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.108+0000 7f974349f9c0 10 manifest: total_size = 0 2024-09-19T14:04:24.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.108+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.8019246093551815324 2024-09-19T14:04:24.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.108+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2be1f0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55dcda2db298 s->prefetch_data=0 2024-09-19T14:04:24.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.108+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2db298 2024-09-19T14:04:24.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.108+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.6.3 2024-09-19T14:04:24.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.108+0000 7f9617fff640 20 handle_completion(): completion ok for obj=___ 2024-09-19T14:04:24.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.116+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2be1f0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55dcda2db298 s->prefetch_data=0 2024-09-19T14:04:24.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.116+0000 7f974349f9c0 10 manifest: total_size = 0 2024-09-19T14:04:24.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.116+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.770654404926292696 2024-09-19T14:04:24.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.116+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2be1f0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55dcda2db298 s->prefetch_data=0 2024-09-19T14:04:24.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.116+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2db298 2024-09-19T14:04:24.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.116+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.6.6 2024-09-19T14:04:24.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.116+0000 7f96177fe640 20 handle_completion(): completion ok for obj=__ _ 2024-09-19T14:04:24.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.124+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2be1f0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55dcda2db298 s->prefetch_data=0 2024-09-19T14:04:24.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.124+0000 7f974349f9c0 10 manifest: total_size = 0 2024-09-19T14:04:24.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.124+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.9814390436224752835 2024-09-19T14:04:24.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.124+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2be1f0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55dcda2db298 s->prefetch_data=0 2024-09-19T14:04:24.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.124+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda2db298 2024-09-19T14:04:24.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.124+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.6.8 2024-09-19T14:04:24.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.124+0000 7f9617fff640 20 handle_completion(): completion ok for obj=__ 2024-09-19T14:04:24.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.132+0000 7f974349f9c0 20 list_objects_ordered: starting attempt 1 2024-09-19T14:04:24.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.132+0000 7f974349f9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T14:04:24.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.132+0000 7f9617fff640 20 handle_completion(): completion ok for obj=obj 2024-09-19T14:04:24.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.136+0000 7f974349f9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T14:04:24.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.136+0000 7f974349f9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T14:04:24.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.136+0000 7f974349f9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T14:04:24.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.136+0000 7f974349f9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T14:04:24.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.136+0000 7f974349f9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[dbb1da81-49d0-421a-b677-974869a7f103.4620.6])"; uploads.size()=0; is_truncated=0 2024-09-19T14:04:24.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.140+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-19T14:04:24.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.140+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.140+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-19T14:04:24.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.140+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-19T14:04:24.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.140+0000 7f974349f9c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-19T14:04:24.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.144+0000 7f974349f9c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-19T14:04:24.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.144+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-19T14:04:24.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.144+0000 7f9617fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333493 cookie 94407041281760 notifier 5916 bl.length()=181 2024-09-19T14:04:24.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.152+0000 7f974349f9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.6 from cache 2024-09-19T14:04:24.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.152+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:dbb1da81-49d0-421a-b677-974869a7f103.4620.6, ofs0, ns] 2024-09-19T14:04:24.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.152+0000 7f96177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333474 cookie 94407041287792 notifier 5916 bl.length()=238 2024-09-19T14:04:24.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.160+0000 7f974349f9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.6 : miss 2024-09-19T14:04:24.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.160+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.160+0000 7f974349f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:24.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.160+0000 7f974349f9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.6 info.flags=0x0 2024-09-19T14:04:24.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.160+0000 7f974349f9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/dbb1da81-49d0-421a-b677-974869a7f103.4620.6 to cache LRU end 2024-09-19T14:04:24.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.168+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:dbb1da81-49d0-421a-b677-974869a7f103.4620.7 : miss 2024-09-19T14:04:24.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.168+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.168+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-19T14:04:24.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.168+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:dbb1da81-49d0-421a-b677-974869a7f103.4620.7 info.flags=0x17 2024-09-19T14:04:24.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.168+0000 7f974349f9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:dbb1da81-49d0-421a-b677-974869a7f103.4620.7 to cache LRU end 2024-09-19T14:04:24.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.168+0000 7f974349f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:04:24.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.168+0000 7f974349f9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T14:04:24.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.168+0000 7f974349f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:dbb1da81-49d0-421a-b677-974869a7f103.4620.7 2024-09-19T14:04:24.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.172+0000 7f974349f9c0 10 cls_bucket_list_unordered: got ___ 2024-09-19T14:04:24.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.172+0000 7f974349f9c0 10 cls_bucket_list_unordered: got __ _ 2024-09-19T14:04:24.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.176+0000 7f974349f9c0 10 cls_bucket_list_unordered: got __ 2024-09-19T14:04:24.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.176+0000 7f974349f9c0 10 cls_bucket_list_unordered: got obj 2024-09-19T14:04:24.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.180+0000 7f974349f9c0 20 get_obj_state: octx=0x7f973805db90 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55dcda28bcb8 s->prefetch_data=0 2024-09-19T14:04:24.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.180+0000 7f974349f9c0 10 manifest: total_size = 524288 2024-09-19T14:04:24.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.180+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.12873270689736215533 2024-09-19T14:04:24.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.180+0000 7f974349f9c0 20 get_obj_state: octx=0x7f973805db90 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55dcda28bcb8 s->prefetch_data=0 2024-09-19T14:04:24.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.180+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda28bcb8 2024-09-19T14:04:24.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.180+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.7.2 2024-09-19T14:04:24.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.188+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:24.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.188+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-19T14:04:24.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.188+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.12873270689736215533 2024-09-19T14:04:24.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.188+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:24.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.188+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.7__shadow_.ZbgAF5BvFJYKS6iAQjDdW-Bvkr0yNiQ_0 2024-09-19T14:04:24.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.188+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-19T14:04:24.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.188+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:24.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.188+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.12873270689736215533 2024-09-19T14:04:24.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.192+0000 7f9617fff640 20 handle_completion(): completion ok for obj=___ 2024-09-19T14:04:24.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.260+0000 7f974349f9c0 20 get_obj_state: octx=0x7f973805db90 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55dcda28bc88 s->prefetch_data=0 2024-09-19T14:04:24.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.260+0000 7f974349f9c0 10 manifest: total_size = 524288 2024-09-19T14:04:24.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.260+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.16507384580774396040 2024-09-19T14:04:24.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.260+0000 7f974349f9c0 20 get_obj_state: octx=0x7f973805db90 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55dcda28bc88 s->prefetch_data=0 2024-09-19T14:04:24.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.260+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda28bc88 2024-09-19T14:04:24.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.260+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.7.3 2024-09-19T14:04:24.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.268+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:24.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.268+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-19T14:04:24.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.268+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.16507384580774396040 2024-09-19T14:04:24.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.268+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:24.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.268+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.7__shadow_.T7lgQTNhW-7BRTL0keb9SnIR3V9Kf4p_0 2024-09-19T14:04:24.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.268+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-19T14:04:24.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.268+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:24.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.268+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.16507384580774396040 2024-09-19T14:04:24.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.272+0000 7f96177fe640 20 handle_completion(): completion ok for obj=__ _ 2024-09-19T14:04:24.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.272+0000 7f974349f9c0 20 get_obj_state: octx=0x7f973805db90 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55dcda28b888 s->prefetch_data=0 2024-09-19T14:04:24.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.272+0000 7f974349f9c0 10 manifest: total_size = 24595 2024-09-19T14:04:24.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.272+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.8244892573344155480 2024-09-19T14:04:24.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.272+0000 7f974349f9c0 20 get_obj_state: octx=0x7f973805db90 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55dcda28b888 s->prefetch_data=0 2024-09-19T14:04:24.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.272+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda28b888 2024-09-19T14:04:24.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.272+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.7.6 2024-09-19T14:04:24.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.280+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:24.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.280+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-19T14:04:24.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.280+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.8244892573344155480 2024-09-19T14:04:24.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.280+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:24.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.280+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.7__shadow_.EU56b7y7mPUlTXXOkvrNomlRw07yElg_0 2024-09-19T14:04:24.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.280+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-19T14:04:24.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.280+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:24.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.280+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.8244892573344155480 2024-09-19T14:04:24.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.284+0000 7f9617fff640 20 handle_completion(): completion ok for obj=__ 2024-09-19T14:04:24.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.284+0000 7f974349f9c0 20 get_obj_state: octx=0x7f973805db90 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55dcda28b888 s->prefetch_data=0 2024-09-19T14:04:24.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.284+0000 7f974349f9c0 10 manifest: total_size = 524288 2024-09-19T14:04:24.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.284+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.10186407353569373784 2024-09-19T14:04:24.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.284+0000 7f974349f9c0 20 get_obj_state: octx=0x7f973805db90 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55dcda28b888 s->prefetch_data=0 2024-09-19T14:04:24.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.284+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda28b888 2024-09-19T14:04:24.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.284+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.7.8 2024-09-19T14:04:24.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.288+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:24.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.288+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-19T14:04:24.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.288+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.10186407353569373784 2024-09-19T14:04:24.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.288+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:24.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.288+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.7__shadow_.6FM8c5jx8ZHNKVOMHkfVSdJvH9Vpqrb_0 2024-09-19T14:04:24.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.288+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-19T14:04:24.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.288+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:24.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.288+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.10186407353569373784 2024-09-19T14:04:24.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.292+0000 7f974349f9c0 20 list_objects_ordered: starting attempt 1 2024-09-19T14:04:24.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.292+0000 7f974349f9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T14:04:24.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.292+0000 7f96177fe640 20 handle_completion(): completion ok for obj=obj 2024-09-19T14:04:24.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.296+0000 7f974349f9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T14:04:24.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.296+0000 7f974349f9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T14:04:24.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.296+0000 7f974349f9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T14:04:24.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.296+0000 7f974349f9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T14:04:24.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.296+0000 7f974349f9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[dbb1da81-49d0-421a-b677-974869a7f103.4620.7])"; uploads.size()=0; is_truncated=0 2024-09-19T14:04:24.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.300+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-19T14:04:24.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.300+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.300+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-19T14:04:24.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.300+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-19T14:04:24.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.300+0000 7f974349f9c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-19T14:04:24.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.304+0000 7f974349f9c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-19T14:04:24.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.304+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-19T14:04:24.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.304+0000 7f9617fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333494 cookie 94407041281760 notifier 5916 bl.length()=181 2024-09-19T14:04:24.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.312+0000 7f974349f9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:dbb1da81-49d0-421a-b677-974869a7f103.4620.7 from cache 2024-09-19T14:04:24.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.312+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:dbb1da81-49d0-421a-b677-974869a7f103.4620.7, ofs0, ns] 2024-09-19T14:04:24.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.312+0000 7f9617fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333475 cookie 94407041287792 notifier 5916 bl.length()=238 2024-09-19T14:04:24.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.320+0000 7f974349f9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/dbb1da81-49d0-421a-b677-974869a7f103.4620.7 : miss 2024-09-19T14:04:24.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.320+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.320+0000 7f974349f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:24.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.320+0000 7f974349f9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/dbb1da81-49d0-421a-b677-974869a7f103.4620.7 info.flags=0x0 2024-09-19T14:04:24.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.320+0000 7f974349f9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/dbb1da81-49d0-421a-b677-974869a7f103.4620.7 to cache LRU end 2024-09-19T14:04:24.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.328+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:dbb1da81-49d0-421a-b677-974869a7f103.4620.8 : miss 2024-09-19T14:04:24.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.328+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.328+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-19T14:04:24.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.328+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:dbb1da81-49d0-421a-b677-974869a7f103.4620.8 info.flags=0x17 2024-09-19T14:04:24.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.328+0000 7f974349f9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:dbb1da81-49d0-421a-b677-974869a7f103.4620.8 to cache LRU end 2024-09-19T14:04:24.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.328+0000 7f974349f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:04:24.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.328+0000 7f974349f9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T14:04:24.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.328+0000 7f974349f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:dbb1da81-49d0-421a-b677-974869a7f103.4620.8 2024-09-19T14:04:24.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.332+0000 7f974349f9c0 10 cls_bucket_list_unordered: got ___ 2024-09-19T14:04:24.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.332+0000 7f974349f9c0 10 cls_bucket_list_unordered: got __ _ 2024-09-19T14:04:24.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.336+0000 7f974349f9c0 10 cls_bucket_list_unordered: got __ 2024-09-19T14:04:24.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.336+0000 7f974349f9c0 10 cls_bucket_list_unordered: got obj 2024-09-19T14:04:24.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.340+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2ec220 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55dcda28c618 s->prefetch_data=0 2024-09-19T14:04:24.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.340+0000 7f974349f9c0 10 manifest: total_size = 49187 2024-09-19T14:04:24.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.340+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.9103820038083936033 2024-09-19T14:04:24.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.340+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2ec220 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55dcda28c618 s->prefetch_data=0 2024-09-19T14:04:24.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.340+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda28c618 2024-09-19T14:04:24.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.340+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.8.2 2024-09-19T14:04:24.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.348+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:24.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.348+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-09-19T14:04:24.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.348+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.9103820038083936033 2024-09-19T14:04:24.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.348+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:24.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.348+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.8__shadow_.FhFLdtFO4UqXKVq7Q47JUg7do4rtGtc_0 2024-09-19T14:04:24.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.348+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-19T14:04:24.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.348+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:24.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.348+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.9103820038083936033 2024-09-19T14:04:24.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.352+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2ec220 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55dcda28c618 s->prefetch_data=0 2024-09-19T14:04:24.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.352+0000 7f96177fe640 20 handle_completion(): completion ok for obj=___ 2024-09-19T14:04:24.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.352+0000 7f974349f9c0 10 manifest: total_size = 4134 2024-09-19T14:04:24.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.352+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.250964799312123171 2024-09-19T14:04:24.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.352+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2ec220 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55dcda28c618 s->prefetch_data=0 2024-09-19T14:04:24.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.352+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda28c618 2024-09-19T14:04:24.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.352+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.8.3 2024-09-19T14:04:24.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.360+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:24.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.360+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-19T14:04:24.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.360+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.250964799312123171 2024-09-19T14:04:24.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.360+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:24.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.360+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.8__shadow_.bTAUpyYkEVfUoX9qBSxq3OCK48zG58h_0 2024-09-19T14:04:24.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.360+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-09-19T14:04:24.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.360+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:24.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.360+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.250964799312123171 2024-09-19T14:04:24.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.364+0000 7f9617fff640 20 handle_completion(): completion ok for obj=__ _ 2024-09-19T14:04:24.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.364+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2ec220 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55dcda28c618 s->prefetch_data=0 2024-09-19T14:04:24.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.364+0000 7f974349f9c0 10 manifest: total_size = 55 2024-09-19T14:04:24.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.364+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.11819407702504252678 2024-09-19T14:04:24.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.364+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2ec220 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55dcda28c618 s->prefetch_data=0 2024-09-19T14:04:24.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.364+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda28c618 2024-09-19T14:04:24.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.364+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.8.6 2024-09-19T14:04:24.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.372+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:24.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.372+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-19T14:04:24.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.372+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.11819407702504252678 2024-09-19T14:04:24.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.372+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:24.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.372+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.8__shadow_.6HWrhRJyXnXGhKuKvRyOaGWV8Wxbfax_0 2024-09-19T14:04:24.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.372+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-19T14:04:24.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.372+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:24.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.372+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.11819407702504252678 2024-09-19T14:04:24.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.376+0000 7f96177fe640 20 handle_completion(): completion ok for obj=__ 2024-09-19T14:04:24.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.376+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2be7e0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55dcda28c618 s->prefetch_data=0 2024-09-19T14:04:24.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.376+0000 7f974349f9c0 10 manifest: total_size = 49187 2024-09-19T14:04:24.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.376+0000 7f974349f9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.15415161046353177993 2024-09-19T14:04:24.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.376+0000 7f974349f9c0 20 get_obj_state: octx=0x55dcda2be7e0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55dcda28c618 s->prefetch_data=0 2024-09-19T14:04:24.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.376+0000 7f974349f9c0 20 prepare_atomic_modification: state is not atomic. state=0x55dcda28c618 2024-09-19T14:04:24.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.376+0000 7f974349f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.8.8 2024-09-19T14:04:24.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.384+0000 7f974349f9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:04:24.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.384+0000 7f974349f9c0 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-09-19T14:04:24.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.384+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.15415161046353177993 2024-09-19T14:04:24.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.384+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-19T14:04:24.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.384+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: dbb1da81-49d0-421a-b677-974869a7f103.4620.8__shadow_.Da7ZHDtoI-_hpRFTPRTla3kCoX3yW8Y_0 2024-09-19T14:04:24.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.384+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-19T14:04:24.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.384+0000 7f974349f9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-19T14:04:24.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.384+0000 7f974349f9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: dbb1da81-49d0-421a-b677-974869a7f103.4620.15415161046353177993 2024-09-19T14:04:24.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.388+0000 7f974349f9c0 20 list_objects_ordered: starting attempt 1 2024-09-19T14:04:24.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.388+0000 7f974349f9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T14:04:24.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.388+0000 7f9617fff640 20 handle_completion(): completion ok for obj=obj 2024-09-19T14:04:24.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.388+0000 7f974349f9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T14:04:24.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.388+0000 7f974349f9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T14:04:24.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.388+0000 7f974349f9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T14:04:24.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.388+0000 7f974349f9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T14:04:24.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.388+0000 7f974349f9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[dbb1da81-49d0-421a-b677-974869a7f103.4620.8])"; uploads.size()=0; is_truncated=0 2024-09-19T14:04:24.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.396+0000 7f974349f9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-19T14:04:24.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.396+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.396+0000 7f974349f9c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-19T14:04:24.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.396+0000 7f974349f9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-19T14:04:24.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.396+0000 7f974349f9c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-19T14:04:24.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.400+0000 7f974349f9c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-19T14:04:24.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.400+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-19T14:04:24.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.400+0000 7f9617fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333495 cookie 94407041281760 notifier 5916 bl.length()=181 2024-09-19T14:04:24.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.404+0000 7f974349f9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:dbb1da81-49d0-421a-b677-974869a7f103.4620.8 from cache 2024-09-19T14:04:24.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.404+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:dbb1da81-49d0-421a-b677-974869a7f103.4620.8, ofs0, ns] 2024-09-19T14:04:24.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.408+0000 7f9617fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333476 cookie 94407041287792 notifier 5916 bl.length()=238 2024-09-19T14:04:24.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.420+0000 7f974349f9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/dbb1da81-49d0-421a-b677-974869a7f103.4620.8 : miss 2024-09-19T14:04:24.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.420+0000 7f974349f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.420+0000 7f974349f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:24.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.420+0000 7f974349f9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/dbb1da81-49d0-421a-b677-974869a7f103.4620.8 info.flags=0x0 2024-09-19T14:04:24.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.420+0000 7f974349f9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/dbb1da81-49d0-421a-b677-974869a7f103.4620.8 to cache LRU end 2024-09-19T14:04:24.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.424+0000 7f974349f9c0 10 removing key index: TAWPMJWNCNLCGOMQPMSW 2024-09-19T14:04:24.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.428+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:TAWPMJWNCNLCGOMQPMSW, ofs0, ns] 2024-09-19T14:04:24.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.428+0000 7f9617fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333461 cookie 94407041283088 notifier 5916 bl.length()=170 2024-09-19T14:04:24.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.432+0000 7f974349f9c0 10 removing email index: ragweed.client.0+test@test.test 2024-09-19T14:04:24.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.432+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-19T14:04:24.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.436+0000 7f9617fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333511 cookie 94407041278352 notifier 5916 bl.length()=182 2024-09-19T14:04:24.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.436+0000 7f974349f9c0 10 removing user buckets index 2024-09-19T14:04:24.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.440+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-19T14:04:24.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.440+0000 7f9617fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333457 cookie 94407041292512 notifier 5916 bl.length()=173 2024-09-19T14:04:24.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.444+0000 7f974349f9c0 10 removing user index: ragweed.client.0 2024-09-19T14:04:24.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.448+0000 7f974349f9c0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-19T14:04:24.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.448+0000 7f974349f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-19T14:04:24.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.448+0000 7f96177fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333477 cookie 94407041287792 notifier 5916 bl.length()=165 2024-09-19T14:04:24.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.460+0000 7f95f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:04:24.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.464+0000 7f974349f9c0 20 remove_watcher() i=0 2024-09-19T14:04:24.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.464+0000 7f974349f9c0 2 removed watcher, disabling cache 2024-09-19T14:04:24.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.468+0000 7f974349f9c0 20 remove_watcher() i=1 2024-09-19T14:04:24.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.472+0000 7f974349f9c0 20 remove_watcher() i=2 2024-09-19T14:04:24.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.472+0000 7f974349f9c0 20 remove_watcher() i=3 2024-09-19T14:04:24.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.476+0000 7f974349f9c0 20 remove_watcher() i=4 2024-09-19T14:04:24.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.476+0000 7f974349f9c0 20 remove_watcher() i=5 2024-09-19T14:04:24.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.480+0000 7f974349f9c0 20 remove_watcher() i=6 2024-09-19T14:04:24.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.480+0000 7f974349f9c0 20 remove_watcher() i=7 2024-09-19T14:04:24.510 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-19T14:04:24.588 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:04:24.588 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:04:24.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.628+0000 7f5cad08f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.628+0000 7f5cad08f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:24.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.628+0000 7f5cad08f9c0 20 realm 2024-09-19T14:04:24.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.628+0000 7f5cad08f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.628+0000 7f5cad08f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:24.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.628+0000 7f5cad08f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:04:24.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.628+0000 7f5cad08f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.632+0000 7f5cad08f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:24.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.632+0000 7f5cad08f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.632+0000 7f5cad08f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:04:24.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.632+0000 7f5cad08f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.632+0000 7f5cad08f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:04:24.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.632+0000 7f5cad08f9c0 20 searching for the correct realm 2024-09-19T14:04:24.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.636+0000 7f5caa394640 0 -- 172.21.15.153:0/418464281 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x55ba218b1270 msgr2=0x55ba218b36e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:04:24.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.644+0000 7f5caab95640 0 -- 172.21.15.153:0/418464281 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f5c9412f0b0 msgr2=0x7f5c9410f6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:04:24.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.652+0000 7f5cad08f9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:04:24.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.652+0000 7f5cad08f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:04:24.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.652+0000 7f5cad08f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:04:24.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.652+0000 7f5cad08f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:04:24.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.652+0000 7f5cad08f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:04:24.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.652+0000 7f5cad08f9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:04:24.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.652+0000 7f5cad08f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.652+0000 7f5cad08f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:24.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.652+0000 7f5cad08f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.652+0000 7f5cad08f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:04:24.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.652+0000 7f5cad08f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.652+0000 7f5cad08f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:04:24.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.652+0000 7f5cad08f9c0 20 zone default found 2024-09-19T14:04:24.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.652+0000 7f5cad08f9c0 4 Realm: () 2024-09-19T14:04:24.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.652+0000 7f5cad08f9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:04:24.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.652+0000 7f5cad08f9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:04:24.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.652+0000 7f5cad08f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:04:24.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.652+0000 7f5cad08f9c0 20 zonegroup default 2024-09-19T14:04:24.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.652+0000 7f5cad08f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.656+0000 7f5cad08f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:24.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.656+0000 7f5cad08f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.656+0000 7f5cad08f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:24.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.656+0000 7f5cad08f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.656+0000 7f5cad08f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:04:24.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.656+0000 7f5cad08f9c0 20 started sync module instance, tier type = 2024-09-19T14:04:24.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.656+0000 7f5cad08f9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:04:24.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.672+0000 7f5cad08f9c0 20 add_watcher() i=0 2024-09-19T14:04:24.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.672+0000 7f5cad08f9c0 20 add_watcher() i=1 2024-09-19T14:04:24.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.672+0000 7f5cad08f9c0 20 add_watcher() i=2 2024-09-19T14:04:24.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.672+0000 7f5cad08f9c0 20 add_watcher() i=3 2024-09-19T14:04:24.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.672+0000 7f5cad08f9c0 20 add_watcher() i=4 2024-09-19T14:04:24.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.672+0000 7f5cad08f9c0 20 add_watcher() i=5 2024-09-19T14:04:24.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.672+0000 7f5cad08f9c0 20 add_watcher() i=6 2024-09-19T14:04:24.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.672+0000 7f5cad08f9c0 20 add_watcher() i=7 2024-09-19T14:04:24.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.672+0000 7f5cad08f9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:04:24.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.676+0000 7f5b61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:04:24.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.676+0000 7f5cad08f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:04:24.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.676+0000 7f5cad08f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:04:24.760 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.756+0000 7f5b60fe1640 20 reqs_thread_entry: start 2024-09-19T14:04:24.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.760+0000 7f5cad08f9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:04:24.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.760+0000 7f5cad08f9c0 20 Filter name: none 2024-09-19T14:04:24.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.760+0000 7f5b59ffb640 20 reqs_thread_entry: start 2024-09-19T14:04:24.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.760+0000 7f5cad08f9c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-19T14:04:24.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.760+0000 7f5cad08f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:04:24.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.760+0000 7f5cad08f9c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-19T14:04:24.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.760+0000 7f5cad08f9c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-19T14:04:24.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.760+0000 7f5cad08f9c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-19T14:04:24.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.760+0000 7f5cad08f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:04:24.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.760+0000 7f5cad08f9c0 10 removing key index: PSRPDLFZLMXOABCIINUV 2024-09-19T14:04:24.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.764+0000 7f5cad08f9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:PSRPDLFZLMXOABCIINUV, ofs0, ns] 2024-09-19T14:04:24.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.764+0000 7f5b8e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333458 cookie 94257915065360 notifier 5937 bl.length()=170 2024-09-19T14:04:24.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.768+0000 7f5cad08f9c0 10 removing email index: sysuser.client.0+test@test.test 2024-09-19T14:04:24.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.768+0000 7f5cad08f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-19T14:04:24.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.768+0000 7f5b8e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333478 cookie 94257915055648 notifier 5937 bl.length()=182 2024-09-19T14:04:24.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.772+0000 7f5cad08f9c0 10 removing user buckets index 2024-09-19T14:04:24.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.776+0000 7f5cad08f9c0 10 removing user index: sysuser.client.0 2024-09-19T14:04:24.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.776+0000 7f5cad08f9c0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-19T14:04:24.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.776+0000 7f5cad08f9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-19T14:04:24.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.776+0000 7f5b8e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333512 cookie 94257915058192 notifier 5937 bl.length()=165 2024-09-19T14:04:24.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.780+0000 7f5b61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:04:24.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.784+0000 7f5cad08f9c0 20 remove_watcher() i=0 2024-09-19T14:04:24.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.784+0000 7f5cad08f9c0 2 removed watcher, disabling cache 2024-09-19T14:04:24.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.788+0000 7f5cad08f9c0 20 remove_watcher() i=1 2024-09-19T14:04:24.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.792+0000 7f5cad08f9c0 20 remove_watcher() i=2 2024-09-19T14:04:24.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.792+0000 7f5cad08f9c0 20 remove_watcher() i=3 2024-09-19T14:04:24.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.796+0000 7f5cad08f9c0 20 remove_watcher() i=4 2024-09-19T14:04:24.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.796+0000 7f5cad08f9c0 20 remove_watcher() i=5 2024-09-19T14:04:24.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.796+0000 7f5cad08f9c0 20 remove_watcher() i=6 2024-09-19T14:04:24.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:04:24.800+0000 7f5cad08f9c0 20 remove_watcher() i=7 2024-09-19T14:04:24.817 INFO:tasks.ragweed:Removing ragweed... 2024-09-19T14:04:24.818 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-19T14:04:24.910 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T14:04:24.921 INFO:tasks.workunit:Pulling workunits from ref 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T14:04:24.921 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T14:04:24.922 DEBUG:teuthology.orchestra.run.smithi153:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T14:04:24.929 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T14:04:24.929 INFO:teuthology.orchestra.run.smithi153.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-19T14:04:24.929 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T14:04:24.976 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-19T14:04:24.977 DEBUG:teuthology.orchestra.run.smithi153:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-19T14:04:25.025 INFO:tasks.workunit:timeout=3h 2024-09-19T14:04:25.025 INFO:tasks.workunit:cleanup=True 2024-09-19T14:04:25.025 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T14:04:25.075 INFO:tasks.workunit.client.0.smithi153.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T14:05:23.337 INFO:tasks.workunit.client.0.smithi153.stderr:Note: switching to '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'. 2024-09-19T14:05:23.337 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:05:23.337 INFO:tasks.workunit.client.0.smithi153.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T14:05:23.337 INFO:tasks.workunit.client.0.smithi153.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T14:05:23.337 INFO:tasks.workunit.client.0.smithi153.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T14:05:23.337 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:05:23.337 INFO:tasks.workunit.client.0.smithi153.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T14:05:23.337 INFO:tasks.workunit.client.0.smithi153.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T14:05:23.338 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:05:23.338 INFO:tasks.workunit.client.0.smithi153.stderr: git switch -c 2024-09-19T14:05:23.338 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:05:23.338 INFO:tasks.workunit.client.0.smithi153.stderr:Or undo this operation with: 2024-09-19T14:05:23.338 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:05:23.338 INFO:tasks.workunit.client.0.smithi153.stderr: git switch - 2024-09-19T14:05:23.338 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:05:23.338 INFO:tasks.workunit.client.0.smithi153.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T14:05:23.338 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:05:23.338 INFO:tasks.workunit.client.0.smithi153.stderr:HEAD is now at 08af21e0d16 rgw_log_backing: error code not returned 2024-09-19T14:05:23.346 DEBUG:teuthology.orchestra.run.smithi153:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T14:05:23.393 INFO:tasks.workunit.client.0.smithi153.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T14:05:23.397 INFO:tasks.workunit.client.0.smithi153.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T14:05:23.397 INFO:tasks.workunit.client.0.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T14:05:23.452 INFO:tasks.workunit.client.0.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T14:05:23.509 INFO:tasks.workunit.client.0.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T14:05:23.558 INFO:tasks.workunit.client.0.smithi153.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T14:05:23.559 INFO:tasks.workunit.client.0.smithi153.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T14:05:23.559 INFO:tasks.workunit.client.0.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T14:05:23.607 INFO:tasks.workunit.client.0.smithi153.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T14:05:23.611 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T14:05:23.611 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T14:05:23.657 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-19T14:05:23.658 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-19T14:05:23.658 DEBUG:teuthology.orchestra.run.smithi153:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-19T14:05:23.710 INFO:tasks.workunit.client.0.smithi153.stderr:+ ulimit -c 0 2024-09-19T14:05:23.710 INFO:tasks.workunit.client.0.smithi153.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-19T14:05:23.711 INFO:tasks.workunit.client.0.smithi153.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T14:05:23.711 INFO:tasks.workunit.client.0.smithi153.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T14:05:26.669 INFO:tasks.workunit.client.0.smithi153.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-19T14:05:26.669 INFO:tasks.workunit.client.0.smithi153.stderr:++ deactivate nondestructive 2024-09-19T14:05:26.669 INFO:tasks.workunit.client.0.smithi153.stderr:++ '[' -n '' ']' 2024-09-19T14:05:26.669 INFO:tasks.workunit.client.0.smithi153.stderr:++ '[' -n '' ']' 2024-09-19T14:05:26.669 INFO:tasks.workunit.client.0.smithi153.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T14:05:26.669 INFO:tasks.workunit.client.0.smithi153.stderr:++ hash -r 2024-09-19T14:05:26.669 INFO:tasks.workunit.client.0.smithi153.stderr:++ '[' -n '' ']' 2024-09-19T14:05:26.669 INFO:tasks.workunit.client.0.smithi153.stderr:++ unset VIRTUAL_ENV 2024-09-19T14:05:26.669 INFO:tasks.workunit.client.0.smithi153.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-19T14:05:26.669 INFO:tasks.workunit.client.0.smithi153.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-19T14:05:26.670 INFO:tasks.workunit.client.0.smithi153.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T14:05:26.670 INFO:tasks.workunit.client.0.smithi153.stderr:++ export VIRTUAL_ENV 2024-09-19T14:05:26.670 INFO:tasks.workunit.client.0.smithi153.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-19T14:05:26.670 INFO:tasks.workunit.client.0.smithi153.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-19T14:05:26.670 INFO:tasks.workunit.client.0.smithi153.stderr:++ export PATH 2024-09-19T14:05:26.670 INFO:tasks.workunit.client.0.smithi153.stderr:++ '[' -n '' ']' 2024-09-19T14:05:26.670 INFO:tasks.workunit.client.0.smithi153.stderr:++ '[' -z '' ']' 2024-09-19T14:05:26.670 INFO:tasks.workunit.client.0.smithi153.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-19T14:05:26.670 INFO:tasks.workunit.client.0.smithi153.stderr:++ PS1='(rgw) ' 2024-09-19T14:05:26.670 INFO:tasks.workunit.client.0.smithi153.stderr:++ export PS1 2024-09-19T14:05:26.670 INFO:tasks.workunit.client.0.smithi153.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-19T14:05:26.670 INFO:tasks.workunit.client.0.smithi153.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-19T14:05:26.670 INFO:tasks.workunit.client.0.smithi153.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T14:05:26.671 INFO:tasks.workunit.client.0.smithi153.stderr:++ hash -r 2024-09-19T14:05:26.671 INFO:tasks.workunit.client.0.smithi153.stderr:+ pip install pip --upgrade 2024-09-19T14:05:27.067 INFO:tasks.workunit.client.0.smithi153.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-19T14:05:27.276 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting pip 2024-09-19T14:05:27.281 INFO:tasks.workunit.client.0.smithi153.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-19T14:05:27.315 INFO:tasks.workunit.client.0.smithi153.stdout:Installing collected packages: pip 2024-09-19T14:05:27.315 INFO:tasks.workunit.client.0.smithi153.stdout: Attempting uninstall: pip 2024-09-19T14:05:27.315 INFO:tasks.workunit.client.0.smithi153.stdout: Found existing installation: pip 22.0.2 2024-09-19T14:05:27.573 INFO:tasks.workunit.client.0.smithi153.stdout: Uninstalling pip-22.0.2: 2024-09-19T14:05:27.579 INFO:tasks.workunit.client.0.smithi153.stdout: Successfully uninstalled pip-22.0.2 2024-09-19T14:05:28.613 INFO:tasks.workunit.client.0.smithi153.stdout:Successfully installed pip-24.2 2024-09-19T14:05:28.687 INFO:tasks.workunit.client.0.smithi153.stderr:+ pip install boto3 2024-09-19T14:05:29.774 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting boto3 2024-09-19T14:05:29.775 INFO:tasks.workunit.client.0.smithi153.stdout: Using cached boto3-1.35.22-py3-none-any.whl.metadata (6.6 kB) 2024-09-19T14:05:30.280 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting botocore<1.36.0,>=1.35.22 (from boto3) 2024-09-19T14:05:30.282 INFO:tasks.workunit.client.0.smithi153.stdout: Using cached botocore-1.35.22-py3-none-any.whl.metadata (5.7 kB) 2024-09-19T14:05:30.340 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-19T14:05:30.341 INFO:tasks.workunit.client.0.smithi153.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-19T14:05:30.389 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-19T14:05:30.391 INFO:tasks.workunit.client.0.smithi153.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-19T14:05:30.450 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T14:05:30.452 INFO:tasks.workunit.client.0.smithi153.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-19T14:05:30.562 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T14:05:30.564 INFO:tasks.workunit.client.0.smithi153.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-19T14:05:30.711 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T14:05:30.712 INFO:tasks.workunit.client.0.smithi153.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-19T14:05:30.715 INFO:tasks.workunit.client.0.smithi153.stdout:Using cached boto3-1.35.22-py3-none-any.whl (139 kB) 2024-09-19T14:05:30.717 INFO:tasks.workunit.client.0.smithi153.stdout:Using cached botocore-1.35.22-py3-none-any.whl (12.6 MB) 2024-09-19T14:05:30.728 INFO:tasks.workunit.client.0.smithi153.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-19T14:05:30.729 INFO:tasks.workunit.client.0.smithi153.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-19T14:05:30.731 INFO:tasks.workunit.client.0.smithi153.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-19T14:05:30.733 INFO:tasks.workunit.client.0.smithi153.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-19T14:05:30.734 INFO:tasks.workunit.client.0.smithi153.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-19T14:05:30.805 INFO:tasks.workunit.client.0.smithi153.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-19T14:05:31.749 INFO:tasks.workunit.client.0.smithi153.stdout:Successfully installed boto3-1.35.22 botocore-1.35.22 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-19T14:05:31.930 INFO:tasks.workunit.client.0.smithi153.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-19T14:05:32.065 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-19T14:05:32.103 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:05:32.103 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:05:32.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.351+0000 7f30e37879c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:32.354 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.351+0000 7f30e37879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:32.354 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.351+0000 7f30e37879c0 20 realm 2024-09-19T14:05:32.354 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.351+0000 7f30e37879c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:32.354 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.351+0000 7f30e37879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:32.354 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.351+0000 7f30e37879c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:05:32.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.351+0000 7f30e37879c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:32.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.351+0000 7f30e37879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:32.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.351+0000 7f30e37879c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:32.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.351+0000 7f30e37879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:05:32.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.351+0000 7f30e37879c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:32.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.355+0000 7f30e37879c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:05:32.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.355+0000 7f30e37879c0 20 searching for the correct realm 2024-09-19T14:05:32.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.355+0000 7f30e0a8c640 0 -- 172.21.15.153:0/3106544815 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f30d40dc070 msgr2=0x7f30d4116310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:05:32.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.571+0000 7f30e128d640 0 -- 172.21.15.153:0/3106544815 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f30d800e830 msgr2=0x7f30d805c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:05:32.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.787+0000 7f30e37879c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:05:32.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.787+0000 7f30e37879c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:05:32.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.787+0000 7f30e37879c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:05:32.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.787+0000 7f30e37879c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:05:32.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.787+0000 7f30e37879c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:05:32.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.787+0000 7f30e37879c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:05:32.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.787+0000 7f30e37879c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:32.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.787+0000 7f30e37879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:32.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.787+0000 7f30e37879c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:32.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.791+0000 7f30e37879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:05:32.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.791+0000 7f30e37879c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:32.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.791+0000 7f30e37879c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:05:32.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.791+0000 7f30e37879c0 20 zone default found 2024-09-19T14:05:32.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.791+0000 7f30e37879c0 4 Realm: () 2024-09-19T14:05:32.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.791+0000 7f30e37879c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:05:32.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.791+0000 7f30e37879c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:05:32.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.791+0000 7f30e37879c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:05:32.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.791+0000 7f30e37879c0 20 zonegroup default 2024-09-19T14:05:32.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.791+0000 7f30e37879c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:32.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.791+0000 7f30e37879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:32.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.791+0000 7f30e37879c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:32.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.791+0000 7f30e37879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:32.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.791+0000 7f30e37879c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:32.797 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.795+0000 7f30e37879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:32.797 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.795+0000 7f30e37879c0 20 started sync module instance, tier type = 2024-09-19T14:05:32.797 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.795+0000 7f30e37879c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:05:32.820 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.815+0000 7f30e37879c0 20 add_watcher() i=0 2024-09-19T14:05:32.820 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.815+0000 7f30e37879c0 20 add_watcher() i=1 2024-09-19T14:05:32.820 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.815+0000 7f30e37879c0 20 add_watcher() i=2 2024-09-19T14:05:32.820 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.815+0000 7f30e37879c0 20 add_watcher() i=3 2024-09-19T14:05:32.820 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.815+0000 7f30e37879c0 20 add_watcher() i=4 2024-09-19T14:05:32.820 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.815+0000 7f30e37879c0 20 add_watcher() i=5 2024-09-19T14:05:32.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.815+0000 7f30e37879c0 20 add_watcher() i=6 2024-09-19T14:05:32.824 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.819+0000 7f30e37879c0 20 add_watcher() i=7 2024-09-19T14:05:32.824 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.819+0000 7f30e37879c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:05:32.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.823+0000 7f2f977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:05:32.828 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.827+0000 7f30e37879c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:05:32.828 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.827+0000 7f30e37879c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:05:32.828 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.827+0000 7f30e37879c0 5 note: GC not initialized 2024-09-19T14:05:32.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.827+0000 7f2f967e4640 20 reqs_thread_entry: start 2024-09-19T14:05:32.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.827+0000 7f30e37879c0 20 init_complete bucket index max shards: 11 2024-09-19T14:05:32.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.827+0000 7f30e37879c0 20 Filter name: none 2024-09-19T14:05:32.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.827+0000 7f2f07fff640 20 reqs_thread_entry: start 2024-09-19T14:05:32.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.827+0000 7f30e37879c0 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-19T14:05:32.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.827+0000 7f30e37879c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:32.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.827+0000 7f30e37879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:32.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.827+0000 7f30e37879c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-19T14:05:32.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.827+0000 7f30e37879c0 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-19T14:05:32.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.827+0000 7f30e37879c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-19T14:05:32.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.827+0000 7f30e37879c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:32.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.827+0000 7f30e37879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:32.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.827+0000 7f30e37879c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-19T14:05:32.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.827+0000 7f30e37879c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-19T14:05:32.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.827+0000 7f30e37879c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-19T14:05:32.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.827+0000 7f30e37879c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-19T14:05:32.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.831+0000 7f30e37879c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-19T14:05:32.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.831+0000 7f30e37879c0 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-19T14:05:32.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.831+0000 7f30e37879c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-09-19T14:05:32.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.831+0000 7f2fc4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333459 cookie 94179177547328 notifier 5633 bl.length()=569 2024-09-19T14:05:32.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.831+0000 7f2fc4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-19T14:05:32.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.831+0000 7f2fc4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-19T14:05:32.839 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.835+0000 7f30e37879c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-19T14:05:32.839 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.835+0000 7f30e37879c0 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-19T14:05:32.839 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.835+0000 7f30e37879c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-19T14:05:32.839 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.835+0000 7f2fc4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333460 cookie 94179177548528 notifier 5633 bl.length()=180 2024-09-19T14:05:32.839 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.835+0000 7f2fc4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-19T14:05:32.839 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.835+0000 7f2fc4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-19T14:05:32.843 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.839+0000 7f2f977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:05:32.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.843+0000 7f30e37879c0 20 remove_watcher() i=0 2024-09-19T14:05:32.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.843+0000 7f30e37879c0 2 removed watcher, disabling cache 2024-09-19T14:05:32.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.847+0000 7f30e37879c0 20 remove_watcher() i=1 2024-09-19T14:05:32.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.851+0000 7f30e37879c0 20 remove_watcher() i=2 2024-09-19T14:05:32.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.851+0000 7f30e37879c0 20 remove_watcher() i=3 2024-09-19T14:05:32.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.855+0000 7f30e37879c0 20 remove_watcher() i=4 2024-09-19T14:05:32.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.855+0000 7f30e37879c0 20 remove_watcher() i=5 2024-09-19T14:05:32.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.859+0000 7f30e37879c0 20 remove_watcher() i=6 2024-09-19T14:05:32.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:32.859+0000 7f30e37879c0 20 remove_watcher() i=7 2024-09-19T14:05:52.672 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:05:52.672 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:05:52.755 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:05:52.755 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:05:52.886 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:05:52.886 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:05:53.025 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:05:53.025 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:05:53.108 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:05:53.108 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:05:53.204 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:05:53.205 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:05:53.289 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard add 2024-09-19T14:05:53.289 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:05:53.290 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T14:05:53.323 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:05:53.324 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:05:53.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.371+0000 7f9c37dd89c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.375+0000 7f9c37dd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:53.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.375+0000 7f9c37dd89c0 20 realm 2024-09-19T14:05:53.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.375+0000 7f9c37dd89c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.375+0000 7f9c37dd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:53.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.375+0000 7f9c37dd89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:05:53.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.375+0000 7f9c37dd89c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.375+0000 7f9c37dd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:53.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.375+0000 7f9c37dd89c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.376 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.375+0000 7f9c37dd89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:05:53.376 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.375+0000 7f9c37dd89c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.376 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.379+0000 7f9c37dd89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:05:53.376 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.379+0000 7f9c37dd89c0 20 searching for the correct realm 2024-09-19T14:05:53.382 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.383+0000 7f9c360df640 0 -- 172.21.15.153:0/2668987441 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x564a33b3c370 msgr2=0x564a33b3e7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:05:53.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.391+0000 7f9c358de640 0 -- 172.21.15.153:0/2668987441 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f9c280f6410 msgr2=0x7f9c280f6890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:05:53.397 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.399+0000 7f9c37dd89c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:05:53.397 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.399+0000 7f9c37dd89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:05:53.397 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.399+0000 7f9c37dd89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:05:53.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.399+0000 7f9c37dd89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:05:53.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.399+0000 7f9c37dd89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:05:53.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.399+0000 7f9c37dd89c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:05:53.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.399+0000 7f9c37dd89c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.399+0000 7f9c37dd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:53.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.399+0000 7f9c37dd89c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.399+0000 7f9c37dd89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:05:53.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.399+0000 7f9c37dd89c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.399 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.399+0000 7f9c37dd89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:05:53.400 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.399+0000 7f9c37dd89c0 20 zone default found 2024-09-19T14:05:53.400 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.399+0000 7f9c37dd89c0 4 Realm: () 2024-09-19T14:05:53.400 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.399+0000 7f9c37dd89c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:05:53.400 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.399+0000 7f9c37dd89c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:05:53.400 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.399+0000 7f9c37dd89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:05:53.400 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.399+0000 7f9c37dd89c0 20 zonegroup default 2024-09-19T14:05:53.400 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.399+0000 7f9c37dd89c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.400 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.399+0000 7f9c37dd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:53.400 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.399+0000 7f9c37dd89c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.401 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.403+0000 7f9c37dd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:53.401 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.403+0000 7f9c37dd89c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.401 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.403+0000 7f9c37dd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:53.401 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.403+0000 7f9c37dd89c0 20 started sync module instance, tier type = 2024-09-19T14:05:53.401 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.403+0000 7f9c37dd89c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:05:53.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.419+0000 7f9c37dd89c0 20 add_watcher() i=0 2024-09-19T14:05:53.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.419+0000 7f9c37dd89c0 20 add_watcher() i=1 2024-09-19T14:05:53.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.419+0000 7f9c37dd89c0 20 add_watcher() i=2 2024-09-19T14:05:53.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.419+0000 7f9c37dd89c0 20 add_watcher() i=3 2024-09-19T14:05:53.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.419+0000 7f9c37dd89c0 20 add_watcher() i=4 2024-09-19T14:05:53.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.419+0000 7f9c37dd89c0 20 add_watcher() i=5 2024-09-19T14:05:53.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.419+0000 7f9c37dd89c0 20 add_watcher() i=6 2024-09-19T14:05:53.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.419+0000 7f9c37dd89c0 20 add_watcher() i=7 2024-09-19T14:05:53.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.419+0000 7f9c37dd89c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:05:53.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.423+0000 7f9ae77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:05:53.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.423+0000 7f9c37dd89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:05:53.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.423+0000 7f9c37dd89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:05:53.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.423+0000 7f9c37dd89c0 5 note: GC not initialized 2024-09-19T14:05:53.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.423+0000 7f9ae67fc640 20 reqs_thread_entry: start 2024-09-19T14:05:53.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.423+0000 7f9c37dd89c0 20 init_complete bucket index max shards: 11 2024-09-19T14:05:53.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.423+0000 7f9c37dd89c0 20 Filter name: none 2024-09-19T14:05:53.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.423+0000 7f9a57fff640 20 reqs_thread_entry: start 2024-09-19T14:05:53.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.423+0000 7f9c37dd89c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.423 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.423+0000 7f9c37dd89c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:05:53.423 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.423+0000 7f9c37dd89c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.424 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.423+0000 7f9c37dd89c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:05:53.424 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.423+0000 7f9c37dd89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:05:53.424 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.423+0000 7f9c37dd89c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.425 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.427+0000 7f9c37dd89c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:05:53.425 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.427+0000 7f9c37dd89c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.425 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.427+0000 7f9c37dd89c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:05:53.425 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.427+0000 7f9c37dd89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:05:53.428 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.427+0000 7f9ae77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:05:53.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.435+0000 7f9c37dd89c0 20 remove_watcher() i=0 2024-09-19T14:05:53.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.435+0000 7f9c37dd89c0 2 removed watcher, disabling cache 2024-09-19T14:05:53.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.435+0000 7f9c37dd89c0 20 remove_watcher() i=1 2024-09-19T14:05:53.436 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.439+0000 7f9c37dd89c0 20 remove_watcher() i=2 2024-09-19T14:05:53.439 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.439+0000 7f9c37dd89c0 20 remove_watcher() i=3 2024-09-19T14:05:53.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.443+0000 7f9c37dd89c0 20 remove_watcher() i=4 2024-09-19T14:05:53.442 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.443+0000 7f9c37dd89c0 20 remove_watcher() i=5 2024-09-19T14:05:53.444 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.443+0000 7f9c37dd89c0 20 remove_watcher() i=6 2024-09-19T14:05:53.445 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.447+0000 7f9c37dd89c0 20 remove_watcher() i=7 2024-09-19T14:05:53.461 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:05:53.461 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:05:53.461 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: a-bucket id: dbb1da81-49d0-421a-b677-974869a7f103.4620.17 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-19T14:05:53.461 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:05:53.461 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-19T14:05:53.490 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:05:53.490 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:05:53.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.535+0000 7ffa2af809c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.539+0000 7ffa2af809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:53.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.539+0000 7ffa2af809c0 20 realm 2024-09-19T14:05:53.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.539+0000 7ffa2af809c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.539+0000 7ffa2af809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:53.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.539+0000 7ffa2af809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:05:53.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.539+0000 7ffa2af809c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.539+0000 7ffa2af809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:53.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.539+0000 7ffa2af809c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.539+0000 7ffa2af809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:05:53.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.539+0000 7ffa2af809c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.539+0000 7ffa2af809c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:05:53.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.539+0000 7ffa2af809c0 20 searching for the correct realm 2024-09-19T14:05:53.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.547+0000 7ffa29287640 0 -- 172.21.15.153:0/1974360419 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7ffa10013030 msgr2=0x7ffa10079020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:05:53.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.763+0000 7ffa28a86640 0 -- 172.21.15.153:0/1974360419 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x564a32ec9680 msgr2=0x564a32ecbab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:05:53.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.771+0000 7ffa2af809c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:05:53.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.771+0000 7ffa2af809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:05:53.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.771+0000 7ffa2af809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:05:53.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.771+0000 7ffa2af809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:05:53.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.771+0000 7ffa2af809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:05:53.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.771+0000 7ffa2af809c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:05:53.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.771+0000 7ffa2af809c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.771+0000 7ffa2af809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:53.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.771+0000 7ffa2af809c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.775+0000 7ffa2af809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:05:53.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.775+0000 7ffa2af809c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.775+0000 7ffa2af809c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:05:53.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.775+0000 7ffa2af809c0 20 zone default found 2024-09-19T14:05:53.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.775+0000 7ffa2af809c0 4 Realm: () 2024-09-19T14:05:53.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.775+0000 7ffa2af809c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:05:53.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.775+0000 7ffa2af809c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:05:53.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.775+0000 7ffa2af809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:05:53.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.775+0000 7ffa2af809c0 20 zonegroup default 2024-09-19T14:05:53.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.775+0000 7ffa2af809c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.775+0000 7ffa2af809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:53.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.775+0000 7ffa2af809c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.775+0000 7ffa2af809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:53.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.775+0000 7ffa2af809c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.775+0000 7ffa2af809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:53.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.775+0000 7ffa2af809c0 20 started sync module instance, tier type = 2024-09-19T14:05:53.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.775+0000 7ffa2af809c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:05:53.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.799+0000 7ffa2af809c0 20 add_watcher() i=0 2024-09-19T14:05:53.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.799+0000 7ffa2af809c0 20 add_watcher() i=1 2024-09-19T14:05:53.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.799+0000 7ffa2af809c0 20 add_watcher() i=2 2024-09-19T14:05:53.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.799+0000 7ffa2af809c0 20 add_watcher() i=3 2024-09-19T14:05:53.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.799+0000 7ffa2af809c0 20 add_watcher() i=4 2024-09-19T14:05:53.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.799+0000 7ffa2af809c0 20 add_watcher() i=5 2024-09-19T14:05:53.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.799+0000 7ffa2af809c0 20 add_watcher() i=6 2024-09-19T14:05:53.799 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.799+0000 7ffa2af809c0 20 add_watcher() i=7 2024-09-19T14:05:53.799 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.799+0000 7ffa2af809c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:05:53.803 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.803+0000 7ff8df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:05:53.804 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.807+0000 7ffa2af809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:05:53.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.807+0000 7ffa2af809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:05:53.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.807+0000 7ffa2af809c0 5 note: GC not initialized 2024-09-19T14:05:53.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.807+0000 7ff8de7e4640 20 reqs_thread_entry: start 2024-09-19T14:05:53.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.807+0000 7ffa2af809c0 20 init_complete bucket index max shards: 11 2024-09-19T14:05:53.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.807+0000 7ffa2af809c0 20 Filter name: none 2024-09-19T14:05:53.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.807+0000 7ff8d77fe640 20 reqs_thread_entry: start 2024-09-19T14:05:53.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.807+0000 7ffa2af809c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:05:53.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.807+0000 7ffa2af809c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.807 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.807+0000 7ffa2af809c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:05:53.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.807+0000 7ffa2af809c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:05:53.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.807+0000 7ffa2af809c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:05:53.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.807+0000 7ffa2af809c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : miss 2024-09-19T14:05:53.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.807+0000 7ffa2af809c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.809 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.811+0000 7ffa2af809c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:05:53.809 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.811+0000 7ffa2af809c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:05:53.809 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.811+0000 7ffa2af809c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:05:53.809 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.811+0000 7ffa2af809c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:05:53.809 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.811+0000 7ffa2af809c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:05:53.809 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.811+0000 7ffa2af809c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:05:53.812 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.815+0000 7ff8df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:05:53.817 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.819+0000 7ffa2af809c0 20 remove_watcher() i=0 2024-09-19T14:05:53.817 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.819+0000 7ffa2af809c0 2 removed watcher, disabling cache 2024-09-19T14:05:53.819 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.819+0000 7ffa2af809c0 20 remove_watcher() i=1 2024-09-19T14:05:53.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.823+0000 7ffa2af809c0 20 remove_watcher() i=2 2024-09-19T14:05:53.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.823+0000 7ffa2af809c0 20 remove_watcher() i=3 2024-09-19T14:05:53.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.827+0000 7ffa2af809c0 20 remove_watcher() i=4 2024-09-19T14:05:53.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.827+0000 7ffa2af809c0 20 remove_watcher() i=5 2024-09-19T14:05:53.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.831+0000 7ffa2af809c0 20 remove_watcher() i=6 2024-09-19T14:05:53.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.831+0000 7ffa2af809c0 20 remove_watcher() i=7 2024-09-19T14:05:53.846 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin reshard list 2024-09-19T14:05:53.875 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:05:53.875 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:05:53.920 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.919+0000 7fd6a3a7c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.923+0000 7fd6a3a7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:53.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.923+0000 7fd6a3a7c9c0 20 realm 2024-09-19T14:05:53.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.923+0000 7fd6a3a7c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.923+0000 7fd6a3a7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:53.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.923+0000 7fd6a3a7c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:05:53.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.923+0000 7fd6a3a7c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.923+0000 7fd6a3a7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:53.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.923+0000 7fd6a3a7c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.923+0000 7fd6a3a7c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:05:53.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.923+0000 7fd6a3a7c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.927+0000 7fd6a3a7c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:05:53.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.927+0000 7fd6a3a7c9c0 20 searching for the correct realm 2024-09-19T14:05:53.930 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.931+0000 7fd6a0d81640 0 -- 172.21.15.153:0/4077146096 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fd694119b60 msgr2=0x7fd694108570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:05:53.937 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.939+0000 7fd6a0d81640 0 -- 172.21.15.153:0/4077146096 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fd56c082340 msgr2=0x7fd56c084770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:05:53.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.943+0000 7fd6a3a7c9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:05:53.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.943+0000 7fd6a3a7c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:05:53.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.943+0000 7fd6a3a7c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:05:53.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.943+0000 7fd6a3a7c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:05:53.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.943+0000 7fd6a3a7c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:05:53.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.943+0000 7fd6a3a7c9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:05:53.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.943+0000 7fd6a3a7c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.947+0000 7fd6a3a7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:53.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.947+0000 7fd6a3a7c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.947+0000 7fd6a3a7c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:05:53.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.947+0000 7fd6a3a7c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.947+0000 7fd6a3a7c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:05:53.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.947+0000 7fd6a3a7c9c0 20 zone default found 2024-09-19T14:05:53.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.947+0000 7fd6a3a7c9c0 4 Realm: () 2024-09-19T14:05:53.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.947+0000 7fd6a3a7c9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:05:53.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.947+0000 7fd6a3a7c9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:05:53.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.947+0000 7fd6a3a7c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:05:53.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.947+0000 7fd6a3a7c9c0 20 zonegroup default 2024-09-19T14:05:53.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.947+0000 7fd6a3a7c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.947+0000 7fd6a3a7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:53.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.947+0000 7fd6a3a7c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.947+0000 7fd6a3a7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:53.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.947+0000 7fd6a3a7c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:53.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.947+0000 7fd6a3a7c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:53.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.947+0000 7fd6a3a7c9c0 20 started sync module instance, tier type = 2024-09-19T14:05:53.948 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.947+0000 7fd6a3a7c9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:05:53.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.963+0000 7fd6a3a7c9c0 20 add_watcher() i=0 2024-09-19T14:05:53.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.963+0000 7fd6a3a7c9c0 20 add_watcher() i=1 2024-09-19T14:05:53.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.963+0000 7fd6a3a7c9c0 20 add_watcher() i=2 2024-09-19T14:05:53.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.963+0000 7fd6a3a7c9c0 20 add_watcher() i=3 2024-09-19T14:05:53.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.963+0000 7fd6a3a7c9c0 20 add_watcher() i=4 2024-09-19T14:05:53.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.963+0000 7fd6a3a7c9c0 20 add_watcher() i=5 2024-09-19T14:05:53.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.963+0000 7fd6a3a7c9c0 20 add_watcher() i=6 2024-09-19T14:05:53.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.967+0000 7fd6a3a7c9c0 20 add_watcher() i=7 2024-09-19T14:05:53.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.967+0000 7fd6a3a7c9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:05:53.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.967+0000 7fd557fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:05:53.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.967+0000 7fd6a3a7c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:05:53.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.967+0000 7fd6a3a7c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:05:53.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.967+0000 7fd6a3a7c9c0 5 note: GC not initialized 2024-09-19T14:05:53.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.967+0000 7fd556fe5640 20 reqs_thread_entry: start 2024-09-19T14:05:53.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.967+0000 7fd6a3a7c9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:05:53.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.967+0000 7fd6a3a7c9c0 20 Filter name: none 2024-09-19T14:05:53.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.967+0000 7fd554fe1640 20 reqs_thread_entry: start 2024-09-19T14:05:53.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.979+0000 7fd557fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:05:53.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.983+0000 7fd6a3a7c9c0 20 remove_watcher() i=0 2024-09-19T14:05:53.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.983+0000 7fd6a3a7c9c0 2 removed watcher, disabling cache 2024-09-19T14:05:53.985 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.987+0000 7fd6a3a7c9c0 20 remove_watcher() i=1 2024-09-19T14:05:53.987 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.987+0000 7fd6a3a7c9c0 20 remove_watcher() i=2 2024-09-19T14:05:53.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.991+0000 7fd6a3a7c9c0 20 remove_watcher() i=3 2024-09-19T14:05:53.991 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.991+0000 7fd6a3a7c9c0 20 remove_watcher() i=4 2024-09-19T14:05:53.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.995+0000 7fd6a3a7c9c0 20 remove_watcher() i=5 2024-09-19T14:05:53.994 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.995+0000 7fd6a3a7c9c0 20 remove_watcher() i=6 2024-09-19T14:05:53.995 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:53.995+0000 7fd6a3a7c9c0 20 remove_watcher() i=7 2024-09-19T14:05:54.009 INFO:tasks.workunit.client.0.smithi153.stderr:bucket name a-bucket 2024-09-19T14:05:54.009 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard process 2024-09-19T14:05:54.009 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:05:54.010 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin reshard process 2024-09-19T14:05:54.034 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:05:54.034 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:05:54.078 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.079+0000 7f406f4e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:54.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.083+0000 7f406f4e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:54.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.083+0000 7f406f4e49c0 20 realm 2024-09-19T14:05:54.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.083+0000 7f406f4e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:54.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.083+0000 7f406f4e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:54.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.083+0000 7f406f4e49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:05:54.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.083+0000 7f406f4e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:54.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.083+0000 7f406f4e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:54.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.083+0000 7f406f4e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:54.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.083+0000 7f406f4e49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:05:54.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.083+0000 7f406f4e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:54.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.083+0000 7f406f4e49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:05:54.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.083+0000 7f406f4e49c0 20 searching for the correct realm 2024-09-19T14:05:54.085 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.087+0000 7f406cfea640 0 -- 172.21.15.153:0/1311166509 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x7f40640bb030 msgr2=0x7f40640f8c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:05:54.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.503+0000 7f406d7eb640 0 -- 172.21.15.153:0/1311166509 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55cc2de0c530 msgr2=0x55cc2de0e940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:05:54.518 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.519+0000 7f406f4e49c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:05:54.518 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.519+0000 7f406f4e49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:05:54.518 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.519+0000 7f406f4e49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:05:54.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.519+0000 7f406f4e49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:05:54.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.519+0000 7f406f4e49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:05:54.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.519+0000 7f406f4e49c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:05:54.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.519+0000 7f406f4e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:54.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.519+0000 7f406f4e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:54.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.519+0000 7f406f4e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:54.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.519+0000 7f406f4e49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:05:54.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.519+0000 7f406f4e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:54.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.523+0000 7f406f4e49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:05:54.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.523+0000 7f406f4e49c0 20 zone default found 2024-09-19T14:05:54.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.523+0000 7f406f4e49c0 4 Realm: () 2024-09-19T14:05:54.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.523+0000 7f406f4e49c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:05:54.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.523+0000 7f406f4e49c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:05:54.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.523+0000 7f406f4e49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:05:54.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.523+0000 7f406f4e49c0 20 zonegroup default 2024-09-19T14:05:54.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.523+0000 7f406f4e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:54.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.523+0000 7f406f4e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:54.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.523+0000 7f406f4e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:54.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.523+0000 7f406f4e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:54.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.523+0000 7f406f4e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:54.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.523+0000 7f406f4e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:54.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.523+0000 7f406f4e49c0 20 started sync module instance, tier type = 2024-09-19T14:05:54.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.523+0000 7f406f4e49c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:05:54.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.547+0000 7f406f4e49c0 20 add_watcher() i=0 2024-09-19T14:05:54.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.547+0000 7f406f4e49c0 20 add_watcher() i=1 2024-09-19T14:05:54.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.547+0000 7f406f4e49c0 20 add_watcher() i=2 2024-09-19T14:05:54.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.547+0000 7f406f4e49c0 20 add_watcher() i=3 2024-09-19T14:05:54.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.547+0000 7f406f4e49c0 20 add_watcher() i=4 2024-09-19T14:05:54.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.547+0000 7f406f4e49c0 20 add_watcher() i=5 2024-09-19T14:05:54.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.547+0000 7f406f4e49c0 20 add_watcher() i=6 2024-09-19T14:05:54.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.551+0000 7f406f4e49c0 20 add_watcher() i=7 2024-09-19T14:05:54.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.551+0000 7f406f4e49c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:05:54.554 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.555+0000 7f3f22fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:05:54.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.555+0000 7f406f4e49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:05:54.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.555+0000 7f406f4e49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:05:54.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.555+0000 7f406f4e49c0 5 note: GC not initialized 2024-09-19T14:05:54.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.555+0000 7f3f21fe3640 20 reqs_thread_entry: start 2024-09-19T14:05:54.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.555+0000 7f406f4e49c0 20 init_complete bucket index max shards: 11 2024-09-19T14:05:54.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.555+0000 7f406f4e49c0 20 Filter name: none 2024-09-19T14:05:54.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.555+0000 7f3e937fe640 20 reqs_thread_entry: start 2024-09-19T14:05:54.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.559+0000 7f406f4e49c0 20 processing logshard = reshard.0000000000 2024-09-19T14:05:54.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.563+0000 7f406f4e49c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-19T14:05:54.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.563+0000 7f406f4e49c0 20 processing logshard = reshard.0000000001 2024-09-19T14:05:54.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.571+0000 7f406f4e49c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-19T14:05:54.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.571+0000 7f406f4e49c0 20 processing logshard = reshard.0000000002 2024-09-19T14:05:54.574 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.575+0000 7f406f4e49c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-19T14:05:54.574 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.575+0000 7f406f4e49c0 20 processing logshard = reshard.0000000003 2024-09-19T14:05:54.579 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.579+0000 7f406f4e49c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-19T14:05:54.579 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.579+0000 7f406f4e49c0 20 processing logshard = reshard.0000000004 2024-09-19T14:05:54.586 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.587+0000 7f406f4e49c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-19T14:05:54.586 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.587+0000 7f406f4e49c0 20 processing logshard = reshard.0000000005 2024-09-19T14:05:54.591 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.591+0000 7f406f4e49c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-19T14:05:54.591 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.591+0000 7f406f4e49c0 20 processing logshard = reshard.0000000006 2024-09-19T14:05:54.594 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.595+0000 7f406f4e49c0 20 process_entry resharding a-bucket 2024-09-19T14:05:54.594 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.595+0000 7f406f4e49c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:05:54.594 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.595+0000 7f406f4e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:54.595 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.595+0000 7f406f4e49c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:05:54.595 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.595+0000 7f406f4e49c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-19T14:05:54.595 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.595+0000 7f406f4e49c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:05:54.596 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.595+0000 7f406f4e49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : miss 2024-09-19T14:05:54.596 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.595+0000 7f406f4e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:54.596 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.599+0000 7f406f4e49c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:05:54.596 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.599+0000 7f406f4e49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:05:54.596 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.599+0000 7f406f4e49c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:05:54.596 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.599+0000 7f406f4e49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:05:54.597 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.599+0000 7f406f4e49c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:05:54.597 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.599+0000 7f406f4e49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:05:54.608 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.611+0000 7f406f4e49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:05:54.608 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.611+0000 7f406f4e49c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:05:54.608 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.611+0000 7f406f4e49c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:05:54.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.611+0000 7f406f4e49c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17, ofs0, ns] 2024-09-19T14:05:54.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.611+0000 7f3f437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333464 cookie 94335431457552 notifier 6030 bl.length()=827 2024-09-19T14:05:54.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.611+0000 7f3f437fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:05:54.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.611+0000 7f3f437fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:05:54.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.611+0000 7f3f437fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:05:54.612 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.611+0000 7f406f4e49c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_sources= new_sources= 2024-09-19T14:05:54.612 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.611+0000 7f406f4e49c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential sources added=[] removed=[] 2024-09-19T14:05:54.612 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.611+0000 7f406f4e49c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_dests= new_dests= 2024-09-19T14:05:54.612 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.611+0000 7f406f4e49c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential dests added=[] removed=[] 2024-09-19T14:05:54.624 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.0 2024-09-19T14:05:54.624 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.0 2024-09-19T14:05:54.624 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.1 2024-09-19T14:05:54.624 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.1 2024-09-19T14:05:54.624 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.2 2024-09-19T14:05:54.624 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.2 2024-09-19T14:05:54.624 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.3 2024-09-19T14:05:54.624 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.3 2024-09-19T14:05:54.624 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.4 2024-09-19T14:05:54.624 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.4 2024-09-19T14:05:54.624 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.5 2024-09-19T14:05:54.624 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.5 2024-09-19T14:05:54.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.6 2024-09-19T14:05:54.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.6 2024-09-19T14:05:54.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.7 2024-09-19T14:05:54.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.7 2024-09-19T14:05:54.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.8 2024-09-19T14:05:54.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.8 2024-09-19T14:05:54.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.9 2024-09-19T14:05:54.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.9 2024-09-19T14:05:54.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.10 2024-09-19T14:05:54.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.10 2024-09-19T14:05:54.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.11 2024-09-19T14:05:54.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.11 2024-09-19T14:05:54.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.623+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.0 2024-09-19T14:05:54.626 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.627+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1 2024-09-19T14:05:54.626 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.627+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2 2024-09-19T14:05:54.627 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.627+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3 2024-09-19T14:05:54.627 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.627+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.4 2024-09-19T14:05:54.629 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.631+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.5 2024-09-19T14:05:54.630 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.631+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.6 2024-09-19T14:05:54.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.631+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.7 2024-09-19T14:05:54.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.631+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.8 2024-09-19T14:05:54.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.635+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.9 2024-09-19T14:05:54.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.635+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.10 2024-09-19T14:05:54.634 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.635+0000 7f406f4e49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : hit (requested=0x17, cached=0x17) 2024-09-19T14:05:54.634 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.635+0000 7f406f4e49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:05:54.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.639+0000 7f406f4e49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:05:54.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.639+0000 7f406f4e49c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:05:54.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.639+0000 7f406f4e49c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:05:54.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.639+0000 7f406f4e49c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17, ofs0, ns] 2024-09-19T14:05:54.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.639+0000 7f3f437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333465 cookie 94335431457552 notifier 6030 bl.length()=827 2024-09-19T14:05:54.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.639+0000 7f3f437fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:05:54.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.639+0000 7f3f437fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:05:54.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.639+0000 7f3f437fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:05:54.640 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.643+0000 7f406f4e49c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_sources= new_sources= 2024-09-19T14:05:54.640 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.643+0000 7f406f4e49c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential sources added=[] removed=[] 2024-09-19T14:05:54.640 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.643+0000 7f406f4e49c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_dests= new_dests= 2024-09-19T14:05:54.641 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.643+0000 7f406f4e49c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential dests added=[] removed=[] 2024-09-19T14:05:54.645 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.647+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.0 2024-09-19T14:05:54.646 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.647+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1 2024-09-19T14:05:54.647 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.647+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2 2024-09-19T14:05:54.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.651+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3 2024-09-19T14:05:54.649 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.651+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.4 2024-09-19T14:05:54.650 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.651+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.5 2024-09-19T14:05:54.651 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.651+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.6 2024-09-19T14:05:54.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.651+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.7 2024-09-19T14:05:54.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.655+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.8 2024-09-19T14:05:54.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.655+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.9 2024-09-19T14:05:54.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.655+0000 7f406f4e49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.10 2024-09-19T14:05:54.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.655+0000 7f406f4e49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : hit (requested=0x17, cached=0x17) 2024-09-19T14:05:54.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.655+0000 7f406f4e49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:05:54.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.659+0000 7f406f4e49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:05:54.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.659+0000 7f406f4e49c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:05:54.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.659+0000 7f406f4e49c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:05:54.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.659+0000 7f406f4e49c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17, ofs0, ns] 2024-09-19T14:05:54.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.659+0000 7f3f43fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333466 cookie 94335431457552 notifier 6030 bl.length()=795 2024-09-19T14:05:54.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.659+0000 7f3f43fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:05:54.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.659+0000 7f3f43fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:05:54.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.659+0000 7f3f43fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:05:54.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.663+0000 7f406f4e49c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_sources= new_sources= 2024-09-19T14:05:54.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.663+0000 7f406f4e49c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential sources added=[] removed=[] 2024-09-19T14:05:54.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.663+0000 7f406f4e49c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_dests= new_dests= 2024-09-19T14:05:54.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.663+0000 7f406f4e49c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential dests added=[] removed=[] 2024-09-19T14:05:54.667 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.667+0000 7f406f4e49c0 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-19T14:05:54.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.671+0000 7f406f4e49c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-19T14:05:54.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.675+0000 7f406f4e49c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-19T14:05:54.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.675+0000 7f406f4e49c0 20 processing logshard = reshard.0000000007 2024-09-19T14:05:54.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.683+0000 7f406f4e49c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-19T14:05:54.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.683+0000 7f406f4e49c0 20 processing logshard = reshard.0000000008 2024-09-19T14:05:54.688 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.687+0000 7f406f4e49c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-19T14:05:54.688 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.687+0000 7f406f4e49c0 20 processing logshard = reshard.0000000009 2024-09-19T14:05:54.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.695+0000 7f406f4e49c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-19T14:05:54.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.695+0000 7f406f4e49c0 20 processing logshard = reshard.0000000010 2024-09-19T14:05:54.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.699+0000 7f406f4e49c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-19T14:05:54.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.699+0000 7f406f4e49c0 20 processing logshard = reshard.0000000011 2024-09-19T14:05:54.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.707+0000 7f406f4e49c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-19T14:05:54.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.707+0000 7f406f4e49c0 20 processing logshard = reshard.0000000012 2024-09-19T14:05:54.712 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.711+0000 7f406f4e49c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-19T14:05:54.712 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.711+0000 7f406f4e49c0 20 processing logshard = reshard.0000000013 2024-09-19T14:05:54.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.719+0000 7f406f4e49c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-19T14:05:54.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.719+0000 7f406f4e49c0 20 processing logshard = reshard.0000000014 2024-09-19T14:05:54.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.723+0000 7f406f4e49c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-19T14:05:54.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.723+0000 7f406f4e49c0 20 processing logshard = reshard.0000000015 2024-09-19T14:05:54.730 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.731+0000 7f406f4e49c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-19T14:05:54.733 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.735+0000 7f3f22fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:05:54.738 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.739+0000 7f406f4e49c0 20 remove_watcher() i=0 2024-09-19T14:05:54.738 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.739+0000 7f406f4e49c0 2 removed watcher, disabling cache 2024-09-19T14:05:54.741 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.743+0000 7f406f4e49c0 20 remove_watcher() i=1 2024-09-19T14:05:54.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.743+0000 7f406f4e49c0 20 remove_watcher() i=2 2024-09-19T14:05:54.746 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.747+0000 7f406f4e49c0 20 remove_watcher() i=3 2024-09-19T14:05:54.749 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.751+0000 7f406f4e49c0 20 remove_watcher() i=4 2024-09-19T14:05:54.751 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.751+0000 7f406f4e49c0 20 remove_watcher() i=5 2024-09-19T14:05:54.753 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.755+0000 7f406f4e49c0 20 remove_watcher() i=6 2024-09-19T14:05:54.755 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:54.755+0000 7f406f4e49c0 20 remove_watcher() i=7 2024-09-19T14:05:59.783 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T14:05:59.816 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:05:59.816 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:05:59.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:59.863+0000 7f7fbe3719c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:59.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:59.863+0000 7f7fbe3719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:59.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:59.863+0000 7f7fbe3719c0 20 realm 2024-09-19T14:05:59.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:59.863+0000 7f7fbe3719c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:59.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:59.863+0000 7f7fbe3719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:59.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:59.863+0000 7f7fbe3719c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:05:59.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:59.863+0000 7f7fbe3719c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:59.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:59.863+0000 7f7fbe3719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:05:59.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:59.863+0000 7f7fbe3719c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:59.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:59.867+0000 7f7fbe3719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:05:59.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:59.867+0000 7f7fbe3719c0 20 rados->read ofs=0 len=0 2024-09-19T14:05:59.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:59.867+0000 7f7fbe3719c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:05:59.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:59.867+0000 7f7fbe3719c0 20 searching for the correct realm 2024-09-19T14:05:59.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:59.871+0000 7f7fbb676640 0 -- 172.21.15.153:0/2706422682 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f7fb403f070 msgr2=0x7f7fb4073910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:05:59.876 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:05:59.879+0000 7f7fbbe77640 0 -- 172.21.15.153:0/2706422682 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f7fa4001ab0 msgr2=0x7f7fa40093d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:00.094 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.095+0000 7f7fbe3719c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:00.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.095+0000 7f7fbe3719c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:00.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.095+0000 7f7fbe3719c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:00.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.095+0000 7f7fbe3719c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:00.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.095+0000 7f7fbe3719c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:00.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.095+0000 7f7fbe3719c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:00.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.095+0000 7f7fbe3719c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:00.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.095+0000 7f7fbe3719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:00.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.095+0000 7f7fbe3719c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:00.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.095+0000 7f7fbe3719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:00.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.095+0000 7f7fbe3719c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:00.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.099+0000 7f7fbe3719c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:00.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.099+0000 7f7fbe3719c0 20 zone default found 2024-09-19T14:06:00.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.099+0000 7f7fbe3719c0 4 Realm: () 2024-09-19T14:06:00.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.099+0000 7f7fbe3719c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:00.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.099+0000 7f7fbe3719c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:00.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.099+0000 7f7fbe3719c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:00.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.099+0000 7f7fbe3719c0 20 zonegroup default 2024-09-19T14:06:00.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.099+0000 7f7fbe3719c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:00.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.099+0000 7f7fbe3719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:00.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.099+0000 7f7fbe3719c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:00.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.099+0000 7f7fbe3719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:00.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.099+0000 7f7fbe3719c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:00.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.099+0000 7f7fbe3719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:00.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.099+0000 7f7fbe3719c0 20 started sync module instance, tier type = 2024-09-19T14:06:00.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.099+0000 7f7fbe3719c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:00.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.123+0000 7f7fbe3719c0 20 add_watcher() i=0 2024-09-19T14:06:00.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.123+0000 7f7fbe3719c0 20 add_watcher() i=1 2024-09-19T14:06:00.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.123+0000 7f7fbe3719c0 20 add_watcher() i=2 2024-09-19T14:06:00.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.123+0000 7f7fbe3719c0 20 add_watcher() i=3 2024-09-19T14:06:00.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.123+0000 7f7fbe3719c0 20 add_watcher() i=4 2024-09-19T14:06:00.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.123+0000 7f7fbe3719c0 20 add_watcher() i=5 2024-09-19T14:06:00.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.123+0000 7f7fbe3719c0 20 add_watcher() i=6 2024-09-19T14:06:00.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.123+0000 7f7fbe3719c0 20 add_watcher() i=7 2024-09-19T14:06:00.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.123+0000 7f7fbe3719c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:00.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.127+0000 7f7e71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:00.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.131+0000 7f7fbe3719c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:00.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.131+0000 7f7fbe3719c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:00.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.131+0000 7f7fbe3719c0 5 note: GC not initialized 2024-09-19T14:06:00.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.131+0000 7f7e70fe1640 20 reqs_thread_entry: start 2024-09-19T14:06:00.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.131+0000 7f7fbe3719c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:00.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.131+0000 7f7fbe3719c0 20 Filter name: none 2024-09-19T14:06:00.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.131+0000 7f7dea7fc640 20 reqs_thread_entry: start 2024-09-19T14:06:00.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.131+0000 7f7fbe3719c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:00.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.131+0000 7f7fbe3719c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:06:00.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.131+0000 7f7fbe3719c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:00.132 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.131+0000 7f7fbe3719c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:06:00.132 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.131+0000 7f7fbe3719c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:00.132 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.131+0000 7f7fbe3719c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:00.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.135+0000 7f7fbe3719c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:06:00.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.135+0000 7f7fbe3719c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:00.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.135+0000 7f7fbe3719c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:06:00.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.135+0000 7f7fbe3719c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:00.137 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.139+0000 7f7e71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:00.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.143+0000 7f7fbe3719c0 20 remove_watcher() i=0 2024-09-19T14:06:00.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.143+0000 7f7fbe3719c0 2 removed watcher, disabling cache 2024-09-19T14:06:00.143 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.143+0000 7f7fbe3719c0 20 remove_watcher() i=1 2024-09-19T14:06:00.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.147+0000 7f7fbe3719c0 20 remove_watcher() i=2 2024-09-19T14:06:00.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.147+0000 7f7fbe3719c0 20 remove_watcher() i=3 2024-09-19T14:06:00.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.151+0000 7f7fbe3719c0 20 remove_watcher() i=4 2024-09-19T14:06:00.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.155+0000 7f7fbe3719c0 20 remove_watcher() i=5 2024-09-19T14:06:00.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.155+0000 7f7fbe3719c0 20 remove_watcher() i=6 2024-09-19T14:06:00.155 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.155+0000 7f7fbe3719c0 20 remove_watcher() i=7 2024-09-19T14:06:00.177 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:00.177 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:06:00.177 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: a-bucket id: dbb1da81-49d0-421a-b677-974869a7f103.4620.17 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-19T14:06:00.177 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:00.177 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard add non empty bucket 2024-09-19T14:06:00.177 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:00.183 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:00.183 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:00.241 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:00.241 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:00.301 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:00.301 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:00.381 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:00.381 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:00.483 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:00.483 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:00.582 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:00.583 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:00.673 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:00.673 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:00.743 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:00.743 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:00.818 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T14:06:00.851 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:00.851 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:00.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.899+0000 7fd4b5e7e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:00.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.903+0000 7fd4b5e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:00.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.903+0000 7fd4b5e7e9c0 20 realm 2024-09-19T14:06:00.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.903+0000 7fd4b5e7e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:00.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.903+0000 7fd4b5e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:00.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.903+0000 7fd4b5e7e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:00.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.903+0000 7fd4b5e7e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:00.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.903+0000 7fd4b5e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:00.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.903+0000 7fd4b5e7e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:00.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.903+0000 7fd4b5e7e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:00.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.903+0000 7fd4b5e7e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:00.903 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.903+0000 7fd4b5e7e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:00.903 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.903+0000 7fd4b5e7e9c0 20 searching for the correct realm 2024-09-19T14:06:00.905 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:00.907+0000 7fd4b3984640 0 -- 172.21.15.153:0/689299055 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x7fd4ac024070 msgr2=0x7fd4ac05fc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:01.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.123+0000 7fd4b4185640 0 -- 172.21.15.153:0/689299055 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7fd4a80ddf00 msgr2=0x7fd4a80e2130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:01.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.139+0000 7fd4b5e7e9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:01.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.139+0000 7fd4b5e7e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:01.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.139+0000 7fd4b5e7e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:01.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.139+0000 7fd4b5e7e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:01.139 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.139+0000 7fd4b5e7e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:01.139 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.139+0000 7fd4b5e7e9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:01.139 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.139+0000 7fd4b5e7e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.139 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.139+0000 7fd4b5e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.139 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.139+0000 7fd4b5e7e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.139+0000 7fd4b5e7e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:01.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.139+0000 7fd4b5e7e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.143+0000 7fd4b5e7e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:01.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.143+0000 7fd4b5e7e9c0 20 zone default found 2024-09-19T14:06:01.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.143+0000 7fd4b5e7e9c0 4 Realm: () 2024-09-19T14:06:01.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.143+0000 7fd4b5e7e9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:01.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.143+0000 7fd4b5e7e9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:01.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.143+0000 7fd4b5e7e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:01.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.143+0000 7fd4b5e7e9c0 20 zonegroup default 2024-09-19T14:06:01.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.143+0000 7fd4b5e7e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.143+0000 7fd4b5e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.143+0000 7fd4b5e7e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.143 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.143+0000 7fd4b5e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.143 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.143+0000 7fd4b5e7e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.143 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.143+0000 7fd4b5e7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.144 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.143+0000 7fd4b5e7e9c0 20 started sync module instance, tier type = 2024-09-19T14:06:01.144 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.143+0000 7fd4b5e7e9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:01.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.167+0000 7fd4b5e7e9c0 20 add_watcher() i=0 2024-09-19T14:06:01.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.167+0000 7fd4b5e7e9c0 20 add_watcher() i=1 2024-09-19T14:06:01.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.167+0000 7fd4b5e7e9c0 20 add_watcher() i=2 2024-09-19T14:06:01.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.167+0000 7fd4b5e7e9c0 20 add_watcher() i=3 2024-09-19T14:06:01.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.167+0000 7fd4b5e7e9c0 20 add_watcher() i=4 2024-09-19T14:06:01.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.167+0000 7fd4b5e7e9c0 20 add_watcher() i=5 2024-09-19T14:06:01.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.167+0000 7fd4b5e7e9c0 20 add_watcher() i=6 2024-09-19T14:06:01.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.171+0000 7fd4b5e7e9c0 20 add_watcher() i=7 2024-09-19T14:06:01.171 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.171+0000 7fd4b5e7e9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:01.175 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.175+0000 7fd369fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:01.176 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.175+0000 7fd4b5e7e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:01.176 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.175+0000 7fd4b5e7e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:01.176 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.175+0000 7fd4b5e7e9c0 5 note: GC not initialized 2024-09-19T14:06:01.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.179+0000 7fd368fe1640 20 reqs_thread_entry: start 2024-09-19T14:06:01.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.179+0000 7fd4b5e7e9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:01.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.179+0000 7fd4b5e7e9c0 20 Filter name: none 2024-09-19T14:06:01.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.179+0000 7fd2e27fc640 20 reqs_thread_entry: start 2024-09-19T14:06:01.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.179+0000 7fd4b5e7e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.178 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.179+0000 7fd4b5e7e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:06:01.178 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.179+0000 7fd4b5e7e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.179+0000 7fd4b5e7e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:06:01.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.179+0000 7fd4b5e7e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:01.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.179+0000 7fd4b5e7e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.179+0000 7fd4b5e7e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:06:01.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.183+0000 7fd4b5e7e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.183+0000 7fd4b5e7e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:06:01.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.183+0000 7fd4b5e7e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:01.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.187+0000 7fd369fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:01.190 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.191+0000 7fd4b5e7e9c0 20 remove_watcher() i=0 2024-09-19T14:06:01.190 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.191+0000 7fd4b5e7e9c0 2 removed watcher, disabling cache 2024-09-19T14:06:01.192 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.191+0000 7fd4b5e7e9c0 20 remove_watcher() i=1 2024-09-19T14:06:01.194 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.195+0000 7fd4b5e7e9c0 20 remove_watcher() i=2 2024-09-19T14:06:01.196 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.199+0000 7fd4b5e7e9c0 20 remove_watcher() i=3 2024-09-19T14:06:01.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.199+0000 7fd4b5e7e9c0 20 remove_watcher() i=4 2024-09-19T14:06:01.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.203+0000 7fd4b5e7e9c0 20 remove_watcher() i=5 2024-09-19T14:06:01.202 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.203+0000 7fd4b5e7e9c0 20 remove_watcher() i=6 2024-09-19T14:06:01.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.203+0000 7fd4b5e7e9c0 20 remove_watcher() i=7 2024-09-19T14:06:01.223 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:01.223 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:06:01.223 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: a-bucket id: dbb1da81-49d0-421a-b677-974869a7f103.4620.17 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-19T14:06:01.223 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:01.224 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-19T14:06:01.254 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:01.254 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:01.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.299+0000 7f67129889c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.303+0000 7f67129889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.303+0000 7f67129889c0 20 realm 2024-09-19T14:06:01.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.303+0000 7f67129889c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.303+0000 7f67129889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.303+0000 7f67129889c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:01.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.303+0000 7f67129889c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.303+0000 7f67129889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.303+0000 7f67129889c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.303+0000 7f67129889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:01.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.303+0000 7f67129889c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.303+0000 7f67129889c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:01.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.303+0000 7f67129889c0 20 searching for the correct realm 2024-09-19T14:06:01.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.311+0000 7f670fc8d640 0 -- 172.21.15.153:0/3362892177 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f6700012bc0 msgr2=0x7f670007b730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:01.315 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.315+0000 7f671048e640 0 -- 172.21.15.153:0/3362892177 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f67040da900 msgr2=0x7f67040b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:01.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.531+0000 7f67129889c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:01.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.531+0000 7f67129889c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:01.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.531+0000 7f67129889c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:01.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.531+0000 7f67129889c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:01.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.531+0000 7f67129889c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:01.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.531+0000 7f67129889c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:01.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.531+0000 7f67129889c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.531+0000 7f67129889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.531+0000 7f67129889c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.535+0000 7f67129889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:01.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.535+0000 7f67129889c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.535+0000 7f67129889c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:01.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.535+0000 7f67129889c0 20 zone default found 2024-09-19T14:06:01.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.535+0000 7f67129889c0 4 Realm: () 2024-09-19T14:06:01.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.535+0000 7f67129889c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:01.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.535+0000 7f67129889c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:01.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.535+0000 7f67129889c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:01.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.535+0000 7f67129889c0 20 zonegroup default 2024-09-19T14:06:01.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.535+0000 7f67129889c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.535+0000 7f67129889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.535+0000 7f67129889c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.535+0000 7f67129889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.535+0000 7f67129889c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.539+0000 7f67129889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.539+0000 7f67129889c0 20 started sync module instance, tier type = 2024-09-19T14:06:01.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.539+0000 7f67129889c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:01.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.563+0000 7f67129889c0 20 add_watcher() i=0 2024-09-19T14:06:01.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.563+0000 7f67129889c0 20 add_watcher() i=1 2024-09-19T14:06:01.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.563+0000 7f67129889c0 20 add_watcher() i=2 2024-09-19T14:06:01.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.563+0000 7f67129889c0 20 add_watcher() i=3 2024-09-19T14:06:01.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.563+0000 7f67129889c0 20 add_watcher() i=4 2024-09-19T14:06:01.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.563+0000 7f67129889c0 20 add_watcher() i=5 2024-09-19T14:06:01.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.563+0000 7f67129889c0 20 add_watcher() i=6 2024-09-19T14:06:01.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.563+0000 7f67129889c0 20 add_watcher() i=7 2024-09-19T14:06:01.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.563+0000 7f67129889c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:01.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.567+0000 7f65c6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:01.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.571+0000 7f67129889c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:01.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.571+0000 7f67129889c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:01.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.571+0000 7f67129889c0 5 note: GC not initialized 2024-09-19T14:06:01.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.571+0000 7f65c5fdb640 20 reqs_thread_entry: start 2024-09-19T14:06:01.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.571+0000 7f67129889c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:01.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.571+0000 7f67129889c0 20 Filter name: none 2024-09-19T14:06:01.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.571+0000 7f65377fe640 20 reqs_thread_entry: start 2024-09-19T14:06:01.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.571+0000 7f67129889c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:06:01.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.571+0000 7f67129889c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.571+0000 7f67129889c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:06:01.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.571+0000 7f67129889c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:06:01.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.571+0000 7f67129889c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:06:01.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.571+0000 7f67129889c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : miss 2024-09-19T14:06:01.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.571+0000 7f67129889c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.571+0000 7f67129889c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:06:01.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.571+0000 7f67129889c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:06:01.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.571+0000 7f67129889c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:06:01.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.571+0000 7f67129889c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:06:01.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.571+0000 7f67129889c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:06:01.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.571+0000 7f67129889c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:06:01.575 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.575+0000 7f65c6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:01.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.579+0000 7f67129889c0 20 remove_watcher() i=0 2024-09-19T14:06:01.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.579+0000 7f67129889c0 2 removed watcher, disabling cache 2024-09-19T14:06:01.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.583+0000 7f67129889c0 20 remove_watcher() i=1 2024-09-19T14:06:01.584 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.587+0000 7f67129889c0 20 remove_watcher() i=2 2024-09-19T14:06:01.586 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.587+0000 7f67129889c0 20 remove_watcher() i=3 2024-09-19T14:06:01.588 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.591+0000 7f67129889c0 20 remove_watcher() i=4 2024-09-19T14:06:01.590 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.591+0000 7f67129889c0 20 remove_watcher() i=5 2024-09-19T14:06:01.591 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.591+0000 7f67129889c0 20 remove_watcher() i=6 2024-09-19T14:06:01.593 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.595+0000 7f67129889c0 20 remove_watcher() i=7 2024-09-19T14:06:01.610 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin reshard list 2024-09-19T14:06:01.636 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:01.636 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:01.681 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.683+0000 7f87e54fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.683+0000 7f87e54fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.683+0000 7f87e54fe9c0 20 realm 2024-09-19T14:06:01.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.683+0000 7f87e54fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.683+0000 7f87e54fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.683+0000 7f87e54fe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:01.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.683+0000 7f87e54fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.683+0000 7f87e54fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.683+0000 7f87e54fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.686 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.687+0000 7f87e54fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:01.686 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.687+0000 7f87e54fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.686 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.687+0000 7f87e54fe9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:01.686 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.687+0000 7f87e54fe9c0 20 searching for the correct realm 2024-09-19T14:06:01.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.695+0000 7f87e2803640 0 -- 172.21.15.153:0/384865724 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x561bd2877780 msgr2=0x561bd2879b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:01.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.699+0000 7f87e2803640 0 -- 172.21.15.153:0/384865724 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f87d4114b00 msgr2=0x7f87d4105410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:01.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.707+0000 7f87e54fe9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:01.706 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.707+0000 7f87e54fe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:01.706 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.707+0000 7f87e54fe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:01.706 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.707+0000 7f87e54fe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:01.706 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.707+0000 7f87e54fe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:01.706 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.707+0000 7f87e54fe9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:01.706 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.707+0000 7f87e54fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.706 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.707+0000 7f87e54fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.706 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.707+0000 7f87e54fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.707 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.707+0000 7f87e54fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:01.707 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.707+0000 7f87e54fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.707 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.707+0000 7f87e54fe9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:01.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.707+0000 7f87e54fe9c0 20 zone default found 2024-09-19T14:06:01.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.707+0000 7f87e54fe9c0 4 Realm: () 2024-09-19T14:06:01.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.707+0000 7f87e54fe9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:01.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.707+0000 7f87e54fe9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:01.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.707+0000 7f87e54fe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:01.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.707+0000 7f87e54fe9c0 20 zonegroup default 2024-09-19T14:06:01.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.707+0000 7f87e54fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.707+0000 7f87e54fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.707+0000 7f87e54fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.709 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.711+0000 7f87e54fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.709 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.711+0000 7f87e54fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.709 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.711+0000 7f87e54fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.709 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.711+0000 7f87e54fe9c0 20 started sync module instance, tier type = 2024-09-19T14:06:01.709 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.711+0000 7f87e54fe9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:01.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.723+0000 7f87e54fe9c0 20 add_watcher() i=0 2024-09-19T14:06:01.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.723+0000 7f87e54fe9c0 20 add_watcher() i=1 2024-09-19T14:06:01.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.723+0000 7f87e54fe9c0 20 add_watcher() i=2 2024-09-19T14:06:01.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.723+0000 7f87e54fe9c0 20 add_watcher() i=3 2024-09-19T14:06:01.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.723+0000 7f87e54fe9c0 20 add_watcher() i=4 2024-09-19T14:06:01.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.723+0000 7f87e54fe9c0 20 add_watcher() i=5 2024-09-19T14:06:01.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.723+0000 7f87e54fe9c0 20 add_watcher() i=6 2024-09-19T14:06:01.725 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.727+0000 7f87e54fe9c0 20 add_watcher() i=7 2024-09-19T14:06:01.725 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.727+0000 7f87e54fe9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:01.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.727+0000 7f86997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:01.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.731+0000 7f87e54fe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:01.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.731+0000 7f87e54fe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:01.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.731+0000 7f87e54fe9c0 5 note: GC not initialized 2024-09-19T14:06:01.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.731+0000 7f8613fff640 20 reqs_thread_entry: start 2024-09-19T14:06:01.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.731+0000 7f87e54fe9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:01.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.731+0000 7f87e54fe9c0 20 Filter name: none 2024-09-19T14:06:01.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.731+0000 7f8611ffb640 20 reqs_thread_entry: start 2024-09-19T14:06:01.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.739+0000 7f86997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:01.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.743+0000 7f87e54fe9c0 20 remove_watcher() i=0 2024-09-19T14:06:01.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.743+0000 7f87e54fe9c0 2 removed watcher, disabling cache 2024-09-19T14:06:01.746 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.747+0000 7f87e54fe9c0 20 remove_watcher() i=1 2024-09-19T14:06:01.748 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.747+0000 7f87e54fe9c0 20 remove_watcher() i=2 2024-09-19T14:06:01.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.751+0000 7f87e54fe9c0 20 remove_watcher() i=3 2024-09-19T14:06:01.752 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.751+0000 7f87e54fe9c0 20 remove_watcher() i=4 2024-09-19T14:06:01.753 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.755+0000 7f87e54fe9c0 20 remove_watcher() i=5 2024-09-19T14:06:01.755 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.755+0000 7f87e54fe9c0 20 remove_watcher() i=6 2024-09-19T14:06:01.756 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.755+0000 7f87e54fe9c0 20 remove_watcher() i=7 2024-09-19T14:06:01.770 INFO:tasks.workunit.client.0.smithi153.stderr:bucket name a-bucket 2024-09-19T14:06:01.770 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard process non empty bucket 2024-09-19T14:06:01.770 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:01.770 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin reshard process 2024-09-19T14:06:01.794 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:01.794 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:01.838 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.839+0000 7f06967089c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.839+0000 7f06967089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.839+0000 7f06967089c0 20 realm 2024-09-19T14:06:01.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.839+0000 7f06967089c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.839+0000 7f06967089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.839+0000 7f06967089c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:01.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.839+0000 7f06967089c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.843+0000 7f06967089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.841 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.843+0000 7f06967089c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.842 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.843+0000 7f06967089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:01.842 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.843+0000 7f06967089c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.842 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.843+0000 7f06967089c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:01.842 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.843+0000 7f06967089c0 20 searching for the correct realm 2024-09-19T14:06:01.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.847+0000 7f0693a0d640 0 -- 172.21.15.153:0/651038903 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x55e4915b2340 msgr2=0x55e4915b4800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:01.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.855+0000 7f069420e640 0 -- 172.21.15.153:0/651038903 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f0688060400 msgr2=0x7f0688060860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:01.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:01.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:01.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:01.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:01.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:01.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:01.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:01.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:01.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 20 zone default found 2024-09-19T14:06:01.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 4 Realm: () 2024-09-19T14:06:01.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:01.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:01.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:01.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 20 zonegroup default 2024-09-19T14:06:01.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:01.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 20 started sync module instance, tier type = 2024-09-19T14:06:01.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.863+0000 7f06967089c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:01.879 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.879+0000 7f06967089c0 20 add_watcher() i=0 2024-09-19T14:06:01.879 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.879+0000 7f06967089c0 20 add_watcher() i=1 2024-09-19T14:06:01.880 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.879+0000 7f06967089c0 20 add_watcher() i=2 2024-09-19T14:06:01.880 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.879+0000 7f06967089c0 20 add_watcher() i=3 2024-09-19T14:06:01.880 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.879+0000 7f06967089c0 20 add_watcher() i=4 2024-09-19T14:06:01.880 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.879+0000 7f06967089c0 20 add_watcher() i=5 2024-09-19T14:06:01.880 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.879+0000 7f06967089c0 20 add_watcher() i=6 2024-09-19T14:06:01.881 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.883+0000 7f06967089c0 20 add_watcher() i=7 2024-09-19T14:06:01.881 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.883+0000 7f06967089c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:01.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.883+0000 7f054afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:01.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.883+0000 7f06967089c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:01.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.883+0000 7f06967089c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:01.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.883+0000 7f06967089c0 5 note: GC not initialized 2024-09-19T14:06:01.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.883+0000 7f0549fdb640 20 reqs_thread_entry: start 2024-09-19T14:06:01.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.883+0000 7f06967089c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:01.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.883+0000 7f06967089c0 20 Filter name: none 2024-09-19T14:06:01.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.883+0000 7f04bb7fe640 20 reqs_thread_entry: start 2024-09-19T14:06:01.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.883+0000 7f06967089c0 20 processing logshard = reshard.0000000000 2024-09-19T14:06:01.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.891+0000 7f06967089c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-19T14:06:01.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.891+0000 7f06967089c0 20 processing logshard = reshard.0000000001 2024-09-19T14:06:01.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.895+0000 7f06967089c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-19T14:06:01.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.895+0000 7f06967089c0 20 processing logshard = reshard.0000000002 2024-09-19T14:06:01.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.899+0000 7f06967089c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-19T14:06:01.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.899+0000 7f06967089c0 20 processing logshard = reshard.0000000003 2024-09-19T14:06:01.903 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.903+0000 7f06967089c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-19T14:06:01.903 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.903+0000 7f06967089c0 20 processing logshard = reshard.0000000004 2024-09-19T14:06:01.909 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.911+0000 7f06967089c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-19T14:06:01.909 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.911+0000 7f06967089c0 20 processing logshard = reshard.0000000005 2024-09-19T14:06:01.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.915+0000 7f06967089c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-19T14:06:01.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.915+0000 7f06967089c0 20 processing logshard = reshard.0000000006 2024-09-19T14:06:01.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.915+0000 7f06967089c0 20 process_entry resharding a-bucket 2024-09-19T14:06:01.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.915+0000 7f06967089c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:06:01.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.915+0000 7f06967089c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.919+0000 7f06967089c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:06:01.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.919+0000 7f06967089c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-19T14:06:01.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.919+0000 7f06967089c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:06:01.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.919+0000 7f06967089c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : miss 2024-09-19T14:06:01.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.919+0000 7f06967089c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:01.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.919+0000 7f06967089c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:06:01.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.919+0000 7f06967089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:06:01.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.919+0000 7f06967089c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:06:01.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.919+0000 7f06967089c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:06:01.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.919+0000 7f06967089c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:06:01.918 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.919+0000 7f06967089c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:06:01.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.931+0000 7f06967089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:06:01.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.931+0000 7f06967089c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:06:01.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.931+0000 7f06967089c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:06:01.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.931+0000 7f06967089c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17, ofs0, ns] 2024-09-19T14:06:01.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.931+0000 7f056b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333467 cookie 94440179599280 notifier 6123 bl.length()=827 2024-09-19T14:06:01.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.931+0000 7f056b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:06:01.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.931+0000 7f056b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:06:01.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.931+0000 7f056b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:06:01.934 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.935+0000 7f06967089c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_sources= new_sources= 2024-09-19T14:06:01.934 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.935+0000 7f06967089c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential sources added=[] removed=[] 2024-09-19T14:06:01.934 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.935+0000 7f06967089c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_dests= new_dests= 2024-09-19T14:06:01.934 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.935+0000 7f06967089c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential dests added=[] removed=[] 2024-09-19T14:06:01.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:06:01.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:06:01.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:06:01.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:06:01.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:06:01.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:06:01.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:06:01.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:06:01.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:06:01.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:06:01.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:06:01.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:06:01.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:06:01.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:06:01.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:06:01.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:06:01.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:06:01.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:06:01.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:06:01.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:06:01.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:06:01.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:06:01.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:06:01.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:06:01.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:06:01.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:06:01.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.0 2024-09-19T14:06:01.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.943+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.0 2024-09-19T14:06:01.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.947+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.1 2024-09-19T14:06:01.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.947+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.1 2024-09-19T14:06:01.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.947+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.2 2024-09-19T14:06:01.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.947+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.2 2024-09-19T14:06:01.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.947+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.3 2024-09-19T14:06:01.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.947+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.3 2024-09-19T14:06:01.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.947+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.4 2024-09-19T14:06:01.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.947+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.4 2024-09-19T14:06:01.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.947+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.5 2024-09-19T14:06:01.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.947+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.5 2024-09-19T14:06:01.948 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.951+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.6 2024-09-19T14:06:01.948 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.951+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.6 2024-09-19T14:06:01.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.951+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.7 2024-09-19T14:06:01.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.951+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.7 2024-09-19T14:06:01.950 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.951+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.8 2024-09-19T14:06:01.950 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.951+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.8 2024-09-19T14:06:01.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.951+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.9 2024-09-19T14:06:01.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.951+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.9 2024-09-19T14:06:01.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.955+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.10 2024-09-19T14:06:01.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.955+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.10 2024-09-19T14:06:01.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.955+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.11 2024-09-19T14:06:01.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.955+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.11 2024-09-19T14:06:01.958 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.959+0000 7f06967089c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : hit (requested=0x17, cached=0x17) 2024-09-19T14:06:01.958 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.959+0000 7f06967089c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:06:01.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.963+0000 7f06967089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:06:01.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.963+0000 7f06967089c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:06:01.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.963+0000 7f06967089c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:06:01.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.963+0000 7f06967089c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17, ofs0, ns] 2024-09-19T14:06:01.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.963+0000 7f056affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333468 cookie 94440179599280 notifier 6123 bl.length()=827 2024-09-19T14:06:01.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.963+0000 7f056affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:06:01.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.963+0000 7f056affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:06:01.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.963+0000 7f056affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:06:01.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.963+0000 7f06967089c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_sources= new_sources= 2024-09-19T14:06:01.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.963+0000 7f06967089c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential sources added=[] removed=[] 2024-09-19T14:06:01.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.963+0000 7f06967089c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_dests= new_dests= 2024-09-19T14:06:01.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.963+0000 7f06967089c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential dests added=[] removed=[] 2024-09-19T14:06:01.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.971+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.0 2024-09-19T14:06:01.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.971+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.0 2024-09-19T14:06:01.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.971+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.1 2024-09-19T14:06:01.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.971+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.1 2024-09-19T14:06:01.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.971+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.2 2024-09-19T14:06:01.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.971+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.2 2024-09-19T14:06:01.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.971+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.3 2024-09-19T14:06:01.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.971+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.3 2024-09-19T14:06:01.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.971+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.4 2024-09-19T14:06:01.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.971+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.4 2024-09-19T14:06:01.971 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.971+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.5 2024-09-19T14:06:01.971 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.971+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.5 2024-09-19T14:06:01.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.971+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.6 2024-09-19T14:06:01.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.971+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.6 2024-09-19T14:06:01.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.975+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.7 2024-09-19T14:06:01.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.975+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.7 2024-09-19T14:06:01.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.975+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.8 2024-09-19T14:06:01.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.975+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.8 2024-09-19T14:06:01.974 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.975+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.9 2024-09-19T14:06:01.974 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.975+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.9 2024-09-19T14:06:01.974 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.975+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.10 2024-09-19T14:06:01.975 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.975+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.10 2024-09-19T14:06:01.975 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.975+0000 7f06967089c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.11 2024-09-19T14:06:01.975 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.975+0000 7f06967089c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.1.11 2024-09-19T14:06:01.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.975+0000 7f06967089c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : hit (requested=0x17, cached=0x17) 2024-09-19T14:06:01.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.975+0000 7f06967089c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:06:01.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.979+0000 7f06967089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:06:01.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.979+0000 7f06967089c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:06:01.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.979+0000 7f06967089c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:06:01.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.979+0000 7f06967089c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17, ofs0, ns] 2024-09-19T14:06:01.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.979+0000 7f056b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333469 cookie 94440179599280 notifier 6123 bl.length()=795 2024-09-19T14:06:01.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.979+0000 7f056b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:06:01.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.979+0000 7f056b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:06:01.979 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.979+0000 7f056b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:06:01.980 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.983+0000 7f06967089c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_sources= new_sources= 2024-09-19T14:06:01.980 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.983+0000 7f06967089c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential sources added=[] removed=[] 2024-09-19T14:06:01.980 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.983+0000 7f06967089c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_dests= new_dests= 2024-09-19T14:06:01.980 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.983+0000 7f06967089c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential dests added=[] removed=[] 2024-09-19T14:06:01.985 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.987+0000 7f06967089c0 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-19T14:06:01.987 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.987+0000 7f06967089c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-19T14:06:01.991 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.991+0000 7f06967089c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-19T14:06:01.991 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.991+0000 7f06967089c0 20 processing logshard = reshard.0000000007 2024-09-19T14:06:01.995 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.995+0000 7f06967089c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-19T14:06:01.995 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.995+0000 7f06967089c0 20 processing logshard = reshard.0000000008 2024-09-19T14:06:02.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.999+0000 7f06967089c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-19T14:06:02.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:01.999+0000 7f06967089c0 20 processing logshard = reshard.0000000009 2024-09-19T14:06:02.007 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.007+0000 7f06967089c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-19T14:06:02.007 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.007+0000 7f06967089c0 20 processing logshard = reshard.0000000010 2024-09-19T14:06:02.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.011+0000 7f06967089c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-19T14:06:02.011 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.011+0000 7f06967089c0 20 processing logshard = reshard.0000000011 2024-09-19T14:06:02.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.015+0000 7f06967089c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-19T14:06:02.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.015+0000 7f06967089c0 20 processing logshard = reshard.0000000012 2024-09-19T14:06:02.022 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.023+0000 7f06967089c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-19T14:06:02.022 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.023+0000 7f06967089c0 20 processing logshard = reshard.0000000013 2024-09-19T14:06:02.028 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.027+0000 7f06967089c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-19T14:06:02.028 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.027+0000 7f06967089c0 20 processing logshard = reshard.0000000014 2024-09-19T14:06:02.032 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.031+0000 7f06967089c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-19T14:06:02.032 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.031+0000 7f06967089c0 20 processing logshard = reshard.0000000015 2024-09-19T14:06:02.038 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.039+0000 7f06967089c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-19T14:06:02.040 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.039+0000 7f054afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:02.045 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.047+0000 7f06967089c0 20 remove_watcher() i=0 2024-09-19T14:06:02.045 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.047+0000 7f06967089c0 2 removed watcher, disabling cache 2024-09-19T14:06:02.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.047+0000 7f06967089c0 20 remove_watcher() i=1 2024-09-19T14:06:02.052 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.051+0000 7f06967089c0 20 remove_watcher() i=2 2024-09-19T14:06:02.052 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.051+0000 7f06967089c0 20 remove_watcher() i=3 2024-09-19T14:06:02.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.055+0000 7f06967089c0 20 remove_watcher() i=4 2024-09-19T14:06:02.056 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.055+0000 7f06967089c0 20 remove_watcher() i=5 2024-09-19T14:06:02.058 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.059+0000 7f06967089c0 20 remove_watcher() i=6 2024-09-19T14:06:02.059 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.059+0000 7f06967089c0 20 remove_watcher() i=7 2024-09-19T14:06:02.078 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T14:06:02.109 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:02.109 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:02.155 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.155+0000 7f63f0f0b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:02.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.159+0000 7f63f0f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:02.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.159+0000 7f63f0f0b9c0 20 realm 2024-09-19T14:06:02.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.159+0000 7f63f0f0b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:02.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.159+0000 7f63f0f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:02.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.159+0000 7f63f0f0b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:02.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.159+0000 7f63f0f0b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:02.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.159+0000 7f63f0f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:02.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.159+0000 7f63f0f0b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:02.159 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.159+0000 7f63f0f0b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:02.159 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.159+0000 7f63f0f0b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:02.160 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.159+0000 7f63f0f0b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:02.160 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.159+0000 7f63f0f0b9c0 20 searching for the correct realm 2024-09-19T14:06:02.165 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.167+0000 7f63ee210640 0 -- 172.21.15.153:0/770207645 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x559ca2cc17c0 msgr2=0x559ca2cc3bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:02.171 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.171+0000 7f63eea11640 0 -- 172.21.15.153:0/770207645 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f63e40895e0 msgr2=0x7f63e4091040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:02.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.179+0000 7f63f0f0b9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:02.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.179+0000 7f63f0f0b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:02.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.179+0000 7f63f0f0b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:02.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.179+0000 7f63f0f0b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:02.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.179+0000 7f63f0f0b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:02.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.179+0000 7f63f0f0b9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:02.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.179+0000 7f63f0f0b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:02.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.179+0000 7f63f0f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:02.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.179+0000 7f63f0f0b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:02.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.183+0000 7f63f0f0b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:02.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.183+0000 7f63f0f0b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:02.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.183+0000 7f63f0f0b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:02.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.183+0000 7f63f0f0b9c0 20 zone default found 2024-09-19T14:06:02.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.183+0000 7f63f0f0b9c0 4 Realm: () 2024-09-19T14:06:02.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.183+0000 7f63f0f0b9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:02.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.183+0000 7f63f0f0b9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:02.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.183+0000 7f63f0f0b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:02.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.183+0000 7f63f0f0b9c0 20 zonegroup default 2024-09-19T14:06:02.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.183+0000 7f63f0f0b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:02.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.183+0000 7f63f0f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:02.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.183+0000 7f63f0f0b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:02.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.183+0000 7f63f0f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:02.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.183+0000 7f63f0f0b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:02.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.183+0000 7f63f0f0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:02.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.183+0000 7f63f0f0b9c0 20 started sync module instance, tier type = 2024-09-19T14:06:02.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.183+0000 7f63f0f0b9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:02.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.199+0000 7f63f0f0b9c0 20 add_watcher() i=0 2024-09-19T14:06:02.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.199+0000 7f63f0f0b9c0 20 add_watcher() i=1 2024-09-19T14:06:02.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.199+0000 7f63f0f0b9c0 20 add_watcher() i=2 2024-09-19T14:06:02.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.199+0000 7f63f0f0b9c0 20 add_watcher() i=3 2024-09-19T14:06:02.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.199+0000 7f63f0f0b9c0 20 add_watcher() i=4 2024-09-19T14:06:02.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.199+0000 7f63f0f0b9c0 20 add_watcher() i=5 2024-09-19T14:06:02.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.199+0000 7f63f0f0b9c0 20 add_watcher() i=6 2024-09-19T14:06:02.199 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.199+0000 7f63f0f0b9c0 20 add_watcher() i=7 2024-09-19T14:06:02.199 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.199+0000 7f63f0f0b9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:02.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.203+0000 7f62a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:02.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.203+0000 7f63f0f0b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:02.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.203+0000 7f63f0f0b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:02.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.203+0000 7f63f0f0b9c0 5 note: GC not initialized 2024-09-19T14:06:02.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.203+0000 7f621ffff640 20 reqs_thread_entry: start 2024-09-19T14:06:02.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.203+0000 7f63f0f0b9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:02.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.203+0000 7f63f0f0b9c0 20 Filter name: none 2024-09-19T14:06:02.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.203+0000 7f621dffb640 20 reqs_thread_entry: start 2024-09-19T14:06:02.204 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.203+0000 7f63f0f0b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:02.204 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.203+0000 7f63f0f0b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:06:02.204 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.203+0000 7f63f0f0b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:02.205 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.207+0000 7f63f0f0b9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:06:02.205 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.207+0000 7f63f0f0b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:02.205 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.207+0000 7f63f0f0b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:02.205 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.207+0000 7f63f0f0b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:06:02.205 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.207+0000 7f63f0f0b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:02.206 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.207+0000 7f63f0f0b9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:06:02.206 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.207+0000 7f63f0f0b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:02.209 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.211+0000 7f62a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:02.214 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.215+0000 7f63f0f0b9c0 20 remove_watcher() i=0 2024-09-19T14:06:02.214 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.215+0000 7f63f0f0b9c0 2 removed watcher, disabling cache 2024-09-19T14:06:02.215 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.215+0000 7f63f0f0b9c0 20 remove_watcher() i=1 2024-09-19T14:06:02.218 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.219+0000 7f63f0f0b9c0 20 remove_watcher() i=2 2024-09-19T14:06:02.219 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.219+0000 7f63f0f0b9c0 20 remove_watcher() i=3 2024-09-19T14:06:02.222 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.223+0000 7f63f0f0b9c0 20 remove_watcher() i=4 2024-09-19T14:06:02.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.223+0000 7f63f0f0b9c0 20 remove_watcher() i=5 2024-09-19T14:06:02.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.227+0000 7f63f0f0b9c0 20 remove_watcher() i=6 2024-09-19T14:06:02.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:02.227+0000 7f63f0f0b9c0 20 remove_watcher() i=7 2024-09-19T14:06:02.240 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:02.240 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:06:02.240 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: a-bucket id: dbb1da81-49d0-421a-b677-974869a7f103.4620.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-19T14:06:02.240 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:02.240 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-19T14:06:02.240 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:02.241 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:02.242 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:02.301 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:02.301 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:02.385 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:02.385 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:02.488 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:02.488 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:02.555 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:02.555 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:02.656 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:02.656 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:02.754 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:02.754 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:02.856 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:02.856 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:02.953 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:02.953 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:03.050 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:03.050 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:03.149 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:03.149 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:03.244 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:03.245 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:03.318 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:03.318 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:03.413 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:03.413 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:03.504 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:03.504 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:03.594 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:03.594 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:03.683 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:03.683 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:03.787 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:03.787 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:03.885 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:03.886 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:03.962 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:03.962 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:04.053 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:04.053 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:04.152 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:04.153 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:04.250 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-19T14:06:04.284 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:04.284 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:04.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.331+0000 7f26da9769c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.332 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.331+0000 7f26da9769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:04.332 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.331+0000 7f26da9769c0 20 realm 2024-09-19T14:06:04.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.331+0000 7f26da9769c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.335+0000 7f26da9769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:04.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.335+0000 7f26da9769c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:04.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.335+0000 7f26da9769c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.335+0000 7f26da9769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:04.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.335+0000 7f26da9769c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.335+0000 7f26da9769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:04.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.335+0000 7f26da9769c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.335+0000 7f26da9769c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:04.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.335+0000 7f26da9769c0 20 searching for the correct realm 2024-09-19T14:06:04.342 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.343+0000 7f26d7c7b640 0 -- 172.21.15.153:0/3619065152 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f26c8046040 msgr2=0x7f26c8046930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:04.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.347+0000 7f26d7c7b640 0 -- 172.21.15.153:0/3619065152 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f25a0082340 msgr2=0x7f25a0084770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:04.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.355+0000 7f26da9769c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:04.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.355+0000 7f26da9769c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:04.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.355+0000 7f26da9769c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:04.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.355+0000 7f26da9769c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:04.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.355+0000 7f26da9769c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:04.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.355+0000 7f26da9769c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:04.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.355+0000 7f26da9769c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.355+0000 7f26da9769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:04.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.355+0000 7f26da9769c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.355+0000 7f26da9769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:04.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.355+0000 7f26da9769c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.359+0000 7f26da9769c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:04.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.359+0000 7f26da9769c0 20 zone default found 2024-09-19T14:06:04.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.359+0000 7f26da9769c0 4 Realm: () 2024-09-19T14:06:04.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.359+0000 7f26da9769c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:04.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.359+0000 7f26da9769c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:04.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.359+0000 7f26da9769c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:04.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.359+0000 7f26da9769c0 20 zonegroup default 2024-09-19T14:06:04.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.359+0000 7f26da9769c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.359+0000 7f26da9769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:04.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.359+0000 7f26da9769c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.359+0000 7f26da9769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:04.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.359+0000 7f26da9769c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.359+0000 7f26da9769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:04.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.359+0000 7f26da9769c0 20 started sync module instance, tier type = 2024-09-19T14:06:04.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.359+0000 7f26da9769c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:04.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.375+0000 7f26da9769c0 20 add_watcher() i=0 2024-09-19T14:06:04.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.375+0000 7f26da9769c0 20 add_watcher() i=1 2024-09-19T14:06:04.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.375+0000 7f26da9769c0 20 add_watcher() i=2 2024-09-19T14:06:04.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.375+0000 7f26da9769c0 20 add_watcher() i=3 2024-09-19T14:06:04.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.375+0000 7f26da9769c0 20 add_watcher() i=4 2024-09-19T14:06:04.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.375+0000 7f26da9769c0 20 add_watcher() i=5 2024-09-19T14:06:04.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.375+0000 7f26da9769c0 20 add_watcher() i=6 2024-09-19T14:06:04.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.375+0000 7f26da9769c0 20 add_watcher() i=7 2024-09-19T14:06:04.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.375+0000 7f26da9769c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:04.377 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.379+0000 7f258efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:04.378 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.379+0000 7f26da9769c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:04.378 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.379+0000 7f26da9769c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:04.379 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.379+0000 7f26da9769c0 5 note: GC not initialized 2024-09-19T14:06:04.379 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.379+0000 7f258dfdb640 20 reqs_thread_entry: start 2024-09-19T14:06:04.379 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.379+0000 7f26da9769c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:04.379 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.379+0000 7f26da9769c0 20 Filter name: none 2024-09-19T14:06:04.379 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.379+0000 7f24ff7fe640 20 reqs_thread_entry: start 2024-09-19T14:06:04.379 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.379+0000 7f26da9769c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.379 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.379+0000 7f26da9769c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:06:04.379 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.379+0000 7f26da9769c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.383+0000 7f26da9769c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:06:04.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.383+0000 7f26da9769c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:04.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.383+0000 7f26da9769c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.383+0000 7f26da9769c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:06:04.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.383+0000 7f26da9769c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.382 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.383+0000 7f26da9769c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:06:04.382 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.383+0000 7f26da9769c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:04.385 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.387+0000 7f258efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:04.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.391+0000 7f26da9769c0 20 remove_watcher() i=0 2024-09-19T14:06:04.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.391+0000 7f26da9769c0 2 removed watcher, disabling cache 2024-09-19T14:06:04.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.391+0000 7f26da9769c0 20 remove_watcher() i=1 2024-09-19T14:06:04.394 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.395+0000 7f26da9769c0 20 remove_watcher() i=2 2024-09-19T14:06:04.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.395+0000 7f26da9769c0 20 remove_watcher() i=3 2024-09-19T14:06:04.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.399+0000 7f26da9769c0 20 remove_watcher() i=4 2024-09-19T14:06:04.399 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.399+0000 7f26da9769c0 20 remove_watcher() i=5 2024-09-19T14:06:04.400 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.403+0000 7f26da9769c0 20 remove_watcher() i=6 2024-09-19T14:06:04.401 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.403+0000 7f26da9769c0 20 remove_watcher() i=7 2024-09-19T14:06:04.416 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:04.416 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:06:04.416 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-init-index id: dbb1da81-49d0-421a-b677-974869a7f103.4620.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:06:04.416 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:04.416 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-19T14:06:04.449 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:04.449 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:04.492 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.495+0000 7f1385c129c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.495+0000 7f1385c129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:04.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.495+0000 7f1385c129c0 20 realm 2024-09-19T14:06:04.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.495+0000 7f1385c129c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.495+0000 7f1385c129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:04.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.495+0000 7f1385c129c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:04.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.495+0000 7f1385c129c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.495 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.495+0000 7f1385c129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:04.495 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.495+0000 7f1385c129c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.499+0000 7f1385c129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:04.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.499+0000 7f1385c129c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.499+0000 7f1385c129c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:04.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.499+0000 7f1385c129c0 20 searching for the correct realm 2024-09-19T14:06:04.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.503+0000 7f1383f19640 0 -- 172.21.15.153:0/4183496643 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7f13780f0920 msgr2=0x7f13780b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:06:04.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.719+0000 7f1383718640 0 -- 172.21.15.153:0/4183496643 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x55edf405f360 msgr2=0x55edf4061800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:04.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.727+0000 7f1385c129c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:04.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.727+0000 7f1385c129c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:04.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.727+0000 7f1385c129c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:04.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.727+0000 7f1385c129c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:04.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.727+0000 7f1385c129c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:04.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.727+0000 7f1385c129c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:04.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.727+0000 7f1385c129c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.727+0000 7f1385c129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:04.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.727+0000 7f1385c129c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.727+0000 7f1385c129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:04.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.727+0000 7f1385c129c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.731+0000 7f1385c129c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:04.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.731+0000 7f1385c129c0 20 zone default found 2024-09-19T14:06:04.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.731+0000 7f1385c129c0 4 Realm: () 2024-09-19T14:06:04.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.731+0000 7f1385c129c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:04.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.731+0000 7f1385c129c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:04.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.731+0000 7f1385c129c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:04.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.731+0000 7f1385c129c0 20 zonegroup default 2024-09-19T14:06:04.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.731+0000 7f1385c129c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.731+0000 7f1385c129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:04.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.731+0000 7f1385c129c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.730 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.731+0000 7f1385c129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:04.730 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.731+0000 7f1385c129c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.731 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.731+0000 7f1385c129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:04.731 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.731+0000 7f1385c129c0 20 started sync module instance, tier type = 2024-09-19T14:06:04.731 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.731+0000 7f1385c129c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:04.756 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.755+0000 7f1385c129c0 20 add_watcher() i=0 2024-09-19T14:06:04.756 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.755+0000 7f1385c129c0 20 add_watcher() i=1 2024-09-19T14:06:04.756 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.755+0000 7f1385c129c0 20 add_watcher() i=2 2024-09-19T14:06:04.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.755+0000 7f1385c129c0 20 add_watcher() i=3 2024-09-19T14:06:04.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.755+0000 7f1385c129c0 20 add_watcher() i=4 2024-09-19T14:06:04.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.755+0000 7f1385c129c0 20 add_watcher() i=5 2024-09-19T14:06:04.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.755+0000 7f1385c129c0 20 add_watcher() i=6 2024-09-19T14:06:04.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.759+0000 7f1385c129c0 20 add_watcher() i=7 2024-09-19T14:06:04.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.759+0000 7f1385c129c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:04.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.763+0000 7f1239fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:04.764 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.763+0000 7f1385c129c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:04.764 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.763+0000 7f1385c129c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:04.764 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.763+0000 7f1385c129c0 5 note: GC not initialized 2024-09-19T14:06:04.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.767+0000 7f1238fe1640 20 reqs_thread_entry: start 2024-09-19T14:06:04.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.767+0000 7f1385c129c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:04.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.767+0000 7f1385c129c0 20 Filter name: none 2024-09-19T14:06:04.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.767+0000 7f11b27fc640 20 reqs_thread_entry: start 2024-09-19T14:06:04.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.767+0000 7f1385c129c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-19T14:06:04.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.767+0000 7f1385c129c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.766 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.767+0000 7f1385c129c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:06:04.766 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.767+0000 7f1385c129c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-19T14:06:04.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.767+0000 7f1385c129c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-19T14:06:04.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.767+0000 7f1385c129c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19 : miss 2024-09-19T14:06:04.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.767+0000 7f1385c129c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.767+0000 7f1385c129c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:06:04.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.767+0000 7f1385c129c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19 info.flags=0x17 2024-09-19T14:06:04.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.767+0000 7f1385c129c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19 to cache LRU end 2024-09-19T14:06:04.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.767+0000 7f1385c129c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:06:04.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.767+0000 7f1385c129c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:04.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.767+0000 7f1385c129c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19 2024-09-19T14:06:04.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.771+0000 7f1385c129c0 -1 Injecting error=-5 at location=init_index 2024-09-19T14:06:04.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.771+0000 7f1385c129c0 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-19T14:06:04.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.775+0000 7f1239fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:04.779 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.779+0000 7f1385c129c0 20 remove_watcher() i=0 2024-09-19T14:06:04.779 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.779+0000 7f1385c129c0 2 removed watcher, disabling cache 2024-09-19T14:06:04.782 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.783+0000 7f1385c129c0 20 remove_watcher() i=1 2024-09-19T14:06:04.784 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.783+0000 7f1385c129c0 20 remove_watcher() i=2 2024-09-19T14:06:04.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.787+0000 7f1385c129c0 20 remove_watcher() i=3 2024-09-19T14:06:04.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.791+0000 7f1385c129c0 20 remove_watcher() i=4 2024-09-19T14:06:04.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.791+0000 7f1385c129c0 20 remove_watcher() i=5 2024-09-19T14:06:04.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.795+0000 7f1385c129c0 20 remove_watcher() i=6 2024-09-19T14:06:04.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.795+0000 7f1385c129c0 20 remove_watcher() i=7 2024-09-19T14:06:04.811 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-19T14:06:04.841 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:04.842 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:04.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.887+0000 7f795525f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.891+0000 7f795525f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:04.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.891+0000 7f795525f9c0 20 realm 2024-09-19T14:06:04.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.891+0000 7f795525f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.891+0000 7f795525f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:04.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.891+0000 7f795525f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:04.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.891+0000 7f795525f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.891+0000 7f795525f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:04.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.891+0000 7f795525f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.891+0000 7f795525f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:04.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.891+0000 7f795525f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:04.892 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.891+0000 7f795525f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:04.892 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.891+0000 7f795525f9c0 20 searching for the correct realm 2024-09-19T14:06:04.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.895+0000 7f7952564640 0 -- 172.21.15.153:0/1050998241 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f794409a180 msgr2=0x7f794407e1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:04.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:04.903+0000 7f7952d65640 0 -- 172.21.15.153:0/1050998241 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f79480f3920 msgr2=0x7f79480aa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:05.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.119+0000 7f795525f9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:05.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.119+0000 7f795525f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:05.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.119+0000 7f795525f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:05.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.119+0000 7f795525f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:05.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.119+0000 7f795525f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:05.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.119+0000 7f795525f9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:05.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.119+0000 7f795525f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:05.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.123+0000 7f795525f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:05.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.123+0000 7f795525f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:05.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.123+0000 7f795525f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:05.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.123+0000 7f795525f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:05.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.123+0000 7f795525f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:05.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.123+0000 7f795525f9c0 20 zone default found 2024-09-19T14:06:05.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.123+0000 7f795525f9c0 4 Realm: () 2024-09-19T14:06:05.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.123+0000 7f795525f9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:05.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.123+0000 7f795525f9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:05.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.123+0000 7f795525f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:05.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.123+0000 7f795525f9c0 20 zonegroup default 2024-09-19T14:06:05.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.123+0000 7f795525f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:05.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.123+0000 7f795525f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:05.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.123+0000 7f795525f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:05.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.127+0000 7f795525f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:05.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.127+0000 7f795525f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:05.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.127+0000 7f795525f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:05.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.127+0000 7f795525f9c0 20 started sync module instance, tier type = 2024-09-19T14:06:05.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.127+0000 7f795525f9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:05.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.151+0000 7f795525f9c0 20 add_watcher() i=0 2024-09-19T14:06:05.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.151+0000 7f795525f9c0 20 add_watcher() i=1 2024-09-19T14:06:05.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.151+0000 7f795525f9c0 20 add_watcher() i=2 2024-09-19T14:06:05.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.151+0000 7f795525f9c0 20 add_watcher() i=3 2024-09-19T14:06:05.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.151+0000 7f795525f9c0 20 add_watcher() i=4 2024-09-19T14:06:05.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.151+0000 7f795525f9c0 20 add_watcher() i=5 2024-09-19T14:06:05.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.151+0000 7f795525f9c0 20 add_watcher() i=6 2024-09-19T14:06:05.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.155+0000 7f795525f9c0 20 add_watcher() i=7 2024-09-19T14:06:05.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.155+0000 7f795525f9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:05.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.159+0000 7f78097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:05.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.159+0000 7f795525f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:05.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.159+0000 7f795525f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:05.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.159+0000 7f795525f9c0 5 note: GC not initialized 2024-09-19T14:06:05.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.159+0000 7f7783fff640 20 reqs_thread_entry: start 2024-09-19T14:06:05.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.159+0000 7f795525f9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:05.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.159+0000 7f795525f9c0 20 Filter name: none 2024-09-19T14:06:05.159 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.159+0000 7f7781ffb640 20 reqs_thread_entry: start 2024-09-19T14:06:05.159 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.159+0000 7f795525f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:05.160 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.159+0000 7f795525f9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:06:05.160 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.159+0000 7f795525f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:05.160 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.163+0000 7f795525f9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:06:05.161 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.163+0000 7f795525f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:05.161 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.163+0000 7f795525f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:05.162 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.163+0000 7f795525f9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:06:05.162 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.163+0000 7f795525f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:05.162 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.163+0000 7f795525f9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:06:05.162 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.163+0000 7f795525f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:05.166 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.167+0000 7f78097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:05.171 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.171+0000 7f795525f9c0 20 remove_watcher() i=0 2024-09-19T14:06:05.171 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.171+0000 7f795525f9c0 2 removed watcher, disabling cache 2024-09-19T14:06:05.173 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.175+0000 7f795525f9c0 20 remove_watcher() i=1 2024-09-19T14:06:05.176 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.179+0000 7f795525f9c0 20 remove_watcher() i=2 2024-09-19T14:06:05.178 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.179+0000 7f795525f9c0 20 remove_watcher() i=3 2024-09-19T14:06:05.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.183+0000 7f795525f9c0 20 remove_watcher() i=4 2024-09-19T14:06:05.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.183+0000 7f795525f9c0 20 remove_watcher() i=5 2024-09-19T14:06:05.184 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.187+0000 7f795525f9c0 20 remove_watcher() i=6 2024-09-19T14:06:05.186 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.187+0000 7f795525f9c0 20 remove_watcher() i=7 2024-09-19T14:06:05.204 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:05.204 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:06:05.204 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-init-index id: dbb1da81-49d0-421a-b677-974869a7f103.4620.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:06:05.204 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:05.205 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:05.205 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:05.252 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:05.252 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:05.310 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T14:06:05.345 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:05.345 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:05.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.391+0000 7faca5a249c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:05.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.391+0000 7faca5a249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:05.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.391+0000 7faca5a249c0 20 realm 2024-09-19T14:06:05.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.391+0000 7faca5a249c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:05.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.391+0000 7faca5a249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:05.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.391+0000 7faca5a249c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:05.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.391+0000 7faca5a249c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:05.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.391+0000 7faca5a249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:05.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.391+0000 7faca5a249c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:05.393 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.395+0000 7faca5a249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:05.393 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.395+0000 7faca5a249c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:05.394 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.395+0000 7faca5a249c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:05.394 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.395+0000 7faca5a249c0 20 searching for the correct realm 2024-09-19T14:06:05.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.603+0000 7faca2d29640 0 -- 172.21.15.153:0/1510294686 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fac94019040 msgr2=0x7fac94068520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:06:05.819 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:05.819+0000 7faca352a640 0 -- 172.21.15.153:0/1510294686 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fac980533d0 msgr2=0x7fac98053830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:06:06.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.035+0000 7faca5a249c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:06.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.035+0000 7faca5a249c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:06.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.035+0000 7faca5a249c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:06.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.035+0000 7faca5a249c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:06.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.035+0000 7faca5a249c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:06.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.035+0000 7faca5a249c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:06.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.035+0000 7faca5a249c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:06.037 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.039+0000 7faca5a249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:06.037 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.039+0000 7faca5a249c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:06.038 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.039+0000 7faca5a249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:06.038 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.039+0000 7faca5a249c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:06.038 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.039+0000 7faca5a249c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:06.039 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.039+0000 7faca5a249c0 20 zone default found 2024-09-19T14:06:06.039 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.039+0000 7faca5a249c0 4 Realm: () 2024-09-19T14:06:06.039 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.039+0000 7faca5a249c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:06.039 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.039+0000 7faca5a249c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:06.039 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.039+0000 7faca5a249c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:06.039 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.039+0000 7faca5a249c0 20 zonegroup default 2024-09-19T14:06:06.039 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.039+0000 7faca5a249c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:06.039 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.039+0000 7faca5a249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:06.039 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.039+0000 7faca5a249c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:06.040 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.039+0000 7faca5a249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:06.040 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.039+0000 7faca5a249c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:06.041 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.043+0000 7faca5a249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:06.041 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.043+0000 7faca5a249c0 20 started sync module instance, tier type = 2024-09-19T14:06:06.041 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.043+0000 7faca5a249c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:06.063 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.063+0000 7faca5a249c0 20 add_watcher() i=0 2024-09-19T14:06:06.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.063+0000 7faca5a249c0 20 add_watcher() i=1 2024-09-19T14:06:06.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.063+0000 7faca5a249c0 20 add_watcher() i=2 2024-09-19T14:06:06.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.063+0000 7faca5a249c0 20 add_watcher() i=3 2024-09-19T14:06:06.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.063+0000 7faca5a249c0 20 add_watcher() i=4 2024-09-19T14:06:06.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.063+0000 7faca5a249c0 20 add_watcher() i=5 2024-09-19T14:06:06.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.063+0000 7faca5a249c0 20 add_watcher() i=6 2024-09-19T14:06:06.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.067+0000 7faca5a249c0 20 add_watcher() i=7 2024-09-19T14:06:06.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.067+0000 7faca5a249c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:06.070 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.071+0000 7fab59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:06.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.071+0000 7faca5a249c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:06.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.071+0000 7faca5a249c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:06.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.071+0000 7faca5a249c0 5 note: GC not initialized 2024-09-19T14:06:06.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.071+0000 7fab58fe1640 20 reqs_thread_entry: start 2024-09-19T14:06:06.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.071+0000 7faca5a249c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:06.072 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.071+0000 7faca5a249c0 20 Filter name: none 2024-09-19T14:06:06.072 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.071+0000 7faad27fc640 20 reqs_thread_entry: start 2024-09-19T14:06:06.072 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.075+0000 7faca5a249c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-19T14:06:06.072 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.075+0000 7faca5a249c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:06.073 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.075+0000 7faca5a249c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:06:06.073 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.075+0000 7faca5a249c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-19T14:06:06.074 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.075+0000 7faca5a249c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-19T14:06:06.074 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.075+0000 7faca5a249c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19 : miss 2024-09-19T14:06:06.074 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.075+0000 7faca5a249c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:06.074 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.075+0000 7faca5a249c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:06:06.074 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.075+0000 7faca5a249c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19 info.flags=0x17 2024-09-19T14:06:06.074 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.075+0000 7faca5a249c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19 to cache LRU end 2024-09-19T14:06:06.074 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.075+0000 7faca5a249c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:06:06.075 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.075+0000 7faca5a249c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:06.075 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.075+0000 7faca5a249c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19 2024-09-19T14:06:06.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.087+0000 7faca5a249c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19 info.flags=0x17 2024-09-19T14:06:06.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.087+0000 7faca5a249c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19 to cache LRU end 2024-09-19T14:06:06.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.087+0000 7faca5a249c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:06.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.087+0000 7faca5a249c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19, ofs0, ns] 2024-09-19T14:06:06.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.087+0000 7fab86ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333459 cookie 94413902819264 notifier 6225 bl.length()=911 2024-09-19T14:06:06.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.087+0000 7fab86ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19 info.flags=0x17 2024-09-19T14:06:06.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.087+0000 7fab86ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19 to cache LRU end 2024-09-19T14:06:06.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.087+0000 7fab86ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:06.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.091+0000 7faca5a249c0 20 handle_bi_update(): bucket=:error-at-init-index[dbb1da81-49d0-421a-b677-974869a7f103.4620.19]): orig_sources= new_sources= 2024-09-19T14:06:06.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.091+0000 7faca5a249c0 20 handle_bi_update(): bucket=:error-at-init-index[dbb1da81-49d0-421a-b677-974869a7f103.4620.19]): potential sources added=[] removed=[] 2024-09-19T14:06:06.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.091+0000 7faca5a249c0 20 handle_bi_update(): bucket=:error-at-init-index[dbb1da81-49d0-421a-b677-974869a7f103.4620.19]): orig_dests= new_dests= 2024-09-19T14:06:06.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.091+0000 7faca5a249c0 20 handle_bi_update(): bucket=:error-at-init-index[dbb1da81-49d0-421a-b677-974869a7f103.4620.19]): potential dests added=[] removed=[] 2024-09-19T14:06:06.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1.0 2024-09-19T14:06:06.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1.0 2024-09-19T14:06:06.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1.1 2024-09-19T14:06:06.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1.1 2024-09-19T14:06:06.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1.2 2024-09-19T14:06:06.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1.2 2024-09-19T14:06:06.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1.3 2024-09-19T14:06:06.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1.3 2024-09-19T14:06:06.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1.4 2024-09-19T14:06:06.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1.4 2024-09-19T14:06:06.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1.5 2024-09-19T14:06:06.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1.5 2024-09-19T14:06:06.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1.6 2024-09-19T14:06:06.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1.6 2024-09-19T14:06:06.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1.7 2024-09-19T14:06:06.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1.7 2024-09-19T14:06:06.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1.8 2024-09-19T14:06:06.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1.8 2024-09-19T14:06:06.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1.9 2024-09-19T14:06:06.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1.9 2024-09-19T14:06:06.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1.10 2024-09-19T14:06:06.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1.10 2024-09-19T14:06:06.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1.11 2024-09-19T14:06:06.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1.11 2024-09-19T14:06:06.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.0 2024-09-19T14:06:06.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1 2024-09-19T14:06:06.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.2 2024-09-19T14:06:06.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.3 2024-09-19T14:06:06.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.099+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.4 2024-09-19T14:06:06.101 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.103+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.5 2024-09-19T14:06:06.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.103+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.6 2024-09-19T14:06:06.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.103+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.7 2024-09-19T14:06:06.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.103+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.8 2024-09-19T14:06:06.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.107+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.9 2024-09-19T14:06:06.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.107+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.10 2024-09-19T14:06:06.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.115+0000 7faca5a249c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19 : hit (requested=0x17, cached=0x17) 2024-09-19T14:06:06.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.115+0000 7faca5a249c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19 2024-09-19T14:06:06.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.115+0000 7faca5a249c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19 info.flags=0x17 2024-09-19T14:06:06.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.115+0000 7faca5a249c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19 to cache LRU end 2024-09-19T14:06:06.116 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.115+0000 7faca5a249c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:06.116 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.115+0000 7faca5a249c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19, ofs0, ns] 2024-09-19T14:06:06.116 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.119+0000 7fab86ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333460 cookie 94413902819264 notifier 6225 bl.length()=911 2024-09-19T14:06:06.116 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.119+0000 7fab86ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19 info.flags=0x17 2024-09-19T14:06:06.116 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.119+0000 7fab86ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19 to cache LRU end 2024-09-19T14:06:06.116 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.119+0000 7fab86ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:06.119 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.119+0000 7faca5a249c0 20 handle_bi_update(): bucket=:error-at-init-index[dbb1da81-49d0-421a-b677-974869a7f103.4620.19]): orig_sources= new_sources= 2024-09-19T14:06:06.119 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.119+0000 7faca5a249c0 20 handle_bi_update(): bucket=:error-at-init-index[dbb1da81-49d0-421a-b677-974869a7f103.4620.19]): potential sources added=[] removed=[] 2024-09-19T14:06:06.119 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.119+0000 7faca5a249c0 20 handle_bi_update(): bucket=:error-at-init-index[dbb1da81-49d0-421a-b677-974869a7f103.4620.19]): orig_dests= new_dests= 2024-09-19T14:06:06.119 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.119+0000 7faca5a249c0 20 handle_bi_update(): bucket=:error-at-init-index[dbb1da81-49d0-421a-b677-974869a7f103.4620.19]): potential dests added=[] removed=[] 2024-09-19T14:06:06.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.127+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.0 2024-09-19T14:06:06.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.127+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.1 2024-09-19T14:06:06.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.127+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.2 2024-09-19T14:06:06.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.127+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.3 2024-09-19T14:06:06.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.127+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.4 2024-09-19T14:06:06.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.127+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.5 2024-09-19T14:06:06.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.131+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.6 2024-09-19T14:06:06.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.131+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.7 2024-09-19T14:06:06.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.131+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.8 2024-09-19T14:06:06.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.131+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.9 2024-09-19T14:06:06.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.131+0000 7faca5a249c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.19.10 2024-09-19T14:06:06.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.135+0000 7faca5a249c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19 : hit (requested=0x17, cached=0x17) 2024-09-19T14:06:06.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.135+0000 7faca5a249c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19 2024-09-19T14:06:06.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.135+0000 7faca5a249c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19 info.flags=0x17 2024-09-19T14:06:06.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.135+0000 7faca5a249c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19 to cache LRU end 2024-09-19T14:06:06.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.135+0000 7faca5a249c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:06.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.135+0000 7faca5a249c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19, ofs0, ns] 2024-09-19T14:06:06.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.135+0000 7fab867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333461 cookie 94413902819264 notifier 6225 bl.length()=879 2024-09-19T14:06:06.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.135+0000 7fab867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19 info.flags=0x17 2024-09-19T14:06:06.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.135+0000 7fab867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.19 to cache LRU end 2024-09-19T14:06:06.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.135+0000 7fab867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:06.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.139+0000 7faca5a249c0 20 handle_bi_update(): bucket=:error-at-init-index[dbb1da81-49d0-421a-b677-974869a7f103.4620.19]): orig_sources= new_sources= 2024-09-19T14:06:06.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.139+0000 7faca5a249c0 20 handle_bi_update(): bucket=:error-at-init-index[dbb1da81-49d0-421a-b677-974869a7f103.4620.19]): potential sources added=[] removed=[] 2024-09-19T14:06:06.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.139+0000 7faca5a249c0 20 handle_bi_update(): bucket=:error-at-init-index[dbb1da81-49d0-421a-b677-974869a7f103.4620.19]): orig_dests= new_dests= 2024-09-19T14:06:06.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.139+0000 7faca5a249c0 20 handle_bi_update(): bucket=:error-at-init-index[dbb1da81-49d0-421a-b677-974869a7f103.4620.19]): potential dests added=[] removed=[] 2024-09-19T14:06:06.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.143+0000 7faca5a249c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-19T14:06:06.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.147+0000 7fab59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:06.151 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.151+0000 7faca5a249c0 20 remove_watcher() i=0 2024-09-19T14:06:06.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.151+0000 7faca5a249c0 2 removed watcher, disabling cache 2024-09-19T14:06:06.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.155+0000 7faca5a249c0 20 remove_watcher() i=1 2024-09-19T14:06:06.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.159+0000 7faca5a249c0 20 remove_watcher() i=2 2024-09-19T14:06:06.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.159+0000 7faca5a249c0 20 remove_watcher() i=3 2024-09-19T14:06:06.161 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.163+0000 7faca5a249c0 20 remove_watcher() i=4 2024-09-19T14:06:06.162 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.163+0000 7faca5a249c0 20 remove_watcher() i=5 2024-09-19T14:06:06.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.163+0000 7faca5a249c0 20 remove_watcher() i=6 2024-09-19T14:06:06.166 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.167+0000 7faca5a249c0 20 remove_watcher() i=7 2024-09-19T14:06:06.184 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-19T14:06:06.214 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:06.214 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:06.258 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.259+0000 7fb9fb99d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:06.260 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.263+0000 7fb9fb99d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:06.260 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.263+0000 7fb9fb99d9c0 20 realm 2024-09-19T14:06:06.261 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.263+0000 7fb9fb99d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:06.261 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.263+0000 7fb9fb99d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:06.261 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.263+0000 7fb9fb99d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:06.261 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.263+0000 7fb9fb99d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:06.261 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.263+0000 7fb9fb99d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:06.261 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.263+0000 7fb9fb99d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:06.263 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.263+0000 7fb9fb99d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:06.263 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.263+0000 7fb9fb99d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:06.263 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.263+0000 7fb9fb99d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:06.263 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.263+0000 7fb9fb99d9c0 20 searching for the correct realm 2024-09-19T14:06:06.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.271+0000 7fb9f8ca2640 0 -- 172.21.15.153:0/406796049 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x55dffccb7f50 msgr2=0x55dffccba340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:06.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.275+0000 7fb9f94a3640 0 -- 172.21.15.153:0/406796049 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fb9f0036ba0 msgr2=0x7fb9f0047940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:06.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.479+0000 7fb9fb99d9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:06.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.479+0000 7fb9fb99d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:06.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.479+0000 7fb9fb99d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:06.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.479+0000 7fb9fb99d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:06.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.479+0000 7fb9fb99d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:06.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.479+0000 7fb9fb99d9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:06.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.479+0000 7fb9fb99d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:06.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.479+0000 7fb9fb99d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:06.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.479+0000 7fb9fb99d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:06.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.483+0000 7fb9fb99d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:06.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.483+0000 7fb9fb99d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:06.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.483+0000 7fb9fb99d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:06.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.483+0000 7fb9fb99d9c0 20 zone default found 2024-09-19T14:06:06.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.483+0000 7fb9fb99d9c0 4 Realm: () 2024-09-19T14:06:06.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.483+0000 7fb9fb99d9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:06.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.483+0000 7fb9fb99d9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:06.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.483+0000 7fb9fb99d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:06.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.483+0000 7fb9fb99d9c0 20 zonegroup default 2024-09-19T14:06:06.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.483+0000 7fb9fb99d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:06.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.483+0000 7fb9fb99d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:06.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.483+0000 7fb9fb99d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:06.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.483+0000 7fb9fb99d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:06.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.483+0000 7fb9fb99d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:06.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.487+0000 7fb9fb99d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:06.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.487+0000 7fb9fb99d9c0 20 started sync module instance, tier type = 2024-09-19T14:06:06.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.487+0000 7fb9fb99d9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:06.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.511+0000 7fb9fb99d9c0 20 add_watcher() i=0 2024-09-19T14:06:06.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.511+0000 7fb9fb99d9c0 20 add_watcher() i=1 2024-09-19T14:06:06.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.511+0000 7fb9fb99d9c0 20 add_watcher() i=2 2024-09-19T14:06:06.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.511+0000 7fb9fb99d9c0 20 add_watcher() i=3 2024-09-19T14:06:06.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.511+0000 7fb9fb99d9c0 20 add_watcher() i=4 2024-09-19T14:06:06.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.511+0000 7fb9fb99d9c0 20 add_watcher() i=5 2024-09-19T14:06:06.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.511+0000 7fb9fb99d9c0 20 add_watcher() i=6 2024-09-19T14:06:06.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.515+0000 7fb9fb99d9c0 20 add_watcher() i=7 2024-09-19T14:06:06.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.515+0000 7fb9fb99d9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:06.517 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.519+0000 7fb8affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:06.518 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.519+0000 7fb9fb99d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:06.518 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.519+0000 7fb9fb99d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:06.518 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.519+0000 7fb9fb99d9c0 5 note: GC not initialized 2024-09-19T14:06:06.518 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.519+0000 7fb8aefe5640 20 reqs_thread_entry: start 2024-09-19T14:06:06.518 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.519+0000 7fb9fb99d9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:06.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.519+0000 7fb9fb99d9c0 20 Filter name: none 2024-09-19T14:06:06.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.519+0000 7fb8acfe1640 20 reqs_thread_entry: start 2024-09-19T14:06:06.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.519+0000 7fb9fb99d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:06.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.523+0000 7fb9fb99d9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:06:06.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.523+0000 7fb9fb99d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:06.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.523+0000 7fb9fb99d9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:06:06.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.523+0000 7fb9fb99d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:06.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.523+0000 7fb9fb99d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:06.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.523+0000 7fb9fb99d9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:06:06.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.523+0000 7fb9fb99d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:06.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.523+0000 7fb9fb99d9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:06:06.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.523+0000 7fb9fb99d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:06.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.527+0000 7fb8affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:06.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.531+0000 7fb9fb99d9c0 20 remove_watcher() i=0 2024-09-19T14:06:06.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.531+0000 7fb9fb99d9c0 2 removed watcher, disabling cache 2024-09-19T14:06:06.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.535+0000 7fb9fb99d9c0 20 remove_watcher() i=1 2024-09-19T14:06:06.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.535+0000 7fb9fb99d9c0 20 remove_watcher() i=2 2024-09-19T14:06:06.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.539+0000 7fb9fb99d9c0 20 remove_watcher() i=3 2024-09-19T14:06:06.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.543+0000 7fb9fb99d9c0 20 remove_watcher() i=4 2024-09-19T14:06:06.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.543+0000 7fb9fb99d9c0 20 remove_watcher() i=5 2024-09-19T14:06:06.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.547+0000 7fb9fb99d9c0 20 remove_watcher() i=6 2024-09-19T14:06:06.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:06.547+0000 7fb9fb99d9c0 20 remove_watcher() i=7 2024-09-19T14:06:06.564 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:06.564 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:06:06.565 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-init-index id: dbb1da81-49d0-421a-b677-974869a7f103.4620.19 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T14:06:06.565 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:06.566 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:06.566 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:06.588 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:06.588 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:07.030 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:07.030 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:07.408 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-19T14:06:07.408 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:07.410 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:07.410 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:07.542 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:07.542 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:07.632 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:07.632 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:07.726 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:07.726 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:07.825 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:07.825 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:07.926 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:07.926 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:08.016 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:08.017 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:08.120 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:08.121 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:08.222 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:08.222 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:08.318 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:08.318 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:08.420 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:08.420 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:08.512 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:08.512 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:08.609 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:08.609 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:08.707 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:08.708 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:08.811 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:08.811 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:08.915 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:08.915 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:09.019 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:09.019 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:09.095 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:09.095 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:09.196 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:09.196 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:09.295 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:09.295 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:09.388 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:09.388 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:09.486 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:09.487 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:09.585 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-19T14:06:09.620 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:09.620 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:09.666 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:09.666+0000 7fa7422899c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:09.668 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:09.670+0000 7fa7422899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:09.668 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:09.670+0000 7fa7422899c0 20 realm 2024-09-19T14:06:09.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:09.670+0000 7fa7422899c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:09.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:09.670+0000 7fa7422899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:09.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:09.670+0000 7fa7422899c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:09.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:09.670+0000 7fa7422899c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:09.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:09.670+0000 7fa7422899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:09.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:09.670+0000 7fa7422899c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:09.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:09.670+0000 7fa7422899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:09.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:09.670+0000 7fa7422899c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:09.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:09.670+0000 7fa7422899c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:09.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:09.670+0000 7fa7422899c0 20 searching for the correct realm 2024-09-19T14:06:09.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:09.674+0000 7fa73f58e640 0 -- 172.21.15.153:0/1063073212 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fa730133070 msgr2=0x7fa7300e14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:09.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:09.890+0000 7fa73fd8f640 0 -- 172.21.15.153:0/1063073212 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fa7340a1050 msgr2=0x7fa73408c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:06:10.108 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.106+0000 7fa7422899c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:10.108 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.106+0000 7fa7422899c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:10.108 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.106+0000 7fa7422899c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:10.108 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.106+0000 7fa7422899c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:10.108 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.106+0000 7fa7422899c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:10.108 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.106+0000 7fa7422899c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:10.108 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.106+0000 7fa7422899c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.108 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.106+0000 7fa7422899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:10.109 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.106+0000 7fa7422899c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.109 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.110+0000 7fa7422899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:10.109 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.110+0000 7fa7422899c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.110+0000 7fa7422899c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:10.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.110+0000 7fa7422899c0 20 zone default found 2024-09-19T14:06:10.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.110+0000 7fa7422899c0 4 Realm: () 2024-09-19T14:06:10.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.110+0000 7fa7422899c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:10.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.110+0000 7fa7422899c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:10.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.110+0000 7fa7422899c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:10.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.110+0000 7fa7422899c0 20 zonegroup default 2024-09-19T14:06:10.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.110+0000 7fa7422899c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.110+0000 7fa7422899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:10.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.110+0000 7fa7422899c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.110+0000 7fa7422899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:10.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.110+0000 7fa7422899c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.112 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.110+0000 7fa7422899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:10.112 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.110+0000 7fa7422899c0 20 started sync module instance, tier type = 2024-09-19T14:06:10.112 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.110+0000 7fa7422899c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:10.144 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.142+0000 7fa7422899c0 20 add_watcher() i=0 2024-09-19T14:06:10.144 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.142+0000 7fa7422899c0 20 add_watcher() i=1 2024-09-19T14:06:10.144 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.142+0000 7fa7422899c0 20 add_watcher() i=2 2024-09-19T14:06:10.144 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.142+0000 7fa7422899c0 20 add_watcher() i=3 2024-09-19T14:06:10.144 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.142+0000 7fa7422899c0 20 add_watcher() i=4 2024-09-19T14:06:10.144 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.142+0000 7fa7422899c0 20 add_watcher() i=5 2024-09-19T14:06:10.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.146+0000 7fa7422899c0 20 add_watcher() i=6 2024-09-19T14:06:10.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.146+0000 7fa7422899c0 20 add_watcher() i=7 2024-09-19T14:06:10.147 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.146+0000 7fa7422899c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:10.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.150+0000 7fa5f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:10.151 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.150+0000 7fa7422899c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:10.151 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.150+0000 7fa7422899c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:10.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.150+0000 7fa7422899c0 5 note: GC not initialized 2024-09-19T14:06:10.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.150+0000 7fa5f4fe1640 20 reqs_thread_entry: start 2024-09-19T14:06:10.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.154+0000 7fa7422899c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:10.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.154+0000 7fa7422899c0 20 Filter name: none 2024-09-19T14:06:10.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.154+0000 7fa56e7fc640 20 reqs_thread_entry: start 2024-09-19T14:06:10.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.154+0000 7fa7422899c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.154+0000 7fa7422899c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:06:10.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.154+0000 7fa7422899c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.155 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.154+0000 7fa7422899c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:06:10.155 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.154+0000 7fa7422899c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:10.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.154+0000 7fa7422899c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.158+0000 7fa7422899c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:06:10.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.158+0000 7fa7422899c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.158+0000 7fa7422899c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:06:10.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.158+0000 7fa7422899c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:10.161 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.162+0000 7fa5f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:10.165 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.166+0000 7fa7422899c0 20 remove_watcher() i=0 2024-09-19T14:06:10.165 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.166+0000 7fa7422899c0 2 removed watcher, disabling cache 2024-09-19T14:06:10.167 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.166+0000 7fa7422899c0 20 remove_watcher() i=1 2024-09-19T14:06:10.169 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.170+0000 7fa7422899c0 20 remove_watcher() i=2 2024-09-19T14:06:10.171 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.170+0000 7fa7422899c0 20 remove_watcher() i=3 2024-09-19T14:06:10.173 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.174+0000 7fa7422899c0 20 remove_watcher() i=4 2024-09-19T14:06:10.175 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.174+0000 7fa7422899c0 20 remove_watcher() i=5 2024-09-19T14:06:10.176 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.178+0000 7fa7422899c0 20 remove_watcher() i=6 2024-09-19T14:06:10.178 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.178+0000 7fa7422899c0 20 remove_watcher() i=7 2024-09-19T14:06:10.193 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:10.193 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:06:10.193 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-init-index id: dbb1da81-49d0-421a-b677-974869a7f103.4620.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:06:10.193 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:10.194 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-19T14:06:10.233 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:10.233 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:10.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.282+0000 7f9d950bf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.282+0000 7f9d950bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:10.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.282+0000 7f9d950bf9c0 20 realm 2024-09-19T14:06:10.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.282+0000 7f9d950bf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.282+0000 7f9d950bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:10.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.282+0000 7f9d950bf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:10.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.282+0000 7f9d950bf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.282+0000 7f9d950bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:10.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.282+0000 7f9d950bf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.284 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.282+0000 7f9d950bf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:10.284 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.282+0000 7f9d950bf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.284 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.286+0000 7f9d950bf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:10.284 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.286+0000 7f9d950bf9c0 20 searching for the correct realm 2024-09-19T14:06:10.288 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.290+0000 7f9d923c4640 0 -- 172.21.15.153:0/1203312636 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f9d840bf070 msgr2=0x7f9d84101420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:10.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.506+0000 7f9d92bc5640 0 -- 172.21.15.153:0/1203312636 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f9d8809db10 msgr2=0x7f9d8809a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:10.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.722+0000 7f9d950bf9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:10.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.722+0000 7f9d950bf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:10.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.722+0000 7f9d950bf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:10.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.722+0000 7f9d950bf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:10.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.722+0000 7f9d950bf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:10.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.722+0000 7f9d950bf9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:10.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.722+0000 7f9d950bf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.726+0000 7f9d950bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:10.725 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.726+0000 7f9d950bf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.725 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.726+0000 7f9d950bf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:10.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.726+0000 7f9d950bf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.726+0000 7f9d950bf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:10.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.726+0000 7f9d950bf9c0 20 zone default found 2024-09-19T14:06:10.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.726+0000 7f9d950bf9c0 4 Realm: () 2024-09-19T14:06:10.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.726+0000 7f9d950bf9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:10.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.726+0000 7f9d950bf9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:10.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.726+0000 7f9d950bf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:10.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.726+0000 7f9d950bf9c0 20 zonegroup default 2024-09-19T14:06:10.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.726+0000 7f9d950bf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.726+0000 7f9d950bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:10.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.726+0000 7f9d950bf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.726+0000 7f9d950bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:10.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.726+0000 7f9d950bf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.730+0000 7f9d950bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:10.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.730+0000 7f9d950bf9c0 20 started sync module instance, tier type = 2024-09-19T14:06:10.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.730+0000 7f9d950bf9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:10.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.758+0000 7f9d950bf9c0 20 add_watcher() i=0 2024-09-19T14:06:10.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.758+0000 7f9d950bf9c0 20 add_watcher() i=1 2024-09-19T14:06:10.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.758+0000 7f9d950bf9c0 20 add_watcher() i=2 2024-09-19T14:06:10.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.758+0000 7f9d950bf9c0 20 add_watcher() i=3 2024-09-19T14:06:10.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.758+0000 7f9d950bf9c0 20 add_watcher() i=4 2024-09-19T14:06:10.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.758+0000 7f9d950bf9c0 20 add_watcher() i=5 2024-09-19T14:06:10.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.758+0000 7f9d950bf9c0 20 add_watcher() i=6 2024-09-19T14:06:10.764 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.766+0000 7f9d950bf9c0 20 add_watcher() i=7 2024-09-19T14:06:10.764 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.766+0000 7f9d950bf9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:10.768 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.770+0000 7f9c497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:10.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.770+0000 7f9d950bf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:10.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.770+0000 7f9d950bf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:10.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.770+0000 7f9d950bf9c0 5 note: GC not initialized 2024-09-19T14:06:10.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.770+0000 7f9bc3fff640 20 reqs_thread_entry: start 2024-09-19T14:06:10.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.770+0000 7f9d950bf9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:10.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.770+0000 7f9d950bf9c0 20 Filter name: none 2024-09-19T14:06:10.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.770+0000 7f9bc1ffb640 20 reqs_thread_entry: start 2024-09-19T14:06:10.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.770+0000 7f9d950bf9c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-19T14:06:10.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.770+0000 7f9d950bf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.770+0000 7f9d950bf9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:06:10.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.770+0000 7f9d950bf9c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-19T14:06:10.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.770+0000 7f9d950bf9c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-19T14:06:10.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.770+0000 7f9d950bf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.20 : miss 2024-09-19T14:06:10.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.770+0000 7f9d950bf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.770+0000 7f9d950bf9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:06:10.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.770+0000 7f9d950bf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.20 info.flags=0x17 2024-09-19T14:06:10.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.770+0000 7f9d950bf9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.20 to cache LRU end 2024-09-19T14:06:10.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.770+0000 7f9d950bf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:06:10.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.770+0000 7f9d950bf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:10.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.770+0000 7f9d950bf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.20 2024-09-19T14:06:10.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.774+0000 7f9d950bf9c0 -1 Injecting error=-95 at location=init_index 2024-09-19T14:06:10.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.774+0000 7f9d950bf9c0 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-19T14:06:10.780 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.782+0000 7f9d950bf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.20 info.flags=0x17 2024-09-19T14:06:10.781 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.782+0000 7f9d950bf9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.20 to cache LRU end 2024-09-19T14:06:10.781 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.782+0000 7f9d950bf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:10.781 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.782+0000 7f9d950bf9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.20, ofs0, ns] 2024-09-19T14:06:10.781 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.782+0000 7f9c767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333466 cookie 94600126228768 notifier 6282 bl.length()=911 2024-09-19T14:06:10.781 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.782+0000 7f9c767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.20 info.flags=0x17 2024-09-19T14:06:10.781 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.782+0000 7f9c767fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.20 to cache LRU end 2024-09-19T14:06:10.781 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.782+0000 7f9c767fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:10.783 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.782+0000 7f9d950bf9c0 20 handle_bi_update(): bucket=:error-at-init-index[dbb1da81-49d0-421a-b677-974869a7f103.4620.20]): orig_sources= new_sources= 2024-09-19T14:06:10.783 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.782+0000 7f9d950bf9c0 20 handle_bi_update(): bucket=:error-at-init-index[dbb1da81-49d0-421a-b677-974869a7f103.4620.20]): potential sources added=[] removed=[] 2024-09-19T14:06:10.783 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.782+0000 7f9d950bf9c0 20 handle_bi_update(): bucket=:error-at-init-index[dbb1da81-49d0-421a-b677-974869a7f103.4620.20]): orig_dests= new_dests= 2024-09-19T14:06:10.783 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.782+0000 7f9d950bf9c0 20 handle_bi_update(): bucket=:error-at-init-index[dbb1da81-49d0-421a-b677-974869a7f103.4620.20]): potential dests added=[] removed=[] 2024-09-19T14:06:10.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1.0 2024-09-19T14:06:10.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1.0 2024-09-19T14:06:10.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1.1 2024-09-19T14:06:10.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1.1 2024-09-19T14:06:10.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1.2 2024-09-19T14:06:10.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1.2 2024-09-19T14:06:10.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1.3 2024-09-19T14:06:10.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1.3 2024-09-19T14:06:10.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1.4 2024-09-19T14:06:10.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1.4 2024-09-19T14:06:10.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1.5 2024-09-19T14:06:10.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1.5 2024-09-19T14:06:10.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1.6 2024-09-19T14:06:10.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1.6 2024-09-19T14:06:10.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1.7 2024-09-19T14:06:10.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1.7 2024-09-19T14:06:10.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1.8 2024-09-19T14:06:10.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1.8 2024-09-19T14:06:10.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1.9 2024-09-19T14:06:10.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1.9 2024-09-19T14:06:10.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1.10 2024-09-19T14:06:10.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1.10 2024-09-19T14:06:10.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1.11 2024-09-19T14:06:10.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1.11 2024-09-19T14:06:10.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.786+0000 7f9d950bf9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.0 2024-09-19T14:06:10.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.790+0000 7f9d950bf9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.1 2024-09-19T14:06:10.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.790+0000 7f9d950bf9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.2 2024-09-19T14:06:10.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.790+0000 7f9d950bf9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.3 2024-09-19T14:06:10.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.790+0000 7f9d950bf9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.4 2024-09-19T14:06:10.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.794+0000 7f9d950bf9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.5 2024-09-19T14:06:10.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.794+0000 7f9d950bf9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.6 2024-09-19T14:06:10.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.794+0000 7f9d950bf9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.7 2024-09-19T14:06:10.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.794+0000 7f9d950bf9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.8 2024-09-19T14:06:10.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.798+0000 7f9d950bf9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.9 2024-09-19T14:06:10.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.798+0000 7f9d950bf9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.20.10 2024-09-19T14:06:10.802 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.802+0000 7f9d950bf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.20 : hit (requested=0x17, cached=0x17) 2024-09-19T14:06:10.803 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.802+0000 7f9d950bf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.20 2024-09-19T14:06:10.804 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.806+0000 7f9d950bf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.20 info.flags=0x17 2024-09-19T14:06:10.804 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.806+0000 7f9d950bf9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.20 to cache LRU end 2024-09-19T14:06:10.804 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.806+0000 7f9d950bf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:10.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.806+0000 7f9d950bf9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.20, ofs0, ns] 2024-09-19T14:06:10.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.806+0000 7f9c767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333467 cookie 94600126228768 notifier 6282 bl.length()=879 2024-09-19T14:06:10.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.806+0000 7f9c767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.20 info.flags=0x17 2024-09-19T14:06:10.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.806+0000 7f9c767fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:dbb1da81-49d0-421a-b677-974869a7f103.4620.20 to cache LRU end 2024-09-19T14:06:10.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.806+0000 7f9c767fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:10.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.806+0000 7f9d950bf9c0 20 handle_bi_update(): bucket=:error-at-init-index[dbb1da81-49d0-421a-b677-974869a7f103.4620.20]): orig_sources= new_sources= 2024-09-19T14:06:10.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.806+0000 7f9d950bf9c0 20 handle_bi_update(): bucket=:error-at-init-index[dbb1da81-49d0-421a-b677-974869a7f103.4620.20]): potential sources added=[] removed=[] 2024-09-19T14:06:10.807 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.806+0000 7f9d950bf9c0 20 handle_bi_update(): bucket=:error-at-init-index[dbb1da81-49d0-421a-b677-974869a7f103.4620.20]): orig_dests= new_dests= 2024-09-19T14:06:10.807 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.806+0000 7f9d950bf9c0 20 handle_bi_update(): bucket=:error-at-init-index[dbb1da81-49d0-421a-b677-974869a7f103.4620.20]): potential dests added=[] removed=[] 2024-09-19T14:06:10.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.810+0000 7f9d950bf9c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-19T14:06:10.815 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.814+0000 7f9c497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:10.819 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.818+0000 7f9d950bf9c0 20 remove_watcher() i=0 2024-09-19T14:06:10.820 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.818+0000 7f9d950bf9c0 2 removed watcher, disabling cache 2024-09-19T14:06:10.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.822+0000 7f9d950bf9c0 20 remove_watcher() i=1 2024-09-19T14:06:10.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.822+0000 7f9d950bf9c0 20 remove_watcher() i=2 2024-09-19T14:06:10.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.826+0000 7f9d950bf9c0 20 remove_watcher() i=3 2024-09-19T14:06:10.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.826+0000 7f9d950bf9c0 20 remove_watcher() i=4 2024-09-19T14:06:10.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.830+0000 7f9d950bf9c0 20 remove_watcher() i=5 2024-09-19T14:06:10.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.830+0000 7f9d950bf9c0 20 remove_watcher() i=6 2024-09-19T14:06:10.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.830+0000 7f9d950bf9c0 20 remove_watcher() i=7 2024-09-19T14:06:10.852 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-19T14:06:10.881 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:10.881 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:10.925 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.926+0000 7fa2955b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.926+0000 7fa2955b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:10.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.926+0000 7fa2955b19c0 20 realm 2024-09-19T14:06:10.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.926+0000 7fa2955b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.926+0000 7fa2955b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:10.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.926+0000 7fa2955b19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:10.928 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.926+0000 7fa2955b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.928 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.926+0000 7fa2955b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:10.928 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.926+0000 7fa2955b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.930+0000 7fa2955b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:10.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.930+0000 7fa2955b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.930+0000 7fa2955b19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:10.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.930+0000 7fa2955b19c0 20 searching for the correct realm 2024-09-19T14:06:10.935 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.934+0000 7fa2938b8640 0 -- 172.21.15.153:0/2462356840 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55679b2c2650 msgr2=0x55679b2c4ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:10.941 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.942+0000 7fa2928b6640 0 -- 172.21.15.153:0/2462356840 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fa284026040 msgr2=0x7fa284071410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:06:10.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.950+0000 7fa2955b19c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:10.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.950+0000 7fa2955b19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:10.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.950+0000 7fa2955b19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:10.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.950+0000 7fa2955b19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:10.950 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.950+0000 7fa2955b19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:10.950 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.950+0000 7fa2955b19c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:10.950 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.950+0000 7fa2955b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.950 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.950+0000 7fa2955b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:10.950 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.950+0000 7fa2955b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.950 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.950+0000 7fa2955b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:10.950 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.950+0000 7fa2955b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.950+0000 7fa2955b19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:10.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.950+0000 7fa2955b19c0 20 zone default found 2024-09-19T14:06:10.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.950+0000 7fa2955b19c0 4 Realm: () 2024-09-19T14:06:10.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.950+0000 7fa2955b19c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:10.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.950+0000 7fa2955b19c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:10.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.950+0000 7fa2955b19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:10.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.950+0000 7fa2955b19c0 20 zonegroup default 2024-09-19T14:06:10.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.950+0000 7fa2955b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.950+0000 7fa2955b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:10.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.950+0000 7fa2955b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.950+0000 7fa2955b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:10.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.950+0000 7fa2955b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.954+0000 7fa2955b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:10.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.954+0000 7fa2955b19c0 20 started sync module instance, tier type = 2024-09-19T14:06:10.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.954+0000 7fa2955b19c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:10.967 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.966+0000 7fa2955b19c0 20 add_watcher() i=0 2024-09-19T14:06:10.967 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.966+0000 7fa2955b19c0 20 add_watcher() i=1 2024-09-19T14:06:10.967 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.966+0000 7fa2955b19c0 20 add_watcher() i=2 2024-09-19T14:06:10.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.966+0000 7fa2955b19c0 20 add_watcher() i=3 2024-09-19T14:06:10.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.966+0000 7fa2955b19c0 20 add_watcher() i=4 2024-09-19T14:06:10.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.966+0000 7fa2955b19c0 20 add_watcher() i=5 2024-09-19T14:06:10.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.966+0000 7fa2955b19c0 20 add_watcher() i=6 2024-09-19T14:06:10.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.970+0000 7fa2955b19c0 20 add_watcher() i=7 2024-09-19T14:06:10.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.970+0000 7fa2955b19c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:10.971 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.970+0000 7fa149fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:10.971 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.970+0000 7fa2955b19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:10.971 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.970+0000 7fa2955b19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:10.971 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.970+0000 7fa2955b19c0 5 note: GC not initialized 2024-09-19T14:06:10.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.970+0000 7fa148fe1640 20 reqs_thread_entry: start 2024-09-19T14:06:10.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.970+0000 7fa2955b19c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:10.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.970+0000 7fa2955b19c0 20 Filter name: none 2024-09-19T14:06:10.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.970+0000 7fa0c27fc640 20 reqs_thread_entry: start 2024-09-19T14:06:10.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.970+0000 7fa2955b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.974+0000 7fa2955b19c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:06:10.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.974+0000 7fa2955b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.974 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.974+0000 7fa2955b19c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:06:10.974 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.974+0000 7fa2955b19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:10.974 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.974+0000 7fa2955b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.975 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.974+0000 7fa2955b19c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:06:10.975 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.974+0000 7fa2955b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:10.975 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.974+0000 7fa2955b19c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:06:10.975 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.974+0000 7fa2955b19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:10.977 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.978+0000 7fa149fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:10.982 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.982+0000 7fa2955b19c0 20 remove_watcher() i=0 2024-09-19T14:06:10.982 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.982+0000 7fa2955b19c0 2 removed watcher, disabling cache 2024-09-19T14:06:10.984 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.982+0000 7fa2955b19c0 20 remove_watcher() i=1 2024-09-19T14:06:10.986 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.986+0000 7fa2955b19c0 20 remove_watcher() i=2 2024-09-19T14:06:10.988 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.986+0000 7fa2955b19c0 20 remove_watcher() i=3 2024-09-19T14:06:10.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.990+0000 7fa2955b19c0 20 remove_watcher() i=4 2024-09-19T14:06:10.991 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.990+0000 7fa2955b19c0 20 remove_watcher() i=5 2024-09-19T14:06:10.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.994+0000 7fa2955b19c0 20 remove_watcher() i=6 2024-09-19T14:06:10.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:10.994+0000 7fa2955b19c0 20 remove_watcher() i=7 2024-09-19T14:06:11.007 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:11.007 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:06:11.007 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-init-index id: dbb1da81-49d0-421a-b677-974869a7f103.4620.20 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-19T14:06:11.007 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:11.008 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:11.008 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:11.027 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:11.027 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:11.603 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:11.603 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:11.976 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard bucket with abort at init_index 2024-09-19T14:06:11.976 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:11.979 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:11.979 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:12.126 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:12.126 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:12.217 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:12.217 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:12.324 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:12.324 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:12.423 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:12.423 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:12.522 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:12.522 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:12.624 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:12.625 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:12.726 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:12.727 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:12.828 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:12.829 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:12.920 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:12.920 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:13.025 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:13.026 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:13.114 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:13.115 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:13.214 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:13.214 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:13.303 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:13.303 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:13.401 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:13.401 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:13.497 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:13.497 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:13.597 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:13.597 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:13.691 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:13.692 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:13.808 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:13.809 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:13.906 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:13.906 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:14.001 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:14.001 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:14.094 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:14.094 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:14.185 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-19T14:06:14.218 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:14.218 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:14.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.266+0000 7f3b7308c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.267 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.266+0000 7f3b7308c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.267 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.266+0000 7f3b7308c9c0 20 realm 2024-09-19T14:06:14.267 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.266+0000 7f3b7308c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.267 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.266+0000 7f3b7308c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.267 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.266+0000 7f3b7308c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:14.267 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.266+0000 7f3b7308c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.267 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.266+0000 7f3b7308c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.268 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.266+0000 7f3b7308c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.270+0000 7f3b7308c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:14.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.270+0000 7f3b7308c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.270+0000 7f3b7308c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:14.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.270+0000 7f3b7308c9c0 20 searching for the correct realm 2024-09-19T14:06:14.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.274+0000 7f3b71393640 0 -- 172.21.15.153:0/2059308605 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55a6f06a4020 msgr2=0x55a6f06a6470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:14.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.282+0000 7f3b70391640 0 -- 172.21.15.153:0/2059308605 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f3b60113040 msgr2=0x7f3b600f7f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:14.288 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.286+0000 7f3b7308c9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:14.288 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.286+0000 7f3b7308c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:14.288 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.286+0000 7f3b7308c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:14.288 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.286+0000 7f3b7308c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:14.288 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.286+0000 7f3b7308c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:14.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.286+0000 7f3b7308c9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:14.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.286+0000 7f3b7308c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.286+0000 7f3b7308c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.286+0000 7f3b7308c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.290+0000 7f3b7308c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:14.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.290+0000 7f3b7308c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.290 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.290+0000 7f3b7308c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:14.290 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.290+0000 7f3b7308c9c0 20 zone default found 2024-09-19T14:06:14.290 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.290+0000 7f3b7308c9c0 4 Realm: () 2024-09-19T14:06:14.290 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.290+0000 7f3b7308c9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:14.290 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.290+0000 7f3b7308c9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:14.290 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.290+0000 7f3b7308c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:14.290 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.290+0000 7f3b7308c9c0 20 zonegroup default 2024-09-19T14:06:14.291 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.290+0000 7f3b7308c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.291 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.290+0000 7f3b7308c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.291 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.290+0000 7f3b7308c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.291 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.290+0000 7f3b7308c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.291 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.290+0000 7f3b7308c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.291 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.290+0000 7f3b7308c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.292 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.290+0000 7f3b7308c9c0 20 started sync module instance, tier type = 2024-09-19T14:06:14.292 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.290+0000 7f3b7308c9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:14.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.306+0000 7f3b7308c9c0 20 add_watcher() i=0 2024-09-19T14:06:14.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.306+0000 7f3b7308c9c0 20 add_watcher() i=1 2024-09-19T14:06:14.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.306+0000 7f3b7308c9c0 20 add_watcher() i=2 2024-09-19T14:06:14.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.306+0000 7f3b7308c9c0 20 add_watcher() i=3 2024-09-19T14:06:14.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.306+0000 7f3b7308c9c0 20 add_watcher() i=4 2024-09-19T14:06:14.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.306+0000 7f3b7308c9c0 20 add_watcher() i=5 2024-09-19T14:06:14.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.306+0000 7f3b7308c9c0 20 add_watcher() i=6 2024-09-19T14:06:14.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.306+0000 7f3b7308c9c0 20 add_watcher() i=7 2024-09-19T14:06:14.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.306+0000 7f3b7308c9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:14.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.310+0000 7f3a26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:14.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.310+0000 7f3b7308c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:14.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.310+0000 7f3b7308c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:14.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.310+0000 7f3b7308c9c0 5 note: GC not initialized 2024-09-19T14:06:14.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.310+0000 7f3a25fe3640 20 reqs_thread_entry: start 2024-09-19T14:06:14.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.310+0000 7f3b7308c9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:14.312 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.310+0000 7f3b7308c9c0 20 Filter name: none 2024-09-19T14:06:14.312 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.310+0000 7f39977fe640 20 reqs_thread_entry: start 2024-09-19T14:06:14.312 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.310+0000 7f3b7308c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.312 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.310+0000 7f3b7308c9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-19T14:06:14.312 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.310+0000 7f3b7308c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.313 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.314+0000 7f3b7308c9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-19T14:06:14.313 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.314+0000 7f3b7308c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:14.313 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.314+0000 7f3b7308c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.313 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.314+0000 7f3b7308c9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-19T14:06:14.313 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.314+0000 7f3b7308c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.313 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.314+0000 7f3b7308c9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-19T14:06:14.314 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.314+0000 7f3b7308c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:14.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.314+0000 7f3a26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:14.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.322+0000 7f3b7308c9c0 20 remove_watcher() i=0 2024-09-19T14:06:14.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.322+0000 7f3b7308c9c0 2 removed watcher, disabling cache 2024-09-19T14:06:14.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.322+0000 7f3b7308c9c0 20 remove_watcher() i=1 2024-09-19T14:06:14.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.326+0000 7f3b7308c9c0 20 remove_watcher() i=2 2024-09-19T14:06:14.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.326+0000 7f3b7308c9c0 20 remove_watcher() i=3 2024-09-19T14:06:14.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.330+0000 7f3b7308c9c0 20 remove_watcher() i=4 2024-09-19T14:06:14.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.330+0000 7f3b7308c9c0 20 remove_watcher() i=5 2024-09-19T14:06:14.331 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.330+0000 7f3b7308c9c0 20 remove_watcher() i=6 2024-09-19T14:06:14.332 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.334+0000 7f3b7308c9c0 20 remove_watcher() i=7 2024-09-19T14:06:14.346 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.346 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:06:14.346 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: abort-at-init-indext id: dbb1da81-49d0-421a-b677-974869a7f103.4620.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:06:14.346 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.346 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-19T14:06:14.379 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:14.379 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:14.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.422+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.424 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.422+0000 7ff3ef2219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.425 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.422+0000 7ff3ef2219c0 20 realm 2024-09-19T14:06:14.425 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.422+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.425 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.426+0000 7ff3ef2219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.425 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.426+0000 7ff3ef2219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:14.425 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.426+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.425 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.426+0000 7ff3ef2219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.425 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.426+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.426 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.426+0000 7ff3ef2219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:14.426 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.426+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.427 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.426+0000 7ff3ef2219c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:14.427 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.426+0000 7ff3ef2219c0 20 searching for the correct realm 2024-09-19T14:06:14.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.434+0000 7ff3ed528640 0 -- 172.21.15.153:0/1848742116 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7ff3d40692d0 msgr2=0x7ff3d4069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:14.651 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.650+0000 7ff3ecd27640 0 -- 172.21.15.153:0/1848742116 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x55bc7a463880 msgr2=0x55bc7a465c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:14.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:14.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:14.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:14.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:14.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:14.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:14.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.660 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.660 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:14.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:14.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 zone default found 2024-09-19T14:06:14.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.662+0000 7ff3ef2219c0 4 Realm: () 2024-09-19T14:06:14.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.662+0000 7ff3ef2219c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:14.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.662+0000 7ff3ef2219c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:14.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.662+0000 7ff3ef2219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:14.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 zonegroup default 2024-09-19T14:06:14.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.666 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.666 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.666 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.666+0000 7ff3ef2219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.666 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.666+0000 7ff3ef2219c0 20 started sync module instance, tier type = 2024-09-19T14:06:14.666 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.666+0000 7ff3ef2219c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:14.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.686+0000 7ff3ef2219c0 20 add_watcher() i=0 2024-09-19T14:06:14.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.686+0000 7ff3ef2219c0 20 add_watcher() i=1 2024-09-19T14:06:14.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.686+0000 7ff3ef2219c0 20 add_watcher() i=2 2024-09-19T14:06:14.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.686+0000 7ff3ef2219c0 20 add_watcher() i=3 2024-09-19T14:06:14.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.686+0000 7ff3ef2219c0 20 add_watcher() i=4 2024-09-19T14:06:14.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.686+0000 7ff3ef2219c0 20 add_watcher() i=5 2024-09-19T14:06:14.686 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.686+0000 7ff3ef2219c0 20 add_watcher() i=6 2024-09-19T14:06:14.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.686+0000 7ff3ef2219c0 20 add_watcher() i=7 2024-09-19T14:06:14.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.686+0000 7ff3ef2219c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:14.691 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.690+0000 7ff2a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:14.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.690+0000 7ff3ef2219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:14.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.690+0000 7ff3ef2219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:14.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 note: GC not initialized 2024-09-19T14:06:14.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.690+0000 7ff2a27e4640 20 reqs_thread_entry: start 2024-09-19T14:06:14.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.694+0000 7ff3ef2219c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:14.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.694+0000 7ff3ef2219c0 20 Filter name: none 2024-09-19T14:06:14.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.694+0000 7ff29b7fe640 20 reqs_thread_entry: start 2024-09-19T14:06:14.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-19T14:06:14.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.694+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.694+0000 7ff3ef2219c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-19T14:06:14.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-19T14:06:14.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-19T14:06:14.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 : miss 2024-09-19T14:06:14.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.694+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.694+0000 7ff3ef2219c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-19T14:06:14.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 info.flags=0x17 2024-09-19T14:06:14.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 to cache LRU end 2024-09-19T14:06:14.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:06:14.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:14.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 2024-09-19T14:06:14.696 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff3ef2219c0 time 2024-09-19T14:06:14.699395+0000 2024-09-19T14:06:14.696 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:06:14.697 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:06:14.698 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff3f2afb2eb] 2024-09-19T14:06:14.698 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff3f2afb49f] 2024-09-19T14:06:14.698 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc77a2d271] 2024-09-19T14:06:14.698 INFO:tasks.workunit.client.0.smithi153.stderr: 4: radosgw-admin(+0x140fa02) [0x55bc7847da02] 2024-09-19T14:06:14.698 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bc77a3d0dd] 2024-09-19T14:06:14.698 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:06:14.698 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff3f1961d90] 2024-09-19T14:06:14.698 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:06:14.698 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:06:14.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.698+0000 7ff3ef2219c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff3ef2219c0 time 2024-09-19T14:06:14.699395+0000 2024-09-19T14:06:14.698 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:06:14.698 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.698 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:06:14.698 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff3f2afb2eb] 2024-09-19T14:06:14.698 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff3f2afb49f] 2024-09-19T14:06:14.699 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc77a2d271] 2024-09-19T14:06:14.699 INFO:tasks.workunit.client.0.smithi153.stderr: 4: radosgw-admin(+0x140fa02) [0x55bc7847da02] 2024-09-19T14:06:14.699 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bc77a3d0dd] 2024-09-19T14:06:14.699 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:06:14.699 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff3f1961d90] 2024-09-19T14:06:14.699 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:06:14.699 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:06:14.699 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.699 INFO:tasks.workunit.client.0.smithi153.stderr:*** Caught signal (Aborted) ** 2024-09-19T14:06:14.699 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7ff3ef2219c0 thread_name:radosgw-admin 2024-09-19T14:06:14.717 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:06:14.717 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff3f197a520] 2024-09-19T14:06:14.717 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:06:14.717 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:06:14.717 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:06:14.717 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff3f2afb345] 2024-09-19T14:06:14.718 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff3f2afb49f] 2024-09-19T14:06:14.718 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc77a2d271] 2024-09-19T14:06:14.718 INFO:tasks.workunit.client.0.smithi153.stderr: 8: radosgw-admin(+0x140fa02) [0x55bc7847da02] 2024-09-19T14:06:14.718 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bc77a3d0dd] 2024-09-19T14:06:14.718 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:06:14.718 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff3f1961d90] 2024-09-19T14:06:14.718 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:06:14.718 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:06:14.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.698+0000 7ff3ef2219c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:06:14.719 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7ff3ef2219c0 thread_name:radosgw-admin 2024-09-19T14:06:14.719 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.719 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:06:14.719 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff3f197a520] 2024-09-19T14:06:14.719 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:06:14.719 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:06:14.719 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:06:14.719 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff3f2afb345] 2024-09-19T14:06:14.719 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff3f2afb49f] 2024-09-19T14:06:14.719 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc77a2d271] 2024-09-19T14:06:14.719 INFO:tasks.workunit.client.0.smithi153.stderr: 8: radosgw-admin(+0x140fa02) [0x55bc7847da02] 2024-09-19T14:06:14.720 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bc77a3d0dd] 2024-09-19T14:06:14.720 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:06:14.720 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff3f1961d90] 2024-09-19T14:06:14.720 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:06:14.720 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:06:14.720 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:06:14.720 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.720 INFO:tasks.workunit.client.0.smithi153.stderr:--- begin dump of recent events --- 2024-09-19T14:06:14.720 INFO:tasks.workunit.client.0.smithi153.stderr: -499> 2024-09-19T14:06:14.398+0000 7ff3ecd27640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:14.720 INFO:tasks.workunit.client.0.smithi153.stderr: -498> 2024-09-19T14:06:14.398+0000 7ff3ecd27640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:14.720 INFO:tasks.workunit.client.0.smithi153.stderr: -497> 2024-09-19T14:06:14.398+0000 7ff3ecd27640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:14.720 INFO:tasks.workunit.client.0.smithi153.stderr: -496> 2024-09-19T14:06:14.398+0000 7ff3ec526640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:14.720 INFO:tasks.workunit.client.0.smithi153.stderr: -495> 2024-09-19T14:06:14.398+0000 7ff3ec526640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:14.721 INFO:tasks.workunit.client.0.smithi153.stderr: -494> 2024-09-19T14:06:14.398+0000 7ff3ec526640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:14.721 INFO:tasks.workunit.client.0.smithi153.stderr: -493> 2024-09-19T14:06:14.398+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:14.721 INFO:tasks.workunit.client.0.smithi153.stderr: -492> 2024-09-19T14:06:14.398+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:14.721 INFO:tasks.workunit.client.0.smithi153.stderr: -491> 2024-09-19T14:06:14.398+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:14.721 INFO:tasks.workunit.client.0.smithi153.stderr: -490> 2024-09-19T14:06:14.402+0000 7ff3ed528640 10 monclient(hunting): get_auth_request con 0x55bc7a3788c0 auth_method 0 2024-09-19T14:06:14.721 INFO:tasks.workunit.client.0.smithi153.stderr: -489> 2024-09-19T14:06:14.402+0000 7ff3ed528640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:14.721 INFO:tasks.workunit.client.0.smithi153.stderr: -488> 2024-09-19T14:06:14.402+0000 7ff3ed528640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:14.721 INFO:tasks.workunit.client.0.smithi153.stderr: -487> 2024-09-19T14:06:14.402+0000 7ff3ed528640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:14.721 INFO:tasks.workunit.client.0.smithi153.stderr: -486> 2024-09-19T14:06:14.402+0000 7ff3ec526640 10 monclient(hunting): handle_auth_done global_id 5948 payload 274 2024-09-19T14:06:14.721 INFO:tasks.workunit.client.0.smithi153.stderr: -485> 2024-09-19T14:06:14.402+0000 7ff3ec526640 10 monclient: _finish_hunting 0 2024-09-19T14:06:14.721 INFO:tasks.workunit.client.0.smithi153.stderr: -484> 2024-09-19T14:06:14.402+0000 7ff3ec526640 1 monclient: found mon.noname-c 2024-09-19T14:06:14.721 INFO:tasks.workunit.client.0.smithi153.stderr: -483> 2024-09-19T14:06:14.402+0000 7ff3ec526640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:06:14.721 INFO:tasks.workunit.client.0.smithi153.stderr: -482> 2024-09-19T14:06:14.402+0000 7ff2dae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:14.721 INFO:tasks.workunit.client.0.smithi153.stderr: -481> 2024-09-19T14:06:14.402+0000 7ff2dae0d640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:06:14.722 INFO:tasks.workunit.client.0.smithi153.stderr: -480> 2024-09-19T14:06:14.402+0000 7ff2dae0d640 10 monclient: dump: 2024-09-19T14:06:14.722 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:14.722 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:14.722 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.722 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.722 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:14.722 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.722 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:14.722 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:14.722 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:14.723 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.723 INFO:tasks.workunit.client.0.smithi153.stderr: -479> 2024-09-19T14:06:14.402+0000 7ff2dae0d640 10 monclient: _finish_auth 0 2024-09-19T14:06:14.723 INFO:tasks.workunit.client.0.smithi153.stderr: -478> 2024-09-19T14:06:14.402+0000 7ff2dae0d640 10 monclient: _check_auth_tickets 2024-09-19T14:06:14.723 INFO:tasks.workunit.client.0.smithi153.stderr: -477> 2024-09-19T14:06:14.402+0000 7ff2dae0d640 10 monclient: handle_config config(0 keys) 2024-09-19T14:06:14.723 INFO:tasks.workunit.client.0.smithi153.stderr: -476> 2024-09-19T14:06:14.402+0000 7ff2dae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:14.723 INFO:tasks.workunit.client.0.smithi153.stderr: -475> 2024-09-19T14:06:14.402+0000 7ff2dae0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:06:14.723 INFO:tasks.workunit.client.0.smithi153.stderr: -474> 2024-09-19T14:06:14.402+0000 7ff2dae0d640 10 monclient: dump: 2024-09-19T14:06:14.723 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:14.723 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:14.723 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.723 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.723 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:14.723 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.723 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:14.723 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:14.724 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:14.724 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.724 INFO:tasks.workunit.client.0.smithi153.stderr: -473> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 monclient: authenticate success, global_id 5948 2024-09-19T14:06:14.724 INFO:tasks.workunit.client.0.smithi153.stderr: -472> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient: get_monmap_and_config success 2024-09-19T14:06:14.724 INFO:tasks.workunit.client.0.smithi153.stderr: -471> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 4 set_mon_vals no callback set 2024-09-19T14:06:14.724 INFO:tasks.workunit.client.0.smithi153.stderr: -470> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient: shutdown 2024-09-19T14:06:14.724 INFO:tasks.workunit.client.0.smithi153.stderr: -469> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) unregister_commands rotate-key 2024-09-19T14:06:14.724 INFO:tasks.workunit.client.0.smithi153.stderr: -468> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient: build_initial_monmap 2024-09-19T14:06:14.724 INFO:tasks.workunit.client.0.smithi153.stderr: -467> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 1 build_initial for_mkfs: 0 2024-09-19T14:06:14.724 INFO:tasks.workunit.client.0.smithi153.stderr: -466> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient: monmap: 2024-09-19T14:06:14.724 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:06:14.724 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:06:14.724 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:06:14.724 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:06:14.725 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:06:14.725 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.725 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:06:14.725 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:06:14.725 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:06:14.725 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.725 INFO:tasks.workunit.client.0.smithi153.stderr: -465> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding auth protocol: cephx 2024-09-19T14:06:14.725 INFO:tasks.workunit.client.0.smithi153.stderr: -464> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding auth protocol: cephx 2024-09-19T14:06:14.725 INFO:tasks.workunit.client.0.smithi153.stderr: -463> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding auth protocol: cephx 2024-09-19T14:06:14.725 INFO:tasks.workunit.client.0.smithi153.stderr: -462> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding con mode: secure 2024-09-19T14:06:14.725 INFO:tasks.workunit.client.0.smithi153.stderr: -461> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding con mode: crc 2024-09-19T14:06:14.725 INFO:tasks.workunit.client.0.smithi153.stderr: -460> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding con mode: secure 2024-09-19T14:06:14.726 INFO:tasks.workunit.client.0.smithi153.stderr: -459> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding con mode: crc 2024-09-19T14:06:14.726 INFO:tasks.workunit.client.0.smithi153.stderr: -458> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding con mode: secure 2024-09-19T14:06:14.726 INFO:tasks.workunit.client.0.smithi153.stderr: -457> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding con mode: crc 2024-09-19T14:06:14.726 INFO:tasks.workunit.client.0.smithi153.stderr: -456> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding con mode: crc 2024-09-19T14:06:14.726 INFO:tasks.workunit.client.0.smithi153.stderr: -455> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding con mode: secure 2024-09-19T14:06:14.726 INFO:tasks.workunit.client.0.smithi153.stderr: -454> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding con mode: crc 2024-09-19T14:06:14.726 INFO:tasks.workunit.client.0.smithi153.stderr: -453> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding con mode: secure 2024-09-19T14:06:14.726 INFO:tasks.workunit.client.0.smithi153.stderr: -452> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding con mode: crc 2024-09-19T14:06:14.726 INFO:tasks.workunit.client.0.smithi153.stderr: -451> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding con mode: secure 2024-09-19T14:06:14.726 INFO:tasks.workunit.client.0.smithi153.stderr: -450> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.726 INFO:tasks.workunit.client.0.smithi153.stderr: -449> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 1 librados: starting msgr at 2024-09-19T14:06:14.726 INFO:tasks.workunit.client.0.smithi153.stderr: -448> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 1 librados: starting objecter 2024-09-19T14:06:14.726 INFO:tasks.workunit.client.0.smithi153.stderr: -447> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command objecter_requests hook 0x55bc7a375bb0 2024-09-19T14:06:14.726 INFO:tasks.workunit.client.0.smithi153.stderr: -446> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 1 librados: setting wanted keys 2024-09-19T14:06:14.727 INFO:tasks.workunit.client.0.smithi153.stderr: -445> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 1 librados: calling monclient init 2024-09-19T14:06:14.727 INFO:tasks.workunit.client.0.smithi153.stderr: -444> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient: init 2024-09-19T14:06:14.727 INFO:tasks.workunit.client.0.smithi153.stderr: -443> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding auth protocol: cephx 2024-09-19T14:06:14.727 INFO:tasks.workunit.client.0.smithi153.stderr: -442> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding auth protocol: cephx 2024-09-19T14:06:14.727 INFO:tasks.workunit.client.0.smithi153.stderr: -441> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding auth protocol: cephx 2024-09-19T14:06:14.727 INFO:tasks.workunit.client.0.smithi153.stderr: -440> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding con mode: secure 2024-09-19T14:06:14.727 INFO:tasks.workunit.client.0.smithi153.stderr: -439> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding con mode: crc 2024-09-19T14:06:14.727 INFO:tasks.workunit.client.0.smithi153.stderr: -438> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding con mode: secure 2024-09-19T14:06:14.727 INFO:tasks.workunit.client.0.smithi153.stderr: -437> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding con mode: crc 2024-09-19T14:06:14.727 INFO:tasks.workunit.client.0.smithi153.stderr: -436> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding con mode: secure 2024-09-19T14:06:14.727 INFO:tasks.workunit.client.0.smithi153.stderr: -435> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding con mode: crc 2024-09-19T14:06:14.727 INFO:tasks.workunit.client.0.smithi153.stderr: -434> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding con mode: crc 2024-09-19T14:06:14.728 INFO:tasks.workunit.client.0.smithi153.stderr: -433> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding con mode: secure 2024-09-19T14:06:14.728 INFO:tasks.workunit.client.0.smithi153.stderr: -432> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding con mode: crc 2024-09-19T14:06:14.728 INFO:tasks.workunit.client.0.smithi153.stderr: -431> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding con mode: secure 2024-09-19T14:06:14.728 INFO:tasks.workunit.client.0.smithi153.stderr: -430> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding con mode: crc 2024-09-19T14:06:14.728 INFO:tasks.workunit.client.0.smithi153.stderr: -429> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding con mode: secure 2024-09-19T14:06:14.728 INFO:tasks.workunit.client.0.smithi153.stderr: -428> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.728 INFO:tasks.workunit.client.0.smithi153.stderr: -427> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.728 INFO:tasks.workunit.client.0.smithi153.stderr: -426> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command rotate-key hook 0x55bc7a374568 2024-09-19T14:06:14.728 INFO:tasks.workunit.client.0.smithi153.stderr: -425> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient: _reopen_session rank -1 2024-09-19T14:06:14.728 INFO:tasks.workunit.client.0.smithi153.stderr: -424> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T14:06:14.729 INFO:tasks.workunit.client.0.smithi153.stderr: -423> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient(hunting): picked mon.noname-a con 0x55bc7a201410 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:06:14.729 INFO:tasks.workunit.client.0.smithi153.stderr: -422> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient(hunting): picked mon.noname-b con 0x55bc7a2020f0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:06:14.729 INFO:tasks.workunit.client.0.smithi153.stderr: -421> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient(hunting): picked mon.noname-c con 0x55bc7a3788c0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:06:14.729 INFO:tasks.workunit.client.0.smithi153.stderr: -420> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:14.729 INFO:tasks.workunit.client.0.smithi153.stderr: -419> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:14.729 INFO:tasks.workunit.client.0.smithi153.stderr: -418> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:14.729 INFO:tasks.workunit.client.0.smithi153.stderr: -417> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient(hunting): _renew_subs 2024-09-19T14:06:14.730 INFO:tasks.workunit.client.0.smithi153.stderr: -416> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient(hunting): authenticate will time out at 2562.866724s 2024-09-19T14:06:14.730 INFO:tasks.workunit.client.0.smithi153.stderr: -415> 2024-09-19T14:06:14.402+0000 7ff3ecd27640 10 monclient(hunting): get_auth_request con 0x55bc7a201410 auth_method 0 2024-09-19T14:06:14.730 INFO:tasks.workunit.client.0.smithi153.stderr: -414> 2024-09-19T14:06:14.402+0000 7ff3ecd27640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:14.730 INFO:tasks.workunit.client.0.smithi153.stderr: -413> 2024-09-19T14:06:14.402+0000 7ff3ecd27640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:14.730 INFO:tasks.workunit.client.0.smithi153.stderr: -412> 2024-09-19T14:06:14.402+0000 7ff3ecd27640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:14.730 INFO:tasks.workunit.client.0.smithi153.stderr: -411> 2024-09-19T14:06:14.402+0000 7ff3ed528640 10 monclient(hunting): get_auth_request con 0x55bc7a3788c0 auth_method 0 2024-09-19T14:06:14.731 INFO:tasks.workunit.client.0.smithi153.stderr: -410> 2024-09-19T14:06:14.402+0000 7ff3ed528640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:14.731 INFO:tasks.workunit.client.0.smithi153.stderr: -409> 2024-09-19T14:06:14.402+0000 7ff3ed528640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:14.731 INFO:tasks.workunit.client.0.smithi153.stderr: -408> 2024-09-19T14:06:14.402+0000 7ff3ed528640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:14.731 INFO:tasks.workunit.client.0.smithi153.stderr: -407> 2024-09-19T14:06:14.402+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:14.731 INFO:tasks.workunit.client.0.smithi153.stderr: -406> 2024-09-19T14:06:14.402+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:14.731 INFO:tasks.workunit.client.0.smithi153.stderr: -405> 2024-09-19T14:06:14.402+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:14.731 INFO:tasks.workunit.client.0.smithi153.stderr: -404> 2024-09-19T14:06:14.402+0000 7ff3ed528640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:14.731 INFO:tasks.workunit.client.0.smithi153.stderr: -403> 2024-09-19T14:06:14.402+0000 7ff3ed528640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:14.731 INFO:tasks.workunit.client.0.smithi153.stderr: -402> 2024-09-19T14:06:14.402+0000 7ff3ed528640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:14.731 INFO:tasks.workunit.client.0.smithi153.stderr: -401> 2024-09-19T14:06:14.402+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_done global_id 6330 payload 824 2024-09-19T14:06:14.731 INFO:tasks.workunit.client.0.smithi153.stderr: -400> 2024-09-19T14:06:14.402+0000 7ff3ecd27640 10 monclient: _finish_hunting 0 2024-09-19T14:06:14.731 INFO:tasks.workunit.client.0.smithi153.stderr: -399> 2024-09-19T14:06:14.402+0000 7ff3ecd27640 1 monclient: found mon.noname-a 2024-09-19T14:06:14.731 INFO:tasks.workunit.client.0.smithi153.stderr: -398> 2024-09-19T14:06:14.402+0000 7ff3ecd27640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:06:14.731 INFO:tasks.workunit.client.0.smithi153.stderr: -397> 2024-09-19T14:06:14.402+0000 7ff2d960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:14.732 INFO:tasks.workunit.client.0.smithi153.stderr: -396> 2024-09-19T14:06:14.402+0000 7ff2d960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:06:14.732 INFO:tasks.workunit.client.0.smithi153.stderr: -395> 2024-09-19T14:06:14.402+0000 7ff2d960a640 10 monclient: dump: 2024-09-19T14:06:14.732 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:14.732 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:14.732 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.732 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.732 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:14.732 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.732 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:14.732 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:14.732 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:14.732 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.732 INFO:tasks.workunit.client.0.smithi153.stderr: -394> 2024-09-19T14:06:14.402+0000 7ff2d960a640 10 monclient: _finish_auth 0 2024-09-19T14:06:14.733 INFO:tasks.workunit.client.0.smithi153.stderr: -393> 2024-09-19T14:06:14.402+0000 7ff2d960a640 10 monclient: _check_auth_tickets 2024-09-19T14:06:14.733 INFO:tasks.workunit.client.0.smithi153.stderr: -392> 2024-09-19T14:06:14.402+0000 7ff2d960a640 10 monclient: handle_config config(0 keys) 2024-09-19T14:06:14.733 INFO:tasks.workunit.client.0.smithi153.stderr: -391> 2024-09-19T14:06:14.402+0000 7ff2d960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:14.733 INFO:tasks.workunit.client.0.smithi153.stderr: -390> 2024-09-19T14:06:14.402+0000 7ff2d960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:06:14.733 INFO:tasks.workunit.client.0.smithi153.stderr: -389> 2024-09-19T14:06:14.402+0000 7ff2d960a640 10 monclient: dump: 2024-09-19T14:06:14.733 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:14.733 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:14.733 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.733 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.733 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:14.733 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.733 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:14.733 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:14.734 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:14.734 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.734 INFO:tasks.workunit.client.0.smithi153.stderr: -388> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 monclient: authenticate success, global_id 6330 2024-09-19T14:06:14.734 INFO:tasks.workunit.client.0.smithi153.stderr: -387> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient: _renew_subs 2024-09-19T14:06:14.734 INFO:tasks.workunit.client.0.smithi153.stderr: -386> 2024-09-19T14:06:14.402+0000 7ff2dae0d640 4 set_mon_vals no callback set 2024-09-19T14:06:14.734 INFO:tasks.workunit.client.0.smithi153.stderr: -385> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:06:14.735 INFO:tasks.workunit.client.0.smithi153.stderr: -384> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient: _renew_subs 2024-09-19T14:06:14.736 INFO:tasks.workunit.client.0.smithi153.stderr: -383> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:06:14.736 INFO:tasks.workunit.client.0.smithi153.stderr: -382> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 1 librados: init done 2024-09-19T14:06:14.736 INFO:tasks.workunit.client.0.smithi153.stderr: -381> 2024-09-19T14:06:14.406+0000 7ff2d960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:06:14.736 INFO:tasks.workunit.client.0.smithi153.stderr: -380> 2024-09-19T14:06:14.406+0000 7ff2d960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:06:14.736 INFO:tasks.workunit.client.0.smithi153.stderr: -379> 2024-09-19T14:06:14.406+0000 7ff2d960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:06:14.736 INFO:tasks.workunit.client.0.smithi153.stderr: -378> 2024-09-19T14:06:14.406+0000 7ff3ec526640 10 monclient: get_auth_request con 0x7ff2d4071be0 auth_method 0 2024-09-19T14:06:14.736 INFO:tasks.workunit.client.0.smithi153.stderr: -377> 2024-09-19T14:06:14.406+0000 7ff3ed528640 10 monclient: get_auth_request con 0x55bc7a3bc5a0 auth_method 0 2024-09-19T14:06:14.736 INFO:tasks.workunit.client.0.smithi153.stderr: -376> 2024-09-19T14:06:14.406+0000 7ff3ecd27640 10 monclient: get_auth_request con 0x55bc7a3bf780 auth_method 0 2024-09-19T14:06:14.736 INFO:tasks.workunit.client.0.smithi153.stderr: -375> 2024-09-19T14:06:14.410+0000 7ff3ec526640 10 monclient: get_auth_request con 0x55bc7a3c4810 auth_method 0 2024-09-19T14:06:14.736 INFO:tasks.workunit.client.0.smithi153.stderr: -374> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 10 monclient: build_initial_monmap 2024-09-19T14:06:14.736 INFO:tasks.workunit.client.0.smithi153.stderr: -373> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 1 build_initial for_mkfs: 0 2024-09-19T14:06:14.737 INFO:tasks.workunit.client.0.smithi153.stderr: -372> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 10 monclient: monmap: 2024-09-19T14:06:14.737 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:06:14.737 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:06:14.737 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:06:14.737 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:06:14.737 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:06:14.737 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.737 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:06:14.737 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:06:14.737 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:06:14.737 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.737 INFO:tasks.workunit.client.0.smithi153.stderr: -371> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding auth protocol: cephx 2024-09-19T14:06:14.737 INFO:tasks.workunit.client.0.smithi153.stderr: -370> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding auth protocol: cephx 2024-09-19T14:06:14.738 INFO:tasks.workunit.client.0.smithi153.stderr: -369> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding auth protocol: cephx 2024-09-19T14:06:14.738 INFO:tasks.workunit.client.0.smithi153.stderr: -368> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding con mode: secure 2024-09-19T14:06:14.738 INFO:tasks.workunit.client.0.smithi153.stderr: -367> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding con mode: crc 2024-09-19T14:06:14.738 INFO:tasks.workunit.client.0.smithi153.stderr: -366> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding con mode: secure 2024-09-19T14:06:14.738 INFO:tasks.workunit.client.0.smithi153.stderr: -365> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding con mode: crc 2024-09-19T14:06:14.738 INFO:tasks.workunit.client.0.smithi153.stderr: -364> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding con mode: secure 2024-09-19T14:06:14.738 INFO:tasks.workunit.client.0.smithi153.stderr: -363> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding con mode: crc 2024-09-19T14:06:14.738 INFO:tasks.workunit.client.0.smithi153.stderr: -362> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding con mode: crc 2024-09-19T14:06:14.738 INFO:tasks.workunit.client.0.smithi153.stderr: -361> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding con mode: secure 2024-09-19T14:06:14.738 INFO:tasks.workunit.client.0.smithi153.stderr: -360> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding con mode: crc 2024-09-19T14:06:14.738 INFO:tasks.workunit.client.0.smithi153.stderr: -359> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding con mode: secure 2024-09-19T14:06:14.738 INFO:tasks.workunit.client.0.smithi153.stderr: -358> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding con mode: crc 2024-09-19T14:06:14.739 INFO:tasks.workunit.client.0.smithi153.stderr: -357> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding con mode: secure 2024-09-19T14:06:14.739 INFO:tasks.workunit.client.0.smithi153.stderr: -356> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.739 INFO:tasks.workunit.client.0.smithi153.stderr: -355> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command objecter_requests cmddesc objecter_requests hook 0x55bc7a3cbea0 EEXIST 2024-09-19T14:06:14.739 INFO:tasks.workunit.client.0.smithi153.stderr: -354> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient: init 2024-09-19T14:06:14.739 INFO:tasks.workunit.client.0.smithi153.stderr: -353> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding auth protocol: cephx 2024-09-19T14:06:14.739 INFO:tasks.workunit.client.0.smithi153.stderr: -352> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding auth protocol: cephx 2024-09-19T14:06:14.739 INFO:tasks.workunit.client.0.smithi153.stderr: -351> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding auth protocol: cephx 2024-09-19T14:06:14.739 INFO:tasks.workunit.client.0.smithi153.stderr: -350> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding con mode: secure 2024-09-19T14:06:14.739 INFO:tasks.workunit.client.0.smithi153.stderr: -349> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding con mode: crc 2024-09-19T14:06:14.739 INFO:tasks.workunit.client.0.smithi153.stderr: -348> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding con mode: secure 2024-09-19T14:06:14.739 INFO:tasks.workunit.client.0.smithi153.stderr: -347> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding con mode: crc 2024-09-19T14:06:14.740 INFO:tasks.workunit.client.0.smithi153.stderr: -346> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding con mode: secure 2024-09-19T14:06:14.740 INFO:tasks.workunit.client.0.smithi153.stderr: -345> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding con mode: crc 2024-09-19T14:06:14.740 INFO:tasks.workunit.client.0.smithi153.stderr: -344> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding con mode: crc 2024-09-19T14:06:14.740 INFO:tasks.workunit.client.0.smithi153.stderr: -343> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding con mode: secure 2024-09-19T14:06:14.740 INFO:tasks.workunit.client.0.smithi153.stderr: -342> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding con mode: crc 2024-09-19T14:06:14.740 INFO:tasks.workunit.client.0.smithi153.stderr: -341> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding con mode: secure 2024-09-19T14:06:14.740 INFO:tasks.workunit.client.0.smithi153.stderr: -340> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding con mode: crc 2024-09-19T14:06:14.740 INFO:tasks.workunit.client.0.smithi153.stderr: -339> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding con mode: secure 2024-09-19T14:06:14.740 INFO:tasks.workunit.client.0.smithi153.stderr: -338> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.740 INFO:tasks.workunit.client.0.smithi153.stderr: -337> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.740 INFO:tasks.workunit.client.0.smithi153.stderr: -336> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command rotate-key cmddesc rotate-key hook 0x55bc7a3c76a0 EEXIST 2024-09-19T14:06:14.740 INFO:tasks.workunit.client.0.smithi153.stderr: -335> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient: _reopen_session rank -1 2024-09-19T14:06:14.740 INFO:tasks.workunit.client.0.smithi153.stderr: -334> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T14:06:14.740 INFO:tasks.workunit.client.0.smithi153.stderr: -333> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient(hunting): picked mon.noname-a con 0x55bc7a3f0050 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:06:14.741 INFO:tasks.workunit.client.0.smithi153.stderr: -332> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient(hunting): picked mon.noname-b con 0x55bc7a3ef980 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:06:14.741 INFO:tasks.workunit.client.0.smithi153.stderr: -331> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient(hunting): picked mon.noname-c con 0x55bc7a3ee360 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:06:14.741 INFO:tasks.workunit.client.0.smithi153.stderr: -330> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:14.741 INFO:tasks.workunit.client.0.smithi153.stderr: -329> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:14.741 INFO:tasks.workunit.client.0.smithi153.stderr: -328> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:14.741 INFO:tasks.workunit.client.0.smithi153.stderr: -327> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient(hunting): _renew_subs 2024-09-19T14:06:14.741 INFO:tasks.workunit.client.0.smithi153.stderr: -326> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient(hunting): authenticate will time out at 2562.876942s 2024-09-19T14:06:14.741 INFO:tasks.workunit.client.0.smithi153.stderr: -325> 2024-09-19T14:06:14.414+0000 7ff3ed528640 10 monclient(hunting): get_auth_request con 0x55bc7a3ee360 auth_method 0 2024-09-19T14:06:14.741 INFO:tasks.workunit.client.0.smithi153.stderr: -324> 2024-09-19T14:06:14.414+0000 7ff3ed528640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:14.741 INFO:tasks.workunit.client.0.smithi153.stderr: -323> 2024-09-19T14:06:14.414+0000 7ff3ed528640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:14.741 INFO:tasks.workunit.client.0.smithi153.stderr: -322> 2024-09-19T14:06:14.414+0000 7ff3ed528640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:14.741 INFO:tasks.workunit.client.0.smithi153.stderr: -321> 2024-09-19T14:06:14.414+0000 7ff3ecd27640 10 monclient(hunting): get_auth_request con 0x55bc7a3f0050 auth_method 0 2024-09-19T14:06:14.741 INFO:tasks.workunit.client.0.smithi153.stderr: -320> 2024-09-19T14:06:14.414+0000 7ff3ecd27640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:14.742 INFO:tasks.workunit.client.0.smithi153.stderr: -319> 2024-09-19T14:06:14.414+0000 7ff3ecd27640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:14.742 INFO:tasks.workunit.client.0.smithi153.stderr: -318> 2024-09-19T14:06:14.414+0000 7ff3ecd27640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:14.742 INFO:tasks.workunit.client.0.smithi153.stderr: -317> 2024-09-19T14:06:14.414+0000 7ff3ed528640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:14.742 INFO:tasks.workunit.client.0.smithi153.stderr: -316> 2024-09-19T14:06:14.414+0000 7ff3ed528640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:14.742 INFO:tasks.workunit.client.0.smithi153.stderr: -315> 2024-09-19T14:06:14.414+0000 7ff3ed528640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:14.742 INFO:tasks.workunit.client.0.smithi153.stderr: -314> 2024-09-19T14:06:14.414+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:14.742 INFO:tasks.workunit.client.0.smithi153.stderr: -313> 2024-09-19T14:06:14.414+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:14.742 INFO:tasks.workunit.client.0.smithi153.stderr: -312> 2024-09-19T14:06:14.414+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:14.742 INFO:tasks.workunit.client.0.smithi153.stderr: -311> 2024-09-19T14:06:14.414+0000 7ff3ec526640 10 monclient(hunting): get_auth_request con 0x55bc7a3ef980 auth_method 0 2024-09-19T14:06:14.742 INFO:tasks.workunit.client.0.smithi153.stderr: -310> 2024-09-19T14:06:14.414+0000 7ff3ec526640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:14.742 INFO:tasks.workunit.client.0.smithi153.stderr: -309> 2024-09-19T14:06:14.414+0000 7ff3ec526640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:14.743 INFO:tasks.workunit.client.0.smithi153.stderr: -308> 2024-09-19T14:06:14.414+0000 7ff3ec526640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:14.743 INFO:tasks.workunit.client.0.smithi153.stderr: -307> 2024-09-19T14:06:14.414+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_done global_id 6333 payload 824 2024-09-19T14:06:14.743 INFO:tasks.workunit.client.0.smithi153.stderr: -306> 2024-09-19T14:06:14.414+0000 7ff3ecd27640 10 monclient: _finish_hunting 0 2024-09-19T14:06:14.743 INFO:tasks.workunit.client.0.smithi153.stderr: -305> 2024-09-19T14:06:14.414+0000 7ff3ecd27640 1 monclient: found mon.noname-a 2024-09-19T14:06:14.743 INFO:tasks.workunit.client.0.smithi153.stderr: -304> 2024-09-19T14:06:14.414+0000 7ff3ecd27640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:06:14.743 INFO:tasks.workunit.client.0.smithi153.stderr: -303> 2024-09-19T14:06:14.414+0000 7ff2d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:14.743 INFO:tasks.workunit.client.0.smithi153.stderr: -302> 2024-09-19T14:06:14.414+0000 7ff2d27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:06:14.743 INFO:tasks.workunit.client.0.smithi153.stderr: -301> 2024-09-19T14:06:14.414+0000 7ff2d27fc640 10 monclient: dump: 2024-09-19T14:06:14.743 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:14.743 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:14.743 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.743 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.744 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:14.744 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.744 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:14.744 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:14.744 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:14.744 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.744 INFO:tasks.workunit.client.0.smithi153.stderr: -300> 2024-09-19T14:06:14.414+0000 7ff2d27fc640 10 monclient: _finish_auth 0 2024-09-19T14:06:14.744 INFO:tasks.workunit.client.0.smithi153.stderr: -299> 2024-09-19T14:06:14.414+0000 7ff2d27fc640 10 monclient: _check_auth_tickets 2024-09-19T14:06:14.744 INFO:tasks.workunit.client.0.smithi153.stderr: -298> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 monclient: authenticate success, global_id 6333 2024-09-19T14:06:14.744 INFO:tasks.workunit.client.0.smithi153.stderr: -297> 2024-09-19T14:06:14.414+0000 7ff2d27fc640 10 monclient: handle_config config(0 keys) 2024-09-19T14:06:14.744 INFO:tasks.workunit.client.0.smithi153.stderr: -296> 2024-09-19T14:06:14.414+0000 7ff2d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:14.744 INFO:tasks.workunit.client.0.smithi153.stderr: -295> 2024-09-19T14:06:14.414+0000 7ff2d27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:06:14.744 INFO:tasks.workunit.client.0.smithi153.stderr: -294> 2024-09-19T14:06:14.414+0000 7ff2d27fc640 10 monclient: dump: 2024-09-19T14:06:14.745 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:14.745 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:14.745 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.745 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.745 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:14.745 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.745 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:14.745 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:14.745 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:14.745 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.745 INFO:tasks.workunit.client.0.smithi153.stderr: -293> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient: _renew_subs 2024-09-19T14:06:14.745 INFO:tasks.workunit.client.0.smithi153.stderr: -292> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:06:14.745 INFO:tasks.workunit.client.0.smithi153.stderr: -291> 2024-09-19T14:06:14.414+0000 7ff3edd29640 4 set_mon_vals no callback set 2024-09-19T14:06:14.746 INFO:tasks.workunit.client.0.smithi153.stderr: -290> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient: _renew_subs 2024-09-19T14:06:14.746 INFO:tasks.workunit.client.0.smithi153.stderr: -289> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:06:14.746 INFO:tasks.workunit.client.0.smithi153.stderr: -288> 2024-09-19T14:06:14.414+0000 7ff2d27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:06:14.746 INFO:tasks.workunit.client.0.smithi153.stderr: -287> 2024-09-19T14:06:14.414+0000 7ff2d27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:06:14.746 INFO:tasks.workunit.client.0.smithi153.stderr: -286> 2024-09-19T14:06:14.414+0000 7ff2d27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:06:14.746 INFO:tasks.workunit.client.0.smithi153.stderr: -285> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: get_monmap_and_config 2024-09-19T14:06:14.746 INFO:tasks.workunit.client.0.smithi153.stderr: -284> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: build_initial_monmap 2024-09-19T14:06:14.746 INFO:tasks.workunit.client.0.smithi153.stderr: -283> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 1 build_initial for_mkfs: 0 2024-09-19T14:06:14.746 INFO:tasks.workunit.client.0.smithi153.stderr: -282> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: monmap: 2024-09-19T14:06:14.746 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:06:14.746 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:06:14.747 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:06:14.747 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:06:14.747 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:06:14.747 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.747 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:06:14.747 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:06:14.747 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:06:14.747 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.748 INFO:tasks.workunit.client.0.smithi153.stderr: -281> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding auth protocol: cephx 2024-09-19T14:06:14.748 INFO:tasks.workunit.client.0.smithi153.stderr: -280> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding auth protocol: cephx 2024-09-19T14:06:14.748 INFO:tasks.workunit.client.0.smithi153.stderr: -279> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding auth protocol: cephx 2024-09-19T14:06:14.748 INFO:tasks.workunit.client.0.smithi153.stderr: -278> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding con mode: secure 2024-09-19T14:06:14.748 INFO:tasks.workunit.client.0.smithi153.stderr: -277> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding con mode: crc 2024-09-19T14:06:14.748 INFO:tasks.workunit.client.0.smithi153.stderr: -276> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding con mode: secure 2024-09-19T14:06:14.748 INFO:tasks.workunit.client.0.smithi153.stderr: -275> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding con mode: crc 2024-09-19T14:06:14.748 INFO:tasks.workunit.client.0.smithi153.stderr: -274> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding con mode: secure 2024-09-19T14:06:14.748 INFO:tasks.workunit.client.0.smithi153.stderr: -273> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding con mode: crc 2024-09-19T14:06:14.748 INFO:tasks.workunit.client.0.smithi153.stderr: -272> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding con mode: crc 2024-09-19T14:06:14.748 INFO:tasks.workunit.client.0.smithi153.stderr: -271> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding con mode: secure 2024-09-19T14:06:14.748 INFO:tasks.workunit.client.0.smithi153.stderr: -270> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding con mode: crc 2024-09-19T14:06:14.748 INFO:tasks.workunit.client.0.smithi153.stderr: -269> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding con mode: secure 2024-09-19T14:06:14.748 INFO:tasks.workunit.client.0.smithi153.stderr: -268> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding con mode: crc 2024-09-19T14:06:14.749 INFO:tasks.workunit.client.0.smithi153.stderr: -267> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding con mode: secure 2024-09-19T14:06:14.749 INFO:tasks.workunit.client.0.smithi153.stderr: -266> 2024-09-19T14:06:14.418+0000 7ff3ec526640 10 monclient: get_auth_request con 0x7ff2c4071b20 auth_method 0 2024-09-19T14:06:14.749 INFO:tasks.workunit.client.0.smithi153.stderr: -265> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.749 INFO:tasks.workunit.client.0.smithi153.stderr: -264> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: init 2024-09-19T14:06:14.749 INFO:tasks.workunit.client.0.smithi153.stderr: -263> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding auth protocol: cephx 2024-09-19T14:06:14.749 INFO:tasks.workunit.client.0.smithi153.stderr: -262> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding auth protocol: cephx 2024-09-19T14:06:14.749 INFO:tasks.workunit.client.0.smithi153.stderr: -261> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding auth protocol: cephx 2024-09-19T14:06:14.749 INFO:tasks.workunit.client.0.smithi153.stderr: -260> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding con mode: secure 2024-09-19T14:06:14.749 INFO:tasks.workunit.client.0.smithi153.stderr: -259> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding con mode: crc 2024-09-19T14:06:14.750 INFO:tasks.workunit.client.0.smithi153.stderr: -258> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding con mode: secure 2024-09-19T14:06:14.750 INFO:tasks.workunit.client.0.smithi153.stderr: -257> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding con mode: crc 2024-09-19T14:06:14.750 INFO:tasks.workunit.client.0.smithi153.stderr: -256> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding con mode: secure 2024-09-19T14:06:14.750 INFO:tasks.workunit.client.0.smithi153.stderr: -255> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding con mode: crc 2024-09-19T14:06:14.750 INFO:tasks.workunit.client.0.smithi153.stderr: -254> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding con mode: crc 2024-09-19T14:06:14.750 INFO:tasks.workunit.client.0.smithi153.stderr: -253> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding con mode: secure 2024-09-19T14:06:14.750 INFO:tasks.workunit.client.0.smithi153.stderr: -252> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding con mode: crc 2024-09-19T14:06:14.750 INFO:tasks.workunit.client.0.smithi153.stderr: -251> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding con mode: secure 2024-09-19T14:06:14.750 INFO:tasks.workunit.client.0.smithi153.stderr: -250> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding con mode: crc 2024-09-19T14:06:14.751 INFO:tasks.workunit.client.0.smithi153.stderr: -249> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding con mode: secure 2024-09-19T14:06:14.751 INFO:tasks.workunit.client.0.smithi153.stderr: -248> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.751 INFO:tasks.workunit.client.0.smithi153.stderr: -247> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.751 INFO:tasks.workunit.client.0.smithi153.stderr: -246> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command rotate-key cmddesc rotate-key hook 0x7ffe134c7418 EEXIST 2024-09-19T14:06:14.751 INFO:tasks.workunit.client.0.smithi153.stderr: -245> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: _reopen_session rank -1 2024-09-19T14:06:14.751 INFO:tasks.workunit.client.0.smithi153.stderr: -244> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T14:06:14.751 INFO:tasks.workunit.client.0.smithi153.stderr: -243> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): picked mon.noname-a con 0x55bc7a43f650 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:06:14.751 INFO:tasks.workunit.client.0.smithi153.stderr: -242> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): picked mon.noname-b con 0x55bc7a443880 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:06:14.751 INFO:tasks.workunit.client.0.smithi153.stderr: -241> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): picked mon.noname-c con 0x55bc7a410650 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:06:14.751 INFO:tasks.workunit.client.0.smithi153.stderr: -240> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:14.751 INFO:tasks.workunit.client.0.smithi153.stderr: -239> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:14.752 INFO:tasks.workunit.client.0.smithi153.stderr: -238> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:14.752 INFO:tasks.workunit.client.0.smithi153.stderr: -237> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): _renew_subs 2024-09-19T14:06:14.752 INFO:tasks.workunit.client.0.smithi153.stderr: -236> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): authenticate will time out at 2562.881054s 2024-09-19T14:06:14.752 INFO:tasks.workunit.client.0.smithi153.stderr: -235> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient(hunting): get_auth_request con 0x55bc7a43f650 auth_method 0 2024-09-19T14:06:14.752 INFO:tasks.workunit.client.0.smithi153.stderr: -234> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:14.752 INFO:tasks.workunit.client.0.smithi153.stderr: -233> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:14.752 INFO:tasks.workunit.client.0.smithi153.stderr: -232> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:14.752 INFO:tasks.workunit.client.0.smithi153.stderr: -231> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): get_auth_request con 0x55bc7a410650 auth_method 0 2024-09-19T14:06:14.752 INFO:tasks.workunit.client.0.smithi153.stderr: -230> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:14.752 INFO:tasks.workunit.client.0.smithi153.stderr: -229> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:14.752 INFO:tasks.workunit.client.0.smithi153.stderr: -228> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:14.752 INFO:tasks.workunit.client.0.smithi153.stderr: -227> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:14.752 INFO:tasks.workunit.client.0.smithi153.stderr: -226> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:14.753 INFO:tasks.workunit.client.0.smithi153.stderr: -225> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:14.753 INFO:tasks.workunit.client.0.smithi153.stderr: -224> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:14.753 INFO:tasks.workunit.client.0.smithi153.stderr: -223> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:14.753 INFO:tasks.workunit.client.0.smithi153.stderr: -222> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:14.753 INFO:tasks.workunit.client.0.smithi153.stderr: -221> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_done global_id 6336 payload 274 2024-09-19T14:06:14.753 INFO:tasks.workunit.client.0.smithi153.stderr: -220> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient: _finish_hunting 0 2024-09-19T14:06:14.753 INFO:tasks.workunit.client.0.smithi153.stderr: -219> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 1 monclient: found mon.noname-a 2024-09-19T14:06:14.753 INFO:tasks.workunit.client.0.smithi153.stderr: -218> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:06:14.753 INFO:tasks.workunit.client.0.smithi153.stderr: -217> 2024-09-19T14:06:14.418+0000 7ff2c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:14.753 INFO:tasks.workunit.client.0.smithi153.stderr: -216> 2024-09-19T14:06:14.418+0000 7ff2c3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:06:14.753 INFO:tasks.workunit.client.0.smithi153.stderr: -215> 2024-09-19T14:06:14.418+0000 7ff2c3fff640 10 monclient: dump: 2024-09-19T14:06:14.753 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:14.753 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:14.753 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.754 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.754 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:14.754 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.754 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:14.754 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:14.754 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:14.754 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.754 INFO:tasks.workunit.client.0.smithi153.stderr: -214> 2024-09-19T14:06:14.418+0000 7ff2c3fff640 10 monclient: _finish_auth 0 2024-09-19T14:06:14.754 INFO:tasks.workunit.client.0.smithi153.stderr: -213> 2024-09-19T14:06:14.418+0000 7ff2c3fff640 10 monclient: _check_auth_tickets 2024-09-19T14:06:14.754 INFO:tasks.workunit.client.0.smithi153.stderr: -212> 2024-09-19T14:06:14.418+0000 7ff2c3fff640 10 monclient: handle_config config(0 keys) 2024-09-19T14:06:14.754 INFO:tasks.workunit.client.0.smithi153.stderr: -211> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 monclient: authenticate success, global_id 6336 2024-09-19T14:06:14.755 INFO:tasks.workunit.client.0.smithi153.stderr: -210> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: get_monmap_and_config success 2024-09-19T14:06:14.755 INFO:tasks.workunit.client.0.smithi153.stderr: -209> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 4 set_mon_vals no callback set 2024-09-19T14:06:14.755 INFO:tasks.workunit.client.0.smithi153.stderr: -208> 2024-09-19T14:06:14.418+0000 7ff2c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:14.755 INFO:tasks.workunit.client.0.smithi153.stderr: -207> 2024-09-19T14:06:14.418+0000 7ff2c3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:06:14.755 INFO:tasks.workunit.client.0.smithi153.stderr: -206> 2024-09-19T14:06:14.418+0000 7ff2c3fff640 10 monclient: dump: 2024-09-19T14:06:14.755 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:14.755 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:14.755 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.755 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.755 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:14.755 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.755 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:14.756 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:14.756 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:14.756 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.756 INFO:tasks.workunit.client.0.smithi153.stderr: -205> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: shutdown 2024-09-19T14:06:14.756 INFO:tasks.workunit.client.0.smithi153.stderr: -204> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: build_initial_monmap 2024-09-19T14:06:14.756 INFO:tasks.workunit.client.0.smithi153.stderr: -203> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 1 build_initial for_mkfs: 0 2024-09-19T14:06:14.756 INFO:tasks.workunit.client.0.smithi153.stderr: -202> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: monmap: 2024-09-19T14:06:14.756 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:06:14.756 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:06:14.756 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:06:14.756 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:06:14.756 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:06:14.757 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.757 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:06:14.757 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:06:14.757 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:06:14.757 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.757 INFO:tasks.workunit.client.0.smithi153.stderr: -201> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding auth protocol: cephx 2024-09-19T14:06:14.757 INFO:tasks.workunit.client.0.smithi153.stderr: -200> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding auth protocol: cephx 2024-09-19T14:06:14.757 INFO:tasks.workunit.client.0.smithi153.stderr: -199> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding auth protocol: cephx 2024-09-19T14:06:14.758 INFO:tasks.workunit.client.0.smithi153.stderr: -198> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding con mode: secure 2024-09-19T14:06:14.758 INFO:tasks.workunit.client.0.smithi153.stderr: -197> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding con mode: crc 2024-09-19T14:06:14.758 INFO:tasks.workunit.client.0.smithi153.stderr: -196> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding con mode: secure 2024-09-19T14:06:14.758 INFO:tasks.workunit.client.0.smithi153.stderr: -195> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding con mode: crc 2024-09-19T14:06:14.758 INFO:tasks.workunit.client.0.smithi153.stderr: -194> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding con mode: secure 2024-09-19T14:06:14.759 INFO:tasks.workunit.client.0.smithi153.stderr: -193> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding con mode: crc 2024-09-19T14:06:14.759 INFO:tasks.workunit.client.0.smithi153.stderr: -192> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding con mode: crc 2024-09-19T14:06:14.759 INFO:tasks.workunit.client.0.smithi153.stderr: -191> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding con mode: secure 2024-09-19T14:06:14.759 INFO:tasks.workunit.client.0.smithi153.stderr: -190> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding con mode: crc 2024-09-19T14:06:14.759 INFO:tasks.workunit.client.0.smithi153.stderr: -189> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding con mode: secure 2024-09-19T14:06:14.759 INFO:tasks.workunit.client.0.smithi153.stderr: -188> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding con mode: crc 2024-09-19T14:06:14.760 INFO:tasks.workunit.client.0.smithi153.stderr: -187> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding con mode: secure 2024-09-19T14:06:14.760 INFO:tasks.workunit.client.0.smithi153.stderr: -186> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.760 INFO:tasks.workunit.client.0.smithi153.stderr: -185> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 1 librados: starting msgr at 2024-09-19T14:06:14.760 INFO:tasks.workunit.client.0.smithi153.stderr: -184> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 1 librados: starting objecter 2024-09-19T14:06:14.760 INFO:tasks.workunit.client.0.smithi153.stderr: -183> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command objecter_requests cmddesc objecter_requests hook 0x55bc7a43d710 EEXIST 2024-09-19T14:06:14.760 INFO:tasks.workunit.client.0.smithi153.stderr: -182> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 1 librados: setting wanted keys 2024-09-19T14:06:14.760 INFO:tasks.workunit.client.0.smithi153.stderr: -181> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 1 librados: calling monclient init 2024-09-19T14:06:14.760 INFO:tasks.workunit.client.0.smithi153.stderr: -180> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: init 2024-09-19T14:06:14.760 INFO:tasks.workunit.client.0.smithi153.stderr: -179> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding auth protocol: cephx 2024-09-19T14:06:14.760 INFO:tasks.workunit.client.0.smithi153.stderr: -178> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding auth protocol: cephx 2024-09-19T14:06:14.761 INFO:tasks.workunit.client.0.smithi153.stderr: -177> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding auth protocol: cephx 2024-09-19T14:06:14.761 INFO:tasks.workunit.client.0.smithi153.stderr: -176> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding con mode: secure 2024-09-19T14:06:14.761 INFO:tasks.workunit.client.0.smithi153.stderr: -175> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding con mode: crc 2024-09-19T14:06:14.761 INFO:tasks.workunit.client.0.smithi153.stderr: -174> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding con mode: secure 2024-09-19T14:06:14.761 INFO:tasks.workunit.client.0.smithi153.stderr: -173> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding con mode: crc 2024-09-19T14:06:14.761 INFO:tasks.workunit.client.0.smithi153.stderr: -172> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding con mode: secure 2024-09-19T14:06:14.761 INFO:tasks.workunit.client.0.smithi153.stderr: -171> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding con mode: crc 2024-09-19T14:06:14.762 INFO:tasks.workunit.client.0.smithi153.stderr: -170> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding con mode: crc 2024-09-19T14:06:14.762 INFO:tasks.workunit.client.0.smithi153.stderr: -169> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding con mode: secure 2024-09-19T14:06:14.762 INFO:tasks.workunit.client.0.smithi153.stderr: -168> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding con mode: crc 2024-09-19T14:06:14.762 INFO:tasks.workunit.client.0.smithi153.stderr: -167> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding con mode: secure 2024-09-19T14:06:14.762 INFO:tasks.workunit.client.0.smithi153.stderr: -166> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding con mode: crc 2024-09-19T14:06:14.762 INFO:tasks.workunit.client.0.smithi153.stderr: -165> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding con mode: secure 2024-09-19T14:06:14.762 INFO:tasks.workunit.client.0.smithi153.stderr: -164> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.762 INFO:tasks.workunit.client.0.smithi153.stderr: -163> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.762 INFO:tasks.workunit.client.0.smithi153.stderr: -162> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command rotate-key cmddesc rotate-key hook 0x55bc7a3f1fb8 EEXIST 2024-09-19T14:06:14.762 INFO:tasks.workunit.client.0.smithi153.stderr: -161> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: _reopen_session rank -1 2024-09-19T14:06:14.762 INFO:tasks.workunit.client.0.smithi153.stderr: -160> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:06:14.762 INFO:tasks.workunit.client.0.smithi153.stderr: -159> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): picked mon.noname-b con 0x55bc7a410650 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:06:14.763 INFO:tasks.workunit.client.0.smithi153.stderr: -158> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): picked mon.noname-a con 0x55bc7a43f650 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:06:14.763 INFO:tasks.workunit.client.0.smithi153.stderr: -157> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): picked mon.noname-c con 0x55bc7a443880 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:06:14.763 INFO:tasks.workunit.client.0.smithi153.stderr: -156> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:14.763 INFO:tasks.workunit.client.0.smithi153.stderr: -155> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:14.763 INFO:tasks.workunit.client.0.smithi153.stderr: -154> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:14.763 INFO:tasks.workunit.client.0.smithi153.stderr: -153> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): _renew_subs 2024-09-19T14:06:14.763 INFO:tasks.workunit.client.0.smithi153.stderr: -152> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): authenticate will time out at 2562.883561s 2024-09-19T14:06:14.763 INFO:tasks.workunit.client.0.smithi153.stderr: -151> 2024-09-19T14:06:14.418+0000 7ff3ec526640 10 monclient(hunting): get_auth_request con 0x55bc7a43f650 auth_method 0 2024-09-19T14:06:14.763 INFO:tasks.workunit.client.0.smithi153.stderr: -150> 2024-09-19T14:06:14.418+0000 7ff3ec526640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:14.763 INFO:tasks.workunit.client.0.smithi153.stderr: -149> 2024-09-19T14:06:14.418+0000 7ff3ec526640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:14.763 INFO:tasks.workunit.client.0.smithi153.stderr: -148> 2024-09-19T14:06:14.418+0000 7ff3ec526640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:14.763 INFO:tasks.workunit.client.0.smithi153.stderr: -147> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): get_auth_request con 0x55bc7a443880 auth_method 0 2024-09-19T14:06:14.763 INFO:tasks.workunit.client.0.smithi153.stderr: -146> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:14.764 INFO:tasks.workunit.client.0.smithi153.stderr: -145> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:14.764 INFO:tasks.workunit.client.0.smithi153.stderr: -144> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:14.764 INFO:tasks.workunit.client.0.smithi153.stderr: -143> 2024-09-19T14:06:14.418+0000 7ff3ec526640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:14.764 INFO:tasks.workunit.client.0.smithi153.stderr: -142> 2024-09-19T14:06:14.418+0000 7ff3ec526640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:14.764 INFO:tasks.workunit.client.0.smithi153.stderr: -141> 2024-09-19T14:06:14.418+0000 7ff3ec526640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:14.764 INFO:tasks.workunit.client.0.smithi153.stderr: -140> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:14.764 INFO:tasks.workunit.client.0.smithi153.stderr: -139> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:14.764 INFO:tasks.workunit.client.0.smithi153.stderr: -138> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:14.764 INFO:tasks.workunit.client.0.smithi153.stderr: -137> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient(hunting): get_auth_request con 0x55bc7a410650 auth_method 0 2024-09-19T14:06:14.764 INFO:tasks.workunit.client.0.smithi153.stderr: -136> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:14.764 INFO:tasks.workunit.client.0.smithi153.stderr: -135> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:14.764 INFO:tasks.workunit.client.0.smithi153.stderr: -134> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:14.765 INFO:tasks.workunit.client.0.smithi153.stderr: -133> 2024-09-19T14:06:14.418+0000 7ff3ec526640 10 monclient(hunting): handle_auth_done global_id 6339 payload 824 2024-09-19T14:06:14.765 INFO:tasks.workunit.client.0.smithi153.stderr: -132> 2024-09-19T14:06:14.418+0000 7ff3ec526640 10 monclient: _finish_hunting 0 2024-09-19T14:06:14.765 INFO:tasks.workunit.client.0.smithi153.stderr: -131> 2024-09-19T14:06:14.418+0000 7ff3ec526640 1 monclient: found mon.noname-a 2024-09-19T14:06:14.765 INFO:tasks.workunit.client.0.smithi153.stderr: -130> 2024-09-19T14:06:14.422+0000 7ff3ec526640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:06:14.765 INFO:tasks.workunit.client.0.smithi153.stderr: -129> 2024-09-19T14:06:14.422+0000 7ff2c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:14.765 INFO:tasks.workunit.client.0.smithi153.stderr: -128> 2024-09-19T14:06:14.422+0000 7ff2c27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:06:14.765 INFO:tasks.workunit.client.0.smithi153.stderr: -127> 2024-09-19T14:06:14.422+0000 7ff2c27fc640 10 monclient: dump: 2024-09-19T14:06:14.765 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:14.765 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:14.765 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.765 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.765 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:14.765 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.766 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:14.766 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:14.766 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:14.766 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.766 INFO:tasks.workunit.client.0.smithi153.stderr: -126> 2024-09-19T14:06:14.422+0000 7ff2c27fc640 10 monclient: _finish_auth 0 2024-09-19T14:06:14.766 INFO:tasks.workunit.client.0.smithi153.stderr: -125> 2024-09-19T14:06:14.422+0000 7ff2c27fc640 10 monclient: _check_auth_tickets 2024-09-19T14:06:14.766 INFO:tasks.workunit.client.0.smithi153.stderr: -124> 2024-09-19T14:06:14.422+0000 7ff2c27fc640 10 monclient: handle_config config(0 keys) 2024-09-19T14:06:14.766 INFO:tasks.workunit.client.0.smithi153.stderr: -123> 2024-09-19T14:06:14.422+0000 7ff3ef2219c0 5 monclient: authenticate success, global_id 6339 2024-09-19T14:06:14.766 INFO:tasks.workunit.client.0.smithi153.stderr: -122> 2024-09-19T14:06:14.422+0000 7ff3ef2219c0 10 monclient: _renew_subs 2024-09-19T14:06:14.766 INFO:tasks.workunit.client.0.smithi153.stderr: -121> 2024-09-19T14:06:14.422+0000 7ff3ef2219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:06:14.766 INFO:tasks.workunit.client.0.smithi153.stderr: -120> 2024-09-19T14:06:14.422+0000 7ff2c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:14.766 INFO:tasks.workunit.client.0.smithi153.stderr: -119> 2024-09-19T14:06:14.422+0000 7ff2c3fff640 4 set_mon_vals no callback set 2024-09-19T14:06:14.766 INFO:tasks.workunit.client.0.smithi153.stderr: -118> 2024-09-19T14:06:14.422+0000 7ff2c27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:06:14.766 INFO:tasks.workunit.client.0.smithi153.stderr: -117> 2024-09-19T14:06:14.422+0000 7ff2c27fc640 10 monclient: dump: 2024-09-19T14:06:14.766 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:14.767 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:14.767 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.767 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.767 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:14.767 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.767 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:14.767 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:14.767 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:14.767 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.767 INFO:tasks.workunit.client.0.smithi153.stderr: -116> 2024-09-19T14:06:14.422+0000 7ff3ef2219c0 10 monclient: _renew_subs 2024-09-19T14:06:14.767 INFO:tasks.workunit.client.0.smithi153.stderr: -115> 2024-09-19T14:06:14.422+0000 7ff3ef2219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:06:14.767 INFO:tasks.workunit.client.0.smithi153.stderr: -114> 2024-09-19T14:06:14.422+0000 7ff3ef2219c0 1 librados: init done 2024-09-19T14:06:14.767 INFO:tasks.workunit.client.0.smithi153.stderr: -113> 2024-09-19T14:06:14.422+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command cr dump hook 0x55bc7a453b78 2024-09-19T14:06:14.767 INFO:tasks.workunit.client.0.smithi153.stderr: -112> 2024-09-19T14:06:14.422+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.768 INFO:tasks.workunit.client.0.smithi153.stderr: -111> 2024-09-19T14:06:14.422+0000 7ff2c27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:06:14.768 INFO:tasks.workunit.client.0.smithi153.stderr: -110> 2024-09-19T14:06:14.422+0000 7ff2c27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:06:14.768 INFO:tasks.workunit.client.0.smithi153.stderr: -109> 2024-09-19T14:06:14.422+0000 7ff2c27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:06:14.768 INFO:tasks.workunit.client.0.smithi153.stderr: -108> 2024-09-19T14:06:14.422+0000 7ff3ed528640 10 monclient: get_auth_request con 0x55bc7a45f4c0 auth_method 0 2024-09-19T14:06:14.768 INFO:tasks.workunit.client.0.smithi153.stderr: -107> 2024-09-19T14:06:14.422+0000 7ff3ecd27640 10 monclient: get_auth_request con 0x7ff2b8071be0 auth_method 0 2024-09-19T14:06:14.768 INFO:tasks.workunit.client.0.smithi153.stderr: -106> 2024-09-19T14:06:14.422+0000 7ff3ef2219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.768 INFO:tasks.workunit.client.0.smithi153.stderr: -105> 2024-09-19T14:06:14.422+0000 7ff3ef2219c0 20 realm 2024-09-19T14:06:14.768 INFO:tasks.workunit.client.0.smithi153.stderr: -104> 2024-09-19T14:06:14.422+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.768 INFO:tasks.workunit.client.0.smithi153.stderr: -103> 2024-09-19T14:06:14.426+0000 7ff3ef2219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.768 INFO:tasks.workunit.client.0.smithi153.stderr: -102> 2024-09-19T14:06:14.426+0000 7ff3ef2219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:14.768 INFO:tasks.workunit.client.0.smithi153.stderr: -101> 2024-09-19T14:06:14.426+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.768 INFO:tasks.workunit.client.0.smithi153.stderr: -100> 2024-09-19T14:06:14.426+0000 7ff3ef2219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.768 INFO:tasks.workunit.client.0.smithi153.stderr: -99> 2024-09-19T14:06:14.426+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.768 INFO:tasks.workunit.client.0.smithi153.stderr: -98> 2024-09-19T14:06:14.426+0000 7ff3ecd27640 10 monclient: get_auth_request con 0x55bc7a463880 auth_method 0 2024-09-19T14:06:14.768 INFO:tasks.workunit.client.0.smithi153.stderr: -97> 2024-09-19T14:06:14.426+0000 7ff3ef2219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:14.769 INFO:tasks.workunit.client.0.smithi153.stderr: -96> 2024-09-19T14:06:14.426+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.769 INFO:tasks.workunit.client.0.smithi153.stderr: -95> 2024-09-19T14:06:14.426+0000 7ff3ef2219c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:14.769 INFO:tasks.workunit.client.0.smithi153.stderr: -94> 2024-09-19T14:06:14.426+0000 7ff3ef2219c0 20 searching for the correct realm 2024-09-19T14:06:14.769 INFO:tasks.workunit.client.0.smithi153.stderr: -93> 2024-09-19T14:06:14.426+0000 7ff3ec526640 10 monclient: get_auth_request con 0x55bc7a4689e0 auth_method 0 2024-09-19T14:06:14.769 INFO:tasks.workunit.client.0.smithi153.stderr: -92> 2024-09-19T14:06:14.426+0000 7ff3ed528640 10 monclient: get_auth_request con 0x7ff3d4008030 auth_method 0 2024-09-19T14:06:14.769 INFO:tasks.workunit.client.0.smithi153.stderr: -91> 2024-09-19T14:06:14.430+0000 7ff3ecd27640 10 monclient: get_auth_request con 0x7ff3e4023040 auth_method 0 2024-09-19T14:06:14.769 INFO:tasks.workunit.client.0.smithi153.stderr: -90> 2024-09-19T14:06:14.430+0000 7ff3ec526640 10 monclient: get_auth_request con 0x7ff3dc0ab070 auth_method 0 2024-09-19T14:06:14.769 INFO:tasks.workunit.client.0.smithi153.stderr: -89> 2024-09-19T14:06:14.434+0000 7ff3ed528640 0 -- 172.21.15.153:0/1848742116 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7ff3d40692d0 msgr2=0x7ff3d4069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:14.769 INFO:tasks.workunit.client.0.smithi153.stderr: -88> 2024-09-19T14:06:14.638+0000 7ff3ed528640 10 monclient: get_auth_request con 0x7ff3d40692d0 auth_method 0 2024-09-19T14:06:14.769 INFO:tasks.workunit.client.0.smithi153.stderr: -87> 2024-09-19T14:06:14.646+0000 7ff3ecd27640 10 monclient: get_auth_request con 0x7ff3d40724c0 auth_method 0 2024-09-19T14:06:14.769 INFO:tasks.workunit.client.0.smithi153.stderr: -86> 2024-09-19T14:06:14.650+0000 7ff3ecd27640 0 -- 172.21.15.153:0/1848742116 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x55bc7a463880 msgr2=0x55bc7a465c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:14.769 INFO:tasks.workunit.client.0.smithi153.stderr: -85> 2024-09-19T14:06:14.650+0000 7ff2c27fc640 1 client.6339.objecter ms_handle_reset 0x55bc7a463880 session 0x55bc7a462710 osd.5 2024-09-19T14:06:14.770 INFO:tasks.workunit.client.0.smithi153.stderr: -84> 2024-09-19T14:06:14.650+0000 7ff2c27fc640 10 monclient: _renew_subs 2024-09-19T14:06:14.770 INFO:tasks.workunit.client.0.smithi153.stderr: -83> 2024-09-19T14:06:14.650+0000 7ff2c27fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:06:14.770 INFO:tasks.workunit.client.0.smithi153.stderr: -82> 2024-09-19T14:06:14.650+0000 7ff3ecd27640 10 monclient: get_auth_request con 0x7ff2b8082290 auth_method 0 2024-09-19T14:06:14.770 INFO:tasks.workunit.client.0.smithi153.stderr: -81> 2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:14.770 INFO:tasks.workunit.client.0.smithi153.stderr: -80> 2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:14.770 INFO:tasks.workunit.client.0.smithi153.stderr: -79> 2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:14.770 INFO:tasks.workunit.client.0.smithi153.stderr: -78> 2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:14.770 INFO:tasks.workunit.client.0.smithi153.stderr: -77> 2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:14.770 INFO:tasks.workunit.client.0.smithi153.stderr: -76> 2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:14.770 INFO:tasks.workunit.client.0.smithi153.stderr: -75> 2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.770 INFO:tasks.workunit.client.0.smithi153.stderr: -74> 2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.770 INFO:tasks.workunit.client.0.smithi153.stderr: -73> 2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.771 INFO:tasks.workunit.client.0.smithi153.stderr: -72> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:14.771 INFO:tasks.workunit.client.0.smithi153.stderr: -71> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.771 INFO:tasks.workunit.client.0.smithi153.stderr: -70> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:14.771 INFO:tasks.workunit.client.0.smithi153.stderr: -69> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 zone default found 2024-09-19T14:06:14.771 INFO:tasks.workunit.client.0.smithi153.stderr: -68> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 4 Realm: () 2024-09-19T14:06:14.771 INFO:tasks.workunit.client.0.smithi153.stderr: -67> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:14.771 INFO:tasks.workunit.client.0.smithi153.stderr: -66> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:14.771 INFO:tasks.workunit.client.0.smithi153.stderr: -65> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:14.771 INFO:tasks.workunit.client.0.smithi153.stderr: -64> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 zonegroup default 2024-09-19T14:06:14.771 INFO:tasks.workunit.client.0.smithi153.stderr: -63> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.771 INFO:tasks.workunit.client.0.smithi153.stderr: -62> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.771 INFO:tasks.workunit.client.0.smithi153.stderr: -61> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.772 INFO:tasks.workunit.client.0.smithi153.stderr: -60> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.772 INFO:tasks.workunit.client.0.smithi153.stderr: -59> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.772 INFO:tasks.workunit.client.0.smithi153.stderr: -58> 2024-09-19T14:06:14.666+0000 7ff3ef2219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.772 INFO:tasks.workunit.client.0.smithi153.stderr: -57> 2024-09-19T14:06:14.666+0000 7ff3ef2219c0 20 started sync module instance, tier type = 2024-09-19T14:06:14.772 INFO:tasks.workunit.client.0.smithi153.stderr: -56> 2024-09-19T14:06:14.666+0000 7ff3ef2219c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:14.772 INFO:tasks.workunit.client.0.smithi153.stderr: -55> 2024-09-19T14:06:14.686+0000 7ff3ef2219c0 20 add_watcher() i=0 2024-09-19T14:06:14.772 INFO:tasks.workunit.client.0.smithi153.stderr: -54> 2024-09-19T14:06:14.686+0000 7ff3ef2219c0 20 add_watcher() i=1 2024-09-19T14:06:14.772 INFO:tasks.workunit.client.0.smithi153.stderr: -53> 2024-09-19T14:06:14.686+0000 7ff3ef2219c0 20 add_watcher() i=2 2024-09-19T14:06:14.772 INFO:tasks.workunit.client.0.smithi153.stderr: -52> 2024-09-19T14:06:14.686+0000 7ff3ef2219c0 20 add_watcher() i=3 2024-09-19T14:06:14.772 INFO:tasks.workunit.client.0.smithi153.stderr: -51> 2024-09-19T14:06:14.686+0000 7ff3ef2219c0 20 add_watcher() i=4 2024-09-19T14:06:14.772 INFO:tasks.workunit.client.0.smithi153.stderr: -50> 2024-09-19T14:06:14.686+0000 7ff3ef2219c0 20 add_watcher() i=5 2024-09-19T14:06:14.772 INFO:tasks.workunit.client.0.smithi153.stderr: -49> 2024-09-19T14:06:14.686+0000 7ff3ef2219c0 20 add_watcher() i=6 2024-09-19T14:06:14.773 INFO:tasks.workunit.client.0.smithi153.stderr: -48> 2024-09-19T14:06:14.686+0000 7ff3ef2219c0 20 add_watcher() i=7 2024-09-19T14:06:14.773 INFO:tasks.workunit.client.0.smithi153.stderr: -47> 2024-09-19T14:06:14.686+0000 7ff3ef2219c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:14.773 INFO:tasks.workunit.client.0.smithi153.stderr: -46> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding auth protocol: cephx 2024-09-19T14:06:14.773 INFO:tasks.workunit.client.0.smithi153.stderr: -45> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding auth protocol: cephx 2024-09-19T14:06:14.773 INFO:tasks.workunit.client.0.smithi153.stderr: -44> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding auth protocol: cephx 2024-09-19T14:06:14.773 INFO:tasks.workunit.client.0.smithi153.stderr: -43> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding con mode: secure 2024-09-19T14:06:14.773 INFO:tasks.workunit.client.0.smithi153.stderr: -42> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding con mode: crc 2024-09-19T14:06:14.773 INFO:tasks.workunit.client.0.smithi153.stderr: -41> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding con mode: secure 2024-09-19T14:06:14.774 INFO:tasks.workunit.client.0.smithi153.stderr: -40> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding con mode: crc 2024-09-19T14:06:14.774 INFO:tasks.workunit.client.0.smithi153.stderr: -39> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding con mode: secure 2024-09-19T14:06:14.774 INFO:tasks.workunit.client.0.smithi153.stderr: -38> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding con mode: crc 2024-09-19T14:06:14.774 INFO:tasks.workunit.client.0.smithi153.stderr: -37> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding con mode: crc 2024-09-19T14:06:14.774 INFO:tasks.workunit.client.0.smithi153.stderr: -36> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding con mode: secure 2024-09-19T14:06:14.774 INFO:tasks.workunit.client.0.smithi153.stderr: -35> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding con mode: crc 2024-09-19T14:06:14.774 INFO:tasks.workunit.client.0.smithi153.stderr: -34> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding con mode: secure 2024-09-19T14:06:14.774 INFO:tasks.workunit.client.0.smithi153.stderr: -33> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding con mode: crc 2024-09-19T14:06:14.774 INFO:tasks.workunit.client.0.smithi153.stderr: -32> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding con mode: secure 2024-09-19T14:06:14.774 INFO:tasks.workunit.client.0.smithi153.stderr: -31> 2024-09-19T14:06:14.690+0000 7ff2a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:14.774 INFO:tasks.workunit.client.0.smithi153.stderr: -30> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.774 INFO:tasks.workunit.client.0.smithi153.stderr: -29> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:14.774 INFO:tasks.workunit.client.0.smithi153.stderr: -28> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:14.775 INFO:tasks.workunit.client.0.smithi153.stderr: -27> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command cache list hook 0x55bc7a453270 2024-09-19T14:06:14.775 INFO:tasks.workunit.client.0.smithi153.stderr: -26> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command cache inspect hook 0x55bc7a453270 2024-09-19T14:06:14.775 INFO:tasks.workunit.client.0.smithi153.stderr: -25> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command cache erase hook 0x55bc7a453270 2024-09-19T14:06:14.775 INFO:tasks.workunit.client.0.smithi153.stderr: -24> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command cache zap hook 0x55bc7a453270 2024-09-19T14:06:14.775 INFO:tasks.workunit.client.0.smithi153.stderr: -23> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 note: GC not initialized 2024-09-19T14:06:14.775 INFO:tasks.workunit.client.0.smithi153.stderr: -22> 2024-09-19T14:06:14.690+0000 7ff2a27e4640 20 reqs_thread_entry: start 2024-09-19T14:06:14.775 INFO:tasks.workunit.client.0.smithi153.stderr: -21> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command sync trace show hook 0x7ff3d400e070 2024-09-19T14:06:14.775 INFO:tasks.workunit.client.0.smithi153.stderr: -20> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command sync trace history hook 0x7ff3d400e070 2024-09-19T14:06:14.775 INFO:tasks.workunit.client.0.smithi153.stderr: -19> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command sync trace active hook 0x7ff3d400e070 2024-09-19T14:06:14.775 INFO:tasks.workunit.client.0.smithi153.stderr: -18> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command sync trace active_short hook 0x7ff3d400e070 2024-09-19T14:06:14.775 INFO:tasks.workunit.client.0.smithi153.stderr: -17> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:14.775 INFO:tasks.workunit.client.0.smithi153.stderr: -16> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 20 Filter name: none 2024-09-19T14:06:14.775 INFO:tasks.workunit.client.0.smithi153.stderr: -15> 2024-09-19T14:06:14.694+0000 7ff29b7fe640 20 reqs_thread_entry: start 2024-09-19T14:06:14.776 INFO:tasks.workunit.client.0.smithi153.stderr: -14> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-19T14:06:14.776 INFO:tasks.workunit.client.0.smithi153.stderr: -13> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.776 INFO:tasks.workunit.client.0.smithi153.stderr: -12> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-19T14:06:14.776 INFO:tasks.workunit.client.0.smithi153.stderr: -11> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-19T14:06:14.776 INFO:tasks.workunit.client.0.smithi153.stderr: -10> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-19T14:06:14.776 INFO:tasks.workunit.client.0.smithi153.stderr: -9> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 : miss 2024-09-19T14:06:14.776 INFO:tasks.workunit.client.0.smithi153.stderr: -8> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.776 INFO:tasks.workunit.client.0.smithi153.stderr: -7> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-19T14:06:14.776 INFO:tasks.workunit.client.0.smithi153.stderr: -6> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 info.flags=0x17 2024-09-19T14:06:14.776 INFO:tasks.workunit.client.0.smithi153.stderr: -5> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 to cache LRU end 2024-09-19T14:06:14.776 INFO:tasks.workunit.client.0.smithi153.stderr: -4> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:06:14.777 INFO:tasks.workunit.client.0.smithi153.stderr: -3> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:14.777 INFO:tasks.workunit.client.0.smithi153.stderr: -2> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 2024-09-19T14:06:14.777 INFO:tasks.workunit.client.0.smithi153.stderr: -1> 2024-09-19T14:06:14.698+0000 7ff3ef2219c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff3ef2219c0 time 2024-09-19T14:06:14.699395+0000 2024-09-19T14:06:14.777 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:06:14.777 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.777 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:06:14.777 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff3f2afb2eb] 2024-09-19T14:06:14.777 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff3f2afb49f] 2024-09-19T14:06:14.777 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc77a2d271] 2024-09-19T14:06:14.777 INFO:tasks.workunit.client.0.smithi153.stderr: 4: radosgw-admin(+0x140fa02) [0x55bc7847da02] 2024-09-19T14:06:14.777 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bc77a3d0dd] 2024-09-19T14:06:14.778 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:06:14.778 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff3f1961d90] 2024-09-19T14:06:14.778 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:06:14.778 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:06:14.778 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.778 INFO:tasks.workunit.client.0.smithi153.stderr: 0> 2024-09-19T14:06:14.698+0000 7ff3ef2219c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:06:14.778 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7ff3ef2219c0 thread_name:radosgw-admin 2024-09-19T14:06:14.778 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.778 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:06:14.778 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff3f197a520] 2024-09-19T14:06:14.778 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:06:14.778 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:06:14.778 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:06:14.778 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff3f2afb345] 2024-09-19T14:06:14.778 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff3f2afb49f] 2024-09-19T14:06:14.779 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc77a2d271] 2024-09-19T14:06:14.779 INFO:tasks.workunit.client.0.smithi153.stderr: 8: radosgw-admin(+0x140fa02) [0x55bc7847da02] 2024-09-19T14:06:14.779 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bc77a3d0dd] 2024-09-19T14:06:14.779 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:06:14.779 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff3f1961d90] 2024-09-19T14:06:14.779 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:06:14.779 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:06:14.779 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:06:14.779 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.779 INFO:tasks.workunit.client.0.smithi153.stderr:--- logging levels --- 2024-09-19T14:06:14.779 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 none 2024-09-19T14:06:14.779 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 lockdep 2024-09-19T14:06:14.779 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 context 2024-09-19T14:06:14.779 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 crush 2024-09-19T14:06:14.780 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds 2024-09-19T14:06:14.780 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_balancer 2024-09-19T14:06:14.780 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_locker 2024-09-19T14:06:14.780 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log 2024-09-19T14:06:14.780 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log_expire 2024-09-19T14:06:14.780 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_migrator 2024-09-19T14:06:14.780 INFO:tasks.workunit.client.0.smithi153.stderr: 3/ 5 mds_quiesce 2024-09-19T14:06:14.780 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 buffer 2024-09-19T14:06:14.780 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 timer 2024-09-19T14:06:14.780 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 filer 2024-09-19T14:06:14.780 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 striper 2024-09-19T14:06:14.780 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 objecter 2024-09-19T14:06:14.780 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rados 2024-09-19T14:06:14.780 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd 2024-09-19T14:06:14.781 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_mirror 2024-09-19T14:06:14.781 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_replay 2024-09-19T14:06:14.781 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_pwl 2024-09-19T14:06:14.781 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 journaler 2024-09-19T14:06:14.781 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objectcacher 2024-09-19T14:06:14.781 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:06:14.781 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 client 2024-09-19T14:06:14.781 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 osd 2024-09-19T14:06:14.781 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 optracker 2024-09-19T14:06:14.781 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objclass 2024-09-19T14:06:14.781 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 filestore 2024-09-19T14:06:14.781 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 journal 2024-09-19T14:06:14.781 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 ms 2024-09-19T14:06:14.781 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mon 2024-09-19T14:06:14.782 INFO:tasks.workunit.client.0.smithi153.stderr: 0/10 monc 2024-09-19T14:06:14.782 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 paxos 2024-09-19T14:06:14.782 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 tp 2024-09-19T14:06:14.782 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 auth 2024-09-19T14:06:14.782 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 crypto 2024-09-19T14:06:14.782 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 finisher 2024-09-19T14:06:14.782 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 reserver 2024-09-19T14:06:14.782 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 heartbeatmap 2024-09-19T14:06:14.782 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 perfcounter 2024-09-19T14:06:14.782 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw 2024-09-19T14:06:14.782 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_sync 2024-09-19T14:06:14.782 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_datacache 2024-09-19T14:06:14.782 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_access 2024-09-19T14:06:14.782 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:06:14.782 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_flight 2024-09-19T14:06:14.782 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:06:14.783 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw_notification 2024-09-19T14:06:14.783 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 javaclient 2024-09-19T14:06:14.783 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 asok 2024-09-19T14:06:14.783 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 throttle 2024-09-19T14:06:14.783 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 refs 2024-09-19T14:06:14.783 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 compressor 2024-09-19T14:06:14.783 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluestore 2024-09-19T14:06:14.783 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluefs 2024-09-19T14:06:14.783 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 bdev 2024-09-19T14:06:14.783 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 kstore 2024-09-19T14:06:14.783 INFO:tasks.workunit.client.0.smithi153.stderr: 4/ 5 rocksdb 2024-09-19T14:06:14.783 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 fuse 2024-09-19T14:06:14.783 INFO:tasks.workunit.client.0.smithi153.stderr: 2/ 5 mgr 2024-09-19T14:06:14.784 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mgrc 2024-09-19T14:06:14.784 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 dpdk 2024-09-19T14:06:14.784 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 eventtrace 2024-09-19T14:06:14.784 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 prioritycache 2024-09-19T14:06:14.784 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 test 2024-09-19T14:06:14.784 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:06:14.784 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephsqlite 2024-09-19T14:06:14.784 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:06:14.784 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore 2024-09-19T14:06:14.784 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_onode 2024-09-19T14:06:14.784 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_odata 2024-09-19T14:06:14.784 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_omap 2024-09-19T14:06:14.784 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_tm 2024-09-19T14:06:14.784 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_t 2024-09-19T14:06:14.784 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:06:14.785 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_epm 2024-09-19T14:06:14.785 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_lba 2024-09-19T14:06:14.785 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:06:14.785 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cache 2024-09-19T14:06:14.785 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_journal 2024-09-19T14:06:14.785 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_device 2024-09-19T14:06:14.785 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_backref 2024-09-19T14:06:14.785 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 alienstore 2024-09-19T14:06:14.785 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mclock 2024-09-19T14:06:14.785 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cyanstore 2024-09-19T14:06:14.785 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 ceph_exporter 2024-09-19T14:06:14.785 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 memstore 2024-09-19T14:06:14.785 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 trace 2024-09-19T14:06:14.785 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 ceph_dedup 2024-09-19T14:06:14.786 INFO:tasks.workunit.client.0.smithi153.stderr: -2/-2 (syslog threshold) 2024-09-19T14:06:14.786 INFO:tasks.workunit.client.0.smithi153.stderr: 99/99 (stderr threshold) 2024-09-19T14:06:14.786 INFO:tasks.workunit.client.0.smithi153.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:06:14.786 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff29b7fe640 / http_manager 2024-09-19T14:06:14.786 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff2a27e4640 / http_manager 2024-09-19T14:06:14.786 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff2a37e6640 / rgw_dt_lg_renew 2024-09-19T14:06:14.786 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff2c27fc640 / ms_dispatch 2024-09-19T14:06:14.786 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff2c3fff640 / io_context_pool 2024-09-19T14:06:14.786 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff2d27fc640 / ms_dispatch 2024-09-19T14:06:14.786 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff2d960a640 / ms_dispatch 2024-09-19T14:06:14.786 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff2dae0d640 / io_context_pool 2024-09-19T14:06:14.786 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff3ec526640 / msgr-worker-2 2024-09-19T14:06:14.786 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff3ecd27640 / msgr-worker-1 2024-09-19T14:06:14.786 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff3ed528640 / msgr-worker-0 2024-09-19T14:06:14.786 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff3edd29640 / io_context_pool 2024-09-19T14:06:14.787 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff3ef2219c0 / radosgw-admin 2024-09-19T14:06:14.787 INFO:tasks.workunit.client.0.smithi153.stderr: max_recent 500 2024-09-19T14:06:14.787 INFO:tasks.workunit.client.0.smithi153.stderr: max_new 1000 2024-09-19T14:06:14.787 INFO:tasks.workunit.client.0.smithi153.stderr: log_file /var/log/ceph/ceph-client.admin.82742.log 2024-09-19T14:06:14.787 INFO:tasks.workunit.client.0.smithi153.stderr:--- end dump of recent events --- 2024-09-19T14:06:14.787 INFO:tasks.workunit.client.0.smithi153.stderr:--- begin dump of recent events --- 2024-09-19T14:06:14.787 INFO:tasks.workunit.client.0.smithi153.stderr: -499> 2024-09-19T14:06:14.398+0000 7ff3ecd27640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:14.787 INFO:tasks.workunit.client.0.smithi153.stderr: -498> 2024-09-19T14:06:14.398+0000 7ff3ecd27640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:14.787 INFO:tasks.workunit.client.0.smithi153.stderr: -497> 2024-09-19T14:06:14.398+0000 7ff3ecd27640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:14.787 INFO:tasks.workunit.client.0.smithi153.stderr: -496> 2024-09-19T14:06:14.398+0000 7ff3ec526640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:14.787 INFO:tasks.workunit.client.0.smithi153.stderr: -495> 2024-09-19T14:06:14.398+0000 7ff3ec526640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:14.787 INFO:tasks.workunit.client.0.smithi153.stderr: -494> 2024-09-19T14:06:14.398+0000 7ff3ec526640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:14.787 INFO:tasks.workunit.client.0.smithi153.stderr: -493> 2024-09-19T14:06:14.398+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:14.787 INFO:tasks.workunit.client.0.smithi153.stderr: -492> 2024-09-19T14:06:14.398+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:14.787 INFO:tasks.workunit.client.0.smithi153.stderr: -491> 2024-09-19T14:06:14.398+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:14.788 INFO:tasks.workunit.client.0.smithi153.stderr: -490> 2024-09-19T14:06:14.402+0000 7ff3ed528640 10 monclient(hunting): get_auth_request con 0x55bc7a3788c0 auth_method 0 2024-09-19T14:06:14.788 INFO:tasks.workunit.client.0.smithi153.stderr: -489> 2024-09-19T14:06:14.402+0000 7ff3ed528640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:14.788 INFO:tasks.workunit.client.0.smithi153.stderr: -488> 2024-09-19T14:06:14.402+0000 7ff3ed528640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:14.788 INFO:tasks.workunit.client.0.smithi153.stderr: -487> 2024-09-19T14:06:14.402+0000 7ff3ed528640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:14.788 INFO:tasks.workunit.client.0.smithi153.stderr: -486> 2024-09-19T14:06:14.402+0000 7ff3ec526640 10 monclient(hunting): handle_auth_done global_id 5948 payload 274 2024-09-19T14:06:14.788 INFO:tasks.workunit.client.0.smithi153.stderr: -485> 2024-09-19T14:06:14.402+0000 7ff3ec526640 10 monclient: _finish_hunting 0 2024-09-19T14:06:14.788 INFO:tasks.workunit.client.0.smithi153.stderr: -484> 2024-09-19T14:06:14.402+0000 7ff3ec526640 1 monclient: found mon.noname-c 2024-09-19T14:06:14.788 INFO:tasks.workunit.client.0.smithi153.stderr: -483> 2024-09-19T14:06:14.402+0000 7ff3ec526640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:06:14.788 INFO:tasks.workunit.client.0.smithi153.stderr: -482> 2024-09-19T14:06:14.402+0000 7ff2dae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:14.788 INFO:tasks.workunit.client.0.smithi153.stderr: -481> 2024-09-19T14:06:14.402+0000 7ff2dae0d640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:06:14.788 INFO:tasks.workunit.client.0.smithi153.stderr: -480> 2024-09-19T14:06:14.402+0000 7ff2dae0d640 10 monclient: dump: 2024-09-19T14:06:14.788 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:14.788 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:14.788 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.788 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.789 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:14.789 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.789 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:14.789 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:14.789 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:14.789 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.789 INFO:tasks.workunit.client.0.smithi153.stderr: -479> 2024-09-19T14:06:14.402+0000 7ff2dae0d640 10 monclient: _finish_auth 0 2024-09-19T14:06:14.789 INFO:tasks.workunit.client.0.smithi153.stderr: -478> 2024-09-19T14:06:14.402+0000 7ff2dae0d640 10 monclient: _check_auth_tickets 2024-09-19T14:06:14.789 INFO:tasks.workunit.client.0.smithi153.stderr: -477> 2024-09-19T14:06:14.402+0000 7ff2dae0d640 10 monclient: handle_config config(0 keys) 2024-09-19T14:06:14.789 INFO:tasks.workunit.client.0.smithi153.stderr: -476> 2024-09-19T14:06:14.402+0000 7ff2dae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:14.790 INFO:tasks.workunit.client.0.smithi153.stderr: -475> 2024-09-19T14:06:14.402+0000 7ff2dae0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:06:14.790 INFO:tasks.workunit.client.0.smithi153.stderr: -474> 2024-09-19T14:06:14.402+0000 7ff2dae0d640 10 monclient: dump: 2024-09-19T14:06:14.790 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:14.790 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:14.790 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.790 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.790 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:14.790 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.790 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:14.790 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:14.790 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:14.790 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.790 INFO:tasks.workunit.client.0.smithi153.stderr: -473> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 monclient: authenticate success, global_id 5948 2024-09-19T14:06:14.790 INFO:tasks.workunit.client.0.smithi153.stderr: -472> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient: get_monmap_and_config success 2024-09-19T14:06:14.791 INFO:tasks.workunit.client.0.smithi153.stderr: -471> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 4 set_mon_vals no callback set 2024-09-19T14:06:14.791 INFO:tasks.workunit.client.0.smithi153.stderr: -470> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient: shutdown 2024-09-19T14:06:14.791 INFO:tasks.workunit.client.0.smithi153.stderr: -469> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) unregister_commands rotate-key 2024-09-19T14:06:14.791 INFO:tasks.workunit.client.0.smithi153.stderr: -468> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient: build_initial_monmap 2024-09-19T14:06:14.791 INFO:tasks.workunit.client.0.smithi153.stderr: -467> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 1 build_initial for_mkfs: 0 2024-09-19T14:06:14.791 INFO:tasks.workunit.client.0.smithi153.stderr: -466> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient: monmap: 2024-09-19T14:06:14.791 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:06:14.791 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:06:14.791 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:06:14.791 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:06:14.791 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:06:14.791 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.791 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:06:14.791 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:06:14.792 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:06:14.792 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.792 INFO:tasks.workunit.client.0.smithi153.stderr: -465> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding auth protocol: cephx 2024-09-19T14:06:14.792 INFO:tasks.workunit.client.0.smithi153.stderr: -464> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding auth protocol: cephx 2024-09-19T14:06:14.792 INFO:tasks.workunit.client.0.smithi153.stderr: -463> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding auth protocol: cephx 2024-09-19T14:06:14.792 INFO:tasks.workunit.client.0.smithi153.stderr: -462> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding con mode: secure 2024-09-19T14:06:14.792 INFO:tasks.workunit.client.0.smithi153.stderr: -461> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding con mode: crc 2024-09-19T14:06:14.792 INFO:tasks.workunit.client.0.smithi153.stderr: -460> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding con mode: secure 2024-09-19T14:06:14.792 INFO:tasks.workunit.client.0.smithi153.stderr: -459> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding con mode: crc 2024-09-19T14:06:14.792 INFO:tasks.workunit.client.0.smithi153.stderr: -458> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding con mode: secure 2024-09-19T14:06:14.792 INFO:tasks.workunit.client.0.smithi153.stderr: -457> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding con mode: crc 2024-09-19T14:06:14.792 INFO:tasks.workunit.client.0.smithi153.stderr: -456> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding con mode: crc 2024-09-19T14:06:14.792 INFO:tasks.workunit.client.0.smithi153.stderr: -455> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding con mode: secure 2024-09-19T14:06:14.792 INFO:tasks.workunit.client.0.smithi153.stderr: -454> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding con mode: crc 2024-09-19T14:06:14.793 INFO:tasks.workunit.client.0.smithi153.stderr: -453> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding con mode: secure 2024-09-19T14:06:14.793 INFO:tasks.workunit.client.0.smithi153.stderr: -452> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding con mode: crc 2024-09-19T14:06:14.793 INFO:tasks.workunit.client.0.smithi153.stderr: -451> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a379a60) adding con mode: secure 2024-09-19T14:06:14.793 INFO:tasks.workunit.client.0.smithi153.stderr: -450> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.793 INFO:tasks.workunit.client.0.smithi153.stderr: -449> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 1 librados: starting msgr at 2024-09-19T14:06:14.793 INFO:tasks.workunit.client.0.smithi153.stderr: -448> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 1 librados: starting objecter 2024-09-19T14:06:14.793 INFO:tasks.workunit.client.0.smithi153.stderr: -447> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command objecter_requests hook 0x55bc7a375bb0 2024-09-19T14:06:14.793 INFO:tasks.workunit.client.0.smithi153.stderr: -446> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 1 librados: setting wanted keys 2024-09-19T14:06:14.793 INFO:tasks.workunit.client.0.smithi153.stderr: -445> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 1 librados: calling monclient init 2024-09-19T14:06:14.793 INFO:tasks.workunit.client.0.smithi153.stderr: -444> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient: init 2024-09-19T14:06:14.793 INFO:tasks.workunit.client.0.smithi153.stderr: -443> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding auth protocol: cephx 2024-09-19T14:06:14.793 INFO:tasks.workunit.client.0.smithi153.stderr: -442> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding auth protocol: cephx 2024-09-19T14:06:14.793 INFO:tasks.workunit.client.0.smithi153.stderr: -441> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding auth protocol: cephx 2024-09-19T14:06:14.793 INFO:tasks.workunit.client.0.smithi153.stderr: -440> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding con mode: secure 2024-09-19T14:06:14.794 INFO:tasks.workunit.client.0.smithi153.stderr: -439> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding con mode: crc 2024-09-19T14:06:14.794 INFO:tasks.workunit.client.0.smithi153.stderr: -438> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding con mode: secure 2024-09-19T14:06:14.794 INFO:tasks.workunit.client.0.smithi153.stderr: -437> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding con mode: crc 2024-09-19T14:06:14.794 INFO:tasks.workunit.client.0.smithi153.stderr: -436> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding con mode: secure 2024-09-19T14:06:14.794 INFO:tasks.workunit.client.0.smithi153.stderr: -435> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding con mode: crc 2024-09-19T14:06:14.794 INFO:tasks.workunit.client.0.smithi153.stderr: -434> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding con mode: crc 2024-09-19T14:06:14.794 INFO:tasks.workunit.client.0.smithi153.stderr: -433> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding con mode: secure 2024-09-19T14:06:14.794 INFO:tasks.workunit.client.0.smithi153.stderr: -432> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding con mode: crc 2024-09-19T14:06:14.794 INFO:tasks.workunit.client.0.smithi153.stderr: -431> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding con mode: secure 2024-09-19T14:06:14.794 INFO:tasks.workunit.client.0.smithi153.stderr: -430> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding con mode: crc 2024-09-19T14:06:14.794 INFO:tasks.workunit.client.0.smithi153.stderr: -429> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a374420) adding con mode: secure 2024-09-19T14:06:14.794 INFO:tasks.workunit.client.0.smithi153.stderr: -428> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.794 INFO:tasks.workunit.client.0.smithi153.stderr: -427> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.794 INFO:tasks.workunit.client.0.smithi153.stderr: -426> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command rotate-key hook 0x55bc7a374568 2024-09-19T14:06:14.795 INFO:tasks.workunit.client.0.smithi153.stderr: -425> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient: _reopen_session rank -1 2024-09-19T14:06:14.795 INFO:tasks.workunit.client.0.smithi153.stderr: -424> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T14:06:14.795 INFO:tasks.workunit.client.0.smithi153.stderr: -423> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient(hunting): picked mon.noname-a con 0x55bc7a201410 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:06:14.795 INFO:tasks.workunit.client.0.smithi153.stderr: -422> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient(hunting): picked mon.noname-b con 0x55bc7a2020f0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:06:14.795 INFO:tasks.workunit.client.0.smithi153.stderr: -421> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient(hunting): picked mon.noname-c con 0x55bc7a3788c0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:06:14.795 INFO:tasks.workunit.client.0.smithi153.stderr: -420> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:14.795 INFO:tasks.workunit.client.0.smithi153.stderr: -419> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:14.795 INFO:tasks.workunit.client.0.smithi153.stderr: -418> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:14.795 INFO:tasks.workunit.client.0.smithi153.stderr: -417> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient(hunting): _renew_subs 2024-09-19T14:06:14.795 INFO:tasks.workunit.client.0.smithi153.stderr: -416> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient(hunting): authenticate will time out at 2562.866724s 2024-09-19T14:06:14.795 INFO:tasks.workunit.client.0.smithi153.stderr: -415> 2024-09-19T14:06:14.402+0000 7ff3ecd27640 10 monclient(hunting): get_auth_request con 0x55bc7a201410 auth_method 0 2024-09-19T14:06:14.795 INFO:tasks.workunit.client.0.smithi153.stderr: -414> 2024-09-19T14:06:14.402+0000 7ff3ecd27640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:14.795 INFO:tasks.workunit.client.0.smithi153.stderr: -413> 2024-09-19T14:06:14.402+0000 7ff3ecd27640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:14.795 INFO:tasks.workunit.client.0.smithi153.stderr: -412> 2024-09-19T14:06:14.402+0000 7ff3ecd27640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:14.796 INFO:tasks.workunit.client.0.smithi153.stderr: -411> 2024-09-19T14:06:14.402+0000 7ff3ed528640 10 monclient(hunting): get_auth_request con 0x55bc7a3788c0 auth_method 0 2024-09-19T14:06:14.796 INFO:tasks.workunit.client.0.smithi153.stderr: -410> 2024-09-19T14:06:14.402+0000 7ff3ed528640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:14.796 INFO:tasks.workunit.client.0.smithi153.stderr: -409> 2024-09-19T14:06:14.402+0000 7ff3ed528640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:14.796 INFO:tasks.workunit.client.0.smithi153.stderr: -408> 2024-09-19T14:06:14.402+0000 7ff3ed528640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:14.796 INFO:tasks.workunit.client.0.smithi153.stderr: -407> 2024-09-19T14:06:14.402+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:14.796 INFO:tasks.workunit.client.0.smithi153.stderr: -406> 2024-09-19T14:06:14.402+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:14.796 INFO:tasks.workunit.client.0.smithi153.stderr: -405> 2024-09-19T14:06:14.402+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:14.796 INFO:tasks.workunit.client.0.smithi153.stderr: -404> 2024-09-19T14:06:14.402+0000 7ff3ed528640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:14.796 INFO:tasks.workunit.client.0.smithi153.stderr: -403> 2024-09-19T14:06:14.402+0000 7ff3ed528640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:14.796 INFO:tasks.workunit.client.0.smithi153.stderr: -402> 2024-09-19T14:06:14.402+0000 7ff3ed528640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:14.796 INFO:tasks.workunit.client.0.smithi153.stderr: -401> 2024-09-19T14:06:14.402+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_done global_id 6330 payload 824 2024-09-19T14:06:14.796 INFO:tasks.workunit.client.0.smithi153.stderr: -400> 2024-09-19T14:06:14.402+0000 7ff3ecd27640 10 monclient: _finish_hunting 0 2024-09-19T14:06:14.796 INFO:tasks.workunit.client.0.smithi153.stderr: -399> 2024-09-19T14:06:14.402+0000 7ff3ecd27640 1 monclient: found mon.noname-a 2024-09-19T14:06:14.796 INFO:tasks.workunit.client.0.smithi153.stderr: -398> 2024-09-19T14:06:14.402+0000 7ff3ecd27640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:06:14.797 INFO:tasks.workunit.client.0.smithi153.stderr: -397> 2024-09-19T14:06:14.402+0000 7ff2d960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:14.797 INFO:tasks.workunit.client.0.smithi153.stderr: -396> 2024-09-19T14:06:14.402+0000 7ff2d960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:06:14.797 INFO:tasks.workunit.client.0.smithi153.stderr: -395> 2024-09-19T14:06:14.402+0000 7ff2d960a640 10 monclient: dump: 2024-09-19T14:06:14.797 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:14.797 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:14.797 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.797 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.797 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:14.797 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.797 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:14.797 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:14.797 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:14.797 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.798 INFO:tasks.workunit.client.0.smithi153.stderr: -394> 2024-09-19T14:06:14.402+0000 7ff2d960a640 10 monclient: _finish_auth 0 2024-09-19T14:06:14.798 INFO:tasks.workunit.client.0.smithi153.stderr: -393> 2024-09-19T14:06:14.402+0000 7ff2d960a640 10 monclient: _check_auth_tickets 2024-09-19T14:06:14.798 INFO:tasks.workunit.client.0.smithi153.stderr: -392> 2024-09-19T14:06:14.402+0000 7ff2d960a640 10 monclient: handle_config config(0 keys) 2024-09-19T14:06:14.798 INFO:tasks.workunit.client.0.smithi153.stderr: -391> 2024-09-19T14:06:14.402+0000 7ff2d960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:14.798 INFO:tasks.workunit.client.0.smithi153.stderr: -390> 2024-09-19T14:06:14.402+0000 7ff2d960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:06:14.798 INFO:tasks.workunit.client.0.smithi153.stderr: -389> 2024-09-19T14:06:14.402+0000 7ff2d960a640 10 monclient: dump: 2024-09-19T14:06:14.798 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:14.798 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:14.798 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.798 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.798 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:14.798 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.798 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:14.798 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:14.799 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:14.799 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.799 INFO:tasks.workunit.client.0.smithi153.stderr: -388> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 5 monclient: authenticate success, global_id 6330 2024-09-19T14:06:14.799 INFO:tasks.workunit.client.0.smithi153.stderr: -387> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient: _renew_subs 2024-09-19T14:06:14.799 INFO:tasks.workunit.client.0.smithi153.stderr: -386> 2024-09-19T14:06:14.402+0000 7ff2dae0d640 4 set_mon_vals no callback set 2024-09-19T14:06:14.799 INFO:tasks.workunit.client.0.smithi153.stderr: -385> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:06:14.799 INFO:tasks.workunit.client.0.smithi153.stderr: -384> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient: _renew_subs 2024-09-19T14:06:14.799 INFO:tasks.workunit.client.0.smithi153.stderr: -383> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:06:14.799 INFO:tasks.workunit.client.0.smithi153.stderr: -382> 2024-09-19T14:06:14.402+0000 7ff3ef2219c0 1 librados: init done 2024-09-19T14:06:14.799 INFO:tasks.workunit.client.0.smithi153.stderr: -381> 2024-09-19T14:06:14.406+0000 7ff2d960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:06:14.799 INFO:tasks.workunit.client.0.smithi153.stderr: -380> 2024-09-19T14:06:14.406+0000 7ff2d960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:06:14.799 INFO:tasks.workunit.client.0.smithi153.stderr: -379> 2024-09-19T14:06:14.406+0000 7ff2d960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:06:14.799 INFO:tasks.workunit.client.0.smithi153.stderr: -378> 2024-09-19T14:06:14.406+0000 7ff3ec526640 10 monclient: get_auth_request con 0x7ff2d4071be0 auth_method 0 2024-09-19T14:06:14.799 INFO:tasks.workunit.client.0.smithi153.stderr: -377> 2024-09-19T14:06:14.406+0000 7ff3ed528640 10 monclient: get_auth_request con 0x55bc7a3bc5a0 auth_method 0 2024-09-19T14:06:14.800 INFO:tasks.workunit.client.0.smithi153.stderr: -376> 2024-09-19T14:06:14.406+0000 7ff3ecd27640 10 monclient: get_auth_request con 0x55bc7a3bf780 auth_method 0 2024-09-19T14:06:14.800 INFO:tasks.workunit.client.0.smithi153.stderr: -375> 2024-09-19T14:06:14.410+0000 7ff3ec526640 10 monclient: get_auth_request con 0x55bc7a3c4810 auth_method 0 2024-09-19T14:06:14.800 INFO:tasks.workunit.client.0.smithi153.stderr: -374> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 10 monclient: build_initial_monmap 2024-09-19T14:06:14.800 INFO:tasks.workunit.client.0.smithi153.stderr: -373> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 1 build_initial for_mkfs: 0 2024-09-19T14:06:14.800 INFO:tasks.workunit.client.0.smithi153.stderr: -372> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 10 monclient: monmap: 2024-09-19T14:06:14.800 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:06:14.800 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:06:14.800 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:06:14.800 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:06:14.800 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:06:14.800 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.800 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:06:14.800 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:06:14.800 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:06:14.801 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.801 INFO:tasks.workunit.client.0.smithi153.stderr: -371> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding auth protocol: cephx 2024-09-19T14:06:14.801 INFO:tasks.workunit.client.0.smithi153.stderr: -370> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding auth protocol: cephx 2024-09-19T14:06:14.801 INFO:tasks.workunit.client.0.smithi153.stderr: -369> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding auth protocol: cephx 2024-09-19T14:06:14.801 INFO:tasks.workunit.client.0.smithi153.stderr: -368> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding con mode: secure 2024-09-19T14:06:14.801 INFO:tasks.workunit.client.0.smithi153.stderr: -367> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding con mode: crc 2024-09-19T14:06:14.801 INFO:tasks.workunit.client.0.smithi153.stderr: -366> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding con mode: secure 2024-09-19T14:06:14.801 INFO:tasks.workunit.client.0.smithi153.stderr: -365> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding con mode: crc 2024-09-19T14:06:14.801 INFO:tasks.workunit.client.0.smithi153.stderr: -364> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding con mode: secure 2024-09-19T14:06:14.801 INFO:tasks.workunit.client.0.smithi153.stderr: -363> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding con mode: crc 2024-09-19T14:06:14.801 INFO:tasks.workunit.client.0.smithi153.stderr: -362> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding con mode: crc 2024-09-19T14:06:14.801 INFO:tasks.workunit.client.0.smithi153.stderr: -361> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding con mode: secure 2024-09-19T14:06:14.801 INFO:tasks.workunit.client.0.smithi153.stderr: -360> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding con mode: crc 2024-09-19T14:06:14.802 INFO:tasks.workunit.client.0.smithi153.stderr: -359> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding con mode: secure 2024-09-19T14:06:14.802 INFO:tasks.workunit.client.0.smithi153.stderr: -358> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding con mode: crc 2024-09-19T14:06:14.802 INFO:tasks.workunit.client.0.smithi153.stderr: -357> 2024-09-19T14:06:14.410+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c84b0) adding con mode: secure 2024-09-19T14:06:14.802 INFO:tasks.workunit.client.0.smithi153.stderr: -356> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.802 INFO:tasks.workunit.client.0.smithi153.stderr: -355> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command objecter_requests cmddesc objecter_requests hook 0x55bc7a3cbea0 EEXIST 2024-09-19T14:06:14.802 INFO:tasks.workunit.client.0.smithi153.stderr: -354> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient: init 2024-09-19T14:06:14.802 INFO:tasks.workunit.client.0.smithi153.stderr: -353> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding auth protocol: cephx 2024-09-19T14:06:14.802 INFO:tasks.workunit.client.0.smithi153.stderr: -352> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding auth protocol: cephx 2024-09-19T14:06:14.802 INFO:tasks.workunit.client.0.smithi153.stderr: -351> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding auth protocol: cephx 2024-09-19T14:06:14.802 INFO:tasks.workunit.client.0.smithi153.stderr: -350> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding con mode: secure 2024-09-19T14:06:14.802 INFO:tasks.workunit.client.0.smithi153.stderr: -349> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding con mode: crc 2024-09-19T14:06:14.802 INFO:tasks.workunit.client.0.smithi153.stderr: -348> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding con mode: secure 2024-09-19T14:06:14.802 INFO:tasks.workunit.client.0.smithi153.stderr: -347> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding con mode: crc 2024-09-19T14:06:14.802 INFO:tasks.workunit.client.0.smithi153.stderr: -346> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding con mode: secure 2024-09-19T14:06:14.803 INFO:tasks.workunit.client.0.smithi153.stderr: -345> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding con mode: crc 2024-09-19T14:06:14.803 INFO:tasks.workunit.client.0.smithi153.stderr: -344> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding con mode: crc 2024-09-19T14:06:14.803 INFO:tasks.workunit.client.0.smithi153.stderr: -343> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding con mode: secure 2024-09-19T14:06:14.803 INFO:tasks.workunit.client.0.smithi153.stderr: -342> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding con mode: crc 2024-09-19T14:06:14.803 INFO:tasks.workunit.client.0.smithi153.stderr: -341> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding con mode: secure 2024-09-19T14:06:14.803 INFO:tasks.workunit.client.0.smithi153.stderr: -340> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding con mode: crc 2024-09-19T14:06:14.803 INFO:tasks.workunit.client.0.smithi153.stderr: -339> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3c7558) adding con mode: secure 2024-09-19T14:06:14.803 INFO:tasks.workunit.client.0.smithi153.stderr: -338> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.803 INFO:tasks.workunit.client.0.smithi153.stderr: -337> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.803 INFO:tasks.workunit.client.0.smithi153.stderr: -336> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command rotate-key cmddesc rotate-key hook 0x55bc7a3c76a0 EEXIST 2024-09-19T14:06:14.803 INFO:tasks.workunit.client.0.smithi153.stderr: -335> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient: _reopen_session rank -1 2024-09-19T14:06:14.803 INFO:tasks.workunit.client.0.smithi153.stderr: -334> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T14:06:14.803 INFO:tasks.workunit.client.0.smithi153.stderr: -333> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient(hunting): picked mon.noname-a con 0x55bc7a3f0050 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:06:14.804 INFO:tasks.workunit.client.0.smithi153.stderr: -332> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient(hunting): picked mon.noname-b con 0x55bc7a3ef980 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:06:14.804 INFO:tasks.workunit.client.0.smithi153.stderr: -331> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient(hunting): picked mon.noname-c con 0x55bc7a3ee360 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:06:14.804 INFO:tasks.workunit.client.0.smithi153.stderr: -330> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:14.804 INFO:tasks.workunit.client.0.smithi153.stderr: -329> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:14.804 INFO:tasks.workunit.client.0.smithi153.stderr: -328> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:14.804 INFO:tasks.workunit.client.0.smithi153.stderr: -327> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient(hunting): _renew_subs 2024-09-19T14:06:14.804 INFO:tasks.workunit.client.0.smithi153.stderr: -326> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient(hunting): authenticate will time out at 2562.876942s 2024-09-19T14:06:14.804 INFO:tasks.workunit.client.0.smithi153.stderr: -325> 2024-09-19T14:06:14.414+0000 7ff3ed528640 10 monclient(hunting): get_auth_request con 0x55bc7a3ee360 auth_method 0 2024-09-19T14:06:14.804 INFO:tasks.workunit.client.0.smithi153.stderr: -324> 2024-09-19T14:06:14.414+0000 7ff3ed528640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:14.804 INFO:tasks.workunit.client.0.smithi153.stderr: -323> 2024-09-19T14:06:14.414+0000 7ff3ed528640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:14.804 INFO:tasks.workunit.client.0.smithi153.stderr: -322> 2024-09-19T14:06:14.414+0000 7ff3ed528640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:14.804 INFO:tasks.workunit.client.0.smithi153.stderr: -321> 2024-09-19T14:06:14.414+0000 7ff3ecd27640 10 monclient(hunting): get_auth_request con 0x55bc7a3f0050 auth_method 0 2024-09-19T14:06:14.804 INFO:tasks.workunit.client.0.smithi153.stderr: -320> 2024-09-19T14:06:14.414+0000 7ff3ecd27640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:14.805 INFO:tasks.workunit.client.0.smithi153.stderr: -319> 2024-09-19T14:06:14.414+0000 7ff3ecd27640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:14.805 INFO:tasks.workunit.client.0.smithi153.stderr: -318> 2024-09-19T14:06:14.414+0000 7ff3ecd27640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:14.805 INFO:tasks.workunit.client.0.smithi153.stderr: -317> 2024-09-19T14:06:14.414+0000 7ff3ed528640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:14.805 INFO:tasks.workunit.client.0.smithi153.stderr: -316> 2024-09-19T14:06:14.414+0000 7ff3ed528640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:14.805 INFO:tasks.workunit.client.0.smithi153.stderr: -315> 2024-09-19T14:06:14.414+0000 7ff3ed528640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:14.805 INFO:tasks.workunit.client.0.smithi153.stderr: -314> 2024-09-19T14:06:14.414+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:14.805 INFO:tasks.workunit.client.0.smithi153.stderr: -313> 2024-09-19T14:06:14.414+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:14.805 INFO:tasks.workunit.client.0.smithi153.stderr: -312> 2024-09-19T14:06:14.414+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:14.805 INFO:tasks.workunit.client.0.smithi153.stderr: -311> 2024-09-19T14:06:14.414+0000 7ff3ec526640 10 monclient(hunting): get_auth_request con 0x55bc7a3ef980 auth_method 0 2024-09-19T14:06:14.805 INFO:tasks.workunit.client.0.smithi153.stderr: -310> 2024-09-19T14:06:14.414+0000 7ff3ec526640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:14.805 INFO:tasks.workunit.client.0.smithi153.stderr: -309> 2024-09-19T14:06:14.414+0000 7ff3ec526640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:14.805 INFO:tasks.workunit.client.0.smithi153.stderr: -308> 2024-09-19T14:06:14.414+0000 7ff3ec526640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:14.805 INFO:tasks.workunit.client.0.smithi153.stderr: -307> 2024-09-19T14:06:14.414+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_done global_id 6333 payload 824 2024-09-19T14:06:14.806 INFO:tasks.workunit.client.0.smithi153.stderr: -306> 2024-09-19T14:06:14.414+0000 7ff3ecd27640 10 monclient: _finish_hunting 0 2024-09-19T14:06:14.806 INFO:tasks.workunit.client.0.smithi153.stderr: -305> 2024-09-19T14:06:14.414+0000 7ff3ecd27640 1 monclient: found mon.noname-a 2024-09-19T14:06:14.806 INFO:tasks.workunit.client.0.smithi153.stderr: -304> 2024-09-19T14:06:14.414+0000 7ff3ecd27640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:06:14.806 INFO:tasks.workunit.client.0.smithi153.stderr: -303> 2024-09-19T14:06:14.414+0000 7ff2d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:14.806 INFO:tasks.workunit.client.0.smithi153.stderr: -302> 2024-09-19T14:06:14.414+0000 7ff2d27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:06:14.806 INFO:tasks.workunit.client.0.smithi153.stderr: -301> 2024-09-19T14:06:14.414+0000 7ff2d27fc640 10 monclient: dump: 2024-09-19T14:06:14.806 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:14.806 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:14.807 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.807 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.807 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:14.807 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.807 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:14.807 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:14.807 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:14.807 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.807 INFO:tasks.workunit.client.0.smithi153.stderr: -300> 2024-09-19T14:06:14.414+0000 7ff2d27fc640 10 monclient: _finish_auth 0 2024-09-19T14:06:14.807 INFO:tasks.workunit.client.0.smithi153.stderr: -299> 2024-09-19T14:06:14.414+0000 7ff2d27fc640 10 monclient: _check_auth_tickets 2024-09-19T14:06:14.807 INFO:tasks.workunit.client.0.smithi153.stderr: -298> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 5 monclient: authenticate success, global_id 6333 2024-09-19T14:06:14.807 INFO:tasks.workunit.client.0.smithi153.stderr: -297> 2024-09-19T14:06:14.414+0000 7ff2d27fc640 10 monclient: handle_config config(0 keys) 2024-09-19T14:06:14.807 INFO:tasks.workunit.client.0.smithi153.stderr: -296> 2024-09-19T14:06:14.414+0000 7ff2d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:14.808 INFO:tasks.workunit.client.0.smithi153.stderr: -295> 2024-09-19T14:06:14.414+0000 7ff2d27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:06:14.808 INFO:tasks.workunit.client.0.smithi153.stderr: -294> 2024-09-19T14:06:14.414+0000 7ff2d27fc640 10 monclient: dump: 2024-09-19T14:06:14.808 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:14.808 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:14.808 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.808 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.808 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:14.808 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.808 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:14.808 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:14.808 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:14.808 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.808 INFO:tasks.workunit.client.0.smithi153.stderr: -293> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient: _renew_subs 2024-09-19T14:06:14.809 INFO:tasks.workunit.client.0.smithi153.stderr: -292> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:06:14.809 INFO:tasks.workunit.client.0.smithi153.stderr: -291> 2024-09-19T14:06:14.414+0000 7ff3edd29640 4 set_mon_vals no callback set 2024-09-19T14:06:14.809 INFO:tasks.workunit.client.0.smithi153.stderr: -290> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient: _renew_subs 2024-09-19T14:06:14.809 INFO:tasks.workunit.client.0.smithi153.stderr: -289> 2024-09-19T14:06:14.414+0000 7ff3ef2219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:06:14.809 INFO:tasks.workunit.client.0.smithi153.stderr: -288> 2024-09-19T14:06:14.414+0000 7ff2d27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:06:14.809 INFO:tasks.workunit.client.0.smithi153.stderr: -287> 2024-09-19T14:06:14.414+0000 7ff2d27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:06:14.809 INFO:tasks.workunit.client.0.smithi153.stderr: -286> 2024-09-19T14:06:14.414+0000 7ff2d27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:06:14.809 INFO:tasks.workunit.client.0.smithi153.stderr: -285> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: get_monmap_and_config 2024-09-19T14:06:14.809 INFO:tasks.workunit.client.0.smithi153.stderr: -284> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: build_initial_monmap 2024-09-19T14:06:14.809 INFO:tasks.workunit.client.0.smithi153.stderr: -283> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 1 build_initial for_mkfs: 0 2024-09-19T14:06:14.809 INFO:tasks.workunit.client.0.smithi153.stderr: -282> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: monmap: 2024-09-19T14:06:14.809 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:06:14.809 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:06:14.810 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:06:14.810 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:06:14.810 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:06:14.810 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.810 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:06:14.810 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:06:14.810 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:06:14.810 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.810 INFO:tasks.workunit.client.0.smithi153.stderr: -281> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding auth protocol: cephx 2024-09-19T14:06:14.810 INFO:tasks.workunit.client.0.smithi153.stderr: -280> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding auth protocol: cephx 2024-09-19T14:06:14.810 INFO:tasks.workunit.client.0.smithi153.stderr: -279> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding auth protocol: cephx 2024-09-19T14:06:14.810 INFO:tasks.workunit.client.0.smithi153.stderr: -278> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding con mode: secure 2024-09-19T14:06:14.810 INFO:tasks.workunit.client.0.smithi153.stderr: -277> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding con mode: crc 2024-09-19T14:06:14.810 INFO:tasks.workunit.client.0.smithi153.stderr: -276> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding con mode: secure 2024-09-19T14:06:14.811 INFO:tasks.workunit.client.0.smithi153.stderr: -275> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding con mode: crc 2024-09-19T14:06:14.811 INFO:tasks.workunit.client.0.smithi153.stderr: -274> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding con mode: secure 2024-09-19T14:06:14.811 INFO:tasks.workunit.client.0.smithi153.stderr: -273> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding con mode: crc 2024-09-19T14:06:14.811 INFO:tasks.workunit.client.0.smithi153.stderr: -272> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding con mode: crc 2024-09-19T14:06:14.811 INFO:tasks.workunit.client.0.smithi153.stderr: -271> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding con mode: secure 2024-09-19T14:06:14.811 INFO:tasks.workunit.client.0.smithi153.stderr: -270> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding con mode: crc 2024-09-19T14:06:14.811 INFO:tasks.workunit.client.0.smithi153.stderr: -269> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding con mode: secure 2024-09-19T14:06:14.811 INFO:tasks.workunit.client.0.smithi153.stderr: -268> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding con mode: crc 2024-09-19T14:06:14.811 INFO:tasks.workunit.client.0.smithi153.stderr: -267> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a40f620) adding con mode: secure 2024-09-19T14:06:14.811 INFO:tasks.workunit.client.0.smithi153.stderr: -266> 2024-09-19T14:06:14.418+0000 7ff3ec526640 10 monclient: get_auth_request con 0x7ff2c4071b20 auth_method 0 2024-09-19T14:06:14.811 INFO:tasks.workunit.client.0.smithi153.stderr: -265> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.811 INFO:tasks.workunit.client.0.smithi153.stderr: -264> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: init 2024-09-19T14:06:14.811 INFO:tasks.workunit.client.0.smithi153.stderr: -263> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding auth protocol: cephx 2024-09-19T14:06:14.811 INFO:tasks.workunit.client.0.smithi153.stderr: -262> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding auth protocol: cephx 2024-09-19T14:06:14.812 INFO:tasks.workunit.client.0.smithi153.stderr: -261> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding auth protocol: cephx 2024-09-19T14:06:14.812 INFO:tasks.workunit.client.0.smithi153.stderr: -260> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding con mode: secure 2024-09-19T14:06:14.812 INFO:tasks.workunit.client.0.smithi153.stderr: -259> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding con mode: crc 2024-09-19T14:06:14.812 INFO:tasks.workunit.client.0.smithi153.stderr: -258> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding con mode: secure 2024-09-19T14:06:14.812 INFO:tasks.workunit.client.0.smithi153.stderr: -257> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding con mode: crc 2024-09-19T14:06:14.812 INFO:tasks.workunit.client.0.smithi153.stderr: -256> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding con mode: secure 2024-09-19T14:06:14.812 INFO:tasks.workunit.client.0.smithi153.stderr: -255> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding con mode: crc 2024-09-19T14:06:14.812 INFO:tasks.workunit.client.0.smithi153.stderr: -254> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding con mode: crc 2024-09-19T14:06:14.812 INFO:tasks.workunit.client.0.smithi153.stderr: -253> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding con mode: secure 2024-09-19T14:06:14.812 INFO:tasks.workunit.client.0.smithi153.stderr: -252> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding con mode: crc 2024-09-19T14:06:14.812 INFO:tasks.workunit.client.0.smithi153.stderr: -251> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding con mode: secure 2024-09-19T14:06:14.812 INFO:tasks.workunit.client.0.smithi153.stderr: -250> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding con mode: crc 2024-09-19T14:06:14.813 INFO:tasks.workunit.client.0.smithi153.stderr: -249> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c72d0) adding con mode: secure 2024-09-19T14:06:14.813 INFO:tasks.workunit.client.0.smithi153.stderr: -248> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.813 INFO:tasks.workunit.client.0.smithi153.stderr: -247> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.813 INFO:tasks.workunit.client.0.smithi153.stderr: -246> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command rotate-key cmddesc rotate-key hook 0x7ffe134c7418 EEXIST 2024-09-19T14:06:14.813 INFO:tasks.workunit.client.0.smithi153.stderr: -245> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: _reopen_session rank -1 2024-09-19T14:06:14.813 INFO:tasks.workunit.client.0.smithi153.stderr: -244> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T14:06:14.813 INFO:tasks.workunit.client.0.smithi153.stderr: -243> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): picked mon.noname-a con 0x55bc7a43f650 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:06:14.813 INFO:tasks.workunit.client.0.smithi153.stderr: -242> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): picked mon.noname-b con 0x55bc7a443880 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:06:14.813 INFO:tasks.workunit.client.0.smithi153.stderr: -241> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): picked mon.noname-c con 0x55bc7a410650 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:06:14.813 INFO:tasks.workunit.client.0.smithi153.stderr: -240> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:14.813 INFO:tasks.workunit.client.0.smithi153.stderr: -239> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:14.813 INFO:tasks.workunit.client.0.smithi153.stderr: -238> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:14.813 INFO:tasks.workunit.client.0.smithi153.stderr: -237> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): _renew_subs 2024-09-19T14:06:14.814 INFO:tasks.workunit.client.0.smithi153.stderr: -236> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): authenticate will time out at 2562.881054s 2024-09-19T14:06:14.814 INFO:tasks.workunit.client.0.smithi153.stderr: -235> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient(hunting): get_auth_request con 0x55bc7a43f650 auth_method 0 2024-09-19T14:06:14.814 INFO:tasks.workunit.client.0.smithi153.stderr: -234> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:14.814 INFO:tasks.workunit.client.0.smithi153.stderr: -233> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:14.814 INFO:tasks.workunit.client.0.smithi153.stderr: -232> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:14.814 INFO:tasks.workunit.client.0.smithi153.stderr: -231> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): get_auth_request con 0x55bc7a410650 auth_method 0 2024-09-19T14:06:14.814 INFO:tasks.workunit.client.0.smithi153.stderr: -230> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:14.814 INFO:tasks.workunit.client.0.smithi153.stderr: -229> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:14.814 INFO:tasks.workunit.client.0.smithi153.stderr: -228> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:14.814 INFO:tasks.workunit.client.0.smithi153.stderr: -227> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:14.814 INFO:tasks.workunit.client.0.smithi153.stderr: -226> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:14.814 INFO:tasks.workunit.client.0.smithi153.stderr: -225> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:14.814 INFO:tasks.workunit.client.0.smithi153.stderr: -224> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:14.814 INFO:tasks.workunit.client.0.smithi153.stderr: -223> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:14.815 INFO:tasks.workunit.client.0.smithi153.stderr: -222> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:14.815 INFO:tasks.workunit.client.0.smithi153.stderr: -221> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient(hunting): handle_auth_done global_id 6336 payload 274 2024-09-19T14:06:14.815 INFO:tasks.workunit.client.0.smithi153.stderr: -220> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient: _finish_hunting 0 2024-09-19T14:06:14.815 INFO:tasks.workunit.client.0.smithi153.stderr: -219> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 1 monclient: found mon.noname-a 2024-09-19T14:06:14.815 INFO:tasks.workunit.client.0.smithi153.stderr: -218> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:06:14.815 INFO:tasks.workunit.client.0.smithi153.stderr: -217> 2024-09-19T14:06:14.418+0000 7ff2c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:14.815 INFO:tasks.workunit.client.0.smithi153.stderr: -216> 2024-09-19T14:06:14.418+0000 7ff2c3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:06:14.815 INFO:tasks.workunit.client.0.smithi153.stderr: -215> 2024-09-19T14:06:14.418+0000 7ff2c3fff640 10 monclient: dump: 2024-09-19T14:06:14.815 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:14.815 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:14.815 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.815 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.815 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:14.815 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.815 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:14.816 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:14.816 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:14.816 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.816 INFO:tasks.workunit.client.0.smithi153.stderr: -214> 2024-09-19T14:06:14.418+0000 7ff2c3fff640 10 monclient: _finish_auth 0 2024-09-19T14:06:14.816 INFO:tasks.workunit.client.0.smithi153.stderr: -213> 2024-09-19T14:06:14.418+0000 7ff2c3fff640 10 monclient: _check_auth_tickets 2024-09-19T14:06:14.816 INFO:tasks.workunit.client.0.smithi153.stderr: -212> 2024-09-19T14:06:14.418+0000 7ff2c3fff640 10 monclient: handle_config config(0 keys) 2024-09-19T14:06:14.816 INFO:tasks.workunit.client.0.smithi153.stderr: -211> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 monclient: authenticate success, global_id 6336 2024-09-19T14:06:14.816 INFO:tasks.workunit.client.0.smithi153.stderr: -210> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: get_monmap_and_config success 2024-09-19T14:06:14.816 INFO:tasks.workunit.client.0.smithi153.stderr: -209> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 4 set_mon_vals no callback set 2024-09-19T14:06:14.816 INFO:tasks.workunit.client.0.smithi153.stderr: -208> 2024-09-19T14:06:14.418+0000 7ff2c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:14.816 INFO:tasks.workunit.client.0.smithi153.stderr: -207> 2024-09-19T14:06:14.418+0000 7ff2c3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:06:14.816 INFO:tasks.workunit.client.0.smithi153.stderr: -206> 2024-09-19T14:06:14.418+0000 7ff2c3fff640 10 monclient: dump: 2024-09-19T14:06:14.816 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:14.816 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:14.817 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.817 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.817 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:14.817 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.817 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:14.817 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:14.817 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:14.817 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.817 INFO:tasks.workunit.client.0.smithi153.stderr: -205> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: shutdown 2024-09-19T14:06:14.817 INFO:tasks.workunit.client.0.smithi153.stderr: -204> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: build_initial_monmap 2024-09-19T14:06:14.817 INFO:tasks.workunit.client.0.smithi153.stderr: -203> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 1 build_initial for_mkfs: 0 2024-09-19T14:06:14.817 INFO:tasks.workunit.client.0.smithi153.stderr: -202> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: monmap: 2024-09-19T14:06:14.817 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:06:14.818 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:06:14.818 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:06:14.818 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:06:14.818 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:06:14.818 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.818 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:06:14.818 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:06:14.818 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:06:14.818 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.818 INFO:tasks.workunit.client.0.smithi153.stderr: -201> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding auth protocol: cephx 2024-09-19T14:06:14.818 INFO:tasks.workunit.client.0.smithi153.stderr: -200> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding auth protocol: cephx 2024-09-19T14:06:14.818 INFO:tasks.workunit.client.0.smithi153.stderr: -199> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding auth protocol: cephx 2024-09-19T14:06:14.818 INFO:tasks.workunit.client.0.smithi153.stderr: -198> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding con mode: secure 2024-09-19T14:06:14.819 INFO:tasks.workunit.client.0.smithi153.stderr: -197> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding con mode: crc 2024-09-19T14:06:14.819 INFO:tasks.workunit.client.0.smithi153.stderr: -196> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding con mode: secure 2024-09-19T14:06:14.819 INFO:tasks.workunit.client.0.smithi153.stderr: -195> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding con mode: crc 2024-09-19T14:06:14.819 INFO:tasks.workunit.client.0.smithi153.stderr: -194> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding con mode: secure 2024-09-19T14:06:14.819 INFO:tasks.workunit.client.0.smithi153.stderr: -193> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding con mode: crc 2024-09-19T14:06:14.819 INFO:tasks.workunit.client.0.smithi153.stderr: -192> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding con mode: crc 2024-09-19T14:06:14.819 INFO:tasks.workunit.client.0.smithi153.stderr: -191> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding con mode: secure 2024-09-19T14:06:14.819 INFO:tasks.workunit.client.0.smithi153.stderr: -190> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding con mode: crc 2024-09-19T14:06:14.819 INFO:tasks.workunit.client.0.smithi153.stderr: -189> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding con mode: secure 2024-09-19T14:06:14.819 INFO:tasks.workunit.client.0.smithi153.stderr: -188> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding con mode: crc 2024-09-19T14:06:14.819 INFO:tasks.workunit.client.0.smithi153.stderr: -187> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a43fbf0) adding con mode: secure 2024-09-19T14:06:14.819 INFO:tasks.workunit.client.0.smithi153.stderr: -186> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.820 INFO:tasks.workunit.client.0.smithi153.stderr: -185> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 1 librados: starting msgr at 2024-09-19T14:06:14.820 INFO:tasks.workunit.client.0.smithi153.stderr: -184> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 1 librados: starting objecter 2024-09-19T14:06:14.820 INFO:tasks.workunit.client.0.smithi153.stderr: -183> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command objecter_requests cmddesc objecter_requests hook 0x55bc7a43d710 EEXIST 2024-09-19T14:06:14.820 INFO:tasks.workunit.client.0.smithi153.stderr: -182> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 1 librados: setting wanted keys 2024-09-19T14:06:14.820 INFO:tasks.workunit.client.0.smithi153.stderr: -181> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 1 librados: calling monclient init 2024-09-19T14:06:14.820 INFO:tasks.workunit.client.0.smithi153.stderr: -180> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: init 2024-09-19T14:06:14.820 INFO:tasks.workunit.client.0.smithi153.stderr: -179> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding auth protocol: cephx 2024-09-19T14:06:14.820 INFO:tasks.workunit.client.0.smithi153.stderr: -178> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding auth protocol: cephx 2024-09-19T14:06:14.820 INFO:tasks.workunit.client.0.smithi153.stderr: -177> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding auth protocol: cephx 2024-09-19T14:06:14.820 INFO:tasks.workunit.client.0.smithi153.stderr: -176> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding con mode: secure 2024-09-19T14:06:14.820 INFO:tasks.workunit.client.0.smithi153.stderr: -175> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding con mode: crc 2024-09-19T14:06:14.820 INFO:tasks.workunit.client.0.smithi153.stderr: -174> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding con mode: secure 2024-09-19T14:06:14.820 INFO:tasks.workunit.client.0.smithi153.stderr: -173> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding con mode: crc 2024-09-19T14:06:14.821 INFO:tasks.workunit.client.0.smithi153.stderr: -172> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding con mode: secure 2024-09-19T14:06:14.821 INFO:tasks.workunit.client.0.smithi153.stderr: -171> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding con mode: crc 2024-09-19T14:06:14.821 INFO:tasks.workunit.client.0.smithi153.stderr: -170> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding con mode: crc 2024-09-19T14:06:14.821 INFO:tasks.workunit.client.0.smithi153.stderr: -169> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding con mode: secure 2024-09-19T14:06:14.821 INFO:tasks.workunit.client.0.smithi153.stderr: -168> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding con mode: crc 2024-09-19T14:06:14.821 INFO:tasks.workunit.client.0.smithi153.stderr: -167> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding con mode: secure 2024-09-19T14:06:14.821 INFO:tasks.workunit.client.0.smithi153.stderr: -166> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding con mode: crc 2024-09-19T14:06:14.821 INFO:tasks.workunit.client.0.smithi153.stderr: -165> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 AuthRegistry(0x55bc7a3f1e70) adding con mode: secure 2024-09-19T14:06:14.821 INFO:tasks.workunit.client.0.smithi153.stderr: -164> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.821 INFO:tasks.workunit.client.0.smithi153.stderr: -163> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.821 INFO:tasks.workunit.client.0.smithi153.stderr: -162> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command rotate-key cmddesc rotate-key hook 0x55bc7a3f1fb8 EEXIST 2024-09-19T14:06:14.821 INFO:tasks.workunit.client.0.smithi153.stderr: -161> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: _reopen_session rank -1 2024-09-19T14:06:14.821 INFO:tasks.workunit.client.0.smithi153.stderr: -160> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:06:14.821 INFO:tasks.workunit.client.0.smithi153.stderr: -159> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): picked mon.noname-b con 0x55bc7a410650 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:06:14.821 INFO:tasks.workunit.client.0.smithi153.stderr: -158> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): picked mon.noname-a con 0x55bc7a43f650 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:06:14.822 INFO:tasks.workunit.client.0.smithi153.stderr: -157> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): picked mon.noname-c con 0x55bc7a443880 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:06:14.822 INFO:tasks.workunit.client.0.smithi153.stderr: -156> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:14.822 INFO:tasks.workunit.client.0.smithi153.stderr: -155> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:14.822 INFO:tasks.workunit.client.0.smithi153.stderr: -154> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:14.822 INFO:tasks.workunit.client.0.smithi153.stderr: -153> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): _renew_subs 2024-09-19T14:06:14.822 INFO:tasks.workunit.client.0.smithi153.stderr: -152> 2024-09-19T14:06:14.418+0000 7ff3ef2219c0 10 monclient(hunting): authenticate will time out at 2562.883561s 2024-09-19T14:06:14.822 INFO:tasks.workunit.client.0.smithi153.stderr: -151> 2024-09-19T14:06:14.418+0000 7ff3ec526640 10 monclient(hunting): get_auth_request con 0x55bc7a43f650 auth_method 0 2024-09-19T14:06:14.822 INFO:tasks.workunit.client.0.smithi153.stderr: -150> 2024-09-19T14:06:14.418+0000 7ff3ec526640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:14.822 INFO:tasks.workunit.client.0.smithi153.stderr: -149> 2024-09-19T14:06:14.418+0000 7ff3ec526640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:14.822 INFO:tasks.workunit.client.0.smithi153.stderr: -148> 2024-09-19T14:06:14.418+0000 7ff3ec526640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:14.822 INFO:tasks.workunit.client.0.smithi153.stderr: -147> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): get_auth_request con 0x55bc7a443880 auth_method 0 2024-09-19T14:06:14.823 INFO:tasks.workunit.client.0.smithi153.stderr: -146> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:14.823 INFO:tasks.workunit.client.0.smithi153.stderr: -145> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:14.823 INFO:tasks.workunit.client.0.smithi153.stderr: -144> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:14.823 INFO:tasks.workunit.client.0.smithi153.stderr: -143> 2024-09-19T14:06:14.418+0000 7ff3ec526640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:14.823 INFO:tasks.workunit.client.0.smithi153.stderr: -142> 2024-09-19T14:06:14.418+0000 7ff3ec526640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:14.823 INFO:tasks.workunit.client.0.smithi153.stderr: -141> 2024-09-19T14:06:14.418+0000 7ff3ec526640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:14.823 INFO:tasks.workunit.client.0.smithi153.stderr: -140> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:14.823 INFO:tasks.workunit.client.0.smithi153.stderr: -139> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:14.823 INFO:tasks.workunit.client.0.smithi153.stderr: -138> 2024-09-19T14:06:14.418+0000 7ff3ed528640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:14.823 INFO:tasks.workunit.client.0.smithi153.stderr: -137> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient(hunting): get_auth_request con 0x55bc7a410650 auth_method 0 2024-09-19T14:06:14.823 INFO:tasks.workunit.client.0.smithi153.stderr: -136> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:14.823 INFO:tasks.workunit.client.0.smithi153.stderr: -135> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:14.823 INFO:tasks.workunit.client.0.smithi153.stderr: -134> 2024-09-19T14:06:14.418+0000 7ff3ecd27640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:14.823 INFO:tasks.workunit.client.0.smithi153.stderr: -133> 2024-09-19T14:06:14.418+0000 7ff3ec526640 10 monclient(hunting): handle_auth_done global_id 6339 payload 824 2024-09-19T14:06:14.823 INFO:tasks.workunit.client.0.smithi153.stderr: -132> 2024-09-19T14:06:14.418+0000 7ff3ec526640 10 monclient: _finish_hunting 0 2024-09-19T14:06:14.824 INFO:tasks.workunit.client.0.smithi153.stderr: -131> 2024-09-19T14:06:14.418+0000 7ff3ec526640 1 monclient: found mon.noname-a 2024-09-19T14:06:14.824 INFO:tasks.workunit.client.0.smithi153.stderr: -130> 2024-09-19T14:06:14.422+0000 7ff3ec526640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:06:14.824 INFO:tasks.workunit.client.0.smithi153.stderr: -129> 2024-09-19T14:06:14.422+0000 7ff2c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:14.824 INFO:tasks.workunit.client.0.smithi153.stderr: -128> 2024-09-19T14:06:14.422+0000 7ff2c27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:06:14.824 INFO:tasks.workunit.client.0.smithi153.stderr: -127> 2024-09-19T14:06:14.422+0000 7ff2c27fc640 10 monclient: dump: 2024-09-19T14:06:14.824 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:14.824 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:14.824 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.824 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.824 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:14.824 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.824 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:14.824 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:14.824 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:14.825 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.825 INFO:tasks.workunit.client.0.smithi153.stderr: -126> 2024-09-19T14:06:14.422+0000 7ff2c27fc640 10 monclient: _finish_auth 0 2024-09-19T14:06:14.825 INFO:tasks.workunit.client.0.smithi153.stderr: -125> 2024-09-19T14:06:14.422+0000 7ff2c27fc640 10 monclient: _check_auth_tickets 2024-09-19T14:06:14.825 INFO:tasks.workunit.client.0.smithi153.stderr: -124> 2024-09-19T14:06:14.422+0000 7ff2c27fc640 10 monclient: handle_config config(0 keys) 2024-09-19T14:06:14.825 INFO:tasks.workunit.client.0.smithi153.stderr: -123> 2024-09-19T14:06:14.422+0000 7ff3ef2219c0 5 monclient: authenticate success, global_id 6339 2024-09-19T14:06:14.825 INFO:tasks.workunit.client.0.smithi153.stderr: -122> 2024-09-19T14:06:14.422+0000 7ff3ef2219c0 10 monclient: _renew_subs 2024-09-19T14:06:14.825 INFO:tasks.workunit.client.0.smithi153.stderr: -121> 2024-09-19T14:06:14.422+0000 7ff3ef2219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:06:14.825 INFO:tasks.workunit.client.0.smithi153.stderr: -120> 2024-09-19T14:06:14.422+0000 7ff2c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:14.825 INFO:tasks.workunit.client.0.smithi153.stderr: -119> 2024-09-19T14:06:14.422+0000 7ff2c3fff640 4 set_mon_vals no callback set 2024-09-19T14:06:14.825 INFO:tasks.workunit.client.0.smithi153.stderr: -118> 2024-09-19T14:06:14.422+0000 7ff2c27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:06:14.825 INFO:tasks.workunit.client.0.smithi153.stderr: -117> 2024-09-19T14:06:14.422+0000 7ff2c27fc640 10 monclient: dump: 2024-09-19T14:06:14.825 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:14.825 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:14.825 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.825 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:14.826 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:14.826 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:14.826 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:14.826 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:14.826 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:14.826 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.826 INFO:tasks.workunit.client.0.smithi153.stderr: -116> 2024-09-19T14:06:14.422+0000 7ff3ef2219c0 10 monclient: _renew_subs 2024-09-19T14:06:14.826 INFO:tasks.workunit.client.0.smithi153.stderr: -115> 2024-09-19T14:06:14.422+0000 7ff3ef2219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:06:14.826 INFO:tasks.workunit.client.0.smithi153.stderr: -114> 2024-09-19T14:06:14.422+0000 7ff3ef2219c0 1 librados: init done 2024-09-19T14:06:14.826 INFO:tasks.workunit.client.0.smithi153.stderr: -113> 2024-09-19T14:06:14.422+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command cr dump hook 0x55bc7a453b78 2024-09-19T14:06:14.826 INFO:tasks.workunit.client.0.smithi153.stderr: -112> 2024-09-19T14:06:14.422+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.826 INFO:tasks.workunit.client.0.smithi153.stderr: -111> 2024-09-19T14:06:14.422+0000 7ff2c27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:06:14.826 INFO:tasks.workunit.client.0.smithi153.stderr: -110> 2024-09-19T14:06:14.422+0000 7ff2c27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:06:14.827 INFO:tasks.workunit.client.0.smithi153.stderr: -109> 2024-09-19T14:06:14.422+0000 7ff2c27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:06:14.827 INFO:tasks.workunit.client.0.smithi153.stderr: -108> 2024-09-19T14:06:14.422+0000 7ff3ed528640 10 monclient: get_auth_request con 0x55bc7a45f4c0 auth_method 0 2024-09-19T14:06:14.827 INFO:tasks.workunit.client.0.smithi153.stderr: -107> 2024-09-19T14:06:14.422+0000 7ff3ecd27640 10 monclient: get_auth_request con 0x7ff2b8071be0 auth_method 0 2024-09-19T14:06:14.827 INFO:tasks.workunit.client.0.smithi153.stderr: -106> 2024-09-19T14:06:14.422+0000 7ff3ef2219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.827 INFO:tasks.workunit.client.0.smithi153.stderr: -105> 2024-09-19T14:06:14.422+0000 7ff3ef2219c0 20 realm 2024-09-19T14:06:14.827 INFO:tasks.workunit.client.0.smithi153.stderr: -104> 2024-09-19T14:06:14.422+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.827 INFO:tasks.workunit.client.0.smithi153.stderr: -103> 2024-09-19T14:06:14.426+0000 7ff3ef2219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.827 INFO:tasks.workunit.client.0.smithi153.stderr: -102> 2024-09-19T14:06:14.426+0000 7ff3ef2219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:14.827 INFO:tasks.workunit.client.0.smithi153.stderr: -101> 2024-09-19T14:06:14.426+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.827 INFO:tasks.workunit.client.0.smithi153.stderr: -100> 2024-09-19T14:06:14.426+0000 7ff3ef2219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.827 INFO:tasks.workunit.client.0.smithi153.stderr: -99> 2024-09-19T14:06:14.426+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.827 INFO:tasks.workunit.client.0.smithi153.stderr: -98> 2024-09-19T14:06:14.426+0000 7ff3ecd27640 10 monclient: get_auth_request con 0x55bc7a463880 auth_method 0 2024-09-19T14:06:14.827 INFO:tasks.workunit.client.0.smithi153.stderr: -97> 2024-09-19T14:06:14.426+0000 7ff3ef2219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:14.827 INFO:tasks.workunit.client.0.smithi153.stderr: -96> 2024-09-19T14:06:14.426+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.827 INFO:tasks.workunit.client.0.smithi153.stderr: -95> 2024-09-19T14:06:14.426+0000 7ff3ef2219c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:14.828 INFO:tasks.workunit.client.0.smithi153.stderr: -94> 2024-09-19T14:06:14.426+0000 7ff3ef2219c0 20 searching for the correct realm 2024-09-19T14:06:14.828 INFO:tasks.workunit.client.0.smithi153.stderr: -93> 2024-09-19T14:06:14.426+0000 7ff3ec526640 10 monclient: get_auth_request con 0x55bc7a4689e0 auth_method 0 2024-09-19T14:06:14.828 INFO:tasks.workunit.client.0.smithi153.stderr: -92> 2024-09-19T14:06:14.426+0000 7ff3ed528640 10 monclient: get_auth_request con 0x7ff3d4008030 auth_method 0 2024-09-19T14:06:14.828 INFO:tasks.workunit.client.0.smithi153.stderr: -91> 2024-09-19T14:06:14.430+0000 7ff3ecd27640 10 monclient: get_auth_request con 0x7ff3e4023040 auth_method 0 2024-09-19T14:06:14.828 INFO:tasks.workunit.client.0.smithi153.stderr: -90> 2024-09-19T14:06:14.430+0000 7ff3ec526640 10 monclient: get_auth_request con 0x7ff3dc0ab070 auth_method 0 2024-09-19T14:06:14.828 INFO:tasks.workunit.client.0.smithi153.stderr: -89> 2024-09-19T14:06:14.434+0000 7ff3ed528640 0 -- 172.21.15.153:0/1848742116 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7ff3d40692d0 msgr2=0x7ff3d4069770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:14.828 INFO:tasks.workunit.client.0.smithi153.stderr: -88> 2024-09-19T14:06:14.638+0000 7ff3ed528640 10 monclient: get_auth_request con 0x7ff3d40692d0 auth_method 0 2024-09-19T14:06:14.828 INFO:tasks.workunit.client.0.smithi153.stderr: -87> 2024-09-19T14:06:14.646+0000 7ff3ecd27640 10 monclient: get_auth_request con 0x7ff3d40724c0 auth_method 0 2024-09-19T14:06:14.828 INFO:tasks.workunit.client.0.smithi153.stderr: -86> 2024-09-19T14:06:14.650+0000 7ff3ecd27640 0 -- 172.21.15.153:0/1848742116 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x55bc7a463880 msgr2=0x55bc7a465c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:14.828 INFO:tasks.workunit.client.0.smithi153.stderr: -85> 2024-09-19T14:06:14.650+0000 7ff2c27fc640 1 client.6339.objecter ms_handle_reset 0x55bc7a463880 session 0x55bc7a462710 osd.5 2024-09-19T14:06:14.828 INFO:tasks.workunit.client.0.smithi153.stderr: -84> 2024-09-19T14:06:14.650+0000 7ff2c27fc640 10 monclient: _renew_subs 2024-09-19T14:06:14.828 INFO:tasks.workunit.client.0.smithi153.stderr: -83> 2024-09-19T14:06:14.650+0000 7ff2c27fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:06:14.828 INFO:tasks.workunit.client.0.smithi153.stderr: -82> 2024-09-19T14:06:14.650+0000 7ff3ecd27640 10 monclient: get_auth_request con 0x7ff2b8082290 auth_method 0 2024-09-19T14:06:14.828 INFO:tasks.workunit.client.0.smithi153.stderr: -81> 2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:14.829 INFO:tasks.workunit.client.0.smithi153.stderr: -80> 2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:14.829 INFO:tasks.workunit.client.0.smithi153.stderr: -79> 2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:14.829 INFO:tasks.workunit.client.0.smithi153.stderr: -78> 2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:14.829 INFO:tasks.workunit.client.0.smithi153.stderr: -77> 2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:14.829 INFO:tasks.workunit.client.0.smithi153.stderr: -76> 2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:14.829 INFO:tasks.workunit.client.0.smithi153.stderr: -75> 2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.829 INFO:tasks.workunit.client.0.smithi153.stderr: -74> 2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.829 INFO:tasks.workunit.client.0.smithi153.stderr: -73> 2024-09-19T14:06:14.658+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.829 INFO:tasks.workunit.client.0.smithi153.stderr: -72> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:14.829 INFO:tasks.workunit.client.0.smithi153.stderr: -71> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.829 INFO:tasks.workunit.client.0.smithi153.stderr: -70> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:14.829 INFO:tasks.workunit.client.0.smithi153.stderr: -69> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 zone default found 2024-09-19T14:06:14.829 INFO:tasks.workunit.client.0.smithi153.stderr: -68> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 4 Realm: () 2024-09-19T14:06:14.830 INFO:tasks.workunit.client.0.smithi153.stderr: -67> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:14.830 INFO:tasks.workunit.client.0.smithi153.stderr: -66> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:14.830 INFO:tasks.workunit.client.0.smithi153.stderr: -65> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:14.830 INFO:tasks.workunit.client.0.smithi153.stderr: -64> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 zonegroup default 2024-09-19T14:06:14.830 INFO:tasks.workunit.client.0.smithi153.stderr: -63> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.830 INFO:tasks.workunit.client.0.smithi153.stderr: -62> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.830 INFO:tasks.workunit.client.0.smithi153.stderr: -61> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.830 INFO:tasks.workunit.client.0.smithi153.stderr: -60> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.830 INFO:tasks.workunit.client.0.smithi153.stderr: -59> 2024-09-19T14:06:14.662+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.830 INFO:tasks.workunit.client.0.smithi153.stderr: -58> 2024-09-19T14:06:14.666+0000 7ff3ef2219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.830 INFO:tasks.workunit.client.0.smithi153.stderr: -57> 2024-09-19T14:06:14.666+0000 7ff3ef2219c0 20 started sync module instance, tier type = 2024-09-19T14:06:14.830 INFO:tasks.workunit.client.0.smithi153.stderr: -56> 2024-09-19T14:06:14.666+0000 7ff3ef2219c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:14.830 INFO:tasks.workunit.client.0.smithi153.stderr: -55> 2024-09-19T14:06:14.686+0000 7ff3ef2219c0 20 add_watcher() i=0 2024-09-19T14:06:14.831 INFO:tasks.workunit.client.0.smithi153.stderr: -54> 2024-09-19T14:06:14.686+0000 7ff3ef2219c0 20 add_watcher() i=1 2024-09-19T14:06:14.831 INFO:tasks.workunit.client.0.smithi153.stderr: -53> 2024-09-19T14:06:14.686+0000 7ff3ef2219c0 20 add_watcher() i=2 2024-09-19T14:06:14.831 INFO:tasks.workunit.client.0.smithi153.stderr: -52> 2024-09-19T14:06:14.686+0000 7ff3ef2219c0 20 add_watcher() i=3 2024-09-19T14:06:14.831 INFO:tasks.workunit.client.0.smithi153.stderr: -51> 2024-09-19T14:06:14.686+0000 7ff3ef2219c0 20 add_watcher() i=4 2024-09-19T14:06:14.831 INFO:tasks.workunit.client.0.smithi153.stderr: -50> 2024-09-19T14:06:14.686+0000 7ff3ef2219c0 20 add_watcher() i=5 2024-09-19T14:06:14.831 INFO:tasks.workunit.client.0.smithi153.stderr: -49> 2024-09-19T14:06:14.686+0000 7ff3ef2219c0 20 add_watcher() i=6 2024-09-19T14:06:14.831 INFO:tasks.workunit.client.0.smithi153.stderr: -48> 2024-09-19T14:06:14.686+0000 7ff3ef2219c0 20 add_watcher() i=7 2024-09-19T14:06:14.831 INFO:tasks.workunit.client.0.smithi153.stderr: -47> 2024-09-19T14:06:14.686+0000 7ff3ef2219c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:14.831 INFO:tasks.workunit.client.0.smithi153.stderr: -46> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding auth protocol: cephx 2024-09-19T14:06:14.831 INFO:tasks.workunit.client.0.smithi153.stderr: -45> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding auth protocol: cephx 2024-09-19T14:06:14.831 INFO:tasks.workunit.client.0.smithi153.stderr: -44> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding auth protocol: cephx 2024-09-19T14:06:14.831 INFO:tasks.workunit.client.0.smithi153.stderr: -43> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding con mode: secure 2024-09-19T14:06:14.831 INFO:tasks.workunit.client.0.smithi153.stderr: -42> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding con mode: crc 2024-09-19T14:06:14.831 INFO:tasks.workunit.client.0.smithi153.stderr: -41> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding con mode: secure 2024-09-19T14:06:14.831 INFO:tasks.workunit.client.0.smithi153.stderr: -40> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding con mode: crc 2024-09-19T14:06:14.832 INFO:tasks.workunit.client.0.smithi153.stderr: -39> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding con mode: secure 2024-09-19T14:06:14.832 INFO:tasks.workunit.client.0.smithi153.stderr: -38> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding con mode: crc 2024-09-19T14:06:14.832 INFO:tasks.workunit.client.0.smithi153.stderr: -37> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding con mode: crc 2024-09-19T14:06:14.832 INFO:tasks.workunit.client.0.smithi153.stderr: -36> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding con mode: secure 2024-09-19T14:06:14.832 INFO:tasks.workunit.client.0.smithi153.stderr: -35> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding con mode: crc 2024-09-19T14:06:14.832 INFO:tasks.workunit.client.0.smithi153.stderr: -34> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding con mode: secure 2024-09-19T14:06:14.832 INFO:tasks.workunit.client.0.smithi153.stderr: -33> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding con mode: crc 2024-09-19T14:06:14.832 INFO:tasks.workunit.client.0.smithi153.stderr: -32> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 AuthRegistry(0x7ffe134c77a0) adding con mode: secure 2024-09-19T14:06:14.832 INFO:tasks.workunit.client.0.smithi153.stderr: -31> 2024-09-19T14:06:14.690+0000 7ff2a37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:14.832 INFO:tasks.workunit.client.0.smithi153.stderr: -30> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:14.832 INFO:tasks.workunit.client.0.smithi153.stderr: -29> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:14.832 INFO:tasks.workunit.client.0.smithi153.stderr: -28> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:14.832 INFO:tasks.workunit.client.0.smithi153.stderr: -27> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command cache list hook 0x55bc7a453270 2024-09-19T14:06:14.832 INFO:tasks.workunit.client.0.smithi153.stderr: -26> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command cache inspect hook 0x55bc7a453270 2024-09-19T14:06:14.833 INFO:tasks.workunit.client.0.smithi153.stderr: -25> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command cache erase hook 0x55bc7a453270 2024-09-19T14:06:14.833 INFO:tasks.workunit.client.0.smithi153.stderr: -24> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command cache zap hook 0x55bc7a453270 2024-09-19T14:06:14.833 INFO:tasks.workunit.client.0.smithi153.stderr: -23> 2024-09-19T14:06:14.690+0000 7ff3ef2219c0 5 note: GC not initialized 2024-09-19T14:06:14.833 INFO:tasks.workunit.client.0.smithi153.stderr: -22> 2024-09-19T14:06:14.690+0000 7ff2a27e4640 20 reqs_thread_entry: start 2024-09-19T14:06:14.833 INFO:tasks.workunit.client.0.smithi153.stderr: -21> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command sync trace show hook 0x7ff3d400e070 2024-09-19T14:06:14.833 INFO:tasks.workunit.client.0.smithi153.stderr: -20> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command sync trace history hook 0x7ff3d400e070 2024-09-19T14:06:14.833 INFO:tasks.workunit.client.0.smithi153.stderr: -19> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command sync trace active hook 0x7ff3d400e070 2024-09-19T14:06:14.833 INFO:tasks.workunit.client.0.smithi153.stderr: -18> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 5 asok(0x55bc7a168d90) register_command sync trace active_short hook 0x7ff3d400e070 2024-09-19T14:06:14.833 INFO:tasks.workunit.client.0.smithi153.stderr: -17> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:14.833 INFO:tasks.workunit.client.0.smithi153.stderr: -16> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 20 Filter name: none 2024-09-19T14:06:14.833 INFO:tasks.workunit.client.0.smithi153.stderr: -15> 2024-09-19T14:06:14.694+0000 7ff29b7fe640 20 reqs_thread_entry: start 2024-09-19T14:06:14.833 INFO:tasks.workunit.client.0.smithi153.stderr: -14> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-19T14:06:14.834 INFO:tasks.workunit.client.0.smithi153.stderr: -13> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.834 INFO:tasks.workunit.client.0.smithi153.stderr: -12> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-19T14:06:14.834 INFO:tasks.workunit.client.0.smithi153.stderr: -11> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-19T14:06:14.834 INFO:tasks.workunit.client.0.smithi153.stderr: -10> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-19T14:06:14.834 INFO:tasks.workunit.client.0.smithi153.stderr: -9> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 : miss 2024-09-19T14:06:14.834 INFO:tasks.workunit.client.0.smithi153.stderr: -8> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.834 INFO:tasks.workunit.client.0.smithi153.stderr: -7> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-19T14:06:14.834 INFO:tasks.workunit.client.0.smithi153.stderr: -6> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 info.flags=0x17 2024-09-19T14:06:14.834 INFO:tasks.workunit.client.0.smithi153.stderr: -5> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 to cache LRU end 2024-09-19T14:06:14.834 INFO:tasks.workunit.client.0.smithi153.stderr: -4> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:06:14.834 INFO:tasks.workunit.client.0.smithi153.stderr: -3> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:14.834 INFO:tasks.workunit.client.0.smithi153.stderr: -2> 2024-09-19T14:06:14.694+0000 7ff3ef2219c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 2024-09-19T14:06:14.834 INFO:tasks.workunit.client.0.smithi153.stderr: -1> 2024-09-19T14:06:14.698+0000 7ff3ef2219c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff3ef2219c0 time 2024-09-19T14:06:14.699395+0000 2024-09-19T14:06:14.834 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:06:14.835 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.835 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:06:14.835 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff3f2afb2eb] 2024-09-19T14:06:14.835 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff3f2afb49f] 2024-09-19T14:06:14.835 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc77a2d271] 2024-09-19T14:06:14.835 INFO:tasks.workunit.client.0.smithi153.stderr: 4: radosgw-admin(+0x140fa02) [0x55bc7847da02] 2024-09-19T14:06:14.835 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bc77a3d0dd] 2024-09-19T14:06:14.835 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:06:14.835 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff3f1961d90] 2024-09-19T14:06:14.835 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:06:14.835 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:06:14.835 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.835 INFO:tasks.workunit.client.0.smithi153.stderr: 0> 2024-09-19T14:06:14.698+0000 7ff3ef2219c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:06:14.835 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7ff3ef2219c0 thread_name:radosgw-admin 2024-09-19T14:06:14.835 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.835 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:06:14.836 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff3f197a520] 2024-09-19T14:06:14.836 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:06:14.836 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:06:14.836 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:06:14.836 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff3f2afb345] 2024-09-19T14:06:14.836 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff3f2afb49f] 2024-09-19T14:06:14.836 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bc77a2d271] 2024-09-19T14:06:14.836 INFO:tasks.workunit.client.0.smithi153.stderr: 8: radosgw-admin(+0x140fa02) [0x55bc7847da02] 2024-09-19T14:06:14.836 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55bc77a3d0dd] 2024-09-19T14:06:14.836 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:06:14.836 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff3f1961d90] 2024-09-19T14:06:14.836 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:06:14.836 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:06:14.836 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:06:14.837 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.837 INFO:tasks.workunit.client.0.smithi153.stderr:--- logging levels --- 2024-09-19T14:06:14.837 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 none 2024-09-19T14:06:14.837 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 lockdep 2024-09-19T14:06:14.837 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 context 2024-09-19T14:06:14.837 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 crush 2024-09-19T14:06:14.837 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds 2024-09-19T14:06:14.837 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_balancer 2024-09-19T14:06:14.837 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_locker 2024-09-19T14:06:14.837 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log 2024-09-19T14:06:14.837 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log_expire 2024-09-19T14:06:14.837 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_migrator 2024-09-19T14:06:14.837 INFO:tasks.workunit.client.0.smithi153.stderr: 3/ 5 mds_quiesce 2024-09-19T14:06:14.837 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 buffer 2024-09-19T14:06:14.838 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 timer 2024-09-19T14:06:14.838 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 filer 2024-09-19T14:06:14.838 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 striper 2024-09-19T14:06:14.838 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 objecter 2024-09-19T14:06:14.838 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rados 2024-09-19T14:06:14.838 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd 2024-09-19T14:06:14.838 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_mirror 2024-09-19T14:06:14.838 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_replay 2024-09-19T14:06:14.838 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_pwl 2024-09-19T14:06:14.838 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 journaler 2024-09-19T14:06:14.838 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objectcacher 2024-09-19T14:06:14.838 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:06:14.838 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 client 2024-09-19T14:06:14.838 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 osd 2024-09-19T14:06:14.838 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 optracker 2024-09-19T14:06:14.838 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objclass 2024-09-19T14:06:14.839 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 filestore 2024-09-19T14:06:14.839 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 journal 2024-09-19T14:06:14.839 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 ms 2024-09-19T14:06:14.839 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mon 2024-09-19T14:06:14.839 INFO:tasks.workunit.client.0.smithi153.stderr: 0/10 monc 2024-09-19T14:06:14.839 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 paxos 2024-09-19T14:06:14.839 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 tp 2024-09-19T14:06:14.839 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 auth 2024-09-19T14:06:14.839 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 crypto 2024-09-19T14:06:14.839 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 finisher 2024-09-19T14:06:14.839 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 reserver 2024-09-19T14:06:14.839 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 heartbeatmap 2024-09-19T14:06:14.839 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 perfcounter 2024-09-19T14:06:14.839 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw 2024-09-19T14:06:14.840 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_sync 2024-09-19T14:06:14.840 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_datacache 2024-09-19T14:06:14.840 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_access 2024-09-19T14:06:14.840 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:06:14.840 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_flight 2024-09-19T14:06:14.840 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:06:14.840 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw_notification 2024-09-19T14:06:14.840 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 javaclient 2024-09-19T14:06:14.840 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 asok 2024-09-19T14:06:14.840 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 throttle 2024-09-19T14:06:14.840 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 refs 2024-09-19T14:06:14.840 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 compressor 2024-09-19T14:06:14.840 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluestore 2024-09-19T14:06:14.840 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluefs 2024-09-19T14:06:14.841 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 bdev 2024-09-19T14:06:14.841 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 kstore 2024-09-19T14:06:14.841 INFO:tasks.workunit.client.0.smithi153.stderr: 4/ 5 rocksdb 2024-09-19T14:06:14.841 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 fuse 2024-09-19T14:06:14.841 INFO:tasks.workunit.client.0.smithi153.stderr: 2/ 5 mgr 2024-09-19T14:06:14.841 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mgrc 2024-09-19T14:06:14.841 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 dpdk 2024-09-19T14:06:14.841 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 eventtrace 2024-09-19T14:06:14.841 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 prioritycache 2024-09-19T14:06:14.841 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 test 2024-09-19T14:06:14.841 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:06:14.841 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephsqlite 2024-09-19T14:06:14.841 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:06:14.841 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore 2024-09-19T14:06:14.841 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_onode 2024-09-19T14:06:14.842 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_odata 2024-09-19T14:06:14.842 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_omap 2024-09-19T14:06:14.842 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_tm 2024-09-19T14:06:14.842 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_t 2024-09-19T14:06:14.842 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:06:14.842 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_epm 2024-09-19T14:06:14.842 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_lba 2024-09-19T14:06:14.842 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:06:14.842 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cache 2024-09-19T14:06:14.842 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_journal 2024-09-19T14:06:14.842 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_device 2024-09-19T14:06:14.842 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_backref 2024-09-19T14:06:14.842 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 alienstore 2024-09-19T14:06:14.843 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mclock 2024-09-19T14:06:14.843 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cyanstore 2024-09-19T14:06:14.843 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 ceph_exporter 2024-09-19T14:06:14.843 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 memstore 2024-09-19T14:06:14.843 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 trace 2024-09-19T14:06:14.843 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 ceph_dedup 2024-09-19T14:06:14.843 INFO:tasks.workunit.client.0.smithi153.stderr: -2/-2 (syslog threshold) 2024-09-19T14:06:14.843 INFO:tasks.workunit.client.0.smithi153.stderr: 99/99 (stderr threshold) 2024-09-19T14:06:14.843 INFO:tasks.workunit.client.0.smithi153.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:06:14.843 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff29b7fe640 / http_manager 2024-09-19T14:06:14.843 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff2a27e4640 / http_manager 2024-09-19T14:06:14.843 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff2a37e6640 / rgw_dt_lg_renew 2024-09-19T14:06:14.843 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff2c27fc640 / ms_dispatch 2024-09-19T14:06:14.843 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff2c3fff640 / io_context_pool 2024-09-19T14:06:14.844 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff2d27fc640 / ms_dispatch 2024-09-19T14:06:14.844 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff2d960a640 / ms_dispatch 2024-09-19T14:06:14.844 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff2dae0d640 / io_context_pool 2024-09-19T14:06:14.844 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff3ec526640 / msgr-worker-2 2024-09-19T14:06:14.844 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff3ecd27640 / msgr-worker-1 2024-09-19T14:06:14.844 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff3ed528640 / msgr-worker-0 2024-09-19T14:06:14.844 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff3edd29640 / io_context_pool 2024-09-19T14:06:14.844 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff3ef2219c0 / radosgw-admin 2024-09-19T14:06:14.844 INFO:tasks.workunit.client.0.smithi153.stderr: max_recent 500 2024-09-19T14:06:14.844 INFO:tasks.workunit.client.0.smithi153.stderr: max_new 1000 2024-09-19T14:06:14.844 INFO:tasks.workunit.client.0.smithi153.stderr: log_file /var/lib/ceph/crash/2024-09-19T14:06:14.702854Z_705b9ef2-9518-4f03-8dbd-0aaca563f970/log 2024-09-19T14:06:14.844 INFO:tasks.workunit.client.0.smithi153.stderr:--- end dump of recent events --- 2024-09-19T14:06:14.844 INFO:tasks.workunit.client.0.smithi153.stderr:Aborted 2024-09-19T14:06:14.845 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-19T14:06:14.851 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:14.851 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:14.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.786+0000 7fc76cc8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.786+0000 7fc76cc8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.786+0000 7fc76cc8e9c0 20 realm 2024-09-19T14:06:14.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.786+0000 7fc76cc8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.786+0000 7fc76cc8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.786+0000 7fc76cc8e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:14.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.786+0000 7fc76cc8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.786+0000 7fc76cc8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.786+0000 7fc76cc8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.790+0000 7fc76cc8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:14.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.790+0000 7fc76cc8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.790+0000 7fc76cc8e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:14.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.790+0000 7fc76cc8e9c0 20 searching for the correct realm 2024-09-19T14:06:14.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.794+0000 7fc769f93640 0 -- 172.21.15.153:0/4284029108 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x5555af8631b0 msgr2=0x5555af8655a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:14.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.798+0000 7fc76a794640 0 -- 172.21.15.153:0/4284029108 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fc760008030 msgr2=0x7fc760053120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:14.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.806+0000 7fc76cc8e9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:14.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.806+0000 7fc76cc8e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:14.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.806+0000 7fc76cc8e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:14.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.806+0000 7fc76cc8e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:14.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.806+0000 7fc76cc8e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:14.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.806+0000 7fc76cc8e9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:14.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.806+0000 7fc76cc8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.806+0000 7fc76cc8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.806+0000 7fc76cc8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.806+0000 7fc76cc8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:14.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.806+0000 7fc76cc8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.810+0000 7fc76cc8e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:14.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.810+0000 7fc76cc8e9c0 20 zone default found 2024-09-19T14:06:14.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.810+0000 7fc76cc8e9c0 4 Realm: () 2024-09-19T14:06:14.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.810+0000 7fc76cc8e9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:14.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.810+0000 7fc76cc8e9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:14.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.810+0000 7fc76cc8e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:14.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.810+0000 7fc76cc8e9c0 20 zonegroup default 2024-09-19T14:06:14.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.810+0000 7fc76cc8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.810+0000 7fc76cc8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.810+0000 7fc76cc8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.810+0000 7fc76cc8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.810+0000 7fc76cc8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.810+0000 7fc76cc8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:14.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.810+0000 7fc76cc8e9c0 20 started sync module instance, tier type = 2024-09-19T14:06:14.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.810+0000 7fc76cc8e9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:14.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.826+0000 7fc76cc8e9c0 20 add_watcher() i=0 2024-09-19T14:06:14.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.826+0000 7fc76cc8e9c0 20 add_watcher() i=1 2024-09-19T14:06:14.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.826+0000 7fc76cc8e9c0 20 add_watcher() i=2 2024-09-19T14:06:14.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.826+0000 7fc76cc8e9c0 20 add_watcher() i=3 2024-09-19T14:06:14.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.826+0000 7fc76cc8e9c0 20 add_watcher() i=4 2024-09-19T14:06:14.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.826+0000 7fc76cc8e9c0 20 add_watcher() i=5 2024-09-19T14:06:14.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.826+0000 7fc76cc8e9c0 20 add_watcher() i=6 2024-09-19T14:06:14.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.826+0000 7fc76cc8e9c0 20 add_watcher() i=7 2024-09-19T14:06:14.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.826+0000 7fc76cc8e9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:14.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.830+0000 7fc6217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:14.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.830+0000 7fc76cc8e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:14.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.830+0000 7fc76cc8e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:14.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.830+0000 7fc76cc8e9c0 5 note: GC not initialized 2024-09-19T14:06:14.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.830+0000 7fc61b7fe640 20 reqs_thread_entry: start 2024-09-19T14:06:14.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.830+0000 7fc76cc8e9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:14.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.830+0000 7fc76cc8e9c0 20 Filter name: none 2024-09-19T14:06:14.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.830+0000 7fc6197fa640 20 reqs_thread_entry: start 2024-09-19T14:06:14.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.830+0000 7fc76cc8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.830+0000 7fc76cc8e9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-19T14:06:14.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.830+0000 7fc76cc8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.830+0000 7fc76cc8e9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-19T14:06:14.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.830+0000 7fc76cc8e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:14.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.830+0000 7fc76cc8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.830+0000 7fc76cc8e9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-19T14:06:14.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.830+0000 7fc76cc8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:14.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.830+0000 7fc76cc8e9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-19T14:06:14.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.830+0000 7fc76cc8e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:14.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.834+0000 7fc6217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:14.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.838+0000 7fc76cc8e9c0 20 remove_watcher() i=0 2024-09-19T14:06:14.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.838+0000 7fc76cc8e9c0 2 removed watcher, disabling cache 2024-09-19T14:06:14.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.842+0000 7fc76cc8e9c0 20 remove_watcher() i=1 2024-09-19T14:06:14.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.842+0000 7fc76cc8e9c0 20 remove_watcher() i=2 2024-09-19T14:06:14.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.846+0000 7fc76cc8e9c0 20 remove_watcher() i=3 2024-09-19T14:06:14.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.846+0000 7fc76cc8e9c0 20 remove_watcher() i=4 2024-09-19T14:06:14.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.846+0000 7fc76cc8e9c0 20 remove_watcher() i=5 2024-09-19T14:06:14.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.850+0000 7fc76cc8e9c0 20 remove_watcher() i=6 2024-09-19T14:06:14.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:14.850+0000 7fc76cc8e9c0 20 remove_watcher() i=7 2024-09-19T14:06:14.863 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.863 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:06:14.863 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: abort-at-init-indext id: dbb1da81-49d0-421a-b677-974869a7f103.4620.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:06:14.863 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:14.864 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:14.864 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:14.902 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:14.902 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:14.962 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T14:06:14.997 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:14.997 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:15.040 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.038+0000 7fc9af7239c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:15.042 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.042+0000 7fc9af7239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:15.042 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.042+0000 7fc9af7239c0 20 realm 2024-09-19T14:06:15.042 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.042+0000 7fc9af7239c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:15.042 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.042+0000 7fc9af7239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:15.042 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.042+0000 7fc9af7239c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:15.042 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.042+0000 7fc9af7239c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:15.042 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.042+0000 7fc9af7239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:15.042 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.042+0000 7fc9af7239c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:15.044 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.042+0000 7fc9af7239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:15.044 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.042+0000 7fc9af7239c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:15.044 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.046+0000 7fc9af7239c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:15.044 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.046+0000 7fc9af7239c0 20 searching for the correct realm 2024-09-19T14:06:15.050 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.050+0000 7fc9ada2a640 0 -- 172.21.15.153:0/442580291 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55ce6680f240 msgr2=0x55ce668116b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:15.057 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.058+0000 7fc9aca28640 0 -- 172.21.15.153:0/442580291 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fc9a80f6450 msgr2=0x7fc9a80f6870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:15.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.062+0000 7fc9af7239c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:15.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.062+0000 7fc9af7239c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:15.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.062+0000 7fc9af7239c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:15.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.062+0000 7fc9af7239c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:15.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.062+0000 7fc9af7239c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:15.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.062+0000 7fc9af7239c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:15.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.062+0000 7fc9af7239c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:15.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.062+0000 7fc9af7239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:15.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.062+0000 7fc9af7239c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:15.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.066+0000 7fc9af7239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:15.065 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.066+0000 7fc9af7239c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:15.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.066+0000 7fc9af7239c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:15.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.066+0000 7fc9af7239c0 20 zone default found 2024-09-19T14:06:15.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.066+0000 7fc9af7239c0 4 Realm: () 2024-09-19T14:06:15.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.066+0000 7fc9af7239c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:15.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.066+0000 7fc9af7239c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:15.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.066+0000 7fc9af7239c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:15.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.066+0000 7fc9af7239c0 20 zonegroup default 2024-09-19T14:06:15.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.066+0000 7fc9af7239c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:15.067 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.066+0000 7fc9af7239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:15.067 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.066+0000 7fc9af7239c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:15.067 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.066+0000 7fc9af7239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:15.067 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.066+0000 7fc9af7239c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:15.067 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.066+0000 7fc9af7239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:15.067 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.066+0000 7fc9af7239c0 20 started sync module instance, tier type = 2024-09-19T14:06:15.067 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.066+0000 7fc9af7239c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:15.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.082+0000 7fc9af7239c0 20 add_watcher() i=0 2024-09-19T14:06:15.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.082+0000 7fc9af7239c0 20 add_watcher() i=1 2024-09-19T14:06:15.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.082+0000 7fc9af7239c0 20 add_watcher() i=2 2024-09-19T14:06:15.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.082+0000 7fc9af7239c0 20 add_watcher() i=3 2024-09-19T14:06:15.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.082+0000 7fc9af7239c0 20 add_watcher() i=4 2024-09-19T14:06:15.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.082+0000 7fc9af7239c0 20 add_watcher() i=5 2024-09-19T14:06:15.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.082+0000 7fc9af7239c0 20 add_watcher() i=6 2024-09-19T14:06:15.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.082+0000 7fc9af7239c0 20 add_watcher() i=7 2024-09-19T14:06:15.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.082+0000 7fc9af7239c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:15.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.086+0000 7fc8637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:15.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.086+0000 7fc9af7239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:15.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.086+0000 7fc9af7239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:15.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.086+0000 7fc9af7239c0 5 note: GC not initialized 2024-09-19T14:06:15.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.086+0000 7fc8627e4640 20 reqs_thread_entry: start 2024-09-19T14:06:15.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.086+0000 7fc9af7239c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:15.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.086+0000 7fc9af7239c0 20 Filter name: none 2024-09-19T14:06:15.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.086+0000 7fc7d3fff640 20 reqs_thread_entry: start 2024-09-19T14:06:15.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.086+0000 7fc9af7239c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-19T14:06:15.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.086+0000 7fc9af7239c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:15.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.086+0000 7fc9af7239c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-19T14:06:15.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.086+0000 7fc9af7239c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-19T14:06:15.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.086+0000 7fc9af7239c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-19T14:06:15.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.086+0000 7fc9af7239c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 : miss 2024-09-19T14:06:15.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.086+0000 7fc9af7239c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:15.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.086+0000 7fc9af7239c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-19T14:06:15.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.086+0000 7fc9af7239c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 info.flags=0x17 2024-09-19T14:06:15.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.086+0000 7fc9af7239c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 to cache LRU end 2024-09-19T14:06:15.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.086+0000 7fc9af7239c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:06:15.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.086+0000 7fc9af7239c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:15.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.086+0000 7fc9af7239c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 2024-09-19T14:06:15.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.090+0000 7fc9af7239c0 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 to be held by another RGW process; skipping for now 2024-09-19T14:06:15.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.090+0000 7fc8637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:15.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.094+0000 7fc9af7239c0 20 remove_watcher() i=0 2024-09-19T14:06:15.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.094+0000 7fc9af7239c0 2 removed watcher, disabling cache 2024-09-19T14:06:15.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.098+0000 7fc9af7239c0 20 remove_watcher() i=1 2024-09-19T14:06:15.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.098+0000 7fc9af7239c0 20 remove_watcher() i=2 2024-09-19T14:06:15.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.102+0000 7fc9af7239c0 20 remove_watcher() i=3 2024-09-19T14:06:15.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.102+0000 7fc9af7239c0 20 remove_watcher() i=4 2024-09-19T14:06:15.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.106+0000 7fc9af7239c0 20 remove_watcher() i=5 2024-09-19T14:06:15.107 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.106+0000 7fc9af7239c0 20 remove_watcher() i=6 2024-09-19T14:06:15.108 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:15.106+0000 7fc9af7239c0 20 remove_watcher() i=7 2024-09-19T14:06:15.121 INFO:tasks.workunit.client.0.smithi153.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-19T14:06:45.152 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T14:06:45.190 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:45.190 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:45.235 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.234+0000 7f0170c8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.237 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.238+0000 7f0170c8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:45.237 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.238+0000 7f0170c8e9c0 20 realm 2024-09-19T14:06:45.237 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.238+0000 7f0170c8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.238 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.238+0000 7f0170c8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:45.238 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.238+0000 7f0170c8e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:45.238 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.238+0000 7f0170c8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.238 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.238+0000 7f0170c8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:45.238 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.238+0000 7f0170c8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.239 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.238+0000 7f0170c8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:45.239 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.238+0000 7f0170c8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.240 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.238+0000 7f0170c8e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:45.240 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.238+0000 7f0170c8e9c0 20 searching for the correct realm 2024-09-19T14:06:45.244 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.246+0000 7f016df93640 0 -- 172.21.15.153:0/950092436 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f0168043b00 msgr2=0x7f01680803e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:45.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.250+0000 7f016e794640 0 -- 172.21.15.153:0/950092436 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f0158107920 msgr2=0x7f01580d7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:06:45.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.466+0000 7f0170c8e9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:45.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.466+0000 7f0170c8e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:45.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.466+0000 7f0170c8e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:45.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.466+0000 7f0170c8e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:45.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.466+0000 7f0170c8e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:45.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.466+0000 7f0170c8e9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:45.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.466+0000 7f0170c8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.466+0000 7f0170c8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:45.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.466+0000 7f0170c8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.468 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.466+0000 7f0170c8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:45.468 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.466+0000 7f0170c8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.468 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.470+0000 7f0170c8e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:45.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.470+0000 7f0170c8e9c0 20 zone default found 2024-09-19T14:06:45.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.470+0000 7f0170c8e9c0 4 Realm: () 2024-09-19T14:06:45.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.470+0000 7f0170c8e9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:45.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.470+0000 7f0170c8e9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:45.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.470+0000 7f0170c8e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:45.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.470+0000 7f0170c8e9c0 20 zonegroup default 2024-09-19T14:06:45.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.470+0000 7f0170c8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.470+0000 7f0170c8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:45.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.470+0000 7f0170c8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.470 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.470+0000 7f0170c8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:45.470 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.470+0000 7f0170c8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.471 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.470+0000 7f0170c8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:45.471 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.470+0000 7f0170c8e9c0 20 started sync module instance, tier type = 2024-09-19T14:06:45.471 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.470+0000 7f0170c8e9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:45.496 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.498+0000 7f0170c8e9c0 20 add_watcher() i=0 2024-09-19T14:06:45.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.498+0000 7f0170c8e9c0 20 add_watcher() i=1 2024-09-19T14:06:45.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.498+0000 7f0170c8e9c0 20 add_watcher() i=2 2024-09-19T14:06:45.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.498+0000 7f0170c8e9c0 20 add_watcher() i=3 2024-09-19T14:06:45.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.498+0000 7f0170c8e9c0 20 add_watcher() i=4 2024-09-19T14:06:45.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.498+0000 7f0170c8e9c0 20 add_watcher() i=5 2024-09-19T14:06:45.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.498+0000 7f0170c8e9c0 20 add_watcher() i=6 2024-09-19T14:06:45.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.498+0000 7f0170c8e9c0 20 add_watcher() i=7 2024-09-19T14:06:45.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.498+0000 7f0170c8e9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:45.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.502+0000 7f0024fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:45.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.506+0000 7f0170c8e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:45.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.506+0000 7f0170c8e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:45.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.506+0000 7f0170c8e9c0 5 note: GC not initialized 2024-09-19T14:06:45.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.506+0000 7eff9f7fe640 20 reqs_thread_entry: start 2024-09-19T14:06:45.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.506+0000 7f0170c8e9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:45.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.506+0000 7f0170c8e9c0 20 Filter name: none 2024-09-19T14:06:45.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.506+0000 7eff9d7fa640 20 reqs_thread_entry: start 2024-09-19T14:06:45.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.506+0000 7f0170c8e9c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-19T14:06:45.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.506+0000 7f0170c8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.506+0000 7f0170c8e9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-19T14:06:45.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.506+0000 7f0170c8e9c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-19T14:06:45.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.506+0000 7f0170c8e9c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-19T14:06:45.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.506+0000 7f0170c8e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 : miss 2024-09-19T14:06:45.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.506+0000 7f0170c8e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.506+0000 7f0170c8e9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-19T14:06:45.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.506+0000 7f0170c8e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 info.flags=0x17 2024-09-19T14:06:45.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.506+0000 7f0170c8e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 to cache LRU end 2024-09-19T14:06:45.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.506+0000 7f0170c8e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:06:45.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.506+0000 7f0170c8e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:45.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.506+0000 7f0170c8e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 2024-09-19T14:06:45.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.518+0000 7f0170c8e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 info.flags=0x17 2024-09-19T14:06:45.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.518+0000 7f0170c8e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 to cache LRU end 2024-09-19T14:06:45.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.518+0000 7f0170c8e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:45.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.518+0000 7f0170c8e9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21, ofs0, ns] 2024-09-19T14:06:45.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.518+0000 7f0051ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333471 cookie 94395563485664 notifier 6393 bl.length()=913 2024-09-19T14:06:45.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.518+0000 7f0051ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 info.flags=0x17 2024-09-19T14:06:45.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.518+0000 7f0051ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 to cache LRU end 2024-09-19T14:06:45.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.518+0000 7f0051ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:45.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.522+0000 7f0170c8e9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[dbb1da81-49d0-421a-b677-974869a7f103.4620.21]): orig_sources= new_sources= 2024-09-19T14:06:45.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.522+0000 7f0170c8e9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[dbb1da81-49d0-421a-b677-974869a7f103.4620.21]): potential sources added=[] removed=[] 2024-09-19T14:06:45.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.522+0000 7f0170c8e9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[dbb1da81-49d0-421a-b677-974869a7f103.4620.21]): orig_dests= new_dests= 2024-09-19T14:06:45.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.522+0000 7f0170c8e9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[dbb1da81-49d0-421a-b677-974869a7f103.4620.21]): potential dests added=[] removed=[] 2024-09-19T14:06:45.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1.0 2024-09-19T14:06:45.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1.0 2024-09-19T14:06:45.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1.1 2024-09-19T14:06:45.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1.1 2024-09-19T14:06:45.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1.2 2024-09-19T14:06:45.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1.2 2024-09-19T14:06:45.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1.3 2024-09-19T14:06:45.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1.3 2024-09-19T14:06:45.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1.4 2024-09-19T14:06:45.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1.4 2024-09-19T14:06:45.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1.5 2024-09-19T14:06:45.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1.5 2024-09-19T14:06:45.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1.6 2024-09-19T14:06:45.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1.6 2024-09-19T14:06:45.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1.7 2024-09-19T14:06:45.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1.7 2024-09-19T14:06:45.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1.8 2024-09-19T14:06:45.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1.8 2024-09-19T14:06:45.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1.9 2024-09-19T14:06:45.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1.9 2024-09-19T14:06:45.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1.10 2024-09-19T14:06:45.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1.10 2024-09-19T14:06:45.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1.11 2024-09-19T14:06:45.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1.11 2024-09-19T14:06:45.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.0 2024-09-19T14:06:45.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.530+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1 2024-09-19T14:06:45.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.534+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.2 2024-09-19T14:06:45.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.534+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.3 2024-09-19T14:06:45.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.534+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.4 2024-09-19T14:06:45.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.534+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.5 2024-09-19T14:06:45.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.534+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.6 2024-09-19T14:06:45.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.538+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.7 2024-09-19T14:06:45.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.538+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.8 2024-09-19T14:06:45.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.538+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.9 2024-09-19T14:06:45.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.538+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.10 2024-09-19T14:06:45.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.542+0000 7f0170c8e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 : hit (requested=0x17, cached=0x17) 2024-09-19T14:06:45.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.542+0000 7f0170c8e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 2024-09-19T14:06:45.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.546+0000 7f0170c8e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 info.flags=0x17 2024-09-19T14:06:45.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.546+0000 7f0170c8e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 to cache LRU end 2024-09-19T14:06:45.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.546+0000 7f0170c8e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:45.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.546+0000 7f0170c8e9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21, ofs0, ns] 2024-09-19T14:06:45.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.546+0000 7f0051ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333472 cookie 94395563485664 notifier 6393 bl.length()=913 2024-09-19T14:06:45.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.546+0000 7f0051ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 info.flags=0x17 2024-09-19T14:06:45.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.546+0000 7f0051ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 to cache LRU end 2024-09-19T14:06:45.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.546+0000 7f0051ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:45.549 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.550+0000 7f0170c8e9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[dbb1da81-49d0-421a-b677-974869a7f103.4620.21]): orig_sources= new_sources= 2024-09-19T14:06:45.549 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.550+0000 7f0170c8e9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[dbb1da81-49d0-421a-b677-974869a7f103.4620.21]): potential sources added=[] removed=[] 2024-09-19T14:06:45.549 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.550+0000 7f0170c8e9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[dbb1da81-49d0-421a-b677-974869a7f103.4620.21]): orig_dests= new_dests= 2024-09-19T14:06:45.549 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.550+0000 7f0170c8e9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[dbb1da81-49d0-421a-b677-974869a7f103.4620.21]): potential dests added=[] removed=[] 2024-09-19T14:06:45.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.554+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.0 2024-09-19T14:06:45.554 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.554+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.1 2024-09-19T14:06:45.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.554+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.2 2024-09-19T14:06:45.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.554+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.3 2024-09-19T14:06:45.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.554+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.4 2024-09-19T14:06:45.557 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.558+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.5 2024-09-19T14:06:45.557 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.558+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.6 2024-09-19T14:06:45.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.558+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.7 2024-09-19T14:06:45.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.558+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.8 2024-09-19T14:06:45.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.558+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.9 2024-09-19T14:06:45.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.558+0000 7f0170c8e9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.21.10 2024-09-19T14:06:45.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.558+0000 7f0170c8e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 : hit (requested=0x17, cached=0x17) 2024-09-19T14:06:45.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.558+0000 7f0170c8e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 2024-09-19T14:06:45.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.562+0000 7f0170c8e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 info.flags=0x17 2024-09-19T14:06:45.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.562+0000 7f0170c8e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 to cache LRU end 2024-09-19T14:06:45.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.562+0000 7f0170c8e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:45.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.562+0000 7f0170c8e9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21, ofs0, ns] 2024-09-19T14:06:45.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.562+0000 7f00517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333473 cookie 94395563485664 notifier 6393 bl.length()=881 2024-09-19T14:06:45.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.562+0000 7f00517fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 info.flags=0x17 2024-09-19T14:06:45.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.562+0000 7f00517fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:dbb1da81-49d0-421a-b677-974869a7f103.4620.21 to cache LRU end 2024-09-19T14:06:45.564 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.562+0000 7f00517fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:45.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.566+0000 7f0170c8e9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[dbb1da81-49d0-421a-b677-974869a7f103.4620.21]): orig_sources= new_sources= 2024-09-19T14:06:45.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.566+0000 7f0170c8e9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[dbb1da81-49d0-421a-b677-974869a7f103.4620.21]): potential sources added=[] removed=[] 2024-09-19T14:06:45.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.566+0000 7f0170c8e9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[dbb1da81-49d0-421a-b677-974869a7f103.4620.21]): orig_dests= new_dests= 2024-09-19T14:06:45.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.566+0000 7f0170c8e9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[dbb1da81-49d0-421a-b677-974869a7f103.4620.21]): potential dests added=[] removed=[] 2024-09-19T14:06:45.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.570+0000 7f0170c8e9c0 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-19T14:06:45.574 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.574+0000 7f0024fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:45.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.578+0000 7f0170c8e9c0 20 remove_watcher() i=0 2024-09-19T14:06:45.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.578+0000 7f0170c8e9c0 2 removed watcher, disabling cache 2024-09-19T14:06:45.581 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.582+0000 7f0170c8e9c0 20 remove_watcher() i=1 2024-09-19T14:06:45.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.582+0000 7f0170c8e9c0 20 remove_watcher() i=2 2024-09-19T14:06:45.585 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.586+0000 7f0170c8e9c0 20 remove_watcher() i=3 2024-09-19T14:06:45.587 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.586+0000 7f0170c8e9c0 20 remove_watcher() i=4 2024-09-19T14:06:45.589 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.590+0000 7f0170c8e9c0 20 remove_watcher() i=5 2024-09-19T14:06:45.590 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.590+0000 7f0170c8e9c0 20 remove_watcher() i=6 2024-09-19T14:06:45.592 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.590+0000 7f0170c8e9c0 20 remove_watcher() i=7 2024-09-19T14:06:45.607 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-19T14:06:45.635 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:45.635 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:45.679 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.678+0000 7f2e71c599c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.682 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.682+0000 7f2e71c599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:45.682 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.682+0000 7f2e71c599c0 20 realm 2024-09-19T14:06:45.682 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.682+0000 7f2e71c599c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.682 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.682+0000 7f2e71c599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:45.682 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.682+0000 7f2e71c599c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:45.682 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.682+0000 7f2e71c599c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.682 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.682+0000 7f2e71c599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:45.682 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.682+0000 7f2e71c599c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.682+0000 7f2e71c599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:45.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.682+0000 7f2e71c599c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.682+0000 7f2e71c599c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:45.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.682+0000 7f2e71c599c0 20 searching for the correct realm 2024-09-19T14:06:45.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.690+0000 7f2e6ff60640 0 -- 172.21.15.153:0/2153107897 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f2e640695c0 msgr2=0x7f2e64072230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:45.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.694+0000 7f2e6f75f640 0 -- 172.21.15.153:0/2153107897 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f2e6409f280 msgr2=0x7f2e64067730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:45.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.910+0000 7f2e71c599c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:45.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.910+0000 7f2e71c599c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:45.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.910+0000 7f2e71c599c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:45.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.910+0000 7f2e71c599c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:45.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.910+0000 7f2e71c599c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:45.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.910+0000 7f2e71c599c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:45.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.910+0000 7f2e71c599c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.914+0000 7f2e71c599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:45.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.914+0000 7f2e71c599c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.914 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.914+0000 7f2e71c599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:45.914 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.914+0000 7f2e71c599c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.914+0000 7f2e71c599c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:45.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.914+0000 7f2e71c599c0 20 zone default found 2024-09-19T14:06:45.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.914+0000 7f2e71c599c0 4 Realm: () 2024-09-19T14:06:45.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.914+0000 7f2e71c599c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:45.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.914+0000 7f2e71c599c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:45.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.914+0000 7f2e71c599c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:45.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.914+0000 7f2e71c599c0 20 zonegroup default 2024-09-19T14:06:45.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.914+0000 7f2e71c599c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.914+0000 7f2e71c599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:45.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.914+0000 7f2e71c599c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.918+0000 7f2e71c599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:45.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.918+0000 7f2e71c599c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.918+0000 7f2e71c599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:45.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.918+0000 7f2e71c599c0 20 started sync module instance, tier type = 2024-09-19T14:06:45.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.918+0000 7f2e71c599c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:45.938 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.938+0000 7f2e71c599c0 20 add_watcher() i=0 2024-09-19T14:06:45.938 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.938+0000 7f2e71c599c0 20 add_watcher() i=1 2024-09-19T14:06:45.938 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.938+0000 7f2e71c599c0 20 add_watcher() i=2 2024-09-19T14:06:45.938 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.938+0000 7f2e71c599c0 20 add_watcher() i=3 2024-09-19T14:06:45.938 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.938+0000 7f2e71c599c0 20 add_watcher() i=4 2024-09-19T14:06:45.938 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.938+0000 7f2e71c599c0 20 add_watcher() i=5 2024-09-19T14:06:45.938 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.938+0000 7f2e71c599c0 20 add_watcher() i=6 2024-09-19T14:06:45.940 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.938+0000 7f2e71c599c0 20 add_watcher() i=7 2024-09-19T14:06:45.940 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.938+0000 7f2e71c599c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:45.943 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.942+0000 7f2d25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:45.943 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.942+0000 7f2e71c599c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:45.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.942+0000 7f2e71c599c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:45.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.942+0000 7f2e71c599c0 5 note: GC not initialized 2024-09-19T14:06:45.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.942+0000 7f2d24fe1640 20 reqs_thread_entry: start 2024-09-19T14:06:45.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.942+0000 7f2e71c599c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:45.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.942+0000 7f2e71c599c0 20 Filter name: none 2024-09-19T14:06:45.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.942+0000 7f2c9e7fc640 20 reqs_thread_entry: start 2024-09-19T14:06:45.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.946+0000 7f2e71c599c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.946+0000 7f2e71c599c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-19T14:06:45.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.946+0000 7f2e71c599c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.946+0000 7f2e71c599c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-19T14:06:45.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.946+0000 7f2e71c599c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:45.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.946+0000 7f2e71c599c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.946+0000 7f2e71c599c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-19T14:06:45.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.946+0000 7f2e71c599c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:45.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.946+0000 7f2e71c599c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-19T14:06:45.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.946+0000 7f2e71c599c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:45.950 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.950+0000 7f2d25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:45.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.954+0000 7f2e71c599c0 20 remove_watcher() i=0 2024-09-19T14:06:45.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.954+0000 7f2e71c599c0 2 removed watcher, disabling cache 2024-09-19T14:06:45.956 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.954+0000 7f2e71c599c0 20 remove_watcher() i=1 2024-09-19T14:06:45.958 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.958+0000 7f2e71c599c0 20 remove_watcher() i=2 2024-09-19T14:06:45.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.962+0000 7f2e71c599c0 20 remove_watcher() i=3 2024-09-19T14:06:45.962 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.962+0000 7f2e71c599c0 20 remove_watcher() i=4 2024-09-19T14:06:45.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.962+0000 7f2e71c599c0 20 remove_watcher() i=5 2024-09-19T14:06:45.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.966+0000 7f2e71c599c0 20 remove_watcher() i=6 2024-09-19T14:06:45.966 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:45.966+0000 7f2e71c599c0 20 remove_watcher() i=7 2024-09-19T14:06:45.983 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:45.983 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:06:45.983 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: abort-at-init-indext id: dbb1da81-49d0-421a-b677-974869a7f103.4620.21 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T14:06:45.983 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:45.984 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:45.985 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:46.013 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:46.013 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:46.628 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:46.629 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:47.003 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-19T14:06:47.003 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:47.008 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:47.008 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:47.155 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:47.156 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:47.245 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:47.245 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:47.349 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:47.349 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:47.445 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:47.445 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:47.545 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:47.546 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:47.645 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:47.645 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:47.740 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:47.740 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:47.826 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:47.826 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:47.920 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:47.920 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:48.019 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:48.019 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:48.125 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:48.125 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:48.224 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:48.224 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:48.328 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:48.328 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:48.432 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:48.432 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:48.521 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:48.521 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:48.620 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:48.620 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:48.718 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:48.718 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:48.833 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:48.833 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:48.924 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:48.924 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:49.026 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:49.026 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:49.129 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:49.129 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:49.226 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-19T14:06:49.259 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:49.260 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:49.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.306+0000 7f27858df9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.310+0000 7f27858df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:49.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.310+0000 7f27858df9c0 20 realm 2024-09-19T14:06:49.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.310+0000 7f27858df9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.310+0000 7f27858df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:49.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.310+0000 7f27858df9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:49.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.310+0000 7f27858df9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.310+0000 7f27858df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:49.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.310+0000 7f27858df9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.310+0000 7f27858df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:49.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.310+0000 7f27858df9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.310+0000 7f27858df9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:49.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.310+0000 7f27858df9c0 20 searching for the correct realm 2024-09-19T14:06:49.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.314+0000 7f2782be4640 0 -- 172.21.15.153:0/4055040478 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f2774041070 msgr2=0x7f2774028040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:49.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.322+0000 7f27833e5640 0 -- 172.21.15.153:0/4055040478 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f276c0d7920 msgr2=0x7f276c0ea410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:06:49.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.538+0000 7f27858df9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:49.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.538+0000 7f27858df9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:49.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.538+0000 7f27858df9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:49.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.538+0000 7f27858df9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:49.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.538+0000 7f27858df9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:49.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.538+0000 7f27858df9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:49.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.538+0000 7f27858df9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.538+0000 7f27858df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:49.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.538+0000 7f27858df9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.542+0000 7f27858df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:49.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.542+0000 7f27858df9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.542+0000 7f27858df9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:49.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.542+0000 7f27858df9c0 20 zone default found 2024-09-19T14:06:49.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.542+0000 7f27858df9c0 4 Realm: () 2024-09-19T14:06:49.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.542+0000 7f27858df9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:49.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.542+0000 7f27858df9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:49.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.542+0000 7f27858df9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:49.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.542+0000 7f27858df9c0 20 zonegroup default 2024-09-19T14:06:49.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.542+0000 7f27858df9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.542+0000 7f27858df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:49.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.542+0000 7f27858df9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.542+0000 7f27858df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:49.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.542+0000 7f27858df9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.542+0000 7f27858df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:49.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.542+0000 7f27858df9c0 20 started sync module instance, tier type = 2024-09-19T14:06:49.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.542+0000 7f27858df9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:49.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.566+0000 7f27858df9c0 20 add_watcher() i=0 2024-09-19T14:06:49.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.566+0000 7f27858df9c0 20 add_watcher() i=1 2024-09-19T14:06:49.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.566+0000 7f27858df9c0 20 add_watcher() i=2 2024-09-19T14:06:49.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.566+0000 7f27858df9c0 20 add_watcher() i=3 2024-09-19T14:06:49.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.566+0000 7f27858df9c0 20 add_watcher() i=4 2024-09-19T14:06:49.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.566+0000 7f27858df9c0 20 add_watcher() i=5 2024-09-19T14:06:49.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.566+0000 7f27858df9c0 20 add_watcher() i=6 2024-09-19T14:06:49.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.570+0000 7f27858df9c0 20 add_watcher() i=7 2024-09-19T14:06:49.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.570+0000 7f27858df9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:49.575 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.574+0000 7f2639fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:49.576 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.574+0000 7f27858df9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:49.576 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.574+0000 7f27858df9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:49.576 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.574+0000 7f27858df9c0 5 note: GC not initialized 2024-09-19T14:06:49.577 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.574+0000 7f2638fe1640 20 reqs_thread_entry: start 2024-09-19T14:06:49.577 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.578+0000 7f27858df9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:49.577 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.578+0000 7f27858df9c0 20 Filter name: none 2024-09-19T14:06:49.577 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.578+0000 7f25b27fc640 20 reqs_thread_entry: start 2024-09-19T14:06:49.577 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.578+0000 7f27858df9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.578 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.578+0000 7f27858df9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-19T14:06:49.578 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.578+0000 7f27858df9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.578+0000 7f27858df9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-19T14:06:49.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.578+0000 7f27858df9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:49.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.578+0000 7f27858df9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.578+0000 7f27858df9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-19T14:06:49.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.578+0000 7f27858df9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.581 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.582+0000 7f27858df9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-19T14:06:49.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.582+0000 7f27858df9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:49.585 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.586+0000 7f2639fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:49.590 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.590+0000 7f27858df9c0 20 remove_watcher() i=0 2024-09-19T14:06:49.590 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.590+0000 7f27858df9c0 2 removed watcher, disabling cache 2024-09-19T14:06:49.592 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.590+0000 7f27858df9c0 20 remove_watcher() i=1 2024-09-19T14:06:49.595 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.594+0000 7f27858df9c0 20 remove_watcher() i=2 2024-09-19T14:06:49.598 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.598+0000 7f27858df9c0 20 remove_watcher() i=3 2024-09-19T14:06:49.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.598+0000 7f27858df9c0 20 remove_watcher() i=4 2024-09-19T14:06:49.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.602+0000 7f27858df9c0 20 remove_watcher() i=5 2024-09-19T14:06:49.603 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.602+0000 7f27858df9c0 20 remove_watcher() i=6 2024-09-19T14:06:49.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.606+0000 7f27858df9c0 20 remove_watcher() i=7 2024-09-19T14:06:49.619 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:49.619 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:06:49.619 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-set-target-layout id: dbb1da81-49d0-421a-b677-974869a7f103.4620.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:06:49.619 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:49.619 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-19T14:06:49.653 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:49.653 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:49.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.698+0000 7f17cd47c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.698+0000 7f17cd47c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:49.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.698+0000 7f17cd47c9c0 20 realm 2024-09-19T14:06:49.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.698+0000 7f17cd47c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.698+0000 7f17cd47c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:49.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.698+0000 7f17cd47c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:49.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.698+0000 7f17cd47c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.698+0000 7f17cd47c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:49.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.698+0000 7f17cd47c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.702+0000 7f17cd47c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:49.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.702+0000 7f17cd47c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.702+0000 7f17cd47c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:49.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.702+0000 7f17cd47c9c0 20 searching for the correct realm 2024-09-19T14:06:49.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.706+0000 7f17ca781640 0 -- 172.21.15.153:0/368652613 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f17bc06c0d0 msgr2=0x7f17bc064030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:49.711 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.710+0000 7f17caf82640 0 -- 172.21.15.153:0/368652613 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x7f17c4028020 msgr2=0x7f17c405e290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:49.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:49.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:49.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:49.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:49.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:49.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:49.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:49.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.722 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:49.722 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:49.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 20 zone default found 2024-09-19T14:06:49.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 4 Realm: () 2024-09-19T14:06:49.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:49.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:49.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:49.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 20 zonegroup default 2024-09-19T14:06:49.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:49.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:49.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:49.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 20 started sync module instance, tier type = 2024-09-19T14:06:49.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.722+0000 7f17cd47c9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:49.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.738+0000 7f17cd47c9c0 20 add_watcher() i=0 2024-09-19T14:06:49.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.738+0000 7f17cd47c9c0 20 add_watcher() i=1 2024-09-19T14:06:49.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.738+0000 7f17cd47c9c0 20 add_watcher() i=2 2024-09-19T14:06:49.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.738+0000 7f17cd47c9c0 20 add_watcher() i=3 2024-09-19T14:06:49.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.738+0000 7f17cd47c9c0 20 add_watcher() i=4 2024-09-19T14:06:49.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.738+0000 7f17cd47c9c0 20 add_watcher() i=5 2024-09-19T14:06:49.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.738+0000 7f17cd47c9c0 20 add_watcher() i=6 2024-09-19T14:06:49.740 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.738+0000 7f17cd47c9c0 20 add_watcher() i=7 2024-09-19T14:06:49.740 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.738+0000 7f17cd47c9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:49.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.742+0000 7f16817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:49.743 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.742+0000 7f17cd47c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:49.743 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.742+0000 7f17cd47c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:49.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.742+0000 7f17cd47c9c0 5 note: GC not initialized 2024-09-19T14:06:49.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.742+0000 7f15fbfff640 20 reqs_thread_entry: start 2024-09-19T14:06:49.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.742+0000 7f17cd47c9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:49.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.742+0000 7f17cd47c9c0 20 Filter name: none 2024-09-19T14:06:49.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.742+0000 7f15f9ffb640 20 reqs_thread_entry: start 2024-09-19T14:06:49.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.742+0000 7f17cd47c9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-19T14:06:49.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.742+0000 7f17cd47c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.742+0000 7f17cd47c9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-19T14:06:49.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.742+0000 7f17cd47c9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-19T14:06:49.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.742+0000 7f17cd47c9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-19T14:06:49.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.742+0000 7f17cd47c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22 : miss 2024-09-19T14:06:49.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.742+0000 7f17cd47c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.746 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.746+0000 7f17cd47c9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-19T14:06:49.746 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.746+0000 7f17cd47c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22 info.flags=0x17 2024-09-19T14:06:49.746 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.746+0000 7f17cd47c9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22 to cache LRU end 2024-09-19T14:06:49.746 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.746+0000 7f17cd47c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:06:49.746 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.746+0000 7f17cd47c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:49.746 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.746+0000 7f17cd47c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22 2024-09-19T14:06:49.752 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.750+0000 7f17cd47c9c0 -1 Injecting error=-5 at location=set_target_layout 2024-09-19T14:06:49.752 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.750+0000 7f17cd47c9c0 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-19T14:06:49.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.758+0000 7f16817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:49.764 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.762+0000 7f17cd47c9c0 20 remove_watcher() i=0 2024-09-19T14:06:49.764 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.762+0000 7f17cd47c9c0 2 removed watcher, disabling cache 2024-09-19T14:06:49.766 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.766+0000 7f17cd47c9c0 20 remove_watcher() i=1 2024-09-19T14:06:49.768 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.766+0000 7f17cd47c9c0 20 remove_watcher() i=2 2024-09-19T14:06:49.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.770+0000 7f17cd47c9c0 20 remove_watcher() i=3 2024-09-19T14:06:49.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.770+0000 7f17cd47c9c0 20 remove_watcher() i=4 2024-09-19T14:06:49.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.774+0000 7f17cd47c9c0 20 remove_watcher() i=5 2024-09-19T14:06:49.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.774+0000 7f17cd47c9c0 20 remove_watcher() i=6 2024-09-19T14:06:49.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.774+0000 7f17cd47c9c0 20 remove_watcher() i=7 2024-09-19T14:06:49.789 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-19T14:06:49.816 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:49.816 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:49.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.858+0000 7ff517a5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.862+0000 7ff517a5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:49.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.862+0000 7ff517a5a9c0 20 realm 2024-09-19T14:06:49.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.862+0000 7ff517a5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.862+0000 7ff517a5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:49.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.862+0000 7ff517a5a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:49.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.862+0000 7ff517a5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.862+0000 7ff517a5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:49.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.862+0000 7ff517a5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.862+0000 7ff517a5a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:49.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.862+0000 7ff517a5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.862+0000 7ff517a5a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:49.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.862+0000 7ff517a5a9c0 20 searching for the correct realm 2024-09-19T14:06:49.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.870+0000 7ff514d5f640 0 -- 172.21.15.153:0/2975571490 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55cd3f256b00 msgr2=0x55cd3f258fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:06:49.875 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.874+0000 7ff515560640 0 -- 172.21.15.153:0/2975571490 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7ff50c0ed910 msgr2=0x7ff50c0df3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:49.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.882+0000 7ff517a5a9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:49.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.882+0000 7ff517a5a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:49.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.882+0000 7ff517a5a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:49.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.882+0000 7ff517a5a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:49.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.882+0000 7ff517a5a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:49.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.882+0000 7ff517a5a9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:49.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.882+0000 7ff517a5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.882+0000 7ff517a5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:49.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.882+0000 7ff517a5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.882+0000 7ff517a5a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:49.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.882+0000 7ff517a5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.885 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.886+0000 7ff517a5a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:49.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.886+0000 7ff517a5a9c0 20 zone default found 2024-09-19T14:06:49.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.886+0000 7ff517a5a9c0 4 Realm: () 2024-09-19T14:06:49.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.886+0000 7ff517a5a9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:49.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.886+0000 7ff517a5a9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:49.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.886+0000 7ff517a5a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:49.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.886+0000 7ff517a5a9c0 20 zonegroup default 2024-09-19T14:06:49.887 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.886+0000 7ff517a5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.887 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.886+0000 7ff517a5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:49.887 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.886+0000 7ff517a5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.886+0000 7ff517a5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:49.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.886+0000 7ff517a5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.886+0000 7ff517a5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:49.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.886+0000 7ff517a5a9c0 20 started sync module instance, tier type = 2024-09-19T14:06:49.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.886+0000 7ff517a5a9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:49.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.902+0000 7ff517a5a9c0 20 add_watcher() i=0 2024-09-19T14:06:49.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.902+0000 7ff517a5a9c0 20 add_watcher() i=1 2024-09-19T14:06:49.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.902+0000 7ff517a5a9c0 20 add_watcher() i=2 2024-09-19T14:06:49.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.902+0000 7ff517a5a9c0 20 add_watcher() i=3 2024-09-19T14:06:49.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.902+0000 7ff517a5a9c0 20 add_watcher() i=4 2024-09-19T14:06:49.903 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.902+0000 7ff517a5a9c0 20 add_watcher() i=5 2024-09-19T14:06:49.903 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.902+0000 7ff517a5a9c0 20 add_watcher() i=6 2024-09-19T14:06:49.903 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.902+0000 7ff517a5a9c0 20 add_watcher() i=7 2024-09-19T14:06:49.904 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.902+0000 7ff517a5a9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:49.907 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.906+0000 7ff3cbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:49.907 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.906+0000 7ff517a5a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:49.907 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.906+0000 7ff517a5a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:49.907 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.906+0000 7ff517a5a9c0 5 note: GC not initialized 2024-09-19T14:06:49.908 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.906+0000 7ff3cafe5640 20 reqs_thread_entry: start 2024-09-19T14:06:49.908 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.906+0000 7ff517a5a9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:49.908 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.906+0000 7ff517a5a9c0 20 Filter name: none 2024-09-19T14:06:49.908 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.906+0000 7ff3c8fe1640 20 reqs_thread_entry: start 2024-09-19T14:06:49.908 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.906+0000 7ff517a5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.908 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.906+0000 7ff517a5a9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-19T14:06:49.909 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.906+0000 7ff517a5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.910 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.906+0000 7ff517a5a9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-19T14:06:49.911 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.906+0000 7ff517a5a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:49.911 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.906+0000 7ff517a5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.911 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.906+0000 7ff517a5a9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-19T14:06:49.911 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.906+0000 7ff517a5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:49.911 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.910+0000 7ff517a5a9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-19T14:06:49.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.910+0000 7ff517a5a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:49.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.910+0000 7ff3cbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:49.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.918+0000 7ff517a5a9c0 20 remove_watcher() i=0 2024-09-19T14:06:49.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.918+0000 7ff517a5a9c0 2 removed watcher, disabling cache 2024-09-19T14:06:49.919 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.918+0000 7ff517a5a9c0 20 remove_watcher() i=1 2024-09-19T14:06:49.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.922+0000 7ff517a5a9c0 20 remove_watcher() i=2 2024-09-19T14:06:49.923 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.922+0000 7ff517a5a9c0 20 remove_watcher() i=3 2024-09-19T14:06:49.925 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.926+0000 7ff517a5a9c0 20 remove_watcher() i=4 2024-09-19T14:06:49.926 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.926+0000 7ff517a5a9c0 20 remove_watcher() i=5 2024-09-19T14:06:49.928 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.926+0000 7ff517a5a9c0 20 remove_watcher() i=6 2024-09-19T14:06:49.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:49.930+0000 7ff517a5a9c0 20 remove_watcher() i=7 2024-09-19T14:06:49.942 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:49.942 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:06:49.942 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-set-target-layout id: dbb1da81-49d0-421a-b677-974869a7f103.4620.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:06:49.942 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:49.943 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:49.943 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:49.982 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:49.982 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:50.042 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T14:06:50.077 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:50.077 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:50.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.122+0000 7f541e2529c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.122+0000 7f541e2529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:50.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.122+0000 7f541e2529c0 20 realm 2024-09-19T14:06:50.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.122+0000 7f541e2529c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.122+0000 7f541e2529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:50.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.122+0000 7f541e2529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:50.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.122+0000 7f541e2529c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.122+0000 7f541e2529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:50.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.122+0000 7f541e2529c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.126+0000 7f541e2529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:50.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.126+0000 7f541e2529c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.126+0000 7f541e2529c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:50.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.126+0000 7f541e2529c0 20 searching for the correct realm 2024-09-19T14:06:50.132 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.130+0000 7f541b557640 0 -- 172.21.15.153:0/2483412410 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x561d05dba800 msgr2=0x561d05dbcca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:50.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.138+0000 7f541bd58640 0 -- 172.21.15.153:0/2483412410 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f5404016070 msgr2=0x7f54040a05c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:50.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.146+0000 7f541e2529c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:50.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.146+0000 7f541e2529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:50.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.146+0000 7f541e2529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:50.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.146+0000 7f541e2529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:50.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.146+0000 7f541e2529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:50.147 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.146+0000 7f541e2529c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:50.147 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.146+0000 7f541e2529c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.147 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.146+0000 7f541e2529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:50.147 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.146+0000 7f541e2529c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.147 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.146+0000 7f541e2529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:50.147 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.146+0000 7f541e2529c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.146+0000 7f541e2529c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:50.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.146+0000 7f541e2529c0 20 zone default found 2024-09-19T14:06:50.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.146+0000 7f541e2529c0 4 Realm: () 2024-09-19T14:06:50.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.146+0000 7f541e2529c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:50.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.146+0000 7f541e2529c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:50.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.146+0000 7f541e2529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:50.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.146+0000 7f541e2529c0 20 zonegroup default 2024-09-19T14:06:50.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.146+0000 7f541e2529c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.150+0000 7f541e2529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:50.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.150+0000 7f541e2529c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.150+0000 7f541e2529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:50.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.150+0000 7f541e2529c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.150+0000 7f541e2529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:50.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.150+0000 7f541e2529c0 20 started sync module instance, tier type = 2024-09-19T14:06:50.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.150+0000 7f541e2529c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:50.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.162+0000 7f541e2529c0 20 add_watcher() i=0 2024-09-19T14:06:50.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.162+0000 7f541e2529c0 20 add_watcher() i=1 2024-09-19T14:06:50.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.162+0000 7f541e2529c0 20 add_watcher() i=2 2024-09-19T14:06:50.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.162+0000 7f541e2529c0 20 add_watcher() i=3 2024-09-19T14:06:50.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.162+0000 7f541e2529c0 20 add_watcher() i=4 2024-09-19T14:06:50.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.162+0000 7f541e2529c0 20 add_watcher() i=5 2024-09-19T14:06:50.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.162+0000 7f541e2529c0 20 add_watcher() i=6 2024-09-19T14:06:50.165 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.166+0000 7f541e2529c0 20 add_watcher() i=7 2024-09-19T14:06:50.165 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.166+0000 7f541e2529c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:50.167 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.166+0000 7f52d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:50.169 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.166+0000 7f541e2529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:50.169 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.166+0000 7f541e2529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:50.169 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.166+0000 7f541e2529c0 5 note: GC not initialized 2024-09-19T14:06:50.169 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.166+0000 7f52d17e2640 20 reqs_thread_entry: start 2024-09-19T14:06:50.169 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.166+0000 7f541e2529c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:50.169 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.166+0000 7f541e2529c0 20 Filter name: none 2024-09-19T14:06:50.169 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.166+0000 7f52ca7fc640 20 reqs_thread_entry: start 2024-09-19T14:06:50.169 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.166+0000 7f541e2529c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-19T14:06:50.169 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.166+0000 7f541e2529c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.169 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.170+0000 7f541e2529c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-19T14:06:50.169 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.170+0000 7f541e2529c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-19T14:06:50.169 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.170+0000 7f541e2529c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-19T14:06:50.169 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.170+0000 7f541e2529c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22 : miss 2024-09-19T14:06:50.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.170+0000 7f541e2529c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.170+0000 7f541e2529c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-19T14:06:50.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.170+0000 7f541e2529c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22 info.flags=0x17 2024-09-19T14:06:50.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.170+0000 7f541e2529c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22 to cache LRU end 2024-09-19T14:06:50.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.170+0000 7f541e2529c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:06:50.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.170+0000 7f541e2529c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:50.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.170+0000 7f541e2529c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22 2024-09-19T14:06:50.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.178+0000 7f541e2529c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22 info.flags=0x17 2024-09-19T14:06:50.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.178+0000 7f541e2529c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22 to cache LRU end 2024-09-19T14:06:50.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.178+0000 7f541e2529c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:50.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.178+0000 7f541e2529c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22, ofs0, ns] 2024-09-19T14:06:50.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.182+0000 7f52faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333471 cookie 94682652337696 notifier 6486 bl.length()=925 2024-09-19T14:06:50.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.182+0000 7f52faffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22 info.flags=0x17 2024-09-19T14:06:50.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.182+0000 7f52faffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22 to cache LRU end 2024-09-19T14:06:50.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.182+0000 7f52faffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:50.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.182+0000 7f541e2529c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.22]): orig_sources= new_sources= 2024-09-19T14:06:50.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.182+0000 7f541e2529c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.22]): potential sources added=[] removed=[] 2024-09-19T14:06:50.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.182+0000 7f541e2529c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.22]): orig_dests= new_dests= 2024-09-19T14:06:50.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.182+0000 7f541e2529c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.22]): potential dests added=[] removed=[] 2024-09-19T14:06:50.192 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1.0 2024-09-19T14:06:50.192 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1.0 2024-09-19T14:06:50.192 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1.1 2024-09-19T14:06:50.192 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1.1 2024-09-19T14:06:50.192 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1.2 2024-09-19T14:06:50.192 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1.2 2024-09-19T14:06:50.192 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1.3 2024-09-19T14:06:50.192 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1.3 2024-09-19T14:06:50.192 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1.4 2024-09-19T14:06:50.192 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1.4 2024-09-19T14:06:50.192 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1.5 2024-09-19T14:06:50.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1.5 2024-09-19T14:06:50.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1.6 2024-09-19T14:06:50.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1.6 2024-09-19T14:06:50.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1.7 2024-09-19T14:06:50.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1.7 2024-09-19T14:06:50.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1.8 2024-09-19T14:06:50.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1.8 2024-09-19T14:06:50.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1.9 2024-09-19T14:06:50.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1.9 2024-09-19T14:06:50.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1.10 2024-09-19T14:06:50.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1.10 2024-09-19T14:06:50.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1.11 2024-09-19T14:06:50.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1.11 2024-09-19T14:06:50.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.190+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.0 2024-09-19T14:06:50.194 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.194+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1 2024-09-19T14:06:50.194 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.194+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.2 2024-09-19T14:06:50.194 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.194+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.3 2024-09-19T14:06:50.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.194+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.4 2024-09-19T14:06:50.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.194+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.5 2024-09-19T14:06:50.196 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.194+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.6 2024-09-19T14:06:50.196 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.198+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.7 2024-09-19T14:06:50.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.198+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.8 2024-09-19T14:06:50.199 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.198+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.9 2024-09-19T14:06:50.199 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.198+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.10 2024-09-19T14:06:50.205 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.206+0000 7f541e2529c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22 : hit (requested=0x17, cached=0x17) 2024-09-19T14:06:50.205 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.206+0000 7f541e2529c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22 2024-09-19T14:06:50.208 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.206+0000 7f541e2529c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22 info.flags=0x17 2024-09-19T14:06:50.208 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.206+0000 7f541e2529c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22 to cache LRU end 2024-09-19T14:06:50.208 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.206+0000 7f541e2529c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:50.208 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.206+0000 7f541e2529c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22, ofs0, ns] 2024-09-19T14:06:50.209 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.210+0000 7f52faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333472 cookie 94682652337696 notifier 6486 bl.length()=925 2024-09-19T14:06:50.209 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.210+0000 7f52faffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22 info.flags=0x17 2024-09-19T14:06:50.209 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.210+0000 7f52faffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22 to cache LRU end 2024-09-19T14:06:50.209 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.210+0000 7f52faffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:50.210 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.210+0000 7f541e2529c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.22]): orig_sources= new_sources= 2024-09-19T14:06:50.210 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.210+0000 7f541e2529c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.22]): potential sources added=[] removed=[] 2024-09-19T14:06:50.210 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.210+0000 7f541e2529c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.22]): orig_dests= new_dests= 2024-09-19T14:06:50.211 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.210+0000 7f541e2529c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.22]): potential dests added=[] removed=[] 2024-09-19T14:06:50.214 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.214+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.0 2024-09-19T14:06:50.215 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.214+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.1 2024-09-19T14:06:50.216 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.214+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.2 2024-09-19T14:06:50.216 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.214+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.3 2024-09-19T14:06:50.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.218+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.4 2024-09-19T14:06:50.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.218+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.5 2024-09-19T14:06:50.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.218+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.6 2024-09-19T14:06:50.218 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.218+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.7 2024-09-19T14:06:50.219 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.218+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.8 2024-09-19T14:06:50.219 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.218+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.9 2024-09-19T14:06:50.219 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.218+0000 7f541e2529c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.22.10 2024-09-19T14:06:50.220 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.222+0000 7f541e2529c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22 : hit (requested=0x17, cached=0x17) 2024-09-19T14:06:50.220 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.222+0000 7f541e2529c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22 2024-09-19T14:06:50.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.222+0000 7f541e2529c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22 info.flags=0x17 2024-09-19T14:06:50.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.222+0000 7f541e2529c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22 to cache LRU end 2024-09-19T14:06:50.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.222+0000 7f541e2529c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:50.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.222+0000 7f541e2529c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22, ofs0, ns] 2024-09-19T14:06:50.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.222+0000 7f52faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333473 cookie 94682652337696 notifier 6486 bl.length()=893 2024-09-19T14:06:50.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.222+0000 7f52faffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22 info.flags=0x17 2024-09-19T14:06:50.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.222+0000 7f52faffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.22 to cache LRU end 2024-09-19T14:06:50.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.222+0000 7f52faffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:50.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.226+0000 7f541e2529c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.22]): orig_sources= new_sources= 2024-09-19T14:06:50.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.226+0000 7f541e2529c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.22]): potential sources added=[] removed=[] 2024-09-19T14:06:50.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.226+0000 7f541e2529c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.22]): orig_dests= new_dests= 2024-09-19T14:06:50.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.226+0000 7f541e2529c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.22]): potential dests added=[] removed=[] 2024-09-19T14:06:50.230 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.230+0000 7f541e2529c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-19T14:06:50.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.234+0000 7f52d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:50.237 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.238+0000 7f541e2529c0 20 remove_watcher() i=0 2024-09-19T14:06:50.237 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.238+0000 7f541e2529c0 2 removed watcher, disabling cache 2024-09-19T14:06:50.239 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.238+0000 7f541e2529c0 20 remove_watcher() i=1 2024-09-19T14:06:50.242 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.242+0000 7f541e2529c0 20 remove_watcher() i=2 2024-09-19T14:06:50.243 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.242+0000 7f541e2529c0 20 remove_watcher() i=3 2024-09-19T14:06:50.245 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.246+0000 7f541e2529c0 20 remove_watcher() i=4 2024-09-19T14:06:50.247 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.246+0000 7f541e2529c0 20 remove_watcher() i=5 2024-09-19T14:06:50.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.246+0000 7f541e2529c0 20 remove_watcher() i=6 2024-09-19T14:06:50.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.250+0000 7f541e2529c0 20 remove_watcher() i=7 2024-09-19T14:06:50.263 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-19T14:06:50.293 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:50.294 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:50.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.546+0000 7f0aceffc9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.550+0000 7f0aceffc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:50.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.550+0000 7f0aceffc9c0 20 realm 2024-09-19T14:06:50.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.550+0000 7f0aceffc9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.550+0000 7f0aceffc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:50.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.550+0000 7f0aceffc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:50.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.550+0000 7f0aceffc9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.550+0000 7f0aceffc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:50.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.550+0000 7f0aceffc9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.550+0000 7f0aceffc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:50.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.550+0000 7f0aceffc9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.550+0000 7f0aceffc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:50.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.554+0000 7f0aceffc9c0 20 searching for the correct realm 2024-09-19T14:06:50.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.558+0000 7f0acd303640 0 -- 172.21.15.153:0/3714199463 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f0ac001a040 msgr2=0x7f0ac005e730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:50.564 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.566+0000 7f0accb02640 0 -- 172.21.15.153:0/3714199463 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f0ac0023760 msgr2=0x7f0ac005de30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:50.784 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.782+0000 7f0aceffc9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:50.784 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.782+0000 7f0aceffc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:50.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.782+0000 7f0aceffc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:50.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.782+0000 7f0aceffc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:50.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.782+0000 7f0aceffc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:50.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.782+0000 7f0aceffc9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:50.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.782+0000 7f0aceffc9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.786+0000 7f0aceffc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:50.786 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.786+0000 7f0aceffc9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.786 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.786+0000 7f0aceffc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:50.786 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.786+0000 7f0aceffc9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.786+0000 7f0aceffc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:50.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.786+0000 7f0aceffc9c0 20 zone default found 2024-09-19T14:06:50.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.786+0000 7f0aceffc9c0 4 Realm: () 2024-09-19T14:06:50.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.786+0000 7f0aceffc9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:50.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.786+0000 7f0aceffc9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:50.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.786+0000 7f0aceffc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:50.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.786+0000 7f0aceffc9c0 20 zonegroup default 2024-09-19T14:06:50.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.786+0000 7f0aceffc9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.786+0000 7f0aceffc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:50.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.786+0000 7f0aceffc9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.786+0000 7f0aceffc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:50.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.790+0000 7f0aceffc9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.790+0000 7f0aceffc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:50.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.790+0000 7f0aceffc9c0 20 started sync module instance, tier type = 2024-09-19T14:06:50.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.790+0000 7f0aceffc9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:50.812 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.810+0000 7f0aceffc9c0 20 add_watcher() i=0 2024-09-19T14:06:50.812 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.810+0000 7f0aceffc9c0 20 add_watcher() i=1 2024-09-19T14:06:50.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.810+0000 7f0aceffc9c0 20 add_watcher() i=2 2024-09-19T14:06:50.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.810+0000 7f0aceffc9c0 20 add_watcher() i=3 2024-09-19T14:06:50.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.810+0000 7f0aceffc9c0 20 add_watcher() i=4 2024-09-19T14:06:50.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.810+0000 7f0aceffc9c0 20 add_watcher() i=5 2024-09-19T14:06:50.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.810+0000 7f0aceffc9c0 20 add_watcher() i=6 2024-09-19T14:06:50.814 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.814+0000 7f0aceffc9c0 20 add_watcher() i=7 2024-09-19T14:06:50.814 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.814+0000 7f0aceffc9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:50.818 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.818+0000 7f0982fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:50.819 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.818+0000 7f0aceffc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:50.819 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.818+0000 7f0aceffc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:50.819 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.818+0000 7f0aceffc9c0 5 note: GC not initialized 2024-09-19T14:06:50.820 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.818+0000 7f0981fe3640 20 reqs_thread_entry: start 2024-09-19T14:06:50.820 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.818+0000 7f0aceffc9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:50.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.822+0000 7f0aceffc9c0 20 Filter name: none 2024-09-19T14:06:50.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.822+0000 7f08f37fe640 20 reqs_thread_entry: start 2024-09-19T14:06:50.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.822+0000 7f0aceffc9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.822+0000 7f0aceffc9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-19T14:06:50.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.822+0000 7f0aceffc9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.822+0000 7f0aceffc9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-19T14:06:50.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.822+0000 7f0aceffc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:50.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.822+0000 7f0aceffc9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.822+0000 7f0aceffc9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-19T14:06:50.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.822+0000 7f0aceffc9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:50.824 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.822+0000 7f0aceffc9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-19T14:06:50.824 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.822+0000 7f0aceffc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:50.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.826+0000 7f0982fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:50.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.830+0000 7f0aceffc9c0 20 remove_watcher() i=0 2024-09-19T14:06:50.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.830+0000 7f0aceffc9c0 2 removed watcher, disabling cache 2024-09-19T14:06:50.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.834+0000 7f0aceffc9c0 20 remove_watcher() i=1 2024-09-19T14:06:50.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.834+0000 7f0aceffc9c0 20 remove_watcher() i=2 2024-09-19T14:06:50.838 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.838+0000 7f0aceffc9c0 20 remove_watcher() i=3 2024-09-19T14:06:50.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.842+0000 7f0aceffc9c0 20 remove_watcher() i=4 2024-09-19T14:06:50.842 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.842+0000 7f0aceffc9c0 20 remove_watcher() i=5 2024-09-19T14:06:50.843 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.842+0000 7f0aceffc9c0 20 remove_watcher() i=6 2024-09-19T14:06:50.845 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:50.846+0000 7f0aceffc9c0 20 remove_watcher() i=7 2024-09-19T14:06:50.859 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:50.860 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:06:50.860 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-set-target-layout id: dbb1da81-49d0-421a-b677-974869a7f103.4620.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T14:06:50.860 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:50.861 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:50.861 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:50.883 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:50.884 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:51.426 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:51.427 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:51.803 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-19T14:06:51.803 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:51.805 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:51.805 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:51.940 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:51.940 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:52.028 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:52.028 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:52.132 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:52.132 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:52.230 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:52.230 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:52.333 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:52.333 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:52.435 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:52.435 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:52.539 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:52.539 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:52.639 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:52.639 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:52.733 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:52.733 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:52.833 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:52.833 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:52.932 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:52.932 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:53.022 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:53.022 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:53.112 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:53.112 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:53.210 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:53.210 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:53.305 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:53.306 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:53.405 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:53.405 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:53.504 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:53.504 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:53.601 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:53.602 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:53.697 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:53.697 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:53.787 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:53.787 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:53.895 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:53.895 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:53.996 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-19T14:06:54.029 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:54.030 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:54.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.081+0000 7f22a1f329c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.081+0000 7f22a1f329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:54.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.081+0000 7f22a1f329c0 20 realm 2024-09-19T14:06:54.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.081+0000 7f22a1f329c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.081+0000 7f22a1f329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:54.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.081+0000 7f22a1f329c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:54.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.081+0000 7f22a1f329c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.085 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.085+0000 7f22a1f329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:54.085 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.085+0000 7f22a1f329c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.085+0000 7f22a1f329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:54.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.085+0000 7f22a1f329c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.085+0000 7f22a1f329c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:54.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.085+0000 7f22a1f329c0 20 searching for the correct realm 2024-09-19T14:06:54.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.089+0000 7f229fa38640 0 -- 172.21.15.153:0/1874468935 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x7f2298008050 msgr2=0x7f22980830b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:54.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.301+0000 7f22a0239640 0 -- 172.21.15.153:0/1874468935 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f228c003100 msgr2=0x7f2288025440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:54.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.321+0000 7f22a1f329c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:54.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.321+0000 7f22a1f329c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:54.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.321+0000 7f22a1f329c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:54.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.321+0000 7f22a1f329c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:54.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.321+0000 7f22a1f329c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:54.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.321+0000 7f22a1f329c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:54.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.321+0000 7f22a1f329c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.321+0000 7f22a1f329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:54.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.321+0000 7f22a1f329c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.321+0000 7f22a1f329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:54.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.321+0000 7f22a1f329c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.321+0000 7f22a1f329c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:54.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.321+0000 7f22a1f329c0 20 zone default found 2024-09-19T14:06:54.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.321+0000 7f22a1f329c0 4 Realm: () 2024-09-19T14:06:54.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.321+0000 7f22a1f329c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:54.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.321+0000 7f22a1f329c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:54.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.321+0000 7f22a1f329c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:54.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.321+0000 7f22a1f329c0 20 zonegroup default 2024-09-19T14:06:54.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.321+0000 7f22a1f329c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.325+0000 7f22a1f329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:54.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.325+0000 7f22a1f329c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.325+0000 7f22a1f329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:54.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.325+0000 7f22a1f329c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.325+0000 7f22a1f329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:54.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.325+0000 7f22a1f329c0 20 started sync module instance, tier type = 2024-09-19T14:06:54.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.325+0000 7f22a1f329c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:54.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.349+0000 7f22a1f329c0 20 add_watcher() i=0 2024-09-19T14:06:54.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.349+0000 7f22a1f329c0 20 add_watcher() i=1 2024-09-19T14:06:54.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.349+0000 7f22a1f329c0 20 add_watcher() i=2 2024-09-19T14:06:54.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.349+0000 7f22a1f329c0 20 add_watcher() i=3 2024-09-19T14:06:54.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.349+0000 7f22a1f329c0 20 add_watcher() i=4 2024-09-19T14:06:54.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.349+0000 7f22a1f329c0 20 add_watcher() i=5 2024-09-19T14:06:54.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.349+0000 7f22a1f329c0 20 add_watcher() i=6 2024-09-19T14:06:54.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.353+0000 7f22a1f329c0 20 add_watcher() i=7 2024-09-19T14:06:54.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.353+0000 7f22a1f329c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:54.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.357+0000 7f2155fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:54.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.357+0000 7f22a1f329c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:54.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.357+0000 7f22a1f329c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:54.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.357+0000 7f22a1f329c0 5 note: GC not initialized 2024-09-19T14:06:54.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.357+0000 7f2154fe1640 20 reqs_thread_entry: start 2024-09-19T14:06:54.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.357+0000 7f22a1f329c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:54.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.357+0000 7f22a1f329c0 20 Filter name: none 2024-09-19T14:06:54.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.357+0000 7f20ce7fc640 20 reqs_thread_entry: start 2024-09-19T14:06:54.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.357+0000 7f22a1f329c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.357+0000 7f22a1f329c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-19T14:06:54.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.357+0000 7f22a1f329c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.361+0000 7f22a1f329c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-19T14:06:54.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.361+0000 7f22a1f329c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:54.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.361+0000 7f22a1f329c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.361+0000 7f22a1f329c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-19T14:06:54.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.361+0000 7f22a1f329c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.361+0000 7f22a1f329c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-19T14:06:54.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.361+0000 7f22a1f329c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:54.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.365+0000 7f2155fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:54.370 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.369+0000 7f22a1f329c0 20 remove_watcher() i=0 2024-09-19T14:06:54.370 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.369+0000 7f22a1f329c0 2 removed watcher, disabling cache 2024-09-19T14:06:54.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.373+0000 7f22a1f329c0 20 remove_watcher() i=1 2024-09-19T14:06:54.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.373+0000 7f22a1f329c0 20 remove_watcher() i=2 2024-09-19T14:06:54.377 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.377+0000 7f22a1f329c0 20 remove_watcher() i=3 2024-09-19T14:06:54.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.377+0000 7f22a1f329c0 20 remove_watcher() i=4 2024-09-19T14:06:54.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.381+0000 7f22a1f329c0 20 remove_watcher() i=5 2024-09-19T14:06:54.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.381+0000 7f22a1f329c0 20 remove_watcher() i=6 2024-09-19T14:06:54.385 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.385+0000 7f22a1f329c0 20 remove_watcher() i=7 2024-09-19T14:06:54.400 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:54.400 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:06:54.400 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-set-target-layout id: dbb1da81-49d0-421a-b677-974869a7f103.4620.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:06:54.400 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:54.400 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-19T14:06:54.440 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:54.440 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:54.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.485+0000 7f6fbecaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.485+0000 7f6fbecaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:54.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.485+0000 7f6fbecaa9c0 20 realm 2024-09-19T14:06:54.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.485+0000 7f6fbecaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.485+0000 7f6fbecaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:54.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.485+0000 7f6fbecaa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:54.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.485+0000 7f6fbecaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.485+0000 7f6fbecaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:54.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.485+0000 7f6fbecaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.488 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.485+0000 7f6fbecaa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:54.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.485+0000 7f6fbecaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.489+0000 7f6fbecaa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:54.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.489+0000 7f6fbecaa9c0 20 searching for the correct realm 2024-09-19T14:06:54.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.697+0000 7f6fbcfb1640 0 -- 172.21.15.153:0/2726564983 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f6fac03b040 msgr2=0x7f6fac03b930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:54.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.705+0000 7f6fbc7b0640 0 -- 172.21.15.153:0/2726564983 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f6fac01a930 msgr2=0x7f6fac030410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:54.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.721+0000 7f6fbecaa9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:54.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.721+0000 7f6fbecaa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:54.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.721+0000 7f6fbecaa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:54.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.721+0000 7f6fbecaa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:54.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.721+0000 7f6fbecaa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:54.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.721+0000 7f6fbecaa9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:54.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.721+0000 7f6fbecaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.721+0000 7f6fbecaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:54.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.721+0000 7f6fbecaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.725 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.725+0000 7f6fbecaa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:54.725 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.725+0000 7f6fbecaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.725+0000 7f6fbecaa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:54.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.725+0000 7f6fbecaa9c0 20 zone default found 2024-09-19T14:06:54.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.725+0000 7f6fbecaa9c0 4 Realm: () 2024-09-19T14:06:54.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.725+0000 7f6fbecaa9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:54.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.725+0000 7f6fbecaa9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:54.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.725+0000 7f6fbecaa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:54.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.725+0000 7f6fbecaa9c0 20 zonegroup default 2024-09-19T14:06:54.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.725+0000 7f6fbecaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.725+0000 7f6fbecaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:54.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.725+0000 7f6fbecaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.725+0000 7f6fbecaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:54.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.725+0000 7f6fbecaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.729+0000 7f6fbecaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:54.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.729+0000 7f6fbecaa9c0 20 started sync module instance, tier type = 2024-09-19T14:06:54.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.729+0000 7f6fbecaa9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:54.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.749+0000 7f6fbecaa9c0 20 add_watcher() i=0 2024-09-19T14:06:54.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.749+0000 7f6fbecaa9c0 20 add_watcher() i=1 2024-09-19T14:06:54.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.749+0000 7f6fbecaa9c0 20 add_watcher() i=2 2024-09-19T14:06:54.751 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.749+0000 7f6fbecaa9c0 20 add_watcher() i=3 2024-09-19T14:06:54.751 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.749+0000 7f6fbecaa9c0 20 add_watcher() i=4 2024-09-19T14:06:54.751 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.749+0000 7f6fbecaa9c0 20 add_watcher() i=5 2024-09-19T14:06:54.751 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.749+0000 7f6fbecaa9c0 20 add_watcher() i=6 2024-09-19T14:06:54.753 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.749+0000 7f6fbecaa9c0 20 add_watcher() i=7 2024-09-19T14:06:54.753 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.749+0000 7f6fbecaa9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:54.755 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.753+0000 7f6e72fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:54.756 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.757+0000 7f6fbecaa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:54.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.757+0000 7f6fbecaa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:54.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.757+0000 7f6fbecaa9c0 5 note: GC not initialized 2024-09-19T14:06:54.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.757+0000 7f6e71fdb640 20 reqs_thread_entry: start 2024-09-19T14:06:54.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.757+0000 7f6fbecaa9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:54.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.757+0000 7f6fbecaa9c0 20 Filter name: none 2024-09-19T14:06:54.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.757+0000 7f6de37fe640 20 reqs_thread_entry: start 2024-09-19T14:06:54.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.757+0000 7f6fbecaa9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-19T14:06:54.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.757+0000 7f6fbecaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.757+0000 7f6fbecaa9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-19T14:06:54.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.757+0000 7f6fbecaa9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-19T14:06:54.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.757+0000 7f6fbecaa9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-19T14:06:54.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.757+0000 7f6fbecaa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.23 : miss 2024-09-19T14:06:54.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.757+0000 7f6fbecaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.757+0000 7f6fbecaa9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-19T14:06:54.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.757+0000 7f6fbecaa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.23 info.flags=0x17 2024-09-19T14:06:54.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.757+0000 7f6fbecaa9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.23 to cache LRU end 2024-09-19T14:06:54.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.757+0000 7f6fbecaa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:06:54.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.757+0000 7f6fbecaa9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:54.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.757+0000 7f6fbecaa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.23 2024-09-19T14:06:54.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.769+0000 7f6fbecaa9c0 -1 Injecting error=-125 at location=set_target_layout 2024-09-19T14:06:54.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.773+0000 7f6fbecaa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.23 info.flags=0x17 2024-09-19T14:06:54.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.773+0000 7f6fbecaa9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.23 to cache LRU end 2024-09-19T14:06:54.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.773+0000 7f6fbecaa9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:54.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.773+0000 7f6fbecaa9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.23, ofs0, ns] 2024-09-19T14:06:54.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.773+0000 7f6e92ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333476 cookie 94600026340176 notifier 6149 bl.length()=925 2024-09-19T14:06:54.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.773+0000 7f6e92ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.23 info.flags=0x17 2024-09-19T14:06:54.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.773+0000 7f6e92ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.23 to cache LRU end 2024-09-19T14:06:54.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.773+0000 7f6e92ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:54.776 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.773+0000 7f6fbecaa9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.23]): orig_sources= new_sources= 2024-09-19T14:06:54.776 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.773+0000 7f6fbecaa9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.23]): potential sources added=[] removed=[] 2024-09-19T14:06:54.776 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.773+0000 7f6fbecaa9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.23]): orig_dests= new_dests= 2024-09-19T14:06:54.777 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.773+0000 7f6fbecaa9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.23]): potential dests added=[] removed=[] 2024-09-19T14:06:54.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1.0 2024-09-19T14:06:54.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1.0 2024-09-19T14:06:54.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1.1 2024-09-19T14:06:54.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1.1 2024-09-19T14:06:54.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1.2 2024-09-19T14:06:54.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1.2 2024-09-19T14:06:54.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1.3 2024-09-19T14:06:54.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1.3 2024-09-19T14:06:54.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1.4 2024-09-19T14:06:54.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1.4 2024-09-19T14:06:54.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1.5 2024-09-19T14:06:54.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1.5 2024-09-19T14:06:54.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1.6 2024-09-19T14:06:54.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1.6 2024-09-19T14:06:54.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1.7 2024-09-19T14:06:54.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1.7 2024-09-19T14:06:54.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1.8 2024-09-19T14:06:54.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1.8 2024-09-19T14:06:54.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1.9 2024-09-19T14:06:54.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1.9 2024-09-19T14:06:54.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1.10 2024-09-19T14:06:54.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1.10 2024-09-19T14:06:54.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1.11 2024-09-19T14:06:54.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1.11 2024-09-19T14:06:54.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.0 2024-09-19T14:06:54.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.785+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1 2024-09-19T14:06:54.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.789+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.2 2024-09-19T14:06:54.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.789+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.3 2024-09-19T14:06:54.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.789+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.4 2024-09-19T14:06:54.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.789+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.5 2024-09-19T14:06:54.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.793+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.6 2024-09-19T14:06:54.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.793+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.7 2024-09-19T14:06:54.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.793+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.8 2024-09-19T14:06:54.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.793+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.9 2024-09-19T14:06:54.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.793+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.10 2024-09-19T14:06:54.803 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.801+0000 7f6fbecaa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.23 : hit (requested=0x17, cached=0x17) 2024-09-19T14:06:54.803 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.801+0000 7f6fbecaa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.23 2024-09-19T14:06:54.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.805+0000 7f6fbecaa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.23 info.flags=0x17 2024-09-19T14:06:54.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.805+0000 7f6fbecaa9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.23 to cache LRU end 2024-09-19T14:06:54.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.805+0000 7f6fbecaa9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:54.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.805+0000 7f6fbecaa9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.23, ofs0, ns] 2024-09-19T14:06:54.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.805+0000 7f6e937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333477 cookie 94600026340176 notifier 6149 bl.length()=925 2024-09-19T14:06:54.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.805+0000 7f6e937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.23 info.flags=0x17 2024-09-19T14:06:54.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.805+0000 7f6e937fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.23 to cache LRU end 2024-09-19T14:06:54.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.805+0000 7f6e937fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:54.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.805+0000 7f6fbecaa9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.23]): orig_sources= new_sources= 2024-09-19T14:06:54.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.805+0000 7f6fbecaa9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.23]): potential sources added=[] removed=[] 2024-09-19T14:06:54.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.805+0000 7f6fbecaa9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.23]): orig_dests= new_dests= 2024-09-19T14:06:54.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.805+0000 7f6fbecaa9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.23]): potential dests added=[] removed=[] 2024-09-19T14:06:54.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.813+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.0 2024-09-19T14:06:54.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.813+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.1 2024-09-19T14:06:54.814 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.813+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.2 2024-09-19T14:06:54.815 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.813+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.3 2024-09-19T14:06:54.815 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.813+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.4 2024-09-19T14:06:54.816 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.817+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.5 2024-09-19T14:06:54.817 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.817+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.6 2024-09-19T14:06:54.818 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.817+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.7 2024-09-19T14:06:54.818 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.817+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.8 2024-09-19T14:06:54.819 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.817+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.9 2024-09-19T14:06:54.820 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.817+0000 7f6fbecaa9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.23.10 2024-09-19T14:06:54.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.821+0000 7f6fbecaa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.23 : hit (requested=0x17, cached=0x17) 2024-09-19T14:06:54.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.821+0000 7f6fbecaa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.23 2024-09-19T14:06:54.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.821+0000 7f6fbecaa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.23 info.flags=0x17 2024-09-19T14:06:54.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.821+0000 7f6fbecaa9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.23 to cache LRU end 2024-09-19T14:06:54.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.821+0000 7f6fbecaa9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:54.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.821+0000 7f6fbecaa9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.23, ofs0, ns] 2024-09-19T14:06:54.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.821+0000 7f6e92ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333478 cookie 94600026340176 notifier 6149 bl.length()=893 2024-09-19T14:06:54.824 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.821+0000 7f6e92ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.23 info.flags=0x17 2024-09-19T14:06:54.824 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.821+0000 7f6e92ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.23 to cache LRU end 2024-09-19T14:06:54.824 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.821+0000 7f6e92ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:54.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.825+0000 7f6fbecaa9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.23]): orig_sources= new_sources= 2024-09-19T14:06:54.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.825+0000 7f6fbecaa9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.23]): potential sources added=[] removed=[] 2024-09-19T14:06:54.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.825+0000 7f6fbecaa9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.23]): orig_dests= new_dests= 2024-09-19T14:06:54.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.825+0000 7f6fbecaa9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.23]): potential dests added=[] removed=[] 2024-09-19T14:06:54.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.829+0000 7f6fbecaa9c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-19T14:06:54.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.833+0000 7f6e72fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:54.842 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.841+0000 7f6fbecaa9c0 20 remove_watcher() i=0 2024-09-19T14:06:54.842 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.841+0000 7f6fbecaa9c0 2 removed watcher, disabling cache 2024-09-19T14:06:54.844 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.841+0000 7f6fbecaa9c0 20 remove_watcher() i=1 2024-09-19T14:06:54.846 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.845+0000 7f6fbecaa9c0 20 remove_watcher() i=2 2024-09-19T14:06:54.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.845+0000 7f6fbecaa9c0 20 remove_watcher() i=3 2024-09-19T14:06:54.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.849+0000 7f6fbecaa9c0 20 remove_watcher() i=4 2024-09-19T14:06:54.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.849+0000 7f6fbecaa9c0 20 remove_watcher() i=5 2024-09-19T14:06:54.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.853+0000 7f6fbecaa9c0 20 remove_watcher() i=6 2024-09-19T14:06:54.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.853+0000 7f6fbecaa9c0 20 remove_watcher() i=7 2024-09-19T14:06:54.875 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-19T14:06:54.905 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:54.905 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:54.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.949+0000 7f57264609c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.949+0000 7f57264609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:54.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.949+0000 7f57264609c0 20 realm 2024-09-19T14:06:54.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.949+0000 7f57264609c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.949+0000 7f57264609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:54.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.949+0000 7f57264609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:54.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.949+0000 7f57264609c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.949+0000 7f57264609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:54.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.949+0000 7f57264609c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.953+0000 7f57264609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:54.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.953+0000 7f57264609c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.953+0000 7f57264609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:54.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.953+0000 7f57264609c0 20 searching for the correct realm 2024-09-19T14:06:54.959 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.957+0000 7f5723765640 0 -- 172.21.15.153:0/2581732762 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x5583801d8310 msgr2=0x5583801da700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:54.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.965+0000 7f5723f66640 0 -- 172.21.15.153:0/2581732762 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f5718135390 msgr2=0x7f57180ffe00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:54.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.973+0000 7f57264609c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:54.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.973+0000 7f57264609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:54.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.973+0000 7f57264609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:54.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.973+0000 7f57264609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:54.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.973+0000 7f57264609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:54.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.973+0000 7f57264609c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:54.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.973+0000 7f57264609c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.974 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.973+0000 7f57264609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:54.974 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.973+0000 7f57264609c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.974 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.973+0000 7f57264609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:54.974 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.973+0000 7f57264609c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.975 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.973+0000 7f57264609c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:54.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.973+0000 7f57264609c0 20 zone default found 2024-09-19T14:06:54.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.973+0000 7f57264609c0 4 Realm: () 2024-09-19T14:06:54.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.973+0000 7f57264609c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:54.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.973+0000 7f57264609c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:54.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.973+0000 7f57264609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:54.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.973+0000 7f57264609c0 20 zonegroup default 2024-09-19T14:06:54.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.973+0000 7f57264609c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.973+0000 7f57264609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:54.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.973+0000 7f57264609c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.973+0000 7f57264609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:54.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.973+0000 7f57264609c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.977+0000 7f57264609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:54.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.977+0000 7f57264609c0 20 started sync module instance, tier type = 2024-09-19T14:06:54.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.977+0000 7f57264609c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:54.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.989+0000 7f57264609c0 20 add_watcher() i=0 2024-09-19T14:06:54.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.989+0000 7f57264609c0 20 add_watcher() i=1 2024-09-19T14:06:54.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.989+0000 7f57264609c0 20 add_watcher() i=2 2024-09-19T14:06:54.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.989+0000 7f57264609c0 20 add_watcher() i=3 2024-09-19T14:06:54.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.989+0000 7f57264609c0 20 add_watcher() i=4 2024-09-19T14:06:54.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.989+0000 7f57264609c0 20 add_watcher() i=5 2024-09-19T14:06:54.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.989+0000 7f57264609c0 20 add_watcher() i=6 2024-09-19T14:06:54.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.993+0000 7f57264609c0 20 add_watcher() i=7 2024-09-19T14:06:54.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.993+0000 7f57264609c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:54.995 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.993+0000 7f55d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:54.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.993+0000 7f57264609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:54.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.993+0000 7f57264609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:54.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.993+0000 7f57264609c0 5 note: GC not initialized 2024-09-19T14:06:54.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.993+0000 7f55d8fe1640 20 reqs_thread_entry: start 2024-09-19T14:06:54.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.997+0000 7f57264609c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:54.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.997+0000 7f57264609c0 20 Filter name: none 2024-09-19T14:06:54.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.997+0000 7f55527fc640 20 reqs_thread_entry: start 2024-09-19T14:06:54.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.997+0000 7f57264609c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.999 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.997+0000 7f57264609c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-19T14:06:54.999 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.997+0000 7f57264609c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.999 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.997+0000 7f57264609c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-19T14:06:54.999 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.997+0000 7f57264609c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:54.999 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.997+0000 7f57264609c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.999 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.997+0000 7f57264609c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-19T14:06:54.999 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.997+0000 7f57264609c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:54.999 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.997+0000 7f57264609c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-19T14:06:54.999 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:54.997+0000 7f57264609c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:55.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:55.001+0000 7f55d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:55.007 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:55.005+0000 7f57264609c0 20 remove_watcher() i=0 2024-09-19T14:06:55.007 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:55.005+0000 7f57264609c0 2 removed watcher, disabling cache 2024-09-19T14:06:55.009 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:55.009+0000 7f57264609c0 20 remove_watcher() i=1 2024-09-19T14:06:55.011 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:55.009+0000 7f57264609c0 20 remove_watcher() i=2 2024-09-19T14:06:55.013 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:55.013+0000 7f57264609c0 20 remove_watcher() i=3 2024-09-19T14:06:55.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:55.013+0000 7f57264609c0 20 remove_watcher() i=4 2024-09-19T14:06:55.016 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:55.017+0000 7f57264609c0 20 remove_watcher() i=5 2024-09-19T14:06:55.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:55.017+0000 7f57264609c0 20 remove_watcher() i=6 2024-09-19T14:06:55.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:55.017+0000 7f57264609c0 20 remove_watcher() i=7 2024-09-19T14:06:55.032 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:55.032 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:06:55.032 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-set-target-layout id: dbb1da81-49d0-421a-b677-974869a7f103.4620.23 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-19T14:06:55.032 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:55.034 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:55.034 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:55.055 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:55.055 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:55.589 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:55.589 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:55.955 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-19T14:06:55.955 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:55.958 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:55.958 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:56.093 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:56.093 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:56.181 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:56.181 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:56.292 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:56.292 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:56.391 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:56.391 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:56.489 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:56.489 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:56.591 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:56.591 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:56.687 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:56.687 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:56.789 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:56.790 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:56.883 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:56.883 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:56.975 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:56.975 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:57.079 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:57.080 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:57.182 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:57.182 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:57.279 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:57.279 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:57.382 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:57.382 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:57.481 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:57.482 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:57.577 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:57.578 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:57.674 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:57.674 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:57.773 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:57.774 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:57.879 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:57.879 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:57.975 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:57.975 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:58.074 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:58.074 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:58.169 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-19T14:06:58.202 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:58.203 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:58.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.249+0000 7f5e4d1ed9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.249+0000 7f5e4d1ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.249+0000 7f5e4d1ed9c0 20 realm 2024-09-19T14:06:58.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.249+0000 7f5e4d1ed9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.249+0000 7f5e4d1ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.249+0000 7f5e4d1ed9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:58.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.249+0000 7f5e4d1ed9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.249+0000 7f5e4d1ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.249+0000 7f5e4d1ed9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.253+0000 7f5e4d1ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:58.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.253+0000 7f5e4d1ed9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.253+0000 7f5e4d1ed9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:58.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.253+0000 7f5e4d1ed9c0 20 searching for the correct realm 2024-09-19T14:06:58.258 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.257+0000 7f5e4b4f4640 0 -- 172.21.15.153:0/176454715 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f5e340a4040 msgr2=0x7f5e340c53d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:58.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.265+0000 7f5e4acf3640 0 -- 172.21.15.153:0/176454715 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f5e34135ba0 msgr2=0x7f5e340ac030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:58.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.481+0000 7f5e4d1ed9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:58.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.481+0000 7f5e4d1ed9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:58.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.481+0000 7f5e4d1ed9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:58.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.481+0000 7f5e4d1ed9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:58.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.481+0000 7f5e4d1ed9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:58.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.481+0000 7f5e4d1ed9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:58.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.481+0000 7f5e4d1ed9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.481+0000 7f5e4d1ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.481+0000 7f5e4d1ed9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.485+0000 7f5e4d1ed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:58.485 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.485+0000 7f5e4d1ed9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.485+0000 7f5e4d1ed9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:58.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.485+0000 7f5e4d1ed9c0 20 zone default found 2024-09-19T14:06:58.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.485+0000 7f5e4d1ed9c0 4 Realm: () 2024-09-19T14:06:58.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.485+0000 7f5e4d1ed9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:58.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.485+0000 7f5e4d1ed9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:58.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.485+0000 7f5e4d1ed9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:58.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.485+0000 7f5e4d1ed9c0 20 zonegroup default 2024-09-19T14:06:58.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.485+0000 7f5e4d1ed9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.485+0000 7f5e4d1ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.485+0000 7f5e4d1ed9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.485+0000 7f5e4d1ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.485+0000 7f5e4d1ed9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.488 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.485+0000 7f5e4d1ed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.488 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.485+0000 7f5e4d1ed9c0 20 started sync module instance, tier type = 2024-09-19T14:06:58.488 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.485+0000 7f5e4d1ed9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:58.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.509+0000 7f5e4d1ed9c0 20 add_watcher() i=0 2024-09-19T14:06:58.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.509+0000 7f5e4d1ed9c0 20 add_watcher() i=1 2024-09-19T14:06:58.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.509+0000 7f5e4d1ed9c0 20 add_watcher() i=2 2024-09-19T14:06:58.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.509+0000 7f5e4d1ed9c0 20 add_watcher() i=3 2024-09-19T14:06:58.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.509+0000 7f5e4d1ed9c0 20 add_watcher() i=4 2024-09-19T14:06:58.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.509+0000 7f5e4d1ed9c0 20 add_watcher() i=5 2024-09-19T14:06:58.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.509+0000 7f5e4d1ed9c0 20 add_watcher() i=6 2024-09-19T14:06:58.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.513+0000 7f5e4d1ed9c0 20 add_watcher() i=7 2024-09-19T14:06:58.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.513+0000 7f5e4d1ed9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:58.518 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.517+0000 7f5d017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:58.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.517+0000 7f5e4d1ed9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:58.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.517+0000 7f5e4d1ed9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:58.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.517+0000 7f5e4d1ed9c0 5 note: GC not initialized 2024-09-19T14:06:58.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.517+0000 7f5c7bfff640 20 reqs_thread_entry: start 2024-09-19T14:06:58.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.517+0000 7f5e4d1ed9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:58.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.521+0000 7f5e4d1ed9c0 20 Filter name: none 2024-09-19T14:06:58.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.521+0000 7f5c79ffb640 20 reqs_thread_entry: start 2024-09-19T14:06:58.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.521+0000 7f5e4d1ed9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.521+0000 7f5e4d1ed9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-19T14:06:58.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.521+0000 7f5e4d1ed9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.521+0000 7f5e4d1ed9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-19T14:06:58.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.521+0000 7f5e4d1ed9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:58.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.521+0000 7f5e4d1ed9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.525+0000 7f5e4d1ed9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-19T14:06:58.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.525+0000 7f5e4d1ed9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.525+0000 7f5e4d1ed9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-19T14:06:58.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.525+0000 7f5e4d1ed9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:58.530 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.529+0000 7f5d017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:58.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.533+0000 7f5e4d1ed9c0 20 remove_watcher() i=0 2024-09-19T14:06:58.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.533+0000 7f5e4d1ed9c0 2 removed watcher, disabling cache 2024-09-19T14:06:58.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.537+0000 7f5e4d1ed9c0 20 remove_watcher() i=1 2024-09-19T14:06:58.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.537+0000 7f5e4d1ed9c0 20 remove_watcher() i=2 2024-09-19T14:06:58.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.541+0000 7f5e4d1ed9c0 20 remove_watcher() i=3 2024-09-19T14:06:58.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.541+0000 7f5e4d1ed9c0 20 remove_watcher() i=4 2024-09-19T14:06:58.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.545+0000 7f5e4d1ed9c0 20 remove_watcher() i=5 2024-09-19T14:06:58.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.545+0000 7f5e4d1ed9c0 20 remove_watcher() i=6 2024-09-19T14:06:58.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.549+0000 7f5e4d1ed9c0 20 remove_watcher() i=7 2024-09-19T14:06:58.573 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.573 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:06:58.573 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: abort-at-set-target-layout id: dbb1da81-49d0-421a-b677-974869a7f103.4620.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:06:58.573 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.573 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-19T14:06:58.607 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:58.607 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:58.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.649+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 realm 2024-09-19T14:06:58.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.653+0000 7f6568b9d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:58.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:58.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:58.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 searching for the correct realm 2024-09-19T14:06:58.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.661+0000 7f6565ea2640 0 -- 172.21.15.153:0/3629314063 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f655810c030 msgr2=0x7f655811e0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:58.668 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.665+0000 7f6565ea2640 0 -- 172.21.15.153:0/3629314063 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f6430082370 msgr2=0x7f64300847a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:58.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:58.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:58.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:58.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:58.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:58.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:58.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:58.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:58.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 zone default found 2024-09-19T14:06:58.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.677+0000 7f6568b9d9c0 4 Realm: () 2024-09-19T14:06:58.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.677+0000 7f6568b9d9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:58.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.677+0000 7f6568b9d9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:58.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.677+0000 7f6568b9d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:58.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 zonegroup default 2024-09-19T14:06:58.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 started sync module instance, tier type = 2024-09-19T14:06:58.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:58.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.693+0000 7f6568b9d9c0 20 add_watcher() i=0 2024-09-19T14:06:58.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.693+0000 7f6568b9d9c0 20 add_watcher() i=1 2024-09-19T14:06:58.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.693+0000 7f6568b9d9c0 20 add_watcher() i=2 2024-09-19T14:06:58.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.693+0000 7f6568b9d9c0 20 add_watcher() i=3 2024-09-19T14:06:58.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.693+0000 7f6568b9d9c0 20 add_watcher() i=4 2024-09-19T14:06:58.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.693+0000 7f6568b9d9c0 20 add_watcher() i=5 2024-09-19T14:06:58.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.693+0000 7f6568b9d9c0 20 add_watcher() i=6 2024-09-19T14:06:58.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.693+0000 7f6568b9d9c0 20 add_watcher() i=7 2024-09-19T14:06:58.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.693+0000 7f6568b9d9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:58.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.697+0000 7f641cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:58.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.697+0000 7f6568b9d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:58.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.697+0000 7f6568b9d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:58.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 note: GC not initialized 2024-09-19T14:06:58.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.697+0000 7f63977fe640 20 reqs_thread_entry: start 2024-09-19T14:06:58.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.697+0000 7f6568b9d9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:58.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.697+0000 7f6568b9d9c0 20 Filter name: none 2024-09-19T14:06:58.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.697+0000 7f63957fa640 20 reqs_thread_entry: start 2024-09-19T14:06:58.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-19T14:06:58.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.697+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.697+0000 7f6568b9d9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-19T14:06:58.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-19T14:06:58.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-19T14:06:58.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 : miss 2024-09-19T14:06:58.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.697+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.697+0000 7f6568b9d9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-19T14:06:58.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 info.flags=0x17 2024-09-19T14:06:58.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 to cache LRU end 2024-09-19T14:06:58.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:06:58.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:58.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 2024-09-19T14:06:58.709 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6568b9d9c0 time 2024-09-19T14:06:58.712209+0000 2024-09-19T14:06:58.709 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:06:58.710 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:06:58.710 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f656c4772eb] 2024-09-19T14:06:58.711 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f656c47749f] 2024-09-19T14:06:58.711 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e29cc6e271] 2024-09-19T14:06:58.711 INFO:tasks.workunit.client.0.smithi153.stderr: 4: radosgw-admin(+0x140fb48) [0x55e29d6beb48] 2024-09-19T14:06:58.711 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e29cc7e0dd] 2024-09-19T14:06:58.711 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:06:58.711 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f656b2ddd90] 2024-09-19T14:06:58.711 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:06:58.711 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:06:58.711 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.709+0000 7f6568b9d9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6568b9d9c0 time 2024-09-19T14:06:58.712209+0000 2024-09-19T14:06:58.711 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:06:58.711 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.711 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:06:58.711 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f656c4772eb] 2024-09-19T14:06:58.712 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f656c47749f] 2024-09-19T14:06:58.712 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e29cc6e271] 2024-09-19T14:06:58.712 INFO:tasks.workunit.client.0.smithi153.stderr: 4: radosgw-admin(+0x140fb48) [0x55e29d6beb48] 2024-09-19T14:06:58.712 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e29cc7e0dd] 2024-09-19T14:06:58.712 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:06:58.712 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f656b2ddd90] 2024-09-19T14:06:58.712 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:06:58.712 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:06:58.712 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.712 INFO:tasks.workunit.client.0.smithi153.stderr:*** Caught signal (Aborted) ** 2024-09-19T14:06:58.712 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7f6568b9d9c0 thread_name:radosgw-admin 2024-09-19T14:06:58.735 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:06:58.735 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f656b2f6520] 2024-09-19T14:06:58.735 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:06:58.735 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:06:58.735 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:06:58.735 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f656c477345] 2024-09-19T14:06:58.735 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f656c47749f] 2024-09-19T14:06:58.735 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e29cc6e271] 2024-09-19T14:06:58.735 INFO:tasks.workunit.client.0.smithi153.stderr: 8: radosgw-admin(+0x140fb48) [0x55e29d6beb48] 2024-09-19T14:06:58.735 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e29cc7e0dd] 2024-09-19T14:06:58.736 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:06:58.736 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f656b2ddd90] 2024-09-19T14:06:58.736 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:06:58.736 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:06:58.736 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.709+0000 7f6568b9d9c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:06:58.736 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7f6568b9d9c0 thread_name:radosgw-admin 2024-09-19T14:06:58.736 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.736 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:06:58.736 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f656b2f6520] 2024-09-19T14:06:58.736 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:06:58.736 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:06:58.736 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:06:58.736 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f656c477345] 2024-09-19T14:06:58.737 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f656c47749f] 2024-09-19T14:06:58.737 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e29cc6e271] 2024-09-19T14:06:58.737 INFO:tasks.workunit.client.0.smithi153.stderr: 8: radosgw-admin(+0x140fb48) [0x55e29d6beb48] 2024-09-19T14:06:58.737 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e29cc7e0dd] 2024-09-19T14:06:58.737 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:06:58.737 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f656b2ddd90] 2024-09-19T14:06:58.737 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:06:58.737 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:06:58.737 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:06:58.737 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.737 INFO:tasks.workunit.client.0.smithi153.stderr:--- begin dump of recent events --- 2024-09-19T14:06:58.737 INFO:tasks.workunit.client.0.smithi153.stderr: -499> 2024-09-19T14:06:58.629+0000 7f6565ea2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:58.737 INFO:tasks.workunit.client.0.smithi153.stderr: -498> 2024-09-19T14:06:58.629+0000 7f6566ea4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:58.738 INFO:tasks.workunit.client.0.smithi153.stderr: -497> 2024-09-19T14:06:58.629+0000 7f6566ea4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:58.738 INFO:tasks.workunit.client.0.smithi153.stderr: -496> 2024-09-19T14:06:58.629+0000 7f6566ea4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:58.738 INFO:tasks.workunit.client.0.smithi153.stderr: -495> 2024-09-19T14:06:58.629+0000 7f6565ea2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:58.738 INFO:tasks.workunit.client.0.smithi153.stderr: -494> 2024-09-19T14:06:58.629+0000 7f6565ea2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:58.738 INFO:tasks.workunit.client.0.smithi153.stderr: -493> 2024-09-19T14:06:58.629+0000 7f6565ea2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:58.738 INFO:tasks.workunit.client.0.smithi153.stderr: -492> 2024-09-19T14:06:58.629+0000 7f65666a3640 10 monclient(hunting): get_auth_request con 0x55e29fbfb290 auth_method 0 2024-09-19T14:06:58.738 INFO:tasks.workunit.client.0.smithi153.stderr: -491> 2024-09-19T14:06:58.629+0000 7f65666a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:58.738 INFO:tasks.workunit.client.0.smithi153.stderr: -490> 2024-09-19T14:06:58.629+0000 7f65666a3640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:58.738 INFO:tasks.workunit.client.0.smithi153.stderr: -489> 2024-09-19T14:06:58.629+0000 7f65666a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:58.738 INFO:tasks.workunit.client.0.smithi153.stderr: -488> 2024-09-19T14:06:58.629+0000 7f6566ea4640 10 monclient(hunting): handle_auth_done global_id 6585 payload 274 2024-09-19T14:06:58.738 INFO:tasks.workunit.client.0.smithi153.stderr: -487> 2024-09-19T14:06:58.629+0000 7f6566ea4640 10 monclient: _finish_hunting 0 2024-09-19T14:06:58.738 INFO:tasks.workunit.client.0.smithi153.stderr: -486> 2024-09-19T14:06:58.629+0000 7f6566ea4640 1 monclient: found mon.noname-a 2024-09-19T14:06:58.738 INFO:tasks.workunit.client.0.smithi153.stderr: -485> 2024-09-19T14:06:58.629+0000 7f6566ea4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:06:58.738 INFO:tasks.workunit.client.0.smithi153.stderr: -484> 2024-09-19T14:06:58.629+0000 7f6454608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:58.739 INFO:tasks.workunit.client.0.smithi153.stderr: -483> 2024-09-19T14:06:58.629+0000 7f6454608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:06:58.739 INFO:tasks.workunit.client.0.smithi153.stderr: -482> 2024-09-19T14:06:58.629+0000 7f6454608640 10 monclient: dump: 2024-09-19T14:06:58.739 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:58.739 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:58.739 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.739 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.739 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:58.739 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.739 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:58.739 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:58.739 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:58.739 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.739 INFO:tasks.workunit.client.0.smithi153.stderr: -481> 2024-09-19T14:06:58.629+0000 7f6454608640 10 monclient: _finish_auth 0 2024-09-19T14:06:58.739 INFO:tasks.workunit.client.0.smithi153.stderr: -480> 2024-09-19T14:06:58.629+0000 7f6454608640 10 monclient: _check_auth_tickets 2024-09-19T14:06:58.740 INFO:tasks.workunit.client.0.smithi153.stderr: -479> 2024-09-19T14:06:58.629+0000 7f6454608640 10 monclient: handle_config config(0 keys) 2024-09-19T14:06:58.740 INFO:tasks.workunit.client.0.smithi153.stderr: -478> 2024-09-19T14:06:58.629+0000 7f6454608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:58.740 INFO:tasks.workunit.client.0.smithi153.stderr: -477> 2024-09-19T14:06:58.629+0000 7f6454608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:06:58.740 INFO:tasks.workunit.client.0.smithi153.stderr: -476> 2024-09-19T14:06:58.629+0000 7f6454608640 10 monclient: dump: 2024-09-19T14:06:58.740 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:58.740 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:58.740 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.740 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.740 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:58.740 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.740 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:58.740 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:58.740 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:58.740 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.741 INFO:tasks.workunit.client.0.smithi153.stderr: -475> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 monclient: authenticate success, global_id 6585 2024-09-19T14:06:58.741 INFO:tasks.workunit.client.0.smithi153.stderr: -474> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 10 monclient: get_monmap_and_config success 2024-09-19T14:06:58.741 INFO:tasks.workunit.client.0.smithi153.stderr: -473> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 4 set_mon_vals no callback set 2024-09-19T14:06:58.741 INFO:tasks.workunit.client.0.smithi153.stderr: -472> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 10 monclient: shutdown 2024-09-19T14:06:58.741 INFO:tasks.workunit.client.0.smithi153.stderr: -471> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) unregister_commands rotate-key 2024-09-19T14:06:58.741 INFO:tasks.workunit.client.0.smithi153.stderr: -470> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 10 monclient: build_initial_monmap 2024-09-19T14:06:58.741 INFO:tasks.workunit.client.0.smithi153.stderr: -469> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 1 build_initial for_mkfs: 0 2024-09-19T14:06:58.741 INFO:tasks.workunit.client.0.smithi153.stderr: -468> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 10 monclient: monmap: 2024-09-19T14:06:58.741 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:06:58.741 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:06:58.741 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:06:58.741 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:06:58.741 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:06:58.741 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.741 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:06:58.741 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:06:58.742 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:06:58.742 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.742 INFO:tasks.workunit.client.0.smithi153.stderr: -467> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding auth protocol: cephx 2024-09-19T14:06:58.742 INFO:tasks.workunit.client.0.smithi153.stderr: -466> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding auth protocol: cephx 2024-09-19T14:06:58.742 INFO:tasks.workunit.client.0.smithi153.stderr: -465> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding auth protocol: cephx 2024-09-19T14:06:58.742 INFO:tasks.workunit.client.0.smithi153.stderr: -464> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding con mode: secure 2024-09-19T14:06:58.742 INFO:tasks.workunit.client.0.smithi153.stderr: -463> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding con mode: crc 2024-09-19T14:06:58.742 INFO:tasks.workunit.client.0.smithi153.stderr: -462> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding con mode: secure 2024-09-19T14:06:58.742 INFO:tasks.workunit.client.0.smithi153.stderr: -461> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding con mode: crc 2024-09-19T14:06:58.742 INFO:tasks.workunit.client.0.smithi153.stderr: -460> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding con mode: secure 2024-09-19T14:06:58.742 INFO:tasks.workunit.client.0.smithi153.stderr: -459> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding con mode: crc 2024-09-19T14:06:58.742 INFO:tasks.workunit.client.0.smithi153.stderr: -458> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding con mode: crc 2024-09-19T14:06:58.742 INFO:tasks.workunit.client.0.smithi153.stderr: -457> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding con mode: secure 2024-09-19T14:06:58.742 INFO:tasks.workunit.client.0.smithi153.stderr: -456> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding con mode: crc 2024-09-19T14:06:58.743 INFO:tasks.workunit.client.0.smithi153.stderr: -455> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding con mode: secure 2024-09-19T14:06:58.743 INFO:tasks.workunit.client.0.smithi153.stderr: -454> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding con mode: crc 2024-09-19T14:06:58.743 INFO:tasks.workunit.client.0.smithi153.stderr: -453> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding con mode: secure 2024-09-19T14:06:58.743 INFO:tasks.workunit.client.0.smithi153.stderr: -452> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.743 INFO:tasks.workunit.client.0.smithi153.stderr: -451> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 1 librados: starting msgr at 2024-09-19T14:06:58.743 INFO:tasks.workunit.client.0.smithi153.stderr: -450> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 1 librados: starting objecter 2024-09-19T14:06:58.743 INFO:tasks.workunit.client.0.smithi153.stderr: -449> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command objecter_requests hook 0x55e29fd4f490 2024-09-19T14:06:58.743 INFO:tasks.workunit.client.0.smithi153.stderr: -448> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 1 librados: setting wanted keys 2024-09-19T14:06:58.743 INFO:tasks.workunit.client.0.smithi153.stderr: -447> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 1 librados: calling monclient init 2024-09-19T14:06:58.743 INFO:tasks.workunit.client.0.smithi153.stderr: -446> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 10 monclient: init 2024-09-19T14:06:58.743 INFO:tasks.workunit.client.0.smithi153.stderr: -445> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding auth protocol: cephx 2024-09-19T14:06:58.743 INFO:tasks.workunit.client.0.smithi153.stderr: -444> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding auth protocol: cephx 2024-09-19T14:06:58.743 INFO:tasks.workunit.client.0.smithi153.stderr: -443> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding auth protocol: cephx 2024-09-19T14:06:58.743 INFO:tasks.workunit.client.0.smithi153.stderr: -442> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding con mode: secure 2024-09-19T14:06:58.743 INFO:tasks.workunit.client.0.smithi153.stderr: -441> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding con mode: crc 2024-09-19T14:06:58.744 INFO:tasks.workunit.client.0.smithi153.stderr: -440> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding con mode: secure 2024-09-19T14:06:58.744 INFO:tasks.workunit.client.0.smithi153.stderr: -439> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding con mode: crc 2024-09-19T14:06:58.744 INFO:tasks.workunit.client.0.smithi153.stderr: -438> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding con mode: secure 2024-09-19T14:06:58.744 INFO:tasks.workunit.client.0.smithi153.stderr: -437> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding con mode: crc 2024-09-19T14:06:58.744 INFO:tasks.workunit.client.0.smithi153.stderr: -436> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding con mode: crc 2024-09-19T14:06:58.744 INFO:tasks.workunit.client.0.smithi153.stderr: -435> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding con mode: secure 2024-09-19T14:06:58.744 INFO:tasks.workunit.client.0.smithi153.stderr: -434> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding con mode: crc 2024-09-19T14:06:58.744 INFO:tasks.workunit.client.0.smithi153.stderr: -433> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding con mode: secure 2024-09-19T14:06:58.744 INFO:tasks.workunit.client.0.smithi153.stderr: -432> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding con mode: crc 2024-09-19T14:06:58.744 INFO:tasks.workunit.client.0.smithi153.stderr: -431> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding con mode: secure 2024-09-19T14:06:58.744 INFO:tasks.workunit.client.0.smithi153.stderr: -430> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.744 INFO:tasks.workunit.client.0.smithi153.stderr: -429> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.744 INFO:tasks.workunit.client.0.smithi153.stderr: -428> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command rotate-key hook 0x55e29fd4b298 2024-09-19T14:06:58.745 INFO:tasks.workunit.client.0.smithi153.stderr: -427> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient: _reopen_session rank -1 2024-09-19T14:06:58.745 INFO:tasks.workunit.client.0.smithi153.stderr: -426> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T14:06:58.745 INFO:tasks.workunit.client.0.smithi153.stderr: -425> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient(hunting): picked mon.noname-c con 0x55e29fbfb290 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:06:58.745 INFO:tasks.workunit.client.0.smithi153.stderr: -424> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient(hunting): picked mon.noname-a con 0x55e29fc90320 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:06:58.745 INFO:tasks.workunit.client.0.smithi153.stderr: -423> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient(hunting): picked mon.noname-b con 0x55e29fc93d50 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:06:58.745 INFO:tasks.workunit.client.0.smithi153.stderr: -422> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:58.745 INFO:tasks.workunit.client.0.smithi153.stderr: -421> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:58.745 INFO:tasks.workunit.client.0.smithi153.stderr: -420> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:58.745 INFO:tasks.workunit.client.0.smithi153.stderr: -419> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient(hunting): _renew_subs 2024-09-19T14:06:58.745 INFO:tasks.workunit.client.0.smithi153.stderr: -418> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient(hunting): authenticate will time out at 2607.096090s 2024-09-19T14:06:58.745 INFO:tasks.workunit.client.0.smithi153.stderr: -417> 2024-09-19T14:06:58.633+0000 7f65666a3640 10 monclient(hunting): get_auth_request con 0x55e29fbfb290 auth_method 0 2024-09-19T14:06:58.745 INFO:tasks.workunit.client.0.smithi153.stderr: -416> 2024-09-19T14:06:58.633+0000 7f65666a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:58.746 INFO:tasks.workunit.client.0.smithi153.stderr: -415> 2024-09-19T14:06:58.633+0000 7f65666a3640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:58.746 INFO:tasks.workunit.client.0.smithi153.stderr: -414> 2024-09-19T14:06:58.633+0000 7f65666a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:58.746 INFO:tasks.workunit.client.0.smithi153.stderr: -413> 2024-09-19T14:06:58.633+0000 7f6565ea2640 10 monclient(hunting): get_auth_request con 0x55e29fc90320 auth_method 0 2024-09-19T14:06:58.746 INFO:tasks.workunit.client.0.smithi153.stderr: -412> 2024-09-19T14:06:58.633+0000 7f6565ea2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:58.746 INFO:tasks.workunit.client.0.smithi153.stderr: -411> 2024-09-19T14:06:58.633+0000 7f6565ea2640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:58.746 INFO:tasks.workunit.client.0.smithi153.stderr: -410> 2024-09-19T14:06:58.633+0000 7f6565ea2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:58.746 INFO:tasks.workunit.client.0.smithi153.stderr: -409> 2024-09-19T14:06:58.633+0000 7f65666a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:58.746 INFO:tasks.workunit.client.0.smithi153.stderr: -408> 2024-09-19T14:06:58.633+0000 7f65666a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:58.746 INFO:tasks.workunit.client.0.smithi153.stderr: -407> 2024-09-19T14:06:58.633+0000 7f65666a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:58.746 INFO:tasks.workunit.client.0.smithi153.stderr: -406> 2024-09-19T14:06:58.633+0000 7f6565ea2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:58.746 INFO:tasks.workunit.client.0.smithi153.stderr: -405> 2024-09-19T14:06:58.633+0000 7f6565ea2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:58.746 INFO:tasks.workunit.client.0.smithi153.stderr: -404> 2024-09-19T14:06:58.633+0000 7f6565ea2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:58.746 INFO:tasks.workunit.client.0.smithi153.stderr: -403> 2024-09-19T14:06:58.633+0000 7f65666a3640 10 monclient(hunting): handle_auth_done global_id 6188 payload 824 2024-09-19T14:06:58.747 INFO:tasks.workunit.client.0.smithi153.stderr: -402> 2024-09-19T14:06:58.633+0000 7f65666a3640 10 monclient: _finish_hunting 0 2024-09-19T14:06:58.747 INFO:tasks.workunit.client.0.smithi153.stderr: -401> 2024-09-19T14:06:58.633+0000 7f65666a3640 1 monclient: found mon.noname-c 2024-09-19T14:06:58.747 INFO:tasks.workunit.client.0.smithi153.stderr: -400> 2024-09-19T14:06:58.633+0000 7f65666a3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:06:58.747 INFO:tasks.workunit.client.0.smithi153.stderr: -399> 2024-09-19T14:06:58.633+0000 7f6452e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:58.747 INFO:tasks.workunit.client.0.smithi153.stderr: -398> 2024-09-19T14:06:58.633+0000 7f6452e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:06:58.747 INFO:tasks.workunit.client.0.smithi153.stderr: -397> 2024-09-19T14:06:58.633+0000 7f6452e05640 10 monclient: dump: 2024-09-19T14:06:58.747 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:58.747 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:58.747 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.747 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.747 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:58.747 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.747 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:58.747 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:58.748 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:58.748 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.748 INFO:tasks.workunit.client.0.smithi153.stderr: -396> 2024-09-19T14:06:58.633+0000 7f6452e05640 10 monclient: _finish_auth 0 2024-09-19T14:06:58.748 INFO:tasks.workunit.client.0.smithi153.stderr: -395> 2024-09-19T14:06:58.633+0000 7f6452e05640 10 monclient: _check_auth_tickets 2024-09-19T14:06:58.748 INFO:tasks.workunit.client.0.smithi153.stderr: -394> 2024-09-19T14:06:58.633+0000 7f6452e05640 10 monclient: handle_config config(0 keys) 2024-09-19T14:06:58.748 INFO:tasks.workunit.client.0.smithi153.stderr: -393> 2024-09-19T14:06:58.633+0000 7f6452e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:58.748 INFO:tasks.workunit.client.0.smithi153.stderr: -392> 2024-09-19T14:06:58.633+0000 7f6452e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:06:58.748 INFO:tasks.workunit.client.0.smithi153.stderr: -391> 2024-09-19T14:06:58.633+0000 7f6452e05640 10 monclient: dump: 2024-09-19T14:06:58.748 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:58.748 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:58.748 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.748 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.748 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:58.749 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.749 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:58.749 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:58.749 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:58.749 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.749 INFO:tasks.workunit.client.0.smithi153.stderr: -390> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 5 monclient: authenticate success, global_id 6188 2024-09-19T14:06:58.749 INFO:tasks.workunit.client.0.smithi153.stderr: -389> 2024-09-19T14:06:58.633+0000 7f6454608640 4 set_mon_vals no callback set 2024-09-19T14:06:58.749 INFO:tasks.workunit.client.0.smithi153.stderr: -388> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient: _renew_subs 2024-09-19T14:06:58.749 INFO:tasks.workunit.client.0.smithi153.stderr: -387> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:06:58.749 INFO:tasks.workunit.client.0.smithi153.stderr: -386> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient: _renew_subs 2024-09-19T14:06:58.749 INFO:tasks.workunit.client.0.smithi153.stderr: -385> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:06:58.749 INFO:tasks.workunit.client.0.smithi153.stderr: -384> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 1 librados: init done 2024-09-19T14:06:58.749 INFO:tasks.workunit.client.0.smithi153.stderr: -383> 2024-09-19T14:06:58.633+0000 7f6452e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:06:58.749 INFO:tasks.workunit.client.0.smithi153.stderr: -382> 2024-09-19T14:06:58.633+0000 7f6452e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:06:58.750 INFO:tasks.workunit.client.0.smithi153.stderr: -381> 2024-09-19T14:06:58.633+0000 7f6452e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:06:58.750 INFO:tasks.workunit.client.0.smithi153.stderr: -380> 2024-09-19T14:06:58.633+0000 7f6565ea2640 10 monclient: get_auth_request con 0x7f644c071c10 auth_method 0 2024-09-19T14:06:58.750 INFO:tasks.workunit.client.0.smithi153.stderr: -379> 2024-09-19T14:06:58.633+0000 7f6566ea4640 10 monclient: get_auth_request con 0x55e29fd72e50 auth_method 0 2024-09-19T14:06:58.750 INFO:tasks.workunit.client.0.smithi153.stderr: -378> 2024-09-19T14:06:58.637+0000 7f65666a3640 10 monclient: get_auth_request con 0x55e29fd95fb0 auth_method 0 2024-09-19T14:06:58.750 INFO:tasks.workunit.client.0.smithi153.stderr: -377> 2024-09-19T14:06:58.637+0000 7f6565ea2640 10 monclient: get_auth_request con 0x55e29fd9b4f0 auth_method 0 2024-09-19T14:06:58.750 INFO:tasks.workunit.client.0.smithi153.stderr: -376> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient: build_initial_monmap 2024-09-19T14:06:58.750 INFO:tasks.workunit.client.0.smithi153.stderr: -375> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 1 build_initial for_mkfs: 0 2024-09-19T14:06:58.750 INFO:tasks.workunit.client.0.smithi153.stderr: -374> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient: monmap: 2024-09-19T14:06:58.750 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:06:58.750 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:06:58.750 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:06:58.750 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:06:58.750 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:06:58.751 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.751 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:06:58.751 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:06:58.751 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:06:58.751 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.751 INFO:tasks.workunit.client.0.smithi153.stderr: -373> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding auth protocol: cephx 2024-09-19T14:06:58.751 INFO:tasks.workunit.client.0.smithi153.stderr: -372> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding auth protocol: cephx 2024-09-19T14:06:58.751 INFO:tasks.workunit.client.0.smithi153.stderr: -371> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding auth protocol: cephx 2024-09-19T14:06:58.751 INFO:tasks.workunit.client.0.smithi153.stderr: -370> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding con mode: secure 2024-09-19T14:06:58.751 INFO:tasks.workunit.client.0.smithi153.stderr: -369> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding con mode: crc 2024-09-19T14:06:58.751 INFO:tasks.workunit.client.0.smithi153.stderr: -368> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding con mode: secure 2024-09-19T14:06:58.751 INFO:tasks.workunit.client.0.smithi153.stderr: -367> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding con mode: crc 2024-09-19T14:06:58.751 INFO:tasks.workunit.client.0.smithi153.stderr: -366> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding con mode: secure 2024-09-19T14:06:58.751 INFO:tasks.workunit.client.0.smithi153.stderr: -365> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding con mode: crc 2024-09-19T14:06:58.752 INFO:tasks.workunit.client.0.smithi153.stderr: -364> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding con mode: crc 2024-09-19T14:06:58.752 INFO:tasks.workunit.client.0.smithi153.stderr: -363> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding con mode: secure 2024-09-19T14:06:58.752 INFO:tasks.workunit.client.0.smithi153.stderr: -362> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding con mode: crc 2024-09-19T14:06:58.752 INFO:tasks.workunit.client.0.smithi153.stderr: -361> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding con mode: secure 2024-09-19T14:06:58.752 INFO:tasks.workunit.client.0.smithi153.stderr: -360> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding con mode: crc 2024-09-19T14:06:58.752 INFO:tasks.workunit.client.0.smithi153.stderr: -359> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding con mode: secure 2024-09-19T14:06:58.752 INFO:tasks.workunit.client.0.smithi153.stderr: -358> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.752 INFO:tasks.workunit.client.0.smithi153.stderr: -357> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command objecter_requests cmddesc objecter_requests hook 0x55e29fda2c50 EEXIST 2024-09-19T14:06:58.752 INFO:tasks.workunit.client.0.smithi153.stderr: -356> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient: init 2024-09-19T14:06:58.752 INFO:tasks.workunit.client.0.smithi153.stderr: -355> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding auth protocol: cephx 2024-09-19T14:06:58.752 INFO:tasks.workunit.client.0.smithi153.stderr: -354> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding auth protocol: cephx 2024-09-19T14:06:58.752 INFO:tasks.workunit.client.0.smithi153.stderr: -353> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding auth protocol: cephx 2024-09-19T14:06:58.752 INFO:tasks.workunit.client.0.smithi153.stderr: -352> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding con mode: secure 2024-09-19T14:06:58.752 INFO:tasks.workunit.client.0.smithi153.stderr: -351> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding con mode: crc 2024-09-19T14:06:58.753 INFO:tasks.workunit.client.0.smithi153.stderr: -350> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding con mode: secure 2024-09-19T14:06:58.753 INFO:tasks.workunit.client.0.smithi153.stderr: -349> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding con mode: crc 2024-09-19T14:06:58.753 INFO:tasks.workunit.client.0.smithi153.stderr: -348> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding con mode: secure 2024-09-19T14:06:58.753 INFO:tasks.workunit.client.0.smithi153.stderr: -347> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding con mode: crc 2024-09-19T14:06:58.753 INFO:tasks.workunit.client.0.smithi153.stderr: -346> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding con mode: crc 2024-09-19T14:06:58.753 INFO:tasks.workunit.client.0.smithi153.stderr: -345> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding con mode: secure 2024-09-19T14:06:58.753 INFO:tasks.workunit.client.0.smithi153.stderr: -344> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding con mode: crc 2024-09-19T14:06:58.753 INFO:tasks.workunit.client.0.smithi153.stderr: -343> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding con mode: secure 2024-09-19T14:06:58.753 INFO:tasks.workunit.client.0.smithi153.stderr: -342> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding con mode: crc 2024-09-19T14:06:58.753 INFO:tasks.workunit.client.0.smithi153.stderr: -341> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding con mode: secure 2024-09-19T14:06:58.753 INFO:tasks.workunit.client.0.smithi153.stderr: -340> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.753 INFO:tasks.workunit.client.0.smithi153.stderr: -339> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.753 INFO:tasks.workunit.client.0.smithi153.stderr: -338> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command rotate-key cmddesc rotate-key hook 0x55e29fd9e380 EEXIST 2024-09-19T14:06:58.753 INFO:tasks.workunit.client.0.smithi153.stderr: -337> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient: _reopen_session rank -1 2024-09-19T14:06:58.754 INFO:tasks.workunit.client.0.smithi153.stderr: -336> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:06:58.754 INFO:tasks.workunit.client.0.smithi153.stderr: -335> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient(hunting): picked mon.noname-b con 0x55e29fdc6e00 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:06:58.754 INFO:tasks.workunit.client.0.smithi153.stderr: -334> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient(hunting): picked mon.noname-a con 0x55e29fdc6730 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:06:58.754 INFO:tasks.workunit.client.0.smithi153.stderr: -333> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient(hunting): picked mon.noname-c con 0x55e29fdc5110 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:06:58.754 INFO:tasks.workunit.client.0.smithi153.stderr: -332> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:58.754 INFO:tasks.workunit.client.0.smithi153.stderr: -331> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:58.754 INFO:tasks.workunit.client.0.smithi153.stderr: -330> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:58.754 INFO:tasks.workunit.client.0.smithi153.stderr: -329> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient(hunting): _renew_subs 2024-09-19T14:06:58.754 INFO:tasks.workunit.client.0.smithi153.stderr: -328> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient(hunting): authenticate will time out at 2607.105809s 2024-09-19T14:06:58.754 INFO:tasks.workunit.client.0.smithi153.stderr: -327> 2024-09-19T14:06:58.641+0000 7f6565ea2640 10 monclient(hunting): get_auth_request con 0x55e29fdc6730 auth_method 0 2024-09-19T14:06:58.754 INFO:tasks.workunit.client.0.smithi153.stderr: -326> 2024-09-19T14:06:58.641+0000 7f6565ea2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:58.754 INFO:tasks.workunit.client.0.smithi153.stderr: -325> 2024-09-19T14:06:58.641+0000 7f6565ea2640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:58.754 INFO:tasks.workunit.client.0.smithi153.stderr: -324> 2024-09-19T14:06:58.641+0000 7f6565ea2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:58.754 INFO:tasks.workunit.client.0.smithi153.stderr: -323> 2024-09-19T14:06:58.641+0000 7f6566ea4640 10 monclient(hunting): get_auth_request con 0x55e29fdc5110 auth_method 0 2024-09-19T14:06:58.755 INFO:tasks.workunit.client.0.smithi153.stderr: -322> 2024-09-19T14:06:58.641+0000 7f6566ea4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:58.755 INFO:tasks.workunit.client.0.smithi153.stderr: -321> 2024-09-19T14:06:58.641+0000 7f6566ea4640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:58.755 INFO:tasks.workunit.client.0.smithi153.stderr: -320> 2024-09-19T14:06:58.641+0000 7f6566ea4640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:58.755 INFO:tasks.workunit.client.0.smithi153.stderr: -319> 2024-09-19T14:06:58.641+0000 7f6565ea2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:58.755 INFO:tasks.workunit.client.0.smithi153.stderr: -318> 2024-09-19T14:06:58.641+0000 7f6565ea2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:58.755 INFO:tasks.workunit.client.0.smithi153.stderr: -317> 2024-09-19T14:06:58.641+0000 7f6565ea2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:58.755 INFO:tasks.workunit.client.0.smithi153.stderr: -316> 2024-09-19T14:06:58.641+0000 7f6566ea4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:58.755 INFO:tasks.workunit.client.0.smithi153.stderr: -315> 2024-09-19T14:06:58.641+0000 7f6566ea4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:58.755 INFO:tasks.workunit.client.0.smithi153.stderr: -314> 2024-09-19T14:06:58.641+0000 7f6566ea4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:58.755 INFO:tasks.workunit.client.0.smithi153.stderr: -313> 2024-09-19T14:06:58.641+0000 7f65666a3640 10 monclient(hunting): get_auth_request con 0x55e29fdc6e00 auth_method 0 2024-09-19T14:06:58.755 INFO:tasks.workunit.client.0.smithi153.stderr: -312> 2024-09-19T14:06:58.641+0000 7f65666a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:58.755 INFO:tasks.workunit.client.0.smithi153.stderr: -311> 2024-09-19T14:06:58.641+0000 7f65666a3640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:58.755 INFO:tasks.workunit.client.0.smithi153.stderr: -310> 2024-09-19T14:06:58.641+0000 7f65666a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:58.755 INFO:tasks.workunit.client.0.smithi153.stderr: -309> 2024-09-19T14:06:58.641+0000 7f6565ea2640 10 monclient(hunting): handle_auth_done global_id 6591 payload 824 2024-09-19T14:06:58.755 INFO:tasks.workunit.client.0.smithi153.stderr: -308> 2024-09-19T14:06:58.641+0000 7f6565ea2640 10 monclient: _finish_hunting 0 2024-09-19T14:06:58.756 INFO:tasks.workunit.client.0.smithi153.stderr: -307> 2024-09-19T14:06:58.641+0000 7f6565ea2640 1 monclient: found mon.noname-a 2024-09-19T14:06:58.756 INFO:tasks.workunit.client.0.smithi153.stderr: -306> 2024-09-19T14:06:58.641+0000 7f6565ea2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:06:58.756 INFO:tasks.workunit.client.0.smithi153.stderr: -305> 2024-09-19T14:06:58.641+0000 7f644bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:58.756 INFO:tasks.workunit.client.0.smithi153.stderr: -304> 2024-09-19T14:06:58.641+0000 7f644bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:06:58.756 INFO:tasks.workunit.client.0.smithi153.stderr: -303> 2024-09-19T14:06:58.641+0000 7f644bfff640 10 monclient: dump: 2024-09-19T14:06:58.756 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:58.756 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:58.756 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.756 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.756 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:58.756 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.756 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:58.756 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:58.756 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:58.757 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.757 INFO:tasks.workunit.client.0.smithi153.stderr: -302> 2024-09-19T14:06:58.641+0000 7f644bfff640 10 monclient: _finish_auth 0 2024-09-19T14:06:58.757 INFO:tasks.workunit.client.0.smithi153.stderr: -301> 2024-09-19T14:06:58.641+0000 7f644bfff640 10 monclient: _check_auth_tickets 2024-09-19T14:06:58.757 INFO:tasks.workunit.client.0.smithi153.stderr: -300> 2024-09-19T14:06:58.641+0000 7f644bfff640 10 monclient: handle_config config(0 keys) 2024-09-19T14:06:58.757 INFO:tasks.workunit.client.0.smithi153.stderr: -299> 2024-09-19T14:06:58.641+0000 7f644bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:58.757 INFO:tasks.workunit.client.0.smithi153.stderr: -298> 2024-09-19T14:06:58.641+0000 7f644bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:06:58.757 INFO:tasks.workunit.client.0.smithi153.stderr: -297> 2024-09-19T14:06:58.641+0000 7f644bfff640 10 monclient: dump: 2024-09-19T14:06:58.757 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:58.757 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:58.757 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.757 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.757 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:58.757 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.757 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:58.758 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:58.758 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:58.758 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.758 INFO:tasks.workunit.client.0.smithi153.stderr: -296> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 monclient: authenticate success, global_id 6591 2024-09-19T14:06:58.758 INFO:tasks.workunit.client.0.smithi153.stderr: -295> 2024-09-19T14:06:58.641+0000 7f6564ea0640 4 set_mon_vals no callback set 2024-09-19T14:06:58.758 INFO:tasks.workunit.client.0.smithi153.stderr: -294> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient: _renew_subs 2024-09-19T14:06:58.758 INFO:tasks.workunit.client.0.smithi153.stderr: -293> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:06:58.758 INFO:tasks.workunit.client.0.smithi153.stderr: -292> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient: _renew_subs 2024-09-19T14:06:58.758 INFO:tasks.workunit.client.0.smithi153.stderr: -291> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:06:58.758 INFO:tasks.workunit.client.0.smithi153.stderr: -290> 2024-09-19T14:06:58.645+0000 7f644bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:06:58.758 INFO:tasks.workunit.client.0.smithi153.stderr: -289> 2024-09-19T14:06:58.645+0000 7f644bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:06:58.758 INFO:tasks.workunit.client.0.smithi153.stderr: -288> 2024-09-19T14:06:58.645+0000 7f644bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:06:58.758 INFO:tasks.workunit.client.0.smithi153.stderr: -287> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient: get_monmap_and_config 2024-09-19T14:06:58.759 INFO:tasks.workunit.client.0.smithi153.stderr: -286> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient: build_initial_monmap 2024-09-19T14:06:58.759 INFO:tasks.workunit.client.0.smithi153.stderr: -285> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 1 build_initial for_mkfs: 0 2024-09-19T14:06:58.759 INFO:tasks.workunit.client.0.smithi153.stderr: -284> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient: monmap: 2024-09-19T14:06:58.759 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:06:58.759 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:06:58.759 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:06:58.759 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:06:58.759 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:06:58.759 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.759 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:06:58.759 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:06:58.759 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:06:58.759 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.760 INFO:tasks.workunit.client.0.smithi153.stderr: -283> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding auth protocol: cephx 2024-09-19T14:06:58.760 INFO:tasks.workunit.client.0.smithi153.stderr: -282> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding auth protocol: cephx 2024-09-19T14:06:58.760 INFO:tasks.workunit.client.0.smithi153.stderr: -281> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding auth protocol: cephx 2024-09-19T14:06:58.760 INFO:tasks.workunit.client.0.smithi153.stderr: -280> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding con mode: secure 2024-09-19T14:06:58.760 INFO:tasks.workunit.client.0.smithi153.stderr: -279> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding con mode: crc 2024-09-19T14:06:58.760 INFO:tasks.workunit.client.0.smithi153.stderr: -278> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding con mode: secure 2024-09-19T14:06:58.760 INFO:tasks.workunit.client.0.smithi153.stderr: -277> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding con mode: crc 2024-09-19T14:06:58.760 INFO:tasks.workunit.client.0.smithi153.stderr: -276> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding con mode: secure 2024-09-19T14:06:58.760 INFO:tasks.workunit.client.0.smithi153.stderr: -275> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding con mode: crc 2024-09-19T14:06:58.760 INFO:tasks.workunit.client.0.smithi153.stderr: -274> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding con mode: crc 2024-09-19T14:06:58.760 INFO:tasks.workunit.client.0.smithi153.stderr: -273> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding con mode: secure 2024-09-19T14:06:58.760 INFO:tasks.workunit.client.0.smithi153.stderr: -272> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding con mode: crc 2024-09-19T14:06:58.760 INFO:tasks.workunit.client.0.smithi153.stderr: -271> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding con mode: secure 2024-09-19T14:06:58.761 INFO:tasks.workunit.client.0.smithi153.stderr: -270> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding con mode: crc 2024-09-19T14:06:58.761 INFO:tasks.workunit.client.0.smithi153.stderr: -269> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding con mode: secure 2024-09-19T14:06:58.761 INFO:tasks.workunit.client.0.smithi153.stderr: -268> 2024-09-19T14:06:58.645+0000 7f65666a3640 10 monclient: get_auth_request con 0x7f6440071b20 auth_method 0 2024-09-19T14:06:58.761 INFO:tasks.workunit.client.0.smithi153.stderr: -267> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.761 INFO:tasks.workunit.client.0.smithi153.stderr: -266> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient: init 2024-09-19T14:06:58.761 INFO:tasks.workunit.client.0.smithi153.stderr: -265> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding auth protocol: cephx 2024-09-19T14:06:58.761 INFO:tasks.workunit.client.0.smithi153.stderr: -264> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding auth protocol: cephx 2024-09-19T14:06:58.761 INFO:tasks.workunit.client.0.smithi153.stderr: -263> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding auth protocol: cephx 2024-09-19T14:06:58.761 INFO:tasks.workunit.client.0.smithi153.stderr: -262> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding con mode: secure 2024-09-19T14:06:58.761 INFO:tasks.workunit.client.0.smithi153.stderr: -261> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding con mode: crc 2024-09-19T14:06:58.761 INFO:tasks.workunit.client.0.smithi153.stderr: -260> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding con mode: secure 2024-09-19T14:06:58.761 INFO:tasks.workunit.client.0.smithi153.stderr: -259> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding con mode: crc 2024-09-19T14:06:58.762 INFO:tasks.workunit.client.0.smithi153.stderr: -258> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding con mode: secure 2024-09-19T14:06:58.762 INFO:tasks.workunit.client.0.smithi153.stderr: -257> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding con mode: crc 2024-09-19T14:06:58.762 INFO:tasks.workunit.client.0.smithi153.stderr: -256> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding con mode: crc 2024-09-19T14:06:58.762 INFO:tasks.workunit.client.0.smithi153.stderr: -255> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding con mode: secure 2024-09-19T14:06:58.762 INFO:tasks.workunit.client.0.smithi153.stderr: -254> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding con mode: crc 2024-09-19T14:06:58.762 INFO:tasks.workunit.client.0.smithi153.stderr: -253> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding con mode: secure 2024-09-19T14:06:58.762 INFO:tasks.workunit.client.0.smithi153.stderr: -252> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding con mode: crc 2024-09-19T14:06:58.762 INFO:tasks.workunit.client.0.smithi153.stderr: -251> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding con mode: secure 2024-09-19T14:06:58.762 INFO:tasks.workunit.client.0.smithi153.stderr: -250> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.762 INFO:tasks.workunit.client.0.smithi153.stderr: -249> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.762 INFO:tasks.workunit.client.0.smithi153.stderr: -248> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command rotate-key cmddesc rotate-key hook 0x7ffe2e6ecac8 EEXIST 2024-09-19T14:06:58.762 INFO:tasks.workunit.client.0.smithi153.stderr: -247> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient: _reopen_session rank -1 2024-09-19T14:06:58.762 INFO:tasks.workunit.client.0.smithi153.stderr: -246> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T14:06:58.762 INFO:tasks.workunit.client.0.smithi153.stderr: -245> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient(hunting): picked mon.noname-c con 0x55e29fe1ac70 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:06:58.763 INFO:tasks.workunit.client.0.smithi153.stderr: -244> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient(hunting): picked mon.noname-b con 0x55e29fdeab00 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:06:58.763 INFO:tasks.workunit.client.0.smithi153.stderr: -243> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient(hunting): picked mon.noname-a con 0x55e29fe16060 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:06:58.763 INFO:tasks.workunit.client.0.smithi153.stderr: -242> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:58.763 INFO:tasks.workunit.client.0.smithi153.stderr: -241> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:58.763 INFO:tasks.workunit.client.0.smithi153.stderr: -240> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:58.763 INFO:tasks.workunit.client.0.smithi153.stderr: -239> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient(hunting): _renew_subs 2024-09-19T14:06:58.763 INFO:tasks.workunit.client.0.smithi153.stderr: -238> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient(hunting): authenticate will time out at 2607.110252s 2024-09-19T14:06:58.763 INFO:tasks.workunit.client.0.smithi153.stderr: -237> 2024-09-19T14:06:58.645+0000 7f65666a3640 10 monclient(hunting): get_auth_request con 0x55e29fe1ac70 auth_method 0 2024-09-19T14:06:58.763 INFO:tasks.workunit.client.0.smithi153.stderr: -236> 2024-09-19T14:06:58.645+0000 7f65666a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:58.763 INFO:tasks.workunit.client.0.smithi153.stderr: -235> 2024-09-19T14:06:58.645+0000 7f65666a3640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:58.763 INFO:tasks.workunit.client.0.smithi153.stderr: -234> 2024-09-19T14:06:58.645+0000 7f65666a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:58.763 INFO:tasks.workunit.client.0.smithi153.stderr: -233> 2024-09-19T14:06:58.645+0000 7f6566ea4640 10 monclient(hunting): get_auth_request con 0x55e29fe16060 auth_method 0 2024-09-19T14:06:58.763 INFO:tasks.workunit.client.0.smithi153.stderr: -232> 2024-09-19T14:06:58.645+0000 7f6566ea4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:58.763 INFO:tasks.workunit.client.0.smithi153.stderr: -231> 2024-09-19T14:06:58.645+0000 7f6566ea4640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:58.764 INFO:tasks.workunit.client.0.smithi153.stderr: -230> 2024-09-19T14:06:58.645+0000 7f6566ea4640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:58.764 INFO:tasks.workunit.client.0.smithi153.stderr: -229> 2024-09-19T14:06:58.645+0000 7f65666a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:58.764 INFO:tasks.workunit.client.0.smithi153.stderr: -228> 2024-09-19T14:06:58.645+0000 7f65666a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:58.764 INFO:tasks.workunit.client.0.smithi153.stderr: -227> 2024-09-19T14:06:58.645+0000 7f65666a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:58.764 INFO:tasks.workunit.client.0.smithi153.stderr: -226> 2024-09-19T14:06:58.645+0000 7f6566ea4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:58.764 INFO:tasks.workunit.client.0.smithi153.stderr: -225> 2024-09-19T14:06:58.645+0000 7f6566ea4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:58.764 INFO:tasks.workunit.client.0.smithi153.stderr: -224> 2024-09-19T14:06:58.645+0000 7f6566ea4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:58.764 INFO:tasks.workunit.client.0.smithi153.stderr: -223> 2024-09-19T14:06:58.645+0000 7f65666a3640 10 monclient(hunting): handle_auth_done global_id 6194 payload 274 2024-09-19T14:06:58.764 INFO:tasks.workunit.client.0.smithi153.stderr: -222> 2024-09-19T14:06:58.645+0000 7f65666a3640 10 monclient: _finish_hunting 0 2024-09-19T14:06:58.764 INFO:tasks.workunit.client.0.smithi153.stderr: -221> 2024-09-19T14:06:58.645+0000 7f65666a3640 1 monclient: found mon.noname-c 2024-09-19T14:06:58.764 INFO:tasks.workunit.client.0.smithi153.stderr: -220> 2024-09-19T14:06:58.645+0000 7f65666a3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:06:58.764 INFO:tasks.workunit.client.0.smithi153.stderr: -219> 2024-09-19T14:06:58.645+0000 7f6449ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:58.765 INFO:tasks.workunit.client.0.smithi153.stderr: -218> 2024-09-19T14:06:58.645+0000 7f6449ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:06:58.765 INFO:tasks.workunit.client.0.smithi153.stderr: -217> 2024-09-19T14:06:58.645+0000 7f6449ffb640 10 monclient: dump: 2024-09-19T14:06:58.765 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:58.765 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:58.765 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.765 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.765 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:58.765 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.765 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:58.765 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:58.765 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:58.765 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.766 INFO:tasks.workunit.client.0.smithi153.stderr: -216> 2024-09-19T14:06:58.645+0000 7f6449ffb640 10 monclient: _finish_auth 0 2024-09-19T14:06:58.766 INFO:tasks.workunit.client.0.smithi153.stderr: -215> 2024-09-19T14:06:58.645+0000 7f6449ffb640 10 monclient: _check_auth_tickets 2024-09-19T14:06:58.766 INFO:tasks.workunit.client.0.smithi153.stderr: -214> 2024-09-19T14:06:58.645+0000 7f6449ffb640 10 monclient: handle_config config(0 keys) 2024-09-19T14:06:58.766 INFO:tasks.workunit.client.0.smithi153.stderr: -213> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 monclient: authenticate success, global_id 6194 2024-09-19T14:06:58.766 INFO:tasks.workunit.client.0.smithi153.stderr: -212> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient: get_monmap_and_config success 2024-09-19T14:06:58.766 INFO:tasks.workunit.client.0.smithi153.stderr: -211> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 4 set_mon_vals no callback set 2024-09-19T14:06:58.766 INFO:tasks.workunit.client.0.smithi153.stderr: -210> 2024-09-19T14:06:58.645+0000 7f6449ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:58.766 INFO:tasks.workunit.client.0.smithi153.stderr: -209> 2024-09-19T14:06:58.645+0000 7f6449ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:06:58.766 INFO:tasks.workunit.client.0.smithi153.stderr: -208> 2024-09-19T14:06:58.645+0000 7f6449ffb640 10 monclient: dump: 2024-09-19T14:06:58.766 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:58.766 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:58.766 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.766 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.767 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:58.767 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.767 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:58.767 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:58.767 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:58.767 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.767 INFO:tasks.workunit.client.0.smithi153.stderr: -207> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient: shutdown 2024-09-19T14:06:58.767 INFO:tasks.workunit.client.0.smithi153.stderr: -206> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient: build_initial_monmap 2024-09-19T14:06:58.767 INFO:tasks.workunit.client.0.smithi153.stderr: -205> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 1 build_initial for_mkfs: 0 2024-09-19T14:06:58.767 INFO:tasks.workunit.client.0.smithi153.stderr: -204> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient: monmap: 2024-09-19T14:06:58.767 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:06:58.767 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:06:58.767 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:06:58.768 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:06:58.768 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:06:58.768 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.768 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:06:58.768 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:06:58.768 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:06:58.768 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.768 INFO:tasks.workunit.client.0.smithi153.stderr: -203> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding auth protocol: cephx 2024-09-19T14:06:58.768 INFO:tasks.workunit.client.0.smithi153.stderr: -202> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding auth protocol: cephx 2024-09-19T14:06:58.768 INFO:tasks.workunit.client.0.smithi153.stderr: -201> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding auth protocol: cephx 2024-09-19T14:06:58.768 INFO:tasks.workunit.client.0.smithi153.stderr: -200> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding con mode: secure 2024-09-19T14:06:58.768 INFO:tasks.workunit.client.0.smithi153.stderr: -199> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding con mode: crc 2024-09-19T14:06:58.769 INFO:tasks.workunit.client.0.smithi153.stderr: -198> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding con mode: secure 2024-09-19T14:06:58.769 INFO:tasks.workunit.client.0.smithi153.stderr: -197> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding con mode: crc 2024-09-19T14:06:58.769 INFO:tasks.workunit.client.0.smithi153.stderr: -196> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding con mode: secure 2024-09-19T14:06:58.769 INFO:tasks.workunit.client.0.smithi153.stderr: -195> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding con mode: crc 2024-09-19T14:06:58.769 INFO:tasks.workunit.client.0.smithi153.stderr: -194> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding con mode: crc 2024-09-19T14:06:58.769 INFO:tasks.workunit.client.0.smithi153.stderr: -193> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding con mode: secure 2024-09-19T14:06:58.769 INFO:tasks.workunit.client.0.smithi153.stderr: -192> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding con mode: crc 2024-09-19T14:06:58.769 INFO:tasks.workunit.client.0.smithi153.stderr: -191> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding con mode: secure 2024-09-19T14:06:58.769 INFO:tasks.workunit.client.0.smithi153.stderr: -190> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding con mode: crc 2024-09-19T14:06:58.769 INFO:tasks.workunit.client.0.smithi153.stderr: -189> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding con mode: secure 2024-09-19T14:06:58.769 INFO:tasks.workunit.client.0.smithi153.stderr: -188> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.770 INFO:tasks.workunit.client.0.smithi153.stderr: -187> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 1 librados: starting msgr at 2024-09-19T14:06:58.770 INFO:tasks.workunit.client.0.smithi153.stderr: -186> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 1 librados: starting objecter 2024-09-19T14:06:58.770 INFO:tasks.workunit.client.0.smithi153.stderr: -185> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command objecter_requests cmddesc objecter_requests hook 0x55e29fdea470 EEXIST 2024-09-19T14:06:58.770 INFO:tasks.workunit.client.0.smithi153.stderr: -184> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 1 librados: setting wanted keys 2024-09-19T14:06:58.770 INFO:tasks.workunit.client.0.smithi153.stderr: -183> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 1 librados: calling monclient init 2024-09-19T14:06:58.770 INFO:tasks.workunit.client.0.smithi153.stderr: -182> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient: init 2024-09-19T14:06:58.770 INFO:tasks.workunit.client.0.smithi153.stderr: -181> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding auth protocol: cephx 2024-09-19T14:06:58.770 INFO:tasks.workunit.client.0.smithi153.stderr: -180> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding auth protocol: cephx 2024-09-19T14:06:58.770 INFO:tasks.workunit.client.0.smithi153.stderr: -179> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding auth protocol: cephx 2024-09-19T14:06:58.770 INFO:tasks.workunit.client.0.smithi153.stderr: -178> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding con mode: secure 2024-09-19T14:06:58.770 INFO:tasks.workunit.client.0.smithi153.stderr: -177> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding con mode: crc 2024-09-19T14:06:58.770 INFO:tasks.workunit.client.0.smithi153.stderr: -176> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding con mode: secure 2024-09-19T14:06:58.770 INFO:tasks.workunit.client.0.smithi153.stderr: -175> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding con mode: crc 2024-09-19T14:06:58.771 INFO:tasks.workunit.client.0.smithi153.stderr: -174> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding con mode: secure 2024-09-19T14:06:58.771 INFO:tasks.workunit.client.0.smithi153.stderr: -173> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding con mode: crc 2024-09-19T14:06:58.771 INFO:tasks.workunit.client.0.smithi153.stderr: -172> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding con mode: crc 2024-09-19T14:06:58.771 INFO:tasks.workunit.client.0.smithi153.stderr: -171> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding con mode: secure 2024-09-19T14:06:58.771 INFO:tasks.workunit.client.0.smithi153.stderr: -170> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding con mode: crc 2024-09-19T14:06:58.771 INFO:tasks.workunit.client.0.smithi153.stderr: -169> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding con mode: secure 2024-09-19T14:06:58.771 INFO:tasks.workunit.client.0.smithi153.stderr: -168> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding con mode: crc 2024-09-19T14:06:58.771 INFO:tasks.workunit.client.0.smithi153.stderr: -167> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding con mode: secure 2024-09-19T14:06:58.771 INFO:tasks.workunit.client.0.smithi153.stderr: -166> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.771 INFO:tasks.workunit.client.0.smithi153.stderr: -165> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.771 INFO:tasks.workunit.client.0.smithi153.stderr: -164> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command rotate-key cmddesc rotate-key hook 0x55e29fdc8d68 EEXIST 2024-09-19T14:06:58.771 INFO:tasks.workunit.client.0.smithi153.stderr: -163> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient: _reopen_session rank -1 2024-09-19T14:06:58.771 INFO:tasks.workunit.client.0.smithi153.stderr: -162> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:06:58.772 INFO:tasks.workunit.client.0.smithi153.stderr: -161> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient(hunting): picked mon.noname-b con 0x55e29fdeab00 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:06:58.772 INFO:tasks.workunit.client.0.smithi153.stderr: -160> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient(hunting): picked mon.noname-a con 0x55e29fe16060 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:06:58.772 INFO:tasks.workunit.client.0.smithi153.stderr: -159> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient(hunting): picked mon.noname-c con 0x55e29fe1ac70 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:06:58.772 INFO:tasks.workunit.client.0.smithi153.stderr: -158> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:58.772 INFO:tasks.workunit.client.0.smithi153.stderr: -157> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:58.772 INFO:tasks.workunit.client.0.smithi153.stderr: -156> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:58.772 INFO:tasks.workunit.client.0.smithi153.stderr: -155> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient(hunting): _renew_subs 2024-09-19T14:06:58.772 INFO:tasks.workunit.client.0.smithi153.stderr: -154> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient(hunting): authenticate will time out at 2607.112821s 2024-09-19T14:06:58.772 INFO:tasks.workunit.client.0.smithi153.stderr: -153> 2024-09-19T14:06:58.649+0000 7f6566ea4640 10 monclient(hunting): get_auth_request con 0x55e29fe1ac70 auth_method 0 2024-09-19T14:06:58.772 INFO:tasks.workunit.client.0.smithi153.stderr: -152> 2024-09-19T14:06:58.649+0000 7f6566ea4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:58.772 INFO:tasks.workunit.client.0.smithi153.stderr: -151> 2024-09-19T14:06:58.649+0000 7f6566ea4640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:58.772 INFO:tasks.workunit.client.0.smithi153.stderr: -150> 2024-09-19T14:06:58.649+0000 7f6566ea4640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:58.773 INFO:tasks.workunit.client.0.smithi153.stderr: -149> 2024-09-19T14:06:58.649+0000 7f6565ea2640 10 monclient(hunting): get_auth_request con 0x55e29fe16060 auth_method 0 2024-09-19T14:06:58.773 INFO:tasks.workunit.client.0.smithi153.stderr: -148> 2024-09-19T14:06:58.649+0000 7f6565ea2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:58.773 INFO:tasks.workunit.client.0.smithi153.stderr: -147> 2024-09-19T14:06:58.649+0000 7f6565ea2640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:58.773 INFO:tasks.workunit.client.0.smithi153.stderr: -146> 2024-09-19T14:06:58.649+0000 7f6565ea2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:58.773 INFO:tasks.workunit.client.0.smithi153.stderr: -145> 2024-09-19T14:06:58.649+0000 7f6566ea4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:58.773 INFO:tasks.workunit.client.0.smithi153.stderr: -144> 2024-09-19T14:06:58.649+0000 7f6566ea4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:58.773 INFO:tasks.workunit.client.0.smithi153.stderr: -143> 2024-09-19T14:06:58.649+0000 7f6566ea4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:58.773 INFO:tasks.workunit.client.0.smithi153.stderr: -142> 2024-09-19T14:06:58.649+0000 7f6565ea2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:58.773 INFO:tasks.workunit.client.0.smithi153.stderr: -141> 2024-09-19T14:06:58.649+0000 7f6565ea2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:58.773 INFO:tasks.workunit.client.0.smithi153.stderr: -140> 2024-09-19T14:06:58.649+0000 7f6565ea2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:58.773 INFO:tasks.workunit.client.0.smithi153.stderr: -139> 2024-09-19T14:06:58.649+0000 7f65666a3640 10 monclient(hunting): get_auth_request con 0x55e29fdeab00 auth_method 0 2024-09-19T14:06:58.773 INFO:tasks.workunit.client.0.smithi153.stderr: -138> 2024-09-19T14:06:58.649+0000 7f65666a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:58.773 INFO:tasks.workunit.client.0.smithi153.stderr: -137> 2024-09-19T14:06:58.649+0000 7f65666a3640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:58.773 INFO:tasks.workunit.client.0.smithi153.stderr: -136> 2024-09-19T14:06:58.649+0000 7f65666a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:58.773 INFO:tasks.workunit.client.0.smithi153.stderr: -135> 2024-09-19T14:06:58.649+0000 7f6566ea4640 10 monclient(hunting): handle_auth_done global_id 6197 payload 824 2024-09-19T14:06:58.774 INFO:tasks.workunit.client.0.smithi153.stderr: -134> 2024-09-19T14:06:58.649+0000 7f6566ea4640 10 monclient: _finish_hunting 0 2024-09-19T14:06:58.774 INFO:tasks.workunit.client.0.smithi153.stderr: -133> 2024-09-19T14:06:58.649+0000 7f6566ea4640 1 monclient: found mon.noname-c 2024-09-19T14:06:58.774 INFO:tasks.workunit.client.0.smithi153.stderr: -132> 2024-09-19T14:06:58.649+0000 7f6566ea4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:06:58.774 INFO:tasks.workunit.client.0.smithi153.stderr: -131> 2024-09-19T14:06:58.649+0000 7f6437fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:58.774 INFO:tasks.workunit.client.0.smithi153.stderr: -130> 2024-09-19T14:06:58.649+0000 7f6437fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:06:58.774 INFO:tasks.workunit.client.0.smithi153.stderr: -129> 2024-09-19T14:06:58.649+0000 7f6437fff640 10 monclient: dump: 2024-09-19T14:06:58.774 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:58.774 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:58.774 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.774 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.774 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:58.774 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.774 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:58.775 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:58.775 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:58.775 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.775 INFO:tasks.workunit.client.0.smithi153.stderr: -128> 2024-09-19T14:06:58.649+0000 7f6437fff640 10 monclient: _finish_auth 0 2024-09-19T14:06:58.775 INFO:tasks.workunit.client.0.smithi153.stderr: -127> 2024-09-19T14:06:58.649+0000 7f6437fff640 10 monclient: _check_auth_tickets 2024-09-19T14:06:58.775 INFO:tasks.workunit.client.0.smithi153.stderr: -126> 2024-09-19T14:06:58.649+0000 7f6437fff640 10 monclient: handle_config config(0 keys) 2024-09-19T14:06:58.775 INFO:tasks.workunit.client.0.smithi153.stderr: -125> 2024-09-19T14:06:58.649+0000 7f6437fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:58.775 INFO:tasks.workunit.client.0.smithi153.stderr: -124> 2024-09-19T14:06:58.649+0000 7f6437fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:06:58.775 INFO:tasks.workunit.client.0.smithi153.stderr: -123> 2024-09-19T14:06:58.649+0000 7f6437fff640 10 monclient: dump: 2024-09-19T14:06:58.775 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:58.775 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:58.775 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.776 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.776 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:58.776 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.776 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:58.776 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:58.776 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:58.776 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.776 INFO:tasks.workunit.client.0.smithi153.stderr: -122> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 monclient: authenticate success, global_id 6197 2024-09-19T14:06:58.776 INFO:tasks.workunit.client.0.smithi153.stderr: -121> 2024-09-19T14:06:58.649+0000 7f6449ffb640 4 set_mon_vals no callback set 2024-09-19T14:06:58.776 INFO:tasks.workunit.client.0.smithi153.stderr: -120> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient: _renew_subs 2024-09-19T14:06:58.776 INFO:tasks.workunit.client.0.smithi153.stderr: -119> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:06:58.776 INFO:tasks.workunit.client.0.smithi153.stderr: -118> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient: _renew_subs 2024-09-19T14:06:58.776 INFO:tasks.workunit.client.0.smithi153.stderr: -117> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:06:58.777 INFO:tasks.workunit.client.0.smithi153.stderr: -116> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 1 librados: init done 2024-09-19T14:06:58.777 INFO:tasks.workunit.client.0.smithi153.stderr: -115> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command cr dump hook 0x55e29fe06a48 2024-09-19T14:06:58.777 INFO:tasks.workunit.client.0.smithi153.stderr: -114> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.777 INFO:tasks.workunit.client.0.smithi153.stderr: -113> 2024-09-19T14:06:58.653+0000 7f6437fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:06:58.777 INFO:tasks.workunit.client.0.smithi153.stderr: -112> 2024-09-19T14:06:58.653+0000 7f6437fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:06:58.777 INFO:tasks.workunit.client.0.smithi153.stderr: -111> 2024-09-19T14:06:58.653+0000 7f6437fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:06:58.777 INFO:tasks.workunit.client.0.smithi153.stderr: -110> 2024-09-19T14:06:58.653+0000 7f6565ea2640 10 monclient: get_auth_request con 0x55e29fe34530 auth_method 0 2024-09-19T14:06:58.777 INFO:tasks.workunit.client.0.smithi153.stderr: -109> 2024-09-19T14:06:58.653+0000 7f65666a3640 10 monclient: get_auth_request con 0x7f6430071be0 auth_method 0 2024-09-19T14:06:58.777 INFO:tasks.workunit.client.0.smithi153.stderr: -108> 2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.777 INFO:tasks.workunit.client.0.smithi153.stderr: -107> 2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 realm 2024-09-19T14:06:58.777 INFO:tasks.workunit.client.0.smithi153.stderr: -106> 2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.777 INFO:tasks.workunit.client.0.smithi153.stderr: -105> 2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.777 INFO:tasks.workunit.client.0.smithi153.stderr: -104> 2024-09-19T14:06:58.653+0000 7f6568b9d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:58.777 INFO:tasks.workunit.client.0.smithi153.stderr: -103> 2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.778 INFO:tasks.workunit.client.0.smithi153.stderr: -102> 2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.778 INFO:tasks.workunit.client.0.smithi153.stderr: -101> 2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.778 INFO:tasks.workunit.client.0.smithi153.stderr: -100> 2024-09-19T14:06:58.653+0000 7f65666a3640 10 monclient: get_auth_request con 0x55e29fe38720 auth_method 0 2024-09-19T14:06:58.778 INFO:tasks.workunit.client.0.smithi153.stderr: -99> 2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:58.778 INFO:tasks.workunit.client.0.smithi153.stderr: -98> 2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.778 INFO:tasks.workunit.client.0.smithi153.stderr: -97> 2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:58.778 INFO:tasks.workunit.client.0.smithi153.stderr: -96> 2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 searching for the correct realm 2024-09-19T14:06:58.778 INFO:tasks.workunit.client.0.smithi153.stderr: -95> 2024-09-19T14:06:58.653+0000 7f6565ea2640 10 monclient: get_auth_request con 0x55e29fe3d930 auth_method 0 2024-09-19T14:06:58.778 INFO:tasks.workunit.client.0.smithi153.stderr: -94> 2024-09-19T14:06:58.657+0000 7f6566ea4640 10 monclient: get_auth_request con 0x7f655c06a130 auth_method 0 2024-09-19T14:06:58.778 INFO:tasks.workunit.client.0.smithi153.stderr: -93> 2024-09-19T14:06:58.657+0000 7f65666a3640 10 monclient: get_auth_request con 0x7f6560033060 auth_method 0 2024-09-19T14:06:58.778 INFO:tasks.workunit.client.0.smithi153.stderr: -92> 2024-09-19T14:06:58.657+0000 7f6565ea2640 10 monclient: get_auth_request con 0x7f655810c030 auth_method 0 2024-09-19T14:06:58.778 INFO:tasks.workunit.client.0.smithi153.stderr: -91> 2024-09-19T14:06:58.661+0000 7f6565ea2640 0 -- 172.21.15.153:0/3629314063 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f655810c030 msgr2=0x7f655811e0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:58.778 INFO:tasks.workunit.client.0.smithi153.stderr: -90> 2024-09-19T14:06:58.661+0000 7f6437fff640 1 client.6197.objecter ms_handle_reset 0x7f655810c030 session 0x7f65580a6070 osd.4 2024-09-19T14:06:58.778 INFO:tasks.workunit.client.0.smithi153.stderr: -89> 2024-09-19T14:06:58.661+0000 7f6437fff640 10 monclient: _renew_subs 2024-09-19T14:06:58.778 INFO:tasks.workunit.client.0.smithi153.stderr: -88> 2024-09-19T14:06:58.661+0000 7f6437fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:06:58.779 INFO:tasks.workunit.client.0.smithi153.stderr: -87> 2024-09-19T14:06:58.661+0000 7f6566ea4640 10 monclient: get_auth_request con 0x7f655c065d20 auth_method 0 2024-09-19T14:06:58.779 INFO:tasks.workunit.client.0.smithi153.stderr: -86> 2024-09-19T14:06:58.661+0000 7f6565ea2640 10 monclient: get_auth_request con 0x7f6430082370 auth_method 0 2024-09-19T14:06:58.779 INFO:tasks.workunit.client.0.smithi153.stderr: -85> 2024-09-19T14:06:58.665+0000 7f65666a3640 10 monclient: get_auth_request con 0x7f655c06efc0 auth_method 0 2024-09-19T14:06:58.779 INFO:tasks.workunit.client.0.smithi153.stderr: -84> 2024-09-19T14:06:58.665+0000 7f6565ea2640 0 -- 172.21.15.153:0/3629314063 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f6430082370 msgr2=0x7f64300847a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:58.779 INFO:tasks.workunit.client.0.smithi153.stderr: -83> 2024-09-19T14:06:58.665+0000 7f6437fff640 1 client.6197.objecter ms_handle_reset 0x7f6430082370 session 0x7f65580a6070 osd.4 2024-09-19T14:06:58.779 INFO:tasks.workunit.client.0.smithi153.stderr: -82> 2024-09-19T14:06:58.669+0000 7f6565ea2640 10 monclient: get_auth_request con 0x7f655810c030 auth_method 0 2024-09-19T14:06:58.779 INFO:tasks.workunit.client.0.smithi153.stderr: -81> 2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:58.779 INFO:tasks.workunit.client.0.smithi153.stderr: -80> 2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:58.779 INFO:tasks.workunit.client.0.smithi153.stderr: -79> 2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:58.779 INFO:tasks.workunit.client.0.smithi153.stderr: -78> 2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:58.779 INFO:tasks.workunit.client.0.smithi153.stderr: -77> 2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:58.779 INFO:tasks.workunit.client.0.smithi153.stderr: -76> 2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:58.780 INFO:tasks.workunit.client.0.smithi153.stderr: -75> 2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.780 INFO:tasks.workunit.client.0.smithi153.stderr: -74> 2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.780 INFO:tasks.workunit.client.0.smithi153.stderr: -73> 2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.780 INFO:tasks.workunit.client.0.smithi153.stderr: -72> 2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:58.780 INFO:tasks.workunit.client.0.smithi153.stderr: -71> 2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.780 INFO:tasks.workunit.client.0.smithi153.stderr: -70> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:58.780 INFO:tasks.workunit.client.0.smithi153.stderr: -69> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 zone default found 2024-09-19T14:06:58.780 INFO:tasks.workunit.client.0.smithi153.stderr: -68> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 4 Realm: () 2024-09-19T14:06:58.780 INFO:tasks.workunit.client.0.smithi153.stderr: -67> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:58.780 INFO:tasks.workunit.client.0.smithi153.stderr: -66> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:58.780 INFO:tasks.workunit.client.0.smithi153.stderr: -65> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:58.780 INFO:tasks.workunit.client.0.smithi153.stderr: -64> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 zonegroup default 2024-09-19T14:06:58.781 INFO:tasks.workunit.client.0.smithi153.stderr: -63> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.781 INFO:tasks.workunit.client.0.smithi153.stderr: -62> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.781 INFO:tasks.workunit.client.0.smithi153.stderr: -61> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.781 INFO:tasks.workunit.client.0.smithi153.stderr: -60> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.781 INFO:tasks.workunit.client.0.smithi153.stderr: -59> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.781 INFO:tasks.workunit.client.0.smithi153.stderr: -58> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.781 INFO:tasks.workunit.client.0.smithi153.stderr: -57> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 started sync module instance, tier type = 2024-09-19T14:06:58.781 INFO:tasks.workunit.client.0.smithi153.stderr: -56> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:58.781 INFO:tasks.workunit.client.0.smithi153.stderr: -55> 2024-09-19T14:06:58.693+0000 7f6568b9d9c0 20 add_watcher() i=0 2024-09-19T14:06:58.781 INFO:tasks.workunit.client.0.smithi153.stderr: -54> 2024-09-19T14:06:58.693+0000 7f6568b9d9c0 20 add_watcher() i=1 2024-09-19T14:06:58.781 INFO:tasks.workunit.client.0.smithi153.stderr: -53> 2024-09-19T14:06:58.693+0000 7f6568b9d9c0 20 add_watcher() i=2 2024-09-19T14:06:58.781 INFO:tasks.workunit.client.0.smithi153.stderr: -52> 2024-09-19T14:06:58.693+0000 7f6568b9d9c0 20 add_watcher() i=3 2024-09-19T14:06:58.781 INFO:tasks.workunit.client.0.smithi153.stderr: -51> 2024-09-19T14:06:58.693+0000 7f6568b9d9c0 20 add_watcher() i=4 2024-09-19T14:06:58.782 INFO:tasks.workunit.client.0.smithi153.stderr: -50> 2024-09-19T14:06:58.693+0000 7f6568b9d9c0 20 add_watcher() i=5 2024-09-19T14:06:58.782 INFO:tasks.workunit.client.0.smithi153.stderr: -49> 2024-09-19T14:06:58.693+0000 7f6568b9d9c0 20 add_watcher() i=6 2024-09-19T14:06:58.782 INFO:tasks.workunit.client.0.smithi153.stderr: -48> 2024-09-19T14:06:58.693+0000 7f6568b9d9c0 20 add_watcher() i=7 2024-09-19T14:06:58.782 INFO:tasks.workunit.client.0.smithi153.stderr: -47> 2024-09-19T14:06:58.693+0000 7f6568b9d9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:58.782 INFO:tasks.workunit.client.0.smithi153.stderr: -46> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding auth protocol: cephx 2024-09-19T14:06:58.782 INFO:tasks.workunit.client.0.smithi153.stderr: -45> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding auth protocol: cephx 2024-09-19T14:06:58.782 INFO:tasks.workunit.client.0.smithi153.stderr: -44> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding auth protocol: cephx 2024-09-19T14:06:58.782 INFO:tasks.workunit.client.0.smithi153.stderr: -43> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding con mode: secure 2024-09-19T14:06:58.782 INFO:tasks.workunit.client.0.smithi153.stderr: -42> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding con mode: crc 2024-09-19T14:06:58.782 INFO:tasks.workunit.client.0.smithi153.stderr: -41> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding con mode: secure 2024-09-19T14:06:58.782 INFO:tasks.workunit.client.0.smithi153.stderr: -40> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding con mode: crc 2024-09-19T14:06:58.782 INFO:tasks.workunit.client.0.smithi153.stderr: -39> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding con mode: secure 2024-09-19T14:06:58.782 INFO:tasks.workunit.client.0.smithi153.stderr: -38> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding con mode: crc 2024-09-19T14:06:58.783 INFO:tasks.workunit.client.0.smithi153.stderr: -37> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding con mode: crc 2024-09-19T14:06:58.783 INFO:tasks.workunit.client.0.smithi153.stderr: -36> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding con mode: secure 2024-09-19T14:06:58.783 INFO:tasks.workunit.client.0.smithi153.stderr: -35> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding con mode: crc 2024-09-19T14:06:58.783 INFO:tasks.workunit.client.0.smithi153.stderr: -34> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding con mode: secure 2024-09-19T14:06:58.783 INFO:tasks.workunit.client.0.smithi153.stderr: -33> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding con mode: crc 2024-09-19T14:06:58.783 INFO:tasks.workunit.client.0.smithi153.stderr: -32> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding con mode: secure 2024-09-19T14:06:58.783 INFO:tasks.workunit.client.0.smithi153.stderr: -31> 2024-09-19T14:06:58.697+0000 7f641cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:58.783 INFO:tasks.workunit.client.0.smithi153.stderr: -30> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.783 INFO:tasks.workunit.client.0.smithi153.stderr: -29> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:58.783 INFO:tasks.workunit.client.0.smithi153.stderr: -28> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:58.783 INFO:tasks.workunit.client.0.smithi153.stderr: -27> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command cache list hook 0x55e29fe07540 2024-09-19T14:06:58.783 INFO:tasks.workunit.client.0.smithi153.stderr: -26> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command cache inspect hook 0x55e29fe07540 2024-09-19T14:06:58.783 INFO:tasks.workunit.client.0.smithi153.stderr: -25> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command cache erase hook 0x55e29fe07540 2024-09-19T14:06:58.783 INFO:tasks.workunit.client.0.smithi153.stderr: -24> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command cache zap hook 0x55e29fe07540 2024-09-19T14:06:58.783 INFO:tasks.workunit.client.0.smithi153.stderr: -23> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 note: GC not initialized 2024-09-19T14:06:58.784 INFO:tasks.workunit.client.0.smithi153.stderr: -22> 2024-09-19T14:06:58.697+0000 7f63977fe640 20 reqs_thread_entry: start 2024-09-19T14:06:58.784 INFO:tasks.workunit.client.0.smithi153.stderr: -21> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command sync trace show hook 0x7f655c004410 2024-09-19T14:06:58.784 INFO:tasks.workunit.client.0.smithi153.stderr: -20> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command sync trace history hook 0x7f655c004410 2024-09-19T14:06:58.784 INFO:tasks.workunit.client.0.smithi153.stderr: -19> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command sync trace active hook 0x7f655c004410 2024-09-19T14:06:58.784 INFO:tasks.workunit.client.0.smithi153.stderr: -18> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command sync trace active_short hook 0x7f655c004410 2024-09-19T14:06:58.784 INFO:tasks.workunit.client.0.smithi153.stderr: -17> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:58.784 INFO:tasks.workunit.client.0.smithi153.stderr: -16> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 20 Filter name: none 2024-09-19T14:06:58.784 INFO:tasks.workunit.client.0.smithi153.stderr: -15> 2024-09-19T14:06:58.697+0000 7f63957fa640 20 reqs_thread_entry: start 2024-09-19T14:06:58.784 INFO:tasks.workunit.client.0.smithi153.stderr: -14> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-19T14:06:58.784 INFO:tasks.workunit.client.0.smithi153.stderr: -13> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.784 INFO:tasks.workunit.client.0.smithi153.stderr: -12> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-19T14:06:58.784 INFO:tasks.workunit.client.0.smithi153.stderr: -11> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-19T14:06:58.784 INFO:tasks.workunit.client.0.smithi153.stderr: -10> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-19T14:06:58.784 INFO:tasks.workunit.client.0.smithi153.stderr: -9> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 : miss 2024-09-19T14:06:58.785 INFO:tasks.workunit.client.0.smithi153.stderr: -8> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.785 INFO:tasks.workunit.client.0.smithi153.stderr: -7> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-19T14:06:58.785 INFO:tasks.workunit.client.0.smithi153.stderr: -6> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 info.flags=0x17 2024-09-19T14:06:58.785 INFO:tasks.workunit.client.0.smithi153.stderr: -5> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 to cache LRU end 2024-09-19T14:06:58.785 INFO:tasks.workunit.client.0.smithi153.stderr: -4> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:06:58.785 INFO:tasks.workunit.client.0.smithi153.stderr: -3> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:58.785 INFO:tasks.workunit.client.0.smithi153.stderr: -2> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 2024-09-19T14:06:58.785 INFO:tasks.workunit.client.0.smithi153.stderr: -1> 2024-09-19T14:06:58.709+0000 7f6568b9d9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6568b9d9c0 time 2024-09-19T14:06:58.712209+0000 2024-09-19T14:06:58.785 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:06:58.785 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.785 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:06:58.785 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f656c4772eb] 2024-09-19T14:06:58.785 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f656c47749f] 2024-09-19T14:06:58.785 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e29cc6e271] 2024-09-19T14:06:58.786 INFO:tasks.workunit.client.0.smithi153.stderr: 4: radosgw-admin(+0x140fb48) [0x55e29d6beb48] 2024-09-19T14:06:58.786 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e29cc7e0dd] 2024-09-19T14:06:58.786 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:06:58.786 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f656b2ddd90] 2024-09-19T14:06:58.786 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:06:58.786 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:06:58.786 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.786 INFO:tasks.workunit.client.0.smithi153.stderr: 0> 2024-09-19T14:06:58.709+0000 7f6568b9d9c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:06:58.786 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7f6568b9d9c0 thread_name:radosgw-admin 2024-09-19T14:06:58.786 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.786 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:06:58.786 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f656b2f6520] 2024-09-19T14:06:58.786 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:06:58.786 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:06:58.787 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:06:58.787 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f656c477345] 2024-09-19T14:06:58.787 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f656c47749f] 2024-09-19T14:06:58.787 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e29cc6e271] 2024-09-19T14:06:58.787 INFO:tasks.workunit.client.0.smithi153.stderr: 8: radosgw-admin(+0x140fb48) [0x55e29d6beb48] 2024-09-19T14:06:58.787 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e29cc7e0dd] 2024-09-19T14:06:58.787 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:06:58.787 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f656b2ddd90] 2024-09-19T14:06:58.787 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:06:58.787 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:06:58.787 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:06:58.787 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.787 INFO:tasks.workunit.client.0.smithi153.stderr:--- logging levels --- 2024-09-19T14:06:58.787 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 none 2024-09-19T14:06:58.787 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 lockdep 2024-09-19T14:06:58.788 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 context 2024-09-19T14:06:58.788 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 crush 2024-09-19T14:06:58.788 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds 2024-09-19T14:06:58.788 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_balancer 2024-09-19T14:06:58.788 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_locker 2024-09-19T14:06:58.788 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log 2024-09-19T14:06:58.788 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log_expire 2024-09-19T14:06:58.788 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_migrator 2024-09-19T14:06:58.788 INFO:tasks.workunit.client.0.smithi153.stderr: 3/ 5 mds_quiesce 2024-09-19T14:06:58.788 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 buffer 2024-09-19T14:06:58.788 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 timer 2024-09-19T14:06:58.788 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 filer 2024-09-19T14:06:58.788 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 striper 2024-09-19T14:06:58.788 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 objecter 2024-09-19T14:06:58.788 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rados 2024-09-19T14:06:58.789 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd 2024-09-19T14:06:58.789 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_mirror 2024-09-19T14:06:58.789 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_replay 2024-09-19T14:06:58.789 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_pwl 2024-09-19T14:06:58.789 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 journaler 2024-09-19T14:06:58.789 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objectcacher 2024-09-19T14:06:58.789 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:06:58.789 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 client 2024-09-19T14:06:58.789 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 osd 2024-09-19T14:06:58.789 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 optracker 2024-09-19T14:06:58.789 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objclass 2024-09-19T14:06:58.789 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 filestore 2024-09-19T14:06:58.789 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 journal 2024-09-19T14:06:58.789 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 ms 2024-09-19T14:06:58.790 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mon 2024-09-19T14:06:58.790 INFO:tasks.workunit.client.0.smithi153.stderr: 0/10 monc 2024-09-19T14:06:58.790 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 paxos 2024-09-19T14:06:58.790 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 tp 2024-09-19T14:06:58.790 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 auth 2024-09-19T14:06:58.790 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 crypto 2024-09-19T14:06:58.790 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 finisher 2024-09-19T14:06:58.790 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 reserver 2024-09-19T14:06:58.790 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 heartbeatmap 2024-09-19T14:06:58.790 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 perfcounter 2024-09-19T14:06:58.790 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw 2024-09-19T14:06:58.790 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_sync 2024-09-19T14:06:58.790 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_datacache 2024-09-19T14:06:58.790 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_access 2024-09-19T14:06:58.790 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:06:58.790 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_flight 2024-09-19T14:06:58.791 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:06:58.791 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw_notification 2024-09-19T14:06:58.791 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 javaclient 2024-09-19T14:06:58.791 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 asok 2024-09-19T14:06:58.791 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 throttle 2024-09-19T14:06:58.791 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 refs 2024-09-19T14:06:58.791 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 compressor 2024-09-19T14:06:58.791 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluestore 2024-09-19T14:06:58.791 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluefs 2024-09-19T14:06:58.791 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 bdev 2024-09-19T14:06:58.791 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 kstore 2024-09-19T14:06:58.791 INFO:tasks.workunit.client.0.smithi153.stderr: 4/ 5 rocksdb 2024-09-19T14:06:58.791 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 fuse 2024-09-19T14:06:58.792 INFO:tasks.workunit.client.0.smithi153.stderr: 2/ 5 mgr 2024-09-19T14:06:58.792 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mgrc 2024-09-19T14:06:58.792 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 dpdk 2024-09-19T14:06:58.792 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 eventtrace 2024-09-19T14:06:58.792 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 prioritycache 2024-09-19T14:06:58.792 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 test 2024-09-19T14:06:58.792 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:06:58.792 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephsqlite 2024-09-19T14:06:58.792 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:06:58.792 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore 2024-09-19T14:06:58.792 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_onode 2024-09-19T14:06:58.792 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_odata 2024-09-19T14:06:58.792 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_omap 2024-09-19T14:06:58.793 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_tm 2024-09-19T14:06:58.793 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_t 2024-09-19T14:06:58.793 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:06:58.793 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_epm 2024-09-19T14:06:58.793 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_lba 2024-09-19T14:06:58.793 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:06:58.793 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cache 2024-09-19T14:06:58.793 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_journal 2024-09-19T14:06:58.793 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_device 2024-09-19T14:06:58.793 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_backref 2024-09-19T14:06:58.793 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 alienstore 2024-09-19T14:06:58.793 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mclock 2024-09-19T14:06:58.793 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cyanstore 2024-09-19T14:06:58.794 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 ceph_exporter 2024-09-19T14:06:58.794 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 memstore 2024-09-19T14:06:58.794 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 trace 2024-09-19T14:06:58.794 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 ceph_dedup 2024-09-19T14:06:58.794 INFO:tasks.workunit.client.0.smithi153.stderr: -2/-2 (syslog threshold) 2024-09-19T14:06:58.794 INFO:tasks.workunit.client.0.smithi153.stderr: 99/99 (stderr threshold) 2024-09-19T14:06:58.794 INFO:tasks.workunit.client.0.smithi153.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:06:58.794 INFO:tasks.workunit.client.0.smithi153.stderr: 7f63957fa640 / http_manager 2024-09-19T14:06:58.794 INFO:tasks.workunit.client.0.smithi153.stderr: 7f63977fe640 / http_manager 2024-09-19T14:06:58.794 INFO:tasks.workunit.client.0.smithi153.stderr: 7f641cfe1640 / rgw_dt_lg_renew 2024-09-19T14:06:58.794 INFO:tasks.workunit.client.0.smithi153.stderr: 7f6437fff640 / ms_dispatch 2024-09-19T14:06:58.794 INFO:tasks.workunit.client.0.smithi153.stderr: 7f6449ffb640 / io_context_pool 2024-09-19T14:06:58.794 INFO:tasks.workunit.client.0.smithi153.stderr: 7f644bfff640 / ms_dispatch 2024-09-19T14:06:58.794 INFO:tasks.workunit.client.0.smithi153.stderr: 7f6452e05640 / ms_dispatch 2024-09-19T14:06:58.794 INFO:tasks.workunit.client.0.smithi153.stderr: 7f6454608640 / io_context_pool 2024-09-19T14:06:58.795 INFO:tasks.workunit.client.0.smithi153.stderr: 7f6564ea0640 / io_context_pool 2024-09-19T14:06:58.795 INFO:tasks.workunit.client.0.smithi153.stderr: 7f6565ea2640 / msgr-worker-2 2024-09-19T14:06:58.795 INFO:tasks.workunit.client.0.smithi153.stderr: 7f65666a3640 / msgr-worker-1 2024-09-19T14:06:58.795 INFO:tasks.workunit.client.0.smithi153.stderr: 7f6566ea4640 / msgr-worker-0 2024-09-19T14:06:58.795 INFO:tasks.workunit.client.0.smithi153.stderr: 7f6568b9d9c0 / radosgw-admin 2024-09-19T14:06:58.795 INFO:tasks.workunit.client.0.smithi153.stderr: max_recent 500 2024-09-19T14:06:58.795 INFO:tasks.workunit.client.0.smithi153.stderr: max_new 1000 2024-09-19T14:06:58.795 INFO:tasks.workunit.client.0.smithi153.stderr: log_file /var/log/ceph/ceph-client.admin.91003.log 2024-09-19T14:06:58.795 INFO:tasks.workunit.client.0.smithi153.stderr:--- end dump of recent events --- 2024-09-19T14:06:58.796 INFO:tasks.workunit.client.0.smithi153.stderr:--- begin dump of recent events --- 2024-09-19T14:06:58.796 INFO:tasks.workunit.client.0.smithi153.stderr: -499> 2024-09-19T14:06:58.629+0000 7f6565ea2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:58.796 INFO:tasks.workunit.client.0.smithi153.stderr: -498> 2024-09-19T14:06:58.629+0000 7f6566ea4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:58.796 INFO:tasks.workunit.client.0.smithi153.stderr: -497> 2024-09-19T14:06:58.629+0000 7f6566ea4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:58.796 INFO:tasks.workunit.client.0.smithi153.stderr: -496> 2024-09-19T14:06:58.629+0000 7f6566ea4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:58.796 INFO:tasks.workunit.client.0.smithi153.stderr: -495> 2024-09-19T14:06:58.629+0000 7f6565ea2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:58.796 INFO:tasks.workunit.client.0.smithi153.stderr: -494> 2024-09-19T14:06:58.629+0000 7f6565ea2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:58.796 INFO:tasks.workunit.client.0.smithi153.stderr: -493> 2024-09-19T14:06:58.629+0000 7f6565ea2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:58.796 INFO:tasks.workunit.client.0.smithi153.stderr: -492> 2024-09-19T14:06:58.629+0000 7f65666a3640 10 monclient(hunting): get_auth_request con 0x55e29fbfb290 auth_method 0 2024-09-19T14:06:58.796 INFO:tasks.workunit.client.0.smithi153.stderr: -491> 2024-09-19T14:06:58.629+0000 7f65666a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:58.796 INFO:tasks.workunit.client.0.smithi153.stderr: -490> 2024-09-19T14:06:58.629+0000 7f65666a3640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:58.796 INFO:tasks.workunit.client.0.smithi153.stderr: -489> 2024-09-19T14:06:58.629+0000 7f65666a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:58.796 INFO:tasks.workunit.client.0.smithi153.stderr: -488> 2024-09-19T14:06:58.629+0000 7f6566ea4640 10 monclient(hunting): handle_auth_done global_id 6585 payload 274 2024-09-19T14:06:58.797 INFO:tasks.workunit.client.0.smithi153.stderr: -487> 2024-09-19T14:06:58.629+0000 7f6566ea4640 10 monclient: _finish_hunting 0 2024-09-19T14:06:58.797 INFO:tasks.workunit.client.0.smithi153.stderr: -486> 2024-09-19T14:06:58.629+0000 7f6566ea4640 1 monclient: found mon.noname-a 2024-09-19T14:06:58.797 INFO:tasks.workunit.client.0.smithi153.stderr: -485> 2024-09-19T14:06:58.629+0000 7f6566ea4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:06:58.797 INFO:tasks.workunit.client.0.smithi153.stderr: -484> 2024-09-19T14:06:58.629+0000 7f6454608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:58.797 INFO:tasks.workunit.client.0.smithi153.stderr: -483> 2024-09-19T14:06:58.629+0000 7f6454608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:06:58.797 INFO:tasks.workunit.client.0.smithi153.stderr: -482> 2024-09-19T14:06:58.629+0000 7f6454608640 10 monclient: dump: 2024-09-19T14:06:58.797 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:58.797 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:58.797 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.797 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.797 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:58.797 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.797 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:58.798 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:58.798 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:58.798 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.798 INFO:tasks.workunit.client.0.smithi153.stderr: -481> 2024-09-19T14:06:58.629+0000 7f6454608640 10 monclient: _finish_auth 0 2024-09-19T14:06:58.798 INFO:tasks.workunit.client.0.smithi153.stderr: -480> 2024-09-19T14:06:58.629+0000 7f6454608640 10 monclient: _check_auth_tickets 2024-09-19T14:06:58.798 INFO:tasks.workunit.client.0.smithi153.stderr: -479> 2024-09-19T14:06:58.629+0000 7f6454608640 10 monclient: handle_config config(0 keys) 2024-09-19T14:06:58.798 INFO:tasks.workunit.client.0.smithi153.stderr: -478> 2024-09-19T14:06:58.629+0000 7f6454608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:58.798 INFO:tasks.workunit.client.0.smithi153.stderr: -477> 2024-09-19T14:06:58.629+0000 7f6454608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:06:58.798 INFO:tasks.workunit.client.0.smithi153.stderr: -476> 2024-09-19T14:06:58.629+0000 7f6454608640 10 monclient: dump: 2024-09-19T14:06:58.798 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:58.798 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:58.798 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.798 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.798 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:58.799 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.799 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:58.799 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:58.799 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:58.799 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.799 INFO:tasks.workunit.client.0.smithi153.stderr: -475> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 monclient: authenticate success, global_id 6585 2024-09-19T14:06:58.799 INFO:tasks.workunit.client.0.smithi153.stderr: -474> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 10 monclient: get_monmap_and_config success 2024-09-19T14:06:58.799 INFO:tasks.workunit.client.0.smithi153.stderr: -473> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 4 set_mon_vals no callback set 2024-09-19T14:06:58.799 INFO:tasks.workunit.client.0.smithi153.stderr: -472> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 10 monclient: shutdown 2024-09-19T14:06:58.799 INFO:tasks.workunit.client.0.smithi153.stderr: -471> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) unregister_commands rotate-key 2024-09-19T14:06:58.799 INFO:tasks.workunit.client.0.smithi153.stderr: -470> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 10 monclient: build_initial_monmap 2024-09-19T14:06:58.799 INFO:tasks.workunit.client.0.smithi153.stderr: -469> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 1 build_initial for_mkfs: 0 2024-09-19T14:06:58.799 INFO:tasks.workunit.client.0.smithi153.stderr: -468> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 10 monclient: monmap: 2024-09-19T14:06:58.800 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:06:58.800 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:06:58.800 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:06:58.800 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:06:58.800 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:06:58.800 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.800 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:06:58.800 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:06:58.800 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:06:58.800 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.800 INFO:tasks.workunit.client.0.smithi153.stderr: -467> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding auth protocol: cephx 2024-09-19T14:06:58.800 INFO:tasks.workunit.client.0.smithi153.stderr: -466> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding auth protocol: cephx 2024-09-19T14:06:58.800 INFO:tasks.workunit.client.0.smithi153.stderr: -465> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding auth protocol: cephx 2024-09-19T14:06:58.801 INFO:tasks.workunit.client.0.smithi153.stderr: -464> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding con mode: secure 2024-09-19T14:06:58.801 INFO:tasks.workunit.client.0.smithi153.stderr: -463> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding con mode: crc 2024-09-19T14:06:58.801 INFO:tasks.workunit.client.0.smithi153.stderr: -462> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding con mode: secure 2024-09-19T14:06:58.801 INFO:tasks.workunit.client.0.smithi153.stderr: -461> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding con mode: crc 2024-09-19T14:06:58.801 INFO:tasks.workunit.client.0.smithi153.stderr: -460> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding con mode: secure 2024-09-19T14:06:58.801 INFO:tasks.workunit.client.0.smithi153.stderr: -459> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding con mode: crc 2024-09-19T14:06:58.801 INFO:tasks.workunit.client.0.smithi153.stderr: -458> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding con mode: crc 2024-09-19T14:06:58.801 INFO:tasks.workunit.client.0.smithi153.stderr: -457> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding con mode: secure 2024-09-19T14:06:58.801 INFO:tasks.workunit.client.0.smithi153.stderr: -456> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding con mode: crc 2024-09-19T14:06:58.801 INFO:tasks.workunit.client.0.smithi153.stderr: -455> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding con mode: secure 2024-09-19T14:06:58.801 INFO:tasks.workunit.client.0.smithi153.stderr: -454> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding con mode: crc 2024-09-19T14:06:58.801 INFO:tasks.workunit.client.0.smithi153.stderr: -453> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4d230) adding con mode: secure 2024-09-19T14:06:58.801 INFO:tasks.workunit.client.0.smithi153.stderr: -452> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.801 INFO:tasks.workunit.client.0.smithi153.stderr: -451> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 1 librados: starting msgr at 2024-09-19T14:06:58.802 INFO:tasks.workunit.client.0.smithi153.stderr: -450> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 1 librados: starting objecter 2024-09-19T14:06:58.802 INFO:tasks.workunit.client.0.smithi153.stderr: -449> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command objecter_requests hook 0x55e29fd4f490 2024-09-19T14:06:58.802 INFO:tasks.workunit.client.0.smithi153.stderr: -448> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 1 librados: setting wanted keys 2024-09-19T14:06:58.802 INFO:tasks.workunit.client.0.smithi153.stderr: -447> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 1 librados: calling monclient init 2024-09-19T14:06:58.802 INFO:tasks.workunit.client.0.smithi153.stderr: -446> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 10 monclient: init 2024-09-19T14:06:58.802 INFO:tasks.workunit.client.0.smithi153.stderr: -445> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding auth protocol: cephx 2024-09-19T14:06:58.802 INFO:tasks.workunit.client.0.smithi153.stderr: -444> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding auth protocol: cephx 2024-09-19T14:06:58.802 INFO:tasks.workunit.client.0.smithi153.stderr: -443> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding auth protocol: cephx 2024-09-19T14:06:58.802 INFO:tasks.workunit.client.0.smithi153.stderr: -442> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding con mode: secure 2024-09-19T14:06:58.802 INFO:tasks.workunit.client.0.smithi153.stderr: -441> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding con mode: crc 2024-09-19T14:06:58.802 INFO:tasks.workunit.client.0.smithi153.stderr: -440> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding con mode: secure 2024-09-19T14:06:58.802 INFO:tasks.workunit.client.0.smithi153.stderr: -439> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding con mode: crc 2024-09-19T14:06:58.802 INFO:tasks.workunit.client.0.smithi153.stderr: -438> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding con mode: secure 2024-09-19T14:06:58.802 INFO:tasks.workunit.client.0.smithi153.stderr: -437> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding con mode: crc 2024-09-19T14:06:58.803 INFO:tasks.workunit.client.0.smithi153.stderr: -436> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding con mode: crc 2024-09-19T14:06:58.803 INFO:tasks.workunit.client.0.smithi153.stderr: -435> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding con mode: secure 2024-09-19T14:06:58.803 INFO:tasks.workunit.client.0.smithi153.stderr: -434> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding con mode: crc 2024-09-19T14:06:58.803 INFO:tasks.workunit.client.0.smithi153.stderr: -433> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding con mode: secure 2024-09-19T14:06:58.803 INFO:tasks.workunit.client.0.smithi153.stderr: -432> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding con mode: crc 2024-09-19T14:06:58.803 INFO:tasks.workunit.client.0.smithi153.stderr: -431> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd4b150) adding con mode: secure 2024-09-19T14:06:58.803 INFO:tasks.workunit.client.0.smithi153.stderr: -430> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.803 INFO:tasks.workunit.client.0.smithi153.stderr: -429> 2024-09-19T14:06:58.629+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.803 INFO:tasks.workunit.client.0.smithi153.stderr: -428> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command rotate-key hook 0x55e29fd4b298 2024-09-19T14:06:58.803 INFO:tasks.workunit.client.0.smithi153.stderr: -427> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient: _reopen_session rank -1 2024-09-19T14:06:58.803 INFO:tasks.workunit.client.0.smithi153.stderr: -426> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T14:06:58.803 INFO:tasks.workunit.client.0.smithi153.stderr: -425> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient(hunting): picked mon.noname-c con 0x55e29fbfb290 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:06:58.803 INFO:tasks.workunit.client.0.smithi153.stderr: -424> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient(hunting): picked mon.noname-a con 0x55e29fc90320 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:06:58.804 INFO:tasks.workunit.client.0.smithi153.stderr: -423> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient(hunting): picked mon.noname-b con 0x55e29fc93d50 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:06:58.804 INFO:tasks.workunit.client.0.smithi153.stderr: -422> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:58.804 INFO:tasks.workunit.client.0.smithi153.stderr: -421> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:58.804 INFO:tasks.workunit.client.0.smithi153.stderr: -420> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:58.804 INFO:tasks.workunit.client.0.smithi153.stderr: -419> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient(hunting): _renew_subs 2024-09-19T14:06:58.804 INFO:tasks.workunit.client.0.smithi153.stderr: -418> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient(hunting): authenticate will time out at 2607.096090s 2024-09-19T14:06:58.804 INFO:tasks.workunit.client.0.smithi153.stderr: -417> 2024-09-19T14:06:58.633+0000 7f65666a3640 10 monclient(hunting): get_auth_request con 0x55e29fbfb290 auth_method 0 2024-09-19T14:06:58.804 INFO:tasks.workunit.client.0.smithi153.stderr: -416> 2024-09-19T14:06:58.633+0000 7f65666a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:58.804 INFO:tasks.workunit.client.0.smithi153.stderr: -415> 2024-09-19T14:06:58.633+0000 7f65666a3640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:58.804 INFO:tasks.workunit.client.0.smithi153.stderr: -414> 2024-09-19T14:06:58.633+0000 7f65666a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:58.804 INFO:tasks.workunit.client.0.smithi153.stderr: -413> 2024-09-19T14:06:58.633+0000 7f6565ea2640 10 monclient(hunting): get_auth_request con 0x55e29fc90320 auth_method 0 2024-09-19T14:06:58.804 INFO:tasks.workunit.client.0.smithi153.stderr: -412> 2024-09-19T14:06:58.633+0000 7f6565ea2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:58.804 INFO:tasks.workunit.client.0.smithi153.stderr: -411> 2024-09-19T14:06:58.633+0000 7f6565ea2640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:58.805 INFO:tasks.workunit.client.0.smithi153.stderr: -410> 2024-09-19T14:06:58.633+0000 7f6565ea2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:58.805 INFO:tasks.workunit.client.0.smithi153.stderr: -409> 2024-09-19T14:06:58.633+0000 7f65666a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:58.805 INFO:tasks.workunit.client.0.smithi153.stderr: -408> 2024-09-19T14:06:58.633+0000 7f65666a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:58.805 INFO:tasks.workunit.client.0.smithi153.stderr: -407> 2024-09-19T14:06:58.633+0000 7f65666a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:58.805 INFO:tasks.workunit.client.0.smithi153.stderr: -406> 2024-09-19T14:06:58.633+0000 7f6565ea2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:58.805 INFO:tasks.workunit.client.0.smithi153.stderr: -405> 2024-09-19T14:06:58.633+0000 7f6565ea2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:58.805 INFO:tasks.workunit.client.0.smithi153.stderr: -404> 2024-09-19T14:06:58.633+0000 7f6565ea2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:58.805 INFO:tasks.workunit.client.0.smithi153.stderr: -403> 2024-09-19T14:06:58.633+0000 7f65666a3640 10 monclient(hunting): handle_auth_done global_id 6188 payload 824 2024-09-19T14:06:58.805 INFO:tasks.workunit.client.0.smithi153.stderr: -402> 2024-09-19T14:06:58.633+0000 7f65666a3640 10 monclient: _finish_hunting 0 2024-09-19T14:06:58.805 INFO:tasks.workunit.client.0.smithi153.stderr: -401> 2024-09-19T14:06:58.633+0000 7f65666a3640 1 monclient: found mon.noname-c 2024-09-19T14:06:58.805 INFO:tasks.workunit.client.0.smithi153.stderr: -400> 2024-09-19T14:06:58.633+0000 7f65666a3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:06:58.805 INFO:tasks.workunit.client.0.smithi153.stderr: -399> 2024-09-19T14:06:58.633+0000 7f6452e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:58.805 INFO:tasks.workunit.client.0.smithi153.stderr: -398> 2024-09-19T14:06:58.633+0000 7f6452e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:06:58.806 INFO:tasks.workunit.client.0.smithi153.stderr: -397> 2024-09-19T14:06:58.633+0000 7f6452e05640 10 monclient: dump: 2024-09-19T14:06:58.806 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:58.806 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:58.806 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.806 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.806 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:58.806 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.806 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:58.806 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:58.806 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:58.806 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.806 INFO:tasks.workunit.client.0.smithi153.stderr: -396> 2024-09-19T14:06:58.633+0000 7f6452e05640 10 monclient: _finish_auth 0 2024-09-19T14:06:58.806 INFO:tasks.workunit.client.0.smithi153.stderr: -395> 2024-09-19T14:06:58.633+0000 7f6452e05640 10 monclient: _check_auth_tickets 2024-09-19T14:06:58.806 INFO:tasks.workunit.client.0.smithi153.stderr: -394> 2024-09-19T14:06:58.633+0000 7f6452e05640 10 monclient: handle_config config(0 keys) 2024-09-19T14:06:58.807 INFO:tasks.workunit.client.0.smithi153.stderr: -393> 2024-09-19T14:06:58.633+0000 7f6452e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:58.807 INFO:tasks.workunit.client.0.smithi153.stderr: -392> 2024-09-19T14:06:58.633+0000 7f6452e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:06:58.807 INFO:tasks.workunit.client.0.smithi153.stderr: -391> 2024-09-19T14:06:58.633+0000 7f6452e05640 10 monclient: dump: 2024-09-19T14:06:58.807 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:58.807 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:58.807 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.807 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.807 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:58.807 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.807 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:58.807 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:58.807 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:58.807 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.807 INFO:tasks.workunit.client.0.smithi153.stderr: -390> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 5 monclient: authenticate success, global_id 6188 2024-09-19T14:06:58.807 INFO:tasks.workunit.client.0.smithi153.stderr: -389> 2024-09-19T14:06:58.633+0000 7f6454608640 4 set_mon_vals no callback set 2024-09-19T14:06:58.807 INFO:tasks.workunit.client.0.smithi153.stderr: -388> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient: _renew_subs 2024-09-19T14:06:58.808 INFO:tasks.workunit.client.0.smithi153.stderr: -387> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:06:58.808 INFO:tasks.workunit.client.0.smithi153.stderr: -386> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient: _renew_subs 2024-09-19T14:06:58.808 INFO:tasks.workunit.client.0.smithi153.stderr: -385> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:06:58.808 INFO:tasks.workunit.client.0.smithi153.stderr: -384> 2024-09-19T14:06:58.633+0000 7f6568b9d9c0 1 librados: init done 2024-09-19T14:06:58.808 INFO:tasks.workunit.client.0.smithi153.stderr: -383> 2024-09-19T14:06:58.633+0000 7f6452e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:06:58.808 INFO:tasks.workunit.client.0.smithi153.stderr: -382> 2024-09-19T14:06:58.633+0000 7f6452e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:06:58.808 INFO:tasks.workunit.client.0.smithi153.stderr: -381> 2024-09-19T14:06:58.633+0000 7f6452e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:06:58.808 INFO:tasks.workunit.client.0.smithi153.stderr: -380> 2024-09-19T14:06:58.633+0000 7f6565ea2640 10 monclient: get_auth_request con 0x7f644c071c10 auth_method 0 2024-09-19T14:06:58.808 INFO:tasks.workunit.client.0.smithi153.stderr: -379> 2024-09-19T14:06:58.633+0000 7f6566ea4640 10 monclient: get_auth_request con 0x55e29fd72e50 auth_method 0 2024-09-19T14:06:58.808 INFO:tasks.workunit.client.0.smithi153.stderr: -378> 2024-09-19T14:06:58.637+0000 7f65666a3640 10 monclient: get_auth_request con 0x55e29fd95fb0 auth_method 0 2024-09-19T14:06:58.808 INFO:tasks.workunit.client.0.smithi153.stderr: -377> 2024-09-19T14:06:58.637+0000 7f6565ea2640 10 monclient: get_auth_request con 0x55e29fd9b4f0 auth_method 0 2024-09-19T14:06:58.808 INFO:tasks.workunit.client.0.smithi153.stderr: -376> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient: build_initial_monmap 2024-09-19T14:06:58.808 INFO:tasks.workunit.client.0.smithi153.stderr: -375> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 1 build_initial for_mkfs: 0 2024-09-19T14:06:58.808 INFO:tasks.workunit.client.0.smithi153.stderr: -374> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient: monmap: 2024-09-19T14:06:58.808 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:06:58.809 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:06:58.809 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:06:58.809 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:06:58.809 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:06:58.809 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.809 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:06:58.809 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:06:58.809 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:06:58.809 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.809 INFO:tasks.workunit.client.0.smithi153.stderr: -373> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding auth protocol: cephx 2024-09-19T14:06:58.809 INFO:tasks.workunit.client.0.smithi153.stderr: -372> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding auth protocol: cephx 2024-09-19T14:06:58.809 INFO:tasks.workunit.client.0.smithi153.stderr: -371> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding auth protocol: cephx 2024-09-19T14:06:58.809 INFO:tasks.workunit.client.0.smithi153.stderr: -370> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding con mode: secure 2024-09-19T14:06:58.810 INFO:tasks.workunit.client.0.smithi153.stderr: -369> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding con mode: crc 2024-09-19T14:06:58.810 INFO:tasks.workunit.client.0.smithi153.stderr: -368> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding con mode: secure 2024-09-19T14:06:58.810 INFO:tasks.workunit.client.0.smithi153.stderr: -367> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding con mode: crc 2024-09-19T14:06:58.810 INFO:tasks.workunit.client.0.smithi153.stderr: -366> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding con mode: secure 2024-09-19T14:06:58.810 INFO:tasks.workunit.client.0.smithi153.stderr: -365> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding con mode: crc 2024-09-19T14:06:58.810 INFO:tasks.workunit.client.0.smithi153.stderr: -364> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding con mode: crc 2024-09-19T14:06:58.810 INFO:tasks.workunit.client.0.smithi153.stderr: -363> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding con mode: secure 2024-09-19T14:06:58.810 INFO:tasks.workunit.client.0.smithi153.stderr: -362> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding con mode: crc 2024-09-19T14:06:58.810 INFO:tasks.workunit.client.0.smithi153.stderr: -361> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding con mode: secure 2024-09-19T14:06:58.810 INFO:tasks.workunit.client.0.smithi153.stderr: -360> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding con mode: crc 2024-09-19T14:06:58.811 INFO:tasks.workunit.client.0.smithi153.stderr: -359> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9f1e0) adding con mode: secure 2024-09-19T14:06:58.811 INFO:tasks.workunit.client.0.smithi153.stderr: -358> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.811 INFO:tasks.workunit.client.0.smithi153.stderr: -357> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command objecter_requests cmddesc objecter_requests hook 0x55e29fda2c50 EEXIST 2024-09-19T14:06:58.811 INFO:tasks.workunit.client.0.smithi153.stderr: -356> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient: init 2024-09-19T14:06:58.811 INFO:tasks.workunit.client.0.smithi153.stderr: -355> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding auth protocol: cephx 2024-09-19T14:06:58.811 INFO:tasks.workunit.client.0.smithi153.stderr: -354> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding auth protocol: cephx 2024-09-19T14:06:58.811 INFO:tasks.workunit.client.0.smithi153.stderr: -353> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding auth protocol: cephx 2024-09-19T14:06:58.811 INFO:tasks.workunit.client.0.smithi153.stderr: -352> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding con mode: secure 2024-09-19T14:06:58.811 INFO:tasks.workunit.client.0.smithi153.stderr: -351> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding con mode: crc 2024-09-19T14:06:58.811 INFO:tasks.workunit.client.0.smithi153.stderr: -350> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding con mode: secure 2024-09-19T14:06:58.811 INFO:tasks.workunit.client.0.smithi153.stderr: -349> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding con mode: crc 2024-09-19T14:06:58.811 INFO:tasks.workunit.client.0.smithi153.stderr: -348> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding con mode: secure 2024-09-19T14:06:58.811 INFO:tasks.workunit.client.0.smithi153.stderr: -347> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding con mode: crc 2024-09-19T14:06:58.811 INFO:tasks.workunit.client.0.smithi153.stderr: -346> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding con mode: crc 2024-09-19T14:06:58.812 INFO:tasks.workunit.client.0.smithi153.stderr: -345> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding con mode: secure 2024-09-19T14:06:58.812 INFO:tasks.workunit.client.0.smithi153.stderr: -344> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding con mode: crc 2024-09-19T14:06:58.812 INFO:tasks.workunit.client.0.smithi153.stderr: -343> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding con mode: secure 2024-09-19T14:06:58.812 INFO:tasks.workunit.client.0.smithi153.stderr: -342> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding con mode: crc 2024-09-19T14:06:58.812 INFO:tasks.workunit.client.0.smithi153.stderr: -341> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fd9e238) adding con mode: secure 2024-09-19T14:06:58.812 INFO:tasks.workunit.client.0.smithi153.stderr: -340> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.812 INFO:tasks.workunit.client.0.smithi153.stderr: -339> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.812 INFO:tasks.workunit.client.0.smithi153.stderr: -338> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command rotate-key cmddesc rotate-key hook 0x55e29fd9e380 EEXIST 2024-09-19T14:06:58.812 INFO:tasks.workunit.client.0.smithi153.stderr: -337> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient: _reopen_session rank -1 2024-09-19T14:06:58.812 INFO:tasks.workunit.client.0.smithi153.stderr: -336> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:06:58.812 INFO:tasks.workunit.client.0.smithi153.stderr: -335> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient(hunting): picked mon.noname-b con 0x55e29fdc6e00 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:06:58.812 INFO:tasks.workunit.client.0.smithi153.stderr: -334> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient(hunting): picked mon.noname-a con 0x55e29fdc6730 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:06:58.812 INFO:tasks.workunit.client.0.smithi153.stderr: -333> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient(hunting): picked mon.noname-c con 0x55e29fdc5110 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:06:58.813 INFO:tasks.workunit.client.0.smithi153.stderr: -332> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:58.813 INFO:tasks.workunit.client.0.smithi153.stderr: -331> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:58.813 INFO:tasks.workunit.client.0.smithi153.stderr: -330> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:58.813 INFO:tasks.workunit.client.0.smithi153.stderr: -329> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient(hunting): _renew_subs 2024-09-19T14:06:58.813 INFO:tasks.workunit.client.0.smithi153.stderr: -328> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient(hunting): authenticate will time out at 2607.105809s 2024-09-19T14:06:58.813 INFO:tasks.workunit.client.0.smithi153.stderr: -327> 2024-09-19T14:06:58.641+0000 7f6565ea2640 10 monclient(hunting): get_auth_request con 0x55e29fdc6730 auth_method 0 2024-09-19T14:06:58.813 INFO:tasks.workunit.client.0.smithi153.stderr: -326> 2024-09-19T14:06:58.641+0000 7f6565ea2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:58.813 INFO:tasks.workunit.client.0.smithi153.stderr: -325> 2024-09-19T14:06:58.641+0000 7f6565ea2640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:58.813 INFO:tasks.workunit.client.0.smithi153.stderr: -324> 2024-09-19T14:06:58.641+0000 7f6565ea2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:58.813 INFO:tasks.workunit.client.0.smithi153.stderr: -323> 2024-09-19T14:06:58.641+0000 7f6566ea4640 10 monclient(hunting): get_auth_request con 0x55e29fdc5110 auth_method 0 2024-09-19T14:06:58.813 INFO:tasks.workunit.client.0.smithi153.stderr: -322> 2024-09-19T14:06:58.641+0000 7f6566ea4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:58.813 INFO:tasks.workunit.client.0.smithi153.stderr: -321> 2024-09-19T14:06:58.641+0000 7f6566ea4640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:58.814 INFO:tasks.workunit.client.0.smithi153.stderr: -320> 2024-09-19T14:06:58.641+0000 7f6566ea4640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:58.814 INFO:tasks.workunit.client.0.smithi153.stderr: -319> 2024-09-19T14:06:58.641+0000 7f6565ea2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:58.814 INFO:tasks.workunit.client.0.smithi153.stderr: -318> 2024-09-19T14:06:58.641+0000 7f6565ea2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:58.814 INFO:tasks.workunit.client.0.smithi153.stderr: -317> 2024-09-19T14:06:58.641+0000 7f6565ea2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:58.814 INFO:tasks.workunit.client.0.smithi153.stderr: -316> 2024-09-19T14:06:58.641+0000 7f6566ea4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:58.814 INFO:tasks.workunit.client.0.smithi153.stderr: -315> 2024-09-19T14:06:58.641+0000 7f6566ea4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:58.814 INFO:tasks.workunit.client.0.smithi153.stderr: -314> 2024-09-19T14:06:58.641+0000 7f6566ea4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:58.814 INFO:tasks.workunit.client.0.smithi153.stderr: -313> 2024-09-19T14:06:58.641+0000 7f65666a3640 10 monclient(hunting): get_auth_request con 0x55e29fdc6e00 auth_method 0 2024-09-19T14:06:58.814 INFO:tasks.workunit.client.0.smithi153.stderr: -312> 2024-09-19T14:06:58.641+0000 7f65666a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:58.814 INFO:tasks.workunit.client.0.smithi153.stderr: -311> 2024-09-19T14:06:58.641+0000 7f65666a3640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:58.814 INFO:tasks.workunit.client.0.smithi153.stderr: -310> 2024-09-19T14:06:58.641+0000 7f65666a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:58.814 INFO:tasks.workunit.client.0.smithi153.stderr: -309> 2024-09-19T14:06:58.641+0000 7f6565ea2640 10 monclient(hunting): handle_auth_done global_id 6591 payload 824 2024-09-19T14:06:58.814 INFO:tasks.workunit.client.0.smithi153.stderr: -308> 2024-09-19T14:06:58.641+0000 7f6565ea2640 10 monclient: _finish_hunting 0 2024-09-19T14:06:58.815 INFO:tasks.workunit.client.0.smithi153.stderr: -307> 2024-09-19T14:06:58.641+0000 7f6565ea2640 1 monclient: found mon.noname-a 2024-09-19T14:06:58.815 INFO:tasks.workunit.client.0.smithi153.stderr: -306> 2024-09-19T14:06:58.641+0000 7f6565ea2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:06:58.815 INFO:tasks.workunit.client.0.smithi153.stderr: -305> 2024-09-19T14:06:58.641+0000 7f644bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:58.815 INFO:tasks.workunit.client.0.smithi153.stderr: -304> 2024-09-19T14:06:58.641+0000 7f644bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:06:58.815 INFO:tasks.workunit.client.0.smithi153.stderr: -303> 2024-09-19T14:06:58.641+0000 7f644bfff640 10 monclient: dump: 2024-09-19T14:06:58.815 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:58.815 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:58.815 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.815 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.815 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:58.815 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.815 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:58.815 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:58.815 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:58.815 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.816 INFO:tasks.workunit.client.0.smithi153.stderr: -302> 2024-09-19T14:06:58.641+0000 7f644bfff640 10 monclient: _finish_auth 0 2024-09-19T14:06:58.816 INFO:tasks.workunit.client.0.smithi153.stderr: -301> 2024-09-19T14:06:58.641+0000 7f644bfff640 10 monclient: _check_auth_tickets 2024-09-19T14:06:58.816 INFO:tasks.workunit.client.0.smithi153.stderr: -300> 2024-09-19T14:06:58.641+0000 7f644bfff640 10 monclient: handle_config config(0 keys) 2024-09-19T14:06:58.816 INFO:tasks.workunit.client.0.smithi153.stderr: -299> 2024-09-19T14:06:58.641+0000 7f644bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:58.816 INFO:tasks.workunit.client.0.smithi153.stderr: -298> 2024-09-19T14:06:58.641+0000 7f644bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:06:58.816 INFO:tasks.workunit.client.0.smithi153.stderr: -297> 2024-09-19T14:06:58.641+0000 7f644bfff640 10 monclient: dump: 2024-09-19T14:06:58.816 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:58.816 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:58.816 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.816 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.816 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:58.816 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.816 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:58.816 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:58.817 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:58.817 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.817 INFO:tasks.workunit.client.0.smithi153.stderr: -296> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 5 monclient: authenticate success, global_id 6591 2024-09-19T14:06:58.817 INFO:tasks.workunit.client.0.smithi153.stderr: -295> 2024-09-19T14:06:58.641+0000 7f6564ea0640 4 set_mon_vals no callback set 2024-09-19T14:06:58.817 INFO:tasks.workunit.client.0.smithi153.stderr: -294> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient: _renew_subs 2024-09-19T14:06:58.817 INFO:tasks.workunit.client.0.smithi153.stderr: -293> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:06:58.817 INFO:tasks.workunit.client.0.smithi153.stderr: -292> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient: _renew_subs 2024-09-19T14:06:58.817 INFO:tasks.workunit.client.0.smithi153.stderr: -291> 2024-09-19T14:06:58.641+0000 7f6568b9d9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:06:58.817 INFO:tasks.workunit.client.0.smithi153.stderr: -290> 2024-09-19T14:06:58.645+0000 7f644bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:06:58.817 INFO:tasks.workunit.client.0.smithi153.stderr: -289> 2024-09-19T14:06:58.645+0000 7f644bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:06:58.817 INFO:tasks.workunit.client.0.smithi153.stderr: -288> 2024-09-19T14:06:58.645+0000 7f644bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:06:58.817 INFO:tasks.workunit.client.0.smithi153.stderr: -287> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient: get_monmap_and_config 2024-09-19T14:06:58.818 INFO:tasks.workunit.client.0.smithi153.stderr: -286> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient: build_initial_monmap 2024-09-19T14:06:58.818 INFO:tasks.workunit.client.0.smithi153.stderr: -285> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 1 build_initial for_mkfs: 0 2024-09-19T14:06:58.818 INFO:tasks.workunit.client.0.smithi153.stderr: -284> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient: monmap: 2024-09-19T14:06:58.818 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:06:58.818 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:06:58.818 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:06:58.818 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:06:58.818 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:06:58.818 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.818 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:06:58.818 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:06:58.818 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:06:58.818 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.819 INFO:tasks.workunit.client.0.smithi153.stderr: -283> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding auth protocol: cephx 2024-09-19T14:06:58.819 INFO:tasks.workunit.client.0.smithi153.stderr: -282> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding auth protocol: cephx 2024-09-19T14:06:58.819 INFO:tasks.workunit.client.0.smithi153.stderr: -281> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding auth protocol: cephx 2024-09-19T14:06:58.819 INFO:tasks.workunit.client.0.smithi153.stderr: -280> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding con mode: secure 2024-09-19T14:06:58.819 INFO:tasks.workunit.client.0.smithi153.stderr: -279> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding con mode: crc 2024-09-19T14:06:58.819 INFO:tasks.workunit.client.0.smithi153.stderr: -278> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding con mode: secure 2024-09-19T14:06:58.819 INFO:tasks.workunit.client.0.smithi153.stderr: -277> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding con mode: crc 2024-09-19T14:06:58.819 INFO:tasks.workunit.client.0.smithi153.stderr: -276> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding con mode: secure 2024-09-19T14:06:58.819 INFO:tasks.workunit.client.0.smithi153.stderr: -275> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding con mode: crc 2024-09-19T14:06:58.819 INFO:tasks.workunit.client.0.smithi153.stderr: -274> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding con mode: crc 2024-09-19T14:06:58.819 INFO:tasks.workunit.client.0.smithi153.stderr: -273> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding con mode: secure 2024-09-19T14:06:58.819 INFO:tasks.workunit.client.0.smithi153.stderr: -272> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding con mode: crc 2024-09-19T14:06:58.819 INFO:tasks.workunit.client.0.smithi153.stderr: -271> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding con mode: secure 2024-09-19T14:06:58.820 INFO:tasks.workunit.client.0.smithi153.stderr: -270> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding con mode: crc 2024-09-19T14:06:58.820 INFO:tasks.workunit.client.0.smithi153.stderr: -269> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fde6750) adding con mode: secure 2024-09-19T14:06:58.820 INFO:tasks.workunit.client.0.smithi153.stderr: -268> 2024-09-19T14:06:58.645+0000 7f65666a3640 10 monclient: get_auth_request con 0x7f6440071b20 auth_method 0 2024-09-19T14:06:58.820 INFO:tasks.workunit.client.0.smithi153.stderr: -267> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.820 INFO:tasks.workunit.client.0.smithi153.stderr: -266> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient: init 2024-09-19T14:06:58.820 INFO:tasks.workunit.client.0.smithi153.stderr: -265> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding auth protocol: cephx 2024-09-19T14:06:58.820 INFO:tasks.workunit.client.0.smithi153.stderr: -264> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding auth protocol: cephx 2024-09-19T14:06:58.820 INFO:tasks.workunit.client.0.smithi153.stderr: -263> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding auth protocol: cephx 2024-09-19T14:06:58.820 INFO:tasks.workunit.client.0.smithi153.stderr: -262> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding con mode: secure 2024-09-19T14:06:58.820 INFO:tasks.workunit.client.0.smithi153.stderr: -261> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding con mode: crc 2024-09-19T14:06:58.820 INFO:tasks.workunit.client.0.smithi153.stderr: -260> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding con mode: secure 2024-09-19T14:06:58.820 INFO:tasks.workunit.client.0.smithi153.stderr: -259> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding con mode: crc 2024-09-19T14:06:58.820 INFO:tasks.workunit.client.0.smithi153.stderr: -258> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding con mode: secure 2024-09-19T14:06:58.820 INFO:tasks.workunit.client.0.smithi153.stderr: -257> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding con mode: crc 2024-09-19T14:06:58.821 INFO:tasks.workunit.client.0.smithi153.stderr: -256> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding con mode: crc 2024-09-19T14:06:58.821 INFO:tasks.workunit.client.0.smithi153.stderr: -255> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding con mode: secure 2024-09-19T14:06:58.821 INFO:tasks.workunit.client.0.smithi153.stderr: -254> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding con mode: crc 2024-09-19T14:06:58.821 INFO:tasks.workunit.client.0.smithi153.stderr: -253> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding con mode: secure 2024-09-19T14:06:58.821 INFO:tasks.workunit.client.0.smithi153.stderr: -252> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding con mode: crc 2024-09-19T14:06:58.821 INFO:tasks.workunit.client.0.smithi153.stderr: -251> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ec980) adding con mode: secure 2024-09-19T14:06:58.821 INFO:tasks.workunit.client.0.smithi153.stderr: -250> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.821 INFO:tasks.workunit.client.0.smithi153.stderr: -249> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.821 INFO:tasks.workunit.client.0.smithi153.stderr: -248> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command rotate-key cmddesc rotate-key hook 0x7ffe2e6ecac8 EEXIST 2024-09-19T14:06:58.821 INFO:tasks.workunit.client.0.smithi153.stderr: -247> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient: _reopen_session rank -1 2024-09-19T14:06:58.821 INFO:tasks.workunit.client.0.smithi153.stderr: -246> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T14:06:58.821 INFO:tasks.workunit.client.0.smithi153.stderr: -245> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient(hunting): picked mon.noname-c con 0x55e29fe1ac70 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:06:58.821 INFO:tasks.workunit.client.0.smithi153.stderr: -244> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient(hunting): picked mon.noname-b con 0x55e29fdeab00 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:06:58.822 INFO:tasks.workunit.client.0.smithi153.stderr: -243> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient(hunting): picked mon.noname-a con 0x55e29fe16060 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:06:58.822 INFO:tasks.workunit.client.0.smithi153.stderr: -242> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:58.822 INFO:tasks.workunit.client.0.smithi153.stderr: -241> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:58.822 INFO:tasks.workunit.client.0.smithi153.stderr: -240> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:58.822 INFO:tasks.workunit.client.0.smithi153.stderr: -239> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient(hunting): _renew_subs 2024-09-19T14:06:58.822 INFO:tasks.workunit.client.0.smithi153.stderr: -238> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient(hunting): authenticate will time out at 2607.110252s 2024-09-19T14:06:58.822 INFO:tasks.workunit.client.0.smithi153.stderr: -237> 2024-09-19T14:06:58.645+0000 7f65666a3640 10 monclient(hunting): get_auth_request con 0x55e29fe1ac70 auth_method 0 2024-09-19T14:06:58.822 INFO:tasks.workunit.client.0.smithi153.stderr: -236> 2024-09-19T14:06:58.645+0000 7f65666a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:58.822 INFO:tasks.workunit.client.0.smithi153.stderr: -235> 2024-09-19T14:06:58.645+0000 7f65666a3640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:58.822 INFO:tasks.workunit.client.0.smithi153.stderr: -234> 2024-09-19T14:06:58.645+0000 7f65666a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:58.822 INFO:tasks.workunit.client.0.smithi153.stderr: -233> 2024-09-19T14:06:58.645+0000 7f6566ea4640 10 monclient(hunting): get_auth_request con 0x55e29fe16060 auth_method 0 2024-09-19T14:06:58.822 INFO:tasks.workunit.client.0.smithi153.stderr: -232> 2024-09-19T14:06:58.645+0000 7f6566ea4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:58.822 INFO:tasks.workunit.client.0.smithi153.stderr: -231> 2024-09-19T14:06:58.645+0000 7f6566ea4640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:58.822 INFO:tasks.workunit.client.0.smithi153.stderr: -230> 2024-09-19T14:06:58.645+0000 7f6566ea4640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:58.823 INFO:tasks.workunit.client.0.smithi153.stderr: -229> 2024-09-19T14:06:58.645+0000 7f65666a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:58.823 INFO:tasks.workunit.client.0.smithi153.stderr: -228> 2024-09-19T14:06:58.645+0000 7f65666a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:58.823 INFO:tasks.workunit.client.0.smithi153.stderr: -227> 2024-09-19T14:06:58.645+0000 7f65666a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:58.823 INFO:tasks.workunit.client.0.smithi153.stderr: -226> 2024-09-19T14:06:58.645+0000 7f6566ea4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:58.823 INFO:tasks.workunit.client.0.smithi153.stderr: -225> 2024-09-19T14:06:58.645+0000 7f6566ea4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:58.823 INFO:tasks.workunit.client.0.smithi153.stderr: -224> 2024-09-19T14:06:58.645+0000 7f6566ea4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:58.823 INFO:tasks.workunit.client.0.smithi153.stderr: -223> 2024-09-19T14:06:58.645+0000 7f65666a3640 10 monclient(hunting): handle_auth_done global_id 6194 payload 274 2024-09-19T14:06:58.823 INFO:tasks.workunit.client.0.smithi153.stderr: -222> 2024-09-19T14:06:58.645+0000 7f65666a3640 10 monclient: _finish_hunting 0 2024-09-19T14:06:58.823 INFO:tasks.workunit.client.0.smithi153.stderr: -221> 2024-09-19T14:06:58.645+0000 7f65666a3640 1 monclient: found mon.noname-c 2024-09-19T14:06:58.823 INFO:tasks.workunit.client.0.smithi153.stderr: -220> 2024-09-19T14:06:58.645+0000 7f65666a3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:06:58.823 INFO:tasks.workunit.client.0.smithi153.stderr: -219> 2024-09-19T14:06:58.645+0000 7f6449ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:58.823 INFO:tasks.workunit.client.0.smithi153.stderr: -218> 2024-09-19T14:06:58.645+0000 7f6449ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:06:58.823 INFO:tasks.workunit.client.0.smithi153.stderr: -217> 2024-09-19T14:06:58.645+0000 7f6449ffb640 10 monclient: dump: 2024-09-19T14:06:58.824 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:58.824 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:58.824 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.824 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.824 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:58.824 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.824 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:58.824 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:58.824 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:58.824 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.824 INFO:tasks.workunit.client.0.smithi153.stderr: -216> 2024-09-19T14:06:58.645+0000 7f6449ffb640 10 monclient: _finish_auth 0 2024-09-19T14:06:58.824 INFO:tasks.workunit.client.0.smithi153.stderr: -215> 2024-09-19T14:06:58.645+0000 7f6449ffb640 10 monclient: _check_auth_tickets 2024-09-19T14:06:58.824 INFO:tasks.workunit.client.0.smithi153.stderr: -214> 2024-09-19T14:06:58.645+0000 7f6449ffb640 10 monclient: handle_config config(0 keys) 2024-09-19T14:06:58.825 INFO:tasks.workunit.client.0.smithi153.stderr: -213> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 monclient: authenticate success, global_id 6194 2024-09-19T14:06:58.825 INFO:tasks.workunit.client.0.smithi153.stderr: -212> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient: get_monmap_and_config success 2024-09-19T14:06:58.825 INFO:tasks.workunit.client.0.smithi153.stderr: -211> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 4 set_mon_vals no callback set 2024-09-19T14:06:58.825 INFO:tasks.workunit.client.0.smithi153.stderr: -210> 2024-09-19T14:06:58.645+0000 7f6449ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:58.825 INFO:tasks.workunit.client.0.smithi153.stderr: -209> 2024-09-19T14:06:58.645+0000 7f6449ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:06:58.825 INFO:tasks.workunit.client.0.smithi153.stderr: -208> 2024-09-19T14:06:58.645+0000 7f6449ffb640 10 monclient: dump: 2024-09-19T14:06:58.825 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:58.825 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:58.825 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.825 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.825 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:58.825 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.826 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:58.826 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:58.826 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:58.826 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.826 INFO:tasks.workunit.client.0.smithi153.stderr: -207> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient: shutdown 2024-09-19T14:06:58.826 INFO:tasks.workunit.client.0.smithi153.stderr: -206> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient: build_initial_monmap 2024-09-19T14:06:58.826 INFO:tasks.workunit.client.0.smithi153.stderr: -205> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 1 build_initial for_mkfs: 0 2024-09-19T14:06:58.826 INFO:tasks.workunit.client.0.smithi153.stderr: -204> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 10 monclient: monmap: 2024-09-19T14:06:58.826 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:06:58.826 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:06:58.826 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:06:58.826 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:06:58.826 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:06:58.827 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.827 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:06:58.827 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:06:58.827 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:06:58.827 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.827 INFO:tasks.workunit.client.0.smithi153.stderr: -203> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding auth protocol: cephx 2024-09-19T14:06:58.827 INFO:tasks.workunit.client.0.smithi153.stderr: -202> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding auth protocol: cephx 2024-09-19T14:06:58.827 INFO:tasks.workunit.client.0.smithi153.stderr: -201> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding auth protocol: cephx 2024-09-19T14:06:58.827 INFO:tasks.workunit.client.0.smithi153.stderr: -200> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding con mode: secure 2024-09-19T14:06:58.827 INFO:tasks.workunit.client.0.smithi153.stderr: -199> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding con mode: crc 2024-09-19T14:06:58.827 INFO:tasks.workunit.client.0.smithi153.stderr: -198> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding con mode: secure 2024-09-19T14:06:58.827 INFO:tasks.workunit.client.0.smithi153.stderr: -197> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding con mode: crc 2024-09-19T14:06:58.827 INFO:tasks.workunit.client.0.smithi153.stderr: -196> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding con mode: secure 2024-09-19T14:06:58.828 INFO:tasks.workunit.client.0.smithi153.stderr: -195> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding con mode: crc 2024-09-19T14:06:58.828 INFO:tasks.workunit.client.0.smithi153.stderr: -194> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding con mode: crc 2024-09-19T14:06:58.828 INFO:tasks.workunit.client.0.smithi153.stderr: -193> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding con mode: secure 2024-09-19T14:06:58.828 INFO:tasks.workunit.client.0.smithi153.stderr: -192> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding con mode: crc 2024-09-19T14:06:58.828 INFO:tasks.workunit.client.0.smithi153.stderr: -191> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding con mode: secure 2024-09-19T14:06:58.828 INFO:tasks.workunit.client.0.smithi153.stderr: -190> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding con mode: crc 2024-09-19T14:06:58.828 INFO:tasks.workunit.client.0.smithi153.stderr: -189> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdeb820) adding con mode: secure 2024-09-19T14:06:58.828 INFO:tasks.workunit.client.0.smithi153.stderr: -188> 2024-09-19T14:06:58.645+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.828 INFO:tasks.workunit.client.0.smithi153.stderr: -187> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 1 librados: starting msgr at 2024-09-19T14:06:58.828 INFO:tasks.workunit.client.0.smithi153.stderr: -186> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 1 librados: starting objecter 2024-09-19T14:06:58.828 INFO:tasks.workunit.client.0.smithi153.stderr: -185> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command objecter_requests cmddesc objecter_requests hook 0x55e29fdea470 EEXIST 2024-09-19T14:06:58.828 INFO:tasks.workunit.client.0.smithi153.stderr: -184> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 1 librados: setting wanted keys 2024-09-19T14:06:58.828 INFO:tasks.workunit.client.0.smithi153.stderr: -183> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 1 librados: calling monclient init 2024-09-19T14:06:58.829 INFO:tasks.workunit.client.0.smithi153.stderr: -182> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient: init 2024-09-19T14:06:58.829 INFO:tasks.workunit.client.0.smithi153.stderr: -181> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding auth protocol: cephx 2024-09-19T14:06:58.829 INFO:tasks.workunit.client.0.smithi153.stderr: -180> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding auth protocol: cephx 2024-09-19T14:06:58.829 INFO:tasks.workunit.client.0.smithi153.stderr: -179> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding auth protocol: cephx 2024-09-19T14:06:58.829 INFO:tasks.workunit.client.0.smithi153.stderr: -178> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding con mode: secure 2024-09-19T14:06:58.829 INFO:tasks.workunit.client.0.smithi153.stderr: -177> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding con mode: crc 2024-09-19T14:06:58.829 INFO:tasks.workunit.client.0.smithi153.stderr: -176> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding con mode: secure 2024-09-19T14:06:58.829 INFO:tasks.workunit.client.0.smithi153.stderr: -175> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding con mode: crc 2024-09-19T14:06:58.829 INFO:tasks.workunit.client.0.smithi153.stderr: -174> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding con mode: secure 2024-09-19T14:06:58.829 INFO:tasks.workunit.client.0.smithi153.stderr: -173> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding con mode: crc 2024-09-19T14:06:58.829 INFO:tasks.workunit.client.0.smithi153.stderr: -172> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding con mode: crc 2024-09-19T14:06:58.829 INFO:tasks.workunit.client.0.smithi153.stderr: -171> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding con mode: secure 2024-09-19T14:06:58.829 INFO:tasks.workunit.client.0.smithi153.stderr: -170> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding con mode: crc 2024-09-19T14:06:58.829 INFO:tasks.workunit.client.0.smithi153.stderr: -169> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding con mode: secure 2024-09-19T14:06:58.829 INFO:tasks.workunit.client.0.smithi153.stderr: -168> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding con mode: crc 2024-09-19T14:06:58.830 INFO:tasks.workunit.client.0.smithi153.stderr: -167> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 AuthRegistry(0x55e29fdc8c20) adding con mode: secure 2024-09-19T14:06:58.830 INFO:tasks.workunit.client.0.smithi153.stderr: -166> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.830 INFO:tasks.workunit.client.0.smithi153.stderr: -165> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.830 INFO:tasks.workunit.client.0.smithi153.stderr: -164> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command rotate-key cmddesc rotate-key hook 0x55e29fdc8d68 EEXIST 2024-09-19T14:06:58.830 INFO:tasks.workunit.client.0.smithi153.stderr: -163> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient: _reopen_session rank -1 2024-09-19T14:06:58.830 INFO:tasks.workunit.client.0.smithi153.stderr: -162> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:06:58.830 INFO:tasks.workunit.client.0.smithi153.stderr: -161> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient(hunting): picked mon.noname-b con 0x55e29fdeab00 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:06:58.830 INFO:tasks.workunit.client.0.smithi153.stderr: -160> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient(hunting): picked mon.noname-a con 0x55e29fe16060 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:06:58.830 INFO:tasks.workunit.client.0.smithi153.stderr: -159> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient(hunting): picked mon.noname-c con 0x55e29fe1ac70 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:06:58.830 INFO:tasks.workunit.client.0.smithi153.stderr: -158> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:58.830 INFO:tasks.workunit.client.0.smithi153.stderr: -157> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:58.830 INFO:tasks.workunit.client.0.smithi153.stderr: -156> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:06:58.830 INFO:tasks.workunit.client.0.smithi153.stderr: -155> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient(hunting): _renew_subs 2024-09-19T14:06:58.831 INFO:tasks.workunit.client.0.smithi153.stderr: -154> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient(hunting): authenticate will time out at 2607.112821s 2024-09-19T14:06:58.831 INFO:tasks.workunit.client.0.smithi153.stderr: -153> 2024-09-19T14:06:58.649+0000 7f6566ea4640 10 monclient(hunting): get_auth_request con 0x55e29fe1ac70 auth_method 0 2024-09-19T14:06:58.831 INFO:tasks.workunit.client.0.smithi153.stderr: -152> 2024-09-19T14:06:58.649+0000 7f6566ea4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:58.831 INFO:tasks.workunit.client.0.smithi153.stderr: -151> 2024-09-19T14:06:58.649+0000 7f6566ea4640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:58.831 INFO:tasks.workunit.client.0.smithi153.stderr: -150> 2024-09-19T14:06:58.649+0000 7f6566ea4640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:58.831 INFO:tasks.workunit.client.0.smithi153.stderr: -149> 2024-09-19T14:06:58.649+0000 7f6565ea2640 10 monclient(hunting): get_auth_request con 0x55e29fe16060 auth_method 0 2024-09-19T14:06:58.831 INFO:tasks.workunit.client.0.smithi153.stderr: -148> 2024-09-19T14:06:58.649+0000 7f6565ea2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:58.831 INFO:tasks.workunit.client.0.smithi153.stderr: -147> 2024-09-19T14:06:58.649+0000 7f6565ea2640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:58.831 INFO:tasks.workunit.client.0.smithi153.stderr: -146> 2024-09-19T14:06:58.649+0000 7f6565ea2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:58.831 INFO:tasks.workunit.client.0.smithi153.stderr: -145> 2024-09-19T14:06:58.649+0000 7f6566ea4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:58.831 INFO:tasks.workunit.client.0.smithi153.stderr: -144> 2024-09-19T14:06:58.649+0000 7f6566ea4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:58.831 INFO:tasks.workunit.client.0.smithi153.stderr: -143> 2024-09-19T14:06:58.649+0000 7f6566ea4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:58.831 INFO:tasks.workunit.client.0.smithi153.stderr: -142> 2024-09-19T14:06:58.649+0000 7f6565ea2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:06:58.832 INFO:tasks.workunit.client.0.smithi153.stderr: -141> 2024-09-19T14:06:58.649+0000 7f6565ea2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:06:58.832 INFO:tasks.workunit.client.0.smithi153.stderr: -140> 2024-09-19T14:06:58.649+0000 7f6565ea2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:06:58.832 INFO:tasks.workunit.client.0.smithi153.stderr: -139> 2024-09-19T14:06:58.649+0000 7f65666a3640 10 monclient(hunting): get_auth_request con 0x55e29fdeab00 auth_method 0 2024-09-19T14:06:58.832 INFO:tasks.workunit.client.0.smithi153.stderr: -138> 2024-09-19T14:06:58.649+0000 7f65666a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:06:58.832 INFO:tasks.workunit.client.0.smithi153.stderr: -137> 2024-09-19T14:06:58.649+0000 7f65666a3640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:06:58.832 INFO:tasks.workunit.client.0.smithi153.stderr: -136> 2024-09-19T14:06:58.649+0000 7f65666a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:06:58.832 INFO:tasks.workunit.client.0.smithi153.stderr: -135> 2024-09-19T14:06:58.649+0000 7f6566ea4640 10 monclient(hunting): handle_auth_done global_id 6197 payload 824 2024-09-19T14:06:58.832 INFO:tasks.workunit.client.0.smithi153.stderr: -134> 2024-09-19T14:06:58.649+0000 7f6566ea4640 10 monclient: _finish_hunting 0 2024-09-19T14:06:58.832 INFO:tasks.workunit.client.0.smithi153.stderr: -133> 2024-09-19T14:06:58.649+0000 7f6566ea4640 1 monclient: found mon.noname-c 2024-09-19T14:06:58.832 INFO:tasks.workunit.client.0.smithi153.stderr: -132> 2024-09-19T14:06:58.649+0000 7f6566ea4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:06:58.832 INFO:tasks.workunit.client.0.smithi153.stderr: -131> 2024-09-19T14:06:58.649+0000 7f6437fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:58.832 INFO:tasks.workunit.client.0.smithi153.stderr: -130> 2024-09-19T14:06:58.649+0000 7f6437fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:06:58.833 INFO:tasks.workunit.client.0.smithi153.stderr: -129> 2024-09-19T14:06:58.649+0000 7f6437fff640 10 monclient: dump: 2024-09-19T14:06:58.833 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:58.833 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:58.833 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.833 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.833 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:58.833 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.833 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:58.833 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:58.833 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:58.833 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.833 INFO:tasks.workunit.client.0.smithi153.stderr: -128> 2024-09-19T14:06:58.649+0000 7f6437fff640 10 monclient: _finish_auth 0 2024-09-19T14:06:58.833 INFO:tasks.workunit.client.0.smithi153.stderr: -127> 2024-09-19T14:06:58.649+0000 7f6437fff640 10 monclient: _check_auth_tickets 2024-09-19T14:06:58.834 INFO:tasks.workunit.client.0.smithi153.stderr: -126> 2024-09-19T14:06:58.649+0000 7f6437fff640 10 monclient: handle_config config(0 keys) 2024-09-19T14:06:58.834 INFO:tasks.workunit.client.0.smithi153.stderr: -125> 2024-09-19T14:06:58.649+0000 7f6437fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:06:58.834 INFO:tasks.workunit.client.0.smithi153.stderr: -124> 2024-09-19T14:06:58.649+0000 7f6437fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:06:58.834 INFO:tasks.workunit.client.0.smithi153.stderr: -123> 2024-09-19T14:06:58.649+0000 7f6437fff640 10 monclient: dump: 2024-09-19T14:06:58.834 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:06:58.834 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:06:58.834 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.834 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:06:58.834 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:06:58.834 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:06:58.834 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:06:58.834 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:06:58.834 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:06:58.835 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.835 INFO:tasks.workunit.client.0.smithi153.stderr: -122> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 monclient: authenticate success, global_id 6197 2024-09-19T14:06:58.835 INFO:tasks.workunit.client.0.smithi153.stderr: -121> 2024-09-19T14:06:58.649+0000 7f6449ffb640 4 set_mon_vals no callback set 2024-09-19T14:06:58.835 INFO:tasks.workunit.client.0.smithi153.stderr: -120> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient: _renew_subs 2024-09-19T14:06:58.835 INFO:tasks.workunit.client.0.smithi153.stderr: -119> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:06:58.835 INFO:tasks.workunit.client.0.smithi153.stderr: -118> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient: _renew_subs 2024-09-19T14:06:58.835 INFO:tasks.workunit.client.0.smithi153.stderr: -117> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:06:58.835 INFO:tasks.workunit.client.0.smithi153.stderr: -116> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 1 librados: init done 2024-09-19T14:06:58.835 INFO:tasks.workunit.client.0.smithi153.stderr: -115> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command cr dump hook 0x55e29fe06a48 2024-09-19T14:06:58.835 INFO:tasks.workunit.client.0.smithi153.stderr: -114> 2024-09-19T14:06:58.649+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.835 INFO:tasks.workunit.client.0.smithi153.stderr: -113> 2024-09-19T14:06:58.653+0000 7f6437fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:06:58.835 INFO:tasks.workunit.client.0.smithi153.stderr: -112> 2024-09-19T14:06:58.653+0000 7f6437fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:06:58.835 INFO:tasks.workunit.client.0.smithi153.stderr: -111> 2024-09-19T14:06:58.653+0000 7f6437fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:06:58.835 INFO:tasks.workunit.client.0.smithi153.stderr: -110> 2024-09-19T14:06:58.653+0000 7f6565ea2640 10 monclient: get_auth_request con 0x55e29fe34530 auth_method 0 2024-09-19T14:06:58.835 INFO:tasks.workunit.client.0.smithi153.stderr: -109> 2024-09-19T14:06:58.653+0000 7f65666a3640 10 monclient: get_auth_request con 0x7f6430071be0 auth_method 0 2024-09-19T14:06:58.836 INFO:tasks.workunit.client.0.smithi153.stderr: -108> 2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.836 INFO:tasks.workunit.client.0.smithi153.stderr: -107> 2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 realm 2024-09-19T14:06:58.836 INFO:tasks.workunit.client.0.smithi153.stderr: -106> 2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.836 INFO:tasks.workunit.client.0.smithi153.stderr: -105> 2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.836 INFO:tasks.workunit.client.0.smithi153.stderr: -104> 2024-09-19T14:06:58.653+0000 7f6568b9d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:58.836 INFO:tasks.workunit.client.0.smithi153.stderr: -103> 2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.836 INFO:tasks.workunit.client.0.smithi153.stderr: -102> 2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.836 INFO:tasks.workunit.client.0.smithi153.stderr: -101> 2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.836 INFO:tasks.workunit.client.0.smithi153.stderr: -100> 2024-09-19T14:06:58.653+0000 7f65666a3640 10 monclient: get_auth_request con 0x55e29fe38720 auth_method 0 2024-09-19T14:06:58.836 INFO:tasks.workunit.client.0.smithi153.stderr: -99> 2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:58.836 INFO:tasks.workunit.client.0.smithi153.stderr: -98> 2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.836 INFO:tasks.workunit.client.0.smithi153.stderr: -97> 2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:58.837 INFO:tasks.workunit.client.0.smithi153.stderr: -96> 2024-09-19T14:06:58.653+0000 7f6568b9d9c0 20 searching for the correct realm 2024-09-19T14:06:58.837 INFO:tasks.workunit.client.0.smithi153.stderr: -95> 2024-09-19T14:06:58.653+0000 7f6565ea2640 10 monclient: get_auth_request con 0x55e29fe3d930 auth_method 0 2024-09-19T14:06:58.837 INFO:tasks.workunit.client.0.smithi153.stderr: -94> 2024-09-19T14:06:58.657+0000 7f6566ea4640 10 monclient: get_auth_request con 0x7f655c06a130 auth_method 0 2024-09-19T14:06:58.837 INFO:tasks.workunit.client.0.smithi153.stderr: -93> 2024-09-19T14:06:58.657+0000 7f65666a3640 10 monclient: get_auth_request con 0x7f6560033060 auth_method 0 2024-09-19T14:06:58.837 INFO:tasks.workunit.client.0.smithi153.stderr: -92> 2024-09-19T14:06:58.657+0000 7f6565ea2640 10 monclient: get_auth_request con 0x7f655810c030 auth_method 0 2024-09-19T14:06:58.837 INFO:tasks.workunit.client.0.smithi153.stderr: -91> 2024-09-19T14:06:58.661+0000 7f6565ea2640 0 -- 172.21.15.153:0/3629314063 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f655810c030 msgr2=0x7f655811e0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:58.837 INFO:tasks.workunit.client.0.smithi153.stderr: -90> 2024-09-19T14:06:58.661+0000 7f6437fff640 1 client.6197.objecter ms_handle_reset 0x7f655810c030 session 0x7f65580a6070 osd.4 2024-09-19T14:06:58.837 INFO:tasks.workunit.client.0.smithi153.stderr: -89> 2024-09-19T14:06:58.661+0000 7f6437fff640 10 monclient: _renew_subs 2024-09-19T14:06:58.837 INFO:tasks.workunit.client.0.smithi153.stderr: -88> 2024-09-19T14:06:58.661+0000 7f6437fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:06:58.837 INFO:tasks.workunit.client.0.smithi153.stderr: -87> 2024-09-19T14:06:58.661+0000 7f6566ea4640 10 monclient: get_auth_request con 0x7f655c065d20 auth_method 0 2024-09-19T14:06:58.837 INFO:tasks.workunit.client.0.smithi153.stderr: -86> 2024-09-19T14:06:58.661+0000 7f6565ea2640 10 monclient: get_auth_request con 0x7f6430082370 auth_method 0 2024-09-19T14:06:58.837 INFO:tasks.workunit.client.0.smithi153.stderr: -85> 2024-09-19T14:06:58.665+0000 7f65666a3640 10 monclient: get_auth_request con 0x7f655c06efc0 auth_method 0 2024-09-19T14:06:58.837 INFO:tasks.workunit.client.0.smithi153.stderr: -84> 2024-09-19T14:06:58.665+0000 7f6565ea2640 0 -- 172.21.15.153:0/3629314063 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f6430082370 msgr2=0x7f64300847a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:58.838 INFO:tasks.workunit.client.0.smithi153.stderr: -83> 2024-09-19T14:06:58.665+0000 7f6437fff640 1 client.6197.objecter ms_handle_reset 0x7f6430082370 session 0x7f65580a6070 osd.4 2024-09-19T14:06:58.838 INFO:tasks.workunit.client.0.smithi153.stderr: -82> 2024-09-19T14:06:58.669+0000 7f6565ea2640 10 monclient: get_auth_request con 0x7f655810c030 auth_method 0 2024-09-19T14:06:58.838 INFO:tasks.workunit.client.0.smithi153.stderr: -81> 2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:58.838 INFO:tasks.workunit.client.0.smithi153.stderr: -80> 2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:58.838 INFO:tasks.workunit.client.0.smithi153.stderr: -79> 2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:58.838 INFO:tasks.workunit.client.0.smithi153.stderr: -78> 2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:58.838 INFO:tasks.workunit.client.0.smithi153.stderr: -77> 2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:58.838 INFO:tasks.workunit.client.0.smithi153.stderr: -76> 2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:58.838 INFO:tasks.workunit.client.0.smithi153.stderr: -75> 2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.838 INFO:tasks.workunit.client.0.smithi153.stderr: -74> 2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.838 INFO:tasks.workunit.client.0.smithi153.stderr: -73> 2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.838 INFO:tasks.workunit.client.0.smithi153.stderr: -72> 2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:58.838 INFO:tasks.workunit.client.0.smithi153.stderr: -71> 2024-09-19T14:06:58.673+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.838 INFO:tasks.workunit.client.0.smithi153.stderr: -70> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:58.839 INFO:tasks.workunit.client.0.smithi153.stderr: -69> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 zone default found 2024-09-19T14:06:58.839 INFO:tasks.workunit.client.0.smithi153.stderr: -68> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 4 Realm: () 2024-09-19T14:06:58.839 INFO:tasks.workunit.client.0.smithi153.stderr: -67> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:58.839 INFO:tasks.workunit.client.0.smithi153.stderr: -66> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:58.839 INFO:tasks.workunit.client.0.smithi153.stderr: -65> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:58.839 INFO:tasks.workunit.client.0.smithi153.stderr: -64> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 zonegroup default 2024-09-19T14:06:58.839 INFO:tasks.workunit.client.0.smithi153.stderr: -63> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.839 INFO:tasks.workunit.client.0.smithi153.stderr: -62> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.839 INFO:tasks.workunit.client.0.smithi153.stderr: -61> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.839 INFO:tasks.workunit.client.0.smithi153.stderr: -60> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.839 INFO:tasks.workunit.client.0.smithi153.stderr: -59> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.839 INFO:tasks.workunit.client.0.smithi153.stderr: -58> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.839 INFO:tasks.workunit.client.0.smithi153.stderr: -57> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 started sync module instance, tier type = 2024-09-19T14:06:58.840 INFO:tasks.workunit.client.0.smithi153.stderr: -56> 2024-09-19T14:06:58.677+0000 7f6568b9d9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:58.840 INFO:tasks.workunit.client.0.smithi153.stderr: -55> 2024-09-19T14:06:58.693+0000 7f6568b9d9c0 20 add_watcher() i=0 2024-09-19T14:06:58.840 INFO:tasks.workunit.client.0.smithi153.stderr: -54> 2024-09-19T14:06:58.693+0000 7f6568b9d9c0 20 add_watcher() i=1 2024-09-19T14:06:58.840 INFO:tasks.workunit.client.0.smithi153.stderr: -53> 2024-09-19T14:06:58.693+0000 7f6568b9d9c0 20 add_watcher() i=2 2024-09-19T14:06:58.840 INFO:tasks.workunit.client.0.smithi153.stderr: -52> 2024-09-19T14:06:58.693+0000 7f6568b9d9c0 20 add_watcher() i=3 2024-09-19T14:06:58.840 INFO:tasks.workunit.client.0.smithi153.stderr: -51> 2024-09-19T14:06:58.693+0000 7f6568b9d9c0 20 add_watcher() i=4 2024-09-19T14:06:58.840 INFO:tasks.workunit.client.0.smithi153.stderr: -50> 2024-09-19T14:06:58.693+0000 7f6568b9d9c0 20 add_watcher() i=5 2024-09-19T14:06:58.840 INFO:tasks.workunit.client.0.smithi153.stderr: -49> 2024-09-19T14:06:58.693+0000 7f6568b9d9c0 20 add_watcher() i=6 2024-09-19T14:06:58.840 INFO:tasks.workunit.client.0.smithi153.stderr: -48> 2024-09-19T14:06:58.693+0000 7f6568b9d9c0 20 add_watcher() i=7 2024-09-19T14:06:58.840 INFO:tasks.workunit.client.0.smithi153.stderr: -47> 2024-09-19T14:06:58.693+0000 7f6568b9d9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:58.840 INFO:tasks.workunit.client.0.smithi153.stderr: -46> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding auth protocol: cephx 2024-09-19T14:06:58.840 INFO:tasks.workunit.client.0.smithi153.stderr: -45> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding auth protocol: cephx 2024-09-19T14:06:58.840 INFO:tasks.workunit.client.0.smithi153.stderr: -44> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding auth protocol: cephx 2024-09-19T14:06:58.841 INFO:tasks.workunit.client.0.smithi153.stderr: -43> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding con mode: secure 2024-09-19T14:06:58.841 INFO:tasks.workunit.client.0.smithi153.stderr: -42> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding con mode: crc 2024-09-19T14:06:58.841 INFO:tasks.workunit.client.0.smithi153.stderr: -41> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding con mode: secure 2024-09-19T14:06:58.841 INFO:tasks.workunit.client.0.smithi153.stderr: -40> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding con mode: crc 2024-09-19T14:06:58.841 INFO:tasks.workunit.client.0.smithi153.stderr: -39> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding con mode: secure 2024-09-19T14:06:58.841 INFO:tasks.workunit.client.0.smithi153.stderr: -38> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding con mode: crc 2024-09-19T14:06:58.841 INFO:tasks.workunit.client.0.smithi153.stderr: -37> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding con mode: crc 2024-09-19T14:06:58.841 INFO:tasks.workunit.client.0.smithi153.stderr: -36> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding con mode: secure 2024-09-19T14:06:58.841 INFO:tasks.workunit.client.0.smithi153.stderr: -35> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding con mode: crc 2024-09-19T14:06:58.841 INFO:tasks.workunit.client.0.smithi153.stderr: -34> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding con mode: secure 2024-09-19T14:06:58.841 INFO:tasks.workunit.client.0.smithi153.stderr: -33> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding con mode: crc 2024-09-19T14:06:58.841 INFO:tasks.workunit.client.0.smithi153.stderr: -32> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 AuthRegistry(0x7ffe2e6ece50) adding con mode: secure 2024-09-19T14:06:58.841 INFO:tasks.workunit.client.0.smithi153.stderr: -31> 2024-09-19T14:06:58.697+0000 7f641cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:58.841 INFO:tasks.workunit.client.0.smithi153.stderr: -30> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:06:58.842 INFO:tasks.workunit.client.0.smithi153.stderr: -29> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:58.842 INFO:tasks.workunit.client.0.smithi153.stderr: -28> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:58.842 INFO:tasks.workunit.client.0.smithi153.stderr: -27> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command cache list hook 0x55e29fe07540 2024-09-19T14:06:58.842 INFO:tasks.workunit.client.0.smithi153.stderr: -26> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command cache inspect hook 0x55e29fe07540 2024-09-19T14:06:58.842 INFO:tasks.workunit.client.0.smithi153.stderr: -25> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command cache erase hook 0x55e29fe07540 2024-09-19T14:06:58.842 INFO:tasks.workunit.client.0.smithi153.stderr: -24> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command cache zap hook 0x55e29fe07540 2024-09-19T14:06:58.842 INFO:tasks.workunit.client.0.smithi153.stderr: -23> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 note: GC not initialized 2024-09-19T14:06:58.842 INFO:tasks.workunit.client.0.smithi153.stderr: -22> 2024-09-19T14:06:58.697+0000 7f63977fe640 20 reqs_thread_entry: start 2024-09-19T14:06:58.842 INFO:tasks.workunit.client.0.smithi153.stderr: -21> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command sync trace show hook 0x7f655c004410 2024-09-19T14:06:58.842 INFO:tasks.workunit.client.0.smithi153.stderr: -20> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command sync trace history hook 0x7f655c004410 2024-09-19T14:06:58.842 INFO:tasks.workunit.client.0.smithi153.stderr: -19> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command sync trace active hook 0x7f655c004410 2024-09-19T14:06:58.842 INFO:tasks.workunit.client.0.smithi153.stderr: -18> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 5 asok(0x55e29fb3dd90) register_command sync trace active_short hook 0x7f655c004410 2024-09-19T14:06:58.842 INFO:tasks.workunit.client.0.smithi153.stderr: -17> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:58.843 INFO:tasks.workunit.client.0.smithi153.stderr: -16> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 20 Filter name: none 2024-09-19T14:06:58.843 INFO:tasks.workunit.client.0.smithi153.stderr: -15> 2024-09-19T14:06:58.697+0000 7f63957fa640 20 reqs_thread_entry: start 2024-09-19T14:06:58.843 INFO:tasks.workunit.client.0.smithi153.stderr: -14> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-19T14:06:58.843 INFO:tasks.workunit.client.0.smithi153.stderr: -13> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.843 INFO:tasks.workunit.client.0.smithi153.stderr: -12> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-19T14:06:58.843 INFO:tasks.workunit.client.0.smithi153.stderr: -11> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-19T14:06:58.843 INFO:tasks.workunit.client.0.smithi153.stderr: -10> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-19T14:06:58.843 INFO:tasks.workunit.client.0.smithi153.stderr: -9> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 : miss 2024-09-19T14:06:58.843 INFO:tasks.workunit.client.0.smithi153.stderr: -8> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.843 INFO:tasks.workunit.client.0.smithi153.stderr: -7> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-19T14:06:58.843 INFO:tasks.workunit.client.0.smithi153.stderr: -6> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 info.flags=0x17 2024-09-19T14:06:58.843 INFO:tasks.workunit.client.0.smithi153.stderr: -5> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 to cache LRU end 2024-09-19T14:06:58.843 INFO:tasks.workunit.client.0.smithi153.stderr: -4> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:06:58.843 INFO:tasks.workunit.client.0.smithi153.stderr: -3> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:58.844 INFO:tasks.workunit.client.0.smithi153.stderr: -2> 2024-09-19T14:06:58.697+0000 7f6568b9d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 2024-09-19T14:06:58.844 INFO:tasks.workunit.client.0.smithi153.stderr: -1> 2024-09-19T14:06:58.709+0000 7f6568b9d9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6568b9d9c0 time 2024-09-19T14:06:58.712209+0000 2024-09-19T14:06:58.844 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:06:58.844 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.844 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:06:58.844 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f656c4772eb] 2024-09-19T14:06:58.844 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f656c47749f] 2024-09-19T14:06:58.844 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e29cc6e271] 2024-09-19T14:06:58.844 INFO:tasks.workunit.client.0.smithi153.stderr: 4: radosgw-admin(+0x140fb48) [0x55e29d6beb48] 2024-09-19T14:06:58.844 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e29cc7e0dd] 2024-09-19T14:06:58.844 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:06:58.844 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f656b2ddd90] 2024-09-19T14:06:58.844 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:06:58.845 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:06:58.845 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.845 INFO:tasks.workunit.client.0.smithi153.stderr: 0> 2024-09-19T14:06:58.709+0000 7f6568b9d9c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:06:58.845 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7f6568b9d9c0 thread_name:radosgw-admin 2024-09-19T14:06:58.845 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.845 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:06:58.845 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f656b2f6520] 2024-09-19T14:06:58.845 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:06:58.845 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:06:58.845 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:06:58.845 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f656c477345] 2024-09-19T14:06:58.845 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f656c47749f] 2024-09-19T14:06:58.845 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e29cc6e271] 2024-09-19T14:06:58.845 INFO:tasks.workunit.client.0.smithi153.stderr: 8: radosgw-admin(+0x140fb48) [0x55e29d6beb48] 2024-09-19T14:06:58.846 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e29cc7e0dd] 2024-09-19T14:06:58.846 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:06:58.846 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f656b2ddd90] 2024-09-19T14:06:58.846 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:06:58.846 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:06:58.846 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:06:58.846 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.846 INFO:tasks.workunit.client.0.smithi153.stderr:--- logging levels --- 2024-09-19T14:06:58.846 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 none 2024-09-19T14:06:58.846 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 lockdep 2024-09-19T14:06:58.846 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 context 2024-09-19T14:06:58.846 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 crush 2024-09-19T14:06:58.846 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds 2024-09-19T14:06:58.846 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_balancer 2024-09-19T14:06:58.847 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_locker 2024-09-19T14:06:58.847 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log 2024-09-19T14:06:58.847 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log_expire 2024-09-19T14:06:58.847 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_migrator 2024-09-19T14:06:58.847 INFO:tasks.workunit.client.0.smithi153.stderr: 3/ 5 mds_quiesce 2024-09-19T14:06:58.847 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 buffer 2024-09-19T14:06:58.847 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 timer 2024-09-19T14:06:58.847 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 filer 2024-09-19T14:06:58.847 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 striper 2024-09-19T14:06:58.847 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 objecter 2024-09-19T14:06:58.847 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rados 2024-09-19T14:06:58.847 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd 2024-09-19T14:06:58.847 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_mirror 2024-09-19T14:06:58.847 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_replay 2024-09-19T14:06:58.848 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_pwl 2024-09-19T14:06:58.848 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 journaler 2024-09-19T14:06:58.848 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objectcacher 2024-09-19T14:06:58.848 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:06:58.848 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 client 2024-09-19T14:06:58.848 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 osd 2024-09-19T14:06:58.848 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 optracker 2024-09-19T14:06:58.848 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objclass 2024-09-19T14:06:58.848 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 filestore 2024-09-19T14:06:58.848 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 journal 2024-09-19T14:06:58.848 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 ms 2024-09-19T14:06:58.848 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mon 2024-09-19T14:06:58.848 INFO:tasks.workunit.client.0.smithi153.stderr: 0/10 monc 2024-09-19T14:06:58.848 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 paxos 2024-09-19T14:06:58.849 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 tp 2024-09-19T14:06:58.849 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 auth 2024-09-19T14:06:58.849 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 crypto 2024-09-19T14:06:58.849 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 finisher 2024-09-19T14:06:58.849 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 reserver 2024-09-19T14:06:58.849 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 heartbeatmap 2024-09-19T14:06:58.849 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 perfcounter 2024-09-19T14:06:58.849 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw 2024-09-19T14:06:58.849 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_sync 2024-09-19T14:06:58.849 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_datacache 2024-09-19T14:06:58.849 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_access 2024-09-19T14:06:58.849 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:06:58.849 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_flight 2024-09-19T14:06:58.849 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:06:58.850 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw_notification 2024-09-19T14:06:58.850 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 javaclient 2024-09-19T14:06:58.850 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 asok 2024-09-19T14:06:58.850 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 throttle 2024-09-19T14:06:58.850 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 refs 2024-09-19T14:06:58.850 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 compressor 2024-09-19T14:06:58.850 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluestore 2024-09-19T14:06:58.850 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluefs 2024-09-19T14:06:58.850 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 bdev 2024-09-19T14:06:58.850 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 kstore 2024-09-19T14:06:58.850 INFO:tasks.workunit.client.0.smithi153.stderr: 4/ 5 rocksdb 2024-09-19T14:06:58.850 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 fuse 2024-09-19T14:06:58.850 INFO:tasks.workunit.client.0.smithi153.stderr: 2/ 5 mgr 2024-09-19T14:06:58.851 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mgrc 2024-09-19T14:06:58.851 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 dpdk 2024-09-19T14:06:58.851 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 eventtrace 2024-09-19T14:06:58.851 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 prioritycache 2024-09-19T14:06:58.851 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 test 2024-09-19T14:06:58.851 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:06:58.851 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephsqlite 2024-09-19T14:06:58.851 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:06:58.851 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore 2024-09-19T14:06:58.851 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_onode 2024-09-19T14:06:58.851 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_odata 2024-09-19T14:06:58.851 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_omap 2024-09-19T14:06:58.851 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_tm 2024-09-19T14:06:58.852 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_t 2024-09-19T14:06:58.852 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:06:58.852 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_epm 2024-09-19T14:06:58.852 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_lba 2024-09-19T14:06:58.852 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:06:58.852 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cache 2024-09-19T14:06:58.852 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_journal 2024-09-19T14:06:58.852 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_device 2024-09-19T14:06:58.852 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_backref 2024-09-19T14:06:58.852 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 alienstore 2024-09-19T14:06:58.852 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mclock 2024-09-19T14:06:58.852 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cyanstore 2024-09-19T14:06:58.853 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 ceph_exporter 2024-09-19T14:06:58.853 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 memstore 2024-09-19T14:06:58.853 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 trace 2024-09-19T14:06:58.853 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 ceph_dedup 2024-09-19T14:06:58.853 INFO:tasks.workunit.client.0.smithi153.stderr: -2/-2 (syslog threshold) 2024-09-19T14:06:58.853 INFO:tasks.workunit.client.0.smithi153.stderr: 99/99 (stderr threshold) 2024-09-19T14:06:58.853 INFO:tasks.workunit.client.0.smithi153.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:06:58.853 INFO:tasks.workunit.client.0.smithi153.stderr: 7f63957fa640 / http_manager 2024-09-19T14:06:58.853 INFO:tasks.workunit.client.0.smithi153.stderr: 7f63977fe640 / http_manager 2024-09-19T14:06:58.853 INFO:tasks.workunit.client.0.smithi153.stderr: 7f641cfe1640 / rgw_dt_lg_renew 2024-09-19T14:06:58.853 INFO:tasks.workunit.client.0.smithi153.stderr: 7f6437fff640 / ms_dispatch 2024-09-19T14:06:58.853 INFO:tasks.workunit.client.0.smithi153.stderr: 7f6449ffb640 / io_context_pool 2024-09-19T14:06:58.853 INFO:tasks.workunit.client.0.smithi153.stderr: 7f644bfff640 / ms_dispatch 2024-09-19T14:06:58.853 INFO:tasks.workunit.client.0.smithi153.stderr: 7f6452e05640 / ms_dispatch 2024-09-19T14:06:58.854 INFO:tasks.workunit.client.0.smithi153.stderr: 7f6454608640 / io_context_pool 2024-09-19T14:06:58.854 INFO:tasks.workunit.client.0.smithi153.stderr: 7f6564ea0640 / io_context_pool 2024-09-19T14:06:58.854 INFO:tasks.workunit.client.0.smithi153.stderr: 7f6565ea2640 / msgr-worker-2 2024-09-19T14:06:58.854 INFO:tasks.workunit.client.0.smithi153.stderr: 7f65666a3640 / msgr-worker-1 2024-09-19T14:06:58.854 INFO:tasks.workunit.client.0.smithi153.stderr: 7f6566ea4640 / msgr-worker-0 2024-09-19T14:06:58.854 INFO:tasks.workunit.client.0.smithi153.stderr: 7f6568b9d9c0 / radosgw-admin 2024-09-19T14:06:58.854 INFO:tasks.workunit.client.0.smithi153.stderr: max_recent 500 2024-09-19T14:06:58.854 INFO:tasks.workunit.client.0.smithi153.stderr: max_new 1000 2024-09-19T14:06:58.854 INFO:tasks.workunit.client.0.smithi153.stderr: log_file /var/lib/ceph/crash/2024-09-19T14:06:58.714858Z_51eab5a1-9770-4273-b71d-b9abc1b1ce8a/log 2024-09-19T14:06:58.854 INFO:tasks.workunit.client.0.smithi153.stderr:--- end dump of recent events --- 2024-09-19T14:06:58.854 INFO:tasks.workunit.client.0.smithi153.stderr:Aborted 2024-09-19T14:06:58.854 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-19T14:06:58.859 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:58.859 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:58.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.793+0000 7f7dfea759c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.793+0000 7f7dfea759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.793+0000 7f7dfea759c0 20 realm 2024-09-19T14:06:58.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.793+0000 7f7dfea759c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.793+0000 7f7dfea759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.793+0000 7f7dfea759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:58.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.793+0000 7f7dfea759c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.793+0000 7f7dfea759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.793+0000 7f7dfea759c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.797+0000 7f7dfea759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:58.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.797+0000 7f7dfea759c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.797+0000 7f7dfea759c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:58.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.797+0000 7f7dfea759c0 20 searching for the correct realm 2024-09-19T14:06:58.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.801+0000 7f7dfbd7a640 0 -- 172.21.15.153:0/4160258744 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x55fe42473230 msgr2=0x55fe42475660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:58.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.809+0000 7f7dfc57b640 0 -- 172.21.15.153:0/4160258744 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f7df0137b60 msgr2=0x7f7df00e7a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:58.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.817+0000 7f7dfea759c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:58.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.817+0000 7f7dfea759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:58.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.817+0000 7f7dfea759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:58.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.817+0000 7f7dfea759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:58.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.817+0000 7f7dfea759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:58.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.817+0000 7f7dfea759c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:58.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.817+0000 7f7dfea759c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.817+0000 7f7dfea759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.817+0000 7f7dfea759c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.817+0000 7f7dfea759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:58.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.817+0000 7f7dfea759c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.817+0000 7f7dfea759c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:58.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.817+0000 7f7dfea759c0 20 zone default found 2024-09-19T14:06:58.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.817+0000 7f7dfea759c0 4 Realm: () 2024-09-19T14:06:58.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.817+0000 7f7dfea759c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:58.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.817+0000 7f7dfea759c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:58.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.817+0000 7f7dfea759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:58.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.817+0000 7f7dfea759c0 20 zonegroup default 2024-09-19T14:06:58.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.817+0000 7f7dfea759c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.817+0000 7f7dfea759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.817+0000 7f7dfea759c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.821+0000 7f7dfea759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.821+0000 7f7dfea759c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.821+0000 7f7dfea759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:58.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.821+0000 7f7dfea759c0 20 started sync module instance, tier type = 2024-09-19T14:06:58.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.821+0000 7f7dfea759c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:58.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.833+0000 7f7dfea759c0 20 add_watcher() i=0 2024-09-19T14:06:58.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.833+0000 7f7dfea759c0 20 add_watcher() i=1 2024-09-19T14:06:58.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.833+0000 7f7dfea759c0 20 add_watcher() i=2 2024-09-19T14:06:58.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.833+0000 7f7dfea759c0 20 add_watcher() i=3 2024-09-19T14:06:58.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.833+0000 7f7dfea759c0 20 add_watcher() i=4 2024-09-19T14:06:58.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.833+0000 7f7dfea759c0 20 add_watcher() i=5 2024-09-19T14:06:58.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.833+0000 7f7dfea759c0 20 add_watcher() i=6 2024-09-19T14:06:58.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.837+0000 7f7dfea759c0 20 add_watcher() i=7 2024-09-19T14:06:58.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.837+0000 7f7dfea759c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:58.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.837+0000 7f7cb2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:58.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.837+0000 7f7dfea759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:58.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.837+0000 7f7dfea759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:58.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.837+0000 7f7dfea759c0 5 note: GC not initialized 2024-09-19T14:06:58.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.841+0000 7f7cb1fdb640 20 reqs_thread_entry: start 2024-09-19T14:06:58.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.841+0000 7f7dfea759c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:58.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.841+0000 7f7dfea759c0 20 Filter name: none 2024-09-19T14:06:58.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.841+0000 7f7c237fe640 20 reqs_thread_entry: start 2024-09-19T14:06:58.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.841+0000 7f7dfea759c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.841+0000 7f7dfea759c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-19T14:06:58.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.841+0000 7f7dfea759c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.841+0000 7f7dfea759c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-19T14:06:58.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.841+0000 7f7dfea759c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:58.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.841+0000 7f7dfea759c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.841+0000 7f7dfea759c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-19T14:06:58.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.841+0000 7f7dfea759c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:58.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.845+0000 7f7dfea759c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-19T14:06:58.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.845+0000 7f7dfea759c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:06:58.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.845+0000 7f7cb2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:58.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.849+0000 7f7dfea759c0 20 remove_watcher() i=0 2024-09-19T14:06:58.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.849+0000 7f7dfea759c0 2 removed watcher, disabling cache 2024-09-19T14:06:58.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.853+0000 7f7dfea759c0 20 remove_watcher() i=1 2024-09-19T14:06:58.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.857+0000 7f7dfea759c0 20 remove_watcher() i=2 2024-09-19T14:06:58.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.857+0000 7f7dfea759c0 20 remove_watcher() i=3 2024-09-19T14:06:58.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.857+0000 7f7dfea759c0 20 remove_watcher() i=4 2024-09-19T14:06:58.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.861+0000 7f7dfea759c0 20 remove_watcher() i=5 2024-09-19T14:06:58.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.861+0000 7f7dfea759c0 20 remove_watcher() i=6 2024-09-19T14:06:58.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:58.861+0000 7f7dfea759c0 20 remove_watcher() i=7 2024-09-19T14:06:58.878 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.878 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:06:58.878 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: abort-at-set-target-layout id: dbb1da81-49d0-421a-b677-974869a7f103.4620.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:06:58.878 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:06:58.879 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:58.879 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:58.918 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:06:58.918 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:06:58.978 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T14:06:59.012 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:06:59.012 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:06:59.056 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.053+0000 7f1577f8b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:59.058 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.057+0000 7f1577f8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:59.058 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.057+0000 7f1577f8b9c0 20 realm 2024-09-19T14:06:59.058 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.057+0000 7f1577f8b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:59.058 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.057+0000 7f1577f8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:59.058 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.057+0000 7f1577f8b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:06:59.058 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.057+0000 7f1577f8b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:59.058 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.057+0000 7f1577f8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:59.059 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.057+0000 7f1577f8b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:59.060 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.057+0000 7f1577f8b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:59.060 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.057+0000 7f1577f8b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:59.060 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.057+0000 7f1577f8b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:06:59.060 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.057+0000 7f1577f8b9c0 20 searching for the correct realm 2024-09-19T14:06:59.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.065+0000 7f1575290640 0 -- 172.21.15.153:0/971816197 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x559d3898cc00 msgr2=0x559d3898f0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:59.072 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.069+0000 7f1575a91640 0 -- 172.21.15.153:0/971816197 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f156c0fa3e0 msgr2=0x7f156c0fa840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:06:59.079 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.077+0000 7f1577f8b9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:06:59.079 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.077+0000 7f1577f8b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:06:59.079 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.077+0000 7f1577f8b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:06:59.079 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.077+0000 7f1577f8b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:06:59.079 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.077+0000 7f1577f8b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:06:59.079 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.077+0000 7f1577f8b9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:06:59.079 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.077+0000 7f1577f8b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:59.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.077+0000 7f1577f8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:59.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.077+0000 7f1577f8b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:59.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.077+0000 7f1577f8b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:06:59.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.077+0000 7f1577f8b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:59.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.077+0000 7f1577f8b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:06:59.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.077+0000 7f1577f8b9c0 20 zone default found 2024-09-19T14:06:59.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.077+0000 7f1577f8b9c0 4 Realm: () 2024-09-19T14:06:59.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.077+0000 7f1577f8b9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:06:59.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.077+0000 7f1577f8b9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:06:59.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.077+0000 7f1577f8b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:06:59.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.077+0000 7f1577f8b9c0 20 zonegroup default 2024-09-19T14:06:59.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.077+0000 7f1577f8b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:59.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.081+0000 7f1577f8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:59.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.081+0000 7f1577f8b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:59.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.081+0000 7f1577f8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:59.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.081+0000 7f1577f8b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:59.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.081+0000 7f1577f8b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:06:59.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.081+0000 7f1577f8b9c0 20 started sync module instance, tier type = 2024-09-19T14:06:59.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.081+0000 7f1577f8b9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:06:59.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.097+0000 7f1577f8b9c0 20 add_watcher() i=0 2024-09-19T14:06:59.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.097+0000 7f1577f8b9c0 20 add_watcher() i=1 2024-09-19T14:06:59.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.097+0000 7f1577f8b9c0 20 add_watcher() i=2 2024-09-19T14:06:59.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.097+0000 7f1577f8b9c0 20 add_watcher() i=3 2024-09-19T14:06:59.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.097+0000 7f1577f8b9c0 20 add_watcher() i=4 2024-09-19T14:06:59.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.097+0000 7f1577f8b9c0 20 add_watcher() i=5 2024-09-19T14:06:59.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.097+0000 7f1577f8b9c0 20 add_watcher() i=6 2024-09-19T14:06:59.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.097+0000 7f1577f8b9c0 20 add_watcher() i=7 2024-09-19T14:06:59.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.097+0000 7f1577f8b9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:06:59.101 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.101+0000 7f1427fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:59.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.101+0000 7f1577f8b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:06:59.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.101+0000 7f1577f8b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:06:59.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.101+0000 7f1577f8b9c0 5 note: GC not initialized 2024-09-19T14:06:59.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.101+0000 7f1426ffd640 20 reqs_thread_entry: start 2024-09-19T14:06:59.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.101+0000 7f1577f8b9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:06:59.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.101+0000 7f1577f8b9c0 20 Filter name: none 2024-09-19T14:06:59.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.101+0000 7f1577f8b9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-19T14:06:59.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.101+0000 7f1577f8b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:59.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.101+0000 7f1424ff9640 20 reqs_thread_entry: start 2024-09-19T14:06:59.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.101+0000 7f1577f8b9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-19T14:06:59.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.101+0000 7f1577f8b9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-19T14:06:59.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.101+0000 7f1577f8b9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-19T14:06:59.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.101+0000 7f1577f8b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 : miss 2024-09-19T14:06:59.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.101+0000 7f1577f8b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:06:59.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.101+0000 7f1577f8b9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-19T14:06:59.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.101+0000 7f1577f8b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 info.flags=0x17 2024-09-19T14:06:59.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.101+0000 7f1577f8b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 to cache LRU end 2024-09-19T14:06:59.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.101+0000 7f1577f8b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:06:59.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.101+0000 7f1577f8b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:06:59.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.101+0000 7f1577f8b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 2024-09-19T14:06:59.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.105+0000 7f1577f8b9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 to be held by another RGW process; skipping for now 2024-09-19T14:06:59.107 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.105+0000 7f1427fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:06:59.112 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.113+0000 7f1577f8b9c0 20 remove_watcher() i=0 2024-09-19T14:06:59.112 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.113+0000 7f1577f8b9c0 2 removed watcher, disabling cache 2024-09-19T14:06:59.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.113+0000 7f1577f8b9c0 20 remove_watcher() i=1 2024-09-19T14:06:59.116 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.117+0000 7f1577f8b9c0 20 remove_watcher() i=2 2024-09-19T14:06:59.118 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.117+0000 7f1577f8b9c0 20 remove_watcher() i=3 2024-09-19T14:06:59.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.121+0000 7f1577f8b9c0 20 remove_watcher() i=4 2024-09-19T14:06:59.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.121+0000 7f1577f8b9c0 20 remove_watcher() i=5 2024-09-19T14:06:59.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.121+0000 7f1577f8b9c0 20 remove_watcher() i=6 2024-09-19T14:06:59.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:06:59.121+0000 7f1577f8b9c0 20 remove_watcher() i=7 2024-09-19T14:06:59.137 INFO:tasks.workunit.client.0.smithi153.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-19T14:07:29.160 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T14:07:29.199 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:07:29.199 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:07:29.245 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.245+0000 7f32a0cf79c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.247 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.245+0000 7f32a0cf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:29.247 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.245+0000 7f32a0cf79c0 20 realm 2024-09-19T14:07:29.247 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.245+0000 7f32a0cf79c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.245+0000 7f32a0cf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:29.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.245+0000 7f32a0cf79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:07:29.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.245+0000 7f32a0cf79c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.245+0000 7f32a0cf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:29.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.245+0000 7f32a0cf79c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.249+0000 7f32a0cf79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:29.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.249+0000 7f32a0cf79c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.250 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.249+0000 7f32a0cf79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:07:29.250 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.249+0000 7f32a0cf79c0 20 searching for the correct realm 2024-09-19T14:07:29.255 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.253+0000 7f329effe640 0 -- 172.21.15.153:0/1241056776 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55ce646f01a0 msgr2=0x55ce646f2630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:07:29.261 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.261+0000 7f329e7fd640 0 -- 172.21.15.153:0/1241056776 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f32881087f0 msgr2=0x7f3288107040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:29.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:07:29.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:07:29.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:07:29.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:07:29.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:07:29.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:07:29.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:29.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:29.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:07:29.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 20 zone default found 2024-09-19T14:07:29.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 4 Realm: () 2024-09-19T14:07:29.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:07:29.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:07:29.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:07:29.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 20 zonegroup default 2024-09-19T14:07:29.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:29.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:29.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:29.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 20 started sync module instance, tier type = 2024-09-19T14:07:29.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.269+0000 7f32a0cf79c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:07:29.288 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.289+0000 7f32a0cf79c0 20 add_watcher() i=0 2024-09-19T14:07:29.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.289+0000 7f32a0cf79c0 20 add_watcher() i=1 2024-09-19T14:07:29.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.289+0000 7f32a0cf79c0 20 add_watcher() i=2 2024-09-19T14:07:29.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.289+0000 7f32a0cf79c0 20 add_watcher() i=3 2024-09-19T14:07:29.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.289+0000 7f32a0cf79c0 20 add_watcher() i=4 2024-09-19T14:07:29.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.289+0000 7f32a0cf79c0 20 add_watcher() i=5 2024-09-19T14:07:29.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.289+0000 7f32a0cf79c0 20 add_watcher() i=6 2024-09-19T14:07:29.290 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.289+0000 7f32a0cf79c0 20 add_watcher() i=7 2024-09-19T14:07:29.290 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.289+0000 7f32a0cf79c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:07:29.292 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.289+0000 7f3154fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:29.293 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.293+0000 7f32a0cf79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:07:29.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.293+0000 7f32a0cf79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:07:29.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.293+0000 7f32a0cf79c0 5 note: GC not initialized 2024-09-19T14:07:29.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.293+0000 7f30cf7fe640 20 reqs_thread_entry: start 2024-09-19T14:07:29.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.293+0000 7f32a0cf79c0 20 init_complete bucket index max shards: 11 2024-09-19T14:07:29.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.293+0000 7f32a0cf79c0 20 Filter name: none 2024-09-19T14:07:29.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.293+0000 7f30cd7fa640 20 reqs_thread_entry: start 2024-09-19T14:07:29.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.293+0000 7f32a0cf79c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-19T14:07:29.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.293+0000 7f32a0cf79c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.293+0000 7f32a0cf79c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-19T14:07:29.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.293+0000 7f32a0cf79c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-19T14:07:29.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.293+0000 7f32a0cf79c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-19T14:07:29.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.293+0000 7f32a0cf79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 : miss 2024-09-19T14:07:29.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.293+0000 7f32a0cf79c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.293+0000 7f32a0cf79c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-19T14:07:29.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.293+0000 7f32a0cf79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 info.flags=0x17 2024-09-19T14:07:29.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.293+0000 7f32a0cf79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 to cache LRU end 2024-09-19T14:07:29.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.293+0000 7f32a0cf79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:07:29.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.293+0000 7f32a0cf79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:29.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.293+0000 7f32a0cf79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 2024-09-19T14:07:29.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.305+0000 7f32a0cf79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 info.flags=0x17 2024-09-19T14:07:29.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.305+0000 7f32a0cf79c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 to cache LRU end 2024-09-19T14:07:29.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.305+0000 7f32a0cf79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:29.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.305+0000 7f32a0cf79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24, ofs0, ns] 2024-09-19T14:07:29.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.305+0000 7f3181ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333515 cookie 94344936626352 notifier 6245 bl.length()=925 2024-09-19T14:07:29.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.305+0000 7f3181ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 info.flags=0x17 2024-09-19T14:07:29.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.305+0000 7f3181ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 to cache LRU end 2024-09-19T14:07:29.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.305+0000 7f3181ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:29.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.309+0000 7f32a0cf79c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.24]): orig_sources= new_sources= 2024-09-19T14:07:29.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.309+0000 7f32a0cf79c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.24]): potential sources added=[] removed=[] 2024-09-19T14:07:29.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.309+0000 7f32a0cf79c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.24]): orig_dests= new_dests= 2024-09-19T14:07:29.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.309+0000 7f32a0cf79c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.24]): potential dests added=[] removed=[] 2024-09-19T14:07:29.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1.0 2024-09-19T14:07:29.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1.0 2024-09-19T14:07:29.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1.1 2024-09-19T14:07:29.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1.1 2024-09-19T14:07:29.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1.2 2024-09-19T14:07:29.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1.2 2024-09-19T14:07:29.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1.3 2024-09-19T14:07:29.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1.3 2024-09-19T14:07:29.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1.4 2024-09-19T14:07:29.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1.4 2024-09-19T14:07:29.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1.5 2024-09-19T14:07:29.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1.5 2024-09-19T14:07:29.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1.6 2024-09-19T14:07:29.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1.6 2024-09-19T14:07:29.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1.7 2024-09-19T14:07:29.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1.7 2024-09-19T14:07:29.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1.8 2024-09-19T14:07:29.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1.8 2024-09-19T14:07:29.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1.9 2024-09-19T14:07:29.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1.9 2024-09-19T14:07:29.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1.10 2024-09-19T14:07:29.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1.10 2024-09-19T14:07:29.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1.11 2024-09-19T14:07:29.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1.11 2024-09-19T14:07:29.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.317+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.0 2024-09-19T14:07:29.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.321+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1 2024-09-19T14:07:29.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.321+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.2 2024-09-19T14:07:29.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.321+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.3 2024-09-19T14:07:29.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.325+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.4 2024-09-19T14:07:29.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.325+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.5 2024-09-19T14:07:29.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.325+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.6 2024-09-19T14:07:29.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.329+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.7 2024-09-19T14:07:29.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.329+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.8 2024-09-19T14:07:29.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.329+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.9 2024-09-19T14:07:29.331 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.329+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.10 2024-09-19T14:07:29.337 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.337+0000 7f32a0cf79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 : hit (requested=0x17, cached=0x17) 2024-09-19T14:07:29.337 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.337+0000 7f32a0cf79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 2024-09-19T14:07:29.340 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.337+0000 7f32a0cf79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 info.flags=0x17 2024-09-19T14:07:29.340 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.337+0000 7f32a0cf79c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 to cache LRU end 2024-09-19T14:07:29.340 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.337+0000 7f32a0cf79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:29.340 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.337+0000 7f32a0cf79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24, ofs0, ns] 2024-09-19T14:07:29.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.341+0000 7f3181ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333516 cookie 94344936626352 notifier 6245 bl.length()=925 2024-09-19T14:07:29.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.341+0000 7f3181ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 info.flags=0x17 2024-09-19T14:07:29.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.341+0000 7f3181ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 to cache LRU end 2024-09-19T14:07:29.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.341+0000 7f3181ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:29.343 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.341+0000 7f32a0cf79c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.24]): orig_sources= new_sources= 2024-09-19T14:07:29.343 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.341+0000 7f32a0cf79c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.24]): potential sources added=[] removed=[] 2024-09-19T14:07:29.343 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.341+0000 7f32a0cf79c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.24]): orig_dests= new_dests= 2024-09-19T14:07:29.343 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.341+0000 7f32a0cf79c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.24]): potential dests added=[] removed=[] 2024-09-19T14:07:29.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.349+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.0 2024-09-19T14:07:29.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.349+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.1 2024-09-19T14:07:29.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.349+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.2 2024-09-19T14:07:29.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.349+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.3 2024-09-19T14:07:29.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.353+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.4 2024-09-19T14:07:29.353 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.353+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.5 2024-09-19T14:07:29.354 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.353+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.6 2024-09-19T14:07:29.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.353+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.7 2024-09-19T14:07:29.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.353+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.8 2024-09-19T14:07:29.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.353+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.9 2024-09-19T14:07:29.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.357+0000 7f32a0cf79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.24.10 2024-09-19T14:07:29.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.357+0000 7f32a0cf79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 : hit (requested=0x17, cached=0x17) 2024-09-19T14:07:29.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.357+0000 7f32a0cf79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 2024-09-19T14:07:29.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.357+0000 7f32a0cf79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 info.flags=0x17 2024-09-19T14:07:29.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.357+0000 7f32a0cf79c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 to cache LRU end 2024-09-19T14:07:29.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.357+0000 7f32a0cf79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:29.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.357+0000 7f32a0cf79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24, ofs0, ns] 2024-09-19T14:07:29.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.361+0000 7f31817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333517 cookie 94344936626352 notifier 6245 bl.length()=893 2024-09-19T14:07:29.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.361+0000 7f31817fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 info.flags=0x17 2024-09-19T14:07:29.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.361+0000 7f31817fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.24 to cache LRU end 2024-09-19T14:07:29.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.361+0000 7f31817fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:29.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.361+0000 7f32a0cf79c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.24]): orig_sources= new_sources= 2024-09-19T14:07:29.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.361+0000 7f32a0cf79c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.24]): potential sources added=[] removed=[] 2024-09-19T14:07:29.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.361+0000 7f32a0cf79c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.24]): orig_dests= new_dests= 2024-09-19T14:07:29.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.361+0000 7f32a0cf79c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.24]): potential dests added=[] removed=[] 2024-09-19T14:07:29.370 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.369+0000 7f32a0cf79c0 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-19T14:07:29.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.373+0000 7f3154fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:29.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.381+0000 7f32a0cf79c0 20 remove_watcher() i=0 2024-09-19T14:07:29.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.381+0000 7f32a0cf79c0 2 removed watcher, disabling cache 2024-09-19T14:07:29.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.381+0000 7f32a0cf79c0 20 remove_watcher() i=1 2024-09-19T14:07:29.385 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.385+0000 7f32a0cf79c0 20 remove_watcher() i=2 2024-09-19T14:07:29.387 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.385+0000 7f32a0cf79c0 20 remove_watcher() i=3 2024-09-19T14:07:29.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.389+0000 7f32a0cf79c0 20 remove_watcher() i=4 2024-09-19T14:07:29.390 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.389+0000 7f32a0cf79c0 20 remove_watcher() i=5 2024-09-19T14:07:29.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.389+0000 7f32a0cf79c0 20 remove_watcher() i=6 2024-09-19T14:07:29.393 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.393+0000 7f32a0cf79c0 20 remove_watcher() i=7 2024-09-19T14:07:29.410 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-19T14:07:29.437 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:07:29.437 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:07:29.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.477+0000 7f8dbd46d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.481+0000 7f8dbd46d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:29.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.481+0000 7f8dbd46d9c0 20 realm 2024-09-19T14:07:29.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.481+0000 7f8dbd46d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.481+0000 7f8dbd46d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:29.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.481+0000 7f8dbd46d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:07:29.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.481+0000 7f8dbd46d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.481+0000 7f8dbd46d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:29.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.481+0000 7f8dbd46d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.481+0000 7f8dbd46d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:29.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.481+0000 7f8dbd46d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.481+0000 7f8dbd46d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:07:29.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.481+0000 7f8dbd46d9c0 20 searching for the correct realm 2024-09-19T14:07:29.490 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.489+0000 7f8dba772640 0 -- 172.21.15.153:0/2123261390 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x561cc7b7dde0 msgr2=0x561cc7b80270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:29.496 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.493+0000 7f8dba772640 0 -- 172.21.15.153:0/2123261390 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f8dac008050 msgr2=0x7f8dac065800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:29.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.501+0000 7f8dbd46d9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:07:29.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.501+0000 7f8dbd46d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:07:29.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.501+0000 7f8dbd46d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:07:29.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.501+0000 7f8dbd46d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:07:29.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.501+0000 7f8dbd46d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:07:29.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.501+0000 7f8dbd46d9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:07:29.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.501+0000 7f8dbd46d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.501+0000 7f8dbd46d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:29.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.501+0000 7f8dbd46d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.501+0000 7f8dbd46d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:29.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.501+0000 7f8dbd46d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.505+0000 7f8dbd46d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:07:29.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.505+0000 7f8dbd46d9c0 20 zone default found 2024-09-19T14:07:29.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.505+0000 7f8dbd46d9c0 4 Realm: () 2024-09-19T14:07:29.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.505+0000 7f8dbd46d9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:07:29.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.505+0000 7f8dbd46d9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:07:29.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.505+0000 7f8dbd46d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:07:29.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.505+0000 7f8dbd46d9c0 20 zonegroup default 2024-09-19T14:07:29.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.505+0000 7f8dbd46d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.505+0000 7f8dbd46d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:29.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.505+0000 7f8dbd46d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.505+0000 7f8dbd46d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:29.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.505+0000 7f8dbd46d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.505+0000 7f8dbd46d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:29.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.505+0000 7f8dbd46d9c0 20 started sync module instance, tier type = 2024-09-19T14:07:29.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.505+0000 7f8dbd46d9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:07:29.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.521+0000 7f8dbd46d9c0 20 add_watcher() i=0 2024-09-19T14:07:29.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.521+0000 7f8dbd46d9c0 20 add_watcher() i=1 2024-09-19T14:07:29.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.521+0000 7f8dbd46d9c0 20 add_watcher() i=2 2024-09-19T14:07:29.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.521+0000 7f8dbd46d9c0 20 add_watcher() i=3 2024-09-19T14:07:29.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.521+0000 7f8dbd46d9c0 20 add_watcher() i=4 2024-09-19T14:07:29.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.521+0000 7f8dbd46d9c0 20 add_watcher() i=5 2024-09-19T14:07:29.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.521+0000 7f8dbd46d9c0 20 add_watcher() i=6 2024-09-19T14:07:29.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.521+0000 7f8dbd46d9c0 20 add_watcher() i=7 2024-09-19T14:07:29.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.521+0000 7f8dbd46d9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:07:29.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.525+0000 7f8c717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:29.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.525+0000 7f8dbd46d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:07:29.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.525+0000 7f8dbd46d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:07:29.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.525+0000 7f8dbd46d9c0 5 note: GC not initialized 2024-09-19T14:07:29.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.525+0000 7f8bebfff640 20 reqs_thread_entry: start 2024-09-19T14:07:29.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.525+0000 7f8dbd46d9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:07:29.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.525+0000 7f8dbd46d9c0 20 Filter name: none 2024-09-19T14:07:29.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.525+0000 7f8be9ffb640 20 reqs_thread_entry: start 2024-09-19T14:07:29.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.525+0000 7f8dbd46d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.527 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.525+0000 7f8dbd46d9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-19T14:07:29.527 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.525+0000 7f8dbd46d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.528 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.525+0000 7f8dbd46d9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-19T14:07:29.528 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.525+0000 7f8dbd46d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:07:29.528 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.525+0000 7f8dbd46d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.525+0000 7f8dbd46d9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-19T14:07:29.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.525+0000 7f8dbd46d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:29.530 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.529+0000 7f8dbd46d9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-19T14:07:29.530 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.529+0000 7f8dbd46d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:07:29.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.533+0000 7f8c717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:29.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.537+0000 7f8dbd46d9c0 20 remove_watcher() i=0 2024-09-19T14:07:29.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.537+0000 7f8dbd46d9c0 2 removed watcher, disabling cache 2024-09-19T14:07:29.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.537+0000 7f8dbd46d9c0 20 remove_watcher() i=1 2024-09-19T14:07:29.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.541+0000 7f8dbd46d9c0 20 remove_watcher() i=2 2024-09-19T14:07:29.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.541+0000 7f8dbd46d9c0 20 remove_watcher() i=3 2024-09-19T14:07:29.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.545+0000 7f8dbd46d9c0 20 remove_watcher() i=4 2024-09-19T14:07:29.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.545+0000 7f8dbd46d9c0 20 remove_watcher() i=5 2024-09-19T14:07:29.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.545+0000 7f8dbd46d9c0 20 remove_watcher() i=6 2024-09-19T14:07:29.549 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:29.549+0000 7f8dbd46d9c0 20 remove_watcher() i=7 2024-09-19T14:07:29.563 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:29.563 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:07:29.563 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: abort-at-set-target-layout id: dbb1da81-49d0-421a-b677-974869a7f103.4620.24 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T14:07:29.563 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:29.565 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:29.565 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:29.583 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:29.583 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:30.116 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:30.117 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:30.491 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-19T14:07:30.491 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:30.494 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:30.494 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:30.629 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:30.629 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:30.717 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:30.717 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:30.819 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:30.819 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:30.927 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:30.927 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:31.022 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:31.022 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:31.123 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:31.124 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:31.222 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:31.222 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:31.326 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:31.326 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:31.427 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:31.427 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:31.529 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:31.530 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:31.629 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:31.629 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:31.728 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:31.728 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:31.878 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:31.879 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:31.975 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:31.975 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:32.062 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:32.062 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:32.160 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:32.160 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:32.271 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:32.271 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:32.376 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:32.376 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:32.476 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:32.476 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:32.573 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:32.573 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:32.672 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:32.672 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:32.769 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-19T14:07:32.803 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:07:32.803 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:07:32.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:32.845+0000 7f6b0a5769c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:32.849 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:32.849+0000 7f6b0a5769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:32.849 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:32.849+0000 7f6b0a5769c0 20 realm 2024-09-19T14:07:32.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:32.849+0000 7f6b0a5769c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:32.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:32.849+0000 7f6b0a5769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:32.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:32.849+0000 7f6b0a5769c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:07:32.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:32.849+0000 7f6b0a5769c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:32.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:32.849+0000 7f6b0a5769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:32.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:32.849+0000 7f6b0a5769c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:32.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:32.849+0000 7f6b0a5769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:32.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:32.849+0000 7f6b0a5769c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:32.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:32.849+0000 7f6b0a5769c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:07:32.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:32.849+0000 7f6b0a5769c0 20 searching for the correct realm 2024-09-19T14:07:32.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:32.857+0000 7f6b0787b640 0 -- 172.21.15.153:0/755806571 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f6af80e1980 msgr2=0x7f6af80ed430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:33.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.061+0000 7f6b0807c640 0 -- 172.21.15.153:0/755806571 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f6afc079040 msgr2=0x7f6afc0298f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:07:33.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.277+0000 7f6b0a5769c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:07:33.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.277+0000 7f6b0a5769c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:07:33.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.277+0000 7f6b0a5769c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:07:33.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.277+0000 7f6b0a5769c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:07:33.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.277+0000 7f6b0a5769c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:07:33.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.277+0000 7f6b0a5769c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:07:33.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.277+0000 7f6b0a5769c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.277+0000 7f6b0a5769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:33.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.277+0000 7f6b0a5769c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.281+0000 7f6b0a5769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:33.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.281+0000 7f6b0a5769c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.281+0000 7f6b0a5769c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:07:33.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.281+0000 7f6b0a5769c0 20 zone default found 2024-09-19T14:07:33.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.281+0000 7f6b0a5769c0 4 Realm: () 2024-09-19T14:07:33.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.281+0000 7f6b0a5769c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:07:33.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.281+0000 7f6b0a5769c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:07:33.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.281+0000 7f6b0a5769c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:07:33.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.281+0000 7f6b0a5769c0 20 zonegroup default 2024-09-19T14:07:33.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.281+0000 7f6b0a5769c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.284 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.281+0000 7f6b0a5769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:33.284 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.281+0000 7f6b0a5769c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.284 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.281+0000 7f6b0a5769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:33.284 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.281+0000 7f6b0a5769c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.285+0000 7f6b0a5769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:33.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.285+0000 7f6b0a5769c0 20 started sync module instance, tier type = 2024-09-19T14:07:33.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.285+0000 7f6b0a5769c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:07:33.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.305+0000 7f6b0a5769c0 20 add_watcher() i=0 2024-09-19T14:07:33.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.305+0000 7f6b0a5769c0 20 add_watcher() i=1 2024-09-19T14:07:33.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.305+0000 7f6b0a5769c0 20 add_watcher() i=2 2024-09-19T14:07:33.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.305+0000 7f6b0a5769c0 20 add_watcher() i=3 2024-09-19T14:07:33.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.305+0000 7f6b0a5769c0 20 add_watcher() i=4 2024-09-19T14:07:33.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.305+0000 7f6b0a5769c0 20 add_watcher() i=5 2024-09-19T14:07:33.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.309+0000 7f6b0a5769c0 20 add_watcher() i=6 2024-09-19T14:07:33.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.309+0000 7f6b0a5769c0 20 add_watcher() i=7 2024-09-19T14:07:33.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.309+0000 7f6b0a5769c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:07:33.315 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.313+0000 7f69befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:33.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.313+0000 7f6b0a5769c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:07:33.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.313+0000 7f6b0a5769c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:07:33.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.313+0000 7f6b0a5769c0 5 note: GC not initialized 2024-09-19T14:07:33.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.313+0000 7f69bdfdb640 20 reqs_thread_entry: start 2024-09-19T14:07:33.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.317+0000 7f6b0a5769c0 20 init_complete bucket index max shards: 11 2024-09-19T14:07:33.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.317+0000 7f6b0a5769c0 20 Filter name: none 2024-09-19T14:07:33.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.317+0000 7f692f7fe640 20 reqs_thread_entry: start 2024-09-19T14:07:33.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.317+0000 7f6b0a5769c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.317+0000 7f6b0a5769c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-19T14:07:33.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.317+0000 7f6b0a5769c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.317+0000 7f6b0a5769c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-19T14:07:33.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.317+0000 7f6b0a5769c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:07:33.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.317+0000 7f6b0a5769c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.321+0000 7f6b0a5769c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-19T14:07:33.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.321+0000 7f6b0a5769c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.321+0000 7f6b0a5769c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-19T14:07:33.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.321+0000 7f6b0a5769c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:07:33.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.325+0000 7f69befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:33.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.329+0000 7f6b0a5769c0 20 remove_watcher() i=0 2024-09-19T14:07:33.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.329+0000 7f6b0a5769c0 2 removed watcher, disabling cache 2024-09-19T14:07:33.331 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.329+0000 7f6b0a5769c0 20 remove_watcher() i=1 2024-09-19T14:07:33.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.333+0000 7f6b0a5769c0 20 remove_watcher() i=2 2024-09-19T14:07:33.336 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.333+0000 7f6b0a5769c0 20 remove_watcher() i=3 2024-09-19T14:07:33.338 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.337+0000 7f6b0a5769c0 20 remove_watcher() i=4 2024-09-19T14:07:33.339 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.337+0000 7f6b0a5769c0 20 remove_watcher() i=5 2024-09-19T14:07:33.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.341+0000 7f6b0a5769c0 20 remove_watcher() i=6 2024-09-19T14:07:33.342 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.341+0000 7f6b0a5769c0 20 remove_watcher() i=7 2024-09-19T14:07:33.360 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:33.360 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:07:33.360 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-trim-reshard-log-entries id: dbb1da81-49d0-421a-b677-974869a7f103.4620.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:07:33.361 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:33.361 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-19T14:07:33.395 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:07:33.395 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:07:33.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.441+0000 7fd70fcac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.441+0000 7fd70fcac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:33.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.441+0000 7fd70fcac9c0 20 realm 2024-09-19T14:07:33.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.441+0000 7fd70fcac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.441+0000 7fd70fcac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:33.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.441+0000 7fd70fcac9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:07:33.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.441+0000 7fd70fcac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.441+0000 7fd70fcac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:33.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.441+0000 7fd70fcac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.445 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.445+0000 7fd70fcac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:33.445 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.445+0000 7fd70fcac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.445 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.445+0000 7fd70fcac9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:07:33.445 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.445+0000 7fd70fcac9c0 20 searching for the correct realm 2024-09-19T14:07:33.450 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.449+0000 7fd70dfb3640 0 -- 172.21.15.153:0/2483041637 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7fd704008050 msgr2=0x7fd70401a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:33.456 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.453+0000 7fd70d7b2640 0 -- 172.21.15.153:0/2483041637 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fd704043410 msgr2=0x7fd704043890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:33.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.669+0000 7fd70fcac9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:07:33.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.669+0000 7fd70fcac9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:07:33.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.669+0000 7fd70fcac9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:07:33.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.669+0000 7fd70fcac9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:07:33.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.669+0000 7fd70fcac9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:07:33.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.669+0000 7fd70fcac9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:07:33.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.669+0000 7fd70fcac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.669+0000 7fd70fcac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:33.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.669+0000 7fd70fcac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.673+0000 7fd70fcac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:33.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.673+0000 7fd70fcac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.673+0000 7fd70fcac9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:07:33.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.673+0000 7fd70fcac9c0 20 zone default found 2024-09-19T14:07:33.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.673+0000 7fd70fcac9c0 4 Realm: () 2024-09-19T14:07:33.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.673+0000 7fd70fcac9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:07:33.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.673+0000 7fd70fcac9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:07:33.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.673+0000 7fd70fcac9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:07:33.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.673+0000 7fd70fcac9c0 20 zonegroup default 2024-09-19T14:07:33.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.673+0000 7fd70fcac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.673+0000 7fd70fcac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:33.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.673+0000 7fd70fcac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.673+0000 7fd70fcac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:33.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.673+0000 7fd70fcac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.673+0000 7fd70fcac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:33.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.673+0000 7fd70fcac9c0 20 started sync module instance, tier type = 2024-09-19T14:07:33.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.673+0000 7fd70fcac9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:07:33.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.697+0000 7fd70fcac9c0 20 add_watcher() i=0 2024-09-19T14:07:33.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.697+0000 7fd70fcac9c0 20 add_watcher() i=1 2024-09-19T14:07:33.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.697+0000 7fd70fcac9c0 20 add_watcher() i=2 2024-09-19T14:07:33.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.697+0000 7fd70fcac9c0 20 add_watcher() i=3 2024-09-19T14:07:33.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.697+0000 7fd70fcac9c0 20 add_watcher() i=4 2024-09-19T14:07:33.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.697+0000 7fd70fcac9c0 20 add_watcher() i=5 2024-09-19T14:07:33.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.697+0000 7fd70fcac9c0 20 add_watcher() i=6 2024-09-19T14:07:33.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.701+0000 7fd70fcac9c0 20 add_watcher() i=7 2024-09-19T14:07:33.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.701+0000 7fd70fcac9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:07:33.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.705+0000 7fd5c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:33.706 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.705+0000 7fd70fcac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:07:33.707 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.705+0000 7fd70fcac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:07:33.707 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.705+0000 7fd70fcac9c0 5 note: GC not initialized 2024-09-19T14:07:33.707 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.705+0000 7fd5c27e4640 20 reqs_thread_entry: start 2024-09-19T14:07:33.707 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.705+0000 7fd70fcac9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:07:33.707 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.705+0000 7fd70fcac9c0 20 Filter name: none 2024-09-19T14:07:33.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.705+0000 7fd533fff640 20 reqs_thread_entry: start 2024-09-19T14:07:33.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.705+0000 7fd70fcac9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-19T14:07:33.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.705+0000 7fd70fcac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.709 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.709+0000 7fd70fcac9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-19T14:07:33.709 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.709+0000 7fd70fcac9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-19T14:07:33.709 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.709+0000 7fd70fcac9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-19T14:07:33.709 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.709+0000 7fd70fcac9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 : miss 2024-09-19T14:07:33.709 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.709+0000 7fd70fcac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.710 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.709+0000 7fd70fcac9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-19T14:07:33.710 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.709+0000 7fd70fcac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 info.flags=0x17 2024-09-19T14:07:33.710 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.709+0000 7fd70fcac9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 to cache LRU end 2024-09-19T14:07:33.710 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.709+0000 7fd70fcac9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:07:33.710 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.709+0000 7fd70fcac9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:33.710 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.709+0000 7fd70fcac9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 2024-09-19T14:07:33.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.721+0000 7fd70fcac9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 info.flags=0x17 2024-09-19T14:07:33.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.721+0000 7fd70fcac9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 to cache LRU end 2024-09-19T14:07:33.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.721+0000 7fd70fcac9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:33.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.721+0000 7fd70fcac9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25, ofs0, ns] 2024-09-19T14:07:33.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.721+0000 7fd5dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333469 cookie 93979004699408 notifier 6702 bl.length()=939 2024-09-19T14:07:33.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.721+0000 7fd5dffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 info.flags=0x17 2024-09-19T14:07:33.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.721+0000 7fd5dffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 to cache LRU end 2024-09-19T14:07:33.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.721+0000 7fd5dffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:33.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.725+0000 7fd70fcac9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.25]): orig_sources= new_sources= 2024-09-19T14:07:33.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.725+0000 7fd70fcac9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.25]): potential sources added=[] removed=[] 2024-09-19T14:07:33.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.725+0000 7fd70fcac9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.25]): orig_dests= new_dests= 2024-09-19T14:07:33.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.725+0000 7fd70fcac9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.25]): potential dests added=[] removed=[] 2024-09-19T14:07:33.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.725+0000 7fd70fcac9c0 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-19T14:07:33.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.725+0000 7fd70fcac9c0 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-19T14:07:33.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.729+0000 7fd5c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:33.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.733+0000 7fd70fcac9c0 20 remove_watcher() i=0 2024-09-19T14:07:33.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.733+0000 7fd70fcac9c0 2 removed watcher, disabling cache 2024-09-19T14:07:33.736 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.733+0000 7fd70fcac9c0 20 remove_watcher() i=1 2024-09-19T14:07:33.738 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.737+0000 7fd70fcac9c0 20 remove_watcher() i=2 2024-09-19T14:07:33.740 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.737+0000 7fd70fcac9c0 20 remove_watcher() i=3 2024-09-19T14:07:33.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.741+0000 7fd70fcac9c0 20 remove_watcher() i=4 2024-09-19T14:07:33.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.741+0000 7fd70fcac9c0 20 remove_watcher() i=5 2024-09-19T14:07:33.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.745+0000 7fd70fcac9c0 20 remove_watcher() i=6 2024-09-19T14:07:33.746 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.745+0000 7fd70fcac9c0 20 remove_watcher() i=7 2024-09-19T14:07:33.764 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-19T14:07:33.791 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:07:33.791 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:07:33.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.833+0000 7f74caabf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.833+0000 7f74caabf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:33.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.833+0000 7f74caabf9c0 20 realm 2024-09-19T14:07:33.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.833+0000 7f74caabf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.833+0000 7f74caabf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:33.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.833+0000 7f74caabf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:07:33.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.833+0000 7f74caabf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.833+0000 7f74caabf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:33.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.833+0000 7f74caabf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.838 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.837+0000 7f74caabf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:33.838 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.837+0000 7f74caabf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.839 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.837+0000 7f74caabf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:07:33.839 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.837+0000 7f74caabf9c0 20 searching for the correct realm 2024-09-19T14:07:33.845 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.845+0000 7f74c7dc4640 0 -- 172.21.15.153:0/2173861193 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f74b8024030 msgr2=0x7f74b805e0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:07:33.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.849+0000 7f74c7dc4640 0 -- 172.21.15.153:0/2173861193 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f7390082370 msgr2=0x7f73900847a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:33.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.857+0000 7f74caabf9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:07:33.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.857+0000 7f74caabf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:07:33.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.857+0000 7f74caabf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:07:33.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.857+0000 7f74caabf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:07:33.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.857+0000 7f74caabf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:07:33.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.857+0000 7f74caabf9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:07:33.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.857+0000 7f74caabf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.857+0000 7f74caabf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:33.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.857+0000 7f74caabf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.857+0000 7f74caabf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:33.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.857+0000 7f74caabf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.861+0000 7f74caabf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:07:33.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.861+0000 7f74caabf9c0 20 zone default found 2024-09-19T14:07:33.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.861+0000 7f74caabf9c0 4 Realm: () 2024-09-19T14:07:33.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.861+0000 7f74caabf9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:07:33.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.861+0000 7f74caabf9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:07:33.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.861+0000 7f74caabf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:07:33.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.861+0000 7f74caabf9c0 20 zonegroup default 2024-09-19T14:07:33.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.861+0000 7f74caabf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.861+0000 7f74caabf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:33.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.861+0000 7f74caabf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.861+0000 7f74caabf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:33.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.861+0000 7f74caabf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.861+0000 7f74caabf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:33.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.861+0000 7f74caabf9c0 20 started sync module instance, tier type = 2024-09-19T14:07:33.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.861+0000 7f74caabf9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:07:33.878 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.877+0000 7f74caabf9c0 20 add_watcher() i=0 2024-09-19T14:07:33.878 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.877+0000 7f74caabf9c0 20 add_watcher() i=1 2024-09-19T14:07:33.878 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.877+0000 7f74caabf9c0 20 add_watcher() i=2 2024-09-19T14:07:33.878 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.877+0000 7f74caabf9c0 20 add_watcher() i=3 2024-09-19T14:07:33.878 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.877+0000 7f74caabf9c0 20 add_watcher() i=4 2024-09-19T14:07:33.878 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.877+0000 7f74caabf9c0 20 add_watcher() i=5 2024-09-19T14:07:33.879 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.877+0000 7f74caabf9c0 20 add_watcher() i=6 2024-09-19T14:07:33.879 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.877+0000 7f74caabf9c0 20 add_watcher() i=7 2024-09-19T14:07:33.879 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.877+0000 7f74caabf9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:07:33.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.881+0000 7f737efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:33.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.881+0000 7f74caabf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:07:33.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.881+0000 7f74caabf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:07:33.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.881+0000 7f74caabf9c0 5 note: GC not initialized 2024-09-19T14:07:33.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.881+0000 7f737dfdb640 20 reqs_thread_entry: start 2024-09-19T14:07:33.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.881+0000 7f74caabf9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:07:33.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.881+0000 7f74caabf9c0 20 Filter name: none 2024-09-19T14:07:33.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.881+0000 7f72ef7fe640 20 reqs_thread_entry: start 2024-09-19T14:07:33.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.881+0000 7f74caabf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.881+0000 7f74caabf9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-19T14:07:33.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.881+0000 7f74caabf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.885 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.885+0000 7f74caabf9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-19T14:07:33.885 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.885+0000 7f74caabf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:07:33.885 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.885+0000 7f74caabf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.885+0000 7f74caabf9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-19T14:07:33.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.885+0000 7f74caabf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:33.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.885+0000 7f74caabf9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-19T14:07:33.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.885+0000 7f74caabf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:07:33.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.889+0000 7f737efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:33.894 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.893+0000 7f74caabf9c0 20 remove_watcher() i=0 2024-09-19T14:07:33.894 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.893+0000 7f74caabf9c0 2 removed watcher, disabling cache 2024-09-19T14:07:33.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.893+0000 7f74caabf9c0 20 remove_watcher() i=1 2024-09-19T14:07:33.899 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.897+0000 7f74caabf9c0 20 remove_watcher() i=2 2024-09-19T14:07:33.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.901+0000 7f74caabf9c0 20 remove_watcher() i=3 2024-09-19T14:07:33.903 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.901+0000 7f74caabf9c0 20 remove_watcher() i=4 2024-09-19T14:07:33.905 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.905+0000 7f74caabf9c0 20 remove_watcher() i=5 2024-09-19T14:07:33.906 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.905+0000 7f74caabf9c0 20 remove_watcher() i=6 2024-09-19T14:07:33.907 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:33.905+0000 7f74caabf9c0 20 remove_watcher() i=7 2024-09-19T14:07:33.921 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:33.921 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:07:33.921 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-trim-reshard-log-entries id: dbb1da81-49d0-421a-b677-974869a7f103.4620.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:07:33.921 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:33.922 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:33.922 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:33.964 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:33.965 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:34.022 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T14:07:34.057 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:07:34.057 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:07:34.101 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.101+0000 7ff095f289c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.101+0000 7ff095f289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:34.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.101+0000 7ff095f289c0 20 realm 2024-09-19T14:07:34.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.101+0000 7ff095f289c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.101+0000 7ff095f289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:34.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.101+0000 7ff095f289c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:07:34.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.101+0000 7ff095f289c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.101+0000 7ff095f289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:34.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.101+0000 7ff095f289c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.105+0000 7ff095f289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:34.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.105+0000 7ff095f289c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.105+0000 7ff095f289c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:07:34.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.105+0000 7ff095f289c0 20 searching for the correct realm 2024-09-19T14:07:34.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.109+0000 7ff09322d640 0 -- 172.21.15.153:0/3051487969 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7ff08400e070 msgr2=0x7ff084070f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:34.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.117+0000 7ff09322d640 0 -- 172.21.15.153:0/3051487969 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fef5c0822c0 msgr2=0x7fef5c0846f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:34.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.121+0000 7ff095f289c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:07:34.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.121+0000 7ff095f289c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:07:34.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.121+0000 7ff095f289c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:07:34.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.121+0000 7ff095f289c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:07:34.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.121+0000 7ff095f289c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:07:34.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.121+0000 7ff095f289c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:07:34.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.121+0000 7ff095f289c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.121+0000 7ff095f289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:34.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.121+0000 7ff095f289c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.125+0000 7ff095f289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:34.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.125+0000 7ff095f289c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.125+0000 7ff095f289c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:07:34.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.125+0000 7ff095f289c0 20 zone default found 2024-09-19T14:07:34.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.125+0000 7ff095f289c0 4 Realm: () 2024-09-19T14:07:34.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.125+0000 7ff095f289c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:07:34.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.125+0000 7ff095f289c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:07:34.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.125+0000 7ff095f289c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:07:34.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.125+0000 7ff095f289c0 20 zonegroup default 2024-09-19T14:07:34.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.125+0000 7ff095f289c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.125+0000 7ff095f289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:34.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.125+0000 7ff095f289c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.125+0000 7ff095f289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:34.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.125+0000 7ff095f289c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.125+0000 7ff095f289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:34.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.125+0000 7ff095f289c0 20 started sync module instance, tier type = 2024-09-19T14:07:34.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.125+0000 7ff095f289c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:07:34.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.141+0000 7ff095f289c0 20 add_watcher() i=0 2024-09-19T14:07:34.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.141+0000 7ff095f289c0 20 add_watcher() i=1 2024-09-19T14:07:34.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.141+0000 7ff095f289c0 20 add_watcher() i=2 2024-09-19T14:07:34.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.141+0000 7ff095f289c0 20 add_watcher() i=3 2024-09-19T14:07:34.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.141+0000 7ff095f289c0 20 add_watcher() i=4 2024-09-19T14:07:34.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.141+0000 7ff095f289c0 20 add_watcher() i=5 2024-09-19T14:07:34.143 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.141+0000 7ff095f289c0 20 add_watcher() i=6 2024-09-19T14:07:34.143 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.141+0000 7ff095f289c0 20 add_watcher() i=7 2024-09-19T14:07:34.143 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.141+0000 7ff095f289c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:07:34.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.145+0000 7fef4a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:34.147 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.145+0000 7ff095f289c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:07:34.147 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.145+0000 7ff095f289c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:07:34.147 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.145+0000 7ff095f289c0 5 note: GC not initialized 2024-09-19T14:07:34.147 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.145+0000 7fef497e2640 20 reqs_thread_entry: start 2024-09-19T14:07:34.147 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.145+0000 7ff095f289c0 20 init_complete bucket index max shards: 11 2024-09-19T14:07:34.147 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.145+0000 7ff095f289c0 20 Filter name: none 2024-09-19T14:07:34.147 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.145+0000 7fef427fc640 20 reqs_thread_entry: start 2024-09-19T14:07:34.147 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.145+0000 7ff095f289c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-19T14:07:34.147 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.145+0000 7ff095f289c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.145+0000 7ff095f289c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-19T14:07:34.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.145+0000 7ff095f289c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-19T14:07:34.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.145+0000 7ff095f289c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-19T14:07:34.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.145+0000 7ff095f289c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 : miss 2024-09-19T14:07:34.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.145+0000 7ff095f289c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.145+0000 7ff095f289c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-19T14:07:34.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.145+0000 7ff095f289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 info.flags=0x17 2024-09-19T14:07:34.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.145+0000 7ff095f289c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 to cache LRU end 2024-09-19T14:07:34.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.145+0000 7ff095f289c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:07:34.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.145+0000 7ff095f289c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:34.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.145+0000 7ff095f289c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 2024-09-19T14:07:34.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.149+0000 7ff095f289c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T14:07:34.167 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.165+0000 7ff095f289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 info.flags=0x17 2024-09-19T14:07:34.167 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.165+0000 7ff095f289c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 to cache LRU end 2024-09-19T14:07:34.167 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.165+0000 7ff095f289c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:34.167 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.165+0000 7ff095f289c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25, ofs0, ns] 2024-09-19T14:07:34.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.165+0000 7fef72ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333470 cookie 94752877787408 notifier 6332 bl.length()=939 2024-09-19T14:07:34.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.165+0000 7fef72ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 info.flags=0x17 2024-09-19T14:07:34.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.165+0000 7fef72ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 to cache LRU end 2024-09-19T14:07:34.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.165+0000 7fef72ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:34.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.169+0000 7ff095f289c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.25]): orig_sources= new_sources= 2024-09-19T14:07:34.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.169+0000 7ff095f289c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.25]): potential sources added=[] removed=[] 2024-09-19T14:07:34.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.169+0000 7ff095f289c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.25]): orig_dests= new_dests= 2024-09-19T14:07:34.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.169+0000 7ff095f289c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.25]): potential dests added=[] removed=[] 2024-09-19T14:07:34.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2.0 2024-09-19T14:07:34.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2.0 2024-09-19T14:07:34.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2.1 2024-09-19T14:07:34.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2.1 2024-09-19T14:07:34.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2.2 2024-09-19T14:07:34.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2.2 2024-09-19T14:07:34.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2.3 2024-09-19T14:07:34.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2.3 2024-09-19T14:07:34.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2.4 2024-09-19T14:07:34.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2.4 2024-09-19T14:07:34.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2.5 2024-09-19T14:07:34.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2.5 2024-09-19T14:07:34.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2.6 2024-09-19T14:07:34.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2.6 2024-09-19T14:07:34.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2.7 2024-09-19T14:07:34.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2.7 2024-09-19T14:07:34.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2.8 2024-09-19T14:07:34.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2.8 2024-09-19T14:07:34.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2.9 2024-09-19T14:07:34.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2.9 2024-09-19T14:07:34.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2.10 2024-09-19T14:07:34.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2.10 2024-09-19T14:07:34.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2.11 2024-09-19T14:07:34.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2.11 2024-09-19T14:07:34.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.177+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.0 2024-09-19T14:07:34.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.181+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.1 2024-09-19T14:07:34.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.181+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2 2024-09-19T14:07:34.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.181+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.3 2024-09-19T14:07:34.184 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.181+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.4 2024-09-19T14:07:34.184 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.181+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.5 2024-09-19T14:07:34.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.185+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.6 2024-09-19T14:07:34.186 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.185+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.7 2024-09-19T14:07:34.187 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.185+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.8 2024-09-19T14:07:34.188 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.185+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.9 2024-09-19T14:07:34.189 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.189+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.10 2024-09-19T14:07:34.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.193+0000 7ff095f289c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 : hit (requested=0x17, cached=0x17) 2024-09-19T14:07:34.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.193+0000 7ff095f289c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 2024-09-19T14:07:34.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.197+0000 7ff095f289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 info.flags=0x17 2024-09-19T14:07:34.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.197+0000 7ff095f289c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 to cache LRU end 2024-09-19T14:07:34.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.197+0000 7ff095f289c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:34.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.197+0000 7ff095f289c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25, ofs0, ns] 2024-09-19T14:07:34.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.197+0000 7fef72ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333471 cookie 94752877787408 notifier 6332 bl.length()=939 2024-09-19T14:07:34.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.197+0000 7fef72ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 info.flags=0x17 2024-09-19T14:07:34.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.197+0000 7fef72ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 to cache LRU end 2024-09-19T14:07:34.199 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.197+0000 7fef72ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:34.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.197+0000 7ff095f289c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.25]): orig_sources= new_sources= 2024-09-19T14:07:34.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.197+0000 7ff095f289c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.25]): potential sources added=[] removed=[] 2024-09-19T14:07:34.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.197+0000 7ff095f289c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.25]): orig_dests= new_dests= 2024-09-19T14:07:34.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.197+0000 7ff095f289c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.25]): potential dests added=[] removed=[] 2024-09-19T14:07:34.205 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.205+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.0 2024-09-19T14:07:34.205 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.205+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.1 2024-09-19T14:07:34.206 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.205+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.2 2024-09-19T14:07:34.207 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.205+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.3 2024-09-19T14:07:34.208 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.205+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.4 2024-09-19T14:07:34.208 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.205+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.5 2024-09-19T14:07:34.209 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.209+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.6 2024-09-19T14:07:34.209 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.209+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.7 2024-09-19T14:07:34.211 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.209+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.8 2024-09-19T14:07:34.211 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.209+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.9 2024-09-19T14:07:34.211 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.209+0000 7ff095f289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.25.10 2024-09-19T14:07:34.211 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.209+0000 7ff095f289c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 : hit (requested=0x17, cached=0x17) 2024-09-19T14:07:34.212 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.209+0000 7ff095f289c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 2024-09-19T14:07:34.214 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.213+0000 7ff095f289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 info.flags=0x17 2024-09-19T14:07:34.214 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.213+0000 7ff095f289c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 to cache LRU end 2024-09-19T14:07:34.214 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.213+0000 7ff095f289c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:34.214 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.213+0000 7ff095f289c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25, ofs0, ns] 2024-09-19T14:07:34.214 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.213+0000 7fef72ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333472 cookie 94752877787408 notifier 6332 bl.length()=907 2024-09-19T14:07:34.214 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.213+0000 7fef72ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 info.flags=0x17 2024-09-19T14:07:34.215 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.213+0000 7fef72ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.25 to cache LRU end 2024-09-19T14:07:34.215 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.213+0000 7fef72ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:34.216 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.213+0000 7ff095f289c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.25]): orig_sources= new_sources= 2024-09-19T14:07:34.216 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.213+0000 7ff095f289c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.25]): potential sources added=[] removed=[] 2024-09-19T14:07:34.216 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.213+0000 7ff095f289c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.25]): orig_dests= new_dests= 2024-09-19T14:07:34.216 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.213+0000 7ff095f289c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.25]): potential dests added=[] removed=[] 2024-09-19T14:07:34.221 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.221+0000 7ff095f289c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-19T14:07:34.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.221+0000 7fef4a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:34.228 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.225+0000 7ff095f289c0 20 remove_watcher() i=0 2024-09-19T14:07:34.228 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.225+0000 7ff095f289c0 2 removed watcher, disabling cache 2024-09-19T14:07:34.230 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.229+0000 7ff095f289c0 20 remove_watcher() i=1 2024-09-19T14:07:34.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.233+0000 7ff095f289c0 20 remove_watcher() i=2 2024-09-19T14:07:34.235 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.233+0000 7ff095f289c0 20 remove_watcher() i=3 2024-09-19T14:07:34.236 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.237+0000 7ff095f289c0 20 remove_watcher() i=4 2024-09-19T14:07:34.238 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.237+0000 7ff095f289c0 20 remove_watcher() i=5 2024-09-19T14:07:34.239 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.237+0000 7ff095f289c0 20 remove_watcher() i=6 2024-09-19T14:07:34.240 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.237+0000 7ff095f289c0 20 remove_watcher() i=7 2024-09-19T14:07:34.255 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-19T14:07:34.282 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:07:34.282 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:07:34.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.325+0000 7f2b3534e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.325+0000 7f2b3534e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:34.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.325+0000 7f2b3534e9c0 20 realm 2024-09-19T14:07:34.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.325+0000 7f2b3534e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.325+0000 7f2b3534e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:34.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.325+0000 7f2b3534e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:07:34.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.325+0000 7f2b3534e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.325+0000 7f2b3534e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:34.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.325+0000 7f2b3534e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.329+0000 7f2b3534e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:34.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.329+0000 7f2b3534e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.329+0000 7f2b3534e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:07:34.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.329+0000 7f2b3534e9c0 20 searching for the correct realm 2024-09-19T14:07:34.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.333+0000 7f2b32653640 0 -- 172.21.15.153:0/3758814755 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x563fa6295ed0 msgr2=0x563fa62982c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:34.340 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.337+0000 7f2b32e54640 0 -- 172.21.15.153:0/3758814755 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f2b1c028970 msgr2=0x7f2b1c0173e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:34.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.345+0000 7f2b3534e9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:07:34.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.345+0000 7f2b3534e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:07:34.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.345+0000 7f2b3534e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:07:34.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.345+0000 7f2b3534e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:07:34.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.345+0000 7f2b3534e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:07:34.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.345+0000 7f2b3534e9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:07:34.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.345+0000 7f2b3534e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.345+0000 7f2b3534e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:34.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.345+0000 7f2b3534e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.345+0000 7f2b3534e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:34.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.345+0000 7f2b3534e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.349+0000 7f2b3534e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:07:34.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.349+0000 7f2b3534e9c0 20 zone default found 2024-09-19T14:07:34.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.349+0000 7f2b3534e9c0 4 Realm: () 2024-09-19T14:07:34.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.349+0000 7f2b3534e9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:07:34.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.349+0000 7f2b3534e9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:07:34.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.349+0000 7f2b3534e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:07:34.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.349+0000 7f2b3534e9c0 20 zonegroup default 2024-09-19T14:07:34.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.349+0000 7f2b3534e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.349+0000 7f2b3534e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:34.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.349+0000 7f2b3534e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.349+0000 7f2b3534e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:34.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.349+0000 7f2b3534e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.349+0000 7f2b3534e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:34.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.349+0000 7f2b3534e9c0 20 started sync module instance, tier type = 2024-09-19T14:07:34.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.349+0000 7f2b3534e9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:07:34.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.365+0000 7f2b3534e9c0 20 add_watcher() i=0 2024-09-19T14:07:34.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.365+0000 7f2b3534e9c0 20 add_watcher() i=1 2024-09-19T14:07:34.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.365+0000 7f2b3534e9c0 20 add_watcher() i=2 2024-09-19T14:07:34.367 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.365+0000 7f2b3534e9c0 20 add_watcher() i=3 2024-09-19T14:07:34.367 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.365+0000 7f2b3534e9c0 20 add_watcher() i=4 2024-09-19T14:07:34.367 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.365+0000 7f2b3534e9c0 20 add_watcher() i=5 2024-09-19T14:07:34.367 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.365+0000 7f2b3534e9c0 20 add_watcher() i=6 2024-09-19T14:07:34.367 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.365+0000 7f2b3534e9c0 20 add_watcher() i=7 2024-09-19T14:07:34.367 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.365+0000 7f2b3534e9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:07:34.370 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.369+0000 7f29e97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:34.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.369+0000 7f2b3534e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:07:34.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.369+0000 7f2b3534e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:07:34.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.369+0000 7f2b3534e9c0 5 note: GC not initialized 2024-09-19T14:07:34.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.369+0000 7f2963fff640 20 reqs_thread_entry: start 2024-09-19T14:07:34.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.369+0000 7f2b3534e9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:07:34.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.369+0000 7f2b3534e9c0 20 Filter name: none 2024-09-19T14:07:34.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.369+0000 7f2961ffb640 20 reqs_thread_entry: start 2024-09-19T14:07:34.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.369+0000 7f2b3534e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.369+0000 7f2b3534e9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-19T14:07:34.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.369+0000 7f2b3534e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.373+0000 7f2b3534e9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-19T14:07:34.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.373+0000 7f2b3534e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:07:34.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.373+0000 7f2b3534e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.373+0000 7f2b3534e9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-19T14:07:34.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.373+0000 7f2b3534e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:34.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.373+0000 7f2b3534e9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-19T14:07:34.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.373+0000 7f2b3534e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:07:34.376 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.373+0000 7f29e97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:34.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.381+0000 7f2b3534e9c0 20 remove_watcher() i=0 2024-09-19T14:07:34.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.381+0000 7f2b3534e9c0 2 removed watcher, disabling cache 2024-09-19T14:07:34.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.381+0000 7f2b3534e9c0 20 remove_watcher() i=1 2024-09-19T14:07:34.385 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.385+0000 7f2b3534e9c0 20 remove_watcher() i=2 2024-09-19T14:07:34.387 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.385+0000 7f2b3534e9c0 20 remove_watcher() i=3 2024-09-19T14:07:34.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.389+0000 7f2b3534e9c0 20 remove_watcher() i=4 2024-09-19T14:07:34.390 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.389+0000 7f2b3534e9c0 20 remove_watcher() i=5 2024-09-19T14:07:34.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.389+0000 7f2b3534e9c0 20 remove_watcher() i=6 2024-09-19T14:07:34.393 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:34.393+0000 7f2b3534e9c0 20 remove_watcher() i=7 2024-09-19T14:07:34.406 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:34.406 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:07:34.406 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-trim-reshard-log-entries id: dbb1da81-49d0-421a-b677-974869a7f103.4620.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T14:07:34.407 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:34.408 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:34.408 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:34.430 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:34.430 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:35.024 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:35.024 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:35.397 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-19T14:07:35.397 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:35.399 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:35.399 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:35.532 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:35.532 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:35.620 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:35.620 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:35.715 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:35.715 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:35.814 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:35.814 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:35.910 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:35.910 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:36.008 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:36.008 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:36.102 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:36.103 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:36.202 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:36.202 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:36.300 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:36.301 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:36.400 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:36.400 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:36.492 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:36.492 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:36.589 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:36.589 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:36.689 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:36.689 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:36.782 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:36.782 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:36.882 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:36.882 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:36.982 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:36.982 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:37.081 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:37.081 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:37.184 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:37.184 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:37.294 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:37.294 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:37.396 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:37.396 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:37.498 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:37.498 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:37.589 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-19T14:07:37.622 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:07:37.623 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:07:37.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.669+0000 7ff4fbdb99c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:37.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.669+0000 7ff4fbdb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:37.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.669+0000 7ff4fbdb99c0 20 realm 2024-09-19T14:07:37.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.669+0000 7ff4fbdb99c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:37.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.669+0000 7ff4fbdb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:37.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.669+0000 7ff4fbdb99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:07:37.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.669+0000 7ff4fbdb99c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:37.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.669+0000 7ff4fbdb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:37.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.669+0000 7ff4fbdb99c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:37.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.673+0000 7ff4fbdb99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:37.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.673+0000 7ff4fbdb99c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:37.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.673+0000 7ff4fbdb99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:07:37.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.673+0000 7ff4fbdb99c0 20 searching for the correct realm 2024-09-19T14:07:37.679 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.677+0000 7ff4f90be640 0 -- 172.21.15.153:0/25070183 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x55880dfc59f0 msgr2=0x55880dfc7de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:37.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.685+0000 7ff4f98bf640 0 -- 172.21.15.153:0/25070183 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7ff4e411f050 msgr2=0x7ff4e41218a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:37.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:07:37.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:07:37.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:07:37.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:07:37.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:07:37.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:07:37.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:37.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:37.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:37.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:37.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:37.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:07:37.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 20 zone default found 2024-09-19T14:07:37.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 4 Realm: () 2024-09-19T14:07:37.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:07:37.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:07:37.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:07:37.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 20 zonegroup default 2024-09-19T14:07:37.696 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:37.696 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:37.696 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:37.696 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:37.696 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:37.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:37.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 20 started sync module instance, tier type = 2024-09-19T14:07:37.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.693+0000 7ff4fbdb99c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:07:37.712 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.709+0000 7ff4fbdb99c0 20 add_watcher() i=0 2024-09-19T14:07:37.712 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.709+0000 7ff4fbdb99c0 20 add_watcher() i=1 2024-09-19T14:07:37.712 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.709+0000 7ff4fbdb99c0 20 add_watcher() i=2 2024-09-19T14:07:37.712 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.709+0000 7ff4fbdb99c0 20 add_watcher() i=3 2024-09-19T14:07:37.712 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.709+0000 7ff4fbdb99c0 20 add_watcher() i=4 2024-09-19T14:07:37.712 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.709+0000 7ff4fbdb99c0 20 add_watcher() i=5 2024-09-19T14:07:37.712 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.709+0000 7ff4fbdb99c0 20 add_watcher() i=6 2024-09-19T14:07:37.713 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.713+0000 7ff4fbdb99c0 20 add_watcher() i=7 2024-09-19T14:07:37.713 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.713+0000 7ff4fbdb99c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:07:37.715 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.713+0000 7ff3affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:37.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.713+0000 7ff4fbdb99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:07:37.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.713+0000 7ff4fbdb99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:07:37.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.713+0000 7ff4fbdb99c0 5 note: GC not initialized 2024-09-19T14:07:37.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.713+0000 7ff3aefe5640 20 reqs_thread_entry: start 2024-09-19T14:07:37.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.713+0000 7ff4fbdb99c0 20 init_complete bucket index max shards: 11 2024-09-19T14:07:37.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.713+0000 7ff4fbdb99c0 20 Filter name: none 2024-09-19T14:07:37.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.713+0000 7ff3acfe1640 20 reqs_thread_entry: start 2024-09-19T14:07:37.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.713+0000 7ff4fbdb99c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:37.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.717+0000 7ff4fbdb99c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-19T14:07:37.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.717+0000 7ff4fbdb99c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:37.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.717+0000 7ff4fbdb99c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-19T14:07:37.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.717+0000 7ff4fbdb99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:07:37.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.717+0000 7ff4fbdb99c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:37.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.717+0000 7ff4fbdb99c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-19T14:07:37.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.717+0000 7ff4fbdb99c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:37.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.717+0000 7ff4fbdb99c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-19T14:07:37.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.717+0000 7ff4fbdb99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:07:37.722 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.721+0000 7ff3affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:37.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.725+0000 7ff4fbdb99c0 20 remove_watcher() i=0 2024-09-19T14:07:37.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.725+0000 7ff4fbdb99c0 2 removed watcher, disabling cache 2024-09-19T14:07:37.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.729+0000 7ff4fbdb99c0 20 remove_watcher() i=1 2024-09-19T14:07:37.731 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.729+0000 7ff4fbdb99c0 20 remove_watcher() i=2 2024-09-19T14:07:37.733 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.733+0000 7ff4fbdb99c0 20 remove_watcher() i=3 2024-09-19T14:07:37.735 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.733+0000 7ff4fbdb99c0 20 remove_watcher() i=4 2024-09-19T14:07:37.736 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.733+0000 7ff4fbdb99c0 20 remove_watcher() i=5 2024-09-19T14:07:37.737 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.737+0000 7ff4fbdb99c0 20 remove_watcher() i=6 2024-09-19T14:07:37.740 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.737+0000 7ff4fbdb99c0 20 remove_watcher() i=7 2024-09-19T14:07:37.753 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:37.753 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:07:37.753 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-trim-reshard-log-entries id: dbb1da81-49d0-421a-b677-974869a7f103.4620.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:07:37.753 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:37.753 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-19T14:07:37.788 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:07:37.788 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:07:37.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.829+0000 7f9ec16059c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:37.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.833+0000 7f9ec16059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:37.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.833+0000 7f9ec16059c0 20 realm 2024-09-19T14:07:37.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.833+0000 7f9ec16059c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:37.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.833+0000 7f9ec16059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:37.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.833+0000 7f9ec16059c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:07:37.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.833+0000 7f9ec16059c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:37.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.833+0000 7f9ec16059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:37.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.833+0000 7f9ec16059c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:37.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.833+0000 7f9ec16059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:37.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.833+0000 7f9ec16059c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:37.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.833+0000 7f9ec16059c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:07:37.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.837+0000 7f9ec16059c0 20 searching for the correct realm 2024-09-19T14:07:37.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:37.837+0000 7f9ebe90a640 0 -- 172.21.15.153:0/2638843753 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f9eb0046030 msgr2=0x7f9eb00684e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:38.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.053+0000 7f9ebf10b640 0 -- 172.21.15.153:0/2638843753 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f9eb4078050 msgr2=0x7f9eb409c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:38.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.269+0000 7f9ec16059c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:07:38.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.269+0000 7f9ec16059c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:07:38.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.269+0000 7f9ec16059c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:07:38.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.269+0000 7f9ec16059c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:07:38.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.269+0000 7f9ec16059c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:07:38.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.269+0000 7f9ec16059c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:07:38.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.269+0000 7f9ec16059c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:38.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.273+0000 7f9ec16059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:38.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.273+0000 7f9ec16059c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:38.274 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.273+0000 7f9ec16059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:38.274 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.273+0000 7f9ec16059c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:38.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.273+0000 7f9ec16059c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:07:38.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.273+0000 7f9ec16059c0 20 zone default found 2024-09-19T14:07:38.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.273+0000 7f9ec16059c0 4 Realm: () 2024-09-19T14:07:38.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.273+0000 7f9ec16059c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:07:38.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.273+0000 7f9ec16059c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:07:38.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.273+0000 7f9ec16059c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:07:38.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.273+0000 7f9ec16059c0 20 zonegroup default 2024-09-19T14:07:38.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.273+0000 7f9ec16059c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:38.276 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.273+0000 7f9ec16059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:38.276 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.273+0000 7f9ec16059c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:38.276 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.273+0000 7f9ec16059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:38.276 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.273+0000 7f9ec16059c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:38.277 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.277+0000 7f9ec16059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:38.277 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.277+0000 7f9ec16059c0 20 started sync module instance, tier type = 2024-09-19T14:07:38.277 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.277+0000 7f9ec16059c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:07:38.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.297+0000 7f9ec16059c0 20 add_watcher() i=0 2024-09-19T14:07:38.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.297+0000 7f9ec16059c0 20 add_watcher() i=1 2024-09-19T14:07:38.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.297+0000 7f9ec16059c0 20 add_watcher() i=2 2024-09-19T14:07:38.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.297+0000 7f9ec16059c0 20 add_watcher() i=3 2024-09-19T14:07:38.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.297+0000 7f9ec16059c0 20 add_watcher() i=4 2024-09-19T14:07:38.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.297+0000 7f9ec16059c0 20 add_watcher() i=5 2024-09-19T14:07:38.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.297+0000 7f9ec16059c0 20 add_watcher() i=6 2024-09-19T14:07:38.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.301+0000 7f9ec16059c0 20 add_watcher() i=7 2024-09-19T14:07:38.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.301+0000 7f9ec16059c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:07:38.305 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.305+0000 7f9d75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:38.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.305+0000 7f9ec16059c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:07:38.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.305+0000 7f9ec16059c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:07:38.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.305+0000 7f9ec16059c0 5 note: GC not initialized 2024-09-19T14:07:38.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.305+0000 7f9d74fe1640 20 reqs_thread_entry: start 2024-09-19T14:07:38.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.305+0000 7f9ec16059c0 20 init_complete bucket index max shards: 11 2024-09-19T14:07:38.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.305+0000 7f9ec16059c0 20 Filter name: none 2024-09-19T14:07:38.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.305+0000 7f9cee7fc640 20 reqs_thread_entry: start 2024-09-19T14:07:38.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.305+0000 7f9ec16059c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-19T14:07:38.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.305+0000 7f9ec16059c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:38.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.305+0000 7f9ec16059c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-19T14:07:38.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.305+0000 7f9ec16059c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-19T14:07:38.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.305+0000 7f9ec16059c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-19T14:07:38.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.305+0000 7f9ec16059c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.26 : miss 2024-09-19T14:07:38.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.305+0000 7f9ec16059c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:38.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.309+0000 7f9ec16059c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-19T14:07:38.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.309+0000 7f9ec16059c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.26 info.flags=0x17 2024-09-19T14:07:38.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.309+0000 7f9ec16059c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.26 to cache LRU end 2024-09-19T14:07:38.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.309+0000 7f9ec16059c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:07:38.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.309+0000 7f9ec16059c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:38.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.309+0000 7f9ec16059c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.26 2024-09-19T14:07:38.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.317+0000 7f9ec16059c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.26 info.flags=0x17 2024-09-19T14:07:38.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.317+0000 7f9ec16059c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.26 to cache LRU end 2024-09-19T14:07:38.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.317+0000 7f9ec16059c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:38.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.317+0000 7f9ec16059c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.26, ofs0, ns] 2024-09-19T14:07:38.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.321+0000 7f9da27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333477 cookie 94221873954416 notifier 6380 bl.length()=939 2024-09-19T14:07:38.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.321+0000 7f9da27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.26 info.flags=0x17 2024-09-19T14:07:38.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.321+0000 7f9da27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.26 to cache LRU end 2024-09-19T14:07:38.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.321+0000 7f9da27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:38.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.321+0000 7f9ec16059c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.26]): orig_sources= new_sources= 2024-09-19T14:07:38.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.321+0000 7f9ec16059c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.26]): potential sources added=[] removed=[] 2024-09-19T14:07:38.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.321+0000 7f9ec16059c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.26]): orig_dests= new_dests= 2024-09-19T14:07:38.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.321+0000 7f9ec16059c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.26]): potential dests added=[] removed=[] 2024-09-19T14:07:38.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.321+0000 7f9ec16059c0 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-19T14:07:38.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.321+0000 7f9ec16059c0 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-19T14:07:38.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.325+0000 7f9ec16059c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1.0 2024-09-19T14:07:38.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.325+0000 7f9ec16059c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1.0 2024-09-19T14:07:38.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1.1 2024-09-19T14:07:38.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1.1 2024-09-19T14:07:38.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1.2 2024-09-19T14:07:38.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1.2 2024-09-19T14:07:38.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1.3 2024-09-19T14:07:38.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1.3 2024-09-19T14:07:38.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1.4 2024-09-19T14:07:38.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1.4 2024-09-19T14:07:38.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1.5 2024-09-19T14:07:38.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1.5 2024-09-19T14:07:38.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1.6 2024-09-19T14:07:38.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1.6 2024-09-19T14:07:38.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1.7 2024-09-19T14:07:38.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1.7 2024-09-19T14:07:38.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1.8 2024-09-19T14:07:38.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1.8 2024-09-19T14:07:38.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1.9 2024-09-19T14:07:38.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1.9 2024-09-19T14:07:38.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1.10 2024-09-19T14:07:38.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1.10 2024-09-19T14:07:38.331 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1.11 2024-09-19T14:07:38.331 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1.11 2024-09-19T14:07:38.331 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.0 2024-09-19T14:07:38.331 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.1 2024-09-19T14:07:38.331 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.2 2024-09-19T14:07:38.331 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.3 2024-09-19T14:07:38.332 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.329+0000 7f9ec16059c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.4 2024-09-19T14:07:38.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.333+0000 7f9ec16059c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.5 2024-09-19T14:07:38.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.333+0000 7f9ec16059c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.6 2024-09-19T14:07:38.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.333+0000 7f9ec16059c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.7 2024-09-19T14:07:38.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.333+0000 7f9ec16059c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.8 2024-09-19T14:07:38.336 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.333+0000 7f9ec16059c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.9 2024-09-19T14:07:38.337 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.337+0000 7f9ec16059c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.26.10 2024-09-19T14:07:38.346 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.345+0000 7f9ec16059c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.26 : hit (requested=0x17, cached=0x17) 2024-09-19T14:07:38.346 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.345+0000 7f9ec16059c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.26 2024-09-19T14:07:38.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.345+0000 7f9ec16059c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.26 info.flags=0x17 2024-09-19T14:07:38.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.345+0000 7f9ec16059c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.26 to cache LRU end 2024-09-19T14:07:38.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.345+0000 7f9ec16059c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:38.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.345+0000 7f9ec16059c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.26, ofs0, ns] 2024-09-19T14:07:38.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.345+0000 7f9da2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333478 cookie 94221873954416 notifier 6380 bl.length()=907 2024-09-19T14:07:38.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.345+0000 7f9da2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.26 info.flags=0x17 2024-09-19T14:07:38.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.345+0000 7f9da2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.26 to cache LRU end 2024-09-19T14:07:38.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.345+0000 7f9da2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:38.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.349+0000 7f9ec16059c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.26]): orig_sources= new_sources= 2024-09-19T14:07:38.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.349+0000 7f9ec16059c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.26]): potential sources added=[] removed=[] 2024-09-19T14:07:38.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.349+0000 7f9ec16059c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.26]): orig_dests= new_dests= 2024-09-19T14:07:38.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.349+0000 7f9ec16059c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.26]): potential dests added=[] removed=[] 2024-09-19T14:07:38.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.353+0000 7f9ec16059c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-19T14:07:38.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.357+0000 7f9d75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:38.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.361+0000 7f9ec16059c0 20 remove_watcher() i=0 2024-09-19T14:07:38.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.361+0000 7f9ec16059c0 2 removed watcher, disabling cache 2024-09-19T14:07:38.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.365+0000 7f9ec16059c0 20 remove_watcher() i=1 2024-09-19T14:07:38.367 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.365+0000 7f9ec16059c0 20 remove_watcher() i=2 2024-09-19T14:07:38.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.369+0000 7f9ec16059c0 20 remove_watcher() i=3 2024-09-19T14:07:38.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.369+0000 7f9ec16059c0 20 remove_watcher() i=4 2024-09-19T14:07:38.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.373+0000 7f9ec16059c0 20 remove_watcher() i=5 2024-09-19T14:07:38.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.373+0000 7f9ec16059c0 20 remove_watcher() i=6 2024-09-19T14:07:38.376 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.373+0000 7f9ec16059c0 20 remove_watcher() i=7 2024-09-19T14:07:38.392 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-19T14:07:38.422 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:07:38.422 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:07:38.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.465+0000 7f524b4149c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:38.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.465+0000 7f524b4149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:38.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.465+0000 7f524b4149c0 20 realm 2024-09-19T14:07:38.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.465+0000 7f524b4149c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:38.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.465+0000 7f524b4149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:38.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.465+0000 7f524b4149c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:07:38.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.465+0000 7f524b4149c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:38.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.465+0000 7f524b4149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:38.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.465+0000 7f524b4149c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:38.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.469+0000 7f524b4149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:38.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.469+0000 7f524b4149c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:38.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.469+0000 7f524b4149c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:07:38.470 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.469+0000 7f524b4149c0 20 searching for the correct realm 2024-09-19T14:07:38.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.473+0000 7f524971b640 0 -- 172.21.15.153:0/3085957293 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f5230027040 msgr2=0x7f523001aac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:38.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.481+0000 7f5248f1a640 0 -- 172.21.15.153:0/3085957293 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f523004a980 msgr2=0x7f523000c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:38.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.697+0000 7f524b4149c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:07:38.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.697+0000 7f524b4149c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:07:38.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.697+0000 7f524b4149c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:07:38.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.697+0000 7f524b4149c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:07:38.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.697+0000 7f524b4149c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:07:38.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.697+0000 7f524b4149c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:07:38.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.697+0000 7f524b4149c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:38.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.701+0000 7f524b4149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:38.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.701+0000 7f524b4149c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:38.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.701+0000 7f524b4149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:38.702 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.701+0000 7f524b4149c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:38.703 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.701+0000 7f524b4149c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:07:38.703 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.701+0000 7f524b4149c0 20 zone default found 2024-09-19T14:07:38.703 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.701+0000 7f524b4149c0 4 Realm: () 2024-09-19T14:07:38.703 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.701+0000 7f524b4149c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:07:38.703 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.701+0000 7f524b4149c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:07:38.703 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.701+0000 7f524b4149c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:07:38.703 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.701+0000 7f524b4149c0 20 zonegroup default 2024-09-19T14:07:38.703 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.701+0000 7f524b4149c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:38.704 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.701+0000 7f524b4149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:38.704 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.701+0000 7f524b4149c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:38.704 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.701+0000 7f524b4149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:38.704 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.701+0000 7f524b4149c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:38.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.705+0000 7f524b4149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:38.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.705+0000 7f524b4149c0 20 started sync module instance, tier type = 2024-09-19T14:07:38.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.705+0000 7f524b4149c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:07:38.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.725+0000 7f524b4149c0 20 add_watcher() i=0 2024-09-19T14:07:38.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.725+0000 7f524b4149c0 20 add_watcher() i=1 2024-09-19T14:07:38.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.725+0000 7f524b4149c0 20 add_watcher() i=2 2024-09-19T14:07:38.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.725+0000 7f524b4149c0 20 add_watcher() i=3 2024-09-19T14:07:38.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.725+0000 7f524b4149c0 20 add_watcher() i=4 2024-09-19T14:07:38.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.725+0000 7f524b4149c0 20 add_watcher() i=5 2024-09-19T14:07:38.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.725+0000 7f524b4149c0 20 add_watcher() i=6 2024-09-19T14:07:38.731 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.729+0000 7f524b4149c0 20 add_watcher() i=7 2024-09-19T14:07:38.731 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.729+0000 7f524b4149c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:07:38.735 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.733+0000 7f50ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:38.736 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.733+0000 7f524b4149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:07:38.736 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.733+0000 7f524b4149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:07:38.736 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.733+0000 7f524b4149c0 5 note: GC not initialized 2024-09-19T14:07:38.737 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.737+0000 7f50fe7e4640 20 reqs_thread_entry: start 2024-09-19T14:07:38.737 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.737+0000 7f524b4149c0 20 init_complete bucket index max shards: 11 2024-09-19T14:07:38.737 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.737+0000 7f524b4149c0 20 Filter name: none 2024-09-19T14:07:38.738 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.737+0000 7f50f77fe640 20 reqs_thread_entry: start 2024-09-19T14:07:38.738 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.737+0000 7f524b4149c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:38.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.737+0000 7f524b4149c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-19T14:07:38.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.737+0000 7f524b4149c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:38.740 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.737+0000 7f524b4149c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-19T14:07:38.740 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.737+0000 7f524b4149c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:07:38.740 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.737+0000 7f524b4149c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:38.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.741+0000 7f524b4149c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-19T14:07:38.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.741+0000 7f524b4149c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:38.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.741+0000 7f524b4149c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-19T14:07:38.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.741+0000 7f524b4149c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:07:38.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.741+0000 7f50ff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:38.749 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.749+0000 7f524b4149c0 20 remove_watcher() i=0 2024-09-19T14:07:38.749 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.749+0000 7f524b4149c0 2 removed watcher, disabling cache 2024-09-19T14:07:38.752 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.749+0000 7f524b4149c0 20 remove_watcher() i=1 2024-09-19T14:07:38.754 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.753+0000 7f524b4149c0 20 remove_watcher() i=2 2024-09-19T14:07:38.755 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.753+0000 7f524b4149c0 20 remove_watcher() i=3 2024-09-19T14:07:38.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.757+0000 7f524b4149c0 20 remove_watcher() i=4 2024-09-19T14:07:38.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.757+0000 7f524b4149c0 20 remove_watcher() i=5 2024-09-19T14:07:38.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.757+0000 7f524b4149c0 20 remove_watcher() i=6 2024-09-19T14:07:38.762 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:38.761+0000 7f524b4149c0 20 remove_watcher() i=7 2024-09-19T14:07:38.778 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:38.778 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:07:38.779 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-trim-reshard-log-entries id: dbb1da81-49d0-421a-b677-974869a7f103.4620.26 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-19T14:07:38.779 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:38.780 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:38.780 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:38.809 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:38.810 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:39.398 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:39.398 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:39.764 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-19T14:07:39.764 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:39.767 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:39.767 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:39.902 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:39.902 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:39.993 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:39.993 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:40.100 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:40.100 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:40.200 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:40.200 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:40.301 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:40.302 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:40.404 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:40.404 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:40.505 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:40.505 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:40.607 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:40.607 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:40.705 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:40.706 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:40.804 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:40.804 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:40.902 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:40.903 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:41.001 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:41.001 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:41.102 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:41.103 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:41.196 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:41.196 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:41.290 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:41.290 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:41.394 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:41.394 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:41.490 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:41.490 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:41.589 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:41.589 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:41.689 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:41.689 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:41.788 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:41.789 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:41.887 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:41.888 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:41.984 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-19T14:07:42.016 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:07:42.016 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:07:42.061 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.060+0000 7f933e49e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.063 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.060+0000 7f933e49e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.063 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.060+0000 7f933e49e9c0 20 realm 2024-09-19T14:07:42.063 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.060+0000 7f933e49e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.060+0000 7f933e49e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.060+0000 7f933e49e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:07:42.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.060+0000 7f933e49e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.060+0000 7f933e49e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.060+0000 7f933e49e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.065 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.064+0000 7f933e49e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:42.065 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.064+0000 7f933e49e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.065 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.064+0000 7f933e49e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:07:42.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.064+0000 7f933e49e9c0 20 searching for the correct realm 2024-09-19T14:07:42.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.068+0000 7f933b7a3640 0 -- 172.21.15.153:0/3134500822 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x55b07d03f660 msgr2=0x55b07d041a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:42.077 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.076+0000 7f933bfa4640 0 -- 172.21.15.153:0/3134500822 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f933003b960 msgr2=0x7f933006a130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:42.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.084+0000 7f933e49e9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:07:42.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.084+0000 7f933e49e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:07:42.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.084+0000 7f933e49e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:07:42.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.084+0000 7f933e49e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:07:42.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.084+0000 7f933e49e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:07:42.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.084+0000 7f933e49e9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:07:42.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.084+0000 7f933e49e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.084+0000 7f933e49e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.084+0000 7f933e49e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.084+0000 7f933e49e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:42.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.084+0000 7f933e49e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.084+0000 7f933e49e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:07:42.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.084+0000 7f933e49e9c0 20 zone default found 2024-09-19T14:07:42.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.084+0000 7f933e49e9c0 4 Realm: () 2024-09-19T14:07:42.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.084+0000 7f933e49e9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:07:42.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.084+0000 7f933e49e9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:07:42.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.084+0000 7f933e49e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:07:42.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.084+0000 7f933e49e9c0 20 zonegroup default 2024-09-19T14:07:42.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.084+0000 7f933e49e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.084+0000 7f933e49e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.084+0000 7f933e49e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.088+0000 7f933e49e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.088+0000 7f933e49e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.088+0000 7f933e49e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.088+0000 7f933e49e9c0 20 started sync module instance, tier type = 2024-09-19T14:07:42.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.088+0000 7f933e49e9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:07:42.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.104+0000 7f933e49e9c0 20 add_watcher() i=0 2024-09-19T14:07:42.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.104+0000 7f933e49e9c0 20 add_watcher() i=1 2024-09-19T14:07:42.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.104+0000 7f933e49e9c0 20 add_watcher() i=2 2024-09-19T14:07:42.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.104+0000 7f933e49e9c0 20 add_watcher() i=3 2024-09-19T14:07:42.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.104+0000 7f933e49e9c0 20 add_watcher() i=4 2024-09-19T14:07:42.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.104+0000 7f933e49e9c0 20 add_watcher() i=5 2024-09-19T14:07:42.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.104+0000 7f933e49e9c0 20 add_watcher() i=6 2024-09-19T14:07:42.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.104+0000 7f933e49e9c0 20 add_watcher() i=7 2024-09-19T14:07:42.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.104+0000 7f933e49e9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:07:42.109 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.108+0000 7f91f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:42.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.108+0000 7f933e49e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:07:42.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.108+0000 7f933e49e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:07:42.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.108+0000 7f933e49e9c0 5 note: GC not initialized 2024-09-19T14:07:42.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.108+0000 7f91f0fe1640 20 reqs_thread_entry: start 2024-09-19T14:07:42.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.108+0000 7f933e49e9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:07:42.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.108+0000 7f933e49e9c0 20 Filter name: none 2024-09-19T14:07:42.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.108+0000 7f916a7fc640 20 reqs_thread_entry: start 2024-09-19T14:07:42.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.108+0000 7f933e49e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.108+0000 7f933e49e9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-19T14:07:42.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.108+0000 7f933e49e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.112 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.108+0000 7f933e49e9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-19T14:07:42.112 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.108+0000 7f933e49e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:07:42.112 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.108+0000 7f933e49e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.112+0000 7f933e49e9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-19T14:07:42.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.112+0000 7f933e49e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.112+0000 7f933e49e9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-19T14:07:42.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.112+0000 7f933e49e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:07:42.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.116+0000 7f91f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:42.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.120+0000 7f933e49e9c0 20 remove_watcher() i=0 2024-09-19T14:07:42.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.120+0000 7f933e49e9c0 2 removed watcher, disabling cache 2024-09-19T14:07:42.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.120+0000 7f933e49e9c0 20 remove_watcher() i=1 2024-09-19T14:07:42.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.124+0000 7f933e49e9c0 20 remove_watcher() i=2 2024-09-19T14:07:42.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.124+0000 7f933e49e9c0 20 remove_watcher() i=3 2024-09-19T14:07:42.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.128+0000 7f933e49e9c0 20 remove_watcher() i=4 2024-09-19T14:07:42.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.128+0000 7f933e49e9c0 20 remove_watcher() i=5 2024-09-19T14:07:42.132 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.128+0000 7f933e49e9c0 20 remove_watcher() i=6 2024-09-19T14:07:42.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.132+0000 7f933e49e9c0 20 remove_watcher() i=7 2024-09-19T14:07:42.146 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.146 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:07:42.146 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: abort-at-trim-reshard-log-entries id: dbb1da81-49d0-421a-b677-974869a7f103.4620.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:07:42.146 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.147 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-19T14:07:42.179 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:07:42.179 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:07:42.222 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.220+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.220+0000 7f91366679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.220+0000 7f91366679c0 20 realm 2024-09-19T14:07:42.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.220+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.220+0000 7f91366679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.220+0000 7f91366679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:07:42.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.220+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.220+0000 7f91366679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.220+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.224+0000 7f91366679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:42.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.224+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.224+0000 7f91366679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:07:42.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.224+0000 7f91366679c0 20 searching for the correct realm 2024-09-19T14:07:42.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.232+0000 7f913496e640 0 -- 172.21.15.153:0/4223309757 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7f9128135230 msgr2=0x7f9128101710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:42.451 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.448+0000 7f913416d640 0 -- 172.21.15.153:0/4223309757 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x55b833691030 msgr2=0x55b833693420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:42.459 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.456+0000 7f91366679c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:07:42.459 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.456+0000 7f91366679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:07:42.459 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.456+0000 7f91366679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:07:42.459 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.456+0000 7f91366679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:07:42.459 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.456+0000 7f91366679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:07:42.459 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.456+0000 7f91366679c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:07:42.459 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.456+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.456+0000 7f91366679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.456+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.456+0000 7f91366679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:42.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.456+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.461 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.460+0000 7f91366679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:07:42.461 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.460+0000 7f91366679c0 20 zone default found 2024-09-19T14:07:42.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.460+0000 7f91366679c0 4 Realm: () 2024-09-19T14:07:42.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.460+0000 7f91366679c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:07:42.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.460+0000 7f91366679c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:07:42.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.460+0000 7f91366679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:07:42.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.460+0000 7f91366679c0 20 zonegroup default 2024-09-19T14:07:42.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.460+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.460+0000 7f91366679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.460+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.460+0000 7f91366679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.460+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.464 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.460+0000 7f91366679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.464 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.460+0000 7f91366679c0 20 started sync module instance, tier type = 2024-09-19T14:07:42.464 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.460+0000 7f91366679c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:07:42.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.484+0000 7f91366679c0 20 add_watcher() i=0 2024-09-19T14:07:42.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.484+0000 7f91366679c0 20 add_watcher() i=1 2024-09-19T14:07:42.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.484+0000 7f91366679c0 20 add_watcher() i=2 2024-09-19T14:07:42.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.484+0000 7f91366679c0 20 add_watcher() i=3 2024-09-19T14:07:42.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.484+0000 7f91366679c0 20 add_watcher() i=4 2024-09-19T14:07:42.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.484+0000 7f91366679c0 20 add_watcher() i=5 2024-09-19T14:07:42.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.484+0000 7f91366679c0 20 add_watcher() i=6 2024-09-19T14:07:42.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.488+0000 7f91366679c0 20 add_watcher() i=7 2024-09-19T14:07:42.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.488+0000 7f91366679c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:07:42.493 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.492+0000 7f8feafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:42.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.492+0000 7f91366679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:07:42.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.492+0000 7f91366679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:07:42.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.492+0000 7f91366679c0 5 note: GC not initialized 2024-09-19T14:07:42.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.492+0000 7f8fe9fdb640 20 reqs_thread_entry: start 2024-09-19T14:07:42.495 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.492+0000 7f91366679c0 20 init_complete bucket index max shards: 11 2024-09-19T14:07:42.495 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.492+0000 7f91366679c0 20 Filter name: none 2024-09-19T14:07:42.495 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.492+0000 7f8f5b7fe640 20 reqs_thread_entry: start 2024-09-19T14:07:42.495 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.492+0000 7f91366679c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-19T14:07:42.495 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.492+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.496 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.492+0000 7f91366679c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-19T14:07:42.496 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.492+0000 7f91366679c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-19T14:07:42.496 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.492+0000 7f91366679c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-19T14:07:42.496 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.492+0000 7f91366679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 : miss 2024-09-19T14:07:42.496 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.492+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.496+0000 7f91366679c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-19T14:07:42.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.496+0000 7f91366679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 info.flags=0x17 2024-09-19T14:07:42.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.496+0000 7f91366679c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 to cache LRU end 2024-09-19T14:07:42.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.496+0000 7f91366679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:07:42.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.496+0000 7f91366679c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:42.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.496+0000 7f91366679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 2024-09-19T14:07:42.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.508+0000 7f91366679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 info.flags=0x17 2024-09-19T14:07:42.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.508+0000 7f91366679c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 to cache LRU end 2024-09-19T14:07:42.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.508+0000 7f91366679c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:42.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.508+0000 7f91366679c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27, ofs0, ns] 2024-09-19T14:07:42.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.508+0000 7f900b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333521 cookie 94249624871424 notifier 6849 bl.length()=939 2024-09-19T14:07:42.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.508+0000 7f900b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 info.flags=0x17 2024-09-19T14:07:42.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.508+0000 7f900b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 to cache LRU end 2024-09-19T14:07:42.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.508+0000 7f900b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:42.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.508+0000 7f91366679c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.27]): orig_sources= new_sources= 2024-09-19T14:07:42.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.508+0000 7f91366679c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.27]): potential sources added=[] removed=[] 2024-09-19T14:07:42.513 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.508+0000 7f91366679c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.27]): orig_dests= new_dests= 2024-09-19T14:07:42.513 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.508+0000 7f91366679c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.27]): potential dests added=[] removed=[] 2024-09-19T14:07:42.513 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f91366679c0 time 2024-09-19T14:07:42.515601+0000 2024-09-19T14:07:42.513 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:07:42.515 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:07:42.515 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9139f412eb] 2024-09-19T14:07:42.515 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9139f4149f] 2024-09-19T14:07:42.515 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b83151d271] 2024-09-19T14:07:42.515 INFO:tasks.workunit.client.0.smithi153.stderr: 4: radosgw-admin(+0x141050e) [0x55b831f6e50e] 2024-09-19T14:07:42.515 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b83152d0dd] 2024-09-19T14:07:42.515 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:07:42.515 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9138da7d90] 2024-09-19T14:07:42.515 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:07:42.515 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:07:42.515 INFO:tasks.workunit.client.0.smithi153.stderr:*** Caught signal (Aborted) ** 2024-09-19T14:07:42.515 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7f91366679c0 thread_name:radosgw-admin 2024-09-19T14:07:42.516 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.512+0000 7f91366679c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f91366679c0 time 2024-09-19T14:07:42.515601+0000 2024-09-19T14:07:42.516 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:07:42.516 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.516 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:07:42.516 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9139f412eb] 2024-09-19T14:07:42.516 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9139f4149f] 2024-09-19T14:07:42.516 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b83151d271] 2024-09-19T14:07:42.516 INFO:tasks.workunit.client.0.smithi153.stderr: 4: radosgw-admin(+0x141050e) [0x55b831f6e50e] 2024-09-19T14:07:42.516 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b83152d0dd] 2024-09-19T14:07:42.516 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:07:42.517 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9138da7d90] 2024-09-19T14:07:42.517 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:07:42.517 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:07:42.517 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.535 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:07:42.535 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9138dc0520] 2024-09-19T14:07:42.535 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:07:42.535 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:07:42.535 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:07:42.535 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9139f41345] 2024-09-19T14:07:42.535 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9139f4149f] 2024-09-19T14:07:42.535 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b83151d271] 2024-09-19T14:07:42.536 INFO:tasks.workunit.client.0.smithi153.stderr: 8: radosgw-admin(+0x141050e) [0x55b831f6e50e] 2024-09-19T14:07:42.536 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b83152d0dd] 2024-09-19T14:07:42.536 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:07:42.536 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9138da7d90] 2024-09-19T14:07:42.536 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:07:42.536 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:07:42.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.512+0000 7f91366679c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:07:42.536 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7f91366679c0 thread_name:radosgw-admin 2024-09-19T14:07:42.536 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.537 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:07:42.537 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9138dc0520] 2024-09-19T14:07:42.537 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:07:42.537 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:07:42.537 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:07:42.537 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9139f41345] 2024-09-19T14:07:42.537 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9139f4149f] 2024-09-19T14:07:42.537 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b83151d271] 2024-09-19T14:07:42.537 INFO:tasks.workunit.client.0.smithi153.stderr: 8: radosgw-admin(+0x141050e) [0x55b831f6e50e] 2024-09-19T14:07:42.537 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b83152d0dd] 2024-09-19T14:07:42.537 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:07:42.537 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9138da7d90] 2024-09-19T14:07:42.537 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:07:42.538 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:07:42.538 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:07:42.538 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.538 INFO:tasks.workunit.client.0.smithi153.stderr:--- begin dump of recent events --- 2024-09-19T14:07:42.538 INFO:tasks.workunit.client.0.smithi153.stderr: -499> 2024-09-19T14:07:42.196+0000 7f902260c640 10 monclient: _finish_auth 0 2024-09-19T14:07:42.538 INFO:tasks.workunit.client.0.smithi153.stderr: -498> 2024-09-19T14:07:42.196+0000 7f902260c640 10 monclient: _check_auth_tickets 2024-09-19T14:07:42.538 INFO:tasks.workunit.client.0.smithi153.stderr: -497> 2024-09-19T14:07:42.196+0000 7f91366679c0 5 monclient: authenticate success, global_id 6837 2024-09-19T14:07:42.538 INFO:tasks.workunit.client.0.smithi153.stderr: -496> 2024-09-19T14:07:42.196+0000 7f902260c640 10 monclient: handle_config config(0 keys) 2024-09-19T14:07:42.538 INFO:tasks.workunit.client.0.smithi153.stderr: -495> 2024-09-19T14:07:42.196+0000 7f91366679c0 10 monclient: get_monmap_and_config success 2024-09-19T14:07:42.538 INFO:tasks.workunit.client.0.smithi153.stderr: -494> 2024-09-19T14:07:42.196+0000 7f91366679c0 4 set_mon_vals no callback set 2024-09-19T14:07:42.538 INFO:tasks.workunit.client.0.smithi153.stderr: -493> 2024-09-19T14:07:42.196+0000 7f902260c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:07:42.538 INFO:tasks.workunit.client.0.smithi153.stderr: -492> 2024-09-19T14:07:42.196+0000 7f902260c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:07:42.538 INFO:tasks.workunit.client.0.smithi153.stderr: -491> 2024-09-19T14:07:42.196+0000 7f902260c640 10 monclient: dump: 2024-09-19T14:07:42.538 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:07:42.538 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:07:42.539 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.539 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.539 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:07:42.539 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.539 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:07:42.539 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:07:42.539 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:07:42.539 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.539 INFO:tasks.workunit.client.0.smithi153.stderr: -490> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient: shutdown 2024-09-19T14:07:42.539 INFO:tasks.workunit.client.0.smithi153.stderr: -489> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 asok(0x55b833398d90) unregister_commands rotate-key 2024-09-19T14:07:42.539 INFO:tasks.workunit.client.0.smithi153.stderr: -488> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient: build_initial_monmap 2024-09-19T14:07:42.539 INFO:tasks.workunit.client.0.smithi153.stderr: -487> 2024-09-19T14:07:42.200+0000 7f91366679c0 1 build_initial for_mkfs: 0 2024-09-19T14:07:42.539 INFO:tasks.workunit.client.0.smithi153.stderr: -486> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient: monmap: 2024-09-19T14:07:42.539 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:07:42.539 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:07:42.540 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:07:42.540 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:07:42.540 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:07:42.540 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.540 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:07:42.540 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:07:42.540 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:07:42.540 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.540 INFO:tasks.workunit.client.0.smithi153.stderr: -485> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding auth protocol: cephx 2024-09-19T14:07:42.540 INFO:tasks.workunit.client.0.smithi153.stderr: -484> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding auth protocol: cephx 2024-09-19T14:07:42.540 INFO:tasks.workunit.client.0.smithi153.stderr: -483> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding auth protocol: cephx 2024-09-19T14:07:42.540 INFO:tasks.workunit.client.0.smithi153.stderr: -482> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding con mode: secure 2024-09-19T14:07:42.540 INFO:tasks.workunit.client.0.smithi153.stderr: -481> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding con mode: crc 2024-09-19T14:07:42.540 INFO:tasks.workunit.client.0.smithi153.stderr: -480> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding con mode: secure 2024-09-19T14:07:42.541 INFO:tasks.workunit.client.0.smithi153.stderr: -479> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding con mode: crc 2024-09-19T14:07:42.541 INFO:tasks.workunit.client.0.smithi153.stderr: -478> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding con mode: secure 2024-09-19T14:07:42.541 INFO:tasks.workunit.client.0.smithi153.stderr: -477> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding con mode: crc 2024-09-19T14:07:42.541 INFO:tasks.workunit.client.0.smithi153.stderr: -476> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding con mode: crc 2024-09-19T14:07:42.541 INFO:tasks.workunit.client.0.smithi153.stderr: -475> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding con mode: secure 2024-09-19T14:07:42.541 INFO:tasks.workunit.client.0.smithi153.stderr: -474> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding con mode: crc 2024-09-19T14:07:42.541 INFO:tasks.workunit.client.0.smithi153.stderr: -473> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding con mode: secure 2024-09-19T14:07:42.541 INFO:tasks.workunit.client.0.smithi153.stderr: -472> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding con mode: crc 2024-09-19T14:07:42.541 INFO:tasks.workunit.client.0.smithi153.stderr: -471> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding con mode: secure 2024-09-19T14:07:42.541 INFO:tasks.workunit.client.0.smithi153.stderr: -470> 2024-09-19T14:07:42.200+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.541 INFO:tasks.workunit.client.0.smithi153.stderr: -469> 2024-09-19T14:07:42.200+0000 7f91366679c0 1 librados: starting msgr at 2024-09-19T14:07:42.541 INFO:tasks.workunit.client.0.smithi153.stderr: -468> 2024-09-19T14:07:42.200+0000 7f91366679c0 1 librados: starting objecter 2024-09-19T14:07:42.541 INFO:tasks.workunit.client.0.smithi153.stderr: -467> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 asok(0x55b833398d90) register_command objecter_requests hook 0x55b8333c0460 2024-09-19T14:07:42.541 INFO:tasks.workunit.client.0.smithi153.stderr: -466> 2024-09-19T14:07:42.200+0000 7f91366679c0 1 librados: setting wanted keys 2024-09-19T14:07:42.542 INFO:tasks.workunit.client.0.smithi153.stderr: -465> 2024-09-19T14:07:42.200+0000 7f91366679c0 1 librados: calling monclient init 2024-09-19T14:07:42.542 INFO:tasks.workunit.client.0.smithi153.stderr: -464> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient: init 2024-09-19T14:07:42.542 INFO:tasks.workunit.client.0.smithi153.stderr: -463> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding auth protocol: cephx 2024-09-19T14:07:42.542 INFO:tasks.workunit.client.0.smithi153.stderr: -462> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding auth protocol: cephx 2024-09-19T14:07:42.542 INFO:tasks.workunit.client.0.smithi153.stderr: -461> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding auth protocol: cephx 2024-09-19T14:07:42.542 INFO:tasks.workunit.client.0.smithi153.stderr: -460> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding con mode: secure 2024-09-19T14:07:42.542 INFO:tasks.workunit.client.0.smithi153.stderr: -459> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding con mode: crc 2024-09-19T14:07:42.542 INFO:tasks.workunit.client.0.smithi153.stderr: -458> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding con mode: secure 2024-09-19T14:07:42.542 INFO:tasks.workunit.client.0.smithi153.stderr: -457> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding con mode: crc 2024-09-19T14:07:42.542 INFO:tasks.workunit.client.0.smithi153.stderr: -456> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding con mode: secure 2024-09-19T14:07:42.542 INFO:tasks.workunit.client.0.smithi153.stderr: -455> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding con mode: crc 2024-09-19T14:07:42.542 INFO:tasks.workunit.client.0.smithi153.stderr: -454> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding con mode: crc 2024-09-19T14:07:42.542 INFO:tasks.workunit.client.0.smithi153.stderr: -453> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding con mode: secure 2024-09-19T14:07:42.542 INFO:tasks.workunit.client.0.smithi153.stderr: -452> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding con mode: crc 2024-09-19T14:07:42.542 INFO:tasks.workunit.client.0.smithi153.stderr: -451> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding con mode: secure 2024-09-19T14:07:42.542 INFO:tasks.workunit.client.0.smithi153.stderr: -450> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding con mode: crc 2024-09-19T14:07:42.543 INFO:tasks.workunit.client.0.smithi153.stderr: -449> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding con mode: secure 2024-09-19T14:07:42.543 INFO:tasks.workunit.client.0.smithi153.stderr: -448> 2024-09-19T14:07:42.200+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.543 INFO:tasks.workunit.client.0.smithi153.stderr: -447> 2024-09-19T14:07:42.200+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.543 INFO:tasks.workunit.client.0.smithi153.stderr: -446> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 asok(0x55b833398d90) register_command rotate-key hook 0x55b8335a4718 2024-09-19T14:07:42.543 INFO:tasks.workunit.client.0.smithi153.stderr: -445> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient: _reopen_session rank -1 2024-09-19T14:07:42.543 INFO:tasks.workunit.client.0.smithi153.stderr: -444> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:07:42.543 INFO:tasks.workunit.client.0.smithi153.stderr: -443> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient(hunting): picked mon.noname-b con 0x55b833431410 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:07:42.543 INFO:tasks.workunit.client.0.smithi153.stderr: -442> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient(hunting): picked mon.noname-a con 0x55b8334320f0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:07:42.543 INFO:tasks.workunit.client.0.smithi153.stderr: -441> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient(hunting): picked mon.noname-c con 0x55b8335aadb0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:07:42.543 INFO:tasks.workunit.client.0.smithi153.stderr: -440> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:07:42.543 INFO:tasks.workunit.client.0.smithi153.stderr: -439> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:07:42.543 INFO:tasks.workunit.client.0.smithi153.stderr: -438> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:07:42.543 INFO:tasks.workunit.client.0.smithi153.stderr: -437> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient(hunting): _renew_subs 2024-09-19T14:07:42.543 INFO:tasks.workunit.client.0.smithi153.stderr: -436> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient(hunting): authenticate will time out at 2650.666018s 2024-09-19T14:07:42.543 INFO:tasks.workunit.client.0.smithi153.stderr: -435> 2024-09-19T14:07:42.200+0000 7f913396c640 10 monclient(hunting): get_auth_request con 0x55b8334320f0 auth_method 0 2024-09-19T14:07:42.544 INFO:tasks.workunit.client.0.smithi153.stderr: -434> 2024-09-19T14:07:42.200+0000 7f913396c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:07:42.544 INFO:tasks.workunit.client.0.smithi153.stderr: -433> 2024-09-19T14:07:42.200+0000 7f913396c640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:07:42.544 INFO:tasks.workunit.client.0.smithi153.stderr: -432> 2024-09-19T14:07:42.200+0000 7f913396c640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:07:42.544 INFO:tasks.workunit.client.0.smithi153.stderr: -431> 2024-09-19T14:07:42.200+0000 7f913496e640 10 monclient(hunting): get_auth_request con 0x55b8335aadb0 auth_method 0 2024-09-19T14:07:42.544 INFO:tasks.workunit.client.0.smithi153.stderr: -430> 2024-09-19T14:07:42.200+0000 7f913496e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:07:42.544 INFO:tasks.workunit.client.0.smithi153.stderr: -429> 2024-09-19T14:07:42.200+0000 7f913496e640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:07:42.544 INFO:tasks.workunit.client.0.smithi153.stderr: -428> 2024-09-19T14:07:42.200+0000 7f913496e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:07:42.544 INFO:tasks.workunit.client.0.smithi153.stderr: -427> 2024-09-19T14:07:42.200+0000 7f913396c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:07:42.544 INFO:tasks.workunit.client.0.smithi153.stderr: -426> 2024-09-19T14:07:42.200+0000 7f913396c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:07:42.544 INFO:tasks.workunit.client.0.smithi153.stderr: -425> 2024-09-19T14:07:42.200+0000 7f913396c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:07:42.544 INFO:tasks.workunit.client.0.smithi153.stderr: -424> 2024-09-19T14:07:42.200+0000 7f913496e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:07:42.544 INFO:tasks.workunit.client.0.smithi153.stderr: -423> 2024-09-19T14:07:42.200+0000 7f913496e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:07:42.544 INFO:tasks.workunit.client.0.smithi153.stderr: -422> 2024-09-19T14:07:42.200+0000 7f913496e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:07:42.544 INFO:tasks.workunit.client.0.smithi153.stderr: -421> 2024-09-19T14:07:42.200+0000 7f913416d640 10 monclient(hunting): get_auth_request con 0x55b833431410 auth_method 0 2024-09-19T14:07:42.545 INFO:tasks.workunit.client.0.smithi153.stderr: -420> 2024-09-19T14:07:42.200+0000 7f913416d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:07:42.545 INFO:tasks.workunit.client.0.smithi153.stderr: -419> 2024-09-19T14:07:42.200+0000 7f913416d640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:07:42.545 INFO:tasks.workunit.client.0.smithi153.stderr: -418> 2024-09-19T14:07:42.200+0000 7f913416d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:07:42.545 INFO:tasks.workunit.client.0.smithi153.stderr: -417> 2024-09-19T14:07:42.200+0000 7f913396c640 10 monclient(hunting): handle_auth_done global_id 6840 payload 824 2024-09-19T14:07:42.545 INFO:tasks.workunit.client.0.smithi153.stderr: -416> 2024-09-19T14:07:42.200+0000 7f913396c640 10 monclient: _finish_hunting 0 2024-09-19T14:07:42.545 INFO:tasks.workunit.client.0.smithi153.stderr: -415> 2024-09-19T14:07:42.200+0000 7f913396c640 1 monclient: found mon.noname-a 2024-09-19T14:07:42.545 INFO:tasks.workunit.client.0.smithi153.stderr: -414> 2024-09-19T14:07:42.200+0000 7f913396c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:07:42.545 INFO:tasks.workunit.client.0.smithi153.stderr: -413> 2024-09-19T14:07:42.200+0000 7f9020e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:07:42.545 INFO:tasks.workunit.client.0.smithi153.stderr: -412> 2024-09-19T14:07:42.200+0000 7f9020e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:07:42.545 INFO:tasks.workunit.client.0.smithi153.stderr: -411> 2024-09-19T14:07:42.200+0000 7f9020e09640 10 monclient: dump: 2024-09-19T14:07:42.545 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:07:42.545 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:07:42.545 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.545 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.545 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:07:42.546 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.546 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:07:42.546 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:07:42.546 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:07:42.546 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.546 INFO:tasks.workunit.client.0.smithi153.stderr: -410> 2024-09-19T14:07:42.200+0000 7f9020e09640 10 monclient: _finish_auth 0 2024-09-19T14:07:42.546 INFO:tasks.workunit.client.0.smithi153.stderr: -409> 2024-09-19T14:07:42.200+0000 7f9020e09640 10 monclient: _check_auth_tickets 2024-09-19T14:07:42.546 INFO:tasks.workunit.client.0.smithi153.stderr: -408> 2024-09-19T14:07:42.200+0000 7f9020e09640 10 monclient: handle_config config(0 keys) 2024-09-19T14:07:42.546 INFO:tasks.workunit.client.0.smithi153.stderr: -407> 2024-09-19T14:07:42.200+0000 7f9020e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:07:42.546 INFO:tasks.workunit.client.0.smithi153.stderr: -406> 2024-09-19T14:07:42.200+0000 7f9020e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:07:42.546 INFO:tasks.workunit.client.0.smithi153.stderr: -405> 2024-09-19T14:07:42.200+0000 7f9020e09640 10 monclient: dump: 2024-09-19T14:07:42.546 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:07:42.546 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:07:42.546 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.547 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.547 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:07:42.547 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.547 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:07:42.547 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:07:42.547 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:07:42.547 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.547 INFO:tasks.workunit.client.0.smithi153.stderr: -404> 2024-09-19T14:07:42.200+0000 7f902260c640 4 set_mon_vals no callback set 2024-09-19T14:07:42.547 INFO:tasks.workunit.client.0.smithi153.stderr: -403> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 monclient: authenticate success, global_id 6840 2024-09-19T14:07:42.547 INFO:tasks.workunit.client.0.smithi153.stderr: -402> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient: _renew_subs 2024-09-19T14:07:42.547 INFO:tasks.workunit.client.0.smithi153.stderr: -401> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:07:42.547 INFO:tasks.workunit.client.0.smithi153.stderr: -400> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient: _renew_subs 2024-09-19T14:07:42.548 INFO:tasks.workunit.client.0.smithi153.stderr: -399> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:07:42.548 INFO:tasks.workunit.client.0.smithi153.stderr: -398> 2024-09-19T14:07:42.200+0000 7f91366679c0 1 librados: init done 2024-09-19T14:07:42.548 INFO:tasks.workunit.client.0.smithi153.stderr: -397> 2024-09-19T14:07:42.204+0000 7f9020e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:07:42.548 INFO:tasks.workunit.client.0.smithi153.stderr: -396> 2024-09-19T14:07:42.204+0000 7f9020e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:07:42.548 INFO:tasks.workunit.client.0.smithi153.stderr: -395> 2024-09-19T14:07:42.204+0000 7f9020e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:07:42.548 INFO:tasks.workunit.client.0.smithi153.stderr: -394> 2024-09-19T14:07:42.204+0000 7f913416d640 10 monclient: get_auth_request con 0x7f901c071c10 auth_method 0 2024-09-19T14:07:42.548 INFO:tasks.workunit.client.0.smithi153.stderr: -393> 2024-09-19T14:07:42.204+0000 7f913496e640 10 monclient: get_auth_request con 0x55b8335e2de0 auth_method 0 2024-09-19T14:07:42.548 INFO:tasks.workunit.client.0.smithi153.stderr: -392> 2024-09-19T14:07:42.204+0000 7f913416d640 10 monclient: get_auth_request con 0x55b8335ef890 auth_method 0 2024-09-19T14:07:42.548 INFO:tasks.workunit.client.0.smithi153.stderr: -391> 2024-09-19T14:07:42.208+0000 7f913396c640 10 monclient: get_auth_request con 0x55b8335f3110 auth_method 0 2024-09-19T14:07:42.548 INFO:tasks.workunit.client.0.smithi153.stderr: -390> 2024-09-19T14:07:42.208+0000 7f91366679c0 10 monclient: build_initial_monmap 2024-09-19T14:07:42.548 INFO:tasks.workunit.client.0.smithi153.stderr: -389> 2024-09-19T14:07:42.208+0000 7f91366679c0 1 build_initial for_mkfs: 0 2024-09-19T14:07:42.548 INFO:tasks.workunit.client.0.smithi153.stderr: -388> 2024-09-19T14:07:42.208+0000 7f91366679c0 10 monclient: monmap: 2024-09-19T14:07:42.548 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:07:42.548 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:07:42.548 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:07:42.549 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:07:42.549 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:07:42.549 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.549 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:07:42.549 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:07:42.549 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:07:42.549 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.549 INFO:tasks.workunit.client.0.smithi153.stderr: -387> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding auth protocol: cephx 2024-09-19T14:07:42.549 INFO:tasks.workunit.client.0.smithi153.stderr: -386> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding auth protocol: cephx 2024-09-19T14:07:42.549 INFO:tasks.workunit.client.0.smithi153.stderr: -385> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding auth protocol: cephx 2024-09-19T14:07:42.549 INFO:tasks.workunit.client.0.smithi153.stderr: -384> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding con mode: secure 2024-09-19T14:07:42.549 INFO:tasks.workunit.client.0.smithi153.stderr: -383> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding con mode: crc 2024-09-19T14:07:42.549 INFO:tasks.workunit.client.0.smithi153.stderr: -382> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding con mode: secure 2024-09-19T14:07:42.549 INFO:tasks.workunit.client.0.smithi153.stderr: -381> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding con mode: crc 2024-09-19T14:07:42.550 INFO:tasks.workunit.client.0.smithi153.stderr: -380> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding con mode: secure 2024-09-19T14:07:42.550 INFO:tasks.workunit.client.0.smithi153.stderr: -379> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding con mode: crc 2024-09-19T14:07:42.550 INFO:tasks.workunit.client.0.smithi153.stderr: -378> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding con mode: crc 2024-09-19T14:07:42.550 INFO:tasks.workunit.client.0.smithi153.stderr: -377> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding con mode: secure 2024-09-19T14:07:42.550 INFO:tasks.workunit.client.0.smithi153.stderr: -376> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding con mode: crc 2024-09-19T14:07:42.550 INFO:tasks.workunit.client.0.smithi153.stderr: -375> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding con mode: secure 2024-09-19T14:07:42.550 INFO:tasks.workunit.client.0.smithi153.stderr: -374> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding con mode: crc 2024-09-19T14:07:42.550 INFO:tasks.workunit.client.0.smithi153.stderr: -373> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding con mode: secure 2024-09-19T14:07:42.550 INFO:tasks.workunit.client.0.smithi153.stderr: -372> 2024-09-19T14:07:42.208+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.550 INFO:tasks.workunit.client.0.smithi153.stderr: -371> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 asok(0x55b833398d90) register_command objecter_requests cmddesc objecter_requests hook 0x55b8335fc530 EEXIST 2024-09-19T14:07:42.550 INFO:tasks.workunit.client.0.smithi153.stderr: -370> 2024-09-19T14:07:42.208+0000 7f91366679c0 10 monclient: init 2024-09-19T14:07:42.550 INFO:tasks.workunit.client.0.smithi153.stderr: -369> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding auth protocol: cephx 2024-09-19T14:07:42.550 INFO:tasks.workunit.client.0.smithi153.stderr: -368> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding auth protocol: cephx 2024-09-19T14:07:42.550 INFO:tasks.workunit.client.0.smithi153.stderr: -367> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding auth protocol: cephx 2024-09-19T14:07:42.551 INFO:tasks.workunit.client.0.smithi153.stderr: -366> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding con mode: secure 2024-09-19T14:07:42.551 INFO:tasks.workunit.client.0.smithi153.stderr: -365> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding con mode: crc 2024-09-19T14:07:42.551 INFO:tasks.workunit.client.0.smithi153.stderr: -364> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding con mode: secure 2024-09-19T14:07:42.551 INFO:tasks.workunit.client.0.smithi153.stderr: -363> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding con mode: crc 2024-09-19T14:07:42.551 INFO:tasks.workunit.client.0.smithi153.stderr: -362> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding con mode: secure 2024-09-19T14:07:42.551 INFO:tasks.workunit.client.0.smithi153.stderr: -361> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding con mode: crc 2024-09-19T14:07:42.551 INFO:tasks.workunit.client.0.smithi153.stderr: -360> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding con mode: crc 2024-09-19T14:07:42.551 INFO:tasks.workunit.client.0.smithi153.stderr: -359> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding con mode: secure 2024-09-19T14:07:42.551 INFO:tasks.workunit.client.0.smithi153.stderr: -358> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding con mode: crc 2024-09-19T14:07:42.551 INFO:tasks.workunit.client.0.smithi153.stderr: -357> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding con mode: secure 2024-09-19T14:07:42.551 INFO:tasks.workunit.client.0.smithi153.stderr: -356> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding con mode: crc 2024-09-19T14:07:42.551 INFO:tasks.workunit.client.0.smithi153.stderr: -355> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding con mode: secure 2024-09-19T14:07:42.551 INFO:tasks.workunit.client.0.smithi153.stderr: -354> 2024-09-19T14:07:42.208+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.551 INFO:tasks.workunit.client.0.smithi153.stderr: -353> 2024-09-19T14:07:42.212+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.552 INFO:tasks.workunit.client.0.smithi153.stderr: -352> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 asok(0x55b833398d90) register_command rotate-key cmddesc rotate-key hook 0x55b8335f7c40 EEXIST 2024-09-19T14:07:42.552 INFO:tasks.workunit.client.0.smithi153.stderr: -351> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient: _reopen_session rank -1 2024-09-19T14:07:42.552 INFO:tasks.workunit.client.0.smithi153.stderr: -350> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T14:07:42.552 INFO:tasks.workunit.client.0.smithi153.stderr: -349> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient(hunting): picked mon.noname-b con 0x55b8336206e0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:07:42.552 INFO:tasks.workunit.client.0.smithi153.stderr: -348> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient(hunting): picked mon.noname-c con 0x55b833620010 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:07:42.552 INFO:tasks.workunit.client.0.smithi153.stderr: -347> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient(hunting): picked mon.noname-a con 0x55b83361e9f0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:07:42.552 INFO:tasks.workunit.client.0.smithi153.stderr: -346> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:07:42.552 INFO:tasks.workunit.client.0.smithi153.stderr: -345> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:07:42.552 INFO:tasks.workunit.client.0.smithi153.stderr: -344> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:07:42.552 INFO:tasks.workunit.client.0.smithi153.stderr: -343> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient(hunting): _renew_subs 2024-09-19T14:07:42.552 INFO:tasks.workunit.client.0.smithi153.stderr: -342> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient(hunting): authenticate will time out at 2650.676432s 2024-09-19T14:07:42.552 INFO:tasks.workunit.client.0.smithi153.stderr: -341> 2024-09-19T14:07:42.212+0000 7f913396c640 10 monclient(hunting): get_auth_request con 0x55b833620010 auth_method 0 2024-09-19T14:07:42.552 INFO:tasks.workunit.client.0.smithi153.stderr: -340> 2024-09-19T14:07:42.212+0000 7f913396c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:07:42.552 INFO:tasks.workunit.client.0.smithi153.stderr: -339> 2024-09-19T14:07:42.212+0000 7f913396c640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:07:42.553 INFO:tasks.workunit.client.0.smithi153.stderr: -338> 2024-09-19T14:07:42.212+0000 7f913396c640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:07:42.553 INFO:tasks.workunit.client.0.smithi153.stderr: -337> 2024-09-19T14:07:42.212+0000 7f913496e640 10 monclient(hunting): get_auth_request con 0x55b83361e9f0 auth_method 0 2024-09-19T14:07:42.553 INFO:tasks.workunit.client.0.smithi153.stderr: -336> 2024-09-19T14:07:42.212+0000 7f913496e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:07:42.553 INFO:tasks.workunit.client.0.smithi153.stderr: -335> 2024-09-19T14:07:42.212+0000 7f913496e640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:07:42.553 INFO:tasks.workunit.client.0.smithi153.stderr: -334> 2024-09-19T14:07:42.212+0000 7f913496e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:07:42.553 INFO:tasks.workunit.client.0.smithi153.stderr: -333> 2024-09-19T14:07:42.212+0000 7f913396c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:07:42.553 INFO:tasks.workunit.client.0.smithi153.stderr: -332> 2024-09-19T14:07:42.212+0000 7f913396c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:07:42.553 INFO:tasks.workunit.client.0.smithi153.stderr: -331> 2024-09-19T14:07:42.212+0000 7f913396c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:07:42.553 INFO:tasks.workunit.client.0.smithi153.stderr: -330> 2024-09-19T14:07:42.212+0000 7f913496e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:07:42.553 INFO:tasks.workunit.client.0.smithi153.stderr: -329> 2024-09-19T14:07:42.212+0000 7f913496e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:07:42.553 INFO:tasks.workunit.client.0.smithi153.stderr: -328> 2024-09-19T14:07:42.212+0000 7f913496e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:07:42.553 INFO:tasks.workunit.client.0.smithi153.stderr: -327> 2024-09-19T14:07:42.212+0000 7f913416d640 10 monclient(hunting): get_auth_request con 0x55b8336206e0 auth_method 0 2024-09-19T14:07:42.553 INFO:tasks.workunit.client.0.smithi153.stderr: -326> 2024-09-19T14:07:42.212+0000 7f913416d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:07:42.553 INFO:tasks.workunit.client.0.smithi153.stderr: -325> 2024-09-19T14:07:42.212+0000 7f913416d640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:07:42.553 INFO:tasks.workunit.client.0.smithi153.stderr: -324> 2024-09-19T14:07:42.212+0000 7f913416d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:07:42.554 INFO:tasks.workunit.client.0.smithi153.stderr: -323> 2024-09-19T14:07:42.212+0000 7f913396c640 10 monclient(hunting): handle_auth_done global_id 6425 payload 824 2024-09-19T14:07:42.554 INFO:tasks.workunit.client.0.smithi153.stderr: -322> 2024-09-19T14:07:42.212+0000 7f913396c640 10 monclient: _finish_hunting 0 2024-09-19T14:07:42.554 INFO:tasks.workunit.client.0.smithi153.stderr: -321> 2024-09-19T14:07:42.212+0000 7f913396c640 1 monclient: found mon.noname-c 2024-09-19T14:07:42.554 INFO:tasks.workunit.client.0.smithi153.stderr: -320> 2024-09-19T14:07:42.212+0000 7f913396c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:07:42.554 INFO:tasks.workunit.client.0.smithi153.stderr: -319> 2024-09-19T14:07:42.212+0000 7f9019ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:07:42.554 INFO:tasks.workunit.client.0.smithi153.stderr: -318> 2024-09-19T14:07:42.212+0000 7f9019ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:07:42.554 INFO:tasks.workunit.client.0.smithi153.stderr: -317> 2024-09-19T14:07:42.212+0000 7f9019ffb640 10 monclient: dump: 2024-09-19T14:07:42.554 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:07:42.554 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:07:42.554 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.554 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.554 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:07:42.554 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.554 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:07:42.554 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:07:42.555 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:07:42.555 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.555 INFO:tasks.workunit.client.0.smithi153.stderr: -316> 2024-09-19T14:07:42.212+0000 7f9019ffb640 10 monclient: _finish_auth 0 2024-09-19T14:07:42.555 INFO:tasks.workunit.client.0.smithi153.stderr: -315> 2024-09-19T14:07:42.212+0000 7f9019ffb640 10 monclient: _check_auth_tickets 2024-09-19T14:07:42.555 INFO:tasks.workunit.client.0.smithi153.stderr: -314> 2024-09-19T14:07:42.212+0000 7f9019ffb640 10 monclient: handle_config config(0 keys) 2024-09-19T14:07:42.555 INFO:tasks.workunit.client.0.smithi153.stderr: -313> 2024-09-19T14:07:42.212+0000 7f9019ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:07:42.555 INFO:tasks.workunit.client.0.smithi153.stderr: -312> 2024-09-19T14:07:42.212+0000 7f9019ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:07:42.555 INFO:tasks.workunit.client.0.smithi153.stderr: -311> 2024-09-19T14:07:42.212+0000 7f9019ffb640 10 monclient: dump: 2024-09-19T14:07:42.555 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:07:42.555 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:07:42.555 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.555 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.555 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:07:42.555 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.556 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:07:42.556 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:07:42.556 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:07:42.556 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.556 INFO:tasks.workunit.client.0.smithi153.stderr: -310> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 monclient: authenticate success, global_id 6425 2024-09-19T14:07:42.556 INFO:tasks.workunit.client.0.smithi153.stderr: -309> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient: _renew_subs 2024-09-19T14:07:42.556 INFO:tasks.workunit.client.0.smithi153.stderr: -308> 2024-09-19T14:07:42.212+0000 7f913516f640 4 set_mon_vals no callback set 2024-09-19T14:07:42.556 INFO:tasks.workunit.client.0.smithi153.stderr: -307> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:07:42.556 INFO:tasks.workunit.client.0.smithi153.stderr: -306> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient: _renew_subs 2024-09-19T14:07:42.556 INFO:tasks.workunit.client.0.smithi153.stderr: -305> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:07:42.556 INFO:tasks.workunit.client.0.smithi153.stderr: -304> 2024-09-19T14:07:42.212+0000 7f9019ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:07:42.556 INFO:tasks.workunit.client.0.smithi153.stderr: -303> 2024-09-19T14:07:42.212+0000 7f9019ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:07:42.556 INFO:tasks.workunit.client.0.smithi153.stderr: -302> 2024-09-19T14:07:42.212+0000 7f9019ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:07:42.556 INFO:tasks.workunit.client.0.smithi153.stderr: -301> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient: get_monmap_and_config 2024-09-19T14:07:42.556 INFO:tasks.workunit.client.0.smithi153.stderr: -300> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient: build_initial_monmap 2024-09-19T14:07:42.557 INFO:tasks.workunit.client.0.smithi153.stderr: -299> 2024-09-19T14:07:42.212+0000 7f91366679c0 1 build_initial for_mkfs: 0 2024-09-19T14:07:42.557 INFO:tasks.workunit.client.0.smithi153.stderr: -298> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient: monmap: 2024-09-19T14:07:42.557 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:07:42.557 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:07:42.557 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:07:42.557 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:07:42.557 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:07:42.557 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.557 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:07:42.557 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:07:42.557 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:07:42.557 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.558 INFO:tasks.workunit.client.0.smithi153.stderr: -297> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding auth protocol: cephx 2024-09-19T14:07:42.558 INFO:tasks.workunit.client.0.smithi153.stderr: -296> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding auth protocol: cephx 2024-09-19T14:07:42.558 INFO:tasks.workunit.client.0.smithi153.stderr: -295> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding auth protocol: cephx 2024-09-19T14:07:42.558 INFO:tasks.workunit.client.0.smithi153.stderr: -294> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding con mode: secure 2024-09-19T14:07:42.558 INFO:tasks.workunit.client.0.smithi153.stderr: -293> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding con mode: crc 2024-09-19T14:07:42.558 INFO:tasks.workunit.client.0.smithi153.stderr: -292> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding con mode: secure 2024-09-19T14:07:42.558 INFO:tasks.workunit.client.0.smithi153.stderr: -291> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding con mode: crc 2024-09-19T14:07:42.558 INFO:tasks.workunit.client.0.smithi153.stderr: -290> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding con mode: secure 2024-09-19T14:07:42.558 INFO:tasks.workunit.client.0.smithi153.stderr: -289> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding con mode: crc 2024-09-19T14:07:42.558 INFO:tasks.workunit.client.0.smithi153.stderr: -288> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding con mode: crc 2024-09-19T14:07:42.558 INFO:tasks.workunit.client.0.smithi153.stderr: -287> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding con mode: secure 2024-09-19T14:07:42.558 INFO:tasks.workunit.client.0.smithi153.stderr: -286> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding con mode: crc 2024-09-19T14:07:42.558 INFO:tasks.workunit.client.0.smithi153.stderr: -285> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding con mode: secure 2024-09-19T14:07:42.558 INFO:tasks.workunit.client.0.smithi153.stderr: -284> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding con mode: crc 2024-09-19T14:07:42.558 INFO:tasks.workunit.client.0.smithi153.stderr: -283> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding con mode: secure 2024-09-19T14:07:42.559 INFO:tasks.workunit.client.0.smithi153.stderr: -282> 2024-09-19T14:07:42.212+0000 7f913416d640 10 monclient: get_auth_request con 0x7f900c071b20 auth_method 0 2024-09-19T14:07:42.559 INFO:tasks.workunit.client.0.smithi153.stderr: -281> 2024-09-19T14:07:42.212+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.559 INFO:tasks.workunit.client.0.smithi153.stderr: -280> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient: init 2024-09-19T14:07:42.559 INFO:tasks.workunit.client.0.smithi153.stderr: -279> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding auth protocol: cephx 2024-09-19T14:07:42.559 INFO:tasks.workunit.client.0.smithi153.stderr: -278> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding auth protocol: cephx 2024-09-19T14:07:42.559 INFO:tasks.workunit.client.0.smithi153.stderr: -277> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding auth protocol: cephx 2024-09-19T14:07:42.559 INFO:tasks.workunit.client.0.smithi153.stderr: -276> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding con mode: secure 2024-09-19T14:07:42.559 INFO:tasks.workunit.client.0.smithi153.stderr: -275> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding con mode: crc 2024-09-19T14:07:42.559 INFO:tasks.workunit.client.0.smithi153.stderr: -274> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding con mode: secure 2024-09-19T14:07:42.559 INFO:tasks.workunit.client.0.smithi153.stderr: -273> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding con mode: crc 2024-09-19T14:07:42.559 INFO:tasks.workunit.client.0.smithi153.stderr: -272> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding con mode: secure 2024-09-19T14:07:42.559 INFO:tasks.workunit.client.0.smithi153.stderr: -271> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding con mode: crc 2024-09-19T14:07:42.559 INFO:tasks.workunit.client.0.smithi153.stderr: -270> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding con mode: crc 2024-09-19T14:07:42.559 INFO:tasks.workunit.client.0.smithi153.stderr: -269> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding con mode: secure 2024-09-19T14:07:42.560 INFO:tasks.workunit.client.0.smithi153.stderr: -268> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding con mode: crc 2024-09-19T14:07:42.560 INFO:tasks.workunit.client.0.smithi153.stderr: -267> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding con mode: secure 2024-09-19T14:07:42.560 INFO:tasks.workunit.client.0.smithi153.stderr: -266> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding con mode: crc 2024-09-19T14:07:42.560 INFO:tasks.workunit.client.0.smithi153.stderr: -265> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding con mode: secure 2024-09-19T14:07:42.560 INFO:tasks.workunit.client.0.smithi153.stderr: -264> 2024-09-19T14:07:42.212+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.560 INFO:tasks.workunit.client.0.smithi153.stderr: -263> 2024-09-19T14:07:42.216+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.560 INFO:tasks.workunit.client.0.smithi153.stderr: -262> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 asok(0x55b833398d90) register_command rotate-key cmddesc rotate-key hook 0x7ffebfa7cb58 EEXIST 2024-09-19T14:07:42.560 INFO:tasks.workunit.client.0.smithi153.stderr: -261> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: _reopen_session rank -1 2024-09-19T14:07:42.560 INFO:tasks.workunit.client.0.smithi153.stderr: -260> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T14:07:42.560 INFO:tasks.workunit.client.0.smithi153.stderr: -259> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): picked mon.noname-c con 0x55b833674060 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:07:42.560 INFO:tasks.workunit.client.0.smithi153.stderr: -258> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): picked mon.noname-a con 0x55b83366f4a0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:07:42.560 INFO:tasks.workunit.client.0.smithi153.stderr: -257> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): picked mon.noname-b con 0x55b833665b70 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:07:42.560 INFO:tasks.workunit.client.0.smithi153.stderr: -256> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:07:42.560 INFO:tasks.workunit.client.0.smithi153.stderr: -255> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:07:42.560 INFO:tasks.workunit.client.0.smithi153.stderr: -254> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:07:42.561 INFO:tasks.workunit.client.0.smithi153.stderr: -253> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): _renew_subs 2024-09-19T14:07:42.561 INFO:tasks.workunit.client.0.smithi153.stderr: -252> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): authenticate will time out at 2650.680341s 2024-09-19T14:07:42.561 INFO:tasks.workunit.client.0.smithi153.stderr: -251> 2024-09-19T14:07:42.216+0000 7f913416d640 10 monclient(hunting): get_auth_request con 0x55b833674060 auth_method 0 2024-09-19T14:07:42.561 INFO:tasks.workunit.client.0.smithi153.stderr: -250> 2024-09-19T14:07:42.216+0000 7f913416d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:07:42.561 INFO:tasks.workunit.client.0.smithi153.stderr: -249> 2024-09-19T14:07:42.216+0000 7f913416d640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:07:42.561 INFO:tasks.workunit.client.0.smithi153.stderr: -248> 2024-09-19T14:07:42.216+0000 7f913416d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:07:42.561 INFO:tasks.workunit.client.0.smithi153.stderr: -247> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): get_auth_request con 0x55b83366f4a0 auth_method 0 2024-09-19T14:07:42.561 INFO:tasks.workunit.client.0.smithi153.stderr: -246> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:07:42.561 INFO:tasks.workunit.client.0.smithi153.stderr: -245> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:07:42.561 INFO:tasks.workunit.client.0.smithi153.stderr: -244> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:07:42.561 INFO:tasks.workunit.client.0.smithi153.stderr: -243> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:07:42.561 INFO:tasks.workunit.client.0.smithi153.stderr: -242> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:07:42.561 INFO:tasks.workunit.client.0.smithi153.stderr: -241> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:07:42.561 INFO:tasks.workunit.client.0.smithi153.stderr: -240> 2024-09-19T14:07:42.216+0000 7f913416d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:07:42.561 INFO:tasks.workunit.client.0.smithi153.stderr: -239> 2024-09-19T14:07:42.216+0000 7f913416d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:07:42.562 INFO:tasks.workunit.client.0.smithi153.stderr: -238> 2024-09-19T14:07:42.216+0000 7f913416d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:07:42.562 INFO:tasks.workunit.client.0.smithi153.stderr: -237> 2024-09-19T14:07:42.216+0000 7f913496e640 10 monclient(hunting): get_auth_request con 0x55b833665b70 auth_method 0 2024-09-19T14:07:42.562 INFO:tasks.workunit.client.0.smithi153.stderr: -236> 2024-09-19T14:07:42.216+0000 7f913496e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:07:42.562 INFO:tasks.workunit.client.0.smithi153.stderr: -235> 2024-09-19T14:07:42.216+0000 7f913496e640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:07:42.562 INFO:tasks.workunit.client.0.smithi153.stderr: -234> 2024-09-19T14:07:42.216+0000 7f913496e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:07:42.562 INFO:tasks.workunit.client.0.smithi153.stderr: -233> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): handle_auth_done global_id 6846 payload 274 2024-09-19T14:07:42.562 INFO:tasks.workunit.client.0.smithi153.stderr: -232> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient: _finish_hunting 0 2024-09-19T14:07:42.562 INFO:tasks.workunit.client.0.smithi153.stderr: -231> 2024-09-19T14:07:42.216+0000 7f913396c640 1 monclient: found mon.noname-a 2024-09-19T14:07:42.562 INFO:tasks.workunit.client.0.smithi153.stderr: -230> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:07:42.562 INFO:tasks.workunit.client.0.smithi153.stderr: -229> 2024-09-19T14:07:42.216+0000 7f900b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:07:42.562 INFO:tasks.workunit.client.0.smithi153.stderr: -228> 2024-09-19T14:07:42.216+0000 7f900b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:07:42.562 INFO:tasks.workunit.client.0.smithi153.stderr: -227> 2024-09-19T14:07:42.216+0000 7f900b7fe640 10 monclient: dump: 2024-09-19T14:07:42.562 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:07:42.562 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:07:42.562 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.563 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.563 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:07:42.563 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.563 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:07:42.563 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:07:42.563 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:07:42.563 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.563 INFO:tasks.workunit.client.0.smithi153.stderr: -226> 2024-09-19T14:07:42.216+0000 7f900b7fe640 10 monclient: _finish_auth 0 2024-09-19T14:07:42.563 INFO:tasks.workunit.client.0.smithi153.stderr: -225> 2024-09-19T14:07:42.216+0000 7f900b7fe640 10 monclient: _check_auth_tickets 2024-09-19T14:07:42.563 INFO:tasks.workunit.client.0.smithi153.stderr: -224> 2024-09-19T14:07:42.216+0000 7f900b7fe640 10 monclient: handle_config config(0 keys) 2024-09-19T14:07:42.563 INFO:tasks.workunit.client.0.smithi153.stderr: -223> 2024-09-19T14:07:42.216+0000 7f900b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:07:42.563 INFO:tasks.workunit.client.0.smithi153.stderr: -222> 2024-09-19T14:07:42.216+0000 7f900b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:07:42.563 INFO:tasks.workunit.client.0.smithi153.stderr: -221> 2024-09-19T14:07:42.216+0000 7f900b7fe640 10 monclient: dump: 2024-09-19T14:07:42.563 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:07:42.564 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:07:42.564 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.564 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.564 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:07:42.564 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.564 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:07:42.564 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:07:42.564 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:07:42.564 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.564 INFO:tasks.workunit.client.0.smithi153.stderr: -220> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 monclient: authenticate success, global_id 6846 2024-09-19T14:07:42.564 INFO:tasks.workunit.client.0.smithi153.stderr: -219> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: get_monmap_and_config success 2024-09-19T14:07:42.564 INFO:tasks.workunit.client.0.smithi153.stderr: -218> 2024-09-19T14:07:42.216+0000 7f91366679c0 4 set_mon_vals no callback set 2024-09-19T14:07:42.564 INFO:tasks.workunit.client.0.smithi153.stderr: -217> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: shutdown 2024-09-19T14:07:42.564 INFO:tasks.workunit.client.0.smithi153.stderr: -216> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: build_initial_monmap 2024-09-19T14:07:42.565 INFO:tasks.workunit.client.0.smithi153.stderr: -215> 2024-09-19T14:07:42.216+0000 7f91366679c0 1 build_initial for_mkfs: 0 2024-09-19T14:07:42.565 INFO:tasks.workunit.client.0.smithi153.stderr: -214> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: monmap: 2024-09-19T14:07:42.565 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:07:42.565 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:07:42.565 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:07:42.565 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:07:42.565 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:07:42.565 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.565 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:07:42.565 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:07:42.565 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:07:42.565 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.565 INFO:tasks.workunit.client.0.smithi153.stderr: -213> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding auth protocol: cephx 2024-09-19T14:07:42.565 INFO:tasks.workunit.client.0.smithi153.stderr: -212> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding auth protocol: cephx 2024-09-19T14:07:42.566 INFO:tasks.workunit.client.0.smithi153.stderr: -211> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding auth protocol: cephx 2024-09-19T14:07:42.566 INFO:tasks.workunit.client.0.smithi153.stderr: -210> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding con mode: secure 2024-09-19T14:07:42.566 INFO:tasks.workunit.client.0.smithi153.stderr: -209> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding con mode: crc 2024-09-19T14:07:42.566 INFO:tasks.workunit.client.0.smithi153.stderr: -208> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding con mode: secure 2024-09-19T14:07:42.566 INFO:tasks.workunit.client.0.smithi153.stderr: -207> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding con mode: crc 2024-09-19T14:07:42.566 INFO:tasks.workunit.client.0.smithi153.stderr: -206> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding con mode: secure 2024-09-19T14:07:42.566 INFO:tasks.workunit.client.0.smithi153.stderr: -205> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding con mode: crc 2024-09-19T14:07:42.566 INFO:tasks.workunit.client.0.smithi153.stderr: -204> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding con mode: crc 2024-09-19T14:07:42.566 INFO:tasks.workunit.client.0.smithi153.stderr: -203> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding con mode: secure 2024-09-19T14:07:42.566 INFO:tasks.workunit.client.0.smithi153.stderr: -202> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding con mode: crc 2024-09-19T14:07:42.566 INFO:tasks.workunit.client.0.smithi153.stderr: -201> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding con mode: secure 2024-09-19T14:07:42.566 INFO:tasks.workunit.client.0.smithi153.stderr: -200> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding con mode: crc 2024-09-19T14:07:42.566 INFO:tasks.workunit.client.0.smithi153.stderr: -199> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding con mode: secure 2024-09-19T14:07:42.566 INFO:tasks.workunit.client.0.smithi153.stderr: -198> 2024-09-19T14:07:42.216+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.566 INFO:tasks.workunit.client.0.smithi153.stderr: -197> 2024-09-19T14:07:42.216+0000 7f91366679c0 1 librados: starting msgr at 2024-09-19T14:07:42.567 INFO:tasks.workunit.client.0.smithi153.stderr: -196> 2024-09-19T14:07:42.216+0000 7f91366679c0 1 librados: starting objecter 2024-09-19T14:07:42.567 INFO:tasks.workunit.client.0.smithi153.stderr: -195> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 asok(0x55b833398d90) register_command objecter_requests cmddesc objecter_requests hook 0x55b833673b80 EEXIST 2024-09-19T14:07:42.567 INFO:tasks.workunit.client.0.smithi153.stderr: -194> 2024-09-19T14:07:42.216+0000 7f91366679c0 1 librados: setting wanted keys 2024-09-19T14:07:42.567 INFO:tasks.workunit.client.0.smithi153.stderr: -193> 2024-09-19T14:07:42.216+0000 7f91366679c0 1 librados: calling monclient init 2024-09-19T14:07:42.567 INFO:tasks.workunit.client.0.smithi153.stderr: -192> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: init 2024-09-19T14:07:42.567 INFO:tasks.workunit.client.0.smithi153.stderr: -191> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding auth protocol: cephx 2024-09-19T14:07:42.567 INFO:tasks.workunit.client.0.smithi153.stderr: -190> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding auth protocol: cephx 2024-09-19T14:07:42.567 INFO:tasks.workunit.client.0.smithi153.stderr: -189> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding auth protocol: cephx 2024-09-19T14:07:42.567 INFO:tasks.workunit.client.0.smithi153.stderr: -188> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding con mode: secure 2024-09-19T14:07:42.567 INFO:tasks.workunit.client.0.smithi153.stderr: -187> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding con mode: crc 2024-09-19T14:07:42.567 INFO:tasks.workunit.client.0.smithi153.stderr: -186> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding con mode: secure 2024-09-19T14:07:42.567 INFO:tasks.workunit.client.0.smithi153.stderr: -185> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding con mode: crc 2024-09-19T14:07:42.567 INFO:tasks.workunit.client.0.smithi153.stderr: -184> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding con mode: secure 2024-09-19T14:07:42.568 INFO:tasks.workunit.client.0.smithi153.stderr: -183> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding con mode: crc 2024-09-19T14:07:42.568 INFO:tasks.workunit.client.0.smithi153.stderr: -182> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding con mode: crc 2024-09-19T14:07:42.568 INFO:tasks.workunit.client.0.smithi153.stderr: -181> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding con mode: secure 2024-09-19T14:07:42.568 INFO:tasks.workunit.client.0.smithi153.stderr: -180> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding con mode: crc 2024-09-19T14:07:42.568 INFO:tasks.workunit.client.0.smithi153.stderr: -179> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding con mode: secure 2024-09-19T14:07:42.568 INFO:tasks.workunit.client.0.smithi153.stderr: -178> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding con mode: crc 2024-09-19T14:07:42.568 INFO:tasks.workunit.client.0.smithi153.stderr: -177> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding con mode: secure 2024-09-19T14:07:42.568 INFO:tasks.workunit.client.0.smithi153.stderr: -176> 2024-09-19T14:07:42.216+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.568 INFO:tasks.workunit.client.0.smithi153.stderr: -175> 2024-09-19T14:07:42.216+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.568 INFO:tasks.workunit.client.0.smithi153.stderr: -174> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 asok(0x55b833398d90) register_command rotate-key cmddesc rotate-key hook 0x55b833622648 EEXIST 2024-09-19T14:07:42.568 INFO:tasks.workunit.client.0.smithi153.stderr: -173> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: _reopen_session rank -1 2024-09-19T14:07:42.568 INFO:tasks.workunit.client.0.smithi153.stderr: -172> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:07:42.568 INFO:tasks.workunit.client.0.smithi153.stderr: -171> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): picked mon.noname-b con 0x55b833665b70 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:07:42.568 INFO:tasks.workunit.client.0.smithi153.stderr: -170> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): picked mon.noname-a con 0x55b83366f4a0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:07:42.569 INFO:tasks.workunit.client.0.smithi153.stderr: -169> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): picked mon.noname-c con 0x55b833674060 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:07:42.569 INFO:tasks.workunit.client.0.smithi153.stderr: -168> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:07:42.569 INFO:tasks.workunit.client.0.smithi153.stderr: -167> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:07:42.569 INFO:tasks.workunit.client.0.smithi153.stderr: -166> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:07:42.569 INFO:tasks.workunit.client.0.smithi153.stderr: -165> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): _renew_subs 2024-09-19T14:07:42.569 INFO:tasks.workunit.client.0.smithi153.stderr: -164> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): authenticate will time out at 2650.682947s 2024-09-19T14:07:42.569 INFO:tasks.workunit.client.0.smithi153.stderr: -163> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): get_auth_request con 0x55b83366f4a0 auth_method 0 2024-09-19T14:07:42.569 INFO:tasks.workunit.client.0.smithi153.stderr: -162> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:07:42.569 INFO:tasks.workunit.client.0.smithi153.stderr: -161> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:07:42.569 INFO:tasks.workunit.client.0.smithi153.stderr: -160> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:07:42.569 INFO:tasks.workunit.client.0.smithi153.stderr: -159> 2024-09-19T14:07:42.216+0000 7f913496e640 10 monclient(hunting): get_auth_request con 0x55b833674060 auth_method 0 2024-09-19T14:07:42.569 INFO:tasks.workunit.client.0.smithi153.stderr: -158> 2024-09-19T14:07:42.216+0000 7f913496e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:07:42.569 INFO:tasks.workunit.client.0.smithi153.stderr: -157> 2024-09-19T14:07:42.216+0000 7f913496e640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:07:42.569 INFO:tasks.workunit.client.0.smithi153.stderr: -156> 2024-09-19T14:07:42.216+0000 7f913496e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:07:42.570 INFO:tasks.workunit.client.0.smithi153.stderr: -155> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:07:42.570 INFO:tasks.workunit.client.0.smithi153.stderr: -154> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:07:42.570 INFO:tasks.workunit.client.0.smithi153.stderr: -153> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:07:42.570 INFO:tasks.workunit.client.0.smithi153.stderr: -152> 2024-09-19T14:07:42.216+0000 7f913496e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:07:42.570 INFO:tasks.workunit.client.0.smithi153.stderr: -151> 2024-09-19T14:07:42.216+0000 7f913496e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:07:42.570 INFO:tasks.workunit.client.0.smithi153.stderr: -150> 2024-09-19T14:07:42.216+0000 7f913496e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:07:42.570 INFO:tasks.workunit.client.0.smithi153.stderr: -149> 2024-09-19T14:07:42.216+0000 7f913416d640 10 monclient(hunting): get_auth_request con 0x55b833665b70 auth_method 0 2024-09-19T14:07:42.570 INFO:tasks.workunit.client.0.smithi153.stderr: -148> 2024-09-19T14:07:42.216+0000 7f913416d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:07:42.570 INFO:tasks.workunit.client.0.smithi153.stderr: -147> 2024-09-19T14:07:42.216+0000 7f913416d640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:07:42.570 INFO:tasks.workunit.client.0.smithi153.stderr: -146> 2024-09-19T14:07:42.216+0000 7f913416d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:07:42.570 INFO:tasks.workunit.client.0.smithi153.stderr: -145> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): handle_auth_done global_id 6849 payload 824 2024-09-19T14:07:42.570 INFO:tasks.workunit.client.0.smithi153.stderr: -144> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient: _finish_hunting 0 2024-09-19T14:07:42.570 INFO:tasks.workunit.client.0.smithi153.stderr: -143> 2024-09-19T14:07:42.216+0000 7f913396c640 1 monclient: found mon.noname-a 2024-09-19T14:07:42.570 INFO:tasks.workunit.client.0.smithi153.stderr: -142> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:07:42.571 INFO:tasks.workunit.client.0.smithi153.stderr: -141> 2024-09-19T14:07:42.216+0000 7f9009ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:07:42.571 INFO:tasks.workunit.client.0.smithi153.stderr: -140> 2024-09-19T14:07:42.216+0000 7f9009ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:07:42.571 INFO:tasks.workunit.client.0.smithi153.stderr: -139> 2024-09-19T14:07:42.216+0000 7f9009ffb640 10 monclient: dump: 2024-09-19T14:07:42.571 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:07:42.571 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:07:42.571 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.571 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.571 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:07:42.571 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.571 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:07:42.571 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:07:42.571 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:07:42.572 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.572 INFO:tasks.workunit.client.0.smithi153.stderr: -138> 2024-09-19T14:07:42.216+0000 7f9009ffb640 10 monclient: _finish_auth 0 2024-09-19T14:07:42.572 INFO:tasks.workunit.client.0.smithi153.stderr: -137> 2024-09-19T14:07:42.216+0000 7f9009ffb640 10 monclient: _check_auth_tickets 2024-09-19T14:07:42.572 INFO:tasks.workunit.client.0.smithi153.stderr: -136> 2024-09-19T14:07:42.216+0000 7f9009ffb640 10 monclient: handle_config config(0 keys) 2024-09-19T14:07:42.572 INFO:tasks.workunit.client.0.smithi153.stderr: -135> 2024-09-19T14:07:42.216+0000 7f9009ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:07:42.572 INFO:tasks.workunit.client.0.smithi153.stderr: -134> 2024-09-19T14:07:42.216+0000 7f9009ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:07:42.572 INFO:tasks.workunit.client.0.smithi153.stderr: -133> 2024-09-19T14:07:42.216+0000 7f9009ffb640 10 monclient: dump: 2024-09-19T14:07:42.572 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:07:42.572 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:07:42.572 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.572 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.572 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:07:42.572 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.573 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:07:42.573 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:07:42.573 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:07:42.573 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.573 INFO:tasks.workunit.client.0.smithi153.stderr: -132> 2024-09-19T14:07:42.216+0000 7f900b7fe640 4 set_mon_vals no callback set 2024-09-19T14:07:42.573 INFO:tasks.workunit.client.0.smithi153.stderr: -131> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 monclient: authenticate success, global_id 6849 2024-09-19T14:07:42.573 INFO:tasks.workunit.client.0.smithi153.stderr: -130> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: _renew_subs 2024-09-19T14:07:42.573 INFO:tasks.workunit.client.0.smithi153.stderr: -129> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:07:42.573 INFO:tasks.workunit.client.0.smithi153.stderr: -128> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: _renew_subs 2024-09-19T14:07:42.573 INFO:tasks.workunit.client.0.smithi153.stderr: -127> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:07:42.573 INFO:tasks.workunit.client.0.smithi153.stderr: -126> 2024-09-19T14:07:42.216+0000 7f91366679c0 1 librados: init done 2024-09-19T14:07:42.573 INFO:tasks.workunit.client.0.smithi153.stderr: -125> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 asok(0x55b833398d90) register_command cr dump hook 0x7f91280f7ec8 2024-09-19T14:07:42.573 INFO:tasks.workunit.client.0.smithi153.stderr: -124> 2024-09-19T14:07:42.220+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.573 INFO:tasks.workunit.client.0.smithi153.stderr: -123> 2024-09-19T14:07:42.220+0000 7f9009ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:07:42.573 INFO:tasks.workunit.client.0.smithi153.stderr: -122> 2024-09-19T14:07:42.220+0000 7f9009ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:07:42.574 INFO:tasks.workunit.client.0.smithi153.stderr: -121> 2024-09-19T14:07:42.220+0000 7f9009ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:07:42.574 INFO:tasks.workunit.client.0.smithi153.stderr: -120> 2024-09-19T14:07:42.220+0000 7f913496e640 10 monclient: get_auth_request con 0x55b83368cc70 auth_method 0 2024-09-19T14:07:42.574 INFO:tasks.workunit.client.0.smithi153.stderr: -119> 2024-09-19T14:07:42.220+0000 7f913416d640 10 monclient: get_auth_request con 0x7f8ffc071be0 auth_method 0 2024-09-19T14:07:42.574 INFO:tasks.workunit.client.0.smithi153.stderr: -118> 2024-09-19T14:07:42.220+0000 7f91366679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.574 INFO:tasks.workunit.client.0.smithi153.stderr: -117> 2024-09-19T14:07:42.220+0000 7f91366679c0 20 realm 2024-09-19T14:07:42.574 INFO:tasks.workunit.client.0.smithi153.stderr: -116> 2024-09-19T14:07:42.220+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.574 INFO:tasks.workunit.client.0.smithi153.stderr: -115> 2024-09-19T14:07:42.220+0000 7f91366679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.574 INFO:tasks.workunit.client.0.smithi153.stderr: -114> 2024-09-19T14:07:42.220+0000 7f91366679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:07:42.574 INFO:tasks.workunit.client.0.smithi153.stderr: -113> 2024-09-19T14:07:42.220+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.574 INFO:tasks.workunit.client.0.smithi153.stderr: -112> 2024-09-19T14:07:42.220+0000 7f91366679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.574 INFO:tasks.workunit.client.0.smithi153.stderr: -111> 2024-09-19T14:07:42.220+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.574 INFO:tasks.workunit.client.0.smithi153.stderr: -110> 2024-09-19T14:07:42.224+0000 7f913416d640 10 monclient: get_auth_request con 0x55b833691030 auth_method 0 2024-09-19T14:07:42.574 INFO:tasks.workunit.client.0.smithi153.stderr: -109> 2024-09-19T14:07:42.224+0000 7f91366679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:42.574 INFO:tasks.workunit.client.0.smithi153.stderr: -108> 2024-09-19T14:07:42.224+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.575 INFO:tasks.workunit.client.0.smithi153.stderr: -107> 2024-09-19T14:07:42.224+0000 7f91366679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:07:42.575 INFO:tasks.workunit.client.0.smithi153.stderr: -106> 2024-09-19T14:07:42.224+0000 7f91366679c0 20 searching for the correct realm 2024-09-19T14:07:42.575 INFO:tasks.workunit.client.0.smithi153.stderr: -105> 2024-09-19T14:07:42.224+0000 7f913396c640 10 monclient: get_auth_request con 0x55b833696330 auth_method 0 2024-09-19T14:07:42.575 INFO:tasks.workunit.client.0.smithi153.stderr: -104> 2024-09-19T14:07:42.224+0000 7f913496e640 10 monclient: get_auth_request con 0x7f912811d040 auth_method 0 2024-09-19T14:07:42.575 INFO:tasks.workunit.client.0.smithi153.stderr: -103> 2024-09-19T14:07:42.228+0000 7f913416d640 10 monclient: get_auth_request con 0x7f912c015500 auth_method 0 2024-09-19T14:07:42.575 INFO:tasks.workunit.client.0.smithi153.stderr: -102> 2024-09-19T14:07:42.228+0000 7f913396c640 10 monclient: get_auth_request con 0x7f9124048410 auth_method 0 2024-09-19T14:07:42.575 INFO:tasks.workunit.client.0.smithi153.stderr: -101> 2024-09-19T14:07:42.232+0000 7f913496e640 0 -- 172.21.15.153:0/4223309757 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7f9128135230 msgr2=0x7f9128101710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:42.575 INFO:tasks.workunit.client.0.smithi153.stderr: -100> 2024-09-19T14:07:42.436+0000 7f913496e640 10 monclient: get_auth_request con 0x7f9128135230 auth_method 0 2024-09-19T14:07:42.575 INFO:tasks.workunit.client.0.smithi153.stderr: -99> 2024-09-19T14:07:42.444+0000 7f913416d640 10 monclient: get_auth_request con 0x7f912810dbb0 auth_method 0 2024-09-19T14:07:42.575 INFO:tasks.workunit.client.0.smithi153.stderr: -98> 2024-09-19T14:07:42.448+0000 7f913416d640 0 -- 172.21.15.153:0/4223309757 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x55b833691030 msgr2=0x55b833693420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:42.575 INFO:tasks.workunit.client.0.smithi153.stderr: -97> 2024-09-19T14:07:42.448+0000 7f9009ffb640 1 client.6849.objecter ms_handle_reset 0x55b833691030 session 0x55b83368fec0 osd.5 2024-09-19T14:07:42.575 INFO:tasks.workunit.client.0.smithi153.stderr: -96> 2024-09-19T14:07:42.448+0000 7f9009ffb640 10 monclient: _renew_subs 2024-09-19T14:07:42.575 INFO:tasks.workunit.client.0.smithi153.stderr: -95> 2024-09-19T14:07:42.448+0000 7f9009ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:07:42.575 INFO:tasks.workunit.client.0.smithi153.stderr: -94> 2024-09-19T14:07:42.448+0000 7f913416d640 10 monclient: get_auth_request con 0x7f8ffc082210 auth_method 0 2024-09-19T14:07:42.575 INFO:tasks.workunit.client.0.smithi153.stderr: -93> 2024-09-19T14:07:42.456+0000 7f91366679c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:07:42.576 INFO:tasks.workunit.client.0.smithi153.stderr: -92> 2024-09-19T14:07:42.456+0000 7f91366679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:07:42.576 INFO:tasks.workunit.client.0.smithi153.stderr: -91> 2024-09-19T14:07:42.456+0000 7f91366679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:07:42.576 INFO:tasks.workunit.client.0.smithi153.stderr: -90> 2024-09-19T14:07:42.456+0000 7f91366679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:07:42.576 INFO:tasks.workunit.client.0.smithi153.stderr: -89> 2024-09-19T14:07:42.456+0000 7f91366679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:07:42.576 INFO:tasks.workunit.client.0.smithi153.stderr: -88> 2024-09-19T14:07:42.456+0000 7f91366679c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:07:42.576 INFO:tasks.workunit.client.0.smithi153.stderr: -87> 2024-09-19T14:07:42.456+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.576 INFO:tasks.workunit.client.0.smithi153.stderr: -86> 2024-09-19T14:07:42.456+0000 7f91366679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.576 INFO:tasks.workunit.client.0.smithi153.stderr: -85> 2024-09-19T14:07:42.456+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.576 INFO:tasks.workunit.client.0.smithi153.stderr: -84> 2024-09-19T14:07:42.456+0000 7f91366679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:42.576 INFO:tasks.workunit.client.0.smithi153.stderr: -83> 2024-09-19T14:07:42.456+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.576 INFO:tasks.workunit.client.0.smithi153.stderr: -82> 2024-09-19T14:07:42.460+0000 7f91366679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:07:42.576 INFO:tasks.workunit.client.0.smithi153.stderr: -81> 2024-09-19T14:07:42.460+0000 7f91366679c0 20 zone default found 2024-09-19T14:07:42.576 INFO:tasks.workunit.client.0.smithi153.stderr: -80> 2024-09-19T14:07:42.460+0000 7f91366679c0 4 Realm: () 2024-09-19T14:07:42.576 INFO:tasks.workunit.client.0.smithi153.stderr: -79> 2024-09-19T14:07:42.460+0000 7f91366679c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:07:42.577 INFO:tasks.workunit.client.0.smithi153.stderr: -78> 2024-09-19T14:07:42.460+0000 7f91366679c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:07:42.577 INFO:tasks.workunit.client.0.smithi153.stderr: -77> 2024-09-19T14:07:42.460+0000 7f91366679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:07:42.577 INFO:tasks.workunit.client.0.smithi153.stderr: -76> 2024-09-19T14:07:42.460+0000 7f91366679c0 20 zonegroup default 2024-09-19T14:07:42.577 INFO:tasks.workunit.client.0.smithi153.stderr: -75> 2024-09-19T14:07:42.460+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.577 INFO:tasks.workunit.client.0.smithi153.stderr: -74> 2024-09-19T14:07:42.460+0000 7f91366679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.577 INFO:tasks.workunit.client.0.smithi153.stderr: -73> 2024-09-19T14:07:42.460+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.577 INFO:tasks.workunit.client.0.smithi153.stderr: -72> 2024-09-19T14:07:42.460+0000 7f91366679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.577 INFO:tasks.workunit.client.0.smithi153.stderr: -71> 2024-09-19T14:07:42.460+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.577 INFO:tasks.workunit.client.0.smithi153.stderr: -70> 2024-09-19T14:07:42.460+0000 7f91366679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.577 INFO:tasks.workunit.client.0.smithi153.stderr: -69> 2024-09-19T14:07:42.460+0000 7f91366679c0 20 started sync module instance, tier type = 2024-09-19T14:07:42.577 INFO:tasks.workunit.client.0.smithi153.stderr: -68> 2024-09-19T14:07:42.460+0000 7f91366679c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:07:42.577 INFO:tasks.workunit.client.0.smithi153.stderr: -67> 2024-09-19T14:07:42.484+0000 7f91366679c0 20 add_watcher() i=0 2024-09-19T14:07:42.578 INFO:tasks.workunit.client.0.smithi153.stderr: -66> 2024-09-19T14:07:42.484+0000 7f91366679c0 20 add_watcher() i=1 2024-09-19T14:07:42.578 INFO:tasks.workunit.client.0.smithi153.stderr: -65> 2024-09-19T14:07:42.484+0000 7f91366679c0 20 add_watcher() i=2 2024-09-19T14:07:42.578 INFO:tasks.workunit.client.0.smithi153.stderr: -64> 2024-09-19T14:07:42.484+0000 7f91366679c0 20 add_watcher() i=3 2024-09-19T14:07:42.578 INFO:tasks.workunit.client.0.smithi153.stderr: -63> 2024-09-19T14:07:42.484+0000 7f91366679c0 20 add_watcher() i=4 2024-09-19T14:07:42.578 INFO:tasks.workunit.client.0.smithi153.stderr: -62> 2024-09-19T14:07:42.484+0000 7f91366679c0 20 add_watcher() i=5 2024-09-19T14:07:42.578 INFO:tasks.workunit.client.0.smithi153.stderr: -61> 2024-09-19T14:07:42.484+0000 7f91366679c0 20 add_watcher() i=6 2024-09-19T14:07:42.578 INFO:tasks.workunit.client.0.smithi153.stderr: -60> 2024-09-19T14:07:42.488+0000 7f91366679c0 20 add_watcher() i=7 2024-09-19T14:07:42.578 INFO:tasks.workunit.client.0.smithi153.stderr: -59> 2024-09-19T14:07:42.488+0000 7f91366679c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:07:42.578 INFO:tasks.workunit.client.0.smithi153.stderr: -58> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding auth protocol: cephx 2024-09-19T14:07:42.578 INFO:tasks.workunit.client.0.smithi153.stderr: -57> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding auth protocol: cephx 2024-09-19T14:07:42.578 INFO:tasks.workunit.client.0.smithi153.stderr: -56> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding auth protocol: cephx 2024-09-19T14:07:42.578 INFO:tasks.workunit.client.0.smithi153.stderr: -55> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding con mode: secure 2024-09-19T14:07:42.578 INFO:tasks.workunit.client.0.smithi153.stderr: -54> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding con mode: crc 2024-09-19T14:07:42.578 INFO:tasks.workunit.client.0.smithi153.stderr: -53> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding con mode: secure 2024-09-19T14:07:42.578 INFO:tasks.workunit.client.0.smithi153.stderr: -52> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding con mode: crc 2024-09-19T14:07:42.579 INFO:tasks.workunit.client.0.smithi153.stderr: -51> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding con mode: secure 2024-09-19T14:07:42.579 INFO:tasks.workunit.client.0.smithi153.stderr: -50> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding con mode: crc 2024-09-19T14:07:42.579 INFO:tasks.workunit.client.0.smithi153.stderr: -49> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding con mode: crc 2024-09-19T14:07:42.579 INFO:tasks.workunit.client.0.smithi153.stderr: -48> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding con mode: secure 2024-09-19T14:07:42.579 INFO:tasks.workunit.client.0.smithi153.stderr: -47> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding con mode: crc 2024-09-19T14:07:42.579 INFO:tasks.workunit.client.0.smithi153.stderr: -46> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding con mode: secure 2024-09-19T14:07:42.579 INFO:tasks.workunit.client.0.smithi153.stderr: -45> 2024-09-19T14:07:42.492+0000 7f8feafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:42.579 INFO:tasks.workunit.client.0.smithi153.stderr: -44> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding con mode: crc 2024-09-19T14:07:42.579 INFO:tasks.workunit.client.0.smithi153.stderr: -43> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding con mode: secure 2024-09-19T14:07:42.579 INFO:tasks.workunit.client.0.smithi153.stderr: -42> 2024-09-19T14:07:42.492+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.579 INFO:tasks.workunit.client.0.smithi153.stderr: -41> 2024-09-19T14:07:42.492+0000 7f91366679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:07:42.579 INFO:tasks.workunit.client.0.smithi153.stderr: -40> 2024-09-19T14:07:42.492+0000 7f91366679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:07:42.579 INFO:tasks.workunit.client.0.smithi153.stderr: -39> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 asok(0x55b833398d90) register_command cache list hook 0x55b8336630e0 2024-09-19T14:07:42.579 INFO:tasks.workunit.client.0.smithi153.stderr: -38> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 asok(0x55b833398d90) register_command cache inspect hook 0x55b8336630e0 2024-09-19T14:07:42.579 INFO:tasks.workunit.client.0.smithi153.stderr: -37> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 asok(0x55b833398d90) register_command cache erase hook 0x55b8336630e0 2024-09-19T14:07:42.580 INFO:tasks.workunit.client.0.smithi153.stderr: -36> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 asok(0x55b833398d90) register_command cache zap hook 0x55b8336630e0 2024-09-19T14:07:42.580 INFO:tasks.workunit.client.0.smithi153.stderr: -35> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 note: GC not initialized 2024-09-19T14:07:42.580 INFO:tasks.workunit.client.0.smithi153.stderr: -34> 2024-09-19T14:07:42.492+0000 7f8fe9fdb640 20 reqs_thread_entry: start 2024-09-19T14:07:42.580 INFO:tasks.workunit.client.0.smithi153.stderr: -33> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 asok(0x55b833398d90) register_command sync trace show hook 0x7f9128106f20 2024-09-19T14:07:42.580 INFO:tasks.workunit.client.0.smithi153.stderr: -32> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 asok(0x55b833398d90) register_command sync trace history hook 0x7f9128106f20 2024-09-19T14:07:42.580 INFO:tasks.workunit.client.0.smithi153.stderr: -31> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 asok(0x55b833398d90) register_command sync trace active hook 0x7f9128106f20 2024-09-19T14:07:42.580 INFO:tasks.workunit.client.0.smithi153.stderr: -30> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 asok(0x55b833398d90) register_command sync trace active_short hook 0x7f9128106f20 2024-09-19T14:07:42.580 INFO:tasks.workunit.client.0.smithi153.stderr: -29> 2024-09-19T14:07:42.492+0000 7f91366679c0 20 init_complete bucket index max shards: 11 2024-09-19T14:07:42.580 INFO:tasks.workunit.client.0.smithi153.stderr: -28> 2024-09-19T14:07:42.492+0000 7f91366679c0 20 Filter name: none 2024-09-19T14:07:42.580 INFO:tasks.workunit.client.0.smithi153.stderr: -27> 2024-09-19T14:07:42.492+0000 7f8f5b7fe640 20 reqs_thread_entry: start 2024-09-19T14:07:42.580 INFO:tasks.workunit.client.0.smithi153.stderr: -26> 2024-09-19T14:07:42.492+0000 7f91366679c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-19T14:07:42.580 INFO:tasks.workunit.client.0.smithi153.stderr: -25> 2024-09-19T14:07:42.492+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.580 INFO:tasks.workunit.client.0.smithi153.stderr: -24> 2024-09-19T14:07:42.492+0000 7f91366679c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-19T14:07:42.580 INFO:tasks.workunit.client.0.smithi153.stderr: -23> 2024-09-19T14:07:42.492+0000 7f91366679c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-19T14:07:42.581 INFO:tasks.workunit.client.0.smithi153.stderr: -22> 2024-09-19T14:07:42.492+0000 7f91366679c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-19T14:07:42.581 INFO:tasks.workunit.client.0.smithi153.stderr: -21> 2024-09-19T14:07:42.492+0000 7f91366679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 : miss 2024-09-19T14:07:42.581 INFO:tasks.workunit.client.0.smithi153.stderr: -20> 2024-09-19T14:07:42.492+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.581 INFO:tasks.workunit.client.0.smithi153.stderr: -19> 2024-09-19T14:07:42.496+0000 7f91366679c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-19T14:07:42.581 INFO:tasks.workunit.client.0.smithi153.stderr: -18> 2024-09-19T14:07:42.496+0000 7f91366679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 info.flags=0x17 2024-09-19T14:07:42.581 INFO:tasks.workunit.client.0.smithi153.stderr: -17> 2024-09-19T14:07:42.496+0000 7f91366679c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 to cache LRU end 2024-09-19T14:07:42.581 INFO:tasks.workunit.client.0.smithi153.stderr: -16> 2024-09-19T14:07:42.496+0000 7f91366679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:07:42.581 INFO:tasks.workunit.client.0.smithi153.stderr: -15> 2024-09-19T14:07:42.496+0000 7f91366679c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:42.581 INFO:tasks.workunit.client.0.smithi153.stderr: -14> 2024-09-19T14:07:42.496+0000 7f91366679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 2024-09-19T14:07:42.581 INFO:tasks.workunit.client.0.smithi153.stderr: -13> 2024-09-19T14:07:42.508+0000 7f91366679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 info.flags=0x17 2024-09-19T14:07:42.581 INFO:tasks.workunit.client.0.smithi153.stderr: -12> 2024-09-19T14:07:42.508+0000 7f91366679c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 to cache LRU end 2024-09-19T14:07:42.581 INFO:tasks.workunit.client.0.smithi153.stderr: -11> 2024-09-19T14:07:42.508+0000 7f91366679c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:42.581 INFO:tasks.workunit.client.0.smithi153.stderr: -10> 2024-09-19T14:07:42.508+0000 7f91366679c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27, ofs0, ns] 2024-09-19T14:07:42.582 INFO:tasks.workunit.client.0.smithi153.stderr: -9> 2024-09-19T14:07:42.508+0000 7f900b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333521 cookie 94249624871424 notifier 6849 bl.length()=939 2024-09-19T14:07:42.582 INFO:tasks.workunit.client.0.smithi153.stderr: -8> 2024-09-19T14:07:42.508+0000 7f900b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 info.flags=0x17 2024-09-19T14:07:42.582 INFO:tasks.workunit.client.0.smithi153.stderr: -7> 2024-09-19T14:07:42.508+0000 7f900b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 to cache LRU end 2024-09-19T14:07:42.582 INFO:tasks.workunit.client.0.smithi153.stderr: -6> 2024-09-19T14:07:42.508+0000 7f900b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:42.582 INFO:tasks.workunit.client.0.smithi153.stderr: -5> 2024-09-19T14:07:42.508+0000 7f91366679c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.27]): orig_sources= new_sources= 2024-09-19T14:07:42.582 INFO:tasks.workunit.client.0.smithi153.stderr: -4> 2024-09-19T14:07:42.508+0000 7f91366679c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.27]): potential sources added=[] removed=[] 2024-09-19T14:07:42.582 INFO:tasks.workunit.client.0.smithi153.stderr: -3> 2024-09-19T14:07:42.508+0000 7f91366679c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.27]): orig_dests= new_dests= 2024-09-19T14:07:42.582 INFO:tasks.workunit.client.0.smithi153.stderr: -2> 2024-09-19T14:07:42.508+0000 7f91366679c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.27]): potential dests added=[] removed=[] 2024-09-19T14:07:42.582 INFO:tasks.workunit.client.0.smithi153.stderr: -1> 2024-09-19T14:07:42.512+0000 7f91366679c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f91366679c0 time 2024-09-19T14:07:42.515601+0000 2024-09-19T14:07:42.582 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:07:42.582 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.582 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:07:42.582 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9139f412eb] 2024-09-19T14:07:42.582 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9139f4149f] 2024-09-19T14:07:42.582 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b83151d271] 2024-09-19T14:07:42.583 INFO:tasks.workunit.client.0.smithi153.stderr: 4: radosgw-admin(+0x141050e) [0x55b831f6e50e] 2024-09-19T14:07:42.583 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b83152d0dd] 2024-09-19T14:07:42.583 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:07:42.583 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9138da7d90] 2024-09-19T14:07:42.583 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:07:42.583 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:07:42.583 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.583 INFO:tasks.workunit.client.0.smithi153.stderr: 0> 2024-09-19T14:07:42.512+0000 7f91366679c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:07:42.583 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7f91366679c0 thread_name:radosgw-admin 2024-09-19T14:07:42.583 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.583 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:07:42.583 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9138dc0520] 2024-09-19T14:07:42.583 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:07:42.583 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:07:42.583 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:07:42.583 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9139f41345] 2024-09-19T14:07:42.584 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9139f4149f] 2024-09-19T14:07:42.584 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b83151d271] 2024-09-19T14:07:42.584 INFO:tasks.workunit.client.0.smithi153.stderr: 8: radosgw-admin(+0x141050e) [0x55b831f6e50e] 2024-09-19T14:07:42.584 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b83152d0dd] 2024-09-19T14:07:42.584 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:07:42.584 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9138da7d90] 2024-09-19T14:07:42.584 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:07:42.584 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:07:42.584 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:07:42.584 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.584 INFO:tasks.workunit.client.0.smithi153.stderr:--- logging levels --- 2024-09-19T14:07:42.584 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 none 2024-09-19T14:07:42.584 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 lockdep 2024-09-19T14:07:42.584 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 context 2024-09-19T14:07:42.585 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 crush 2024-09-19T14:07:42.585 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds 2024-09-19T14:07:42.585 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_balancer 2024-09-19T14:07:42.585 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_locker 2024-09-19T14:07:42.585 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log 2024-09-19T14:07:42.585 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log_expire 2024-09-19T14:07:42.585 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_migrator 2024-09-19T14:07:42.585 INFO:tasks.workunit.client.0.smithi153.stderr: 3/ 5 mds_quiesce 2024-09-19T14:07:42.585 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 buffer 2024-09-19T14:07:42.585 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 timer 2024-09-19T14:07:42.585 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 filer 2024-09-19T14:07:42.585 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 striper 2024-09-19T14:07:42.585 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 objecter 2024-09-19T14:07:42.585 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rados 2024-09-19T14:07:42.585 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd 2024-09-19T14:07:42.586 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_mirror 2024-09-19T14:07:42.586 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_replay 2024-09-19T14:07:42.586 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_pwl 2024-09-19T14:07:42.586 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 journaler 2024-09-19T14:07:42.586 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objectcacher 2024-09-19T14:07:42.586 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:07:42.586 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 client 2024-09-19T14:07:42.586 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 osd 2024-09-19T14:07:42.586 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 optracker 2024-09-19T14:07:42.586 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objclass 2024-09-19T14:07:42.586 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 filestore 2024-09-19T14:07:42.586 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 journal 2024-09-19T14:07:42.586 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 ms 2024-09-19T14:07:42.586 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mon 2024-09-19T14:07:42.586 INFO:tasks.workunit.client.0.smithi153.stderr: 0/10 monc 2024-09-19T14:07:42.587 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 paxos 2024-09-19T14:07:42.587 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 tp 2024-09-19T14:07:42.587 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 auth 2024-09-19T14:07:42.587 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 crypto 2024-09-19T14:07:42.587 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 finisher 2024-09-19T14:07:42.587 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 reserver 2024-09-19T14:07:42.587 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 heartbeatmap 2024-09-19T14:07:42.587 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 perfcounter 2024-09-19T14:07:42.587 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw 2024-09-19T14:07:42.587 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_sync 2024-09-19T14:07:42.587 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_datacache 2024-09-19T14:07:42.587 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_access 2024-09-19T14:07:42.587 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:07:42.587 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_flight 2024-09-19T14:07:42.587 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:07:42.587 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw_notification 2024-09-19T14:07:42.588 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 javaclient 2024-09-19T14:07:42.588 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 asok 2024-09-19T14:07:42.588 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 throttle 2024-09-19T14:07:42.588 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 refs 2024-09-19T14:07:42.588 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 compressor 2024-09-19T14:07:42.588 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluestore 2024-09-19T14:07:42.588 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluefs 2024-09-19T14:07:42.588 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 bdev 2024-09-19T14:07:42.588 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 kstore 2024-09-19T14:07:42.588 INFO:tasks.workunit.client.0.smithi153.stderr: 4/ 5 rocksdb 2024-09-19T14:07:42.588 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 fuse 2024-09-19T14:07:42.588 INFO:tasks.workunit.client.0.smithi153.stderr: 2/ 5 mgr 2024-09-19T14:07:42.589 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mgrc 2024-09-19T14:07:42.589 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 dpdk 2024-09-19T14:07:42.589 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 eventtrace 2024-09-19T14:07:42.589 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 prioritycache 2024-09-19T14:07:42.589 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 test 2024-09-19T14:07:42.589 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:07:42.589 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephsqlite 2024-09-19T14:07:42.589 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:07:42.589 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore 2024-09-19T14:07:42.589 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_onode 2024-09-19T14:07:42.589 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_odata 2024-09-19T14:07:42.589 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_omap 2024-09-19T14:07:42.589 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_tm 2024-09-19T14:07:42.589 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_t 2024-09-19T14:07:42.589 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:07:42.590 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_epm 2024-09-19T14:07:42.590 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_lba 2024-09-19T14:07:42.590 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:07:42.590 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cache 2024-09-19T14:07:42.590 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_journal 2024-09-19T14:07:42.590 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_device 2024-09-19T14:07:42.590 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_backref 2024-09-19T14:07:42.590 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 alienstore 2024-09-19T14:07:42.590 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mclock 2024-09-19T14:07:42.590 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cyanstore 2024-09-19T14:07:42.590 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 ceph_exporter 2024-09-19T14:07:42.590 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 memstore 2024-09-19T14:07:42.590 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 trace 2024-09-19T14:07:42.590 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 ceph_dedup 2024-09-19T14:07:42.590 INFO:tasks.workunit.client.0.smithi153.stderr: -2/-2 (syslog threshold) 2024-09-19T14:07:42.591 INFO:tasks.workunit.client.0.smithi153.stderr: 99/99 (stderr threshold) 2024-09-19T14:07:42.591 INFO:tasks.workunit.client.0.smithi153.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:07:42.591 INFO:tasks.workunit.client.0.smithi153.stderr: 7f8f5b7fe640 / http_manager 2024-09-19T14:07:42.591 INFO:tasks.workunit.client.0.smithi153.stderr: 7f8fe9fdb640 / http_manager 2024-09-19T14:07:42.591 INFO:tasks.workunit.client.0.smithi153.stderr: 7f8feafdd640 / rgw_dt_lg_renew 2024-09-19T14:07:42.591 INFO:tasks.workunit.client.0.smithi153.stderr: 7f9009ffb640 / ms_dispatch 2024-09-19T14:07:42.591 INFO:tasks.workunit.client.0.smithi153.stderr: 7f900b7fe640 / io_context_pool 2024-09-19T14:07:42.591 INFO:tasks.workunit.client.0.smithi153.stderr: 7f9019ffb640 / ms_dispatch 2024-09-19T14:07:42.591 INFO:tasks.workunit.client.0.smithi153.stderr: 7f9020e09640 / ms_dispatch 2024-09-19T14:07:42.591 INFO:tasks.workunit.client.0.smithi153.stderr: 7f902260c640 / io_context_pool 2024-09-19T14:07:42.591 INFO:tasks.workunit.client.0.smithi153.stderr: 7f913396c640 / msgr-worker-2 2024-09-19T14:07:42.591 INFO:tasks.workunit.client.0.smithi153.stderr: 7f913416d640 / msgr-worker-1 2024-09-19T14:07:42.591 INFO:tasks.workunit.client.0.smithi153.stderr: 7f913496e640 / msgr-worker-0 2024-09-19T14:07:42.591 INFO:tasks.workunit.client.0.smithi153.stderr: 7f913516f640 / io_context_pool 2024-09-19T14:07:42.591 INFO:tasks.workunit.client.0.smithi153.stderr: 7f91366679c0 / radosgw-admin 2024-09-19T14:07:42.592 INFO:tasks.workunit.client.0.smithi153.stderr: max_recent 500 2024-09-19T14:07:42.592 INFO:tasks.workunit.client.0.smithi153.stderr: max_new 1000 2024-09-19T14:07:42.592 INFO:tasks.workunit.client.0.smithi153.stderr: log_file /var/log/ceph/ceph-client.admin.99263.log 2024-09-19T14:07:42.592 INFO:tasks.workunit.client.0.smithi153.stderr:--- end dump of recent events --- 2024-09-19T14:07:42.592 INFO:tasks.workunit.client.0.smithi153.stderr:--- begin dump of recent events --- 2024-09-19T14:07:42.592 INFO:tasks.workunit.client.0.smithi153.stderr: -499> 2024-09-19T14:07:42.196+0000 7f902260c640 10 monclient: _finish_auth 0 2024-09-19T14:07:42.592 INFO:tasks.workunit.client.0.smithi153.stderr: -498> 2024-09-19T14:07:42.196+0000 7f902260c640 10 monclient: _check_auth_tickets 2024-09-19T14:07:42.592 INFO:tasks.workunit.client.0.smithi153.stderr: -497> 2024-09-19T14:07:42.196+0000 7f91366679c0 5 monclient: authenticate success, global_id 6837 2024-09-19T14:07:42.592 INFO:tasks.workunit.client.0.smithi153.stderr: -496> 2024-09-19T14:07:42.196+0000 7f902260c640 10 monclient: handle_config config(0 keys) 2024-09-19T14:07:42.592 INFO:tasks.workunit.client.0.smithi153.stderr: -495> 2024-09-19T14:07:42.196+0000 7f91366679c0 10 monclient: get_monmap_and_config success 2024-09-19T14:07:42.592 INFO:tasks.workunit.client.0.smithi153.stderr: -494> 2024-09-19T14:07:42.196+0000 7f91366679c0 4 set_mon_vals no callback set 2024-09-19T14:07:42.592 INFO:tasks.workunit.client.0.smithi153.stderr: -493> 2024-09-19T14:07:42.196+0000 7f902260c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:07:42.593 INFO:tasks.workunit.client.0.smithi153.stderr: -492> 2024-09-19T14:07:42.196+0000 7f902260c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:07:42.593 INFO:tasks.workunit.client.0.smithi153.stderr: -491> 2024-09-19T14:07:42.196+0000 7f902260c640 10 monclient: dump: 2024-09-19T14:07:42.593 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:07:42.593 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:07:42.593 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.593 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.593 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:07:42.593 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.593 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:07:42.593 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:07:42.593 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:07:42.593 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.593 INFO:tasks.workunit.client.0.smithi153.stderr: -490> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient: shutdown 2024-09-19T14:07:42.593 INFO:tasks.workunit.client.0.smithi153.stderr: -489> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 asok(0x55b833398d90) unregister_commands rotate-key 2024-09-19T14:07:42.594 INFO:tasks.workunit.client.0.smithi153.stderr: -488> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient: build_initial_monmap 2024-09-19T14:07:42.594 INFO:tasks.workunit.client.0.smithi153.stderr: -487> 2024-09-19T14:07:42.200+0000 7f91366679c0 1 build_initial for_mkfs: 0 2024-09-19T14:07:42.594 INFO:tasks.workunit.client.0.smithi153.stderr: -486> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient: monmap: 2024-09-19T14:07:42.594 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:07:42.594 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:07:42.594 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:07:42.594 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:07:42.594 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:07:42.594 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.594 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:07:42.594 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:07:42.594 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:07:42.594 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.595 INFO:tasks.workunit.client.0.smithi153.stderr: -485> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding auth protocol: cephx 2024-09-19T14:07:42.595 INFO:tasks.workunit.client.0.smithi153.stderr: -484> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding auth protocol: cephx 2024-09-19T14:07:42.595 INFO:tasks.workunit.client.0.smithi153.stderr: -483> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding auth protocol: cephx 2024-09-19T14:07:42.595 INFO:tasks.workunit.client.0.smithi153.stderr: -482> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding con mode: secure 2024-09-19T14:07:42.595 INFO:tasks.workunit.client.0.smithi153.stderr: -481> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding con mode: crc 2024-09-19T14:07:42.595 INFO:tasks.workunit.client.0.smithi153.stderr: -480> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding con mode: secure 2024-09-19T14:07:42.595 INFO:tasks.workunit.client.0.smithi153.stderr: -479> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding con mode: crc 2024-09-19T14:07:42.595 INFO:tasks.workunit.client.0.smithi153.stderr: -478> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding con mode: secure 2024-09-19T14:07:42.595 INFO:tasks.workunit.client.0.smithi153.stderr: -477> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding con mode: crc 2024-09-19T14:07:42.595 INFO:tasks.workunit.client.0.smithi153.stderr: -476> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding con mode: crc 2024-09-19T14:07:42.595 INFO:tasks.workunit.client.0.smithi153.stderr: -475> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding con mode: secure 2024-09-19T14:07:42.595 INFO:tasks.workunit.client.0.smithi153.stderr: -474> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding con mode: crc 2024-09-19T14:07:42.595 INFO:tasks.workunit.client.0.smithi153.stderr: -473> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding con mode: secure 2024-09-19T14:07:42.596 INFO:tasks.workunit.client.0.smithi153.stderr: -472> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding con mode: crc 2024-09-19T14:07:42.596 INFO:tasks.workunit.client.0.smithi153.stderr: -471> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a79d0) adding con mode: secure 2024-09-19T14:07:42.596 INFO:tasks.workunit.client.0.smithi153.stderr: -470> 2024-09-19T14:07:42.200+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.596 INFO:tasks.workunit.client.0.smithi153.stderr: -469> 2024-09-19T14:07:42.200+0000 7f91366679c0 1 librados: starting msgr at 2024-09-19T14:07:42.596 INFO:tasks.workunit.client.0.smithi153.stderr: -468> 2024-09-19T14:07:42.200+0000 7f91366679c0 1 librados: starting objecter 2024-09-19T14:07:42.596 INFO:tasks.workunit.client.0.smithi153.stderr: -467> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 asok(0x55b833398d90) register_command objecter_requests hook 0x55b8333c0460 2024-09-19T14:07:42.596 INFO:tasks.workunit.client.0.smithi153.stderr: -466> 2024-09-19T14:07:42.200+0000 7f91366679c0 1 librados: setting wanted keys 2024-09-19T14:07:42.596 INFO:tasks.workunit.client.0.smithi153.stderr: -465> 2024-09-19T14:07:42.200+0000 7f91366679c0 1 librados: calling monclient init 2024-09-19T14:07:42.596 INFO:tasks.workunit.client.0.smithi153.stderr: -464> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient: init 2024-09-19T14:07:42.596 INFO:tasks.workunit.client.0.smithi153.stderr: -463> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding auth protocol: cephx 2024-09-19T14:07:42.596 INFO:tasks.workunit.client.0.smithi153.stderr: -462> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding auth protocol: cephx 2024-09-19T14:07:42.596 INFO:tasks.workunit.client.0.smithi153.stderr: -461> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding auth protocol: cephx 2024-09-19T14:07:42.596 INFO:tasks.workunit.client.0.smithi153.stderr: -460> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding con mode: secure 2024-09-19T14:07:42.596 INFO:tasks.workunit.client.0.smithi153.stderr: -459> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding con mode: crc 2024-09-19T14:07:42.597 INFO:tasks.workunit.client.0.smithi153.stderr: -458> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding con mode: secure 2024-09-19T14:07:42.597 INFO:tasks.workunit.client.0.smithi153.stderr: -457> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding con mode: crc 2024-09-19T14:07:42.597 INFO:tasks.workunit.client.0.smithi153.stderr: -456> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding con mode: secure 2024-09-19T14:07:42.597 INFO:tasks.workunit.client.0.smithi153.stderr: -455> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding con mode: crc 2024-09-19T14:07:42.597 INFO:tasks.workunit.client.0.smithi153.stderr: -454> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding con mode: crc 2024-09-19T14:07:42.597 INFO:tasks.workunit.client.0.smithi153.stderr: -453> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding con mode: secure 2024-09-19T14:07:42.597 INFO:tasks.workunit.client.0.smithi153.stderr: -452> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding con mode: crc 2024-09-19T14:07:42.597 INFO:tasks.workunit.client.0.smithi153.stderr: -451> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding con mode: secure 2024-09-19T14:07:42.597 INFO:tasks.workunit.client.0.smithi153.stderr: -450> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding con mode: crc 2024-09-19T14:07:42.597 INFO:tasks.workunit.client.0.smithi153.stderr: -449> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 AuthRegistry(0x55b8335a45d0) adding con mode: secure 2024-09-19T14:07:42.597 INFO:tasks.workunit.client.0.smithi153.stderr: -448> 2024-09-19T14:07:42.200+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.597 INFO:tasks.workunit.client.0.smithi153.stderr: -447> 2024-09-19T14:07:42.200+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.597 INFO:tasks.workunit.client.0.smithi153.stderr: -446> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 asok(0x55b833398d90) register_command rotate-key hook 0x55b8335a4718 2024-09-19T14:07:42.597 INFO:tasks.workunit.client.0.smithi153.stderr: -445> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient: _reopen_session rank -1 2024-09-19T14:07:42.598 INFO:tasks.workunit.client.0.smithi153.stderr: -444> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:07:42.598 INFO:tasks.workunit.client.0.smithi153.stderr: -443> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient(hunting): picked mon.noname-b con 0x55b833431410 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:07:42.598 INFO:tasks.workunit.client.0.smithi153.stderr: -442> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient(hunting): picked mon.noname-a con 0x55b8334320f0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:07:42.598 INFO:tasks.workunit.client.0.smithi153.stderr: -441> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient(hunting): picked mon.noname-c con 0x55b8335aadb0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:07:42.598 INFO:tasks.workunit.client.0.smithi153.stderr: -440> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:07:42.598 INFO:tasks.workunit.client.0.smithi153.stderr: -439> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:07:42.598 INFO:tasks.workunit.client.0.smithi153.stderr: -438> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:07:42.598 INFO:tasks.workunit.client.0.smithi153.stderr: -437> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient(hunting): _renew_subs 2024-09-19T14:07:42.598 INFO:tasks.workunit.client.0.smithi153.stderr: -436> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient(hunting): authenticate will time out at 2650.666018s 2024-09-19T14:07:42.598 INFO:tasks.workunit.client.0.smithi153.stderr: -435> 2024-09-19T14:07:42.200+0000 7f913396c640 10 monclient(hunting): get_auth_request con 0x55b8334320f0 auth_method 0 2024-09-19T14:07:42.599 INFO:tasks.workunit.client.0.smithi153.stderr: -434> 2024-09-19T14:07:42.200+0000 7f913396c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:07:42.599 INFO:tasks.workunit.client.0.smithi153.stderr: -433> 2024-09-19T14:07:42.200+0000 7f913396c640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:07:42.599 INFO:tasks.workunit.client.0.smithi153.stderr: -432> 2024-09-19T14:07:42.200+0000 7f913396c640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:07:42.599 INFO:tasks.workunit.client.0.smithi153.stderr: -431> 2024-09-19T14:07:42.200+0000 7f913496e640 10 monclient(hunting): get_auth_request con 0x55b8335aadb0 auth_method 0 2024-09-19T14:07:42.599 INFO:tasks.workunit.client.0.smithi153.stderr: -430> 2024-09-19T14:07:42.200+0000 7f913496e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:07:42.599 INFO:tasks.workunit.client.0.smithi153.stderr: -429> 2024-09-19T14:07:42.200+0000 7f913496e640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:07:42.599 INFO:tasks.workunit.client.0.smithi153.stderr: -428> 2024-09-19T14:07:42.200+0000 7f913496e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:07:42.599 INFO:tasks.workunit.client.0.smithi153.stderr: -427> 2024-09-19T14:07:42.200+0000 7f913396c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:07:42.599 INFO:tasks.workunit.client.0.smithi153.stderr: -426> 2024-09-19T14:07:42.200+0000 7f913396c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:07:42.599 INFO:tasks.workunit.client.0.smithi153.stderr: -425> 2024-09-19T14:07:42.200+0000 7f913396c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:07:42.599 INFO:tasks.workunit.client.0.smithi153.stderr: -424> 2024-09-19T14:07:42.200+0000 7f913496e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:07:42.599 INFO:tasks.workunit.client.0.smithi153.stderr: -423> 2024-09-19T14:07:42.200+0000 7f913496e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:07:42.599 INFO:tasks.workunit.client.0.smithi153.stderr: -422> 2024-09-19T14:07:42.200+0000 7f913496e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:07:42.600 INFO:tasks.workunit.client.0.smithi153.stderr: -421> 2024-09-19T14:07:42.200+0000 7f913416d640 10 monclient(hunting): get_auth_request con 0x55b833431410 auth_method 0 2024-09-19T14:07:42.600 INFO:tasks.workunit.client.0.smithi153.stderr: -420> 2024-09-19T14:07:42.200+0000 7f913416d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:07:42.600 INFO:tasks.workunit.client.0.smithi153.stderr: -419> 2024-09-19T14:07:42.200+0000 7f913416d640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:07:42.600 INFO:tasks.workunit.client.0.smithi153.stderr: -418> 2024-09-19T14:07:42.200+0000 7f913416d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:07:42.600 INFO:tasks.workunit.client.0.smithi153.stderr: -417> 2024-09-19T14:07:42.200+0000 7f913396c640 10 monclient(hunting): handle_auth_done global_id 6840 payload 824 2024-09-19T14:07:42.600 INFO:tasks.workunit.client.0.smithi153.stderr: -416> 2024-09-19T14:07:42.200+0000 7f913396c640 10 monclient: _finish_hunting 0 2024-09-19T14:07:42.600 INFO:tasks.workunit.client.0.smithi153.stderr: -415> 2024-09-19T14:07:42.200+0000 7f913396c640 1 monclient: found mon.noname-a 2024-09-19T14:07:42.600 INFO:tasks.workunit.client.0.smithi153.stderr: -414> 2024-09-19T14:07:42.200+0000 7f913396c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:07:42.600 INFO:tasks.workunit.client.0.smithi153.stderr: -413> 2024-09-19T14:07:42.200+0000 7f9020e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:07:42.600 INFO:tasks.workunit.client.0.smithi153.stderr: -412> 2024-09-19T14:07:42.200+0000 7f9020e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:07:42.600 INFO:tasks.workunit.client.0.smithi153.stderr: -411> 2024-09-19T14:07:42.200+0000 7f9020e09640 10 monclient: dump: 2024-09-19T14:07:42.600 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:07:42.600 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:07:42.601 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.601 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.601 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:07:42.601 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.601 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:07:42.601 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:07:42.601 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:07:42.601 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.601 INFO:tasks.workunit.client.0.smithi153.stderr: -410> 2024-09-19T14:07:42.200+0000 7f9020e09640 10 monclient: _finish_auth 0 2024-09-19T14:07:42.601 INFO:tasks.workunit.client.0.smithi153.stderr: -409> 2024-09-19T14:07:42.200+0000 7f9020e09640 10 monclient: _check_auth_tickets 2024-09-19T14:07:42.601 INFO:tasks.workunit.client.0.smithi153.stderr: -408> 2024-09-19T14:07:42.200+0000 7f9020e09640 10 monclient: handle_config config(0 keys) 2024-09-19T14:07:42.601 INFO:tasks.workunit.client.0.smithi153.stderr: -407> 2024-09-19T14:07:42.200+0000 7f9020e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:07:42.601 INFO:tasks.workunit.client.0.smithi153.stderr: -406> 2024-09-19T14:07:42.200+0000 7f9020e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:07:42.601 INFO:tasks.workunit.client.0.smithi153.stderr: -405> 2024-09-19T14:07:42.200+0000 7f9020e09640 10 monclient: dump: 2024-09-19T14:07:42.602 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:07:42.602 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:07:42.602 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.602 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.602 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:07:42.602 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.602 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:07:42.602 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:07:42.602 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:07:42.602 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.602 INFO:tasks.workunit.client.0.smithi153.stderr: -404> 2024-09-19T14:07:42.200+0000 7f902260c640 4 set_mon_vals no callback set 2024-09-19T14:07:42.602 INFO:tasks.workunit.client.0.smithi153.stderr: -403> 2024-09-19T14:07:42.200+0000 7f91366679c0 5 monclient: authenticate success, global_id 6840 2024-09-19T14:07:42.602 INFO:tasks.workunit.client.0.smithi153.stderr: -402> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient: _renew_subs 2024-09-19T14:07:42.603 INFO:tasks.workunit.client.0.smithi153.stderr: -401> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:07:42.603 INFO:tasks.workunit.client.0.smithi153.stderr: -400> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient: _renew_subs 2024-09-19T14:07:42.603 INFO:tasks.workunit.client.0.smithi153.stderr: -399> 2024-09-19T14:07:42.200+0000 7f91366679c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:07:42.603 INFO:tasks.workunit.client.0.smithi153.stderr: -398> 2024-09-19T14:07:42.200+0000 7f91366679c0 1 librados: init done 2024-09-19T14:07:42.603 INFO:tasks.workunit.client.0.smithi153.stderr: -397> 2024-09-19T14:07:42.204+0000 7f9020e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:07:42.603 INFO:tasks.workunit.client.0.smithi153.stderr: -396> 2024-09-19T14:07:42.204+0000 7f9020e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:07:42.603 INFO:tasks.workunit.client.0.smithi153.stderr: -395> 2024-09-19T14:07:42.204+0000 7f9020e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:07:42.603 INFO:tasks.workunit.client.0.smithi153.stderr: -394> 2024-09-19T14:07:42.204+0000 7f913416d640 10 monclient: get_auth_request con 0x7f901c071c10 auth_method 0 2024-09-19T14:07:42.603 INFO:tasks.workunit.client.0.smithi153.stderr: -393> 2024-09-19T14:07:42.204+0000 7f913496e640 10 monclient: get_auth_request con 0x55b8335e2de0 auth_method 0 2024-09-19T14:07:42.603 INFO:tasks.workunit.client.0.smithi153.stderr: -392> 2024-09-19T14:07:42.204+0000 7f913416d640 10 monclient: get_auth_request con 0x55b8335ef890 auth_method 0 2024-09-19T14:07:42.603 INFO:tasks.workunit.client.0.smithi153.stderr: -391> 2024-09-19T14:07:42.208+0000 7f913396c640 10 monclient: get_auth_request con 0x55b8335f3110 auth_method 0 2024-09-19T14:07:42.603 INFO:tasks.workunit.client.0.smithi153.stderr: -390> 2024-09-19T14:07:42.208+0000 7f91366679c0 10 monclient: build_initial_monmap 2024-09-19T14:07:42.603 INFO:tasks.workunit.client.0.smithi153.stderr: -389> 2024-09-19T14:07:42.208+0000 7f91366679c0 1 build_initial for_mkfs: 0 2024-09-19T14:07:42.604 INFO:tasks.workunit.client.0.smithi153.stderr: -388> 2024-09-19T14:07:42.208+0000 7f91366679c0 10 monclient: monmap: 2024-09-19T14:07:42.604 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:07:42.604 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:07:42.604 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:07:42.604 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:07:42.604 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:07:42.604 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.604 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:07:42.604 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:07:42.604 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:07:42.604 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.604 INFO:tasks.workunit.client.0.smithi153.stderr: -387> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding auth protocol: cephx 2024-09-19T14:07:42.604 INFO:tasks.workunit.client.0.smithi153.stderr: -386> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding auth protocol: cephx 2024-09-19T14:07:42.604 INFO:tasks.workunit.client.0.smithi153.stderr: -385> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding auth protocol: cephx 2024-09-19T14:07:42.605 INFO:tasks.workunit.client.0.smithi153.stderr: -384> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding con mode: secure 2024-09-19T14:07:42.605 INFO:tasks.workunit.client.0.smithi153.stderr: -383> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding con mode: crc 2024-09-19T14:07:42.605 INFO:tasks.workunit.client.0.smithi153.stderr: -382> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding con mode: secure 2024-09-19T14:07:42.605 INFO:tasks.workunit.client.0.smithi153.stderr: -381> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding con mode: crc 2024-09-19T14:07:42.605 INFO:tasks.workunit.client.0.smithi153.stderr: -380> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding con mode: secure 2024-09-19T14:07:42.605 INFO:tasks.workunit.client.0.smithi153.stderr: -379> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding con mode: crc 2024-09-19T14:07:42.605 INFO:tasks.workunit.client.0.smithi153.stderr: -378> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding con mode: crc 2024-09-19T14:07:42.605 INFO:tasks.workunit.client.0.smithi153.stderr: -377> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding con mode: secure 2024-09-19T14:07:42.605 INFO:tasks.workunit.client.0.smithi153.stderr: -376> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding con mode: crc 2024-09-19T14:07:42.605 INFO:tasks.workunit.client.0.smithi153.stderr: -375> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding con mode: secure 2024-09-19T14:07:42.605 INFO:tasks.workunit.client.0.smithi153.stderr: -374> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding con mode: crc 2024-09-19T14:07:42.605 INFO:tasks.workunit.client.0.smithi153.stderr: -373> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f8b40) adding con mode: secure 2024-09-19T14:07:42.605 INFO:tasks.workunit.client.0.smithi153.stderr: -372> 2024-09-19T14:07:42.208+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.606 INFO:tasks.workunit.client.0.smithi153.stderr: -371> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 asok(0x55b833398d90) register_command objecter_requests cmddesc objecter_requests hook 0x55b8335fc530 EEXIST 2024-09-19T14:07:42.606 INFO:tasks.workunit.client.0.smithi153.stderr: -370> 2024-09-19T14:07:42.208+0000 7f91366679c0 10 monclient: init 2024-09-19T14:07:42.606 INFO:tasks.workunit.client.0.smithi153.stderr: -369> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding auth protocol: cephx 2024-09-19T14:07:42.606 INFO:tasks.workunit.client.0.smithi153.stderr: -368> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding auth protocol: cephx 2024-09-19T14:07:42.606 INFO:tasks.workunit.client.0.smithi153.stderr: -367> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding auth protocol: cephx 2024-09-19T14:07:42.606 INFO:tasks.workunit.client.0.smithi153.stderr: -366> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding con mode: secure 2024-09-19T14:07:42.606 INFO:tasks.workunit.client.0.smithi153.stderr: -365> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding con mode: crc 2024-09-19T14:07:42.606 INFO:tasks.workunit.client.0.smithi153.stderr: -364> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding con mode: secure 2024-09-19T14:07:42.606 INFO:tasks.workunit.client.0.smithi153.stderr: -363> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding con mode: crc 2024-09-19T14:07:42.606 INFO:tasks.workunit.client.0.smithi153.stderr: -362> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding con mode: secure 2024-09-19T14:07:42.606 INFO:tasks.workunit.client.0.smithi153.stderr: -361> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding con mode: crc 2024-09-19T14:07:42.606 INFO:tasks.workunit.client.0.smithi153.stderr: -360> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding con mode: crc 2024-09-19T14:07:42.606 INFO:tasks.workunit.client.0.smithi153.stderr: -359> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding con mode: secure 2024-09-19T14:07:42.607 INFO:tasks.workunit.client.0.smithi153.stderr: -358> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding con mode: crc 2024-09-19T14:07:42.607 INFO:tasks.workunit.client.0.smithi153.stderr: -357> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding con mode: secure 2024-09-19T14:07:42.607 INFO:tasks.workunit.client.0.smithi153.stderr: -356> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding con mode: crc 2024-09-19T14:07:42.607 INFO:tasks.workunit.client.0.smithi153.stderr: -355> 2024-09-19T14:07:42.208+0000 7f91366679c0 5 AuthRegistry(0x55b8335f7af8) adding con mode: secure 2024-09-19T14:07:42.607 INFO:tasks.workunit.client.0.smithi153.stderr: -354> 2024-09-19T14:07:42.208+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.607 INFO:tasks.workunit.client.0.smithi153.stderr: -353> 2024-09-19T14:07:42.212+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.607 INFO:tasks.workunit.client.0.smithi153.stderr: -352> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 asok(0x55b833398d90) register_command rotate-key cmddesc rotate-key hook 0x55b8335f7c40 EEXIST 2024-09-19T14:07:42.607 INFO:tasks.workunit.client.0.smithi153.stderr: -351> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient: _reopen_session rank -1 2024-09-19T14:07:42.607 INFO:tasks.workunit.client.0.smithi153.stderr: -350> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T14:07:42.607 INFO:tasks.workunit.client.0.smithi153.stderr: -349> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient(hunting): picked mon.noname-b con 0x55b8336206e0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:07:42.607 INFO:tasks.workunit.client.0.smithi153.stderr: -348> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient(hunting): picked mon.noname-c con 0x55b833620010 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:07:42.607 INFO:tasks.workunit.client.0.smithi153.stderr: -347> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient(hunting): picked mon.noname-a con 0x55b83361e9f0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:07:42.607 INFO:tasks.workunit.client.0.smithi153.stderr: -346> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:07:42.608 INFO:tasks.workunit.client.0.smithi153.stderr: -345> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:07:42.608 INFO:tasks.workunit.client.0.smithi153.stderr: -344> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:07:42.608 INFO:tasks.workunit.client.0.smithi153.stderr: -343> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient(hunting): _renew_subs 2024-09-19T14:07:42.608 INFO:tasks.workunit.client.0.smithi153.stderr: -342> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient(hunting): authenticate will time out at 2650.676432s 2024-09-19T14:07:42.608 INFO:tasks.workunit.client.0.smithi153.stderr: -341> 2024-09-19T14:07:42.212+0000 7f913396c640 10 monclient(hunting): get_auth_request con 0x55b833620010 auth_method 0 2024-09-19T14:07:42.608 INFO:tasks.workunit.client.0.smithi153.stderr: -340> 2024-09-19T14:07:42.212+0000 7f913396c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:07:42.608 INFO:tasks.workunit.client.0.smithi153.stderr: -339> 2024-09-19T14:07:42.212+0000 7f913396c640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:07:42.608 INFO:tasks.workunit.client.0.smithi153.stderr: -338> 2024-09-19T14:07:42.212+0000 7f913396c640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:07:42.608 INFO:tasks.workunit.client.0.smithi153.stderr: -337> 2024-09-19T14:07:42.212+0000 7f913496e640 10 monclient(hunting): get_auth_request con 0x55b83361e9f0 auth_method 0 2024-09-19T14:07:42.608 INFO:tasks.workunit.client.0.smithi153.stderr: -336> 2024-09-19T14:07:42.212+0000 7f913496e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:07:42.608 INFO:tasks.workunit.client.0.smithi153.stderr: -335> 2024-09-19T14:07:42.212+0000 7f913496e640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:07:42.609 INFO:tasks.workunit.client.0.smithi153.stderr: -334> 2024-09-19T14:07:42.212+0000 7f913496e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:07:42.609 INFO:tasks.workunit.client.0.smithi153.stderr: -333> 2024-09-19T14:07:42.212+0000 7f913396c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:07:42.609 INFO:tasks.workunit.client.0.smithi153.stderr: -332> 2024-09-19T14:07:42.212+0000 7f913396c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:07:42.609 INFO:tasks.workunit.client.0.smithi153.stderr: -331> 2024-09-19T14:07:42.212+0000 7f913396c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:07:42.609 INFO:tasks.workunit.client.0.smithi153.stderr: -330> 2024-09-19T14:07:42.212+0000 7f913496e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:07:42.609 INFO:tasks.workunit.client.0.smithi153.stderr: -329> 2024-09-19T14:07:42.212+0000 7f913496e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:07:42.609 INFO:tasks.workunit.client.0.smithi153.stderr: -328> 2024-09-19T14:07:42.212+0000 7f913496e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:07:42.609 INFO:tasks.workunit.client.0.smithi153.stderr: -327> 2024-09-19T14:07:42.212+0000 7f913416d640 10 monclient(hunting): get_auth_request con 0x55b8336206e0 auth_method 0 2024-09-19T14:07:42.609 INFO:tasks.workunit.client.0.smithi153.stderr: -326> 2024-09-19T14:07:42.212+0000 7f913416d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:07:42.609 INFO:tasks.workunit.client.0.smithi153.stderr: -325> 2024-09-19T14:07:42.212+0000 7f913416d640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:07:42.609 INFO:tasks.workunit.client.0.smithi153.stderr: -324> 2024-09-19T14:07:42.212+0000 7f913416d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:07:42.609 INFO:tasks.workunit.client.0.smithi153.stderr: -323> 2024-09-19T14:07:42.212+0000 7f913396c640 10 monclient(hunting): handle_auth_done global_id 6425 payload 824 2024-09-19T14:07:42.609 INFO:tasks.workunit.client.0.smithi153.stderr: -322> 2024-09-19T14:07:42.212+0000 7f913396c640 10 monclient: _finish_hunting 0 2024-09-19T14:07:42.610 INFO:tasks.workunit.client.0.smithi153.stderr: -321> 2024-09-19T14:07:42.212+0000 7f913396c640 1 monclient: found mon.noname-c 2024-09-19T14:07:42.610 INFO:tasks.workunit.client.0.smithi153.stderr: -320> 2024-09-19T14:07:42.212+0000 7f913396c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:07:42.610 INFO:tasks.workunit.client.0.smithi153.stderr: -319> 2024-09-19T14:07:42.212+0000 7f9019ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:07:42.610 INFO:tasks.workunit.client.0.smithi153.stderr: -318> 2024-09-19T14:07:42.212+0000 7f9019ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:07:42.610 INFO:tasks.workunit.client.0.smithi153.stderr: -317> 2024-09-19T14:07:42.212+0000 7f9019ffb640 10 monclient: dump: 2024-09-19T14:07:42.610 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:07:42.610 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:07:42.610 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.610 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.610 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:07:42.610 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.610 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:07:42.610 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:07:42.610 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:07:42.611 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.611 INFO:tasks.workunit.client.0.smithi153.stderr: -316> 2024-09-19T14:07:42.212+0000 7f9019ffb640 10 monclient: _finish_auth 0 2024-09-19T14:07:42.611 INFO:tasks.workunit.client.0.smithi153.stderr: -315> 2024-09-19T14:07:42.212+0000 7f9019ffb640 10 monclient: _check_auth_tickets 2024-09-19T14:07:42.611 INFO:tasks.workunit.client.0.smithi153.stderr: -314> 2024-09-19T14:07:42.212+0000 7f9019ffb640 10 monclient: handle_config config(0 keys) 2024-09-19T14:07:42.611 INFO:tasks.workunit.client.0.smithi153.stderr: -313> 2024-09-19T14:07:42.212+0000 7f9019ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:07:42.611 INFO:tasks.workunit.client.0.smithi153.stderr: -312> 2024-09-19T14:07:42.212+0000 7f9019ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:07:42.611 INFO:tasks.workunit.client.0.smithi153.stderr: -311> 2024-09-19T14:07:42.212+0000 7f9019ffb640 10 monclient: dump: 2024-09-19T14:07:42.611 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:07:42.611 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:07:42.611 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.611 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.611 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:07:42.611 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.611 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:07:42.611 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:07:42.612 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:07:42.612 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.612 INFO:tasks.workunit.client.0.smithi153.stderr: -310> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 monclient: authenticate success, global_id 6425 2024-09-19T14:07:42.612 INFO:tasks.workunit.client.0.smithi153.stderr: -309> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient: _renew_subs 2024-09-19T14:07:42.612 INFO:tasks.workunit.client.0.smithi153.stderr: -308> 2024-09-19T14:07:42.212+0000 7f913516f640 4 set_mon_vals no callback set 2024-09-19T14:07:42.612 INFO:tasks.workunit.client.0.smithi153.stderr: -307> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:07:42.612 INFO:tasks.workunit.client.0.smithi153.stderr: -306> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient: _renew_subs 2024-09-19T14:07:42.612 INFO:tasks.workunit.client.0.smithi153.stderr: -305> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:07:42.612 INFO:tasks.workunit.client.0.smithi153.stderr: -304> 2024-09-19T14:07:42.212+0000 7f9019ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:07:42.612 INFO:tasks.workunit.client.0.smithi153.stderr: -303> 2024-09-19T14:07:42.212+0000 7f9019ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:07:42.612 INFO:tasks.workunit.client.0.smithi153.stderr: -302> 2024-09-19T14:07:42.212+0000 7f9019ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:07:42.612 INFO:tasks.workunit.client.0.smithi153.stderr: -301> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient: get_monmap_and_config 2024-09-19T14:07:42.612 INFO:tasks.workunit.client.0.smithi153.stderr: -300> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient: build_initial_monmap 2024-09-19T14:07:42.612 INFO:tasks.workunit.client.0.smithi153.stderr: -299> 2024-09-19T14:07:42.212+0000 7f91366679c0 1 build_initial for_mkfs: 0 2024-09-19T14:07:42.612 INFO:tasks.workunit.client.0.smithi153.stderr: -298> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient: monmap: 2024-09-19T14:07:42.613 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:07:42.613 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:07:42.613 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:07:42.613 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:07:42.613 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:07:42.613 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.613 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:07:42.613 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:07:42.613 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:07:42.613 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.613 INFO:tasks.workunit.client.0.smithi153.stderr: -297> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding auth protocol: cephx 2024-09-19T14:07:42.613 INFO:tasks.workunit.client.0.smithi153.stderr: -296> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding auth protocol: cephx 2024-09-19T14:07:42.613 INFO:tasks.workunit.client.0.smithi153.stderr: -295> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding auth protocol: cephx 2024-09-19T14:07:42.613 INFO:tasks.workunit.client.0.smithi153.stderr: -294> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding con mode: secure 2024-09-19T14:07:42.614 INFO:tasks.workunit.client.0.smithi153.stderr: -293> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding con mode: crc 2024-09-19T14:07:42.614 INFO:tasks.workunit.client.0.smithi153.stderr: -292> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding con mode: secure 2024-09-19T14:07:42.614 INFO:tasks.workunit.client.0.smithi153.stderr: -291> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding con mode: crc 2024-09-19T14:07:42.614 INFO:tasks.workunit.client.0.smithi153.stderr: -290> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding con mode: secure 2024-09-19T14:07:42.614 INFO:tasks.workunit.client.0.smithi153.stderr: -289> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding con mode: crc 2024-09-19T14:07:42.614 INFO:tasks.workunit.client.0.smithi153.stderr: -288> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding con mode: crc 2024-09-19T14:07:42.614 INFO:tasks.workunit.client.0.smithi153.stderr: -287> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding con mode: secure 2024-09-19T14:07:42.614 INFO:tasks.workunit.client.0.smithi153.stderr: -286> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding con mode: crc 2024-09-19T14:07:42.614 INFO:tasks.workunit.client.0.smithi153.stderr: -285> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding con mode: secure 2024-09-19T14:07:42.614 INFO:tasks.workunit.client.0.smithi153.stderr: -284> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding con mode: crc 2024-09-19T14:07:42.614 INFO:tasks.workunit.client.0.smithi153.stderr: -283> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x55b83363fba0) adding con mode: secure 2024-09-19T14:07:42.614 INFO:tasks.workunit.client.0.smithi153.stderr: -282> 2024-09-19T14:07:42.212+0000 7f913416d640 10 monclient: get_auth_request con 0x7f900c071b20 auth_method 0 2024-09-19T14:07:42.614 INFO:tasks.workunit.client.0.smithi153.stderr: -281> 2024-09-19T14:07:42.212+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.614 INFO:tasks.workunit.client.0.smithi153.stderr: -280> 2024-09-19T14:07:42.212+0000 7f91366679c0 10 monclient: init 2024-09-19T14:07:42.615 INFO:tasks.workunit.client.0.smithi153.stderr: -279> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding auth protocol: cephx 2024-09-19T14:07:42.615 INFO:tasks.workunit.client.0.smithi153.stderr: -278> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding auth protocol: cephx 2024-09-19T14:07:42.615 INFO:tasks.workunit.client.0.smithi153.stderr: -277> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding auth protocol: cephx 2024-09-19T14:07:42.615 INFO:tasks.workunit.client.0.smithi153.stderr: -276> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding con mode: secure 2024-09-19T14:07:42.615 INFO:tasks.workunit.client.0.smithi153.stderr: -275> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding con mode: crc 2024-09-19T14:07:42.615 INFO:tasks.workunit.client.0.smithi153.stderr: -274> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding con mode: secure 2024-09-19T14:07:42.615 INFO:tasks.workunit.client.0.smithi153.stderr: -273> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding con mode: crc 2024-09-19T14:07:42.615 INFO:tasks.workunit.client.0.smithi153.stderr: -272> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding con mode: secure 2024-09-19T14:07:42.615 INFO:tasks.workunit.client.0.smithi153.stderr: -271> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding con mode: crc 2024-09-19T14:07:42.615 INFO:tasks.workunit.client.0.smithi153.stderr: -270> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding con mode: crc 2024-09-19T14:07:42.615 INFO:tasks.workunit.client.0.smithi153.stderr: -269> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding con mode: secure 2024-09-19T14:07:42.615 INFO:tasks.workunit.client.0.smithi153.stderr: -268> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding con mode: crc 2024-09-19T14:07:42.615 INFO:tasks.workunit.client.0.smithi153.stderr: -267> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding con mode: secure 2024-09-19T14:07:42.615 INFO:tasks.workunit.client.0.smithi153.stderr: -266> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding con mode: crc 2024-09-19T14:07:42.615 INFO:tasks.workunit.client.0.smithi153.stderr: -265> 2024-09-19T14:07:42.212+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7ca10) adding con mode: secure 2024-09-19T14:07:42.616 INFO:tasks.workunit.client.0.smithi153.stderr: -264> 2024-09-19T14:07:42.212+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.616 INFO:tasks.workunit.client.0.smithi153.stderr: -263> 2024-09-19T14:07:42.216+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.616 INFO:tasks.workunit.client.0.smithi153.stderr: -262> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 asok(0x55b833398d90) register_command rotate-key cmddesc rotate-key hook 0x7ffebfa7cb58 EEXIST 2024-09-19T14:07:42.616 INFO:tasks.workunit.client.0.smithi153.stderr: -261> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: _reopen_session rank -1 2024-09-19T14:07:42.616 INFO:tasks.workunit.client.0.smithi153.stderr: -260> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T14:07:42.616 INFO:tasks.workunit.client.0.smithi153.stderr: -259> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): picked mon.noname-c con 0x55b833674060 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:07:42.616 INFO:tasks.workunit.client.0.smithi153.stderr: -258> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): picked mon.noname-a con 0x55b83366f4a0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:07:42.616 INFO:tasks.workunit.client.0.smithi153.stderr: -257> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): picked mon.noname-b con 0x55b833665b70 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:07:42.616 INFO:tasks.workunit.client.0.smithi153.stderr: -256> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:07:42.616 INFO:tasks.workunit.client.0.smithi153.stderr: -255> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:07:42.616 INFO:tasks.workunit.client.0.smithi153.stderr: -254> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:07:42.616 INFO:tasks.workunit.client.0.smithi153.stderr: -253> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): _renew_subs 2024-09-19T14:07:42.616 INFO:tasks.workunit.client.0.smithi153.stderr: -252> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): authenticate will time out at 2650.680341s 2024-09-19T14:07:42.616 INFO:tasks.workunit.client.0.smithi153.stderr: -251> 2024-09-19T14:07:42.216+0000 7f913416d640 10 monclient(hunting): get_auth_request con 0x55b833674060 auth_method 0 2024-09-19T14:07:42.617 INFO:tasks.workunit.client.0.smithi153.stderr: -250> 2024-09-19T14:07:42.216+0000 7f913416d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:07:42.617 INFO:tasks.workunit.client.0.smithi153.stderr: -249> 2024-09-19T14:07:42.216+0000 7f913416d640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:07:42.617 INFO:tasks.workunit.client.0.smithi153.stderr: -248> 2024-09-19T14:07:42.216+0000 7f913416d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:07:42.617 INFO:tasks.workunit.client.0.smithi153.stderr: -247> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): get_auth_request con 0x55b83366f4a0 auth_method 0 2024-09-19T14:07:42.617 INFO:tasks.workunit.client.0.smithi153.stderr: -246> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:07:42.617 INFO:tasks.workunit.client.0.smithi153.stderr: -245> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:07:42.617 INFO:tasks.workunit.client.0.smithi153.stderr: -244> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:07:42.617 INFO:tasks.workunit.client.0.smithi153.stderr: -243> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:07:42.617 INFO:tasks.workunit.client.0.smithi153.stderr: -242> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:07:42.617 INFO:tasks.workunit.client.0.smithi153.stderr: -241> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:07:42.617 INFO:tasks.workunit.client.0.smithi153.stderr: -240> 2024-09-19T14:07:42.216+0000 7f913416d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:07:42.617 INFO:tasks.workunit.client.0.smithi153.stderr: -239> 2024-09-19T14:07:42.216+0000 7f913416d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:07:42.617 INFO:tasks.workunit.client.0.smithi153.stderr: -238> 2024-09-19T14:07:42.216+0000 7f913416d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:07:42.618 INFO:tasks.workunit.client.0.smithi153.stderr: -237> 2024-09-19T14:07:42.216+0000 7f913496e640 10 monclient(hunting): get_auth_request con 0x55b833665b70 auth_method 0 2024-09-19T14:07:42.618 INFO:tasks.workunit.client.0.smithi153.stderr: -236> 2024-09-19T14:07:42.216+0000 7f913496e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:07:42.618 INFO:tasks.workunit.client.0.smithi153.stderr: -235> 2024-09-19T14:07:42.216+0000 7f913496e640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:07:42.618 INFO:tasks.workunit.client.0.smithi153.stderr: -234> 2024-09-19T14:07:42.216+0000 7f913496e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:07:42.618 INFO:tasks.workunit.client.0.smithi153.stderr: -233> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): handle_auth_done global_id 6846 payload 274 2024-09-19T14:07:42.618 INFO:tasks.workunit.client.0.smithi153.stderr: -232> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient: _finish_hunting 0 2024-09-19T14:07:42.618 INFO:tasks.workunit.client.0.smithi153.stderr: -231> 2024-09-19T14:07:42.216+0000 7f913396c640 1 monclient: found mon.noname-a 2024-09-19T14:07:42.618 INFO:tasks.workunit.client.0.smithi153.stderr: -230> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:07:42.618 INFO:tasks.workunit.client.0.smithi153.stderr: -229> 2024-09-19T14:07:42.216+0000 7f900b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:07:42.618 INFO:tasks.workunit.client.0.smithi153.stderr: -228> 2024-09-19T14:07:42.216+0000 7f900b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:07:42.618 INFO:tasks.workunit.client.0.smithi153.stderr: -227> 2024-09-19T14:07:42.216+0000 7f900b7fe640 10 monclient: dump: 2024-09-19T14:07:42.618 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:07:42.618 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:07:42.618 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.619 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.619 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:07:42.619 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.619 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:07:42.619 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:07:42.619 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:07:42.619 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.619 INFO:tasks.workunit.client.0.smithi153.stderr: -226> 2024-09-19T14:07:42.216+0000 7f900b7fe640 10 monclient: _finish_auth 0 2024-09-19T14:07:42.619 INFO:tasks.workunit.client.0.smithi153.stderr: -225> 2024-09-19T14:07:42.216+0000 7f900b7fe640 10 monclient: _check_auth_tickets 2024-09-19T14:07:42.619 INFO:tasks.workunit.client.0.smithi153.stderr: -224> 2024-09-19T14:07:42.216+0000 7f900b7fe640 10 monclient: handle_config config(0 keys) 2024-09-19T14:07:42.619 INFO:tasks.workunit.client.0.smithi153.stderr: -223> 2024-09-19T14:07:42.216+0000 7f900b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:07:42.619 INFO:tasks.workunit.client.0.smithi153.stderr: -222> 2024-09-19T14:07:42.216+0000 7f900b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:07:42.619 INFO:tasks.workunit.client.0.smithi153.stderr: -221> 2024-09-19T14:07:42.216+0000 7f900b7fe640 10 monclient: dump: 2024-09-19T14:07:42.619 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:07:42.620 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:07:42.620 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.620 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.620 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:07:42.620 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.620 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:07:42.620 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:07:42.620 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:07:42.620 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.620 INFO:tasks.workunit.client.0.smithi153.stderr: -220> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 monclient: authenticate success, global_id 6846 2024-09-19T14:07:42.620 INFO:tasks.workunit.client.0.smithi153.stderr: -219> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: get_monmap_and_config success 2024-09-19T14:07:42.620 INFO:tasks.workunit.client.0.smithi153.stderr: -218> 2024-09-19T14:07:42.216+0000 7f91366679c0 4 set_mon_vals no callback set 2024-09-19T14:07:42.620 INFO:tasks.workunit.client.0.smithi153.stderr: -217> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: shutdown 2024-09-19T14:07:42.621 INFO:tasks.workunit.client.0.smithi153.stderr: -216> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: build_initial_monmap 2024-09-19T14:07:42.621 INFO:tasks.workunit.client.0.smithi153.stderr: -215> 2024-09-19T14:07:42.216+0000 7f91366679c0 1 build_initial for_mkfs: 0 2024-09-19T14:07:42.621 INFO:tasks.workunit.client.0.smithi153.stderr: -214> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: monmap: 2024-09-19T14:07:42.621 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:07:42.621 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:07:42.621 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:07:42.621 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:07:42.621 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:07:42.621 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.621 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:07:42.621 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:07:42.621 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:07:42.621 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.621 INFO:tasks.workunit.client.0.smithi153.stderr: -213> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding auth protocol: cephx 2024-09-19T14:07:42.622 INFO:tasks.workunit.client.0.smithi153.stderr: -212> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding auth protocol: cephx 2024-09-19T14:07:42.622 INFO:tasks.workunit.client.0.smithi153.stderr: -211> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding auth protocol: cephx 2024-09-19T14:07:42.622 INFO:tasks.workunit.client.0.smithi153.stderr: -210> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding con mode: secure 2024-09-19T14:07:42.622 INFO:tasks.workunit.client.0.smithi153.stderr: -209> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding con mode: crc 2024-09-19T14:07:42.622 INFO:tasks.workunit.client.0.smithi153.stderr: -208> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding con mode: secure 2024-09-19T14:07:42.622 INFO:tasks.workunit.client.0.smithi153.stderr: -207> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding con mode: crc 2024-09-19T14:07:42.622 INFO:tasks.workunit.client.0.smithi153.stderr: -206> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding con mode: secure 2024-09-19T14:07:42.622 INFO:tasks.workunit.client.0.smithi153.stderr: -205> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding con mode: crc 2024-09-19T14:07:42.622 INFO:tasks.workunit.client.0.smithi153.stderr: -204> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding con mode: crc 2024-09-19T14:07:42.622 INFO:tasks.workunit.client.0.smithi153.stderr: -203> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding con mode: secure 2024-09-19T14:07:42.622 INFO:tasks.workunit.client.0.smithi153.stderr: -202> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding con mode: crc 2024-09-19T14:07:42.622 INFO:tasks.workunit.client.0.smithi153.stderr: -201> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding con mode: secure 2024-09-19T14:07:42.622 INFO:tasks.workunit.client.0.smithi153.stderr: -200> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding con mode: crc 2024-09-19T14:07:42.623 INFO:tasks.workunit.client.0.smithi153.stderr: -199> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833666060) adding con mode: secure 2024-09-19T14:07:42.623 INFO:tasks.workunit.client.0.smithi153.stderr: -198> 2024-09-19T14:07:42.216+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.623 INFO:tasks.workunit.client.0.smithi153.stderr: -197> 2024-09-19T14:07:42.216+0000 7f91366679c0 1 librados: starting msgr at 2024-09-19T14:07:42.623 INFO:tasks.workunit.client.0.smithi153.stderr: -196> 2024-09-19T14:07:42.216+0000 7f91366679c0 1 librados: starting objecter 2024-09-19T14:07:42.623 INFO:tasks.workunit.client.0.smithi153.stderr: -195> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 asok(0x55b833398d90) register_command objecter_requests cmddesc objecter_requests hook 0x55b833673b80 EEXIST 2024-09-19T14:07:42.623 INFO:tasks.workunit.client.0.smithi153.stderr: -194> 2024-09-19T14:07:42.216+0000 7f91366679c0 1 librados: setting wanted keys 2024-09-19T14:07:42.623 INFO:tasks.workunit.client.0.smithi153.stderr: -193> 2024-09-19T14:07:42.216+0000 7f91366679c0 1 librados: calling monclient init 2024-09-19T14:07:42.623 INFO:tasks.workunit.client.0.smithi153.stderr: -192> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: init 2024-09-19T14:07:42.623 INFO:tasks.workunit.client.0.smithi153.stderr: -191> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding auth protocol: cephx 2024-09-19T14:07:42.623 INFO:tasks.workunit.client.0.smithi153.stderr: -190> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding auth protocol: cephx 2024-09-19T14:07:42.623 INFO:tasks.workunit.client.0.smithi153.stderr: -189> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding auth protocol: cephx 2024-09-19T14:07:42.623 INFO:tasks.workunit.client.0.smithi153.stderr: -188> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding con mode: secure 2024-09-19T14:07:42.623 INFO:tasks.workunit.client.0.smithi153.stderr: -187> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding con mode: crc 2024-09-19T14:07:42.623 INFO:tasks.workunit.client.0.smithi153.stderr: -186> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding con mode: secure 2024-09-19T14:07:42.623 INFO:tasks.workunit.client.0.smithi153.stderr: -185> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding con mode: crc 2024-09-19T14:07:42.624 INFO:tasks.workunit.client.0.smithi153.stderr: -184> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding con mode: secure 2024-09-19T14:07:42.624 INFO:tasks.workunit.client.0.smithi153.stderr: -183> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding con mode: crc 2024-09-19T14:07:42.624 INFO:tasks.workunit.client.0.smithi153.stderr: -182> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding con mode: crc 2024-09-19T14:07:42.624 INFO:tasks.workunit.client.0.smithi153.stderr: -181> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding con mode: secure 2024-09-19T14:07:42.624 INFO:tasks.workunit.client.0.smithi153.stderr: -180> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding con mode: crc 2024-09-19T14:07:42.624 INFO:tasks.workunit.client.0.smithi153.stderr: -179> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding con mode: secure 2024-09-19T14:07:42.624 INFO:tasks.workunit.client.0.smithi153.stderr: -178> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding con mode: crc 2024-09-19T14:07:42.624 INFO:tasks.workunit.client.0.smithi153.stderr: -177> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 AuthRegistry(0x55b833622500) adding con mode: secure 2024-09-19T14:07:42.624 INFO:tasks.workunit.client.0.smithi153.stderr: -176> 2024-09-19T14:07:42.216+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.624 INFO:tasks.workunit.client.0.smithi153.stderr: -175> 2024-09-19T14:07:42.216+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.624 INFO:tasks.workunit.client.0.smithi153.stderr: -174> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 asok(0x55b833398d90) register_command rotate-key cmddesc rotate-key hook 0x55b833622648 EEXIST 2024-09-19T14:07:42.624 INFO:tasks.workunit.client.0.smithi153.stderr: -173> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: _reopen_session rank -1 2024-09-19T14:07:42.624 INFO:tasks.workunit.client.0.smithi153.stderr: -172> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:07:42.624 INFO:tasks.workunit.client.0.smithi153.stderr: -171> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): picked mon.noname-b con 0x55b833665b70 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:07:42.625 INFO:tasks.workunit.client.0.smithi153.stderr: -170> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): picked mon.noname-a con 0x55b83366f4a0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:07:42.625 INFO:tasks.workunit.client.0.smithi153.stderr: -169> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): picked mon.noname-c con 0x55b833674060 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:07:42.625 INFO:tasks.workunit.client.0.smithi153.stderr: -168> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:07:42.625 INFO:tasks.workunit.client.0.smithi153.stderr: -167> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:07:42.625 INFO:tasks.workunit.client.0.smithi153.stderr: -166> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:07:42.625 INFO:tasks.workunit.client.0.smithi153.stderr: -165> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): _renew_subs 2024-09-19T14:07:42.625 INFO:tasks.workunit.client.0.smithi153.stderr: -164> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient(hunting): authenticate will time out at 2650.682947s 2024-09-19T14:07:42.625 INFO:tasks.workunit.client.0.smithi153.stderr: -163> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): get_auth_request con 0x55b83366f4a0 auth_method 0 2024-09-19T14:07:42.625 INFO:tasks.workunit.client.0.smithi153.stderr: -162> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:07:42.625 INFO:tasks.workunit.client.0.smithi153.stderr: -161> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:07:42.625 INFO:tasks.workunit.client.0.smithi153.stderr: -160> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:07:42.625 INFO:tasks.workunit.client.0.smithi153.stderr: -159> 2024-09-19T14:07:42.216+0000 7f913496e640 10 monclient(hunting): get_auth_request con 0x55b833674060 auth_method 0 2024-09-19T14:07:42.625 INFO:tasks.workunit.client.0.smithi153.stderr: -158> 2024-09-19T14:07:42.216+0000 7f913496e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:07:42.626 INFO:tasks.workunit.client.0.smithi153.stderr: -157> 2024-09-19T14:07:42.216+0000 7f913496e640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:07:42.626 INFO:tasks.workunit.client.0.smithi153.stderr: -156> 2024-09-19T14:07:42.216+0000 7f913496e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:07:42.626 INFO:tasks.workunit.client.0.smithi153.stderr: -155> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:07:42.626 INFO:tasks.workunit.client.0.smithi153.stderr: -154> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:07:42.626 INFO:tasks.workunit.client.0.smithi153.stderr: -153> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:07:42.626 INFO:tasks.workunit.client.0.smithi153.stderr: -152> 2024-09-19T14:07:42.216+0000 7f913496e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:07:42.626 INFO:tasks.workunit.client.0.smithi153.stderr: -151> 2024-09-19T14:07:42.216+0000 7f913496e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:07:42.626 INFO:tasks.workunit.client.0.smithi153.stderr: -150> 2024-09-19T14:07:42.216+0000 7f913496e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:07:42.626 INFO:tasks.workunit.client.0.smithi153.stderr: -149> 2024-09-19T14:07:42.216+0000 7f913416d640 10 monclient(hunting): get_auth_request con 0x55b833665b70 auth_method 0 2024-09-19T14:07:42.626 INFO:tasks.workunit.client.0.smithi153.stderr: -148> 2024-09-19T14:07:42.216+0000 7f913416d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:07:42.626 INFO:tasks.workunit.client.0.smithi153.stderr: -147> 2024-09-19T14:07:42.216+0000 7f913416d640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:07:42.626 INFO:tasks.workunit.client.0.smithi153.stderr: -146> 2024-09-19T14:07:42.216+0000 7f913416d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:07:42.626 INFO:tasks.workunit.client.0.smithi153.stderr: -145> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient(hunting): handle_auth_done global_id 6849 payload 824 2024-09-19T14:07:42.626 INFO:tasks.workunit.client.0.smithi153.stderr: -144> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient: _finish_hunting 0 2024-09-19T14:07:42.627 INFO:tasks.workunit.client.0.smithi153.stderr: -143> 2024-09-19T14:07:42.216+0000 7f913396c640 1 monclient: found mon.noname-a 2024-09-19T14:07:42.627 INFO:tasks.workunit.client.0.smithi153.stderr: -142> 2024-09-19T14:07:42.216+0000 7f913396c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:07:42.627 INFO:tasks.workunit.client.0.smithi153.stderr: -141> 2024-09-19T14:07:42.216+0000 7f9009ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:07:42.627 INFO:tasks.workunit.client.0.smithi153.stderr: -140> 2024-09-19T14:07:42.216+0000 7f9009ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:07:42.627 INFO:tasks.workunit.client.0.smithi153.stderr: -139> 2024-09-19T14:07:42.216+0000 7f9009ffb640 10 monclient: dump: 2024-09-19T14:07:42.627 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:07:42.627 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:07:42.627 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.627 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.627 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:07:42.627 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.627 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:07:42.627 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:07:42.628 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:07:42.628 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.628 INFO:tasks.workunit.client.0.smithi153.stderr: -138> 2024-09-19T14:07:42.216+0000 7f9009ffb640 10 monclient: _finish_auth 0 2024-09-19T14:07:42.628 INFO:tasks.workunit.client.0.smithi153.stderr: -137> 2024-09-19T14:07:42.216+0000 7f9009ffb640 10 monclient: _check_auth_tickets 2024-09-19T14:07:42.628 INFO:tasks.workunit.client.0.smithi153.stderr: -136> 2024-09-19T14:07:42.216+0000 7f9009ffb640 10 monclient: handle_config config(0 keys) 2024-09-19T14:07:42.628 INFO:tasks.workunit.client.0.smithi153.stderr: -135> 2024-09-19T14:07:42.216+0000 7f9009ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:07:42.628 INFO:tasks.workunit.client.0.smithi153.stderr: -134> 2024-09-19T14:07:42.216+0000 7f9009ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:07:42.628 INFO:tasks.workunit.client.0.smithi153.stderr: -133> 2024-09-19T14:07:42.216+0000 7f9009ffb640 10 monclient: dump: 2024-09-19T14:07:42.628 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:07:42.628 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:07:42.628 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.628 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:07:42.628 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:07:42.628 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:07:42.629 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:07:42.629 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:07:42.629 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:07:42.629 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.629 INFO:tasks.workunit.client.0.smithi153.stderr: -132> 2024-09-19T14:07:42.216+0000 7f900b7fe640 4 set_mon_vals no callback set 2024-09-19T14:07:42.629 INFO:tasks.workunit.client.0.smithi153.stderr: -131> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 monclient: authenticate success, global_id 6849 2024-09-19T14:07:42.629 INFO:tasks.workunit.client.0.smithi153.stderr: -130> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: _renew_subs 2024-09-19T14:07:42.629 INFO:tasks.workunit.client.0.smithi153.stderr: -129> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:07:42.629 INFO:tasks.workunit.client.0.smithi153.stderr: -128> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: _renew_subs 2024-09-19T14:07:42.629 INFO:tasks.workunit.client.0.smithi153.stderr: -127> 2024-09-19T14:07:42.216+0000 7f91366679c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:07:42.629 INFO:tasks.workunit.client.0.smithi153.stderr: -126> 2024-09-19T14:07:42.216+0000 7f91366679c0 1 librados: init done 2024-09-19T14:07:42.630 INFO:tasks.workunit.client.0.smithi153.stderr: -125> 2024-09-19T14:07:42.216+0000 7f91366679c0 5 asok(0x55b833398d90) register_command cr dump hook 0x7f91280f7ec8 2024-09-19T14:07:42.630 INFO:tasks.workunit.client.0.smithi153.stderr: -124> 2024-09-19T14:07:42.220+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.630 INFO:tasks.workunit.client.0.smithi153.stderr: -123> 2024-09-19T14:07:42.220+0000 7f9009ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:07:42.630 INFO:tasks.workunit.client.0.smithi153.stderr: -122> 2024-09-19T14:07:42.220+0000 7f9009ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:07:42.630 INFO:tasks.workunit.client.0.smithi153.stderr: -121> 2024-09-19T14:07:42.220+0000 7f9009ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:07:42.630 INFO:tasks.workunit.client.0.smithi153.stderr: -120> 2024-09-19T14:07:42.220+0000 7f913496e640 10 monclient: get_auth_request con 0x55b83368cc70 auth_method 0 2024-09-19T14:07:42.630 INFO:tasks.workunit.client.0.smithi153.stderr: -119> 2024-09-19T14:07:42.220+0000 7f913416d640 10 monclient: get_auth_request con 0x7f8ffc071be0 auth_method 0 2024-09-19T14:07:42.630 INFO:tasks.workunit.client.0.smithi153.stderr: -118> 2024-09-19T14:07:42.220+0000 7f91366679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.630 INFO:tasks.workunit.client.0.smithi153.stderr: -117> 2024-09-19T14:07:42.220+0000 7f91366679c0 20 realm 2024-09-19T14:07:42.630 INFO:tasks.workunit.client.0.smithi153.stderr: -116> 2024-09-19T14:07:42.220+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.630 INFO:tasks.workunit.client.0.smithi153.stderr: -115> 2024-09-19T14:07:42.220+0000 7f91366679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.630 INFO:tasks.workunit.client.0.smithi153.stderr: -114> 2024-09-19T14:07:42.220+0000 7f91366679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:07:42.630 INFO:tasks.workunit.client.0.smithi153.stderr: -113> 2024-09-19T14:07:42.220+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.630 INFO:tasks.workunit.client.0.smithi153.stderr: -112> 2024-09-19T14:07:42.220+0000 7f91366679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.631 INFO:tasks.workunit.client.0.smithi153.stderr: -111> 2024-09-19T14:07:42.220+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.631 INFO:tasks.workunit.client.0.smithi153.stderr: -110> 2024-09-19T14:07:42.224+0000 7f913416d640 10 monclient: get_auth_request con 0x55b833691030 auth_method 0 2024-09-19T14:07:42.631 INFO:tasks.workunit.client.0.smithi153.stderr: -109> 2024-09-19T14:07:42.224+0000 7f91366679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:42.631 INFO:tasks.workunit.client.0.smithi153.stderr: -108> 2024-09-19T14:07:42.224+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.631 INFO:tasks.workunit.client.0.smithi153.stderr: -107> 2024-09-19T14:07:42.224+0000 7f91366679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:07:42.631 INFO:tasks.workunit.client.0.smithi153.stderr: -106> 2024-09-19T14:07:42.224+0000 7f91366679c0 20 searching for the correct realm 2024-09-19T14:07:42.631 INFO:tasks.workunit.client.0.smithi153.stderr: -105> 2024-09-19T14:07:42.224+0000 7f913396c640 10 monclient: get_auth_request con 0x55b833696330 auth_method 0 2024-09-19T14:07:42.631 INFO:tasks.workunit.client.0.smithi153.stderr: -104> 2024-09-19T14:07:42.224+0000 7f913496e640 10 monclient: get_auth_request con 0x7f912811d040 auth_method 0 2024-09-19T14:07:42.631 INFO:tasks.workunit.client.0.smithi153.stderr: -103> 2024-09-19T14:07:42.228+0000 7f913416d640 10 monclient: get_auth_request con 0x7f912c015500 auth_method 0 2024-09-19T14:07:42.631 INFO:tasks.workunit.client.0.smithi153.stderr: -102> 2024-09-19T14:07:42.228+0000 7f913396c640 10 monclient: get_auth_request con 0x7f9124048410 auth_method 0 2024-09-19T14:07:42.631 INFO:tasks.workunit.client.0.smithi153.stderr: -101> 2024-09-19T14:07:42.232+0000 7f913496e640 0 -- 172.21.15.153:0/4223309757 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7f9128135230 msgr2=0x7f9128101710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:42.631 INFO:tasks.workunit.client.0.smithi153.stderr: -100> 2024-09-19T14:07:42.436+0000 7f913496e640 10 monclient: get_auth_request con 0x7f9128135230 auth_method 0 2024-09-19T14:07:42.631 INFO:tasks.workunit.client.0.smithi153.stderr: -99> 2024-09-19T14:07:42.444+0000 7f913416d640 10 monclient: get_auth_request con 0x7f912810dbb0 auth_method 0 2024-09-19T14:07:42.631 INFO:tasks.workunit.client.0.smithi153.stderr: -98> 2024-09-19T14:07:42.448+0000 7f913416d640 0 -- 172.21.15.153:0/4223309757 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x55b833691030 msgr2=0x55b833693420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:42.632 INFO:tasks.workunit.client.0.smithi153.stderr: -97> 2024-09-19T14:07:42.448+0000 7f9009ffb640 1 client.6849.objecter ms_handle_reset 0x55b833691030 session 0x55b83368fec0 osd.5 2024-09-19T14:07:42.632 INFO:tasks.workunit.client.0.smithi153.stderr: -96> 2024-09-19T14:07:42.448+0000 7f9009ffb640 10 monclient: _renew_subs 2024-09-19T14:07:42.632 INFO:tasks.workunit.client.0.smithi153.stderr: -95> 2024-09-19T14:07:42.448+0000 7f9009ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:07:42.632 INFO:tasks.workunit.client.0.smithi153.stderr: -94> 2024-09-19T14:07:42.448+0000 7f913416d640 10 monclient: get_auth_request con 0x7f8ffc082210 auth_method 0 2024-09-19T14:07:42.632 INFO:tasks.workunit.client.0.smithi153.stderr: -93> 2024-09-19T14:07:42.456+0000 7f91366679c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:07:42.632 INFO:tasks.workunit.client.0.smithi153.stderr: -92> 2024-09-19T14:07:42.456+0000 7f91366679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:07:42.632 INFO:tasks.workunit.client.0.smithi153.stderr: -91> 2024-09-19T14:07:42.456+0000 7f91366679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:07:42.632 INFO:tasks.workunit.client.0.smithi153.stderr: -90> 2024-09-19T14:07:42.456+0000 7f91366679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:07:42.632 INFO:tasks.workunit.client.0.smithi153.stderr: -89> 2024-09-19T14:07:42.456+0000 7f91366679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:07:42.632 INFO:tasks.workunit.client.0.smithi153.stderr: -88> 2024-09-19T14:07:42.456+0000 7f91366679c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:07:42.632 INFO:tasks.workunit.client.0.smithi153.stderr: -87> 2024-09-19T14:07:42.456+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.632 INFO:tasks.workunit.client.0.smithi153.stderr: -86> 2024-09-19T14:07:42.456+0000 7f91366679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.632 INFO:tasks.workunit.client.0.smithi153.stderr: -85> 2024-09-19T14:07:42.456+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.632 INFO:tasks.workunit.client.0.smithi153.stderr: -84> 2024-09-19T14:07:42.456+0000 7f91366679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:42.633 INFO:tasks.workunit.client.0.smithi153.stderr: -83> 2024-09-19T14:07:42.456+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.633 INFO:tasks.workunit.client.0.smithi153.stderr: -82> 2024-09-19T14:07:42.460+0000 7f91366679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:07:42.633 INFO:tasks.workunit.client.0.smithi153.stderr: -81> 2024-09-19T14:07:42.460+0000 7f91366679c0 20 zone default found 2024-09-19T14:07:42.633 INFO:tasks.workunit.client.0.smithi153.stderr: -80> 2024-09-19T14:07:42.460+0000 7f91366679c0 4 Realm: () 2024-09-19T14:07:42.633 INFO:tasks.workunit.client.0.smithi153.stderr: -79> 2024-09-19T14:07:42.460+0000 7f91366679c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:07:42.633 INFO:tasks.workunit.client.0.smithi153.stderr: -78> 2024-09-19T14:07:42.460+0000 7f91366679c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:07:42.633 INFO:tasks.workunit.client.0.smithi153.stderr: -77> 2024-09-19T14:07:42.460+0000 7f91366679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:07:42.633 INFO:tasks.workunit.client.0.smithi153.stderr: -76> 2024-09-19T14:07:42.460+0000 7f91366679c0 20 zonegroup default 2024-09-19T14:07:42.633 INFO:tasks.workunit.client.0.smithi153.stderr: -75> 2024-09-19T14:07:42.460+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.633 INFO:tasks.workunit.client.0.smithi153.stderr: -74> 2024-09-19T14:07:42.460+0000 7f91366679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.633 INFO:tasks.workunit.client.0.smithi153.stderr: -73> 2024-09-19T14:07:42.460+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.633 INFO:tasks.workunit.client.0.smithi153.stderr: -72> 2024-09-19T14:07:42.460+0000 7f91366679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.633 INFO:tasks.workunit.client.0.smithi153.stderr: -71> 2024-09-19T14:07:42.460+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.633 INFO:tasks.workunit.client.0.smithi153.stderr: -70> 2024-09-19T14:07:42.460+0000 7f91366679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.634 INFO:tasks.workunit.client.0.smithi153.stderr: -69> 2024-09-19T14:07:42.460+0000 7f91366679c0 20 started sync module instance, tier type = 2024-09-19T14:07:42.634 INFO:tasks.workunit.client.0.smithi153.stderr: -68> 2024-09-19T14:07:42.460+0000 7f91366679c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:07:42.634 INFO:tasks.workunit.client.0.smithi153.stderr: -67> 2024-09-19T14:07:42.484+0000 7f91366679c0 20 add_watcher() i=0 2024-09-19T14:07:42.634 INFO:tasks.workunit.client.0.smithi153.stderr: -66> 2024-09-19T14:07:42.484+0000 7f91366679c0 20 add_watcher() i=1 2024-09-19T14:07:42.634 INFO:tasks.workunit.client.0.smithi153.stderr: -65> 2024-09-19T14:07:42.484+0000 7f91366679c0 20 add_watcher() i=2 2024-09-19T14:07:42.634 INFO:tasks.workunit.client.0.smithi153.stderr: -64> 2024-09-19T14:07:42.484+0000 7f91366679c0 20 add_watcher() i=3 2024-09-19T14:07:42.634 INFO:tasks.workunit.client.0.smithi153.stderr: -63> 2024-09-19T14:07:42.484+0000 7f91366679c0 20 add_watcher() i=4 2024-09-19T14:07:42.634 INFO:tasks.workunit.client.0.smithi153.stderr: -62> 2024-09-19T14:07:42.484+0000 7f91366679c0 20 add_watcher() i=5 2024-09-19T14:07:42.634 INFO:tasks.workunit.client.0.smithi153.stderr: -61> 2024-09-19T14:07:42.484+0000 7f91366679c0 20 add_watcher() i=6 2024-09-19T14:07:42.634 INFO:tasks.workunit.client.0.smithi153.stderr: -60> 2024-09-19T14:07:42.488+0000 7f91366679c0 20 add_watcher() i=7 2024-09-19T14:07:42.634 INFO:tasks.workunit.client.0.smithi153.stderr: -59> 2024-09-19T14:07:42.488+0000 7f91366679c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:07:42.634 INFO:tasks.workunit.client.0.smithi153.stderr: -58> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding auth protocol: cephx 2024-09-19T14:07:42.634 INFO:tasks.workunit.client.0.smithi153.stderr: -57> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding auth protocol: cephx 2024-09-19T14:07:42.634 INFO:tasks.workunit.client.0.smithi153.stderr: -56> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding auth protocol: cephx 2024-09-19T14:07:42.634 INFO:tasks.workunit.client.0.smithi153.stderr: -55> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding con mode: secure 2024-09-19T14:07:42.635 INFO:tasks.workunit.client.0.smithi153.stderr: -54> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding con mode: crc 2024-09-19T14:07:42.635 INFO:tasks.workunit.client.0.smithi153.stderr: -53> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding con mode: secure 2024-09-19T14:07:42.635 INFO:tasks.workunit.client.0.smithi153.stderr: -52> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding con mode: crc 2024-09-19T14:07:42.635 INFO:tasks.workunit.client.0.smithi153.stderr: -51> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding con mode: secure 2024-09-19T14:07:42.635 INFO:tasks.workunit.client.0.smithi153.stderr: -50> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding con mode: crc 2024-09-19T14:07:42.635 INFO:tasks.workunit.client.0.smithi153.stderr: -49> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding con mode: crc 2024-09-19T14:07:42.635 INFO:tasks.workunit.client.0.smithi153.stderr: -48> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding con mode: secure 2024-09-19T14:07:42.635 INFO:tasks.workunit.client.0.smithi153.stderr: -47> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding con mode: crc 2024-09-19T14:07:42.635 INFO:tasks.workunit.client.0.smithi153.stderr: -46> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding con mode: secure 2024-09-19T14:07:42.635 INFO:tasks.workunit.client.0.smithi153.stderr: -45> 2024-09-19T14:07:42.492+0000 7f8feafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:42.635 INFO:tasks.workunit.client.0.smithi153.stderr: -44> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding con mode: crc 2024-09-19T14:07:42.635 INFO:tasks.workunit.client.0.smithi153.stderr: -43> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 AuthRegistry(0x7ffebfa7cee0) adding con mode: secure 2024-09-19T14:07:42.635 INFO:tasks.workunit.client.0.smithi153.stderr: -42> 2024-09-19T14:07:42.492+0000 7f91366679c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:07:42.635 INFO:tasks.workunit.client.0.smithi153.stderr: -41> 2024-09-19T14:07:42.492+0000 7f91366679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:07:42.635 INFO:tasks.workunit.client.0.smithi153.stderr: -40> 2024-09-19T14:07:42.492+0000 7f91366679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:07:42.636 INFO:tasks.workunit.client.0.smithi153.stderr: -39> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 asok(0x55b833398d90) register_command cache list hook 0x55b8336630e0 2024-09-19T14:07:42.636 INFO:tasks.workunit.client.0.smithi153.stderr: -38> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 asok(0x55b833398d90) register_command cache inspect hook 0x55b8336630e0 2024-09-19T14:07:42.636 INFO:tasks.workunit.client.0.smithi153.stderr: -37> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 asok(0x55b833398d90) register_command cache erase hook 0x55b8336630e0 2024-09-19T14:07:42.636 INFO:tasks.workunit.client.0.smithi153.stderr: -36> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 asok(0x55b833398d90) register_command cache zap hook 0x55b8336630e0 2024-09-19T14:07:42.636 INFO:tasks.workunit.client.0.smithi153.stderr: -35> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 note: GC not initialized 2024-09-19T14:07:42.636 INFO:tasks.workunit.client.0.smithi153.stderr: -34> 2024-09-19T14:07:42.492+0000 7f8fe9fdb640 20 reqs_thread_entry: start 2024-09-19T14:07:42.636 INFO:tasks.workunit.client.0.smithi153.stderr: -33> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 asok(0x55b833398d90) register_command sync trace show hook 0x7f9128106f20 2024-09-19T14:07:42.636 INFO:tasks.workunit.client.0.smithi153.stderr: -32> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 asok(0x55b833398d90) register_command sync trace history hook 0x7f9128106f20 2024-09-19T14:07:42.636 INFO:tasks.workunit.client.0.smithi153.stderr: -31> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 asok(0x55b833398d90) register_command sync trace active hook 0x7f9128106f20 2024-09-19T14:07:42.636 INFO:tasks.workunit.client.0.smithi153.stderr: -30> 2024-09-19T14:07:42.492+0000 7f91366679c0 5 asok(0x55b833398d90) register_command sync trace active_short hook 0x7f9128106f20 2024-09-19T14:07:42.636 INFO:tasks.workunit.client.0.smithi153.stderr: -29> 2024-09-19T14:07:42.492+0000 7f91366679c0 20 init_complete bucket index max shards: 11 2024-09-19T14:07:42.637 INFO:tasks.workunit.client.0.smithi153.stderr: -28> 2024-09-19T14:07:42.492+0000 7f91366679c0 20 Filter name: none 2024-09-19T14:07:42.637 INFO:tasks.workunit.client.0.smithi153.stderr: -27> 2024-09-19T14:07:42.492+0000 7f8f5b7fe640 20 reqs_thread_entry: start 2024-09-19T14:07:42.637 INFO:tasks.workunit.client.0.smithi153.stderr: -26> 2024-09-19T14:07:42.492+0000 7f91366679c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-19T14:07:42.637 INFO:tasks.workunit.client.0.smithi153.stderr: -25> 2024-09-19T14:07:42.492+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.637 INFO:tasks.workunit.client.0.smithi153.stderr: -24> 2024-09-19T14:07:42.492+0000 7f91366679c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-19T14:07:42.637 INFO:tasks.workunit.client.0.smithi153.stderr: -23> 2024-09-19T14:07:42.492+0000 7f91366679c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-19T14:07:42.637 INFO:tasks.workunit.client.0.smithi153.stderr: -22> 2024-09-19T14:07:42.492+0000 7f91366679c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-19T14:07:42.637 INFO:tasks.workunit.client.0.smithi153.stderr: -21> 2024-09-19T14:07:42.492+0000 7f91366679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 : miss 2024-09-19T14:07:42.637 INFO:tasks.workunit.client.0.smithi153.stderr: -20> 2024-09-19T14:07:42.492+0000 7f91366679c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.637 INFO:tasks.workunit.client.0.smithi153.stderr: -19> 2024-09-19T14:07:42.496+0000 7f91366679c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-19T14:07:42.637 INFO:tasks.workunit.client.0.smithi153.stderr: -18> 2024-09-19T14:07:42.496+0000 7f91366679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 info.flags=0x17 2024-09-19T14:07:42.637 INFO:tasks.workunit.client.0.smithi153.stderr: -17> 2024-09-19T14:07:42.496+0000 7f91366679c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 to cache LRU end 2024-09-19T14:07:42.638 INFO:tasks.workunit.client.0.smithi153.stderr: -16> 2024-09-19T14:07:42.496+0000 7f91366679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:07:42.638 INFO:tasks.workunit.client.0.smithi153.stderr: -15> 2024-09-19T14:07:42.496+0000 7f91366679c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:42.638 INFO:tasks.workunit.client.0.smithi153.stderr: -14> 2024-09-19T14:07:42.496+0000 7f91366679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 2024-09-19T14:07:42.638 INFO:tasks.workunit.client.0.smithi153.stderr: -13> 2024-09-19T14:07:42.508+0000 7f91366679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 info.flags=0x17 2024-09-19T14:07:42.638 INFO:tasks.workunit.client.0.smithi153.stderr: -12> 2024-09-19T14:07:42.508+0000 7f91366679c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 to cache LRU end 2024-09-19T14:07:42.638 INFO:tasks.workunit.client.0.smithi153.stderr: -11> 2024-09-19T14:07:42.508+0000 7f91366679c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:42.638 INFO:tasks.workunit.client.0.smithi153.stderr: -10> 2024-09-19T14:07:42.508+0000 7f91366679c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27, ofs0, ns] 2024-09-19T14:07:42.638 INFO:tasks.workunit.client.0.smithi153.stderr: -9> 2024-09-19T14:07:42.508+0000 7f900b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333521 cookie 94249624871424 notifier 6849 bl.length()=939 2024-09-19T14:07:42.638 INFO:tasks.workunit.client.0.smithi153.stderr: -8> 2024-09-19T14:07:42.508+0000 7f900b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 info.flags=0x17 2024-09-19T14:07:42.638 INFO:tasks.workunit.client.0.smithi153.stderr: -7> 2024-09-19T14:07:42.508+0000 7f900b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 to cache LRU end 2024-09-19T14:07:42.638 INFO:tasks.workunit.client.0.smithi153.stderr: -6> 2024-09-19T14:07:42.508+0000 7f900b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:42.638 INFO:tasks.workunit.client.0.smithi153.stderr: -5> 2024-09-19T14:07:42.508+0000 7f91366679c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.27]): orig_sources= new_sources= 2024-09-19T14:07:42.638 INFO:tasks.workunit.client.0.smithi153.stderr: -4> 2024-09-19T14:07:42.508+0000 7f91366679c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.27]): potential sources added=[] removed=[] 2024-09-19T14:07:42.638 INFO:tasks.workunit.client.0.smithi153.stderr: -3> 2024-09-19T14:07:42.508+0000 7f91366679c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.27]): orig_dests= new_dests= 2024-09-19T14:07:42.639 INFO:tasks.workunit.client.0.smithi153.stderr: -2> 2024-09-19T14:07:42.508+0000 7f91366679c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.27]): potential dests added=[] removed=[] 2024-09-19T14:07:42.639 INFO:tasks.workunit.client.0.smithi153.stderr: -1> 2024-09-19T14:07:42.512+0000 7f91366679c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f91366679c0 time 2024-09-19T14:07:42.515601+0000 2024-09-19T14:07:42.639 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:07:42.639 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.639 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:07:42.639 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9139f412eb] 2024-09-19T14:07:42.639 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9139f4149f] 2024-09-19T14:07:42.639 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b83151d271] 2024-09-19T14:07:42.639 INFO:tasks.workunit.client.0.smithi153.stderr: 4: radosgw-admin(+0x141050e) [0x55b831f6e50e] 2024-09-19T14:07:42.639 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b83152d0dd] 2024-09-19T14:07:42.639 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:07:42.639 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9138da7d90] 2024-09-19T14:07:42.640 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:07:42.640 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:07:42.640 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.640 INFO:tasks.workunit.client.0.smithi153.stderr: 0> 2024-09-19T14:07:42.512+0000 7f91366679c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:07:42.640 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7f91366679c0 thread_name:radosgw-admin 2024-09-19T14:07:42.640 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.640 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:07:42.640 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9138dc0520] 2024-09-19T14:07:42.640 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:07:42.640 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:07:42.640 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:07:42.640 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9139f41345] 2024-09-19T14:07:42.640 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9139f4149f] 2024-09-19T14:07:42.640 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b83151d271] 2024-09-19T14:07:42.641 INFO:tasks.workunit.client.0.smithi153.stderr: 8: radosgw-admin(+0x141050e) [0x55b831f6e50e] 2024-09-19T14:07:42.641 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b83152d0dd] 2024-09-19T14:07:42.641 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:07:42.641 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9138da7d90] 2024-09-19T14:07:42.641 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:07:42.641 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:07:42.641 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:07:42.641 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.641 INFO:tasks.workunit.client.0.smithi153.stderr:--- logging levels --- 2024-09-19T14:07:42.641 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 none 2024-09-19T14:07:42.641 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 lockdep 2024-09-19T14:07:42.641 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 context 2024-09-19T14:07:42.641 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 crush 2024-09-19T14:07:42.642 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds 2024-09-19T14:07:42.642 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_balancer 2024-09-19T14:07:42.642 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_locker 2024-09-19T14:07:42.642 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log 2024-09-19T14:07:42.642 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log_expire 2024-09-19T14:07:42.642 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_migrator 2024-09-19T14:07:42.642 INFO:tasks.workunit.client.0.smithi153.stderr: 3/ 5 mds_quiesce 2024-09-19T14:07:42.642 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 buffer 2024-09-19T14:07:42.642 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 timer 2024-09-19T14:07:42.642 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 filer 2024-09-19T14:07:42.642 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 striper 2024-09-19T14:07:42.642 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 objecter 2024-09-19T14:07:42.642 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rados 2024-09-19T14:07:42.642 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd 2024-09-19T14:07:42.642 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_mirror 2024-09-19T14:07:42.642 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_replay 2024-09-19T14:07:42.643 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_pwl 2024-09-19T14:07:42.643 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 journaler 2024-09-19T14:07:42.643 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objectcacher 2024-09-19T14:07:42.643 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:07:42.643 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 client 2024-09-19T14:07:42.643 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 osd 2024-09-19T14:07:42.643 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 optracker 2024-09-19T14:07:42.643 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objclass 2024-09-19T14:07:42.643 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 filestore 2024-09-19T14:07:42.643 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 journal 2024-09-19T14:07:42.643 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 ms 2024-09-19T14:07:42.643 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mon 2024-09-19T14:07:42.643 INFO:tasks.workunit.client.0.smithi153.stderr: 0/10 monc 2024-09-19T14:07:42.643 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 paxos 2024-09-19T14:07:42.643 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 tp 2024-09-19T14:07:42.644 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 auth 2024-09-19T14:07:42.644 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 crypto 2024-09-19T14:07:42.644 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 finisher 2024-09-19T14:07:42.644 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 reserver 2024-09-19T14:07:42.644 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 heartbeatmap 2024-09-19T14:07:42.644 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 perfcounter 2024-09-19T14:07:42.644 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw 2024-09-19T14:07:42.644 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_sync 2024-09-19T14:07:42.644 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_datacache 2024-09-19T14:07:42.644 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_access 2024-09-19T14:07:42.644 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:07:42.644 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_flight 2024-09-19T14:07:42.644 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:07:42.644 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw_notification 2024-09-19T14:07:42.644 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 javaclient 2024-09-19T14:07:42.645 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 asok 2024-09-19T14:07:42.645 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 throttle 2024-09-19T14:07:42.645 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 refs 2024-09-19T14:07:42.645 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 compressor 2024-09-19T14:07:42.645 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluestore 2024-09-19T14:07:42.645 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluefs 2024-09-19T14:07:42.645 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 bdev 2024-09-19T14:07:42.645 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 kstore 2024-09-19T14:07:42.645 INFO:tasks.workunit.client.0.smithi153.stderr: 4/ 5 rocksdb 2024-09-19T14:07:42.645 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 fuse 2024-09-19T14:07:42.645 INFO:tasks.workunit.client.0.smithi153.stderr: 2/ 5 mgr 2024-09-19T14:07:42.645 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mgrc 2024-09-19T14:07:42.645 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 dpdk 2024-09-19T14:07:42.646 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 eventtrace 2024-09-19T14:07:42.646 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 prioritycache 2024-09-19T14:07:42.646 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 test 2024-09-19T14:07:42.646 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:07:42.646 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephsqlite 2024-09-19T14:07:42.646 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:07:42.646 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore 2024-09-19T14:07:42.646 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_onode 2024-09-19T14:07:42.646 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_odata 2024-09-19T14:07:42.646 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_omap 2024-09-19T14:07:42.646 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_tm 2024-09-19T14:07:42.646 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_t 2024-09-19T14:07:42.646 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:07:42.646 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_epm 2024-09-19T14:07:42.647 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_lba 2024-09-19T14:07:42.647 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:07:42.647 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cache 2024-09-19T14:07:42.647 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_journal 2024-09-19T14:07:42.647 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_device 2024-09-19T14:07:42.647 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_backref 2024-09-19T14:07:42.647 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 alienstore 2024-09-19T14:07:42.647 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mclock 2024-09-19T14:07:42.647 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cyanstore 2024-09-19T14:07:42.647 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 ceph_exporter 2024-09-19T14:07:42.648 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 memstore 2024-09-19T14:07:42.648 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 trace 2024-09-19T14:07:42.648 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 ceph_dedup 2024-09-19T14:07:42.648 INFO:tasks.workunit.client.0.smithi153.stderr: -2/-2 (syslog threshold) 2024-09-19T14:07:42.648 INFO:tasks.workunit.client.0.smithi153.stderr: 99/99 (stderr threshold) 2024-09-19T14:07:42.648 INFO:tasks.workunit.client.0.smithi153.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:07:42.648 INFO:tasks.workunit.client.0.smithi153.stderr: 7f8f5b7fe640 / http_manager 2024-09-19T14:07:42.648 INFO:tasks.workunit.client.0.smithi153.stderr: 7f8fe9fdb640 / http_manager 2024-09-19T14:07:42.648 INFO:tasks.workunit.client.0.smithi153.stderr: 7f8feafdd640 / rgw_dt_lg_renew 2024-09-19T14:07:42.648 INFO:tasks.workunit.client.0.smithi153.stderr: 7f9009ffb640 / ms_dispatch 2024-09-19T14:07:42.648 INFO:tasks.workunit.client.0.smithi153.stderr: 7f900b7fe640 / io_context_pool 2024-09-19T14:07:42.649 INFO:tasks.workunit.client.0.smithi153.stderr: 7f9019ffb640 / ms_dispatch 2024-09-19T14:07:42.649 INFO:tasks.workunit.client.0.smithi153.stderr: 7f9020e09640 / ms_dispatch 2024-09-19T14:07:42.649 INFO:tasks.workunit.client.0.smithi153.stderr: 7f902260c640 / io_context_pool 2024-09-19T14:07:42.649 INFO:tasks.workunit.client.0.smithi153.stderr: 7f913396c640 / msgr-worker-2 2024-09-19T14:07:42.649 INFO:tasks.workunit.client.0.smithi153.stderr: 7f913416d640 / msgr-worker-1 2024-09-19T14:07:42.649 INFO:tasks.workunit.client.0.smithi153.stderr: 7f913496e640 / msgr-worker-0 2024-09-19T14:07:42.649 INFO:tasks.workunit.client.0.smithi153.stderr: 7f913516f640 / io_context_pool 2024-09-19T14:07:42.649 INFO:tasks.workunit.client.0.smithi153.stderr: 7f91366679c0 / radosgw-admin 2024-09-19T14:07:42.649 INFO:tasks.workunit.client.0.smithi153.stderr: max_recent 500 2024-09-19T14:07:42.649 INFO:tasks.workunit.client.0.smithi153.stderr: max_new 1000 2024-09-19T14:07:42.650 INFO:tasks.workunit.client.0.smithi153.stderr: log_file /var/lib/ceph/crash/2024-09-19T14:07:42.519274Z_b12582dd-3ed9-45b7-9d41-089aa5eadccd/log 2024-09-19T14:07:42.650 INFO:tasks.workunit.client.0.smithi153.stderr:--- end dump of recent events --- 2024-09-19T14:07:42.650 INFO:tasks.workunit.client.0.smithi153.stderr:Aborted 2024-09-19T14:07:42.650 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-19T14:07:42.654 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:07:42.654 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:07:42.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.596+0000 7f9a5dac89c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.600+0000 7f9a5dac89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.600+0000 7f9a5dac89c0 20 realm 2024-09-19T14:07:42.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.600+0000 7f9a5dac89c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.600+0000 7f9a5dac89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.600+0000 7f9a5dac89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:07:42.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.600+0000 7f9a5dac89c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.600+0000 7f9a5dac89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.600+0000 7f9a5dac89c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.600+0000 7f9a5dac89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:42.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.600+0000 7f9a5dac89c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.600+0000 7f9a5dac89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:07:42.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.600+0000 7f9a5dac89c0 20 searching for the correct realm 2024-09-19T14:07:42.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.608+0000 7f9a5adcd640 0 -- 172.21.15.153:0/62563690 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f9a4c017760 msgr2=0x7f9a4c083190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:42.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.612+0000 7f9a5adcd640 0 -- 172.21.15.153:0/62563690 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f9924082310 msgr2=0x7f9924084740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:42.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.620+0000 7f9a5dac89c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:07:42.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.620+0000 7f9a5dac89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:07:42.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.620+0000 7f9a5dac89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:07:42.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.620+0000 7f9a5dac89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:07:42.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.620+0000 7f9a5dac89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:07:42.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.620+0000 7f9a5dac89c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:07:42.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.620+0000 7f9a5dac89c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.620+0000 7f9a5dac89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.620+0000 7f9a5dac89c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.620+0000 7f9a5dac89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:42.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.620+0000 7f9a5dac89c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.624+0000 7f9a5dac89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:07:42.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.624+0000 7f9a5dac89c0 20 zone default found 2024-09-19T14:07:42.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.624+0000 7f9a5dac89c0 4 Realm: () 2024-09-19T14:07:42.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.624+0000 7f9a5dac89c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:07:42.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.624+0000 7f9a5dac89c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:07:42.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.624+0000 7f9a5dac89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:07:42.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.624+0000 7f9a5dac89c0 20 zonegroup default 2024-09-19T14:07:42.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.624+0000 7f9a5dac89c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.624+0000 7f9a5dac89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.624+0000 7f9a5dac89c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.624+0000 7f9a5dac89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.624+0000 7f9a5dac89c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.624+0000 7f9a5dac89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.624+0000 7f9a5dac89c0 20 started sync module instance, tier type = 2024-09-19T14:07:42.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.624+0000 7f9a5dac89c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:07:42.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.644+0000 7f9a5dac89c0 20 add_watcher() i=0 2024-09-19T14:07:42.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.644+0000 7f9a5dac89c0 20 add_watcher() i=1 2024-09-19T14:07:42.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.644+0000 7f9a5dac89c0 20 add_watcher() i=2 2024-09-19T14:07:42.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.644+0000 7f9a5dac89c0 20 add_watcher() i=3 2024-09-19T14:07:42.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.644+0000 7f9a5dac89c0 20 add_watcher() i=4 2024-09-19T14:07:42.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.644+0000 7f9a5dac89c0 20 add_watcher() i=5 2024-09-19T14:07:42.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.644+0000 7f9a5dac89c0 20 add_watcher() i=6 2024-09-19T14:07:42.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.644+0000 7f9a5dac89c0 20 add_watcher() i=7 2024-09-19T14:07:42.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.644+0000 7f9a5dac89c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:07:42.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.648+0000 7f9911fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:42.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.648+0000 7f9a5dac89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:07:42.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.648+0000 7f9a5dac89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:07:42.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.648+0000 7f9a5dac89c0 5 note: GC not initialized 2024-09-19T14:07:42.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.648+0000 7f9910fe1640 20 reqs_thread_entry: start 2024-09-19T14:07:42.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.648+0000 7f9a5dac89c0 20 init_complete bucket index max shards: 11 2024-09-19T14:07:42.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.648+0000 7f9a5dac89c0 20 Filter name: none 2024-09-19T14:07:42.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.648+0000 7f988a7fc640 20 reqs_thread_entry: start 2024-09-19T14:07:42.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.648+0000 7f9a5dac89c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.648+0000 7f9a5dac89c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-19T14:07:42.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.648+0000 7f9a5dac89c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.648+0000 7f9a5dac89c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-19T14:07:42.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.648+0000 7f9a5dac89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:07:42.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.648+0000 7f9a5dac89c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.652+0000 7f9a5dac89c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-19T14:07:42.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.652+0000 7f9a5dac89c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.652+0000 7f9a5dac89c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-19T14:07:42.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.652+0000 7f9a5dac89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:07:42.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.652+0000 7f9911fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:42.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.660+0000 7f9a5dac89c0 20 remove_watcher() i=0 2024-09-19T14:07:42.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.660+0000 7f9a5dac89c0 2 removed watcher, disabling cache 2024-09-19T14:07:42.664 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.660+0000 7f9a5dac89c0 20 remove_watcher() i=1 2024-09-19T14:07:42.666 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.664+0000 7f9a5dac89c0 20 remove_watcher() i=2 2024-09-19T14:07:42.668 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.664+0000 7f9a5dac89c0 20 remove_watcher() i=3 2024-09-19T14:07:42.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.668+0000 7f9a5dac89c0 20 remove_watcher() i=4 2024-09-19T14:07:42.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.668+0000 7f9a5dac89c0 20 remove_watcher() i=5 2024-09-19T14:07:42.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.672+0000 7f9a5dac89c0 20 remove_watcher() i=6 2024-09-19T14:07:42.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.672+0000 7f9a5dac89c0 20 remove_watcher() i=7 2024-09-19T14:07:42.687 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.687 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:07:42.687 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: abort-at-trim-reshard-log-entries id: dbb1da81-49d0-421a-b677-974869a7f103.4620.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:07:42.688 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:07:42.689 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:42.689 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:42.728 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:07:42.728 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:07:42.786 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T14:07:42.821 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:07:42.821 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:07:42.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.864+0000 7fc42069a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.867 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.864+0000 7fc42069a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.867 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.864+0000 7fc42069a9c0 20 realm 2024-09-19T14:07:42.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.864+0000 7fc42069a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.864+0000 7fc42069a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.864+0000 7fc42069a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:07:42.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.864+0000 7fc42069a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.864+0000 7fc42069a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.864+0000 7fc42069a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.868+0000 7fc42069a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:42.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.868+0000 7fc42069a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.868+0000 7fc42069a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:07:42.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.868+0000 7fc42069a9c0 20 searching for the correct realm 2024-09-19T14:07:42.876 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.872+0000 7fc41d99f640 0 -- 172.21.15.153:0/3530232952 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fc41002b060 msgr2=0x7fc4100791e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:07:42.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.880+0000 7fc41e9a1640 0 -- 172.21.15.153:0/3530232952 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7fc4140342a0 msgr2=0x7fc41409d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:07:42.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:07:42.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:07:42.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:07:42.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:07:42.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:07:42.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:07:42.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:07:42.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:07:42.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 20 zone default found 2024-09-19T14:07:42.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 4 Realm: () 2024-09-19T14:07:42.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:07:42.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:07:42.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:07:42.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 20 zonegroup default 2024-09-19T14:07:42.892 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.892 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.892 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.892 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.892 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:07:42.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 20 started sync module instance, tier type = 2024-09-19T14:07:42.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.888+0000 7fc42069a9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:07:42.908 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.904+0000 7fc42069a9c0 20 add_watcher() i=0 2024-09-19T14:07:42.908 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.904+0000 7fc42069a9c0 20 add_watcher() i=1 2024-09-19T14:07:42.908 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.904+0000 7fc42069a9c0 20 add_watcher() i=2 2024-09-19T14:07:42.908 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.904+0000 7fc42069a9c0 20 add_watcher() i=3 2024-09-19T14:07:42.908 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.904+0000 7fc42069a9c0 20 add_watcher() i=4 2024-09-19T14:07:42.908 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.904+0000 7fc42069a9c0 20 add_watcher() i=5 2024-09-19T14:07:42.909 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.904+0000 7fc42069a9c0 20 add_watcher() i=6 2024-09-19T14:07:42.909 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.908+0000 7fc42069a9c0 20 add_watcher() i=7 2024-09-19T14:07:42.909 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.908+0000 7fc42069a9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:07:42.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.908+0000 7fc2d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:42.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.908+0000 7fc42069a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:07:42.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.908+0000 7fc42069a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:07:42.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.908+0000 7fc42069a9c0 5 note: GC not initialized 2024-09-19T14:07:42.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.912+0000 7fc24f7fe640 20 reqs_thread_entry: start 2024-09-19T14:07:42.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.912+0000 7fc42069a9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:07:42.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.912+0000 7fc42069a9c0 20 Filter name: none 2024-09-19T14:07:42.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.912+0000 7fc24d7fa640 20 reqs_thread_entry: start 2024-09-19T14:07:42.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.912+0000 7fc42069a9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-19T14:07:42.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.912+0000 7fc42069a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.914 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.912+0000 7fc42069a9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-19T14:07:42.914 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.912+0000 7fc42069a9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-19T14:07:42.914 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.912+0000 7fc42069a9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-19T14:07:42.914 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.912+0000 7fc42069a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 : miss 2024-09-19T14:07:42.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.912+0000 7fc42069a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:07:42.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.912+0000 7fc42069a9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-19T14:07:42.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.912+0000 7fc42069a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 info.flags=0x17 2024-09-19T14:07:42.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.912+0000 7fc42069a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 to cache LRU end 2024-09-19T14:07:42.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.912+0000 7fc42069a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:07:42.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.912+0000 7fc42069a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:07:42.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.912+0000 7fc42069a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 2024-09-19T14:07:42.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.916+0000 7fc42069a9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 to be held by another RGW process; skipping for now 2024-09-19T14:07:42.918 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.916+0000 7fc2d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:07:42.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.924+0000 7fc42069a9c0 20 remove_watcher() i=0 2024-09-19T14:07:42.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.924+0000 7fc42069a9c0 2 removed watcher, disabling cache 2024-09-19T14:07:42.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.928+0000 7fc42069a9c0 20 remove_watcher() i=1 2024-09-19T14:07:42.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.928+0000 7fc42069a9c0 20 remove_watcher() i=2 2024-09-19T14:07:42.933 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.932+0000 7fc42069a9c0 20 remove_watcher() i=3 2024-09-19T14:07:42.939 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.936+0000 7fc42069a9c0 20 remove_watcher() i=4 2024-09-19T14:07:42.940 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.936+0000 7fc42069a9c0 20 remove_watcher() i=5 2024-09-19T14:07:42.942 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.940+0000 7fc42069a9c0 20 remove_watcher() i=6 2024-09-19T14:07:42.943 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:07:42.940+0000 7fc42069a9c0 20 remove_watcher() i=7 2024-09-19T14:07:42.956 INFO:tasks.workunit.client.0.smithi153.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-19T14:08:12.986 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T14:08:13.022 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:08:13.022 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:08:13.068 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.064+0000 7f6d2a0129c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.070 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.068+0000 7f6d2a0129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:13.070 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.068+0000 7f6d2a0129c0 20 realm 2024-09-19T14:08:13.070 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.068+0000 7f6d2a0129c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.070 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.068+0000 7f6d2a0129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:13.070 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.068+0000 7f6d2a0129c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:08:13.070 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.068+0000 7f6d2a0129c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.070 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.068+0000 7f6d2a0129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:13.070 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.068+0000 7f6d2a0129c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.072 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.068+0000 7f6d2a0129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:13.072 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.068+0000 7f6d2a0129c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.072 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.068+0000 7f6d2a0129c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:08:13.072 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.068+0000 7f6d2a0129c0 20 searching for the correct realm 2024-09-19T14:08:13.079 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.076+0000 7f6d27317640 0 -- 172.21.15.153:0/14549803 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f6d180e1030 msgr2=0x7f6d180e1920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:08:13.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.084+0000 7f6d27317640 0 -- 172.21.15.153:0/14549803 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f6bf0082340 msgr2=0x7f6bf0084770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:13.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.088+0000 7f6d2a0129c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:08:13.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.088+0000 7f6d2a0129c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:08:13.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.088+0000 7f6d2a0129c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:08:13.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.088+0000 7f6d2a0129c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:08:13.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.088+0000 7f6d2a0129c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:08:13.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.088+0000 7f6d2a0129c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:08:13.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.088+0000 7f6d2a0129c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.092+0000 7f6d2a0129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:13.094 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.092+0000 7f6d2a0129c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.094 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.092+0000 7f6d2a0129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:13.094 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.092+0000 7f6d2a0129c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.092+0000 7f6d2a0129c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:08:13.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.092+0000 7f6d2a0129c0 20 zone default found 2024-09-19T14:08:13.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.092+0000 7f6d2a0129c0 4 Realm: () 2024-09-19T14:08:13.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.092+0000 7f6d2a0129c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:08:13.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.092+0000 7f6d2a0129c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:08:13.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.092+0000 7f6d2a0129c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:08:13.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.092+0000 7f6d2a0129c0 20 zonegroup default 2024-09-19T14:08:13.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.092+0000 7f6d2a0129c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.092+0000 7f6d2a0129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:13.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.092+0000 7f6d2a0129c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.092+0000 7f6d2a0129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:13.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.092+0000 7f6d2a0129c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.092+0000 7f6d2a0129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:13.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.092+0000 7f6d2a0129c0 20 started sync module instance, tier type = 2024-09-19T14:08:13.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.092+0000 7f6d2a0129c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:08:13.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.116+0000 7f6d2a0129c0 20 add_watcher() i=0 2024-09-19T14:08:13.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.116+0000 7f6d2a0129c0 20 add_watcher() i=1 2024-09-19T14:08:13.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.116+0000 7f6d2a0129c0 20 add_watcher() i=2 2024-09-19T14:08:13.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.116+0000 7f6d2a0129c0 20 add_watcher() i=3 2024-09-19T14:08:13.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.116+0000 7f6d2a0129c0 20 add_watcher() i=4 2024-09-19T14:08:13.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.116+0000 7f6d2a0129c0 20 add_watcher() i=5 2024-09-19T14:08:13.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.116+0000 7f6d2a0129c0 20 add_watcher() i=6 2024-09-19T14:08:13.118 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.116+0000 7f6d2a0129c0 20 add_watcher() i=7 2024-09-19T14:08:13.118 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.116+0000 7f6d2a0129c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:08:13.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.116+0000 7f6bddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:13.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.120+0000 7f6d2a0129c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:08:13.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.120+0000 7f6d2a0129c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:08:13.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.120+0000 7f6d2a0129c0 5 note: GC not initialized 2024-09-19T14:08:13.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.120+0000 7f6bdcfe1640 20 reqs_thread_entry: start 2024-09-19T14:08:13.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.120+0000 7f6d2a0129c0 20 init_complete bucket index max shards: 11 2024-09-19T14:08:13.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.120+0000 7f6d2a0129c0 20 Filter name: none 2024-09-19T14:08:13.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.120+0000 7f6b567fc640 20 reqs_thread_entry: start 2024-09-19T14:08:13.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.120+0000 7f6d2a0129c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-19T14:08:13.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.120+0000 7f6d2a0129c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.120+0000 7f6d2a0129c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-19T14:08:13.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.120+0000 7f6d2a0129c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-19T14:08:13.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.120+0000 7f6d2a0129c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-19T14:08:13.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.120+0000 7f6d2a0129c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 : miss 2024-09-19T14:08:13.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.120+0000 7f6d2a0129c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.120+0000 7f6d2a0129c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-19T14:08:13.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.120+0000 7f6d2a0129c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 info.flags=0x17 2024-09-19T14:08:13.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.120+0000 7f6d2a0129c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 to cache LRU end 2024-09-19T14:08:13.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.120+0000 7f6d2a0129c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:08:13.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.120+0000 7f6d2a0129c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:13.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.120+0000 7f6d2a0129c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 2024-09-19T14:08:13.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.124+0000 7f6d2a0129c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T14:08:13.139 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.136+0000 7f6d2a0129c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 info.flags=0x17 2024-09-19T14:08:13.139 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.136+0000 7f6d2a0129c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 to cache LRU end 2024-09-19T14:08:13.139 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.136+0000 7f6d2a0129c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:13.139 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.136+0000 7f6d2a0129c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27, ofs0, ns] 2024-09-19T14:08:13.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.136+0000 7f6c06ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333522 cookie 93933323798112 notifier 6482 bl.length()=939 2024-09-19T14:08:13.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.136+0000 7f6c06ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 info.flags=0x17 2024-09-19T14:08:13.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.136+0000 7f6c06ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 to cache LRU end 2024-09-19T14:08:13.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.136+0000 7f6c06ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:13.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.140+0000 7f6d2a0129c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.27]): orig_sources= new_sources= 2024-09-19T14:08:13.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.140+0000 7f6d2a0129c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.27]): potential sources added=[] removed=[] 2024-09-19T14:08:13.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.140+0000 7f6d2a0129c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.27]): orig_dests= new_dests= 2024-09-19T14:08:13.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.140+0000 7f6d2a0129c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.27]): potential dests added=[] removed=[] 2024-09-19T14:08:13.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2.0 2024-09-19T14:08:13.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2.0 2024-09-19T14:08:13.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2.1 2024-09-19T14:08:13.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2.1 2024-09-19T14:08:13.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2.2 2024-09-19T14:08:13.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2.2 2024-09-19T14:08:13.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2.3 2024-09-19T14:08:13.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2.3 2024-09-19T14:08:13.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2.4 2024-09-19T14:08:13.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2.4 2024-09-19T14:08:13.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2.5 2024-09-19T14:08:13.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2.5 2024-09-19T14:08:13.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2.6 2024-09-19T14:08:13.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2.6 2024-09-19T14:08:13.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2.7 2024-09-19T14:08:13.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2.7 2024-09-19T14:08:13.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2.8 2024-09-19T14:08:13.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2.8 2024-09-19T14:08:13.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2.9 2024-09-19T14:08:13.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2.9 2024-09-19T14:08:13.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2.10 2024-09-19T14:08:13.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2.10 2024-09-19T14:08:13.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2.11 2024-09-19T14:08:13.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2.11 2024-09-19T14:08:13.155 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.0 2024-09-19T14:08:13.155 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.1 2024-09-19T14:08:13.155 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2 2024-09-19T14:08:13.155 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.3 2024-09-19T14:08:13.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.4 2024-09-19T14:08:13.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.152+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.5 2024-09-19T14:08:13.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.156+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.6 2024-09-19T14:08:13.159 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.156+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.7 2024-09-19T14:08:13.159 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.156+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.8 2024-09-19T14:08:13.161 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.160+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.9 2024-09-19T14:08:13.162 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.160+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.10 2024-09-19T14:08:13.167 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.164+0000 7f6d2a0129c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 : hit (requested=0x17, cached=0x17) 2024-09-19T14:08:13.167 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.164+0000 7f6d2a0129c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 2024-09-19T14:08:13.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.168+0000 7f6d2a0129c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 info.flags=0x17 2024-09-19T14:08:13.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.168+0000 7f6d2a0129c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 to cache LRU end 2024-09-19T14:08:13.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.168+0000 7f6d2a0129c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:13.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.168+0000 7f6d2a0129c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27, ofs0, ns] 2024-09-19T14:08:13.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.168+0000 7f6c06ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333523 cookie 93933323798112 notifier 6482 bl.length()=939 2024-09-19T14:08:13.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.168+0000 7f6c06ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 info.flags=0x17 2024-09-19T14:08:13.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.168+0000 7f6c06ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 to cache LRU end 2024-09-19T14:08:13.171 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.168+0000 7f6c06ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:13.173 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.172+0000 7f6d2a0129c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.27]): orig_sources= new_sources= 2024-09-19T14:08:13.173 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.172+0000 7f6d2a0129c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.27]): potential sources added=[] removed=[] 2024-09-19T14:08:13.173 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.172+0000 7f6d2a0129c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.27]): orig_dests= new_dests= 2024-09-19T14:08:13.173 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.172+0000 7f6d2a0129c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.27]): potential dests added=[] removed=[] 2024-09-19T14:08:13.178 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.176+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.0 2024-09-19T14:08:13.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.176+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.1 2024-09-19T14:08:13.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.176+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.2 2024-09-19T14:08:13.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.176+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.3 2024-09-19T14:08:13.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.176+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.4 2024-09-19T14:08:13.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.180+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.5 2024-09-19T14:08:13.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.180+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.6 2024-09-19T14:08:13.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.180+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.7 2024-09-19T14:08:13.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.180+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.8 2024-09-19T14:08:13.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.180+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.9 2024-09-19T14:08:13.184 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.180+0000 7f6d2a0129c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.27.10 2024-09-19T14:08:13.184 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.180+0000 7f6d2a0129c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 : hit (requested=0x17, cached=0x17) 2024-09-19T14:08:13.184 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.180+0000 7f6d2a0129c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 2024-09-19T14:08:13.186 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.184+0000 7f6d2a0129c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 info.flags=0x17 2024-09-19T14:08:13.187 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.184+0000 7f6d2a0129c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 to cache LRU end 2024-09-19T14:08:13.187 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.184+0000 7f6d2a0129c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:13.187 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.184+0000 7f6d2a0129c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27, ofs0, ns] 2024-09-19T14:08:13.187 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.184+0000 7f6c067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333524 cookie 93933323798112 notifier 6482 bl.length()=907 2024-09-19T14:08:13.187 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.184+0000 7f6c067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 info.flags=0x17 2024-09-19T14:08:13.188 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.184+0000 7f6c067fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:dbb1da81-49d0-421a-b677-974869a7f103.4620.27 to cache LRU end 2024-09-19T14:08:13.188 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.184+0000 7f6c067fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:13.190 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.188+0000 7f6d2a0129c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.27]): orig_sources= new_sources= 2024-09-19T14:08:13.190 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.188+0000 7f6d2a0129c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.27]): potential sources added=[] removed=[] 2024-09-19T14:08:13.190 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.188+0000 7f6d2a0129c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.27]): orig_dests= new_dests= 2024-09-19T14:08:13.190 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.188+0000 7f6d2a0129c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[dbb1da81-49d0-421a-b677-974869a7f103.4620.27]): potential dests added=[] removed=[] 2024-09-19T14:08:13.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.192+0000 7f6d2a0129c0 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-19T14:08:13.199 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.196+0000 7f6bddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:13.204 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.200+0000 7f6d2a0129c0 20 remove_watcher() i=0 2024-09-19T14:08:13.204 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.200+0000 7f6d2a0129c0 2 removed watcher, disabling cache 2024-09-19T14:08:13.206 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.204+0000 7f6d2a0129c0 20 remove_watcher() i=1 2024-09-19T14:08:13.208 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.204+0000 7f6d2a0129c0 20 remove_watcher() i=2 2024-09-19T14:08:13.211 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.208+0000 7f6d2a0129c0 20 remove_watcher() i=3 2024-09-19T14:08:13.213 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.212+0000 7f6d2a0129c0 20 remove_watcher() i=4 2024-09-19T14:08:13.214 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.212+0000 7f6d2a0129c0 20 remove_watcher() i=5 2024-09-19T14:08:13.216 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.212+0000 7f6d2a0129c0 20 remove_watcher() i=6 2024-09-19T14:08:13.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.216+0000 7f6d2a0129c0 20 remove_watcher() i=7 2024-09-19T14:08:13.233 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-19T14:08:13.259 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:08:13.259 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:08:13.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.300+0000 7f195aa349c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.300+0000 7f195aa349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:13.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.300+0000 7f195aa349c0 20 realm 2024-09-19T14:08:13.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.300+0000 7f195aa349c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.300+0000 7f195aa349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:13.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.300+0000 7f195aa349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:08:13.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.300+0000 7f195aa349c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.300+0000 7f195aa349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:13.305 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.300+0000 7f195aa349c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.304+0000 7f195aa349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:13.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.304+0000 7f195aa349c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.304+0000 7f195aa349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:08:13.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.304+0000 7f195aa349c0 20 searching for the correct realm 2024-09-19T14:08:13.312 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.308+0000 7f1957d39640 0 -- 172.21.15.153:0/4179828097 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x55ac9b995830 msgr2=0x55ac9b997c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:13.318 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.316+0000 7f195853a640 0 -- 172.21.15.153:0/4179828097 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f194c0e78f0 msgr2=0x7f194c0b83e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:13.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:08:13.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:08:13.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:08:13.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:08:13.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:08:13.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:08:13.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:13.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:13.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:08:13.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 20 zone default found 2024-09-19T14:08:13.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 4 Realm: () 2024-09-19T14:08:13.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:08:13.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:08:13.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:08:13.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 20 zonegroup default 2024-09-19T14:08:13.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:13.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:13.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:13.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 20 started sync module instance, tier type = 2024-09-19T14:08:13.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.324+0000 7f195aa349c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:08:13.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.340+0000 7f195aa349c0 20 add_watcher() i=0 2024-09-19T14:08:13.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.340+0000 7f195aa349c0 20 add_watcher() i=1 2024-09-19T14:08:13.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.340+0000 7f195aa349c0 20 add_watcher() i=2 2024-09-19T14:08:13.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.340+0000 7f195aa349c0 20 add_watcher() i=3 2024-09-19T14:08:13.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.340+0000 7f195aa349c0 20 add_watcher() i=4 2024-09-19T14:08:13.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.340+0000 7f195aa349c0 20 add_watcher() i=5 2024-09-19T14:08:13.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.340+0000 7f195aa349c0 20 add_watcher() i=6 2024-09-19T14:08:13.345 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.344+0000 7f195aa349c0 20 add_watcher() i=7 2024-09-19T14:08:13.345 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.344+0000 7f195aa349c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:08:13.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.344+0000 7f180e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:13.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.344+0000 7f195aa349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:08:13.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.344+0000 7f195aa349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:08:13.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.344+0000 7f195aa349c0 5 note: GC not initialized 2024-09-19T14:08:13.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.344+0000 7f180d7e2640 20 reqs_thread_entry: start 2024-09-19T14:08:13.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.344+0000 7f195aa349c0 20 init_complete bucket index max shards: 11 2024-09-19T14:08:13.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.344+0000 7f195aa349c0 20 Filter name: none 2024-09-19T14:08:13.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.344+0000 7f177effd640 20 reqs_thread_entry: start 2024-09-19T14:08:13.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.344+0000 7f195aa349c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.348+0000 7f195aa349c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-19T14:08:13.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.348+0000 7f195aa349c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.348+0000 7f195aa349c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-19T14:08:13.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.348+0000 7f195aa349c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:08:13.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.348+0000 7f195aa349c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.348+0000 7f195aa349c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-19T14:08:13.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.348+0000 7f195aa349c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:13.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.348+0000 7f195aa349c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-19T14:08:13.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.348+0000 7f195aa349c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:08:13.353 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.352+0000 7f180e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:13.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.356+0000 7f195aa349c0 20 remove_watcher() i=0 2024-09-19T14:08:13.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.356+0000 7f195aa349c0 2 removed watcher, disabling cache 2024-09-19T14:08:13.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.356+0000 7f195aa349c0 20 remove_watcher() i=1 2024-09-19T14:08:13.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.360+0000 7f195aa349c0 20 remove_watcher() i=2 2024-09-19T14:08:13.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.360+0000 7f195aa349c0 20 remove_watcher() i=3 2024-09-19T14:08:13.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.364+0000 7f195aa349c0 20 remove_watcher() i=4 2024-09-19T14:08:13.367 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.364+0000 7f195aa349c0 20 remove_watcher() i=5 2024-09-19T14:08:13.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.364+0000 7f195aa349c0 20 remove_watcher() i=6 2024-09-19T14:08:13.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:13.368+0000 7f195aa349c0 20 remove_watcher() i=7 2024-09-19T14:08:13.382 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:13.382 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:08:13.383 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: abort-at-trim-reshard-log-entries id: dbb1da81-49d0-421a-b677-974869a7f103.4620.27 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T14:08:13.383 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:13.384 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:13.384 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:13.406 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:13.407 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:13.953 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:13.953 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:14.332 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-19T14:08:14.332 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:14.335 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:14.335 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:14.469 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:14.469 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:14.557 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:14.557 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:14.659 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:14.660 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:14.758 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:14.758 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:14.854 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:14.854 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:14.952 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:14.952 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:15.057 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:15.057 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:15.158 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:15.158 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:15.251 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:15.251 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:15.336 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:15.336 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:15.437 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:15.437 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:15.537 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:15.537 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:15.646 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:15.646 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:15.746 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:15.746 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:15.846 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:15.846 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:15.946 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:15.946 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:16.042 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:16.042 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:16.141 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:16.141 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:16.236 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:16.236 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:16.324 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:16.324 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:16.422 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:16.422 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:16.520 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-19T14:08:16.553 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:08:16.553 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:08:16.599 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.596+0000 7f155e7439c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.600+0000 7f155e7439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:16.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.600+0000 7f155e7439c0 20 realm 2024-09-19T14:08:16.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.600+0000 7f155e7439c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.600+0000 7f155e7439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:16.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.600+0000 7f155e7439c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:08:16.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.600+0000 7f155e7439c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.600+0000 7f155e7439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:16.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.600+0000 7f155e7439c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.603 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.600+0000 7f155e7439c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:16.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.600+0000 7f155e7439c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.600+0000 7f155e7439c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:08:16.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.600+0000 7f155e7439c0 20 searching for the correct realm 2024-09-19T14:08:16.610 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.608+0000 7f155ca4a640 0 -- 172.21.15.153:0/3467219825 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x562b1e5134b0 msgr2=0x562b1e5158a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:16.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.612+0000 7f155ba48640 0 -- 172.21.15.153:0/3467219825 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f154c0e8020 msgr2=0x7f154c0b8960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:08:16.624 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.620+0000 7f155e7439c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:08:16.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.620+0000 7f155e7439c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:08:16.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.620+0000 7f155e7439c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:08:16.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.620+0000 7f155e7439c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:08:16.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.620+0000 7f155e7439c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:08:16.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.620+0000 7f155e7439c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:08:16.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.620+0000 7f155e7439c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.624+0000 7f155e7439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:16.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.624+0000 7f155e7439c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.626 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.624+0000 7f155e7439c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:16.626 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.624+0000 7f155e7439c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.626 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.624+0000 7f155e7439c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:08:16.626 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.624+0000 7f155e7439c0 20 zone default found 2024-09-19T14:08:16.627 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.624+0000 7f155e7439c0 4 Realm: () 2024-09-19T14:08:16.627 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.624+0000 7f155e7439c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:08:16.627 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.624+0000 7f155e7439c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:08:16.627 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.624+0000 7f155e7439c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:08:16.627 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.624+0000 7f155e7439c0 20 zonegroup default 2024-09-19T14:08:16.627 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.624+0000 7f155e7439c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.627 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.624+0000 7f155e7439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:16.627 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.624+0000 7f155e7439c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.624+0000 7f155e7439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:16.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.624+0000 7f155e7439c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.624+0000 7f155e7439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:16.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.624+0000 7f155e7439c0 20 started sync module instance, tier type = 2024-09-19T14:08:16.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.624+0000 7f155e7439c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:08:16.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.640+0000 7f155e7439c0 20 add_watcher() i=0 2024-09-19T14:08:16.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.640+0000 7f155e7439c0 20 add_watcher() i=1 2024-09-19T14:08:16.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.640+0000 7f155e7439c0 20 add_watcher() i=2 2024-09-19T14:08:16.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.640+0000 7f155e7439c0 20 add_watcher() i=3 2024-09-19T14:08:16.643 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.640+0000 7f155e7439c0 20 add_watcher() i=4 2024-09-19T14:08:16.643 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.640+0000 7f155e7439c0 20 add_watcher() i=5 2024-09-19T14:08:16.643 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.640+0000 7f155e7439c0 20 add_watcher() i=6 2024-09-19T14:08:16.643 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.640+0000 7f155e7439c0 20 add_watcher() i=7 2024-09-19T14:08:16.643 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.640+0000 7f155e7439c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:08:16.646 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.644+0000 7f1412fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:16.647 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.644+0000 7f155e7439c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:08:16.647 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.644+0000 7f155e7439c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:08:16.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.644+0000 7f155e7439c0 5 note: GC not initialized 2024-09-19T14:08:16.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.644+0000 7f1411fdb640 20 reqs_thread_entry: start 2024-09-19T14:08:16.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.644+0000 7f155e7439c0 20 init_complete bucket index max shards: 11 2024-09-19T14:08:16.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.644+0000 7f155e7439c0 20 Filter name: none 2024-09-19T14:08:16.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.644+0000 7f13837fe640 20 reqs_thread_entry: start 2024-09-19T14:08:16.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.644+0000 7f155e7439c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.644+0000 7f155e7439c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-19T14:08:16.649 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.644+0000 7f155e7439c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.649 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.648+0000 7f155e7439c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-19T14:08:16.650 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.648+0000 7f155e7439c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:08:16.650 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.648+0000 7f155e7439c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.650 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.648+0000 7f155e7439c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-19T14:08:16.650 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.648+0000 7f155e7439c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.651 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.648+0000 7f155e7439c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-19T14:08:16.651 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.648+0000 7f155e7439c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:08:16.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.652+0000 7f1412fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:16.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.656+0000 7f155e7439c0 20 remove_watcher() i=0 2024-09-19T14:08:16.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.656+0000 7f155e7439c0 2 removed watcher, disabling cache 2024-09-19T14:08:16.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.660+0000 7f155e7439c0 20 remove_watcher() i=1 2024-09-19T14:08:16.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.660+0000 7f155e7439c0 20 remove_watcher() i=2 2024-09-19T14:08:16.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.664+0000 7f155e7439c0 20 remove_watcher() i=3 2024-09-19T14:08:16.666 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.664+0000 7f155e7439c0 20 remove_watcher() i=4 2024-09-19T14:08:16.668 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.664+0000 7f155e7439c0 20 remove_watcher() i=5 2024-09-19T14:08:16.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.668+0000 7f155e7439c0 20 remove_watcher() i=6 2024-09-19T14:08:16.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.668+0000 7f155e7439c0 20 remove_watcher() i=7 2024-09-19T14:08:16.684 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:16.684 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:08:16.684 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-block-writes id: dbb1da81-49d0-421a-b677-974869a7f103.4620.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:08:16.684 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:16.684 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-19T14:08:16.717 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:08:16.717 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:08:16.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.756+0000 7fbb7aec19c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.762 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.760+0000 7fbb7aec19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:16.762 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.760+0000 7fbb7aec19c0 20 realm 2024-09-19T14:08:16.762 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.760+0000 7fbb7aec19c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.760+0000 7fbb7aec19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:16.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.760+0000 7fbb7aec19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:08:16.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.760+0000 7fbb7aec19c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.760+0000 7fbb7aec19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:16.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.760+0000 7fbb7aec19c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.760+0000 7fbb7aec19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:16.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.760+0000 7fbb7aec19c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.764+0000 7fbb7aec19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:08:16.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.764+0000 7fbb7aec19c0 20 searching for the correct realm 2024-09-19T14:08:16.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.768+0000 7fbb781c6640 0 -- 172.21.15.153:0/3295686121 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x55bcda836a40 msgr2=0x55bcda838ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:16.776 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.772+0000 7fbb789c7640 0 -- 172.21.15.153:0/3295686121 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x55bcda5f2070 msgr2=0x7fbb6c108680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:16.784 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.780+0000 7fbb7aec19c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:08:16.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.780+0000 7fbb7aec19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:08:16.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.780+0000 7fbb7aec19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:08:16.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.780+0000 7fbb7aec19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:08:16.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.780+0000 7fbb7aec19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:08:16.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.780+0000 7fbb7aec19c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:08:16.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.780+0000 7fbb7aec19c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.780+0000 7fbb7aec19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:16.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.780+0000 7fbb7aec19c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.786 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.784+0000 7fbb7aec19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:16.786 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.784+0000 7fbb7aec19c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.786 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.784+0000 7fbb7aec19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:08:16.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.784+0000 7fbb7aec19c0 20 zone default found 2024-09-19T14:08:16.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.784+0000 7fbb7aec19c0 4 Realm: () 2024-09-19T14:08:16.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.784+0000 7fbb7aec19c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:08:16.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.784+0000 7fbb7aec19c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:08:16.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.784+0000 7fbb7aec19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:08:16.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.784+0000 7fbb7aec19c0 20 zonegroup default 2024-09-19T14:08:16.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.784+0000 7fbb7aec19c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.784+0000 7fbb7aec19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:16.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.784+0000 7fbb7aec19c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.784+0000 7fbb7aec19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:16.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.784+0000 7fbb7aec19c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.784+0000 7fbb7aec19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:16.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.784+0000 7fbb7aec19c0 20 started sync module instance, tier type = 2024-09-19T14:08:16.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.784+0000 7fbb7aec19c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:08:16.803 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.800+0000 7fbb7aec19c0 20 add_watcher() i=0 2024-09-19T14:08:16.803 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.800+0000 7fbb7aec19c0 20 add_watcher() i=1 2024-09-19T14:08:16.803 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.800+0000 7fbb7aec19c0 20 add_watcher() i=2 2024-09-19T14:08:16.803 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.800+0000 7fbb7aec19c0 20 add_watcher() i=3 2024-09-19T14:08:16.803 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.800+0000 7fbb7aec19c0 20 add_watcher() i=4 2024-09-19T14:08:16.803 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.800+0000 7fbb7aec19c0 20 add_watcher() i=5 2024-09-19T14:08:16.803 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.800+0000 7fbb7aec19c0 20 add_watcher() i=6 2024-09-19T14:08:16.804 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.800+0000 7fbb7aec19c0 20 add_watcher() i=7 2024-09-19T14:08:16.804 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.800+0000 7fbb7aec19c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:08:16.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.804+0000 7fba2efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:16.807 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.804+0000 7fbb7aec19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:08:16.807 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.804+0000 7fbb7aec19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:08:16.807 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.804+0000 7fbb7aec19c0 5 note: GC not initialized 2024-09-19T14:08:16.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.804+0000 7fba2dfe3640 20 reqs_thread_entry: start 2024-09-19T14:08:16.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.804+0000 7fbb7aec19c0 20 init_complete bucket index max shards: 11 2024-09-19T14:08:16.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.804+0000 7fbb7aec19c0 20 Filter name: none 2024-09-19T14:08:16.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.804+0000 7fb99f7fe640 20 reqs_thread_entry: start 2024-09-19T14:08:16.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.804+0000 7fbb7aec19c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-19T14:08:16.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.804+0000 7fbb7aec19c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.809 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.804+0000 7fbb7aec19c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-19T14:08:16.809 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.804+0000 7fbb7aec19c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-19T14:08:16.809 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.804+0000 7fbb7aec19c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-19T14:08:16.809 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.804+0000 7fbb7aec19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 : miss 2024-09-19T14:08:16.809 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.804+0000 7fbb7aec19c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.809 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.808+0000 7fbb7aec19c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-19T14:08:16.809 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.808+0000 7fbb7aec19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 info.flags=0x17 2024-09-19T14:08:16.809 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.808+0000 7fbb7aec19c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 to cache LRU end 2024-09-19T14:08:16.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.808+0000 7fbb7aec19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:08:16.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.808+0000 7fbb7aec19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:16.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.808+0000 7fbb7aec19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 2024-09-19T14:08:16.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.820+0000 7fbb7aec19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 info.flags=0x17 2024-09-19T14:08:16.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.820+0000 7fbb7aec19c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 to cache LRU end 2024-09-19T14:08:16.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.820+0000 7fbb7aec19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:16.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.820+0000 7fbb7aec19c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28, ofs0, ns] 2024-09-19T14:08:16.822 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.820+0000 7fba4ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333483 cookie 94269608271264 notifier 6533 bl.length()=915 2024-09-19T14:08:16.822 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.820+0000 7fba4ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 info.flags=0x17 2024-09-19T14:08:16.822 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.820+0000 7fba4ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 to cache LRU end 2024-09-19T14:08:16.822 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.820+0000 7fba4ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:16.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.820+0000 7fbb7aec19c0 20 handle_bi_update(): bucket=:error-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.28]): orig_sources= new_sources= 2024-09-19T14:08:16.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.820+0000 7fbb7aec19c0 20 handle_bi_update(): bucket=:error-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.28]): potential sources added=[] removed=[] 2024-09-19T14:08:16.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.820+0000 7fbb7aec19c0 20 handle_bi_update(): bucket=:error-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.28]): orig_dests= new_dests= 2024-09-19T14:08:16.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.820+0000 7fbb7aec19c0 20 handle_bi_update(): bucket=:error-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.28]): potential dests added=[] removed=[] 2024-09-19T14:08:16.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.0 2024-09-19T14:08:16.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.0 2024-09-19T14:08:16.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.1 2024-09-19T14:08:16.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.1 2024-09-19T14:08:16.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.2 2024-09-19T14:08:16.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.2 2024-09-19T14:08:16.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.3 2024-09-19T14:08:16.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.3 2024-09-19T14:08:16.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.4 2024-09-19T14:08:16.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.4 2024-09-19T14:08:16.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.5 2024-09-19T14:08:16.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.5 2024-09-19T14:08:16.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.6 2024-09-19T14:08:16.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.6 2024-09-19T14:08:16.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.7 2024-09-19T14:08:16.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.7 2024-09-19T14:08:16.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.8 2024-09-19T14:08:16.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.8 2024-09-19T14:08:16.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.9 2024-09-19T14:08:16.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.9 2024-09-19T14:08:16.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.10 2024-09-19T14:08:16.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.10 2024-09-19T14:08:16.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.11 2024-09-19T14:08:16.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.11 2024-09-19T14:08:16.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.0 2024-09-19T14:08:16.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1 2024-09-19T14:08:16.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.2 2024-09-19T14:08:16.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.832+0000 7fbb7aec19c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.3 2024-09-19T14:08:16.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.836+0000 7fbb7aec19c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.4 2024-09-19T14:08:16.839 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.836+0000 7fbb7aec19c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.5 2024-09-19T14:08:16.839 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.836+0000 7fbb7aec19c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.6 2024-09-19T14:08:16.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.836+0000 7fbb7aec19c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.7 2024-09-19T14:08:16.842 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.840+0000 7fbb7aec19c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.8 2024-09-19T14:08:16.843 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.840+0000 7fbb7aec19c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.9 2024-09-19T14:08:16.843 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.840+0000 7fbb7aec19c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.10 2024-09-19T14:08:16.849 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.848+0000 7fbb7aec19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 : hit (requested=0x17, cached=0x17) 2024-09-19T14:08:16.849 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.848+0000 7fbb7aec19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 2024-09-19T14:08:16.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.848+0000 7fbb7aec19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 info.flags=0x17 2024-09-19T14:08:16.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.848+0000 7fbb7aec19c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 to cache LRU end 2024-09-19T14:08:16.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.848+0000 7fbb7aec19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:16.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.848+0000 7fbb7aec19c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28, ofs0, ns] 2024-09-19T14:08:16.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.848+0000 7fba4f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333484 cookie 94269608271264 notifier 6533 bl.length()=915 2024-09-19T14:08:16.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.848+0000 7fba4f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 info.flags=0x17 2024-09-19T14:08:16.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.848+0000 7fba4f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 to cache LRU end 2024-09-19T14:08:16.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.848+0000 7fba4f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:16.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.852+0000 7fbb7aec19c0 20 handle_bi_update(): bucket=:error-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.28]): orig_sources= new_sources= 2024-09-19T14:08:16.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.852+0000 7fbb7aec19c0 20 handle_bi_update(): bucket=:error-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.28]): potential sources added=[] removed=[] 2024-09-19T14:08:16.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.852+0000 7fbb7aec19c0 20 handle_bi_update(): bucket=:error-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.28]): orig_dests= new_dests= 2024-09-19T14:08:16.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.852+0000 7fbb7aec19c0 20 handle_bi_update(): bucket=:error-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.28]): potential dests added=[] removed=[] 2024-09-19T14:08:16.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.852+0000 7fbb7aec19c0 -1 Injecting error=-5 at location=block_writes 2024-09-19T14:08:16.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.852+0000 7fbb7aec19c0 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-19T14:08:16.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.860+0000 7fbb7aec19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 : hit (requested=0x17, cached=0x17) 2024-09-19T14:08:16.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.864+0000 7fbb7aec19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 2024-09-19T14:08:16.867 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.864+0000 7fbb7aec19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 info.flags=0x17 2024-09-19T14:08:16.867 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.864+0000 7fbb7aec19c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 to cache LRU end 2024-09-19T14:08:16.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.864+0000 7fbb7aec19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:16.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.864+0000 7fbb7aec19c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28, ofs0, ns] 2024-09-19T14:08:16.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.864+0000 7fba4ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333485 cookie 94269608271264 notifier 6533 bl.length()=883 2024-09-19T14:08:16.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.864+0000 7fba4ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 info.flags=0x17 2024-09-19T14:08:16.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.864+0000 7fba4ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 to cache LRU end 2024-09-19T14:08:16.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.864+0000 7fba4ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:16.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.868+0000 7fbb7aec19c0 20 handle_bi_update(): bucket=:error-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.28]): orig_sources= new_sources= 2024-09-19T14:08:16.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.868+0000 7fbb7aec19c0 20 handle_bi_update(): bucket=:error-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.28]): potential sources added=[] removed=[] 2024-09-19T14:08:16.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.868+0000 7fbb7aec19c0 20 handle_bi_update(): bucket=:error-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.28]): orig_dests= new_dests= 2024-09-19T14:08:16.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.868+0000 7fbb7aec19c0 20 handle_bi_update(): bucket=:error-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.28]): potential dests added=[] removed=[] 2024-09-19T14:08:16.875 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.872+0000 7fbb7aec19c0 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-19T14:08:16.879 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.876+0000 7fba2efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:16.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.880+0000 7fbb7aec19c0 20 remove_watcher() i=0 2024-09-19T14:08:16.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.880+0000 7fbb7aec19c0 2 removed watcher, disabling cache 2024-09-19T14:08:16.885 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.884+0000 7fbb7aec19c0 20 remove_watcher() i=1 2024-09-19T14:08:16.887 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.884+0000 7fbb7aec19c0 20 remove_watcher() i=2 2024-09-19T14:08:16.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.888+0000 7fbb7aec19c0 20 remove_watcher() i=3 2024-09-19T14:08:16.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.888+0000 7fbb7aec19c0 20 remove_watcher() i=4 2024-09-19T14:08:16.892 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.888+0000 7fbb7aec19c0 20 remove_watcher() i=5 2024-09-19T14:08:16.894 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.892+0000 7fbb7aec19c0 20 remove_watcher() i=6 2024-09-19T14:08:16.895 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.892+0000 7fbb7aec19c0 20 remove_watcher() i=7 2024-09-19T14:08:16.909 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-19T14:08:16.936 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:08:16.936 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:08:16.980 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.976+0000 7f91242e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.982 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.980+0000 7f91242e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:16.982 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.980+0000 7f91242e49c0 20 realm 2024-09-19T14:08:16.982 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.980+0000 7f91242e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.982 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.980+0000 7f91242e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:16.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.980+0000 7f91242e49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:08:16.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.980+0000 7f91242e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.980+0000 7f91242e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:16.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.980+0000 7f91242e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.980+0000 7f91242e49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:16.984 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.980+0000 7f91242e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:16.984 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.980+0000 7f91242e49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:08:16.984 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.980+0000 7f91242e49c0 20 searching for the correct realm 2024-09-19T14:08:16.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.988+0000 7f91225eb640 0 -- 172.21.15.153:0/3979082429 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x5589bfd01400 msgr2=0x5589bfd03880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:16.995 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:16.992+0000 7f9121dea640 0 -- 172.21.15.153:0/3979082429 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f910c0710a0 msgr2=0x7f910c0440c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:17.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.000+0000 7f91242e49c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:08:17.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.000+0000 7f91242e49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:08:17.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.000+0000 7f91242e49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:08:17.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.000+0000 7f91242e49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:08:17.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.000+0000 7f91242e49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:08:17.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.000+0000 7f91242e49c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:08:17.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.000+0000 7f91242e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.000+0000 7f91242e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:17.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.000+0000 7f91242e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.004 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.000+0000 7f91242e49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:17.004 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.000+0000 7f91242e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.005 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.000+0000 7f91242e49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:08:17.005 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.000+0000 7f91242e49c0 20 zone default found 2024-09-19T14:08:17.005 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.000+0000 7f91242e49c0 4 Realm: () 2024-09-19T14:08:17.005 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.000+0000 7f91242e49c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:08:17.005 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.000+0000 7f91242e49c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:08:17.005 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.000+0000 7f91242e49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:08:17.005 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.000+0000 7f91242e49c0 20 zonegroup default 2024-09-19T14:08:17.005 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.000+0000 7f91242e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.005 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.000+0000 7f91242e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:17.005 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.000+0000 7f91242e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.006 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.004+0000 7f91242e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:17.006 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.004+0000 7f91242e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.006 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.004+0000 7f91242e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:17.006 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.004+0000 7f91242e49c0 20 started sync module instance, tier type = 2024-09-19T14:08:17.006 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.004+0000 7f91242e49c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:08:17.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.016+0000 7f91242e49c0 20 add_watcher() i=0 2024-09-19T14:08:17.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.016+0000 7f91242e49c0 20 add_watcher() i=1 2024-09-19T14:08:17.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.016+0000 7f91242e49c0 20 add_watcher() i=2 2024-09-19T14:08:17.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.016+0000 7f91242e49c0 20 add_watcher() i=3 2024-09-19T14:08:17.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.016+0000 7f91242e49c0 20 add_watcher() i=4 2024-09-19T14:08:17.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.016+0000 7f91242e49c0 20 add_watcher() i=5 2024-09-19T14:08:17.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.016+0000 7f91242e49c0 20 add_watcher() i=6 2024-09-19T14:08:17.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.020+0000 7f91242e49c0 20 add_watcher() i=7 2024-09-19T14:08:17.022 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.020+0000 7f91242e49c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:08:17.024 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.020+0000 7f8fd3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:17.025 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.020+0000 7f91242e49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:08:17.025 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.020+0000 7f91242e49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:08:17.025 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.020+0000 7f91242e49c0 5 note: GC not initialized 2024-09-19T14:08:17.025 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.024+0000 7f8fd2ffd640 20 reqs_thread_entry: start 2024-09-19T14:08:17.025 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.024+0000 7f91242e49c0 20 init_complete bucket index max shards: 11 2024-09-19T14:08:17.025 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.024+0000 7f91242e49c0 20 Filter name: none 2024-09-19T14:08:17.026 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.024+0000 7f8fd0ff9640 20 reqs_thread_entry: start 2024-09-19T14:08:17.026 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.024+0000 7f91242e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.026 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.024+0000 7f91242e49c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-19T14:08:17.026 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.024+0000 7f91242e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.027 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.024+0000 7f91242e49c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-19T14:08:17.027 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.024+0000 7f91242e49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:08:17.027 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.024+0000 7f91242e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.028 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.024+0000 7f91242e49c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-19T14:08:17.028 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.024+0000 7f91242e49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.029 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.028+0000 7f91242e49c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-19T14:08:17.029 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.028+0000 7f91242e49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:08:17.031 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.028+0000 7f8fd3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:17.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.032+0000 7f91242e49c0 20 remove_watcher() i=0 2024-09-19T14:08:17.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.032+0000 7f91242e49c0 2 removed watcher, disabling cache 2024-09-19T14:08:17.038 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.036+0000 7f91242e49c0 20 remove_watcher() i=1 2024-09-19T14:08:17.040 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.036+0000 7f91242e49c0 20 remove_watcher() i=2 2024-09-19T14:08:17.042 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.040+0000 7f91242e49c0 20 remove_watcher() i=3 2024-09-19T14:08:17.044 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.040+0000 7f91242e49c0 20 remove_watcher() i=4 2024-09-19T14:08:17.045 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.044+0000 7f91242e49c0 20 remove_watcher() i=5 2024-09-19T14:08:17.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.044+0000 7f91242e49c0 20 remove_watcher() i=6 2024-09-19T14:08:17.048 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.044+0000 7f91242e49c0 20 remove_watcher() i=7 2024-09-19T14:08:17.061 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:17.061 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:08:17.061 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-block-writes id: dbb1da81-49d0-421a-b677-974869a7f103.4620.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:08:17.061 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:17.062 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:17.062 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:17.104 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:17.104 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:17.166 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T14:08:17.201 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:08:17.201 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:08:17.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.452+0000 7f49714849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.456 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.452+0000 7f49714849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:17.456 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.452+0000 7f49714849c0 20 realm 2024-09-19T14:08:17.456 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.452+0000 7f49714849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.456 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.452+0000 7f49714849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:17.457 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.452+0000 7f49714849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:08:17.457 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.452+0000 7f49714849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.457 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.452+0000 7f49714849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:17.457 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.452+0000 7f49714849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.458 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.456+0000 7f49714849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:17.458 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.456+0000 7f49714849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.459 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.456+0000 7f49714849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:08:17.459 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.456+0000 7f49714849c0 20 searching for the correct realm 2024-09-19T14:08:17.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.460+0000 7f496f78b640 0 -- 172.21.15.153:0/898150782 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f4964008040 msgr2=0x7f4964008930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:17.471 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.468+0000 7f496ef8a640 0 -- 172.21.15.153:0/898150782 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f496400a440 msgr2=0x7f496400a8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:08:17.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.684+0000 7f49714849c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:08:17.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.684+0000 7f49714849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:08:17.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.684+0000 7f49714849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:08:17.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.684+0000 7f49714849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:08:17.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.684+0000 7f49714849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:08:17.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.684+0000 7f49714849c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:08:17.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.684+0000 7f49714849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.690 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.688+0000 7f49714849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:17.690 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.688+0000 7f49714849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.690 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.688+0000 7f49714849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:17.690 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.688+0000 7f49714849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.688+0000 7f49714849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:08:17.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.688+0000 7f49714849c0 20 zone default found 2024-09-19T14:08:17.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.688+0000 7f49714849c0 4 Realm: () 2024-09-19T14:08:17.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.688+0000 7f49714849c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:08:17.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.688+0000 7f49714849c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:08:17.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.688+0000 7f49714849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:08:17.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.688+0000 7f49714849c0 20 zonegroup default 2024-09-19T14:08:17.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.688+0000 7f49714849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.688+0000 7f49714849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:17.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.688+0000 7f49714849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.692+0000 7f49714849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:17.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.692+0000 7f49714849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.692+0000 7f49714849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:17.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.692+0000 7f49714849c0 20 started sync module instance, tier type = 2024-09-19T14:08:17.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.692+0000 7f49714849c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:08:17.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.716+0000 7f49714849c0 20 add_watcher() i=0 2024-09-19T14:08:17.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.716+0000 7f49714849c0 20 add_watcher() i=1 2024-09-19T14:08:17.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.716+0000 7f49714849c0 20 add_watcher() i=2 2024-09-19T14:08:17.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.716+0000 7f49714849c0 20 add_watcher() i=3 2024-09-19T14:08:17.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.716+0000 7f49714849c0 20 add_watcher() i=4 2024-09-19T14:08:17.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.716+0000 7f49714849c0 20 add_watcher() i=5 2024-09-19T14:08:17.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.716+0000 7f49714849c0 20 add_watcher() i=6 2024-09-19T14:08:17.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.716+0000 7f49714849c0 20 add_watcher() i=7 2024-09-19T14:08:17.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.716+0000 7f49714849c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:08:17.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.720+0000 7f48257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:17.725 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.724+0000 7f49714849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:08:17.725 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.724+0000 7f49714849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:08:17.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.724+0000 7f49714849c0 5 note: GC not initialized 2024-09-19T14:08:17.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.724+0000 7f479ffff640 20 reqs_thread_entry: start 2024-09-19T14:08:17.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.724+0000 7f49714849c0 20 init_complete bucket index max shards: 11 2024-09-19T14:08:17.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.724+0000 7f49714849c0 20 Filter name: none 2024-09-19T14:08:17.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.724+0000 7f479dffb640 20 reqs_thread_entry: start 2024-09-19T14:08:17.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.724+0000 7f49714849c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-19T14:08:17.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.724+0000 7f49714849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.724+0000 7f49714849c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-19T14:08:17.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.724+0000 7f49714849c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-19T14:08:17.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.724+0000 7f49714849c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-19T14:08:17.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.724+0000 7f49714849c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 : miss 2024-09-19T14:08:17.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.724+0000 7f49714849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.728+0000 7f49714849c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-19T14:08:17.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.728+0000 7f49714849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 info.flags=0x17 2024-09-19T14:08:17.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.728+0000 7f49714849c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 to cache LRU end 2024-09-19T14:08:17.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.728+0000 7f49714849c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:08:17.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.728+0000 7f49714849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:17.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.728+0000 7f49714849c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 2024-09-19T14:08:17.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.740+0000 7f49714849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 info.flags=0x17 2024-09-19T14:08:17.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.740+0000 7f49714849c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 to cache LRU end 2024-09-19T14:08:17.743 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.740+0000 7f49714849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:17.743 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.740+0000 7f49714849c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28, ofs0, ns] 2024-09-19T14:08:17.743 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.740+0000 7f48527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333486 cookie 94095098589136 notifier 6990 bl.length()=915 2024-09-19T14:08:17.743 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.740+0000 7f48527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 info.flags=0x17 2024-09-19T14:08:17.743 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.740+0000 7f48527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 to cache LRU end 2024-09-19T14:08:17.743 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.740+0000 7f48527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:17.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.744+0000 7f49714849c0 20 handle_bi_update(): bucket=:error-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.28]): orig_sources= new_sources= 2024-09-19T14:08:17.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.744+0000 7f49714849c0 20 handle_bi_update(): bucket=:error-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.28]): potential sources added=[] removed=[] 2024-09-19T14:08:17.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.744+0000 7f49714849c0 20 handle_bi_update(): bucket=:error-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.28]): orig_dests= new_dests= 2024-09-19T14:08:17.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.744+0000 7f49714849c0 20 handle_bi_update(): bucket=:error-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.28]): potential dests added=[] removed=[] 2024-09-19T14:08:17.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.0 2024-09-19T14:08:17.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.0 2024-09-19T14:08:17.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.1 2024-09-19T14:08:17.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.1 2024-09-19T14:08:17.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.2 2024-09-19T14:08:17.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.2 2024-09-19T14:08:17.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.3 2024-09-19T14:08:17.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.3 2024-09-19T14:08:17.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.4 2024-09-19T14:08:17.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.4 2024-09-19T14:08:17.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.5 2024-09-19T14:08:17.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.5 2024-09-19T14:08:17.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.6 2024-09-19T14:08:17.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.6 2024-09-19T14:08:17.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.7 2024-09-19T14:08:17.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.7 2024-09-19T14:08:17.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.8 2024-09-19T14:08:17.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.8 2024-09-19T14:08:17.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.9 2024-09-19T14:08:17.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.9 2024-09-19T14:08:17.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.10 2024-09-19T14:08:17.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.10 2024-09-19T14:08:17.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.11 2024-09-19T14:08:17.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1.11 2024-09-19T14:08:17.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.0 2024-09-19T14:08:17.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.752+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1 2024-09-19T14:08:17.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.756+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.2 2024-09-19T14:08:17.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.756+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.3 2024-09-19T14:08:17.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.760+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.4 2024-09-19T14:08:17.762 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.760+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.5 2024-09-19T14:08:17.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.760+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.6 2024-09-19T14:08:17.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.764+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.7 2024-09-19T14:08:17.766 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.764+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.8 2024-09-19T14:08:17.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.764+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.9 2024-09-19T14:08:17.768 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.764+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.10 2024-09-19T14:08:17.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.772+0000 7f49714849c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 : hit (requested=0x17, cached=0x17) 2024-09-19T14:08:17.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.772+0000 7f49714849c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 2024-09-19T14:08:17.778 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.776+0000 7f49714849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 info.flags=0x17 2024-09-19T14:08:17.778 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.776+0000 7f49714849c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 to cache LRU end 2024-09-19T14:08:17.778 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.776+0000 7f49714849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:17.778 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.776+0000 7f49714849c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28, ofs0, ns] 2024-09-19T14:08:17.779 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.776+0000 7f4851ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333487 cookie 94095098589136 notifier 6990 bl.length()=915 2024-09-19T14:08:17.779 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.776+0000 7f4851ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 info.flags=0x17 2024-09-19T14:08:17.779 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.776+0000 7f4851ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 to cache LRU end 2024-09-19T14:08:17.779 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.776+0000 7f4851ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:17.781 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.780+0000 7f49714849c0 20 handle_bi_update(): bucket=:error-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.28]): orig_sources= new_sources= 2024-09-19T14:08:17.781 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.780+0000 7f49714849c0 20 handle_bi_update(): bucket=:error-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.28]): potential sources added=[] removed=[] 2024-09-19T14:08:17.781 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.780+0000 7f49714849c0 20 handle_bi_update(): bucket=:error-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.28]): orig_dests= new_dests= 2024-09-19T14:08:17.781 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.780+0000 7f49714849c0 20 handle_bi_update(): bucket=:error-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.28]): potential dests added=[] removed=[] 2024-09-19T14:08:17.786 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.784+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.0 2024-09-19T14:08:17.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.784+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.1 2024-09-19T14:08:17.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.784+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.2 2024-09-19T14:08:17.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.784+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.3 2024-09-19T14:08:17.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.788+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.4 2024-09-19T14:08:17.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.788+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.5 2024-09-19T14:08:17.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.788+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.6 2024-09-19T14:08:17.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.788+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.7 2024-09-19T14:08:17.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.788+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.8 2024-09-19T14:08:17.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.792+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.9 2024-09-19T14:08:17.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.792+0000 7f49714849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.28.10 2024-09-19T14:08:17.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.792+0000 7f49714849c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 : hit (requested=0x17, cached=0x17) 2024-09-19T14:08:17.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.792+0000 7f49714849c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 2024-09-19T14:08:17.797 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.796+0000 7f49714849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 info.flags=0x17 2024-09-19T14:08:17.797 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.796+0000 7f49714849c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 to cache LRU end 2024-09-19T14:08:17.797 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.796+0000 7f49714849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:17.797 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.796+0000 7f49714849c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28, ofs0, ns] 2024-09-19T14:08:17.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.796+0000 7f4851ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333488 cookie 94095098589136 notifier 6990 bl.length()=883 2024-09-19T14:08:17.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.796+0000 7f4851ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 info.flags=0x17 2024-09-19T14:08:17.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.796+0000 7f4851ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.28 to cache LRU end 2024-09-19T14:08:17.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.796+0000 7f4851ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:17.800 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.796+0000 7f49714849c0 20 handle_bi_update(): bucket=:error-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.28]): orig_sources= new_sources= 2024-09-19T14:08:17.800 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.796+0000 7f49714849c0 20 handle_bi_update(): bucket=:error-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.28]): potential sources added=[] removed=[] 2024-09-19T14:08:17.801 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.796+0000 7f49714849c0 20 handle_bi_update(): bucket=:error-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.28]): orig_dests= new_dests= 2024-09-19T14:08:17.801 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.796+0000 7f49714849c0 20 handle_bi_update(): bucket=:error-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.28]): potential dests added=[] removed=[] 2024-09-19T14:08:17.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.804+0000 7f49714849c0 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-19T14:08:17.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.808+0000 7f48257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:17.816 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.812+0000 7f49714849c0 20 remove_watcher() i=0 2024-09-19T14:08:17.816 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.812+0000 7f49714849c0 2 removed watcher, disabling cache 2024-09-19T14:08:17.818 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.816+0000 7f49714849c0 20 remove_watcher() i=1 2024-09-19T14:08:17.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.820+0000 7f49714849c0 20 remove_watcher() i=2 2024-09-19T14:08:17.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.820+0000 7f49714849c0 20 remove_watcher() i=3 2024-09-19T14:08:17.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.824+0000 7f49714849c0 20 remove_watcher() i=4 2024-09-19T14:08:17.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.824+0000 7f49714849c0 20 remove_watcher() i=5 2024-09-19T14:08:17.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.828+0000 7f49714849c0 20 remove_watcher() i=6 2024-09-19T14:08:17.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.828+0000 7f49714849c0 20 remove_watcher() i=7 2024-09-19T14:08:17.848 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-19T14:08:17.877 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:08:17.878 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:08:17.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.920+0000 7fed63f529c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.920+0000 7fed63f529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:17.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.920+0000 7fed63f529c0 20 realm 2024-09-19T14:08:17.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.920+0000 7fed63f529c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.920+0000 7fed63f529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:17.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.920+0000 7fed63f529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:08:17.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.920+0000 7fed63f529c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.920+0000 7fed63f529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:17.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.920+0000 7fed63f529c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.926 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.924+0000 7fed63f529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:17.926 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.924+0000 7fed63f529c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.926 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.924+0000 7fed63f529c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:08:17.926 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.924+0000 7fed63f529c0 20 searching for the correct realm 2024-09-19T14:08:17.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.928+0000 7fed61257640 0 -- 172.21.15.153:0/2489420873 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x55db4b704f90 msgr2=0x55db4b707380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:17.938 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.936+0000 7fed61a58640 0 -- 172.21.15.153:0/2489420873 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fed58008040 msgr2=0x7fed58069360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:17.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.944+0000 7fed63f529c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:08:17.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.944+0000 7fed63f529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:08:17.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.944+0000 7fed63f529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:08:17.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.944+0000 7fed63f529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:08:17.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.944+0000 7fed63f529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:08:17.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.944+0000 7fed63f529c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:08:17.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.944+0000 7fed63f529c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.944+0000 7fed63f529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:17.946 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.944+0000 7fed63f529c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.944+0000 7fed63f529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:17.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.944+0000 7fed63f529c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.944+0000 7fed63f529c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:08:17.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.944+0000 7fed63f529c0 20 zone default found 2024-09-19T14:08:17.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.944+0000 7fed63f529c0 4 Realm: () 2024-09-19T14:08:17.948 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.944+0000 7fed63f529c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:08:17.948 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.944+0000 7fed63f529c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:08:17.948 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.944+0000 7fed63f529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:08:17.948 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.944+0000 7fed63f529c0 20 zonegroup default 2024-09-19T14:08:17.948 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.944+0000 7fed63f529c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.948 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.944+0000 7fed63f529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:17.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.944+0000 7fed63f529c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.948+0000 7fed63f529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:17.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.948+0000 7fed63f529c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.948+0000 7fed63f529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:17.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.948+0000 7fed63f529c0 20 started sync module instance, tier type = 2024-09-19T14:08:17.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.948+0000 7fed63f529c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:08:17.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.960+0000 7fed63f529c0 20 add_watcher() i=0 2024-09-19T14:08:17.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.960+0000 7fed63f529c0 20 add_watcher() i=1 2024-09-19T14:08:17.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.960+0000 7fed63f529c0 20 add_watcher() i=2 2024-09-19T14:08:17.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.960+0000 7fed63f529c0 20 add_watcher() i=3 2024-09-19T14:08:17.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.960+0000 7fed63f529c0 20 add_watcher() i=4 2024-09-19T14:08:17.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.960+0000 7fed63f529c0 20 add_watcher() i=5 2024-09-19T14:08:17.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.960+0000 7fed63f529c0 20 add_watcher() i=6 2024-09-19T14:08:17.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.964+0000 7fed63f529c0 20 add_watcher() i=7 2024-09-19T14:08:17.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.964+0000 7fed63f529c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:08:17.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.964+0000 7fec137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:17.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.964+0000 7fed63f529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:08:17.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.964+0000 7fed63f529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:08:17.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.964+0000 7fed63f529c0 5 note: GC not initialized 2024-09-19T14:08:17.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.968+0000 7fec127fc640 20 reqs_thread_entry: start 2024-09-19T14:08:17.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.968+0000 7fed63f529c0 20 init_complete bucket index max shards: 11 2024-09-19T14:08:17.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.968+0000 7fed63f529c0 20 Filter name: none 2024-09-19T14:08:17.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.968+0000 7feb83fff640 20 reqs_thread_entry: start 2024-09-19T14:08:17.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.968+0000 7fed63f529c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.968+0000 7fed63f529c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-19T14:08:17.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.968+0000 7fed63f529c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.971 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.968+0000 7fed63f529c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-19T14:08:17.971 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.968+0000 7fed63f529c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:08:17.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.968+0000 7fed63f529c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.968+0000 7fed63f529c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-19T14:08:17.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.968+0000 7fed63f529c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:17.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.972+0000 7fed63f529c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-19T14:08:17.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.972+0000 7fed63f529c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:08:17.975 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.972+0000 7fec137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:17.980 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.976+0000 7fed63f529c0 20 remove_watcher() i=0 2024-09-19T14:08:17.980 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.976+0000 7fed63f529c0 2 removed watcher, disabling cache 2024-09-19T14:08:17.982 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.980+0000 7fed63f529c0 20 remove_watcher() i=1 2024-09-19T14:08:17.984 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.980+0000 7fed63f529c0 20 remove_watcher() i=2 2024-09-19T14:08:17.986 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.984+0000 7fed63f529c0 20 remove_watcher() i=3 2024-09-19T14:08:17.988 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.984+0000 7fed63f529c0 20 remove_watcher() i=4 2024-09-19T14:08:17.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.988+0000 7fed63f529c0 20 remove_watcher() i=5 2024-09-19T14:08:17.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.988+0000 7fed63f529c0 20 remove_watcher() i=6 2024-09-19T14:08:17.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:17.988+0000 7fed63f529c0 20 remove_watcher() i=7 2024-09-19T14:08:18.004 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:18.005 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:08:18.005 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-block-writes id: dbb1da81-49d0-421a-b677-974869a7f103.4620.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T14:08:18.005 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:18.006 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:18.006 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:18.028 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:18.028 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:18.523 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:18.523 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:18.873 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard bucket with abort at block_writes 2024-09-19T14:08:18.874 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:18.876 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:18.877 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:19.002 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:19.002 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:19.089 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:19.089 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:19.193 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:19.193 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:19.294 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:19.294 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:19.390 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:19.390 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:19.487 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:19.488 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:19.581 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:19.582 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:19.681 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:19.681 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:19.782 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:19.782 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:19.885 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:19.886 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:19.981 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:19.981 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:20.080 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:20.080 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:20.181 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:20.181 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:20.281 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:20.281 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:20.379 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:20.379 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:20.476 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:20.476 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:20.577 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:20.577 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:20.681 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:20.681 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:20.774 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:20.774 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:20.871 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:20.871 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:20.978 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:20.978 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:21.074 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-19T14:08:21.106 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:08:21.106 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:08:21.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.148+0000 7fd9a310f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.152+0000 7fd9a310f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.155 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.152+0000 7fd9a310f9c0 20 realm 2024-09-19T14:08:21.155 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.152+0000 7fd9a310f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.155 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.152+0000 7fd9a310f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.155 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.152+0000 7fd9a310f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:08:21.155 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.152+0000 7fd9a310f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.155 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.152+0000 7fd9a310f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.155 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.152+0000 7fd9a310f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.152+0000 7fd9a310f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:21.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.152+0000 7fd9a310f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.156+0000 7fd9a310f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:08:21.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.156+0000 7fd9a310f9c0 20 searching for the correct realm 2024-09-19T14:08:21.162 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.160+0000 7fd9a1416640 0 -- 172.21.15.153:0/1356834370 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7fd994001bd0 msgr2=0x7fd99405c1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:21.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.164+0000 7fd9a0c15640 0 -- 172.21.15.153:0/1356834370 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fd99405e7a0 msgr2=0x7fd994093050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:21.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.380+0000 7fd9a310f9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:08:21.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.380+0000 7fd9a310f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:08:21.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.380+0000 7fd9a310f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:08:21.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.380+0000 7fd9a310f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:08:21.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.380+0000 7fd9a310f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:08:21.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.380+0000 7fd9a310f9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:08:21.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.380+0000 7fd9a310f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.380+0000 7fd9a310f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.380+0000 7fd9a310f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.385 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.384+0000 7fd9a310f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:21.385 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.384+0000 7fd9a310f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.384+0000 7fd9a310f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:08:21.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.384+0000 7fd9a310f9c0 20 zone default found 2024-09-19T14:08:21.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.384+0000 7fd9a310f9c0 4 Realm: () 2024-09-19T14:08:21.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.384+0000 7fd9a310f9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:08:21.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.384+0000 7fd9a310f9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:08:21.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.384+0000 7fd9a310f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:08:21.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.384+0000 7fd9a310f9c0 20 zonegroup default 2024-09-19T14:08:21.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.384+0000 7fd9a310f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.387 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.384+0000 7fd9a310f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.387 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.384+0000 7fd9a310f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.387 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.384+0000 7fd9a310f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.387 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.384+0000 7fd9a310f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.388 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.384+0000 7fd9a310f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.384+0000 7fd9a310f9c0 20 started sync module instance, tier type = 2024-09-19T14:08:21.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.384+0000 7fd9a310f9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:08:21.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.408+0000 7fd9a310f9c0 20 add_watcher() i=0 2024-09-19T14:08:21.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.408+0000 7fd9a310f9c0 20 add_watcher() i=1 2024-09-19T14:08:21.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.408+0000 7fd9a310f9c0 20 add_watcher() i=2 2024-09-19T14:08:21.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.408+0000 7fd9a310f9c0 20 add_watcher() i=3 2024-09-19T14:08:21.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.408+0000 7fd9a310f9c0 20 add_watcher() i=4 2024-09-19T14:08:21.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.408+0000 7fd9a310f9c0 20 add_watcher() i=5 2024-09-19T14:08:21.413 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.408+0000 7fd9a310f9c0 20 add_watcher() i=6 2024-09-19T14:08:21.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.412+0000 7fd9a310f9c0 20 add_watcher() i=7 2024-09-19T14:08:21.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.412+0000 7fd9a310f9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:08:21.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.416+0000 7fd8577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:21.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.416+0000 7fd9a310f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:08:21.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.416+0000 7fd9a310f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:08:21.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.416+0000 7fd9a310f9c0 5 note: GC not initialized 2024-09-19T14:08:21.420 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.416+0000 7fd8567e4640 20 reqs_thread_entry: start 2024-09-19T14:08:21.420 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.416+0000 7fd9a310f9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:08:21.420 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.416+0000 7fd9a310f9c0 20 Filter name: none 2024-09-19T14:08:21.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.416+0000 7fd84f7fe640 20 reqs_thread_entry: start 2024-09-19T14:08:21.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.416+0000 7fd9a310f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.420+0000 7fd9a310f9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-19T14:08:21.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.420+0000 7fd9a310f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.423 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.420+0000 7fd9a310f9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-19T14:08:21.423 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.420+0000 7fd9a310f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:08:21.423 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.420+0000 7fd9a310f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.424 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.420+0000 7fd9a310f9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-19T14:08:21.424 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.420+0000 7fd9a310f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.425 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.420+0000 7fd9a310f9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-19T14:08:21.425 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.420+0000 7fd9a310f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:08:21.427 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.424+0000 7fd8577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:21.432 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.428+0000 7fd9a310f9c0 20 remove_watcher() i=0 2024-09-19T14:08:21.432 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.428+0000 7fd9a310f9c0 2 removed watcher, disabling cache 2024-09-19T14:08:21.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.432+0000 7fd9a310f9c0 20 remove_watcher() i=1 2024-09-19T14:08:21.436 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.432+0000 7fd9a310f9c0 20 remove_watcher() i=2 2024-09-19T14:08:21.438 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.436+0000 7fd9a310f9c0 20 remove_watcher() i=3 2024-09-19T14:08:21.440 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.436+0000 7fd9a310f9c0 20 remove_watcher() i=4 2024-09-19T14:08:21.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.440+0000 7fd9a310f9c0 20 remove_watcher() i=5 2024-09-19T14:08:21.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.440+0000 7fd9a310f9c0 20 remove_watcher() i=6 2024-09-19T14:08:21.444 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.440+0000 7fd9a310f9c0 20 remove_watcher() i=7 2024-09-19T14:08:21.460 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.460 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:08:21.461 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: abort-at-block-writes id: dbb1da81-49d0-421a-b677-974869a7f103.4620.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:08:21.461 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.461 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-19T14:08:21.497 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:08:21.498 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:08:21.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 20 realm 2024-09-19T14:08:21.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:08:21.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.544+0000 7f1a0a8c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:21.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.544+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.544+0000 7f1a0a8c49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:08:21.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.544+0000 7f1a0a8c49c0 20 searching for the correct realm 2024-09-19T14:08:21.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.548+0000 7f1a08bcb640 0 -- 172.21.15.153:0/824375401 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x563af2b18c70 msgr2=0x563af2b1b0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:08:21.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.556+0000 7f1a083ca640 0 -- 172.21.15.153:0/824375401 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f19fc067940 msgr2=0x7f19fc062110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:21.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:08:21.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:08:21.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:08:21.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:08:21.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:08:21.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:08:21.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:21.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:08:21.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 zone default found 2024-09-19T14:08:21.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 4 Realm: () 2024-09-19T14:08:21.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:08:21.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:08:21.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:08:21.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 zonegroup default 2024-09-19T14:08:21.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.568+0000 7f1a0a8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.568+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.568+0000 7f1a0a8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.568+0000 7f1a0a8c49c0 20 started sync module instance, tier type = 2024-09-19T14:08:21.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.568+0000 7f1a0a8c49c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:08:21.585 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 20 add_watcher() i=0 2024-09-19T14:08:21.585 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 20 add_watcher() i=1 2024-09-19T14:08:21.585 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 20 add_watcher() i=2 2024-09-19T14:08:21.585 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 20 add_watcher() i=3 2024-09-19T14:08:21.585 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 20 add_watcher() i=4 2024-09-19T14:08:21.585 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 20 add_watcher() i=5 2024-09-19T14:08:21.585 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 20 add_watcher() i=6 2024-09-19T14:08:21.586 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 20 add_watcher() i=7 2024-09-19T14:08:21.586 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:08:21.588 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.584+0000 7f18bf7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:21.589 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:08:21.589 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:08:21.589 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 5 note: GC not initialized 2024-09-19T14:08:21.590 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.588+0000 7f18be7dc640 20 reqs_thread_entry: start 2024-09-19T14:08:21.590 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 20 init_complete bucket index max shards: 11 2024-09-19T14:08:21.590 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 20 Filter name: none 2024-09-19T14:08:21.590 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.588+0000 7f18b77fe640 20 reqs_thread_entry: start 2024-09-19T14:08:21.590 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-19T14:08:21.590 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.590 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-19T14:08:21.590 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-19T14:08:21.591 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-19T14:08:21.591 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 : miss 2024-09-19T14:08:21.591 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.591 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-19T14:08:21.591 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 info.flags=0x17 2024-09-19T14:08:21.592 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 to cache LRU end 2024-09-19T14:08:21.592 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:08:21.592 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:21.592 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 2024-09-19T14:08:21.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.600+0000 7f1a0a8c49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 info.flags=0x17 2024-09-19T14:08:21.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.600+0000 7f1a0a8c49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 to cache LRU end 2024-09-19T14:08:21.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.600+0000 7f1a0a8c49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:21.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.600+0000 7f1a0a8c49c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29, ofs0, ns] 2024-09-19T14:08:21.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.600+0000 7f18deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333527 cookie 94811179866944 notifier 6620 bl.length()=915 2024-09-19T14:08:21.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.600+0000 7f18deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 info.flags=0x17 2024-09-19T14:08:21.603 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.600+0000 7f18deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 to cache LRU end 2024-09-19T14:08:21.603 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.600+0000 7f18deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:21.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.604+0000 7f1a0a8c49c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): orig_sources= new_sources= 2024-09-19T14:08:21.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.604+0000 7f1a0a8c49c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): potential sources added=[] removed=[] 2024-09-19T14:08:21.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.604+0000 7f1a0a8c49c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): orig_dests= new_dests= 2024-09-19T14:08:21.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.604+0000 7f1a0a8c49c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): potential dests added=[] removed=[] 2024-09-19T14:08:21.614 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.0 2024-09-19T14:08:21.614 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.0 2024-09-19T14:08:21.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.1 2024-09-19T14:08:21.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.1 2024-09-19T14:08:21.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.2 2024-09-19T14:08:21.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.2 2024-09-19T14:08:21.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.3 2024-09-19T14:08:21.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.3 2024-09-19T14:08:21.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.4 2024-09-19T14:08:21.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.4 2024-09-19T14:08:21.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.5 2024-09-19T14:08:21.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.5 2024-09-19T14:08:21.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.6 2024-09-19T14:08:21.615 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.6 2024-09-19T14:08:21.616 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.7 2024-09-19T14:08:21.616 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.7 2024-09-19T14:08:21.616 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.8 2024-09-19T14:08:21.616 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.8 2024-09-19T14:08:21.616 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.9 2024-09-19T14:08:21.616 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.9 2024-09-19T14:08:21.616 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.10 2024-09-19T14:08:21.616 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.10 2024-09-19T14:08:21.616 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.11 2024-09-19T14:08:21.616 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.11 2024-09-19T14:08:21.616 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.0 2024-09-19T14:08:21.617 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1 2024-09-19T14:08:21.617 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2 2024-09-19T14:08:21.617 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.3 2024-09-19T14:08:21.617 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.4 2024-09-19T14:08:21.618 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.616+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.5 2024-09-19T14:08:21.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.616+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.6 2024-09-19T14:08:21.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.616+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.7 2024-09-19T14:08:21.620 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.616+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.8 2024-09-19T14:08:21.621 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.620+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.9 2024-09-19T14:08:21.623 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.620+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.10 2024-09-19T14:08:21.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.624+0000 7f1a0a8c49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 : hit (requested=0x17, cached=0x17) 2024-09-19T14:08:21.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.624+0000 7f1a0a8c49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 2024-09-19T14:08:21.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.628+0000 7f1a0a8c49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 info.flags=0x17 2024-09-19T14:08:21.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.628+0000 7f1a0a8c49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 to cache LRU end 2024-09-19T14:08:21.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.628+0000 7f1a0a8c49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:21.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.628+0000 7f1a0a8c49c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29, ofs0, ns] 2024-09-19T14:08:21.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.628+0000 7f18deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333528 cookie 94811179866944 notifier 6620 bl.length()=915 2024-09-19T14:08:21.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.628+0000 7f18deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 info.flags=0x17 2024-09-19T14:08:21.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.628+0000 7f18deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 to cache LRU end 2024-09-19T14:08:21.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.628+0000 7f18deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:21.634 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.632+0000 7f1a0a8c49c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): orig_sources= new_sources= 2024-09-19T14:08:21.635 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.632+0000 7f1a0a8c49c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): potential sources added=[] removed=[] 2024-09-19T14:08:21.635 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.632+0000 7f1a0a8c49c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): orig_dests= new_dests= 2024-09-19T14:08:21.635 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.632+0000 7f1a0a8c49c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): potential dests added=[] removed=[] 2024-09-19T14:08:21.635 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1a0a8c49c0 time 2024-09-19T14:08:21.637834+0000 2024-09-19T14:08:21.635 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:08:21.636 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:08:21.636 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1a0e19e2eb] 2024-09-19T14:08:21.636 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1a0e19e49f] 2024-09-19T14:08:21.636 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563af02f6271] 2024-09-19T14:08:21.636 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x563af03054ab] 2024-09-19T14:08:21.636 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563af0306a94] 2024-09-19T14:08:21.637 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:08:21.637 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1a0d004d90] 2024-09-19T14:08:21.637 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:08:21.637 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:08:21.637 INFO:tasks.workunit.client.0.smithi153.stderr:*** Caught signal (Aborted) ** 2024-09-19T14:08:21.637 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7f1a0a8c49c0 thread_name:radosgw-admin 2024-09-19T14:08:21.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.632+0000 7f1a0a8c49c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1a0a8c49c0 time 2024-09-19T14:08:21.637834+0000 2024-09-19T14:08:21.637 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:08:21.637 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.637 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:08:21.637 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1a0e19e2eb] 2024-09-19T14:08:21.637 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1a0e19e49f] 2024-09-19T14:08:21.637 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563af02f6271] 2024-09-19T14:08:21.638 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x563af03054ab] 2024-09-19T14:08:21.638 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563af0306a94] 2024-09-19T14:08:21.638 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:08:21.638 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1a0d004d90] 2024-09-19T14:08:21.638 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:08:21.638 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:08:21.638 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.652 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:08:21.652 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1a0d01d520] 2024-09-19T14:08:21.652 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:08:21.652 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:08:21.652 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:08:21.652 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1a0e19e345] 2024-09-19T14:08:21.652 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1a0e19e49f] 2024-09-19T14:08:21.653 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563af02f6271] 2024-09-19T14:08:21.653 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x563af03054ab] 2024-09-19T14:08:21.653 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563af0306a94] 2024-09-19T14:08:21.653 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:08:21.653 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1a0d004d90] 2024-09-19T14:08:21.653 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:08:21.653 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:08:21.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.636+0000 7f1a0a8c49c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:08:21.653 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7f1a0a8c49c0 thread_name:radosgw-admin 2024-09-19T14:08:21.653 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.653 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:08:21.653 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1a0d01d520] 2024-09-19T14:08:21.653 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:08:21.654 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:08:21.654 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:08:21.654 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1a0e19e345] 2024-09-19T14:08:21.654 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1a0e19e49f] 2024-09-19T14:08:21.654 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563af02f6271] 2024-09-19T14:08:21.654 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x563af03054ab] 2024-09-19T14:08:21.654 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563af0306a94] 2024-09-19T14:08:21.654 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:08:21.654 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1a0d004d90] 2024-09-19T14:08:21.654 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:08:21.654 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:08:21.654 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:08:21.654 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.655 INFO:tasks.workunit.client.0.smithi153.stderr:--- begin dump of recent events --- 2024-09-19T14:08:21.655 INFO:tasks.workunit.client.0.smithi153.stderr: -499> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a2f060) adding con mode: crc 2024-09-19T14:08:21.655 INFO:tasks.workunit.client.0.smithi153.stderr: -498> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a2f060) adding con mode: crc 2024-09-19T14:08:21.655 INFO:tasks.workunit.client.0.smithi153.stderr: -497> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a2f060) adding con mode: secure 2024-09-19T14:08:21.655 INFO:tasks.workunit.client.0.smithi153.stderr: -496> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a2f060) adding con mode: crc 2024-09-19T14:08:21.655 INFO:tasks.workunit.client.0.smithi153.stderr: -495> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a2f060) adding con mode: secure 2024-09-19T14:08:21.655 INFO:tasks.workunit.client.0.smithi153.stderr: -494> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a2f060) adding con mode: crc 2024-09-19T14:08:21.655 INFO:tasks.workunit.client.0.smithi153.stderr: -493> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a2f060) adding con mode: secure 2024-09-19T14:08:21.655 INFO:tasks.workunit.client.0.smithi153.stderr: -492> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:08:21.655 INFO:tasks.workunit.client.0.smithi153.stderr: -491> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:08:21.655 INFO:tasks.workunit.client.0.smithi153.stderr: -490> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command rotate-key hook 0x563af2a2f1a8 2024-09-19T14:08:21.655 INFO:tasks.workunit.client.0.smithi153.stderr: -489> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient: _reopen_session rank -1 2024-09-19T14:08:21.655 INFO:tasks.workunit.client.0.smithi153.stderr: -488> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T14:08:21.655 INFO:tasks.workunit.client.0.smithi153.stderr: -487> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient(hunting): picked mon.noname-a con 0x563af28bc410 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:08:21.656 INFO:tasks.workunit.client.0.smithi153.stderr: -486> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient(hunting): picked mon.noname-c con 0x563af28bd0f0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:08:21.656 INFO:tasks.workunit.client.0.smithi153.stderr: -485> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient(hunting): picked mon.noname-b con 0x563af2a38000 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:08:21.656 INFO:tasks.workunit.client.0.smithi153.stderr: -484> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:08:21.656 INFO:tasks.workunit.client.0.smithi153.stderr: -483> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:08:21.656 INFO:tasks.workunit.client.0.smithi153.stderr: -482> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:08:21.656 INFO:tasks.workunit.client.0.smithi153.stderr: -481> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient(hunting): _renew_subs 2024-09-19T14:08:21.656 INFO:tasks.workunit.client.0.smithi153.stderr: -480> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient(hunting): authenticate will time out at 2689.985591s 2024-09-19T14:08:21.656 INFO:tasks.workunit.client.0.smithi153.stderr: -479> 2024-09-19T14:08:21.520+0000 7f1a07bc9640 10 monclient(hunting): get_auth_request con 0x563af28bd0f0 auth_method 0 2024-09-19T14:08:21.656 INFO:tasks.workunit.client.0.smithi153.stderr: -478> 2024-09-19T14:08:21.520+0000 7f1a07bc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:08:21.656 INFO:tasks.workunit.client.0.smithi153.stderr: -477> 2024-09-19T14:08:21.520+0000 7f1a07bc9640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:08:21.656 INFO:tasks.workunit.client.0.smithi153.stderr: -476> 2024-09-19T14:08:21.520+0000 7f1a07bc9640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:08:21.656 INFO:tasks.workunit.client.0.smithi153.stderr: -475> 2024-09-19T14:08:21.520+0000 7f1a083ca640 10 monclient(hunting): get_auth_request con 0x563af28bc410 auth_method 0 2024-09-19T14:08:21.656 INFO:tasks.workunit.client.0.smithi153.stderr: -474> 2024-09-19T14:08:21.520+0000 7f1a083ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:08:21.657 INFO:tasks.workunit.client.0.smithi153.stderr: -473> 2024-09-19T14:08:21.520+0000 7f1a083ca640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:08:21.657 INFO:tasks.workunit.client.0.smithi153.stderr: -472> 2024-09-19T14:08:21.520+0000 7f1a083ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:08:21.657 INFO:tasks.workunit.client.0.smithi153.stderr: -471> 2024-09-19T14:08:21.520+0000 7f1a07bc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:08:21.657 INFO:tasks.workunit.client.0.smithi153.stderr: -470> 2024-09-19T14:08:21.520+0000 7f1a07bc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:08:21.657 INFO:tasks.workunit.client.0.smithi153.stderr: -469> 2024-09-19T14:08:21.520+0000 7f1a07bc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:08:21.657 INFO:tasks.workunit.client.0.smithi153.stderr: -468> 2024-09-19T14:08:21.520+0000 7f1a083ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:08:21.657 INFO:tasks.workunit.client.0.smithi153.stderr: -467> 2024-09-19T14:08:21.520+0000 7f1a083ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:08:21.657 INFO:tasks.workunit.client.0.smithi153.stderr: -466> 2024-09-19T14:08:21.520+0000 7f1a083ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:08:21.657 INFO:tasks.workunit.client.0.smithi153.stderr: -465> 2024-09-19T14:08:21.520+0000 7f1a07bc9640 10 monclient(hunting): handle_auth_done global_id 6611 payload 824 2024-09-19T14:08:21.657 INFO:tasks.workunit.client.0.smithi153.stderr: -464> 2024-09-19T14:08:21.520+0000 7f1a07bc9640 10 monclient: _finish_hunting 0 2024-09-19T14:08:21.657 INFO:tasks.workunit.client.0.smithi153.stderr: -463> 2024-09-19T14:08:21.520+0000 7f1a07bc9640 1 monclient: found mon.noname-c 2024-09-19T14:08:21.657 INFO:tasks.workunit.client.0.smithi153.stderr: -462> 2024-09-19T14:08:21.520+0000 7f1a07bc9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:08:21.657 INFO:tasks.workunit.client.0.smithi153.stderr: -461> 2024-09-19T14:08:21.520+0000 7f18f4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:08:21.657 INFO:tasks.workunit.client.0.smithi153.stderr: -460> 2024-09-19T14:08:21.520+0000 7f18f4e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:08:21.658 INFO:tasks.workunit.client.0.smithi153.stderr: -459> 2024-09-19T14:08:21.520+0000 7f18f4e09640 10 monclient: dump: 2024-09-19T14:08:21.658 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:08:21.658 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:08:21.658 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.658 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.658 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:08:21.658 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:08:21.658 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:08:21.658 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:08:21.658 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:08:21.658 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.658 INFO:tasks.workunit.client.0.smithi153.stderr: -458> 2024-09-19T14:08:21.520+0000 7f18f4e09640 10 monclient: _finish_auth 0 2024-09-19T14:08:21.658 INFO:tasks.workunit.client.0.smithi153.stderr: -457> 2024-09-19T14:08:21.520+0000 7f18f4e09640 10 monclient: _check_auth_tickets 2024-09-19T14:08:21.659 INFO:tasks.workunit.client.0.smithi153.stderr: -456> 2024-09-19T14:08:21.520+0000 7f18f4e09640 10 monclient: handle_config config(0 keys) 2024-09-19T14:08:21.659 INFO:tasks.workunit.client.0.smithi153.stderr: -455> 2024-09-19T14:08:21.520+0000 7f18f4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:08:21.659 INFO:tasks.workunit.client.0.smithi153.stderr: -454> 2024-09-19T14:08:21.520+0000 7f18f4e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:08:21.659 INFO:tasks.workunit.client.0.smithi153.stderr: -453> 2024-09-19T14:08:21.520+0000 7f18f4e09640 10 monclient: dump: 2024-09-19T14:08:21.659 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:08:21.659 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:08:21.659 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.659 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.659 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:08:21.659 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:08:21.659 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:08:21.659 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:08:21.659 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:08:21.660 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.660 INFO:tasks.workunit.client.0.smithi153.stderr: -452> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 5 monclient: authenticate success, global_id 6611 2024-09-19T14:08:21.660 INFO:tasks.workunit.client.0.smithi153.stderr: -451> 2024-09-19T14:08:21.520+0000 7f18f660c640 4 set_mon_vals no callback set 2024-09-19T14:08:21.660 INFO:tasks.workunit.client.0.smithi153.stderr: -450> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient: _renew_subs 2024-09-19T14:08:21.660 INFO:tasks.workunit.client.0.smithi153.stderr: -449> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:08:21.660 INFO:tasks.workunit.client.0.smithi153.stderr: -448> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient: _renew_subs 2024-09-19T14:08:21.660 INFO:tasks.workunit.client.0.smithi153.stderr: -447> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:08:21.660 INFO:tasks.workunit.client.0.smithi153.stderr: -446> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 1 librados: init done 2024-09-19T14:08:21.660 INFO:tasks.workunit.client.0.smithi153.stderr: -445> 2024-09-19T14:08:21.524+0000 7f18f4e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:08:21.660 INFO:tasks.workunit.client.0.smithi153.stderr: -444> 2024-09-19T14:08:21.524+0000 7f18f4e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:08:21.660 INFO:tasks.workunit.client.0.smithi153.stderr: -443> 2024-09-19T14:08:21.524+0000 7f18f4e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:08:21.660 INFO:tasks.workunit.client.0.smithi153.stderr: -442> 2024-09-19T14:08:21.524+0000 7f1a083ca640 10 monclient: get_auth_request con 0x7f18f0071be0 auth_method 0 2024-09-19T14:08:21.660 INFO:tasks.workunit.client.0.smithi153.stderr: -441> 2024-09-19T14:08:21.524+0000 7f1a08bcb640 10 monclient: get_auth_request con 0x563af2a776e0 auth_method 0 2024-09-19T14:08:21.661 INFO:tasks.workunit.client.0.smithi153.stderr: -440> 2024-09-19T14:08:21.524+0000 7f1a083ca640 10 monclient: get_auth_request con 0x563af2a7a8c0 auth_method 0 2024-09-19T14:08:21.661 INFO:tasks.workunit.client.0.smithi153.stderr: -439> 2024-09-19T14:08:21.528+0000 7f1a07bc9640 10 monclient: get_auth_request con 0x563af2a7f950 auth_method 0 2024-09-19T14:08:21.661 INFO:tasks.workunit.client.0.smithi153.stderr: -438> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient: build_initial_monmap 2024-09-19T14:08:21.661 INFO:tasks.workunit.client.0.smithi153.stderr: -437> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 1 build_initial for_mkfs: 0 2024-09-19T14:08:21.661 INFO:tasks.workunit.client.0.smithi153.stderr: -436> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient: monmap: 2024-09-19T14:08:21.661 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:08:21.661 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:08:21.661 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:08:21.661 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:08:21.661 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:08:21.661 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:08:21.661 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:08:21.661 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:08:21.662 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:08:21.662 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.662 INFO:tasks.workunit.client.0.smithi153.stderr: -435> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding auth protocol: cephx 2024-09-19T14:08:21.662 INFO:tasks.workunit.client.0.smithi153.stderr: -434> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding auth protocol: cephx 2024-09-19T14:08:21.662 INFO:tasks.workunit.client.0.smithi153.stderr: -433> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding auth protocol: cephx 2024-09-19T14:08:21.662 INFO:tasks.workunit.client.0.smithi153.stderr: -432> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding con mode: secure 2024-09-19T14:08:21.662 INFO:tasks.workunit.client.0.smithi153.stderr: -431> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding con mode: crc 2024-09-19T14:08:21.662 INFO:tasks.workunit.client.0.smithi153.stderr: -430> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding con mode: secure 2024-09-19T14:08:21.662 INFO:tasks.workunit.client.0.smithi153.stderr: -429> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding con mode: crc 2024-09-19T14:08:21.662 INFO:tasks.workunit.client.0.smithi153.stderr: -428> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding con mode: secure 2024-09-19T14:08:21.662 INFO:tasks.workunit.client.0.smithi153.stderr: -427> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding con mode: crc 2024-09-19T14:08:21.662 INFO:tasks.workunit.client.0.smithi153.stderr: -426> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding con mode: crc 2024-09-19T14:08:21.662 INFO:tasks.workunit.client.0.smithi153.stderr: -425> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding con mode: secure 2024-09-19T14:08:21.663 INFO:tasks.workunit.client.0.smithi153.stderr: -424> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding con mode: crc 2024-09-19T14:08:21.663 INFO:tasks.workunit.client.0.smithi153.stderr: -423> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding con mode: secure 2024-09-19T14:08:21.663 INFO:tasks.workunit.client.0.smithi153.stderr: -422> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding con mode: crc 2024-09-19T14:08:21.663 INFO:tasks.workunit.client.0.smithi153.stderr: -421> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding con mode: secure 2024-09-19T14:08:21.663 INFO:tasks.workunit.client.0.smithi153.stderr: -420> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:08:21.663 INFO:tasks.workunit.client.0.smithi153.stderr: -419> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command objecter_requests cmddesc objecter_requests hook 0x563af2a872d0 EEXIST 2024-09-19T14:08:21.663 INFO:tasks.workunit.client.0.smithi153.stderr: -418> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient: init 2024-09-19T14:08:21.663 INFO:tasks.workunit.client.0.smithi153.stderr: -417> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding auth protocol: cephx 2024-09-19T14:08:21.663 INFO:tasks.workunit.client.0.smithi153.stderr: -416> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding auth protocol: cephx 2024-09-19T14:08:21.663 INFO:tasks.workunit.client.0.smithi153.stderr: -415> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding auth protocol: cephx 2024-09-19T14:08:21.663 INFO:tasks.workunit.client.0.smithi153.stderr: -414> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding con mode: secure 2024-09-19T14:08:21.663 INFO:tasks.workunit.client.0.smithi153.stderr: -413> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding con mode: crc 2024-09-19T14:08:21.663 INFO:tasks.workunit.client.0.smithi153.stderr: -412> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding con mode: secure 2024-09-19T14:08:21.664 INFO:tasks.workunit.client.0.smithi153.stderr: -411> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding con mode: crc 2024-09-19T14:08:21.664 INFO:tasks.workunit.client.0.smithi153.stderr: -410> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding con mode: secure 2024-09-19T14:08:21.664 INFO:tasks.workunit.client.0.smithi153.stderr: -409> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding con mode: crc 2024-09-19T14:08:21.664 INFO:tasks.workunit.client.0.smithi153.stderr: -408> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding con mode: crc 2024-09-19T14:08:21.664 INFO:tasks.workunit.client.0.smithi153.stderr: -407> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding con mode: secure 2024-09-19T14:08:21.664 INFO:tasks.workunit.client.0.smithi153.stderr: -406> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding con mode: crc 2024-09-19T14:08:21.664 INFO:tasks.workunit.client.0.smithi153.stderr: -405> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding con mode: secure 2024-09-19T14:08:21.664 INFO:tasks.workunit.client.0.smithi153.stderr: -404> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding con mode: crc 2024-09-19T14:08:21.664 INFO:tasks.workunit.client.0.smithi153.stderr: -403> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding con mode: secure 2024-09-19T14:08:21.664 INFO:tasks.workunit.client.0.smithi153.stderr: -402> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:08:21.664 INFO:tasks.workunit.client.0.smithi153.stderr: -401> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:08:21.664 INFO:tasks.workunit.client.0.smithi153.stderr: -400> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command rotate-key cmddesc rotate-key hook 0x563af2a82a00 EEXIST 2024-09-19T14:08:21.664 INFO:tasks.workunit.client.0.smithi153.stderr: -399> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient: _reopen_session rank -1 2024-09-19T14:08:21.665 INFO:tasks.workunit.client.0.smithi153.stderr: -398> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T14:08:21.665 INFO:tasks.workunit.client.0.smithi153.stderr: -397> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient(hunting): picked mon.noname-a con 0x563af2aab480 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:08:21.665 INFO:tasks.workunit.client.0.smithi153.stderr: -396> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient(hunting): picked mon.noname-b con 0x563af2aaadb0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:08:21.665 INFO:tasks.workunit.client.0.smithi153.stderr: -395> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient(hunting): picked mon.noname-c con 0x563af2aa9790 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:08:21.665 INFO:tasks.workunit.client.0.smithi153.stderr: -394> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:08:21.665 INFO:tasks.workunit.client.0.smithi153.stderr: -393> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:08:21.665 INFO:tasks.workunit.client.0.smithi153.stderr: -392> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:08:21.665 INFO:tasks.workunit.client.0.smithi153.stderr: -391> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient(hunting): _renew_subs 2024-09-19T14:08:21.665 INFO:tasks.workunit.client.0.smithi153.stderr: -390> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient(hunting): authenticate will time out at 2689.995026s 2024-09-19T14:08:21.665 INFO:tasks.workunit.client.0.smithi153.stderr: -389> 2024-09-19T14:08:21.528+0000 7f1a083ca640 10 monclient(hunting): get_auth_request con 0x563af2aab480 auth_method 0 2024-09-19T14:08:21.665 INFO:tasks.workunit.client.0.smithi153.stderr: -388> 2024-09-19T14:08:21.528+0000 7f1a083ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:08:21.665 INFO:tasks.workunit.client.0.smithi153.stderr: -387> 2024-09-19T14:08:21.528+0000 7f1a083ca640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:08:21.665 INFO:tasks.workunit.client.0.smithi153.stderr: -386> 2024-09-19T14:08:21.528+0000 7f1a083ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:08:21.665 INFO:tasks.workunit.client.0.smithi153.stderr: -385> 2024-09-19T14:08:21.528+0000 7f1a08bcb640 10 monclient(hunting): get_auth_request con 0x563af2aa9790 auth_method 0 2024-09-19T14:08:21.666 INFO:tasks.workunit.client.0.smithi153.stderr: -384> 2024-09-19T14:08:21.528+0000 7f1a08bcb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:08:21.666 INFO:tasks.workunit.client.0.smithi153.stderr: -383> 2024-09-19T14:08:21.528+0000 7f1a08bcb640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:08:21.666 INFO:tasks.workunit.client.0.smithi153.stderr: -382> 2024-09-19T14:08:21.528+0000 7f1a08bcb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:08:21.666 INFO:tasks.workunit.client.0.smithi153.stderr: -381> 2024-09-19T14:08:21.528+0000 7f1a083ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:08:21.666 INFO:tasks.workunit.client.0.smithi153.stderr: -380> 2024-09-19T14:08:21.528+0000 7f1a083ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:08:21.666 INFO:tasks.workunit.client.0.smithi153.stderr: -379> 2024-09-19T14:08:21.528+0000 7f1a083ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:08:21.666 INFO:tasks.workunit.client.0.smithi153.stderr: -378> 2024-09-19T14:08:21.528+0000 7f1a08bcb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:08:21.666 INFO:tasks.workunit.client.0.smithi153.stderr: -377> 2024-09-19T14:08:21.528+0000 7f1a08bcb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:08:21.666 INFO:tasks.workunit.client.0.smithi153.stderr: -376> 2024-09-19T14:08:21.528+0000 7f1a08bcb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:08:21.666 INFO:tasks.workunit.client.0.smithi153.stderr: -375> 2024-09-19T14:08:21.528+0000 7f1a07bc9640 10 monclient(hunting): get_auth_request con 0x563af2aaadb0 auth_method 0 2024-09-19T14:08:21.666 INFO:tasks.workunit.client.0.smithi153.stderr: -374> 2024-09-19T14:08:21.528+0000 7f1a07bc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:08:21.666 INFO:tasks.workunit.client.0.smithi153.stderr: -373> 2024-09-19T14:08:21.528+0000 7f1a07bc9640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:08:21.666 INFO:tasks.workunit.client.0.smithi153.stderr: -372> 2024-09-19T14:08:21.528+0000 7f1a07bc9640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:08:21.666 INFO:tasks.workunit.client.0.smithi153.stderr: -371> 2024-09-19T14:08:21.528+0000 7f1a08bcb640 10 monclient(hunting): handle_auth_done global_id 6614 payload 824 2024-09-19T14:08:21.667 INFO:tasks.workunit.client.0.smithi153.stderr: -370> 2024-09-19T14:08:21.528+0000 7f1a08bcb640 10 monclient: _finish_hunting 0 2024-09-19T14:08:21.667 INFO:tasks.workunit.client.0.smithi153.stderr: -369> 2024-09-19T14:08:21.528+0000 7f1a08bcb640 1 monclient: found mon.noname-c 2024-09-19T14:08:21.667 INFO:tasks.workunit.client.0.smithi153.stderr: -368> 2024-09-19T14:08:21.528+0000 7f1a08bcb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:08:21.667 INFO:tasks.workunit.client.0.smithi153.stderr: -367> 2024-09-19T14:08:21.528+0000 7f18edffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:08:21.667 INFO:tasks.workunit.client.0.smithi153.stderr: -366> 2024-09-19T14:08:21.528+0000 7f18edffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:08:21.667 INFO:tasks.workunit.client.0.smithi153.stderr: -365> 2024-09-19T14:08:21.528+0000 7f18edffb640 10 monclient: dump: 2024-09-19T14:08:21.667 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:08:21.667 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:08:21.667 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.667 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.667 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:08:21.667 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:08:21.667 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:08:21.667 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:08:21.668 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:08:21.668 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.668 INFO:tasks.workunit.client.0.smithi153.stderr: -364> 2024-09-19T14:08:21.528+0000 7f18edffb640 10 monclient: _finish_auth 0 2024-09-19T14:08:21.668 INFO:tasks.workunit.client.0.smithi153.stderr: -363> 2024-09-19T14:08:21.528+0000 7f18edffb640 10 monclient: _check_auth_tickets 2024-09-19T14:08:21.668 INFO:tasks.workunit.client.0.smithi153.stderr: -362> 2024-09-19T14:08:21.528+0000 7f18edffb640 10 monclient: handle_config config(0 keys) 2024-09-19T14:08:21.668 INFO:tasks.workunit.client.0.smithi153.stderr: -361> 2024-09-19T14:08:21.528+0000 7f18edffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:08:21.668 INFO:tasks.workunit.client.0.smithi153.stderr: -360> 2024-09-19T14:08:21.528+0000 7f18edffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:08:21.668 INFO:tasks.workunit.client.0.smithi153.stderr: -359> 2024-09-19T14:08:21.528+0000 7f18edffb640 10 monclient: dump: 2024-09-19T14:08:21.668 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:08:21.668 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:08:21.668 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.668 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.668 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:08:21.669 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:08:21.669 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:08:21.669 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:08:21.669 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:08:21.669 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.669 INFO:tasks.workunit.client.0.smithi153.stderr: -358> 2024-09-19T14:08:21.528+0000 7f1a093cc640 4 set_mon_vals no callback set 2024-09-19T14:08:21.669 INFO:tasks.workunit.client.0.smithi153.stderr: -357> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 monclient: authenticate success, global_id 6614 2024-09-19T14:08:21.669 INFO:tasks.workunit.client.0.smithi153.stderr: -356> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient: _renew_subs 2024-09-19T14:08:21.669 INFO:tasks.workunit.client.0.smithi153.stderr: -355> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:08:21.669 INFO:tasks.workunit.client.0.smithi153.stderr: -354> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient: _renew_subs 2024-09-19T14:08:21.669 INFO:tasks.workunit.client.0.smithi153.stderr: -353> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:08:21.669 INFO:tasks.workunit.client.0.smithi153.stderr: -352> 2024-09-19T14:08:21.532+0000 7f18edffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:08:21.669 INFO:tasks.workunit.client.0.smithi153.stderr: -351> 2024-09-19T14:08:21.532+0000 7f18edffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:08:21.669 INFO:tasks.workunit.client.0.smithi153.stderr: -350> 2024-09-19T14:08:21.532+0000 7f18edffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:08:21.670 INFO:tasks.workunit.client.0.smithi153.stderr: -349> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient: get_monmap_and_config 2024-09-19T14:08:21.670 INFO:tasks.workunit.client.0.smithi153.stderr: -348> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient: build_initial_monmap 2024-09-19T14:08:21.670 INFO:tasks.workunit.client.0.smithi153.stderr: -347> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 1 build_initial for_mkfs: 0 2024-09-19T14:08:21.670 INFO:tasks.workunit.client.0.smithi153.stderr: -346> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient: monmap: 2024-09-19T14:08:21.670 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:08:21.670 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:08:21.670 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:08:21.670 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:08:21.670 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:08:21.670 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:08:21.670 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:08:21.670 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:08:21.670 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:08:21.671 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.671 INFO:tasks.workunit.client.0.smithi153.stderr: -345> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding auth protocol: cephx 2024-09-19T14:08:21.671 INFO:tasks.workunit.client.0.smithi153.stderr: -344> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding auth protocol: cephx 2024-09-19T14:08:21.671 INFO:tasks.workunit.client.0.smithi153.stderr: -343> 2024-09-19T14:08:21.532+0000 7f1a083ca640 10 monclient: get_auth_request con 0x7f18e0071b20 auth_method 0 2024-09-19T14:08:21.671 INFO:tasks.workunit.client.0.smithi153.stderr: -342> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding auth protocol: cephx 2024-09-19T14:08:21.671 INFO:tasks.workunit.client.0.smithi153.stderr: -341> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding con mode: secure 2024-09-19T14:08:21.671 INFO:tasks.workunit.client.0.smithi153.stderr: -340> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding con mode: crc 2024-09-19T14:08:21.671 INFO:tasks.workunit.client.0.smithi153.stderr: -339> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding con mode: secure 2024-09-19T14:08:21.671 INFO:tasks.workunit.client.0.smithi153.stderr: -338> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding con mode: crc 2024-09-19T14:08:21.671 INFO:tasks.workunit.client.0.smithi153.stderr: -337> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding con mode: secure 2024-09-19T14:08:21.671 INFO:tasks.workunit.client.0.smithi153.stderr: -336> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding con mode: crc 2024-09-19T14:08:21.671 INFO:tasks.workunit.client.0.smithi153.stderr: -335> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding con mode: crc 2024-09-19T14:08:21.671 INFO:tasks.workunit.client.0.smithi153.stderr: -334> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding con mode: secure 2024-09-19T14:08:21.671 INFO:tasks.workunit.client.0.smithi153.stderr: -333> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding con mode: crc 2024-09-19T14:08:21.672 INFO:tasks.workunit.client.0.smithi153.stderr: -332> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding con mode: secure 2024-09-19T14:08:21.672 INFO:tasks.workunit.client.0.smithi153.stderr: -331> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding con mode: crc 2024-09-19T14:08:21.672 INFO:tasks.workunit.client.0.smithi153.stderr: -330> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding con mode: secure 2024-09-19T14:08:21.672 INFO:tasks.workunit.client.0.smithi153.stderr: -329> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:08:21.672 INFO:tasks.workunit.client.0.smithi153.stderr: -328> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient: init 2024-09-19T14:08:21.672 INFO:tasks.workunit.client.0.smithi153.stderr: -327> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding auth protocol: cephx 2024-09-19T14:08:21.672 INFO:tasks.workunit.client.0.smithi153.stderr: -326> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding auth protocol: cephx 2024-09-19T14:08:21.672 INFO:tasks.workunit.client.0.smithi153.stderr: -325> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding auth protocol: cephx 2024-09-19T14:08:21.672 INFO:tasks.workunit.client.0.smithi153.stderr: -324> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding con mode: secure 2024-09-19T14:08:21.672 INFO:tasks.workunit.client.0.smithi153.stderr: -323> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding con mode: crc 2024-09-19T14:08:21.672 INFO:tasks.workunit.client.0.smithi153.stderr: -322> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding con mode: secure 2024-09-19T14:08:21.672 INFO:tasks.workunit.client.0.smithi153.stderr: -321> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding con mode: crc 2024-09-19T14:08:21.672 INFO:tasks.workunit.client.0.smithi153.stderr: -320> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding con mode: secure 2024-09-19T14:08:21.673 INFO:tasks.workunit.client.0.smithi153.stderr: -319> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding con mode: crc 2024-09-19T14:08:21.673 INFO:tasks.workunit.client.0.smithi153.stderr: -318> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding con mode: crc 2024-09-19T14:08:21.673 INFO:tasks.workunit.client.0.smithi153.stderr: -317> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding con mode: secure 2024-09-19T14:08:21.673 INFO:tasks.workunit.client.0.smithi153.stderr: -316> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding con mode: crc 2024-09-19T14:08:21.673 INFO:tasks.workunit.client.0.smithi153.stderr: -315> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding con mode: secure 2024-09-19T14:08:21.673 INFO:tasks.workunit.client.0.smithi153.stderr: -314> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding con mode: crc 2024-09-19T14:08:21.673 INFO:tasks.workunit.client.0.smithi153.stderr: -313> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding con mode: secure 2024-09-19T14:08:21.673 INFO:tasks.workunit.client.0.smithi153.stderr: -312> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:08:21.673 INFO:tasks.workunit.client.0.smithi153.stderr: -311> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:08:21.673 INFO:tasks.workunit.client.0.smithi153.stderr: -310> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command rotate-key cmddesc rotate-key hook 0x7ffc83c0bf68 EEXIST 2024-09-19T14:08:21.673 INFO:tasks.workunit.client.0.smithi153.stderr: -309> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient: _reopen_session rank -1 2024-09-19T14:08:21.673 INFO:tasks.workunit.client.0.smithi153.stderr: -308> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T14:08:21.673 INFO:tasks.workunit.client.0.smithi153.stderr: -307> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient(hunting): picked mon.noname-c con 0x563af2aff1f0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:08:21.674 INFO:tasks.workunit.client.0.smithi153.stderr: -306> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient(hunting): picked mon.noname-b con 0x563af2acec10 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:08:21.674 INFO:tasks.workunit.client.0.smithi153.stderr: -305> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient(hunting): picked mon.noname-a con 0x563af2afa9c0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:08:21.674 INFO:tasks.workunit.client.0.smithi153.stderr: -304> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:08:21.674 INFO:tasks.workunit.client.0.smithi153.stderr: -303> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:08:21.674 INFO:tasks.workunit.client.0.smithi153.stderr: -302> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:08:21.674 INFO:tasks.workunit.client.0.smithi153.stderr: -301> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient(hunting): _renew_subs 2024-09-19T14:08:21.674 INFO:tasks.workunit.client.0.smithi153.stderr: -300> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient(hunting): authenticate will time out at 2689.999506s 2024-09-19T14:08:21.674 INFO:tasks.workunit.client.0.smithi153.stderr: -299> 2024-09-19T14:08:21.532+0000 7f1a083ca640 10 monclient(hunting): get_auth_request con 0x563af2aff1f0 auth_method 0 2024-09-19T14:08:21.674 INFO:tasks.workunit.client.0.smithi153.stderr: -298> 2024-09-19T14:08:21.532+0000 7f1a083ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:08:21.674 INFO:tasks.workunit.client.0.smithi153.stderr: -297> 2024-09-19T14:08:21.532+0000 7f1a083ca640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:08:21.674 INFO:tasks.workunit.client.0.smithi153.stderr: -296> 2024-09-19T14:08:21.532+0000 7f1a083ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:08:21.674 INFO:tasks.workunit.client.0.smithi153.stderr: -295> 2024-09-19T14:08:21.532+0000 7f1a08bcb640 10 monclient(hunting): get_auth_request con 0x563af2afa9c0 auth_method 0 2024-09-19T14:08:21.674 INFO:tasks.workunit.client.0.smithi153.stderr: -294> 2024-09-19T14:08:21.532+0000 7f1a08bcb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:08:21.675 INFO:tasks.workunit.client.0.smithi153.stderr: -293> 2024-09-19T14:08:21.532+0000 7f1a08bcb640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:08:21.675 INFO:tasks.workunit.client.0.smithi153.stderr: -292> 2024-09-19T14:08:21.532+0000 7f1a08bcb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:08:21.675 INFO:tasks.workunit.client.0.smithi153.stderr: -291> 2024-09-19T14:08:21.532+0000 7f1a08bcb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:08:21.675 INFO:tasks.workunit.client.0.smithi153.stderr: -290> 2024-09-19T14:08:21.532+0000 7f1a08bcb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:08:21.675 INFO:tasks.workunit.client.0.smithi153.stderr: -289> 2024-09-19T14:08:21.532+0000 7f1a08bcb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:08:21.675 INFO:tasks.workunit.client.0.smithi153.stderr: -288> 2024-09-19T14:08:21.532+0000 7f1a083ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:08:21.675 INFO:tasks.workunit.client.0.smithi153.stderr: -287> 2024-09-19T14:08:21.532+0000 7f1a083ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:08:21.675 INFO:tasks.workunit.client.0.smithi153.stderr: -286> 2024-09-19T14:08:21.532+0000 7f1a083ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:08:21.675 INFO:tasks.workunit.client.0.smithi153.stderr: -285> 2024-09-19T14:08:21.532+0000 7f1a07bc9640 10 monclient(hunting): get_auth_request con 0x563af2acec10 auth_method 0 2024-09-19T14:08:21.675 INFO:tasks.workunit.client.0.smithi153.stderr: -284> 2024-09-19T14:08:21.532+0000 7f1a07bc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:08:21.675 INFO:tasks.workunit.client.0.smithi153.stderr: -283> 2024-09-19T14:08:21.532+0000 7f1a07bc9640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:08:21.675 INFO:tasks.workunit.client.0.smithi153.stderr: -282> 2024-09-19T14:08:21.532+0000 7f1a07bc9640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:08:21.675 INFO:tasks.workunit.client.0.smithi153.stderr: -281> 2024-09-19T14:08:21.532+0000 7f1a08bcb640 10 monclient(hunting): handle_auth_done global_id 7044 payload 274 2024-09-19T14:08:21.675 INFO:tasks.workunit.client.0.smithi153.stderr: -280> 2024-09-19T14:08:21.532+0000 7f1a08bcb640 10 monclient: _finish_hunting 0 2024-09-19T14:08:21.676 INFO:tasks.workunit.client.0.smithi153.stderr: -279> 2024-09-19T14:08:21.532+0000 7f1a08bcb640 1 monclient: found mon.noname-a 2024-09-19T14:08:21.676 INFO:tasks.workunit.client.0.smithi153.stderr: -278> 2024-09-19T14:08:21.532+0000 7f1a08bcb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:08:21.676 INFO:tasks.workunit.client.0.smithi153.stderr: -277> 2024-09-19T14:08:21.536+0000 7f18df7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:08:21.676 INFO:tasks.workunit.client.0.smithi153.stderr: -276> 2024-09-19T14:08:21.536+0000 7f18df7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:08:21.676 INFO:tasks.workunit.client.0.smithi153.stderr: -275> 2024-09-19T14:08:21.536+0000 7f18df7fe640 10 monclient: dump: 2024-09-19T14:08:21.676 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:08:21.676 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:08:21.676 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.676 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.676 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:08:21.676 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:08:21.676 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:08:21.676 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:08:21.676 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:08:21.677 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.677 INFO:tasks.workunit.client.0.smithi153.stderr: -274> 2024-09-19T14:08:21.536+0000 7f18df7fe640 10 monclient: _finish_auth 0 2024-09-19T14:08:21.677 INFO:tasks.workunit.client.0.smithi153.stderr: -273> 2024-09-19T14:08:21.536+0000 7f18df7fe640 10 monclient: _check_auth_tickets 2024-09-19T14:08:21.677 INFO:tasks.workunit.client.0.smithi153.stderr: -272> 2024-09-19T14:08:21.536+0000 7f18df7fe640 10 monclient: handle_config config(0 keys) 2024-09-19T14:08:21.677 INFO:tasks.workunit.client.0.smithi153.stderr: -271> 2024-09-19T14:08:21.536+0000 7f18df7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:08:21.677 INFO:tasks.workunit.client.0.smithi153.stderr: -270> 2024-09-19T14:08:21.536+0000 7f18df7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:08:21.677 INFO:tasks.workunit.client.0.smithi153.stderr: -269> 2024-09-19T14:08:21.536+0000 7f18df7fe640 10 monclient: dump: 2024-09-19T14:08:21.677 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:08:21.677 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:08:21.677 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.677 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.677 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:08:21.677 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:08:21.678 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:08:21.678 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:08:21.678 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:08:21.678 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.678 INFO:tasks.workunit.client.0.smithi153.stderr: -268> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 monclient: authenticate success, global_id 7044 2024-09-19T14:08:21.678 INFO:tasks.workunit.client.0.smithi153.stderr: -267> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient: get_monmap_and_config success 2024-09-19T14:08:21.678 INFO:tasks.workunit.client.0.smithi153.stderr: -266> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 4 set_mon_vals no callback set 2024-09-19T14:08:21.678 INFO:tasks.workunit.client.0.smithi153.stderr: -265> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient: shutdown 2024-09-19T14:08:21.678 INFO:tasks.workunit.client.0.smithi153.stderr: -264> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient: build_initial_monmap 2024-09-19T14:08:21.678 INFO:tasks.workunit.client.0.smithi153.stderr: -263> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 1 build_initial for_mkfs: 0 2024-09-19T14:08:21.678 INFO:tasks.workunit.client.0.smithi153.stderr: -262> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient: monmap: 2024-09-19T14:08:21.678 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:08:21.678 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:08:21.678 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:08:21.679 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:08:21.679 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:08:21.679 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:08:21.679 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:08:21.679 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:08:21.679 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:08:21.679 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.679 INFO:tasks.workunit.client.0.smithi153.stderr: -261> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding auth protocol: cephx 2024-09-19T14:08:21.679 INFO:tasks.workunit.client.0.smithi153.stderr: -260> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding auth protocol: cephx 2024-09-19T14:08:21.679 INFO:tasks.workunit.client.0.smithi153.stderr: -259> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding auth protocol: cephx 2024-09-19T14:08:21.679 INFO:tasks.workunit.client.0.smithi153.stderr: -258> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding con mode: secure 2024-09-19T14:08:21.679 INFO:tasks.workunit.client.0.smithi153.stderr: -257> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding con mode: crc 2024-09-19T14:08:21.679 INFO:tasks.workunit.client.0.smithi153.stderr: -256> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding con mode: secure 2024-09-19T14:08:21.679 INFO:tasks.workunit.client.0.smithi153.stderr: -255> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding con mode: crc 2024-09-19T14:08:21.680 INFO:tasks.workunit.client.0.smithi153.stderr: -254> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding con mode: secure 2024-09-19T14:08:21.680 INFO:tasks.workunit.client.0.smithi153.stderr: -253> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding con mode: crc 2024-09-19T14:08:21.680 INFO:tasks.workunit.client.0.smithi153.stderr: -252> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding con mode: crc 2024-09-19T14:08:21.680 INFO:tasks.workunit.client.0.smithi153.stderr: -251> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding con mode: secure 2024-09-19T14:08:21.680 INFO:tasks.workunit.client.0.smithi153.stderr: -250> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding con mode: crc 2024-09-19T14:08:21.680 INFO:tasks.workunit.client.0.smithi153.stderr: -249> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding con mode: secure 2024-09-19T14:08:21.680 INFO:tasks.workunit.client.0.smithi153.stderr: -248> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding con mode: crc 2024-09-19T14:08:21.680 INFO:tasks.workunit.client.0.smithi153.stderr: -247> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding con mode: secure 2024-09-19T14:08:21.680 INFO:tasks.workunit.client.0.smithi153.stderr: -246> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:08:21.680 INFO:tasks.workunit.client.0.smithi153.stderr: -245> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 1 librados: starting msgr at 2024-09-19T14:08:21.680 INFO:tasks.workunit.client.0.smithi153.stderr: -244> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 1 librados: starting objecter 2024-09-19T14:08:21.680 INFO:tasks.workunit.client.0.smithi153.stderr: -243> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command objecter_requests cmddesc objecter_requests hook 0x563af2ad03b0 EEXIST 2024-09-19T14:08:21.680 INFO:tasks.workunit.client.0.smithi153.stderr: -242> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 1 librados: setting wanted keys 2024-09-19T14:08:21.680 INFO:tasks.workunit.client.0.smithi153.stderr: -241> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 1 librados: calling monclient init 2024-09-19T14:08:21.681 INFO:tasks.workunit.client.0.smithi153.stderr: -240> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient: init 2024-09-19T14:08:21.681 INFO:tasks.workunit.client.0.smithi153.stderr: -239> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding auth protocol: cephx 2024-09-19T14:08:21.681 INFO:tasks.workunit.client.0.smithi153.stderr: -238> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding auth protocol: cephx 2024-09-19T14:08:21.681 INFO:tasks.workunit.client.0.smithi153.stderr: -237> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding auth protocol: cephx 2024-09-19T14:08:21.681 INFO:tasks.workunit.client.0.smithi153.stderr: -236> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding con mode: secure 2024-09-19T14:08:21.681 INFO:tasks.workunit.client.0.smithi153.stderr: -235> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding con mode: crc 2024-09-19T14:08:21.681 INFO:tasks.workunit.client.0.smithi153.stderr: -234> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding con mode: secure 2024-09-19T14:08:21.681 INFO:tasks.workunit.client.0.smithi153.stderr: -233> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding con mode: crc 2024-09-19T14:08:21.681 INFO:tasks.workunit.client.0.smithi153.stderr: -232> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding con mode: secure 2024-09-19T14:08:21.681 INFO:tasks.workunit.client.0.smithi153.stderr: -231> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding con mode: crc 2024-09-19T14:08:21.681 INFO:tasks.workunit.client.0.smithi153.stderr: -230> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding con mode: crc 2024-09-19T14:08:21.681 INFO:tasks.workunit.client.0.smithi153.stderr: -229> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding con mode: secure 2024-09-19T14:08:21.681 INFO:tasks.workunit.client.0.smithi153.stderr: -228> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding con mode: crc 2024-09-19T14:08:21.681 INFO:tasks.workunit.client.0.smithi153.stderr: -227> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding con mode: secure 2024-09-19T14:08:21.682 INFO:tasks.workunit.client.0.smithi153.stderr: -226> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding con mode: crc 2024-09-19T14:08:21.682 INFO:tasks.workunit.client.0.smithi153.stderr: -225> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding con mode: secure 2024-09-19T14:08:21.682 INFO:tasks.workunit.client.0.smithi153.stderr: -224> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:08:21.682 INFO:tasks.workunit.client.0.smithi153.stderr: -223> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:08:21.682 INFO:tasks.workunit.client.0.smithi153.stderr: -222> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command rotate-key cmddesc rotate-key hook 0x563af2aad3e8 EEXIST 2024-09-19T14:08:21.682 INFO:tasks.workunit.client.0.smithi153.stderr: -221> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient: _reopen_session rank -1 2024-09-19T14:08:21.682 INFO:tasks.workunit.client.0.smithi153.stderr: -220> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T14:08:21.682 INFO:tasks.workunit.client.0.smithi153.stderr: -219> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient(hunting): picked mon.noname-c con 0x563af2acec10 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:08:21.682 INFO:tasks.workunit.client.0.smithi153.stderr: -218> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient(hunting): picked mon.noname-b con 0x563af2afa9c0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:08:21.682 INFO:tasks.workunit.client.0.smithi153.stderr: -217> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient(hunting): picked mon.noname-a con 0x563af2aff1f0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:08:21.682 INFO:tasks.workunit.client.0.smithi153.stderr: -216> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:08:21.682 INFO:tasks.workunit.client.0.smithi153.stderr: -215> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:08:21.682 INFO:tasks.workunit.client.0.smithi153.stderr: -214> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:08:21.683 INFO:tasks.workunit.client.0.smithi153.stderr: -213> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient(hunting): _renew_subs 2024-09-19T14:08:21.683 INFO:tasks.workunit.client.0.smithi153.stderr: -212> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient(hunting): authenticate will time out at 2690.002117s 2024-09-19T14:08:21.683 INFO:tasks.workunit.client.0.smithi153.stderr: -211> 2024-09-19T14:08:21.536+0000 7f1a083ca640 10 monclient(hunting): get_auth_request con 0x563af2acec10 auth_method 0 2024-09-19T14:08:21.683 INFO:tasks.workunit.client.0.smithi153.stderr: -210> 2024-09-19T14:08:21.536+0000 7f1a083ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:08:21.683 INFO:tasks.workunit.client.0.smithi153.stderr: -209> 2024-09-19T14:08:21.536+0000 7f1a083ca640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:08:21.683 INFO:tasks.workunit.client.0.smithi153.stderr: -208> 2024-09-19T14:08:21.536+0000 7f1a083ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:08:21.683 INFO:tasks.workunit.client.0.smithi153.stderr: -207> 2024-09-19T14:08:21.536+0000 7f1a083ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:08:21.683 INFO:tasks.workunit.client.0.smithi153.stderr: -206> 2024-09-19T14:08:21.536+0000 7f1a083ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:08:21.683 INFO:tasks.workunit.client.0.smithi153.stderr: -205> 2024-09-19T14:08:21.536+0000 7f1a083ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:08:21.683 INFO:tasks.workunit.client.0.smithi153.stderr: -204> 2024-09-19T14:08:21.536+0000 7f1a08bcb640 10 monclient(hunting): get_auth_request con 0x563af2aff1f0 auth_method 0 2024-09-19T14:08:21.683 INFO:tasks.workunit.client.0.smithi153.stderr: -203> 2024-09-19T14:08:21.536+0000 7f1a08bcb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:08:21.683 INFO:tasks.workunit.client.0.smithi153.stderr: -202> 2024-09-19T14:08:21.536+0000 7f1a08bcb640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:08:21.683 INFO:tasks.workunit.client.0.smithi153.stderr: -201> 2024-09-19T14:08:21.536+0000 7f1a08bcb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:08:21.684 INFO:tasks.workunit.client.0.smithi153.stderr: -200> 2024-09-19T14:08:21.536+0000 7f1a08bcb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:08:21.684 INFO:tasks.workunit.client.0.smithi153.stderr: -199> 2024-09-19T14:08:21.536+0000 7f1a08bcb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:08:21.684 INFO:tasks.workunit.client.0.smithi153.stderr: -198> 2024-09-19T14:08:21.536+0000 7f1a08bcb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:08:21.684 INFO:tasks.workunit.client.0.smithi153.stderr: -197> 2024-09-19T14:08:21.536+0000 7f1a083ca640 10 monclient(hunting): handle_auth_done global_id 6620 payload 824 2024-09-19T14:08:21.684 INFO:tasks.workunit.client.0.smithi153.stderr: -196> 2024-09-19T14:08:21.536+0000 7f1a083ca640 10 monclient: _finish_hunting 0 2024-09-19T14:08:21.684 INFO:tasks.workunit.client.0.smithi153.stderr: -195> 2024-09-19T14:08:21.536+0000 7f1a083ca640 1 monclient: found mon.noname-c 2024-09-19T14:08:21.684 INFO:tasks.workunit.client.0.smithi153.stderr: -194> 2024-09-19T14:08:21.536+0000 7f1a083ca640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:08:21.684 INFO:tasks.workunit.client.0.smithi153.stderr: -193> 2024-09-19T14:08:21.536+0000 7f1a07bc9640 10 monclient: get_auth_request con 0x563af2afa9c0 auth_method 0 2024-09-19T14:08:21.684 INFO:tasks.workunit.client.0.smithi153.stderr: -192> 2024-09-19T14:08:21.536+0000 7f18ddffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:08:21.684 INFO:tasks.workunit.client.0.smithi153.stderr: -191> 2024-09-19T14:08:21.536+0000 7f18ddffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:08:21.684 INFO:tasks.workunit.client.0.smithi153.stderr: -190> 2024-09-19T14:08:21.536+0000 7f18ddffb640 10 monclient: dump: 2024-09-19T14:08:21.684 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:08:21.684 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:08:21.684 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.685 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.685 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:08:21.685 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:08:21.685 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:08:21.685 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:08:21.685 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:08:21.685 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.685 INFO:tasks.workunit.client.0.smithi153.stderr: -189> 2024-09-19T14:08:21.536+0000 7f18ddffb640 10 monclient: _finish_auth 0 2024-09-19T14:08:21.685 INFO:tasks.workunit.client.0.smithi153.stderr: -188> 2024-09-19T14:08:21.536+0000 7f18ddffb640 10 monclient: _check_auth_tickets 2024-09-19T14:08:21.685 INFO:tasks.workunit.client.0.smithi153.stderr: -187> 2024-09-19T14:08:21.536+0000 7f18ddffb640 10 monclient: handle_config config(0 keys) 2024-09-19T14:08:21.685 INFO:tasks.workunit.client.0.smithi153.stderr: -186> 2024-09-19T14:08:21.536+0000 7f18ddffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:08:21.685 INFO:tasks.workunit.client.0.smithi153.stderr: -185> 2024-09-19T14:08:21.536+0000 7f18ddffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:08:21.685 INFO:tasks.workunit.client.0.smithi153.stderr: -184> 2024-09-19T14:08:21.536+0000 7f18ddffb640 10 monclient: dump: 2024-09-19T14:08:21.685 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:08:21.685 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:08:21.686 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.686 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.686 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:08:21.686 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:08:21.686 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:08:21.686 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:08:21.686 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:08:21.686 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.686 INFO:tasks.workunit.client.0.smithi153.stderr: -183> 2024-09-19T14:08:21.536+0000 7f18df7fe640 4 set_mon_vals no callback set 2024-09-19T14:08:21.686 INFO:tasks.workunit.client.0.smithi153.stderr: -182> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 monclient: authenticate success, global_id 6620 2024-09-19T14:08:21.686 INFO:tasks.workunit.client.0.smithi153.stderr: -181> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient: _renew_subs 2024-09-19T14:08:21.686 INFO:tasks.workunit.client.0.smithi153.stderr: -180> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:08:21.686 INFO:tasks.workunit.client.0.smithi153.stderr: -179> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient: _renew_subs 2024-09-19T14:08:21.686 INFO:tasks.workunit.client.0.smithi153.stderr: -178> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:08:21.686 INFO:tasks.workunit.client.0.smithi153.stderr: -177> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 1 librados: init done 2024-09-19T14:08:21.687 INFO:tasks.workunit.client.0.smithi153.stderr: -176> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command cr dump hook 0x7f1a00001578 2024-09-19T14:08:21.687 INFO:tasks.workunit.client.0.smithi153.stderr: -175> 2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.687 INFO:tasks.workunit.client.0.smithi153.stderr: -174> 2024-09-19T14:08:21.540+0000 7f18ddffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:08:21.687 INFO:tasks.workunit.client.0.smithi153.stderr: -173> 2024-09-19T14:08:21.540+0000 7f18ddffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:08:21.687 INFO:tasks.workunit.client.0.smithi153.stderr: -172> 2024-09-19T14:08:21.540+0000 7f18ddffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:08:21.687 INFO:tasks.workunit.client.0.smithi153.stderr: -171> 2024-09-19T14:08:21.540+0000 7f1a07bc9640 10 monclient: get_auth_request con 0x7f18d0071c10 auth_method 0 2024-09-19T14:08:21.687 INFO:tasks.workunit.client.0.smithi153.stderr: -170> 2024-09-19T14:08:21.540+0000 7f1a08bcb640 10 monclient: get_auth_request con 0x563af2b18c70 auth_method 0 2024-09-19T14:08:21.687 INFO:tasks.workunit.client.0.smithi153.stderr: -169> 2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.687 INFO:tasks.workunit.client.0.smithi153.stderr: -168> 2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 20 realm 2024-09-19T14:08:21.687 INFO:tasks.workunit.client.0.smithi153.stderr: -167> 2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.687 INFO:tasks.workunit.client.0.smithi153.stderr: -166> 2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.687 INFO:tasks.workunit.client.0.smithi153.stderr: -165> 2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:08:21.687 INFO:tasks.workunit.client.0.smithi153.stderr: -164> 2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.687 INFO:tasks.workunit.client.0.smithi153.stderr: -163> 2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.688 INFO:tasks.workunit.client.0.smithi153.stderr: -162> 2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.688 INFO:tasks.workunit.client.0.smithi153.stderr: -161> 2024-09-19T14:08:21.540+0000 7f1a083ca640 10 monclient: get_auth_request con 0x563af2b1ce90 auth_method 0 2024-09-19T14:08:21.688 INFO:tasks.workunit.client.0.smithi153.stderr: -160> 2024-09-19T14:08:21.544+0000 7f1a0a8c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:21.688 INFO:tasks.workunit.client.0.smithi153.stderr: -159> 2024-09-19T14:08:21.544+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.688 INFO:tasks.workunit.client.0.smithi153.stderr: -158> 2024-09-19T14:08:21.544+0000 7f1a0a8c49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:08:21.688 INFO:tasks.workunit.client.0.smithi153.stderr: -157> 2024-09-19T14:08:21.544+0000 7f1a0a8c49c0 20 searching for the correct realm 2024-09-19T14:08:21.688 INFO:tasks.workunit.client.0.smithi153.stderr: -156> 2024-09-19T14:08:21.544+0000 7f1a07bc9640 10 monclient: get_auth_request con 0x563af2b21d50 auth_method 0 2024-09-19T14:08:21.688 INFO:tasks.workunit.client.0.smithi153.stderr: -155> 2024-09-19T14:08:21.544+0000 7f1a08bcb640 10 monclient: get_auth_request con 0x7f19fc018020 auth_method 0 2024-09-19T14:08:21.688 INFO:tasks.workunit.client.0.smithi153.stderr: -154> 2024-09-19T14:08:21.548+0000 7f1a083ca640 10 monclient: get_auth_request con 0x7f1a00078be0 auth_method 0 2024-09-19T14:08:21.688 INFO:tasks.workunit.client.0.smithi153.stderr: -153> 2024-09-19T14:08:21.548+0000 7f1a07bc9640 10 monclient: get_auth_request con 0x7f19f80e8060 auth_method 0 2024-09-19T14:08:21.688 INFO:tasks.workunit.client.0.smithi153.stderr: -152> 2024-09-19T14:08:21.548+0000 7f1a08bcb640 0 -- 172.21.15.153:0/824375401 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x563af2b18c70 msgr2=0x563af2b1b0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:08:21.688 INFO:tasks.workunit.client.0.smithi153.stderr: -151> 2024-09-19T14:08:21.548+0000 7f18ddffb640 1 client.6620.objecter ms_handle_reset 0x563af2b18c70 session 0x563af2ace1e0 osd.1 2024-09-19T14:08:21.688 INFO:tasks.workunit.client.0.smithi153.stderr: -150> 2024-09-19T14:08:21.548+0000 7f18ddffb640 10 monclient: _renew_subs 2024-09-19T14:08:21.688 INFO:tasks.workunit.client.0.smithi153.stderr: -149> 2024-09-19T14:08:21.548+0000 7f18ddffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:08:21.689 INFO:tasks.workunit.client.0.smithi153.stderr: -148> 2024-09-19T14:08:21.548+0000 7f1a08bcb640 10 monclient: get_auth_request con 0x7f18d0082340 auth_method 0 2024-09-19T14:08:21.689 INFO:tasks.workunit.client.0.smithi153.stderr: -147> 2024-09-19T14:08:21.552+0000 7f1a08bcb640 10 monclient: get_auth_request con 0x7f19fc04b130 auth_method 0 2024-09-19T14:08:21.689 INFO:tasks.workunit.client.0.smithi153.stderr: -146> 2024-09-19T14:08:21.556+0000 7f1a083ca640 10 monclient: get_auth_request con 0x7f19fc067940 auth_method 0 2024-09-19T14:08:21.689 INFO:tasks.workunit.client.0.smithi153.stderr: -145> 2024-09-19T14:08:21.556+0000 7f1a083ca640 0 -- 172.21.15.153:0/824375401 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f19fc067940 msgr2=0x7f19fc062110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:21.689 INFO:tasks.workunit.client.0.smithi153.stderr: -144> 2024-09-19T14:08:21.556+0000 7f18ddffb640 1 client.6620.objecter ms_handle_reset 0x7f19fc067940 session 0x7f19fc091930 osd.0 2024-09-19T14:08:21.689 INFO:tasks.workunit.client.0.smithi153.stderr: -143> 2024-09-19T14:08:21.556+0000 7f1a083ca640 10 monclient: get_auth_request con 0x563af2b18c70 auth_method 0 2024-09-19T14:08:21.689 INFO:tasks.workunit.client.0.smithi153.stderr: -142> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:08:21.689 INFO:tasks.workunit.client.0.smithi153.stderr: -141> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:08:21.689 INFO:tasks.workunit.client.0.smithi153.stderr: -140> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:08:21.689 INFO:tasks.workunit.client.0.smithi153.stderr: -139> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:08:21.689 INFO:tasks.workunit.client.0.smithi153.stderr: -138> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:08:21.689 INFO:tasks.workunit.client.0.smithi153.stderr: -137> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:08:21.689 INFO:tasks.workunit.client.0.smithi153.stderr: -136> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.690 INFO:tasks.workunit.client.0.smithi153.stderr: -135> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.690 INFO:tasks.workunit.client.0.smithi153.stderr: -134> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.690 INFO:tasks.workunit.client.0.smithi153.stderr: -133> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:21.690 INFO:tasks.workunit.client.0.smithi153.stderr: -132> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.690 INFO:tasks.workunit.client.0.smithi153.stderr: -131> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:08:21.690 INFO:tasks.workunit.client.0.smithi153.stderr: -130> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 zone default found 2024-09-19T14:08:21.690 INFO:tasks.workunit.client.0.smithi153.stderr: -129> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 4 Realm: () 2024-09-19T14:08:21.690 INFO:tasks.workunit.client.0.smithi153.stderr: -128> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:08:21.690 INFO:tasks.workunit.client.0.smithi153.stderr: -127> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:08:21.690 INFO:tasks.workunit.client.0.smithi153.stderr: -126> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:08:21.690 INFO:tasks.workunit.client.0.smithi153.stderr: -125> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 zonegroup default 2024-09-19T14:08:21.690 INFO:tasks.workunit.client.0.smithi153.stderr: -124> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.690 INFO:tasks.workunit.client.0.smithi153.stderr: -123> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.690 INFO:tasks.workunit.client.0.smithi153.stderr: -122> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.691 INFO:tasks.workunit.client.0.smithi153.stderr: -121> 2024-09-19T14:08:21.568+0000 7f1a0a8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.691 INFO:tasks.workunit.client.0.smithi153.stderr: -120> 2024-09-19T14:08:21.568+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.691 INFO:tasks.workunit.client.0.smithi153.stderr: -119> 2024-09-19T14:08:21.568+0000 7f1a0a8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.691 INFO:tasks.workunit.client.0.smithi153.stderr: -118> 2024-09-19T14:08:21.568+0000 7f1a0a8c49c0 20 started sync module instance, tier type = 2024-09-19T14:08:21.691 INFO:tasks.workunit.client.0.smithi153.stderr: -117> 2024-09-19T14:08:21.568+0000 7f1a0a8c49c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:08:21.691 INFO:tasks.workunit.client.0.smithi153.stderr: -116> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 20 add_watcher() i=0 2024-09-19T14:08:21.691 INFO:tasks.workunit.client.0.smithi153.stderr: -115> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 20 add_watcher() i=1 2024-09-19T14:08:21.691 INFO:tasks.workunit.client.0.smithi153.stderr: -114> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 20 add_watcher() i=2 2024-09-19T14:08:21.691 INFO:tasks.workunit.client.0.smithi153.stderr: -113> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 20 add_watcher() i=3 2024-09-19T14:08:21.691 INFO:tasks.workunit.client.0.smithi153.stderr: -112> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 20 add_watcher() i=4 2024-09-19T14:08:21.691 INFO:tasks.workunit.client.0.smithi153.stderr: -111> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 20 add_watcher() i=5 2024-09-19T14:08:21.691 INFO:tasks.workunit.client.0.smithi153.stderr: -110> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 20 add_watcher() i=6 2024-09-19T14:08:21.691 INFO:tasks.workunit.client.0.smithi153.stderr: -109> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 20 add_watcher() i=7 2024-09-19T14:08:21.691 INFO:tasks.workunit.client.0.smithi153.stderr: -108> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:08:21.692 INFO:tasks.workunit.client.0.smithi153.stderr: -107> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding auth protocol: cephx 2024-09-19T14:08:21.692 INFO:tasks.workunit.client.0.smithi153.stderr: -106> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding auth protocol: cephx 2024-09-19T14:08:21.692 INFO:tasks.workunit.client.0.smithi153.stderr: -105> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding auth protocol: cephx 2024-09-19T14:08:21.692 INFO:tasks.workunit.client.0.smithi153.stderr: -104> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding con mode: secure 2024-09-19T14:08:21.692 INFO:tasks.workunit.client.0.smithi153.stderr: -103> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding con mode: crc 2024-09-19T14:08:21.692 INFO:tasks.workunit.client.0.smithi153.stderr: -102> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding con mode: secure 2024-09-19T14:08:21.692 INFO:tasks.workunit.client.0.smithi153.stderr: -101> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding con mode: crc 2024-09-19T14:08:21.692 INFO:tasks.workunit.client.0.smithi153.stderr: -100> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding con mode: secure 2024-09-19T14:08:21.692 INFO:tasks.workunit.client.0.smithi153.stderr: -99> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding con mode: crc 2024-09-19T14:08:21.692 INFO:tasks.workunit.client.0.smithi153.stderr: -98> 2024-09-19T14:08:21.584+0000 7f18bf7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:21.692 INFO:tasks.workunit.client.0.smithi153.stderr: -97> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding con mode: crc 2024-09-19T14:08:21.692 INFO:tasks.workunit.client.0.smithi153.stderr: -96> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding con mode: secure 2024-09-19T14:08:21.692 INFO:tasks.workunit.client.0.smithi153.stderr: -95> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding con mode: crc 2024-09-19T14:08:21.693 INFO:tasks.workunit.client.0.smithi153.stderr: -94> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding con mode: secure 2024-09-19T14:08:21.693 INFO:tasks.workunit.client.0.smithi153.stderr: -93> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding con mode: crc 2024-09-19T14:08:21.693 INFO:tasks.workunit.client.0.smithi153.stderr: -92> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding con mode: secure 2024-09-19T14:08:21.693 INFO:tasks.workunit.client.0.smithi153.stderr: -91> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:08:21.693 INFO:tasks.workunit.client.0.smithi153.stderr: -90> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:08:21.693 INFO:tasks.workunit.client.0.smithi153.stderr: -89> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:08:21.693 INFO:tasks.workunit.client.0.smithi153.stderr: -88> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command cache list hook 0x563af2af7fa0 2024-09-19T14:08:21.693 INFO:tasks.workunit.client.0.smithi153.stderr: -87> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command cache inspect hook 0x563af2af7fa0 2024-09-19T14:08:21.693 INFO:tasks.workunit.client.0.smithi153.stderr: -86> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command cache erase hook 0x563af2af7fa0 2024-09-19T14:08:21.693 INFO:tasks.workunit.client.0.smithi153.stderr: -85> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command cache zap hook 0x563af2af7fa0 2024-09-19T14:08:21.693 INFO:tasks.workunit.client.0.smithi153.stderr: -84> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 5 note: GC not initialized 2024-09-19T14:08:21.693 INFO:tasks.workunit.client.0.smithi153.stderr: -83> 2024-09-19T14:08:21.588+0000 7f18be7dc640 20 reqs_thread_entry: start 2024-09-19T14:08:21.693 INFO:tasks.workunit.client.0.smithi153.stderr: -82> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command sync trace show hook 0x7f19f80aa4b0 2024-09-19T14:08:21.693 INFO:tasks.workunit.client.0.smithi153.stderr: -81> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command sync trace history hook 0x7f19f80aa4b0 2024-09-19T14:08:21.694 INFO:tasks.workunit.client.0.smithi153.stderr: -80> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command sync trace active hook 0x7f19f80aa4b0 2024-09-19T14:08:21.694 INFO:tasks.workunit.client.0.smithi153.stderr: -79> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command sync trace active_short hook 0x7f19f80aa4b0 2024-09-19T14:08:21.694 INFO:tasks.workunit.client.0.smithi153.stderr: -78> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 20 init_complete bucket index max shards: 11 2024-09-19T14:08:21.694 INFO:tasks.workunit.client.0.smithi153.stderr: -77> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 20 Filter name: none 2024-09-19T14:08:21.694 INFO:tasks.workunit.client.0.smithi153.stderr: -76> 2024-09-19T14:08:21.588+0000 7f18b77fe640 20 reqs_thread_entry: start 2024-09-19T14:08:21.694 INFO:tasks.workunit.client.0.smithi153.stderr: -75> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-19T14:08:21.694 INFO:tasks.workunit.client.0.smithi153.stderr: -74> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.694 INFO:tasks.workunit.client.0.smithi153.stderr: -73> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-19T14:08:21.694 INFO:tasks.workunit.client.0.smithi153.stderr: -72> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-19T14:08:21.694 INFO:tasks.workunit.client.0.smithi153.stderr: -71> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-19T14:08:21.694 INFO:tasks.workunit.client.0.smithi153.stderr: -70> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 : miss 2024-09-19T14:08:21.694 INFO:tasks.workunit.client.0.smithi153.stderr: -69> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.694 INFO:tasks.workunit.client.0.smithi153.stderr: -68> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-19T14:08:21.695 INFO:tasks.workunit.client.0.smithi153.stderr: -67> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 info.flags=0x17 2024-09-19T14:08:21.695 INFO:tasks.workunit.client.0.smithi153.stderr: -66> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 to cache LRU end 2024-09-19T14:08:21.695 INFO:tasks.workunit.client.0.smithi153.stderr: -65> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:08:21.695 INFO:tasks.workunit.client.0.smithi153.stderr: -64> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:21.695 INFO:tasks.workunit.client.0.smithi153.stderr: -63> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 2024-09-19T14:08:21.695 INFO:tasks.workunit.client.0.smithi153.stderr: -62> 2024-09-19T14:08:21.600+0000 7f1a0a8c49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 info.flags=0x17 2024-09-19T14:08:21.695 INFO:tasks.workunit.client.0.smithi153.stderr: -61> 2024-09-19T14:08:21.600+0000 7f1a0a8c49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 to cache LRU end 2024-09-19T14:08:21.695 INFO:tasks.workunit.client.0.smithi153.stderr: -60> 2024-09-19T14:08:21.600+0000 7f1a0a8c49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:21.695 INFO:tasks.workunit.client.0.smithi153.stderr: -59> 2024-09-19T14:08:21.600+0000 7f1a0a8c49c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29, ofs0, ns] 2024-09-19T14:08:21.695 INFO:tasks.workunit.client.0.smithi153.stderr: -58> 2024-09-19T14:08:21.600+0000 7f18deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333527 cookie 94811179866944 notifier 6620 bl.length()=915 2024-09-19T14:08:21.695 INFO:tasks.workunit.client.0.smithi153.stderr: -57> 2024-09-19T14:08:21.600+0000 7f18deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 info.flags=0x17 2024-09-19T14:08:21.695 INFO:tasks.workunit.client.0.smithi153.stderr: -56> 2024-09-19T14:08:21.600+0000 7f18deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 to cache LRU end 2024-09-19T14:08:21.695 INFO:tasks.workunit.client.0.smithi153.stderr: -55> 2024-09-19T14:08:21.600+0000 7f18deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:21.695 INFO:tasks.workunit.client.0.smithi153.stderr: -54> 2024-09-19T14:08:21.604+0000 7f1a0a8c49c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): orig_sources= new_sources= 2024-09-19T14:08:21.696 INFO:tasks.workunit.client.0.smithi153.stderr: -53> 2024-09-19T14:08:21.604+0000 7f1a0a8c49c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): potential sources added=[] removed=[] 2024-09-19T14:08:21.696 INFO:tasks.workunit.client.0.smithi153.stderr: -52> 2024-09-19T14:08:21.604+0000 7f1a0a8c49c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): orig_dests= new_dests= 2024-09-19T14:08:21.696 INFO:tasks.workunit.client.0.smithi153.stderr: -51> 2024-09-19T14:08:21.604+0000 7f1a0a8c49c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): potential dests added=[] removed=[] 2024-09-19T14:08:21.696 INFO:tasks.workunit.client.0.smithi153.stderr: -50> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.0 2024-09-19T14:08:21.696 INFO:tasks.workunit.client.0.smithi153.stderr: -49> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.0 2024-09-19T14:08:21.696 INFO:tasks.workunit.client.0.smithi153.stderr: -48> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.1 2024-09-19T14:08:21.696 INFO:tasks.workunit.client.0.smithi153.stderr: -47> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.1 2024-09-19T14:08:21.696 INFO:tasks.workunit.client.0.smithi153.stderr: -46> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.2 2024-09-19T14:08:21.696 INFO:tasks.workunit.client.0.smithi153.stderr: -45> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.2 2024-09-19T14:08:21.696 INFO:tasks.workunit.client.0.smithi153.stderr: -44> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.3 2024-09-19T14:08:21.696 INFO:tasks.workunit.client.0.smithi153.stderr: -43> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.3 2024-09-19T14:08:21.696 INFO:tasks.workunit.client.0.smithi153.stderr: -42> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.4 2024-09-19T14:08:21.696 INFO:tasks.workunit.client.0.smithi153.stderr: -41> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.4 2024-09-19T14:08:21.697 INFO:tasks.workunit.client.0.smithi153.stderr: -40> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.5 2024-09-19T14:08:21.697 INFO:tasks.workunit.client.0.smithi153.stderr: -39> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.5 2024-09-19T14:08:21.697 INFO:tasks.workunit.client.0.smithi153.stderr: -38> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.6 2024-09-19T14:08:21.697 INFO:tasks.workunit.client.0.smithi153.stderr: -37> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.6 2024-09-19T14:08:21.697 INFO:tasks.workunit.client.0.smithi153.stderr: -36> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.7 2024-09-19T14:08:21.697 INFO:tasks.workunit.client.0.smithi153.stderr: -35> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.7 2024-09-19T14:08:21.697 INFO:tasks.workunit.client.0.smithi153.stderr: -34> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.8 2024-09-19T14:08:21.697 INFO:tasks.workunit.client.0.smithi153.stderr: -33> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.8 2024-09-19T14:08:21.697 INFO:tasks.workunit.client.0.smithi153.stderr: -32> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.9 2024-09-19T14:08:21.697 INFO:tasks.workunit.client.0.smithi153.stderr: -31> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.9 2024-09-19T14:08:21.697 INFO:tasks.workunit.client.0.smithi153.stderr: -30> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.10 2024-09-19T14:08:21.697 INFO:tasks.workunit.client.0.smithi153.stderr: -29> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.10 2024-09-19T14:08:21.697 INFO:tasks.workunit.client.0.smithi153.stderr: -28> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.11 2024-09-19T14:08:21.698 INFO:tasks.workunit.client.0.smithi153.stderr: -27> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.11 2024-09-19T14:08:21.698 INFO:tasks.workunit.client.0.smithi153.stderr: -26> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.0 2024-09-19T14:08:21.698 INFO:tasks.workunit.client.0.smithi153.stderr: -25> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1 2024-09-19T14:08:21.698 INFO:tasks.workunit.client.0.smithi153.stderr: -24> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2 2024-09-19T14:08:21.698 INFO:tasks.workunit.client.0.smithi153.stderr: -23> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.3 2024-09-19T14:08:21.698 INFO:tasks.workunit.client.0.smithi153.stderr: -22> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.4 2024-09-19T14:08:21.698 INFO:tasks.workunit.client.0.smithi153.stderr: -21> 2024-09-19T14:08:21.616+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.5 2024-09-19T14:08:21.698 INFO:tasks.workunit.client.0.smithi153.stderr: -20> 2024-09-19T14:08:21.616+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.6 2024-09-19T14:08:21.698 INFO:tasks.workunit.client.0.smithi153.stderr: -19> 2024-09-19T14:08:21.616+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.7 2024-09-19T14:08:21.698 INFO:tasks.workunit.client.0.smithi153.stderr: -18> 2024-09-19T14:08:21.616+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.8 2024-09-19T14:08:21.698 INFO:tasks.workunit.client.0.smithi153.stderr: -17> 2024-09-19T14:08:21.620+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.9 2024-09-19T14:08:21.698 INFO:tasks.workunit.client.0.smithi153.stderr: -16> 2024-09-19T14:08:21.620+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.10 2024-09-19T14:08:21.698 INFO:tasks.workunit.client.0.smithi153.stderr: -15> 2024-09-19T14:08:21.624+0000 7f1a0a8c49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 : hit (requested=0x17, cached=0x17) 2024-09-19T14:08:21.699 INFO:tasks.workunit.client.0.smithi153.stderr: -14> 2024-09-19T14:08:21.624+0000 7f1a0a8c49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 2024-09-19T14:08:21.699 INFO:tasks.workunit.client.0.smithi153.stderr: -13> 2024-09-19T14:08:21.628+0000 7f1a0a8c49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 info.flags=0x17 2024-09-19T14:08:21.699 INFO:tasks.workunit.client.0.smithi153.stderr: -12> 2024-09-19T14:08:21.628+0000 7f1a0a8c49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 to cache LRU end 2024-09-19T14:08:21.699 INFO:tasks.workunit.client.0.smithi153.stderr: -11> 2024-09-19T14:08:21.628+0000 7f1a0a8c49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:21.699 INFO:tasks.workunit.client.0.smithi153.stderr: -10> 2024-09-19T14:08:21.628+0000 7f1a0a8c49c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29, ofs0, ns] 2024-09-19T14:08:21.699 INFO:tasks.workunit.client.0.smithi153.stderr: -9> 2024-09-19T14:08:21.628+0000 7f18deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333528 cookie 94811179866944 notifier 6620 bl.length()=915 2024-09-19T14:08:21.699 INFO:tasks.workunit.client.0.smithi153.stderr: -8> 2024-09-19T14:08:21.628+0000 7f18deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 info.flags=0x17 2024-09-19T14:08:21.699 INFO:tasks.workunit.client.0.smithi153.stderr: -7> 2024-09-19T14:08:21.628+0000 7f18deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 to cache LRU end 2024-09-19T14:08:21.699 INFO:tasks.workunit.client.0.smithi153.stderr: -6> 2024-09-19T14:08:21.628+0000 7f18deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:21.699 INFO:tasks.workunit.client.0.smithi153.stderr: -5> 2024-09-19T14:08:21.632+0000 7f1a0a8c49c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): orig_sources= new_sources= 2024-09-19T14:08:21.699 INFO:tasks.workunit.client.0.smithi153.stderr: -4> 2024-09-19T14:08:21.632+0000 7f1a0a8c49c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): potential sources added=[] removed=[] 2024-09-19T14:08:21.699 INFO:tasks.workunit.client.0.smithi153.stderr: -3> 2024-09-19T14:08:21.632+0000 7f1a0a8c49c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): orig_dests= new_dests= 2024-09-19T14:08:21.699 INFO:tasks.workunit.client.0.smithi153.stderr: -2> 2024-09-19T14:08:21.632+0000 7f1a0a8c49c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): potential dests added=[] removed=[] 2024-09-19T14:08:21.699 INFO:tasks.workunit.client.0.smithi153.stderr: -1> 2024-09-19T14:08:21.632+0000 7f1a0a8c49c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1a0a8c49c0 time 2024-09-19T14:08:21.637834+0000 2024-09-19T14:08:21.699 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:08:21.700 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.700 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:08:21.700 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1a0e19e2eb] 2024-09-19T14:08:21.700 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1a0e19e49f] 2024-09-19T14:08:21.700 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563af02f6271] 2024-09-19T14:08:21.700 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x563af03054ab] 2024-09-19T14:08:21.700 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563af0306a94] 2024-09-19T14:08:21.700 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:08:21.700 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1a0d004d90] 2024-09-19T14:08:21.700 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:08:21.700 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:08:21.700 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.700 INFO:tasks.workunit.client.0.smithi153.stderr: 0> 2024-09-19T14:08:21.636+0000 7f1a0a8c49c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:08:21.700 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7f1a0a8c49c0 thread_name:radosgw-admin 2024-09-19T14:08:21.701 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.701 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:08:21.701 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1a0d01d520] 2024-09-19T14:08:21.701 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:08:21.701 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:08:21.701 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:08:21.701 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1a0e19e345] 2024-09-19T14:08:21.701 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1a0e19e49f] 2024-09-19T14:08:21.701 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563af02f6271] 2024-09-19T14:08:21.701 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x563af03054ab] 2024-09-19T14:08:21.701 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563af0306a94] 2024-09-19T14:08:21.701 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:08:21.701 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1a0d004d90] 2024-09-19T14:08:21.701 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:08:21.701 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:08:21.702 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:08:21.702 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.702 INFO:tasks.workunit.client.0.smithi153.stderr:--- logging levels --- 2024-09-19T14:08:21.702 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 none 2024-09-19T14:08:21.702 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 lockdep 2024-09-19T14:08:21.702 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 context 2024-09-19T14:08:21.702 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 crush 2024-09-19T14:08:21.702 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds 2024-09-19T14:08:21.702 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_balancer 2024-09-19T14:08:21.702 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_locker 2024-09-19T14:08:21.702 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log 2024-09-19T14:08:21.702 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log_expire 2024-09-19T14:08:21.702 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_migrator 2024-09-19T14:08:21.702 INFO:tasks.workunit.client.0.smithi153.stderr: 3/ 5 mds_quiesce 2024-09-19T14:08:21.703 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 buffer 2024-09-19T14:08:21.703 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 timer 2024-09-19T14:08:21.703 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 filer 2024-09-19T14:08:21.703 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 striper 2024-09-19T14:08:21.703 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 objecter 2024-09-19T14:08:21.703 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rados 2024-09-19T14:08:21.703 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd 2024-09-19T14:08:21.703 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_mirror 2024-09-19T14:08:21.703 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_replay 2024-09-19T14:08:21.703 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_pwl 2024-09-19T14:08:21.703 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 journaler 2024-09-19T14:08:21.703 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objectcacher 2024-09-19T14:08:21.703 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:08:21.703 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 client 2024-09-19T14:08:21.704 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 osd 2024-09-19T14:08:21.704 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 optracker 2024-09-19T14:08:21.704 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objclass 2024-09-19T14:08:21.704 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 filestore 2024-09-19T14:08:21.704 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 journal 2024-09-19T14:08:21.704 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 ms 2024-09-19T14:08:21.704 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mon 2024-09-19T14:08:21.704 INFO:tasks.workunit.client.0.smithi153.stderr: 0/10 monc 2024-09-19T14:08:21.704 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 paxos 2024-09-19T14:08:21.704 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 tp 2024-09-19T14:08:21.704 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 auth 2024-09-19T14:08:21.704 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 crypto 2024-09-19T14:08:21.704 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 finisher 2024-09-19T14:08:21.704 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 reserver 2024-09-19T14:08:21.705 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 heartbeatmap 2024-09-19T14:08:21.705 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 perfcounter 2024-09-19T14:08:21.705 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw 2024-09-19T14:08:21.705 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_sync 2024-09-19T14:08:21.705 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_datacache 2024-09-19T14:08:21.705 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_access 2024-09-19T14:08:21.705 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:08:21.705 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_flight 2024-09-19T14:08:21.705 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:08:21.705 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw_notification 2024-09-19T14:08:21.705 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 javaclient 2024-09-19T14:08:21.705 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 asok 2024-09-19T14:08:21.705 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 throttle 2024-09-19T14:08:21.706 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 refs 2024-09-19T14:08:21.706 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 compressor 2024-09-19T14:08:21.706 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluestore 2024-09-19T14:08:21.706 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluefs 2024-09-19T14:08:21.706 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 bdev 2024-09-19T14:08:21.706 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 kstore 2024-09-19T14:08:21.706 INFO:tasks.workunit.client.0.smithi153.stderr: 4/ 5 rocksdb 2024-09-19T14:08:21.706 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 fuse 2024-09-19T14:08:21.706 INFO:tasks.workunit.client.0.smithi153.stderr: 2/ 5 mgr 2024-09-19T14:08:21.706 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mgrc 2024-09-19T14:08:21.706 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 dpdk 2024-09-19T14:08:21.706 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 eventtrace 2024-09-19T14:08:21.706 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 prioritycache 2024-09-19T14:08:21.706 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 test 2024-09-19T14:08:21.706 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:08:21.707 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephsqlite 2024-09-19T14:08:21.707 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:08:21.707 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore 2024-09-19T14:08:21.707 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_onode 2024-09-19T14:08:21.707 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_odata 2024-09-19T14:08:21.707 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_omap 2024-09-19T14:08:21.707 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_tm 2024-09-19T14:08:21.707 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_t 2024-09-19T14:08:21.707 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:08:21.707 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_epm 2024-09-19T14:08:21.707 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_lba 2024-09-19T14:08:21.707 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:08:21.707 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cache 2024-09-19T14:08:21.707 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_journal 2024-09-19T14:08:21.708 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_device 2024-09-19T14:08:21.708 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_backref 2024-09-19T14:08:21.708 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 alienstore 2024-09-19T14:08:21.708 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mclock 2024-09-19T14:08:21.708 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cyanstore 2024-09-19T14:08:21.708 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 ceph_exporter 2024-09-19T14:08:21.708 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 memstore 2024-09-19T14:08:21.708 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 trace 2024-09-19T14:08:21.708 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 ceph_dedup 2024-09-19T14:08:21.708 INFO:tasks.workunit.client.0.smithi153.stderr: -2/-2 (syslog threshold) 2024-09-19T14:08:21.708 INFO:tasks.workunit.client.0.smithi153.stderr: 99/99 (stderr threshold) 2024-09-19T14:08:21.708 INFO:tasks.workunit.client.0.smithi153.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:08:21.708 INFO:tasks.workunit.client.0.smithi153.stderr: 7f18b77fe640 / http_manager 2024-09-19T14:08:21.708 INFO:tasks.workunit.client.0.smithi153.stderr: 7f18be7dc640 / http_manager 2024-09-19T14:08:21.709 INFO:tasks.workunit.client.0.smithi153.stderr: 7f18bf7de640 / rgw_dt_lg_renew 2024-09-19T14:08:21.709 INFO:tasks.workunit.client.0.smithi153.stderr: 7f18ddffb640 / ms_dispatch 2024-09-19T14:08:21.709 INFO:tasks.workunit.client.0.smithi153.stderr: 7f18deffd640 / io_context_pool 2024-09-19T14:08:21.709 INFO:tasks.workunit.client.0.smithi153.stderr: 7f18df7fe640 / io_context_pool 2024-09-19T14:08:21.709 INFO:tasks.workunit.client.0.smithi153.stderr: 7f18edffb640 / ms_dispatch 2024-09-19T14:08:21.709 INFO:tasks.workunit.client.0.smithi153.stderr: 7f18f4e09640 / ms_dispatch 2024-09-19T14:08:21.709 INFO:tasks.workunit.client.0.smithi153.stderr: 7f18f660c640 / io_context_pool 2024-09-19T14:08:21.709 INFO:tasks.workunit.client.0.smithi153.stderr: 7f1a07bc9640 / msgr-worker-2 2024-09-19T14:08:21.709 INFO:tasks.workunit.client.0.smithi153.stderr: 7f1a083ca640 / msgr-worker-1 2024-09-19T14:08:21.709 INFO:tasks.workunit.client.0.smithi153.stderr: 7f1a08bcb640 / msgr-worker-0 2024-09-19T14:08:21.709 INFO:tasks.workunit.client.0.smithi153.stderr: 7f1a093cc640 / io_context_pool 2024-09-19T14:08:21.709 INFO:tasks.workunit.client.0.smithi153.stderr: 7f1a0a8c49c0 / radosgw-admin 2024-09-19T14:08:21.709 INFO:tasks.workunit.client.0.smithi153.stderr: max_recent 500 2024-09-19T14:08:21.709 INFO:tasks.workunit.client.0.smithi153.stderr: max_new 1000 2024-09-19T14:08:21.710 INFO:tasks.workunit.client.0.smithi153.stderr: log_file /var/log/ceph/ceph-client.admin.105753.log 2024-09-19T14:08:21.710 INFO:tasks.workunit.client.0.smithi153.stderr:--- end dump of recent events --- 2024-09-19T14:08:21.710 INFO:tasks.workunit.client.0.smithi153.stderr:--- begin dump of recent events --- 2024-09-19T14:08:21.710 INFO:tasks.workunit.client.0.smithi153.stderr: -499> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a2f060) adding con mode: crc 2024-09-19T14:08:21.710 INFO:tasks.workunit.client.0.smithi153.stderr: -498> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a2f060) adding con mode: crc 2024-09-19T14:08:21.710 INFO:tasks.workunit.client.0.smithi153.stderr: -497> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a2f060) adding con mode: secure 2024-09-19T14:08:21.710 INFO:tasks.workunit.client.0.smithi153.stderr: -496> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a2f060) adding con mode: crc 2024-09-19T14:08:21.710 INFO:tasks.workunit.client.0.smithi153.stderr: -495> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a2f060) adding con mode: secure 2024-09-19T14:08:21.710 INFO:tasks.workunit.client.0.smithi153.stderr: -494> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a2f060) adding con mode: crc 2024-09-19T14:08:21.710 INFO:tasks.workunit.client.0.smithi153.stderr: -493> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a2f060) adding con mode: secure 2024-09-19T14:08:21.710 INFO:tasks.workunit.client.0.smithi153.stderr: -492> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:08:21.710 INFO:tasks.workunit.client.0.smithi153.stderr: -491> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:08:21.710 INFO:tasks.workunit.client.0.smithi153.stderr: -490> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command rotate-key hook 0x563af2a2f1a8 2024-09-19T14:08:21.710 INFO:tasks.workunit.client.0.smithi153.stderr: -489> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient: _reopen_session rank -1 2024-09-19T14:08:21.711 INFO:tasks.workunit.client.0.smithi153.stderr: -488> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T14:08:21.711 INFO:tasks.workunit.client.0.smithi153.stderr: -487> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient(hunting): picked mon.noname-a con 0x563af28bc410 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:08:21.711 INFO:tasks.workunit.client.0.smithi153.stderr: -486> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient(hunting): picked mon.noname-c con 0x563af28bd0f0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:08:21.711 INFO:tasks.workunit.client.0.smithi153.stderr: -485> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient(hunting): picked mon.noname-b con 0x563af2a38000 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:08:21.711 INFO:tasks.workunit.client.0.smithi153.stderr: -484> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:08:21.711 INFO:tasks.workunit.client.0.smithi153.stderr: -483> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:08:21.711 INFO:tasks.workunit.client.0.smithi153.stderr: -482> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:08:21.711 INFO:tasks.workunit.client.0.smithi153.stderr: -481> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient(hunting): _renew_subs 2024-09-19T14:08:21.711 INFO:tasks.workunit.client.0.smithi153.stderr: -480> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient(hunting): authenticate will time out at 2689.985591s 2024-09-19T14:08:21.711 INFO:tasks.workunit.client.0.smithi153.stderr: -479> 2024-09-19T14:08:21.520+0000 7f1a07bc9640 10 monclient(hunting): get_auth_request con 0x563af28bd0f0 auth_method 0 2024-09-19T14:08:21.711 INFO:tasks.workunit.client.0.smithi153.stderr: -478> 2024-09-19T14:08:21.520+0000 7f1a07bc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:08:21.711 INFO:tasks.workunit.client.0.smithi153.stderr: -477> 2024-09-19T14:08:21.520+0000 7f1a07bc9640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:08:21.711 INFO:tasks.workunit.client.0.smithi153.stderr: -476> 2024-09-19T14:08:21.520+0000 7f1a07bc9640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:08:21.711 INFO:tasks.workunit.client.0.smithi153.stderr: -475> 2024-09-19T14:08:21.520+0000 7f1a083ca640 10 monclient(hunting): get_auth_request con 0x563af28bc410 auth_method 0 2024-09-19T14:08:21.712 INFO:tasks.workunit.client.0.smithi153.stderr: -474> 2024-09-19T14:08:21.520+0000 7f1a083ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:08:21.712 INFO:tasks.workunit.client.0.smithi153.stderr: -473> 2024-09-19T14:08:21.520+0000 7f1a083ca640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:08:21.712 INFO:tasks.workunit.client.0.smithi153.stderr: -472> 2024-09-19T14:08:21.520+0000 7f1a083ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:08:21.712 INFO:tasks.workunit.client.0.smithi153.stderr: -471> 2024-09-19T14:08:21.520+0000 7f1a07bc9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:08:21.712 INFO:tasks.workunit.client.0.smithi153.stderr: -470> 2024-09-19T14:08:21.520+0000 7f1a07bc9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:08:21.712 INFO:tasks.workunit.client.0.smithi153.stderr: -469> 2024-09-19T14:08:21.520+0000 7f1a07bc9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:08:21.712 INFO:tasks.workunit.client.0.smithi153.stderr: -468> 2024-09-19T14:08:21.520+0000 7f1a083ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:08:21.712 INFO:tasks.workunit.client.0.smithi153.stderr: -467> 2024-09-19T14:08:21.520+0000 7f1a083ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:08:21.712 INFO:tasks.workunit.client.0.smithi153.stderr: -466> 2024-09-19T14:08:21.520+0000 7f1a083ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:08:21.712 INFO:tasks.workunit.client.0.smithi153.stderr: -465> 2024-09-19T14:08:21.520+0000 7f1a07bc9640 10 monclient(hunting): handle_auth_done global_id 6611 payload 824 2024-09-19T14:08:21.712 INFO:tasks.workunit.client.0.smithi153.stderr: -464> 2024-09-19T14:08:21.520+0000 7f1a07bc9640 10 monclient: _finish_hunting 0 2024-09-19T14:08:21.712 INFO:tasks.workunit.client.0.smithi153.stderr: -463> 2024-09-19T14:08:21.520+0000 7f1a07bc9640 1 monclient: found mon.noname-c 2024-09-19T14:08:21.712 INFO:tasks.workunit.client.0.smithi153.stderr: -462> 2024-09-19T14:08:21.520+0000 7f1a07bc9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:08:21.712 INFO:tasks.workunit.client.0.smithi153.stderr: -461> 2024-09-19T14:08:21.520+0000 7f18f4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:08:21.713 INFO:tasks.workunit.client.0.smithi153.stderr: -460> 2024-09-19T14:08:21.520+0000 7f18f4e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:08:21.713 INFO:tasks.workunit.client.0.smithi153.stderr: -459> 2024-09-19T14:08:21.520+0000 7f18f4e09640 10 monclient: dump: 2024-09-19T14:08:21.713 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:08:21.713 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:08:21.713 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.713 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.713 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:08:21.713 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:08:21.713 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:08:21.713 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:08:21.713 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:08:21.713 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.713 INFO:tasks.workunit.client.0.smithi153.stderr: -458> 2024-09-19T14:08:21.520+0000 7f18f4e09640 10 monclient: _finish_auth 0 2024-09-19T14:08:21.714 INFO:tasks.workunit.client.0.smithi153.stderr: -457> 2024-09-19T14:08:21.520+0000 7f18f4e09640 10 monclient: _check_auth_tickets 2024-09-19T14:08:21.714 INFO:tasks.workunit.client.0.smithi153.stderr: -456> 2024-09-19T14:08:21.520+0000 7f18f4e09640 10 monclient: handle_config config(0 keys) 2024-09-19T14:08:21.714 INFO:tasks.workunit.client.0.smithi153.stderr: -455> 2024-09-19T14:08:21.520+0000 7f18f4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:08:21.714 INFO:tasks.workunit.client.0.smithi153.stderr: -454> 2024-09-19T14:08:21.520+0000 7f18f4e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:08:21.714 INFO:tasks.workunit.client.0.smithi153.stderr: -453> 2024-09-19T14:08:21.520+0000 7f18f4e09640 10 monclient: dump: 2024-09-19T14:08:21.714 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:08:21.714 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:08:21.714 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.714 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.714 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:08:21.714 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:08:21.714 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:08:21.714 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:08:21.715 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:08:21.715 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.715 INFO:tasks.workunit.client.0.smithi153.stderr: -452> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 5 monclient: authenticate success, global_id 6611 2024-09-19T14:08:21.715 INFO:tasks.workunit.client.0.smithi153.stderr: -451> 2024-09-19T14:08:21.520+0000 7f18f660c640 4 set_mon_vals no callback set 2024-09-19T14:08:21.715 INFO:tasks.workunit.client.0.smithi153.stderr: -450> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient: _renew_subs 2024-09-19T14:08:21.715 INFO:tasks.workunit.client.0.smithi153.stderr: -449> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:08:21.715 INFO:tasks.workunit.client.0.smithi153.stderr: -448> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient: _renew_subs 2024-09-19T14:08:21.715 INFO:tasks.workunit.client.0.smithi153.stderr: -447> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:08:21.715 INFO:tasks.workunit.client.0.smithi153.stderr: -446> 2024-09-19T14:08:21.520+0000 7f1a0a8c49c0 1 librados: init done 2024-09-19T14:08:21.715 INFO:tasks.workunit.client.0.smithi153.stderr: -445> 2024-09-19T14:08:21.524+0000 7f18f4e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:08:21.715 INFO:tasks.workunit.client.0.smithi153.stderr: -444> 2024-09-19T14:08:21.524+0000 7f18f4e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:08:21.715 INFO:tasks.workunit.client.0.smithi153.stderr: -443> 2024-09-19T14:08:21.524+0000 7f18f4e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:08:21.715 INFO:tasks.workunit.client.0.smithi153.stderr: -442> 2024-09-19T14:08:21.524+0000 7f1a083ca640 10 monclient: get_auth_request con 0x7f18f0071be0 auth_method 0 2024-09-19T14:08:21.715 INFO:tasks.workunit.client.0.smithi153.stderr: -441> 2024-09-19T14:08:21.524+0000 7f1a08bcb640 10 monclient: get_auth_request con 0x563af2a776e0 auth_method 0 2024-09-19T14:08:21.716 INFO:tasks.workunit.client.0.smithi153.stderr: -440> 2024-09-19T14:08:21.524+0000 7f1a083ca640 10 monclient: get_auth_request con 0x563af2a7a8c0 auth_method 0 2024-09-19T14:08:21.716 INFO:tasks.workunit.client.0.smithi153.stderr: -439> 2024-09-19T14:08:21.528+0000 7f1a07bc9640 10 monclient: get_auth_request con 0x563af2a7f950 auth_method 0 2024-09-19T14:08:21.716 INFO:tasks.workunit.client.0.smithi153.stderr: -438> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient: build_initial_monmap 2024-09-19T14:08:21.716 INFO:tasks.workunit.client.0.smithi153.stderr: -437> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 1 build_initial for_mkfs: 0 2024-09-19T14:08:21.716 INFO:tasks.workunit.client.0.smithi153.stderr: -436> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient: monmap: 2024-09-19T14:08:21.716 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:08:21.716 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:08:21.716 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:08:21.716 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:08:21.716 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:08:21.716 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:08:21.716 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:08:21.716 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:08:21.717 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:08:21.717 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.717 INFO:tasks.workunit.client.0.smithi153.stderr: -435> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding auth protocol: cephx 2024-09-19T14:08:21.717 INFO:tasks.workunit.client.0.smithi153.stderr: -434> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding auth protocol: cephx 2024-09-19T14:08:21.717 INFO:tasks.workunit.client.0.smithi153.stderr: -433> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding auth protocol: cephx 2024-09-19T14:08:21.717 INFO:tasks.workunit.client.0.smithi153.stderr: -432> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding con mode: secure 2024-09-19T14:08:21.717 INFO:tasks.workunit.client.0.smithi153.stderr: -431> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding con mode: crc 2024-09-19T14:08:21.717 INFO:tasks.workunit.client.0.smithi153.stderr: -430> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding con mode: secure 2024-09-19T14:08:21.717 INFO:tasks.workunit.client.0.smithi153.stderr: -429> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding con mode: crc 2024-09-19T14:08:21.717 INFO:tasks.workunit.client.0.smithi153.stderr: -428> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding con mode: secure 2024-09-19T14:08:21.717 INFO:tasks.workunit.client.0.smithi153.stderr: -427> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding con mode: crc 2024-09-19T14:08:21.717 INFO:tasks.workunit.client.0.smithi153.stderr: -426> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding con mode: crc 2024-09-19T14:08:21.717 INFO:tasks.workunit.client.0.smithi153.stderr: -425> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding con mode: secure 2024-09-19T14:08:21.717 INFO:tasks.workunit.client.0.smithi153.stderr: -424> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding con mode: crc 2024-09-19T14:08:21.718 INFO:tasks.workunit.client.0.smithi153.stderr: -423> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding con mode: secure 2024-09-19T14:08:21.718 INFO:tasks.workunit.client.0.smithi153.stderr: -422> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding con mode: crc 2024-09-19T14:08:21.718 INFO:tasks.workunit.client.0.smithi153.stderr: -421> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a83860) adding con mode: secure 2024-09-19T14:08:21.718 INFO:tasks.workunit.client.0.smithi153.stderr: -420> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:08:21.718 INFO:tasks.workunit.client.0.smithi153.stderr: -419> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command objecter_requests cmddesc objecter_requests hook 0x563af2a872d0 EEXIST 2024-09-19T14:08:21.718 INFO:tasks.workunit.client.0.smithi153.stderr: -418> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient: init 2024-09-19T14:08:21.718 INFO:tasks.workunit.client.0.smithi153.stderr: -417> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding auth protocol: cephx 2024-09-19T14:08:21.718 INFO:tasks.workunit.client.0.smithi153.stderr: -416> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding auth protocol: cephx 2024-09-19T14:08:21.718 INFO:tasks.workunit.client.0.smithi153.stderr: -415> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding auth protocol: cephx 2024-09-19T14:08:21.718 INFO:tasks.workunit.client.0.smithi153.stderr: -414> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding con mode: secure 2024-09-19T14:08:21.718 INFO:tasks.workunit.client.0.smithi153.stderr: -413> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding con mode: crc 2024-09-19T14:08:21.718 INFO:tasks.workunit.client.0.smithi153.stderr: -412> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding con mode: secure 2024-09-19T14:08:21.719 INFO:tasks.workunit.client.0.smithi153.stderr: -411> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding con mode: crc 2024-09-19T14:08:21.719 INFO:tasks.workunit.client.0.smithi153.stderr: -410> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding con mode: secure 2024-09-19T14:08:21.719 INFO:tasks.workunit.client.0.smithi153.stderr: -409> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding con mode: crc 2024-09-19T14:08:21.719 INFO:tasks.workunit.client.0.smithi153.stderr: -408> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding con mode: crc 2024-09-19T14:08:21.719 INFO:tasks.workunit.client.0.smithi153.stderr: -407> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding con mode: secure 2024-09-19T14:08:21.719 INFO:tasks.workunit.client.0.smithi153.stderr: -406> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding con mode: crc 2024-09-19T14:08:21.719 INFO:tasks.workunit.client.0.smithi153.stderr: -405> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding con mode: secure 2024-09-19T14:08:21.719 INFO:tasks.workunit.client.0.smithi153.stderr: -404> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding con mode: crc 2024-09-19T14:08:21.719 INFO:tasks.workunit.client.0.smithi153.stderr: -403> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2a828b8) adding con mode: secure 2024-09-19T14:08:21.719 INFO:tasks.workunit.client.0.smithi153.stderr: -402> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:08:21.719 INFO:tasks.workunit.client.0.smithi153.stderr: -401> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:08:21.719 INFO:tasks.workunit.client.0.smithi153.stderr: -400> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command rotate-key cmddesc rotate-key hook 0x563af2a82a00 EEXIST 2024-09-19T14:08:21.719 INFO:tasks.workunit.client.0.smithi153.stderr: -399> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient: _reopen_session rank -1 2024-09-19T14:08:21.719 INFO:tasks.workunit.client.0.smithi153.stderr: -398> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T14:08:21.720 INFO:tasks.workunit.client.0.smithi153.stderr: -397> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient(hunting): picked mon.noname-a con 0x563af2aab480 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:08:21.720 INFO:tasks.workunit.client.0.smithi153.stderr: -396> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient(hunting): picked mon.noname-b con 0x563af2aaadb0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:08:21.720 INFO:tasks.workunit.client.0.smithi153.stderr: -395> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient(hunting): picked mon.noname-c con 0x563af2aa9790 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:08:21.720 INFO:tasks.workunit.client.0.smithi153.stderr: -394> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:08:21.720 INFO:tasks.workunit.client.0.smithi153.stderr: -393> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:08:21.720 INFO:tasks.workunit.client.0.smithi153.stderr: -392> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:08:21.720 INFO:tasks.workunit.client.0.smithi153.stderr: -391> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient(hunting): _renew_subs 2024-09-19T14:08:21.720 INFO:tasks.workunit.client.0.smithi153.stderr: -390> 2024-09-19T14:08:21.528+0000 7f1a0a8c49c0 10 monclient(hunting): authenticate will time out at 2689.995026s 2024-09-19T14:08:21.720 INFO:tasks.workunit.client.0.smithi153.stderr: -389> 2024-09-19T14:08:21.528+0000 7f1a083ca640 10 monclient(hunting): get_auth_request con 0x563af2aab480 auth_method 0 2024-09-19T14:08:21.720 INFO:tasks.workunit.client.0.smithi153.stderr: -388> 2024-09-19T14:08:21.528+0000 7f1a083ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:08:21.720 INFO:tasks.workunit.client.0.smithi153.stderr: -387> 2024-09-19T14:08:21.528+0000 7f1a083ca640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:08:21.720 INFO:tasks.workunit.client.0.smithi153.stderr: -386> 2024-09-19T14:08:21.528+0000 7f1a083ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:08:21.720 INFO:tasks.workunit.client.0.smithi153.stderr: -385> 2024-09-19T14:08:21.528+0000 7f1a08bcb640 10 monclient(hunting): get_auth_request con 0x563af2aa9790 auth_method 0 2024-09-19T14:08:21.720 INFO:tasks.workunit.client.0.smithi153.stderr: -384> 2024-09-19T14:08:21.528+0000 7f1a08bcb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:08:21.720 INFO:tasks.workunit.client.0.smithi153.stderr: -383> 2024-09-19T14:08:21.528+0000 7f1a08bcb640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:08:21.721 INFO:tasks.workunit.client.0.smithi153.stderr: -382> 2024-09-19T14:08:21.528+0000 7f1a08bcb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:08:21.721 INFO:tasks.workunit.client.0.smithi153.stderr: -381> 2024-09-19T14:08:21.528+0000 7f1a083ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:08:21.721 INFO:tasks.workunit.client.0.smithi153.stderr: -380> 2024-09-19T14:08:21.528+0000 7f1a083ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:08:21.721 INFO:tasks.workunit.client.0.smithi153.stderr: -379> 2024-09-19T14:08:21.528+0000 7f1a083ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:08:21.721 INFO:tasks.workunit.client.0.smithi153.stderr: -378> 2024-09-19T14:08:21.528+0000 7f1a08bcb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:08:21.721 INFO:tasks.workunit.client.0.smithi153.stderr: -377> 2024-09-19T14:08:21.528+0000 7f1a08bcb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:08:21.721 INFO:tasks.workunit.client.0.smithi153.stderr: -376> 2024-09-19T14:08:21.528+0000 7f1a08bcb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:08:21.721 INFO:tasks.workunit.client.0.smithi153.stderr: -375> 2024-09-19T14:08:21.528+0000 7f1a07bc9640 10 monclient(hunting): get_auth_request con 0x563af2aaadb0 auth_method 0 2024-09-19T14:08:21.721 INFO:tasks.workunit.client.0.smithi153.stderr: -374> 2024-09-19T14:08:21.528+0000 7f1a07bc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:08:21.721 INFO:tasks.workunit.client.0.smithi153.stderr: -373> 2024-09-19T14:08:21.528+0000 7f1a07bc9640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:08:21.721 INFO:tasks.workunit.client.0.smithi153.stderr: -372> 2024-09-19T14:08:21.528+0000 7f1a07bc9640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:08:21.721 INFO:tasks.workunit.client.0.smithi153.stderr: -371> 2024-09-19T14:08:21.528+0000 7f1a08bcb640 10 monclient(hunting): handle_auth_done global_id 6614 payload 824 2024-09-19T14:08:21.721 INFO:tasks.workunit.client.0.smithi153.stderr: -370> 2024-09-19T14:08:21.528+0000 7f1a08bcb640 10 monclient: _finish_hunting 0 2024-09-19T14:08:21.721 INFO:tasks.workunit.client.0.smithi153.stderr: -369> 2024-09-19T14:08:21.528+0000 7f1a08bcb640 1 monclient: found mon.noname-c 2024-09-19T14:08:21.721 INFO:tasks.workunit.client.0.smithi153.stderr: -368> 2024-09-19T14:08:21.528+0000 7f1a08bcb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:08:21.722 INFO:tasks.workunit.client.0.smithi153.stderr: -367> 2024-09-19T14:08:21.528+0000 7f18edffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:08:21.722 INFO:tasks.workunit.client.0.smithi153.stderr: -366> 2024-09-19T14:08:21.528+0000 7f18edffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:08:21.722 INFO:tasks.workunit.client.0.smithi153.stderr: -365> 2024-09-19T14:08:21.528+0000 7f18edffb640 10 monclient: dump: 2024-09-19T14:08:21.722 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:08:21.722 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:08:21.722 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.722 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.722 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:08:21.722 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:08:21.722 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:08:21.722 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:08:21.722 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:08:21.722 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.722 INFO:tasks.workunit.client.0.smithi153.stderr: -364> 2024-09-19T14:08:21.528+0000 7f18edffb640 10 monclient: _finish_auth 0 2024-09-19T14:08:21.722 INFO:tasks.workunit.client.0.smithi153.stderr: -363> 2024-09-19T14:08:21.528+0000 7f18edffb640 10 monclient: _check_auth_tickets 2024-09-19T14:08:21.723 INFO:tasks.workunit.client.0.smithi153.stderr: -362> 2024-09-19T14:08:21.528+0000 7f18edffb640 10 monclient: handle_config config(0 keys) 2024-09-19T14:08:21.723 INFO:tasks.workunit.client.0.smithi153.stderr: -361> 2024-09-19T14:08:21.528+0000 7f18edffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:08:21.723 INFO:tasks.workunit.client.0.smithi153.stderr: -360> 2024-09-19T14:08:21.528+0000 7f18edffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:08:21.723 INFO:tasks.workunit.client.0.smithi153.stderr: -359> 2024-09-19T14:08:21.528+0000 7f18edffb640 10 monclient: dump: 2024-09-19T14:08:21.723 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:08:21.723 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:08:21.723 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.723 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.723 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:08:21.723 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:08:21.723 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:08:21.723 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:08:21.723 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:08:21.723 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.724 INFO:tasks.workunit.client.0.smithi153.stderr: -358> 2024-09-19T14:08:21.528+0000 7f1a093cc640 4 set_mon_vals no callback set 2024-09-19T14:08:21.724 INFO:tasks.workunit.client.0.smithi153.stderr: -357> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 monclient: authenticate success, global_id 6614 2024-09-19T14:08:21.724 INFO:tasks.workunit.client.0.smithi153.stderr: -356> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient: _renew_subs 2024-09-19T14:08:21.724 INFO:tasks.workunit.client.0.smithi153.stderr: -355> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:08:21.724 INFO:tasks.workunit.client.0.smithi153.stderr: -354> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient: _renew_subs 2024-09-19T14:08:21.724 INFO:tasks.workunit.client.0.smithi153.stderr: -353> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:08:21.724 INFO:tasks.workunit.client.0.smithi153.stderr: -352> 2024-09-19T14:08:21.532+0000 7f18edffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:08:21.724 INFO:tasks.workunit.client.0.smithi153.stderr: -351> 2024-09-19T14:08:21.532+0000 7f18edffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:08:21.724 INFO:tasks.workunit.client.0.smithi153.stderr: -350> 2024-09-19T14:08:21.532+0000 7f18edffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:08:21.724 INFO:tasks.workunit.client.0.smithi153.stderr: -349> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient: get_monmap_and_config 2024-09-19T14:08:21.724 INFO:tasks.workunit.client.0.smithi153.stderr: -348> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient: build_initial_monmap 2024-09-19T14:08:21.724 INFO:tasks.workunit.client.0.smithi153.stderr: -347> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 1 build_initial for_mkfs: 0 2024-09-19T14:08:21.724 INFO:tasks.workunit.client.0.smithi153.stderr: -346> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient: monmap: 2024-09-19T14:08:21.725 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:08:21.725 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:08:21.725 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:08:21.725 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:08:21.725 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:08:21.725 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:08:21.725 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:08:21.725 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:08:21.725 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:08:21.725 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.725 INFO:tasks.workunit.client.0.smithi153.stderr: -345> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding auth protocol: cephx 2024-09-19T14:08:21.725 INFO:tasks.workunit.client.0.smithi153.stderr: -344> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding auth protocol: cephx 2024-09-19T14:08:21.725 INFO:tasks.workunit.client.0.smithi153.stderr: -343> 2024-09-19T14:08:21.532+0000 7f1a083ca640 10 monclient: get_auth_request con 0x7f18e0071b20 auth_method 0 2024-09-19T14:08:21.725 INFO:tasks.workunit.client.0.smithi153.stderr: -342> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding auth protocol: cephx 2024-09-19T14:08:21.726 INFO:tasks.workunit.client.0.smithi153.stderr: -341> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding con mode: secure 2024-09-19T14:08:21.726 INFO:tasks.workunit.client.0.smithi153.stderr: -340> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding con mode: crc 2024-09-19T14:08:21.726 INFO:tasks.workunit.client.0.smithi153.stderr: -339> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding con mode: secure 2024-09-19T14:08:21.726 INFO:tasks.workunit.client.0.smithi153.stderr: -338> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding con mode: crc 2024-09-19T14:08:21.726 INFO:tasks.workunit.client.0.smithi153.stderr: -337> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding con mode: secure 2024-09-19T14:08:21.726 INFO:tasks.workunit.client.0.smithi153.stderr: -336> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding con mode: crc 2024-09-19T14:08:21.726 INFO:tasks.workunit.client.0.smithi153.stderr: -335> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding con mode: crc 2024-09-19T14:08:21.726 INFO:tasks.workunit.client.0.smithi153.stderr: -334> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding con mode: secure 2024-09-19T14:08:21.726 INFO:tasks.workunit.client.0.smithi153.stderr: -333> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding con mode: crc 2024-09-19T14:08:21.726 INFO:tasks.workunit.client.0.smithi153.stderr: -332> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding con mode: secure 2024-09-19T14:08:21.726 INFO:tasks.workunit.client.0.smithi153.stderr: -331> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding con mode: crc 2024-09-19T14:08:21.726 INFO:tasks.workunit.client.0.smithi153.stderr: -330> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2acacf0) adding con mode: secure 2024-09-19T14:08:21.726 INFO:tasks.workunit.client.0.smithi153.stderr: -329> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:08:21.726 INFO:tasks.workunit.client.0.smithi153.stderr: -328> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient: init 2024-09-19T14:08:21.727 INFO:tasks.workunit.client.0.smithi153.stderr: -327> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding auth protocol: cephx 2024-09-19T14:08:21.727 INFO:tasks.workunit.client.0.smithi153.stderr: -326> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding auth protocol: cephx 2024-09-19T14:08:21.727 INFO:tasks.workunit.client.0.smithi153.stderr: -325> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding auth protocol: cephx 2024-09-19T14:08:21.727 INFO:tasks.workunit.client.0.smithi153.stderr: -324> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding con mode: secure 2024-09-19T14:08:21.727 INFO:tasks.workunit.client.0.smithi153.stderr: -323> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding con mode: crc 2024-09-19T14:08:21.727 INFO:tasks.workunit.client.0.smithi153.stderr: -322> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding con mode: secure 2024-09-19T14:08:21.727 INFO:tasks.workunit.client.0.smithi153.stderr: -321> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding con mode: crc 2024-09-19T14:08:21.727 INFO:tasks.workunit.client.0.smithi153.stderr: -320> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding con mode: secure 2024-09-19T14:08:21.727 INFO:tasks.workunit.client.0.smithi153.stderr: -319> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding con mode: crc 2024-09-19T14:08:21.727 INFO:tasks.workunit.client.0.smithi153.stderr: -318> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding con mode: crc 2024-09-19T14:08:21.727 INFO:tasks.workunit.client.0.smithi153.stderr: -317> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding con mode: secure 2024-09-19T14:08:21.727 INFO:tasks.workunit.client.0.smithi153.stderr: -316> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding con mode: crc 2024-09-19T14:08:21.727 INFO:tasks.workunit.client.0.smithi153.stderr: -315> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding con mode: secure 2024-09-19T14:08:21.728 INFO:tasks.workunit.client.0.smithi153.stderr: -314> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding con mode: crc 2024-09-19T14:08:21.728 INFO:tasks.workunit.client.0.smithi153.stderr: -313> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0be20) adding con mode: secure 2024-09-19T14:08:21.728 INFO:tasks.workunit.client.0.smithi153.stderr: -312> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:08:21.728 INFO:tasks.workunit.client.0.smithi153.stderr: -311> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:08:21.728 INFO:tasks.workunit.client.0.smithi153.stderr: -310> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command rotate-key cmddesc rotate-key hook 0x7ffc83c0bf68 EEXIST 2024-09-19T14:08:21.728 INFO:tasks.workunit.client.0.smithi153.stderr: -309> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient: _reopen_session rank -1 2024-09-19T14:08:21.728 INFO:tasks.workunit.client.0.smithi153.stderr: -308> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T14:08:21.728 INFO:tasks.workunit.client.0.smithi153.stderr: -307> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient(hunting): picked mon.noname-c con 0x563af2aff1f0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:08:21.728 INFO:tasks.workunit.client.0.smithi153.stderr: -306> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient(hunting): picked mon.noname-b con 0x563af2acec10 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:08:21.728 INFO:tasks.workunit.client.0.smithi153.stderr: -305> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient(hunting): picked mon.noname-a con 0x563af2afa9c0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:08:21.728 INFO:tasks.workunit.client.0.smithi153.stderr: -304> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:08:21.728 INFO:tasks.workunit.client.0.smithi153.stderr: -303> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:08:21.728 INFO:tasks.workunit.client.0.smithi153.stderr: -302> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:08:21.728 INFO:tasks.workunit.client.0.smithi153.stderr: -301> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient(hunting): _renew_subs 2024-09-19T14:08:21.728 INFO:tasks.workunit.client.0.smithi153.stderr: -300> 2024-09-19T14:08:21.532+0000 7f1a0a8c49c0 10 monclient(hunting): authenticate will time out at 2689.999506s 2024-09-19T14:08:21.729 INFO:tasks.workunit.client.0.smithi153.stderr: -299> 2024-09-19T14:08:21.532+0000 7f1a083ca640 10 monclient(hunting): get_auth_request con 0x563af2aff1f0 auth_method 0 2024-09-19T14:08:21.729 INFO:tasks.workunit.client.0.smithi153.stderr: -298> 2024-09-19T14:08:21.532+0000 7f1a083ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:08:21.729 INFO:tasks.workunit.client.0.smithi153.stderr: -297> 2024-09-19T14:08:21.532+0000 7f1a083ca640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:08:21.729 INFO:tasks.workunit.client.0.smithi153.stderr: -296> 2024-09-19T14:08:21.532+0000 7f1a083ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:08:21.729 INFO:tasks.workunit.client.0.smithi153.stderr: -295> 2024-09-19T14:08:21.532+0000 7f1a08bcb640 10 monclient(hunting): get_auth_request con 0x563af2afa9c0 auth_method 0 2024-09-19T14:08:21.729 INFO:tasks.workunit.client.0.smithi153.stderr: -294> 2024-09-19T14:08:21.532+0000 7f1a08bcb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:08:21.729 INFO:tasks.workunit.client.0.smithi153.stderr: -293> 2024-09-19T14:08:21.532+0000 7f1a08bcb640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:08:21.729 INFO:tasks.workunit.client.0.smithi153.stderr: -292> 2024-09-19T14:08:21.532+0000 7f1a08bcb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:08:21.729 INFO:tasks.workunit.client.0.smithi153.stderr: -291> 2024-09-19T14:08:21.532+0000 7f1a08bcb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:08:21.729 INFO:tasks.workunit.client.0.smithi153.stderr: -290> 2024-09-19T14:08:21.532+0000 7f1a08bcb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:08:21.729 INFO:tasks.workunit.client.0.smithi153.stderr: -289> 2024-09-19T14:08:21.532+0000 7f1a08bcb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:08:21.729 INFO:tasks.workunit.client.0.smithi153.stderr: -288> 2024-09-19T14:08:21.532+0000 7f1a083ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:08:21.729 INFO:tasks.workunit.client.0.smithi153.stderr: -287> 2024-09-19T14:08:21.532+0000 7f1a083ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:08:21.729 INFO:tasks.workunit.client.0.smithi153.stderr: -286> 2024-09-19T14:08:21.532+0000 7f1a083ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:08:21.729 INFO:tasks.workunit.client.0.smithi153.stderr: -285> 2024-09-19T14:08:21.532+0000 7f1a07bc9640 10 monclient(hunting): get_auth_request con 0x563af2acec10 auth_method 0 2024-09-19T14:08:21.730 INFO:tasks.workunit.client.0.smithi153.stderr: -284> 2024-09-19T14:08:21.532+0000 7f1a07bc9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:08:21.730 INFO:tasks.workunit.client.0.smithi153.stderr: -283> 2024-09-19T14:08:21.532+0000 7f1a07bc9640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:08:21.730 INFO:tasks.workunit.client.0.smithi153.stderr: -282> 2024-09-19T14:08:21.532+0000 7f1a07bc9640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:08:21.730 INFO:tasks.workunit.client.0.smithi153.stderr: -281> 2024-09-19T14:08:21.532+0000 7f1a08bcb640 10 monclient(hunting): handle_auth_done global_id 7044 payload 274 2024-09-19T14:08:21.730 INFO:tasks.workunit.client.0.smithi153.stderr: -280> 2024-09-19T14:08:21.532+0000 7f1a08bcb640 10 monclient: _finish_hunting 0 2024-09-19T14:08:21.730 INFO:tasks.workunit.client.0.smithi153.stderr: -279> 2024-09-19T14:08:21.532+0000 7f1a08bcb640 1 monclient: found mon.noname-a 2024-09-19T14:08:21.730 INFO:tasks.workunit.client.0.smithi153.stderr: -278> 2024-09-19T14:08:21.532+0000 7f1a08bcb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:08:21.730 INFO:tasks.workunit.client.0.smithi153.stderr: -277> 2024-09-19T14:08:21.536+0000 7f18df7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:08:21.730 INFO:tasks.workunit.client.0.smithi153.stderr: -276> 2024-09-19T14:08:21.536+0000 7f18df7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:08:21.730 INFO:tasks.workunit.client.0.smithi153.stderr: -275> 2024-09-19T14:08:21.536+0000 7f18df7fe640 10 monclient: dump: 2024-09-19T14:08:21.730 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:08:21.730 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:08:21.730 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.730 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.731 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:08:21.731 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:08:21.731 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:08:21.731 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:08:21.731 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:08:21.731 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.731 INFO:tasks.workunit.client.0.smithi153.stderr: -274> 2024-09-19T14:08:21.536+0000 7f18df7fe640 10 monclient: _finish_auth 0 2024-09-19T14:08:21.731 INFO:tasks.workunit.client.0.smithi153.stderr: -273> 2024-09-19T14:08:21.536+0000 7f18df7fe640 10 monclient: _check_auth_tickets 2024-09-19T14:08:21.731 INFO:tasks.workunit.client.0.smithi153.stderr: -272> 2024-09-19T14:08:21.536+0000 7f18df7fe640 10 monclient: handle_config config(0 keys) 2024-09-19T14:08:21.731 INFO:tasks.workunit.client.0.smithi153.stderr: -271> 2024-09-19T14:08:21.536+0000 7f18df7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:08:21.731 INFO:tasks.workunit.client.0.smithi153.stderr: -270> 2024-09-19T14:08:21.536+0000 7f18df7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:08:21.731 INFO:tasks.workunit.client.0.smithi153.stderr: -269> 2024-09-19T14:08:21.536+0000 7f18df7fe640 10 monclient: dump: 2024-09-19T14:08:21.731 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:08:21.731 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:08:21.732 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.732 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.732 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:08:21.732 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:08:21.732 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:08:21.732 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:08:21.732 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:08:21.732 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.732 INFO:tasks.workunit.client.0.smithi153.stderr: -268> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 monclient: authenticate success, global_id 7044 2024-09-19T14:08:21.732 INFO:tasks.workunit.client.0.smithi153.stderr: -267> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient: get_monmap_and_config success 2024-09-19T14:08:21.732 INFO:tasks.workunit.client.0.smithi153.stderr: -266> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 4 set_mon_vals no callback set 2024-09-19T14:08:21.732 INFO:tasks.workunit.client.0.smithi153.stderr: -265> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient: shutdown 2024-09-19T14:08:21.732 INFO:tasks.workunit.client.0.smithi153.stderr: -264> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient: build_initial_monmap 2024-09-19T14:08:21.732 INFO:tasks.workunit.client.0.smithi153.stderr: -263> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 1 build_initial for_mkfs: 0 2024-09-19T14:08:21.733 INFO:tasks.workunit.client.0.smithi153.stderr: -262> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient: monmap: 2024-09-19T14:08:21.733 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:08:21.733 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:08:21.733 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:08:21.733 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:08:21.733 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:08:21.733 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:08:21.733 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:08:21.733 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:08:21.733 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:08:21.733 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.733 INFO:tasks.workunit.client.0.smithi153.stderr: -261> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding auth protocol: cephx 2024-09-19T14:08:21.733 INFO:tasks.workunit.client.0.smithi153.stderr: -260> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding auth protocol: cephx 2024-09-19T14:08:21.733 INFO:tasks.workunit.client.0.smithi153.stderr: -259> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding auth protocol: cephx 2024-09-19T14:08:21.733 INFO:tasks.workunit.client.0.smithi153.stderr: -258> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding con mode: secure 2024-09-19T14:08:21.734 INFO:tasks.workunit.client.0.smithi153.stderr: -257> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding con mode: crc 2024-09-19T14:08:21.734 INFO:tasks.workunit.client.0.smithi153.stderr: -256> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding con mode: secure 2024-09-19T14:08:21.734 INFO:tasks.workunit.client.0.smithi153.stderr: -255> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding con mode: crc 2024-09-19T14:08:21.734 INFO:tasks.workunit.client.0.smithi153.stderr: -254> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding con mode: secure 2024-09-19T14:08:21.734 INFO:tasks.workunit.client.0.smithi153.stderr: -253> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding con mode: crc 2024-09-19T14:08:21.734 INFO:tasks.workunit.client.0.smithi153.stderr: -252> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding con mode: crc 2024-09-19T14:08:21.734 INFO:tasks.workunit.client.0.smithi153.stderr: -251> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding con mode: secure 2024-09-19T14:08:21.734 INFO:tasks.workunit.client.0.smithi153.stderr: -250> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding con mode: crc 2024-09-19T14:08:21.734 INFO:tasks.workunit.client.0.smithi153.stderr: -249> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding con mode: secure 2024-09-19T14:08:21.734 INFO:tasks.workunit.client.0.smithi153.stderr: -248> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding con mode: crc 2024-09-19T14:08:21.734 INFO:tasks.workunit.client.0.smithi153.stderr: -247> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2af14d0) adding con mode: secure 2024-09-19T14:08:21.734 INFO:tasks.workunit.client.0.smithi153.stderr: -246> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:08:21.734 INFO:tasks.workunit.client.0.smithi153.stderr: -245> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 1 librados: starting msgr at 2024-09-19T14:08:21.735 INFO:tasks.workunit.client.0.smithi153.stderr: -244> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 1 librados: starting objecter 2024-09-19T14:08:21.735 INFO:tasks.workunit.client.0.smithi153.stderr: -243> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command objecter_requests cmddesc objecter_requests hook 0x563af2ad03b0 EEXIST 2024-09-19T14:08:21.735 INFO:tasks.workunit.client.0.smithi153.stderr: -242> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 1 librados: setting wanted keys 2024-09-19T14:08:21.735 INFO:tasks.workunit.client.0.smithi153.stderr: -241> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 1 librados: calling monclient init 2024-09-19T14:08:21.735 INFO:tasks.workunit.client.0.smithi153.stderr: -240> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient: init 2024-09-19T14:08:21.735 INFO:tasks.workunit.client.0.smithi153.stderr: -239> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding auth protocol: cephx 2024-09-19T14:08:21.735 INFO:tasks.workunit.client.0.smithi153.stderr: -238> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding auth protocol: cephx 2024-09-19T14:08:21.735 INFO:tasks.workunit.client.0.smithi153.stderr: -237> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding auth protocol: cephx 2024-09-19T14:08:21.735 INFO:tasks.workunit.client.0.smithi153.stderr: -236> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding con mode: secure 2024-09-19T14:08:21.735 INFO:tasks.workunit.client.0.smithi153.stderr: -235> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding con mode: crc 2024-09-19T14:08:21.735 INFO:tasks.workunit.client.0.smithi153.stderr: -234> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding con mode: secure 2024-09-19T14:08:21.735 INFO:tasks.workunit.client.0.smithi153.stderr: -233> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding con mode: crc 2024-09-19T14:08:21.735 INFO:tasks.workunit.client.0.smithi153.stderr: -232> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding con mode: secure 2024-09-19T14:08:21.735 INFO:tasks.workunit.client.0.smithi153.stderr: -231> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding con mode: crc 2024-09-19T14:08:21.736 INFO:tasks.workunit.client.0.smithi153.stderr: -230> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding con mode: crc 2024-09-19T14:08:21.736 INFO:tasks.workunit.client.0.smithi153.stderr: -229> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding con mode: secure 2024-09-19T14:08:21.736 INFO:tasks.workunit.client.0.smithi153.stderr: -228> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding con mode: crc 2024-09-19T14:08:21.736 INFO:tasks.workunit.client.0.smithi153.stderr: -227> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding con mode: secure 2024-09-19T14:08:21.736 INFO:tasks.workunit.client.0.smithi153.stderr: -226> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding con mode: crc 2024-09-19T14:08:21.736 INFO:tasks.workunit.client.0.smithi153.stderr: -225> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 AuthRegistry(0x563af2aad2a0) adding con mode: secure 2024-09-19T14:08:21.736 INFO:tasks.workunit.client.0.smithi153.stderr: -224> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:08:21.736 INFO:tasks.workunit.client.0.smithi153.stderr: -223> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:08:21.736 INFO:tasks.workunit.client.0.smithi153.stderr: -222> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command rotate-key cmddesc rotate-key hook 0x563af2aad3e8 EEXIST 2024-09-19T14:08:21.736 INFO:tasks.workunit.client.0.smithi153.stderr: -221> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient: _reopen_session rank -1 2024-09-19T14:08:21.736 INFO:tasks.workunit.client.0.smithi153.stderr: -220> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T14:08:21.736 INFO:tasks.workunit.client.0.smithi153.stderr: -219> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient(hunting): picked mon.noname-c con 0x563af2acec10 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:08:21.736 INFO:tasks.workunit.client.0.smithi153.stderr: -218> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient(hunting): picked mon.noname-b con 0x563af2afa9c0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:08:21.736 INFO:tasks.workunit.client.0.smithi153.stderr: -217> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient(hunting): picked mon.noname-a con 0x563af2aff1f0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:08:21.736 INFO:tasks.workunit.client.0.smithi153.stderr: -216> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:08:21.737 INFO:tasks.workunit.client.0.smithi153.stderr: -215> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:08:21.737 INFO:tasks.workunit.client.0.smithi153.stderr: -214> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:08:21.737 INFO:tasks.workunit.client.0.smithi153.stderr: -213> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient(hunting): _renew_subs 2024-09-19T14:08:21.737 INFO:tasks.workunit.client.0.smithi153.stderr: -212> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient(hunting): authenticate will time out at 2690.002117s 2024-09-19T14:08:21.737 INFO:tasks.workunit.client.0.smithi153.stderr: -211> 2024-09-19T14:08:21.536+0000 7f1a083ca640 10 monclient(hunting): get_auth_request con 0x563af2acec10 auth_method 0 2024-09-19T14:08:21.737 INFO:tasks.workunit.client.0.smithi153.stderr: -210> 2024-09-19T14:08:21.536+0000 7f1a083ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:08:21.737 INFO:tasks.workunit.client.0.smithi153.stderr: -209> 2024-09-19T14:08:21.536+0000 7f1a083ca640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:08:21.737 INFO:tasks.workunit.client.0.smithi153.stderr: -208> 2024-09-19T14:08:21.536+0000 7f1a083ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:08:21.737 INFO:tasks.workunit.client.0.smithi153.stderr: -207> 2024-09-19T14:08:21.536+0000 7f1a083ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:08:21.737 INFO:tasks.workunit.client.0.smithi153.stderr: -206> 2024-09-19T14:08:21.536+0000 7f1a083ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:08:21.737 INFO:tasks.workunit.client.0.smithi153.stderr: -205> 2024-09-19T14:08:21.536+0000 7f1a083ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:08:21.737 INFO:tasks.workunit.client.0.smithi153.stderr: -204> 2024-09-19T14:08:21.536+0000 7f1a08bcb640 10 monclient(hunting): get_auth_request con 0x563af2aff1f0 auth_method 0 2024-09-19T14:08:21.737 INFO:tasks.workunit.client.0.smithi153.stderr: -203> 2024-09-19T14:08:21.536+0000 7f1a08bcb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:08:21.738 INFO:tasks.workunit.client.0.smithi153.stderr: -202> 2024-09-19T14:08:21.536+0000 7f1a08bcb640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:08:21.738 INFO:tasks.workunit.client.0.smithi153.stderr: -201> 2024-09-19T14:08:21.536+0000 7f1a08bcb640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:08:21.738 INFO:tasks.workunit.client.0.smithi153.stderr: -200> 2024-09-19T14:08:21.536+0000 7f1a08bcb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:08:21.738 INFO:tasks.workunit.client.0.smithi153.stderr: -199> 2024-09-19T14:08:21.536+0000 7f1a08bcb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:08:21.738 INFO:tasks.workunit.client.0.smithi153.stderr: -198> 2024-09-19T14:08:21.536+0000 7f1a08bcb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:08:21.738 INFO:tasks.workunit.client.0.smithi153.stderr: -197> 2024-09-19T14:08:21.536+0000 7f1a083ca640 10 monclient(hunting): handle_auth_done global_id 6620 payload 824 2024-09-19T14:08:21.738 INFO:tasks.workunit.client.0.smithi153.stderr: -196> 2024-09-19T14:08:21.536+0000 7f1a083ca640 10 monclient: _finish_hunting 0 2024-09-19T14:08:21.738 INFO:tasks.workunit.client.0.smithi153.stderr: -195> 2024-09-19T14:08:21.536+0000 7f1a083ca640 1 monclient: found mon.noname-c 2024-09-19T14:08:21.738 INFO:tasks.workunit.client.0.smithi153.stderr: -194> 2024-09-19T14:08:21.536+0000 7f1a083ca640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:08:21.738 INFO:tasks.workunit.client.0.smithi153.stderr: -193> 2024-09-19T14:08:21.536+0000 7f1a07bc9640 10 monclient: get_auth_request con 0x563af2afa9c0 auth_method 0 2024-09-19T14:08:21.738 INFO:tasks.workunit.client.0.smithi153.stderr: -192> 2024-09-19T14:08:21.536+0000 7f18ddffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:08:21.738 INFO:tasks.workunit.client.0.smithi153.stderr: -191> 2024-09-19T14:08:21.536+0000 7f18ddffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:08:21.738 INFO:tasks.workunit.client.0.smithi153.stderr: -190> 2024-09-19T14:08:21.536+0000 7f18ddffb640 10 monclient: dump: 2024-09-19T14:08:21.738 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:08:21.739 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:08:21.739 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.739 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.739 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:08:21.739 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:08:21.739 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:08:21.739 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:08:21.739 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:08:21.739 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.739 INFO:tasks.workunit.client.0.smithi153.stderr: -189> 2024-09-19T14:08:21.536+0000 7f18ddffb640 10 monclient: _finish_auth 0 2024-09-19T14:08:21.739 INFO:tasks.workunit.client.0.smithi153.stderr: -188> 2024-09-19T14:08:21.536+0000 7f18ddffb640 10 monclient: _check_auth_tickets 2024-09-19T14:08:21.739 INFO:tasks.workunit.client.0.smithi153.stderr: -187> 2024-09-19T14:08:21.536+0000 7f18ddffb640 10 monclient: handle_config config(0 keys) 2024-09-19T14:08:21.739 INFO:tasks.workunit.client.0.smithi153.stderr: -186> 2024-09-19T14:08:21.536+0000 7f18ddffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:08:21.740 INFO:tasks.workunit.client.0.smithi153.stderr: -185> 2024-09-19T14:08:21.536+0000 7f18ddffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:08:21.740 INFO:tasks.workunit.client.0.smithi153.stderr: -184> 2024-09-19T14:08:21.536+0000 7f18ddffb640 10 monclient: dump: 2024-09-19T14:08:21.740 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:08:21.740 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:08:21.740 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.740 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:08:21.740 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:08:21.740 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:08:21.740 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:08:21.740 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:08:21.740 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:08:21.740 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.740 INFO:tasks.workunit.client.0.smithi153.stderr: -183> 2024-09-19T14:08:21.536+0000 7f18df7fe640 4 set_mon_vals no callback set 2024-09-19T14:08:21.740 INFO:tasks.workunit.client.0.smithi153.stderr: -182> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 monclient: authenticate success, global_id 6620 2024-09-19T14:08:21.741 INFO:tasks.workunit.client.0.smithi153.stderr: -181> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient: _renew_subs 2024-09-19T14:08:21.741 INFO:tasks.workunit.client.0.smithi153.stderr: -180> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:08:21.741 INFO:tasks.workunit.client.0.smithi153.stderr: -179> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient: _renew_subs 2024-09-19T14:08:21.741 INFO:tasks.workunit.client.0.smithi153.stderr: -178> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:08:21.741 INFO:tasks.workunit.client.0.smithi153.stderr: -177> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 1 librados: init done 2024-09-19T14:08:21.741 INFO:tasks.workunit.client.0.smithi153.stderr: -176> 2024-09-19T14:08:21.536+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command cr dump hook 0x7f1a00001578 2024-09-19T14:08:21.741 INFO:tasks.workunit.client.0.smithi153.stderr: -175> 2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.741 INFO:tasks.workunit.client.0.smithi153.stderr: -174> 2024-09-19T14:08:21.540+0000 7f18ddffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:08:21.741 INFO:tasks.workunit.client.0.smithi153.stderr: -173> 2024-09-19T14:08:21.540+0000 7f18ddffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:08:21.741 INFO:tasks.workunit.client.0.smithi153.stderr: -172> 2024-09-19T14:08:21.540+0000 7f18ddffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:08:21.741 INFO:tasks.workunit.client.0.smithi153.stderr: -171> 2024-09-19T14:08:21.540+0000 7f1a07bc9640 10 monclient: get_auth_request con 0x7f18d0071c10 auth_method 0 2024-09-19T14:08:21.741 INFO:tasks.workunit.client.0.smithi153.stderr: -170> 2024-09-19T14:08:21.540+0000 7f1a08bcb640 10 monclient: get_auth_request con 0x563af2b18c70 auth_method 0 2024-09-19T14:08:21.741 INFO:tasks.workunit.client.0.smithi153.stderr: -169> 2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.742 INFO:tasks.workunit.client.0.smithi153.stderr: -168> 2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 20 realm 2024-09-19T14:08:21.742 INFO:tasks.workunit.client.0.smithi153.stderr: -167> 2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.742 INFO:tasks.workunit.client.0.smithi153.stderr: -166> 2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.742 INFO:tasks.workunit.client.0.smithi153.stderr: -165> 2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:08:21.742 INFO:tasks.workunit.client.0.smithi153.stderr: -164> 2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.742 INFO:tasks.workunit.client.0.smithi153.stderr: -163> 2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.742 INFO:tasks.workunit.client.0.smithi153.stderr: -162> 2024-09-19T14:08:21.540+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.742 INFO:tasks.workunit.client.0.smithi153.stderr: -161> 2024-09-19T14:08:21.540+0000 7f1a083ca640 10 monclient: get_auth_request con 0x563af2b1ce90 auth_method 0 2024-09-19T14:08:21.742 INFO:tasks.workunit.client.0.smithi153.stderr: -160> 2024-09-19T14:08:21.544+0000 7f1a0a8c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:21.742 INFO:tasks.workunit.client.0.smithi153.stderr: -159> 2024-09-19T14:08:21.544+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.742 INFO:tasks.workunit.client.0.smithi153.stderr: -158> 2024-09-19T14:08:21.544+0000 7f1a0a8c49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:08:21.742 INFO:tasks.workunit.client.0.smithi153.stderr: -157> 2024-09-19T14:08:21.544+0000 7f1a0a8c49c0 20 searching for the correct realm 2024-09-19T14:08:21.742 INFO:tasks.workunit.client.0.smithi153.stderr: -156> 2024-09-19T14:08:21.544+0000 7f1a07bc9640 10 monclient: get_auth_request con 0x563af2b21d50 auth_method 0 2024-09-19T14:08:21.743 INFO:tasks.workunit.client.0.smithi153.stderr: -155> 2024-09-19T14:08:21.544+0000 7f1a08bcb640 10 monclient: get_auth_request con 0x7f19fc018020 auth_method 0 2024-09-19T14:08:21.743 INFO:tasks.workunit.client.0.smithi153.stderr: -154> 2024-09-19T14:08:21.548+0000 7f1a083ca640 10 monclient: get_auth_request con 0x7f1a00078be0 auth_method 0 2024-09-19T14:08:21.743 INFO:tasks.workunit.client.0.smithi153.stderr: -153> 2024-09-19T14:08:21.548+0000 7f1a07bc9640 10 monclient: get_auth_request con 0x7f19f80e8060 auth_method 0 2024-09-19T14:08:21.743 INFO:tasks.workunit.client.0.smithi153.stderr: -152> 2024-09-19T14:08:21.548+0000 7f1a08bcb640 0 -- 172.21.15.153:0/824375401 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x563af2b18c70 msgr2=0x563af2b1b0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:08:21.743 INFO:tasks.workunit.client.0.smithi153.stderr: -151> 2024-09-19T14:08:21.548+0000 7f18ddffb640 1 client.6620.objecter ms_handle_reset 0x563af2b18c70 session 0x563af2ace1e0 osd.1 2024-09-19T14:08:21.743 INFO:tasks.workunit.client.0.smithi153.stderr: -150> 2024-09-19T14:08:21.548+0000 7f18ddffb640 10 monclient: _renew_subs 2024-09-19T14:08:21.743 INFO:tasks.workunit.client.0.smithi153.stderr: -149> 2024-09-19T14:08:21.548+0000 7f18ddffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:08:21.743 INFO:tasks.workunit.client.0.smithi153.stderr: -148> 2024-09-19T14:08:21.548+0000 7f1a08bcb640 10 monclient: get_auth_request con 0x7f18d0082340 auth_method 0 2024-09-19T14:08:21.743 INFO:tasks.workunit.client.0.smithi153.stderr: -147> 2024-09-19T14:08:21.552+0000 7f1a08bcb640 10 monclient: get_auth_request con 0x7f19fc04b130 auth_method 0 2024-09-19T14:08:21.743 INFO:tasks.workunit.client.0.smithi153.stderr: -146> 2024-09-19T14:08:21.556+0000 7f1a083ca640 10 monclient: get_auth_request con 0x7f19fc067940 auth_method 0 2024-09-19T14:08:21.743 INFO:tasks.workunit.client.0.smithi153.stderr: -145> 2024-09-19T14:08:21.556+0000 7f1a083ca640 0 -- 172.21.15.153:0/824375401 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f19fc067940 msgr2=0x7f19fc062110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:21.743 INFO:tasks.workunit.client.0.smithi153.stderr: -144> 2024-09-19T14:08:21.556+0000 7f18ddffb640 1 client.6620.objecter ms_handle_reset 0x7f19fc067940 session 0x7f19fc091930 osd.0 2024-09-19T14:08:21.743 INFO:tasks.workunit.client.0.smithi153.stderr: -143> 2024-09-19T14:08:21.556+0000 7f1a083ca640 10 monclient: get_auth_request con 0x563af2b18c70 auth_method 0 2024-09-19T14:08:21.743 INFO:tasks.workunit.client.0.smithi153.stderr: -142> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:08:21.744 INFO:tasks.workunit.client.0.smithi153.stderr: -141> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:08:21.744 INFO:tasks.workunit.client.0.smithi153.stderr: -140> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:08:21.744 INFO:tasks.workunit.client.0.smithi153.stderr: -139> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:08:21.744 INFO:tasks.workunit.client.0.smithi153.stderr: -138> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:08:21.744 INFO:tasks.workunit.client.0.smithi153.stderr: -137> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:08:21.744 INFO:tasks.workunit.client.0.smithi153.stderr: -136> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.744 INFO:tasks.workunit.client.0.smithi153.stderr: -135> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.744 INFO:tasks.workunit.client.0.smithi153.stderr: -134> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.744 INFO:tasks.workunit.client.0.smithi153.stderr: -133> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:21.744 INFO:tasks.workunit.client.0.smithi153.stderr: -132> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.744 INFO:tasks.workunit.client.0.smithi153.stderr: -131> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:08:21.744 INFO:tasks.workunit.client.0.smithi153.stderr: -130> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 zone default found 2024-09-19T14:08:21.744 INFO:tasks.workunit.client.0.smithi153.stderr: -129> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 4 Realm: () 2024-09-19T14:08:21.745 INFO:tasks.workunit.client.0.smithi153.stderr: -128> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:08:21.745 INFO:tasks.workunit.client.0.smithi153.stderr: -127> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:08:21.745 INFO:tasks.workunit.client.0.smithi153.stderr: -126> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:08:21.745 INFO:tasks.workunit.client.0.smithi153.stderr: -125> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 zonegroup default 2024-09-19T14:08:21.745 INFO:tasks.workunit.client.0.smithi153.stderr: -124> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.745 INFO:tasks.workunit.client.0.smithi153.stderr: -123> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.745 INFO:tasks.workunit.client.0.smithi153.stderr: -122> 2024-09-19T14:08:21.564+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.745 INFO:tasks.workunit.client.0.smithi153.stderr: -121> 2024-09-19T14:08:21.568+0000 7f1a0a8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.745 INFO:tasks.workunit.client.0.smithi153.stderr: -120> 2024-09-19T14:08:21.568+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.745 INFO:tasks.workunit.client.0.smithi153.stderr: -119> 2024-09-19T14:08:21.568+0000 7f1a0a8c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.745 INFO:tasks.workunit.client.0.smithi153.stderr: -118> 2024-09-19T14:08:21.568+0000 7f1a0a8c49c0 20 started sync module instance, tier type = 2024-09-19T14:08:21.745 INFO:tasks.workunit.client.0.smithi153.stderr: -117> 2024-09-19T14:08:21.568+0000 7f1a0a8c49c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:08:21.745 INFO:tasks.workunit.client.0.smithi153.stderr: -116> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 20 add_watcher() i=0 2024-09-19T14:08:21.745 INFO:tasks.workunit.client.0.smithi153.stderr: -115> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 20 add_watcher() i=1 2024-09-19T14:08:21.746 INFO:tasks.workunit.client.0.smithi153.stderr: -114> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 20 add_watcher() i=2 2024-09-19T14:08:21.746 INFO:tasks.workunit.client.0.smithi153.stderr: -113> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 20 add_watcher() i=3 2024-09-19T14:08:21.746 INFO:tasks.workunit.client.0.smithi153.stderr: -112> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 20 add_watcher() i=4 2024-09-19T14:08:21.746 INFO:tasks.workunit.client.0.smithi153.stderr: -111> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 20 add_watcher() i=5 2024-09-19T14:08:21.746 INFO:tasks.workunit.client.0.smithi153.stderr: -110> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 20 add_watcher() i=6 2024-09-19T14:08:21.746 INFO:tasks.workunit.client.0.smithi153.stderr: -109> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 20 add_watcher() i=7 2024-09-19T14:08:21.746 INFO:tasks.workunit.client.0.smithi153.stderr: -108> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:08:21.746 INFO:tasks.workunit.client.0.smithi153.stderr: -107> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding auth protocol: cephx 2024-09-19T14:08:21.746 INFO:tasks.workunit.client.0.smithi153.stderr: -106> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding auth protocol: cephx 2024-09-19T14:08:21.746 INFO:tasks.workunit.client.0.smithi153.stderr: -105> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding auth protocol: cephx 2024-09-19T14:08:21.746 INFO:tasks.workunit.client.0.smithi153.stderr: -104> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding con mode: secure 2024-09-19T14:08:21.746 INFO:tasks.workunit.client.0.smithi153.stderr: -103> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding con mode: crc 2024-09-19T14:08:21.746 INFO:tasks.workunit.client.0.smithi153.stderr: -102> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding con mode: secure 2024-09-19T14:08:21.746 INFO:tasks.workunit.client.0.smithi153.stderr: -101> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding con mode: crc 2024-09-19T14:08:21.747 INFO:tasks.workunit.client.0.smithi153.stderr: -100> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding con mode: secure 2024-09-19T14:08:21.747 INFO:tasks.workunit.client.0.smithi153.stderr: -99> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding con mode: crc 2024-09-19T14:08:21.747 INFO:tasks.workunit.client.0.smithi153.stderr: -98> 2024-09-19T14:08:21.584+0000 7f18bf7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:21.747 INFO:tasks.workunit.client.0.smithi153.stderr: -97> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding con mode: crc 2024-09-19T14:08:21.747 INFO:tasks.workunit.client.0.smithi153.stderr: -96> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding con mode: secure 2024-09-19T14:08:21.747 INFO:tasks.workunit.client.0.smithi153.stderr: -95> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding con mode: crc 2024-09-19T14:08:21.747 INFO:tasks.workunit.client.0.smithi153.stderr: -94> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding con mode: secure 2024-09-19T14:08:21.747 INFO:tasks.workunit.client.0.smithi153.stderr: -93> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding con mode: crc 2024-09-19T14:08:21.747 INFO:tasks.workunit.client.0.smithi153.stderr: -92> 2024-09-19T14:08:21.584+0000 7f1a0a8c49c0 5 AuthRegistry(0x7ffc83c0c2f0) adding con mode: secure 2024-09-19T14:08:21.747 INFO:tasks.workunit.client.0.smithi153.stderr: -91> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:08:21.747 INFO:tasks.workunit.client.0.smithi153.stderr: -90> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:08:21.747 INFO:tasks.workunit.client.0.smithi153.stderr: -89> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:08:21.747 INFO:tasks.workunit.client.0.smithi153.stderr: -88> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command cache list hook 0x563af2af7fa0 2024-09-19T14:08:21.747 INFO:tasks.workunit.client.0.smithi153.stderr: -87> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command cache inspect hook 0x563af2af7fa0 2024-09-19T14:08:21.748 INFO:tasks.workunit.client.0.smithi153.stderr: -86> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command cache erase hook 0x563af2af7fa0 2024-09-19T14:08:21.748 INFO:tasks.workunit.client.0.smithi153.stderr: -85> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command cache zap hook 0x563af2af7fa0 2024-09-19T14:08:21.748 INFO:tasks.workunit.client.0.smithi153.stderr: -84> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 5 note: GC not initialized 2024-09-19T14:08:21.748 INFO:tasks.workunit.client.0.smithi153.stderr: -83> 2024-09-19T14:08:21.588+0000 7f18be7dc640 20 reqs_thread_entry: start 2024-09-19T14:08:21.748 INFO:tasks.workunit.client.0.smithi153.stderr: -82> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command sync trace show hook 0x7f19f80aa4b0 2024-09-19T14:08:21.748 INFO:tasks.workunit.client.0.smithi153.stderr: -81> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command sync trace history hook 0x7f19f80aa4b0 2024-09-19T14:08:21.748 INFO:tasks.workunit.client.0.smithi153.stderr: -80> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command sync trace active hook 0x7f19f80aa4b0 2024-09-19T14:08:21.748 INFO:tasks.workunit.client.0.smithi153.stderr: -79> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 5 asok(0x563af2823d90) register_command sync trace active_short hook 0x7f19f80aa4b0 2024-09-19T14:08:21.748 INFO:tasks.workunit.client.0.smithi153.stderr: -78> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 20 init_complete bucket index max shards: 11 2024-09-19T14:08:21.748 INFO:tasks.workunit.client.0.smithi153.stderr: -77> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 20 Filter name: none 2024-09-19T14:08:21.748 INFO:tasks.workunit.client.0.smithi153.stderr: -76> 2024-09-19T14:08:21.588+0000 7f18b77fe640 20 reqs_thread_entry: start 2024-09-19T14:08:21.748 INFO:tasks.workunit.client.0.smithi153.stderr: -75> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-19T14:08:21.748 INFO:tasks.workunit.client.0.smithi153.stderr: -74> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.748 INFO:tasks.workunit.client.0.smithi153.stderr: -73> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-19T14:08:21.749 INFO:tasks.workunit.client.0.smithi153.stderr: -72> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-19T14:08:21.749 INFO:tasks.workunit.client.0.smithi153.stderr: -71> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-19T14:08:21.749 INFO:tasks.workunit.client.0.smithi153.stderr: -70> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 : miss 2024-09-19T14:08:21.749 INFO:tasks.workunit.client.0.smithi153.stderr: -69> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.749 INFO:tasks.workunit.client.0.smithi153.stderr: -68> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-19T14:08:21.749 INFO:tasks.workunit.client.0.smithi153.stderr: -67> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 info.flags=0x17 2024-09-19T14:08:21.749 INFO:tasks.workunit.client.0.smithi153.stderr: -66> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 to cache LRU end 2024-09-19T14:08:21.749 INFO:tasks.workunit.client.0.smithi153.stderr: -65> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:08:21.749 INFO:tasks.workunit.client.0.smithi153.stderr: -64> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:21.749 INFO:tasks.workunit.client.0.smithi153.stderr: -63> 2024-09-19T14:08:21.588+0000 7f1a0a8c49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 2024-09-19T14:08:21.749 INFO:tasks.workunit.client.0.smithi153.stderr: -62> 2024-09-19T14:08:21.600+0000 7f1a0a8c49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 info.flags=0x17 2024-09-19T14:08:21.749 INFO:tasks.workunit.client.0.smithi153.stderr: -61> 2024-09-19T14:08:21.600+0000 7f1a0a8c49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 to cache LRU end 2024-09-19T14:08:21.750 INFO:tasks.workunit.client.0.smithi153.stderr: -60> 2024-09-19T14:08:21.600+0000 7f1a0a8c49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:21.750 INFO:tasks.workunit.client.0.smithi153.stderr: -59> 2024-09-19T14:08:21.600+0000 7f1a0a8c49c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29, ofs0, ns] 2024-09-19T14:08:21.750 INFO:tasks.workunit.client.0.smithi153.stderr: -58> 2024-09-19T14:08:21.600+0000 7f18deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333527 cookie 94811179866944 notifier 6620 bl.length()=915 2024-09-19T14:08:21.750 INFO:tasks.workunit.client.0.smithi153.stderr: -57> 2024-09-19T14:08:21.600+0000 7f18deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 info.flags=0x17 2024-09-19T14:08:21.750 INFO:tasks.workunit.client.0.smithi153.stderr: -56> 2024-09-19T14:08:21.600+0000 7f18deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 to cache LRU end 2024-09-19T14:08:21.750 INFO:tasks.workunit.client.0.smithi153.stderr: -55> 2024-09-19T14:08:21.600+0000 7f18deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:21.750 INFO:tasks.workunit.client.0.smithi153.stderr: -54> 2024-09-19T14:08:21.604+0000 7f1a0a8c49c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): orig_sources= new_sources= 2024-09-19T14:08:21.750 INFO:tasks.workunit.client.0.smithi153.stderr: -53> 2024-09-19T14:08:21.604+0000 7f1a0a8c49c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): potential sources added=[] removed=[] 2024-09-19T14:08:21.750 INFO:tasks.workunit.client.0.smithi153.stderr: -52> 2024-09-19T14:08:21.604+0000 7f1a0a8c49c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): orig_dests= new_dests= 2024-09-19T14:08:21.750 INFO:tasks.workunit.client.0.smithi153.stderr: -51> 2024-09-19T14:08:21.604+0000 7f1a0a8c49c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): potential dests added=[] removed=[] 2024-09-19T14:08:21.750 INFO:tasks.workunit.client.0.smithi153.stderr: -50> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.0 2024-09-19T14:08:21.750 INFO:tasks.workunit.client.0.smithi153.stderr: -49> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.0 2024-09-19T14:08:21.750 INFO:tasks.workunit.client.0.smithi153.stderr: -48> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.1 2024-09-19T14:08:21.750 INFO:tasks.workunit.client.0.smithi153.stderr: -47> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.1 2024-09-19T14:08:21.751 INFO:tasks.workunit.client.0.smithi153.stderr: -46> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.2 2024-09-19T14:08:21.751 INFO:tasks.workunit.client.0.smithi153.stderr: -45> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.2 2024-09-19T14:08:21.751 INFO:tasks.workunit.client.0.smithi153.stderr: -44> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.3 2024-09-19T14:08:21.751 INFO:tasks.workunit.client.0.smithi153.stderr: -43> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.3 2024-09-19T14:08:21.751 INFO:tasks.workunit.client.0.smithi153.stderr: -42> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.4 2024-09-19T14:08:21.751 INFO:tasks.workunit.client.0.smithi153.stderr: -41> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.4 2024-09-19T14:08:21.751 INFO:tasks.workunit.client.0.smithi153.stderr: -40> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.5 2024-09-19T14:08:21.751 INFO:tasks.workunit.client.0.smithi153.stderr: -39> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.5 2024-09-19T14:08:21.751 INFO:tasks.workunit.client.0.smithi153.stderr: -38> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.6 2024-09-19T14:08:21.751 INFO:tasks.workunit.client.0.smithi153.stderr: -37> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.6 2024-09-19T14:08:21.751 INFO:tasks.workunit.client.0.smithi153.stderr: -36> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.7 2024-09-19T14:08:21.751 INFO:tasks.workunit.client.0.smithi153.stderr: -35> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.7 2024-09-19T14:08:21.751 INFO:tasks.workunit.client.0.smithi153.stderr: -34> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.8 2024-09-19T14:08:21.752 INFO:tasks.workunit.client.0.smithi153.stderr: -33> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.8 2024-09-19T14:08:21.752 INFO:tasks.workunit.client.0.smithi153.stderr: -32> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.9 2024-09-19T14:08:21.752 INFO:tasks.workunit.client.0.smithi153.stderr: -31> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.9 2024-09-19T14:08:21.752 INFO:tasks.workunit.client.0.smithi153.stderr: -30> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.10 2024-09-19T14:08:21.752 INFO:tasks.workunit.client.0.smithi153.stderr: -29> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.10 2024-09-19T14:08:21.752 INFO:tasks.workunit.client.0.smithi153.stderr: -28> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.11 2024-09-19T14:08:21.752 INFO:tasks.workunit.client.0.smithi153.stderr: -27> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1.11 2024-09-19T14:08:21.752 INFO:tasks.workunit.client.0.smithi153.stderr: -26> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.0 2024-09-19T14:08:21.752 INFO:tasks.workunit.client.0.smithi153.stderr: -25> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1 2024-09-19T14:08:21.752 INFO:tasks.workunit.client.0.smithi153.stderr: -24> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2 2024-09-19T14:08:21.752 INFO:tasks.workunit.client.0.smithi153.stderr: -23> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.3 2024-09-19T14:08:21.752 INFO:tasks.workunit.client.0.smithi153.stderr: -22> 2024-09-19T14:08:21.612+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.4 2024-09-19T14:08:21.752 INFO:tasks.workunit.client.0.smithi153.stderr: -21> 2024-09-19T14:08:21.616+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.5 2024-09-19T14:08:21.752 INFO:tasks.workunit.client.0.smithi153.stderr: -20> 2024-09-19T14:08:21.616+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.6 2024-09-19T14:08:21.753 INFO:tasks.workunit.client.0.smithi153.stderr: -19> 2024-09-19T14:08:21.616+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.7 2024-09-19T14:08:21.753 INFO:tasks.workunit.client.0.smithi153.stderr: -18> 2024-09-19T14:08:21.616+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.8 2024-09-19T14:08:21.753 INFO:tasks.workunit.client.0.smithi153.stderr: -17> 2024-09-19T14:08:21.620+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.9 2024-09-19T14:08:21.753 INFO:tasks.workunit.client.0.smithi153.stderr: -16> 2024-09-19T14:08:21.620+0000 7f1a0a8c49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.10 2024-09-19T14:08:21.753 INFO:tasks.workunit.client.0.smithi153.stderr: -15> 2024-09-19T14:08:21.624+0000 7f1a0a8c49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 : hit (requested=0x17, cached=0x17) 2024-09-19T14:08:21.753 INFO:tasks.workunit.client.0.smithi153.stderr: -14> 2024-09-19T14:08:21.624+0000 7f1a0a8c49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 2024-09-19T14:08:21.753 INFO:tasks.workunit.client.0.smithi153.stderr: -13> 2024-09-19T14:08:21.628+0000 7f1a0a8c49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 info.flags=0x17 2024-09-19T14:08:21.753 INFO:tasks.workunit.client.0.smithi153.stderr: -12> 2024-09-19T14:08:21.628+0000 7f1a0a8c49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 to cache LRU end 2024-09-19T14:08:21.753 INFO:tasks.workunit.client.0.smithi153.stderr: -11> 2024-09-19T14:08:21.628+0000 7f1a0a8c49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:21.753 INFO:tasks.workunit.client.0.smithi153.stderr: -10> 2024-09-19T14:08:21.628+0000 7f1a0a8c49c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29, ofs0, ns] 2024-09-19T14:08:21.753 INFO:tasks.workunit.client.0.smithi153.stderr: -9> 2024-09-19T14:08:21.628+0000 7f18deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333528 cookie 94811179866944 notifier 6620 bl.length()=915 2024-09-19T14:08:21.753 INFO:tasks.workunit.client.0.smithi153.stderr: -8> 2024-09-19T14:08:21.628+0000 7f18deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 info.flags=0x17 2024-09-19T14:08:21.753 INFO:tasks.workunit.client.0.smithi153.stderr: -7> 2024-09-19T14:08:21.628+0000 7f18deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 to cache LRU end 2024-09-19T14:08:21.753 INFO:tasks.workunit.client.0.smithi153.stderr: -6> 2024-09-19T14:08:21.628+0000 7f18deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:21.754 INFO:tasks.workunit.client.0.smithi153.stderr: -5> 2024-09-19T14:08:21.632+0000 7f1a0a8c49c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): orig_sources= new_sources= 2024-09-19T14:08:21.754 INFO:tasks.workunit.client.0.smithi153.stderr: -4> 2024-09-19T14:08:21.632+0000 7f1a0a8c49c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): potential sources added=[] removed=[] 2024-09-19T14:08:21.754 INFO:tasks.workunit.client.0.smithi153.stderr: -3> 2024-09-19T14:08:21.632+0000 7f1a0a8c49c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): orig_dests= new_dests= 2024-09-19T14:08:21.754 INFO:tasks.workunit.client.0.smithi153.stderr: -2> 2024-09-19T14:08:21.632+0000 7f1a0a8c49c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): potential dests added=[] removed=[] 2024-09-19T14:08:21.754 INFO:tasks.workunit.client.0.smithi153.stderr: -1> 2024-09-19T14:08:21.632+0000 7f1a0a8c49c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1a0a8c49c0 time 2024-09-19T14:08:21.637834+0000 2024-09-19T14:08:21.754 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:08:21.754 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.754 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:08:21.754 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1a0e19e2eb] 2024-09-19T14:08:21.754 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1a0e19e49f] 2024-09-19T14:08:21.754 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563af02f6271] 2024-09-19T14:08:21.754 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x563af03054ab] 2024-09-19T14:08:21.754 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563af0306a94] 2024-09-19T14:08:21.754 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:08:21.755 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1a0d004d90] 2024-09-19T14:08:21.755 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:08:21.755 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:08:21.755 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.755 INFO:tasks.workunit.client.0.smithi153.stderr: 0> 2024-09-19T14:08:21.636+0000 7f1a0a8c49c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:08:21.755 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7f1a0a8c49c0 thread_name:radosgw-admin 2024-09-19T14:08:21.755 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.755 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:08:21.755 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1a0d01d520] 2024-09-19T14:08:21.755 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:08:21.755 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:08:21.755 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:08:21.755 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1a0e19e345] 2024-09-19T14:08:21.755 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1a0e19e49f] 2024-09-19T14:08:21.756 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563af02f6271] 2024-09-19T14:08:21.756 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x563af03054ab] 2024-09-19T14:08:21.756 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563af0306a94] 2024-09-19T14:08:21.756 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:08:21.756 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1a0d004d90] 2024-09-19T14:08:21.756 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:08:21.756 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:08:21.756 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:08:21.756 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.756 INFO:tasks.workunit.client.0.smithi153.stderr:--- logging levels --- 2024-09-19T14:08:21.756 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 none 2024-09-19T14:08:21.756 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 lockdep 2024-09-19T14:08:21.756 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 context 2024-09-19T14:08:21.757 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 crush 2024-09-19T14:08:21.757 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds 2024-09-19T14:08:21.757 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_balancer 2024-09-19T14:08:21.757 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_locker 2024-09-19T14:08:21.757 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log 2024-09-19T14:08:21.757 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log_expire 2024-09-19T14:08:21.757 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_migrator 2024-09-19T14:08:21.757 INFO:tasks.workunit.client.0.smithi153.stderr: 3/ 5 mds_quiesce 2024-09-19T14:08:21.757 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 buffer 2024-09-19T14:08:21.757 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 timer 2024-09-19T14:08:21.757 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 filer 2024-09-19T14:08:21.757 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 striper 2024-09-19T14:08:21.757 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 objecter 2024-09-19T14:08:21.757 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rados 2024-09-19T14:08:21.758 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd 2024-09-19T14:08:21.758 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_mirror 2024-09-19T14:08:21.758 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_replay 2024-09-19T14:08:21.758 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_pwl 2024-09-19T14:08:21.758 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 journaler 2024-09-19T14:08:21.758 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objectcacher 2024-09-19T14:08:21.758 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:08:21.758 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 client 2024-09-19T14:08:21.758 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 osd 2024-09-19T14:08:21.758 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 optracker 2024-09-19T14:08:21.758 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objclass 2024-09-19T14:08:21.758 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 filestore 2024-09-19T14:08:21.758 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 journal 2024-09-19T14:08:21.758 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 ms 2024-09-19T14:08:21.758 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mon 2024-09-19T14:08:21.759 INFO:tasks.workunit.client.0.smithi153.stderr: 0/10 monc 2024-09-19T14:08:21.759 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 paxos 2024-09-19T14:08:21.759 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 tp 2024-09-19T14:08:21.759 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 auth 2024-09-19T14:08:21.759 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 crypto 2024-09-19T14:08:21.759 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 finisher 2024-09-19T14:08:21.759 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 reserver 2024-09-19T14:08:21.759 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 heartbeatmap 2024-09-19T14:08:21.759 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 perfcounter 2024-09-19T14:08:21.759 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw 2024-09-19T14:08:21.759 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_sync 2024-09-19T14:08:21.759 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_datacache 2024-09-19T14:08:21.759 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_access 2024-09-19T14:08:21.759 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:08:21.760 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_flight 2024-09-19T14:08:21.760 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:08:21.760 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw_notification 2024-09-19T14:08:21.760 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 javaclient 2024-09-19T14:08:21.760 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 asok 2024-09-19T14:08:21.760 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 throttle 2024-09-19T14:08:21.760 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 refs 2024-09-19T14:08:21.760 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 compressor 2024-09-19T14:08:21.760 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluestore 2024-09-19T14:08:21.760 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluefs 2024-09-19T14:08:21.760 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 bdev 2024-09-19T14:08:21.760 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 kstore 2024-09-19T14:08:21.760 INFO:tasks.workunit.client.0.smithi153.stderr: 4/ 5 rocksdb 2024-09-19T14:08:21.760 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 fuse 2024-09-19T14:08:21.761 INFO:tasks.workunit.client.0.smithi153.stderr: 2/ 5 mgr 2024-09-19T14:08:21.761 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mgrc 2024-09-19T14:08:21.761 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 dpdk 2024-09-19T14:08:21.761 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 eventtrace 2024-09-19T14:08:21.761 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 prioritycache 2024-09-19T14:08:21.761 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 test 2024-09-19T14:08:21.761 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:08:21.761 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephsqlite 2024-09-19T14:08:21.761 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:08:21.761 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore 2024-09-19T14:08:21.761 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_onode 2024-09-19T14:08:21.761 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_odata 2024-09-19T14:08:21.761 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_omap 2024-09-19T14:08:21.761 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_tm 2024-09-19T14:08:21.762 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_t 2024-09-19T14:08:21.762 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:08:21.762 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_epm 2024-09-19T14:08:21.762 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_lba 2024-09-19T14:08:21.762 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:08:21.762 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cache 2024-09-19T14:08:21.762 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_journal 2024-09-19T14:08:21.762 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_device 2024-09-19T14:08:21.762 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_backref 2024-09-19T14:08:21.762 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 alienstore 2024-09-19T14:08:21.762 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mclock 2024-09-19T14:08:21.762 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cyanstore 2024-09-19T14:08:21.762 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 ceph_exporter 2024-09-19T14:08:21.763 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 memstore 2024-09-19T14:08:21.763 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 trace 2024-09-19T14:08:21.763 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 ceph_dedup 2024-09-19T14:08:21.763 INFO:tasks.workunit.client.0.smithi153.stderr: -2/-2 (syslog threshold) 2024-09-19T14:08:21.763 INFO:tasks.workunit.client.0.smithi153.stderr: 99/99 (stderr threshold) 2024-09-19T14:08:21.763 INFO:tasks.workunit.client.0.smithi153.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:08:21.763 INFO:tasks.workunit.client.0.smithi153.stderr: 7f18b77fe640 / http_manager 2024-09-19T14:08:21.763 INFO:tasks.workunit.client.0.smithi153.stderr: 7f18be7dc640 / http_manager 2024-09-19T14:08:21.763 INFO:tasks.workunit.client.0.smithi153.stderr: 7f18bf7de640 / rgw_dt_lg_renew 2024-09-19T14:08:21.763 INFO:tasks.workunit.client.0.smithi153.stderr: 7f18ddffb640 / ms_dispatch 2024-09-19T14:08:21.763 INFO:tasks.workunit.client.0.smithi153.stderr: 7f18deffd640 / io_context_pool 2024-09-19T14:08:21.763 INFO:tasks.workunit.client.0.smithi153.stderr: 7f18df7fe640 / io_context_pool 2024-09-19T14:08:21.763 INFO:tasks.workunit.client.0.smithi153.stderr: 7f18edffb640 / ms_dispatch 2024-09-19T14:08:21.763 INFO:tasks.workunit.client.0.smithi153.stderr: 7f18f4e09640 / ms_dispatch 2024-09-19T14:08:21.764 INFO:tasks.workunit.client.0.smithi153.stderr: 7f18f660c640 / io_context_pool 2024-09-19T14:08:21.764 INFO:tasks.workunit.client.0.smithi153.stderr: 7f1a07bc9640 / msgr-worker-2 2024-09-19T14:08:21.764 INFO:tasks.workunit.client.0.smithi153.stderr: 7f1a083ca640 / msgr-worker-1 2024-09-19T14:08:21.764 INFO:tasks.workunit.client.0.smithi153.stderr: 7f1a08bcb640 / msgr-worker-0 2024-09-19T14:08:21.764 INFO:tasks.workunit.client.0.smithi153.stderr: 7f1a093cc640 / io_context_pool 2024-09-19T14:08:21.764 INFO:tasks.workunit.client.0.smithi153.stderr: 7f1a0a8c49c0 / radosgw-admin 2024-09-19T14:08:21.764 INFO:tasks.workunit.client.0.smithi153.stderr: max_recent 500 2024-09-19T14:08:21.764 INFO:tasks.workunit.client.0.smithi153.stderr: max_new 1000 2024-09-19T14:08:21.764 INFO:tasks.workunit.client.0.smithi153.stderr: log_file /var/lib/ceph/crash/2024-09-19T14:08:21.640327Z_b5a3193d-9d8b-42de-9913-c4bc4e2a3920/log 2024-09-19T14:08:21.764 INFO:tasks.workunit.client.0.smithi153.stderr:--- end dump of recent events --- 2024-09-19T14:08:21.764 INFO:tasks.workunit.client.0.smithi153.stderr:Aborted 2024-09-19T14:08:21.764 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-19T14:08:21.768 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:08:21.768 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:08:21.768 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.712+0000 7f74a97e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.768 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.716+0000 7f74a97e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.716+0000 7f74a97e29c0 20 realm 2024-09-19T14:08:21.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.716+0000 7f74a97e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.716+0000 7f74a97e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.716+0000 7f74a97e29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:08:21.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.716+0000 7f74a97e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.716+0000 7f74a97e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.716+0000 7f74a97e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.716+0000 7f74a97e29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:21.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.716+0000 7f74a97e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.716+0000 7f74a97e29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:08:21.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.716+0000 7f74a97e29c0 20 searching for the correct realm 2024-09-19T14:08:21.769 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.724+0000 7f74a7ae9640 0 -- 172.21.15.153:0/3629214020 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55de84512150 msgr2=0x55de84514590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:08:21.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.728+0000 7f74a72e8640 0 -- 172.21.15.153:0/3629214020 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f749c10b610 msgr2=0x7f749c101aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:21.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.736+0000 7f74a97e29c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:08:21.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.736+0000 7f74a97e29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:08:21.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.736+0000 7f74a97e29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:08:21.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.736+0000 7f74a97e29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:08:21.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.736+0000 7f74a97e29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:08:21.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.736+0000 7f74a97e29c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:08:21.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.736+0000 7f74a97e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.736+0000 7f74a97e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.736+0000 7f74a97e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.736+0000 7f74a97e29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:21.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.736+0000 7f74a97e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.736+0000 7f74a97e29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:08:21.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.736+0000 7f74a97e29c0 20 zone default found 2024-09-19T14:08:21.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.736+0000 7f74a97e29c0 4 Realm: () 2024-09-19T14:08:21.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.736+0000 7f74a97e29c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:08:21.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.736+0000 7f74a97e29c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:08:21.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.736+0000 7f74a97e29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:08:21.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.736+0000 7f74a97e29c0 20 zonegroup default 2024-09-19T14:08:21.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.736+0000 7f74a97e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.736+0000 7f74a97e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.736+0000 7f74a97e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.740+0000 7f74a97e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.740+0000 7f74a97e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.740+0000 7f74a97e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.771 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.740+0000 7f74a97e29c0 20 started sync module instance, tier type = 2024-09-19T14:08:21.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.740+0000 7f74a97e29c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:08:21.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.752+0000 7f74a97e29c0 20 add_watcher() i=0 2024-09-19T14:08:21.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.752+0000 7f74a97e29c0 20 add_watcher() i=1 2024-09-19T14:08:21.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.752+0000 7f74a97e29c0 20 add_watcher() i=2 2024-09-19T14:08:21.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.752+0000 7f74a97e29c0 20 add_watcher() i=3 2024-09-19T14:08:21.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.752+0000 7f74a97e29c0 20 add_watcher() i=4 2024-09-19T14:08:21.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.752+0000 7f74a97e29c0 20 add_watcher() i=5 2024-09-19T14:08:21.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.752+0000 7f74a97e29c0 20 add_watcher() i=6 2024-09-19T14:08:21.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.756+0000 7f74a97e29c0 20 add_watcher() i=7 2024-09-19T14:08:21.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.756+0000 7f74a97e29c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:08:21.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.756+0000 7f735e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:21.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.756+0000 7f74a97e29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:08:21.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.756+0000 7f74a97e29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:08:21.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.756+0000 7f74a97e29c0 5 note: GC not initialized 2024-09-19T14:08:21.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.756+0000 7f735d7e2640 20 reqs_thread_entry: start 2024-09-19T14:08:21.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.760+0000 7f74a97e29c0 20 init_complete bucket index max shards: 11 2024-09-19T14:08:21.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.760+0000 7f74a97e29c0 20 Filter name: none 2024-09-19T14:08:21.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.760+0000 7f73567fc640 20 reqs_thread_entry: start 2024-09-19T14:08:21.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.760+0000 7f74a97e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.760+0000 7f74a97e29c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-19T14:08:21.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.760+0000 7f74a97e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.760+0000 7f74a97e29c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T14:08:21.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.760+0000 7f74a97e29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:08:21.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.760+0000 7f74a97e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.760+0000 7f74a97e29c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-19T14:08:21.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.760+0000 7f74a97e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.760+0000 7f74a97e29c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T14:08:21.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.760+0000 7f74a97e29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:08:21.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.764+0000 7f735e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:21.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.768+0000 7f74a97e29c0 20 remove_watcher() i=0 2024-09-19T14:08:21.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.768+0000 7f74a97e29c0 2 removed watcher, disabling cache 2024-09-19T14:08:21.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.772+0000 7f74a97e29c0 20 remove_watcher() i=1 2024-09-19T14:08:21.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.772+0000 7f74a97e29c0 20 remove_watcher() i=2 2024-09-19T14:08:21.777 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.776+0000 7f74a97e29c0 20 remove_watcher() i=3 2024-09-19T14:08:21.779 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.776+0000 7f74a97e29c0 20 remove_watcher() i=4 2024-09-19T14:08:21.780 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.776+0000 7f74a97e29c0 20 remove_watcher() i=5 2024-09-19T14:08:21.781 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.780+0000 7f74a97e29c0 20 remove_watcher() i=6 2024-09-19T14:08:21.782 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.780+0000 7f74a97e29c0 20 remove_watcher() i=7 2024-09-19T14:08:21.795 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.795 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:08:21.795 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: abort-at-block-writes id: dbb1da81-49d0-421a-b677-974869a7f103.4620.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:08:21.795 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:21.796 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:21.796 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:21.832 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:21.832 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:21.890 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T14:08:21.924 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:08:21.925 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:08:21.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.964+0000 7f56a24449c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.968+0000 7f56a24449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.968+0000 7f56a24449c0 20 realm 2024-09-19T14:08:21.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.968+0000 7f56a24449c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.968+0000 7f56a24449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.968+0000 7f56a24449c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:08:21.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.968+0000 7f56a24449c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.968+0000 7f56a24449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.968+0000 7f56a24449c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.968+0000 7f56a24449c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:21.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.968+0000 7f56a24449c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.968+0000 7f56a24449c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:08:21.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.968+0000 7f56a24449c0 20 searching for the correct realm 2024-09-19T14:08:21.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.976+0000 7f56a074b640 0 -- 172.21.15.153:0/476788198 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x5602ed5d3d60 msgr2=0x5602ed5d6170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:21.984 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.980+0000 7f569f749640 0 -- 172.21.15.153:0/476788198 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f5690029070 msgr2=0x7f5690087a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:21.991 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.988+0000 7f56a24449c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:08:21.991 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.988+0000 7f56a24449c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:08:21.991 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.988+0000 7f56a24449c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:08:21.991 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.988+0000 7f56a24449c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:08:21.991 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.988+0000 7f56a24449c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:08:21.991 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.988+0000 7f56a24449c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:08:21.991 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.988+0000 7f56a24449c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.991 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.988+0000 7f56a24449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.991 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.988+0000 7f56a24449c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.988+0000 7f56a24449c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:21.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.988+0000 7f56a24449c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.988+0000 7f56a24449c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:08:21.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.988+0000 7f56a24449c0 20 zone default found 2024-09-19T14:08:21.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.988+0000 7f56a24449c0 4 Realm: () 2024-09-19T14:08:21.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.988+0000 7f56a24449c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:08:21.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.988+0000 7f56a24449c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:08:21.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.988+0000 7f56a24449c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:08:21.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.988+0000 7f56a24449c0 20 zonegroup default 2024-09-19T14:08:21.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.988+0000 7f56a24449c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.988+0000 7f56a24449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.988+0000 7f56a24449c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.994 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.992+0000 7f56a24449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.994 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.992+0000 7f56a24449c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:21.994 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.992+0000 7f56a24449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:21.994 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.992+0000 7f56a24449c0 20 started sync module instance, tier type = 2024-09-19T14:08:21.994 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:21.992+0000 7f56a24449c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:08:22.009 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.008+0000 7f56a24449c0 20 add_watcher() i=0 2024-09-19T14:08:22.009 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.008+0000 7f56a24449c0 20 add_watcher() i=1 2024-09-19T14:08:22.009 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.008+0000 7f56a24449c0 20 add_watcher() i=2 2024-09-19T14:08:22.009 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.008+0000 7f56a24449c0 20 add_watcher() i=3 2024-09-19T14:08:22.009 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.008+0000 7f56a24449c0 20 add_watcher() i=4 2024-09-19T14:08:22.009 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.008+0000 7f56a24449c0 20 add_watcher() i=5 2024-09-19T14:08:22.009 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.008+0000 7f56a24449c0 20 add_watcher() i=6 2024-09-19T14:08:22.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.008+0000 7f56a24449c0 20 add_watcher() i=7 2024-09-19T14:08:22.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.008+0000 7f56a24449c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:08:22.013 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.008+0000 7f5555fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:22.013 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.012+0000 7f56a24449c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:08:22.013 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.012+0000 7f56a24449c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:08:22.013 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.012+0000 7f56a24449c0 5 note: GC not initialized 2024-09-19T14:08:22.014 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.012+0000 7f5554fe1640 20 reqs_thread_entry: start 2024-09-19T14:08:22.014 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.012+0000 7f56a24449c0 20 init_complete bucket index max shards: 11 2024-09-19T14:08:22.014 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.012+0000 7f56a24449c0 20 Filter name: none 2024-09-19T14:08:22.014 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.012+0000 7f54ce7fc640 20 reqs_thread_entry: start 2024-09-19T14:08:22.014 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.012+0000 7f56a24449c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-19T14:08:22.014 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.012+0000 7f56a24449c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:22.014 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.012+0000 7f56a24449c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-19T14:08:22.014 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.012+0000 7f56a24449c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-19T14:08:22.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.012+0000 7f56a24449c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-19T14:08:22.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.012+0000 7f56a24449c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 : miss 2024-09-19T14:08:22.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.012+0000 7f56a24449c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:22.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.012+0000 7f56a24449c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T14:08:22.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.012+0000 7f56a24449c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 info.flags=0x17 2024-09-19T14:08:22.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.012+0000 7f56a24449c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 to cache LRU end 2024-09-19T14:08:22.016 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.012+0000 7f56a24449c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:08:22.016 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.012+0000 7f56a24449c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:22.016 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.012+0000 7f56a24449c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 2024-09-19T14:08:22.017 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.016+0000 7f56a24449c0 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 to be held by another RGW process; skipping for now 2024-09-19T14:08:22.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.016+0000 7f5555fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:22.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.020+0000 7f56a24449c0 20 remove_watcher() i=0 2024-09-19T14:08:22.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.020+0000 7f56a24449c0 2 removed watcher, disabling cache 2024-09-19T14:08:22.025 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.024+0000 7f56a24449c0 20 remove_watcher() i=1 2024-09-19T14:08:22.027 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.024+0000 7f56a24449c0 20 remove_watcher() i=2 2024-09-19T14:08:22.029 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.028+0000 7f56a24449c0 20 remove_watcher() i=3 2024-09-19T14:08:22.031 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.028+0000 7f56a24449c0 20 remove_watcher() i=4 2024-09-19T14:08:22.032 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.028+0000 7f56a24449c0 20 remove_watcher() i=5 2024-09-19T14:08:22.033 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.032+0000 7f56a24449c0 20 remove_watcher() i=6 2024-09-19T14:08:22.034 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:22.032+0000 7f56a24449c0 20 remove_watcher() i=7 2024-09-19T14:08:22.047 INFO:tasks.workunit.client.0.smithi153.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-19T14:08:52.050 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T14:08:52.087 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:08:52.087 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:08:52.132 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.131+0000 7f6ee04939c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.135+0000 7f6ee04939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:52.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.135+0000 7f6ee04939c0 20 realm 2024-09-19T14:08:52.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.135+0000 7f6ee04939c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.135+0000 7f6ee04939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:52.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.135+0000 7f6ee04939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:08:52.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.135+0000 7f6ee04939c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.135+0000 7f6ee04939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:52.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.135+0000 7f6ee04939c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.135+0000 7f6ee04939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:52.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.135+0000 7f6ee04939c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.135+0000 7f6ee04939c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:08:52.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.135+0000 7f6ee04939c0 20 searching for the correct realm 2024-09-19T14:08:52.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.143+0000 7f6ede79a640 0 -- 172.21.15.153:0/3471863549 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f6ed40c4210 msgr2=0x7f6ed4001000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:52.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.147+0000 7f6eddf99640 0 -- 172.21.15.153:0/3471863549 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f6ed40c5950 msgr2=0x7f6ed4117540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:52.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.363+0000 7f6ee04939c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:08:52.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.363+0000 7f6ee04939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:08:52.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.363+0000 7f6ee04939c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:08:52.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.363+0000 7f6ee04939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:08:52.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.363+0000 7f6ee04939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:08:52.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.363+0000 7f6ee04939c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:08:52.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.363+0000 7f6ee04939c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.363+0000 7f6ee04939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:52.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.363+0000 7f6ee04939c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.363+0000 7f6ee04939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:52.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.363+0000 7f6ee04939c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.367+0000 7f6ee04939c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:08:52.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.367+0000 7f6ee04939c0 20 zone default found 2024-09-19T14:08:52.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.367+0000 7f6ee04939c0 4 Realm: () 2024-09-19T14:08:52.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.367+0000 7f6ee04939c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:08:52.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.367+0000 7f6ee04939c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:08:52.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.367+0000 7f6ee04939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:08:52.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.367+0000 7f6ee04939c0 20 zonegroup default 2024-09-19T14:08:52.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.367+0000 7f6ee04939c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.367+0000 7f6ee04939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:52.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.367+0000 7f6ee04939c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.367 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.367+0000 7f6ee04939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:52.367 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.367+0000 7f6ee04939c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.367+0000 7f6ee04939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:52.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.367+0000 7f6ee04939c0 20 started sync module instance, tier type = 2024-09-19T14:08:52.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.367+0000 7f6ee04939c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:08:52.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.391+0000 7f6ee04939c0 20 add_watcher() i=0 2024-09-19T14:08:52.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.391+0000 7f6ee04939c0 20 add_watcher() i=1 2024-09-19T14:08:52.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.391+0000 7f6ee04939c0 20 add_watcher() i=2 2024-09-19T14:08:52.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.391+0000 7f6ee04939c0 20 add_watcher() i=3 2024-09-19T14:08:52.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.391+0000 7f6ee04939c0 20 add_watcher() i=4 2024-09-19T14:08:52.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.391+0000 7f6ee04939c0 20 add_watcher() i=5 2024-09-19T14:08:52.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.391+0000 7f6ee04939c0 20 add_watcher() i=6 2024-09-19T14:08:52.395 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.395+0000 7f6ee04939c0 20 add_watcher() i=7 2024-09-19T14:08:52.395 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.395+0000 7f6ee04939c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:08:52.399 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.399+0000 7f6d8f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:52.400 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.399+0000 7f6ee04939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:08:52.400 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.399+0000 7f6ee04939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:08:52.400 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.399+0000 7f6ee04939c0 5 note: GC not initialized 2024-09-19T14:08:52.401 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.399+0000 7f6d8e7fc640 20 reqs_thread_entry: start 2024-09-19T14:08:52.401 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.399+0000 7f6ee04939c0 20 init_complete bucket index max shards: 11 2024-09-19T14:08:52.401 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.403+0000 7f6ee04939c0 20 Filter name: none 2024-09-19T14:08:52.401 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.403+0000 7f6cfffff640 20 reqs_thread_entry: start 2024-09-19T14:08:52.401 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.403+0000 7f6ee04939c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-19T14:08:52.401 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.403+0000 7f6ee04939c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.402 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.403+0000 7f6ee04939c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-19T14:08:52.402 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.403+0000 7f6ee04939c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-19T14:08:52.402 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.403+0000 7f6ee04939c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-19T14:08:52.402 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.403+0000 7f6ee04939c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 : miss 2024-09-19T14:08:52.402 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.403+0000 7f6ee04939c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.403 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.403+0000 7f6ee04939c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-19T14:08:52.403 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.403+0000 7f6ee04939c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 info.flags=0x17 2024-09-19T14:08:52.403 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.403+0000 7f6ee04939c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 to cache LRU end 2024-09-19T14:08:52.403 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.403+0000 7f6ee04939c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:08:52.403 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.403+0000 7f6ee04939c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:52.403 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.403+0000 7f6ee04939c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 2024-09-19T14:08:52.405 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.407+0000 7f6ee04939c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T14:08:52.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.419+0000 7f6ee04939c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 info.flags=0x17 2024-09-19T14:08:52.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.419+0000 7f6ee04939c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 to cache LRU end 2024-09-19T14:08:52.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.419+0000 7f6ee04939c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:52.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.419+0000 7f6ee04939c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29, ofs0, ns] 2024-09-19T14:08:52.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.419+0000 7f6dc17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333529 cookie 94842844238128 notifier 7107 bl.length()=915 2024-09-19T14:08:52.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.419+0000 7f6dc17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 info.flags=0x17 2024-09-19T14:08:52.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.419+0000 7f6dc17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 to cache LRU end 2024-09-19T14:08:52.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.419+0000 7f6dc17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:52.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.423+0000 7f6ee04939c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): orig_sources= new_sources= 2024-09-19T14:08:52.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.423+0000 7f6ee04939c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): potential sources added=[] removed=[] 2024-09-19T14:08:52.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.423+0000 7f6ee04939c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): orig_dests= new_dests= 2024-09-19T14:08:52.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.423+0000 7f6ee04939c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): potential dests added=[] removed=[] 2024-09-19T14:08:52.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2.0 2024-09-19T14:08:52.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2.0 2024-09-19T14:08:52.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2.1 2024-09-19T14:08:52.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2.1 2024-09-19T14:08:52.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2.2 2024-09-19T14:08:52.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2.2 2024-09-19T14:08:52.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2.3 2024-09-19T14:08:52.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2.3 2024-09-19T14:08:52.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2.4 2024-09-19T14:08:52.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2.4 2024-09-19T14:08:52.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2.5 2024-09-19T14:08:52.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2.5 2024-09-19T14:08:52.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2.6 2024-09-19T14:08:52.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2.6 2024-09-19T14:08:52.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2.7 2024-09-19T14:08:52.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2.7 2024-09-19T14:08:52.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2.8 2024-09-19T14:08:52.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2.8 2024-09-19T14:08:52.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2.9 2024-09-19T14:08:52.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2.9 2024-09-19T14:08:52.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2.10 2024-09-19T14:08:52.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2.10 2024-09-19T14:08:52.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2.11 2024-09-19T14:08:52.435 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2.11 2024-09-19T14:08:52.435 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.431+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.0 2024-09-19T14:08:52.435 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.435+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1 2024-09-19T14:08:52.435 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.435+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2 2024-09-19T14:08:52.435 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.435+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.3 2024-09-19T14:08:52.436 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.435+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.4 2024-09-19T14:08:52.436 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.435+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.5 2024-09-19T14:08:52.439 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.439+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.6 2024-09-19T14:08:52.440 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.439+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.7 2024-09-19T14:08:52.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.443+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.8 2024-09-19T14:08:52.442 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.443+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.9 2024-09-19T14:08:52.444 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.443+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.10 2024-09-19T14:08:52.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.451+0000 7f6ee04939c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 : hit (requested=0x17, cached=0x17) 2024-09-19T14:08:52.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.451+0000 7f6ee04939c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 2024-09-19T14:08:52.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.451+0000 7f6ee04939c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 info.flags=0x17 2024-09-19T14:08:52.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.451+0000 7f6ee04939c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 to cache LRU end 2024-09-19T14:08:52.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.451+0000 7f6ee04939c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:52.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.451+0000 7f6ee04939c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29, ofs0, ns] 2024-09-19T14:08:52.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.451+0000 7f6dc17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333530 cookie 94842844238128 notifier 7107 bl.length()=915 2024-09-19T14:08:52.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.451+0000 7f6dc17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 info.flags=0x17 2024-09-19T14:08:52.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.455+0000 7f6dc17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 to cache LRU end 2024-09-19T14:08:52.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.455+0000 7f6dc17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:52.456 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.455+0000 7f6ee04939c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): orig_sources= new_sources= 2024-09-19T14:08:52.456 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.455+0000 7f6ee04939c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): potential sources added=[] removed=[] 2024-09-19T14:08:52.456 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.455+0000 7f6ee04939c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): orig_dests= new_dests= 2024-09-19T14:08:52.456 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.455+0000 7f6ee04939c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): potential dests added=[] removed=[] 2024-09-19T14:08:52.461 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.463+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.0 2024-09-19T14:08:52.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.463+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.1 2024-09-19T14:08:52.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.463+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.2 2024-09-19T14:08:52.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.463+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.3 2024-09-19T14:08:52.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.463+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.4 2024-09-19T14:08:52.464 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.463+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.5 2024-09-19T14:08:52.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.467+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.6 2024-09-19T14:08:52.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.467+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.7 2024-09-19T14:08:52.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.467+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.8 2024-09-19T14:08:52.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.467+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.9 2024-09-19T14:08:52.468 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.467+0000 7f6ee04939c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.29.10 2024-09-19T14:08:52.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.471+0000 7f6ee04939c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 : hit (requested=0x17, cached=0x17) 2024-09-19T14:08:52.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.471+0000 7f6ee04939c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 2024-09-19T14:08:52.472 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.471+0000 7f6ee04939c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 info.flags=0x17 2024-09-19T14:08:52.472 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.471+0000 7f6ee04939c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 to cache LRU end 2024-09-19T14:08:52.472 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.471+0000 7f6ee04939c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:52.472 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.471+0000 7f6ee04939c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29, ofs0, ns] 2024-09-19T14:08:52.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.475+0000 7f6dc0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333531 cookie 94842844238128 notifier 7107 bl.length()=883 2024-09-19T14:08:52.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.475+0000 7f6dc0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 info.flags=0x17 2024-09-19T14:08:52.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.475+0000 7f6dc0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.29 to cache LRU end 2024-09-19T14:08:52.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.475+0000 7f6dc0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:52.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.475+0000 7f6ee04939c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): orig_sources= new_sources= 2024-09-19T14:08:52.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.475+0000 7f6ee04939c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): potential sources added=[] removed=[] 2024-09-19T14:08:52.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.475+0000 7f6ee04939c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): orig_dests= new_dests= 2024-09-19T14:08:52.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.475+0000 7f6ee04939c0 20 handle_bi_update(): bucket=:abort-at-block-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.29]): potential dests added=[] removed=[] 2024-09-19T14:08:52.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.483+0000 7f6ee04939c0 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-19T14:08:52.485 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.487+0000 7f6d8f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:52.490 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.491+0000 7f6ee04939c0 20 remove_watcher() i=0 2024-09-19T14:08:52.490 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.491+0000 7f6ee04939c0 2 removed watcher, disabling cache 2024-09-19T14:08:52.492 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.491+0000 7f6ee04939c0 20 remove_watcher() i=1 2024-09-19T14:08:52.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.495+0000 7f6ee04939c0 20 remove_watcher() i=2 2024-09-19T14:08:52.496 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.495+0000 7f6ee04939c0 20 remove_watcher() i=3 2024-09-19T14:08:52.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.499+0000 7f6ee04939c0 20 remove_watcher() i=4 2024-09-19T14:08:52.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.499+0000 7f6ee04939c0 20 remove_watcher() i=5 2024-09-19T14:08:52.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.503+0000 7f6ee04939c0 20 remove_watcher() i=6 2024-09-19T14:08:52.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.503+0000 7f6ee04939c0 20 remove_watcher() i=7 2024-09-19T14:08:52.523 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-19T14:08:52.553 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:08:52.553 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:08:52.597 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.599+0000 7fbbcea399c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.599+0000 7fbbcea399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:52.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.599+0000 7fbbcea399c0 20 realm 2024-09-19T14:08:52.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.599+0000 7fbbcea399c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.599+0000 7fbbcea399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:52.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.599+0000 7fbbcea399c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:08:52.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.599+0000 7fbbcea399c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.599+0000 7fbbcea399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:52.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.599+0000 7fbbcea399c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.603+0000 7fbbcea399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:52.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.603+0000 7fbbcea399c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.603+0000 7fbbcea399c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:08:52.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.603+0000 7fbbcea399c0 20 searching for the correct realm 2024-09-19T14:08:52.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.607+0000 7fbbccd40640 0 -- 172.21.15.153:0/2446115820 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7fbbc0008040 msgr2=0x7fbbc0034a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:52.613 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.615+0000 7fbbcc53f640 0 -- 172.21.15.153:0/2446115820 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fbbc000c460 msgr2=0x7fbbc000c8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:08:52.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.831+0000 7fbbcea399c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:08:52.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.831+0000 7fbbcea399c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:08:52.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.831+0000 7fbbcea399c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:08:52.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.831+0000 7fbbcea399c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:08:52.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.831+0000 7fbbcea399c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:08:52.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.831+0000 7fbbcea399c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:08:52.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.831+0000 7fbbcea399c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.835+0000 7fbbcea399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:52.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.835+0000 7fbbcea399c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.835+0000 7fbbcea399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:52.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.835+0000 7fbbcea399c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.835+0000 7fbbcea399c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:08:52.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.835+0000 7fbbcea399c0 20 zone default found 2024-09-19T14:08:52.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.835+0000 7fbbcea399c0 4 Realm: () 2024-09-19T14:08:52.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.835+0000 7fbbcea399c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:08:52.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.835+0000 7fbbcea399c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:08:52.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.835+0000 7fbbcea399c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:08:52.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.835+0000 7fbbcea399c0 20 zonegroup default 2024-09-19T14:08:52.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.835+0000 7fbbcea399c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.835+0000 7fbbcea399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:52.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.835+0000 7fbbcea399c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.839+0000 7fbbcea399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:52.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.839+0000 7fbbcea399c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.839+0000 7fbbcea399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:52.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.839+0000 7fbbcea399c0 20 started sync module instance, tier type = 2024-09-19T14:08:52.838 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.839+0000 7fbbcea399c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:08:52.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.859+0000 7fbbcea399c0 20 add_watcher() i=0 2024-09-19T14:08:52.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.859+0000 7fbbcea399c0 20 add_watcher() i=1 2024-09-19T14:08:52.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.859+0000 7fbbcea399c0 20 add_watcher() i=2 2024-09-19T14:08:52.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.859+0000 7fbbcea399c0 20 add_watcher() i=3 2024-09-19T14:08:52.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.859+0000 7fbbcea399c0 20 add_watcher() i=4 2024-09-19T14:08:52.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.859+0000 7fbbcea399c0 20 add_watcher() i=5 2024-09-19T14:08:52.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.859+0000 7fbbcea399c0 20 add_watcher() i=6 2024-09-19T14:08:52.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.863+0000 7fbbcea399c0 20 add_watcher() i=7 2024-09-19T14:08:52.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.863+0000 7fbbcea399c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:08:52.867 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.867+0000 7fba82fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:52.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.867+0000 7fbbcea399c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:08:52.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.867+0000 7fbbcea399c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:08:52.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.867+0000 7fbbcea399c0 5 note: GC not initialized 2024-09-19T14:08:52.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.871+0000 7fba81fdb640 20 reqs_thread_entry: start 2024-09-19T14:08:52.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.871+0000 7fbbcea399c0 20 init_complete bucket index max shards: 11 2024-09-19T14:08:52.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.871+0000 7fbbcea399c0 20 Filter name: none 2024-09-19T14:08:52.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.871+0000 7fb9f37fe640 20 reqs_thread_entry: start 2024-09-19T14:08:52.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.871+0000 7fbbcea399c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.871+0000 7fbbcea399c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-19T14:08:52.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.871+0000 7fbbcea399c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.871+0000 7fbbcea399c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-19T14:08:52.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.871+0000 7fbbcea399c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:08:52.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.871+0000 7fbbcea399c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.873 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.875+0000 7fbbcea399c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-19T14:08:52.873 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.875+0000 7fbbcea399c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:52.874 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.875+0000 7fbbcea399c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-19T14:08:52.874 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.875+0000 7fbbcea399c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:08:52.877 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.879+0000 7fba82fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:52.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.883+0000 7fbbcea399c0 20 remove_watcher() i=0 2024-09-19T14:08:52.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.883+0000 7fbbcea399c0 2 removed watcher, disabling cache 2024-09-19T14:08:52.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.883+0000 7fbbcea399c0 20 remove_watcher() i=1 2024-09-19T14:08:52.887 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.887+0000 7fbbcea399c0 20 remove_watcher() i=2 2024-09-19T14:08:52.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.891+0000 7fbbcea399c0 20 remove_watcher() i=3 2024-09-19T14:08:52.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.891+0000 7fbbcea399c0 20 remove_watcher() i=4 2024-09-19T14:08:52.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.895+0000 7fbbcea399c0 20 remove_watcher() i=5 2024-09-19T14:08:52.894 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.895+0000 7fbbcea399c0 20 remove_watcher() i=6 2024-09-19T14:08:52.895 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:52.895+0000 7fbbcea399c0 20 remove_watcher() i=7 2024-09-19T14:08:52.912 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:52.912 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:08:52.912 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: abort-at-block-writes id: dbb1da81-49d0-421a-b677-974869a7f103.4620.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T14:08:52.912 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:52.914 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:52.914 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:52.939 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:52.939 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:53.443 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:53.443 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:53.811 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-19T14:08:53.812 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:53.814 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:53.815 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:53.948 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:53.948 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:54.041 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:54.041 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:54.145 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:54.145 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:54.242 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:54.242 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:54.338 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:54.338 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:54.434 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:54.435 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:54.535 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:54.536 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:54.641 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:54.641 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:54.740 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:54.740 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:54.835 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:54.836 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:54.931 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:54.931 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:55.034 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:55.034 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:55.124 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:55.124 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:55.221 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:55.221 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:55.322 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:55.322 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:55.420 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:55.420 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:55.517 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:55.518 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:55.616 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:55.616 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:55.715 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:55.716 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:55.810 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:55.810 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:55.910 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:55.910 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:56.006 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-19T14:08:56.039 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:08:56.039 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:08:56.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.083+0000 7f80f2aad9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.087+0000 7f80f2aad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:56.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.087+0000 7f80f2aad9c0 20 realm 2024-09-19T14:08:56.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.087+0000 7f80f2aad9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.087+0000 7f80f2aad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:56.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.087+0000 7f80f2aad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:08:56.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.087+0000 7f80f2aad9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.087+0000 7f80f2aad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:56.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.087+0000 7f80f2aad9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.091+0000 7f80f2aad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:56.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.091+0000 7f80f2aad9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.091+0000 7f80f2aad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:08:56.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.091+0000 7f80f2aad9c0 20 searching for the correct realm 2024-09-19T14:08:56.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.095+0000 7f80f0db4640 0 -- 172.21.15.153:0/3748196529 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f80e402d950 msgr2=0x7f80e401f450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:56.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.099+0000 7f80f05b3640 0 -- 172.21.15.153:0/3748196529 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f80e401d950 msgr2=0x7f80e402c3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:56.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.315+0000 7f80f2aad9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:08:56.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.315+0000 7f80f2aad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:08:56.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.315+0000 7f80f2aad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:08:56.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.315+0000 7f80f2aad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:08:56.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.315+0000 7f80f2aad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:08:56.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.315+0000 7f80f2aad9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:08:56.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.315+0000 7f80f2aad9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.319+0000 7f80f2aad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:56.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.319+0000 7f80f2aad9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.318 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.319+0000 7f80f2aad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:56.318 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.319+0000 7f80f2aad9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.319+0000 7f80f2aad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:08:56.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.319+0000 7f80f2aad9c0 20 zone default found 2024-09-19T14:08:56.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.319+0000 7f80f2aad9c0 4 Realm: () 2024-09-19T14:08:56.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.319+0000 7f80f2aad9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:08:56.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.319+0000 7f80f2aad9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:08:56.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.319+0000 7f80f2aad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:08:56.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.319+0000 7f80f2aad9c0 20 zonegroup default 2024-09-19T14:08:56.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.319+0000 7f80f2aad9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.319+0000 7f80f2aad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:56.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.319+0000 7f80f2aad9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.319+0000 7f80f2aad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:56.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.319+0000 7f80f2aad9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.323+0000 7f80f2aad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:56.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.323+0000 7f80f2aad9c0 20 started sync module instance, tier type = 2024-09-19T14:08:56.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.323+0000 7f80f2aad9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:08:56.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.343+0000 7f80f2aad9c0 20 add_watcher() i=0 2024-09-19T14:08:56.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.343+0000 7f80f2aad9c0 20 add_watcher() i=1 2024-09-19T14:08:56.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.343+0000 7f80f2aad9c0 20 add_watcher() i=2 2024-09-19T14:08:56.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.343+0000 7f80f2aad9c0 20 add_watcher() i=3 2024-09-19T14:08:56.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.343+0000 7f80f2aad9c0 20 add_watcher() i=4 2024-09-19T14:08:56.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.343+0000 7f80f2aad9c0 20 add_watcher() i=5 2024-09-19T14:08:56.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.343+0000 7f80f2aad9c0 20 add_watcher() i=6 2024-09-19T14:08:56.346 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.347+0000 7f80f2aad9c0 20 add_watcher() i=7 2024-09-19T14:08:56.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.347+0000 7f80f2aad9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:08:56.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.351+0000 7f7fa6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:56.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.351+0000 7f80f2aad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:08:56.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.351+0000 7f80f2aad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:08:56.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.351+0000 7f80f2aad9c0 5 note: GC not initialized 2024-09-19T14:08:56.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.351+0000 7f7fa5fdb640 20 reqs_thread_entry: start 2024-09-19T14:08:56.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.351+0000 7f80f2aad9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:08:56.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.351+0000 7f80f2aad9c0 20 Filter name: none 2024-09-19T14:08:56.353 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.351+0000 7f7f177fe640 20 reqs_thread_entry: start 2024-09-19T14:08:56.353 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.355+0000 7f80f2aad9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.354 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.355+0000 7f80f2aad9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:08:56.354 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.355+0000 7f80f2aad9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.355+0000 7f80f2aad9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:08:56.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.355+0000 7f80f2aad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:08:56.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.355+0000 7f80f2aad9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.355+0000 7f80f2aad9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:08:56.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.355+0000 7f80f2aad9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.359+0000 7f80f2aad9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:08:56.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.359+0000 7f80f2aad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:08:56.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.363+0000 7f7fa6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:56.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.367+0000 7f80f2aad9c0 20 remove_watcher() i=0 2024-09-19T14:08:56.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.367+0000 7f80f2aad9c0 2 removed watcher, disabling cache 2024-09-19T14:08:56.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.367+0000 7f80f2aad9c0 20 remove_watcher() i=1 2024-09-19T14:08:56.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.371+0000 7f80f2aad9c0 20 remove_watcher() i=2 2024-09-19T14:08:56.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.375+0000 7f80f2aad9c0 20 remove_watcher() i=3 2024-09-19T14:08:56.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.375+0000 7f80f2aad9c0 20 remove_watcher() i=4 2024-09-19T14:08:56.376 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.375+0000 7f80f2aad9c0 20 remove_watcher() i=5 2024-09-19T14:08:56.378 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.379+0000 7f80f2aad9c0 20 remove_watcher() i=6 2024-09-19T14:08:56.379 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.379+0000 7f80f2aad9c0 20 remove_watcher() i=7 2024-09-19T14:08:56.394 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:56.394 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:08:56.394 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-commit-target-layout id: dbb1da81-49d0-421a-b677-974869a7f103.4620.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:08:56.394 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:56.394 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-19T14:08:56.429 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:08:56.429 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:08:56.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.475+0000 7f18ebc849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.475+0000 7f18ebc849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:56.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.475+0000 7f18ebc849c0 20 realm 2024-09-19T14:08:56.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.475+0000 7f18ebc849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.475+0000 7f18ebc849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:56.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.475+0000 7f18ebc849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:08:56.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.475+0000 7f18ebc849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.475+0000 7f18ebc849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:56.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.475+0000 7f18ebc849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.477 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.479+0000 7f18ebc849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:56.477 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.479+0000 7f18ebc849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.478 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.479+0000 7f18ebc849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:08:56.478 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.479+0000 7f18ebc849c0 20 searching for the correct realm 2024-09-19T14:08:56.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.483+0000 7f18e8f89640 0 -- 172.21.15.153:0/1810133887 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f18dc024040 msgr2=0x7f18dc065470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:56.490 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.491+0000 7f18e9f8b640 0 -- 172.21.15.153:0/1810133887 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7f18d411e070 msgr2=0x7f18d410f240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:56.496 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.495+0000 7f18ebc849c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:08:56.496 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.495+0000 7f18ebc849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:08:56.496 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.495+0000 7f18ebc849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:08:56.496 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.495+0000 7f18ebc849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:08:56.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.495+0000 7f18ebc849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:08:56.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.495+0000 7f18ebc849c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:08:56.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.495+0000 7f18ebc849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.495+0000 7f18ebc849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:56.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.495+0000 7f18ebc849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.499+0000 7f18ebc849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:56.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.499+0000 7f18ebc849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.499+0000 7f18ebc849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:08:56.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.499+0000 7f18ebc849c0 20 zone default found 2024-09-19T14:08:56.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.499+0000 7f18ebc849c0 4 Realm: () 2024-09-19T14:08:56.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.499+0000 7f18ebc849c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:08:56.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.499+0000 7f18ebc849c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:08:56.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.499+0000 7f18ebc849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:08:56.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.499+0000 7f18ebc849c0 20 zonegroup default 2024-09-19T14:08:56.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.499+0000 7f18ebc849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.499+0000 7f18ebc849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:56.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.499+0000 7f18ebc849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.499+0000 7f18ebc849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:56.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.499+0000 7f18ebc849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.499+0000 7f18ebc849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:56.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.499+0000 7f18ebc849c0 20 started sync module instance, tier type = 2024-09-19T14:08:56.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.499+0000 7f18ebc849c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:08:56.515 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.515+0000 7f18ebc849c0 20 add_watcher() i=0 2024-09-19T14:08:56.515 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.515+0000 7f18ebc849c0 20 add_watcher() i=1 2024-09-19T14:08:56.515 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.515+0000 7f18ebc849c0 20 add_watcher() i=2 2024-09-19T14:08:56.515 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.515+0000 7f18ebc849c0 20 add_watcher() i=3 2024-09-19T14:08:56.515 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.515+0000 7f18ebc849c0 20 add_watcher() i=4 2024-09-19T14:08:56.515 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.515+0000 7f18ebc849c0 20 add_watcher() i=5 2024-09-19T14:08:56.515 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.515+0000 7f18ebc849c0 20 add_watcher() i=6 2024-09-19T14:08:56.515 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.515+0000 7f18ebc849c0 20 add_watcher() i=7 2024-09-19T14:08:56.516 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.515+0000 7f18ebc849c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:08:56.518 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.519+0000 7f179ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:56.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.519+0000 7f18ebc849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:08:56.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.519+0000 7f18ebc849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:08:56.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.519+0000 7f18ebc849c0 5 note: GC not initialized 2024-09-19T14:08:56.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.519+0000 7f179efe5640 20 reqs_thread_entry: start 2024-09-19T14:08:56.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.519+0000 7f18ebc849c0 20 init_complete bucket index max shards: 11 2024-09-19T14:08:56.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.519+0000 7f18ebc849c0 20 Filter name: none 2024-09-19T14:08:56.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.519+0000 7f179cfe1640 20 reqs_thread_entry: start 2024-09-19T14:08:56.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.519+0000 7f18ebc849c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-19T14:08:56.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.519+0000 7f18ebc849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.519+0000 7f18ebc849c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:08:56.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.519+0000 7f18ebc849c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-19T14:08:56.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.519+0000 7f18ebc849c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-19T14:08:56.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.519+0000 7f18ebc849c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 : miss 2024-09-19T14:08:56.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.519+0000 7f18ebc849c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.523+0000 7f18ebc849c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:08:56.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.523+0000 7f18ebc849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 info.flags=0x17 2024-09-19T14:08:56.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.523+0000 7f18ebc849c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 to cache LRU end 2024-09-19T14:08:56.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.523+0000 7f18ebc849c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:08:56.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.523+0000 7f18ebc849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:56.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.523+0000 7f18ebc849c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 2024-09-19T14:08:56.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.535+0000 7f18ebc849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 info.flags=0x17 2024-09-19T14:08:56.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.535+0000 7f18ebc849c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 to cache LRU end 2024-09-19T14:08:56.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.535+0000 7f18ebc849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:56.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.535+0000 7f18ebc849c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30, ofs0, ns] 2024-09-19T14:08:56.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.535+0000 7f17ccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333481 cookie 94740672277264 notifier 7158 bl.length()=931 2024-09-19T14:08:56.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.535+0000 7f17ccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 info.flags=0x17 2024-09-19T14:08:56.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.535+0000 7f17ccff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 to cache LRU end 2024-09-19T14:08:56.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.535+0000 7f17ccff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:56.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.535+0000 7f18ebc849c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.30]): orig_sources= new_sources= 2024-09-19T14:08:56.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.535+0000 7f18ebc849c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.30]): potential sources added=[] removed=[] 2024-09-19T14:08:56.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.535+0000 7f18ebc849c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.30]): orig_dests= new_dests= 2024-09-19T14:08:56.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.535+0000 7f18ebc849c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.30]): potential dests added=[] removed=[] 2024-09-19T14:08:56.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1.0 2024-09-19T14:08:56.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1.0 2024-09-19T14:08:56.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1.1 2024-09-19T14:08:56.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1.1 2024-09-19T14:08:56.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1.2 2024-09-19T14:08:56.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1.2 2024-09-19T14:08:56.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1.3 2024-09-19T14:08:56.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1.3 2024-09-19T14:08:56.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1.4 2024-09-19T14:08:56.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1.4 2024-09-19T14:08:56.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1.5 2024-09-19T14:08:56.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1.5 2024-09-19T14:08:56.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1.6 2024-09-19T14:08:56.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1.6 2024-09-19T14:08:56.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1.7 2024-09-19T14:08:56.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1.7 2024-09-19T14:08:56.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1.8 2024-09-19T14:08:56.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1.8 2024-09-19T14:08:56.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1.9 2024-09-19T14:08:56.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1.9 2024-09-19T14:08:56.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1.10 2024-09-19T14:08:56.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1.10 2024-09-19T14:08:56.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1.11 2024-09-19T14:08:56.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1.11 2024-09-19T14:08:56.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.0 2024-09-19T14:08:56.549 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1 2024-09-19T14:08:56.549 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2 2024-09-19T14:08:56.549 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.547+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.3 2024-09-19T14:08:56.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.551+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.4 2024-09-19T14:08:56.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.551+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.5 2024-09-19T14:08:56.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.551+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.6 2024-09-19T14:08:56.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.551+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.7 2024-09-19T14:08:56.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.555+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.8 2024-09-19T14:08:56.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.555+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.9 2024-09-19T14:08:56.554 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.555+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.10 2024-09-19T14:08:56.562 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.563+0000 7f18ebc849c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 : hit (requested=0x17, cached=0x17) 2024-09-19T14:08:56.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.563+0000 7f18ebc849c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 2024-09-19T14:08:56.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.563+0000 7f18ebc849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 info.flags=0x17 2024-09-19T14:08:56.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.563+0000 7f18ebc849c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 to cache LRU end 2024-09-19T14:08:56.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.563+0000 7f18ebc849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:56.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.563+0000 7f18ebc849c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30, ofs0, ns] 2024-09-19T14:08:56.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.567+0000 7f17ccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333482 cookie 94740672277264 notifier 7158 bl.length()=931 2024-09-19T14:08:56.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.567+0000 7f17ccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 info.flags=0x17 2024-09-19T14:08:56.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.567+0000 7f17ccff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 to cache LRU end 2024-09-19T14:08:56.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.567+0000 7f17ccff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:56.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.567+0000 7f18ebc849c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.30]): orig_sources= new_sources= 2024-09-19T14:08:56.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.567+0000 7f18ebc849c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.30]): potential sources added=[] removed=[] 2024-09-19T14:08:56.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.567+0000 7f18ebc849c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.30]): orig_dests= new_dests= 2024-09-19T14:08:56.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.567+0000 7f18ebc849c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.30]): potential dests added=[] removed=[] 2024-09-19T14:08:56.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.571+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.0 2024-09-19T14:08:56.573 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.575+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1 2024-09-19T14:08:56.573 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.575+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2 2024-09-19T14:08:56.573 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.575+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.3 2024-09-19T14:08:56.575 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.575+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.4 2024-09-19T14:08:56.575 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.575+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.5 2024-09-19T14:08:56.576 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.575+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.6 2024-09-19T14:08:56.576 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.575+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.7 2024-09-19T14:08:56.577 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.575+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.8 2024-09-19T14:08:56.577 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.579+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.9 2024-09-19T14:08:56.577 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.579+0000 7f18ebc849c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.10 2024-09-19T14:08:56.578 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.579+0000 7f18ebc849c0 -1 Injecting error=-5 at location=commit_target_layout 2024-09-19T14:08:56.578 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.579+0000 7f18ebc849c0 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-19T14:08:56.587 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.587+0000 7f179ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:56.592 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.591+0000 7f18ebc849c0 20 remove_watcher() i=0 2024-09-19T14:08:56.592 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.591+0000 7f18ebc849c0 2 removed watcher, disabling cache 2024-09-19T14:08:56.594 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.595+0000 7f18ebc849c0 20 remove_watcher() i=1 2024-09-19T14:08:56.596 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.595+0000 7f18ebc849c0 20 remove_watcher() i=2 2024-09-19T14:08:56.598 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.599+0000 7f18ebc849c0 20 remove_watcher() i=3 2024-09-19T14:08:56.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.599+0000 7f18ebc849c0 20 remove_watcher() i=4 2024-09-19T14:08:56.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.603+0000 7f18ebc849c0 20 remove_watcher() i=5 2024-09-19T14:08:56.603 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.603+0000 7f18ebc849c0 20 remove_watcher() i=6 2024-09-19T14:08:56.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.603+0000 7f18ebc849c0 20 remove_watcher() i=7 2024-09-19T14:08:56.620 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-19T14:08:56.649 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:08:56.649 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:08:56.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.691+0000 7f56ceece9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.695+0000 7f56ceece9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:56.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.695+0000 7f56ceece9c0 20 realm 2024-09-19T14:08:56.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.695+0000 7f56ceece9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.695+0000 7f56ceece9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:56.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.695+0000 7f56ceece9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:08:56.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.695+0000 7f56ceece9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.695+0000 7f56ceece9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:56.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.695+0000 7f56ceece9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.695+0000 7f56ceece9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:56.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.695+0000 7f56ceece9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.699+0000 7f56ceece9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:08:56.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.699+0000 7f56ceece9c0 20 searching for the correct realm 2024-09-19T14:08:56.704 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.703+0000 7f56cc1d3640 0 -- 172.21.15.153:0/1278788603 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f56bc082070 msgr2=0x7f56bc05d520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:56.709 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.711+0000 7f56cd1d5640 0 -- 172.21.15.153:0/1278788603 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7f56c00e4020 msgr2=0x7f56c00e4480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:08:56.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.715+0000 7f56ceece9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:08:56.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.715+0000 7f56ceece9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:08:56.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.715+0000 7f56ceece9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:08:56.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.715+0000 7f56ceece9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:08:56.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.715+0000 7f56ceece9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:08:56.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.715+0000 7f56ceece9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:08:56.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.715+0000 7f56ceece9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.715+0000 7f56ceece9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:56.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.715+0000 7f56ceece9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.719+0000 7f56ceece9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:56.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.719+0000 7f56ceece9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.719+0000 7f56ceece9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:08:56.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.719+0000 7f56ceece9c0 20 zone default found 2024-09-19T14:08:56.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.719+0000 7f56ceece9c0 4 Realm: () 2024-09-19T14:08:56.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.719+0000 7f56ceece9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:08:56.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.719+0000 7f56ceece9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:08:56.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.719+0000 7f56ceece9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:08:56.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.719+0000 7f56ceece9c0 20 zonegroup default 2024-09-19T14:08:56.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.719+0000 7f56ceece9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.719+0000 7f56ceece9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:56.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.719+0000 7f56ceece9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.719+0000 7f56ceece9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:56.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.719+0000 7f56ceece9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.719+0000 7f56ceece9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:56.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.719+0000 7f56ceece9c0 20 started sync module instance, tier type = 2024-09-19T14:08:56.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.719+0000 7f56ceece9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:08:56.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.735+0000 7f56ceece9c0 20 add_watcher() i=0 2024-09-19T14:08:56.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.735+0000 7f56ceece9c0 20 add_watcher() i=1 2024-09-19T14:08:56.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.735+0000 7f56ceece9c0 20 add_watcher() i=2 2024-09-19T14:08:56.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.735+0000 7f56ceece9c0 20 add_watcher() i=3 2024-09-19T14:08:56.735 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.735+0000 7f56ceece9c0 20 add_watcher() i=4 2024-09-19T14:08:56.735 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.735+0000 7f56ceece9c0 20 add_watcher() i=5 2024-09-19T14:08:56.735 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.735+0000 7f56ceece9c0 20 add_watcher() i=6 2024-09-19T14:08:56.735 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.735+0000 7f56ceece9c0 20 add_watcher() i=7 2024-09-19T14:08:56.736 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.735+0000 7f56ceece9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:08:56.738 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.739+0000 7f5582fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:56.738 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.739+0000 7f56ceece9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:08:56.738 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.739+0000 7f56ceece9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:08:56.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.739+0000 7f56ceece9c0 5 note: GC not initialized 2024-09-19T14:08:56.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.739+0000 7f5581fe3640 20 reqs_thread_entry: start 2024-09-19T14:08:56.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.739+0000 7f56ceece9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:08:56.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.739+0000 7f56ceece9c0 20 Filter name: none 2024-09-19T14:08:56.740 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.739+0000 7f54f37fe640 20 reqs_thread_entry: start 2024-09-19T14:08:56.740 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.739+0000 7f56ceece9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.740 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.739+0000 7f56ceece9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:08:56.740 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.739+0000 7f56ceece9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.741 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.739+0000 7f56ceece9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-19T14:08:56.741 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.739+0000 7f56ceece9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:08:56.741 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.739+0000 7f56ceece9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.741 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.743+0000 7f56ceece9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:08:56.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.743+0000 7f56ceece9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.743+0000 7f56ceece9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-19T14:08:56.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.743+0000 7f56ceece9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:08:56.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.747+0000 7f5582fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:56.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.751+0000 7f56ceece9c0 20 remove_watcher() i=0 2024-09-19T14:08:56.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.751+0000 7f56ceece9c0 2 removed watcher, disabling cache 2024-09-19T14:08:56.752 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.751+0000 7f56ceece9c0 20 remove_watcher() i=1 2024-09-19T14:08:56.754 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.755+0000 7f56ceece9c0 20 remove_watcher() i=2 2024-09-19T14:08:56.755 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.755+0000 7f56ceece9c0 20 remove_watcher() i=3 2024-09-19T14:08:56.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.759+0000 7f56ceece9c0 20 remove_watcher() i=4 2024-09-19T14:08:56.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.759+0000 7f56ceece9c0 20 remove_watcher() i=5 2024-09-19T14:08:56.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.759+0000 7f56ceece9c0 20 remove_watcher() i=6 2024-09-19T14:08:56.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.763+0000 7f56ceece9c0 20 remove_watcher() i=7 2024-09-19T14:08:56.774 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:56.774 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:08:56.774 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-commit-target-layout id: dbb1da81-49d0-421a-b677-974869a7f103.4620.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:08:56.774 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:56.775 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:56.775 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:56.818 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:56.818 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:56.878 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T14:08:56.915 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:08:56.915 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:08:56.958 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.959+0000 7f16c33709c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.959+0000 7f16c33709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:56.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.959+0000 7f16c33709c0 20 realm 2024-09-19T14:08:56.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.959+0000 7f16c33709c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.959+0000 7f16c33709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:56.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.959+0000 7f16c33709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:08:56.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.959+0000 7f16c33709c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.959+0000 7f16c33709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:56.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.959+0000 7f16c33709c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.962 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.963+0000 7f16c33709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:56.962 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.963+0000 7f16c33709c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:56.962 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.963+0000 7f16c33709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:08:56.962 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.963+0000 7f16c33709c0 20 searching for the correct realm 2024-09-19T14:08:56.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:56.971+0000 7f16c1677640 0 -- 172.21.15.153:0/3994143336 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7f16a802a040 msgr2=0x7f16a804a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:57.187 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.187+0000 7f16c0e76640 0 -- 172.21.15.153:0/3994143336 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x55c9be957790 msgr2=0x55c9be959ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:57.194 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.195+0000 7f16c33709c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:08:57.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.195+0000 7f16c33709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:08:57.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.195+0000 7f16c33709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:08:57.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.195+0000 7f16c33709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:08:57.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.195+0000 7f16c33709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:08:57.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.195+0000 7f16c33709c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:08:57.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.195+0000 7f16c33709c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:57.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.195+0000 7f16c33709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:57.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.195+0000 7f16c33709c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:57.196 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.195+0000 7f16c33709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:57.196 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.195+0000 7f16c33709c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:57.197 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.199+0000 7f16c33709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:08:57.197 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.199+0000 7f16c33709c0 20 zone default found 2024-09-19T14:08:57.197 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.199+0000 7f16c33709c0 4 Realm: () 2024-09-19T14:08:57.197 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.199+0000 7f16c33709c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:08:57.197 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.199+0000 7f16c33709c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:08:57.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.199+0000 7f16c33709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:08:57.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.199+0000 7f16c33709c0 20 zonegroup default 2024-09-19T14:08:57.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.199+0000 7f16c33709c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:57.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.199+0000 7f16c33709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:57.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.199+0000 7f16c33709c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:57.199 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.199+0000 7f16c33709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:57.199 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.199+0000 7f16c33709c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:57.199 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.199+0000 7f16c33709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:57.199 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.199+0000 7f16c33709c0 20 started sync module instance, tier type = 2024-09-19T14:08:57.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.199+0000 7f16c33709c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:08:57.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.223+0000 7f16c33709c0 20 add_watcher() i=0 2024-09-19T14:08:57.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.223+0000 7f16c33709c0 20 add_watcher() i=1 2024-09-19T14:08:57.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.223+0000 7f16c33709c0 20 add_watcher() i=2 2024-09-19T14:08:57.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.223+0000 7f16c33709c0 20 add_watcher() i=3 2024-09-19T14:08:57.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.223+0000 7f16c33709c0 20 add_watcher() i=4 2024-09-19T14:08:57.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.223+0000 7f16c33709c0 20 add_watcher() i=5 2024-09-19T14:08:57.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.223+0000 7f16c33709c0 20 add_watcher() i=6 2024-09-19T14:08:57.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.227+0000 7f16c33709c0 20 add_watcher() i=7 2024-09-19T14:08:57.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.227+0000 7f16c33709c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:08:57.229 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.231+0000 7f15777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:57.230 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.231+0000 7f16c33709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:08:57.230 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.231+0000 7f16c33709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:08:57.230 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.231+0000 7f16c33709c0 5 note: GC not initialized 2024-09-19T14:08:57.231 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.231+0000 7f15767e4640 20 reqs_thread_entry: start 2024-09-19T14:08:57.231 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.231+0000 7f16c33709c0 20 init_complete bucket index max shards: 11 2024-09-19T14:08:57.231 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.231+0000 7f16c33709c0 20 Filter name: none 2024-09-19T14:08:57.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.231+0000 7f156f7fe640 20 reqs_thread_entry: start 2024-09-19T14:08:57.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.231+0000 7f16c33709c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-19T14:08:57.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.231+0000 7f16c33709c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:57.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.231+0000 7f16c33709c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:08:57.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.231+0000 7f16c33709c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-19T14:08:57.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.231+0000 7f16c33709c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-19T14:08:57.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.231+0000 7f16c33709c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 : miss 2024-09-19T14:08:57.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.231+0000 7f16c33709c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:57.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.235+0000 7f16c33709c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-19T14:08:57.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.235+0000 7f16c33709c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 info.flags=0x17 2024-09-19T14:08:57.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.235+0000 7f16c33709c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 to cache LRU end 2024-09-19T14:08:57.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.235+0000 7f16c33709c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:08:57.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.235+0000 7f16c33709c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:57.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.235+0000 7f16c33709c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 2024-09-19T14:08:57.235 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.235+0000 7f16c33709c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T14:08:57.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.251+0000 7f16c33709c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 info.flags=0x17 2024-09-19T14:08:57.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.251+0000 7f16c33709c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 to cache LRU end 2024-09-19T14:08:57.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.251+0000 7f16c33709c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:57.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.251+0000 7f16c33709c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30, ofs0, ns] 2024-09-19T14:08:57.252 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.251+0000 7f1597fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333483 cookie 94324974305520 notifier 7191 bl.length()=931 2024-09-19T14:08:57.252 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.251+0000 7f1597fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 info.flags=0x17 2024-09-19T14:08:57.252 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.251+0000 7f1597fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 to cache LRU end 2024-09-19T14:08:57.252 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.251+0000 7f1597fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:57.254 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.255+0000 7f16c33709c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.30]): orig_sources= new_sources= 2024-09-19T14:08:57.254 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.255+0000 7f16c33709c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.30]): potential sources added=[] removed=[] 2024-09-19T14:08:57.254 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.255+0000 7f16c33709c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.30]): orig_dests= new_dests= 2024-09-19T14:08:57.255 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.255+0000 7f16c33709c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.30]): potential dests added=[] removed=[] 2024-09-19T14:08:57.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2.0 2024-09-19T14:08:57.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2.0 2024-09-19T14:08:57.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2.1 2024-09-19T14:08:57.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2.1 2024-09-19T14:08:57.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2.2 2024-09-19T14:08:57.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2.2 2024-09-19T14:08:57.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2.3 2024-09-19T14:08:57.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2.3 2024-09-19T14:08:57.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2.4 2024-09-19T14:08:57.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2.4 2024-09-19T14:08:57.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2.5 2024-09-19T14:08:57.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2.5 2024-09-19T14:08:57.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2.6 2024-09-19T14:08:57.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2.6 2024-09-19T14:08:57.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2.7 2024-09-19T14:08:57.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2.7 2024-09-19T14:08:57.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2.8 2024-09-19T14:08:57.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2.8 2024-09-19T14:08:57.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2.9 2024-09-19T14:08:57.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2.9 2024-09-19T14:08:57.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2.10 2024-09-19T14:08:57.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2.10 2024-09-19T14:08:57.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2.11 2024-09-19T14:08:57.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2.11 2024-09-19T14:08:57.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.263+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.0 2024-09-19T14:08:57.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.267+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1 2024-09-19T14:08:57.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.267+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2 2024-09-19T14:08:57.267 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.267+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.3 2024-09-19T14:08:57.267 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.267+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.4 2024-09-19T14:08:57.268 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.267+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.5 2024-09-19T14:08:57.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.271+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.6 2024-09-19T14:08:57.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.271+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.7 2024-09-19T14:08:57.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.271+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.8 2024-09-19T14:08:57.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.271+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.9 2024-09-19T14:08:57.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.271+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.10 2024-09-19T14:08:57.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.283+0000 7f16c33709c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 : hit (requested=0x17, cached=0x17) 2024-09-19T14:08:57.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.283+0000 7f16c33709c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 2024-09-19T14:08:57.284 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.283+0000 7f16c33709c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 info.flags=0x17 2024-09-19T14:08:57.284 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.283+0000 7f16c33709c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 to cache LRU end 2024-09-19T14:08:57.284 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.283+0000 7f16c33709c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:57.284 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.283+0000 7f16c33709c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30, ofs0, ns] 2024-09-19T14:08:57.284 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.283+0000 7f15977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333484 cookie 94324974305520 notifier 7191 bl.length()=931 2024-09-19T14:08:57.284 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.283+0000 7f15977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 info.flags=0x17 2024-09-19T14:08:57.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.283+0000 7f15977fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 to cache LRU end 2024-09-19T14:08:57.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.283+0000 7f15977fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:57.286 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.287+0000 7f16c33709c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.30]): orig_sources= new_sources= 2024-09-19T14:08:57.286 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.287+0000 7f16c33709c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.30]): potential sources added=[] removed=[] 2024-09-19T14:08:57.287 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.287+0000 7f16c33709c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.30]): orig_dests= new_dests= 2024-09-19T14:08:57.287 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.287+0000 7f16c33709c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.30]): potential dests added=[] removed=[] 2024-09-19T14:08:57.292 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.291+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.0 2024-09-19T14:08:57.292 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.291+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.1 2024-09-19T14:08:57.293 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.295+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.2 2024-09-19T14:08:57.293 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.295+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.3 2024-09-19T14:08:57.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.295+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.4 2024-09-19T14:08:57.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.295+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.5 2024-09-19T14:08:57.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.295+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.6 2024-09-19T14:08:57.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.295+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.7 2024-09-19T14:08:57.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.299+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.8 2024-09-19T14:08:57.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.299+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.9 2024-09-19T14:08:57.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.299+0000 7f16c33709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.30.10 2024-09-19T14:08:57.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.299+0000 7f16c33709c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 : hit (requested=0x17, cached=0x17) 2024-09-19T14:08:57.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.299+0000 7f16c33709c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 2024-09-19T14:08:57.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.303+0000 7f16c33709c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 info.flags=0x17 2024-09-19T14:08:57.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.303+0000 7f16c33709c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 to cache LRU end 2024-09-19T14:08:57.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.303+0000 7f16c33709c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:57.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.303+0000 7f16c33709c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30, ofs0, ns] 2024-09-19T14:08:57.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.303+0000 7f1597fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333485 cookie 94324974305520 notifier 7191 bl.length()=899 2024-09-19T14:08:57.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.303+0000 7f1597fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 info.flags=0x17 2024-09-19T14:08:57.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.303+0000 7f1597fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.30 to cache LRU end 2024-09-19T14:08:57.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.303+0000 7f1597fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:08:57.305 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.307+0000 7f16c33709c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.30]): orig_sources= new_sources= 2024-09-19T14:08:57.305 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.307+0000 7f16c33709c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.30]): potential sources added=[] removed=[] 2024-09-19T14:08:57.305 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.307+0000 7f16c33709c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.30]): orig_dests= new_dests= 2024-09-19T14:08:57.305 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.307+0000 7f16c33709c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.30]): potential dests added=[] removed=[] 2024-09-19T14:08:57.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.311+0000 7f16c33709c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-19T14:08:57.314 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.315+0000 7f15777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:57.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.319+0000 7f16c33709c0 20 remove_watcher() i=0 2024-09-19T14:08:57.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.319+0000 7f16c33709c0 2 removed watcher, disabling cache 2024-09-19T14:08:57.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.323+0000 7f16c33709c0 20 remove_watcher() i=1 2024-09-19T14:08:57.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.323+0000 7f16c33709c0 20 remove_watcher() i=2 2024-09-19T14:08:57.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.327+0000 7f16c33709c0 20 remove_watcher() i=3 2024-09-19T14:08:57.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.331+0000 7f16c33709c0 20 remove_watcher() i=4 2024-09-19T14:08:57.331 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.331+0000 7f16c33709c0 20 remove_watcher() i=5 2024-09-19T14:08:57.332 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.331+0000 7f16c33709c0 20 remove_watcher() i=6 2024-09-19T14:08:57.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.335+0000 7f16c33709c0 20 remove_watcher() i=7 2024-09-19T14:08:57.352 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-19T14:08:57.383 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:08:57.383 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:08:57.428 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.427+0000 7f451e6af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:57.430 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.431+0000 7f451e6af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:57.430 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.431+0000 7f451e6af9c0 20 realm 2024-09-19T14:08:57.430 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.431+0000 7f451e6af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:57.430 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.431+0000 7f451e6af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:57.431 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.431+0000 7f451e6af9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:08:57.431 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.431+0000 7f451e6af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:57.431 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.431+0000 7f451e6af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:57.431 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.431+0000 7f451e6af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:57.432 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.431+0000 7f451e6af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:57.432 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.431+0000 7f451e6af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:57.432 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.431+0000 7f451e6af9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:08:57.432 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.431+0000 7f451e6af9c0 20 searching for the correct realm 2024-09-19T14:08:57.437 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.439+0000 7f451c9b6640 0 -- 172.21.15.153:0/1524305801 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f4504074c20 msgr2=0x7f450403b9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:08:57.445 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.443+0000 7f451c1b5640 0 -- 172.21.15.153:0/1524305801 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f45040460f0 msgr2=0x7f4504045ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:08:57.660 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.659+0000 7f451e6af9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:08:57.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.659+0000 7f451e6af9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:08:57.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.659+0000 7f451e6af9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:08:57.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.659+0000 7f451e6af9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:08:57.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.659+0000 7f451e6af9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:08:57.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.659+0000 7f451e6af9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:08:57.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.659+0000 7f451e6af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:57.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.663+0000 7f451e6af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:57.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.663+0000 7f451e6af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:57.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.663+0000 7f451e6af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:08:57.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.663+0000 7f451e6af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:57.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.663+0000 7f451e6af9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:08:57.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.663+0000 7f451e6af9c0 20 zone default found 2024-09-19T14:08:57.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.663+0000 7f451e6af9c0 4 Realm: () 2024-09-19T14:08:57.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.663+0000 7f451e6af9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:08:57.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.663+0000 7f451e6af9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:08:57.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.663+0000 7f451e6af9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:08:57.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.663+0000 7f451e6af9c0 20 zonegroup default 2024-09-19T14:08:57.664 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.663+0000 7f451e6af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:57.664 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.663+0000 7f451e6af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:57.664 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.663+0000 7f451e6af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:57.664 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.663+0000 7f451e6af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:57.664 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.663+0000 7f451e6af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:57.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.667+0000 7f451e6af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:08:57.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.667+0000 7f451e6af9c0 20 started sync module instance, tier type = 2024-09-19T14:08:57.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.667+0000 7f451e6af9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:08:57.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.687+0000 7f451e6af9c0 20 add_watcher() i=0 2024-09-19T14:08:57.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.687+0000 7f451e6af9c0 20 add_watcher() i=1 2024-09-19T14:08:57.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.687+0000 7f451e6af9c0 20 add_watcher() i=2 2024-09-19T14:08:57.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.687+0000 7f451e6af9c0 20 add_watcher() i=3 2024-09-19T14:08:57.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.687+0000 7f451e6af9c0 20 add_watcher() i=4 2024-09-19T14:08:57.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.687+0000 7f451e6af9c0 20 add_watcher() i=5 2024-09-19T14:08:57.688 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.687+0000 7f451e6af9c0 20 add_watcher() i=6 2024-09-19T14:08:57.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.691+0000 7f451e6af9c0 20 add_watcher() i=7 2024-09-19T14:08:57.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.691+0000 7f451e6af9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:08:57.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.691+0000 7f43d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:57.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.695+0000 7f451e6af9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:08:57.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.695+0000 7f451e6af9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:08:57.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.695+0000 7f451e6af9c0 5 note: GC not initialized 2024-09-19T14:08:57.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.695+0000 7f43d17e2640 20 reqs_thread_entry: start 2024-09-19T14:08:57.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.695+0000 7f451e6af9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:08:57.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.695+0000 7f451e6af9c0 20 Filter name: none 2024-09-19T14:08:57.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.695+0000 7f4342ffd640 20 reqs_thread_entry: start 2024-09-19T14:08:57.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.695+0000 7f451e6af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:57.696 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.695+0000 7f451e6af9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:08:57.696 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.695+0000 7f451e6af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:57.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.699+0000 7f451e6af9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:08:57.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.699+0000 7f451e6af9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:08:57.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.699+0000 7f451e6af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:57.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.699+0000 7f451e6af9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:08:57.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.699+0000 7f451e6af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:08:57.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.699+0000 7f451e6af9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:08:57.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.699+0000 7f451e6af9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:08:57.702 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.703+0000 7f43d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:08:57.707 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.707+0000 7f451e6af9c0 20 remove_watcher() i=0 2024-09-19T14:08:57.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.707+0000 7f451e6af9c0 2 removed watcher, disabling cache 2024-09-19T14:08:57.710 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.711+0000 7f451e6af9c0 20 remove_watcher() i=1 2024-09-19T14:08:57.713 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.711+0000 7f451e6af9c0 20 remove_watcher() i=2 2024-09-19T14:08:57.715 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.715+0000 7f451e6af9c0 20 remove_watcher() i=3 2024-09-19T14:08:57.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.719+0000 7f451e6af9c0 20 remove_watcher() i=4 2024-09-19T14:08:57.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.719+0000 7f451e6af9c0 20 remove_watcher() i=5 2024-09-19T14:08:57.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.719+0000 7f451e6af9c0 20 remove_watcher() i=6 2024-09-19T14:08:57.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:08:57.723+0000 7f451e6af9c0 20 remove_watcher() i=7 2024-09-19T14:08:57.736 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:57.737 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:08:57.737 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-commit-target-layout id: dbb1da81-49d0-421a-b677-974869a7f103.4620.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T14:08:57.737 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:57.738 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:57.738 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:57.766 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:57.766 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:58.333 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:58.333 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:58.708 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-19T14:08:58.708 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:08:58.710 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:58.710 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:58.845 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:58.845 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:58.932 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:58.932 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:59.038 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:59.038 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:59.137 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:59.137 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:59.223 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:59.224 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:59.323 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:59.324 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:59.420 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:59.420 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:59.516 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:59.517 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:59.616 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:59.616 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:59.718 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:59.718 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:59.814 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:59.814 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:08:59.909 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:08:59.910 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:00.009 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:00.009 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:00.106 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:00.107 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:00.205 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:00.205 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:00.306 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:00.306 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:00.403 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:00.403 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:00.506 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:00.506 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:00.607 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:00.607 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:00.710 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:00.710 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:00.810 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:00.810 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:00.908 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-19T14:09:00.940 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:09:00.940 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:09:00.984 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:00.983+0000 7fbb62a169c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:00.987 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:00.987+0000 7fbb62a169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:00.987 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:00.987+0000 7fbb62a169c0 20 realm 2024-09-19T14:09:00.987 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:00.987+0000 7fbb62a169c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:00.987 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:00.987+0000 7fbb62a169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:00.987 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:00.987+0000 7fbb62a169c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:09:00.987 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:00.987+0000 7fbb62a169c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:00.987 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:00.987+0000 7fbb62a169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:00.987 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:00.987+0000 7fbb62a169c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:00.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:00.987+0000 7fbb62a169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:00.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:00.987+0000 7fbb62a169c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:00.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:00.987+0000 7fbb62a169c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:09:00.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:00.987+0000 7fbb62a169c0 20 searching for the correct realm 2024-09-19T14:09:00.994 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:00.995+0000 7fbb60d1d640 0 -- 172.21.15.153:0/3035285896 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7fbb5409f040 msgr2=0x7fbb54073390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:01.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:00.999+0000 7fbb6051c640 0 -- 172.21.15.153:0/3035285896 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fbb54008050 msgr2=0x7fbb5404c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:01.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.215+0000 7fbb62a169c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:09:01.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.215+0000 7fbb62a169c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:09:01.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.215+0000 7fbb62a169c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:09:01.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.215+0000 7fbb62a169c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:09:01.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.215+0000 7fbb62a169c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:09:01.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.215+0000 7fbb62a169c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:09:01.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.215+0000 7fbb62a169c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.218 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.219+0000 7fbb62a169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:01.218 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.219+0000 7fbb62a169c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.218 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.219+0000 7fbb62a169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:01.218 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.219+0000 7fbb62a169c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.219 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.219+0000 7fbb62a169c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:09:01.219 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.219+0000 7fbb62a169c0 20 zone default found 2024-09-19T14:09:01.219 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.219+0000 7fbb62a169c0 4 Realm: () 2024-09-19T14:09:01.219 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.219+0000 7fbb62a169c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:09:01.219 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.219+0000 7fbb62a169c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:09:01.219 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.219+0000 7fbb62a169c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:09:01.220 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.219+0000 7fbb62a169c0 20 zonegroup default 2024-09-19T14:09:01.220 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.219+0000 7fbb62a169c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.220 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.219+0000 7fbb62a169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:01.220 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.219+0000 7fbb62a169c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.221 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.219+0000 7fbb62a169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:01.221 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.219+0000 7fbb62a169c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.221 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.223+0000 7fbb62a169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:01.221 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.223+0000 7fbb62a169c0 20 started sync module instance, tier type = 2024-09-19T14:09:01.222 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.223+0000 7fbb62a169c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:09:01.243 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.243+0000 7fbb62a169c0 20 add_watcher() i=0 2024-09-19T14:09:01.243 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.243+0000 7fbb62a169c0 20 add_watcher() i=1 2024-09-19T14:09:01.243 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.243+0000 7fbb62a169c0 20 add_watcher() i=2 2024-09-19T14:09:01.243 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.243+0000 7fbb62a169c0 20 add_watcher() i=3 2024-09-19T14:09:01.243 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.243+0000 7fbb62a169c0 20 add_watcher() i=4 2024-09-19T14:09:01.243 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.243+0000 7fbb62a169c0 20 add_watcher() i=5 2024-09-19T14:09:01.243 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.243+0000 7fbb62a169c0 20 add_watcher() i=6 2024-09-19T14:09:01.245 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.247+0000 7fbb62a169c0 20 add_watcher() i=7 2024-09-19T14:09:01.245 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.247+0000 7fbb62a169c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:09:01.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.247+0000 7fba16fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:01.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.251+0000 7fbb62a169c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:09:01.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.251+0000 7fbb62a169c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:09:01.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.251+0000 7fbb62a169c0 5 note: GC not initialized 2024-09-19T14:09:01.250 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.251+0000 7fba15fdb640 20 reqs_thread_entry: start 2024-09-19T14:09:01.250 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.251+0000 7fbb62a169c0 20 init_complete bucket index max shards: 11 2024-09-19T14:09:01.250 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.251+0000 7fbb62a169c0 20 Filter name: none 2024-09-19T14:09:01.250 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.251+0000 7fb9877fe640 20 reqs_thread_entry: start 2024-09-19T14:09:01.250 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.251+0000 7fbb62a169c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.251+0000 7fbb62a169c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:09:01.252 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.251+0000 7fbb62a169c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.255+0000 7fbb62a169c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:09:01.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.255+0000 7fbb62a169c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:09:01.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.255+0000 7fbb62a169c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.254 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.255+0000 7fbb62a169c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:09:01.254 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.255+0000 7fbb62a169c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.255 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.255+0000 7fbb62a169c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:09:01.255 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.255+0000 7fbb62a169c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:09:01.259 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.259+0000 7fba16fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:01.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.263+0000 7fbb62a169c0 20 remove_watcher() i=0 2024-09-19T14:09:01.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.263+0000 7fbb62a169c0 2 removed watcher, disabling cache 2024-09-19T14:09:01.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.267+0000 7fbb62a169c0 20 remove_watcher() i=1 2024-09-19T14:09:01.268 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.267+0000 7fbb62a169c0 20 remove_watcher() i=2 2024-09-19T14:09:01.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.271+0000 7fbb62a169c0 20 remove_watcher() i=3 2024-09-19T14:09:01.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.271+0000 7fbb62a169c0 20 remove_watcher() i=4 2024-09-19T14:09:01.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.275+0000 7fbb62a169c0 20 remove_watcher() i=5 2024-09-19T14:09:01.274 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.275+0000 7fbb62a169c0 20 remove_watcher() i=6 2024-09-19T14:09:01.276 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.275+0000 7fbb62a169c0 20 remove_watcher() i=7 2024-09-19T14:09:01.291 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:01.291 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:09:01.291 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-commit-target-layout id: dbb1da81-49d0-421a-b677-974869a7f103.4620.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:09:01.291 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:01.292 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-19T14:09:01.327 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:09:01.327 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:09:01.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.371+0000 7f4d5f5a79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.375+0000 7f4d5f5a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:01.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.375+0000 7f4d5f5a79c0 20 realm 2024-09-19T14:09:01.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.375+0000 7f4d5f5a79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.375+0000 7f4d5f5a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:01.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.375+0000 7f4d5f5a79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:09:01.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.375+0000 7f4d5f5a79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.375+0000 7f4d5f5a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:01.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.375+0000 7f4d5f5a79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.376 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.375+0000 7f4d5f5a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:01.376 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.375+0000 7f4d5f5a79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.376 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.375+0000 7f4d5f5a79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:09:01.376 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.375+0000 7f4d5f5a79c0 20 searching for the correct realm 2024-09-19T14:09:01.379 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.379+0000 7f4d5d0ad640 0 -- 172.21.15.153:0/3147116241 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x7f4d58023990 msgr2=0x7f4d58008460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:01.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.387+0000 7f4d5d8ae640 0 -- 172.21.15.153:0/3147116241 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f4d48027080 msgr2=0x7f4d4805d410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:01.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.395+0000 7f4d5f5a79c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:09:01.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.395+0000 7f4d5f5a79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:09:01.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.395+0000 7f4d5f5a79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:09:01.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.395+0000 7f4d5f5a79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:09:01.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.395+0000 7f4d5f5a79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:09:01.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.395+0000 7f4d5f5a79c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:09:01.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.395+0000 7f4d5f5a79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.395+0000 7f4d5f5a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:01.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.395+0000 7f4d5f5a79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.397 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.395+0000 7f4d5f5a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:01.397 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.395+0000 7f4d5f5a79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.399+0000 7f4d5f5a79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:09:01.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.399+0000 7f4d5f5a79c0 20 zone default found 2024-09-19T14:09:01.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.399+0000 7f4d5f5a79c0 4 Realm: () 2024-09-19T14:09:01.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.399+0000 7f4d5f5a79c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:09:01.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.399+0000 7f4d5f5a79c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:09:01.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.399+0000 7f4d5f5a79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:09:01.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.399+0000 7f4d5f5a79c0 20 zonegroup default 2024-09-19T14:09:01.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.399+0000 7f4d5f5a79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.399+0000 7f4d5f5a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:01.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.399+0000 7f4d5f5a79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.399 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.399+0000 7f4d5f5a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:01.399 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.399+0000 7f4d5f5a79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.399 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.399+0000 7f4d5f5a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:01.399 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.399+0000 7f4d5f5a79c0 20 started sync module instance, tier type = 2024-09-19T14:09:01.399 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.399+0000 7f4d5f5a79c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:09:01.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.415+0000 7f4d5f5a79c0 20 add_watcher() i=0 2024-09-19T14:09:01.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.415+0000 7f4d5f5a79c0 20 add_watcher() i=1 2024-09-19T14:09:01.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.415+0000 7f4d5f5a79c0 20 add_watcher() i=2 2024-09-19T14:09:01.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.415+0000 7f4d5f5a79c0 20 add_watcher() i=3 2024-09-19T14:09:01.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.415+0000 7f4d5f5a79c0 20 add_watcher() i=4 2024-09-19T14:09:01.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.415+0000 7f4d5f5a79c0 20 add_watcher() i=5 2024-09-19T14:09:01.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.415+0000 7f4d5f5a79c0 20 add_watcher() i=6 2024-09-19T14:09:01.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.415+0000 7f4d5f5a79c0 20 add_watcher() i=7 2024-09-19T14:09:01.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.415+0000 7f4d5f5a79c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:09:01.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.419+0000 7f4c137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:01.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.419+0000 7f4d5f5a79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:09:01.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.419+0000 7f4d5f5a79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:09:01.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.419+0000 7f4d5f5a79c0 5 note: GC not initialized 2024-09-19T14:09:01.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.419+0000 7f4c127e4640 20 reqs_thread_entry: start 2024-09-19T14:09:01.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.419+0000 7f4d5f5a79c0 20 init_complete bucket index max shards: 11 2024-09-19T14:09:01.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.419+0000 7f4d5f5a79c0 20 Filter name: none 2024-09-19T14:09:01.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.419+0000 7f4b83fff640 20 reqs_thread_entry: start 2024-09-19T14:09:01.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.419+0000 7f4d5f5a79c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-19T14:09:01.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.419+0000 7f4d5f5a79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.420 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.419+0000 7f4d5f5a79c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:09:01.420 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.419+0000 7f4d5f5a79c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-19T14:09:01.420 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.419+0000 7f4d5f5a79c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-19T14:09:01.420 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.419+0000 7f4d5f5a79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.31 : miss 2024-09-19T14:09:01.420 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.419+0000 7f4d5f5a79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.419+0000 7f4d5f5a79c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:09:01.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.419+0000 7f4d5f5a79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.31 info.flags=0x17 2024-09-19T14:09:01.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.419+0000 7f4d5f5a79c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.31 to cache LRU end 2024-09-19T14:09:01.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.419+0000 7f4d5f5a79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:09:01.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.419+0000 7f4d5f5a79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:01.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.419+0000 7f4d5f5a79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.31 2024-09-19T14:09:01.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.435+0000 7f4d5f5a79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.31 info.flags=0x17 2024-09-19T14:09:01.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.435+0000 7f4d5f5a79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.31 to cache LRU end 2024-09-19T14:09:01.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.435+0000 7f4d5f5a79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:01.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.435+0000 7f4d5f5a79c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.31, ofs0, ns] 2024-09-19T14:09:01.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.435+0000 7f4c33fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333488 cookie 93944223146784 notifier 6809 bl.length()=931 2024-09-19T14:09:01.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.435+0000 7f4c33fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.31 info.flags=0x17 2024-09-19T14:09:01.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.435+0000 7f4c33fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.31 to cache LRU end 2024-09-19T14:09:01.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.435+0000 7f4c33fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:01.435 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.435+0000 7f4d5f5a79c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.31]): orig_sources= new_sources= 2024-09-19T14:09:01.435 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.435+0000 7f4d5f5a79c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.31]): potential sources added=[] removed=[] 2024-09-19T14:09:01.435 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.435+0000 7f4d5f5a79c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.31]): orig_dests= new_dests= 2024-09-19T14:09:01.435 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.435+0000 7f4d5f5a79c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.31]): potential dests added=[] removed=[] 2024-09-19T14:09:01.447 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1.0 2024-09-19T14:09:01.447 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1.0 2024-09-19T14:09:01.447 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1.1 2024-09-19T14:09:01.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1.1 2024-09-19T14:09:01.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1.2 2024-09-19T14:09:01.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1.2 2024-09-19T14:09:01.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1.3 2024-09-19T14:09:01.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1.3 2024-09-19T14:09:01.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1.4 2024-09-19T14:09:01.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1.4 2024-09-19T14:09:01.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1.5 2024-09-19T14:09:01.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1.5 2024-09-19T14:09:01.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1.6 2024-09-19T14:09:01.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1.6 2024-09-19T14:09:01.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1.7 2024-09-19T14:09:01.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1.7 2024-09-19T14:09:01.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1.8 2024-09-19T14:09:01.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1.8 2024-09-19T14:09:01.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1.9 2024-09-19T14:09:01.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1.9 2024-09-19T14:09:01.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1.10 2024-09-19T14:09:01.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1.10 2024-09-19T14:09:01.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1.11 2024-09-19T14:09:01.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1.11 2024-09-19T14:09:01.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.0 2024-09-19T14:09:01.450 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1 2024-09-19T14:09:01.450 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.447+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.2 2024-09-19T14:09:01.450 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.451+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.3 2024-09-19T14:09:01.450 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.451+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.4 2024-09-19T14:09:01.451 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.451+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.5 2024-09-19T14:09:01.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.451+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.6 2024-09-19T14:09:01.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.455+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.7 2024-09-19T14:09:01.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.455+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.8 2024-09-19T14:09:01.456 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.455+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.9 2024-09-19T14:09:01.457 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.459+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.10 2024-09-19T14:09:01.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.467+0000 7f4d5f5a79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.31 : hit (requested=0x17, cached=0x17) 2024-09-19T14:09:01.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.467+0000 7f4d5f5a79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.31 2024-09-19T14:09:01.468 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.467+0000 7f4d5f5a79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.31 info.flags=0x17 2024-09-19T14:09:01.468 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.467+0000 7f4d5f5a79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.31 to cache LRU end 2024-09-19T14:09:01.468 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.467+0000 7f4d5f5a79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:01.468 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.467+0000 7f4d5f5a79c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.31, ofs0, ns] 2024-09-19T14:09:01.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.467+0000 7f4c33fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333489 cookie 93944223146784 notifier 6809 bl.length()=931 2024-09-19T14:09:01.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.467+0000 7f4c33fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.31 info.flags=0x17 2024-09-19T14:09:01.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.467+0000 7f4c33fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.31 to cache LRU end 2024-09-19T14:09:01.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.467+0000 7f4c33fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:01.470 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.471+0000 7f4d5f5a79c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.31]): orig_sources= new_sources= 2024-09-19T14:09:01.471 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.471+0000 7f4d5f5a79c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.31]): potential sources added=[] removed=[] 2024-09-19T14:09:01.471 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.471+0000 7f4d5f5a79c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.31]): orig_dests= new_dests= 2024-09-19T14:09:01.471 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.471+0000 7f4d5f5a79c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.31]): potential dests added=[] removed=[] 2024-09-19T14:09:01.477 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.479+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.0 2024-09-19T14:09:01.477 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.479+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.1 2024-09-19T14:09:01.478 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.479+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.2 2024-09-19T14:09:01.479 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.479+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.3 2024-09-19T14:09:01.479 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.479+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.4 2024-09-19T14:09:01.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.479+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.5 2024-09-19T14:09:01.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.483+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.6 2024-09-19T14:09:01.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.483+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.7 2024-09-19T14:09:01.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.483+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.8 2024-09-19T14:09:01.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.483+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.9 2024-09-19T14:09:01.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.483+0000 7f4d5f5a79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.31.10 2024-09-19T14:09:01.485 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.487+0000 7f4d5f5a79c0 -1 Injecting error=-125 at location=commit_target_layout 2024-09-19T14:09:01.485 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.487+0000 7f4d5f5a79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.31 : hit (requested=0x17, cached=0x17) 2024-09-19T14:09:01.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.487+0000 7f4d5f5a79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.31 2024-09-19T14:09:01.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.487+0000 7f4d5f5a79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.31 info.flags=0x17 2024-09-19T14:09:01.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.487+0000 7f4d5f5a79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.31 to cache LRU end 2024-09-19T14:09:01.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.487+0000 7f4d5f5a79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:01.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.487+0000 7f4d5f5a79c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.31, ofs0, ns] 2024-09-19T14:09:01.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.491+0000 7f4c40ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333490 cookie 93944223146784 notifier 6809 bl.length()=899 2024-09-19T14:09:01.490 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.491+0000 7f4c40ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.31 info.flags=0x17 2024-09-19T14:09:01.490 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.491+0000 7f4c40ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.31 to cache LRU end 2024-09-19T14:09:01.490 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.491+0000 7f4c40ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:01.491 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.491+0000 7f4d5f5a79c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.31]): orig_sources= new_sources= 2024-09-19T14:09:01.491 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.491+0000 7f4d5f5a79c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.31]): potential sources added=[] removed=[] 2024-09-19T14:09:01.491 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.491+0000 7f4d5f5a79c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.31]): orig_dests= new_dests= 2024-09-19T14:09:01.491 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.491+0000 7f4d5f5a79c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.31]): potential dests added=[] removed=[] 2024-09-19T14:09:01.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.499+0000 7f4d5f5a79c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-19T14:09:01.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.503+0000 7f4c137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:01.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.507+0000 7f4d5f5a79c0 20 remove_watcher() i=0 2024-09-19T14:09:01.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.507+0000 7f4d5f5a79c0 2 removed watcher, disabling cache 2024-09-19T14:09:01.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.507+0000 7f4d5f5a79c0 20 remove_watcher() i=1 2024-09-19T14:09:01.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.511+0000 7f4d5f5a79c0 20 remove_watcher() i=2 2024-09-19T14:09:01.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.511+0000 7f4d5f5a79c0 20 remove_watcher() i=3 2024-09-19T14:09:01.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.515+0000 7f4d5f5a79c0 20 remove_watcher() i=4 2024-09-19T14:09:01.516 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.515+0000 7f4d5f5a79c0 20 remove_watcher() i=5 2024-09-19T14:09:01.517 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.519+0000 7f4d5f5a79c0 20 remove_watcher() i=6 2024-09-19T14:09:01.518 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.519+0000 7f4d5f5a79c0 20 remove_watcher() i=7 2024-09-19T14:09:01.533 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-19T14:09:01.560 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:09:01.560 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:09:01.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.603+0000 7f3e814689c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.607+0000 7f3e814689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:01.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.607+0000 7f3e814689c0 20 realm 2024-09-19T14:09:01.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.607+0000 7f3e814689c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.607+0000 7f3e814689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:01.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.607+0000 7f3e814689c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:09:01.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.607+0000 7f3e814689c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.607+0000 7f3e814689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:01.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.607+0000 7f3e814689c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.608 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.607+0000 7f3e814689c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:01.608 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.607+0000 7f3e814689c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.607+0000 7f3e814689c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:09:01.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.607+0000 7f3e814689c0 20 searching for the correct realm 2024-09-19T14:09:01.614 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.615+0000 7f3e7f76f640 0 -- 172.21.15.153:0/1913458600 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f3e740b5920 msgr2=0x7f3e740d7400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:01.620 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.619+0000 7f3e7ef6e640 0 -- 172.21.15.153:0/1913458600 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f3e740d7400 msgr2=0x7f3e740d7860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:09:01.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.835+0000 7f3e814689c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:09:01.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.835+0000 7f3e814689c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:09:01.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.835+0000 7f3e814689c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:09:01.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.835+0000 7f3e814689c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:09:01.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.835+0000 7f3e814689c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:09:01.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.835+0000 7f3e814689c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:09:01.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.835+0000 7f3e814689c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.835+0000 7f3e814689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:01.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.835+0000 7f3e814689c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.838 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.839+0000 7f3e814689c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:01.838 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.839+0000 7f3e814689c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.839 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.839+0000 7f3e814689c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:09:01.839 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.839+0000 7f3e814689c0 20 zone default found 2024-09-19T14:09:01.839 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.839+0000 7f3e814689c0 4 Realm: () 2024-09-19T14:09:01.839 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.839+0000 7f3e814689c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:09:01.839 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.839+0000 7f3e814689c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:09:01.839 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.839+0000 7f3e814689c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:09:01.839 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.839+0000 7f3e814689c0 20 zonegroup default 2024-09-19T14:09:01.839 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.839+0000 7f3e814689c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.839+0000 7f3e814689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:01.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.839+0000 7f3e814689c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.839+0000 7f3e814689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:01.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.839+0000 7f3e814689c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.841 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.843+0000 7f3e814689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:01.841 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.843+0000 7f3e814689c0 20 started sync module instance, tier type = 2024-09-19T14:09:01.841 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.843+0000 7f3e814689c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:09:01.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.863+0000 7f3e814689c0 20 add_watcher() i=0 2024-09-19T14:09:01.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.863+0000 7f3e814689c0 20 add_watcher() i=1 2024-09-19T14:09:01.863 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.863+0000 7f3e814689c0 20 add_watcher() i=2 2024-09-19T14:09:01.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.863+0000 7f3e814689c0 20 add_watcher() i=3 2024-09-19T14:09:01.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.863+0000 7f3e814689c0 20 add_watcher() i=4 2024-09-19T14:09:01.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.863+0000 7f3e814689c0 20 add_watcher() i=5 2024-09-19T14:09:01.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.863+0000 7f3e814689c0 20 add_watcher() i=6 2024-09-19T14:09:01.866 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.867+0000 7f3e814689c0 20 add_watcher() i=7 2024-09-19T14:09:01.866 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.867+0000 7f3e814689c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:09:01.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.871+0000 7f3d357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:01.871 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.871+0000 7f3e814689c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:09:01.871 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.871+0000 7f3e814689c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:09:01.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.871+0000 7f3e814689c0 5 note: GC not initialized 2024-09-19T14:09:01.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.871+0000 7f3caffff640 20 reqs_thread_entry: start 2024-09-19T14:09:01.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.871+0000 7f3e814689c0 20 init_complete bucket index max shards: 11 2024-09-19T14:09:01.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.871+0000 7f3e814689c0 20 Filter name: none 2024-09-19T14:09:01.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.871+0000 7f3cadffb640 20 reqs_thread_entry: start 2024-09-19T14:09:01.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.871+0000 7f3e814689c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.873 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.875+0000 7f3e814689c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:09:01.873 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.875+0000 7f3e814689c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.874 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.875+0000 7f3e814689c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:09:01.875 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.875+0000 7f3e814689c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:09:01.875 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.875+0000 7f3e814689c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.875 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.875+0000 7f3e814689c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:09:01.875 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.875+0000 7f3e814689c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:01.876 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.875+0000 7f3e814689c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:09:01.876 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.875+0000 7f3e814689c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:09:01.880 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.879+0000 7f3d357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:01.885 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.887+0000 7f3e814689c0 20 remove_watcher() i=0 2024-09-19T14:09:01.885 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.887+0000 7f3e814689c0 2 removed watcher, disabling cache 2024-09-19T14:09:01.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.887+0000 7f3e814689c0 20 remove_watcher() i=1 2024-09-19T14:09:01.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.891+0000 7f3e814689c0 20 remove_watcher() i=2 2024-09-19T14:09:01.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.895+0000 7f3e814689c0 20 remove_watcher() i=3 2024-09-19T14:09:01.895 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.895+0000 7f3e814689c0 20 remove_watcher() i=4 2024-09-19T14:09:01.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.895+0000 7f3e814689c0 20 remove_watcher() i=5 2024-09-19T14:09:01.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.899+0000 7f3e814689c0 20 remove_watcher() i=6 2024-09-19T14:09:01.899 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:01.899+0000 7f3e814689c0 20 remove_watcher() i=7 2024-09-19T14:09:01.916 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:01.916 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:09:01.916 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-commit-target-layout id: dbb1da81-49d0-421a-b677-974869a7f103.4620.31 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-19T14:09:01.916 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:01.917 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:01.917 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:01.940 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:01.940 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:02.493 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:02.493 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:02.862 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-19T14:09:02.863 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:02.865 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:02.866 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:02.998 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:02.998 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:03.086 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:03.086 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:03.188 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:03.188 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:03.286 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:03.286 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:03.384 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:03.384 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:03.482 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:03.483 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:03.582 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:03.582 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:03.681 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:03.681 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:03.764 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:03.764 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:03.863 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:03.863 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:03.955 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:03.955 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:04.063 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:04.063 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:04.161 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:04.161 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:04.261 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:04.261 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:04.359 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:04.359 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:04.460 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:04.460 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:04.561 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:04.561 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:04.654 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:04.654 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:04.751 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:04.752 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:04.849 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:04.849 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:04.948 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:04.948 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:05.043 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-19T14:09:05.076 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:09:05.076 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:09:05.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.119+0000 7f2165f5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.123+0000 7f2165f5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:05.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.123+0000 7f2165f5a9c0 20 realm 2024-09-19T14:09:05.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.123+0000 7f2165f5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.123+0000 7f2165f5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:05.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.123+0000 7f2165f5a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:09:05.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.123+0000 7f2165f5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.123+0000 7f2165f5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:05.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.123+0000 7f2165f5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.127+0000 7f2165f5a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:05.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.127+0000 7f2165f5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.127+0000 7f2165f5a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:09:05.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.127+0000 7f2165f5a9c0 20 searching for the correct realm 2024-09-19T14:09:05.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.131+0000 7f216325f640 0 -- 172.21.15.153:0/4022382763 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f215c02c990 msgr2=0x7f215c03b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:05.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.347+0000 7f2163a60640 0 -- 172.21.15.153:0/4022382763 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f21580e1930 msgr2=0x7f21580b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:09:05.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.563+0000 7f2165f5a9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:09:05.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.563+0000 7f2165f5a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:09:05.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.563+0000 7f2165f5a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:09:05.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.563+0000 7f2165f5a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:09:05.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.563+0000 7f2165f5a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:09:05.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.563+0000 7f2165f5a9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:09:05.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.563+0000 7f2165f5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.567+0000 7f2165f5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:05.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.567+0000 7f2165f5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.567+0000 7f2165f5a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:05.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.567+0000 7f2165f5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.567+0000 7f2165f5a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:09:05.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.567+0000 7f2165f5a9c0 20 zone default found 2024-09-19T14:09:05.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.567+0000 7f2165f5a9c0 4 Realm: () 2024-09-19T14:09:05.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.567+0000 7f2165f5a9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:09:05.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.567+0000 7f2165f5a9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:09:05.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.567+0000 7f2165f5a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:09:05.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.567+0000 7f2165f5a9c0 20 zonegroup default 2024-09-19T14:09:05.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.567+0000 7f2165f5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.567+0000 7f2165f5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:05.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.567+0000 7f2165f5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.567+0000 7f2165f5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:05.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.571+0000 7f2165f5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.571+0000 7f2165f5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:05.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.571+0000 7f2165f5a9c0 20 started sync module instance, tier type = 2024-09-19T14:09:05.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.571+0000 7f2165f5a9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:09:05.592 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.591+0000 7f2165f5a9c0 20 add_watcher() i=0 2024-09-19T14:09:05.593 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.591+0000 7f2165f5a9c0 20 add_watcher() i=1 2024-09-19T14:09:05.593 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.591+0000 7f2165f5a9c0 20 add_watcher() i=2 2024-09-19T14:09:05.593 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.591+0000 7f2165f5a9c0 20 add_watcher() i=3 2024-09-19T14:09:05.593 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.591+0000 7f2165f5a9c0 20 add_watcher() i=4 2024-09-19T14:09:05.593 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.591+0000 7f2165f5a9c0 20 add_watcher() i=5 2024-09-19T14:09:05.593 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.591+0000 7f2165f5a9c0 20 add_watcher() i=6 2024-09-19T14:09:05.594 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.595+0000 7f2165f5a9c0 20 add_watcher() i=7 2024-09-19T14:09:05.594 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.595+0000 7f2165f5a9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:09:05.598 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.599+0000 7f2019fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:05.599 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.599+0000 7f2165f5a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:09:05.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.599+0000 7f2165f5a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:09:05.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.599+0000 7f2165f5a9c0 5 note: GC not initialized 2024-09-19T14:09:05.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.599+0000 7f2018fe1640 20 reqs_thread_entry: start 2024-09-19T14:09:05.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.599+0000 7f2165f5a9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:09:05.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.599+0000 7f2165f5a9c0 20 Filter name: none 2024-09-19T14:09:05.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.599+0000 7f1f927fc640 20 reqs_thread_entry: start 2024-09-19T14:09:05.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.599+0000 7f2165f5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.603+0000 7f2165f5a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:09:05.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.603+0000 7f2165f5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.603+0000 7f2165f5a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:09:05.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.603+0000 7f2165f5a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:09:05.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.603+0000 7f2165f5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.603 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.603+0000 7f2165f5a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:09:05.603 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.603+0000 7f2165f5a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.603 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.603+0000 7f2165f5a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:09:05.603 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.603+0000 7f2165f5a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:09:05.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.607+0000 7f2019fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:05.612 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.611+0000 7f2165f5a9c0 20 remove_watcher() i=0 2024-09-19T14:09:05.612 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.611+0000 7f2165f5a9c0 2 removed watcher, disabling cache 2024-09-19T14:09:05.614 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.615+0000 7f2165f5a9c0 20 remove_watcher() i=1 2024-09-19T14:09:05.616 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.615+0000 7f2165f5a9c0 20 remove_watcher() i=2 2024-09-19T14:09:05.618 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.619+0000 7f2165f5a9c0 20 remove_watcher() i=3 2024-09-19T14:09:05.620 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.619+0000 7f2165f5a9c0 20 remove_watcher() i=4 2024-09-19T14:09:05.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.623+0000 7f2165f5a9c0 20 remove_watcher() i=5 2024-09-19T14:09:05.623 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.623+0000 7f2165f5a9c0 20 remove_watcher() i=6 2024-09-19T14:09:05.624 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.623+0000 7f2165f5a9c0 20 remove_watcher() i=7 2024-09-19T14:09:05.643 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:05.643 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:09:05.643 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: abort-at-commit-target-layout id: dbb1da81-49d0-421a-b677-974869a7f103.4620.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:09:05.643 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:05.643 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-19T14:09:05.675 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:09:05.675 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:09:05.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.719+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:05.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.723+0000 7f2584d289c0 20 realm 2024-09-19T14:09:05.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:05.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.723+0000 7f2584d289c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:09:05.722 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.722 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:05.722 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:05.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:09:05.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.723+0000 7f2584d289c0 20 searching for the correct realm 2024-09-19T14:09:05.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.727+0000 7f258202d640 0 -- 172.21.15.153:0/225296854 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f2574109040 msgr2=0x7f25741019c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:05.735 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.735+0000 7f258282e640 0 -- 172.21.15.153:0/225296854 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f2578054150 msgr2=0x7f2578054760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:05.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.951+0000 7f2584d289c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:09:05.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.951+0000 7f2584d289c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:09:05.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.951+0000 7f2584d289c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:09:05.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.951+0000 7f2584d289c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:09:05.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.951+0000 7f2584d289c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:09:05.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.951+0000 7f2584d289c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:09:05.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.951+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.951+0000 7f2584d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:05.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.951+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.951+0000 7f2584d289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:05.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.951+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.955+0000 7f2584d289c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:09:05.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.955+0000 7f2584d289c0 20 zone default found 2024-09-19T14:09:05.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.955+0000 7f2584d289c0 4 Realm: () 2024-09-19T14:09:05.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.955+0000 7f2584d289c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:09:05.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.955+0000 7f2584d289c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:09:05.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.955+0000 7f2584d289c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:09:05.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.955+0000 7f2584d289c0 20 zonegroup default 2024-09-19T14:09:05.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.955+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.955 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.955+0000 7f2584d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:05.955 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.955+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.955 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.955+0000 7f2584d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:05.955 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.955+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.956 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.955+0000 7f2584d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:05.956 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.955+0000 7f2584d289c0 20 started sync module instance, tier type = 2024-09-19T14:09:05.956 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.955+0000 7f2584d289c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:09:05.980 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.979+0000 7f2584d289c0 20 add_watcher() i=0 2024-09-19T14:09:05.980 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.979+0000 7f2584d289c0 20 add_watcher() i=1 2024-09-19T14:09:05.980 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.979+0000 7f2584d289c0 20 add_watcher() i=2 2024-09-19T14:09:05.980 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.979+0000 7f2584d289c0 20 add_watcher() i=3 2024-09-19T14:09:05.980 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.979+0000 7f2584d289c0 20 add_watcher() i=4 2024-09-19T14:09:05.980 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.979+0000 7f2584d289c0 20 add_watcher() i=5 2024-09-19T14:09:05.980 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.979+0000 7f2584d289c0 20 add_watcher() i=6 2024-09-19T14:09:05.982 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.983+0000 7f2584d289c0 20 add_watcher() i=7 2024-09-19T14:09:05.982 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.983+0000 7f2584d289c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:09:05.986 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.987+0000 7f24397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:05.987 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.987+0000 7f2584d289c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:09:05.987 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.987+0000 7f2584d289c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:09:05.987 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.987+0000 7f2584d289c0 5 note: GC not initialized 2024-09-19T14:09:05.988 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.987+0000 7f23b3fff640 20 reqs_thread_entry: start 2024-09-19T14:09:05.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.987+0000 7f2584d289c0 20 init_complete bucket index max shards: 11 2024-09-19T14:09:05.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.987+0000 7f2584d289c0 20 Filter name: none 2024-09-19T14:09:05.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.987+0000 7f23b1ffb640 20 reqs_thread_entry: start 2024-09-19T14:09:05.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.987+0000 7f2584d289c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-19T14:09:05.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.987+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.991+0000 7f2584d289c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:09:05.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.991+0000 7f2584d289c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-19T14:09:05.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.991+0000 7f2584d289c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-19T14:09:05.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.991+0000 7f2584d289c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 : miss 2024-09-19T14:09:05.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.991+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:05.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.991+0000 7f2584d289c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:09:05.991 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.991+0000 7f2584d289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 info.flags=0x17 2024-09-19T14:09:05.991 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.991+0000 7f2584d289c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 to cache LRU end 2024-09-19T14:09:05.991 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.991+0000 7f2584d289c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:09:05.991 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.991+0000 7f2584d289c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:05.991 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.991+0000 7f2584d289c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 2024-09-19T14:09:06.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.999+0000 7f2584d289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 info.flags=0x17 2024-09-19T14:09:06.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.999+0000 7f2584d289c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 to cache LRU end 2024-09-19T14:09:06.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.999+0000 7f2584d289c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:06.001 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.999+0000 7f2584d289c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32, ofs0, ns] 2024-09-19T14:09:06.001 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.999+0000 7f2465ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333493 cookie 94591116184432 notifier 6860 bl.length()=931 2024-09-19T14:09:06.001 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.999+0000 7f2465ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 info.flags=0x17 2024-09-19T14:09:06.001 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.999+0000 7f2465ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 to cache LRU end 2024-09-19T14:09:06.001 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:05.999+0000 7f2465ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:06.004 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.003+0000 7f2584d289c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): orig_sources= new_sources= 2024-09-19T14:09:06.004 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.003+0000 7f2584d289c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): potential sources added=[] removed=[] 2024-09-19T14:09:06.004 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.003+0000 7f2584d289c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): orig_dests= new_dests= 2024-09-19T14:09:06.004 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.003+0000 7f2584d289c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): potential dests added=[] removed=[] 2024-09-19T14:09:06.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.0 2024-09-19T14:09:06.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.0 2024-09-19T14:09:06.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.1 2024-09-19T14:09:06.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.1 2024-09-19T14:09:06.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.2 2024-09-19T14:09:06.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.2 2024-09-19T14:09:06.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.3 2024-09-19T14:09:06.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.3 2024-09-19T14:09:06.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.4 2024-09-19T14:09:06.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.4 2024-09-19T14:09:06.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.5 2024-09-19T14:09:06.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.5 2024-09-19T14:09:06.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.6 2024-09-19T14:09:06.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.6 2024-09-19T14:09:06.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.7 2024-09-19T14:09:06.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.7 2024-09-19T14:09:06.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.8 2024-09-19T14:09:06.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.8 2024-09-19T14:09:06.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.9 2024-09-19T14:09:06.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.9 2024-09-19T14:09:06.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.10 2024-09-19T14:09:06.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.10 2024-09-19T14:09:06.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.11 2024-09-19T14:09:06.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.11 2024-09-19T14:09:06.020 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.0 2024-09-19T14:09:06.020 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1 2024-09-19T14:09:06.020 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.2 2024-09-19T14:09:06.020 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.3 2024-09-19T14:09:06.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.4 2024-09-19T14:09:06.022 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.023+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.5 2024-09-19T14:09:06.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.023+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.6 2024-09-19T14:09:06.024 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.023+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.7 2024-09-19T14:09:06.025 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.027+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.8 2024-09-19T14:09:06.027 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.027+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.9 2024-09-19T14:09:06.028 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.027+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.10 2024-09-19T14:09:06.034 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.035+0000 7f2584d289c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 : hit (requested=0x17, cached=0x17) 2024-09-19T14:09:06.034 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.035+0000 7f2584d289c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 2024-09-19T14:09:06.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.035+0000 7f2584d289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 info.flags=0x17 2024-09-19T14:09:06.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.035+0000 7f2584d289c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 to cache LRU end 2024-09-19T14:09:06.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.035+0000 7f2584d289c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:06.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.035+0000 7f2584d289c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32, ofs0, ns] 2024-09-19T14:09:06.037 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.035+0000 7f2465ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333494 cookie 94591116184432 notifier 6860 bl.length()=931 2024-09-19T14:09:06.037 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.035+0000 7f2465ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 info.flags=0x17 2024-09-19T14:09:06.037 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.035+0000 7f2465ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 to cache LRU end 2024-09-19T14:09:06.037 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.035+0000 7f2465ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:06.039 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.039+0000 7f2584d289c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): orig_sources= new_sources= 2024-09-19T14:09:06.039 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.039+0000 7f2584d289c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): potential sources added=[] removed=[] 2024-09-19T14:09:06.039 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.039+0000 7f2584d289c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): orig_dests= new_dests= 2024-09-19T14:09:06.039 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.039+0000 7f2584d289c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): potential dests added=[] removed=[] 2024-09-19T14:09:06.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.047+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.0 2024-09-19T14:09:06.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.047+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1 2024-09-19T14:09:06.048 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.047+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.2 2024-09-19T14:09:06.048 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.047+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.3 2024-09-19T14:09:06.049 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.051+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.4 2024-09-19T14:09:06.049 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.051+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.5 2024-09-19T14:09:06.050 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.051+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.6 2024-09-19T14:09:06.051 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.051+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.7 2024-09-19T14:09:06.052 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.051+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.8 2024-09-19T14:09:06.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.055+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.9 2024-09-19T14:09:06.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.055+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.10 2024-09-19T14:09:06.055 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2584d289c0 time 2024-09-19T14:09:06.058360+0000 2024-09-19T14:09:06.056 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:09:06.057 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:09:06.057 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f25886022eb] 2024-09-19T14:09:06.057 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f258860249f] 2024-09-19T14:09:06.057 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5607b4501271] 2024-09-19T14:09:06.057 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5607b45113b7] 2024-09-19T14:09:06.057 INFO:tasks.workunit.client.0.smithi153.stderr: 5: main() 2024-09-19T14:09:06.057 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2587468d90] 2024-09-19T14:09:06.057 INFO:tasks.workunit.client.0.smithi153.stderr: 7: __libc_start_main() 2024-09-19T14:09:06.057 INFO:tasks.workunit.client.0.smithi153.stderr: 8: _start() 2024-09-19T14:09:06.057 INFO:tasks.workunit.client.0.smithi153.stderr:*** Caught signal (Aborted) ** 2024-09-19T14:09:06.057 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7f2584d289c0 thread_name:radosgw-admin 2024-09-19T14:09:06.058 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.055+0000 7f2584d289c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2584d289c0 time 2024-09-19T14:09:06.058360+0000 2024-09-19T14:09:06.058 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:09:06.058 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.058 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:09:06.058 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f25886022eb] 2024-09-19T14:09:06.058 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f258860249f] 2024-09-19T14:09:06.058 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5607b4501271] 2024-09-19T14:09:06.058 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5607b45113b7] 2024-09-19T14:09:06.058 INFO:tasks.workunit.client.0.smithi153.stderr: 5: main() 2024-09-19T14:09:06.058 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2587468d90] 2024-09-19T14:09:06.058 INFO:tasks.workunit.client.0.smithi153.stderr: 7: __libc_start_main() 2024-09-19T14:09:06.058 INFO:tasks.workunit.client.0.smithi153.stderr: 8: _start() 2024-09-19T14:09:06.058 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.069 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:09:06.069 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2587481520] 2024-09-19T14:09:06.069 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:09:06.069 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:09:06.069 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:09:06.069 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2588602345] 2024-09-19T14:09:06.069 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f258860249f] 2024-09-19T14:09:06.069 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5607b4501271] 2024-09-19T14:09:06.069 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5607b45113b7] 2024-09-19T14:09:06.070 INFO:tasks.workunit.client.0.smithi153.stderr: 9: main() 2024-09-19T14:09:06.070 INFO:tasks.workunit.client.0.smithi153.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2587468d90] 2024-09-19T14:09:06.070 INFO:tasks.workunit.client.0.smithi153.stderr: 11: __libc_start_main() 2024-09-19T14:09:06.070 INFO:tasks.workunit.client.0.smithi153.stderr: 12: _start() 2024-09-19T14:09:06.070 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.059+0000 7f2584d289c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:09:06.070 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7f2584d289c0 thread_name:radosgw-admin 2024-09-19T14:09:06.070 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.070 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:09:06.070 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2587481520] 2024-09-19T14:09:06.070 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:09:06.070 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:09:06.070 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:09:06.070 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2588602345] 2024-09-19T14:09:06.070 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f258860249f] 2024-09-19T14:09:06.070 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5607b4501271] 2024-09-19T14:09:06.071 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5607b45113b7] 2024-09-19T14:09:06.071 INFO:tasks.workunit.client.0.smithi153.stderr: 9: main() 2024-09-19T14:09:06.071 INFO:tasks.workunit.client.0.smithi153.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2587468d90] 2024-09-19T14:09:06.071 INFO:tasks.workunit.client.0.smithi153.stderr: 11: __libc_start_main() 2024-09-19T14:09:06.071 INFO:tasks.workunit.client.0.smithi153.stderr: 12: _start() 2024-09-19T14:09:06.071 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:09:06.071 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.071 INFO:tasks.workunit.client.0.smithi153.stderr:--- begin dump of recent events --- 2024-09-19T14:09:06.071 INFO:tasks.workunit.client.0.smithi153.stderr: -499> 2024-09-19T14:09:05.699+0000 7f2584d289c0 10 monclient(hunting): picked mon.noname-a con 0x5607b5c5e2d0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:09:06.071 INFO:tasks.workunit.client.0.smithi153.stderr: -498> 2024-09-19T14:09:05.699+0000 7f2584d289c0 10 monclient(hunting): picked mon.noname-c con 0x5607b5d1b850 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:09:06.071 INFO:tasks.workunit.client.0.smithi153.stderr: -497> 2024-09-19T14:09:05.699+0000 7f2584d289c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:06.071 INFO:tasks.workunit.client.0.smithi153.stderr: -496> 2024-09-19T14:09:05.699+0000 7f2584d289c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:06.071 INFO:tasks.workunit.client.0.smithi153.stderr: -495> 2024-09-19T14:09:05.699+0000 7f2584d289c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:06.071 INFO:tasks.workunit.client.0.smithi153.stderr: -494> 2024-09-19T14:09:05.699+0000 7f2584d289c0 10 monclient(hunting): _renew_subs 2024-09-19T14:09:06.071 INFO:tasks.workunit.client.0.smithi153.stderr: -493> 2024-09-19T14:09:05.699+0000 7f2584d289c0 10 monclient(hunting): authenticate will time out at 2734.163093s 2024-09-19T14:09:06.072 INFO:tasks.workunit.client.0.smithi153.stderr: -492> 2024-09-19T14:09:05.699+0000 7f258202d640 10 monclient(hunting): get_auth_request con 0x5607b5c5e2d0 auth_method 0 2024-09-19T14:09:06.072 INFO:tasks.workunit.client.0.smithi153.stderr: -491> 2024-09-19T14:09:05.699+0000 7f258202d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:06.072 INFO:tasks.workunit.client.0.smithi153.stderr: -490> 2024-09-19T14:09:05.699+0000 7f258202d640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:06.072 INFO:tasks.workunit.client.0.smithi153.stderr: -489> 2024-09-19T14:09:05.699+0000 7f258202d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:06.072 INFO:tasks.workunit.client.0.smithi153.stderr: -488> 2024-09-19T14:09:05.699+0000 7f258302f640 10 monclient(hunting): get_auth_request con 0x5607b5d1b850 auth_method 0 2024-09-19T14:09:06.072 INFO:tasks.workunit.client.0.smithi153.stderr: -487> 2024-09-19T14:09:05.699+0000 7f258302f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:06.072 INFO:tasks.workunit.client.0.smithi153.stderr: -486> 2024-09-19T14:09:05.699+0000 7f258302f640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:06.072 INFO:tasks.workunit.client.0.smithi153.stderr: -485> 2024-09-19T14:09:05.699+0000 7f258302f640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:06.072 INFO:tasks.workunit.client.0.smithi153.stderr: -484> 2024-09-19T14:09:05.699+0000 7f258202d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:06.072 INFO:tasks.workunit.client.0.smithi153.stderr: -483> 2024-09-19T14:09:05.699+0000 7f258202d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:06.072 INFO:tasks.workunit.client.0.smithi153.stderr: -482> 2024-09-19T14:09:05.699+0000 7f258202d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:06.072 INFO:tasks.workunit.client.0.smithi153.stderr: -481> 2024-09-19T14:09:05.699+0000 7f258302f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:06.072 INFO:tasks.workunit.client.0.smithi153.stderr: -480> 2024-09-19T14:09:05.699+0000 7f258302f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:06.072 INFO:tasks.workunit.client.0.smithi153.stderr: -479> 2024-09-19T14:09:05.699+0000 7f258302f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:06.072 INFO:tasks.workunit.client.0.smithi153.stderr: -478> 2024-09-19T14:09:05.699+0000 7f258202d640 10 monclient(hunting): handle_auth_done global_id 7299 payload 824 2024-09-19T14:09:06.072 INFO:tasks.workunit.client.0.smithi153.stderr: -477> 2024-09-19T14:09:05.699+0000 7f258202d640 10 monclient: _finish_hunting 0 2024-09-19T14:09:06.073 INFO:tasks.workunit.client.0.smithi153.stderr: -476> 2024-09-19T14:09:05.699+0000 7f258202d640 1 monclient: found mon.noname-a 2024-09-19T14:09:06.073 INFO:tasks.workunit.client.0.smithi153.stderr: -475> 2024-09-19T14:09:05.699+0000 7f258202d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:09:06.073 INFO:tasks.workunit.client.0.smithi153.stderr: -474> 2024-09-19T14:09:05.699+0000 7f258282e640 10 monclient: get_auth_request con 0x5607b5c5d620 auth_method 0 2024-09-19T14:09:06.073 INFO:tasks.workunit.client.0.smithi153.stderr: -473> 2024-09-19T14:09:05.699+0000 7f246f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:06.073 INFO:tasks.workunit.client.0.smithi153.stderr: -472> 2024-09-19T14:09:05.699+0000 7f246f606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:09:06.073 INFO:tasks.workunit.client.0.smithi153.stderr: -471> 2024-09-19T14:09:05.699+0000 7f246f606640 10 monclient: dump: 2024-09-19T14:09:06.073 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:06.073 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:06.073 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.073 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.073 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:06.073 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:06.073 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:06.073 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:06.074 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:06.074 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.074 INFO:tasks.workunit.client.0.smithi153.stderr: -470> 2024-09-19T14:09:05.699+0000 7f246f606640 10 monclient: _finish_auth 0 2024-09-19T14:09:06.074 INFO:tasks.workunit.client.0.smithi153.stderr: -469> 2024-09-19T14:09:05.699+0000 7f246f606640 10 monclient: _check_auth_tickets 2024-09-19T14:09:06.074 INFO:tasks.workunit.client.0.smithi153.stderr: -468> 2024-09-19T14:09:05.699+0000 7f246f606640 10 monclient: handle_config config(0 keys) 2024-09-19T14:09:06.074 INFO:tasks.workunit.client.0.smithi153.stderr: -467> 2024-09-19T14:09:05.699+0000 7f246f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:06.074 INFO:tasks.workunit.client.0.smithi153.stderr: -466> 2024-09-19T14:09:05.699+0000 7f246f606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:09:06.074 INFO:tasks.workunit.client.0.smithi153.stderr: -465> 2024-09-19T14:09:05.699+0000 7f246f606640 10 monclient: dump: 2024-09-19T14:09:06.074 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:06.074 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:06.074 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.074 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.074 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:06.074 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:06.074 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:06.075 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:06.075 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:06.075 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.075 INFO:tasks.workunit.client.0.smithi153.stderr: -464> 2024-09-19T14:09:05.699+0000 7f2584d289c0 5 monclient: authenticate success, global_id 7299 2024-09-19T14:09:06.075 INFO:tasks.workunit.client.0.smithi153.stderr: -463> 2024-09-19T14:09:05.699+0000 7f2584d289c0 10 monclient: _renew_subs 2024-09-19T14:09:06.075 INFO:tasks.workunit.client.0.smithi153.stderr: -462> 2024-09-19T14:09:05.699+0000 7f2584d289c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:09:06.075 INFO:tasks.workunit.client.0.smithi153.stderr: -461> 2024-09-19T14:09:05.699+0000 7f2470e09640 4 set_mon_vals no callback set 2024-09-19T14:09:06.075 INFO:tasks.workunit.client.0.smithi153.stderr: -460> 2024-09-19T14:09:05.703+0000 7f2584d289c0 10 monclient: _renew_subs 2024-09-19T14:09:06.075 INFO:tasks.workunit.client.0.smithi153.stderr: -459> 2024-09-19T14:09:05.703+0000 7f2584d289c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:09:06.075 INFO:tasks.workunit.client.0.smithi153.stderr: -458> 2024-09-19T14:09:05.703+0000 7f2584d289c0 1 librados: init done 2024-09-19T14:09:06.075 INFO:tasks.workunit.client.0.smithi153.stderr: -457> 2024-09-19T14:09:05.703+0000 7f246f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:09:06.075 INFO:tasks.workunit.client.0.smithi153.stderr: -456> 2024-09-19T14:09:05.703+0000 7f246f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:09:06.075 INFO:tasks.workunit.client.0.smithi153.stderr: -455> 2024-09-19T14:09:05.703+0000 7f246f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:09:06.075 INFO:tasks.workunit.client.0.smithi153.stderr: -454> 2024-09-19T14:09:05.703+0000 7f258282e640 10 monclient: get_auth_request con 0x7f2468071be0 auth_method 0 2024-09-19T14:09:06.076 INFO:tasks.workunit.client.0.smithi153.stderr: -453> 2024-09-19T14:09:05.703+0000 7f258302f640 10 monclient: get_auth_request con 0x5607b5d5d3f0 auth_method 0 2024-09-19T14:09:06.076 INFO:tasks.workunit.client.0.smithi153.stderr: -452> 2024-09-19T14:09:05.703+0000 7f258282e640 10 monclient: get_auth_request con 0x5607b5d60230 auth_method 0 2024-09-19T14:09:06.076 INFO:tasks.workunit.client.0.smithi153.stderr: -451> 2024-09-19T14:09:05.707+0000 7f258202d640 10 monclient: get_auth_request con 0x5607b5d63a80 auth_method 0 2024-09-19T14:09:06.076 INFO:tasks.workunit.client.0.smithi153.stderr: -450> 2024-09-19T14:09:05.707+0000 7f2584d289c0 10 monclient: build_initial_monmap 2024-09-19T14:09:06.076 INFO:tasks.workunit.client.0.smithi153.stderr: -449> 2024-09-19T14:09:05.707+0000 7f2584d289c0 1 build_initial for_mkfs: 0 2024-09-19T14:09:06.076 INFO:tasks.workunit.client.0.smithi153.stderr: -448> 2024-09-19T14:09:05.707+0000 7f2584d289c0 10 monclient: monmap: 2024-09-19T14:09:06.076 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:09:06.076 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:09:06.076 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:09:06.076 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:09:06.076 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:09:06.076 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:06.076 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:09:06.076 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:09:06.076 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:09:06.076 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.077 INFO:tasks.workunit.client.0.smithi153.stderr: -447> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding auth protocol: cephx 2024-09-19T14:09:06.077 INFO:tasks.workunit.client.0.smithi153.stderr: -446> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding auth protocol: cephx 2024-09-19T14:09:06.077 INFO:tasks.workunit.client.0.smithi153.stderr: -445> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding auth protocol: cephx 2024-09-19T14:09:06.077 INFO:tasks.workunit.client.0.smithi153.stderr: -444> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding con mode: secure 2024-09-19T14:09:06.077 INFO:tasks.workunit.client.0.smithi153.stderr: -443> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding con mode: crc 2024-09-19T14:09:06.077 INFO:tasks.workunit.client.0.smithi153.stderr: -442> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding con mode: secure 2024-09-19T14:09:06.077 INFO:tasks.workunit.client.0.smithi153.stderr: -441> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding con mode: crc 2024-09-19T14:09:06.077 INFO:tasks.workunit.client.0.smithi153.stderr: -440> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding con mode: secure 2024-09-19T14:09:06.077 INFO:tasks.workunit.client.0.smithi153.stderr: -439> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding con mode: crc 2024-09-19T14:09:06.077 INFO:tasks.workunit.client.0.smithi153.stderr: -438> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding con mode: crc 2024-09-19T14:09:06.077 INFO:tasks.workunit.client.0.smithi153.stderr: -437> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding con mode: secure 2024-09-19T14:09:06.077 INFO:tasks.workunit.client.0.smithi153.stderr: -436> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding con mode: crc 2024-09-19T14:09:06.077 INFO:tasks.workunit.client.0.smithi153.stderr: -435> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding con mode: secure 2024-09-19T14:09:06.078 INFO:tasks.workunit.client.0.smithi153.stderr: -434> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding con mode: crc 2024-09-19T14:09:06.078 INFO:tasks.workunit.client.0.smithi153.stderr: -433> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding con mode: secure 2024-09-19T14:09:06.078 INFO:tasks.workunit.client.0.smithi153.stderr: -432> 2024-09-19T14:09:05.711+0000 7f2584d289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:06.078 INFO:tasks.workunit.client.0.smithi153.stderr: -431> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command objecter_requests cmddesc objecter_requests hook 0x5607b5d6dcf0 EEXIST 2024-09-19T14:09:06.078 INFO:tasks.workunit.client.0.smithi153.stderr: -430> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient: init 2024-09-19T14:09:06.078 INFO:tasks.workunit.client.0.smithi153.stderr: -429> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding auth protocol: cephx 2024-09-19T14:09:06.078 INFO:tasks.workunit.client.0.smithi153.stderr: -428> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding auth protocol: cephx 2024-09-19T14:09:06.078 INFO:tasks.workunit.client.0.smithi153.stderr: -427> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding auth protocol: cephx 2024-09-19T14:09:06.078 INFO:tasks.workunit.client.0.smithi153.stderr: -426> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding con mode: secure 2024-09-19T14:09:06.078 INFO:tasks.workunit.client.0.smithi153.stderr: -425> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding con mode: crc 2024-09-19T14:09:06.078 INFO:tasks.workunit.client.0.smithi153.stderr: -424> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding con mode: secure 2024-09-19T14:09:06.078 INFO:tasks.workunit.client.0.smithi153.stderr: -423> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding con mode: crc 2024-09-19T14:09:06.078 INFO:tasks.workunit.client.0.smithi153.stderr: -422> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding con mode: secure 2024-09-19T14:09:06.079 INFO:tasks.workunit.client.0.smithi153.stderr: -421> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding con mode: crc 2024-09-19T14:09:06.079 INFO:tasks.workunit.client.0.smithi153.stderr: -420> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding con mode: crc 2024-09-19T14:09:06.079 INFO:tasks.workunit.client.0.smithi153.stderr: -419> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding con mode: secure 2024-09-19T14:09:06.079 INFO:tasks.workunit.client.0.smithi153.stderr: -418> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding con mode: crc 2024-09-19T14:09:06.079 INFO:tasks.workunit.client.0.smithi153.stderr: -417> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding con mode: secure 2024-09-19T14:09:06.079 INFO:tasks.workunit.client.0.smithi153.stderr: -416> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding con mode: crc 2024-09-19T14:09:06.079 INFO:tasks.workunit.client.0.smithi153.stderr: -415> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding con mode: secure 2024-09-19T14:09:06.079 INFO:tasks.workunit.client.0.smithi153.stderr: -414> 2024-09-19T14:09:05.711+0000 7f2584d289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:06.079 INFO:tasks.workunit.client.0.smithi153.stderr: -413> 2024-09-19T14:09:05.711+0000 7f2584d289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:06.079 INFO:tasks.workunit.client.0.smithi153.stderr: -412> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command rotate-key cmddesc rotate-key hook 0x5607b5d68370 EEXIST 2024-09-19T14:09:06.079 INFO:tasks.workunit.client.0.smithi153.stderr: -411> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient: _reopen_session rank -1 2024-09-19T14:09:06.079 INFO:tasks.workunit.client.0.smithi153.stderr: -410> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T14:09:06.079 INFO:tasks.workunit.client.0.smithi153.stderr: -409> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient(hunting): picked mon.noname-a con 0x5607b5d919b0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:09:06.079 INFO:tasks.workunit.client.0.smithi153.stderr: -408> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient(hunting): picked mon.noname-b con 0x5607b5da6150 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:09:06.080 INFO:tasks.workunit.client.0.smithi153.stderr: -407> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient(hunting): picked mon.noname-c con 0x5607b5d8fbf0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:09:06.080 INFO:tasks.workunit.client.0.smithi153.stderr: -406> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:06.080 INFO:tasks.workunit.client.0.smithi153.stderr: -405> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:06.080 INFO:tasks.workunit.client.0.smithi153.stderr: -404> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:06.080 INFO:tasks.workunit.client.0.smithi153.stderr: -403> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient(hunting): _renew_subs 2024-09-19T14:09:06.080 INFO:tasks.workunit.client.0.smithi153.stderr: -402> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient(hunting): authenticate will time out at 2734.173101s 2024-09-19T14:09:06.080 INFO:tasks.workunit.client.0.smithi153.stderr: -401> 2024-09-19T14:09:05.711+0000 7f258282e640 10 monclient(hunting): get_auth_request con 0x5607b5d919b0 auth_method 0 2024-09-19T14:09:06.080 INFO:tasks.workunit.client.0.smithi153.stderr: -400> 2024-09-19T14:09:05.711+0000 7f258282e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:06.080 INFO:tasks.workunit.client.0.smithi153.stderr: -399> 2024-09-19T14:09:05.711+0000 7f258282e640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:06.080 INFO:tasks.workunit.client.0.smithi153.stderr: -398> 2024-09-19T14:09:05.711+0000 7f258282e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:06.080 INFO:tasks.workunit.client.0.smithi153.stderr: -397> 2024-09-19T14:09:05.711+0000 7f258302f640 10 monclient(hunting): get_auth_request con 0x5607b5d8fbf0 auth_method 0 2024-09-19T14:09:06.080 INFO:tasks.workunit.client.0.smithi153.stderr: -396> 2024-09-19T14:09:05.711+0000 7f258302f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:06.080 INFO:tasks.workunit.client.0.smithi153.stderr: -395> 2024-09-19T14:09:05.711+0000 7f258302f640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:06.081 INFO:tasks.workunit.client.0.smithi153.stderr: -394> 2024-09-19T14:09:05.711+0000 7f258302f640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:06.081 INFO:tasks.workunit.client.0.smithi153.stderr: -393> 2024-09-19T14:09:05.711+0000 7f258282e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:06.081 INFO:tasks.workunit.client.0.smithi153.stderr: -392> 2024-09-19T14:09:05.711+0000 7f258282e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:06.081 INFO:tasks.workunit.client.0.smithi153.stderr: -391> 2024-09-19T14:09:05.711+0000 7f258282e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:06.081 INFO:tasks.workunit.client.0.smithi153.stderr: -390> 2024-09-19T14:09:05.711+0000 7f258302f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:06.081 INFO:tasks.workunit.client.0.smithi153.stderr: -389> 2024-09-19T14:09:05.711+0000 7f258302f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:06.081 INFO:tasks.workunit.client.0.smithi153.stderr: -388> 2024-09-19T14:09:05.711+0000 7f258302f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:06.081 INFO:tasks.workunit.client.0.smithi153.stderr: -387> 2024-09-19T14:09:05.711+0000 7f258202d640 10 monclient(hunting): get_auth_request con 0x5607b5da6150 auth_method 0 2024-09-19T14:09:06.081 INFO:tasks.workunit.client.0.smithi153.stderr: -386> 2024-09-19T14:09:05.711+0000 7f258202d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:06.081 INFO:tasks.workunit.client.0.smithi153.stderr: -385> 2024-09-19T14:09:05.711+0000 7f258202d640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:06.081 INFO:tasks.workunit.client.0.smithi153.stderr: -384> 2024-09-19T14:09:05.711+0000 7f258202d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:06.081 INFO:tasks.workunit.client.0.smithi153.stderr: -383> 2024-09-19T14:09:05.711+0000 7f258282e640 10 monclient(hunting): handle_auth_done global_id 7302 payload 824 2024-09-19T14:09:06.081 INFO:tasks.workunit.client.0.smithi153.stderr: -382> 2024-09-19T14:09:05.711+0000 7f258282e640 10 monclient: _finish_hunting 0 2024-09-19T14:09:06.082 INFO:tasks.workunit.client.0.smithi153.stderr: -381> 2024-09-19T14:09:05.711+0000 7f258282e640 1 monclient: found mon.noname-a 2024-09-19T14:09:06.082 INFO:tasks.workunit.client.0.smithi153.stderr: -380> 2024-09-19T14:09:05.711+0000 7f258282e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:09:06.082 INFO:tasks.workunit.client.0.smithi153.stderr: -379> 2024-09-19T14:09:05.711+0000 7f246ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:06.082 INFO:tasks.workunit.client.0.smithi153.stderr: -378> 2024-09-19T14:09:05.711+0000 7f246ce01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:09:06.082 INFO:tasks.workunit.client.0.smithi153.stderr: -377> 2024-09-19T14:09:05.711+0000 7f246ce01640 10 monclient: dump: 2024-09-19T14:09:06.082 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:06.082 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:06.082 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.082 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.082 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:06.082 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:06.082 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:06.082 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:06.082 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:06.082 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.082 INFO:tasks.workunit.client.0.smithi153.stderr: -376> 2024-09-19T14:09:05.711+0000 7f246ce01640 10 monclient: _finish_auth 0 2024-09-19T14:09:06.083 INFO:tasks.workunit.client.0.smithi153.stderr: -375> 2024-09-19T14:09:05.711+0000 7f246ce01640 10 monclient: _check_auth_tickets 2024-09-19T14:09:06.083 INFO:tasks.workunit.client.0.smithi153.stderr: -374> 2024-09-19T14:09:05.711+0000 7f246ce01640 10 monclient: handle_config config(0 keys) 2024-09-19T14:09:06.083 INFO:tasks.workunit.client.0.smithi153.stderr: -373> 2024-09-19T14:09:05.711+0000 7f246ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:06.083 INFO:tasks.workunit.client.0.smithi153.stderr: -372> 2024-09-19T14:09:05.711+0000 7f246ce01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:09:06.083 INFO:tasks.workunit.client.0.smithi153.stderr: -371> 2024-09-19T14:09:05.711+0000 7f246ce01640 10 monclient: dump: 2024-09-19T14:09:06.083 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:06.083 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:06.083 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.083 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.083 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:06.083 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:06.083 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:06.083 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:06.084 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:06.084 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.084 INFO:tasks.workunit.client.0.smithi153.stderr: -370> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 monclient: authenticate success, global_id 7302 2024-09-19T14:09:06.084 INFO:tasks.workunit.client.0.smithi153.stderr: -369> 2024-09-19T14:09:05.711+0000 7f2583830640 4 set_mon_vals no callback set 2024-09-19T14:09:06.084 INFO:tasks.workunit.client.0.smithi153.stderr: -368> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient: _renew_subs 2024-09-19T14:09:06.084 INFO:tasks.workunit.client.0.smithi153.stderr: -367> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:09:06.084 INFO:tasks.workunit.client.0.smithi153.stderr: -366> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient: _renew_subs 2024-09-19T14:09:06.084 INFO:tasks.workunit.client.0.smithi153.stderr: -365> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:09:06.084 INFO:tasks.workunit.client.0.smithi153.stderr: -364> 2024-09-19T14:09:05.715+0000 7f246ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:09:06.084 INFO:tasks.workunit.client.0.smithi153.stderr: -363> 2024-09-19T14:09:05.715+0000 7f246ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:09:06.084 INFO:tasks.workunit.client.0.smithi153.stderr: -362> 2024-09-19T14:09:05.715+0000 7f246ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:09:06.084 INFO:tasks.workunit.client.0.smithi153.stderr: -361> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient: get_monmap_and_config 2024-09-19T14:09:06.084 INFO:tasks.workunit.client.0.smithi153.stderr: -360> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient: build_initial_monmap 2024-09-19T14:09:06.084 INFO:tasks.workunit.client.0.smithi153.stderr: -359> 2024-09-19T14:09:05.715+0000 7f2584d289c0 1 build_initial for_mkfs: 0 2024-09-19T14:09:06.085 INFO:tasks.workunit.client.0.smithi153.stderr: -358> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient: monmap: 2024-09-19T14:09:06.085 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:09:06.085 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:09:06.085 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:09:06.085 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:09:06.085 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:09:06.085 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:06.085 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:09:06.085 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:09:06.086 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:09:06.086 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.086 INFO:tasks.workunit.client.0.smithi153.stderr: -357> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding auth protocol: cephx 2024-09-19T14:09:06.086 INFO:tasks.workunit.client.0.smithi153.stderr: -356> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding auth protocol: cephx 2024-09-19T14:09:06.086 INFO:tasks.workunit.client.0.smithi153.stderr: -355> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding auth protocol: cephx 2024-09-19T14:09:06.086 INFO:tasks.workunit.client.0.smithi153.stderr: -354> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding con mode: secure 2024-09-19T14:09:06.086 INFO:tasks.workunit.client.0.smithi153.stderr: -353> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding con mode: crc 2024-09-19T14:09:06.086 INFO:tasks.workunit.client.0.smithi153.stderr: -352> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding con mode: secure 2024-09-19T14:09:06.086 INFO:tasks.workunit.client.0.smithi153.stderr: -351> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding con mode: crc 2024-09-19T14:09:06.086 INFO:tasks.workunit.client.0.smithi153.stderr: -350> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding con mode: secure 2024-09-19T14:09:06.086 INFO:tasks.workunit.client.0.smithi153.stderr: -349> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding con mode: crc 2024-09-19T14:09:06.086 INFO:tasks.workunit.client.0.smithi153.stderr: -348> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding con mode: crc 2024-09-19T14:09:06.086 INFO:tasks.workunit.client.0.smithi153.stderr: -347> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding con mode: secure 2024-09-19T14:09:06.087 INFO:tasks.workunit.client.0.smithi153.stderr: -346> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding con mode: crc 2024-09-19T14:09:06.087 INFO:tasks.workunit.client.0.smithi153.stderr: -345> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding con mode: secure 2024-09-19T14:09:06.087 INFO:tasks.workunit.client.0.smithi153.stderr: -344> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding con mode: crc 2024-09-19T14:09:06.087 INFO:tasks.workunit.client.0.smithi153.stderr: -343> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding con mode: secure 2024-09-19T14:09:06.087 INFO:tasks.workunit.client.0.smithi153.stderr: -342> 2024-09-19T14:09:05.715+0000 7f258202d640 10 monclient: get_auth_request con 0x7f245c071af0 auth_method 0 2024-09-19T14:09:06.087 INFO:tasks.workunit.client.0.smithi153.stderr: -341> 2024-09-19T14:09:05.715+0000 7f2584d289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:06.087 INFO:tasks.workunit.client.0.smithi153.stderr: -340> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient: init 2024-09-19T14:09:06.087 INFO:tasks.workunit.client.0.smithi153.stderr: -339> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding auth protocol: cephx 2024-09-19T14:09:06.087 INFO:tasks.workunit.client.0.smithi153.stderr: -338> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding auth protocol: cephx 2024-09-19T14:09:06.087 INFO:tasks.workunit.client.0.smithi153.stderr: -337> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding auth protocol: cephx 2024-09-19T14:09:06.087 INFO:tasks.workunit.client.0.smithi153.stderr: -336> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding con mode: secure 2024-09-19T14:09:06.087 INFO:tasks.workunit.client.0.smithi153.stderr: -335> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding con mode: crc 2024-09-19T14:09:06.087 INFO:tasks.workunit.client.0.smithi153.stderr: -334> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding con mode: secure 2024-09-19T14:09:06.087 INFO:tasks.workunit.client.0.smithi153.stderr: -333> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding con mode: crc 2024-09-19T14:09:06.088 INFO:tasks.workunit.client.0.smithi153.stderr: -332> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding con mode: secure 2024-09-19T14:09:06.088 INFO:tasks.workunit.client.0.smithi153.stderr: -331> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding con mode: crc 2024-09-19T14:09:06.088 INFO:tasks.workunit.client.0.smithi153.stderr: -330> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding con mode: crc 2024-09-19T14:09:06.088 INFO:tasks.workunit.client.0.smithi153.stderr: -329> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding con mode: secure 2024-09-19T14:09:06.088 INFO:tasks.workunit.client.0.smithi153.stderr: -328> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding con mode: crc 2024-09-19T14:09:06.088 INFO:tasks.workunit.client.0.smithi153.stderr: -327> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding con mode: secure 2024-09-19T14:09:06.088 INFO:tasks.workunit.client.0.smithi153.stderr: -326> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding con mode: crc 2024-09-19T14:09:06.088 INFO:tasks.workunit.client.0.smithi153.stderr: -325> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding con mode: secure 2024-09-19T14:09:06.088 INFO:tasks.workunit.client.0.smithi153.stderr: -324> 2024-09-19T14:09:05.715+0000 7f2584d289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:06.088 INFO:tasks.workunit.client.0.smithi153.stderr: -323> 2024-09-19T14:09:05.715+0000 7f2584d289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:06.088 INFO:tasks.workunit.client.0.smithi153.stderr: -322> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command rotate-key cmddesc rotate-key hook 0x7ffe79b18b78 EEXIST 2024-09-19T14:09:06.088 INFO:tasks.workunit.client.0.smithi153.stderr: -321> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient: _reopen_session rank -1 2024-09-19T14:09:06.088 INFO:tasks.workunit.client.0.smithi153.stderr: -320> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T14:09:06.088 INFO:tasks.workunit.client.0.smithi153.stderr: -319> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient(hunting): picked mon.noname-b con 0x5607b5de59e0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:09:06.089 INFO:tasks.workunit.client.0.smithi153.stderr: -318> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient(hunting): picked mon.noname-c con 0x5607b5db5400 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:09:06.089 INFO:tasks.workunit.client.0.smithi153.stderr: -317> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient(hunting): picked mon.noname-a con 0x5607b5de11b0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:09:06.089 INFO:tasks.workunit.client.0.smithi153.stderr: -316> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:06.089 INFO:tasks.workunit.client.0.smithi153.stderr: -315> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:06.089 INFO:tasks.workunit.client.0.smithi153.stderr: -314> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:06.089 INFO:tasks.workunit.client.0.smithi153.stderr: -313> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient(hunting): _renew_subs 2024-09-19T14:09:06.089 INFO:tasks.workunit.client.0.smithi153.stderr: -312> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient(hunting): authenticate will time out at 2734.177477s 2024-09-19T14:09:06.089 INFO:tasks.workunit.client.0.smithi153.stderr: -311> 2024-09-19T14:09:05.715+0000 7f258302f640 10 monclient(hunting): get_auth_request con 0x5607b5de11b0 auth_method 0 2024-09-19T14:09:06.089 INFO:tasks.workunit.client.0.smithi153.stderr: -310> 2024-09-19T14:09:05.715+0000 7f258302f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:06.089 INFO:tasks.workunit.client.0.smithi153.stderr: -309> 2024-09-19T14:09:05.715+0000 7f258302f640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:06.090 INFO:tasks.workunit.client.0.smithi153.stderr: -308> 2024-09-19T14:09:05.715+0000 7f258302f640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:06.090 INFO:tasks.workunit.client.0.smithi153.stderr: -307> 2024-09-19T14:09:05.715+0000 7f258202d640 10 monclient(hunting): get_auth_request con 0x5607b5db5400 auth_method 0 2024-09-19T14:09:06.090 INFO:tasks.workunit.client.0.smithi153.stderr: -306> 2024-09-19T14:09:05.715+0000 7f258202d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:06.090 INFO:tasks.workunit.client.0.smithi153.stderr: -305> 2024-09-19T14:09:05.715+0000 7f258202d640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:06.090 INFO:tasks.workunit.client.0.smithi153.stderr: -304> 2024-09-19T14:09:05.715+0000 7f258202d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:06.090 INFO:tasks.workunit.client.0.smithi153.stderr: -303> 2024-09-19T14:09:05.715+0000 7f258302f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:06.090 INFO:tasks.workunit.client.0.smithi153.stderr: -302> 2024-09-19T14:09:05.715+0000 7f258302f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:06.090 INFO:tasks.workunit.client.0.smithi153.stderr: -301> 2024-09-19T14:09:05.715+0000 7f258302f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:06.090 INFO:tasks.workunit.client.0.smithi153.stderr: -300> 2024-09-19T14:09:05.715+0000 7f258202d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:06.090 INFO:tasks.workunit.client.0.smithi153.stderr: -299> 2024-09-19T14:09:05.715+0000 7f258202d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:06.090 INFO:tasks.workunit.client.0.smithi153.stderr: -298> 2024-09-19T14:09:05.715+0000 7f258202d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:06.090 INFO:tasks.workunit.client.0.smithi153.stderr: -297> 2024-09-19T14:09:05.715+0000 7f258202d640 10 monclient(hunting): handle_auth_done global_id 6857 payload 274 2024-09-19T14:09:06.090 INFO:tasks.workunit.client.0.smithi153.stderr: -296> 2024-09-19T14:09:05.715+0000 7f258202d640 10 monclient: _finish_hunting 0 2024-09-19T14:09:06.091 INFO:tasks.workunit.client.0.smithi153.stderr: -295> 2024-09-19T14:09:05.715+0000 7f258202d640 1 monclient: found mon.noname-c 2024-09-19T14:09:06.091 INFO:tasks.workunit.client.0.smithi153.stderr: -294> 2024-09-19T14:09:05.715+0000 7f258202d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:09:06.091 INFO:tasks.workunit.client.0.smithi153.stderr: -293> 2024-09-19T14:09:05.715+0000 7f258282e640 10 monclient: get_auth_request con 0x5607b5de59e0 auth_method 0 2024-09-19T14:09:06.091 INFO:tasks.workunit.client.0.smithi153.stderr: -292> 2024-09-19T14:09:05.715+0000 7f24667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:06.091 INFO:tasks.workunit.client.0.smithi153.stderr: -291> 2024-09-19T14:09:05.715+0000 7f24667fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:09:06.091 INFO:tasks.workunit.client.0.smithi153.stderr: -290> 2024-09-19T14:09:05.715+0000 7f24667fc640 10 monclient: dump: 2024-09-19T14:09:06.091 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:06.091 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:06.091 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.091 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.091 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:06.091 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:06.091 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:06.091 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:06.092 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:06.092 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.092 INFO:tasks.workunit.client.0.smithi153.stderr: -289> 2024-09-19T14:09:05.715+0000 7f24667fc640 10 monclient: _finish_auth 0 2024-09-19T14:09:06.092 INFO:tasks.workunit.client.0.smithi153.stderr: -288> 2024-09-19T14:09:05.715+0000 7f24667fc640 10 monclient: _check_auth_tickets 2024-09-19T14:09:06.092 INFO:tasks.workunit.client.0.smithi153.stderr: -287> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 monclient: authenticate success, global_id 6857 2024-09-19T14:09:06.092 INFO:tasks.workunit.client.0.smithi153.stderr: -286> 2024-09-19T14:09:05.715+0000 7f24667fc640 10 monclient: handle_config config(0 keys) 2024-09-19T14:09:06.092 INFO:tasks.workunit.client.0.smithi153.stderr: -285> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient: get_monmap_and_config success 2024-09-19T14:09:06.092 INFO:tasks.workunit.client.0.smithi153.stderr: -284> 2024-09-19T14:09:05.715+0000 7f2584d289c0 4 set_mon_vals no callback set 2024-09-19T14:09:06.092 INFO:tasks.workunit.client.0.smithi153.stderr: -283> 2024-09-19T14:09:05.715+0000 7f24667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:06.092 INFO:tasks.workunit.client.0.smithi153.stderr: -282> 2024-09-19T14:09:05.715+0000 7f24667fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:09:06.092 INFO:tasks.workunit.client.0.smithi153.stderr: -281> 2024-09-19T14:09:05.715+0000 7f24667fc640 10 monclient: dump: 2024-09-19T14:09:06.092 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:06.092 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:06.092 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.092 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.093 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:06.093 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:06.093 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:06.093 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:06.093 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:06.093 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.093 INFO:tasks.workunit.client.0.smithi153.stderr: -280> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient: shutdown 2024-09-19T14:09:06.093 INFO:tasks.workunit.client.0.smithi153.stderr: -279> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient: build_initial_monmap 2024-09-19T14:09:06.093 INFO:tasks.workunit.client.0.smithi153.stderr: -278> 2024-09-19T14:09:05.715+0000 7f2584d289c0 1 build_initial for_mkfs: 0 2024-09-19T14:09:06.093 INFO:tasks.workunit.client.0.smithi153.stderr: -277> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient: monmap: 2024-09-19T14:09:06.093 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:09:06.093 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:09:06.093 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:09:06.094 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:09:06.094 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:09:06.094 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:06.094 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:09:06.094 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:09:06.094 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:09:06.094 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.094 INFO:tasks.workunit.client.0.smithi153.stderr: -276> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding auth protocol: cephx 2024-09-19T14:09:06.094 INFO:tasks.workunit.client.0.smithi153.stderr: -275> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding auth protocol: cephx 2024-09-19T14:09:06.094 INFO:tasks.workunit.client.0.smithi153.stderr: -274> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding auth protocol: cephx 2024-09-19T14:09:06.094 INFO:tasks.workunit.client.0.smithi153.stderr: -273> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding con mode: secure 2024-09-19T14:09:06.094 INFO:tasks.workunit.client.0.smithi153.stderr: -272> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding con mode: crc 2024-09-19T14:09:06.094 INFO:tasks.workunit.client.0.smithi153.stderr: -271> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding con mode: secure 2024-09-19T14:09:06.095 INFO:tasks.workunit.client.0.smithi153.stderr: -270> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding con mode: crc 2024-09-19T14:09:06.095 INFO:tasks.workunit.client.0.smithi153.stderr: -269> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding con mode: secure 2024-09-19T14:09:06.095 INFO:tasks.workunit.client.0.smithi153.stderr: -268> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding con mode: crc 2024-09-19T14:09:06.095 INFO:tasks.workunit.client.0.smithi153.stderr: -267> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding con mode: crc 2024-09-19T14:09:06.095 INFO:tasks.workunit.client.0.smithi153.stderr: -266> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding con mode: secure 2024-09-19T14:09:06.095 INFO:tasks.workunit.client.0.smithi153.stderr: -265> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding con mode: crc 2024-09-19T14:09:06.095 INFO:tasks.workunit.client.0.smithi153.stderr: -264> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding con mode: secure 2024-09-19T14:09:06.095 INFO:tasks.workunit.client.0.smithi153.stderr: -263> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding con mode: crc 2024-09-19T14:09:06.095 INFO:tasks.workunit.client.0.smithi153.stderr: -262> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding con mode: secure 2024-09-19T14:09:06.095 INFO:tasks.workunit.client.0.smithi153.stderr: -261> 2024-09-19T14:09:05.715+0000 7f2584d289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:06.095 INFO:tasks.workunit.client.0.smithi153.stderr: -260> 2024-09-19T14:09:05.715+0000 7f2584d289c0 1 librados: starting msgr at 2024-09-19T14:09:06.095 INFO:tasks.workunit.client.0.smithi153.stderr: -259> 2024-09-19T14:09:05.715+0000 7f2584d289c0 1 librados: starting objecter 2024-09-19T14:09:06.095 INFO:tasks.workunit.client.0.smithi153.stderr: -258> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command objecter_requests cmddesc objecter_requests hook 0x5607b5de2af0 EEXIST 2024-09-19T14:09:06.095 INFO:tasks.workunit.client.0.smithi153.stderr: -257> 2024-09-19T14:09:05.715+0000 7f2584d289c0 1 librados: setting wanted keys 2024-09-19T14:09:06.096 INFO:tasks.workunit.client.0.smithi153.stderr: -256> 2024-09-19T14:09:05.715+0000 7f2584d289c0 1 librados: calling monclient init 2024-09-19T14:09:06.096 INFO:tasks.workunit.client.0.smithi153.stderr: -255> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient: init 2024-09-19T14:09:06.096 INFO:tasks.workunit.client.0.smithi153.stderr: -254> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding auth protocol: cephx 2024-09-19T14:09:06.096 INFO:tasks.workunit.client.0.smithi153.stderr: -253> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding auth protocol: cephx 2024-09-19T14:09:06.096 INFO:tasks.workunit.client.0.smithi153.stderr: -252> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding auth protocol: cephx 2024-09-19T14:09:06.096 INFO:tasks.workunit.client.0.smithi153.stderr: -251> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding con mode: secure 2024-09-19T14:09:06.096 INFO:tasks.workunit.client.0.smithi153.stderr: -250> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding con mode: crc 2024-09-19T14:09:06.096 INFO:tasks.workunit.client.0.smithi153.stderr: -249> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding con mode: secure 2024-09-19T14:09:06.096 INFO:tasks.workunit.client.0.smithi153.stderr: -248> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding con mode: crc 2024-09-19T14:09:06.096 INFO:tasks.workunit.client.0.smithi153.stderr: -247> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding con mode: secure 2024-09-19T14:09:06.096 INFO:tasks.workunit.client.0.smithi153.stderr: -246> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding con mode: crc 2024-09-19T14:09:06.096 INFO:tasks.workunit.client.0.smithi153.stderr: -245> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding con mode: crc 2024-09-19T14:09:06.096 INFO:tasks.workunit.client.0.smithi153.stderr: -244> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding con mode: secure 2024-09-19T14:09:06.097 INFO:tasks.workunit.client.0.smithi153.stderr: -243> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding con mode: crc 2024-09-19T14:09:06.097 INFO:tasks.workunit.client.0.smithi153.stderr: -242> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding con mode: secure 2024-09-19T14:09:06.097 INFO:tasks.workunit.client.0.smithi153.stderr: -241> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding con mode: crc 2024-09-19T14:09:06.097 INFO:tasks.workunit.client.0.smithi153.stderr: -240> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding con mode: secure 2024-09-19T14:09:06.097 INFO:tasks.workunit.client.0.smithi153.stderr: -239> 2024-09-19T14:09:05.715+0000 7f2584d289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:06.097 INFO:tasks.workunit.client.0.smithi153.stderr: -238> 2024-09-19T14:09:05.715+0000 7f2584d289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:06.097 INFO:tasks.workunit.client.0.smithi153.stderr: -237> 2024-09-19T14:09:05.719+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command rotate-key cmddesc rotate-key hook 0x5607b5d93e28 EEXIST 2024-09-19T14:09:06.097 INFO:tasks.workunit.client.0.smithi153.stderr: -236> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient: _reopen_session rank -1 2024-09-19T14:09:06.097 INFO:tasks.workunit.client.0.smithi153.stderr: -235> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T14:09:06.097 INFO:tasks.workunit.client.0.smithi153.stderr: -234> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient(hunting): picked mon.noname-b con 0x5607b5db5400 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:09:06.097 INFO:tasks.workunit.client.0.smithi153.stderr: -233> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient(hunting): picked mon.noname-c con 0x5607b5de11b0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:09:06.097 INFO:tasks.workunit.client.0.smithi153.stderr: -232> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient(hunting): picked mon.noname-a con 0x5607b5de59e0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:09:06.097 INFO:tasks.workunit.client.0.smithi153.stderr: -231> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:06.098 INFO:tasks.workunit.client.0.smithi153.stderr: -230> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:06.098 INFO:tasks.workunit.client.0.smithi153.stderr: -229> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:06.098 INFO:tasks.workunit.client.0.smithi153.stderr: -228> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient(hunting): _renew_subs 2024-09-19T14:09:06.098 INFO:tasks.workunit.client.0.smithi153.stderr: -227> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient(hunting): authenticate will time out at 2734.180113s 2024-09-19T14:09:06.098 INFO:tasks.workunit.client.0.smithi153.stderr: -226> 2024-09-19T14:09:05.719+0000 7f258202d640 10 monclient(hunting): get_auth_request con 0x5607b5de11b0 auth_method 0 2024-09-19T14:09:06.098 INFO:tasks.workunit.client.0.smithi153.stderr: -225> 2024-09-19T14:09:05.719+0000 7f258202d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:06.098 INFO:tasks.workunit.client.0.smithi153.stderr: -224> 2024-09-19T14:09:05.719+0000 7f258202d640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:06.098 INFO:tasks.workunit.client.0.smithi153.stderr: -223> 2024-09-19T14:09:05.719+0000 7f258202d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:06.098 INFO:tasks.workunit.client.0.smithi153.stderr: -222> 2024-09-19T14:09:05.719+0000 7f258302f640 10 monclient(hunting): get_auth_request con 0x5607b5de59e0 auth_method 0 2024-09-19T14:09:06.098 INFO:tasks.workunit.client.0.smithi153.stderr: -221> 2024-09-19T14:09:05.719+0000 7f258302f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:06.098 INFO:tasks.workunit.client.0.smithi153.stderr: -220> 2024-09-19T14:09:05.719+0000 7f258302f640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:06.098 INFO:tasks.workunit.client.0.smithi153.stderr: -219> 2024-09-19T14:09:05.719+0000 7f258302f640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:06.098 INFO:tasks.workunit.client.0.smithi153.stderr: -218> 2024-09-19T14:09:05.719+0000 7f258202d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:06.099 INFO:tasks.workunit.client.0.smithi153.stderr: -217> 2024-09-19T14:09:05.719+0000 7f258202d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:06.099 INFO:tasks.workunit.client.0.smithi153.stderr: -216> 2024-09-19T14:09:05.719+0000 7f258202d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:06.099 INFO:tasks.workunit.client.0.smithi153.stderr: -215> 2024-09-19T14:09:05.719+0000 7f258302f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:06.099 INFO:tasks.workunit.client.0.smithi153.stderr: -214> 2024-09-19T14:09:05.719+0000 7f258302f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:06.099 INFO:tasks.workunit.client.0.smithi153.stderr: -213> 2024-09-19T14:09:05.719+0000 7f258302f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:06.099 INFO:tasks.workunit.client.0.smithi153.stderr: -212> 2024-09-19T14:09:05.719+0000 7f258282e640 10 monclient(hunting): get_auth_request con 0x5607b5db5400 auth_method 0 2024-09-19T14:09:06.099 INFO:tasks.workunit.client.0.smithi153.stderr: -211> 2024-09-19T14:09:05.719+0000 7f258282e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:06.099 INFO:tasks.workunit.client.0.smithi153.stderr: -210> 2024-09-19T14:09:05.719+0000 7f258282e640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:06.099 INFO:tasks.workunit.client.0.smithi153.stderr: -209> 2024-09-19T14:09:05.719+0000 7f258282e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:06.099 INFO:tasks.workunit.client.0.smithi153.stderr: -208> 2024-09-19T14:09:05.719+0000 7f258202d640 10 monclient(hunting): handle_auth_done global_id 6860 payload 824 2024-09-19T14:09:06.099 INFO:tasks.workunit.client.0.smithi153.stderr: -207> 2024-09-19T14:09:05.719+0000 7f258202d640 10 monclient: _finish_hunting 0 2024-09-19T14:09:06.099 INFO:tasks.workunit.client.0.smithi153.stderr: -206> 2024-09-19T14:09:05.719+0000 7f258202d640 1 monclient: found mon.noname-c 2024-09-19T14:09:06.099 INFO:tasks.workunit.client.0.smithi153.stderr: -205> 2024-09-19T14:09:05.719+0000 7f258202d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:09:06.099 INFO:tasks.workunit.client.0.smithi153.stderr: -204> 2024-09-19T14:09:05.719+0000 7f2464ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:06.100 INFO:tasks.workunit.client.0.smithi153.stderr: -203> 2024-09-19T14:09:05.719+0000 7f2464ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:09:06.100 INFO:tasks.workunit.client.0.smithi153.stderr: -202> 2024-09-19T14:09:05.719+0000 7f2464ff9640 10 monclient: dump: 2024-09-19T14:09:06.100 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:06.100 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:06.100 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.100 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.100 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:06.100 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:06.100 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:06.100 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:06.100 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:06.100 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.100 INFO:tasks.workunit.client.0.smithi153.stderr: -201> 2024-09-19T14:09:05.719+0000 7f2464ff9640 10 monclient: _finish_auth 0 2024-09-19T14:09:06.101 INFO:tasks.workunit.client.0.smithi153.stderr: -200> 2024-09-19T14:09:05.719+0000 7f2464ff9640 10 monclient: _check_auth_tickets 2024-09-19T14:09:06.101 INFO:tasks.workunit.client.0.smithi153.stderr: -199> 2024-09-19T14:09:05.719+0000 7f2584d289c0 5 monclient: authenticate success, global_id 6860 2024-09-19T14:09:06.101 INFO:tasks.workunit.client.0.smithi153.stderr: -198> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient: _renew_subs 2024-09-19T14:09:06.101 INFO:tasks.workunit.client.0.smithi153.stderr: -197> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:09:06.101 INFO:tasks.workunit.client.0.smithi153.stderr: -196> 2024-09-19T14:09:05.719+0000 7f2464ff9640 10 monclient: handle_config config(0 keys) 2024-09-19T14:09:06.101 INFO:tasks.workunit.client.0.smithi153.stderr: -195> 2024-09-19T14:09:05.719+0000 7f2464ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:06.101 INFO:tasks.workunit.client.0.smithi153.stderr: -194> 2024-09-19T14:09:05.719+0000 7f2464ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:09:06.101 INFO:tasks.workunit.client.0.smithi153.stderr: -193> 2024-09-19T14:09:05.719+0000 7f2464ff9640 10 monclient: dump: 2024-09-19T14:09:06.101 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:06.101 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:06.101 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.101 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.101 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:06.101 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:06.101 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:06.102 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:06.102 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:06.102 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.102 INFO:tasks.workunit.client.0.smithi153.stderr: -192> 2024-09-19T14:09:05.719+0000 7f24667fc640 4 set_mon_vals no callback set 2024-09-19T14:09:06.102 INFO:tasks.workunit.client.0.smithi153.stderr: -191> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient: _renew_subs 2024-09-19T14:09:06.102 INFO:tasks.workunit.client.0.smithi153.stderr: -190> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:09:06.102 INFO:tasks.workunit.client.0.smithi153.stderr: -189> 2024-09-19T14:09:05.719+0000 7f2584d289c0 1 librados: init done 2024-09-19T14:09:06.102 INFO:tasks.workunit.client.0.smithi153.stderr: -188> 2024-09-19T14:09:05.719+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command cr dump hook 0x5607b5dd8958 2024-09-19T14:09:06.102 INFO:tasks.workunit.client.0.smithi153.stderr: -187> 2024-09-19T14:09:05.719+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.102 INFO:tasks.workunit.client.0.smithi153.stderr: -186> 2024-09-19T14:09:05.719+0000 7f2464ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:09:06.102 INFO:tasks.workunit.client.0.smithi153.stderr: -185> 2024-09-19T14:09:05.719+0000 7f2464ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:09:06.102 INFO:tasks.workunit.client.0.smithi153.stderr: -184> 2024-09-19T14:09:05.719+0000 7f2464ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:09:06.102 INFO:tasks.workunit.client.0.smithi153.stderr: -183> 2024-09-19T14:09:05.719+0000 7f258302f640 10 monclient: get_auth_request con 0x5607b5dfeff0 auth_method 0 2024-09-19T14:09:06.102 INFO:tasks.workunit.client.0.smithi153.stderr: -182> 2024-09-19T14:09:05.719+0000 7f258282e640 10 monclient: get_auth_request con 0x7f244c071c10 auth_method 0 2024-09-19T14:09:06.102 INFO:tasks.workunit.client.0.smithi153.stderr: -181> 2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:06.103 INFO:tasks.workunit.client.0.smithi153.stderr: -180> 2024-09-19T14:09:05.723+0000 7f2584d289c0 20 realm 2024-09-19T14:09:06.103 INFO:tasks.workunit.client.0.smithi153.stderr: -179> 2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.103 INFO:tasks.workunit.client.0.smithi153.stderr: -178> 2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:06.103 INFO:tasks.workunit.client.0.smithi153.stderr: -177> 2024-09-19T14:09:05.723+0000 7f2584d289c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:09:06.103 INFO:tasks.workunit.client.0.smithi153.stderr: -176> 2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.103 INFO:tasks.workunit.client.0.smithi153.stderr: -175> 2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:06.103 INFO:tasks.workunit.client.0.smithi153.stderr: -174> 2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.103 INFO:tasks.workunit.client.0.smithi153.stderr: -173> 2024-09-19T14:09:05.723+0000 7f258282e640 10 monclient: get_auth_request con 0x5607b5e033e0 auth_method 0 2024-09-19T14:09:06.103 INFO:tasks.workunit.client.0.smithi153.stderr: -172> 2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:06.103 INFO:tasks.workunit.client.0.smithi153.stderr: -171> 2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.103 INFO:tasks.workunit.client.0.smithi153.stderr: -170> 2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:09:06.103 INFO:tasks.workunit.client.0.smithi153.stderr: -169> 2024-09-19T14:09:05.723+0000 7f2584d289c0 20 searching for the correct realm 2024-09-19T14:09:06.103 INFO:tasks.workunit.client.0.smithi153.stderr: -168> 2024-09-19T14:09:05.723+0000 7f258202d640 10 monclient: get_auth_request con 0x5607b5e08560 auth_method 0 2024-09-19T14:09:06.103 INFO:tasks.workunit.client.0.smithi153.stderr: -167> 2024-09-19T14:09:05.723+0000 7f258302f640 10 monclient: get_auth_request con 0x7f2578003290 auth_method 0 2024-09-19T14:09:06.103 INFO:tasks.workunit.client.0.smithi153.stderr: -166> 2024-09-19T14:09:05.727+0000 7f258282e640 10 monclient: get_auth_request con 0x7f257c015b10 auth_method 0 2024-09-19T14:09:06.104 INFO:tasks.workunit.client.0.smithi153.stderr: -165> 2024-09-19T14:09:05.727+0000 7f258202d640 10 monclient: get_auth_request con 0x7f2574109040 auth_method 0 2024-09-19T14:09:06.104 INFO:tasks.workunit.client.0.smithi153.stderr: -164> 2024-09-19T14:09:05.727+0000 7f258202d640 0 -- 172.21.15.153:0/225296854 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f2574109040 msgr2=0x7f25741019c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:06.104 INFO:tasks.workunit.client.0.smithi153.stderr: -163> 2024-09-19T14:09:05.727+0000 7f2464ff9640 1 client.6860.objecter ms_handle_reset 0x7f2574109040 session 0x7f25740a6070 osd.4 2024-09-19T14:09:06.104 INFO:tasks.workunit.client.0.smithi153.stderr: -162> 2024-09-19T14:09:05.727+0000 7f2464ff9640 10 monclient: _renew_subs 2024-09-19T14:09:06.104 INFO:tasks.workunit.client.0.smithi153.stderr: -161> 2024-09-19T14:09:05.727+0000 7f2464ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:09:06.104 INFO:tasks.workunit.client.0.smithi153.stderr: -160> 2024-09-19T14:09:05.727+0000 7f258202d640 10 monclient: get_auth_request con 0x7f244c082340 auth_method 0 2024-09-19T14:09:06.104 INFO:tasks.workunit.client.0.smithi153.stderr: -159> 2024-09-19T14:09:05.731+0000 7f258302f640 10 monclient: get_auth_request con 0x7f257803c110 auth_method 0 2024-09-19T14:09:06.104 INFO:tasks.workunit.client.0.smithi153.stderr: -158> 2024-09-19T14:09:05.735+0000 7f258282e640 10 monclient: get_auth_request con 0x7f2578054150 auth_method 0 2024-09-19T14:09:06.104 INFO:tasks.workunit.client.0.smithi153.stderr: -157> 2024-09-19T14:09:05.735+0000 7f258282e640 0 -- 172.21.15.153:0/225296854 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f2578054150 msgr2=0x7f2578054760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:06.104 INFO:tasks.workunit.client.0.smithi153.stderr: -156> 2024-09-19T14:09:05.939+0000 7f258282e640 10 monclient: get_auth_request con 0x7f2578054150 auth_method 0 2024-09-19T14:09:06.104 INFO:tasks.workunit.client.0.smithi153.stderr: -155> 2024-09-19T14:09:05.951+0000 7f2584d289c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:09:06.104 INFO:tasks.workunit.client.0.smithi153.stderr: -154> 2024-09-19T14:09:05.951+0000 7f2584d289c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:09:06.104 INFO:tasks.workunit.client.0.smithi153.stderr: -153> 2024-09-19T14:09:05.951+0000 7f2584d289c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:09:06.104 INFO:tasks.workunit.client.0.smithi153.stderr: -152> 2024-09-19T14:09:05.951+0000 7f2584d289c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:09:06.104 INFO:tasks.workunit.client.0.smithi153.stderr: -151> 2024-09-19T14:09:05.951+0000 7f2584d289c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:09:06.105 INFO:tasks.workunit.client.0.smithi153.stderr: -150> 2024-09-19T14:09:05.951+0000 7f2584d289c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:09:06.105 INFO:tasks.workunit.client.0.smithi153.stderr: -149> 2024-09-19T14:09:05.951+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.105 INFO:tasks.workunit.client.0.smithi153.stderr: -148> 2024-09-19T14:09:05.951+0000 7f2584d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:06.105 INFO:tasks.workunit.client.0.smithi153.stderr: -147> 2024-09-19T14:09:05.951+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.105 INFO:tasks.workunit.client.0.smithi153.stderr: -146> 2024-09-19T14:09:05.951+0000 7f2584d289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:06.105 INFO:tasks.workunit.client.0.smithi153.stderr: -145> 2024-09-19T14:09:05.951+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.105 INFO:tasks.workunit.client.0.smithi153.stderr: -144> 2024-09-19T14:09:05.955+0000 7f2584d289c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:09:06.105 INFO:tasks.workunit.client.0.smithi153.stderr: -143> 2024-09-19T14:09:05.955+0000 7f2584d289c0 20 zone default found 2024-09-19T14:09:06.105 INFO:tasks.workunit.client.0.smithi153.stderr: -142> 2024-09-19T14:09:05.955+0000 7f2584d289c0 4 Realm: () 2024-09-19T14:09:06.105 INFO:tasks.workunit.client.0.smithi153.stderr: -141> 2024-09-19T14:09:05.955+0000 7f2584d289c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:09:06.105 INFO:tasks.workunit.client.0.smithi153.stderr: -140> 2024-09-19T14:09:05.955+0000 7f2584d289c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:09:06.105 INFO:tasks.workunit.client.0.smithi153.stderr: -139> 2024-09-19T14:09:05.955+0000 7f2584d289c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:09:06.105 INFO:tasks.workunit.client.0.smithi153.stderr: -138> 2024-09-19T14:09:05.955+0000 7f2584d289c0 20 zonegroup default 2024-09-19T14:09:06.105 INFO:tasks.workunit.client.0.smithi153.stderr: -137> 2024-09-19T14:09:05.955+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.106 INFO:tasks.workunit.client.0.smithi153.stderr: -136> 2024-09-19T14:09:05.955+0000 7f2584d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:06.106 INFO:tasks.workunit.client.0.smithi153.stderr: -135> 2024-09-19T14:09:05.955+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.106 INFO:tasks.workunit.client.0.smithi153.stderr: -134> 2024-09-19T14:09:05.955+0000 7f2584d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:06.106 INFO:tasks.workunit.client.0.smithi153.stderr: -133> 2024-09-19T14:09:05.955+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.106 INFO:tasks.workunit.client.0.smithi153.stderr: -132> 2024-09-19T14:09:05.955+0000 7f2584d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:06.106 INFO:tasks.workunit.client.0.smithi153.stderr: -131> 2024-09-19T14:09:05.955+0000 7f2584d289c0 20 started sync module instance, tier type = 2024-09-19T14:09:06.106 INFO:tasks.workunit.client.0.smithi153.stderr: -130> 2024-09-19T14:09:05.955+0000 7f2584d289c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:09:06.106 INFO:tasks.workunit.client.0.smithi153.stderr: -129> 2024-09-19T14:09:05.979+0000 7f2584d289c0 20 add_watcher() i=0 2024-09-19T14:09:06.106 INFO:tasks.workunit.client.0.smithi153.stderr: -128> 2024-09-19T14:09:05.979+0000 7f2584d289c0 20 add_watcher() i=1 2024-09-19T14:09:06.106 INFO:tasks.workunit.client.0.smithi153.stderr: -127> 2024-09-19T14:09:05.979+0000 7f2584d289c0 20 add_watcher() i=2 2024-09-19T14:09:06.106 INFO:tasks.workunit.client.0.smithi153.stderr: -126> 2024-09-19T14:09:05.979+0000 7f2584d289c0 20 add_watcher() i=3 2024-09-19T14:09:06.106 INFO:tasks.workunit.client.0.smithi153.stderr: -125> 2024-09-19T14:09:05.979+0000 7f2584d289c0 20 add_watcher() i=4 2024-09-19T14:09:06.106 INFO:tasks.workunit.client.0.smithi153.stderr: -124> 2024-09-19T14:09:05.979+0000 7f2584d289c0 20 add_watcher() i=5 2024-09-19T14:09:06.106 INFO:tasks.workunit.client.0.smithi153.stderr: -123> 2024-09-19T14:09:05.979+0000 7f2584d289c0 20 add_watcher() i=6 2024-09-19T14:09:06.107 INFO:tasks.workunit.client.0.smithi153.stderr: -122> 2024-09-19T14:09:05.983+0000 7f2584d289c0 20 add_watcher() i=7 2024-09-19T14:09:06.107 INFO:tasks.workunit.client.0.smithi153.stderr: -121> 2024-09-19T14:09:05.983+0000 7f2584d289c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:09:06.107 INFO:tasks.workunit.client.0.smithi153.stderr: -120> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding auth protocol: cephx 2024-09-19T14:09:06.107 INFO:tasks.workunit.client.0.smithi153.stderr: -119> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding auth protocol: cephx 2024-09-19T14:09:06.107 INFO:tasks.workunit.client.0.smithi153.stderr: -118> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding auth protocol: cephx 2024-09-19T14:09:06.107 INFO:tasks.workunit.client.0.smithi153.stderr: -117> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding con mode: secure 2024-09-19T14:09:06.107 INFO:tasks.workunit.client.0.smithi153.stderr: -116> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding con mode: crc 2024-09-19T14:09:06.107 INFO:tasks.workunit.client.0.smithi153.stderr: -115> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding con mode: secure 2024-09-19T14:09:06.107 INFO:tasks.workunit.client.0.smithi153.stderr: -114> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding con mode: crc 2024-09-19T14:09:06.107 INFO:tasks.workunit.client.0.smithi153.stderr: -113> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding con mode: secure 2024-09-19T14:09:06.107 INFO:tasks.workunit.client.0.smithi153.stderr: -112> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding con mode: crc 2024-09-19T14:09:06.107 INFO:tasks.workunit.client.0.smithi153.stderr: -111> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding con mode: crc 2024-09-19T14:09:06.107 INFO:tasks.workunit.client.0.smithi153.stderr: -110> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding con mode: secure 2024-09-19T14:09:06.107 INFO:tasks.workunit.client.0.smithi153.stderr: -109> 2024-09-19T14:09:05.987+0000 7f24397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:06.108 INFO:tasks.workunit.client.0.smithi153.stderr: -108> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding con mode: crc 2024-09-19T14:09:06.108 INFO:tasks.workunit.client.0.smithi153.stderr: -107> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding con mode: secure 2024-09-19T14:09:06.108 INFO:tasks.workunit.client.0.smithi153.stderr: -106> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding con mode: crc 2024-09-19T14:09:06.108 INFO:tasks.workunit.client.0.smithi153.stderr: -105> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding con mode: secure 2024-09-19T14:09:06.108 INFO:tasks.workunit.client.0.smithi153.stderr: -104> 2024-09-19T14:09:05.987+0000 7f2584d289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:06.108 INFO:tasks.workunit.client.0.smithi153.stderr: -103> 2024-09-19T14:09:05.987+0000 7f2584d289c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:09:06.108 INFO:tasks.workunit.client.0.smithi153.stderr: -102> 2024-09-19T14:09:05.987+0000 7f2584d289c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:09:06.108 INFO:tasks.workunit.client.0.smithi153.stderr: -101> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command cache list hook 0x5607b5dd5c50 2024-09-19T14:09:06.108 INFO:tasks.workunit.client.0.smithi153.stderr: -100> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command cache inspect hook 0x5607b5dd5c50 2024-09-19T14:09:06.108 INFO:tasks.workunit.client.0.smithi153.stderr: -99> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command cache erase hook 0x5607b5dd5c50 2024-09-19T14:09:06.108 INFO:tasks.workunit.client.0.smithi153.stderr: -98> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command cache zap hook 0x5607b5dd5c50 2024-09-19T14:09:06.108 INFO:tasks.workunit.client.0.smithi153.stderr: -97> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 note: GC not initialized 2024-09-19T14:09:06.108 INFO:tasks.workunit.client.0.smithi153.stderr: -96> 2024-09-19T14:09:05.987+0000 7f23b3fff640 20 reqs_thread_entry: start 2024-09-19T14:09:06.108 INFO:tasks.workunit.client.0.smithi153.stderr: -95> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command sync trace show hook 0x7f2578059870 2024-09-19T14:09:06.109 INFO:tasks.workunit.client.0.smithi153.stderr: -94> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command sync trace history hook 0x7f2578059870 2024-09-19T14:09:06.109 INFO:tasks.workunit.client.0.smithi153.stderr: -93> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command sync trace active hook 0x7f2578059870 2024-09-19T14:09:06.109 INFO:tasks.workunit.client.0.smithi153.stderr: -92> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command sync trace active_short hook 0x7f2578059870 2024-09-19T14:09:06.109 INFO:tasks.workunit.client.0.smithi153.stderr: -91> 2024-09-19T14:09:05.987+0000 7f2584d289c0 20 init_complete bucket index max shards: 11 2024-09-19T14:09:06.109 INFO:tasks.workunit.client.0.smithi153.stderr: -90> 2024-09-19T14:09:05.987+0000 7f2584d289c0 20 Filter name: none 2024-09-19T14:09:06.109 INFO:tasks.workunit.client.0.smithi153.stderr: -89> 2024-09-19T14:09:05.987+0000 7f23b1ffb640 20 reqs_thread_entry: start 2024-09-19T14:09:06.109 INFO:tasks.workunit.client.0.smithi153.stderr: -88> 2024-09-19T14:09:05.987+0000 7f2584d289c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-19T14:09:06.109 INFO:tasks.workunit.client.0.smithi153.stderr: -87> 2024-09-19T14:09:05.987+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.109 INFO:tasks.workunit.client.0.smithi153.stderr: -86> 2024-09-19T14:09:05.991+0000 7f2584d289c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:09:06.109 INFO:tasks.workunit.client.0.smithi153.stderr: -85> 2024-09-19T14:09:05.991+0000 7f2584d289c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-19T14:09:06.109 INFO:tasks.workunit.client.0.smithi153.stderr: -84> 2024-09-19T14:09:05.991+0000 7f2584d289c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-19T14:09:06.109 INFO:tasks.workunit.client.0.smithi153.stderr: -83> 2024-09-19T14:09:05.991+0000 7f2584d289c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 : miss 2024-09-19T14:09:06.109 INFO:tasks.workunit.client.0.smithi153.stderr: -82> 2024-09-19T14:09:05.991+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.110 INFO:tasks.workunit.client.0.smithi153.stderr: -81> 2024-09-19T14:09:05.991+0000 7f2584d289c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:09:06.110 INFO:tasks.workunit.client.0.smithi153.stderr: -80> 2024-09-19T14:09:05.991+0000 7f2584d289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 info.flags=0x17 2024-09-19T14:09:06.110 INFO:tasks.workunit.client.0.smithi153.stderr: -79> 2024-09-19T14:09:05.991+0000 7f2584d289c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 to cache LRU end 2024-09-19T14:09:06.110 INFO:tasks.workunit.client.0.smithi153.stderr: -78> 2024-09-19T14:09:05.991+0000 7f2584d289c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:09:06.110 INFO:tasks.workunit.client.0.smithi153.stderr: -77> 2024-09-19T14:09:05.991+0000 7f2584d289c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:06.110 INFO:tasks.workunit.client.0.smithi153.stderr: -76> 2024-09-19T14:09:05.991+0000 7f2584d289c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 2024-09-19T14:09:06.110 INFO:tasks.workunit.client.0.smithi153.stderr: -75> 2024-09-19T14:09:05.999+0000 7f2584d289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 info.flags=0x17 2024-09-19T14:09:06.110 INFO:tasks.workunit.client.0.smithi153.stderr: -74> 2024-09-19T14:09:05.999+0000 7f2584d289c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 to cache LRU end 2024-09-19T14:09:06.110 INFO:tasks.workunit.client.0.smithi153.stderr: -73> 2024-09-19T14:09:05.999+0000 7f2584d289c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:06.110 INFO:tasks.workunit.client.0.smithi153.stderr: -72> 2024-09-19T14:09:05.999+0000 7f2584d289c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32, ofs0, ns] 2024-09-19T14:09:06.110 INFO:tasks.workunit.client.0.smithi153.stderr: -71> 2024-09-19T14:09:05.999+0000 7f2465ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333493 cookie 94591116184432 notifier 6860 bl.length()=931 2024-09-19T14:09:06.110 INFO:tasks.workunit.client.0.smithi153.stderr: -70> 2024-09-19T14:09:05.999+0000 7f2465ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 info.flags=0x17 2024-09-19T14:09:06.110 INFO:tasks.workunit.client.0.smithi153.stderr: -69> 2024-09-19T14:09:05.999+0000 7f2465ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 to cache LRU end 2024-09-19T14:09:06.111 INFO:tasks.workunit.client.0.smithi153.stderr: -68> 2024-09-19T14:09:05.999+0000 7f2465ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:06.111 INFO:tasks.workunit.client.0.smithi153.stderr: -67> 2024-09-19T14:09:06.003+0000 7f2584d289c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): orig_sources= new_sources= 2024-09-19T14:09:06.111 INFO:tasks.workunit.client.0.smithi153.stderr: -66> 2024-09-19T14:09:06.003+0000 7f2584d289c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): potential sources added=[] removed=[] 2024-09-19T14:09:06.111 INFO:tasks.workunit.client.0.smithi153.stderr: -65> 2024-09-19T14:09:06.003+0000 7f2584d289c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): orig_dests= new_dests= 2024-09-19T14:09:06.111 INFO:tasks.workunit.client.0.smithi153.stderr: -64> 2024-09-19T14:09:06.003+0000 7f2584d289c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): potential dests added=[] removed=[] 2024-09-19T14:09:06.111 INFO:tasks.workunit.client.0.smithi153.stderr: -63> 2024-09-19T14:09:06.007+0000 7f2464ff9640 1 client.6860.objecter ms_handle_reset 0x7f244c082340 session 0x7f25740a6070 osd.4 2024-09-19T14:09:06.111 INFO:tasks.workunit.client.0.smithi153.stderr: -62> 2024-09-19T14:09:06.011+0000 7f258202d640 10 monclient: get_auth_request con 0x7f2574109040 auth_method 0 2024-09-19T14:09:06.111 INFO:tasks.workunit.client.0.smithi153.stderr: -61> 2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.0 2024-09-19T14:09:06.111 INFO:tasks.workunit.client.0.smithi153.stderr: -60> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.0 2024-09-19T14:09:06.111 INFO:tasks.workunit.client.0.smithi153.stderr: -59> 2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.1 2024-09-19T14:09:06.111 INFO:tasks.workunit.client.0.smithi153.stderr: -58> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.1 2024-09-19T14:09:06.111 INFO:tasks.workunit.client.0.smithi153.stderr: -57> 2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.2 2024-09-19T14:09:06.111 INFO:tasks.workunit.client.0.smithi153.stderr: -56> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.2 2024-09-19T14:09:06.111 INFO:tasks.workunit.client.0.smithi153.stderr: -55> 2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.3 2024-09-19T14:09:06.111 INFO:tasks.workunit.client.0.smithi153.stderr: -54> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.3 2024-09-19T14:09:06.112 INFO:tasks.workunit.client.0.smithi153.stderr: -53> 2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.4 2024-09-19T14:09:06.112 INFO:tasks.workunit.client.0.smithi153.stderr: -52> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.4 2024-09-19T14:09:06.112 INFO:tasks.workunit.client.0.smithi153.stderr: -51> 2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.5 2024-09-19T14:09:06.112 INFO:tasks.workunit.client.0.smithi153.stderr: -50> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.5 2024-09-19T14:09:06.112 INFO:tasks.workunit.client.0.smithi153.stderr: -49> 2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.6 2024-09-19T14:09:06.112 INFO:tasks.workunit.client.0.smithi153.stderr: -48> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.6 2024-09-19T14:09:06.112 INFO:tasks.workunit.client.0.smithi153.stderr: -47> 2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.7 2024-09-19T14:09:06.112 INFO:tasks.workunit.client.0.smithi153.stderr: -46> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.7 2024-09-19T14:09:06.112 INFO:tasks.workunit.client.0.smithi153.stderr: -45> 2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.8 2024-09-19T14:09:06.112 INFO:tasks.workunit.client.0.smithi153.stderr: -44> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.8 2024-09-19T14:09:06.112 INFO:tasks.workunit.client.0.smithi153.stderr: -43> 2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.9 2024-09-19T14:09:06.112 INFO:tasks.workunit.client.0.smithi153.stderr: -42> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.9 2024-09-19T14:09:06.112 INFO:tasks.workunit.client.0.smithi153.stderr: -41> 2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.10 2024-09-19T14:09:06.113 INFO:tasks.workunit.client.0.smithi153.stderr: -40> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.10 2024-09-19T14:09:06.113 INFO:tasks.workunit.client.0.smithi153.stderr: -39> 2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.11 2024-09-19T14:09:06.113 INFO:tasks.workunit.client.0.smithi153.stderr: -38> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.11 2024-09-19T14:09:06.113 INFO:tasks.workunit.client.0.smithi153.stderr: -37> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.0 2024-09-19T14:09:06.113 INFO:tasks.workunit.client.0.smithi153.stderr: -36> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1 2024-09-19T14:09:06.113 INFO:tasks.workunit.client.0.smithi153.stderr: -35> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.2 2024-09-19T14:09:06.113 INFO:tasks.workunit.client.0.smithi153.stderr: -34> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.3 2024-09-19T14:09:06.113 INFO:tasks.workunit.client.0.smithi153.stderr: -33> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.4 2024-09-19T14:09:06.113 INFO:tasks.workunit.client.0.smithi153.stderr: -32> 2024-09-19T14:09:06.023+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.5 2024-09-19T14:09:06.113 INFO:tasks.workunit.client.0.smithi153.stderr: -31> 2024-09-19T14:09:06.023+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.6 2024-09-19T14:09:06.113 INFO:tasks.workunit.client.0.smithi153.stderr: -30> 2024-09-19T14:09:06.023+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.7 2024-09-19T14:09:06.113 INFO:tasks.workunit.client.0.smithi153.stderr: -29> 2024-09-19T14:09:06.027+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.8 2024-09-19T14:09:06.114 INFO:tasks.workunit.client.0.smithi153.stderr: -28> 2024-09-19T14:09:06.027+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.9 2024-09-19T14:09:06.114 INFO:tasks.workunit.client.0.smithi153.stderr: -27> 2024-09-19T14:09:06.027+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.10 2024-09-19T14:09:06.114 INFO:tasks.workunit.client.0.smithi153.stderr: -26> 2024-09-19T14:09:06.035+0000 7f2584d289c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 : hit (requested=0x17, cached=0x17) 2024-09-19T14:09:06.114 INFO:tasks.workunit.client.0.smithi153.stderr: -25> 2024-09-19T14:09:06.035+0000 7f2584d289c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 2024-09-19T14:09:06.114 INFO:tasks.workunit.client.0.smithi153.stderr: -24> 2024-09-19T14:09:06.035+0000 7f2584d289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 info.flags=0x17 2024-09-19T14:09:06.114 INFO:tasks.workunit.client.0.smithi153.stderr: -23> 2024-09-19T14:09:06.035+0000 7f2584d289c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 to cache LRU end 2024-09-19T14:09:06.114 INFO:tasks.workunit.client.0.smithi153.stderr: -22> 2024-09-19T14:09:06.035+0000 7f2584d289c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:06.114 INFO:tasks.workunit.client.0.smithi153.stderr: -21> 2024-09-19T14:09:06.035+0000 7f2584d289c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32, ofs0, ns] 2024-09-19T14:09:06.114 INFO:tasks.workunit.client.0.smithi153.stderr: -20> 2024-09-19T14:09:06.035+0000 7f2465ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333494 cookie 94591116184432 notifier 6860 bl.length()=931 2024-09-19T14:09:06.114 INFO:tasks.workunit.client.0.smithi153.stderr: -19> 2024-09-19T14:09:06.035+0000 7f2465ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 info.flags=0x17 2024-09-19T14:09:06.114 INFO:tasks.workunit.client.0.smithi153.stderr: -18> 2024-09-19T14:09:06.035+0000 7f2465ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 to cache LRU end 2024-09-19T14:09:06.114 INFO:tasks.workunit.client.0.smithi153.stderr: -17> 2024-09-19T14:09:06.035+0000 7f2465ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:06.114 INFO:tasks.workunit.client.0.smithi153.stderr: -16> 2024-09-19T14:09:06.039+0000 7f2584d289c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): orig_sources= new_sources= 2024-09-19T14:09:06.114 INFO:tasks.workunit.client.0.smithi153.stderr: -15> 2024-09-19T14:09:06.039+0000 7f2584d289c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): potential sources added=[] removed=[] 2024-09-19T14:09:06.114 INFO:tasks.workunit.client.0.smithi153.stderr: -14> 2024-09-19T14:09:06.039+0000 7f2584d289c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): orig_dests= new_dests= 2024-09-19T14:09:06.115 INFO:tasks.workunit.client.0.smithi153.stderr: -13> 2024-09-19T14:09:06.039+0000 7f2584d289c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): potential dests added=[] removed=[] 2024-09-19T14:09:06.115 INFO:tasks.workunit.client.0.smithi153.stderr: -12> 2024-09-19T14:09:06.047+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.0 2024-09-19T14:09:06.115 INFO:tasks.workunit.client.0.smithi153.stderr: -11> 2024-09-19T14:09:06.047+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1 2024-09-19T14:09:06.115 INFO:tasks.workunit.client.0.smithi153.stderr: -10> 2024-09-19T14:09:06.047+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.2 2024-09-19T14:09:06.115 INFO:tasks.workunit.client.0.smithi153.stderr: -9> 2024-09-19T14:09:06.047+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.3 2024-09-19T14:09:06.115 INFO:tasks.workunit.client.0.smithi153.stderr: -8> 2024-09-19T14:09:06.051+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.4 2024-09-19T14:09:06.115 INFO:tasks.workunit.client.0.smithi153.stderr: -7> 2024-09-19T14:09:06.051+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.5 2024-09-19T14:09:06.115 INFO:tasks.workunit.client.0.smithi153.stderr: -6> 2024-09-19T14:09:06.051+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.6 2024-09-19T14:09:06.115 INFO:tasks.workunit.client.0.smithi153.stderr: -5> 2024-09-19T14:09:06.051+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.7 2024-09-19T14:09:06.115 INFO:tasks.workunit.client.0.smithi153.stderr: -4> 2024-09-19T14:09:06.051+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.8 2024-09-19T14:09:06.115 INFO:tasks.workunit.client.0.smithi153.stderr: -3> 2024-09-19T14:09:06.055+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.9 2024-09-19T14:09:06.115 INFO:tasks.workunit.client.0.smithi153.stderr: -2> 2024-09-19T14:09:06.055+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.10 2024-09-19T14:09:06.115 INFO:tasks.workunit.client.0.smithi153.stderr: -1> 2024-09-19T14:09:06.055+0000 7f2584d289c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2584d289c0 time 2024-09-19T14:09:06.058360+0000 2024-09-19T14:09:06.115 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:09:06.115 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.116 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:09:06.116 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f25886022eb] 2024-09-19T14:09:06.116 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f258860249f] 2024-09-19T14:09:06.116 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5607b4501271] 2024-09-19T14:09:06.116 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5607b45113b7] 2024-09-19T14:09:06.116 INFO:tasks.workunit.client.0.smithi153.stderr: 5: main() 2024-09-19T14:09:06.116 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2587468d90] 2024-09-19T14:09:06.116 INFO:tasks.workunit.client.0.smithi153.stderr: 7: __libc_start_main() 2024-09-19T14:09:06.116 INFO:tasks.workunit.client.0.smithi153.stderr: 8: _start() 2024-09-19T14:09:06.116 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.116 INFO:tasks.workunit.client.0.smithi153.stderr: 0> 2024-09-19T14:09:06.059+0000 7f2584d289c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:09:06.116 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7f2584d289c0 thread_name:radosgw-admin 2024-09-19T14:09:06.116 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.116 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:09:06.116 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2587481520] 2024-09-19T14:09:06.117 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:09:06.117 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:09:06.117 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:09:06.117 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2588602345] 2024-09-19T14:09:06.117 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f258860249f] 2024-09-19T14:09:06.117 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5607b4501271] 2024-09-19T14:09:06.117 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5607b45113b7] 2024-09-19T14:09:06.117 INFO:tasks.workunit.client.0.smithi153.stderr: 9: main() 2024-09-19T14:09:06.117 INFO:tasks.workunit.client.0.smithi153.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2587468d90] 2024-09-19T14:09:06.117 INFO:tasks.workunit.client.0.smithi153.stderr: 11: __libc_start_main() 2024-09-19T14:09:06.117 INFO:tasks.workunit.client.0.smithi153.stderr: 12: _start() 2024-09-19T14:09:06.118 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:09:06.118 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.118 INFO:tasks.workunit.client.0.smithi153.stderr:--- logging levels --- 2024-09-19T14:09:06.118 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 none 2024-09-19T14:09:06.118 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 lockdep 2024-09-19T14:09:06.118 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 context 2024-09-19T14:09:06.118 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 crush 2024-09-19T14:09:06.118 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds 2024-09-19T14:09:06.118 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_balancer 2024-09-19T14:09:06.118 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_locker 2024-09-19T14:09:06.118 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log 2024-09-19T14:09:06.118 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log_expire 2024-09-19T14:09:06.118 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_migrator 2024-09-19T14:09:06.118 INFO:tasks.workunit.client.0.smithi153.stderr: 3/ 5 mds_quiesce 2024-09-19T14:09:06.118 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 buffer 2024-09-19T14:09:06.119 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 timer 2024-09-19T14:09:06.119 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 filer 2024-09-19T14:09:06.119 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 striper 2024-09-19T14:09:06.119 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 objecter 2024-09-19T14:09:06.119 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rados 2024-09-19T14:09:06.119 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd 2024-09-19T14:09:06.119 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_mirror 2024-09-19T14:09:06.119 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_replay 2024-09-19T14:09:06.119 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_pwl 2024-09-19T14:09:06.119 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 journaler 2024-09-19T14:09:06.119 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objectcacher 2024-09-19T14:09:06.119 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:09:06.119 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 client 2024-09-19T14:09:06.119 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 osd 2024-09-19T14:09:06.119 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 optracker 2024-09-19T14:09:06.120 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objclass 2024-09-19T14:09:06.120 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 filestore 2024-09-19T14:09:06.120 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 journal 2024-09-19T14:09:06.120 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 ms 2024-09-19T14:09:06.120 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mon 2024-09-19T14:09:06.120 INFO:tasks.workunit.client.0.smithi153.stderr: 0/10 monc 2024-09-19T14:09:06.120 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 paxos 2024-09-19T14:09:06.120 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 tp 2024-09-19T14:09:06.120 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 auth 2024-09-19T14:09:06.120 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 crypto 2024-09-19T14:09:06.120 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 finisher 2024-09-19T14:09:06.120 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 reserver 2024-09-19T14:09:06.120 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 heartbeatmap 2024-09-19T14:09:06.120 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 perfcounter 2024-09-19T14:09:06.121 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw 2024-09-19T14:09:06.121 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_sync 2024-09-19T14:09:06.121 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_datacache 2024-09-19T14:09:06.121 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_access 2024-09-19T14:09:06.121 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:09:06.121 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_flight 2024-09-19T14:09:06.121 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:09:06.121 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw_notification 2024-09-19T14:09:06.121 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 javaclient 2024-09-19T14:09:06.121 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 asok 2024-09-19T14:09:06.121 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 throttle 2024-09-19T14:09:06.121 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 refs 2024-09-19T14:09:06.121 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 compressor 2024-09-19T14:09:06.121 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluestore 2024-09-19T14:09:06.121 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluefs 2024-09-19T14:09:06.122 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 bdev 2024-09-19T14:09:06.122 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 kstore 2024-09-19T14:09:06.122 INFO:tasks.workunit.client.0.smithi153.stderr: 4/ 5 rocksdb 2024-09-19T14:09:06.122 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 fuse 2024-09-19T14:09:06.122 INFO:tasks.workunit.client.0.smithi153.stderr: 2/ 5 mgr 2024-09-19T14:09:06.122 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mgrc 2024-09-19T14:09:06.122 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 dpdk 2024-09-19T14:09:06.122 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 eventtrace 2024-09-19T14:09:06.122 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 prioritycache 2024-09-19T14:09:06.122 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 test 2024-09-19T14:09:06.122 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:09:06.122 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephsqlite 2024-09-19T14:09:06.122 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:09:06.122 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore 2024-09-19T14:09:06.122 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_onode 2024-09-19T14:09:06.122 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_odata 2024-09-19T14:09:06.123 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_omap 2024-09-19T14:09:06.123 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_tm 2024-09-19T14:09:06.123 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_t 2024-09-19T14:09:06.123 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:09:06.123 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_epm 2024-09-19T14:09:06.123 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_lba 2024-09-19T14:09:06.123 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:09:06.123 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cache 2024-09-19T14:09:06.123 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_journal 2024-09-19T14:09:06.123 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_device 2024-09-19T14:09:06.123 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_backref 2024-09-19T14:09:06.123 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 alienstore 2024-09-19T14:09:06.123 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mclock 2024-09-19T14:09:06.123 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cyanstore 2024-09-19T14:09:06.123 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 ceph_exporter 2024-09-19T14:09:06.124 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 memstore 2024-09-19T14:09:06.124 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 trace 2024-09-19T14:09:06.124 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 ceph_dedup 2024-09-19T14:09:06.124 INFO:tasks.workunit.client.0.smithi153.stderr: -2/-2 (syslog threshold) 2024-09-19T14:09:06.124 INFO:tasks.workunit.client.0.smithi153.stderr: 99/99 (stderr threshold) 2024-09-19T14:09:06.124 INFO:tasks.workunit.client.0.smithi153.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:09:06.124 INFO:tasks.workunit.client.0.smithi153.stderr: 7f23b1ffb640 / http_manager 2024-09-19T14:09:06.124 INFO:tasks.workunit.client.0.smithi153.stderr: 7f23b3fff640 / http_manager 2024-09-19T14:09:06.124 INFO:tasks.workunit.client.0.smithi153.stderr: 7f24397e2640 / rgw_dt_lg_renew 2024-09-19T14:09:06.124 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2464ff9640 / ms_dispatch 2024-09-19T14:09:06.124 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2465ffb640 / io_context_pool 2024-09-19T14:09:06.124 INFO:tasks.workunit.client.0.smithi153.stderr: 7f24667fc640 / io_context_pool 2024-09-19T14:09:06.124 INFO:tasks.workunit.client.0.smithi153.stderr: 7f246ce01640 / ms_dispatch 2024-09-19T14:09:06.124 INFO:tasks.workunit.client.0.smithi153.stderr: 7f246f606640 / ms_dispatch 2024-09-19T14:09:06.124 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2470e09640 / io_context_pool 2024-09-19T14:09:06.125 INFO:tasks.workunit.client.0.smithi153.stderr: 7f258202d640 / msgr-worker-2 2024-09-19T14:09:06.125 INFO:tasks.workunit.client.0.smithi153.stderr: 7f258282e640 / msgr-worker-1 2024-09-19T14:09:06.125 INFO:tasks.workunit.client.0.smithi153.stderr: 7f258302f640 / msgr-worker-0 2024-09-19T14:09:06.125 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2583830640 / io_context_pool 2024-09-19T14:09:06.125 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2584d289c0 / radosgw-admin 2024-09-19T14:09:06.125 INFO:tasks.workunit.client.0.smithi153.stderr: max_recent 500 2024-09-19T14:09:06.125 INFO:tasks.workunit.client.0.smithi153.stderr: max_new 1000 2024-09-19T14:09:06.125 INFO:tasks.workunit.client.0.smithi153.stderr: log_file /var/log/ceph/ceph-client.admin.114014.log 2024-09-19T14:09:06.125 INFO:tasks.workunit.client.0.smithi153.stderr:--- end dump of recent events --- 2024-09-19T14:09:06.125 INFO:tasks.workunit.client.0.smithi153.stderr:--- begin dump of recent events --- 2024-09-19T14:09:06.125 INFO:tasks.workunit.client.0.smithi153.stderr: -499> 2024-09-19T14:09:05.699+0000 7f2584d289c0 10 monclient(hunting): picked mon.noname-a con 0x5607b5c5e2d0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:09:06.125 INFO:tasks.workunit.client.0.smithi153.stderr: -498> 2024-09-19T14:09:05.699+0000 7f2584d289c0 10 monclient(hunting): picked mon.noname-c con 0x5607b5d1b850 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:09:06.126 INFO:tasks.workunit.client.0.smithi153.stderr: -497> 2024-09-19T14:09:05.699+0000 7f2584d289c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:06.126 INFO:tasks.workunit.client.0.smithi153.stderr: -496> 2024-09-19T14:09:05.699+0000 7f2584d289c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:06.126 INFO:tasks.workunit.client.0.smithi153.stderr: -495> 2024-09-19T14:09:05.699+0000 7f2584d289c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:06.126 INFO:tasks.workunit.client.0.smithi153.stderr: -494> 2024-09-19T14:09:05.699+0000 7f2584d289c0 10 monclient(hunting): _renew_subs 2024-09-19T14:09:06.126 INFO:tasks.workunit.client.0.smithi153.stderr: -493> 2024-09-19T14:09:05.699+0000 7f2584d289c0 10 monclient(hunting): authenticate will time out at 2734.163093s 2024-09-19T14:09:06.126 INFO:tasks.workunit.client.0.smithi153.stderr: -492> 2024-09-19T14:09:05.699+0000 7f258202d640 10 monclient(hunting): get_auth_request con 0x5607b5c5e2d0 auth_method 0 2024-09-19T14:09:06.126 INFO:tasks.workunit.client.0.smithi153.stderr: -491> 2024-09-19T14:09:05.699+0000 7f258202d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:06.126 INFO:tasks.workunit.client.0.smithi153.stderr: -490> 2024-09-19T14:09:05.699+0000 7f258202d640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:06.126 INFO:tasks.workunit.client.0.smithi153.stderr: -489> 2024-09-19T14:09:05.699+0000 7f258202d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:06.126 INFO:tasks.workunit.client.0.smithi153.stderr: -488> 2024-09-19T14:09:05.699+0000 7f258302f640 10 monclient(hunting): get_auth_request con 0x5607b5d1b850 auth_method 0 2024-09-19T14:09:06.126 INFO:tasks.workunit.client.0.smithi153.stderr: -487> 2024-09-19T14:09:05.699+0000 7f258302f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:06.126 INFO:tasks.workunit.client.0.smithi153.stderr: -486> 2024-09-19T14:09:05.699+0000 7f258302f640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:06.126 INFO:tasks.workunit.client.0.smithi153.stderr: -485> 2024-09-19T14:09:05.699+0000 7f258302f640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:06.127 INFO:tasks.workunit.client.0.smithi153.stderr: -484> 2024-09-19T14:09:05.699+0000 7f258202d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:06.127 INFO:tasks.workunit.client.0.smithi153.stderr: -483> 2024-09-19T14:09:05.699+0000 7f258202d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:06.127 INFO:tasks.workunit.client.0.smithi153.stderr: -482> 2024-09-19T14:09:05.699+0000 7f258202d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:06.127 INFO:tasks.workunit.client.0.smithi153.stderr: -481> 2024-09-19T14:09:05.699+0000 7f258302f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:06.127 INFO:tasks.workunit.client.0.smithi153.stderr: -480> 2024-09-19T14:09:05.699+0000 7f258302f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:06.127 INFO:tasks.workunit.client.0.smithi153.stderr: -479> 2024-09-19T14:09:05.699+0000 7f258302f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:06.127 INFO:tasks.workunit.client.0.smithi153.stderr: -478> 2024-09-19T14:09:05.699+0000 7f258202d640 10 monclient(hunting): handle_auth_done global_id 7299 payload 824 2024-09-19T14:09:06.127 INFO:tasks.workunit.client.0.smithi153.stderr: -477> 2024-09-19T14:09:05.699+0000 7f258202d640 10 monclient: _finish_hunting 0 2024-09-19T14:09:06.127 INFO:tasks.workunit.client.0.smithi153.stderr: -476> 2024-09-19T14:09:05.699+0000 7f258202d640 1 monclient: found mon.noname-a 2024-09-19T14:09:06.127 INFO:tasks.workunit.client.0.smithi153.stderr: -475> 2024-09-19T14:09:05.699+0000 7f258202d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:09:06.127 INFO:tasks.workunit.client.0.smithi153.stderr: -474> 2024-09-19T14:09:05.699+0000 7f258282e640 10 monclient: get_auth_request con 0x5607b5c5d620 auth_method 0 2024-09-19T14:09:06.127 INFO:tasks.workunit.client.0.smithi153.stderr: -473> 2024-09-19T14:09:05.699+0000 7f246f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:06.127 INFO:tasks.workunit.client.0.smithi153.stderr: -472> 2024-09-19T14:09:05.699+0000 7f246f606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:09:06.128 INFO:tasks.workunit.client.0.smithi153.stderr: -471> 2024-09-19T14:09:05.699+0000 7f246f606640 10 monclient: dump: 2024-09-19T14:09:06.128 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:06.128 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:06.128 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.128 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.128 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:06.128 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:06.128 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:06.128 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:06.128 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:06.128 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.128 INFO:tasks.workunit.client.0.smithi153.stderr: -470> 2024-09-19T14:09:05.699+0000 7f246f606640 10 monclient: _finish_auth 0 2024-09-19T14:09:06.128 INFO:tasks.workunit.client.0.smithi153.stderr: -469> 2024-09-19T14:09:05.699+0000 7f246f606640 10 monclient: _check_auth_tickets 2024-09-19T14:09:06.128 INFO:tasks.workunit.client.0.smithi153.stderr: -468> 2024-09-19T14:09:05.699+0000 7f246f606640 10 monclient: handle_config config(0 keys) 2024-09-19T14:09:06.129 INFO:tasks.workunit.client.0.smithi153.stderr: -467> 2024-09-19T14:09:05.699+0000 7f246f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:06.129 INFO:tasks.workunit.client.0.smithi153.stderr: -466> 2024-09-19T14:09:05.699+0000 7f246f606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:09:06.129 INFO:tasks.workunit.client.0.smithi153.stderr: -465> 2024-09-19T14:09:05.699+0000 7f246f606640 10 monclient: dump: 2024-09-19T14:09:06.129 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:06.129 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:06.129 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.129 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.129 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:06.129 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:06.129 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:06.129 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:06.129 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:06.129 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.130 INFO:tasks.workunit.client.0.smithi153.stderr: -464> 2024-09-19T14:09:05.699+0000 7f2584d289c0 5 monclient: authenticate success, global_id 7299 2024-09-19T14:09:06.130 INFO:tasks.workunit.client.0.smithi153.stderr: -463> 2024-09-19T14:09:05.699+0000 7f2584d289c0 10 monclient: _renew_subs 2024-09-19T14:09:06.130 INFO:tasks.workunit.client.0.smithi153.stderr: -462> 2024-09-19T14:09:05.699+0000 7f2584d289c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:09:06.130 INFO:tasks.workunit.client.0.smithi153.stderr: -461> 2024-09-19T14:09:05.699+0000 7f2470e09640 4 set_mon_vals no callback set 2024-09-19T14:09:06.130 INFO:tasks.workunit.client.0.smithi153.stderr: -460> 2024-09-19T14:09:05.703+0000 7f2584d289c0 10 monclient: _renew_subs 2024-09-19T14:09:06.130 INFO:tasks.workunit.client.0.smithi153.stderr: -459> 2024-09-19T14:09:05.703+0000 7f2584d289c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:09:06.130 INFO:tasks.workunit.client.0.smithi153.stderr: -458> 2024-09-19T14:09:05.703+0000 7f2584d289c0 1 librados: init done 2024-09-19T14:09:06.130 INFO:tasks.workunit.client.0.smithi153.stderr: -457> 2024-09-19T14:09:05.703+0000 7f246f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:09:06.130 INFO:tasks.workunit.client.0.smithi153.stderr: -456> 2024-09-19T14:09:05.703+0000 7f246f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:09:06.130 INFO:tasks.workunit.client.0.smithi153.stderr: -455> 2024-09-19T14:09:05.703+0000 7f246f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:09:06.130 INFO:tasks.workunit.client.0.smithi153.stderr: -454> 2024-09-19T14:09:05.703+0000 7f258282e640 10 monclient: get_auth_request con 0x7f2468071be0 auth_method 0 2024-09-19T14:09:06.130 INFO:tasks.workunit.client.0.smithi153.stderr: -453> 2024-09-19T14:09:05.703+0000 7f258302f640 10 monclient: get_auth_request con 0x5607b5d5d3f0 auth_method 0 2024-09-19T14:09:06.130 INFO:tasks.workunit.client.0.smithi153.stderr: -452> 2024-09-19T14:09:05.703+0000 7f258282e640 10 monclient: get_auth_request con 0x5607b5d60230 auth_method 0 2024-09-19T14:09:06.130 INFO:tasks.workunit.client.0.smithi153.stderr: -451> 2024-09-19T14:09:05.707+0000 7f258202d640 10 monclient: get_auth_request con 0x5607b5d63a80 auth_method 0 2024-09-19T14:09:06.131 INFO:tasks.workunit.client.0.smithi153.stderr: -450> 2024-09-19T14:09:05.707+0000 7f2584d289c0 10 monclient: build_initial_monmap 2024-09-19T14:09:06.131 INFO:tasks.workunit.client.0.smithi153.stderr: -449> 2024-09-19T14:09:05.707+0000 7f2584d289c0 1 build_initial for_mkfs: 0 2024-09-19T14:09:06.131 INFO:tasks.workunit.client.0.smithi153.stderr: -448> 2024-09-19T14:09:05.707+0000 7f2584d289c0 10 monclient: monmap: 2024-09-19T14:09:06.131 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:09:06.131 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:09:06.131 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:09:06.131 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:09:06.131 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:09:06.131 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:06.131 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:09:06.131 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:09:06.131 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:09:06.131 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.131 INFO:tasks.workunit.client.0.smithi153.stderr: -447> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding auth protocol: cephx 2024-09-19T14:09:06.131 INFO:tasks.workunit.client.0.smithi153.stderr: -446> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding auth protocol: cephx 2024-09-19T14:09:06.132 INFO:tasks.workunit.client.0.smithi153.stderr: -445> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding auth protocol: cephx 2024-09-19T14:09:06.132 INFO:tasks.workunit.client.0.smithi153.stderr: -444> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding con mode: secure 2024-09-19T14:09:06.132 INFO:tasks.workunit.client.0.smithi153.stderr: -443> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding con mode: crc 2024-09-19T14:09:06.132 INFO:tasks.workunit.client.0.smithi153.stderr: -442> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding con mode: secure 2024-09-19T14:09:06.132 INFO:tasks.workunit.client.0.smithi153.stderr: -441> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding con mode: crc 2024-09-19T14:09:06.132 INFO:tasks.workunit.client.0.smithi153.stderr: -440> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding con mode: secure 2024-09-19T14:09:06.132 INFO:tasks.workunit.client.0.smithi153.stderr: -439> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding con mode: crc 2024-09-19T14:09:06.132 INFO:tasks.workunit.client.0.smithi153.stderr: -438> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding con mode: crc 2024-09-19T14:09:06.132 INFO:tasks.workunit.client.0.smithi153.stderr: -437> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding con mode: secure 2024-09-19T14:09:06.132 INFO:tasks.workunit.client.0.smithi153.stderr: -436> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding con mode: crc 2024-09-19T14:09:06.132 INFO:tasks.workunit.client.0.smithi153.stderr: -435> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding con mode: secure 2024-09-19T14:09:06.132 INFO:tasks.workunit.client.0.smithi153.stderr: -434> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding con mode: crc 2024-09-19T14:09:06.132 INFO:tasks.workunit.client.0.smithi153.stderr: -433> 2024-09-19T14:09:05.707+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d69270) adding con mode: secure 2024-09-19T14:09:06.133 INFO:tasks.workunit.client.0.smithi153.stderr: -432> 2024-09-19T14:09:05.711+0000 7f2584d289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:06.133 INFO:tasks.workunit.client.0.smithi153.stderr: -431> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command objecter_requests cmddesc objecter_requests hook 0x5607b5d6dcf0 EEXIST 2024-09-19T14:09:06.133 INFO:tasks.workunit.client.0.smithi153.stderr: -430> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient: init 2024-09-19T14:09:06.133 INFO:tasks.workunit.client.0.smithi153.stderr: -429> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding auth protocol: cephx 2024-09-19T14:09:06.133 INFO:tasks.workunit.client.0.smithi153.stderr: -428> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding auth protocol: cephx 2024-09-19T14:09:06.133 INFO:tasks.workunit.client.0.smithi153.stderr: -427> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding auth protocol: cephx 2024-09-19T14:09:06.133 INFO:tasks.workunit.client.0.smithi153.stderr: -426> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding con mode: secure 2024-09-19T14:09:06.133 INFO:tasks.workunit.client.0.smithi153.stderr: -425> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding con mode: crc 2024-09-19T14:09:06.133 INFO:tasks.workunit.client.0.smithi153.stderr: -424> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding con mode: secure 2024-09-19T14:09:06.133 INFO:tasks.workunit.client.0.smithi153.stderr: -423> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding con mode: crc 2024-09-19T14:09:06.133 INFO:tasks.workunit.client.0.smithi153.stderr: -422> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding con mode: secure 2024-09-19T14:09:06.133 INFO:tasks.workunit.client.0.smithi153.stderr: -421> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding con mode: crc 2024-09-19T14:09:06.133 INFO:tasks.workunit.client.0.smithi153.stderr: -420> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding con mode: crc 2024-09-19T14:09:06.133 INFO:tasks.workunit.client.0.smithi153.stderr: -419> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding con mode: secure 2024-09-19T14:09:06.133 INFO:tasks.workunit.client.0.smithi153.stderr: -418> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding con mode: crc 2024-09-19T14:09:06.134 INFO:tasks.workunit.client.0.smithi153.stderr: -417> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding con mode: secure 2024-09-19T14:09:06.134 INFO:tasks.workunit.client.0.smithi153.stderr: -416> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding con mode: crc 2024-09-19T14:09:06.134 INFO:tasks.workunit.client.0.smithi153.stderr: -415> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d68228) adding con mode: secure 2024-09-19T14:09:06.134 INFO:tasks.workunit.client.0.smithi153.stderr: -414> 2024-09-19T14:09:05.711+0000 7f2584d289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:06.134 INFO:tasks.workunit.client.0.smithi153.stderr: -413> 2024-09-19T14:09:05.711+0000 7f2584d289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:06.134 INFO:tasks.workunit.client.0.smithi153.stderr: -412> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command rotate-key cmddesc rotate-key hook 0x5607b5d68370 EEXIST 2024-09-19T14:09:06.134 INFO:tasks.workunit.client.0.smithi153.stderr: -411> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient: _reopen_session rank -1 2024-09-19T14:09:06.134 INFO:tasks.workunit.client.0.smithi153.stderr: -410> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T14:09:06.134 INFO:tasks.workunit.client.0.smithi153.stderr: -409> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient(hunting): picked mon.noname-a con 0x5607b5d919b0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:09:06.134 INFO:tasks.workunit.client.0.smithi153.stderr: -408> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient(hunting): picked mon.noname-b con 0x5607b5da6150 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:09:06.134 INFO:tasks.workunit.client.0.smithi153.stderr: -407> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient(hunting): picked mon.noname-c con 0x5607b5d8fbf0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:09:06.134 INFO:tasks.workunit.client.0.smithi153.stderr: -406> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:06.134 INFO:tasks.workunit.client.0.smithi153.stderr: -405> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:06.134 INFO:tasks.workunit.client.0.smithi153.stderr: -404> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:06.135 INFO:tasks.workunit.client.0.smithi153.stderr: -403> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient(hunting): _renew_subs 2024-09-19T14:09:06.135 INFO:tasks.workunit.client.0.smithi153.stderr: -402> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient(hunting): authenticate will time out at 2734.173101s 2024-09-19T14:09:06.135 INFO:tasks.workunit.client.0.smithi153.stderr: -401> 2024-09-19T14:09:05.711+0000 7f258282e640 10 monclient(hunting): get_auth_request con 0x5607b5d919b0 auth_method 0 2024-09-19T14:09:06.135 INFO:tasks.workunit.client.0.smithi153.stderr: -400> 2024-09-19T14:09:05.711+0000 7f258282e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:06.135 INFO:tasks.workunit.client.0.smithi153.stderr: -399> 2024-09-19T14:09:05.711+0000 7f258282e640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:06.135 INFO:tasks.workunit.client.0.smithi153.stderr: -398> 2024-09-19T14:09:05.711+0000 7f258282e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:06.135 INFO:tasks.workunit.client.0.smithi153.stderr: -397> 2024-09-19T14:09:05.711+0000 7f258302f640 10 monclient(hunting): get_auth_request con 0x5607b5d8fbf0 auth_method 0 2024-09-19T14:09:06.135 INFO:tasks.workunit.client.0.smithi153.stderr: -396> 2024-09-19T14:09:05.711+0000 7f258302f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:06.135 INFO:tasks.workunit.client.0.smithi153.stderr: -395> 2024-09-19T14:09:05.711+0000 7f258302f640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:06.135 INFO:tasks.workunit.client.0.smithi153.stderr: -394> 2024-09-19T14:09:05.711+0000 7f258302f640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:06.135 INFO:tasks.workunit.client.0.smithi153.stderr: -393> 2024-09-19T14:09:05.711+0000 7f258282e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:06.135 INFO:tasks.workunit.client.0.smithi153.stderr: -392> 2024-09-19T14:09:05.711+0000 7f258282e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:06.135 INFO:tasks.workunit.client.0.smithi153.stderr: -391> 2024-09-19T14:09:05.711+0000 7f258282e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:06.135 INFO:tasks.workunit.client.0.smithi153.stderr: -390> 2024-09-19T14:09:05.711+0000 7f258302f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:06.135 INFO:tasks.workunit.client.0.smithi153.stderr: -389> 2024-09-19T14:09:05.711+0000 7f258302f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:06.136 INFO:tasks.workunit.client.0.smithi153.stderr: -388> 2024-09-19T14:09:05.711+0000 7f258302f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:06.136 INFO:tasks.workunit.client.0.smithi153.stderr: -387> 2024-09-19T14:09:05.711+0000 7f258202d640 10 monclient(hunting): get_auth_request con 0x5607b5da6150 auth_method 0 2024-09-19T14:09:06.136 INFO:tasks.workunit.client.0.smithi153.stderr: -386> 2024-09-19T14:09:05.711+0000 7f258202d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:06.136 INFO:tasks.workunit.client.0.smithi153.stderr: -385> 2024-09-19T14:09:05.711+0000 7f258202d640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:06.136 INFO:tasks.workunit.client.0.smithi153.stderr: -384> 2024-09-19T14:09:05.711+0000 7f258202d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:06.136 INFO:tasks.workunit.client.0.smithi153.stderr: -383> 2024-09-19T14:09:05.711+0000 7f258282e640 10 monclient(hunting): handle_auth_done global_id 7302 payload 824 2024-09-19T14:09:06.136 INFO:tasks.workunit.client.0.smithi153.stderr: -382> 2024-09-19T14:09:05.711+0000 7f258282e640 10 monclient: _finish_hunting 0 2024-09-19T14:09:06.136 INFO:tasks.workunit.client.0.smithi153.stderr: -381> 2024-09-19T14:09:05.711+0000 7f258282e640 1 monclient: found mon.noname-a 2024-09-19T14:09:06.136 INFO:tasks.workunit.client.0.smithi153.stderr: -380> 2024-09-19T14:09:05.711+0000 7f258282e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:09:06.136 INFO:tasks.workunit.client.0.smithi153.stderr: -379> 2024-09-19T14:09:05.711+0000 7f246ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:06.136 INFO:tasks.workunit.client.0.smithi153.stderr: -378> 2024-09-19T14:09:05.711+0000 7f246ce01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:09:06.136 INFO:tasks.workunit.client.0.smithi153.stderr: -377> 2024-09-19T14:09:05.711+0000 7f246ce01640 10 monclient: dump: 2024-09-19T14:09:06.136 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:06.136 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:06.137 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.137 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.137 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:06.137 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:06.137 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:06.137 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:06.137 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:06.137 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.137 INFO:tasks.workunit.client.0.smithi153.stderr: -376> 2024-09-19T14:09:05.711+0000 7f246ce01640 10 monclient: _finish_auth 0 2024-09-19T14:09:06.137 INFO:tasks.workunit.client.0.smithi153.stderr: -375> 2024-09-19T14:09:05.711+0000 7f246ce01640 10 monclient: _check_auth_tickets 2024-09-19T14:09:06.137 INFO:tasks.workunit.client.0.smithi153.stderr: -374> 2024-09-19T14:09:05.711+0000 7f246ce01640 10 monclient: handle_config config(0 keys) 2024-09-19T14:09:06.137 INFO:tasks.workunit.client.0.smithi153.stderr: -373> 2024-09-19T14:09:05.711+0000 7f246ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:06.137 INFO:tasks.workunit.client.0.smithi153.stderr: -372> 2024-09-19T14:09:05.711+0000 7f246ce01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:09:06.138 INFO:tasks.workunit.client.0.smithi153.stderr: -371> 2024-09-19T14:09:05.711+0000 7f246ce01640 10 monclient: dump: 2024-09-19T14:09:06.138 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:06.138 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:06.138 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.138 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.138 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:06.138 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:06.138 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:06.138 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:06.138 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:06.138 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.138 INFO:tasks.workunit.client.0.smithi153.stderr: -370> 2024-09-19T14:09:05.711+0000 7f2584d289c0 5 monclient: authenticate success, global_id 7302 2024-09-19T14:09:06.138 INFO:tasks.workunit.client.0.smithi153.stderr: -369> 2024-09-19T14:09:05.711+0000 7f2583830640 4 set_mon_vals no callback set 2024-09-19T14:09:06.138 INFO:tasks.workunit.client.0.smithi153.stderr: -368> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient: _renew_subs 2024-09-19T14:09:06.139 INFO:tasks.workunit.client.0.smithi153.stderr: -367> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:09:06.139 INFO:tasks.workunit.client.0.smithi153.stderr: -366> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient: _renew_subs 2024-09-19T14:09:06.139 INFO:tasks.workunit.client.0.smithi153.stderr: -365> 2024-09-19T14:09:05.711+0000 7f2584d289c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:09:06.139 INFO:tasks.workunit.client.0.smithi153.stderr: -364> 2024-09-19T14:09:05.715+0000 7f246ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:09:06.139 INFO:tasks.workunit.client.0.smithi153.stderr: -363> 2024-09-19T14:09:05.715+0000 7f246ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:09:06.139 INFO:tasks.workunit.client.0.smithi153.stderr: -362> 2024-09-19T14:09:05.715+0000 7f246ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:09:06.139 INFO:tasks.workunit.client.0.smithi153.stderr: -361> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient: get_monmap_and_config 2024-09-19T14:09:06.139 INFO:tasks.workunit.client.0.smithi153.stderr: -360> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient: build_initial_monmap 2024-09-19T14:09:06.139 INFO:tasks.workunit.client.0.smithi153.stderr: -359> 2024-09-19T14:09:05.715+0000 7f2584d289c0 1 build_initial for_mkfs: 0 2024-09-19T14:09:06.139 INFO:tasks.workunit.client.0.smithi153.stderr: -358> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient: monmap: 2024-09-19T14:09:06.139 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:09:06.139 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:09:06.139 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:09:06.139 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:09:06.140 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:09:06.140 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:06.140 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:09:06.140 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:09:06.140 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:09:06.140 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.140 INFO:tasks.workunit.client.0.smithi153.stderr: -357> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding auth protocol: cephx 2024-09-19T14:09:06.140 INFO:tasks.workunit.client.0.smithi153.stderr: -356> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding auth protocol: cephx 2024-09-19T14:09:06.140 INFO:tasks.workunit.client.0.smithi153.stderr: -355> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding auth protocol: cephx 2024-09-19T14:09:06.140 INFO:tasks.workunit.client.0.smithi153.stderr: -354> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding con mode: secure 2024-09-19T14:09:06.140 INFO:tasks.workunit.client.0.smithi153.stderr: -353> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding con mode: crc 2024-09-19T14:09:06.140 INFO:tasks.workunit.client.0.smithi153.stderr: -352> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding con mode: secure 2024-09-19T14:09:06.140 INFO:tasks.workunit.client.0.smithi153.stderr: -351> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding con mode: crc 2024-09-19T14:09:06.140 INFO:tasks.workunit.client.0.smithi153.stderr: -350> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding con mode: secure 2024-09-19T14:09:06.141 INFO:tasks.workunit.client.0.smithi153.stderr: -349> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding con mode: crc 2024-09-19T14:09:06.141 INFO:tasks.workunit.client.0.smithi153.stderr: -348> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding con mode: crc 2024-09-19T14:09:06.141 INFO:tasks.workunit.client.0.smithi153.stderr: -347> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding con mode: secure 2024-09-19T14:09:06.141 INFO:tasks.workunit.client.0.smithi153.stderr: -346> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding con mode: crc 2024-09-19T14:09:06.141 INFO:tasks.workunit.client.0.smithi153.stderr: -345> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding con mode: secure 2024-09-19T14:09:06.141 INFO:tasks.workunit.client.0.smithi153.stderr: -344> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding con mode: crc 2024-09-19T14:09:06.141 INFO:tasks.workunit.client.0.smithi153.stderr: -343> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5db1370) adding con mode: secure 2024-09-19T14:09:06.141 INFO:tasks.workunit.client.0.smithi153.stderr: -342> 2024-09-19T14:09:05.715+0000 7f258202d640 10 monclient: get_auth_request con 0x7f245c071af0 auth_method 0 2024-09-19T14:09:06.141 INFO:tasks.workunit.client.0.smithi153.stderr: -341> 2024-09-19T14:09:05.715+0000 7f2584d289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:06.141 INFO:tasks.workunit.client.0.smithi153.stderr: -340> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient: init 2024-09-19T14:09:06.141 INFO:tasks.workunit.client.0.smithi153.stderr: -339> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding auth protocol: cephx 2024-09-19T14:09:06.141 INFO:tasks.workunit.client.0.smithi153.stderr: -338> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding auth protocol: cephx 2024-09-19T14:09:06.141 INFO:tasks.workunit.client.0.smithi153.stderr: -337> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding auth protocol: cephx 2024-09-19T14:09:06.141 INFO:tasks.workunit.client.0.smithi153.stderr: -336> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding con mode: secure 2024-09-19T14:09:06.142 INFO:tasks.workunit.client.0.smithi153.stderr: -335> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding con mode: crc 2024-09-19T14:09:06.142 INFO:tasks.workunit.client.0.smithi153.stderr: -334> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding con mode: secure 2024-09-19T14:09:06.142 INFO:tasks.workunit.client.0.smithi153.stderr: -333> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding con mode: crc 2024-09-19T14:09:06.142 INFO:tasks.workunit.client.0.smithi153.stderr: -332> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding con mode: secure 2024-09-19T14:09:06.142 INFO:tasks.workunit.client.0.smithi153.stderr: -331> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding con mode: crc 2024-09-19T14:09:06.142 INFO:tasks.workunit.client.0.smithi153.stderr: -330> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding con mode: crc 2024-09-19T14:09:06.142 INFO:tasks.workunit.client.0.smithi153.stderr: -329> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding con mode: secure 2024-09-19T14:09:06.142 INFO:tasks.workunit.client.0.smithi153.stderr: -328> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding con mode: crc 2024-09-19T14:09:06.142 INFO:tasks.workunit.client.0.smithi153.stderr: -327> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding con mode: secure 2024-09-19T14:09:06.142 INFO:tasks.workunit.client.0.smithi153.stderr: -326> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding con mode: crc 2024-09-19T14:09:06.142 INFO:tasks.workunit.client.0.smithi153.stderr: -325> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18a30) adding con mode: secure 2024-09-19T14:09:06.142 INFO:tasks.workunit.client.0.smithi153.stderr: -324> 2024-09-19T14:09:05.715+0000 7f2584d289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:06.142 INFO:tasks.workunit.client.0.smithi153.stderr: -323> 2024-09-19T14:09:05.715+0000 7f2584d289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:06.142 INFO:tasks.workunit.client.0.smithi153.stderr: -322> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command rotate-key cmddesc rotate-key hook 0x7ffe79b18b78 EEXIST 2024-09-19T14:09:06.142 INFO:tasks.workunit.client.0.smithi153.stderr: -321> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient: _reopen_session rank -1 2024-09-19T14:09:06.143 INFO:tasks.workunit.client.0.smithi153.stderr: -320> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T14:09:06.143 INFO:tasks.workunit.client.0.smithi153.stderr: -319> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient(hunting): picked mon.noname-b con 0x5607b5de59e0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:09:06.143 INFO:tasks.workunit.client.0.smithi153.stderr: -318> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient(hunting): picked mon.noname-c con 0x5607b5db5400 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:09:06.143 INFO:tasks.workunit.client.0.smithi153.stderr: -317> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient(hunting): picked mon.noname-a con 0x5607b5de11b0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:09:06.143 INFO:tasks.workunit.client.0.smithi153.stderr: -316> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:06.143 INFO:tasks.workunit.client.0.smithi153.stderr: -315> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:06.143 INFO:tasks.workunit.client.0.smithi153.stderr: -314> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:06.143 INFO:tasks.workunit.client.0.smithi153.stderr: -313> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient(hunting): _renew_subs 2024-09-19T14:09:06.143 INFO:tasks.workunit.client.0.smithi153.stderr: -312> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient(hunting): authenticate will time out at 2734.177477s 2024-09-19T14:09:06.143 INFO:tasks.workunit.client.0.smithi153.stderr: -311> 2024-09-19T14:09:05.715+0000 7f258302f640 10 monclient(hunting): get_auth_request con 0x5607b5de11b0 auth_method 0 2024-09-19T14:09:06.143 INFO:tasks.workunit.client.0.smithi153.stderr: -310> 2024-09-19T14:09:05.715+0000 7f258302f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:06.143 INFO:tasks.workunit.client.0.smithi153.stderr: -309> 2024-09-19T14:09:05.715+0000 7f258302f640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:06.143 INFO:tasks.workunit.client.0.smithi153.stderr: -308> 2024-09-19T14:09:05.715+0000 7f258302f640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:06.143 INFO:tasks.workunit.client.0.smithi153.stderr: -307> 2024-09-19T14:09:05.715+0000 7f258202d640 10 monclient(hunting): get_auth_request con 0x5607b5db5400 auth_method 0 2024-09-19T14:09:06.143 INFO:tasks.workunit.client.0.smithi153.stderr: -306> 2024-09-19T14:09:05.715+0000 7f258202d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:06.144 INFO:tasks.workunit.client.0.smithi153.stderr: -305> 2024-09-19T14:09:05.715+0000 7f258202d640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:06.144 INFO:tasks.workunit.client.0.smithi153.stderr: -304> 2024-09-19T14:09:05.715+0000 7f258202d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:06.144 INFO:tasks.workunit.client.0.smithi153.stderr: -303> 2024-09-19T14:09:05.715+0000 7f258302f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:06.144 INFO:tasks.workunit.client.0.smithi153.stderr: -302> 2024-09-19T14:09:05.715+0000 7f258302f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:06.144 INFO:tasks.workunit.client.0.smithi153.stderr: -301> 2024-09-19T14:09:05.715+0000 7f258302f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:06.144 INFO:tasks.workunit.client.0.smithi153.stderr: -300> 2024-09-19T14:09:05.715+0000 7f258202d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:06.144 INFO:tasks.workunit.client.0.smithi153.stderr: -299> 2024-09-19T14:09:05.715+0000 7f258202d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:06.144 INFO:tasks.workunit.client.0.smithi153.stderr: -298> 2024-09-19T14:09:05.715+0000 7f258202d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:06.144 INFO:tasks.workunit.client.0.smithi153.stderr: -297> 2024-09-19T14:09:05.715+0000 7f258202d640 10 monclient(hunting): handle_auth_done global_id 6857 payload 274 2024-09-19T14:09:06.144 INFO:tasks.workunit.client.0.smithi153.stderr: -296> 2024-09-19T14:09:05.715+0000 7f258202d640 10 monclient: _finish_hunting 0 2024-09-19T14:09:06.144 INFO:tasks.workunit.client.0.smithi153.stderr: -295> 2024-09-19T14:09:05.715+0000 7f258202d640 1 monclient: found mon.noname-c 2024-09-19T14:09:06.144 INFO:tasks.workunit.client.0.smithi153.stderr: -294> 2024-09-19T14:09:05.715+0000 7f258202d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:09:06.144 INFO:tasks.workunit.client.0.smithi153.stderr: -293> 2024-09-19T14:09:05.715+0000 7f258282e640 10 monclient: get_auth_request con 0x5607b5de59e0 auth_method 0 2024-09-19T14:09:06.144 INFO:tasks.workunit.client.0.smithi153.stderr: -292> 2024-09-19T14:09:05.715+0000 7f24667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:06.144 INFO:tasks.workunit.client.0.smithi153.stderr: -291> 2024-09-19T14:09:05.715+0000 7f24667fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:09:06.145 INFO:tasks.workunit.client.0.smithi153.stderr: -290> 2024-09-19T14:09:05.715+0000 7f24667fc640 10 monclient: dump: 2024-09-19T14:09:06.145 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:06.145 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:06.145 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.145 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.145 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:06.145 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:06.145 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:06.145 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:06.145 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:06.145 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.145 INFO:tasks.workunit.client.0.smithi153.stderr: -289> 2024-09-19T14:09:05.715+0000 7f24667fc640 10 monclient: _finish_auth 0 2024-09-19T14:09:06.145 INFO:tasks.workunit.client.0.smithi153.stderr: -288> 2024-09-19T14:09:05.715+0000 7f24667fc640 10 monclient: _check_auth_tickets 2024-09-19T14:09:06.146 INFO:tasks.workunit.client.0.smithi153.stderr: -287> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 monclient: authenticate success, global_id 6857 2024-09-19T14:09:06.146 INFO:tasks.workunit.client.0.smithi153.stderr: -286> 2024-09-19T14:09:05.715+0000 7f24667fc640 10 monclient: handle_config config(0 keys) 2024-09-19T14:09:06.146 INFO:tasks.workunit.client.0.smithi153.stderr: -285> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient: get_monmap_and_config success 2024-09-19T14:09:06.146 INFO:tasks.workunit.client.0.smithi153.stderr: -284> 2024-09-19T14:09:05.715+0000 7f2584d289c0 4 set_mon_vals no callback set 2024-09-19T14:09:06.146 INFO:tasks.workunit.client.0.smithi153.stderr: -283> 2024-09-19T14:09:05.715+0000 7f24667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:06.146 INFO:tasks.workunit.client.0.smithi153.stderr: -282> 2024-09-19T14:09:05.715+0000 7f24667fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:09:06.146 INFO:tasks.workunit.client.0.smithi153.stderr: -281> 2024-09-19T14:09:05.715+0000 7f24667fc640 10 monclient: dump: 2024-09-19T14:09:06.146 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:06.146 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:06.146 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.146 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.146 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:06.146 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:06.147 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:06.147 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:06.147 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:06.147 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.147 INFO:tasks.workunit.client.0.smithi153.stderr: -280> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient: shutdown 2024-09-19T14:09:06.147 INFO:tasks.workunit.client.0.smithi153.stderr: -279> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient: build_initial_monmap 2024-09-19T14:09:06.147 INFO:tasks.workunit.client.0.smithi153.stderr: -278> 2024-09-19T14:09:05.715+0000 7f2584d289c0 1 build_initial for_mkfs: 0 2024-09-19T14:09:06.147 INFO:tasks.workunit.client.0.smithi153.stderr: -277> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient: monmap: 2024-09-19T14:09:06.147 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:09:06.147 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:09:06.147 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:09:06.147 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:09:06.147 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:09:06.147 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:06.148 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:09:06.148 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:09:06.148 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:09:06.148 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.148 INFO:tasks.workunit.client.0.smithi153.stderr: -276> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding auth protocol: cephx 2024-09-19T14:09:06.148 INFO:tasks.workunit.client.0.smithi153.stderr: -275> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding auth protocol: cephx 2024-09-19T14:09:06.148 INFO:tasks.workunit.client.0.smithi153.stderr: -274> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding auth protocol: cephx 2024-09-19T14:09:06.148 INFO:tasks.workunit.client.0.smithi153.stderr: -273> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding con mode: secure 2024-09-19T14:09:06.148 INFO:tasks.workunit.client.0.smithi153.stderr: -272> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding con mode: crc 2024-09-19T14:09:06.148 INFO:tasks.workunit.client.0.smithi153.stderr: -271> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding con mode: secure 2024-09-19T14:09:06.148 INFO:tasks.workunit.client.0.smithi153.stderr: -270> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding con mode: crc 2024-09-19T14:09:06.148 INFO:tasks.workunit.client.0.smithi153.stderr: -269> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding con mode: secure 2024-09-19T14:09:06.148 INFO:tasks.workunit.client.0.smithi153.stderr: -268> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding con mode: crc 2024-09-19T14:09:06.148 INFO:tasks.workunit.client.0.smithi153.stderr: -267> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding con mode: crc 2024-09-19T14:09:06.149 INFO:tasks.workunit.client.0.smithi153.stderr: -266> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding con mode: secure 2024-09-19T14:09:06.149 INFO:tasks.workunit.client.0.smithi153.stderr: -265> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding con mode: crc 2024-09-19T14:09:06.149 INFO:tasks.workunit.client.0.smithi153.stderr: -264> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding con mode: secure 2024-09-19T14:09:06.149 INFO:tasks.workunit.client.0.smithi153.stderr: -263> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding con mode: crc 2024-09-19T14:09:06.149 INFO:tasks.workunit.client.0.smithi153.stderr: -262> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5ddfb40) adding con mode: secure 2024-09-19T14:09:06.149 INFO:tasks.workunit.client.0.smithi153.stderr: -261> 2024-09-19T14:09:05.715+0000 7f2584d289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:06.149 INFO:tasks.workunit.client.0.smithi153.stderr: -260> 2024-09-19T14:09:05.715+0000 7f2584d289c0 1 librados: starting msgr at 2024-09-19T14:09:06.149 INFO:tasks.workunit.client.0.smithi153.stderr: -259> 2024-09-19T14:09:05.715+0000 7f2584d289c0 1 librados: starting objecter 2024-09-19T14:09:06.149 INFO:tasks.workunit.client.0.smithi153.stderr: -258> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command objecter_requests cmddesc objecter_requests hook 0x5607b5de2af0 EEXIST 2024-09-19T14:09:06.149 INFO:tasks.workunit.client.0.smithi153.stderr: -257> 2024-09-19T14:09:05.715+0000 7f2584d289c0 1 librados: setting wanted keys 2024-09-19T14:09:06.149 INFO:tasks.workunit.client.0.smithi153.stderr: -256> 2024-09-19T14:09:05.715+0000 7f2584d289c0 1 librados: calling monclient init 2024-09-19T14:09:06.149 INFO:tasks.workunit.client.0.smithi153.stderr: -255> 2024-09-19T14:09:05.715+0000 7f2584d289c0 10 monclient: init 2024-09-19T14:09:06.149 INFO:tasks.workunit.client.0.smithi153.stderr: -254> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding auth protocol: cephx 2024-09-19T14:09:06.149 INFO:tasks.workunit.client.0.smithi153.stderr: -253> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding auth protocol: cephx 2024-09-19T14:09:06.150 INFO:tasks.workunit.client.0.smithi153.stderr: -252> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding auth protocol: cephx 2024-09-19T14:09:06.150 INFO:tasks.workunit.client.0.smithi153.stderr: -251> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding con mode: secure 2024-09-19T14:09:06.150 INFO:tasks.workunit.client.0.smithi153.stderr: -250> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding con mode: crc 2024-09-19T14:09:06.150 INFO:tasks.workunit.client.0.smithi153.stderr: -249> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding con mode: secure 2024-09-19T14:09:06.150 INFO:tasks.workunit.client.0.smithi153.stderr: -248> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding con mode: crc 2024-09-19T14:09:06.150 INFO:tasks.workunit.client.0.smithi153.stderr: -247> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding con mode: secure 2024-09-19T14:09:06.150 INFO:tasks.workunit.client.0.smithi153.stderr: -246> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding con mode: crc 2024-09-19T14:09:06.150 INFO:tasks.workunit.client.0.smithi153.stderr: -245> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding con mode: crc 2024-09-19T14:09:06.150 INFO:tasks.workunit.client.0.smithi153.stderr: -244> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding con mode: secure 2024-09-19T14:09:06.150 INFO:tasks.workunit.client.0.smithi153.stderr: -243> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding con mode: crc 2024-09-19T14:09:06.150 INFO:tasks.workunit.client.0.smithi153.stderr: -242> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding con mode: secure 2024-09-19T14:09:06.150 INFO:tasks.workunit.client.0.smithi153.stderr: -241> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding con mode: crc 2024-09-19T14:09:06.151 INFO:tasks.workunit.client.0.smithi153.stderr: -240> 2024-09-19T14:09:05.715+0000 7f2584d289c0 5 AuthRegistry(0x5607b5d93ce0) adding con mode: secure 2024-09-19T14:09:06.151 INFO:tasks.workunit.client.0.smithi153.stderr: -239> 2024-09-19T14:09:05.715+0000 7f2584d289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:06.151 INFO:tasks.workunit.client.0.smithi153.stderr: -238> 2024-09-19T14:09:05.715+0000 7f2584d289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:06.151 INFO:tasks.workunit.client.0.smithi153.stderr: -237> 2024-09-19T14:09:05.719+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command rotate-key cmddesc rotate-key hook 0x5607b5d93e28 EEXIST 2024-09-19T14:09:06.151 INFO:tasks.workunit.client.0.smithi153.stderr: -236> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient: _reopen_session rank -1 2024-09-19T14:09:06.151 INFO:tasks.workunit.client.0.smithi153.stderr: -235> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T14:09:06.151 INFO:tasks.workunit.client.0.smithi153.stderr: -234> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient(hunting): picked mon.noname-b con 0x5607b5db5400 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:09:06.151 INFO:tasks.workunit.client.0.smithi153.stderr: -233> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient(hunting): picked mon.noname-c con 0x5607b5de11b0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:09:06.151 INFO:tasks.workunit.client.0.smithi153.stderr: -232> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient(hunting): picked mon.noname-a con 0x5607b5de59e0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:09:06.151 INFO:tasks.workunit.client.0.smithi153.stderr: -231> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:06.151 INFO:tasks.workunit.client.0.smithi153.stderr: -230> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:06.151 INFO:tasks.workunit.client.0.smithi153.stderr: -229> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:06.151 INFO:tasks.workunit.client.0.smithi153.stderr: -228> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient(hunting): _renew_subs 2024-09-19T14:09:06.151 INFO:tasks.workunit.client.0.smithi153.stderr: -227> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient(hunting): authenticate will time out at 2734.180113s 2024-09-19T14:09:06.152 INFO:tasks.workunit.client.0.smithi153.stderr: -226> 2024-09-19T14:09:05.719+0000 7f258202d640 10 monclient(hunting): get_auth_request con 0x5607b5de11b0 auth_method 0 2024-09-19T14:09:06.152 INFO:tasks.workunit.client.0.smithi153.stderr: -225> 2024-09-19T14:09:05.719+0000 7f258202d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:06.152 INFO:tasks.workunit.client.0.smithi153.stderr: -224> 2024-09-19T14:09:05.719+0000 7f258202d640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:06.152 INFO:tasks.workunit.client.0.smithi153.stderr: -223> 2024-09-19T14:09:05.719+0000 7f258202d640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:06.152 INFO:tasks.workunit.client.0.smithi153.stderr: -222> 2024-09-19T14:09:05.719+0000 7f258302f640 10 monclient(hunting): get_auth_request con 0x5607b5de59e0 auth_method 0 2024-09-19T14:09:06.152 INFO:tasks.workunit.client.0.smithi153.stderr: -221> 2024-09-19T14:09:05.719+0000 7f258302f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:06.152 INFO:tasks.workunit.client.0.smithi153.stderr: -220> 2024-09-19T14:09:05.719+0000 7f258302f640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:06.152 INFO:tasks.workunit.client.0.smithi153.stderr: -219> 2024-09-19T14:09:05.719+0000 7f258302f640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:06.152 INFO:tasks.workunit.client.0.smithi153.stderr: -218> 2024-09-19T14:09:05.719+0000 7f258202d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:06.152 INFO:tasks.workunit.client.0.smithi153.stderr: -217> 2024-09-19T14:09:05.719+0000 7f258202d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:06.152 INFO:tasks.workunit.client.0.smithi153.stderr: -216> 2024-09-19T14:09:05.719+0000 7f258202d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:06.152 INFO:tasks.workunit.client.0.smithi153.stderr: -215> 2024-09-19T14:09:05.719+0000 7f258302f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:06.152 INFO:tasks.workunit.client.0.smithi153.stderr: -214> 2024-09-19T14:09:05.719+0000 7f258302f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:06.153 INFO:tasks.workunit.client.0.smithi153.stderr: -213> 2024-09-19T14:09:05.719+0000 7f258302f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:06.153 INFO:tasks.workunit.client.0.smithi153.stderr: -212> 2024-09-19T14:09:05.719+0000 7f258282e640 10 monclient(hunting): get_auth_request con 0x5607b5db5400 auth_method 0 2024-09-19T14:09:06.153 INFO:tasks.workunit.client.0.smithi153.stderr: -211> 2024-09-19T14:09:05.719+0000 7f258282e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:06.153 INFO:tasks.workunit.client.0.smithi153.stderr: -210> 2024-09-19T14:09:05.719+0000 7f258282e640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:06.153 INFO:tasks.workunit.client.0.smithi153.stderr: -209> 2024-09-19T14:09:05.719+0000 7f258282e640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:06.153 INFO:tasks.workunit.client.0.smithi153.stderr: -208> 2024-09-19T14:09:05.719+0000 7f258202d640 10 monclient(hunting): handle_auth_done global_id 6860 payload 824 2024-09-19T14:09:06.153 INFO:tasks.workunit.client.0.smithi153.stderr: -207> 2024-09-19T14:09:05.719+0000 7f258202d640 10 monclient: _finish_hunting 0 2024-09-19T14:09:06.153 INFO:tasks.workunit.client.0.smithi153.stderr: -206> 2024-09-19T14:09:05.719+0000 7f258202d640 1 monclient: found mon.noname-c 2024-09-19T14:09:06.153 INFO:tasks.workunit.client.0.smithi153.stderr: -205> 2024-09-19T14:09:05.719+0000 7f258202d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:09:06.153 INFO:tasks.workunit.client.0.smithi153.stderr: -204> 2024-09-19T14:09:05.719+0000 7f2464ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:06.153 INFO:tasks.workunit.client.0.smithi153.stderr: -203> 2024-09-19T14:09:05.719+0000 7f2464ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:09:06.153 INFO:tasks.workunit.client.0.smithi153.stderr: -202> 2024-09-19T14:09:05.719+0000 7f2464ff9640 10 monclient: dump: 2024-09-19T14:09:06.153 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:06.154 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:06.154 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.154 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.154 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:06.154 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:06.154 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:06.154 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:06.154 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:06.154 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.154 INFO:tasks.workunit.client.0.smithi153.stderr: -201> 2024-09-19T14:09:05.719+0000 7f2464ff9640 10 monclient: _finish_auth 0 2024-09-19T14:09:06.154 INFO:tasks.workunit.client.0.smithi153.stderr: -200> 2024-09-19T14:09:05.719+0000 7f2464ff9640 10 monclient: _check_auth_tickets 2024-09-19T14:09:06.154 INFO:tasks.workunit.client.0.smithi153.stderr: -199> 2024-09-19T14:09:05.719+0000 7f2584d289c0 5 monclient: authenticate success, global_id 6860 2024-09-19T14:09:06.154 INFO:tasks.workunit.client.0.smithi153.stderr: -198> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient: _renew_subs 2024-09-19T14:09:06.154 INFO:tasks.workunit.client.0.smithi153.stderr: -197> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:09:06.154 INFO:tasks.workunit.client.0.smithi153.stderr: -196> 2024-09-19T14:09:05.719+0000 7f2464ff9640 10 monclient: handle_config config(0 keys) 2024-09-19T14:09:06.155 INFO:tasks.workunit.client.0.smithi153.stderr: -195> 2024-09-19T14:09:05.719+0000 7f2464ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:06.155 INFO:tasks.workunit.client.0.smithi153.stderr: -194> 2024-09-19T14:09:05.719+0000 7f2464ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:09:06.155 INFO:tasks.workunit.client.0.smithi153.stderr: -193> 2024-09-19T14:09:05.719+0000 7f2464ff9640 10 monclient: dump: 2024-09-19T14:09:06.155 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:06.155 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:06.155 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.155 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:06.155 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:06.155 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:06.155 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:06.155 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:06.155 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:06.155 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.155 INFO:tasks.workunit.client.0.smithi153.stderr: -192> 2024-09-19T14:09:05.719+0000 7f24667fc640 4 set_mon_vals no callback set 2024-09-19T14:09:06.155 INFO:tasks.workunit.client.0.smithi153.stderr: -191> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient: _renew_subs 2024-09-19T14:09:06.156 INFO:tasks.workunit.client.0.smithi153.stderr: -190> 2024-09-19T14:09:05.719+0000 7f2584d289c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:09:06.156 INFO:tasks.workunit.client.0.smithi153.stderr: -189> 2024-09-19T14:09:05.719+0000 7f2584d289c0 1 librados: init done 2024-09-19T14:09:06.156 INFO:tasks.workunit.client.0.smithi153.stderr: -188> 2024-09-19T14:09:05.719+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command cr dump hook 0x5607b5dd8958 2024-09-19T14:09:06.156 INFO:tasks.workunit.client.0.smithi153.stderr: -187> 2024-09-19T14:09:05.719+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.156 INFO:tasks.workunit.client.0.smithi153.stderr: -186> 2024-09-19T14:09:05.719+0000 7f2464ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:09:06.156 INFO:tasks.workunit.client.0.smithi153.stderr: -185> 2024-09-19T14:09:05.719+0000 7f2464ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:09:06.156 INFO:tasks.workunit.client.0.smithi153.stderr: -184> 2024-09-19T14:09:05.719+0000 7f2464ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:09:06.156 INFO:tasks.workunit.client.0.smithi153.stderr: -183> 2024-09-19T14:09:05.719+0000 7f258302f640 10 monclient: get_auth_request con 0x5607b5dfeff0 auth_method 0 2024-09-19T14:09:06.156 INFO:tasks.workunit.client.0.smithi153.stderr: -182> 2024-09-19T14:09:05.719+0000 7f258282e640 10 monclient: get_auth_request con 0x7f244c071c10 auth_method 0 2024-09-19T14:09:06.156 INFO:tasks.workunit.client.0.smithi153.stderr: -181> 2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:06.156 INFO:tasks.workunit.client.0.smithi153.stderr: -180> 2024-09-19T14:09:05.723+0000 7f2584d289c0 20 realm 2024-09-19T14:09:06.156 INFO:tasks.workunit.client.0.smithi153.stderr: -179> 2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.156 INFO:tasks.workunit.client.0.smithi153.stderr: -178> 2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:06.156 INFO:tasks.workunit.client.0.smithi153.stderr: -177> 2024-09-19T14:09:05.723+0000 7f2584d289c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:09:06.156 INFO:tasks.workunit.client.0.smithi153.stderr: -176> 2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.157 INFO:tasks.workunit.client.0.smithi153.stderr: -175> 2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:06.157 INFO:tasks.workunit.client.0.smithi153.stderr: -174> 2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.157 INFO:tasks.workunit.client.0.smithi153.stderr: -173> 2024-09-19T14:09:05.723+0000 7f258282e640 10 monclient: get_auth_request con 0x5607b5e033e0 auth_method 0 2024-09-19T14:09:06.157 INFO:tasks.workunit.client.0.smithi153.stderr: -172> 2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:06.157 INFO:tasks.workunit.client.0.smithi153.stderr: -171> 2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.157 INFO:tasks.workunit.client.0.smithi153.stderr: -170> 2024-09-19T14:09:05.723+0000 7f2584d289c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:09:06.157 INFO:tasks.workunit.client.0.smithi153.stderr: -169> 2024-09-19T14:09:05.723+0000 7f2584d289c0 20 searching for the correct realm 2024-09-19T14:09:06.157 INFO:tasks.workunit.client.0.smithi153.stderr: -168> 2024-09-19T14:09:05.723+0000 7f258202d640 10 monclient: get_auth_request con 0x5607b5e08560 auth_method 0 2024-09-19T14:09:06.157 INFO:tasks.workunit.client.0.smithi153.stderr: -167> 2024-09-19T14:09:05.723+0000 7f258302f640 10 monclient: get_auth_request con 0x7f2578003290 auth_method 0 2024-09-19T14:09:06.157 INFO:tasks.workunit.client.0.smithi153.stderr: -166> 2024-09-19T14:09:05.727+0000 7f258282e640 10 monclient: get_auth_request con 0x7f257c015b10 auth_method 0 2024-09-19T14:09:06.157 INFO:tasks.workunit.client.0.smithi153.stderr: -165> 2024-09-19T14:09:05.727+0000 7f258202d640 10 monclient: get_auth_request con 0x7f2574109040 auth_method 0 2024-09-19T14:09:06.157 INFO:tasks.workunit.client.0.smithi153.stderr: -164> 2024-09-19T14:09:05.727+0000 7f258202d640 0 -- 172.21.15.153:0/225296854 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f2574109040 msgr2=0x7f25741019c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:06.157 INFO:tasks.workunit.client.0.smithi153.stderr: -163> 2024-09-19T14:09:05.727+0000 7f2464ff9640 1 client.6860.objecter ms_handle_reset 0x7f2574109040 session 0x7f25740a6070 osd.4 2024-09-19T14:09:06.157 INFO:tasks.workunit.client.0.smithi153.stderr: -162> 2024-09-19T14:09:05.727+0000 7f2464ff9640 10 monclient: _renew_subs 2024-09-19T14:09:06.158 INFO:tasks.workunit.client.0.smithi153.stderr: -161> 2024-09-19T14:09:05.727+0000 7f2464ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:09:06.158 INFO:tasks.workunit.client.0.smithi153.stderr: -160> 2024-09-19T14:09:05.727+0000 7f258202d640 10 monclient: get_auth_request con 0x7f244c082340 auth_method 0 2024-09-19T14:09:06.158 INFO:tasks.workunit.client.0.smithi153.stderr: -159> 2024-09-19T14:09:05.731+0000 7f258302f640 10 monclient: get_auth_request con 0x7f257803c110 auth_method 0 2024-09-19T14:09:06.158 INFO:tasks.workunit.client.0.smithi153.stderr: -158> 2024-09-19T14:09:05.735+0000 7f258282e640 10 monclient: get_auth_request con 0x7f2578054150 auth_method 0 2024-09-19T14:09:06.158 INFO:tasks.workunit.client.0.smithi153.stderr: -157> 2024-09-19T14:09:05.735+0000 7f258282e640 0 -- 172.21.15.153:0/225296854 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f2578054150 msgr2=0x7f2578054760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:06.158 INFO:tasks.workunit.client.0.smithi153.stderr: -156> 2024-09-19T14:09:05.939+0000 7f258282e640 10 monclient: get_auth_request con 0x7f2578054150 auth_method 0 2024-09-19T14:09:06.158 INFO:tasks.workunit.client.0.smithi153.stderr: -155> 2024-09-19T14:09:05.951+0000 7f2584d289c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:09:06.158 INFO:tasks.workunit.client.0.smithi153.stderr: -154> 2024-09-19T14:09:05.951+0000 7f2584d289c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:09:06.158 INFO:tasks.workunit.client.0.smithi153.stderr: -153> 2024-09-19T14:09:05.951+0000 7f2584d289c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:09:06.158 INFO:tasks.workunit.client.0.smithi153.stderr: -152> 2024-09-19T14:09:05.951+0000 7f2584d289c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:09:06.158 INFO:tasks.workunit.client.0.smithi153.stderr: -151> 2024-09-19T14:09:05.951+0000 7f2584d289c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:09:06.158 INFO:tasks.workunit.client.0.smithi153.stderr: -150> 2024-09-19T14:09:05.951+0000 7f2584d289c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:09:06.158 INFO:tasks.workunit.client.0.smithi153.stderr: -149> 2024-09-19T14:09:05.951+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.158 INFO:tasks.workunit.client.0.smithi153.stderr: -148> 2024-09-19T14:09:05.951+0000 7f2584d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:06.158 INFO:tasks.workunit.client.0.smithi153.stderr: -147> 2024-09-19T14:09:05.951+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.159 INFO:tasks.workunit.client.0.smithi153.stderr: -146> 2024-09-19T14:09:05.951+0000 7f2584d289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:06.159 INFO:tasks.workunit.client.0.smithi153.stderr: -145> 2024-09-19T14:09:05.951+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.159 INFO:tasks.workunit.client.0.smithi153.stderr: -144> 2024-09-19T14:09:05.955+0000 7f2584d289c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:09:06.159 INFO:tasks.workunit.client.0.smithi153.stderr: -143> 2024-09-19T14:09:05.955+0000 7f2584d289c0 20 zone default found 2024-09-19T14:09:06.159 INFO:tasks.workunit.client.0.smithi153.stderr: -142> 2024-09-19T14:09:05.955+0000 7f2584d289c0 4 Realm: () 2024-09-19T14:09:06.159 INFO:tasks.workunit.client.0.smithi153.stderr: -141> 2024-09-19T14:09:05.955+0000 7f2584d289c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:09:06.159 INFO:tasks.workunit.client.0.smithi153.stderr: -140> 2024-09-19T14:09:05.955+0000 7f2584d289c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:09:06.159 INFO:tasks.workunit.client.0.smithi153.stderr: -139> 2024-09-19T14:09:05.955+0000 7f2584d289c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:09:06.159 INFO:tasks.workunit.client.0.smithi153.stderr: -138> 2024-09-19T14:09:05.955+0000 7f2584d289c0 20 zonegroup default 2024-09-19T14:09:06.159 INFO:tasks.workunit.client.0.smithi153.stderr: -137> 2024-09-19T14:09:05.955+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.159 INFO:tasks.workunit.client.0.smithi153.stderr: -136> 2024-09-19T14:09:05.955+0000 7f2584d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:06.159 INFO:tasks.workunit.client.0.smithi153.stderr: -135> 2024-09-19T14:09:05.955+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.159 INFO:tasks.workunit.client.0.smithi153.stderr: -134> 2024-09-19T14:09:05.955+0000 7f2584d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:06.159 INFO:tasks.workunit.client.0.smithi153.stderr: -133> 2024-09-19T14:09:05.955+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.160 INFO:tasks.workunit.client.0.smithi153.stderr: -132> 2024-09-19T14:09:05.955+0000 7f2584d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:06.160 INFO:tasks.workunit.client.0.smithi153.stderr: -131> 2024-09-19T14:09:05.955+0000 7f2584d289c0 20 started sync module instance, tier type = 2024-09-19T14:09:06.160 INFO:tasks.workunit.client.0.smithi153.stderr: -130> 2024-09-19T14:09:05.955+0000 7f2584d289c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:09:06.160 INFO:tasks.workunit.client.0.smithi153.stderr: -129> 2024-09-19T14:09:05.979+0000 7f2584d289c0 20 add_watcher() i=0 2024-09-19T14:09:06.160 INFO:tasks.workunit.client.0.smithi153.stderr: -128> 2024-09-19T14:09:05.979+0000 7f2584d289c0 20 add_watcher() i=1 2024-09-19T14:09:06.160 INFO:tasks.workunit.client.0.smithi153.stderr: -127> 2024-09-19T14:09:05.979+0000 7f2584d289c0 20 add_watcher() i=2 2024-09-19T14:09:06.160 INFO:tasks.workunit.client.0.smithi153.stderr: -126> 2024-09-19T14:09:05.979+0000 7f2584d289c0 20 add_watcher() i=3 2024-09-19T14:09:06.160 INFO:tasks.workunit.client.0.smithi153.stderr: -125> 2024-09-19T14:09:05.979+0000 7f2584d289c0 20 add_watcher() i=4 2024-09-19T14:09:06.160 INFO:tasks.workunit.client.0.smithi153.stderr: -124> 2024-09-19T14:09:05.979+0000 7f2584d289c0 20 add_watcher() i=5 2024-09-19T14:09:06.160 INFO:tasks.workunit.client.0.smithi153.stderr: -123> 2024-09-19T14:09:05.979+0000 7f2584d289c0 20 add_watcher() i=6 2024-09-19T14:09:06.160 INFO:tasks.workunit.client.0.smithi153.stderr: -122> 2024-09-19T14:09:05.983+0000 7f2584d289c0 20 add_watcher() i=7 2024-09-19T14:09:06.160 INFO:tasks.workunit.client.0.smithi153.stderr: -121> 2024-09-19T14:09:05.983+0000 7f2584d289c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:09:06.160 INFO:tasks.workunit.client.0.smithi153.stderr: -120> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding auth protocol: cephx 2024-09-19T14:09:06.160 INFO:tasks.workunit.client.0.smithi153.stderr: -119> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding auth protocol: cephx 2024-09-19T14:09:06.161 INFO:tasks.workunit.client.0.smithi153.stderr: -118> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding auth protocol: cephx 2024-09-19T14:09:06.161 INFO:tasks.workunit.client.0.smithi153.stderr: -117> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding con mode: secure 2024-09-19T14:09:06.161 INFO:tasks.workunit.client.0.smithi153.stderr: -116> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding con mode: crc 2024-09-19T14:09:06.161 INFO:tasks.workunit.client.0.smithi153.stderr: -115> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding con mode: secure 2024-09-19T14:09:06.161 INFO:tasks.workunit.client.0.smithi153.stderr: -114> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding con mode: crc 2024-09-19T14:09:06.161 INFO:tasks.workunit.client.0.smithi153.stderr: -113> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding con mode: secure 2024-09-19T14:09:06.161 INFO:tasks.workunit.client.0.smithi153.stderr: -112> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding con mode: crc 2024-09-19T14:09:06.161 INFO:tasks.workunit.client.0.smithi153.stderr: -111> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding con mode: crc 2024-09-19T14:09:06.161 INFO:tasks.workunit.client.0.smithi153.stderr: -110> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding con mode: secure 2024-09-19T14:09:06.161 INFO:tasks.workunit.client.0.smithi153.stderr: -109> 2024-09-19T14:09:05.987+0000 7f24397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:06.161 INFO:tasks.workunit.client.0.smithi153.stderr: -108> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding con mode: crc 2024-09-19T14:09:06.161 INFO:tasks.workunit.client.0.smithi153.stderr: -107> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding con mode: secure 2024-09-19T14:09:06.161 INFO:tasks.workunit.client.0.smithi153.stderr: -106> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding con mode: crc 2024-09-19T14:09:06.161 INFO:tasks.workunit.client.0.smithi153.stderr: -105> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 AuthRegistry(0x7ffe79b18f00) adding con mode: secure 2024-09-19T14:09:06.162 INFO:tasks.workunit.client.0.smithi153.stderr: -104> 2024-09-19T14:09:05.987+0000 7f2584d289c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:06.162 INFO:tasks.workunit.client.0.smithi153.stderr: -103> 2024-09-19T14:09:05.987+0000 7f2584d289c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:09:06.162 INFO:tasks.workunit.client.0.smithi153.stderr: -102> 2024-09-19T14:09:05.987+0000 7f2584d289c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:09:06.162 INFO:tasks.workunit.client.0.smithi153.stderr: -101> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command cache list hook 0x5607b5dd5c50 2024-09-19T14:09:06.162 INFO:tasks.workunit.client.0.smithi153.stderr: -100> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command cache inspect hook 0x5607b5dd5c50 2024-09-19T14:09:06.162 INFO:tasks.workunit.client.0.smithi153.stderr: -99> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command cache erase hook 0x5607b5dd5c50 2024-09-19T14:09:06.162 INFO:tasks.workunit.client.0.smithi153.stderr: -98> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command cache zap hook 0x5607b5dd5c50 2024-09-19T14:09:06.162 INFO:tasks.workunit.client.0.smithi153.stderr: -97> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 note: GC not initialized 2024-09-19T14:09:06.162 INFO:tasks.workunit.client.0.smithi153.stderr: -96> 2024-09-19T14:09:05.987+0000 7f23b3fff640 20 reqs_thread_entry: start 2024-09-19T14:09:06.162 INFO:tasks.workunit.client.0.smithi153.stderr: -95> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command sync trace show hook 0x7f2578059870 2024-09-19T14:09:06.162 INFO:tasks.workunit.client.0.smithi153.stderr: -94> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command sync trace history hook 0x7f2578059870 2024-09-19T14:09:06.162 INFO:tasks.workunit.client.0.smithi153.stderr: -93> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command sync trace active hook 0x7f2578059870 2024-09-19T14:09:06.162 INFO:tasks.workunit.client.0.smithi153.stderr: -92> 2024-09-19T14:09:05.987+0000 7f2584d289c0 5 asok(0x5607b5b0ad90) register_command sync trace active_short hook 0x7f2578059870 2024-09-19T14:09:06.163 INFO:tasks.workunit.client.0.smithi153.stderr: -91> 2024-09-19T14:09:05.987+0000 7f2584d289c0 20 init_complete bucket index max shards: 11 2024-09-19T14:09:06.163 INFO:tasks.workunit.client.0.smithi153.stderr: -90> 2024-09-19T14:09:05.987+0000 7f2584d289c0 20 Filter name: none 2024-09-19T14:09:06.163 INFO:tasks.workunit.client.0.smithi153.stderr: -89> 2024-09-19T14:09:05.987+0000 7f23b1ffb640 20 reqs_thread_entry: start 2024-09-19T14:09:06.163 INFO:tasks.workunit.client.0.smithi153.stderr: -88> 2024-09-19T14:09:05.987+0000 7f2584d289c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-19T14:09:06.163 INFO:tasks.workunit.client.0.smithi153.stderr: -87> 2024-09-19T14:09:05.987+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.163 INFO:tasks.workunit.client.0.smithi153.stderr: -86> 2024-09-19T14:09:05.991+0000 7f2584d289c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:09:06.163 INFO:tasks.workunit.client.0.smithi153.stderr: -85> 2024-09-19T14:09:05.991+0000 7f2584d289c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-19T14:09:06.163 INFO:tasks.workunit.client.0.smithi153.stderr: -84> 2024-09-19T14:09:05.991+0000 7f2584d289c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-19T14:09:06.163 INFO:tasks.workunit.client.0.smithi153.stderr: -83> 2024-09-19T14:09:05.991+0000 7f2584d289c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 : miss 2024-09-19T14:09:06.163 INFO:tasks.workunit.client.0.smithi153.stderr: -82> 2024-09-19T14:09:05.991+0000 7f2584d289c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.163 INFO:tasks.workunit.client.0.smithi153.stderr: -81> 2024-09-19T14:09:05.991+0000 7f2584d289c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:09:06.163 INFO:tasks.workunit.client.0.smithi153.stderr: -80> 2024-09-19T14:09:05.991+0000 7f2584d289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 info.flags=0x17 2024-09-19T14:09:06.163 INFO:tasks.workunit.client.0.smithi153.stderr: -79> 2024-09-19T14:09:05.991+0000 7f2584d289c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 to cache LRU end 2024-09-19T14:09:06.164 INFO:tasks.workunit.client.0.smithi153.stderr: -78> 2024-09-19T14:09:05.991+0000 7f2584d289c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:09:06.164 INFO:tasks.workunit.client.0.smithi153.stderr: -77> 2024-09-19T14:09:05.991+0000 7f2584d289c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:06.164 INFO:tasks.workunit.client.0.smithi153.stderr: -76> 2024-09-19T14:09:05.991+0000 7f2584d289c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 2024-09-19T14:09:06.164 INFO:tasks.workunit.client.0.smithi153.stderr: -75> 2024-09-19T14:09:05.999+0000 7f2584d289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 info.flags=0x17 2024-09-19T14:09:06.164 INFO:tasks.workunit.client.0.smithi153.stderr: -74> 2024-09-19T14:09:05.999+0000 7f2584d289c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 to cache LRU end 2024-09-19T14:09:06.164 INFO:tasks.workunit.client.0.smithi153.stderr: -73> 2024-09-19T14:09:05.999+0000 7f2584d289c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:06.164 INFO:tasks.workunit.client.0.smithi153.stderr: -72> 2024-09-19T14:09:05.999+0000 7f2584d289c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32, ofs0, ns] 2024-09-19T14:09:06.164 INFO:tasks.workunit.client.0.smithi153.stderr: -71> 2024-09-19T14:09:05.999+0000 7f2465ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333493 cookie 94591116184432 notifier 6860 bl.length()=931 2024-09-19T14:09:06.164 INFO:tasks.workunit.client.0.smithi153.stderr: -70> 2024-09-19T14:09:05.999+0000 7f2465ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 info.flags=0x17 2024-09-19T14:09:06.164 INFO:tasks.workunit.client.0.smithi153.stderr: -69> 2024-09-19T14:09:05.999+0000 7f2465ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 to cache LRU end 2024-09-19T14:09:06.164 INFO:tasks.workunit.client.0.smithi153.stderr: -68> 2024-09-19T14:09:05.999+0000 7f2465ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:06.164 INFO:tasks.workunit.client.0.smithi153.stderr: -67> 2024-09-19T14:09:06.003+0000 7f2584d289c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): orig_sources= new_sources= 2024-09-19T14:09:06.164 INFO:tasks.workunit.client.0.smithi153.stderr: -66> 2024-09-19T14:09:06.003+0000 7f2584d289c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): potential sources added=[] removed=[] 2024-09-19T14:09:06.164 INFO:tasks.workunit.client.0.smithi153.stderr: -65> 2024-09-19T14:09:06.003+0000 7f2584d289c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): orig_dests= new_dests= 2024-09-19T14:09:06.165 INFO:tasks.workunit.client.0.smithi153.stderr: -64> 2024-09-19T14:09:06.003+0000 7f2584d289c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): potential dests added=[] removed=[] 2024-09-19T14:09:06.165 INFO:tasks.workunit.client.0.smithi153.stderr: -63> 2024-09-19T14:09:06.007+0000 7f2464ff9640 1 client.6860.objecter ms_handle_reset 0x7f244c082340 session 0x7f25740a6070 osd.4 2024-09-19T14:09:06.165 INFO:tasks.workunit.client.0.smithi153.stderr: -62> 2024-09-19T14:09:06.011+0000 7f258202d640 10 monclient: get_auth_request con 0x7f2574109040 auth_method 0 2024-09-19T14:09:06.165 INFO:tasks.workunit.client.0.smithi153.stderr: -61> 2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.0 2024-09-19T14:09:06.165 INFO:tasks.workunit.client.0.smithi153.stderr: -60> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.0 2024-09-19T14:09:06.165 INFO:tasks.workunit.client.0.smithi153.stderr: -59> 2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.1 2024-09-19T14:09:06.165 INFO:tasks.workunit.client.0.smithi153.stderr: -58> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.1 2024-09-19T14:09:06.165 INFO:tasks.workunit.client.0.smithi153.stderr: -57> 2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.2 2024-09-19T14:09:06.165 INFO:tasks.workunit.client.0.smithi153.stderr: -56> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.2 2024-09-19T14:09:06.165 INFO:tasks.workunit.client.0.smithi153.stderr: -55> 2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.3 2024-09-19T14:09:06.165 INFO:tasks.workunit.client.0.smithi153.stderr: -54> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.3 2024-09-19T14:09:06.165 INFO:tasks.workunit.client.0.smithi153.stderr: -53> 2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.4 2024-09-19T14:09:06.165 INFO:tasks.workunit.client.0.smithi153.stderr: -52> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.4 2024-09-19T14:09:06.168 INFO:tasks.workunit.client.0.smithi153.stderr: -51> 2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.5 2024-09-19T14:09:06.168 INFO:tasks.workunit.client.0.smithi153.stderr: -50> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.5 2024-09-19T14:09:06.168 INFO:tasks.workunit.client.0.smithi153.stderr: -49> 2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.6 2024-09-19T14:09:06.168 INFO:tasks.workunit.client.0.smithi153.stderr: -48> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.6 2024-09-19T14:09:06.168 INFO:tasks.workunit.client.0.smithi153.stderr: -47> 2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.7 2024-09-19T14:09:06.168 INFO:tasks.workunit.client.0.smithi153.stderr: -46> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.7 2024-09-19T14:09:06.168 INFO:tasks.workunit.client.0.smithi153.stderr: -45> 2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.8 2024-09-19T14:09:06.168 INFO:tasks.workunit.client.0.smithi153.stderr: -44> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.8 2024-09-19T14:09:06.168 INFO:tasks.workunit.client.0.smithi153.stderr: -43> 2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.9 2024-09-19T14:09:06.168 INFO:tasks.workunit.client.0.smithi153.stderr: -42> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.9 2024-09-19T14:09:06.168 INFO:tasks.workunit.client.0.smithi153.stderr: -41> 2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.10 2024-09-19T14:09:06.168 INFO:tasks.workunit.client.0.smithi153.stderr: -40> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.10 2024-09-19T14:09:06.169 INFO:tasks.workunit.client.0.smithi153.stderr: -39> 2024-09-19T14:09:06.019+0000 7f2584d289c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.11 2024-09-19T14:09:06.169 INFO:tasks.workunit.client.0.smithi153.stderr: -38> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.11 2024-09-19T14:09:06.169 INFO:tasks.workunit.client.0.smithi153.stderr: -37> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.0 2024-09-19T14:09:06.169 INFO:tasks.workunit.client.0.smithi153.stderr: -36> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1 2024-09-19T14:09:06.169 INFO:tasks.workunit.client.0.smithi153.stderr: -35> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.2 2024-09-19T14:09:06.169 INFO:tasks.workunit.client.0.smithi153.stderr: -34> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.3 2024-09-19T14:09:06.169 INFO:tasks.workunit.client.0.smithi153.stderr: -33> 2024-09-19T14:09:06.019+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.4 2024-09-19T14:09:06.169 INFO:tasks.workunit.client.0.smithi153.stderr: -32> 2024-09-19T14:09:06.023+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.5 2024-09-19T14:09:06.169 INFO:tasks.workunit.client.0.smithi153.stderr: -31> 2024-09-19T14:09:06.023+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.6 2024-09-19T14:09:06.169 INFO:tasks.workunit.client.0.smithi153.stderr: -30> 2024-09-19T14:09:06.023+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.7 2024-09-19T14:09:06.169 INFO:tasks.workunit.client.0.smithi153.stderr: -29> 2024-09-19T14:09:06.027+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.8 2024-09-19T14:09:06.169 INFO:tasks.workunit.client.0.smithi153.stderr: -28> 2024-09-19T14:09:06.027+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.9 2024-09-19T14:09:06.169 INFO:tasks.workunit.client.0.smithi153.stderr: -27> 2024-09-19T14:09:06.027+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.10 2024-09-19T14:09:06.169 INFO:tasks.workunit.client.0.smithi153.stderr: -26> 2024-09-19T14:09:06.035+0000 7f2584d289c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 : hit (requested=0x17, cached=0x17) 2024-09-19T14:09:06.170 INFO:tasks.workunit.client.0.smithi153.stderr: -25> 2024-09-19T14:09:06.035+0000 7f2584d289c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 2024-09-19T14:09:06.170 INFO:tasks.workunit.client.0.smithi153.stderr: -24> 2024-09-19T14:09:06.035+0000 7f2584d289c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 info.flags=0x17 2024-09-19T14:09:06.170 INFO:tasks.workunit.client.0.smithi153.stderr: -23> 2024-09-19T14:09:06.035+0000 7f2584d289c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 to cache LRU end 2024-09-19T14:09:06.170 INFO:tasks.workunit.client.0.smithi153.stderr: -22> 2024-09-19T14:09:06.035+0000 7f2584d289c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:06.170 INFO:tasks.workunit.client.0.smithi153.stderr: -21> 2024-09-19T14:09:06.035+0000 7f2584d289c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32, ofs0, ns] 2024-09-19T14:09:06.170 INFO:tasks.workunit.client.0.smithi153.stderr: -20> 2024-09-19T14:09:06.035+0000 7f2465ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333494 cookie 94591116184432 notifier 6860 bl.length()=931 2024-09-19T14:09:06.170 INFO:tasks.workunit.client.0.smithi153.stderr: -19> 2024-09-19T14:09:06.035+0000 7f2465ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 info.flags=0x17 2024-09-19T14:09:06.170 INFO:tasks.workunit.client.0.smithi153.stderr: -18> 2024-09-19T14:09:06.035+0000 7f2465ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 to cache LRU end 2024-09-19T14:09:06.170 INFO:tasks.workunit.client.0.smithi153.stderr: -17> 2024-09-19T14:09:06.035+0000 7f2465ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:06.170 INFO:tasks.workunit.client.0.smithi153.stderr: -16> 2024-09-19T14:09:06.039+0000 7f2584d289c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): orig_sources= new_sources= 2024-09-19T14:09:06.170 INFO:tasks.workunit.client.0.smithi153.stderr: -15> 2024-09-19T14:09:06.039+0000 7f2584d289c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): potential sources added=[] removed=[] 2024-09-19T14:09:06.170 INFO:tasks.workunit.client.0.smithi153.stderr: -14> 2024-09-19T14:09:06.039+0000 7f2584d289c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): orig_dests= new_dests= 2024-09-19T14:09:06.170 INFO:tasks.workunit.client.0.smithi153.stderr: -13> 2024-09-19T14:09:06.039+0000 7f2584d289c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): potential dests added=[] removed=[] 2024-09-19T14:09:06.170 INFO:tasks.workunit.client.0.smithi153.stderr: -12> 2024-09-19T14:09:06.047+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.0 2024-09-19T14:09:06.170 INFO:tasks.workunit.client.0.smithi153.stderr: -11> 2024-09-19T14:09:06.047+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1 2024-09-19T14:09:06.171 INFO:tasks.workunit.client.0.smithi153.stderr: -10> 2024-09-19T14:09:06.047+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.2 2024-09-19T14:09:06.171 INFO:tasks.workunit.client.0.smithi153.stderr: -9> 2024-09-19T14:09:06.047+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.3 2024-09-19T14:09:06.171 INFO:tasks.workunit.client.0.smithi153.stderr: -8> 2024-09-19T14:09:06.051+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.4 2024-09-19T14:09:06.171 INFO:tasks.workunit.client.0.smithi153.stderr: -7> 2024-09-19T14:09:06.051+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.5 2024-09-19T14:09:06.171 INFO:tasks.workunit.client.0.smithi153.stderr: -6> 2024-09-19T14:09:06.051+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.6 2024-09-19T14:09:06.171 INFO:tasks.workunit.client.0.smithi153.stderr: -5> 2024-09-19T14:09:06.051+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.7 2024-09-19T14:09:06.171 INFO:tasks.workunit.client.0.smithi153.stderr: -4> 2024-09-19T14:09:06.051+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.8 2024-09-19T14:09:06.171 INFO:tasks.workunit.client.0.smithi153.stderr: -3> 2024-09-19T14:09:06.055+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.9 2024-09-19T14:09:06.171 INFO:tasks.workunit.client.0.smithi153.stderr: -2> 2024-09-19T14:09:06.055+0000 7f2584d289c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.10 2024-09-19T14:09:06.171 INFO:tasks.workunit.client.0.smithi153.stderr: -1> 2024-09-19T14:09:06.055+0000 7f2584d289c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2584d289c0 time 2024-09-19T14:09:06.058360+0000 2024-09-19T14:09:06.171 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:09:06.171 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.171 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:09:06.171 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f25886022eb] 2024-09-19T14:09:06.172 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f258860249f] 2024-09-19T14:09:06.172 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5607b4501271] 2024-09-19T14:09:06.172 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5607b45113b7] 2024-09-19T14:09:06.172 INFO:tasks.workunit.client.0.smithi153.stderr: 5: main() 2024-09-19T14:09:06.172 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2587468d90] 2024-09-19T14:09:06.172 INFO:tasks.workunit.client.0.smithi153.stderr: 7: __libc_start_main() 2024-09-19T14:09:06.172 INFO:tasks.workunit.client.0.smithi153.stderr: 8: _start() 2024-09-19T14:09:06.172 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.172 INFO:tasks.workunit.client.0.smithi153.stderr: 0> 2024-09-19T14:09:06.059+0000 7f2584d289c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:09:06.172 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7f2584d289c0 thread_name:radosgw-admin 2024-09-19T14:09:06.172 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.172 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:09:06.172 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2587481520] 2024-09-19T14:09:06.172 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:09:06.172 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:09:06.173 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:09:06.173 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2588602345] 2024-09-19T14:09:06.173 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f258860249f] 2024-09-19T14:09:06.173 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5607b4501271] 2024-09-19T14:09:06.173 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5607b45113b7] 2024-09-19T14:09:06.173 INFO:tasks.workunit.client.0.smithi153.stderr: 9: main() 2024-09-19T14:09:06.173 INFO:tasks.workunit.client.0.smithi153.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2587468d90] 2024-09-19T14:09:06.173 INFO:tasks.workunit.client.0.smithi153.stderr: 11: __libc_start_main() 2024-09-19T14:09:06.173 INFO:tasks.workunit.client.0.smithi153.stderr: 12: _start() 2024-09-19T14:09:06.173 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:09:06.173 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.173 INFO:tasks.workunit.client.0.smithi153.stderr:--- logging levels --- 2024-09-19T14:09:06.173 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 none 2024-09-19T14:09:06.173 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 lockdep 2024-09-19T14:09:06.173 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 context 2024-09-19T14:09:06.174 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 crush 2024-09-19T14:09:06.174 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds 2024-09-19T14:09:06.174 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_balancer 2024-09-19T14:09:06.174 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_locker 2024-09-19T14:09:06.174 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log 2024-09-19T14:09:06.174 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log_expire 2024-09-19T14:09:06.174 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_migrator 2024-09-19T14:09:06.174 INFO:tasks.workunit.client.0.smithi153.stderr: 3/ 5 mds_quiesce 2024-09-19T14:09:06.174 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 buffer 2024-09-19T14:09:06.174 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 timer 2024-09-19T14:09:06.174 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 filer 2024-09-19T14:09:06.174 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 striper 2024-09-19T14:09:06.174 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 objecter 2024-09-19T14:09:06.174 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rados 2024-09-19T14:09:06.174 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd 2024-09-19T14:09:06.174 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_mirror 2024-09-19T14:09:06.175 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_replay 2024-09-19T14:09:06.175 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_pwl 2024-09-19T14:09:06.175 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 journaler 2024-09-19T14:09:06.175 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objectcacher 2024-09-19T14:09:06.175 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:09:06.175 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 client 2024-09-19T14:09:06.175 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 osd 2024-09-19T14:09:06.175 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 optracker 2024-09-19T14:09:06.175 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objclass 2024-09-19T14:09:06.175 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 filestore 2024-09-19T14:09:06.175 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 journal 2024-09-19T14:09:06.175 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 ms 2024-09-19T14:09:06.175 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mon 2024-09-19T14:09:06.176 INFO:tasks.workunit.client.0.smithi153.stderr: 0/10 monc 2024-09-19T14:09:06.176 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 paxos 2024-09-19T14:09:06.176 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 tp 2024-09-19T14:09:06.176 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 auth 2024-09-19T14:09:06.176 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 crypto 2024-09-19T14:09:06.176 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 finisher 2024-09-19T14:09:06.176 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 reserver 2024-09-19T14:09:06.176 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 heartbeatmap 2024-09-19T14:09:06.176 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 perfcounter 2024-09-19T14:09:06.176 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw 2024-09-19T14:09:06.176 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_sync 2024-09-19T14:09:06.176 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_datacache 2024-09-19T14:09:06.176 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_access 2024-09-19T14:09:06.176 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:09:06.176 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_flight 2024-09-19T14:09:06.177 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:09:06.177 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw_notification 2024-09-19T14:09:06.177 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 javaclient 2024-09-19T14:09:06.177 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 asok 2024-09-19T14:09:06.177 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 throttle 2024-09-19T14:09:06.177 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 refs 2024-09-19T14:09:06.177 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 compressor 2024-09-19T14:09:06.177 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluestore 2024-09-19T14:09:06.177 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluefs 2024-09-19T14:09:06.177 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 bdev 2024-09-19T14:09:06.177 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 kstore 2024-09-19T14:09:06.177 INFO:tasks.workunit.client.0.smithi153.stderr: 4/ 5 rocksdb 2024-09-19T14:09:06.177 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 fuse 2024-09-19T14:09:06.177 INFO:tasks.workunit.client.0.smithi153.stderr: 2/ 5 mgr 2024-09-19T14:09:06.178 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mgrc 2024-09-19T14:09:06.178 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 dpdk 2024-09-19T14:09:06.178 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 eventtrace 2024-09-19T14:09:06.178 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 prioritycache 2024-09-19T14:09:06.178 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 test 2024-09-19T14:09:06.178 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:09:06.178 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephsqlite 2024-09-19T14:09:06.178 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:09:06.178 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore 2024-09-19T14:09:06.178 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_onode 2024-09-19T14:09:06.178 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_odata 2024-09-19T14:09:06.178 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_omap 2024-09-19T14:09:06.178 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_tm 2024-09-19T14:09:06.178 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_t 2024-09-19T14:09:06.178 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:09:06.178 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_epm 2024-09-19T14:09:06.178 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_lba 2024-09-19T14:09:06.179 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:09:06.179 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cache 2024-09-19T14:09:06.179 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_journal 2024-09-19T14:09:06.179 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_device 2024-09-19T14:09:06.179 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_backref 2024-09-19T14:09:06.179 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 alienstore 2024-09-19T14:09:06.179 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mclock 2024-09-19T14:09:06.179 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cyanstore 2024-09-19T14:09:06.179 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 ceph_exporter 2024-09-19T14:09:06.179 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 memstore 2024-09-19T14:09:06.179 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 trace 2024-09-19T14:09:06.179 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 ceph_dedup 2024-09-19T14:09:06.179 INFO:tasks.workunit.client.0.smithi153.stderr: -2/-2 (syslog threshold) 2024-09-19T14:09:06.179 INFO:tasks.workunit.client.0.smithi153.stderr: 99/99 (stderr threshold) 2024-09-19T14:09:06.179 INFO:tasks.workunit.client.0.smithi153.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:09:06.180 INFO:tasks.workunit.client.0.smithi153.stderr: 7f23b1ffb640 / http_manager 2024-09-19T14:09:06.180 INFO:tasks.workunit.client.0.smithi153.stderr: 7f23b3fff640 / http_manager 2024-09-19T14:09:06.180 INFO:tasks.workunit.client.0.smithi153.stderr: 7f24397e2640 / rgw_dt_lg_renew 2024-09-19T14:09:06.180 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2464ff9640 / ms_dispatch 2024-09-19T14:09:06.180 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2465ffb640 / io_context_pool 2024-09-19T14:09:06.180 INFO:tasks.workunit.client.0.smithi153.stderr: 7f24667fc640 / io_context_pool 2024-09-19T14:09:06.180 INFO:tasks.workunit.client.0.smithi153.stderr: 7f246ce01640 / ms_dispatch 2024-09-19T14:09:06.180 INFO:tasks.workunit.client.0.smithi153.stderr: 7f246f606640 / ms_dispatch 2024-09-19T14:09:06.180 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2470e09640 / io_context_pool 2024-09-19T14:09:06.180 INFO:tasks.workunit.client.0.smithi153.stderr: 7f258202d640 / msgr-worker-2 2024-09-19T14:09:06.180 INFO:tasks.workunit.client.0.smithi153.stderr: 7f258282e640 / msgr-worker-1 2024-09-19T14:09:06.180 INFO:tasks.workunit.client.0.smithi153.stderr: 7f258302f640 / msgr-worker-0 2024-09-19T14:09:06.180 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2583830640 / io_context_pool 2024-09-19T14:09:06.181 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2584d289c0 / radosgw-admin 2024-09-19T14:09:06.181 INFO:tasks.workunit.client.0.smithi153.stderr: max_recent 500 2024-09-19T14:09:06.181 INFO:tasks.workunit.client.0.smithi153.stderr: max_new 1000 2024-09-19T14:09:06.181 INFO:tasks.workunit.client.0.smithi153.stderr: log_file /var/lib/ceph/crash/2024-09-19T14:09:06.060522Z_5f828c99-beb5-4e97-8cc0-41bf3340eb58/log 2024-09-19T14:09:06.181 INFO:tasks.workunit.client.0.smithi153.stderr:--- end dump of recent events --- 2024-09-19T14:09:06.181 INFO:tasks.workunit.client.0.smithi153.stderr:Aborted 2024-09-19T14:09:06.181 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-19T14:09:06.182 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:09:06.182 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:09:06.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.143+0000 7faef64799c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.143+0000 7faef64799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:06.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.143+0000 7faef64799c0 20 realm 2024-09-19T14:09:06.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.143+0000 7faef64799c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.143+0000 7faef64799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:06.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.143+0000 7faef64799c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:09:06.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.143+0000 7faef64799c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.143+0000 7faef64799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:06.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.143+0000 7faef64799c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.147+0000 7faef64799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:06.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.147+0000 7faef64799c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.147+0000 7faef64799c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:09:06.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.147+0000 7faef64799c0 20 searching for the correct realm 2024-09-19T14:09:06.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.147+0000 7faef3f7f640 0 -- 172.21.15.153:0/3408299121 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x7faedc003bc0 msgr2=0x7faeec010440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:09:06.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.359+0000 7faef3f7f640 0 -- 172.21.15.153:0/3408299121 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x7faedc003bc0 msgr2=0x7faeec010440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:09:06.378 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.379+0000 7faef64799c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:09:06.378 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.379+0000 7faef64799c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:09:06.378 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.379+0000 7faef64799c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:09:06.378 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.379+0000 7faef64799c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:09:06.378 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.379+0000 7faef64799c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:09:06.378 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.379+0000 7faef64799c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:09:06.378 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.379+0000 7faef64799c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.379 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.379+0000 7faef64799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:06.379 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.379+0000 7faef64799c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.379 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.379+0000 7faef64799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:06.379 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.379+0000 7faef64799c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.379+0000 7faef64799c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:09:06.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.379+0000 7faef64799c0 20 zone default found 2024-09-19T14:09:06.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.379+0000 7faef64799c0 4 Realm: () 2024-09-19T14:09:06.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.379+0000 7faef64799c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:09:06.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.379+0000 7faef64799c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:09:06.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.379+0000 7faef64799c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:09:06.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.379+0000 7faef64799c0 20 zonegroup default 2024-09-19T14:09:06.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.379+0000 7faef64799c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.379+0000 7faef64799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:06.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.379+0000 7faef64799c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.383+0000 7faef64799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:06.382 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.383+0000 7faef64799c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.382 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.383+0000 7faef64799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:06.382 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.383+0000 7faef64799c0 20 started sync module instance, tier type = 2024-09-19T14:09:06.382 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.383+0000 7faef64799c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:09:06.403 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.403+0000 7faef64799c0 20 add_watcher() i=0 2024-09-19T14:09:06.404 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.403+0000 7faef64799c0 20 add_watcher() i=1 2024-09-19T14:09:06.404 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.403+0000 7faef64799c0 20 add_watcher() i=2 2024-09-19T14:09:06.404 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.403+0000 7faef64799c0 20 add_watcher() i=3 2024-09-19T14:09:06.404 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.403+0000 7faef64799c0 20 add_watcher() i=4 2024-09-19T14:09:06.404 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.403+0000 7faef64799c0 20 add_watcher() i=5 2024-09-19T14:09:06.404 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.403+0000 7faef64799c0 20 add_watcher() i=6 2024-09-19T14:09:06.406 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.407+0000 7faef64799c0 20 add_watcher() i=7 2024-09-19T14:09:06.406 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.407+0000 7faef64799c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:09:06.411 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.411+0000 7fada9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:06.411 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.411+0000 7faef64799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:09:06.411 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.411+0000 7faef64799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:09:06.411 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.411+0000 7faef64799c0 5 note: GC not initialized 2024-09-19T14:09:06.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.411+0000 7fada8fe1640 20 reqs_thread_entry: start 2024-09-19T14:09:06.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.411+0000 7faef64799c0 20 init_complete bucket index max shards: 11 2024-09-19T14:09:06.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.411+0000 7faef64799c0 20 Filter name: none 2024-09-19T14:09:06.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.411+0000 7fad227fc640 20 reqs_thread_entry: start 2024-09-19T14:09:06.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.411+0000 7faef64799c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.411+0000 7faef64799c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:09:06.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.411+0000 7faef64799c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.413 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.415+0000 7faef64799c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-19T14:09:06.413 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.415+0000 7faef64799c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:09:06.413 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.415+0000 7faef64799c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.413 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.415+0000 7faef64799c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:09:06.413 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.415+0000 7faef64799c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:06.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.415+0000 7faef64799c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-19T14:09:06.414 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.415+0000 7faef64799c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:09:06.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.419+0000 7fada9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:06.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.423+0000 7faef64799c0 20 remove_watcher() i=0 2024-09-19T14:09:06.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.423+0000 7faef64799c0 2 removed watcher, disabling cache 2024-09-19T14:09:06.425 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.423+0000 7faef64799c0 20 remove_watcher() i=1 2024-09-19T14:09:06.427 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.427+0000 7faef64799c0 20 remove_watcher() i=2 2024-09-19T14:09:06.429 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.431+0000 7faef64799c0 20 remove_watcher() i=3 2024-09-19T14:09:06.431 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.431+0000 7faef64799c0 20 remove_watcher() i=4 2024-09-19T14:09:06.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.435+0000 7faef64799c0 20 remove_watcher() i=5 2024-09-19T14:09:06.435 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.435+0000 7faef64799c0 20 remove_watcher() i=6 2024-09-19T14:09:06.436 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:06.435+0000 7faef64799c0 20 remove_watcher() i=7 2024-09-19T14:09:06.451 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.452 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:09:06.452 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: abort-at-commit-target-layout id: dbb1da81-49d0-421a-b677-974869a7f103.4620.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:09:06.452 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:06.453 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:06.453 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:36.794 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:36.794 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:36.879 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T14:09:36.915 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:09:36.915 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:09:36.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:36.958+0000 7f9a667fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:36.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:36.962+0000 7f9a667fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:36.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:36.962+0000 7f9a667fe9c0 20 realm 2024-09-19T14:09:36.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:36.962+0000 7f9a667fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:36.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:36.962+0000 7f9a667fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:36.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:36.962+0000 7f9a667fe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:09:36.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:36.962+0000 7f9a667fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:36.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:36.962+0000 7f9a667fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:36.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:36.962+0000 7f9a667fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:36.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:36.962+0000 7f9a667fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:36.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:36.962+0000 7f9a667fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:36.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:36.966+0000 7f9a667fe9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:09:36.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:36.966+0000 7f9a667fe9c0 20 searching for the correct realm 2024-09-19T14:09:36.970 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:36.970+0000 7f9a63b03640 0 -- 172.21.15.153:0/1462294718 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f9a54001260 msgr2=0x7f9a540f50c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:36.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:36.974+0000 7f9a64304640 0 -- 172.21.15.153:0/1462294718 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f9a4c0732c0 msgr2=0x7f9a4c06e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:37.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.190+0000 7f9a667fe9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:09:37.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.190+0000 7f9a667fe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:09:37.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.190+0000 7f9a667fe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:09:37.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.190+0000 7f9a667fe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:09:37.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.190+0000 7f9a667fe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:09:37.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.190+0000 7f9a667fe9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:09:37.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.190+0000 7f9a667fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:37.194 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.194+0000 7f9a667fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:37.194 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.194+0000 7f9a667fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:37.194 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.194+0000 7f9a667fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:37.194 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.194+0000 7f9a667fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:37.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.194+0000 7f9a667fe9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:09:37.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.194+0000 7f9a667fe9c0 20 zone default found 2024-09-19T14:09:37.196 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.194+0000 7f9a667fe9c0 4 Realm: () 2024-09-19T14:09:37.196 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.194+0000 7f9a667fe9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:09:37.196 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.194+0000 7f9a667fe9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:09:37.196 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.194+0000 7f9a667fe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:09:37.196 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.194+0000 7f9a667fe9c0 20 zonegroup default 2024-09-19T14:09:37.196 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.194+0000 7f9a667fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:37.196 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.194+0000 7f9a667fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:37.196 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.194+0000 7f9a667fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:37.197 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.198+0000 7f9a667fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:37.197 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.198+0000 7f9a667fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:37.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.198+0000 7f9a667fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:37.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.198+0000 7f9a667fe9c0 20 started sync module instance, tier type = 2024-09-19T14:09:37.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.198+0000 7f9a667fe9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:09:37.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.222+0000 7f9a667fe9c0 20 add_watcher() i=0 2024-09-19T14:09:37.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.222+0000 7f9a667fe9c0 20 add_watcher() i=1 2024-09-19T14:09:37.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.222+0000 7f9a667fe9c0 20 add_watcher() i=2 2024-09-19T14:09:37.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.222+0000 7f9a667fe9c0 20 add_watcher() i=3 2024-09-19T14:09:37.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.222+0000 7f9a667fe9c0 20 add_watcher() i=4 2024-09-19T14:09:37.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.222+0000 7f9a667fe9c0 20 add_watcher() i=5 2024-09-19T14:09:37.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.222+0000 7f9a667fe9c0 20 add_watcher() i=6 2024-09-19T14:09:37.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.226+0000 7f9a667fe9c0 20 add_watcher() i=7 2024-09-19T14:09:37.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.226+0000 7f9a667fe9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:09:37.229 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.230+0000 7f991afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:37.230 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.230+0000 7f9a667fe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:09:37.230 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.230+0000 7f9a667fe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:09:37.231 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.230+0000 7f9a667fe9c0 5 note: GC not initialized 2024-09-19T14:09:37.231 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.230+0000 7f9919fdb640 20 reqs_thread_entry: start 2024-09-19T14:09:37.231 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.230+0000 7f9a667fe9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:09:37.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.230+0000 7f9a667fe9c0 20 Filter name: none 2024-09-19T14:09:37.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.230+0000 7f988b7fe640 20 reqs_thread_entry: start 2024-09-19T14:09:37.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.230+0000 7f9a667fe9c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-19T14:09:37.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.230+0000 7f9a667fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:37.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.230+0000 7f9a667fe9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:09:37.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.230+0000 7f9a667fe9c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-19T14:09:37.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.230+0000 7f9a667fe9c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-19T14:09:37.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.230+0000 7f9a667fe9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 : miss 2024-09-19T14:09:37.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.230+0000 7f9a667fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:37.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.234+0000 7f9a667fe9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:09:37.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.234+0000 7f9a667fe9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 info.flags=0x17 2024-09-19T14:09:37.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.234+0000 7f9a667fe9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 to cache LRU end 2024-09-19T14:09:37.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.234+0000 7f9a667fe9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:09:37.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.234+0000 7f9a667fe9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:37.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.234+0000 7f9a667fe9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 2024-09-19T14:09:37.244 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.242+0000 7f9a667fe9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 info.flags=0x17 2024-09-19T14:09:37.245 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.242+0000 7f9a667fe9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 to cache LRU end 2024-09-19T14:09:37.245 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.242+0000 7f9a667fe9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:37.245 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.242+0000 7f9a667fe9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32, ofs0, ns] 2024-09-19T14:09:37.245 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.246+0000 7f993affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333496 cookie 94111872703504 notifier 6893 bl.length()=931 2024-09-19T14:09:37.245 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.246+0000 7f993affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 info.flags=0x17 2024-09-19T14:09:37.245 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.246+0000 7f993affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 to cache LRU end 2024-09-19T14:09:37.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.246+0000 7f993affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:37.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.246+0000 7f9a667fe9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): orig_sources= new_sources= 2024-09-19T14:09:37.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.246+0000 7f9a667fe9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): potential sources added=[] removed=[] 2024-09-19T14:09:37.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.246+0000 7f9a667fe9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): orig_dests= new_dests= 2024-09-19T14:09:37.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.246+0000 7f9a667fe9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): potential dests added=[] removed=[] 2024-09-19T14:09:37.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.0 2024-09-19T14:09:37.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.0 2024-09-19T14:09:37.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.1 2024-09-19T14:09:37.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.1 2024-09-19T14:09:37.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.2 2024-09-19T14:09:37.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.2 2024-09-19T14:09:37.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.3 2024-09-19T14:09:37.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.3 2024-09-19T14:09:37.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.4 2024-09-19T14:09:37.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.4 2024-09-19T14:09:37.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.5 2024-09-19T14:09:37.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.5 2024-09-19T14:09:37.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.6 2024-09-19T14:09:37.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.6 2024-09-19T14:09:37.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.7 2024-09-19T14:09:37.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.7 2024-09-19T14:09:37.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.8 2024-09-19T14:09:37.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.8 2024-09-19T14:09:37.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.9 2024-09-19T14:09:37.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.9 2024-09-19T14:09:37.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.10 2024-09-19T14:09:37.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.10 2024-09-19T14:09:37.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.11 2024-09-19T14:09:37.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1.11 2024-09-19T14:09:37.267 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.262+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.0 2024-09-19T14:09:37.267 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.266+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1 2024-09-19T14:09:37.267 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.266+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.2 2024-09-19T14:09:37.268 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.266+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.3 2024-09-19T14:09:37.268 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.266+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.4 2024-09-19T14:09:37.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.270+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.5 2024-09-19T14:09:37.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.270+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.6 2024-09-19T14:09:37.272 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.270+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.7 2024-09-19T14:09:37.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.270+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.8 2024-09-19T14:09:37.274 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.274+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.9 2024-09-19T14:09:37.276 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.274+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.10 2024-09-19T14:09:37.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.282+0000 7f9a667fe9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 : hit (requested=0x17, cached=0x17) 2024-09-19T14:09:37.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.282+0000 7f9a667fe9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 2024-09-19T14:09:37.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.282+0000 7f9a667fe9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 info.flags=0x17 2024-09-19T14:09:37.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.282+0000 7f9a667fe9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 to cache LRU end 2024-09-19T14:09:37.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.282+0000 7f9a667fe9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:37.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.282+0000 7f9a667fe9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32, ofs0, ns] 2024-09-19T14:09:37.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.286+0000 7f993b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333497 cookie 94111872703504 notifier 6893 bl.length()=931 2024-09-19T14:09:37.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.286+0000 7f993b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 info.flags=0x17 2024-09-19T14:09:37.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.286+0000 7f993b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 to cache LRU end 2024-09-19T14:09:37.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.286+0000 7f993b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:37.288 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.286+0000 7f9a667fe9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): orig_sources= new_sources= 2024-09-19T14:09:37.288 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.286+0000 7f9a667fe9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): potential sources added=[] removed=[] 2024-09-19T14:09:37.288 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.286+0000 7f9a667fe9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): orig_dests= new_dests= 2024-09-19T14:09:37.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.286+0000 7f9a667fe9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): potential dests added=[] removed=[] 2024-09-19T14:09:37.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.294+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.0 2024-09-19T14:09:37.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.294+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.1 2024-09-19T14:09:37.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.294+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.2 2024-09-19T14:09:37.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.298+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.3 2024-09-19T14:09:37.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.298+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.4 2024-09-19T14:09:37.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.298+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.5 2024-09-19T14:09:37.300 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.298+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.6 2024-09-19T14:09:37.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.298+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.7 2024-09-19T14:09:37.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.302+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.8 2024-09-19T14:09:37.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.302+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.9 2024-09-19T14:09:37.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.302+0000 7f9a667fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.32.10 2024-09-19T14:09:37.305 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.302+0000 7f9a667fe9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 : hit (requested=0x17, cached=0x17) 2024-09-19T14:09:37.305 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.302+0000 7f9a667fe9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 2024-09-19T14:09:37.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.306+0000 7f9a667fe9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 info.flags=0x17 2024-09-19T14:09:37.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.306+0000 7f9a667fe9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 to cache LRU end 2024-09-19T14:09:37.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.306+0000 7f9a667fe9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:37.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.306+0000 7f9a667fe9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32, ofs0, ns] 2024-09-19T14:09:37.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.306+0000 7f993b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333498 cookie 94111872703504 notifier 6893 bl.length()=899 2024-09-19T14:09:37.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.306+0000 7f993b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 info.flags=0x17 2024-09-19T14:09:37.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.306+0000 7f993b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:dbb1da81-49d0-421a-b677-974869a7f103.4620.32 to cache LRU end 2024-09-19T14:09:37.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.306+0000 7f993b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:37.312 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.310+0000 7f9a667fe9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): orig_sources= new_sources= 2024-09-19T14:09:37.312 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.310+0000 7f9a667fe9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): potential sources added=[] removed=[] 2024-09-19T14:09:37.312 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.310+0000 7f9a667fe9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): orig_dests= new_dests= 2024-09-19T14:09:37.312 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.310+0000 7f9a667fe9c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[dbb1da81-49d0-421a-b677-974869a7f103.4620.32]): potential dests added=[] removed=[] 2024-09-19T14:09:37.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.318+0000 7f9a667fe9c0 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-19T14:09:37.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.322+0000 7f991afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:37.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.326+0000 7f9a667fe9c0 20 remove_watcher() i=0 2024-09-19T14:09:37.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.326+0000 7f9a667fe9c0 2 removed watcher, disabling cache 2024-09-19T14:09:37.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.330+0000 7f9a667fe9c0 20 remove_watcher() i=1 2024-09-19T14:09:37.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.330+0000 7f9a667fe9c0 20 remove_watcher() i=2 2024-09-19T14:09:37.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.334+0000 7f9a667fe9c0 20 remove_watcher() i=3 2024-09-19T14:09:37.337 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.338+0000 7f9a667fe9c0 20 remove_watcher() i=4 2024-09-19T14:09:37.338 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.338+0000 7f9a667fe9c0 20 remove_watcher() i=5 2024-09-19T14:09:37.340 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.338+0000 7f9a667fe9c0 20 remove_watcher() i=6 2024-09-19T14:09:37.342 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.342+0000 7f9a667fe9c0 20 remove_watcher() i=7 2024-09-19T14:09:37.359 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-19T14:09:37.390 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:09:37.390 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:09:37.436 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.434+0000 7f5600eaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:37.437 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.434+0000 7f5600eaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:37.437 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.434+0000 7f5600eaa9c0 20 realm 2024-09-19T14:09:37.437 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.434+0000 7f5600eaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:37.437 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.434+0000 7f5600eaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:37.437 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.434+0000 7f5600eaa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:09:37.437 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.434+0000 7f5600eaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:37.437 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.434+0000 7f5600eaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:37.437 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.434+0000 7f5600eaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:37.439 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.438+0000 7f5600eaa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:37.439 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.438+0000 7f5600eaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:37.439 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.438+0000 7f5600eaa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:09:37.439 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.438+0000 7f5600eaa9c0 20 searching for the correct realm 2024-09-19T14:09:37.444 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.442+0000 7f55ff1b1640 0 -- 172.21.15.153:0/1883427614 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f55e807fab0 msgr2=0x7f55e805cd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:37.450 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.450+0000 7f55fe9b0640 0 -- 172.21.15.153:0/1883427614 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f55e80625e0 msgr2=0x7f55e80859c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:09:37.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.666+0000 7f5600eaa9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:09:37.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.666+0000 7f5600eaa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:09:37.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.666+0000 7f5600eaa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:09:37.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.666+0000 7f5600eaa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:09:37.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.666+0000 7f5600eaa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:09:37.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.666+0000 7f5600eaa9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:09:37.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.666+0000 7f5600eaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:37.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.670+0000 7f5600eaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:37.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.670+0000 7f5600eaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:37.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.670+0000 7f5600eaa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:37.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.670+0000 7f5600eaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:37.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.670+0000 7f5600eaa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:09:37.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.670+0000 7f5600eaa9c0 20 zone default found 2024-09-19T14:09:37.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.670+0000 7f5600eaa9c0 4 Realm: () 2024-09-19T14:09:37.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.670+0000 7f5600eaa9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:09:37.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.670+0000 7f5600eaa9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:09:37.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.670+0000 7f5600eaa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:09:37.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.670+0000 7f5600eaa9c0 20 zonegroup default 2024-09-19T14:09:37.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.670+0000 7f5600eaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:37.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.670+0000 7f5600eaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:37.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.670+0000 7f5600eaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:37.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.670+0000 7f5600eaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:37.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.670+0000 7f5600eaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:37.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.674+0000 7f5600eaa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:37.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.674+0000 7f5600eaa9c0 20 started sync module instance, tier type = 2024-09-19T14:09:37.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.674+0000 7f5600eaa9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:09:37.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.694+0000 7f5600eaa9c0 20 add_watcher() i=0 2024-09-19T14:09:37.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.694+0000 7f5600eaa9c0 20 add_watcher() i=1 2024-09-19T14:09:37.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.694+0000 7f5600eaa9c0 20 add_watcher() i=2 2024-09-19T14:09:37.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.694+0000 7f5600eaa9c0 20 add_watcher() i=3 2024-09-19T14:09:37.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.694+0000 7f5600eaa9c0 20 add_watcher() i=4 2024-09-19T14:09:37.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.694+0000 7f5600eaa9c0 20 add_watcher() i=5 2024-09-19T14:09:37.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.694+0000 7f5600eaa9c0 20 add_watcher() i=6 2024-09-19T14:09:37.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.698+0000 7f5600eaa9c0 20 add_watcher() i=7 2024-09-19T14:09:37.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.698+0000 7f5600eaa9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:09:37.704 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.702+0000 7f54b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:37.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.706+0000 7f5600eaa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:09:37.706 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.706+0000 7f5600eaa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:09:37.706 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.706+0000 7f5600eaa9c0 5 note: GC not initialized 2024-09-19T14:09:37.706 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.706+0000 7f542ffff640 20 reqs_thread_entry: start 2024-09-19T14:09:37.706 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.706+0000 7f5600eaa9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:09:37.706 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.706+0000 7f5600eaa9c0 20 Filter name: none 2024-09-19T14:09:37.707 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.706+0000 7f542dffb640 20 reqs_thread_entry: start 2024-09-19T14:09:37.707 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.706+0000 7f5600eaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:37.707 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.706+0000 7f5600eaa9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:09:37.707 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.706+0000 7f5600eaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:37.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.706+0000 7f5600eaa9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:09:37.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.706+0000 7f5600eaa9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:09:37.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.706+0000 7f5600eaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:37.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.706+0000 7f5600eaa9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:09:37.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.706+0000 7f5600eaa9c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:37.709 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.706+0000 7f5600eaa9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:09:37.709 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.706+0000 7f5600eaa9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:09:37.711 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.710+0000 7f54b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:37.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.714+0000 7f5600eaa9c0 20 remove_watcher() i=0 2024-09-19T14:09:37.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.714+0000 7f5600eaa9c0 2 removed watcher, disabling cache 2024-09-19T14:09:37.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.718+0000 7f5600eaa9c0 20 remove_watcher() i=1 2024-09-19T14:09:37.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.718+0000 7f5600eaa9c0 20 remove_watcher() i=2 2024-09-19T14:09:37.723 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.722+0000 7f5600eaa9c0 20 remove_watcher() i=3 2024-09-19T14:09:37.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.722+0000 7f5600eaa9c0 20 remove_watcher() i=4 2024-09-19T14:09:37.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.726+0000 7f5600eaa9c0 20 remove_watcher() i=5 2024-09-19T14:09:37.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.726+0000 7f5600eaa9c0 20 remove_watcher() i=6 2024-09-19T14:09:37.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:37.726+0000 7f5600eaa9c0 20 remove_watcher() i=7 2024-09-19T14:09:37.742 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:37.742 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:09:37.742 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: abort-at-commit-target-layout id: dbb1da81-49d0-421a-b677-974869a7f103.4620.32 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T14:09:37.743 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:37.744 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:37.744 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:37.763 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:37.763 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:38.356 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:38.357 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:38.727 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-19T14:09:38.727 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:38.730 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:38.730 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:38.867 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:38.867 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:38.958 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:38.958 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:39.078 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:39.079 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:39.182 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:39.182 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:39.279 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:39.279 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:39.433 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:39.433 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:39.528 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:39.528 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:39.630 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:39.630 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:39.734 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:39.734 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:39.817 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:39.818 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:39.908 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:39.908 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:40.010 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:40.010 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:40.105 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:40.105 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:40.206 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:40.206 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:40.315 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:40.315 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:40.415 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:40.415 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:40.513 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:40.513 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:40.619 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:40.619 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:40.721 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:40.721 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:40.821 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:40.821 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:40.918 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:40.918 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:41.013 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-19T14:09:41.047 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:09:41.047 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:09:41.092 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.090+0000 7fe49b3c79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.094+0000 7fe49b3c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:41.094 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.094+0000 7fe49b3c79c0 20 realm 2024-09-19T14:09:41.094 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.094+0000 7fe49b3c79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.094 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.094+0000 7fe49b3c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:41.094 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.094+0000 7fe49b3c79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:09:41.094 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.094+0000 7fe49b3c79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.094 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.094+0000 7fe49b3c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:41.094 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.094+0000 7fe49b3c79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.094+0000 7fe49b3c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:41.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.094+0000 7fe49b3c79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.094+0000 7fe49b3c79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:09:41.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.094+0000 7fe49b3c79c0 20 searching for the correct realm 2024-09-19T14:09:41.101 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.098+0000 7fe4986cc640 0 -- 172.21.15.153:0/1610642886 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fe488081040 msgr2=0x7fe488086b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:41.108 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.106+0000 7fe498ecd640 0 -- 172.21.15.153:0/1610642886 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fe48c108d70 msgr2=0x7fe48c1091f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:41.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.322+0000 7fe49b3c79c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:09:41.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.322+0000 7fe49b3c79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:09:41.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.322+0000 7fe49b3c79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:09:41.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.322+0000 7fe49b3c79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:09:41.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.322+0000 7fe49b3c79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:09:41.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.322+0000 7fe49b3c79c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:09:41.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.322+0000 7fe49b3c79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.322+0000 7fe49b3c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:41.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.322+0000 7fe49b3c79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.322+0000 7fe49b3c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:41.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.322+0000 7fe49b3c79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.326+0000 7fe49b3c79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:09:41.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.326+0000 7fe49b3c79c0 20 zone default found 2024-09-19T14:09:41.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.326+0000 7fe49b3c79c0 4 Realm: () 2024-09-19T14:09:41.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.326+0000 7fe49b3c79c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:09:41.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.326+0000 7fe49b3c79c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:09:41.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.326+0000 7fe49b3c79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:09:41.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.326+0000 7fe49b3c79c0 20 zonegroup default 2024-09-19T14:09:41.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.326+0000 7fe49b3c79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.326+0000 7fe49b3c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:41.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.326+0000 7fe49b3c79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.326+0000 7fe49b3c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:41.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.326+0000 7fe49b3c79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.326+0000 7fe49b3c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:41.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.326+0000 7fe49b3c79c0 20 started sync module instance, tier type = 2024-09-19T14:09:41.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.326+0000 7fe49b3c79c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:09:41.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.350+0000 7fe49b3c79c0 20 add_watcher() i=0 2024-09-19T14:09:41.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.350+0000 7fe49b3c79c0 20 add_watcher() i=1 2024-09-19T14:09:41.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.350+0000 7fe49b3c79c0 20 add_watcher() i=2 2024-09-19T14:09:41.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.350+0000 7fe49b3c79c0 20 add_watcher() i=3 2024-09-19T14:09:41.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.350+0000 7fe49b3c79c0 20 add_watcher() i=4 2024-09-19T14:09:41.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.350+0000 7fe49b3c79c0 20 add_watcher() i=5 2024-09-19T14:09:41.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.350+0000 7fe49b3c79c0 20 add_watcher() i=6 2024-09-19T14:09:41.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.350+0000 7fe49b3c79c0 20 add_watcher() i=7 2024-09-19T14:09:41.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.350+0000 7fe49b3c79c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:09:41.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.354+0000 7fe34efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:41.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.354+0000 7fe49b3c79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:09:41.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.354+0000 7fe49b3c79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:09:41.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.354+0000 7fe49b3c79c0 5 note: GC not initialized 2024-09-19T14:09:41.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.354+0000 7fe34dfe3640 20 reqs_thread_entry: start 2024-09-19T14:09:41.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.354+0000 7fe49b3c79c0 20 init_complete bucket index max shards: 11 2024-09-19T14:09:41.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.354+0000 7fe49b3c79c0 20 Filter name: none 2024-09-19T14:09:41.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.354+0000 7fe2bf7fe640 20 reqs_thread_entry: start 2024-09-19T14:09:41.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.354+0000 7fe49b3c79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.358+0000 7fe49b3c79c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:09:41.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.358+0000 7fe49b3c79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.358+0000 7fe49b3c79c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:09:41.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.358+0000 7fe49b3c79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:09:41.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.358+0000 7fe49b3c79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.358+0000 7fe49b3c79c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:09:41.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.358+0000 7fe49b3c79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.358+0000 7fe49b3c79c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:09:41.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.358+0000 7fe49b3c79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:09:41.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.362+0000 7fe34efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:41.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.366+0000 7fe49b3c79c0 20 remove_watcher() i=0 2024-09-19T14:09:41.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.366+0000 7fe49b3c79c0 2 removed watcher, disabling cache 2024-09-19T14:09:41.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.370+0000 7fe49b3c79c0 20 remove_watcher() i=1 2024-09-19T14:09:41.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.374+0000 7fe49b3c79c0 20 remove_watcher() i=2 2024-09-19T14:09:41.375 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.374+0000 7fe49b3c79c0 20 remove_watcher() i=3 2024-09-19T14:09:41.377 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.378+0000 7fe49b3c79c0 20 remove_watcher() i=4 2024-09-19T14:09:41.378 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.378+0000 7fe49b3c79c0 20 remove_watcher() i=5 2024-09-19T14:09:41.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.378+0000 7fe49b3c79c0 20 remove_watcher() i=6 2024-09-19T14:09:41.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.382+0000 7fe49b3c79c0 20 remove_watcher() i=7 2024-09-19T14:09:41.398 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:41.398 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:09:41.398 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-do-reshard id: dbb1da81-49d0-421a-b677-974869a7f103.4620.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:09:41.398 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:41.398 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-19T14:09:41.435 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:09:41.435 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:09:41.479 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.478+0000 7f24fa9b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.478+0000 7f24fa9b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:41.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.478+0000 7f24fa9b79c0 20 realm 2024-09-19T14:09:41.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.478+0000 7f24fa9b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.478+0000 7f24fa9b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:41.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.478+0000 7f24fa9b79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:09:41.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.478+0000 7f24fa9b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.482+0000 7f24fa9b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:41.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.482+0000 7f24fa9b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.482+0000 7f24fa9b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:41.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.482+0000 7f24fa9b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.482+0000 7f24fa9b79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:09:41.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.482+0000 7f24fa9b79c0 20 searching for the correct realm 2024-09-19T14:09:41.488 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.486+0000 7f24f8cbe640 0 -- 172.21.15.153:0/3832255959 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f24e0109070 msgr2=0x7f24e010e130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:41.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.494+0000 7f24f84bd640 0 -- 172.21.15.153:0/3832255959 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f24e00f6ab0 msgr2=0x7f24e0112150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:09:41.714 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.714+0000 7f24fa9b79c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:09:41.714 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.714+0000 7f24fa9b79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:09:41.714 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.714+0000 7f24fa9b79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:09:41.714 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.714+0000 7f24fa9b79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:09:41.714 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.714+0000 7f24fa9b79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:09:41.714 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.714+0000 7f24fa9b79c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:09:41.714 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.714+0000 7f24fa9b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.715 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.714+0000 7f24fa9b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:41.715 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.714+0000 7f24fa9b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.715 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.714+0000 7f24fa9b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:41.715 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.714+0000 7f24fa9b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.714+0000 7f24fa9b79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:09:41.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.714+0000 7f24fa9b79c0 20 zone default found 2024-09-19T14:09:41.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.714+0000 7f24fa9b79c0 4 Realm: () 2024-09-19T14:09:41.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.714+0000 7f24fa9b79c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:09:41.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.714+0000 7f24fa9b79c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:09:41.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.714+0000 7f24fa9b79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:09:41.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.714+0000 7f24fa9b79c0 20 zonegroup default 2024-09-19T14:09:41.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.714+0000 7f24fa9b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.714+0000 7f24fa9b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:41.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.714+0000 7f24fa9b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.718+0000 7f24fa9b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:41.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.718+0000 7f24fa9b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.718+0000 7f24fa9b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:41.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.718+0000 7f24fa9b79c0 20 started sync module instance, tier type = 2024-09-19T14:09:41.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.718+0000 7f24fa9b79c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:09:41.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.742+0000 7f24fa9b79c0 20 add_watcher() i=0 2024-09-19T14:09:41.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.742+0000 7f24fa9b79c0 20 add_watcher() i=1 2024-09-19T14:09:41.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.742+0000 7f24fa9b79c0 20 add_watcher() i=2 2024-09-19T14:09:41.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.742+0000 7f24fa9b79c0 20 add_watcher() i=3 2024-09-19T14:09:41.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.742+0000 7f24fa9b79c0 20 add_watcher() i=4 2024-09-19T14:09:41.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.742+0000 7f24fa9b79c0 20 add_watcher() i=5 2024-09-19T14:09:41.742 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.742+0000 7f24fa9b79c0 20 add_watcher() i=6 2024-09-19T14:09:41.744 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.742+0000 7f24fa9b79c0 20 add_watcher() i=7 2024-09-19T14:09:41.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.742+0000 7f24fa9b79c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:09:41.748 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.746+0000 7f23aefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:41.749 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.746+0000 7f24fa9b79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:09:41.749 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.746+0000 7f24fa9b79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:09:41.749 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.746+0000 7f24fa9b79c0 5 note: GC not initialized 2024-09-19T14:09:41.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.750+0000 7f23adfdb640 20 reqs_thread_entry: start 2024-09-19T14:09:41.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.750+0000 7f24fa9b79c0 20 init_complete bucket index max shards: 11 2024-09-19T14:09:41.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.750+0000 7f24fa9b79c0 20 Filter name: none 2024-09-19T14:09:41.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.750+0000 7f231f7fe640 20 reqs_thread_entry: start 2024-09-19T14:09:41.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.750+0000 7f24fa9b79c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-19T14:09:41.751 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.750+0000 7f24fa9b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.751 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.750+0000 7f24fa9b79c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:09:41.751 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.750+0000 7f24fa9b79c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-19T14:09:41.751 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.750+0000 7f24fa9b79c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-19T14:09:41.751 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.750+0000 7f24fa9b79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 : miss 2024-09-19T14:09:41.751 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.750+0000 7f24fa9b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.752 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.750+0000 7f24fa9b79c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:09:41.752 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.750+0000 7f24fa9b79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 info.flags=0x17 2024-09-19T14:09:41.752 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.750+0000 7f24fa9b79c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 to cache LRU end 2024-09-19T14:09:41.752 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.750+0000 7f24fa9b79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:09:41.752 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.750+0000 7f24fa9b79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:41.752 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.750+0000 7f24fa9b79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 2024-09-19T14:09:41.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.762+0000 7f24fa9b79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 info.flags=0x17 2024-09-19T14:09:41.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.762+0000 7f24fa9b79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 to cache LRU end 2024-09-19T14:09:41.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.762+0000 7f24fa9b79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:41.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.762+0000 7f24fa9b79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33, ofs0, ns] 2024-09-19T14:09:41.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.762+0000 7f23ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333534 cookie 94580700145920 notifier 6947 bl.length()=911 2024-09-19T14:09:41.764 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.762+0000 7f23ceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 info.flags=0x17 2024-09-19T14:09:41.764 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.762+0000 7f23ceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 to cache LRU end 2024-09-19T14:09:41.764 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.762+0000 7f23ceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:41.766 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.766+0000 7f24fa9b79c0 20 handle_bi_update(): bucket=:error-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.33]): orig_sources= new_sources= 2024-09-19T14:09:41.766 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.766+0000 7f24fa9b79c0 20 handle_bi_update(): bucket=:error-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.33]): potential sources added=[] removed=[] 2024-09-19T14:09:41.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.766+0000 7f24fa9b79c0 20 handle_bi_update(): bucket=:error-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.33]): orig_dests= new_dests= 2024-09-19T14:09:41.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.766+0000 7f24fa9b79c0 20 handle_bi_update(): bucket=:error-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.33]): potential dests added=[] removed=[] 2024-09-19T14:09:41.777 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.774+0000 7f24fa9b79c0 -1 Injecting error=-5 at location=do_reshard 2024-09-19T14:09:41.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.794+0000 7f24fa9b79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 : hit (requested=0x17, cached=0x17) 2024-09-19T14:09:41.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.794+0000 7f24fa9b79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 2024-09-19T14:09:41.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.798+0000 7f24fa9b79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 info.flags=0x17 2024-09-19T14:09:41.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.798+0000 7f24fa9b79c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 to cache LRU end 2024-09-19T14:09:41.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.798+0000 7f24fa9b79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:41.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.798+0000 7f24fa9b79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33, ofs0, ns] 2024-09-19T14:09:41.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.798+0000 7f23ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333535 cookie 94580700145920 notifier 6947 bl.length()=879 2024-09-19T14:09:41.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.798+0000 7f23ceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 info.flags=0x17 2024-09-19T14:09:41.799 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.798+0000 7f23ceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 to cache LRU end 2024-09-19T14:09:41.799 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.798+0000 7f23ceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:41.801 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.802+0000 7f24fa9b79c0 20 handle_bi_update(): bucket=:error-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.33]): orig_sources= new_sources= 2024-09-19T14:09:41.801 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.802+0000 7f24fa9b79c0 20 handle_bi_update(): bucket=:error-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.33]): potential sources added=[] removed=[] 2024-09-19T14:09:41.801 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.802+0000 7f24fa9b79c0 20 handle_bi_update(): bucket=:error-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.33]): orig_dests= new_dests= 2024-09-19T14:09:41.801 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.802+0000 7f24fa9b79c0 20 handle_bi_update(): bucket=:error-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.33]): potential dests added=[] removed=[] 2024-09-19T14:09:41.801 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.802+0000 7f24fa9b79c0 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-19T14:09:41.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.806+0000 7f23aefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:41.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.810+0000 7f24fa9b79c0 20 remove_watcher() i=0 2024-09-19T14:09:41.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.810+0000 7f24fa9b79c0 2 removed watcher, disabling cache 2024-09-19T14:09:41.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.810+0000 7f24fa9b79c0 20 remove_watcher() i=1 2024-09-19T14:09:41.815 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.814+0000 7f24fa9b79c0 20 remove_watcher() i=2 2024-09-19T14:09:41.817 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.818+0000 7f24fa9b79c0 20 remove_watcher() i=3 2024-09-19T14:09:41.820 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.818+0000 7f24fa9b79c0 20 remove_watcher() i=4 2024-09-19T14:09:41.822 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.822+0000 7f24fa9b79c0 20 remove_watcher() i=5 2024-09-19T14:09:41.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.822+0000 7f24fa9b79c0 20 remove_watcher() i=6 2024-09-19T14:09:41.824 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.822+0000 7f24fa9b79c0 20 remove_watcher() i=7 2024-09-19T14:09:41.840 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-19T14:09:41.866 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:09:41.866 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:09:41.910 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.910+0000 7fbdeb3c19c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.910+0000 7fbdeb3c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:41.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.910+0000 7fbdeb3c19c0 20 realm 2024-09-19T14:09:41.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.910+0000 7fbdeb3c19c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.910+0000 7fbdeb3c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:41.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.910+0000 7fbdeb3c19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:09:41.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.910+0000 7fbdeb3c19c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.910+0000 7fbdeb3c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:41.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.910+0000 7fbdeb3c19c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.914 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.914+0000 7fbdeb3c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:41.914 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.914+0000 7fbdeb3c19c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:41.914 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.914+0000 7fbdeb3c19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:09:41.914 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.914+0000 7fbdeb3c19c0 20 searching for the correct realm 2024-09-19T14:09:41.918 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:41.918+0000 7fbde86c6640 0 -- 172.21.15.153:0/1665375100 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fbdd80c5b60 msgr2=0x7fbdd80f93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:42.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.134+0000 7fbde8ec7640 0 -- 172.21.15.153:0/1665375100 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fbddc051920 msgr2=0x7fbddc050400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:42.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.754+0000 7fbdeb3c19c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:09:42.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.754+0000 7fbdeb3c19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:09:42.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.754+0000 7fbdeb3c19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:09:42.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.754+0000 7fbdeb3c19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:09:42.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.754+0000 7fbdeb3c19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:09:42.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.754+0000 7fbdeb3c19c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:09:42.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.754+0000 7fbdeb3c19c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:42.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.758+0000 7fbdeb3c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:42.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.758+0000 7fbdeb3c19c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:42.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.758+0000 7fbdeb3c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:42.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.758+0000 7fbdeb3c19c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:42.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.758+0000 7fbdeb3c19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:09:42.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.758+0000 7fbdeb3c19c0 20 zone default found 2024-09-19T14:09:42.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.758+0000 7fbdeb3c19c0 4 Realm: () 2024-09-19T14:09:42.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.758+0000 7fbdeb3c19c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:09:42.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.758+0000 7fbdeb3c19c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:09:42.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.758+0000 7fbdeb3c19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:09:42.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.758+0000 7fbdeb3c19c0 20 zonegroup default 2024-09-19T14:09:42.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.758+0000 7fbdeb3c19c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:42.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.758+0000 7fbdeb3c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:42.762 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.758+0000 7fbdeb3c19c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:42.762 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.762+0000 7fbdeb3c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:42.762 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.762+0000 7fbdeb3c19c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:42.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.762+0000 7fbdeb3c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:42.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.762+0000 7fbdeb3c19c0 20 started sync module instance, tier type = 2024-09-19T14:09:42.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.762+0000 7fbdeb3c19c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:09:42.786 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.786+0000 7fbdeb3c19c0 20 add_watcher() i=0 2024-09-19T14:09:42.786 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.786+0000 7fbdeb3c19c0 20 add_watcher() i=1 2024-09-19T14:09:42.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.786+0000 7fbdeb3c19c0 20 add_watcher() i=2 2024-09-19T14:09:42.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.786+0000 7fbdeb3c19c0 20 add_watcher() i=3 2024-09-19T14:09:42.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.786+0000 7fbdeb3c19c0 20 add_watcher() i=4 2024-09-19T14:09:42.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.786+0000 7fbdeb3c19c0 20 add_watcher() i=5 2024-09-19T14:09:42.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.786+0000 7fbdeb3c19c0 20 add_watcher() i=6 2024-09-19T14:09:42.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.786+0000 7fbdeb3c19c0 20 add_watcher() i=7 2024-09-19T14:09:42.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.786+0000 7fbdeb3c19c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:09:42.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.790+0000 7fbc9efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:42.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.794+0000 7fbdeb3c19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:09:42.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.794+0000 7fbdeb3c19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:09:42.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.794+0000 7fbdeb3c19c0 5 note: GC not initialized 2024-09-19T14:09:42.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.794+0000 7fbc9dfe3640 20 reqs_thread_entry: start 2024-09-19T14:09:42.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.794+0000 7fbdeb3c19c0 20 init_complete bucket index max shards: 11 2024-09-19T14:09:42.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.794+0000 7fbdeb3c19c0 20 Filter name: none 2024-09-19T14:09:42.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.794+0000 7fbc0f7fe640 20 reqs_thread_entry: start 2024-09-19T14:09:42.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.794+0000 7fbdeb3c19c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:42.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.794+0000 7fbdeb3c19c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:09:42.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.794+0000 7fbdeb3c19c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:42.797 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.794+0000 7fbdeb3c19c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:09:42.797 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.794+0000 7fbdeb3c19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:09:42.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.794+0000 7fbdeb3c19c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:42.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.798+0000 7fbdeb3c19c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:09:42.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.798+0000 7fbdeb3c19c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:42.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.798+0000 7fbdeb3c19c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:09:42.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.798+0000 7fbdeb3c19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:09:42.801 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.802+0000 7fbc9efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:42.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.806+0000 7fbdeb3c19c0 20 remove_watcher() i=0 2024-09-19T14:09:42.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.806+0000 7fbdeb3c19c0 2 removed watcher, disabling cache 2024-09-19T14:09:42.809 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.810+0000 7fbdeb3c19c0 20 remove_watcher() i=1 2024-09-19T14:09:42.812 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.810+0000 7fbdeb3c19c0 20 remove_watcher() i=2 2024-09-19T14:09:42.814 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.814+0000 7fbdeb3c19c0 20 remove_watcher() i=3 2024-09-19T14:09:42.817 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.814+0000 7fbdeb3c19c0 20 remove_watcher() i=4 2024-09-19T14:09:42.818 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.818+0000 7fbdeb3c19c0 20 remove_watcher() i=5 2024-09-19T14:09:42.820 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.818+0000 7fbdeb3c19c0 20 remove_watcher() i=6 2024-09-19T14:09:42.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:42.822+0000 7fbdeb3c19c0 20 remove_watcher() i=7 2024-09-19T14:09:42.841 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:42.841 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:09:42.841 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-do-reshard id: dbb1da81-49d0-421a-b677-974869a7f103.4620.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:09:42.841 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:42.844 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:42.844 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:42.899 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:42.899 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:42.987 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T14:09:43.023 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:09:43.023 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:09:43.069 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.066+0000 7f75754b49c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.070 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.070+0000 7f75754b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:43.070 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.070+0000 7f75754b49c0 20 realm 2024-09-19T14:09:43.070 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.070+0000 7f75754b49c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.070+0000 7f75754b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:43.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.070+0000 7f75754b49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:09:43.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.070+0000 7f75754b49c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.070+0000 7f75754b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:43.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.070+0000 7f75754b49c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.072 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.070+0000 7f75754b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:43.072 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.070+0000 7f75754b49c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.073 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.070+0000 7f75754b49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:09:43.073 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.070+0000 7f75754b49c0 20 searching for the correct realm 2024-09-19T14:09:43.077 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.074+0000 7f75727b9640 0 -- 172.21.15.153:0/2542615146 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f7564018070 msgr2=0x7f7564091a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:09:43.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.082+0000 7f7572fba640 0 -- 172.21.15.153:0/2542615146 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f75680d6900 msgr2=0x7f756810b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:09:43.300 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.298+0000 7f75754b49c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:09:43.300 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.298+0000 7f75754b49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:09:43.300 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.298+0000 7f75754b49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:09:43.300 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.298+0000 7f75754b49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:09:43.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.298+0000 7f75754b49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:09:43.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.298+0000 7f75754b49c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:09:43.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.298+0000 7f75754b49c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.298+0000 7f75754b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:43.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.298+0000 7f75754b49c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.298+0000 7f75754b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:43.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.298+0000 7f75754b49c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.302+0000 7f75754b49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:09:43.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.302+0000 7f75754b49c0 20 zone default found 2024-09-19T14:09:43.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.302+0000 7f75754b49c0 4 Realm: () 2024-09-19T14:09:43.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.302+0000 7f75754b49c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:09:43.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.302+0000 7f75754b49c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:09:43.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.302+0000 7f75754b49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:09:43.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.302+0000 7f75754b49c0 20 zonegroup default 2024-09-19T14:09:43.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.302+0000 7f75754b49c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.302+0000 7f75754b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:43.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.302+0000 7f75754b49c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.302+0000 7f75754b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:43.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.302+0000 7f75754b49c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.302+0000 7f75754b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:43.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.302+0000 7f75754b49c0 20 started sync module instance, tier type = 2024-09-19T14:09:43.305 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.302+0000 7f75754b49c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:09:43.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.326+0000 7f75754b49c0 20 add_watcher() i=0 2024-09-19T14:09:43.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.326+0000 7f75754b49c0 20 add_watcher() i=1 2024-09-19T14:09:43.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.326+0000 7f75754b49c0 20 add_watcher() i=2 2024-09-19T14:09:43.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.326+0000 7f75754b49c0 20 add_watcher() i=3 2024-09-19T14:09:43.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.326+0000 7f75754b49c0 20 add_watcher() i=4 2024-09-19T14:09:43.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.326+0000 7f75754b49c0 20 add_watcher() i=5 2024-09-19T14:09:43.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.326+0000 7f75754b49c0 20 add_watcher() i=6 2024-09-19T14:09:43.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.326+0000 7f75754b49c0 20 add_watcher() i=7 2024-09-19T14:09:43.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.326+0000 7f75754b49c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:09:43.331 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.330+0000 7f74297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:43.332 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.330+0000 7f75754b49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:09:43.332 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.330+0000 7f75754b49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:09:43.332 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.330+0000 7f75754b49c0 5 note: GC not initialized 2024-09-19T14:09:43.332 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.330+0000 7f73a3fff640 20 reqs_thread_entry: start 2024-09-19T14:09:43.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.330+0000 7f75754b49c0 20 init_complete bucket index max shards: 11 2024-09-19T14:09:43.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.330+0000 7f75754b49c0 20 Filter name: none 2024-09-19T14:09:43.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.330+0000 7f73a1ffb640 20 reqs_thread_entry: start 2024-09-19T14:09:43.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.330+0000 7f75754b49c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-19T14:09:43.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.330+0000 7f75754b49c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.330+0000 7f75754b49c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:09:43.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.330+0000 7f75754b49c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-19T14:09:43.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.330+0000 7f75754b49c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-19T14:09:43.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.330+0000 7f75754b49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 : miss 2024-09-19T14:09:43.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.330+0000 7f75754b49c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.334+0000 7f75754b49c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:09:43.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.334+0000 7f75754b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 info.flags=0x17 2024-09-19T14:09:43.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.334+0000 7f75754b49c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 to cache LRU end 2024-09-19T14:09:43.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.334+0000 7f75754b49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:09:43.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.334+0000 7f75754b49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:43.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.334+0000 7f75754b49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 2024-09-19T14:09:43.345 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.346+0000 7f75754b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 info.flags=0x17 2024-09-19T14:09:43.345 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.346+0000 7f75754b49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 to cache LRU end 2024-09-19T14:09:43.345 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.346+0000 7f75754b49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:43.345 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.346+0000 7f75754b49c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33, ofs0, ns] 2024-09-19T14:09:43.346 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.346+0000 7f74567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333536 cookie 93906266590080 notifier 7440 bl.length()=911 2024-09-19T14:09:43.346 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.346+0000 7f74567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 info.flags=0x17 2024-09-19T14:09:43.346 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.346+0000 7f74567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 to cache LRU end 2024-09-19T14:09:43.346 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.346+0000 7f74567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:43.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.346+0000 7f75754b49c0 20 handle_bi_update(): bucket=:error-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.33]): orig_sources= new_sources= 2024-09-19T14:09:43.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.346+0000 7f75754b49c0 20 handle_bi_update(): bucket=:error-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.33]): potential sources added=[] removed=[] 2024-09-19T14:09:43.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.346+0000 7f75754b49c0 20 handle_bi_update(): bucket=:error-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.33]): orig_dests= new_dests= 2024-09-19T14:09:43.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.346+0000 7f75754b49c0 20 handle_bi_update(): bucket=:error-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.33]): potential dests added=[] removed=[] 2024-09-19T14:09:43.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1.0 2024-09-19T14:09:43.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1.0 2024-09-19T14:09:43.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1.1 2024-09-19T14:09:43.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1.1 2024-09-19T14:09:43.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1.2 2024-09-19T14:09:43.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1.2 2024-09-19T14:09:43.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1.3 2024-09-19T14:09:43.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1.3 2024-09-19T14:09:43.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1.4 2024-09-19T14:09:43.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1.4 2024-09-19T14:09:43.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1.5 2024-09-19T14:09:43.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1.5 2024-09-19T14:09:43.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1.6 2024-09-19T14:09:43.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1.6 2024-09-19T14:09:43.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1.7 2024-09-19T14:09:43.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1.7 2024-09-19T14:09:43.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1.8 2024-09-19T14:09:43.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1.8 2024-09-19T14:09:43.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1.9 2024-09-19T14:09:43.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1.9 2024-09-19T14:09:43.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1.10 2024-09-19T14:09:43.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1.10 2024-09-19T14:09:43.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1.11 2024-09-19T14:09:43.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1.11 2024-09-19T14:09:43.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.0 2024-09-19T14:09:43.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1 2024-09-19T14:09:43.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.358+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.2 2024-09-19T14:09:43.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.362+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.3 2024-09-19T14:09:43.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.362+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.4 2024-09-19T14:09:43.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.362+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.5 2024-09-19T14:09:43.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.362+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.6 2024-09-19T14:09:43.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.366+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.7 2024-09-19T14:09:43.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.366+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.8 2024-09-19T14:09:43.368 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.366+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.9 2024-09-19T14:09:43.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.370+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.10 2024-09-19T14:09:43.377 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.378+0000 7f75754b49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 : hit (requested=0x17, cached=0x17) 2024-09-19T14:09:43.377 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.378+0000 7f75754b49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 2024-09-19T14:09:43.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.378+0000 7f75754b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 info.flags=0x17 2024-09-19T14:09:43.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.378+0000 7f75754b49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 to cache LRU end 2024-09-19T14:09:43.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.378+0000 7f75754b49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:43.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.378+0000 7f75754b49c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33, ofs0, ns] 2024-09-19T14:09:43.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.378+0000 7f74567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333537 cookie 93906266590080 notifier 7440 bl.length()=911 2024-09-19T14:09:43.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.378+0000 7f74567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 info.flags=0x17 2024-09-19T14:09:43.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.378+0000 7f74567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 to cache LRU end 2024-09-19T14:09:43.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.378+0000 7f74567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:43.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.382+0000 7f75754b49c0 20 handle_bi_update(): bucket=:error-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.33]): orig_sources= new_sources= 2024-09-19T14:09:43.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.382+0000 7f75754b49c0 20 handle_bi_update(): bucket=:error-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.33]): potential sources added=[] removed=[] 2024-09-19T14:09:43.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.382+0000 7f75754b49c0 20 handle_bi_update(): bucket=:error-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.33]): orig_dests= new_dests= 2024-09-19T14:09:43.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.382+0000 7f75754b49c0 20 handle_bi_update(): bucket=:error-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.33]): potential dests added=[] removed=[] 2024-09-19T14:09:43.388 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.386+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.0 2024-09-19T14:09:43.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.386+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.1 2024-09-19T14:09:43.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.390+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.2 2024-09-19T14:09:43.390 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.390+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.3 2024-09-19T14:09:43.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.390+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.4 2024-09-19T14:09:43.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.390+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.5 2024-09-19T14:09:43.392 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.390+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.6 2024-09-19T14:09:43.393 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.390+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.7 2024-09-19T14:09:43.393 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.394+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.8 2024-09-19T14:09:43.394 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.394+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.9 2024-09-19T14:09:43.394 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.394+0000 7f75754b49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.33.10 2024-09-19T14:09:43.395 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.394+0000 7f75754b49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 : hit (requested=0x17, cached=0x17) 2024-09-19T14:09:43.395 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.394+0000 7f75754b49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 2024-09-19T14:09:43.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.398+0000 7f75754b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 info.flags=0x17 2024-09-19T14:09:43.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.398+0000 7f75754b49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 to cache LRU end 2024-09-19T14:09:43.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.398+0000 7f75754b49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:43.399 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.398+0000 7f75754b49c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33, ofs0, ns] 2024-09-19T14:09:43.399 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.398+0000 7f74567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333538 cookie 93906266590080 notifier 7440 bl.length()=879 2024-09-19T14:09:43.399 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.398+0000 7f74567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 info.flags=0x17 2024-09-19T14:09:43.399 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.398+0000 7f74567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.33 to cache LRU end 2024-09-19T14:09:43.399 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.398+0000 7f74567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:43.402 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.402+0000 7f75754b49c0 20 handle_bi_update(): bucket=:error-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.33]): orig_sources= new_sources= 2024-09-19T14:09:43.402 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.402+0000 7f75754b49c0 20 handle_bi_update(): bucket=:error-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.33]): potential sources added=[] removed=[] 2024-09-19T14:09:43.402 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.402+0000 7f75754b49c0 20 handle_bi_update(): bucket=:error-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.33]): orig_dests= new_dests= 2024-09-19T14:09:43.402 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.402+0000 7f75754b49c0 20 handle_bi_update(): bucket=:error-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.33]): potential dests added=[] removed=[] 2024-09-19T14:09:43.407 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.406+0000 7f75754b49c0 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-19T14:09:43.411 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.410+0000 7f74297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:43.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.414+0000 7f75754b49c0 20 remove_watcher() i=0 2024-09-19T14:09:43.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.414+0000 7f75754b49c0 2 removed watcher, disabling cache 2024-09-19T14:09:43.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.418+0000 7f75754b49c0 20 remove_watcher() i=1 2024-09-19T14:09:43.420 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.418+0000 7f75754b49c0 20 remove_watcher() i=2 2024-09-19T14:09:43.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.422+0000 7f75754b49c0 20 remove_watcher() i=3 2024-09-19T14:09:43.425 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.422+0000 7f75754b49c0 20 remove_watcher() i=4 2024-09-19T14:09:43.426 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.426+0000 7f75754b49c0 20 remove_watcher() i=5 2024-09-19T14:09:43.427 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.426+0000 7f75754b49c0 20 remove_watcher() i=6 2024-09-19T14:09:43.429 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.426+0000 7f75754b49c0 20 remove_watcher() i=7 2024-09-19T14:09:43.446 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-19T14:09:43.476 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:09:43.476 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:09:43.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.522+0000 7f66dbb309c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.522+0000 7f66dbb309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:43.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.522+0000 7f66dbb309c0 20 realm 2024-09-19T14:09:43.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.522+0000 7f66dbb309c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.522+0000 7f66dbb309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:43.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.522+0000 7f66dbb309c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:09:43.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.522+0000 7f66dbb309c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.522+0000 7f66dbb309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:43.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.522+0000 7f66dbb309c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.526+0000 7f66dbb309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:43.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.526+0000 7f66dbb309c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.527 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.526+0000 7f66dbb309c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:09:43.527 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.526+0000 7f66dbb309c0 20 searching for the correct realm 2024-09-19T14:09:43.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.530+0000 7f66d9e37640 0 -- 172.21.15.153:0/3888651250 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f66c4066240 msgr2=0x7f66c4064cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:43.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.538+0000 7f66d9636640 0 -- 172.21.15.153:0/3888651250 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f66c406bba0 msgr2=0x7f66c40019f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:09:43.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.754+0000 7f66dbb309c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:09:43.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.754+0000 7f66dbb309c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:09:43.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.754+0000 7f66dbb309c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:09:43.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.754+0000 7f66dbb309c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:09:43.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.754+0000 7f66dbb309c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:09:43.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.754+0000 7f66dbb309c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:09:43.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.754+0000 7f66dbb309c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.754+0000 7f66dbb309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:43.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.754+0000 7f66dbb309c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.758+0000 7f66dbb309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:43.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.758+0000 7f66dbb309c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.758+0000 7f66dbb309c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:09:43.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.758+0000 7f66dbb309c0 20 zone default found 2024-09-19T14:09:43.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.758+0000 7f66dbb309c0 4 Realm: () 2024-09-19T14:09:43.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.758+0000 7f66dbb309c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:09:43.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.758+0000 7f66dbb309c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:09:43.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.758+0000 7f66dbb309c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:09:43.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.758+0000 7f66dbb309c0 20 zonegroup default 2024-09-19T14:09:43.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.758+0000 7f66dbb309c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.758+0000 7f66dbb309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:43.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.758+0000 7f66dbb309c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.758+0000 7f66dbb309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:43.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.758+0000 7f66dbb309c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.762+0000 7f66dbb309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:43.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.762+0000 7f66dbb309c0 20 started sync module instance, tier type = 2024-09-19T14:09:43.762 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.762+0000 7f66dbb309c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:09:43.782 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.782+0000 7f66dbb309c0 20 add_watcher() i=0 2024-09-19T14:09:43.782 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.782+0000 7f66dbb309c0 20 add_watcher() i=1 2024-09-19T14:09:43.782 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.782+0000 7f66dbb309c0 20 add_watcher() i=2 2024-09-19T14:09:43.782 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.782+0000 7f66dbb309c0 20 add_watcher() i=3 2024-09-19T14:09:43.783 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.782+0000 7f66dbb309c0 20 add_watcher() i=4 2024-09-19T14:09:43.783 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.782+0000 7f66dbb309c0 20 add_watcher() i=5 2024-09-19T14:09:43.783 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.782+0000 7f66dbb309c0 20 add_watcher() i=6 2024-09-19T14:09:43.784 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.782+0000 7f66dbb309c0 20 add_watcher() i=7 2024-09-19T14:09:43.784 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.782+0000 7f66dbb309c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:09:43.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.786+0000 7f658ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:43.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.790+0000 7f66dbb309c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:09:43.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.790+0000 7f66dbb309c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:09:43.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.790+0000 7f66dbb309c0 5 note: GC not initialized 2024-09-19T14:09:43.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.790+0000 7f658efe5640 20 reqs_thread_entry: start 2024-09-19T14:09:43.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.790+0000 7f66dbb309c0 20 init_complete bucket index max shards: 11 2024-09-19T14:09:43.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.790+0000 7f66dbb309c0 20 Filter name: none 2024-09-19T14:09:43.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.790+0000 7f658cfe1640 20 reqs_thread_entry: start 2024-09-19T14:09:43.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.790+0000 7f66dbb309c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.790+0000 7f66dbb309c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:09:43.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.790+0000 7f66dbb309c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.790+0000 7f66dbb309c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:09:43.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.790+0000 7f66dbb309c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:09:43.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.790+0000 7f66dbb309c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.794+0000 7f66dbb309c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:09:43.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.794+0000 7f66dbb309c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:43.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.794+0000 7f66dbb309c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:09:43.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.794+0000 7f66dbb309c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:09:43.799 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.798+0000 7f658ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:43.803 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.802+0000 7f66dbb309c0 20 remove_watcher() i=0 2024-09-19T14:09:43.803 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.802+0000 7f66dbb309c0 2 removed watcher, disabling cache 2024-09-19T14:09:43.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.806+0000 7f66dbb309c0 20 remove_watcher() i=1 2024-09-19T14:09:43.809 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.806+0000 7f66dbb309c0 20 remove_watcher() i=2 2024-09-19T14:09:43.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.810+0000 7f66dbb309c0 20 remove_watcher() i=3 2024-09-19T14:09:43.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.810+0000 7f66dbb309c0 20 remove_watcher() i=4 2024-09-19T14:09:43.817 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.818+0000 7f66dbb309c0 20 remove_watcher() i=5 2024-09-19T14:09:43.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.818+0000 7f66dbb309c0 20 remove_watcher() i=6 2024-09-19T14:09:43.822 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:43.822+0000 7f66dbb309c0 20 remove_watcher() i=7 2024-09-19T14:09:43.840 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:43.840 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:09:43.840 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-do-reshard id: dbb1da81-49d0-421a-b677-974869a7f103.4620.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T14:09:43.840 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:43.842 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:43.842 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:43.870 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:43.870 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:44.422 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:44.423 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:44.807 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-19T14:09:44.807 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:44.812 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:44.812 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:44.943 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:44.943 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:45.033 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:45.034 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:45.141 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:45.141 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:45.237 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:45.238 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:45.333 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:45.333 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:45.433 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:45.433 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:45.529 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:45.530 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:45.628 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:45.628 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:45.729 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:45.729 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:45.826 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:45.827 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:45.923 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:45.923 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:46.025 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:46.025 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:46.127 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:46.127 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:46.224 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:46.224 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:46.329 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:46.329 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:46.417 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:46.417 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:46.514 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:46.514 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:46.613 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:46.613 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:46.714 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:46.714 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:46.816 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:46.816 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:46.910 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:46.910 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:47.007 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-19T14:09:47.039 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:09:47.039 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:09:47.085 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.086+0000 7fc0834529c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.086+0000 7fc0834529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:47.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.086+0000 7fc0834529c0 20 realm 2024-09-19T14:09:47.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.086+0000 7fc0834529c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.086+0000 7fc0834529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:47.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.086+0000 7fc0834529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:09:47.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.086+0000 7fc0834529c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.086+0000 7fc0834529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:47.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.086+0000 7fc0834529c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.090+0000 7fc0834529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:47.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.090+0000 7fc0834529c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.090+0000 7fc0834529c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:09:47.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.090+0000 7fc0834529c0 20 searching for the correct realm 2024-09-19T14:09:47.094 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.094+0000 7fc080757640 0 -- 172.21.15.153:0/1859067993 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fc07012d000 msgr2=0x7fc070101050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:09:47.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.310+0000 7fc080f58640 0 -- 172.21.15.153:0/1859067993 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fc068003100 msgr2=0x7fc07402a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:47.528 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.526+0000 7fc0834529c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:09:47.528 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.526+0000 7fc0834529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:09:47.528 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.526+0000 7fc0834529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:09:47.528 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.526+0000 7fc0834529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:09:47.528 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.526+0000 7fc0834529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:09:47.528 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.526+0000 7fc0834529c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:09:47.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.526+0000 7fc0834529c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.526+0000 7fc0834529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:47.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.526+0000 7fc0834529c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.526+0000 7fc0834529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:47.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.526+0000 7fc0834529c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.530 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.530+0000 7fc0834529c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:09:47.530 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.530+0000 7fc0834529c0 20 zone default found 2024-09-19T14:09:47.530 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.530+0000 7fc0834529c0 4 Realm: () 2024-09-19T14:09:47.530 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.530+0000 7fc0834529c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:09:47.530 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.530+0000 7fc0834529c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:09:47.530 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.530+0000 7fc0834529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:09:47.530 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.530+0000 7fc0834529c0 20 zonegroup default 2024-09-19T14:09:47.530 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.530+0000 7fc0834529c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.530+0000 7fc0834529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:47.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.530+0000 7fc0834529c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.530+0000 7fc0834529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:47.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.530+0000 7fc0834529c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.530+0000 7fc0834529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:47.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.530+0000 7fc0834529c0 20 started sync module instance, tier type = 2024-09-19T14:09:47.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.530+0000 7fc0834529c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:09:47.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.558+0000 7fc0834529c0 20 add_watcher() i=0 2024-09-19T14:09:47.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.558+0000 7fc0834529c0 20 add_watcher() i=1 2024-09-19T14:09:47.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.558+0000 7fc0834529c0 20 add_watcher() i=2 2024-09-19T14:09:47.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.558+0000 7fc0834529c0 20 add_watcher() i=3 2024-09-19T14:09:47.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.558+0000 7fc0834529c0 20 add_watcher() i=4 2024-09-19T14:09:47.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.558+0000 7fc0834529c0 20 add_watcher() i=5 2024-09-19T14:09:47.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.558+0000 7fc0834529c0 20 add_watcher() i=6 2024-09-19T14:09:47.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.562+0000 7fc0834529c0 20 add_watcher() i=7 2024-09-19T14:09:47.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.562+0000 7fc0834529c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:09:47.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.566+0000 7fbf377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:47.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.566+0000 7fc0834529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:09:47.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.566+0000 7fc0834529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:09:47.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.566+0000 7fc0834529c0 5 note: GC not initialized 2024-09-19T14:09:47.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.566+0000 7fbf367e4640 20 reqs_thread_entry: start 2024-09-19T14:09:47.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.566+0000 7fc0834529c0 20 init_complete bucket index max shards: 11 2024-09-19T14:09:47.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.566+0000 7fc0834529c0 20 Filter name: none 2024-09-19T14:09:47.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.566+0000 7fbf2f7fe640 20 reqs_thread_entry: start 2024-09-19T14:09:47.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.566+0000 7fc0834529c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.566+0000 7fc0834529c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:09:47.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.566+0000 7fc0834529c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.570+0000 7fc0834529c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:09:47.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.570+0000 7fc0834529c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:09:47.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.570+0000 7fc0834529c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.570+0000 7fc0834529c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:09:47.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.570+0000 7fc0834529c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.570+0000 7fc0834529c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:09:47.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.570+0000 7fc0834529c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:09:47.575 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.574+0000 7fbf377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:47.579 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.578+0000 7fc0834529c0 20 remove_watcher() i=0 2024-09-19T14:09:47.579 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.578+0000 7fc0834529c0 2 removed watcher, disabling cache 2024-09-19T14:09:47.581 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.582+0000 7fc0834529c0 20 remove_watcher() i=1 2024-09-19T14:09:47.584 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.582+0000 7fc0834529c0 20 remove_watcher() i=2 2024-09-19T14:09:47.586 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.586+0000 7fc0834529c0 20 remove_watcher() i=3 2024-09-19T14:09:47.588 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.586+0000 7fc0834529c0 20 remove_watcher() i=4 2024-09-19T14:09:47.590 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.590+0000 7fc0834529c0 20 remove_watcher() i=5 2024-09-19T14:09:47.591 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.590+0000 7fc0834529c0 20 remove_watcher() i=6 2024-09-19T14:09:47.592 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.590+0000 7fc0834529c0 20 remove_watcher() i=7 2024-09-19T14:09:47.609 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:47.609 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:09:47.609 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: abort-at-do-reshard id: dbb1da81-49d0-421a-b677-974869a7f103.4620.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:09:47.609 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:47.610 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-19T14:09:47.646 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:09:47.646 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:09:47.690 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.690+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.690+0000 7fd1840e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:47.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.690+0000 7fd1840e29c0 20 realm 2024-09-19T14:09:47.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.690+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.690+0000 7fd1840e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:47.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.690+0000 7fd1840e29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:09:47.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.690+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.690+0000 7fd1840e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:47.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.690+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.694+0000 7fd1840e29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:47.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.694+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.694+0000 7fd1840e29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:09:47.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.694+0000 7fd1840e29c0 20 searching for the correct realm 2024-09-19T14:09:47.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.698+0000 7fd1813e7640 0 -- 172.21.15.153:0/4029659940 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fd17405c3f0 msgr2=0x7fd17405ea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:47.706 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.706+0000 7fd181be8640 0 -- 172.21.15.153:0/4029659940 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fd1780a2330 msgr2=0x7fd178002860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:47.926 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:09:47.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:09:47.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:09:47.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:09:47.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:09:47.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:09:47.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:47.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.928 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:47.928 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:09:47.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 zone default found 2024-09-19T14:09:47.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.926+0000 7fd1840e29c0 4 Realm: () 2024-09-19T14:09:47.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.926+0000 7fd1840e29c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:09:47.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.926+0000 7fd1840e29c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:09:47.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.926+0000 7fd1840e29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:09:47.930 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 zonegroup default 2024-09-19T14:09:47.930 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.930 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.930+0000 7fd1840e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:47.930 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.930+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.930 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.930+0000 7fd1840e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:47.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.930+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.930+0000 7fd1840e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:47.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.930+0000 7fd1840e29c0 20 started sync module instance, tier type = 2024-09-19T14:09:47.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.930+0000 7fd1840e29c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:09:47.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.950+0000 7fd1840e29c0 20 add_watcher() i=0 2024-09-19T14:09:47.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.950+0000 7fd1840e29c0 20 add_watcher() i=1 2024-09-19T14:09:47.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.950+0000 7fd1840e29c0 20 add_watcher() i=2 2024-09-19T14:09:47.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.950+0000 7fd1840e29c0 20 add_watcher() i=3 2024-09-19T14:09:47.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.950+0000 7fd1840e29c0 20 add_watcher() i=4 2024-09-19T14:09:47.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.950+0000 7fd1840e29c0 20 add_watcher() i=5 2024-09-19T14:09:47.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.950+0000 7fd1840e29c0 20 add_watcher() i=6 2024-09-19T14:09:47.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.954+0000 7fd1840e29c0 20 add_watcher() i=7 2024-09-19T14:09:47.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.954+0000 7fd1840e29c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:09:47.957 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.958+0000 7fd0337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:47.958 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.958+0000 7fd1840e29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:09:47.959 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.958+0000 7fd1840e29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:09:47.959 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 note: GC not initialized 2024-09-19T14:09:47.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.958+0000 7fd0327fc640 20 reqs_thread_entry: start 2024-09-19T14:09:47.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.958+0000 7fd1840e29c0 20 init_complete bucket index max shards: 11 2024-09-19T14:09:47.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.958+0000 7fd1840e29c0 20 Filter name: none 2024-09-19T14:09:47.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.958+0000 7fcfa3fff640 20 reqs_thread_entry: start 2024-09-19T14:09:47.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.958+0000 7fd1840e29c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-19T14:09:47.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.958+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.958+0000 7fd1840e29c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:09:47.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.958+0000 7fd1840e29c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-19T14:09:47.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.958+0000 7fd1840e29c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-19T14:09:47.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.958+0000 7fd1840e29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 : miss 2024-09-19T14:09:47.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.958+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:47.962 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.962+0000 7fd1840e29c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:09:47.962 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.962+0000 7fd1840e29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 info.flags=0x17 2024-09-19T14:09:47.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.962+0000 7fd1840e29c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 to cache LRU end 2024-09-19T14:09:47.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.962+0000 7fd1840e29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:09:47.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.962+0000 7fd1840e29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:47.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.962+0000 7fd1840e29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 2024-09-19T14:09:47.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.970+0000 7fd1840e29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 info.flags=0x17 2024-09-19T14:09:47.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.970+0000 7fd1840e29c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 to cache LRU end 2024-09-19T14:09:47.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.970+0000 7fd1840e29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:47.972 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.970+0000 7fd1840e29c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34, ofs0, ns] 2024-09-19T14:09:47.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.970+0000 7fd0657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333501 cookie 94730702858816 notifier 7031 bl.length()=911 2024-09-19T14:09:47.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.970+0000 7fd0657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 info.flags=0x17 2024-09-19T14:09:47.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.970+0000 7fd0657fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 to cache LRU end 2024-09-19T14:09:47.973 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.970+0000 7fd0657fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:47.977 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.978+0000 7fd1840e29c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.34]): orig_sources= new_sources= 2024-09-19T14:09:47.977 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.978+0000 7fd1840e29c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.34]): potential sources added=[] removed=[] 2024-09-19T14:09:47.977 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.978+0000 7fd1840e29c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.34]): orig_dests= new_dests= 2024-09-19T14:09:47.977 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.978+0000 7fd1840e29c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.34]): potential dests added=[] removed=[] 2024-09-19T14:09:47.986 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd1840e29c0 time 2024-09-19T14:09:47.988509+0000 2024-09-19T14:09:47.986 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:09:47.987 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:09:47.987 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd1879bc2eb] 2024-09-19T14:09:47.987 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd1879bc49f] 2024-09-19T14:09:47.987 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562833833271] 2024-09-19T14:09:47.987 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56283384314a] 2024-09-19T14:09:47.987 INFO:tasks.workunit.client.0.smithi153.stderr: 5: main() 2024-09-19T14:09:47.987 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd186822d90] 2024-09-19T14:09:47.987 INFO:tasks.workunit.client.0.smithi153.stderr: 7: __libc_start_main() 2024-09-19T14:09:47.987 INFO:tasks.workunit.client.0.smithi153.stderr: 8: _start() 2024-09-19T14:09:47.987 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.986+0000 7fd1840e29c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd1840e29c0 time 2024-09-19T14:09:47.988509+0000 2024-09-19T14:09:47.988 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:09:47.988 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:47.988 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:09:47.988 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd1879bc2eb] 2024-09-19T14:09:47.988 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd1879bc49f] 2024-09-19T14:09:47.988 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562833833271] 2024-09-19T14:09:47.988 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56283384314a] 2024-09-19T14:09:47.988 INFO:tasks.workunit.client.0.smithi153.stderr: 5: main() 2024-09-19T14:09:47.988 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd186822d90] 2024-09-19T14:09:47.989 INFO:tasks.workunit.client.0.smithi153.stderr: 7: __libc_start_main() 2024-09-19T14:09:47.989 INFO:tasks.workunit.client.0.smithi153.stderr: 8: _start() 2024-09-19T14:09:47.989 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:47.989 INFO:tasks.workunit.client.0.smithi153.stderr:*** Caught signal (Aborted) ** 2024-09-19T14:09:47.989 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7fd1840e29c0 thread_name:radosgw-admin 2024-09-19T14:09:48.000 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:09:48.000 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd18683b520] 2024-09-19T14:09:48.000 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:09:48.000 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:09:48.000 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:09:48.000 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd1879bc345] 2024-09-19T14:09:48.001 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd1879bc49f] 2024-09-19T14:09:48.001 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562833833271] 2024-09-19T14:09:48.001 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56283384314a] 2024-09-19T14:09:48.001 INFO:tasks.workunit.client.0.smithi153.stderr: 9: main() 2024-09-19T14:09:48.001 INFO:tasks.workunit.client.0.smithi153.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd186822d90] 2024-09-19T14:09:48.001 INFO:tasks.workunit.client.0.smithi153.stderr: 11: __libc_start_main() 2024-09-19T14:09:48.001 INFO:tasks.workunit.client.0.smithi153.stderr: 12: _start() 2024-09-19T14:09:48.001 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:47.986+0000 7fd1840e29c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:09:48.001 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7fd1840e29c0 thread_name:radosgw-admin 2024-09-19T14:09:48.001 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.001 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:09:48.001 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd18683b520] 2024-09-19T14:09:48.001 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:09:48.002 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:09:48.002 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:09:48.002 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd1879bc345] 2024-09-19T14:09:48.002 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd1879bc49f] 2024-09-19T14:09:48.002 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562833833271] 2024-09-19T14:09:48.002 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56283384314a] 2024-09-19T14:09:48.002 INFO:tasks.workunit.client.0.smithi153.stderr: 9: main() 2024-09-19T14:09:48.002 INFO:tasks.workunit.client.0.smithi153.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd186822d90] 2024-09-19T14:09:48.002 INFO:tasks.workunit.client.0.smithi153.stderr: 11: __libc_start_main() 2024-09-19T14:09:48.002 INFO:tasks.workunit.client.0.smithi153.stderr: 12: _start() 2024-09-19T14:09:48.002 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:09:48.002 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.002 INFO:tasks.workunit.client.0.smithi153.stderr:--- begin dump of recent events --- 2024-09-19T14:09:48.003 INFO:tasks.workunit.client.0.smithi153.stderr: -499> 2024-09-19T14:09:47.666+0000 7fd06fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:48.003 INFO:tasks.workunit.client.0.smithi153.stderr: -498> 2024-09-19T14:09:47.666+0000 7fd06fe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:09:48.003 INFO:tasks.workunit.client.0.smithi153.stderr: -497> 2024-09-19T14:09:47.666+0000 7fd06fe07640 10 monclient: dump: 2024-09-19T14:09:48.003 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:48.003 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:48.003 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.003 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.003 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:48.003 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.003 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:48.003 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:48.003 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:48.003 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.003 INFO:tasks.workunit.client.0.smithi153.stderr: -496> 2024-09-19T14:09:47.666+0000 7fd1840e29c0 5 monclient: authenticate success, global_id 7019 2024-09-19T14:09:48.004 INFO:tasks.workunit.client.0.smithi153.stderr: -495> 2024-09-19T14:09:47.666+0000 7fd1840e29c0 10 monclient: get_monmap_and_config success 2024-09-19T14:09:48.004 INFO:tasks.workunit.client.0.smithi153.stderr: -494> 2024-09-19T14:09:47.666+0000 7fd1840e29c0 4 set_mon_vals no callback set 2024-09-19T14:09:48.004 INFO:tasks.workunit.client.0.smithi153.stderr: -493> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient: shutdown 2024-09-19T14:09:48.004 INFO:tasks.workunit.client.0.smithi153.stderr: -492> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 asok(0x562835b49d90) unregister_commands rotate-key 2024-09-19T14:09:48.004 INFO:tasks.workunit.client.0.smithi153.stderr: -491> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient: build_initial_monmap 2024-09-19T14:09:48.004 INFO:tasks.workunit.client.0.smithi153.stderr: -490> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 1 build_initial for_mkfs: 0 2024-09-19T14:09:48.004 INFO:tasks.workunit.client.0.smithi153.stderr: -489> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient: monmap: 2024-09-19T14:09:48.004 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:09:48.004 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:09:48.004 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:09:48.004 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:09:48.004 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:09:48.004 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.004 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:09:48.005 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:09:48.005 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:09:48.005 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.005 INFO:tasks.workunit.client.0.smithi153.stderr: -488> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding auth protocol: cephx 2024-09-19T14:09:48.005 INFO:tasks.workunit.client.0.smithi153.stderr: -487> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding auth protocol: cephx 2024-09-19T14:09:48.005 INFO:tasks.workunit.client.0.smithi153.stderr: -486> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding auth protocol: cephx 2024-09-19T14:09:48.005 INFO:tasks.workunit.client.0.smithi153.stderr: -485> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding con mode: secure 2024-09-19T14:09:48.005 INFO:tasks.workunit.client.0.smithi153.stderr: -484> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding con mode: crc 2024-09-19T14:09:48.005 INFO:tasks.workunit.client.0.smithi153.stderr: -483> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding con mode: secure 2024-09-19T14:09:48.005 INFO:tasks.workunit.client.0.smithi153.stderr: -482> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding con mode: crc 2024-09-19T14:09:48.005 INFO:tasks.workunit.client.0.smithi153.stderr: -481> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding con mode: secure 2024-09-19T14:09:48.005 INFO:tasks.workunit.client.0.smithi153.stderr: -480> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding con mode: crc 2024-09-19T14:09:48.005 INFO:tasks.workunit.client.0.smithi153.stderr: -479> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding con mode: crc 2024-09-19T14:09:48.005 INFO:tasks.workunit.client.0.smithi153.stderr: -478> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding con mode: secure 2024-09-19T14:09:48.006 INFO:tasks.workunit.client.0.smithi153.stderr: -477> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding con mode: crc 2024-09-19T14:09:48.006 INFO:tasks.workunit.client.0.smithi153.stderr: -476> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding con mode: secure 2024-09-19T14:09:48.006 INFO:tasks.workunit.client.0.smithi153.stderr: -475> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding con mode: crc 2024-09-19T14:09:48.006 INFO:tasks.workunit.client.0.smithi153.stderr: -474> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding con mode: secure 2024-09-19T14:09:48.006 INFO:tasks.workunit.client.0.smithi153.stderr: -473> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.006 INFO:tasks.workunit.client.0.smithi153.stderr: -472> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 1 librados: starting msgr at 2024-09-19T14:09:48.006 INFO:tasks.workunit.client.0.smithi153.stderr: -471> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 1 librados: starting objecter 2024-09-19T14:09:48.006 INFO:tasks.workunit.client.0.smithi153.stderr: -470> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command objecter_requests hook 0x562835d58250 2024-09-19T14:09:48.006 INFO:tasks.workunit.client.0.smithi153.stderr: -469> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 1 librados: setting wanted keys 2024-09-19T14:09:48.006 INFO:tasks.workunit.client.0.smithi153.stderr: -468> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 1 librados: calling monclient init 2024-09-19T14:09:48.006 INFO:tasks.workunit.client.0.smithi153.stderr: -467> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient: init 2024-09-19T14:09:48.006 INFO:tasks.workunit.client.0.smithi153.stderr: -466> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding auth protocol: cephx 2024-09-19T14:09:48.006 INFO:tasks.workunit.client.0.smithi153.stderr: -465> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding auth protocol: cephx 2024-09-19T14:09:48.006 INFO:tasks.workunit.client.0.smithi153.stderr: -464> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding auth protocol: cephx 2024-09-19T14:09:48.007 INFO:tasks.workunit.client.0.smithi153.stderr: -463> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding con mode: secure 2024-09-19T14:09:48.007 INFO:tasks.workunit.client.0.smithi153.stderr: -462> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding con mode: crc 2024-09-19T14:09:48.007 INFO:tasks.workunit.client.0.smithi153.stderr: -461> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding con mode: secure 2024-09-19T14:09:48.007 INFO:tasks.workunit.client.0.smithi153.stderr: -460> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding con mode: crc 2024-09-19T14:09:48.007 INFO:tasks.workunit.client.0.smithi153.stderr: -459> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding con mode: secure 2024-09-19T14:09:48.007 INFO:tasks.workunit.client.0.smithi153.stderr: -458> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding con mode: crc 2024-09-19T14:09:48.007 INFO:tasks.workunit.client.0.smithi153.stderr: -457> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding con mode: crc 2024-09-19T14:09:48.007 INFO:tasks.workunit.client.0.smithi153.stderr: -456> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding con mode: secure 2024-09-19T14:09:48.007 INFO:tasks.workunit.client.0.smithi153.stderr: -455> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding con mode: crc 2024-09-19T14:09:48.007 INFO:tasks.workunit.client.0.smithi153.stderr: -454> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding con mode: secure 2024-09-19T14:09:48.007 INFO:tasks.workunit.client.0.smithi153.stderr: -453> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding con mode: crc 2024-09-19T14:09:48.007 INFO:tasks.workunit.client.0.smithi153.stderr: -452> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding con mode: secure 2024-09-19T14:09:48.007 INFO:tasks.workunit.client.0.smithi153.stderr: -451> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.007 INFO:tasks.workunit.client.0.smithi153.stderr: -450> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.008 INFO:tasks.workunit.client.0.smithi153.stderr: -449> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command rotate-key hook 0x562835d54a38 2024-09-19T14:09:48.008 INFO:tasks.workunit.client.0.smithi153.stderr: -448> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient: _reopen_session rank -1 2024-09-19T14:09:48.008 INFO:tasks.workunit.client.0.smithi153.stderr: -447> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T14:09:48.008 INFO:tasks.workunit.client.0.smithi153.stderr: -446> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient(hunting): picked mon.noname-c con 0x562835be2410 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:09:48.008 INFO:tasks.workunit.client.0.smithi153.stderr: -445> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient(hunting): picked mon.noname-b con 0x562835d82c80 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:09:48.008 INFO:tasks.workunit.client.0.smithi153.stderr: -444> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient(hunting): picked mon.noname-a con 0x562835d92a40 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:09:48.008 INFO:tasks.workunit.client.0.smithi153.stderr: -443> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:48.008 INFO:tasks.workunit.client.0.smithi153.stderr: -442> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:48.008 INFO:tasks.workunit.client.0.smithi153.stderr: -441> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:48.008 INFO:tasks.workunit.client.0.smithi153.stderr: -440> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient(hunting): _renew_subs 2024-09-19T14:09:48.008 INFO:tasks.workunit.client.0.smithi153.stderr: -439> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient(hunting): authenticate will time out at 2776.134131s 2024-09-19T14:09:48.008 INFO:tasks.workunit.client.0.smithi153.stderr: -438> 2024-09-19T14:09:47.670+0000 7fd181be8640 10 monclient(hunting): get_auth_request con 0x562835be2410 auth_method 0 2024-09-19T14:09:48.008 INFO:tasks.workunit.client.0.smithi153.stderr: -437> 2024-09-19T14:09:47.670+0000 7fd181be8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:48.009 INFO:tasks.workunit.client.0.smithi153.stderr: -436> 2024-09-19T14:09:47.670+0000 7fd181be8640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:48.009 INFO:tasks.workunit.client.0.smithi153.stderr: -435> 2024-09-19T14:09:47.670+0000 7fd181be8640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:48.009 INFO:tasks.workunit.client.0.smithi153.stderr: -434> 2024-09-19T14:09:47.670+0000 7fd1823e9640 10 monclient(hunting): get_auth_request con 0x562835d92a40 auth_method 0 2024-09-19T14:09:48.009 INFO:tasks.workunit.client.0.smithi153.stderr: -433> 2024-09-19T14:09:47.670+0000 7fd1823e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:48.009 INFO:tasks.workunit.client.0.smithi153.stderr: -432> 2024-09-19T14:09:47.670+0000 7fd1823e9640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:48.009 INFO:tasks.workunit.client.0.smithi153.stderr: -431> 2024-09-19T14:09:47.670+0000 7fd1823e9640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:48.009 INFO:tasks.workunit.client.0.smithi153.stderr: -430> 2024-09-19T14:09:47.670+0000 7fd181be8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:48.009 INFO:tasks.workunit.client.0.smithi153.stderr: -429> 2024-09-19T14:09:47.670+0000 7fd181be8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:48.009 INFO:tasks.workunit.client.0.smithi153.stderr: -428> 2024-09-19T14:09:47.670+0000 7fd181be8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:48.009 INFO:tasks.workunit.client.0.smithi153.stderr: -427> 2024-09-19T14:09:47.670+0000 7fd1823e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:48.010 INFO:tasks.workunit.client.0.smithi153.stderr: -426> 2024-09-19T14:09:47.670+0000 7fd1823e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:48.010 INFO:tasks.workunit.client.0.smithi153.stderr: -425> 2024-09-19T14:09:47.670+0000 7fd1823e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:48.010 INFO:tasks.workunit.client.0.smithi153.stderr: -424> 2024-09-19T14:09:47.670+0000 7fd1813e7640 10 monclient(hunting): get_auth_request con 0x562835d82c80 auth_method 0 2024-09-19T14:09:48.010 INFO:tasks.workunit.client.0.smithi153.stderr: -423> 2024-09-19T14:09:47.670+0000 7fd1813e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:48.010 INFO:tasks.workunit.client.0.smithi153.stderr: -422> 2024-09-19T14:09:47.670+0000 7fd1813e7640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:48.010 INFO:tasks.workunit.client.0.smithi153.stderr: -421> 2024-09-19T14:09:47.670+0000 7fd1813e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:48.010 INFO:tasks.workunit.client.0.smithi153.stderr: -420> 2024-09-19T14:09:47.670+0000 7fd181be8640 10 monclient(hunting): handle_auth_done global_id 7022 payload 824 2024-09-19T14:09:48.010 INFO:tasks.workunit.client.0.smithi153.stderr: -419> 2024-09-19T14:09:47.670+0000 7fd181be8640 10 monclient: _finish_hunting 0 2024-09-19T14:09:48.011 INFO:tasks.workunit.client.0.smithi153.stderr: -418> 2024-09-19T14:09:47.670+0000 7fd181be8640 1 monclient: found mon.noname-c 2024-09-19T14:09:48.011 INFO:tasks.workunit.client.0.smithi153.stderr: -417> 2024-09-19T14:09:47.670+0000 7fd181be8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:09:48.011 INFO:tasks.workunit.client.0.smithi153.stderr: -416> 2024-09-19T14:09:47.670+0000 7fd06e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:48.011 INFO:tasks.workunit.client.0.smithi153.stderr: -415> 2024-09-19T14:09:47.670+0000 7fd06e604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:09:48.011 INFO:tasks.workunit.client.0.smithi153.stderr: -414> 2024-09-19T14:09:47.670+0000 7fd06e604640 10 monclient: dump: 2024-09-19T14:09:48.011 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:48.011 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:48.011 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.011 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.011 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:48.011 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.011 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:48.011 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:48.011 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:48.012 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.012 INFO:tasks.workunit.client.0.smithi153.stderr: -413> 2024-09-19T14:09:47.670+0000 7fd06e604640 10 monclient: _finish_auth 0 2024-09-19T14:09:48.012 INFO:tasks.workunit.client.0.smithi153.stderr: -412> 2024-09-19T14:09:47.670+0000 7fd06e604640 10 monclient: _check_auth_tickets 2024-09-19T14:09:48.012 INFO:tasks.workunit.client.0.smithi153.stderr: -411> 2024-09-19T14:09:47.670+0000 7fd06e604640 10 monclient: handle_config config(0 keys) 2024-09-19T14:09:48.012 INFO:tasks.workunit.client.0.smithi153.stderr: -410> 2024-09-19T14:09:47.670+0000 7fd06e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:48.012 INFO:tasks.workunit.client.0.smithi153.stderr: -409> 2024-09-19T14:09:47.670+0000 7fd06e604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:09:48.012 INFO:tasks.workunit.client.0.smithi153.stderr: -408> 2024-09-19T14:09:47.670+0000 7fd06e604640 10 monclient: dump: 2024-09-19T14:09:48.012 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:48.012 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:48.012 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.012 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.012 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:48.012 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.012 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:48.012 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:48.012 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:48.013 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.013 INFO:tasks.workunit.client.0.smithi153.stderr: -407> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 monclient: authenticate success, global_id 7022 2024-09-19T14:09:48.013 INFO:tasks.workunit.client.0.smithi153.stderr: -406> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient: _renew_subs 2024-09-19T14:09:48.013 INFO:tasks.workunit.client.0.smithi153.stderr: -405> 2024-09-19T14:09:47.670+0000 7fd06fe07640 4 set_mon_vals no callback set 2024-09-19T14:09:48.013 INFO:tasks.workunit.client.0.smithi153.stderr: -404> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:09:48.013 INFO:tasks.workunit.client.0.smithi153.stderr: -403> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient: _renew_subs 2024-09-19T14:09:48.013 INFO:tasks.workunit.client.0.smithi153.stderr: -402> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:09:48.013 INFO:tasks.workunit.client.0.smithi153.stderr: -401> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 1 librados: init done 2024-09-19T14:09:48.013 INFO:tasks.workunit.client.0.smithi153.stderr: -400> 2024-09-19T14:09:47.674+0000 7fd06e604640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:09:48.013 INFO:tasks.workunit.client.0.smithi153.stderr: -399> 2024-09-19T14:09:47.674+0000 7fd06e604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:09:48.013 INFO:tasks.workunit.client.0.smithi153.stderr: -398> 2024-09-19T14:09:47.674+0000 7fd06e604640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:09:48.013 INFO:tasks.workunit.client.0.smithi153.stderr: -397> 2024-09-19T14:09:47.674+0000 7fd1813e7640 10 monclient: get_auth_request con 0x7fd068071c10 auth_method 0 2024-09-19T14:09:48.013 INFO:tasks.workunit.client.0.smithi153.stderr: -396> 2024-09-19T14:09:47.674+0000 7fd1823e9640 10 monclient: get_auth_request con 0x562835d9ce10 auth_method 0 2024-09-19T14:09:48.013 INFO:tasks.workunit.client.0.smithi153.stderr: -395> 2024-09-19T14:09:47.674+0000 7fd181be8640 10 monclient: get_auth_request con 0x562835d9fff0 auth_method 0 2024-09-19T14:09:48.013 INFO:tasks.workunit.client.0.smithi153.stderr: -394> 2024-09-19T14:09:47.678+0000 7fd1813e7640 10 monclient: get_auth_request con 0x562835da3850 auth_method 0 2024-09-19T14:09:48.013 INFO:tasks.workunit.client.0.smithi153.stderr: -393> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient: build_initial_monmap 2024-09-19T14:09:48.014 INFO:tasks.workunit.client.0.smithi153.stderr: -392> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 1 build_initial for_mkfs: 0 2024-09-19T14:09:48.014 INFO:tasks.workunit.client.0.smithi153.stderr: -391> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient: monmap: 2024-09-19T14:09:48.014 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:09:48.014 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:09:48.014 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:09:48.014 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:09:48.014 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:09:48.014 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.014 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:09:48.014 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:09:48.014 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:09:48.014 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.014 INFO:tasks.workunit.client.0.smithi153.stderr: -390> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding auth protocol: cephx 2024-09-19T14:09:48.014 INFO:tasks.workunit.client.0.smithi153.stderr: -389> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding auth protocol: cephx 2024-09-19T14:09:48.015 INFO:tasks.workunit.client.0.smithi153.stderr: -388> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding auth protocol: cephx 2024-09-19T14:09:48.015 INFO:tasks.workunit.client.0.smithi153.stderr: -387> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding con mode: secure 2024-09-19T14:09:48.015 INFO:tasks.workunit.client.0.smithi153.stderr: -386> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding con mode: crc 2024-09-19T14:09:48.015 INFO:tasks.workunit.client.0.smithi153.stderr: -385> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding con mode: secure 2024-09-19T14:09:48.015 INFO:tasks.workunit.client.0.smithi153.stderr: -384> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding con mode: crc 2024-09-19T14:09:48.015 INFO:tasks.workunit.client.0.smithi153.stderr: -383> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding con mode: secure 2024-09-19T14:09:48.015 INFO:tasks.workunit.client.0.smithi153.stderr: -382> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding con mode: crc 2024-09-19T14:09:48.015 INFO:tasks.workunit.client.0.smithi153.stderr: -381> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding con mode: crc 2024-09-19T14:09:48.015 INFO:tasks.workunit.client.0.smithi153.stderr: -380> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding con mode: secure 2024-09-19T14:09:48.015 INFO:tasks.workunit.client.0.smithi153.stderr: -379> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding con mode: crc 2024-09-19T14:09:48.015 INFO:tasks.workunit.client.0.smithi153.stderr: -378> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding con mode: secure 2024-09-19T14:09:48.015 INFO:tasks.workunit.client.0.smithi153.stderr: -377> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding con mode: crc 2024-09-19T14:09:48.015 INFO:tasks.workunit.client.0.smithi153.stderr: -376> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding con mode: secure 2024-09-19T14:09:48.015 INFO:tasks.workunit.client.0.smithi153.stderr: -375> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.016 INFO:tasks.workunit.client.0.smithi153.stderr: -374> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command objecter_requests cmddesc objecter_requests hook 0x562835dacb80 EEXIST 2024-09-19T14:09:48.016 INFO:tasks.workunit.client.0.smithi153.stderr: -373> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient: init 2024-09-19T14:09:48.016 INFO:tasks.workunit.client.0.smithi153.stderr: -372> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding auth protocol: cephx 2024-09-19T14:09:48.016 INFO:tasks.workunit.client.0.smithi153.stderr: -371> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding auth protocol: cephx 2024-09-19T14:09:48.016 INFO:tasks.workunit.client.0.smithi153.stderr: -370> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding auth protocol: cephx 2024-09-19T14:09:48.016 INFO:tasks.workunit.client.0.smithi153.stderr: -369> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding con mode: secure 2024-09-19T14:09:48.016 INFO:tasks.workunit.client.0.smithi153.stderr: -368> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding con mode: crc 2024-09-19T14:09:48.016 INFO:tasks.workunit.client.0.smithi153.stderr: -367> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding con mode: secure 2024-09-19T14:09:48.016 INFO:tasks.workunit.client.0.smithi153.stderr: -366> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding con mode: crc 2024-09-19T14:09:48.016 INFO:tasks.workunit.client.0.smithi153.stderr: -365> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding con mode: secure 2024-09-19T14:09:48.016 INFO:tasks.workunit.client.0.smithi153.stderr: -364> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding con mode: crc 2024-09-19T14:09:48.016 INFO:tasks.workunit.client.0.smithi153.stderr: -363> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding con mode: crc 2024-09-19T14:09:48.016 INFO:tasks.workunit.client.0.smithi153.stderr: -362> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding con mode: secure 2024-09-19T14:09:48.017 INFO:tasks.workunit.client.0.smithi153.stderr: -361> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding con mode: crc 2024-09-19T14:09:48.017 INFO:tasks.workunit.client.0.smithi153.stderr: -360> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding con mode: secure 2024-09-19T14:09:48.017 INFO:tasks.workunit.client.0.smithi153.stderr: -359> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding con mode: crc 2024-09-19T14:09:48.017 INFO:tasks.workunit.client.0.smithi153.stderr: -358> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding con mode: secure 2024-09-19T14:09:48.017 INFO:tasks.workunit.client.0.smithi153.stderr: -357> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.017 INFO:tasks.workunit.client.0.smithi153.stderr: -356> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.017 INFO:tasks.workunit.client.0.smithi153.stderr: -355> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command rotate-key cmddesc rotate-key hook 0x562835da82b0 EEXIST 2024-09-19T14:09:48.017 INFO:tasks.workunit.client.0.smithi153.stderr: -354> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient: _reopen_session rank -1 2024-09-19T14:09:48.017 INFO:tasks.workunit.client.0.smithi153.stderr: -353> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T14:09:48.017 INFO:tasks.workunit.client.0.smithi153.stderr: -352> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient(hunting): picked mon.noname-c con 0x562835dd0d30 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:09:48.017 INFO:tasks.workunit.client.0.smithi153.stderr: -351> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient(hunting): picked mon.noname-a con 0x562835dd0660 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:09:48.017 INFO:tasks.workunit.client.0.smithi153.stderr: -350> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient(hunting): picked mon.noname-b con 0x562835dcf040 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:09:48.017 INFO:tasks.workunit.client.0.smithi153.stderr: -349> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:48.017 INFO:tasks.workunit.client.0.smithi153.stderr: -348> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:48.017 INFO:tasks.workunit.client.0.smithi153.stderr: -347> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:48.018 INFO:tasks.workunit.client.0.smithi153.stderr: -346> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient(hunting): _renew_subs 2024-09-19T14:09:48.018 INFO:tasks.workunit.client.0.smithi153.stderr: -345> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient(hunting): authenticate will time out at 2776.143899s 2024-09-19T14:09:48.018 INFO:tasks.workunit.client.0.smithi153.stderr: -344> 2024-09-19T14:09:47.682+0000 7fd1813e7640 10 monclient(hunting): get_auth_request con 0x562835dd0660 auth_method 0 2024-09-19T14:09:48.018 INFO:tasks.workunit.client.0.smithi153.stderr: -343> 2024-09-19T14:09:47.682+0000 7fd1813e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:48.018 INFO:tasks.workunit.client.0.smithi153.stderr: -342> 2024-09-19T14:09:47.682+0000 7fd1813e7640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:48.018 INFO:tasks.workunit.client.0.smithi153.stderr: -341> 2024-09-19T14:09:47.682+0000 7fd1813e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:48.018 INFO:tasks.workunit.client.0.smithi153.stderr: -340> 2024-09-19T14:09:47.682+0000 7fd181be8640 10 monclient(hunting): get_auth_request con 0x562835dd0d30 auth_method 0 2024-09-19T14:09:48.018 INFO:tasks.workunit.client.0.smithi153.stderr: -339> 2024-09-19T14:09:47.682+0000 7fd181be8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:48.018 INFO:tasks.workunit.client.0.smithi153.stderr: -338> 2024-09-19T14:09:47.682+0000 7fd181be8640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:48.018 INFO:tasks.workunit.client.0.smithi153.stderr: -337> 2024-09-19T14:09:47.682+0000 7fd181be8640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:48.018 INFO:tasks.workunit.client.0.smithi153.stderr: -336> 2024-09-19T14:09:47.682+0000 7fd1813e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:48.018 INFO:tasks.workunit.client.0.smithi153.stderr: -335> 2024-09-19T14:09:47.682+0000 7fd1813e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:48.018 INFO:tasks.workunit.client.0.smithi153.stderr: -334> 2024-09-19T14:09:47.682+0000 7fd1813e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:48.019 INFO:tasks.workunit.client.0.smithi153.stderr: -333> 2024-09-19T14:09:47.682+0000 7fd181be8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:48.019 INFO:tasks.workunit.client.0.smithi153.stderr: -332> 2024-09-19T14:09:47.682+0000 7fd181be8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:48.019 INFO:tasks.workunit.client.0.smithi153.stderr: -331> 2024-09-19T14:09:47.682+0000 7fd181be8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:48.019 INFO:tasks.workunit.client.0.smithi153.stderr: -330> 2024-09-19T14:09:47.682+0000 7fd1823e9640 10 monclient(hunting): get_auth_request con 0x562835dcf040 auth_method 0 2024-09-19T14:09:48.019 INFO:tasks.workunit.client.0.smithi153.stderr: -329> 2024-09-19T14:09:47.682+0000 7fd1823e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:48.019 INFO:tasks.workunit.client.0.smithi153.stderr: -328> 2024-09-19T14:09:47.682+0000 7fd1823e9640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:48.019 INFO:tasks.workunit.client.0.smithi153.stderr: -327> 2024-09-19T14:09:47.682+0000 7fd1823e9640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:48.019 INFO:tasks.workunit.client.0.smithi153.stderr: -326> 2024-09-19T14:09:47.682+0000 7fd1813e7640 10 monclient(hunting): handle_auth_done global_id 7491 payload 824 2024-09-19T14:09:48.019 INFO:tasks.workunit.client.0.smithi153.stderr: -325> 2024-09-19T14:09:47.682+0000 7fd1813e7640 10 monclient: _finish_hunting 0 2024-09-19T14:09:48.019 INFO:tasks.workunit.client.0.smithi153.stderr: -324> 2024-09-19T14:09:47.682+0000 7fd1813e7640 1 monclient: found mon.noname-a 2024-09-19T14:09:48.019 INFO:tasks.workunit.client.0.smithi153.stderr: -323> 2024-09-19T14:09:47.682+0000 7fd1813e7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:09:48.019 INFO:tasks.workunit.client.0.smithi153.stderr: -322> 2024-09-19T14:09:47.682+0000 7fd0677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:48.020 INFO:tasks.workunit.client.0.smithi153.stderr: -321> 2024-09-19T14:09:47.682+0000 7fd0677fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:09:48.020 INFO:tasks.workunit.client.0.smithi153.stderr: -320> 2024-09-19T14:09:47.682+0000 7fd0677fe640 10 monclient: dump: 2024-09-19T14:09:48.020 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:48.020 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:48.020 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.020 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.020 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:48.020 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.020 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:48.020 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:48.020 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:48.020 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.020 INFO:tasks.workunit.client.0.smithi153.stderr: -319> 2024-09-19T14:09:47.682+0000 7fd0677fe640 10 monclient: _finish_auth 0 2024-09-19T14:09:48.021 INFO:tasks.workunit.client.0.smithi153.stderr: -318> 2024-09-19T14:09:47.682+0000 7fd0677fe640 10 monclient: _check_auth_tickets 2024-09-19T14:09:48.021 INFO:tasks.workunit.client.0.smithi153.stderr: -317> 2024-09-19T14:09:47.682+0000 7fd0677fe640 10 monclient: handle_config config(0 keys) 2024-09-19T14:09:48.021 INFO:tasks.workunit.client.0.smithi153.stderr: -316> 2024-09-19T14:09:47.682+0000 7fd0677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:48.021 INFO:tasks.workunit.client.0.smithi153.stderr: -315> 2024-09-19T14:09:47.682+0000 7fd0677fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:09:48.021 INFO:tasks.workunit.client.0.smithi153.stderr: -314> 2024-09-19T14:09:47.682+0000 7fd0677fe640 10 monclient: dump: 2024-09-19T14:09:48.021 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:48.021 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:48.021 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.021 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.021 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:48.021 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.021 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:48.021 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:48.022 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:48.022 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.022 INFO:tasks.workunit.client.0.smithi153.stderr: -313> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 monclient: authenticate success, global_id 7491 2024-09-19T14:09:48.022 INFO:tasks.workunit.client.0.smithi153.stderr: -312> 2024-09-19T14:09:47.682+0000 7fd182bea640 4 set_mon_vals no callback set 2024-09-19T14:09:48.022 INFO:tasks.workunit.client.0.smithi153.stderr: -311> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 10 monclient: _renew_subs 2024-09-19T14:09:48.022 INFO:tasks.workunit.client.0.smithi153.stderr: -310> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:09:48.022 INFO:tasks.workunit.client.0.smithi153.stderr: -309> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 10 monclient: _renew_subs 2024-09-19T14:09:48.022 INFO:tasks.workunit.client.0.smithi153.stderr: -308> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:09:48.022 INFO:tasks.workunit.client.0.smithi153.stderr: -307> 2024-09-19T14:09:47.682+0000 7fd0677fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:09:48.022 INFO:tasks.workunit.client.0.smithi153.stderr: -306> 2024-09-19T14:09:47.682+0000 7fd0677fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:09:48.022 INFO:tasks.workunit.client.0.smithi153.stderr: -305> 2024-09-19T14:09:47.682+0000 7fd0677fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:09:48.022 INFO:tasks.workunit.client.0.smithi153.stderr: -304> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 10 monclient: get_monmap_and_config 2024-09-19T14:09:48.022 INFO:tasks.workunit.client.0.smithi153.stderr: -303> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 10 monclient: build_initial_monmap 2024-09-19T14:09:48.023 INFO:tasks.workunit.client.0.smithi153.stderr: -302> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 1 build_initial for_mkfs: 0 2024-09-19T14:09:48.023 INFO:tasks.workunit.client.0.smithi153.stderr: -301> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 10 monclient: monmap: 2024-09-19T14:09:48.023 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:09:48.023 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:09:48.023 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:09:48.023 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:09:48.023 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:09:48.023 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.023 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:09:48.023 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:09:48.023 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:09:48.023 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.023 INFO:tasks.workunit.client.0.smithi153.stderr: -300> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding auth protocol: cephx 2024-09-19T14:09:48.023 INFO:tasks.workunit.client.0.smithi153.stderr: -299> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding auth protocol: cephx 2024-09-19T14:09:48.024 INFO:tasks.workunit.client.0.smithi153.stderr: -298> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding auth protocol: cephx 2024-09-19T14:09:48.024 INFO:tasks.workunit.client.0.smithi153.stderr: -297> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding con mode: secure 2024-09-19T14:09:48.024 INFO:tasks.workunit.client.0.smithi153.stderr: -296> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding con mode: crc 2024-09-19T14:09:48.024 INFO:tasks.workunit.client.0.smithi153.stderr: -295> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding con mode: secure 2024-09-19T14:09:48.024 INFO:tasks.workunit.client.0.smithi153.stderr: -294> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding con mode: crc 2024-09-19T14:09:48.024 INFO:tasks.workunit.client.0.smithi153.stderr: -293> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding con mode: secure 2024-09-19T14:09:48.024 INFO:tasks.workunit.client.0.smithi153.stderr: -292> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding con mode: crc 2024-09-19T14:09:48.024 INFO:tasks.workunit.client.0.smithi153.stderr: -291> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding con mode: crc 2024-09-19T14:09:48.024 INFO:tasks.workunit.client.0.smithi153.stderr: -290> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding con mode: secure 2024-09-19T14:09:48.024 INFO:tasks.workunit.client.0.smithi153.stderr: -289> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding con mode: crc 2024-09-19T14:09:48.024 INFO:tasks.workunit.client.0.smithi153.stderr: -288> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding con mode: secure 2024-09-19T14:09:48.024 INFO:tasks.workunit.client.0.smithi153.stderr: -287> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding con mode: crc 2024-09-19T14:09:48.024 INFO:tasks.workunit.client.0.smithi153.stderr: -286> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding con mode: secure 2024-09-19T14:09:48.024 INFO:tasks.workunit.client.0.smithi153.stderr: -285> 2024-09-19T14:09:47.682+0000 7fd181be8640 10 monclient: get_auth_request con 0x7fd05c071b20 auth_method 0 2024-09-19T14:09:48.024 INFO:tasks.workunit.client.0.smithi153.stderr: -284> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.025 INFO:tasks.workunit.client.0.smithi153.stderr: -283> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 10 monclient: init 2024-09-19T14:09:48.025 INFO:tasks.workunit.client.0.smithi153.stderr: -282> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding auth protocol: cephx 2024-09-19T14:09:48.025 INFO:tasks.workunit.client.0.smithi153.stderr: -281> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding auth protocol: cephx 2024-09-19T14:09:48.025 INFO:tasks.workunit.client.0.smithi153.stderr: -280> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding auth protocol: cephx 2024-09-19T14:09:48.025 INFO:tasks.workunit.client.0.smithi153.stderr: -279> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding con mode: secure 2024-09-19T14:09:48.025 INFO:tasks.workunit.client.0.smithi153.stderr: -278> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding con mode: crc 2024-09-19T14:09:48.025 INFO:tasks.workunit.client.0.smithi153.stderr: -277> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding con mode: secure 2024-09-19T14:09:48.025 INFO:tasks.workunit.client.0.smithi153.stderr: -276> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding con mode: crc 2024-09-19T14:09:48.025 INFO:tasks.workunit.client.0.smithi153.stderr: -275> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding con mode: secure 2024-09-19T14:09:48.025 INFO:tasks.workunit.client.0.smithi153.stderr: -274> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding con mode: crc 2024-09-19T14:09:48.025 INFO:tasks.workunit.client.0.smithi153.stderr: -273> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding con mode: crc 2024-09-19T14:09:48.025 INFO:tasks.workunit.client.0.smithi153.stderr: -272> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding con mode: secure 2024-09-19T14:09:48.025 INFO:tasks.workunit.client.0.smithi153.stderr: -271> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding con mode: crc 2024-09-19T14:09:48.025 INFO:tasks.workunit.client.0.smithi153.stderr: -270> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding con mode: secure 2024-09-19T14:09:48.025 INFO:tasks.workunit.client.0.smithi153.stderr: -269> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding con mode: crc 2024-09-19T14:09:48.025 INFO:tasks.workunit.client.0.smithi153.stderr: -268> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding con mode: secure 2024-09-19T14:09:48.026 INFO:tasks.workunit.client.0.smithi153.stderr: -267> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.026 INFO:tasks.workunit.client.0.smithi153.stderr: -266> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.026 INFO:tasks.workunit.client.0.smithi153.stderr: -265> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command rotate-key cmddesc rotate-key hook 0x7ffcc3f18c78 EEXIST 2024-09-19T14:09:48.026 INFO:tasks.workunit.client.0.smithi153.stderr: -264> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: _reopen_session rank -1 2024-09-19T14:09:48.026 INFO:tasks.workunit.client.0.smithi153.stderr: -263> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T14:09:48.026 INFO:tasks.workunit.client.0.smithi153.stderr: -262> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): picked mon.noname-a con 0x562835e24bf0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:09:48.026 INFO:tasks.workunit.client.0.smithi153.stderr: -261> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): picked mon.noname-b con 0x562835e1ffe0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:09:48.026 INFO:tasks.workunit.client.0.smithi153.stderr: -260> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): picked mon.noname-c con 0x562835e16810 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:09:48.026 INFO:tasks.workunit.client.0.smithi153.stderr: -259> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:48.026 INFO:tasks.workunit.client.0.smithi153.stderr: -258> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:48.026 INFO:tasks.workunit.client.0.smithi153.stderr: -257> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:48.026 INFO:tasks.workunit.client.0.smithi153.stderr: -256> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): _renew_subs 2024-09-19T14:09:48.026 INFO:tasks.workunit.client.0.smithi153.stderr: -255> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): authenticate will time out at 2776.148304s 2024-09-19T14:09:48.026 INFO:tasks.workunit.client.0.smithi153.stderr: -254> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient(hunting): get_auth_request con 0x562835e24bf0 auth_method 0 2024-09-19T14:09:48.027 INFO:tasks.workunit.client.0.smithi153.stderr: -253> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:48.027 INFO:tasks.workunit.client.0.smithi153.stderr: -252> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:48.027 INFO:tasks.workunit.client.0.smithi153.stderr: -251> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:48.027 INFO:tasks.workunit.client.0.smithi153.stderr: -250> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): get_auth_request con 0x562835e16810 auth_method 0 2024-09-19T14:09:48.027 INFO:tasks.workunit.client.0.smithi153.stderr: -249> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:48.027 INFO:tasks.workunit.client.0.smithi153.stderr: -248> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:48.027 INFO:tasks.workunit.client.0.smithi153.stderr: -247> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:48.027 INFO:tasks.workunit.client.0.smithi153.stderr: -246> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:48.027 INFO:tasks.workunit.client.0.smithi153.stderr: -245> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:48.027 INFO:tasks.workunit.client.0.smithi153.stderr: -244> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:48.027 INFO:tasks.workunit.client.0.smithi153.stderr: -243> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:48.027 INFO:tasks.workunit.client.0.smithi153.stderr: -242> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:48.027 INFO:tasks.workunit.client.0.smithi153.stderr: -241> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:48.027 INFO:tasks.workunit.client.0.smithi153.stderr: -240> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient(hunting): get_auth_request con 0x562835e1ffe0 auth_method 0 2024-09-19T14:09:48.027 INFO:tasks.workunit.client.0.smithi153.stderr: -239> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:48.028 INFO:tasks.workunit.client.0.smithi153.stderr: -238> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:48.028 INFO:tasks.workunit.client.0.smithi153.stderr: -237> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:48.028 INFO:tasks.workunit.client.0.smithi153.stderr: -236> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient(hunting): handle_auth_done global_id 7494 payload 274 2024-09-19T14:09:48.028 INFO:tasks.workunit.client.0.smithi153.stderr: -235> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient: _finish_hunting 0 2024-09-19T14:09:48.028 INFO:tasks.workunit.client.0.smithi153.stderr: -234> 2024-09-19T14:09:47.686+0000 7fd181be8640 1 monclient: found mon.noname-a 2024-09-19T14:09:48.028 INFO:tasks.workunit.client.0.smithi153.stderr: -233> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:09:48.028 INFO:tasks.workunit.client.0.smithi153.stderr: -232> 2024-09-19T14:09:47.686+0000 7fd0657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:48.028 INFO:tasks.workunit.client.0.smithi153.stderr: -231> 2024-09-19T14:09:47.686+0000 7fd0657fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:09:48.028 INFO:tasks.workunit.client.0.smithi153.stderr: -230> 2024-09-19T14:09:47.686+0000 7fd0657fa640 10 monclient: dump: 2024-09-19T14:09:48.028 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:48.028 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:48.028 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.028 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.028 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:48.029 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.029 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:48.029 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:48.029 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:48.029 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.029 INFO:tasks.workunit.client.0.smithi153.stderr: -229> 2024-09-19T14:09:47.686+0000 7fd0657fa640 10 monclient: _finish_auth 0 2024-09-19T14:09:48.029 INFO:tasks.workunit.client.0.smithi153.stderr: -228> 2024-09-19T14:09:47.686+0000 7fd0657fa640 10 monclient: _check_auth_tickets 2024-09-19T14:09:48.029 INFO:tasks.workunit.client.0.smithi153.stderr: -227> 2024-09-19T14:09:47.686+0000 7fd0657fa640 10 monclient: handle_config config(0 keys) 2024-09-19T14:09:48.029 INFO:tasks.workunit.client.0.smithi153.stderr: -226> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 monclient: authenticate success, global_id 7494 2024-09-19T14:09:48.029 INFO:tasks.workunit.client.0.smithi153.stderr: -225> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: get_monmap_and_config success 2024-09-19T14:09:48.029 INFO:tasks.workunit.client.0.smithi153.stderr: -224> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 4 set_mon_vals no callback set 2024-09-19T14:09:48.029 INFO:tasks.workunit.client.0.smithi153.stderr: -223> 2024-09-19T14:09:47.686+0000 7fd0657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:48.030 INFO:tasks.workunit.client.0.smithi153.stderr: -222> 2024-09-19T14:09:47.686+0000 7fd0657fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:09:48.030 INFO:tasks.workunit.client.0.smithi153.stderr: -221> 2024-09-19T14:09:47.686+0000 7fd0657fa640 10 monclient: dump: 2024-09-19T14:09:48.030 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:48.030 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:48.030 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.030 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.030 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:48.030 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.030 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:48.030 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:48.030 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:48.030 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.030 INFO:tasks.workunit.client.0.smithi153.stderr: -220> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: shutdown 2024-09-19T14:09:48.030 INFO:tasks.workunit.client.0.smithi153.stderr: -219> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: build_initial_monmap 2024-09-19T14:09:48.031 INFO:tasks.workunit.client.0.smithi153.stderr: -218> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 1 build_initial for_mkfs: 0 2024-09-19T14:09:48.031 INFO:tasks.workunit.client.0.smithi153.stderr: -217> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: monmap: 2024-09-19T14:09:48.031 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:09:48.031 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:09:48.031 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:09:48.031 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:09:48.031 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:09:48.031 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.031 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:09:48.031 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:09:48.031 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:09:48.031 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.031 INFO:tasks.workunit.client.0.smithi153.stderr: -216> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding auth protocol: cephx 2024-09-19T14:09:48.031 INFO:tasks.workunit.client.0.smithi153.stderr: -215> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding auth protocol: cephx 2024-09-19T14:09:48.032 INFO:tasks.workunit.client.0.smithi153.stderr: -214> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding auth protocol: cephx 2024-09-19T14:09:48.032 INFO:tasks.workunit.client.0.smithi153.stderr: -213> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding con mode: secure 2024-09-19T14:09:48.032 INFO:tasks.workunit.client.0.smithi153.stderr: -212> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding con mode: crc 2024-09-19T14:09:48.032 INFO:tasks.workunit.client.0.smithi153.stderr: -211> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding con mode: secure 2024-09-19T14:09:48.032 INFO:tasks.workunit.client.0.smithi153.stderr: -210> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding con mode: crc 2024-09-19T14:09:48.032 INFO:tasks.workunit.client.0.smithi153.stderr: -209> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding con mode: secure 2024-09-19T14:09:48.032 INFO:tasks.workunit.client.0.smithi153.stderr: -208> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding con mode: crc 2024-09-19T14:09:48.032 INFO:tasks.workunit.client.0.smithi153.stderr: -207> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding con mode: crc 2024-09-19T14:09:48.032 INFO:tasks.workunit.client.0.smithi153.stderr: -206> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding con mode: secure 2024-09-19T14:09:48.032 INFO:tasks.workunit.client.0.smithi153.stderr: -205> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding con mode: crc 2024-09-19T14:09:48.032 INFO:tasks.workunit.client.0.smithi153.stderr: -204> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding con mode: secure 2024-09-19T14:09:48.032 INFO:tasks.workunit.client.0.smithi153.stderr: -203> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding con mode: crc 2024-09-19T14:09:48.032 INFO:tasks.workunit.client.0.smithi153.stderr: -202> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding con mode: secure 2024-09-19T14:09:48.033 INFO:tasks.workunit.client.0.smithi153.stderr: -201> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.033 INFO:tasks.workunit.client.0.smithi153.stderr: -200> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 1 librados: starting msgr at 2024-09-19T14:09:48.033 INFO:tasks.workunit.client.0.smithi153.stderr: -199> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 1 librados: starting objecter 2024-09-19T14:09:48.033 INFO:tasks.workunit.client.0.smithi153.stderr: -198> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command objecter_requests cmddesc objecter_requests hook 0x562835df4c20 EEXIST 2024-09-19T14:09:48.033 INFO:tasks.workunit.client.0.smithi153.stderr: -197> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 1 librados: setting wanted keys 2024-09-19T14:09:48.033 INFO:tasks.workunit.client.0.smithi153.stderr: -196> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 1 librados: calling monclient init 2024-09-19T14:09:48.033 INFO:tasks.workunit.client.0.smithi153.stderr: -195> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: init 2024-09-19T14:09:48.033 INFO:tasks.workunit.client.0.smithi153.stderr: -194> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding auth protocol: cephx 2024-09-19T14:09:48.033 INFO:tasks.workunit.client.0.smithi153.stderr: -193> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding auth protocol: cephx 2024-09-19T14:09:48.033 INFO:tasks.workunit.client.0.smithi153.stderr: -192> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding auth protocol: cephx 2024-09-19T14:09:48.033 INFO:tasks.workunit.client.0.smithi153.stderr: -191> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding con mode: secure 2024-09-19T14:09:48.033 INFO:tasks.workunit.client.0.smithi153.stderr: -190> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding con mode: crc 2024-09-19T14:09:48.033 INFO:tasks.workunit.client.0.smithi153.stderr: -189> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding con mode: secure 2024-09-19T14:09:48.033 INFO:tasks.workunit.client.0.smithi153.stderr: -188> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding con mode: crc 2024-09-19T14:09:48.034 INFO:tasks.workunit.client.0.smithi153.stderr: -187> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding con mode: secure 2024-09-19T14:09:48.034 INFO:tasks.workunit.client.0.smithi153.stderr: -186> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding con mode: crc 2024-09-19T14:09:48.034 INFO:tasks.workunit.client.0.smithi153.stderr: -185> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding con mode: crc 2024-09-19T14:09:48.034 INFO:tasks.workunit.client.0.smithi153.stderr: -184> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding con mode: secure 2024-09-19T14:09:48.034 INFO:tasks.workunit.client.0.smithi153.stderr: -183> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding con mode: crc 2024-09-19T14:09:48.034 INFO:tasks.workunit.client.0.smithi153.stderr: -182> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding con mode: secure 2024-09-19T14:09:48.034 INFO:tasks.workunit.client.0.smithi153.stderr: -181> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding con mode: crc 2024-09-19T14:09:48.034 INFO:tasks.workunit.client.0.smithi153.stderr: -180> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding con mode: secure 2024-09-19T14:09:48.034 INFO:tasks.workunit.client.0.smithi153.stderr: -179> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.034 INFO:tasks.workunit.client.0.smithi153.stderr: -178> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.034 INFO:tasks.workunit.client.0.smithi153.stderr: -177> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command rotate-key cmddesc rotate-key hook 0x562835dd2c98 EEXIST 2024-09-19T14:09:48.034 INFO:tasks.workunit.client.0.smithi153.stderr: -176> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: _reopen_session rank -1 2024-09-19T14:09:48.034 INFO:tasks.workunit.client.0.smithi153.stderr: -175> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T14:09:48.034 INFO:tasks.workunit.client.0.smithi153.stderr: -174> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): picked mon.noname-b con 0x562835e16810 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:09:48.035 INFO:tasks.workunit.client.0.smithi153.stderr: -173> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): picked mon.noname-c con 0x562835e1ffe0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:09:48.035 INFO:tasks.workunit.client.0.smithi153.stderr: -172> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): picked mon.noname-a con 0x562835e24bf0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:09:48.035 INFO:tasks.workunit.client.0.smithi153.stderr: -171> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:48.035 INFO:tasks.workunit.client.0.smithi153.stderr: -170> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:48.035 INFO:tasks.workunit.client.0.smithi153.stderr: -169> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:48.035 INFO:tasks.workunit.client.0.smithi153.stderr: -168> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): _renew_subs 2024-09-19T14:09:48.035 INFO:tasks.workunit.client.0.smithi153.stderr: -167> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): authenticate will time out at 2776.150862s 2024-09-19T14:09:48.035 INFO:tasks.workunit.client.0.smithi153.stderr: -166> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient(hunting): get_auth_request con 0x562835e1ffe0 auth_method 0 2024-09-19T14:09:48.035 INFO:tasks.workunit.client.0.smithi153.stderr: -165> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:48.035 INFO:tasks.workunit.client.0.smithi153.stderr: -164> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:48.035 INFO:tasks.workunit.client.0.smithi153.stderr: -163> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:48.035 INFO:tasks.workunit.client.0.smithi153.stderr: -162> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): get_auth_request con 0x562835e24bf0 auth_method 0 2024-09-19T14:09:48.035 INFO:tasks.workunit.client.0.smithi153.stderr: -161> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:48.035 INFO:tasks.workunit.client.0.smithi153.stderr: -160> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:48.035 INFO:tasks.workunit.client.0.smithi153.stderr: -159> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:48.035 INFO:tasks.workunit.client.0.smithi153.stderr: -158> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:48.036 INFO:tasks.workunit.client.0.smithi153.stderr: -157> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:48.036 INFO:tasks.workunit.client.0.smithi153.stderr: -156> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:48.036 INFO:tasks.workunit.client.0.smithi153.stderr: -155> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:48.036 INFO:tasks.workunit.client.0.smithi153.stderr: -154> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:48.036 INFO:tasks.workunit.client.0.smithi153.stderr: -153> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:48.036 INFO:tasks.workunit.client.0.smithi153.stderr: -152> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient(hunting): get_auth_request con 0x562835e16810 auth_method 0 2024-09-19T14:09:48.036 INFO:tasks.workunit.client.0.smithi153.stderr: -151> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:48.036 INFO:tasks.workunit.client.0.smithi153.stderr: -150> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:48.036 INFO:tasks.workunit.client.0.smithi153.stderr: -149> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:48.036 INFO:tasks.workunit.client.0.smithi153.stderr: -148> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient(hunting): handle_auth_done global_id 7031 payload 824 2024-09-19T14:09:48.036 INFO:tasks.workunit.client.0.smithi153.stderr: -147> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient: _finish_hunting 0 2024-09-19T14:09:48.036 INFO:tasks.workunit.client.0.smithi153.stderr: -146> 2024-09-19T14:09:47.686+0000 7fd1813e7640 1 monclient: found mon.noname-c 2024-09-19T14:09:48.037 INFO:tasks.workunit.client.0.smithi153.stderr: -145> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:09:48.037 INFO:tasks.workunit.client.0.smithi153.stderr: -144> 2024-09-19T14:09:47.686+0000 7fd0537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:48.037 INFO:tasks.workunit.client.0.smithi153.stderr: -143> 2024-09-19T14:09:47.686+0000 7fd0537fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:09:48.037 INFO:tasks.workunit.client.0.smithi153.stderr: -142> 2024-09-19T14:09:47.686+0000 7fd0537fe640 10 monclient: dump: 2024-09-19T14:09:48.037 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:48.037 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:48.037 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.037 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.037 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:48.037 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.037 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:48.037 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:48.037 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:48.038 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.038 INFO:tasks.workunit.client.0.smithi153.stderr: -141> 2024-09-19T14:09:47.686+0000 7fd0537fe640 10 monclient: _finish_auth 0 2024-09-19T14:09:48.038 INFO:tasks.workunit.client.0.smithi153.stderr: -140> 2024-09-19T14:09:47.686+0000 7fd0537fe640 10 monclient: _check_auth_tickets 2024-09-19T14:09:48.038 INFO:tasks.workunit.client.0.smithi153.stderr: -139> 2024-09-19T14:09:47.686+0000 7fd0537fe640 10 monclient: handle_config config(0 keys) 2024-09-19T14:09:48.038 INFO:tasks.workunit.client.0.smithi153.stderr: -138> 2024-09-19T14:09:47.686+0000 7fd0537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:48.038 INFO:tasks.workunit.client.0.smithi153.stderr: -137> 2024-09-19T14:09:47.686+0000 7fd0537fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:09:48.038 INFO:tasks.workunit.client.0.smithi153.stderr: -136> 2024-09-19T14:09:47.686+0000 7fd0537fe640 10 monclient: dump: 2024-09-19T14:09:48.038 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:48.038 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:48.038 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.038 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.038 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:48.038 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.039 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:48.039 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:48.039 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:48.039 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.039 INFO:tasks.workunit.client.0.smithi153.stderr: -135> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 monclient: authenticate success, global_id 7031 2024-09-19T14:09:48.039 INFO:tasks.workunit.client.0.smithi153.stderr: -134> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: _renew_subs 2024-09-19T14:09:48.039 INFO:tasks.workunit.client.0.smithi153.stderr: -133> 2024-09-19T14:09:47.686+0000 7fd0657fa640 4 set_mon_vals no callback set 2024-09-19T14:09:48.039 INFO:tasks.workunit.client.0.smithi153.stderr: -132> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:09:48.039 INFO:tasks.workunit.client.0.smithi153.stderr: -131> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: _renew_subs 2024-09-19T14:09:48.039 INFO:tasks.workunit.client.0.smithi153.stderr: -130> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:09:48.040 INFO:tasks.workunit.client.0.smithi153.stderr: -129> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 1 librados: init done 2024-09-19T14:09:48.040 INFO:tasks.workunit.client.0.smithi153.stderr: -128> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command cr dump hook 0x562835e1f2c8 2024-09-19T14:09:48.040 INFO:tasks.workunit.client.0.smithi153.stderr: -127> 2024-09-19T14:09:47.690+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.040 INFO:tasks.workunit.client.0.smithi153.stderr: -126> 2024-09-19T14:09:47.690+0000 7fd0537fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:09:48.040 INFO:tasks.workunit.client.0.smithi153.stderr: -125> 2024-09-19T14:09:47.690+0000 7fd0537fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:09:48.040 INFO:tasks.workunit.client.0.smithi153.stderr: -124> 2024-09-19T14:09:47.690+0000 7fd0537fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:09:48.040 INFO:tasks.workunit.client.0.smithi153.stderr: -123> 2024-09-19T14:09:47.690+0000 7fd181be8640 10 monclient: get_auth_request con 0x7fd04c071c10 auth_method 0 2024-09-19T14:09:48.040 INFO:tasks.workunit.client.0.smithi153.stderr: -122> 2024-09-19T14:09:47.690+0000 7fd1823e9640 10 monclient: get_auth_request con 0x562835e3e3e0 auth_method 0 2024-09-19T14:09:48.040 INFO:tasks.workunit.client.0.smithi153.stderr: -121> 2024-09-19T14:09:47.690+0000 7fd1840e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.040 INFO:tasks.workunit.client.0.smithi153.stderr: -120> 2024-09-19T14:09:47.690+0000 7fd1840e29c0 20 realm 2024-09-19T14:09:48.040 INFO:tasks.workunit.client.0.smithi153.stderr: -119> 2024-09-19T14:09:47.690+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.040 INFO:tasks.workunit.client.0.smithi153.stderr: -118> 2024-09-19T14:09:47.690+0000 7fd1840e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.040 INFO:tasks.workunit.client.0.smithi153.stderr: -117> 2024-09-19T14:09:47.690+0000 7fd1840e29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:09:48.040 INFO:tasks.workunit.client.0.smithi153.stderr: -116> 2024-09-19T14:09:47.690+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.041 INFO:tasks.workunit.client.0.smithi153.stderr: -115> 2024-09-19T14:09:47.690+0000 7fd1840e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.041 INFO:tasks.workunit.client.0.smithi153.stderr: -114> 2024-09-19T14:09:47.690+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.041 INFO:tasks.workunit.client.0.smithi153.stderr: -113> 2024-09-19T14:09:47.690+0000 7fd181be8640 10 monclient: get_auth_request con 0x562835e42530 auth_method 0 2024-09-19T14:09:48.041 INFO:tasks.workunit.client.0.smithi153.stderr: -112> 2024-09-19T14:09:47.694+0000 7fd1840e29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:48.041 INFO:tasks.workunit.client.0.smithi153.stderr: -111> 2024-09-19T14:09:47.694+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.041 INFO:tasks.workunit.client.0.smithi153.stderr: -110> 2024-09-19T14:09:47.694+0000 7fd1840e29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:09:48.041 INFO:tasks.workunit.client.0.smithi153.stderr: -109> 2024-09-19T14:09:47.694+0000 7fd1840e29c0 20 searching for the correct realm 2024-09-19T14:09:48.041 INFO:tasks.workunit.client.0.smithi153.stderr: -108> 2024-09-19T14:09:47.694+0000 7fd1813e7640 10 monclient: get_auth_request con 0x562835e47740 auth_method 0 2024-09-19T14:09:48.041 INFO:tasks.workunit.client.0.smithi153.stderr: -107> 2024-09-19T14:09:47.694+0000 7fd1823e9640 10 monclient: get_auth_request con 0x7fd17801a040 auth_method 0 2024-09-19T14:09:48.041 INFO:tasks.workunit.client.0.smithi153.stderr: -106> 2024-09-19T14:09:47.694+0000 7fd181be8640 10 monclient: get_auth_request con 0x7fd17c0c6920 auth_method 0 2024-09-19T14:09:48.041 INFO:tasks.workunit.client.0.smithi153.stderr: -105> 2024-09-19T14:09:47.698+0000 7fd1813e7640 10 monclient: get_auth_request con 0x7fd17405c3f0 auth_method 0 2024-09-19T14:09:48.041 INFO:tasks.workunit.client.0.smithi153.stderr: -104> 2024-09-19T14:09:47.698+0000 7fd1813e7640 0 -- 172.21.15.153:0/4029659940 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fd17405c3f0 msgr2=0x7fd17405ea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:48.041 INFO:tasks.workunit.client.0.smithi153.stderr: -103> 2024-09-19T14:09:47.698+0000 7fd0537fe640 1 client.7031.objecter ms_handle_reset 0x7fd17405c3f0 session 0x7fd174059070 osd.4 2024-09-19T14:09:48.042 INFO:tasks.workunit.client.0.smithi153.stderr: -102> 2024-09-19T14:09:47.698+0000 7fd0537fe640 10 monclient: _renew_subs 2024-09-19T14:09:48.042 INFO:tasks.workunit.client.0.smithi153.stderr: -101> 2024-09-19T14:09:47.698+0000 7fd0537fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:09:48.042 INFO:tasks.workunit.client.0.smithi153.stderr: -100> 2024-09-19T14:09:47.698+0000 7fd1813e7640 10 monclient: get_auth_request con 0x7fd04c082340 auth_method 0 2024-09-19T14:09:48.042 INFO:tasks.workunit.client.0.smithi153.stderr: -99> 2024-09-19T14:09:47.702+0000 7fd1823e9640 10 monclient: get_auth_request con 0x562835c9afd0 auth_method 0 2024-09-19T14:09:48.042 INFO:tasks.workunit.client.0.smithi153.stderr: -98> 2024-09-19T14:09:47.706+0000 7fd181be8640 10 monclient: get_auth_request con 0x7fd1780a2330 auth_method 0 2024-09-19T14:09:48.042 INFO:tasks.workunit.client.0.smithi153.stderr: -97> 2024-09-19T14:09:47.706+0000 7fd181be8640 0 -- 172.21.15.153:0/4029659940 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fd1780a2330 msgr2=0x7fd178002860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:48.042 INFO:tasks.workunit.client.0.smithi153.stderr: -96> 2024-09-19T14:09:47.910+0000 7fd181be8640 10 monclient: get_auth_request con 0x7fd1780a2330 auth_method 0 2024-09-19T14:09:48.042 INFO:tasks.workunit.client.0.smithi153.stderr: -95> 2024-09-19T14:09:47.914+0000 7fd0537fe640 1 client.7031.objecter ms_handle_reset 0x562835e42530 session 0x562835e41eb0 osd.5 2024-09-19T14:09:48.042 INFO:tasks.workunit.client.0.smithi153.stderr: -94> 2024-09-19T14:09:47.914+0000 7fd181be8640 10 monclient: get_auth_request con 0x7fd17405c3f0 auth_method 0 2024-09-19T14:09:48.042 INFO:tasks.workunit.client.0.smithi153.stderr: -93> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:09:48.042 INFO:tasks.workunit.client.0.smithi153.stderr: -92> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:09:48.042 INFO:tasks.workunit.client.0.smithi153.stderr: -91> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:09:48.042 INFO:tasks.workunit.client.0.smithi153.stderr: -90> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:09:48.042 INFO:tasks.workunit.client.0.smithi153.stderr: -89> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:09:48.043 INFO:tasks.workunit.client.0.smithi153.stderr: -88> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:09:48.043 INFO:tasks.workunit.client.0.smithi153.stderr: -87> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.043 INFO:tasks.workunit.client.0.smithi153.stderr: -86> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.043 INFO:tasks.workunit.client.0.smithi153.stderr: -85> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.043 INFO:tasks.workunit.client.0.smithi153.stderr: -84> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:48.043 INFO:tasks.workunit.client.0.smithi153.stderr: -83> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.043 INFO:tasks.workunit.client.0.smithi153.stderr: -82> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:09:48.043 INFO:tasks.workunit.client.0.smithi153.stderr: -81> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 zone default found 2024-09-19T14:09:48.043 INFO:tasks.workunit.client.0.smithi153.stderr: -80> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 4 Realm: () 2024-09-19T14:09:48.043 INFO:tasks.workunit.client.0.smithi153.stderr: -79> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:09:48.043 INFO:tasks.workunit.client.0.smithi153.stderr: -78> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:09:48.043 INFO:tasks.workunit.client.0.smithi153.stderr: -77> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:09:48.043 INFO:tasks.workunit.client.0.smithi153.stderr: -76> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 zonegroup default 2024-09-19T14:09:48.044 INFO:tasks.workunit.client.0.smithi153.stderr: -75> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.044 INFO:tasks.workunit.client.0.smithi153.stderr: -74> 2024-09-19T14:09:47.930+0000 7fd1840e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.044 INFO:tasks.workunit.client.0.smithi153.stderr: -73> 2024-09-19T14:09:47.930+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.044 INFO:tasks.workunit.client.0.smithi153.stderr: -72> 2024-09-19T14:09:47.930+0000 7fd1840e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.044 INFO:tasks.workunit.client.0.smithi153.stderr: -71> 2024-09-19T14:09:47.930+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.044 INFO:tasks.workunit.client.0.smithi153.stderr: -70> 2024-09-19T14:09:47.930+0000 7fd1840e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.044 INFO:tasks.workunit.client.0.smithi153.stderr: -69> 2024-09-19T14:09:47.930+0000 7fd1840e29c0 20 started sync module instance, tier type = 2024-09-19T14:09:48.044 INFO:tasks.workunit.client.0.smithi153.stderr: -68> 2024-09-19T14:09:47.930+0000 7fd1840e29c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:09:48.044 INFO:tasks.workunit.client.0.smithi153.stderr: -67> 2024-09-19T14:09:47.950+0000 7fd1840e29c0 20 add_watcher() i=0 2024-09-19T14:09:48.044 INFO:tasks.workunit.client.0.smithi153.stderr: -66> 2024-09-19T14:09:47.950+0000 7fd1840e29c0 20 add_watcher() i=1 2024-09-19T14:09:48.044 INFO:tasks.workunit.client.0.smithi153.stderr: -65> 2024-09-19T14:09:47.950+0000 7fd1840e29c0 20 add_watcher() i=2 2024-09-19T14:09:48.044 INFO:tasks.workunit.client.0.smithi153.stderr: -64> 2024-09-19T14:09:47.950+0000 7fd1840e29c0 20 add_watcher() i=3 2024-09-19T14:09:48.044 INFO:tasks.workunit.client.0.smithi153.stderr: -63> 2024-09-19T14:09:47.950+0000 7fd1840e29c0 20 add_watcher() i=4 2024-09-19T14:09:48.045 INFO:tasks.workunit.client.0.smithi153.stderr: -62> 2024-09-19T14:09:47.950+0000 7fd1840e29c0 20 add_watcher() i=5 2024-09-19T14:09:48.045 INFO:tasks.workunit.client.0.smithi153.stderr: -61> 2024-09-19T14:09:47.950+0000 7fd1840e29c0 20 add_watcher() i=6 2024-09-19T14:09:48.045 INFO:tasks.workunit.client.0.smithi153.stderr: -60> 2024-09-19T14:09:47.954+0000 7fd1840e29c0 20 add_watcher() i=7 2024-09-19T14:09:48.045 INFO:tasks.workunit.client.0.smithi153.stderr: -59> 2024-09-19T14:09:47.954+0000 7fd1840e29c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:09:48.045 INFO:tasks.workunit.client.0.smithi153.stderr: -58> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding auth protocol: cephx 2024-09-19T14:09:48.045 INFO:tasks.workunit.client.0.smithi153.stderr: -57> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding auth protocol: cephx 2024-09-19T14:09:48.045 INFO:tasks.workunit.client.0.smithi153.stderr: -56> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding auth protocol: cephx 2024-09-19T14:09:48.045 INFO:tasks.workunit.client.0.smithi153.stderr: -55> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding con mode: secure 2024-09-19T14:09:48.045 INFO:tasks.workunit.client.0.smithi153.stderr: -54> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding con mode: crc 2024-09-19T14:09:48.045 INFO:tasks.workunit.client.0.smithi153.stderr: -53> 2024-09-19T14:09:47.958+0000 7fd0337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:48.045 INFO:tasks.workunit.client.0.smithi153.stderr: -52> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding con mode: secure 2024-09-19T14:09:48.045 INFO:tasks.workunit.client.0.smithi153.stderr: -51> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding con mode: crc 2024-09-19T14:09:48.045 INFO:tasks.workunit.client.0.smithi153.stderr: -50> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding con mode: secure 2024-09-19T14:09:48.046 INFO:tasks.workunit.client.0.smithi153.stderr: -49> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding con mode: crc 2024-09-19T14:09:48.046 INFO:tasks.workunit.client.0.smithi153.stderr: -48> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding con mode: crc 2024-09-19T14:09:48.046 INFO:tasks.workunit.client.0.smithi153.stderr: -47> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding con mode: secure 2024-09-19T14:09:48.046 INFO:tasks.workunit.client.0.smithi153.stderr: -46> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding con mode: crc 2024-09-19T14:09:48.046 INFO:tasks.workunit.client.0.smithi153.stderr: -45> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding con mode: secure 2024-09-19T14:09:48.046 INFO:tasks.workunit.client.0.smithi153.stderr: -44> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding con mode: crc 2024-09-19T14:09:48.046 INFO:tasks.workunit.client.0.smithi153.stderr: -43> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding con mode: secure 2024-09-19T14:09:48.046 INFO:tasks.workunit.client.0.smithi153.stderr: -42> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.046 INFO:tasks.workunit.client.0.smithi153.stderr: -41> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:09:48.046 INFO:tasks.workunit.client.0.smithi153.stderr: -40> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:09:48.046 INFO:tasks.workunit.client.0.smithi153.stderr: -39> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command cache list hook 0x562835e1e250 2024-09-19T14:09:48.046 INFO:tasks.workunit.client.0.smithi153.stderr: -38> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command cache inspect hook 0x562835e1e250 2024-09-19T14:09:48.046 INFO:tasks.workunit.client.0.smithi153.stderr: -37> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command cache erase hook 0x562835e1e250 2024-09-19T14:09:48.046 INFO:tasks.workunit.client.0.smithi153.stderr: -36> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command cache zap hook 0x562835e1e250 2024-09-19T14:09:48.047 INFO:tasks.workunit.client.0.smithi153.stderr: -35> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 note: GC not initialized 2024-09-19T14:09:48.047 INFO:tasks.workunit.client.0.smithi153.stderr: -34> 2024-09-19T14:09:47.958+0000 7fd0327fc640 20 reqs_thread_entry: start 2024-09-19T14:09:48.047 INFO:tasks.workunit.client.0.smithi153.stderr: -33> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command sync trace show hook 0x7fd1740043b0 2024-09-19T14:09:48.047 INFO:tasks.workunit.client.0.smithi153.stderr: -32> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command sync trace history hook 0x7fd1740043b0 2024-09-19T14:09:48.047 INFO:tasks.workunit.client.0.smithi153.stderr: -31> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command sync trace active hook 0x7fd1740043b0 2024-09-19T14:09:48.047 INFO:tasks.workunit.client.0.smithi153.stderr: -30> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command sync trace active_short hook 0x7fd1740043b0 2024-09-19T14:09:48.047 INFO:tasks.workunit.client.0.smithi153.stderr: -29> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 20 init_complete bucket index max shards: 11 2024-09-19T14:09:48.047 INFO:tasks.workunit.client.0.smithi153.stderr: -28> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 20 Filter name: none 2024-09-19T14:09:48.047 INFO:tasks.workunit.client.0.smithi153.stderr: -27> 2024-09-19T14:09:47.958+0000 7fcfa3fff640 20 reqs_thread_entry: start 2024-09-19T14:09:48.047 INFO:tasks.workunit.client.0.smithi153.stderr: -26> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-19T14:09:48.047 INFO:tasks.workunit.client.0.smithi153.stderr: -25> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.047 INFO:tasks.workunit.client.0.smithi153.stderr: -24> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:09:48.047 INFO:tasks.workunit.client.0.smithi153.stderr: -23> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-19T14:09:48.047 INFO:tasks.workunit.client.0.smithi153.stderr: -22> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-19T14:09:48.048 INFO:tasks.workunit.client.0.smithi153.stderr: -21> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 : miss 2024-09-19T14:09:48.048 INFO:tasks.workunit.client.0.smithi153.stderr: -20> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.048 INFO:tasks.workunit.client.0.smithi153.stderr: -19> 2024-09-19T14:09:47.962+0000 7fd1840e29c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:09:48.048 INFO:tasks.workunit.client.0.smithi153.stderr: -18> 2024-09-19T14:09:47.962+0000 7fd1840e29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 info.flags=0x17 2024-09-19T14:09:48.048 INFO:tasks.workunit.client.0.smithi153.stderr: -17> 2024-09-19T14:09:47.962+0000 7fd1840e29c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 to cache LRU end 2024-09-19T14:09:48.048 INFO:tasks.workunit.client.0.smithi153.stderr: -16> 2024-09-19T14:09:47.962+0000 7fd1840e29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:09:48.048 INFO:tasks.workunit.client.0.smithi153.stderr: -15> 2024-09-19T14:09:47.962+0000 7fd1840e29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:48.048 INFO:tasks.workunit.client.0.smithi153.stderr: -14> 2024-09-19T14:09:47.962+0000 7fd1840e29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 2024-09-19T14:09:48.048 INFO:tasks.workunit.client.0.smithi153.stderr: -13> 2024-09-19T14:09:47.970+0000 7fd1840e29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 info.flags=0x17 2024-09-19T14:09:48.048 INFO:tasks.workunit.client.0.smithi153.stderr: -12> 2024-09-19T14:09:47.970+0000 7fd1840e29c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 to cache LRU end 2024-09-19T14:09:48.048 INFO:tasks.workunit.client.0.smithi153.stderr: -11> 2024-09-19T14:09:47.970+0000 7fd1840e29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:48.048 INFO:tasks.workunit.client.0.smithi153.stderr: -10> 2024-09-19T14:09:47.970+0000 7fd1840e29c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34, ofs0, ns] 2024-09-19T14:09:48.048 INFO:tasks.workunit.client.0.smithi153.stderr: -9> 2024-09-19T14:09:47.970+0000 7fd0657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333501 cookie 94730702858816 notifier 7031 bl.length()=911 2024-09-19T14:09:48.049 INFO:tasks.workunit.client.0.smithi153.stderr: -8> 2024-09-19T14:09:47.970+0000 7fd0657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 info.flags=0x17 2024-09-19T14:09:48.049 INFO:tasks.workunit.client.0.smithi153.stderr: -7> 2024-09-19T14:09:47.970+0000 7fd0657fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 to cache LRU end 2024-09-19T14:09:48.049 INFO:tasks.workunit.client.0.smithi153.stderr: -6> 2024-09-19T14:09:47.970+0000 7fd0657fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:48.049 INFO:tasks.workunit.client.0.smithi153.stderr: -5> 2024-09-19T14:09:47.978+0000 7fd1840e29c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.34]): orig_sources= new_sources= 2024-09-19T14:09:48.049 INFO:tasks.workunit.client.0.smithi153.stderr: -4> 2024-09-19T14:09:47.978+0000 7fd1840e29c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.34]): potential sources added=[] removed=[] 2024-09-19T14:09:48.049 INFO:tasks.workunit.client.0.smithi153.stderr: -3> 2024-09-19T14:09:47.978+0000 7fd1840e29c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.34]): orig_dests= new_dests= 2024-09-19T14:09:48.049 INFO:tasks.workunit.client.0.smithi153.stderr: -2> 2024-09-19T14:09:47.978+0000 7fd1840e29c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.34]): potential dests added=[] removed=[] 2024-09-19T14:09:48.049 INFO:tasks.workunit.client.0.smithi153.stderr: -1> 2024-09-19T14:09:47.986+0000 7fd1840e29c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd1840e29c0 time 2024-09-19T14:09:47.988509+0000 2024-09-19T14:09:48.049 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:09:48.049 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.049 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:09:48.049 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd1879bc2eb] 2024-09-19T14:09:48.050 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd1879bc49f] 2024-09-19T14:09:48.050 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562833833271] 2024-09-19T14:09:48.050 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56283384314a] 2024-09-19T14:09:48.050 INFO:tasks.workunit.client.0.smithi153.stderr: 5: main() 2024-09-19T14:09:48.050 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd186822d90] 2024-09-19T14:09:48.050 INFO:tasks.workunit.client.0.smithi153.stderr: 7: __libc_start_main() 2024-09-19T14:09:48.050 INFO:tasks.workunit.client.0.smithi153.stderr: 8: _start() 2024-09-19T14:09:48.050 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.050 INFO:tasks.workunit.client.0.smithi153.stderr: 0> 2024-09-19T14:09:47.986+0000 7fd1840e29c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:09:48.050 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7fd1840e29c0 thread_name:radosgw-admin 2024-09-19T14:09:48.050 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.050 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:09:48.050 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd18683b520] 2024-09-19T14:09:48.051 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:09:48.051 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:09:48.051 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:09:48.051 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd1879bc345] 2024-09-19T14:09:48.051 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd1879bc49f] 2024-09-19T14:09:48.051 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562833833271] 2024-09-19T14:09:48.051 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56283384314a] 2024-09-19T14:09:48.051 INFO:tasks.workunit.client.0.smithi153.stderr: 9: main() 2024-09-19T14:09:48.051 INFO:tasks.workunit.client.0.smithi153.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd186822d90] 2024-09-19T14:09:48.051 INFO:tasks.workunit.client.0.smithi153.stderr: 11: __libc_start_main() 2024-09-19T14:09:48.051 INFO:tasks.workunit.client.0.smithi153.stderr: 12: _start() 2024-09-19T14:09:48.051 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:09:48.051 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.052 INFO:tasks.workunit.client.0.smithi153.stderr:--- logging levels --- 2024-09-19T14:09:48.052 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 none 2024-09-19T14:09:48.052 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 lockdep 2024-09-19T14:09:48.052 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 context 2024-09-19T14:09:48.052 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 crush 2024-09-19T14:09:48.052 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds 2024-09-19T14:09:48.052 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_balancer 2024-09-19T14:09:48.052 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_locker 2024-09-19T14:09:48.052 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log 2024-09-19T14:09:48.052 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log_expire 2024-09-19T14:09:48.052 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_migrator 2024-09-19T14:09:48.052 INFO:tasks.workunit.client.0.smithi153.stderr: 3/ 5 mds_quiesce 2024-09-19T14:09:48.053 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 buffer 2024-09-19T14:09:48.053 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 timer 2024-09-19T14:09:48.053 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 filer 2024-09-19T14:09:48.053 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 striper 2024-09-19T14:09:48.053 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 objecter 2024-09-19T14:09:48.053 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rados 2024-09-19T14:09:48.053 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd 2024-09-19T14:09:48.053 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_mirror 2024-09-19T14:09:48.053 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_replay 2024-09-19T14:09:48.053 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_pwl 2024-09-19T14:09:48.053 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 journaler 2024-09-19T14:09:48.053 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objectcacher 2024-09-19T14:09:48.054 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:09:48.054 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 client 2024-09-19T14:09:48.054 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 osd 2024-09-19T14:09:48.054 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 optracker 2024-09-19T14:09:48.054 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objclass 2024-09-19T14:09:48.054 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 filestore 2024-09-19T14:09:48.054 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 journal 2024-09-19T14:09:48.054 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 ms 2024-09-19T14:09:48.054 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mon 2024-09-19T14:09:48.054 INFO:tasks.workunit.client.0.smithi153.stderr: 0/10 monc 2024-09-19T14:09:48.054 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 paxos 2024-09-19T14:09:48.054 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 tp 2024-09-19T14:09:48.055 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 auth 2024-09-19T14:09:48.055 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 crypto 2024-09-19T14:09:48.055 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 finisher 2024-09-19T14:09:48.055 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 reserver 2024-09-19T14:09:48.055 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 heartbeatmap 2024-09-19T14:09:48.055 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 perfcounter 2024-09-19T14:09:48.055 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw 2024-09-19T14:09:48.055 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_sync 2024-09-19T14:09:48.055 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_datacache 2024-09-19T14:09:48.055 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_access 2024-09-19T14:09:48.056 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:09:48.056 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_flight 2024-09-19T14:09:48.056 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:09:48.056 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw_notification 2024-09-19T14:09:48.056 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 javaclient 2024-09-19T14:09:48.056 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 asok 2024-09-19T14:09:48.056 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 throttle 2024-09-19T14:09:48.056 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 refs 2024-09-19T14:09:48.056 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 compressor 2024-09-19T14:09:48.056 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluestore 2024-09-19T14:09:48.056 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluefs 2024-09-19T14:09:48.056 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 bdev 2024-09-19T14:09:48.056 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 kstore 2024-09-19T14:09:48.056 INFO:tasks.workunit.client.0.smithi153.stderr: 4/ 5 rocksdb 2024-09-19T14:09:48.057 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 fuse 2024-09-19T14:09:48.057 INFO:tasks.workunit.client.0.smithi153.stderr: 2/ 5 mgr 2024-09-19T14:09:48.057 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mgrc 2024-09-19T14:09:48.057 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 dpdk 2024-09-19T14:09:48.057 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 eventtrace 2024-09-19T14:09:48.057 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 prioritycache 2024-09-19T14:09:48.057 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 test 2024-09-19T14:09:48.057 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:09:48.057 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephsqlite 2024-09-19T14:09:48.057 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:09:48.057 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore 2024-09-19T14:09:48.057 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_onode 2024-09-19T14:09:48.057 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_odata 2024-09-19T14:09:48.057 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_omap 2024-09-19T14:09:48.058 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_tm 2024-09-19T14:09:48.058 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_t 2024-09-19T14:09:48.058 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:09:48.058 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_epm 2024-09-19T14:09:48.058 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_lba 2024-09-19T14:09:48.058 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:09:48.058 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cache 2024-09-19T14:09:48.058 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_journal 2024-09-19T14:09:48.058 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_device 2024-09-19T14:09:48.058 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_backref 2024-09-19T14:09:48.058 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 alienstore 2024-09-19T14:09:48.058 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mclock 2024-09-19T14:09:48.058 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cyanstore 2024-09-19T14:09:48.058 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 ceph_exporter 2024-09-19T14:09:48.058 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 memstore 2024-09-19T14:09:48.059 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 trace 2024-09-19T14:09:48.059 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 ceph_dedup 2024-09-19T14:09:48.059 INFO:tasks.workunit.client.0.smithi153.stderr: -2/-2 (syslog threshold) 2024-09-19T14:09:48.059 INFO:tasks.workunit.client.0.smithi153.stderr: 99/99 (stderr threshold) 2024-09-19T14:09:48.059 INFO:tasks.workunit.client.0.smithi153.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:09:48.059 INFO:tasks.workunit.client.0.smithi153.stderr: 7fcfa3fff640 / http_manager 2024-09-19T14:09:48.059 INFO:tasks.workunit.client.0.smithi153.stderr: 7fd0327fc640 / http_manager 2024-09-19T14:09:48.059 INFO:tasks.workunit.client.0.smithi153.stderr: 7fd0337fe640 / rgw_dt_lg_renew 2024-09-19T14:09:48.059 INFO:tasks.workunit.client.0.smithi153.stderr: 7fd0537fe640 / ms_dispatch 2024-09-19T14:09:48.059 INFO:tasks.workunit.client.0.smithi153.stderr: 7fd0657fa640 / io_context_pool 2024-09-19T14:09:48.059 INFO:tasks.workunit.client.0.smithi153.stderr: 7fd0677fe640 / ms_dispatch 2024-09-19T14:09:48.059 INFO:tasks.workunit.client.0.smithi153.stderr: 7fd06e604640 / ms_dispatch 2024-09-19T14:09:48.059 INFO:tasks.workunit.client.0.smithi153.stderr: 7fd06fe07640 / io_context_pool 2024-09-19T14:09:48.059 INFO:tasks.workunit.client.0.smithi153.stderr: 7fd1813e7640 / msgr-worker-2 2024-09-19T14:09:48.059 INFO:tasks.workunit.client.0.smithi153.stderr: 7fd181be8640 / msgr-worker-1 2024-09-19T14:09:48.060 INFO:tasks.workunit.client.0.smithi153.stderr: 7fd1823e9640 / msgr-worker-0 2024-09-19T14:09:48.060 INFO:tasks.workunit.client.0.smithi153.stderr: 7fd182bea640 / io_context_pool 2024-09-19T14:09:48.060 INFO:tasks.workunit.client.0.smithi153.stderr: 7fd1840e29c0 / radosgw-admin 2024-09-19T14:09:48.060 INFO:tasks.workunit.client.0.smithi153.stderr: max_recent 500 2024-09-19T14:09:48.060 INFO:tasks.workunit.client.0.smithi153.stderr: max_new 1000 2024-09-19T14:09:48.060 INFO:tasks.workunit.client.0.smithi153.stderr: log_file /var/log/ceph/ceph-client.admin.119914.log 2024-09-19T14:09:48.060 INFO:tasks.workunit.client.0.smithi153.stderr:--- end dump of recent events --- 2024-09-19T14:09:48.060 INFO:tasks.workunit.client.0.smithi153.stderr:--- begin dump of recent events --- 2024-09-19T14:09:48.060 INFO:tasks.workunit.client.0.smithi153.stderr: -499> 2024-09-19T14:09:47.666+0000 7fd06fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:48.060 INFO:tasks.workunit.client.0.smithi153.stderr: -498> 2024-09-19T14:09:47.666+0000 7fd06fe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:09:48.060 INFO:tasks.workunit.client.0.smithi153.stderr: -497> 2024-09-19T14:09:47.666+0000 7fd06fe07640 10 monclient: dump: 2024-09-19T14:09:48.060 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:48.061 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:48.061 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.061 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.061 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:48.061 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.061 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:48.061 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:48.061 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:48.061 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.061 INFO:tasks.workunit.client.0.smithi153.stderr: -496> 2024-09-19T14:09:47.666+0000 7fd1840e29c0 5 monclient: authenticate success, global_id 7019 2024-09-19T14:09:48.061 INFO:tasks.workunit.client.0.smithi153.stderr: -495> 2024-09-19T14:09:47.666+0000 7fd1840e29c0 10 monclient: get_monmap_and_config success 2024-09-19T14:09:48.062 INFO:tasks.workunit.client.0.smithi153.stderr: -494> 2024-09-19T14:09:47.666+0000 7fd1840e29c0 4 set_mon_vals no callback set 2024-09-19T14:09:48.062 INFO:tasks.workunit.client.0.smithi153.stderr: -493> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient: shutdown 2024-09-19T14:09:48.062 INFO:tasks.workunit.client.0.smithi153.stderr: -492> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 asok(0x562835b49d90) unregister_commands rotate-key 2024-09-19T14:09:48.062 INFO:tasks.workunit.client.0.smithi153.stderr: -491> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient: build_initial_monmap 2024-09-19T14:09:48.062 INFO:tasks.workunit.client.0.smithi153.stderr: -490> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 1 build_initial for_mkfs: 0 2024-09-19T14:09:48.062 INFO:tasks.workunit.client.0.smithi153.stderr: -489> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient: monmap: 2024-09-19T14:09:48.062 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:09:48.062 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:09:48.062 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:09:48.062 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:09:48.062 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:09:48.062 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.063 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:09:48.063 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:09:48.063 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:09:48.063 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.063 INFO:tasks.workunit.client.0.smithi153.stderr: -488> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding auth protocol: cephx 2024-09-19T14:09:48.063 INFO:tasks.workunit.client.0.smithi153.stderr: -487> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding auth protocol: cephx 2024-09-19T14:09:48.063 INFO:tasks.workunit.client.0.smithi153.stderr: -486> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding auth protocol: cephx 2024-09-19T14:09:48.063 INFO:tasks.workunit.client.0.smithi153.stderr: -485> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding con mode: secure 2024-09-19T14:09:48.063 INFO:tasks.workunit.client.0.smithi153.stderr: -484> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding con mode: crc 2024-09-19T14:09:48.063 INFO:tasks.workunit.client.0.smithi153.stderr: -483> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding con mode: secure 2024-09-19T14:09:48.063 INFO:tasks.workunit.client.0.smithi153.stderr: -482> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding con mode: crc 2024-09-19T14:09:48.063 INFO:tasks.workunit.client.0.smithi153.stderr: -481> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding con mode: secure 2024-09-19T14:09:48.063 INFO:tasks.workunit.client.0.smithi153.stderr: -480> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding con mode: crc 2024-09-19T14:09:48.064 INFO:tasks.workunit.client.0.smithi153.stderr: -479> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding con mode: crc 2024-09-19T14:09:48.064 INFO:tasks.workunit.client.0.smithi153.stderr: -478> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding con mode: secure 2024-09-19T14:09:48.064 INFO:tasks.workunit.client.0.smithi153.stderr: -477> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding con mode: crc 2024-09-19T14:09:48.064 INFO:tasks.workunit.client.0.smithi153.stderr: -476> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding con mode: secure 2024-09-19T14:09:48.064 INFO:tasks.workunit.client.0.smithi153.stderr: -475> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding con mode: crc 2024-09-19T14:09:48.064 INFO:tasks.workunit.client.0.smithi153.stderr: -474> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d5a980) adding con mode: secure 2024-09-19T14:09:48.064 INFO:tasks.workunit.client.0.smithi153.stderr: -473> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.064 INFO:tasks.workunit.client.0.smithi153.stderr: -472> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 1 librados: starting msgr at 2024-09-19T14:09:48.064 INFO:tasks.workunit.client.0.smithi153.stderr: -471> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 1 librados: starting objecter 2024-09-19T14:09:48.064 INFO:tasks.workunit.client.0.smithi153.stderr: -470> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command objecter_requests hook 0x562835d58250 2024-09-19T14:09:48.064 INFO:tasks.workunit.client.0.smithi153.stderr: -469> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 1 librados: setting wanted keys 2024-09-19T14:09:48.064 INFO:tasks.workunit.client.0.smithi153.stderr: -468> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 1 librados: calling monclient init 2024-09-19T14:09:48.064 INFO:tasks.workunit.client.0.smithi153.stderr: -467> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient: init 2024-09-19T14:09:48.064 INFO:tasks.workunit.client.0.smithi153.stderr: -466> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding auth protocol: cephx 2024-09-19T14:09:48.065 INFO:tasks.workunit.client.0.smithi153.stderr: -465> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding auth protocol: cephx 2024-09-19T14:09:48.065 INFO:tasks.workunit.client.0.smithi153.stderr: -464> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding auth protocol: cephx 2024-09-19T14:09:48.065 INFO:tasks.workunit.client.0.smithi153.stderr: -463> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding con mode: secure 2024-09-19T14:09:48.065 INFO:tasks.workunit.client.0.smithi153.stderr: -462> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding con mode: crc 2024-09-19T14:09:48.065 INFO:tasks.workunit.client.0.smithi153.stderr: -461> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding con mode: secure 2024-09-19T14:09:48.065 INFO:tasks.workunit.client.0.smithi153.stderr: -460> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding con mode: crc 2024-09-19T14:09:48.065 INFO:tasks.workunit.client.0.smithi153.stderr: -459> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding con mode: secure 2024-09-19T14:09:48.065 INFO:tasks.workunit.client.0.smithi153.stderr: -458> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding con mode: crc 2024-09-19T14:09:48.065 INFO:tasks.workunit.client.0.smithi153.stderr: -457> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding con mode: crc 2024-09-19T14:09:48.065 INFO:tasks.workunit.client.0.smithi153.stderr: -456> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding con mode: secure 2024-09-19T14:09:48.065 INFO:tasks.workunit.client.0.smithi153.stderr: -455> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding con mode: crc 2024-09-19T14:09:48.065 INFO:tasks.workunit.client.0.smithi153.stderr: -454> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding con mode: secure 2024-09-19T14:09:48.065 INFO:tasks.workunit.client.0.smithi153.stderr: -453> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding con mode: crc 2024-09-19T14:09:48.065 INFO:tasks.workunit.client.0.smithi153.stderr: -452> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 AuthRegistry(0x562835d548f0) adding con mode: secure 2024-09-19T14:09:48.066 INFO:tasks.workunit.client.0.smithi153.stderr: -451> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.066 INFO:tasks.workunit.client.0.smithi153.stderr: -450> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.066 INFO:tasks.workunit.client.0.smithi153.stderr: -449> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command rotate-key hook 0x562835d54a38 2024-09-19T14:09:48.066 INFO:tasks.workunit.client.0.smithi153.stderr: -448> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient: _reopen_session rank -1 2024-09-19T14:09:48.066 INFO:tasks.workunit.client.0.smithi153.stderr: -447> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T14:09:48.066 INFO:tasks.workunit.client.0.smithi153.stderr: -446> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient(hunting): picked mon.noname-c con 0x562835be2410 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:09:48.066 INFO:tasks.workunit.client.0.smithi153.stderr: -445> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient(hunting): picked mon.noname-b con 0x562835d82c80 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:09:48.066 INFO:tasks.workunit.client.0.smithi153.stderr: -444> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient(hunting): picked mon.noname-a con 0x562835d92a40 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:09:48.066 INFO:tasks.workunit.client.0.smithi153.stderr: -443> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:48.066 INFO:tasks.workunit.client.0.smithi153.stderr: -442> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:48.066 INFO:tasks.workunit.client.0.smithi153.stderr: -441> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:48.066 INFO:tasks.workunit.client.0.smithi153.stderr: -440> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient(hunting): _renew_subs 2024-09-19T14:09:48.066 INFO:tasks.workunit.client.0.smithi153.stderr: -439> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient(hunting): authenticate will time out at 2776.134131s 2024-09-19T14:09:48.066 INFO:tasks.workunit.client.0.smithi153.stderr: -438> 2024-09-19T14:09:47.670+0000 7fd181be8640 10 monclient(hunting): get_auth_request con 0x562835be2410 auth_method 0 2024-09-19T14:09:48.067 INFO:tasks.workunit.client.0.smithi153.stderr: -437> 2024-09-19T14:09:47.670+0000 7fd181be8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:48.067 INFO:tasks.workunit.client.0.smithi153.stderr: -436> 2024-09-19T14:09:47.670+0000 7fd181be8640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:48.067 INFO:tasks.workunit.client.0.smithi153.stderr: -435> 2024-09-19T14:09:47.670+0000 7fd181be8640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:48.067 INFO:tasks.workunit.client.0.smithi153.stderr: -434> 2024-09-19T14:09:47.670+0000 7fd1823e9640 10 monclient(hunting): get_auth_request con 0x562835d92a40 auth_method 0 2024-09-19T14:09:48.067 INFO:tasks.workunit.client.0.smithi153.stderr: -433> 2024-09-19T14:09:47.670+0000 7fd1823e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:48.067 INFO:tasks.workunit.client.0.smithi153.stderr: -432> 2024-09-19T14:09:47.670+0000 7fd1823e9640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:48.067 INFO:tasks.workunit.client.0.smithi153.stderr: -431> 2024-09-19T14:09:47.670+0000 7fd1823e9640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:48.067 INFO:tasks.workunit.client.0.smithi153.stderr: -430> 2024-09-19T14:09:47.670+0000 7fd181be8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:48.067 INFO:tasks.workunit.client.0.smithi153.stderr: -429> 2024-09-19T14:09:47.670+0000 7fd181be8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:48.067 INFO:tasks.workunit.client.0.smithi153.stderr: -428> 2024-09-19T14:09:47.670+0000 7fd181be8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:48.067 INFO:tasks.workunit.client.0.smithi153.stderr: -427> 2024-09-19T14:09:47.670+0000 7fd1823e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:48.067 INFO:tasks.workunit.client.0.smithi153.stderr: -426> 2024-09-19T14:09:47.670+0000 7fd1823e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:48.067 INFO:tasks.workunit.client.0.smithi153.stderr: -425> 2024-09-19T14:09:47.670+0000 7fd1823e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:48.067 INFO:tasks.workunit.client.0.smithi153.stderr: -424> 2024-09-19T14:09:47.670+0000 7fd1813e7640 10 monclient(hunting): get_auth_request con 0x562835d82c80 auth_method 0 2024-09-19T14:09:48.067 INFO:tasks.workunit.client.0.smithi153.stderr: -423> 2024-09-19T14:09:47.670+0000 7fd1813e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:48.068 INFO:tasks.workunit.client.0.smithi153.stderr: -422> 2024-09-19T14:09:47.670+0000 7fd1813e7640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:48.068 INFO:tasks.workunit.client.0.smithi153.stderr: -421> 2024-09-19T14:09:47.670+0000 7fd1813e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:48.068 INFO:tasks.workunit.client.0.smithi153.stderr: -420> 2024-09-19T14:09:47.670+0000 7fd181be8640 10 monclient(hunting): handle_auth_done global_id 7022 payload 824 2024-09-19T14:09:48.068 INFO:tasks.workunit.client.0.smithi153.stderr: -419> 2024-09-19T14:09:47.670+0000 7fd181be8640 10 monclient: _finish_hunting 0 2024-09-19T14:09:48.068 INFO:tasks.workunit.client.0.smithi153.stderr: -418> 2024-09-19T14:09:47.670+0000 7fd181be8640 1 monclient: found mon.noname-c 2024-09-19T14:09:48.068 INFO:tasks.workunit.client.0.smithi153.stderr: -417> 2024-09-19T14:09:47.670+0000 7fd181be8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:09:48.068 INFO:tasks.workunit.client.0.smithi153.stderr: -416> 2024-09-19T14:09:47.670+0000 7fd06e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:48.068 INFO:tasks.workunit.client.0.smithi153.stderr: -415> 2024-09-19T14:09:47.670+0000 7fd06e604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:09:48.068 INFO:tasks.workunit.client.0.smithi153.stderr: -414> 2024-09-19T14:09:47.670+0000 7fd06e604640 10 monclient: dump: 2024-09-19T14:09:48.068 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:48.068 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:48.068 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.068 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.069 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:48.069 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.069 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:48.069 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:48.069 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:48.069 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.069 INFO:tasks.workunit.client.0.smithi153.stderr: -413> 2024-09-19T14:09:47.670+0000 7fd06e604640 10 monclient: _finish_auth 0 2024-09-19T14:09:48.069 INFO:tasks.workunit.client.0.smithi153.stderr: -412> 2024-09-19T14:09:47.670+0000 7fd06e604640 10 monclient: _check_auth_tickets 2024-09-19T14:09:48.069 INFO:tasks.workunit.client.0.smithi153.stderr: -411> 2024-09-19T14:09:47.670+0000 7fd06e604640 10 monclient: handle_config config(0 keys) 2024-09-19T14:09:48.069 INFO:tasks.workunit.client.0.smithi153.stderr: -410> 2024-09-19T14:09:47.670+0000 7fd06e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:48.069 INFO:tasks.workunit.client.0.smithi153.stderr: -409> 2024-09-19T14:09:47.670+0000 7fd06e604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:09:48.069 INFO:tasks.workunit.client.0.smithi153.stderr: -408> 2024-09-19T14:09:47.670+0000 7fd06e604640 10 monclient: dump: 2024-09-19T14:09:48.069 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:48.070 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:48.070 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.070 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.070 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:48.070 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.070 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:48.070 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:48.070 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:48.070 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.070 INFO:tasks.workunit.client.0.smithi153.stderr: -407> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 5 monclient: authenticate success, global_id 7022 2024-09-19T14:09:48.070 INFO:tasks.workunit.client.0.smithi153.stderr: -406> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient: _renew_subs 2024-09-19T14:09:48.070 INFO:tasks.workunit.client.0.smithi153.stderr: -405> 2024-09-19T14:09:47.670+0000 7fd06fe07640 4 set_mon_vals no callback set 2024-09-19T14:09:48.070 INFO:tasks.workunit.client.0.smithi153.stderr: -404> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:09:48.070 INFO:tasks.workunit.client.0.smithi153.stderr: -403> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient: _renew_subs 2024-09-19T14:09:48.071 INFO:tasks.workunit.client.0.smithi153.stderr: -402> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:09:48.071 INFO:tasks.workunit.client.0.smithi153.stderr: -401> 2024-09-19T14:09:47.670+0000 7fd1840e29c0 1 librados: init done 2024-09-19T14:09:48.071 INFO:tasks.workunit.client.0.smithi153.stderr: -400> 2024-09-19T14:09:47.674+0000 7fd06e604640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:09:48.071 INFO:tasks.workunit.client.0.smithi153.stderr: -399> 2024-09-19T14:09:47.674+0000 7fd06e604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:09:48.071 INFO:tasks.workunit.client.0.smithi153.stderr: -398> 2024-09-19T14:09:47.674+0000 7fd06e604640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:09:48.071 INFO:tasks.workunit.client.0.smithi153.stderr: -397> 2024-09-19T14:09:47.674+0000 7fd1813e7640 10 monclient: get_auth_request con 0x7fd068071c10 auth_method 0 2024-09-19T14:09:48.071 INFO:tasks.workunit.client.0.smithi153.stderr: -396> 2024-09-19T14:09:47.674+0000 7fd1823e9640 10 monclient: get_auth_request con 0x562835d9ce10 auth_method 0 2024-09-19T14:09:48.071 INFO:tasks.workunit.client.0.smithi153.stderr: -395> 2024-09-19T14:09:47.674+0000 7fd181be8640 10 monclient: get_auth_request con 0x562835d9fff0 auth_method 0 2024-09-19T14:09:48.071 INFO:tasks.workunit.client.0.smithi153.stderr: -394> 2024-09-19T14:09:47.678+0000 7fd1813e7640 10 monclient: get_auth_request con 0x562835da3850 auth_method 0 2024-09-19T14:09:48.071 INFO:tasks.workunit.client.0.smithi153.stderr: -393> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient: build_initial_monmap 2024-09-19T14:09:48.071 INFO:tasks.workunit.client.0.smithi153.stderr: -392> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 1 build_initial for_mkfs: 0 2024-09-19T14:09:48.071 INFO:tasks.workunit.client.0.smithi153.stderr: -391> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient: monmap: 2024-09-19T14:09:48.071 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:09:48.071 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:09:48.072 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:09:48.072 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:09:48.072 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:09:48.072 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.072 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:09:48.072 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:09:48.072 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:09:48.072 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.072 INFO:tasks.workunit.client.0.smithi153.stderr: -390> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding auth protocol: cephx 2024-09-19T14:09:48.072 INFO:tasks.workunit.client.0.smithi153.stderr: -389> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding auth protocol: cephx 2024-09-19T14:09:48.072 INFO:tasks.workunit.client.0.smithi153.stderr: -388> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding auth protocol: cephx 2024-09-19T14:09:48.072 INFO:tasks.workunit.client.0.smithi153.stderr: -387> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding con mode: secure 2024-09-19T14:09:48.072 INFO:tasks.workunit.client.0.smithi153.stderr: -386> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding con mode: crc 2024-09-19T14:09:48.072 INFO:tasks.workunit.client.0.smithi153.stderr: -385> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding con mode: secure 2024-09-19T14:09:48.073 INFO:tasks.workunit.client.0.smithi153.stderr: -384> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding con mode: crc 2024-09-19T14:09:48.073 INFO:tasks.workunit.client.0.smithi153.stderr: -383> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding con mode: secure 2024-09-19T14:09:48.073 INFO:tasks.workunit.client.0.smithi153.stderr: -382> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding con mode: crc 2024-09-19T14:09:48.073 INFO:tasks.workunit.client.0.smithi153.stderr: -381> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding con mode: crc 2024-09-19T14:09:48.073 INFO:tasks.workunit.client.0.smithi153.stderr: -380> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding con mode: secure 2024-09-19T14:09:48.073 INFO:tasks.workunit.client.0.smithi153.stderr: -379> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding con mode: crc 2024-09-19T14:09:48.073 INFO:tasks.workunit.client.0.smithi153.stderr: -378> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding con mode: secure 2024-09-19T14:09:48.073 INFO:tasks.workunit.client.0.smithi153.stderr: -377> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding con mode: crc 2024-09-19T14:09:48.073 INFO:tasks.workunit.client.0.smithi153.stderr: -376> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da9110) adding con mode: secure 2024-09-19T14:09:48.073 INFO:tasks.workunit.client.0.smithi153.stderr: -375> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.073 INFO:tasks.workunit.client.0.smithi153.stderr: -374> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command objecter_requests cmddesc objecter_requests hook 0x562835dacb80 EEXIST 2024-09-19T14:09:48.073 INFO:tasks.workunit.client.0.smithi153.stderr: -373> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient: init 2024-09-19T14:09:48.073 INFO:tasks.workunit.client.0.smithi153.stderr: -372> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding auth protocol: cephx 2024-09-19T14:09:48.073 INFO:tasks.workunit.client.0.smithi153.stderr: -371> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding auth protocol: cephx 2024-09-19T14:09:48.074 INFO:tasks.workunit.client.0.smithi153.stderr: -370> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding auth protocol: cephx 2024-09-19T14:09:48.074 INFO:tasks.workunit.client.0.smithi153.stderr: -369> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding con mode: secure 2024-09-19T14:09:48.074 INFO:tasks.workunit.client.0.smithi153.stderr: -368> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding con mode: crc 2024-09-19T14:09:48.074 INFO:tasks.workunit.client.0.smithi153.stderr: -367> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding con mode: secure 2024-09-19T14:09:48.074 INFO:tasks.workunit.client.0.smithi153.stderr: -366> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding con mode: crc 2024-09-19T14:09:48.074 INFO:tasks.workunit.client.0.smithi153.stderr: -365> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding con mode: secure 2024-09-19T14:09:48.074 INFO:tasks.workunit.client.0.smithi153.stderr: -364> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding con mode: crc 2024-09-19T14:09:48.074 INFO:tasks.workunit.client.0.smithi153.stderr: -363> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding con mode: crc 2024-09-19T14:09:48.074 INFO:tasks.workunit.client.0.smithi153.stderr: -362> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding con mode: secure 2024-09-19T14:09:48.074 INFO:tasks.workunit.client.0.smithi153.stderr: -361> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding con mode: crc 2024-09-19T14:09:48.074 INFO:tasks.workunit.client.0.smithi153.stderr: -360> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding con mode: secure 2024-09-19T14:09:48.074 INFO:tasks.workunit.client.0.smithi153.stderr: -359> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding con mode: crc 2024-09-19T14:09:48.074 INFO:tasks.workunit.client.0.smithi153.stderr: -358> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 AuthRegistry(0x562835da8168) adding con mode: secure 2024-09-19T14:09:48.074 INFO:tasks.workunit.client.0.smithi153.stderr: -357> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.075 INFO:tasks.workunit.client.0.smithi153.stderr: -356> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.075 INFO:tasks.workunit.client.0.smithi153.stderr: -355> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command rotate-key cmddesc rotate-key hook 0x562835da82b0 EEXIST 2024-09-19T14:09:48.075 INFO:tasks.workunit.client.0.smithi153.stderr: -354> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient: _reopen_session rank -1 2024-09-19T14:09:48.075 INFO:tasks.workunit.client.0.smithi153.stderr: -353> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T14:09:48.075 INFO:tasks.workunit.client.0.smithi153.stderr: -352> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient(hunting): picked mon.noname-c con 0x562835dd0d30 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:09:48.075 INFO:tasks.workunit.client.0.smithi153.stderr: -351> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient(hunting): picked mon.noname-a con 0x562835dd0660 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:09:48.075 INFO:tasks.workunit.client.0.smithi153.stderr: -350> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient(hunting): picked mon.noname-b con 0x562835dcf040 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:09:48.075 INFO:tasks.workunit.client.0.smithi153.stderr: -349> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:48.075 INFO:tasks.workunit.client.0.smithi153.stderr: -348> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:48.075 INFO:tasks.workunit.client.0.smithi153.stderr: -347> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:48.075 INFO:tasks.workunit.client.0.smithi153.stderr: -346> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient(hunting): _renew_subs 2024-09-19T14:09:48.075 INFO:tasks.workunit.client.0.smithi153.stderr: -345> 2024-09-19T14:09:47.678+0000 7fd1840e29c0 10 monclient(hunting): authenticate will time out at 2776.143899s 2024-09-19T14:09:48.076 INFO:tasks.workunit.client.0.smithi153.stderr: -344> 2024-09-19T14:09:47.682+0000 7fd1813e7640 10 monclient(hunting): get_auth_request con 0x562835dd0660 auth_method 0 2024-09-19T14:09:48.076 INFO:tasks.workunit.client.0.smithi153.stderr: -343> 2024-09-19T14:09:47.682+0000 7fd1813e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:48.076 INFO:tasks.workunit.client.0.smithi153.stderr: -342> 2024-09-19T14:09:47.682+0000 7fd1813e7640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:48.076 INFO:tasks.workunit.client.0.smithi153.stderr: -341> 2024-09-19T14:09:47.682+0000 7fd1813e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:48.076 INFO:tasks.workunit.client.0.smithi153.stderr: -340> 2024-09-19T14:09:47.682+0000 7fd181be8640 10 monclient(hunting): get_auth_request con 0x562835dd0d30 auth_method 0 2024-09-19T14:09:48.076 INFO:tasks.workunit.client.0.smithi153.stderr: -339> 2024-09-19T14:09:47.682+0000 7fd181be8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:48.076 INFO:tasks.workunit.client.0.smithi153.stderr: -338> 2024-09-19T14:09:47.682+0000 7fd181be8640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:48.076 INFO:tasks.workunit.client.0.smithi153.stderr: -337> 2024-09-19T14:09:47.682+0000 7fd181be8640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:48.076 INFO:tasks.workunit.client.0.smithi153.stderr: -336> 2024-09-19T14:09:47.682+0000 7fd1813e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:48.076 INFO:tasks.workunit.client.0.smithi153.stderr: -335> 2024-09-19T14:09:47.682+0000 7fd1813e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:48.076 INFO:tasks.workunit.client.0.smithi153.stderr: -334> 2024-09-19T14:09:47.682+0000 7fd1813e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:48.076 INFO:tasks.workunit.client.0.smithi153.stderr: -333> 2024-09-19T14:09:47.682+0000 7fd181be8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:48.076 INFO:tasks.workunit.client.0.smithi153.stderr: -332> 2024-09-19T14:09:47.682+0000 7fd181be8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:48.076 INFO:tasks.workunit.client.0.smithi153.stderr: -331> 2024-09-19T14:09:47.682+0000 7fd181be8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:48.077 INFO:tasks.workunit.client.0.smithi153.stderr: -330> 2024-09-19T14:09:47.682+0000 7fd1823e9640 10 monclient(hunting): get_auth_request con 0x562835dcf040 auth_method 0 2024-09-19T14:09:48.077 INFO:tasks.workunit.client.0.smithi153.stderr: -329> 2024-09-19T14:09:47.682+0000 7fd1823e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:48.077 INFO:tasks.workunit.client.0.smithi153.stderr: -328> 2024-09-19T14:09:47.682+0000 7fd1823e9640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:48.077 INFO:tasks.workunit.client.0.smithi153.stderr: -327> 2024-09-19T14:09:47.682+0000 7fd1823e9640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:48.077 INFO:tasks.workunit.client.0.smithi153.stderr: -326> 2024-09-19T14:09:47.682+0000 7fd1813e7640 10 monclient(hunting): handle_auth_done global_id 7491 payload 824 2024-09-19T14:09:48.077 INFO:tasks.workunit.client.0.smithi153.stderr: -325> 2024-09-19T14:09:47.682+0000 7fd1813e7640 10 monclient: _finish_hunting 0 2024-09-19T14:09:48.077 INFO:tasks.workunit.client.0.smithi153.stderr: -324> 2024-09-19T14:09:47.682+0000 7fd1813e7640 1 monclient: found mon.noname-a 2024-09-19T14:09:48.077 INFO:tasks.workunit.client.0.smithi153.stderr: -323> 2024-09-19T14:09:47.682+0000 7fd1813e7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:09:48.077 INFO:tasks.workunit.client.0.smithi153.stderr: -322> 2024-09-19T14:09:47.682+0000 7fd0677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:48.077 INFO:tasks.workunit.client.0.smithi153.stderr: -321> 2024-09-19T14:09:47.682+0000 7fd0677fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:09:48.077 INFO:tasks.workunit.client.0.smithi153.stderr: -320> 2024-09-19T14:09:47.682+0000 7fd0677fe640 10 monclient: dump: 2024-09-19T14:09:48.077 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:48.078 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:48.078 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.078 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.078 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:48.078 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.078 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:48.078 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:48.078 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:48.078 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.080 INFO:tasks.workunit.client.0.smithi153.stderr: -319> 2024-09-19T14:09:47.682+0000 7fd0677fe640 10 monclient: _finish_auth 0 2024-09-19T14:09:48.080 INFO:tasks.workunit.client.0.smithi153.stderr: -318> 2024-09-19T14:09:47.682+0000 7fd0677fe640 10 monclient: _check_auth_tickets 2024-09-19T14:09:48.080 INFO:tasks.workunit.client.0.smithi153.stderr: -317> 2024-09-19T14:09:47.682+0000 7fd0677fe640 10 monclient: handle_config config(0 keys) 2024-09-19T14:09:48.080 INFO:tasks.workunit.client.0.smithi153.stderr: -316> 2024-09-19T14:09:47.682+0000 7fd0677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:48.080 INFO:tasks.workunit.client.0.smithi153.stderr: -315> 2024-09-19T14:09:47.682+0000 7fd0677fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:09:48.080 INFO:tasks.workunit.client.0.smithi153.stderr: -314> 2024-09-19T14:09:47.682+0000 7fd0677fe640 10 monclient: dump: 2024-09-19T14:09:48.080 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:48.080 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:48.080 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.080 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.080 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:48.080 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.081 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:48.081 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:48.081 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:48.081 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.081 INFO:tasks.workunit.client.0.smithi153.stderr: -313> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 monclient: authenticate success, global_id 7491 2024-09-19T14:09:48.081 INFO:tasks.workunit.client.0.smithi153.stderr: -312> 2024-09-19T14:09:47.682+0000 7fd182bea640 4 set_mon_vals no callback set 2024-09-19T14:09:48.081 INFO:tasks.workunit.client.0.smithi153.stderr: -311> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 10 monclient: _renew_subs 2024-09-19T14:09:48.081 INFO:tasks.workunit.client.0.smithi153.stderr: -310> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:09:48.081 INFO:tasks.workunit.client.0.smithi153.stderr: -309> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 10 monclient: _renew_subs 2024-09-19T14:09:48.081 INFO:tasks.workunit.client.0.smithi153.stderr: -308> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:09:48.081 INFO:tasks.workunit.client.0.smithi153.stderr: -307> 2024-09-19T14:09:47.682+0000 7fd0677fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:09:48.081 INFO:tasks.workunit.client.0.smithi153.stderr: -306> 2024-09-19T14:09:47.682+0000 7fd0677fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:09:48.081 INFO:tasks.workunit.client.0.smithi153.stderr: -305> 2024-09-19T14:09:47.682+0000 7fd0677fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:09:48.082 INFO:tasks.workunit.client.0.smithi153.stderr: -304> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 10 monclient: get_monmap_and_config 2024-09-19T14:09:48.082 INFO:tasks.workunit.client.0.smithi153.stderr: -303> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 10 monclient: build_initial_monmap 2024-09-19T14:09:48.082 INFO:tasks.workunit.client.0.smithi153.stderr: -302> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 1 build_initial for_mkfs: 0 2024-09-19T14:09:48.082 INFO:tasks.workunit.client.0.smithi153.stderr: -301> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 10 monclient: monmap: 2024-09-19T14:09:48.082 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:09:48.082 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:09:48.082 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:09:48.082 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:09:48.082 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:09:48.082 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.082 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:09:48.082 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:09:48.082 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:09:48.083 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.083 INFO:tasks.workunit.client.0.smithi153.stderr: -300> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding auth protocol: cephx 2024-09-19T14:09:48.083 INFO:tasks.workunit.client.0.smithi153.stderr: -299> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding auth protocol: cephx 2024-09-19T14:09:48.083 INFO:tasks.workunit.client.0.smithi153.stderr: -298> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding auth protocol: cephx 2024-09-19T14:09:48.083 INFO:tasks.workunit.client.0.smithi153.stderr: -297> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding con mode: secure 2024-09-19T14:09:48.083 INFO:tasks.workunit.client.0.smithi153.stderr: -296> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding con mode: crc 2024-09-19T14:09:48.083 INFO:tasks.workunit.client.0.smithi153.stderr: -295> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding con mode: secure 2024-09-19T14:09:48.083 INFO:tasks.workunit.client.0.smithi153.stderr: -294> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding con mode: crc 2024-09-19T14:09:48.083 INFO:tasks.workunit.client.0.smithi153.stderr: -293> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding con mode: secure 2024-09-19T14:09:48.083 INFO:tasks.workunit.client.0.smithi153.stderr: -292> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding con mode: crc 2024-09-19T14:09:48.083 INFO:tasks.workunit.client.0.smithi153.stderr: -291> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding con mode: crc 2024-09-19T14:09:48.083 INFO:tasks.workunit.client.0.smithi153.stderr: -290> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding con mode: secure 2024-09-19T14:09:48.083 INFO:tasks.workunit.client.0.smithi153.stderr: -289> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding con mode: crc 2024-09-19T14:09:48.084 INFO:tasks.workunit.client.0.smithi153.stderr: -288> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding con mode: secure 2024-09-19T14:09:48.084 INFO:tasks.workunit.client.0.smithi153.stderr: -287> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding con mode: crc 2024-09-19T14:09:48.084 INFO:tasks.workunit.client.0.smithi153.stderr: -286> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x562835df06b0) adding con mode: secure 2024-09-19T14:09:48.084 INFO:tasks.workunit.client.0.smithi153.stderr: -285> 2024-09-19T14:09:47.682+0000 7fd181be8640 10 monclient: get_auth_request con 0x7fd05c071b20 auth_method 0 2024-09-19T14:09:48.084 INFO:tasks.workunit.client.0.smithi153.stderr: -284> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.084 INFO:tasks.workunit.client.0.smithi153.stderr: -283> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 10 monclient: init 2024-09-19T14:09:48.084 INFO:tasks.workunit.client.0.smithi153.stderr: -282> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding auth protocol: cephx 2024-09-19T14:09:48.084 INFO:tasks.workunit.client.0.smithi153.stderr: -281> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding auth protocol: cephx 2024-09-19T14:09:48.084 INFO:tasks.workunit.client.0.smithi153.stderr: -280> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding auth protocol: cephx 2024-09-19T14:09:48.084 INFO:tasks.workunit.client.0.smithi153.stderr: -279> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding con mode: secure 2024-09-19T14:09:48.084 INFO:tasks.workunit.client.0.smithi153.stderr: -278> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding con mode: crc 2024-09-19T14:09:48.084 INFO:tasks.workunit.client.0.smithi153.stderr: -277> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding con mode: secure 2024-09-19T14:09:48.084 INFO:tasks.workunit.client.0.smithi153.stderr: -276> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding con mode: crc 2024-09-19T14:09:48.084 INFO:tasks.workunit.client.0.smithi153.stderr: -275> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding con mode: secure 2024-09-19T14:09:48.085 INFO:tasks.workunit.client.0.smithi153.stderr: -274> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding con mode: crc 2024-09-19T14:09:48.085 INFO:tasks.workunit.client.0.smithi153.stderr: -273> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding con mode: crc 2024-09-19T14:09:48.085 INFO:tasks.workunit.client.0.smithi153.stderr: -272> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding con mode: secure 2024-09-19T14:09:48.085 INFO:tasks.workunit.client.0.smithi153.stderr: -271> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding con mode: crc 2024-09-19T14:09:48.085 INFO:tasks.workunit.client.0.smithi153.stderr: -270> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding con mode: secure 2024-09-19T14:09:48.085 INFO:tasks.workunit.client.0.smithi153.stderr: -269> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding con mode: crc 2024-09-19T14:09:48.085 INFO:tasks.workunit.client.0.smithi153.stderr: -268> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f18b30) adding con mode: secure 2024-09-19T14:09:48.085 INFO:tasks.workunit.client.0.smithi153.stderr: -267> 2024-09-19T14:09:47.682+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.085 INFO:tasks.workunit.client.0.smithi153.stderr: -266> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.085 INFO:tasks.workunit.client.0.smithi153.stderr: -265> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command rotate-key cmddesc rotate-key hook 0x7ffcc3f18c78 EEXIST 2024-09-19T14:09:48.085 INFO:tasks.workunit.client.0.smithi153.stderr: -264> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: _reopen_session rank -1 2024-09-19T14:09:48.085 INFO:tasks.workunit.client.0.smithi153.stderr: -263> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T14:09:48.085 INFO:tasks.workunit.client.0.smithi153.stderr: -262> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): picked mon.noname-a con 0x562835e24bf0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:09:48.086 INFO:tasks.workunit.client.0.smithi153.stderr: -261> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): picked mon.noname-b con 0x562835e1ffe0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:09:48.086 INFO:tasks.workunit.client.0.smithi153.stderr: -260> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): picked mon.noname-c con 0x562835e16810 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:09:48.086 INFO:tasks.workunit.client.0.smithi153.stderr: -259> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:48.086 INFO:tasks.workunit.client.0.smithi153.stderr: -258> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:48.086 INFO:tasks.workunit.client.0.smithi153.stderr: -257> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:48.086 INFO:tasks.workunit.client.0.smithi153.stderr: -256> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): _renew_subs 2024-09-19T14:09:48.086 INFO:tasks.workunit.client.0.smithi153.stderr: -255> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): authenticate will time out at 2776.148304s 2024-09-19T14:09:48.086 INFO:tasks.workunit.client.0.smithi153.stderr: -254> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient(hunting): get_auth_request con 0x562835e24bf0 auth_method 0 2024-09-19T14:09:48.086 INFO:tasks.workunit.client.0.smithi153.stderr: -253> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:48.086 INFO:tasks.workunit.client.0.smithi153.stderr: -252> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:48.086 INFO:tasks.workunit.client.0.smithi153.stderr: -251> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:48.086 INFO:tasks.workunit.client.0.smithi153.stderr: -250> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): get_auth_request con 0x562835e16810 auth_method 0 2024-09-19T14:09:48.086 INFO:tasks.workunit.client.0.smithi153.stderr: -249> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:48.086 INFO:tasks.workunit.client.0.smithi153.stderr: -248> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:48.087 INFO:tasks.workunit.client.0.smithi153.stderr: -247> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:48.087 INFO:tasks.workunit.client.0.smithi153.stderr: -246> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:48.087 INFO:tasks.workunit.client.0.smithi153.stderr: -245> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:48.087 INFO:tasks.workunit.client.0.smithi153.stderr: -244> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:48.087 INFO:tasks.workunit.client.0.smithi153.stderr: -243> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:48.087 INFO:tasks.workunit.client.0.smithi153.stderr: -242> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:48.087 INFO:tasks.workunit.client.0.smithi153.stderr: -241> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:48.087 INFO:tasks.workunit.client.0.smithi153.stderr: -240> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient(hunting): get_auth_request con 0x562835e1ffe0 auth_method 0 2024-09-19T14:09:48.087 INFO:tasks.workunit.client.0.smithi153.stderr: -239> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:48.087 INFO:tasks.workunit.client.0.smithi153.stderr: -238> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:48.087 INFO:tasks.workunit.client.0.smithi153.stderr: -237> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:48.087 INFO:tasks.workunit.client.0.smithi153.stderr: -236> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient(hunting): handle_auth_done global_id 7494 payload 274 2024-09-19T14:09:48.087 INFO:tasks.workunit.client.0.smithi153.stderr: -235> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient: _finish_hunting 0 2024-09-19T14:09:48.087 INFO:tasks.workunit.client.0.smithi153.stderr: -234> 2024-09-19T14:09:47.686+0000 7fd181be8640 1 monclient: found mon.noname-a 2024-09-19T14:09:48.087 INFO:tasks.workunit.client.0.smithi153.stderr: -233> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:09:48.087 INFO:tasks.workunit.client.0.smithi153.stderr: -232> 2024-09-19T14:09:47.686+0000 7fd0657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:48.088 INFO:tasks.workunit.client.0.smithi153.stderr: -231> 2024-09-19T14:09:47.686+0000 7fd0657fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:09:48.088 INFO:tasks.workunit.client.0.smithi153.stderr: -230> 2024-09-19T14:09:47.686+0000 7fd0657fa640 10 monclient: dump: 2024-09-19T14:09:48.088 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:48.088 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:48.088 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.088 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.088 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:48.088 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.088 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:48.088 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:48.088 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:48.088 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.088 INFO:tasks.workunit.client.0.smithi153.stderr: -229> 2024-09-19T14:09:47.686+0000 7fd0657fa640 10 monclient: _finish_auth 0 2024-09-19T14:09:48.088 INFO:tasks.workunit.client.0.smithi153.stderr: -228> 2024-09-19T14:09:47.686+0000 7fd0657fa640 10 monclient: _check_auth_tickets 2024-09-19T14:09:48.089 INFO:tasks.workunit.client.0.smithi153.stderr: -227> 2024-09-19T14:09:47.686+0000 7fd0657fa640 10 monclient: handle_config config(0 keys) 2024-09-19T14:09:48.089 INFO:tasks.workunit.client.0.smithi153.stderr: -226> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 monclient: authenticate success, global_id 7494 2024-09-19T14:09:48.089 INFO:tasks.workunit.client.0.smithi153.stderr: -225> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: get_monmap_and_config success 2024-09-19T14:09:48.089 INFO:tasks.workunit.client.0.smithi153.stderr: -224> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 4 set_mon_vals no callback set 2024-09-19T14:09:48.089 INFO:tasks.workunit.client.0.smithi153.stderr: -223> 2024-09-19T14:09:47.686+0000 7fd0657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:48.089 INFO:tasks.workunit.client.0.smithi153.stderr: -222> 2024-09-19T14:09:47.686+0000 7fd0657fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:09:48.089 INFO:tasks.workunit.client.0.smithi153.stderr: -221> 2024-09-19T14:09:47.686+0000 7fd0657fa640 10 monclient: dump: 2024-09-19T14:09:48.089 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:48.089 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:48.089 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.089 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.089 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:48.089 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.090 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:48.090 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:48.090 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:48.090 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.090 INFO:tasks.workunit.client.0.smithi153.stderr: -220> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: shutdown 2024-09-19T14:09:48.090 INFO:tasks.workunit.client.0.smithi153.stderr: -219> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: build_initial_monmap 2024-09-19T14:09:48.090 INFO:tasks.workunit.client.0.smithi153.stderr: -218> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 1 build_initial for_mkfs: 0 2024-09-19T14:09:48.090 INFO:tasks.workunit.client.0.smithi153.stderr: -217> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: monmap: 2024-09-19T14:09:48.090 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:09:48.090 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:09:48.090 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:09:48.090 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:09:48.090 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:09:48.090 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.091 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:09:48.091 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:09:48.091 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:09:48.091 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.091 INFO:tasks.workunit.client.0.smithi153.stderr: -216> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding auth protocol: cephx 2024-09-19T14:09:48.091 INFO:tasks.workunit.client.0.smithi153.stderr: -215> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding auth protocol: cephx 2024-09-19T14:09:48.091 INFO:tasks.workunit.client.0.smithi153.stderr: -214> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding auth protocol: cephx 2024-09-19T14:09:48.091 INFO:tasks.workunit.client.0.smithi153.stderr: -213> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding con mode: secure 2024-09-19T14:09:48.091 INFO:tasks.workunit.client.0.smithi153.stderr: -212> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding con mode: crc 2024-09-19T14:09:48.091 INFO:tasks.workunit.client.0.smithi153.stderr: -211> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding con mode: secure 2024-09-19T14:09:48.091 INFO:tasks.workunit.client.0.smithi153.stderr: -210> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding con mode: crc 2024-09-19T14:09:48.091 INFO:tasks.workunit.client.0.smithi153.stderr: -209> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding con mode: secure 2024-09-19T14:09:48.091 INFO:tasks.workunit.client.0.smithi153.stderr: -208> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding con mode: crc 2024-09-19T14:09:48.092 INFO:tasks.workunit.client.0.smithi153.stderr: -207> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding con mode: crc 2024-09-19T14:09:48.092 INFO:tasks.workunit.client.0.smithi153.stderr: -206> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding con mode: secure 2024-09-19T14:09:48.092 INFO:tasks.workunit.client.0.smithi153.stderr: -205> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding con mode: crc 2024-09-19T14:09:48.092 INFO:tasks.workunit.client.0.smithi153.stderr: -204> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding con mode: secure 2024-09-19T14:09:48.092 INFO:tasks.workunit.client.0.smithi153.stderr: -203> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding con mode: crc 2024-09-19T14:09:48.092 INFO:tasks.workunit.client.0.smithi153.stderr: -202> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835e20de0) adding con mode: secure 2024-09-19T14:09:48.092 INFO:tasks.workunit.client.0.smithi153.stderr: -201> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.092 INFO:tasks.workunit.client.0.smithi153.stderr: -200> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 1 librados: starting msgr at 2024-09-19T14:09:48.092 INFO:tasks.workunit.client.0.smithi153.stderr: -199> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 1 librados: starting objecter 2024-09-19T14:09:48.092 INFO:tasks.workunit.client.0.smithi153.stderr: -198> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command objecter_requests cmddesc objecter_requests hook 0x562835df4c20 EEXIST 2024-09-19T14:09:48.092 INFO:tasks.workunit.client.0.smithi153.stderr: -197> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 1 librados: setting wanted keys 2024-09-19T14:09:48.092 INFO:tasks.workunit.client.0.smithi153.stderr: -196> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 1 librados: calling monclient init 2024-09-19T14:09:48.092 INFO:tasks.workunit.client.0.smithi153.stderr: -195> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: init 2024-09-19T14:09:48.092 INFO:tasks.workunit.client.0.smithi153.stderr: -194> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding auth protocol: cephx 2024-09-19T14:09:48.093 INFO:tasks.workunit.client.0.smithi153.stderr: -193> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding auth protocol: cephx 2024-09-19T14:09:48.093 INFO:tasks.workunit.client.0.smithi153.stderr: -192> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding auth protocol: cephx 2024-09-19T14:09:48.093 INFO:tasks.workunit.client.0.smithi153.stderr: -191> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding con mode: secure 2024-09-19T14:09:48.093 INFO:tasks.workunit.client.0.smithi153.stderr: -190> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding con mode: crc 2024-09-19T14:09:48.093 INFO:tasks.workunit.client.0.smithi153.stderr: -189> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding con mode: secure 2024-09-19T14:09:48.093 INFO:tasks.workunit.client.0.smithi153.stderr: -188> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding con mode: crc 2024-09-19T14:09:48.093 INFO:tasks.workunit.client.0.smithi153.stderr: -187> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding con mode: secure 2024-09-19T14:09:48.093 INFO:tasks.workunit.client.0.smithi153.stderr: -186> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding con mode: crc 2024-09-19T14:09:48.093 INFO:tasks.workunit.client.0.smithi153.stderr: -185> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding con mode: crc 2024-09-19T14:09:48.093 INFO:tasks.workunit.client.0.smithi153.stderr: -184> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding con mode: secure 2024-09-19T14:09:48.094 INFO:tasks.workunit.client.0.smithi153.stderr: -183> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding con mode: crc 2024-09-19T14:09:48.094 INFO:tasks.workunit.client.0.smithi153.stderr: -182> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding con mode: secure 2024-09-19T14:09:48.094 INFO:tasks.workunit.client.0.smithi153.stderr: -181> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding con mode: crc 2024-09-19T14:09:48.094 INFO:tasks.workunit.client.0.smithi153.stderr: -180> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 AuthRegistry(0x562835dd2b50) adding con mode: secure 2024-09-19T14:09:48.094 INFO:tasks.workunit.client.0.smithi153.stderr: -179> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.094 INFO:tasks.workunit.client.0.smithi153.stderr: -178> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.094 INFO:tasks.workunit.client.0.smithi153.stderr: -177> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command rotate-key cmddesc rotate-key hook 0x562835dd2c98 EEXIST 2024-09-19T14:09:48.094 INFO:tasks.workunit.client.0.smithi153.stderr: -176> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: _reopen_session rank -1 2024-09-19T14:09:48.094 INFO:tasks.workunit.client.0.smithi153.stderr: -175> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T14:09:48.094 INFO:tasks.workunit.client.0.smithi153.stderr: -174> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): picked mon.noname-b con 0x562835e16810 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:09:48.094 INFO:tasks.workunit.client.0.smithi153.stderr: -173> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): picked mon.noname-c con 0x562835e1ffe0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:09:48.094 INFO:tasks.workunit.client.0.smithi153.stderr: -172> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): picked mon.noname-a con 0x562835e24bf0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:09:48.094 INFO:tasks.workunit.client.0.smithi153.stderr: -171> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:48.095 INFO:tasks.workunit.client.0.smithi153.stderr: -170> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:48.095 INFO:tasks.workunit.client.0.smithi153.stderr: -169> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:09:48.095 INFO:tasks.workunit.client.0.smithi153.stderr: -168> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): _renew_subs 2024-09-19T14:09:48.095 INFO:tasks.workunit.client.0.smithi153.stderr: -167> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient(hunting): authenticate will time out at 2776.150862s 2024-09-19T14:09:48.095 INFO:tasks.workunit.client.0.smithi153.stderr: -166> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient(hunting): get_auth_request con 0x562835e1ffe0 auth_method 0 2024-09-19T14:09:48.095 INFO:tasks.workunit.client.0.smithi153.stderr: -165> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:48.095 INFO:tasks.workunit.client.0.smithi153.stderr: -164> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:48.095 INFO:tasks.workunit.client.0.smithi153.stderr: -163> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:48.095 INFO:tasks.workunit.client.0.smithi153.stderr: -162> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): get_auth_request con 0x562835e24bf0 auth_method 0 2024-09-19T14:09:48.095 INFO:tasks.workunit.client.0.smithi153.stderr: -161> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:48.095 INFO:tasks.workunit.client.0.smithi153.stderr: -160> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:48.095 INFO:tasks.workunit.client.0.smithi153.stderr: -159> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:48.095 INFO:tasks.workunit.client.0.smithi153.stderr: -158> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:48.096 INFO:tasks.workunit.client.0.smithi153.stderr: -157> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:48.096 INFO:tasks.workunit.client.0.smithi153.stderr: -156> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:48.096 INFO:tasks.workunit.client.0.smithi153.stderr: -155> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:09:48.096 INFO:tasks.workunit.client.0.smithi153.stderr: -154> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:09:48.096 INFO:tasks.workunit.client.0.smithi153.stderr: -153> 2024-09-19T14:09:47.686+0000 7fd1823e9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:09:48.096 INFO:tasks.workunit.client.0.smithi153.stderr: -152> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient(hunting): get_auth_request con 0x562835e16810 auth_method 0 2024-09-19T14:09:48.096 INFO:tasks.workunit.client.0.smithi153.stderr: -151> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:09:48.096 INFO:tasks.workunit.client.0.smithi153.stderr: -150> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:09:48.096 INFO:tasks.workunit.client.0.smithi153.stderr: -149> 2024-09-19T14:09:47.686+0000 7fd181be8640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:09:48.096 INFO:tasks.workunit.client.0.smithi153.stderr: -148> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient(hunting): handle_auth_done global_id 7031 payload 824 2024-09-19T14:09:48.096 INFO:tasks.workunit.client.0.smithi153.stderr: -147> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient: _finish_hunting 0 2024-09-19T14:09:48.096 INFO:tasks.workunit.client.0.smithi153.stderr: -146> 2024-09-19T14:09:47.686+0000 7fd1813e7640 1 monclient: found mon.noname-c 2024-09-19T14:09:48.097 INFO:tasks.workunit.client.0.smithi153.stderr: -145> 2024-09-19T14:09:47.686+0000 7fd1813e7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:09:48.097 INFO:tasks.workunit.client.0.smithi153.stderr: -144> 2024-09-19T14:09:47.686+0000 7fd0537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:48.097 INFO:tasks.workunit.client.0.smithi153.stderr: -143> 2024-09-19T14:09:47.686+0000 7fd0537fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:09:48.097 INFO:tasks.workunit.client.0.smithi153.stderr: -142> 2024-09-19T14:09:47.686+0000 7fd0537fe640 10 monclient: dump: 2024-09-19T14:09:48.097 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:48.097 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:48.097 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.097 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.097 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:48.097 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.098 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:48.098 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:48.098 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:48.098 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.098 INFO:tasks.workunit.client.0.smithi153.stderr: -141> 2024-09-19T14:09:47.686+0000 7fd0537fe640 10 monclient: _finish_auth 0 2024-09-19T14:09:48.098 INFO:tasks.workunit.client.0.smithi153.stderr: -140> 2024-09-19T14:09:47.686+0000 7fd0537fe640 10 monclient: _check_auth_tickets 2024-09-19T14:09:48.098 INFO:tasks.workunit.client.0.smithi153.stderr: -139> 2024-09-19T14:09:47.686+0000 7fd0537fe640 10 monclient: handle_config config(0 keys) 2024-09-19T14:09:48.098 INFO:tasks.workunit.client.0.smithi153.stderr: -138> 2024-09-19T14:09:47.686+0000 7fd0537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:09:48.098 INFO:tasks.workunit.client.0.smithi153.stderr: -137> 2024-09-19T14:09:47.686+0000 7fd0537fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:09:48.098 INFO:tasks.workunit.client.0.smithi153.stderr: -136> 2024-09-19T14:09:47.686+0000 7fd0537fe640 10 monclient: dump: 2024-09-19T14:09:48.098 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:09:48.098 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:09:48.098 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.098 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:09:48.098 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:09:48.099 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:09:48.099 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:09:48.099 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:09:48.099 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:09:48.099 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.099 INFO:tasks.workunit.client.0.smithi153.stderr: -135> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 monclient: authenticate success, global_id 7031 2024-09-19T14:09:48.099 INFO:tasks.workunit.client.0.smithi153.stderr: -134> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: _renew_subs 2024-09-19T14:09:48.099 INFO:tasks.workunit.client.0.smithi153.stderr: -133> 2024-09-19T14:09:47.686+0000 7fd0657fa640 4 set_mon_vals no callback set 2024-09-19T14:09:48.099 INFO:tasks.workunit.client.0.smithi153.stderr: -132> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:09:48.099 INFO:tasks.workunit.client.0.smithi153.stderr: -131> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: _renew_subs 2024-09-19T14:09:48.099 INFO:tasks.workunit.client.0.smithi153.stderr: -130> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:09:48.099 INFO:tasks.workunit.client.0.smithi153.stderr: -129> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 1 librados: init done 2024-09-19T14:09:48.099 INFO:tasks.workunit.client.0.smithi153.stderr: -128> 2024-09-19T14:09:47.686+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command cr dump hook 0x562835e1f2c8 2024-09-19T14:09:48.099 INFO:tasks.workunit.client.0.smithi153.stderr: -127> 2024-09-19T14:09:47.690+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.099 INFO:tasks.workunit.client.0.smithi153.stderr: -126> 2024-09-19T14:09:47.690+0000 7fd0537fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:09:48.100 INFO:tasks.workunit.client.0.smithi153.stderr: -125> 2024-09-19T14:09:47.690+0000 7fd0537fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:09:48.100 INFO:tasks.workunit.client.0.smithi153.stderr: -124> 2024-09-19T14:09:47.690+0000 7fd0537fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:09:48.100 INFO:tasks.workunit.client.0.smithi153.stderr: -123> 2024-09-19T14:09:47.690+0000 7fd181be8640 10 monclient: get_auth_request con 0x7fd04c071c10 auth_method 0 2024-09-19T14:09:48.100 INFO:tasks.workunit.client.0.smithi153.stderr: -122> 2024-09-19T14:09:47.690+0000 7fd1823e9640 10 monclient: get_auth_request con 0x562835e3e3e0 auth_method 0 2024-09-19T14:09:48.100 INFO:tasks.workunit.client.0.smithi153.stderr: -121> 2024-09-19T14:09:47.690+0000 7fd1840e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.100 INFO:tasks.workunit.client.0.smithi153.stderr: -120> 2024-09-19T14:09:47.690+0000 7fd1840e29c0 20 realm 2024-09-19T14:09:48.100 INFO:tasks.workunit.client.0.smithi153.stderr: -119> 2024-09-19T14:09:47.690+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.100 INFO:tasks.workunit.client.0.smithi153.stderr: -118> 2024-09-19T14:09:47.690+0000 7fd1840e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.100 INFO:tasks.workunit.client.0.smithi153.stderr: -117> 2024-09-19T14:09:47.690+0000 7fd1840e29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:09:48.100 INFO:tasks.workunit.client.0.smithi153.stderr: -116> 2024-09-19T14:09:47.690+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.100 INFO:tasks.workunit.client.0.smithi153.stderr: -115> 2024-09-19T14:09:47.690+0000 7fd1840e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.100 INFO:tasks.workunit.client.0.smithi153.stderr: -114> 2024-09-19T14:09:47.690+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.100 INFO:tasks.workunit.client.0.smithi153.stderr: -113> 2024-09-19T14:09:47.690+0000 7fd181be8640 10 monclient: get_auth_request con 0x562835e42530 auth_method 0 2024-09-19T14:09:48.100 INFO:tasks.workunit.client.0.smithi153.stderr: -112> 2024-09-19T14:09:47.694+0000 7fd1840e29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:48.101 INFO:tasks.workunit.client.0.smithi153.stderr: -111> 2024-09-19T14:09:47.694+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.101 INFO:tasks.workunit.client.0.smithi153.stderr: -110> 2024-09-19T14:09:47.694+0000 7fd1840e29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:09:48.101 INFO:tasks.workunit.client.0.smithi153.stderr: -109> 2024-09-19T14:09:47.694+0000 7fd1840e29c0 20 searching for the correct realm 2024-09-19T14:09:48.101 INFO:tasks.workunit.client.0.smithi153.stderr: -108> 2024-09-19T14:09:47.694+0000 7fd1813e7640 10 monclient: get_auth_request con 0x562835e47740 auth_method 0 2024-09-19T14:09:48.101 INFO:tasks.workunit.client.0.smithi153.stderr: -107> 2024-09-19T14:09:47.694+0000 7fd1823e9640 10 monclient: get_auth_request con 0x7fd17801a040 auth_method 0 2024-09-19T14:09:48.101 INFO:tasks.workunit.client.0.smithi153.stderr: -106> 2024-09-19T14:09:47.694+0000 7fd181be8640 10 monclient: get_auth_request con 0x7fd17c0c6920 auth_method 0 2024-09-19T14:09:48.101 INFO:tasks.workunit.client.0.smithi153.stderr: -105> 2024-09-19T14:09:47.698+0000 7fd1813e7640 10 monclient: get_auth_request con 0x7fd17405c3f0 auth_method 0 2024-09-19T14:09:48.101 INFO:tasks.workunit.client.0.smithi153.stderr: -104> 2024-09-19T14:09:47.698+0000 7fd1813e7640 0 -- 172.21.15.153:0/4029659940 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fd17405c3f0 msgr2=0x7fd17405ea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:48.101 INFO:tasks.workunit.client.0.smithi153.stderr: -103> 2024-09-19T14:09:47.698+0000 7fd0537fe640 1 client.7031.objecter ms_handle_reset 0x7fd17405c3f0 session 0x7fd174059070 osd.4 2024-09-19T14:09:48.101 INFO:tasks.workunit.client.0.smithi153.stderr: -102> 2024-09-19T14:09:47.698+0000 7fd0537fe640 10 monclient: _renew_subs 2024-09-19T14:09:48.101 INFO:tasks.workunit.client.0.smithi153.stderr: -101> 2024-09-19T14:09:47.698+0000 7fd0537fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:09:48.101 INFO:tasks.workunit.client.0.smithi153.stderr: -100> 2024-09-19T14:09:47.698+0000 7fd1813e7640 10 monclient: get_auth_request con 0x7fd04c082340 auth_method 0 2024-09-19T14:09:48.101 INFO:tasks.workunit.client.0.smithi153.stderr: -99> 2024-09-19T14:09:47.702+0000 7fd1823e9640 10 monclient: get_auth_request con 0x562835c9afd0 auth_method 0 2024-09-19T14:09:48.102 INFO:tasks.workunit.client.0.smithi153.stderr: -98> 2024-09-19T14:09:47.706+0000 7fd181be8640 10 monclient: get_auth_request con 0x7fd1780a2330 auth_method 0 2024-09-19T14:09:48.102 INFO:tasks.workunit.client.0.smithi153.stderr: -97> 2024-09-19T14:09:47.706+0000 7fd181be8640 0 -- 172.21.15.153:0/4029659940 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fd1780a2330 msgr2=0x7fd178002860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:48.102 INFO:tasks.workunit.client.0.smithi153.stderr: -96> 2024-09-19T14:09:47.910+0000 7fd181be8640 10 monclient: get_auth_request con 0x7fd1780a2330 auth_method 0 2024-09-19T14:09:48.102 INFO:tasks.workunit.client.0.smithi153.stderr: -95> 2024-09-19T14:09:47.914+0000 7fd0537fe640 1 client.7031.objecter ms_handle_reset 0x562835e42530 session 0x562835e41eb0 osd.5 2024-09-19T14:09:48.102 INFO:tasks.workunit.client.0.smithi153.stderr: -94> 2024-09-19T14:09:47.914+0000 7fd181be8640 10 monclient: get_auth_request con 0x7fd17405c3f0 auth_method 0 2024-09-19T14:09:48.102 INFO:tasks.workunit.client.0.smithi153.stderr: -93> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:09:48.102 INFO:tasks.workunit.client.0.smithi153.stderr: -92> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:09:48.102 INFO:tasks.workunit.client.0.smithi153.stderr: -91> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:09:48.102 INFO:tasks.workunit.client.0.smithi153.stderr: -90> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:09:48.102 INFO:tasks.workunit.client.0.smithi153.stderr: -89> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:09:48.102 INFO:tasks.workunit.client.0.smithi153.stderr: -88> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:09:48.102 INFO:tasks.workunit.client.0.smithi153.stderr: -87> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.102 INFO:tasks.workunit.client.0.smithi153.stderr: -86> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.102 INFO:tasks.workunit.client.0.smithi153.stderr: -85> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.103 INFO:tasks.workunit.client.0.smithi153.stderr: -84> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:48.103 INFO:tasks.workunit.client.0.smithi153.stderr: -83> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.103 INFO:tasks.workunit.client.0.smithi153.stderr: -82> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:09:48.103 INFO:tasks.workunit.client.0.smithi153.stderr: -81> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 zone default found 2024-09-19T14:09:48.103 INFO:tasks.workunit.client.0.smithi153.stderr: -80> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 4 Realm: () 2024-09-19T14:09:48.103 INFO:tasks.workunit.client.0.smithi153.stderr: -79> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:09:48.103 INFO:tasks.workunit.client.0.smithi153.stderr: -78> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:09:48.103 INFO:tasks.workunit.client.0.smithi153.stderr: -77> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:09:48.103 INFO:tasks.workunit.client.0.smithi153.stderr: -76> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 zonegroup default 2024-09-19T14:09:48.103 INFO:tasks.workunit.client.0.smithi153.stderr: -75> 2024-09-19T14:09:47.926+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.103 INFO:tasks.workunit.client.0.smithi153.stderr: -74> 2024-09-19T14:09:47.930+0000 7fd1840e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.103 INFO:tasks.workunit.client.0.smithi153.stderr: -73> 2024-09-19T14:09:47.930+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.103 INFO:tasks.workunit.client.0.smithi153.stderr: -72> 2024-09-19T14:09:47.930+0000 7fd1840e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.103 INFO:tasks.workunit.client.0.smithi153.stderr: -71> 2024-09-19T14:09:47.930+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.104 INFO:tasks.workunit.client.0.smithi153.stderr: -70> 2024-09-19T14:09:47.930+0000 7fd1840e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.104 INFO:tasks.workunit.client.0.smithi153.stderr: -69> 2024-09-19T14:09:47.930+0000 7fd1840e29c0 20 started sync module instance, tier type = 2024-09-19T14:09:48.104 INFO:tasks.workunit.client.0.smithi153.stderr: -68> 2024-09-19T14:09:47.930+0000 7fd1840e29c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:09:48.104 INFO:tasks.workunit.client.0.smithi153.stderr: -67> 2024-09-19T14:09:47.950+0000 7fd1840e29c0 20 add_watcher() i=0 2024-09-19T14:09:48.104 INFO:tasks.workunit.client.0.smithi153.stderr: -66> 2024-09-19T14:09:47.950+0000 7fd1840e29c0 20 add_watcher() i=1 2024-09-19T14:09:48.104 INFO:tasks.workunit.client.0.smithi153.stderr: -65> 2024-09-19T14:09:47.950+0000 7fd1840e29c0 20 add_watcher() i=2 2024-09-19T14:09:48.104 INFO:tasks.workunit.client.0.smithi153.stderr: -64> 2024-09-19T14:09:47.950+0000 7fd1840e29c0 20 add_watcher() i=3 2024-09-19T14:09:48.104 INFO:tasks.workunit.client.0.smithi153.stderr: -63> 2024-09-19T14:09:47.950+0000 7fd1840e29c0 20 add_watcher() i=4 2024-09-19T14:09:48.104 INFO:tasks.workunit.client.0.smithi153.stderr: -62> 2024-09-19T14:09:47.950+0000 7fd1840e29c0 20 add_watcher() i=5 2024-09-19T14:09:48.104 INFO:tasks.workunit.client.0.smithi153.stderr: -61> 2024-09-19T14:09:47.950+0000 7fd1840e29c0 20 add_watcher() i=6 2024-09-19T14:09:48.104 INFO:tasks.workunit.client.0.smithi153.stderr: -60> 2024-09-19T14:09:47.954+0000 7fd1840e29c0 20 add_watcher() i=7 2024-09-19T14:09:48.104 INFO:tasks.workunit.client.0.smithi153.stderr: -59> 2024-09-19T14:09:47.954+0000 7fd1840e29c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:09:48.104 INFO:tasks.workunit.client.0.smithi153.stderr: -58> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding auth protocol: cephx 2024-09-19T14:09:48.104 INFO:tasks.workunit.client.0.smithi153.stderr: -57> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding auth protocol: cephx 2024-09-19T14:09:48.104 INFO:tasks.workunit.client.0.smithi153.stderr: -56> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding auth protocol: cephx 2024-09-19T14:09:48.105 INFO:tasks.workunit.client.0.smithi153.stderr: -55> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding con mode: secure 2024-09-19T14:09:48.105 INFO:tasks.workunit.client.0.smithi153.stderr: -54> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding con mode: crc 2024-09-19T14:09:48.105 INFO:tasks.workunit.client.0.smithi153.stderr: -53> 2024-09-19T14:09:47.958+0000 7fd0337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:48.105 INFO:tasks.workunit.client.0.smithi153.stderr: -52> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding con mode: secure 2024-09-19T14:09:48.105 INFO:tasks.workunit.client.0.smithi153.stderr: -51> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding con mode: crc 2024-09-19T14:09:48.105 INFO:tasks.workunit.client.0.smithi153.stderr: -50> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding con mode: secure 2024-09-19T14:09:48.105 INFO:tasks.workunit.client.0.smithi153.stderr: -49> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding con mode: crc 2024-09-19T14:09:48.105 INFO:tasks.workunit.client.0.smithi153.stderr: -48> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding con mode: crc 2024-09-19T14:09:48.105 INFO:tasks.workunit.client.0.smithi153.stderr: -47> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding con mode: secure 2024-09-19T14:09:48.105 INFO:tasks.workunit.client.0.smithi153.stderr: -46> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding con mode: crc 2024-09-19T14:09:48.105 INFO:tasks.workunit.client.0.smithi153.stderr: -45> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding con mode: secure 2024-09-19T14:09:48.105 INFO:tasks.workunit.client.0.smithi153.stderr: -44> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding con mode: crc 2024-09-19T14:09:48.105 INFO:tasks.workunit.client.0.smithi153.stderr: -43> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 AuthRegistry(0x7ffcc3f19000) adding con mode: secure 2024-09-19T14:09:48.105 INFO:tasks.workunit.client.0.smithi153.stderr: -42> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:09:48.106 INFO:tasks.workunit.client.0.smithi153.stderr: -41> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:09:48.106 INFO:tasks.workunit.client.0.smithi153.stderr: -40> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:09:48.106 INFO:tasks.workunit.client.0.smithi153.stderr: -39> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command cache list hook 0x562835e1e250 2024-09-19T14:09:48.106 INFO:tasks.workunit.client.0.smithi153.stderr: -38> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command cache inspect hook 0x562835e1e250 2024-09-19T14:09:48.106 INFO:tasks.workunit.client.0.smithi153.stderr: -37> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command cache erase hook 0x562835e1e250 2024-09-19T14:09:48.106 INFO:tasks.workunit.client.0.smithi153.stderr: -36> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command cache zap hook 0x562835e1e250 2024-09-19T14:09:48.106 INFO:tasks.workunit.client.0.smithi153.stderr: -35> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 note: GC not initialized 2024-09-19T14:09:48.106 INFO:tasks.workunit.client.0.smithi153.stderr: -34> 2024-09-19T14:09:47.958+0000 7fd0327fc640 20 reqs_thread_entry: start 2024-09-19T14:09:48.106 INFO:tasks.workunit.client.0.smithi153.stderr: -33> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command sync trace show hook 0x7fd1740043b0 2024-09-19T14:09:48.106 INFO:tasks.workunit.client.0.smithi153.stderr: -32> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command sync trace history hook 0x7fd1740043b0 2024-09-19T14:09:48.106 INFO:tasks.workunit.client.0.smithi153.stderr: -31> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command sync trace active hook 0x7fd1740043b0 2024-09-19T14:09:48.106 INFO:tasks.workunit.client.0.smithi153.stderr: -30> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 5 asok(0x562835b49d90) register_command sync trace active_short hook 0x7fd1740043b0 2024-09-19T14:09:48.106 INFO:tasks.workunit.client.0.smithi153.stderr: -29> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 20 init_complete bucket index max shards: 11 2024-09-19T14:09:48.106 INFO:tasks.workunit.client.0.smithi153.stderr: -28> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 20 Filter name: none 2024-09-19T14:09:48.107 INFO:tasks.workunit.client.0.smithi153.stderr: -27> 2024-09-19T14:09:47.958+0000 7fcfa3fff640 20 reqs_thread_entry: start 2024-09-19T14:09:48.107 INFO:tasks.workunit.client.0.smithi153.stderr: -26> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-19T14:09:48.107 INFO:tasks.workunit.client.0.smithi153.stderr: -25> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.107 INFO:tasks.workunit.client.0.smithi153.stderr: -24> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:09:48.107 INFO:tasks.workunit.client.0.smithi153.stderr: -23> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-19T14:09:48.107 INFO:tasks.workunit.client.0.smithi153.stderr: -22> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-19T14:09:48.107 INFO:tasks.workunit.client.0.smithi153.stderr: -21> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 : miss 2024-09-19T14:09:48.107 INFO:tasks.workunit.client.0.smithi153.stderr: -20> 2024-09-19T14:09:47.958+0000 7fd1840e29c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.107 INFO:tasks.workunit.client.0.smithi153.stderr: -19> 2024-09-19T14:09:47.962+0000 7fd1840e29c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:09:48.107 INFO:tasks.workunit.client.0.smithi153.stderr: -18> 2024-09-19T14:09:47.962+0000 7fd1840e29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 info.flags=0x17 2024-09-19T14:09:48.107 INFO:tasks.workunit.client.0.smithi153.stderr: -17> 2024-09-19T14:09:47.962+0000 7fd1840e29c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 to cache LRU end 2024-09-19T14:09:48.107 INFO:tasks.workunit.client.0.smithi153.stderr: -16> 2024-09-19T14:09:47.962+0000 7fd1840e29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:09:48.107 INFO:tasks.workunit.client.0.smithi153.stderr: -15> 2024-09-19T14:09:47.962+0000 7fd1840e29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:48.107 INFO:tasks.workunit.client.0.smithi153.stderr: -14> 2024-09-19T14:09:47.962+0000 7fd1840e29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 2024-09-19T14:09:48.107 INFO:tasks.workunit.client.0.smithi153.stderr: -13> 2024-09-19T14:09:47.970+0000 7fd1840e29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 info.flags=0x17 2024-09-19T14:09:48.108 INFO:tasks.workunit.client.0.smithi153.stderr: -12> 2024-09-19T14:09:47.970+0000 7fd1840e29c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 to cache LRU end 2024-09-19T14:09:48.108 INFO:tasks.workunit.client.0.smithi153.stderr: -11> 2024-09-19T14:09:47.970+0000 7fd1840e29c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:48.108 INFO:tasks.workunit.client.0.smithi153.stderr: -10> 2024-09-19T14:09:47.970+0000 7fd1840e29c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34, ofs0, ns] 2024-09-19T14:09:48.108 INFO:tasks.workunit.client.0.smithi153.stderr: -9> 2024-09-19T14:09:47.970+0000 7fd0657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333501 cookie 94730702858816 notifier 7031 bl.length()=911 2024-09-19T14:09:48.108 INFO:tasks.workunit.client.0.smithi153.stderr: -8> 2024-09-19T14:09:47.970+0000 7fd0657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 info.flags=0x17 2024-09-19T14:09:48.108 INFO:tasks.workunit.client.0.smithi153.stderr: -7> 2024-09-19T14:09:47.970+0000 7fd0657fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 to cache LRU end 2024-09-19T14:09:48.108 INFO:tasks.workunit.client.0.smithi153.stderr: -6> 2024-09-19T14:09:47.970+0000 7fd0657fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:48.108 INFO:tasks.workunit.client.0.smithi153.stderr: -5> 2024-09-19T14:09:47.978+0000 7fd1840e29c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.34]): orig_sources= new_sources= 2024-09-19T14:09:48.108 INFO:tasks.workunit.client.0.smithi153.stderr: -4> 2024-09-19T14:09:47.978+0000 7fd1840e29c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.34]): potential sources added=[] removed=[] 2024-09-19T14:09:48.108 INFO:tasks.workunit.client.0.smithi153.stderr: -3> 2024-09-19T14:09:47.978+0000 7fd1840e29c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.34]): orig_dests= new_dests= 2024-09-19T14:09:48.108 INFO:tasks.workunit.client.0.smithi153.stderr: -2> 2024-09-19T14:09:47.978+0000 7fd1840e29c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.34]): potential dests added=[] removed=[] 2024-09-19T14:09:48.108 INFO:tasks.workunit.client.0.smithi153.stderr: -1> 2024-09-19T14:09:47.986+0000 7fd1840e29c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd1840e29c0 time 2024-09-19T14:09:47.988509+0000 2024-09-19T14:09:48.108 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:09:48.109 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.109 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:09:48.109 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd1879bc2eb] 2024-09-19T14:09:48.109 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd1879bc49f] 2024-09-19T14:09:48.109 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562833833271] 2024-09-19T14:09:48.109 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56283384314a] 2024-09-19T14:09:48.109 INFO:tasks.workunit.client.0.smithi153.stderr: 5: main() 2024-09-19T14:09:48.109 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd186822d90] 2024-09-19T14:09:48.109 INFO:tasks.workunit.client.0.smithi153.stderr: 7: __libc_start_main() 2024-09-19T14:09:48.109 INFO:tasks.workunit.client.0.smithi153.stderr: 8: _start() 2024-09-19T14:09:48.109 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.109 INFO:tasks.workunit.client.0.smithi153.stderr: 0> 2024-09-19T14:09:47.986+0000 7fd1840e29c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:09:48.109 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7fd1840e29c0 thread_name:radosgw-admin 2024-09-19T14:09:48.109 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.109 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:09:48.110 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd18683b520] 2024-09-19T14:09:48.110 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:09:48.110 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:09:48.110 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:09:48.110 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd1879bc345] 2024-09-19T14:09:48.110 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd1879bc49f] 2024-09-19T14:09:48.110 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562833833271] 2024-09-19T14:09:48.110 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56283384314a] 2024-09-19T14:09:48.110 INFO:tasks.workunit.client.0.smithi153.stderr: 9: main() 2024-09-19T14:09:48.110 INFO:tasks.workunit.client.0.smithi153.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd186822d90] 2024-09-19T14:09:48.110 INFO:tasks.workunit.client.0.smithi153.stderr: 11: __libc_start_main() 2024-09-19T14:09:48.110 INFO:tasks.workunit.client.0.smithi153.stderr: 12: _start() 2024-09-19T14:09:48.110 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:09:48.111 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.111 INFO:tasks.workunit.client.0.smithi153.stderr:--- logging levels --- 2024-09-19T14:09:48.111 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 none 2024-09-19T14:09:48.111 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 lockdep 2024-09-19T14:09:48.111 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 context 2024-09-19T14:09:48.111 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 crush 2024-09-19T14:09:48.111 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds 2024-09-19T14:09:48.111 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_balancer 2024-09-19T14:09:48.111 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_locker 2024-09-19T14:09:48.111 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log 2024-09-19T14:09:48.111 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log_expire 2024-09-19T14:09:48.111 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_migrator 2024-09-19T14:09:48.111 INFO:tasks.workunit.client.0.smithi153.stderr: 3/ 5 mds_quiesce 2024-09-19T14:09:48.112 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 buffer 2024-09-19T14:09:48.112 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 timer 2024-09-19T14:09:48.112 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 filer 2024-09-19T14:09:48.112 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 striper 2024-09-19T14:09:48.112 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 objecter 2024-09-19T14:09:48.112 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rados 2024-09-19T14:09:48.112 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd 2024-09-19T14:09:48.112 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_mirror 2024-09-19T14:09:48.112 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_replay 2024-09-19T14:09:48.112 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_pwl 2024-09-19T14:09:48.112 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 journaler 2024-09-19T14:09:48.112 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objectcacher 2024-09-19T14:09:48.112 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:09:48.113 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 client 2024-09-19T14:09:48.113 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 osd 2024-09-19T14:09:48.113 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 optracker 2024-09-19T14:09:48.113 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objclass 2024-09-19T14:09:48.113 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 filestore 2024-09-19T14:09:48.113 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 journal 2024-09-19T14:09:48.113 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 ms 2024-09-19T14:09:48.113 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mon 2024-09-19T14:09:48.113 INFO:tasks.workunit.client.0.smithi153.stderr: 0/10 monc 2024-09-19T14:09:48.113 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 paxos 2024-09-19T14:09:48.113 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 tp 2024-09-19T14:09:48.113 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 auth 2024-09-19T14:09:48.113 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 crypto 2024-09-19T14:09:48.114 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 finisher 2024-09-19T14:09:48.114 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 reserver 2024-09-19T14:09:48.114 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 heartbeatmap 2024-09-19T14:09:48.114 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 perfcounter 2024-09-19T14:09:48.114 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw 2024-09-19T14:09:48.114 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_sync 2024-09-19T14:09:48.114 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_datacache 2024-09-19T14:09:48.114 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_access 2024-09-19T14:09:48.114 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:09:48.114 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_flight 2024-09-19T14:09:48.114 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:09:48.114 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw_notification 2024-09-19T14:09:48.115 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 javaclient 2024-09-19T14:09:48.115 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 asok 2024-09-19T14:09:48.115 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 throttle 2024-09-19T14:09:48.115 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 refs 2024-09-19T14:09:48.115 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 compressor 2024-09-19T14:09:48.115 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluestore 2024-09-19T14:09:48.115 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluefs 2024-09-19T14:09:48.115 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 bdev 2024-09-19T14:09:48.115 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 kstore 2024-09-19T14:09:48.115 INFO:tasks.workunit.client.0.smithi153.stderr: 4/ 5 rocksdb 2024-09-19T14:09:48.115 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 fuse 2024-09-19T14:09:48.115 INFO:tasks.workunit.client.0.smithi153.stderr: 2/ 5 mgr 2024-09-19T14:09:48.115 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mgrc 2024-09-19T14:09:48.116 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 dpdk 2024-09-19T14:09:48.116 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 eventtrace 2024-09-19T14:09:48.116 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 prioritycache 2024-09-19T14:09:48.116 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 test 2024-09-19T14:09:48.116 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:09:48.116 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephsqlite 2024-09-19T14:09:48.116 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:09:48.116 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore 2024-09-19T14:09:48.116 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_onode 2024-09-19T14:09:48.116 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_odata 2024-09-19T14:09:48.116 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_omap 2024-09-19T14:09:48.116 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_tm 2024-09-19T14:09:48.116 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_t 2024-09-19T14:09:48.116 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:09:48.117 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_epm 2024-09-19T14:09:48.117 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_lba 2024-09-19T14:09:48.117 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:09:48.117 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cache 2024-09-19T14:09:48.117 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_journal 2024-09-19T14:09:48.117 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_device 2024-09-19T14:09:48.117 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_backref 2024-09-19T14:09:48.117 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 alienstore 2024-09-19T14:09:48.117 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mclock 2024-09-19T14:09:48.117 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cyanstore 2024-09-19T14:09:48.117 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 ceph_exporter 2024-09-19T14:09:48.117 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 memstore 2024-09-19T14:09:48.117 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 trace 2024-09-19T14:09:48.118 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 ceph_dedup 2024-09-19T14:09:48.118 INFO:tasks.workunit.client.0.smithi153.stderr: -2/-2 (syslog threshold) 2024-09-19T14:09:48.118 INFO:tasks.workunit.client.0.smithi153.stderr: 99/99 (stderr threshold) 2024-09-19T14:09:48.118 INFO:tasks.workunit.client.0.smithi153.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:09:48.118 INFO:tasks.workunit.client.0.smithi153.stderr: 7fcfa3fff640 / http_manager 2024-09-19T14:09:48.118 INFO:tasks.workunit.client.0.smithi153.stderr: 7fd0327fc640 / http_manager 2024-09-19T14:09:48.118 INFO:tasks.workunit.client.0.smithi153.stderr: 7fd0337fe640 / rgw_dt_lg_renew 2024-09-19T14:09:48.118 INFO:tasks.workunit.client.0.smithi153.stderr: 7fd0537fe640 / ms_dispatch 2024-09-19T14:09:48.118 INFO:tasks.workunit.client.0.smithi153.stderr: 7fd0657fa640 / io_context_pool 2024-09-19T14:09:48.118 INFO:tasks.workunit.client.0.smithi153.stderr: 7fd0677fe640 / ms_dispatch 2024-09-19T14:09:48.118 INFO:tasks.workunit.client.0.smithi153.stderr: 7fd06e604640 / ms_dispatch 2024-09-19T14:09:48.118 INFO:tasks.workunit.client.0.smithi153.stderr: 7fd06fe07640 / io_context_pool 2024-09-19T14:09:48.118 INFO:tasks.workunit.client.0.smithi153.stderr: 7fd1813e7640 / msgr-worker-2 2024-09-19T14:09:48.118 INFO:tasks.workunit.client.0.smithi153.stderr: 7fd181be8640 / msgr-worker-1 2024-09-19T14:09:48.118 INFO:tasks.workunit.client.0.smithi153.stderr: 7fd1823e9640 / msgr-worker-0 2024-09-19T14:09:48.119 INFO:tasks.workunit.client.0.smithi153.stderr: 7fd182bea640 / io_context_pool 2024-09-19T14:09:48.119 INFO:tasks.workunit.client.0.smithi153.stderr: 7fd1840e29c0 / radosgw-admin 2024-09-19T14:09:48.119 INFO:tasks.workunit.client.0.smithi153.stderr: max_recent 500 2024-09-19T14:09:48.119 INFO:tasks.workunit.client.0.smithi153.stderr: max_new 1000 2024-09-19T14:09:48.119 INFO:tasks.workunit.client.0.smithi153.stderr: log_file /var/lib/ceph/crash/2024-09-19T14:09:47.990555Z_f6ad3419-4742-4992-a501-4865ca747cb0/log 2024-09-19T14:09:48.119 INFO:tasks.workunit.client.0.smithi153.stderr:--- end dump of recent events --- 2024-09-19T14:09:48.119 INFO:tasks.workunit.client.0.smithi153.stderr:Aborted 2024-09-19T14:09:48.119 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-19T14:09:48.121 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:09:48.121 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:09:48.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.074+0000 7fded7b959c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.074+0000 7fded7b959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.074+0000 7fded7b959c0 20 realm 2024-09-19T14:09:48.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.074+0000 7fded7b959c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.074+0000 7fded7b959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.074+0000 7fded7b959c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:09:48.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.074+0000 7fded7b959c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.074+0000 7fded7b959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.074+0000 7fded7b959c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.078+0000 7fded7b959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:48.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.078+0000 7fded7b959c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.078+0000 7fded7b959c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:09:48.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.078+0000 7fded7b959c0 20 searching for the correct realm 2024-09-19T14:09:48.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.082+0000 7fded5e9c640 0 -- 172.21.15.153:0/232957350 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7fdec0018070 msgr2=0x7fdec00779e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:09:48.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.090+0000 7fded569b640 0 -- 172.21.15.153:0/232957350 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fdec0073640 msgr2=0x7fdec0073ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:48.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.306+0000 7fded7b959c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:09:48.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.306+0000 7fded7b959c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:09:48.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.306+0000 7fded7b959c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:09:48.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.306+0000 7fded7b959c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:09:48.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.306+0000 7fded7b959c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:09:48.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.306+0000 7fded7b959c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:09:48.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.306+0000 7fded7b959c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.306+0000 7fded7b959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.306+0000 7fded7b959c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.310+0000 7fded7b959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:48.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.310+0000 7fded7b959c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.310+0000 7fded7b959c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:09:48.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.310+0000 7fded7b959c0 20 zone default found 2024-09-19T14:09:48.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.310+0000 7fded7b959c0 4 Realm: () 2024-09-19T14:09:48.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.310+0000 7fded7b959c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:09:48.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.310+0000 7fded7b959c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:09:48.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.310+0000 7fded7b959c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:09:48.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.310+0000 7fded7b959c0 20 zonegroup default 2024-09-19T14:09:48.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.310+0000 7fded7b959c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.310+0000 7fded7b959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.310+0000 7fded7b959c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.310+0000 7fded7b959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.310+0000 7fded7b959c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.312 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.310+0000 7fded7b959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.312 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.310+0000 7fded7b959c0 20 started sync module instance, tier type = 2024-09-19T14:09:48.312 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.310+0000 7fded7b959c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:09:48.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.334+0000 7fded7b959c0 20 add_watcher() i=0 2024-09-19T14:09:48.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.334+0000 7fded7b959c0 20 add_watcher() i=1 2024-09-19T14:09:48.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.334+0000 7fded7b959c0 20 add_watcher() i=2 2024-09-19T14:09:48.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.334+0000 7fded7b959c0 20 add_watcher() i=3 2024-09-19T14:09:48.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.334+0000 7fded7b959c0 20 add_watcher() i=4 2024-09-19T14:09:48.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.334+0000 7fded7b959c0 20 add_watcher() i=5 2024-09-19T14:09:48.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.334+0000 7fded7b959c0 20 add_watcher() i=6 2024-09-19T14:09:48.338 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.338+0000 7fded7b959c0 20 add_watcher() i=7 2024-09-19T14:09:48.338 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.338+0000 7fded7b959c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:09:48.342 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.342+0000 7fdd8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:48.343 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.342+0000 7fded7b959c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:09:48.343 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.342+0000 7fded7b959c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:09:48.343 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.342+0000 7fded7b959c0 5 note: GC not initialized 2024-09-19T14:09:48.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.342+0000 7fdd8a7e4640 20 reqs_thread_entry: start 2024-09-19T14:09:48.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.342+0000 7fded7b959c0 20 init_complete bucket index max shards: 11 2024-09-19T14:09:48.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.342+0000 7fded7b959c0 20 Filter name: none 2024-09-19T14:09:48.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.342+0000 7fdcfbfff640 20 reqs_thread_entry: start 2024-09-19T14:09:48.344 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.342+0000 7fded7b959c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.345 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.342+0000 7fded7b959c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:09:48.345 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.342+0000 7fded7b959c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.346+0000 7fded7b959c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-19T14:09:48.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.346+0000 7fded7b959c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:09:48.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.346+0000 7fded7b959c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.346+0000 7fded7b959c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:09:48.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.346+0000 7fded7b959c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.346+0000 7fded7b959c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-19T14:09:48.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.346+0000 7fded7b959c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:09:48.353 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.350+0000 7fdd8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:48.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.358+0000 7fded7b959c0 20 remove_watcher() i=0 2024-09-19T14:09:48.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.358+0000 7fded7b959c0 2 removed watcher, disabling cache 2024-09-19T14:09:48.360 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.358+0000 7fded7b959c0 20 remove_watcher() i=1 2024-09-19T14:09:48.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.362+0000 7fded7b959c0 20 remove_watcher() i=2 2024-09-19T14:09:48.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.370+0000 7fded7b959c0 20 remove_watcher() i=3 2024-09-19T14:09:48.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.370+0000 7fded7b959c0 20 remove_watcher() i=4 2024-09-19T14:09:48.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.370+0000 7fded7b959c0 20 remove_watcher() i=5 2024-09-19T14:09:48.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.374+0000 7fded7b959c0 20 remove_watcher() i=6 2024-09-19T14:09:48.376 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.374+0000 7fded7b959c0 20 remove_watcher() i=7 2024-09-19T14:09:48.393 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.394 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:09:48.394 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: abort-at-do-reshard id: dbb1da81-49d0-421a-b677-974869a7f103.4620.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:09:48.394 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:09:48.395 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:48.395 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:48.439 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:09:48.439 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:09:48.527 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T14:09:48.563 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:09:48.563 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:09:48.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.606+0000 7fb3154229c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.611 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.610+0000 7fb3154229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.611 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.610+0000 7fb3154229c0 20 realm 2024-09-19T14:09:48.611 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.610+0000 7fb3154229c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.611 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.610+0000 7fb3154229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.611 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.610+0000 7fb3154229c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:09:48.611 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.610+0000 7fb3154229c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.611 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.610+0000 7fb3154229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.611 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.610+0000 7fb3154229c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.613 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.610+0000 7fb3154229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:48.613 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.610+0000 7fb3154229c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.613 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.610+0000 7fb3154229c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:09:48.613 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.610+0000 7fb3154229c0 20 searching for the correct realm 2024-09-19T14:09:48.616 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.614+0000 7fb312f28640 0 -- 172.21.15.153:0/2291772037 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x7fb304020040 msgr2=0x7fb304010930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:48.623 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.622+0000 7fb313729640 0 -- 172.21.15.153:0/2291772037 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7fb2fc01d040 msgr2=0x7fb2fc03e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:09:48.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.630+0000 7fb3154229c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:09:48.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.630+0000 7fb3154229c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:09:48.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.630+0000 7fb3154229c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:09:48.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.630+0000 7fb3154229c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:09:48.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.630+0000 7fb3154229c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:09:48.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.630+0000 7fb3154229c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:09:48.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.630+0000 7fb3154229c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.634+0000 7fb3154229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.634 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.634+0000 7fb3154229c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.634 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.634+0000 7fb3154229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:09:48.634 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.634+0000 7fb3154229c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.635 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.634+0000 7fb3154229c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:09:48.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.634+0000 7fb3154229c0 20 zone default found 2024-09-19T14:09:48.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.634+0000 7fb3154229c0 4 Realm: () 2024-09-19T14:09:48.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.634+0000 7fb3154229c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:09:48.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.634+0000 7fb3154229c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:09:48.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.634+0000 7fb3154229c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:09:48.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.634+0000 7fb3154229c0 20 zonegroup default 2024-09-19T14:09:48.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.634+0000 7fb3154229c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.634+0000 7fb3154229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.634+0000 7fb3154229c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.634+0000 7fb3154229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.634+0000 7fb3154229c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.634+0000 7fb3154229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:09:48.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.634+0000 7fb3154229c0 20 started sync module instance, tier type = 2024-09-19T14:09:48.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.634+0000 7fb3154229c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:09:48.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.650+0000 7fb3154229c0 20 add_watcher() i=0 2024-09-19T14:09:48.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.650+0000 7fb3154229c0 20 add_watcher() i=1 2024-09-19T14:09:48.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.650+0000 7fb3154229c0 20 add_watcher() i=2 2024-09-19T14:09:48.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.650+0000 7fb3154229c0 20 add_watcher() i=3 2024-09-19T14:09:48.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.650+0000 7fb3154229c0 20 add_watcher() i=4 2024-09-19T14:09:48.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.650+0000 7fb3154229c0 20 add_watcher() i=5 2024-09-19T14:09:48.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.650+0000 7fb3154229c0 20 add_watcher() i=6 2024-09-19T14:09:48.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.654+0000 7fb3154229c0 20 add_watcher() i=7 2024-09-19T14:09:48.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.654+0000 7fb3154229c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:09:48.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.654+0000 7fb1c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:48.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.654+0000 7fb3154229c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:09:48.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.654+0000 7fb3154229c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:09:48.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.654+0000 7fb3154229c0 5 note: GC not initialized 2024-09-19T14:09:48.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.654+0000 7fb143fff640 20 reqs_thread_entry: start 2024-09-19T14:09:48.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.654+0000 7fb3154229c0 20 init_complete bucket index max shards: 11 2024-09-19T14:09:48.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.654+0000 7fb3154229c0 20 Filter name: none 2024-09-19T14:09:48.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.654+0000 7fb141ffb640 20 reqs_thread_entry: start 2024-09-19T14:09:48.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.654+0000 7fb3154229c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-19T14:09:48.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.654+0000 7fb3154229c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.658+0000 7fb3154229c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:09:48.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.658+0000 7fb3154229c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-19T14:09:48.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.658+0000 7fb3154229c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-19T14:09:48.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.658+0000 7fb3154229c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 : miss 2024-09-19T14:09:48.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.658+0000 7fb3154229c0 20 rados->read ofs=0 len=0 2024-09-19T14:09:48.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.658+0000 7fb3154229c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-19T14:09:48.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.658+0000 7fb3154229c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 info.flags=0x17 2024-09-19T14:09:48.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.658+0000 7fb3154229c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 to cache LRU end 2024-09-19T14:09:48.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.658+0000 7fb3154229c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:09:48.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.658+0000 7fb3154229c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:09:48.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.658+0000 7fb3154229c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 2024-09-19T14:09:48.660 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.658+0000 7fb3154229c0 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 to be held by another RGW process; skipping for now 2024-09-19T14:09:48.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.658+0000 7fb1c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:09:48.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.666+0000 7fb3154229c0 20 remove_watcher() i=0 2024-09-19T14:09:48.666 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.666+0000 7fb3154229c0 2 removed watcher, disabling cache 2024-09-19T14:09:48.668 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.666+0000 7fb3154229c0 20 remove_watcher() i=1 2024-09-19T14:09:48.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.670+0000 7fb3154229c0 20 remove_watcher() i=2 2024-09-19T14:09:48.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.670+0000 7fb3154229c0 20 remove_watcher() i=3 2024-09-19T14:09:48.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.674+0000 7fb3154229c0 20 remove_watcher() i=4 2024-09-19T14:09:48.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.674+0000 7fb3154229c0 20 remove_watcher() i=5 2024-09-19T14:09:48.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.674+0000 7fb3154229c0 20 remove_watcher() i=6 2024-09-19T14:09:48.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:09:48.678+0000 7fb3154229c0 20 remove_watcher() i=7 2024-09-19T14:09:48.692 INFO:tasks.workunit.client.0.smithi153.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-19T14:10:18.723 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T14:10:18.759 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:10:18.759 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:10:18.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.805+0000 7f69ab3fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:18.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.805+0000 7f69ab3fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:18.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.805+0000 7f69ab3fe9c0 20 realm 2024-09-19T14:10:18.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.805+0000 7f69ab3fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:18.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.805+0000 7f69ab3fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:18.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.805+0000 7f69ab3fe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:10:18.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.805+0000 7f69ab3fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:18.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.805+0000 7f69ab3fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:18.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.805+0000 7f69ab3fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:18.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.809+0000 7f69ab3fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:18.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.809+0000 7f69ab3fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:18.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.809+0000 7f69ab3fe9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:10:18.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.809+0000 7f69ab3fe9c0 20 searching for the correct realm 2024-09-19T14:10:18.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.809+0000 7f69a8f04640 0 -- 172.21.15.153:0/1542616449 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x56472d507280 msgr2=0x7f69a0007aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:10:18.820 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.817+0000 7f69a9705640 0 -- 172.21.15.153:0/1542616449 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f699c008050 msgr2=0x7f699c044460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:10:18.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.829+0000 7f69ab3fe9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:10:18.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.829+0000 7f69ab3fe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:10:18.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.829+0000 7f69ab3fe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:10:18.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.829+0000 7f69ab3fe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:10:18.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.829+0000 7f69ab3fe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:10:18.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.829+0000 7f69ab3fe9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:10:18.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.829+0000 7f69ab3fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:18.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.829+0000 7f69ab3fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:18.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.829+0000 7f69ab3fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:18.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.829+0000 7f69ab3fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:18.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.829+0000 7f69ab3fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:18.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.829+0000 7f69ab3fe9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:10:18.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.829+0000 7f69ab3fe9c0 20 zone default found 2024-09-19T14:10:18.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.829+0000 7f69ab3fe9c0 4 Realm: () 2024-09-19T14:10:18.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.829+0000 7f69ab3fe9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:10:18.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.829+0000 7f69ab3fe9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:10:18.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.829+0000 7f69ab3fe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:10:18.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.829+0000 7f69ab3fe9c0 20 zonegroup default 2024-09-19T14:10:18.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.829+0000 7f69ab3fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:18.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.829+0000 7f69ab3fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:18.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.829+0000 7f69ab3fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:18.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.833+0000 7f69ab3fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:18.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.833+0000 7f69ab3fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:18.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.833+0000 7f69ab3fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:18.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.833+0000 7f69ab3fe9c0 20 started sync module instance, tier type = 2024-09-19T14:10:18.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.833+0000 7f69ab3fe9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:10:18.849 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.849+0000 7f69ab3fe9c0 20 add_watcher() i=0 2024-09-19T14:10:18.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.849+0000 7f69ab3fe9c0 20 add_watcher() i=1 2024-09-19T14:10:18.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.849+0000 7f69ab3fe9c0 20 add_watcher() i=2 2024-09-19T14:10:18.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.849+0000 7f69ab3fe9c0 20 add_watcher() i=3 2024-09-19T14:10:18.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.849+0000 7f69ab3fe9c0 20 add_watcher() i=4 2024-09-19T14:10:18.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.849+0000 7f69ab3fe9c0 20 add_watcher() i=5 2024-09-19T14:10:18.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.849+0000 7f69ab3fe9c0 20 add_watcher() i=6 2024-09-19T14:10:18.851 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.849+0000 7f69ab3fe9c0 20 add_watcher() i=7 2024-09-19T14:10:18.851 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.849+0000 7f69ab3fe9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:10:18.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.849+0000 7f685f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:18.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.853+0000 7f69ab3fe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:10:18.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.853+0000 7f69ab3fe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:10:18.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.853+0000 7f69ab3fe9c0 5 note: GC not initialized 2024-09-19T14:10:18.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.853+0000 7f685e7e4640 20 reqs_thread_entry: start 2024-09-19T14:10:18.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.853+0000 7f69ab3fe9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:10:18.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.853+0000 7f69ab3fe9c0 20 Filter name: none 2024-09-19T14:10:18.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.853+0000 7f68577fe640 20 reqs_thread_entry: start 2024-09-19T14:10:18.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.853+0000 7f69ab3fe9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-19T14:10:18.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.853+0000 7f69ab3fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:18.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.853+0000 7f69ab3fe9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:10:18.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.853+0000 7f69ab3fe9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-19T14:10:18.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.853+0000 7f69ab3fe9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-19T14:10:18.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.853+0000 7f69ab3fe9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 : miss 2024-09-19T14:10:18.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.853+0000 7f69ab3fe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:18.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.853+0000 7f69ab3fe9c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-19T14:10:18.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.853+0000 7f69ab3fe9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 info.flags=0x17 2024-09-19T14:10:18.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.853+0000 7f69ab3fe9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 to cache LRU end 2024-09-19T14:10:18.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.853+0000 7f69ab3fe9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:10:18.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.853+0000 7f69ab3fe9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:18.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.853+0000 7f69ab3fe9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 2024-09-19T14:10:18.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.857+0000 7f69ab3fe9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T14:10:18.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.869+0000 7f69ab3fe9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 info.flags=0x17 2024-09-19T14:10:18.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.869+0000 7f69ab3fe9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 to cache LRU end 2024-09-19T14:10:18.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.869+0000 7f69ab3fe9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:18.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.869+0000 7f69ab3fe9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34, ofs0, ns] 2024-09-19T14:10:18.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.869+0000 7f687ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333502 cookie 94863705291440 notifier 7554 bl.length()=911 2024-09-19T14:10:18.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.869+0000 7f687ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 info.flags=0x17 2024-09-19T14:10:18.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.869+0000 7f687ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 to cache LRU end 2024-09-19T14:10:18.871 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.869+0000 7f687ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:18.873 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.869+0000 7f69ab3fe9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.34]): orig_sources= new_sources= 2024-09-19T14:10:18.873 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.869+0000 7f69ab3fe9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.34]): potential sources added=[] removed=[] 2024-09-19T14:10:18.873 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.869+0000 7f69ab3fe9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.34]): orig_dests= new_dests= 2024-09-19T14:10:18.873 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.869+0000 7f69ab3fe9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.34]): potential dests added=[] removed=[] 2024-09-19T14:10:18.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2.0 2024-09-19T14:10:18.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2.0 2024-09-19T14:10:18.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2.1 2024-09-19T14:10:18.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2.1 2024-09-19T14:10:18.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2.2 2024-09-19T14:10:18.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2.2 2024-09-19T14:10:18.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2.3 2024-09-19T14:10:18.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2.3 2024-09-19T14:10:18.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2.4 2024-09-19T14:10:18.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2.4 2024-09-19T14:10:18.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2.5 2024-09-19T14:10:18.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2.5 2024-09-19T14:10:18.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2.6 2024-09-19T14:10:18.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2.6 2024-09-19T14:10:18.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2.7 2024-09-19T14:10:18.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2.7 2024-09-19T14:10:18.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2.8 2024-09-19T14:10:18.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2.8 2024-09-19T14:10:18.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2.9 2024-09-19T14:10:18.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2.9 2024-09-19T14:10:18.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2.10 2024-09-19T14:10:18.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2.10 2024-09-19T14:10:18.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2.11 2024-09-19T14:10:18.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2.11 2024-09-19T14:10:18.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.0 2024-09-19T14:10:18.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.1 2024-09-19T14:10:18.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2 2024-09-19T14:10:18.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.3 2024-09-19T14:10:18.885 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.881+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.4 2024-09-19T14:10:18.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.885+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.5 2024-09-19T14:10:18.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.885+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.6 2024-09-19T14:10:18.887 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.885+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.7 2024-09-19T14:10:18.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.885+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.8 2024-09-19T14:10:18.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.885+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.9 2024-09-19T14:10:18.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.889+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.10 2024-09-19T14:10:18.895 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.893+0000 7f69ab3fe9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 : hit (requested=0x17, cached=0x17) 2024-09-19T14:10:18.895 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.893+0000 7f69ab3fe9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 2024-09-19T14:10:18.899 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.897+0000 7f69ab3fe9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 info.flags=0x17 2024-09-19T14:10:18.899 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.897+0000 7f69ab3fe9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 to cache LRU end 2024-09-19T14:10:18.899 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.897+0000 7f69ab3fe9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:18.899 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.897+0000 7f69ab3fe9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34, ofs0, ns] 2024-09-19T14:10:18.900 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.897+0000 7f687ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333503 cookie 94863705291440 notifier 7554 bl.length()=911 2024-09-19T14:10:18.900 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.897+0000 7f687ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 info.flags=0x17 2024-09-19T14:10:18.900 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.897+0000 7f687ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 to cache LRU end 2024-09-19T14:10:18.900 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.897+0000 7f687ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:18.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.901+0000 7f69ab3fe9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.34]): orig_sources= new_sources= 2024-09-19T14:10:18.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.901+0000 7f69ab3fe9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.34]): potential sources added=[] removed=[] 2024-09-19T14:10:18.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.901+0000 7f69ab3fe9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.34]): orig_dests= new_dests= 2024-09-19T14:10:18.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.901+0000 7f69ab3fe9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.34]): potential dests added=[] removed=[] 2024-09-19T14:10:18.906 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.905+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.0 2024-09-19T14:10:18.906 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.905+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.1 2024-09-19T14:10:18.907 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.905+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.2 2024-09-19T14:10:18.907 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.905+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.3 2024-09-19T14:10:18.908 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.905+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.4 2024-09-19T14:10:18.909 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.905+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.5 2024-09-19T14:10:18.909 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.905+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.6 2024-09-19T14:10:18.909 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.909+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.7 2024-09-19T14:10:18.910 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.909+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.8 2024-09-19T14:10:18.911 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.909+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.9 2024-09-19T14:10:18.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.909+0000 7f69ab3fe9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.34.10 2024-09-19T14:10:18.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.909+0000 7f69ab3fe9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 : hit (requested=0x17, cached=0x17) 2024-09-19T14:10:18.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.909+0000 7f69ab3fe9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 2024-09-19T14:10:18.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.913+0000 7f69ab3fe9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 info.flags=0x17 2024-09-19T14:10:18.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.913+0000 7f69ab3fe9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 to cache LRU end 2024-09-19T14:10:18.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.913+0000 7f69ab3fe9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:18.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.913+0000 7f69ab3fe9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34, ofs0, ns] 2024-09-19T14:10:18.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.913+0000 7f687f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333504 cookie 94863705291440 notifier 7554 bl.length()=879 2024-09-19T14:10:18.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.913+0000 7f687f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 info.flags=0x17 2024-09-19T14:10:18.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.913+0000 7f687f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:dbb1da81-49d0-421a-b677-974869a7f103.4620.34 to cache LRU end 2024-09-19T14:10:18.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.913+0000 7f687f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:18.920 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.917+0000 7f69ab3fe9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.34]): orig_sources= new_sources= 2024-09-19T14:10:18.920 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.917+0000 7f69ab3fe9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.34]): potential sources added=[] removed=[] 2024-09-19T14:10:18.920 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.917+0000 7f69ab3fe9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.34]): orig_dests= new_dests= 2024-09-19T14:10:18.920 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.917+0000 7f69ab3fe9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[dbb1da81-49d0-421a-b677-974869a7f103.4620.34]): potential dests added=[] removed=[] 2024-09-19T14:10:18.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.921+0000 7f69ab3fe9c0 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-19T14:10:18.926 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.925+0000 7f685f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:18.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.929+0000 7f69ab3fe9c0 20 remove_watcher() i=0 2024-09-19T14:10:18.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.929+0000 7f69ab3fe9c0 2 removed watcher, disabling cache 2024-09-19T14:10:18.933 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.933+0000 7f69ab3fe9c0 20 remove_watcher() i=1 2024-09-19T14:10:18.935 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.933+0000 7f69ab3fe9c0 20 remove_watcher() i=2 2024-09-19T14:10:18.937 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.933+0000 7f69ab3fe9c0 20 remove_watcher() i=3 2024-09-19T14:10:18.939 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.937+0000 7f69ab3fe9c0 20 remove_watcher() i=4 2024-09-19T14:10:18.940 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.937+0000 7f69ab3fe9c0 20 remove_watcher() i=5 2024-09-19T14:10:18.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.941+0000 7f69ab3fe9c0 20 remove_watcher() i=6 2024-09-19T14:10:18.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:18.941+0000 7f69ab3fe9c0 20 remove_watcher() i=7 2024-09-19T14:10:18.958 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-19T14:10:18.985 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:10:18.985 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:10:19.028 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.025+0000 7fdb9e6139c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:19.031 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.029+0000 7fdb9e6139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:19.031 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.029+0000 7fdb9e6139c0 20 realm 2024-09-19T14:10:19.031 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.029+0000 7fdb9e6139c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:19.031 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.029+0000 7fdb9e6139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:19.031 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.029+0000 7fdb9e6139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:10:19.031 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.029+0000 7fdb9e6139c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:19.032 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.029+0000 7fdb9e6139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:19.032 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.029+0000 7fdb9e6139c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:19.033 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.029+0000 7fdb9e6139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:19.033 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.029+0000 7fdb9e6139c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:19.033 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.029+0000 7fdb9e6139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:10:19.034 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.029+0000 7fdb9e6139c0 20 searching for the correct realm 2024-09-19T14:10:19.040 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.037+0000 7fdb9b918640 0 -- 172.21.15.153:0/1200452456 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fdb8c06f040 msgr2=0x7fdb8c063550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:10:19.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.045+0000 7fdb9c91a640 0 -- 172.21.15.153:0/1200452456 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7fdb90015070 msgr2=0x7fdb900679a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:10:19.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.049+0000 7fdb9e6139c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:10:19.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.049+0000 7fdb9e6139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:10:19.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.049+0000 7fdb9e6139c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:10:19.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.049+0000 7fdb9e6139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:10:19.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.049+0000 7fdb9e6139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:10:19.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.049+0000 7fdb9e6139c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:10:19.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.049+0000 7fdb9e6139c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:19.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.049+0000 7fdb9e6139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:19.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.049+0000 7fdb9e6139c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:19.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.053+0000 7fdb9e6139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:19.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.053+0000 7fdb9e6139c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:19.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.053+0000 7fdb9e6139c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:10:19.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.053+0000 7fdb9e6139c0 20 zone default found 2024-09-19T14:10:19.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.053+0000 7fdb9e6139c0 4 Realm: () 2024-09-19T14:10:19.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.053+0000 7fdb9e6139c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:10:19.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.053+0000 7fdb9e6139c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:10:19.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.053+0000 7fdb9e6139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:10:19.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.053+0000 7fdb9e6139c0 20 zonegroup default 2024-09-19T14:10:19.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.053+0000 7fdb9e6139c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:19.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.053+0000 7fdb9e6139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:19.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.053+0000 7fdb9e6139c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:19.056 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.053+0000 7fdb9e6139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:19.056 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.053+0000 7fdb9e6139c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:19.056 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.053+0000 7fdb9e6139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:19.056 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.053+0000 7fdb9e6139c0 20 started sync module instance, tier type = 2024-09-19T14:10:19.056 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.053+0000 7fdb9e6139c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:10:19.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.069+0000 7fdb9e6139c0 20 add_watcher() i=0 2024-09-19T14:10:19.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.069+0000 7fdb9e6139c0 20 add_watcher() i=1 2024-09-19T14:10:19.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.069+0000 7fdb9e6139c0 20 add_watcher() i=2 2024-09-19T14:10:19.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.069+0000 7fdb9e6139c0 20 add_watcher() i=3 2024-09-19T14:10:19.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.069+0000 7fdb9e6139c0 20 add_watcher() i=4 2024-09-19T14:10:19.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.069+0000 7fdb9e6139c0 20 add_watcher() i=5 2024-09-19T14:10:19.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.069+0000 7fdb9e6139c0 20 add_watcher() i=6 2024-09-19T14:10:19.072 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.069+0000 7fdb9e6139c0 20 add_watcher() i=7 2024-09-19T14:10:19.072 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.069+0000 7fdb9e6139c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:10:19.075 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.073+0000 7fda52fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:19.076 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.073+0000 7fdb9e6139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:10:19.076 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.073+0000 7fdb9e6139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:10:19.076 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.073+0000 7fdb9e6139c0 5 note: GC not initialized 2024-09-19T14:10:19.076 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.073+0000 7fda51fdb640 20 reqs_thread_entry: start 2024-09-19T14:10:19.076 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.073+0000 7fdb9e6139c0 20 init_complete bucket index max shards: 11 2024-09-19T14:10:19.076 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.073+0000 7fdb9e6139c0 20 Filter name: none 2024-09-19T14:10:19.076 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.073+0000 7fd9c37fe640 20 reqs_thread_entry: start 2024-09-19T14:10:19.077 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.073+0000 7fdb9e6139c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:19.077 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.073+0000 7fdb9e6139c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:10:19.077 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.073+0000 7fdb9e6139c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:19.078 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.077+0000 7fdb9e6139c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:10:19.078 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.077+0000 7fdb9e6139c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:10:19.078 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.077+0000 7fdb9e6139c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:19.079 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.077+0000 7fdb9e6139c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T14:10:19.079 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.077+0000 7fdb9e6139c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:19.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.077+0000 7fdb9e6139c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-19T14:10:19.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.077+0000 7fdb9e6139c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:10:19.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.081+0000 7fda52fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:19.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.085+0000 7fdb9e6139c0 20 remove_watcher() i=0 2024-09-19T14:10:19.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.085+0000 7fdb9e6139c0 2 removed watcher, disabling cache 2024-09-19T14:10:19.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.089+0000 7fdb9e6139c0 20 remove_watcher() i=1 2024-09-19T14:10:19.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.089+0000 7fdb9e6139c0 20 remove_watcher() i=2 2024-09-19T14:10:19.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.093+0000 7fdb9e6139c0 20 remove_watcher() i=3 2024-09-19T14:10:19.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.093+0000 7fdb9e6139c0 20 remove_watcher() i=4 2024-09-19T14:10:19.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.093+0000 7fdb9e6139c0 20 remove_watcher() i=5 2024-09-19T14:10:19.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.097+0000 7fdb9e6139c0 20 remove_watcher() i=6 2024-09-19T14:10:19.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:19.097+0000 7fdb9e6139c0 20 remove_watcher() i=7 2024-09-19T14:10:19.111 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:19.111 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:10:19.112 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: abort-at-do-reshard id: dbb1da81-49d0-421a-b677-974869a7f103.4620.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T14:10:19.112 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:19.113 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:19.113 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:19.135 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:19.135 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:19.657 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:19.658 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:20.027 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-19T14:10:20.027 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:20.030 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:20.031 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:20.148 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:20.148 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:20.238 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:20.238 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:20.345 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:20.345 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:20.442 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:20.442 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:20.541 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:20.541 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:20.643 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:20.643 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:20.740 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:20.740 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:20.839 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:20.839 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:20.939 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:20.940 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:21.035 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:21.035 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:21.141 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:21.141 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:21.243 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:21.243 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:21.345 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:21.345 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:21.443 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:21.443 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:21.541 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:21.542 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:21.642 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:21.642 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:21.735 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:21.736 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:21.835 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:21.835 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:21.929 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:21.929 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:22.029 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:22.030 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:22.132 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:22.132 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:22.225 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-19T14:10:22.257 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:10:22.257 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:10:22.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.301+0000 7fdff7d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.301+0000 7fdff7d0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:22.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.301+0000 7fdff7d0a9c0 20 realm 2024-09-19T14:10:22.305 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.301+0000 7fdff7d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.305 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.301+0000 7fdff7d0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:22.305 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.301+0000 7fdff7d0a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:10:22.305 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.301+0000 7fdff7d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.305 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.301+0000 7fdff7d0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:22.305 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.301+0000 7fdff7d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.305+0000 7fdff7d0a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:22.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.305+0000 7fdff7d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.305+0000 7fdff7d0a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:10:22.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.305+0000 7fdff7d0a9c0 20 searching for the correct realm 2024-09-19T14:10:22.312 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.309+0000 7fdff500f640 0 -- 172.21.15.153:0/2963781738 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x563b4fd50160 msgr2=0x563b4fd52620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:10:22.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.317+0000 7fdff5810640 0 -- 172.21.15.153:0/2963781738 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fdfec042900 msgr2=0x7fdfec0143f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:10:22.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.537+0000 7fdff7d0a9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:10:22.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.537+0000 7fdff7d0a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:10:22.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.537+0000 7fdff7d0a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:10:22.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.537+0000 7fdff7d0a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:10:22.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.537+0000 7fdff7d0a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:10:22.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.537+0000 7fdff7d0a9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:10:22.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.537+0000 7fdff7d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.537+0000 7fdff7d0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:22.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.537+0000 7fdff7d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.537+0000 7fdff7d0a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:22.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.537+0000 7fdff7d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.537+0000 7fdff7d0a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:10:22.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.537+0000 7fdff7d0a9c0 20 zone default found 2024-09-19T14:10:22.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.537+0000 7fdff7d0a9c0 4 Realm: () 2024-09-19T14:10:22.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.537+0000 7fdff7d0a9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:10:22.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.537+0000 7fdff7d0a9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:10:22.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.537+0000 7fdff7d0a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:10:22.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.537+0000 7fdff7d0a9c0 20 zonegroup default 2024-09-19T14:10:22.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.537+0000 7fdff7d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.537+0000 7fdff7d0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:22.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.537+0000 7fdff7d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.541+0000 7fdff7d0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:22.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.541+0000 7fdff7d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.541+0000 7fdff7d0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:22.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.541+0000 7fdff7d0a9c0 20 started sync module instance, tier type = 2024-09-19T14:10:22.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.541+0000 7fdff7d0a9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:10:22.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.561+0000 7fdff7d0a9c0 20 add_watcher() i=0 2024-09-19T14:10:22.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.561+0000 7fdff7d0a9c0 20 add_watcher() i=1 2024-09-19T14:10:22.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.561+0000 7fdff7d0a9c0 20 add_watcher() i=2 2024-09-19T14:10:22.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.561+0000 7fdff7d0a9c0 20 add_watcher() i=3 2024-09-19T14:10:22.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.561+0000 7fdff7d0a9c0 20 add_watcher() i=4 2024-09-19T14:10:22.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.561+0000 7fdff7d0a9c0 20 add_watcher() i=5 2024-09-19T14:10:22.564 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.561+0000 7fdff7d0a9c0 20 add_watcher() i=6 2024-09-19T14:10:22.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.561+0000 7fdff7d0a9c0 20 add_watcher() i=7 2024-09-19T14:10:22.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.561+0000 7fdff7d0a9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:10:22.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.569+0000 7fdea77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:22.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.569+0000 7fdff7d0a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:10:22.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.569+0000 7fdff7d0a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:10:22.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.569+0000 7fdff7d0a9c0 5 note: GC not initialized 2024-09-19T14:10:22.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.569+0000 7fdea67fc640 20 reqs_thread_entry: start 2024-09-19T14:10:22.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.569+0000 7fdff7d0a9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:10:22.571 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.569+0000 7fdff7d0a9c0 20 Filter name: none 2024-09-19T14:10:22.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.569+0000 7fde17fff640 20 reqs_thread_entry: start 2024-09-19T14:10:22.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.569+0000 7fdff7d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.573 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.569+0000 7fdff7d0a9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-19T14:10:22.573 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.569+0000 7fdff7d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.574 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.573+0000 7fdff7d0a9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-19T14:10:22.575 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.573+0000 7fdff7d0a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:10:22.575 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.573+0000 7fdff7d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.575 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.573+0000 7fdff7d0a9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-19T14:10:22.575 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.573+0000 7fdff7d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.576 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.573+0000 7fdff7d0a9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-19T14:10:22.576 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.573+0000 7fdff7d0a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:10:22.579 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.577+0000 7fdea77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:22.585 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.581+0000 7fdff7d0a9c0 20 remove_watcher() i=0 2024-09-19T14:10:22.585 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.581+0000 7fdff7d0a9c0 2 removed watcher, disabling cache 2024-09-19T14:10:22.587 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.585+0000 7fdff7d0a9c0 20 remove_watcher() i=1 2024-09-19T14:10:22.589 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.585+0000 7fdff7d0a9c0 20 remove_watcher() i=2 2024-09-19T14:10:22.591 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.589+0000 7fdff7d0a9c0 20 remove_watcher() i=3 2024-09-19T14:10:22.593 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.589+0000 7fdff7d0a9c0 20 remove_watcher() i=4 2024-09-19T14:10:22.594 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.593+0000 7fdff7d0a9c0 20 remove_watcher() i=5 2024-09-19T14:10:22.596 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.593+0000 7fdff7d0a9c0 20 remove_watcher() i=6 2024-09-19T14:10:22.598 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.597+0000 7fdff7d0a9c0 20 remove_watcher() i=7 2024-09-19T14:10:22.617 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:22.617 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:10:22.617 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-logrecord-writes id: dbb1da81-49d0-421a-b677-974869a7f103.4620.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:10:22.617 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:22.617 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-19T14:10:22.656 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:10:22.656 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:10:22.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.697+0000 7f4aa0a479c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.703 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.701+0000 7f4aa0a479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:22.703 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.701+0000 7f4aa0a479c0 20 realm 2024-09-19T14:10:22.703 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.701+0000 7f4aa0a479c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.703 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.701+0000 7f4aa0a479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:22.703 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.701+0000 7f4aa0a479c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:10:22.703 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.701+0000 7f4aa0a479c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.703 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.701+0000 7f4aa0a479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:22.703 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.701+0000 7f4aa0a479c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.701+0000 7f4aa0a479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:22.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.701+0000 7f4aa0a479c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.701+0000 7f4aa0a479c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:10:22.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.701+0000 7f4aa0a479c0 20 searching for the correct realm 2024-09-19T14:10:22.710 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.709+0000 7f4a9ed4e640 0 -- 172.21.15.153:0/1782456970 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f4a94047060 msgr2=0x7f4a940669b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:10:22.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.713+0000 7f4a9e54d640 0 -- 172.21.15.153:0/1782456970 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f4a940707e0 msgr2=0x7f4a9401a7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:10:22.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.929+0000 7f4aa0a479c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:10:22.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.929+0000 7f4aa0a479c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:10:22.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.929+0000 7f4aa0a479c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:10:22.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.929+0000 7f4aa0a479c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:10:22.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.929+0000 7f4aa0a479c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:10:22.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.929+0000 7f4aa0a479c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:10:22.933 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.929+0000 7f4aa0a479c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.933 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.929+0000 7f4aa0a479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:22.933 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.929+0000 7f4aa0a479c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.933 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.933+0000 7f4aa0a479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:22.933 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.933+0000 7f4aa0a479c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.934 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.933+0000 7f4aa0a479c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:10:22.934 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.933+0000 7f4aa0a479c0 20 zone default found 2024-09-19T14:10:22.934 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.933+0000 7f4aa0a479c0 4 Realm: () 2024-09-19T14:10:22.935 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.933+0000 7f4aa0a479c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:10:22.935 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.933+0000 7f4aa0a479c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:10:22.935 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.933+0000 7f4aa0a479c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:10:22.935 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.933+0000 7f4aa0a479c0 20 zonegroup default 2024-09-19T14:10:22.935 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.933+0000 7f4aa0a479c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.935 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.933+0000 7f4aa0a479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:22.936 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.933+0000 7f4aa0a479c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.936 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.933+0000 7f4aa0a479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:22.936 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.933+0000 7f4aa0a479c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.936 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.933+0000 7f4aa0a479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:22.936 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.933+0000 7f4aa0a479c0 20 started sync module instance, tier type = 2024-09-19T14:10:22.937 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.933+0000 7f4aa0a479c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:10:22.957 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.953+0000 7f4aa0a479c0 20 add_watcher() i=0 2024-09-19T14:10:22.957 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.953+0000 7f4aa0a479c0 20 add_watcher() i=1 2024-09-19T14:10:22.957 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.953+0000 7f4aa0a479c0 20 add_watcher() i=2 2024-09-19T14:10:22.957 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.953+0000 7f4aa0a479c0 20 add_watcher() i=3 2024-09-19T14:10:22.957 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.953+0000 7f4aa0a479c0 20 add_watcher() i=4 2024-09-19T14:10:22.957 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.953+0000 7f4aa0a479c0 20 add_watcher() i=5 2024-09-19T14:10:22.958 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.953+0000 7f4aa0a479c0 20 add_watcher() i=6 2024-09-19T14:10:22.959 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.957+0000 7f4aa0a479c0 20 add_watcher() i=7 2024-09-19T14:10:22.959 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.957+0000 7f4aa0a479c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:10:22.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.961+0000 7f4954fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:22.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.961+0000 7f4aa0a479c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:10:22.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.961+0000 7f4aa0a479c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:10:22.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.961+0000 7f4aa0a479c0 5 note: GC not initialized 2024-09-19T14:10:22.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.961+0000 7f48cf7fe640 20 reqs_thread_entry: start 2024-09-19T14:10:22.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.961+0000 7f4aa0a479c0 20 init_complete bucket index max shards: 11 2024-09-19T14:10:22.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.961+0000 7f4aa0a479c0 20 Filter name: none 2024-09-19T14:10:22.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.961+0000 7f48cd7fa640 20 reqs_thread_entry: start 2024-09-19T14:10:22.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.961+0000 7f4aa0a479c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-19T14:10:22.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.961+0000 7f4aa0a479c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.961+0000 7f4aa0a479c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-19T14:10:22.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.961+0000 7f4aa0a479c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-19T14:10:22.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.961+0000 7f4aa0a479c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-19T14:10:22.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.961+0000 7f4aa0a479c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 : miss 2024-09-19T14:10:22.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.961+0000 7f4aa0a479c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:22.966 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.965+0000 7f4aa0a479c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-19T14:10:22.966 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.965+0000 7f4aa0a479c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 info.flags=0x17 2024-09-19T14:10:22.966 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.965+0000 7f4aa0a479c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 to cache LRU end 2024-09-19T14:10:22.966 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.965+0000 7f4aa0a479c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:10:22.966 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.965+0000 7f4aa0a479c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:22.967 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.965+0000 7f4aa0a479c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 2024-09-19T14:10:22.975 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.973+0000 7f4aa0a479c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 info.flags=0x17 2024-09-19T14:10:22.975 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.973+0000 7f4aa0a479c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 to cache LRU end 2024-09-19T14:10:22.975 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.973+0000 7f4aa0a479c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:22.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.973+0000 7f4aa0a479c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35, ofs0, ns] 2024-09-19T14:10:22.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.973+0000 7f4981ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333503 cookie 94830080833408 notifier 7130 bl.length()=923 2024-09-19T14:10:22.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.973+0000 7f4981ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 info.flags=0x17 2024-09-19T14:10:22.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.973+0000 7f4981ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 to cache LRU end 2024-09-19T14:10:22.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.973+0000 7f4981ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:22.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.977+0000 7f4aa0a479c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.35]): orig_sources= new_sources= 2024-09-19T14:10:22.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.977+0000 7f4aa0a479c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.35]): potential sources added=[] removed=[] 2024-09-19T14:10:22.979 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.977+0000 7f4aa0a479c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.35]): orig_dests= new_dests= 2024-09-19T14:10:22.979 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.977+0000 7f4aa0a479c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.35]): potential dests added=[] removed=[] 2024-09-19T14:10:22.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.981+0000 7f4aa0a479c0 -1 Injecting error=-5 at location=logrecord_writes 2024-09-19T14:10:22.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.981+0000 7f4aa0a479c0 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-19T14:10:22.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.989+0000 7f4aa0a479c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 : hit (requested=0x17, cached=0x17) 2024-09-19T14:10:22.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.989+0000 7f4aa0a479c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 2024-09-19T14:10:22.994 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.993+0000 7f4aa0a479c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 info.flags=0x17 2024-09-19T14:10:22.994 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.993+0000 7f4aa0a479c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 to cache LRU end 2024-09-19T14:10:22.994 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.993+0000 7f4aa0a479c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:22.994 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.993+0000 7f4aa0a479c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35, ofs0, ns] 2024-09-19T14:10:22.995 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.993+0000 7f4981ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333504 cookie 94830080833408 notifier 7130 bl.length()=891 2024-09-19T14:10:22.995 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.993+0000 7f4981ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 info.flags=0x17 2024-09-19T14:10:22.995 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.993+0000 7f4981ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 to cache LRU end 2024-09-19T14:10:22.995 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.993+0000 7f4981ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:22.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.993+0000 7f4aa0a479c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.35]): orig_sources= new_sources= 2024-09-19T14:10:22.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.993+0000 7f4aa0a479c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.35]): potential sources added=[] removed=[] 2024-09-19T14:10:22.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.993+0000 7f4aa0a479c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.35]): orig_dests= new_dests= 2024-09-19T14:10:22.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.993+0000 7f4aa0a479c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.35]): potential dests added=[] removed=[] 2024-09-19T14:10:23.001 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:22.997+0000 7f4954fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:23.006 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.005+0000 7f4aa0a479c0 20 remove_watcher() i=0 2024-09-19T14:10:23.006 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.005+0000 7f4aa0a479c0 2 removed watcher, disabling cache 2024-09-19T14:10:23.008 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.005+0000 7f4aa0a479c0 20 remove_watcher() i=1 2024-09-19T14:10:23.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.009+0000 7f4aa0a479c0 20 remove_watcher() i=2 2024-09-19T14:10:23.012 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.009+0000 7f4aa0a479c0 20 remove_watcher() i=3 2024-09-19T14:10:23.014 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.013+0000 7f4aa0a479c0 20 remove_watcher() i=4 2024-09-19T14:10:23.016 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.013+0000 7f4aa0a479c0 20 remove_watcher() i=5 2024-09-19T14:10:23.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.017+0000 7f4aa0a479c0 20 remove_watcher() i=6 2024-09-19T14:10:23.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.017+0000 7f4aa0a479c0 20 remove_watcher() i=7 2024-09-19T14:10:23.038 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-19T14:10:23.071 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:10:23.071 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:10:23.116 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.113+0000 7f24118af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.118 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.117+0000 7f24118af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:23.118 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.117+0000 7f24118af9c0 20 realm 2024-09-19T14:10:23.118 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.117+0000 7f24118af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.119 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.117+0000 7f24118af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:23.119 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.117+0000 7f24118af9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:10:23.119 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.117+0000 7f24118af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.119 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.117+0000 7f24118af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:23.119 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.117+0000 7f24118af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.117+0000 7f24118af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:23.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.117+0000 7f24118af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.117+0000 7f24118af9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:10:23.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.117+0000 7f24118af9c0 20 searching for the correct realm 2024-09-19T14:10:23.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.125+0000 7f240ebb4640 0 -- 172.21.15.153:0/2696275113 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55ec65a90200 msgr2=0x55ec65a92640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:10:23.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.129+0000 7f240ebb4640 0 -- 172.21.15.153:0/2696275113 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f24000ed040 msgr2=0x7f24000b63f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:10:23.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.137+0000 7f24118af9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:10:23.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.137+0000 7f24118af9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:10:23.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.137+0000 7f24118af9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:10:23.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.137+0000 7f24118af9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:10:23.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.137+0000 7f24118af9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:10:23.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.137+0000 7f24118af9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:10:23.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.137+0000 7f24118af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.137+0000 7f24118af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:23.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.137+0000 7f24118af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.137+0000 7f24118af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:23.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.137+0000 7f24118af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.137+0000 7f24118af9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:10:23.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.137+0000 7f24118af9c0 20 zone default found 2024-09-19T14:10:23.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.137+0000 7f24118af9c0 4 Realm: () 2024-09-19T14:10:23.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.137+0000 7f24118af9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:10:23.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.137+0000 7f24118af9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:10:23.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.137+0000 7f24118af9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:10:23.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.137+0000 7f24118af9c0 20 zonegroup default 2024-09-19T14:10:23.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.137+0000 7f24118af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.141+0000 7f24118af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:23.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.141+0000 7f24118af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.143 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.141+0000 7f24118af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:23.143 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.141+0000 7f24118af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.143 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.141+0000 7f24118af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:23.143 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.141+0000 7f24118af9c0 20 started sync module instance, tier type = 2024-09-19T14:10:23.143 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.141+0000 7f24118af9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:10:23.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.157+0000 7f24118af9c0 20 add_watcher() i=0 2024-09-19T14:10:23.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.157+0000 7f24118af9c0 20 add_watcher() i=1 2024-09-19T14:10:23.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.157+0000 7f24118af9c0 20 add_watcher() i=2 2024-09-19T14:10:23.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.157+0000 7f24118af9c0 20 add_watcher() i=3 2024-09-19T14:10:23.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.157+0000 7f24118af9c0 20 add_watcher() i=4 2024-09-19T14:10:23.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.157+0000 7f24118af9c0 20 add_watcher() i=5 2024-09-19T14:10:23.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.157+0000 7f24118af9c0 20 add_watcher() i=6 2024-09-19T14:10:23.159 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.157+0000 7f24118af9c0 20 add_watcher() i=7 2024-09-19T14:10:23.159 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.157+0000 7f24118af9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:10:23.161 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.161+0000 7f22c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:23.162 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.161+0000 7f24118af9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:10:23.162 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.161+0000 7f24118af9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:10:23.162 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.161+0000 7f24118af9c0 5 note: GC not initialized 2024-09-19T14:10:23.162 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.161+0000 7f22c4fe1640 20 reqs_thread_entry: start 2024-09-19T14:10:23.163 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.161+0000 7f24118af9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:10:23.163 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.161+0000 7f24118af9c0 20 Filter name: none 2024-09-19T14:10:23.163 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.161+0000 7f223e7fc640 20 reqs_thread_entry: start 2024-09-19T14:10:23.163 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.161+0000 7f24118af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.163 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.161+0000 7f24118af9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-19T14:10:23.163 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.161+0000 7f24118af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.161+0000 7f24118af9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-19T14:10:23.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.161+0000 7f24118af9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:10:23.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.161+0000 7f24118af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.165 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.161+0000 7f24118af9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-19T14:10:23.165 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.161+0000 7f24118af9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.165 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.161+0000 7f24118af9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-19T14:10:23.165 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.161+0000 7f24118af9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:10:23.167 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.165+0000 7f22c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:23.172 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.169+0000 7f24118af9c0 20 remove_watcher() i=0 2024-09-19T14:10:23.172 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.169+0000 7f24118af9c0 2 removed watcher, disabling cache 2024-09-19T14:10:23.174 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.173+0000 7f24118af9c0 20 remove_watcher() i=1 2024-09-19T14:10:23.176 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.173+0000 7f24118af9c0 20 remove_watcher() i=2 2024-09-19T14:10:23.178 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.177+0000 7f24118af9c0 20 remove_watcher() i=3 2024-09-19T14:10:23.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.177+0000 7f24118af9c0 20 remove_watcher() i=4 2024-09-19T14:10:23.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.177+0000 7f24118af9c0 20 remove_watcher() i=5 2024-09-19T14:10:23.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.181+0000 7f24118af9c0 20 remove_watcher() i=6 2024-09-19T14:10:23.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.181+0000 7f24118af9c0 20 remove_watcher() i=7 2024-09-19T14:10:23.197 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:23.197 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:10:23.197 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-logrecord-writes id: dbb1da81-49d0-421a-b677-974869a7f103.4620.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:10:23.197 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:23.198 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:23.198 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:23.244 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:23.244 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:23.303 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T14:10:23.339 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:10:23.339 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:10:23.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.381+0000 7f6b18be39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.385 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.385+0000 7f6b18be39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:23.385 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.385+0000 7f6b18be39c0 20 realm 2024-09-19T14:10:23.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.385+0000 7f6b18be39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.385+0000 7f6b18be39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:23.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.385+0000 7f6b18be39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:10:23.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.385+0000 7f6b18be39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.385+0000 7f6b18be39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:23.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.385+0000 7f6b18be39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.388 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.385+0000 7f6b18be39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:23.388 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.385+0000 7f6b18be39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.388 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.385+0000 7f6b18be39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:10:23.388 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.385+0000 7f6b18be39c0 20 searching for the correct realm 2024-09-19T14:10:23.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.389+0000 7f6b166e9640 0 -- 172.21.15.153:0/1006371288 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x7f6b00003bc0 msgr2=0x7f6b1006d2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:10:23.397 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.393+0000 7f6b166e9640 0 -- 172.21.15.153:0/1006371288 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x7f69e0082310 msgr2=0x7f69e0084740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:10:23.407 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.405+0000 7f6b18be39c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:10:23.407 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.405+0000 7f6b18be39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:10:23.407 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.405+0000 7f6b18be39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:10:23.407 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.405+0000 7f6b18be39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:10:23.407 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.405+0000 7f6b18be39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:10:23.407 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.405+0000 7f6b18be39c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:10:23.407 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.405+0000 7f6b18be39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.408 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.405+0000 7f6b18be39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:23.408 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.405+0000 7f6b18be39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.408 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.405+0000 7f6b18be39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:23.408 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.405+0000 7f6b18be39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.405+0000 7f6b18be39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:10:23.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.405+0000 7f6b18be39c0 20 zone default found 2024-09-19T14:10:23.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.405+0000 7f6b18be39c0 4 Realm: () 2024-09-19T14:10:23.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.405+0000 7f6b18be39c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:10:23.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.405+0000 7f6b18be39c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:10:23.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.405+0000 7f6b18be39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:10:23.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.405+0000 7f6b18be39c0 20 zonegroup default 2024-09-19T14:10:23.410 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.405+0000 7f6b18be39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.410 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.405+0000 7f6b18be39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:23.410 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.405+0000 7f6b18be39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.410 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.409+0000 7f6b18be39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:23.410 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.409+0000 7f6b18be39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.410 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.409+0000 7f6b18be39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:23.410 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.409+0000 7f6b18be39c0 20 started sync module instance, tier type = 2024-09-19T14:10:23.410 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.409+0000 7f6b18be39c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:10:23.426 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.425+0000 7f6b18be39c0 20 add_watcher() i=0 2024-09-19T14:10:23.426 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.425+0000 7f6b18be39c0 20 add_watcher() i=1 2024-09-19T14:10:23.426 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.425+0000 7f6b18be39c0 20 add_watcher() i=2 2024-09-19T14:10:23.426 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.425+0000 7f6b18be39c0 20 add_watcher() i=3 2024-09-19T14:10:23.426 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.425+0000 7f6b18be39c0 20 add_watcher() i=4 2024-09-19T14:10:23.426 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.425+0000 7f6b18be39c0 20 add_watcher() i=5 2024-09-19T14:10:23.426 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.425+0000 7f6b18be39c0 20 add_watcher() i=6 2024-09-19T14:10:23.427 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.425+0000 7f6b18be39c0 20 add_watcher() i=7 2024-09-19T14:10:23.427 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.425+0000 7f6b18be39c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:10:23.430 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.429+0000 7f69ccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:23.431 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.429+0000 7f6b18be39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:10:23.431 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.429+0000 7f6b18be39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:10:23.431 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.429+0000 7f6b18be39c0 5 note: GC not initialized 2024-09-19T14:10:23.431 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.429+0000 7f69477fe640 20 reqs_thread_entry: start 2024-09-19T14:10:23.431 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.429+0000 7f6b18be39c0 20 init_complete bucket index max shards: 11 2024-09-19T14:10:23.431 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.429+0000 7f6b18be39c0 20 Filter name: none 2024-09-19T14:10:23.431 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.429+0000 7f69457fa640 20 reqs_thread_entry: start 2024-09-19T14:10:23.431 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.429+0000 7f6b18be39c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-19T14:10:23.431 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.429+0000 7f6b18be39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.432 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.429+0000 7f6b18be39c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-19T14:10:23.432 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.429+0000 7f6b18be39c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-19T14:10:23.432 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.429+0000 7f6b18be39c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-19T14:10:23.432 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.429+0000 7f6b18be39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 : miss 2024-09-19T14:10:23.432 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.429+0000 7f6b18be39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.432 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.429+0000 7f6b18be39c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-19T14:10:23.432 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.429+0000 7f6b18be39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 info.flags=0x17 2024-09-19T14:10:23.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.429+0000 7f6b18be39c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 to cache LRU end 2024-09-19T14:10:23.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.429+0000 7f6b18be39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:10:23.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.429+0000 7f6b18be39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:23.433 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.429+0000 7f6b18be39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 2024-09-19T14:10:23.440 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.437+0000 7f6b18be39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 info.flags=0x17 2024-09-19T14:10:23.440 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.437+0000 7f6b18be39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 to cache LRU end 2024-09-19T14:10:23.440 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.437+0000 7f6b18be39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:23.440 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.437+0000 7f6b18be39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35, ofs0, ns] 2024-09-19T14:10:23.440 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.437+0000 7f69f9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333505 cookie 94155405371072 notifier 7163 bl.length()=923 2024-09-19T14:10:23.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.437+0000 7f69f9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 info.flags=0x17 2024-09-19T14:10:23.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.437+0000 7f69f9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 to cache LRU end 2024-09-19T14:10:23.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.437+0000 7f69f9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:23.442 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.441+0000 7f6b18be39c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.35]): orig_sources= new_sources= 2024-09-19T14:10:23.442 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.441+0000 7f6b18be39c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.35]): potential sources added=[] removed=[] 2024-09-19T14:10:23.442 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.441+0000 7f6b18be39c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.35]): orig_dests= new_dests= 2024-09-19T14:10:23.442 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.441+0000 7f6b18be39c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.35]): potential dests added=[] removed=[] 2024-09-19T14:10:23.451 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1.0 2024-09-19T14:10:23.451 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1.0 2024-09-19T14:10:23.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1.1 2024-09-19T14:10:23.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1.1 2024-09-19T14:10:23.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1.2 2024-09-19T14:10:23.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1.2 2024-09-19T14:10:23.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1.3 2024-09-19T14:10:23.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1.3 2024-09-19T14:10:23.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1.4 2024-09-19T14:10:23.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1.4 2024-09-19T14:10:23.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1.5 2024-09-19T14:10:23.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1.5 2024-09-19T14:10:23.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1.6 2024-09-19T14:10:23.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1.6 2024-09-19T14:10:23.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1.7 2024-09-19T14:10:23.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1.7 2024-09-19T14:10:23.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1.8 2024-09-19T14:10:23.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1.8 2024-09-19T14:10:23.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1.9 2024-09-19T14:10:23.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1.9 2024-09-19T14:10:23.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1.10 2024-09-19T14:10:23.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1.10 2024-09-19T14:10:23.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1.11 2024-09-19T14:10:23.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1.11 2024-09-19T14:10:23.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.0 2024-09-19T14:10:23.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1 2024-09-19T14:10:23.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.2 2024-09-19T14:10:23.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.449+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.3 2024-09-19T14:10:23.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.453+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.4 2024-09-19T14:10:23.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.453+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.5 2024-09-19T14:10:23.455 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.453+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.6 2024-09-19T14:10:23.456 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.453+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.7 2024-09-19T14:10:23.457 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.457+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.8 2024-09-19T14:10:23.458 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.457+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.9 2024-09-19T14:10:23.459 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.457+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.10 2024-09-19T14:10:23.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.461+0000 7f6b18be39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 : hit (requested=0x17, cached=0x17) 2024-09-19T14:10:23.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.461+0000 7f6b18be39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 2024-09-19T14:10:23.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.465+0000 7f6b18be39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 info.flags=0x17 2024-09-19T14:10:23.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.465+0000 7f6b18be39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 to cache LRU end 2024-09-19T14:10:23.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.465+0000 7f6b18be39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:23.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.465+0000 7f6b18be39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35, ofs0, ns] 2024-09-19T14:10:23.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.465+0000 7f69f97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333506 cookie 94155405371072 notifier 7163 bl.length()=923 2024-09-19T14:10:23.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.465+0000 7f69f97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 info.flags=0x17 2024-09-19T14:10:23.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.465+0000 7f69f97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 to cache LRU end 2024-09-19T14:10:23.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.465+0000 7f69f97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:23.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.465+0000 7f6b18be39c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.35]): orig_sources= new_sources= 2024-09-19T14:10:23.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.465+0000 7f6b18be39c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.35]): potential sources added=[] removed=[] 2024-09-19T14:10:23.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.465+0000 7f6b18be39c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.35]): orig_dests= new_dests= 2024-09-19T14:10:23.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.465+0000 7f6b18be39c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.35]): potential dests added=[] removed=[] 2024-09-19T14:10:23.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.469+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.0 2024-09-19T14:10:23.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.473+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.1 2024-09-19T14:10:23.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.473+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.2 2024-09-19T14:10:23.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.473+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.3 2024-09-19T14:10:23.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.473+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.4 2024-09-19T14:10:23.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.473+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.5 2024-09-19T14:10:23.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.473+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.6 2024-09-19T14:10:23.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.473+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.7 2024-09-19T14:10:23.477 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.473+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.8 2024-09-19T14:10:23.477 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.473+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.9 2024-09-19T14:10:23.478 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.477+0000 7f6b18be39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.35.10 2024-09-19T14:10:23.478 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.477+0000 7f6b18be39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 : hit (requested=0x17, cached=0x17) 2024-09-19T14:10:23.478 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.477+0000 7f6b18be39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 2024-09-19T14:10:23.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.477+0000 7f6b18be39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 info.flags=0x17 2024-09-19T14:10:23.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.477+0000 7f6b18be39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 to cache LRU end 2024-09-19T14:10:23.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.477+0000 7f6b18be39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:23.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.477+0000 7f6b18be39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35, ofs0, ns] 2024-09-19T14:10:23.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.477+0000 7f69f97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333507 cookie 94155405371072 notifier 7163 bl.length()=891 2024-09-19T14:10:23.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.477+0000 7f69f97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 info.flags=0x17 2024-09-19T14:10:23.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.477+0000 7f69f97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.35 to cache LRU end 2024-09-19T14:10:23.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.477+0000 7f69f97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:23.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.481+0000 7f6b18be39c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.35]): orig_sources= new_sources= 2024-09-19T14:10:23.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.481+0000 7f6b18be39c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.35]): potential sources added=[] removed=[] 2024-09-19T14:10:23.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.481+0000 7f6b18be39c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.35]): orig_dests= new_dests= 2024-09-19T14:10:23.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.481+0000 7f6b18be39c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.35]): potential dests added=[] removed=[] 2024-09-19T14:10:23.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.485+0000 7f6b18be39c0 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-19T14:10:23.490 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.489+0000 7f69ccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:23.495 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.493+0000 7f6b18be39c0 20 remove_watcher() i=0 2024-09-19T14:10:23.495 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.493+0000 7f6b18be39c0 2 removed watcher, disabling cache 2024-09-19T14:10:23.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.493+0000 7f6b18be39c0 20 remove_watcher() i=1 2024-09-19T14:10:23.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.497+0000 7f6b18be39c0 20 remove_watcher() i=2 2024-09-19T14:10:23.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.497+0000 7f6b18be39c0 20 remove_watcher() i=3 2024-09-19T14:10:23.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.501+0000 7f6b18be39c0 20 remove_watcher() i=4 2024-09-19T14:10:23.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.501+0000 7f6b18be39c0 20 remove_watcher() i=5 2024-09-19T14:10:23.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.505+0000 7f6b18be39c0 20 remove_watcher() i=6 2024-09-19T14:10:23.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.505+0000 7f6b18be39c0 20 remove_watcher() i=7 2024-09-19T14:10:23.523 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-19T14:10:23.551 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:10:23.551 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:10:23.595 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.593+0000 7f8f255469c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.598 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.597+0000 7f8f255469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:23.598 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.597+0000 7f8f255469c0 20 realm 2024-09-19T14:10:23.598 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.597+0000 7f8f255469c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.598 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.597+0000 7f8f255469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:23.598 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.597+0000 7f8f255469c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:10:23.598 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.597+0000 7f8f255469c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.599 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.597+0000 7f8f255469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:23.599 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.597+0000 7f8f255469c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.597+0000 7f8f255469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:23.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.597+0000 7f8f255469c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.597+0000 7f8f255469c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:10:23.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.597+0000 7f8f255469c0 20 searching for the correct realm 2024-09-19T14:10:23.603 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.601+0000 7f8f2304c640 0 -- 172.21.15.153:0/1936382360 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x555824f11c10 msgr2=0x7f8f1c05b610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:10:23.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.605+0000 7f8f2384d640 0 -- 172.21.15.153:0/1936382360 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f8f1803b070 msgr2=0x7f8f1806d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:10:23.620 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.617+0000 7f8f255469c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:10:23.620 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.617+0000 7f8f255469c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:10:23.620 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.617+0000 7f8f255469c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:10:23.620 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.617+0000 7f8f255469c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:10:23.620 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.617+0000 7f8f255469c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:10:23.620 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.617+0000 7f8f255469c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:10:23.620 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.617+0000 7f8f255469c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.620 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.617+0000 7f8f255469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:23.621 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.617+0000 7f8f255469c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.621 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.617+0000 7f8f255469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:23.621 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.617+0000 7f8f255469c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.617+0000 7f8f255469c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:10:23.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.617+0000 7f8f255469c0 20 zone default found 2024-09-19T14:10:23.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.617+0000 7f8f255469c0 4 Realm: () 2024-09-19T14:10:23.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.617+0000 7f8f255469c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:10:23.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.617+0000 7f8f255469c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:10:23.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.617+0000 7f8f255469c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:10:23.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.617+0000 7f8f255469c0 20 zonegroup default 2024-09-19T14:10:23.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.617+0000 7f8f255469c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.623 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.621+0000 7f8f255469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:23.623 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.621+0000 7f8f255469c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.623 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.621+0000 7f8f255469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:23.623 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.621+0000 7f8f255469c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.623 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.621+0000 7f8f255469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:23.623 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.621+0000 7f8f255469c0 20 started sync module instance, tier type = 2024-09-19T14:10:23.623 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.621+0000 7f8f255469c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:10:23.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.637+0000 7f8f255469c0 20 add_watcher() i=0 2024-09-19T14:10:23.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.637+0000 7f8f255469c0 20 add_watcher() i=1 2024-09-19T14:10:23.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.637+0000 7f8f255469c0 20 add_watcher() i=2 2024-09-19T14:10:23.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.637+0000 7f8f255469c0 20 add_watcher() i=3 2024-09-19T14:10:23.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.637+0000 7f8f255469c0 20 add_watcher() i=4 2024-09-19T14:10:23.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.637+0000 7f8f255469c0 20 add_watcher() i=5 2024-09-19T14:10:23.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.637+0000 7f8f255469c0 20 add_watcher() i=6 2024-09-19T14:10:23.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.637+0000 7f8f255469c0 20 add_watcher() i=7 2024-09-19T14:10:23.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.637+0000 7f8f255469c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:10:23.641 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.637+0000 7f8dd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:23.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.641+0000 7f8f255469c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:10:23.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.641+0000 7f8f255469c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:10:23.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.641+0000 7f8f255469c0 5 note: GC not initialized 2024-09-19T14:10:23.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.641+0000 7f8dd8fe1640 20 reqs_thread_entry: start 2024-09-19T14:10:23.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.641+0000 7f8f255469c0 20 init_complete bucket index max shards: 11 2024-09-19T14:10:23.643 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.641+0000 7f8f255469c0 20 Filter name: none 2024-09-19T14:10:23.643 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.641+0000 7f8d527fc640 20 reqs_thread_entry: start 2024-09-19T14:10:23.643 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.641+0000 7f8f255469c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.643 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.641+0000 7f8f255469c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-19T14:10:23.643 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.641+0000 7f8f255469c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.644 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.641+0000 7f8f255469c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-19T14:10:23.644 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.641+0000 7f8f255469c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:10:23.644 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.641+0000 7f8f255469c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.644 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.641+0000 7f8f255469c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-19T14:10:23.644 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.641+0000 7f8f255469c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:23.645 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.641+0000 7f8f255469c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-19T14:10:23.645 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.641+0000 7f8f255469c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:10:23.647 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.645+0000 7f8dd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:23.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.649+0000 7f8f255469c0 20 remove_watcher() i=0 2024-09-19T14:10:23.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.649+0000 7f8f255469c0 2 removed watcher, disabling cache 2024-09-19T14:10:23.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.653+0000 7f8f255469c0 20 remove_watcher() i=1 2024-09-19T14:10:23.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.653+0000 7f8f255469c0 20 remove_watcher() i=2 2024-09-19T14:10:23.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.657+0000 7f8f255469c0 20 remove_watcher() i=3 2024-09-19T14:10:23.660 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.657+0000 7f8f255469c0 20 remove_watcher() i=4 2024-09-19T14:10:23.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.661+0000 7f8f255469c0 20 remove_watcher() i=5 2024-09-19T14:10:23.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.661+0000 7f8f255469c0 20 remove_watcher() i=6 2024-09-19T14:10:23.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:23.661+0000 7f8f255469c0 20 remove_watcher() i=7 2024-09-19T14:10:23.677 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:23.677 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:10:23.677 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-logrecord-writes id: dbb1da81-49d0-421a-b677-974869a7f103.4620.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T14:10:23.677 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:23.678 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:23.678 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:23.702 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:23.702 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:24.257 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:24.258 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:24.640 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-19T14:10:24.640 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:24.643 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:24.643 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:24.768 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:24.768 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:24.854 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:24.854 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:24.958 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:24.958 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:25.056 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:25.057 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:25.158 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:25.158 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:25.250 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:25.250 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:25.357 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:25.358 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:25.457 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:25.457 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:25.555 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:25.555 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:25.653 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:25.653 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:25.756 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:25.756 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:25.859 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:25.859 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:25.957 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:25.957 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:26.055 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:26.055 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:26.154 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:26.154 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:26.250 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:26.251 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:26.356 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:26.356 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:26.455 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:26.455 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:26.554 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:26.555 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:26.649 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:26.649 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:26.745 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:26.745 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:26.841 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-19T14:10:26.875 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:10:26.875 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:10:26.919 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:26.917+0000 7f13a07c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:26.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:26.917+0000 7f13a07c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:26.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:26.917+0000 7f13a07c49c0 20 realm 2024-09-19T14:10:26.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:26.917+0000 7f13a07c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:26.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:26.921+0000 7f13a07c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:26.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:26.921+0000 7f13a07c49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:10:26.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:26.921+0000 7f13a07c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:26.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:26.921+0000 7f13a07c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:26.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:26.921+0000 7f13a07c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:26.923 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:26.921+0000 7f13a07c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:26.923 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:26.921+0000 7f13a07c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:26.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:26.921+0000 7f13a07c49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:10:26.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:26.921+0000 7f13a07c49c0 20 searching for the correct realm 2024-09-19T14:10:27.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.129+0000 7f139dac9640 0 -- 172.21.15.153:0/4031827077 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f1390008050 msgr2=0x7f1390074a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:10:27.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.141+0000 7f139e2ca640 0 -- 172.21.15.153:0/4031827077 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f13940661f0 msgr2=0x7f13940279f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:10:27.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.361+0000 7f13a07c49c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:10:27.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.361+0000 7f13a07c49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:10:27.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.361+0000 7f13a07c49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:10:27.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.361+0000 7f13a07c49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:10:27.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.361+0000 7f13a07c49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:10:27.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.361+0000 7f13a07c49c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:10:27.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.361+0000 7f13a07c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.361+0000 7f13a07c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.361+0000 7f13a07c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.361+0000 7f13a07c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:27.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.361+0000 7f13a07c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.361+0000 7f13a07c49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:10:27.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.361+0000 7f13a07c49c0 20 zone default found 2024-09-19T14:10:27.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.361+0000 7f13a07c49c0 4 Realm: () 2024-09-19T14:10:27.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.361+0000 7f13a07c49c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:10:27.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.361+0000 7f13a07c49c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:10:27.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.361+0000 7f13a07c49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:10:27.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.361+0000 7f13a07c49c0 20 zonegroup default 2024-09-19T14:10:27.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.361+0000 7f13a07c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.361+0000 7f13a07c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.361+0000 7f13a07c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.365+0000 7f13a07c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.366 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.365+0000 7f13a07c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.367 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.365+0000 7f13a07c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.367 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.365+0000 7f13a07c49c0 20 started sync module instance, tier type = 2024-09-19T14:10:27.367 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.365+0000 7f13a07c49c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:10:27.388 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.385+0000 7f13a07c49c0 20 add_watcher() i=0 2024-09-19T14:10:27.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.385+0000 7f13a07c49c0 20 add_watcher() i=1 2024-09-19T14:10:27.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.385+0000 7f13a07c49c0 20 add_watcher() i=2 2024-09-19T14:10:27.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.385+0000 7f13a07c49c0 20 add_watcher() i=3 2024-09-19T14:10:27.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.385+0000 7f13a07c49c0 20 add_watcher() i=4 2024-09-19T14:10:27.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.385+0000 7f13a07c49c0 20 add_watcher() i=5 2024-09-19T14:10:27.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.385+0000 7f13a07c49c0 20 add_watcher() i=6 2024-09-19T14:10:27.390 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.389+0000 7f13a07c49c0 20 add_watcher() i=7 2024-09-19T14:10:27.390 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.389+0000 7f13a07c49c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:10:27.394 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.393+0000 7f1254fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:27.394 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.393+0000 7f13a07c49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:10:27.395 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.393+0000 7f13a07c49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:10:27.395 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.393+0000 7f13a07c49c0 5 note: GC not initialized 2024-09-19T14:10:27.395 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.393+0000 7f11cf7fe640 20 reqs_thread_entry: start 2024-09-19T14:10:27.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.393+0000 7f13a07c49c0 20 init_complete bucket index max shards: 11 2024-09-19T14:10:27.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.393+0000 7f13a07c49c0 20 Filter name: none 2024-09-19T14:10:27.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.393+0000 7f11cd7fa640 20 reqs_thread_entry: start 2024-09-19T14:10:27.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.393+0000 7f13a07c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.393+0000 7f13a07c49c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-19T14:10:27.397 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.393+0000 7f13a07c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.397+0000 7f13a07c49c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-19T14:10:27.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.397+0000 7f13a07c49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:10:27.398 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.397+0000 7f13a07c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.399 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.397+0000 7f13a07c49c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-19T14:10:27.399 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.397+0000 7f13a07c49c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.400 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.397+0000 7f13a07c49c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-19T14:10:27.400 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.397+0000 7f13a07c49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:10:27.404 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.401+0000 7f1254fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:27.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.405+0000 7f13a07c49c0 20 remove_watcher() i=0 2024-09-19T14:10:27.409 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.405+0000 7f13a07c49c0 2 removed watcher, disabling cache 2024-09-19T14:10:27.411 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.409+0000 7f13a07c49c0 20 remove_watcher() i=1 2024-09-19T14:10:27.413 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.409+0000 7f13a07c49c0 20 remove_watcher() i=2 2024-09-19T14:10:27.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.413+0000 7f13a07c49c0 20 remove_watcher() i=3 2024-09-19T14:10:27.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.417+0000 7f13a07c49c0 20 remove_watcher() i=4 2024-09-19T14:10:27.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.417+0000 7f13a07c49c0 20 remove_watcher() i=5 2024-09-19T14:10:27.420 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.417+0000 7f13a07c49c0 20 remove_watcher() i=6 2024-09-19T14:10:27.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.421+0000 7f13a07c49c0 20 remove_watcher() i=7 2024-09-19T14:10:27.437 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.437 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:10:27.437 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: abort-at-logrecord-writes id: dbb1da81-49d0-421a-b677-974869a7f103.4620.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:10:27.438 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.438 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-19T14:10:27.474 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:10:27.474 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:10:27.518 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.517+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.517+0000 7ff795cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.517+0000 7ff795cc79c0 20 realm 2024-09-19T14:10:27.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.517+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.517+0000 7ff795cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.517+0000 7ff795cc79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:10:27.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.517+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.517+0000 7ff795cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.517+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.521+0000 7ff795cc79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:27.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.521+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.521+0000 7ff795cc79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:10:27.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.521+0000 7ff795cc79c0 20 searching for the correct realm 2024-09-19T14:10:27.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.521+0000 7ff7937cd640 0 -- 172.21.15.153:0/1648261788 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x7ff78c049060 msgr2=0x7ff78c06b870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:10:27.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.529+0000 7ff7937cd640 0 -- 172.21.15.153:0/1648261788 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x7ff65c082310 msgr2=0x7ff65c084740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:10:27.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:10:27.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:10:27.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:10:27.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:10:27.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:10:27.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:10:27.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:27.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:10:27.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 zone default found 2024-09-19T14:10:27.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.541+0000 7ff795cc79c0 4 Realm: () 2024-09-19T14:10:27.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.541+0000 7ff795cc79c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:10:27.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.541+0000 7ff795cc79c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:10:27.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.541+0000 7ff795cc79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:10:27.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 zonegroup default 2024-09-19T14:10:27.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 started sync module instance, tier type = 2024-09-19T14:10:27.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:10:27.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.557+0000 7ff795cc79c0 20 add_watcher() i=0 2024-09-19T14:10:27.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.557+0000 7ff795cc79c0 20 add_watcher() i=1 2024-09-19T14:10:27.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.557+0000 7ff795cc79c0 20 add_watcher() i=2 2024-09-19T14:10:27.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.557+0000 7ff795cc79c0 20 add_watcher() i=3 2024-09-19T14:10:27.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.557+0000 7ff795cc79c0 20 add_watcher() i=4 2024-09-19T14:10:27.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.557+0000 7ff795cc79c0 20 add_watcher() i=5 2024-09-19T14:10:27.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.557+0000 7ff795cc79c0 20 add_watcher() i=6 2024-09-19T14:10:27.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.557+0000 7ff795cc79c0 20 add_watcher() i=7 2024-09-19T14:10:27.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.557+0000 7ff795cc79c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:10:27.562 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.557+0000 7ff64a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:27.562 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.561+0000 7ff795cc79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:10:27.562 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.561+0000 7ff795cc79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:10:27.562 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 note: GC not initialized 2024-09-19T14:10:27.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.561+0000 7ff6497e2640 20 reqs_thread_entry: start 2024-09-19T14:10:27.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.561+0000 7ff795cc79c0 20 init_complete bucket index max shards: 11 2024-09-19T14:10:27.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.561+0000 7ff795cc79c0 20 Filter name: none 2024-09-19T14:10:27.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.561+0000 7ff6427fc640 20 reqs_thread_entry: start 2024-09-19T14:10:27.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-19T14:10:27.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.561+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.561+0000 7ff795cc79c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-19T14:10:27.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-19T14:10:27.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-19T14:10:27.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 : miss 2024-09-19T14:10:27.564 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.561+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.564 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.561+0000 7ff795cc79c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-19T14:10:27.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 info.flags=0x17 2024-09-19T14:10:27.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 to cache LRU end 2024-09-19T14:10:27.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:10:27.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:27.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 2024-09-19T14:10:27.578 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.577+0000 7ff795cc79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 info.flags=0x17 2024-09-19T14:10:27.578 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.577+0000 7ff795cc79c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 to cache LRU end 2024-09-19T14:10:27.579 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.577+0000 7ff795cc79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:27.579 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.577+0000 7ff795cc79c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36, ofs0, ns] 2024-09-19T14:10:27.579 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.577+0000 7ff676ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333492 cookie 94029277222720 notifier 7208 bl.length()=923 2024-09-19T14:10:27.579 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.577+0000 7ff676ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 info.flags=0x17 2024-09-19T14:10:27.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.577+0000 7ff676ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 to cache LRU end 2024-09-19T14:10:27.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.577+0000 7ff676ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:27.581 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.577+0000 7ff795cc79c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.36]): orig_sources= new_sources= 2024-09-19T14:10:27.581 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.577+0000 7ff795cc79c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.36]): potential sources added=[] removed=[] 2024-09-19T14:10:27.581 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.577+0000 7ff795cc79c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.36]): orig_dests= new_dests= 2024-09-19T14:10:27.581 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.577+0000 7ff795cc79c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.36]): potential dests added=[] removed=[] 2024-09-19T14:10:27.585 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff795cc79c0 time 2024-09-19T14:10:27.587368+0000 2024-09-19T14:10:27.585 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:10:27.586 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:10:27.586 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff7995a12eb] 2024-09-19T14:10:27.586 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff7995a149f] 2024-09-19T14:10:27.586 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5584e3588271] 2024-09-19T14:10:27.586 INFO:tasks.workunit.client.0.smithi153.stderr: 4: radosgw-admin(+0x141057c) [0x5584e3fd957c] 2024-09-19T14:10:27.586 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5584e35980dd] 2024-09-19T14:10:27.587 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:10:27.587 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff798407d90] 2024-09-19T14:10:27.587 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:10:27.587 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:10:27.587 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.585+0000 7ff795cc79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff795cc79c0 time 2024-09-19T14:10:27.587368+0000 2024-09-19T14:10:27.587 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:10:27.587 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.587 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:10:27.587 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff7995a12eb] 2024-09-19T14:10:27.587 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff7995a149f] 2024-09-19T14:10:27.587 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5584e3588271] 2024-09-19T14:10:27.587 INFO:tasks.workunit.client.0.smithi153.stderr: 4: radosgw-admin(+0x141057c) [0x5584e3fd957c] 2024-09-19T14:10:27.588 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5584e35980dd] 2024-09-19T14:10:27.588 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:10:27.588 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff798407d90] 2024-09-19T14:10:27.588 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:10:27.588 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:10:27.588 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.588 INFO:tasks.workunit.client.0.smithi153.stderr:*** Caught signal (Aborted) ** 2024-09-19T14:10:27.588 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7ff795cc79c0 thread_name:radosgw-admin 2024-09-19T14:10:27.606 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:10:27.606 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff798420520] 2024-09-19T14:10:27.606 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:10:27.607 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:10:27.607 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:10:27.607 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff7995a1345] 2024-09-19T14:10:27.607 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff7995a149f] 2024-09-19T14:10:27.607 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5584e3588271] 2024-09-19T14:10:27.607 INFO:tasks.workunit.client.0.smithi153.stderr: 8: radosgw-admin(+0x141057c) [0x5584e3fd957c] 2024-09-19T14:10:27.607 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5584e35980dd] 2024-09-19T14:10:27.607 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:10:27.607 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff798407d90] 2024-09-19T14:10:27.607 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:10:27.607 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:10:27.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.585+0000 7ff795cc79c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:10:27.608 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7ff795cc79c0 thread_name:radosgw-admin 2024-09-19T14:10:27.608 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.608 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:10:27.608 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff798420520] 2024-09-19T14:10:27.608 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:10:27.608 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:10:27.608 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:10:27.608 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff7995a1345] 2024-09-19T14:10:27.608 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff7995a149f] 2024-09-19T14:10:27.608 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5584e3588271] 2024-09-19T14:10:27.608 INFO:tasks.workunit.client.0.smithi153.stderr: 8: radosgw-admin(+0x141057c) [0x5584e3fd957c] 2024-09-19T14:10:27.609 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5584e35980dd] 2024-09-19T14:10:27.609 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:10:27.609 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff798407d90] 2024-09-19T14:10:27.609 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:10:27.609 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:10:27.609 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:10:27.609 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.609 INFO:tasks.workunit.client.0.smithi153.stderr:--- begin dump of recent events --- 2024-09-19T14:10:27.609 INFO:tasks.workunit.client.0.smithi153.stderr: -499> 2024-09-19T14:10:27.493+0000 7ff7937cd640 1 monclient: found mon.noname-a 2024-09-19T14:10:27.609 INFO:tasks.workunit.client.0.smithi153.stderr: -498> 2024-09-19T14:10:27.493+0000 7ff7937cd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:10:27.609 INFO:tasks.workunit.client.0.smithi153.stderr: -497> 2024-09-19T14:10:27.493+0000 7ff792fcc640 10 monclient: get_auth_request con 0x5584e59ba3d0 auth_method 0 2024-09-19T14:10:27.610 INFO:tasks.workunit.client.0.smithi153.stderr: -496> 2024-09-19T14:10:27.493+0000 7ff68160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:10:27.610 INFO:tasks.workunit.client.0.smithi153.stderr: -495> 2024-09-19T14:10:27.493+0000 7ff68160a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:10:27.610 INFO:tasks.workunit.client.0.smithi153.stderr: -494> 2024-09-19T14:10:27.493+0000 7ff68160a640 10 monclient: dump: 2024-09-19T14:10:27.610 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:10:27.610 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:10:27.610 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.610 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.610 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:10:27.610 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.610 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:10:27.610 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:10:27.610 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:10:27.610 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.611 INFO:tasks.workunit.client.0.smithi153.stderr: -493> 2024-09-19T14:10:27.493+0000 7ff68160a640 10 monclient: _finish_auth 0 2024-09-19T14:10:27.611 INFO:tasks.workunit.client.0.smithi153.stderr: -492> 2024-09-19T14:10:27.493+0000 7ff68160a640 10 monclient: _check_auth_tickets 2024-09-19T14:10:27.611 INFO:tasks.workunit.client.0.smithi153.stderr: -491> 2024-09-19T14:10:27.493+0000 7ff68160a640 10 monclient: handle_config config(0 keys) 2024-09-19T14:10:27.611 INFO:tasks.workunit.client.0.smithi153.stderr: -490> 2024-09-19T14:10:27.493+0000 7ff795cc79c0 5 monclient: authenticate success, global_id 7680 2024-09-19T14:10:27.611 INFO:tasks.workunit.client.0.smithi153.stderr: -489> 2024-09-19T14:10:27.493+0000 7ff795cc79c0 10 monclient: get_monmap_and_config success 2024-09-19T14:10:27.611 INFO:tasks.workunit.client.0.smithi153.stderr: -488> 2024-09-19T14:10:27.493+0000 7ff795cc79c0 4 set_mon_vals no callback set 2024-09-19T14:10:27.611 INFO:tasks.workunit.client.0.smithi153.stderr: -487> 2024-09-19T14:10:27.493+0000 7ff68160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:10:27.611 INFO:tasks.workunit.client.0.smithi153.stderr: -486> 2024-09-19T14:10:27.493+0000 7ff68160a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:10:27.611 INFO:tasks.workunit.client.0.smithi153.stderr: -485> 2024-09-19T14:10:27.493+0000 7ff68160a640 10 monclient: dump: 2024-09-19T14:10:27.611 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:10:27.611 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:10:27.611 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.611 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.611 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:10:27.611 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.612 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:10:27.612 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:10:27.612 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:10:27.612 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.612 INFO:tasks.workunit.client.0.smithi153.stderr: -484> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient: shutdown 2024-09-19T14:10:27.612 INFO:tasks.workunit.client.0.smithi153.stderr: -483> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) unregister_commands rotate-key 2024-09-19T14:10:27.612 INFO:tasks.workunit.client.0.smithi153.stderr: -482> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient: build_initial_monmap 2024-09-19T14:10:27.612 INFO:tasks.workunit.client.0.smithi153.stderr: -481> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 1 build_initial for_mkfs: 0 2024-09-19T14:10:27.612 INFO:tasks.workunit.client.0.smithi153.stderr: -480> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient: monmap: 2024-09-19T14:10:27.612 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:10:27.613 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:10:27.613 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:10:27.613 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:10:27.613 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:10:27.613 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.613 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:10:27.613 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:10:27.613 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:10:27.613 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.613 INFO:tasks.workunit.client.0.smithi153.stderr: -479> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding auth protocol: cephx 2024-09-19T14:10:27.613 INFO:tasks.workunit.client.0.smithi153.stderr: -478> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding auth protocol: cephx 2024-09-19T14:10:27.613 INFO:tasks.workunit.client.0.smithi153.stderr: -477> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding auth protocol: cephx 2024-09-19T14:10:27.614 INFO:tasks.workunit.client.0.smithi153.stderr: -476> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding con mode: secure 2024-09-19T14:10:27.614 INFO:tasks.workunit.client.0.smithi153.stderr: -475> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding con mode: crc 2024-09-19T14:10:27.614 INFO:tasks.workunit.client.0.smithi153.stderr: -474> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding con mode: secure 2024-09-19T14:10:27.614 INFO:tasks.workunit.client.0.smithi153.stderr: -473> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding con mode: crc 2024-09-19T14:10:27.614 INFO:tasks.workunit.client.0.smithi153.stderr: -472> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding con mode: secure 2024-09-19T14:10:27.614 INFO:tasks.workunit.client.0.smithi153.stderr: -471> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding con mode: crc 2024-09-19T14:10:27.614 INFO:tasks.workunit.client.0.smithi153.stderr: -470> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding con mode: crc 2024-09-19T14:10:27.614 INFO:tasks.workunit.client.0.smithi153.stderr: -469> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding con mode: secure 2024-09-19T14:10:27.614 INFO:tasks.workunit.client.0.smithi153.stderr: -468> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding con mode: crc 2024-09-19T14:10:27.614 INFO:tasks.workunit.client.0.smithi153.stderr: -467> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding con mode: secure 2024-09-19T14:10:27.614 INFO:tasks.workunit.client.0.smithi153.stderr: -466> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding con mode: crc 2024-09-19T14:10:27.614 INFO:tasks.workunit.client.0.smithi153.stderr: -465> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding con mode: secure 2024-09-19T14:10:27.614 INFO:tasks.workunit.client.0.smithi153.stderr: -464> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.615 INFO:tasks.workunit.client.0.smithi153.stderr: -463> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 1 librados: starting msgr at 2024-09-19T14:10:27.615 INFO:tasks.workunit.client.0.smithi153.stderr: -462> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 1 librados: starting objecter 2024-09-19T14:10:27.615 INFO:tasks.workunit.client.0.smithi153.stderr: -461> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command objecter_requests hook 0x5584e571d6d0 2024-09-19T14:10:27.615 INFO:tasks.workunit.client.0.smithi153.stderr: -460> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 1 librados: setting wanted keys 2024-09-19T14:10:27.615 INFO:tasks.workunit.client.0.smithi153.stderr: -459> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 1 librados: calling monclient init 2024-09-19T14:10:27.615 INFO:tasks.workunit.client.0.smithi153.stderr: -458> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient: init 2024-09-19T14:10:27.615 INFO:tasks.workunit.client.0.smithi153.stderr: -457> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding auth protocol: cephx 2024-09-19T14:10:27.615 INFO:tasks.workunit.client.0.smithi153.stderr: -456> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding auth protocol: cephx 2024-09-19T14:10:27.615 INFO:tasks.workunit.client.0.smithi153.stderr: -455> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding auth protocol: cephx 2024-09-19T14:10:27.615 INFO:tasks.workunit.client.0.smithi153.stderr: -454> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding con mode: secure 2024-09-19T14:10:27.615 INFO:tasks.workunit.client.0.smithi153.stderr: -453> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding con mode: crc 2024-09-19T14:10:27.615 INFO:tasks.workunit.client.0.smithi153.stderr: -452> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding con mode: secure 2024-09-19T14:10:27.615 INFO:tasks.workunit.client.0.smithi153.stderr: -451> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding con mode: crc 2024-09-19T14:10:27.616 INFO:tasks.workunit.client.0.smithi153.stderr: -450> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding con mode: secure 2024-09-19T14:10:27.616 INFO:tasks.workunit.client.0.smithi153.stderr: -449> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding con mode: crc 2024-09-19T14:10:27.616 INFO:tasks.workunit.client.0.smithi153.stderr: -448> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding con mode: crc 2024-09-19T14:10:27.616 INFO:tasks.workunit.client.0.smithi153.stderr: -447> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding con mode: secure 2024-09-19T14:10:27.616 INFO:tasks.workunit.client.0.smithi153.stderr: -446> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding con mode: crc 2024-09-19T14:10:27.616 INFO:tasks.workunit.client.0.smithi153.stderr: -445> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding con mode: secure 2024-09-19T14:10:27.616 INFO:tasks.workunit.client.0.smithi153.stderr: -444> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding con mode: crc 2024-09-19T14:10:27.616 INFO:tasks.workunit.client.0.smithi153.stderr: -443> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding con mode: secure 2024-09-19T14:10:27.616 INFO:tasks.workunit.client.0.smithi153.stderr: -442> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.616 INFO:tasks.workunit.client.0.smithi153.stderr: -441> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.616 INFO:tasks.workunit.client.0.smithi153.stderr: -440> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command rotate-key hook 0x5584e59b3748 2024-09-19T14:10:27.616 INFO:tasks.workunit.client.0.smithi153.stderr: -439> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient: _reopen_session rank -1 2024-09-19T14:10:27.616 INFO:tasks.workunit.client.0.smithi153.stderr: -438> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T14:10:27.617 INFO:tasks.workunit.client.0.smithi153.stderr: -437> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient(hunting): picked mon.noname-a con 0x5584e59ba3d0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:10:27.617 INFO:tasks.workunit.client.0.smithi153.stderr: -436> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient(hunting): picked mon.noname-b con 0x5584e59dd380 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:10:27.617 INFO:tasks.workunit.client.0.smithi153.stderr: -435> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient(hunting): picked mon.noname-c con 0x7ff77c0023c0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:10:27.617 INFO:tasks.workunit.client.0.smithi153.stderr: -434> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:10:27.617 INFO:tasks.workunit.client.0.smithi153.stderr: -433> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:10:27.617 INFO:tasks.workunit.client.0.smithi153.stderr: -432> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:10:27.617 INFO:tasks.workunit.client.0.smithi153.stderr: -431> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient(hunting): _renew_subs 2024-09-19T14:10:27.617 INFO:tasks.workunit.client.0.smithi153.stderr: -430> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient(hunting): authenticate will time out at 2815.961450s 2024-09-19T14:10:27.617 INFO:tasks.workunit.client.0.smithi153.stderr: -429> 2024-09-19T14:10:27.497+0000 7ff793fce640 10 monclient(hunting): get_auth_request con 0x7ff77c0023c0 auth_method 0 2024-09-19T14:10:27.617 INFO:tasks.workunit.client.0.smithi153.stderr: -428> 2024-09-19T14:10:27.497+0000 7ff793fce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:10:27.617 INFO:tasks.workunit.client.0.smithi153.stderr: -427> 2024-09-19T14:10:27.497+0000 7ff793fce640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:10:27.617 INFO:tasks.workunit.client.0.smithi153.stderr: -426> 2024-09-19T14:10:27.497+0000 7ff793fce640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:10:27.617 INFO:tasks.workunit.client.0.smithi153.stderr: -425> 2024-09-19T14:10:27.497+0000 7ff7937cd640 10 monclient(hunting): get_auth_request con 0x5584e59ba3d0 auth_method 0 2024-09-19T14:10:27.618 INFO:tasks.workunit.client.0.smithi153.stderr: -424> 2024-09-19T14:10:27.497+0000 7ff7937cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:10:27.618 INFO:tasks.workunit.client.0.smithi153.stderr: -423> 2024-09-19T14:10:27.497+0000 7ff7937cd640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:10:27.618 INFO:tasks.workunit.client.0.smithi153.stderr: -422> 2024-09-19T14:10:27.497+0000 7ff7937cd640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:10:27.618 INFO:tasks.workunit.client.0.smithi153.stderr: -421> 2024-09-19T14:10:27.497+0000 7ff793fce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:10:27.618 INFO:tasks.workunit.client.0.smithi153.stderr: -420> 2024-09-19T14:10:27.497+0000 7ff793fce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:10:27.618 INFO:tasks.workunit.client.0.smithi153.stderr: -419> 2024-09-19T14:10:27.497+0000 7ff793fce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:10:27.618 INFO:tasks.workunit.client.0.smithi153.stderr: -418> 2024-09-19T14:10:27.497+0000 7ff7937cd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:10:27.618 INFO:tasks.workunit.client.0.smithi153.stderr: -417> 2024-09-19T14:10:27.497+0000 7ff7937cd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:10:27.618 INFO:tasks.workunit.client.0.smithi153.stderr: -416> 2024-09-19T14:10:27.497+0000 7ff7937cd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:10:27.618 INFO:tasks.workunit.client.0.smithi153.stderr: -415> 2024-09-19T14:10:27.497+0000 7ff793fce640 10 monclient(hunting): handle_auth_done global_id 7199 payload 824 2024-09-19T14:10:27.618 INFO:tasks.workunit.client.0.smithi153.stderr: -414> 2024-09-19T14:10:27.497+0000 7ff793fce640 10 monclient: _finish_hunting 0 2024-09-19T14:10:27.618 INFO:tasks.workunit.client.0.smithi153.stderr: -413> 2024-09-19T14:10:27.497+0000 7ff793fce640 1 monclient: found mon.noname-c 2024-09-19T14:10:27.618 INFO:tasks.workunit.client.0.smithi153.stderr: -412> 2024-09-19T14:10:27.497+0000 7ff793fce640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:10:27.618 INFO:tasks.workunit.client.0.smithi153.stderr: -411> 2024-09-19T14:10:27.497+0000 7ff67fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:10:27.619 INFO:tasks.workunit.client.0.smithi153.stderr: -410> 2024-09-19T14:10:27.497+0000 7ff67fe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:10:27.619 INFO:tasks.workunit.client.0.smithi153.stderr: -409> 2024-09-19T14:10:27.497+0000 7ff67fe07640 10 monclient: dump: 2024-09-19T14:10:27.619 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:10:27.619 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:10:27.619 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.619 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.619 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:10:27.619 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.619 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:10:27.619 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:10:27.619 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:10:27.619 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.619 INFO:tasks.workunit.client.0.smithi153.stderr: -408> 2024-09-19T14:10:27.497+0000 7ff67fe07640 10 monclient: _finish_auth 0 2024-09-19T14:10:27.620 INFO:tasks.workunit.client.0.smithi153.stderr: -407> 2024-09-19T14:10:27.497+0000 7ff67fe07640 10 monclient: _check_auth_tickets 2024-09-19T14:10:27.620 INFO:tasks.workunit.client.0.smithi153.stderr: -406> 2024-09-19T14:10:27.497+0000 7ff67fe07640 10 monclient: handle_config config(0 keys) 2024-09-19T14:10:27.620 INFO:tasks.workunit.client.0.smithi153.stderr: -405> 2024-09-19T14:10:27.497+0000 7ff67fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:10:27.620 INFO:tasks.workunit.client.0.smithi153.stderr: -404> 2024-09-19T14:10:27.497+0000 7ff67fe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:10:27.620 INFO:tasks.workunit.client.0.smithi153.stderr: -403> 2024-09-19T14:10:27.497+0000 7ff67fe07640 10 monclient: dump: 2024-09-19T14:10:27.620 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:10:27.620 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:10:27.620 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.620 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.620 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:10:27.620 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.620 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:10:27.620 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:10:27.621 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:10:27.621 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.621 INFO:tasks.workunit.client.0.smithi153.stderr: -402> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 monclient: authenticate success, global_id 7199 2024-09-19T14:10:27.621 INFO:tasks.workunit.client.0.smithi153.stderr: -401> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient: _renew_subs 2024-09-19T14:10:27.621 INFO:tasks.workunit.client.0.smithi153.stderr: -400> 2024-09-19T14:10:27.497+0000 7ff68160a640 4 set_mon_vals no callback set 2024-09-19T14:10:27.621 INFO:tasks.workunit.client.0.smithi153.stderr: -399> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:10:27.621 INFO:tasks.workunit.client.0.smithi153.stderr: -398> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient: _renew_subs 2024-09-19T14:10:27.621 INFO:tasks.workunit.client.0.smithi153.stderr: -397> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:10:27.621 INFO:tasks.workunit.client.0.smithi153.stderr: -396> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 1 librados: init done 2024-09-19T14:10:27.621 INFO:tasks.workunit.client.0.smithi153.stderr: -395> 2024-09-19T14:10:27.501+0000 7ff67fe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:10:27.621 INFO:tasks.workunit.client.0.smithi153.stderr: -394> 2024-09-19T14:10:27.501+0000 7ff67fe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:10:27.621 INFO:tasks.workunit.client.0.smithi153.stderr: -393> 2024-09-19T14:10:27.501+0000 7ff67fe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:10:27.621 INFO:tasks.workunit.client.0.smithi153.stderr: -392> 2024-09-19T14:10:27.501+0000 7ff7937cd640 10 monclient: get_auth_request con 0x7ff678071be0 auth_method 0 2024-09-19T14:10:27.622 INFO:tasks.workunit.client.0.smithi153.stderr: -391> 2024-09-19T14:10:27.501+0000 7ff792fcc640 10 monclient: get_auth_request con 0x5584e59f35a0 auth_method 0 2024-09-19T14:10:27.622 INFO:tasks.workunit.client.0.smithi153.stderr: -390> 2024-09-19T14:10:27.501+0000 7ff7937cd640 10 monclient: get_auth_request con 0x5584e59fecc0 auth_method 0 2024-09-19T14:10:27.622 INFO:tasks.workunit.client.0.smithi153.stderr: -389> 2024-09-19T14:10:27.505+0000 7ff792fcc640 10 monclient: get_auth_request con 0x5584e5a03d50 auth_method 0 2024-09-19T14:10:27.622 INFO:tasks.workunit.client.0.smithi153.stderr: -388> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient: build_initial_monmap 2024-09-19T14:10:27.622 INFO:tasks.workunit.client.0.smithi153.stderr: -387> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 1 build_initial for_mkfs: 0 2024-09-19T14:10:27.622 INFO:tasks.workunit.client.0.smithi153.stderr: -386> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient: monmap: 2024-09-19T14:10:27.622 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:10:27.622 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:10:27.622 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:10:27.622 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:10:27.622 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:10:27.622 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.622 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:10:27.622 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:10:27.623 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:10:27.623 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.623 INFO:tasks.workunit.client.0.smithi153.stderr: -385> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding auth protocol: cephx 2024-09-19T14:10:27.623 INFO:tasks.workunit.client.0.smithi153.stderr: -384> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding auth protocol: cephx 2024-09-19T14:10:27.623 INFO:tasks.workunit.client.0.smithi153.stderr: -383> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding auth protocol: cephx 2024-09-19T14:10:27.623 INFO:tasks.workunit.client.0.smithi153.stderr: -382> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding con mode: secure 2024-09-19T14:10:27.623 INFO:tasks.workunit.client.0.smithi153.stderr: -381> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding con mode: crc 2024-09-19T14:10:27.623 INFO:tasks.workunit.client.0.smithi153.stderr: -380> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding con mode: secure 2024-09-19T14:10:27.623 INFO:tasks.workunit.client.0.smithi153.stderr: -379> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding con mode: crc 2024-09-19T14:10:27.623 INFO:tasks.workunit.client.0.smithi153.stderr: -378> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding con mode: secure 2024-09-19T14:10:27.623 INFO:tasks.workunit.client.0.smithi153.stderr: -377> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding con mode: crc 2024-09-19T14:10:27.623 INFO:tasks.workunit.client.0.smithi153.stderr: -376> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding con mode: crc 2024-09-19T14:10:27.623 INFO:tasks.workunit.client.0.smithi153.stderr: -375> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding con mode: secure 2024-09-19T14:10:27.624 INFO:tasks.workunit.client.0.smithi153.stderr: -374> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding con mode: crc 2024-09-19T14:10:27.624 INFO:tasks.workunit.client.0.smithi153.stderr: -373> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding con mode: secure 2024-09-19T14:10:27.624 INFO:tasks.workunit.client.0.smithi153.stderr: -372> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding con mode: crc 2024-09-19T14:10:27.624 INFO:tasks.workunit.client.0.smithi153.stderr: -371> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding con mode: secure 2024-09-19T14:10:27.624 INFO:tasks.workunit.client.0.smithi153.stderr: -370> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.624 INFO:tasks.workunit.client.0.smithi153.stderr: -369> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command objecter_requests cmddesc objecter_requests hook 0x5584e5a0b640 EEXIST 2024-09-19T14:10:27.624 INFO:tasks.workunit.client.0.smithi153.stderr: -368> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient: init 2024-09-19T14:10:27.624 INFO:tasks.workunit.client.0.smithi153.stderr: -367> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding auth protocol: cephx 2024-09-19T14:10:27.624 INFO:tasks.workunit.client.0.smithi153.stderr: -366> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding auth protocol: cephx 2024-09-19T14:10:27.624 INFO:tasks.workunit.client.0.smithi153.stderr: -365> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding auth protocol: cephx 2024-09-19T14:10:27.624 INFO:tasks.workunit.client.0.smithi153.stderr: -364> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding con mode: secure 2024-09-19T14:10:27.624 INFO:tasks.workunit.client.0.smithi153.stderr: -363> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding con mode: crc 2024-09-19T14:10:27.624 INFO:tasks.workunit.client.0.smithi153.stderr: -362> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding con mode: secure 2024-09-19T14:10:27.625 INFO:tasks.workunit.client.0.smithi153.stderr: -361> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding con mode: crc 2024-09-19T14:10:27.625 INFO:tasks.workunit.client.0.smithi153.stderr: -360> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding con mode: secure 2024-09-19T14:10:27.625 INFO:tasks.workunit.client.0.smithi153.stderr: -359> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding con mode: crc 2024-09-19T14:10:27.625 INFO:tasks.workunit.client.0.smithi153.stderr: -358> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding con mode: crc 2024-09-19T14:10:27.625 INFO:tasks.workunit.client.0.smithi153.stderr: -357> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding con mode: secure 2024-09-19T14:10:27.625 INFO:tasks.workunit.client.0.smithi153.stderr: -356> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding con mode: crc 2024-09-19T14:10:27.625 INFO:tasks.workunit.client.0.smithi153.stderr: -355> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding con mode: secure 2024-09-19T14:10:27.625 INFO:tasks.workunit.client.0.smithi153.stderr: -354> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding con mode: crc 2024-09-19T14:10:27.625 INFO:tasks.workunit.client.0.smithi153.stderr: -353> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding con mode: secure 2024-09-19T14:10:27.625 INFO:tasks.workunit.client.0.smithi153.stderr: -352> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.625 INFO:tasks.workunit.client.0.smithi153.stderr: -351> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.625 INFO:tasks.workunit.client.0.smithi153.stderr: -350> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command rotate-key cmddesc rotate-key hook 0x5584e5a06db0 EEXIST 2024-09-19T14:10:27.625 INFO:tasks.workunit.client.0.smithi153.stderr: -349> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient: _reopen_session rank -1 2024-09-19T14:10:27.625 INFO:tasks.workunit.client.0.smithi153.stderr: -348> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T14:10:27.626 INFO:tasks.workunit.client.0.smithi153.stderr: -347> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient(hunting): picked mon.noname-b con 0x5584e5a2f7f0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:10:27.626 INFO:tasks.workunit.client.0.smithi153.stderr: -346> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient(hunting): picked mon.noname-c con 0x5584e5a2f120 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:10:27.626 INFO:tasks.workunit.client.0.smithi153.stderr: -345> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient(hunting): picked mon.noname-a con 0x5584e5a2db00 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:10:27.626 INFO:tasks.workunit.client.0.smithi153.stderr: -344> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:10:27.626 INFO:tasks.workunit.client.0.smithi153.stderr: -343> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:10:27.626 INFO:tasks.workunit.client.0.smithi153.stderr: -342> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:10:27.626 INFO:tasks.workunit.client.0.smithi153.stderr: -341> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient(hunting): _renew_subs 2024-09-19T14:10:27.626 INFO:tasks.workunit.client.0.smithi153.stderr: -340> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient(hunting): authenticate will time out at 2815.970981s 2024-09-19T14:10:27.626 INFO:tasks.workunit.client.0.smithi153.stderr: -339> 2024-09-19T14:10:27.505+0000 7ff792fcc640 10 monclient(hunting): get_auth_request con 0x5584e5a2f120 auth_method 0 2024-09-19T14:10:27.626 INFO:tasks.workunit.client.0.smithi153.stderr: -338> 2024-09-19T14:10:27.505+0000 7ff792fcc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:10:27.626 INFO:tasks.workunit.client.0.smithi153.stderr: -337> 2024-09-19T14:10:27.505+0000 7ff792fcc640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:10:27.626 INFO:tasks.workunit.client.0.smithi153.stderr: -336> 2024-09-19T14:10:27.505+0000 7ff792fcc640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:10:27.626 INFO:tasks.workunit.client.0.smithi153.stderr: -335> 2024-09-19T14:10:27.505+0000 7ff793fce640 10 monclient(hunting): get_auth_request con 0x5584e5a2db00 auth_method 0 2024-09-19T14:10:27.626 INFO:tasks.workunit.client.0.smithi153.stderr: -334> 2024-09-19T14:10:27.505+0000 7ff793fce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:10:27.627 INFO:tasks.workunit.client.0.smithi153.stderr: -333> 2024-09-19T14:10:27.505+0000 7ff793fce640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:10:27.627 INFO:tasks.workunit.client.0.smithi153.stderr: -332> 2024-09-19T14:10:27.505+0000 7ff793fce640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:10:27.627 INFO:tasks.workunit.client.0.smithi153.stderr: -331> 2024-09-19T14:10:27.505+0000 7ff792fcc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:10:27.627 INFO:tasks.workunit.client.0.smithi153.stderr: -330> 2024-09-19T14:10:27.505+0000 7ff792fcc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:10:27.627 INFO:tasks.workunit.client.0.smithi153.stderr: -329> 2024-09-19T14:10:27.505+0000 7ff792fcc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:10:27.627 INFO:tasks.workunit.client.0.smithi153.stderr: -328> 2024-09-19T14:10:27.505+0000 7ff793fce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:10:27.627 INFO:tasks.workunit.client.0.smithi153.stderr: -327> 2024-09-19T14:10:27.505+0000 7ff793fce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:10:27.627 INFO:tasks.workunit.client.0.smithi153.stderr: -326> 2024-09-19T14:10:27.505+0000 7ff793fce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:10:27.627 INFO:tasks.workunit.client.0.smithi153.stderr: -325> 2024-09-19T14:10:27.505+0000 7ff7937cd640 10 monclient(hunting): get_auth_request con 0x5584e5a2f7f0 auth_method 0 2024-09-19T14:10:27.627 INFO:tasks.workunit.client.0.smithi153.stderr: -324> 2024-09-19T14:10:27.505+0000 7ff7937cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:10:27.627 INFO:tasks.workunit.client.0.smithi153.stderr: -323> 2024-09-19T14:10:27.505+0000 7ff7937cd640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:10:27.627 INFO:tasks.workunit.client.0.smithi153.stderr: -322> 2024-09-19T14:10:27.505+0000 7ff7937cd640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:10:27.627 INFO:tasks.workunit.client.0.smithi153.stderr: -321> 2024-09-19T14:10:27.505+0000 7ff793fce640 10 monclient(hunting): handle_auth_done global_id 7686 payload 824 2024-09-19T14:10:27.627 INFO:tasks.workunit.client.0.smithi153.stderr: -320> 2024-09-19T14:10:27.505+0000 7ff793fce640 10 monclient: _finish_hunting 0 2024-09-19T14:10:27.628 INFO:tasks.workunit.client.0.smithi153.stderr: -319> 2024-09-19T14:10:27.505+0000 7ff793fce640 1 monclient: found mon.noname-a 2024-09-19T14:10:27.628 INFO:tasks.workunit.client.0.smithi153.stderr: -318> 2024-09-19T14:10:27.505+0000 7ff793fce640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:10:27.628 INFO:tasks.workunit.client.0.smithi153.stderr: -317> 2024-09-19T14:10:27.505+0000 7ff67d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:10:27.628 INFO:tasks.workunit.client.0.smithi153.stderr: -316> 2024-09-19T14:10:27.505+0000 7ff67d602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:10:27.628 INFO:tasks.workunit.client.0.smithi153.stderr: -315> 2024-09-19T14:10:27.505+0000 7ff67d602640 10 monclient: dump: 2024-09-19T14:10:27.628 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:10:27.628 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:10:27.628 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.628 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.629 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:10:27.629 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.629 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:10:27.629 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:10:27.629 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:10:27.629 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.629 INFO:tasks.workunit.client.0.smithi153.stderr: -314> 2024-09-19T14:10:27.505+0000 7ff67d602640 10 monclient: _finish_auth 0 2024-09-19T14:10:27.629 INFO:tasks.workunit.client.0.smithi153.stderr: -313> 2024-09-19T14:10:27.505+0000 7ff67d602640 10 monclient: _check_auth_tickets 2024-09-19T14:10:27.629 INFO:tasks.workunit.client.0.smithi153.stderr: -312> 2024-09-19T14:10:27.505+0000 7ff67d602640 10 monclient: handle_config config(0 keys) 2024-09-19T14:10:27.629 INFO:tasks.workunit.client.0.smithi153.stderr: -311> 2024-09-19T14:10:27.505+0000 7ff67d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:10:27.629 INFO:tasks.workunit.client.0.smithi153.stderr: -310> 2024-09-19T14:10:27.505+0000 7ff67d602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:10:27.629 INFO:tasks.workunit.client.0.smithi153.stderr: -309> 2024-09-19T14:10:27.505+0000 7ff67d602640 10 monclient: dump: 2024-09-19T14:10:27.629 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:10:27.630 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:10:27.630 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.630 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.630 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:10:27.630 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.630 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:10:27.630 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:10:27.630 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:10:27.630 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.630 INFO:tasks.workunit.client.0.smithi153.stderr: -308> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 monclient: authenticate success, global_id 7686 2024-09-19T14:10:27.630 INFO:tasks.workunit.client.0.smithi153.stderr: -307> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient: _renew_subs 2024-09-19T14:10:27.630 INFO:tasks.workunit.client.0.smithi153.stderr: -306> 2024-09-19T14:10:27.505+0000 7ff7947cf640 4 set_mon_vals no callback set 2024-09-19T14:10:27.630 INFO:tasks.workunit.client.0.smithi153.stderr: -305> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:10:27.630 INFO:tasks.workunit.client.0.smithi153.stderr: -304> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient: _renew_subs 2024-09-19T14:10:27.631 INFO:tasks.workunit.client.0.smithi153.stderr: -303> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:10:27.631 INFO:tasks.workunit.client.0.smithi153.stderr: -302> 2024-09-19T14:10:27.509+0000 7ff67d602640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:10:27.631 INFO:tasks.workunit.client.0.smithi153.stderr: -301> 2024-09-19T14:10:27.509+0000 7ff67d602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:10:27.631 INFO:tasks.workunit.client.0.smithi153.stderr: -300> 2024-09-19T14:10:27.509+0000 7ff67d602640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:10:27.631 INFO:tasks.workunit.client.0.smithi153.stderr: -299> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient: get_monmap_and_config 2024-09-19T14:10:27.631 INFO:tasks.workunit.client.0.smithi153.stderr: -298> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient: build_initial_monmap 2024-09-19T14:10:27.631 INFO:tasks.workunit.client.0.smithi153.stderr: -297> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 1 build_initial for_mkfs: 0 2024-09-19T14:10:27.631 INFO:tasks.workunit.client.0.smithi153.stderr: -296> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient: monmap: 2024-09-19T14:10:27.631 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:10:27.631 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:10:27.631 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:10:27.631 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:10:27.631 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:10:27.631 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.632 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:10:27.632 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:10:27.632 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:10:27.632 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.632 INFO:tasks.workunit.client.0.smithi153.stderr: -295> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding auth protocol: cephx 2024-09-19T14:10:27.632 INFO:tasks.workunit.client.0.smithi153.stderr: -294> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding auth protocol: cephx 2024-09-19T14:10:27.632 INFO:tasks.workunit.client.0.smithi153.stderr: -293> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding auth protocol: cephx 2024-09-19T14:10:27.632 INFO:tasks.workunit.client.0.smithi153.stderr: -292> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding con mode: secure 2024-09-19T14:10:27.632 INFO:tasks.workunit.client.0.smithi153.stderr: -291> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding con mode: crc 2024-09-19T14:10:27.632 INFO:tasks.workunit.client.0.smithi153.stderr: -290> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding con mode: secure 2024-09-19T14:10:27.632 INFO:tasks.workunit.client.0.smithi153.stderr: -289> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding con mode: crc 2024-09-19T14:10:27.632 INFO:tasks.workunit.client.0.smithi153.stderr: -288> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding con mode: secure 2024-09-19T14:10:27.632 INFO:tasks.workunit.client.0.smithi153.stderr: -287> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding con mode: crc 2024-09-19T14:10:27.632 INFO:tasks.workunit.client.0.smithi153.stderr: -286> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding con mode: crc 2024-09-19T14:10:27.633 INFO:tasks.workunit.client.0.smithi153.stderr: -285> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding con mode: secure 2024-09-19T14:10:27.633 INFO:tasks.workunit.client.0.smithi153.stderr: -284> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding con mode: crc 2024-09-19T14:10:27.633 INFO:tasks.workunit.client.0.smithi153.stderr: -283> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding con mode: secure 2024-09-19T14:10:27.633 INFO:tasks.workunit.client.0.smithi153.stderr: -282> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding con mode: crc 2024-09-19T14:10:27.633 INFO:tasks.workunit.client.0.smithi153.stderr: -281> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding con mode: secure 2024-09-19T14:10:27.633 INFO:tasks.workunit.client.0.smithi153.stderr: -280> 2024-09-19T14:10:27.509+0000 7ff7937cd640 10 monclient: get_auth_request con 0x7ff66c071b20 auth_method 0 2024-09-19T14:10:27.633 INFO:tasks.workunit.client.0.smithi153.stderr: -279> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.633 INFO:tasks.workunit.client.0.smithi153.stderr: -278> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient: init 2024-09-19T14:10:27.633 INFO:tasks.workunit.client.0.smithi153.stderr: -277> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding auth protocol: cephx 2024-09-19T14:10:27.633 INFO:tasks.workunit.client.0.smithi153.stderr: -276> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding auth protocol: cephx 2024-09-19T14:10:27.633 INFO:tasks.workunit.client.0.smithi153.stderr: -275> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding auth protocol: cephx 2024-09-19T14:10:27.633 INFO:tasks.workunit.client.0.smithi153.stderr: -274> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding con mode: secure 2024-09-19T14:10:27.633 INFO:tasks.workunit.client.0.smithi153.stderr: -273> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding con mode: crc 2024-09-19T14:10:27.634 INFO:tasks.workunit.client.0.smithi153.stderr: -272> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding con mode: secure 2024-09-19T14:10:27.634 INFO:tasks.workunit.client.0.smithi153.stderr: -271> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding con mode: crc 2024-09-19T14:10:27.634 INFO:tasks.workunit.client.0.smithi153.stderr: -270> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding con mode: secure 2024-09-19T14:10:27.634 INFO:tasks.workunit.client.0.smithi153.stderr: -269> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding con mode: crc 2024-09-19T14:10:27.634 INFO:tasks.workunit.client.0.smithi153.stderr: -268> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding con mode: crc 2024-09-19T14:10:27.634 INFO:tasks.workunit.client.0.smithi153.stderr: -267> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding con mode: secure 2024-09-19T14:10:27.634 INFO:tasks.workunit.client.0.smithi153.stderr: -266> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding con mode: crc 2024-09-19T14:10:27.634 INFO:tasks.workunit.client.0.smithi153.stderr: -265> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding con mode: secure 2024-09-19T14:10:27.634 INFO:tasks.workunit.client.0.smithi153.stderr: -264> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding con mode: crc 2024-09-19T14:10:27.634 INFO:tasks.workunit.client.0.smithi153.stderr: -263> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding con mode: secure 2024-09-19T14:10:27.634 INFO:tasks.workunit.client.0.smithi153.stderr: -262> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.634 INFO:tasks.workunit.client.0.smithi153.stderr: -261> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.634 INFO:tasks.workunit.client.0.smithi153.stderr: -260> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command rotate-key cmddesc rotate-key hook 0x7ffe3c8bdf78 EEXIST 2024-09-19T14:10:27.634 INFO:tasks.workunit.client.0.smithi153.stderr: -259> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient: _reopen_session rank -1 2024-09-19T14:10:27.635 INFO:tasks.workunit.client.0.smithi153.stderr: -258> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:10:27.635 INFO:tasks.workunit.client.0.smithi153.stderr: -257> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient(hunting): picked mon.noname-b con 0x5584e5a53200 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:10:27.635 INFO:tasks.workunit.client.0.smithi153.stderr: -256> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient(hunting): picked mon.noname-a con 0x5584e5a7d7f0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:10:27.635 INFO:tasks.workunit.client.0.smithi153.stderr: -255> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient(hunting): picked mon.noname-c con 0x5584e5a7ea30 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:10:27.635 INFO:tasks.workunit.client.0.smithi153.stderr: -254> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:10:27.635 INFO:tasks.workunit.client.0.smithi153.stderr: -253> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:10:27.635 INFO:tasks.workunit.client.0.smithi153.stderr: -252> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:10:27.635 INFO:tasks.workunit.client.0.smithi153.stderr: -251> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient(hunting): _renew_subs 2024-09-19T14:10:27.635 INFO:tasks.workunit.client.0.smithi153.stderr: -250> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient(hunting): authenticate will time out at 2815.975211s 2024-09-19T14:10:27.635 INFO:tasks.workunit.client.0.smithi153.stderr: -249> 2024-09-19T14:10:27.509+0000 7ff792fcc640 10 monclient(hunting): get_auth_request con 0x5584e5a7d7f0 auth_method 0 2024-09-19T14:10:27.635 INFO:tasks.workunit.client.0.smithi153.stderr: -248> 2024-09-19T14:10:27.509+0000 7ff792fcc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:10:27.635 INFO:tasks.workunit.client.0.smithi153.stderr: -247> 2024-09-19T14:10:27.509+0000 7ff792fcc640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:10:27.635 INFO:tasks.workunit.client.0.smithi153.stderr: -246> 2024-09-19T14:10:27.509+0000 7ff792fcc640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:10:27.636 INFO:tasks.workunit.client.0.smithi153.stderr: -245> 2024-09-19T14:10:27.509+0000 7ff793fce640 10 monclient(hunting): get_auth_request con 0x5584e5a7ea30 auth_method 0 2024-09-19T14:10:27.636 INFO:tasks.workunit.client.0.smithi153.stderr: -244> 2024-09-19T14:10:27.509+0000 7ff793fce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:10:27.636 INFO:tasks.workunit.client.0.smithi153.stderr: -243> 2024-09-19T14:10:27.509+0000 7ff793fce640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:10:27.636 INFO:tasks.workunit.client.0.smithi153.stderr: -242> 2024-09-19T14:10:27.509+0000 7ff793fce640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:10:27.636 INFO:tasks.workunit.client.0.smithi153.stderr: -241> 2024-09-19T14:10:27.509+0000 7ff792fcc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:10:27.636 INFO:tasks.workunit.client.0.smithi153.stderr: -240> 2024-09-19T14:10:27.509+0000 7ff792fcc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:10:27.636 INFO:tasks.workunit.client.0.smithi153.stderr: -239> 2024-09-19T14:10:27.509+0000 7ff792fcc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:10:27.636 INFO:tasks.workunit.client.0.smithi153.stderr: -238> 2024-09-19T14:10:27.509+0000 7ff793fce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:10:27.636 INFO:tasks.workunit.client.0.smithi153.stderr: -237> 2024-09-19T14:10:27.509+0000 7ff793fce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:10:27.636 INFO:tasks.workunit.client.0.smithi153.stderr: -236> 2024-09-19T14:10:27.509+0000 7ff793fce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:10:27.636 INFO:tasks.workunit.client.0.smithi153.stderr: -235> 2024-09-19T14:10:27.509+0000 7ff7937cd640 10 monclient(hunting): get_auth_request con 0x5584e5a53200 auth_method 0 2024-09-19T14:10:27.636 INFO:tasks.workunit.client.0.smithi153.stderr: -234> 2024-09-19T14:10:27.509+0000 7ff7937cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:10:27.636 INFO:tasks.workunit.client.0.smithi153.stderr: -233> 2024-09-19T14:10:27.509+0000 7ff7937cd640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:10:27.637 INFO:tasks.workunit.client.0.smithi153.stderr: -232> 2024-09-19T14:10:27.509+0000 7ff7937cd640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:10:27.637 INFO:tasks.workunit.client.0.smithi153.stderr: -231> 2024-09-19T14:10:27.509+0000 7ff792fcc640 10 monclient(hunting): handle_auth_done global_id 7689 payload 274 2024-09-19T14:10:27.637 INFO:tasks.workunit.client.0.smithi153.stderr: -230> 2024-09-19T14:10:27.509+0000 7ff792fcc640 10 monclient: _finish_hunting 0 2024-09-19T14:10:27.637 INFO:tasks.workunit.client.0.smithi153.stderr: -229> 2024-09-19T14:10:27.509+0000 7ff792fcc640 1 monclient: found mon.noname-a 2024-09-19T14:10:27.637 INFO:tasks.workunit.client.0.smithi153.stderr: -228> 2024-09-19T14:10:27.509+0000 7ff792fcc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:10:27.637 INFO:tasks.workunit.client.0.smithi153.stderr: -227> 2024-09-19T14:10:27.509+0000 7ff676ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:10:27.637 INFO:tasks.workunit.client.0.smithi153.stderr: -226> 2024-09-19T14:10:27.509+0000 7ff676ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:10:27.637 INFO:tasks.workunit.client.0.smithi153.stderr: -225> 2024-09-19T14:10:27.509+0000 7ff676ffd640 10 monclient: dump: 2024-09-19T14:10:27.637 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:10:27.637 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:10:27.637 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.637 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.637 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:10:27.638 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.638 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:10:27.638 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:10:27.638 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:10:27.638 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.638 INFO:tasks.workunit.client.0.smithi153.stderr: -224> 2024-09-19T14:10:27.513+0000 7ff676ffd640 10 monclient: _finish_auth 0 2024-09-19T14:10:27.638 INFO:tasks.workunit.client.0.smithi153.stderr: -223> 2024-09-19T14:10:27.513+0000 7ff676ffd640 10 monclient: _check_auth_tickets 2024-09-19T14:10:27.638 INFO:tasks.workunit.client.0.smithi153.stderr: -222> 2024-09-19T14:10:27.513+0000 7ff676ffd640 10 monclient: handle_config config(0 keys) 2024-09-19T14:10:27.638 INFO:tasks.workunit.client.0.smithi153.stderr: -221> 2024-09-19T14:10:27.513+0000 7ff676ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:10:27.638 INFO:tasks.workunit.client.0.smithi153.stderr: -220> 2024-09-19T14:10:27.513+0000 7ff676ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:10:27.638 INFO:tasks.workunit.client.0.smithi153.stderr: -219> 2024-09-19T14:10:27.513+0000 7ff676ffd640 10 monclient: dump: 2024-09-19T14:10:27.638 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:10:27.638 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:10:27.638 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.639 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.639 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:10:27.639 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.639 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:10:27.639 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:10:27.639 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:10:27.639 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.639 INFO:tasks.workunit.client.0.smithi153.stderr: -218> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 monclient: authenticate success, global_id 7689 2024-09-19T14:10:27.639 INFO:tasks.workunit.client.0.smithi153.stderr: -217> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient: get_monmap_and_config success 2024-09-19T14:10:27.639 INFO:tasks.workunit.client.0.smithi153.stderr: -216> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 4 set_mon_vals no callback set 2024-09-19T14:10:27.639 INFO:tasks.workunit.client.0.smithi153.stderr: -215> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient: shutdown 2024-09-19T14:10:27.639 INFO:tasks.workunit.client.0.smithi153.stderr: -214> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient: build_initial_monmap 2024-09-19T14:10:27.639 INFO:tasks.workunit.client.0.smithi153.stderr: -213> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 1 build_initial for_mkfs: 0 2024-09-19T14:10:27.639 INFO:tasks.workunit.client.0.smithi153.stderr: -212> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient: monmap: 2024-09-19T14:10:27.640 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:10:27.640 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:10:27.640 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:10:27.640 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:10:27.640 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:10:27.640 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.640 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:10:27.640 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:10:27.640 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:10:27.640 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.640 INFO:tasks.workunit.client.0.smithi153.stderr: -211> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding auth protocol: cephx 2024-09-19T14:10:27.640 INFO:tasks.workunit.client.0.smithi153.stderr: -210> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding auth protocol: cephx 2024-09-19T14:10:27.640 INFO:tasks.workunit.client.0.smithi153.stderr: -209> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding auth protocol: cephx 2024-09-19T14:10:27.640 INFO:tasks.workunit.client.0.smithi153.stderr: -208> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding con mode: secure 2024-09-19T14:10:27.641 INFO:tasks.workunit.client.0.smithi153.stderr: -207> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding con mode: crc 2024-09-19T14:10:27.641 INFO:tasks.workunit.client.0.smithi153.stderr: -206> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding con mode: secure 2024-09-19T14:10:27.641 INFO:tasks.workunit.client.0.smithi153.stderr: -205> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding con mode: crc 2024-09-19T14:10:27.641 INFO:tasks.workunit.client.0.smithi153.stderr: -204> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding con mode: secure 2024-09-19T14:10:27.641 INFO:tasks.workunit.client.0.smithi153.stderr: -203> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding con mode: crc 2024-09-19T14:10:27.641 INFO:tasks.workunit.client.0.smithi153.stderr: -202> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding con mode: crc 2024-09-19T14:10:27.641 INFO:tasks.workunit.client.0.smithi153.stderr: -201> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding con mode: secure 2024-09-19T14:10:27.641 INFO:tasks.workunit.client.0.smithi153.stderr: -200> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding con mode: crc 2024-09-19T14:10:27.641 INFO:tasks.workunit.client.0.smithi153.stderr: -199> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding con mode: secure 2024-09-19T14:10:27.641 INFO:tasks.workunit.client.0.smithi153.stderr: -198> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding con mode: crc 2024-09-19T14:10:27.641 INFO:tasks.workunit.client.0.smithi153.stderr: -197> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding con mode: secure 2024-09-19T14:10:27.641 INFO:tasks.workunit.client.0.smithi153.stderr: -196> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.641 INFO:tasks.workunit.client.0.smithi153.stderr: -195> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 1 librados: starting msgr at 2024-09-19T14:10:27.641 INFO:tasks.workunit.client.0.smithi153.stderr: -194> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 1 librados: starting objecter 2024-09-19T14:10:27.642 INFO:tasks.workunit.client.0.smithi153.stderr: -193> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command objecter_requests cmddesc objecter_requests hook 0x5584e5a2d770 EEXIST 2024-09-19T14:10:27.642 INFO:tasks.workunit.client.0.smithi153.stderr: -192> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 1 librados: setting wanted keys 2024-09-19T14:10:27.642 INFO:tasks.workunit.client.0.smithi153.stderr: -191> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 1 librados: calling monclient init 2024-09-19T14:10:27.642 INFO:tasks.workunit.client.0.smithi153.stderr: -190> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient: init 2024-09-19T14:10:27.642 INFO:tasks.workunit.client.0.smithi153.stderr: -189> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding auth protocol: cephx 2024-09-19T14:10:27.642 INFO:tasks.workunit.client.0.smithi153.stderr: -188> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding auth protocol: cephx 2024-09-19T14:10:27.642 INFO:tasks.workunit.client.0.smithi153.stderr: -187> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding auth protocol: cephx 2024-09-19T14:10:27.642 INFO:tasks.workunit.client.0.smithi153.stderr: -186> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding con mode: secure 2024-09-19T14:10:27.642 INFO:tasks.workunit.client.0.smithi153.stderr: -185> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding con mode: crc 2024-09-19T14:10:27.642 INFO:tasks.workunit.client.0.smithi153.stderr: -184> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding con mode: secure 2024-09-19T14:10:27.642 INFO:tasks.workunit.client.0.smithi153.stderr: -183> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding con mode: crc 2024-09-19T14:10:27.642 INFO:tasks.workunit.client.0.smithi153.stderr: -182> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding con mode: secure 2024-09-19T14:10:27.642 INFO:tasks.workunit.client.0.smithi153.stderr: -181> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding con mode: crc 2024-09-19T14:10:27.643 INFO:tasks.workunit.client.0.smithi153.stderr: -180> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding con mode: crc 2024-09-19T14:10:27.643 INFO:tasks.workunit.client.0.smithi153.stderr: -179> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding con mode: secure 2024-09-19T14:10:27.643 INFO:tasks.workunit.client.0.smithi153.stderr: -178> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding con mode: crc 2024-09-19T14:10:27.643 INFO:tasks.workunit.client.0.smithi153.stderr: -177> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding con mode: secure 2024-09-19T14:10:27.643 INFO:tasks.workunit.client.0.smithi153.stderr: -176> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding con mode: crc 2024-09-19T14:10:27.643 INFO:tasks.workunit.client.0.smithi153.stderr: -175> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding con mode: secure 2024-09-19T14:10:27.643 INFO:tasks.workunit.client.0.smithi153.stderr: -174> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.643 INFO:tasks.workunit.client.0.smithi153.stderr: -173> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.643 INFO:tasks.workunit.client.0.smithi153.stderr: -172> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command rotate-key cmddesc rotate-key hook 0x5584e5a31758 EEXIST 2024-09-19T14:10:27.643 INFO:tasks.workunit.client.0.smithi153.stderr: -171> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient: _reopen_session rank -1 2024-09-19T14:10:27.643 INFO:tasks.workunit.client.0.smithi153.stderr: -170> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T14:10:27.643 INFO:tasks.workunit.client.0.smithi153.stderr: -169> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient(hunting): picked mon.noname-c con 0x5584e5a53200 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:10:27.643 INFO:tasks.workunit.client.0.smithi153.stderr: -168> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient(hunting): picked mon.noname-b con 0x5584e5a7d7f0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:10:27.643 INFO:tasks.workunit.client.0.smithi153.stderr: -167> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient(hunting): picked mon.noname-a con 0x5584e5a7ea30 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:10:27.644 INFO:tasks.workunit.client.0.smithi153.stderr: -166> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:10:27.644 INFO:tasks.workunit.client.0.smithi153.stderr: -165> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:10:27.644 INFO:tasks.workunit.client.0.smithi153.stderr: -164> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:10:27.644 INFO:tasks.workunit.client.0.smithi153.stderr: -163> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient(hunting): _renew_subs 2024-09-19T14:10:27.644 INFO:tasks.workunit.client.0.smithi153.stderr: -162> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient(hunting): authenticate will time out at 2815.977929s 2024-09-19T14:10:27.644 INFO:tasks.workunit.client.0.smithi153.stderr: -161> 2024-09-19T14:10:27.513+0000 7ff7937cd640 10 monclient(hunting): get_auth_request con 0x5584e5a53200 auth_method 0 2024-09-19T14:10:27.644 INFO:tasks.workunit.client.0.smithi153.stderr: -160> 2024-09-19T14:10:27.513+0000 7ff7937cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:10:27.644 INFO:tasks.workunit.client.0.smithi153.stderr: -159> 2024-09-19T14:10:27.513+0000 7ff7937cd640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:10:27.644 INFO:tasks.workunit.client.0.smithi153.stderr: -158> 2024-09-19T14:10:27.513+0000 7ff7937cd640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:10:27.644 INFO:tasks.workunit.client.0.smithi153.stderr: -157> 2024-09-19T14:10:27.513+0000 7ff793fce640 10 monclient(hunting): get_auth_request con 0x5584e5a7ea30 auth_method 0 2024-09-19T14:10:27.644 INFO:tasks.workunit.client.0.smithi153.stderr: -156> 2024-09-19T14:10:27.513+0000 7ff793fce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:10:27.644 INFO:tasks.workunit.client.0.smithi153.stderr: -155> 2024-09-19T14:10:27.513+0000 7ff793fce640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:10:27.644 INFO:tasks.workunit.client.0.smithi153.stderr: -154> 2024-09-19T14:10:27.513+0000 7ff793fce640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:10:27.644 INFO:tasks.workunit.client.0.smithi153.stderr: -153> 2024-09-19T14:10:27.513+0000 7ff7937cd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:10:27.645 INFO:tasks.workunit.client.0.smithi153.stderr: -152> 2024-09-19T14:10:27.513+0000 7ff7937cd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:10:27.645 INFO:tasks.workunit.client.0.smithi153.stderr: -151> 2024-09-19T14:10:27.513+0000 7ff7937cd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:10:27.645 INFO:tasks.workunit.client.0.smithi153.stderr: -150> 2024-09-19T14:10:27.513+0000 7ff793fce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:10:27.645 INFO:tasks.workunit.client.0.smithi153.stderr: -149> 2024-09-19T14:10:27.513+0000 7ff793fce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:10:27.645 INFO:tasks.workunit.client.0.smithi153.stderr: -148> 2024-09-19T14:10:27.513+0000 7ff793fce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:10:27.645 INFO:tasks.workunit.client.0.smithi153.stderr: -147> 2024-09-19T14:10:27.513+0000 7ff7937cd640 10 monclient(hunting): handle_auth_done global_id 7208 payload 824 2024-09-19T14:10:27.645 INFO:tasks.workunit.client.0.smithi153.stderr: -146> 2024-09-19T14:10:27.513+0000 7ff7937cd640 10 monclient: _finish_hunting 0 2024-09-19T14:10:27.645 INFO:tasks.workunit.client.0.smithi153.stderr: -145> 2024-09-19T14:10:27.513+0000 7ff7937cd640 1 monclient: found mon.noname-c 2024-09-19T14:10:27.645 INFO:tasks.workunit.client.0.smithi153.stderr: -144> 2024-09-19T14:10:27.513+0000 7ff7937cd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:10:27.645 INFO:tasks.workunit.client.0.smithi153.stderr: -143> 2024-09-19T14:10:27.513+0000 7ff6757fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:10:27.645 INFO:tasks.workunit.client.0.smithi153.stderr: -142> 2024-09-19T14:10:27.513+0000 7ff6757fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:10:27.645 INFO:tasks.workunit.client.0.smithi153.stderr: -141> 2024-09-19T14:10:27.513+0000 7ff6757fa640 10 monclient: dump: 2024-09-19T14:10:27.645 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:10:27.645 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:10:27.646 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.646 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.646 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:10:27.646 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.646 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:10:27.646 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:10:27.646 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:10:27.646 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.646 INFO:tasks.workunit.client.0.smithi153.stderr: -140> 2024-09-19T14:10:27.513+0000 7ff6757fa640 10 monclient: _finish_auth 0 2024-09-19T14:10:27.646 INFO:tasks.workunit.client.0.smithi153.stderr: -139> 2024-09-19T14:10:27.513+0000 7ff6757fa640 10 monclient: _check_auth_tickets 2024-09-19T14:10:27.646 INFO:tasks.workunit.client.0.smithi153.stderr: -138> 2024-09-19T14:10:27.513+0000 7ff6757fa640 10 monclient: handle_config config(0 keys) 2024-09-19T14:10:27.646 INFO:tasks.workunit.client.0.smithi153.stderr: -137> 2024-09-19T14:10:27.513+0000 7ff6757fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:10:27.646 INFO:tasks.workunit.client.0.smithi153.stderr: -136> 2024-09-19T14:10:27.513+0000 7ff6757fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:10:27.646 INFO:tasks.workunit.client.0.smithi153.stderr: -135> 2024-09-19T14:10:27.513+0000 7ff6757fa640 10 monclient: dump: 2024-09-19T14:10:27.647 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:10:27.647 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:10:27.647 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.647 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.647 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:10:27.647 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.647 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:10:27.647 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:10:27.647 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:10:27.647 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.647 INFO:tasks.workunit.client.0.smithi153.stderr: -134> 2024-09-19T14:10:27.513+0000 7ff676ffd640 4 set_mon_vals no callback set 2024-09-19T14:10:27.647 INFO:tasks.workunit.client.0.smithi153.stderr: -133> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 monclient: authenticate success, global_id 7208 2024-09-19T14:10:27.647 INFO:tasks.workunit.client.0.smithi153.stderr: -132> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient: _renew_subs 2024-09-19T14:10:27.647 INFO:tasks.workunit.client.0.smithi153.stderr: -131> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:10:27.648 INFO:tasks.workunit.client.0.smithi153.stderr: -130> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient: _renew_subs 2024-09-19T14:10:27.648 INFO:tasks.workunit.client.0.smithi153.stderr: -129> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:10:27.648 INFO:tasks.workunit.client.0.smithi153.stderr: -128> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 1 librados: init done 2024-09-19T14:10:27.648 INFO:tasks.workunit.client.0.smithi153.stderr: -127> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command cr dump hook 0x7ff788004588 2024-09-19T14:10:27.648 INFO:tasks.workunit.client.0.smithi153.stderr: -126> 2024-09-19T14:10:27.517+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.648 INFO:tasks.workunit.client.0.smithi153.stderr: -125> 2024-09-19T14:10:27.517+0000 7ff6757fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:10:27.648 INFO:tasks.workunit.client.0.smithi153.stderr: -124> 2024-09-19T14:10:27.517+0000 7ff6757fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:10:27.648 INFO:tasks.workunit.client.0.smithi153.stderr: -123> 2024-09-19T14:10:27.517+0000 7ff6757fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:10:27.648 INFO:tasks.workunit.client.0.smithi153.stderr: -122> 2024-09-19T14:10:27.517+0000 7ff792fcc640 10 monclient: get_auth_request con 0x7ff65c071be0 auth_method 0 2024-09-19T14:10:27.648 INFO:tasks.workunit.client.0.smithi153.stderr: -121> 2024-09-19T14:10:27.517+0000 7ff793fce640 10 monclient: get_auth_request con 0x5584e5a9cbb0 auth_method 0 2024-09-19T14:10:27.648 INFO:tasks.workunit.client.0.smithi153.stderr: -120> 2024-09-19T14:10:27.517+0000 7ff795cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.648 INFO:tasks.workunit.client.0.smithi153.stderr: -119> 2024-09-19T14:10:27.517+0000 7ff795cc79c0 20 realm 2024-09-19T14:10:27.648 INFO:tasks.workunit.client.0.smithi153.stderr: -118> 2024-09-19T14:10:27.517+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.648 INFO:tasks.workunit.client.0.smithi153.stderr: -117> 2024-09-19T14:10:27.517+0000 7ff795cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.649 INFO:tasks.workunit.client.0.smithi153.stderr: -116> 2024-09-19T14:10:27.517+0000 7ff795cc79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:10:27.649 INFO:tasks.workunit.client.0.smithi153.stderr: -115> 2024-09-19T14:10:27.517+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.649 INFO:tasks.workunit.client.0.smithi153.stderr: -114> 2024-09-19T14:10:27.517+0000 7ff795cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.649 INFO:tasks.workunit.client.0.smithi153.stderr: -113> 2024-09-19T14:10:27.517+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.649 INFO:tasks.workunit.client.0.smithi153.stderr: -112> 2024-09-19T14:10:27.517+0000 7ff7937cd640 10 monclient: get_auth_request con 0x5584e5aa0e50 auth_method 0 2024-09-19T14:10:27.649 INFO:tasks.workunit.client.0.smithi153.stderr: -111> 2024-09-19T14:10:27.521+0000 7ff795cc79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:27.649 INFO:tasks.workunit.client.0.smithi153.stderr: -110> 2024-09-19T14:10:27.521+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.649 INFO:tasks.workunit.client.0.smithi153.stderr: -109> 2024-09-19T14:10:27.521+0000 7ff795cc79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:10:27.649 INFO:tasks.workunit.client.0.smithi153.stderr: -108> 2024-09-19T14:10:27.521+0000 7ff795cc79c0 20 searching for the correct realm 2024-09-19T14:10:27.649 INFO:tasks.workunit.client.0.smithi153.stderr: -107> 2024-09-19T14:10:27.521+0000 7ff792fcc640 10 monclient: get_auth_request con 0x5584e5aa6060 auth_method 0 2024-09-19T14:10:27.649 INFO:tasks.workunit.client.0.smithi153.stderr: -106> 2024-09-19T14:10:27.521+0000 7ff793fce640 10 monclient: get_auth_request con 0x7ff788008040 auth_method 0 2024-09-19T14:10:27.649 INFO:tasks.workunit.client.0.smithi153.stderr: -105> 2024-09-19T14:10:27.521+0000 7ff7937cd640 10 monclient: get_auth_request con 0x7ff78c049060 auth_method 0 2024-09-19T14:10:27.649 INFO:tasks.workunit.client.0.smithi153.stderr: -104> 2024-09-19T14:10:27.521+0000 7ff7937cd640 0 -- 172.21.15.153:0/1648261788 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x7ff78c049060 msgr2=0x7ff78c06b870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:10:27.649 INFO:tasks.workunit.client.0.smithi153.stderr: -103> 2024-09-19T14:10:27.521+0000 7ff6757fa640 1 client.7208.objecter ms_handle_reset 0x7ff78c049060 session 0x7ff78c00f040 osd.2 2024-09-19T14:10:27.650 INFO:tasks.workunit.client.0.smithi153.stderr: -102> 2024-09-19T14:10:27.521+0000 7ff6757fa640 10 monclient: _renew_subs 2024-09-19T14:10:27.650 INFO:tasks.workunit.client.0.smithi153.stderr: -101> 2024-09-19T14:10:27.521+0000 7ff6757fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:10:27.650 INFO:tasks.workunit.client.0.smithi153.stderr: -100> 2024-09-19T14:10:27.521+0000 7ff7937cd640 10 monclient: get_auth_request con 0x7ff65c082310 auth_method 0 2024-09-19T14:10:27.650 INFO:tasks.workunit.client.0.smithi153.stderr: -99> 2024-09-19T14:10:27.521+0000 7ff792fcc640 10 monclient: get_auth_request con 0x7ff78413b040 auth_method 0 2024-09-19T14:10:27.650 INFO:tasks.workunit.client.0.smithi153.stderr: -98> 2024-09-19T14:10:27.525+0000 7ff793fce640 10 monclient: get_auth_request con 0x7ff788034950 auth_method 0 2024-09-19T14:10:27.650 INFO:tasks.workunit.client.0.smithi153.stderr: -97> 2024-09-19T14:10:27.529+0000 7ff7937cd640 0 -- 172.21.15.153:0/1648261788 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x7ff65c082310 msgr2=0x7ff65c084740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:10:27.650 INFO:tasks.workunit.client.0.smithi153.stderr: -96> 2024-09-19T14:10:27.529+0000 7ff6757fa640 1 client.7208.objecter ms_handle_reset 0x7ff65c082310 session 0x7ff78c00f040 osd.2 2024-09-19T14:10:27.650 INFO:tasks.workunit.client.0.smithi153.stderr: -95> 2024-09-19T14:10:27.529+0000 7ff7937cd640 10 monclient: get_auth_request con 0x7ff78c049060 auth_method 0 2024-09-19T14:10:27.650 INFO:tasks.workunit.client.0.smithi153.stderr: -94> 2024-09-19T14:10:27.529+0000 7ff7937cd640 10 monclient: get_auth_request con 0x7ff78802a3f0 auth_method 0 2024-09-19T14:10:27.650 INFO:tasks.workunit.client.0.smithi153.stderr: -93> 2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:10:27.650 INFO:tasks.workunit.client.0.smithi153.stderr: -92> 2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:10:27.650 INFO:tasks.workunit.client.0.smithi153.stderr: -91> 2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:10:27.650 INFO:tasks.workunit.client.0.smithi153.stderr: -90> 2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:10:27.650 INFO:tasks.workunit.client.0.smithi153.stderr: -89> 2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:10:27.651 INFO:tasks.workunit.client.0.smithi153.stderr: -88> 2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:10:27.651 INFO:tasks.workunit.client.0.smithi153.stderr: -87> 2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.651 INFO:tasks.workunit.client.0.smithi153.stderr: -86> 2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.651 INFO:tasks.workunit.client.0.smithi153.stderr: -85> 2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.651 INFO:tasks.workunit.client.0.smithi153.stderr: -84> 2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:27.651 INFO:tasks.workunit.client.0.smithi153.stderr: -83> 2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.651 INFO:tasks.workunit.client.0.smithi153.stderr: -82> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:10:27.651 INFO:tasks.workunit.client.0.smithi153.stderr: -81> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 zone default found 2024-09-19T14:10:27.651 INFO:tasks.workunit.client.0.smithi153.stderr: -80> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 4 Realm: () 2024-09-19T14:10:27.651 INFO:tasks.workunit.client.0.smithi153.stderr: -79> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:10:27.651 INFO:tasks.workunit.client.0.smithi153.stderr: -78> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:10:27.651 INFO:tasks.workunit.client.0.smithi153.stderr: -77> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:10:27.651 INFO:tasks.workunit.client.0.smithi153.stderr: -76> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 zonegroup default 2024-09-19T14:10:27.651 INFO:tasks.workunit.client.0.smithi153.stderr: -75> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.652 INFO:tasks.workunit.client.0.smithi153.stderr: -74> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.652 INFO:tasks.workunit.client.0.smithi153.stderr: -73> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.652 INFO:tasks.workunit.client.0.smithi153.stderr: -72> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.652 INFO:tasks.workunit.client.0.smithi153.stderr: -71> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.652 INFO:tasks.workunit.client.0.smithi153.stderr: -70> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.652 INFO:tasks.workunit.client.0.smithi153.stderr: -69> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 started sync module instance, tier type = 2024-09-19T14:10:27.652 INFO:tasks.workunit.client.0.smithi153.stderr: -68> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:10:27.652 INFO:tasks.workunit.client.0.smithi153.stderr: -67> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 20 add_watcher() i=0 2024-09-19T14:10:27.652 INFO:tasks.workunit.client.0.smithi153.stderr: -66> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 20 add_watcher() i=1 2024-09-19T14:10:27.652 INFO:tasks.workunit.client.0.smithi153.stderr: -65> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 20 add_watcher() i=2 2024-09-19T14:10:27.652 INFO:tasks.workunit.client.0.smithi153.stderr: -64> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 20 add_watcher() i=3 2024-09-19T14:10:27.652 INFO:tasks.workunit.client.0.smithi153.stderr: -63> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 20 add_watcher() i=4 2024-09-19T14:10:27.652 INFO:tasks.workunit.client.0.smithi153.stderr: -62> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 20 add_watcher() i=5 2024-09-19T14:10:27.652 INFO:tasks.workunit.client.0.smithi153.stderr: -61> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 20 add_watcher() i=6 2024-09-19T14:10:27.653 INFO:tasks.workunit.client.0.smithi153.stderr: -60> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 20 add_watcher() i=7 2024-09-19T14:10:27.653 INFO:tasks.workunit.client.0.smithi153.stderr: -59> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:10:27.653 INFO:tasks.workunit.client.0.smithi153.stderr: -58> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding auth protocol: cephx 2024-09-19T14:10:27.653 INFO:tasks.workunit.client.0.smithi153.stderr: -57> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding auth protocol: cephx 2024-09-19T14:10:27.653 INFO:tasks.workunit.client.0.smithi153.stderr: -56> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding auth protocol: cephx 2024-09-19T14:10:27.653 INFO:tasks.workunit.client.0.smithi153.stderr: -55> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding con mode: secure 2024-09-19T14:10:27.653 INFO:tasks.workunit.client.0.smithi153.stderr: -54> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding con mode: crc 2024-09-19T14:10:27.653 INFO:tasks.workunit.client.0.smithi153.stderr: -53> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding con mode: secure 2024-09-19T14:10:27.653 INFO:tasks.workunit.client.0.smithi153.stderr: -52> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding con mode: crc 2024-09-19T14:10:27.653 INFO:tasks.workunit.client.0.smithi153.stderr: -51> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding con mode: secure 2024-09-19T14:10:27.653 INFO:tasks.workunit.client.0.smithi153.stderr: -50> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding con mode: crc 2024-09-19T14:10:27.653 INFO:tasks.workunit.client.0.smithi153.stderr: -49> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding con mode: crc 2024-09-19T14:10:27.653 INFO:tasks.workunit.client.0.smithi153.stderr: -48> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding con mode: secure 2024-09-19T14:10:27.653 INFO:tasks.workunit.client.0.smithi153.stderr: -47> 2024-09-19T14:10:27.557+0000 7ff64a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:27.654 INFO:tasks.workunit.client.0.smithi153.stderr: -46> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding con mode: crc 2024-09-19T14:10:27.654 INFO:tasks.workunit.client.0.smithi153.stderr: -45> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding con mode: secure 2024-09-19T14:10:27.654 INFO:tasks.workunit.client.0.smithi153.stderr: -44> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding con mode: crc 2024-09-19T14:10:27.654 INFO:tasks.workunit.client.0.smithi153.stderr: -43> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding con mode: secure 2024-09-19T14:10:27.654 INFO:tasks.workunit.client.0.smithi153.stderr: -42> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.654 INFO:tasks.workunit.client.0.smithi153.stderr: -41> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:10:27.654 INFO:tasks.workunit.client.0.smithi153.stderr: -40> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:10:27.654 INFO:tasks.workunit.client.0.smithi153.stderr: -39> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command cache list hook 0x5584e5a82920 2024-09-19T14:10:27.654 INFO:tasks.workunit.client.0.smithi153.stderr: -38> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command cache inspect hook 0x5584e5a82920 2024-09-19T14:10:27.654 INFO:tasks.workunit.client.0.smithi153.stderr: -37> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command cache erase hook 0x5584e5a82920 2024-09-19T14:10:27.654 INFO:tasks.workunit.client.0.smithi153.stderr: -36> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command cache zap hook 0x5584e5a82920 2024-09-19T14:10:27.654 INFO:tasks.workunit.client.0.smithi153.stderr: -35> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 note: GC not initialized 2024-09-19T14:10:27.654 INFO:tasks.workunit.client.0.smithi153.stderr: -34> 2024-09-19T14:10:27.561+0000 7ff6497e2640 20 reqs_thread_entry: start 2024-09-19T14:10:27.655 INFO:tasks.workunit.client.0.smithi153.stderr: -33> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command sync trace show hook 0x7ff77c001d40 2024-09-19T14:10:27.655 INFO:tasks.workunit.client.0.smithi153.stderr: -32> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command sync trace history hook 0x7ff77c001d40 2024-09-19T14:10:27.655 INFO:tasks.workunit.client.0.smithi153.stderr: -31> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command sync trace active hook 0x7ff77c001d40 2024-09-19T14:10:27.655 INFO:tasks.workunit.client.0.smithi153.stderr: -30> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command sync trace active_short hook 0x7ff77c001d40 2024-09-19T14:10:27.655 INFO:tasks.workunit.client.0.smithi153.stderr: -29> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 20 init_complete bucket index max shards: 11 2024-09-19T14:10:27.655 INFO:tasks.workunit.client.0.smithi153.stderr: -28> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 20 Filter name: none 2024-09-19T14:10:27.655 INFO:tasks.workunit.client.0.smithi153.stderr: -27> 2024-09-19T14:10:27.561+0000 7ff6427fc640 20 reqs_thread_entry: start 2024-09-19T14:10:27.655 INFO:tasks.workunit.client.0.smithi153.stderr: -26> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-19T14:10:27.655 INFO:tasks.workunit.client.0.smithi153.stderr: -25> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.655 INFO:tasks.workunit.client.0.smithi153.stderr: -24> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-19T14:10:27.655 INFO:tasks.workunit.client.0.smithi153.stderr: -23> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-19T14:10:27.655 INFO:tasks.workunit.client.0.smithi153.stderr: -22> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-19T14:10:27.655 INFO:tasks.workunit.client.0.smithi153.stderr: -21> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 : miss 2024-09-19T14:10:27.655 INFO:tasks.workunit.client.0.smithi153.stderr: -20> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.656 INFO:tasks.workunit.client.0.smithi153.stderr: -19> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-19T14:10:27.656 INFO:tasks.workunit.client.0.smithi153.stderr: -18> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 info.flags=0x17 2024-09-19T14:10:27.656 INFO:tasks.workunit.client.0.smithi153.stderr: -17> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 to cache LRU end 2024-09-19T14:10:27.656 INFO:tasks.workunit.client.0.smithi153.stderr: -16> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:10:27.656 INFO:tasks.workunit.client.0.smithi153.stderr: -15> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:27.656 INFO:tasks.workunit.client.0.smithi153.stderr: -14> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 2024-09-19T14:10:27.656 INFO:tasks.workunit.client.0.smithi153.stderr: -13> 2024-09-19T14:10:27.577+0000 7ff795cc79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 info.flags=0x17 2024-09-19T14:10:27.656 INFO:tasks.workunit.client.0.smithi153.stderr: -12> 2024-09-19T14:10:27.577+0000 7ff795cc79c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 to cache LRU end 2024-09-19T14:10:27.656 INFO:tasks.workunit.client.0.smithi153.stderr: -11> 2024-09-19T14:10:27.577+0000 7ff795cc79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:27.656 INFO:tasks.workunit.client.0.smithi153.stderr: -10> 2024-09-19T14:10:27.577+0000 7ff795cc79c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36, ofs0, ns] 2024-09-19T14:10:27.656 INFO:tasks.workunit.client.0.smithi153.stderr: -9> 2024-09-19T14:10:27.577+0000 7ff676ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333492 cookie 94029277222720 notifier 7208 bl.length()=923 2024-09-19T14:10:27.656 INFO:tasks.workunit.client.0.smithi153.stderr: -8> 2024-09-19T14:10:27.577+0000 7ff676ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 info.flags=0x17 2024-09-19T14:10:27.656 INFO:tasks.workunit.client.0.smithi153.stderr: -7> 2024-09-19T14:10:27.577+0000 7ff676ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 to cache LRU end 2024-09-19T14:10:27.656 INFO:tasks.workunit.client.0.smithi153.stderr: -6> 2024-09-19T14:10:27.577+0000 7ff676ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:27.657 INFO:tasks.workunit.client.0.smithi153.stderr: -5> 2024-09-19T14:10:27.577+0000 7ff795cc79c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.36]): orig_sources= new_sources= 2024-09-19T14:10:27.657 INFO:tasks.workunit.client.0.smithi153.stderr: -4> 2024-09-19T14:10:27.577+0000 7ff795cc79c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.36]): potential sources added=[] removed=[] 2024-09-19T14:10:27.657 INFO:tasks.workunit.client.0.smithi153.stderr: -3> 2024-09-19T14:10:27.577+0000 7ff795cc79c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.36]): orig_dests= new_dests= 2024-09-19T14:10:27.657 INFO:tasks.workunit.client.0.smithi153.stderr: -2> 2024-09-19T14:10:27.577+0000 7ff795cc79c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.36]): potential dests added=[] removed=[] 2024-09-19T14:10:27.657 INFO:tasks.workunit.client.0.smithi153.stderr: -1> 2024-09-19T14:10:27.585+0000 7ff795cc79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff795cc79c0 time 2024-09-19T14:10:27.587368+0000 2024-09-19T14:10:27.657 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:10:27.657 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.657 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:10:27.657 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff7995a12eb] 2024-09-19T14:10:27.657 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff7995a149f] 2024-09-19T14:10:27.657 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5584e3588271] 2024-09-19T14:10:27.657 INFO:tasks.workunit.client.0.smithi153.stderr: 4: radosgw-admin(+0x141057c) [0x5584e3fd957c] 2024-09-19T14:10:27.657 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5584e35980dd] 2024-09-19T14:10:27.658 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:10:27.658 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff798407d90] 2024-09-19T14:10:27.658 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:10:27.658 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:10:27.658 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.658 INFO:tasks.workunit.client.0.smithi153.stderr: 0> 2024-09-19T14:10:27.585+0000 7ff795cc79c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:10:27.658 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7ff795cc79c0 thread_name:radosgw-admin 2024-09-19T14:10:27.658 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.658 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:10:27.658 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff798420520] 2024-09-19T14:10:27.658 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:10:27.658 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:10:27.658 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:10:27.659 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff7995a1345] 2024-09-19T14:10:27.659 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff7995a149f] 2024-09-19T14:10:27.659 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5584e3588271] 2024-09-19T14:10:27.659 INFO:tasks.workunit.client.0.smithi153.stderr: 8: radosgw-admin(+0x141057c) [0x5584e3fd957c] 2024-09-19T14:10:27.659 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5584e35980dd] 2024-09-19T14:10:27.659 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:10:27.659 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff798407d90] 2024-09-19T14:10:27.659 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:10:27.659 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:10:27.659 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:10:27.659 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.659 INFO:tasks.workunit.client.0.smithi153.stderr:--- logging levels --- 2024-09-19T14:10:27.659 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 none 2024-09-19T14:10:27.659 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 lockdep 2024-09-19T14:10:27.660 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 context 2024-09-19T14:10:27.660 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 crush 2024-09-19T14:10:27.660 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds 2024-09-19T14:10:27.660 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_balancer 2024-09-19T14:10:27.660 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_locker 2024-09-19T14:10:27.660 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log 2024-09-19T14:10:27.660 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log_expire 2024-09-19T14:10:27.660 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_migrator 2024-09-19T14:10:27.660 INFO:tasks.workunit.client.0.smithi153.stderr: 3/ 5 mds_quiesce 2024-09-19T14:10:27.660 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 buffer 2024-09-19T14:10:27.660 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 timer 2024-09-19T14:10:27.660 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 filer 2024-09-19T14:10:27.660 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 striper 2024-09-19T14:10:27.660 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 objecter 2024-09-19T14:10:27.661 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rados 2024-09-19T14:10:27.661 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd 2024-09-19T14:10:27.661 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_mirror 2024-09-19T14:10:27.661 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_replay 2024-09-19T14:10:27.661 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_pwl 2024-09-19T14:10:27.661 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 journaler 2024-09-19T14:10:27.661 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objectcacher 2024-09-19T14:10:27.661 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:10:27.661 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 client 2024-09-19T14:10:27.661 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 osd 2024-09-19T14:10:27.661 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 optracker 2024-09-19T14:10:27.661 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objclass 2024-09-19T14:10:27.661 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 filestore 2024-09-19T14:10:27.661 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 journal 2024-09-19T14:10:27.662 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 ms 2024-09-19T14:10:27.662 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mon 2024-09-19T14:10:27.662 INFO:tasks.workunit.client.0.smithi153.stderr: 0/10 monc 2024-09-19T14:10:27.662 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 paxos 2024-09-19T14:10:27.662 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 tp 2024-09-19T14:10:27.662 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 auth 2024-09-19T14:10:27.662 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 crypto 2024-09-19T14:10:27.662 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 finisher 2024-09-19T14:10:27.662 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 reserver 2024-09-19T14:10:27.662 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 heartbeatmap 2024-09-19T14:10:27.662 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 perfcounter 2024-09-19T14:10:27.662 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw 2024-09-19T14:10:27.662 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_sync 2024-09-19T14:10:27.662 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_datacache 2024-09-19T14:10:27.663 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_access 2024-09-19T14:10:27.663 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:10:27.663 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_flight 2024-09-19T14:10:27.663 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:10:27.663 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw_notification 2024-09-19T14:10:27.663 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 javaclient 2024-09-19T14:10:27.663 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 asok 2024-09-19T14:10:27.663 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 throttle 2024-09-19T14:10:27.663 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 refs 2024-09-19T14:10:27.663 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 compressor 2024-09-19T14:10:27.663 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluestore 2024-09-19T14:10:27.663 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluefs 2024-09-19T14:10:27.663 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 bdev 2024-09-19T14:10:27.664 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 kstore 2024-09-19T14:10:27.664 INFO:tasks.workunit.client.0.smithi153.stderr: 4/ 5 rocksdb 2024-09-19T14:10:27.664 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 fuse 2024-09-19T14:10:27.664 INFO:tasks.workunit.client.0.smithi153.stderr: 2/ 5 mgr 2024-09-19T14:10:27.664 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mgrc 2024-09-19T14:10:27.664 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 dpdk 2024-09-19T14:10:27.664 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 eventtrace 2024-09-19T14:10:27.664 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 prioritycache 2024-09-19T14:10:27.664 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 test 2024-09-19T14:10:27.664 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:10:27.664 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephsqlite 2024-09-19T14:10:27.664 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:10:27.664 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore 2024-09-19T14:10:27.664 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_onode 2024-09-19T14:10:27.665 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_odata 2024-09-19T14:10:27.665 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_omap 2024-09-19T14:10:27.665 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_tm 2024-09-19T14:10:27.665 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_t 2024-09-19T14:10:27.665 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:10:27.665 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_epm 2024-09-19T14:10:27.665 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_lba 2024-09-19T14:10:27.665 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:10:27.665 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cache 2024-09-19T14:10:27.665 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_journal 2024-09-19T14:10:27.665 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_device 2024-09-19T14:10:27.665 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_backref 2024-09-19T14:10:27.665 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 alienstore 2024-09-19T14:10:27.666 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mclock 2024-09-19T14:10:27.666 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cyanstore 2024-09-19T14:10:27.666 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 ceph_exporter 2024-09-19T14:10:27.666 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 memstore 2024-09-19T14:10:27.666 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 trace 2024-09-19T14:10:27.666 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 ceph_dedup 2024-09-19T14:10:27.666 INFO:tasks.workunit.client.0.smithi153.stderr: -2/-2 (syslog threshold) 2024-09-19T14:10:27.666 INFO:tasks.workunit.client.0.smithi153.stderr: 99/99 (stderr threshold) 2024-09-19T14:10:27.666 INFO:tasks.workunit.client.0.smithi153.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:10:27.666 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff6427fc640 / http_manager 2024-09-19T14:10:27.666 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff6497e2640 / http_manager 2024-09-19T14:10:27.666 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff64a7e4640 / rgw_dt_lg_renew 2024-09-19T14:10:27.666 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff6757fa640 / ms_dispatch 2024-09-19T14:10:27.667 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff676ffd640 / io_context_pool 2024-09-19T14:10:27.667 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff67d602640 / ms_dispatch 2024-09-19T14:10:27.667 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff67fe07640 / ms_dispatch 2024-09-19T14:10:27.667 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff68160a640 / io_context_pool 2024-09-19T14:10:27.667 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff792fcc640 / msgr-worker-2 2024-09-19T14:10:27.667 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff7937cd640 / msgr-worker-1 2024-09-19T14:10:27.667 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff793fce640 / msgr-worker-0 2024-09-19T14:10:27.667 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff7947cf640 / io_context_pool 2024-09-19T14:10:27.667 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff795cc79c0 / radosgw-admin 2024-09-19T14:10:27.667 INFO:tasks.workunit.client.0.smithi153.stderr: max_recent 500 2024-09-19T14:10:27.667 INFO:tasks.workunit.client.0.smithi153.stderr: max_new 1000 2024-09-19T14:10:27.667 INFO:tasks.workunit.client.0.smithi153.stderr: log_file /var/log/ceph/ceph-client.admin.126405.log 2024-09-19T14:10:27.667 INFO:tasks.workunit.client.0.smithi153.stderr:--- end dump of recent events --- 2024-09-19T14:10:27.667 INFO:tasks.workunit.client.0.smithi153.stderr:--- begin dump of recent events --- 2024-09-19T14:10:27.668 INFO:tasks.workunit.client.0.smithi153.stderr: -499> 2024-09-19T14:10:27.493+0000 7ff7937cd640 1 monclient: found mon.noname-a 2024-09-19T14:10:27.668 INFO:tasks.workunit.client.0.smithi153.stderr: -498> 2024-09-19T14:10:27.493+0000 7ff7937cd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:10:27.668 INFO:tasks.workunit.client.0.smithi153.stderr: -497> 2024-09-19T14:10:27.493+0000 7ff792fcc640 10 monclient: get_auth_request con 0x5584e59ba3d0 auth_method 0 2024-09-19T14:10:27.668 INFO:tasks.workunit.client.0.smithi153.stderr: -496> 2024-09-19T14:10:27.493+0000 7ff68160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:10:27.668 INFO:tasks.workunit.client.0.smithi153.stderr: -495> 2024-09-19T14:10:27.493+0000 7ff68160a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:10:27.668 INFO:tasks.workunit.client.0.smithi153.stderr: -494> 2024-09-19T14:10:27.493+0000 7ff68160a640 10 monclient: dump: 2024-09-19T14:10:27.668 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:10:27.668 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:10:27.668 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.668 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.668 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:10:27.668 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.668 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:10:27.668 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:10:27.669 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:10:27.669 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.669 INFO:tasks.workunit.client.0.smithi153.stderr: -493> 2024-09-19T14:10:27.493+0000 7ff68160a640 10 monclient: _finish_auth 0 2024-09-19T14:10:27.669 INFO:tasks.workunit.client.0.smithi153.stderr: -492> 2024-09-19T14:10:27.493+0000 7ff68160a640 10 monclient: _check_auth_tickets 2024-09-19T14:10:27.669 INFO:tasks.workunit.client.0.smithi153.stderr: -491> 2024-09-19T14:10:27.493+0000 7ff68160a640 10 monclient: handle_config config(0 keys) 2024-09-19T14:10:27.669 INFO:tasks.workunit.client.0.smithi153.stderr: -490> 2024-09-19T14:10:27.493+0000 7ff795cc79c0 5 monclient: authenticate success, global_id 7680 2024-09-19T14:10:27.669 INFO:tasks.workunit.client.0.smithi153.stderr: -489> 2024-09-19T14:10:27.493+0000 7ff795cc79c0 10 monclient: get_monmap_and_config success 2024-09-19T14:10:27.669 INFO:tasks.workunit.client.0.smithi153.stderr: -488> 2024-09-19T14:10:27.493+0000 7ff795cc79c0 4 set_mon_vals no callback set 2024-09-19T14:10:27.669 INFO:tasks.workunit.client.0.smithi153.stderr: -487> 2024-09-19T14:10:27.493+0000 7ff68160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:10:27.669 INFO:tasks.workunit.client.0.smithi153.stderr: -486> 2024-09-19T14:10:27.493+0000 7ff68160a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:10:27.669 INFO:tasks.workunit.client.0.smithi153.stderr: -485> 2024-09-19T14:10:27.493+0000 7ff68160a640 10 monclient: dump: 2024-09-19T14:10:27.669 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:10:27.669 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:10:27.670 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.670 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.670 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:10:27.670 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.670 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:10:27.670 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:10:27.670 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:10:27.670 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.670 INFO:tasks.workunit.client.0.smithi153.stderr: -484> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient: shutdown 2024-09-19T14:10:27.670 INFO:tasks.workunit.client.0.smithi153.stderr: -483> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) unregister_commands rotate-key 2024-09-19T14:10:27.670 INFO:tasks.workunit.client.0.smithi153.stderr: -482> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient: build_initial_monmap 2024-09-19T14:10:27.670 INFO:tasks.workunit.client.0.smithi153.stderr: -481> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 1 build_initial for_mkfs: 0 2024-09-19T14:10:27.670 INFO:tasks.workunit.client.0.smithi153.stderr: -480> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient: monmap: 2024-09-19T14:10:27.670 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:10:27.671 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:10:27.671 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:10:27.671 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:10:27.671 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:10:27.671 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.671 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:10:27.671 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:10:27.671 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:10:27.671 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.671 INFO:tasks.workunit.client.0.smithi153.stderr: -479> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding auth protocol: cephx 2024-09-19T14:10:27.671 INFO:tasks.workunit.client.0.smithi153.stderr: -478> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding auth protocol: cephx 2024-09-19T14:10:27.671 INFO:tasks.workunit.client.0.smithi153.stderr: -477> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding auth protocol: cephx 2024-09-19T14:10:27.671 INFO:tasks.workunit.client.0.smithi153.stderr: -476> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding con mode: secure 2024-09-19T14:10:27.671 INFO:tasks.workunit.client.0.smithi153.stderr: -475> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding con mode: crc 2024-09-19T14:10:27.672 INFO:tasks.workunit.client.0.smithi153.stderr: -474> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding con mode: secure 2024-09-19T14:10:27.672 INFO:tasks.workunit.client.0.smithi153.stderr: -473> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding con mode: crc 2024-09-19T14:10:27.672 INFO:tasks.workunit.client.0.smithi153.stderr: -472> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding con mode: secure 2024-09-19T14:10:27.672 INFO:tasks.workunit.client.0.smithi153.stderr: -471> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding con mode: crc 2024-09-19T14:10:27.672 INFO:tasks.workunit.client.0.smithi153.stderr: -470> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding con mode: crc 2024-09-19T14:10:27.672 INFO:tasks.workunit.client.0.smithi153.stderr: -469> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding con mode: secure 2024-09-19T14:10:27.672 INFO:tasks.workunit.client.0.smithi153.stderr: -468> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding con mode: crc 2024-09-19T14:10:27.672 INFO:tasks.workunit.client.0.smithi153.stderr: -467> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding con mode: secure 2024-09-19T14:10:27.672 INFO:tasks.workunit.client.0.smithi153.stderr: -466> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding con mode: crc 2024-09-19T14:10:27.672 INFO:tasks.workunit.client.0.smithi153.stderr: -465> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b9130) adding con mode: secure 2024-09-19T14:10:27.672 INFO:tasks.workunit.client.0.smithi153.stderr: -464> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.672 INFO:tasks.workunit.client.0.smithi153.stderr: -463> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 1 librados: starting msgr at 2024-09-19T14:10:27.672 INFO:tasks.workunit.client.0.smithi153.stderr: -462> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 1 librados: starting objecter 2024-09-19T14:10:27.673 INFO:tasks.workunit.client.0.smithi153.stderr: -461> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command objecter_requests hook 0x5584e571d6d0 2024-09-19T14:10:27.673 INFO:tasks.workunit.client.0.smithi153.stderr: -460> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 1 librados: setting wanted keys 2024-09-19T14:10:27.673 INFO:tasks.workunit.client.0.smithi153.stderr: -459> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 1 librados: calling monclient init 2024-09-19T14:10:27.673 INFO:tasks.workunit.client.0.smithi153.stderr: -458> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient: init 2024-09-19T14:10:27.673 INFO:tasks.workunit.client.0.smithi153.stderr: -457> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding auth protocol: cephx 2024-09-19T14:10:27.673 INFO:tasks.workunit.client.0.smithi153.stderr: -456> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding auth protocol: cephx 2024-09-19T14:10:27.673 INFO:tasks.workunit.client.0.smithi153.stderr: -455> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding auth protocol: cephx 2024-09-19T14:10:27.673 INFO:tasks.workunit.client.0.smithi153.stderr: -454> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding con mode: secure 2024-09-19T14:10:27.673 INFO:tasks.workunit.client.0.smithi153.stderr: -453> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding con mode: crc 2024-09-19T14:10:27.673 INFO:tasks.workunit.client.0.smithi153.stderr: -452> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding con mode: secure 2024-09-19T14:10:27.673 INFO:tasks.workunit.client.0.smithi153.stderr: -451> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding con mode: crc 2024-09-19T14:10:27.673 INFO:tasks.workunit.client.0.smithi153.stderr: -450> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding con mode: secure 2024-09-19T14:10:27.673 INFO:tasks.workunit.client.0.smithi153.stderr: -449> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding con mode: crc 2024-09-19T14:10:27.673 INFO:tasks.workunit.client.0.smithi153.stderr: -448> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding con mode: crc 2024-09-19T14:10:27.673 INFO:tasks.workunit.client.0.smithi153.stderr: -447> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding con mode: secure 2024-09-19T14:10:27.674 INFO:tasks.workunit.client.0.smithi153.stderr: -446> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding con mode: crc 2024-09-19T14:10:27.674 INFO:tasks.workunit.client.0.smithi153.stderr: -445> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding con mode: secure 2024-09-19T14:10:27.674 INFO:tasks.workunit.client.0.smithi153.stderr: -444> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding con mode: crc 2024-09-19T14:10:27.674 INFO:tasks.workunit.client.0.smithi153.stderr: -443> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 AuthRegistry(0x5584e59b3600) adding con mode: secure 2024-09-19T14:10:27.674 INFO:tasks.workunit.client.0.smithi153.stderr: -442> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.674 INFO:tasks.workunit.client.0.smithi153.stderr: -441> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.674 INFO:tasks.workunit.client.0.smithi153.stderr: -440> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command rotate-key hook 0x5584e59b3748 2024-09-19T14:10:27.674 INFO:tasks.workunit.client.0.smithi153.stderr: -439> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient: _reopen_session rank -1 2024-09-19T14:10:27.674 INFO:tasks.workunit.client.0.smithi153.stderr: -438> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T14:10:27.674 INFO:tasks.workunit.client.0.smithi153.stderr: -437> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient(hunting): picked mon.noname-a con 0x5584e59ba3d0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:10:27.674 INFO:tasks.workunit.client.0.smithi153.stderr: -436> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient(hunting): picked mon.noname-b con 0x5584e59dd380 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:10:27.674 INFO:tasks.workunit.client.0.smithi153.stderr: -435> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient(hunting): picked mon.noname-c con 0x7ff77c0023c0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:10:27.674 INFO:tasks.workunit.client.0.smithi153.stderr: -434> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:10:27.674 INFO:tasks.workunit.client.0.smithi153.stderr: -433> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:10:27.675 INFO:tasks.workunit.client.0.smithi153.stderr: -432> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:10:27.675 INFO:tasks.workunit.client.0.smithi153.stderr: -431> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient(hunting): _renew_subs 2024-09-19T14:10:27.675 INFO:tasks.workunit.client.0.smithi153.stderr: -430> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient(hunting): authenticate will time out at 2815.961450s 2024-09-19T14:10:27.675 INFO:tasks.workunit.client.0.smithi153.stderr: -429> 2024-09-19T14:10:27.497+0000 7ff793fce640 10 monclient(hunting): get_auth_request con 0x7ff77c0023c0 auth_method 0 2024-09-19T14:10:27.675 INFO:tasks.workunit.client.0.smithi153.stderr: -428> 2024-09-19T14:10:27.497+0000 7ff793fce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:10:27.675 INFO:tasks.workunit.client.0.smithi153.stderr: -427> 2024-09-19T14:10:27.497+0000 7ff793fce640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:10:27.675 INFO:tasks.workunit.client.0.smithi153.stderr: -426> 2024-09-19T14:10:27.497+0000 7ff793fce640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:10:27.675 INFO:tasks.workunit.client.0.smithi153.stderr: -425> 2024-09-19T14:10:27.497+0000 7ff7937cd640 10 monclient(hunting): get_auth_request con 0x5584e59ba3d0 auth_method 0 2024-09-19T14:10:27.675 INFO:tasks.workunit.client.0.smithi153.stderr: -424> 2024-09-19T14:10:27.497+0000 7ff7937cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:10:27.675 INFO:tasks.workunit.client.0.smithi153.stderr: -423> 2024-09-19T14:10:27.497+0000 7ff7937cd640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:10:27.675 INFO:tasks.workunit.client.0.smithi153.stderr: -422> 2024-09-19T14:10:27.497+0000 7ff7937cd640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:10:27.675 INFO:tasks.workunit.client.0.smithi153.stderr: -421> 2024-09-19T14:10:27.497+0000 7ff793fce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:10:27.675 INFO:tasks.workunit.client.0.smithi153.stderr: -420> 2024-09-19T14:10:27.497+0000 7ff793fce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:10:27.676 INFO:tasks.workunit.client.0.smithi153.stderr: -419> 2024-09-19T14:10:27.497+0000 7ff793fce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:10:27.676 INFO:tasks.workunit.client.0.smithi153.stderr: -418> 2024-09-19T14:10:27.497+0000 7ff7937cd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:10:27.676 INFO:tasks.workunit.client.0.smithi153.stderr: -417> 2024-09-19T14:10:27.497+0000 7ff7937cd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:10:27.676 INFO:tasks.workunit.client.0.smithi153.stderr: -416> 2024-09-19T14:10:27.497+0000 7ff7937cd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:10:27.676 INFO:tasks.workunit.client.0.smithi153.stderr: -415> 2024-09-19T14:10:27.497+0000 7ff793fce640 10 monclient(hunting): handle_auth_done global_id 7199 payload 824 2024-09-19T14:10:27.676 INFO:tasks.workunit.client.0.smithi153.stderr: -414> 2024-09-19T14:10:27.497+0000 7ff793fce640 10 monclient: _finish_hunting 0 2024-09-19T14:10:27.676 INFO:tasks.workunit.client.0.smithi153.stderr: -413> 2024-09-19T14:10:27.497+0000 7ff793fce640 1 monclient: found mon.noname-c 2024-09-19T14:10:27.676 INFO:tasks.workunit.client.0.smithi153.stderr: -412> 2024-09-19T14:10:27.497+0000 7ff793fce640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:10:27.676 INFO:tasks.workunit.client.0.smithi153.stderr: -411> 2024-09-19T14:10:27.497+0000 7ff67fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:10:27.676 INFO:tasks.workunit.client.0.smithi153.stderr: -410> 2024-09-19T14:10:27.497+0000 7ff67fe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:10:27.676 INFO:tasks.workunit.client.0.smithi153.stderr: -409> 2024-09-19T14:10:27.497+0000 7ff67fe07640 10 monclient: dump: 2024-09-19T14:10:27.676 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:10:27.676 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:10:27.676 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.677 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.677 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:10:27.677 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.677 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:10:27.677 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:10:27.677 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:10:27.677 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.677 INFO:tasks.workunit.client.0.smithi153.stderr: -408> 2024-09-19T14:10:27.497+0000 7ff67fe07640 10 monclient: _finish_auth 0 2024-09-19T14:10:27.677 INFO:tasks.workunit.client.0.smithi153.stderr: -407> 2024-09-19T14:10:27.497+0000 7ff67fe07640 10 monclient: _check_auth_tickets 2024-09-19T14:10:27.677 INFO:tasks.workunit.client.0.smithi153.stderr: -406> 2024-09-19T14:10:27.497+0000 7ff67fe07640 10 monclient: handle_config config(0 keys) 2024-09-19T14:10:27.677 INFO:tasks.workunit.client.0.smithi153.stderr: -405> 2024-09-19T14:10:27.497+0000 7ff67fe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:10:27.677 INFO:tasks.workunit.client.0.smithi153.stderr: -404> 2024-09-19T14:10:27.497+0000 7ff67fe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:10:27.677 INFO:tasks.workunit.client.0.smithi153.stderr: -403> 2024-09-19T14:10:27.497+0000 7ff67fe07640 10 monclient: dump: 2024-09-19T14:10:27.677 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:10:27.678 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:10:27.678 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.678 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.678 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:10:27.678 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.678 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:10:27.678 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:10:27.678 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:10:27.678 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.678 INFO:tasks.workunit.client.0.smithi153.stderr: -402> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 5 monclient: authenticate success, global_id 7199 2024-09-19T14:10:27.678 INFO:tasks.workunit.client.0.smithi153.stderr: -401> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient: _renew_subs 2024-09-19T14:10:27.678 INFO:tasks.workunit.client.0.smithi153.stderr: -400> 2024-09-19T14:10:27.497+0000 7ff68160a640 4 set_mon_vals no callback set 2024-09-19T14:10:27.678 INFO:tasks.workunit.client.0.smithi153.stderr: -399> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:10:27.678 INFO:tasks.workunit.client.0.smithi153.stderr: -398> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient: _renew_subs 2024-09-19T14:10:27.679 INFO:tasks.workunit.client.0.smithi153.stderr: -397> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:10:27.679 INFO:tasks.workunit.client.0.smithi153.stderr: -396> 2024-09-19T14:10:27.497+0000 7ff795cc79c0 1 librados: init done 2024-09-19T14:10:27.679 INFO:tasks.workunit.client.0.smithi153.stderr: -395> 2024-09-19T14:10:27.501+0000 7ff67fe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:10:27.679 INFO:tasks.workunit.client.0.smithi153.stderr: -394> 2024-09-19T14:10:27.501+0000 7ff67fe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:10:27.679 INFO:tasks.workunit.client.0.smithi153.stderr: -393> 2024-09-19T14:10:27.501+0000 7ff67fe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:10:27.679 INFO:tasks.workunit.client.0.smithi153.stderr: -392> 2024-09-19T14:10:27.501+0000 7ff7937cd640 10 monclient: get_auth_request con 0x7ff678071be0 auth_method 0 2024-09-19T14:10:27.679 INFO:tasks.workunit.client.0.smithi153.stderr: -391> 2024-09-19T14:10:27.501+0000 7ff792fcc640 10 monclient: get_auth_request con 0x5584e59f35a0 auth_method 0 2024-09-19T14:10:27.679 INFO:tasks.workunit.client.0.smithi153.stderr: -390> 2024-09-19T14:10:27.501+0000 7ff7937cd640 10 monclient: get_auth_request con 0x5584e59fecc0 auth_method 0 2024-09-19T14:10:27.679 INFO:tasks.workunit.client.0.smithi153.stderr: -389> 2024-09-19T14:10:27.505+0000 7ff792fcc640 10 monclient: get_auth_request con 0x5584e5a03d50 auth_method 0 2024-09-19T14:10:27.679 INFO:tasks.workunit.client.0.smithi153.stderr: -388> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient: build_initial_monmap 2024-09-19T14:10:27.679 INFO:tasks.workunit.client.0.smithi153.stderr: -387> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 1 build_initial for_mkfs: 0 2024-09-19T14:10:27.679 INFO:tasks.workunit.client.0.smithi153.stderr: -386> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient: monmap: 2024-09-19T14:10:27.679 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:10:27.679 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:10:27.680 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:10:27.680 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:10:27.680 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:10:27.680 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.680 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:10:27.680 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:10:27.680 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:10:27.680 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.680 INFO:tasks.workunit.client.0.smithi153.stderr: -385> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding auth protocol: cephx 2024-09-19T14:10:27.680 INFO:tasks.workunit.client.0.smithi153.stderr: -384> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding auth protocol: cephx 2024-09-19T14:10:27.680 INFO:tasks.workunit.client.0.smithi153.stderr: -383> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding auth protocol: cephx 2024-09-19T14:10:27.680 INFO:tasks.workunit.client.0.smithi153.stderr: -382> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding con mode: secure 2024-09-19T14:10:27.680 INFO:tasks.workunit.client.0.smithi153.stderr: -381> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding con mode: crc 2024-09-19T14:10:27.680 INFO:tasks.workunit.client.0.smithi153.stderr: -380> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding con mode: secure 2024-09-19T14:10:27.681 INFO:tasks.workunit.client.0.smithi153.stderr: -379> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding con mode: crc 2024-09-19T14:10:27.681 INFO:tasks.workunit.client.0.smithi153.stderr: -378> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding con mode: secure 2024-09-19T14:10:27.681 INFO:tasks.workunit.client.0.smithi153.stderr: -377> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding con mode: crc 2024-09-19T14:10:27.681 INFO:tasks.workunit.client.0.smithi153.stderr: -376> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding con mode: crc 2024-09-19T14:10:27.681 INFO:tasks.workunit.client.0.smithi153.stderr: -375> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding con mode: secure 2024-09-19T14:10:27.681 INFO:tasks.workunit.client.0.smithi153.stderr: -374> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding con mode: crc 2024-09-19T14:10:27.681 INFO:tasks.workunit.client.0.smithi153.stderr: -373> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding con mode: secure 2024-09-19T14:10:27.681 INFO:tasks.workunit.client.0.smithi153.stderr: -372> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding con mode: crc 2024-09-19T14:10:27.681 INFO:tasks.workunit.client.0.smithi153.stderr: -371> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a07c10) adding con mode: secure 2024-09-19T14:10:27.681 INFO:tasks.workunit.client.0.smithi153.stderr: -370> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.681 INFO:tasks.workunit.client.0.smithi153.stderr: -369> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command objecter_requests cmddesc objecter_requests hook 0x5584e5a0b640 EEXIST 2024-09-19T14:10:27.681 INFO:tasks.workunit.client.0.smithi153.stderr: -368> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient: init 2024-09-19T14:10:27.681 INFO:tasks.workunit.client.0.smithi153.stderr: -367> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding auth protocol: cephx 2024-09-19T14:10:27.681 INFO:tasks.workunit.client.0.smithi153.stderr: -366> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding auth protocol: cephx 2024-09-19T14:10:27.682 INFO:tasks.workunit.client.0.smithi153.stderr: -365> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding auth protocol: cephx 2024-09-19T14:10:27.682 INFO:tasks.workunit.client.0.smithi153.stderr: -364> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding con mode: secure 2024-09-19T14:10:27.682 INFO:tasks.workunit.client.0.smithi153.stderr: -363> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding con mode: crc 2024-09-19T14:10:27.682 INFO:tasks.workunit.client.0.smithi153.stderr: -362> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding con mode: secure 2024-09-19T14:10:27.682 INFO:tasks.workunit.client.0.smithi153.stderr: -361> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding con mode: crc 2024-09-19T14:10:27.682 INFO:tasks.workunit.client.0.smithi153.stderr: -360> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding con mode: secure 2024-09-19T14:10:27.682 INFO:tasks.workunit.client.0.smithi153.stderr: -359> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding con mode: crc 2024-09-19T14:10:27.682 INFO:tasks.workunit.client.0.smithi153.stderr: -358> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding con mode: crc 2024-09-19T14:10:27.682 INFO:tasks.workunit.client.0.smithi153.stderr: -357> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding con mode: secure 2024-09-19T14:10:27.682 INFO:tasks.workunit.client.0.smithi153.stderr: -356> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding con mode: crc 2024-09-19T14:10:27.682 INFO:tasks.workunit.client.0.smithi153.stderr: -355> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding con mode: secure 2024-09-19T14:10:27.682 INFO:tasks.workunit.client.0.smithi153.stderr: -354> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding con mode: crc 2024-09-19T14:10:27.682 INFO:tasks.workunit.client.0.smithi153.stderr: -353> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a06c68) adding con mode: secure 2024-09-19T14:10:27.682 INFO:tasks.workunit.client.0.smithi153.stderr: -352> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.683 INFO:tasks.workunit.client.0.smithi153.stderr: -351> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.683 INFO:tasks.workunit.client.0.smithi153.stderr: -350> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command rotate-key cmddesc rotate-key hook 0x5584e5a06db0 EEXIST 2024-09-19T14:10:27.683 INFO:tasks.workunit.client.0.smithi153.stderr: -349> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient: _reopen_session rank -1 2024-09-19T14:10:27.683 INFO:tasks.workunit.client.0.smithi153.stderr: -348> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T14:10:27.683 INFO:tasks.workunit.client.0.smithi153.stderr: -347> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient(hunting): picked mon.noname-b con 0x5584e5a2f7f0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:10:27.683 INFO:tasks.workunit.client.0.smithi153.stderr: -346> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient(hunting): picked mon.noname-c con 0x5584e5a2f120 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:10:27.683 INFO:tasks.workunit.client.0.smithi153.stderr: -345> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient(hunting): picked mon.noname-a con 0x5584e5a2db00 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:10:27.683 INFO:tasks.workunit.client.0.smithi153.stderr: -344> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:10:27.683 INFO:tasks.workunit.client.0.smithi153.stderr: -343> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:10:27.683 INFO:tasks.workunit.client.0.smithi153.stderr: -342> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:10:27.683 INFO:tasks.workunit.client.0.smithi153.stderr: -341> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient(hunting): _renew_subs 2024-09-19T14:10:27.683 INFO:tasks.workunit.client.0.smithi153.stderr: -340> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient(hunting): authenticate will time out at 2815.970981s 2024-09-19T14:10:27.683 INFO:tasks.workunit.client.0.smithi153.stderr: -339> 2024-09-19T14:10:27.505+0000 7ff792fcc640 10 monclient(hunting): get_auth_request con 0x5584e5a2f120 auth_method 0 2024-09-19T14:10:27.683 INFO:tasks.workunit.client.0.smithi153.stderr: -338> 2024-09-19T14:10:27.505+0000 7ff792fcc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:10:27.683 INFO:tasks.workunit.client.0.smithi153.stderr: -337> 2024-09-19T14:10:27.505+0000 7ff792fcc640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:10:27.684 INFO:tasks.workunit.client.0.smithi153.stderr: -336> 2024-09-19T14:10:27.505+0000 7ff792fcc640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:10:27.684 INFO:tasks.workunit.client.0.smithi153.stderr: -335> 2024-09-19T14:10:27.505+0000 7ff793fce640 10 monclient(hunting): get_auth_request con 0x5584e5a2db00 auth_method 0 2024-09-19T14:10:27.684 INFO:tasks.workunit.client.0.smithi153.stderr: -334> 2024-09-19T14:10:27.505+0000 7ff793fce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:10:27.684 INFO:tasks.workunit.client.0.smithi153.stderr: -333> 2024-09-19T14:10:27.505+0000 7ff793fce640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:10:27.684 INFO:tasks.workunit.client.0.smithi153.stderr: -332> 2024-09-19T14:10:27.505+0000 7ff793fce640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:10:27.684 INFO:tasks.workunit.client.0.smithi153.stderr: -331> 2024-09-19T14:10:27.505+0000 7ff792fcc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:10:27.684 INFO:tasks.workunit.client.0.smithi153.stderr: -330> 2024-09-19T14:10:27.505+0000 7ff792fcc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:10:27.684 INFO:tasks.workunit.client.0.smithi153.stderr: -329> 2024-09-19T14:10:27.505+0000 7ff792fcc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:10:27.684 INFO:tasks.workunit.client.0.smithi153.stderr: -328> 2024-09-19T14:10:27.505+0000 7ff793fce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:10:27.684 INFO:tasks.workunit.client.0.smithi153.stderr: -327> 2024-09-19T14:10:27.505+0000 7ff793fce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:10:27.684 INFO:tasks.workunit.client.0.smithi153.stderr: -326> 2024-09-19T14:10:27.505+0000 7ff793fce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:10:27.684 INFO:tasks.workunit.client.0.smithi153.stderr: -325> 2024-09-19T14:10:27.505+0000 7ff7937cd640 10 monclient(hunting): get_auth_request con 0x5584e5a2f7f0 auth_method 0 2024-09-19T14:10:27.684 INFO:tasks.workunit.client.0.smithi153.stderr: -324> 2024-09-19T14:10:27.505+0000 7ff7937cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:10:27.685 INFO:tasks.workunit.client.0.smithi153.stderr: -323> 2024-09-19T14:10:27.505+0000 7ff7937cd640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:10:27.685 INFO:tasks.workunit.client.0.smithi153.stderr: -322> 2024-09-19T14:10:27.505+0000 7ff7937cd640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:10:27.685 INFO:tasks.workunit.client.0.smithi153.stderr: -321> 2024-09-19T14:10:27.505+0000 7ff793fce640 10 monclient(hunting): handle_auth_done global_id 7686 payload 824 2024-09-19T14:10:27.685 INFO:tasks.workunit.client.0.smithi153.stderr: -320> 2024-09-19T14:10:27.505+0000 7ff793fce640 10 monclient: _finish_hunting 0 2024-09-19T14:10:27.685 INFO:tasks.workunit.client.0.smithi153.stderr: -319> 2024-09-19T14:10:27.505+0000 7ff793fce640 1 monclient: found mon.noname-a 2024-09-19T14:10:27.685 INFO:tasks.workunit.client.0.smithi153.stderr: -318> 2024-09-19T14:10:27.505+0000 7ff793fce640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:10:27.685 INFO:tasks.workunit.client.0.smithi153.stderr: -317> 2024-09-19T14:10:27.505+0000 7ff67d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:10:27.685 INFO:tasks.workunit.client.0.smithi153.stderr: -316> 2024-09-19T14:10:27.505+0000 7ff67d602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:10:27.685 INFO:tasks.workunit.client.0.smithi153.stderr: -315> 2024-09-19T14:10:27.505+0000 7ff67d602640 10 monclient: dump: 2024-09-19T14:10:27.685 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:10:27.685 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:10:27.685 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.685 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.686 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:10:27.686 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.686 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:10:27.686 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:10:27.686 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:10:27.686 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.686 INFO:tasks.workunit.client.0.smithi153.stderr: -314> 2024-09-19T14:10:27.505+0000 7ff67d602640 10 monclient: _finish_auth 0 2024-09-19T14:10:27.686 INFO:tasks.workunit.client.0.smithi153.stderr: -313> 2024-09-19T14:10:27.505+0000 7ff67d602640 10 monclient: _check_auth_tickets 2024-09-19T14:10:27.686 INFO:tasks.workunit.client.0.smithi153.stderr: -312> 2024-09-19T14:10:27.505+0000 7ff67d602640 10 monclient: handle_config config(0 keys) 2024-09-19T14:10:27.686 INFO:tasks.workunit.client.0.smithi153.stderr: -311> 2024-09-19T14:10:27.505+0000 7ff67d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:10:27.686 INFO:tasks.workunit.client.0.smithi153.stderr: -310> 2024-09-19T14:10:27.505+0000 7ff67d602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:10:27.686 INFO:tasks.workunit.client.0.smithi153.stderr: -309> 2024-09-19T14:10:27.505+0000 7ff67d602640 10 monclient: dump: 2024-09-19T14:10:27.686 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:10:27.686 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:10:27.686 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.687 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.687 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:10:27.687 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.687 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:10:27.687 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:10:27.687 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:10:27.687 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.687 INFO:tasks.workunit.client.0.smithi153.stderr: -308> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 5 monclient: authenticate success, global_id 7686 2024-09-19T14:10:27.687 INFO:tasks.workunit.client.0.smithi153.stderr: -307> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient: _renew_subs 2024-09-19T14:10:27.687 INFO:tasks.workunit.client.0.smithi153.stderr: -306> 2024-09-19T14:10:27.505+0000 7ff7947cf640 4 set_mon_vals no callback set 2024-09-19T14:10:27.687 INFO:tasks.workunit.client.0.smithi153.stderr: -305> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:10:27.687 INFO:tasks.workunit.client.0.smithi153.stderr: -304> 2024-09-19T14:10:27.505+0000 7ff795cc79c0 10 monclient: _renew_subs 2024-09-19T14:10:27.687 INFO:tasks.workunit.client.0.smithi153.stderr: -303> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:10:27.687 INFO:tasks.workunit.client.0.smithi153.stderr: -302> 2024-09-19T14:10:27.509+0000 7ff67d602640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:10:27.688 INFO:tasks.workunit.client.0.smithi153.stderr: -301> 2024-09-19T14:10:27.509+0000 7ff67d602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:10:27.688 INFO:tasks.workunit.client.0.smithi153.stderr: -300> 2024-09-19T14:10:27.509+0000 7ff67d602640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:10:27.688 INFO:tasks.workunit.client.0.smithi153.stderr: -299> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient: get_monmap_and_config 2024-09-19T14:10:27.688 INFO:tasks.workunit.client.0.smithi153.stderr: -298> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient: build_initial_monmap 2024-09-19T14:10:27.688 INFO:tasks.workunit.client.0.smithi153.stderr: -297> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 1 build_initial for_mkfs: 0 2024-09-19T14:10:27.688 INFO:tasks.workunit.client.0.smithi153.stderr: -296> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient: monmap: 2024-09-19T14:10:27.688 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:10:27.688 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:10:27.688 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:10:27.688 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:10:27.688 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:10:27.688 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.688 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:10:27.688 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:10:27.689 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:10:27.689 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.689 INFO:tasks.workunit.client.0.smithi153.stderr: -295> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding auth protocol: cephx 2024-09-19T14:10:27.689 INFO:tasks.workunit.client.0.smithi153.stderr: -294> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding auth protocol: cephx 2024-09-19T14:10:27.689 INFO:tasks.workunit.client.0.smithi153.stderr: -293> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding auth protocol: cephx 2024-09-19T14:10:27.689 INFO:tasks.workunit.client.0.smithi153.stderr: -292> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding con mode: secure 2024-09-19T14:10:27.689 INFO:tasks.workunit.client.0.smithi153.stderr: -291> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding con mode: crc 2024-09-19T14:10:27.689 INFO:tasks.workunit.client.0.smithi153.stderr: -290> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding con mode: secure 2024-09-19T14:10:27.689 INFO:tasks.workunit.client.0.smithi153.stderr: -289> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding con mode: crc 2024-09-19T14:10:27.689 INFO:tasks.workunit.client.0.smithi153.stderr: -288> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding con mode: secure 2024-09-19T14:10:27.689 INFO:tasks.workunit.client.0.smithi153.stderr: -287> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding con mode: crc 2024-09-19T14:10:27.689 INFO:tasks.workunit.client.0.smithi153.stderr: -286> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding con mode: crc 2024-09-19T14:10:27.689 INFO:tasks.workunit.client.0.smithi153.stderr: -285> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding con mode: secure 2024-09-19T14:10:27.689 INFO:tasks.workunit.client.0.smithi153.stderr: -284> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding con mode: crc 2024-09-19T14:10:27.690 INFO:tasks.workunit.client.0.smithi153.stderr: -283> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding con mode: secure 2024-09-19T14:10:27.690 INFO:tasks.workunit.client.0.smithi153.stderr: -282> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding con mode: crc 2024-09-19T14:10:27.690 INFO:tasks.workunit.client.0.smithi153.stderr: -281> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a4f140) adding con mode: secure 2024-09-19T14:10:27.690 INFO:tasks.workunit.client.0.smithi153.stderr: -280> 2024-09-19T14:10:27.509+0000 7ff7937cd640 10 monclient: get_auth_request con 0x7ff66c071b20 auth_method 0 2024-09-19T14:10:27.690 INFO:tasks.workunit.client.0.smithi153.stderr: -279> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.690 INFO:tasks.workunit.client.0.smithi153.stderr: -278> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient: init 2024-09-19T14:10:27.690 INFO:tasks.workunit.client.0.smithi153.stderr: -277> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding auth protocol: cephx 2024-09-19T14:10:27.690 INFO:tasks.workunit.client.0.smithi153.stderr: -276> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding auth protocol: cephx 2024-09-19T14:10:27.690 INFO:tasks.workunit.client.0.smithi153.stderr: -275> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding auth protocol: cephx 2024-09-19T14:10:27.690 INFO:tasks.workunit.client.0.smithi153.stderr: -274> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding con mode: secure 2024-09-19T14:10:27.690 INFO:tasks.workunit.client.0.smithi153.stderr: -273> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding con mode: crc 2024-09-19T14:10:27.690 INFO:tasks.workunit.client.0.smithi153.stderr: -272> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding con mode: secure 2024-09-19T14:10:27.690 INFO:tasks.workunit.client.0.smithi153.stderr: -271> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding con mode: crc 2024-09-19T14:10:27.690 INFO:tasks.workunit.client.0.smithi153.stderr: -270> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding con mode: secure 2024-09-19T14:10:27.691 INFO:tasks.workunit.client.0.smithi153.stderr: -269> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding con mode: crc 2024-09-19T14:10:27.691 INFO:tasks.workunit.client.0.smithi153.stderr: -268> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding con mode: crc 2024-09-19T14:10:27.691 INFO:tasks.workunit.client.0.smithi153.stderr: -267> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding con mode: secure 2024-09-19T14:10:27.691 INFO:tasks.workunit.client.0.smithi153.stderr: -266> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding con mode: crc 2024-09-19T14:10:27.691 INFO:tasks.workunit.client.0.smithi153.stderr: -265> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding con mode: secure 2024-09-19T14:10:27.691 INFO:tasks.workunit.client.0.smithi153.stderr: -264> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding con mode: crc 2024-09-19T14:10:27.691 INFO:tasks.workunit.client.0.smithi153.stderr: -263> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8bde30) adding con mode: secure 2024-09-19T14:10:27.691 INFO:tasks.workunit.client.0.smithi153.stderr: -262> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.691 INFO:tasks.workunit.client.0.smithi153.stderr: -261> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.691 INFO:tasks.workunit.client.0.smithi153.stderr: -260> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command rotate-key cmddesc rotate-key hook 0x7ffe3c8bdf78 EEXIST 2024-09-19T14:10:27.691 INFO:tasks.workunit.client.0.smithi153.stderr: -259> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient: _reopen_session rank -1 2024-09-19T14:10:27.691 INFO:tasks.workunit.client.0.smithi153.stderr: -258> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:10:27.691 INFO:tasks.workunit.client.0.smithi153.stderr: -257> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient(hunting): picked mon.noname-b con 0x5584e5a53200 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:10:27.691 INFO:tasks.workunit.client.0.smithi153.stderr: -256> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient(hunting): picked mon.noname-a con 0x5584e5a7d7f0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:10:27.692 INFO:tasks.workunit.client.0.smithi153.stderr: -255> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient(hunting): picked mon.noname-c con 0x5584e5a7ea30 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:10:27.692 INFO:tasks.workunit.client.0.smithi153.stderr: -254> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:10:27.692 INFO:tasks.workunit.client.0.smithi153.stderr: -253> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:10:27.692 INFO:tasks.workunit.client.0.smithi153.stderr: -252> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:10:27.692 INFO:tasks.workunit.client.0.smithi153.stderr: -251> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient(hunting): _renew_subs 2024-09-19T14:10:27.692 INFO:tasks.workunit.client.0.smithi153.stderr: -250> 2024-09-19T14:10:27.509+0000 7ff795cc79c0 10 monclient(hunting): authenticate will time out at 2815.975211s 2024-09-19T14:10:27.692 INFO:tasks.workunit.client.0.smithi153.stderr: -249> 2024-09-19T14:10:27.509+0000 7ff792fcc640 10 monclient(hunting): get_auth_request con 0x5584e5a7d7f0 auth_method 0 2024-09-19T14:10:27.692 INFO:tasks.workunit.client.0.smithi153.stderr: -248> 2024-09-19T14:10:27.509+0000 7ff792fcc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:10:27.692 INFO:tasks.workunit.client.0.smithi153.stderr: -247> 2024-09-19T14:10:27.509+0000 7ff792fcc640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:10:27.692 INFO:tasks.workunit.client.0.smithi153.stderr: -246> 2024-09-19T14:10:27.509+0000 7ff792fcc640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:10:27.692 INFO:tasks.workunit.client.0.smithi153.stderr: -245> 2024-09-19T14:10:27.509+0000 7ff793fce640 10 monclient(hunting): get_auth_request con 0x5584e5a7ea30 auth_method 0 2024-09-19T14:10:27.692 INFO:tasks.workunit.client.0.smithi153.stderr: -244> 2024-09-19T14:10:27.509+0000 7ff793fce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:10:27.692 INFO:tasks.workunit.client.0.smithi153.stderr: -243> 2024-09-19T14:10:27.509+0000 7ff793fce640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:10:27.692 INFO:tasks.workunit.client.0.smithi153.stderr: -242> 2024-09-19T14:10:27.509+0000 7ff793fce640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:10:27.693 INFO:tasks.workunit.client.0.smithi153.stderr: -241> 2024-09-19T14:10:27.509+0000 7ff792fcc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:10:27.693 INFO:tasks.workunit.client.0.smithi153.stderr: -240> 2024-09-19T14:10:27.509+0000 7ff792fcc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:10:27.693 INFO:tasks.workunit.client.0.smithi153.stderr: -239> 2024-09-19T14:10:27.509+0000 7ff792fcc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:10:27.693 INFO:tasks.workunit.client.0.smithi153.stderr: -238> 2024-09-19T14:10:27.509+0000 7ff793fce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:10:27.693 INFO:tasks.workunit.client.0.smithi153.stderr: -237> 2024-09-19T14:10:27.509+0000 7ff793fce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:10:27.693 INFO:tasks.workunit.client.0.smithi153.stderr: -236> 2024-09-19T14:10:27.509+0000 7ff793fce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:10:27.693 INFO:tasks.workunit.client.0.smithi153.stderr: -235> 2024-09-19T14:10:27.509+0000 7ff7937cd640 10 monclient(hunting): get_auth_request con 0x5584e5a53200 auth_method 0 2024-09-19T14:10:27.693 INFO:tasks.workunit.client.0.smithi153.stderr: -234> 2024-09-19T14:10:27.509+0000 7ff7937cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:10:27.693 INFO:tasks.workunit.client.0.smithi153.stderr: -233> 2024-09-19T14:10:27.509+0000 7ff7937cd640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:10:27.693 INFO:tasks.workunit.client.0.smithi153.stderr: -232> 2024-09-19T14:10:27.509+0000 7ff7937cd640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:10:27.693 INFO:tasks.workunit.client.0.smithi153.stderr: -231> 2024-09-19T14:10:27.509+0000 7ff792fcc640 10 monclient(hunting): handle_auth_done global_id 7689 payload 274 2024-09-19T14:10:27.693 INFO:tasks.workunit.client.0.smithi153.stderr: -230> 2024-09-19T14:10:27.509+0000 7ff792fcc640 10 monclient: _finish_hunting 0 2024-09-19T14:10:27.693 INFO:tasks.workunit.client.0.smithi153.stderr: -229> 2024-09-19T14:10:27.509+0000 7ff792fcc640 1 monclient: found mon.noname-a 2024-09-19T14:10:27.693 INFO:tasks.workunit.client.0.smithi153.stderr: -228> 2024-09-19T14:10:27.509+0000 7ff792fcc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:10:27.694 INFO:tasks.workunit.client.0.smithi153.stderr: -227> 2024-09-19T14:10:27.509+0000 7ff676ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:10:27.694 INFO:tasks.workunit.client.0.smithi153.stderr: -226> 2024-09-19T14:10:27.509+0000 7ff676ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:10:27.694 INFO:tasks.workunit.client.0.smithi153.stderr: -225> 2024-09-19T14:10:27.509+0000 7ff676ffd640 10 monclient: dump: 2024-09-19T14:10:27.694 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:10:27.694 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:10:27.694 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.694 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.694 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:10:27.694 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.694 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:10:27.694 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:10:27.694 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:10:27.694 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.694 INFO:tasks.workunit.client.0.smithi153.stderr: -224> 2024-09-19T14:10:27.513+0000 7ff676ffd640 10 monclient: _finish_auth 0 2024-09-19T14:10:27.695 INFO:tasks.workunit.client.0.smithi153.stderr: -223> 2024-09-19T14:10:27.513+0000 7ff676ffd640 10 monclient: _check_auth_tickets 2024-09-19T14:10:27.695 INFO:tasks.workunit.client.0.smithi153.stderr: -222> 2024-09-19T14:10:27.513+0000 7ff676ffd640 10 monclient: handle_config config(0 keys) 2024-09-19T14:10:27.695 INFO:tasks.workunit.client.0.smithi153.stderr: -221> 2024-09-19T14:10:27.513+0000 7ff676ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:10:27.695 INFO:tasks.workunit.client.0.smithi153.stderr: -220> 2024-09-19T14:10:27.513+0000 7ff676ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:10:27.695 INFO:tasks.workunit.client.0.smithi153.stderr: -219> 2024-09-19T14:10:27.513+0000 7ff676ffd640 10 monclient: dump: 2024-09-19T14:10:27.695 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:10:27.695 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:10:27.695 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.695 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.695 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:10:27.695 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.695 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:10:27.695 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:10:27.696 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:10:27.696 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.696 INFO:tasks.workunit.client.0.smithi153.stderr: -218> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 monclient: authenticate success, global_id 7689 2024-09-19T14:10:27.696 INFO:tasks.workunit.client.0.smithi153.stderr: -217> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient: get_monmap_and_config success 2024-09-19T14:10:27.696 INFO:tasks.workunit.client.0.smithi153.stderr: -216> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 4 set_mon_vals no callback set 2024-09-19T14:10:27.696 INFO:tasks.workunit.client.0.smithi153.stderr: -215> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient: shutdown 2024-09-19T14:10:27.696 INFO:tasks.workunit.client.0.smithi153.stderr: -214> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient: build_initial_monmap 2024-09-19T14:10:27.696 INFO:tasks.workunit.client.0.smithi153.stderr: -213> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 1 build_initial for_mkfs: 0 2024-09-19T14:10:27.696 INFO:tasks.workunit.client.0.smithi153.stderr: -212> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient: monmap: 2024-09-19T14:10:27.696 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:10:27.696 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:10:27.696 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:10:27.696 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:10:27.696 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:10:27.697 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.697 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:10:27.697 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:10:27.697 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:10:27.697 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.697 INFO:tasks.workunit.client.0.smithi153.stderr: -211> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding auth protocol: cephx 2024-09-19T14:10:27.697 INFO:tasks.workunit.client.0.smithi153.stderr: -210> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding auth protocol: cephx 2024-09-19T14:10:27.697 INFO:tasks.workunit.client.0.smithi153.stderr: -209> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding auth protocol: cephx 2024-09-19T14:10:27.697 INFO:tasks.workunit.client.0.smithi153.stderr: -208> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding con mode: secure 2024-09-19T14:10:27.697 INFO:tasks.workunit.client.0.smithi153.stderr: -207> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding con mode: crc 2024-09-19T14:10:27.697 INFO:tasks.workunit.client.0.smithi153.stderr: -206> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding con mode: secure 2024-09-19T14:10:27.697 INFO:tasks.workunit.client.0.smithi153.stderr: -205> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding con mode: crc 2024-09-19T14:10:27.697 INFO:tasks.workunit.client.0.smithi153.stderr: -204> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding con mode: secure 2024-09-19T14:10:27.698 INFO:tasks.workunit.client.0.smithi153.stderr: -203> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding con mode: crc 2024-09-19T14:10:27.698 INFO:tasks.workunit.client.0.smithi153.stderr: -202> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding con mode: crc 2024-09-19T14:10:27.698 INFO:tasks.workunit.client.0.smithi153.stderr: -201> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding con mode: secure 2024-09-19T14:10:27.698 INFO:tasks.workunit.client.0.smithi153.stderr: -200> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding con mode: crc 2024-09-19T14:10:27.698 INFO:tasks.workunit.client.0.smithi153.stderr: -199> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding con mode: secure 2024-09-19T14:10:27.698 INFO:tasks.workunit.client.0.smithi153.stderr: -198> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding con mode: crc 2024-09-19T14:10:27.698 INFO:tasks.workunit.client.0.smithi153.stderr: -197> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a7ef80) adding con mode: secure 2024-09-19T14:10:27.698 INFO:tasks.workunit.client.0.smithi153.stderr: -196> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.698 INFO:tasks.workunit.client.0.smithi153.stderr: -195> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 1 librados: starting msgr at 2024-09-19T14:10:27.698 INFO:tasks.workunit.client.0.smithi153.stderr: -194> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 1 librados: starting objecter 2024-09-19T14:10:27.698 INFO:tasks.workunit.client.0.smithi153.stderr: -193> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command objecter_requests cmddesc objecter_requests hook 0x5584e5a2d770 EEXIST 2024-09-19T14:10:27.698 INFO:tasks.workunit.client.0.smithi153.stderr: -192> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 1 librados: setting wanted keys 2024-09-19T14:10:27.698 INFO:tasks.workunit.client.0.smithi153.stderr: -191> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 1 librados: calling monclient init 2024-09-19T14:10:27.698 INFO:tasks.workunit.client.0.smithi153.stderr: -190> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient: init 2024-09-19T14:10:27.699 INFO:tasks.workunit.client.0.smithi153.stderr: -189> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding auth protocol: cephx 2024-09-19T14:10:27.699 INFO:tasks.workunit.client.0.smithi153.stderr: -188> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding auth protocol: cephx 2024-09-19T14:10:27.699 INFO:tasks.workunit.client.0.smithi153.stderr: -187> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding auth protocol: cephx 2024-09-19T14:10:27.699 INFO:tasks.workunit.client.0.smithi153.stderr: -186> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding con mode: secure 2024-09-19T14:10:27.699 INFO:tasks.workunit.client.0.smithi153.stderr: -185> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding con mode: crc 2024-09-19T14:10:27.699 INFO:tasks.workunit.client.0.smithi153.stderr: -184> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding con mode: secure 2024-09-19T14:10:27.699 INFO:tasks.workunit.client.0.smithi153.stderr: -183> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding con mode: crc 2024-09-19T14:10:27.699 INFO:tasks.workunit.client.0.smithi153.stderr: -182> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding con mode: secure 2024-09-19T14:10:27.699 INFO:tasks.workunit.client.0.smithi153.stderr: -181> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding con mode: crc 2024-09-19T14:10:27.699 INFO:tasks.workunit.client.0.smithi153.stderr: -180> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding con mode: crc 2024-09-19T14:10:27.699 INFO:tasks.workunit.client.0.smithi153.stderr: -179> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding con mode: secure 2024-09-19T14:10:27.699 INFO:tasks.workunit.client.0.smithi153.stderr: -178> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding con mode: crc 2024-09-19T14:10:27.699 INFO:tasks.workunit.client.0.smithi153.stderr: -177> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding con mode: secure 2024-09-19T14:10:27.700 INFO:tasks.workunit.client.0.smithi153.stderr: -176> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding con mode: crc 2024-09-19T14:10:27.700 INFO:tasks.workunit.client.0.smithi153.stderr: -175> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 AuthRegistry(0x5584e5a31610) adding con mode: secure 2024-09-19T14:10:27.700 INFO:tasks.workunit.client.0.smithi153.stderr: -174> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.700 INFO:tasks.workunit.client.0.smithi153.stderr: -173> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.700 INFO:tasks.workunit.client.0.smithi153.stderr: -172> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command rotate-key cmddesc rotate-key hook 0x5584e5a31758 EEXIST 2024-09-19T14:10:27.700 INFO:tasks.workunit.client.0.smithi153.stderr: -171> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient: _reopen_session rank -1 2024-09-19T14:10:27.700 INFO:tasks.workunit.client.0.smithi153.stderr: -170> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T14:10:27.700 INFO:tasks.workunit.client.0.smithi153.stderr: -169> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient(hunting): picked mon.noname-c con 0x5584e5a53200 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:10:27.700 INFO:tasks.workunit.client.0.smithi153.stderr: -168> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient(hunting): picked mon.noname-b con 0x5584e5a7d7f0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:10:27.700 INFO:tasks.workunit.client.0.smithi153.stderr: -167> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient(hunting): picked mon.noname-a con 0x5584e5a7ea30 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:10:27.700 INFO:tasks.workunit.client.0.smithi153.stderr: -166> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:10:27.700 INFO:tasks.workunit.client.0.smithi153.stderr: -165> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:10:27.700 INFO:tasks.workunit.client.0.smithi153.stderr: -164> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:10:27.700 INFO:tasks.workunit.client.0.smithi153.stderr: -163> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient(hunting): _renew_subs 2024-09-19T14:10:27.701 INFO:tasks.workunit.client.0.smithi153.stderr: -162> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient(hunting): authenticate will time out at 2815.977929s 2024-09-19T14:10:27.701 INFO:tasks.workunit.client.0.smithi153.stderr: -161> 2024-09-19T14:10:27.513+0000 7ff7937cd640 10 monclient(hunting): get_auth_request con 0x5584e5a53200 auth_method 0 2024-09-19T14:10:27.701 INFO:tasks.workunit.client.0.smithi153.stderr: -160> 2024-09-19T14:10:27.513+0000 7ff7937cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:10:27.701 INFO:tasks.workunit.client.0.smithi153.stderr: -159> 2024-09-19T14:10:27.513+0000 7ff7937cd640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:10:27.701 INFO:tasks.workunit.client.0.smithi153.stderr: -158> 2024-09-19T14:10:27.513+0000 7ff7937cd640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:10:27.701 INFO:tasks.workunit.client.0.smithi153.stderr: -157> 2024-09-19T14:10:27.513+0000 7ff793fce640 10 monclient(hunting): get_auth_request con 0x5584e5a7ea30 auth_method 0 2024-09-19T14:10:27.701 INFO:tasks.workunit.client.0.smithi153.stderr: -156> 2024-09-19T14:10:27.513+0000 7ff793fce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:10:27.701 INFO:tasks.workunit.client.0.smithi153.stderr: -155> 2024-09-19T14:10:27.513+0000 7ff793fce640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:10:27.701 INFO:tasks.workunit.client.0.smithi153.stderr: -154> 2024-09-19T14:10:27.513+0000 7ff793fce640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:10:27.701 INFO:tasks.workunit.client.0.smithi153.stderr: -153> 2024-09-19T14:10:27.513+0000 7ff7937cd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:10:27.701 INFO:tasks.workunit.client.0.smithi153.stderr: -152> 2024-09-19T14:10:27.513+0000 7ff7937cd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:10:27.701 INFO:tasks.workunit.client.0.smithi153.stderr: -151> 2024-09-19T14:10:27.513+0000 7ff7937cd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:10:27.701 INFO:tasks.workunit.client.0.smithi153.stderr: -150> 2024-09-19T14:10:27.513+0000 7ff793fce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:10:27.702 INFO:tasks.workunit.client.0.smithi153.stderr: -149> 2024-09-19T14:10:27.513+0000 7ff793fce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:10:27.702 INFO:tasks.workunit.client.0.smithi153.stderr: -148> 2024-09-19T14:10:27.513+0000 7ff793fce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:10:27.702 INFO:tasks.workunit.client.0.smithi153.stderr: -147> 2024-09-19T14:10:27.513+0000 7ff7937cd640 10 monclient(hunting): handle_auth_done global_id 7208 payload 824 2024-09-19T14:10:27.702 INFO:tasks.workunit.client.0.smithi153.stderr: -146> 2024-09-19T14:10:27.513+0000 7ff7937cd640 10 monclient: _finish_hunting 0 2024-09-19T14:10:27.702 INFO:tasks.workunit.client.0.smithi153.stderr: -145> 2024-09-19T14:10:27.513+0000 7ff7937cd640 1 monclient: found mon.noname-c 2024-09-19T14:10:27.702 INFO:tasks.workunit.client.0.smithi153.stderr: -144> 2024-09-19T14:10:27.513+0000 7ff7937cd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:10:27.702 INFO:tasks.workunit.client.0.smithi153.stderr: -143> 2024-09-19T14:10:27.513+0000 7ff6757fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:10:27.702 INFO:tasks.workunit.client.0.smithi153.stderr: -142> 2024-09-19T14:10:27.513+0000 7ff6757fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:10:27.702 INFO:tasks.workunit.client.0.smithi153.stderr: -141> 2024-09-19T14:10:27.513+0000 7ff6757fa640 10 monclient: dump: 2024-09-19T14:10:27.702 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:10:27.702 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:10:27.702 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.702 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.702 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:10:27.702 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.703 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:10:27.703 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:10:27.703 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:10:27.703 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.703 INFO:tasks.workunit.client.0.smithi153.stderr: -140> 2024-09-19T14:10:27.513+0000 7ff6757fa640 10 monclient: _finish_auth 0 2024-09-19T14:10:27.703 INFO:tasks.workunit.client.0.smithi153.stderr: -139> 2024-09-19T14:10:27.513+0000 7ff6757fa640 10 monclient: _check_auth_tickets 2024-09-19T14:10:27.703 INFO:tasks.workunit.client.0.smithi153.stderr: -138> 2024-09-19T14:10:27.513+0000 7ff6757fa640 10 monclient: handle_config config(0 keys) 2024-09-19T14:10:27.703 INFO:tasks.workunit.client.0.smithi153.stderr: -137> 2024-09-19T14:10:27.513+0000 7ff6757fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:10:27.703 INFO:tasks.workunit.client.0.smithi153.stderr: -136> 2024-09-19T14:10:27.513+0000 7ff6757fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:10:27.703 INFO:tasks.workunit.client.0.smithi153.stderr: -135> 2024-09-19T14:10:27.513+0000 7ff6757fa640 10 monclient: dump: 2024-09-19T14:10:27.703 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:10:27.703 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:10:27.703 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.703 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:10:27.703 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:10:27.704 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:10:27.704 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:10:27.704 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:10:27.704 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:10:27.704 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.704 INFO:tasks.workunit.client.0.smithi153.stderr: -134> 2024-09-19T14:10:27.513+0000 7ff676ffd640 4 set_mon_vals no callback set 2024-09-19T14:10:27.704 INFO:tasks.workunit.client.0.smithi153.stderr: -133> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 monclient: authenticate success, global_id 7208 2024-09-19T14:10:27.704 INFO:tasks.workunit.client.0.smithi153.stderr: -132> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient: _renew_subs 2024-09-19T14:10:27.704 INFO:tasks.workunit.client.0.smithi153.stderr: -131> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:10:27.704 INFO:tasks.workunit.client.0.smithi153.stderr: -130> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient: _renew_subs 2024-09-19T14:10:27.704 INFO:tasks.workunit.client.0.smithi153.stderr: -129> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:10:27.704 INFO:tasks.workunit.client.0.smithi153.stderr: -128> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 1 librados: init done 2024-09-19T14:10:27.704 INFO:tasks.workunit.client.0.smithi153.stderr: -127> 2024-09-19T14:10:27.513+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command cr dump hook 0x7ff788004588 2024-09-19T14:10:27.704 INFO:tasks.workunit.client.0.smithi153.stderr: -126> 2024-09-19T14:10:27.517+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.705 INFO:tasks.workunit.client.0.smithi153.stderr: -125> 2024-09-19T14:10:27.517+0000 7ff6757fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:10:27.705 INFO:tasks.workunit.client.0.smithi153.stderr: -124> 2024-09-19T14:10:27.517+0000 7ff6757fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:10:27.705 INFO:tasks.workunit.client.0.smithi153.stderr: -123> 2024-09-19T14:10:27.517+0000 7ff6757fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:10:27.705 INFO:tasks.workunit.client.0.smithi153.stderr: -122> 2024-09-19T14:10:27.517+0000 7ff792fcc640 10 monclient: get_auth_request con 0x7ff65c071be0 auth_method 0 2024-09-19T14:10:27.705 INFO:tasks.workunit.client.0.smithi153.stderr: -121> 2024-09-19T14:10:27.517+0000 7ff793fce640 10 monclient: get_auth_request con 0x5584e5a9cbb0 auth_method 0 2024-09-19T14:10:27.705 INFO:tasks.workunit.client.0.smithi153.stderr: -120> 2024-09-19T14:10:27.517+0000 7ff795cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.705 INFO:tasks.workunit.client.0.smithi153.stderr: -119> 2024-09-19T14:10:27.517+0000 7ff795cc79c0 20 realm 2024-09-19T14:10:27.705 INFO:tasks.workunit.client.0.smithi153.stderr: -118> 2024-09-19T14:10:27.517+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.705 INFO:tasks.workunit.client.0.smithi153.stderr: -117> 2024-09-19T14:10:27.517+0000 7ff795cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.705 INFO:tasks.workunit.client.0.smithi153.stderr: -116> 2024-09-19T14:10:27.517+0000 7ff795cc79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:10:27.705 INFO:tasks.workunit.client.0.smithi153.stderr: -115> 2024-09-19T14:10:27.517+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.705 INFO:tasks.workunit.client.0.smithi153.stderr: -114> 2024-09-19T14:10:27.517+0000 7ff795cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.705 INFO:tasks.workunit.client.0.smithi153.stderr: -113> 2024-09-19T14:10:27.517+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.705 INFO:tasks.workunit.client.0.smithi153.stderr: -112> 2024-09-19T14:10:27.517+0000 7ff7937cd640 10 monclient: get_auth_request con 0x5584e5aa0e50 auth_method 0 2024-09-19T14:10:27.706 INFO:tasks.workunit.client.0.smithi153.stderr: -111> 2024-09-19T14:10:27.521+0000 7ff795cc79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:27.706 INFO:tasks.workunit.client.0.smithi153.stderr: -110> 2024-09-19T14:10:27.521+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.706 INFO:tasks.workunit.client.0.smithi153.stderr: -109> 2024-09-19T14:10:27.521+0000 7ff795cc79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:10:27.706 INFO:tasks.workunit.client.0.smithi153.stderr: -108> 2024-09-19T14:10:27.521+0000 7ff795cc79c0 20 searching for the correct realm 2024-09-19T14:10:27.706 INFO:tasks.workunit.client.0.smithi153.stderr: -107> 2024-09-19T14:10:27.521+0000 7ff792fcc640 10 monclient: get_auth_request con 0x5584e5aa6060 auth_method 0 2024-09-19T14:10:27.706 INFO:tasks.workunit.client.0.smithi153.stderr: -106> 2024-09-19T14:10:27.521+0000 7ff793fce640 10 monclient: get_auth_request con 0x7ff788008040 auth_method 0 2024-09-19T14:10:27.706 INFO:tasks.workunit.client.0.smithi153.stderr: -105> 2024-09-19T14:10:27.521+0000 7ff7937cd640 10 monclient: get_auth_request con 0x7ff78c049060 auth_method 0 2024-09-19T14:10:27.706 INFO:tasks.workunit.client.0.smithi153.stderr: -104> 2024-09-19T14:10:27.521+0000 7ff7937cd640 0 -- 172.21.15.153:0/1648261788 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x7ff78c049060 msgr2=0x7ff78c06b870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:10:27.706 INFO:tasks.workunit.client.0.smithi153.stderr: -103> 2024-09-19T14:10:27.521+0000 7ff6757fa640 1 client.7208.objecter ms_handle_reset 0x7ff78c049060 session 0x7ff78c00f040 osd.2 2024-09-19T14:10:27.706 INFO:tasks.workunit.client.0.smithi153.stderr: -102> 2024-09-19T14:10:27.521+0000 7ff6757fa640 10 monclient: _renew_subs 2024-09-19T14:10:27.706 INFO:tasks.workunit.client.0.smithi153.stderr: -101> 2024-09-19T14:10:27.521+0000 7ff6757fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:10:27.706 INFO:tasks.workunit.client.0.smithi153.stderr: -100> 2024-09-19T14:10:27.521+0000 7ff7937cd640 10 monclient: get_auth_request con 0x7ff65c082310 auth_method 0 2024-09-19T14:10:27.706 INFO:tasks.workunit.client.0.smithi153.stderr: -99> 2024-09-19T14:10:27.521+0000 7ff792fcc640 10 monclient: get_auth_request con 0x7ff78413b040 auth_method 0 2024-09-19T14:10:27.706 INFO:tasks.workunit.client.0.smithi153.stderr: -98> 2024-09-19T14:10:27.525+0000 7ff793fce640 10 monclient: get_auth_request con 0x7ff788034950 auth_method 0 2024-09-19T14:10:27.707 INFO:tasks.workunit.client.0.smithi153.stderr: -97> 2024-09-19T14:10:27.529+0000 7ff7937cd640 0 -- 172.21.15.153:0/1648261788 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x7ff65c082310 msgr2=0x7ff65c084740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:10:27.707 INFO:tasks.workunit.client.0.smithi153.stderr: -96> 2024-09-19T14:10:27.529+0000 7ff6757fa640 1 client.7208.objecter ms_handle_reset 0x7ff65c082310 session 0x7ff78c00f040 osd.2 2024-09-19T14:10:27.707 INFO:tasks.workunit.client.0.smithi153.stderr: -95> 2024-09-19T14:10:27.529+0000 7ff7937cd640 10 monclient: get_auth_request con 0x7ff78c049060 auth_method 0 2024-09-19T14:10:27.707 INFO:tasks.workunit.client.0.smithi153.stderr: -94> 2024-09-19T14:10:27.529+0000 7ff7937cd640 10 monclient: get_auth_request con 0x7ff78802a3f0 auth_method 0 2024-09-19T14:10:27.707 INFO:tasks.workunit.client.0.smithi153.stderr: -93> 2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:10:27.707 INFO:tasks.workunit.client.0.smithi153.stderr: -92> 2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:10:27.707 INFO:tasks.workunit.client.0.smithi153.stderr: -91> 2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:10:27.707 INFO:tasks.workunit.client.0.smithi153.stderr: -90> 2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:10:27.707 INFO:tasks.workunit.client.0.smithi153.stderr: -89> 2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:10:27.707 INFO:tasks.workunit.client.0.smithi153.stderr: -88> 2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:10:27.707 INFO:tasks.workunit.client.0.smithi153.stderr: -87> 2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.707 INFO:tasks.workunit.client.0.smithi153.stderr: -86> 2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.707 INFO:tasks.workunit.client.0.smithi153.stderr: -85> 2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.707 INFO:tasks.workunit.client.0.smithi153.stderr: -84> 2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:27.707 INFO:tasks.workunit.client.0.smithi153.stderr: -83> 2024-09-19T14:10:27.537+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.708 INFO:tasks.workunit.client.0.smithi153.stderr: -82> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:10:27.708 INFO:tasks.workunit.client.0.smithi153.stderr: -81> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 zone default found 2024-09-19T14:10:27.708 INFO:tasks.workunit.client.0.smithi153.stderr: -80> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 4 Realm: () 2024-09-19T14:10:27.708 INFO:tasks.workunit.client.0.smithi153.stderr: -79> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:10:27.708 INFO:tasks.workunit.client.0.smithi153.stderr: -78> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:10:27.708 INFO:tasks.workunit.client.0.smithi153.stderr: -77> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:10:27.708 INFO:tasks.workunit.client.0.smithi153.stderr: -76> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 zonegroup default 2024-09-19T14:10:27.708 INFO:tasks.workunit.client.0.smithi153.stderr: -75> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.708 INFO:tasks.workunit.client.0.smithi153.stderr: -74> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.708 INFO:tasks.workunit.client.0.smithi153.stderr: -73> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.708 INFO:tasks.workunit.client.0.smithi153.stderr: -72> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.708 INFO:tasks.workunit.client.0.smithi153.stderr: -71> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.708 INFO:tasks.workunit.client.0.smithi153.stderr: -70> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.709 INFO:tasks.workunit.client.0.smithi153.stderr: -69> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 started sync module instance, tier type = 2024-09-19T14:10:27.709 INFO:tasks.workunit.client.0.smithi153.stderr: -68> 2024-09-19T14:10:27.541+0000 7ff795cc79c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:10:27.709 INFO:tasks.workunit.client.0.smithi153.stderr: -67> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 20 add_watcher() i=0 2024-09-19T14:10:27.709 INFO:tasks.workunit.client.0.smithi153.stderr: -66> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 20 add_watcher() i=1 2024-09-19T14:10:27.709 INFO:tasks.workunit.client.0.smithi153.stderr: -65> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 20 add_watcher() i=2 2024-09-19T14:10:27.709 INFO:tasks.workunit.client.0.smithi153.stderr: -64> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 20 add_watcher() i=3 2024-09-19T14:10:27.709 INFO:tasks.workunit.client.0.smithi153.stderr: -63> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 20 add_watcher() i=4 2024-09-19T14:10:27.709 INFO:tasks.workunit.client.0.smithi153.stderr: -62> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 20 add_watcher() i=5 2024-09-19T14:10:27.709 INFO:tasks.workunit.client.0.smithi153.stderr: -61> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 20 add_watcher() i=6 2024-09-19T14:10:27.709 INFO:tasks.workunit.client.0.smithi153.stderr: -60> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 20 add_watcher() i=7 2024-09-19T14:10:27.709 INFO:tasks.workunit.client.0.smithi153.stderr: -59> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:10:27.709 INFO:tasks.workunit.client.0.smithi153.stderr: -58> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding auth protocol: cephx 2024-09-19T14:10:27.709 INFO:tasks.workunit.client.0.smithi153.stderr: -57> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding auth protocol: cephx 2024-09-19T14:10:27.709 INFO:tasks.workunit.client.0.smithi153.stderr: -56> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding auth protocol: cephx 2024-09-19T14:10:27.710 INFO:tasks.workunit.client.0.smithi153.stderr: -55> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding con mode: secure 2024-09-19T14:10:27.710 INFO:tasks.workunit.client.0.smithi153.stderr: -54> 2024-09-19T14:10:27.557+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding con mode: crc 2024-09-19T14:10:27.710 INFO:tasks.workunit.client.0.smithi153.stderr: -53> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding con mode: secure 2024-09-19T14:10:27.710 INFO:tasks.workunit.client.0.smithi153.stderr: -52> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding con mode: crc 2024-09-19T14:10:27.710 INFO:tasks.workunit.client.0.smithi153.stderr: -51> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding con mode: secure 2024-09-19T14:10:27.710 INFO:tasks.workunit.client.0.smithi153.stderr: -50> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding con mode: crc 2024-09-19T14:10:27.710 INFO:tasks.workunit.client.0.smithi153.stderr: -49> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding con mode: crc 2024-09-19T14:10:27.710 INFO:tasks.workunit.client.0.smithi153.stderr: -48> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding con mode: secure 2024-09-19T14:10:27.710 INFO:tasks.workunit.client.0.smithi153.stderr: -47> 2024-09-19T14:10:27.557+0000 7ff64a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:27.710 INFO:tasks.workunit.client.0.smithi153.stderr: -46> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding con mode: crc 2024-09-19T14:10:27.710 INFO:tasks.workunit.client.0.smithi153.stderr: -45> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding con mode: secure 2024-09-19T14:10:27.710 INFO:tasks.workunit.client.0.smithi153.stderr: -44> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding con mode: crc 2024-09-19T14:10:27.710 INFO:tasks.workunit.client.0.smithi153.stderr: -43> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 AuthRegistry(0x7ffe3c8be300) adding con mode: secure 2024-09-19T14:10:27.710 INFO:tasks.workunit.client.0.smithi153.stderr: -42> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:10:27.711 INFO:tasks.workunit.client.0.smithi153.stderr: -41> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:10:27.711 INFO:tasks.workunit.client.0.smithi153.stderr: -40> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:10:27.711 INFO:tasks.workunit.client.0.smithi153.stderr: -39> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command cache list hook 0x5584e5a82920 2024-09-19T14:10:27.711 INFO:tasks.workunit.client.0.smithi153.stderr: -38> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command cache inspect hook 0x5584e5a82920 2024-09-19T14:10:27.711 INFO:tasks.workunit.client.0.smithi153.stderr: -37> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command cache erase hook 0x5584e5a82920 2024-09-19T14:10:27.711 INFO:tasks.workunit.client.0.smithi153.stderr: -36> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command cache zap hook 0x5584e5a82920 2024-09-19T14:10:27.711 INFO:tasks.workunit.client.0.smithi153.stderr: -35> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 note: GC not initialized 2024-09-19T14:10:27.711 INFO:tasks.workunit.client.0.smithi153.stderr: -34> 2024-09-19T14:10:27.561+0000 7ff6497e2640 20 reqs_thread_entry: start 2024-09-19T14:10:27.711 INFO:tasks.workunit.client.0.smithi153.stderr: -33> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command sync trace show hook 0x7ff77c001d40 2024-09-19T14:10:27.711 INFO:tasks.workunit.client.0.smithi153.stderr: -32> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command sync trace history hook 0x7ff77c001d40 2024-09-19T14:10:27.711 INFO:tasks.workunit.client.0.smithi153.stderr: -31> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command sync trace active hook 0x7ff77c001d40 2024-09-19T14:10:27.711 INFO:tasks.workunit.client.0.smithi153.stderr: -30> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 5 asok(0x5584e57a5d90) register_command sync trace active_short hook 0x7ff77c001d40 2024-09-19T14:10:27.711 INFO:tasks.workunit.client.0.smithi153.stderr: -29> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 20 init_complete bucket index max shards: 11 2024-09-19T14:10:27.711 INFO:tasks.workunit.client.0.smithi153.stderr: -28> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 20 Filter name: none 2024-09-19T14:10:27.712 INFO:tasks.workunit.client.0.smithi153.stderr: -27> 2024-09-19T14:10:27.561+0000 7ff6427fc640 20 reqs_thread_entry: start 2024-09-19T14:10:27.712 INFO:tasks.workunit.client.0.smithi153.stderr: -26> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-19T14:10:27.712 INFO:tasks.workunit.client.0.smithi153.stderr: -25> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.712 INFO:tasks.workunit.client.0.smithi153.stderr: -24> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-19T14:10:27.712 INFO:tasks.workunit.client.0.smithi153.stderr: -23> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-19T14:10:27.712 INFO:tasks.workunit.client.0.smithi153.stderr: -22> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-19T14:10:27.712 INFO:tasks.workunit.client.0.smithi153.stderr: -21> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 : miss 2024-09-19T14:10:27.712 INFO:tasks.workunit.client.0.smithi153.stderr: -20> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.712 INFO:tasks.workunit.client.0.smithi153.stderr: -19> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-19T14:10:27.712 INFO:tasks.workunit.client.0.smithi153.stderr: -18> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 info.flags=0x17 2024-09-19T14:10:27.712 INFO:tasks.workunit.client.0.smithi153.stderr: -17> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 to cache LRU end 2024-09-19T14:10:27.712 INFO:tasks.workunit.client.0.smithi153.stderr: -16> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:10:27.712 INFO:tasks.workunit.client.0.smithi153.stderr: -15> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:27.713 INFO:tasks.workunit.client.0.smithi153.stderr: -14> 2024-09-19T14:10:27.561+0000 7ff795cc79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 2024-09-19T14:10:27.713 INFO:tasks.workunit.client.0.smithi153.stderr: -13> 2024-09-19T14:10:27.577+0000 7ff795cc79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 info.flags=0x17 2024-09-19T14:10:27.713 INFO:tasks.workunit.client.0.smithi153.stderr: -12> 2024-09-19T14:10:27.577+0000 7ff795cc79c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 to cache LRU end 2024-09-19T14:10:27.713 INFO:tasks.workunit.client.0.smithi153.stderr: -11> 2024-09-19T14:10:27.577+0000 7ff795cc79c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:27.713 INFO:tasks.workunit.client.0.smithi153.stderr: -10> 2024-09-19T14:10:27.577+0000 7ff795cc79c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36, ofs0, ns] 2024-09-19T14:10:27.713 INFO:tasks.workunit.client.0.smithi153.stderr: -9> 2024-09-19T14:10:27.577+0000 7ff676ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333492 cookie 94029277222720 notifier 7208 bl.length()=923 2024-09-19T14:10:27.713 INFO:tasks.workunit.client.0.smithi153.stderr: -8> 2024-09-19T14:10:27.577+0000 7ff676ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 info.flags=0x17 2024-09-19T14:10:27.713 INFO:tasks.workunit.client.0.smithi153.stderr: -7> 2024-09-19T14:10:27.577+0000 7ff676ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 to cache LRU end 2024-09-19T14:10:27.713 INFO:tasks.workunit.client.0.smithi153.stderr: -6> 2024-09-19T14:10:27.577+0000 7ff676ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:27.713 INFO:tasks.workunit.client.0.smithi153.stderr: -5> 2024-09-19T14:10:27.577+0000 7ff795cc79c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.36]): orig_sources= new_sources= 2024-09-19T14:10:27.713 INFO:tasks.workunit.client.0.smithi153.stderr: -4> 2024-09-19T14:10:27.577+0000 7ff795cc79c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.36]): potential sources added=[] removed=[] 2024-09-19T14:10:27.713 INFO:tasks.workunit.client.0.smithi153.stderr: -3> 2024-09-19T14:10:27.577+0000 7ff795cc79c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.36]): orig_dests= new_dests= 2024-09-19T14:10:27.713 INFO:tasks.workunit.client.0.smithi153.stderr: -2> 2024-09-19T14:10:27.577+0000 7ff795cc79c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.36]): potential dests added=[] removed=[] 2024-09-19T14:10:27.714 INFO:tasks.workunit.client.0.smithi153.stderr: -1> 2024-09-19T14:10:27.585+0000 7ff795cc79c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff795cc79c0 time 2024-09-19T14:10:27.587368+0000 2024-09-19T14:10:27.714 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:10:27.714 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.714 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:10:27.714 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff7995a12eb] 2024-09-19T14:10:27.714 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff7995a149f] 2024-09-19T14:10:27.714 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5584e3588271] 2024-09-19T14:10:27.714 INFO:tasks.workunit.client.0.smithi153.stderr: 4: radosgw-admin(+0x141057c) [0x5584e3fd957c] 2024-09-19T14:10:27.714 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5584e35980dd] 2024-09-19T14:10:27.714 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:10:27.714 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff798407d90] 2024-09-19T14:10:27.714 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:10:27.714 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:10:27.714 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.715 INFO:tasks.workunit.client.0.smithi153.stderr: 0> 2024-09-19T14:10:27.585+0000 7ff795cc79c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:10:27.715 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7ff795cc79c0 thread_name:radosgw-admin 2024-09-19T14:10:27.715 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.715 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:10:27.715 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff798420520] 2024-09-19T14:10:27.715 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:10:27.715 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:10:27.715 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:10:27.715 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff7995a1345] 2024-09-19T14:10:27.715 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff7995a149f] 2024-09-19T14:10:27.715 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5584e3588271] 2024-09-19T14:10:27.715 INFO:tasks.workunit.client.0.smithi153.stderr: 8: radosgw-admin(+0x141057c) [0x5584e3fd957c] 2024-09-19T14:10:27.715 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5584e35980dd] 2024-09-19T14:10:27.715 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:10:27.716 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff798407d90] 2024-09-19T14:10:27.716 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:10:27.716 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:10:27.716 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:10:27.716 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:27.716 INFO:tasks.workunit.client.0.smithi153.stderr:--- logging levels --- 2024-09-19T14:10:27.716 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 none 2024-09-19T14:10:27.716 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 lockdep 2024-09-19T14:10:27.716 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 context 2024-09-19T14:10:27.716 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 crush 2024-09-19T14:10:27.716 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds 2024-09-19T14:10:27.716 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_balancer 2024-09-19T14:10:27.716 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_locker 2024-09-19T14:10:27.716 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log 2024-09-19T14:10:27.717 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log_expire 2024-09-19T14:10:27.717 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_migrator 2024-09-19T14:10:27.717 INFO:tasks.workunit.client.0.smithi153.stderr: 3/ 5 mds_quiesce 2024-09-19T14:10:27.717 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 buffer 2024-09-19T14:10:27.717 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 timer 2024-09-19T14:10:27.717 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 filer 2024-09-19T14:10:27.717 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 striper 2024-09-19T14:10:27.717 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 objecter 2024-09-19T14:10:27.717 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rados 2024-09-19T14:10:27.717 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd 2024-09-19T14:10:27.717 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_mirror 2024-09-19T14:10:27.717 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_replay 2024-09-19T14:10:27.717 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_pwl 2024-09-19T14:10:27.718 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 journaler 2024-09-19T14:10:27.718 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objectcacher 2024-09-19T14:10:27.718 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:10:27.718 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 client 2024-09-19T14:10:27.718 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 osd 2024-09-19T14:10:27.718 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 optracker 2024-09-19T14:10:27.718 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objclass 2024-09-19T14:10:27.718 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 filestore 2024-09-19T14:10:27.718 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 journal 2024-09-19T14:10:27.718 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 ms 2024-09-19T14:10:27.718 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mon 2024-09-19T14:10:27.718 INFO:tasks.workunit.client.0.smithi153.stderr: 0/10 monc 2024-09-19T14:10:27.718 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 paxos 2024-09-19T14:10:27.718 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 tp 2024-09-19T14:10:27.719 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 auth 2024-09-19T14:10:27.719 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 crypto 2024-09-19T14:10:27.719 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 finisher 2024-09-19T14:10:27.719 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 reserver 2024-09-19T14:10:27.719 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 heartbeatmap 2024-09-19T14:10:27.719 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 perfcounter 2024-09-19T14:10:27.719 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw 2024-09-19T14:10:27.719 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_sync 2024-09-19T14:10:27.719 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_datacache 2024-09-19T14:10:27.719 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_access 2024-09-19T14:10:27.719 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:10:27.719 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_flight 2024-09-19T14:10:27.719 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:10:27.719 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw_notification 2024-09-19T14:10:27.720 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 javaclient 2024-09-19T14:10:27.720 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 asok 2024-09-19T14:10:27.720 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 throttle 2024-09-19T14:10:27.720 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 refs 2024-09-19T14:10:27.720 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 compressor 2024-09-19T14:10:27.720 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluestore 2024-09-19T14:10:27.720 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluefs 2024-09-19T14:10:27.720 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 bdev 2024-09-19T14:10:27.720 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 kstore 2024-09-19T14:10:27.720 INFO:tasks.workunit.client.0.smithi153.stderr: 4/ 5 rocksdb 2024-09-19T14:10:27.720 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 fuse 2024-09-19T14:10:27.720 INFO:tasks.workunit.client.0.smithi153.stderr: 2/ 5 mgr 2024-09-19T14:10:27.720 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mgrc 2024-09-19T14:10:27.720 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 dpdk 2024-09-19T14:10:27.721 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 eventtrace 2024-09-19T14:10:27.721 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 prioritycache 2024-09-19T14:10:27.721 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 test 2024-09-19T14:10:27.721 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:10:27.721 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephsqlite 2024-09-19T14:10:27.721 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:10:27.721 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore 2024-09-19T14:10:27.721 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_onode 2024-09-19T14:10:27.721 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_odata 2024-09-19T14:10:27.721 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_omap 2024-09-19T14:10:27.721 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_tm 2024-09-19T14:10:27.721 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_t 2024-09-19T14:10:27.721 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:10:27.721 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_epm 2024-09-19T14:10:27.722 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_lba 2024-09-19T14:10:27.722 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:10:27.722 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cache 2024-09-19T14:10:27.722 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_journal 2024-09-19T14:10:27.722 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_device 2024-09-19T14:10:27.722 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_backref 2024-09-19T14:10:27.722 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 alienstore 2024-09-19T14:10:27.722 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mclock 2024-09-19T14:10:27.722 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cyanstore 2024-09-19T14:10:27.722 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 ceph_exporter 2024-09-19T14:10:27.722 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 memstore 2024-09-19T14:10:27.722 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 trace 2024-09-19T14:10:27.722 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 ceph_dedup 2024-09-19T14:10:27.722 INFO:tasks.workunit.client.0.smithi153.stderr: -2/-2 (syslog threshold) 2024-09-19T14:10:27.722 INFO:tasks.workunit.client.0.smithi153.stderr: 99/99 (stderr threshold) 2024-09-19T14:10:27.723 INFO:tasks.workunit.client.0.smithi153.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:10:27.723 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff6427fc640 / http_manager 2024-09-19T14:10:27.723 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff6497e2640 / http_manager 2024-09-19T14:10:27.723 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff64a7e4640 / rgw_dt_lg_renew 2024-09-19T14:10:27.723 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff6757fa640 / ms_dispatch 2024-09-19T14:10:27.723 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff676ffd640 / io_context_pool 2024-09-19T14:10:27.723 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff67d602640 / ms_dispatch 2024-09-19T14:10:27.723 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff67fe07640 / ms_dispatch 2024-09-19T14:10:27.723 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff68160a640 / io_context_pool 2024-09-19T14:10:27.723 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff792fcc640 / msgr-worker-2 2024-09-19T14:10:27.723 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff7937cd640 / msgr-worker-1 2024-09-19T14:10:27.723 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff793fce640 / msgr-worker-0 2024-09-19T14:10:27.723 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff7947cf640 / io_context_pool 2024-09-19T14:10:27.723 INFO:tasks.workunit.client.0.smithi153.stderr: 7ff795cc79c0 / radosgw-admin 2024-09-19T14:10:27.724 INFO:tasks.workunit.client.0.smithi153.stderr: max_recent 500 2024-09-19T14:10:27.724 INFO:tasks.workunit.client.0.smithi153.stderr: max_new 1000 2024-09-19T14:10:27.724 INFO:tasks.workunit.client.0.smithi153.stderr: log_file /var/lib/ceph/crash/2024-09-19T14:10:27.589856Z_34df81fd-ecbf-4eb2-9321-5e254e08e5a1/log 2024-09-19T14:10:27.724 INFO:tasks.workunit.client.0.smithi153.stderr:--- end dump of recent events --- 2024-09-19T14:10:27.724 INFO:tasks.workunit.client.0.smithi153.stderr:Aborted 2024-09-19T14:10:27.724 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-19T14:10:27.725 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:10:27.725 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:10:27.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.665+0000 7f5a8adb69c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.669+0000 7f5a8adb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.669+0000 7f5a8adb69c0 20 realm 2024-09-19T14:10:27.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.669+0000 7f5a8adb69c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.669+0000 7f5a8adb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.669+0000 7f5a8adb69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:10:27.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.669+0000 7f5a8adb69c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.669+0000 7f5a8adb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:27.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.669+0000 7f5a8adb69c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.669+0000 7f5a8adb69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:27.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.669+0000 7f5a8adb69c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:27.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.669+0000 7f5a8adb69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:10:27.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.669+0000 7f5a8adb69c0 20 searching for the correct realm 2024-09-19T14:10:27.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.673+0000 7f5a880bb640 0 -- 172.21.15.153:0/2815044073 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f5a78010040 msgr2=0x7f5a780663d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:10:27.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:27.885+0000 7f5a888bc640 0 -- 172.21.15.153:0/2815044073 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f5a7c027920 msgr2=0x7f5a7c059400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:10:28.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.101+0000 7f5a8adb69c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:10:28.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.101+0000 7f5a8adb69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:10:28.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.101+0000 7f5a8adb69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:10:28.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.101+0000 7f5a8adb69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:10:28.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.101+0000 7f5a8adb69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:10:28.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.101+0000 7f5a8adb69c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:10:28.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.101+0000 7f5a8adb69c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:28.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.101+0000 7f5a8adb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:28.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.101+0000 7f5a8adb69c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:28.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.105+0000 7f5a8adb69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:28.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.105+0000 7f5a8adb69c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:28.107 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.105+0000 7f5a8adb69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:10:28.107 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.105+0000 7f5a8adb69c0 20 zone default found 2024-09-19T14:10:28.107 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.105+0000 7f5a8adb69c0 4 Realm: () 2024-09-19T14:10:28.107 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.105+0000 7f5a8adb69c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:10:28.107 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.105+0000 7f5a8adb69c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:10:28.107 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.105+0000 7f5a8adb69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:10:28.107 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.105+0000 7f5a8adb69c0 20 zonegroup default 2024-09-19T14:10:28.108 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.105+0000 7f5a8adb69c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:28.108 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.105+0000 7f5a8adb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:28.108 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.105+0000 7f5a8adb69c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:28.108 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.105+0000 7f5a8adb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:28.108 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.105+0000 7f5a8adb69c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:28.109 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.105+0000 7f5a8adb69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:28.109 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.105+0000 7f5a8adb69c0 20 started sync module instance, tier type = 2024-09-19T14:10:28.109 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.105+0000 7f5a8adb69c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:10:28.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.129+0000 7f5a8adb69c0 20 add_watcher() i=0 2024-09-19T14:10:28.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.129+0000 7f5a8adb69c0 20 add_watcher() i=1 2024-09-19T14:10:28.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.129+0000 7f5a8adb69c0 20 add_watcher() i=2 2024-09-19T14:10:28.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.129+0000 7f5a8adb69c0 20 add_watcher() i=3 2024-09-19T14:10:28.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.129+0000 7f5a8adb69c0 20 add_watcher() i=4 2024-09-19T14:10:28.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.129+0000 7f5a8adb69c0 20 add_watcher() i=5 2024-09-19T14:10:28.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.133+0000 7f5a8adb69c0 20 add_watcher() i=6 2024-09-19T14:10:28.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.133+0000 7f5a8adb69c0 20 add_watcher() i=7 2024-09-19T14:10:28.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.133+0000 7f5a8adb69c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:10:28.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.137+0000 7f593efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:28.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.137+0000 7f5a8adb69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:10:28.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.137+0000 7f5a8adb69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:10:28.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.137+0000 7f5a8adb69c0 5 note: GC not initialized 2024-09-19T14:10:28.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.141+0000 7f593dfe3640 20 reqs_thread_entry: start 2024-09-19T14:10:28.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.141+0000 7f5a8adb69c0 20 init_complete bucket index max shards: 11 2024-09-19T14:10:28.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.141+0000 7f5a8adb69c0 20 Filter name: none 2024-09-19T14:10:28.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.141+0000 7f58af7fe640 20 reqs_thread_entry: start 2024-09-19T14:10:28.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.141+0000 7f5a8adb69c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:28.143 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.141+0000 7f5a8adb69c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-19T14:10:28.143 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.141+0000 7f5a8adb69c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:28.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.141+0000 7f5a8adb69c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T14:10:28.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.141+0000 7f5a8adb69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:10:28.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.141+0000 7f5a8adb69c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:28.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.145+0000 7f5a8adb69c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-19T14:10:28.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.145+0000 7f5a8adb69c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:28.147 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.145+0000 7f5a8adb69c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T14:10:28.147 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.145+0000 7f5a8adb69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:10:28.151 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.149+0000 7f593efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:28.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.153+0000 7f5a8adb69c0 20 remove_watcher() i=0 2024-09-19T14:10:28.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.153+0000 7f5a8adb69c0 2 removed watcher, disabling cache 2024-09-19T14:10:28.159 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.157+0000 7f5a8adb69c0 20 remove_watcher() i=1 2024-09-19T14:10:28.161 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.157+0000 7f5a8adb69c0 20 remove_watcher() i=2 2024-09-19T14:10:28.163 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.161+0000 7f5a8adb69c0 20 remove_watcher() i=3 2024-09-19T14:10:28.166 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.165+0000 7f5a8adb69c0 20 remove_watcher() i=4 2024-09-19T14:10:28.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.165+0000 7f5a8adb69c0 20 remove_watcher() i=5 2024-09-19T14:10:28.169 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.169+0000 7f5a8adb69c0 20 remove_watcher() i=6 2024-09-19T14:10:28.171 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.169+0000 7f5a8adb69c0 20 remove_watcher() i=7 2024-09-19T14:10:28.189 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:28.189 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:10:28.190 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: abort-at-logrecord-writes id: dbb1da81-49d0-421a-b677-974869a7f103.4620.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:10:28.190 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:28.191 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:28.191 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:28.241 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:28.241 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:28.319 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T14:10:28.355 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:10:28.355 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:10:28.401 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.397+0000 7f259ff059c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:28.403 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.401+0000 7f259ff059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:28.403 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.401+0000 7f259ff059c0 20 realm 2024-09-19T14:10:28.403 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.401+0000 7f259ff059c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:28.403 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.401+0000 7f259ff059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:28.403 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.401+0000 7f259ff059c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:10:28.403 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.401+0000 7f259ff059c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:28.403 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.401+0000 7f259ff059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:28.403 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.401+0000 7f259ff059c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:28.405 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.401+0000 7f259ff059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:28.405 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.401+0000 7f259ff059c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:28.405 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.401+0000 7f259ff059c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:10:28.405 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.401+0000 7f259ff059c0 20 searching for the correct realm 2024-09-19T14:10:28.410 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.409+0000 7f259d20a640 0 -- 172.21.15.153:0/4261833873 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f25900f0070 msgr2=0x7f25900f1f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:10:28.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.413+0000 7f259da0b640 0 -- 172.21.15.153:0/4261833873 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f259403e910 msgr2=0x7f259402c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:10:28.635 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.633+0000 7f259ff059c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:10:28.635 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.633+0000 7f259ff059c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:10:28.635 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.633+0000 7f259ff059c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:10:28.635 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.633+0000 7f259ff059c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:10:28.635 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.633+0000 7f259ff059c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:10:28.635 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.633+0000 7f259ff059c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:10:28.635 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.633+0000 7f259ff059c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:28.635 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.633+0000 7f259ff059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:28.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.633+0000 7f259ff059c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:28.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.633+0000 7f259ff059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:28.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.633+0000 7f259ff059c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:28.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.633+0000 7f259ff059c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:10:28.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.633+0000 7f259ff059c0 20 zone default found 2024-09-19T14:10:28.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.633+0000 7f259ff059c0 4 Realm: () 2024-09-19T14:10:28.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.633+0000 7f259ff059c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:10:28.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.633+0000 7f259ff059c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:10:28.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.633+0000 7f259ff059c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:10:28.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.633+0000 7f259ff059c0 20 zonegroup default 2024-09-19T14:10:28.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.633+0000 7f259ff059c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:28.639 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.637+0000 7f259ff059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:28.639 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.637+0000 7f259ff059c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:28.639 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.637+0000 7f259ff059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:28.639 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.637+0000 7f259ff059c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:28.640 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.637+0000 7f259ff059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:28.640 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.637+0000 7f259ff059c0 20 started sync module instance, tier type = 2024-09-19T14:10:28.640 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.637+0000 7f259ff059c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:10:28.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.661+0000 7f259ff059c0 20 add_watcher() i=0 2024-09-19T14:10:28.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.661+0000 7f259ff059c0 20 add_watcher() i=1 2024-09-19T14:10:28.664 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.661+0000 7f259ff059c0 20 add_watcher() i=2 2024-09-19T14:10:28.664 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.661+0000 7f259ff059c0 20 add_watcher() i=3 2024-09-19T14:10:28.664 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.661+0000 7f259ff059c0 20 add_watcher() i=4 2024-09-19T14:10:28.664 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.661+0000 7f259ff059c0 20 add_watcher() i=5 2024-09-19T14:10:28.664 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.661+0000 7f259ff059c0 20 add_watcher() i=6 2024-09-19T14:10:28.666 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.665+0000 7f259ff059c0 20 add_watcher() i=7 2024-09-19T14:10:28.666 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.665+0000 7f259ff059c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:10:28.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.669+0000 7f2453fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:28.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.669+0000 7f259ff059c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:10:28.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.669+0000 7f259ff059c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:10:28.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.669+0000 7f259ff059c0 5 note: GC not initialized 2024-09-19T14:10:28.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.669+0000 7f2452fe5640 20 reqs_thread_entry: start 2024-09-19T14:10:28.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.669+0000 7f259ff059c0 20 init_complete bucket index max shards: 11 2024-09-19T14:10:28.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.669+0000 7f259ff059c0 20 Filter name: none 2024-09-19T14:10:28.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.669+0000 7f2450fe1640 20 reqs_thread_entry: start 2024-09-19T14:10:28.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.669+0000 7f259ff059c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-19T14:10:28.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.669+0000 7f259ff059c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:28.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.669+0000 7f259ff059c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-19T14:10:28.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.669+0000 7f259ff059c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-19T14:10:28.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.669+0000 7f259ff059c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-19T14:10:28.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.669+0000 7f259ff059c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 : miss 2024-09-19T14:10:28.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.669+0000 7f259ff059c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:28.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.673+0000 7f259ff059c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T14:10:28.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.673+0000 7f259ff059c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 info.flags=0x17 2024-09-19T14:10:28.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.673+0000 7f259ff059c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 to cache LRU end 2024-09-19T14:10:28.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.673+0000 7f259ff059c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:10:28.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.673+0000 7f259ff059c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:28.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.673+0000 7f259ff059c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 2024-09-19T14:10:28.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.673+0000 7f259ff059c0 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 to be held by another RGW process; skipping for now 2024-09-19T14:10:28.679 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.677+0000 7f2453fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:28.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.681+0000 7f259ff059c0 20 remove_watcher() i=0 2024-09-19T14:10:28.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.681+0000 7f259ff059c0 2 removed watcher, disabling cache 2024-09-19T14:10:28.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.685+0000 7f259ff059c0 20 remove_watcher() i=1 2024-09-19T14:10:28.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.689+0000 7f259ff059c0 20 remove_watcher() i=2 2024-09-19T14:10:28.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.689+0000 7f259ff059c0 20 remove_watcher() i=3 2024-09-19T14:10:28.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.693+0000 7f259ff059c0 20 remove_watcher() i=4 2024-09-19T14:10:28.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.693+0000 7f259ff059c0 20 remove_watcher() i=5 2024-09-19T14:10:28.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.693+0000 7f259ff059c0 20 remove_watcher() i=6 2024-09-19T14:10:28.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:28.697+0000 7f259ff059c0 20 remove_watcher() i=7 2024-09-19T14:10:28.723 INFO:tasks.workunit.client.0.smithi153.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-19T14:10:58.739 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T14:10:58.776 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:10:58.776 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:10:58.821 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:58.816+0000 7fefaf9a39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:58.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:58.820+0000 7fefaf9a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:58.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:58.820+0000 7fefaf9a39c0 20 realm 2024-09-19T14:10:58.823 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:58.820+0000 7fefaf9a39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:58.824 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:58.820+0000 7fefaf9a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:58.824 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:58.820+0000 7fefaf9a39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:10:58.824 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:58.820+0000 7fefaf9a39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:58.824 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:58.820+0000 7fefaf9a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:58.824 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:58.820+0000 7fefaf9a39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:58.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:58.820+0000 7fefaf9a39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:58.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:58.824+0000 7fefaf9a39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:58.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:58.824+0000 7fefaf9a39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:10:58.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:58.824+0000 7fefaf9a39c0 20 searching for the correct realm 2024-09-19T14:10:58.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:58.828+0000 7fefadcaa640 0 -- 172.21.15.153:0/628955075 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7fef98027070 msgr2=0x7fef98068090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:10:59.048 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.044+0000 7fefad4a9640 0 -- 172.21.15.153:0/628955075 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x55d32f4ce9c0 msgr2=0x55d32f4d0dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:10:59.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.052+0000 7fefaf9a39c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:10:59.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.052+0000 7fefaf9a39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:10:59.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.052+0000 7fefaf9a39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:10:59.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.052+0000 7fefaf9a39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:10:59.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.052+0000 7fefaf9a39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:10:59.056 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.052+0000 7fefaf9a39c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:10:59.056 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.052+0000 7fefaf9a39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:59.056 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.052+0000 7fefaf9a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:59.056 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.052+0000 7fefaf9a39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:59.056 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.052+0000 7fefaf9a39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:59.056 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.052+0000 7fefaf9a39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:59.058 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.052+0000 7fefaf9a39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:10:59.058 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.056+0000 7fefaf9a39c0 20 zone default found 2024-09-19T14:10:59.058 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.056+0000 7fefaf9a39c0 4 Realm: () 2024-09-19T14:10:59.058 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.056+0000 7fefaf9a39c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:10:59.058 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.056+0000 7fefaf9a39c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:10:59.058 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.056+0000 7fefaf9a39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:10:59.058 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.056+0000 7fefaf9a39c0 20 zonegroup default 2024-09-19T14:10:59.058 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.056+0000 7fefaf9a39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:59.058 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.056+0000 7fefaf9a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:59.058 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.056+0000 7fefaf9a39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:59.059 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.056+0000 7fefaf9a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:59.059 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.056+0000 7fefaf9a39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:59.060 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.056+0000 7fefaf9a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:59.060 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.056+0000 7fefaf9a39c0 20 started sync module instance, tier type = 2024-09-19T14:10:59.060 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.056+0000 7fefaf9a39c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:10:59.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.080+0000 7fefaf9a39c0 20 add_watcher() i=0 2024-09-19T14:10:59.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.080+0000 7fefaf9a39c0 20 add_watcher() i=1 2024-09-19T14:10:59.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.080+0000 7fefaf9a39c0 20 add_watcher() i=2 2024-09-19T14:10:59.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.080+0000 7fefaf9a39c0 20 add_watcher() i=3 2024-09-19T14:10:59.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.080+0000 7fefaf9a39c0 20 add_watcher() i=4 2024-09-19T14:10:59.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.080+0000 7fefaf9a39c0 20 add_watcher() i=5 2024-09-19T14:10:59.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.080+0000 7fefaf9a39c0 20 add_watcher() i=6 2024-09-19T14:10:59.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.084+0000 7fefaf9a39c0 20 add_watcher() i=7 2024-09-19T14:10:59.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.084+0000 7fefaf9a39c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:10:59.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.088+0000 7fee63fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:59.092 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.088+0000 7fefaf9a39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:10:59.092 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.088+0000 7fefaf9a39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:10:59.092 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.088+0000 7fefaf9a39c0 5 note: GC not initialized 2024-09-19T14:10:59.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.088+0000 7fee62fe5640 20 reqs_thread_entry: start 2024-09-19T14:10:59.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.088+0000 7fefaf9a39c0 20 init_complete bucket index max shards: 11 2024-09-19T14:10:59.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.088+0000 7fefaf9a39c0 20 Filter name: none 2024-09-19T14:10:59.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.088+0000 7fee60fe1640 20 reqs_thread_entry: start 2024-09-19T14:10:59.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.088+0000 7fefaf9a39c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-19T14:10:59.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.088+0000 7fefaf9a39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:59.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.092+0000 7fefaf9a39c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-19T14:10:59.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.092+0000 7fefaf9a39c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-19T14:10:59.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.092+0000 7fefaf9a39c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-19T14:10:59.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.092+0000 7fefaf9a39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 : miss 2024-09-19T14:10:59.095 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.092+0000 7fefaf9a39c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:59.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.092+0000 7fefaf9a39c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-19T14:10:59.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.092+0000 7fefaf9a39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 info.flags=0x17 2024-09-19T14:10:59.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.092+0000 7fefaf9a39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 to cache LRU end 2024-09-19T14:10:59.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.092+0000 7fefaf9a39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:10:59.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.092+0000 7fefaf9a39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:59.097 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.092+0000 7fefaf9a39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 2024-09-19T14:10:59.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.096+0000 7fefaf9a39c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T14:10:59.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.108+0000 7fefaf9a39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 info.flags=0x17 2024-09-19T14:10:59.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.108+0000 7fefaf9a39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 to cache LRU end 2024-09-19T14:10:59.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.108+0000 7fefaf9a39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:59.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.108+0000 7fefaf9a39c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36, ofs0, ns] 2024-09-19T14:10:59.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.112+0000 7fee7ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333493 cookie 94365520071184 notifier 7253 bl.length()=923 2024-09-19T14:10:59.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.112+0000 7fee7ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 info.flags=0x17 2024-09-19T14:10:59.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.112+0000 7fee7ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 to cache LRU end 2024-09-19T14:10:59.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.112+0000 7fee7ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:59.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.112+0000 7fefaf9a39c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.36]): orig_sources= new_sources= 2024-09-19T14:10:59.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.112+0000 7fefaf9a39c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.36]): potential sources added=[] removed=[] 2024-09-19T14:10:59.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.112+0000 7fefaf9a39c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.36]): orig_dests= new_dests= 2024-09-19T14:10:59.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.112+0000 7fefaf9a39c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.36]): potential dests added=[] removed=[] 2024-09-19T14:10:59.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2.0 2024-09-19T14:10:59.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2.0 2024-09-19T14:10:59.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2.1 2024-09-19T14:10:59.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2.1 2024-09-19T14:10:59.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2.2 2024-09-19T14:10:59.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2.2 2024-09-19T14:10:59.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2.3 2024-09-19T14:10:59.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2.3 2024-09-19T14:10:59.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2.4 2024-09-19T14:10:59.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2.4 2024-09-19T14:10:59.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2.5 2024-09-19T14:10:59.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2.5 2024-09-19T14:10:59.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2.6 2024-09-19T14:10:59.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2.6 2024-09-19T14:10:59.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2.7 2024-09-19T14:10:59.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2.7 2024-09-19T14:10:59.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2.8 2024-09-19T14:10:59.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2.8 2024-09-19T14:10:59.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2.9 2024-09-19T14:10:59.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2.9 2024-09-19T14:10:59.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2.10 2024-09-19T14:10:59.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2.10 2024-09-19T14:10:59.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2.11 2024-09-19T14:10:59.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2.11 2024-09-19T14:10:59.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.0 2024-09-19T14:10:59.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.1 2024-09-19T14:10:59.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2 2024-09-19T14:10:59.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.124+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.3 2024-09-19T14:10:59.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.128+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.4 2024-09-19T14:10:59.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.128+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.5 2024-09-19T14:10:59.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.128+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.6 2024-09-19T14:10:59.132 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.128+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.7 2024-09-19T14:10:59.132 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.128+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.8 2024-09-19T14:10:59.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.128+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.9 2024-09-19T14:10:59.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.132+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.10 2024-09-19T14:10:59.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.136+0000 7fefaf9a39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 : hit (requested=0x17, cached=0x17) 2024-09-19T14:10:59.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.136+0000 7fefaf9a39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 2024-09-19T14:10:59.144 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.140+0000 7fefaf9a39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 info.flags=0x17 2024-09-19T14:10:59.144 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.140+0000 7fefaf9a39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 to cache LRU end 2024-09-19T14:10:59.144 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.140+0000 7fefaf9a39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:59.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.140+0000 7fefaf9a39c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36, ofs0, ns] 2024-09-19T14:10:59.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.140+0000 7fee7ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333494 cookie 94365520071184 notifier 7253 bl.length()=923 2024-09-19T14:10:59.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.140+0000 7fee7ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 info.flags=0x17 2024-09-19T14:10:59.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.140+0000 7fee7ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 to cache LRU end 2024-09-19T14:10:59.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.140+0000 7fee7ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:59.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.144+0000 7fefaf9a39c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.36]): orig_sources= new_sources= 2024-09-19T14:10:59.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.144+0000 7fefaf9a39c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.36]): potential sources added=[] removed=[] 2024-09-19T14:10:59.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.144+0000 7fefaf9a39c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.36]): orig_dests= new_dests= 2024-09-19T14:10:59.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.144+0000 7fefaf9a39c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.36]): potential dests added=[] removed=[] 2024-09-19T14:10:59.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.148+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.0 2024-09-19T14:10:59.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.152+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.1 2024-09-19T14:10:59.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.152+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.2 2024-09-19T14:10:59.155 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.152+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.3 2024-09-19T14:10:59.155 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.152+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.4 2024-09-19T14:10:59.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.152+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.5 2024-09-19T14:10:59.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.152+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.6 2024-09-19T14:10:59.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.156+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.7 2024-09-19T14:10:59.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.156+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.8 2024-09-19T14:10:59.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.156+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.9 2024-09-19T14:10:59.159 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.156+0000 7fefaf9a39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.36.10 2024-09-19T14:10:59.160 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.156+0000 7fefaf9a39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 : hit (requested=0x17, cached=0x17) 2024-09-19T14:10:59.160 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.156+0000 7fefaf9a39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 2024-09-19T14:10:59.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.160+0000 7fefaf9a39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 info.flags=0x17 2024-09-19T14:10:59.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.160+0000 7fefaf9a39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 to cache LRU end 2024-09-19T14:10:59.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.160+0000 7fefaf9a39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:59.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.160+0000 7fefaf9a39c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36, ofs0, ns] 2024-09-19T14:10:59.165 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.160+0000 7fee7ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333495 cookie 94365520071184 notifier 7253 bl.length()=891 2024-09-19T14:10:59.165 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.160+0000 7fee7ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 info.flags=0x17 2024-09-19T14:10:59.165 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.160+0000 7fee7ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:dbb1da81-49d0-421a-b677-974869a7f103.4620.36 to cache LRU end 2024-09-19T14:10:59.165 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.160+0000 7fee7ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:10:59.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.164+0000 7fefaf9a39c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.36]): orig_sources= new_sources= 2024-09-19T14:10:59.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.164+0000 7fefaf9a39c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.36]): potential sources added=[] removed=[] 2024-09-19T14:10:59.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.164+0000 7fefaf9a39c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.36]): orig_dests= new_dests= 2024-09-19T14:10:59.169 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.164+0000 7fefaf9a39c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[dbb1da81-49d0-421a-b677-974869a7f103.4620.36]): potential dests added=[] removed=[] 2024-09-19T14:10:59.173 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.168+0000 7fefaf9a39c0 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-19T14:10:59.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.172+0000 7fee63fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:59.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.180+0000 7fefaf9a39c0 20 remove_watcher() i=0 2024-09-19T14:10:59.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.180+0000 7fefaf9a39c0 2 removed watcher, disabling cache 2024-09-19T14:10:59.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.180+0000 7fefaf9a39c0 20 remove_watcher() i=1 2024-09-19T14:10:59.186 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.184+0000 7fefaf9a39c0 20 remove_watcher() i=2 2024-09-19T14:10:59.188 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.184+0000 7fefaf9a39c0 20 remove_watcher() i=3 2024-09-19T14:10:59.190 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.188+0000 7fefaf9a39c0 20 remove_watcher() i=4 2024-09-19T14:10:59.192 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.188+0000 7fefaf9a39c0 20 remove_watcher() i=5 2024-09-19T14:10:59.193 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.188+0000 7fefaf9a39c0 20 remove_watcher() i=6 2024-09-19T14:10:59.194 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.192+0000 7fefaf9a39c0 20 remove_watcher() i=7 2024-09-19T14:10:59.212 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-19T14:10:59.243 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:10:59.243 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:10:59.286 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.284+0000 7f7f81fbd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:59.288 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.284+0000 7f7f81fbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:59.288 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.284+0000 7f7f81fbd9c0 20 realm 2024-09-19T14:10:59.288 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.284+0000 7f7f81fbd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:59.288 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.284+0000 7f7f81fbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:59.288 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.284+0000 7f7f81fbd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:10:59.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.284+0000 7f7f81fbd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:59.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.284+0000 7f7f81fbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:59.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.284+0000 7f7f81fbd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:59.290 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.288+0000 7f7f81fbd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:59.290 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.288+0000 7f7f81fbd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:59.291 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.288+0000 7f7f81fbd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:10:59.291 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.288+0000 7f7f81fbd9c0 20 searching for the correct realm 2024-09-19T14:10:59.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.292+0000 7f7f7f2c2640 0 -- 172.21.15.153:0/4249660653 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x5589478bd340 msgr2=0x5589478bf770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:10:59.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.300+0000 7f7f7fac3640 0 -- 172.21.15.153:0/4249660653 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f7f740489c0 msgr2=0x7f7f740819a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:10:59.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.520+0000 7f7f81fbd9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:10:59.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.520+0000 7f7f81fbd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:10:59.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.520+0000 7f7f81fbd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:10:59.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.520+0000 7f7f81fbd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:10:59.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.520+0000 7f7f81fbd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:10:59.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.520+0000 7f7f81fbd9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:10:59.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.520+0000 7f7f81fbd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:59.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.520+0000 7f7f81fbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:59.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.520+0000 7f7f81fbd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:59.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.520+0000 7f7f81fbd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:10:59.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.520+0000 7f7f81fbd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:59.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.520+0000 7f7f81fbd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:10:59.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.520+0000 7f7f81fbd9c0 20 zone default found 2024-09-19T14:10:59.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.520+0000 7f7f81fbd9c0 4 Realm: () 2024-09-19T14:10:59.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.520+0000 7f7f81fbd9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:10:59.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.520+0000 7f7f81fbd9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:10:59.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.520+0000 7f7f81fbd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:10:59.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.520+0000 7f7f81fbd9c0 20 zonegroup default 2024-09-19T14:10:59.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.520+0000 7f7f81fbd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:59.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.524+0000 7f7f81fbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:59.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.524+0000 7f7f81fbd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:59.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.524+0000 7f7f81fbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:59.527 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.524+0000 7f7f81fbd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:59.527 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.524+0000 7f7f81fbd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:10:59.527 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.524+0000 7f7f81fbd9c0 20 started sync module instance, tier type = 2024-09-19T14:10:59.527 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.524+0000 7f7f81fbd9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:10:59.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.548+0000 7f7f81fbd9c0 20 add_watcher() i=0 2024-09-19T14:10:59.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.548+0000 7f7f81fbd9c0 20 add_watcher() i=1 2024-09-19T14:10:59.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.548+0000 7f7f81fbd9c0 20 add_watcher() i=2 2024-09-19T14:10:59.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.548+0000 7f7f81fbd9c0 20 add_watcher() i=3 2024-09-19T14:10:59.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.548+0000 7f7f81fbd9c0 20 add_watcher() i=4 2024-09-19T14:10:59.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.548+0000 7f7f81fbd9c0 20 add_watcher() i=5 2024-09-19T14:10:59.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.548+0000 7f7f81fbd9c0 20 add_watcher() i=6 2024-09-19T14:10:59.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.548+0000 7f7f81fbd9c0 20 add_watcher() i=7 2024-09-19T14:10:59.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.548+0000 7f7f81fbd9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:10:59.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.556+0000 7f7e35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:59.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.556+0000 7f7f81fbd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:10:59.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.556+0000 7f7f81fbd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:10:59.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.556+0000 7f7f81fbd9c0 5 note: GC not initialized 2024-09-19T14:10:59.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.556+0000 7f7e34fe1640 20 reqs_thread_entry: start 2024-09-19T14:10:59.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.556+0000 7f7f81fbd9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:10:59.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.556+0000 7f7f81fbd9c0 20 Filter name: none 2024-09-19T14:10:59.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.556+0000 7f7dae7fc640 20 reqs_thread_entry: start 2024-09-19T14:10:59.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.556+0000 7f7f81fbd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:59.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.556+0000 7f7f81fbd9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-19T14:10:59.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.556+0000 7f7f81fbd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:59.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.560+0000 7f7f81fbd9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-19T14:10:59.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.560+0000 7f7f81fbd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:10:59.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.560+0000 7f7f81fbd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:59.564 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.560+0000 7f7f81fbd9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-19T14:10:59.564 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.560+0000 7f7f81fbd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:10:59.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.560+0000 7f7f81fbd9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-19T14:10:59.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.560+0000 7f7f81fbd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:10:59.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.564+0000 7f7e35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:10:59.573 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.568+0000 7f7f81fbd9c0 20 remove_watcher() i=0 2024-09-19T14:10:59.573 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.568+0000 7f7f81fbd9c0 2 removed watcher, disabling cache 2024-09-19T14:10:59.575 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.572+0000 7f7f81fbd9c0 20 remove_watcher() i=1 2024-09-19T14:10:59.578 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.576+0000 7f7f81fbd9c0 20 remove_watcher() i=2 2024-09-19T14:10:59.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.576+0000 7f7f81fbd9c0 20 remove_watcher() i=3 2024-09-19T14:10:59.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.580+0000 7f7f81fbd9c0 20 remove_watcher() i=4 2024-09-19T14:10:59.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.580+0000 7f7f81fbd9c0 20 remove_watcher() i=5 2024-09-19T14:10:59.584 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.580+0000 7f7f81fbd9c0 20 remove_watcher() i=6 2024-09-19T14:10:59.586 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:10:59.584+0000 7f7f81fbd9c0 20 remove_watcher() i=7 2024-09-19T14:10:59.600 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:59.601 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:10:59.601 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: abort-at-logrecord-writes id: dbb1da81-49d0-421a-b677-974869a7f103.4620.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T14:10:59.601 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:10:59.602 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:59.602 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:10:59.626 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:10:59.626 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:00.161 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:00.161 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:00.500 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-19T14:11:00.500 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:00.503 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:00.503 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:00.642 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:00.642 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:00.730 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:00.730 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:00.833 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:00.833 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:00.941 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:00.941 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:01.038 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:01.039 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:01.133 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:01.133 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:01.234 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:01.234 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:01.336 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:01.336 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:01.436 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:01.437 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:01.539 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:01.539 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:01.634 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:01.635 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:01.723 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:01.723 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:01.823 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:01.823 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:01.925 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:01.925 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:02.017 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:02.017 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:02.119 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:02.119 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:02.221 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:02.221 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:02.323 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:02.323 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:02.418 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:02.418 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:02.516 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:02.517 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:02.627 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:02.627 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:02.729 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-19T14:11:02.763 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:11:02.763 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:11:02.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:02.804+0000 7f3203bb29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:02.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:02.808+0000 7f3203bb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:02.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:02.808+0000 7f3203bb29c0 20 realm 2024-09-19T14:11:02.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:02.808+0000 7f3203bb29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:02.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:02.808+0000 7f3203bb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:02.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:02.808+0000 7f3203bb29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:11:02.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:02.808+0000 7f3203bb29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:02.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:02.808+0000 7f3203bb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:02.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:02.808+0000 7f3203bb29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:02.812 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:02.808+0000 7f3203bb29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:02.812 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:02.808+0000 7f3203bb29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:02.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:02.808+0000 7f3203bb29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:11:02.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:02.808+0000 7f3203bb29c0 20 searching for the correct realm 2024-09-19T14:11:02.815 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:02.812+0000 7f32016b8640 0 -- 172.21.15.153:0/3358201744 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x7f31fc025040 msgr2=0x7f31fc025930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:03.029 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.024+0000 7f3201eb9640 0 -- 172.21.15.153:0/3358201744 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f31f80cd040 msgr2=0x7f31f80e1420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:03.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.044+0000 7f3203bb29c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:11:03.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.044+0000 7f3203bb29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:11:03.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.044+0000 7f3203bb29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:11:03.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.044+0000 7f3203bb29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:11:03.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.044+0000 7f3203bb29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:11:03.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.044+0000 7f3203bb29c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:11:03.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.044+0000 7f3203bb29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.044+0000 7f3203bb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:03.048 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.044+0000 7f3203bb29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.048 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.044+0000 7f3203bb29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:03.048 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.044+0000 7f3203bb29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.049 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.044+0000 7f3203bb29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:11:03.049 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.044+0000 7f3203bb29c0 20 zone default found 2024-09-19T14:11:03.049 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.044+0000 7f3203bb29c0 4 Realm: () 2024-09-19T14:11:03.050 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.044+0000 7f3203bb29c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:11:03.050 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.044+0000 7f3203bb29c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:11:03.050 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.044+0000 7f3203bb29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:11:03.050 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.044+0000 7f3203bb29c0 20 zonegroup default 2024-09-19T14:11:03.050 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.044+0000 7f3203bb29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.050 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.048+0000 7f3203bb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:03.050 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.048+0000 7f3203bb29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.051 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.048+0000 7f3203bb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:03.051 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.048+0000 7f3203bb29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.051 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.048+0000 7f3203bb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:03.052 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.048+0000 7f3203bb29c0 20 started sync module instance, tier type = 2024-09-19T14:11:03.052 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.048+0000 7f3203bb29c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:11:03.073 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.068+0000 7f3203bb29c0 20 add_watcher() i=0 2024-09-19T14:11:03.073 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.068+0000 7f3203bb29c0 20 add_watcher() i=1 2024-09-19T14:11:03.073 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.068+0000 7f3203bb29c0 20 add_watcher() i=2 2024-09-19T14:11:03.073 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.068+0000 7f3203bb29c0 20 add_watcher() i=3 2024-09-19T14:11:03.073 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.068+0000 7f3203bb29c0 20 add_watcher() i=4 2024-09-19T14:11:03.073 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.068+0000 7f3203bb29c0 20 add_watcher() i=5 2024-09-19T14:11:03.073 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.068+0000 7f3203bb29c0 20 add_watcher() i=6 2024-09-19T14:11:03.075 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.072+0000 7f3203bb29c0 20 add_watcher() i=7 2024-09-19T14:11:03.075 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.072+0000 7f3203bb29c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:11:03.078 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.076+0000 7f30b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:03.078 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.076+0000 7f3203bb29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:11:03.078 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.076+0000 7f3203bb29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:11:03.078 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.076+0000 7f3203bb29c0 5 note: GC not initialized 2024-09-19T14:11:03.079 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.076+0000 7f30b67e4640 20 reqs_thread_entry: start 2024-09-19T14:11:03.079 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.076+0000 7f3203bb29c0 20 init_complete bucket index max shards: 11 2024-09-19T14:11:03.079 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.076+0000 7f3203bb29c0 20 Filter name: none 2024-09-19T14:11:03.079 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.076+0000 7f3027fff640 20 reqs_thread_entry: start 2024-09-19T14:11:03.079 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.076+0000 7f3203bb29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.076+0000 7f3203bb29c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:11:03.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.076+0000 7f3203bb29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.076+0000 7f3203bb29c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:11:03.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.076+0000 7f3203bb29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:11:03.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.076+0000 7f3203bb29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.080+0000 7f3203bb29c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:11:03.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.080+0000 7f3203bb29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.080+0000 7f3203bb29c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:11:03.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.080+0000 7f3203bb29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:11:03.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.084+0000 7f30b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:03.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.088+0000 7f3203bb29c0 20 remove_watcher() i=0 2024-09-19T14:11:03.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.088+0000 7f3203bb29c0 2 removed watcher, disabling cache 2024-09-19T14:11:03.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.088+0000 7f3203bb29c0 20 remove_watcher() i=1 2024-09-19T14:11:03.096 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.092+0000 7f3203bb29c0 20 remove_watcher() i=2 2024-09-19T14:11:03.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.096+0000 7f3203bb29c0 20 remove_watcher() i=3 2024-09-19T14:11:03.100 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.096+0000 7f3203bb29c0 20 remove_watcher() i=4 2024-09-19T14:11:03.101 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.096+0000 7f3203bb29c0 20 remove_watcher() i=5 2024-09-19T14:11:03.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.100+0000 7f3203bb29c0 20 remove_watcher() i=6 2024-09-19T14:11:03.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.100+0000 7f3203bb29c0 20 remove_watcher() i=7 2024-09-19T14:11:03.119 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:03.119 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:11:03.119 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-change-reshard-state id: dbb1da81-49d0-421a-b677-974869a7f103.4620.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:11:03.119 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:03.119 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-19T14:11:03.154 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:11:03.154 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:11:03.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.196+0000 7ff10d0559c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.202 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.200+0000 7ff10d0559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:03.202 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.200+0000 7ff10d0559c0 20 realm 2024-09-19T14:11:03.202 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.200+0000 7ff10d0559c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.200+0000 7ff10d0559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:03.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.200+0000 7ff10d0559c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:11:03.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.200+0000 7ff10d0559c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.200+0000 7ff10d0559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:03.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.200+0000 7ff10d0559c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.204 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.200+0000 7ff10d0559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:03.204 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.200+0000 7ff10d0559c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.205 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.200+0000 7ff10d0559c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:11:03.205 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.200+0000 7ff10d0559c0 20 searching for the correct realm 2024-09-19T14:11:03.210 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.208+0000 7ff10b35c640 0 -- 172.21.15.153:0/736024092 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7ff100026910 msgr2=0x7ff1000323d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:03.215 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.212+0000 7ff10ab5b640 0 -- 172.21.15.153:0/736024092 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7ff100034ba0 msgr2=0x7ff1000413f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:03.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.428+0000 7ff10d0559c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:11:03.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.428+0000 7ff10d0559c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:11:03.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.428+0000 7ff10d0559c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:11:03.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.428+0000 7ff10d0559c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:11:03.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.428+0000 7ff10d0559c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:11:03.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.428+0000 7ff10d0559c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:11:03.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.428+0000 7ff10d0559c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.432+0000 7ff10d0559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:03.434 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.432+0000 7ff10d0559c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.435 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.432+0000 7ff10d0559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:03.435 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.432+0000 7ff10d0559c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.436 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.432+0000 7ff10d0559c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:11:03.436 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.432+0000 7ff10d0559c0 20 zone default found 2024-09-19T14:11:03.436 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.432+0000 7ff10d0559c0 4 Realm: () 2024-09-19T14:11:03.436 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.432+0000 7ff10d0559c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:11:03.436 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.432+0000 7ff10d0559c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:11:03.436 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.432+0000 7ff10d0559c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:11:03.437 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.432+0000 7ff10d0559c0 20 zonegroup default 2024-09-19T14:11:03.437 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.432+0000 7ff10d0559c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.437 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.432+0000 7ff10d0559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:03.437 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.432+0000 7ff10d0559c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.438 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.436+0000 7ff10d0559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:03.438 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.436+0000 7ff10d0559c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.438 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.436+0000 7ff10d0559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:03.438 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.436+0000 7ff10d0559c0 20 started sync module instance, tier type = 2024-09-19T14:11:03.438 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.436+0000 7ff10d0559c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:11:03.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.460+0000 7ff10d0559c0 20 add_watcher() i=0 2024-09-19T14:11:03.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.460+0000 7ff10d0559c0 20 add_watcher() i=1 2024-09-19T14:11:03.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.460+0000 7ff10d0559c0 20 add_watcher() i=2 2024-09-19T14:11:03.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.460+0000 7ff10d0559c0 20 add_watcher() i=3 2024-09-19T14:11:03.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.460+0000 7ff10d0559c0 20 add_watcher() i=4 2024-09-19T14:11:03.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.460+0000 7ff10d0559c0 20 add_watcher() i=5 2024-09-19T14:11:03.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.460+0000 7ff10d0559c0 20 add_watcher() i=6 2024-09-19T14:11:03.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.460+0000 7ff10d0559c0 20 add_watcher() i=7 2024-09-19T14:11:03.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.460+0000 7ff10d0559c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:11:03.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.464+0000 7fefc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:03.470 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.468+0000 7ff10d0559c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:11:03.470 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.468+0000 7ff10d0559c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:11:03.471 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.468+0000 7ff10d0559c0 5 note: GC not initialized 2024-09-19T14:11:03.471 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.468+0000 7fef3bfff640 20 reqs_thread_entry: start 2024-09-19T14:11:03.471 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.468+0000 7ff10d0559c0 20 init_complete bucket index max shards: 11 2024-09-19T14:11:03.471 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.468+0000 7ff10d0559c0 20 Filter name: none 2024-09-19T14:11:03.472 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.468+0000 7fef39ffb640 20 reqs_thread_entry: start 2024-09-19T14:11:03.472 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.468+0000 7ff10d0559c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-19T14:11:03.472 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.468+0000 7ff10d0559c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.468+0000 7ff10d0559c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:11:03.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.468+0000 7ff10d0559c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-19T14:11:03.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.468+0000 7ff10d0559c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-19T14:11:03.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.468+0000 7ff10d0559c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 : miss 2024-09-19T14:11:03.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.468+0000 7ff10d0559c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.472+0000 7ff10d0559c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:11:03.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.472+0000 7ff10d0559c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 info.flags=0x17 2024-09-19T14:11:03.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.472+0000 7ff10d0559c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 to cache LRU end 2024-09-19T14:11:03.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.472+0000 7ff10d0559c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:11:03.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.472+0000 7ff10d0559c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:03.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.472+0000 7ff10d0559c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 2024-09-19T14:11:03.485 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.480+0000 7ff10d0559c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 info.flags=0x17 2024-09-19T14:11:03.485 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.480+0000 7ff10d0559c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 to cache LRU end 2024-09-19T14:11:03.485 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.480+0000 7ff10d0559c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:03.485 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.480+0000 7ff10d0559c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37, ofs0, ns] 2024-09-19T14:11:03.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.484+0000 7fefee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333512 cookie 94392844174784 notifier 7301 bl.length()=931 2024-09-19T14:11:03.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.484+0000 7fefee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 info.flags=0x17 2024-09-19T14:11:03.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.484+0000 7fefee7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 to cache LRU end 2024-09-19T14:11:03.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.484+0000 7fefee7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:03.488 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.484+0000 7ff10d0559c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.37]): orig_sources= new_sources= 2024-09-19T14:11:03.488 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.484+0000 7ff10d0559c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.37]): potential sources added=[] removed=[] 2024-09-19T14:11:03.488 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.484+0000 7ff10d0559c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.37]): orig_dests= new_dests= 2024-09-19T14:11:03.488 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.484+0000 7ff10d0559c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.37]): potential dests added=[] removed=[] 2024-09-19T14:11:03.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.0 2024-09-19T14:11:03.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.0 2024-09-19T14:11:03.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.1 2024-09-19T14:11:03.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.1 2024-09-19T14:11:03.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.2 2024-09-19T14:11:03.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.2 2024-09-19T14:11:03.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.3 2024-09-19T14:11:03.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.3 2024-09-19T14:11:03.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.4 2024-09-19T14:11:03.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.4 2024-09-19T14:11:03.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.5 2024-09-19T14:11:03.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.5 2024-09-19T14:11:03.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.6 2024-09-19T14:11:03.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.6 2024-09-19T14:11:03.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.7 2024-09-19T14:11:03.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.7 2024-09-19T14:11:03.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.8 2024-09-19T14:11:03.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.8 2024-09-19T14:11:03.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.9 2024-09-19T14:11:03.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.9 2024-09-19T14:11:03.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.10 2024-09-19T14:11:03.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.10 2024-09-19T14:11:03.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.11 2024-09-19T14:11:03.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.11 2024-09-19T14:11:03.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.492+0000 7ff10d0559c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.0 2024-09-19T14:11:03.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.496+0000 7ff10d0559c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1 2024-09-19T14:11:03.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.496+0000 7ff10d0559c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.2 2024-09-19T14:11:03.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.496+0000 7ff10d0559c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.3 2024-09-19T14:11:03.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.500+0000 7ff10d0559c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.4 2024-09-19T14:11:03.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.500+0000 7ff10d0559c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.5 2024-09-19T14:11:03.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.500+0000 7ff10d0559c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.6 2024-09-19T14:11:03.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.500+0000 7ff10d0559c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.7 2024-09-19T14:11:03.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.504+0000 7ff10d0559c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.8 2024-09-19T14:11:03.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.504+0000 7ff10d0559c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.9 2024-09-19T14:11:03.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.504+0000 7ff10d0559c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.10 2024-09-19T14:11:03.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.512+0000 7ff10d0559c0 -1 Injecting error=-5 at location=change_reshard_state 2024-09-19T14:11:03.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.512+0000 7ff10d0559c0 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-19T14:11:03.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.532+0000 7ff10d0559c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 : hit (requested=0x17, cached=0x17) 2024-09-19T14:11:03.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.532+0000 7ff10d0559c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 2024-09-19T14:11:03.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.536+0000 7ff10d0559c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 info.flags=0x17 2024-09-19T14:11:03.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.536+0000 7ff10d0559c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 to cache LRU end 2024-09-19T14:11:03.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.536+0000 7ff10d0559c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:03.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.536+0000 7ff10d0559c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37, ofs0, ns] 2024-09-19T14:11:03.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.536+0000 7fefedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333513 cookie 94392844174784 notifier 7301 bl.length()=899 2024-09-19T14:11:03.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.536+0000 7fefedffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 info.flags=0x17 2024-09-19T14:11:03.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.536+0000 7fefedffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 to cache LRU end 2024-09-19T14:11:03.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.536+0000 7fefedffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:03.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.536+0000 7ff10d0559c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.37]): orig_sources= new_sources= 2024-09-19T14:11:03.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.536+0000 7ff10d0559c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.37]): potential sources added=[] removed=[] 2024-09-19T14:11:03.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.536+0000 7ff10d0559c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.37]): orig_dests= new_dests= 2024-09-19T14:11:03.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.536+0000 7ff10d0559c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.37]): potential dests added=[] removed=[] 2024-09-19T14:11:03.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.536+0000 7ff10d0559c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-19T14:11:03.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.540+0000 7fefc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:03.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.544+0000 7ff10d0559c0 20 remove_watcher() i=0 2024-09-19T14:11:03.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.544+0000 7ff10d0559c0 2 removed watcher, disabling cache 2024-09-19T14:11:03.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.548+0000 7ff10d0559c0 20 remove_watcher() i=1 2024-09-19T14:11:03.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.548+0000 7ff10d0559c0 20 remove_watcher() i=2 2024-09-19T14:11:03.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.552+0000 7ff10d0559c0 20 remove_watcher() i=3 2024-09-19T14:11:03.557 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.552+0000 7ff10d0559c0 20 remove_watcher() i=4 2024-09-19T14:11:03.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.556+0000 7ff10d0559c0 20 remove_watcher() i=5 2024-09-19T14:11:03.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.556+0000 7ff10d0559c0 20 remove_watcher() i=6 2024-09-19T14:11:03.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.556+0000 7ff10d0559c0 20 remove_watcher() i=7 2024-09-19T14:11:03.578 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-19T14:11:03.607 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:11:03.607 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:11:03.651 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.648+0000 7f6b31d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.648+0000 7f6b31d0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:03.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.648+0000 7f6b31d0a9c0 20 realm 2024-09-19T14:11:03.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.648+0000 7f6b31d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.648+0000 7f6b31d0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:03.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.648+0000 7f6b31d0a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:11:03.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.648+0000 7f6b31d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.648+0000 7f6b31d0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:03.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.648+0000 7f6b31d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.652+0000 7f6b31d0a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:03.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.652+0000 7f6b31d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.652+0000 7f6b31d0a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:11:03.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.652+0000 7f6b31d0a9c0 20 searching for the correct realm 2024-09-19T14:11:03.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.656+0000 7f6b30011640 0 -- 172.21.15.153:0/4181420305 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x5646e3930ba0 msgr2=0x5646e3932fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:03.667 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.664+0000 7f6b2f810640 0 -- 172.21.15.153:0/4181420305 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f6b240aa3d0 msgr2=0x7f6b240aa850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:03.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.672+0000 7f6b31d0a9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:11:03.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.672+0000 7f6b31d0a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:11:03.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.672+0000 7f6b31d0a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:11:03.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.672+0000 7f6b31d0a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:11:03.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.672+0000 7f6b31d0a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:11:03.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.672+0000 7f6b31d0a9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:11:03.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.672+0000 7f6b31d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.672+0000 7f6b31d0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:03.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.672+0000 7f6b31d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.672+0000 7f6b31d0a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:03.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.672+0000 7f6b31d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.672+0000 7f6b31d0a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:11:03.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.672+0000 7f6b31d0a9c0 20 zone default found 2024-09-19T14:11:03.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.672+0000 7f6b31d0a9c0 4 Realm: () 2024-09-19T14:11:03.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.672+0000 7f6b31d0a9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:11:03.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.672+0000 7f6b31d0a9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:11:03.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.672+0000 7f6b31d0a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:11:03.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.672+0000 7f6b31d0a9c0 20 zonegroup default 2024-09-19T14:11:03.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.672+0000 7f6b31d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.672+0000 7f6b31d0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:03.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.672+0000 7f6b31d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.672+0000 7f6b31d0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:03.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.672+0000 7f6b31d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.676+0000 7f6b31d0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:03.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.676+0000 7f6b31d0a9c0 20 started sync module instance, tier type = 2024-09-19T14:11:03.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.676+0000 7f6b31d0a9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:11:03.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.688+0000 7f6b31d0a9c0 20 add_watcher() i=0 2024-09-19T14:11:03.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.688+0000 7f6b31d0a9c0 20 add_watcher() i=1 2024-09-19T14:11:03.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.688+0000 7f6b31d0a9c0 20 add_watcher() i=2 2024-09-19T14:11:03.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.688+0000 7f6b31d0a9c0 20 add_watcher() i=3 2024-09-19T14:11:03.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.688+0000 7f6b31d0a9c0 20 add_watcher() i=4 2024-09-19T14:11:03.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.688+0000 7f6b31d0a9c0 20 add_watcher() i=5 2024-09-19T14:11:03.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.688+0000 7f6b31d0a9c0 20 add_watcher() i=6 2024-09-19T14:11:03.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.692+0000 7f6b31d0a9c0 20 add_watcher() i=7 2024-09-19T14:11:03.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.692+0000 7f6b31d0a9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:11:03.696 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.692+0000 7f69e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:03.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.692+0000 7f6b31d0a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:11:03.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.692+0000 7f6b31d0a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:11:03.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.692+0000 7f6b31d0a9c0 5 note: GC not initialized 2024-09-19T14:11:03.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.692+0000 7f69e4fe1640 20 reqs_thread_entry: start 2024-09-19T14:11:03.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.692+0000 7f6b31d0a9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:11:03.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.692+0000 7f6b31d0a9c0 20 Filter name: none 2024-09-19T14:11:03.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.692+0000 7f695e7fc640 20 reqs_thread_entry: start 2024-09-19T14:11:03.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.696+0000 7f6b31d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.696+0000 7f6b31d0a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:11:03.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.696+0000 7f6b31d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.696+0000 7f6b31d0a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:11:03.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.696+0000 7f6b31d0a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:11:03.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.696+0000 7f6b31d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.696+0000 7f6b31d0a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:11:03.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.696+0000 7f6b31d0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:03.702 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.700+0000 7f6b31d0a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:11:03.702 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.700+0000 7f6b31d0a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:11:03.704 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.700+0000 7f69e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:03.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.704+0000 7f6b31d0a9c0 20 remove_watcher() i=0 2024-09-19T14:11:03.709 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.704+0000 7f6b31d0a9c0 2 removed watcher, disabling cache 2024-09-19T14:11:03.712 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.708+0000 7f6b31d0a9c0 20 remove_watcher() i=1 2024-09-19T14:11:03.713 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.708+0000 7f6b31d0a9c0 20 remove_watcher() i=2 2024-09-19T14:11:03.715 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.712+0000 7f6b31d0a9c0 20 remove_watcher() i=3 2024-09-19T14:11:03.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.712+0000 7f6b31d0a9c0 20 remove_watcher() i=4 2024-09-19T14:11:03.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.716+0000 7f6b31d0a9c0 20 remove_watcher() i=5 2024-09-19T14:11:03.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.716+0000 7f6b31d0a9c0 20 remove_watcher() i=6 2024-09-19T14:11:03.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:03.716+0000 7f6b31d0a9c0 20 remove_watcher() i=7 2024-09-19T14:11:03.734 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:03.734 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:11:03.734 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-change-reshard-state id: dbb1da81-49d0-421a-b677-974869a7f103.4620.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:11:03.734 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:03.735 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:03.735 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:03.776 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:03.776 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:03.835 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T14:11:03.871 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:11:03.871 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:11:04.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.120+0000 7f435740a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.124+0000 7f435740a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:04.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.124+0000 7f435740a9c0 20 realm 2024-09-19T14:11:04.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.124+0000 7f435740a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.124+0000 7f435740a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:04.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.124+0000 7f435740a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:11:04.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.124+0000 7f435740a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.124+0000 7f435740a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:04.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.124+0000 7f435740a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.124+0000 7f435740a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:04.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.124+0000 7f435740a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.124+0000 7f435740a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:11:04.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.124+0000 7f435740a9c0 20 searching for the correct realm 2024-09-19T14:11:04.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.128+0000 7f435470f640 0 -- 172.21.15.153:0/514782718 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f43440ee040 msgr2=0x7f43440ed410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:04.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.344+0000 7f4354f10640 0 -- 172.21.15.153:0/514782718 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f434802cb60 msgr2=0x7f4348023700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:11:04.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.560+0000 7f435740a9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:11:04.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.560+0000 7f435740a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:11:04.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.560+0000 7f435740a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:11:04.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.560+0000 7f435740a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:11:04.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.560+0000 7f435740a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:11:04.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.560+0000 7f435740a9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:11:04.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.560+0000 7f435740a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.564+0000 7f435740a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:04.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.564+0000 7f435740a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.564+0000 7f435740a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:04.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.564+0000 7f435740a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.564+0000 7f435740a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:11:04.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.564+0000 7f435740a9c0 20 zone default found 2024-09-19T14:11:04.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.564+0000 7f435740a9c0 4 Realm: () 2024-09-19T14:11:04.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.564+0000 7f435740a9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:11:04.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.564+0000 7f435740a9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:11:04.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.564+0000 7f435740a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:11:04.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.564+0000 7f435740a9c0 20 zonegroup default 2024-09-19T14:11:04.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.564+0000 7f435740a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.564+0000 7f435740a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:04.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.564+0000 7f435740a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.568+0000 7f435740a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:04.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.568+0000 7f435740a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.568+0000 7f435740a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:04.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.568+0000 7f435740a9c0 20 started sync module instance, tier type = 2024-09-19T14:11:04.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.568+0000 7f435740a9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:11:04.594 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.592+0000 7f435740a9c0 20 add_watcher() i=0 2024-09-19T14:11:04.595 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.592+0000 7f435740a9c0 20 add_watcher() i=1 2024-09-19T14:11:04.595 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.592+0000 7f435740a9c0 20 add_watcher() i=2 2024-09-19T14:11:04.595 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.592+0000 7f435740a9c0 20 add_watcher() i=3 2024-09-19T14:11:04.595 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.592+0000 7f435740a9c0 20 add_watcher() i=4 2024-09-19T14:11:04.595 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.592+0000 7f435740a9c0 20 add_watcher() i=5 2024-09-19T14:11:04.595 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.592+0000 7f435740a9c0 20 add_watcher() i=6 2024-09-19T14:11:04.597 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.592+0000 7f435740a9c0 20 add_watcher() i=7 2024-09-19T14:11:04.597 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.592+0000 7f435740a9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:11:04.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.600+0000 7f420b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:04.603 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.600+0000 7f435740a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:11:04.603 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.600+0000 7f435740a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:11:04.603 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.600+0000 7f435740a9c0 5 note: GC not initialized 2024-09-19T14:11:04.603 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.600+0000 7f420a7e4640 20 reqs_thread_entry: start 2024-09-19T14:11:04.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.600+0000 7f435740a9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:11:04.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.600+0000 7f435740a9c0 20 Filter name: none 2024-09-19T14:11:04.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.600+0000 7f4203fff640 20 reqs_thread_entry: start 2024-09-19T14:11:04.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.600+0000 7f435740a9c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-19T14:11:04.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.600+0000 7f435740a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.600+0000 7f435740a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:11:04.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.600+0000 7f435740a9c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-19T14:11:04.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.600+0000 7f435740a9c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-19T14:11:04.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.600+0000 7f435740a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 : miss 2024-09-19T14:11:04.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.600+0000 7f435740a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.604+0000 7f435740a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:11:04.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.604+0000 7f435740a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 info.flags=0x17 2024-09-19T14:11:04.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.604+0000 7f435740a9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 to cache LRU end 2024-09-19T14:11:04.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.604+0000 7f435740a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:11:04.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.604+0000 7f435740a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:04.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.604+0000 7f435740a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 2024-09-19T14:11:04.617 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.612+0000 7f435740a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 info.flags=0x17 2024-09-19T14:11:04.617 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.612+0000 7f435740a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 to cache LRU end 2024-09-19T14:11:04.617 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.612+0000 7f435740a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:04.617 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.612+0000 7f435740a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37, ofs0, ns] 2024-09-19T14:11:04.617 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.612+0000 7f422bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333514 cookie 94835978229568 notifier 7845 bl.length()=931 2024-09-19T14:11:04.617 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.612+0000 7f422bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 info.flags=0x17 2024-09-19T14:11:04.618 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.612+0000 7f422bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 to cache LRU end 2024-09-19T14:11:04.618 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.612+0000 7f422bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:04.620 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.616+0000 7f435740a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.37]): orig_sources= new_sources= 2024-09-19T14:11:04.620 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.616+0000 7f435740a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.37]): potential sources added=[] removed=[] 2024-09-19T14:11:04.620 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.616+0000 7f435740a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.37]): orig_dests= new_dests= 2024-09-19T14:11:04.621 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.616+0000 7f435740a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.37]): potential dests added=[] removed=[] 2024-09-19T14:11:04.630 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.0 2024-09-19T14:11:04.630 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.0 2024-09-19T14:11:04.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.1 2024-09-19T14:11:04.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.1 2024-09-19T14:11:04.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.2 2024-09-19T14:11:04.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.2 2024-09-19T14:11:04.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.3 2024-09-19T14:11:04.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.3 2024-09-19T14:11:04.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.4 2024-09-19T14:11:04.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.4 2024-09-19T14:11:04.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.5 2024-09-19T14:11:04.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.5 2024-09-19T14:11:04.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.6 2024-09-19T14:11:04.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.6 2024-09-19T14:11:04.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.7 2024-09-19T14:11:04.631 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.7 2024-09-19T14:11:04.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.8 2024-09-19T14:11:04.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.8 2024-09-19T14:11:04.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.9 2024-09-19T14:11:04.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.9 2024-09-19T14:11:04.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.10 2024-09-19T14:11:04.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.10 2024-09-19T14:11:04.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.11 2024-09-19T14:11:04.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1.11 2024-09-19T14:11:04.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.0 2024-09-19T14:11:04.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1 2024-09-19T14:11:04.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.2 2024-09-19T14:11:04.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.628+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.3 2024-09-19T14:11:04.634 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.632+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.4 2024-09-19T14:11:04.635 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.632+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.5 2024-09-19T14:11:04.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.632+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.6 2024-09-19T14:11:04.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.636+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.7 2024-09-19T14:11:04.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.636+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.8 2024-09-19T14:11:04.639 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.636+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.9 2024-09-19T14:11:04.639 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.636+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.10 2024-09-19T14:11:04.647 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.644+0000 7f435740a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 : hit (requested=0x17, cached=0x17) 2024-09-19T14:11:04.647 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.644+0000 7f435740a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 2024-09-19T14:11:04.649 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.644+0000 7f435740a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 info.flags=0x17 2024-09-19T14:11:04.649 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.644+0000 7f435740a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 to cache LRU end 2024-09-19T14:11:04.649 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.644+0000 7f435740a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:04.650 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.644+0000 7f435740a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37, ofs0, ns] 2024-09-19T14:11:04.650 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.648+0000 7f422bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333515 cookie 94835978229568 notifier 7845 bl.length()=931 2024-09-19T14:11:04.650 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.648+0000 7f422bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 info.flags=0x17 2024-09-19T14:11:04.650 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.648+0000 7f422bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 to cache LRU end 2024-09-19T14:11:04.650 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.648+0000 7f422bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:04.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.648+0000 7f435740a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.37]): orig_sources= new_sources= 2024-09-19T14:11:04.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.648+0000 7f435740a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.37]): potential sources added=[] removed=[] 2024-09-19T14:11:04.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.648+0000 7f435740a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.37]): orig_dests= new_dests= 2024-09-19T14:11:04.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.648+0000 7f435740a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.37]): potential dests added=[] removed=[] 2024-09-19T14:11:04.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.652+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.0 2024-09-19T14:11:04.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.656+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.1 2024-09-19T14:11:04.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.656+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.2 2024-09-19T14:11:04.660 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.656+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.3 2024-09-19T14:11:04.660 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.656+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.4 2024-09-19T14:11:04.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.660+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.5 2024-09-19T14:11:04.664 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.660+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.6 2024-09-19T14:11:04.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.660+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.7 2024-09-19T14:11:04.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.660+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.8 2024-09-19T14:11:04.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.664+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.9 2024-09-19T14:11:04.666 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.664+0000 7f435740a9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.37.10 2024-09-19T14:11:04.667 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.664+0000 7f435740a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 : hit (requested=0x17, cached=0x17) 2024-09-19T14:11:04.667 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.664+0000 7f435740a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 2024-09-19T14:11:04.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.668+0000 7f435740a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 info.flags=0x17 2024-09-19T14:11:04.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.668+0000 7f435740a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 to cache LRU end 2024-09-19T14:11:04.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.668+0000 7f435740a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:04.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.668+0000 7f435740a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37, ofs0, ns] 2024-09-19T14:11:04.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.668+0000 7f422b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333516 cookie 94835978229568 notifier 7845 bl.length()=899 2024-09-19T14:11:04.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.668+0000 7f422b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 info.flags=0x17 2024-09-19T14:11:04.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.668+0000 7f422b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.37 to cache LRU end 2024-09-19T14:11:04.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.668+0000 7f422b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:04.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.668+0000 7f435740a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.37]): orig_sources= new_sources= 2024-09-19T14:11:04.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.668+0000 7f435740a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.37]): potential sources added=[] removed=[] 2024-09-19T14:11:04.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.668+0000 7f435740a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.37]): orig_dests= new_dests= 2024-09-19T14:11:04.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.668+0000 7f435740a9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.37]): potential dests added=[] removed=[] 2024-09-19T14:11:04.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.676+0000 7f435740a9c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-19T14:11:04.681 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.680+0000 7f420b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:04.686 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.684+0000 7f435740a9c0 20 remove_watcher() i=0 2024-09-19T14:11:04.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.684+0000 7f435740a9c0 2 removed watcher, disabling cache 2024-09-19T14:11:04.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.684+0000 7f435740a9c0 20 remove_watcher() i=1 2024-09-19T14:11:04.691 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.688+0000 7f435740a9c0 20 remove_watcher() i=2 2024-09-19T14:11:04.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.688+0000 7f435740a9c0 20 remove_watcher() i=3 2024-09-19T14:11:04.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.692+0000 7f435740a9c0 20 remove_watcher() i=4 2024-09-19T14:11:04.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.692+0000 7f435740a9c0 20 remove_watcher() i=5 2024-09-19T14:11:04.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.696+0000 7f435740a9c0 20 remove_watcher() i=6 2024-09-19T14:11:04.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.696+0000 7f435740a9c0 20 remove_watcher() i=7 2024-09-19T14:11:04.717 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-19T14:11:04.744 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:11:04.745 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:11:04.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.784+0000 7fa1f22199c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.788+0000 7fa1f22199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:04.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.788+0000 7fa1f22199c0 20 realm 2024-09-19T14:11:04.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.788+0000 7fa1f22199c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.788+0000 7fa1f22199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:04.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.788+0000 7fa1f22199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:11:04.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.788+0000 7fa1f22199c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.788+0000 7fa1f22199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:04.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.788+0000 7fa1f22199c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.788+0000 7fa1f22199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:04.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.788+0000 7fa1f22199c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.788+0000 7fa1f22199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:11:04.793 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.788+0000 7fa1f22199c0 20 searching for the correct realm 2024-09-19T14:11:04.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.796+0000 7fa1f0520640 0 -- 172.21.15.153:0/3225118574 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55ca999f99b0 msgr2=0x55ca999fbdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:04.804 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.800+0000 7fa1efd1f640 0 -- 172.21.15.153:0/3225118574 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fa1e406f4b0 msgr2=0x7fa1e408b9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:04.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.808+0000 7fa1f22199c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:11:04.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.808+0000 7fa1f22199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:11:04.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.808+0000 7fa1f22199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:11:04.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.808+0000 7fa1f22199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:11:04.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.808+0000 7fa1f22199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:11:04.812 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.808+0000 7fa1f22199c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:11:04.812 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.808+0000 7fa1f22199c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.812 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.808+0000 7fa1f22199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:04.812 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.808+0000 7fa1f22199c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.812 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.808+0000 7fa1f22199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:04.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.808+0000 7fa1f22199c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.808+0000 7fa1f22199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:11:04.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.808+0000 7fa1f22199c0 20 zone default found 2024-09-19T14:11:04.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.808+0000 7fa1f22199c0 4 Realm: () 2024-09-19T14:11:04.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.808+0000 7fa1f22199c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:11:04.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.808+0000 7fa1f22199c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:11:04.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.808+0000 7fa1f22199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:11:04.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.808+0000 7fa1f22199c0 20 zonegroup default 2024-09-19T14:11:04.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.808+0000 7fa1f22199c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.814 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.808+0000 7fa1f22199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:04.814 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.808+0000 7fa1f22199c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.814 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.812+0000 7fa1f22199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:04.814 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.812+0000 7fa1f22199c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.814 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.812+0000 7fa1f22199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:04.814 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.812+0000 7fa1f22199c0 20 started sync module instance, tier type = 2024-09-19T14:11:04.814 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.812+0000 7fa1f22199c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:11:04.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.824+0000 7fa1f22199c0 20 add_watcher() i=0 2024-09-19T14:11:04.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.824+0000 7fa1f22199c0 20 add_watcher() i=1 2024-09-19T14:11:04.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.824+0000 7fa1f22199c0 20 add_watcher() i=2 2024-09-19T14:11:04.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.824+0000 7fa1f22199c0 20 add_watcher() i=3 2024-09-19T14:11:04.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.824+0000 7fa1f22199c0 20 add_watcher() i=4 2024-09-19T14:11:04.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.824+0000 7fa1f22199c0 20 add_watcher() i=5 2024-09-19T14:11:04.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.824+0000 7fa1f22199c0 20 add_watcher() i=6 2024-09-19T14:11:04.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.828+0000 7fa1f22199c0 20 add_watcher() i=7 2024-09-19T14:11:04.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.828+0000 7fa1f22199c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:11:04.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.828+0000 7fa0a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:04.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.828+0000 7fa1f22199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:11:04.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.828+0000 7fa1f22199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:11:04.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.828+0000 7fa1f22199c0 5 note: GC not initialized 2024-09-19T14:11:04.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.828+0000 7fa0a4fe1640 20 reqs_thread_entry: start 2024-09-19T14:11:04.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.832+0000 7fa1f22199c0 20 init_complete bucket index max shards: 11 2024-09-19T14:11:04.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.832+0000 7fa1f22199c0 20 Filter name: none 2024-09-19T14:11:04.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.832+0000 7fa01e7fc640 20 reqs_thread_entry: start 2024-09-19T14:11:04.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.832+0000 7fa1f22199c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.832+0000 7fa1f22199c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:11:04.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.832+0000 7fa1f22199c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.832+0000 7fa1f22199c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:11:04.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.832+0000 7fa1f22199c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:11:04.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.832+0000 7fa1f22199c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.832+0000 7fa1f22199c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:11:04.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.832+0000 7fa1f22199c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:04.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.832+0000 7fa1f22199c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:11:04.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.832+0000 7fa1f22199c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:11:04.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.836+0000 7fa0a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:04.845 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.840+0000 7fa1f22199c0 20 remove_watcher() i=0 2024-09-19T14:11:04.845 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.840+0000 7fa1f22199c0 2 removed watcher, disabling cache 2024-09-19T14:11:04.846 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.844+0000 7fa1f22199c0 20 remove_watcher() i=1 2024-09-19T14:11:04.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.844+0000 7fa1f22199c0 20 remove_watcher() i=2 2024-09-19T14:11:04.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.848+0000 7fa1f22199c0 20 remove_watcher() i=3 2024-09-19T14:11:04.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.848+0000 7fa1f22199c0 20 remove_watcher() i=4 2024-09-19T14:11:04.853 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.848+0000 7fa1f22199c0 20 remove_watcher() i=5 2024-09-19T14:11:04.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.852+0000 7fa1f22199c0 20 remove_watcher() i=6 2024-09-19T14:11:04.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:04.852+0000 7fa1f22199c0 20 remove_watcher() i=7 2024-09-19T14:11:04.869 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:04.869 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:11:04.869 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-change-reshard-state id: dbb1da81-49d0-421a-b677-974869a7f103.4620.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T14:11:04.869 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:04.871 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:04.871 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:04.893 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:04.893 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:05.408 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:05.409 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:05.785 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-19T14:11:05.785 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:05.787 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:05.787 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:05.920 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:05.921 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:06.009 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:06.009 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:06.103 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:06.103 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:06.202 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:06.202 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:06.303 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:06.304 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:06.403 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:06.404 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:06.503 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:06.503 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:06.600 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:06.600 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:06.690 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:06.690 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:06.782 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:06.782 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:06.877 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:06.878 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:06.974 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:06.974 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:07.073 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:07.074 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:07.174 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:07.174 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:07.274 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:07.274 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:07.376 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:07.377 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:07.475 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:07.475 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:07.586 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:07.586 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:07.680 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:07.680 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:07.781 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:07.781 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:07.875 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:07.875 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:07.966 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-19T14:11:07.999 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:11:07.999 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:11:08.045 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.040+0000 7ff48b3ac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.044+0000 7ff48b3ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:08.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.044+0000 7ff48b3ac9c0 20 realm 2024-09-19T14:11:08.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.044+0000 7ff48b3ac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.044+0000 7ff48b3ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:08.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.044+0000 7ff48b3ac9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:11:08.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.044+0000 7ff48b3ac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.044+0000 7ff48b3ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:08.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.044+0000 7ff48b3ac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.048 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.044+0000 7ff48b3ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:08.048 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.044+0000 7ff48b3ac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.049 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.044+0000 7ff48b3ac9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:11:08.049 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.044+0000 7ff48b3ac9c0 20 searching for the correct realm 2024-09-19T14:11:08.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.052+0000 7ff4886b1640 0 -- 172.21.15.153:0/3452896923 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x55ccaa5cd8c0 msgr2=0x55ccaa5cfcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:11:08.061 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.056+0000 7ff488eb2640 0 -- 172.21.15.153:0/3452896923 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7ff47c003920 msgr2=0x7ff47c0589e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:08.278 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.276+0000 7ff48b3ac9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:11:08.278 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.276+0000 7ff48b3ac9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:11:08.278 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.276+0000 7ff48b3ac9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:11:08.279 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.276+0000 7ff48b3ac9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:11:08.279 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.276+0000 7ff48b3ac9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:11:08.279 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.276+0000 7ff48b3ac9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:11:08.279 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.276+0000 7ff48b3ac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.279 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.276+0000 7ff48b3ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:08.279 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.276+0000 7ff48b3ac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.276+0000 7ff48b3ac9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:08.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.276+0000 7ff48b3ac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.276+0000 7ff48b3ac9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:11:08.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.276+0000 7ff48b3ac9c0 20 zone default found 2024-09-19T14:11:08.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.276+0000 7ff48b3ac9c0 4 Realm: () 2024-09-19T14:11:08.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.276+0000 7ff48b3ac9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:11:08.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.276+0000 7ff48b3ac9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:11:08.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.276+0000 7ff48b3ac9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:11:08.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.276+0000 7ff48b3ac9c0 20 zonegroup default 2024-09-19T14:11:08.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.276+0000 7ff48b3ac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.276+0000 7ff48b3ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:08.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.276+0000 7ff48b3ac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.280+0000 7ff48b3ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:08.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.280+0000 7ff48b3ac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.280+0000 7ff48b3ac9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:08.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.280+0000 7ff48b3ac9c0 20 started sync module instance, tier type = 2024-09-19T14:11:08.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.280+0000 7ff48b3ac9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:11:08.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.304+0000 7ff48b3ac9c0 20 add_watcher() i=0 2024-09-19T14:11:08.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.304+0000 7ff48b3ac9c0 20 add_watcher() i=1 2024-09-19T14:11:08.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.304+0000 7ff48b3ac9c0 20 add_watcher() i=2 2024-09-19T14:11:08.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.304+0000 7ff48b3ac9c0 20 add_watcher() i=3 2024-09-19T14:11:08.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.304+0000 7ff48b3ac9c0 20 add_watcher() i=4 2024-09-19T14:11:08.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.304+0000 7ff48b3ac9c0 20 add_watcher() i=5 2024-09-19T14:11:08.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.304+0000 7ff48b3ac9c0 20 add_watcher() i=6 2024-09-19T14:11:08.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.304+0000 7ff48b3ac9c0 20 add_watcher() i=7 2024-09-19T14:11:08.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.304+0000 7ff48b3ac9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:11:08.312 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.308+0000 7ff33f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:08.313 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.308+0000 7ff48b3ac9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:11:08.313 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.308+0000 7ff48b3ac9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:11:08.313 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.308+0000 7ff48b3ac9c0 5 note: GC not initialized 2024-09-19T14:11:08.313 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.308+0000 7ff33e7e4640 20 reqs_thread_entry: start 2024-09-19T14:11:08.313 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.308+0000 7ff48b3ac9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:11:08.314 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.308+0000 7ff48b3ac9c0 20 Filter name: none 2024-09-19T14:11:08.314 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.308+0000 7ff3377fe640 20 reqs_thread_entry: start 2024-09-19T14:11:08.314 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.312+0000 7ff48b3ac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.315 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.312+0000 7ff48b3ac9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:11:08.315 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.312+0000 7ff48b3ac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.312+0000 7ff48b3ac9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:11:08.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.312+0000 7ff48b3ac9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:11:08.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.312+0000 7ff48b3ac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.312+0000 7ff48b3ac9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:11:08.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.312+0000 7ff48b3ac9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.316+0000 7ff48b3ac9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:11:08.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.316+0000 7ff48b3ac9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:11:08.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.320+0000 7ff33f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:08.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.324+0000 7ff48b3ac9c0 20 remove_watcher() i=0 2024-09-19T14:11:08.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.324+0000 7ff48b3ac9c0 2 removed watcher, disabling cache 2024-09-19T14:11:08.329 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.324+0000 7ff48b3ac9c0 20 remove_watcher() i=1 2024-09-19T14:11:08.331 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.328+0000 7ff48b3ac9c0 20 remove_watcher() i=2 2024-09-19T14:11:08.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.328+0000 7ff48b3ac9c0 20 remove_watcher() i=3 2024-09-19T14:11:08.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.332+0000 7ff48b3ac9c0 20 remove_watcher() i=4 2024-09-19T14:11:08.336 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.332+0000 7ff48b3ac9c0 20 remove_watcher() i=5 2024-09-19T14:11:08.337 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.332+0000 7ff48b3ac9c0 20 remove_watcher() i=6 2024-09-19T14:11:08.339 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.336+0000 7ff48b3ac9c0 20 remove_watcher() i=7 2024-09-19T14:11:08.356 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:08.356 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:11:08.356 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-change-reshard-state id: dbb1da81-49d0-421a-b677-974869a7f103.4620.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:11:08.356 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:08.356 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-19T14:11:08.391 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:11:08.392 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:11:08.435 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.432+0000 7f15aa0789c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.437 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.432+0000 7f15aa0789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:08.437 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.432+0000 7f15aa0789c0 20 realm 2024-09-19T14:11:08.437 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.432+0000 7f15aa0789c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.437 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.432+0000 7f15aa0789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:08.438 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.432+0000 7f15aa0789c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:11:08.438 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.432+0000 7f15aa0789c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.438 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.432+0000 7f15aa0789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:08.438 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.432+0000 7f15aa0789c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.439 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.436+0000 7f15aa0789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:08.440 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.436+0000 7f15aa0789c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.440 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.436+0000 7f15aa0789c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:11:08.440 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.436+0000 7f15aa0789c0 20 searching for the correct realm 2024-09-19T14:11:08.445 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.440+0000 7f15a737d640 0 -- 172.21.15.153:0/2942605093 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x559ed03401c0 msgr2=0x559ed0342680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:08.450 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.448+0000 7f15a7b7e640 0 -- 172.21.15.153:0/2942605093 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f159c070420 msgr2=0x7f159c0653a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:08.459 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.456+0000 7f15aa0789c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:11:08.459 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.456+0000 7f15aa0789c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:11:08.459 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.456+0000 7f15aa0789c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:11:08.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.456+0000 7f15aa0789c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:11:08.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.456+0000 7f15aa0789c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:11:08.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.456+0000 7f15aa0789c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:11:08.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.456+0000 7f15aa0789c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.456+0000 7f15aa0789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:08.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.456+0000 7f15aa0789c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.461 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.456+0000 7f15aa0789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:08.461 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.456+0000 7f15aa0789c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.461 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.456+0000 7f15aa0789c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:11:08.461 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.456+0000 7f15aa0789c0 20 zone default found 2024-09-19T14:11:08.461 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.456+0000 7f15aa0789c0 4 Realm: () 2024-09-19T14:11:08.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.456+0000 7f15aa0789c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:11:08.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.456+0000 7f15aa0789c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:11:08.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.456+0000 7f15aa0789c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:11:08.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.456+0000 7f15aa0789c0 20 zonegroup default 2024-09-19T14:11:08.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.456+0000 7f15aa0789c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.456+0000 7f15aa0789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:08.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.456+0000 7f15aa0789c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.460+0000 7f15aa0789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:08.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.460+0000 7f15aa0789c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.460+0000 7f15aa0789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:08.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.460+0000 7f15aa0789c0 20 started sync module instance, tier type = 2024-09-19T14:11:08.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.460+0000 7f15aa0789c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:11:08.479 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.476+0000 7f15aa0789c0 20 add_watcher() i=0 2024-09-19T14:11:08.479 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.476+0000 7f15aa0789c0 20 add_watcher() i=1 2024-09-19T14:11:08.479 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.476+0000 7f15aa0789c0 20 add_watcher() i=2 2024-09-19T14:11:08.479 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.476+0000 7f15aa0789c0 20 add_watcher() i=3 2024-09-19T14:11:08.479 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.476+0000 7f15aa0789c0 20 add_watcher() i=4 2024-09-19T14:11:08.479 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.476+0000 7f15aa0789c0 20 add_watcher() i=5 2024-09-19T14:11:08.479 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.476+0000 7f15aa0789c0 20 add_watcher() i=6 2024-09-19T14:11:08.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.476+0000 7f15aa0789c0 20 add_watcher() i=7 2024-09-19T14:11:08.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.476+0000 7f15aa0789c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:11:08.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.480+0000 7f145dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:08.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.480+0000 7f15aa0789c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:11:08.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.480+0000 7f15aa0789c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:11:08.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.480+0000 7f15aa0789c0 5 note: GC not initialized 2024-09-19T14:11:08.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.480+0000 7f145cfe1640 20 reqs_thread_entry: start 2024-09-19T14:11:08.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.480+0000 7f15aa0789c0 20 init_complete bucket index max shards: 11 2024-09-19T14:11:08.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.480+0000 7f15aa0789c0 20 Filter name: none 2024-09-19T14:11:08.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.480+0000 7f13d67fc640 20 reqs_thread_entry: start 2024-09-19T14:11:08.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.480+0000 7f15aa0789c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-19T14:11:08.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.480+0000 7f15aa0789c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.485 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.480+0000 7f15aa0789c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:11:08.485 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.480+0000 7f15aa0789c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-19T14:11:08.485 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.480+0000 7f15aa0789c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-19T14:11:08.485 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.480+0000 7f15aa0789c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.38 : miss 2024-09-19T14:11:08.485 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.480+0000 7f15aa0789c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.484+0000 7f15aa0789c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:11:08.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.484+0000 7f15aa0789c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.38 info.flags=0x17 2024-09-19T14:11:08.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.484+0000 7f15aa0789c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.38 to cache LRU end 2024-09-19T14:11:08.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.484+0000 7f15aa0789c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:11:08.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.484+0000 7f15aa0789c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:08.486 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.484+0000 7f15aa0789c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.38 2024-09-19T14:11:08.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.496+0000 7f15aa0789c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.38 info.flags=0x17 2024-09-19T14:11:08.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.496+0000 7f15aa0789c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.38 to cache LRU end 2024-09-19T14:11:08.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.496+0000 7f15aa0789c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:08.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.496+0000 7f15aa0789c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.38, ofs0, ns] 2024-09-19T14:11:08.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.496+0000 7f1486ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333519 cookie 94140586279568 notifier 7388 bl.length()=931 2024-09-19T14:11:08.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.496+0000 7f1486ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.38 info.flags=0x17 2024-09-19T14:11:08.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.496+0000 7f1486ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.38 to cache LRU end 2024-09-19T14:11:08.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.496+0000 7f1486ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:08.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.496+0000 7f15aa0789c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.38]): orig_sources= new_sources= 2024-09-19T14:11:08.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.496+0000 7f15aa0789c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.38]): potential sources added=[] removed=[] 2024-09-19T14:11:08.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.496+0000 7f15aa0789c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.38]): orig_dests= new_dests= 2024-09-19T14:11:08.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.496+0000 7f15aa0789c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.38]): potential dests added=[] removed=[] 2024-09-19T14:11:08.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1.0 2024-09-19T14:11:08.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1.0 2024-09-19T14:11:08.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1.1 2024-09-19T14:11:08.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1.1 2024-09-19T14:11:08.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1.2 2024-09-19T14:11:08.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1.2 2024-09-19T14:11:08.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1.3 2024-09-19T14:11:08.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1.3 2024-09-19T14:11:08.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1.4 2024-09-19T14:11:08.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1.4 2024-09-19T14:11:08.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1.5 2024-09-19T14:11:08.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1.5 2024-09-19T14:11:08.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1.6 2024-09-19T14:11:08.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1.6 2024-09-19T14:11:08.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1.7 2024-09-19T14:11:08.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1.7 2024-09-19T14:11:08.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1.8 2024-09-19T14:11:08.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1.8 2024-09-19T14:11:08.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1.9 2024-09-19T14:11:08.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1.9 2024-09-19T14:11:08.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1.10 2024-09-19T14:11:08.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1.10 2024-09-19T14:11:08.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1.11 2024-09-19T14:11:08.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1.11 2024-09-19T14:11:08.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.504+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.0 2024-09-19T14:11:08.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.508+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1 2024-09-19T14:11:08.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.508+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.2 2024-09-19T14:11:08.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.508+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.3 2024-09-19T14:11:08.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.508+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.4 2024-09-19T14:11:08.513 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.508+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.5 2024-09-19T14:11:08.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.512+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.6 2024-09-19T14:11:08.515 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.512+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.7 2024-09-19T14:11:08.515 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.512+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.8 2024-09-19T14:11:08.516 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.512+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.9 2024-09-19T14:11:08.516 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.512+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.10 2024-09-19T14:11:08.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.520+0000 7f15aa0789c0 -1 Injecting error=-125 at location=change_reshard_state 2024-09-19T14:11:08.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.520+0000 7f15aa0789c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.38 : hit (requested=0x17, cached=0x17) 2024-09-19T14:11:08.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.520+0000 7f15aa0789c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.38 2024-09-19T14:11:08.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.524+0000 7f15aa0789c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.38 info.flags=0x17 2024-09-19T14:11:08.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.524+0000 7f15aa0789c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.38 to cache LRU end 2024-09-19T14:11:08.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.524+0000 7f15aa0789c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:08.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.524+0000 7f15aa0789c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.38, ofs0, ns] 2024-09-19T14:11:08.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.524+0000 7f14867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333520 cookie 94140586279568 notifier 7388 bl.length()=931 2024-09-19T14:11:08.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.524+0000 7f14867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.38 info.flags=0x17 2024-09-19T14:11:08.527 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.524+0000 7f14867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.38 to cache LRU end 2024-09-19T14:11:08.527 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.524+0000 7f14867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:08.528 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.524+0000 7f15aa0789c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.38]): orig_sources= new_sources= 2024-09-19T14:11:08.528 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.524+0000 7f15aa0789c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.38]): potential sources added=[] removed=[] 2024-09-19T14:11:08.528 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.524+0000 7f15aa0789c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.38]): orig_dests= new_dests= 2024-09-19T14:11:08.528 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.524+0000 7f15aa0789c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.38]): potential dests added=[] removed=[] 2024-09-19T14:11:08.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.528+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.0 2024-09-19T14:11:08.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.532+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.1 2024-09-19T14:11:08.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.532+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.2 2024-09-19T14:11:08.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.532+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.3 2024-09-19T14:11:08.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.532+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.4 2024-09-19T14:11:08.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.532+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.5 2024-09-19T14:11:08.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.532+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.6 2024-09-19T14:11:08.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.536+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.7 2024-09-19T14:11:08.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.536+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.8 2024-09-19T14:11:08.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.536+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.9 2024-09-19T14:11:08.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.536+0000 7f15aa0789c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.38.10 2024-09-19T14:11:08.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.536+0000 7f15aa0789c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.38 : hit (requested=0x17, cached=0x17) 2024-09-19T14:11:08.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.536+0000 7f15aa0789c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.38 2024-09-19T14:11:08.542 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.540+0000 7f15aa0789c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.38 info.flags=0x17 2024-09-19T14:11:08.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.540+0000 7f15aa0789c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.38 to cache LRU end 2024-09-19T14:11:08.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.540+0000 7f15aa0789c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:08.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.540+0000 7f15aa0789c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.38, ofs0, ns] 2024-09-19T14:11:08.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.540+0000 7f14867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333521 cookie 94140586279568 notifier 7388 bl.length()=899 2024-09-19T14:11:08.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.540+0000 7f14867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.38 info.flags=0x17 2024-09-19T14:11:08.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.540+0000 7f14867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.38 to cache LRU end 2024-09-19T14:11:08.543 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.540+0000 7f14867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:08.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.540+0000 7f15aa0789c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.38]): orig_sources= new_sources= 2024-09-19T14:11:08.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.540+0000 7f15aa0789c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.38]): potential sources added=[] removed=[] 2024-09-19T14:11:08.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.540+0000 7f15aa0789c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.38]): orig_dests= new_dests= 2024-09-19T14:11:08.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.540+0000 7f15aa0789c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.38]): potential dests added=[] removed=[] 2024-09-19T14:11:08.549 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.548+0000 7f15aa0789c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-19T14:11:08.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.548+0000 7f145dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:08.557 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.552+0000 7f15aa0789c0 20 remove_watcher() i=0 2024-09-19T14:11:08.557 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.552+0000 7f15aa0789c0 2 removed watcher, disabling cache 2024-09-19T14:11:08.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.556+0000 7f15aa0789c0 20 remove_watcher() i=1 2024-09-19T14:11:08.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.560+0000 7f15aa0789c0 20 remove_watcher() i=2 2024-09-19T14:11:08.564 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.560+0000 7f15aa0789c0 20 remove_watcher() i=3 2024-09-19T14:11:08.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.560+0000 7f15aa0789c0 20 remove_watcher() i=4 2024-09-19T14:11:08.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.564+0000 7f15aa0789c0 20 remove_watcher() i=5 2024-09-19T14:11:08.568 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.564+0000 7f15aa0789c0 20 remove_watcher() i=6 2024-09-19T14:11:08.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.568+0000 7f15aa0789c0 20 remove_watcher() i=7 2024-09-19T14:11:08.586 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-19T14:11:08.615 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:11:08.615 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:11:08.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.656+0000 7f4784bd29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.660 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.656+0000 7f4784bd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:08.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.656+0000 7f4784bd29c0 20 realm 2024-09-19T14:11:08.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.656+0000 7f4784bd29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.656+0000 7f4784bd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:08.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.656+0000 7f4784bd29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:11:08.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.656+0000 7f4784bd29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.656+0000 7f4784bd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:08.662 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.656+0000 7f4784bd29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.660+0000 7f4784bd29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:08.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.660+0000 7f4784bd29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.660+0000 7f4784bd29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:11:08.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.660+0000 7f4784bd29c0 20 searching for the correct realm 2024-09-19T14:11:08.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.664+0000 7f477bfff640 0 -- 172.21.15.153:0/4073329105 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55983b4bc3d0 msgr2=0x55983b4be860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:08.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.672+0000 7f47826d8640 0 -- 172.21.15.153:0/4073329105 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f476c053440 msgr2=0x7f476c0538a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:08.683 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.680+0000 7f4784bd29c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:11:08.683 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.680+0000 7f4784bd29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:11:08.683 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.680+0000 7f4784bd29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:11:08.683 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.680+0000 7f4784bd29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:11:08.683 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.680+0000 7f4784bd29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:11:08.683 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.680+0000 7f4784bd29c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:11:08.683 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.680+0000 7f4784bd29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.683 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.680+0000 7f4784bd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:08.683 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.680+0000 7f4784bd29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.680+0000 7f4784bd29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:08.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.680+0000 7f4784bd29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.680+0000 7f4784bd29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:11:08.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.680+0000 7f4784bd29c0 20 zone default found 2024-09-19T14:11:08.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.680+0000 7f4784bd29c0 4 Realm: () 2024-09-19T14:11:08.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.680+0000 7f4784bd29c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:11:08.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.680+0000 7f4784bd29c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:11:08.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.680+0000 7f4784bd29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:11:08.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.680+0000 7f4784bd29c0 20 zonegroup default 2024-09-19T14:11:08.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.680+0000 7f4784bd29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.686 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.680+0000 7f4784bd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:08.686 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.680+0000 7f4784bd29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.686 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.684+0000 7f4784bd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:08.686 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.684+0000 7f4784bd29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.684+0000 7f4784bd29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:08.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.684+0000 7f4784bd29c0 20 started sync module instance, tier type = 2024-09-19T14:11:08.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.684+0000 7f4784bd29c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:11:08.702 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.696+0000 7f4784bd29c0 20 add_watcher() i=0 2024-09-19T14:11:08.702 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.696+0000 7f4784bd29c0 20 add_watcher() i=1 2024-09-19T14:11:08.702 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.696+0000 7f4784bd29c0 20 add_watcher() i=2 2024-09-19T14:11:08.702 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.696+0000 7f4784bd29c0 20 add_watcher() i=3 2024-09-19T14:11:08.702 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.696+0000 7f4784bd29c0 20 add_watcher() i=4 2024-09-19T14:11:08.702 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.696+0000 7f4784bd29c0 20 add_watcher() i=5 2024-09-19T14:11:08.702 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.696+0000 7f4784bd29c0 20 add_watcher() i=6 2024-09-19T14:11:08.702 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.700+0000 7f4784bd29c0 20 add_watcher() i=7 2024-09-19T14:11:08.703 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.700+0000 7f4784bd29c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:11:08.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.700+0000 7f4638fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:08.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.700+0000 7f4784bd29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:11:08.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.700+0000 7f4784bd29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:11:08.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.700+0000 7f4784bd29c0 5 note: GC not initialized 2024-09-19T14:11:08.706 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.704+0000 7f45b37fe640 20 reqs_thread_entry: start 2024-09-19T14:11:08.706 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.704+0000 7f4784bd29c0 20 init_complete bucket index max shards: 11 2024-09-19T14:11:08.706 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.704+0000 7f4784bd29c0 20 Filter name: none 2024-09-19T14:11:08.706 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.704+0000 7f45b17fa640 20 reqs_thread_entry: start 2024-09-19T14:11:08.707 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.704+0000 7f4784bd29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.707 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.704+0000 7f4784bd29c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:11:08.707 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.704+0000 7f4784bd29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.704+0000 7f4784bd29c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:11:08.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.704+0000 7f4784bd29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:11:08.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.704+0000 7f4784bd29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.709 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.704+0000 7f4784bd29c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:11:08.709 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.704+0000 7f4784bd29c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:08.710 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.708+0000 7f4784bd29c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:11:08.710 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.708+0000 7f4784bd29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:11:08.713 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.708+0000 7f4638fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:08.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.716+0000 7f4784bd29c0 20 remove_watcher() i=0 2024-09-19T14:11:08.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.716+0000 7f4784bd29c0 2 removed watcher, disabling cache 2024-09-19T14:11:08.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.716+0000 7f4784bd29c0 20 remove_watcher() i=1 2024-09-19T14:11:08.722 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.720+0000 7f4784bd29c0 20 remove_watcher() i=2 2024-09-19T14:11:08.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.720+0000 7f4784bd29c0 20 remove_watcher() i=3 2024-09-19T14:11:08.726 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.724+0000 7f4784bd29c0 20 remove_watcher() i=4 2024-09-19T14:11:08.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.724+0000 7f4784bd29c0 20 remove_watcher() i=5 2024-09-19T14:11:08.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.724+0000 7f4784bd29c0 20 remove_watcher() i=6 2024-09-19T14:11:08.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:08.728+0000 7f4784bd29c0 20 remove_watcher() i=7 2024-09-19T14:11:08.743 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:08.743 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:11:08.744 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: error-at-change-reshard-state id: dbb1da81-49d0-421a-b677-974869a7f103.4620.38 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-19T14:11:08.744 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:08.744 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:08.744 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:08.764 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:08.764 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:09.327 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:09.327 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:09.708 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-19T14:11:09.708 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:09.711 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:09.711 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:09.863 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:09.863 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:09.950 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:09.950 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:10.062 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:10.062 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:10.150 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:10.151 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:10.246 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:10.247 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:10.346 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:10.346 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:10.441 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:10.441 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:10.538 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:10.538 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:10.636 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:10.636 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:10.730 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:10.730 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:10.827 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:10.828 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:10.919 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:10.920 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:11.018 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:11.018 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:11.116 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:11.116 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:11.215 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:11.215 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:11.321 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:11.321 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:11.423 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:11.424 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:11.536 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:11.537 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:11.641 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:11.641 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:11.749 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:11.749 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:11.859 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:11.860 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:11.975 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-19T14:11:12.009 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:11:12.009 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:11:12.061 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.056+0000 7f2a3e88d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.063 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.060+0000 7f2a3e88d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.063 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.060+0000 7f2a3e88d9c0 20 realm 2024-09-19T14:11:12.063 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.060+0000 7f2a3e88d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.063 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.060+0000 7f2a3e88d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.063 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.060+0000 7f2a3e88d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:11:12.063 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.060+0000 7f2a3e88d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.060+0000 7f2a3e88d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.064 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.060+0000 7f2a3e88d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.065 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.060+0000 7f2a3e88d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:12.065 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.060+0000 7f2a3e88d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.065 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.060+0000 7f2a3e88d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:11:12.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.060+0000 7f2a3e88d9c0 20 searching for the correct realm 2024-09-19T14:11:12.072 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.068+0000 7f2a3cb94640 0 -- 172.21.15.153:0/4192748121 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f2a30027040 msgr2=0x7f2a300657f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:12.078 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.076+0000 7f2a3c393640 0 -- 172.21.15.153:0/4192748121 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f2a30070020 msgr2=0x7f2a3006c790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:12.293 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.288+0000 7f2a3e88d9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:11:12.293 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.288+0000 7f2a3e88d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:11:12.293 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.288+0000 7f2a3e88d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:11:12.293 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.288+0000 7f2a3e88d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:11:12.293 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.288+0000 7f2a3e88d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:11:12.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.288+0000 7f2a3e88d9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:11:12.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.288+0000 7f2a3e88d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.288+0000 7f2a3e88d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.288+0000 7f2a3e88d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.292+0000 7f2a3e88d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:12.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.292+0000 7f2a3e88d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.292+0000 7f2a3e88d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:11:12.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.292+0000 7f2a3e88d9c0 20 zone default found 2024-09-19T14:11:12.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.292+0000 7f2a3e88d9c0 4 Realm: () 2024-09-19T14:11:12.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.292+0000 7f2a3e88d9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:11:12.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.292+0000 7f2a3e88d9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:11:12.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.292+0000 7f2a3e88d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:11:12.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.292+0000 7f2a3e88d9c0 20 zonegroup default 2024-09-19T14:11:12.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.292+0000 7f2a3e88d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.292+0000 7f2a3e88d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.292+0000 7f2a3e88d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.292+0000 7f2a3e88d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.292+0000 7f2a3e88d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.292+0000 7f2a3e88d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.292+0000 7f2a3e88d9c0 20 started sync module instance, tier type = 2024-09-19T14:11:12.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.292+0000 7f2a3e88d9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:11:12.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.312+0000 7f2a3e88d9c0 20 add_watcher() i=0 2024-09-19T14:11:12.318 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.312+0000 7f2a3e88d9c0 20 add_watcher() i=1 2024-09-19T14:11:12.318 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.312+0000 7f2a3e88d9c0 20 add_watcher() i=2 2024-09-19T14:11:12.318 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.312+0000 7f2a3e88d9c0 20 add_watcher() i=3 2024-09-19T14:11:12.318 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.312+0000 7f2a3e88d9c0 20 add_watcher() i=4 2024-09-19T14:11:12.318 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.312+0000 7f2a3e88d9c0 20 add_watcher() i=5 2024-09-19T14:11:12.318 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.312+0000 7f2a3e88d9c0 20 add_watcher() i=6 2024-09-19T14:11:12.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.316+0000 7f2a3e88d9c0 20 add_watcher() i=7 2024-09-19T14:11:12.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.316+0000 7f2a3e88d9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:11:12.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.320+0000 7f28f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:12.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.320+0000 7f2a3e88d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:11:12.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.320+0000 7f2a3e88d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:11:12.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.320+0000 7f2a3e88d9c0 5 note: GC not initialized 2024-09-19T14:11:12.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.320+0000 7f28f1fdb640 20 reqs_thread_entry: start 2024-09-19T14:11:12.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.320+0000 7f2a3e88d9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:11:12.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.320+0000 7f2a3e88d9c0 20 Filter name: none 2024-09-19T14:11:12.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.320+0000 7f28637fe640 20 reqs_thread_entry: start 2024-09-19T14:11:12.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.320+0000 7f2a3e88d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.320+0000 7f2a3e88d9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:11:12.324 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.320+0000 7f2a3e88d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.324+0000 7f2a3e88d9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:11:12.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.324+0000 7f2a3e88d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:11:12.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.324+0000 7f2a3e88d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.324+0000 7f2a3e88d9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:11:12.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.324+0000 7f2a3e88d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.324+0000 7f2a3e88d9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:11:12.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.324+0000 7f2a3e88d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:11:12.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.328+0000 7f28f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:12.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.332+0000 7f2a3e88d9c0 20 remove_watcher() i=0 2024-09-19T14:11:12.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.332+0000 7f2a3e88d9c0 2 removed watcher, disabling cache 2024-09-19T14:11:12.337 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.332+0000 7f2a3e88d9c0 20 remove_watcher() i=1 2024-09-19T14:11:12.339 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.336+0000 7f2a3e88d9c0 20 remove_watcher() i=2 2024-09-19T14:11:12.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.336+0000 7f2a3e88d9c0 20 remove_watcher() i=3 2024-09-19T14:11:12.343 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.340+0000 7f2a3e88d9c0 20 remove_watcher() i=4 2024-09-19T14:11:12.345 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.340+0000 7f2a3e88d9c0 20 remove_watcher() i=5 2024-09-19T14:11:12.346 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.344+0000 7f2a3e88d9c0 20 remove_watcher() i=6 2024-09-19T14:11:12.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.344+0000 7f2a3e88d9c0 20 remove_watcher() i=7 2024-09-19T14:11:12.363 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.364 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:11:12.364 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: abort-at-change-reshard-state id: dbb1da81-49d0-421a-b677-974869a7f103.4620.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:11:12.364 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.364 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-19T14:11:12.398 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:11:12.398 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:11:12.447 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 20 realm 2024-09-19T14:11:12.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:11:12.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.450 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.450 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.448+0000 7fa5ef97f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:12.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.448+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.448+0000 7fa5ef97f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:11:12.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.448+0000 7fa5ef97f9c0 20 searching for the correct realm 2024-09-19T14:11:12.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.452+0000 7fa5ed485640 0 -- 172.21.15.153:0/3833316202 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x561b209b2750 msgr2=0x7fa5e807bac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:12.461 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.460+0000 7fa5edc86640 0 -- 172.21.15.153:0/3833316202 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7fa5e4008050 msgr2=0x7fa5e406e4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:11:12.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:11:12.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:11:12.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:11:12.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:11:12.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:11:12.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:11:12.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:12.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:11:12.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 zone default found 2024-09-19T14:11:12.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 4 Realm: () 2024-09-19T14:11:12.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:11:12.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:11:12.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:11:12.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 zonegroup default 2024-09-19T14:11:12.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.477 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.477 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.477 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.477 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 started sync module instance, tier type = 2024-09-19T14:11:12.477 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:11:12.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.488+0000 7fa5ef97f9c0 20 add_watcher() i=0 2024-09-19T14:11:12.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.488+0000 7fa5ef97f9c0 20 add_watcher() i=1 2024-09-19T14:11:12.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.488+0000 7fa5ef97f9c0 20 add_watcher() i=2 2024-09-19T14:11:12.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.488+0000 7fa5ef97f9c0 20 add_watcher() i=3 2024-09-19T14:11:12.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.488+0000 7fa5ef97f9c0 20 add_watcher() i=4 2024-09-19T14:11:12.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.488+0000 7fa5ef97f9c0 20 add_watcher() i=5 2024-09-19T14:11:12.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.488+0000 7fa5ef97f9c0 20 add_watcher() i=6 2024-09-19T14:11:12.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 20 add_watcher() i=7 2024-09-19T14:11:12.495 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:11:12.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.492+0000 7fa4a3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:12.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:11:12.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:11:12.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 5 note: GC not initialized 2024-09-19T14:11:12.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.496+0000 7fa4a2fe5640 20 reqs_thread_entry: start 2024-09-19T14:11:12.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:11:12.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 20 Filter name: none 2024-09-19T14:11:12.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.496+0000 7fa4a0fe1640 20 reqs_thread_entry: start 2024-09-19T14:11:12.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-19T14:11:12.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:11:12.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-19T14:11:12.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-19T14:11:12.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 : miss 2024-09-19T14:11:12.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:11:12.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 info.flags=0x17 2024-09-19T14:11:12.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 to cache LRU end 2024-09-19T14:11:12.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:11:12.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:12.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 2024-09-19T14:11:12.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.508+0000 7fa5ef97f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 info.flags=0x17 2024-09-19T14:11:12.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.508+0000 7fa5ef97f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 to cache LRU end 2024-09-19T14:11:12.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.508+0000 7fa5ef97f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:12.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.508+0000 7fa5ef97f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39, ofs0, ns] 2024-09-19T14:11:12.513 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.508+0000 7fa4d0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333498 cookie 94674513474032 notifier 7953 bl.length()=931 2024-09-19T14:11:12.513 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.508+0000 7fa4d0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 info.flags=0x17 2024-09-19T14:11:12.513 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.508+0000 7fa4d0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 to cache LRU end 2024-09-19T14:11:12.513 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.508+0000 7fa4d0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:12.515 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.512+0000 7fa5ef97f9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.39]): orig_sources= new_sources= 2024-09-19T14:11:12.515 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.512+0000 7fa5ef97f9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.39]): potential sources added=[] removed=[] 2024-09-19T14:11:12.515 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.512+0000 7fa5ef97f9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.39]): orig_dests= new_dests= 2024-09-19T14:11:12.515 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.512+0000 7fa5ef97f9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.39]): potential dests added=[] removed=[] 2024-09-19T14:11:12.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.0 2024-09-19T14:11:12.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.0 2024-09-19T14:11:12.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.1 2024-09-19T14:11:12.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.1 2024-09-19T14:11:12.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.2 2024-09-19T14:11:12.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.2 2024-09-19T14:11:12.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.3 2024-09-19T14:11:12.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.3 2024-09-19T14:11:12.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.4 2024-09-19T14:11:12.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.4 2024-09-19T14:11:12.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.5 2024-09-19T14:11:12.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.5 2024-09-19T14:11:12.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.6 2024-09-19T14:11:12.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.6 2024-09-19T14:11:12.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.7 2024-09-19T14:11:12.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.7 2024-09-19T14:11:12.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.8 2024-09-19T14:11:12.525 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.8 2024-09-19T14:11:12.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.9 2024-09-19T14:11:12.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.9 2024-09-19T14:11:12.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.10 2024-09-19T14:11:12.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.10 2024-09-19T14:11:12.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.11 2024-09-19T14:11:12.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.11 2024-09-19T14:11:12.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.0 2024-09-19T14:11:12.527 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1 2024-09-19T14:11:12.527 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2 2024-09-19T14:11:12.527 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.524+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.3 2024-09-19T14:11:12.528 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.524+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.4 2024-09-19T14:11:12.528 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.524+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.5 2024-09-19T14:11:12.530 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.528+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.6 2024-09-19T14:11:12.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.528+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.7 2024-09-19T14:11:12.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.528+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.8 2024-09-19T14:11:12.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.528+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.9 2024-09-19T14:11:12.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.528+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.10 2024-09-19T14:11:12.539 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa5ef97f9c0 time 2024-09-19T14:11:12.541389+0000 2024-09-19T14:11:12.539 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:11:12.540 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:11:12.541 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa5f32592eb] 2024-09-19T14:11:12.541 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa5f325949f] 2024-09-19T14:11:12.541 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561b1d9c3271] 2024-09-19T14:11:12.541 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x561b1d9d2441] 2024-09-19T14:11:12.541 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561b1d9d3a94] 2024-09-19T14:11:12.541 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:11:12.541 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa5f20bfd90] 2024-09-19T14:11:12.541 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:11:12.541 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:11:12.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.536+0000 7fa5ef97f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa5ef97f9c0 time 2024-09-19T14:11:12.541389+0000 2024-09-19T14:11:12.542 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:11:12.542 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.542 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:11:12.542 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa5f32592eb] 2024-09-19T14:11:12.542 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa5f325949f] 2024-09-19T14:11:12.542 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561b1d9c3271] 2024-09-19T14:11:12.542 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x561b1d9d2441] 2024-09-19T14:11:12.542 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561b1d9d3a94] 2024-09-19T14:11:12.542 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:11:12.543 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa5f20bfd90] 2024-09-19T14:11:12.543 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:11:12.543 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:11:12.543 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.543 INFO:tasks.workunit.client.0.smithi153.stderr:*** Caught signal (Aborted) ** 2024-09-19T14:11:12.543 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7fa5ef97f9c0 thread_name:radosgw-admin 2024-09-19T14:11:12.557 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:11:12.557 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa5f20d8520] 2024-09-19T14:11:12.557 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:11:12.557 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:11:12.557 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:11:12.557 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa5f3259345] 2024-09-19T14:11:12.557 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa5f325949f] 2024-09-19T14:11:12.557 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561b1d9c3271] 2024-09-19T14:11:12.557 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x561b1d9d2441] 2024-09-19T14:11:12.558 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561b1d9d3a94] 2024-09-19T14:11:12.558 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:11:12.558 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa5f20bfd90] 2024-09-19T14:11:12.558 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:11:12.558 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:11:12.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.540+0000 7fa5ef97f9c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:11:12.558 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7fa5ef97f9c0 thread_name:radosgw-admin 2024-09-19T14:11:12.558 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.558 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:11:12.558 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa5f20d8520] 2024-09-19T14:11:12.558 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:11:12.558 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:11:12.559 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:11:12.559 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa5f3259345] 2024-09-19T14:11:12.559 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa5f325949f] 2024-09-19T14:11:12.559 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561b1d9c3271] 2024-09-19T14:11:12.559 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x561b1d9d2441] 2024-09-19T14:11:12.559 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561b1d9d3a94] 2024-09-19T14:11:12.559 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:11:12.559 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa5f20bfd90] 2024-09-19T14:11:12.559 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:11:12.559 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:11:12.559 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:11:12.560 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.560 INFO:tasks.workunit.client.0.smithi153.stderr:--- begin dump of recent events --- 2024-09-19T14:11:12.560 INFO:tasks.workunit.client.0.smithi153.stderr: -499> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 1 librados: setting wanted keys 2024-09-19T14:11:12.560 INFO:tasks.workunit.client.0.smithi153.stderr: -498> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 1 librados: calling monclient init 2024-09-19T14:11:12.560 INFO:tasks.workunit.client.0.smithi153.stderr: -497> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 10 monclient: init 2024-09-19T14:11:12.560 INFO:tasks.workunit.client.0.smithi153.stderr: -496> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding auth protocol: cephx 2024-09-19T14:11:12.560 INFO:tasks.workunit.client.0.smithi153.stderr: -495> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding auth protocol: cephx 2024-09-19T14:11:12.560 INFO:tasks.workunit.client.0.smithi153.stderr: -494> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding auth protocol: cephx 2024-09-19T14:11:12.560 INFO:tasks.workunit.client.0.smithi153.stderr: -493> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding con mode: secure 2024-09-19T14:11:12.560 INFO:tasks.workunit.client.0.smithi153.stderr: -492> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding con mode: crc 2024-09-19T14:11:12.560 INFO:tasks.workunit.client.0.smithi153.stderr: -491> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding con mode: secure 2024-09-19T14:11:12.560 INFO:tasks.workunit.client.0.smithi153.stderr: -490> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding con mode: crc 2024-09-19T14:11:12.561 INFO:tasks.workunit.client.0.smithi153.stderr: -489> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding con mode: secure 2024-09-19T14:11:12.561 INFO:tasks.workunit.client.0.smithi153.stderr: -488> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding con mode: crc 2024-09-19T14:11:12.561 INFO:tasks.workunit.client.0.smithi153.stderr: -487> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding con mode: crc 2024-09-19T14:11:12.561 INFO:tasks.workunit.client.0.smithi153.stderr: -486> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding con mode: secure 2024-09-19T14:11:12.561 INFO:tasks.workunit.client.0.smithi153.stderr: -485> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding con mode: crc 2024-09-19T14:11:12.561 INFO:tasks.workunit.client.0.smithi153.stderr: -484> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding con mode: secure 2024-09-19T14:11:12.561 INFO:tasks.workunit.client.0.smithi153.stderr: -483> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding con mode: crc 2024-09-19T14:11:12.561 INFO:tasks.workunit.client.0.smithi153.stderr: -482> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding con mode: secure 2024-09-19T14:11:12.561 INFO:tasks.workunit.client.0.smithi153.stderr: -481> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:12.561 INFO:tasks.workunit.client.0.smithi153.stderr: -480> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:12.561 INFO:tasks.workunit.client.0.smithi153.stderr: -479> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command rotate-key hook 0x561b20af3718 2024-09-19T14:11:12.561 INFO:tasks.workunit.client.0.smithi153.stderr: -478> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient: _reopen_session rank -1 2024-09-19T14:11:12.561 INFO:tasks.workunit.client.0.smithi153.stderr: -477> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T14:11:12.561 INFO:tasks.workunit.client.0.smithi153.stderr: -476> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient(hunting): picked mon.noname-a con 0x561b20af6c40 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:11:12.562 INFO:tasks.workunit.client.0.smithi153.stderr: -475> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient(hunting): picked mon.noname-c con 0x561b20af9de0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:11:12.562 INFO:tasks.workunit.client.0.smithi153.stderr: -474> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient(hunting): picked mon.noname-b con 0x7fa5d80023c0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:11:12.562 INFO:tasks.workunit.client.0.smithi153.stderr: -473> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:12.562 INFO:tasks.workunit.client.0.smithi153.stderr: -472> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:12.562 INFO:tasks.workunit.client.0.smithi153.stderr: -471> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:12.562 INFO:tasks.workunit.client.0.smithi153.stderr: -470> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient(hunting): _renew_subs 2024-09-19T14:11:12.562 INFO:tasks.workunit.client.0.smithi153.stderr: -469> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient(hunting): authenticate will time out at 2860.888462s 2024-09-19T14:11:12.562 INFO:tasks.workunit.client.0.smithi153.stderr: -468> 2024-09-19T14:11:12.424+0000 7fa5ed485640 10 monclient(hunting): get_auth_request con 0x561b20af6c40 auth_method 0 2024-09-19T14:11:12.562 INFO:tasks.workunit.client.0.smithi153.stderr: -467> 2024-09-19T14:11:12.424+0000 7fa5ed485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:12.562 INFO:tasks.workunit.client.0.smithi153.stderr: -466> 2024-09-19T14:11:12.424+0000 7fa5ed485640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:12.562 INFO:tasks.workunit.client.0.smithi153.stderr: -465> 2024-09-19T14:11:12.424+0000 7fa5ed485640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:12.562 INFO:tasks.workunit.client.0.smithi153.stderr: -464> 2024-09-19T14:11:12.424+0000 7fa5ecc84640 10 monclient(hunting): get_auth_request con 0x561b20af9de0 auth_method 0 2024-09-19T14:11:12.562 INFO:tasks.workunit.client.0.smithi153.stderr: -463> 2024-09-19T14:11:12.424+0000 7fa5ecc84640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:12.562 INFO:tasks.workunit.client.0.smithi153.stderr: -462> 2024-09-19T14:11:12.424+0000 7fa5ecc84640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:12.563 INFO:tasks.workunit.client.0.smithi153.stderr: -461> 2024-09-19T14:11:12.424+0000 7fa5ecc84640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:12.563 INFO:tasks.workunit.client.0.smithi153.stderr: -460> 2024-09-19T14:11:12.424+0000 7fa5ed485640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:12.563 INFO:tasks.workunit.client.0.smithi153.stderr: -459> 2024-09-19T14:11:12.424+0000 7fa5ed485640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:12.563 INFO:tasks.workunit.client.0.smithi153.stderr: -458> 2024-09-19T14:11:12.424+0000 7fa5ed485640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:12.563 INFO:tasks.workunit.client.0.smithi153.stderr: -457> 2024-09-19T14:11:12.424+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:12.563 INFO:tasks.workunit.client.0.smithi153.stderr: -456> 2024-09-19T14:11:12.424+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:12.563 INFO:tasks.workunit.client.0.smithi153.stderr: -455> 2024-09-19T14:11:12.424+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:12.563 INFO:tasks.workunit.client.0.smithi153.stderr: -454> 2024-09-19T14:11:12.424+0000 7fa5ed485640 10 monclient(hunting): handle_auth_done global_id 7944 payload 824 2024-09-19T14:11:12.563 INFO:tasks.workunit.client.0.smithi153.stderr: -453> 2024-09-19T14:11:12.424+0000 7fa5ed485640 10 monclient: _finish_hunting 0 2024-09-19T14:11:12.563 INFO:tasks.workunit.client.0.smithi153.stderr: -452> 2024-09-19T14:11:12.424+0000 7fa5ed485640 1 monclient: found mon.noname-a 2024-09-19T14:11:12.563 INFO:tasks.workunit.client.0.smithi153.stderr: -451> 2024-09-19T14:11:12.424+0000 7fa5ed485640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:11:12.564 INFO:tasks.workunit.client.0.smithi153.stderr: -450> 2024-09-19T14:11:12.424+0000 7fa4d9e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:12.564 INFO:tasks.workunit.client.0.smithi153.stderr: -449> 2024-09-19T14:11:12.424+0000 7fa4d9e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:11:12.564 INFO:tasks.workunit.client.0.smithi153.stderr: -448> 2024-09-19T14:11:12.424+0000 7fa4d9e03640 10 monclient: dump: 2024-09-19T14:11:12.564 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:12.564 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:12.564 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.564 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.564 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:12.564 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:12.564 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:12.564 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:12.564 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:12.564 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.564 INFO:tasks.workunit.client.0.smithi153.stderr: -447> 2024-09-19T14:11:12.424+0000 7fa4d9e03640 10 monclient: _finish_auth 0 2024-09-19T14:11:12.565 INFO:tasks.workunit.client.0.smithi153.stderr: -446> 2024-09-19T14:11:12.424+0000 7fa4d9e03640 10 monclient: _check_auth_tickets 2024-09-19T14:11:12.565 INFO:tasks.workunit.client.0.smithi153.stderr: -445> 2024-09-19T14:11:12.424+0000 7fa4d9e03640 10 monclient: handle_config config(0 keys) 2024-09-19T14:11:12.565 INFO:tasks.workunit.client.0.smithi153.stderr: -444> 2024-09-19T14:11:12.424+0000 7fa4d9e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:12.565 INFO:tasks.workunit.client.0.smithi153.stderr: -443> 2024-09-19T14:11:12.424+0000 7fa4d9e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:11:12.565 INFO:tasks.workunit.client.0.smithi153.stderr: -442> 2024-09-19T14:11:12.424+0000 7fa4d9e03640 10 monclient: dump: 2024-09-19T14:11:12.565 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:12.565 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:12.565 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.565 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.565 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:12.565 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:12.565 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:12.565 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:12.566 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:12.566 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.566 INFO:tasks.workunit.client.0.smithi153.stderr: -441> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 5 monclient: authenticate success, global_id 7944 2024-09-19T14:11:12.566 INFO:tasks.workunit.client.0.smithi153.stderr: -440> 2024-09-19T14:11:12.424+0000 7fa4db606640 4 set_mon_vals no callback set 2024-09-19T14:11:12.566 INFO:tasks.workunit.client.0.smithi153.stderr: -439> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient: _renew_subs 2024-09-19T14:11:12.566 INFO:tasks.workunit.client.0.smithi153.stderr: -438> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:11:12.566 INFO:tasks.workunit.client.0.smithi153.stderr: -437> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient: _renew_subs 2024-09-19T14:11:12.566 INFO:tasks.workunit.client.0.smithi153.stderr: -436> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:11:12.566 INFO:tasks.workunit.client.0.smithi153.stderr: -435> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 1 librados: init done 2024-09-19T14:11:12.566 INFO:tasks.workunit.client.0.smithi153.stderr: -434> 2024-09-19T14:11:12.424+0000 7fa4d9e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:11:12.566 INFO:tasks.workunit.client.0.smithi153.stderr: -433> 2024-09-19T14:11:12.424+0000 7fa4d9e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:11:12.566 INFO:tasks.workunit.client.0.smithi153.stderr: -432> 2024-09-19T14:11:12.424+0000 7fa4d9e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:11:12.566 INFO:tasks.workunit.client.0.smithi153.stderr: -431> 2024-09-19T14:11:12.424+0000 7fa5ecc84640 10 monclient: get_auth_request con 0x7fa4d4071be0 auth_method 0 2024-09-19T14:11:12.567 INFO:tasks.workunit.client.0.smithi153.stderr: -430> 2024-09-19T14:11:12.424+0000 7fa5edc86640 10 monclient: get_auth_request con 0x561b20b33640 auth_method 0 2024-09-19T14:11:12.567 INFO:tasks.workunit.client.0.smithi153.stderr: -429> 2024-09-19T14:11:12.428+0000 7fa5ed485640 10 monclient: get_auth_request con 0x561b20b3ca70 auth_method 0 2024-09-19T14:11:12.567 INFO:tasks.workunit.client.0.smithi153.stderr: -428> 2024-09-19T14:11:12.428+0000 7fa5ecc84640 10 monclient: get_auth_request con 0x561b20b41b00 auth_method 0 2024-09-19T14:11:12.567 INFO:tasks.workunit.client.0.smithi153.stderr: -427> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient: build_initial_monmap 2024-09-19T14:11:12.567 INFO:tasks.workunit.client.0.smithi153.stderr: -426> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 1 build_initial for_mkfs: 0 2024-09-19T14:11:12.567 INFO:tasks.workunit.client.0.smithi153.stderr: -425> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient: monmap: 2024-09-19T14:11:12.567 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:11:12.567 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:11:12.567 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:11:12.567 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:11:12.567 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:11:12.567 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:12.567 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:11:12.568 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:11:12.568 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:11:12.568 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.568 INFO:tasks.workunit.client.0.smithi153.stderr: -424> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding auth protocol: cephx 2024-09-19T14:11:12.568 INFO:tasks.workunit.client.0.smithi153.stderr: -423> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding auth protocol: cephx 2024-09-19T14:11:12.568 INFO:tasks.workunit.client.0.smithi153.stderr: -422> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding auth protocol: cephx 2024-09-19T14:11:12.568 INFO:tasks.workunit.client.0.smithi153.stderr: -421> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding con mode: secure 2024-09-19T14:11:12.568 INFO:tasks.workunit.client.0.smithi153.stderr: -420> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding con mode: crc 2024-09-19T14:11:12.568 INFO:tasks.workunit.client.0.smithi153.stderr: -419> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding con mode: secure 2024-09-19T14:11:12.568 INFO:tasks.workunit.client.0.smithi153.stderr: -418> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding con mode: crc 2024-09-19T14:11:12.568 INFO:tasks.workunit.client.0.smithi153.stderr: -417> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding con mode: secure 2024-09-19T14:11:12.568 INFO:tasks.workunit.client.0.smithi153.stderr: -416> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding con mode: crc 2024-09-19T14:11:12.568 INFO:tasks.workunit.client.0.smithi153.stderr: -415> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding con mode: crc 2024-09-19T14:11:12.568 INFO:tasks.workunit.client.0.smithi153.stderr: -414> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding con mode: secure 2024-09-19T14:11:12.569 INFO:tasks.workunit.client.0.smithi153.stderr: -413> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding con mode: crc 2024-09-19T14:11:12.569 INFO:tasks.workunit.client.0.smithi153.stderr: -412> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding con mode: secure 2024-09-19T14:11:12.569 INFO:tasks.workunit.client.0.smithi153.stderr: -411> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding con mode: crc 2024-09-19T14:11:12.569 INFO:tasks.workunit.client.0.smithi153.stderr: -410> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding con mode: secure 2024-09-19T14:11:12.569 INFO:tasks.workunit.client.0.smithi153.stderr: -409> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:12.569 INFO:tasks.workunit.client.0.smithi153.stderr: -408> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command objecter_requests cmddesc objecter_requests hook 0x561b20b49310 EEXIST 2024-09-19T14:11:12.569 INFO:tasks.workunit.client.0.smithi153.stderr: -407> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient: init 2024-09-19T14:11:12.569 INFO:tasks.workunit.client.0.smithi153.stderr: -406> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding auth protocol: cephx 2024-09-19T14:11:12.569 INFO:tasks.workunit.client.0.smithi153.stderr: -405> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding auth protocol: cephx 2024-09-19T14:11:12.569 INFO:tasks.workunit.client.0.smithi153.stderr: -404> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding auth protocol: cephx 2024-09-19T14:11:12.569 INFO:tasks.workunit.client.0.smithi153.stderr: -403> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding con mode: secure 2024-09-19T14:11:12.569 INFO:tasks.workunit.client.0.smithi153.stderr: -402> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding con mode: crc 2024-09-19T14:11:12.569 INFO:tasks.workunit.client.0.smithi153.stderr: -401> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding con mode: secure 2024-09-19T14:11:12.570 INFO:tasks.workunit.client.0.smithi153.stderr: -400> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding con mode: crc 2024-09-19T14:11:12.570 INFO:tasks.workunit.client.0.smithi153.stderr: -399> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding con mode: secure 2024-09-19T14:11:12.570 INFO:tasks.workunit.client.0.smithi153.stderr: -398> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding con mode: crc 2024-09-19T14:11:12.570 INFO:tasks.workunit.client.0.smithi153.stderr: -397> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding con mode: crc 2024-09-19T14:11:12.570 INFO:tasks.workunit.client.0.smithi153.stderr: -396> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding con mode: secure 2024-09-19T14:11:12.570 INFO:tasks.workunit.client.0.smithi153.stderr: -395> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding con mode: crc 2024-09-19T14:11:12.570 INFO:tasks.workunit.client.0.smithi153.stderr: -394> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding con mode: secure 2024-09-19T14:11:12.570 INFO:tasks.workunit.client.0.smithi153.stderr: -393> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding con mode: crc 2024-09-19T14:11:12.570 INFO:tasks.workunit.client.0.smithi153.stderr: -392> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding con mode: secure 2024-09-19T14:11:12.570 INFO:tasks.workunit.client.0.smithi153.stderr: -391> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:12.570 INFO:tasks.workunit.client.0.smithi153.stderr: -390> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:12.570 INFO:tasks.workunit.client.0.smithi153.stderr: -389> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command rotate-key cmddesc rotate-key hook 0x561b20b44af0 EEXIST 2024-09-19T14:11:12.571 INFO:tasks.workunit.client.0.smithi153.stderr: -388> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient: _reopen_session rank -1 2024-09-19T14:11:12.571 INFO:tasks.workunit.client.0.smithi153.stderr: -387> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:11:12.571 INFO:tasks.workunit.client.0.smithi153.stderr: -386> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient(hunting): picked mon.noname-b con 0x561b20b6d4c0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:11:12.571 INFO:tasks.workunit.client.0.smithi153.stderr: -385> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient(hunting): picked mon.noname-a con 0x561b20b6cdf0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:11:12.571 INFO:tasks.workunit.client.0.smithi153.stderr: -384> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient(hunting): picked mon.noname-c con 0x561b20b6b7d0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:11:12.571 INFO:tasks.workunit.client.0.smithi153.stderr: -383> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:12.571 INFO:tasks.workunit.client.0.smithi153.stderr: -382> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:12.571 INFO:tasks.workunit.client.0.smithi153.stderr: -381> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:12.571 INFO:tasks.workunit.client.0.smithi153.stderr: -380> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient(hunting): _renew_subs 2024-09-19T14:11:12.571 INFO:tasks.workunit.client.0.smithi153.stderr: -379> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient(hunting): authenticate will time out at 2860.898208s 2024-09-19T14:11:12.571 INFO:tasks.workunit.client.0.smithi153.stderr: -378> 2024-09-19T14:11:12.432+0000 7fa5edc86640 10 monclient(hunting): get_auth_request con 0x561b20b6b7d0 auth_method 0 2024-09-19T14:11:12.571 INFO:tasks.workunit.client.0.smithi153.stderr: -377> 2024-09-19T14:11:12.432+0000 7fa5edc86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:12.572 INFO:tasks.workunit.client.0.smithi153.stderr: -376> 2024-09-19T14:11:12.432+0000 7fa5edc86640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:12.572 INFO:tasks.workunit.client.0.smithi153.stderr: -375> 2024-09-19T14:11:12.432+0000 7fa5edc86640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:12.572 INFO:tasks.workunit.client.0.smithi153.stderr: -374> 2024-09-19T14:11:12.432+0000 7fa5ecc84640 10 monclient(hunting): get_auth_request con 0x561b20b6cdf0 auth_method 0 2024-09-19T14:11:12.572 INFO:tasks.workunit.client.0.smithi153.stderr: -373> 2024-09-19T14:11:12.432+0000 7fa5ecc84640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:12.572 INFO:tasks.workunit.client.0.smithi153.stderr: -372> 2024-09-19T14:11:12.432+0000 7fa5ecc84640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:12.572 INFO:tasks.workunit.client.0.smithi153.stderr: -371> 2024-09-19T14:11:12.432+0000 7fa5ecc84640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:12.572 INFO:tasks.workunit.client.0.smithi153.stderr: -370> 2024-09-19T14:11:12.432+0000 7fa5edc86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:12.572 INFO:tasks.workunit.client.0.smithi153.stderr: -369> 2024-09-19T14:11:12.432+0000 7fa5edc86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:12.573 INFO:tasks.workunit.client.0.smithi153.stderr: -368> 2024-09-19T14:11:12.432+0000 7fa5edc86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:12.573 INFO:tasks.workunit.client.0.smithi153.stderr: -367> 2024-09-19T14:11:12.432+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:12.573 INFO:tasks.workunit.client.0.smithi153.stderr: -366> 2024-09-19T14:11:12.432+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:12.573 INFO:tasks.workunit.client.0.smithi153.stderr: -365> 2024-09-19T14:11:12.432+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:12.573 INFO:tasks.workunit.client.0.smithi153.stderr: -364> 2024-09-19T14:11:12.432+0000 7fa5ed485640 10 monclient(hunting): get_auth_request con 0x561b20b6d4c0 auth_method 0 2024-09-19T14:11:12.573 INFO:tasks.workunit.client.0.smithi153.stderr: -363> 2024-09-19T14:11:12.432+0000 7fa5ed485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:12.573 INFO:tasks.workunit.client.0.smithi153.stderr: -362> 2024-09-19T14:11:12.432+0000 7fa5ed485640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:12.573 INFO:tasks.workunit.client.0.smithi153.stderr: -361> 2024-09-19T14:11:12.432+0000 7fa5ed485640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:12.573 INFO:tasks.workunit.client.0.smithi153.stderr: -360> 2024-09-19T14:11:12.432+0000 7fa5edc86640 10 monclient(hunting): handle_auth_done global_id 7430 payload 824 2024-09-19T14:11:12.573 INFO:tasks.workunit.client.0.smithi153.stderr: -359> 2024-09-19T14:11:12.432+0000 7fa5edc86640 10 monclient: _finish_hunting 0 2024-09-19T14:11:12.573 INFO:tasks.workunit.client.0.smithi153.stderr: -358> 2024-09-19T14:11:12.432+0000 7fa5edc86640 1 monclient: found mon.noname-c 2024-09-19T14:11:12.573 INFO:tasks.workunit.client.0.smithi153.stderr: -357> 2024-09-19T14:11:12.432+0000 7fa5edc86640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:11:12.574 INFO:tasks.workunit.client.0.smithi153.stderr: -356> 2024-09-19T14:11:12.432+0000 7fa4d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:12.574 INFO:tasks.workunit.client.0.smithi153.stderr: -355> 2024-09-19T14:11:12.432+0000 7fa4d2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:11:12.574 INFO:tasks.workunit.client.0.smithi153.stderr: -354> 2024-09-19T14:11:12.432+0000 7fa4d2ffd640 10 monclient: dump: 2024-09-19T14:11:12.574 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:12.574 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:12.574 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.574 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.574 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:12.574 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:12.574 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:12.574 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:12.574 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:12.574 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.575 INFO:tasks.workunit.client.0.smithi153.stderr: -353> 2024-09-19T14:11:12.432+0000 7fa4d2ffd640 10 monclient: _finish_auth 0 2024-09-19T14:11:12.575 INFO:tasks.workunit.client.0.smithi153.stderr: -352> 2024-09-19T14:11:12.432+0000 7fa4d2ffd640 10 monclient: _check_auth_tickets 2024-09-19T14:11:12.575 INFO:tasks.workunit.client.0.smithi153.stderr: -351> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 monclient: authenticate success, global_id 7430 2024-09-19T14:11:12.575 INFO:tasks.workunit.client.0.smithi153.stderr: -350> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient: _renew_subs 2024-09-19T14:11:12.575 INFO:tasks.workunit.client.0.smithi153.stderr: -349> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:11:12.575 INFO:tasks.workunit.client.0.smithi153.stderr: -348> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient: _renew_subs 2024-09-19T14:11:12.575 INFO:tasks.workunit.client.0.smithi153.stderr: -347> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:11:12.575 INFO:tasks.workunit.client.0.smithi153.stderr: -346> 2024-09-19T14:11:12.432+0000 7fa4d2ffd640 10 monclient: handle_config config(0 keys) 2024-09-19T14:11:12.575 INFO:tasks.workunit.client.0.smithi153.stderr: -345> 2024-09-19T14:11:12.432+0000 7fa4d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:12.575 INFO:tasks.workunit.client.0.smithi153.stderr: -344> 2024-09-19T14:11:12.432+0000 7fa4d2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:11:12.575 INFO:tasks.workunit.client.0.smithi153.stderr: -343> 2024-09-19T14:11:12.432+0000 7fa4d2ffd640 10 monclient: dump: 2024-09-19T14:11:12.575 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:12.575 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:12.576 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.576 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.576 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:12.576 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:12.576 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:12.576 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:12.576 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:12.576 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.576 INFO:tasks.workunit.client.0.smithi153.stderr: -342> 2024-09-19T14:11:12.432+0000 7fa5ee487640 4 set_mon_vals no callback set 2024-09-19T14:11:12.576 INFO:tasks.workunit.client.0.smithi153.stderr: -341> 2024-09-19T14:11:12.436+0000 7fa4d2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:11:12.576 INFO:tasks.workunit.client.0.smithi153.stderr: -340> 2024-09-19T14:11:12.436+0000 7fa4d2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:11:12.576 INFO:tasks.workunit.client.0.smithi153.stderr: -339> 2024-09-19T14:11:12.436+0000 7fa4d2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:11:12.576 INFO:tasks.workunit.client.0.smithi153.stderr: -338> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient: get_monmap_and_config 2024-09-19T14:11:12.577 INFO:tasks.workunit.client.0.smithi153.stderr: -337> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient: build_initial_monmap 2024-09-19T14:11:12.577 INFO:tasks.workunit.client.0.smithi153.stderr: -336> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 1 build_initial for_mkfs: 0 2024-09-19T14:11:12.577 INFO:tasks.workunit.client.0.smithi153.stderr: -335> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient: monmap: 2024-09-19T14:11:12.577 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:11:12.577 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:11:12.577 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:11:12.577 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:11:12.577 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:11:12.577 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:12.577 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:11:12.577 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:11:12.578 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:11:12.578 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.578 INFO:tasks.workunit.client.0.smithi153.stderr: -334> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding auth protocol: cephx 2024-09-19T14:11:12.578 INFO:tasks.workunit.client.0.smithi153.stderr: -333> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding auth protocol: cephx 2024-09-19T14:11:12.578 INFO:tasks.workunit.client.0.smithi153.stderr: -332> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding auth protocol: cephx 2024-09-19T14:11:12.578 INFO:tasks.workunit.client.0.smithi153.stderr: -331> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding con mode: secure 2024-09-19T14:11:12.578 INFO:tasks.workunit.client.0.smithi153.stderr: -330> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding con mode: crc 2024-09-19T14:11:12.578 INFO:tasks.workunit.client.0.smithi153.stderr: -329> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding con mode: secure 2024-09-19T14:11:12.578 INFO:tasks.workunit.client.0.smithi153.stderr: -328> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding con mode: crc 2024-09-19T14:11:12.578 INFO:tasks.workunit.client.0.smithi153.stderr: -327> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding con mode: secure 2024-09-19T14:11:12.578 INFO:tasks.workunit.client.0.smithi153.stderr: -326> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding con mode: crc 2024-09-19T14:11:12.578 INFO:tasks.workunit.client.0.smithi153.stderr: -325> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding con mode: crc 2024-09-19T14:11:12.578 INFO:tasks.workunit.client.0.smithi153.stderr: -324> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding con mode: secure 2024-09-19T14:11:12.579 INFO:tasks.workunit.client.0.smithi153.stderr: -323> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding con mode: crc 2024-09-19T14:11:12.579 INFO:tasks.workunit.client.0.smithi153.stderr: -322> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding con mode: secure 2024-09-19T14:11:12.579 INFO:tasks.workunit.client.0.smithi153.stderr: -321> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding con mode: crc 2024-09-19T14:11:12.579 INFO:tasks.workunit.client.0.smithi153.stderr: -320> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding con mode: secure 2024-09-19T14:11:12.579 INFO:tasks.workunit.client.0.smithi153.stderr: -319> 2024-09-19T14:11:12.436+0000 7fa5ed485640 10 monclient: get_auth_request con 0x7fa4c8071b20 auth_method 0 2024-09-19T14:11:12.579 INFO:tasks.workunit.client.0.smithi153.stderr: -318> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:12.579 INFO:tasks.workunit.client.0.smithi153.stderr: -317> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient: init 2024-09-19T14:11:12.579 INFO:tasks.workunit.client.0.smithi153.stderr: -316> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding auth protocol: cephx 2024-09-19T14:11:12.579 INFO:tasks.workunit.client.0.smithi153.stderr: -315> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding auth protocol: cephx 2024-09-19T14:11:12.580 INFO:tasks.workunit.client.0.smithi153.stderr: -314> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding auth protocol: cephx 2024-09-19T14:11:12.580 INFO:tasks.workunit.client.0.smithi153.stderr: -313> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding con mode: secure 2024-09-19T14:11:12.580 INFO:tasks.workunit.client.0.smithi153.stderr: -312> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding con mode: crc 2024-09-19T14:11:12.580 INFO:tasks.workunit.client.0.smithi153.stderr: -311> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding con mode: secure 2024-09-19T14:11:12.580 INFO:tasks.workunit.client.0.smithi153.stderr: -310> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding con mode: crc 2024-09-19T14:11:12.580 INFO:tasks.workunit.client.0.smithi153.stderr: -309> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding con mode: secure 2024-09-19T14:11:12.580 INFO:tasks.workunit.client.0.smithi153.stderr: -308> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding con mode: crc 2024-09-19T14:11:12.580 INFO:tasks.workunit.client.0.smithi153.stderr: -307> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding con mode: crc 2024-09-19T14:11:12.580 INFO:tasks.workunit.client.0.smithi153.stderr: -306> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding con mode: secure 2024-09-19T14:11:12.580 INFO:tasks.workunit.client.0.smithi153.stderr: -305> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding con mode: crc 2024-09-19T14:11:12.580 INFO:tasks.workunit.client.0.smithi153.stderr: -304> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding con mode: secure 2024-09-19T14:11:12.580 INFO:tasks.workunit.client.0.smithi153.stderr: -303> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding con mode: crc 2024-09-19T14:11:12.580 INFO:tasks.workunit.client.0.smithi153.stderr: -302> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding con mode: secure 2024-09-19T14:11:12.581 INFO:tasks.workunit.client.0.smithi153.stderr: -301> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:12.581 INFO:tasks.workunit.client.0.smithi153.stderr: -300> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:12.581 INFO:tasks.workunit.client.0.smithi153.stderr: -299> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command rotate-key cmddesc rotate-key hook 0x7ffee17f15f8 EEXIST 2024-09-19T14:11:12.581 INFO:tasks.workunit.client.0.smithi153.stderr: -298> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient: _reopen_session rank -1 2024-09-19T14:11:12.581 INFO:tasks.workunit.client.0.smithi153.stderr: -297> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T14:11:12.581 INFO:tasks.workunit.client.0.smithi153.stderr: -296> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient(hunting): picked mon.noname-b con 0x561b20bc12a0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:11:12.581 INFO:tasks.workunit.client.0.smithi153.stderr: -295> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient(hunting): picked mon.noname-c con 0x561b20b911c0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:11:12.581 INFO:tasks.workunit.client.0.smithi153.stderr: -294> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient(hunting): picked mon.noname-a con 0x561b20b92280 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:11:12.581 INFO:tasks.workunit.client.0.smithi153.stderr: -293> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:12.581 INFO:tasks.workunit.client.0.smithi153.stderr: -292> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:12.581 INFO:tasks.workunit.client.0.smithi153.stderr: -291> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:12.581 INFO:tasks.workunit.client.0.smithi153.stderr: -290> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient(hunting): _renew_subs 2024-09-19T14:11:12.582 INFO:tasks.workunit.client.0.smithi153.stderr: -289> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient(hunting): authenticate will time out at 2860.903234s 2024-09-19T14:11:12.582 INFO:tasks.workunit.client.0.smithi153.stderr: -288> 2024-09-19T14:11:12.436+0000 7fa5ecc84640 10 monclient(hunting): get_auth_request con 0x561b20b911c0 auth_method 0 2024-09-19T14:11:12.582 INFO:tasks.workunit.client.0.smithi153.stderr: -287> 2024-09-19T14:11:12.436+0000 7fa5ecc84640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:12.582 INFO:tasks.workunit.client.0.smithi153.stderr: -286> 2024-09-19T14:11:12.436+0000 7fa5ecc84640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:12.582 INFO:tasks.workunit.client.0.smithi153.stderr: -285> 2024-09-19T14:11:12.436+0000 7fa5ecc84640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:12.582 INFO:tasks.workunit.client.0.smithi153.stderr: -284> 2024-09-19T14:11:12.436+0000 7fa5edc86640 10 monclient(hunting): get_auth_request con 0x561b20b92280 auth_method 0 2024-09-19T14:11:12.582 INFO:tasks.workunit.client.0.smithi153.stderr: -283> 2024-09-19T14:11:12.436+0000 7fa5edc86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:12.582 INFO:tasks.workunit.client.0.smithi153.stderr: -282> 2024-09-19T14:11:12.436+0000 7fa5edc86640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:12.582 INFO:tasks.workunit.client.0.smithi153.stderr: -281> 2024-09-19T14:11:12.436+0000 7fa5edc86640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:12.582 INFO:tasks.workunit.client.0.smithi153.stderr: -280> 2024-09-19T14:11:12.436+0000 7fa5edc86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:12.582 INFO:tasks.workunit.client.0.smithi153.stderr: -279> 2024-09-19T14:11:12.436+0000 7fa5edc86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:12.582 INFO:tasks.workunit.client.0.smithi153.stderr: -278> 2024-09-19T14:11:12.436+0000 7fa5edc86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:12.582 INFO:tasks.workunit.client.0.smithi153.stderr: -277> 2024-09-19T14:11:12.436+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:12.582 INFO:tasks.workunit.client.0.smithi153.stderr: -276> 2024-09-19T14:11:12.436+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:12.582 INFO:tasks.workunit.client.0.smithi153.stderr: -275> 2024-09-19T14:11:12.436+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:12.583 INFO:tasks.workunit.client.0.smithi153.stderr: -274> 2024-09-19T14:11:12.436+0000 7fa5ed485640 10 monclient(hunting): get_auth_request con 0x561b20bc12a0 auth_method 0 2024-09-19T14:11:12.583 INFO:tasks.workunit.client.0.smithi153.stderr: -273> 2024-09-19T14:11:12.436+0000 7fa5ed485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:12.583 INFO:tasks.workunit.client.0.smithi153.stderr: -272> 2024-09-19T14:11:12.436+0000 7fa5ed485640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:12.583 INFO:tasks.workunit.client.0.smithi153.stderr: -271> 2024-09-19T14:11:12.436+0000 7fa5ed485640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:12.583 INFO:tasks.workunit.client.0.smithi153.stderr: -270> 2024-09-19T14:11:12.436+0000 7fa5edc86640 10 monclient(hunting): handle_auth_done global_id 7950 payload 274 2024-09-19T14:11:12.583 INFO:tasks.workunit.client.0.smithi153.stderr: -269> 2024-09-19T14:11:12.436+0000 7fa5edc86640 10 monclient: _finish_hunting 0 2024-09-19T14:11:12.583 INFO:tasks.workunit.client.0.smithi153.stderr: -268> 2024-09-19T14:11:12.436+0000 7fa5edc86640 1 monclient: found mon.noname-a 2024-09-19T14:11:12.583 INFO:tasks.workunit.client.0.smithi153.stderr: -267> 2024-09-19T14:11:12.436+0000 7fa5edc86640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:11:12.583 INFO:tasks.workunit.client.0.smithi153.stderr: -266> 2024-09-19T14:11:12.436+0000 7fa4d0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:12.583 INFO:tasks.workunit.client.0.smithi153.stderr: -265> 2024-09-19T14:11:12.440+0000 7fa4d0ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:11:12.583 INFO:tasks.workunit.client.0.smithi153.stderr: -264> 2024-09-19T14:11:12.440+0000 7fa4d0ff9640 10 monclient: dump: 2024-09-19T14:11:12.583 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:12.583 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:12.584 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.584 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.584 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:12.584 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:12.584 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:12.584 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:12.584 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:12.584 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.584 INFO:tasks.workunit.client.0.smithi153.stderr: -263> 2024-09-19T14:11:12.440+0000 7fa4d0ff9640 10 monclient: _finish_auth 0 2024-09-19T14:11:12.584 INFO:tasks.workunit.client.0.smithi153.stderr: -262> 2024-09-19T14:11:12.440+0000 7fa4d0ff9640 10 monclient: _check_auth_tickets 2024-09-19T14:11:12.584 INFO:tasks.workunit.client.0.smithi153.stderr: -261> 2024-09-19T14:11:12.440+0000 7fa4d0ff9640 10 monclient: handle_config config(0 keys) 2024-09-19T14:11:12.584 INFO:tasks.workunit.client.0.smithi153.stderr: -260> 2024-09-19T14:11:12.440+0000 7fa4d0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:12.584 INFO:tasks.workunit.client.0.smithi153.stderr: -259> 2024-09-19T14:11:12.440+0000 7fa4d0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:11:12.584 INFO:tasks.workunit.client.0.smithi153.stderr: -258> 2024-09-19T14:11:12.440+0000 7fa4d0ff9640 10 monclient: dump: 2024-09-19T14:11:12.585 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:12.585 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:12.585 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.585 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.585 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:12.585 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:12.585 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:12.585 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:12.585 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:12.585 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.585 INFO:tasks.workunit.client.0.smithi153.stderr: -257> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 monclient: authenticate success, global_id 7950 2024-09-19T14:11:12.585 INFO:tasks.workunit.client.0.smithi153.stderr: -256> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient: get_monmap_and_config success 2024-09-19T14:11:12.585 INFO:tasks.workunit.client.0.smithi153.stderr: -255> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 4 set_mon_vals no callback set 2024-09-19T14:11:12.585 INFO:tasks.workunit.client.0.smithi153.stderr: -254> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient: shutdown 2024-09-19T14:11:12.586 INFO:tasks.workunit.client.0.smithi153.stderr: -253> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient: build_initial_monmap 2024-09-19T14:11:12.586 INFO:tasks.workunit.client.0.smithi153.stderr: -252> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 1 build_initial for_mkfs: 0 2024-09-19T14:11:12.586 INFO:tasks.workunit.client.0.smithi153.stderr: -251> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient: monmap: 2024-09-19T14:11:12.586 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:11:12.586 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:11:12.586 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:11:12.586 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:11:12.586 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:11:12.586 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:12.586 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:11:12.586 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:11:12.586 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:11:12.586 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.586 INFO:tasks.workunit.client.0.smithi153.stderr: -250> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding auth protocol: cephx 2024-09-19T14:11:12.587 INFO:tasks.workunit.client.0.smithi153.stderr: -249> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding auth protocol: cephx 2024-09-19T14:11:12.587 INFO:tasks.workunit.client.0.smithi153.stderr: -248> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding auth protocol: cephx 2024-09-19T14:11:12.587 INFO:tasks.workunit.client.0.smithi153.stderr: -247> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding con mode: secure 2024-09-19T14:11:12.587 INFO:tasks.workunit.client.0.smithi153.stderr: -246> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding con mode: crc 2024-09-19T14:11:12.587 INFO:tasks.workunit.client.0.smithi153.stderr: -245> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding con mode: secure 2024-09-19T14:11:12.587 INFO:tasks.workunit.client.0.smithi153.stderr: -244> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding con mode: crc 2024-09-19T14:11:12.587 INFO:tasks.workunit.client.0.smithi153.stderr: -243> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding con mode: secure 2024-09-19T14:11:12.587 INFO:tasks.workunit.client.0.smithi153.stderr: -242> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding con mode: crc 2024-09-19T14:11:12.587 INFO:tasks.workunit.client.0.smithi153.stderr: -241> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding con mode: crc 2024-09-19T14:11:12.587 INFO:tasks.workunit.client.0.smithi153.stderr: -240> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding con mode: secure 2024-09-19T14:11:12.587 INFO:tasks.workunit.client.0.smithi153.stderr: -239> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding con mode: crc 2024-09-19T14:11:12.587 INFO:tasks.workunit.client.0.smithi153.stderr: -238> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding con mode: secure 2024-09-19T14:11:12.587 INFO:tasks.workunit.client.0.smithi153.stderr: -237> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding con mode: crc 2024-09-19T14:11:12.588 INFO:tasks.workunit.client.0.smithi153.stderr: -236> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding con mode: secure 2024-09-19T14:11:12.588 INFO:tasks.workunit.client.0.smithi153.stderr: -235> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:12.588 INFO:tasks.workunit.client.0.smithi153.stderr: -234> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 1 librados: starting msgr at 2024-09-19T14:11:12.588 INFO:tasks.workunit.client.0.smithi153.stderr: -233> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 1 librados: starting objecter 2024-09-19T14:11:12.588 INFO:tasks.workunit.client.0.smithi153.stderr: -232> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command objecter_requests cmddesc objecter_requests hook 0x561b20b6edc0 EEXIST 2024-09-19T14:11:12.588 INFO:tasks.workunit.client.0.smithi153.stderr: -231> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 1 librados: setting wanted keys 2024-09-19T14:11:12.588 INFO:tasks.workunit.client.0.smithi153.stderr: -230> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 1 librados: calling monclient init 2024-09-19T14:11:12.588 INFO:tasks.workunit.client.0.smithi153.stderr: -229> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient: init 2024-09-19T14:11:12.588 INFO:tasks.workunit.client.0.smithi153.stderr: -228> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding auth protocol: cephx 2024-09-19T14:11:12.588 INFO:tasks.workunit.client.0.smithi153.stderr: -227> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding auth protocol: cephx 2024-09-19T14:11:12.588 INFO:tasks.workunit.client.0.smithi153.stderr: -226> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding auth protocol: cephx 2024-09-19T14:11:12.589 INFO:tasks.workunit.client.0.smithi153.stderr: -225> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding con mode: secure 2024-09-19T14:11:12.589 INFO:tasks.workunit.client.0.smithi153.stderr: -224> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding con mode: crc 2024-09-19T14:11:12.589 INFO:tasks.workunit.client.0.smithi153.stderr: -223> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding con mode: secure 2024-09-19T14:11:12.589 INFO:tasks.workunit.client.0.smithi153.stderr: -222> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding con mode: crc 2024-09-19T14:11:12.589 INFO:tasks.workunit.client.0.smithi153.stderr: -221> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding con mode: secure 2024-09-19T14:11:12.589 INFO:tasks.workunit.client.0.smithi153.stderr: -220> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding con mode: crc 2024-09-19T14:11:12.589 INFO:tasks.workunit.client.0.smithi153.stderr: -219> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding con mode: crc 2024-09-19T14:11:12.589 INFO:tasks.workunit.client.0.smithi153.stderr: -218> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding con mode: secure 2024-09-19T14:11:12.589 INFO:tasks.workunit.client.0.smithi153.stderr: -217> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding con mode: crc 2024-09-19T14:11:12.589 INFO:tasks.workunit.client.0.smithi153.stderr: -216> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding con mode: secure 2024-09-19T14:11:12.589 INFO:tasks.workunit.client.0.smithi153.stderr: -215> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding con mode: crc 2024-09-19T14:11:12.589 INFO:tasks.workunit.client.0.smithi153.stderr: -214> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding con mode: secure 2024-09-19T14:11:12.589 INFO:tasks.workunit.client.0.smithi153.stderr: -213> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:12.590 INFO:tasks.workunit.client.0.smithi153.stderr: -212> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:12.590 INFO:tasks.workunit.client.0.smithi153.stderr: -211> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command rotate-key cmddesc rotate-key hook 0x561b20b6f428 EEXIST 2024-09-19T14:11:12.590 INFO:tasks.workunit.client.0.smithi153.stderr: -210> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient: _reopen_session rank -1 2024-09-19T14:11:12.590 INFO:tasks.workunit.client.0.smithi153.stderr: -209> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T14:11:12.590 INFO:tasks.workunit.client.0.smithi153.stderr: -208> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient(hunting): picked mon.noname-c con 0x561b20b92280 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:11:12.590 INFO:tasks.workunit.client.0.smithi153.stderr: -207> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient(hunting): picked mon.noname-a con 0x561b20bc12a0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:11:12.590 INFO:tasks.workunit.client.0.smithi153.stderr: -206> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient(hunting): picked mon.noname-b con 0x561b20bb6ff0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:11:12.590 INFO:tasks.workunit.client.0.smithi153.stderr: -205> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:12.590 INFO:tasks.workunit.client.0.smithi153.stderr: -204> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:12.590 INFO:tasks.workunit.client.0.smithi153.stderr: -203> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:12.590 INFO:tasks.workunit.client.0.smithi153.stderr: -202> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient(hunting): _renew_subs 2024-09-19T14:11:12.590 INFO:tasks.workunit.client.0.smithi153.stderr: -201> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient(hunting): authenticate will time out at 2860.906366s 2024-09-19T14:11:12.590 INFO:tasks.workunit.client.0.smithi153.stderr: -200> 2024-09-19T14:11:12.440+0000 7fa5ecc84640 10 monclient(hunting): get_auth_request con 0x561b20bc12a0 auth_method 0 2024-09-19T14:11:12.591 INFO:tasks.workunit.client.0.smithi153.stderr: -199> 2024-09-19T14:11:12.440+0000 7fa5ecc84640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:12.591 INFO:tasks.workunit.client.0.smithi153.stderr: -198> 2024-09-19T14:11:12.440+0000 7fa5ecc84640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:12.591 INFO:tasks.workunit.client.0.smithi153.stderr: -197> 2024-09-19T14:11:12.440+0000 7fa5ecc84640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:12.591 INFO:tasks.workunit.client.0.smithi153.stderr: -196> 2024-09-19T14:11:12.440+0000 7fa5ed485640 10 monclient(hunting): get_auth_request con 0x561b20b92280 auth_method 0 2024-09-19T14:11:12.591 INFO:tasks.workunit.client.0.smithi153.stderr: -195> 2024-09-19T14:11:12.440+0000 7fa5ed485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:12.591 INFO:tasks.workunit.client.0.smithi153.stderr: -194> 2024-09-19T14:11:12.440+0000 7fa5ed485640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:12.591 INFO:tasks.workunit.client.0.smithi153.stderr: -193> 2024-09-19T14:11:12.440+0000 7fa5ed485640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:12.591 INFO:tasks.workunit.client.0.smithi153.stderr: -192> 2024-09-19T14:11:12.440+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:12.591 INFO:tasks.workunit.client.0.smithi153.stderr: -191> 2024-09-19T14:11:12.440+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:12.591 INFO:tasks.workunit.client.0.smithi153.stderr: -190> 2024-09-19T14:11:12.440+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:12.591 INFO:tasks.workunit.client.0.smithi153.stderr: -189> 2024-09-19T14:11:12.440+0000 7fa5ed485640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:12.591 INFO:tasks.workunit.client.0.smithi153.stderr: -188> 2024-09-19T14:11:12.440+0000 7fa5ed485640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:12.592 INFO:tasks.workunit.client.0.smithi153.stderr: -187> 2024-09-19T14:11:12.440+0000 7fa5ed485640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:12.592 INFO:tasks.workunit.client.0.smithi153.stderr: -186> 2024-09-19T14:11:12.440+0000 7fa5edc86640 10 monclient(hunting): get_auth_request con 0x561b20bb6ff0 auth_method 0 2024-09-19T14:11:12.592 INFO:tasks.workunit.client.0.smithi153.stderr: -185> 2024-09-19T14:11:12.440+0000 7fa5edc86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:12.592 INFO:tasks.workunit.client.0.smithi153.stderr: -184> 2024-09-19T14:11:12.440+0000 7fa5edc86640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:12.592 INFO:tasks.workunit.client.0.smithi153.stderr: -183> 2024-09-19T14:11:12.440+0000 7fa5edc86640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:12.592 INFO:tasks.workunit.client.0.smithi153.stderr: -182> 2024-09-19T14:11:12.440+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_done global_id 7953 payload 824 2024-09-19T14:11:12.592 INFO:tasks.workunit.client.0.smithi153.stderr: -181> 2024-09-19T14:11:12.440+0000 7fa5ecc84640 10 monclient: _finish_hunting 0 2024-09-19T14:11:12.592 INFO:tasks.workunit.client.0.smithi153.stderr: -180> 2024-09-19T14:11:12.440+0000 7fa5ecc84640 1 monclient: found mon.noname-a 2024-09-19T14:11:12.592 INFO:tasks.workunit.client.0.smithi153.stderr: -179> 2024-09-19T14:11:12.440+0000 7fa5ecc84640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:11:12.592 INFO:tasks.workunit.client.0.smithi153.stderr: -178> 2024-09-19T14:11:12.440+0000 7fa4beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:12.592 INFO:tasks.workunit.client.0.smithi153.stderr: -177> 2024-09-19T14:11:12.440+0000 7fa4beffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:11:12.593 INFO:tasks.workunit.client.0.smithi153.stderr: -176> 2024-09-19T14:11:12.440+0000 7fa4beffd640 10 monclient: dump: 2024-09-19T14:11:12.593 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:12.593 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:12.593 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.593 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.593 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:12.593 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:12.593 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:12.593 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:12.593 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:12.593 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.593 INFO:tasks.workunit.client.0.smithi153.stderr: -175> 2024-09-19T14:11:12.440+0000 7fa4beffd640 10 monclient: _finish_auth 0 2024-09-19T14:11:12.593 INFO:tasks.workunit.client.0.smithi153.stderr: -174> 2024-09-19T14:11:12.440+0000 7fa4beffd640 10 monclient: _check_auth_tickets 2024-09-19T14:11:12.593 INFO:tasks.workunit.client.0.smithi153.stderr: -173> 2024-09-19T14:11:12.440+0000 7fa4beffd640 10 monclient: handle_config config(0 keys) 2024-09-19T14:11:12.594 INFO:tasks.workunit.client.0.smithi153.stderr: -172> 2024-09-19T14:11:12.440+0000 7fa4beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:12.594 INFO:tasks.workunit.client.0.smithi153.stderr: -171> 2024-09-19T14:11:12.440+0000 7fa4beffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:11:12.594 INFO:tasks.workunit.client.0.smithi153.stderr: -170> 2024-09-19T14:11:12.440+0000 7fa4beffd640 10 monclient: dump: 2024-09-19T14:11:12.594 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:12.594 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:12.594 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.594 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.594 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:12.594 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:12.594 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:12.594 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:12.594 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:12.594 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.594 INFO:tasks.workunit.client.0.smithi153.stderr: -169> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 monclient: authenticate success, global_id 7953 2024-09-19T14:11:12.595 INFO:tasks.workunit.client.0.smithi153.stderr: -168> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient: _renew_subs 2024-09-19T14:11:12.595 INFO:tasks.workunit.client.0.smithi153.stderr: -167> 2024-09-19T14:11:12.440+0000 7fa4d0ff9640 4 set_mon_vals no callback set 2024-09-19T14:11:12.595 INFO:tasks.workunit.client.0.smithi153.stderr: -166> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:11:12.595 INFO:tasks.workunit.client.0.smithi153.stderr: -165> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient: _renew_subs 2024-09-19T14:11:12.595 INFO:tasks.workunit.client.0.smithi153.stderr: -164> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:11:12.595 INFO:tasks.workunit.client.0.smithi153.stderr: -163> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 1 librados: init done 2024-09-19T14:11:12.595 INFO:tasks.workunit.client.0.smithi153.stderr: -162> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command cr dump hook 0x561b20bb6068 2024-09-19T14:11:12.595 INFO:tasks.workunit.client.0.smithi153.stderr: -161> 2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.595 INFO:tasks.workunit.client.0.smithi153.stderr: -160> 2024-09-19T14:11:12.444+0000 7fa4beffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:11:12.595 INFO:tasks.workunit.client.0.smithi153.stderr: -159> 2024-09-19T14:11:12.444+0000 7fa4beffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:11:12.595 INFO:tasks.workunit.client.0.smithi153.stderr: -158> 2024-09-19T14:11:12.444+0000 7fa4beffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:11:12.595 INFO:tasks.workunit.client.0.smithi153.stderr: -157> 2024-09-19T14:11:12.444+0000 7fa5ed485640 10 monclient: get_auth_request con 0x7fa4b8071c10 auth_method 0 2024-09-19T14:11:12.595 INFO:tasks.workunit.client.0.smithi153.stderr: -156> 2024-09-19T14:11:12.444+0000 7fa5edc86640 10 monclient: get_auth_request con 0x561b20bdb290 auth_method 0 2024-09-19T14:11:12.595 INFO:tasks.workunit.client.0.smithi153.stderr: -155> 2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.596 INFO:tasks.workunit.client.0.smithi153.stderr: -154> 2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 20 realm 2024-09-19T14:11:12.596 INFO:tasks.workunit.client.0.smithi153.stderr: -153> 2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.596 INFO:tasks.workunit.client.0.smithi153.stderr: -152> 2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.596 INFO:tasks.workunit.client.0.smithi153.stderr: -151> 2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:11:12.596 INFO:tasks.workunit.client.0.smithi153.stderr: -150> 2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.596 INFO:tasks.workunit.client.0.smithi153.stderr: -149> 2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.596 INFO:tasks.workunit.client.0.smithi153.stderr: -148> 2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.596 INFO:tasks.workunit.client.0.smithi153.stderr: -147> 2024-09-19T14:11:12.448+0000 7fa5ed485640 10 monclient: get_auth_request con 0x561b20bdf450 auth_method 0 2024-09-19T14:11:12.596 INFO:tasks.workunit.client.0.smithi153.stderr: -146> 2024-09-19T14:11:12.448+0000 7fa5ef97f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:12.596 INFO:tasks.workunit.client.0.smithi153.stderr: -145> 2024-09-19T14:11:12.448+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.596 INFO:tasks.workunit.client.0.smithi153.stderr: -144> 2024-09-19T14:11:12.448+0000 7fa5ef97f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:11:12.596 INFO:tasks.workunit.client.0.smithi153.stderr: -143> 2024-09-19T14:11:12.448+0000 7fa5ef97f9c0 20 searching for the correct realm 2024-09-19T14:11:12.596 INFO:tasks.workunit.client.0.smithi153.stderr: -142> 2024-09-19T14:11:12.448+0000 7fa5ecc84640 10 monclient: get_auth_request con 0x561b20be46c0 auth_method 0 2024-09-19T14:11:12.597 INFO:tasks.workunit.client.0.smithi153.stderr: -141> 2024-09-19T14:11:12.448+0000 7fa5edc86640 10 monclient: get_auth_request con 0x7fa5e4008050 auth_method 0 2024-09-19T14:11:12.597 INFO:tasks.workunit.client.0.smithi153.stderr: -140> 2024-09-19T14:11:12.452+0000 7fa5ed485640 10 monclient: get_auth_request con 0x561b209b2750 auth_method 0 2024-09-19T14:11:12.597 INFO:tasks.workunit.client.0.smithi153.stderr: -139> 2024-09-19T14:11:12.452+0000 7fa5ed485640 0 -- 172.21.15.153:0/3833316202 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x561b209b2750 msgr2=0x7fa5e807bac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:12.597 INFO:tasks.workunit.client.0.smithi153.stderr: -138> 2024-09-19T14:11:12.452+0000 7fa4beffd640 1 client.7953.objecter ms_handle_reset 0x561b209b2750 session 0x7fa5e806af90 osd.2 2024-09-19T14:11:12.597 INFO:tasks.workunit.client.0.smithi153.stderr: -137> 2024-09-19T14:11:12.452+0000 7fa4beffd640 10 monclient: _renew_subs 2024-09-19T14:11:12.597 INFO:tasks.workunit.client.0.smithi153.stderr: -136> 2024-09-19T14:11:12.452+0000 7fa4beffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:11:12.597 INFO:tasks.workunit.client.0.smithi153.stderr: -135> 2024-09-19T14:11:12.452+0000 7fa5ed485640 10 monclient: get_auth_request con 0x7fa4b8082340 auth_method 0 2024-09-19T14:11:12.597 INFO:tasks.workunit.client.0.smithi153.stderr: -134> 2024-09-19T14:11:12.452+0000 7fa5ecc84640 10 monclient: get_auth_request con 0x7fa5e00fa2f0 auth_method 0 2024-09-19T14:11:12.597 INFO:tasks.workunit.client.0.smithi153.stderr: -133> 2024-09-19T14:11:12.456+0000 7fa5edc86640 10 monclient: get_auth_request con 0x7fa5d8003100 auth_method 0 2024-09-19T14:11:12.597 INFO:tasks.workunit.client.0.smithi153.stderr: -132> 2024-09-19T14:11:12.460+0000 7fa5edc86640 0 -- 172.21.15.153:0/3833316202 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7fa5e4008050 msgr2=0x7fa5e406e4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:11:12.597 INFO:tasks.workunit.client.0.smithi153.stderr: -131> 2024-09-19T14:11:12.460+0000 7fa4beffd640 1 client.7953.objecter ms_handle_reset 0x7fa5e4008050 session 0x7fa5e4011040 osd.7 2024-09-19T14:11:12.597 INFO:tasks.workunit.client.0.smithi153.stderr: -130> 2024-09-19T14:11:12.460+0000 7fa5edc86640 10 monclient: get_auth_request con 0x561b209b2750 auth_method 0 2024-09-19T14:11:12.597 INFO:tasks.workunit.client.0.smithi153.stderr: -129> 2024-09-19T14:11:12.460+0000 7fa5ed485640 10 monclient: get_auth_request con 0x7fa5e4067a90 auth_method 0 2024-09-19T14:11:12.598 INFO:tasks.workunit.client.0.smithi153.stderr: -128> 2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:11:12.598 INFO:tasks.workunit.client.0.smithi153.stderr: -127> 2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:11:12.598 INFO:tasks.workunit.client.0.smithi153.stderr: -126> 2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:11:12.598 INFO:tasks.workunit.client.0.smithi153.stderr: -125> 2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:11:12.598 INFO:tasks.workunit.client.0.smithi153.stderr: -124> 2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:11:12.598 INFO:tasks.workunit.client.0.smithi153.stderr: -123> 2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:11:12.598 INFO:tasks.workunit.client.0.smithi153.stderr: -122> 2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.598 INFO:tasks.workunit.client.0.smithi153.stderr: -121> 2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.598 INFO:tasks.workunit.client.0.smithi153.stderr: -120> 2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.598 INFO:tasks.workunit.client.0.smithi153.stderr: -119> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:12.598 INFO:tasks.workunit.client.0.smithi153.stderr: -118> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.598 INFO:tasks.workunit.client.0.smithi153.stderr: -117> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:11:12.598 INFO:tasks.workunit.client.0.smithi153.stderr: -116> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 zone default found 2024-09-19T14:11:12.598 INFO:tasks.workunit.client.0.smithi153.stderr: -115> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 4 Realm: () 2024-09-19T14:11:12.599 INFO:tasks.workunit.client.0.smithi153.stderr: -114> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:11:12.599 INFO:tasks.workunit.client.0.smithi153.stderr: -113> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:11:12.599 INFO:tasks.workunit.client.0.smithi153.stderr: -112> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:11:12.599 INFO:tasks.workunit.client.0.smithi153.stderr: -111> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 zonegroup default 2024-09-19T14:11:12.599 INFO:tasks.workunit.client.0.smithi153.stderr: -110> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.599 INFO:tasks.workunit.client.0.smithi153.stderr: -109> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.599 INFO:tasks.workunit.client.0.smithi153.stderr: -108> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.599 INFO:tasks.workunit.client.0.smithi153.stderr: -107> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.599 INFO:tasks.workunit.client.0.smithi153.stderr: -106> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.599 INFO:tasks.workunit.client.0.smithi153.stderr: -105> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.599 INFO:tasks.workunit.client.0.smithi153.stderr: -104> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 started sync module instance, tier type = 2024-09-19T14:11:12.599 INFO:tasks.workunit.client.0.smithi153.stderr: -103> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:11:12.599 INFO:tasks.workunit.client.0.smithi153.stderr: -102> 2024-09-19T14:11:12.488+0000 7fa5ef97f9c0 20 add_watcher() i=0 2024-09-19T14:11:12.600 INFO:tasks.workunit.client.0.smithi153.stderr: -101> 2024-09-19T14:11:12.488+0000 7fa5ef97f9c0 20 add_watcher() i=1 2024-09-19T14:11:12.600 INFO:tasks.workunit.client.0.smithi153.stderr: -100> 2024-09-19T14:11:12.488+0000 7fa5ef97f9c0 20 add_watcher() i=2 2024-09-19T14:11:12.600 INFO:tasks.workunit.client.0.smithi153.stderr: -99> 2024-09-19T14:11:12.488+0000 7fa5ef97f9c0 20 add_watcher() i=3 2024-09-19T14:11:12.600 INFO:tasks.workunit.client.0.smithi153.stderr: -98> 2024-09-19T14:11:12.488+0000 7fa5ef97f9c0 20 add_watcher() i=4 2024-09-19T14:11:12.600 INFO:tasks.workunit.client.0.smithi153.stderr: -97> 2024-09-19T14:11:12.488+0000 7fa5ef97f9c0 20 add_watcher() i=5 2024-09-19T14:11:12.600 INFO:tasks.workunit.client.0.smithi153.stderr: -96> 2024-09-19T14:11:12.488+0000 7fa5ef97f9c0 20 add_watcher() i=6 2024-09-19T14:11:12.600 INFO:tasks.workunit.client.0.smithi153.stderr: -95> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 20 add_watcher() i=7 2024-09-19T14:11:12.600 INFO:tasks.workunit.client.0.smithi153.stderr: -94> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:11:12.600 INFO:tasks.workunit.client.0.smithi153.stderr: -93> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding auth protocol: cephx 2024-09-19T14:11:12.600 INFO:tasks.workunit.client.0.smithi153.stderr: -92> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding auth protocol: cephx 2024-09-19T14:11:12.600 INFO:tasks.workunit.client.0.smithi153.stderr: -91> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding auth protocol: cephx 2024-09-19T14:11:12.601 INFO:tasks.workunit.client.0.smithi153.stderr: -90> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding con mode: secure 2024-09-19T14:11:12.601 INFO:tasks.workunit.client.0.smithi153.stderr: -89> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding con mode: crc 2024-09-19T14:11:12.601 INFO:tasks.workunit.client.0.smithi153.stderr: -88> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding con mode: secure 2024-09-19T14:11:12.601 INFO:tasks.workunit.client.0.smithi153.stderr: -87> 2024-09-19T14:11:12.492+0000 7fa4a3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:12.601 INFO:tasks.workunit.client.0.smithi153.stderr: -86> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding con mode: crc 2024-09-19T14:11:12.601 INFO:tasks.workunit.client.0.smithi153.stderr: -85> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding con mode: secure 2024-09-19T14:11:12.601 INFO:tasks.workunit.client.0.smithi153.stderr: -84> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding con mode: crc 2024-09-19T14:11:12.601 INFO:tasks.workunit.client.0.smithi153.stderr: -83> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding con mode: crc 2024-09-19T14:11:12.601 INFO:tasks.workunit.client.0.smithi153.stderr: -82> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding con mode: secure 2024-09-19T14:11:12.601 INFO:tasks.workunit.client.0.smithi153.stderr: -81> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding con mode: crc 2024-09-19T14:11:12.601 INFO:tasks.workunit.client.0.smithi153.stderr: -80> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding con mode: secure 2024-09-19T14:11:12.601 INFO:tasks.workunit.client.0.smithi153.stderr: -79> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding con mode: crc 2024-09-19T14:11:12.602 INFO:tasks.workunit.client.0.smithi153.stderr: -78> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding con mode: secure 2024-09-19T14:11:12.602 INFO:tasks.workunit.client.0.smithi153.stderr: -77> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:12.602 INFO:tasks.workunit.client.0.smithi153.stderr: -76> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:11:12.602 INFO:tasks.workunit.client.0.smithi153.stderr: -75> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:11:12.602 INFO:tasks.workunit.client.0.smithi153.stderr: -74> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command cache list hook 0x561b20bb73f0 2024-09-19T14:11:12.602 INFO:tasks.workunit.client.0.smithi153.stderr: -73> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command cache inspect hook 0x561b20bb73f0 2024-09-19T14:11:12.602 INFO:tasks.workunit.client.0.smithi153.stderr: -72> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command cache erase hook 0x561b20bb73f0 2024-09-19T14:11:12.602 INFO:tasks.workunit.client.0.smithi153.stderr: -71> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command cache zap hook 0x561b20bb73f0 2024-09-19T14:11:12.602 INFO:tasks.workunit.client.0.smithi153.stderr: -70> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 5 note: GC not initialized 2024-09-19T14:11:12.602 INFO:tasks.workunit.client.0.smithi153.stderr: -69> 2024-09-19T14:11:12.496+0000 7fa4a2fe5640 20 reqs_thread_entry: start 2024-09-19T14:11:12.602 INFO:tasks.workunit.client.0.smithi153.stderr: -68> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command sync trace show hook 0x7fa5e80047a0 2024-09-19T14:11:12.602 INFO:tasks.workunit.client.0.smithi153.stderr: -67> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command sync trace history hook 0x7fa5e80047a0 2024-09-19T14:11:12.602 INFO:tasks.workunit.client.0.smithi153.stderr: -66> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command sync trace active hook 0x7fa5e80047a0 2024-09-19T14:11:12.603 INFO:tasks.workunit.client.0.smithi153.stderr: -65> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command sync trace active_short hook 0x7fa5e80047a0 2024-09-19T14:11:12.603 INFO:tasks.workunit.client.0.smithi153.stderr: -64> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:11:12.603 INFO:tasks.workunit.client.0.smithi153.stderr: -63> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 20 Filter name: none 2024-09-19T14:11:12.603 INFO:tasks.workunit.client.0.smithi153.stderr: -62> 2024-09-19T14:11:12.496+0000 7fa4a0fe1640 20 reqs_thread_entry: start 2024-09-19T14:11:12.603 INFO:tasks.workunit.client.0.smithi153.stderr: -61> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-19T14:11:12.603 INFO:tasks.workunit.client.0.smithi153.stderr: -60> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.603 INFO:tasks.workunit.client.0.smithi153.stderr: -59> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:11:12.603 INFO:tasks.workunit.client.0.smithi153.stderr: -58> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-19T14:11:12.603 INFO:tasks.workunit.client.0.smithi153.stderr: -57> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-19T14:11:12.603 INFO:tasks.workunit.client.0.smithi153.stderr: -56> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 : miss 2024-09-19T14:11:12.603 INFO:tasks.workunit.client.0.smithi153.stderr: -55> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.603 INFO:tasks.workunit.client.0.smithi153.stderr: -54> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:11:12.603 INFO:tasks.workunit.client.0.smithi153.stderr: -53> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 info.flags=0x17 2024-09-19T14:11:12.604 INFO:tasks.workunit.client.0.smithi153.stderr: -52> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 to cache LRU end 2024-09-19T14:11:12.604 INFO:tasks.workunit.client.0.smithi153.stderr: -51> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:11:12.604 INFO:tasks.workunit.client.0.smithi153.stderr: -50> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:12.604 INFO:tasks.workunit.client.0.smithi153.stderr: -49> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 2024-09-19T14:11:12.604 INFO:tasks.workunit.client.0.smithi153.stderr: -48> 2024-09-19T14:11:12.508+0000 7fa5ef97f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 info.flags=0x17 2024-09-19T14:11:12.604 INFO:tasks.workunit.client.0.smithi153.stderr: -47> 2024-09-19T14:11:12.508+0000 7fa5ef97f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 to cache LRU end 2024-09-19T14:11:12.604 INFO:tasks.workunit.client.0.smithi153.stderr: -46> 2024-09-19T14:11:12.508+0000 7fa5ef97f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:12.604 INFO:tasks.workunit.client.0.smithi153.stderr: -45> 2024-09-19T14:11:12.508+0000 7fa5ef97f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39, ofs0, ns] 2024-09-19T14:11:12.604 INFO:tasks.workunit.client.0.smithi153.stderr: -44> 2024-09-19T14:11:12.508+0000 7fa4d0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333498 cookie 94674513474032 notifier 7953 bl.length()=931 2024-09-19T14:11:12.604 INFO:tasks.workunit.client.0.smithi153.stderr: -43> 2024-09-19T14:11:12.508+0000 7fa4d0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 info.flags=0x17 2024-09-19T14:11:12.604 INFO:tasks.workunit.client.0.smithi153.stderr: -42> 2024-09-19T14:11:12.508+0000 7fa4d0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 to cache LRU end 2024-09-19T14:11:12.604 INFO:tasks.workunit.client.0.smithi153.stderr: -41> 2024-09-19T14:11:12.508+0000 7fa4d0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:12.605 INFO:tasks.workunit.client.0.smithi153.stderr: -40> 2024-09-19T14:11:12.512+0000 7fa5ef97f9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.39]): orig_sources= new_sources= 2024-09-19T14:11:12.605 INFO:tasks.workunit.client.0.smithi153.stderr: -39> 2024-09-19T14:11:12.512+0000 7fa5ef97f9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.39]): potential sources added=[] removed=[] 2024-09-19T14:11:12.605 INFO:tasks.workunit.client.0.smithi153.stderr: -38> 2024-09-19T14:11:12.512+0000 7fa5ef97f9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.39]): orig_dests= new_dests= 2024-09-19T14:11:12.605 INFO:tasks.workunit.client.0.smithi153.stderr: -37> 2024-09-19T14:11:12.512+0000 7fa5ef97f9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.39]): potential dests added=[] removed=[] 2024-09-19T14:11:12.605 INFO:tasks.workunit.client.0.smithi153.stderr: -36> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.0 2024-09-19T14:11:12.605 INFO:tasks.workunit.client.0.smithi153.stderr: -35> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.0 2024-09-19T14:11:12.605 INFO:tasks.workunit.client.0.smithi153.stderr: -34> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.1 2024-09-19T14:11:12.605 INFO:tasks.workunit.client.0.smithi153.stderr: -33> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.1 2024-09-19T14:11:12.605 INFO:tasks.workunit.client.0.smithi153.stderr: -32> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.2 2024-09-19T14:11:12.605 INFO:tasks.workunit.client.0.smithi153.stderr: -31> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.2 2024-09-19T14:11:12.605 INFO:tasks.workunit.client.0.smithi153.stderr: -30> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.3 2024-09-19T14:11:12.605 INFO:tasks.workunit.client.0.smithi153.stderr: -29> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.3 2024-09-19T14:11:12.605 INFO:tasks.workunit.client.0.smithi153.stderr: -28> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.4 2024-09-19T14:11:12.606 INFO:tasks.workunit.client.0.smithi153.stderr: -27> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.4 2024-09-19T14:11:12.606 INFO:tasks.workunit.client.0.smithi153.stderr: -26> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.5 2024-09-19T14:11:12.606 INFO:tasks.workunit.client.0.smithi153.stderr: -25> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.5 2024-09-19T14:11:12.606 INFO:tasks.workunit.client.0.smithi153.stderr: -24> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.6 2024-09-19T14:11:12.606 INFO:tasks.workunit.client.0.smithi153.stderr: -23> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.6 2024-09-19T14:11:12.606 INFO:tasks.workunit.client.0.smithi153.stderr: -22> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.7 2024-09-19T14:11:12.606 INFO:tasks.workunit.client.0.smithi153.stderr: -21> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.7 2024-09-19T14:11:12.606 INFO:tasks.workunit.client.0.smithi153.stderr: -20> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.8 2024-09-19T14:11:12.606 INFO:tasks.workunit.client.0.smithi153.stderr: -19> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.8 2024-09-19T14:11:12.606 INFO:tasks.workunit.client.0.smithi153.stderr: -18> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.9 2024-09-19T14:11:12.606 INFO:tasks.workunit.client.0.smithi153.stderr: -17> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.9 2024-09-19T14:11:12.606 INFO:tasks.workunit.client.0.smithi153.stderr: -16> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.10 2024-09-19T14:11:12.606 INFO:tasks.workunit.client.0.smithi153.stderr: -15> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.10 2024-09-19T14:11:12.607 INFO:tasks.workunit.client.0.smithi153.stderr: -14> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.11 2024-09-19T14:11:12.607 INFO:tasks.workunit.client.0.smithi153.stderr: -13> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.11 2024-09-19T14:11:12.607 INFO:tasks.workunit.client.0.smithi153.stderr: -12> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.0 2024-09-19T14:11:12.607 INFO:tasks.workunit.client.0.smithi153.stderr: -11> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1 2024-09-19T14:11:12.607 INFO:tasks.workunit.client.0.smithi153.stderr: -10> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2 2024-09-19T14:11:12.607 INFO:tasks.workunit.client.0.smithi153.stderr: -9> 2024-09-19T14:11:12.524+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.3 2024-09-19T14:11:12.607 INFO:tasks.workunit.client.0.smithi153.stderr: -8> 2024-09-19T14:11:12.524+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.4 2024-09-19T14:11:12.607 INFO:tasks.workunit.client.0.smithi153.stderr: -7> 2024-09-19T14:11:12.524+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.5 2024-09-19T14:11:12.607 INFO:tasks.workunit.client.0.smithi153.stderr: -6> 2024-09-19T14:11:12.528+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.6 2024-09-19T14:11:12.607 INFO:tasks.workunit.client.0.smithi153.stderr: -5> 2024-09-19T14:11:12.528+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.7 2024-09-19T14:11:12.607 INFO:tasks.workunit.client.0.smithi153.stderr: -4> 2024-09-19T14:11:12.528+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.8 2024-09-19T14:11:12.607 INFO:tasks.workunit.client.0.smithi153.stderr: -3> 2024-09-19T14:11:12.528+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.9 2024-09-19T14:11:12.607 INFO:tasks.workunit.client.0.smithi153.stderr: -2> 2024-09-19T14:11:12.528+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.10 2024-09-19T14:11:12.607 INFO:tasks.workunit.client.0.smithi153.stderr: -1> 2024-09-19T14:11:12.536+0000 7fa5ef97f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa5ef97f9c0 time 2024-09-19T14:11:12.541389+0000 2024-09-19T14:11:12.608 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:11:12.608 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.608 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:11:12.608 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa5f32592eb] 2024-09-19T14:11:12.608 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa5f325949f] 2024-09-19T14:11:12.608 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561b1d9c3271] 2024-09-19T14:11:12.608 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x561b1d9d2441] 2024-09-19T14:11:12.608 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561b1d9d3a94] 2024-09-19T14:11:12.608 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:11:12.608 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa5f20bfd90] 2024-09-19T14:11:12.608 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:11:12.608 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:11:12.608 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.609 INFO:tasks.workunit.client.0.smithi153.stderr: 0> 2024-09-19T14:11:12.540+0000 7fa5ef97f9c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:11:12.609 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7fa5ef97f9c0 thread_name:radosgw-admin 2024-09-19T14:11:12.609 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.609 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:11:12.609 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa5f20d8520] 2024-09-19T14:11:12.609 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:11:12.609 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:11:12.609 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:11:12.609 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa5f3259345] 2024-09-19T14:11:12.609 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa5f325949f] 2024-09-19T14:11:12.609 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561b1d9c3271] 2024-09-19T14:11:12.609 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x561b1d9d2441] 2024-09-19T14:11:12.609 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561b1d9d3a94] 2024-09-19T14:11:12.610 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:11:12.610 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa5f20bfd90] 2024-09-19T14:11:12.610 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:11:12.610 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:11:12.610 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:11:12.610 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.610 INFO:tasks.workunit.client.0.smithi153.stderr:--- logging levels --- 2024-09-19T14:11:12.610 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 none 2024-09-19T14:11:12.610 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 lockdep 2024-09-19T14:11:12.610 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 context 2024-09-19T14:11:12.610 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 crush 2024-09-19T14:11:12.610 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds 2024-09-19T14:11:12.610 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_balancer 2024-09-19T14:11:12.611 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_locker 2024-09-19T14:11:12.611 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log 2024-09-19T14:11:12.611 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log_expire 2024-09-19T14:11:12.611 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_migrator 2024-09-19T14:11:12.611 INFO:tasks.workunit.client.0.smithi153.stderr: 3/ 5 mds_quiesce 2024-09-19T14:11:12.611 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 buffer 2024-09-19T14:11:12.611 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 timer 2024-09-19T14:11:12.611 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 filer 2024-09-19T14:11:12.611 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 striper 2024-09-19T14:11:12.611 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 objecter 2024-09-19T14:11:12.611 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rados 2024-09-19T14:11:12.611 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd 2024-09-19T14:11:12.611 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_mirror 2024-09-19T14:11:12.612 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_replay 2024-09-19T14:11:12.612 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_pwl 2024-09-19T14:11:12.612 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 journaler 2024-09-19T14:11:12.612 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objectcacher 2024-09-19T14:11:12.612 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:11:12.612 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 client 2024-09-19T14:11:12.612 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 osd 2024-09-19T14:11:12.612 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 optracker 2024-09-19T14:11:12.612 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objclass 2024-09-19T14:11:12.612 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 filestore 2024-09-19T14:11:12.612 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 journal 2024-09-19T14:11:12.612 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 ms 2024-09-19T14:11:12.613 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mon 2024-09-19T14:11:12.613 INFO:tasks.workunit.client.0.smithi153.stderr: 0/10 monc 2024-09-19T14:11:12.613 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 paxos 2024-09-19T14:11:12.613 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 tp 2024-09-19T14:11:12.613 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 auth 2024-09-19T14:11:12.613 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 crypto 2024-09-19T14:11:12.613 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 finisher 2024-09-19T14:11:12.613 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 reserver 2024-09-19T14:11:12.613 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 heartbeatmap 2024-09-19T14:11:12.613 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 perfcounter 2024-09-19T14:11:12.613 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw 2024-09-19T14:11:12.613 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_sync 2024-09-19T14:11:12.613 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_datacache 2024-09-19T14:11:12.613 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_access 2024-09-19T14:11:12.614 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:11:12.614 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_flight 2024-09-19T14:11:12.614 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:11:12.614 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw_notification 2024-09-19T14:11:12.614 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 javaclient 2024-09-19T14:11:12.614 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 asok 2024-09-19T14:11:12.614 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 throttle 2024-09-19T14:11:12.614 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 refs 2024-09-19T14:11:12.614 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 compressor 2024-09-19T14:11:12.614 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluestore 2024-09-19T14:11:12.614 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluefs 2024-09-19T14:11:12.614 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 bdev 2024-09-19T14:11:12.614 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 kstore 2024-09-19T14:11:12.614 INFO:tasks.workunit.client.0.smithi153.stderr: 4/ 5 rocksdb 2024-09-19T14:11:12.615 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 fuse 2024-09-19T14:11:12.615 INFO:tasks.workunit.client.0.smithi153.stderr: 2/ 5 mgr 2024-09-19T14:11:12.615 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mgrc 2024-09-19T14:11:12.615 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 dpdk 2024-09-19T14:11:12.615 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 eventtrace 2024-09-19T14:11:12.615 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 prioritycache 2024-09-19T14:11:12.615 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 test 2024-09-19T14:11:12.615 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:11:12.615 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephsqlite 2024-09-19T14:11:12.615 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:11:12.615 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore 2024-09-19T14:11:12.615 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_onode 2024-09-19T14:11:12.615 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_odata 2024-09-19T14:11:12.615 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_omap 2024-09-19T14:11:12.615 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_tm 2024-09-19T14:11:12.616 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_t 2024-09-19T14:11:12.616 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:11:12.616 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_epm 2024-09-19T14:11:12.616 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_lba 2024-09-19T14:11:12.616 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:11:12.616 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cache 2024-09-19T14:11:12.616 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_journal 2024-09-19T14:11:12.616 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_device 2024-09-19T14:11:12.616 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_backref 2024-09-19T14:11:12.616 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 alienstore 2024-09-19T14:11:12.616 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mclock 2024-09-19T14:11:12.616 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cyanstore 2024-09-19T14:11:12.617 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 ceph_exporter 2024-09-19T14:11:12.617 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 memstore 2024-09-19T14:11:12.617 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 trace 2024-09-19T14:11:12.617 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 ceph_dedup 2024-09-19T14:11:12.617 INFO:tasks.workunit.client.0.smithi153.stderr: -2/-2 (syslog threshold) 2024-09-19T14:11:12.617 INFO:tasks.workunit.client.0.smithi153.stderr: 99/99 (stderr threshold) 2024-09-19T14:11:12.617 INFO:tasks.workunit.client.0.smithi153.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:11:12.617 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa4a0fe1640 / http_manager 2024-09-19T14:11:12.617 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa4a2fe5640 / http_manager 2024-09-19T14:11:12.617 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa4a3fe7640 / rgw_dt_lg_renew 2024-09-19T14:11:12.617 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa4beffd640 / ms_dispatch 2024-09-19T14:11:12.617 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa4d0ff9640 / io_context_pool 2024-09-19T14:11:12.617 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa4d2ffd640 / ms_dispatch 2024-09-19T14:11:12.617 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa4d9e03640 / ms_dispatch 2024-09-19T14:11:12.618 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa4db606640 / io_context_pool 2024-09-19T14:11:12.618 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa5ecc84640 / msgr-worker-2 2024-09-19T14:11:12.618 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa5ed485640 / msgr-worker-1 2024-09-19T14:11:12.618 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa5edc86640 / msgr-worker-0 2024-09-19T14:11:12.618 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa5ee487640 / io_context_pool 2024-09-19T14:11:12.618 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa5ef97f9c0 / radosgw-admin 2024-09-19T14:11:12.618 INFO:tasks.workunit.client.0.smithi153.stderr: max_recent 500 2024-09-19T14:11:12.618 INFO:tasks.workunit.client.0.smithi153.stderr: max_new 1000 2024-09-19T14:11:12.618 INFO:tasks.workunit.client.0.smithi153.stderr: log_file /var/log/ceph/ceph-client.admin.134666.log 2024-09-19T14:11:12.618 INFO:tasks.workunit.client.0.smithi153.stderr:--- end dump of recent events --- 2024-09-19T14:11:12.618 INFO:tasks.workunit.client.0.smithi153.stderr:--- begin dump of recent events --- 2024-09-19T14:11:12.618 INFO:tasks.workunit.client.0.smithi153.stderr: -499> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 1 librados: setting wanted keys 2024-09-19T14:11:12.618 INFO:tasks.workunit.client.0.smithi153.stderr: -498> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 1 librados: calling monclient init 2024-09-19T14:11:12.619 INFO:tasks.workunit.client.0.smithi153.stderr: -497> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 10 monclient: init 2024-09-19T14:11:12.619 INFO:tasks.workunit.client.0.smithi153.stderr: -496> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding auth protocol: cephx 2024-09-19T14:11:12.619 INFO:tasks.workunit.client.0.smithi153.stderr: -495> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding auth protocol: cephx 2024-09-19T14:11:12.619 INFO:tasks.workunit.client.0.smithi153.stderr: -494> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding auth protocol: cephx 2024-09-19T14:11:12.619 INFO:tasks.workunit.client.0.smithi153.stderr: -493> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding con mode: secure 2024-09-19T14:11:12.619 INFO:tasks.workunit.client.0.smithi153.stderr: -492> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding con mode: crc 2024-09-19T14:11:12.619 INFO:tasks.workunit.client.0.smithi153.stderr: -491> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding con mode: secure 2024-09-19T14:11:12.619 INFO:tasks.workunit.client.0.smithi153.stderr: -490> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding con mode: crc 2024-09-19T14:11:12.619 INFO:tasks.workunit.client.0.smithi153.stderr: -489> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding con mode: secure 2024-09-19T14:11:12.619 INFO:tasks.workunit.client.0.smithi153.stderr: -488> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding con mode: crc 2024-09-19T14:11:12.619 INFO:tasks.workunit.client.0.smithi153.stderr: -487> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding con mode: crc 2024-09-19T14:11:12.619 INFO:tasks.workunit.client.0.smithi153.stderr: -486> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding con mode: secure 2024-09-19T14:11:12.619 INFO:tasks.workunit.client.0.smithi153.stderr: -485> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding con mode: crc 2024-09-19T14:11:12.620 INFO:tasks.workunit.client.0.smithi153.stderr: -484> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding con mode: secure 2024-09-19T14:11:12.620 INFO:tasks.workunit.client.0.smithi153.stderr: -483> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding con mode: crc 2024-09-19T14:11:12.620 INFO:tasks.workunit.client.0.smithi153.stderr: -482> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20af35d0) adding con mode: secure 2024-09-19T14:11:12.620 INFO:tasks.workunit.client.0.smithi153.stderr: -481> 2024-09-19T14:11:12.420+0000 7fa5ef97f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:12.620 INFO:tasks.workunit.client.0.smithi153.stderr: -480> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:12.620 INFO:tasks.workunit.client.0.smithi153.stderr: -479> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command rotate-key hook 0x561b20af3718 2024-09-19T14:11:12.620 INFO:tasks.workunit.client.0.smithi153.stderr: -478> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient: _reopen_session rank -1 2024-09-19T14:11:12.620 INFO:tasks.workunit.client.0.smithi153.stderr: -477> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T14:11:12.620 INFO:tasks.workunit.client.0.smithi153.stderr: -476> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient(hunting): picked mon.noname-a con 0x561b20af6c40 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:11:12.620 INFO:tasks.workunit.client.0.smithi153.stderr: -475> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient(hunting): picked mon.noname-c con 0x561b20af9de0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:11:12.620 INFO:tasks.workunit.client.0.smithi153.stderr: -474> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient(hunting): picked mon.noname-b con 0x7fa5d80023c0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:11:12.620 INFO:tasks.workunit.client.0.smithi153.stderr: -473> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:12.621 INFO:tasks.workunit.client.0.smithi153.stderr: -472> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:12.621 INFO:tasks.workunit.client.0.smithi153.stderr: -471> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:12.621 INFO:tasks.workunit.client.0.smithi153.stderr: -470> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient(hunting): _renew_subs 2024-09-19T14:11:12.621 INFO:tasks.workunit.client.0.smithi153.stderr: -469> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient(hunting): authenticate will time out at 2860.888462s 2024-09-19T14:11:12.621 INFO:tasks.workunit.client.0.smithi153.stderr: -468> 2024-09-19T14:11:12.424+0000 7fa5ed485640 10 monclient(hunting): get_auth_request con 0x561b20af6c40 auth_method 0 2024-09-19T14:11:12.621 INFO:tasks.workunit.client.0.smithi153.stderr: -467> 2024-09-19T14:11:12.424+0000 7fa5ed485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:12.621 INFO:tasks.workunit.client.0.smithi153.stderr: -466> 2024-09-19T14:11:12.424+0000 7fa5ed485640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:12.621 INFO:tasks.workunit.client.0.smithi153.stderr: -465> 2024-09-19T14:11:12.424+0000 7fa5ed485640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:12.621 INFO:tasks.workunit.client.0.smithi153.stderr: -464> 2024-09-19T14:11:12.424+0000 7fa5ecc84640 10 monclient(hunting): get_auth_request con 0x561b20af9de0 auth_method 0 2024-09-19T14:11:12.621 INFO:tasks.workunit.client.0.smithi153.stderr: -463> 2024-09-19T14:11:12.424+0000 7fa5ecc84640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:12.621 INFO:tasks.workunit.client.0.smithi153.stderr: -462> 2024-09-19T14:11:12.424+0000 7fa5ecc84640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:12.621 INFO:tasks.workunit.client.0.smithi153.stderr: -461> 2024-09-19T14:11:12.424+0000 7fa5ecc84640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:12.621 INFO:tasks.workunit.client.0.smithi153.stderr: -460> 2024-09-19T14:11:12.424+0000 7fa5ed485640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:12.622 INFO:tasks.workunit.client.0.smithi153.stderr: -459> 2024-09-19T14:11:12.424+0000 7fa5ed485640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:12.622 INFO:tasks.workunit.client.0.smithi153.stderr: -458> 2024-09-19T14:11:12.424+0000 7fa5ed485640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:12.622 INFO:tasks.workunit.client.0.smithi153.stderr: -457> 2024-09-19T14:11:12.424+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:12.622 INFO:tasks.workunit.client.0.smithi153.stderr: -456> 2024-09-19T14:11:12.424+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:12.622 INFO:tasks.workunit.client.0.smithi153.stderr: -455> 2024-09-19T14:11:12.424+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:12.622 INFO:tasks.workunit.client.0.smithi153.stderr: -454> 2024-09-19T14:11:12.424+0000 7fa5ed485640 10 monclient(hunting): handle_auth_done global_id 7944 payload 824 2024-09-19T14:11:12.622 INFO:tasks.workunit.client.0.smithi153.stderr: -453> 2024-09-19T14:11:12.424+0000 7fa5ed485640 10 monclient: _finish_hunting 0 2024-09-19T14:11:12.622 INFO:tasks.workunit.client.0.smithi153.stderr: -452> 2024-09-19T14:11:12.424+0000 7fa5ed485640 1 monclient: found mon.noname-a 2024-09-19T14:11:12.622 INFO:tasks.workunit.client.0.smithi153.stderr: -451> 2024-09-19T14:11:12.424+0000 7fa5ed485640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:11:12.622 INFO:tasks.workunit.client.0.smithi153.stderr: -450> 2024-09-19T14:11:12.424+0000 7fa4d9e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:12.622 INFO:tasks.workunit.client.0.smithi153.stderr: -449> 2024-09-19T14:11:12.424+0000 7fa4d9e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:11:12.622 INFO:tasks.workunit.client.0.smithi153.stderr: -448> 2024-09-19T14:11:12.424+0000 7fa4d9e03640 10 monclient: dump: 2024-09-19T14:11:12.622 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:12.622 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:12.623 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.623 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.623 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:12.623 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:12.623 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:12.623 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:12.623 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:12.623 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.623 INFO:tasks.workunit.client.0.smithi153.stderr: -447> 2024-09-19T14:11:12.424+0000 7fa4d9e03640 10 monclient: _finish_auth 0 2024-09-19T14:11:12.623 INFO:tasks.workunit.client.0.smithi153.stderr: -446> 2024-09-19T14:11:12.424+0000 7fa4d9e03640 10 monclient: _check_auth_tickets 2024-09-19T14:11:12.623 INFO:tasks.workunit.client.0.smithi153.stderr: -445> 2024-09-19T14:11:12.424+0000 7fa4d9e03640 10 monclient: handle_config config(0 keys) 2024-09-19T14:11:12.623 INFO:tasks.workunit.client.0.smithi153.stderr: -444> 2024-09-19T14:11:12.424+0000 7fa4d9e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:12.623 INFO:tasks.workunit.client.0.smithi153.stderr: -443> 2024-09-19T14:11:12.424+0000 7fa4d9e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:11:12.623 INFO:tasks.workunit.client.0.smithi153.stderr: -442> 2024-09-19T14:11:12.424+0000 7fa4d9e03640 10 monclient: dump: 2024-09-19T14:11:12.623 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:12.624 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:12.624 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.624 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.624 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:12.624 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:12.624 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:12.624 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:12.624 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:12.624 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.624 INFO:tasks.workunit.client.0.smithi153.stderr: -441> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 5 monclient: authenticate success, global_id 7944 2024-09-19T14:11:12.624 INFO:tasks.workunit.client.0.smithi153.stderr: -440> 2024-09-19T14:11:12.424+0000 7fa4db606640 4 set_mon_vals no callback set 2024-09-19T14:11:12.624 INFO:tasks.workunit.client.0.smithi153.stderr: -439> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient: _renew_subs 2024-09-19T14:11:12.624 INFO:tasks.workunit.client.0.smithi153.stderr: -438> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:11:12.624 INFO:tasks.workunit.client.0.smithi153.stderr: -437> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient: _renew_subs 2024-09-19T14:11:12.624 INFO:tasks.workunit.client.0.smithi153.stderr: -436> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:11:12.625 INFO:tasks.workunit.client.0.smithi153.stderr: -435> 2024-09-19T14:11:12.424+0000 7fa5ef97f9c0 1 librados: init done 2024-09-19T14:11:12.625 INFO:tasks.workunit.client.0.smithi153.stderr: -434> 2024-09-19T14:11:12.424+0000 7fa4d9e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:11:12.625 INFO:tasks.workunit.client.0.smithi153.stderr: -433> 2024-09-19T14:11:12.424+0000 7fa4d9e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:11:12.625 INFO:tasks.workunit.client.0.smithi153.stderr: -432> 2024-09-19T14:11:12.424+0000 7fa4d9e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:11:12.625 INFO:tasks.workunit.client.0.smithi153.stderr: -431> 2024-09-19T14:11:12.424+0000 7fa5ecc84640 10 monclient: get_auth_request con 0x7fa4d4071be0 auth_method 0 2024-09-19T14:11:12.625 INFO:tasks.workunit.client.0.smithi153.stderr: -430> 2024-09-19T14:11:12.424+0000 7fa5edc86640 10 monclient: get_auth_request con 0x561b20b33640 auth_method 0 2024-09-19T14:11:12.625 INFO:tasks.workunit.client.0.smithi153.stderr: -429> 2024-09-19T14:11:12.428+0000 7fa5ed485640 10 monclient: get_auth_request con 0x561b20b3ca70 auth_method 0 2024-09-19T14:11:12.625 INFO:tasks.workunit.client.0.smithi153.stderr: -428> 2024-09-19T14:11:12.428+0000 7fa5ecc84640 10 monclient: get_auth_request con 0x561b20b41b00 auth_method 0 2024-09-19T14:11:12.625 INFO:tasks.workunit.client.0.smithi153.stderr: -427> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient: build_initial_monmap 2024-09-19T14:11:12.625 INFO:tasks.workunit.client.0.smithi153.stderr: -426> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 1 build_initial for_mkfs: 0 2024-09-19T14:11:12.625 INFO:tasks.workunit.client.0.smithi153.stderr: -425> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient: monmap: 2024-09-19T14:11:12.625 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:11:12.625 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:11:12.625 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:11:12.626 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:11:12.626 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:11:12.626 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:12.626 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:11:12.626 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:11:12.626 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:11:12.626 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.626 INFO:tasks.workunit.client.0.smithi153.stderr: -424> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding auth protocol: cephx 2024-09-19T14:11:12.626 INFO:tasks.workunit.client.0.smithi153.stderr: -423> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding auth protocol: cephx 2024-09-19T14:11:12.626 INFO:tasks.workunit.client.0.smithi153.stderr: -422> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding auth protocol: cephx 2024-09-19T14:11:12.626 INFO:tasks.workunit.client.0.smithi153.stderr: -421> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding con mode: secure 2024-09-19T14:11:12.626 INFO:tasks.workunit.client.0.smithi153.stderr: -420> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding con mode: crc 2024-09-19T14:11:12.626 INFO:tasks.workunit.client.0.smithi153.stderr: -419> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding con mode: secure 2024-09-19T14:11:12.627 INFO:tasks.workunit.client.0.smithi153.stderr: -418> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding con mode: crc 2024-09-19T14:11:12.627 INFO:tasks.workunit.client.0.smithi153.stderr: -417> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding con mode: secure 2024-09-19T14:11:12.627 INFO:tasks.workunit.client.0.smithi153.stderr: -416> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding con mode: crc 2024-09-19T14:11:12.627 INFO:tasks.workunit.client.0.smithi153.stderr: -415> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding con mode: crc 2024-09-19T14:11:12.627 INFO:tasks.workunit.client.0.smithi153.stderr: -414> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding con mode: secure 2024-09-19T14:11:12.627 INFO:tasks.workunit.client.0.smithi153.stderr: -413> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding con mode: crc 2024-09-19T14:11:12.627 INFO:tasks.workunit.client.0.smithi153.stderr: -412> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding con mode: secure 2024-09-19T14:11:12.627 INFO:tasks.workunit.client.0.smithi153.stderr: -411> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding con mode: crc 2024-09-19T14:11:12.627 INFO:tasks.workunit.client.0.smithi153.stderr: -410> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b45960) adding con mode: secure 2024-09-19T14:11:12.627 INFO:tasks.workunit.client.0.smithi153.stderr: -409> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:12.627 INFO:tasks.workunit.client.0.smithi153.stderr: -408> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command objecter_requests cmddesc objecter_requests hook 0x561b20b49310 EEXIST 2024-09-19T14:11:12.627 INFO:tasks.workunit.client.0.smithi153.stderr: -407> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient: init 2024-09-19T14:11:12.627 INFO:tasks.workunit.client.0.smithi153.stderr: -406> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding auth protocol: cephx 2024-09-19T14:11:12.627 INFO:tasks.workunit.client.0.smithi153.stderr: -405> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding auth protocol: cephx 2024-09-19T14:11:12.628 INFO:tasks.workunit.client.0.smithi153.stderr: -404> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding auth protocol: cephx 2024-09-19T14:11:12.628 INFO:tasks.workunit.client.0.smithi153.stderr: -403> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding con mode: secure 2024-09-19T14:11:12.628 INFO:tasks.workunit.client.0.smithi153.stderr: -402> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding con mode: crc 2024-09-19T14:11:12.628 INFO:tasks.workunit.client.0.smithi153.stderr: -401> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding con mode: secure 2024-09-19T14:11:12.628 INFO:tasks.workunit.client.0.smithi153.stderr: -400> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding con mode: crc 2024-09-19T14:11:12.628 INFO:tasks.workunit.client.0.smithi153.stderr: -399> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding con mode: secure 2024-09-19T14:11:12.628 INFO:tasks.workunit.client.0.smithi153.stderr: -398> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding con mode: crc 2024-09-19T14:11:12.628 INFO:tasks.workunit.client.0.smithi153.stderr: -397> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding con mode: crc 2024-09-19T14:11:12.628 INFO:tasks.workunit.client.0.smithi153.stderr: -396> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding con mode: secure 2024-09-19T14:11:12.628 INFO:tasks.workunit.client.0.smithi153.stderr: -395> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding con mode: crc 2024-09-19T14:11:12.628 INFO:tasks.workunit.client.0.smithi153.stderr: -394> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding con mode: secure 2024-09-19T14:11:12.628 INFO:tasks.workunit.client.0.smithi153.stderr: -393> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding con mode: crc 2024-09-19T14:11:12.628 INFO:tasks.workunit.client.0.smithi153.stderr: -392> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b449a8) adding con mode: secure 2024-09-19T14:11:12.628 INFO:tasks.workunit.client.0.smithi153.stderr: -391> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:12.629 INFO:tasks.workunit.client.0.smithi153.stderr: -390> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:12.629 INFO:tasks.workunit.client.0.smithi153.stderr: -389> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command rotate-key cmddesc rotate-key hook 0x561b20b44af0 EEXIST 2024-09-19T14:11:12.629 INFO:tasks.workunit.client.0.smithi153.stderr: -388> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient: _reopen_session rank -1 2024-09-19T14:11:12.629 INFO:tasks.workunit.client.0.smithi153.stderr: -387> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:11:12.629 INFO:tasks.workunit.client.0.smithi153.stderr: -386> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient(hunting): picked mon.noname-b con 0x561b20b6d4c0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:11:12.629 INFO:tasks.workunit.client.0.smithi153.stderr: -385> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient(hunting): picked mon.noname-a con 0x561b20b6cdf0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:11:12.629 INFO:tasks.workunit.client.0.smithi153.stderr: -384> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient(hunting): picked mon.noname-c con 0x561b20b6b7d0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:11:12.629 INFO:tasks.workunit.client.0.smithi153.stderr: -383> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:12.629 INFO:tasks.workunit.client.0.smithi153.stderr: -382> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:12.629 INFO:tasks.workunit.client.0.smithi153.stderr: -381> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:12.629 INFO:tasks.workunit.client.0.smithi153.stderr: -380> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient(hunting): _renew_subs 2024-09-19T14:11:12.629 INFO:tasks.workunit.client.0.smithi153.stderr: -379> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient(hunting): authenticate will time out at 2860.898208s 2024-09-19T14:11:12.629 INFO:tasks.workunit.client.0.smithi153.stderr: -378> 2024-09-19T14:11:12.432+0000 7fa5edc86640 10 monclient(hunting): get_auth_request con 0x561b20b6b7d0 auth_method 0 2024-09-19T14:11:12.629 INFO:tasks.workunit.client.0.smithi153.stderr: -377> 2024-09-19T14:11:12.432+0000 7fa5edc86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:12.629 INFO:tasks.workunit.client.0.smithi153.stderr: -376> 2024-09-19T14:11:12.432+0000 7fa5edc86640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:12.630 INFO:tasks.workunit.client.0.smithi153.stderr: -375> 2024-09-19T14:11:12.432+0000 7fa5edc86640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:12.630 INFO:tasks.workunit.client.0.smithi153.stderr: -374> 2024-09-19T14:11:12.432+0000 7fa5ecc84640 10 monclient(hunting): get_auth_request con 0x561b20b6cdf0 auth_method 0 2024-09-19T14:11:12.630 INFO:tasks.workunit.client.0.smithi153.stderr: -373> 2024-09-19T14:11:12.432+0000 7fa5ecc84640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:12.630 INFO:tasks.workunit.client.0.smithi153.stderr: -372> 2024-09-19T14:11:12.432+0000 7fa5ecc84640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:12.630 INFO:tasks.workunit.client.0.smithi153.stderr: -371> 2024-09-19T14:11:12.432+0000 7fa5ecc84640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:12.630 INFO:tasks.workunit.client.0.smithi153.stderr: -370> 2024-09-19T14:11:12.432+0000 7fa5edc86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:12.630 INFO:tasks.workunit.client.0.smithi153.stderr: -369> 2024-09-19T14:11:12.432+0000 7fa5edc86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:12.630 INFO:tasks.workunit.client.0.smithi153.stderr: -368> 2024-09-19T14:11:12.432+0000 7fa5edc86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:12.630 INFO:tasks.workunit.client.0.smithi153.stderr: -367> 2024-09-19T14:11:12.432+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:12.630 INFO:tasks.workunit.client.0.smithi153.stderr: -366> 2024-09-19T14:11:12.432+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:12.630 INFO:tasks.workunit.client.0.smithi153.stderr: -365> 2024-09-19T14:11:12.432+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:12.630 INFO:tasks.workunit.client.0.smithi153.stderr: -364> 2024-09-19T14:11:12.432+0000 7fa5ed485640 10 monclient(hunting): get_auth_request con 0x561b20b6d4c0 auth_method 0 2024-09-19T14:11:12.630 INFO:tasks.workunit.client.0.smithi153.stderr: -363> 2024-09-19T14:11:12.432+0000 7fa5ed485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:12.631 INFO:tasks.workunit.client.0.smithi153.stderr: -362> 2024-09-19T14:11:12.432+0000 7fa5ed485640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:12.631 INFO:tasks.workunit.client.0.smithi153.stderr: -361> 2024-09-19T14:11:12.432+0000 7fa5ed485640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:12.631 INFO:tasks.workunit.client.0.smithi153.stderr: -360> 2024-09-19T14:11:12.432+0000 7fa5edc86640 10 monclient(hunting): handle_auth_done global_id 7430 payload 824 2024-09-19T14:11:12.631 INFO:tasks.workunit.client.0.smithi153.stderr: -359> 2024-09-19T14:11:12.432+0000 7fa5edc86640 10 monclient: _finish_hunting 0 2024-09-19T14:11:12.631 INFO:tasks.workunit.client.0.smithi153.stderr: -358> 2024-09-19T14:11:12.432+0000 7fa5edc86640 1 monclient: found mon.noname-c 2024-09-19T14:11:12.631 INFO:tasks.workunit.client.0.smithi153.stderr: -357> 2024-09-19T14:11:12.432+0000 7fa5edc86640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:11:12.631 INFO:tasks.workunit.client.0.smithi153.stderr: -356> 2024-09-19T14:11:12.432+0000 7fa4d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:12.631 INFO:tasks.workunit.client.0.smithi153.stderr: -355> 2024-09-19T14:11:12.432+0000 7fa4d2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:11:12.631 INFO:tasks.workunit.client.0.smithi153.stderr: -354> 2024-09-19T14:11:12.432+0000 7fa4d2ffd640 10 monclient: dump: 2024-09-19T14:11:12.631 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:12.631 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:12.631 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.631 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.631 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:12.632 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:12.632 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:12.632 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:12.632 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:12.632 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.632 INFO:tasks.workunit.client.0.smithi153.stderr: -353> 2024-09-19T14:11:12.432+0000 7fa4d2ffd640 10 monclient: _finish_auth 0 2024-09-19T14:11:12.632 INFO:tasks.workunit.client.0.smithi153.stderr: -352> 2024-09-19T14:11:12.432+0000 7fa4d2ffd640 10 monclient: _check_auth_tickets 2024-09-19T14:11:12.632 INFO:tasks.workunit.client.0.smithi153.stderr: -351> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 5 monclient: authenticate success, global_id 7430 2024-09-19T14:11:12.632 INFO:tasks.workunit.client.0.smithi153.stderr: -350> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient: _renew_subs 2024-09-19T14:11:12.632 INFO:tasks.workunit.client.0.smithi153.stderr: -349> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:11:12.632 INFO:tasks.workunit.client.0.smithi153.stderr: -348> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient: _renew_subs 2024-09-19T14:11:12.632 INFO:tasks.workunit.client.0.smithi153.stderr: -347> 2024-09-19T14:11:12.432+0000 7fa5ef97f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:11:12.632 INFO:tasks.workunit.client.0.smithi153.stderr: -346> 2024-09-19T14:11:12.432+0000 7fa4d2ffd640 10 monclient: handle_config config(0 keys) 2024-09-19T14:11:12.633 INFO:tasks.workunit.client.0.smithi153.stderr: -345> 2024-09-19T14:11:12.432+0000 7fa4d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:12.633 INFO:tasks.workunit.client.0.smithi153.stderr: -344> 2024-09-19T14:11:12.432+0000 7fa4d2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:11:12.633 INFO:tasks.workunit.client.0.smithi153.stderr: -343> 2024-09-19T14:11:12.432+0000 7fa4d2ffd640 10 monclient: dump: 2024-09-19T14:11:12.633 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:12.633 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:12.633 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.633 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.633 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:12.633 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:12.633 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:12.633 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:12.633 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:12.633 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.633 INFO:tasks.workunit.client.0.smithi153.stderr: -342> 2024-09-19T14:11:12.432+0000 7fa5ee487640 4 set_mon_vals no callback set 2024-09-19T14:11:12.634 INFO:tasks.workunit.client.0.smithi153.stderr: -341> 2024-09-19T14:11:12.436+0000 7fa4d2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:11:12.634 INFO:tasks.workunit.client.0.smithi153.stderr: -340> 2024-09-19T14:11:12.436+0000 7fa4d2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:11:12.634 INFO:tasks.workunit.client.0.smithi153.stderr: -339> 2024-09-19T14:11:12.436+0000 7fa4d2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:11:12.634 INFO:tasks.workunit.client.0.smithi153.stderr: -338> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient: get_monmap_and_config 2024-09-19T14:11:12.634 INFO:tasks.workunit.client.0.smithi153.stderr: -337> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient: build_initial_monmap 2024-09-19T14:11:12.634 INFO:tasks.workunit.client.0.smithi153.stderr: -336> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 1 build_initial for_mkfs: 0 2024-09-19T14:11:12.634 INFO:tasks.workunit.client.0.smithi153.stderr: -335> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient: monmap: 2024-09-19T14:11:12.634 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:11:12.634 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:11:12.634 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:11:12.634 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:11:12.634 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:11:12.634 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:12.634 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:11:12.635 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:11:12.635 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:11:12.635 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.635 INFO:tasks.workunit.client.0.smithi153.stderr: -334> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding auth protocol: cephx 2024-09-19T14:11:12.635 INFO:tasks.workunit.client.0.smithi153.stderr: -333> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding auth protocol: cephx 2024-09-19T14:11:12.635 INFO:tasks.workunit.client.0.smithi153.stderr: -332> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding auth protocol: cephx 2024-09-19T14:11:12.635 INFO:tasks.workunit.client.0.smithi153.stderr: -331> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding con mode: secure 2024-09-19T14:11:12.635 INFO:tasks.workunit.client.0.smithi153.stderr: -330> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding con mode: crc 2024-09-19T14:11:12.635 INFO:tasks.workunit.client.0.smithi153.stderr: -329> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding con mode: secure 2024-09-19T14:11:12.635 INFO:tasks.workunit.client.0.smithi153.stderr: -328> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding con mode: crc 2024-09-19T14:11:12.635 INFO:tasks.workunit.client.0.smithi153.stderr: -327> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding con mode: secure 2024-09-19T14:11:12.635 INFO:tasks.workunit.client.0.smithi153.stderr: -326> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding con mode: crc 2024-09-19T14:11:12.635 INFO:tasks.workunit.client.0.smithi153.stderr: -325> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding con mode: crc 2024-09-19T14:11:12.636 INFO:tasks.workunit.client.0.smithi153.stderr: -324> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding con mode: secure 2024-09-19T14:11:12.636 INFO:tasks.workunit.client.0.smithi153.stderr: -323> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding con mode: crc 2024-09-19T14:11:12.636 INFO:tasks.workunit.client.0.smithi153.stderr: -322> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding con mode: secure 2024-09-19T14:11:12.636 INFO:tasks.workunit.client.0.smithi153.stderr: -321> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding con mode: crc 2024-09-19T14:11:12.636 INFO:tasks.workunit.client.0.smithi153.stderr: -320> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b8cd30) adding con mode: secure 2024-09-19T14:11:12.636 INFO:tasks.workunit.client.0.smithi153.stderr: -319> 2024-09-19T14:11:12.436+0000 7fa5ed485640 10 monclient: get_auth_request con 0x7fa4c8071b20 auth_method 0 2024-09-19T14:11:12.636 INFO:tasks.workunit.client.0.smithi153.stderr: -318> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:12.636 INFO:tasks.workunit.client.0.smithi153.stderr: -317> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient: init 2024-09-19T14:11:12.636 INFO:tasks.workunit.client.0.smithi153.stderr: -316> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding auth protocol: cephx 2024-09-19T14:11:12.636 INFO:tasks.workunit.client.0.smithi153.stderr: -315> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding auth protocol: cephx 2024-09-19T14:11:12.636 INFO:tasks.workunit.client.0.smithi153.stderr: -314> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding auth protocol: cephx 2024-09-19T14:11:12.636 INFO:tasks.workunit.client.0.smithi153.stderr: -313> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding con mode: secure 2024-09-19T14:11:12.636 INFO:tasks.workunit.client.0.smithi153.stderr: -312> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding con mode: crc 2024-09-19T14:11:12.637 INFO:tasks.workunit.client.0.smithi153.stderr: -311> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding con mode: secure 2024-09-19T14:11:12.637 INFO:tasks.workunit.client.0.smithi153.stderr: -310> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding con mode: crc 2024-09-19T14:11:12.637 INFO:tasks.workunit.client.0.smithi153.stderr: -309> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding con mode: secure 2024-09-19T14:11:12.637 INFO:tasks.workunit.client.0.smithi153.stderr: -308> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding con mode: crc 2024-09-19T14:11:12.637 INFO:tasks.workunit.client.0.smithi153.stderr: -307> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding con mode: crc 2024-09-19T14:11:12.637 INFO:tasks.workunit.client.0.smithi153.stderr: -306> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding con mode: secure 2024-09-19T14:11:12.637 INFO:tasks.workunit.client.0.smithi153.stderr: -305> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding con mode: crc 2024-09-19T14:11:12.637 INFO:tasks.workunit.client.0.smithi153.stderr: -304> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding con mode: secure 2024-09-19T14:11:12.637 INFO:tasks.workunit.client.0.smithi153.stderr: -303> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding con mode: crc 2024-09-19T14:11:12.637 INFO:tasks.workunit.client.0.smithi153.stderr: -302> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f14b0) adding con mode: secure 2024-09-19T14:11:12.637 INFO:tasks.workunit.client.0.smithi153.stderr: -301> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:12.637 INFO:tasks.workunit.client.0.smithi153.stderr: -300> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:12.638 INFO:tasks.workunit.client.0.smithi153.stderr: -299> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command rotate-key cmddesc rotate-key hook 0x7ffee17f15f8 EEXIST 2024-09-19T14:11:12.638 INFO:tasks.workunit.client.0.smithi153.stderr: -298> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient: _reopen_session rank -1 2024-09-19T14:11:12.638 INFO:tasks.workunit.client.0.smithi153.stderr: -297> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T14:11:12.638 INFO:tasks.workunit.client.0.smithi153.stderr: -296> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient(hunting): picked mon.noname-b con 0x561b20bc12a0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:11:12.638 INFO:tasks.workunit.client.0.smithi153.stderr: -295> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient(hunting): picked mon.noname-c con 0x561b20b911c0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:11:12.638 INFO:tasks.workunit.client.0.smithi153.stderr: -294> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient(hunting): picked mon.noname-a con 0x561b20b92280 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:11:12.638 INFO:tasks.workunit.client.0.smithi153.stderr: -293> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:12.638 INFO:tasks.workunit.client.0.smithi153.stderr: -292> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:12.638 INFO:tasks.workunit.client.0.smithi153.stderr: -291> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:12.638 INFO:tasks.workunit.client.0.smithi153.stderr: -290> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient(hunting): _renew_subs 2024-09-19T14:11:12.638 INFO:tasks.workunit.client.0.smithi153.stderr: -289> 2024-09-19T14:11:12.436+0000 7fa5ef97f9c0 10 monclient(hunting): authenticate will time out at 2860.903234s 2024-09-19T14:11:12.638 INFO:tasks.workunit.client.0.smithi153.stderr: -288> 2024-09-19T14:11:12.436+0000 7fa5ecc84640 10 monclient(hunting): get_auth_request con 0x561b20b911c0 auth_method 0 2024-09-19T14:11:12.638 INFO:tasks.workunit.client.0.smithi153.stderr: -287> 2024-09-19T14:11:12.436+0000 7fa5ecc84640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:12.638 INFO:tasks.workunit.client.0.smithi153.stderr: -286> 2024-09-19T14:11:12.436+0000 7fa5ecc84640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:12.638 INFO:tasks.workunit.client.0.smithi153.stderr: -285> 2024-09-19T14:11:12.436+0000 7fa5ecc84640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:12.639 INFO:tasks.workunit.client.0.smithi153.stderr: -284> 2024-09-19T14:11:12.436+0000 7fa5edc86640 10 monclient(hunting): get_auth_request con 0x561b20b92280 auth_method 0 2024-09-19T14:11:12.639 INFO:tasks.workunit.client.0.smithi153.stderr: -283> 2024-09-19T14:11:12.436+0000 7fa5edc86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:12.639 INFO:tasks.workunit.client.0.smithi153.stderr: -282> 2024-09-19T14:11:12.436+0000 7fa5edc86640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:12.639 INFO:tasks.workunit.client.0.smithi153.stderr: -281> 2024-09-19T14:11:12.436+0000 7fa5edc86640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:12.639 INFO:tasks.workunit.client.0.smithi153.stderr: -280> 2024-09-19T14:11:12.436+0000 7fa5edc86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:12.639 INFO:tasks.workunit.client.0.smithi153.stderr: -279> 2024-09-19T14:11:12.436+0000 7fa5edc86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:12.639 INFO:tasks.workunit.client.0.smithi153.stderr: -278> 2024-09-19T14:11:12.436+0000 7fa5edc86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:12.639 INFO:tasks.workunit.client.0.smithi153.stderr: -277> 2024-09-19T14:11:12.436+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:12.639 INFO:tasks.workunit.client.0.smithi153.stderr: -276> 2024-09-19T14:11:12.436+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:12.639 INFO:tasks.workunit.client.0.smithi153.stderr: -275> 2024-09-19T14:11:12.436+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:12.639 INFO:tasks.workunit.client.0.smithi153.stderr: -274> 2024-09-19T14:11:12.436+0000 7fa5ed485640 10 monclient(hunting): get_auth_request con 0x561b20bc12a0 auth_method 0 2024-09-19T14:11:12.639 INFO:tasks.workunit.client.0.smithi153.stderr: -273> 2024-09-19T14:11:12.436+0000 7fa5ed485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:12.639 INFO:tasks.workunit.client.0.smithi153.stderr: -272> 2024-09-19T14:11:12.436+0000 7fa5ed485640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:12.640 INFO:tasks.workunit.client.0.smithi153.stderr: -271> 2024-09-19T14:11:12.436+0000 7fa5ed485640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:12.640 INFO:tasks.workunit.client.0.smithi153.stderr: -270> 2024-09-19T14:11:12.436+0000 7fa5edc86640 10 monclient(hunting): handle_auth_done global_id 7950 payload 274 2024-09-19T14:11:12.640 INFO:tasks.workunit.client.0.smithi153.stderr: -269> 2024-09-19T14:11:12.436+0000 7fa5edc86640 10 monclient: _finish_hunting 0 2024-09-19T14:11:12.640 INFO:tasks.workunit.client.0.smithi153.stderr: -268> 2024-09-19T14:11:12.436+0000 7fa5edc86640 1 monclient: found mon.noname-a 2024-09-19T14:11:12.640 INFO:tasks.workunit.client.0.smithi153.stderr: -267> 2024-09-19T14:11:12.436+0000 7fa5edc86640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:11:12.640 INFO:tasks.workunit.client.0.smithi153.stderr: -266> 2024-09-19T14:11:12.436+0000 7fa4d0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:12.640 INFO:tasks.workunit.client.0.smithi153.stderr: -265> 2024-09-19T14:11:12.440+0000 7fa4d0ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:11:12.640 INFO:tasks.workunit.client.0.smithi153.stderr: -264> 2024-09-19T14:11:12.440+0000 7fa4d0ff9640 10 monclient: dump: 2024-09-19T14:11:12.640 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:12.640 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:12.640 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.640 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.641 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:12.641 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:12.641 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:12.641 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:12.641 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:12.641 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.641 INFO:tasks.workunit.client.0.smithi153.stderr: -263> 2024-09-19T14:11:12.440+0000 7fa4d0ff9640 10 monclient: _finish_auth 0 2024-09-19T14:11:12.641 INFO:tasks.workunit.client.0.smithi153.stderr: -262> 2024-09-19T14:11:12.440+0000 7fa4d0ff9640 10 monclient: _check_auth_tickets 2024-09-19T14:11:12.641 INFO:tasks.workunit.client.0.smithi153.stderr: -261> 2024-09-19T14:11:12.440+0000 7fa4d0ff9640 10 monclient: handle_config config(0 keys) 2024-09-19T14:11:12.641 INFO:tasks.workunit.client.0.smithi153.stderr: -260> 2024-09-19T14:11:12.440+0000 7fa4d0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:12.641 INFO:tasks.workunit.client.0.smithi153.stderr: -259> 2024-09-19T14:11:12.440+0000 7fa4d0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:11:12.641 INFO:tasks.workunit.client.0.smithi153.stderr: -258> 2024-09-19T14:11:12.440+0000 7fa4d0ff9640 10 monclient: dump: 2024-09-19T14:11:12.641 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:12.641 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:12.642 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.642 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.642 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:12.642 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:12.642 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:12.642 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:12.642 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:12.642 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.642 INFO:tasks.workunit.client.0.smithi153.stderr: -257> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 monclient: authenticate success, global_id 7950 2024-09-19T14:11:12.642 INFO:tasks.workunit.client.0.smithi153.stderr: -256> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient: get_monmap_and_config success 2024-09-19T14:11:12.642 INFO:tasks.workunit.client.0.smithi153.stderr: -255> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 4 set_mon_vals no callback set 2024-09-19T14:11:12.642 INFO:tasks.workunit.client.0.smithi153.stderr: -254> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient: shutdown 2024-09-19T14:11:12.642 INFO:tasks.workunit.client.0.smithi153.stderr: -253> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient: build_initial_monmap 2024-09-19T14:11:12.642 INFO:tasks.workunit.client.0.smithi153.stderr: -252> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 1 build_initial for_mkfs: 0 2024-09-19T14:11:12.643 INFO:tasks.workunit.client.0.smithi153.stderr: -251> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient: monmap: 2024-09-19T14:11:12.643 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:11:12.643 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:11:12.643 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:11:12.643 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:11:12.643 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:11:12.643 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:12.643 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:11:12.643 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:11:12.643 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:11:12.643 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.643 INFO:tasks.workunit.client.0.smithi153.stderr: -250> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding auth protocol: cephx 2024-09-19T14:11:12.643 INFO:tasks.workunit.client.0.smithi153.stderr: -249> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding auth protocol: cephx 2024-09-19T14:11:12.643 INFO:tasks.workunit.client.0.smithi153.stderr: -248> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding auth protocol: cephx 2024-09-19T14:11:12.644 INFO:tasks.workunit.client.0.smithi153.stderr: -247> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding con mode: secure 2024-09-19T14:11:12.644 INFO:tasks.workunit.client.0.smithi153.stderr: -246> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding con mode: crc 2024-09-19T14:11:12.644 INFO:tasks.workunit.client.0.smithi153.stderr: -245> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding con mode: secure 2024-09-19T14:11:12.644 INFO:tasks.workunit.client.0.smithi153.stderr: -244> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding con mode: crc 2024-09-19T14:11:12.644 INFO:tasks.workunit.client.0.smithi153.stderr: -243> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding con mode: secure 2024-09-19T14:11:12.644 INFO:tasks.workunit.client.0.smithi153.stderr: -242> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding con mode: crc 2024-09-19T14:11:12.644 INFO:tasks.workunit.client.0.smithi153.stderr: -241> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding con mode: crc 2024-09-19T14:11:12.644 INFO:tasks.workunit.client.0.smithi153.stderr: -240> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding con mode: secure 2024-09-19T14:11:12.644 INFO:tasks.workunit.client.0.smithi153.stderr: -239> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding con mode: crc 2024-09-19T14:11:12.644 INFO:tasks.workunit.client.0.smithi153.stderr: -238> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding con mode: secure 2024-09-19T14:11:12.644 INFO:tasks.workunit.client.0.smithi153.stderr: -237> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding con mode: crc 2024-09-19T14:11:12.644 INFO:tasks.workunit.client.0.smithi153.stderr: -236> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20bb3700) adding con mode: secure 2024-09-19T14:11:12.644 INFO:tasks.workunit.client.0.smithi153.stderr: -235> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:12.644 INFO:tasks.workunit.client.0.smithi153.stderr: -234> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 1 librados: starting msgr at 2024-09-19T14:11:12.645 INFO:tasks.workunit.client.0.smithi153.stderr: -233> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 1 librados: starting objecter 2024-09-19T14:11:12.645 INFO:tasks.workunit.client.0.smithi153.stderr: -232> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command objecter_requests cmddesc objecter_requests hook 0x561b20b6edc0 EEXIST 2024-09-19T14:11:12.645 INFO:tasks.workunit.client.0.smithi153.stderr: -231> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 1 librados: setting wanted keys 2024-09-19T14:11:12.645 INFO:tasks.workunit.client.0.smithi153.stderr: -230> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 1 librados: calling monclient init 2024-09-19T14:11:12.645 INFO:tasks.workunit.client.0.smithi153.stderr: -229> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient: init 2024-09-19T14:11:12.645 INFO:tasks.workunit.client.0.smithi153.stderr: -228> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding auth protocol: cephx 2024-09-19T14:11:12.645 INFO:tasks.workunit.client.0.smithi153.stderr: -227> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding auth protocol: cephx 2024-09-19T14:11:12.645 INFO:tasks.workunit.client.0.smithi153.stderr: -226> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding auth protocol: cephx 2024-09-19T14:11:12.645 INFO:tasks.workunit.client.0.smithi153.stderr: -225> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding con mode: secure 2024-09-19T14:11:12.645 INFO:tasks.workunit.client.0.smithi153.stderr: -224> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding con mode: crc 2024-09-19T14:11:12.645 INFO:tasks.workunit.client.0.smithi153.stderr: -223> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding con mode: secure 2024-09-19T14:11:12.645 INFO:tasks.workunit.client.0.smithi153.stderr: -222> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding con mode: crc 2024-09-19T14:11:12.645 INFO:tasks.workunit.client.0.smithi153.stderr: -221> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding con mode: secure 2024-09-19T14:11:12.645 INFO:tasks.workunit.client.0.smithi153.stderr: -220> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding con mode: crc 2024-09-19T14:11:12.645 INFO:tasks.workunit.client.0.smithi153.stderr: -219> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding con mode: crc 2024-09-19T14:11:12.646 INFO:tasks.workunit.client.0.smithi153.stderr: -218> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding con mode: secure 2024-09-19T14:11:12.646 INFO:tasks.workunit.client.0.smithi153.stderr: -217> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding con mode: crc 2024-09-19T14:11:12.646 INFO:tasks.workunit.client.0.smithi153.stderr: -216> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding con mode: secure 2024-09-19T14:11:12.646 INFO:tasks.workunit.client.0.smithi153.stderr: -215> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding con mode: crc 2024-09-19T14:11:12.646 INFO:tasks.workunit.client.0.smithi153.stderr: -214> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 AuthRegistry(0x561b20b6f2e0) adding con mode: secure 2024-09-19T14:11:12.646 INFO:tasks.workunit.client.0.smithi153.stderr: -213> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:12.646 INFO:tasks.workunit.client.0.smithi153.stderr: -212> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:12.646 INFO:tasks.workunit.client.0.smithi153.stderr: -211> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command rotate-key cmddesc rotate-key hook 0x561b20b6f428 EEXIST 2024-09-19T14:11:12.646 INFO:tasks.workunit.client.0.smithi153.stderr: -210> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient: _reopen_session rank -1 2024-09-19T14:11:12.646 INFO:tasks.workunit.client.0.smithi153.stderr: -209> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T14:11:12.646 INFO:tasks.workunit.client.0.smithi153.stderr: -208> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient(hunting): picked mon.noname-c con 0x561b20b92280 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:11:12.646 INFO:tasks.workunit.client.0.smithi153.stderr: -207> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient(hunting): picked mon.noname-a con 0x561b20bc12a0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:11:12.646 INFO:tasks.workunit.client.0.smithi153.stderr: -206> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient(hunting): picked mon.noname-b con 0x561b20bb6ff0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:11:12.646 INFO:tasks.workunit.client.0.smithi153.stderr: -205> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:12.646 INFO:tasks.workunit.client.0.smithi153.stderr: -204> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:12.647 INFO:tasks.workunit.client.0.smithi153.stderr: -203> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:12.647 INFO:tasks.workunit.client.0.smithi153.stderr: -202> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient(hunting): _renew_subs 2024-09-19T14:11:12.647 INFO:tasks.workunit.client.0.smithi153.stderr: -201> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient(hunting): authenticate will time out at 2860.906366s 2024-09-19T14:11:12.647 INFO:tasks.workunit.client.0.smithi153.stderr: -200> 2024-09-19T14:11:12.440+0000 7fa5ecc84640 10 monclient(hunting): get_auth_request con 0x561b20bc12a0 auth_method 0 2024-09-19T14:11:12.647 INFO:tasks.workunit.client.0.smithi153.stderr: -199> 2024-09-19T14:11:12.440+0000 7fa5ecc84640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:12.647 INFO:tasks.workunit.client.0.smithi153.stderr: -198> 2024-09-19T14:11:12.440+0000 7fa5ecc84640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:12.647 INFO:tasks.workunit.client.0.smithi153.stderr: -197> 2024-09-19T14:11:12.440+0000 7fa5ecc84640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:12.647 INFO:tasks.workunit.client.0.smithi153.stderr: -196> 2024-09-19T14:11:12.440+0000 7fa5ed485640 10 monclient(hunting): get_auth_request con 0x561b20b92280 auth_method 0 2024-09-19T14:11:12.647 INFO:tasks.workunit.client.0.smithi153.stderr: -195> 2024-09-19T14:11:12.440+0000 7fa5ed485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:12.647 INFO:tasks.workunit.client.0.smithi153.stderr: -194> 2024-09-19T14:11:12.440+0000 7fa5ed485640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:12.647 INFO:tasks.workunit.client.0.smithi153.stderr: -193> 2024-09-19T14:11:12.440+0000 7fa5ed485640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:12.647 INFO:tasks.workunit.client.0.smithi153.stderr: -192> 2024-09-19T14:11:12.440+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:12.647 INFO:tasks.workunit.client.0.smithi153.stderr: -191> 2024-09-19T14:11:12.440+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:12.647 INFO:tasks.workunit.client.0.smithi153.stderr: -190> 2024-09-19T14:11:12.440+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:12.647 INFO:tasks.workunit.client.0.smithi153.stderr: -189> 2024-09-19T14:11:12.440+0000 7fa5ed485640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:12.648 INFO:tasks.workunit.client.0.smithi153.stderr: -188> 2024-09-19T14:11:12.440+0000 7fa5ed485640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:12.648 INFO:tasks.workunit.client.0.smithi153.stderr: -187> 2024-09-19T14:11:12.440+0000 7fa5ed485640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:12.648 INFO:tasks.workunit.client.0.smithi153.stderr: -186> 2024-09-19T14:11:12.440+0000 7fa5edc86640 10 monclient(hunting): get_auth_request con 0x561b20bb6ff0 auth_method 0 2024-09-19T14:11:12.648 INFO:tasks.workunit.client.0.smithi153.stderr: -185> 2024-09-19T14:11:12.440+0000 7fa5edc86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:12.648 INFO:tasks.workunit.client.0.smithi153.stderr: -184> 2024-09-19T14:11:12.440+0000 7fa5edc86640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:12.648 INFO:tasks.workunit.client.0.smithi153.stderr: -183> 2024-09-19T14:11:12.440+0000 7fa5edc86640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:12.648 INFO:tasks.workunit.client.0.smithi153.stderr: -182> 2024-09-19T14:11:12.440+0000 7fa5ecc84640 10 monclient(hunting): handle_auth_done global_id 7953 payload 824 2024-09-19T14:11:12.648 INFO:tasks.workunit.client.0.smithi153.stderr: -181> 2024-09-19T14:11:12.440+0000 7fa5ecc84640 10 monclient: _finish_hunting 0 2024-09-19T14:11:12.648 INFO:tasks.workunit.client.0.smithi153.stderr: -180> 2024-09-19T14:11:12.440+0000 7fa5ecc84640 1 monclient: found mon.noname-a 2024-09-19T14:11:12.648 INFO:tasks.workunit.client.0.smithi153.stderr: -179> 2024-09-19T14:11:12.440+0000 7fa5ecc84640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:11:12.648 INFO:tasks.workunit.client.0.smithi153.stderr: -178> 2024-09-19T14:11:12.440+0000 7fa4beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:12.648 INFO:tasks.workunit.client.0.smithi153.stderr: -177> 2024-09-19T14:11:12.440+0000 7fa4beffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:11:12.648 INFO:tasks.workunit.client.0.smithi153.stderr: -176> 2024-09-19T14:11:12.440+0000 7fa4beffd640 10 monclient: dump: 2024-09-19T14:11:12.648 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:12.649 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:12.649 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.649 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.649 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:12.649 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:12.649 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:12.649 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:12.649 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:12.649 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.649 INFO:tasks.workunit.client.0.smithi153.stderr: -175> 2024-09-19T14:11:12.440+0000 7fa4beffd640 10 monclient: _finish_auth 0 2024-09-19T14:11:12.649 INFO:tasks.workunit.client.0.smithi153.stderr: -174> 2024-09-19T14:11:12.440+0000 7fa4beffd640 10 monclient: _check_auth_tickets 2024-09-19T14:11:12.649 INFO:tasks.workunit.client.0.smithi153.stderr: -173> 2024-09-19T14:11:12.440+0000 7fa4beffd640 10 monclient: handle_config config(0 keys) 2024-09-19T14:11:12.650 INFO:tasks.workunit.client.0.smithi153.stderr: -172> 2024-09-19T14:11:12.440+0000 7fa4beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:12.650 INFO:tasks.workunit.client.0.smithi153.stderr: -171> 2024-09-19T14:11:12.440+0000 7fa4beffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:11:12.650 INFO:tasks.workunit.client.0.smithi153.stderr: -170> 2024-09-19T14:11:12.440+0000 7fa4beffd640 10 monclient: dump: 2024-09-19T14:11:12.650 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:12.650 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:12.650 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.650 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:12.650 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:12.650 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:12.650 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:12.650 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:12.650 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:12.650 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.650 INFO:tasks.workunit.client.0.smithi153.stderr: -169> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 monclient: authenticate success, global_id 7953 2024-09-19T14:11:12.651 INFO:tasks.workunit.client.0.smithi153.stderr: -168> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient: _renew_subs 2024-09-19T14:11:12.651 INFO:tasks.workunit.client.0.smithi153.stderr: -167> 2024-09-19T14:11:12.440+0000 7fa4d0ff9640 4 set_mon_vals no callback set 2024-09-19T14:11:12.651 INFO:tasks.workunit.client.0.smithi153.stderr: -166> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:11:12.651 INFO:tasks.workunit.client.0.smithi153.stderr: -165> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient: _renew_subs 2024-09-19T14:11:12.651 INFO:tasks.workunit.client.0.smithi153.stderr: -164> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:11:12.651 INFO:tasks.workunit.client.0.smithi153.stderr: -163> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 1 librados: init done 2024-09-19T14:11:12.651 INFO:tasks.workunit.client.0.smithi153.stderr: -162> 2024-09-19T14:11:12.440+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command cr dump hook 0x561b20bb6068 2024-09-19T14:11:12.651 INFO:tasks.workunit.client.0.smithi153.stderr: -161> 2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.651 INFO:tasks.workunit.client.0.smithi153.stderr: -160> 2024-09-19T14:11:12.444+0000 7fa4beffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:11:12.651 INFO:tasks.workunit.client.0.smithi153.stderr: -159> 2024-09-19T14:11:12.444+0000 7fa4beffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:11:12.651 INFO:tasks.workunit.client.0.smithi153.stderr: -158> 2024-09-19T14:11:12.444+0000 7fa4beffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:11:12.651 INFO:tasks.workunit.client.0.smithi153.stderr: -157> 2024-09-19T14:11:12.444+0000 7fa5ed485640 10 monclient: get_auth_request con 0x7fa4b8071c10 auth_method 0 2024-09-19T14:11:12.651 INFO:tasks.workunit.client.0.smithi153.stderr: -156> 2024-09-19T14:11:12.444+0000 7fa5edc86640 10 monclient: get_auth_request con 0x561b20bdb290 auth_method 0 2024-09-19T14:11:12.651 INFO:tasks.workunit.client.0.smithi153.stderr: -155> 2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.652 INFO:tasks.workunit.client.0.smithi153.stderr: -154> 2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 20 realm 2024-09-19T14:11:12.652 INFO:tasks.workunit.client.0.smithi153.stderr: -153> 2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.652 INFO:tasks.workunit.client.0.smithi153.stderr: -152> 2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.652 INFO:tasks.workunit.client.0.smithi153.stderr: -151> 2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:11:12.652 INFO:tasks.workunit.client.0.smithi153.stderr: -150> 2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.652 INFO:tasks.workunit.client.0.smithi153.stderr: -149> 2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.652 INFO:tasks.workunit.client.0.smithi153.stderr: -148> 2024-09-19T14:11:12.444+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.652 INFO:tasks.workunit.client.0.smithi153.stderr: -147> 2024-09-19T14:11:12.448+0000 7fa5ed485640 10 monclient: get_auth_request con 0x561b20bdf450 auth_method 0 2024-09-19T14:11:12.652 INFO:tasks.workunit.client.0.smithi153.stderr: -146> 2024-09-19T14:11:12.448+0000 7fa5ef97f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:12.652 INFO:tasks.workunit.client.0.smithi153.stderr: -145> 2024-09-19T14:11:12.448+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.652 INFO:tasks.workunit.client.0.smithi153.stderr: -144> 2024-09-19T14:11:12.448+0000 7fa5ef97f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:11:12.652 INFO:tasks.workunit.client.0.smithi153.stderr: -143> 2024-09-19T14:11:12.448+0000 7fa5ef97f9c0 20 searching for the correct realm 2024-09-19T14:11:12.652 INFO:tasks.workunit.client.0.smithi153.stderr: -142> 2024-09-19T14:11:12.448+0000 7fa5ecc84640 10 monclient: get_auth_request con 0x561b20be46c0 auth_method 0 2024-09-19T14:11:12.652 INFO:tasks.workunit.client.0.smithi153.stderr: -141> 2024-09-19T14:11:12.448+0000 7fa5edc86640 10 monclient: get_auth_request con 0x7fa5e4008050 auth_method 0 2024-09-19T14:11:12.653 INFO:tasks.workunit.client.0.smithi153.stderr: -140> 2024-09-19T14:11:12.452+0000 7fa5ed485640 10 monclient: get_auth_request con 0x561b209b2750 auth_method 0 2024-09-19T14:11:12.653 INFO:tasks.workunit.client.0.smithi153.stderr: -139> 2024-09-19T14:11:12.452+0000 7fa5ed485640 0 -- 172.21.15.153:0/3833316202 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x561b209b2750 msgr2=0x7fa5e807bac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:12.653 INFO:tasks.workunit.client.0.smithi153.stderr: -138> 2024-09-19T14:11:12.452+0000 7fa4beffd640 1 client.7953.objecter ms_handle_reset 0x561b209b2750 session 0x7fa5e806af90 osd.2 2024-09-19T14:11:12.653 INFO:tasks.workunit.client.0.smithi153.stderr: -137> 2024-09-19T14:11:12.452+0000 7fa4beffd640 10 monclient: _renew_subs 2024-09-19T14:11:12.653 INFO:tasks.workunit.client.0.smithi153.stderr: -136> 2024-09-19T14:11:12.452+0000 7fa4beffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:11:12.653 INFO:tasks.workunit.client.0.smithi153.stderr: -135> 2024-09-19T14:11:12.452+0000 7fa5ed485640 10 monclient: get_auth_request con 0x7fa4b8082340 auth_method 0 2024-09-19T14:11:12.653 INFO:tasks.workunit.client.0.smithi153.stderr: -134> 2024-09-19T14:11:12.452+0000 7fa5ecc84640 10 monclient: get_auth_request con 0x7fa5e00fa2f0 auth_method 0 2024-09-19T14:11:12.653 INFO:tasks.workunit.client.0.smithi153.stderr: -133> 2024-09-19T14:11:12.456+0000 7fa5edc86640 10 monclient: get_auth_request con 0x7fa5d8003100 auth_method 0 2024-09-19T14:11:12.653 INFO:tasks.workunit.client.0.smithi153.stderr: -132> 2024-09-19T14:11:12.460+0000 7fa5edc86640 0 -- 172.21.15.153:0/3833316202 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7fa5e4008050 msgr2=0x7fa5e406e4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:11:12.653 INFO:tasks.workunit.client.0.smithi153.stderr: -131> 2024-09-19T14:11:12.460+0000 7fa4beffd640 1 client.7953.objecter ms_handle_reset 0x7fa5e4008050 session 0x7fa5e4011040 osd.7 2024-09-19T14:11:12.653 INFO:tasks.workunit.client.0.smithi153.stderr: -130> 2024-09-19T14:11:12.460+0000 7fa5edc86640 10 monclient: get_auth_request con 0x561b209b2750 auth_method 0 2024-09-19T14:11:12.653 INFO:tasks.workunit.client.0.smithi153.stderr: -129> 2024-09-19T14:11:12.460+0000 7fa5ed485640 10 monclient: get_auth_request con 0x7fa5e4067a90 auth_method 0 2024-09-19T14:11:12.653 INFO:tasks.workunit.client.0.smithi153.stderr: -128> 2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:11:12.653 INFO:tasks.workunit.client.0.smithi153.stderr: -127> 2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:11:12.653 INFO:tasks.workunit.client.0.smithi153.stderr: -126> 2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:11:12.654 INFO:tasks.workunit.client.0.smithi153.stderr: -125> 2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:11:12.654 INFO:tasks.workunit.client.0.smithi153.stderr: -124> 2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:11:12.654 INFO:tasks.workunit.client.0.smithi153.stderr: -123> 2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:11:12.654 INFO:tasks.workunit.client.0.smithi153.stderr: -122> 2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.654 INFO:tasks.workunit.client.0.smithi153.stderr: -121> 2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.654 INFO:tasks.workunit.client.0.smithi153.stderr: -120> 2024-09-19T14:11:12.468+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.654 INFO:tasks.workunit.client.0.smithi153.stderr: -119> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:12.654 INFO:tasks.workunit.client.0.smithi153.stderr: -118> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.654 INFO:tasks.workunit.client.0.smithi153.stderr: -117> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:11:12.654 INFO:tasks.workunit.client.0.smithi153.stderr: -116> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 zone default found 2024-09-19T14:11:12.654 INFO:tasks.workunit.client.0.smithi153.stderr: -115> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 4 Realm: () 2024-09-19T14:11:12.654 INFO:tasks.workunit.client.0.smithi153.stderr: -114> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:11:12.654 INFO:tasks.workunit.client.0.smithi153.stderr: -113> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:11:12.654 INFO:tasks.workunit.client.0.smithi153.stderr: -112> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:11:12.655 INFO:tasks.workunit.client.0.smithi153.stderr: -111> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 zonegroup default 2024-09-19T14:11:12.655 INFO:tasks.workunit.client.0.smithi153.stderr: -110> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.655 INFO:tasks.workunit.client.0.smithi153.stderr: -109> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.655 INFO:tasks.workunit.client.0.smithi153.stderr: -108> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.655 INFO:tasks.workunit.client.0.smithi153.stderr: -107> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.655 INFO:tasks.workunit.client.0.smithi153.stderr: -106> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.655 INFO:tasks.workunit.client.0.smithi153.stderr: -105> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.655 INFO:tasks.workunit.client.0.smithi153.stderr: -104> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 started sync module instance, tier type = 2024-09-19T14:11:12.655 INFO:tasks.workunit.client.0.smithi153.stderr: -103> 2024-09-19T14:11:12.472+0000 7fa5ef97f9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:11:12.655 INFO:tasks.workunit.client.0.smithi153.stderr: -102> 2024-09-19T14:11:12.488+0000 7fa5ef97f9c0 20 add_watcher() i=0 2024-09-19T14:11:12.655 INFO:tasks.workunit.client.0.smithi153.stderr: -101> 2024-09-19T14:11:12.488+0000 7fa5ef97f9c0 20 add_watcher() i=1 2024-09-19T14:11:12.655 INFO:tasks.workunit.client.0.smithi153.stderr: -100> 2024-09-19T14:11:12.488+0000 7fa5ef97f9c0 20 add_watcher() i=2 2024-09-19T14:11:12.655 INFO:tasks.workunit.client.0.smithi153.stderr: -99> 2024-09-19T14:11:12.488+0000 7fa5ef97f9c0 20 add_watcher() i=3 2024-09-19T14:11:12.656 INFO:tasks.workunit.client.0.smithi153.stderr: -98> 2024-09-19T14:11:12.488+0000 7fa5ef97f9c0 20 add_watcher() i=4 2024-09-19T14:11:12.656 INFO:tasks.workunit.client.0.smithi153.stderr: -97> 2024-09-19T14:11:12.488+0000 7fa5ef97f9c0 20 add_watcher() i=5 2024-09-19T14:11:12.656 INFO:tasks.workunit.client.0.smithi153.stderr: -96> 2024-09-19T14:11:12.488+0000 7fa5ef97f9c0 20 add_watcher() i=6 2024-09-19T14:11:12.656 INFO:tasks.workunit.client.0.smithi153.stderr: -95> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 20 add_watcher() i=7 2024-09-19T14:11:12.656 INFO:tasks.workunit.client.0.smithi153.stderr: -94> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:11:12.656 INFO:tasks.workunit.client.0.smithi153.stderr: -93> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding auth protocol: cephx 2024-09-19T14:11:12.656 INFO:tasks.workunit.client.0.smithi153.stderr: -92> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding auth protocol: cephx 2024-09-19T14:11:12.656 INFO:tasks.workunit.client.0.smithi153.stderr: -91> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding auth protocol: cephx 2024-09-19T14:11:12.656 INFO:tasks.workunit.client.0.smithi153.stderr: -90> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding con mode: secure 2024-09-19T14:11:12.656 INFO:tasks.workunit.client.0.smithi153.stderr: -89> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding con mode: crc 2024-09-19T14:11:12.656 INFO:tasks.workunit.client.0.smithi153.stderr: -88> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding con mode: secure 2024-09-19T14:11:12.656 INFO:tasks.workunit.client.0.smithi153.stderr: -87> 2024-09-19T14:11:12.492+0000 7fa4a3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:12.656 INFO:tasks.workunit.client.0.smithi153.stderr: -86> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding con mode: crc 2024-09-19T14:11:12.656 INFO:tasks.workunit.client.0.smithi153.stderr: -85> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding con mode: secure 2024-09-19T14:11:12.656 INFO:tasks.workunit.client.0.smithi153.stderr: -84> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding con mode: crc 2024-09-19T14:11:12.657 INFO:tasks.workunit.client.0.smithi153.stderr: -83> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding con mode: crc 2024-09-19T14:11:12.657 INFO:tasks.workunit.client.0.smithi153.stderr: -82> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding con mode: secure 2024-09-19T14:11:12.657 INFO:tasks.workunit.client.0.smithi153.stderr: -81> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding con mode: crc 2024-09-19T14:11:12.657 INFO:tasks.workunit.client.0.smithi153.stderr: -80> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding con mode: secure 2024-09-19T14:11:12.657 INFO:tasks.workunit.client.0.smithi153.stderr: -79> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding con mode: crc 2024-09-19T14:11:12.657 INFO:tasks.workunit.client.0.smithi153.stderr: -78> 2024-09-19T14:11:12.492+0000 7fa5ef97f9c0 5 AuthRegistry(0x7ffee17f1980) adding con mode: secure 2024-09-19T14:11:12.657 INFO:tasks.workunit.client.0.smithi153.stderr: -77> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:12.657 INFO:tasks.workunit.client.0.smithi153.stderr: -76> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:11:12.657 INFO:tasks.workunit.client.0.smithi153.stderr: -75> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:11:12.657 INFO:tasks.workunit.client.0.smithi153.stderr: -74> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command cache list hook 0x561b20bb73f0 2024-09-19T14:11:12.657 INFO:tasks.workunit.client.0.smithi153.stderr: -73> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command cache inspect hook 0x561b20bb73f0 2024-09-19T14:11:12.657 INFO:tasks.workunit.client.0.smithi153.stderr: -72> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command cache erase hook 0x561b20bb73f0 2024-09-19T14:11:12.657 INFO:tasks.workunit.client.0.smithi153.stderr: -71> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command cache zap hook 0x561b20bb73f0 2024-09-19T14:11:12.657 INFO:tasks.workunit.client.0.smithi153.stderr: -70> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 5 note: GC not initialized 2024-09-19T14:11:12.658 INFO:tasks.workunit.client.0.smithi153.stderr: -69> 2024-09-19T14:11:12.496+0000 7fa4a2fe5640 20 reqs_thread_entry: start 2024-09-19T14:11:12.658 INFO:tasks.workunit.client.0.smithi153.stderr: -68> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command sync trace show hook 0x7fa5e80047a0 2024-09-19T14:11:12.658 INFO:tasks.workunit.client.0.smithi153.stderr: -67> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command sync trace history hook 0x7fa5e80047a0 2024-09-19T14:11:12.658 INFO:tasks.workunit.client.0.smithi153.stderr: -66> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command sync trace active hook 0x7fa5e80047a0 2024-09-19T14:11:12.658 INFO:tasks.workunit.client.0.smithi153.stderr: -65> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 5 asok(0x561b208e7d90) register_command sync trace active_short hook 0x7fa5e80047a0 2024-09-19T14:11:12.658 INFO:tasks.workunit.client.0.smithi153.stderr: -64> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:11:12.658 INFO:tasks.workunit.client.0.smithi153.stderr: -63> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 20 Filter name: none 2024-09-19T14:11:12.658 INFO:tasks.workunit.client.0.smithi153.stderr: -62> 2024-09-19T14:11:12.496+0000 7fa4a0fe1640 20 reqs_thread_entry: start 2024-09-19T14:11:12.658 INFO:tasks.workunit.client.0.smithi153.stderr: -61> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-19T14:11:12.658 INFO:tasks.workunit.client.0.smithi153.stderr: -60> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.658 INFO:tasks.workunit.client.0.smithi153.stderr: -59> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:11:12.658 INFO:tasks.workunit.client.0.smithi153.stderr: -58> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-19T14:11:12.659 INFO:tasks.workunit.client.0.smithi153.stderr: -57> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-19T14:11:12.659 INFO:tasks.workunit.client.0.smithi153.stderr: -56> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 : miss 2024-09-19T14:11:12.659 INFO:tasks.workunit.client.0.smithi153.stderr: -55> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.659 INFO:tasks.workunit.client.0.smithi153.stderr: -54> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:11:12.659 INFO:tasks.workunit.client.0.smithi153.stderr: -53> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 info.flags=0x17 2024-09-19T14:11:12.659 INFO:tasks.workunit.client.0.smithi153.stderr: -52> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 to cache LRU end 2024-09-19T14:11:12.659 INFO:tasks.workunit.client.0.smithi153.stderr: -51> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:11:12.659 INFO:tasks.workunit.client.0.smithi153.stderr: -50> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:12.659 INFO:tasks.workunit.client.0.smithi153.stderr: -49> 2024-09-19T14:11:12.496+0000 7fa5ef97f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 2024-09-19T14:11:12.659 INFO:tasks.workunit.client.0.smithi153.stderr: -48> 2024-09-19T14:11:12.508+0000 7fa5ef97f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 info.flags=0x17 2024-09-19T14:11:12.659 INFO:tasks.workunit.client.0.smithi153.stderr: -47> 2024-09-19T14:11:12.508+0000 7fa5ef97f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 to cache LRU end 2024-09-19T14:11:12.659 INFO:tasks.workunit.client.0.smithi153.stderr: -46> 2024-09-19T14:11:12.508+0000 7fa5ef97f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:12.660 INFO:tasks.workunit.client.0.smithi153.stderr: -45> 2024-09-19T14:11:12.508+0000 7fa5ef97f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39, ofs0, ns] 2024-09-19T14:11:12.660 INFO:tasks.workunit.client.0.smithi153.stderr: -44> 2024-09-19T14:11:12.508+0000 7fa4d0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333498 cookie 94674513474032 notifier 7953 bl.length()=931 2024-09-19T14:11:12.660 INFO:tasks.workunit.client.0.smithi153.stderr: -43> 2024-09-19T14:11:12.508+0000 7fa4d0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 info.flags=0x17 2024-09-19T14:11:12.660 INFO:tasks.workunit.client.0.smithi153.stderr: -42> 2024-09-19T14:11:12.508+0000 7fa4d0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 to cache LRU end 2024-09-19T14:11:12.660 INFO:tasks.workunit.client.0.smithi153.stderr: -41> 2024-09-19T14:11:12.508+0000 7fa4d0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:12.660 INFO:tasks.workunit.client.0.smithi153.stderr: -40> 2024-09-19T14:11:12.512+0000 7fa5ef97f9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.39]): orig_sources= new_sources= 2024-09-19T14:11:12.660 INFO:tasks.workunit.client.0.smithi153.stderr: -39> 2024-09-19T14:11:12.512+0000 7fa5ef97f9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.39]): potential sources added=[] removed=[] 2024-09-19T14:11:12.660 INFO:tasks.workunit.client.0.smithi153.stderr: -38> 2024-09-19T14:11:12.512+0000 7fa5ef97f9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.39]): orig_dests= new_dests= 2024-09-19T14:11:12.660 INFO:tasks.workunit.client.0.smithi153.stderr: -37> 2024-09-19T14:11:12.512+0000 7fa5ef97f9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.39]): potential dests added=[] removed=[] 2024-09-19T14:11:12.660 INFO:tasks.workunit.client.0.smithi153.stderr: -36> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.0 2024-09-19T14:11:12.660 INFO:tasks.workunit.client.0.smithi153.stderr: -35> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.0 2024-09-19T14:11:12.660 INFO:tasks.workunit.client.0.smithi153.stderr: -34> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.1 2024-09-19T14:11:12.661 INFO:tasks.workunit.client.0.smithi153.stderr: -33> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.1 2024-09-19T14:11:12.661 INFO:tasks.workunit.client.0.smithi153.stderr: -32> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.2 2024-09-19T14:11:12.661 INFO:tasks.workunit.client.0.smithi153.stderr: -31> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.2 2024-09-19T14:11:12.661 INFO:tasks.workunit.client.0.smithi153.stderr: -30> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.3 2024-09-19T14:11:12.661 INFO:tasks.workunit.client.0.smithi153.stderr: -29> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.3 2024-09-19T14:11:12.661 INFO:tasks.workunit.client.0.smithi153.stderr: -28> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.4 2024-09-19T14:11:12.661 INFO:tasks.workunit.client.0.smithi153.stderr: -27> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.4 2024-09-19T14:11:12.661 INFO:tasks.workunit.client.0.smithi153.stderr: -26> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.5 2024-09-19T14:11:12.661 INFO:tasks.workunit.client.0.smithi153.stderr: -25> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.5 2024-09-19T14:11:12.661 INFO:tasks.workunit.client.0.smithi153.stderr: -24> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.6 2024-09-19T14:11:12.661 INFO:tasks.workunit.client.0.smithi153.stderr: -23> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.6 2024-09-19T14:11:12.661 INFO:tasks.workunit.client.0.smithi153.stderr: -22> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.7 2024-09-19T14:11:12.662 INFO:tasks.workunit.client.0.smithi153.stderr: -21> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.7 2024-09-19T14:11:12.662 INFO:tasks.workunit.client.0.smithi153.stderr: -20> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.8 2024-09-19T14:11:12.662 INFO:tasks.workunit.client.0.smithi153.stderr: -19> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.8 2024-09-19T14:11:12.662 INFO:tasks.workunit.client.0.smithi153.stderr: -18> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.9 2024-09-19T14:11:12.662 INFO:tasks.workunit.client.0.smithi153.stderr: -17> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.9 2024-09-19T14:11:12.662 INFO:tasks.workunit.client.0.smithi153.stderr: -16> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.10 2024-09-19T14:11:12.662 INFO:tasks.workunit.client.0.smithi153.stderr: -15> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.10 2024-09-19T14:11:12.662 INFO:tasks.workunit.client.0.smithi153.stderr: -14> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.11 2024-09-19T14:11:12.662 INFO:tasks.workunit.client.0.smithi153.stderr: -13> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1.11 2024-09-19T14:11:12.662 INFO:tasks.workunit.client.0.smithi153.stderr: -12> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.0 2024-09-19T14:11:12.662 INFO:tasks.workunit.client.0.smithi153.stderr: -11> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1 2024-09-19T14:11:12.662 INFO:tasks.workunit.client.0.smithi153.stderr: -10> 2024-09-19T14:11:12.520+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2 2024-09-19T14:11:12.662 INFO:tasks.workunit.client.0.smithi153.stderr: -9> 2024-09-19T14:11:12.524+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.3 2024-09-19T14:11:12.662 INFO:tasks.workunit.client.0.smithi153.stderr: -8> 2024-09-19T14:11:12.524+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.4 2024-09-19T14:11:12.663 INFO:tasks.workunit.client.0.smithi153.stderr: -7> 2024-09-19T14:11:12.524+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.5 2024-09-19T14:11:12.663 INFO:tasks.workunit.client.0.smithi153.stderr: -6> 2024-09-19T14:11:12.528+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.6 2024-09-19T14:11:12.663 INFO:tasks.workunit.client.0.smithi153.stderr: -5> 2024-09-19T14:11:12.528+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.7 2024-09-19T14:11:12.663 INFO:tasks.workunit.client.0.smithi153.stderr: -4> 2024-09-19T14:11:12.528+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.8 2024-09-19T14:11:12.663 INFO:tasks.workunit.client.0.smithi153.stderr: -3> 2024-09-19T14:11:12.528+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.9 2024-09-19T14:11:12.663 INFO:tasks.workunit.client.0.smithi153.stderr: -2> 2024-09-19T14:11:12.528+0000 7fa5ef97f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.10 2024-09-19T14:11:12.663 INFO:tasks.workunit.client.0.smithi153.stderr: -1> 2024-09-19T14:11:12.536+0000 7fa5ef97f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa5ef97f9c0 time 2024-09-19T14:11:12.541389+0000 2024-09-19T14:11:12.663 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:11:12.663 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.663 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:11:12.663 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fa5f32592eb] 2024-09-19T14:11:12.663 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa5f325949f] 2024-09-19T14:11:12.663 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561b1d9c3271] 2024-09-19T14:11:12.663 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x561b1d9d2441] 2024-09-19T14:11:12.664 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561b1d9d3a94] 2024-09-19T14:11:12.664 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:11:12.664 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa5f20bfd90] 2024-09-19T14:11:12.664 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:11:12.664 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:11:12.664 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.664 INFO:tasks.workunit.client.0.smithi153.stderr: 0> 2024-09-19T14:11:12.540+0000 7fa5ef97f9c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:11:12.664 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7fa5ef97f9c0 thread_name:radosgw-admin 2024-09-19T14:11:12.664 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.664 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:11:12.664 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa5f20d8520] 2024-09-19T14:11:12.664 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:11:12.664 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:11:12.664 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:11:12.665 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fa5f3259345] 2024-09-19T14:11:12.665 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fa5f325949f] 2024-09-19T14:11:12.665 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561b1d9c3271] 2024-09-19T14:11:12.665 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x561b1d9d2441] 2024-09-19T14:11:12.665 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x561b1d9d3a94] 2024-09-19T14:11:12.665 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:11:12.665 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa5f20bfd90] 2024-09-19T14:11:12.665 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:11:12.665 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:11:12.665 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:11:12.665 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.665 INFO:tasks.workunit.client.0.smithi153.stderr:--- logging levels --- 2024-09-19T14:11:12.665 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 none 2024-09-19T14:11:12.665 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 lockdep 2024-09-19T14:11:12.665 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 context 2024-09-19T14:11:12.666 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 crush 2024-09-19T14:11:12.666 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds 2024-09-19T14:11:12.666 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_balancer 2024-09-19T14:11:12.666 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_locker 2024-09-19T14:11:12.666 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log 2024-09-19T14:11:12.666 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log_expire 2024-09-19T14:11:12.666 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_migrator 2024-09-19T14:11:12.666 INFO:tasks.workunit.client.0.smithi153.stderr: 3/ 5 mds_quiesce 2024-09-19T14:11:12.666 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 buffer 2024-09-19T14:11:12.666 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 timer 2024-09-19T14:11:12.666 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 filer 2024-09-19T14:11:12.666 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 striper 2024-09-19T14:11:12.666 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 objecter 2024-09-19T14:11:12.666 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rados 2024-09-19T14:11:12.666 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd 2024-09-19T14:11:12.666 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_mirror 2024-09-19T14:11:12.667 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_replay 2024-09-19T14:11:12.667 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_pwl 2024-09-19T14:11:12.667 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 journaler 2024-09-19T14:11:12.667 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objectcacher 2024-09-19T14:11:12.667 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:11:12.667 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 client 2024-09-19T14:11:12.667 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 osd 2024-09-19T14:11:12.667 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 optracker 2024-09-19T14:11:12.667 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objclass 2024-09-19T14:11:12.667 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 filestore 2024-09-19T14:11:12.667 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 journal 2024-09-19T14:11:12.667 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 ms 2024-09-19T14:11:12.667 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mon 2024-09-19T14:11:12.667 INFO:tasks.workunit.client.0.smithi153.stderr: 0/10 monc 2024-09-19T14:11:12.667 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 paxos 2024-09-19T14:11:12.668 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 tp 2024-09-19T14:11:12.668 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 auth 2024-09-19T14:11:12.668 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 crypto 2024-09-19T14:11:12.668 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 finisher 2024-09-19T14:11:12.668 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 reserver 2024-09-19T14:11:12.668 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 heartbeatmap 2024-09-19T14:11:12.668 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 perfcounter 2024-09-19T14:11:12.668 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw 2024-09-19T14:11:12.668 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_sync 2024-09-19T14:11:12.668 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_datacache 2024-09-19T14:11:12.668 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_access 2024-09-19T14:11:12.668 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:11:12.668 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_flight 2024-09-19T14:11:12.668 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:11:12.669 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw_notification 2024-09-19T14:11:12.669 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 javaclient 2024-09-19T14:11:12.669 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 asok 2024-09-19T14:11:12.669 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 throttle 2024-09-19T14:11:12.669 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 refs 2024-09-19T14:11:12.669 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 compressor 2024-09-19T14:11:12.669 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluestore 2024-09-19T14:11:12.669 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluefs 2024-09-19T14:11:12.669 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 bdev 2024-09-19T14:11:12.669 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 kstore 2024-09-19T14:11:12.669 INFO:tasks.workunit.client.0.smithi153.stderr: 4/ 5 rocksdb 2024-09-19T14:11:12.669 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 fuse 2024-09-19T14:11:12.669 INFO:tasks.workunit.client.0.smithi153.stderr: 2/ 5 mgr 2024-09-19T14:11:12.669 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mgrc 2024-09-19T14:11:12.670 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 dpdk 2024-09-19T14:11:12.670 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 eventtrace 2024-09-19T14:11:12.670 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 prioritycache 2024-09-19T14:11:12.670 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 test 2024-09-19T14:11:12.670 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:11:12.670 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephsqlite 2024-09-19T14:11:12.670 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:11:12.670 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore 2024-09-19T14:11:12.670 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_onode 2024-09-19T14:11:12.670 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_odata 2024-09-19T14:11:12.670 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_omap 2024-09-19T14:11:12.670 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_tm 2024-09-19T14:11:12.670 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_t 2024-09-19T14:11:12.671 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:11:12.671 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_epm 2024-09-19T14:11:12.671 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_lba 2024-09-19T14:11:12.671 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:11:12.671 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cache 2024-09-19T14:11:12.671 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_journal 2024-09-19T14:11:12.671 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_device 2024-09-19T14:11:12.671 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_backref 2024-09-19T14:11:12.671 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 alienstore 2024-09-19T14:11:12.671 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mclock 2024-09-19T14:11:12.671 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cyanstore 2024-09-19T14:11:12.671 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 ceph_exporter 2024-09-19T14:11:12.671 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 memstore 2024-09-19T14:11:12.671 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 trace 2024-09-19T14:11:12.672 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 ceph_dedup 2024-09-19T14:11:12.672 INFO:tasks.workunit.client.0.smithi153.stderr: -2/-2 (syslog threshold) 2024-09-19T14:11:12.672 INFO:tasks.workunit.client.0.smithi153.stderr: 99/99 (stderr threshold) 2024-09-19T14:11:12.672 INFO:tasks.workunit.client.0.smithi153.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:11:12.672 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa4a0fe1640 / http_manager 2024-09-19T14:11:12.672 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa4a2fe5640 / http_manager 2024-09-19T14:11:12.672 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa4a3fe7640 / rgw_dt_lg_renew 2024-09-19T14:11:12.672 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa4beffd640 / ms_dispatch 2024-09-19T14:11:12.672 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa4d0ff9640 / io_context_pool 2024-09-19T14:11:12.672 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa4d2ffd640 / ms_dispatch 2024-09-19T14:11:12.672 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa4d9e03640 / ms_dispatch 2024-09-19T14:11:12.672 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa4db606640 / io_context_pool 2024-09-19T14:11:12.673 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa5ecc84640 / msgr-worker-2 2024-09-19T14:11:12.673 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa5ed485640 / msgr-worker-1 2024-09-19T14:11:12.673 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa5edc86640 / msgr-worker-0 2024-09-19T14:11:12.673 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa5ee487640 / io_context_pool 2024-09-19T14:11:12.673 INFO:tasks.workunit.client.0.smithi153.stderr: 7fa5ef97f9c0 / radosgw-admin 2024-09-19T14:11:12.673 INFO:tasks.workunit.client.0.smithi153.stderr: max_recent 500 2024-09-19T14:11:12.673 INFO:tasks.workunit.client.0.smithi153.stderr: max_new 1000 2024-09-19T14:11:12.673 INFO:tasks.workunit.client.0.smithi153.stderr: log_file /var/lib/ceph/crash/2024-09-19T14:11:12.543782Z_aef9e54e-8bf7-4ad1-ba58-e6eb16757ec9/log 2024-09-19T14:11:12.673 INFO:tasks.workunit.client.0.smithi153.stderr:--- end dump of recent events --- 2024-09-19T14:11:12.673 INFO:tasks.workunit.client.0.smithi153.stderr:Aborted 2024-09-19T14:11:12.673 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-19T14:11:12.675 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:11:12.675 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:11:12.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.624+0000 7ff0294b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.628+0000 7ff0294b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.628+0000 7ff0294b19c0 20 realm 2024-09-19T14:11:12.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.628+0000 7ff0294b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.628+0000 7ff0294b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.628+0000 7ff0294b19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:11:12.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.628+0000 7ff0294b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.628+0000 7ff0294b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.628+0000 7ff0294b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.628+0000 7ff0294b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:12.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.628+0000 7ff0294b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.628+0000 7ff0294b19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:11:12.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.628+0000 7ff0294b19c0 20 searching for the correct realm 2024-09-19T14:11:12.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.636+0000 7ff0267b6640 0 -- 172.21.15.153:0/3928513448 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x56021fbe8270 msgr2=0x56021fbea660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:11:12.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.640+0000 7ff026fb7640 0 -- 172.21.15.153:0/3928513448 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7ff01c063af0 msgr2=0x7ff01c07a880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:11:12.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.852+0000 7ff0294b19c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:11:12.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.856+0000 7ff0294b19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:11:12.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.856+0000 7ff0294b19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:11:12.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.856+0000 7ff0294b19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:11:12.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.856+0000 7ff0294b19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:11:12.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.856+0000 7ff0294b19c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:11:12.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.856+0000 7ff0294b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.856+0000 7ff0294b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.856+0000 7ff0294b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.856+0000 7ff0294b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:12.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.856+0000 7ff0294b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.856+0000 7ff0294b19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:11:12.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.856+0000 7ff0294b19c0 20 zone default found 2024-09-19T14:11:12.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.856+0000 7ff0294b19c0 4 Realm: () 2024-09-19T14:11:12.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.856+0000 7ff0294b19c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:11:12.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.856+0000 7ff0294b19c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:11:12.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.856+0000 7ff0294b19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:11:12.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.856+0000 7ff0294b19c0 20 zonegroup default 2024-09-19T14:11:12.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.856+0000 7ff0294b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.856+0000 7ff0294b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.856+0000 7ff0294b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.856+0000 7ff0294b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.856+0000 7ff0294b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.860+0000 7ff0294b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:12.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.860+0000 7ff0294b19c0 20 started sync module instance, tier type = 2024-09-19T14:11:12.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.860+0000 7ff0294b19c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:11:12.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.880+0000 7ff0294b19c0 20 add_watcher() i=0 2024-09-19T14:11:12.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.880+0000 7ff0294b19c0 20 add_watcher() i=1 2024-09-19T14:11:12.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.880+0000 7ff0294b19c0 20 add_watcher() i=2 2024-09-19T14:11:12.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.880+0000 7ff0294b19c0 20 add_watcher() i=3 2024-09-19T14:11:12.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.880+0000 7ff0294b19c0 20 add_watcher() i=4 2024-09-19T14:11:12.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.880+0000 7ff0294b19c0 20 add_watcher() i=5 2024-09-19T14:11:12.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.880+0000 7ff0294b19c0 20 add_watcher() i=6 2024-09-19T14:11:12.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.880+0000 7ff0294b19c0 20 add_watcher() i=7 2024-09-19T14:11:12.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.880+0000 7ff0294b19c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:11:12.887 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.884+0000 7feedd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:12.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.884+0000 7ff0294b19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:11:12.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.884+0000 7ff0294b19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:11:12.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.884+0000 7ff0294b19c0 5 note: GC not initialized 2024-09-19T14:11:12.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.884+0000 7fee57fff640 20 reqs_thread_entry: start 2024-09-19T14:11:12.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.884+0000 7ff0294b19c0 20 init_complete bucket index max shards: 11 2024-09-19T14:11:12.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.884+0000 7ff0294b19c0 20 Filter name: none 2024-09-19T14:11:12.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.884+0000 7fee55ffb640 20 reqs_thread_entry: start 2024-09-19T14:11:12.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.888+0000 7ff0294b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.888+0000 7ff0294b19c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:11:12.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.888+0000 7ff0294b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.892 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.888+0000 7ff0294b19c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-19T14:11:12.892 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.888+0000 7ff0294b19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:11:12.892 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.888+0000 7ff0294b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.892 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.888+0000 7ff0294b19c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:11:12.892 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.888+0000 7ff0294b19c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:12.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.888+0000 7ff0294b19c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-19T14:11:12.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.888+0000 7ff0294b19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:11:12.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.892+0000 7feedd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:12.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.896+0000 7ff0294b19c0 20 remove_watcher() i=0 2024-09-19T14:11:12.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.896+0000 7ff0294b19c0 2 removed watcher, disabling cache 2024-09-19T14:11:12.904 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.900+0000 7ff0294b19c0 20 remove_watcher() i=1 2024-09-19T14:11:12.906 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.904+0000 7ff0294b19c0 20 remove_watcher() i=2 2024-09-19T14:11:12.908 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.904+0000 7ff0294b19c0 20 remove_watcher() i=3 2024-09-19T14:11:12.910 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.908+0000 7ff0294b19c0 20 remove_watcher() i=4 2024-09-19T14:11:12.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.908+0000 7ff0294b19c0 20 remove_watcher() i=5 2024-09-19T14:11:12.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.908+0000 7ff0294b19c0 20 remove_watcher() i=6 2024-09-19T14:11:12.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:12.912+0000 7ff0294b19c0 20 remove_watcher() i=7 2024-09-19T14:11:12.930 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.931 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:11:12.931 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: abort-at-change-reshard-state id: dbb1da81-49d0-421a-b677-974869a7f103.4620.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-19T14:11:12.931 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:12.932 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:12.932 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:12.981 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:12.981 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:13.052 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T14:11:13.088 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:11:13.088 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:11:13.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.132+0000 7f866840a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:13.139 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.136+0000 7f866840a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:13.139 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.136+0000 7f866840a9c0 20 realm 2024-09-19T14:11:13.139 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.136+0000 7f866840a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:13.139 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.136+0000 7f866840a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:13.139 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.136+0000 7f866840a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:11:13.139 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.136+0000 7f866840a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:13.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.136+0000 7f866840a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:13.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.136+0000 7f866840a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:13.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.136+0000 7f866840a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:13.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.136+0000 7f866840a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:13.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.136+0000 7f866840a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:11:13.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.136+0000 7f866840a9c0 20 searching for the correct realm 2024-09-19T14:11:13.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.144+0000 7f866570f640 0 -- 172.21.15.153:0/915465693 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f8658128060 msgr2=0x7f8658112840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:13.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.360+0000 7f8665f10640 0 -- 172.21.15.153:0/915465693 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f8650067860 msgr2=0x7f865001b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:13.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.576+0000 7f866840a9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:11:13.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.576+0000 7f866840a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:11:13.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.576+0000 7f866840a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:11:13.581 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.576+0000 7f866840a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:11:13.581 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.576+0000 7f866840a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:11:13.581 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.576+0000 7f866840a9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:11:13.581 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.576+0000 7f866840a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:13.581 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.576+0000 7f866840a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:13.581 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.576+0000 7f866840a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:13.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.580+0000 7f866840a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:13.582 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.580+0000 7f866840a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:13.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.580+0000 7f866840a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:11:13.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.580+0000 7f866840a9c0 20 zone default found 2024-09-19T14:11:13.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.580+0000 7f866840a9c0 4 Realm: () 2024-09-19T14:11:13.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.580+0000 7f866840a9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:11:13.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.580+0000 7f866840a9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:11:13.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.580+0000 7f866840a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:11:13.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.580+0000 7f866840a9c0 20 zonegroup default 2024-09-19T14:11:13.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.580+0000 7f866840a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:13.584 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.580+0000 7f866840a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:13.584 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.580+0000 7f866840a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:13.585 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.580+0000 7f866840a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:13.585 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.580+0000 7f866840a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:13.585 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.580+0000 7f866840a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:13.586 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.580+0000 7f866840a9c0 20 started sync module instance, tier type = 2024-09-19T14:11:13.586 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.580+0000 7f866840a9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:11:13.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.604+0000 7f866840a9c0 20 add_watcher() i=0 2024-09-19T14:11:13.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.604+0000 7f866840a9c0 20 add_watcher() i=1 2024-09-19T14:11:13.610 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.604+0000 7f866840a9c0 20 add_watcher() i=2 2024-09-19T14:11:13.610 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.604+0000 7f866840a9c0 20 add_watcher() i=3 2024-09-19T14:11:13.610 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.604+0000 7f866840a9c0 20 add_watcher() i=4 2024-09-19T14:11:13.610 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.604+0000 7f866840a9c0 20 add_watcher() i=5 2024-09-19T14:11:13.610 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.604+0000 7f866840a9c0 20 add_watcher() i=6 2024-09-19T14:11:13.611 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.608+0000 7f866840a9c0 20 add_watcher() i=7 2024-09-19T14:11:13.612 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.608+0000 7f866840a9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:11:13.616 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.612+0000 7f85177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:13.617 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.612+0000 7f866840a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:11:13.617 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.612+0000 7f866840a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:11:13.617 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.612+0000 7f866840a9c0 5 note: GC not initialized 2024-09-19T14:11:13.618 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.612+0000 7f85167fc640 20 reqs_thread_entry: start 2024-09-19T14:11:13.618 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.616+0000 7f866840a9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:11:13.618 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.616+0000 7f866840a9c0 20 Filter name: none 2024-09-19T14:11:13.618 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.616+0000 7f8487fff640 20 reqs_thread_entry: start 2024-09-19T14:11:13.618 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.616+0000 7f866840a9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-19T14:11:13.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.616+0000 7f866840a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:13.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.616+0000 7f866840a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:11:13.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.616+0000 7f866840a9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-19T14:11:13.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.616+0000 7f866840a9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-19T14:11:13.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.616+0000 7f866840a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 : miss 2024-09-19T14:11:13.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.616+0000 7f866840a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:13.621 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.616+0000 7f866840a9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-19T14:11:13.621 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.616+0000 7f866840a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 info.flags=0x17 2024-09-19T14:11:13.621 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.616+0000 7f866840a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 to cache LRU end 2024-09-19T14:11:13.621 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.616+0000 7f866840a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:11:13.621 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.616+0000 7f866840a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:13.621 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.616+0000 7f866840a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 2024-09-19T14:11:13.623 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.620+0000 7f866840a9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 to be held by another RGW process; skipping for now 2024-09-19T14:11:13.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.620+0000 7f85177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:13.630 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.628+0000 7f866840a9c0 20 remove_watcher() i=0 2024-09-19T14:11:13.630 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.628+0000 7f866840a9c0 2 removed watcher, disabling cache 2024-09-19T14:11:13.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.628+0000 7f866840a9c0 20 remove_watcher() i=1 2024-09-19T14:11:13.635 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.632+0000 7f866840a9c0 20 remove_watcher() i=2 2024-09-19T14:11:13.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.632+0000 7f866840a9c0 20 remove_watcher() i=3 2024-09-19T14:11:13.639 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.636+0000 7f866840a9c0 20 remove_watcher() i=4 2024-09-19T14:11:13.641 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.636+0000 7f866840a9c0 20 remove_watcher() i=5 2024-09-19T14:11:13.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.640+0000 7f866840a9c0 20 remove_watcher() i=6 2024-09-19T14:11:13.644 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:13.640+0000 7f866840a9c0 20 remove_watcher() i=7 2024-09-19T14:11:13.660 INFO:tasks.workunit.client.0.smithi153.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-19T14:11:43.662 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-19T14:11:43.699 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:11:43.700 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:11:43.747 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.747+0000 7fd3fc41c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:43.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.747+0000 7fd3fc41c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:43.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.747+0000 7fd3fc41c9c0 20 realm 2024-09-19T14:11:43.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.747+0000 7fd3fc41c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:43.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.751+0000 7fd3fc41c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:43.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.751+0000 7fd3fc41c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:11:43.750 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.751+0000 7fd3fc41c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:43.751 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.751+0000 7fd3fc41c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:43.751 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.751+0000 7fd3fc41c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:43.752 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.751+0000 7fd3fc41c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:43.752 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.751+0000 7fd3fc41c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:43.752 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.751+0000 7fd3fc41c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:11:43.752 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.751+0000 7fd3fc41c9c0 20 searching for the correct realm 2024-09-19T14:11:43.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.759+0000 7fd3fa723640 0 -- 172.21.15.153:0/1639736757 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55f0226d5730 msgr2=0x55f0226d7ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:43.764 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.763+0000 7fd3f9721640 0 -- 172.21.15.153:0/1639736757 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fd3ec0d0070 msgr2=0x7fd3ec109920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:43.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.771+0000 7fd3fc41c9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:11:43.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.771+0000 7fd3fc41c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:11:43.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.771+0000 7fd3fc41c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:11:43.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.771+0000 7fd3fc41c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:11:43.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.771+0000 7fd3fc41c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:11:43.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.771+0000 7fd3fc41c9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:11:43.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.771+0000 7fd3fc41c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:43.772 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.771+0000 7fd3fc41c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:43.773 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.771+0000 7fd3fc41c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:43.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.771+0000 7fd3fc41c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:43.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.771+0000 7fd3fc41c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:43.774 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.771+0000 7fd3fc41c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:11:43.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.771+0000 7fd3fc41c9c0 20 zone default found 2024-09-19T14:11:43.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.771+0000 7fd3fc41c9c0 4 Realm: () 2024-09-19T14:11:43.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.771+0000 7fd3fc41c9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:11:43.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.771+0000 7fd3fc41c9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:11:43.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.771+0000 7fd3fc41c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:11:43.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.771+0000 7fd3fc41c9c0 20 zonegroup default 2024-09-19T14:11:43.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.771+0000 7fd3fc41c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:43.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.775+0000 7fd3fc41c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:43.775 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.775+0000 7fd3fc41c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:43.776 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.775+0000 7fd3fc41c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:43.776 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.775+0000 7fd3fc41c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:43.777 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.775+0000 7fd3fc41c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:43.777 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.775+0000 7fd3fc41c9c0 20 started sync module instance, tier type = 2024-09-19T14:11:43.777 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.775+0000 7fd3fc41c9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:11:43.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.791+0000 7fd3fc41c9c0 20 add_watcher() i=0 2024-09-19T14:11:43.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.791+0000 7fd3fc41c9c0 20 add_watcher() i=1 2024-09-19T14:11:43.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.791+0000 7fd3fc41c9c0 20 add_watcher() i=2 2024-09-19T14:11:43.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.791+0000 7fd3fc41c9c0 20 add_watcher() i=3 2024-09-19T14:11:43.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.791+0000 7fd3fc41c9c0 20 add_watcher() i=4 2024-09-19T14:11:43.791 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.791+0000 7fd3fc41c9c0 20 add_watcher() i=5 2024-09-19T14:11:43.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.791+0000 7fd3fc41c9c0 20 add_watcher() i=6 2024-09-19T14:11:43.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.791+0000 7fd3fc41c9c0 20 add_watcher() i=7 2024-09-19T14:11:43.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.791+0000 7fd3fc41c9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:11:43.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.795+0000 7fd2affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:43.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.795+0000 7fd3fc41c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:11:43.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.795+0000 7fd3fc41c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:11:43.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.795+0000 7fd3fc41c9c0 5 note: GC not initialized 2024-09-19T14:11:43.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.795+0000 7fd2aefe5640 20 reqs_thread_entry: start 2024-09-19T14:11:43.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.795+0000 7fd3fc41c9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:11:43.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.795+0000 7fd3fc41c9c0 20 Filter name: none 2024-09-19T14:11:43.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.795+0000 7fd2acfe1640 20 reqs_thread_entry: start 2024-09-19T14:11:43.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.795+0000 7fd3fc41c9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-19T14:11:43.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.795+0000 7fd3fc41c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:43.797 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.795+0000 7fd3fc41c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:11:43.797 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.795+0000 7fd3fc41c9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-19T14:11:43.797 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.795+0000 7fd3fc41c9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-19T14:11:43.797 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.795+0000 7fd3fc41c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 : miss 2024-09-19T14:11:43.797 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.795+0000 7fd3fc41c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:43.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.795+0000 7fd3fc41c9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-19T14:11:43.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.795+0000 7fd3fc41c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 info.flags=0x17 2024-09-19T14:11:43.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.795+0000 7fd3fc41c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 to cache LRU end 2024-09-19T14:11:43.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.795+0000 7fd3fc41c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:11:43.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.795+0000 7fd3fc41c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:43.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.795+0000 7fd3fc41c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 2024-09-19T14:11:43.800 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.799+0000 7fd3fc41c9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T14:11:43.815 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.815+0000 7fd3fc41c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 info.flags=0x17 2024-09-19T14:11:43.815 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.815+0000 7fd3fc41c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 to cache LRU end 2024-09-19T14:11:43.815 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.815+0000 7fd3fc41c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:43.815 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.815+0000 7fd3fc41c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39, ofs0, ns] 2024-09-19T14:11:43.816 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.815+0000 7fd2dcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333499 cookie 94489858162720 notifier 8004 bl.length()=931 2024-09-19T14:11:43.816 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.815+0000 7fd2dcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 info.flags=0x17 2024-09-19T14:11:43.816 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.815+0000 7fd2dcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 to cache LRU end 2024-09-19T14:11:43.816 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.815+0000 7fd2dcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:43.818 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.819+0000 7fd3fc41c9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.39]): orig_sources= new_sources= 2024-09-19T14:11:43.818 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.819+0000 7fd3fc41c9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.39]): potential sources added=[] removed=[] 2024-09-19T14:11:43.818 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.819+0000 7fd3fc41c9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.39]): orig_dests= new_dests= 2024-09-19T14:11:43.818 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.819+0000 7fd3fc41c9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.39]): potential dests added=[] removed=[] 2024-09-19T14:11:43.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2.0 2024-09-19T14:11:43.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2.0 2024-09-19T14:11:43.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2.1 2024-09-19T14:11:43.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2.1 2024-09-19T14:11:43.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2.2 2024-09-19T14:11:43.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2.2 2024-09-19T14:11:43.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2.3 2024-09-19T14:11:43.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2.3 2024-09-19T14:11:43.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2.4 2024-09-19T14:11:43.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2.4 2024-09-19T14:11:43.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2.5 2024-09-19T14:11:43.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2.5 2024-09-19T14:11:43.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2.6 2024-09-19T14:11:43.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2.6 2024-09-19T14:11:43.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2.7 2024-09-19T14:11:43.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2.7 2024-09-19T14:11:43.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2.8 2024-09-19T14:11:43.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2.8 2024-09-19T14:11:43.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2.9 2024-09-19T14:11:43.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2.9 2024-09-19T14:11:43.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2.10 2024-09-19T14:11:43.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2.10 2024-09-19T14:11:43.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2.11 2024-09-19T14:11:43.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2.11 2024-09-19T14:11:43.831 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.827+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.0 2024-09-19T14:11:43.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.831+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1 2024-09-19T14:11:43.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.831+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2 2024-09-19T14:11:43.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.831+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.3 2024-09-19T14:11:43.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.831+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.4 2024-09-19T14:11:43.833 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.831+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.5 2024-09-19T14:11:43.835 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.835+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.6 2024-09-19T14:11:43.836 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.835+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.7 2024-09-19T14:11:43.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.835+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.8 2024-09-19T14:11:43.837 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.835+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.9 2024-09-19T14:11:43.838 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.839+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.10 2024-09-19T14:11:43.843 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.843+0000 7fd3fc41c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 : hit (requested=0x17, cached=0x17) 2024-09-19T14:11:43.843 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.843+0000 7fd3fc41c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 2024-09-19T14:11:43.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.847+0000 7fd3fc41c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 info.flags=0x17 2024-09-19T14:11:43.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.847+0000 7fd3fc41c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 to cache LRU end 2024-09-19T14:11:43.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.847+0000 7fd3fc41c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:43.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.847+0000 7fd3fc41c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39, ofs0, ns] 2024-09-19T14:11:43.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.847+0000 7fd2dd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333500 cookie 94489858162720 notifier 8004 bl.length()=931 2024-09-19T14:11:43.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.847+0000 7fd2dd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 info.flags=0x17 2024-09-19T14:11:43.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.847+0000 7fd2dd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 to cache LRU end 2024-09-19T14:11:43.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.847+0000 7fd2dd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:43.849 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.847+0000 7fd3fc41c9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.39]): orig_sources= new_sources= 2024-09-19T14:11:43.849 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.847+0000 7fd3fc41c9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.39]): potential sources added=[] removed=[] 2024-09-19T14:11:43.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.847+0000 7fd3fc41c9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.39]): orig_dests= new_dests= 2024-09-19T14:11:43.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.847+0000 7fd3fc41c9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.39]): potential dests added=[] removed=[] 2024-09-19T14:11:43.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.855+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.0 2024-09-19T14:11:43.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.855+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.1 2024-09-19T14:11:43.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.855+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.2 2024-09-19T14:11:43.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.855+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.3 2024-09-19T14:11:43.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.855+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.4 2024-09-19T14:11:43.857 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.855+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.5 2024-09-19T14:11:43.858 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.859+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.6 2024-09-19T14:11:43.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.859+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.7 2024-09-19T14:11:43.859 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.859+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.8 2024-09-19T14:11:43.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.859+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.9 2024-09-19T14:11:43.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.859+0000 7fd3fc41c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.39.10 2024-09-19T14:11:43.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.859+0000 7fd3fc41c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 : hit (requested=0x17, cached=0x17) 2024-09-19T14:11:43.861 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.859+0000 7fd3fc41c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 2024-09-19T14:11:43.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.863+0000 7fd3fc41c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 info.flags=0x17 2024-09-19T14:11:43.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.863+0000 7fd3fc41c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 to cache LRU end 2024-09-19T14:11:43.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.863+0000 7fd3fc41c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:43.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.863+0000 7fd3fc41c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39, ofs0, ns] 2024-09-19T14:11:43.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.863+0000 7fd2dd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333501 cookie 94489858162720 notifier 8004 bl.length()=899 2024-09-19T14:11:43.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.863+0000 7fd2dd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 info.flags=0x17 2024-09-19T14:11:43.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.863+0000 7fd2dd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:dbb1da81-49d0-421a-b677-974869a7f103.4620.39 to cache LRU end 2024-09-19T14:11:43.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.863+0000 7fd2dd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-19T14:11:43.867 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.867+0000 7fd3fc41c9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.39]): orig_sources= new_sources= 2024-09-19T14:11:43.867 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.867+0000 7fd3fc41c9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.39]): potential sources added=[] removed=[] 2024-09-19T14:11:43.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.867+0000 7fd3fc41c9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.39]): orig_dests= new_dests= 2024-09-19T14:11:43.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.867+0000 7fd3fc41c9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[dbb1da81-49d0-421a-b677-974869a7f103.4620.39]): potential dests added=[] removed=[] 2024-09-19T14:11:43.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.871+0000 7fd3fc41c9c0 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-19T14:11:43.875 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.875+0000 7fd2affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:43.880 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.879+0000 7fd3fc41c9c0 20 remove_watcher() i=0 2024-09-19T14:11:43.880 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.879+0000 7fd3fc41c9c0 2 removed watcher, disabling cache 2024-09-19T14:11:43.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.883+0000 7fd3fc41c9c0 20 remove_watcher() i=1 2024-09-19T14:11:43.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.883+0000 7fd3fc41c9c0 20 remove_watcher() i=2 2024-09-19T14:11:43.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.887+0000 7fd3fc41c9c0 20 remove_watcher() i=3 2024-09-19T14:11:43.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.887+0000 7fd3fc41c9c0 20 remove_watcher() i=4 2024-09-19T14:11:43.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.891+0000 7fd3fc41c9c0 20 remove_watcher() i=5 2024-09-19T14:11:43.892 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.891+0000 7fd3fc41c9c0 20 remove_watcher() i=6 2024-09-19T14:11:43.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:43.891+0000 7fd3fc41c9c0 20 remove_watcher() i=7 2024-09-19T14:11:43.912 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-19T14:11:43.943 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:11:43.943 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:11:44.195 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.195+0000 7fd6f69cf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:44.197 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.195+0000 7fd6f69cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:44.197 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.195+0000 7fd6f69cf9c0 20 realm 2024-09-19T14:11:44.197 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.195+0000 7fd6f69cf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:44.197 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.195+0000 7fd6f69cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:44.197 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.195+0000 7fd6f69cf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:11:44.197 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.195+0000 7fd6f69cf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:44.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.195+0000 7fd6f69cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:44.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.195+0000 7fd6f69cf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:44.199 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.199+0000 7fd6f69cf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:44.199 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.199+0000 7fd6f69cf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:44.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.199+0000 7fd6f69cf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:11:44.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.199+0000 7fd6f69cf9c0 20 searching for the correct realm 2024-09-19T14:11:44.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.203+0000 7fd6f3cd4640 0 -- 172.21.15.153:0/1622973232 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fd6e401b040 msgr2=0x7fd6e4037930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:44.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.419+0000 7fd6f44d5640 0 -- 172.21.15.153:0/1622973232 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fd6e805cac0 msgr2=0x7fd6e800c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:44.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.635+0000 7fd6f69cf9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:11:44.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.635+0000 7fd6f69cf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:11:44.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.635+0000 7fd6f69cf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:11:44.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.635+0000 7fd6f69cf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:11:44.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.635+0000 7fd6f69cf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:11:44.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.635+0000 7fd6f69cf9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:11:44.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.639+0000 7fd6f69cf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:44.639 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.639+0000 7fd6f69cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:44.639 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.639+0000 7fd6f69cf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:44.639 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.639+0000 7fd6f69cf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:44.639 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.639+0000 7fd6f69cf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:44.641 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.639+0000 7fd6f69cf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:11:44.641 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.639+0000 7fd6f69cf9c0 20 zone default found 2024-09-19T14:11:44.641 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.639+0000 7fd6f69cf9c0 4 Realm: () 2024-09-19T14:11:44.641 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.639+0000 7fd6f69cf9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:11:44.641 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.639+0000 7fd6f69cf9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:11:44.641 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.639+0000 7fd6f69cf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:11:44.641 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.639+0000 7fd6f69cf9c0 20 zonegroup default 2024-09-19T14:11:44.641 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.639+0000 7fd6f69cf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:44.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.639+0000 7fd6f69cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:44.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.639+0000 7fd6f69cf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:44.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.643+0000 7fd6f69cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:44.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.643+0000 7fd6f69cf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:44.643 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.643+0000 7fd6f69cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:44.643 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.643+0000 7fd6f69cf9c0 20 started sync module instance, tier type = 2024-09-19T14:11:44.643 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.643+0000 7fd6f69cf9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:11:44.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.663+0000 7fd6f69cf9c0 20 add_watcher() i=0 2024-09-19T14:11:44.666 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.663+0000 7fd6f69cf9c0 20 add_watcher() i=1 2024-09-19T14:11:44.666 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.663+0000 7fd6f69cf9c0 20 add_watcher() i=2 2024-09-19T14:11:44.666 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.663+0000 7fd6f69cf9c0 20 add_watcher() i=3 2024-09-19T14:11:44.666 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.663+0000 7fd6f69cf9c0 20 add_watcher() i=4 2024-09-19T14:11:44.666 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.663+0000 7fd6f69cf9c0 20 add_watcher() i=5 2024-09-19T14:11:44.666 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.663+0000 7fd6f69cf9c0 20 add_watcher() i=6 2024-09-19T14:11:44.668 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.667+0000 7fd6f69cf9c0 20 add_watcher() i=7 2024-09-19T14:11:44.668 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.667+0000 7fd6f69cf9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:11:44.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.671+0000 7fd5aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:44.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.671+0000 7fd6f69cf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:11:44.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.671+0000 7fd6f69cf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:11:44.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.671+0000 7fd6f69cf9c0 5 note: GC not initialized 2024-09-19T14:11:44.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.671+0000 7fd5a9fdb640 20 reqs_thread_entry: start 2024-09-19T14:11:44.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.671+0000 7fd6f69cf9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:11:44.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.671+0000 7fd6f69cf9c0 20 Filter name: none 2024-09-19T14:11:44.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.671+0000 7fd51b7fe640 20 reqs_thread_entry: start 2024-09-19T14:11:44.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.671+0000 7fd6f69cf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:44.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.671+0000 7fd6f69cf9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:11:44.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.671+0000 7fd6f69cf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:44.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.675+0000 7fd6f69cf9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:11:44.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.675+0000 7fd6f69cf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:11:44.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.675+0000 7fd6f69cf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:44.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.675+0000 7fd6f69cf9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-19T14:11:44.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.675+0000 7fd6f69cf9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:44.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.675+0000 7fd6f69cf9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T14:11:44.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.675+0000 7fd6f69cf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:11:44.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.679+0000 7fd5aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:44.683 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.683+0000 7fd6f69cf9c0 20 remove_watcher() i=0 2024-09-19T14:11:44.683 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.683+0000 7fd6f69cf9c0 2 removed watcher, disabling cache 2024-09-19T14:11:44.686 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.683+0000 7fd6f69cf9c0 20 remove_watcher() i=1 2024-09-19T14:11:44.688 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.687+0000 7fd6f69cf9c0 20 remove_watcher() i=2 2024-09-19T14:11:44.690 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.691+0000 7fd6f69cf9c0 20 remove_watcher() i=3 2024-09-19T14:11:44.692 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.691+0000 7fd6f69cf9c0 20 remove_watcher() i=4 2024-09-19T14:11:44.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.691+0000 7fd6f69cf9c0 20 remove_watcher() i=5 2024-09-19T14:11:44.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.695+0000 7fd6f69cf9c0 20 remove_watcher() i=6 2024-09-19T14:11:44.696 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:44.695+0000 7fd6f69cf9c0 20 remove_watcher() i=7 2024-09-19T14:11:44.712 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:44.712 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:11:44.712 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: abort-at-change-reshard-state id: dbb1da81-49d0-421a-b677-974869a7f103.4620.39 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-19T14:11:44.712 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:44.714 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:44.714 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:44.745 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:44.745 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:45.276 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:45.276 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:45.652 INFO:tasks.workunit.client.0.smithi153.stderr: test: logrecord could be stopped after reshard failed 2024-09-19T14:11:45.652 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T14:11:45.685 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:11:45.685 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:11:45.730 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.731+0000 7f0481abe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:45.732 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.731+0000 7f0481abe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:45.732 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.731+0000 7f0481abe9c0 20 realm 2024-09-19T14:11:45.732 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.731+0000 7f0481abe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:45.732 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.731+0000 7f0481abe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:45.732 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.731+0000 7f0481abe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:11:45.732 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.731+0000 7f0481abe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:45.733 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.731+0000 7f0481abe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:45.733 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.731+0000 7f0481abe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:45.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.735+0000 7f0481abe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:45.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.735+0000 7f0481abe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:45.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.735+0000 7f0481abe9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:11:45.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.735+0000 7f0481abe9c0 20 searching for the correct realm 2024-09-19T14:11:45.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.739+0000 7f047edc3640 0 -- 172.21.15.153:0/134556315 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f047004d040 msgr2=0x7f047004d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:45.745 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.743+0000 7f047f5c4640 0 -- 172.21.15.153:0/134556315 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f04740786f0 msgr2=0x7f047406dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:45.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.959+0000 7f0481abe9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:11:45.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.959+0000 7f0481abe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:11:45.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.959+0000 7f0481abe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:11:45.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.959+0000 7f0481abe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:11:45.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.959+0000 7f0481abe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:11:45.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.959+0000 7f0481abe9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:11:45.962 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.959+0000 7f0481abe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:45.962 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.959+0000 7f0481abe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:45.962 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.959+0000 7f0481abe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:45.962 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.963+0000 7f0481abe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:45.962 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.963+0000 7f0481abe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:45.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.963+0000 7f0481abe9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:11:45.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.963+0000 7f0481abe9c0 20 zone default found 2024-09-19T14:11:45.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.963+0000 7f0481abe9c0 4 Realm: () 2024-09-19T14:11:45.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.963+0000 7f0481abe9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:11:45.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.963+0000 7f0481abe9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:11:45.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.963+0000 7f0481abe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:11:45.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.963+0000 7f0481abe9c0 20 zonegroup default 2024-09-19T14:11:45.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.963+0000 7f0481abe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:45.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.963+0000 7f0481abe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:45.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.963+0000 7f0481abe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:45.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.963+0000 7f0481abe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:45.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.963+0000 7f0481abe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:45.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.963+0000 7f0481abe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:45.966 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.963+0000 7f0481abe9c0 20 started sync module instance, tier type = 2024-09-19T14:11:45.966 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.963+0000 7f0481abe9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:11:45.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.987+0000 7f0481abe9c0 20 add_watcher() i=0 2024-09-19T14:11:45.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.987+0000 7f0481abe9c0 20 add_watcher() i=1 2024-09-19T14:11:45.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.987+0000 7f0481abe9c0 20 add_watcher() i=2 2024-09-19T14:11:45.989 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.987+0000 7f0481abe9c0 20 add_watcher() i=3 2024-09-19T14:11:45.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.987+0000 7f0481abe9c0 20 add_watcher() i=4 2024-09-19T14:11:45.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.987+0000 7f0481abe9c0 20 add_watcher() i=5 2024-09-19T14:11:45.990 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.987+0000 7f0481abe9c0 20 add_watcher() i=6 2024-09-19T14:11:45.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.991+0000 7f0481abe9c0 20 add_watcher() i=7 2024-09-19T14:11:45.992 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.991+0000 7f0481abe9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:11:45.996 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.995+0000 7f0335fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:45.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.995+0000 7f0481abe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:11:45.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.995+0000 7f0481abe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:11:45.997 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.995+0000 7f0481abe9c0 5 note: GC not initialized 2024-09-19T14:11:45.998 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.995+0000 7f0334fe1640 20 reqs_thread_entry: start 2024-09-19T14:11:45.998 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.995+0000 7f0481abe9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:11:45.998 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.995+0000 7f0481abe9c0 20 Filter name: none 2024-09-19T14:11:45.998 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.999+0000 7f02ae7fc640 20 reqs_thread_entry: start 2024-09-19T14:11:45.998 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.999+0000 7f0481abe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:45.999 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.999+0000 7f0481abe9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:11:45.999 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.999+0000 7f0481abe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.999+0000 7f0481abe9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:11:46.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.999+0000 7f0481abe9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:11:46.000 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.999+0000 7f0481abe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.001 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.999+0000 7f0481abe9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:11:46.001 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:45.999+0000 7f0481abe9c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.003+0000 7f0481abe9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:11:46.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.003+0000 7f0481abe9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:11:46.005 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.003+0000 7f0335fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:46.009 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.007+0000 7f0481abe9c0 20 remove_watcher() i=0 2024-09-19T14:11:46.009 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.007+0000 7f0481abe9c0 2 removed watcher, disabling cache 2024-09-19T14:11:46.012 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.011+0000 7f0481abe9c0 20 remove_watcher() i=1 2024-09-19T14:11:46.014 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.015+0000 7f0481abe9c0 20 remove_watcher() i=2 2024-09-19T14:11:46.016 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.015+0000 7f0481abe9c0 20 remove_watcher() i=3 2024-09-19T14:11:46.017 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.015+0000 7f0481abe9c0 20 remove_watcher() i=4 2024-09-19T14:11:46.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.019+0000 7f0481abe9c0 20 remove_watcher() i=5 2024-09-19T14:11:46.020 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.019+0000 7f0481abe9c0 20 remove_watcher() i=6 2024-09-19T14:11:46.022 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.023+0000 7f0481abe9c0 20 remove_watcher() i=7 2024-09-19T14:11:46.038 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.038 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:11:46.038 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: a-bucket id: dbb1da81-49d0-421a-b677-974869a7f103.4620.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-19T14:11:46.038 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.039 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T14:11:46.066 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:11:46.066 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:11:46.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.111+0000 7f61543449c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.111+0000 7f61543449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.111+0000 7f61543449c0 20 realm 2024-09-19T14:11:46.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.111+0000 7f61543449c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.111+0000 7f61543449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.111+0000 7f61543449c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:11:46.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.111+0000 7f61543449c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.111+0000 7f61543449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.111+0000 7f61543449c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.115+0000 7f61543449c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:46.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.115+0000 7f61543449c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.115+0000 7f61543449c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:11:46.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.115+0000 7f61543449c0 20 searching for the correct realm 2024-09-19T14:11:46.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.119+0000 7f615264b640 0 -- 172.21.15.153:0/3447047891 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x556e55968380 msgr2=0x556e5596a770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:46.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.127+0000 7f6151e4a640 0 -- 172.21.15.153:0/3447047891 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f61480ac040 msgr2=0x7f6148138740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:46.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.131+0000 7f61543449c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:11:46.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.131+0000 7f61543449c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:11:46.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.131+0000 7f61543449c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:11:46.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.131+0000 7f61543449c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:11:46.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.131+0000 7f61543449c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:11:46.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.131+0000 7f61543449c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:11:46.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.131+0000 7f61543449c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.135+0000 7f61543449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.135+0000 7f61543449c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.135+0000 7f61543449c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:46.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.135+0000 7f61543449c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.135+0000 7f61543449c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:11:46.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.135+0000 7f61543449c0 20 zone default found 2024-09-19T14:11:46.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.135+0000 7f61543449c0 4 Realm: () 2024-09-19T14:11:46.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.135+0000 7f61543449c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:11:46.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.135+0000 7f61543449c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:11:46.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.135+0000 7f61543449c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:11:46.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.135+0000 7f61543449c0 20 zonegroup default 2024-09-19T14:11:46.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.135+0000 7f61543449c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.135+0000 7f61543449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.135+0000 7f61543449c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.137 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.135+0000 7f61543449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.137 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.135+0000 7f61543449c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.137 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.135+0000 7f61543449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.137 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.135+0000 7f61543449c0 20 started sync module instance, tier type = 2024-09-19T14:11:46.137 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.135+0000 7f61543449c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:11:46.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.151+0000 7f61543449c0 20 add_watcher() i=0 2024-09-19T14:11:46.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.151+0000 7f61543449c0 20 add_watcher() i=1 2024-09-19T14:11:46.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.151+0000 7f61543449c0 20 add_watcher() i=2 2024-09-19T14:11:46.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.151+0000 7f61543449c0 20 add_watcher() i=3 2024-09-19T14:11:46.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.151+0000 7f61543449c0 20 add_watcher() i=4 2024-09-19T14:11:46.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.151+0000 7f61543449c0 20 add_watcher() i=5 2024-09-19T14:11:46.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.151+0000 7f61543449c0 20 add_watcher() i=6 2024-09-19T14:11:46.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.151+0000 7f61543449c0 20 add_watcher() i=7 2024-09-19T14:11:46.153 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.151+0000 7f61543449c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:11:46.156 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.155+0000 7f60037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:46.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.155+0000 7f61543449c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:11:46.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.155+0000 7f61543449c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:11:46.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.155+0000 7f61543449c0 5 note: GC not initialized 2024-09-19T14:11:46.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.155+0000 7f60027fc640 20 reqs_thread_entry: start 2024-09-19T14:11:46.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.155+0000 7f61543449c0 20 init_complete bucket index max shards: 11 2024-09-19T14:11:46.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.155+0000 7f61543449c0 20 Filter name: none 2024-09-19T14:11:46.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.155+0000 7f5f73fff640 20 reqs_thread_entry: start 2024-09-19T14:11:46.157 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.155+0000 7f61543449c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.155+0000 7f61543449c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:11:46.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.155+0000 7f61543449c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.159+0000 7f61543449c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:11:46.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.159+0000 7f61543449c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:11:46.158 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.159+0000 7f61543449c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.159 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.159+0000 7f61543449c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:11:46.159 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.159+0000 7f61543449c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.159 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.159+0000 7f61543449c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:11:46.159 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.159+0000 7f61543449c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:11:46.162 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.163+0000 7f60037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:46.166 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.167+0000 7f61543449c0 20 remove_watcher() i=0 2024-09-19T14:11:46.167 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.167+0000 7f61543449c0 2 removed watcher, disabling cache 2024-09-19T14:11:46.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.167+0000 7f61543449c0 20 remove_watcher() i=1 2024-09-19T14:11:46.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.171+0000 7f61543449c0 20 remove_watcher() i=2 2024-09-19T14:11:46.172 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.171+0000 7f61543449c0 20 remove_watcher() i=3 2024-09-19T14:11:46.174 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.175+0000 7f61543449c0 20 remove_watcher() i=4 2024-09-19T14:11:46.176 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.175+0000 7f61543449c0 20 remove_watcher() i=5 2024-09-19T14:11:46.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.179+0000 7f61543449c0 20 remove_watcher() i=6 2024-09-19T14:11:46.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.179+0000 7f61543449c0 20 remove_watcher() i=7 2024-09-19T14:11:46.193 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-19T14:11:46.225 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:11:46.225 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:11:46.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.271+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.271+0000 7efc023419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.271+0000 7efc023419c0 20 realm 2024-09-19T14:11:46.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.271+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.271+0000 7efc023419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.271+0000 7efc023419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:11:46.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.271+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.271+0000 7efc023419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.273 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.271+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.275+0000 7efc023419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:46.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.275+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.275+0000 7efc023419c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:11:46.275 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.275+0000 7efc023419c0 20 searching for the correct realm 2024-09-19T14:11:46.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.279+0000 7efc00648640 0 -- 172.21.15.153:0/387941972 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55d90a50a5b0 msgr2=0x55d90a50ca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:46.287 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.287+0000 7efbffe47640 0 -- 172.21.15.153:0/387941972 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7efbf40714b0 msgr2=0x7efbf40658e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:46.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.295+0000 7efc023419c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:11:46.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.295+0000 7efc023419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:11:46.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.295+0000 7efc023419c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:11:46.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.295+0000 7efc023419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:11:46.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.295+0000 7efc023419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:11:46.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.295+0000 7efc023419c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:11:46.295 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:46.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:11:46.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.295+0000 7efc023419c0 20 zone default found 2024-09-19T14:11:46.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.295+0000 7efc023419c0 4 Realm: () 2024-09-19T14:11:46.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.295+0000 7efc023419c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:11:46.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.295+0000 7efc023419c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:11:46.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.295+0000 7efc023419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:11:46.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.295+0000 7efc023419c0 20 zonegroup default 2024-09-19T14:11:46.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.299+0000 7efc023419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.299+0000 7efc023419c0 20 started sync module instance, tier type = 2024-09-19T14:11:46.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.299+0000 7efc023419c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:11:46.315 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.315+0000 7efc023419c0 20 add_watcher() i=0 2024-09-19T14:11:46.315 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.315+0000 7efc023419c0 20 add_watcher() i=1 2024-09-19T14:11:46.315 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.315+0000 7efc023419c0 20 add_watcher() i=2 2024-09-19T14:11:46.315 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.315+0000 7efc023419c0 20 add_watcher() i=3 2024-09-19T14:11:46.315 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.315+0000 7efc023419c0 20 add_watcher() i=4 2024-09-19T14:11:46.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.315+0000 7efc023419c0 20 add_watcher() i=5 2024-09-19T14:11:46.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.315+0000 7efc023419c0 20 add_watcher() i=6 2024-09-19T14:11:46.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.315+0000 7efc023419c0 20 add_watcher() i=7 2024-09-19T14:11:46.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.315+0000 7efc023419c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:11:46.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.319+0000 7efab5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:46.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.319+0000 7efc023419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:11:46.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.319+0000 7efc023419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:11:46.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.319+0000 7efc023419c0 5 note: GC not initialized 2024-09-19T14:11:46.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.319+0000 7efab4fe1640 20 reqs_thread_entry: start 2024-09-19T14:11:46.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.319+0000 7efc023419c0 20 init_complete bucket index max shards: 11 2024-09-19T14:11:46.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.319+0000 7efc023419c0 20 Filter name: none 2024-09-19T14:11:46.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.319+0000 7efa2e7fc640 20 reqs_thread_entry: start 2024-09-19T14:11:46.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.319+0000 7efc023419c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:11:46.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.319+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.319+0000 7efc023419c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:11:46.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.319+0000 7efc023419c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:11:46.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.319+0000 7efc023419c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:11:46.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.319+0000 7efc023419c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : miss 2024-09-19T14:11:46.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.319+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.319+0000 7efc023419c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:11:46.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.319+0000 7efc023419c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:11:46.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.319+0000 7efc023419c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:11:46.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.319+0000 7efc023419c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:11:46.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.319+0000 7efc023419c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:11:46.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.319+0000 7efc023419c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:11:46.331 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.331+0000 7efc023419c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:11:46.331 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.331+0000 7efc023419c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:11:46.331 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.331+0000 7efc023419c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:11:46.331 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.331+0000 7efc023419c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17, ofs0, ns] 2024-09-19T14:11:46.331 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.331+0000 7efade7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333525 cookie 94390669384832 notifier 7556 bl.length()=827 2024-09-19T14:11:46.332 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.331+0000 7efade7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:11:46.332 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.331+0000 7efade7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:11:46.332 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.331+0000 7efade7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:11:46.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.331+0000 7efc023419c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_sources= new_sources= 2024-09-19T14:11:46.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.331+0000 7efc023419c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential sources added=[] removed=[] 2024-09-19T14:11:46.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.331+0000 7efc023419c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_dests= new_dests= 2024-09-19T14:11:46.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.331+0000 7efc023419c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential dests added=[] removed=[] 2024-09-19T14:11:46.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.0 2024-09-19T14:11:46.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.0 2024-09-19T14:11:46.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.1 2024-09-19T14:11:46.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.1 2024-09-19T14:11:46.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.2 2024-09-19T14:11:46.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.2 2024-09-19T14:11:46.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.3 2024-09-19T14:11:46.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.3 2024-09-19T14:11:46.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.4 2024-09-19T14:11:46.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.4 2024-09-19T14:11:46.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.5 2024-09-19T14:11:46.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.5 2024-09-19T14:11:46.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.6 2024-09-19T14:11:46.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.6 2024-09-19T14:11:46.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.7 2024-09-19T14:11:46.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.7 2024-09-19T14:11:46.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.8 2024-09-19T14:11:46.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.8 2024-09-19T14:11:46.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.9 2024-09-19T14:11:46.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.9 2024-09-19T14:11:46.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.10 2024-09-19T14:11:46.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.10 2024-09-19T14:11:46.349 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.11 2024-09-19T14:11:46.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.11 2024-09-19T14:11:46.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.12 2024-09-19T14:11:46.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.12 2024-09-19T14:11:46.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.13 2024-09-19T14:11:46.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.13 2024-09-19T14:11:46.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:11:46.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:11:46.350 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:11:46.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:11:46.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.351+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:11:46.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.351+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:11:46.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.351+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:11:46.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.351+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:11:46.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.351+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:11:46.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.351+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:11:46.354 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.351+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:11:46.354 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.351+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:11:46.354 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.355+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:11:46.354 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.355+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:11:46.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.355+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:11:46.355 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.355+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:11:46.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.355+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:11:46.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.355+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:11:46.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.355+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:11:46.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.355+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:11:46.357 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.355+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:11:46.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.355+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:11:46.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.359+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:11:46.358 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.359+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:11:46.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.359+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:11:46.359 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.359+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:11:46.363 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efc023419c0 time 2024-09-19T14:11:46.365238+0000 2024-09-19T14:11:46.363 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:11:46.364 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:11:46.364 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7efc05c1b2eb] 2024-09-19T14:11:46.365 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7efc05c1b49f] 2024-09-19T14:11:46.365 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d90773a271] 2024-09-19T14:11:46.365 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55d907749441] 2024-09-19T14:11:46.365 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55d90774aa94] 2024-09-19T14:11:46.365 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:11:46.365 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7efc04a81d90] 2024-09-19T14:11:46.365 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:11:46.365 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:11:46.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.363+0000 7efc023419c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efc023419c0 time 2024-09-19T14:11:46.365238+0000 2024-09-19T14:11:46.365 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:11:46.365 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.365 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:11:46.365 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7efc05c1b2eb] 2024-09-19T14:11:46.366 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7efc05c1b49f] 2024-09-19T14:11:46.366 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d90773a271] 2024-09-19T14:11:46.366 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55d907749441] 2024-09-19T14:11:46.366 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55d90774aa94] 2024-09-19T14:11:46.366 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:11:46.366 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7efc04a81d90] 2024-09-19T14:11:46.366 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:11:46.366 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:11:46.366 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.366 INFO:tasks.workunit.client.0.smithi153.stderr:*** Caught signal (Aborted) ** 2024-09-19T14:11:46.366 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7efc023419c0 thread_name:radosgw-admin 2024-09-19T14:11:46.384 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:11:46.384 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7efc04a9a520] 2024-09-19T14:11:46.384 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:11:46.384 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:11:46.384 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:11:46.384 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7efc05c1b345] 2024-09-19T14:11:46.384 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7efc05c1b49f] 2024-09-19T14:11:46.384 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d90773a271] 2024-09-19T14:11:46.384 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55d907749441] 2024-09-19T14:11:46.385 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55d90774aa94] 2024-09-19T14:11:46.385 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:11:46.385 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7efc04a81d90] 2024-09-19T14:11:46.385 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:11:46.385 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:11:46.385 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.363+0000 7efc023419c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:11:46.385 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7efc023419c0 thread_name:radosgw-admin 2024-09-19T14:11:46.385 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.385 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:11:46.385 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7efc04a9a520] 2024-09-19T14:11:46.385 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:11:46.386 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:11:46.386 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:11:46.386 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7efc05c1b345] 2024-09-19T14:11:46.386 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7efc05c1b49f] 2024-09-19T14:11:46.386 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d90773a271] 2024-09-19T14:11:46.386 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55d907749441] 2024-09-19T14:11:46.386 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55d90774aa94] 2024-09-19T14:11:46.386 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:11:46.386 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7efc04a81d90] 2024-09-19T14:11:46.386 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:11:46.386 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:11:46.386 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:11:46.386 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.387 INFO:tasks.workunit.client.0.smithi153.stderr:--- begin dump of recent events --- 2024-09-19T14:11:46.387 INFO:tasks.workunit.client.0.smithi153.stderr: -499> 2024-09-19T14:11:46.247+0000 7efc023419c0 5 AuthRegistry(0x55d90a41fe30) adding con mode: crc 2024-09-19T14:11:46.387 INFO:tasks.workunit.client.0.smithi153.stderr: -498> 2024-09-19T14:11:46.247+0000 7efc023419c0 5 AuthRegistry(0x55d90a41fe30) adding con mode: secure 2024-09-19T14:11:46.387 INFO:tasks.workunit.client.0.smithi153.stderr: -497> 2024-09-19T14:11:46.247+0000 7efc023419c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:46.387 INFO:tasks.workunit.client.0.smithi153.stderr: -496> 2024-09-19T14:11:46.247+0000 7efc023419c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:46.387 INFO:tasks.workunit.client.0.smithi153.stderr: -495> 2024-09-19T14:11:46.247+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command rotate-key hook 0x55d90a41ff78 2024-09-19T14:11:46.387 INFO:tasks.workunit.client.0.smithi153.stderr: -494> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient: _reopen_session rank -1 2024-09-19T14:11:46.387 INFO:tasks.workunit.client.0.smithi153.stderr: -493> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:11:46.387 INFO:tasks.workunit.client.0.smithi153.stderr: -492> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient(hunting): picked mon.noname-b con 0x55d90a2ad410 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:11:46.387 INFO:tasks.workunit.client.0.smithi153.stderr: -491> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient(hunting): picked mon.noname-a con 0x55d90a2ae0f0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:11:46.387 INFO:tasks.workunit.client.0.smithi153.stderr: -490> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient(hunting): picked mon.noname-c con 0x55d90a45e700 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:11:46.387 INFO:tasks.workunit.client.0.smithi153.stderr: -489> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:46.387 INFO:tasks.workunit.client.0.smithi153.stderr: -488> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:46.388 INFO:tasks.workunit.client.0.smithi153.stderr: -487> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:46.388 INFO:tasks.workunit.client.0.smithi153.stderr: -486> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient(hunting): _renew_subs 2024-09-19T14:11:46.388 INFO:tasks.workunit.client.0.smithi153.stderr: -485> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient(hunting): authenticate will time out at 2894.710960s 2024-09-19T14:11:46.388 INFO:tasks.workunit.client.0.smithi153.stderr: -484> 2024-09-19T14:11:46.247+0000 7efc00648640 10 monclient(hunting): get_auth_request con 0x55d90a45e700 auth_method 0 2024-09-19T14:11:46.388 INFO:tasks.workunit.client.0.smithi153.stderr: -483> 2024-09-19T14:11:46.247+0000 7efc00648640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:46.388 INFO:tasks.workunit.client.0.smithi153.stderr: -482> 2024-09-19T14:11:46.247+0000 7efc00648640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:46.388 INFO:tasks.workunit.client.0.smithi153.stderr: -481> 2024-09-19T14:11:46.247+0000 7efc00648640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:46.388 INFO:tasks.workunit.client.0.smithi153.stderr: -480> 2024-09-19T14:11:46.247+0000 7efbff646640 10 monclient(hunting): get_auth_request con 0x55d90a2ae0f0 auth_method 0 2024-09-19T14:11:46.388 INFO:tasks.workunit.client.0.smithi153.stderr: -479> 2024-09-19T14:11:46.247+0000 7efbff646640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:46.388 INFO:tasks.workunit.client.0.smithi153.stderr: -478> 2024-09-19T14:11:46.247+0000 7efbff646640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:46.388 INFO:tasks.workunit.client.0.smithi153.stderr: -477> 2024-09-19T14:11:46.247+0000 7efbff646640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:46.388 INFO:tasks.workunit.client.0.smithi153.stderr: -476> 2024-09-19T14:11:46.247+0000 7efc00648640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:46.388 INFO:tasks.workunit.client.0.smithi153.stderr: -475> 2024-09-19T14:11:46.247+0000 7efc00648640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:46.388 INFO:tasks.workunit.client.0.smithi153.stderr: -474> 2024-09-19T14:11:46.247+0000 7efc00648640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:46.389 INFO:tasks.workunit.client.0.smithi153.stderr: -473> 2024-09-19T14:11:46.247+0000 7efbff646640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:46.389 INFO:tasks.workunit.client.0.smithi153.stderr: -472> 2024-09-19T14:11:46.247+0000 7efbff646640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:46.389 INFO:tasks.workunit.client.0.smithi153.stderr: -471> 2024-09-19T14:11:46.247+0000 7efbff646640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:46.389 INFO:tasks.workunit.client.0.smithi153.stderr: -470> 2024-09-19T14:11:46.247+0000 7efc00648640 10 monclient(hunting): handle_auth_done global_id 7547 payload 824 2024-09-19T14:11:46.389 INFO:tasks.workunit.client.0.smithi153.stderr: -469> 2024-09-19T14:11:46.247+0000 7efc00648640 10 monclient: _finish_hunting 0 2024-09-19T14:11:46.389 INFO:tasks.workunit.client.0.smithi153.stderr: -468> 2024-09-19T14:11:46.247+0000 7efc00648640 1 monclient: found mon.noname-c 2024-09-19T14:11:46.389 INFO:tasks.workunit.client.0.smithi153.stderr: -467> 2024-09-19T14:11:46.247+0000 7efc00648640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:11:46.389 INFO:tasks.workunit.client.0.smithi153.stderr: -466> 2024-09-19T14:11:46.247+0000 7efae7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:46.389 INFO:tasks.workunit.client.0.smithi153.stderr: -465> 2024-09-19T14:11:46.247+0000 7efae7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:11:46.389 INFO:tasks.workunit.client.0.smithi153.stderr: -464> 2024-09-19T14:11:46.247+0000 7efae7fff640 10 monclient: dump: 2024-09-19T14:11:46.389 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:46.389 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:46.389 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.390 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.390 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:46.390 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:46.390 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:46.390 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:46.390 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:46.390 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.390 INFO:tasks.workunit.client.0.smithi153.stderr: -463> 2024-09-19T14:11:46.247+0000 7efae7fff640 10 monclient: _finish_auth 0 2024-09-19T14:11:46.390 INFO:tasks.workunit.client.0.smithi153.stderr: -462> 2024-09-19T14:11:46.247+0000 7efae7fff640 10 monclient: _check_auth_tickets 2024-09-19T14:11:46.390 INFO:tasks.workunit.client.0.smithi153.stderr: -461> 2024-09-19T14:11:46.247+0000 7efae7fff640 10 monclient: handle_config config(0 keys) 2024-09-19T14:11:46.390 INFO:tasks.workunit.client.0.smithi153.stderr: -460> 2024-09-19T14:11:46.247+0000 7efae7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:46.390 INFO:tasks.workunit.client.0.smithi153.stderr: -459> 2024-09-19T14:11:46.247+0000 7efae7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:11:46.390 INFO:tasks.workunit.client.0.smithi153.stderr: -458> 2024-09-19T14:11:46.247+0000 7efae7fff640 10 monclient: dump: 2024-09-19T14:11:46.390 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:46.391 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:46.391 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.391 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.391 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:46.391 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:46.391 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:46.391 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:46.391 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:46.391 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.391 INFO:tasks.workunit.client.0.smithi153.stderr: -457> 2024-09-19T14:11:46.247+0000 7efc023419c0 5 monclient: authenticate success, global_id 7547 2024-09-19T14:11:46.391 INFO:tasks.workunit.client.0.smithi153.stderr: -456> 2024-09-19T14:11:46.247+0000 7efaede0b640 4 set_mon_vals no callback set 2024-09-19T14:11:46.391 INFO:tasks.workunit.client.0.smithi153.stderr: -455> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient: _renew_subs 2024-09-19T14:11:46.391 INFO:tasks.workunit.client.0.smithi153.stderr: -454> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:11:46.391 INFO:tasks.workunit.client.0.smithi153.stderr: -453> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient: _renew_subs 2024-09-19T14:11:46.391 INFO:tasks.workunit.client.0.smithi153.stderr: -452> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:11:46.391 INFO:tasks.workunit.client.0.smithi153.stderr: -451> 2024-09-19T14:11:46.247+0000 7efc023419c0 1 librados: init done 2024-09-19T14:11:46.391 INFO:tasks.workunit.client.0.smithi153.stderr: -450> 2024-09-19T14:11:46.251+0000 7efae7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:11:46.392 INFO:tasks.workunit.client.0.smithi153.stderr: -449> 2024-09-19T14:11:46.251+0000 7efae7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:11:46.392 INFO:tasks.workunit.client.0.smithi153.stderr: -448> 2024-09-19T14:11:46.251+0000 7efae7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:11:46.392 INFO:tasks.workunit.client.0.smithi153.stderr: -447> 2024-09-19T14:11:46.251+0000 7efbffe47640 10 monclient: get_auth_request con 0x7efae8071be0 auth_method 0 2024-09-19T14:11:46.392 INFO:tasks.workunit.client.0.smithi153.stderr: -446> 2024-09-19T14:11:46.251+0000 7efbff646640 10 monclient: get_auth_request con 0x55d90a44b4f0 auth_method 0 2024-09-19T14:11:46.392 INFO:tasks.workunit.client.0.smithi153.stderr: -445> 2024-09-19T14:11:46.251+0000 7efbffe47640 10 monclient: get_auth_request con 0x55d90a46b410 auth_method 0 2024-09-19T14:11:46.392 INFO:tasks.workunit.client.0.smithi153.stderr: -444> 2024-09-19T14:11:46.255+0000 7efbff646640 10 monclient: get_auth_request con 0x55d90a4706d0 auth_method 0 2024-09-19T14:11:46.392 INFO:tasks.workunit.client.0.smithi153.stderr: -443> 2024-09-19T14:11:46.255+0000 7efc023419c0 10 monclient: build_initial_monmap 2024-09-19T14:11:46.392 INFO:tasks.workunit.client.0.smithi153.stderr: -442> 2024-09-19T14:11:46.255+0000 7efc023419c0 1 build_initial for_mkfs: 0 2024-09-19T14:11:46.392 INFO:tasks.workunit.client.0.smithi153.stderr: -441> 2024-09-19T14:11:46.255+0000 7efc023419c0 10 monclient: monmap: 2024-09-19T14:11:46.392 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:11:46.392 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:11:46.392 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:11:46.392 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:11:46.392 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:11:46.393 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:46.393 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:11:46.393 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:11:46.393 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:11:46.393 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.393 INFO:tasks.workunit.client.0.smithi153.stderr: -440> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding auth protocol: cephx 2024-09-19T14:11:46.393 INFO:tasks.workunit.client.0.smithi153.stderr: -439> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding auth protocol: cephx 2024-09-19T14:11:46.393 INFO:tasks.workunit.client.0.smithi153.stderr: -438> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding auth protocol: cephx 2024-09-19T14:11:46.393 INFO:tasks.workunit.client.0.smithi153.stderr: -437> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding con mode: secure 2024-09-19T14:11:46.393 INFO:tasks.workunit.client.0.smithi153.stderr: -436> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding con mode: crc 2024-09-19T14:11:46.393 INFO:tasks.workunit.client.0.smithi153.stderr: -435> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding con mode: secure 2024-09-19T14:11:46.393 INFO:tasks.workunit.client.0.smithi153.stderr: -434> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding con mode: crc 2024-09-19T14:11:46.393 INFO:tasks.workunit.client.0.smithi153.stderr: -433> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding con mode: secure 2024-09-19T14:11:46.393 INFO:tasks.workunit.client.0.smithi153.stderr: -432> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding con mode: crc 2024-09-19T14:11:46.393 INFO:tasks.workunit.client.0.smithi153.stderr: -431> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding con mode: crc 2024-09-19T14:11:46.394 INFO:tasks.workunit.client.0.smithi153.stderr: -430> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding con mode: secure 2024-09-19T14:11:46.394 INFO:tasks.workunit.client.0.smithi153.stderr: -429> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding con mode: crc 2024-09-19T14:11:46.394 INFO:tasks.workunit.client.0.smithi153.stderr: -428> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding con mode: secure 2024-09-19T14:11:46.394 INFO:tasks.workunit.client.0.smithi153.stderr: -427> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding con mode: crc 2024-09-19T14:11:46.394 INFO:tasks.workunit.client.0.smithi153.stderr: -426> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding con mode: secure 2024-09-19T14:11:46.394 INFO:tasks.workunit.client.0.smithi153.stderr: -425> 2024-09-19T14:11:46.259+0000 7efc023419c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:46.394 INFO:tasks.workunit.client.0.smithi153.stderr: -424> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command objecter_requests cmddesc objecter_requests hook 0x55d90a478080 EEXIST 2024-09-19T14:11:46.394 INFO:tasks.workunit.client.0.smithi153.stderr: -423> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient: init 2024-09-19T14:11:46.394 INFO:tasks.workunit.client.0.smithi153.stderr: -422> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding auth protocol: cephx 2024-09-19T14:11:46.394 INFO:tasks.workunit.client.0.smithi153.stderr: -421> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding auth protocol: cephx 2024-09-19T14:11:46.394 INFO:tasks.workunit.client.0.smithi153.stderr: -420> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding auth protocol: cephx 2024-09-19T14:11:46.394 INFO:tasks.workunit.client.0.smithi153.stderr: -419> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding con mode: secure 2024-09-19T14:11:46.394 INFO:tasks.workunit.client.0.smithi153.stderr: -418> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding con mode: crc 2024-09-19T14:11:46.394 INFO:tasks.workunit.client.0.smithi153.stderr: -417> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding con mode: secure 2024-09-19T14:11:46.395 INFO:tasks.workunit.client.0.smithi153.stderr: -416> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding con mode: crc 2024-09-19T14:11:46.395 INFO:tasks.workunit.client.0.smithi153.stderr: -415> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding con mode: secure 2024-09-19T14:11:46.395 INFO:tasks.workunit.client.0.smithi153.stderr: -414> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding con mode: crc 2024-09-19T14:11:46.395 INFO:tasks.workunit.client.0.smithi153.stderr: -413> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding con mode: crc 2024-09-19T14:11:46.395 INFO:tasks.workunit.client.0.smithi153.stderr: -412> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding con mode: secure 2024-09-19T14:11:46.395 INFO:tasks.workunit.client.0.smithi153.stderr: -411> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding con mode: crc 2024-09-19T14:11:46.395 INFO:tasks.workunit.client.0.smithi153.stderr: -410> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding con mode: secure 2024-09-19T14:11:46.395 INFO:tasks.workunit.client.0.smithi153.stderr: -409> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding con mode: crc 2024-09-19T14:11:46.395 INFO:tasks.workunit.client.0.smithi153.stderr: -408> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding con mode: secure 2024-09-19T14:11:46.395 INFO:tasks.workunit.client.0.smithi153.stderr: -407> 2024-09-19T14:11:46.259+0000 7efc023419c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:46.395 INFO:tasks.workunit.client.0.smithi153.stderr: -406> 2024-09-19T14:11:46.259+0000 7efc023419c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:46.395 INFO:tasks.workunit.client.0.smithi153.stderr: -405> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command rotate-key cmddesc rotate-key hook 0x55d90a473830 EEXIST 2024-09-19T14:11:46.395 INFO:tasks.workunit.client.0.smithi153.stderr: -404> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient: _reopen_session rank -1 2024-09-19T14:11:46.395 INFO:tasks.workunit.client.0.smithi153.stderr: -403> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T14:11:46.395 INFO:tasks.workunit.client.0.smithi153.stderr: -402> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient(hunting): picked mon.noname-b con 0x55d90a49c230 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:11:46.395 INFO:tasks.workunit.client.0.smithi153.stderr: -401> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient(hunting): picked mon.noname-c con 0x55d90a49bb60 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:11:46.396 INFO:tasks.workunit.client.0.smithi153.stderr: -400> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient(hunting): picked mon.noname-a con 0x55d90a49a540 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:11:46.396 INFO:tasks.workunit.client.0.smithi153.stderr: -399> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:46.396 INFO:tasks.workunit.client.0.smithi153.stderr: -398> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:46.396 INFO:tasks.workunit.client.0.smithi153.stderr: -397> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:46.396 INFO:tasks.workunit.client.0.smithi153.stderr: -396> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient(hunting): _renew_subs 2024-09-19T14:11:46.396 INFO:tasks.workunit.client.0.smithi153.stderr: -395> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient(hunting): authenticate will time out at 2894.721617s 2024-09-19T14:11:46.396 INFO:tasks.workunit.client.0.smithi153.stderr: -394> 2024-09-19T14:11:46.259+0000 7efc00648640 10 monclient(hunting): get_auth_request con 0x55d90a49a540 auth_method 0 2024-09-19T14:11:46.396 INFO:tasks.workunit.client.0.smithi153.stderr: -393> 2024-09-19T14:11:46.259+0000 7efc00648640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:46.396 INFO:tasks.workunit.client.0.smithi153.stderr: -392> 2024-09-19T14:11:46.259+0000 7efc00648640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:46.396 INFO:tasks.workunit.client.0.smithi153.stderr: -391> 2024-09-19T14:11:46.259+0000 7efc00648640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:46.396 INFO:tasks.workunit.client.0.smithi153.stderr: -390> 2024-09-19T14:11:46.259+0000 7efbff646640 10 monclient(hunting): get_auth_request con 0x55d90a49bb60 auth_method 0 2024-09-19T14:11:46.396 INFO:tasks.workunit.client.0.smithi153.stderr: -389> 2024-09-19T14:11:46.259+0000 7efbff646640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:46.396 INFO:tasks.workunit.client.0.smithi153.stderr: -388> 2024-09-19T14:11:46.259+0000 7efbff646640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:46.396 INFO:tasks.workunit.client.0.smithi153.stderr: -387> 2024-09-19T14:11:46.259+0000 7efbff646640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:46.396 INFO:tasks.workunit.client.0.smithi153.stderr: -386> 2024-09-19T14:11:46.259+0000 7efc00648640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:46.397 INFO:tasks.workunit.client.0.smithi153.stderr: -385> 2024-09-19T14:11:46.259+0000 7efc00648640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:46.397 INFO:tasks.workunit.client.0.smithi153.stderr: -384> 2024-09-19T14:11:46.259+0000 7efc00648640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:46.397 INFO:tasks.workunit.client.0.smithi153.stderr: -383> 2024-09-19T14:11:46.259+0000 7efbff646640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:46.397 INFO:tasks.workunit.client.0.smithi153.stderr: -382> 2024-09-19T14:11:46.259+0000 7efbff646640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:46.397 INFO:tasks.workunit.client.0.smithi153.stderr: -381> 2024-09-19T14:11:46.259+0000 7efbff646640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:46.397 INFO:tasks.workunit.client.0.smithi153.stderr: -380> 2024-09-19T14:11:46.259+0000 7efbff646640 10 monclient(hunting): handle_auth_done global_id 7550 payload 824 2024-09-19T14:11:46.397 INFO:tasks.workunit.client.0.smithi153.stderr: -379> 2024-09-19T14:11:46.259+0000 7efbff646640 10 monclient: _finish_hunting 0 2024-09-19T14:11:46.397 INFO:tasks.workunit.client.0.smithi153.stderr: -378> 2024-09-19T14:11:46.259+0000 7efbff646640 1 monclient: found mon.noname-c 2024-09-19T14:11:46.397 INFO:tasks.workunit.client.0.smithi153.stderr: -377> 2024-09-19T14:11:46.259+0000 7efbff646640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:11:46.397 INFO:tasks.workunit.client.0.smithi153.stderr: -376> 2024-09-19T14:11:46.259+0000 7efbffe47640 10 monclient: get_auth_request con 0x55d90a49c230 auth_method 0 2024-09-19T14:11:46.397 INFO:tasks.workunit.client.0.smithi153.stderr: -375> 2024-09-19T14:11:46.259+0000 7efae57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:46.397 INFO:tasks.workunit.client.0.smithi153.stderr: -374> 2024-09-19T14:11:46.259+0000 7efae57fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:11:46.397 INFO:tasks.workunit.client.0.smithi153.stderr: -373> 2024-09-19T14:11:46.259+0000 7efae57fa640 10 monclient: dump: 2024-09-19T14:11:46.397 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:46.398 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:46.398 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.398 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.398 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:46.398 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:46.398 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:46.398 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:46.398 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:46.398 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.398 INFO:tasks.workunit.client.0.smithi153.stderr: -372> 2024-09-19T14:11:46.259+0000 7efae57fa640 10 monclient: _finish_auth 0 2024-09-19T14:11:46.398 INFO:tasks.workunit.client.0.smithi153.stderr: -371> 2024-09-19T14:11:46.259+0000 7efae57fa640 10 monclient: _check_auth_tickets 2024-09-19T14:11:46.398 INFO:tasks.workunit.client.0.smithi153.stderr: -370> 2024-09-19T14:11:46.259+0000 7efae57fa640 10 monclient: handle_config config(0 keys) 2024-09-19T14:11:46.398 INFO:tasks.workunit.client.0.smithi153.stderr: -369> 2024-09-19T14:11:46.259+0000 7efae57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:46.398 INFO:tasks.workunit.client.0.smithi153.stderr: -368> 2024-09-19T14:11:46.259+0000 7efae57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:11:46.399 INFO:tasks.workunit.client.0.smithi153.stderr: -367> 2024-09-19T14:11:46.259+0000 7efae57fa640 10 monclient: dump: 2024-09-19T14:11:46.399 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:46.399 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:46.399 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.399 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.399 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:46.399 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:46.399 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:46.399 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:46.399 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:46.399 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.399 INFO:tasks.workunit.client.0.smithi153.stderr: -366> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 monclient: authenticate success, global_id 7550 2024-09-19T14:11:46.399 INFO:tasks.workunit.client.0.smithi153.stderr: -365> 2024-09-19T14:11:46.259+0000 7efc00e49640 4 set_mon_vals no callback set 2024-09-19T14:11:46.399 INFO:tasks.workunit.client.0.smithi153.stderr: -364> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient: _renew_subs 2024-09-19T14:11:46.399 INFO:tasks.workunit.client.0.smithi153.stderr: -363> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:11:46.400 INFO:tasks.workunit.client.0.smithi153.stderr: -362> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient: _renew_subs 2024-09-19T14:11:46.400 INFO:tasks.workunit.client.0.smithi153.stderr: -361> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:11:46.400 INFO:tasks.workunit.client.0.smithi153.stderr: -360> 2024-09-19T14:11:46.263+0000 7efae57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:11:46.400 INFO:tasks.workunit.client.0.smithi153.stderr: -359> 2024-09-19T14:11:46.263+0000 7efae57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:11:46.400 INFO:tasks.workunit.client.0.smithi153.stderr: -358> 2024-09-19T14:11:46.263+0000 7efae57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:11:46.400 INFO:tasks.workunit.client.0.smithi153.stderr: -357> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient: get_monmap_and_config 2024-09-19T14:11:46.400 INFO:tasks.workunit.client.0.smithi153.stderr: -356> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient: build_initial_monmap 2024-09-19T14:11:46.400 INFO:tasks.workunit.client.0.smithi153.stderr: -355> 2024-09-19T14:11:46.263+0000 7efc023419c0 1 build_initial for_mkfs: 0 2024-09-19T14:11:46.400 INFO:tasks.workunit.client.0.smithi153.stderr: -354> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient: monmap: 2024-09-19T14:11:46.400 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:11:46.400 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:11:46.400 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:11:46.400 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:11:46.400 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:11:46.401 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:46.401 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:11:46.401 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:11:46.401 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:11:46.401 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.401 INFO:tasks.workunit.client.0.smithi153.stderr: -353> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding auth protocol: cephx 2024-09-19T14:11:46.401 INFO:tasks.workunit.client.0.smithi153.stderr: -352> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding auth protocol: cephx 2024-09-19T14:11:46.401 INFO:tasks.workunit.client.0.smithi153.stderr: -351> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding auth protocol: cephx 2024-09-19T14:11:46.401 INFO:tasks.workunit.client.0.smithi153.stderr: -350> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding con mode: secure 2024-09-19T14:11:46.401 INFO:tasks.workunit.client.0.smithi153.stderr: -349> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding con mode: crc 2024-09-19T14:11:46.401 INFO:tasks.workunit.client.0.smithi153.stderr: -348> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding con mode: secure 2024-09-19T14:11:46.401 INFO:tasks.workunit.client.0.smithi153.stderr: -347> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding con mode: crc 2024-09-19T14:11:46.401 INFO:tasks.workunit.client.0.smithi153.stderr: -346> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding con mode: secure 2024-09-19T14:11:46.401 INFO:tasks.workunit.client.0.smithi153.stderr: -345> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding con mode: crc 2024-09-19T14:11:46.401 INFO:tasks.workunit.client.0.smithi153.stderr: -344> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding con mode: crc 2024-09-19T14:11:46.402 INFO:tasks.workunit.client.0.smithi153.stderr: -343> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding con mode: secure 2024-09-19T14:11:46.402 INFO:tasks.workunit.client.0.smithi153.stderr: -342> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding con mode: crc 2024-09-19T14:11:46.402 INFO:tasks.workunit.client.0.smithi153.stderr: -341> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding con mode: secure 2024-09-19T14:11:46.402 INFO:tasks.workunit.client.0.smithi153.stderr: -340> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding con mode: crc 2024-09-19T14:11:46.402 INFO:tasks.workunit.client.0.smithi153.stderr: -339> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding con mode: secure 2024-09-19T14:11:46.402 INFO:tasks.workunit.client.0.smithi153.stderr: -338> 2024-09-19T14:11:46.263+0000 7efbffe47640 10 monclient: get_auth_request con 0x7efad8071b20 auth_method 0 2024-09-19T14:11:46.402 INFO:tasks.workunit.client.0.smithi153.stderr: -337> 2024-09-19T14:11:46.263+0000 7efc023419c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:46.402 INFO:tasks.workunit.client.0.smithi153.stderr: -336> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient: init 2024-09-19T14:11:46.402 INFO:tasks.workunit.client.0.smithi153.stderr: -335> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding auth protocol: cephx 2024-09-19T14:11:46.402 INFO:tasks.workunit.client.0.smithi153.stderr: -334> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding auth protocol: cephx 2024-09-19T14:11:46.402 INFO:tasks.workunit.client.0.smithi153.stderr: -333> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding auth protocol: cephx 2024-09-19T14:11:46.402 INFO:tasks.workunit.client.0.smithi153.stderr: -332> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding con mode: secure 2024-09-19T14:11:46.402 INFO:tasks.workunit.client.0.smithi153.stderr: -331> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding con mode: crc 2024-09-19T14:11:46.402 INFO:tasks.workunit.client.0.smithi153.stderr: -330> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding con mode: secure 2024-09-19T14:11:46.402 INFO:tasks.workunit.client.0.smithi153.stderr: -329> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding con mode: crc 2024-09-19T14:11:46.402 INFO:tasks.workunit.client.0.smithi153.stderr: -328> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding con mode: secure 2024-09-19T14:11:46.403 INFO:tasks.workunit.client.0.smithi153.stderr: -327> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding con mode: crc 2024-09-19T14:11:46.403 INFO:tasks.workunit.client.0.smithi153.stderr: -326> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding con mode: crc 2024-09-19T14:11:46.403 INFO:tasks.workunit.client.0.smithi153.stderr: -325> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding con mode: secure 2024-09-19T14:11:46.403 INFO:tasks.workunit.client.0.smithi153.stderr: -324> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding con mode: crc 2024-09-19T14:11:46.403 INFO:tasks.workunit.client.0.smithi153.stderr: -323> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding con mode: secure 2024-09-19T14:11:46.403 INFO:tasks.workunit.client.0.smithi153.stderr: -322> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding con mode: crc 2024-09-19T14:11:46.403 INFO:tasks.workunit.client.0.smithi153.stderr: -321> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding con mode: secure 2024-09-19T14:11:46.403 INFO:tasks.workunit.client.0.smithi153.stderr: -320> 2024-09-19T14:11:46.263+0000 7efc023419c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:46.403 INFO:tasks.workunit.client.0.smithi153.stderr: -319> 2024-09-19T14:11:46.263+0000 7efc023419c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:46.403 INFO:tasks.workunit.client.0.smithi153.stderr: -318> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command rotate-key cmddesc rotate-key hook 0x7ffcbeeb0e68 EEXIST 2024-09-19T14:11:46.403 INFO:tasks.workunit.client.0.smithi153.stderr: -317> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient: _reopen_session rank -1 2024-09-19T14:11:46.403 INFO:tasks.workunit.client.0.smithi153.stderr: -316> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T14:11:46.404 INFO:tasks.workunit.client.0.smithi153.stderr: -315> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient(hunting): picked mon.noname-a con 0x55d90a4bfda0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:11:46.404 INFO:tasks.workunit.client.0.smithi153.stderr: -314> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient(hunting): picked mon.noname-b con 0x55d90a4eb720 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:11:46.404 INFO:tasks.workunit.client.0.smithi153.stderr: -313> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient(hunting): picked mon.noname-c con 0x55d90a4e1cc0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:11:46.404 INFO:tasks.workunit.client.0.smithi153.stderr: -312> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:46.404 INFO:tasks.workunit.client.0.smithi153.stderr: -311> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:46.404 INFO:tasks.workunit.client.0.smithi153.stderr: -310> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:46.404 INFO:tasks.workunit.client.0.smithi153.stderr: -309> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient(hunting): _renew_subs 2024-09-19T14:11:46.404 INFO:tasks.workunit.client.0.smithi153.stderr: -308> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient(hunting): authenticate will time out at 2894.726456s 2024-09-19T14:11:46.404 INFO:tasks.workunit.client.0.smithi153.stderr: -307> 2024-09-19T14:11:46.263+0000 7efbffe47640 10 monclient(hunting): get_auth_request con 0x55d90a4bfda0 auth_method 0 2024-09-19T14:11:46.404 INFO:tasks.workunit.client.0.smithi153.stderr: -306> 2024-09-19T14:11:46.263+0000 7efbffe47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:46.404 INFO:tasks.workunit.client.0.smithi153.stderr: -305> 2024-09-19T14:11:46.263+0000 7efbffe47640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:46.404 INFO:tasks.workunit.client.0.smithi153.stderr: -304> 2024-09-19T14:11:46.263+0000 7efbffe47640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:46.404 INFO:tasks.workunit.client.0.smithi153.stderr: -303> 2024-09-19T14:11:46.263+0000 7efc00648640 10 monclient(hunting): get_auth_request con 0x55d90a4e1cc0 auth_method 0 2024-09-19T14:11:46.405 INFO:tasks.workunit.client.0.smithi153.stderr: -302> 2024-09-19T14:11:46.263+0000 7efc00648640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:46.405 INFO:tasks.workunit.client.0.smithi153.stderr: -301> 2024-09-19T14:11:46.263+0000 7efc00648640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:46.405 INFO:tasks.workunit.client.0.smithi153.stderr: -300> 2024-09-19T14:11:46.263+0000 7efc00648640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:46.405 INFO:tasks.workunit.client.0.smithi153.stderr: -299> 2024-09-19T14:11:46.263+0000 7efbffe47640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:46.405 INFO:tasks.workunit.client.0.smithi153.stderr: -298> 2024-09-19T14:11:46.263+0000 7efbffe47640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:46.405 INFO:tasks.workunit.client.0.smithi153.stderr: -297> 2024-09-19T14:11:46.263+0000 7efbffe47640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:46.405 INFO:tasks.workunit.client.0.smithi153.stderr: -296> 2024-09-19T14:11:46.263+0000 7efc00648640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:46.405 INFO:tasks.workunit.client.0.smithi153.stderr: -295> 2024-09-19T14:11:46.263+0000 7efc00648640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:46.405 INFO:tasks.workunit.client.0.smithi153.stderr: -294> 2024-09-19T14:11:46.263+0000 7efc00648640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:46.405 INFO:tasks.workunit.client.0.smithi153.stderr: -293> 2024-09-19T14:11:46.263+0000 7efbff646640 10 monclient(hunting): get_auth_request con 0x55d90a4eb720 auth_method 0 2024-09-19T14:11:46.405 INFO:tasks.workunit.client.0.smithi153.stderr: -292> 2024-09-19T14:11:46.263+0000 7efbff646640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:46.405 INFO:tasks.workunit.client.0.smithi153.stderr: -291> 2024-09-19T14:11:46.263+0000 7efbff646640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:46.405 INFO:tasks.workunit.client.0.smithi153.stderr: -290> 2024-09-19T14:11:46.263+0000 7efbff646640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:46.406 INFO:tasks.workunit.client.0.smithi153.stderr: -289> 2024-09-19T14:11:46.263+0000 7efbffe47640 10 monclient(hunting): handle_auth_done global_id 8076 payload 274 2024-09-19T14:11:46.406 INFO:tasks.workunit.client.0.smithi153.stderr: -288> 2024-09-19T14:11:46.263+0000 7efbffe47640 10 monclient: _finish_hunting 0 2024-09-19T14:11:46.406 INFO:tasks.workunit.client.0.smithi153.stderr: -287> 2024-09-19T14:11:46.263+0000 7efbffe47640 1 monclient: found mon.noname-a 2024-09-19T14:11:46.406 INFO:tasks.workunit.client.0.smithi153.stderr: -286> 2024-09-19T14:11:46.263+0000 7efbffe47640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:11:46.406 INFO:tasks.workunit.client.0.smithi153.stderr: -285> 2024-09-19T14:11:46.263+0000 7efadeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:46.406 INFO:tasks.workunit.client.0.smithi153.stderr: -284> 2024-09-19T14:11:46.263+0000 7efadeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:11:46.406 INFO:tasks.workunit.client.0.smithi153.stderr: -283> 2024-09-19T14:11:46.263+0000 7efadeffd640 10 monclient: dump: 2024-09-19T14:11:46.406 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:46.406 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:46.406 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.406 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.406 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:46.406 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:46.406 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:46.407 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:46.407 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:46.407 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.407 INFO:tasks.workunit.client.0.smithi153.stderr: -282> 2024-09-19T14:11:46.263+0000 7efadeffd640 10 monclient: _finish_auth 0 2024-09-19T14:11:46.407 INFO:tasks.workunit.client.0.smithi153.stderr: -281> 2024-09-19T14:11:46.263+0000 7efadeffd640 10 monclient: _check_auth_tickets 2024-09-19T14:11:46.407 INFO:tasks.workunit.client.0.smithi153.stderr: -280> 2024-09-19T14:11:46.263+0000 7efadeffd640 10 monclient: handle_config config(0 keys) 2024-09-19T14:11:46.407 INFO:tasks.workunit.client.0.smithi153.stderr: -279> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 monclient: authenticate success, global_id 8076 2024-09-19T14:11:46.407 INFO:tasks.workunit.client.0.smithi153.stderr: -278> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient: get_monmap_and_config success 2024-09-19T14:11:46.407 INFO:tasks.workunit.client.0.smithi153.stderr: -277> 2024-09-19T14:11:46.263+0000 7efc023419c0 4 set_mon_vals no callback set 2024-09-19T14:11:46.407 INFO:tasks.workunit.client.0.smithi153.stderr: -276> 2024-09-19T14:11:46.263+0000 7efadeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:46.407 INFO:tasks.workunit.client.0.smithi153.stderr: -275> 2024-09-19T14:11:46.263+0000 7efadeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:11:46.407 INFO:tasks.workunit.client.0.smithi153.stderr: -274> 2024-09-19T14:11:46.263+0000 7efadeffd640 10 monclient: dump: 2024-09-19T14:11:46.407 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:46.407 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:46.407 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.408 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.408 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:46.408 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:46.408 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:46.408 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:46.408 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:46.408 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.408 INFO:tasks.workunit.client.0.smithi153.stderr: -273> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient: shutdown 2024-09-19T14:11:46.408 INFO:tasks.workunit.client.0.smithi153.stderr: -272> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient: build_initial_monmap 2024-09-19T14:11:46.408 INFO:tasks.workunit.client.0.smithi153.stderr: -271> 2024-09-19T14:11:46.267+0000 7efc023419c0 1 build_initial for_mkfs: 0 2024-09-19T14:11:46.408 INFO:tasks.workunit.client.0.smithi153.stderr: -270> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient: monmap: 2024-09-19T14:11:46.408 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:11:46.408 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:11:46.408 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:11:46.409 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:11:46.409 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:11:46.409 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:46.409 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:11:46.409 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:11:46.409 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:11:46.409 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.409 INFO:tasks.workunit.client.0.smithi153.stderr: -269> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding auth protocol: cephx 2024-09-19T14:11:46.409 INFO:tasks.workunit.client.0.smithi153.stderr: -268> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding auth protocol: cephx 2024-09-19T14:11:46.409 INFO:tasks.workunit.client.0.smithi153.stderr: -267> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding auth protocol: cephx 2024-09-19T14:11:46.409 INFO:tasks.workunit.client.0.smithi153.stderr: -266> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding con mode: secure 2024-09-19T14:11:46.409 INFO:tasks.workunit.client.0.smithi153.stderr: -265> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding con mode: crc 2024-09-19T14:11:46.409 INFO:tasks.workunit.client.0.smithi153.stderr: -264> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding con mode: secure 2024-09-19T14:11:46.409 INFO:tasks.workunit.client.0.smithi153.stderr: -263> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding con mode: crc 2024-09-19T14:11:46.410 INFO:tasks.workunit.client.0.smithi153.stderr: -262> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding con mode: secure 2024-09-19T14:11:46.410 INFO:tasks.workunit.client.0.smithi153.stderr: -261> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding con mode: crc 2024-09-19T14:11:46.410 INFO:tasks.workunit.client.0.smithi153.stderr: -260> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding con mode: crc 2024-09-19T14:11:46.410 INFO:tasks.workunit.client.0.smithi153.stderr: -259> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding con mode: secure 2024-09-19T14:11:46.410 INFO:tasks.workunit.client.0.smithi153.stderr: -258> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding con mode: crc 2024-09-19T14:11:46.410 INFO:tasks.workunit.client.0.smithi153.stderr: -257> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding con mode: secure 2024-09-19T14:11:46.410 INFO:tasks.workunit.client.0.smithi153.stderr: -256> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding con mode: crc 2024-09-19T14:11:46.411 INFO:tasks.workunit.client.0.smithi153.stderr: -255> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding con mode: secure 2024-09-19T14:11:46.411 INFO:tasks.workunit.client.0.smithi153.stderr: -254> 2024-09-19T14:11:46.267+0000 7efc023419c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:46.412 INFO:tasks.workunit.client.0.smithi153.stderr: -253> 2024-09-19T14:11:46.267+0000 7efc023419c0 1 librados: starting msgr at 2024-09-19T14:11:46.412 INFO:tasks.workunit.client.0.smithi153.stderr: -252> 2024-09-19T14:11:46.267+0000 7efc023419c0 1 librados: starting objecter 2024-09-19T14:11:46.412 INFO:tasks.workunit.client.0.smithi153.stderr: -251> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command objecter_requests cmddesc objecter_requests hook 0x55d90a4eb390 EEXIST 2024-09-19T14:11:46.412 INFO:tasks.workunit.client.0.smithi153.stderr: -250> 2024-09-19T14:11:46.267+0000 7efc023419c0 1 librados: setting wanted keys 2024-09-19T14:11:46.412 INFO:tasks.workunit.client.0.smithi153.stderr: -249> 2024-09-19T14:11:46.267+0000 7efc023419c0 1 librados: calling monclient init 2024-09-19T14:11:46.412 INFO:tasks.workunit.client.0.smithi153.stderr: -248> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient: init 2024-09-19T14:11:46.412 INFO:tasks.workunit.client.0.smithi153.stderr: -247> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding auth protocol: cephx 2024-09-19T14:11:46.412 INFO:tasks.workunit.client.0.smithi153.stderr: -246> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding auth protocol: cephx 2024-09-19T14:11:46.412 INFO:tasks.workunit.client.0.smithi153.stderr: -245> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding auth protocol: cephx 2024-09-19T14:11:46.412 INFO:tasks.workunit.client.0.smithi153.stderr: -244> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding con mode: secure 2024-09-19T14:11:46.412 INFO:tasks.workunit.client.0.smithi153.stderr: -243> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding con mode: crc 2024-09-19T14:11:46.412 INFO:tasks.workunit.client.0.smithi153.stderr: -242> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding con mode: secure 2024-09-19T14:11:46.412 INFO:tasks.workunit.client.0.smithi153.stderr: -241> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding con mode: crc 2024-09-19T14:11:46.413 INFO:tasks.workunit.client.0.smithi153.stderr: -240> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding con mode: secure 2024-09-19T14:11:46.413 INFO:tasks.workunit.client.0.smithi153.stderr: -239> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding con mode: crc 2024-09-19T14:11:46.413 INFO:tasks.workunit.client.0.smithi153.stderr: -238> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding con mode: crc 2024-09-19T14:11:46.413 INFO:tasks.workunit.client.0.smithi153.stderr: -237> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding con mode: secure 2024-09-19T14:11:46.413 INFO:tasks.workunit.client.0.smithi153.stderr: -236> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding con mode: crc 2024-09-19T14:11:46.413 INFO:tasks.workunit.client.0.smithi153.stderr: -235> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding con mode: secure 2024-09-19T14:11:46.413 INFO:tasks.workunit.client.0.smithi153.stderr: -234> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding con mode: crc 2024-09-19T14:11:46.413 INFO:tasks.workunit.client.0.smithi153.stderr: -233> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding con mode: secure 2024-09-19T14:11:46.413 INFO:tasks.workunit.client.0.smithi153.stderr: -232> 2024-09-19T14:11:46.267+0000 7efc023419c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:46.413 INFO:tasks.workunit.client.0.smithi153.stderr: -231> 2024-09-19T14:11:46.267+0000 7efc023419c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:46.413 INFO:tasks.workunit.client.0.smithi153.stderr: -230> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command rotate-key cmddesc rotate-key hook 0x55d90a49e198 EEXIST 2024-09-19T14:11:46.413 INFO:tasks.workunit.client.0.smithi153.stderr: -229> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient: _reopen_session rank -1 2024-09-19T14:11:46.413 INFO:tasks.workunit.client.0.smithi153.stderr: -228> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T14:11:46.413 INFO:tasks.workunit.client.0.smithi153.stderr: -227> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient(hunting): picked mon.noname-b con 0x55d90a4bfda0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:11:46.414 INFO:tasks.workunit.client.0.smithi153.stderr: -226> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient(hunting): picked mon.noname-c con 0x55d90a4e1cc0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:11:46.414 INFO:tasks.workunit.client.0.smithi153.stderr: -225> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient(hunting): picked mon.noname-a con 0x55d90a4eb720 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:11:46.414 INFO:tasks.workunit.client.0.smithi153.stderr: -224> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:46.414 INFO:tasks.workunit.client.0.smithi153.stderr: -223> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:46.414 INFO:tasks.workunit.client.0.smithi153.stderr: -222> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:46.414 INFO:tasks.workunit.client.0.smithi153.stderr: -221> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient(hunting): _renew_subs 2024-09-19T14:11:46.414 INFO:tasks.workunit.client.0.smithi153.stderr: -220> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient(hunting): authenticate will time out at 2894.729277s 2024-09-19T14:11:46.414 INFO:tasks.workunit.client.0.smithi153.stderr: -219> 2024-09-19T14:11:46.267+0000 7efbff646640 10 monclient(hunting): get_auth_request con 0x55d90a4e1cc0 auth_method 0 2024-09-19T14:11:46.414 INFO:tasks.workunit.client.0.smithi153.stderr: -218> 2024-09-19T14:11:46.267+0000 7efbff646640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:46.414 INFO:tasks.workunit.client.0.smithi153.stderr: -217> 2024-09-19T14:11:46.267+0000 7efbff646640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:46.414 INFO:tasks.workunit.client.0.smithi153.stderr: -216> 2024-09-19T14:11:46.267+0000 7efbff646640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:46.414 INFO:tasks.workunit.client.0.smithi153.stderr: -215> 2024-09-19T14:11:46.267+0000 7efc00648640 10 monclient(hunting): get_auth_request con 0x55d90a4eb720 auth_method 0 2024-09-19T14:11:46.414 INFO:tasks.workunit.client.0.smithi153.stderr: -214> 2024-09-19T14:11:46.267+0000 7efc00648640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:46.415 INFO:tasks.workunit.client.0.smithi153.stderr: -213> 2024-09-19T14:11:46.267+0000 7efc00648640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:46.415 INFO:tasks.workunit.client.0.smithi153.stderr: -212> 2024-09-19T14:11:46.267+0000 7efc00648640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:46.415 INFO:tasks.workunit.client.0.smithi153.stderr: -211> 2024-09-19T14:11:46.267+0000 7efbff646640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:46.415 INFO:tasks.workunit.client.0.smithi153.stderr: -210> 2024-09-19T14:11:46.267+0000 7efbff646640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:46.415 INFO:tasks.workunit.client.0.smithi153.stderr: -209> 2024-09-19T14:11:46.267+0000 7efbff646640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:46.415 INFO:tasks.workunit.client.0.smithi153.stderr: -208> 2024-09-19T14:11:46.267+0000 7efc00648640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:46.415 INFO:tasks.workunit.client.0.smithi153.stderr: -207> 2024-09-19T14:11:46.267+0000 7efc00648640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:46.415 INFO:tasks.workunit.client.0.smithi153.stderr: -206> 2024-09-19T14:11:46.267+0000 7efc00648640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:46.415 INFO:tasks.workunit.client.0.smithi153.stderr: -205> 2024-09-19T14:11:46.267+0000 7efbffe47640 10 monclient(hunting): get_auth_request con 0x55d90a4bfda0 auth_method 0 2024-09-19T14:11:46.415 INFO:tasks.workunit.client.0.smithi153.stderr: -204> 2024-09-19T14:11:46.267+0000 7efbffe47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:46.415 INFO:tasks.workunit.client.0.smithi153.stderr: -203> 2024-09-19T14:11:46.267+0000 7efbffe47640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:46.415 INFO:tasks.workunit.client.0.smithi153.stderr: -202> 2024-09-19T14:11:46.267+0000 7efbffe47640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:46.415 INFO:tasks.workunit.client.0.smithi153.stderr: -201> 2024-09-19T14:11:46.267+0000 7efbff646640 10 monclient(hunting): handle_auth_done global_id 7556 payload 824 2024-09-19T14:11:46.415 INFO:tasks.workunit.client.0.smithi153.stderr: -200> 2024-09-19T14:11:46.267+0000 7efbff646640 10 monclient: _finish_hunting 0 2024-09-19T14:11:46.415 INFO:tasks.workunit.client.0.smithi153.stderr: -199> 2024-09-19T14:11:46.267+0000 7efbff646640 1 monclient: found mon.noname-c 2024-09-19T14:11:46.416 INFO:tasks.workunit.client.0.smithi153.stderr: -198> 2024-09-19T14:11:46.267+0000 7efbff646640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:11:46.416 INFO:tasks.workunit.client.0.smithi153.stderr: -197> 2024-09-19T14:11:46.267+0000 7efadd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:46.416 INFO:tasks.workunit.client.0.smithi153.stderr: -196> 2024-09-19T14:11:46.267+0000 7efadd7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:11:46.416 INFO:tasks.workunit.client.0.smithi153.stderr: -195> 2024-09-19T14:11:46.267+0000 7efadd7fa640 10 monclient: dump: 2024-09-19T14:11:46.416 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:46.416 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:46.416 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.416 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.416 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:46.416 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:46.416 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:46.416 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:46.416 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:46.416 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.417 INFO:tasks.workunit.client.0.smithi153.stderr: -194> 2024-09-19T14:11:46.267+0000 7efadd7fa640 10 monclient: _finish_auth 0 2024-09-19T14:11:46.417 INFO:tasks.workunit.client.0.smithi153.stderr: -193> 2024-09-19T14:11:46.267+0000 7efadd7fa640 10 monclient: _check_auth_tickets 2024-09-19T14:11:46.417 INFO:tasks.workunit.client.0.smithi153.stderr: -192> 2024-09-19T14:11:46.267+0000 7efadd7fa640 10 monclient: handle_config config(0 keys) 2024-09-19T14:11:46.417 INFO:tasks.workunit.client.0.smithi153.stderr: -191> 2024-09-19T14:11:46.267+0000 7efadd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:46.417 INFO:tasks.workunit.client.0.smithi153.stderr: -190> 2024-09-19T14:11:46.267+0000 7efadd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:11:46.417 INFO:tasks.workunit.client.0.smithi153.stderr: -189> 2024-09-19T14:11:46.267+0000 7efadd7fa640 10 monclient: dump: 2024-09-19T14:11:46.417 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:46.417 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:46.417 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.417 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.417 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:46.417 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:46.417 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:46.417 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:46.418 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:46.418 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.418 INFO:tasks.workunit.client.0.smithi153.stderr: -188> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 monclient: authenticate success, global_id 7556 2024-09-19T14:11:46.418 INFO:tasks.workunit.client.0.smithi153.stderr: -187> 2024-09-19T14:11:46.267+0000 7efadeffd640 4 set_mon_vals no callback set 2024-09-19T14:11:46.418 INFO:tasks.workunit.client.0.smithi153.stderr: -186> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient: _renew_subs 2024-09-19T14:11:46.418 INFO:tasks.workunit.client.0.smithi153.stderr: -185> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:11:46.418 INFO:tasks.workunit.client.0.smithi153.stderr: -184> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient: _renew_subs 2024-09-19T14:11:46.418 INFO:tasks.workunit.client.0.smithi153.stderr: -183> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:11:46.418 INFO:tasks.workunit.client.0.smithi153.stderr: -182> 2024-09-19T14:11:46.267+0000 7efc023419c0 1 librados: init done 2024-09-19T14:11:46.418 INFO:tasks.workunit.client.0.smithi153.stderr: -181> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command cr dump hook 0x55d90a4e6cc8 2024-09-19T14:11:46.418 INFO:tasks.workunit.client.0.smithi153.stderr: -180> 2024-09-19T14:11:46.271+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.418 INFO:tasks.workunit.client.0.smithi153.stderr: -179> 2024-09-19T14:11:46.271+0000 7efadd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:11:46.418 INFO:tasks.workunit.client.0.smithi153.stderr: -178> 2024-09-19T14:11:46.271+0000 7efadd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:11:46.418 INFO:tasks.workunit.client.0.smithi153.stderr: -177> 2024-09-19T14:11:46.271+0000 7efadd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:11:46.418 INFO:tasks.workunit.client.0.smithi153.stderr: -176> 2024-09-19T14:11:46.271+0000 7efc00648640 10 monclient: get_auth_request con 0x55d90a50a5b0 auth_method 0 2024-09-19T14:11:46.419 INFO:tasks.workunit.client.0.smithi153.stderr: -175> 2024-09-19T14:11:46.271+0000 7efbffe47640 10 monclient: get_auth_request con 0x7efac8071be0 auth_method 0 2024-09-19T14:11:46.419 INFO:tasks.workunit.client.0.smithi153.stderr: -174> 2024-09-19T14:11:46.271+0000 7efc023419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.419 INFO:tasks.workunit.client.0.smithi153.stderr: -173> 2024-09-19T14:11:46.271+0000 7efc023419c0 20 realm 2024-09-19T14:11:46.419 INFO:tasks.workunit.client.0.smithi153.stderr: -172> 2024-09-19T14:11:46.271+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.419 INFO:tasks.workunit.client.0.smithi153.stderr: -171> 2024-09-19T14:11:46.271+0000 7efc023419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.419 INFO:tasks.workunit.client.0.smithi153.stderr: -170> 2024-09-19T14:11:46.271+0000 7efc023419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:11:46.419 INFO:tasks.workunit.client.0.smithi153.stderr: -169> 2024-09-19T14:11:46.271+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.419 INFO:tasks.workunit.client.0.smithi153.stderr: -168> 2024-09-19T14:11:46.271+0000 7efc023419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.419 INFO:tasks.workunit.client.0.smithi153.stderr: -167> 2024-09-19T14:11:46.271+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.419 INFO:tasks.workunit.client.0.smithi153.stderr: -166> 2024-09-19T14:11:46.271+0000 7efbffe47640 10 monclient: get_auth_request con 0x55d90a50e7e0 auth_method 0 2024-09-19T14:11:46.419 INFO:tasks.workunit.client.0.smithi153.stderr: -165> 2024-09-19T14:11:46.275+0000 7efc023419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:46.419 INFO:tasks.workunit.client.0.smithi153.stderr: -164> 2024-09-19T14:11:46.275+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.419 INFO:tasks.workunit.client.0.smithi153.stderr: -163> 2024-09-19T14:11:46.275+0000 7efc023419c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:11:46.419 INFO:tasks.workunit.client.0.smithi153.stderr: -162> 2024-09-19T14:11:46.275+0000 7efc023419c0 20 searching for the correct realm 2024-09-19T14:11:46.419 INFO:tasks.workunit.client.0.smithi153.stderr: -161> 2024-09-19T14:11:46.275+0000 7efbff646640 10 monclient: get_auth_request con 0x55d90a513a70 auth_method 0 2024-09-19T14:11:46.420 INFO:tasks.workunit.client.0.smithi153.stderr: -160> 2024-09-19T14:11:46.275+0000 7efc00648640 10 monclient: get_auth_request con 0x7efbf401e040 auth_method 0 2024-09-19T14:11:46.420 INFO:tasks.workunit.client.0.smithi153.stderr: -159> 2024-09-19T14:11:46.275+0000 7efbffe47640 10 monclient: get_auth_request con 0x7efbf80b0070 auth_method 0 2024-09-19T14:11:46.420 INFO:tasks.workunit.client.0.smithi153.stderr: -158> 2024-09-19T14:11:46.279+0000 7efbff646640 10 monclient: get_auth_request con 0x7efbf004a040 auth_method 0 2024-09-19T14:11:46.420 INFO:tasks.workunit.client.0.smithi153.stderr: -157> 2024-09-19T14:11:46.279+0000 7efc00648640 0 -- 172.21.15.153:0/387941972 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55d90a50a5b0 msgr2=0x55d90a50ca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:46.420 INFO:tasks.workunit.client.0.smithi153.stderr: -156> 2024-09-19T14:11:46.279+0000 7efadd7fa640 1 client.7556.objecter ms_handle_reset 0x55d90a50a5b0 session 0x55d90a509f30 osd.1 2024-09-19T14:11:46.420 INFO:tasks.workunit.client.0.smithi153.stderr: -155> 2024-09-19T14:11:46.279+0000 7efadd7fa640 10 monclient: _renew_subs 2024-09-19T14:11:46.420 INFO:tasks.workunit.client.0.smithi153.stderr: -154> 2024-09-19T14:11:46.279+0000 7efadd7fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:11:46.420 INFO:tasks.workunit.client.0.smithi153.stderr: -153> 2024-09-19T14:11:46.279+0000 7efc00648640 10 monclient: get_auth_request con 0x7efac8082310 auth_method 0 2024-09-19T14:11:46.420 INFO:tasks.workunit.client.0.smithi153.stderr: -152> 2024-09-19T14:11:46.279+0000 7efc00648640 10 monclient: get_auth_request con 0x7efbf4050190 auth_method 0 2024-09-19T14:11:46.420 INFO:tasks.workunit.client.0.smithi153.stderr: -151> 2024-09-19T14:11:46.287+0000 7efbffe47640 10 monclient: get_auth_request con 0x7efbf40714b0 auth_method 0 2024-09-19T14:11:46.420 INFO:tasks.workunit.client.0.smithi153.stderr: -150> 2024-09-19T14:11:46.287+0000 7efbffe47640 0 -- 172.21.15.153:0/387941972 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7efbf40714b0 msgr2=0x7efbf40658e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:46.420 INFO:tasks.workunit.client.0.smithi153.stderr: -149> 2024-09-19T14:11:46.287+0000 7efadd7fa640 1 client.7556.objecter ms_handle_reset 0x7efbf40714b0 session 0x7efbf407ce90 osd.0 2024-09-19T14:11:46.420 INFO:tasks.workunit.client.0.smithi153.stderr: -148> 2024-09-19T14:11:46.287+0000 7efbffe47640 10 monclient: get_auth_request con 0x55d90a50a5b0 auth_method 0 2024-09-19T14:11:46.420 INFO:tasks.workunit.client.0.smithi153.stderr: -147> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:11:46.421 INFO:tasks.workunit.client.0.smithi153.stderr: -146> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:11:46.421 INFO:tasks.workunit.client.0.smithi153.stderr: -145> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:11:46.421 INFO:tasks.workunit.client.0.smithi153.stderr: -144> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:11:46.421 INFO:tasks.workunit.client.0.smithi153.stderr: -143> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:11:46.421 INFO:tasks.workunit.client.0.smithi153.stderr: -142> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:11:46.421 INFO:tasks.workunit.client.0.smithi153.stderr: -141> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.421 INFO:tasks.workunit.client.0.smithi153.stderr: -140> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.421 INFO:tasks.workunit.client.0.smithi153.stderr: -139> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.421 INFO:tasks.workunit.client.0.smithi153.stderr: -138> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:46.421 INFO:tasks.workunit.client.0.smithi153.stderr: -137> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.421 INFO:tasks.workunit.client.0.smithi153.stderr: -136> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:11:46.421 INFO:tasks.workunit.client.0.smithi153.stderr: -135> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 zone default found 2024-09-19T14:11:46.421 INFO:tasks.workunit.client.0.smithi153.stderr: -134> 2024-09-19T14:11:46.295+0000 7efc023419c0 4 Realm: () 2024-09-19T14:11:46.421 INFO:tasks.workunit.client.0.smithi153.stderr: -133> 2024-09-19T14:11:46.295+0000 7efc023419c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:11:46.421 INFO:tasks.workunit.client.0.smithi153.stderr: -132> 2024-09-19T14:11:46.295+0000 7efc023419c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:11:46.422 INFO:tasks.workunit.client.0.smithi153.stderr: -131> 2024-09-19T14:11:46.295+0000 7efc023419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:11:46.422 INFO:tasks.workunit.client.0.smithi153.stderr: -130> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 zonegroup default 2024-09-19T14:11:46.422 INFO:tasks.workunit.client.0.smithi153.stderr: -129> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.422 INFO:tasks.workunit.client.0.smithi153.stderr: -128> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.422 INFO:tasks.workunit.client.0.smithi153.stderr: -127> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.422 INFO:tasks.workunit.client.0.smithi153.stderr: -126> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.422 INFO:tasks.workunit.client.0.smithi153.stderr: -125> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.422 INFO:tasks.workunit.client.0.smithi153.stderr: -124> 2024-09-19T14:11:46.299+0000 7efc023419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.422 INFO:tasks.workunit.client.0.smithi153.stderr: -123> 2024-09-19T14:11:46.299+0000 7efc023419c0 20 started sync module instance, tier type = 2024-09-19T14:11:46.422 INFO:tasks.workunit.client.0.smithi153.stderr: -122> 2024-09-19T14:11:46.299+0000 7efc023419c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:11:46.422 INFO:tasks.workunit.client.0.smithi153.stderr: -121> 2024-09-19T14:11:46.315+0000 7efc023419c0 20 add_watcher() i=0 2024-09-19T14:11:46.422 INFO:tasks.workunit.client.0.smithi153.stderr: -120> 2024-09-19T14:11:46.315+0000 7efc023419c0 20 add_watcher() i=1 2024-09-19T14:11:46.422 INFO:tasks.workunit.client.0.smithi153.stderr: -119> 2024-09-19T14:11:46.315+0000 7efc023419c0 20 add_watcher() i=2 2024-09-19T14:11:46.422 INFO:tasks.workunit.client.0.smithi153.stderr: -118> 2024-09-19T14:11:46.315+0000 7efc023419c0 20 add_watcher() i=3 2024-09-19T14:11:46.422 INFO:tasks.workunit.client.0.smithi153.stderr: -117> 2024-09-19T14:11:46.315+0000 7efc023419c0 20 add_watcher() i=4 2024-09-19T14:11:46.423 INFO:tasks.workunit.client.0.smithi153.stderr: -116> 2024-09-19T14:11:46.315+0000 7efc023419c0 20 add_watcher() i=5 2024-09-19T14:11:46.423 INFO:tasks.workunit.client.0.smithi153.stderr: -115> 2024-09-19T14:11:46.315+0000 7efc023419c0 20 add_watcher() i=6 2024-09-19T14:11:46.423 INFO:tasks.workunit.client.0.smithi153.stderr: -114> 2024-09-19T14:11:46.315+0000 7efc023419c0 20 add_watcher() i=7 2024-09-19T14:11:46.423 INFO:tasks.workunit.client.0.smithi153.stderr: -113> 2024-09-19T14:11:46.315+0000 7efc023419c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:11:46.423 INFO:tasks.workunit.client.0.smithi153.stderr: -112> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding auth protocol: cephx 2024-09-19T14:11:46.423 INFO:tasks.workunit.client.0.smithi153.stderr: -111> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding auth protocol: cephx 2024-09-19T14:11:46.423 INFO:tasks.workunit.client.0.smithi153.stderr: -110> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding auth protocol: cephx 2024-09-19T14:11:46.423 INFO:tasks.workunit.client.0.smithi153.stderr: -109> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding con mode: secure 2024-09-19T14:11:46.423 INFO:tasks.workunit.client.0.smithi153.stderr: -108> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding con mode: crc 2024-09-19T14:11:46.423 INFO:tasks.workunit.client.0.smithi153.stderr: -107> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding con mode: secure 2024-09-19T14:11:46.423 INFO:tasks.workunit.client.0.smithi153.stderr: -106> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding con mode: crc 2024-09-19T14:11:46.423 INFO:tasks.workunit.client.0.smithi153.stderr: -105> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding con mode: secure 2024-09-19T14:11:46.423 INFO:tasks.workunit.client.0.smithi153.stderr: -104> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding con mode: crc 2024-09-19T14:11:46.423 INFO:tasks.workunit.client.0.smithi153.stderr: -103> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding con mode: crc 2024-09-19T14:11:46.423 INFO:tasks.workunit.client.0.smithi153.stderr: -102> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding con mode: secure 2024-09-19T14:11:46.423 INFO:tasks.workunit.client.0.smithi153.stderr: -101> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding con mode: crc 2024-09-19T14:11:46.424 INFO:tasks.workunit.client.0.smithi153.stderr: -100> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding con mode: secure 2024-09-19T14:11:46.424 INFO:tasks.workunit.client.0.smithi153.stderr: -99> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding con mode: crc 2024-09-19T14:11:46.424 INFO:tasks.workunit.client.0.smithi153.stderr: -98> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding con mode: secure 2024-09-19T14:11:46.424 INFO:tasks.workunit.client.0.smithi153.stderr: -97> 2024-09-19T14:11:46.319+0000 7efab5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:46.424 INFO:tasks.workunit.client.0.smithi153.stderr: -96> 2024-09-19T14:11:46.319+0000 7efc023419c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:46.424 INFO:tasks.workunit.client.0.smithi153.stderr: -95> 2024-09-19T14:11:46.319+0000 7efc023419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:11:46.424 INFO:tasks.workunit.client.0.smithi153.stderr: -94> 2024-09-19T14:11:46.319+0000 7efc023419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:11:46.424 INFO:tasks.workunit.client.0.smithi153.stderr: -93> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command cache list hook 0x55d90a4e6ef0 2024-09-19T14:11:46.424 INFO:tasks.workunit.client.0.smithi153.stderr: -92> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command cache inspect hook 0x55d90a4e6ef0 2024-09-19T14:11:46.424 INFO:tasks.workunit.client.0.smithi153.stderr: -91> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command cache erase hook 0x55d90a4e6ef0 2024-09-19T14:11:46.424 INFO:tasks.workunit.client.0.smithi153.stderr: -90> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command cache zap hook 0x55d90a4e6ef0 2024-09-19T14:11:46.424 INFO:tasks.workunit.client.0.smithi153.stderr: -89> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 note: GC not initialized 2024-09-19T14:11:46.424 INFO:tasks.workunit.client.0.smithi153.stderr: -88> 2024-09-19T14:11:46.319+0000 7efab4fe1640 20 reqs_thread_entry: start 2024-09-19T14:11:46.424 INFO:tasks.workunit.client.0.smithi153.stderr: -87> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command sync trace show hook 0x7efbf8004910 2024-09-19T14:11:46.425 INFO:tasks.workunit.client.0.smithi153.stderr: -86> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command sync trace history hook 0x7efbf8004910 2024-09-19T14:11:46.425 INFO:tasks.workunit.client.0.smithi153.stderr: -85> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command sync trace active hook 0x7efbf8004910 2024-09-19T14:11:46.425 INFO:tasks.workunit.client.0.smithi153.stderr: -84> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command sync trace active_short hook 0x7efbf8004910 2024-09-19T14:11:46.425 INFO:tasks.workunit.client.0.smithi153.stderr: -83> 2024-09-19T14:11:46.319+0000 7efc023419c0 20 init_complete bucket index max shards: 11 2024-09-19T14:11:46.425 INFO:tasks.workunit.client.0.smithi153.stderr: -82> 2024-09-19T14:11:46.319+0000 7efc023419c0 20 Filter name: none 2024-09-19T14:11:46.425 INFO:tasks.workunit.client.0.smithi153.stderr: -81> 2024-09-19T14:11:46.319+0000 7efa2e7fc640 20 reqs_thread_entry: start 2024-09-19T14:11:46.425 INFO:tasks.workunit.client.0.smithi153.stderr: -80> 2024-09-19T14:11:46.319+0000 7efc023419c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:11:46.425 INFO:tasks.workunit.client.0.smithi153.stderr: -79> 2024-09-19T14:11:46.319+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.425 INFO:tasks.workunit.client.0.smithi153.stderr: -78> 2024-09-19T14:11:46.319+0000 7efc023419c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:11:46.425 INFO:tasks.workunit.client.0.smithi153.stderr: -77> 2024-09-19T14:11:46.319+0000 7efc023419c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:11:46.425 INFO:tasks.workunit.client.0.smithi153.stderr: -76> 2024-09-19T14:11:46.319+0000 7efc023419c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:11:46.425 INFO:tasks.workunit.client.0.smithi153.stderr: -75> 2024-09-19T14:11:46.319+0000 7efc023419c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : miss 2024-09-19T14:11:46.425 INFO:tasks.workunit.client.0.smithi153.stderr: -74> 2024-09-19T14:11:46.319+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.425 INFO:tasks.workunit.client.0.smithi153.stderr: -73> 2024-09-19T14:11:46.319+0000 7efc023419c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:11:46.425 INFO:tasks.workunit.client.0.smithi153.stderr: -72> 2024-09-19T14:11:46.319+0000 7efc023419c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:11:46.426 INFO:tasks.workunit.client.0.smithi153.stderr: -71> 2024-09-19T14:11:46.319+0000 7efc023419c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:11:46.426 INFO:tasks.workunit.client.0.smithi153.stderr: -70> 2024-09-19T14:11:46.319+0000 7efc023419c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:11:46.426 INFO:tasks.workunit.client.0.smithi153.stderr: -69> 2024-09-19T14:11:46.319+0000 7efc023419c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:11:46.426 INFO:tasks.workunit.client.0.smithi153.stderr: -68> 2024-09-19T14:11:46.319+0000 7efc023419c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:11:46.426 INFO:tasks.workunit.client.0.smithi153.stderr: -67> 2024-09-19T14:11:46.331+0000 7efc023419c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:11:46.426 INFO:tasks.workunit.client.0.smithi153.stderr: -66> 2024-09-19T14:11:46.331+0000 7efc023419c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:11:46.426 INFO:tasks.workunit.client.0.smithi153.stderr: -65> 2024-09-19T14:11:46.331+0000 7efc023419c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:11:46.426 INFO:tasks.workunit.client.0.smithi153.stderr: -64> 2024-09-19T14:11:46.331+0000 7efc023419c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17, ofs0, ns] 2024-09-19T14:11:46.426 INFO:tasks.workunit.client.0.smithi153.stderr: -63> 2024-09-19T14:11:46.331+0000 7efade7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333525 cookie 94390669384832 notifier 7556 bl.length()=827 2024-09-19T14:11:46.426 INFO:tasks.workunit.client.0.smithi153.stderr: -62> 2024-09-19T14:11:46.331+0000 7efade7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:11:46.426 INFO:tasks.workunit.client.0.smithi153.stderr: -61> 2024-09-19T14:11:46.331+0000 7efade7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:11:46.426 INFO:tasks.workunit.client.0.smithi153.stderr: -60> 2024-09-19T14:11:46.331+0000 7efade7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:11:46.426 INFO:tasks.workunit.client.0.smithi153.stderr: -59> 2024-09-19T14:11:46.331+0000 7efc023419c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_sources= new_sources= 2024-09-19T14:11:46.426 INFO:tasks.workunit.client.0.smithi153.stderr: -58> 2024-09-19T14:11:46.331+0000 7efc023419c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential sources added=[] removed=[] 2024-09-19T14:11:46.426 INFO:tasks.workunit.client.0.smithi153.stderr: -57> 2024-09-19T14:11:46.331+0000 7efc023419c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_dests= new_dests= 2024-09-19T14:11:46.427 INFO:tasks.workunit.client.0.smithi153.stderr: -56> 2024-09-19T14:11:46.331+0000 7efc023419c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential dests added=[] removed=[] 2024-09-19T14:11:46.427 INFO:tasks.workunit.client.0.smithi153.stderr: -55> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.0 2024-09-19T14:11:46.427 INFO:tasks.workunit.client.0.smithi153.stderr: -54> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.0 2024-09-19T14:11:46.427 INFO:tasks.workunit.client.0.smithi153.stderr: -53> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.1 2024-09-19T14:11:46.427 INFO:tasks.workunit.client.0.smithi153.stderr: -52> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.1 2024-09-19T14:11:46.427 INFO:tasks.workunit.client.0.smithi153.stderr: -51> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.2 2024-09-19T14:11:46.427 INFO:tasks.workunit.client.0.smithi153.stderr: -50> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.2 2024-09-19T14:11:46.427 INFO:tasks.workunit.client.0.smithi153.stderr: -49> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.3 2024-09-19T14:11:46.427 INFO:tasks.workunit.client.0.smithi153.stderr: -48> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.3 2024-09-19T14:11:46.427 INFO:tasks.workunit.client.0.smithi153.stderr: -47> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.4 2024-09-19T14:11:46.427 INFO:tasks.workunit.client.0.smithi153.stderr: -46> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.4 2024-09-19T14:11:46.427 INFO:tasks.workunit.client.0.smithi153.stderr: -45> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.5 2024-09-19T14:11:46.427 INFO:tasks.workunit.client.0.smithi153.stderr: -44> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.5 2024-09-19T14:11:46.427 INFO:tasks.workunit.client.0.smithi153.stderr: -43> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.6 2024-09-19T14:11:46.427 INFO:tasks.workunit.client.0.smithi153.stderr: -42> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.6 2024-09-19T14:11:46.427 INFO:tasks.workunit.client.0.smithi153.stderr: -41> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.7 2024-09-19T14:11:46.428 INFO:tasks.workunit.client.0.smithi153.stderr: -40> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.7 2024-09-19T14:11:46.428 INFO:tasks.workunit.client.0.smithi153.stderr: -39> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.8 2024-09-19T14:11:46.428 INFO:tasks.workunit.client.0.smithi153.stderr: -38> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.8 2024-09-19T14:11:46.428 INFO:tasks.workunit.client.0.smithi153.stderr: -37> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.9 2024-09-19T14:11:46.428 INFO:tasks.workunit.client.0.smithi153.stderr: -36> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.9 2024-09-19T14:11:46.428 INFO:tasks.workunit.client.0.smithi153.stderr: -35> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.10 2024-09-19T14:11:46.428 INFO:tasks.workunit.client.0.smithi153.stderr: -34> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.10 2024-09-19T14:11:46.428 INFO:tasks.workunit.client.0.smithi153.stderr: -33> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.11 2024-09-19T14:11:46.428 INFO:tasks.workunit.client.0.smithi153.stderr: -32> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.11 2024-09-19T14:11:46.428 INFO:tasks.workunit.client.0.smithi153.stderr: -31> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.12 2024-09-19T14:11:46.428 INFO:tasks.workunit.client.0.smithi153.stderr: -30> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.12 2024-09-19T14:11:46.428 INFO:tasks.workunit.client.0.smithi153.stderr: -29> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.13 2024-09-19T14:11:46.428 INFO:tasks.workunit.client.0.smithi153.stderr: -28> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.13 2024-09-19T14:11:46.428 INFO:tasks.workunit.client.0.smithi153.stderr: -27> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:11:46.428 INFO:tasks.workunit.client.0.smithi153.stderr: -26> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:11:46.428 INFO:tasks.workunit.client.0.smithi153.stderr: -25> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:11:46.429 INFO:tasks.workunit.client.0.smithi153.stderr: -24> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:11:46.429 INFO:tasks.workunit.client.0.smithi153.stderr: -23> 2024-09-19T14:11:46.351+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:11:46.429 INFO:tasks.workunit.client.0.smithi153.stderr: -22> 2024-09-19T14:11:46.351+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:11:46.429 INFO:tasks.workunit.client.0.smithi153.stderr: -21> 2024-09-19T14:11:46.351+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:11:46.429 INFO:tasks.workunit.client.0.smithi153.stderr: -20> 2024-09-19T14:11:46.351+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:11:46.429 INFO:tasks.workunit.client.0.smithi153.stderr: -19> 2024-09-19T14:11:46.351+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:11:46.429 INFO:tasks.workunit.client.0.smithi153.stderr: -18> 2024-09-19T14:11:46.351+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:11:46.429 INFO:tasks.workunit.client.0.smithi153.stderr: -17> 2024-09-19T14:11:46.351+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:11:46.429 INFO:tasks.workunit.client.0.smithi153.stderr: -16> 2024-09-19T14:11:46.351+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:11:46.429 INFO:tasks.workunit.client.0.smithi153.stderr: -15> 2024-09-19T14:11:46.355+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:11:46.429 INFO:tasks.workunit.client.0.smithi153.stderr: -14> 2024-09-19T14:11:46.355+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:11:46.429 INFO:tasks.workunit.client.0.smithi153.stderr: -13> 2024-09-19T14:11:46.355+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:11:46.429 INFO:tasks.workunit.client.0.smithi153.stderr: -12> 2024-09-19T14:11:46.355+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:11:46.429 INFO:tasks.workunit.client.0.smithi153.stderr: -11> 2024-09-19T14:11:46.355+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:11:46.430 INFO:tasks.workunit.client.0.smithi153.stderr: -10> 2024-09-19T14:11:46.355+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:11:46.430 INFO:tasks.workunit.client.0.smithi153.stderr: -9> 2024-09-19T14:11:46.355+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:11:46.430 INFO:tasks.workunit.client.0.smithi153.stderr: -8> 2024-09-19T14:11:46.355+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:11:46.430 INFO:tasks.workunit.client.0.smithi153.stderr: -7> 2024-09-19T14:11:46.355+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:11:46.430 INFO:tasks.workunit.client.0.smithi153.stderr: -6> 2024-09-19T14:11:46.355+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:11:46.430 INFO:tasks.workunit.client.0.smithi153.stderr: -5> 2024-09-19T14:11:46.359+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:11:46.430 INFO:tasks.workunit.client.0.smithi153.stderr: -4> 2024-09-19T14:11:46.359+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:11:46.430 INFO:tasks.workunit.client.0.smithi153.stderr: -3> 2024-09-19T14:11:46.359+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:11:46.430 INFO:tasks.workunit.client.0.smithi153.stderr: -2> 2024-09-19T14:11:46.359+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:11:46.430 INFO:tasks.workunit.client.0.smithi153.stderr: -1> 2024-09-19T14:11:46.363+0000 7efc023419c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efc023419c0 time 2024-09-19T14:11:46.365238+0000 2024-09-19T14:11:46.430 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:11:46.430 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.430 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:11:46.430 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7efc05c1b2eb] 2024-09-19T14:11:46.430 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7efc05c1b49f] 2024-09-19T14:11:46.431 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d90773a271] 2024-09-19T14:11:46.431 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55d907749441] 2024-09-19T14:11:46.431 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55d90774aa94] 2024-09-19T14:11:46.431 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:11:46.431 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7efc04a81d90] 2024-09-19T14:11:46.431 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:11:46.431 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:11:46.431 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.431 INFO:tasks.workunit.client.0.smithi153.stderr: 0> 2024-09-19T14:11:46.363+0000 7efc023419c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:11:46.431 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7efc023419c0 thread_name:radosgw-admin 2024-09-19T14:11:46.431 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.431 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:11:46.431 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7efc04a9a520] 2024-09-19T14:11:46.431 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:11:46.431 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:11:46.431 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:11:46.432 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7efc05c1b345] 2024-09-19T14:11:46.432 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7efc05c1b49f] 2024-09-19T14:11:46.432 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d90773a271] 2024-09-19T14:11:46.432 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55d907749441] 2024-09-19T14:11:46.432 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55d90774aa94] 2024-09-19T14:11:46.432 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:11:46.432 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7efc04a81d90] 2024-09-19T14:11:46.432 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:11:46.432 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:11:46.432 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:11:46.432 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.432 INFO:tasks.workunit.client.0.smithi153.stderr:--- logging levels --- 2024-09-19T14:11:46.432 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 none 2024-09-19T14:11:46.433 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 lockdep 2024-09-19T14:11:46.433 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 context 2024-09-19T14:11:46.433 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 crush 2024-09-19T14:11:46.433 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds 2024-09-19T14:11:46.433 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_balancer 2024-09-19T14:11:46.433 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_locker 2024-09-19T14:11:46.433 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log 2024-09-19T14:11:46.433 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log_expire 2024-09-19T14:11:46.433 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_migrator 2024-09-19T14:11:46.433 INFO:tasks.workunit.client.0.smithi153.stderr: 3/ 5 mds_quiesce 2024-09-19T14:11:46.433 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 buffer 2024-09-19T14:11:46.433 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 timer 2024-09-19T14:11:46.433 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 filer 2024-09-19T14:11:46.433 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 striper 2024-09-19T14:11:46.433 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 objecter 2024-09-19T14:11:46.434 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rados 2024-09-19T14:11:46.434 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd 2024-09-19T14:11:46.434 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_mirror 2024-09-19T14:11:46.434 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_replay 2024-09-19T14:11:46.434 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_pwl 2024-09-19T14:11:46.434 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 journaler 2024-09-19T14:11:46.434 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objectcacher 2024-09-19T14:11:46.434 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:11:46.434 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 client 2024-09-19T14:11:46.434 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 osd 2024-09-19T14:11:46.434 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 optracker 2024-09-19T14:11:46.434 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objclass 2024-09-19T14:11:46.434 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 filestore 2024-09-19T14:11:46.434 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 journal 2024-09-19T14:11:46.435 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 ms 2024-09-19T14:11:46.435 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mon 2024-09-19T14:11:46.435 INFO:tasks.workunit.client.0.smithi153.stderr: 0/10 monc 2024-09-19T14:11:46.435 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 paxos 2024-09-19T14:11:46.435 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 tp 2024-09-19T14:11:46.435 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 auth 2024-09-19T14:11:46.435 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 crypto 2024-09-19T14:11:46.435 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 finisher 2024-09-19T14:11:46.435 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 reserver 2024-09-19T14:11:46.435 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 heartbeatmap 2024-09-19T14:11:46.435 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 perfcounter 2024-09-19T14:11:46.435 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw 2024-09-19T14:11:46.435 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_sync 2024-09-19T14:11:46.435 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_datacache 2024-09-19T14:11:46.436 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_access 2024-09-19T14:11:46.436 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:11:46.436 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_flight 2024-09-19T14:11:46.436 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:11:46.436 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw_notification 2024-09-19T14:11:46.436 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 javaclient 2024-09-19T14:11:46.436 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 asok 2024-09-19T14:11:46.436 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 throttle 2024-09-19T14:11:46.436 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 refs 2024-09-19T14:11:46.436 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 compressor 2024-09-19T14:11:46.436 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluestore 2024-09-19T14:11:46.436 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluefs 2024-09-19T14:11:46.436 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 bdev 2024-09-19T14:11:46.436 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 kstore 2024-09-19T14:11:46.437 INFO:tasks.workunit.client.0.smithi153.stderr: 4/ 5 rocksdb 2024-09-19T14:11:46.437 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 fuse 2024-09-19T14:11:46.437 INFO:tasks.workunit.client.0.smithi153.stderr: 2/ 5 mgr 2024-09-19T14:11:46.437 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mgrc 2024-09-19T14:11:46.437 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 dpdk 2024-09-19T14:11:46.437 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 eventtrace 2024-09-19T14:11:46.437 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 prioritycache 2024-09-19T14:11:46.437 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 test 2024-09-19T14:11:46.437 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:11:46.437 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephsqlite 2024-09-19T14:11:46.437 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:11:46.437 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore 2024-09-19T14:11:46.437 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_onode 2024-09-19T14:11:46.438 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_odata 2024-09-19T14:11:46.438 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_omap 2024-09-19T14:11:46.438 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_tm 2024-09-19T14:11:46.438 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_t 2024-09-19T14:11:46.438 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:11:46.438 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_epm 2024-09-19T14:11:46.438 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_lba 2024-09-19T14:11:46.438 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:11:46.438 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cache 2024-09-19T14:11:46.438 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_journal 2024-09-19T14:11:46.438 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_device 2024-09-19T14:11:46.438 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_backref 2024-09-19T14:11:46.438 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 alienstore 2024-09-19T14:11:46.439 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mclock 2024-09-19T14:11:46.439 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cyanstore 2024-09-19T14:11:46.439 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 ceph_exporter 2024-09-19T14:11:46.439 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 memstore 2024-09-19T14:11:46.439 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 trace 2024-09-19T14:11:46.439 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 ceph_dedup 2024-09-19T14:11:46.439 INFO:tasks.workunit.client.0.smithi153.stderr: -2/-2 (syslog threshold) 2024-09-19T14:11:46.439 INFO:tasks.workunit.client.0.smithi153.stderr: 99/99 (stderr threshold) 2024-09-19T14:11:46.439 INFO:tasks.workunit.client.0.smithi153.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:11:46.439 INFO:tasks.workunit.client.0.smithi153.stderr: 7efa2e7fc640 / http_manager 2024-09-19T14:11:46.439 INFO:tasks.workunit.client.0.smithi153.stderr: 7efab4fe1640 / http_manager 2024-09-19T14:11:46.439 INFO:tasks.workunit.client.0.smithi153.stderr: 7efab5fe3640 / rgw_dt_lg_renew 2024-09-19T14:11:46.439 INFO:tasks.workunit.client.0.smithi153.stderr: 7efadd7fa640 / ms_dispatch 2024-09-19T14:11:46.439 INFO:tasks.workunit.client.0.smithi153.stderr: 7efade7fc640 / io_context_pool 2024-09-19T14:11:46.439 INFO:tasks.workunit.client.0.smithi153.stderr: 7efadeffd640 / io_context_pool 2024-09-19T14:11:46.440 INFO:tasks.workunit.client.0.smithi153.stderr: 7efae57fa640 / ms_dispatch 2024-09-19T14:11:46.440 INFO:tasks.workunit.client.0.smithi153.stderr: 7efae7fff640 / ms_dispatch 2024-09-19T14:11:46.440 INFO:tasks.workunit.client.0.smithi153.stderr: 7efaede0b640 / io_context_pool 2024-09-19T14:11:46.440 INFO:tasks.workunit.client.0.smithi153.stderr: 7efbff646640 / msgr-worker-2 2024-09-19T14:11:46.440 INFO:tasks.workunit.client.0.smithi153.stderr: 7efbffe47640 / msgr-worker-1 2024-09-19T14:11:46.440 INFO:tasks.workunit.client.0.smithi153.stderr: 7efc00648640 / msgr-worker-0 2024-09-19T14:11:46.440 INFO:tasks.workunit.client.0.smithi153.stderr: 7efc00e49640 / io_context_pool 2024-09-19T14:11:46.440 INFO:tasks.workunit.client.0.smithi153.stderr: 7efc023419c0 / radosgw-admin 2024-09-19T14:11:46.440 INFO:tasks.workunit.client.0.smithi153.stderr: max_recent 500 2024-09-19T14:11:46.440 INFO:tasks.workunit.client.0.smithi153.stderr: max_new 1000 2024-09-19T14:11:46.440 INFO:tasks.workunit.client.0.smithi153.stderr: log_file /var/log/ceph/ceph-client.admin.138796.log 2024-09-19T14:11:46.440 INFO:tasks.workunit.client.0.smithi153.stderr:--- end dump of recent events --- 2024-09-19T14:11:46.440 INFO:tasks.workunit.client.0.smithi153.stderr:--- begin dump of recent events --- 2024-09-19T14:11:46.440 INFO:tasks.workunit.client.0.smithi153.stderr: -499> 2024-09-19T14:11:46.247+0000 7efc023419c0 5 AuthRegistry(0x55d90a41fe30) adding con mode: crc 2024-09-19T14:11:46.441 INFO:tasks.workunit.client.0.smithi153.stderr: -498> 2024-09-19T14:11:46.247+0000 7efc023419c0 5 AuthRegistry(0x55d90a41fe30) adding con mode: secure 2024-09-19T14:11:46.441 INFO:tasks.workunit.client.0.smithi153.stderr: -497> 2024-09-19T14:11:46.247+0000 7efc023419c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:46.441 INFO:tasks.workunit.client.0.smithi153.stderr: -496> 2024-09-19T14:11:46.247+0000 7efc023419c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:46.441 INFO:tasks.workunit.client.0.smithi153.stderr: -495> 2024-09-19T14:11:46.247+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command rotate-key hook 0x55d90a41ff78 2024-09-19T14:11:46.441 INFO:tasks.workunit.client.0.smithi153.stderr: -494> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient: _reopen_session rank -1 2024-09-19T14:11:46.441 INFO:tasks.workunit.client.0.smithi153.stderr: -493> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:11:46.441 INFO:tasks.workunit.client.0.smithi153.stderr: -492> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient(hunting): picked mon.noname-b con 0x55d90a2ad410 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:11:46.441 INFO:tasks.workunit.client.0.smithi153.stderr: -491> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient(hunting): picked mon.noname-a con 0x55d90a2ae0f0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:11:46.441 INFO:tasks.workunit.client.0.smithi153.stderr: -490> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient(hunting): picked mon.noname-c con 0x55d90a45e700 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:11:46.441 INFO:tasks.workunit.client.0.smithi153.stderr: -489> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:46.441 INFO:tasks.workunit.client.0.smithi153.stderr: -488> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:46.441 INFO:tasks.workunit.client.0.smithi153.stderr: -487> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:46.441 INFO:tasks.workunit.client.0.smithi153.stderr: -486> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient(hunting): _renew_subs 2024-09-19T14:11:46.441 INFO:tasks.workunit.client.0.smithi153.stderr: -485> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient(hunting): authenticate will time out at 2894.710960s 2024-09-19T14:11:46.442 INFO:tasks.workunit.client.0.smithi153.stderr: -484> 2024-09-19T14:11:46.247+0000 7efc00648640 10 monclient(hunting): get_auth_request con 0x55d90a45e700 auth_method 0 2024-09-19T14:11:46.442 INFO:tasks.workunit.client.0.smithi153.stderr: -483> 2024-09-19T14:11:46.247+0000 7efc00648640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:46.442 INFO:tasks.workunit.client.0.smithi153.stderr: -482> 2024-09-19T14:11:46.247+0000 7efc00648640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:46.442 INFO:tasks.workunit.client.0.smithi153.stderr: -481> 2024-09-19T14:11:46.247+0000 7efc00648640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:46.442 INFO:tasks.workunit.client.0.smithi153.stderr: -480> 2024-09-19T14:11:46.247+0000 7efbff646640 10 monclient(hunting): get_auth_request con 0x55d90a2ae0f0 auth_method 0 2024-09-19T14:11:46.442 INFO:tasks.workunit.client.0.smithi153.stderr: -479> 2024-09-19T14:11:46.247+0000 7efbff646640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:46.442 INFO:tasks.workunit.client.0.smithi153.stderr: -478> 2024-09-19T14:11:46.247+0000 7efbff646640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:46.442 INFO:tasks.workunit.client.0.smithi153.stderr: -477> 2024-09-19T14:11:46.247+0000 7efbff646640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:46.442 INFO:tasks.workunit.client.0.smithi153.stderr: -476> 2024-09-19T14:11:46.247+0000 7efc00648640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:46.442 INFO:tasks.workunit.client.0.smithi153.stderr: -475> 2024-09-19T14:11:46.247+0000 7efc00648640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:46.442 INFO:tasks.workunit.client.0.smithi153.stderr: -474> 2024-09-19T14:11:46.247+0000 7efc00648640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:46.442 INFO:tasks.workunit.client.0.smithi153.stderr: -473> 2024-09-19T14:11:46.247+0000 7efbff646640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:46.442 INFO:tasks.workunit.client.0.smithi153.stderr: -472> 2024-09-19T14:11:46.247+0000 7efbff646640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:46.442 INFO:tasks.workunit.client.0.smithi153.stderr: -471> 2024-09-19T14:11:46.247+0000 7efbff646640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:46.442 INFO:tasks.workunit.client.0.smithi153.stderr: -470> 2024-09-19T14:11:46.247+0000 7efc00648640 10 monclient(hunting): handle_auth_done global_id 7547 payload 824 2024-09-19T14:11:46.443 INFO:tasks.workunit.client.0.smithi153.stderr: -469> 2024-09-19T14:11:46.247+0000 7efc00648640 10 monclient: _finish_hunting 0 2024-09-19T14:11:46.443 INFO:tasks.workunit.client.0.smithi153.stderr: -468> 2024-09-19T14:11:46.247+0000 7efc00648640 1 monclient: found mon.noname-c 2024-09-19T14:11:46.443 INFO:tasks.workunit.client.0.smithi153.stderr: -467> 2024-09-19T14:11:46.247+0000 7efc00648640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:11:46.443 INFO:tasks.workunit.client.0.smithi153.stderr: -466> 2024-09-19T14:11:46.247+0000 7efae7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:46.443 INFO:tasks.workunit.client.0.smithi153.stderr: -465> 2024-09-19T14:11:46.247+0000 7efae7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:11:46.443 INFO:tasks.workunit.client.0.smithi153.stderr: -464> 2024-09-19T14:11:46.247+0000 7efae7fff640 10 monclient: dump: 2024-09-19T14:11:46.443 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:46.443 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:46.443 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.443 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.443 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:46.443 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:46.443 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:46.443 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:46.443 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:46.443 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.444 INFO:tasks.workunit.client.0.smithi153.stderr: -463> 2024-09-19T14:11:46.247+0000 7efae7fff640 10 monclient: _finish_auth 0 2024-09-19T14:11:46.444 INFO:tasks.workunit.client.0.smithi153.stderr: -462> 2024-09-19T14:11:46.247+0000 7efae7fff640 10 monclient: _check_auth_tickets 2024-09-19T14:11:46.444 INFO:tasks.workunit.client.0.smithi153.stderr: -461> 2024-09-19T14:11:46.247+0000 7efae7fff640 10 monclient: handle_config config(0 keys) 2024-09-19T14:11:46.444 INFO:tasks.workunit.client.0.smithi153.stderr: -460> 2024-09-19T14:11:46.247+0000 7efae7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:46.444 INFO:tasks.workunit.client.0.smithi153.stderr: -459> 2024-09-19T14:11:46.247+0000 7efae7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:11:46.444 INFO:tasks.workunit.client.0.smithi153.stderr: -458> 2024-09-19T14:11:46.247+0000 7efae7fff640 10 monclient: dump: 2024-09-19T14:11:46.444 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:46.444 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:46.444 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.444 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.444 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:46.444 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:46.444 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:46.444 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:46.445 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:46.445 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.445 INFO:tasks.workunit.client.0.smithi153.stderr: -457> 2024-09-19T14:11:46.247+0000 7efc023419c0 5 monclient: authenticate success, global_id 7547 2024-09-19T14:11:46.445 INFO:tasks.workunit.client.0.smithi153.stderr: -456> 2024-09-19T14:11:46.247+0000 7efaede0b640 4 set_mon_vals no callback set 2024-09-19T14:11:46.445 INFO:tasks.workunit.client.0.smithi153.stderr: -455> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient: _renew_subs 2024-09-19T14:11:46.445 INFO:tasks.workunit.client.0.smithi153.stderr: -454> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:11:46.445 INFO:tasks.workunit.client.0.smithi153.stderr: -453> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient: _renew_subs 2024-09-19T14:11:46.445 INFO:tasks.workunit.client.0.smithi153.stderr: -452> 2024-09-19T14:11:46.247+0000 7efc023419c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:11:46.445 INFO:tasks.workunit.client.0.smithi153.stderr: -451> 2024-09-19T14:11:46.247+0000 7efc023419c0 1 librados: init done 2024-09-19T14:11:46.445 INFO:tasks.workunit.client.0.smithi153.stderr: -450> 2024-09-19T14:11:46.251+0000 7efae7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:11:46.445 INFO:tasks.workunit.client.0.smithi153.stderr: -449> 2024-09-19T14:11:46.251+0000 7efae7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:11:46.445 INFO:tasks.workunit.client.0.smithi153.stderr: -448> 2024-09-19T14:11:46.251+0000 7efae7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:11:46.445 INFO:tasks.workunit.client.0.smithi153.stderr: -447> 2024-09-19T14:11:46.251+0000 7efbffe47640 10 monclient: get_auth_request con 0x7efae8071be0 auth_method 0 2024-09-19T14:11:46.445 INFO:tasks.workunit.client.0.smithi153.stderr: -446> 2024-09-19T14:11:46.251+0000 7efbff646640 10 monclient: get_auth_request con 0x55d90a44b4f0 auth_method 0 2024-09-19T14:11:46.446 INFO:tasks.workunit.client.0.smithi153.stderr: -445> 2024-09-19T14:11:46.251+0000 7efbffe47640 10 monclient: get_auth_request con 0x55d90a46b410 auth_method 0 2024-09-19T14:11:46.446 INFO:tasks.workunit.client.0.smithi153.stderr: -444> 2024-09-19T14:11:46.255+0000 7efbff646640 10 monclient: get_auth_request con 0x55d90a4706d0 auth_method 0 2024-09-19T14:11:46.446 INFO:tasks.workunit.client.0.smithi153.stderr: -443> 2024-09-19T14:11:46.255+0000 7efc023419c0 10 monclient: build_initial_monmap 2024-09-19T14:11:46.446 INFO:tasks.workunit.client.0.smithi153.stderr: -442> 2024-09-19T14:11:46.255+0000 7efc023419c0 1 build_initial for_mkfs: 0 2024-09-19T14:11:46.446 INFO:tasks.workunit.client.0.smithi153.stderr: -441> 2024-09-19T14:11:46.255+0000 7efc023419c0 10 monclient: monmap: 2024-09-19T14:11:46.446 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:11:46.446 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:11:46.446 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:11:46.446 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:11:46.446 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:11:46.446 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:46.446 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:11:46.446 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:11:46.446 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:11:46.447 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.447 INFO:tasks.workunit.client.0.smithi153.stderr: -440> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding auth protocol: cephx 2024-09-19T14:11:46.447 INFO:tasks.workunit.client.0.smithi153.stderr: -439> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding auth protocol: cephx 2024-09-19T14:11:46.447 INFO:tasks.workunit.client.0.smithi153.stderr: -438> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding auth protocol: cephx 2024-09-19T14:11:46.447 INFO:tasks.workunit.client.0.smithi153.stderr: -437> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding con mode: secure 2024-09-19T14:11:46.447 INFO:tasks.workunit.client.0.smithi153.stderr: -436> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding con mode: crc 2024-09-19T14:11:46.447 INFO:tasks.workunit.client.0.smithi153.stderr: -435> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding con mode: secure 2024-09-19T14:11:46.447 INFO:tasks.workunit.client.0.smithi153.stderr: -434> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding con mode: crc 2024-09-19T14:11:46.447 INFO:tasks.workunit.client.0.smithi153.stderr: -433> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding con mode: secure 2024-09-19T14:11:46.447 INFO:tasks.workunit.client.0.smithi153.stderr: -432> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding con mode: crc 2024-09-19T14:11:46.447 INFO:tasks.workunit.client.0.smithi153.stderr: -431> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding con mode: crc 2024-09-19T14:11:46.447 INFO:tasks.workunit.client.0.smithi153.stderr: -430> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding con mode: secure 2024-09-19T14:11:46.447 INFO:tasks.workunit.client.0.smithi153.stderr: -429> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding con mode: crc 2024-09-19T14:11:46.447 INFO:tasks.workunit.client.0.smithi153.stderr: -428> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding con mode: secure 2024-09-19T14:11:46.447 INFO:tasks.workunit.client.0.smithi153.stderr: -427> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding con mode: crc 2024-09-19T14:11:46.448 INFO:tasks.workunit.client.0.smithi153.stderr: -426> 2024-09-19T14:11:46.255+0000 7efc023419c0 5 AuthRegistry(0x55d90a474730) adding con mode: secure 2024-09-19T14:11:46.448 INFO:tasks.workunit.client.0.smithi153.stderr: -425> 2024-09-19T14:11:46.259+0000 7efc023419c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:46.448 INFO:tasks.workunit.client.0.smithi153.stderr: -424> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command objecter_requests cmddesc objecter_requests hook 0x55d90a478080 EEXIST 2024-09-19T14:11:46.448 INFO:tasks.workunit.client.0.smithi153.stderr: -423> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient: init 2024-09-19T14:11:46.448 INFO:tasks.workunit.client.0.smithi153.stderr: -422> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding auth protocol: cephx 2024-09-19T14:11:46.448 INFO:tasks.workunit.client.0.smithi153.stderr: -421> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding auth protocol: cephx 2024-09-19T14:11:46.448 INFO:tasks.workunit.client.0.smithi153.stderr: -420> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding auth protocol: cephx 2024-09-19T14:11:46.448 INFO:tasks.workunit.client.0.smithi153.stderr: -419> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding con mode: secure 2024-09-19T14:11:46.448 INFO:tasks.workunit.client.0.smithi153.stderr: -418> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding con mode: crc 2024-09-19T14:11:46.448 INFO:tasks.workunit.client.0.smithi153.stderr: -417> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding con mode: secure 2024-09-19T14:11:46.448 INFO:tasks.workunit.client.0.smithi153.stderr: -416> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding con mode: crc 2024-09-19T14:11:46.448 INFO:tasks.workunit.client.0.smithi153.stderr: -415> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding con mode: secure 2024-09-19T14:11:46.448 INFO:tasks.workunit.client.0.smithi153.stderr: -414> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding con mode: crc 2024-09-19T14:11:46.448 INFO:tasks.workunit.client.0.smithi153.stderr: -413> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding con mode: crc 2024-09-19T14:11:46.448 INFO:tasks.workunit.client.0.smithi153.stderr: -412> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding con mode: secure 2024-09-19T14:11:46.449 INFO:tasks.workunit.client.0.smithi153.stderr: -411> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding con mode: crc 2024-09-19T14:11:46.449 INFO:tasks.workunit.client.0.smithi153.stderr: -410> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding con mode: secure 2024-09-19T14:11:46.449 INFO:tasks.workunit.client.0.smithi153.stderr: -409> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding con mode: crc 2024-09-19T14:11:46.449 INFO:tasks.workunit.client.0.smithi153.stderr: -408> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 AuthRegistry(0x55d90a4736e8) adding con mode: secure 2024-09-19T14:11:46.449 INFO:tasks.workunit.client.0.smithi153.stderr: -407> 2024-09-19T14:11:46.259+0000 7efc023419c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:46.449 INFO:tasks.workunit.client.0.smithi153.stderr: -406> 2024-09-19T14:11:46.259+0000 7efc023419c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:46.449 INFO:tasks.workunit.client.0.smithi153.stderr: -405> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command rotate-key cmddesc rotate-key hook 0x55d90a473830 EEXIST 2024-09-19T14:11:46.449 INFO:tasks.workunit.client.0.smithi153.stderr: -404> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient: _reopen_session rank -1 2024-09-19T14:11:46.449 INFO:tasks.workunit.client.0.smithi153.stderr: -403> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T14:11:46.449 INFO:tasks.workunit.client.0.smithi153.stderr: -402> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient(hunting): picked mon.noname-b con 0x55d90a49c230 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:11:46.449 INFO:tasks.workunit.client.0.smithi153.stderr: -401> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient(hunting): picked mon.noname-c con 0x55d90a49bb60 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:11:46.449 INFO:tasks.workunit.client.0.smithi153.stderr: -400> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient(hunting): picked mon.noname-a con 0x55d90a49a540 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:11:46.450 INFO:tasks.workunit.client.0.smithi153.stderr: -399> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:46.450 INFO:tasks.workunit.client.0.smithi153.stderr: -398> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:46.450 INFO:tasks.workunit.client.0.smithi153.stderr: -397> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:46.450 INFO:tasks.workunit.client.0.smithi153.stderr: -396> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient(hunting): _renew_subs 2024-09-19T14:11:46.450 INFO:tasks.workunit.client.0.smithi153.stderr: -395> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient(hunting): authenticate will time out at 2894.721617s 2024-09-19T14:11:46.450 INFO:tasks.workunit.client.0.smithi153.stderr: -394> 2024-09-19T14:11:46.259+0000 7efc00648640 10 monclient(hunting): get_auth_request con 0x55d90a49a540 auth_method 0 2024-09-19T14:11:46.450 INFO:tasks.workunit.client.0.smithi153.stderr: -393> 2024-09-19T14:11:46.259+0000 7efc00648640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:46.450 INFO:tasks.workunit.client.0.smithi153.stderr: -392> 2024-09-19T14:11:46.259+0000 7efc00648640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:46.450 INFO:tasks.workunit.client.0.smithi153.stderr: -391> 2024-09-19T14:11:46.259+0000 7efc00648640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:46.450 INFO:tasks.workunit.client.0.smithi153.stderr: -390> 2024-09-19T14:11:46.259+0000 7efbff646640 10 monclient(hunting): get_auth_request con 0x55d90a49bb60 auth_method 0 2024-09-19T14:11:46.450 INFO:tasks.workunit.client.0.smithi153.stderr: -389> 2024-09-19T14:11:46.259+0000 7efbff646640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:46.451 INFO:tasks.workunit.client.0.smithi153.stderr: -388> 2024-09-19T14:11:46.259+0000 7efbff646640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:46.451 INFO:tasks.workunit.client.0.smithi153.stderr: -387> 2024-09-19T14:11:46.259+0000 7efbff646640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:46.451 INFO:tasks.workunit.client.0.smithi153.stderr: -386> 2024-09-19T14:11:46.259+0000 7efc00648640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:46.451 INFO:tasks.workunit.client.0.smithi153.stderr: -385> 2024-09-19T14:11:46.259+0000 7efc00648640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:46.451 INFO:tasks.workunit.client.0.smithi153.stderr: -384> 2024-09-19T14:11:46.259+0000 7efc00648640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:46.451 INFO:tasks.workunit.client.0.smithi153.stderr: -383> 2024-09-19T14:11:46.259+0000 7efbff646640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:46.451 INFO:tasks.workunit.client.0.smithi153.stderr: -382> 2024-09-19T14:11:46.259+0000 7efbff646640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:46.451 INFO:tasks.workunit.client.0.smithi153.stderr: -381> 2024-09-19T14:11:46.259+0000 7efbff646640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:46.451 INFO:tasks.workunit.client.0.smithi153.stderr: -380> 2024-09-19T14:11:46.259+0000 7efbff646640 10 monclient(hunting): handle_auth_done global_id 7550 payload 824 2024-09-19T14:11:46.451 INFO:tasks.workunit.client.0.smithi153.stderr: -379> 2024-09-19T14:11:46.259+0000 7efbff646640 10 monclient: _finish_hunting 0 2024-09-19T14:11:46.451 INFO:tasks.workunit.client.0.smithi153.stderr: -378> 2024-09-19T14:11:46.259+0000 7efbff646640 1 monclient: found mon.noname-c 2024-09-19T14:11:46.451 INFO:tasks.workunit.client.0.smithi153.stderr: -377> 2024-09-19T14:11:46.259+0000 7efbff646640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:11:46.451 INFO:tasks.workunit.client.0.smithi153.stderr: -376> 2024-09-19T14:11:46.259+0000 7efbffe47640 10 monclient: get_auth_request con 0x55d90a49c230 auth_method 0 2024-09-19T14:11:46.451 INFO:tasks.workunit.client.0.smithi153.stderr: -375> 2024-09-19T14:11:46.259+0000 7efae57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:46.451 INFO:tasks.workunit.client.0.smithi153.stderr: -374> 2024-09-19T14:11:46.259+0000 7efae57fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:11:46.451 INFO:tasks.workunit.client.0.smithi153.stderr: -373> 2024-09-19T14:11:46.259+0000 7efae57fa640 10 monclient: dump: 2024-09-19T14:11:46.452 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:46.452 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:46.452 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.452 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.452 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:46.452 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:46.452 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:46.452 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:46.452 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:46.452 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.452 INFO:tasks.workunit.client.0.smithi153.stderr: -372> 2024-09-19T14:11:46.259+0000 7efae57fa640 10 monclient: _finish_auth 0 2024-09-19T14:11:46.452 INFO:tasks.workunit.client.0.smithi153.stderr: -371> 2024-09-19T14:11:46.259+0000 7efae57fa640 10 monclient: _check_auth_tickets 2024-09-19T14:11:46.452 INFO:tasks.workunit.client.0.smithi153.stderr: -370> 2024-09-19T14:11:46.259+0000 7efae57fa640 10 monclient: handle_config config(0 keys) 2024-09-19T14:11:46.453 INFO:tasks.workunit.client.0.smithi153.stderr: -369> 2024-09-19T14:11:46.259+0000 7efae57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:46.453 INFO:tasks.workunit.client.0.smithi153.stderr: -368> 2024-09-19T14:11:46.259+0000 7efae57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:11:46.453 INFO:tasks.workunit.client.0.smithi153.stderr: -367> 2024-09-19T14:11:46.259+0000 7efae57fa640 10 monclient: dump: 2024-09-19T14:11:46.453 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:46.453 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:46.453 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.453 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.453 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:46.453 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:46.453 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:46.453 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:46.453 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:46.453 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.453 INFO:tasks.workunit.client.0.smithi153.stderr: -366> 2024-09-19T14:11:46.259+0000 7efc023419c0 5 monclient: authenticate success, global_id 7550 2024-09-19T14:11:46.454 INFO:tasks.workunit.client.0.smithi153.stderr: -365> 2024-09-19T14:11:46.259+0000 7efc00e49640 4 set_mon_vals no callback set 2024-09-19T14:11:46.454 INFO:tasks.workunit.client.0.smithi153.stderr: -364> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient: _renew_subs 2024-09-19T14:11:46.454 INFO:tasks.workunit.client.0.smithi153.stderr: -363> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:11:46.454 INFO:tasks.workunit.client.0.smithi153.stderr: -362> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient: _renew_subs 2024-09-19T14:11:46.454 INFO:tasks.workunit.client.0.smithi153.stderr: -361> 2024-09-19T14:11:46.259+0000 7efc023419c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:11:46.454 INFO:tasks.workunit.client.0.smithi153.stderr: -360> 2024-09-19T14:11:46.263+0000 7efae57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:11:46.454 INFO:tasks.workunit.client.0.smithi153.stderr: -359> 2024-09-19T14:11:46.263+0000 7efae57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:11:46.454 INFO:tasks.workunit.client.0.smithi153.stderr: -358> 2024-09-19T14:11:46.263+0000 7efae57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:11:46.454 INFO:tasks.workunit.client.0.smithi153.stderr: -357> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient: get_monmap_and_config 2024-09-19T14:11:46.454 INFO:tasks.workunit.client.0.smithi153.stderr: -356> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient: build_initial_monmap 2024-09-19T14:11:46.454 INFO:tasks.workunit.client.0.smithi153.stderr: -355> 2024-09-19T14:11:46.263+0000 7efc023419c0 1 build_initial for_mkfs: 0 2024-09-19T14:11:46.454 INFO:tasks.workunit.client.0.smithi153.stderr: -354> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient: monmap: 2024-09-19T14:11:46.454 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:11:46.454 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:11:46.455 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:11:46.455 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:11:46.455 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:11:46.455 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:46.455 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:11:46.455 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:11:46.455 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:11:46.455 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.455 INFO:tasks.workunit.client.0.smithi153.stderr: -353> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding auth protocol: cephx 2024-09-19T14:11:46.455 INFO:tasks.workunit.client.0.smithi153.stderr: -352> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding auth protocol: cephx 2024-09-19T14:11:46.455 INFO:tasks.workunit.client.0.smithi153.stderr: -351> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding auth protocol: cephx 2024-09-19T14:11:46.455 INFO:tasks.workunit.client.0.smithi153.stderr: -350> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding con mode: secure 2024-09-19T14:11:46.455 INFO:tasks.workunit.client.0.smithi153.stderr: -349> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding con mode: crc 2024-09-19T14:11:46.455 INFO:tasks.workunit.client.0.smithi153.stderr: -348> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding con mode: secure 2024-09-19T14:11:46.455 INFO:tasks.workunit.client.0.smithi153.stderr: -347> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding con mode: crc 2024-09-19T14:11:46.456 INFO:tasks.workunit.client.0.smithi153.stderr: -346> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding con mode: secure 2024-09-19T14:11:46.456 INFO:tasks.workunit.client.0.smithi153.stderr: -345> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding con mode: crc 2024-09-19T14:11:46.456 INFO:tasks.workunit.client.0.smithi153.stderr: -344> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding con mode: crc 2024-09-19T14:11:46.456 INFO:tasks.workunit.client.0.smithi153.stderr: -343> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding con mode: secure 2024-09-19T14:11:46.456 INFO:tasks.workunit.client.0.smithi153.stderr: -342> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding con mode: crc 2024-09-19T14:11:46.456 INFO:tasks.workunit.client.0.smithi153.stderr: -341> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding con mode: secure 2024-09-19T14:11:46.456 INFO:tasks.workunit.client.0.smithi153.stderr: -340> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding con mode: crc 2024-09-19T14:11:46.456 INFO:tasks.workunit.client.0.smithi153.stderr: -339> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x55d90a4bbc20) adding con mode: secure 2024-09-19T14:11:46.456 INFO:tasks.workunit.client.0.smithi153.stderr: -338> 2024-09-19T14:11:46.263+0000 7efbffe47640 10 monclient: get_auth_request con 0x7efad8071b20 auth_method 0 2024-09-19T14:11:46.456 INFO:tasks.workunit.client.0.smithi153.stderr: -337> 2024-09-19T14:11:46.263+0000 7efc023419c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:46.456 INFO:tasks.workunit.client.0.smithi153.stderr: -336> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient: init 2024-09-19T14:11:46.456 INFO:tasks.workunit.client.0.smithi153.stderr: -335> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding auth protocol: cephx 2024-09-19T14:11:46.456 INFO:tasks.workunit.client.0.smithi153.stderr: -334> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding auth protocol: cephx 2024-09-19T14:11:46.456 INFO:tasks.workunit.client.0.smithi153.stderr: -333> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding auth protocol: cephx 2024-09-19T14:11:46.457 INFO:tasks.workunit.client.0.smithi153.stderr: -332> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding con mode: secure 2024-09-19T14:11:46.457 INFO:tasks.workunit.client.0.smithi153.stderr: -331> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding con mode: crc 2024-09-19T14:11:46.457 INFO:tasks.workunit.client.0.smithi153.stderr: -330> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding con mode: secure 2024-09-19T14:11:46.457 INFO:tasks.workunit.client.0.smithi153.stderr: -329> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding con mode: crc 2024-09-19T14:11:46.457 INFO:tasks.workunit.client.0.smithi153.stderr: -328> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding con mode: secure 2024-09-19T14:11:46.457 INFO:tasks.workunit.client.0.smithi153.stderr: -327> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding con mode: crc 2024-09-19T14:11:46.457 INFO:tasks.workunit.client.0.smithi153.stderr: -326> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding con mode: crc 2024-09-19T14:11:46.457 INFO:tasks.workunit.client.0.smithi153.stderr: -325> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding con mode: secure 2024-09-19T14:11:46.457 INFO:tasks.workunit.client.0.smithi153.stderr: -324> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding con mode: crc 2024-09-19T14:11:46.457 INFO:tasks.workunit.client.0.smithi153.stderr: -323> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding con mode: secure 2024-09-19T14:11:46.457 INFO:tasks.workunit.client.0.smithi153.stderr: -322> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding con mode: crc 2024-09-19T14:11:46.457 INFO:tasks.workunit.client.0.smithi153.stderr: -321> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb0d20) adding con mode: secure 2024-09-19T14:11:46.457 INFO:tasks.workunit.client.0.smithi153.stderr: -320> 2024-09-19T14:11:46.263+0000 7efc023419c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:46.457 INFO:tasks.workunit.client.0.smithi153.stderr: -319> 2024-09-19T14:11:46.263+0000 7efc023419c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:46.458 INFO:tasks.workunit.client.0.smithi153.stderr: -318> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command rotate-key cmddesc rotate-key hook 0x7ffcbeeb0e68 EEXIST 2024-09-19T14:11:46.458 INFO:tasks.workunit.client.0.smithi153.stderr: -317> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient: _reopen_session rank -1 2024-09-19T14:11:46.458 INFO:tasks.workunit.client.0.smithi153.stderr: -316> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T14:11:46.458 INFO:tasks.workunit.client.0.smithi153.stderr: -315> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient(hunting): picked mon.noname-a con 0x55d90a4bfda0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:11:46.458 INFO:tasks.workunit.client.0.smithi153.stderr: -314> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient(hunting): picked mon.noname-b con 0x55d90a4eb720 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:11:46.458 INFO:tasks.workunit.client.0.smithi153.stderr: -313> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient(hunting): picked mon.noname-c con 0x55d90a4e1cc0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:11:46.458 INFO:tasks.workunit.client.0.smithi153.stderr: -312> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:46.458 INFO:tasks.workunit.client.0.smithi153.stderr: -311> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:46.458 INFO:tasks.workunit.client.0.smithi153.stderr: -310> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:46.458 INFO:tasks.workunit.client.0.smithi153.stderr: -309> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient(hunting): _renew_subs 2024-09-19T14:11:46.458 INFO:tasks.workunit.client.0.smithi153.stderr: -308> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient(hunting): authenticate will time out at 2894.726456s 2024-09-19T14:11:46.458 INFO:tasks.workunit.client.0.smithi153.stderr: -307> 2024-09-19T14:11:46.263+0000 7efbffe47640 10 monclient(hunting): get_auth_request con 0x55d90a4bfda0 auth_method 0 2024-09-19T14:11:46.458 INFO:tasks.workunit.client.0.smithi153.stderr: -306> 2024-09-19T14:11:46.263+0000 7efbffe47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:46.458 INFO:tasks.workunit.client.0.smithi153.stderr: -305> 2024-09-19T14:11:46.263+0000 7efbffe47640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:46.459 INFO:tasks.workunit.client.0.smithi153.stderr: -304> 2024-09-19T14:11:46.263+0000 7efbffe47640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:46.459 INFO:tasks.workunit.client.0.smithi153.stderr: -303> 2024-09-19T14:11:46.263+0000 7efc00648640 10 monclient(hunting): get_auth_request con 0x55d90a4e1cc0 auth_method 0 2024-09-19T14:11:46.459 INFO:tasks.workunit.client.0.smithi153.stderr: -302> 2024-09-19T14:11:46.263+0000 7efc00648640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:46.459 INFO:tasks.workunit.client.0.smithi153.stderr: -301> 2024-09-19T14:11:46.263+0000 7efc00648640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:46.459 INFO:tasks.workunit.client.0.smithi153.stderr: -300> 2024-09-19T14:11:46.263+0000 7efc00648640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:46.459 INFO:tasks.workunit.client.0.smithi153.stderr: -299> 2024-09-19T14:11:46.263+0000 7efbffe47640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:46.459 INFO:tasks.workunit.client.0.smithi153.stderr: -298> 2024-09-19T14:11:46.263+0000 7efbffe47640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:46.459 INFO:tasks.workunit.client.0.smithi153.stderr: -297> 2024-09-19T14:11:46.263+0000 7efbffe47640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:46.459 INFO:tasks.workunit.client.0.smithi153.stderr: -296> 2024-09-19T14:11:46.263+0000 7efc00648640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:46.459 INFO:tasks.workunit.client.0.smithi153.stderr: -295> 2024-09-19T14:11:46.263+0000 7efc00648640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:46.459 INFO:tasks.workunit.client.0.smithi153.stderr: -294> 2024-09-19T14:11:46.263+0000 7efc00648640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:46.459 INFO:tasks.workunit.client.0.smithi153.stderr: -293> 2024-09-19T14:11:46.263+0000 7efbff646640 10 monclient(hunting): get_auth_request con 0x55d90a4eb720 auth_method 0 2024-09-19T14:11:46.459 INFO:tasks.workunit.client.0.smithi153.stderr: -292> 2024-09-19T14:11:46.263+0000 7efbff646640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:46.459 INFO:tasks.workunit.client.0.smithi153.stderr: -291> 2024-09-19T14:11:46.263+0000 7efbff646640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:46.460 INFO:tasks.workunit.client.0.smithi153.stderr: -290> 2024-09-19T14:11:46.263+0000 7efbff646640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:46.460 INFO:tasks.workunit.client.0.smithi153.stderr: -289> 2024-09-19T14:11:46.263+0000 7efbffe47640 10 monclient(hunting): handle_auth_done global_id 8076 payload 274 2024-09-19T14:11:46.460 INFO:tasks.workunit.client.0.smithi153.stderr: -288> 2024-09-19T14:11:46.263+0000 7efbffe47640 10 monclient: _finish_hunting 0 2024-09-19T14:11:46.460 INFO:tasks.workunit.client.0.smithi153.stderr: -287> 2024-09-19T14:11:46.263+0000 7efbffe47640 1 monclient: found mon.noname-a 2024-09-19T14:11:46.460 INFO:tasks.workunit.client.0.smithi153.stderr: -286> 2024-09-19T14:11:46.263+0000 7efbffe47640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:11:46.460 INFO:tasks.workunit.client.0.smithi153.stderr: -285> 2024-09-19T14:11:46.263+0000 7efadeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:46.460 INFO:tasks.workunit.client.0.smithi153.stderr: -284> 2024-09-19T14:11:46.263+0000 7efadeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:11:46.460 INFO:tasks.workunit.client.0.smithi153.stderr: -283> 2024-09-19T14:11:46.263+0000 7efadeffd640 10 monclient: dump: 2024-09-19T14:11:46.460 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:46.460 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:46.460 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.460 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.460 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:46.460 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:46.461 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:46.461 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:46.461 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:46.461 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.461 INFO:tasks.workunit.client.0.smithi153.stderr: -282> 2024-09-19T14:11:46.263+0000 7efadeffd640 10 monclient: _finish_auth 0 2024-09-19T14:11:46.461 INFO:tasks.workunit.client.0.smithi153.stderr: -281> 2024-09-19T14:11:46.263+0000 7efadeffd640 10 monclient: _check_auth_tickets 2024-09-19T14:11:46.461 INFO:tasks.workunit.client.0.smithi153.stderr: -280> 2024-09-19T14:11:46.263+0000 7efadeffd640 10 monclient: handle_config config(0 keys) 2024-09-19T14:11:46.461 INFO:tasks.workunit.client.0.smithi153.stderr: -279> 2024-09-19T14:11:46.263+0000 7efc023419c0 5 monclient: authenticate success, global_id 8076 2024-09-19T14:11:46.461 INFO:tasks.workunit.client.0.smithi153.stderr: -278> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient: get_monmap_and_config success 2024-09-19T14:11:46.461 INFO:tasks.workunit.client.0.smithi153.stderr: -277> 2024-09-19T14:11:46.263+0000 7efc023419c0 4 set_mon_vals no callback set 2024-09-19T14:11:46.461 INFO:tasks.workunit.client.0.smithi153.stderr: -276> 2024-09-19T14:11:46.263+0000 7efadeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:46.461 INFO:tasks.workunit.client.0.smithi153.stderr: -275> 2024-09-19T14:11:46.263+0000 7efadeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:11:46.461 INFO:tasks.workunit.client.0.smithi153.stderr: -274> 2024-09-19T14:11:46.263+0000 7efadeffd640 10 monclient: dump: 2024-09-19T14:11:46.461 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:46.462 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:46.462 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.462 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.462 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:46.462 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:46.462 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:46.462 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:46.462 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:46.462 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.462 INFO:tasks.workunit.client.0.smithi153.stderr: -273> 2024-09-19T14:11:46.263+0000 7efc023419c0 10 monclient: shutdown 2024-09-19T14:11:46.462 INFO:tasks.workunit.client.0.smithi153.stderr: -272> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient: build_initial_monmap 2024-09-19T14:11:46.462 INFO:tasks.workunit.client.0.smithi153.stderr: -271> 2024-09-19T14:11:46.267+0000 7efc023419c0 1 build_initial for_mkfs: 0 2024-09-19T14:11:46.462 INFO:tasks.workunit.client.0.smithi153.stderr: -270> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient: monmap: 2024-09-19T14:11:46.462 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:11:46.463 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:11:46.463 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:11:46.463 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:11:46.463 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:11:46.463 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:46.463 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:11:46.463 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:11:46.463 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:11:46.463 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.463 INFO:tasks.workunit.client.0.smithi153.stderr: -269> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding auth protocol: cephx 2024-09-19T14:11:46.463 INFO:tasks.workunit.client.0.smithi153.stderr: -268> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding auth protocol: cephx 2024-09-19T14:11:46.463 INFO:tasks.workunit.client.0.smithi153.stderr: -267> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding auth protocol: cephx 2024-09-19T14:11:46.463 INFO:tasks.workunit.client.0.smithi153.stderr: -266> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding con mode: secure 2024-09-19T14:11:46.463 INFO:tasks.workunit.client.0.smithi153.stderr: -265> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding con mode: crc 2024-09-19T14:11:46.464 INFO:tasks.workunit.client.0.smithi153.stderr: -264> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding con mode: secure 2024-09-19T14:11:46.464 INFO:tasks.workunit.client.0.smithi153.stderr: -263> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding con mode: crc 2024-09-19T14:11:46.464 INFO:tasks.workunit.client.0.smithi153.stderr: -262> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding con mode: secure 2024-09-19T14:11:46.464 INFO:tasks.workunit.client.0.smithi153.stderr: -261> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding con mode: crc 2024-09-19T14:11:46.464 INFO:tasks.workunit.client.0.smithi153.stderr: -260> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding con mode: crc 2024-09-19T14:11:46.464 INFO:tasks.workunit.client.0.smithi153.stderr: -259> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding con mode: secure 2024-09-19T14:11:46.464 INFO:tasks.workunit.client.0.smithi153.stderr: -258> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding con mode: crc 2024-09-19T14:11:46.464 INFO:tasks.workunit.client.0.smithi153.stderr: -257> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding con mode: secure 2024-09-19T14:11:46.464 INFO:tasks.workunit.client.0.smithi153.stderr: -256> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding con mode: crc 2024-09-19T14:11:46.464 INFO:tasks.workunit.client.0.smithi153.stderr: -255> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a4e0910) adding con mode: secure 2024-09-19T14:11:46.464 INFO:tasks.workunit.client.0.smithi153.stderr: -254> 2024-09-19T14:11:46.267+0000 7efc023419c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:46.464 INFO:tasks.workunit.client.0.smithi153.stderr: -253> 2024-09-19T14:11:46.267+0000 7efc023419c0 1 librados: starting msgr at 2024-09-19T14:11:46.464 INFO:tasks.workunit.client.0.smithi153.stderr: -252> 2024-09-19T14:11:46.267+0000 7efc023419c0 1 librados: starting objecter 2024-09-19T14:11:46.464 INFO:tasks.workunit.client.0.smithi153.stderr: -251> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command objecter_requests cmddesc objecter_requests hook 0x55d90a4eb390 EEXIST 2024-09-19T14:11:46.465 INFO:tasks.workunit.client.0.smithi153.stderr: -250> 2024-09-19T14:11:46.267+0000 7efc023419c0 1 librados: setting wanted keys 2024-09-19T14:11:46.465 INFO:tasks.workunit.client.0.smithi153.stderr: -249> 2024-09-19T14:11:46.267+0000 7efc023419c0 1 librados: calling monclient init 2024-09-19T14:11:46.465 INFO:tasks.workunit.client.0.smithi153.stderr: -248> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient: init 2024-09-19T14:11:46.465 INFO:tasks.workunit.client.0.smithi153.stderr: -247> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding auth protocol: cephx 2024-09-19T14:11:46.465 INFO:tasks.workunit.client.0.smithi153.stderr: -246> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding auth protocol: cephx 2024-09-19T14:11:46.465 INFO:tasks.workunit.client.0.smithi153.stderr: -245> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding auth protocol: cephx 2024-09-19T14:11:46.465 INFO:tasks.workunit.client.0.smithi153.stderr: -244> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding con mode: secure 2024-09-19T14:11:46.465 INFO:tasks.workunit.client.0.smithi153.stderr: -243> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding con mode: crc 2024-09-19T14:11:46.465 INFO:tasks.workunit.client.0.smithi153.stderr: -242> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding con mode: secure 2024-09-19T14:11:46.465 INFO:tasks.workunit.client.0.smithi153.stderr: -241> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding con mode: crc 2024-09-19T14:11:46.465 INFO:tasks.workunit.client.0.smithi153.stderr: -240> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding con mode: secure 2024-09-19T14:11:46.465 INFO:tasks.workunit.client.0.smithi153.stderr: -239> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding con mode: crc 2024-09-19T14:11:46.465 INFO:tasks.workunit.client.0.smithi153.stderr: -238> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding con mode: crc 2024-09-19T14:11:46.465 INFO:tasks.workunit.client.0.smithi153.stderr: -237> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding con mode: secure 2024-09-19T14:11:46.466 INFO:tasks.workunit.client.0.smithi153.stderr: -236> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding con mode: crc 2024-09-19T14:11:46.466 INFO:tasks.workunit.client.0.smithi153.stderr: -235> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding con mode: secure 2024-09-19T14:11:46.466 INFO:tasks.workunit.client.0.smithi153.stderr: -234> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding con mode: crc 2024-09-19T14:11:46.466 INFO:tasks.workunit.client.0.smithi153.stderr: -233> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 AuthRegistry(0x55d90a49e050) adding con mode: secure 2024-09-19T14:11:46.466 INFO:tasks.workunit.client.0.smithi153.stderr: -232> 2024-09-19T14:11:46.267+0000 7efc023419c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:46.466 INFO:tasks.workunit.client.0.smithi153.stderr: -231> 2024-09-19T14:11:46.267+0000 7efc023419c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:46.466 INFO:tasks.workunit.client.0.smithi153.stderr: -230> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command rotate-key cmddesc rotate-key hook 0x55d90a49e198 EEXIST 2024-09-19T14:11:46.466 INFO:tasks.workunit.client.0.smithi153.stderr: -229> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient: _reopen_session rank -1 2024-09-19T14:11:46.466 INFO:tasks.workunit.client.0.smithi153.stderr: -228> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T14:11:46.466 INFO:tasks.workunit.client.0.smithi153.stderr: -227> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient(hunting): picked mon.noname-b con 0x55d90a4bfda0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:11:46.466 INFO:tasks.workunit.client.0.smithi153.stderr: -226> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient(hunting): picked mon.noname-c con 0x55d90a4e1cc0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:11:46.466 INFO:tasks.workunit.client.0.smithi153.stderr: -225> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient(hunting): picked mon.noname-a con 0x55d90a4eb720 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:11:46.466 INFO:tasks.workunit.client.0.smithi153.stderr: -224> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:46.466 INFO:tasks.workunit.client.0.smithi153.stderr: -223> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:46.466 INFO:tasks.workunit.client.0.smithi153.stderr: -222> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:11:46.467 INFO:tasks.workunit.client.0.smithi153.stderr: -221> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient(hunting): _renew_subs 2024-09-19T14:11:46.467 INFO:tasks.workunit.client.0.smithi153.stderr: -220> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient(hunting): authenticate will time out at 2894.729277s 2024-09-19T14:11:46.467 INFO:tasks.workunit.client.0.smithi153.stderr: -219> 2024-09-19T14:11:46.267+0000 7efbff646640 10 monclient(hunting): get_auth_request con 0x55d90a4e1cc0 auth_method 0 2024-09-19T14:11:46.467 INFO:tasks.workunit.client.0.smithi153.stderr: -218> 2024-09-19T14:11:46.267+0000 7efbff646640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:46.467 INFO:tasks.workunit.client.0.smithi153.stderr: -217> 2024-09-19T14:11:46.267+0000 7efbff646640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:46.467 INFO:tasks.workunit.client.0.smithi153.stderr: -216> 2024-09-19T14:11:46.267+0000 7efbff646640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:46.467 INFO:tasks.workunit.client.0.smithi153.stderr: -215> 2024-09-19T14:11:46.267+0000 7efc00648640 10 monclient(hunting): get_auth_request con 0x55d90a4eb720 auth_method 0 2024-09-19T14:11:46.467 INFO:tasks.workunit.client.0.smithi153.stderr: -214> 2024-09-19T14:11:46.267+0000 7efc00648640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:46.467 INFO:tasks.workunit.client.0.smithi153.stderr: -213> 2024-09-19T14:11:46.267+0000 7efc00648640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:46.467 INFO:tasks.workunit.client.0.smithi153.stderr: -212> 2024-09-19T14:11:46.267+0000 7efc00648640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:46.467 INFO:tasks.workunit.client.0.smithi153.stderr: -211> 2024-09-19T14:11:46.267+0000 7efbff646640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:46.467 INFO:tasks.workunit.client.0.smithi153.stderr: -210> 2024-09-19T14:11:46.267+0000 7efbff646640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:46.467 INFO:tasks.workunit.client.0.smithi153.stderr: -209> 2024-09-19T14:11:46.267+0000 7efbff646640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:46.467 INFO:tasks.workunit.client.0.smithi153.stderr: -208> 2024-09-19T14:11:46.267+0000 7efc00648640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:11:46.467 INFO:tasks.workunit.client.0.smithi153.stderr: -207> 2024-09-19T14:11:46.267+0000 7efc00648640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:11:46.468 INFO:tasks.workunit.client.0.smithi153.stderr: -206> 2024-09-19T14:11:46.267+0000 7efc00648640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:11:46.468 INFO:tasks.workunit.client.0.smithi153.stderr: -205> 2024-09-19T14:11:46.267+0000 7efbffe47640 10 monclient(hunting): get_auth_request con 0x55d90a4bfda0 auth_method 0 2024-09-19T14:11:46.468 INFO:tasks.workunit.client.0.smithi153.stderr: -204> 2024-09-19T14:11:46.267+0000 7efbffe47640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:11:46.468 INFO:tasks.workunit.client.0.smithi153.stderr: -203> 2024-09-19T14:11:46.267+0000 7efbffe47640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:11:46.468 INFO:tasks.workunit.client.0.smithi153.stderr: -202> 2024-09-19T14:11:46.267+0000 7efbffe47640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:11:46.468 INFO:tasks.workunit.client.0.smithi153.stderr: -201> 2024-09-19T14:11:46.267+0000 7efbff646640 10 monclient(hunting): handle_auth_done global_id 7556 payload 824 2024-09-19T14:11:46.468 INFO:tasks.workunit.client.0.smithi153.stderr: -200> 2024-09-19T14:11:46.267+0000 7efbff646640 10 monclient: _finish_hunting 0 2024-09-19T14:11:46.468 INFO:tasks.workunit.client.0.smithi153.stderr: -199> 2024-09-19T14:11:46.267+0000 7efbff646640 1 monclient: found mon.noname-c 2024-09-19T14:11:46.468 INFO:tasks.workunit.client.0.smithi153.stderr: -198> 2024-09-19T14:11:46.267+0000 7efbff646640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:11:46.468 INFO:tasks.workunit.client.0.smithi153.stderr: -197> 2024-09-19T14:11:46.267+0000 7efadd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:46.468 INFO:tasks.workunit.client.0.smithi153.stderr: -196> 2024-09-19T14:11:46.267+0000 7efadd7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:11:46.468 INFO:tasks.workunit.client.0.smithi153.stderr: -195> 2024-09-19T14:11:46.267+0000 7efadd7fa640 10 monclient: dump: 2024-09-19T14:11:46.468 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:46.468 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:46.469 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.469 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.469 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:46.469 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:46.469 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:46.469 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:46.469 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:46.469 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.469 INFO:tasks.workunit.client.0.smithi153.stderr: -194> 2024-09-19T14:11:46.267+0000 7efadd7fa640 10 monclient: _finish_auth 0 2024-09-19T14:11:46.469 INFO:tasks.workunit.client.0.smithi153.stderr: -193> 2024-09-19T14:11:46.267+0000 7efadd7fa640 10 monclient: _check_auth_tickets 2024-09-19T14:11:46.469 INFO:tasks.workunit.client.0.smithi153.stderr: -192> 2024-09-19T14:11:46.267+0000 7efadd7fa640 10 monclient: handle_config config(0 keys) 2024-09-19T14:11:46.469 INFO:tasks.workunit.client.0.smithi153.stderr: -191> 2024-09-19T14:11:46.267+0000 7efadd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:11:46.469 INFO:tasks.workunit.client.0.smithi153.stderr: -190> 2024-09-19T14:11:46.267+0000 7efadd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:11:46.469 INFO:tasks.workunit.client.0.smithi153.stderr: -189> 2024-09-19T14:11:46.267+0000 7efadd7fa640 10 monclient: dump: 2024-09-19T14:11:46.470 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:11:46.470 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:11:46.470 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.470 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:11:46.470 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:11:46.470 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:11:46.470 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:11:46.470 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:11:46.470 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:11:46.470 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.470 INFO:tasks.workunit.client.0.smithi153.stderr: -188> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 monclient: authenticate success, global_id 7556 2024-09-19T14:11:46.470 INFO:tasks.workunit.client.0.smithi153.stderr: -187> 2024-09-19T14:11:46.267+0000 7efadeffd640 4 set_mon_vals no callback set 2024-09-19T14:11:46.470 INFO:tasks.workunit.client.0.smithi153.stderr: -186> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient: _renew_subs 2024-09-19T14:11:46.470 INFO:tasks.workunit.client.0.smithi153.stderr: -185> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:11:46.470 INFO:tasks.workunit.client.0.smithi153.stderr: -184> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient: _renew_subs 2024-09-19T14:11:46.471 INFO:tasks.workunit.client.0.smithi153.stderr: -183> 2024-09-19T14:11:46.267+0000 7efc023419c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:11:46.471 INFO:tasks.workunit.client.0.smithi153.stderr: -182> 2024-09-19T14:11:46.267+0000 7efc023419c0 1 librados: init done 2024-09-19T14:11:46.471 INFO:tasks.workunit.client.0.smithi153.stderr: -181> 2024-09-19T14:11:46.267+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command cr dump hook 0x55d90a4e6cc8 2024-09-19T14:11:46.471 INFO:tasks.workunit.client.0.smithi153.stderr: -180> 2024-09-19T14:11:46.271+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.471 INFO:tasks.workunit.client.0.smithi153.stderr: -179> 2024-09-19T14:11:46.271+0000 7efadd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:11:46.471 INFO:tasks.workunit.client.0.smithi153.stderr: -178> 2024-09-19T14:11:46.271+0000 7efadd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:11:46.471 INFO:tasks.workunit.client.0.smithi153.stderr: -177> 2024-09-19T14:11:46.271+0000 7efadd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:11:46.471 INFO:tasks.workunit.client.0.smithi153.stderr: -176> 2024-09-19T14:11:46.271+0000 7efc00648640 10 monclient: get_auth_request con 0x55d90a50a5b0 auth_method 0 2024-09-19T14:11:46.471 INFO:tasks.workunit.client.0.smithi153.stderr: -175> 2024-09-19T14:11:46.271+0000 7efbffe47640 10 monclient: get_auth_request con 0x7efac8071be0 auth_method 0 2024-09-19T14:11:46.471 INFO:tasks.workunit.client.0.smithi153.stderr: -174> 2024-09-19T14:11:46.271+0000 7efc023419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.471 INFO:tasks.workunit.client.0.smithi153.stderr: -173> 2024-09-19T14:11:46.271+0000 7efc023419c0 20 realm 2024-09-19T14:11:46.471 INFO:tasks.workunit.client.0.smithi153.stderr: -172> 2024-09-19T14:11:46.271+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.471 INFO:tasks.workunit.client.0.smithi153.stderr: -171> 2024-09-19T14:11:46.271+0000 7efc023419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.471 INFO:tasks.workunit.client.0.smithi153.stderr: -170> 2024-09-19T14:11:46.271+0000 7efc023419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:11:46.472 INFO:tasks.workunit.client.0.smithi153.stderr: -169> 2024-09-19T14:11:46.271+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.472 INFO:tasks.workunit.client.0.smithi153.stderr: -168> 2024-09-19T14:11:46.271+0000 7efc023419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.472 INFO:tasks.workunit.client.0.smithi153.stderr: -167> 2024-09-19T14:11:46.271+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.472 INFO:tasks.workunit.client.0.smithi153.stderr: -166> 2024-09-19T14:11:46.271+0000 7efbffe47640 10 monclient: get_auth_request con 0x55d90a50e7e0 auth_method 0 2024-09-19T14:11:46.472 INFO:tasks.workunit.client.0.smithi153.stderr: -165> 2024-09-19T14:11:46.275+0000 7efc023419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:46.472 INFO:tasks.workunit.client.0.smithi153.stderr: -164> 2024-09-19T14:11:46.275+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.472 INFO:tasks.workunit.client.0.smithi153.stderr: -163> 2024-09-19T14:11:46.275+0000 7efc023419c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:11:46.472 INFO:tasks.workunit.client.0.smithi153.stderr: -162> 2024-09-19T14:11:46.275+0000 7efc023419c0 20 searching for the correct realm 2024-09-19T14:11:46.472 INFO:tasks.workunit.client.0.smithi153.stderr: -161> 2024-09-19T14:11:46.275+0000 7efbff646640 10 monclient: get_auth_request con 0x55d90a513a70 auth_method 0 2024-09-19T14:11:46.472 INFO:tasks.workunit.client.0.smithi153.stderr: -160> 2024-09-19T14:11:46.275+0000 7efc00648640 10 monclient: get_auth_request con 0x7efbf401e040 auth_method 0 2024-09-19T14:11:46.472 INFO:tasks.workunit.client.0.smithi153.stderr: -159> 2024-09-19T14:11:46.275+0000 7efbffe47640 10 monclient: get_auth_request con 0x7efbf80b0070 auth_method 0 2024-09-19T14:11:46.472 INFO:tasks.workunit.client.0.smithi153.stderr: -158> 2024-09-19T14:11:46.279+0000 7efbff646640 10 monclient: get_auth_request con 0x7efbf004a040 auth_method 0 2024-09-19T14:11:46.472 INFO:tasks.workunit.client.0.smithi153.stderr: -157> 2024-09-19T14:11:46.279+0000 7efc00648640 0 -- 172.21.15.153:0/387941972 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55d90a50a5b0 msgr2=0x55d90a50ca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:46.473 INFO:tasks.workunit.client.0.smithi153.stderr: -156> 2024-09-19T14:11:46.279+0000 7efadd7fa640 1 client.7556.objecter ms_handle_reset 0x55d90a50a5b0 session 0x55d90a509f30 osd.1 2024-09-19T14:11:46.473 INFO:tasks.workunit.client.0.smithi153.stderr: -155> 2024-09-19T14:11:46.279+0000 7efadd7fa640 10 monclient: _renew_subs 2024-09-19T14:11:46.473 INFO:tasks.workunit.client.0.smithi153.stderr: -154> 2024-09-19T14:11:46.279+0000 7efadd7fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:11:46.473 INFO:tasks.workunit.client.0.smithi153.stderr: -153> 2024-09-19T14:11:46.279+0000 7efc00648640 10 monclient: get_auth_request con 0x7efac8082310 auth_method 0 2024-09-19T14:11:46.473 INFO:tasks.workunit.client.0.smithi153.stderr: -152> 2024-09-19T14:11:46.279+0000 7efc00648640 10 monclient: get_auth_request con 0x7efbf4050190 auth_method 0 2024-09-19T14:11:46.473 INFO:tasks.workunit.client.0.smithi153.stderr: -151> 2024-09-19T14:11:46.287+0000 7efbffe47640 10 monclient: get_auth_request con 0x7efbf40714b0 auth_method 0 2024-09-19T14:11:46.473 INFO:tasks.workunit.client.0.smithi153.stderr: -150> 2024-09-19T14:11:46.287+0000 7efbffe47640 0 -- 172.21.15.153:0/387941972 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7efbf40714b0 msgr2=0x7efbf40658e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:46.473 INFO:tasks.workunit.client.0.smithi153.stderr: -149> 2024-09-19T14:11:46.287+0000 7efadd7fa640 1 client.7556.objecter ms_handle_reset 0x7efbf40714b0 session 0x7efbf407ce90 osd.0 2024-09-19T14:11:46.473 INFO:tasks.workunit.client.0.smithi153.stderr: -148> 2024-09-19T14:11:46.287+0000 7efbffe47640 10 monclient: get_auth_request con 0x55d90a50a5b0 auth_method 0 2024-09-19T14:11:46.473 INFO:tasks.workunit.client.0.smithi153.stderr: -147> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:11:46.473 INFO:tasks.workunit.client.0.smithi153.stderr: -146> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:11:46.473 INFO:tasks.workunit.client.0.smithi153.stderr: -145> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:11:46.473 INFO:tasks.workunit.client.0.smithi153.stderr: -144> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:11:46.473 INFO:tasks.workunit.client.0.smithi153.stderr: -143> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:11:46.474 INFO:tasks.workunit.client.0.smithi153.stderr: -142> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:11:46.474 INFO:tasks.workunit.client.0.smithi153.stderr: -141> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.474 INFO:tasks.workunit.client.0.smithi153.stderr: -140> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.474 INFO:tasks.workunit.client.0.smithi153.stderr: -139> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.474 INFO:tasks.workunit.client.0.smithi153.stderr: -138> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:46.474 INFO:tasks.workunit.client.0.smithi153.stderr: -137> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.474 INFO:tasks.workunit.client.0.smithi153.stderr: -136> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:11:46.474 INFO:tasks.workunit.client.0.smithi153.stderr: -135> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 zone default found 2024-09-19T14:11:46.474 INFO:tasks.workunit.client.0.smithi153.stderr: -134> 2024-09-19T14:11:46.295+0000 7efc023419c0 4 Realm: () 2024-09-19T14:11:46.474 INFO:tasks.workunit.client.0.smithi153.stderr: -133> 2024-09-19T14:11:46.295+0000 7efc023419c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:11:46.474 INFO:tasks.workunit.client.0.smithi153.stderr: -132> 2024-09-19T14:11:46.295+0000 7efc023419c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:11:46.474 INFO:tasks.workunit.client.0.smithi153.stderr: -131> 2024-09-19T14:11:46.295+0000 7efc023419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:11:46.474 INFO:tasks.workunit.client.0.smithi153.stderr: -130> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 zonegroup default 2024-09-19T14:11:46.474 INFO:tasks.workunit.client.0.smithi153.stderr: -129> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.475 INFO:tasks.workunit.client.0.smithi153.stderr: -128> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.475 INFO:tasks.workunit.client.0.smithi153.stderr: -127> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.475 INFO:tasks.workunit.client.0.smithi153.stderr: -126> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.475 INFO:tasks.workunit.client.0.smithi153.stderr: -125> 2024-09-19T14:11:46.295+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.475 INFO:tasks.workunit.client.0.smithi153.stderr: -124> 2024-09-19T14:11:46.299+0000 7efc023419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.475 INFO:tasks.workunit.client.0.smithi153.stderr: -123> 2024-09-19T14:11:46.299+0000 7efc023419c0 20 started sync module instance, tier type = 2024-09-19T14:11:46.475 INFO:tasks.workunit.client.0.smithi153.stderr: -122> 2024-09-19T14:11:46.299+0000 7efc023419c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:11:46.475 INFO:tasks.workunit.client.0.smithi153.stderr: -121> 2024-09-19T14:11:46.315+0000 7efc023419c0 20 add_watcher() i=0 2024-09-19T14:11:46.475 INFO:tasks.workunit.client.0.smithi153.stderr: -120> 2024-09-19T14:11:46.315+0000 7efc023419c0 20 add_watcher() i=1 2024-09-19T14:11:46.475 INFO:tasks.workunit.client.0.smithi153.stderr: -119> 2024-09-19T14:11:46.315+0000 7efc023419c0 20 add_watcher() i=2 2024-09-19T14:11:46.475 INFO:tasks.workunit.client.0.smithi153.stderr: -118> 2024-09-19T14:11:46.315+0000 7efc023419c0 20 add_watcher() i=3 2024-09-19T14:11:46.475 INFO:tasks.workunit.client.0.smithi153.stderr: -117> 2024-09-19T14:11:46.315+0000 7efc023419c0 20 add_watcher() i=4 2024-09-19T14:11:46.475 INFO:tasks.workunit.client.0.smithi153.stderr: -116> 2024-09-19T14:11:46.315+0000 7efc023419c0 20 add_watcher() i=5 2024-09-19T14:11:46.475 INFO:tasks.workunit.client.0.smithi153.stderr: -115> 2024-09-19T14:11:46.315+0000 7efc023419c0 20 add_watcher() i=6 2024-09-19T14:11:46.476 INFO:tasks.workunit.client.0.smithi153.stderr: -114> 2024-09-19T14:11:46.315+0000 7efc023419c0 20 add_watcher() i=7 2024-09-19T14:11:46.476 INFO:tasks.workunit.client.0.smithi153.stderr: -113> 2024-09-19T14:11:46.315+0000 7efc023419c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:11:46.476 INFO:tasks.workunit.client.0.smithi153.stderr: -112> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding auth protocol: cephx 2024-09-19T14:11:46.476 INFO:tasks.workunit.client.0.smithi153.stderr: -111> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding auth protocol: cephx 2024-09-19T14:11:46.476 INFO:tasks.workunit.client.0.smithi153.stderr: -110> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding auth protocol: cephx 2024-09-19T14:11:46.476 INFO:tasks.workunit.client.0.smithi153.stderr: -109> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding con mode: secure 2024-09-19T14:11:46.476 INFO:tasks.workunit.client.0.smithi153.stderr: -108> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding con mode: crc 2024-09-19T14:11:46.476 INFO:tasks.workunit.client.0.smithi153.stderr: -107> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding con mode: secure 2024-09-19T14:11:46.476 INFO:tasks.workunit.client.0.smithi153.stderr: -106> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding con mode: crc 2024-09-19T14:11:46.476 INFO:tasks.workunit.client.0.smithi153.stderr: -105> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding con mode: secure 2024-09-19T14:11:46.476 INFO:tasks.workunit.client.0.smithi153.stderr: -104> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding con mode: crc 2024-09-19T14:11:46.476 INFO:tasks.workunit.client.0.smithi153.stderr: -103> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding con mode: crc 2024-09-19T14:11:46.476 INFO:tasks.workunit.client.0.smithi153.stderr: -102> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding con mode: secure 2024-09-19T14:11:46.476 INFO:tasks.workunit.client.0.smithi153.stderr: -101> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding con mode: crc 2024-09-19T14:11:46.476 INFO:tasks.workunit.client.0.smithi153.stderr: -100> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding con mode: secure 2024-09-19T14:11:46.477 INFO:tasks.workunit.client.0.smithi153.stderr: -99> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding con mode: crc 2024-09-19T14:11:46.477 INFO:tasks.workunit.client.0.smithi153.stderr: -98> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 AuthRegistry(0x7ffcbeeb11f0) adding con mode: secure 2024-09-19T14:11:46.477 INFO:tasks.workunit.client.0.smithi153.stderr: -97> 2024-09-19T14:11:46.319+0000 7efab5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:46.477 INFO:tasks.workunit.client.0.smithi153.stderr: -96> 2024-09-19T14:11:46.319+0000 7efc023419c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:11:46.477 INFO:tasks.workunit.client.0.smithi153.stderr: -95> 2024-09-19T14:11:46.319+0000 7efc023419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:11:46.477 INFO:tasks.workunit.client.0.smithi153.stderr: -94> 2024-09-19T14:11:46.319+0000 7efc023419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:11:46.477 INFO:tasks.workunit.client.0.smithi153.stderr: -93> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command cache list hook 0x55d90a4e6ef0 2024-09-19T14:11:46.477 INFO:tasks.workunit.client.0.smithi153.stderr: -92> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command cache inspect hook 0x55d90a4e6ef0 2024-09-19T14:11:46.477 INFO:tasks.workunit.client.0.smithi153.stderr: -91> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command cache erase hook 0x55d90a4e6ef0 2024-09-19T14:11:46.477 INFO:tasks.workunit.client.0.smithi153.stderr: -90> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command cache zap hook 0x55d90a4e6ef0 2024-09-19T14:11:46.477 INFO:tasks.workunit.client.0.smithi153.stderr: -89> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 note: GC not initialized 2024-09-19T14:11:46.477 INFO:tasks.workunit.client.0.smithi153.stderr: -88> 2024-09-19T14:11:46.319+0000 7efab4fe1640 20 reqs_thread_entry: start 2024-09-19T14:11:46.477 INFO:tasks.workunit.client.0.smithi153.stderr: -87> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command sync trace show hook 0x7efbf8004910 2024-09-19T14:11:46.478 INFO:tasks.workunit.client.0.smithi153.stderr: -86> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command sync trace history hook 0x7efbf8004910 2024-09-19T14:11:46.478 INFO:tasks.workunit.client.0.smithi153.stderr: -85> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command sync trace active hook 0x7efbf8004910 2024-09-19T14:11:46.478 INFO:tasks.workunit.client.0.smithi153.stderr: -84> 2024-09-19T14:11:46.319+0000 7efc023419c0 5 asok(0x55d90a214d90) register_command sync trace active_short hook 0x7efbf8004910 2024-09-19T14:11:46.478 INFO:tasks.workunit.client.0.smithi153.stderr: -83> 2024-09-19T14:11:46.319+0000 7efc023419c0 20 init_complete bucket index max shards: 11 2024-09-19T14:11:46.478 INFO:tasks.workunit.client.0.smithi153.stderr: -82> 2024-09-19T14:11:46.319+0000 7efc023419c0 20 Filter name: none 2024-09-19T14:11:46.478 INFO:tasks.workunit.client.0.smithi153.stderr: -81> 2024-09-19T14:11:46.319+0000 7efa2e7fc640 20 reqs_thread_entry: start 2024-09-19T14:11:46.478 INFO:tasks.workunit.client.0.smithi153.stderr: -80> 2024-09-19T14:11:46.319+0000 7efc023419c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:11:46.478 INFO:tasks.workunit.client.0.smithi153.stderr: -79> 2024-09-19T14:11:46.319+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.478 INFO:tasks.workunit.client.0.smithi153.stderr: -78> 2024-09-19T14:11:46.319+0000 7efc023419c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:11:46.478 INFO:tasks.workunit.client.0.smithi153.stderr: -77> 2024-09-19T14:11:46.319+0000 7efc023419c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:11:46.478 INFO:tasks.workunit.client.0.smithi153.stderr: -76> 2024-09-19T14:11:46.319+0000 7efc023419c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:11:46.478 INFO:tasks.workunit.client.0.smithi153.stderr: -75> 2024-09-19T14:11:46.319+0000 7efc023419c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : miss 2024-09-19T14:11:46.478 INFO:tasks.workunit.client.0.smithi153.stderr: -74> 2024-09-19T14:11:46.319+0000 7efc023419c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.478 INFO:tasks.workunit.client.0.smithi153.stderr: -73> 2024-09-19T14:11:46.319+0000 7efc023419c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:11:46.479 INFO:tasks.workunit.client.0.smithi153.stderr: -72> 2024-09-19T14:11:46.319+0000 7efc023419c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:11:46.479 INFO:tasks.workunit.client.0.smithi153.stderr: -71> 2024-09-19T14:11:46.319+0000 7efc023419c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:11:46.479 INFO:tasks.workunit.client.0.smithi153.stderr: -70> 2024-09-19T14:11:46.319+0000 7efc023419c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:11:46.479 INFO:tasks.workunit.client.0.smithi153.stderr: -69> 2024-09-19T14:11:46.319+0000 7efc023419c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:11:46.479 INFO:tasks.workunit.client.0.smithi153.stderr: -68> 2024-09-19T14:11:46.319+0000 7efc023419c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:11:46.479 INFO:tasks.workunit.client.0.smithi153.stderr: -67> 2024-09-19T14:11:46.331+0000 7efc023419c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:11:46.479 INFO:tasks.workunit.client.0.smithi153.stderr: -66> 2024-09-19T14:11:46.331+0000 7efc023419c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:11:46.479 INFO:tasks.workunit.client.0.smithi153.stderr: -65> 2024-09-19T14:11:46.331+0000 7efc023419c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:11:46.479 INFO:tasks.workunit.client.0.smithi153.stderr: -64> 2024-09-19T14:11:46.331+0000 7efc023419c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17, ofs0, ns] 2024-09-19T14:11:46.479 INFO:tasks.workunit.client.0.smithi153.stderr: -63> 2024-09-19T14:11:46.331+0000 7efade7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333525 cookie 94390669384832 notifier 7556 bl.length()=827 2024-09-19T14:11:46.479 INFO:tasks.workunit.client.0.smithi153.stderr: -62> 2024-09-19T14:11:46.331+0000 7efade7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:11:46.479 INFO:tasks.workunit.client.0.smithi153.stderr: -61> 2024-09-19T14:11:46.331+0000 7efade7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:11:46.479 INFO:tasks.workunit.client.0.smithi153.stderr: -60> 2024-09-19T14:11:46.331+0000 7efade7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:11:46.479 INFO:tasks.workunit.client.0.smithi153.stderr: -59> 2024-09-19T14:11:46.331+0000 7efc023419c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_sources= new_sources= 2024-09-19T14:11:46.479 INFO:tasks.workunit.client.0.smithi153.stderr: -58> 2024-09-19T14:11:46.331+0000 7efc023419c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential sources added=[] removed=[] 2024-09-19T14:11:46.480 INFO:tasks.workunit.client.0.smithi153.stderr: -57> 2024-09-19T14:11:46.331+0000 7efc023419c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_dests= new_dests= 2024-09-19T14:11:46.480 INFO:tasks.workunit.client.0.smithi153.stderr: -56> 2024-09-19T14:11:46.331+0000 7efc023419c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential dests added=[] removed=[] 2024-09-19T14:11:46.480 INFO:tasks.workunit.client.0.smithi153.stderr: -55> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.0 2024-09-19T14:11:46.480 INFO:tasks.workunit.client.0.smithi153.stderr: -54> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.0 2024-09-19T14:11:46.480 INFO:tasks.workunit.client.0.smithi153.stderr: -53> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.1 2024-09-19T14:11:46.480 INFO:tasks.workunit.client.0.smithi153.stderr: -52> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.1 2024-09-19T14:11:46.480 INFO:tasks.workunit.client.0.smithi153.stderr: -51> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.2 2024-09-19T14:11:46.480 INFO:tasks.workunit.client.0.smithi153.stderr: -50> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.2 2024-09-19T14:11:46.480 INFO:tasks.workunit.client.0.smithi153.stderr: -49> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.3 2024-09-19T14:11:46.480 INFO:tasks.workunit.client.0.smithi153.stderr: -48> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.3 2024-09-19T14:11:46.480 INFO:tasks.workunit.client.0.smithi153.stderr: -47> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.4 2024-09-19T14:11:46.480 INFO:tasks.workunit.client.0.smithi153.stderr: -46> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.4 2024-09-19T14:11:46.480 INFO:tasks.workunit.client.0.smithi153.stderr: -45> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.5 2024-09-19T14:11:46.480 INFO:tasks.workunit.client.0.smithi153.stderr: -44> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.5 2024-09-19T14:11:46.481 INFO:tasks.workunit.client.0.smithi153.stderr: -43> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.6 2024-09-19T14:11:46.481 INFO:tasks.workunit.client.0.smithi153.stderr: -42> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.6 2024-09-19T14:11:46.481 INFO:tasks.workunit.client.0.smithi153.stderr: -41> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.7 2024-09-19T14:11:46.481 INFO:tasks.workunit.client.0.smithi153.stderr: -40> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.7 2024-09-19T14:11:46.481 INFO:tasks.workunit.client.0.smithi153.stderr: -39> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.8 2024-09-19T14:11:46.481 INFO:tasks.workunit.client.0.smithi153.stderr: -38> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.8 2024-09-19T14:11:46.481 INFO:tasks.workunit.client.0.smithi153.stderr: -37> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.9 2024-09-19T14:11:46.481 INFO:tasks.workunit.client.0.smithi153.stderr: -36> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.9 2024-09-19T14:11:46.481 INFO:tasks.workunit.client.0.smithi153.stderr: -35> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.10 2024-09-19T14:11:46.481 INFO:tasks.workunit.client.0.smithi153.stderr: -34> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.10 2024-09-19T14:11:46.481 INFO:tasks.workunit.client.0.smithi153.stderr: -33> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.11 2024-09-19T14:11:46.481 INFO:tasks.workunit.client.0.smithi153.stderr: -32> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.11 2024-09-19T14:11:46.481 INFO:tasks.workunit.client.0.smithi153.stderr: -31> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.12 2024-09-19T14:11:46.481 INFO:tasks.workunit.client.0.smithi153.stderr: -30> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.12 2024-09-19T14:11:46.482 INFO:tasks.workunit.client.0.smithi153.stderr: -29> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.13 2024-09-19T14:11:46.482 INFO:tasks.workunit.client.0.smithi153.stderr: -28> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.13 2024-09-19T14:11:46.482 INFO:tasks.workunit.client.0.smithi153.stderr: -27> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:11:46.482 INFO:tasks.workunit.client.0.smithi153.stderr: -26> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:11:46.482 INFO:tasks.workunit.client.0.smithi153.stderr: -25> 2024-09-19T14:11:46.347+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:11:46.482 INFO:tasks.workunit.client.0.smithi153.stderr: -24> 2024-09-19T14:11:46.347+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:11:46.482 INFO:tasks.workunit.client.0.smithi153.stderr: -23> 2024-09-19T14:11:46.351+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:11:46.482 INFO:tasks.workunit.client.0.smithi153.stderr: -22> 2024-09-19T14:11:46.351+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:11:46.482 INFO:tasks.workunit.client.0.smithi153.stderr: -21> 2024-09-19T14:11:46.351+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:11:46.482 INFO:tasks.workunit.client.0.smithi153.stderr: -20> 2024-09-19T14:11:46.351+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:11:46.482 INFO:tasks.workunit.client.0.smithi153.stderr: -19> 2024-09-19T14:11:46.351+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:11:46.482 INFO:tasks.workunit.client.0.smithi153.stderr: -18> 2024-09-19T14:11:46.351+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:11:46.482 INFO:tasks.workunit.client.0.smithi153.stderr: -17> 2024-09-19T14:11:46.351+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:11:46.482 INFO:tasks.workunit.client.0.smithi153.stderr: -16> 2024-09-19T14:11:46.351+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:11:46.483 INFO:tasks.workunit.client.0.smithi153.stderr: -15> 2024-09-19T14:11:46.355+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:11:46.483 INFO:tasks.workunit.client.0.smithi153.stderr: -14> 2024-09-19T14:11:46.355+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:11:46.483 INFO:tasks.workunit.client.0.smithi153.stderr: -13> 2024-09-19T14:11:46.355+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:11:46.483 INFO:tasks.workunit.client.0.smithi153.stderr: -12> 2024-09-19T14:11:46.355+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:11:46.483 INFO:tasks.workunit.client.0.smithi153.stderr: -11> 2024-09-19T14:11:46.355+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:11:46.483 INFO:tasks.workunit.client.0.smithi153.stderr: -10> 2024-09-19T14:11:46.355+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:11:46.483 INFO:tasks.workunit.client.0.smithi153.stderr: -9> 2024-09-19T14:11:46.355+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:11:46.483 INFO:tasks.workunit.client.0.smithi153.stderr: -8> 2024-09-19T14:11:46.355+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:11:46.483 INFO:tasks.workunit.client.0.smithi153.stderr: -7> 2024-09-19T14:11:46.355+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:11:46.483 INFO:tasks.workunit.client.0.smithi153.stderr: -6> 2024-09-19T14:11:46.355+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:11:46.483 INFO:tasks.workunit.client.0.smithi153.stderr: -5> 2024-09-19T14:11:46.359+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:11:46.483 INFO:tasks.workunit.client.0.smithi153.stderr: -4> 2024-09-19T14:11:46.359+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:11:46.483 INFO:tasks.workunit.client.0.smithi153.stderr: -3> 2024-09-19T14:11:46.359+0000 7efc023419c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:11:46.484 INFO:tasks.workunit.client.0.smithi153.stderr: -2> 2024-09-19T14:11:46.359+0000 7efc023419c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:11:46.484 INFO:tasks.workunit.client.0.smithi153.stderr: -1> 2024-09-19T14:11:46.363+0000 7efc023419c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efc023419c0 time 2024-09-19T14:11:46.365238+0000 2024-09-19T14:11:46.484 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:11:46.484 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.484 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:11:46.484 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7efc05c1b2eb] 2024-09-19T14:11:46.484 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7efc05c1b49f] 2024-09-19T14:11:46.484 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d90773a271] 2024-09-19T14:11:46.484 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55d907749441] 2024-09-19T14:11:46.484 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55d90774aa94] 2024-09-19T14:11:46.484 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:11:46.484 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7efc04a81d90] 2024-09-19T14:11:46.484 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:11:46.484 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:11:46.485 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.485 INFO:tasks.workunit.client.0.smithi153.stderr: 0> 2024-09-19T14:11:46.363+0000 7efc023419c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:11:46.485 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7efc023419c0 thread_name:radosgw-admin 2024-09-19T14:11:46.485 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.485 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:11:46.485 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7efc04a9a520] 2024-09-19T14:11:46.485 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:11:46.485 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:11:46.485 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:11:46.485 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7efc05c1b345] 2024-09-19T14:11:46.485 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7efc05c1b49f] 2024-09-19T14:11:46.485 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d90773a271] 2024-09-19T14:11:46.485 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x55d907749441] 2024-09-19T14:11:46.486 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55d90774aa94] 2024-09-19T14:11:46.486 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:11:46.486 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7efc04a81d90] 2024-09-19T14:11:46.486 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:11:46.486 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:11:46.486 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:11:46.486 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:11:46.486 INFO:tasks.workunit.client.0.smithi153.stderr:--- logging levels --- 2024-09-19T14:11:46.486 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 none 2024-09-19T14:11:46.486 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 lockdep 2024-09-19T14:11:46.486 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 context 2024-09-19T14:11:46.486 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 crush 2024-09-19T14:11:46.486 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds 2024-09-19T14:11:46.486 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_balancer 2024-09-19T14:11:46.487 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_locker 2024-09-19T14:11:46.487 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log 2024-09-19T14:11:46.487 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log_expire 2024-09-19T14:11:46.487 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_migrator 2024-09-19T14:11:46.487 INFO:tasks.workunit.client.0.smithi153.stderr: 3/ 5 mds_quiesce 2024-09-19T14:11:46.487 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 buffer 2024-09-19T14:11:46.487 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 timer 2024-09-19T14:11:46.487 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 filer 2024-09-19T14:11:46.487 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 striper 2024-09-19T14:11:46.487 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 objecter 2024-09-19T14:11:46.487 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rados 2024-09-19T14:11:46.487 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd 2024-09-19T14:11:46.487 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_mirror 2024-09-19T14:11:46.487 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_replay 2024-09-19T14:11:46.488 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_pwl 2024-09-19T14:11:46.488 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 journaler 2024-09-19T14:11:46.488 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objectcacher 2024-09-19T14:11:46.488 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:11:46.488 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 client 2024-09-19T14:11:46.488 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 osd 2024-09-19T14:11:46.488 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 optracker 2024-09-19T14:11:46.488 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objclass 2024-09-19T14:11:46.488 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 filestore 2024-09-19T14:11:46.488 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 journal 2024-09-19T14:11:46.488 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 ms 2024-09-19T14:11:46.488 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mon 2024-09-19T14:11:46.488 INFO:tasks.workunit.client.0.smithi153.stderr: 0/10 monc 2024-09-19T14:11:46.488 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 paxos 2024-09-19T14:11:46.489 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 tp 2024-09-19T14:11:46.489 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 auth 2024-09-19T14:11:46.489 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 crypto 2024-09-19T14:11:46.489 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 finisher 2024-09-19T14:11:46.489 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 reserver 2024-09-19T14:11:46.489 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 heartbeatmap 2024-09-19T14:11:46.489 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 perfcounter 2024-09-19T14:11:46.489 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw 2024-09-19T14:11:46.489 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_sync 2024-09-19T14:11:46.489 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_datacache 2024-09-19T14:11:46.489 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_access 2024-09-19T14:11:46.489 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:11:46.489 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_flight 2024-09-19T14:11:46.489 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:11:46.489 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw_notification 2024-09-19T14:11:46.490 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 javaclient 2024-09-19T14:11:46.490 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 asok 2024-09-19T14:11:46.490 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 throttle 2024-09-19T14:11:46.490 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 refs 2024-09-19T14:11:46.490 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 compressor 2024-09-19T14:11:46.490 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluestore 2024-09-19T14:11:46.490 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluefs 2024-09-19T14:11:46.490 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 bdev 2024-09-19T14:11:46.490 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 kstore 2024-09-19T14:11:46.490 INFO:tasks.workunit.client.0.smithi153.stderr: 4/ 5 rocksdb 2024-09-19T14:11:46.490 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 fuse 2024-09-19T14:11:46.490 INFO:tasks.workunit.client.0.smithi153.stderr: 2/ 5 mgr 2024-09-19T14:11:46.490 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mgrc 2024-09-19T14:11:46.490 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 dpdk 2024-09-19T14:11:46.491 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 eventtrace 2024-09-19T14:11:46.491 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 prioritycache 2024-09-19T14:11:46.491 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 test 2024-09-19T14:11:46.491 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:11:46.491 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephsqlite 2024-09-19T14:11:46.491 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:11:46.491 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore 2024-09-19T14:11:46.491 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_onode 2024-09-19T14:11:46.491 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_odata 2024-09-19T14:11:46.491 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_omap 2024-09-19T14:11:46.491 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_tm 2024-09-19T14:11:46.491 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_t 2024-09-19T14:11:46.491 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:11:46.491 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_epm 2024-09-19T14:11:46.492 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_lba 2024-09-19T14:11:46.492 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:11:46.492 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cache 2024-09-19T14:11:46.492 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_journal 2024-09-19T14:11:46.492 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_device 2024-09-19T14:11:46.492 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_backref 2024-09-19T14:11:46.492 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 alienstore 2024-09-19T14:11:46.492 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mclock 2024-09-19T14:11:46.492 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cyanstore 2024-09-19T14:11:46.492 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 ceph_exporter 2024-09-19T14:11:46.492 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 memstore 2024-09-19T14:11:46.492 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 trace 2024-09-19T14:11:46.492 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 ceph_dedup 2024-09-19T14:11:46.492 INFO:tasks.workunit.client.0.smithi153.stderr: -2/-2 (syslog threshold) 2024-09-19T14:11:46.493 INFO:tasks.workunit.client.0.smithi153.stderr: 99/99 (stderr threshold) 2024-09-19T14:11:46.493 INFO:tasks.workunit.client.0.smithi153.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:11:46.493 INFO:tasks.workunit.client.0.smithi153.stderr: 7efa2e7fc640 / http_manager 2024-09-19T14:11:46.493 INFO:tasks.workunit.client.0.smithi153.stderr: 7efab4fe1640 / http_manager 2024-09-19T14:11:46.493 INFO:tasks.workunit.client.0.smithi153.stderr: 7efab5fe3640 / rgw_dt_lg_renew 2024-09-19T14:11:46.493 INFO:tasks.workunit.client.0.smithi153.stderr: 7efadd7fa640 / ms_dispatch 2024-09-19T14:11:46.493 INFO:tasks.workunit.client.0.smithi153.stderr: 7efade7fc640 / io_context_pool 2024-09-19T14:11:46.493 INFO:tasks.workunit.client.0.smithi153.stderr: 7efadeffd640 / io_context_pool 2024-09-19T14:11:46.493 INFO:tasks.workunit.client.0.smithi153.stderr: 7efae57fa640 / ms_dispatch 2024-09-19T14:11:46.493 INFO:tasks.workunit.client.0.smithi153.stderr: 7efae7fff640 / ms_dispatch 2024-09-19T14:11:46.493 INFO:tasks.workunit.client.0.smithi153.stderr: 7efaede0b640 / io_context_pool 2024-09-19T14:11:46.493 INFO:tasks.workunit.client.0.smithi153.stderr: 7efbff646640 / msgr-worker-2 2024-09-19T14:11:46.493 INFO:tasks.workunit.client.0.smithi153.stderr: 7efbffe47640 / msgr-worker-1 2024-09-19T14:11:46.493 INFO:tasks.workunit.client.0.smithi153.stderr: 7efc00648640 / msgr-worker-0 2024-09-19T14:11:46.494 INFO:tasks.workunit.client.0.smithi153.stderr: 7efc00e49640 / io_context_pool 2024-09-19T14:11:46.494 INFO:tasks.workunit.client.0.smithi153.stderr: 7efc023419c0 / radosgw-admin 2024-09-19T14:11:46.494 INFO:tasks.workunit.client.0.smithi153.stderr: max_recent 500 2024-09-19T14:11:46.494 INFO:tasks.workunit.client.0.smithi153.stderr: max_new 1000 2024-09-19T14:11:46.494 INFO:tasks.workunit.client.0.smithi153.stderr: log_file /var/lib/ceph/crash/2024-09-19T14:11:46.367675Z_c261f2bd-1ab4-4092-8689-3aead2555332/log 2024-09-19T14:11:46.494 INFO:tasks.workunit.client.0.smithi153.stderr:--- end dump of recent events --- 2024-09-19T14:11:46.494 INFO:tasks.workunit.client.0.smithi153.stderr:Aborted 2024-09-19T14:11:46.494 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T14:11:46.498 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:11:46.498 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:11:46.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.447+0000 7fb3d80019c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.447+0000 7fb3d80019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.447+0000 7fb3d80019c0 20 realm 2024-09-19T14:11:46.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.447+0000 7fb3d80019c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.447+0000 7fb3d80019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.447+0000 7fb3d80019c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:11:46.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.447+0000 7fb3d80019c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.447+0000 7fb3d80019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.447+0000 7fb3d80019c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.451+0000 7fb3d80019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:46.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.451+0000 7fb3d80019c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.451+0000 7fb3d80019c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:11:46.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.451+0000 7fb3d80019c0 20 searching for the correct realm 2024-09-19T14:11:46.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.455+0000 7fb3d5306640 0 -- 172.21.15.153:0/3283991653 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fb3c80d0070 msgr2=0x7fb3c80d5960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:46.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.463+0000 7fb3d5306640 0 -- 172.21.15.153:0/3283991653 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fb2a0082290 msgr2=0x7fb2a00846c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:46.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.467+0000 7fb3d80019c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:11:46.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.467+0000 7fb3d80019c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:11:46.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.467+0000 7fb3d80019c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:11:46.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.467+0000 7fb3d80019c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:11:46.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.467+0000 7fb3d80019c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:11:46.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.467+0000 7fb3d80019c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:11:46.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.467+0000 7fb3d80019c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.467+0000 7fb3d80019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.467+0000 7fb3d80019c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.467+0000 7fb3d80019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:46.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.467+0000 7fb3d80019c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.471+0000 7fb3d80019c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:11:46.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.471+0000 7fb3d80019c0 20 zone default found 2024-09-19T14:11:46.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.471+0000 7fb3d80019c0 4 Realm: () 2024-09-19T14:11:46.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.471+0000 7fb3d80019c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:11:46.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.471+0000 7fb3d80019c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:11:46.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.471+0000 7fb3d80019c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:11:46.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.471+0000 7fb3d80019c0 20 zonegroup default 2024-09-19T14:11:46.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.471+0000 7fb3d80019c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.471+0000 7fb3d80019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.471+0000 7fb3d80019c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.471+0000 7fb3d80019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.471+0000 7fb3d80019c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.471+0000 7fb3d80019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.471+0000 7fb3d80019c0 20 started sync module instance, tier type = 2024-09-19T14:11:46.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.471+0000 7fb3d80019c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:11:46.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.487+0000 7fb3d80019c0 20 add_watcher() i=0 2024-09-19T14:11:46.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.487+0000 7fb3d80019c0 20 add_watcher() i=1 2024-09-19T14:11:46.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.487+0000 7fb3d80019c0 20 add_watcher() i=2 2024-09-19T14:11:46.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.487+0000 7fb3d80019c0 20 add_watcher() i=3 2024-09-19T14:11:46.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.487+0000 7fb3d80019c0 20 add_watcher() i=4 2024-09-19T14:11:46.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.487+0000 7fb3d80019c0 20 add_watcher() i=5 2024-09-19T14:11:46.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.487+0000 7fb3d80019c0 20 add_watcher() i=6 2024-09-19T14:11:46.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.487+0000 7fb3d80019c0 20 add_watcher() i=7 2024-09-19T14:11:46.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.487+0000 7fb3d80019c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:11:46.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.491+0000 7fb2877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:46.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.491+0000 7fb3d80019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:11:46.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.491+0000 7fb3d80019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:11:46.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.491+0000 7fb3d80019c0 5 note: GC not initialized 2024-09-19T14:11:46.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.491+0000 7fb2867fc640 20 reqs_thread_entry: start 2024-09-19T14:11:46.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.491+0000 7fb3d80019c0 20 init_complete bucket index max shards: 11 2024-09-19T14:11:46.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.491+0000 7fb3d80019c0 20 Filter name: none 2024-09-19T14:11:46.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.491+0000 7fb1f7fff640 20 reqs_thread_entry: start 2024-09-19T14:11:46.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.491+0000 7fb3d80019c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.491+0000 7fb3d80019c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:11:46.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.491+0000 7fb3d80019c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.491+0000 7fb3d80019c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-19T14:11:46.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.491+0000 7fb3d80019c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:11:46.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.491+0000 7fb3d80019c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.495+0000 7fb3d80019c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:11:46.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.495+0000 7fb3d80019c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.495+0000 7fb3d80019c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-19T14:11:46.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.495+0000 7fb3d80019c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:11:46.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.495+0000 7fb2877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:46.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.503+0000 7fb3d80019c0 20 remove_watcher() i=0 2024-09-19T14:11:46.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.503+0000 7fb3d80019c0 2 removed watcher, disabling cache 2024-09-19T14:11:46.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.503+0000 7fb3d80019c0 20 remove_watcher() i=1 2024-09-19T14:11:46.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.507+0000 7fb3d80019c0 20 remove_watcher() i=2 2024-09-19T14:11:46.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.507+0000 7fb3d80019c0 20 remove_watcher() i=3 2024-09-19T14:11:46.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.511+0000 7fb3d80019c0 20 remove_watcher() i=4 2024-09-19T14:11:46.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.511+0000 7fb3d80019c0 20 remove_watcher() i=5 2024-09-19T14:11:46.513 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.511+0000 7fb3d80019c0 20 remove_watcher() i=6 2024-09-19T14:11:46.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.515+0000 7fb3d80019c0 20 remove_watcher() i=7 2024-09-19T14:11:46.528 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:11:46.528 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:11:46.581 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-19T14:11:46.610 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:11:46.610 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:11:46.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.655+0000 7f68a41999c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.655+0000 7f68a41999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.655+0000 7f68a41999c0 20 realm 2024-09-19T14:11:46.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.655+0000 7f68a41999c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.655+0000 7f68a41999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.655+0000 7f68a41999c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:11:46.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.655+0000 7f68a41999c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.655+0000 7f68a41999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.655+0000 7f68a41999c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.659+0000 7f68a41999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:46.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.659+0000 7f68a41999c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.659+0000 7f68a41999c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:11:46.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.659+0000 7f68a41999c0 20 searching for the correct realm 2024-09-19T14:11:46.664 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.663+0000 7f68a149e640 0 -- 172.21.15.153:0/2229207986 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x55ae7cb27940 msgr2=0x55ae7cb29de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:46.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.667+0000 7f68a1c9f640 0 -- 172.21.15.153:0/2229207986 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f689401a420 msgr2=0x7f689401a880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:11:46.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.675+0000 7f68a41999c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:11:46.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.675+0000 7f68a41999c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:11:46.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.675+0000 7f68a41999c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:11:46.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.675+0000 7f68a41999c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:11:46.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.675+0000 7f68a41999c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:11:46.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.675+0000 7f68a41999c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:11:46.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.675+0000 7f68a41999c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.679+0000 7f68a41999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.679+0000 7f68a41999c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.679 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.679+0000 7f68a41999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:11:46.679 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.679+0000 7f68a41999c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.679+0000 7f68a41999c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:11:46.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.679+0000 7f68a41999c0 20 zone default found 2024-09-19T14:11:46.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.679+0000 7f68a41999c0 4 Realm: () 2024-09-19T14:11:46.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.679+0000 7f68a41999c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:11:46.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.679+0000 7f68a41999c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:11:46.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.679+0000 7f68a41999c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:11:46.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.679+0000 7f68a41999c0 20 zonegroup default 2024-09-19T14:11:46.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.679+0000 7f68a41999c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.679+0000 7f68a41999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.679+0000 7f68a41999c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.681 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.679+0000 7f68a41999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.681 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.679+0000 7f68a41999c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.681 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.679+0000 7f68a41999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:11:46.681 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.679+0000 7f68a41999c0 20 started sync module instance, tier type = 2024-09-19T14:11:46.681 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.679+0000 7f68a41999c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:11:46.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.703+0000 7f68a41999c0 20 add_watcher() i=0 2024-09-19T14:11:46.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.703+0000 7f68a41999c0 20 add_watcher() i=1 2024-09-19T14:11:46.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.703+0000 7f68a41999c0 20 add_watcher() i=2 2024-09-19T14:11:46.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.703+0000 7f68a41999c0 20 add_watcher() i=3 2024-09-19T14:11:46.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.703+0000 7f68a41999c0 20 add_watcher() i=4 2024-09-19T14:11:46.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.703+0000 7f68a41999c0 20 add_watcher() i=5 2024-09-19T14:11:46.705 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.703+0000 7f68a41999c0 20 add_watcher() i=6 2024-09-19T14:11:46.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.707+0000 7f68a41999c0 20 add_watcher() i=7 2024-09-19T14:11:46.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.707+0000 7f68a41999c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:11:46.710 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.711+0000 7f67537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:46.711 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.711+0000 7f68a41999c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:11:46.711 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.711+0000 7f68a41999c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:11:46.711 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.711+0000 7f68a41999c0 5 note: GC not initialized 2024-09-19T14:11:46.711 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.711+0000 7f67527fc640 20 reqs_thread_entry: start 2024-09-19T14:11:46.712 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.711+0000 7f68a41999c0 20 init_complete bucket index max shards: 11 2024-09-19T14:11:46.712 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.711+0000 7f68a41999c0 20 Filter name: none 2024-09-19T14:11:46.712 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.711+0000 7f66c3fff640 20 reqs_thread_entry: start 2024-09-19T14:11:46.712 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.711+0000 7f68a41999c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:11:46.712 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.711+0000 7f68a41999c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.712 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.711+0000 7f68a41999c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:11:46.713 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.711+0000 7f68a41999c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:11:46.713 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.711+0000 7f68a41999c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:11:46.713 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.711+0000 7f68a41999c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : miss 2024-09-19T14:11:46.713 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.711+0000 7f68a41999c0 20 rados->read ofs=0 len=0 2024-09-19T14:11:46.713 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.711+0000 7f68a41999c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-19T14:11:46.713 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.711+0000 7f68a41999c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:11:46.713 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.711+0000 7f68a41999c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:11:46.714 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.711+0000 7f68a41999c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:11:46.714 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.711+0000 7f68a41999c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:11:46.714 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.711+0000 7f68a41999c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:11:46.714 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.711+0000 7f68a41999c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:11:46.714 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.711+0000 7f68a41999c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:11:46.714 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.715+0000 7f68a41999c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:11:46.714 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.715+0000 7f68a41999c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:11:46.715 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.715+0000 7f68a41999c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:11:46.715 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.715+0000 7f68a41999c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:11:46.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.715+0000 7f68a41999c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:11:46.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.715+0000 7f68a41999c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:11:46.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.715+0000 7f68a41999c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:11:46.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.715+0000 7f68a41999c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:11:46.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.715+0000 7f68a41999c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:11:46.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.715+0000 7f68a41999c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:11:46.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.719+0000 7f68a41999c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:11:46.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.719+0000 7f68a41999c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:11:46.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.719+0000 7f68a41999c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:11:46.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.719+0000 7f68a41999c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:11:46.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.719+0000 7f68a41999c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:11:46.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.719+0000 7f68a41999c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:11:46.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.719+0000 7f68a41999c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:11:46.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.719+0000 7f68a41999c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:11:46.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.719+0000 7f68a41999c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:11:46.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.719+0000 7f68a41999c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:11:46.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.719+0000 7f68a41999c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:11:46.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.719+0000 7f68a41999c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:11:46.722 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.723+0000 7f68a41999c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:11:46.722 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.723+0000 7f68a41999c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:11:46.724 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.723+0000 7f67537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:11:46.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.727+0000 7f68a41999c0 20 remove_watcher() i=0 2024-09-19T14:11:46.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.727+0000 7f68a41999c0 2 removed watcher, disabling cache 2024-09-19T14:11:46.730 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.731+0000 7f68a41999c0 20 remove_watcher() i=1 2024-09-19T14:11:46.733 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.731+0000 7f68a41999c0 20 remove_watcher() i=2 2024-09-19T14:11:46.735 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.735+0000 7f68a41999c0 20 remove_watcher() i=3 2024-09-19T14:11:46.737 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.735+0000 7f68a41999c0 20 remove_watcher() i=4 2024-09-19T14:11:46.738 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.739+0000 7f68a41999c0 20 remove_watcher() i=5 2024-09-19T14:11:46.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.739+0000 7f68a41999c0 20 remove_watcher() i=6 2024-09-19T14:11:46.741 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:11:46.739+0000 7f68a41999c0 20 remove_watcher() i=7 2024-09-19T14:12:16.786 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T14:12:16.820 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:12:16.820 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:12:16.866 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.862+0000 7fcca8b499c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:16.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.866+0000 7fcca8b499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:16.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.866+0000 7fcca8b499c0 20 realm 2024-09-19T14:12:16.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.866+0000 7fcca8b499c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:16.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.866+0000 7fcca8b499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:16.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.866+0000 7fcca8b499c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:12:16.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.866+0000 7fcca8b499c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:16.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.866+0000 7fcca8b499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:16.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.866+0000 7fcca8b499c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:16.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.870+0000 7fcca8b499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:16.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.870+0000 7fcca8b499c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:16.871 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.870+0000 7fcca8b499c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:12:16.871 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.870+0000 7fcca8b499c0 20 searching for the correct realm 2024-09-19T14:12:16.876 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.874+0000 7fcca5e4e640 0 -- 172.21.15.153:0/906618647 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fcc98024070 msgr2=0x7fcc9806d770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:12:16.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.882+0000 7fcca5e4e640 0 -- 172.21.15.153:0/906618647 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fcb70082310 msgr2=0x7fcb70084740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:12:16.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.890+0000 7fcca8b499c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:12:16.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.890+0000 7fcca8b499c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:12:16.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.890+0000 7fcca8b499c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:12:16.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.890+0000 7fcca8b499c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:12:16.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.890+0000 7fcca8b499c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:12:16.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.890+0000 7fcca8b499c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:12:16.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.890+0000 7fcca8b499c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:16.891 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.890+0000 7fcca8b499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:16.892 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.890+0000 7fcca8b499c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:16.892 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.890+0000 7fcca8b499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:16.892 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.890+0000 7fcca8b499c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:16.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.890+0000 7fcca8b499c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:12:16.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.890+0000 7fcca8b499c0 20 zone default found 2024-09-19T14:12:16.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.890+0000 7fcca8b499c0 4 Realm: () 2024-09-19T14:12:16.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.890+0000 7fcca8b499c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:12:16.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.890+0000 7fcca8b499c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:12:16.893 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.890+0000 7fcca8b499c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:12:16.894 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.890+0000 7fcca8b499c0 20 zonegroup default 2024-09-19T14:12:16.894 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.890+0000 7fcca8b499c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:16.894 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.890+0000 7fcca8b499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:16.894 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.890+0000 7fcca8b499c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:16.894 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.890+0000 7fcca8b499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:16.895 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.890+0000 7fcca8b499c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:16.895 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.894+0000 7fcca8b499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:16.895 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.894+0000 7fcca8b499c0 20 started sync module instance, tier type = 2024-09-19T14:12:16.895 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.894+0000 7fcca8b499c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:12:16.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.910+0000 7fcca8b499c0 20 add_watcher() i=0 2024-09-19T14:12:16.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.910+0000 7fcca8b499c0 20 add_watcher() i=1 2024-09-19T14:12:16.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.910+0000 7fcca8b499c0 20 add_watcher() i=2 2024-09-19T14:12:16.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.910+0000 7fcca8b499c0 20 add_watcher() i=3 2024-09-19T14:12:16.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.910+0000 7fcca8b499c0 20 add_watcher() i=4 2024-09-19T14:12:16.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.910+0000 7fcca8b499c0 20 add_watcher() i=5 2024-09-19T14:12:16.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.910+0000 7fcca8b499c0 20 add_watcher() i=6 2024-09-19T14:12:16.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.910+0000 7fcca8b499c0 20 add_watcher() i=7 2024-09-19T14:12:16.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.910+0000 7fcca8b499c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:12:16.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.914+0000 7fcb5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:12:16.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.914+0000 7fcca8b499c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:12:16.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.914+0000 7fcca8b499c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:12:16.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.914+0000 7fcca8b499c0 5 note: GC not initialized 2024-09-19T14:12:16.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.914+0000 7fcad77fe640 20 reqs_thread_entry: start 2024-09-19T14:12:16.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.914+0000 7fcca8b499c0 20 init_complete bucket index max shards: 11 2024-09-19T14:12:16.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.914+0000 7fcca8b499c0 20 Filter name: none 2024-09-19T14:12:16.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.914+0000 7fcad57fa640 20 reqs_thread_entry: start 2024-09-19T14:12:16.918 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.914+0000 7fcca8b499c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:16.918 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.914+0000 7fcca8b499c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:12:16.918 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.914+0000 7fcca8b499c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:16.918 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.918+0000 7fcca8b499c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-19T14:12:16.919 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.918+0000 7fcca8b499c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:12:16.919 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.918+0000 7fcca8b499c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:16.919 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.918+0000 7fcca8b499c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:12:16.919 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.918+0000 7fcca8b499c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:16.919 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.918+0000 7fcca8b499c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-19T14:12:16.919 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.918+0000 7fcca8b499c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:12:16.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.922+0000 7fcb5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:12:16.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.926+0000 7fcca8b499c0 20 remove_watcher() i=0 2024-09-19T14:12:16.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.926+0000 7fcca8b499c0 2 removed watcher, disabling cache 2024-09-19T14:12:16.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.926+0000 7fcca8b499c0 20 remove_watcher() i=1 2024-09-19T14:12:16.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.930+0000 7fcca8b499c0 20 remove_watcher() i=2 2024-09-19T14:12:16.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.930+0000 7fcca8b499c0 20 remove_watcher() i=3 2024-09-19T14:12:16.935 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.934+0000 7fcca8b499c0 20 remove_watcher() i=4 2024-09-19T14:12:16.936 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.934+0000 7fcca8b499c0 20 remove_watcher() i=5 2024-09-19T14:12:16.937 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.934+0000 7fcca8b499c0 20 remove_watcher() i=6 2024-09-19T14:12:16.939 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:16.938+0000 7fcca8b499c0 20 remove_watcher() i=7 2024-09-19T14:12:16.954 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:12:16.954 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:12:17.098 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-19T14:12:17.130 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:12:17.130 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:12:17.175 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.174+0000 7ff8268429c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.174+0000 7ff8268429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.174+0000 7ff8268429c0 20 realm 2024-09-19T14:12:17.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.174+0000 7ff8268429c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.174+0000 7ff8268429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.174+0000 7ff8268429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:12:17.177 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.174+0000 7ff8268429c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.178 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.174+0000 7ff8268429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.178 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.174+0000 7ff8268429c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.178+0000 7ff8268429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:17.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.178+0000 7ff8268429c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.178+0000 7ff8268429c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:12:17.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.178+0000 7ff8268429c0 20 searching for the correct realm 2024-09-19T14:12:17.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.182+0000 7ff823b47640 0 -- 172.21.15.153:0/2663607434 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x556a2669c510 msgr2=0x556a2669e9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:12:17.191 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.190+0000 7ff824348640 0 -- 172.21.15.153:0/2663607434 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7ff80c13d300 msgr2=0x7ff80c1109e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:12:17.199 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.198+0000 7ff8268429c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:12:17.199 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.198+0000 7ff8268429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:12:17.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.198+0000 7ff8268429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:12:17.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.198+0000 7ff8268429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:12:17.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.198+0000 7ff8268429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:12:17.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.198+0000 7ff8268429c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:12:17.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.198+0000 7ff8268429c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.198+0000 7ff8268429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.198+0000 7ff8268429c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.198+0000 7ff8268429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:17.201 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.198+0000 7ff8268429c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.201 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.198+0000 7ff8268429c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:12:17.201 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.198+0000 7ff8268429c0 20 zone default found 2024-09-19T14:12:17.202 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.198+0000 7ff8268429c0 4 Realm: () 2024-09-19T14:12:17.202 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.198+0000 7ff8268429c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:12:17.202 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.198+0000 7ff8268429c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:12:17.202 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.198+0000 7ff8268429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:12:17.202 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.198+0000 7ff8268429c0 20 zonegroup default 2024-09-19T14:12:17.202 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.198+0000 7ff8268429c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.202 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.198+0000 7ff8268429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.202 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.198+0000 7ff8268429c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.202+0000 7ff8268429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.202+0000 7ff8268429c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.202+0000 7ff8268429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.202+0000 7ff8268429c0 20 started sync module instance, tier type = 2024-09-19T14:12:17.203 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.202+0000 7ff8268429c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:12:17.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.214+0000 7ff8268429c0 20 add_watcher() i=0 2024-09-19T14:12:17.217 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.214+0000 7ff8268429c0 20 add_watcher() i=1 2024-09-19T14:12:17.218 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.214+0000 7ff8268429c0 20 add_watcher() i=2 2024-09-19T14:12:17.218 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.214+0000 7ff8268429c0 20 add_watcher() i=3 2024-09-19T14:12:17.218 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.214+0000 7ff8268429c0 20 add_watcher() i=4 2024-09-19T14:12:17.218 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.214+0000 7ff8268429c0 20 add_watcher() i=5 2024-09-19T14:12:17.218 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.214+0000 7ff8268429c0 20 add_watcher() i=6 2024-09-19T14:12:17.218 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.218+0000 7ff8268429c0 20 add_watcher() i=7 2024-09-19T14:12:17.218 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.218+0000 7ff8268429c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:12:17.221 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.218+0000 7ff6dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:12:17.222 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.218+0000 7ff8268429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:12:17.222 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.218+0000 7ff8268429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:12:17.222 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.218+0000 7ff8268429c0 5 note: GC not initialized 2024-09-19T14:12:17.222 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.218+0000 7ff6d9fdb640 20 reqs_thread_entry: start 2024-09-19T14:12:17.222 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.218+0000 7ff8268429c0 20 init_complete bucket index max shards: 11 2024-09-19T14:12:17.222 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.218+0000 7ff8268429c0 20 Filter name: none 2024-09-19T14:12:17.222 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.222+0000 7ff64b7fe640 20 reqs_thread_entry: start 2024-09-19T14:12:17.222 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.222+0000 7ff8268429c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:12:17.222 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.222+0000 7ff8268429c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.222+0000 7ff8268429c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:12:17.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.222+0000 7ff8268429c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:12:17.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.222+0000 7ff8268429c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:12:17.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.222+0000 7ff8268429c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : miss 2024-09-19T14:12:17.223 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.222+0000 7ff8268429c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.222+0000 7ff8268429c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:12:17.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.222+0000 7ff8268429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:12:17.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.222+0000 7ff8268429c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:12:17.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.222+0000 7ff8268429c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:12:17.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.222+0000 7ff8268429c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:12:17.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.222+0000 7ff8268429c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:12:17.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.222+0000 7ff8268429c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:12:17.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.222+0000 7ff8268429c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:12:17.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.222+0000 7ff8268429c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:12:17.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.222+0000 7ff8268429c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:12:17.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.222+0000 7ff8268429c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:12:17.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.222+0000 7ff8268429c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:12:17.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.226+0000 7ff8268429c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:12:17.227 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.226+0000 7ff8268429c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:12:17.228 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.226+0000 7ff8268429c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:12:17.228 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.226+0000 7ff8268429c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:12:17.229 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.226+0000 7ff8268429c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:12:17.229 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.226+0000 7ff8268429c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:12:17.229 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.226+0000 7ff8268429c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:12:17.229 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.226+0000 7ff8268429c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:12:17.230 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.230+0000 7ff8268429c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:12:17.230 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.230+0000 7ff8268429c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:12:17.231 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.230+0000 7ff8268429c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:12:17.231 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.230+0000 7ff8268429c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:12:17.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.230+0000 7ff8268429c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:12:17.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.230+0000 7ff8268429c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:12:17.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.230+0000 7ff8268429c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:12:17.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.230+0000 7ff8268429c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:12:17.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.230+0000 7ff8268429c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:12:17.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.230+0000 7ff8268429c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:12:17.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.230+0000 7ff8268429c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:12:17.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.230+0000 7ff8268429c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:12:17.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.234+0000 7ff6dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:12:17.239 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.238+0000 7ff8268429c0 20 remove_watcher() i=0 2024-09-19T14:12:17.239 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.238+0000 7ff8268429c0 2 removed watcher, disabling cache 2024-09-19T14:12:17.242 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.238+0000 7ff8268429c0 20 remove_watcher() i=1 2024-09-19T14:12:17.244 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.242+0000 7ff8268429c0 20 remove_watcher() i=2 2024-09-19T14:12:17.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.246+0000 7ff8268429c0 20 remove_watcher() i=3 2024-09-19T14:12:17.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.246+0000 7ff8268429c0 20 remove_watcher() i=4 2024-09-19T14:12:17.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.246+0000 7ff8268429c0 20 remove_watcher() i=5 2024-09-19T14:12:17.251 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.250+0000 7ff8268429c0 20 remove_watcher() i=6 2024-09-19T14:12:17.252 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.250+0000 7ff8268429c0 20 remove_watcher() i=7 2024-09-19T14:12:17.267 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T14:12:17.294 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:12:17.294 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:12:17.337 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.334+0000 7f3d8da679c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.339 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.338+0000 7f3d8da679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.339 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.338+0000 7f3d8da679c0 20 realm 2024-09-19T14:12:17.339 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.338+0000 7f3d8da679c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.339 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.338+0000 7f3d8da679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.339 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.338+0000 7f3d8da679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:12:17.339 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.338+0000 7f3d8da679c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.339 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.338+0000 7f3d8da679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.340 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.338+0000 7f3d8da679c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.338+0000 7f3d8da679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:17.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.338+0000 7f3d8da679c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.338+0000 7f3d8da679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:12:17.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.338+0000 7f3d8da679c0 20 searching for the correct realm 2024-09-19T14:12:17.348 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.346+0000 7f3d8ad6c640 0 -- 172.21.15.153:0/165804880 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f3d7c008050 msgr2=0x7f3d7c075440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:12:17.354 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.354+0000 7f3d8ad6c640 0 -- 172.21.15.153:0/165804880 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f3c54082310 msgr2=0x7f3c54084740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:12:17.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.358+0000 7f3d8da679c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:12:17.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.358+0000 7f3d8da679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:12:17.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.358+0000 7f3d8da679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:12:17.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.358+0000 7f3d8da679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:12:17.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.358+0000 7f3d8da679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:12:17.361 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.358+0000 7f3d8da679c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:12:17.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.358+0000 7f3d8da679c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.358+0000 7f3d8da679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.362 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.358+0000 7f3d8da679c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.358+0000 7f3d8da679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:17.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.358+0000 7f3d8da679c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.362+0000 7f3d8da679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:12:17.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.362+0000 7f3d8da679c0 20 zone default found 2024-09-19T14:12:17.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.362+0000 7f3d8da679c0 4 Realm: () 2024-09-19T14:12:17.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.362+0000 7f3d8da679c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:12:17.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.362+0000 7f3d8da679c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:12:17.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.362+0000 7f3d8da679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:12:17.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.362+0000 7f3d8da679c0 20 zonegroup default 2024-09-19T14:12:17.363 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.362+0000 7f3d8da679c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.362+0000 7f3d8da679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.362+0000 7f3d8da679c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.362+0000 7f3d8da679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.362+0000 7f3d8da679c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.362+0000 7f3d8da679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.362+0000 7f3d8da679c0 20 started sync module instance, tier type = 2024-09-19T14:12:17.365 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.362+0000 7f3d8da679c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:12:17.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.378+0000 7f3d8da679c0 20 add_watcher() i=0 2024-09-19T14:12:17.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.378+0000 7f3d8da679c0 20 add_watcher() i=1 2024-09-19T14:12:17.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.378+0000 7f3d8da679c0 20 add_watcher() i=2 2024-09-19T14:12:17.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.378+0000 7f3d8da679c0 20 add_watcher() i=3 2024-09-19T14:12:17.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.378+0000 7f3d8da679c0 20 add_watcher() i=4 2024-09-19T14:12:17.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.378+0000 7f3d8da679c0 20 add_watcher() i=5 2024-09-19T14:12:17.380 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.378+0000 7f3d8da679c0 20 add_watcher() i=6 2024-09-19T14:12:17.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.378+0000 7f3d8da679c0 20 add_watcher() i=7 2024-09-19T14:12:17.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.378+0000 7f3d8da679c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:12:17.383 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.382+0000 7f3c41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:12:17.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.382+0000 7f3d8da679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:12:17.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.382+0000 7f3d8da679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:12:17.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.382+0000 7f3d8da679c0 5 note: GC not initialized 2024-09-19T14:12:17.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.382+0000 7f3c40fe1640 20 reqs_thread_entry: start 2024-09-19T14:12:17.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.382+0000 7f3d8da679c0 20 init_complete bucket index max shards: 11 2024-09-19T14:12:17.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.382+0000 7f3d8da679c0 20 Filter name: none 2024-09-19T14:12:17.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.382+0000 7f3bba7fc640 20 reqs_thread_entry: start 2024-09-19T14:12:17.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.382+0000 7f3d8da679c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.385 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.382+0000 7f3d8da679c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:12:17.385 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.382+0000 7f3d8da679c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.385 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.382+0000 7f3d8da679c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:12:17.385 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.382+0000 7f3d8da679c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:12:17.385 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.382+0000 7f3d8da679c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.382+0000 7f3d8da679c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:12:17.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.382+0000 7f3d8da679c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.386+0000 7f3d8da679c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:12:17.387 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.386+0000 7f3d8da679c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:12:17.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.386+0000 7f3c41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:12:17.394 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.390+0000 7f3d8da679c0 20 remove_watcher() i=0 2024-09-19T14:12:17.394 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.390+0000 7f3d8da679c0 2 removed watcher, disabling cache 2024-09-19T14:12:17.396 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.394+0000 7f3d8da679c0 20 remove_watcher() i=1 2024-09-19T14:12:17.397 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.394+0000 7f3d8da679c0 20 remove_watcher() i=2 2024-09-19T14:12:17.399 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.398+0000 7f3d8da679c0 20 remove_watcher() i=3 2024-09-19T14:12:17.401 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.398+0000 7f3d8da679c0 20 remove_watcher() i=4 2024-09-19T14:12:17.402 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.402+0000 7f3d8da679c0 20 remove_watcher() i=5 2024-09-19T14:12:17.404 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.402+0000 7f3d8da679c0 20 remove_watcher() i=6 2024-09-19T14:12:17.405 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.402+0000 7f3d8da679c0 20 remove_watcher() i=7 2024-09-19T14:12:17.418 INFO:tasks.workunit.client.0.smithi153.stderr: test: duplicated entries should be purged before reshard 2024-09-19T14:12:17.419 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T14:12:17.445 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:12:17.445 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:12:17.488 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.486+0000 7f1fa2c629c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.490 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.490+0000 7f1fa2c629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.490 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.490+0000 7f1fa2c629c0 20 realm 2024-09-19T14:12:17.491 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.490+0000 7f1fa2c629c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.491 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.490+0000 7f1fa2c629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.491 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.490+0000 7f1fa2c629c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:12:17.491 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.490+0000 7f1fa2c629c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.491 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.490+0000 7f1fa2c629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.491 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.490+0000 7f1fa2c629c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.492 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.490+0000 7f1fa2c629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:17.492 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.490+0000 7f1fa2c629c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.493 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.490+0000 7f1fa2c629c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:12:17.493 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.490+0000 7f1fa2c629c0 20 searching for the correct realm 2024-09-19T14:12:17.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.498+0000 7f1f9ff67640 0 -- 172.21.15.153:0/3754591101 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x55ef5c7595e0 msgr2=0x55ef5c75b9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:12:17.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.502+0000 7f1fa0768640 0 -- 172.21.15.153:0/3754591101 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f1f9405e630 msgr2=0x7f1f940771e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:12:17.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.510+0000 7f1fa2c629c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:12:17.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.510+0000 7f1fa2c629c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:12:17.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.510+0000 7f1fa2c629c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:12:17.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.510+0000 7f1fa2c629c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:12:17.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.510+0000 7f1fa2c629c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:12:17.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.510+0000 7f1fa2c629c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:12:17.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.510+0000 7f1fa2c629c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.510+0000 7f1fa2c629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.510+0000 7f1fa2c629c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.513 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.510+0000 7f1fa2c629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:17.513 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.510+0000 7f1fa2c629c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.510+0000 7f1fa2c629c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:12:17.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.510+0000 7f1fa2c629c0 20 zone default found 2024-09-19T14:12:17.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.510+0000 7f1fa2c629c0 4 Realm: () 2024-09-19T14:12:17.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.510+0000 7f1fa2c629c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:12:17.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.510+0000 7f1fa2c629c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:12:17.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.510+0000 7f1fa2c629c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:12:17.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.510+0000 7f1fa2c629c0 20 zonegroup default 2024-09-19T14:12:17.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.510+0000 7f1fa2c629c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.510+0000 7f1fa2c629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.514 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.510+0000 7f1fa2c629c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.515 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.514+0000 7f1fa2c629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.515 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.514+0000 7f1fa2c629c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.515 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.514+0000 7f1fa2c629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.515 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.514+0000 7f1fa2c629c0 20 started sync module instance, tier type = 2024-09-19T14:12:17.515 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.514+0000 7f1fa2c629c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:12:17.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.526+0000 7f1fa2c629c0 20 add_watcher() i=0 2024-09-19T14:12:17.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.526+0000 7f1fa2c629c0 20 add_watcher() i=1 2024-09-19T14:12:17.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.526+0000 7f1fa2c629c0 20 add_watcher() i=2 2024-09-19T14:12:17.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.526+0000 7f1fa2c629c0 20 add_watcher() i=3 2024-09-19T14:12:17.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.526+0000 7f1fa2c629c0 20 add_watcher() i=4 2024-09-19T14:12:17.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.526+0000 7f1fa2c629c0 20 add_watcher() i=5 2024-09-19T14:12:17.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.526+0000 7f1fa2c629c0 20 add_watcher() i=6 2024-09-19T14:12:17.530 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.530+0000 7f1fa2c629c0 20 add_watcher() i=7 2024-09-19T14:12:17.530 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.530+0000 7f1fa2c629c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:12:17.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.534+0000 7f1e56fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:12:17.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.534+0000 7f1fa2c629c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:12:17.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.534+0000 7f1fa2c629c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:12:17.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.534+0000 7f1fa2c629c0 5 note: GC not initialized 2024-09-19T14:12:17.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.534+0000 7f1e55fdb640 20 reqs_thread_entry: start 2024-09-19T14:12:17.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.534+0000 7f1fa2c629c0 20 init_complete bucket index max shards: 11 2024-09-19T14:12:17.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.534+0000 7f1fa2c629c0 20 Filter name: none 2024-09-19T14:12:17.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.534+0000 7f1dc77fe640 20 reqs_thread_entry: start 2024-09-19T14:12:17.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.534+0000 7f1fa2c629c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.534+0000 7f1fa2c629c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:12:17.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.534+0000 7f1fa2c629c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.534+0000 7f1fa2c629c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:12:17.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.534+0000 7f1fa2c629c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:12:17.538 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.534+0000 7f1fa2c629c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.538+0000 7f1fa2c629c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:12:17.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.538+0000 7f1fa2c629c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.538+0000 7f1fa2c629c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:12:17.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.538+0000 7f1fa2c629c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:12:17.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.538+0000 7f1e56fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:12:17.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.546+0000 7f1fa2c629c0 20 remove_watcher() i=0 2024-09-19T14:12:17.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.546+0000 7f1fa2c629c0 2 removed watcher, disabling cache 2024-09-19T14:12:17.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.546+0000 7f1fa2c629c0 20 remove_watcher() i=1 2024-09-19T14:12:17.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.546+0000 7f1fa2c629c0 20 remove_watcher() i=2 2024-09-19T14:12:17.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.550+0000 7f1fa2c629c0 20 remove_watcher() i=3 2024-09-19T14:12:17.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.550+0000 7f1fa2c629c0 20 remove_watcher() i=4 2024-09-19T14:12:17.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.554+0000 7f1fa2c629c0 20 remove_watcher() i=5 2024-09-19T14:12:17.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.554+0000 7f1fa2c629c0 20 remove_watcher() i=6 2024-09-19T14:12:17.557 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.554+0000 7f1fa2c629c0 20 remove_watcher() i=7 2024-09-19T14:12:17.570 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.570 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:12:17.570 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: a-bucket id: dbb1da81-49d0-421a-b677-974869a7f103.4620.17 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-19T14:12:17.570 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.571 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-19T14:12:17.602 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:12:17.602 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:12:17.645 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.642+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.646 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.646 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 realm 2024-09-19T14:12:17.646 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.647 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.647 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.646+0000 7f308c6d49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:12:17.647 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.647 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.647 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:17.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:12:17.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 searching for the correct realm 2024-09-19T14:12:17.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.654+0000 7f3083fff640 0 -- 172.21.15.153:0/3164683518 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f307c0c3bd0 msgr2=0x7f307c0ef400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:12:17.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.658+0000 7f308a9db640 0 -- 172.21.15.153:0/3164683518 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7f3074094bd0 msgr2=0x7f3074066320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:12:17.667 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:12:17.667 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:12:17.667 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:12:17.667 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:12:17.667 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:12:17.668 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:12:17.668 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.668 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.668 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:17.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:12:17.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 zone default found 2024-09-19T14:12:17.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 4 Realm: () 2024-09-19T14:12:17.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:12:17.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:12:17.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:12:17.669 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 zonegroup default 2024-09-19T14:12:17.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 started sync module instance, tier type = 2024-09-19T14:12:17.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:12:17.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.682+0000 7f308c6d49c0 20 add_watcher() i=0 2024-09-19T14:12:17.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.682+0000 7f308c6d49c0 20 add_watcher() i=1 2024-09-19T14:12:17.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.682+0000 7f308c6d49c0 20 add_watcher() i=2 2024-09-19T14:12:17.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.682+0000 7f308c6d49c0 20 add_watcher() i=3 2024-09-19T14:12:17.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.682+0000 7f308c6d49c0 20 add_watcher() i=4 2024-09-19T14:12:17.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.682+0000 7f308c6d49c0 20 add_watcher() i=5 2024-09-19T14:12:17.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.682+0000 7f308c6d49c0 20 add_watcher() i=6 2024-09-19T14:12:17.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.682+0000 7f308c6d49c0 20 add_watcher() i=7 2024-09-19T14:12:17.685 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.682+0000 7f308c6d49c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:12:17.687 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.686+0000 7f2f417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:12:17.688 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.686+0000 7f308c6d49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:12:17.688 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.686+0000 7f308c6d49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:12:17.688 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 note: GC not initialized 2024-09-19T14:12:17.688 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.686+0000 7f2f3b7fe640 20 reqs_thread_entry: start 2024-09-19T14:12:17.688 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.686+0000 7f308c6d49c0 20 init_complete bucket index max shards: 11 2024-09-19T14:12:17.688 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.686+0000 7f308c6d49c0 20 Filter name: none 2024-09-19T14:12:17.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.686+0000 7f2f397fa640 20 reqs_thread_entry: start 2024-09-19T14:12:17.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:12:17.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.686+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.686+0000 7f308c6d49c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:12:17.690 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:12:17.690 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:12:17.690 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : miss 2024-09-19T14:12:17.690 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.686+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.690 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.686+0000 7f308c6d49c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:12:17.690 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:12:17.690 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:12:17.690 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:12:17.690 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:12:17.690 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:12:17.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.698+0000 7f308c6d49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:12:17.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.698+0000 7f308c6d49c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:12:17.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.698+0000 7f308c6d49c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:12:17.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.698+0000 7f308c6d49c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17, ofs0, ns] 2024-09-19T14:12:17.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.698+0000 7f2f6dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333527 cookie 94313457466496 notifier 8205 bl.length()=827 2024-09-19T14:12:17.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.698+0000 7f2f6dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:12:17.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.698+0000 7f2f6dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:12:17.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.698+0000 7f2f6dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:12:17.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.698+0000 7f308c6d49c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_sources= new_sources= 2024-09-19T14:12:17.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.698+0000 7f308c6d49c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential sources added=[] removed=[] 2024-09-19T14:12:17.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.698+0000 7f308c6d49c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_dests= new_dests= 2024-09-19T14:12:17.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.698+0000 7f308c6d49c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential dests added=[] removed=[] 2024-09-19T14:12:17.713 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f308c6d49c0 time 2024-09-19T14:12:17.714547+0000 2024-09-19T14:12:17.713 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:12:17.714 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:12:17.714 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f308ffae2eb] 2024-09-19T14:12:17.714 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f308ffae49f] 2024-09-19T14:12:17.714 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c70d27e271] 2024-09-19T14:12:17.714 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55c70d28e14a] 2024-09-19T14:12:17.714 INFO:tasks.workunit.client.0.smithi153.stderr: 5: main() 2024-09-19T14:12:17.714 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f308ee14d90] 2024-09-19T14:12:17.714 INFO:tasks.workunit.client.0.smithi153.stderr: 7: __libc_start_main() 2024-09-19T14:12:17.715 INFO:tasks.workunit.client.0.smithi153.stderr: 8: _start() 2024-09-19T14:12:17.715 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.710+0000 7f308c6d49c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f308c6d49c0 time 2024-09-19T14:12:17.714547+0000 2024-09-19T14:12:17.715 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:12:17.715 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.715 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:12:17.715 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f308ffae2eb] 2024-09-19T14:12:17.715 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f308ffae49f] 2024-09-19T14:12:17.715 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c70d27e271] 2024-09-19T14:12:17.715 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55c70d28e14a] 2024-09-19T14:12:17.716 INFO:tasks.workunit.client.0.smithi153.stderr: 5: main() 2024-09-19T14:12:17.716 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f308ee14d90] 2024-09-19T14:12:17.716 INFO:tasks.workunit.client.0.smithi153.stderr: 7: __libc_start_main() 2024-09-19T14:12:17.716 INFO:tasks.workunit.client.0.smithi153.stderr: 8: _start() 2024-09-19T14:12:17.716 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.716 INFO:tasks.workunit.client.0.smithi153.stderr:*** Caught signal (Aborted) ** 2024-09-19T14:12:17.716 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7f308c6d49c0 thread_name:radosgw-admin 2024-09-19T14:12:17.734 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:12:17.734 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f308ee2d520] 2024-09-19T14:12:17.734 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:12:17.734 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:12:17.734 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:12:17.734 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f308ffae345] 2024-09-19T14:12:17.734 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f308ffae49f] 2024-09-19T14:12:17.734 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c70d27e271] 2024-09-19T14:12:17.734 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55c70d28e14a] 2024-09-19T14:12:17.734 INFO:tasks.workunit.client.0.smithi153.stderr: 9: main() 2024-09-19T14:12:17.735 INFO:tasks.workunit.client.0.smithi153.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f308ee14d90] 2024-09-19T14:12:17.735 INFO:tasks.workunit.client.0.smithi153.stderr: 11: __libc_start_main() 2024-09-19T14:12:17.735 INFO:tasks.workunit.client.0.smithi153.stderr: 12: _start() 2024-09-19T14:12:17.735 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.714+0000 7f308c6d49c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:12:17.735 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7f308c6d49c0 thread_name:radosgw-admin 2024-09-19T14:12:17.735 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.735 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:12:17.735 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f308ee2d520] 2024-09-19T14:12:17.735 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:12:17.735 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:12:17.735 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:12:17.735 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f308ffae345] 2024-09-19T14:12:17.735 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f308ffae49f] 2024-09-19T14:12:17.735 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c70d27e271] 2024-09-19T14:12:17.736 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55c70d28e14a] 2024-09-19T14:12:17.736 INFO:tasks.workunit.client.0.smithi153.stderr: 9: main() 2024-09-19T14:12:17.736 INFO:tasks.workunit.client.0.smithi153.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f308ee14d90] 2024-09-19T14:12:17.736 INFO:tasks.workunit.client.0.smithi153.stderr: 11: __libc_start_main() 2024-09-19T14:12:17.736 INFO:tasks.workunit.client.0.smithi153.stderr: 12: _start() 2024-09-19T14:12:17.736 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:12:17.736 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.736 INFO:tasks.workunit.client.0.smithi153.stderr:--- begin dump of recent events --- 2024-09-19T14:12:17.736 INFO:tasks.workunit.client.0.smithi153.stderr: -499> 2024-09-19T14:12:17.622+0000 7f308a9db640 10 monclient: _finish_hunting 0 2024-09-19T14:12:17.736 INFO:tasks.workunit.client.0.smithi153.stderr: -498> 2024-09-19T14:12:17.622+0000 7f308a9db640 1 monclient: found mon.noname-c 2024-09-19T14:12:17.736 INFO:tasks.workunit.client.0.smithi153.stderr: -497> 2024-09-19T14:12:17.622+0000 7f308a9db640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:12:17.736 INFO:tasks.workunit.client.0.smithi153.stderr: -496> 2024-09-19T14:12:17.622+0000 7f2f78608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:17.736 INFO:tasks.workunit.client.0.smithi153.stderr: -495> 2024-09-19T14:12:17.622+0000 7f2f78608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:12:17.736 INFO:tasks.workunit.client.0.smithi153.stderr: -494> 2024-09-19T14:12:17.622+0000 7f2f78608640 10 monclient: dump: 2024-09-19T14:12:17.737 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:17.737 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:17.737 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.737 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.737 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:17.737 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.737 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:17.737 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:17.737 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:17.737 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.738 INFO:tasks.workunit.client.0.smithi153.stderr: -493> 2024-09-19T14:12:17.622+0000 7f2f78608640 10 monclient: _finish_auth 0 2024-09-19T14:12:17.738 INFO:tasks.workunit.client.0.smithi153.stderr: -492> 2024-09-19T14:12:17.622+0000 7f2f78608640 10 monclient: _check_auth_tickets 2024-09-19T14:12:17.738 INFO:tasks.workunit.client.0.smithi153.stderr: -491> 2024-09-19T14:12:17.622+0000 7f2f78608640 10 monclient: handle_config config(0 keys) 2024-09-19T14:12:17.738 INFO:tasks.workunit.client.0.smithi153.stderr: -490> 2024-09-19T14:12:17.622+0000 7f2f78608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:17.738 INFO:tasks.workunit.client.0.smithi153.stderr: -489> 2024-09-19T14:12:17.622+0000 7f2f78608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:12:17.738 INFO:tasks.workunit.client.0.smithi153.stderr: -488> 2024-09-19T14:12:17.622+0000 7f2f78608640 10 monclient: dump: 2024-09-19T14:12:17.738 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:17.738 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:17.738 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.738 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.738 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:17.738 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.738 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:17.738 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:17.739 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:17.739 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.739 INFO:tasks.workunit.client.0.smithi153.stderr: -487> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 monclient: authenticate success, global_id 7670 2024-09-19T14:12:17.739 INFO:tasks.workunit.client.0.smithi153.stderr: -486> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient: get_monmap_and_config success 2024-09-19T14:12:17.739 INFO:tasks.workunit.client.0.smithi153.stderr: -485> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 4 set_mon_vals no callback set 2024-09-19T14:12:17.739 INFO:tasks.workunit.client.0.smithi153.stderr: -484> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient: shutdown 2024-09-19T14:12:17.739 INFO:tasks.workunit.client.0.smithi153.stderr: -483> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) unregister_commands rotate-key 2024-09-19T14:12:17.739 INFO:tasks.workunit.client.0.smithi153.stderr: -482> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient: build_initial_monmap 2024-09-19T14:12:17.739 INFO:tasks.workunit.client.0.smithi153.stderr: -481> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 1 build_initial for_mkfs: 0 2024-09-19T14:12:17.739 INFO:tasks.workunit.client.0.smithi153.stderr: -480> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient: monmap: 2024-09-19T14:12:17.739 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:12:17.739 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:12:17.739 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:12:17.739 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:12:17.740 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:12:17.740 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.740 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:12:17.740 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:12:17.740 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:12:17.740 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.740 INFO:tasks.workunit.client.0.smithi153.stderr: -479> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding auth protocol: cephx 2024-09-19T14:12:17.740 INFO:tasks.workunit.client.0.smithi153.stderr: -478> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding auth protocol: cephx 2024-09-19T14:12:17.740 INFO:tasks.workunit.client.0.smithi153.stderr: -477> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding auth protocol: cephx 2024-09-19T14:12:17.740 INFO:tasks.workunit.client.0.smithi153.stderr: -476> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding con mode: secure 2024-09-19T14:12:17.740 INFO:tasks.workunit.client.0.smithi153.stderr: -475> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding con mode: crc 2024-09-19T14:12:17.740 INFO:tasks.workunit.client.0.smithi153.stderr: -474> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding con mode: secure 2024-09-19T14:12:17.740 INFO:tasks.workunit.client.0.smithi153.stderr: -473> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding con mode: crc 2024-09-19T14:12:17.741 INFO:tasks.workunit.client.0.smithi153.stderr: -472> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding con mode: secure 2024-09-19T14:12:17.741 INFO:tasks.workunit.client.0.smithi153.stderr: -471> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding con mode: crc 2024-09-19T14:12:17.741 INFO:tasks.workunit.client.0.smithi153.stderr: -470> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding con mode: crc 2024-09-19T14:12:17.741 INFO:tasks.workunit.client.0.smithi153.stderr: -469> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding con mode: secure 2024-09-19T14:12:17.741 INFO:tasks.workunit.client.0.smithi153.stderr: -468> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding con mode: crc 2024-09-19T14:12:17.741 INFO:tasks.workunit.client.0.smithi153.stderr: -467> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding con mode: secure 2024-09-19T14:12:17.741 INFO:tasks.workunit.client.0.smithi153.stderr: -466> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding con mode: crc 2024-09-19T14:12:17.741 INFO:tasks.workunit.client.0.smithi153.stderr: -465> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding con mode: secure 2024-09-19T14:12:17.741 INFO:tasks.workunit.client.0.smithi153.stderr: -464> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.741 INFO:tasks.workunit.client.0.smithi153.stderr: -463> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 1 librados: starting msgr at 2024-09-19T14:12:17.744 INFO:tasks.workunit.client.0.smithi153.stderr: -462> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 1 librados: starting objecter 2024-09-19T14:12:17.744 INFO:tasks.workunit.client.0.smithi153.stderr: -461> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command objecter_requests hook 0x55c70fed34b0 2024-09-19T14:12:17.744 INFO:tasks.workunit.client.0.smithi153.stderr: -460> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 1 librados: setting wanted keys 2024-09-19T14:12:17.744 INFO:tasks.workunit.client.0.smithi153.stderr: -459> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 1 librados: calling monclient init 2024-09-19T14:12:17.744 INFO:tasks.workunit.client.0.smithi153.stderr: -458> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient: init 2024-09-19T14:12:17.744 INFO:tasks.workunit.client.0.smithi153.stderr: -457> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding auth protocol: cephx 2024-09-19T14:12:17.744 INFO:tasks.workunit.client.0.smithi153.stderr: -456> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding auth protocol: cephx 2024-09-19T14:12:17.744 INFO:tasks.workunit.client.0.smithi153.stderr: -455> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding auth protocol: cephx 2024-09-19T14:12:17.744 INFO:tasks.workunit.client.0.smithi153.stderr: -454> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding con mode: secure 2024-09-19T14:12:17.744 INFO:tasks.workunit.client.0.smithi153.stderr: -453> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding con mode: crc 2024-09-19T14:12:17.744 INFO:tasks.workunit.client.0.smithi153.stderr: -452> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding con mode: secure 2024-09-19T14:12:17.744 INFO:tasks.workunit.client.0.smithi153.stderr: -451> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding con mode: crc 2024-09-19T14:12:17.745 INFO:tasks.workunit.client.0.smithi153.stderr: -450> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding con mode: secure 2024-09-19T14:12:17.745 INFO:tasks.workunit.client.0.smithi153.stderr: -449> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding con mode: crc 2024-09-19T14:12:17.745 INFO:tasks.workunit.client.0.smithi153.stderr: -448> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding con mode: crc 2024-09-19T14:12:17.745 INFO:tasks.workunit.client.0.smithi153.stderr: -447> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding con mode: secure 2024-09-19T14:12:17.745 INFO:tasks.workunit.client.0.smithi153.stderr: -446> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding con mode: crc 2024-09-19T14:12:17.745 INFO:tasks.workunit.client.0.smithi153.stderr: -445> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding con mode: secure 2024-09-19T14:12:17.745 INFO:tasks.workunit.client.0.smithi153.stderr: -444> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding con mode: crc 2024-09-19T14:12:17.745 INFO:tasks.workunit.client.0.smithi153.stderr: -443> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding con mode: secure 2024-09-19T14:12:17.745 INFO:tasks.workunit.client.0.smithi153.stderr: -442> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.745 INFO:tasks.workunit.client.0.smithi153.stderr: -441> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.745 INFO:tasks.workunit.client.0.smithi153.stderr: -440> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command rotate-key hook 0x55c710115168 2024-09-19T14:12:17.745 INFO:tasks.workunit.client.0.smithi153.stderr: -439> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient: _reopen_session rank -1 2024-09-19T14:12:17.746 INFO:tasks.workunit.client.0.smithi153.stderr: -438> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:12:17.746 INFO:tasks.workunit.client.0.smithi153.stderr: -437> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient(hunting): picked mon.noname-b con 0x55c70ffc4be0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:12:17.746 INFO:tasks.workunit.client.0.smithi153.stderr: -436> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient(hunting): picked mon.noname-a con 0x55c70ffd02e0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:12:17.746 INFO:tasks.workunit.client.0.smithi153.stderr: -435> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient(hunting): picked mon.noname-c con 0x55c71013eca0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:12:17.746 INFO:tasks.workunit.client.0.smithi153.stderr: -434> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:17.746 INFO:tasks.workunit.client.0.smithi153.stderr: -433> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:17.746 INFO:tasks.workunit.client.0.smithi153.stderr: -432> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:17.746 INFO:tasks.workunit.client.0.smithi153.stderr: -431> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient(hunting): _renew_subs 2024-09-19T14:12:17.746 INFO:tasks.workunit.client.0.smithi153.stderr: -430> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient(hunting): authenticate will time out at 2926.087695s 2024-09-19T14:12:17.746 INFO:tasks.workunit.client.0.smithi153.stderr: -429> 2024-09-19T14:12:17.622+0000 7f3083fff640 10 monclient(hunting): get_auth_request con 0x55c70ffd02e0 auth_method 0 2024-09-19T14:12:17.746 INFO:tasks.workunit.client.0.smithi153.stderr: -428> 2024-09-19T14:12:17.622+0000 7f3083fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:17.746 INFO:tasks.workunit.client.0.smithi153.stderr: -427> 2024-09-19T14:12:17.622+0000 7f3083fff640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:17.746 INFO:tasks.workunit.client.0.smithi153.stderr: -426> 2024-09-19T14:12:17.622+0000 7f3083fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:17.746 INFO:tasks.workunit.client.0.smithi153.stderr: -425> 2024-09-19T14:12:17.622+0000 7f308a9db640 10 monclient(hunting): get_auth_request con 0x55c71013eca0 auth_method 0 2024-09-19T14:12:17.747 INFO:tasks.workunit.client.0.smithi153.stderr: -424> 2024-09-19T14:12:17.622+0000 7f308a9db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:17.747 INFO:tasks.workunit.client.0.smithi153.stderr: -423> 2024-09-19T14:12:17.622+0000 7f308a9db640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:17.747 INFO:tasks.workunit.client.0.smithi153.stderr: -422> 2024-09-19T14:12:17.622+0000 7f308a9db640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:17.747 INFO:tasks.workunit.client.0.smithi153.stderr: -421> 2024-09-19T14:12:17.622+0000 7f3083fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:17.747 INFO:tasks.workunit.client.0.smithi153.stderr: -420> 2024-09-19T14:12:17.622+0000 7f3083fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:17.747 INFO:tasks.workunit.client.0.smithi153.stderr: -419> 2024-09-19T14:12:17.622+0000 7f3083fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:17.747 INFO:tasks.workunit.client.0.smithi153.stderr: -418> 2024-09-19T14:12:17.622+0000 7f308a9db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:17.747 INFO:tasks.workunit.client.0.smithi153.stderr: -417> 2024-09-19T14:12:17.622+0000 7f308a9db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:17.747 INFO:tasks.workunit.client.0.smithi153.stderr: -416> 2024-09-19T14:12:17.622+0000 7f308a9db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:17.747 INFO:tasks.workunit.client.0.smithi153.stderr: -415> 2024-09-19T14:12:17.626+0000 7f3083fff640 10 monclient(hunting): handle_auth_done global_id 8196 payload 824 2024-09-19T14:12:17.747 INFO:tasks.workunit.client.0.smithi153.stderr: -414> 2024-09-19T14:12:17.626+0000 7f3083fff640 10 monclient: _finish_hunting 0 2024-09-19T14:12:17.747 INFO:tasks.workunit.client.0.smithi153.stderr: -413> 2024-09-19T14:12:17.626+0000 7f3083fff640 1 monclient: found mon.noname-a 2024-09-19T14:12:17.748 INFO:tasks.workunit.client.0.smithi153.stderr: -412> 2024-09-19T14:12:17.626+0000 7f3083fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:12:17.748 INFO:tasks.workunit.client.0.smithi153.stderr: -411> 2024-09-19T14:12:17.626+0000 7f2f76e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:17.748 INFO:tasks.workunit.client.0.smithi153.stderr: -410> 2024-09-19T14:12:17.626+0000 7f2f76e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:12:17.748 INFO:tasks.workunit.client.0.smithi153.stderr: -409> 2024-09-19T14:12:17.626+0000 7f2f76e05640 10 monclient: dump: 2024-09-19T14:12:17.748 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:17.748 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:17.748 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.748 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.748 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:17.748 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.748 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:17.748 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:17.748 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:17.748 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.749 INFO:tasks.workunit.client.0.smithi153.stderr: -408> 2024-09-19T14:12:17.626+0000 7f2f76e05640 10 monclient: _finish_auth 0 2024-09-19T14:12:17.749 INFO:tasks.workunit.client.0.smithi153.stderr: -407> 2024-09-19T14:12:17.626+0000 7f2f76e05640 10 monclient: _check_auth_tickets 2024-09-19T14:12:17.749 INFO:tasks.workunit.client.0.smithi153.stderr: -406> 2024-09-19T14:12:17.626+0000 7f2f76e05640 10 monclient: handle_config config(0 keys) 2024-09-19T14:12:17.749 INFO:tasks.workunit.client.0.smithi153.stderr: -405> 2024-09-19T14:12:17.626+0000 7f2f76e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:17.749 INFO:tasks.workunit.client.0.smithi153.stderr: -404> 2024-09-19T14:12:17.626+0000 7f2f76e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:12:17.749 INFO:tasks.workunit.client.0.smithi153.stderr: -403> 2024-09-19T14:12:17.626+0000 7f2f76e05640 10 monclient: dump: 2024-09-19T14:12:17.749 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:17.749 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:17.749 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.749 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.749 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:17.749 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.750 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:17.750 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:17.750 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:17.750 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.750 INFO:tasks.workunit.client.0.smithi153.stderr: -402> 2024-09-19T14:12:17.626+0000 7f2f78608640 4 set_mon_vals no callback set 2024-09-19T14:12:17.750 INFO:tasks.workunit.client.0.smithi153.stderr: -401> 2024-09-19T14:12:17.626+0000 7f308c6d49c0 5 monclient: authenticate success, global_id 8196 2024-09-19T14:12:17.750 INFO:tasks.workunit.client.0.smithi153.stderr: -400> 2024-09-19T14:12:17.626+0000 7f308c6d49c0 10 monclient: _renew_subs 2024-09-19T14:12:17.750 INFO:tasks.workunit.client.0.smithi153.stderr: -399> 2024-09-19T14:12:17.626+0000 7f308c6d49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:12:17.750 INFO:tasks.workunit.client.0.smithi153.stderr: -398> 2024-09-19T14:12:17.626+0000 7f308c6d49c0 10 monclient: _renew_subs 2024-09-19T14:12:17.750 INFO:tasks.workunit.client.0.smithi153.stderr: -397> 2024-09-19T14:12:17.626+0000 7f308c6d49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:12:17.750 INFO:tasks.workunit.client.0.smithi153.stderr: -396> 2024-09-19T14:12:17.626+0000 7f308c6d49c0 1 librados: init done 2024-09-19T14:12:17.750 INFO:tasks.workunit.client.0.smithi153.stderr: -395> 2024-09-19T14:12:17.626+0000 7f2f76e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:12:17.750 INFO:tasks.workunit.client.0.smithi153.stderr: -394> 2024-09-19T14:12:17.626+0000 7f2f76e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:12:17.750 INFO:tasks.workunit.client.0.smithi153.stderr: -393> 2024-09-19T14:12:17.626+0000 7f2f76e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:12:17.750 INFO:tasks.workunit.client.0.smithi153.stderr: -392> 2024-09-19T14:12:17.626+0000 7f308a1da640 10 monclient: get_auth_request con 0x7f2f70071be0 auth_method 0 2024-09-19T14:12:17.751 INFO:tasks.workunit.client.0.smithi153.stderr: -391> 2024-09-19T14:12:17.626+0000 7f308a9db640 10 monclient: get_auth_request con 0x55c71013d8c0 auth_method 0 2024-09-19T14:12:17.751 INFO:tasks.workunit.client.0.smithi153.stderr: -390> 2024-09-19T14:12:17.630+0000 7f308a1da640 10 monclient: get_auth_request con 0x55c710161360 auth_method 0 2024-09-19T14:12:17.751 INFO:tasks.workunit.client.0.smithi153.stderr: -389> 2024-09-19T14:12:17.630+0000 7f3083fff640 10 monclient: get_auth_request con 0x55c7101663f0 auth_method 0 2024-09-19T14:12:17.751 INFO:tasks.workunit.client.0.smithi153.stderr: -388> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient: build_initial_monmap 2024-09-19T14:12:17.751 INFO:tasks.workunit.client.0.smithi153.stderr: -387> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 1 build_initial for_mkfs: 0 2024-09-19T14:12:17.751 INFO:tasks.workunit.client.0.smithi153.stderr: -386> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient: monmap: 2024-09-19T14:12:17.751 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:12:17.751 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:12:17.751 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:12:17.751 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:12:17.751 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:12:17.751 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.751 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:12:17.752 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:12:17.752 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:12:17.752 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.752 INFO:tasks.workunit.client.0.smithi153.stderr: -385> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding auth protocol: cephx 2024-09-19T14:12:17.752 INFO:tasks.workunit.client.0.smithi153.stderr: -384> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding auth protocol: cephx 2024-09-19T14:12:17.752 INFO:tasks.workunit.client.0.smithi153.stderr: -383> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding auth protocol: cephx 2024-09-19T14:12:17.752 INFO:tasks.workunit.client.0.smithi153.stderr: -382> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding con mode: secure 2024-09-19T14:12:17.752 INFO:tasks.workunit.client.0.smithi153.stderr: -381> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding con mode: crc 2024-09-19T14:12:17.752 INFO:tasks.workunit.client.0.smithi153.stderr: -380> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding con mode: secure 2024-09-19T14:12:17.752 INFO:tasks.workunit.client.0.smithi153.stderr: -379> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding con mode: crc 2024-09-19T14:12:17.752 INFO:tasks.workunit.client.0.smithi153.stderr: -378> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding con mode: secure 2024-09-19T14:12:17.752 INFO:tasks.workunit.client.0.smithi153.stderr: -377> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding con mode: crc 2024-09-19T14:12:17.752 INFO:tasks.workunit.client.0.smithi153.stderr: -376> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding con mode: crc 2024-09-19T14:12:17.753 INFO:tasks.workunit.client.0.smithi153.stderr: -375> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding con mode: secure 2024-09-19T14:12:17.753 INFO:tasks.workunit.client.0.smithi153.stderr: -374> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding con mode: crc 2024-09-19T14:12:17.753 INFO:tasks.workunit.client.0.smithi153.stderr: -373> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding con mode: secure 2024-09-19T14:12:17.753 INFO:tasks.workunit.client.0.smithi153.stderr: -372> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding con mode: crc 2024-09-19T14:12:17.753 INFO:tasks.workunit.client.0.smithi153.stderr: -371> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding con mode: secure 2024-09-19T14:12:17.753 INFO:tasks.workunit.client.0.smithi153.stderr: -370> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.753 INFO:tasks.workunit.client.0.smithi153.stderr: -369> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command objecter_requests cmddesc objecter_requests hook 0x55c7101700d0 EEXIST 2024-09-19T14:12:17.753 INFO:tasks.workunit.client.0.smithi153.stderr: -368> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient: init 2024-09-19T14:12:17.753 INFO:tasks.workunit.client.0.smithi153.stderr: -367> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding auth protocol: cephx 2024-09-19T14:12:17.753 INFO:tasks.workunit.client.0.smithi153.stderr: -366> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding auth protocol: cephx 2024-09-19T14:12:17.753 INFO:tasks.workunit.client.0.smithi153.stderr: -365> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding auth protocol: cephx 2024-09-19T14:12:17.753 INFO:tasks.workunit.client.0.smithi153.stderr: -364> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding con mode: secure 2024-09-19T14:12:17.753 INFO:tasks.workunit.client.0.smithi153.stderr: -363> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding con mode: crc 2024-09-19T14:12:17.753 INFO:tasks.workunit.client.0.smithi153.stderr: -362> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding con mode: secure 2024-09-19T14:12:17.754 INFO:tasks.workunit.client.0.smithi153.stderr: -361> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding con mode: crc 2024-09-19T14:12:17.754 INFO:tasks.workunit.client.0.smithi153.stderr: -360> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding con mode: secure 2024-09-19T14:12:17.754 INFO:tasks.workunit.client.0.smithi153.stderr: -359> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding con mode: crc 2024-09-19T14:12:17.754 INFO:tasks.workunit.client.0.smithi153.stderr: -358> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding con mode: crc 2024-09-19T14:12:17.754 INFO:tasks.workunit.client.0.smithi153.stderr: -357> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding con mode: secure 2024-09-19T14:12:17.754 INFO:tasks.workunit.client.0.smithi153.stderr: -356> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding con mode: crc 2024-09-19T14:12:17.754 INFO:tasks.workunit.client.0.smithi153.stderr: -355> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding con mode: secure 2024-09-19T14:12:17.754 INFO:tasks.workunit.client.0.smithi153.stderr: -354> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding con mode: crc 2024-09-19T14:12:17.754 INFO:tasks.workunit.client.0.smithi153.stderr: -353> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding con mode: secure 2024-09-19T14:12:17.754 INFO:tasks.workunit.client.0.smithi153.stderr: -352> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.754 INFO:tasks.workunit.client.0.smithi153.stderr: -351> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.754 INFO:tasks.workunit.client.0.smithi153.stderr: -350> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command rotate-key cmddesc rotate-key hook 0x55c7101695b0 EEXIST 2024-09-19T14:12:17.754 INFO:tasks.workunit.client.0.smithi153.stderr: -349> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient: _reopen_session rank -1 2024-09-19T14:12:17.754 INFO:tasks.workunit.client.0.smithi153.stderr: -348> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T14:12:17.755 INFO:tasks.workunit.client.0.smithi153.stderr: -347> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient(hunting): picked mon.noname-c con 0x55c710193d90 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:12:17.755 INFO:tasks.workunit.client.0.smithi153.stderr: -346> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient(hunting): picked mon.noname-b con 0x55c710195f30 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:12:17.755 INFO:tasks.workunit.client.0.smithi153.stderr: -345> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient(hunting): picked mon.noname-a con 0x55c710192590 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:12:17.755 INFO:tasks.workunit.client.0.smithi153.stderr: -344> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:17.755 INFO:tasks.workunit.client.0.smithi153.stderr: -343> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:17.755 INFO:tasks.workunit.client.0.smithi153.stderr: -342> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:17.755 INFO:tasks.workunit.client.0.smithi153.stderr: -341> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient(hunting): _renew_subs 2024-09-19T14:12:17.755 INFO:tasks.workunit.client.0.smithi153.stderr: -340> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient(hunting): authenticate will time out at 2926.097610s 2024-09-19T14:12:17.755 INFO:tasks.workunit.client.0.smithi153.stderr: -339> 2024-09-19T14:12:17.634+0000 7f308a1da640 10 monclient(hunting): get_auth_request con 0x55c710193d90 auth_method 0 2024-09-19T14:12:17.755 INFO:tasks.workunit.client.0.smithi153.stderr: -338> 2024-09-19T14:12:17.634+0000 7f308a1da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:17.755 INFO:tasks.workunit.client.0.smithi153.stderr: -337> 2024-09-19T14:12:17.634+0000 7f308a1da640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:17.755 INFO:tasks.workunit.client.0.smithi153.stderr: -336> 2024-09-19T14:12:17.634+0000 7f308a1da640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:17.755 INFO:tasks.workunit.client.0.smithi153.stderr: -335> 2024-09-19T14:12:17.634+0000 7f308a9db640 10 monclient(hunting): get_auth_request con 0x55c710192590 auth_method 0 2024-09-19T14:12:17.755 INFO:tasks.workunit.client.0.smithi153.stderr: -334> 2024-09-19T14:12:17.634+0000 7f308a9db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:17.755 INFO:tasks.workunit.client.0.smithi153.stderr: -333> 2024-09-19T14:12:17.634+0000 7f308a9db640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:17.756 INFO:tasks.workunit.client.0.smithi153.stderr: -332> 2024-09-19T14:12:17.634+0000 7f308a9db640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:17.756 INFO:tasks.workunit.client.0.smithi153.stderr: -331> 2024-09-19T14:12:17.634+0000 7f308a1da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:17.756 INFO:tasks.workunit.client.0.smithi153.stderr: -330> 2024-09-19T14:12:17.634+0000 7f308a1da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:17.756 INFO:tasks.workunit.client.0.smithi153.stderr: -329> 2024-09-19T14:12:17.634+0000 7f308a1da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:17.756 INFO:tasks.workunit.client.0.smithi153.stderr: -328> 2024-09-19T14:12:17.634+0000 7f308a9db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:17.756 INFO:tasks.workunit.client.0.smithi153.stderr: -327> 2024-09-19T14:12:17.634+0000 7f308a9db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:17.756 INFO:tasks.workunit.client.0.smithi153.stderr: -326> 2024-09-19T14:12:17.634+0000 7f308a9db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:17.756 INFO:tasks.workunit.client.0.smithi153.stderr: -325> 2024-09-19T14:12:17.634+0000 7f308a9db640 10 monclient(hunting): handle_auth_done global_id 8199 payload 824 2024-09-19T14:12:17.756 INFO:tasks.workunit.client.0.smithi153.stderr: -324> 2024-09-19T14:12:17.634+0000 7f308a9db640 10 monclient: _finish_hunting 0 2024-09-19T14:12:17.756 INFO:tasks.workunit.client.0.smithi153.stderr: -323> 2024-09-19T14:12:17.634+0000 7f308a9db640 1 monclient: found mon.noname-a 2024-09-19T14:12:17.756 INFO:tasks.workunit.client.0.smithi153.stderr: -322> 2024-09-19T14:12:17.634+0000 7f308a9db640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:12:17.756 INFO:tasks.workunit.client.0.smithi153.stderr: -321> 2024-09-19T14:12:17.634+0000 7f2f6ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:17.756 INFO:tasks.workunit.client.0.smithi153.stderr: -320> 2024-09-19T14:12:17.634+0000 7f2f6ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:12:17.756 INFO:tasks.workunit.client.0.smithi153.stderr: -319> 2024-09-19T14:12:17.634+0000 7f2f6ffff640 10 monclient: dump: 2024-09-19T14:12:17.757 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:17.757 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:17.757 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.757 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.757 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:17.757 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.757 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:17.757 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:17.757 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:17.757 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.757 INFO:tasks.workunit.client.0.smithi153.stderr: -318> 2024-09-19T14:12:17.634+0000 7f2f6ffff640 10 monclient: _finish_auth 0 2024-09-19T14:12:17.757 INFO:tasks.workunit.client.0.smithi153.stderr: -317> 2024-09-19T14:12:17.634+0000 7f2f6ffff640 10 monclient: _check_auth_tickets 2024-09-19T14:12:17.758 INFO:tasks.workunit.client.0.smithi153.stderr: -316> 2024-09-19T14:12:17.634+0000 7f2f6ffff640 10 monclient: handle_config config(0 keys) 2024-09-19T14:12:17.758 INFO:tasks.workunit.client.0.smithi153.stderr: -315> 2024-09-19T14:12:17.634+0000 7f2f6ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:17.758 INFO:tasks.workunit.client.0.smithi153.stderr: -314> 2024-09-19T14:12:17.634+0000 7f2f6ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:12:17.758 INFO:tasks.workunit.client.0.smithi153.stderr: -313> 2024-09-19T14:12:17.634+0000 7f2f6ffff640 10 monclient: dump: 2024-09-19T14:12:17.758 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:17.758 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:17.758 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.758 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.758 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:17.758 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.758 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:17.758 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:17.758 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:17.758 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.759 INFO:tasks.workunit.client.0.smithi153.stderr: -312> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 monclient: authenticate success, global_id 8199 2024-09-19T14:12:17.759 INFO:tasks.workunit.client.0.smithi153.stderr: -311> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient: _renew_subs 2024-09-19T14:12:17.759 INFO:tasks.workunit.client.0.smithi153.stderr: -310> 2024-09-19T14:12:17.634+0000 7f308b1dc640 4 set_mon_vals no callback set 2024-09-19T14:12:17.759 INFO:tasks.workunit.client.0.smithi153.stderr: -309> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:12:17.759 INFO:tasks.workunit.client.0.smithi153.stderr: -308> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient: _renew_subs 2024-09-19T14:12:17.759 INFO:tasks.workunit.client.0.smithi153.stderr: -307> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:12:17.759 INFO:tasks.workunit.client.0.smithi153.stderr: -306> 2024-09-19T14:12:17.638+0000 7f2f6ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:12:17.759 INFO:tasks.workunit.client.0.smithi153.stderr: -305> 2024-09-19T14:12:17.638+0000 7f2f6ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:12:17.759 INFO:tasks.workunit.client.0.smithi153.stderr: -304> 2024-09-19T14:12:17.638+0000 7f2f6ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:12:17.759 INFO:tasks.workunit.client.0.smithi153.stderr: -303> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient: get_monmap_and_config 2024-09-19T14:12:17.759 INFO:tasks.workunit.client.0.smithi153.stderr: -302> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient: build_initial_monmap 2024-09-19T14:12:17.759 INFO:tasks.workunit.client.0.smithi153.stderr: -301> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 1 build_initial for_mkfs: 0 2024-09-19T14:12:17.759 INFO:tasks.workunit.client.0.smithi153.stderr: -300> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient: monmap: 2024-09-19T14:12:17.759 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:12:17.759 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:12:17.760 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:12:17.760 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:12:17.760 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:12:17.760 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.760 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:12:17.760 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:12:17.760 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:12:17.760 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.760 INFO:tasks.workunit.client.0.smithi153.stderr: -299> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding auth protocol: cephx 2024-09-19T14:12:17.760 INFO:tasks.workunit.client.0.smithi153.stderr: -298> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding auth protocol: cephx 2024-09-19T14:12:17.760 INFO:tasks.workunit.client.0.smithi153.stderr: -297> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding auth protocol: cephx 2024-09-19T14:12:17.760 INFO:tasks.workunit.client.0.smithi153.stderr: -296> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding con mode: secure 2024-09-19T14:12:17.760 INFO:tasks.workunit.client.0.smithi153.stderr: -295> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding con mode: crc 2024-09-19T14:12:17.760 INFO:tasks.workunit.client.0.smithi153.stderr: -294> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding con mode: secure 2024-09-19T14:12:17.761 INFO:tasks.workunit.client.0.smithi153.stderr: -293> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding con mode: crc 2024-09-19T14:12:17.761 INFO:tasks.workunit.client.0.smithi153.stderr: -292> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding con mode: secure 2024-09-19T14:12:17.761 INFO:tasks.workunit.client.0.smithi153.stderr: -291> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding con mode: crc 2024-09-19T14:12:17.761 INFO:tasks.workunit.client.0.smithi153.stderr: -290> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding con mode: crc 2024-09-19T14:12:17.761 INFO:tasks.workunit.client.0.smithi153.stderr: -289> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding con mode: secure 2024-09-19T14:12:17.761 INFO:tasks.workunit.client.0.smithi153.stderr: -288> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding con mode: crc 2024-09-19T14:12:17.761 INFO:tasks.workunit.client.0.smithi153.stderr: -287> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding con mode: secure 2024-09-19T14:12:17.761 INFO:tasks.workunit.client.0.smithi153.stderr: -286> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding con mode: crc 2024-09-19T14:12:17.761 INFO:tasks.workunit.client.0.smithi153.stderr: -285> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding con mode: secure 2024-09-19T14:12:17.761 INFO:tasks.workunit.client.0.smithi153.stderr: -284> 2024-09-19T14:12:17.638+0000 7f308a1da640 10 monclient: get_auth_request con 0x7f2f64071af0 auth_method 0 2024-09-19T14:12:17.761 INFO:tasks.workunit.client.0.smithi153.stderr: -283> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.761 INFO:tasks.workunit.client.0.smithi153.stderr: -282> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient: init 2024-09-19T14:12:17.762 INFO:tasks.workunit.client.0.smithi153.stderr: -281> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding auth protocol: cephx 2024-09-19T14:12:17.762 INFO:tasks.workunit.client.0.smithi153.stderr: -280> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding auth protocol: cephx 2024-09-19T14:12:17.762 INFO:tasks.workunit.client.0.smithi153.stderr: -279> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding auth protocol: cephx 2024-09-19T14:12:17.762 INFO:tasks.workunit.client.0.smithi153.stderr: -278> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding con mode: secure 2024-09-19T14:12:17.762 INFO:tasks.workunit.client.0.smithi153.stderr: -277> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding con mode: crc 2024-09-19T14:12:17.762 INFO:tasks.workunit.client.0.smithi153.stderr: -276> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding con mode: secure 2024-09-19T14:12:17.762 INFO:tasks.workunit.client.0.smithi153.stderr: -275> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding con mode: crc 2024-09-19T14:12:17.762 INFO:tasks.workunit.client.0.smithi153.stderr: -274> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding con mode: secure 2024-09-19T14:12:17.762 INFO:tasks.workunit.client.0.smithi153.stderr: -273> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding con mode: crc 2024-09-19T14:12:17.762 INFO:tasks.workunit.client.0.smithi153.stderr: -272> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding con mode: crc 2024-09-19T14:12:17.762 INFO:tasks.workunit.client.0.smithi153.stderr: -271> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding con mode: secure 2024-09-19T14:12:17.762 INFO:tasks.workunit.client.0.smithi153.stderr: -270> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding con mode: crc 2024-09-19T14:12:17.762 INFO:tasks.workunit.client.0.smithi153.stderr: -269> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding con mode: secure 2024-09-19T14:12:17.762 INFO:tasks.workunit.client.0.smithi153.stderr: -268> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding con mode: crc 2024-09-19T14:12:17.762 INFO:tasks.workunit.client.0.smithi153.stderr: -267> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding con mode: secure 2024-09-19T14:12:17.763 INFO:tasks.workunit.client.0.smithi153.stderr: -266> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.763 INFO:tasks.workunit.client.0.smithi153.stderr: -265> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.763 INFO:tasks.workunit.client.0.smithi153.stderr: -264> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command rotate-key cmddesc rotate-key hook 0x7ffcba449c78 EEXIST 2024-09-19T14:12:17.763 INFO:tasks.workunit.client.0.smithi153.stderr: -263> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient: _reopen_session rank -1 2024-09-19T14:12:17.763 INFO:tasks.workunit.client.0.smithi153.stderr: -262> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:12:17.763 INFO:tasks.workunit.client.0.smithi153.stderr: -261> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient(hunting): picked mon.noname-b con 0x55c7101e7f50 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:12:17.763 INFO:tasks.workunit.client.0.smithi153.stderr: -260> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient(hunting): picked mon.noname-a con 0x55c7101b7970 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:12:17.763 INFO:tasks.workunit.client.0.smithi153.stderr: -259> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient(hunting): picked mon.noname-c con 0x55c7101e3720 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:12:17.763 INFO:tasks.workunit.client.0.smithi153.stderr: -258> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:17.763 INFO:tasks.workunit.client.0.smithi153.stderr: -257> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:17.763 INFO:tasks.workunit.client.0.smithi153.stderr: -256> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:17.763 INFO:tasks.workunit.client.0.smithi153.stderr: -255> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient(hunting): _renew_subs 2024-09-19T14:12:17.763 INFO:tasks.workunit.client.0.smithi153.stderr: -254> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient(hunting): authenticate will time out at 2926.101759s 2024-09-19T14:12:17.763 INFO:tasks.workunit.client.0.smithi153.stderr: -253> 2024-09-19T14:12:17.638+0000 7f308a9db640 10 monclient(hunting): get_auth_request con 0x55c7101e3720 auth_method 0 2024-09-19T14:12:17.764 INFO:tasks.workunit.client.0.smithi153.stderr: -252> 2024-09-19T14:12:17.638+0000 7f308a9db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:17.764 INFO:tasks.workunit.client.0.smithi153.stderr: -251> 2024-09-19T14:12:17.638+0000 7f308a9db640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:17.764 INFO:tasks.workunit.client.0.smithi153.stderr: -250> 2024-09-19T14:12:17.638+0000 7f308a9db640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:17.764 INFO:tasks.workunit.client.0.smithi153.stderr: -249> 2024-09-19T14:12:17.638+0000 7f3083fff640 10 monclient(hunting): get_auth_request con 0x55c7101b7970 auth_method 0 2024-09-19T14:12:17.764 INFO:tasks.workunit.client.0.smithi153.stderr: -248> 2024-09-19T14:12:17.638+0000 7f3083fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:17.764 INFO:tasks.workunit.client.0.smithi153.stderr: -247> 2024-09-19T14:12:17.638+0000 7f3083fff640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:17.764 INFO:tasks.workunit.client.0.smithi153.stderr: -246> 2024-09-19T14:12:17.638+0000 7f3083fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:17.764 INFO:tasks.workunit.client.0.smithi153.stderr: -245> 2024-09-19T14:12:17.638+0000 7f308a9db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:17.764 INFO:tasks.workunit.client.0.smithi153.stderr: -244> 2024-09-19T14:12:17.638+0000 7f308a9db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:17.764 INFO:tasks.workunit.client.0.smithi153.stderr: -243> 2024-09-19T14:12:17.638+0000 7f308a9db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:17.764 INFO:tasks.workunit.client.0.smithi153.stderr: -242> 2024-09-19T14:12:17.638+0000 7f3083fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:17.764 INFO:tasks.workunit.client.0.smithi153.stderr: -241> 2024-09-19T14:12:17.638+0000 7f3083fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:17.764 INFO:tasks.workunit.client.0.smithi153.stderr: -240> 2024-09-19T14:12:17.638+0000 7f3083fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:17.764 INFO:tasks.workunit.client.0.smithi153.stderr: -239> 2024-09-19T14:12:17.638+0000 7f308a1da640 10 monclient(hunting): get_auth_request con 0x55c7101e7f50 auth_method 0 2024-09-19T14:12:17.765 INFO:tasks.workunit.client.0.smithi153.stderr: -238> 2024-09-19T14:12:17.638+0000 7f308a1da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:17.765 INFO:tasks.workunit.client.0.smithi153.stderr: -237> 2024-09-19T14:12:17.638+0000 7f308a1da640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:17.765 INFO:tasks.workunit.client.0.smithi153.stderr: -236> 2024-09-19T14:12:17.638+0000 7f308a1da640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:17.765 INFO:tasks.workunit.client.0.smithi153.stderr: -235> 2024-09-19T14:12:17.638+0000 7f3083fff640 10 monclient(hunting): handle_auth_done global_id 8202 payload 274 2024-09-19T14:12:17.765 INFO:tasks.workunit.client.0.smithi153.stderr: -234> 2024-09-19T14:12:17.638+0000 7f3083fff640 10 monclient: _finish_hunting 0 2024-09-19T14:12:17.765 INFO:tasks.workunit.client.0.smithi153.stderr: -233> 2024-09-19T14:12:17.638+0000 7f3083fff640 1 monclient: found mon.noname-a 2024-09-19T14:12:17.765 INFO:tasks.workunit.client.0.smithi153.stderr: -232> 2024-09-19T14:12:17.638+0000 7f3083fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:12:17.765 INFO:tasks.workunit.client.0.smithi153.stderr: -231> 2024-09-19T14:12:17.638+0000 7f2f6dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:17.765 INFO:tasks.workunit.client.0.smithi153.stderr: -230> 2024-09-19T14:12:17.638+0000 7f2f6dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:12:17.765 INFO:tasks.workunit.client.0.smithi153.stderr: -229> 2024-09-19T14:12:17.638+0000 7f2f6dffb640 10 monclient: dump: 2024-09-19T14:12:17.765 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:17.765 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:17.765 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.766 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.766 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:17.766 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.766 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:17.766 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:17.766 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:17.766 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.766 INFO:tasks.workunit.client.0.smithi153.stderr: -228> 2024-09-19T14:12:17.638+0000 7f2f6dffb640 10 monclient: _finish_auth 0 2024-09-19T14:12:17.766 INFO:tasks.workunit.client.0.smithi153.stderr: -227> 2024-09-19T14:12:17.638+0000 7f2f6dffb640 10 monclient: _check_auth_tickets 2024-09-19T14:12:17.766 INFO:tasks.workunit.client.0.smithi153.stderr: -226> 2024-09-19T14:12:17.638+0000 7f2f6dffb640 10 monclient: handle_config config(0 keys) 2024-09-19T14:12:17.766 INFO:tasks.workunit.client.0.smithi153.stderr: -225> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 monclient: authenticate success, global_id 8202 2024-09-19T14:12:17.766 INFO:tasks.workunit.client.0.smithi153.stderr: -224> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient: get_monmap_and_config success 2024-09-19T14:12:17.766 INFO:tasks.workunit.client.0.smithi153.stderr: -223> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 4 set_mon_vals no callback set 2024-09-19T14:12:17.766 INFO:tasks.workunit.client.0.smithi153.stderr: -222> 2024-09-19T14:12:17.638+0000 7f2f6dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:17.767 INFO:tasks.workunit.client.0.smithi153.stderr: -221> 2024-09-19T14:12:17.638+0000 7f2f6dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:12:17.767 INFO:tasks.workunit.client.0.smithi153.stderr: -220> 2024-09-19T14:12:17.638+0000 7f2f6dffb640 10 monclient: dump: 2024-09-19T14:12:17.767 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:17.767 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:17.767 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.767 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.767 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:17.767 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.767 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:17.767 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:17.767 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:17.767 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.767 INFO:tasks.workunit.client.0.smithi153.stderr: -219> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient: shutdown 2024-09-19T14:12:17.767 INFO:tasks.workunit.client.0.smithi153.stderr: -218> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient: build_initial_monmap 2024-09-19T14:12:17.768 INFO:tasks.workunit.client.0.smithi153.stderr: -217> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 1 build_initial for_mkfs: 0 2024-09-19T14:12:17.768 INFO:tasks.workunit.client.0.smithi153.stderr: -216> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient: monmap: 2024-09-19T14:12:17.768 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:12:17.768 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:12:17.768 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:12:17.768 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:12:17.768 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:12:17.768 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.768 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:12:17.768 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:12:17.768 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:12:17.768 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.768 INFO:tasks.workunit.client.0.smithi153.stderr: -215> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding auth protocol: cephx 2024-09-19T14:12:17.769 INFO:tasks.workunit.client.0.smithi153.stderr: -214> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding auth protocol: cephx 2024-09-19T14:12:17.769 INFO:tasks.workunit.client.0.smithi153.stderr: -213> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding auth protocol: cephx 2024-09-19T14:12:17.769 INFO:tasks.workunit.client.0.smithi153.stderr: -212> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding con mode: secure 2024-09-19T14:12:17.769 INFO:tasks.workunit.client.0.smithi153.stderr: -211> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding con mode: crc 2024-09-19T14:12:17.769 INFO:tasks.workunit.client.0.smithi153.stderr: -210> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding con mode: secure 2024-09-19T14:12:17.769 INFO:tasks.workunit.client.0.smithi153.stderr: -209> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding con mode: crc 2024-09-19T14:12:17.769 INFO:tasks.workunit.client.0.smithi153.stderr: -208> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding con mode: secure 2024-09-19T14:12:17.769 INFO:tasks.workunit.client.0.smithi153.stderr: -207> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding con mode: crc 2024-09-19T14:12:17.769 INFO:tasks.workunit.client.0.smithi153.stderr: -206> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding con mode: crc 2024-09-19T14:12:17.769 INFO:tasks.workunit.client.0.smithi153.stderr: -205> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding con mode: secure 2024-09-19T14:12:17.769 INFO:tasks.workunit.client.0.smithi153.stderr: -204> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding con mode: crc 2024-09-19T14:12:17.769 INFO:tasks.workunit.client.0.smithi153.stderr: -203> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding con mode: secure 2024-09-19T14:12:17.769 INFO:tasks.workunit.client.0.smithi153.stderr: -202> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding con mode: crc 2024-09-19T14:12:17.770 INFO:tasks.workunit.client.0.smithi153.stderr: -201> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding con mode: secure 2024-09-19T14:12:17.770 INFO:tasks.workunit.client.0.smithi153.stderr: -200> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.770 INFO:tasks.workunit.client.0.smithi153.stderr: -199> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 1 librados: starting msgr at 2024-09-19T14:12:17.770 INFO:tasks.workunit.client.0.smithi153.stderr: -198> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 1 librados: starting objecter 2024-09-19T14:12:17.770 INFO:tasks.workunit.client.0.smithi153.stderr: -197> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command objecter_requests cmddesc objecter_requests hook 0x55c7101e20a0 EEXIST 2024-09-19T14:12:17.770 INFO:tasks.workunit.client.0.smithi153.stderr: -196> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 1 librados: setting wanted keys 2024-09-19T14:12:17.770 INFO:tasks.workunit.client.0.smithi153.stderr: -195> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 1 librados: calling monclient init 2024-09-19T14:12:17.770 INFO:tasks.workunit.client.0.smithi153.stderr: -194> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient: init 2024-09-19T14:12:17.770 INFO:tasks.workunit.client.0.smithi153.stderr: -193> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding auth protocol: cephx 2024-09-19T14:12:17.770 INFO:tasks.workunit.client.0.smithi153.stderr: -192> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding auth protocol: cephx 2024-09-19T14:12:17.770 INFO:tasks.workunit.client.0.smithi153.stderr: -191> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding auth protocol: cephx 2024-09-19T14:12:17.770 INFO:tasks.workunit.client.0.smithi153.stderr: -190> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding con mode: secure 2024-09-19T14:12:17.770 INFO:tasks.workunit.client.0.smithi153.stderr: -189> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding con mode: crc 2024-09-19T14:12:17.770 INFO:tasks.workunit.client.0.smithi153.stderr: -188> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding con mode: secure 2024-09-19T14:12:17.771 INFO:tasks.workunit.client.0.smithi153.stderr: -187> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding con mode: crc 2024-09-19T14:12:17.771 INFO:tasks.workunit.client.0.smithi153.stderr: -186> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding con mode: secure 2024-09-19T14:12:17.771 INFO:tasks.workunit.client.0.smithi153.stderr: -185> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding con mode: crc 2024-09-19T14:12:17.771 INFO:tasks.workunit.client.0.smithi153.stderr: -184> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding con mode: crc 2024-09-19T14:12:17.771 INFO:tasks.workunit.client.0.smithi153.stderr: -183> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding con mode: secure 2024-09-19T14:12:17.771 INFO:tasks.workunit.client.0.smithi153.stderr: -182> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding con mode: crc 2024-09-19T14:12:17.771 INFO:tasks.workunit.client.0.smithi153.stderr: -181> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding con mode: secure 2024-09-19T14:12:17.771 INFO:tasks.workunit.client.0.smithi153.stderr: -180> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding con mode: crc 2024-09-19T14:12:17.771 INFO:tasks.workunit.client.0.smithi153.stderr: -179> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding con mode: secure 2024-09-19T14:12:17.771 INFO:tasks.workunit.client.0.smithi153.stderr: -178> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.771 INFO:tasks.workunit.client.0.smithi153.stderr: -177> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.772 INFO:tasks.workunit.client.0.smithi153.stderr: -176> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command rotate-key cmddesc rotate-key hook 0x55c7101abc58 EEXIST 2024-09-19T14:12:17.772 INFO:tasks.workunit.client.0.smithi153.stderr: -175> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient: _reopen_session rank -1 2024-09-19T14:12:17.772 INFO:tasks.workunit.client.0.smithi153.stderr: -174> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:12:17.772 INFO:tasks.workunit.client.0.smithi153.stderr: -173> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient(hunting): picked mon.noname-b con 0x55c7101b7970 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:12:17.772 INFO:tasks.workunit.client.0.smithi153.stderr: -172> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient(hunting): picked mon.noname-a con 0x55c7101e3720 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:12:17.772 INFO:tasks.workunit.client.0.smithi153.stderr: -171> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient(hunting): picked mon.noname-c con 0x55c7101e7f50 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:12:17.772 INFO:tasks.workunit.client.0.smithi153.stderr: -170> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:17.772 INFO:tasks.workunit.client.0.smithi153.stderr: -169> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:17.772 INFO:tasks.workunit.client.0.smithi153.stderr: -168> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:17.772 INFO:tasks.workunit.client.0.smithi153.stderr: -167> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient(hunting): _renew_subs 2024-09-19T14:12:17.772 INFO:tasks.workunit.client.0.smithi153.stderr: -166> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient(hunting): authenticate will time out at 2926.104324s 2024-09-19T14:12:17.772 INFO:tasks.workunit.client.0.smithi153.stderr: -165> 2024-09-19T14:12:17.642+0000 7f3083fff640 10 monclient(hunting): get_auth_request con 0x55c7101e3720 auth_method 0 2024-09-19T14:12:17.772 INFO:tasks.workunit.client.0.smithi153.stderr: -164> 2024-09-19T14:12:17.642+0000 7f3083fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:17.772 INFO:tasks.workunit.client.0.smithi153.stderr: -163> 2024-09-19T14:12:17.642+0000 7f3083fff640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:17.773 INFO:tasks.workunit.client.0.smithi153.stderr: -162> 2024-09-19T14:12:17.642+0000 7f3083fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:17.773 INFO:tasks.workunit.client.0.smithi153.stderr: -161> 2024-09-19T14:12:17.642+0000 7f308a9db640 10 monclient(hunting): get_auth_request con 0x55c7101e7f50 auth_method 0 2024-09-19T14:12:17.773 INFO:tasks.workunit.client.0.smithi153.stderr: -160> 2024-09-19T14:12:17.642+0000 7f308a9db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:17.773 INFO:tasks.workunit.client.0.smithi153.stderr: -159> 2024-09-19T14:12:17.642+0000 7f308a9db640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:17.773 INFO:tasks.workunit.client.0.smithi153.stderr: -158> 2024-09-19T14:12:17.642+0000 7f308a9db640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:17.773 INFO:tasks.workunit.client.0.smithi153.stderr: -157> 2024-09-19T14:12:17.642+0000 7f3083fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:17.773 INFO:tasks.workunit.client.0.smithi153.stderr: -156> 2024-09-19T14:12:17.642+0000 7f3083fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:17.773 INFO:tasks.workunit.client.0.smithi153.stderr: -155> 2024-09-19T14:12:17.642+0000 7f3083fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:17.773 INFO:tasks.workunit.client.0.smithi153.stderr: -154> 2024-09-19T14:12:17.642+0000 7f308a9db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:17.773 INFO:tasks.workunit.client.0.smithi153.stderr: -153> 2024-09-19T14:12:17.642+0000 7f308a9db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:17.773 INFO:tasks.workunit.client.0.smithi153.stderr: -152> 2024-09-19T14:12:17.642+0000 7f308a9db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:17.773 INFO:tasks.workunit.client.0.smithi153.stderr: -151> 2024-09-19T14:12:17.642+0000 7f308a1da640 10 monclient(hunting): get_auth_request con 0x55c7101b7970 auth_method 0 2024-09-19T14:12:17.773 INFO:tasks.workunit.client.0.smithi153.stderr: -150> 2024-09-19T14:12:17.642+0000 7f308a1da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:17.773 INFO:tasks.workunit.client.0.smithi153.stderr: -149> 2024-09-19T14:12:17.642+0000 7f308a1da640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:17.774 INFO:tasks.workunit.client.0.smithi153.stderr: -148> 2024-09-19T14:12:17.642+0000 7f308a1da640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:17.774 INFO:tasks.workunit.client.0.smithi153.stderr: -147> 2024-09-19T14:12:17.642+0000 7f3083fff640 10 monclient(hunting): handle_auth_done global_id 8205 payload 824 2024-09-19T14:12:17.774 INFO:tasks.workunit.client.0.smithi153.stderr: -146> 2024-09-19T14:12:17.642+0000 7f3083fff640 10 monclient: _finish_hunting 0 2024-09-19T14:12:17.774 INFO:tasks.workunit.client.0.smithi153.stderr: -145> 2024-09-19T14:12:17.642+0000 7f3083fff640 1 monclient: found mon.noname-a 2024-09-19T14:12:17.774 INFO:tasks.workunit.client.0.smithi153.stderr: -144> 2024-09-19T14:12:17.642+0000 7f3083fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:12:17.774 INFO:tasks.workunit.client.0.smithi153.stderr: -143> 2024-09-19T14:12:17.642+0000 7f2f5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:17.774 INFO:tasks.workunit.client.0.smithi153.stderr: -142> 2024-09-19T14:12:17.642+0000 7f2f5bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:12:17.774 INFO:tasks.workunit.client.0.smithi153.stderr: -141> 2024-09-19T14:12:17.642+0000 7f2f5bfff640 10 monclient: dump: 2024-09-19T14:12:17.774 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:17.774 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:17.774 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.774 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.774 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:17.774 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.774 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:17.775 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:17.775 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:17.775 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.775 INFO:tasks.workunit.client.0.smithi153.stderr: -140> 2024-09-19T14:12:17.642+0000 7f2f5bfff640 10 monclient: _finish_auth 0 2024-09-19T14:12:17.775 INFO:tasks.workunit.client.0.smithi153.stderr: -139> 2024-09-19T14:12:17.642+0000 7f2f5bfff640 10 monclient: _check_auth_tickets 2024-09-19T14:12:17.775 INFO:tasks.workunit.client.0.smithi153.stderr: -138> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 5 monclient: authenticate success, global_id 8205 2024-09-19T14:12:17.775 INFO:tasks.workunit.client.0.smithi153.stderr: -137> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient: _renew_subs 2024-09-19T14:12:17.775 INFO:tasks.workunit.client.0.smithi153.stderr: -136> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:12:17.775 INFO:tasks.workunit.client.0.smithi153.stderr: -135> 2024-09-19T14:12:17.642+0000 7f2f5bfff640 10 monclient: handle_config config(0 keys) 2024-09-19T14:12:17.775 INFO:tasks.workunit.client.0.smithi153.stderr: -134> 2024-09-19T14:12:17.642+0000 7f2f6dffb640 4 set_mon_vals no callback set 2024-09-19T14:12:17.775 INFO:tasks.workunit.client.0.smithi153.stderr: -133> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient: _renew_subs 2024-09-19T14:12:17.775 INFO:tasks.workunit.client.0.smithi153.stderr: -132> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:12:17.775 INFO:tasks.workunit.client.0.smithi153.stderr: -131> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 1 librados: init done 2024-09-19T14:12:17.776 INFO:tasks.workunit.client.0.smithi153.stderr: -130> 2024-09-19T14:12:17.642+0000 7f2f5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:17.776 INFO:tasks.workunit.client.0.smithi153.stderr: -129> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command cr dump hook 0x55c7101d89c8 2024-09-19T14:12:17.776 INFO:tasks.workunit.client.0.smithi153.stderr: -128> 2024-09-19T14:12:17.642+0000 7f2f5bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:12:17.776 INFO:tasks.workunit.client.0.smithi153.stderr: -127> 2024-09-19T14:12:17.642+0000 7f2f5bfff640 10 monclient: dump: 2024-09-19T14:12:17.776 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:17.776 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:17.776 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.776 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.776 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:17.776 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.776 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:17.776 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:17.776 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:17.776 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.777 INFO:tasks.workunit.client.0.smithi153.stderr: -126> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.777 INFO:tasks.workunit.client.0.smithi153.stderr: -125> 2024-09-19T14:12:17.642+0000 7f2f5bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:12:17.777 INFO:tasks.workunit.client.0.smithi153.stderr: -124> 2024-09-19T14:12:17.642+0000 7f2f5bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:12:17.777 INFO:tasks.workunit.client.0.smithi153.stderr: -123> 2024-09-19T14:12:17.642+0000 7f2f5bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:12:17.777 INFO:tasks.workunit.client.0.smithi153.stderr: -122> 2024-09-19T14:12:17.642+0000 7f308a1da640 10 monclient: get_auth_request con 0x7f2f54071c10 auth_method 0 2024-09-19T14:12:17.777 INFO:tasks.workunit.client.0.smithi153.stderr: -121> 2024-09-19T14:12:17.642+0000 7f308a9db640 10 monclient: get_auth_request con 0x55c710201e30 auth_method 0 2024-09-19T14:12:17.777 INFO:tasks.workunit.client.0.smithi153.stderr: -120> 2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.777 INFO:tasks.workunit.client.0.smithi153.stderr: -119> 2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 realm 2024-09-19T14:12:17.777 INFO:tasks.workunit.client.0.smithi153.stderr: -118> 2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.777 INFO:tasks.workunit.client.0.smithi153.stderr: -117> 2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.777 INFO:tasks.workunit.client.0.smithi153.stderr: -116> 2024-09-19T14:12:17.646+0000 7f308c6d49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:12:17.777 INFO:tasks.workunit.client.0.smithi153.stderr: -115> 2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.777 INFO:tasks.workunit.client.0.smithi153.stderr: -114> 2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.777 INFO:tasks.workunit.client.0.smithi153.stderr: -113> 2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.777 INFO:tasks.workunit.client.0.smithi153.stderr: -112> 2024-09-19T14:12:17.646+0000 7f308a1da640 10 monclient: get_auth_request con 0x55c710205fe0 auth_method 0 2024-09-19T14:12:17.778 INFO:tasks.workunit.client.0.smithi153.stderr: -111> 2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:17.778 INFO:tasks.workunit.client.0.smithi153.stderr: -110> 2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.778 INFO:tasks.workunit.client.0.smithi153.stderr: -109> 2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:12:17.778 INFO:tasks.workunit.client.0.smithi153.stderr: -108> 2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 searching for the correct realm 2024-09-19T14:12:17.778 INFO:tasks.workunit.client.0.smithi153.stderr: -107> 2024-09-19T14:12:17.646+0000 7f3083fff640 10 monclient: get_auth_request con 0x55c71020b370 auth_method 0 2024-09-19T14:12:17.778 INFO:tasks.workunit.client.0.smithi153.stderr: -106> 2024-09-19T14:12:17.646+0000 7f308a9db640 10 monclient: get_auth_request con 0x7f307404d060 auth_method 0 2024-09-19T14:12:17.778 INFO:tasks.workunit.client.0.smithi153.stderr: -105> 2024-09-19T14:12:17.650+0000 7f308a1da640 10 monclient: get_auth_request con 0x7f3084061990 auth_method 0 2024-09-19T14:12:17.778 INFO:tasks.workunit.client.0.smithi153.stderr: -104> 2024-09-19T14:12:17.650+0000 7f3083fff640 10 monclient: get_auth_request con 0x7f307c0c3bd0 auth_method 0 2024-09-19T14:12:17.778 INFO:tasks.workunit.client.0.smithi153.stderr: -103> 2024-09-19T14:12:17.654+0000 7f3083fff640 0 -- 172.21.15.153:0/3164683518 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f307c0c3bd0 msgr2=0x7f307c0ef400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:12:17.778 INFO:tasks.workunit.client.0.smithi153.stderr: -102> 2024-09-19T14:12:17.654+0000 7f2f5bfff640 1 client.8205.objecter ms_handle_reset 0x7f307c0c3bd0 session 0x7f307c0c9040 osd.4 2024-09-19T14:12:17.778 INFO:tasks.workunit.client.0.smithi153.stderr: -101> 2024-09-19T14:12:17.654+0000 7f2f5bfff640 10 monclient: _renew_subs 2024-09-19T14:12:17.778 INFO:tasks.workunit.client.0.smithi153.stderr: -100> 2024-09-19T14:12:17.654+0000 7f2f5bfff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:12:17.778 INFO:tasks.workunit.client.0.smithi153.stderr: -99> 2024-09-19T14:12:17.654+0000 7f308a9db640 10 monclient: get_auth_request con 0x7f3074094bd0 auth_method 0 2024-09-19T14:12:17.778 INFO:tasks.workunit.client.0.smithi153.stderr: -98> 2024-09-19T14:12:17.654+0000 7f3083fff640 10 monclient: get_auth_request con 0x7f2f54082340 auth_method 0 2024-09-19T14:12:17.778 INFO:tasks.workunit.client.0.smithi153.stderr: -97> 2024-09-19T14:12:17.658+0000 7f308a1da640 10 monclient: get_auth_request con 0x7f3074056300 auth_method 0 2024-09-19T14:12:17.779 INFO:tasks.workunit.client.0.smithi153.stderr: -96> 2024-09-19T14:12:17.658+0000 7f308a9db640 0 -- 172.21.15.153:0/3164683518 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7f3074094bd0 msgr2=0x7f3074066320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:12:17.779 INFO:tasks.workunit.client.0.smithi153.stderr: -95> 2024-09-19T14:12:17.658+0000 7f2f5bfff640 1 client.8205.objecter ms_handle_reset 0x7f3074094bd0 session 0x7f3074051040 osd.6 2024-09-19T14:12:17.779 INFO:tasks.workunit.client.0.smithi153.stderr: -94> 2024-09-19T14:12:17.658+0000 7f308a9db640 10 monclient: get_auth_request con 0x7f307c0c3bd0 auth_method 0 2024-09-19T14:12:17.779 INFO:tasks.workunit.client.0.smithi153.stderr: -93> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:12:17.779 INFO:tasks.workunit.client.0.smithi153.stderr: -92> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:12:17.779 INFO:tasks.workunit.client.0.smithi153.stderr: -91> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:12:17.779 INFO:tasks.workunit.client.0.smithi153.stderr: -90> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:12:17.779 INFO:tasks.workunit.client.0.smithi153.stderr: -89> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:12:17.779 INFO:tasks.workunit.client.0.smithi153.stderr: -88> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:12:17.779 INFO:tasks.workunit.client.0.smithi153.stderr: -87> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.779 INFO:tasks.workunit.client.0.smithi153.stderr: -86> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.779 INFO:tasks.workunit.client.0.smithi153.stderr: -85> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.779 INFO:tasks.workunit.client.0.smithi153.stderr: -84> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:17.780 INFO:tasks.workunit.client.0.smithi153.stderr: -83> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.780 INFO:tasks.workunit.client.0.smithi153.stderr: -82> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:12:17.780 INFO:tasks.workunit.client.0.smithi153.stderr: -81> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 zone default found 2024-09-19T14:12:17.780 INFO:tasks.workunit.client.0.smithi153.stderr: -80> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 4 Realm: () 2024-09-19T14:12:17.780 INFO:tasks.workunit.client.0.smithi153.stderr: -79> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:12:17.780 INFO:tasks.workunit.client.0.smithi153.stderr: -78> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:12:17.780 INFO:tasks.workunit.client.0.smithi153.stderr: -77> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:12:17.780 INFO:tasks.workunit.client.0.smithi153.stderr: -76> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 zonegroup default 2024-09-19T14:12:17.780 INFO:tasks.workunit.client.0.smithi153.stderr: -75> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.780 INFO:tasks.workunit.client.0.smithi153.stderr: -74> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.780 INFO:tasks.workunit.client.0.smithi153.stderr: -73> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.780 INFO:tasks.workunit.client.0.smithi153.stderr: -72> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.780 INFO:tasks.workunit.client.0.smithi153.stderr: -71> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.780 INFO:tasks.workunit.client.0.smithi153.stderr: -70> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.781 INFO:tasks.workunit.client.0.smithi153.stderr: -69> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 started sync module instance, tier type = 2024-09-19T14:12:17.781 INFO:tasks.workunit.client.0.smithi153.stderr: -68> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:12:17.781 INFO:tasks.workunit.client.0.smithi153.stderr: -67> 2024-09-19T14:12:17.682+0000 7f308c6d49c0 20 add_watcher() i=0 2024-09-19T14:12:17.781 INFO:tasks.workunit.client.0.smithi153.stderr: -66> 2024-09-19T14:12:17.682+0000 7f308c6d49c0 20 add_watcher() i=1 2024-09-19T14:12:17.781 INFO:tasks.workunit.client.0.smithi153.stderr: -65> 2024-09-19T14:12:17.682+0000 7f308c6d49c0 20 add_watcher() i=2 2024-09-19T14:12:17.781 INFO:tasks.workunit.client.0.smithi153.stderr: -64> 2024-09-19T14:12:17.682+0000 7f308c6d49c0 20 add_watcher() i=3 2024-09-19T14:12:17.781 INFO:tasks.workunit.client.0.smithi153.stderr: -63> 2024-09-19T14:12:17.682+0000 7f308c6d49c0 20 add_watcher() i=4 2024-09-19T14:12:17.781 INFO:tasks.workunit.client.0.smithi153.stderr: -62> 2024-09-19T14:12:17.682+0000 7f308c6d49c0 20 add_watcher() i=5 2024-09-19T14:12:17.781 INFO:tasks.workunit.client.0.smithi153.stderr: -61> 2024-09-19T14:12:17.682+0000 7f308c6d49c0 20 add_watcher() i=6 2024-09-19T14:12:17.781 INFO:tasks.workunit.client.0.smithi153.stderr: -60> 2024-09-19T14:12:17.682+0000 7f308c6d49c0 20 add_watcher() i=7 2024-09-19T14:12:17.781 INFO:tasks.workunit.client.0.smithi153.stderr: -59> 2024-09-19T14:12:17.682+0000 7f308c6d49c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:12:17.781 INFO:tasks.workunit.client.0.smithi153.stderr: -58> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding auth protocol: cephx 2024-09-19T14:12:17.781 INFO:tasks.workunit.client.0.smithi153.stderr: -57> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding auth protocol: cephx 2024-09-19T14:12:17.781 INFO:tasks.workunit.client.0.smithi153.stderr: -56> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding auth protocol: cephx 2024-09-19T14:12:17.781 INFO:tasks.workunit.client.0.smithi153.stderr: -55> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding con mode: secure 2024-09-19T14:12:17.782 INFO:tasks.workunit.client.0.smithi153.stderr: -54> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding con mode: crc 2024-09-19T14:12:17.782 INFO:tasks.workunit.client.0.smithi153.stderr: -53> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding con mode: secure 2024-09-19T14:12:17.782 INFO:tasks.workunit.client.0.smithi153.stderr: -52> 2024-09-19T14:12:17.686+0000 7f2f417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:12:17.782 INFO:tasks.workunit.client.0.smithi153.stderr: -51> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding con mode: crc 2024-09-19T14:12:17.782 INFO:tasks.workunit.client.0.smithi153.stderr: -50> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding con mode: secure 2024-09-19T14:12:17.782 INFO:tasks.workunit.client.0.smithi153.stderr: -49> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding con mode: crc 2024-09-19T14:12:17.782 INFO:tasks.workunit.client.0.smithi153.stderr: -48> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding con mode: crc 2024-09-19T14:12:17.782 INFO:tasks.workunit.client.0.smithi153.stderr: -47> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding con mode: secure 2024-09-19T14:12:17.782 INFO:tasks.workunit.client.0.smithi153.stderr: -46> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding con mode: crc 2024-09-19T14:12:17.782 INFO:tasks.workunit.client.0.smithi153.stderr: -45> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding con mode: secure 2024-09-19T14:12:17.782 INFO:tasks.workunit.client.0.smithi153.stderr: -44> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding con mode: crc 2024-09-19T14:12:17.782 INFO:tasks.workunit.client.0.smithi153.stderr: -43> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding con mode: secure 2024-09-19T14:12:17.782 INFO:tasks.workunit.client.0.smithi153.stderr: -42> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.782 INFO:tasks.workunit.client.0.smithi153.stderr: -41> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:12:17.783 INFO:tasks.workunit.client.0.smithi153.stderr: -40> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:12:17.783 INFO:tasks.workunit.client.0.smithi153.stderr: -39> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command cache list hook 0x55c7101d7000 2024-09-19T14:12:17.783 INFO:tasks.workunit.client.0.smithi153.stderr: -38> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command cache inspect hook 0x55c7101d7000 2024-09-19T14:12:17.783 INFO:tasks.workunit.client.0.smithi153.stderr: -37> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command cache erase hook 0x55c7101d7000 2024-09-19T14:12:17.783 INFO:tasks.workunit.client.0.smithi153.stderr: -36> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command cache zap hook 0x55c7101d7000 2024-09-19T14:12:17.783 INFO:tasks.workunit.client.0.smithi153.stderr: -35> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 note: GC not initialized 2024-09-19T14:12:17.783 INFO:tasks.workunit.client.0.smithi153.stderr: -34> 2024-09-19T14:12:17.686+0000 7f2f3b7fe640 20 reqs_thread_entry: start 2024-09-19T14:12:17.783 INFO:tasks.workunit.client.0.smithi153.stderr: -33> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command sync trace show hook 0x7f30740043b0 2024-09-19T14:12:17.783 INFO:tasks.workunit.client.0.smithi153.stderr: -32> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command sync trace history hook 0x7f30740043b0 2024-09-19T14:12:17.783 INFO:tasks.workunit.client.0.smithi153.stderr: -31> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command sync trace active hook 0x7f30740043b0 2024-09-19T14:12:17.783 INFO:tasks.workunit.client.0.smithi153.stderr: -30> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command sync trace active_short hook 0x7f30740043b0 2024-09-19T14:12:17.783 INFO:tasks.workunit.client.0.smithi153.stderr: -29> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 20 init_complete bucket index max shards: 11 2024-09-19T14:12:17.783 INFO:tasks.workunit.client.0.smithi153.stderr: -28> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 20 Filter name: none 2024-09-19T14:12:17.783 INFO:tasks.workunit.client.0.smithi153.stderr: -27> 2024-09-19T14:12:17.686+0000 7f2f397fa640 20 reqs_thread_entry: start 2024-09-19T14:12:17.783 INFO:tasks.workunit.client.0.smithi153.stderr: -26> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:12:17.784 INFO:tasks.workunit.client.0.smithi153.stderr: -25> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.784 INFO:tasks.workunit.client.0.smithi153.stderr: -24> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:12:17.784 INFO:tasks.workunit.client.0.smithi153.stderr: -23> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:12:17.784 INFO:tasks.workunit.client.0.smithi153.stderr: -22> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:12:17.784 INFO:tasks.workunit.client.0.smithi153.stderr: -21> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : miss 2024-09-19T14:12:17.784 INFO:tasks.workunit.client.0.smithi153.stderr: -20> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.784 INFO:tasks.workunit.client.0.smithi153.stderr: -19> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:12:17.784 INFO:tasks.workunit.client.0.smithi153.stderr: -18> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:12:17.784 INFO:tasks.workunit.client.0.smithi153.stderr: -17> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:12:17.784 INFO:tasks.workunit.client.0.smithi153.stderr: -16> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:12:17.784 INFO:tasks.workunit.client.0.smithi153.stderr: -15> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:12:17.784 INFO:tasks.workunit.client.0.smithi153.stderr: -14> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:12:17.784 INFO:tasks.workunit.client.0.smithi153.stderr: -13> 2024-09-19T14:12:17.698+0000 7f308c6d49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:12:17.785 INFO:tasks.workunit.client.0.smithi153.stderr: -12> 2024-09-19T14:12:17.698+0000 7f308c6d49c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:12:17.785 INFO:tasks.workunit.client.0.smithi153.stderr: -11> 2024-09-19T14:12:17.698+0000 7f308c6d49c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:12:17.785 INFO:tasks.workunit.client.0.smithi153.stderr: -10> 2024-09-19T14:12:17.698+0000 7f308c6d49c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17, ofs0, ns] 2024-09-19T14:12:17.785 INFO:tasks.workunit.client.0.smithi153.stderr: -9> 2024-09-19T14:12:17.698+0000 7f2f6dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333527 cookie 94313457466496 notifier 8205 bl.length()=827 2024-09-19T14:12:17.785 INFO:tasks.workunit.client.0.smithi153.stderr: -8> 2024-09-19T14:12:17.698+0000 7f2f6dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:12:17.785 INFO:tasks.workunit.client.0.smithi153.stderr: -7> 2024-09-19T14:12:17.698+0000 7f2f6dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:12:17.785 INFO:tasks.workunit.client.0.smithi153.stderr: -6> 2024-09-19T14:12:17.698+0000 7f2f6dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:12:17.785 INFO:tasks.workunit.client.0.smithi153.stderr: -5> 2024-09-19T14:12:17.698+0000 7f308c6d49c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_sources= new_sources= 2024-09-19T14:12:17.785 INFO:tasks.workunit.client.0.smithi153.stderr: -4> 2024-09-19T14:12:17.698+0000 7f308c6d49c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential sources added=[] removed=[] 2024-09-19T14:12:17.785 INFO:tasks.workunit.client.0.smithi153.stderr: -3> 2024-09-19T14:12:17.698+0000 7f308c6d49c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_dests= new_dests= 2024-09-19T14:12:17.785 INFO:tasks.workunit.client.0.smithi153.stderr: -2> 2024-09-19T14:12:17.698+0000 7f308c6d49c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential dests added=[] removed=[] 2024-09-19T14:12:17.785 INFO:tasks.workunit.client.0.smithi153.stderr: -1> 2024-09-19T14:12:17.710+0000 7f308c6d49c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f308c6d49c0 time 2024-09-19T14:12:17.714547+0000 2024-09-19T14:12:17.785 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:12:17.785 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.786 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:12:17.786 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f308ffae2eb] 2024-09-19T14:12:17.786 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f308ffae49f] 2024-09-19T14:12:17.786 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c70d27e271] 2024-09-19T14:12:17.786 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55c70d28e14a] 2024-09-19T14:12:17.786 INFO:tasks.workunit.client.0.smithi153.stderr: 5: main() 2024-09-19T14:12:17.786 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f308ee14d90] 2024-09-19T14:12:17.786 INFO:tasks.workunit.client.0.smithi153.stderr: 7: __libc_start_main() 2024-09-19T14:12:17.786 INFO:tasks.workunit.client.0.smithi153.stderr: 8: _start() 2024-09-19T14:12:17.786 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.786 INFO:tasks.workunit.client.0.smithi153.stderr: 0> 2024-09-19T14:12:17.714+0000 7f308c6d49c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:12:17.786 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7f308c6d49c0 thread_name:radosgw-admin 2024-09-19T14:12:17.786 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.786 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:12:17.787 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f308ee2d520] 2024-09-19T14:12:17.787 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:12:17.787 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:12:17.787 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:12:17.787 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f308ffae345] 2024-09-19T14:12:17.787 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f308ffae49f] 2024-09-19T14:12:17.787 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c70d27e271] 2024-09-19T14:12:17.787 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55c70d28e14a] 2024-09-19T14:12:17.787 INFO:tasks.workunit.client.0.smithi153.stderr: 9: main() 2024-09-19T14:12:17.787 INFO:tasks.workunit.client.0.smithi153.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f308ee14d90] 2024-09-19T14:12:17.787 INFO:tasks.workunit.client.0.smithi153.stderr: 11: __libc_start_main() 2024-09-19T14:12:17.787 INFO:tasks.workunit.client.0.smithi153.stderr: 12: _start() 2024-09-19T14:12:17.787 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:12:17.787 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.787 INFO:tasks.workunit.client.0.smithi153.stderr:--- logging levels --- 2024-09-19T14:12:17.788 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 none 2024-09-19T14:12:17.788 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 lockdep 2024-09-19T14:12:17.788 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 context 2024-09-19T14:12:17.788 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 crush 2024-09-19T14:12:17.788 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds 2024-09-19T14:12:17.788 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_balancer 2024-09-19T14:12:17.788 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_locker 2024-09-19T14:12:17.788 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log 2024-09-19T14:12:17.788 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log_expire 2024-09-19T14:12:17.788 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_migrator 2024-09-19T14:12:17.788 INFO:tasks.workunit.client.0.smithi153.stderr: 3/ 5 mds_quiesce 2024-09-19T14:12:17.788 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 buffer 2024-09-19T14:12:17.788 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 timer 2024-09-19T14:12:17.788 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 filer 2024-09-19T14:12:17.789 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 striper 2024-09-19T14:12:17.789 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 objecter 2024-09-19T14:12:17.789 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rados 2024-09-19T14:12:17.789 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd 2024-09-19T14:12:17.789 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_mirror 2024-09-19T14:12:17.789 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_replay 2024-09-19T14:12:17.789 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_pwl 2024-09-19T14:12:17.789 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 journaler 2024-09-19T14:12:17.789 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objectcacher 2024-09-19T14:12:17.789 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:12:17.789 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 client 2024-09-19T14:12:17.789 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 osd 2024-09-19T14:12:17.789 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 optracker 2024-09-19T14:12:17.789 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objclass 2024-09-19T14:12:17.789 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 filestore 2024-09-19T14:12:17.790 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 journal 2024-09-19T14:12:17.790 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 ms 2024-09-19T14:12:17.790 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mon 2024-09-19T14:12:17.790 INFO:tasks.workunit.client.0.smithi153.stderr: 0/10 monc 2024-09-19T14:12:17.790 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 paxos 2024-09-19T14:12:17.790 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 tp 2024-09-19T14:12:17.790 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 auth 2024-09-19T14:12:17.790 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 crypto 2024-09-19T14:12:17.790 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 finisher 2024-09-19T14:12:17.790 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 reserver 2024-09-19T14:12:17.790 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 heartbeatmap 2024-09-19T14:12:17.790 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 perfcounter 2024-09-19T14:12:17.790 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw 2024-09-19T14:12:17.790 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_sync 2024-09-19T14:12:17.790 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_datacache 2024-09-19T14:12:17.791 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_access 2024-09-19T14:12:17.791 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:12:17.791 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_flight 2024-09-19T14:12:17.791 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:12:17.791 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw_notification 2024-09-19T14:12:17.791 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 javaclient 2024-09-19T14:12:17.791 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 asok 2024-09-19T14:12:17.791 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 throttle 2024-09-19T14:12:17.791 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 refs 2024-09-19T14:12:17.791 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 compressor 2024-09-19T14:12:17.791 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluestore 2024-09-19T14:12:17.791 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluefs 2024-09-19T14:12:17.791 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 bdev 2024-09-19T14:12:17.791 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 kstore 2024-09-19T14:12:17.791 INFO:tasks.workunit.client.0.smithi153.stderr: 4/ 5 rocksdb 2024-09-19T14:12:17.792 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 fuse 2024-09-19T14:12:17.792 INFO:tasks.workunit.client.0.smithi153.stderr: 2/ 5 mgr 2024-09-19T14:12:17.792 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mgrc 2024-09-19T14:12:17.792 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 dpdk 2024-09-19T14:12:17.792 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 eventtrace 2024-09-19T14:12:17.792 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 prioritycache 2024-09-19T14:12:17.792 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 test 2024-09-19T14:12:17.792 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:12:17.792 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephsqlite 2024-09-19T14:12:17.792 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:12:17.792 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore 2024-09-19T14:12:17.792 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_onode 2024-09-19T14:12:17.792 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_odata 2024-09-19T14:12:17.792 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_omap 2024-09-19T14:12:17.793 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_tm 2024-09-19T14:12:17.793 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_t 2024-09-19T14:12:17.793 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:12:17.793 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_epm 2024-09-19T14:12:17.793 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_lba 2024-09-19T14:12:17.793 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:12:17.793 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cache 2024-09-19T14:12:17.793 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_journal 2024-09-19T14:12:17.793 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_device 2024-09-19T14:12:17.793 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_backref 2024-09-19T14:12:17.793 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 alienstore 2024-09-19T14:12:17.793 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mclock 2024-09-19T14:12:17.793 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cyanstore 2024-09-19T14:12:17.793 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 ceph_exporter 2024-09-19T14:12:17.794 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 memstore 2024-09-19T14:12:17.794 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 trace 2024-09-19T14:12:17.794 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 ceph_dedup 2024-09-19T14:12:17.794 INFO:tasks.workunit.client.0.smithi153.stderr: -2/-2 (syslog threshold) 2024-09-19T14:12:17.794 INFO:tasks.workunit.client.0.smithi153.stderr: 99/99 (stderr threshold) 2024-09-19T14:12:17.794 INFO:tasks.workunit.client.0.smithi153.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:12:17.794 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2f397fa640 / http_manager 2024-09-19T14:12:17.794 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2f3b7fe640 / http_manager 2024-09-19T14:12:17.794 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2f417e2640 / rgw_dt_lg_renew 2024-09-19T14:12:17.794 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2f5bfff640 / ms_dispatch 2024-09-19T14:12:17.794 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2f6dffb640 / io_context_pool 2024-09-19T14:12:17.795 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2f6ffff640 / ms_dispatch 2024-09-19T14:12:17.795 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2f76e05640 / ms_dispatch 2024-09-19T14:12:17.795 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2f78608640 / io_context_pool 2024-09-19T14:12:17.795 INFO:tasks.workunit.client.0.smithi153.stderr: 7f3083fff640 / msgr-worker-2 2024-09-19T14:12:17.795 INFO:tasks.workunit.client.0.smithi153.stderr: 7f308a1da640 / msgr-worker-1 2024-09-19T14:12:17.795 INFO:tasks.workunit.client.0.smithi153.stderr: 7f308a9db640 / msgr-worker-0 2024-09-19T14:12:17.795 INFO:tasks.workunit.client.0.smithi153.stderr: 7f308b1dc640 / io_context_pool 2024-09-19T14:12:17.795 INFO:tasks.workunit.client.0.smithi153.stderr: 7f308c6d49c0 / radosgw-admin 2024-09-19T14:12:17.795 INFO:tasks.workunit.client.0.smithi153.stderr: max_recent 500 2024-09-19T14:12:17.796 INFO:tasks.workunit.client.0.smithi153.stderr: max_new 1000 2024-09-19T14:12:17.796 INFO:tasks.workunit.client.0.smithi153.stderr: log_file /var/log/ceph/ceph-client.admin.142926.log 2024-09-19T14:12:17.796 INFO:tasks.workunit.client.0.smithi153.stderr:--- end dump of recent events --- 2024-09-19T14:12:17.796 INFO:tasks.workunit.client.0.smithi153.stderr:--- begin dump of recent events --- 2024-09-19T14:12:17.796 INFO:tasks.workunit.client.0.smithi153.stderr: -499> 2024-09-19T14:12:17.622+0000 7f308a9db640 10 monclient: _finish_hunting 0 2024-09-19T14:12:17.796 INFO:tasks.workunit.client.0.smithi153.stderr: -498> 2024-09-19T14:12:17.622+0000 7f308a9db640 1 monclient: found mon.noname-c 2024-09-19T14:12:17.796 INFO:tasks.workunit.client.0.smithi153.stderr: -497> 2024-09-19T14:12:17.622+0000 7f308a9db640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:12:17.796 INFO:tasks.workunit.client.0.smithi153.stderr: -496> 2024-09-19T14:12:17.622+0000 7f2f78608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:17.796 INFO:tasks.workunit.client.0.smithi153.stderr: -495> 2024-09-19T14:12:17.622+0000 7f2f78608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:12:17.796 INFO:tasks.workunit.client.0.smithi153.stderr: -494> 2024-09-19T14:12:17.622+0000 7f2f78608640 10 monclient: dump: 2024-09-19T14:12:17.796 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:17.796 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:17.796 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.797 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.797 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:17.797 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.797 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:17.797 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:17.797 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:17.797 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.797 INFO:tasks.workunit.client.0.smithi153.stderr: -493> 2024-09-19T14:12:17.622+0000 7f2f78608640 10 monclient: _finish_auth 0 2024-09-19T14:12:17.797 INFO:tasks.workunit.client.0.smithi153.stderr: -492> 2024-09-19T14:12:17.622+0000 7f2f78608640 10 monclient: _check_auth_tickets 2024-09-19T14:12:17.797 INFO:tasks.workunit.client.0.smithi153.stderr: -491> 2024-09-19T14:12:17.622+0000 7f2f78608640 10 monclient: handle_config config(0 keys) 2024-09-19T14:12:17.797 INFO:tasks.workunit.client.0.smithi153.stderr: -490> 2024-09-19T14:12:17.622+0000 7f2f78608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:17.797 INFO:tasks.workunit.client.0.smithi153.stderr: -489> 2024-09-19T14:12:17.622+0000 7f2f78608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:12:17.797 INFO:tasks.workunit.client.0.smithi153.stderr: -488> 2024-09-19T14:12:17.622+0000 7f2f78608640 10 monclient: dump: 2024-09-19T14:12:17.797 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:17.798 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:17.798 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.798 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.798 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:17.798 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.798 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:17.798 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:17.798 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:17.798 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.798 INFO:tasks.workunit.client.0.smithi153.stderr: -487> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 monclient: authenticate success, global_id 7670 2024-09-19T14:12:17.798 INFO:tasks.workunit.client.0.smithi153.stderr: -486> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient: get_monmap_and_config success 2024-09-19T14:12:17.798 INFO:tasks.workunit.client.0.smithi153.stderr: -485> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 4 set_mon_vals no callback set 2024-09-19T14:12:17.798 INFO:tasks.workunit.client.0.smithi153.stderr: -484> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient: shutdown 2024-09-19T14:12:17.798 INFO:tasks.workunit.client.0.smithi153.stderr: -483> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) unregister_commands rotate-key 2024-09-19T14:12:17.799 INFO:tasks.workunit.client.0.smithi153.stderr: -482> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient: build_initial_monmap 2024-09-19T14:12:17.799 INFO:tasks.workunit.client.0.smithi153.stderr: -481> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 1 build_initial for_mkfs: 0 2024-09-19T14:12:17.799 INFO:tasks.workunit.client.0.smithi153.stderr: -480> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient: monmap: 2024-09-19T14:12:17.799 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:12:17.799 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:12:17.799 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:12:17.799 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:12:17.799 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:12:17.799 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.799 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:12:17.799 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:12:17.799 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:12:17.799 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.799 INFO:tasks.workunit.client.0.smithi153.stderr: -479> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding auth protocol: cephx 2024-09-19T14:12:17.799 INFO:tasks.workunit.client.0.smithi153.stderr: -478> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding auth protocol: cephx 2024-09-19T14:12:17.800 INFO:tasks.workunit.client.0.smithi153.stderr: -477> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding auth protocol: cephx 2024-09-19T14:12:17.800 INFO:tasks.workunit.client.0.smithi153.stderr: -476> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding con mode: secure 2024-09-19T14:12:17.800 INFO:tasks.workunit.client.0.smithi153.stderr: -475> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding con mode: crc 2024-09-19T14:12:17.800 INFO:tasks.workunit.client.0.smithi153.stderr: -474> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding con mode: secure 2024-09-19T14:12:17.800 INFO:tasks.workunit.client.0.smithi153.stderr: -473> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding con mode: crc 2024-09-19T14:12:17.800 INFO:tasks.workunit.client.0.smithi153.stderr: -472> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding con mode: secure 2024-09-19T14:12:17.800 INFO:tasks.workunit.client.0.smithi153.stderr: -471> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding con mode: crc 2024-09-19T14:12:17.800 INFO:tasks.workunit.client.0.smithi153.stderr: -470> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding con mode: crc 2024-09-19T14:12:17.800 INFO:tasks.workunit.client.0.smithi153.stderr: -469> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding con mode: secure 2024-09-19T14:12:17.800 INFO:tasks.workunit.client.0.smithi153.stderr: -468> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding con mode: crc 2024-09-19T14:12:17.800 INFO:tasks.workunit.client.0.smithi153.stderr: -467> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding con mode: secure 2024-09-19T14:12:17.800 INFO:tasks.workunit.client.0.smithi153.stderr: -466> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding con mode: crc 2024-09-19T14:12:17.800 INFO:tasks.workunit.client.0.smithi153.stderr: -465> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c71011a7d0) adding con mode: secure 2024-09-19T14:12:17.800 INFO:tasks.workunit.client.0.smithi153.stderr: -464> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.801 INFO:tasks.workunit.client.0.smithi153.stderr: -463> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 1 librados: starting msgr at 2024-09-19T14:12:17.801 INFO:tasks.workunit.client.0.smithi153.stderr: -462> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 1 librados: starting objecter 2024-09-19T14:12:17.801 INFO:tasks.workunit.client.0.smithi153.stderr: -461> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command objecter_requests hook 0x55c70fed34b0 2024-09-19T14:12:17.801 INFO:tasks.workunit.client.0.smithi153.stderr: -460> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 1 librados: setting wanted keys 2024-09-19T14:12:17.801 INFO:tasks.workunit.client.0.smithi153.stderr: -459> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 1 librados: calling monclient init 2024-09-19T14:12:17.801 INFO:tasks.workunit.client.0.smithi153.stderr: -458> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient: init 2024-09-19T14:12:17.801 INFO:tasks.workunit.client.0.smithi153.stderr: -457> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding auth protocol: cephx 2024-09-19T14:12:17.801 INFO:tasks.workunit.client.0.smithi153.stderr: -456> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding auth protocol: cephx 2024-09-19T14:12:17.801 INFO:tasks.workunit.client.0.smithi153.stderr: -455> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding auth protocol: cephx 2024-09-19T14:12:17.801 INFO:tasks.workunit.client.0.smithi153.stderr: -454> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding con mode: secure 2024-09-19T14:12:17.801 INFO:tasks.workunit.client.0.smithi153.stderr: -453> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding con mode: crc 2024-09-19T14:12:17.801 INFO:tasks.workunit.client.0.smithi153.stderr: -452> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding con mode: secure 2024-09-19T14:12:17.801 INFO:tasks.workunit.client.0.smithi153.stderr: -451> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding con mode: crc 2024-09-19T14:12:17.801 INFO:tasks.workunit.client.0.smithi153.stderr: -450> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding con mode: secure 2024-09-19T14:12:17.802 INFO:tasks.workunit.client.0.smithi153.stderr: -449> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding con mode: crc 2024-09-19T14:12:17.802 INFO:tasks.workunit.client.0.smithi153.stderr: -448> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding con mode: crc 2024-09-19T14:12:17.802 INFO:tasks.workunit.client.0.smithi153.stderr: -447> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding con mode: secure 2024-09-19T14:12:17.802 INFO:tasks.workunit.client.0.smithi153.stderr: -446> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding con mode: crc 2024-09-19T14:12:17.802 INFO:tasks.workunit.client.0.smithi153.stderr: -445> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding con mode: secure 2024-09-19T14:12:17.802 INFO:tasks.workunit.client.0.smithi153.stderr: -444> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding con mode: crc 2024-09-19T14:12:17.802 INFO:tasks.workunit.client.0.smithi153.stderr: -443> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 AuthRegistry(0x55c710115020) adding con mode: secure 2024-09-19T14:12:17.802 INFO:tasks.workunit.client.0.smithi153.stderr: -442> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.802 INFO:tasks.workunit.client.0.smithi153.stderr: -441> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.802 INFO:tasks.workunit.client.0.smithi153.stderr: -440> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command rotate-key hook 0x55c710115168 2024-09-19T14:12:17.802 INFO:tasks.workunit.client.0.smithi153.stderr: -439> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient: _reopen_session rank -1 2024-09-19T14:12:17.802 INFO:tasks.workunit.client.0.smithi153.stderr: -438> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:12:17.802 INFO:tasks.workunit.client.0.smithi153.stderr: -437> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient(hunting): picked mon.noname-b con 0x55c70ffc4be0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:12:17.802 INFO:tasks.workunit.client.0.smithi153.stderr: -436> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient(hunting): picked mon.noname-a con 0x55c70ffd02e0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:12:17.803 INFO:tasks.workunit.client.0.smithi153.stderr: -435> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient(hunting): picked mon.noname-c con 0x55c71013eca0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:12:17.803 INFO:tasks.workunit.client.0.smithi153.stderr: -434> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:17.803 INFO:tasks.workunit.client.0.smithi153.stderr: -433> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:17.803 INFO:tasks.workunit.client.0.smithi153.stderr: -432> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:17.803 INFO:tasks.workunit.client.0.smithi153.stderr: -431> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient(hunting): _renew_subs 2024-09-19T14:12:17.803 INFO:tasks.workunit.client.0.smithi153.stderr: -430> 2024-09-19T14:12:17.622+0000 7f308c6d49c0 10 monclient(hunting): authenticate will time out at 2926.087695s 2024-09-19T14:12:17.803 INFO:tasks.workunit.client.0.smithi153.stderr: -429> 2024-09-19T14:12:17.622+0000 7f3083fff640 10 monclient(hunting): get_auth_request con 0x55c70ffd02e0 auth_method 0 2024-09-19T14:12:17.803 INFO:tasks.workunit.client.0.smithi153.stderr: -428> 2024-09-19T14:12:17.622+0000 7f3083fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:17.803 INFO:tasks.workunit.client.0.smithi153.stderr: -427> 2024-09-19T14:12:17.622+0000 7f3083fff640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:17.803 INFO:tasks.workunit.client.0.smithi153.stderr: -426> 2024-09-19T14:12:17.622+0000 7f3083fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:17.803 INFO:tasks.workunit.client.0.smithi153.stderr: -425> 2024-09-19T14:12:17.622+0000 7f308a9db640 10 monclient(hunting): get_auth_request con 0x55c71013eca0 auth_method 0 2024-09-19T14:12:17.803 INFO:tasks.workunit.client.0.smithi153.stderr: -424> 2024-09-19T14:12:17.622+0000 7f308a9db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:17.803 INFO:tasks.workunit.client.0.smithi153.stderr: -423> 2024-09-19T14:12:17.622+0000 7f308a9db640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:17.803 INFO:tasks.workunit.client.0.smithi153.stderr: -422> 2024-09-19T14:12:17.622+0000 7f308a9db640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:17.804 INFO:tasks.workunit.client.0.smithi153.stderr: -421> 2024-09-19T14:12:17.622+0000 7f3083fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:17.804 INFO:tasks.workunit.client.0.smithi153.stderr: -420> 2024-09-19T14:12:17.622+0000 7f3083fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:17.804 INFO:tasks.workunit.client.0.smithi153.stderr: -419> 2024-09-19T14:12:17.622+0000 7f3083fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:17.804 INFO:tasks.workunit.client.0.smithi153.stderr: -418> 2024-09-19T14:12:17.622+0000 7f308a9db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:17.804 INFO:tasks.workunit.client.0.smithi153.stderr: -417> 2024-09-19T14:12:17.622+0000 7f308a9db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:17.804 INFO:tasks.workunit.client.0.smithi153.stderr: -416> 2024-09-19T14:12:17.622+0000 7f308a9db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:17.804 INFO:tasks.workunit.client.0.smithi153.stderr: -415> 2024-09-19T14:12:17.626+0000 7f3083fff640 10 monclient(hunting): handle_auth_done global_id 8196 payload 824 2024-09-19T14:12:17.804 INFO:tasks.workunit.client.0.smithi153.stderr: -414> 2024-09-19T14:12:17.626+0000 7f3083fff640 10 monclient: _finish_hunting 0 2024-09-19T14:12:17.804 INFO:tasks.workunit.client.0.smithi153.stderr: -413> 2024-09-19T14:12:17.626+0000 7f3083fff640 1 monclient: found mon.noname-a 2024-09-19T14:12:17.804 INFO:tasks.workunit.client.0.smithi153.stderr: -412> 2024-09-19T14:12:17.626+0000 7f3083fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:12:17.804 INFO:tasks.workunit.client.0.smithi153.stderr: -411> 2024-09-19T14:12:17.626+0000 7f2f76e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:17.804 INFO:tasks.workunit.client.0.smithi153.stderr: -410> 2024-09-19T14:12:17.626+0000 7f2f76e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:12:17.804 INFO:tasks.workunit.client.0.smithi153.stderr: -409> 2024-09-19T14:12:17.626+0000 7f2f76e05640 10 monclient: dump: 2024-09-19T14:12:17.804 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:17.805 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:17.805 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.805 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.805 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:17.805 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.805 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:17.805 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:17.805 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:17.805 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.805 INFO:tasks.workunit.client.0.smithi153.stderr: -408> 2024-09-19T14:12:17.626+0000 7f2f76e05640 10 monclient: _finish_auth 0 2024-09-19T14:12:17.805 INFO:tasks.workunit.client.0.smithi153.stderr: -407> 2024-09-19T14:12:17.626+0000 7f2f76e05640 10 monclient: _check_auth_tickets 2024-09-19T14:12:17.805 INFO:tasks.workunit.client.0.smithi153.stderr: -406> 2024-09-19T14:12:17.626+0000 7f2f76e05640 10 monclient: handle_config config(0 keys) 2024-09-19T14:12:17.805 INFO:tasks.workunit.client.0.smithi153.stderr: -405> 2024-09-19T14:12:17.626+0000 7f2f76e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:17.805 INFO:tasks.workunit.client.0.smithi153.stderr: -404> 2024-09-19T14:12:17.626+0000 7f2f76e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:12:17.806 INFO:tasks.workunit.client.0.smithi153.stderr: -403> 2024-09-19T14:12:17.626+0000 7f2f76e05640 10 monclient: dump: 2024-09-19T14:12:17.806 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:17.806 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:17.806 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.806 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.806 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:17.806 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.807 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:17.807 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:17.807 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:17.807 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.807 INFO:tasks.workunit.client.0.smithi153.stderr: -402> 2024-09-19T14:12:17.626+0000 7f2f78608640 4 set_mon_vals no callback set 2024-09-19T14:12:17.807 INFO:tasks.workunit.client.0.smithi153.stderr: -401> 2024-09-19T14:12:17.626+0000 7f308c6d49c0 5 monclient: authenticate success, global_id 8196 2024-09-19T14:12:17.807 INFO:tasks.workunit.client.0.smithi153.stderr: -400> 2024-09-19T14:12:17.626+0000 7f308c6d49c0 10 monclient: _renew_subs 2024-09-19T14:12:17.807 INFO:tasks.workunit.client.0.smithi153.stderr: -399> 2024-09-19T14:12:17.626+0000 7f308c6d49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:12:17.807 INFO:tasks.workunit.client.0.smithi153.stderr: -398> 2024-09-19T14:12:17.626+0000 7f308c6d49c0 10 monclient: _renew_subs 2024-09-19T14:12:17.807 INFO:tasks.workunit.client.0.smithi153.stderr: -397> 2024-09-19T14:12:17.626+0000 7f308c6d49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:12:17.807 INFO:tasks.workunit.client.0.smithi153.stderr: -396> 2024-09-19T14:12:17.626+0000 7f308c6d49c0 1 librados: init done 2024-09-19T14:12:17.807 INFO:tasks.workunit.client.0.smithi153.stderr: -395> 2024-09-19T14:12:17.626+0000 7f2f76e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:12:17.807 INFO:tasks.workunit.client.0.smithi153.stderr: -394> 2024-09-19T14:12:17.626+0000 7f2f76e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:12:17.808 INFO:tasks.workunit.client.0.smithi153.stderr: -393> 2024-09-19T14:12:17.626+0000 7f2f76e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:12:17.808 INFO:tasks.workunit.client.0.smithi153.stderr: -392> 2024-09-19T14:12:17.626+0000 7f308a1da640 10 monclient: get_auth_request con 0x7f2f70071be0 auth_method 0 2024-09-19T14:12:17.808 INFO:tasks.workunit.client.0.smithi153.stderr: -391> 2024-09-19T14:12:17.626+0000 7f308a9db640 10 monclient: get_auth_request con 0x55c71013d8c0 auth_method 0 2024-09-19T14:12:17.808 INFO:tasks.workunit.client.0.smithi153.stderr: -390> 2024-09-19T14:12:17.630+0000 7f308a1da640 10 monclient: get_auth_request con 0x55c710161360 auth_method 0 2024-09-19T14:12:17.808 INFO:tasks.workunit.client.0.smithi153.stderr: -389> 2024-09-19T14:12:17.630+0000 7f3083fff640 10 monclient: get_auth_request con 0x55c7101663f0 auth_method 0 2024-09-19T14:12:17.808 INFO:tasks.workunit.client.0.smithi153.stderr: -388> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient: build_initial_monmap 2024-09-19T14:12:17.808 INFO:tasks.workunit.client.0.smithi153.stderr: -387> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 1 build_initial for_mkfs: 0 2024-09-19T14:12:17.808 INFO:tasks.workunit.client.0.smithi153.stderr: -386> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient: monmap: 2024-09-19T14:12:17.808 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:12:17.808 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:12:17.808 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:12:17.808 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:12:17.808 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:12:17.808 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.809 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:12:17.809 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:12:17.809 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:12:17.809 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.809 INFO:tasks.workunit.client.0.smithi153.stderr: -385> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding auth protocol: cephx 2024-09-19T14:12:17.809 INFO:tasks.workunit.client.0.smithi153.stderr: -384> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding auth protocol: cephx 2024-09-19T14:12:17.809 INFO:tasks.workunit.client.0.smithi153.stderr: -383> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding auth protocol: cephx 2024-09-19T14:12:17.809 INFO:tasks.workunit.client.0.smithi153.stderr: -382> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding con mode: secure 2024-09-19T14:12:17.809 INFO:tasks.workunit.client.0.smithi153.stderr: -381> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding con mode: crc 2024-09-19T14:12:17.809 INFO:tasks.workunit.client.0.smithi153.stderr: -380> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding con mode: secure 2024-09-19T14:12:17.809 INFO:tasks.workunit.client.0.smithi153.stderr: -379> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding con mode: crc 2024-09-19T14:12:17.809 INFO:tasks.workunit.client.0.smithi153.stderr: -378> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding con mode: secure 2024-09-19T14:12:17.809 INFO:tasks.workunit.client.0.smithi153.stderr: -377> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding con mode: crc 2024-09-19T14:12:17.809 INFO:tasks.workunit.client.0.smithi153.stderr: -376> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding con mode: crc 2024-09-19T14:12:17.810 INFO:tasks.workunit.client.0.smithi153.stderr: -375> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding con mode: secure 2024-09-19T14:12:17.810 INFO:tasks.workunit.client.0.smithi153.stderr: -374> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding con mode: crc 2024-09-19T14:12:17.810 INFO:tasks.workunit.client.0.smithi153.stderr: -373> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding con mode: secure 2024-09-19T14:12:17.810 INFO:tasks.workunit.client.0.smithi153.stderr: -372> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding con mode: crc 2024-09-19T14:12:17.810 INFO:tasks.workunit.client.0.smithi153.stderr: -371> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c71016a410) adding con mode: secure 2024-09-19T14:12:17.810 INFO:tasks.workunit.client.0.smithi153.stderr: -370> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.810 INFO:tasks.workunit.client.0.smithi153.stderr: -369> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command objecter_requests cmddesc objecter_requests hook 0x55c7101700d0 EEXIST 2024-09-19T14:12:17.810 INFO:tasks.workunit.client.0.smithi153.stderr: -368> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient: init 2024-09-19T14:12:17.810 INFO:tasks.workunit.client.0.smithi153.stderr: -367> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding auth protocol: cephx 2024-09-19T14:12:17.810 INFO:tasks.workunit.client.0.smithi153.stderr: -366> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding auth protocol: cephx 2024-09-19T14:12:17.810 INFO:tasks.workunit.client.0.smithi153.stderr: -365> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding auth protocol: cephx 2024-09-19T14:12:17.810 INFO:tasks.workunit.client.0.smithi153.stderr: -364> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding con mode: secure 2024-09-19T14:12:17.810 INFO:tasks.workunit.client.0.smithi153.stderr: -363> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding con mode: crc 2024-09-19T14:12:17.811 INFO:tasks.workunit.client.0.smithi153.stderr: -362> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding con mode: secure 2024-09-19T14:12:17.811 INFO:tasks.workunit.client.0.smithi153.stderr: -361> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding con mode: crc 2024-09-19T14:12:17.811 INFO:tasks.workunit.client.0.smithi153.stderr: -360> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding con mode: secure 2024-09-19T14:12:17.811 INFO:tasks.workunit.client.0.smithi153.stderr: -359> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding con mode: crc 2024-09-19T14:12:17.811 INFO:tasks.workunit.client.0.smithi153.stderr: -358> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding con mode: crc 2024-09-19T14:12:17.811 INFO:tasks.workunit.client.0.smithi153.stderr: -357> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding con mode: secure 2024-09-19T14:12:17.811 INFO:tasks.workunit.client.0.smithi153.stderr: -356> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding con mode: crc 2024-09-19T14:12:17.811 INFO:tasks.workunit.client.0.smithi153.stderr: -355> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding con mode: secure 2024-09-19T14:12:17.811 INFO:tasks.workunit.client.0.smithi153.stderr: -354> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding con mode: crc 2024-09-19T14:12:17.811 INFO:tasks.workunit.client.0.smithi153.stderr: -353> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 AuthRegistry(0x55c710169468) adding con mode: secure 2024-09-19T14:12:17.811 INFO:tasks.workunit.client.0.smithi153.stderr: -352> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.811 INFO:tasks.workunit.client.0.smithi153.stderr: -351> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.811 INFO:tasks.workunit.client.0.smithi153.stderr: -350> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command rotate-key cmddesc rotate-key hook 0x55c7101695b0 EEXIST 2024-09-19T14:12:17.811 INFO:tasks.workunit.client.0.smithi153.stderr: -349> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient: _reopen_session rank -1 2024-09-19T14:12:17.812 INFO:tasks.workunit.client.0.smithi153.stderr: -348> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T14:12:17.812 INFO:tasks.workunit.client.0.smithi153.stderr: -347> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient(hunting): picked mon.noname-c con 0x55c710193d90 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:12:17.812 INFO:tasks.workunit.client.0.smithi153.stderr: -346> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient(hunting): picked mon.noname-b con 0x55c710195f30 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:12:17.812 INFO:tasks.workunit.client.0.smithi153.stderr: -345> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient(hunting): picked mon.noname-a con 0x55c710192590 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:12:17.812 INFO:tasks.workunit.client.0.smithi153.stderr: -344> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:17.812 INFO:tasks.workunit.client.0.smithi153.stderr: -343> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:17.812 INFO:tasks.workunit.client.0.smithi153.stderr: -342> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:17.812 INFO:tasks.workunit.client.0.smithi153.stderr: -341> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient(hunting): _renew_subs 2024-09-19T14:12:17.812 INFO:tasks.workunit.client.0.smithi153.stderr: -340> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient(hunting): authenticate will time out at 2926.097610s 2024-09-19T14:12:17.812 INFO:tasks.workunit.client.0.smithi153.stderr: -339> 2024-09-19T14:12:17.634+0000 7f308a1da640 10 monclient(hunting): get_auth_request con 0x55c710193d90 auth_method 0 2024-09-19T14:12:17.812 INFO:tasks.workunit.client.0.smithi153.stderr: -338> 2024-09-19T14:12:17.634+0000 7f308a1da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:17.812 INFO:tasks.workunit.client.0.smithi153.stderr: -337> 2024-09-19T14:12:17.634+0000 7f308a1da640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:17.812 INFO:tasks.workunit.client.0.smithi153.stderr: -336> 2024-09-19T14:12:17.634+0000 7f308a1da640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:17.812 INFO:tasks.workunit.client.0.smithi153.stderr: -335> 2024-09-19T14:12:17.634+0000 7f308a9db640 10 monclient(hunting): get_auth_request con 0x55c710192590 auth_method 0 2024-09-19T14:12:17.812 INFO:tasks.workunit.client.0.smithi153.stderr: -334> 2024-09-19T14:12:17.634+0000 7f308a9db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:17.813 INFO:tasks.workunit.client.0.smithi153.stderr: -333> 2024-09-19T14:12:17.634+0000 7f308a9db640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:17.813 INFO:tasks.workunit.client.0.smithi153.stderr: -332> 2024-09-19T14:12:17.634+0000 7f308a9db640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:17.813 INFO:tasks.workunit.client.0.smithi153.stderr: -331> 2024-09-19T14:12:17.634+0000 7f308a1da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:17.813 INFO:tasks.workunit.client.0.smithi153.stderr: -330> 2024-09-19T14:12:17.634+0000 7f308a1da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:17.813 INFO:tasks.workunit.client.0.smithi153.stderr: -329> 2024-09-19T14:12:17.634+0000 7f308a1da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:17.813 INFO:tasks.workunit.client.0.smithi153.stderr: -328> 2024-09-19T14:12:17.634+0000 7f308a9db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:17.813 INFO:tasks.workunit.client.0.smithi153.stderr: -327> 2024-09-19T14:12:17.634+0000 7f308a9db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:17.813 INFO:tasks.workunit.client.0.smithi153.stderr: -326> 2024-09-19T14:12:17.634+0000 7f308a9db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:17.813 INFO:tasks.workunit.client.0.smithi153.stderr: -325> 2024-09-19T14:12:17.634+0000 7f308a9db640 10 monclient(hunting): handle_auth_done global_id 8199 payload 824 2024-09-19T14:12:17.813 INFO:tasks.workunit.client.0.smithi153.stderr: -324> 2024-09-19T14:12:17.634+0000 7f308a9db640 10 monclient: _finish_hunting 0 2024-09-19T14:12:17.813 INFO:tasks.workunit.client.0.smithi153.stderr: -323> 2024-09-19T14:12:17.634+0000 7f308a9db640 1 monclient: found mon.noname-a 2024-09-19T14:12:17.813 INFO:tasks.workunit.client.0.smithi153.stderr: -322> 2024-09-19T14:12:17.634+0000 7f308a9db640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:12:17.813 INFO:tasks.workunit.client.0.smithi153.stderr: -321> 2024-09-19T14:12:17.634+0000 7f2f6ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:17.813 INFO:tasks.workunit.client.0.smithi153.stderr: -320> 2024-09-19T14:12:17.634+0000 7f2f6ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:12:17.814 INFO:tasks.workunit.client.0.smithi153.stderr: -319> 2024-09-19T14:12:17.634+0000 7f2f6ffff640 10 monclient: dump: 2024-09-19T14:12:17.814 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:17.814 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:17.814 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.814 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.814 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:17.814 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.814 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:17.814 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:17.814 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:17.814 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.814 INFO:tasks.workunit.client.0.smithi153.stderr: -318> 2024-09-19T14:12:17.634+0000 7f2f6ffff640 10 monclient: _finish_auth 0 2024-09-19T14:12:17.814 INFO:tasks.workunit.client.0.smithi153.stderr: -317> 2024-09-19T14:12:17.634+0000 7f2f6ffff640 10 monclient: _check_auth_tickets 2024-09-19T14:12:17.814 INFO:tasks.workunit.client.0.smithi153.stderr: -316> 2024-09-19T14:12:17.634+0000 7f2f6ffff640 10 monclient: handle_config config(0 keys) 2024-09-19T14:12:17.815 INFO:tasks.workunit.client.0.smithi153.stderr: -315> 2024-09-19T14:12:17.634+0000 7f2f6ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:17.815 INFO:tasks.workunit.client.0.smithi153.stderr: -314> 2024-09-19T14:12:17.634+0000 7f2f6ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:12:17.815 INFO:tasks.workunit.client.0.smithi153.stderr: -313> 2024-09-19T14:12:17.634+0000 7f2f6ffff640 10 monclient: dump: 2024-09-19T14:12:17.815 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:17.815 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:17.815 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.815 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.815 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:17.815 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.815 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:17.815 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:17.815 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:17.815 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.815 INFO:tasks.workunit.client.0.smithi153.stderr: -312> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 5 monclient: authenticate success, global_id 8199 2024-09-19T14:12:17.815 INFO:tasks.workunit.client.0.smithi153.stderr: -311> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient: _renew_subs 2024-09-19T14:12:17.816 INFO:tasks.workunit.client.0.smithi153.stderr: -310> 2024-09-19T14:12:17.634+0000 7f308b1dc640 4 set_mon_vals no callback set 2024-09-19T14:12:17.816 INFO:tasks.workunit.client.0.smithi153.stderr: -309> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:12:17.816 INFO:tasks.workunit.client.0.smithi153.stderr: -308> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient: _renew_subs 2024-09-19T14:12:17.816 INFO:tasks.workunit.client.0.smithi153.stderr: -307> 2024-09-19T14:12:17.634+0000 7f308c6d49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:12:17.816 INFO:tasks.workunit.client.0.smithi153.stderr: -306> 2024-09-19T14:12:17.638+0000 7f2f6ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:12:17.816 INFO:tasks.workunit.client.0.smithi153.stderr: -305> 2024-09-19T14:12:17.638+0000 7f2f6ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:12:17.816 INFO:tasks.workunit.client.0.smithi153.stderr: -304> 2024-09-19T14:12:17.638+0000 7f2f6ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:12:17.816 INFO:tasks.workunit.client.0.smithi153.stderr: -303> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient: get_monmap_and_config 2024-09-19T14:12:17.816 INFO:tasks.workunit.client.0.smithi153.stderr: -302> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient: build_initial_monmap 2024-09-19T14:12:17.816 INFO:tasks.workunit.client.0.smithi153.stderr: -301> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 1 build_initial for_mkfs: 0 2024-09-19T14:12:17.816 INFO:tasks.workunit.client.0.smithi153.stderr: -300> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient: monmap: 2024-09-19T14:12:17.816 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:12:17.816 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:12:17.817 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:12:17.817 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:12:17.817 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:12:17.817 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.817 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:12:17.817 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:12:17.817 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:12:17.817 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.817 INFO:tasks.workunit.client.0.smithi153.stderr: -299> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding auth protocol: cephx 2024-09-19T14:12:17.817 INFO:tasks.workunit.client.0.smithi153.stderr: -298> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding auth protocol: cephx 2024-09-19T14:12:17.817 INFO:tasks.workunit.client.0.smithi153.stderr: -297> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding auth protocol: cephx 2024-09-19T14:12:17.817 INFO:tasks.workunit.client.0.smithi153.stderr: -296> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding con mode: secure 2024-09-19T14:12:17.817 INFO:tasks.workunit.client.0.smithi153.stderr: -295> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding con mode: crc 2024-09-19T14:12:17.818 INFO:tasks.workunit.client.0.smithi153.stderr: -294> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding con mode: secure 2024-09-19T14:12:17.818 INFO:tasks.workunit.client.0.smithi153.stderr: -293> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding con mode: crc 2024-09-19T14:12:17.818 INFO:tasks.workunit.client.0.smithi153.stderr: -292> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding con mode: secure 2024-09-19T14:12:17.818 INFO:tasks.workunit.client.0.smithi153.stderr: -291> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding con mode: crc 2024-09-19T14:12:17.818 INFO:tasks.workunit.client.0.smithi153.stderr: -290> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding con mode: crc 2024-09-19T14:12:17.818 INFO:tasks.workunit.client.0.smithi153.stderr: -289> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding con mode: secure 2024-09-19T14:12:17.818 INFO:tasks.workunit.client.0.smithi153.stderr: -288> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding con mode: crc 2024-09-19T14:12:17.818 INFO:tasks.workunit.client.0.smithi153.stderr: -287> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding con mode: secure 2024-09-19T14:12:17.818 INFO:tasks.workunit.client.0.smithi153.stderr: -286> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding con mode: crc 2024-09-19T14:12:17.818 INFO:tasks.workunit.client.0.smithi153.stderr: -285> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b3ab0) adding con mode: secure 2024-09-19T14:12:17.818 INFO:tasks.workunit.client.0.smithi153.stderr: -284> 2024-09-19T14:12:17.638+0000 7f308a1da640 10 monclient: get_auth_request con 0x7f2f64071af0 auth_method 0 2024-09-19T14:12:17.818 INFO:tasks.workunit.client.0.smithi153.stderr: -283> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.818 INFO:tasks.workunit.client.0.smithi153.stderr: -282> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient: init 2024-09-19T14:12:17.818 INFO:tasks.workunit.client.0.smithi153.stderr: -281> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding auth protocol: cephx 2024-09-19T14:12:17.818 INFO:tasks.workunit.client.0.smithi153.stderr: -280> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding auth protocol: cephx 2024-09-19T14:12:17.819 INFO:tasks.workunit.client.0.smithi153.stderr: -279> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding auth protocol: cephx 2024-09-19T14:12:17.819 INFO:tasks.workunit.client.0.smithi153.stderr: -278> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding con mode: secure 2024-09-19T14:12:17.819 INFO:tasks.workunit.client.0.smithi153.stderr: -277> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding con mode: crc 2024-09-19T14:12:17.819 INFO:tasks.workunit.client.0.smithi153.stderr: -276> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding con mode: secure 2024-09-19T14:12:17.819 INFO:tasks.workunit.client.0.smithi153.stderr: -275> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding con mode: crc 2024-09-19T14:12:17.819 INFO:tasks.workunit.client.0.smithi153.stderr: -274> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding con mode: secure 2024-09-19T14:12:17.819 INFO:tasks.workunit.client.0.smithi153.stderr: -273> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding con mode: crc 2024-09-19T14:12:17.819 INFO:tasks.workunit.client.0.smithi153.stderr: -272> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding con mode: crc 2024-09-19T14:12:17.819 INFO:tasks.workunit.client.0.smithi153.stderr: -271> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding con mode: secure 2024-09-19T14:12:17.819 INFO:tasks.workunit.client.0.smithi153.stderr: -270> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding con mode: crc 2024-09-19T14:12:17.819 INFO:tasks.workunit.client.0.smithi153.stderr: -269> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding con mode: secure 2024-09-19T14:12:17.819 INFO:tasks.workunit.client.0.smithi153.stderr: -268> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding con mode: crc 2024-09-19T14:12:17.819 INFO:tasks.workunit.client.0.smithi153.stderr: -267> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba449b30) adding con mode: secure 2024-09-19T14:12:17.819 INFO:tasks.workunit.client.0.smithi153.stderr: -266> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.819 INFO:tasks.workunit.client.0.smithi153.stderr: -265> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.820 INFO:tasks.workunit.client.0.smithi153.stderr: -264> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command rotate-key cmddesc rotate-key hook 0x7ffcba449c78 EEXIST 2024-09-19T14:12:17.820 INFO:tasks.workunit.client.0.smithi153.stderr: -263> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient: _reopen_session rank -1 2024-09-19T14:12:17.820 INFO:tasks.workunit.client.0.smithi153.stderr: -262> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:12:17.820 INFO:tasks.workunit.client.0.smithi153.stderr: -261> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient(hunting): picked mon.noname-b con 0x55c7101e7f50 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:12:17.820 INFO:tasks.workunit.client.0.smithi153.stderr: -260> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient(hunting): picked mon.noname-a con 0x55c7101b7970 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:12:17.820 INFO:tasks.workunit.client.0.smithi153.stderr: -259> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient(hunting): picked mon.noname-c con 0x55c7101e3720 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:12:17.820 INFO:tasks.workunit.client.0.smithi153.stderr: -258> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:17.820 INFO:tasks.workunit.client.0.smithi153.stderr: -257> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:17.820 INFO:tasks.workunit.client.0.smithi153.stderr: -256> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:17.820 INFO:tasks.workunit.client.0.smithi153.stderr: -255> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient(hunting): _renew_subs 2024-09-19T14:12:17.820 INFO:tasks.workunit.client.0.smithi153.stderr: -254> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient(hunting): authenticate will time out at 2926.101759s 2024-09-19T14:12:17.820 INFO:tasks.workunit.client.0.smithi153.stderr: -253> 2024-09-19T14:12:17.638+0000 7f308a9db640 10 monclient(hunting): get_auth_request con 0x55c7101e3720 auth_method 0 2024-09-19T14:12:17.820 INFO:tasks.workunit.client.0.smithi153.stderr: -252> 2024-09-19T14:12:17.638+0000 7f308a9db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:17.820 INFO:tasks.workunit.client.0.smithi153.stderr: -251> 2024-09-19T14:12:17.638+0000 7f308a9db640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:17.821 INFO:tasks.workunit.client.0.smithi153.stderr: -250> 2024-09-19T14:12:17.638+0000 7f308a9db640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:17.821 INFO:tasks.workunit.client.0.smithi153.stderr: -249> 2024-09-19T14:12:17.638+0000 7f3083fff640 10 monclient(hunting): get_auth_request con 0x55c7101b7970 auth_method 0 2024-09-19T14:12:17.821 INFO:tasks.workunit.client.0.smithi153.stderr: -248> 2024-09-19T14:12:17.638+0000 7f3083fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:17.821 INFO:tasks.workunit.client.0.smithi153.stderr: -247> 2024-09-19T14:12:17.638+0000 7f3083fff640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:17.821 INFO:tasks.workunit.client.0.smithi153.stderr: -246> 2024-09-19T14:12:17.638+0000 7f3083fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:17.821 INFO:tasks.workunit.client.0.smithi153.stderr: -245> 2024-09-19T14:12:17.638+0000 7f308a9db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:17.821 INFO:tasks.workunit.client.0.smithi153.stderr: -244> 2024-09-19T14:12:17.638+0000 7f308a9db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:17.821 INFO:tasks.workunit.client.0.smithi153.stderr: -243> 2024-09-19T14:12:17.638+0000 7f308a9db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:17.821 INFO:tasks.workunit.client.0.smithi153.stderr: -242> 2024-09-19T14:12:17.638+0000 7f3083fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:17.821 INFO:tasks.workunit.client.0.smithi153.stderr: -241> 2024-09-19T14:12:17.638+0000 7f3083fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:17.821 INFO:tasks.workunit.client.0.smithi153.stderr: -240> 2024-09-19T14:12:17.638+0000 7f3083fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:17.821 INFO:tasks.workunit.client.0.smithi153.stderr: -239> 2024-09-19T14:12:17.638+0000 7f308a1da640 10 monclient(hunting): get_auth_request con 0x55c7101e7f50 auth_method 0 2024-09-19T14:12:17.821 INFO:tasks.workunit.client.0.smithi153.stderr: -238> 2024-09-19T14:12:17.638+0000 7f308a1da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:17.821 INFO:tasks.workunit.client.0.smithi153.stderr: -237> 2024-09-19T14:12:17.638+0000 7f308a1da640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:17.822 INFO:tasks.workunit.client.0.smithi153.stderr: -236> 2024-09-19T14:12:17.638+0000 7f308a1da640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:17.822 INFO:tasks.workunit.client.0.smithi153.stderr: -235> 2024-09-19T14:12:17.638+0000 7f3083fff640 10 monclient(hunting): handle_auth_done global_id 8202 payload 274 2024-09-19T14:12:17.822 INFO:tasks.workunit.client.0.smithi153.stderr: -234> 2024-09-19T14:12:17.638+0000 7f3083fff640 10 monclient: _finish_hunting 0 2024-09-19T14:12:17.822 INFO:tasks.workunit.client.0.smithi153.stderr: -233> 2024-09-19T14:12:17.638+0000 7f3083fff640 1 monclient: found mon.noname-a 2024-09-19T14:12:17.822 INFO:tasks.workunit.client.0.smithi153.stderr: -232> 2024-09-19T14:12:17.638+0000 7f3083fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:12:17.822 INFO:tasks.workunit.client.0.smithi153.stderr: -231> 2024-09-19T14:12:17.638+0000 7f2f6dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:17.822 INFO:tasks.workunit.client.0.smithi153.stderr: -230> 2024-09-19T14:12:17.638+0000 7f2f6dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:12:17.822 INFO:tasks.workunit.client.0.smithi153.stderr: -229> 2024-09-19T14:12:17.638+0000 7f2f6dffb640 10 monclient: dump: 2024-09-19T14:12:17.822 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:17.822 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:17.822 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.822 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.822 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:17.822 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.822 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:17.823 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:17.823 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:17.823 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.823 INFO:tasks.workunit.client.0.smithi153.stderr: -228> 2024-09-19T14:12:17.638+0000 7f2f6dffb640 10 monclient: _finish_auth 0 2024-09-19T14:12:17.823 INFO:tasks.workunit.client.0.smithi153.stderr: -227> 2024-09-19T14:12:17.638+0000 7f2f6dffb640 10 monclient: _check_auth_tickets 2024-09-19T14:12:17.823 INFO:tasks.workunit.client.0.smithi153.stderr: -226> 2024-09-19T14:12:17.638+0000 7f2f6dffb640 10 monclient: handle_config config(0 keys) 2024-09-19T14:12:17.823 INFO:tasks.workunit.client.0.smithi153.stderr: -225> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 monclient: authenticate success, global_id 8202 2024-09-19T14:12:17.823 INFO:tasks.workunit.client.0.smithi153.stderr: -224> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient: get_monmap_and_config success 2024-09-19T14:12:17.823 INFO:tasks.workunit.client.0.smithi153.stderr: -223> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 4 set_mon_vals no callback set 2024-09-19T14:12:17.823 INFO:tasks.workunit.client.0.smithi153.stderr: -222> 2024-09-19T14:12:17.638+0000 7f2f6dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:17.823 INFO:tasks.workunit.client.0.smithi153.stderr: -221> 2024-09-19T14:12:17.638+0000 7f2f6dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:12:17.823 INFO:tasks.workunit.client.0.smithi153.stderr: -220> 2024-09-19T14:12:17.638+0000 7f2f6dffb640 10 monclient: dump: 2024-09-19T14:12:17.823 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:17.823 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:17.823 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.824 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.824 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:17.824 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.824 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:17.824 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:17.824 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:17.824 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.824 INFO:tasks.workunit.client.0.smithi153.stderr: -219> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient: shutdown 2024-09-19T14:12:17.824 INFO:tasks.workunit.client.0.smithi153.stderr: -218> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient: build_initial_monmap 2024-09-19T14:12:17.824 INFO:tasks.workunit.client.0.smithi153.stderr: -217> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 1 build_initial for_mkfs: 0 2024-09-19T14:12:17.824 INFO:tasks.workunit.client.0.smithi153.stderr: -216> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient: monmap: 2024-09-19T14:12:17.824 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:12:17.824 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:12:17.824 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:12:17.825 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:12:17.825 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:12:17.825 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.825 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:12:17.825 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:12:17.825 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:12:17.825 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.825 INFO:tasks.workunit.client.0.smithi153.stderr: -215> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding auth protocol: cephx 2024-09-19T14:12:17.825 INFO:tasks.workunit.client.0.smithi153.stderr: -214> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding auth protocol: cephx 2024-09-19T14:12:17.825 INFO:tasks.workunit.client.0.smithi153.stderr: -213> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding auth protocol: cephx 2024-09-19T14:12:17.825 INFO:tasks.workunit.client.0.smithi153.stderr: -212> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding con mode: secure 2024-09-19T14:12:17.825 INFO:tasks.workunit.client.0.smithi153.stderr: -211> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding con mode: crc 2024-09-19T14:12:17.825 INFO:tasks.workunit.client.0.smithi153.stderr: -210> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding con mode: secure 2024-09-19T14:12:17.825 INFO:tasks.workunit.client.0.smithi153.stderr: -209> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding con mode: crc 2024-09-19T14:12:17.825 INFO:tasks.workunit.client.0.smithi153.stderr: -208> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding con mode: secure 2024-09-19T14:12:17.826 INFO:tasks.workunit.client.0.smithi153.stderr: -207> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding con mode: crc 2024-09-19T14:12:17.826 INFO:tasks.workunit.client.0.smithi153.stderr: -206> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding con mode: crc 2024-09-19T14:12:17.826 INFO:tasks.workunit.client.0.smithi153.stderr: -205> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding con mode: secure 2024-09-19T14:12:17.826 INFO:tasks.workunit.client.0.smithi153.stderr: -204> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding con mode: crc 2024-09-19T14:12:17.826 INFO:tasks.workunit.client.0.smithi153.stderr: -203> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding con mode: secure 2024-09-19T14:12:17.826 INFO:tasks.workunit.client.0.smithi153.stderr: -202> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding con mode: crc 2024-09-19T14:12:17.826 INFO:tasks.workunit.client.0.smithi153.stderr: -201> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101b50f0) adding con mode: secure 2024-09-19T14:12:17.826 INFO:tasks.workunit.client.0.smithi153.stderr: -200> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.826 INFO:tasks.workunit.client.0.smithi153.stderr: -199> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 1 librados: starting msgr at 2024-09-19T14:12:17.826 INFO:tasks.workunit.client.0.smithi153.stderr: -198> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 1 librados: starting objecter 2024-09-19T14:12:17.826 INFO:tasks.workunit.client.0.smithi153.stderr: -197> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command objecter_requests cmddesc objecter_requests hook 0x55c7101e20a0 EEXIST 2024-09-19T14:12:17.826 INFO:tasks.workunit.client.0.smithi153.stderr: -196> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 1 librados: setting wanted keys 2024-09-19T14:12:17.826 INFO:tasks.workunit.client.0.smithi153.stderr: -195> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 1 librados: calling monclient init 2024-09-19T14:12:17.826 INFO:tasks.workunit.client.0.smithi153.stderr: -194> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 10 monclient: init 2024-09-19T14:12:17.827 INFO:tasks.workunit.client.0.smithi153.stderr: -193> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding auth protocol: cephx 2024-09-19T14:12:17.827 INFO:tasks.workunit.client.0.smithi153.stderr: -192> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding auth protocol: cephx 2024-09-19T14:12:17.827 INFO:tasks.workunit.client.0.smithi153.stderr: -191> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding auth protocol: cephx 2024-09-19T14:12:17.827 INFO:tasks.workunit.client.0.smithi153.stderr: -190> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding con mode: secure 2024-09-19T14:12:17.827 INFO:tasks.workunit.client.0.smithi153.stderr: -189> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding con mode: crc 2024-09-19T14:12:17.827 INFO:tasks.workunit.client.0.smithi153.stderr: -188> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding con mode: secure 2024-09-19T14:12:17.827 INFO:tasks.workunit.client.0.smithi153.stderr: -187> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding con mode: crc 2024-09-19T14:12:17.827 INFO:tasks.workunit.client.0.smithi153.stderr: -186> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding con mode: secure 2024-09-19T14:12:17.827 INFO:tasks.workunit.client.0.smithi153.stderr: -185> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding con mode: crc 2024-09-19T14:12:17.827 INFO:tasks.workunit.client.0.smithi153.stderr: -184> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding con mode: crc 2024-09-19T14:12:17.828 INFO:tasks.workunit.client.0.smithi153.stderr: -183> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding con mode: secure 2024-09-19T14:12:17.828 INFO:tasks.workunit.client.0.smithi153.stderr: -182> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding con mode: crc 2024-09-19T14:12:17.828 INFO:tasks.workunit.client.0.smithi153.stderr: -181> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding con mode: secure 2024-09-19T14:12:17.828 INFO:tasks.workunit.client.0.smithi153.stderr: -180> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding con mode: crc 2024-09-19T14:12:17.828 INFO:tasks.workunit.client.0.smithi153.stderr: -179> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 5 AuthRegistry(0x55c7101abb10) adding con mode: secure 2024-09-19T14:12:17.828 INFO:tasks.workunit.client.0.smithi153.stderr: -178> 2024-09-19T14:12:17.638+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.828 INFO:tasks.workunit.client.0.smithi153.stderr: -177> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.828 INFO:tasks.workunit.client.0.smithi153.stderr: -176> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command rotate-key cmddesc rotate-key hook 0x55c7101abc58 EEXIST 2024-09-19T14:12:17.828 INFO:tasks.workunit.client.0.smithi153.stderr: -175> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient: _reopen_session rank -1 2024-09-19T14:12:17.828 INFO:tasks.workunit.client.0.smithi153.stderr: -174> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:12:17.828 INFO:tasks.workunit.client.0.smithi153.stderr: -173> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient(hunting): picked mon.noname-b con 0x55c7101b7970 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:12:17.828 INFO:tasks.workunit.client.0.smithi153.stderr: -172> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient(hunting): picked mon.noname-a con 0x55c7101e3720 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:12:17.828 INFO:tasks.workunit.client.0.smithi153.stderr: -171> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient(hunting): picked mon.noname-c con 0x55c7101e7f50 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:12:17.828 INFO:tasks.workunit.client.0.smithi153.stderr: -170> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:17.829 INFO:tasks.workunit.client.0.smithi153.stderr: -169> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:17.829 INFO:tasks.workunit.client.0.smithi153.stderr: -168> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:17.829 INFO:tasks.workunit.client.0.smithi153.stderr: -167> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient(hunting): _renew_subs 2024-09-19T14:12:17.829 INFO:tasks.workunit.client.0.smithi153.stderr: -166> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient(hunting): authenticate will time out at 2926.104324s 2024-09-19T14:12:17.829 INFO:tasks.workunit.client.0.smithi153.stderr: -165> 2024-09-19T14:12:17.642+0000 7f3083fff640 10 monclient(hunting): get_auth_request con 0x55c7101e3720 auth_method 0 2024-09-19T14:12:17.829 INFO:tasks.workunit.client.0.smithi153.stderr: -164> 2024-09-19T14:12:17.642+0000 7f3083fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:17.829 INFO:tasks.workunit.client.0.smithi153.stderr: -163> 2024-09-19T14:12:17.642+0000 7f3083fff640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:17.829 INFO:tasks.workunit.client.0.smithi153.stderr: -162> 2024-09-19T14:12:17.642+0000 7f3083fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:17.829 INFO:tasks.workunit.client.0.smithi153.stderr: -161> 2024-09-19T14:12:17.642+0000 7f308a9db640 10 monclient(hunting): get_auth_request con 0x55c7101e7f50 auth_method 0 2024-09-19T14:12:17.829 INFO:tasks.workunit.client.0.smithi153.stderr: -160> 2024-09-19T14:12:17.642+0000 7f308a9db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:17.829 INFO:tasks.workunit.client.0.smithi153.stderr: -159> 2024-09-19T14:12:17.642+0000 7f308a9db640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:17.829 INFO:tasks.workunit.client.0.smithi153.stderr: -158> 2024-09-19T14:12:17.642+0000 7f308a9db640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:17.829 INFO:tasks.workunit.client.0.smithi153.stderr: -157> 2024-09-19T14:12:17.642+0000 7f3083fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:17.830 INFO:tasks.workunit.client.0.smithi153.stderr: -156> 2024-09-19T14:12:17.642+0000 7f3083fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:17.830 INFO:tasks.workunit.client.0.smithi153.stderr: -155> 2024-09-19T14:12:17.642+0000 7f3083fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:17.830 INFO:tasks.workunit.client.0.smithi153.stderr: -154> 2024-09-19T14:12:17.642+0000 7f308a9db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:17.830 INFO:tasks.workunit.client.0.smithi153.stderr: -153> 2024-09-19T14:12:17.642+0000 7f308a9db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:17.830 INFO:tasks.workunit.client.0.smithi153.stderr: -152> 2024-09-19T14:12:17.642+0000 7f308a9db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:17.830 INFO:tasks.workunit.client.0.smithi153.stderr: -151> 2024-09-19T14:12:17.642+0000 7f308a1da640 10 monclient(hunting): get_auth_request con 0x55c7101b7970 auth_method 0 2024-09-19T14:12:17.830 INFO:tasks.workunit.client.0.smithi153.stderr: -150> 2024-09-19T14:12:17.642+0000 7f308a1da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:17.830 INFO:tasks.workunit.client.0.smithi153.stderr: -149> 2024-09-19T14:12:17.642+0000 7f308a1da640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:17.830 INFO:tasks.workunit.client.0.smithi153.stderr: -148> 2024-09-19T14:12:17.642+0000 7f308a1da640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:17.830 INFO:tasks.workunit.client.0.smithi153.stderr: -147> 2024-09-19T14:12:17.642+0000 7f3083fff640 10 monclient(hunting): handle_auth_done global_id 8205 payload 824 2024-09-19T14:12:17.830 INFO:tasks.workunit.client.0.smithi153.stderr: -146> 2024-09-19T14:12:17.642+0000 7f3083fff640 10 monclient: _finish_hunting 0 2024-09-19T14:12:17.830 INFO:tasks.workunit.client.0.smithi153.stderr: -145> 2024-09-19T14:12:17.642+0000 7f3083fff640 1 monclient: found mon.noname-a 2024-09-19T14:12:17.830 INFO:tasks.workunit.client.0.smithi153.stderr: -144> 2024-09-19T14:12:17.642+0000 7f3083fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:12:17.830 INFO:tasks.workunit.client.0.smithi153.stderr: -143> 2024-09-19T14:12:17.642+0000 7f2f5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:17.831 INFO:tasks.workunit.client.0.smithi153.stderr: -142> 2024-09-19T14:12:17.642+0000 7f2f5bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:12:17.831 INFO:tasks.workunit.client.0.smithi153.stderr: -141> 2024-09-19T14:12:17.642+0000 7f2f5bfff640 10 monclient: dump: 2024-09-19T14:12:17.831 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:17.831 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:17.831 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.831 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.831 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:17.831 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.831 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:17.831 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:17.831 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:17.831 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.831 INFO:tasks.workunit.client.0.smithi153.stderr: -140> 2024-09-19T14:12:17.642+0000 7f2f5bfff640 10 monclient: _finish_auth 0 2024-09-19T14:12:17.831 INFO:tasks.workunit.client.0.smithi153.stderr: -139> 2024-09-19T14:12:17.642+0000 7f2f5bfff640 10 monclient: _check_auth_tickets 2024-09-19T14:12:17.832 INFO:tasks.workunit.client.0.smithi153.stderr: -138> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 5 monclient: authenticate success, global_id 8205 2024-09-19T14:12:17.832 INFO:tasks.workunit.client.0.smithi153.stderr: -137> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient: _renew_subs 2024-09-19T14:12:17.832 INFO:tasks.workunit.client.0.smithi153.stderr: -136> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:12:17.832 INFO:tasks.workunit.client.0.smithi153.stderr: -135> 2024-09-19T14:12:17.642+0000 7f2f5bfff640 10 monclient: handle_config config(0 keys) 2024-09-19T14:12:17.832 INFO:tasks.workunit.client.0.smithi153.stderr: -134> 2024-09-19T14:12:17.642+0000 7f2f6dffb640 4 set_mon_vals no callback set 2024-09-19T14:12:17.832 INFO:tasks.workunit.client.0.smithi153.stderr: -133> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient: _renew_subs 2024-09-19T14:12:17.832 INFO:tasks.workunit.client.0.smithi153.stderr: -132> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:12:17.832 INFO:tasks.workunit.client.0.smithi153.stderr: -131> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 1 librados: init done 2024-09-19T14:12:17.832 INFO:tasks.workunit.client.0.smithi153.stderr: -130> 2024-09-19T14:12:17.642+0000 7f2f5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:17.832 INFO:tasks.workunit.client.0.smithi153.stderr: -129> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command cr dump hook 0x55c7101d89c8 2024-09-19T14:12:17.832 INFO:tasks.workunit.client.0.smithi153.stderr: -128> 2024-09-19T14:12:17.642+0000 7f2f5bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:12:17.832 INFO:tasks.workunit.client.0.smithi153.stderr: -127> 2024-09-19T14:12:17.642+0000 7f2f5bfff640 10 monclient: dump: 2024-09-19T14:12:17.832 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:17.833 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:17.833 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.833 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:17.833 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:17.833 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:17.833 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:17.833 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:17.833 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:17.833 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.833 INFO:tasks.workunit.client.0.smithi153.stderr: -126> 2024-09-19T14:12:17.642+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.833 INFO:tasks.workunit.client.0.smithi153.stderr: -125> 2024-09-19T14:12:17.642+0000 7f2f5bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:12:17.833 INFO:tasks.workunit.client.0.smithi153.stderr: -124> 2024-09-19T14:12:17.642+0000 7f2f5bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:12:17.833 INFO:tasks.workunit.client.0.smithi153.stderr: -123> 2024-09-19T14:12:17.642+0000 7f2f5bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:12:17.833 INFO:tasks.workunit.client.0.smithi153.stderr: -122> 2024-09-19T14:12:17.642+0000 7f308a1da640 10 monclient: get_auth_request con 0x7f2f54071c10 auth_method 0 2024-09-19T14:12:17.834 INFO:tasks.workunit.client.0.smithi153.stderr: -121> 2024-09-19T14:12:17.642+0000 7f308a9db640 10 monclient: get_auth_request con 0x55c710201e30 auth_method 0 2024-09-19T14:12:17.834 INFO:tasks.workunit.client.0.smithi153.stderr: -120> 2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.834 INFO:tasks.workunit.client.0.smithi153.stderr: -119> 2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 realm 2024-09-19T14:12:17.834 INFO:tasks.workunit.client.0.smithi153.stderr: -118> 2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.834 INFO:tasks.workunit.client.0.smithi153.stderr: -117> 2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.834 INFO:tasks.workunit.client.0.smithi153.stderr: -116> 2024-09-19T14:12:17.646+0000 7f308c6d49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:12:17.834 INFO:tasks.workunit.client.0.smithi153.stderr: -115> 2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.834 INFO:tasks.workunit.client.0.smithi153.stderr: -114> 2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.834 INFO:tasks.workunit.client.0.smithi153.stderr: -113> 2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.834 INFO:tasks.workunit.client.0.smithi153.stderr: -112> 2024-09-19T14:12:17.646+0000 7f308a1da640 10 monclient: get_auth_request con 0x55c710205fe0 auth_method 0 2024-09-19T14:12:17.834 INFO:tasks.workunit.client.0.smithi153.stderr: -111> 2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:17.834 INFO:tasks.workunit.client.0.smithi153.stderr: -110> 2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.834 INFO:tasks.workunit.client.0.smithi153.stderr: -109> 2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:12:17.834 INFO:tasks.workunit.client.0.smithi153.stderr: -108> 2024-09-19T14:12:17.646+0000 7f308c6d49c0 20 searching for the correct realm 2024-09-19T14:12:17.834 INFO:tasks.workunit.client.0.smithi153.stderr: -107> 2024-09-19T14:12:17.646+0000 7f3083fff640 10 monclient: get_auth_request con 0x55c71020b370 auth_method 0 2024-09-19T14:12:17.835 INFO:tasks.workunit.client.0.smithi153.stderr: -106> 2024-09-19T14:12:17.646+0000 7f308a9db640 10 monclient: get_auth_request con 0x7f307404d060 auth_method 0 2024-09-19T14:12:17.835 INFO:tasks.workunit.client.0.smithi153.stderr: -105> 2024-09-19T14:12:17.650+0000 7f308a1da640 10 monclient: get_auth_request con 0x7f3084061990 auth_method 0 2024-09-19T14:12:17.835 INFO:tasks.workunit.client.0.smithi153.stderr: -104> 2024-09-19T14:12:17.650+0000 7f3083fff640 10 monclient: get_auth_request con 0x7f307c0c3bd0 auth_method 0 2024-09-19T14:12:17.835 INFO:tasks.workunit.client.0.smithi153.stderr: -103> 2024-09-19T14:12:17.654+0000 7f3083fff640 0 -- 172.21.15.153:0/3164683518 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f307c0c3bd0 msgr2=0x7f307c0ef400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:12:17.835 INFO:tasks.workunit.client.0.smithi153.stderr: -102> 2024-09-19T14:12:17.654+0000 7f2f5bfff640 1 client.8205.objecter ms_handle_reset 0x7f307c0c3bd0 session 0x7f307c0c9040 osd.4 2024-09-19T14:12:17.835 INFO:tasks.workunit.client.0.smithi153.stderr: -101> 2024-09-19T14:12:17.654+0000 7f2f5bfff640 10 monclient: _renew_subs 2024-09-19T14:12:17.835 INFO:tasks.workunit.client.0.smithi153.stderr: -100> 2024-09-19T14:12:17.654+0000 7f2f5bfff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:12:17.835 INFO:tasks.workunit.client.0.smithi153.stderr: -99> 2024-09-19T14:12:17.654+0000 7f308a9db640 10 monclient: get_auth_request con 0x7f3074094bd0 auth_method 0 2024-09-19T14:12:17.835 INFO:tasks.workunit.client.0.smithi153.stderr: -98> 2024-09-19T14:12:17.654+0000 7f3083fff640 10 monclient: get_auth_request con 0x7f2f54082340 auth_method 0 2024-09-19T14:12:17.835 INFO:tasks.workunit.client.0.smithi153.stderr: -97> 2024-09-19T14:12:17.658+0000 7f308a1da640 10 monclient: get_auth_request con 0x7f3074056300 auth_method 0 2024-09-19T14:12:17.835 INFO:tasks.workunit.client.0.smithi153.stderr: -96> 2024-09-19T14:12:17.658+0000 7f308a9db640 0 -- 172.21.15.153:0/3164683518 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7f3074094bd0 msgr2=0x7f3074066320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:12:17.835 INFO:tasks.workunit.client.0.smithi153.stderr: -95> 2024-09-19T14:12:17.658+0000 7f2f5bfff640 1 client.8205.objecter ms_handle_reset 0x7f3074094bd0 session 0x7f3074051040 osd.6 2024-09-19T14:12:17.835 INFO:tasks.workunit.client.0.smithi153.stderr: -94> 2024-09-19T14:12:17.658+0000 7f308a9db640 10 monclient: get_auth_request con 0x7f307c0c3bd0 auth_method 0 2024-09-19T14:12:17.835 INFO:tasks.workunit.client.0.smithi153.stderr: -93> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:12:17.836 INFO:tasks.workunit.client.0.smithi153.stderr: -92> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:12:17.836 INFO:tasks.workunit.client.0.smithi153.stderr: -91> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:12:17.836 INFO:tasks.workunit.client.0.smithi153.stderr: -90> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:12:17.836 INFO:tasks.workunit.client.0.smithi153.stderr: -89> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:12:17.836 INFO:tasks.workunit.client.0.smithi153.stderr: -88> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:12:17.836 INFO:tasks.workunit.client.0.smithi153.stderr: -87> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.836 INFO:tasks.workunit.client.0.smithi153.stderr: -86> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.836 INFO:tasks.workunit.client.0.smithi153.stderr: -85> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.836 INFO:tasks.workunit.client.0.smithi153.stderr: -84> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:17.836 INFO:tasks.workunit.client.0.smithi153.stderr: -83> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.836 INFO:tasks.workunit.client.0.smithi153.stderr: -82> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:12:17.836 INFO:tasks.workunit.client.0.smithi153.stderr: -81> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 zone default found 2024-09-19T14:12:17.836 INFO:tasks.workunit.client.0.smithi153.stderr: -80> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 4 Realm: () 2024-09-19T14:12:17.837 INFO:tasks.workunit.client.0.smithi153.stderr: -79> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:12:17.837 INFO:tasks.workunit.client.0.smithi153.stderr: -78> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:12:17.837 INFO:tasks.workunit.client.0.smithi153.stderr: -77> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:12:17.837 INFO:tasks.workunit.client.0.smithi153.stderr: -76> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 zonegroup default 2024-09-19T14:12:17.837 INFO:tasks.workunit.client.0.smithi153.stderr: -75> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.837 INFO:tasks.workunit.client.0.smithi153.stderr: -74> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.837 INFO:tasks.workunit.client.0.smithi153.stderr: -73> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.837 INFO:tasks.workunit.client.0.smithi153.stderr: -72> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.837 INFO:tasks.workunit.client.0.smithi153.stderr: -71> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.837 INFO:tasks.workunit.client.0.smithi153.stderr: -70> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.837 INFO:tasks.workunit.client.0.smithi153.stderr: -69> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 started sync module instance, tier type = 2024-09-19T14:12:17.837 INFO:tasks.workunit.client.0.smithi153.stderr: -68> 2024-09-19T14:12:17.666+0000 7f308c6d49c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:12:17.837 INFO:tasks.workunit.client.0.smithi153.stderr: -67> 2024-09-19T14:12:17.682+0000 7f308c6d49c0 20 add_watcher() i=0 2024-09-19T14:12:17.837 INFO:tasks.workunit.client.0.smithi153.stderr: -66> 2024-09-19T14:12:17.682+0000 7f308c6d49c0 20 add_watcher() i=1 2024-09-19T14:12:17.838 INFO:tasks.workunit.client.0.smithi153.stderr: -65> 2024-09-19T14:12:17.682+0000 7f308c6d49c0 20 add_watcher() i=2 2024-09-19T14:12:17.838 INFO:tasks.workunit.client.0.smithi153.stderr: -64> 2024-09-19T14:12:17.682+0000 7f308c6d49c0 20 add_watcher() i=3 2024-09-19T14:12:17.838 INFO:tasks.workunit.client.0.smithi153.stderr: -63> 2024-09-19T14:12:17.682+0000 7f308c6d49c0 20 add_watcher() i=4 2024-09-19T14:12:17.838 INFO:tasks.workunit.client.0.smithi153.stderr: -62> 2024-09-19T14:12:17.682+0000 7f308c6d49c0 20 add_watcher() i=5 2024-09-19T14:12:17.838 INFO:tasks.workunit.client.0.smithi153.stderr: -61> 2024-09-19T14:12:17.682+0000 7f308c6d49c0 20 add_watcher() i=6 2024-09-19T14:12:17.838 INFO:tasks.workunit.client.0.smithi153.stderr: -60> 2024-09-19T14:12:17.682+0000 7f308c6d49c0 20 add_watcher() i=7 2024-09-19T14:12:17.838 INFO:tasks.workunit.client.0.smithi153.stderr: -59> 2024-09-19T14:12:17.682+0000 7f308c6d49c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:12:17.838 INFO:tasks.workunit.client.0.smithi153.stderr: -58> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding auth protocol: cephx 2024-09-19T14:12:17.838 INFO:tasks.workunit.client.0.smithi153.stderr: -57> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding auth protocol: cephx 2024-09-19T14:12:17.838 INFO:tasks.workunit.client.0.smithi153.stderr: -56> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding auth protocol: cephx 2024-09-19T14:12:17.838 INFO:tasks.workunit.client.0.smithi153.stderr: -55> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding con mode: secure 2024-09-19T14:12:17.838 INFO:tasks.workunit.client.0.smithi153.stderr: -54> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding con mode: crc 2024-09-19T14:12:17.838 INFO:tasks.workunit.client.0.smithi153.stderr: -53> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding con mode: secure 2024-09-19T14:12:17.838 INFO:tasks.workunit.client.0.smithi153.stderr: -52> 2024-09-19T14:12:17.686+0000 7f2f417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:12:17.839 INFO:tasks.workunit.client.0.smithi153.stderr: -51> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding con mode: crc 2024-09-19T14:12:17.839 INFO:tasks.workunit.client.0.smithi153.stderr: -50> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding con mode: secure 2024-09-19T14:12:17.839 INFO:tasks.workunit.client.0.smithi153.stderr: -49> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding con mode: crc 2024-09-19T14:12:17.839 INFO:tasks.workunit.client.0.smithi153.stderr: -48> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding con mode: crc 2024-09-19T14:12:17.839 INFO:tasks.workunit.client.0.smithi153.stderr: -47> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding con mode: secure 2024-09-19T14:12:17.839 INFO:tasks.workunit.client.0.smithi153.stderr: -46> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding con mode: crc 2024-09-19T14:12:17.839 INFO:tasks.workunit.client.0.smithi153.stderr: -45> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding con mode: secure 2024-09-19T14:12:17.839 INFO:tasks.workunit.client.0.smithi153.stderr: -44> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding con mode: crc 2024-09-19T14:12:17.839 INFO:tasks.workunit.client.0.smithi153.stderr: -43> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 AuthRegistry(0x7ffcba44a000) adding con mode: secure 2024-09-19T14:12:17.839 INFO:tasks.workunit.client.0.smithi153.stderr: -42> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:17.839 INFO:tasks.workunit.client.0.smithi153.stderr: -41> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:12:17.839 INFO:tasks.workunit.client.0.smithi153.stderr: -40> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:12:17.839 INFO:tasks.workunit.client.0.smithi153.stderr: -39> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command cache list hook 0x55c7101d7000 2024-09-19T14:12:17.839 INFO:tasks.workunit.client.0.smithi153.stderr: -38> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command cache inspect hook 0x55c7101d7000 2024-09-19T14:12:17.839 INFO:tasks.workunit.client.0.smithi153.stderr: -37> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command cache erase hook 0x55c7101d7000 2024-09-19T14:12:17.840 INFO:tasks.workunit.client.0.smithi153.stderr: -36> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command cache zap hook 0x55c7101d7000 2024-09-19T14:12:17.840 INFO:tasks.workunit.client.0.smithi153.stderr: -35> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 note: GC not initialized 2024-09-19T14:12:17.840 INFO:tasks.workunit.client.0.smithi153.stderr: -34> 2024-09-19T14:12:17.686+0000 7f2f3b7fe640 20 reqs_thread_entry: start 2024-09-19T14:12:17.840 INFO:tasks.workunit.client.0.smithi153.stderr: -33> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command sync trace show hook 0x7f30740043b0 2024-09-19T14:12:17.840 INFO:tasks.workunit.client.0.smithi153.stderr: -32> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command sync trace history hook 0x7f30740043b0 2024-09-19T14:12:17.840 INFO:tasks.workunit.client.0.smithi153.stderr: -31> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command sync trace active hook 0x7f30740043b0 2024-09-19T14:12:17.840 INFO:tasks.workunit.client.0.smithi153.stderr: -30> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 5 asok(0x55c70ff0ad90) register_command sync trace active_short hook 0x7f30740043b0 2024-09-19T14:12:17.840 INFO:tasks.workunit.client.0.smithi153.stderr: -29> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 20 init_complete bucket index max shards: 11 2024-09-19T14:12:17.840 INFO:tasks.workunit.client.0.smithi153.stderr: -28> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 20 Filter name: none 2024-09-19T14:12:17.840 INFO:tasks.workunit.client.0.smithi153.stderr: -27> 2024-09-19T14:12:17.686+0000 7f2f397fa640 20 reqs_thread_entry: start 2024-09-19T14:12:17.840 INFO:tasks.workunit.client.0.smithi153.stderr: -26> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:12:17.840 INFO:tasks.workunit.client.0.smithi153.stderr: -25> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.840 INFO:tasks.workunit.client.0.smithi153.stderr: -24> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:12:17.840 INFO:tasks.workunit.client.0.smithi153.stderr: -23> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:12:17.841 INFO:tasks.workunit.client.0.smithi153.stderr: -22> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:12:17.841 INFO:tasks.workunit.client.0.smithi153.stderr: -21> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : miss 2024-09-19T14:12:17.841 INFO:tasks.workunit.client.0.smithi153.stderr: -20> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.841 INFO:tasks.workunit.client.0.smithi153.stderr: -19> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:12:17.841 INFO:tasks.workunit.client.0.smithi153.stderr: -18> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:12:17.841 INFO:tasks.workunit.client.0.smithi153.stderr: -17> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:12:17.841 INFO:tasks.workunit.client.0.smithi153.stderr: -16> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:12:17.841 INFO:tasks.workunit.client.0.smithi153.stderr: -15> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:12:17.841 INFO:tasks.workunit.client.0.smithi153.stderr: -14> 2024-09-19T14:12:17.686+0000 7f308c6d49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:12:17.841 INFO:tasks.workunit.client.0.smithi153.stderr: -13> 2024-09-19T14:12:17.698+0000 7f308c6d49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:12:17.841 INFO:tasks.workunit.client.0.smithi153.stderr: -12> 2024-09-19T14:12:17.698+0000 7f308c6d49c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:12:17.841 INFO:tasks.workunit.client.0.smithi153.stderr: -11> 2024-09-19T14:12:17.698+0000 7f308c6d49c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:12:17.841 INFO:tasks.workunit.client.0.smithi153.stderr: -10> 2024-09-19T14:12:17.698+0000 7f308c6d49c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17, ofs0, ns] 2024-09-19T14:12:17.842 INFO:tasks.workunit.client.0.smithi153.stderr: -9> 2024-09-19T14:12:17.698+0000 7f2f6dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333527 cookie 94313457466496 notifier 8205 bl.length()=827 2024-09-19T14:12:17.842 INFO:tasks.workunit.client.0.smithi153.stderr: -8> 2024-09-19T14:12:17.698+0000 7f2f6dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:12:17.842 INFO:tasks.workunit.client.0.smithi153.stderr: -7> 2024-09-19T14:12:17.698+0000 7f2f6dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:12:17.842 INFO:tasks.workunit.client.0.smithi153.stderr: -6> 2024-09-19T14:12:17.698+0000 7f2f6dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:12:17.842 INFO:tasks.workunit.client.0.smithi153.stderr: -5> 2024-09-19T14:12:17.698+0000 7f308c6d49c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_sources= new_sources= 2024-09-19T14:12:17.842 INFO:tasks.workunit.client.0.smithi153.stderr: -4> 2024-09-19T14:12:17.698+0000 7f308c6d49c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential sources added=[] removed=[] 2024-09-19T14:12:17.842 INFO:tasks.workunit.client.0.smithi153.stderr: -3> 2024-09-19T14:12:17.698+0000 7f308c6d49c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_dests= new_dests= 2024-09-19T14:12:17.842 INFO:tasks.workunit.client.0.smithi153.stderr: -2> 2024-09-19T14:12:17.698+0000 7f308c6d49c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential dests added=[] removed=[] 2024-09-19T14:12:17.842 INFO:tasks.workunit.client.0.smithi153.stderr: -1> 2024-09-19T14:12:17.710+0000 7f308c6d49c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f308c6d49c0 time 2024-09-19T14:12:17.714547+0000 2024-09-19T14:12:17.842 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:12:17.842 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.842 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:12:17.842 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f308ffae2eb] 2024-09-19T14:12:17.842 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f308ffae49f] 2024-09-19T14:12:17.843 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c70d27e271] 2024-09-19T14:12:17.843 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55c70d28e14a] 2024-09-19T14:12:17.843 INFO:tasks.workunit.client.0.smithi153.stderr: 5: main() 2024-09-19T14:12:17.843 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f308ee14d90] 2024-09-19T14:12:17.843 INFO:tasks.workunit.client.0.smithi153.stderr: 7: __libc_start_main() 2024-09-19T14:12:17.843 INFO:tasks.workunit.client.0.smithi153.stderr: 8: _start() 2024-09-19T14:12:17.843 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.843 INFO:tasks.workunit.client.0.smithi153.stderr: 0> 2024-09-19T14:12:17.714+0000 7f308c6d49c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:12:17.843 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7f308c6d49c0 thread_name:radosgw-admin 2024-09-19T14:12:17.843 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.843 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:12:17.843 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f308ee2d520] 2024-09-19T14:12:17.843 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:12:17.843 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:12:17.844 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:12:17.844 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f308ffae345] 2024-09-19T14:12:17.844 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f308ffae49f] 2024-09-19T14:12:17.844 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c70d27e271] 2024-09-19T14:12:17.844 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55c70d28e14a] 2024-09-19T14:12:17.844 INFO:tasks.workunit.client.0.smithi153.stderr: 9: main() 2024-09-19T14:12:17.844 INFO:tasks.workunit.client.0.smithi153.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f308ee14d90] 2024-09-19T14:12:17.844 INFO:tasks.workunit.client.0.smithi153.stderr: 11: __libc_start_main() 2024-09-19T14:12:17.844 INFO:tasks.workunit.client.0.smithi153.stderr: 12: _start() 2024-09-19T14:12:17.844 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:12:17.844 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:17.844 INFO:tasks.workunit.client.0.smithi153.stderr:--- logging levels --- 2024-09-19T14:12:17.844 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 none 2024-09-19T14:12:17.844 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 lockdep 2024-09-19T14:12:17.845 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 context 2024-09-19T14:12:17.845 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 crush 2024-09-19T14:12:17.845 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds 2024-09-19T14:12:17.845 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_balancer 2024-09-19T14:12:17.845 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_locker 2024-09-19T14:12:17.845 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log 2024-09-19T14:12:17.845 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log_expire 2024-09-19T14:12:17.845 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_migrator 2024-09-19T14:12:17.845 INFO:tasks.workunit.client.0.smithi153.stderr: 3/ 5 mds_quiesce 2024-09-19T14:12:17.845 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 buffer 2024-09-19T14:12:17.845 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 timer 2024-09-19T14:12:17.845 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 filer 2024-09-19T14:12:17.845 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 striper 2024-09-19T14:12:17.845 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 objecter 2024-09-19T14:12:17.846 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rados 2024-09-19T14:12:17.846 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd 2024-09-19T14:12:17.846 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_mirror 2024-09-19T14:12:17.846 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_replay 2024-09-19T14:12:17.846 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_pwl 2024-09-19T14:12:17.846 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 journaler 2024-09-19T14:12:17.846 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objectcacher 2024-09-19T14:12:17.846 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:12:17.846 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 client 2024-09-19T14:12:17.846 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 osd 2024-09-19T14:12:17.846 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 optracker 2024-09-19T14:12:17.846 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objclass 2024-09-19T14:12:17.846 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 filestore 2024-09-19T14:12:17.846 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 journal 2024-09-19T14:12:17.847 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 ms 2024-09-19T14:12:17.847 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mon 2024-09-19T14:12:17.847 INFO:tasks.workunit.client.0.smithi153.stderr: 0/10 monc 2024-09-19T14:12:17.847 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 paxos 2024-09-19T14:12:17.847 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 tp 2024-09-19T14:12:17.847 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 auth 2024-09-19T14:12:17.847 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 crypto 2024-09-19T14:12:17.847 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 finisher 2024-09-19T14:12:17.847 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 reserver 2024-09-19T14:12:17.847 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 heartbeatmap 2024-09-19T14:12:17.847 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 perfcounter 2024-09-19T14:12:17.847 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw 2024-09-19T14:12:17.847 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_sync 2024-09-19T14:12:17.847 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_datacache 2024-09-19T14:12:17.848 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_access 2024-09-19T14:12:17.848 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:12:17.848 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_flight 2024-09-19T14:12:17.848 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:12:17.848 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw_notification 2024-09-19T14:12:17.848 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 javaclient 2024-09-19T14:12:17.848 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 asok 2024-09-19T14:12:17.848 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 throttle 2024-09-19T14:12:17.848 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 refs 2024-09-19T14:12:17.848 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 compressor 2024-09-19T14:12:17.848 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluestore 2024-09-19T14:12:17.848 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluefs 2024-09-19T14:12:17.848 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 bdev 2024-09-19T14:12:17.848 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 kstore 2024-09-19T14:12:17.848 INFO:tasks.workunit.client.0.smithi153.stderr: 4/ 5 rocksdb 2024-09-19T14:12:17.849 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 fuse 2024-09-19T14:12:17.849 INFO:tasks.workunit.client.0.smithi153.stderr: 2/ 5 mgr 2024-09-19T14:12:17.849 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mgrc 2024-09-19T14:12:17.849 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 dpdk 2024-09-19T14:12:17.849 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 eventtrace 2024-09-19T14:12:17.849 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 prioritycache 2024-09-19T14:12:17.849 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 test 2024-09-19T14:12:17.849 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:12:17.849 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephsqlite 2024-09-19T14:12:17.849 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:12:17.849 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore 2024-09-19T14:12:17.849 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_onode 2024-09-19T14:12:17.849 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_odata 2024-09-19T14:12:17.849 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_omap 2024-09-19T14:12:17.850 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_tm 2024-09-19T14:12:17.850 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_t 2024-09-19T14:12:17.850 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:12:17.850 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_epm 2024-09-19T14:12:17.850 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_lba 2024-09-19T14:12:17.850 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:12:17.850 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cache 2024-09-19T14:12:17.850 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_journal 2024-09-19T14:12:17.850 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_device 2024-09-19T14:12:17.850 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_backref 2024-09-19T14:12:17.850 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 alienstore 2024-09-19T14:12:17.850 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mclock 2024-09-19T14:12:17.850 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cyanstore 2024-09-19T14:12:17.850 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 ceph_exporter 2024-09-19T14:12:17.851 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 memstore 2024-09-19T14:12:17.851 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 trace 2024-09-19T14:12:17.851 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 ceph_dedup 2024-09-19T14:12:17.851 INFO:tasks.workunit.client.0.smithi153.stderr: -2/-2 (syslog threshold) 2024-09-19T14:12:17.851 INFO:tasks.workunit.client.0.smithi153.stderr: 99/99 (stderr threshold) 2024-09-19T14:12:17.851 INFO:tasks.workunit.client.0.smithi153.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:12:17.851 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2f397fa640 / http_manager 2024-09-19T14:12:17.851 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2f3b7fe640 / http_manager 2024-09-19T14:12:17.851 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2f417e2640 / rgw_dt_lg_renew 2024-09-19T14:12:17.851 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2f5bfff640 / ms_dispatch 2024-09-19T14:12:17.851 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2f6dffb640 / io_context_pool 2024-09-19T14:12:17.851 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2f6ffff640 / ms_dispatch 2024-09-19T14:12:17.851 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2f76e05640 / ms_dispatch 2024-09-19T14:12:17.851 INFO:tasks.workunit.client.0.smithi153.stderr: 7f2f78608640 / io_context_pool 2024-09-19T14:12:17.851 INFO:tasks.workunit.client.0.smithi153.stderr: 7f3083fff640 / msgr-worker-2 2024-09-19T14:12:17.852 INFO:tasks.workunit.client.0.smithi153.stderr: 7f308a1da640 / msgr-worker-1 2024-09-19T14:12:17.852 INFO:tasks.workunit.client.0.smithi153.stderr: 7f308a9db640 / msgr-worker-0 2024-09-19T14:12:17.852 INFO:tasks.workunit.client.0.smithi153.stderr: 7f308b1dc640 / io_context_pool 2024-09-19T14:12:17.852 INFO:tasks.workunit.client.0.smithi153.stderr: 7f308c6d49c0 / radosgw-admin 2024-09-19T14:12:17.852 INFO:tasks.workunit.client.0.smithi153.stderr: max_recent 500 2024-09-19T14:12:17.852 INFO:tasks.workunit.client.0.smithi153.stderr: max_new 1000 2024-09-19T14:12:17.852 INFO:tasks.workunit.client.0.smithi153.stderr: log_file /var/lib/ceph/crash/2024-09-19T14:12:17.716522Z_9cc2cb1a-7f59-4aba-9876-8e44eeccda0a/log 2024-09-19T14:12:17.852 INFO:tasks.workunit.client.0.smithi153.stderr:--- end dump of recent events --- 2024-09-19T14:12:17.852 INFO:tasks.workunit.client.0.smithi153.stderr:Aborted 2024-09-19T14:12:17.852 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T14:12:17.853 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:12:17.854 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:12:17.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.786+0000 7fdadc0829c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.786+0000 7fdadc0829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.786+0000 7fdadc0829c0 20 realm 2024-09-19T14:12:17.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.786+0000 7fdadc0829c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.786+0000 7fdadc0829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.786+0000 7fdadc0829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:12:17.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.786+0000 7fdadc0829c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.786+0000 7fdadc0829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:17.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.786+0000 7fdadc0829c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.786+0000 7fdadc0829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:17.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.786+0000 7fdadc0829c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:17.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.790+0000 7fdadc0829c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:12:17.854 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.790+0000 7fdadc0829c0 20 searching for the correct realm 2024-09-19T14:12:17.855 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:17.794+0000 7fdada389640 0 -- 172.21.15.153:0/681298099 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7fdad0073040 msgr2=0x7fdad005cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:12:18.011 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.010+0000 7fdad9b88640 0 -- 172.21.15.153:0/681298099 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x55a286dae510 msgr2=0x55a286db0900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:12:18.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.018+0000 7fdadc0829c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:12:18.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.018+0000 7fdadc0829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:12:18.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.018+0000 7fdadc0829c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:12:18.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.018+0000 7fdadc0829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:12:18.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.018+0000 7fdadc0829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:12:18.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.018+0000 7fdadc0829c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:12:18.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.018+0000 7fdadc0829c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:18.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.018+0000 7fdadc0829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:18.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.018+0000 7fdadc0829c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:18.020 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.018+0000 7fdadc0829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:18.020 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.018+0000 7fdadc0829c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:18.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.018+0000 7fdadc0829c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:12:18.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.018+0000 7fdadc0829c0 20 zone default found 2024-09-19T14:12:18.022 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.018+0000 7fdadc0829c0 4 Realm: () 2024-09-19T14:12:18.022 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.018+0000 7fdadc0829c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:12:18.022 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.018+0000 7fdadc0829c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:12:18.022 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.018+0000 7fdadc0829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:12:18.022 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.018+0000 7fdadc0829c0 20 zonegroup default 2024-09-19T14:12:18.022 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.018+0000 7fdadc0829c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:18.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.018+0000 7fdadc0829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:18.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.018+0000 7fdadc0829c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:18.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.022+0000 7fdadc0829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:18.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.022+0000 7fdadc0829c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:18.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.022+0000 7fdadc0829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:18.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.022+0000 7fdadc0829c0 20 started sync module instance, tier type = 2024-09-19T14:12:18.023 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.022+0000 7fdadc0829c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:12:18.045 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.042+0000 7fdadc0829c0 20 add_watcher() i=0 2024-09-19T14:12:18.045 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.042+0000 7fdadc0829c0 20 add_watcher() i=1 2024-09-19T14:12:18.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.042+0000 7fdadc0829c0 20 add_watcher() i=2 2024-09-19T14:12:18.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.042+0000 7fdadc0829c0 20 add_watcher() i=3 2024-09-19T14:12:18.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.042+0000 7fdadc0829c0 20 add_watcher() i=4 2024-09-19T14:12:18.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.042+0000 7fdadc0829c0 20 add_watcher() i=5 2024-09-19T14:12:18.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.042+0000 7fdadc0829c0 20 add_watcher() i=6 2024-09-19T14:12:18.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.046+0000 7fdadc0829c0 20 add_watcher() i=7 2024-09-19T14:12:18.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.046+0000 7fdadc0829c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:12:18.051 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.050+0000 7fd98b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:12:18.052 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.050+0000 7fdadc0829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:12:18.052 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.050+0000 7fdadc0829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:12:18.052 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.050+0000 7fdadc0829c0 5 note: GC not initialized 2024-09-19T14:12:18.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.050+0000 7fd98a7fc640 20 reqs_thread_entry: start 2024-09-19T14:12:18.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.050+0000 7fdadc0829c0 20 init_complete bucket index max shards: 11 2024-09-19T14:12:18.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.050+0000 7fdadc0829c0 20 Filter name: none 2024-09-19T14:12:18.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.050+0000 7fd8fbfff640 20 reqs_thread_entry: start 2024-09-19T14:12:18.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.050+0000 7fdadc0829c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:18.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.054+0000 7fdadc0829c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:12:18.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.054+0000 7fdadc0829c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:18.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.054+0000 7fdadc0829c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-19T14:12:18.056 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.054+0000 7fdadc0829c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:12:18.056 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.054+0000 7fdadc0829c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:18.056 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.054+0000 7fdadc0829c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:12:18.056 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.054+0000 7fdadc0829c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:18.057 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.054+0000 7fdadc0829c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-19T14:12:18.057 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.054+0000 7fdadc0829c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:12:18.060 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.058+0000 7fd98b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:12:18.065 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.062+0000 7fdadc0829c0 20 remove_watcher() i=0 2024-09-19T14:12:18.065 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.062+0000 7fdadc0829c0 2 removed watcher, disabling cache 2024-09-19T14:12:18.067 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.066+0000 7fdadc0829c0 20 remove_watcher() i=1 2024-09-19T14:12:18.069 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.066+0000 7fdadc0829c0 20 remove_watcher() i=2 2024-09-19T14:12:18.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.070+0000 7fdadc0829c0 20 remove_watcher() i=3 2024-09-19T14:12:18.073 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.070+0000 7fdadc0829c0 20 remove_watcher() i=4 2024-09-19T14:12:18.075 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.074+0000 7fdadc0829c0 20 remove_watcher() i=5 2024-09-19T14:12:18.076 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.074+0000 7fdadc0829c0 20 remove_watcher() i=6 2024-09-19T14:12:18.077 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.074+0000 7fdadc0829c0 20 remove_watcher() i=7 2024-09-19T14:12:18.095 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:12:18.095 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:12:18.155 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-19T14:12:18.186 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:12:18.186 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:12:18.232 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.230+0000 7f236c22f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:18.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.230+0000 7f236c22f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:18.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.230+0000 7f236c22f9c0 20 realm 2024-09-19T14:12:18.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.230+0000 7f236c22f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:18.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.230+0000 7f236c22f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:18.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.230+0000 7f236c22f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:12:18.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.230+0000 7f236c22f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:18.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.230+0000 7f236c22f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:18.234 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.230+0000 7f236c22f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:18.235 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.234+0000 7f236c22f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:18.235 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.234+0000 7f236c22f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:18.235 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.234+0000 7f236c22f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:12:18.235 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.234+0000 7f236c22f9c0 20 searching for the correct realm 2024-09-19T14:12:18.242 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.238+0000 7f236a536640 0 -- 172.21.15.153:0/3934876017 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7f235400f3d0 msgr2=0x7f235400f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:12:18.455 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.454+0000 7f2369d35640 0 -- 172.21.15.153:0/3934876017 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x555b5c61c8f0 msgr2=0x555b5c61ed00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:12:18.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.458+0000 7f236c22f9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:12:18.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.458+0000 7f236c22f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:12:18.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.458+0000 7f236c22f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:12:18.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.458+0000 7f236c22f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:12:18.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.458+0000 7f236c22f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:12:18.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.458+0000 7f236c22f9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:12:18.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.458+0000 7f236c22f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:18.462 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.462+0000 7f236c22f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:18.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.462+0000 7f236c22f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:18.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.462+0000 7f236c22f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:18.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.462+0000 7f236c22f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:18.464 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.462+0000 7f236c22f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:12:18.464 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.462+0000 7f236c22f9c0 20 zone default found 2024-09-19T14:12:18.464 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.462+0000 7f236c22f9c0 4 Realm: () 2024-09-19T14:12:18.464 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.462+0000 7f236c22f9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:12:18.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.462+0000 7f236c22f9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:12:18.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.462+0000 7f236c22f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:12:18.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.462+0000 7f236c22f9c0 20 zonegroup default 2024-09-19T14:12:18.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.462+0000 7f236c22f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:18.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.462+0000 7f236c22f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:18.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.462+0000 7f236c22f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:18.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.462+0000 7f236c22f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:18.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.462+0000 7f236c22f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:18.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.466+0000 7f236c22f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:18.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.466+0000 7f236c22f9c0 20 started sync module instance, tier type = 2024-09-19T14:12:18.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.466+0000 7f236c22f9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:12:18.488 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.486+0000 7f236c22f9c0 20 add_watcher() i=0 2024-09-19T14:12:18.488 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.486+0000 7f236c22f9c0 20 add_watcher() i=1 2024-09-19T14:12:18.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.486+0000 7f236c22f9c0 20 add_watcher() i=2 2024-09-19T14:12:18.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.486+0000 7f236c22f9c0 20 add_watcher() i=3 2024-09-19T14:12:18.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.486+0000 7f236c22f9c0 20 add_watcher() i=4 2024-09-19T14:12:18.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.486+0000 7f236c22f9c0 20 add_watcher() i=5 2024-09-19T14:12:18.489 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.486+0000 7f236c22f9c0 20 add_watcher() i=6 2024-09-19T14:12:18.492 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.490+0000 7f236c22f9c0 20 add_watcher() i=7 2024-09-19T14:12:18.492 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.490+0000 7f236c22f9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:12:18.496 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.494+0000 7f221b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:12:18.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.494+0000 7f236c22f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:12:18.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.494+0000 7f236c22f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:12:18.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.494+0000 7f236c22f9c0 5 note: GC not initialized 2024-09-19T14:12:18.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.494+0000 7f221a7fc640 20 reqs_thread_entry: start 2024-09-19T14:12:18.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.494+0000 7f236c22f9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:12:18.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.494+0000 7f236c22f9c0 20 Filter name: none 2024-09-19T14:12:18.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.498+0000 7f218bfff640 20 reqs_thread_entry: start 2024-09-19T14:12:18.498 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.498+0000 7f236c22f9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:12:18.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.498+0000 7f236c22f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:18.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.498+0000 7f236c22f9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:12:18.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.498+0000 7f236c22f9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:12:18.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.498+0000 7f236c22f9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:12:18.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.498+0000 7f236c22f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : miss 2024-09-19T14:12:18.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.498+0000 7f236c22f9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:18.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.498+0000 7f236c22f9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-19T14:12:18.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.498+0000 7f236c22f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:12:18.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.498+0000 7f236c22f9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:12:18.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.498+0000 7f236c22f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:12:18.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.498+0000 7f236c22f9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:12:18.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.498+0000 7f236c22f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:12:18.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.498+0000 7f236c22f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:12:18.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.498+0000 7f236c22f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:12:18.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.498+0000 7f236c22f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:12:18.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.498+0000 7f236c22f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:12:18.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.502+0000 7f236c22f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:12:18.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.502+0000 7f236c22f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:12:18.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.502+0000 7f236c22f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:12:18.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.502+0000 7f236c22f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:12:18.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.502+0000 7f236c22f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:12:18.504 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.502+0000 7f236c22f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:12:18.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.502+0000 7f236c22f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:12:18.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.502+0000 7f236c22f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:12:18.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.502+0000 7f236c22f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:12:18.505 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.502+0000 7f236c22f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:12:18.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.506+0000 7f236c22f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:12:18.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.506+0000 7f236c22f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:12:18.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.506+0000 7f236c22f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:12:18.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.506+0000 7f236c22f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:12:18.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.506+0000 7f236c22f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:12:18.508 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.506+0000 7f236c22f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:12:18.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.506+0000 7f236c22f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:12:18.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.506+0000 7f236c22f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:12:18.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.506+0000 7f236c22f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:12:18.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.506+0000 7f236c22f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:12:18.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.510+0000 7f236c22f9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:12:18.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.510+0000 7f236c22f9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:12:18.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.510+0000 7f221b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:12:18.517 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.514+0000 7f236c22f9c0 20 remove_watcher() i=0 2024-09-19T14:12:18.517 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.514+0000 7f236c22f9c0 2 removed watcher, disabling cache 2024-09-19T14:12:18.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.518+0000 7f236c22f9c0 20 remove_watcher() i=1 2024-09-19T14:12:18.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.518+0000 7f236c22f9c0 20 remove_watcher() i=2 2024-09-19T14:12:18.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.522+0000 7f236c22f9c0 20 remove_watcher() i=3 2024-09-19T14:12:18.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.526+0000 7f236c22f9c0 20 remove_watcher() i=4 2024-09-19T14:12:18.528 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.526+0000 7f236c22f9c0 20 remove_watcher() i=5 2024-09-19T14:12:18.529 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.526+0000 7f236c22f9c0 20 remove_watcher() i=6 2024-09-19T14:12:18.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:18.530+0000 7f236c22f9c0 20 remove_watcher() i=7 2024-09-19T14:12:48.568 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-19T14:12:48.607 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:12:48.607 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:12:48.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:48.650+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:48.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:48.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 realm 2024-09-19T14:12:48.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:48.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:48.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:12:48.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:48.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:48.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:48.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:48.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:48.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:12:48.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 searching for the correct realm 2024-09-19T14:12:48.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:48.862+0000 7f4e9b2e2640 0 -- 172.21.15.153:0/2583246184 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f4e8c008050 msgr2=0x7f4e8c030930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:12:49.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.278+0000 7f4e9bae3640 0 -- 172.21.15.153:0/2583246184 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f4e840c5bb0 msgr2=0x7f4e840c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:12:49.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:12:49.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:12:49.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:12:49.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:12:49.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:12:49.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:12:49.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:49.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:12:49.501 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 zone default found 2024-09-19T14:12:49.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 4 Realm: () 2024-09-19T14:12:49.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:12:49.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:12:49.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:12:49.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 zonegroup default 2024-09-19T14:12:49.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.502 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.502+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.502+0000 7f4e9dfdd9c0 20 started sync module instance, tier type = 2024-09-19T14:12:49.503 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.502+0000 7f4e9dfdd9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:12:49.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 20 add_watcher() i=0 2024-09-19T14:12:49.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 20 add_watcher() i=1 2024-09-19T14:12:49.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 20 add_watcher() i=2 2024-09-19T14:12:49.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 20 add_watcher() i=3 2024-09-19T14:12:49.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 20 add_watcher() i=4 2024-09-19T14:12:49.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 20 add_watcher() i=5 2024-09-19T14:12:49.524 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 20 add_watcher() i=6 2024-09-19T14:12:49.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 20 add_watcher() i=7 2024-09-19T14:12:49.526 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:12:49.531 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.530+0000 7f4d51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:12:49.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:12:49.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:12:49.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 note: GC not initialized 2024-09-19T14:12:49.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.530+0000 7f4d50fe1640 20 reqs_thread_entry: start 2024-09-19T14:12:49.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:12:49.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 20 Filter name: none 2024-09-19T14:12:49.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.530+0000 7f4cca7fc640 20 reqs_thread_entry: start 2024-09-19T14:12:49.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:12:49.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:12:49.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:12:49.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:12:49.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : miss 2024-09-19T14:12:49.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-19T14:12:49.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:12:49.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:12:49.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:12:49.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:12:49.536 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:12:49.537 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T14:12:49.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.550+0000 7f4e9dfdd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:12:49.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.550+0000 7f4e9dfdd9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:12:49.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.550+0000 7f4e9dfdd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:12:49.552 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.550+0000 7f4e9dfdd9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17, ofs0, ns] 2024-09-19T14:12:49.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.550+0000 7f4d7a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333528 cookie 94662027007440 notifier 8259 bl.length()=827 2024-09-19T14:12:49.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.550+0000 7f4d7a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:12:49.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.550+0000 7f4d7a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:12:49.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.550+0000 7f4d7a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:12:49.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.554+0000 7f4e9dfdd9c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_sources= new_sources= 2024-09-19T14:12:49.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.554+0000 7f4e9dfdd9c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential sources added=[] removed=[] 2024-09-19T14:12:49.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.554+0000 7f4e9dfdd9c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_dests= new_dests= 2024-09-19T14:12:49.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.554+0000 7f4e9dfdd9c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential dests added=[] removed=[] 2024-09-19T14:12:49.562 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4e9dfdd9c0 time 2024-09-19T14:12:49.564285+0000 2024-09-19T14:12:49.563 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:12:49.564 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:12:49.564 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4ea18b72eb] 2024-09-19T14:12:49.564 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4ea18b749f] 2024-09-19T14:12:49.564 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561835b51271] 2024-09-19T14:12:49.564 INFO:tasks.workunit.client.0.smithi153.stderr: 4: radosgw-admin(+0x141057c) [0x5618365a257c] 2024-09-19T14:12:49.564 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561835b610dd] 2024-09-19T14:12:49.564 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:12:49.565 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4ea071dd90] 2024-09-19T14:12:49.565 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:12:49.565 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:12:49.565 INFO:tasks.workunit.client.0.smithi153.stderr:*** Caught signal (Aborted) ** 2024-09-19T14:12:49.565 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7f4e9dfdd9c0 thread_name:radosgw-admin 2024-09-19T14:12:49.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.562+0000 7f4e9dfdd9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4e9dfdd9c0 time 2024-09-19T14:12:49.564285+0000 2024-09-19T14:12:49.565 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:12:49.565 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.565 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:12:49.565 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4ea18b72eb] 2024-09-19T14:12:49.565 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4ea18b749f] 2024-09-19T14:12:49.565 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561835b51271] 2024-09-19T14:12:49.565 INFO:tasks.workunit.client.0.smithi153.stderr: 4: radosgw-admin(+0x141057c) [0x5618365a257c] 2024-09-19T14:12:49.566 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561835b610dd] 2024-09-19T14:12:49.566 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:12:49.566 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4ea071dd90] 2024-09-19T14:12:49.566 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:12:49.566 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:12:49.566 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.578 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:12:49.578 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4ea0736520] 2024-09-19T14:12:49.578 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:12:49.578 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:12:49.579 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:12:49.579 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4ea18b7345] 2024-09-19T14:12:49.579 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4ea18b749f] 2024-09-19T14:12:49.579 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561835b51271] 2024-09-19T14:12:49.579 INFO:tasks.workunit.client.0.smithi153.stderr: 8: radosgw-admin(+0x141057c) [0x5618365a257c] 2024-09-19T14:12:49.579 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561835b610dd] 2024-09-19T14:12:49.579 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:12:49.579 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4ea071dd90] 2024-09-19T14:12:49.579 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:12:49.579 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:12:49.579 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.562+0000 7f4e9dfdd9c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:12:49.579 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7f4e9dfdd9c0 thread_name:radosgw-admin 2024-09-19T14:12:49.579 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.580 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:12:49.580 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4ea0736520] 2024-09-19T14:12:49.580 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:12:49.580 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:12:49.580 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:12:49.580 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4ea18b7345] 2024-09-19T14:12:49.580 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4ea18b749f] 2024-09-19T14:12:49.580 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561835b51271] 2024-09-19T14:12:49.580 INFO:tasks.workunit.client.0.smithi153.stderr: 8: radosgw-admin(+0x141057c) [0x5618365a257c] 2024-09-19T14:12:49.580 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561835b610dd] 2024-09-19T14:12:49.580 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:12:49.580 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4ea071dd90] 2024-09-19T14:12:49.580 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:12:49.580 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:12:49.581 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:12:49.581 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.581 INFO:tasks.workunit.client.0.smithi153.stderr:--- begin dump of recent events --- 2024-09-19T14:12:49.581 INFO:tasks.workunit.client.0.smithi153.stderr: -499> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:49.581 INFO:tasks.workunit.client.0.smithi153.stderr: -498> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_done global_id 8247 payload 274 2024-09-19T14:12:49.581 INFO:tasks.workunit.client.0.smithi153.stderr: -497> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient: _finish_hunting 0 2024-09-19T14:12:49.581 INFO:tasks.workunit.client.0.smithi153.stderr: -496> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 1 monclient: found mon.noname-a 2024-09-19T14:12:49.581 INFO:tasks.workunit.client.0.smithi153.stderr: -495> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:12:49.581 INFO:tasks.workunit.client.0.smithi153.stderr: -494> 2024-09-19T14:12:48.630+0000 7f4e9c2e4640 10 monclient: get_auth_request con 0x561838636cb0 auth_method 0 2024-09-19T14:12:49.581 INFO:tasks.workunit.client.0.smithi153.stderr: -493> 2024-09-19T14:12:48.630+0000 7f4d89e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:49.581 INFO:tasks.workunit.client.0.smithi153.stderr: -492> 2024-09-19T14:12:48.630+0000 7f4d89e0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:12:49.581 INFO:tasks.workunit.client.0.smithi153.stderr: -491> 2024-09-19T14:12:48.630+0000 7f4d89e0b640 10 monclient: dump: 2024-09-19T14:12:49.581 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:49.582 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:49.582 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.582 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.582 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:49.582 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.582 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:49.582 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:49.582 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:49.582 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.582 INFO:tasks.workunit.client.0.smithi153.stderr: -490> 2024-09-19T14:12:48.630+0000 7f4d89e0b640 10 monclient: _finish_auth 0 2024-09-19T14:12:49.582 INFO:tasks.workunit.client.0.smithi153.stderr: -489> 2024-09-19T14:12:48.630+0000 7f4d89e0b640 10 monclient: _check_auth_tickets 2024-09-19T14:12:49.582 INFO:tasks.workunit.client.0.smithi153.stderr: -488> 2024-09-19T14:12:48.630+0000 7f4d89e0b640 10 monclient: handle_config config(0 keys) 2024-09-19T14:12:49.582 INFO:tasks.workunit.client.0.smithi153.stderr: -487> 2024-09-19T14:12:48.630+0000 7f4d89e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:49.582 INFO:tasks.workunit.client.0.smithi153.stderr: -486> 2024-09-19T14:12:48.630+0000 7f4d89e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:12:49.583 INFO:tasks.workunit.client.0.smithi153.stderr: -485> 2024-09-19T14:12:48.630+0000 7f4d89e0b640 10 monclient: dump: 2024-09-19T14:12:49.583 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:49.583 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:49.583 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.583 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.583 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:49.583 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.583 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:49.583 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:49.583 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:49.583 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.583 INFO:tasks.workunit.client.0.smithi153.stderr: -484> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 monclient: authenticate success, global_id 8247 2024-09-19T14:12:49.583 INFO:tasks.workunit.client.0.smithi153.stderr: -483> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient: get_monmap_and_config success 2024-09-19T14:12:49.584 INFO:tasks.workunit.client.0.smithi153.stderr: -482> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 4 set_mon_vals no callback set 2024-09-19T14:12:49.584 INFO:tasks.workunit.client.0.smithi153.stderr: -481> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient: shutdown 2024-09-19T14:12:49.584 INFO:tasks.workunit.client.0.smithi153.stderr: -480> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) unregister_commands rotate-key 2024-09-19T14:12:49.584 INFO:tasks.workunit.client.0.smithi153.stderr: -479> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient: build_initial_monmap 2024-09-19T14:12:49.584 INFO:tasks.workunit.client.0.smithi153.stderr: -478> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 1 build_initial for_mkfs: 0 2024-09-19T14:12:49.584 INFO:tasks.workunit.client.0.smithi153.stderr: -477> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient: monmap: 2024-09-19T14:12:49.584 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:12:49.584 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:12:49.584 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:12:49.584 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:12:49.584 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:12:49.585 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.585 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:12:49.585 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:12:49.585 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:12:49.585 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.585 INFO:tasks.workunit.client.0.smithi153.stderr: -476> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding auth protocol: cephx 2024-09-19T14:12:49.585 INFO:tasks.workunit.client.0.smithi153.stderr: -475> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding auth protocol: cephx 2024-09-19T14:12:49.585 INFO:tasks.workunit.client.0.smithi153.stderr: -474> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding auth protocol: cephx 2024-09-19T14:12:49.585 INFO:tasks.workunit.client.0.smithi153.stderr: -473> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding con mode: secure 2024-09-19T14:12:49.585 INFO:tasks.workunit.client.0.smithi153.stderr: -472> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding con mode: crc 2024-09-19T14:12:49.585 INFO:tasks.workunit.client.0.smithi153.stderr: -471> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding con mode: secure 2024-09-19T14:12:49.585 INFO:tasks.workunit.client.0.smithi153.stderr: -470> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding con mode: crc 2024-09-19T14:12:49.585 INFO:tasks.workunit.client.0.smithi153.stderr: -469> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding con mode: secure 2024-09-19T14:12:49.585 INFO:tasks.workunit.client.0.smithi153.stderr: -468> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding con mode: crc 2024-09-19T14:12:49.586 INFO:tasks.workunit.client.0.smithi153.stderr: -467> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding con mode: crc 2024-09-19T14:12:49.586 INFO:tasks.workunit.client.0.smithi153.stderr: -466> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding con mode: secure 2024-09-19T14:12:49.586 INFO:tasks.workunit.client.0.smithi153.stderr: -465> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding con mode: crc 2024-09-19T14:12:49.586 INFO:tasks.workunit.client.0.smithi153.stderr: -464> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding con mode: secure 2024-09-19T14:12:49.586 INFO:tasks.workunit.client.0.smithi153.stderr: -463> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding con mode: crc 2024-09-19T14:12:49.586 INFO:tasks.workunit.client.0.smithi153.stderr: -462> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding con mode: secure 2024-09-19T14:12:49.586 INFO:tasks.workunit.client.0.smithi153.stderr: -461> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.586 INFO:tasks.workunit.client.0.smithi153.stderr: -460> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 1 librados: starting msgr at 2024-09-19T14:12:49.586 INFO:tasks.workunit.client.0.smithi153.stderr: -459> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 1 librados: starting objecter 2024-09-19T14:12:49.586 INFO:tasks.workunit.client.0.smithi153.stderr: -458> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command objecter_requests hook 0x5618386e8c50 2024-09-19T14:12:49.586 INFO:tasks.workunit.client.0.smithi153.stderr: -457> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 1 librados: setting wanted keys 2024-09-19T14:12:49.586 INFO:tasks.workunit.client.0.smithi153.stderr: -456> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 1 librados: calling monclient init 2024-09-19T14:12:49.586 INFO:tasks.workunit.client.0.smithi153.stderr: -455> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient: init 2024-09-19T14:12:49.586 INFO:tasks.workunit.client.0.smithi153.stderr: -454> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding auth protocol: cephx 2024-09-19T14:12:49.586 INFO:tasks.workunit.client.0.smithi153.stderr: -453> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding auth protocol: cephx 2024-09-19T14:12:49.587 INFO:tasks.workunit.client.0.smithi153.stderr: -452> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding auth protocol: cephx 2024-09-19T14:12:49.587 INFO:tasks.workunit.client.0.smithi153.stderr: -451> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding con mode: secure 2024-09-19T14:12:49.587 INFO:tasks.workunit.client.0.smithi153.stderr: -450> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding con mode: crc 2024-09-19T14:12:49.587 INFO:tasks.workunit.client.0.smithi153.stderr: -449> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding con mode: secure 2024-09-19T14:12:49.587 INFO:tasks.workunit.client.0.smithi153.stderr: -448> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding con mode: crc 2024-09-19T14:12:49.587 INFO:tasks.workunit.client.0.smithi153.stderr: -447> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding con mode: secure 2024-09-19T14:12:49.587 INFO:tasks.workunit.client.0.smithi153.stderr: -446> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding con mode: crc 2024-09-19T14:12:49.587 INFO:tasks.workunit.client.0.smithi153.stderr: -445> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding con mode: crc 2024-09-19T14:12:49.587 INFO:tasks.workunit.client.0.smithi153.stderr: -444> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding con mode: secure 2024-09-19T14:12:49.587 INFO:tasks.workunit.client.0.smithi153.stderr: -443> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding con mode: crc 2024-09-19T14:12:49.587 INFO:tasks.workunit.client.0.smithi153.stderr: -442> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding con mode: secure 2024-09-19T14:12:49.587 INFO:tasks.workunit.client.0.smithi153.stderr: -441> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding con mode: crc 2024-09-19T14:12:49.587 INFO:tasks.workunit.client.0.smithi153.stderr: -440> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding con mode: secure 2024-09-19T14:12:49.587 INFO:tasks.workunit.client.0.smithi153.stderr: -439> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.588 INFO:tasks.workunit.client.0.smithi153.stderr: -438> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.588 INFO:tasks.workunit.client.0.smithi153.stderr: -437> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command rotate-key hook 0x5618386eb208 2024-09-19T14:12:49.588 INFO:tasks.workunit.client.0.smithi153.stderr: -436> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient: _reopen_session rank -1 2024-09-19T14:12:49.588 INFO:tasks.workunit.client.0.smithi153.stderr: -435> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T14:12:49.588 INFO:tasks.workunit.client.0.smithi153.stderr: -434> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient(hunting): picked mon.noname-b con 0x56183859b290 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:12:49.588 INFO:tasks.workunit.client.0.smithi153.stderr: -433> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient(hunting): picked mon.noname-c con 0x561838633d50 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:12:49.588 INFO:tasks.workunit.client.0.smithi153.stderr: -432> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient(hunting): picked mon.noname-a con 0x561838636cb0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:12:49.588 INFO:tasks.workunit.client.0.smithi153.stderr: -431> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:49.588 INFO:tasks.workunit.client.0.smithi153.stderr: -430> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:49.588 INFO:tasks.workunit.client.0.smithi153.stderr: -429> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:49.588 INFO:tasks.workunit.client.0.smithi153.stderr: -428> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient(hunting): _renew_subs 2024-09-19T14:12:49.588 INFO:tasks.workunit.client.0.smithi153.stderr: -427> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient(hunting): authenticate will time out at 2957.094874s 2024-09-19T14:12:49.589 INFO:tasks.workunit.client.0.smithi153.stderr: -426> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient(hunting): get_auth_request con 0x561838633d50 auth_method 0 2024-09-19T14:12:49.589 INFO:tasks.workunit.client.0.smithi153.stderr: -425> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:49.589 INFO:tasks.workunit.client.0.smithi153.stderr: -424> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:49.589 INFO:tasks.workunit.client.0.smithi153.stderr: -423> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:49.589 INFO:tasks.workunit.client.0.smithi153.stderr: -422> 2024-09-19T14:12:48.630+0000 7f4e9c2e4640 10 monclient(hunting): get_auth_request con 0x561838636cb0 auth_method 0 2024-09-19T14:12:49.589 INFO:tasks.workunit.client.0.smithi153.stderr: -421> 2024-09-19T14:12:48.630+0000 7f4e9c2e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:49.589 INFO:tasks.workunit.client.0.smithi153.stderr: -420> 2024-09-19T14:12:48.630+0000 7f4e9c2e4640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:49.589 INFO:tasks.workunit.client.0.smithi153.stderr: -419> 2024-09-19T14:12:48.630+0000 7f4e9c2e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:49.589 INFO:tasks.workunit.client.0.smithi153.stderr: -418> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:49.590 INFO:tasks.workunit.client.0.smithi153.stderr: -417> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:49.590 INFO:tasks.workunit.client.0.smithi153.stderr: -416> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:49.590 INFO:tasks.workunit.client.0.smithi153.stderr: -415> 2024-09-19T14:12:48.630+0000 7f4e9c2e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:49.590 INFO:tasks.workunit.client.0.smithi153.stderr: -414> 2024-09-19T14:12:48.630+0000 7f4e9c2e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:49.590 INFO:tasks.workunit.client.0.smithi153.stderr: -413> 2024-09-19T14:12:48.630+0000 7f4e9c2e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:49.590 INFO:tasks.workunit.client.0.smithi153.stderr: -412> 2024-09-19T14:12:48.630+0000 7f4e9bae3640 10 monclient(hunting): get_auth_request con 0x56183859b290 auth_method 0 2024-09-19T14:12:49.590 INFO:tasks.workunit.client.0.smithi153.stderr: -411> 2024-09-19T14:12:48.630+0000 7f4e9bae3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:49.590 INFO:tasks.workunit.client.0.smithi153.stderr: -410> 2024-09-19T14:12:48.630+0000 7f4e9bae3640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:49.590 INFO:tasks.workunit.client.0.smithi153.stderr: -409> 2024-09-19T14:12:48.630+0000 7f4e9bae3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:49.590 INFO:tasks.workunit.client.0.smithi153.stderr: -408> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_done global_id 7727 payload 824 2024-09-19T14:12:49.590 INFO:tasks.workunit.client.0.smithi153.stderr: -407> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient: _finish_hunting 0 2024-09-19T14:12:49.590 INFO:tasks.workunit.client.0.smithi153.stderr: -406> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 1 monclient: found mon.noname-c 2024-09-19T14:12:49.590 INFO:tasks.workunit.client.0.smithi153.stderr: -405> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:12:49.590 INFO:tasks.workunit.client.0.smithi153.stderr: -404> 2024-09-19T14:12:48.630+0000 7f4d83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:49.591 INFO:tasks.workunit.client.0.smithi153.stderr: -403> 2024-09-19T14:12:48.630+0000 7f4d83fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:12:49.591 INFO:tasks.workunit.client.0.smithi153.stderr: -402> 2024-09-19T14:12:48.630+0000 7f4d83fff640 10 monclient: dump: 2024-09-19T14:12:49.591 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:49.591 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:49.591 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.591 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.591 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:49.591 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.591 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:49.591 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:49.591 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:49.591 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.591 INFO:tasks.workunit.client.0.smithi153.stderr: -401> 2024-09-19T14:12:48.630+0000 7f4d83fff640 10 monclient: _finish_auth 0 2024-09-19T14:12:49.591 INFO:tasks.workunit.client.0.smithi153.stderr: -400> 2024-09-19T14:12:48.630+0000 7f4d83fff640 10 monclient: _check_auth_tickets 2024-09-19T14:12:49.592 INFO:tasks.workunit.client.0.smithi153.stderr: -399> 2024-09-19T14:12:48.630+0000 7f4d83fff640 10 monclient: handle_config config(0 keys) 2024-09-19T14:12:49.592 INFO:tasks.workunit.client.0.smithi153.stderr: -398> 2024-09-19T14:12:48.630+0000 7f4d83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:49.592 INFO:tasks.workunit.client.0.smithi153.stderr: -397> 2024-09-19T14:12:48.630+0000 7f4d83fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:12:49.592 INFO:tasks.workunit.client.0.smithi153.stderr: -396> 2024-09-19T14:12:48.630+0000 7f4d83fff640 10 monclient: dump: 2024-09-19T14:12:49.592 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:49.592 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:49.592 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.592 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.592 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:49.592 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.592 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:49.592 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:49.592 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:49.592 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.593 INFO:tasks.workunit.client.0.smithi153.stderr: -395> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 monclient: authenticate success, global_id 7727 2024-09-19T14:12:49.593 INFO:tasks.workunit.client.0.smithi153.stderr: -394> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient: _renew_subs 2024-09-19T14:12:49.593 INFO:tasks.workunit.client.0.smithi153.stderr: -393> 2024-09-19T14:12:48.630+0000 7f4d89e0b640 4 set_mon_vals no callback set 2024-09-19T14:12:49.593 INFO:tasks.workunit.client.0.smithi153.stderr: -392> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:12:49.593 INFO:tasks.workunit.client.0.smithi153.stderr: -391> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient: _renew_subs 2024-09-19T14:12:49.593 INFO:tasks.workunit.client.0.smithi153.stderr: -390> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:12:49.593 INFO:tasks.workunit.client.0.smithi153.stderr: -389> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 1 librados: init done 2024-09-19T14:12:49.593 INFO:tasks.workunit.client.0.smithi153.stderr: -388> 2024-09-19T14:12:48.634+0000 7f4d83fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:12:49.593 INFO:tasks.workunit.client.0.smithi153.stderr: -387> 2024-09-19T14:12:48.634+0000 7f4d83fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:12:49.593 INFO:tasks.workunit.client.0.smithi153.stderr: -386> 2024-09-19T14:12:48.634+0000 7f4d83fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:12:49.593 INFO:tasks.workunit.client.0.smithi153.stderr: -385> 2024-09-19T14:12:48.634+0000 7f4e9bae3640 10 monclient: get_auth_request con 0x7f4d84071be0 auth_method 0 2024-09-19T14:12:49.593 INFO:tasks.workunit.client.0.smithi153.stderr: -384> 2024-09-19T14:12:48.634+0000 7f4e9c2e4640 10 monclient: get_auth_request con 0x561838713520 auth_method 0 2024-09-19T14:12:49.594 INFO:tasks.workunit.client.0.smithi153.stderr: -383> 2024-09-19T14:12:48.634+0000 7f4e9bae3640 10 monclient: get_auth_request con 0x561838736030 auth_method 0 2024-09-19T14:12:49.594 INFO:tasks.workunit.client.0.smithi153.stderr: -382> 2024-09-19T14:12:48.638+0000 7f4e9b2e2640 10 monclient: get_auth_request con 0x56183873b0c0 auth_method 0 2024-09-19T14:12:49.594 INFO:tasks.workunit.client.0.smithi153.stderr: -381> 2024-09-19T14:12:48.638+0000 7f4e9dfdd9c0 10 monclient: build_initial_monmap 2024-09-19T14:12:49.594 INFO:tasks.workunit.client.0.smithi153.stderr: -380> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 1 build_initial for_mkfs: 0 2024-09-19T14:12:49.594 INFO:tasks.workunit.client.0.smithi153.stderr: -379> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient: monmap: 2024-09-19T14:12:49.594 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:12:49.594 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:12:49.594 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:12:49.594 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:12:49.594 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:12:49.594 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.594 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:12:49.594 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:12:49.594 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:12:49.595 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.595 INFO:tasks.workunit.client.0.smithi153.stderr: -378> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding auth protocol: cephx 2024-09-19T14:12:49.595 INFO:tasks.workunit.client.0.smithi153.stderr: -377> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding auth protocol: cephx 2024-09-19T14:12:49.595 INFO:tasks.workunit.client.0.smithi153.stderr: -376> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding auth protocol: cephx 2024-09-19T14:12:49.595 INFO:tasks.workunit.client.0.smithi153.stderr: -375> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding con mode: secure 2024-09-19T14:12:49.595 INFO:tasks.workunit.client.0.smithi153.stderr: -374> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding con mode: crc 2024-09-19T14:12:49.595 INFO:tasks.workunit.client.0.smithi153.stderr: -373> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding con mode: secure 2024-09-19T14:12:49.595 INFO:tasks.workunit.client.0.smithi153.stderr: -372> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding con mode: crc 2024-09-19T14:12:49.595 INFO:tasks.workunit.client.0.smithi153.stderr: -371> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding con mode: secure 2024-09-19T14:12:49.595 INFO:tasks.workunit.client.0.smithi153.stderr: -370> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding con mode: crc 2024-09-19T14:12:49.595 INFO:tasks.workunit.client.0.smithi153.stderr: -369> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding con mode: crc 2024-09-19T14:12:49.595 INFO:tasks.workunit.client.0.smithi153.stderr: -368> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding con mode: secure 2024-09-19T14:12:49.595 INFO:tasks.workunit.client.0.smithi153.stderr: -367> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding con mode: crc 2024-09-19T14:12:49.595 INFO:tasks.workunit.client.0.smithi153.stderr: -366> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding con mode: secure 2024-09-19T14:12:49.596 INFO:tasks.workunit.client.0.smithi153.stderr: -365> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding con mode: crc 2024-09-19T14:12:49.596 INFO:tasks.workunit.client.0.smithi153.stderr: -364> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding con mode: secure 2024-09-19T14:12:49.596 INFO:tasks.workunit.client.0.smithi153.stderr: -363> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.596 INFO:tasks.workunit.client.0.smithi153.stderr: -362> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command objecter_requests cmddesc objecter_requests hook 0x5618387426d0 EEXIST 2024-09-19T14:12:49.596 INFO:tasks.workunit.client.0.smithi153.stderr: -361> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient: init 2024-09-19T14:12:49.596 INFO:tasks.workunit.client.0.smithi153.stderr: -360> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding auth protocol: cephx 2024-09-19T14:12:49.596 INFO:tasks.workunit.client.0.smithi153.stderr: -359> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding auth protocol: cephx 2024-09-19T14:12:49.596 INFO:tasks.workunit.client.0.smithi153.stderr: -358> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding auth protocol: cephx 2024-09-19T14:12:49.596 INFO:tasks.workunit.client.0.smithi153.stderr: -357> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding con mode: secure 2024-09-19T14:12:49.596 INFO:tasks.workunit.client.0.smithi153.stderr: -356> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding con mode: crc 2024-09-19T14:12:49.596 INFO:tasks.workunit.client.0.smithi153.stderr: -355> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding con mode: secure 2024-09-19T14:12:49.596 INFO:tasks.workunit.client.0.smithi153.stderr: -354> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding con mode: crc 2024-09-19T14:12:49.596 INFO:tasks.workunit.client.0.smithi153.stderr: -353> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding con mode: secure 2024-09-19T14:12:49.597 INFO:tasks.workunit.client.0.smithi153.stderr: -352> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding con mode: crc 2024-09-19T14:12:49.597 INFO:tasks.workunit.client.0.smithi153.stderr: -351> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding con mode: crc 2024-09-19T14:12:49.597 INFO:tasks.workunit.client.0.smithi153.stderr: -350> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding con mode: secure 2024-09-19T14:12:49.597 INFO:tasks.workunit.client.0.smithi153.stderr: -349> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding con mode: crc 2024-09-19T14:12:49.597 INFO:tasks.workunit.client.0.smithi153.stderr: -348> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding con mode: secure 2024-09-19T14:12:49.597 INFO:tasks.workunit.client.0.smithi153.stderr: -347> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding con mode: crc 2024-09-19T14:12:49.597 INFO:tasks.workunit.client.0.smithi153.stderr: -346> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding con mode: secure 2024-09-19T14:12:49.597 INFO:tasks.workunit.client.0.smithi153.stderr: -345> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.597 INFO:tasks.workunit.client.0.smithi153.stderr: -344> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.597 INFO:tasks.workunit.client.0.smithi153.stderr: -343> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command rotate-key cmddesc rotate-key hook 0x56183873df50 EEXIST 2024-09-19T14:12:49.597 INFO:tasks.workunit.client.0.smithi153.stderr: -342> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient: _reopen_session rank -1 2024-09-19T14:12:49.598 INFO:tasks.workunit.client.0.smithi153.stderr: -341> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:12:49.598 INFO:tasks.workunit.client.0.smithi153.stderr: -340> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient(hunting): picked mon.noname-b con 0x561838766880 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:12:49.598 INFO:tasks.workunit.client.0.smithi153.stderr: -339> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient(hunting): picked mon.noname-a con 0x5618387661b0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:12:49.598 INFO:tasks.workunit.client.0.smithi153.stderr: -338> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient(hunting): picked mon.noname-c con 0x561838764b90 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:12:49.598 INFO:tasks.workunit.client.0.smithi153.stderr: -337> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:49.598 INFO:tasks.workunit.client.0.smithi153.stderr: -336> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:49.598 INFO:tasks.workunit.client.0.smithi153.stderr: -335> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:49.598 INFO:tasks.workunit.client.0.smithi153.stderr: -334> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient(hunting): _renew_subs 2024-09-19T14:12:49.598 INFO:tasks.workunit.client.0.smithi153.stderr: -333> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient(hunting): authenticate will time out at 2957.105184s 2024-09-19T14:12:49.598 INFO:tasks.workunit.client.0.smithi153.stderr: -332> 2024-09-19T14:12:48.642+0000 7f4e9b2e2640 10 monclient(hunting): get_auth_request con 0x5618387661b0 auth_method 0 2024-09-19T14:12:49.598 INFO:tasks.workunit.client.0.smithi153.stderr: -331> 2024-09-19T14:12:48.642+0000 7f4e9b2e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:49.598 INFO:tasks.workunit.client.0.smithi153.stderr: -330> 2024-09-19T14:12:48.642+0000 7f4e9b2e2640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:49.598 INFO:tasks.workunit.client.0.smithi153.stderr: -329> 2024-09-19T14:12:48.642+0000 7f4e9b2e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:49.598 INFO:tasks.workunit.client.0.smithi153.stderr: -328> 2024-09-19T14:12:48.642+0000 7f4e9c2e4640 10 monclient(hunting): get_auth_request con 0x561838764b90 auth_method 0 2024-09-19T14:12:49.599 INFO:tasks.workunit.client.0.smithi153.stderr: -327> 2024-09-19T14:12:48.642+0000 7f4e9c2e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:49.599 INFO:tasks.workunit.client.0.smithi153.stderr: -326> 2024-09-19T14:12:48.642+0000 7f4e9c2e4640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:49.599 INFO:tasks.workunit.client.0.smithi153.stderr: -325> 2024-09-19T14:12:48.642+0000 7f4e9c2e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:49.599 INFO:tasks.workunit.client.0.smithi153.stderr: -324> 2024-09-19T14:12:48.642+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:49.599 INFO:tasks.workunit.client.0.smithi153.stderr: -323> 2024-09-19T14:12:48.642+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:49.599 INFO:tasks.workunit.client.0.smithi153.stderr: -322> 2024-09-19T14:12:48.642+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:49.599 INFO:tasks.workunit.client.0.smithi153.stderr: -321> 2024-09-19T14:12:48.642+0000 7f4e9c2e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:49.599 INFO:tasks.workunit.client.0.smithi153.stderr: -320> 2024-09-19T14:12:48.642+0000 7f4e9c2e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:49.599 INFO:tasks.workunit.client.0.smithi153.stderr: -319> 2024-09-19T14:12:48.642+0000 7f4e9c2e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:49.599 INFO:tasks.workunit.client.0.smithi153.stderr: -318> 2024-09-19T14:12:48.642+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_done global_id 8253 payload 824 2024-09-19T14:12:49.599 INFO:tasks.workunit.client.0.smithi153.stderr: -317> 2024-09-19T14:12:48.642+0000 7f4e9b2e2640 10 monclient: _finish_hunting 0 2024-09-19T14:12:49.599 INFO:tasks.workunit.client.0.smithi153.stderr: -316> 2024-09-19T14:12:48.642+0000 7f4e9b2e2640 1 monclient: found mon.noname-a 2024-09-19T14:12:49.599 INFO:tasks.workunit.client.0.smithi153.stderr: -315> 2024-09-19T14:12:48.642+0000 7f4e9b2e2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:12:49.599 INFO:tasks.workunit.client.0.smithi153.stderr: -314> 2024-09-19T14:12:48.642+0000 7f4e9bae3640 10 monclient: get_auth_request con 0x561838766880 auth_method 0 2024-09-19T14:12:49.600 INFO:tasks.workunit.client.0.smithi153.stderr: -313> 2024-09-19T14:12:48.642+0000 7f4d817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:49.600 INFO:tasks.workunit.client.0.smithi153.stderr: -312> 2024-09-19T14:12:48.642+0000 7f4d817fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:12:49.600 INFO:tasks.workunit.client.0.smithi153.stderr: -311> 2024-09-19T14:12:48.642+0000 7f4d817fa640 10 monclient: dump: 2024-09-19T14:12:49.600 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:49.600 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:49.600 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.600 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.600 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:49.600 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.600 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:49.600 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:49.600 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:49.600 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.600 INFO:tasks.workunit.client.0.smithi153.stderr: -310> 2024-09-19T14:12:48.642+0000 7f4d817fa640 10 monclient: _finish_auth 0 2024-09-19T14:12:49.601 INFO:tasks.workunit.client.0.smithi153.stderr: -309> 2024-09-19T14:12:48.642+0000 7f4d817fa640 10 monclient: _check_auth_tickets 2024-09-19T14:12:49.601 INFO:tasks.workunit.client.0.smithi153.stderr: -308> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 monclient: authenticate success, global_id 8253 2024-09-19T14:12:49.601 INFO:tasks.workunit.client.0.smithi153.stderr: -307> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient: _renew_subs 2024-09-19T14:12:49.601 INFO:tasks.workunit.client.0.smithi153.stderr: -306> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:12:49.601 INFO:tasks.workunit.client.0.smithi153.stderr: -305> 2024-09-19T14:12:48.642+0000 7f4d817fa640 10 monclient: handle_config config(0 keys) 2024-09-19T14:12:49.601 INFO:tasks.workunit.client.0.smithi153.stderr: -304> 2024-09-19T14:12:48.642+0000 7f4d817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:49.601 INFO:tasks.workunit.client.0.smithi153.stderr: -303> 2024-09-19T14:12:48.642+0000 7f4d817fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:12:49.601 INFO:tasks.workunit.client.0.smithi153.stderr: -302> 2024-09-19T14:12:48.642+0000 7f4d817fa640 10 monclient: dump: 2024-09-19T14:12:49.601 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:49.601 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:49.601 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.601 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.601 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:49.602 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.602 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:49.602 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:49.602 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:49.602 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.602 INFO:tasks.workunit.client.0.smithi153.stderr: -301> 2024-09-19T14:12:48.642+0000 7f4e9cae5640 4 set_mon_vals no callback set 2024-09-19T14:12:49.602 INFO:tasks.workunit.client.0.smithi153.stderr: -300> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient: _renew_subs 2024-09-19T14:12:49.602 INFO:tasks.workunit.client.0.smithi153.stderr: -299> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:12:49.602 INFO:tasks.workunit.client.0.smithi153.stderr: -298> 2024-09-19T14:12:48.642+0000 7f4d817fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:12:49.602 INFO:tasks.workunit.client.0.smithi153.stderr: -297> 2024-09-19T14:12:48.642+0000 7f4d817fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:12:49.602 INFO:tasks.workunit.client.0.smithi153.stderr: -296> 2024-09-19T14:12:48.642+0000 7f4d817fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:12:49.602 INFO:tasks.workunit.client.0.smithi153.stderr: -295> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: get_monmap_and_config 2024-09-19T14:12:49.602 INFO:tasks.workunit.client.0.smithi153.stderr: -294> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: build_initial_monmap 2024-09-19T14:12:49.602 INFO:tasks.workunit.client.0.smithi153.stderr: -293> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 1 build_initial for_mkfs: 0 2024-09-19T14:12:49.603 INFO:tasks.workunit.client.0.smithi153.stderr: -292> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: monmap: 2024-09-19T14:12:49.603 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:12:49.603 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:12:49.603 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:12:49.603 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:12:49.603 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:12:49.603 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.603 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:12:49.603 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:12:49.603 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:12:49.603 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.603 INFO:tasks.workunit.client.0.smithi153.stderr: -291> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding auth protocol: cephx 2024-09-19T14:12:49.603 INFO:tasks.workunit.client.0.smithi153.stderr: -290> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding auth protocol: cephx 2024-09-19T14:12:49.604 INFO:tasks.workunit.client.0.smithi153.stderr: -289> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding auth protocol: cephx 2024-09-19T14:12:49.604 INFO:tasks.workunit.client.0.smithi153.stderr: -288> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding con mode: secure 2024-09-19T14:12:49.604 INFO:tasks.workunit.client.0.smithi153.stderr: -287> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding con mode: crc 2024-09-19T14:12:49.604 INFO:tasks.workunit.client.0.smithi153.stderr: -286> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding con mode: secure 2024-09-19T14:12:49.604 INFO:tasks.workunit.client.0.smithi153.stderr: -285> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding con mode: crc 2024-09-19T14:12:49.604 INFO:tasks.workunit.client.0.smithi153.stderr: -284> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding con mode: secure 2024-09-19T14:12:49.604 INFO:tasks.workunit.client.0.smithi153.stderr: -283> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding con mode: crc 2024-09-19T14:12:49.604 INFO:tasks.workunit.client.0.smithi153.stderr: -282> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding con mode: crc 2024-09-19T14:12:49.604 INFO:tasks.workunit.client.0.smithi153.stderr: -281> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding con mode: secure 2024-09-19T14:12:49.604 INFO:tasks.workunit.client.0.smithi153.stderr: -280> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding con mode: crc 2024-09-19T14:12:49.604 INFO:tasks.workunit.client.0.smithi153.stderr: -279> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding con mode: secure 2024-09-19T14:12:49.604 INFO:tasks.workunit.client.0.smithi153.stderr: -278> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding con mode: crc 2024-09-19T14:12:49.604 INFO:tasks.workunit.client.0.smithi153.stderr: -277> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding con mode: secure 2024-09-19T14:12:49.604 INFO:tasks.workunit.client.0.smithi153.stderr: -276> 2024-09-19T14:12:48.646+0000 7f4e9bae3640 10 monclient: get_auth_request con 0x7f4d74071b20 auth_method 0 2024-09-19T14:12:49.605 INFO:tasks.workunit.client.0.smithi153.stderr: -275> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.605 INFO:tasks.workunit.client.0.smithi153.stderr: -274> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: init 2024-09-19T14:12:49.605 INFO:tasks.workunit.client.0.smithi153.stderr: -273> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding auth protocol: cephx 2024-09-19T14:12:49.605 INFO:tasks.workunit.client.0.smithi153.stderr: -272> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding auth protocol: cephx 2024-09-19T14:12:49.605 INFO:tasks.workunit.client.0.smithi153.stderr: -271> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding auth protocol: cephx 2024-09-19T14:12:49.605 INFO:tasks.workunit.client.0.smithi153.stderr: -270> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding con mode: secure 2024-09-19T14:12:49.605 INFO:tasks.workunit.client.0.smithi153.stderr: -269> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding con mode: crc 2024-09-19T14:12:49.605 INFO:tasks.workunit.client.0.smithi153.stderr: -268> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding con mode: secure 2024-09-19T14:12:49.605 INFO:tasks.workunit.client.0.smithi153.stderr: -267> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding con mode: crc 2024-09-19T14:12:49.605 INFO:tasks.workunit.client.0.smithi153.stderr: -266> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding con mode: secure 2024-09-19T14:12:49.605 INFO:tasks.workunit.client.0.smithi153.stderr: -265> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding con mode: crc 2024-09-19T14:12:49.605 INFO:tasks.workunit.client.0.smithi153.stderr: -264> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding con mode: crc 2024-09-19T14:12:49.605 INFO:tasks.workunit.client.0.smithi153.stderr: -263> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding con mode: secure 2024-09-19T14:12:49.605 INFO:tasks.workunit.client.0.smithi153.stderr: -262> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding con mode: crc 2024-09-19T14:12:49.606 INFO:tasks.workunit.client.0.smithi153.stderr: -261> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding con mode: secure 2024-09-19T14:12:49.606 INFO:tasks.workunit.client.0.smithi153.stderr: -260> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding con mode: crc 2024-09-19T14:12:49.606 INFO:tasks.workunit.client.0.smithi153.stderr: -259> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding con mode: secure 2024-09-19T14:12:49.606 INFO:tasks.workunit.client.0.smithi153.stderr: -258> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.606 INFO:tasks.workunit.client.0.smithi153.stderr: -257> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.606 INFO:tasks.workunit.client.0.smithi153.stderr: -256> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command rotate-key cmddesc rotate-key hook 0x7ffd81de2ed8 EEXIST 2024-09-19T14:12:49.606 INFO:tasks.workunit.client.0.smithi153.stderr: -255> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: _reopen_session rank -1 2024-09-19T14:12:49.606 INFO:tasks.workunit.client.0.smithi153.stderr: -254> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T14:12:49.606 INFO:tasks.workunit.client.0.smithi153.stderr: -253> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): picked mon.noname-c con 0x5618387b9f80 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:12:49.606 INFO:tasks.workunit.client.0.smithi153.stderr: -252> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): picked mon.noname-a con 0x561838789d60 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:12:49.606 INFO:tasks.workunit.client.0.smithi153.stderr: -251> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): picked mon.noname-b con 0x5618387b5370 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:12:49.606 INFO:tasks.workunit.client.0.smithi153.stderr: -250> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:49.607 INFO:tasks.workunit.client.0.smithi153.stderr: -249> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:49.607 INFO:tasks.workunit.client.0.smithi153.stderr: -248> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:49.607 INFO:tasks.workunit.client.0.smithi153.stderr: -247> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): _renew_subs 2024-09-19T14:12:49.607 INFO:tasks.workunit.client.0.smithi153.stderr: -246> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): authenticate will time out at 2957.109233s 2024-09-19T14:12:49.607 INFO:tasks.workunit.client.0.smithi153.stderr: -245> 2024-09-19T14:12:48.646+0000 7f4e9bae3640 10 monclient(hunting): get_auth_request con 0x5618387b9f80 auth_method 0 2024-09-19T14:12:49.607 INFO:tasks.workunit.client.0.smithi153.stderr: -244> 2024-09-19T14:12:48.646+0000 7f4e9bae3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:49.607 INFO:tasks.workunit.client.0.smithi153.stderr: -243> 2024-09-19T14:12:48.646+0000 7f4e9bae3640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:49.607 INFO:tasks.workunit.client.0.smithi153.stderr: -242> 2024-09-19T14:12:48.646+0000 7f4e9bae3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:49.607 INFO:tasks.workunit.client.0.smithi153.stderr: -241> 2024-09-19T14:12:48.646+0000 7f4e9b2e2640 10 monclient(hunting): get_auth_request con 0x561838789d60 auth_method 0 2024-09-19T14:12:49.607 INFO:tasks.workunit.client.0.smithi153.stderr: -240> 2024-09-19T14:12:48.646+0000 7f4e9b2e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:49.607 INFO:tasks.workunit.client.0.smithi153.stderr: -239> 2024-09-19T14:12:48.646+0000 7f4e9b2e2640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:49.607 INFO:tasks.workunit.client.0.smithi153.stderr: -238> 2024-09-19T14:12:48.646+0000 7f4e9b2e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:49.607 INFO:tasks.workunit.client.0.smithi153.stderr: -237> 2024-09-19T14:12:48.646+0000 7f4e9bae3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:49.607 INFO:tasks.workunit.client.0.smithi153.stderr: -236> 2024-09-19T14:12:48.646+0000 7f4e9bae3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:49.608 INFO:tasks.workunit.client.0.smithi153.stderr: -235> 2024-09-19T14:12:48.646+0000 7f4e9bae3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:49.608 INFO:tasks.workunit.client.0.smithi153.stderr: -234> 2024-09-19T14:12:48.646+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:49.608 INFO:tasks.workunit.client.0.smithi153.stderr: -233> 2024-09-19T14:12:48.646+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:49.608 INFO:tasks.workunit.client.0.smithi153.stderr: -232> 2024-09-19T14:12:48.646+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:49.608 INFO:tasks.workunit.client.0.smithi153.stderr: -231> 2024-09-19T14:12:48.646+0000 7f4e9bae3640 10 monclient(hunting): handle_auth_done global_id 7733 payload 274 2024-09-19T14:12:49.608 INFO:tasks.workunit.client.0.smithi153.stderr: -230> 2024-09-19T14:12:48.646+0000 7f4e9bae3640 10 monclient: _finish_hunting 0 2024-09-19T14:12:49.608 INFO:tasks.workunit.client.0.smithi153.stderr: -229> 2024-09-19T14:12:48.646+0000 7f4e9bae3640 1 monclient: found mon.noname-c 2024-09-19T14:12:49.608 INFO:tasks.workunit.client.0.smithi153.stderr: -228> 2024-09-19T14:12:48.646+0000 7f4e9bae3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:12:49.608 INFO:tasks.workunit.client.0.smithi153.stderr: -227> 2024-09-19T14:12:48.646+0000 7f4e9c2e4640 10 monclient: get_auth_request con 0x5618387b5370 auth_method 0 2024-09-19T14:12:49.608 INFO:tasks.workunit.client.0.smithi153.stderr: -226> 2024-09-19T14:12:48.646+0000 7f4d7affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:49.608 INFO:tasks.workunit.client.0.smithi153.stderr: -225> 2024-09-19T14:12:48.646+0000 7f4d7affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:12:49.608 INFO:tasks.workunit.client.0.smithi153.stderr: -224> 2024-09-19T14:12:48.646+0000 7f4d7affd640 10 monclient: dump: 2024-09-19T14:12:49.608 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:49.609 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:49.609 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.609 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.609 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:49.609 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.609 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:49.609 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:49.609 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:49.609 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.609 INFO:tasks.workunit.client.0.smithi153.stderr: -223> 2024-09-19T14:12:48.646+0000 7f4d7affd640 10 monclient: _finish_auth 0 2024-09-19T14:12:49.609 INFO:tasks.workunit.client.0.smithi153.stderr: -222> 2024-09-19T14:12:48.646+0000 7f4d7affd640 10 monclient: _check_auth_tickets 2024-09-19T14:12:49.609 INFO:tasks.workunit.client.0.smithi153.stderr: -221> 2024-09-19T14:12:48.646+0000 7f4d7affd640 10 monclient: handle_config config(0 keys) 2024-09-19T14:12:49.609 INFO:tasks.workunit.client.0.smithi153.stderr: -220> 2024-09-19T14:12:48.646+0000 7f4d7affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:49.609 INFO:tasks.workunit.client.0.smithi153.stderr: -219> 2024-09-19T14:12:48.646+0000 7f4d7affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:12:49.610 INFO:tasks.workunit.client.0.smithi153.stderr: -218> 2024-09-19T14:12:48.646+0000 7f4d7affd640 10 monclient: dump: 2024-09-19T14:12:49.610 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:49.610 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:49.610 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.610 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.610 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:49.610 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.610 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:49.610 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:49.610 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:49.610 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.610 INFO:tasks.workunit.client.0.smithi153.stderr: -217> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 monclient: authenticate success, global_id 7733 2024-09-19T14:12:49.610 INFO:tasks.workunit.client.0.smithi153.stderr: -216> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: get_monmap_and_config success 2024-09-19T14:12:49.610 INFO:tasks.workunit.client.0.smithi153.stderr: -215> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 4 set_mon_vals no callback set 2024-09-19T14:12:49.611 INFO:tasks.workunit.client.0.smithi153.stderr: -214> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: shutdown 2024-09-19T14:12:49.611 INFO:tasks.workunit.client.0.smithi153.stderr: -213> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: build_initial_monmap 2024-09-19T14:12:49.611 INFO:tasks.workunit.client.0.smithi153.stderr: -212> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 1 build_initial for_mkfs: 0 2024-09-19T14:12:49.611 INFO:tasks.workunit.client.0.smithi153.stderr: -211> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: monmap: 2024-09-19T14:12:49.611 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:12:49.611 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:12:49.611 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:12:49.611 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:12:49.611 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:12:49.611 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.611 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:12:49.611 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:12:49.611 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:12:49.612 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.612 INFO:tasks.workunit.client.0.smithi153.stderr: -210> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding auth protocol: cephx 2024-09-19T14:12:49.612 INFO:tasks.workunit.client.0.smithi153.stderr: -209> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding auth protocol: cephx 2024-09-19T14:12:49.612 INFO:tasks.workunit.client.0.smithi153.stderr: -208> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding auth protocol: cephx 2024-09-19T14:12:49.612 INFO:tasks.workunit.client.0.smithi153.stderr: -207> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding con mode: secure 2024-09-19T14:12:49.612 INFO:tasks.workunit.client.0.smithi153.stderr: -206> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding con mode: crc 2024-09-19T14:12:49.612 INFO:tasks.workunit.client.0.smithi153.stderr: -205> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding con mode: secure 2024-09-19T14:12:49.612 INFO:tasks.workunit.client.0.smithi153.stderr: -204> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding con mode: crc 2024-09-19T14:12:49.612 INFO:tasks.workunit.client.0.smithi153.stderr: -203> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding con mode: secure 2024-09-19T14:12:49.612 INFO:tasks.workunit.client.0.smithi153.stderr: -202> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding con mode: crc 2024-09-19T14:12:49.612 INFO:tasks.workunit.client.0.smithi153.stderr: -201> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding con mode: crc 2024-09-19T14:12:49.612 INFO:tasks.workunit.client.0.smithi153.stderr: -200> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding con mode: secure 2024-09-19T14:12:49.612 INFO:tasks.workunit.client.0.smithi153.stderr: -199> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding con mode: crc 2024-09-19T14:12:49.612 INFO:tasks.workunit.client.0.smithi153.stderr: -198> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding con mode: secure 2024-09-19T14:12:49.613 INFO:tasks.workunit.client.0.smithi153.stderr: -197> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding con mode: crc 2024-09-19T14:12:49.613 INFO:tasks.workunit.client.0.smithi153.stderr: -196> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding con mode: secure 2024-09-19T14:12:49.613 INFO:tasks.workunit.client.0.smithi153.stderr: -195> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.613 INFO:tasks.workunit.client.0.smithi153.stderr: -194> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 1 librados: starting msgr at 2024-09-19T14:12:49.613 INFO:tasks.workunit.client.0.smithi153.stderr: -193> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 1 librados: starting objecter 2024-09-19T14:12:49.613 INFO:tasks.workunit.client.0.smithi153.stderr: -192> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command objecter_requests cmddesc objecter_requests hook 0x5618387aceb0 EEXIST 2024-09-19T14:12:49.613 INFO:tasks.workunit.client.0.smithi153.stderr: -191> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 1 librados: setting wanted keys 2024-09-19T14:12:49.613 INFO:tasks.workunit.client.0.smithi153.stderr: -190> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 1 librados: calling monclient init 2024-09-19T14:12:49.613 INFO:tasks.workunit.client.0.smithi153.stderr: -189> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: init 2024-09-19T14:12:49.613 INFO:tasks.workunit.client.0.smithi153.stderr: -188> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding auth protocol: cephx 2024-09-19T14:12:49.613 INFO:tasks.workunit.client.0.smithi153.stderr: -187> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding auth protocol: cephx 2024-09-19T14:12:49.613 INFO:tasks.workunit.client.0.smithi153.stderr: -186> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding auth protocol: cephx 2024-09-19T14:12:49.613 INFO:tasks.workunit.client.0.smithi153.stderr: -185> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding con mode: secure 2024-09-19T14:12:49.614 INFO:tasks.workunit.client.0.smithi153.stderr: -184> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding con mode: crc 2024-09-19T14:12:49.614 INFO:tasks.workunit.client.0.smithi153.stderr: -183> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding con mode: secure 2024-09-19T14:12:49.614 INFO:tasks.workunit.client.0.smithi153.stderr: -182> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding con mode: crc 2024-09-19T14:12:49.614 INFO:tasks.workunit.client.0.smithi153.stderr: -181> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding con mode: secure 2024-09-19T14:12:49.614 INFO:tasks.workunit.client.0.smithi153.stderr: -180> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding con mode: crc 2024-09-19T14:12:49.614 INFO:tasks.workunit.client.0.smithi153.stderr: -179> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding con mode: crc 2024-09-19T14:12:49.614 INFO:tasks.workunit.client.0.smithi153.stderr: -178> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding con mode: secure 2024-09-19T14:12:49.614 INFO:tasks.workunit.client.0.smithi153.stderr: -177> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding con mode: crc 2024-09-19T14:12:49.614 INFO:tasks.workunit.client.0.smithi153.stderr: -176> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding con mode: secure 2024-09-19T14:12:49.614 INFO:tasks.workunit.client.0.smithi153.stderr: -175> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding con mode: crc 2024-09-19T14:12:49.614 INFO:tasks.workunit.client.0.smithi153.stderr: -174> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding con mode: secure 2024-09-19T14:12:49.614 INFO:tasks.workunit.client.0.smithi153.stderr: -173> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.614 INFO:tasks.workunit.client.0.smithi153.stderr: -172> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.615 INFO:tasks.workunit.client.0.smithi153.stderr: -171> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command rotate-key cmddesc rotate-key hook 0x5618387687e8 EEXIST 2024-09-19T14:12:49.615 INFO:tasks.workunit.client.0.smithi153.stderr: -170> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: _reopen_session rank -1 2024-09-19T14:12:49.615 INFO:tasks.workunit.client.0.smithi153.stderr: -169> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T14:12:49.615 INFO:tasks.workunit.client.0.smithi153.stderr: -168> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): picked mon.noname-b con 0x561838789d60 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:12:49.615 INFO:tasks.workunit.client.0.smithi153.stderr: -167> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): picked mon.noname-c con 0x5618387b5370 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:12:49.615 INFO:tasks.workunit.client.0.smithi153.stderr: -166> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): picked mon.noname-a con 0x5618387b9f80 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:12:49.615 INFO:tasks.workunit.client.0.smithi153.stderr: -165> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:49.615 INFO:tasks.workunit.client.0.smithi153.stderr: -164> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:49.615 INFO:tasks.workunit.client.0.smithi153.stderr: -163> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:49.615 INFO:tasks.workunit.client.0.smithi153.stderr: -162> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): _renew_subs 2024-09-19T14:12:49.615 INFO:tasks.workunit.client.0.smithi153.stderr: -161> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): authenticate will time out at 2957.111897s 2024-09-19T14:12:49.615 INFO:tasks.workunit.client.0.smithi153.stderr: -160> 2024-09-19T14:12:48.650+0000 7f4e9c2e4640 10 monclient(hunting): get_auth_request con 0x5618387b9f80 auth_method 0 2024-09-19T14:12:49.615 INFO:tasks.workunit.client.0.smithi153.stderr: -159> 2024-09-19T14:12:48.650+0000 7f4e9c2e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:49.616 INFO:tasks.workunit.client.0.smithi153.stderr: -158> 2024-09-19T14:12:48.650+0000 7f4e9c2e4640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:49.616 INFO:tasks.workunit.client.0.smithi153.stderr: -157> 2024-09-19T14:12:48.650+0000 7f4e9c2e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:49.616 INFO:tasks.workunit.client.0.smithi153.stderr: -156> 2024-09-19T14:12:48.650+0000 7f4e9b2e2640 10 monclient(hunting): get_auth_request con 0x5618387b5370 auth_method 0 2024-09-19T14:12:49.616 INFO:tasks.workunit.client.0.smithi153.stderr: -155> 2024-09-19T14:12:48.650+0000 7f4e9b2e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:49.616 INFO:tasks.workunit.client.0.smithi153.stderr: -154> 2024-09-19T14:12:48.650+0000 7f4e9b2e2640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:49.616 INFO:tasks.workunit.client.0.smithi153.stderr: -153> 2024-09-19T14:12:48.650+0000 7f4e9b2e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:49.616 INFO:tasks.workunit.client.0.smithi153.stderr: -152> 2024-09-19T14:12:48.650+0000 7f4e9c2e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:49.616 INFO:tasks.workunit.client.0.smithi153.stderr: -151> 2024-09-19T14:12:48.650+0000 7f4e9c2e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:49.616 INFO:tasks.workunit.client.0.smithi153.stderr: -150> 2024-09-19T14:12:48.650+0000 7f4e9c2e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:49.616 INFO:tasks.workunit.client.0.smithi153.stderr: -149> 2024-09-19T14:12:48.650+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:49.616 INFO:tasks.workunit.client.0.smithi153.stderr: -148> 2024-09-19T14:12:48.650+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:49.616 INFO:tasks.workunit.client.0.smithi153.stderr: -147> 2024-09-19T14:12:48.650+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:49.616 INFO:tasks.workunit.client.0.smithi153.stderr: -146> 2024-09-19T14:12:48.650+0000 7f4e9c2e4640 10 monclient(hunting): handle_auth_done global_id 8259 payload 824 2024-09-19T14:12:49.616 INFO:tasks.workunit.client.0.smithi153.stderr: -145> 2024-09-19T14:12:48.650+0000 7f4e9c2e4640 10 monclient: _finish_hunting 0 2024-09-19T14:12:49.617 INFO:tasks.workunit.client.0.smithi153.stderr: -144> 2024-09-19T14:12:48.650+0000 7f4e9c2e4640 1 monclient: found mon.noname-a 2024-09-19T14:12:49.617 INFO:tasks.workunit.client.0.smithi153.stderr: -143> 2024-09-19T14:12:48.650+0000 7f4e9c2e4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:12:49.617 INFO:tasks.workunit.client.0.smithi153.stderr: -142> 2024-09-19T14:12:48.650+0000 7f4e9bae3640 10 monclient: get_auth_request con 0x561838789d60 auth_method 0 2024-09-19T14:12:49.617 INFO:tasks.workunit.client.0.smithi153.stderr: -141> 2024-09-19T14:12:48.650+0000 7f4d797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:49.617 INFO:tasks.workunit.client.0.smithi153.stderr: -140> 2024-09-19T14:12:48.650+0000 7f4d797fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:12:49.617 INFO:tasks.workunit.client.0.smithi153.stderr: -139> 2024-09-19T14:12:48.650+0000 7f4d797fa640 10 monclient: dump: 2024-09-19T14:12:49.617 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:49.617 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:49.617 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.617 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.617 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:49.617 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.617 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:49.618 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:49.618 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:49.618 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.618 INFO:tasks.workunit.client.0.smithi153.stderr: -138> 2024-09-19T14:12:48.650+0000 7f4d797fa640 10 monclient: _finish_auth 0 2024-09-19T14:12:49.618 INFO:tasks.workunit.client.0.smithi153.stderr: -137> 2024-09-19T14:12:48.650+0000 7f4d797fa640 10 monclient: _check_auth_tickets 2024-09-19T14:12:49.618 INFO:tasks.workunit.client.0.smithi153.stderr: -136> 2024-09-19T14:12:48.650+0000 7f4d797fa640 10 monclient: handle_config config(0 keys) 2024-09-19T14:12:49.618 INFO:tasks.workunit.client.0.smithi153.stderr: -135> 2024-09-19T14:12:48.650+0000 7f4d797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:49.618 INFO:tasks.workunit.client.0.smithi153.stderr: -134> 2024-09-19T14:12:48.650+0000 7f4d797fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:12:49.618 INFO:tasks.workunit.client.0.smithi153.stderr: -133> 2024-09-19T14:12:48.650+0000 7f4d797fa640 10 monclient: dump: 2024-09-19T14:12:49.618 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:49.618 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:49.618 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.618 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.619 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:49.619 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.619 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:49.619 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:49.619 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:49.619 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.619 INFO:tasks.workunit.client.0.smithi153.stderr: -132> 2024-09-19T14:12:48.650+0000 7f4d7affd640 4 set_mon_vals no callback set 2024-09-19T14:12:49.619 INFO:tasks.workunit.client.0.smithi153.stderr: -131> 2024-09-19T14:12:48.650+0000 7f4e9dfdd9c0 5 monclient: authenticate success, global_id 8259 2024-09-19T14:12:49.619 INFO:tasks.workunit.client.0.smithi153.stderr: -130> 2024-09-19T14:12:48.650+0000 7f4e9dfdd9c0 10 monclient: _renew_subs 2024-09-19T14:12:49.619 INFO:tasks.workunit.client.0.smithi153.stderr: -129> 2024-09-19T14:12:48.650+0000 7f4e9dfdd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:12:49.619 INFO:tasks.workunit.client.0.smithi153.stderr: -128> 2024-09-19T14:12:48.650+0000 7f4e9dfdd9c0 10 monclient: _renew_subs 2024-09-19T14:12:49.619 INFO:tasks.workunit.client.0.smithi153.stderr: -127> 2024-09-19T14:12:48.650+0000 7f4e9dfdd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:12:49.619 INFO:tasks.workunit.client.0.smithi153.stderr: -126> 2024-09-19T14:12:48.650+0000 7f4e9dfdd9c0 1 librados: init done 2024-09-19T14:12:49.619 INFO:tasks.workunit.client.0.smithi153.stderr: -125> 2024-09-19T14:12:48.650+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command cr dump hook 0x5618387a81f8 2024-09-19T14:12:49.620 INFO:tasks.workunit.client.0.smithi153.stderr: -124> 2024-09-19T14:12:48.650+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.620 INFO:tasks.workunit.client.0.smithi153.stderr: -123> 2024-09-19T14:12:48.650+0000 7f4d797fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:12:49.620 INFO:tasks.workunit.client.0.smithi153.stderr: -122> 2024-09-19T14:12:48.650+0000 7f4d797fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:12:49.620 INFO:tasks.workunit.client.0.smithi153.stderr: -121> 2024-09-19T14:12:48.650+0000 7f4d797fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:12:49.620 INFO:tasks.workunit.client.0.smithi153.stderr: -120> 2024-09-19T14:12:48.650+0000 7f4e9bae3640 10 monclient: get_auth_request con 0x7f4d64071c10 auth_method 0 2024-09-19T14:12:49.620 INFO:tasks.workunit.client.0.smithi153.stderr: -119> 2024-09-19T14:12:48.650+0000 7f4e9b2e2640 10 monclient: get_auth_request con 0x5618387d3a30 auth_method 0 2024-09-19T14:12:49.620 INFO:tasks.workunit.client.0.smithi153.stderr: -118> 2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.620 INFO:tasks.workunit.client.0.smithi153.stderr: -117> 2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 realm 2024-09-19T14:12:49.620 INFO:tasks.workunit.client.0.smithi153.stderr: -116> 2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.620 INFO:tasks.workunit.client.0.smithi153.stderr: -115> 2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.620 INFO:tasks.workunit.client.0.smithi153.stderr: -114> 2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:12:49.620 INFO:tasks.workunit.client.0.smithi153.stderr: -113> 2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.620 INFO:tasks.workunit.client.0.smithi153.stderr: -112> 2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.620 INFO:tasks.workunit.client.0.smithi153.stderr: -111> 2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.621 INFO:tasks.workunit.client.0.smithi153.stderr: -110> 2024-09-19T14:12:48.654+0000 7f4e9bae3640 10 monclient: get_auth_request con 0x5618387d7bf0 auth_method 0 2024-09-19T14:12:49.621 INFO:tasks.workunit.client.0.smithi153.stderr: -109> 2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:49.621 INFO:tasks.workunit.client.0.smithi153.stderr: -108> 2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.621 INFO:tasks.workunit.client.0.smithi153.stderr: -107> 2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:12:49.621 INFO:tasks.workunit.client.0.smithi153.stderr: -106> 2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 searching for the correct realm 2024-09-19T14:12:49.621 INFO:tasks.workunit.client.0.smithi153.stderr: -105> 2024-09-19T14:12:48.654+0000 7f4e9b2e2640 10 monclient: get_auth_request con 0x5618387dce60 auth_method 0 2024-09-19T14:12:49.621 INFO:tasks.workunit.client.0.smithi153.stderr: -104> 2024-09-19T14:12:48.658+0000 7f4e9c2e4640 10 monclient: get_auth_request con 0x7f4e84139190 auth_method 0 2024-09-19T14:12:49.621 INFO:tasks.workunit.client.0.smithi153.stderr: -103> 2024-09-19T14:12:48.658+0000 7f4e9bae3640 10 monclient: get_auth_request con 0x7f4e9402c060 auth_method 0 2024-09-19T14:12:49.621 INFO:tasks.workunit.client.0.smithi153.stderr: -102> 2024-09-19T14:12:48.658+0000 7f4e9b2e2640 10 monclient: get_auth_request con 0x7f4e8c008050 auth_method 0 2024-09-19T14:12:49.621 INFO:tasks.workunit.client.0.smithi153.stderr: -101> 2024-09-19T14:12:48.862+0000 7f4e9b2e2640 10 monclient: get_auth_request con 0x7f4e8c008050 auth_method 0 2024-09-19T14:12:49.621 INFO:tasks.workunit.client.0.smithi153.stderr: -100> 2024-09-19T14:12:48.862+0000 7f4e9b2e2640 0 -- 172.21.15.153:0/2583246184 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f4e8c008050 msgr2=0x7f4e8c030930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:12:49.621 INFO:tasks.workunit.client.0.smithi153.stderr: -99> 2024-09-19T14:12:49.266+0000 7f4e9b2e2640 10 monclient: get_auth_request con 0x7f4e8c008050 auth_method 0 2024-09-19T14:12:49.621 INFO:tasks.workunit.client.0.smithi153.stderr: -98> 2024-09-19T14:12:49.270+0000 7f4e9c2e4640 10 monclient: get_auth_request con 0x7f4e84114ba0 auth_method 0 2024-09-19T14:12:49.621 INFO:tasks.workunit.client.0.smithi153.stderr: -97> 2024-09-19T14:12:49.278+0000 7f4e9bae3640 10 monclient: get_auth_request con 0x7f4e840c5bb0 auth_method 0 2024-09-19T14:12:49.622 INFO:tasks.workunit.client.0.smithi153.stderr: -96> 2024-09-19T14:12:49.278+0000 7f4e9bae3640 0 -- 172.21.15.153:0/2583246184 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f4e840c5bb0 msgr2=0x7f4e840c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:12:49.622 INFO:tasks.workunit.client.0.smithi153.stderr: -95> 2024-09-19T14:12:49.482+0000 7f4e9bae3640 10 monclient: get_auth_request con 0x7f4e840c5bb0 auth_method 0 2024-09-19T14:12:49.622 INFO:tasks.workunit.client.0.smithi153.stderr: -94> 2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:12:49.622 INFO:tasks.workunit.client.0.smithi153.stderr: -93> 2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:12:49.622 INFO:tasks.workunit.client.0.smithi153.stderr: -92> 2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:12:49.622 INFO:tasks.workunit.client.0.smithi153.stderr: -91> 2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:12:49.622 INFO:tasks.workunit.client.0.smithi153.stderr: -90> 2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:12:49.622 INFO:tasks.workunit.client.0.smithi153.stderr: -89> 2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:12:49.622 INFO:tasks.workunit.client.0.smithi153.stderr: -88> 2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.622 INFO:tasks.workunit.client.0.smithi153.stderr: -87> 2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.622 INFO:tasks.workunit.client.0.smithi153.stderr: -86> 2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.622 INFO:tasks.workunit.client.0.smithi153.stderr: -85> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:49.622 INFO:tasks.workunit.client.0.smithi153.stderr: -84> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.623 INFO:tasks.workunit.client.0.smithi153.stderr: -83> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:12:49.623 INFO:tasks.workunit.client.0.smithi153.stderr: -82> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 zone default found 2024-09-19T14:12:49.623 INFO:tasks.workunit.client.0.smithi153.stderr: -81> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 4 Realm: () 2024-09-19T14:12:49.623 INFO:tasks.workunit.client.0.smithi153.stderr: -80> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:12:49.623 INFO:tasks.workunit.client.0.smithi153.stderr: -79> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:12:49.623 INFO:tasks.workunit.client.0.smithi153.stderr: -78> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:12:49.623 INFO:tasks.workunit.client.0.smithi153.stderr: -77> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 zonegroup default 2024-09-19T14:12:49.623 INFO:tasks.workunit.client.0.smithi153.stderr: -76> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.623 INFO:tasks.workunit.client.0.smithi153.stderr: -75> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.623 INFO:tasks.workunit.client.0.smithi153.stderr: -74> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.623 INFO:tasks.workunit.client.0.smithi153.stderr: -73> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.623 INFO:tasks.workunit.client.0.smithi153.stderr: -72> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.623 INFO:tasks.workunit.client.0.smithi153.stderr: -71> 2024-09-19T14:12:49.502+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.623 INFO:tasks.workunit.client.0.smithi153.stderr: -70> 2024-09-19T14:12:49.502+0000 7f4e9dfdd9c0 20 started sync module instance, tier type = 2024-09-19T14:12:49.624 INFO:tasks.workunit.client.0.smithi153.stderr: -69> 2024-09-19T14:12:49.502+0000 7f4e9dfdd9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:12:49.624 INFO:tasks.workunit.client.0.smithi153.stderr: -68> 2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 20 add_watcher() i=0 2024-09-19T14:12:49.624 INFO:tasks.workunit.client.0.smithi153.stderr: -67> 2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 20 add_watcher() i=1 2024-09-19T14:12:49.624 INFO:tasks.workunit.client.0.smithi153.stderr: -66> 2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 20 add_watcher() i=2 2024-09-19T14:12:49.624 INFO:tasks.workunit.client.0.smithi153.stderr: -65> 2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 20 add_watcher() i=3 2024-09-19T14:12:49.624 INFO:tasks.workunit.client.0.smithi153.stderr: -64> 2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 20 add_watcher() i=4 2024-09-19T14:12:49.624 INFO:tasks.workunit.client.0.smithi153.stderr: -63> 2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 20 add_watcher() i=5 2024-09-19T14:12:49.624 INFO:tasks.workunit.client.0.smithi153.stderr: -62> 2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 20 add_watcher() i=6 2024-09-19T14:12:49.624 INFO:tasks.workunit.client.0.smithi153.stderr: -61> 2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 20 add_watcher() i=7 2024-09-19T14:12:49.624 INFO:tasks.workunit.client.0.smithi153.stderr: -60> 2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:12:49.624 INFO:tasks.workunit.client.0.smithi153.stderr: -59> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding auth protocol: cephx 2024-09-19T14:12:49.624 INFO:tasks.workunit.client.0.smithi153.stderr: -58> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding auth protocol: cephx 2024-09-19T14:12:49.624 INFO:tasks.workunit.client.0.smithi153.stderr: -57> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding auth protocol: cephx 2024-09-19T14:12:49.625 INFO:tasks.workunit.client.0.smithi153.stderr: -56> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding con mode: secure 2024-09-19T14:12:49.625 INFO:tasks.workunit.client.0.smithi153.stderr: -55> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding con mode: crc 2024-09-19T14:12:49.625 INFO:tasks.workunit.client.0.smithi153.stderr: -54> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding con mode: secure 2024-09-19T14:12:49.625 INFO:tasks.workunit.client.0.smithi153.stderr: -53> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding con mode: crc 2024-09-19T14:12:49.625 INFO:tasks.workunit.client.0.smithi153.stderr: -52> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding con mode: secure 2024-09-19T14:12:49.625 INFO:tasks.workunit.client.0.smithi153.stderr: -51> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding con mode: crc 2024-09-19T14:12:49.625 INFO:tasks.workunit.client.0.smithi153.stderr: -50> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding con mode: crc 2024-09-19T14:12:49.625 INFO:tasks.workunit.client.0.smithi153.stderr: -49> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding con mode: secure 2024-09-19T14:12:49.625 INFO:tasks.workunit.client.0.smithi153.stderr: -48> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding con mode: crc 2024-09-19T14:12:49.625 INFO:tasks.workunit.client.0.smithi153.stderr: -47> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding con mode: secure 2024-09-19T14:12:49.625 INFO:tasks.workunit.client.0.smithi153.stderr: -46> 2024-09-19T14:12:49.530+0000 7f4d51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:12:49.625 INFO:tasks.workunit.client.0.smithi153.stderr: -45> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding con mode: crc 2024-09-19T14:12:49.625 INFO:tasks.workunit.client.0.smithi153.stderr: -44> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding con mode: secure 2024-09-19T14:12:49.625 INFO:tasks.workunit.client.0.smithi153.stderr: -43> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.626 INFO:tasks.workunit.client.0.smithi153.stderr: -42> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:12:49.626 INFO:tasks.workunit.client.0.smithi153.stderr: -41> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:12:49.626 INFO:tasks.workunit.client.0.smithi153.stderr: -40> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command cache list hook 0x5618387af770 2024-09-19T14:12:49.626 INFO:tasks.workunit.client.0.smithi153.stderr: -39> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command cache inspect hook 0x5618387af770 2024-09-19T14:12:49.626 INFO:tasks.workunit.client.0.smithi153.stderr: -38> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command cache erase hook 0x5618387af770 2024-09-19T14:12:49.626 INFO:tasks.workunit.client.0.smithi153.stderr: -37> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command cache zap hook 0x5618387af770 2024-09-19T14:12:49.626 INFO:tasks.workunit.client.0.smithi153.stderr: -36> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 note: GC not initialized 2024-09-19T14:12:49.626 INFO:tasks.workunit.client.0.smithi153.stderr: -35> 2024-09-19T14:12:49.530+0000 7f4d50fe1640 20 reqs_thread_entry: start 2024-09-19T14:12:49.626 INFO:tasks.workunit.client.0.smithi153.stderr: -34> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command sync trace show hook 0x7f4e8c00d8a0 2024-09-19T14:12:49.626 INFO:tasks.workunit.client.0.smithi153.stderr: -33> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command sync trace history hook 0x7f4e8c00d8a0 2024-09-19T14:12:49.626 INFO:tasks.workunit.client.0.smithi153.stderr: -32> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command sync trace active hook 0x7f4e8c00d8a0 2024-09-19T14:12:49.626 INFO:tasks.workunit.client.0.smithi153.stderr: -31> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command sync trace active_short hook 0x7f4e8c00d8a0 2024-09-19T14:12:49.626 INFO:tasks.workunit.client.0.smithi153.stderr: -30> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:12:49.627 INFO:tasks.workunit.client.0.smithi153.stderr: -29> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 20 Filter name: none 2024-09-19T14:12:49.627 INFO:tasks.workunit.client.0.smithi153.stderr: -28> 2024-09-19T14:12:49.530+0000 7f4cca7fc640 20 reqs_thread_entry: start 2024-09-19T14:12:49.627 INFO:tasks.workunit.client.0.smithi153.stderr: -27> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:12:49.627 INFO:tasks.workunit.client.0.smithi153.stderr: -26> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.627 INFO:tasks.workunit.client.0.smithi153.stderr: -25> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:12:49.627 INFO:tasks.workunit.client.0.smithi153.stderr: -24> 2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:12:49.627 INFO:tasks.workunit.client.0.smithi153.stderr: -23> 2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:12:49.627 INFO:tasks.workunit.client.0.smithi153.stderr: -22> 2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : miss 2024-09-19T14:12:49.627 INFO:tasks.workunit.client.0.smithi153.stderr: -21> 2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.627 INFO:tasks.workunit.client.0.smithi153.stderr: -20> 2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-19T14:12:49.627 INFO:tasks.workunit.client.0.smithi153.stderr: -19> 2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:12:49.627 INFO:tasks.workunit.client.0.smithi153.stderr: -18> 2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:12:49.627 INFO:tasks.workunit.client.0.smithi153.stderr: -17> 2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:12:49.627 INFO:tasks.workunit.client.0.smithi153.stderr: -16> 2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:12:49.628 INFO:tasks.workunit.client.0.smithi153.stderr: -15> 2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:12:49.628 INFO:tasks.workunit.client.0.smithi153.stderr: -14> 2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T14:12:49.628 INFO:tasks.workunit.client.0.smithi153.stderr: -13> 2024-09-19T14:12:49.550+0000 7f4e9dfdd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:12:49.628 INFO:tasks.workunit.client.0.smithi153.stderr: -12> 2024-09-19T14:12:49.550+0000 7f4e9dfdd9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:12:49.628 INFO:tasks.workunit.client.0.smithi153.stderr: -11> 2024-09-19T14:12:49.550+0000 7f4e9dfdd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:12:49.628 INFO:tasks.workunit.client.0.smithi153.stderr: -10> 2024-09-19T14:12:49.550+0000 7f4e9dfdd9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17, ofs0, ns] 2024-09-19T14:12:49.628 INFO:tasks.workunit.client.0.smithi153.stderr: -9> 2024-09-19T14:12:49.550+0000 7f4d7a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333528 cookie 94662027007440 notifier 8259 bl.length()=827 2024-09-19T14:12:49.628 INFO:tasks.workunit.client.0.smithi153.stderr: -8> 2024-09-19T14:12:49.550+0000 7f4d7a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:12:49.628 INFO:tasks.workunit.client.0.smithi153.stderr: -7> 2024-09-19T14:12:49.550+0000 7f4d7a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:12:49.628 INFO:tasks.workunit.client.0.smithi153.stderr: -6> 2024-09-19T14:12:49.550+0000 7f4d7a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:12:49.628 INFO:tasks.workunit.client.0.smithi153.stderr: -5> 2024-09-19T14:12:49.554+0000 7f4e9dfdd9c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_sources= new_sources= 2024-09-19T14:12:49.628 INFO:tasks.workunit.client.0.smithi153.stderr: -4> 2024-09-19T14:12:49.554+0000 7f4e9dfdd9c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential sources added=[] removed=[] 2024-09-19T14:12:49.628 INFO:tasks.workunit.client.0.smithi153.stderr: -3> 2024-09-19T14:12:49.554+0000 7f4e9dfdd9c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_dests= new_dests= 2024-09-19T14:12:49.629 INFO:tasks.workunit.client.0.smithi153.stderr: -2> 2024-09-19T14:12:49.554+0000 7f4e9dfdd9c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential dests added=[] removed=[] 2024-09-19T14:12:49.629 INFO:tasks.workunit.client.0.smithi153.stderr: -1> 2024-09-19T14:12:49.562+0000 7f4e9dfdd9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4e9dfdd9c0 time 2024-09-19T14:12:49.564285+0000 2024-09-19T14:12:49.629 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:12:49.629 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.629 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:12:49.629 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4ea18b72eb] 2024-09-19T14:12:49.629 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4ea18b749f] 2024-09-19T14:12:49.629 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561835b51271] 2024-09-19T14:12:49.629 INFO:tasks.workunit.client.0.smithi153.stderr: 4: radosgw-admin(+0x141057c) [0x5618365a257c] 2024-09-19T14:12:49.629 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561835b610dd] 2024-09-19T14:12:49.629 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:12:49.629 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4ea071dd90] 2024-09-19T14:12:49.629 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:12:49.630 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:12:49.630 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.630 INFO:tasks.workunit.client.0.smithi153.stderr: 0> 2024-09-19T14:12:49.562+0000 7f4e9dfdd9c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:12:49.630 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7f4e9dfdd9c0 thread_name:radosgw-admin 2024-09-19T14:12:49.630 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.630 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:12:49.630 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4ea0736520] 2024-09-19T14:12:49.630 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:12:49.630 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:12:49.630 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:12:49.630 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4ea18b7345] 2024-09-19T14:12:49.630 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4ea18b749f] 2024-09-19T14:12:49.630 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561835b51271] 2024-09-19T14:12:49.630 INFO:tasks.workunit.client.0.smithi153.stderr: 8: radosgw-admin(+0x141057c) [0x5618365a257c] 2024-09-19T14:12:49.630 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561835b610dd] 2024-09-19T14:12:49.631 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:12:49.631 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4ea071dd90] 2024-09-19T14:12:49.631 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:12:49.631 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:12:49.631 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:12:49.631 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.631 INFO:tasks.workunit.client.0.smithi153.stderr:--- logging levels --- 2024-09-19T14:12:49.631 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 none 2024-09-19T14:12:49.631 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 lockdep 2024-09-19T14:12:49.631 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 context 2024-09-19T14:12:49.631 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 crush 2024-09-19T14:12:49.631 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds 2024-09-19T14:12:49.631 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_balancer 2024-09-19T14:12:49.631 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_locker 2024-09-19T14:12:49.632 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log 2024-09-19T14:12:49.632 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log_expire 2024-09-19T14:12:49.632 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_migrator 2024-09-19T14:12:49.632 INFO:tasks.workunit.client.0.smithi153.stderr: 3/ 5 mds_quiesce 2024-09-19T14:12:49.632 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 buffer 2024-09-19T14:12:49.632 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 timer 2024-09-19T14:12:49.632 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 filer 2024-09-19T14:12:49.632 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 striper 2024-09-19T14:12:49.632 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 objecter 2024-09-19T14:12:49.632 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rados 2024-09-19T14:12:49.632 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd 2024-09-19T14:12:49.632 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_mirror 2024-09-19T14:12:49.632 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_replay 2024-09-19T14:12:49.632 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_pwl 2024-09-19T14:12:49.633 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 journaler 2024-09-19T14:12:49.633 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objectcacher 2024-09-19T14:12:49.633 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:12:49.633 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 client 2024-09-19T14:12:49.633 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 osd 2024-09-19T14:12:49.633 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 optracker 2024-09-19T14:12:49.633 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objclass 2024-09-19T14:12:49.633 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 filestore 2024-09-19T14:12:49.633 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 journal 2024-09-19T14:12:49.633 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 ms 2024-09-19T14:12:49.633 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mon 2024-09-19T14:12:49.633 INFO:tasks.workunit.client.0.smithi153.stderr: 0/10 monc 2024-09-19T14:12:49.633 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 paxos 2024-09-19T14:12:49.633 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 tp 2024-09-19T14:12:49.634 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 auth 2024-09-19T14:12:49.634 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 crypto 2024-09-19T14:12:49.634 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 finisher 2024-09-19T14:12:49.634 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 reserver 2024-09-19T14:12:49.634 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 heartbeatmap 2024-09-19T14:12:49.634 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 perfcounter 2024-09-19T14:12:49.634 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw 2024-09-19T14:12:49.634 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_sync 2024-09-19T14:12:49.634 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_datacache 2024-09-19T14:12:49.634 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_access 2024-09-19T14:12:49.634 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:12:49.634 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_flight 2024-09-19T14:12:49.634 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:12:49.635 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw_notification 2024-09-19T14:12:49.635 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 javaclient 2024-09-19T14:12:49.635 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 asok 2024-09-19T14:12:49.635 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 throttle 2024-09-19T14:12:49.635 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 refs 2024-09-19T14:12:49.635 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 compressor 2024-09-19T14:12:49.635 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluestore 2024-09-19T14:12:49.635 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluefs 2024-09-19T14:12:49.635 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 bdev 2024-09-19T14:12:49.635 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 kstore 2024-09-19T14:12:49.635 INFO:tasks.workunit.client.0.smithi153.stderr: 4/ 5 rocksdb 2024-09-19T14:12:49.635 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 fuse 2024-09-19T14:12:49.635 INFO:tasks.workunit.client.0.smithi153.stderr: 2/ 5 mgr 2024-09-19T14:12:49.635 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mgrc 2024-09-19T14:12:49.636 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 dpdk 2024-09-19T14:12:49.636 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 eventtrace 2024-09-19T14:12:49.636 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 prioritycache 2024-09-19T14:12:49.636 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 test 2024-09-19T14:12:49.636 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:12:49.636 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephsqlite 2024-09-19T14:12:49.636 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:12:49.636 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore 2024-09-19T14:12:49.636 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_onode 2024-09-19T14:12:49.636 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_odata 2024-09-19T14:12:49.636 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_omap 2024-09-19T14:12:49.636 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_tm 2024-09-19T14:12:49.636 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_t 2024-09-19T14:12:49.637 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:12:49.637 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_epm 2024-09-19T14:12:49.637 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_lba 2024-09-19T14:12:49.637 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:12:49.637 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cache 2024-09-19T14:12:49.637 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_journal 2024-09-19T14:12:49.637 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_device 2024-09-19T14:12:49.637 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_backref 2024-09-19T14:12:49.637 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 alienstore 2024-09-19T14:12:49.637 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mclock 2024-09-19T14:12:49.637 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cyanstore 2024-09-19T14:12:49.637 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 ceph_exporter 2024-09-19T14:12:49.637 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 memstore 2024-09-19T14:12:49.637 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 trace 2024-09-19T14:12:49.637 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 ceph_dedup 2024-09-19T14:12:49.638 INFO:tasks.workunit.client.0.smithi153.stderr: -2/-2 (syslog threshold) 2024-09-19T14:12:49.638 INFO:tasks.workunit.client.0.smithi153.stderr: 99/99 (stderr threshold) 2024-09-19T14:12:49.638 INFO:tasks.workunit.client.0.smithi153.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:12:49.638 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4cca7fc640 / http_manager 2024-09-19T14:12:49.638 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4d50fe1640 / http_manager 2024-09-19T14:12:49.638 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4d51fe3640 / rgw_dt_lg_renew 2024-09-19T14:12:49.638 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4d797fa640 / ms_dispatch 2024-09-19T14:12:49.638 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4d7a7fc640 / io_context_pool 2024-09-19T14:12:49.638 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4d7affd640 / io_context_pool 2024-09-19T14:12:49.638 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4d817fa640 / ms_dispatch 2024-09-19T14:12:49.638 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4d83fff640 / ms_dispatch 2024-09-19T14:12:49.638 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4d89e0b640 / io_context_pool 2024-09-19T14:12:49.638 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4e9b2e2640 / msgr-worker-2 2024-09-19T14:12:49.638 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4e9bae3640 / msgr-worker-1 2024-09-19T14:12:49.639 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4e9c2e4640 / msgr-worker-0 2024-09-19T14:12:49.639 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4e9cae5640 / io_context_pool 2024-09-19T14:12:49.639 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4e9dfdd9c0 / radosgw-admin 2024-09-19T14:12:49.639 INFO:tasks.workunit.client.0.smithi153.stderr: max_recent 500 2024-09-19T14:12:49.639 INFO:tasks.workunit.client.0.smithi153.stderr: max_new 1000 2024-09-19T14:12:49.639 INFO:tasks.workunit.client.0.smithi153.stderr: log_file /var/log/ceph/ceph-client.admin.144696.log 2024-09-19T14:12:49.639 INFO:tasks.workunit.client.0.smithi153.stderr:--- end dump of recent events --- 2024-09-19T14:12:49.639 INFO:tasks.workunit.client.0.smithi153.stderr:--- begin dump of recent events --- 2024-09-19T14:12:49.639 INFO:tasks.workunit.client.0.smithi153.stderr: -499> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:49.639 INFO:tasks.workunit.client.0.smithi153.stderr: -498> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_done global_id 8247 payload 274 2024-09-19T14:12:49.639 INFO:tasks.workunit.client.0.smithi153.stderr: -497> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient: _finish_hunting 0 2024-09-19T14:12:49.639 INFO:tasks.workunit.client.0.smithi153.stderr: -496> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 1 monclient: found mon.noname-a 2024-09-19T14:12:49.639 INFO:tasks.workunit.client.0.smithi153.stderr: -495> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:12:49.639 INFO:tasks.workunit.client.0.smithi153.stderr: -494> 2024-09-19T14:12:48.630+0000 7f4e9c2e4640 10 monclient: get_auth_request con 0x561838636cb0 auth_method 0 2024-09-19T14:12:49.640 INFO:tasks.workunit.client.0.smithi153.stderr: -493> 2024-09-19T14:12:48.630+0000 7f4d89e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:49.640 INFO:tasks.workunit.client.0.smithi153.stderr: -492> 2024-09-19T14:12:48.630+0000 7f4d89e0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:12:49.640 INFO:tasks.workunit.client.0.smithi153.stderr: -491> 2024-09-19T14:12:48.630+0000 7f4d89e0b640 10 monclient: dump: 2024-09-19T14:12:49.640 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:49.640 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:49.640 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.640 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.640 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:49.640 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.640 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:49.640 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:49.640 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:49.640 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.641 INFO:tasks.workunit.client.0.smithi153.stderr: -490> 2024-09-19T14:12:48.630+0000 7f4d89e0b640 10 monclient: _finish_auth 0 2024-09-19T14:12:49.641 INFO:tasks.workunit.client.0.smithi153.stderr: -489> 2024-09-19T14:12:48.630+0000 7f4d89e0b640 10 monclient: _check_auth_tickets 2024-09-19T14:12:49.641 INFO:tasks.workunit.client.0.smithi153.stderr: -488> 2024-09-19T14:12:48.630+0000 7f4d89e0b640 10 monclient: handle_config config(0 keys) 2024-09-19T14:12:49.641 INFO:tasks.workunit.client.0.smithi153.stderr: -487> 2024-09-19T14:12:48.630+0000 7f4d89e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:49.641 INFO:tasks.workunit.client.0.smithi153.stderr: -486> 2024-09-19T14:12:48.630+0000 7f4d89e0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:12:49.641 INFO:tasks.workunit.client.0.smithi153.stderr: -485> 2024-09-19T14:12:48.630+0000 7f4d89e0b640 10 monclient: dump: 2024-09-19T14:12:49.641 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:49.641 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:49.641 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.641 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.641 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:49.641 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.641 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:49.642 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:49.642 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:49.642 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.642 INFO:tasks.workunit.client.0.smithi153.stderr: -484> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 monclient: authenticate success, global_id 8247 2024-09-19T14:12:49.642 INFO:tasks.workunit.client.0.smithi153.stderr: -483> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient: get_monmap_and_config success 2024-09-19T14:12:49.642 INFO:tasks.workunit.client.0.smithi153.stderr: -482> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 4 set_mon_vals no callback set 2024-09-19T14:12:49.642 INFO:tasks.workunit.client.0.smithi153.stderr: -481> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient: shutdown 2024-09-19T14:12:49.642 INFO:tasks.workunit.client.0.smithi153.stderr: -480> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) unregister_commands rotate-key 2024-09-19T14:12:49.642 INFO:tasks.workunit.client.0.smithi153.stderr: -479> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient: build_initial_monmap 2024-09-19T14:12:49.642 INFO:tasks.workunit.client.0.smithi153.stderr: -478> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 1 build_initial for_mkfs: 0 2024-09-19T14:12:49.642 INFO:tasks.workunit.client.0.smithi153.stderr: -477> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient: monmap: 2024-09-19T14:12:49.642 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:12:49.642 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:12:49.642 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:12:49.643 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:12:49.643 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:12:49.643 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.643 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:12:49.643 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:12:49.643 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:12:49.643 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.643 INFO:tasks.workunit.client.0.smithi153.stderr: -476> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding auth protocol: cephx 2024-09-19T14:12:49.643 INFO:tasks.workunit.client.0.smithi153.stderr: -475> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding auth protocol: cephx 2024-09-19T14:12:49.643 INFO:tasks.workunit.client.0.smithi153.stderr: -474> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding auth protocol: cephx 2024-09-19T14:12:49.643 INFO:tasks.workunit.client.0.smithi153.stderr: -473> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding con mode: secure 2024-09-19T14:12:49.643 INFO:tasks.workunit.client.0.smithi153.stderr: -472> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding con mode: crc 2024-09-19T14:12:49.643 INFO:tasks.workunit.client.0.smithi153.stderr: -471> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding con mode: secure 2024-09-19T14:12:49.643 INFO:tasks.workunit.client.0.smithi153.stderr: -470> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding con mode: crc 2024-09-19T14:12:49.644 INFO:tasks.workunit.client.0.smithi153.stderr: -469> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding con mode: secure 2024-09-19T14:12:49.644 INFO:tasks.workunit.client.0.smithi153.stderr: -468> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding con mode: crc 2024-09-19T14:12:49.644 INFO:tasks.workunit.client.0.smithi153.stderr: -467> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding con mode: crc 2024-09-19T14:12:49.644 INFO:tasks.workunit.client.0.smithi153.stderr: -466> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding con mode: secure 2024-09-19T14:12:49.644 INFO:tasks.workunit.client.0.smithi153.stderr: -465> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding con mode: crc 2024-09-19T14:12:49.644 INFO:tasks.workunit.client.0.smithi153.stderr: -464> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding con mode: secure 2024-09-19T14:12:49.644 INFO:tasks.workunit.client.0.smithi153.stderr: -463> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding con mode: crc 2024-09-19T14:12:49.644 INFO:tasks.workunit.client.0.smithi153.stderr: -462> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183871bff0) adding con mode: secure 2024-09-19T14:12:49.644 INFO:tasks.workunit.client.0.smithi153.stderr: -461> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.644 INFO:tasks.workunit.client.0.smithi153.stderr: -460> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 1 librados: starting msgr at 2024-09-19T14:12:49.644 INFO:tasks.workunit.client.0.smithi153.stderr: -459> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 1 librados: starting objecter 2024-09-19T14:12:49.644 INFO:tasks.workunit.client.0.smithi153.stderr: -458> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command objecter_requests hook 0x5618386e8c50 2024-09-19T14:12:49.644 INFO:tasks.workunit.client.0.smithi153.stderr: -457> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 1 librados: setting wanted keys 2024-09-19T14:12:49.645 INFO:tasks.workunit.client.0.smithi153.stderr: -456> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 1 librados: calling monclient init 2024-09-19T14:12:49.645 INFO:tasks.workunit.client.0.smithi153.stderr: -455> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient: init 2024-09-19T14:12:49.645 INFO:tasks.workunit.client.0.smithi153.stderr: -454> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding auth protocol: cephx 2024-09-19T14:12:49.645 INFO:tasks.workunit.client.0.smithi153.stderr: -453> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding auth protocol: cephx 2024-09-19T14:12:49.645 INFO:tasks.workunit.client.0.smithi153.stderr: -452> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding auth protocol: cephx 2024-09-19T14:12:49.645 INFO:tasks.workunit.client.0.smithi153.stderr: -451> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding con mode: secure 2024-09-19T14:12:49.645 INFO:tasks.workunit.client.0.smithi153.stderr: -450> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding con mode: crc 2024-09-19T14:12:49.645 INFO:tasks.workunit.client.0.smithi153.stderr: -449> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding con mode: secure 2024-09-19T14:12:49.645 INFO:tasks.workunit.client.0.smithi153.stderr: -448> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding con mode: crc 2024-09-19T14:12:49.645 INFO:tasks.workunit.client.0.smithi153.stderr: -447> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding con mode: secure 2024-09-19T14:12:49.645 INFO:tasks.workunit.client.0.smithi153.stderr: -446> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding con mode: crc 2024-09-19T14:12:49.645 INFO:tasks.workunit.client.0.smithi153.stderr: -445> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding con mode: crc 2024-09-19T14:12:49.645 INFO:tasks.workunit.client.0.smithi153.stderr: -444> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding con mode: secure 2024-09-19T14:12:49.645 INFO:tasks.workunit.client.0.smithi153.stderr: -443> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding con mode: crc 2024-09-19T14:12:49.646 INFO:tasks.workunit.client.0.smithi153.stderr: -442> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding con mode: secure 2024-09-19T14:12:49.646 INFO:tasks.workunit.client.0.smithi153.stderr: -441> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding con mode: crc 2024-09-19T14:12:49.646 INFO:tasks.workunit.client.0.smithi153.stderr: -440> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618386eb0c0) adding con mode: secure 2024-09-19T14:12:49.646 INFO:tasks.workunit.client.0.smithi153.stderr: -439> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.646 INFO:tasks.workunit.client.0.smithi153.stderr: -438> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.646 INFO:tasks.workunit.client.0.smithi153.stderr: -437> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command rotate-key hook 0x5618386eb208 2024-09-19T14:12:49.646 INFO:tasks.workunit.client.0.smithi153.stderr: -436> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient: _reopen_session rank -1 2024-09-19T14:12:49.646 INFO:tasks.workunit.client.0.smithi153.stderr: -435> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T14:12:49.646 INFO:tasks.workunit.client.0.smithi153.stderr: -434> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient(hunting): picked mon.noname-b con 0x56183859b290 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:12:49.646 INFO:tasks.workunit.client.0.smithi153.stderr: -433> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient(hunting): picked mon.noname-c con 0x561838633d50 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:12:49.646 INFO:tasks.workunit.client.0.smithi153.stderr: -432> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient(hunting): picked mon.noname-a con 0x561838636cb0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:12:49.646 INFO:tasks.workunit.client.0.smithi153.stderr: -431> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:49.646 INFO:tasks.workunit.client.0.smithi153.stderr: -430> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:49.646 INFO:tasks.workunit.client.0.smithi153.stderr: -429> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:49.647 INFO:tasks.workunit.client.0.smithi153.stderr: -428> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient(hunting): _renew_subs 2024-09-19T14:12:49.647 INFO:tasks.workunit.client.0.smithi153.stderr: -427> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient(hunting): authenticate will time out at 2957.094874s 2024-09-19T14:12:49.647 INFO:tasks.workunit.client.0.smithi153.stderr: -426> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient(hunting): get_auth_request con 0x561838633d50 auth_method 0 2024-09-19T14:12:49.647 INFO:tasks.workunit.client.0.smithi153.stderr: -425> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:49.647 INFO:tasks.workunit.client.0.smithi153.stderr: -424> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:49.647 INFO:tasks.workunit.client.0.smithi153.stderr: -423> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:49.647 INFO:tasks.workunit.client.0.smithi153.stderr: -422> 2024-09-19T14:12:48.630+0000 7f4e9c2e4640 10 monclient(hunting): get_auth_request con 0x561838636cb0 auth_method 0 2024-09-19T14:12:49.647 INFO:tasks.workunit.client.0.smithi153.stderr: -421> 2024-09-19T14:12:48.630+0000 7f4e9c2e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:49.647 INFO:tasks.workunit.client.0.smithi153.stderr: -420> 2024-09-19T14:12:48.630+0000 7f4e9c2e4640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:49.647 INFO:tasks.workunit.client.0.smithi153.stderr: -419> 2024-09-19T14:12:48.630+0000 7f4e9c2e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:49.647 INFO:tasks.workunit.client.0.smithi153.stderr: -418> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:49.647 INFO:tasks.workunit.client.0.smithi153.stderr: -417> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:49.647 INFO:tasks.workunit.client.0.smithi153.stderr: -416> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:49.648 INFO:tasks.workunit.client.0.smithi153.stderr: -415> 2024-09-19T14:12:48.630+0000 7f4e9c2e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:49.648 INFO:tasks.workunit.client.0.smithi153.stderr: -414> 2024-09-19T14:12:48.630+0000 7f4e9c2e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:49.648 INFO:tasks.workunit.client.0.smithi153.stderr: -413> 2024-09-19T14:12:48.630+0000 7f4e9c2e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:49.648 INFO:tasks.workunit.client.0.smithi153.stderr: -412> 2024-09-19T14:12:48.630+0000 7f4e9bae3640 10 monclient(hunting): get_auth_request con 0x56183859b290 auth_method 0 2024-09-19T14:12:49.648 INFO:tasks.workunit.client.0.smithi153.stderr: -411> 2024-09-19T14:12:48.630+0000 7f4e9bae3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:49.648 INFO:tasks.workunit.client.0.smithi153.stderr: -410> 2024-09-19T14:12:48.630+0000 7f4e9bae3640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:49.648 INFO:tasks.workunit.client.0.smithi153.stderr: -409> 2024-09-19T14:12:48.630+0000 7f4e9bae3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:49.648 INFO:tasks.workunit.client.0.smithi153.stderr: -408> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_done global_id 7727 payload 824 2024-09-19T14:12:49.648 INFO:tasks.workunit.client.0.smithi153.stderr: -407> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient: _finish_hunting 0 2024-09-19T14:12:49.648 INFO:tasks.workunit.client.0.smithi153.stderr: -406> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 1 monclient: found mon.noname-c 2024-09-19T14:12:49.648 INFO:tasks.workunit.client.0.smithi153.stderr: -405> 2024-09-19T14:12:48.630+0000 7f4e9b2e2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:12:49.648 INFO:tasks.workunit.client.0.smithi153.stderr: -404> 2024-09-19T14:12:48.630+0000 7f4d83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:49.648 INFO:tasks.workunit.client.0.smithi153.stderr: -403> 2024-09-19T14:12:48.630+0000 7f4d83fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:12:49.649 INFO:tasks.workunit.client.0.smithi153.stderr: -402> 2024-09-19T14:12:48.630+0000 7f4d83fff640 10 monclient: dump: 2024-09-19T14:12:49.649 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:49.649 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:49.649 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.649 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.649 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:49.649 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.649 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:49.649 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:49.649 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:49.649 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.649 INFO:tasks.workunit.client.0.smithi153.stderr: -401> 2024-09-19T14:12:48.630+0000 7f4d83fff640 10 monclient: _finish_auth 0 2024-09-19T14:12:49.649 INFO:tasks.workunit.client.0.smithi153.stderr: -400> 2024-09-19T14:12:48.630+0000 7f4d83fff640 10 monclient: _check_auth_tickets 2024-09-19T14:12:49.650 INFO:tasks.workunit.client.0.smithi153.stderr: -399> 2024-09-19T14:12:48.630+0000 7f4d83fff640 10 monclient: handle_config config(0 keys) 2024-09-19T14:12:49.650 INFO:tasks.workunit.client.0.smithi153.stderr: -398> 2024-09-19T14:12:48.630+0000 7f4d83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:49.650 INFO:tasks.workunit.client.0.smithi153.stderr: -397> 2024-09-19T14:12:48.630+0000 7f4d83fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:12:49.650 INFO:tasks.workunit.client.0.smithi153.stderr: -396> 2024-09-19T14:12:48.630+0000 7f4d83fff640 10 monclient: dump: 2024-09-19T14:12:49.650 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:49.650 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:49.650 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.650 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.650 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:49.650 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.650 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:49.650 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:49.650 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:49.650 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.651 INFO:tasks.workunit.client.0.smithi153.stderr: -395> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 5 monclient: authenticate success, global_id 7727 2024-09-19T14:12:49.651 INFO:tasks.workunit.client.0.smithi153.stderr: -394> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient: _renew_subs 2024-09-19T14:12:49.651 INFO:tasks.workunit.client.0.smithi153.stderr: -393> 2024-09-19T14:12:48.630+0000 7f4d89e0b640 4 set_mon_vals no callback set 2024-09-19T14:12:49.651 INFO:tasks.workunit.client.0.smithi153.stderr: -392> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:12:49.651 INFO:tasks.workunit.client.0.smithi153.stderr: -391> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient: _renew_subs 2024-09-19T14:12:49.651 INFO:tasks.workunit.client.0.smithi153.stderr: -390> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:12:49.651 INFO:tasks.workunit.client.0.smithi153.stderr: -389> 2024-09-19T14:12:48.630+0000 7f4e9dfdd9c0 1 librados: init done 2024-09-19T14:12:49.651 INFO:tasks.workunit.client.0.smithi153.stderr: -388> 2024-09-19T14:12:48.634+0000 7f4d83fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:12:49.651 INFO:tasks.workunit.client.0.smithi153.stderr: -387> 2024-09-19T14:12:48.634+0000 7f4d83fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:12:49.651 INFO:tasks.workunit.client.0.smithi153.stderr: -386> 2024-09-19T14:12:48.634+0000 7f4d83fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:12:49.651 INFO:tasks.workunit.client.0.smithi153.stderr: -385> 2024-09-19T14:12:48.634+0000 7f4e9bae3640 10 monclient: get_auth_request con 0x7f4d84071be0 auth_method 0 2024-09-19T14:12:49.651 INFO:tasks.workunit.client.0.smithi153.stderr: -384> 2024-09-19T14:12:48.634+0000 7f4e9c2e4640 10 monclient: get_auth_request con 0x561838713520 auth_method 0 2024-09-19T14:12:49.651 INFO:tasks.workunit.client.0.smithi153.stderr: -383> 2024-09-19T14:12:48.634+0000 7f4e9bae3640 10 monclient: get_auth_request con 0x561838736030 auth_method 0 2024-09-19T14:12:49.651 INFO:tasks.workunit.client.0.smithi153.stderr: -382> 2024-09-19T14:12:48.638+0000 7f4e9b2e2640 10 monclient: get_auth_request con 0x56183873b0c0 auth_method 0 2024-09-19T14:12:49.652 INFO:tasks.workunit.client.0.smithi153.stderr: -381> 2024-09-19T14:12:48.638+0000 7f4e9dfdd9c0 10 monclient: build_initial_monmap 2024-09-19T14:12:49.652 INFO:tasks.workunit.client.0.smithi153.stderr: -380> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 1 build_initial for_mkfs: 0 2024-09-19T14:12:49.652 INFO:tasks.workunit.client.0.smithi153.stderr: -379> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient: monmap: 2024-09-19T14:12:49.652 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:12:49.652 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:12:49.652 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:12:49.652 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:12:49.652 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:12:49.652 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.652 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:12:49.652 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:12:49.652 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:12:49.652 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.653 INFO:tasks.workunit.client.0.smithi153.stderr: -378> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding auth protocol: cephx 2024-09-19T14:12:49.653 INFO:tasks.workunit.client.0.smithi153.stderr: -377> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding auth protocol: cephx 2024-09-19T14:12:49.653 INFO:tasks.workunit.client.0.smithi153.stderr: -376> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding auth protocol: cephx 2024-09-19T14:12:49.653 INFO:tasks.workunit.client.0.smithi153.stderr: -375> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding con mode: secure 2024-09-19T14:12:49.653 INFO:tasks.workunit.client.0.smithi153.stderr: -374> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding con mode: crc 2024-09-19T14:12:49.653 INFO:tasks.workunit.client.0.smithi153.stderr: -373> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding con mode: secure 2024-09-19T14:12:49.653 INFO:tasks.workunit.client.0.smithi153.stderr: -372> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding con mode: crc 2024-09-19T14:12:49.653 INFO:tasks.workunit.client.0.smithi153.stderr: -371> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding con mode: secure 2024-09-19T14:12:49.653 INFO:tasks.workunit.client.0.smithi153.stderr: -370> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding con mode: crc 2024-09-19T14:12:49.653 INFO:tasks.workunit.client.0.smithi153.stderr: -369> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding con mode: crc 2024-09-19T14:12:49.653 INFO:tasks.workunit.client.0.smithi153.stderr: -368> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding con mode: secure 2024-09-19T14:12:49.653 INFO:tasks.workunit.client.0.smithi153.stderr: -367> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding con mode: crc 2024-09-19T14:12:49.653 INFO:tasks.workunit.client.0.smithi153.stderr: -366> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding con mode: secure 2024-09-19T14:12:49.653 INFO:tasks.workunit.client.0.smithi153.stderr: -365> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding con mode: crc 2024-09-19T14:12:49.654 INFO:tasks.workunit.client.0.smithi153.stderr: -364> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873edb0) adding con mode: secure 2024-09-19T14:12:49.654 INFO:tasks.workunit.client.0.smithi153.stderr: -363> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.654 INFO:tasks.workunit.client.0.smithi153.stderr: -362> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command objecter_requests cmddesc objecter_requests hook 0x5618387426d0 EEXIST 2024-09-19T14:12:49.654 INFO:tasks.workunit.client.0.smithi153.stderr: -361> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient: init 2024-09-19T14:12:49.654 INFO:tasks.workunit.client.0.smithi153.stderr: -360> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding auth protocol: cephx 2024-09-19T14:12:49.654 INFO:tasks.workunit.client.0.smithi153.stderr: -359> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding auth protocol: cephx 2024-09-19T14:12:49.654 INFO:tasks.workunit.client.0.smithi153.stderr: -358> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding auth protocol: cephx 2024-09-19T14:12:49.654 INFO:tasks.workunit.client.0.smithi153.stderr: -357> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding con mode: secure 2024-09-19T14:12:49.654 INFO:tasks.workunit.client.0.smithi153.stderr: -356> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding con mode: crc 2024-09-19T14:12:49.654 INFO:tasks.workunit.client.0.smithi153.stderr: -355> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding con mode: secure 2024-09-19T14:12:49.654 INFO:tasks.workunit.client.0.smithi153.stderr: -354> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding con mode: crc 2024-09-19T14:12:49.654 INFO:tasks.workunit.client.0.smithi153.stderr: -353> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding con mode: secure 2024-09-19T14:12:49.654 INFO:tasks.workunit.client.0.smithi153.stderr: -352> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding con mode: crc 2024-09-19T14:12:49.654 INFO:tasks.workunit.client.0.smithi153.stderr: -351> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding con mode: crc 2024-09-19T14:12:49.655 INFO:tasks.workunit.client.0.smithi153.stderr: -350> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding con mode: secure 2024-09-19T14:12:49.655 INFO:tasks.workunit.client.0.smithi153.stderr: -349> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding con mode: crc 2024-09-19T14:12:49.655 INFO:tasks.workunit.client.0.smithi153.stderr: -348> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding con mode: secure 2024-09-19T14:12:49.655 INFO:tasks.workunit.client.0.smithi153.stderr: -347> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding con mode: crc 2024-09-19T14:12:49.655 INFO:tasks.workunit.client.0.smithi153.stderr: -346> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183873de08) adding con mode: secure 2024-09-19T14:12:49.655 INFO:tasks.workunit.client.0.smithi153.stderr: -345> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.655 INFO:tasks.workunit.client.0.smithi153.stderr: -344> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.655 INFO:tasks.workunit.client.0.smithi153.stderr: -343> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command rotate-key cmddesc rotate-key hook 0x56183873df50 EEXIST 2024-09-19T14:12:49.655 INFO:tasks.workunit.client.0.smithi153.stderr: -342> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient: _reopen_session rank -1 2024-09-19T14:12:49.655 INFO:tasks.workunit.client.0.smithi153.stderr: -341> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-19T14:12:49.655 INFO:tasks.workunit.client.0.smithi153.stderr: -340> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient(hunting): picked mon.noname-b con 0x561838766880 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:12:49.655 INFO:tasks.workunit.client.0.smithi153.stderr: -339> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient(hunting): picked mon.noname-a con 0x5618387661b0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:12:49.655 INFO:tasks.workunit.client.0.smithi153.stderr: -338> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient(hunting): picked mon.noname-c con 0x561838764b90 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:12:49.656 INFO:tasks.workunit.client.0.smithi153.stderr: -337> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:49.656 INFO:tasks.workunit.client.0.smithi153.stderr: -336> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:49.656 INFO:tasks.workunit.client.0.smithi153.stderr: -335> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:49.656 INFO:tasks.workunit.client.0.smithi153.stderr: -334> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient(hunting): _renew_subs 2024-09-19T14:12:49.656 INFO:tasks.workunit.client.0.smithi153.stderr: -333> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient(hunting): authenticate will time out at 2957.105184s 2024-09-19T14:12:49.656 INFO:tasks.workunit.client.0.smithi153.stderr: -332> 2024-09-19T14:12:48.642+0000 7f4e9b2e2640 10 monclient(hunting): get_auth_request con 0x5618387661b0 auth_method 0 2024-09-19T14:12:49.656 INFO:tasks.workunit.client.0.smithi153.stderr: -331> 2024-09-19T14:12:48.642+0000 7f4e9b2e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:49.656 INFO:tasks.workunit.client.0.smithi153.stderr: -330> 2024-09-19T14:12:48.642+0000 7f4e9b2e2640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:49.656 INFO:tasks.workunit.client.0.smithi153.stderr: -329> 2024-09-19T14:12:48.642+0000 7f4e9b2e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:49.656 INFO:tasks.workunit.client.0.smithi153.stderr: -328> 2024-09-19T14:12:48.642+0000 7f4e9c2e4640 10 monclient(hunting): get_auth_request con 0x561838764b90 auth_method 0 2024-09-19T14:12:49.656 INFO:tasks.workunit.client.0.smithi153.stderr: -327> 2024-09-19T14:12:48.642+0000 7f4e9c2e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:49.656 INFO:tasks.workunit.client.0.smithi153.stderr: -326> 2024-09-19T14:12:48.642+0000 7f4e9c2e4640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:49.656 INFO:tasks.workunit.client.0.smithi153.stderr: -325> 2024-09-19T14:12:48.642+0000 7f4e9c2e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:49.657 INFO:tasks.workunit.client.0.smithi153.stderr: -324> 2024-09-19T14:12:48.642+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:49.657 INFO:tasks.workunit.client.0.smithi153.stderr: -323> 2024-09-19T14:12:48.642+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:49.657 INFO:tasks.workunit.client.0.smithi153.stderr: -322> 2024-09-19T14:12:48.642+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:49.657 INFO:tasks.workunit.client.0.smithi153.stderr: -321> 2024-09-19T14:12:48.642+0000 7f4e9c2e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:49.657 INFO:tasks.workunit.client.0.smithi153.stderr: -320> 2024-09-19T14:12:48.642+0000 7f4e9c2e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:49.657 INFO:tasks.workunit.client.0.smithi153.stderr: -319> 2024-09-19T14:12:48.642+0000 7f4e9c2e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:49.657 INFO:tasks.workunit.client.0.smithi153.stderr: -318> 2024-09-19T14:12:48.642+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_done global_id 8253 payload 824 2024-09-19T14:12:49.657 INFO:tasks.workunit.client.0.smithi153.stderr: -317> 2024-09-19T14:12:48.642+0000 7f4e9b2e2640 10 monclient: _finish_hunting 0 2024-09-19T14:12:49.657 INFO:tasks.workunit.client.0.smithi153.stderr: -316> 2024-09-19T14:12:48.642+0000 7f4e9b2e2640 1 monclient: found mon.noname-a 2024-09-19T14:12:49.657 INFO:tasks.workunit.client.0.smithi153.stderr: -315> 2024-09-19T14:12:48.642+0000 7f4e9b2e2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:12:49.657 INFO:tasks.workunit.client.0.smithi153.stderr: -314> 2024-09-19T14:12:48.642+0000 7f4e9bae3640 10 monclient: get_auth_request con 0x561838766880 auth_method 0 2024-09-19T14:12:49.657 INFO:tasks.workunit.client.0.smithi153.stderr: -313> 2024-09-19T14:12:48.642+0000 7f4d817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:49.657 INFO:tasks.workunit.client.0.smithi153.stderr: -312> 2024-09-19T14:12:48.642+0000 7f4d817fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:12:49.657 INFO:tasks.workunit.client.0.smithi153.stderr: -311> 2024-09-19T14:12:48.642+0000 7f4d817fa640 10 monclient: dump: 2024-09-19T14:12:49.658 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:49.658 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:49.658 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.658 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.658 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:49.658 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.658 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:49.658 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:49.658 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:49.658 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.658 INFO:tasks.workunit.client.0.smithi153.stderr: -310> 2024-09-19T14:12:48.642+0000 7f4d817fa640 10 monclient: _finish_auth 0 2024-09-19T14:12:49.658 INFO:tasks.workunit.client.0.smithi153.stderr: -309> 2024-09-19T14:12:48.642+0000 7f4d817fa640 10 monclient: _check_auth_tickets 2024-09-19T14:12:49.658 INFO:tasks.workunit.client.0.smithi153.stderr: -308> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 5 monclient: authenticate success, global_id 8253 2024-09-19T14:12:49.658 INFO:tasks.workunit.client.0.smithi153.stderr: -307> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient: _renew_subs 2024-09-19T14:12:49.659 INFO:tasks.workunit.client.0.smithi153.stderr: -306> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:12:49.659 INFO:tasks.workunit.client.0.smithi153.stderr: -305> 2024-09-19T14:12:48.642+0000 7f4d817fa640 10 monclient: handle_config config(0 keys) 2024-09-19T14:12:49.659 INFO:tasks.workunit.client.0.smithi153.stderr: -304> 2024-09-19T14:12:48.642+0000 7f4d817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:49.659 INFO:tasks.workunit.client.0.smithi153.stderr: -303> 2024-09-19T14:12:48.642+0000 7f4d817fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:12:49.659 INFO:tasks.workunit.client.0.smithi153.stderr: -302> 2024-09-19T14:12:48.642+0000 7f4d817fa640 10 monclient: dump: 2024-09-19T14:12:49.659 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:49.659 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:49.659 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.659 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.659 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:49.659 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.659 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:49.660 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:49.660 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:49.660 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.660 INFO:tasks.workunit.client.0.smithi153.stderr: -301> 2024-09-19T14:12:48.642+0000 7f4e9cae5640 4 set_mon_vals no callback set 2024-09-19T14:12:49.660 INFO:tasks.workunit.client.0.smithi153.stderr: -300> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient: _renew_subs 2024-09-19T14:12:49.660 INFO:tasks.workunit.client.0.smithi153.stderr: -299> 2024-09-19T14:12:48.642+0000 7f4e9dfdd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:12:49.660 INFO:tasks.workunit.client.0.smithi153.stderr: -298> 2024-09-19T14:12:48.642+0000 7f4d817fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:12:49.660 INFO:tasks.workunit.client.0.smithi153.stderr: -297> 2024-09-19T14:12:48.642+0000 7f4d817fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:12:49.660 INFO:tasks.workunit.client.0.smithi153.stderr: -296> 2024-09-19T14:12:48.642+0000 7f4d817fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:12:49.660 INFO:tasks.workunit.client.0.smithi153.stderr: -295> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: get_monmap_and_config 2024-09-19T14:12:49.660 INFO:tasks.workunit.client.0.smithi153.stderr: -294> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: build_initial_monmap 2024-09-19T14:12:49.660 INFO:tasks.workunit.client.0.smithi153.stderr: -293> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 1 build_initial for_mkfs: 0 2024-09-19T14:12:49.660 INFO:tasks.workunit.client.0.smithi153.stderr: -292> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: monmap: 2024-09-19T14:12:49.661 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:12:49.661 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:12:49.661 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:12:49.661 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:12:49.661 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:12:49.661 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.661 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:12:49.661 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:12:49.661 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:12:49.661 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.661 INFO:tasks.workunit.client.0.smithi153.stderr: -291> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding auth protocol: cephx 2024-09-19T14:12:49.661 INFO:tasks.workunit.client.0.smithi153.stderr: -290> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding auth protocol: cephx 2024-09-19T14:12:49.661 INFO:tasks.workunit.client.0.smithi153.stderr: -289> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding auth protocol: cephx 2024-09-19T14:12:49.662 INFO:tasks.workunit.client.0.smithi153.stderr: -288> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding con mode: secure 2024-09-19T14:12:49.662 INFO:tasks.workunit.client.0.smithi153.stderr: -287> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding con mode: crc 2024-09-19T14:12:49.662 INFO:tasks.workunit.client.0.smithi153.stderr: -286> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding con mode: secure 2024-09-19T14:12:49.662 INFO:tasks.workunit.client.0.smithi153.stderr: -285> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding con mode: crc 2024-09-19T14:12:49.662 INFO:tasks.workunit.client.0.smithi153.stderr: -284> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding con mode: secure 2024-09-19T14:12:49.662 INFO:tasks.workunit.client.0.smithi153.stderr: -283> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding con mode: crc 2024-09-19T14:12:49.662 INFO:tasks.workunit.client.0.smithi153.stderr: -282> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding con mode: crc 2024-09-19T14:12:49.662 INFO:tasks.workunit.client.0.smithi153.stderr: -281> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding con mode: secure 2024-09-19T14:12:49.662 INFO:tasks.workunit.client.0.smithi153.stderr: -280> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding con mode: crc 2024-09-19T14:12:49.662 INFO:tasks.workunit.client.0.smithi153.stderr: -279> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding con mode: secure 2024-09-19T14:12:49.662 INFO:tasks.workunit.client.0.smithi153.stderr: -278> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding con mode: crc 2024-09-19T14:12:49.662 INFO:tasks.workunit.client.0.smithi153.stderr: -277> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x561838785b00) adding con mode: secure 2024-09-19T14:12:49.662 INFO:tasks.workunit.client.0.smithi153.stderr: -276> 2024-09-19T14:12:48.646+0000 7f4e9bae3640 10 monclient: get_auth_request con 0x7f4d74071b20 auth_method 0 2024-09-19T14:12:49.662 INFO:tasks.workunit.client.0.smithi153.stderr: -275> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.663 INFO:tasks.workunit.client.0.smithi153.stderr: -274> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: init 2024-09-19T14:12:49.663 INFO:tasks.workunit.client.0.smithi153.stderr: -273> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding auth protocol: cephx 2024-09-19T14:12:49.663 INFO:tasks.workunit.client.0.smithi153.stderr: -272> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding auth protocol: cephx 2024-09-19T14:12:49.663 INFO:tasks.workunit.client.0.smithi153.stderr: -271> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding auth protocol: cephx 2024-09-19T14:12:49.663 INFO:tasks.workunit.client.0.smithi153.stderr: -270> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding con mode: secure 2024-09-19T14:12:49.663 INFO:tasks.workunit.client.0.smithi153.stderr: -269> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding con mode: crc 2024-09-19T14:12:49.663 INFO:tasks.workunit.client.0.smithi153.stderr: -268> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding con mode: secure 2024-09-19T14:12:49.663 INFO:tasks.workunit.client.0.smithi153.stderr: -267> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding con mode: crc 2024-09-19T14:12:49.663 INFO:tasks.workunit.client.0.smithi153.stderr: -266> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding con mode: secure 2024-09-19T14:12:49.663 INFO:tasks.workunit.client.0.smithi153.stderr: -265> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding con mode: crc 2024-09-19T14:12:49.663 INFO:tasks.workunit.client.0.smithi153.stderr: -264> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding con mode: crc 2024-09-19T14:12:49.663 INFO:tasks.workunit.client.0.smithi153.stderr: -263> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding con mode: secure 2024-09-19T14:12:49.663 INFO:tasks.workunit.client.0.smithi153.stderr: -262> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding con mode: crc 2024-09-19T14:12:49.664 INFO:tasks.workunit.client.0.smithi153.stderr: -261> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding con mode: secure 2024-09-19T14:12:49.664 INFO:tasks.workunit.client.0.smithi153.stderr: -260> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding con mode: crc 2024-09-19T14:12:49.664 INFO:tasks.workunit.client.0.smithi153.stderr: -259> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de2d90) adding con mode: secure 2024-09-19T14:12:49.664 INFO:tasks.workunit.client.0.smithi153.stderr: -258> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.664 INFO:tasks.workunit.client.0.smithi153.stderr: -257> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.664 INFO:tasks.workunit.client.0.smithi153.stderr: -256> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command rotate-key cmddesc rotate-key hook 0x7ffd81de2ed8 EEXIST 2024-09-19T14:12:49.664 INFO:tasks.workunit.client.0.smithi153.stderr: -255> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: _reopen_session rank -1 2024-09-19T14:12:49.664 INFO:tasks.workunit.client.0.smithi153.stderr: -254> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-19T14:12:49.664 INFO:tasks.workunit.client.0.smithi153.stderr: -253> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): picked mon.noname-c con 0x5618387b9f80 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:12:49.664 INFO:tasks.workunit.client.0.smithi153.stderr: -252> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): picked mon.noname-a con 0x561838789d60 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:12:49.664 INFO:tasks.workunit.client.0.smithi153.stderr: -251> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): picked mon.noname-b con 0x5618387b5370 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:12:49.664 INFO:tasks.workunit.client.0.smithi153.stderr: -250> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:49.664 INFO:tasks.workunit.client.0.smithi153.stderr: -249> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:49.665 INFO:tasks.workunit.client.0.smithi153.stderr: -248> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:49.665 INFO:tasks.workunit.client.0.smithi153.stderr: -247> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): _renew_subs 2024-09-19T14:12:49.665 INFO:tasks.workunit.client.0.smithi153.stderr: -246> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): authenticate will time out at 2957.109233s 2024-09-19T14:12:49.665 INFO:tasks.workunit.client.0.smithi153.stderr: -245> 2024-09-19T14:12:48.646+0000 7f4e9bae3640 10 monclient(hunting): get_auth_request con 0x5618387b9f80 auth_method 0 2024-09-19T14:12:49.665 INFO:tasks.workunit.client.0.smithi153.stderr: -244> 2024-09-19T14:12:48.646+0000 7f4e9bae3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:49.665 INFO:tasks.workunit.client.0.smithi153.stderr: -243> 2024-09-19T14:12:48.646+0000 7f4e9bae3640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:49.665 INFO:tasks.workunit.client.0.smithi153.stderr: -242> 2024-09-19T14:12:48.646+0000 7f4e9bae3640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:49.665 INFO:tasks.workunit.client.0.smithi153.stderr: -241> 2024-09-19T14:12:48.646+0000 7f4e9b2e2640 10 monclient(hunting): get_auth_request con 0x561838789d60 auth_method 0 2024-09-19T14:12:49.665 INFO:tasks.workunit.client.0.smithi153.stderr: -240> 2024-09-19T14:12:48.646+0000 7f4e9b2e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:49.665 INFO:tasks.workunit.client.0.smithi153.stderr: -239> 2024-09-19T14:12:48.646+0000 7f4e9b2e2640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:49.665 INFO:tasks.workunit.client.0.smithi153.stderr: -238> 2024-09-19T14:12:48.646+0000 7f4e9b2e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:49.665 INFO:tasks.workunit.client.0.smithi153.stderr: -237> 2024-09-19T14:12:48.646+0000 7f4e9bae3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:49.665 INFO:tasks.workunit.client.0.smithi153.stderr: -236> 2024-09-19T14:12:48.646+0000 7f4e9bae3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:49.665 INFO:tasks.workunit.client.0.smithi153.stderr: -235> 2024-09-19T14:12:48.646+0000 7f4e9bae3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:49.666 INFO:tasks.workunit.client.0.smithi153.stderr: -234> 2024-09-19T14:12:48.646+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:49.666 INFO:tasks.workunit.client.0.smithi153.stderr: -233> 2024-09-19T14:12:48.646+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:49.666 INFO:tasks.workunit.client.0.smithi153.stderr: -232> 2024-09-19T14:12:48.646+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:49.666 INFO:tasks.workunit.client.0.smithi153.stderr: -231> 2024-09-19T14:12:48.646+0000 7f4e9bae3640 10 monclient(hunting): handle_auth_done global_id 7733 payload 274 2024-09-19T14:12:49.666 INFO:tasks.workunit.client.0.smithi153.stderr: -230> 2024-09-19T14:12:48.646+0000 7f4e9bae3640 10 monclient: _finish_hunting 0 2024-09-19T14:12:49.666 INFO:tasks.workunit.client.0.smithi153.stderr: -229> 2024-09-19T14:12:48.646+0000 7f4e9bae3640 1 monclient: found mon.noname-c 2024-09-19T14:12:49.666 INFO:tasks.workunit.client.0.smithi153.stderr: -228> 2024-09-19T14:12:48.646+0000 7f4e9bae3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:12:49.666 INFO:tasks.workunit.client.0.smithi153.stderr: -227> 2024-09-19T14:12:48.646+0000 7f4e9c2e4640 10 monclient: get_auth_request con 0x5618387b5370 auth_method 0 2024-09-19T14:12:49.666 INFO:tasks.workunit.client.0.smithi153.stderr: -226> 2024-09-19T14:12:48.646+0000 7f4d7affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:49.666 INFO:tasks.workunit.client.0.smithi153.stderr: -225> 2024-09-19T14:12:48.646+0000 7f4d7affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:12:49.667 INFO:tasks.workunit.client.0.smithi153.stderr: -224> 2024-09-19T14:12:48.646+0000 7f4d7affd640 10 monclient: dump: 2024-09-19T14:12:49.667 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:49.667 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:49.667 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.667 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.667 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:49.667 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.667 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:49.667 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:49.667 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:49.667 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.667 INFO:tasks.workunit.client.0.smithi153.stderr: -223> 2024-09-19T14:12:48.646+0000 7f4d7affd640 10 monclient: _finish_auth 0 2024-09-19T14:12:49.667 INFO:tasks.workunit.client.0.smithi153.stderr: -222> 2024-09-19T14:12:48.646+0000 7f4d7affd640 10 monclient: _check_auth_tickets 2024-09-19T14:12:49.667 INFO:tasks.workunit.client.0.smithi153.stderr: -221> 2024-09-19T14:12:48.646+0000 7f4d7affd640 10 monclient: handle_config config(0 keys) 2024-09-19T14:12:49.668 INFO:tasks.workunit.client.0.smithi153.stderr: -220> 2024-09-19T14:12:48.646+0000 7f4d7affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:49.668 INFO:tasks.workunit.client.0.smithi153.stderr: -219> 2024-09-19T14:12:48.646+0000 7f4d7affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:12:49.668 INFO:tasks.workunit.client.0.smithi153.stderr: -218> 2024-09-19T14:12:48.646+0000 7f4d7affd640 10 monclient: dump: 2024-09-19T14:12:49.668 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:49.668 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:49.668 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.668 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.668 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:49.668 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.668 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:49.668 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:49.668 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:49.668 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.668 INFO:tasks.workunit.client.0.smithi153.stderr: -217> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 monclient: authenticate success, global_id 7733 2024-09-19T14:12:49.668 INFO:tasks.workunit.client.0.smithi153.stderr: -216> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: get_monmap_and_config success 2024-09-19T14:12:49.669 INFO:tasks.workunit.client.0.smithi153.stderr: -215> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 4 set_mon_vals no callback set 2024-09-19T14:12:49.669 INFO:tasks.workunit.client.0.smithi153.stderr: -214> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: shutdown 2024-09-19T14:12:49.669 INFO:tasks.workunit.client.0.smithi153.stderr: -213> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: build_initial_monmap 2024-09-19T14:12:49.669 INFO:tasks.workunit.client.0.smithi153.stderr: -212> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 1 build_initial for_mkfs: 0 2024-09-19T14:12:49.669 INFO:tasks.workunit.client.0.smithi153.stderr: -211> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: monmap: 2024-09-19T14:12:49.669 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:12:49.669 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:12:49.669 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:12:49.669 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:12:49.669 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:12:49.669 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.669 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:12:49.669 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:12:49.669 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:12:49.670 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.670 INFO:tasks.workunit.client.0.smithi153.stderr: -210> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding auth protocol: cephx 2024-09-19T14:12:49.670 INFO:tasks.workunit.client.0.smithi153.stderr: -209> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding auth protocol: cephx 2024-09-19T14:12:49.670 INFO:tasks.workunit.client.0.smithi153.stderr: -208> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding auth protocol: cephx 2024-09-19T14:12:49.670 INFO:tasks.workunit.client.0.smithi153.stderr: -207> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding con mode: secure 2024-09-19T14:12:49.670 INFO:tasks.workunit.client.0.smithi153.stderr: -206> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding con mode: crc 2024-09-19T14:12:49.670 INFO:tasks.workunit.client.0.smithi153.stderr: -205> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding con mode: secure 2024-09-19T14:12:49.670 INFO:tasks.workunit.client.0.smithi153.stderr: -204> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding con mode: crc 2024-09-19T14:12:49.670 INFO:tasks.workunit.client.0.smithi153.stderr: -203> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding con mode: secure 2024-09-19T14:12:49.670 INFO:tasks.workunit.client.0.smithi153.stderr: -202> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding con mode: crc 2024-09-19T14:12:49.670 INFO:tasks.workunit.client.0.smithi153.stderr: -201> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding con mode: crc 2024-09-19T14:12:49.670 INFO:tasks.workunit.client.0.smithi153.stderr: -200> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding con mode: secure 2024-09-19T14:12:49.670 INFO:tasks.workunit.client.0.smithi153.stderr: -199> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding con mode: crc 2024-09-19T14:12:49.671 INFO:tasks.workunit.client.0.smithi153.stderr: -198> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding con mode: secure 2024-09-19T14:12:49.671 INFO:tasks.workunit.client.0.smithi153.stderr: -197> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding con mode: crc 2024-09-19T14:12:49.671 INFO:tasks.workunit.client.0.smithi153.stderr: -196> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x56183878abb0) adding con mode: secure 2024-09-19T14:12:49.671 INFO:tasks.workunit.client.0.smithi153.stderr: -195> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.671 INFO:tasks.workunit.client.0.smithi153.stderr: -194> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 1 librados: starting msgr at 2024-09-19T14:12:49.671 INFO:tasks.workunit.client.0.smithi153.stderr: -193> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 1 librados: starting objecter 2024-09-19T14:12:49.671 INFO:tasks.workunit.client.0.smithi153.stderr: -192> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command objecter_requests cmddesc objecter_requests hook 0x5618387aceb0 EEXIST 2024-09-19T14:12:49.671 INFO:tasks.workunit.client.0.smithi153.stderr: -191> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 1 librados: setting wanted keys 2024-09-19T14:12:49.671 INFO:tasks.workunit.client.0.smithi153.stderr: -190> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 1 librados: calling monclient init 2024-09-19T14:12:49.671 INFO:tasks.workunit.client.0.smithi153.stderr: -189> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: init 2024-09-19T14:12:49.671 INFO:tasks.workunit.client.0.smithi153.stderr: -188> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding auth protocol: cephx 2024-09-19T14:12:49.671 INFO:tasks.workunit.client.0.smithi153.stderr: -187> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding auth protocol: cephx 2024-09-19T14:12:49.671 INFO:tasks.workunit.client.0.smithi153.stderr: -186> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding auth protocol: cephx 2024-09-19T14:12:49.672 INFO:tasks.workunit.client.0.smithi153.stderr: -185> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding con mode: secure 2024-09-19T14:12:49.672 INFO:tasks.workunit.client.0.smithi153.stderr: -184> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding con mode: crc 2024-09-19T14:12:49.672 INFO:tasks.workunit.client.0.smithi153.stderr: -183> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding con mode: secure 2024-09-19T14:12:49.672 INFO:tasks.workunit.client.0.smithi153.stderr: -182> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding con mode: crc 2024-09-19T14:12:49.672 INFO:tasks.workunit.client.0.smithi153.stderr: -181> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding con mode: secure 2024-09-19T14:12:49.672 INFO:tasks.workunit.client.0.smithi153.stderr: -180> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding con mode: crc 2024-09-19T14:12:49.672 INFO:tasks.workunit.client.0.smithi153.stderr: -179> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding con mode: crc 2024-09-19T14:12:49.672 INFO:tasks.workunit.client.0.smithi153.stderr: -178> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding con mode: secure 2024-09-19T14:12:49.672 INFO:tasks.workunit.client.0.smithi153.stderr: -177> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding con mode: crc 2024-09-19T14:12:49.672 INFO:tasks.workunit.client.0.smithi153.stderr: -176> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding con mode: secure 2024-09-19T14:12:49.672 INFO:tasks.workunit.client.0.smithi153.stderr: -175> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding con mode: crc 2024-09-19T14:12:49.672 INFO:tasks.workunit.client.0.smithi153.stderr: -174> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 AuthRegistry(0x5618387686a0) adding con mode: secure 2024-09-19T14:12:49.672 INFO:tasks.workunit.client.0.smithi153.stderr: -173> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.672 INFO:tasks.workunit.client.0.smithi153.stderr: -172> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.673 INFO:tasks.workunit.client.0.smithi153.stderr: -171> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command rotate-key cmddesc rotate-key hook 0x5618387687e8 EEXIST 2024-09-19T14:12:49.673 INFO:tasks.workunit.client.0.smithi153.stderr: -170> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: _reopen_session rank -1 2024-09-19T14:12:49.673 INFO:tasks.workunit.client.0.smithi153.stderr: -169> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-19T14:12:49.673 INFO:tasks.workunit.client.0.smithi153.stderr: -168> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): picked mon.noname-b con 0x561838789d60 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:12:49.673 INFO:tasks.workunit.client.0.smithi153.stderr: -167> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): picked mon.noname-c con 0x5618387b5370 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:12:49.673 INFO:tasks.workunit.client.0.smithi153.stderr: -166> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): picked mon.noname-a con 0x5618387b9f80 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:12:49.673 INFO:tasks.workunit.client.0.smithi153.stderr: -165> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:49.673 INFO:tasks.workunit.client.0.smithi153.stderr: -164> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:49.673 INFO:tasks.workunit.client.0.smithi153.stderr: -163> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:12:49.673 INFO:tasks.workunit.client.0.smithi153.stderr: -162> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): _renew_subs 2024-09-19T14:12:49.673 INFO:tasks.workunit.client.0.smithi153.stderr: -161> 2024-09-19T14:12:48.646+0000 7f4e9dfdd9c0 10 monclient(hunting): authenticate will time out at 2957.111897s 2024-09-19T14:12:49.673 INFO:tasks.workunit.client.0.smithi153.stderr: -160> 2024-09-19T14:12:48.650+0000 7f4e9c2e4640 10 monclient(hunting): get_auth_request con 0x5618387b9f80 auth_method 0 2024-09-19T14:12:49.673 INFO:tasks.workunit.client.0.smithi153.stderr: -159> 2024-09-19T14:12:48.650+0000 7f4e9c2e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:49.673 INFO:tasks.workunit.client.0.smithi153.stderr: -158> 2024-09-19T14:12:48.650+0000 7f4e9c2e4640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:49.674 INFO:tasks.workunit.client.0.smithi153.stderr: -157> 2024-09-19T14:12:48.650+0000 7f4e9c2e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:49.674 INFO:tasks.workunit.client.0.smithi153.stderr: -156> 2024-09-19T14:12:48.650+0000 7f4e9b2e2640 10 monclient(hunting): get_auth_request con 0x5618387b5370 auth_method 0 2024-09-19T14:12:49.674 INFO:tasks.workunit.client.0.smithi153.stderr: -155> 2024-09-19T14:12:48.650+0000 7f4e9b2e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:12:49.674 INFO:tasks.workunit.client.0.smithi153.stderr: -154> 2024-09-19T14:12:48.650+0000 7f4e9b2e2640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:12:49.674 INFO:tasks.workunit.client.0.smithi153.stderr: -153> 2024-09-19T14:12:48.650+0000 7f4e9b2e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:12:49.674 INFO:tasks.workunit.client.0.smithi153.stderr: -152> 2024-09-19T14:12:48.650+0000 7f4e9c2e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:49.674 INFO:tasks.workunit.client.0.smithi153.stderr: -151> 2024-09-19T14:12:48.650+0000 7f4e9c2e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:49.674 INFO:tasks.workunit.client.0.smithi153.stderr: -150> 2024-09-19T14:12:48.650+0000 7f4e9c2e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:49.674 INFO:tasks.workunit.client.0.smithi153.stderr: -149> 2024-09-19T14:12:48.650+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:12:49.674 INFO:tasks.workunit.client.0.smithi153.stderr: -148> 2024-09-19T14:12:48.650+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:12:49.674 INFO:tasks.workunit.client.0.smithi153.stderr: -147> 2024-09-19T14:12:48.650+0000 7f4e9b2e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:12:49.674 INFO:tasks.workunit.client.0.smithi153.stderr: -146> 2024-09-19T14:12:48.650+0000 7f4e9c2e4640 10 monclient(hunting): handle_auth_done global_id 8259 payload 824 2024-09-19T14:12:49.674 INFO:tasks.workunit.client.0.smithi153.stderr: -145> 2024-09-19T14:12:48.650+0000 7f4e9c2e4640 10 monclient: _finish_hunting 0 2024-09-19T14:12:49.674 INFO:tasks.workunit.client.0.smithi153.stderr: -144> 2024-09-19T14:12:48.650+0000 7f4e9c2e4640 1 monclient: found mon.noname-a 2024-09-19T14:12:49.675 INFO:tasks.workunit.client.0.smithi153.stderr: -143> 2024-09-19T14:12:48.650+0000 7f4e9c2e4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:12:49.675 INFO:tasks.workunit.client.0.smithi153.stderr: -142> 2024-09-19T14:12:48.650+0000 7f4e9bae3640 10 monclient: get_auth_request con 0x561838789d60 auth_method 0 2024-09-19T14:12:49.675 INFO:tasks.workunit.client.0.smithi153.stderr: -141> 2024-09-19T14:12:48.650+0000 7f4d797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:49.675 INFO:tasks.workunit.client.0.smithi153.stderr: -140> 2024-09-19T14:12:48.650+0000 7f4d797fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:12:49.675 INFO:tasks.workunit.client.0.smithi153.stderr: -139> 2024-09-19T14:12:48.650+0000 7f4d797fa640 10 monclient: dump: 2024-09-19T14:12:49.675 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:49.675 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:49.675 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.675 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.675 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:49.675 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.675 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:49.675 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:49.676 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:49.676 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.676 INFO:tasks.workunit.client.0.smithi153.stderr: -138> 2024-09-19T14:12:48.650+0000 7f4d797fa640 10 monclient: _finish_auth 0 2024-09-19T14:12:49.676 INFO:tasks.workunit.client.0.smithi153.stderr: -137> 2024-09-19T14:12:48.650+0000 7f4d797fa640 10 monclient: _check_auth_tickets 2024-09-19T14:12:49.676 INFO:tasks.workunit.client.0.smithi153.stderr: -136> 2024-09-19T14:12:48.650+0000 7f4d797fa640 10 monclient: handle_config config(0 keys) 2024-09-19T14:12:49.676 INFO:tasks.workunit.client.0.smithi153.stderr: -135> 2024-09-19T14:12:48.650+0000 7f4d797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:12:49.676 INFO:tasks.workunit.client.0.smithi153.stderr: -134> 2024-09-19T14:12:48.650+0000 7f4d797fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:12:49.676 INFO:tasks.workunit.client.0.smithi153.stderr: -133> 2024-09-19T14:12:48.650+0000 7f4d797fa640 10 monclient: dump: 2024-09-19T14:12:49.676 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:12:49.676 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:12:49.676 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.676 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:12:49.676 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:12:49.676 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:12:49.677 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:12:49.677 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:12:49.677 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:12:49.677 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.677 INFO:tasks.workunit.client.0.smithi153.stderr: -132> 2024-09-19T14:12:48.650+0000 7f4d7affd640 4 set_mon_vals no callback set 2024-09-19T14:12:49.677 INFO:tasks.workunit.client.0.smithi153.stderr: -131> 2024-09-19T14:12:48.650+0000 7f4e9dfdd9c0 5 monclient: authenticate success, global_id 8259 2024-09-19T14:12:49.677 INFO:tasks.workunit.client.0.smithi153.stderr: -130> 2024-09-19T14:12:48.650+0000 7f4e9dfdd9c0 10 monclient: _renew_subs 2024-09-19T14:12:49.677 INFO:tasks.workunit.client.0.smithi153.stderr: -129> 2024-09-19T14:12:48.650+0000 7f4e9dfdd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:12:49.677 INFO:tasks.workunit.client.0.smithi153.stderr: -128> 2024-09-19T14:12:48.650+0000 7f4e9dfdd9c0 10 monclient: _renew_subs 2024-09-19T14:12:49.677 INFO:tasks.workunit.client.0.smithi153.stderr: -127> 2024-09-19T14:12:48.650+0000 7f4e9dfdd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:12:49.677 INFO:tasks.workunit.client.0.smithi153.stderr: -126> 2024-09-19T14:12:48.650+0000 7f4e9dfdd9c0 1 librados: init done 2024-09-19T14:12:49.677 INFO:tasks.workunit.client.0.smithi153.stderr: -125> 2024-09-19T14:12:48.650+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command cr dump hook 0x5618387a81f8 2024-09-19T14:12:49.677 INFO:tasks.workunit.client.0.smithi153.stderr: -124> 2024-09-19T14:12:48.650+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.678 INFO:tasks.workunit.client.0.smithi153.stderr: -123> 2024-09-19T14:12:48.650+0000 7f4d797fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:12:49.678 INFO:tasks.workunit.client.0.smithi153.stderr: -122> 2024-09-19T14:12:48.650+0000 7f4d797fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:12:49.678 INFO:tasks.workunit.client.0.smithi153.stderr: -121> 2024-09-19T14:12:48.650+0000 7f4d797fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:12:49.678 INFO:tasks.workunit.client.0.smithi153.stderr: -120> 2024-09-19T14:12:48.650+0000 7f4e9bae3640 10 monclient: get_auth_request con 0x7f4d64071c10 auth_method 0 2024-09-19T14:12:49.678 INFO:tasks.workunit.client.0.smithi153.stderr: -119> 2024-09-19T14:12:48.650+0000 7f4e9b2e2640 10 monclient: get_auth_request con 0x5618387d3a30 auth_method 0 2024-09-19T14:12:49.678 INFO:tasks.workunit.client.0.smithi153.stderr: -118> 2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.678 INFO:tasks.workunit.client.0.smithi153.stderr: -117> 2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 realm 2024-09-19T14:12:49.678 INFO:tasks.workunit.client.0.smithi153.stderr: -116> 2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.678 INFO:tasks.workunit.client.0.smithi153.stderr: -115> 2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.678 INFO:tasks.workunit.client.0.smithi153.stderr: -114> 2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:12:49.678 INFO:tasks.workunit.client.0.smithi153.stderr: -113> 2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.678 INFO:tasks.workunit.client.0.smithi153.stderr: -112> 2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.678 INFO:tasks.workunit.client.0.smithi153.stderr: -111> 2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.678 INFO:tasks.workunit.client.0.smithi153.stderr: -110> 2024-09-19T14:12:48.654+0000 7f4e9bae3640 10 monclient: get_auth_request con 0x5618387d7bf0 auth_method 0 2024-09-19T14:12:49.679 INFO:tasks.workunit.client.0.smithi153.stderr: -109> 2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:49.679 INFO:tasks.workunit.client.0.smithi153.stderr: -108> 2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.679 INFO:tasks.workunit.client.0.smithi153.stderr: -107> 2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:12:49.679 INFO:tasks.workunit.client.0.smithi153.stderr: -106> 2024-09-19T14:12:48.654+0000 7f4e9dfdd9c0 20 searching for the correct realm 2024-09-19T14:12:49.679 INFO:tasks.workunit.client.0.smithi153.stderr: -105> 2024-09-19T14:12:48.654+0000 7f4e9b2e2640 10 monclient: get_auth_request con 0x5618387dce60 auth_method 0 2024-09-19T14:12:49.679 INFO:tasks.workunit.client.0.smithi153.stderr: -104> 2024-09-19T14:12:48.658+0000 7f4e9c2e4640 10 monclient: get_auth_request con 0x7f4e84139190 auth_method 0 2024-09-19T14:12:49.679 INFO:tasks.workunit.client.0.smithi153.stderr: -103> 2024-09-19T14:12:48.658+0000 7f4e9bae3640 10 monclient: get_auth_request con 0x7f4e9402c060 auth_method 0 2024-09-19T14:12:49.679 INFO:tasks.workunit.client.0.smithi153.stderr: -102> 2024-09-19T14:12:48.658+0000 7f4e9b2e2640 10 monclient: get_auth_request con 0x7f4e8c008050 auth_method 0 2024-09-19T14:12:49.679 INFO:tasks.workunit.client.0.smithi153.stderr: -101> 2024-09-19T14:12:48.862+0000 7f4e9b2e2640 10 monclient: get_auth_request con 0x7f4e8c008050 auth_method 0 2024-09-19T14:12:49.679 INFO:tasks.workunit.client.0.smithi153.stderr: -100> 2024-09-19T14:12:48.862+0000 7f4e9b2e2640 0 -- 172.21.15.153:0/2583246184 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f4e8c008050 msgr2=0x7f4e8c030930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:12:49.679 INFO:tasks.workunit.client.0.smithi153.stderr: -99> 2024-09-19T14:12:49.266+0000 7f4e9b2e2640 10 monclient: get_auth_request con 0x7f4e8c008050 auth_method 0 2024-09-19T14:12:49.679 INFO:tasks.workunit.client.0.smithi153.stderr: -98> 2024-09-19T14:12:49.270+0000 7f4e9c2e4640 10 monclient: get_auth_request con 0x7f4e84114ba0 auth_method 0 2024-09-19T14:12:49.679 INFO:tasks.workunit.client.0.smithi153.stderr: -97> 2024-09-19T14:12:49.278+0000 7f4e9bae3640 10 monclient: get_auth_request con 0x7f4e840c5bb0 auth_method 0 2024-09-19T14:12:49.679 INFO:tasks.workunit.client.0.smithi153.stderr: -96> 2024-09-19T14:12:49.278+0000 7f4e9bae3640 0 -- 172.21.15.153:0/2583246184 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f4e840c5bb0 msgr2=0x7f4e840c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:12:49.680 INFO:tasks.workunit.client.0.smithi153.stderr: -95> 2024-09-19T14:12:49.482+0000 7f4e9bae3640 10 monclient: get_auth_request con 0x7f4e840c5bb0 auth_method 0 2024-09-19T14:12:49.680 INFO:tasks.workunit.client.0.smithi153.stderr: -94> 2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:12:49.680 INFO:tasks.workunit.client.0.smithi153.stderr: -93> 2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:12:49.680 INFO:tasks.workunit.client.0.smithi153.stderr: -92> 2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:12:49.680 INFO:tasks.workunit.client.0.smithi153.stderr: -91> 2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:12:49.680 INFO:tasks.workunit.client.0.smithi153.stderr: -90> 2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:12:49.680 INFO:tasks.workunit.client.0.smithi153.stderr: -89> 2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:12:49.680 INFO:tasks.workunit.client.0.smithi153.stderr: -88> 2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.680 INFO:tasks.workunit.client.0.smithi153.stderr: -87> 2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.680 INFO:tasks.workunit.client.0.smithi153.stderr: -86> 2024-09-19T14:12:49.494+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.680 INFO:tasks.workunit.client.0.smithi153.stderr: -85> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:49.680 INFO:tasks.workunit.client.0.smithi153.stderr: -84> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.680 INFO:tasks.workunit.client.0.smithi153.stderr: -83> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:12:49.681 INFO:tasks.workunit.client.0.smithi153.stderr: -82> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 zone default found 2024-09-19T14:12:49.681 INFO:tasks.workunit.client.0.smithi153.stderr: -81> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 4 Realm: () 2024-09-19T14:12:49.681 INFO:tasks.workunit.client.0.smithi153.stderr: -80> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:12:49.681 INFO:tasks.workunit.client.0.smithi153.stderr: -79> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:12:49.681 INFO:tasks.workunit.client.0.smithi153.stderr: -78> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:12:49.681 INFO:tasks.workunit.client.0.smithi153.stderr: -77> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 zonegroup default 2024-09-19T14:12:49.681 INFO:tasks.workunit.client.0.smithi153.stderr: -76> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.681 INFO:tasks.workunit.client.0.smithi153.stderr: -75> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.681 INFO:tasks.workunit.client.0.smithi153.stderr: -74> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.681 INFO:tasks.workunit.client.0.smithi153.stderr: -73> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.681 INFO:tasks.workunit.client.0.smithi153.stderr: -72> 2024-09-19T14:12:49.498+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.681 INFO:tasks.workunit.client.0.smithi153.stderr: -71> 2024-09-19T14:12:49.502+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.681 INFO:tasks.workunit.client.0.smithi153.stderr: -70> 2024-09-19T14:12:49.502+0000 7f4e9dfdd9c0 20 started sync module instance, tier type = 2024-09-19T14:12:49.681 INFO:tasks.workunit.client.0.smithi153.stderr: -69> 2024-09-19T14:12:49.502+0000 7f4e9dfdd9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:12:49.682 INFO:tasks.workunit.client.0.smithi153.stderr: -68> 2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 20 add_watcher() i=0 2024-09-19T14:12:49.682 INFO:tasks.workunit.client.0.smithi153.stderr: -67> 2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 20 add_watcher() i=1 2024-09-19T14:12:49.682 INFO:tasks.workunit.client.0.smithi153.stderr: -66> 2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 20 add_watcher() i=2 2024-09-19T14:12:49.682 INFO:tasks.workunit.client.0.smithi153.stderr: -65> 2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 20 add_watcher() i=3 2024-09-19T14:12:49.682 INFO:tasks.workunit.client.0.smithi153.stderr: -64> 2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 20 add_watcher() i=4 2024-09-19T14:12:49.682 INFO:tasks.workunit.client.0.smithi153.stderr: -63> 2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 20 add_watcher() i=5 2024-09-19T14:12:49.682 INFO:tasks.workunit.client.0.smithi153.stderr: -62> 2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 20 add_watcher() i=6 2024-09-19T14:12:49.682 INFO:tasks.workunit.client.0.smithi153.stderr: -61> 2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 20 add_watcher() i=7 2024-09-19T14:12:49.682 INFO:tasks.workunit.client.0.smithi153.stderr: -60> 2024-09-19T14:12:49.522+0000 7f4e9dfdd9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:12:49.682 INFO:tasks.workunit.client.0.smithi153.stderr: -59> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding auth protocol: cephx 2024-09-19T14:12:49.682 INFO:tasks.workunit.client.0.smithi153.stderr: -58> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding auth protocol: cephx 2024-09-19T14:12:49.682 INFO:tasks.workunit.client.0.smithi153.stderr: -57> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding auth protocol: cephx 2024-09-19T14:12:49.682 INFO:tasks.workunit.client.0.smithi153.stderr: -56> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding con mode: secure 2024-09-19T14:12:49.683 INFO:tasks.workunit.client.0.smithi153.stderr: -55> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding con mode: crc 2024-09-19T14:12:49.683 INFO:tasks.workunit.client.0.smithi153.stderr: -54> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding con mode: secure 2024-09-19T14:12:49.683 INFO:tasks.workunit.client.0.smithi153.stderr: -53> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding con mode: crc 2024-09-19T14:12:49.683 INFO:tasks.workunit.client.0.smithi153.stderr: -52> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding con mode: secure 2024-09-19T14:12:49.683 INFO:tasks.workunit.client.0.smithi153.stderr: -51> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding con mode: crc 2024-09-19T14:12:49.683 INFO:tasks.workunit.client.0.smithi153.stderr: -50> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding con mode: crc 2024-09-19T14:12:49.683 INFO:tasks.workunit.client.0.smithi153.stderr: -49> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding con mode: secure 2024-09-19T14:12:49.683 INFO:tasks.workunit.client.0.smithi153.stderr: -48> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding con mode: crc 2024-09-19T14:12:49.683 INFO:tasks.workunit.client.0.smithi153.stderr: -47> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding con mode: secure 2024-09-19T14:12:49.683 INFO:tasks.workunit.client.0.smithi153.stderr: -46> 2024-09-19T14:12:49.530+0000 7f4d51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:12:49.683 INFO:tasks.workunit.client.0.smithi153.stderr: -45> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding con mode: crc 2024-09-19T14:12:49.683 INFO:tasks.workunit.client.0.smithi153.stderr: -44> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 AuthRegistry(0x7ffd81de3260) adding con mode: secure 2024-09-19T14:12:49.683 INFO:tasks.workunit.client.0.smithi153.stderr: -43> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:12:49.683 INFO:tasks.workunit.client.0.smithi153.stderr: -42> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:12:49.684 INFO:tasks.workunit.client.0.smithi153.stderr: -41> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:12:49.684 INFO:tasks.workunit.client.0.smithi153.stderr: -40> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command cache list hook 0x5618387af770 2024-09-19T14:12:49.684 INFO:tasks.workunit.client.0.smithi153.stderr: -39> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command cache inspect hook 0x5618387af770 2024-09-19T14:12:49.684 INFO:tasks.workunit.client.0.smithi153.stderr: -38> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command cache erase hook 0x5618387af770 2024-09-19T14:12:49.684 INFO:tasks.workunit.client.0.smithi153.stderr: -37> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command cache zap hook 0x5618387af770 2024-09-19T14:12:49.684 INFO:tasks.workunit.client.0.smithi153.stderr: -36> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 note: GC not initialized 2024-09-19T14:12:49.684 INFO:tasks.workunit.client.0.smithi153.stderr: -35> 2024-09-19T14:12:49.530+0000 7f4d50fe1640 20 reqs_thread_entry: start 2024-09-19T14:12:49.684 INFO:tasks.workunit.client.0.smithi153.stderr: -34> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command sync trace show hook 0x7f4e8c00d8a0 2024-09-19T14:12:49.684 INFO:tasks.workunit.client.0.smithi153.stderr: -33> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command sync trace history hook 0x7f4e8c00d8a0 2024-09-19T14:12:49.684 INFO:tasks.workunit.client.0.smithi153.stderr: -32> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command sync trace active hook 0x7f4e8c00d8a0 2024-09-19T14:12:49.684 INFO:tasks.workunit.client.0.smithi153.stderr: -31> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 5 asok(0x5618384ddd90) register_command sync trace active_short hook 0x7f4e8c00d8a0 2024-09-19T14:12:49.684 INFO:tasks.workunit.client.0.smithi153.stderr: -30> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:12:49.684 INFO:tasks.workunit.client.0.smithi153.stderr: -29> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 20 Filter name: none 2024-09-19T14:12:49.684 INFO:tasks.workunit.client.0.smithi153.stderr: -28> 2024-09-19T14:12:49.530+0000 7f4cca7fc640 20 reqs_thread_entry: start 2024-09-19T14:12:49.685 INFO:tasks.workunit.client.0.smithi153.stderr: -27> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:12:49.685 INFO:tasks.workunit.client.0.smithi153.stderr: -26> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.685 INFO:tasks.workunit.client.0.smithi153.stderr: -25> 2024-09-19T14:12:49.530+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:12:49.685 INFO:tasks.workunit.client.0.smithi153.stderr: -24> 2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:12:49.685 INFO:tasks.workunit.client.0.smithi153.stderr: -23> 2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:12:49.685 INFO:tasks.workunit.client.0.smithi153.stderr: -22> 2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : miss 2024-09-19T14:12:49.685 INFO:tasks.workunit.client.0.smithi153.stderr: -21> 2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.685 INFO:tasks.workunit.client.0.smithi153.stderr: -20> 2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-19T14:12:49.685 INFO:tasks.workunit.client.0.smithi153.stderr: -19> 2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:12:49.685 INFO:tasks.workunit.client.0.smithi153.stderr: -18> 2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:12:49.685 INFO:tasks.workunit.client.0.smithi153.stderr: -17> 2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:12:49.685 INFO:tasks.workunit.client.0.smithi153.stderr: -16> 2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:12:49.685 INFO:tasks.workunit.client.0.smithi153.stderr: -15> 2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:12:49.685 INFO:tasks.workunit.client.0.smithi153.stderr: -14> 2024-09-19T14:12:49.534+0000 7f4e9dfdd9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T14:12:49.686 INFO:tasks.workunit.client.0.smithi153.stderr: -13> 2024-09-19T14:12:49.550+0000 7f4e9dfdd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:12:49.686 INFO:tasks.workunit.client.0.smithi153.stderr: -12> 2024-09-19T14:12:49.550+0000 7f4e9dfdd9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:12:49.686 INFO:tasks.workunit.client.0.smithi153.stderr: -11> 2024-09-19T14:12:49.550+0000 7f4e9dfdd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:12:49.686 INFO:tasks.workunit.client.0.smithi153.stderr: -10> 2024-09-19T14:12:49.550+0000 7f4e9dfdd9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17, ofs0, ns] 2024-09-19T14:12:49.686 INFO:tasks.workunit.client.0.smithi153.stderr: -9> 2024-09-19T14:12:49.550+0000 7f4d7a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333528 cookie 94662027007440 notifier 8259 bl.length()=827 2024-09-19T14:12:49.686 INFO:tasks.workunit.client.0.smithi153.stderr: -8> 2024-09-19T14:12:49.550+0000 7f4d7a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:12:49.686 INFO:tasks.workunit.client.0.smithi153.stderr: -7> 2024-09-19T14:12:49.550+0000 7f4d7a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:12:49.686 INFO:tasks.workunit.client.0.smithi153.stderr: -6> 2024-09-19T14:12:49.550+0000 7f4d7a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:12:49.686 INFO:tasks.workunit.client.0.smithi153.stderr: -5> 2024-09-19T14:12:49.554+0000 7f4e9dfdd9c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_sources= new_sources= 2024-09-19T14:12:49.686 INFO:tasks.workunit.client.0.smithi153.stderr: -4> 2024-09-19T14:12:49.554+0000 7f4e9dfdd9c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential sources added=[] removed=[] 2024-09-19T14:12:49.686 INFO:tasks.workunit.client.0.smithi153.stderr: -3> 2024-09-19T14:12:49.554+0000 7f4e9dfdd9c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_dests= new_dests= 2024-09-19T14:12:49.686 INFO:tasks.workunit.client.0.smithi153.stderr: -2> 2024-09-19T14:12:49.554+0000 7f4e9dfdd9c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential dests added=[] removed=[] 2024-09-19T14:12:49.686 INFO:tasks.workunit.client.0.smithi153.stderr: -1> 2024-09-19T14:12:49.562+0000 7f4e9dfdd9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4e9dfdd9c0 time 2024-09-19T14:12:49.564285+0000 2024-09-19T14:12:49.686 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:12:49.687 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.687 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:12:49.687 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4ea18b72eb] 2024-09-19T14:12:49.687 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4ea18b749f] 2024-09-19T14:12:49.687 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561835b51271] 2024-09-19T14:12:49.687 INFO:tasks.workunit.client.0.smithi153.stderr: 4: radosgw-admin(+0x141057c) [0x5618365a257c] 2024-09-19T14:12:49.687 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561835b610dd] 2024-09-19T14:12:49.687 INFO:tasks.workunit.client.0.smithi153.stderr: 6: main() 2024-09-19T14:12:49.687 INFO:tasks.workunit.client.0.smithi153.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4ea071dd90] 2024-09-19T14:12:49.687 INFO:tasks.workunit.client.0.smithi153.stderr: 8: __libc_start_main() 2024-09-19T14:12:49.687 INFO:tasks.workunit.client.0.smithi153.stderr: 9: _start() 2024-09-19T14:12:49.687 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.688 INFO:tasks.workunit.client.0.smithi153.stderr: 0> 2024-09-19T14:12:49.562+0000 7f4e9dfdd9c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:12:49.688 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7f4e9dfdd9c0 thread_name:radosgw-admin 2024-09-19T14:12:49.688 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.688 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:12:49.688 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4ea0736520] 2024-09-19T14:12:49.688 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:12:49.688 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:12:49.688 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:12:49.688 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4ea18b7345] 2024-09-19T14:12:49.688 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4ea18b749f] 2024-09-19T14:12:49.688 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561835b51271] 2024-09-19T14:12:49.688 INFO:tasks.workunit.client.0.smithi153.stderr: 8: radosgw-admin(+0x141057c) [0x5618365a257c] 2024-09-19T14:12:49.688 INFO:tasks.workunit.client.0.smithi153.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561835b610dd] 2024-09-19T14:12:49.688 INFO:tasks.workunit.client.0.smithi153.stderr: 10: main() 2024-09-19T14:12:49.689 INFO:tasks.workunit.client.0.smithi153.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4ea071dd90] 2024-09-19T14:12:49.689 INFO:tasks.workunit.client.0.smithi153.stderr: 12: __libc_start_main() 2024-09-19T14:12:49.689 INFO:tasks.workunit.client.0.smithi153.stderr: 13: _start() 2024-09-19T14:12:49.689 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:12:49.689 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:12:49.689 INFO:tasks.workunit.client.0.smithi153.stderr:--- logging levels --- 2024-09-19T14:12:49.689 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 none 2024-09-19T14:12:49.689 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 lockdep 2024-09-19T14:12:49.689 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 context 2024-09-19T14:12:49.689 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 crush 2024-09-19T14:12:49.689 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds 2024-09-19T14:12:49.689 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_balancer 2024-09-19T14:12:49.689 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_locker 2024-09-19T14:12:49.689 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log 2024-09-19T14:12:49.690 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log_expire 2024-09-19T14:12:49.690 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_migrator 2024-09-19T14:12:49.690 INFO:tasks.workunit.client.0.smithi153.stderr: 3/ 5 mds_quiesce 2024-09-19T14:12:49.690 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 buffer 2024-09-19T14:12:49.690 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 timer 2024-09-19T14:12:49.690 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 filer 2024-09-19T14:12:49.690 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 striper 2024-09-19T14:12:49.690 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 objecter 2024-09-19T14:12:49.690 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rados 2024-09-19T14:12:49.690 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd 2024-09-19T14:12:49.690 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_mirror 2024-09-19T14:12:49.690 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_replay 2024-09-19T14:12:49.690 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_pwl 2024-09-19T14:12:49.691 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 journaler 2024-09-19T14:12:49.691 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objectcacher 2024-09-19T14:12:49.691 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:12:49.691 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 client 2024-09-19T14:12:49.691 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 osd 2024-09-19T14:12:49.691 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 optracker 2024-09-19T14:12:49.691 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objclass 2024-09-19T14:12:49.691 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 filestore 2024-09-19T14:12:49.691 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 journal 2024-09-19T14:12:49.691 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 ms 2024-09-19T14:12:49.691 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mon 2024-09-19T14:12:49.691 INFO:tasks.workunit.client.0.smithi153.stderr: 0/10 monc 2024-09-19T14:12:49.691 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 paxos 2024-09-19T14:12:49.692 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 tp 2024-09-19T14:12:49.692 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 auth 2024-09-19T14:12:49.692 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 crypto 2024-09-19T14:12:49.692 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 finisher 2024-09-19T14:12:49.692 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 reserver 2024-09-19T14:12:49.692 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 heartbeatmap 2024-09-19T14:12:49.692 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 perfcounter 2024-09-19T14:12:49.692 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw 2024-09-19T14:12:49.692 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_sync 2024-09-19T14:12:49.692 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_datacache 2024-09-19T14:12:49.692 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_access 2024-09-19T14:12:49.692 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:12:49.692 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_flight 2024-09-19T14:12:49.692 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:12:49.693 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw_notification 2024-09-19T14:12:49.693 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 javaclient 2024-09-19T14:12:49.693 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 asok 2024-09-19T14:12:49.693 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 throttle 2024-09-19T14:12:49.693 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 refs 2024-09-19T14:12:49.693 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 compressor 2024-09-19T14:12:49.693 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluestore 2024-09-19T14:12:49.693 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluefs 2024-09-19T14:12:49.693 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 bdev 2024-09-19T14:12:49.693 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 kstore 2024-09-19T14:12:49.693 INFO:tasks.workunit.client.0.smithi153.stderr: 4/ 5 rocksdb 2024-09-19T14:12:49.694 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 fuse 2024-09-19T14:12:49.694 INFO:tasks.workunit.client.0.smithi153.stderr: 2/ 5 mgr 2024-09-19T14:12:49.694 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mgrc 2024-09-19T14:12:49.694 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 dpdk 2024-09-19T14:12:49.694 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 eventtrace 2024-09-19T14:12:49.694 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 prioritycache 2024-09-19T14:12:49.694 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 test 2024-09-19T14:12:49.694 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:12:49.694 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephsqlite 2024-09-19T14:12:49.694 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:12:49.694 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore 2024-09-19T14:12:49.694 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_onode 2024-09-19T14:12:49.694 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_odata 2024-09-19T14:12:49.694 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_omap 2024-09-19T14:12:49.695 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_tm 2024-09-19T14:12:49.695 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_t 2024-09-19T14:12:49.695 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:12:49.695 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_epm 2024-09-19T14:12:49.695 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_lba 2024-09-19T14:12:49.695 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:12:49.695 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cache 2024-09-19T14:12:49.695 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_journal 2024-09-19T14:12:49.695 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_device 2024-09-19T14:12:49.695 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_backref 2024-09-19T14:12:49.695 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 alienstore 2024-09-19T14:12:49.695 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mclock 2024-09-19T14:12:49.695 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cyanstore 2024-09-19T14:12:49.696 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 ceph_exporter 2024-09-19T14:12:49.696 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 memstore 2024-09-19T14:12:49.696 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 trace 2024-09-19T14:12:49.696 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 ceph_dedup 2024-09-19T14:12:49.696 INFO:tasks.workunit.client.0.smithi153.stderr: -2/-2 (syslog threshold) 2024-09-19T14:12:49.696 INFO:tasks.workunit.client.0.smithi153.stderr: 99/99 (stderr threshold) 2024-09-19T14:12:49.696 INFO:tasks.workunit.client.0.smithi153.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:12:49.696 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4cca7fc640 / http_manager 2024-09-19T14:12:49.696 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4d50fe1640 / http_manager 2024-09-19T14:12:49.696 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4d51fe3640 / rgw_dt_lg_renew 2024-09-19T14:12:49.696 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4d797fa640 / ms_dispatch 2024-09-19T14:12:49.696 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4d7a7fc640 / io_context_pool 2024-09-19T14:12:49.696 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4d7affd640 / io_context_pool 2024-09-19T14:12:49.696 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4d817fa640 / ms_dispatch 2024-09-19T14:12:49.696 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4d83fff640 / ms_dispatch 2024-09-19T14:12:49.697 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4d89e0b640 / io_context_pool 2024-09-19T14:12:49.697 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4e9b2e2640 / msgr-worker-2 2024-09-19T14:12:49.697 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4e9bae3640 / msgr-worker-1 2024-09-19T14:12:49.697 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4e9c2e4640 / msgr-worker-0 2024-09-19T14:12:49.697 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4e9cae5640 / io_context_pool 2024-09-19T14:12:49.697 INFO:tasks.workunit.client.0.smithi153.stderr: 7f4e9dfdd9c0 / radosgw-admin 2024-09-19T14:12:49.697 INFO:tasks.workunit.client.0.smithi153.stderr: max_recent 500 2024-09-19T14:12:49.697 INFO:tasks.workunit.client.0.smithi153.stderr: max_new 1000 2024-09-19T14:12:49.697 INFO:tasks.workunit.client.0.smithi153.stderr: log_file /var/lib/ceph/crash/2024-09-19T14:12:49.566830Z_ad98041d-0eda-48e2-a21d-9667214dffa4/log 2024-09-19T14:12:49.697 INFO:tasks.workunit.client.0.smithi153.stderr:--- end dump of recent events --- 2024-09-19T14:12:49.697 INFO:tasks.workunit.client.0.smithi153.stderr:Aborted 2024-09-19T14:12:49.697 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-19T14:12:49.699 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:12:49.699 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:12:49.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.646+0000 7f12bc4d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.650+0000 7f12bc4d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.650+0000 7f12bc4d49c0 20 realm 2024-09-19T14:12:49.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.650+0000 7f12bc4d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.650+0000 7f12bc4d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.699 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.650+0000 7f12bc4d49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:12:49.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.650+0000 7f12bc4d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.650+0000 7f12bc4d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.650+0000 7f12bc4d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.654+0000 7f12bc4d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:49.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.654+0000 7f12bc4d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.654+0000 7f12bc4d49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:12:49.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.654+0000 7f12bc4d49c0 20 searching for the correct realm 2024-09-19T14:12:49.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.658+0000 7f12ba7db640 0 -- 172.21.15.153:0/4182467454 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f12a403b410 msgr2=0x7f12a403b850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:12:49.700 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.662+0000 7f12b9fda640 0 -- 172.21.15.153:0/4182467454 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f12a4051460 msgr2=0x7f12a40518e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:12:49.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.882+0000 7f12bc4d49c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:12:49.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.882+0000 7f12bc4d49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:12:49.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.882+0000 7f12bc4d49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:12:49.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.882+0000 7f12bc4d49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:12:49.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.882+0000 7f12bc4d49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:12:49.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.882+0000 7f12bc4d49c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:12:49.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.882+0000 7f12bc4d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.882+0000 7f12bc4d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.882+0000 7f12bc4d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.882+0000 7f12bc4d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:12:49.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.882+0000 7f12bc4d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.885 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.882+0000 7f12bc4d49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:12:49.885 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.882+0000 7f12bc4d49c0 20 zone default found 2024-09-19T14:12:49.885 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.882+0000 7f12bc4d49c0 4 Realm: () 2024-09-19T14:12:49.885 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.882+0000 7f12bc4d49c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:12:49.885 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.882+0000 7f12bc4d49c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:12:49.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.882+0000 7f12bc4d49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:12:49.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.882+0000 7f12bc4d49c0 20 zonegroup default 2024-09-19T14:12:49.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.882+0000 7f12bc4d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.882+0000 7f12bc4d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.882+0000 7f12bc4d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.887 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.886+0000 7f12bc4d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.887 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.886+0000 7f12bc4d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.886+0000 7f12bc4d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:12:49.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.886+0000 7f12bc4d49c0 20 started sync module instance, tier type = 2024-09-19T14:12:49.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.886+0000 7f12bc4d49c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:12:49.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.910+0000 7f12bc4d49c0 20 add_watcher() i=0 2024-09-19T14:12:49.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.910+0000 7f12bc4d49c0 20 add_watcher() i=1 2024-09-19T14:12:49.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.910+0000 7f12bc4d49c0 20 add_watcher() i=2 2024-09-19T14:12:49.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.910+0000 7f12bc4d49c0 20 add_watcher() i=3 2024-09-19T14:12:49.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.910+0000 7f12bc4d49c0 20 add_watcher() i=4 2024-09-19T14:12:49.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.910+0000 7f12bc4d49c0 20 add_watcher() i=5 2024-09-19T14:12:49.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.910+0000 7f12bc4d49c0 20 add_watcher() i=6 2024-09-19T14:12:49.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.910+0000 7f12bc4d49c0 20 add_watcher() i=7 2024-09-19T14:12:49.914 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.910+0000 7f12bc4d49c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:12:49.919 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.918+0000 7f116b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:12:49.920 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.918+0000 7f12bc4d49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:12:49.920 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.918+0000 7f12bc4d49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:12:49.920 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.918+0000 7f12bc4d49c0 5 note: GC not initialized 2024-09-19T14:12:49.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.918+0000 7f116a7fc640 20 reqs_thread_entry: start 2024-09-19T14:12:49.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.918+0000 7f12bc4d49c0 20 init_complete bucket index max shards: 11 2024-09-19T14:12:49.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.918+0000 7f12bc4d49c0 20 Filter name: none 2024-09-19T14:12:49.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.918+0000 7f10dbfff640 20 reqs_thread_entry: start 2024-09-19T14:12:49.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.918+0000 7f12bc4d49c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:12:49.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.918+0000 7f12bc4d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.922+0000 7f12bc4d49c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:12:49.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.922+0000 7f12bc4d49c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:12:49.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.922+0000 7f12bc4d49c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:12:49.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.922+0000 7f12bc4d49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : miss 2024-09-19T14:12:49.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.922+0000 7f12bc4d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:12:49.923 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.922+0000 7f12bc4d49c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-19T14:12:49.923 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.922+0000 7f12bc4d49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:12:49.923 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.922+0000 7f12bc4d49c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:12:49.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.922+0000 7f12bc4d49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:12:49.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.922+0000 7f12bc4d49c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:12:49.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.922+0000 7f12bc4d49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:12:49.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.922+0000 7f12bc4d49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:12:49.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.922+0000 7f12bc4d49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:12:49.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.922+0000 7f12bc4d49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:12:49.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.922+0000 7f12bc4d49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:12:49.925 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.922+0000 7f12bc4d49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:12:49.925 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.922+0000 7f12bc4d49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:12:49.926 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.922+0000 7f12bc4d49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:12:49.926 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.922+0000 7f12bc4d49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:12:49.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.926+0000 7f12bc4d49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:12:49.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.926+0000 7f12bc4d49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:12:49.928 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.926+0000 7f12bc4d49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:12:49.928 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.926+0000 7f12bc4d49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:12:49.928 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.926+0000 7f12bc4d49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:12:49.928 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.926+0000 7f12bc4d49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:12:49.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.926+0000 7f12bc4d49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:12:49.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.926+0000 7f12bc4d49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:12:49.930 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.926+0000 7f12bc4d49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:12:49.930 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.926+0000 7f12bc4d49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:12:49.930 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.930+0000 7f12bc4d49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:12:49.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.930+0000 7f12bc4d49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:12:49.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.930+0000 7f12bc4d49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:12:49.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.930+0000 7f12bc4d49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:12:49.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.930+0000 7f12bc4d49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:12:49.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.930+0000 7f12bc4d49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:12:49.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.930+0000 7f12bc4d49c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:12:49.933 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.930+0000 7f12bc4d49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:12:49.935 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.934+0000 7f116b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:12:49.940 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.938+0000 7f12bc4d49c0 20 remove_watcher() i=0 2024-09-19T14:12:49.940 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.938+0000 7f12bc4d49c0 2 removed watcher, disabling cache 2024-09-19T14:12:49.942 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.942+0000 7f12bc4d49c0 20 remove_watcher() i=1 2024-09-19T14:12:49.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.942+0000 7f12bc4d49c0 20 remove_watcher() i=2 2024-09-19T14:12:49.947 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.946+0000 7f12bc4d49c0 20 remove_watcher() i=3 2024-09-19T14:12:49.950 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.946+0000 7f12bc4d49c0 20 remove_watcher() i=4 2024-09-19T14:12:49.952 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.950+0000 7f12bc4d49c0 20 remove_watcher() i=5 2024-09-19T14:12:49.953 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.950+0000 7f12bc4d49c0 20 remove_watcher() i=6 2024-09-19T14:12:49.955 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:12:49.954+0000 7f12bc4d49c0 20 remove_watcher() i=7 2024-09-19T14:12:49.970 INFO:tasks.workunit.client.0.smithi153.stderr: test: duplicated entries can be purged manually 2024-09-19T14:13:20.000 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T14:13:20.033 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:13:20.034 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:13:20.078 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.073+0000 7f5699b089c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.077+0000 7f5699b089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.077+0000 7f5699b089c0 20 realm 2024-09-19T14:13:20.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.077+0000 7f5699b089c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.077+0000 7f5699b089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.077+0000 7f5699b089c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:13:20.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.077+0000 7f5699b089c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.077+0000 7f5699b089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.077+0000 7f5699b089c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.077+0000 7f5699b089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:20.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.077+0000 7f5699b089c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.081+0000 7f5699b089c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:13:20.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.081+0000 7f5699b089c0 20 searching for the correct realm 2024-09-19T14:13:20.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.085+0000 7f5696e0d640 0 -- 172.21.15.153:0/2795705463 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x564fc8dc0c80 msgr2=0x564fc8dc3070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:20.094 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.089+0000 7f569760e640 0 -- 172.21.15.153:0/2795705463 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f568c0e9550 msgr2=0x7f568c11da50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:20.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:13:20.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:13:20.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:13:20.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:13:20.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:13:20.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:13:20.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:20.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:13:20.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 20 zone default found 2024-09-19T14:13:20.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 4 Realm: () 2024-09-19T14:13:20.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:13:20.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:13:20.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:13:20.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 20 zonegroup default 2024-09-19T14:13:20.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 20 started sync module instance, tier type = 2024-09-19T14:13:20.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.101+0000 7f5699b089c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:13:20.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.117+0000 7f5699b089c0 20 add_watcher() i=0 2024-09-19T14:13:20.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.117+0000 7f5699b089c0 20 add_watcher() i=1 2024-09-19T14:13:20.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.117+0000 7f5699b089c0 20 add_watcher() i=2 2024-09-19T14:13:20.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.117+0000 7f5699b089c0 20 add_watcher() i=3 2024-09-19T14:13:20.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.117+0000 7f5699b089c0 20 add_watcher() i=4 2024-09-19T14:13:20.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.117+0000 7f5699b089c0 20 add_watcher() i=5 2024-09-19T14:13:20.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.117+0000 7f5699b089c0 20 add_watcher() i=6 2024-09-19T14:13:20.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.117+0000 7f5699b089c0 20 add_watcher() i=7 2024-09-19T14:13:20.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.117+0000 7f5699b089c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:13:20.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.121+0000 7f554dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:20.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.121+0000 7f5699b089c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:13:20.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.121+0000 7f5699b089c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:13:20.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.121+0000 7f5699b089c0 5 note: GC not initialized 2024-09-19T14:13:20.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.121+0000 7f554cfe1640 20 reqs_thread_entry: start 2024-09-19T14:13:20.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.121+0000 7f5699b089c0 20 init_complete bucket index max shards: 11 2024-09-19T14:13:20.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.121+0000 7f5699b089c0 20 Filter name: none 2024-09-19T14:13:20.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.121+0000 7f54c67fc640 20 reqs_thread_entry: start 2024-09-19T14:13:20.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.121+0000 7f5699b089c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.121+0000 7f5699b089c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:13:20.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.121+0000 7f5699b089c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.125+0000 7f5699b089c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-19T14:13:20.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.125+0000 7f5699b089c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:13:20.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.125+0000 7f5699b089c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.125+0000 7f5699b089c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:13:20.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.125+0000 7f5699b089c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.125+0000 7f5699b089c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-19T14:13:20.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.125+0000 7f5699b089c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:13:20.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.129+0000 7f554dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:20.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.133+0000 7f5699b089c0 20 remove_watcher() i=0 2024-09-19T14:13:20.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.133+0000 7f5699b089c0 2 removed watcher, disabling cache 2024-09-19T14:13:20.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.133+0000 7f5699b089c0 20 remove_watcher() i=1 2024-09-19T14:13:20.140 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.137+0000 7f5699b089c0 20 remove_watcher() i=2 2024-09-19T14:13:20.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.137+0000 7f5699b089c0 20 remove_watcher() i=3 2024-09-19T14:13:20.144 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.141+0000 7f5699b089c0 20 remove_watcher() i=4 2024-09-19T14:13:20.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.141+0000 7f5699b089c0 20 remove_watcher() i=5 2024-09-19T14:13:20.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.145+0000 7f5699b089c0 20 remove_watcher() i=6 2024-09-19T14:13:20.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.145+0000 7f5699b089c0 20 remove_watcher() i=7 2024-09-19T14:13:20.161 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.161 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:13:20.161 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: a-bucket id: dbb1da81-49d0-421a-b677-974869a7f103.4620.17 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-19T14:13:20.161 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.162 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-19T14:13:20.194 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:13:20.194 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:13:20.241 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.241 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.241 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.237+0000 7fe8205829c0 20 realm 2024-09-19T14:13:20.242 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.242 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.242 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.237+0000 7fe8205829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:13:20.242 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.242 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.242 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.243 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:20.243 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.243 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.241+0000 7fe8205829c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:13:20.243 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.241+0000 7fe8205829c0 20 searching for the correct realm 2024-09-19T14:13:20.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.245+0000 7fe81e889640 0 -- 172.21.15.153:0/3493415984 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55f1f68c4a30 msgr2=0x55f1f68c6e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:13:20.254 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.253+0000 7fe81e088640 0 -- 172.21.15.153:0/3493415984 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fe8140fe480 msgr2=0x7fe8140f8260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:20.262 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.257+0000 7fe8205829c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:13:20.262 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.257+0000 7fe8205829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:13:20.263 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.257+0000 7fe8205829c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:13:20.263 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.257+0000 7fe8205829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:13:20.263 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.257+0000 7fe8205829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:13:20.263 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.257+0000 7fe8205829c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:13:20.263 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.257+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.263 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.263 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:20.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:13:20.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.261+0000 7fe8205829c0 20 zone default found 2024-09-19T14:13:20.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.261+0000 7fe8205829c0 4 Realm: () 2024-09-19T14:13:20.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.261+0000 7fe8205829c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:13:20.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.261+0000 7fe8205829c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:13:20.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.261+0000 7fe8205829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:13:20.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.261+0000 7fe8205829c0 20 zonegroup default 2024-09-19T14:13:20.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.261+0000 7fe8205829c0 20 started sync module instance, tier type = 2024-09-19T14:13:20.266 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.261+0000 7fe8205829c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:13:20.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.277+0000 7fe8205829c0 20 add_watcher() i=0 2024-09-19T14:13:20.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.277+0000 7fe8205829c0 20 add_watcher() i=1 2024-09-19T14:13:20.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.277+0000 7fe8205829c0 20 add_watcher() i=2 2024-09-19T14:13:20.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.277+0000 7fe8205829c0 20 add_watcher() i=3 2024-09-19T14:13:20.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.277+0000 7fe8205829c0 20 add_watcher() i=4 2024-09-19T14:13:20.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.277+0000 7fe8205829c0 20 add_watcher() i=5 2024-09-19T14:13:20.280 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.277+0000 7fe8205829c0 20 add_watcher() i=6 2024-09-19T14:13:20.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.277+0000 7fe8205829c0 20 add_watcher() i=7 2024-09-19T14:13:20.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.277+0000 7fe8205829c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:13:20.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.281+0000 7fe6d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:20.284 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.281+0000 7fe8205829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:13:20.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.281+0000 7fe8205829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:13:20.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.281+0000 7fe8205829c0 5 note: GC not initialized 2024-09-19T14:13:20.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.281+0000 7fe64f7fe640 20 reqs_thread_entry: start 2024-09-19T14:13:20.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.281+0000 7fe8205829c0 20 init_complete bucket index max shards: 11 2024-09-19T14:13:20.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.281+0000 7fe8205829c0 20 Filter name: none 2024-09-19T14:13:20.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.281+0000 7fe64d7fa640 20 reqs_thread_entry: start 2024-09-19T14:13:20.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.281+0000 7fe8205829c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:13:20.285 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.281+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.286 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.281+0000 7fe8205829c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:13:20.286 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.281+0000 7fe8205829c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:13:20.286 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.281+0000 7fe8205829c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:13:20.286 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.281+0000 7fe8205829c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : miss 2024-09-19T14:13:20.286 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.281+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.287 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.281+0000 7fe8205829c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-19T14:13:20.287 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.281+0000 7fe8205829c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:13:20.287 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.281+0000 7fe8205829c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:13:20.287 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.281+0000 7fe8205829c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:13:20.287 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.281+0000 7fe8205829c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:20.287 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.285+0000 7fe8205829c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:13:20.289 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.285+0000 7fe8205829c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T14:13:20.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.297+0000 7fe8205829c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:13:20.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.297+0000 7fe8205829c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:13:20.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.297+0000 7fe8205829c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:20.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.297+0000 7fe8205829c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17, ofs0, ns] 2024-09-19T14:13:20.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.301+0000 7fe701ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333529 cookie 94497711931696 notifier 7787 bl.length()=827 2024-09-19T14:13:20.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.301+0000 7fe701ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:13:20.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.301+0000 7fe701ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:13:20.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.301+0000 7fe701ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:20.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.301+0000 7fe8205829c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_sources= new_sources= 2024-09-19T14:13:20.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.301+0000 7fe8205829c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential sources added=[] removed=[] 2024-09-19T14:13:20.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.301+0000 7fe8205829c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_dests= new_dests= 2024-09-19T14:13:20.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.301+0000 7fe8205829c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential dests added=[] removed=[] 2024-09-19T14:13:20.320 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe8205829c0 time 2024-09-19T14:13:20.321472+0000 2024-09-19T14:13:20.320 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:13:20.321 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:13:20.321 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe823e5c2eb] 2024-09-19T14:13:20.321 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe823e5c49f] 2024-09-19T14:13:20.321 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f1f36be271] 2024-09-19T14:13:20.321 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f1f36ce14a] 2024-09-19T14:13:20.321 INFO:tasks.workunit.client.0.smithi153.stderr: 5: main() 2024-09-19T14:13:20.321 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe822cc2d90] 2024-09-19T14:13:20.321 INFO:tasks.workunit.client.0.smithi153.stderr: 7: __libc_start_main() 2024-09-19T14:13:20.321 INFO:tasks.workunit.client.0.smithi153.stderr: 8: _start() 2024-09-19T14:13:20.321 INFO:tasks.workunit.client.0.smithi153.stderr:*** Caught signal (Aborted) ** 2024-09-19T14:13:20.322 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7fe8205829c0 thread_name:radosgw-admin 2024-09-19T14:13:20.322 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.317+0000 7fe8205829c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe8205829c0 time 2024-09-19T14:13:20.321472+0000 2024-09-19T14:13:20.322 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:13:20.322 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.322 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:13:20.322 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe823e5c2eb] 2024-09-19T14:13:20.322 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe823e5c49f] 2024-09-19T14:13:20.322 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f1f36be271] 2024-09-19T14:13:20.322 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f1f36ce14a] 2024-09-19T14:13:20.322 INFO:tasks.workunit.client.0.smithi153.stderr: 5: main() 2024-09-19T14:13:20.322 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe822cc2d90] 2024-09-19T14:13:20.322 INFO:tasks.workunit.client.0.smithi153.stderr: 7: __libc_start_main() 2024-09-19T14:13:20.323 INFO:tasks.workunit.client.0.smithi153.stderr: 8: _start() 2024-09-19T14:13:20.323 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.346 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:13:20.346 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe822cdb520] 2024-09-19T14:13:20.346 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:13:20.346 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:13:20.346 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:13:20.346 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe823e5c345] 2024-09-19T14:13:20.346 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe823e5c49f] 2024-09-19T14:13:20.346 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f1f36be271] 2024-09-19T14:13:20.347 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f1f36ce14a] 2024-09-19T14:13:20.347 INFO:tasks.workunit.client.0.smithi153.stderr: 9: main() 2024-09-19T14:13:20.347 INFO:tasks.workunit.client.0.smithi153.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe822cc2d90] 2024-09-19T14:13:20.347 INFO:tasks.workunit.client.0.smithi153.stderr: 11: __libc_start_main() 2024-09-19T14:13:20.347 INFO:tasks.workunit.client.0.smithi153.stderr: 12: _start() 2024-09-19T14:13:20.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.317+0000 7fe8205829c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:13:20.347 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7fe8205829c0 thread_name:radosgw-admin 2024-09-19T14:13:20.347 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.347 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:13:20.347 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe822cdb520] 2024-09-19T14:13:20.347 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:13:20.347 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:13:20.347 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:13:20.347 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe823e5c345] 2024-09-19T14:13:20.348 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe823e5c49f] 2024-09-19T14:13:20.348 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f1f36be271] 2024-09-19T14:13:20.348 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f1f36ce14a] 2024-09-19T14:13:20.348 INFO:tasks.workunit.client.0.smithi153.stderr: 9: main() 2024-09-19T14:13:20.348 INFO:tasks.workunit.client.0.smithi153.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe822cc2d90] 2024-09-19T14:13:20.348 INFO:tasks.workunit.client.0.smithi153.stderr: 11: __libc_start_main() 2024-09-19T14:13:20.348 INFO:tasks.workunit.client.0.smithi153.stderr: 12: _start() 2024-09-19T14:13:20.348 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:13:20.348 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.348 INFO:tasks.workunit.client.0.smithi153.stderr:--- begin dump of recent events --- 2024-09-19T14:13:20.348 INFO:tasks.workunit.client.0.smithi153.stderr: -499> 2024-09-19T14:13:20.213+0000 7fe81e889640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:13:20.348 INFO:tasks.workunit.client.0.smithi153.stderr: -498> 2024-09-19T14:13:20.213+0000 7fe81e889640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:13:20.349 INFO:tasks.workunit.client.0.smithi153.stderr: -497> 2024-09-19T14:13:20.213+0000 7fe81e889640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:13:20.349 INFO:tasks.workunit.client.0.smithi153.stderr: -496> 2024-09-19T14:13:20.213+0000 7fe81d887640 10 monclient(hunting): handle_auth_done global_id 7775 payload 274 2024-09-19T14:13:20.349 INFO:tasks.workunit.client.0.smithi153.stderr: -495> 2024-09-19T14:13:20.213+0000 7fe81d887640 10 monclient: _finish_hunting 0 2024-09-19T14:13:20.349 INFO:tasks.workunit.client.0.smithi153.stderr: -494> 2024-09-19T14:13:20.213+0000 7fe81d887640 1 monclient: found mon.noname-c 2024-09-19T14:13:20.349 INFO:tasks.workunit.client.0.smithi153.stderr: -493> 2024-09-19T14:13:20.213+0000 7fe81d887640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:13:20.349 INFO:tasks.workunit.client.0.smithi153.stderr: -492> 2024-09-19T14:13:20.213+0000 7fe70c608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:13:20.349 INFO:tasks.workunit.client.0.smithi153.stderr: -491> 2024-09-19T14:13:20.213+0000 7fe70c608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:13:20.349 INFO:tasks.workunit.client.0.smithi153.stderr: -490> 2024-09-19T14:13:20.213+0000 7fe70c608640 10 monclient: dump: 2024-09-19T14:13:20.349 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:13:20.349 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:13:20.349 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.349 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.350 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:13:20.350 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.350 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:13:20.350 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:13:20.350 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:13:20.350 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.350 INFO:tasks.workunit.client.0.smithi153.stderr: -489> 2024-09-19T14:13:20.213+0000 7fe70c608640 10 monclient: _finish_auth 0 2024-09-19T14:13:20.350 INFO:tasks.workunit.client.0.smithi153.stderr: -488> 2024-09-19T14:13:20.213+0000 7fe70c608640 10 monclient: _check_auth_tickets 2024-09-19T14:13:20.350 INFO:tasks.workunit.client.0.smithi153.stderr: -487> 2024-09-19T14:13:20.213+0000 7fe70c608640 10 monclient: handle_config config(0 keys) 2024-09-19T14:13:20.350 INFO:tasks.workunit.client.0.smithi153.stderr: -486> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 monclient: authenticate success, global_id 7775 2024-09-19T14:13:20.350 INFO:tasks.workunit.client.0.smithi153.stderr: -485> 2024-09-19T14:13:20.213+0000 7fe8205829c0 10 monclient: get_monmap_and_config success 2024-09-19T14:13:20.350 INFO:tasks.workunit.client.0.smithi153.stderr: -484> 2024-09-19T14:13:20.213+0000 7fe70c608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:13:20.351 INFO:tasks.workunit.client.0.smithi153.stderr: -483> 2024-09-19T14:13:20.213+0000 7fe8205829c0 4 set_mon_vals no callback set 2024-09-19T14:13:20.351 INFO:tasks.workunit.client.0.smithi153.stderr: -482> 2024-09-19T14:13:20.213+0000 7fe70c608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:13:20.351 INFO:tasks.workunit.client.0.smithi153.stderr: -481> 2024-09-19T14:13:20.213+0000 7fe70c608640 10 monclient: dump: 2024-09-19T14:13:20.351 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:13:20.351 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:13:20.351 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.351 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.351 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:13:20.351 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.351 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:13:20.351 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:13:20.351 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:13:20.351 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.351 INFO:tasks.workunit.client.0.smithi153.stderr: -480> 2024-09-19T14:13:20.213+0000 7fe8205829c0 10 monclient: shutdown 2024-09-19T14:13:20.352 INFO:tasks.workunit.client.0.smithi153.stderr: -479> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) unregister_commands rotate-key 2024-09-19T14:13:20.352 INFO:tasks.workunit.client.0.smithi153.stderr: -478> 2024-09-19T14:13:20.213+0000 7fe8205829c0 10 monclient: build_initial_monmap 2024-09-19T14:13:20.352 INFO:tasks.workunit.client.0.smithi153.stderr: -477> 2024-09-19T14:13:20.213+0000 7fe8205829c0 1 build_initial for_mkfs: 0 2024-09-19T14:13:20.352 INFO:tasks.workunit.client.0.smithi153.stderr: -476> 2024-09-19T14:13:20.213+0000 7fe8205829c0 10 monclient: monmap: 2024-09-19T14:13:20.352 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:13:20.352 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:13:20.352 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:13:20.352 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:13:20.352 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:13:20.352 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.352 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:13:20.352 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:13:20.352 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:13:20.352 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.353 INFO:tasks.workunit.client.0.smithi153.stderr: -475> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding auth protocol: cephx 2024-09-19T14:13:20.353 INFO:tasks.workunit.client.0.smithi153.stderr: -474> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding auth protocol: cephx 2024-09-19T14:13:20.353 INFO:tasks.workunit.client.0.smithi153.stderr: -473> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding auth protocol: cephx 2024-09-19T14:13:20.353 INFO:tasks.workunit.client.0.smithi153.stderr: -472> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding con mode: secure 2024-09-19T14:13:20.353 INFO:tasks.workunit.client.0.smithi153.stderr: -471> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding con mode: crc 2024-09-19T14:13:20.353 INFO:tasks.workunit.client.0.smithi153.stderr: -470> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding con mode: secure 2024-09-19T14:13:20.353 INFO:tasks.workunit.client.0.smithi153.stderr: -469> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding con mode: crc 2024-09-19T14:13:20.353 INFO:tasks.workunit.client.0.smithi153.stderr: -468> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding con mode: secure 2024-09-19T14:13:20.353 INFO:tasks.workunit.client.0.smithi153.stderr: -467> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding con mode: crc 2024-09-19T14:13:20.353 INFO:tasks.workunit.client.0.smithi153.stderr: -466> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding con mode: crc 2024-09-19T14:13:20.353 INFO:tasks.workunit.client.0.smithi153.stderr: -465> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding con mode: secure 2024-09-19T14:13:20.353 INFO:tasks.workunit.client.0.smithi153.stderr: -464> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding con mode: crc 2024-09-19T14:13:20.353 INFO:tasks.workunit.client.0.smithi153.stderr: -463> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding con mode: secure 2024-09-19T14:13:20.354 INFO:tasks.workunit.client.0.smithi153.stderr: -462> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding con mode: crc 2024-09-19T14:13:20.354 INFO:tasks.workunit.client.0.smithi153.stderr: -461> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding con mode: secure 2024-09-19T14:13:20.354 INFO:tasks.workunit.client.0.smithi153.stderr: -460> 2024-09-19T14:13:20.217+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.354 INFO:tasks.workunit.client.0.smithi153.stderr: -459> 2024-09-19T14:13:20.217+0000 7fe8205829c0 1 librados: starting msgr at 2024-09-19T14:13:20.354 INFO:tasks.workunit.client.0.smithi153.stderr: -458> 2024-09-19T14:13:20.217+0000 7fe8205829c0 1 librados: starting objecter 2024-09-19T14:13:20.354 INFO:tasks.workunit.client.0.smithi153.stderr: -457> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command objecter_requests hook 0x55f1f6723990 2024-09-19T14:13:20.354 INFO:tasks.workunit.client.0.smithi153.stderr: -456> 2024-09-19T14:13:20.217+0000 7fe8205829c0 1 librados: setting wanted keys 2024-09-19T14:13:20.354 INFO:tasks.workunit.client.0.smithi153.stderr: -455> 2024-09-19T14:13:20.217+0000 7fe8205829c0 1 librados: calling monclient init 2024-09-19T14:13:20.354 INFO:tasks.workunit.client.0.smithi153.stderr: -454> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient: init 2024-09-19T14:13:20.354 INFO:tasks.workunit.client.0.smithi153.stderr: -453> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding auth protocol: cephx 2024-09-19T14:13:20.354 INFO:tasks.workunit.client.0.smithi153.stderr: -452> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding auth protocol: cephx 2024-09-19T14:13:20.354 INFO:tasks.workunit.client.0.smithi153.stderr: -451> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding auth protocol: cephx 2024-09-19T14:13:20.354 INFO:tasks.workunit.client.0.smithi153.stderr: -450> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding con mode: secure 2024-09-19T14:13:20.355 INFO:tasks.workunit.client.0.smithi153.stderr: -449> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding con mode: crc 2024-09-19T14:13:20.355 INFO:tasks.workunit.client.0.smithi153.stderr: -448> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding con mode: secure 2024-09-19T14:13:20.355 INFO:tasks.workunit.client.0.smithi153.stderr: -447> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding con mode: crc 2024-09-19T14:13:20.355 INFO:tasks.workunit.client.0.smithi153.stderr: -446> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding con mode: secure 2024-09-19T14:13:20.355 INFO:tasks.workunit.client.0.smithi153.stderr: -445> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding con mode: crc 2024-09-19T14:13:20.355 INFO:tasks.workunit.client.0.smithi153.stderr: -444> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding con mode: crc 2024-09-19T14:13:20.355 INFO:tasks.workunit.client.0.smithi153.stderr: -443> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding con mode: secure 2024-09-19T14:13:20.355 INFO:tasks.workunit.client.0.smithi153.stderr: -442> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding con mode: crc 2024-09-19T14:13:20.355 INFO:tasks.workunit.client.0.smithi153.stderr: -441> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding con mode: secure 2024-09-19T14:13:20.355 INFO:tasks.workunit.client.0.smithi153.stderr: -440> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding con mode: crc 2024-09-19T14:13:20.355 INFO:tasks.workunit.client.0.smithi153.stderr: -439> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding con mode: secure 2024-09-19T14:13:20.355 INFO:tasks.workunit.client.0.smithi153.stderr: -438> 2024-09-19T14:13:20.217+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.355 INFO:tasks.workunit.client.0.smithi153.stderr: -437> 2024-09-19T14:13:20.217+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.355 INFO:tasks.workunit.client.0.smithi153.stderr: -436> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command rotate-key hook 0x55f1f67da008 2024-09-19T14:13:20.356 INFO:tasks.workunit.client.0.smithi153.stderr: -435> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient: _reopen_session rank -1 2024-09-19T14:13:20.356 INFO:tasks.workunit.client.0.smithi153.stderr: -434> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T14:13:20.356 INFO:tasks.workunit.client.0.smithi153.stderr: -433> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient(hunting): picked mon.noname-a con 0x55f1f6689be0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:13:20.356 INFO:tasks.workunit.client.0.smithi153.stderr: -432> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient(hunting): picked mon.noname-c con 0x55f1f66952e0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:13:20.356 INFO:tasks.workunit.client.0.smithi153.stderr: -431> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient(hunting): picked mon.noname-b con 0x55f1f67dde50 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:13:20.356 INFO:tasks.workunit.client.0.smithi153.stderr: -430> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:13:20.356 INFO:tasks.workunit.client.0.smithi153.stderr: -429> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:13:20.356 INFO:tasks.workunit.client.0.smithi153.stderr: -428> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:13:20.356 INFO:tasks.workunit.client.0.smithi153.stderr: -427> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient(hunting): _renew_subs 2024-09-19T14:13:20.356 INFO:tasks.workunit.client.0.smithi153.stderr: -426> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient(hunting): authenticate will time out at 2988.680895s 2024-09-19T14:13:20.356 INFO:tasks.workunit.client.0.smithi153.stderr: -425> 2024-09-19T14:13:20.217+0000 7fe81d887640 10 monclient(hunting): get_auth_request con 0x55f1f66952e0 auth_method 0 2024-09-19T14:13:20.356 INFO:tasks.workunit.client.0.smithi153.stderr: -424> 2024-09-19T14:13:20.217+0000 7fe81d887640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:13:20.356 INFO:tasks.workunit.client.0.smithi153.stderr: -423> 2024-09-19T14:13:20.217+0000 7fe81d887640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:13:20.357 INFO:tasks.workunit.client.0.smithi153.stderr: -422> 2024-09-19T14:13:20.217+0000 7fe81d887640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:13:20.357 INFO:tasks.workunit.client.0.smithi153.stderr: -421> 2024-09-19T14:13:20.217+0000 7fe81e088640 10 monclient(hunting): get_auth_request con 0x55f1f6689be0 auth_method 0 2024-09-19T14:13:20.357 INFO:tasks.workunit.client.0.smithi153.stderr: -420> 2024-09-19T14:13:20.217+0000 7fe81e088640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:13:20.357 INFO:tasks.workunit.client.0.smithi153.stderr: -419> 2024-09-19T14:13:20.217+0000 7fe81e088640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:13:20.357 INFO:tasks.workunit.client.0.smithi153.stderr: -418> 2024-09-19T14:13:20.217+0000 7fe81e088640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:13:20.357 INFO:tasks.workunit.client.0.smithi153.stderr: -417> 2024-09-19T14:13:20.217+0000 7fe81d887640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:13:20.357 INFO:tasks.workunit.client.0.smithi153.stderr: -416> 2024-09-19T14:13:20.217+0000 7fe81d887640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:13:20.357 INFO:tasks.workunit.client.0.smithi153.stderr: -415> 2024-09-19T14:13:20.217+0000 7fe81d887640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:13:20.357 INFO:tasks.workunit.client.0.smithi153.stderr: -414> 2024-09-19T14:13:20.217+0000 7fe81e088640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:13:20.357 INFO:tasks.workunit.client.0.smithi153.stderr: -413> 2024-09-19T14:13:20.217+0000 7fe81e088640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:13:20.357 INFO:tasks.workunit.client.0.smithi153.stderr: -412> 2024-09-19T14:13:20.217+0000 7fe81e088640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:13:20.357 INFO:tasks.workunit.client.0.smithi153.stderr: -411> 2024-09-19T14:13:20.217+0000 7fe81d887640 10 monclient(hunting): handle_auth_done global_id 7778 payload 824 2024-09-19T14:13:20.357 INFO:tasks.workunit.client.0.smithi153.stderr: -410> 2024-09-19T14:13:20.217+0000 7fe81d887640 10 monclient: _finish_hunting 0 2024-09-19T14:13:20.357 INFO:tasks.workunit.client.0.smithi153.stderr: -409> 2024-09-19T14:13:20.217+0000 7fe81d887640 1 monclient: found mon.noname-c 2024-09-19T14:13:20.357 INFO:tasks.workunit.client.0.smithi153.stderr: -408> 2024-09-19T14:13:20.217+0000 7fe81d887640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:13:20.358 INFO:tasks.workunit.client.0.smithi153.stderr: -407> 2024-09-19T14:13:20.217+0000 7fe70ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:13:20.358 INFO:tasks.workunit.client.0.smithi153.stderr: -406> 2024-09-19T14:13:20.217+0000 7fe70ae05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:13:20.358 INFO:tasks.workunit.client.0.smithi153.stderr: -405> 2024-09-19T14:13:20.217+0000 7fe70ae05640 10 monclient: dump: 2024-09-19T14:13:20.358 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:13:20.358 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:13:20.358 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.358 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.358 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:13:20.358 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.358 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:13:20.358 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:13:20.358 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:13:20.358 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.358 INFO:tasks.workunit.client.0.smithi153.stderr: -404> 2024-09-19T14:13:20.217+0000 7fe70ae05640 10 monclient: _finish_auth 0 2024-09-19T14:13:20.358 INFO:tasks.workunit.client.0.smithi153.stderr: -403> 2024-09-19T14:13:20.217+0000 7fe70ae05640 10 monclient: _check_auth_tickets 2024-09-19T14:13:20.359 INFO:tasks.workunit.client.0.smithi153.stderr: -402> 2024-09-19T14:13:20.217+0000 7fe70ae05640 10 monclient: handle_config config(0 keys) 2024-09-19T14:13:20.359 INFO:tasks.workunit.client.0.smithi153.stderr: -401> 2024-09-19T14:13:20.217+0000 7fe70ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:13:20.359 INFO:tasks.workunit.client.0.smithi153.stderr: -400> 2024-09-19T14:13:20.217+0000 7fe70ae05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:13:20.359 INFO:tasks.workunit.client.0.smithi153.stderr: -399> 2024-09-19T14:13:20.217+0000 7fe70ae05640 10 monclient: dump: 2024-09-19T14:13:20.359 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:13:20.359 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:13:20.359 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.359 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.359 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:13:20.359 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.359 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:13:20.359 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:13:20.359 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:13:20.359 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.359 INFO:tasks.workunit.client.0.smithi153.stderr: -398> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 monclient: authenticate success, global_id 7778 2024-09-19T14:13:20.360 INFO:tasks.workunit.client.0.smithi153.stderr: -397> 2024-09-19T14:13:20.217+0000 7fe70c608640 4 set_mon_vals no callback set 2024-09-19T14:13:20.360 INFO:tasks.workunit.client.0.smithi153.stderr: -396> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient: _renew_subs 2024-09-19T14:13:20.360 INFO:tasks.workunit.client.0.smithi153.stderr: -395> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:13:20.360 INFO:tasks.workunit.client.0.smithi153.stderr: -394> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient: _renew_subs 2024-09-19T14:13:20.360 INFO:tasks.workunit.client.0.smithi153.stderr: -393> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:13:20.360 INFO:tasks.workunit.client.0.smithi153.stderr: -392> 2024-09-19T14:13:20.217+0000 7fe8205829c0 1 librados: init done 2024-09-19T14:13:20.360 INFO:tasks.workunit.client.0.smithi153.stderr: -391> 2024-09-19T14:13:20.217+0000 7fe70ae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:13:20.360 INFO:tasks.workunit.client.0.smithi153.stderr: -390> 2024-09-19T14:13:20.217+0000 7fe70ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:13:20.360 INFO:tasks.workunit.client.0.smithi153.stderr: -389> 2024-09-19T14:13:20.217+0000 7fe70ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:13:20.360 INFO:tasks.workunit.client.0.smithi153.stderr: -388> 2024-09-19T14:13:20.221+0000 7fe81e088640 10 monclient: get_auth_request con 0x7fe704071c10 auth_method 0 2024-09-19T14:13:20.360 INFO:tasks.workunit.client.0.smithi153.stderr: -387> 2024-09-19T14:13:20.221+0000 7fe81e889640 10 monclient: get_auth_request con 0x55f1f6806710 auth_method 0 2024-09-19T14:13:20.360 INFO:tasks.workunit.client.0.smithi153.stderr: -386> 2024-09-19T14:13:20.221+0000 7fe81e088640 10 monclient: get_auth_request con 0x55f1f6826130 auth_method 0 2024-09-19T14:13:20.360 INFO:tasks.workunit.client.0.smithi153.stderr: -385> 2024-09-19T14:13:20.225+0000 7fe81d887640 10 monclient: get_auth_request con 0x55f1f68299c0 auth_method 0 2024-09-19T14:13:20.360 INFO:tasks.workunit.client.0.smithi153.stderr: -384> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient: build_initial_monmap 2024-09-19T14:13:20.360 INFO:tasks.workunit.client.0.smithi153.stderr: -383> 2024-09-19T14:13:20.225+0000 7fe8205829c0 1 build_initial for_mkfs: 0 2024-09-19T14:13:20.361 INFO:tasks.workunit.client.0.smithi153.stderr: -382> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient: monmap: 2024-09-19T14:13:20.361 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:13:20.361 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:13:20.361 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:13:20.361 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:13:20.361 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:13:20.361 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.361 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:13:20.361 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:13:20.361 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:13:20.361 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.361 INFO:tasks.workunit.client.0.smithi153.stderr: -381> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding auth protocol: cephx 2024-09-19T14:13:20.361 INFO:tasks.workunit.client.0.smithi153.stderr: -380> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding auth protocol: cephx 2024-09-19T14:13:20.362 INFO:tasks.workunit.client.0.smithi153.stderr: -379> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding auth protocol: cephx 2024-09-19T14:13:20.362 INFO:tasks.workunit.client.0.smithi153.stderr: -378> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding con mode: secure 2024-09-19T14:13:20.362 INFO:tasks.workunit.client.0.smithi153.stderr: -377> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding con mode: crc 2024-09-19T14:13:20.362 INFO:tasks.workunit.client.0.smithi153.stderr: -376> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding con mode: secure 2024-09-19T14:13:20.362 INFO:tasks.workunit.client.0.smithi153.stderr: -375> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding con mode: crc 2024-09-19T14:13:20.362 INFO:tasks.workunit.client.0.smithi153.stderr: -374> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding con mode: secure 2024-09-19T14:13:20.362 INFO:tasks.workunit.client.0.smithi153.stderr: -373> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding con mode: crc 2024-09-19T14:13:20.362 INFO:tasks.workunit.client.0.smithi153.stderr: -372> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding con mode: crc 2024-09-19T14:13:20.362 INFO:tasks.workunit.client.0.smithi153.stderr: -371> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding con mode: secure 2024-09-19T14:13:20.362 INFO:tasks.workunit.client.0.smithi153.stderr: -370> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding con mode: crc 2024-09-19T14:13:20.362 INFO:tasks.workunit.client.0.smithi153.stderr: -369> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding con mode: secure 2024-09-19T14:13:20.362 INFO:tasks.workunit.client.0.smithi153.stderr: -368> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding con mode: crc 2024-09-19T14:13:20.362 INFO:tasks.workunit.client.0.smithi153.stderr: -367> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding con mode: secure 2024-09-19T14:13:20.362 INFO:tasks.workunit.client.0.smithi153.stderr: -366> 2024-09-19T14:13:20.225+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.363 INFO:tasks.workunit.client.0.smithi153.stderr: -365> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command objecter_requests cmddesc objecter_requests hook 0x55f1f6832c50 EEXIST 2024-09-19T14:13:20.363 INFO:tasks.workunit.client.0.smithi153.stderr: -364> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient: init 2024-09-19T14:13:20.363 INFO:tasks.workunit.client.0.smithi153.stderr: -363> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding auth protocol: cephx 2024-09-19T14:13:20.363 INFO:tasks.workunit.client.0.smithi153.stderr: -362> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding auth protocol: cephx 2024-09-19T14:13:20.363 INFO:tasks.workunit.client.0.smithi153.stderr: -361> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding auth protocol: cephx 2024-09-19T14:13:20.363 INFO:tasks.workunit.client.0.smithi153.stderr: -360> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding con mode: secure 2024-09-19T14:13:20.363 INFO:tasks.workunit.client.0.smithi153.stderr: -359> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding con mode: crc 2024-09-19T14:13:20.363 INFO:tasks.workunit.client.0.smithi153.stderr: -358> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding con mode: secure 2024-09-19T14:13:20.363 INFO:tasks.workunit.client.0.smithi153.stderr: -357> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding con mode: crc 2024-09-19T14:13:20.363 INFO:tasks.workunit.client.0.smithi153.stderr: -356> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding con mode: secure 2024-09-19T14:13:20.363 INFO:tasks.workunit.client.0.smithi153.stderr: -355> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding con mode: crc 2024-09-19T14:13:20.363 INFO:tasks.workunit.client.0.smithi153.stderr: -354> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding con mode: crc 2024-09-19T14:13:20.363 INFO:tasks.workunit.client.0.smithi153.stderr: -353> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding con mode: secure 2024-09-19T14:13:20.363 INFO:tasks.workunit.client.0.smithi153.stderr: -352> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding con mode: crc 2024-09-19T14:13:20.364 INFO:tasks.workunit.client.0.smithi153.stderr: -351> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding con mode: secure 2024-09-19T14:13:20.364 INFO:tasks.workunit.client.0.smithi153.stderr: -350> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding con mode: crc 2024-09-19T14:13:20.364 INFO:tasks.workunit.client.0.smithi153.stderr: -349> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding con mode: secure 2024-09-19T14:13:20.364 INFO:tasks.workunit.client.0.smithi153.stderr: -348> 2024-09-19T14:13:20.225+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.364 INFO:tasks.workunit.client.0.smithi153.stderr: -347> 2024-09-19T14:13:20.225+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.364 INFO:tasks.workunit.client.0.smithi153.stderr: -346> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command rotate-key cmddesc rotate-key hook 0x55f1f682e380 EEXIST 2024-09-19T14:13:20.364 INFO:tasks.workunit.client.0.smithi153.stderr: -345> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient: _reopen_session rank -1 2024-09-19T14:13:20.364 INFO:tasks.workunit.client.0.smithi153.stderr: -344> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T14:13:20.364 INFO:tasks.workunit.client.0.smithi153.stderr: -343> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient(hunting): picked mon.noname-a con 0x55f1f6856e00 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:13:20.364 INFO:tasks.workunit.client.0.smithi153.stderr: -342> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient(hunting): picked mon.noname-b con 0x55f1f6856730 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:13:20.364 INFO:tasks.workunit.client.0.smithi153.stderr: -341> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient(hunting): picked mon.noname-c con 0x55f1f6855110 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:13:20.364 INFO:tasks.workunit.client.0.smithi153.stderr: -340> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:13:20.364 INFO:tasks.workunit.client.0.smithi153.stderr: -339> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:13:20.364 INFO:tasks.workunit.client.0.smithi153.stderr: -338> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:13:20.365 INFO:tasks.workunit.client.0.smithi153.stderr: -337> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient(hunting): _renew_subs 2024-09-19T14:13:20.365 INFO:tasks.workunit.client.0.smithi153.stderr: -336> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient(hunting): authenticate will time out at 2988.690941s 2024-09-19T14:13:20.365 INFO:tasks.workunit.client.0.smithi153.stderr: -335> 2024-09-19T14:13:20.225+0000 7fe81e088640 10 monclient(hunting): get_auth_request con 0x55f1f6856e00 auth_method 0 2024-09-19T14:13:20.365 INFO:tasks.workunit.client.0.smithi153.stderr: -334> 2024-09-19T14:13:20.225+0000 7fe81e088640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:13:20.365 INFO:tasks.workunit.client.0.smithi153.stderr: -333> 2024-09-19T14:13:20.225+0000 7fe81e088640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:13:20.365 INFO:tasks.workunit.client.0.smithi153.stderr: -332> 2024-09-19T14:13:20.225+0000 7fe81e088640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:13:20.365 INFO:tasks.workunit.client.0.smithi153.stderr: -331> 2024-09-19T14:13:20.225+0000 7fe81e889640 10 monclient(hunting): get_auth_request con 0x55f1f6855110 auth_method 0 2024-09-19T14:13:20.365 INFO:tasks.workunit.client.0.smithi153.stderr: -330> 2024-09-19T14:13:20.225+0000 7fe81e889640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:13:20.365 INFO:tasks.workunit.client.0.smithi153.stderr: -329> 2024-09-19T14:13:20.225+0000 7fe81e889640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:13:20.365 INFO:tasks.workunit.client.0.smithi153.stderr: -328> 2024-09-19T14:13:20.225+0000 7fe81e889640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:13:20.365 INFO:tasks.workunit.client.0.smithi153.stderr: -327> 2024-09-19T14:13:20.225+0000 7fe81e088640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:13:20.365 INFO:tasks.workunit.client.0.smithi153.stderr: -326> 2024-09-19T14:13:20.225+0000 7fe81e088640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:13:20.365 INFO:tasks.workunit.client.0.smithi153.stderr: -325> 2024-09-19T14:13:20.225+0000 7fe81e088640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:13:20.366 INFO:tasks.workunit.client.0.smithi153.stderr: -324> 2024-09-19T14:13:20.225+0000 7fe81e889640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:13:20.366 INFO:tasks.workunit.client.0.smithi153.stderr: -323> 2024-09-19T14:13:20.225+0000 7fe81e889640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:13:20.366 INFO:tasks.workunit.client.0.smithi153.stderr: -322> 2024-09-19T14:13:20.225+0000 7fe81e889640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:13:20.366 INFO:tasks.workunit.client.0.smithi153.stderr: -321> 2024-09-19T14:13:20.225+0000 7fe81e088640 10 monclient(hunting): handle_auth_done global_id 8310 payload 824 2024-09-19T14:13:20.366 INFO:tasks.workunit.client.0.smithi153.stderr: -320> 2024-09-19T14:13:20.225+0000 7fe81e088640 10 monclient: _finish_hunting 0 2024-09-19T14:13:20.366 INFO:tasks.workunit.client.0.smithi153.stderr: -319> 2024-09-19T14:13:20.225+0000 7fe81e088640 1 monclient: found mon.noname-a 2024-09-19T14:13:20.366 INFO:tasks.workunit.client.0.smithi153.stderr: -318> 2024-09-19T14:13:20.225+0000 7fe81e088640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:13:20.366 INFO:tasks.workunit.client.0.smithi153.stderr: -317> 2024-09-19T14:13:20.225+0000 7fe81d887640 10 monclient: get_auth_request con 0x55f1f6856730 auth_method 0 2024-09-19T14:13:20.366 INFO:tasks.workunit.client.0.smithi153.stderr: -316> 2024-09-19T14:13:20.225+0000 7fe703fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:13:20.366 INFO:tasks.workunit.client.0.smithi153.stderr: -315> 2024-09-19T14:13:20.225+0000 7fe703fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:13:20.366 INFO:tasks.workunit.client.0.smithi153.stderr: -314> 2024-09-19T14:13:20.225+0000 7fe703fff640 10 monclient: dump: 2024-09-19T14:13:20.366 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:13:20.366 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:13:20.366 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.367 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.367 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:13:20.367 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.367 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:13:20.367 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:13:20.367 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:13:20.367 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.367 INFO:tasks.workunit.client.0.smithi153.stderr: -313> 2024-09-19T14:13:20.225+0000 7fe703fff640 10 monclient: _finish_auth 0 2024-09-19T14:13:20.367 INFO:tasks.workunit.client.0.smithi153.stderr: -312> 2024-09-19T14:13:20.225+0000 7fe703fff640 10 monclient: _check_auth_tickets 2024-09-19T14:13:20.367 INFO:tasks.workunit.client.0.smithi153.stderr: -311> 2024-09-19T14:13:20.225+0000 7fe703fff640 10 monclient: handle_config config(0 keys) 2024-09-19T14:13:20.367 INFO:tasks.workunit.client.0.smithi153.stderr: -310> 2024-09-19T14:13:20.225+0000 7fe703fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:13:20.367 INFO:tasks.workunit.client.0.smithi153.stderr: -309> 2024-09-19T14:13:20.225+0000 7fe703fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:13:20.368 INFO:tasks.workunit.client.0.smithi153.stderr: -308> 2024-09-19T14:13:20.225+0000 7fe703fff640 10 monclient: dump: 2024-09-19T14:13:20.368 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:13:20.368 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:13:20.368 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.368 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.368 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:13:20.368 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.368 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:13:20.368 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:13:20.368 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:13:20.368 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.368 INFO:tasks.workunit.client.0.smithi153.stderr: -307> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 monclient: authenticate success, global_id 8310 2024-09-19T14:13:20.368 INFO:tasks.workunit.client.0.smithi153.stderr: -306> 2024-09-19T14:13:20.225+0000 7fe81f08a640 4 set_mon_vals no callback set 2024-09-19T14:13:20.369 INFO:tasks.workunit.client.0.smithi153.stderr: -305> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient: _renew_subs 2024-09-19T14:13:20.369 INFO:tasks.workunit.client.0.smithi153.stderr: -304> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:13:20.369 INFO:tasks.workunit.client.0.smithi153.stderr: -303> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient: _renew_subs 2024-09-19T14:13:20.369 INFO:tasks.workunit.client.0.smithi153.stderr: -302> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:13:20.369 INFO:tasks.workunit.client.0.smithi153.stderr: -301> 2024-09-19T14:13:20.229+0000 7fe703fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:13:20.369 INFO:tasks.workunit.client.0.smithi153.stderr: -300> 2024-09-19T14:13:20.229+0000 7fe703fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:13:20.369 INFO:tasks.workunit.client.0.smithi153.stderr: -299> 2024-09-19T14:13:20.229+0000 7fe703fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:13:20.369 INFO:tasks.workunit.client.0.smithi153.stderr: -298> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient: get_monmap_and_config 2024-09-19T14:13:20.369 INFO:tasks.workunit.client.0.smithi153.stderr: -297> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient: build_initial_monmap 2024-09-19T14:13:20.369 INFO:tasks.workunit.client.0.smithi153.stderr: -296> 2024-09-19T14:13:20.229+0000 7fe8205829c0 1 build_initial for_mkfs: 0 2024-09-19T14:13:20.369 INFO:tasks.workunit.client.0.smithi153.stderr: -295> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient: monmap: 2024-09-19T14:13:20.370 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:13:20.370 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:13:20.370 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:13:20.370 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:13:20.370 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:13:20.370 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.370 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:13:20.370 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:13:20.370 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:13:20.370 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.370 INFO:tasks.workunit.client.0.smithi153.stderr: -294> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding auth protocol: cephx 2024-09-19T14:13:20.370 INFO:tasks.workunit.client.0.smithi153.stderr: -293> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding auth protocol: cephx 2024-09-19T14:13:20.370 INFO:tasks.workunit.client.0.smithi153.stderr: -292> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding auth protocol: cephx 2024-09-19T14:13:20.371 INFO:tasks.workunit.client.0.smithi153.stderr: -291> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding con mode: secure 2024-09-19T14:13:20.371 INFO:tasks.workunit.client.0.smithi153.stderr: -290> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding con mode: crc 2024-09-19T14:13:20.371 INFO:tasks.workunit.client.0.smithi153.stderr: -289> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding con mode: secure 2024-09-19T14:13:20.371 INFO:tasks.workunit.client.0.smithi153.stderr: -288> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding con mode: crc 2024-09-19T14:13:20.371 INFO:tasks.workunit.client.0.smithi153.stderr: -287> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding con mode: secure 2024-09-19T14:13:20.371 INFO:tasks.workunit.client.0.smithi153.stderr: -286> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding con mode: crc 2024-09-19T14:13:20.371 INFO:tasks.workunit.client.0.smithi153.stderr: -285> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding con mode: crc 2024-09-19T14:13:20.371 INFO:tasks.workunit.client.0.smithi153.stderr: -284> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding con mode: secure 2024-09-19T14:13:20.371 INFO:tasks.workunit.client.0.smithi153.stderr: -283> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding con mode: crc 2024-09-19T14:13:20.371 INFO:tasks.workunit.client.0.smithi153.stderr: -282> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding con mode: secure 2024-09-19T14:13:20.371 INFO:tasks.workunit.client.0.smithi153.stderr: -281> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding con mode: crc 2024-09-19T14:13:20.371 INFO:tasks.workunit.client.0.smithi153.stderr: -280> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding con mode: secure 2024-09-19T14:13:20.371 INFO:tasks.workunit.client.0.smithi153.stderr: -279> 2024-09-19T14:13:20.229+0000 7fe81d887640 10 monclient: get_auth_request con 0x7fe6f8071b20 auth_method 0 2024-09-19T14:13:20.372 INFO:tasks.workunit.client.0.smithi153.stderr: -278> 2024-09-19T14:13:20.229+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.372 INFO:tasks.workunit.client.0.smithi153.stderr: -277> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient: init 2024-09-19T14:13:20.372 INFO:tasks.workunit.client.0.smithi153.stderr: -276> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding auth protocol: cephx 2024-09-19T14:13:20.372 INFO:tasks.workunit.client.0.smithi153.stderr: -275> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding auth protocol: cephx 2024-09-19T14:13:20.372 INFO:tasks.workunit.client.0.smithi153.stderr: -274> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding auth protocol: cephx 2024-09-19T14:13:20.372 INFO:tasks.workunit.client.0.smithi153.stderr: -273> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding con mode: secure 2024-09-19T14:13:20.372 INFO:tasks.workunit.client.0.smithi153.stderr: -272> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding con mode: crc 2024-09-19T14:13:20.372 INFO:tasks.workunit.client.0.smithi153.stderr: -271> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding con mode: secure 2024-09-19T14:13:20.372 INFO:tasks.workunit.client.0.smithi153.stderr: -270> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding con mode: crc 2024-09-19T14:13:20.372 INFO:tasks.workunit.client.0.smithi153.stderr: -269> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding con mode: secure 2024-09-19T14:13:20.372 INFO:tasks.workunit.client.0.smithi153.stderr: -268> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding con mode: crc 2024-09-19T14:13:20.372 INFO:tasks.workunit.client.0.smithi153.stderr: -267> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding con mode: crc 2024-09-19T14:13:20.372 INFO:tasks.workunit.client.0.smithi153.stderr: -266> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding con mode: secure 2024-09-19T14:13:20.373 INFO:tasks.workunit.client.0.smithi153.stderr: -265> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding con mode: crc 2024-09-19T14:13:20.373 INFO:tasks.workunit.client.0.smithi153.stderr: -264> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding con mode: secure 2024-09-19T14:13:20.373 INFO:tasks.workunit.client.0.smithi153.stderr: -263> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding con mode: crc 2024-09-19T14:13:20.373 INFO:tasks.workunit.client.0.smithi153.stderr: -262> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding con mode: secure 2024-09-19T14:13:20.373 INFO:tasks.workunit.client.0.smithi153.stderr: -261> 2024-09-19T14:13:20.229+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.373 INFO:tasks.workunit.client.0.smithi153.stderr: -260> 2024-09-19T14:13:20.229+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.373 INFO:tasks.workunit.client.0.smithi153.stderr: -259> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command rotate-key cmddesc rotate-key hook 0x7ffdc1d03f48 EEXIST 2024-09-19T14:13:20.373 INFO:tasks.workunit.client.0.smithi153.stderr: -258> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient: _reopen_session rank -1 2024-09-19T14:13:20.373 INFO:tasks.workunit.client.0.smithi153.stderr: -257> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T14:13:20.373 INFO:tasks.workunit.client.0.smithi153.stderr: -256> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient(hunting): picked mon.noname-a con 0x55f1f68a4ed0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:13:20.373 INFO:tasks.workunit.client.0.smithi153.stderr: -255> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient(hunting): picked mon.noname-b con 0x55f1f68a6ba0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:13:20.373 INFO:tasks.workunit.client.0.smithi153.stderr: -254> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient(hunting): picked mon.noname-c con 0x55f1f689c770 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:13:20.373 INFO:tasks.workunit.client.0.smithi153.stderr: -253> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:13:20.374 INFO:tasks.workunit.client.0.smithi153.stderr: -252> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:13:20.374 INFO:tasks.workunit.client.0.smithi153.stderr: -251> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:13:20.374 INFO:tasks.workunit.client.0.smithi153.stderr: -250> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient(hunting): _renew_subs 2024-09-19T14:13:20.374 INFO:tasks.workunit.client.0.smithi153.stderr: -249> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient(hunting): authenticate will time out at 2988.695197s 2024-09-19T14:13:20.374 INFO:tasks.workunit.client.0.smithi153.stderr: -248> 2024-09-19T14:13:20.229+0000 7fe81e088640 10 monclient(hunting): get_auth_request con 0x55f1f68a4ed0 auth_method 0 2024-09-19T14:13:20.374 INFO:tasks.workunit.client.0.smithi153.stderr: -247> 2024-09-19T14:13:20.229+0000 7fe81e088640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:13:20.374 INFO:tasks.workunit.client.0.smithi153.stderr: -246> 2024-09-19T14:13:20.229+0000 7fe81e088640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:13:20.374 INFO:tasks.workunit.client.0.smithi153.stderr: -245> 2024-09-19T14:13:20.229+0000 7fe81e088640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:13:20.374 INFO:tasks.workunit.client.0.smithi153.stderr: -244> 2024-09-19T14:13:20.229+0000 7fe81e889640 10 monclient(hunting): get_auth_request con 0x55f1f689c770 auth_method 0 2024-09-19T14:13:20.374 INFO:tasks.workunit.client.0.smithi153.stderr: -243> 2024-09-19T14:13:20.229+0000 7fe81e889640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:13:20.374 INFO:tasks.workunit.client.0.smithi153.stderr: -242> 2024-09-19T14:13:20.229+0000 7fe81e889640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:13:20.374 INFO:tasks.workunit.client.0.smithi153.stderr: -241> 2024-09-19T14:13:20.229+0000 7fe81e889640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:13:20.374 INFO:tasks.workunit.client.0.smithi153.stderr: -240> 2024-09-19T14:13:20.229+0000 7fe81e088640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:13:20.375 INFO:tasks.workunit.client.0.smithi153.stderr: -239> 2024-09-19T14:13:20.229+0000 7fe81e088640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:13:20.375 INFO:tasks.workunit.client.0.smithi153.stderr: -238> 2024-09-19T14:13:20.229+0000 7fe81e088640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:13:20.375 INFO:tasks.workunit.client.0.smithi153.stderr: -237> 2024-09-19T14:13:20.229+0000 7fe81e889640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:13:20.375 INFO:tasks.workunit.client.0.smithi153.stderr: -236> 2024-09-19T14:13:20.229+0000 7fe81e889640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:13:20.375 INFO:tasks.workunit.client.0.smithi153.stderr: -235> 2024-09-19T14:13:20.229+0000 7fe81e889640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:13:20.375 INFO:tasks.workunit.client.0.smithi153.stderr: -234> 2024-09-19T14:13:20.229+0000 7fe81e088640 10 monclient(hunting): handle_auth_done global_id 8313 payload 274 2024-09-19T14:13:20.375 INFO:tasks.workunit.client.0.smithi153.stderr: -233> 2024-09-19T14:13:20.229+0000 7fe81e088640 10 monclient: _finish_hunting 0 2024-09-19T14:13:20.375 INFO:tasks.workunit.client.0.smithi153.stderr: -232> 2024-09-19T14:13:20.229+0000 7fe81e088640 1 monclient: found mon.noname-a 2024-09-19T14:13:20.375 INFO:tasks.workunit.client.0.smithi153.stderr: -231> 2024-09-19T14:13:20.229+0000 7fe81e088640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:13:20.375 INFO:tasks.workunit.client.0.smithi153.stderr: -230> 2024-09-19T14:13:20.229+0000 7fe81d887640 10 monclient: get_auth_request con 0x55f1f68a6ba0 auth_method 0 2024-09-19T14:13:20.375 INFO:tasks.workunit.client.0.smithi153.stderr: -229> 2024-09-19T14:13:20.229+0000 7fe701ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:13:20.375 INFO:tasks.workunit.client.0.smithi153.stderr: -228> 2024-09-19T14:13:20.229+0000 7fe701ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:13:20.375 INFO:tasks.workunit.client.0.smithi153.stderr: -227> 2024-09-19T14:13:20.229+0000 7fe701ffb640 10 monclient: dump: 2024-09-19T14:13:20.375 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:13:20.376 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:13:20.376 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.376 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.376 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:13:20.376 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.376 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:13:20.376 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:13:20.376 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:13:20.376 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.376 INFO:tasks.workunit.client.0.smithi153.stderr: -226> 2024-09-19T14:13:20.229+0000 7fe701ffb640 10 monclient: _finish_auth 0 2024-09-19T14:13:20.376 INFO:tasks.workunit.client.0.smithi153.stderr: -225> 2024-09-19T14:13:20.229+0000 7fe701ffb640 10 monclient: _check_auth_tickets 2024-09-19T14:13:20.376 INFO:tasks.workunit.client.0.smithi153.stderr: -224> 2024-09-19T14:13:20.229+0000 7fe701ffb640 10 monclient: handle_config config(0 keys) 2024-09-19T14:13:20.376 INFO:tasks.workunit.client.0.smithi153.stderr: -223> 2024-09-19T14:13:20.229+0000 7fe701ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:13:20.377 INFO:tasks.workunit.client.0.smithi153.stderr: -222> 2024-09-19T14:13:20.229+0000 7fe701ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:13:20.377 INFO:tasks.workunit.client.0.smithi153.stderr: -221> 2024-09-19T14:13:20.229+0000 7fe701ffb640 10 monclient: dump: 2024-09-19T14:13:20.377 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:13:20.377 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:13:20.377 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.377 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.377 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:13:20.377 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.377 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:13:20.377 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:13:20.377 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:13:20.377 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.378 INFO:tasks.workunit.client.0.smithi153.stderr: -220> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 monclient: authenticate success, global_id 8313 2024-09-19T14:13:20.378 INFO:tasks.workunit.client.0.smithi153.stderr: -219> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient: get_monmap_and_config success 2024-09-19T14:13:20.378 INFO:tasks.workunit.client.0.smithi153.stderr: -218> 2024-09-19T14:13:20.229+0000 7fe8205829c0 4 set_mon_vals no callback set 2024-09-19T14:13:20.378 INFO:tasks.workunit.client.0.smithi153.stderr: -217> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient: shutdown 2024-09-19T14:13:20.378 INFO:tasks.workunit.client.0.smithi153.stderr: -216> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient: build_initial_monmap 2024-09-19T14:13:20.378 INFO:tasks.workunit.client.0.smithi153.stderr: -215> 2024-09-19T14:13:20.233+0000 7fe8205829c0 1 build_initial for_mkfs: 0 2024-09-19T14:13:20.378 INFO:tasks.workunit.client.0.smithi153.stderr: -214> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient: monmap: 2024-09-19T14:13:20.378 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:13:20.378 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:13:20.378 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:13:20.378 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:13:20.378 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:13:20.378 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.378 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:13:20.379 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:13:20.379 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:13:20.379 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.379 INFO:tasks.workunit.client.0.smithi153.stderr: -213> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding auth protocol: cephx 2024-09-19T14:13:20.379 INFO:tasks.workunit.client.0.smithi153.stderr: -212> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding auth protocol: cephx 2024-09-19T14:13:20.379 INFO:tasks.workunit.client.0.smithi153.stderr: -211> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding auth protocol: cephx 2024-09-19T14:13:20.379 INFO:tasks.workunit.client.0.smithi153.stderr: -210> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding con mode: secure 2024-09-19T14:13:20.379 INFO:tasks.workunit.client.0.smithi153.stderr: -209> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding con mode: crc 2024-09-19T14:13:20.379 INFO:tasks.workunit.client.0.smithi153.stderr: -208> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding con mode: secure 2024-09-19T14:13:20.379 INFO:tasks.workunit.client.0.smithi153.stderr: -207> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding con mode: crc 2024-09-19T14:13:20.379 INFO:tasks.workunit.client.0.smithi153.stderr: -206> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding con mode: secure 2024-09-19T14:13:20.379 INFO:tasks.workunit.client.0.smithi153.stderr: -205> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding con mode: crc 2024-09-19T14:13:20.380 INFO:tasks.workunit.client.0.smithi153.stderr: -204> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding con mode: crc 2024-09-19T14:13:20.380 INFO:tasks.workunit.client.0.smithi153.stderr: -203> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding con mode: secure 2024-09-19T14:13:20.380 INFO:tasks.workunit.client.0.smithi153.stderr: -202> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding con mode: crc 2024-09-19T14:13:20.380 INFO:tasks.workunit.client.0.smithi153.stderr: -201> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding con mode: secure 2024-09-19T14:13:20.380 INFO:tasks.workunit.client.0.smithi153.stderr: -200> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding con mode: crc 2024-09-19T14:13:20.380 INFO:tasks.workunit.client.0.smithi153.stderr: -199> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding con mode: secure 2024-09-19T14:13:20.380 INFO:tasks.workunit.client.0.smithi153.stderr: -198> 2024-09-19T14:13:20.233+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.380 INFO:tasks.workunit.client.0.smithi153.stderr: -197> 2024-09-19T14:13:20.233+0000 7fe8205829c0 1 librados: starting msgr at 2024-09-19T14:13:20.380 INFO:tasks.workunit.client.0.smithi153.stderr: -196> 2024-09-19T14:13:20.233+0000 7fe8205829c0 1 librados: starting objecter 2024-09-19T14:13:20.380 INFO:tasks.workunit.client.0.smithi153.stderr: -195> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command objecter_requests cmddesc objecter_requests hook 0x55f1f68a77c0 EEXIST 2024-09-19T14:13:20.380 INFO:tasks.workunit.client.0.smithi153.stderr: -194> 2024-09-19T14:13:20.233+0000 7fe8205829c0 1 librados: setting wanted keys 2024-09-19T14:13:20.380 INFO:tasks.workunit.client.0.smithi153.stderr: -193> 2024-09-19T14:13:20.233+0000 7fe8205829c0 1 librados: calling monclient init 2024-09-19T14:13:20.380 INFO:tasks.workunit.client.0.smithi153.stderr: -192> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient: init 2024-09-19T14:13:20.381 INFO:tasks.workunit.client.0.smithi153.stderr: -191> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding auth protocol: cephx 2024-09-19T14:13:20.381 INFO:tasks.workunit.client.0.smithi153.stderr: -190> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding auth protocol: cephx 2024-09-19T14:13:20.381 INFO:tasks.workunit.client.0.smithi153.stderr: -189> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding auth protocol: cephx 2024-09-19T14:13:20.381 INFO:tasks.workunit.client.0.smithi153.stderr: -188> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding con mode: secure 2024-09-19T14:13:20.381 INFO:tasks.workunit.client.0.smithi153.stderr: -187> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding con mode: crc 2024-09-19T14:13:20.381 INFO:tasks.workunit.client.0.smithi153.stderr: -186> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding con mode: secure 2024-09-19T14:13:20.381 INFO:tasks.workunit.client.0.smithi153.stderr: -185> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding con mode: crc 2024-09-19T14:13:20.381 INFO:tasks.workunit.client.0.smithi153.stderr: -184> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding con mode: secure 2024-09-19T14:13:20.381 INFO:tasks.workunit.client.0.smithi153.stderr: -183> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding con mode: crc 2024-09-19T14:13:20.381 INFO:tasks.workunit.client.0.smithi153.stderr: -182> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding con mode: crc 2024-09-19T14:13:20.381 INFO:tasks.workunit.client.0.smithi153.stderr: -181> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding con mode: secure 2024-09-19T14:13:20.381 INFO:tasks.workunit.client.0.smithi153.stderr: -180> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding con mode: crc 2024-09-19T14:13:20.381 INFO:tasks.workunit.client.0.smithi153.stderr: -179> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding con mode: secure 2024-09-19T14:13:20.382 INFO:tasks.workunit.client.0.smithi153.stderr: -178> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding con mode: crc 2024-09-19T14:13:20.382 INFO:tasks.workunit.client.0.smithi153.stderr: -177> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding con mode: secure 2024-09-19T14:13:20.382 INFO:tasks.workunit.client.0.smithi153.stderr: -176> 2024-09-19T14:13:20.233+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.382 INFO:tasks.workunit.client.0.smithi153.stderr: -175> 2024-09-19T14:13:20.233+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.382 INFO:tasks.workunit.client.0.smithi153.stderr: -174> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command rotate-key cmddesc rotate-key hook 0x55f1f6858d68 EEXIST 2024-09-19T14:13:20.382 INFO:tasks.workunit.client.0.smithi153.stderr: -173> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient: _reopen_session rank -1 2024-09-19T14:13:20.382 INFO:tasks.workunit.client.0.smithi153.stderr: -172> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T14:13:20.382 INFO:tasks.workunit.client.0.smithi153.stderr: -171> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient(hunting): picked mon.noname-c con 0x55f1f689c770 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:13:20.382 INFO:tasks.workunit.client.0.smithi153.stderr: -170> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient(hunting): picked mon.noname-b con 0x55f1f68a4ed0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:13:20.382 INFO:tasks.workunit.client.0.smithi153.stderr: -169> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient(hunting): picked mon.noname-a con 0x55f1f68a6ba0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:13:20.382 INFO:tasks.workunit.client.0.smithi153.stderr: -168> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:13:20.382 INFO:tasks.workunit.client.0.smithi153.stderr: -167> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:13:20.382 INFO:tasks.workunit.client.0.smithi153.stderr: -166> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:13:20.382 INFO:tasks.workunit.client.0.smithi153.stderr: -165> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient(hunting): _renew_subs 2024-09-19T14:13:20.383 INFO:tasks.workunit.client.0.smithi153.stderr: -164> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient(hunting): authenticate will time out at 2988.697770s 2024-09-19T14:13:20.383 INFO:tasks.workunit.client.0.smithi153.stderr: -163> 2024-09-19T14:13:20.233+0000 7fe81e088640 10 monclient(hunting): get_auth_request con 0x55f1f689c770 auth_method 0 2024-09-19T14:13:20.383 INFO:tasks.workunit.client.0.smithi153.stderr: -162> 2024-09-19T14:13:20.233+0000 7fe81e088640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:13:20.383 INFO:tasks.workunit.client.0.smithi153.stderr: -161> 2024-09-19T14:13:20.233+0000 7fe81e088640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:13:20.383 INFO:tasks.workunit.client.0.smithi153.stderr: -160> 2024-09-19T14:13:20.233+0000 7fe81e088640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:13:20.383 INFO:tasks.workunit.client.0.smithi153.stderr: -159> 2024-09-19T14:13:20.233+0000 7fe81e889640 10 monclient(hunting): get_auth_request con 0x55f1f68a6ba0 auth_method 0 2024-09-19T14:13:20.383 INFO:tasks.workunit.client.0.smithi153.stderr: -158> 2024-09-19T14:13:20.233+0000 7fe81e889640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:13:20.383 INFO:tasks.workunit.client.0.smithi153.stderr: -157> 2024-09-19T14:13:20.233+0000 7fe81e889640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:13:20.383 INFO:tasks.workunit.client.0.smithi153.stderr: -156> 2024-09-19T14:13:20.233+0000 7fe81e889640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:13:20.383 INFO:tasks.workunit.client.0.smithi153.stderr: -155> 2024-09-19T14:13:20.233+0000 7fe81e088640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:13:20.383 INFO:tasks.workunit.client.0.smithi153.stderr: -154> 2024-09-19T14:13:20.233+0000 7fe81e088640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:13:20.383 INFO:tasks.workunit.client.0.smithi153.stderr: -153> 2024-09-19T14:13:20.233+0000 7fe81e088640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:13:20.383 INFO:tasks.workunit.client.0.smithi153.stderr: -152> 2024-09-19T14:13:20.233+0000 7fe81e889640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:13:20.384 INFO:tasks.workunit.client.0.smithi153.stderr: -151> 2024-09-19T14:13:20.233+0000 7fe81e889640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:13:20.384 INFO:tasks.workunit.client.0.smithi153.stderr: -150> 2024-09-19T14:13:20.233+0000 7fe81e889640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:13:20.384 INFO:tasks.workunit.client.0.smithi153.stderr: -149> 2024-09-19T14:13:20.233+0000 7fe81e088640 10 monclient(hunting): handle_auth_done global_id 7787 payload 824 2024-09-19T14:13:20.384 INFO:tasks.workunit.client.0.smithi153.stderr: -148> 2024-09-19T14:13:20.233+0000 7fe81e088640 10 monclient: _finish_hunting 0 2024-09-19T14:13:20.384 INFO:tasks.workunit.client.0.smithi153.stderr: -147> 2024-09-19T14:13:20.233+0000 7fe81e088640 1 monclient: found mon.noname-c 2024-09-19T14:13:20.384 INFO:tasks.workunit.client.0.smithi153.stderr: -146> 2024-09-19T14:13:20.233+0000 7fe81e088640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:13:20.384 INFO:tasks.workunit.client.0.smithi153.stderr: -145> 2024-09-19T14:13:20.233+0000 7fe81d887640 10 monclient: get_auth_request con 0x55f1f68a4ed0 auth_method 0 2024-09-19T14:13:20.384 INFO:tasks.workunit.client.0.smithi153.stderr: -144> 2024-09-19T14:13:20.233+0000 7fe6effff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:13:20.384 INFO:tasks.workunit.client.0.smithi153.stderr: -143> 2024-09-19T14:13:20.233+0000 7fe6effff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:13:20.384 INFO:tasks.workunit.client.0.smithi153.stderr: -142> 2024-09-19T14:13:20.233+0000 7fe6effff640 10 monclient: dump: 2024-09-19T14:13:20.384 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:13:20.384 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:13:20.384 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.384 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.384 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:13:20.384 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.385 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:13:20.385 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:13:20.385 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:13:20.385 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.385 INFO:tasks.workunit.client.0.smithi153.stderr: -141> 2024-09-19T14:13:20.233+0000 7fe6effff640 10 monclient: _finish_auth 0 2024-09-19T14:13:20.385 INFO:tasks.workunit.client.0.smithi153.stderr: -140> 2024-09-19T14:13:20.233+0000 7fe6effff640 10 monclient: _check_auth_tickets 2024-09-19T14:13:20.385 INFO:tasks.workunit.client.0.smithi153.stderr: -139> 2024-09-19T14:13:20.233+0000 7fe6effff640 10 monclient: handle_config config(0 keys) 2024-09-19T14:13:20.385 INFO:tasks.workunit.client.0.smithi153.stderr: -138> 2024-09-19T14:13:20.233+0000 7fe6effff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:13:20.385 INFO:tasks.workunit.client.0.smithi153.stderr: -137> 2024-09-19T14:13:20.233+0000 7fe6effff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:13:20.385 INFO:tasks.workunit.client.0.smithi153.stderr: -136> 2024-09-19T14:13:20.233+0000 7fe6effff640 10 monclient: dump: 2024-09-19T14:13:20.385 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:13:20.385 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:13:20.385 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.385 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.385 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:13:20.386 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.386 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:13:20.386 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:13:20.386 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:13:20.386 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.386 INFO:tasks.workunit.client.0.smithi153.stderr: -135> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 monclient: authenticate success, global_id 7787 2024-09-19T14:13:20.386 INFO:tasks.workunit.client.0.smithi153.stderr: -134> 2024-09-19T14:13:20.233+0000 7fe701ffb640 4 set_mon_vals no callback set 2024-09-19T14:13:20.386 INFO:tasks.workunit.client.0.smithi153.stderr: -133> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient: _renew_subs 2024-09-19T14:13:20.386 INFO:tasks.workunit.client.0.smithi153.stderr: -132> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:13:20.386 INFO:tasks.workunit.client.0.smithi153.stderr: -131> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient: _renew_subs 2024-09-19T14:13:20.386 INFO:tasks.workunit.client.0.smithi153.stderr: -130> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:13:20.386 INFO:tasks.workunit.client.0.smithi153.stderr: -129> 2024-09-19T14:13:20.233+0000 7fe8205829c0 1 librados: init done 2024-09-19T14:13:20.386 INFO:tasks.workunit.client.0.smithi153.stderr: -128> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command cr dump hook 0x55f1f689ac48 2024-09-19T14:13:20.386 INFO:tasks.workunit.client.0.smithi153.stderr: -127> 2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.386 INFO:tasks.workunit.client.0.smithi153.stderr: -126> 2024-09-19T14:13:20.237+0000 7fe6effff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:13:20.386 INFO:tasks.workunit.client.0.smithi153.stderr: -125> 2024-09-19T14:13:20.237+0000 7fe6effff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:13:20.387 INFO:tasks.workunit.client.0.smithi153.stderr: -124> 2024-09-19T14:13:20.237+0000 7fe6effff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:13:20.387 INFO:tasks.workunit.client.0.smithi153.stderr: -123> 2024-09-19T14:13:20.237+0000 7fe81e889640 10 monclient: get_auth_request con 0x55f1f68c4a30 auth_method 0 2024-09-19T14:13:20.387 INFO:tasks.workunit.client.0.smithi153.stderr: -122> 2024-09-19T14:13:20.237+0000 7fe81d887640 10 monclient: get_auth_request con 0x7fe6e8071be0 auth_method 0 2024-09-19T14:13:20.387 INFO:tasks.workunit.client.0.smithi153.stderr: -121> 2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.387 INFO:tasks.workunit.client.0.smithi153.stderr: -120> 2024-09-19T14:13:20.237+0000 7fe8205829c0 20 realm 2024-09-19T14:13:20.387 INFO:tasks.workunit.client.0.smithi153.stderr: -119> 2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.387 INFO:tasks.workunit.client.0.smithi153.stderr: -118> 2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.387 INFO:tasks.workunit.client.0.smithi153.stderr: -117> 2024-09-19T14:13:20.237+0000 7fe8205829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:13:20.387 INFO:tasks.workunit.client.0.smithi153.stderr: -116> 2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.387 INFO:tasks.workunit.client.0.smithi153.stderr: -115> 2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.387 INFO:tasks.workunit.client.0.smithi153.stderr: -114> 2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.387 INFO:tasks.workunit.client.0.smithi153.stderr: -113> 2024-09-19T14:13:20.237+0000 7fe81e088640 10 monclient: get_auth_request con 0x55f1f68c8dd0 auth_method 0 2024-09-19T14:13:20.387 INFO:tasks.workunit.client.0.smithi153.stderr: -112> 2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:20.387 INFO:tasks.workunit.client.0.smithi153.stderr: -111> 2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.388 INFO:tasks.workunit.client.0.smithi153.stderr: -110> 2024-09-19T14:13:20.241+0000 7fe8205829c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:13:20.388 INFO:tasks.workunit.client.0.smithi153.stderr: -109> 2024-09-19T14:13:20.241+0000 7fe8205829c0 20 searching for the correct realm 2024-09-19T14:13:20.388 INFO:tasks.workunit.client.0.smithi153.stderr: -108> 2024-09-19T14:13:20.241+0000 7fe81d887640 10 monclient: get_auth_request con 0x55f1f68cdf60 auth_method 0 2024-09-19T14:13:20.388 INFO:tasks.workunit.client.0.smithi153.stderr: -107> 2024-09-19T14:13:20.241+0000 7fe81e889640 10 monclient: get_auth_request con 0x7fe8140f8b60 auth_method 0 2024-09-19T14:13:20.388 INFO:tasks.workunit.client.0.smithi153.stderr: -106> 2024-09-19T14:13:20.241+0000 7fe81e088640 10 monclient: get_auth_request con 0x7fe81801e040 auth_method 0 2024-09-19T14:13:20.388 INFO:tasks.workunit.client.0.smithi153.stderr: -105> 2024-09-19T14:13:20.241+0000 7fe81d887640 10 monclient: get_auth_request con 0x7fe81001d040 auth_method 0 2024-09-19T14:13:20.388 INFO:tasks.workunit.client.0.smithi153.stderr: -104> 2024-09-19T14:13:20.245+0000 7fe81e889640 0 -- 172.21.15.153:0/3493415984 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55f1f68c4a30 msgr2=0x55f1f68c6e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:13:20.388 INFO:tasks.workunit.client.0.smithi153.stderr: -103> 2024-09-19T14:13:20.245+0000 7fe6effff640 1 client.7787.objecter ms_handle_reset 0x55f1f68c4a30 session 0x55f1f6876e70 osd.1 2024-09-19T14:13:20.388 INFO:tasks.workunit.client.0.smithi153.stderr: -102> 2024-09-19T14:13:20.245+0000 7fe6effff640 10 monclient: _renew_subs 2024-09-19T14:13:20.388 INFO:tasks.workunit.client.0.smithi153.stderr: -101> 2024-09-19T14:13:20.245+0000 7fe6effff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:13:20.388 INFO:tasks.workunit.client.0.smithi153.stderr: -100> 2024-09-19T14:13:20.245+0000 7fe81e889640 10 monclient: get_auth_request con 0x7fe6e8082290 auth_method 0 2024-09-19T14:13:20.388 INFO:tasks.workunit.client.0.smithi153.stderr: -99> 2024-09-19T14:13:20.245+0000 7fe81e889640 10 monclient: get_auth_request con 0x7fe81412d3a0 auth_method 0 2024-09-19T14:13:20.388 INFO:tasks.workunit.client.0.smithi153.stderr: -98> 2024-09-19T14:13:20.249+0000 7fe81e088640 10 monclient: get_auth_request con 0x7fe8140fe480 auth_method 0 2024-09-19T14:13:20.388 INFO:tasks.workunit.client.0.smithi153.stderr: -97> 2024-09-19T14:13:20.253+0000 7fe81e088640 0 -- 172.21.15.153:0/3493415984 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fe8140fe480 msgr2=0x7fe8140f8260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:20.388 INFO:tasks.workunit.client.0.smithi153.stderr: -96> 2024-09-19T14:13:20.253+0000 7fe6effff640 1 client.7787.objecter ms_handle_reset 0x7fe8140fe480 session 0x7fe8140fe310 osd.0 2024-09-19T14:13:20.389 INFO:tasks.workunit.client.0.smithi153.stderr: -95> 2024-09-19T14:13:20.253+0000 7fe81e088640 10 monclient: get_auth_request con 0x55f1f68c4a30 auth_method 0 2024-09-19T14:13:20.389 INFO:tasks.workunit.client.0.smithi153.stderr: -94> 2024-09-19T14:13:20.257+0000 7fe8205829c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:13:20.389 INFO:tasks.workunit.client.0.smithi153.stderr: -93> 2024-09-19T14:13:20.257+0000 7fe8205829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:13:20.389 INFO:tasks.workunit.client.0.smithi153.stderr: -92> 2024-09-19T14:13:20.257+0000 7fe8205829c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:13:20.389 INFO:tasks.workunit.client.0.smithi153.stderr: -91> 2024-09-19T14:13:20.257+0000 7fe8205829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:13:20.389 INFO:tasks.workunit.client.0.smithi153.stderr: -90> 2024-09-19T14:13:20.257+0000 7fe8205829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:13:20.389 INFO:tasks.workunit.client.0.smithi153.stderr: -89> 2024-09-19T14:13:20.257+0000 7fe8205829c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:13:20.389 INFO:tasks.workunit.client.0.smithi153.stderr: -88> 2024-09-19T14:13:20.257+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.389 INFO:tasks.workunit.client.0.smithi153.stderr: -87> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.389 INFO:tasks.workunit.client.0.smithi153.stderr: -86> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.389 INFO:tasks.workunit.client.0.smithi153.stderr: -85> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:20.389 INFO:tasks.workunit.client.0.smithi153.stderr: -84> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.389 INFO:tasks.workunit.client.0.smithi153.stderr: -83> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:13:20.389 INFO:tasks.workunit.client.0.smithi153.stderr: -82> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 zone default found 2024-09-19T14:13:20.390 INFO:tasks.workunit.client.0.smithi153.stderr: -81> 2024-09-19T14:13:20.261+0000 7fe8205829c0 4 Realm: () 2024-09-19T14:13:20.390 INFO:tasks.workunit.client.0.smithi153.stderr: -80> 2024-09-19T14:13:20.261+0000 7fe8205829c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:13:20.390 INFO:tasks.workunit.client.0.smithi153.stderr: -79> 2024-09-19T14:13:20.261+0000 7fe8205829c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:13:20.390 INFO:tasks.workunit.client.0.smithi153.stderr: -78> 2024-09-19T14:13:20.261+0000 7fe8205829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:13:20.390 INFO:tasks.workunit.client.0.smithi153.stderr: -77> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 zonegroup default 2024-09-19T14:13:20.390 INFO:tasks.workunit.client.0.smithi153.stderr: -76> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.390 INFO:tasks.workunit.client.0.smithi153.stderr: -75> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.390 INFO:tasks.workunit.client.0.smithi153.stderr: -74> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.390 INFO:tasks.workunit.client.0.smithi153.stderr: -73> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.390 INFO:tasks.workunit.client.0.smithi153.stderr: -72> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.390 INFO:tasks.workunit.client.0.smithi153.stderr: -71> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.390 INFO:tasks.workunit.client.0.smithi153.stderr: -70> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 started sync module instance, tier type = 2024-09-19T14:13:20.390 INFO:tasks.workunit.client.0.smithi153.stderr: -69> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:13:20.391 INFO:tasks.workunit.client.0.smithi153.stderr: -68> 2024-09-19T14:13:20.277+0000 7fe8205829c0 20 add_watcher() i=0 2024-09-19T14:13:20.391 INFO:tasks.workunit.client.0.smithi153.stderr: -67> 2024-09-19T14:13:20.277+0000 7fe8205829c0 20 add_watcher() i=1 2024-09-19T14:13:20.391 INFO:tasks.workunit.client.0.smithi153.stderr: -66> 2024-09-19T14:13:20.277+0000 7fe8205829c0 20 add_watcher() i=2 2024-09-19T14:13:20.391 INFO:tasks.workunit.client.0.smithi153.stderr: -65> 2024-09-19T14:13:20.277+0000 7fe8205829c0 20 add_watcher() i=3 2024-09-19T14:13:20.391 INFO:tasks.workunit.client.0.smithi153.stderr: -64> 2024-09-19T14:13:20.277+0000 7fe8205829c0 20 add_watcher() i=4 2024-09-19T14:13:20.391 INFO:tasks.workunit.client.0.smithi153.stderr: -63> 2024-09-19T14:13:20.277+0000 7fe8205829c0 20 add_watcher() i=5 2024-09-19T14:13:20.391 INFO:tasks.workunit.client.0.smithi153.stderr: -62> 2024-09-19T14:13:20.277+0000 7fe8205829c0 20 add_watcher() i=6 2024-09-19T14:13:20.391 INFO:tasks.workunit.client.0.smithi153.stderr: -61> 2024-09-19T14:13:20.277+0000 7fe8205829c0 20 add_watcher() i=7 2024-09-19T14:13:20.391 INFO:tasks.workunit.client.0.smithi153.stderr: -60> 2024-09-19T14:13:20.277+0000 7fe8205829c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:13:20.391 INFO:tasks.workunit.client.0.smithi153.stderr: -59> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding auth protocol: cephx 2024-09-19T14:13:20.391 INFO:tasks.workunit.client.0.smithi153.stderr: -58> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding auth protocol: cephx 2024-09-19T14:13:20.391 INFO:tasks.workunit.client.0.smithi153.stderr: -57> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding auth protocol: cephx 2024-09-19T14:13:20.391 INFO:tasks.workunit.client.0.smithi153.stderr: -56> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding con mode: secure 2024-09-19T14:13:20.391 INFO:tasks.workunit.client.0.smithi153.stderr: -55> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding con mode: crc 2024-09-19T14:13:20.392 INFO:tasks.workunit.client.0.smithi153.stderr: -54> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding con mode: secure 2024-09-19T14:13:20.392 INFO:tasks.workunit.client.0.smithi153.stderr: -53> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding con mode: crc 2024-09-19T14:13:20.392 INFO:tasks.workunit.client.0.smithi153.stderr: -52> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding con mode: secure 2024-09-19T14:13:20.392 INFO:tasks.workunit.client.0.smithi153.stderr: -51> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding con mode: crc 2024-09-19T14:13:20.392 INFO:tasks.workunit.client.0.smithi153.stderr: -50> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding con mode: crc 2024-09-19T14:13:20.392 INFO:tasks.workunit.client.0.smithi153.stderr: -49> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding con mode: secure 2024-09-19T14:13:20.392 INFO:tasks.workunit.client.0.smithi153.stderr: -48> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding con mode: crc 2024-09-19T14:13:20.392 INFO:tasks.workunit.client.0.smithi153.stderr: -47> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding con mode: secure 2024-09-19T14:13:20.392 INFO:tasks.workunit.client.0.smithi153.stderr: -46> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding con mode: crc 2024-09-19T14:13:20.392 INFO:tasks.workunit.client.0.smithi153.stderr: -45> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding con mode: secure 2024-09-19T14:13:20.392 INFO:tasks.workunit.client.0.smithi153.stderr: -44> 2024-09-19T14:13:20.281+0000 7fe6d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:20.392 INFO:tasks.workunit.client.0.smithi153.stderr: -43> 2024-09-19T14:13:20.281+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.392 INFO:tasks.workunit.client.0.smithi153.stderr: -42> 2024-09-19T14:13:20.281+0000 7fe8205829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:13:20.392 INFO:tasks.workunit.client.0.smithi153.stderr: -41> 2024-09-19T14:13:20.281+0000 7fe8205829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:13:20.393 INFO:tasks.workunit.client.0.smithi153.stderr: -40> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command cache list hook 0x55f1f689c290 2024-09-19T14:13:20.393 INFO:tasks.workunit.client.0.smithi153.stderr: -39> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command cache inspect hook 0x55f1f689c290 2024-09-19T14:13:20.393 INFO:tasks.workunit.client.0.smithi153.stderr: -38> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command cache erase hook 0x55f1f689c290 2024-09-19T14:13:20.393 INFO:tasks.workunit.client.0.smithi153.stderr: -37> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command cache zap hook 0x55f1f689c290 2024-09-19T14:13:20.393 INFO:tasks.workunit.client.0.smithi153.stderr: -36> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 note: GC not initialized 2024-09-19T14:13:20.393 INFO:tasks.workunit.client.0.smithi153.stderr: -35> 2024-09-19T14:13:20.281+0000 7fe64f7fe640 20 reqs_thread_entry: start 2024-09-19T14:13:20.393 INFO:tasks.workunit.client.0.smithi153.stderr: -34> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command sync trace show hook 0x7fe8180026c0 2024-09-19T14:13:20.393 INFO:tasks.workunit.client.0.smithi153.stderr: -33> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command sync trace history hook 0x7fe8180026c0 2024-09-19T14:13:20.393 INFO:tasks.workunit.client.0.smithi153.stderr: -32> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command sync trace active hook 0x7fe8180026c0 2024-09-19T14:13:20.393 INFO:tasks.workunit.client.0.smithi153.stderr: -31> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command sync trace active_short hook 0x7fe8180026c0 2024-09-19T14:13:20.393 INFO:tasks.workunit.client.0.smithi153.stderr: -30> 2024-09-19T14:13:20.281+0000 7fe8205829c0 20 init_complete bucket index max shards: 11 2024-09-19T14:13:20.393 INFO:tasks.workunit.client.0.smithi153.stderr: -29> 2024-09-19T14:13:20.281+0000 7fe8205829c0 20 Filter name: none 2024-09-19T14:13:20.393 INFO:tasks.workunit.client.0.smithi153.stderr: -28> 2024-09-19T14:13:20.281+0000 7fe64d7fa640 20 reqs_thread_entry: start 2024-09-19T14:13:20.394 INFO:tasks.workunit.client.0.smithi153.stderr: -27> 2024-09-19T14:13:20.281+0000 7fe8205829c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:13:20.394 INFO:tasks.workunit.client.0.smithi153.stderr: -26> 2024-09-19T14:13:20.281+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.394 INFO:tasks.workunit.client.0.smithi153.stderr: -25> 2024-09-19T14:13:20.281+0000 7fe8205829c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:13:20.394 INFO:tasks.workunit.client.0.smithi153.stderr: -24> 2024-09-19T14:13:20.281+0000 7fe8205829c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:13:20.394 INFO:tasks.workunit.client.0.smithi153.stderr: -23> 2024-09-19T14:13:20.281+0000 7fe8205829c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:13:20.394 INFO:tasks.workunit.client.0.smithi153.stderr: -22> 2024-09-19T14:13:20.281+0000 7fe8205829c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : miss 2024-09-19T14:13:20.394 INFO:tasks.workunit.client.0.smithi153.stderr: -21> 2024-09-19T14:13:20.281+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.394 INFO:tasks.workunit.client.0.smithi153.stderr: -20> 2024-09-19T14:13:20.281+0000 7fe8205829c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-19T14:13:20.394 INFO:tasks.workunit.client.0.smithi153.stderr: -19> 2024-09-19T14:13:20.281+0000 7fe8205829c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:13:20.394 INFO:tasks.workunit.client.0.smithi153.stderr: -18> 2024-09-19T14:13:20.281+0000 7fe8205829c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:13:20.394 INFO:tasks.workunit.client.0.smithi153.stderr: -17> 2024-09-19T14:13:20.281+0000 7fe8205829c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:13:20.394 INFO:tasks.workunit.client.0.smithi153.stderr: -16> 2024-09-19T14:13:20.281+0000 7fe8205829c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:20.394 INFO:tasks.workunit.client.0.smithi153.stderr: -15> 2024-09-19T14:13:20.285+0000 7fe8205829c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:13:20.395 INFO:tasks.workunit.client.0.smithi153.stderr: -14> 2024-09-19T14:13:20.285+0000 7fe8205829c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T14:13:20.395 INFO:tasks.workunit.client.0.smithi153.stderr: -13> 2024-09-19T14:13:20.297+0000 7fe8205829c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:13:20.395 INFO:tasks.workunit.client.0.smithi153.stderr: -12> 2024-09-19T14:13:20.297+0000 7fe8205829c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:13:20.395 INFO:tasks.workunit.client.0.smithi153.stderr: -11> 2024-09-19T14:13:20.297+0000 7fe8205829c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:20.395 INFO:tasks.workunit.client.0.smithi153.stderr: -10> 2024-09-19T14:13:20.297+0000 7fe8205829c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17, ofs0, ns] 2024-09-19T14:13:20.395 INFO:tasks.workunit.client.0.smithi153.stderr: -9> 2024-09-19T14:13:20.301+0000 7fe701ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333529 cookie 94497711931696 notifier 7787 bl.length()=827 2024-09-19T14:13:20.395 INFO:tasks.workunit.client.0.smithi153.stderr: -8> 2024-09-19T14:13:20.301+0000 7fe701ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:13:20.395 INFO:tasks.workunit.client.0.smithi153.stderr: -7> 2024-09-19T14:13:20.301+0000 7fe701ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:13:20.395 INFO:tasks.workunit.client.0.smithi153.stderr: -6> 2024-09-19T14:13:20.301+0000 7fe701ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:20.395 INFO:tasks.workunit.client.0.smithi153.stderr: -5> 2024-09-19T14:13:20.301+0000 7fe8205829c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_sources= new_sources= 2024-09-19T14:13:20.395 INFO:tasks.workunit.client.0.smithi153.stderr: -4> 2024-09-19T14:13:20.301+0000 7fe8205829c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential sources added=[] removed=[] 2024-09-19T14:13:20.395 INFO:tasks.workunit.client.0.smithi153.stderr: -3> 2024-09-19T14:13:20.301+0000 7fe8205829c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_dests= new_dests= 2024-09-19T14:13:20.395 INFO:tasks.workunit.client.0.smithi153.stderr: -2> 2024-09-19T14:13:20.301+0000 7fe8205829c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential dests added=[] removed=[] 2024-09-19T14:13:20.395 INFO:tasks.workunit.client.0.smithi153.stderr: -1> 2024-09-19T14:13:20.317+0000 7fe8205829c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe8205829c0 time 2024-09-19T14:13:20.321472+0000 2024-09-19T14:13:20.396 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:13:20.396 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.396 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:13:20.396 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe823e5c2eb] 2024-09-19T14:13:20.396 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe823e5c49f] 2024-09-19T14:13:20.396 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f1f36be271] 2024-09-19T14:13:20.396 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f1f36ce14a] 2024-09-19T14:13:20.396 INFO:tasks.workunit.client.0.smithi153.stderr: 5: main() 2024-09-19T14:13:20.396 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe822cc2d90] 2024-09-19T14:13:20.396 INFO:tasks.workunit.client.0.smithi153.stderr: 7: __libc_start_main() 2024-09-19T14:13:20.396 INFO:tasks.workunit.client.0.smithi153.stderr: 8: _start() 2024-09-19T14:13:20.396 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.396 INFO:tasks.workunit.client.0.smithi153.stderr: 0> 2024-09-19T14:13:20.317+0000 7fe8205829c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:13:20.397 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7fe8205829c0 thread_name:radosgw-admin 2024-09-19T14:13:20.397 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.397 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:13:20.397 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe822cdb520] 2024-09-19T14:13:20.397 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:13:20.397 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:13:20.397 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:13:20.397 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe823e5c345] 2024-09-19T14:13:20.397 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe823e5c49f] 2024-09-19T14:13:20.397 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f1f36be271] 2024-09-19T14:13:20.397 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f1f36ce14a] 2024-09-19T14:13:20.397 INFO:tasks.workunit.client.0.smithi153.stderr: 9: main() 2024-09-19T14:13:20.397 INFO:tasks.workunit.client.0.smithi153.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe822cc2d90] 2024-09-19T14:13:20.397 INFO:tasks.workunit.client.0.smithi153.stderr: 11: __libc_start_main() 2024-09-19T14:13:20.398 INFO:tasks.workunit.client.0.smithi153.stderr: 12: _start() 2024-09-19T14:13:20.398 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:13:20.398 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.398 INFO:tasks.workunit.client.0.smithi153.stderr:--- logging levels --- 2024-09-19T14:13:20.398 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 none 2024-09-19T14:13:20.398 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 lockdep 2024-09-19T14:13:20.398 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 context 2024-09-19T14:13:20.398 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 crush 2024-09-19T14:13:20.398 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds 2024-09-19T14:13:20.398 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_balancer 2024-09-19T14:13:20.398 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_locker 2024-09-19T14:13:20.398 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log 2024-09-19T14:13:20.398 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log_expire 2024-09-19T14:13:20.398 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_migrator 2024-09-19T14:13:20.398 INFO:tasks.workunit.client.0.smithi153.stderr: 3/ 5 mds_quiesce 2024-09-19T14:13:20.398 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 buffer 2024-09-19T14:13:20.399 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 timer 2024-09-19T14:13:20.399 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 filer 2024-09-19T14:13:20.399 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 striper 2024-09-19T14:13:20.399 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 objecter 2024-09-19T14:13:20.399 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rados 2024-09-19T14:13:20.399 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd 2024-09-19T14:13:20.399 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_mirror 2024-09-19T14:13:20.399 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_replay 2024-09-19T14:13:20.399 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_pwl 2024-09-19T14:13:20.399 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 journaler 2024-09-19T14:13:20.399 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objectcacher 2024-09-19T14:13:20.399 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:13:20.399 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 client 2024-09-19T14:13:20.399 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 osd 2024-09-19T14:13:20.400 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 optracker 2024-09-19T14:13:20.400 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objclass 2024-09-19T14:13:20.400 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 filestore 2024-09-19T14:13:20.400 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 journal 2024-09-19T14:13:20.400 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 ms 2024-09-19T14:13:20.400 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mon 2024-09-19T14:13:20.400 INFO:tasks.workunit.client.0.smithi153.stderr: 0/10 monc 2024-09-19T14:13:20.400 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 paxos 2024-09-19T14:13:20.400 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 tp 2024-09-19T14:13:20.400 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 auth 2024-09-19T14:13:20.400 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 crypto 2024-09-19T14:13:20.400 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 finisher 2024-09-19T14:13:20.400 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 reserver 2024-09-19T14:13:20.400 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 heartbeatmap 2024-09-19T14:13:20.401 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 perfcounter 2024-09-19T14:13:20.401 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw 2024-09-19T14:13:20.401 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_sync 2024-09-19T14:13:20.401 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_datacache 2024-09-19T14:13:20.401 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_access 2024-09-19T14:13:20.401 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:13:20.401 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_flight 2024-09-19T14:13:20.401 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:13:20.401 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw_notification 2024-09-19T14:13:20.401 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 javaclient 2024-09-19T14:13:20.401 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 asok 2024-09-19T14:13:20.401 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 throttle 2024-09-19T14:13:20.401 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 refs 2024-09-19T14:13:20.401 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 compressor 2024-09-19T14:13:20.402 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluestore 2024-09-19T14:13:20.402 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluefs 2024-09-19T14:13:20.402 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 bdev 2024-09-19T14:13:20.402 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 kstore 2024-09-19T14:13:20.402 INFO:tasks.workunit.client.0.smithi153.stderr: 4/ 5 rocksdb 2024-09-19T14:13:20.402 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 fuse 2024-09-19T14:13:20.402 INFO:tasks.workunit.client.0.smithi153.stderr: 2/ 5 mgr 2024-09-19T14:13:20.402 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mgrc 2024-09-19T14:13:20.402 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 dpdk 2024-09-19T14:13:20.402 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 eventtrace 2024-09-19T14:13:20.402 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 prioritycache 2024-09-19T14:13:20.402 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 test 2024-09-19T14:13:20.402 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:13:20.402 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephsqlite 2024-09-19T14:13:20.402 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:13:20.403 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore 2024-09-19T14:13:20.403 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_onode 2024-09-19T14:13:20.403 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_odata 2024-09-19T14:13:20.403 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_omap 2024-09-19T14:13:20.403 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_tm 2024-09-19T14:13:20.403 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_t 2024-09-19T14:13:20.403 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:13:20.403 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_epm 2024-09-19T14:13:20.403 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_lba 2024-09-19T14:13:20.403 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:13:20.403 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cache 2024-09-19T14:13:20.403 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_journal 2024-09-19T14:13:20.403 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_device 2024-09-19T14:13:20.403 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_backref 2024-09-19T14:13:20.403 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 alienstore 2024-09-19T14:13:20.404 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mclock 2024-09-19T14:13:20.404 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cyanstore 2024-09-19T14:13:20.404 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 ceph_exporter 2024-09-19T14:13:20.404 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 memstore 2024-09-19T14:13:20.404 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 trace 2024-09-19T14:13:20.404 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 ceph_dedup 2024-09-19T14:13:20.404 INFO:tasks.workunit.client.0.smithi153.stderr: -2/-2 (syslog threshold) 2024-09-19T14:13:20.404 INFO:tasks.workunit.client.0.smithi153.stderr: 99/99 (stderr threshold) 2024-09-19T14:13:20.404 INFO:tasks.workunit.client.0.smithi153.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:13:20.404 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe64d7fa640 / http_manager 2024-09-19T14:13:20.404 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe64f7fe640 / http_manager 2024-09-19T14:13:20.404 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe6d4fe1640 / rgw_dt_lg_renew 2024-09-19T14:13:20.404 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe6effff640 / ms_dispatch 2024-09-19T14:13:20.404 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe701ffb640 / io_context_pool 2024-09-19T14:13:20.405 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe703fff640 / ms_dispatch 2024-09-19T14:13:20.405 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe70ae05640 / ms_dispatch 2024-09-19T14:13:20.405 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe70c608640 / io_context_pool 2024-09-19T14:13:20.405 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe81d887640 / msgr-worker-2 2024-09-19T14:13:20.405 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe81e088640 / msgr-worker-1 2024-09-19T14:13:20.405 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe81e889640 / msgr-worker-0 2024-09-19T14:13:20.405 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe81f08a640 / io_context_pool 2024-09-19T14:13:20.405 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe8205829c0 / radosgw-admin 2024-09-19T14:13:20.405 INFO:tasks.workunit.client.0.smithi153.stderr: max_recent 500 2024-09-19T14:13:20.405 INFO:tasks.workunit.client.0.smithi153.stderr: max_new 1000 2024-09-19T14:13:20.405 INFO:tasks.workunit.client.0.smithi153.stderr: log_file /var/log/ceph/ceph-client.admin.146466.log 2024-09-19T14:13:20.405 INFO:tasks.workunit.client.0.smithi153.stderr:--- end dump of recent events --- 2024-09-19T14:13:20.405 INFO:tasks.workunit.client.0.smithi153.stderr:--- begin dump of recent events --- 2024-09-19T14:13:20.405 INFO:tasks.workunit.client.0.smithi153.stderr: -499> 2024-09-19T14:13:20.213+0000 7fe81e889640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:13:20.406 INFO:tasks.workunit.client.0.smithi153.stderr: -498> 2024-09-19T14:13:20.213+0000 7fe81e889640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:13:20.406 INFO:tasks.workunit.client.0.smithi153.stderr: -497> 2024-09-19T14:13:20.213+0000 7fe81e889640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:13:20.406 INFO:tasks.workunit.client.0.smithi153.stderr: -496> 2024-09-19T14:13:20.213+0000 7fe81d887640 10 monclient(hunting): handle_auth_done global_id 7775 payload 274 2024-09-19T14:13:20.406 INFO:tasks.workunit.client.0.smithi153.stderr: -495> 2024-09-19T14:13:20.213+0000 7fe81d887640 10 monclient: _finish_hunting 0 2024-09-19T14:13:20.406 INFO:tasks.workunit.client.0.smithi153.stderr: -494> 2024-09-19T14:13:20.213+0000 7fe81d887640 1 monclient: found mon.noname-c 2024-09-19T14:13:20.406 INFO:tasks.workunit.client.0.smithi153.stderr: -493> 2024-09-19T14:13:20.213+0000 7fe81d887640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:13:20.406 INFO:tasks.workunit.client.0.smithi153.stderr: -492> 2024-09-19T14:13:20.213+0000 7fe70c608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:13:20.406 INFO:tasks.workunit.client.0.smithi153.stderr: -491> 2024-09-19T14:13:20.213+0000 7fe70c608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:13:20.406 INFO:tasks.workunit.client.0.smithi153.stderr: -490> 2024-09-19T14:13:20.213+0000 7fe70c608640 10 monclient: dump: 2024-09-19T14:13:20.406 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:13:20.406 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:13:20.406 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.406 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.406 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:13:20.406 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.407 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:13:20.407 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:13:20.407 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:13:20.407 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.407 INFO:tasks.workunit.client.0.smithi153.stderr: -489> 2024-09-19T14:13:20.213+0000 7fe70c608640 10 monclient: _finish_auth 0 2024-09-19T14:13:20.407 INFO:tasks.workunit.client.0.smithi153.stderr: -488> 2024-09-19T14:13:20.213+0000 7fe70c608640 10 monclient: _check_auth_tickets 2024-09-19T14:13:20.407 INFO:tasks.workunit.client.0.smithi153.stderr: -487> 2024-09-19T14:13:20.213+0000 7fe70c608640 10 monclient: handle_config config(0 keys) 2024-09-19T14:13:20.407 INFO:tasks.workunit.client.0.smithi153.stderr: -486> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 monclient: authenticate success, global_id 7775 2024-09-19T14:13:20.407 INFO:tasks.workunit.client.0.smithi153.stderr: -485> 2024-09-19T14:13:20.213+0000 7fe8205829c0 10 monclient: get_monmap_and_config success 2024-09-19T14:13:20.407 INFO:tasks.workunit.client.0.smithi153.stderr: -484> 2024-09-19T14:13:20.213+0000 7fe70c608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:13:20.407 INFO:tasks.workunit.client.0.smithi153.stderr: -483> 2024-09-19T14:13:20.213+0000 7fe8205829c0 4 set_mon_vals no callback set 2024-09-19T14:13:20.407 INFO:tasks.workunit.client.0.smithi153.stderr: -482> 2024-09-19T14:13:20.213+0000 7fe70c608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:13:20.407 INFO:tasks.workunit.client.0.smithi153.stderr: -481> 2024-09-19T14:13:20.213+0000 7fe70c608640 10 monclient: dump: 2024-09-19T14:13:20.407 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:13:20.408 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:13:20.408 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.408 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.408 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:13:20.408 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.408 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:13:20.408 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:13:20.408 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:13:20.408 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.408 INFO:tasks.workunit.client.0.smithi153.stderr: -480> 2024-09-19T14:13:20.213+0000 7fe8205829c0 10 monclient: shutdown 2024-09-19T14:13:20.408 INFO:tasks.workunit.client.0.smithi153.stderr: -479> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) unregister_commands rotate-key 2024-09-19T14:13:20.408 INFO:tasks.workunit.client.0.smithi153.stderr: -478> 2024-09-19T14:13:20.213+0000 7fe8205829c0 10 monclient: build_initial_monmap 2024-09-19T14:13:20.408 INFO:tasks.workunit.client.0.smithi153.stderr: -477> 2024-09-19T14:13:20.213+0000 7fe8205829c0 1 build_initial for_mkfs: 0 2024-09-19T14:13:20.408 INFO:tasks.workunit.client.0.smithi153.stderr: -476> 2024-09-19T14:13:20.213+0000 7fe8205829c0 10 monclient: monmap: 2024-09-19T14:13:20.408 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:13:20.409 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:13:20.409 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:13:20.409 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:13:20.409 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:13:20.409 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.409 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:13:20.409 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:13:20.409 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:13:20.409 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.409 INFO:tasks.workunit.client.0.smithi153.stderr: -475> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding auth protocol: cephx 2024-09-19T14:13:20.409 INFO:tasks.workunit.client.0.smithi153.stderr: -474> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding auth protocol: cephx 2024-09-19T14:13:20.409 INFO:tasks.workunit.client.0.smithi153.stderr: -473> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding auth protocol: cephx 2024-09-19T14:13:20.409 INFO:tasks.workunit.client.0.smithi153.stderr: -472> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding con mode: secure 2024-09-19T14:13:20.410 INFO:tasks.workunit.client.0.smithi153.stderr: -471> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding con mode: crc 2024-09-19T14:13:20.410 INFO:tasks.workunit.client.0.smithi153.stderr: -470> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding con mode: secure 2024-09-19T14:13:20.410 INFO:tasks.workunit.client.0.smithi153.stderr: -469> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding con mode: crc 2024-09-19T14:13:20.410 INFO:tasks.workunit.client.0.smithi153.stderr: -468> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding con mode: secure 2024-09-19T14:13:20.410 INFO:tasks.workunit.client.0.smithi153.stderr: -467> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding con mode: crc 2024-09-19T14:13:20.410 INFO:tasks.workunit.client.0.smithi153.stderr: -466> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding con mode: crc 2024-09-19T14:13:20.410 INFO:tasks.workunit.client.0.smithi153.stderr: -465> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding con mode: secure 2024-09-19T14:13:20.410 INFO:tasks.workunit.client.0.smithi153.stderr: -464> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding con mode: crc 2024-09-19T14:13:20.410 INFO:tasks.workunit.client.0.smithi153.stderr: -463> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding con mode: secure 2024-09-19T14:13:20.410 INFO:tasks.workunit.client.0.smithi153.stderr: -462> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding con mode: crc 2024-09-19T14:13:20.410 INFO:tasks.workunit.client.0.smithi153.stderr: -461> 2024-09-19T14:13:20.213+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67df500) adding con mode: secure 2024-09-19T14:13:20.410 INFO:tasks.workunit.client.0.smithi153.stderr: -460> 2024-09-19T14:13:20.217+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.411 INFO:tasks.workunit.client.0.smithi153.stderr: -459> 2024-09-19T14:13:20.217+0000 7fe8205829c0 1 librados: starting msgr at 2024-09-19T14:13:20.411 INFO:tasks.workunit.client.0.smithi153.stderr: -458> 2024-09-19T14:13:20.217+0000 7fe8205829c0 1 librados: starting objecter 2024-09-19T14:13:20.411 INFO:tasks.workunit.client.0.smithi153.stderr: -457> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command objecter_requests hook 0x55f1f6723990 2024-09-19T14:13:20.411 INFO:tasks.workunit.client.0.smithi153.stderr: -456> 2024-09-19T14:13:20.217+0000 7fe8205829c0 1 librados: setting wanted keys 2024-09-19T14:13:20.411 INFO:tasks.workunit.client.0.smithi153.stderr: -455> 2024-09-19T14:13:20.217+0000 7fe8205829c0 1 librados: calling monclient init 2024-09-19T14:13:20.411 INFO:tasks.workunit.client.0.smithi153.stderr: -454> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient: init 2024-09-19T14:13:20.411 INFO:tasks.workunit.client.0.smithi153.stderr: -453> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding auth protocol: cephx 2024-09-19T14:13:20.411 INFO:tasks.workunit.client.0.smithi153.stderr: -452> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding auth protocol: cephx 2024-09-19T14:13:20.411 INFO:tasks.workunit.client.0.smithi153.stderr: -451> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding auth protocol: cephx 2024-09-19T14:13:20.411 INFO:tasks.workunit.client.0.smithi153.stderr: -450> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding con mode: secure 2024-09-19T14:13:20.411 INFO:tasks.workunit.client.0.smithi153.stderr: -449> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding con mode: crc 2024-09-19T14:13:20.411 INFO:tasks.workunit.client.0.smithi153.stderr: -448> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding con mode: secure 2024-09-19T14:13:20.411 INFO:tasks.workunit.client.0.smithi153.stderr: -447> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding con mode: crc 2024-09-19T14:13:20.411 INFO:tasks.workunit.client.0.smithi153.stderr: -446> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding con mode: secure 2024-09-19T14:13:20.411 INFO:tasks.workunit.client.0.smithi153.stderr: -445> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding con mode: crc 2024-09-19T14:13:20.412 INFO:tasks.workunit.client.0.smithi153.stderr: -444> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding con mode: crc 2024-09-19T14:13:20.412 INFO:tasks.workunit.client.0.smithi153.stderr: -443> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding con mode: secure 2024-09-19T14:13:20.412 INFO:tasks.workunit.client.0.smithi153.stderr: -442> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding con mode: crc 2024-09-19T14:13:20.412 INFO:tasks.workunit.client.0.smithi153.stderr: -441> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding con mode: secure 2024-09-19T14:13:20.412 INFO:tasks.workunit.client.0.smithi153.stderr: -440> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding con mode: crc 2024-09-19T14:13:20.412 INFO:tasks.workunit.client.0.smithi153.stderr: -439> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 AuthRegistry(0x55f1f67d9ec0) adding con mode: secure 2024-09-19T14:13:20.412 INFO:tasks.workunit.client.0.smithi153.stderr: -438> 2024-09-19T14:13:20.217+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.412 INFO:tasks.workunit.client.0.smithi153.stderr: -437> 2024-09-19T14:13:20.217+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.412 INFO:tasks.workunit.client.0.smithi153.stderr: -436> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command rotate-key hook 0x55f1f67da008 2024-09-19T14:13:20.412 INFO:tasks.workunit.client.0.smithi153.stderr: -435> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient: _reopen_session rank -1 2024-09-19T14:13:20.412 INFO:tasks.workunit.client.0.smithi153.stderr: -434> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-19T14:13:20.412 INFO:tasks.workunit.client.0.smithi153.stderr: -433> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient(hunting): picked mon.noname-a con 0x55f1f6689be0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:13:20.412 INFO:tasks.workunit.client.0.smithi153.stderr: -432> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient(hunting): picked mon.noname-c con 0x55f1f66952e0 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:13:20.412 INFO:tasks.workunit.client.0.smithi153.stderr: -431> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient(hunting): picked mon.noname-b con 0x55f1f67dde50 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:13:20.413 INFO:tasks.workunit.client.0.smithi153.stderr: -430> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:13:20.413 INFO:tasks.workunit.client.0.smithi153.stderr: -429> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:13:20.413 INFO:tasks.workunit.client.0.smithi153.stderr: -428> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:13:20.413 INFO:tasks.workunit.client.0.smithi153.stderr: -427> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient(hunting): _renew_subs 2024-09-19T14:13:20.413 INFO:tasks.workunit.client.0.smithi153.stderr: -426> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient(hunting): authenticate will time out at 2988.680895s 2024-09-19T14:13:20.413 INFO:tasks.workunit.client.0.smithi153.stderr: -425> 2024-09-19T14:13:20.217+0000 7fe81d887640 10 monclient(hunting): get_auth_request con 0x55f1f66952e0 auth_method 0 2024-09-19T14:13:20.413 INFO:tasks.workunit.client.0.smithi153.stderr: -424> 2024-09-19T14:13:20.217+0000 7fe81d887640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:13:20.413 INFO:tasks.workunit.client.0.smithi153.stderr: -423> 2024-09-19T14:13:20.217+0000 7fe81d887640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:13:20.413 INFO:tasks.workunit.client.0.smithi153.stderr: -422> 2024-09-19T14:13:20.217+0000 7fe81d887640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:13:20.413 INFO:tasks.workunit.client.0.smithi153.stderr: -421> 2024-09-19T14:13:20.217+0000 7fe81e088640 10 monclient(hunting): get_auth_request con 0x55f1f6689be0 auth_method 0 2024-09-19T14:13:20.413 INFO:tasks.workunit.client.0.smithi153.stderr: -420> 2024-09-19T14:13:20.217+0000 7fe81e088640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:13:20.413 INFO:tasks.workunit.client.0.smithi153.stderr: -419> 2024-09-19T14:13:20.217+0000 7fe81e088640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:13:20.413 INFO:tasks.workunit.client.0.smithi153.stderr: -418> 2024-09-19T14:13:20.217+0000 7fe81e088640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:13:20.414 INFO:tasks.workunit.client.0.smithi153.stderr: -417> 2024-09-19T14:13:20.217+0000 7fe81d887640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:13:20.414 INFO:tasks.workunit.client.0.smithi153.stderr: -416> 2024-09-19T14:13:20.217+0000 7fe81d887640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:13:20.414 INFO:tasks.workunit.client.0.smithi153.stderr: -415> 2024-09-19T14:13:20.217+0000 7fe81d887640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:13:20.414 INFO:tasks.workunit.client.0.smithi153.stderr: -414> 2024-09-19T14:13:20.217+0000 7fe81e088640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:13:20.414 INFO:tasks.workunit.client.0.smithi153.stderr: -413> 2024-09-19T14:13:20.217+0000 7fe81e088640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:13:20.414 INFO:tasks.workunit.client.0.smithi153.stderr: -412> 2024-09-19T14:13:20.217+0000 7fe81e088640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:13:20.414 INFO:tasks.workunit.client.0.smithi153.stderr: -411> 2024-09-19T14:13:20.217+0000 7fe81d887640 10 monclient(hunting): handle_auth_done global_id 7778 payload 824 2024-09-19T14:13:20.414 INFO:tasks.workunit.client.0.smithi153.stderr: -410> 2024-09-19T14:13:20.217+0000 7fe81d887640 10 monclient: _finish_hunting 0 2024-09-19T14:13:20.414 INFO:tasks.workunit.client.0.smithi153.stderr: -409> 2024-09-19T14:13:20.217+0000 7fe81d887640 1 monclient: found mon.noname-c 2024-09-19T14:13:20.414 INFO:tasks.workunit.client.0.smithi153.stderr: -408> 2024-09-19T14:13:20.217+0000 7fe81d887640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:13:20.414 INFO:tasks.workunit.client.0.smithi153.stderr: -407> 2024-09-19T14:13:20.217+0000 7fe70ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:13:20.414 INFO:tasks.workunit.client.0.smithi153.stderr: -406> 2024-09-19T14:13:20.217+0000 7fe70ae05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:13:20.414 INFO:tasks.workunit.client.0.smithi153.stderr: -405> 2024-09-19T14:13:20.217+0000 7fe70ae05640 10 monclient: dump: 2024-09-19T14:13:20.415 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:13:20.415 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:13:20.415 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.415 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.415 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:13:20.415 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.415 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:13:20.415 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:13:20.415 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:13:20.415 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.415 INFO:tasks.workunit.client.0.smithi153.stderr: -404> 2024-09-19T14:13:20.217+0000 7fe70ae05640 10 monclient: _finish_auth 0 2024-09-19T14:13:20.415 INFO:tasks.workunit.client.0.smithi153.stderr: -403> 2024-09-19T14:13:20.217+0000 7fe70ae05640 10 monclient: _check_auth_tickets 2024-09-19T14:13:20.415 INFO:tasks.workunit.client.0.smithi153.stderr: -402> 2024-09-19T14:13:20.217+0000 7fe70ae05640 10 monclient: handle_config config(0 keys) 2024-09-19T14:13:20.416 INFO:tasks.workunit.client.0.smithi153.stderr: -401> 2024-09-19T14:13:20.217+0000 7fe70ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:13:20.416 INFO:tasks.workunit.client.0.smithi153.stderr: -400> 2024-09-19T14:13:20.217+0000 7fe70ae05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:13:20.416 INFO:tasks.workunit.client.0.smithi153.stderr: -399> 2024-09-19T14:13:20.217+0000 7fe70ae05640 10 monclient: dump: 2024-09-19T14:13:20.416 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:13:20.416 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:13:20.416 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.416 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.416 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:13:20.416 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.416 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:13:20.416 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:13:20.416 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:13:20.417 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.417 INFO:tasks.workunit.client.0.smithi153.stderr: -398> 2024-09-19T14:13:20.217+0000 7fe8205829c0 5 monclient: authenticate success, global_id 7778 2024-09-19T14:13:20.417 INFO:tasks.workunit.client.0.smithi153.stderr: -397> 2024-09-19T14:13:20.217+0000 7fe70c608640 4 set_mon_vals no callback set 2024-09-19T14:13:20.417 INFO:tasks.workunit.client.0.smithi153.stderr: -396> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient: _renew_subs 2024-09-19T14:13:20.417 INFO:tasks.workunit.client.0.smithi153.stderr: -395> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:13:20.417 INFO:tasks.workunit.client.0.smithi153.stderr: -394> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient: _renew_subs 2024-09-19T14:13:20.417 INFO:tasks.workunit.client.0.smithi153.stderr: -393> 2024-09-19T14:13:20.217+0000 7fe8205829c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:13:20.417 INFO:tasks.workunit.client.0.smithi153.stderr: -392> 2024-09-19T14:13:20.217+0000 7fe8205829c0 1 librados: init done 2024-09-19T14:13:20.417 INFO:tasks.workunit.client.0.smithi153.stderr: -391> 2024-09-19T14:13:20.217+0000 7fe70ae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:13:20.417 INFO:tasks.workunit.client.0.smithi153.stderr: -390> 2024-09-19T14:13:20.217+0000 7fe70ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:13:20.417 INFO:tasks.workunit.client.0.smithi153.stderr: -389> 2024-09-19T14:13:20.217+0000 7fe70ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:13:20.417 INFO:tasks.workunit.client.0.smithi153.stderr: -388> 2024-09-19T14:13:20.221+0000 7fe81e088640 10 monclient: get_auth_request con 0x7fe704071c10 auth_method 0 2024-09-19T14:13:20.417 INFO:tasks.workunit.client.0.smithi153.stderr: -387> 2024-09-19T14:13:20.221+0000 7fe81e889640 10 monclient: get_auth_request con 0x55f1f6806710 auth_method 0 2024-09-19T14:13:20.418 INFO:tasks.workunit.client.0.smithi153.stderr: -386> 2024-09-19T14:13:20.221+0000 7fe81e088640 10 monclient: get_auth_request con 0x55f1f6826130 auth_method 0 2024-09-19T14:13:20.418 INFO:tasks.workunit.client.0.smithi153.stderr: -385> 2024-09-19T14:13:20.225+0000 7fe81d887640 10 monclient: get_auth_request con 0x55f1f68299c0 auth_method 0 2024-09-19T14:13:20.418 INFO:tasks.workunit.client.0.smithi153.stderr: -384> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient: build_initial_monmap 2024-09-19T14:13:20.418 INFO:tasks.workunit.client.0.smithi153.stderr: -383> 2024-09-19T14:13:20.225+0000 7fe8205829c0 1 build_initial for_mkfs: 0 2024-09-19T14:13:20.418 INFO:tasks.workunit.client.0.smithi153.stderr: -382> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient: monmap: 2024-09-19T14:13:20.418 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:13:20.418 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:13:20.418 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:13:20.418 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:13:20.418 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:13:20.418 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.418 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:13:20.418 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:13:20.418 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:13:20.419 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.419 INFO:tasks.workunit.client.0.smithi153.stderr: -381> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding auth protocol: cephx 2024-09-19T14:13:20.419 INFO:tasks.workunit.client.0.smithi153.stderr: -380> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding auth protocol: cephx 2024-09-19T14:13:20.419 INFO:tasks.workunit.client.0.smithi153.stderr: -379> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding auth protocol: cephx 2024-09-19T14:13:20.419 INFO:tasks.workunit.client.0.smithi153.stderr: -378> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding con mode: secure 2024-09-19T14:13:20.419 INFO:tasks.workunit.client.0.smithi153.stderr: -377> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding con mode: crc 2024-09-19T14:13:20.419 INFO:tasks.workunit.client.0.smithi153.stderr: -376> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding con mode: secure 2024-09-19T14:13:20.419 INFO:tasks.workunit.client.0.smithi153.stderr: -375> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding con mode: crc 2024-09-19T14:13:20.419 INFO:tasks.workunit.client.0.smithi153.stderr: -374> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding con mode: secure 2024-09-19T14:13:20.419 INFO:tasks.workunit.client.0.smithi153.stderr: -373> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding con mode: crc 2024-09-19T14:13:20.419 INFO:tasks.workunit.client.0.smithi153.stderr: -372> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding con mode: crc 2024-09-19T14:13:20.419 INFO:tasks.workunit.client.0.smithi153.stderr: -371> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding con mode: secure 2024-09-19T14:13:20.419 INFO:tasks.workunit.client.0.smithi153.stderr: -370> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding con mode: crc 2024-09-19T14:13:20.419 INFO:tasks.workunit.client.0.smithi153.stderr: -369> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding con mode: secure 2024-09-19T14:13:20.420 INFO:tasks.workunit.client.0.smithi153.stderr: -368> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding con mode: crc 2024-09-19T14:13:20.420 INFO:tasks.workunit.client.0.smithi153.stderr: -367> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682f1e0) adding con mode: secure 2024-09-19T14:13:20.420 INFO:tasks.workunit.client.0.smithi153.stderr: -366> 2024-09-19T14:13:20.225+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.420 INFO:tasks.workunit.client.0.smithi153.stderr: -365> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command objecter_requests cmddesc objecter_requests hook 0x55f1f6832c50 EEXIST 2024-09-19T14:13:20.420 INFO:tasks.workunit.client.0.smithi153.stderr: -364> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient: init 2024-09-19T14:13:20.420 INFO:tasks.workunit.client.0.smithi153.stderr: -363> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding auth protocol: cephx 2024-09-19T14:13:20.420 INFO:tasks.workunit.client.0.smithi153.stderr: -362> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding auth protocol: cephx 2024-09-19T14:13:20.420 INFO:tasks.workunit.client.0.smithi153.stderr: -361> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding auth protocol: cephx 2024-09-19T14:13:20.420 INFO:tasks.workunit.client.0.smithi153.stderr: -360> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding con mode: secure 2024-09-19T14:13:20.420 INFO:tasks.workunit.client.0.smithi153.stderr: -359> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding con mode: crc 2024-09-19T14:13:20.420 INFO:tasks.workunit.client.0.smithi153.stderr: -358> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding con mode: secure 2024-09-19T14:13:20.420 INFO:tasks.workunit.client.0.smithi153.stderr: -357> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding con mode: crc 2024-09-19T14:13:20.420 INFO:tasks.workunit.client.0.smithi153.stderr: -356> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding con mode: secure 2024-09-19T14:13:20.421 INFO:tasks.workunit.client.0.smithi153.stderr: -355> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding con mode: crc 2024-09-19T14:13:20.421 INFO:tasks.workunit.client.0.smithi153.stderr: -354> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding con mode: crc 2024-09-19T14:13:20.421 INFO:tasks.workunit.client.0.smithi153.stderr: -353> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding con mode: secure 2024-09-19T14:13:20.421 INFO:tasks.workunit.client.0.smithi153.stderr: -352> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding con mode: crc 2024-09-19T14:13:20.421 INFO:tasks.workunit.client.0.smithi153.stderr: -351> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding con mode: secure 2024-09-19T14:13:20.421 INFO:tasks.workunit.client.0.smithi153.stderr: -350> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding con mode: crc 2024-09-19T14:13:20.421 INFO:tasks.workunit.client.0.smithi153.stderr: -349> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 AuthRegistry(0x55f1f682e238) adding con mode: secure 2024-09-19T14:13:20.421 INFO:tasks.workunit.client.0.smithi153.stderr: -348> 2024-09-19T14:13:20.225+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.421 INFO:tasks.workunit.client.0.smithi153.stderr: -347> 2024-09-19T14:13:20.225+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.421 INFO:tasks.workunit.client.0.smithi153.stderr: -346> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command rotate-key cmddesc rotate-key hook 0x55f1f682e380 EEXIST 2024-09-19T14:13:20.421 INFO:tasks.workunit.client.0.smithi153.stderr: -345> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient: _reopen_session rank -1 2024-09-19T14:13:20.421 INFO:tasks.workunit.client.0.smithi153.stderr: -344> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T14:13:20.421 INFO:tasks.workunit.client.0.smithi153.stderr: -343> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient(hunting): picked mon.noname-a con 0x55f1f6856e00 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:13:20.422 INFO:tasks.workunit.client.0.smithi153.stderr: -342> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient(hunting): picked mon.noname-b con 0x55f1f6856730 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:13:20.422 INFO:tasks.workunit.client.0.smithi153.stderr: -341> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient(hunting): picked mon.noname-c con 0x55f1f6855110 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:13:20.422 INFO:tasks.workunit.client.0.smithi153.stderr: -340> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:13:20.422 INFO:tasks.workunit.client.0.smithi153.stderr: -339> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:13:20.422 INFO:tasks.workunit.client.0.smithi153.stderr: -338> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:13:20.422 INFO:tasks.workunit.client.0.smithi153.stderr: -337> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient(hunting): _renew_subs 2024-09-19T14:13:20.422 INFO:tasks.workunit.client.0.smithi153.stderr: -336> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient(hunting): authenticate will time out at 2988.690941s 2024-09-19T14:13:20.422 INFO:tasks.workunit.client.0.smithi153.stderr: -335> 2024-09-19T14:13:20.225+0000 7fe81e088640 10 monclient(hunting): get_auth_request con 0x55f1f6856e00 auth_method 0 2024-09-19T14:13:20.422 INFO:tasks.workunit.client.0.smithi153.stderr: -334> 2024-09-19T14:13:20.225+0000 7fe81e088640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:13:20.422 INFO:tasks.workunit.client.0.smithi153.stderr: -333> 2024-09-19T14:13:20.225+0000 7fe81e088640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:13:20.422 INFO:tasks.workunit.client.0.smithi153.stderr: -332> 2024-09-19T14:13:20.225+0000 7fe81e088640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:13:20.422 INFO:tasks.workunit.client.0.smithi153.stderr: -331> 2024-09-19T14:13:20.225+0000 7fe81e889640 10 monclient(hunting): get_auth_request con 0x55f1f6855110 auth_method 0 2024-09-19T14:13:20.422 INFO:tasks.workunit.client.0.smithi153.stderr: -330> 2024-09-19T14:13:20.225+0000 7fe81e889640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:13:20.422 INFO:tasks.workunit.client.0.smithi153.stderr: -329> 2024-09-19T14:13:20.225+0000 7fe81e889640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:13:20.422 INFO:tasks.workunit.client.0.smithi153.stderr: -328> 2024-09-19T14:13:20.225+0000 7fe81e889640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:13:20.423 INFO:tasks.workunit.client.0.smithi153.stderr: -327> 2024-09-19T14:13:20.225+0000 7fe81e088640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:13:20.423 INFO:tasks.workunit.client.0.smithi153.stderr: -326> 2024-09-19T14:13:20.225+0000 7fe81e088640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:13:20.423 INFO:tasks.workunit.client.0.smithi153.stderr: -325> 2024-09-19T14:13:20.225+0000 7fe81e088640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:13:20.423 INFO:tasks.workunit.client.0.smithi153.stderr: -324> 2024-09-19T14:13:20.225+0000 7fe81e889640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:13:20.423 INFO:tasks.workunit.client.0.smithi153.stderr: -323> 2024-09-19T14:13:20.225+0000 7fe81e889640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:13:20.423 INFO:tasks.workunit.client.0.smithi153.stderr: -322> 2024-09-19T14:13:20.225+0000 7fe81e889640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:13:20.423 INFO:tasks.workunit.client.0.smithi153.stderr: -321> 2024-09-19T14:13:20.225+0000 7fe81e088640 10 monclient(hunting): handle_auth_done global_id 8310 payload 824 2024-09-19T14:13:20.423 INFO:tasks.workunit.client.0.smithi153.stderr: -320> 2024-09-19T14:13:20.225+0000 7fe81e088640 10 monclient: _finish_hunting 0 2024-09-19T14:13:20.423 INFO:tasks.workunit.client.0.smithi153.stderr: -319> 2024-09-19T14:13:20.225+0000 7fe81e088640 1 monclient: found mon.noname-a 2024-09-19T14:13:20.423 INFO:tasks.workunit.client.0.smithi153.stderr: -318> 2024-09-19T14:13:20.225+0000 7fe81e088640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:13:20.423 INFO:tasks.workunit.client.0.smithi153.stderr: -317> 2024-09-19T14:13:20.225+0000 7fe81d887640 10 monclient: get_auth_request con 0x55f1f6856730 auth_method 0 2024-09-19T14:13:20.423 INFO:tasks.workunit.client.0.smithi153.stderr: -316> 2024-09-19T14:13:20.225+0000 7fe703fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:13:20.423 INFO:tasks.workunit.client.0.smithi153.stderr: -315> 2024-09-19T14:13:20.225+0000 7fe703fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:13:20.423 INFO:tasks.workunit.client.0.smithi153.stderr: -314> 2024-09-19T14:13:20.225+0000 7fe703fff640 10 monclient: dump: 2024-09-19T14:13:20.424 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:13:20.424 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:13:20.424 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.424 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.424 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:13:20.424 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.424 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:13:20.424 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:13:20.424 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:13:20.424 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.424 INFO:tasks.workunit.client.0.smithi153.stderr: -313> 2024-09-19T14:13:20.225+0000 7fe703fff640 10 monclient: _finish_auth 0 2024-09-19T14:13:20.424 INFO:tasks.workunit.client.0.smithi153.stderr: -312> 2024-09-19T14:13:20.225+0000 7fe703fff640 10 monclient: _check_auth_tickets 2024-09-19T14:13:20.424 INFO:tasks.workunit.client.0.smithi153.stderr: -311> 2024-09-19T14:13:20.225+0000 7fe703fff640 10 monclient: handle_config config(0 keys) 2024-09-19T14:13:20.424 INFO:tasks.workunit.client.0.smithi153.stderr: -310> 2024-09-19T14:13:20.225+0000 7fe703fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:13:20.425 INFO:tasks.workunit.client.0.smithi153.stderr: -309> 2024-09-19T14:13:20.225+0000 7fe703fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:13:20.425 INFO:tasks.workunit.client.0.smithi153.stderr: -308> 2024-09-19T14:13:20.225+0000 7fe703fff640 10 monclient: dump: 2024-09-19T14:13:20.425 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:13:20.425 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:13:20.425 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.425 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.425 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:13:20.425 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.425 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:13:20.425 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:13:20.425 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:13:20.425 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.425 INFO:tasks.workunit.client.0.smithi153.stderr: -307> 2024-09-19T14:13:20.225+0000 7fe8205829c0 5 monclient: authenticate success, global_id 8310 2024-09-19T14:13:20.425 INFO:tasks.workunit.client.0.smithi153.stderr: -306> 2024-09-19T14:13:20.225+0000 7fe81f08a640 4 set_mon_vals no callback set 2024-09-19T14:13:20.425 INFO:tasks.workunit.client.0.smithi153.stderr: -305> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient: _renew_subs 2024-09-19T14:13:20.426 INFO:tasks.workunit.client.0.smithi153.stderr: -304> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:13:20.426 INFO:tasks.workunit.client.0.smithi153.stderr: -303> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient: _renew_subs 2024-09-19T14:13:20.426 INFO:tasks.workunit.client.0.smithi153.stderr: -302> 2024-09-19T14:13:20.225+0000 7fe8205829c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.153:3300/0 2024-09-19T14:13:20.426 INFO:tasks.workunit.client.0.smithi153.stderr: -301> 2024-09-19T14:13:20.229+0000 7fe703fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:13:20.426 INFO:tasks.workunit.client.0.smithi153.stderr: -300> 2024-09-19T14:13:20.229+0000 7fe703fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:13:20.426 INFO:tasks.workunit.client.0.smithi153.stderr: -299> 2024-09-19T14:13:20.229+0000 7fe703fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:13:20.426 INFO:tasks.workunit.client.0.smithi153.stderr: -298> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient: get_monmap_and_config 2024-09-19T14:13:20.426 INFO:tasks.workunit.client.0.smithi153.stderr: -297> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient: build_initial_monmap 2024-09-19T14:13:20.426 INFO:tasks.workunit.client.0.smithi153.stderr: -296> 2024-09-19T14:13:20.229+0000 7fe8205829c0 1 build_initial for_mkfs: 0 2024-09-19T14:13:20.426 INFO:tasks.workunit.client.0.smithi153.stderr: -295> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient: monmap: 2024-09-19T14:13:20.426 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:13:20.426 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:13:20.426 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:13:20.427 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:13:20.427 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:13:20.427 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.427 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:13:20.427 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:13:20.427 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:13:20.427 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.427 INFO:tasks.workunit.client.0.smithi153.stderr: -294> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding auth protocol: cephx 2024-09-19T14:13:20.427 INFO:tasks.workunit.client.0.smithi153.stderr: -293> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding auth protocol: cephx 2024-09-19T14:13:20.427 INFO:tasks.workunit.client.0.smithi153.stderr: -292> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding auth protocol: cephx 2024-09-19T14:13:20.427 INFO:tasks.workunit.client.0.smithi153.stderr: -291> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding con mode: secure 2024-09-19T14:13:20.427 INFO:tasks.workunit.client.0.smithi153.stderr: -290> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding con mode: crc 2024-09-19T14:13:20.427 INFO:tasks.workunit.client.0.smithi153.stderr: -289> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding con mode: secure 2024-09-19T14:13:20.427 INFO:tasks.workunit.client.0.smithi153.stderr: -288> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding con mode: crc 2024-09-19T14:13:20.427 INFO:tasks.workunit.client.0.smithi153.stderr: -287> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding con mode: secure 2024-09-19T14:13:20.428 INFO:tasks.workunit.client.0.smithi153.stderr: -286> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding con mode: crc 2024-09-19T14:13:20.428 INFO:tasks.workunit.client.0.smithi153.stderr: -285> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding con mode: crc 2024-09-19T14:13:20.428 INFO:tasks.workunit.client.0.smithi153.stderr: -284> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding con mode: secure 2024-09-19T14:13:20.428 INFO:tasks.workunit.client.0.smithi153.stderr: -283> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding con mode: crc 2024-09-19T14:13:20.428 INFO:tasks.workunit.client.0.smithi153.stderr: -282> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding con mode: secure 2024-09-19T14:13:20.428 INFO:tasks.workunit.client.0.smithi153.stderr: -281> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding con mode: crc 2024-09-19T14:13:20.428 INFO:tasks.workunit.client.0.smithi153.stderr: -280> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876770) adding con mode: secure 2024-09-19T14:13:20.428 INFO:tasks.workunit.client.0.smithi153.stderr: -279> 2024-09-19T14:13:20.229+0000 7fe81d887640 10 monclient: get_auth_request con 0x7fe6f8071b20 auth_method 0 2024-09-19T14:13:20.428 INFO:tasks.workunit.client.0.smithi153.stderr: -278> 2024-09-19T14:13:20.229+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.428 INFO:tasks.workunit.client.0.smithi153.stderr: -277> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient: init 2024-09-19T14:13:20.428 INFO:tasks.workunit.client.0.smithi153.stderr: -276> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding auth protocol: cephx 2024-09-19T14:13:20.428 INFO:tasks.workunit.client.0.smithi153.stderr: -275> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding auth protocol: cephx 2024-09-19T14:13:20.428 INFO:tasks.workunit.client.0.smithi153.stderr: -274> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding auth protocol: cephx 2024-09-19T14:13:20.429 INFO:tasks.workunit.client.0.smithi153.stderr: -273> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding con mode: secure 2024-09-19T14:13:20.429 INFO:tasks.workunit.client.0.smithi153.stderr: -272> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding con mode: crc 2024-09-19T14:13:20.429 INFO:tasks.workunit.client.0.smithi153.stderr: -271> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding con mode: secure 2024-09-19T14:13:20.429 INFO:tasks.workunit.client.0.smithi153.stderr: -270> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding con mode: crc 2024-09-19T14:13:20.429 INFO:tasks.workunit.client.0.smithi153.stderr: -269> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding con mode: secure 2024-09-19T14:13:20.429 INFO:tasks.workunit.client.0.smithi153.stderr: -268> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding con mode: crc 2024-09-19T14:13:20.429 INFO:tasks.workunit.client.0.smithi153.stderr: -267> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding con mode: crc 2024-09-19T14:13:20.429 INFO:tasks.workunit.client.0.smithi153.stderr: -266> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding con mode: secure 2024-09-19T14:13:20.429 INFO:tasks.workunit.client.0.smithi153.stderr: -265> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding con mode: crc 2024-09-19T14:13:20.429 INFO:tasks.workunit.client.0.smithi153.stderr: -264> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding con mode: secure 2024-09-19T14:13:20.429 INFO:tasks.workunit.client.0.smithi153.stderr: -263> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding con mode: crc 2024-09-19T14:13:20.429 INFO:tasks.workunit.client.0.smithi153.stderr: -262> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d03e00) adding con mode: secure 2024-09-19T14:13:20.430 INFO:tasks.workunit.client.0.smithi153.stderr: -261> 2024-09-19T14:13:20.229+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.430 INFO:tasks.workunit.client.0.smithi153.stderr: -260> 2024-09-19T14:13:20.229+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.430 INFO:tasks.workunit.client.0.smithi153.stderr: -259> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command rotate-key cmddesc rotate-key hook 0x7ffdc1d03f48 EEXIST 2024-09-19T14:13:20.430 INFO:tasks.workunit.client.0.smithi153.stderr: -258> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient: _reopen_session rank -1 2024-09-19T14:13:20.430 INFO:tasks.workunit.client.0.smithi153.stderr: -257> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-19T14:13:20.430 INFO:tasks.workunit.client.0.smithi153.stderr: -256> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient(hunting): picked mon.noname-a con 0x55f1f68a4ed0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:13:20.430 INFO:tasks.workunit.client.0.smithi153.stderr: -255> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient(hunting): picked mon.noname-b con 0x55f1f68a6ba0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:13:20.430 INFO:tasks.workunit.client.0.smithi153.stderr: -254> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient(hunting): picked mon.noname-c con 0x55f1f689c770 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:13:20.430 INFO:tasks.workunit.client.0.smithi153.stderr: -253> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:13:20.430 INFO:tasks.workunit.client.0.smithi153.stderr: -252> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:13:20.430 INFO:tasks.workunit.client.0.smithi153.stderr: -251> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:13:20.430 INFO:tasks.workunit.client.0.smithi153.stderr: -250> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient(hunting): _renew_subs 2024-09-19T14:13:20.430 INFO:tasks.workunit.client.0.smithi153.stderr: -249> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient(hunting): authenticate will time out at 2988.695197s 2024-09-19T14:13:20.430 INFO:tasks.workunit.client.0.smithi153.stderr: -248> 2024-09-19T14:13:20.229+0000 7fe81e088640 10 monclient(hunting): get_auth_request con 0x55f1f68a4ed0 auth_method 0 2024-09-19T14:13:20.431 INFO:tasks.workunit.client.0.smithi153.stderr: -247> 2024-09-19T14:13:20.229+0000 7fe81e088640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:13:20.431 INFO:tasks.workunit.client.0.smithi153.stderr: -246> 2024-09-19T14:13:20.229+0000 7fe81e088640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:13:20.431 INFO:tasks.workunit.client.0.smithi153.stderr: -245> 2024-09-19T14:13:20.229+0000 7fe81e088640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:13:20.431 INFO:tasks.workunit.client.0.smithi153.stderr: -244> 2024-09-19T14:13:20.229+0000 7fe81e889640 10 monclient(hunting): get_auth_request con 0x55f1f689c770 auth_method 0 2024-09-19T14:13:20.431 INFO:tasks.workunit.client.0.smithi153.stderr: -243> 2024-09-19T14:13:20.229+0000 7fe81e889640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:13:20.431 INFO:tasks.workunit.client.0.smithi153.stderr: -242> 2024-09-19T14:13:20.229+0000 7fe81e889640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:13:20.431 INFO:tasks.workunit.client.0.smithi153.stderr: -241> 2024-09-19T14:13:20.229+0000 7fe81e889640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:13:20.431 INFO:tasks.workunit.client.0.smithi153.stderr: -240> 2024-09-19T14:13:20.229+0000 7fe81e088640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:13:20.431 INFO:tasks.workunit.client.0.smithi153.stderr: -239> 2024-09-19T14:13:20.229+0000 7fe81e088640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:13:20.431 INFO:tasks.workunit.client.0.smithi153.stderr: -238> 2024-09-19T14:13:20.229+0000 7fe81e088640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:13:20.431 INFO:tasks.workunit.client.0.smithi153.stderr: -237> 2024-09-19T14:13:20.229+0000 7fe81e889640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:13:20.431 INFO:tasks.workunit.client.0.smithi153.stderr: -236> 2024-09-19T14:13:20.229+0000 7fe81e889640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:13:20.431 INFO:tasks.workunit.client.0.smithi153.stderr: -235> 2024-09-19T14:13:20.229+0000 7fe81e889640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:13:20.432 INFO:tasks.workunit.client.0.smithi153.stderr: -234> 2024-09-19T14:13:20.229+0000 7fe81e088640 10 monclient(hunting): handle_auth_done global_id 8313 payload 274 2024-09-19T14:13:20.432 INFO:tasks.workunit.client.0.smithi153.stderr: -233> 2024-09-19T14:13:20.229+0000 7fe81e088640 10 monclient: _finish_hunting 0 2024-09-19T14:13:20.432 INFO:tasks.workunit.client.0.smithi153.stderr: -232> 2024-09-19T14:13:20.229+0000 7fe81e088640 1 monclient: found mon.noname-a 2024-09-19T14:13:20.432 INFO:tasks.workunit.client.0.smithi153.stderr: -231> 2024-09-19T14:13:20.229+0000 7fe81e088640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.153:3300/0 2024-09-19T14:13:20.432 INFO:tasks.workunit.client.0.smithi153.stderr: -230> 2024-09-19T14:13:20.229+0000 7fe81d887640 10 monclient: get_auth_request con 0x55f1f68a6ba0 auth_method 0 2024-09-19T14:13:20.432 INFO:tasks.workunit.client.0.smithi153.stderr: -229> 2024-09-19T14:13:20.229+0000 7fe701ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:13:20.432 INFO:tasks.workunit.client.0.smithi153.stderr: -228> 2024-09-19T14:13:20.229+0000 7fe701ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-19T14:13:20.432 INFO:tasks.workunit.client.0.smithi153.stderr: -227> 2024-09-19T14:13:20.229+0000 7fe701ffb640 10 monclient: dump: 2024-09-19T14:13:20.432 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:13:20.432 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:13:20.432 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.432 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.433 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:13:20.433 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.433 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:13:20.433 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:13:20.433 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:13:20.433 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.433 INFO:tasks.workunit.client.0.smithi153.stderr: -226> 2024-09-19T14:13:20.229+0000 7fe701ffb640 10 monclient: _finish_auth 0 2024-09-19T14:13:20.433 INFO:tasks.workunit.client.0.smithi153.stderr: -225> 2024-09-19T14:13:20.229+0000 7fe701ffb640 10 monclient: _check_auth_tickets 2024-09-19T14:13:20.433 INFO:tasks.workunit.client.0.smithi153.stderr: -224> 2024-09-19T14:13:20.229+0000 7fe701ffb640 10 monclient: handle_config config(0 keys) 2024-09-19T14:13:20.433 INFO:tasks.workunit.client.0.smithi153.stderr: -223> 2024-09-19T14:13:20.229+0000 7fe701ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:13:20.433 INFO:tasks.workunit.client.0.smithi153.stderr: -222> 2024-09-19T14:13:20.229+0000 7fe701ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-19T14:13:20.433 INFO:tasks.workunit.client.0.smithi153.stderr: -221> 2024-09-19T14:13:20.229+0000 7fe701ffb640 10 monclient: dump: 2024-09-19T14:13:20.434 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:13:20.434 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:13:20.434 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.434 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.434 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:13:20.434 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.434 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:13:20.434 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:13:20.434 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:13:20.434 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.434 INFO:tasks.workunit.client.0.smithi153.stderr: -220> 2024-09-19T14:13:20.229+0000 7fe8205829c0 5 monclient: authenticate success, global_id 8313 2024-09-19T14:13:20.434 INFO:tasks.workunit.client.0.smithi153.stderr: -219> 2024-09-19T14:13:20.229+0000 7fe8205829c0 10 monclient: get_monmap_and_config success 2024-09-19T14:13:20.434 INFO:tasks.workunit.client.0.smithi153.stderr: -218> 2024-09-19T14:13:20.229+0000 7fe8205829c0 4 set_mon_vals no callback set 2024-09-19T14:13:20.435 INFO:tasks.workunit.client.0.smithi153.stderr: -217> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient: shutdown 2024-09-19T14:13:20.435 INFO:tasks.workunit.client.0.smithi153.stderr: -216> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient: build_initial_monmap 2024-09-19T14:13:20.435 INFO:tasks.workunit.client.0.smithi153.stderr: -215> 2024-09-19T14:13:20.233+0000 7fe8205829c0 1 build_initial for_mkfs: 0 2024-09-19T14:13:20.435 INFO:tasks.workunit.client.0.smithi153.stderr: -214> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient: monmap: 2024-09-19T14:13:20.435 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 0 2024-09-19T14:13:20.435 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-19T14:13:20.435 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 0.000000 2024-09-19T14:13:20.435 INFO:tasks.workunit.client.0.smithi153.stderr:created 0.000000 2024-09-19T14:13:20.435 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 0 (unknown) 2024-09-19T14:13:20.435 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.435 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.noname-a 2024-09-19T14:13:20.435 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.noname-b 2024-09-19T14:13:20.435 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.noname-c 2024-09-19T14:13:20.435 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.436 INFO:tasks.workunit.client.0.smithi153.stderr: -213> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding auth protocol: cephx 2024-09-19T14:13:20.436 INFO:tasks.workunit.client.0.smithi153.stderr: -212> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding auth protocol: cephx 2024-09-19T14:13:20.436 INFO:tasks.workunit.client.0.smithi153.stderr: -211> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding auth protocol: cephx 2024-09-19T14:13:20.436 INFO:tasks.workunit.client.0.smithi153.stderr: -210> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding con mode: secure 2024-09-19T14:13:20.436 INFO:tasks.workunit.client.0.smithi153.stderr: -209> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding con mode: crc 2024-09-19T14:13:20.436 INFO:tasks.workunit.client.0.smithi153.stderr: -208> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding con mode: secure 2024-09-19T14:13:20.436 INFO:tasks.workunit.client.0.smithi153.stderr: -207> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding con mode: crc 2024-09-19T14:13:20.436 INFO:tasks.workunit.client.0.smithi153.stderr: -206> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding con mode: secure 2024-09-19T14:13:20.436 INFO:tasks.workunit.client.0.smithi153.stderr: -205> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding con mode: crc 2024-09-19T14:13:20.436 INFO:tasks.workunit.client.0.smithi153.stderr: -204> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding con mode: crc 2024-09-19T14:13:20.436 INFO:tasks.workunit.client.0.smithi153.stderr: -203> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding con mode: secure 2024-09-19T14:13:20.436 INFO:tasks.workunit.client.0.smithi153.stderr: -202> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding con mode: crc 2024-09-19T14:13:20.436 INFO:tasks.workunit.client.0.smithi153.stderr: -201> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding con mode: secure 2024-09-19T14:13:20.437 INFO:tasks.workunit.client.0.smithi153.stderr: -200> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding con mode: crc 2024-09-19T14:13:20.437 INFO:tasks.workunit.client.0.smithi153.stderr: -199> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6876720) adding con mode: secure 2024-09-19T14:13:20.437 INFO:tasks.workunit.client.0.smithi153.stderr: -198> 2024-09-19T14:13:20.233+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.437 INFO:tasks.workunit.client.0.smithi153.stderr: -197> 2024-09-19T14:13:20.233+0000 7fe8205829c0 1 librados: starting msgr at 2024-09-19T14:13:20.437 INFO:tasks.workunit.client.0.smithi153.stderr: -196> 2024-09-19T14:13:20.233+0000 7fe8205829c0 1 librados: starting objecter 2024-09-19T14:13:20.437 INFO:tasks.workunit.client.0.smithi153.stderr: -195> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command objecter_requests cmddesc objecter_requests hook 0x55f1f68a77c0 EEXIST 2024-09-19T14:13:20.437 INFO:tasks.workunit.client.0.smithi153.stderr: -194> 2024-09-19T14:13:20.233+0000 7fe8205829c0 1 librados: setting wanted keys 2024-09-19T14:13:20.437 INFO:tasks.workunit.client.0.smithi153.stderr: -193> 2024-09-19T14:13:20.233+0000 7fe8205829c0 1 librados: calling monclient init 2024-09-19T14:13:20.437 INFO:tasks.workunit.client.0.smithi153.stderr: -192> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient: init 2024-09-19T14:13:20.437 INFO:tasks.workunit.client.0.smithi153.stderr: -191> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding auth protocol: cephx 2024-09-19T14:13:20.437 INFO:tasks.workunit.client.0.smithi153.stderr: -190> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding auth protocol: cephx 2024-09-19T14:13:20.437 INFO:tasks.workunit.client.0.smithi153.stderr: -189> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding auth protocol: cephx 2024-09-19T14:13:20.437 INFO:tasks.workunit.client.0.smithi153.stderr: -188> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding con mode: secure 2024-09-19T14:13:20.438 INFO:tasks.workunit.client.0.smithi153.stderr: -187> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding con mode: crc 2024-09-19T14:13:20.438 INFO:tasks.workunit.client.0.smithi153.stderr: -186> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding con mode: secure 2024-09-19T14:13:20.438 INFO:tasks.workunit.client.0.smithi153.stderr: -185> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding con mode: crc 2024-09-19T14:13:20.438 INFO:tasks.workunit.client.0.smithi153.stderr: -184> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding con mode: secure 2024-09-19T14:13:20.438 INFO:tasks.workunit.client.0.smithi153.stderr: -183> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding con mode: crc 2024-09-19T14:13:20.438 INFO:tasks.workunit.client.0.smithi153.stderr: -182> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding con mode: crc 2024-09-19T14:13:20.438 INFO:tasks.workunit.client.0.smithi153.stderr: -181> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding con mode: secure 2024-09-19T14:13:20.438 INFO:tasks.workunit.client.0.smithi153.stderr: -180> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding con mode: crc 2024-09-19T14:13:20.438 INFO:tasks.workunit.client.0.smithi153.stderr: -179> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding con mode: secure 2024-09-19T14:13:20.438 INFO:tasks.workunit.client.0.smithi153.stderr: -178> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding con mode: crc 2024-09-19T14:13:20.438 INFO:tasks.workunit.client.0.smithi153.stderr: -177> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 AuthRegistry(0x55f1f6858c20) adding con mode: secure 2024-09-19T14:13:20.438 INFO:tasks.workunit.client.0.smithi153.stderr: -176> 2024-09-19T14:13:20.233+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.439 INFO:tasks.workunit.client.0.smithi153.stderr: -175> 2024-09-19T14:13:20.233+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.439 INFO:tasks.workunit.client.0.smithi153.stderr: -174> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command rotate-key cmddesc rotate-key hook 0x55f1f6858d68 EEXIST 2024-09-19T14:13:20.439 INFO:tasks.workunit.client.0.smithi153.stderr: -173> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient: _reopen_session rank -1 2024-09-19T14:13:20.439 INFO:tasks.workunit.client.0.smithi153.stderr: -172> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-19T14:13:20.439 INFO:tasks.workunit.client.0.smithi153.stderr: -171> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient(hunting): picked mon.noname-c con 0x55f1f689c770 addr [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] 2024-09-19T14:13:20.439 INFO:tasks.workunit.client.0.smithi153.stderr: -170> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient(hunting): picked mon.noname-b con 0x55f1f68a4ed0 addr [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] 2024-09-19T14:13:20.439 INFO:tasks.workunit.client.0.smithi153.stderr: -169> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient(hunting): picked mon.noname-a con 0x55f1f68a6ba0 addr [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] 2024-09-19T14:13:20.439 INFO:tasks.workunit.client.0.smithi153.stderr: -168> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:13:20.439 INFO:tasks.workunit.client.0.smithi153.stderr: -167> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:13:20.439 INFO:tasks.workunit.client.0.smithi153.stderr: -166> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient(hunting): start opening mon connection 2024-09-19T14:13:20.439 INFO:tasks.workunit.client.0.smithi153.stderr: -165> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient(hunting): _renew_subs 2024-09-19T14:13:20.439 INFO:tasks.workunit.client.0.smithi153.stderr: -164> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient(hunting): authenticate will time out at 2988.697770s 2024-09-19T14:13:20.439 INFO:tasks.workunit.client.0.smithi153.stderr: -163> 2024-09-19T14:13:20.233+0000 7fe81e088640 10 monclient(hunting): get_auth_request con 0x55f1f689c770 auth_method 0 2024-09-19T14:13:20.440 INFO:tasks.workunit.client.0.smithi153.stderr: -162> 2024-09-19T14:13:20.233+0000 7fe81e088640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:13:20.440 INFO:tasks.workunit.client.0.smithi153.stderr: -161> 2024-09-19T14:13:20.233+0000 7fe81e088640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:13:20.440 INFO:tasks.workunit.client.0.smithi153.stderr: -160> 2024-09-19T14:13:20.233+0000 7fe81e088640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:13:20.440 INFO:tasks.workunit.client.0.smithi153.stderr: -159> 2024-09-19T14:13:20.233+0000 7fe81e889640 10 monclient(hunting): get_auth_request con 0x55f1f68a6ba0 auth_method 0 2024-09-19T14:13:20.440 INFO:tasks.workunit.client.0.smithi153.stderr: -158> 2024-09-19T14:13:20.233+0000 7fe81e889640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-19T14:13:20.440 INFO:tasks.workunit.client.0.smithi153.stderr: -157> 2024-09-19T14:13:20.233+0000 7fe81e889640 10 monclient(hunting): _init_auth method 2 2024-09-19T14:13:20.440 INFO:tasks.workunit.client.0.smithi153.stderr: -156> 2024-09-19T14:13:20.233+0000 7fe81e889640 10 monclient(hunting): _init_auth creating new auth 2024-09-19T14:13:20.440 INFO:tasks.workunit.client.0.smithi153.stderr: -155> 2024-09-19T14:13:20.233+0000 7fe81e088640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:13:20.440 INFO:tasks.workunit.client.0.smithi153.stderr: -154> 2024-09-19T14:13:20.233+0000 7fe81e088640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:13:20.440 INFO:tasks.workunit.client.0.smithi153.stderr: -153> 2024-09-19T14:13:20.233+0000 7fe81e088640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:13:20.440 INFO:tasks.workunit.client.0.smithi153.stderr: -152> 2024-09-19T14:13:20.233+0000 7fe81e889640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-19T14:13:20.440 INFO:tasks.workunit.client.0.smithi153.stderr: -151> 2024-09-19T14:13:20.233+0000 7fe81e889640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-19T14:13:20.441 INFO:tasks.workunit.client.0.smithi153.stderr: -150> 2024-09-19T14:13:20.233+0000 7fe81e889640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-19T14:13:20.441 INFO:tasks.workunit.client.0.smithi153.stderr: -149> 2024-09-19T14:13:20.233+0000 7fe81e088640 10 monclient(hunting): handle_auth_done global_id 7787 payload 824 2024-09-19T14:13:20.441 INFO:tasks.workunit.client.0.smithi153.stderr: -148> 2024-09-19T14:13:20.233+0000 7fe81e088640 10 monclient: _finish_hunting 0 2024-09-19T14:13:20.441 INFO:tasks.workunit.client.0.smithi153.stderr: -147> 2024-09-19T14:13:20.233+0000 7fe81e088640 1 monclient: found mon.noname-c 2024-09-19T14:13:20.441 INFO:tasks.workunit.client.0.smithi153.stderr: -146> 2024-09-19T14:13:20.233+0000 7fe81e088640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.153:3301/0 2024-09-19T14:13:20.441 INFO:tasks.workunit.client.0.smithi153.stderr: -145> 2024-09-19T14:13:20.233+0000 7fe81d887640 10 monclient: get_auth_request con 0x55f1f68a4ed0 auth_method 0 2024-09-19T14:13:20.441 INFO:tasks.workunit.client.0.smithi153.stderr: -144> 2024-09-19T14:13:20.233+0000 7fe6effff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:13:20.441 INFO:tasks.workunit.client.0.smithi153.stderr: -143> 2024-09-19T14:13:20.233+0000 7fe6effff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-19T14:13:20.441 INFO:tasks.workunit.client.0.smithi153.stderr: -142> 2024-09-19T14:13:20.233+0000 7fe6effff640 10 monclient: dump: 2024-09-19T14:13:20.441 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:13:20.441 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:13:20.441 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.441 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.441 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:13:20.442 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.442 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:13:20.442 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:13:20.442 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:13:20.442 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.442 INFO:tasks.workunit.client.0.smithi153.stderr: -141> 2024-09-19T14:13:20.233+0000 7fe6effff640 10 monclient: _finish_auth 0 2024-09-19T14:13:20.442 INFO:tasks.workunit.client.0.smithi153.stderr: -140> 2024-09-19T14:13:20.233+0000 7fe6effff640 10 monclient: _check_auth_tickets 2024-09-19T14:13:20.442 INFO:tasks.workunit.client.0.smithi153.stderr: -139> 2024-09-19T14:13:20.233+0000 7fe6effff640 10 monclient: handle_config config(0 keys) 2024-09-19T14:13:20.442 INFO:tasks.workunit.client.0.smithi153.stderr: -138> 2024-09-19T14:13:20.233+0000 7fe6effff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-19T14:13:20.442 INFO:tasks.workunit.client.0.smithi153.stderr: -137> 2024-09-19T14:13:20.233+0000 7fe6effff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-19T14:13:20.442 INFO:tasks.workunit.client.0.smithi153.stderr: -136> 2024-09-19T14:13:20.233+0000 7fe6effff640 10 monclient: dump: 2024-09-19T14:13:20.442 INFO:tasks.workunit.client.0.smithi153.stderr:epoch 1 2024-09-19T14:13:20.442 INFO:tasks.workunit.client.0.smithi153.stderr:fsid 3b892dc0-ee3c-4a62-acaf-b5dc1a676e05 2024-09-19T14:13:20.443 INFO:tasks.workunit.client.0.smithi153.stderr:last_changed 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.443 INFO:tasks.workunit.client.0.smithi153.stderr:created 2024-09-19T13:39:18.951178+0000 2024-09-19T14:13:20.443 INFO:tasks.workunit.client.0.smithi153.stderr:min_mon_release 19 (squid) 2024-09-19T14:13:20.443 INFO:tasks.workunit.client.0.smithi153.stderr:election_strategy: 1 2024-09-19T14:13:20.443 INFO:tasks.workunit.client.0.smithi153.stderr:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2024-09-19T14:13:20.443 INFO:tasks.workunit.client.0.smithi153.stderr:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-09-19T14:13:20.443 INFO:tasks.workunit.client.0.smithi153.stderr:2: [v2:172.21.15.153:3301/0,v1:172.21.15.153:6790/0] mon.c 2024-09-19T14:13:20.443 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.443 INFO:tasks.workunit.client.0.smithi153.stderr: -135> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 monclient: authenticate success, global_id 7787 2024-09-19T14:13:20.443 INFO:tasks.workunit.client.0.smithi153.stderr: -134> 2024-09-19T14:13:20.233+0000 7fe701ffb640 4 set_mon_vals no callback set 2024-09-19T14:13:20.443 INFO:tasks.workunit.client.0.smithi153.stderr: -133> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient: _renew_subs 2024-09-19T14:13:20.443 INFO:tasks.workunit.client.0.smithi153.stderr: -132> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:13:20.443 INFO:tasks.workunit.client.0.smithi153.stderr: -131> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient: _renew_subs 2024-09-19T14:13:20.443 INFO:tasks.workunit.client.0.smithi153.stderr: -130> 2024-09-19T14:13:20.233+0000 7fe8205829c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:13:20.444 INFO:tasks.workunit.client.0.smithi153.stderr: -129> 2024-09-19T14:13:20.233+0000 7fe8205829c0 1 librados: init done 2024-09-19T14:13:20.444 INFO:tasks.workunit.client.0.smithi153.stderr: -128> 2024-09-19T14:13:20.233+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command cr dump hook 0x55f1f689ac48 2024-09-19T14:13:20.444 INFO:tasks.workunit.client.0.smithi153.stderr: -127> 2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.444 INFO:tasks.workunit.client.0.smithi153.stderr: -126> 2024-09-19T14:13:20.237+0000 7fe6effff640 4 mgrc handle_mgr_map Got map version 5 2024-09-19T14:13:20.444 INFO:tasks.workunit.client.0.smithi153.stderr: -125> 2024-09-19T14:13:20.237+0000 7fe6effff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:13:20.444 INFO:tasks.workunit.client.0.smithi153.stderr: -124> 2024-09-19T14:13:20.237+0000 7fe6effff640 4 mgrc reconnect Starting new session with [v2:172.21.15.196:6808/2353680615,v1:172.21.15.196:6809/2353680615] 2024-09-19T14:13:20.444 INFO:tasks.workunit.client.0.smithi153.stderr: -123> 2024-09-19T14:13:20.237+0000 7fe81e889640 10 monclient: get_auth_request con 0x55f1f68c4a30 auth_method 0 2024-09-19T14:13:20.444 INFO:tasks.workunit.client.0.smithi153.stderr: -122> 2024-09-19T14:13:20.237+0000 7fe81d887640 10 monclient: get_auth_request con 0x7fe6e8071be0 auth_method 0 2024-09-19T14:13:20.444 INFO:tasks.workunit.client.0.smithi153.stderr: -121> 2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.444 INFO:tasks.workunit.client.0.smithi153.stderr: -120> 2024-09-19T14:13:20.237+0000 7fe8205829c0 20 realm 2024-09-19T14:13:20.444 INFO:tasks.workunit.client.0.smithi153.stderr: -119> 2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.444 INFO:tasks.workunit.client.0.smithi153.stderr: -118> 2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.445 INFO:tasks.workunit.client.0.smithi153.stderr: -117> 2024-09-19T14:13:20.237+0000 7fe8205829c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:13:20.445 INFO:tasks.workunit.client.0.smithi153.stderr: -116> 2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.445 INFO:tasks.workunit.client.0.smithi153.stderr: -115> 2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.445 INFO:tasks.workunit.client.0.smithi153.stderr: -114> 2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.445 INFO:tasks.workunit.client.0.smithi153.stderr: -113> 2024-09-19T14:13:20.237+0000 7fe81e088640 10 monclient: get_auth_request con 0x55f1f68c8dd0 auth_method 0 2024-09-19T14:13:20.445 INFO:tasks.workunit.client.0.smithi153.stderr: -112> 2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:20.445 INFO:tasks.workunit.client.0.smithi153.stderr: -111> 2024-09-19T14:13:20.237+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.445 INFO:tasks.workunit.client.0.smithi153.stderr: -110> 2024-09-19T14:13:20.241+0000 7fe8205829c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:13:20.445 INFO:tasks.workunit.client.0.smithi153.stderr: -109> 2024-09-19T14:13:20.241+0000 7fe8205829c0 20 searching for the correct realm 2024-09-19T14:13:20.445 INFO:tasks.workunit.client.0.smithi153.stderr: -108> 2024-09-19T14:13:20.241+0000 7fe81d887640 10 monclient: get_auth_request con 0x55f1f68cdf60 auth_method 0 2024-09-19T14:13:20.445 INFO:tasks.workunit.client.0.smithi153.stderr: -107> 2024-09-19T14:13:20.241+0000 7fe81e889640 10 monclient: get_auth_request con 0x7fe8140f8b60 auth_method 0 2024-09-19T14:13:20.445 INFO:tasks.workunit.client.0.smithi153.stderr: -106> 2024-09-19T14:13:20.241+0000 7fe81e088640 10 monclient: get_auth_request con 0x7fe81801e040 auth_method 0 2024-09-19T14:13:20.445 INFO:tasks.workunit.client.0.smithi153.stderr: -105> 2024-09-19T14:13:20.241+0000 7fe81d887640 10 monclient: get_auth_request con 0x7fe81001d040 auth_method 0 2024-09-19T14:13:20.445 INFO:tasks.workunit.client.0.smithi153.stderr: -104> 2024-09-19T14:13:20.245+0000 7fe81e889640 0 -- 172.21.15.153:0/3493415984 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55f1f68c4a30 msgr2=0x55f1f68c6e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:13:20.446 INFO:tasks.workunit.client.0.smithi153.stderr: -103> 2024-09-19T14:13:20.245+0000 7fe6effff640 1 client.7787.objecter ms_handle_reset 0x55f1f68c4a30 session 0x55f1f6876e70 osd.1 2024-09-19T14:13:20.446 INFO:tasks.workunit.client.0.smithi153.stderr: -102> 2024-09-19T14:13:20.245+0000 7fe6effff640 10 monclient: _renew_subs 2024-09-19T14:13:20.446 INFO:tasks.workunit.client.0.smithi153.stderr: -101> 2024-09-19T14:13:20.245+0000 7fe6effff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.153:3301/0 2024-09-19T14:13:20.446 INFO:tasks.workunit.client.0.smithi153.stderr: -100> 2024-09-19T14:13:20.245+0000 7fe81e889640 10 monclient: get_auth_request con 0x7fe6e8082290 auth_method 0 2024-09-19T14:13:20.446 INFO:tasks.workunit.client.0.smithi153.stderr: -99> 2024-09-19T14:13:20.245+0000 7fe81e889640 10 monclient: get_auth_request con 0x7fe81412d3a0 auth_method 0 2024-09-19T14:13:20.446 INFO:tasks.workunit.client.0.smithi153.stderr: -98> 2024-09-19T14:13:20.249+0000 7fe81e088640 10 monclient: get_auth_request con 0x7fe8140fe480 auth_method 0 2024-09-19T14:13:20.446 INFO:tasks.workunit.client.0.smithi153.stderr: -97> 2024-09-19T14:13:20.253+0000 7fe81e088640 0 -- 172.21.15.153:0/3493415984 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fe8140fe480 msgr2=0x7fe8140f8260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:20.446 INFO:tasks.workunit.client.0.smithi153.stderr: -96> 2024-09-19T14:13:20.253+0000 7fe6effff640 1 client.7787.objecter ms_handle_reset 0x7fe8140fe480 session 0x7fe8140fe310 osd.0 2024-09-19T14:13:20.446 INFO:tasks.workunit.client.0.smithi153.stderr: -95> 2024-09-19T14:13:20.253+0000 7fe81e088640 10 monclient: get_auth_request con 0x55f1f68c4a30 auth_method 0 2024-09-19T14:13:20.446 INFO:tasks.workunit.client.0.smithi153.stderr: -94> 2024-09-19T14:13:20.257+0000 7fe8205829c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:13:20.446 INFO:tasks.workunit.client.0.smithi153.stderr: -93> 2024-09-19T14:13:20.257+0000 7fe8205829c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:13:20.446 INFO:tasks.workunit.client.0.smithi153.stderr: -92> 2024-09-19T14:13:20.257+0000 7fe8205829c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:13:20.446 INFO:tasks.workunit.client.0.smithi153.stderr: -91> 2024-09-19T14:13:20.257+0000 7fe8205829c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:13:20.447 INFO:tasks.workunit.client.0.smithi153.stderr: -90> 2024-09-19T14:13:20.257+0000 7fe8205829c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:13:20.447 INFO:tasks.workunit.client.0.smithi153.stderr: -89> 2024-09-19T14:13:20.257+0000 7fe8205829c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:13:20.447 INFO:tasks.workunit.client.0.smithi153.stderr: -88> 2024-09-19T14:13:20.257+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.447 INFO:tasks.workunit.client.0.smithi153.stderr: -87> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.447 INFO:tasks.workunit.client.0.smithi153.stderr: -86> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.447 INFO:tasks.workunit.client.0.smithi153.stderr: -85> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:20.447 INFO:tasks.workunit.client.0.smithi153.stderr: -84> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.447 INFO:tasks.workunit.client.0.smithi153.stderr: -83> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:13:20.447 INFO:tasks.workunit.client.0.smithi153.stderr: -82> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 zone default found 2024-09-19T14:13:20.447 INFO:tasks.workunit.client.0.smithi153.stderr: -81> 2024-09-19T14:13:20.261+0000 7fe8205829c0 4 Realm: () 2024-09-19T14:13:20.447 INFO:tasks.workunit.client.0.smithi153.stderr: -80> 2024-09-19T14:13:20.261+0000 7fe8205829c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:13:20.447 INFO:tasks.workunit.client.0.smithi153.stderr: -79> 2024-09-19T14:13:20.261+0000 7fe8205829c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:13:20.448 INFO:tasks.workunit.client.0.smithi153.stderr: -78> 2024-09-19T14:13:20.261+0000 7fe8205829c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:13:20.448 INFO:tasks.workunit.client.0.smithi153.stderr: -77> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 zonegroup default 2024-09-19T14:13:20.448 INFO:tasks.workunit.client.0.smithi153.stderr: -76> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.448 INFO:tasks.workunit.client.0.smithi153.stderr: -75> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.448 INFO:tasks.workunit.client.0.smithi153.stderr: -74> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.448 INFO:tasks.workunit.client.0.smithi153.stderr: -73> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.448 INFO:tasks.workunit.client.0.smithi153.stderr: -72> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.448 INFO:tasks.workunit.client.0.smithi153.stderr: -71> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.448 INFO:tasks.workunit.client.0.smithi153.stderr: -70> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 started sync module instance, tier type = 2024-09-19T14:13:20.448 INFO:tasks.workunit.client.0.smithi153.stderr: -69> 2024-09-19T14:13:20.261+0000 7fe8205829c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:13:20.448 INFO:tasks.workunit.client.0.smithi153.stderr: -68> 2024-09-19T14:13:20.277+0000 7fe8205829c0 20 add_watcher() i=0 2024-09-19T14:13:20.448 INFO:tasks.workunit.client.0.smithi153.stderr: -67> 2024-09-19T14:13:20.277+0000 7fe8205829c0 20 add_watcher() i=1 2024-09-19T14:13:20.449 INFO:tasks.workunit.client.0.smithi153.stderr: -66> 2024-09-19T14:13:20.277+0000 7fe8205829c0 20 add_watcher() i=2 2024-09-19T14:13:20.449 INFO:tasks.workunit.client.0.smithi153.stderr: -65> 2024-09-19T14:13:20.277+0000 7fe8205829c0 20 add_watcher() i=3 2024-09-19T14:13:20.449 INFO:tasks.workunit.client.0.smithi153.stderr: -64> 2024-09-19T14:13:20.277+0000 7fe8205829c0 20 add_watcher() i=4 2024-09-19T14:13:20.449 INFO:tasks.workunit.client.0.smithi153.stderr: -63> 2024-09-19T14:13:20.277+0000 7fe8205829c0 20 add_watcher() i=5 2024-09-19T14:13:20.449 INFO:tasks.workunit.client.0.smithi153.stderr: -62> 2024-09-19T14:13:20.277+0000 7fe8205829c0 20 add_watcher() i=6 2024-09-19T14:13:20.449 INFO:tasks.workunit.client.0.smithi153.stderr: -61> 2024-09-19T14:13:20.277+0000 7fe8205829c0 20 add_watcher() i=7 2024-09-19T14:13:20.449 INFO:tasks.workunit.client.0.smithi153.stderr: -60> 2024-09-19T14:13:20.277+0000 7fe8205829c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:13:20.449 INFO:tasks.workunit.client.0.smithi153.stderr: -59> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding auth protocol: cephx 2024-09-19T14:13:20.449 INFO:tasks.workunit.client.0.smithi153.stderr: -58> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding auth protocol: cephx 2024-09-19T14:13:20.449 INFO:tasks.workunit.client.0.smithi153.stderr: -57> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding auth protocol: cephx 2024-09-19T14:13:20.449 INFO:tasks.workunit.client.0.smithi153.stderr: -56> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding con mode: secure 2024-09-19T14:13:20.450 INFO:tasks.workunit.client.0.smithi153.stderr: -55> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding con mode: crc 2024-09-19T14:13:20.450 INFO:tasks.workunit.client.0.smithi153.stderr: -54> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding con mode: secure 2024-09-19T14:13:20.450 INFO:tasks.workunit.client.0.smithi153.stderr: -53> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding con mode: crc 2024-09-19T14:13:20.450 INFO:tasks.workunit.client.0.smithi153.stderr: -52> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding con mode: secure 2024-09-19T14:13:20.450 INFO:tasks.workunit.client.0.smithi153.stderr: -51> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding con mode: crc 2024-09-19T14:13:20.450 INFO:tasks.workunit.client.0.smithi153.stderr: -50> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding con mode: crc 2024-09-19T14:13:20.450 INFO:tasks.workunit.client.0.smithi153.stderr: -49> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding con mode: secure 2024-09-19T14:13:20.450 INFO:tasks.workunit.client.0.smithi153.stderr: -48> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding con mode: crc 2024-09-19T14:13:20.450 INFO:tasks.workunit.client.0.smithi153.stderr: -47> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding con mode: secure 2024-09-19T14:13:20.450 INFO:tasks.workunit.client.0.smithi153.stderr: -46> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding con mode: crc 2024-09-19T14:13:20.450 INFO:tasks.workunit.client.0.smithi153.stderr: -45> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 AuthRegistry(0x7ffdc1d042d0) adding con mode: secure 2024-09-19T14:13:20.450 INFO:tasks.workunit.client.0.smithi153.stderr: -44> 2024-09-19T14:13:20.281+0000 7fe6d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:20.451 INFO:tasks.workunit.client.0.smithi153.stderr: -43> 2024-09-19T14:13:20.281+0000 7fe8205829c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-19T14:13:20.451 INFO:tasks.workunit.client.0.smithi153.stderr: -42> 2024-09-19T14:13:20.281+0000 7fe8205829c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:13:20.451 INFO:tasks.workunit.client.0.smithi153.stderr: -41> 2024-09-19T14:13:20.281+0000 7fe8205829c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:13:20.451 INFO:tasks.workunit.client.0.smithi153.stderr: -40> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command cache list hook 0x55f1f689c290 2024-09-19T14:13:20.451 INFO:tasks.workunit.client.0.smithi153.stderr: -39> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command cache inspect hook 0x55f1f689c290 2024-09-19T14:13:20.451 INFO:tasks.workunit.client.0.smithi153.stderr: -38> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command cache erase hook 0x55f1f689c290 2024-09-19T14:13:20.451 INFO:tasks.workunit.client.0.smithi153.stderr: -37> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command cache zap hook 0x55f1f689c290 2024-09-19T14:13:20.451 INFO:tasks.workunit.client.0.smithi153.stderr: -36> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 note: GC not initialized 2024-09-19T14:13:20.451 INFO:tasks.workunit.client.0.smithi153.stderr: -35> 2024-09-19T14:13:20.281+0000 7fe64f7fe640 20 reqs_thread_entry: start 2024-09-19T14:13:20.451 INFO:tasks.workunit.client.0.smithi153.stderr: -34> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command sync trace show hook 0x7fe8180026c0 2024-09-19T14:13:20.451 INFO:tasks.workunit.client.0.smithi153.stderr: -33> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command sync trace history hook 0x7fe8180026c0 2024-09-19T14:13:20.451 INFO:tasks.workunit.client.0.smithi153.stderr: -32> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command sync trace active hook 0x7fe8180026c0 2024-09-19T14:13:20.451 INFO:tasks.workunit.client.0.smithi153.stderr: -31> 2024-09-19T14:13:20.281+0000 7fe8205829c0 5 asok(0x55f1f65cfd90) register_command sync trace active_short hook 0x7fe8180026c0 2024-09-19T14:13:20.452 INFO:tasks.workunit.client.0.smithi153.stderr: -30> 2024-09-19T14:13:20.281+0000 7fe8205829c0 20 init_complete bucket index max shards: 11 2024-09-19T14:13:20.452 INFO:tasks.workunit.client.0.smithi153.stderr: -29> 2024-09-19T14:13:20.281+0000 7fe8205829c0 20 Filter name: none 2024-09-19T14:13:20.452 INFO:tasks.workunit.client.0.smithi153.stderr: -28> 2024-09-19T14:13:20.281+0000 7fe64d7fa640 20 reqs_thread_entry: start 2024-09-19T14:13:20.452 INFO:tasks.workunit.client.0.smithi153.stderr: -27> 2024-09-19T14:13:20.281+0000 7fe8205829c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:13:20.452 INFO:tasks.workunit.client.0.smithi153.stderr: -26> 2024-09-19T14:13:20.281+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.452 INFO:tasks.workunit.client.0.smithi153.stderr: -25> 2024-09-19T14:13:20.281+0000 7fe8205829c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:13:20.452 INFO:tasks.workunit.client.0.smithi153.stderr: -24> 2024-09-19T14:13:20.281+0000 7fe8205829c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:13:20.452 INFO:tasks.workunit.client.0.smithi153.stderr: -23> 2024-09-19T14:13:20.281+0000 7fe8205829c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:13:20.452 INFO:tasks.workunit.client.0.smithi153.stderr: -22> 2024-09-19T14:13:20.281+0000 7fe8205829c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : miss 2024-09-19T14:13:20.452 INFO:tasks.workunit.client.0.smithi153.stderr: -21> 2024-09-19T14:13:20.281+0000 7fe8205829c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.452 INFO:tasks.workunit.client.0.smithi153.stderr: -20> 2024-09-19T14:13:20.281+0000 7fe8205829c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-19T14:13:20.452 INFO:tasks.workunit.client.0.smithi153.stderr: -19> 2024-09-19T14:13:20.281+0000 7fe8205829c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:13:20.452 INFO:tasks.workunit.client.0.smithi153.stderr: -18> 2024-09-19T14:13:20.281+0000 7fe8205829c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:13:20.453 INFO:tasks.workunit.client.0.smithi153.stderr: -17> 2024-09-19T14:13:20.281+0000 7fe8205829c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:13:20.453 INFO:tasks.workunit.client.0.smithi153.stderr: -16> 2024-09-19T14:13:20.281+0000 7fe8205829c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:20.453 INFO:tasks.workunit.client.0.smithi153.stderr: -15> 2024-09-19T14:13:20.285+0000 7fe8205829c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:13:20.453 INFO:tasks.workunit.client.0.smithi153.stderr: -14> 2024-09-19T14:13:20.285+0000 7fe8205829c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-19T14:13:20.453 INFO:tasks.workunit.client.0.smithi153.stderr: -13> 2024-09-19T14:13:20.297+0000 7fe8205829c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:13:20.453 INFO:tasks.workunit.client.0.smithi153.stderr: -12> 2024-09-19T14:13:20.297+0000 7fe8205829c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:13:20.453 INFO:tasks.workunit.client.0.smithi153.stderr: -11> 2024-09-19T14:13:20.297+0000 7fe8205829c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:20.453 INFO:tasks.workunit.client.0.smithi153.stderr: -10> 2024-09-19T14:13:20.297+0000 7fe8205829c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17, ofs0, ns] 2024-09-19T14:13:20.453 INFO:tasks.workunit.client.0.smithi153.stderr: -9> 2024-09-19T14:13:20.301+0000 7fe701ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333529 cookie 94497711931696 notifier 7787 bl.length()=827 2024-09-19T14:13:20.453 INFO:tasks.workunit.client.0.smithi153.stderr: -8> 2024-09-19T14:13:20.301+0000 7fe701ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:13:20.453 INFO:tasks.workunit.client.0.smithi153.stderr: -7> 2024-09-19T14:13:20.301+0000 7fe701ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:13:20.454 INFO:tasks.workunit.client.0.smithi153.stderr: -6> 2024-09-19T14:13:20.301+0000 7fe701ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:20.454 INFO:tasks.workunit.client.0.smithi153.stderr: -5> 2024-09-19T14:13:20.301+0000 7fe8205829c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_sources= new_sources= 2024-09-19T14:13:20.454 INFO:tasks.workunit.client.0.smithi153.stderr: -4> 2024-09-19T14:13:20.301+0000 7fe8205829c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential sources added=[] removed=[] 2024-09-19T14:13:20.454 INFO:tasks.workunit.client.0.smithi153.stderr: -3> 2024-09-19T14:13:20.301+0000 7fe8205829c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_dests= new_dests= 2024-09-19T14:13:20.454 INFO:tasks.workunit.client.0.smithi153.stderr: -2> 2024-09-19T14:13:20.301+0000 7fe8205829c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential dests added=[] removed=[] 2024-09-19T14:13:20.454 INFO:tasks.workunit.client.0.smithi153.stderr: -1> 2024-09-19T14:13:20.317+0000 7fe8205829c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe8205829c0 time 2024-09-19T14:13:20.321472+0000 2024-09-19T14:13:20.454 INFO:tasks.workunit.client.0.smithi153.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-19T14:13:20.454 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.454 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:13:20.454 INFO:tasks.workunit.client.0.smithi153.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe823e5c2eb] 2024-09-19T14:13:20.454 INFO:tasks.workunit.client.0.smithi153.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe823e5c49f] 2024-09-19T14:13:20.455 INFO:tasks.workunit.client.0.smithi153.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f1f36be271] 2024-09-19T14:13:20.455 INFO:tasks.workunit.client.0.smithi153.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f1f36ce14a] 2024-09-19T14:13:20.455 INFO:tasks.workunit.client.0.smithi153.stderr: 5: main() 2024-09-19T14:13:20.455 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe822cc2d90] 2024-09-19T14:13:20.455 INFO:tasks.workunit.client.0.smithi153.stderr: 7: __libc_start_main() 2024-09-19T14:13:20.455 INFO:tasks.workunit.client.0.smithi153.stderr: 8: _start() 2024-09-19T14:13:20.455 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.455 INFO:tasks.workunit.client.0.smithi153.stderr: 0> 2024-09-19T14:13:20.317+0000 7fe8205829c0 -1 *** Caught signal (Aborted) ** 2024-09-19T14:13:20.455 INFO:tasks.workunit.client.0.smithi153.stderr: in thread 7fe8205829c0 thread_name:radosgw-admin 2024-09-19T14:13:20.455 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.455 INFO:tasks.workunit.client.0.smithi153.stderr: ceph version 19.3.0-5012-g08af21e0 (08af21e0d16078b88ddf808fe9ba2ab84dbe6754) squid (dev) 2024-09-19T14:13:20.455 INFO:tasks.workunit.client.0.smithi153.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe822cdb520] 2024-09-19T14:13:20.456 INFO:tasks.workunit.client.0.smithi153.stderr: 2: pthread_kill() 2024-09-19T14:13:20.456 INFO:tasks.workunit.client.0.smithi153.stderr: 3: raise() 2024-09-19T14:13:20.456 INFO:tasks.workunit.client.0.smithi153.stderr: 4: abort() 2024-09-19T14:13:20.456 INFO:tasks.workunit.client.0.smithi153.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe823e5c345] 2024-09-19T14:13:20.456 INFO:tasks.workunit.client.0.smithi153.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fe823e5c49f] 2024-09-19T14:13:20.456 INFO:tasks.workunit.client.0.smithi153.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f1f36be271] 2024-09-19T14:13:20.456 INFO:tasks.workunit.client.0.smithi153.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f1f36ce14a] 2024-09-19T14:13:20.456 INFO:tasks.workunit.client.0.smithi153.stderr: 9: main() 2024-09-19T14:13:20.456 INFO:tasks.workunit.client.0.smithi153.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe822cc2d90] 2024-09-19T14:13:20.456 INFO:tasks.workunit.client.0.smithi153.stderr: 11: __libc_start_main() 2024-09-19T14:13:20.456 INFO:tasks.workunit.client.0.smithi153.stderr: 12: _start() 2024-09-19T14:13:20.456 INFO:tasks.workunit.client.0.smithi153.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-19T14:13:20.456 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:20.457 INFO:tasks.workunit.client.0.smithi153.stderr:--- logging levels --- 2024-09-19T14:13:20.457 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 none 2024-09-19T14:13:20.457 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 lockdep 2024-09-19T14:13:20.457 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 context 2024-09-19T14:13:20.457 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 crush 2024-09-19T14:13:20.457 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds 2024-09-19T14:13:20.457 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_balancer 2024-09-19T14:13:20.457 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_locker 2024-09-19T14:13:20.457 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log 2024-09-19T14:13:20.457 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_log_expire 2024-09-19T14:13:20.457 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mds_migrator 2024-09-19T14:13:20.457 INFO:tasks.workunit.client.0.smithi153.stderr: 3/ 5 mds_quiesce 2024-09-19T14:13:20.458 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 buffer 2024-09-19T14:13:20.458 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 timer 2024-09-19T14:13:20.458 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 filer 2024-09-19T14:13:20.458 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 striper 2024-09-19T14:13:20.458 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 1 objecter 2024-09-19T14:13:20.458 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rados 2024-09-19T14:13:20.458 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd 2024-09-19T14:13:20.458 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_mirror 2024-09-19T14:13:20.458 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_replay 2024-09-19T14:13:20.458 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 rbd_pwl 2024-09-19T14:13:20.458 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 journaler 2024-09-19T14:13:20.458 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objectcacher 2024-09-19T14:13:20.458 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 immutable_obj_cache 2024-09-19T14:13:20.458 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 client 2024-09-19T14:13:20.459 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 osd 2024-09-19T14:13:20.459 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 optracker 2024-09-19T14:13:20.459 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 objclass 2024-09-19T14:13:20.459 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 filestore 2024-09-19T14:13:20.459 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 journal 2024-09-19T14:13:20.459 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 ms 2024-09-19T14:13:20.459 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mon 2024-09-19T14:13:20.459 INFO:tasks.workunit.client.0.smithi153.stderr: 0/10 monc 2024-09-19T14:13:20.459 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 paxos 2024-09-19T14:13:20.459 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 tp 2024-09-19T14:13:20.459 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 auth 2024-09-19T14:13:20.459 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 crypto 2024-09-19T14:13:20.459 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 finisher 2024-09-19T14:13:20.459 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 reserver 2024-09-19T14:13:20.459 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 heartbeatmap 2024-09-19T14:13:20.460 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 perfcounter 2024-09-19T14:13:20.460 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw 2024-09-19T14:13:20.460 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_sync 2024-09-19T14:13:20.460 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_datacache 2024-09-19T14:13:20.460 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_access 2024-09-19T14:13:20.460 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_dbstore 2024-09-19T14:13:20.460 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_flight 2024-09-19T14:13:20.460 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 rgw_lifecycle 2024-09-19T14:13:20.460 INFO:tasks.workunit.client.0.smithi153.stderr: 20/20 rgw_notification 2024-09-19T14:13:20.460 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 javaclient 2024-09-19T14:13:20.460 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 asok 2024-09-19T14:13:20.460 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 1 throttle 2024-09-19T14:13:20.460 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 0 refs 2024-09-19T14:13:20.460 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 compressor 2024-09-19T14:13:20.461 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluestore 2024-09-19T14:13:20.461 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 bluefs 2024-09-19T14:13:20.461 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 3 bdev 2024-09-19T14:13:20.461 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 kstore 2024-09-19T14:13:20.461 INFO:tasks.workunit.client.0.smithi153.stderr: 4/ 5 rocksdb 2024-09-19T14:13:20.461 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 fuse 2024-09-19T14:13:20.461 INFO:tasks.workunit.client.0.smithi153.stderr: 2/ 5 mgr 2024-09-19T14:13:20.461 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mgrc 2024-09-19T14:13:20.461 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 dpdk 2024-09-19T14:13:20.461 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 eventtrace 2024-09-19T14:13:20.461 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 prioritycache 2024-09-19T14:13:20.461 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 test 2024-09-19T14:13:20.461 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephfs_mirror 2024-09-19T14:13:20.461 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cephsqlite 2024-09-19T14:13:20.462 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 crimson_interrupt 2024-09-19T14:13:20.462 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore 2024-09-19T14:13:20.462 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_onode 2024-09-19T14:13:20.462 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_odata 2024-09-19T14:13:20.462 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_omap 2024-09-19T14:13:20.462 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_tm 2024-09-19T14:13:20.462 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_t 2024-09-19T14:13:20.462 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cleaner 2024-09-19T14:13:20.462 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_epm 2024-09-19T14:13:20.462 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_lba 2024-09-19T14:13:20.462 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-19T14:13:20.462 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_cache 2024-09-19T14:13:20.462 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_journal 2024-09-19T14:13:20.462 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_device 2024-09-19T14:13:20.462 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 seastore_backref 2024-09-19T14:13:20.463 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 alienstore 2024-09-19T14:13:20.463 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 mclock 2024-09-19T14:13:20.463 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 cyanstore 2024-09-19T14:13:20.463 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 ceph_exporter 2024-09-19T14:13:20.463 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 memstore 2024-09-19T14:13:20.463 INFO:tasks.workunit.client.0.smithi153.stderr: 1/ 5 trace 2024-09-19T14:13:20.463 INFO:tasks.workunit.client.0.smithi153.stderr: 0/ 5 ceph_dedup 2024-09-19T14:13:20.463 INFO:tasks.workunit.client.0.smithi153.stderr: -2/-2 (syslog threshold) 2024-09-19T14:13:20.463 INFO:tasks.workunit.client.0.smithi153.stderr: 99/99 (stderr threshold) 2024-09-19T14:13:20.463 INFO:tasks.workunit.client.0.smithi153.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-19T14:13:20.463 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe64d7fa640 / http_manager 2024-09-19T14:13:20.463 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe64f7fe640 / http_manager 2024-09-19T14:13:20.463 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe6d4fe1640 / rgw_dt_lg_renew 2024-09-19T14:13:20.463 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe6effff640 / ms_dispatch 2024-09-19T14:13:20.464 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe701ffb640 / io_context_pool 2024-09-19T14:13:20.464 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe703fff640 / ms_dispatch 2024-09-19T14:13:20.464 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe70ae05640 / ms_dispatch 2024-09-19T14:13:20.464 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe70c608640 / io_context_pool 2024-09-19T14:13:20.464 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe81d887640 / msgr-worker-2 2024-09-19T14:13:20.464 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe81e088640 / msgr-worker-1 2024-09-19T14:13:20.464 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe81e889640 / msgr-worker-0 2024-09-19T14:13:20.464 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe81f08a640 / io_context_pool 2024-09-19T14:13:20.464 INFO:tasks.workunit.client.0.smithi153.stderr: 7fe8205829c0 / radosgw-admin 2024-09-19T14:13:20.464 INFO:tasks.workunit.client.0.smithi153.stderr: max_recent 500 2024-09-19T14:13:20.464 INFO:tasks.workunit.client.0.smithi153.stderr: max_new 1000 2024-09-19T14:13:20.464 INFO:tasks.workunit.client.0.smithi153.stderr: log_file /var/lib/ceph/crash/2024-09-19T14:13:20.323526Z_7c0529d2-8673-4b4f-a306-78a77114c222/log 2024-09-19T14:13:20.464 INFO:tasks.workunit.client.0.smithi153.stderr:--- end dump of recent events --- 2024-09-19T14:13:20.465 INFO:tasks.workunit.client.0.smithi153.stderr:Aborted 2024-09-19T14:13:20.465 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T14:13:20.466 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:13:20.466 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:13:20.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.397+0000 7f880b27e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.401+0000 7f880b27e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.401+0000 7f880b27e9c0 20 realm 2024-09-19T14:13:20.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.401+0000 7f880b27e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.401+0000 7f880b27e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.401+0000 7f880b27e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:13:20.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.401+0000 7f880b27e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.401+0000 7f880b27e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.401+0000 7f880b27e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.401+0000 7f880b27e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:20.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.401+0000 7f880b27e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.401+0000 7f880b27e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:13:20.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.401+0000 7f880b27e9c0 20 searching for the correct realm 2024-09-19T14:13:20.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.409+0000 7f8809585640 0 -- 172.21.15.153:0/150451011 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7f87fc0710b0 msgr2=0x7f87fc09ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:20.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.625+0000 7f8808d84640 0 -- 172.21.15.153:0/150451011 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x55d85a1edbe0 msgr2=0x55d85a1f00a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:20.635 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.633+0000 7f880b27e9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:13:20.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.633+0000 7f880b27e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:13:20.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.633+0000 7f880b27e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:13:20.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.633+0000 7f880b27e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:13:20.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.633+0000 7f880b27e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:13:20.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.633+0000 7f880b27e9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:13:20.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.633+0000 7f880b27e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.633+0000 7f880b27e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.636 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.633+0000 7f880b27e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.633+0000 7f880b27e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:20.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.633+0000 7f880b27e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.633+0000 7f880b27e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:13:20.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.633+0000 7f880b27e9c0 20 zone default found 2024-09-19T14:13:20.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.633+0000 7f880b27e9c0 4 Realm: () 2024-09-19T14:13:20.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.633+0000 7f880b27e9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:13:20.639 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.633+0000 7f880b27e9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:13:20.639 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.633+0000 7f880b27e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:13:20.639 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.633+0000 7f880b27e9c0 20 zonegroup default 2024-09-19T14:13:20.639 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.633+0000 7f880b27e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.639 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.637+0000 7f880b27e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.639 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.637+0000 7f880b27e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.640 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.637+0000 7f880b27e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.640 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.637+0000 7f880b27e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.640 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.637+0000 7f880b27e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.640 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.637+0000 7f880b27e9c0 20 started sync module instance, tier type = 2024-09-19T14:13:20.640 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.637+0000 7f880b27e9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:13:20.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.661+0000 7f880b27e9c0 20 add_watcher() i=0 2024-09-19T14:13:20.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.661+0000 7f880b27e9c0 20 add_watcher() i=1 2024-09-19T14:13:20.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.661+0000 7f880b27e9c0 20 add_watcher() i=2 2024-09-19T14:13:20.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.661+0000 7f880b27e9c0 20 add_watcher() i=3 2024-09-19T14:13:20.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.661+0000 7f880b27e9c0 20 add_watcher() i=4 2024-09-19T14:13:20.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.661+0000 7f880b27e9c0 20 add_watcher() i=5 2024-09-19T14:13:20.664 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.661+0000 7f880b27e9c0 20 add_watcher() i=6 2024-09-19T14:13:20.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.661+0000 7f880b27e9c0 20 add_watcher() i=7 2024-09-19T14:13:20.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.661+0000 7f880b27e9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:13:20.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.665+0000 7f86bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:20.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.669+0000 7f880b27e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:13:20.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.669+0000 7f880b27e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:13:20.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.669+0000 7f880b27e9c0 5 note: GC not initialized 2024-09-19T14:13:20.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.669+0000 7f86be7e4640 20 reqs_thread_entry: start 2024-09-19T14:13:20.671 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.669+0000 7f880b27e9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:13:20.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.669+0000 7f880b27e9c0 20 Filter name: none 2024-09-19T14:13:20.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.669+0000 7f86b77fe640 20 reqs_thread_entry: start 2024-09-19T14:13:20.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.669+0000 7f880b27e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.669+0000 7f880b27e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:13:20.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.669+0000 7f880b27e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.669+0000 7f880b27e9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-19T14:13:20.673 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.669+0000 7f880b27e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:13:20.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.669+0000 7f880b27e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.673+0000 7f880b27e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:13:20.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.673+0000 7f880b27e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.673+0000 7f880b27e9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-19T14:13:20.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.673+0000 7f880b27e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:13:20.679 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.677+0000 7f86bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:20.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.681+0000 7f880b27e9c0 20 remove_watcher() i=0 2024-09-19T14:13:20.684 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.681+0000 7f880b27e9c0 2 removed watcher, disabling cache 2024-09-19T14:13:20.686 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.685+0000 7f880b27e9c0 20 remove_watcher() i=1 2024-09-19T14:13:20.689 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.685+0000 7f880b27e9c0 20 remove_watcher() i=2 2024-09-19T14:13:20.691 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.689+0000 7f880b27e9c0 20 remove_watcher() i=3 2024-09-19T14:13:20.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.689+0000 7f880b27e9c0 20 remove_watcher() i=4 2024-09-19T14:13:20.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.693+0000 7f880b27e9c0 20 remove_watcher() i=5 2024-09-19T14:13:20.696 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.693+0000 7f880b27e9c0 20 remove_watcher() i=6 2024-09-19T14:13:20.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.697+0000 7f880b27e9c0 20 remove_watcher() i=7 2024-09-19T14:13:20.716 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:13:20.716 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:13:20.771 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-19T14:13:20.804 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:13:20.804 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:13:20.846 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.845+0000 7fb7e63e39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.845+0000 7fb7e63e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.845+0000 7fb7e63e39c0 20 realm 2024-09-19T14:13:20.849 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.845+0000 7fb7e63e39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.849 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.845+0000 7fb7e63e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.849 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.845+0000 7fb7e63e39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:13:20.849 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.845+0000 7fb7e63e39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.849 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.845+0000 7fb7e63e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.849 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.845+0000 7fb7e63e39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.845+0000 7fb7e63e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:20.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.845+0000 7fb7e63e39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.849+0000 7fb7e63e39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:13:20.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.849+0000 7fb7e63e39c0 20 searching for the correct realm 2024-09-19T14:13:20.856 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.853+0000 7fb7e36e8640 0 -- 172.21.15.153:0/4185806986 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x55e09a356f40 msgr2=0x55e09a3593e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:20.862 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.861+0000 7fb7e3ee9640 0 -- 172.21.15.153:0/4185806986 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fb7d80e1070 msgr2=0x7fb7d80d33d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:20.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.865+0000 7fb7e63e39c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:13:20.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.865+0000 7fb7e63e39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:13:20.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.865+0000 7fb7e63e39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:13:20.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.865+0000 7fb7e63e39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:13:20.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.865+0000 7fb7e63e39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:13:20.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.865+0000 7fb7e63e39c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:13:20.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.865+0000 7fb7e63e39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.871 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.869+0000 7fb7e63e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.871 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.869+0000 7fb7e63e39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.869+0000 7fb7e63e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:20.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.869+0000 7fb7e63e39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.869+0000 7fb7e63e39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:13:20.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.869+0000 7fb7e63e39c0 20 zone default found 2024-09-19T14:13:20.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.869+0000 7fb7e63e39c0 4 Realm: () 2024-09-19T14:13:20.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.869+0000 7fb7e63e39c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:13:20.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.869+0000 7fb7e63e39c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:13:20.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.869+0000 7fb7e63e39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:13:20.872 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.869+0000 7fb7e63e39c0 20 zonegroup default 2024-09-19T14:13:20.873 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.869+0000 7fb7e63e39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.873 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.869+0000 7fb7e63e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.873 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.869+0000 7fb7e63e39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.873 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.869+0000 7fb7e63e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.873 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.869+0000 7fb7e63e39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.874 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.869+0000 7fb7e63e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:20.874 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.869+0000 7fb7e63e39c0 20 started sync module instance, tier type = 2024-09-19T14:13:20.874 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.869+0000 7fb7e63e39c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:13:20.887 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.885+0000 7fb7e63e39c0 20 add_watcher() i=0 2024-09-19T14:13:20.887 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.885+0000 7fb7e63e39c0 20 add_watcher() i=1 2024-09-19T14:13:20.887 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.885+0000 7fb7e63e39c0 20 add_watcher() i=2 2024-09-19T14:13:20.887 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.885+0000 7fb7e63e39c0 20 add_watcher() i=3 2024-09-19T14:13:20.887 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.885+0000 7fb7e63e39c0 20 add_watcher() i=4 2024-09-19T14:13:20.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.885+0000 7fb7e63e39c0 20 add_watcher() i=5 2024-09-19T14:13:20.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.885+0000 7fb7e63e39c0 20 add_watcher() i=6 2024-09-19T14:13:20.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.885+0000 7fb7e63e39c0 20 add_watcher() i=7 2024-09-19T14:13:20.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.885+0000 7fb7e63e39c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:13:20.894 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb69a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:20.894 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb7e63e39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:13:20.895 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb7e63e39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:13:20.895 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb7e63e39c0 5 note: GC not initialized 2024-09-19T14:13:20.895 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb6997e2640 20 reqs_thread_entry: start 2024-09-19T14:13:20.895 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb7e63e39c0 20 init_complete bucket index max shards: 11 2024-09-19T14:13:20.895 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb7e63e39c0 20 Filter name: none 2024-09-19T14:13:20.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb6927fc640 20 reqs_thread_entry: start 2024-09-19T14:13:20.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb7e63e39c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:13:20.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb7e63e39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb7e63e39c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:13:20.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb7e63e39c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:13:20.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb7e63e39c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:13:20.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb7e63e39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : miss 2024-09-19T14:13:20.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb7e63e39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:20.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb7e63e39c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-19T14:13:20.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb7e63e39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:13:20.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb7e63e39c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:13:20.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb7e63e39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:13:20.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb7e63e39c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:20.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb7e63e39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:13:20.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb7e63e39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:13:20.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb7e63e39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:13:20.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb7e63e39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:13:20.899 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.889+0000 7fb7e63e39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:13:20.899 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.893+0000 7fb7e63e39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:13:20.899 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.893+0000 7fb7e63e39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:13:20.900 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.893+0000 7fb7e63e39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:13:20.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.893+0000 7fb7e63e39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:13:20.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.893+0000 7fb7e63e39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:13:20.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.893+0000 7fb7e63e39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:13:20.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.893+0000 7fb7e63e39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:13:20.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.893+0000 7fb7e63e39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:13:20.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.893+0000 7fb7e63e39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:13:20.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.893+0000 7fb7e63e39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:13:20.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.893+0000 7fb7e63e39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:13:20.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.897+0000 7fb7e63e39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:13:20.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.897+0000 7fb7e63e39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:13:20.901 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.897+0000 7fb7e63e39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:13:20.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.897+0000 7fb7e63e39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:13:20.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.897+0000 7fb7e63e39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:13:20.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.897+0000 7fb7e63e39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:13:20.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.897+0000 7fb7e63e39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:13:20.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.897+0000 7fb7e63e39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:13:20.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.897+0000 7fb7e63e39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:13:20.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.897+0000 7fb7e63e39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:13:20.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.897+0000 7fb7e63e39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:13:20.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.897+0000 7fb69a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:20.906 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.905+0000 7fb7e63e39c0 20 remove_watcher() i=0 2024-09-19T14:13:20.906 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.905+0000 7fb7e63e39c0 2 removed watcher, disabling cache 2024-09-19T14:13:20.908 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.905+0000 7fb7e63e39c0 20 remove_watcher() i=1 2024-09-19T14:13:20.910 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.905+0000 7fb7e63e39c0 20 remove_watcher() i=2 2024-09-19T14:13:20.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.909+0000 7fb7e63e39c0 20 remove_watcher() i=3 2024-09-19T14:13:20.914 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.909+0000 7fb7e63e39c0 20 remove_watcher() i=4 2024-09-19T14:13:20.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.913+0000 7fb7e63e39c0 20 remove_watcher() i=5 2024-09-19T14:13:20.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.913+0000 7fb7e63e39c0 20 remove_watcher() i=6 2024-09-19T14:13:20.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:20.913+0000 7fb7e63e39c0 20 remove_watcher() i=7 2024-09-19T14:13:50.956 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-19T14:13:50.989 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:13:50.989 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:13:51.034 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.028+0000 7f673717e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.032+0000 7f673717e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.032+0000 7f673717e9c0 20 realm 2024-09-19T14:13:51.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.032+0000 7f673717e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.032+0000 7f673717e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.032+0000 7f673717e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:13:51.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.032+0000 7f673717e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.032+0000 7f673717e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.032+0000 7f673717e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.037 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.032+0000 7f673717e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:51.037 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.032+0000 7f673717e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.038 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.032+0000 7f673717e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:13:51.038 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.032+0000 7f673717e9c0 20 searching for the correct realm 2024-09-19T14:13:51.043 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.040+0000 7f6734483640 0 -- 172.21.15.153:0/4171325137 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f67240c8070 msgr2=0x7f6724103040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:51.049 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.044+0000 7f6734c84640 0 -- 172.21.15.153:0/4171325137 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f672806b800 msgr2=0x7f672802d7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:51.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.260+0000 7f673717e9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:13:51.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.260+0000 7f673717e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:13:51.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.260+0000 7f673717e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:13:51.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.260+0000 7f673717e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:13:51.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.260+0000 7f673717e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:13:51.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.260+0000 7f673717e9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:13:51.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.260+0000 7f673717e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.267 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.260+0000 7f673717e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.268 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.260+0000 7f673717e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.268 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.260+0000 7f673717e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:51.268 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.260+0000 7f673717e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.260+0000 7f673717e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:13:51.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.260+0000 7f673717e9c0 20 zone default found 2024-09-19T14:13:51.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.260+0000 7f673717e9c0 4 Realm: () 2024-09-19T14:13:51.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.260+0000 7f673717e9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:13:51.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.260+0000 7f673717e9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:13:51.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.260+0000 7f673717e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:13:51.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.260+0000 7f673717e9c0 20 zonegroup default 2024-09-19T14:13:51.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.260+0000 7f673717e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.264+0000 7f673717e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.264+0000 7f673717e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.264+0000 7f673717e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.264+0000 7f673717e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.264+0000 7f673717e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.264+0000 7f673717e9c0 20 started sync module instance, tier type = 2024-09-19T14:13:51.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.264+0000 7f673717e9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:13:51.293 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.288+0000 7f673717e9c0 20 add_watcher() i=0 2024-09-19T14:13:51.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.288+0000 7f673717e9c0 20 add_watcher() i=1 2024-09-19T14:13:51.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.288+0000 7f673717e9c0 20 add_watcher() i=2 2024-09-19T14:13:51.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.288+0000 7f673717e9c0 20 add_watcher() i=3 2024-09-19T14:13:51.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.288+0000 7f673717e9c0 20 add_watcher() i=4 2024-09-19T14:13:51.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.288+0000 7f673717e9c0 20 add_watcher() i=5 2024-09-19T14:13:51.294 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.288+0000 7f673717e9c0 20 add_watcher() i=6 2024-09-19T14:13:51.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.292+0000 7f673717e9c0 20 add_watcher() i=7 2024-09-19T14:13:51.296 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.292+0000 7f673717e9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:13:51.300 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.296+0000 7f65eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:51.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.296+0000 7f673717e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:13:51.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.296+0000 7f673717e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:13:51.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.296+0000 7f673717e9c0 5 note: GC not initialized 2024-09-19T14:13:51.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.296+0000 7f65ea7e4640 20 reqs_thread_entry: start 2024-09-19T14:13:51.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.296+0000 7f673717e9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:13:51.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.296+0000 7f673717e9c0 20 Filter name: none 2024-09-19T14:13:51.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.296+0000 7f65e37fe640 20 reqs_thread_entry: start 2024-09-19T14:13:51.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.296+0000 7f673717e9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:13:51.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.296+0000 7f673717e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.300+0000 7f673717e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:13:51.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.300+0000 7f673717e9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:13:51.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.300+0000 7f673717e9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:13:51.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.300+0000 7f673717e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : miss 2024-09-19T14:13:51.303 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.300+0000 7f673717e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.300+0000 7f673717e9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-19T14:13:51.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.300+0000 7f673717e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:13:51.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.300+0000 7f673717e9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:13:51.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.300+0000 7f673717e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:13:51.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.300+0000 7f673717e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:51.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.300+0000 7f673717e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:13:51.314 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.308+0000 7f65eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:51.318 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.316+0000 7f673717e9c0 20 remove_watcher() i=0 2024-09-19T14:13:51.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.316+0000 7f673717e9c0 2 removed watcher, disabling cache 2024-09-19T14:13:51.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.316+0000 7f673717e9c0 20 remove_watcher() i=1 2024-09-19T14:13:51.323 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.320+0000 7f673717e9c0 20 remove_watcher() i=2 2024-09-19T14:13:51.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.320+0000 7f673717e9c0 20 remove_watcher() i=3 2024-09-19T14:13:51.327 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.324+0000 7f673717e9c0 20 remove_watcher() i=4 2024-09-19T14:13:51.328 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.324+0000 7f673717e9c0 20 remove_watcher() i=5 2024-09-19T14:13:51.330 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.324+0000 7f673717e9c0 20 remove_watcher() i=6 2024-09-19T14:13:51.331 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.328+0000 7f673717e9c0 20 remove_watcher() i=7 2024-09-19T14:13:51.346 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-19T14:13:51.374 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:13:51.374 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:13:51.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.412+0000 7ff3498e79c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.416+0000 7ff3498e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.416+0000 7ff3498e79c0 20 realm 2024-09-19T14:13:51.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.416+0000 7ff3498e79c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.416+0000 7ff3498e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.416+0000 7ff3498e79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:13:51.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.416+0000 7ff3498e79c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.416+0000 7ff3498e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.416+0000 7ff3498e79c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.420 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.416+0000 7ff3498e79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:51.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.416+0000 7ff3498e79c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.416+0000 7ff3498e79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:13:51.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.416+0000 7ff3498e79c0 20 searching for the correct realm 2024-09-19T14:13:51.427 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.424+0000 7ff346bec640 0 -- 172.21.15.153:0/3683485182 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x5636a0731160 msgr2=0x5636a0733600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:51.432 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.428+0000 7ff3473ed640 0 -- 172.21.15.153:0/3683485182 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7ff33c03b410 msgr2=0x7ff33c03b890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:51.440 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.436+0000 7ff3498e79c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:13:51.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.436+0000 7ff3498e79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:13:51.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.436+0000 7ff3498e79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:13:51.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.436+0000 7ff3498e79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:13:51.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.436+0000 7ff3498e79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:13:51.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.436+0000 7ff3498e79c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:13:51.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.436+0000 7ff3498e79c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.436+0000 7ff3498e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.441 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.436+0000 7ff3498e79c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.442 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.436+0000 7ff3498e79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:51.442 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.436+0000 7ff3498e79c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.440+0000 7ff3498e79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:13:51.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.440+0000 7ff3498e79c0 20 zone default found 2024-09-19T14:13:51.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.440+0000 7ff3498e79c0 4 Realm: () 2024-09-19T14:13:51.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.440+0000 7ff3498e79c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:13:51.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.440+0000 7ff3498e79c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:13:51.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.440+0000 7ff3498e79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:13:51.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.440+0000 7ff3498e79c0 20 zonegroup default 2024-09-19T14:13:51.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.440+0000 7ff3498e79c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.440+0000 7ff3498e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.440+0000 7ff3498e79c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.444 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.440+0000 7ff3498e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.444 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.440+0000 7ff3498e79c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.444 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.440+0000 7ff3498e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.444 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.440+0000 7ff3498e79c0 20 started sync module instance, tier type = 2024-09-19T14:13:51.444 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.440+0000 7ff3498e79c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:13:51.459 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.456+0000 7ff3498e79c0 20 add_watcher() i=0 2024-09-19T14:13:51.459 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.456+0000 7ff3498e79c0 20 add_watcher() i=1 2024-09-19T14:13:51.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.456+0000 7ff3498e79c0 20 add_watcher() i=2 2024-09-19T14:13:51.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.456+0000 7ff3498e79c0 20 add_watcher() i=3 2024-09-19T14:13:51.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.456+0000 7ff3498e79c0 20 add_watcher() i=4 2024-09-19T14:13:51.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.456+0000 7ff3498e79c0 20 add_watcher() i=5 2024-09-19T14:13:51.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.456+0000 7ff3498e79c0 20 add_watcher() i=6 2024-09-19T14:13:51.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.456+0000 7ff3498e79c0 20 add_watcher() i=7 2024-09-19T14:13:51.460 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.456+0000 7ff3498e79c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:13:51.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.460+0000 7ff1fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:51.464 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.460+0000 7ff3498e79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:13:51.464 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.460+0000 7ff3498e79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:13:51.464 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.460+0000 7ff3498e79c0 5 note: GC not initialized 2024-09-19T14:13:51.464 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.460+0000 7ff1fd7e2640 20 reqs_thread_entry: start 2024-09-19T14:13:51.464 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.460+0000 7ff3498e79c0 20 init_complete bucket index max shards: 11 2024-09-19T14:13:51.464 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.460+0000 7ff3498e79c0 20 Filter name: none 2024-09-19T14:13:51.464 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.460+0000 7ff3498e79c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:13:51.464 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.460+0000 7ff3498e79c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.460+0000 7ff1f67fc640 20 reqs_thread_entry: start 2024-09-19T14:13:51.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.460+0000 7ff3498e79c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:13:51.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.460+0000 7ff3498e79c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:13:51.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.460+0000 7ff3498e79c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:13:51.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.460+0000 7ff3498e79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : miss 2024-09-19T14:13:51.465 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.460+0000 7ff3498e79c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.460+0000 7ff3498e79c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-19T14:13:51.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.460+0000 7ff3498e79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:13:51.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.460+0000 7ff3498e79c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:13:51.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.460+0000 7ff3498e79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:13:51.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.460+0000 7ff3498e79c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:51.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.460+0000 7ff3498e79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:13:51.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.460+0000 7ff3498e79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:13:51.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.460+0000 7ff3498e79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:13:51.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.464+0000 7ff3498e79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:13:51.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.464+0000 7ff3498e79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:13:51.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.464+0000 7ff3498e79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:13:51.468 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.464+0000 7ff3498e79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:13:51.468 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.464+0000 7ff3498e79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:13:51.468 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.464+0000 7ff3498e79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:13:51.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.464+0000 7ff3498e79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:13:51.469 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.464+0000 7ff3498e79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:13:51.470 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.464+0000 7ff3498e79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:13:51.470 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.464+0000 7ff3498e79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:13:51.470 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.468+0000 7ff3498e79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:13:51.470 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.468+0000 7ff3498e79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:13:51.471 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.468+0000 7ff3498e79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:13:51.471 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.468+0000 7ff3498e79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:13:51.472 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.468+0000 7ff3498e79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:13:51.472 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.468+0000 7ff3498e79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:13:51.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.468+0000 7ff3498e79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:13:51.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.468+0000 7ff3498e79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:13:51.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.468+0000 7ff3498e79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:13:51.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.468+0000 7ff3498e79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:13:51.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.468+0000 7ff3498e79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:13:51.473 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.468+0000 7ff3498e79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:13:51.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.472+0000 7ff3498e79c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:13:51.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.472+0000 7ff3498e79c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:13:51.475 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.472+0000 7ff1fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:51.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.476+0000 7ff3498e79c0 20 remove_watcher() i=0 2024-09-19T14:13:51.480 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.476+0000 7ff3498e79c0 2 removed watcher, disabling cache 2024-09-19T14:13:51.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.480+0000 7ff3498e79c0 20 remove_watcher() i=1 2024-09-19T14:13:51.484 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.480+0000 7ff3498e79c0 20 remove_watcher() i=2 2024-09-19T14:13:51.487 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.484+0000 7ff3498e79c0 20 remove_watcher() i=3 2024-09-19T14:13:51.488 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.484+0000 7ff3498e79c0 20 remove_watcher() i=4 2024-09-19T14:13:51.490 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.484+0000 7ff3498e79c0 20 remove_watcher() i=5 2024-09-19T14:13:51.491 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.488+0000 7ff3498e79c0 20 remove_watcher() i=6 2024-09-19T14:13:51.492 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.488+0000 7ff3498e79c0 20 remove_watcher() i=7 2024-09-19T14:13:51.506 INFO:tasks.workunit.client.0.smithi153.stderr:check reshard logrecord successfully 2024-09-19T14:13:51.506 INFO:tasks.workunit.client.0.smithi153.stderr: test: reshard versioned bucket 2024-09-19T14:13:51.506 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket myver 2024-09-19T14:13:51.533 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:13:51.533 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:13:51.576 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.572+0000 7fc73ca0e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.578 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.572+0000 7fc73ca0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.578 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.572+0000 7fc73ca0e9c0 20 realm 2024-09-19T14:13:51.579 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.572+0000 7fc73ca0e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.579 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.576+0000 7fc73ca0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.579 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.576+0000 7fc73ca0e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:13:51.579 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.576+0000 7fc73ca0e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.579 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.576+0000 7fc73ca0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.579 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.576+0000 7fc73ca0e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.576+0000 7fc73ca0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:51.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.576+0000 7fc73ca0e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.581 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.576+0000 7fc73ca0e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:13:51.581 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.576+0000 7fc73ca0e9c0 20 searching for the correct realm 2024-09-19T14:13:51.586 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.580+0000 7fc739d13640 0 -- 172.21.15.153:0/3946155215 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x55bfeaceb340 msgr2=0x55bfeaced730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:51.592 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.588+0000 7fc73a514640 0 -- 172.21.15.153:0/3946155215 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fc730008040 msgr2=0x7fc730065750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:51.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.596+0000 7fc73ca0e9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:13:51.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.596+0000 7fc73ca0e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:13:51.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.596+0000 7fc73ca0e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:13:51.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.596+0000 7fc73ca0e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:13:51.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.596+0000 7fc73ca0e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:13:51.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.596+0000 7fc73ca0e9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:13:51.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.596+0000 7fc73ca0e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.596+0000 7fc73ca0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.600 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.596+0000 7fc73ca0e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.596+0000 7fc73ca0e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:51.601 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.596+0000 7fc73ca0e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.603 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.596+0000 7fc73ca0e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:13:51.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.596+0000 7fc73ca0e9c0 20 zone default found 2024-09-19T14:13:51.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.596+0000 7fc73ca0e9c0 4 Realm: () 2024-09-19T14:13:51.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.596+0000 7fc73ca0e9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:13:51.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.596+0000 7fc73ca0e9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:13:51.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.596+0000 7fc73ca0e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:13:51.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.596+0000 7fc73ca0e9c0 20 zonegroup default 2024-09-19T14:13:51.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.596+0000 7fc73ca0e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.596+0000 7fc73ca0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.596+0000 7fc73ca0e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.600+0000 7fc73ca0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.600+0000 7fc73ca0e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.600+0000 7fc73ca0e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.600+0000 7fc73ca0e9c0 20 started sync module instance, tier type = 2024-09-19T14:13:51.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.600+0000 7fc73ca0e9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:13:51.618 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.612+0000 7fc73ca0e9c0 20 add_watcher() i=0 2024-09-19T14:13:51.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.612+0000 7fc73ca0e9c0 20 add_watcher() i=1 2024-09-19T14:13:51.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.612+0000 7fc73ca0e9c0 20 add_watcher() i=2 2024-09-19T14:13:51.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.612+0000 7fc73ca0e9c0 20 add_watcher() i=3 2024-09-19T14:13:51.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.612+0000 7fc73ca0e9c0 20 add_watcher() i=4 2024-09-19T14:13:51.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.612+0000 7fc73ca0e9c0 20 add_watcher() i=5 2024-09-19T14:13:51.619 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.612+0000 7fc73ca0e9c0 20 add_watcher() i=6 2024-09-19T14:13:51.620 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.616+0000 7fc73ca0e9c0 20 add_watcher() i=7 2024-09-19T14:13:51.620 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.616+0000 7fc73ca0e9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:13:51.621 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.616+0000 7fc5f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:51.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.616+0000 7fc73ca0e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:13:51.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.616+0000 7fc73ca0e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:13:51.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.616+0000 7fc73ca0e9c0 5 note: GC not initialized 2024-09-19T14:13:51.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.616+0000 7fc56b7fe640 20 reqs_thread_entry: start 2024-09-19T14:13:51.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.616+0000 7fc73ca0e9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:13:51.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.616+0000 7fc73ca0e9c0 20 Filter name: none 2024-09-19T14:13:51.622 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.616+0000 7fc5697fa640 20 reqs_thread_entry: start 2024-09-19T14:13:51.623 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.620+0000 7fc73ca0e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.623 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.620+0000 7fc73ca0e9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-19T14:13:51.623 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.620+0000 7fc73ca0e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.624 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.620+0000 7fc73ca0e9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-19T14:13:51.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.620+0000 7fc73ca0e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:13:51.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.620+0000 7fc73ca0e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.620+0000 7fc73ca0e9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-19T14:13:51.625 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.620+0000 7fc73ca0e9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.626 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.620+0000 7fc73ca0e9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-19T14:13:51.626 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.620+0000 7fc73ca0e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:13:51.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.624+0000 7fc5f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:51.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.628+0000 7fc73ca0e9c0 20 remove_watcher() i=0 2024-09-19T14:13:51.633 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.628+0000 7fc73ca0e9c0 2 removed watcher, disabling cache 2024-09-19T14:13:51.635 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.632+0000 7fc73ca0e9c0 20 remove_watcher() i=1 2024-09-19T14:13:51.637 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.632+0000 7fc73ca0e9c0 20 remove_watcher() i=2 2024-09-19T14:13:51.639 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.636+0000 7fc73ca0e9c0 20 remove_watcher() i=3 2024-09-19T14:13:51.641 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.636+0000 7fc73ca0e9c0 20 remove_watcher() i=4 2024-09-19T14:13:51.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.640+0000 7fc73ca0e9c0 20 remove_watcher() i=5 2024-09-19T14:13:51.643 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.640+0000 7fc73ca0e9c0 20 remove_watcher() i=6 2024-09-19T14:13:51.645 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.640+0000 7fc73ca0e9c0 20 remove_watcher() i=7 2024-09-19T14:13:51.658 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:51.658 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:13:51.658 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: myver id: dbb1da81-49d0-421a-b677-974869a7f103.4620.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-19T14:13:51.658 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:51.658 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-19T14:13:51.687 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:13:51.687 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:13:51.730 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.724+0000 7f163a7dd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.732 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.728+0000 7f163a7dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.732 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.728+0000 7f163a7dd9c0 20 realm 2024-09-19T14:13:51.732 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.728+0000 7f163a7dd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.732 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.728+0000 7f163a7dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.732 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.728+0000 7f163a7dd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:13:51.732 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.728+0000 7f163a7dd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.732 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.728+0000 7f163a7dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.732 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.728+0000 7f163a7dd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.728+0000 7f163a7dd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:51.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.728+0000 7f163a7dd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.728+0000 7f163a7dd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:13:51.734 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.728+0000 7f163a7dd9c0 20 searching for the correct realm 2024-09-19T14:13:51.741 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.736+0000 7f1638ae4640 0 -- 172.21.15.153:0/1472513823 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7f162006ebd0 msgr2=0x7f1620063470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:51.957 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.952+0000 7f16382e3640 0 -- 172.21.15.153:0/1472513823 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x5650863f3d50 msgr2=0x5650863f6140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:51.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.960+0000 7f163a7dd9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:13:51.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.960+0000 7f163a7dd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:13:51.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.960+0000 7f163a7dd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:13:51.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.960+0000 7f163a7dd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:13:51.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.960+0000 7f163a7dd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:13:51.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.960+0000 7f163a7dd9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:13:51.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.960+0000 7f163a7dd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.960+0000 7f163a7dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.960+0000 7f163a7dd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.960+0000 7f163a7dd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:51.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.960+0000 7f163a7dd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.967 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.964+0000 7f163a7dd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:13:51.967 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.964+0000 7f163a7dd9c0 20 zone default found 2024-09-19T14:13:51.967 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.964+0000 7f163a7dd9c0 4 Realm: () 2024-09-19T14:13:51.967 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.964+0000 7f163a7dd9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:13:51.967 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.964+0000 7f163a7dd9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:13:51.967 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.964+0000 7f163a7dd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:13:51.967 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.964+0000 7f163a7dd9c0 20 zonegroup default 2024-09-19T14:13:51.967 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.964+0000 7f163a7dd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.964+0000 7f163a7dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.964+0000 7f163a7dd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.964+0000 7f163a7dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.964+0000 7f163a7dd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:51.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.964+0000 7f163a7dd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:51.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.964+0000 7f163a7dd9c0 20 started sync module instance, tier type = 2024-09-19T14:13:51.969 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.964+0000 7f163a7dd9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:13:51.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.988+0000 7f163a7dd9c0 20 add_watcher() i=0 2024-09-19T14:13:51.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.988+0000 7f163a7dd9c0 20 add_watcher() i=1 2024-09-19T14:13:51.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.988+0000 7f163a7dd9c0 20 add_watcher() i=2 2024-09-19T14:13:51.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.988+0000 7f163a7dd9c0 20 add_watcher() i=3 2024-09-19T14:13:51.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.988+0000 7f163a7dd9c0 20 add_watcher() i=4 2024-09-19T14:13:51.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.988+0000 7f163a7dd9c0 20 add_watcher() i=5 2024-09-19T14:13:51.993 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.988+0000 7f163a7dd9c0 20 add_watcher() i=6 2024-09-19T14:13:51.995 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.992+0000 7f163a7dd9c0 20 add_watcher() i=7 2024-09-19T14:13:51.995 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.992+0000 7f163a7dd9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:13:51.999 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.996+0000 7f14eefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:52.001 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.996+0000 7f163a7dd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:13:52.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.996+0000 7f163a7dd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:13:52.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.996+0000 7f163a7dd9c0 5 note: GC not initialized 2024-09-19T14:13:52.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.996+0000 7f14edfdb640 20 reqs_thread_entry: start 2024-09-19T14:13:52.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.996+0000 7f163a7dd9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:13:52.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.996+0000 7f163a7dd9c0 20 Filter name: none 2024-09-19T14:13:52.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.996+0000 7f145f7fe640 20 reqs_thread_entry: start 2024-09-19T14:13:52.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.996+0000 7f163a7dd9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-19T14:13:52.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.996+0000 7f163a7dd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:52.004 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.996+0000 7f163a7dd9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-19T14:13:52.004 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.996+0000 7f163a7dd9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-19T14:13:52.004 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.996+0000 7f163a7dd9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-19T14:13:52.005 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.996+0000 7f163a7dd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 : miss 2024-09-19T14:13:52.005 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:51.996+0000 7f163a7dd9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:52.005 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.000+0000 7f163a7dd9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-19T14:13:52.005 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.000+0000 7f163a7dd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 info.flags=0x17 2024-09-19T14:13:52.005 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.000+0000 7f163a7dd9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 to cache LRU end 2024-09-19T14:13:52.006 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.000+0000 7f163a7dd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:13:52.006 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.000+0000 7f163a7dd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:52.006 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.000+0000 7f163a7dd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 2024-09-19T14:13:52.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.012+0000 7f163a7dd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 info.flags=0x17 2024-09-19T14:13:52.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.012+0000 7f163a7dd9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 to cache LRU end 2024-09-19T14:13:52.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.012+0000 7f163a7dd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:52.016 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.012+0000 7f163a7dd9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18, ofs0, ns] 2024-09-19T14:13:52.016 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.012+0000 7f150f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333530 cookie 94903849713088 notifier 8421 bl.length()=821 2024-09-19T14:13:52.017 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.012+0000 7f150f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 info.flags=0x17 2024-09-19T14:13:52.017 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.012+0000 7f150f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 to cache LRU end 2024-09-19T14:13:52.017 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.012+0000 7f150f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:52.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.012+0000 7f163a7dd9c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): orig_sources= new_sources= 2024-09-19T14:13:52.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.012+0000 7f163a7dd9c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): potential sources added=[] removed=[] 2024-09-19T14:13:52.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.012+0000 7f163a7dd9c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): orig_dests= new_dests= 2024-09-19T14:13:52.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.012+0000 7f163a7dd9c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): potential dests added=[] removed=[] 2024-09-19T14:13:52.030 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.0 2024-09-19T14:13:52.030 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.0 2024-09-19T14:13:52.030 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.1 2024-09-19T14:13:52.030 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.1 2024-09-19T14:13:52.031 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.2 2024-09-19T14:13:52.031 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.2 2024-09-19T14:13:52.031 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.3 2024-09-19T14:13:52.031 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.3 2024-09-19T14:13:52.031 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.4 2024-09-19T14:13:52.031 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.4 2024-09-19T14:13:52.032 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.5 2024-09-19T14:13:52.032 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.5 2024-09-19T14:13:52.032 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.6 2024-09-19T14:13:52.032 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.6 2024-09-19T14:13:52.032 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.7 2024-09-19T14:13:52.033 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.7 2024-09-19T14:13:52.033 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.8 2024-09-19T14:13:52.033 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.8 2024-09-19T14:13:52.033 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.9 2024-09-19T14:13:52.033 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.9 2024-09-19T14:13:52.033 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.10 2024-09-19T14:13:52.034 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.10 2024-09-19T14:13:52.034 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.11 2024-09-19T14:13:52.034 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.11 2024-09-19T14:13:52.034 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.0 2024-09-19T14:13:52.034 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.024+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1 2024-09-19T14:13:52.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.028+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2 2024-09-19T14:13:52.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.028+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3 2024-09-19T14:13:52.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.028+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.4 2024-09-19T14:13:52.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.028+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.5 2024-09-19T14:13:52.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.028+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.6 2024-09-19T14:13:52.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.032+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.7 2024-09-19T14:13:52.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.032+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.8 2024-09-19T14:13:52.037 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.032+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.9 2024-09-19T14:13:52.038 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.032+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.10 2024-09-19T14:13:52.039 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.036+0000 7f163a7dd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 : hit (requested=0x17, cached=0x17) 2024-09-19T14:13:52.039 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.036+0000 7f163a7dd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 2024-09-19T14:13:52.042 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.040+0000 7f163a7dd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 info.flags=0x17 2024-09-19T14:13:52.042 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.040+0000 7f163a7dd9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 to cache LRU end 2024-09-19T14:13:52.042 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.040+0000 7f163a7dd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:52.042 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.040+0000 7f163a7dd9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18, ofs0, ns] 2024-09-19T14:13:52.043 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.040+0000 7f150f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333531 cookie 94903849713088 notifier 8421 bl.length()=821 2024-09-19T14:13:52.043 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.040+0000 7f150f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 info.flags=0x17 2024-09-19T14:13:52.043 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.040+0000 7f150f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 to cache LRU end 2024-09-19T14:13:52.043 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.040+0000 7f150f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:52.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.044+0000 7f163a7dd9c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): orig_sources= new_sources= 2024-09-19T14:13:52.046 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.044+0000 7f163a7dd9c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): potential sources added=[] removed=[] 2024-09-19T14:13:52.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.044+0000 7f163a7dd9c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): orig_dests= new_dests= 2024-09-19T14:13:52.047 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.044+0000 7f163a7dd9c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): potential dests added=[] removed=[] 2024-09-19T14:13:52.051 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.048+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.0 2024-09-19T14:13:52.051 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.048+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1 2024-09-19T14:13:52.052 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.048+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2 2024-09-19T14:13:52.052 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.048+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3 2024-09-19T14:13:52.053 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.048+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.4 2024-09-19T14:13:52.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.048+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.5 2024-09-19T14:13:52.054 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.052+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.6 2024-09-19T14:13:52.055 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.052+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.7 2024-09-19T14:13:52.056 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.052+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.8 2024-09-19T14:13:52.056 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.052+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.9 2024-09-19T14:13:52.057 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.052+0000 7f163a7dd9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.10 2024-09-19T14:13:52.059 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.056+0000 7f163a7dd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 : hit (requested=0x17, cached=0x17) 2024-09-19T14:13:52.059 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.056+0000 7f163a7dd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 2024-09-19T14:13:52.062 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.056+0000 7f163a7dd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 info.flags=0x17 2024-09-19T14:13:52.062 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.056+0000 7f163a7dd9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 to cache LRU end 2024-09-19T14:13:52.062 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.056+0000 7f163a7dd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:52.062 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.056+0000 7f163a7dd9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18, ofs0, ns] 2024-09-19T14:13:52.063 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.060+0000 7f150effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333532 cookie 94903849713088 notifier 8421 bl.length()=789 2024-09-19T14:13:52.063 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.060+0000 7f150effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 info.flags=0x17 2024-09-19T14:13:52.063 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.060+0000 7f150effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 to cache LRU end 2024-09-19T14:13:52.063 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.060+0000 7f150effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:52.065 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.060+0000 7f163a7dd9c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): orig_sources= new_sources= 2024-09-19T14:13:52.065 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.060+0000 7f163a7dd9c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): potential sources added=[] removed=[] 2024-09-19T14:13:52.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.060+0000 7f163a7dd9c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): orig_dests= new_dests= 2024-09-19T14:13:52.066 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.060+0000 7f163a7dd9c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): potential dests added=[] removed=[] 2024-09-19T14:13:52.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.068+0000 7f163a7dd9c0 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-19T14:13:52.075 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.072+0000 7f14eefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:52.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.076+0000 7f163a7dd9c0 20 remove_watcher() i=0 2024-09-19T14:13:52.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.076+0000 7f163a7dd9c0 2 removed watcher, disabling cache 2024-09-19T14:13:52.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.076+0000 7f163a7dd9c0 20 remove_watcher() i=1 2024-09-19T14:13:52.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.080+0000 7f163a7dd9c0 20 remove_watcher() i=2 2024-09-19T14:13:52.086 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.084+0000 7f163a7dd9c0 20 remove_watcher() i=3 2024-09-19T14:13:52.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.084+0000 7f163a7dd9c0 20 remove_watcher() i=4 2024-09-19T14:13:52.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.084+0000 7f163a7dd9c0 20 remove_watcher() i=5 2024-09-19T14:13:52.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.088+0000 7f163a7dd9c0 20 remove_watcher() i=6 2024-09-19T14:13:52.092 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.088+0000 7f163a7dd9c0 20 remove_watcher() i=7 2024-09-19T14:13:52.108 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket myver 2024-09-19T14:13:52.138 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:13:52.138 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:13:52.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.180+0000 7faa89a599c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:52.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.180+0000 7faa89a599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:52.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.180+0000 7faa89a599c0 20 realm 2024-09-19T14:13:52.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.180+0000 7faa89a599c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:52.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.180+0000 7faa89a599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:52.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.180+0000 7faa89a599c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:13:52.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.180+0000 7faa89a599c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:52.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.180+0000 7faa89a599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:52.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.180+0000 7faa89a599c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:52.186 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.184+0000 7faa89a599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:52.186 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.184+0000 7faa89a599c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:52.187 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.184+0000 7faa89a599c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:13:52.187 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.184+0000 7faa89a599c0 20 searching for the correct realm 2024-09-19T14:13:52.192 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.188+0000 7faa86d5e640 0 -- 172.21.15.153:0/223722568 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7faa781383a0 msgr2=0x7faa780df940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:52.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.196+0000 7faa8755f640 0 -- 172.21.15.153:0/223722568 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7faa7c0702a0 msgr2=0x7faa7c06a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:52.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.412+0000 7faa89a599c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:13:52.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.412+0000 7faa89a599c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:13:52.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.412+0000 7faa89a599c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:13:52.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.412+0000 7faa89a599c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:13:52.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.412+0000 7faa89a599c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:13:52.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.412+0000 7faa89a599c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:13:52.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.412+0000 7faa89a599c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:52.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.416+0000 7faa89a599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:52.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.416+0000 7faa89a599c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:52.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.416+0000 7faa89a599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:52.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.416+0000 7faa89a599c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:52.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.416+0000 7faa89a599c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:13:52.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.416+0000 7faa89a599c0 20 zone default found 2024-09-19T14:13:52.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.416+0000 7faa89a599c0 4 Realm: () 2024-09-19T14:13:52.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.416+0000 7faa89a599c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:13:52.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.416+0000 7faa89a599c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:13:52.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.416+0000 7faa89a599c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:13:52.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.416+0000 7faa89a599c0 20 zonegroup default 2024-09-19T14:13:52.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.416+0000 7faa89a599c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:52.421 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.416+0000 7faa89a599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:52.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.416+0000 7faa89a599c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:52.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.420+0000 7faa89a599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:52.422 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.420+0000 7faa89a599c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:52.423 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.420+0000 7faa89a599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:52.423 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.420+0000 7faa89a599c0 20 started sync module instance, tier type = 2024-09-19T14:13:52.423 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.420+0000 7faa89a599c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:13:52.446 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.440+0000 7faa89a599c0 20 add_watcher() i=0 2024-09-19T14:13:52.446 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.440+0000 7faa89a599c0 20 add_watcher() i=1 2024-09-19T14:13:52.446 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.440+0000 7faa89a599c0 20 add_watcher() i=2 2024-09-19T14:13:52.446 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.440+0000 7faa89a599c0 20 add_watcher() i=3 2024-09-19T14:13:52.446 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.440+0000 7faa89a599c0 20 add_watcher() i=4 2024-09-19T14:13:52.446 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.440+0000 7faa89a599c0 20 add_watcher() i=5 2024-09-19T14:13:52.446 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.440+0000 7faa89a599c0 20 add_watcher() i=6 2024-09-19T14:13:52.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.444+0000 7faa89a599c0 20 add_watcher() i=7 2024-09-19T14:13:52.448 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.444+0000 7faa89a599c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:13:52.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.448+0000 7fa93dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:52.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.448+0000 7faa89a599c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:13:52.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.448+0000 7faa89a599c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:13:52.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.448+0000 7faa89a599c0 5 note: GC not initialized 2024-09-19T14:13:52.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.448+0000 7fa93cfe1640 20 reqs_thread_entry: start 2024-09-19T14:13:52.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.448+0000 7faa89a599c0 20 init_complete bucket index max shards: 11 2024-09-19T14:13:52.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.448+0000 7faa89a599c0 20 Filter name: none 2024-09-19T14:13:52.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.448+0000 7fa8b67fc640 20 reqs_thread_entry: start 2024-09-19T14:13:52.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.448+0000 7faa89a599c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:52.455 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.452+0000 7faa89a599c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-19T14:13:52.455 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.452+0000 7faa89a599c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:52.456 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.452+0000 7faa89a599c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-19T14:13:52.456 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.452+0000 7faa89a599c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:13:52.456 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.452+0000 7faa89a599c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:52.457 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.452+0000 7faa89a599c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-19T14:13:52.457 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.452+0000 7faa89a599c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:52.458 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.452+0000 7faa89a599c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-19T14:13:52.458 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.452+0000 7faa89a599c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:13:52.461 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.456+0000 7fa93dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:52.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.460+0000 7faa89a599c0 20 remove_watcher() i=0 2024-09-19T14:13:52.466 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.460+0000 7faa89a599c0 2 removed watcher, disabling cache 2024-09-19T14:13:52.468 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.464+0000 7faa89a599c0 20 remove_watcher() i=1 2024-09-19T14:13:52.470 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.468+0000 7faa89a599c0 20 remove_watcher() i=2 2024-09-19T14:13:52.472 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.468+0000 7faa89a599c0 20 remove_watcher() i=3 2024-09-19T14:13:52.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.472+0000 7faa89a599c0 20 remove_watcher() i=4 2024-09-19T14:13:52.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.472+0000 7faa89a599c0 20 remove_watcher() i=5 2024-09-19T14:13:52.477 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.472+0000 7faa89a599c0 20 remove_watcher() i=6 2024-09-19T14:13:52.479 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:52.476+0000 7faa89a599c0 20 remove_watcher() i=7 2024-09-19T14:13:52.495 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:52.495 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:13:52.495 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: myver id: dbb1da81-49d0-421a-b677-974869a7f103.4620.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-19T14:13:52.496 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:52.499 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:13:52.499 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:13:52.523 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:13:52.523 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:13:52.583 INFO:tasks.workunit.client.0.smithi153.stderr: test: reshard removes olh entries with empty name 2024-09-19T14:13:52.588 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:13:52.588 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:13:52.734 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:13:52.734 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:13:53.413 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-19T14:13:53.445 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:13:53.445 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:13:53.494 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.488+0000 7f96fb8399c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.496 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.492+0000 7f96fb8399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:53.496 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.492+0000 7f96fb8399c0 20 realm 2024-09-19T14:13:53.496 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.492+0000 7f96fb8399c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.492+0000 7f96fb8399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:53.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.492+0000 7f96fb8399c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:13:53.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.492+0000 7f96fb8399c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.492+0000 7f96fb8399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:53.497 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.492+0000 7f96fb8399c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.496+0000 7f96fb8399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:53.499 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.496+0000 7f96fb8399c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.496+0000 7f96fb8399c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:13:53.500 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.496+0000 7f96fb8399c0 20 searching for the correct realm 2024-09-19T14:13:53.506 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.500+0000 7f96f9b40640 0 -- 172.21.15.153:0/350149826 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x56469ad6e710 msgr2=0x56469ad70ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:53.512 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.508+0000 7f96f8b3e640 0 -- 172.21.15.153:0/350149826 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f96ec0022e0 msgr2=0x7f96ec124150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:53.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.516+0000 7f96fb8399c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:13:53.519 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.516+0000 7f96fb8399c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:13:53.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.516+0000 7f96fb8399c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:13:53.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.516+0000 7f96fb8399c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:13:53.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.516+0000 7f96fb8399c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:13:53.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.516+0000 7f96fb8399c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:13:53.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.516+0000 7f96fb8399c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.516+0000 7f96fb8399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:53.520 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.516+0000 7f96fb8399c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.516+0000 7f96fb8399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:53.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.516+0000 7f96fb8399c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.516+0000 7f96fb8399c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:13:53.521 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.516+0000 7f96fb8399c0 20 zone default found 2024-09-19T14:13:53.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.516+0000 7f96fb8399c0 4 Realm: () 2024-09-19T14:13:53.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.516+0000 7f96fb8399c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:13:53.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.516+0000 7f96fb8399c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:13:53.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.516+0000 7f96fb8399c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:13:53.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.516+0000 7f96fb8399c0 20 zonegroup default 2024-09-19T14:13:53.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.516+0000 7f96fb8399c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.516+0000 7f96fb8399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:53.522 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.516+0000 7f96fb8399c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.520+0000 7f96fb8399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:53.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.520+0000 7f96fb8399c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.520+0000 7f96fb8399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:53.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.520+0000 7f96fb8399c0 20 started sync module instance, tier type = 2024-09-19T14:13:53.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.520+0000 7f96fb8399c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:13:53.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.536+0000 7f96fb8399c0 20 add_watcher() i=0 2024-09-19T14:13:53.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.536+0000 7f96fb8399c0 20 add_watcher() i=1 2024-09-19T14:13:53.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.536+0000 7f96fb8399c0 20 add_watcher() i=2 2024-09-19T14:13:53.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.536+0000 7f96fb8399c0 20 add_watcher() i=3 2024-09-19T14:13:53.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.536+0000 7f96fb8399c0 20 add_watcher() i=4 2024-09-19T14:13:53.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.536+0000 7f96fb8399c0 20 add_watcher() i=5 2024-09-19T14:13:53.540 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.536+0000 7f96fb8399c0 20 add_watcher() i=6 2024-09-19T14:13:53.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.536+0000 7f96fb8399c0 20 add_watcher() i=7 2024-09-19T14:13:53.541 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.536+0000 7f96fb8399c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:13:53.544 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.540+0000 7f95affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:53.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.540+0000 7f96fb8399c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:13:53.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.540+0000 7f96fb8399c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:13:53.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.540+0000 7f96fb8399c0 5 note: GC not initialized 2024-09-19T14:13:53.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.540+0000 7f95aefe5640 20 reqs_thread_entry: start 2024-09-19T14:13:53.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.540+0000 7f96fb8399c0 20 init_complete bucket index max shards: 11 2024-09-19T14:13:53.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.540+0000 7f96fb8399c0 20 Filter name: none 2024-09-19T14:13:53.545 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.540+0000 7f95acfe1640 20 reqs_thread_entry: start 2024-09-19T14:13:53.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.540+0000 7f96fb8399c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.540+0000 7f96fb8399c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:13:53.546 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.540+0000 7f96fb8399c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.544+0000 7f96fb8399c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:13:53.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.544+0000 7f96fb8399c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:13:53.547 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.544+0000 7f96fb8399c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.544+0000 7f96fb8399c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:13:53.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.544+0000 7f96fb8399c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.544+0000 7f96fb8399c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:13:53.548 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.544+0000 7f96fb8399c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:13:53.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.548+0000 7f95affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:53.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.552+0000 7f96fb8399c0 20 remove_watcher() i=0 2024-09-19T14:13:53.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.552+0000 7f96fb8399c0 2 removed watcher, disabling cache 2024-09-19T14:13:53.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.552+0000 7f96fb8399c0 20 remove_watcher() i=1 2024-09-19T14:13:53.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.556+0000 7f96fb8399c0 20 remove_watcher() i=2 2024-09-19T14:13:53.562 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.560+0000 7f96fb8399c0 20 remove_watcher() i=3 2024-09-19T14:13:53.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.560+0000 7f96fb8399c0 20 remove_watcher() i=4 2024-09-19T14:13:53.566 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.564+0000 7f96fb8399c0 20 remove_watcher() i=5 2024-09-19T14:13:53.567 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.564+0000 7f96fb8399c0 20 remove_watcher() i=6 2024-09-19T14:13:53.569 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.564+0000 7f96fb8399c0 20 remove_watcher() i=7 2024-09-19T14:13:53.583 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:53.583 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:13:53.583 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: a-bucket id: dbb1da81-49d0-421a-b677-974869a7f103.4620.17 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-19T14:13:53.584 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:53.584 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-19T14:13:53.611 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:13:53.611 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:13:53.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.652+0000 7f222f6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.652+0000 7f222f6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:53.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.652+0000 7f222f6d49c0 20 realm 2024-09-19T14:13:53.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.652+0000 7f222f6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.652+0000 7f222f6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:53.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.652+0000 7f222f6d49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:13:53.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.652+0000 7f222f6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.652+0000 7f222f6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:53.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.652+0000 7f222f6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.656+0000 7f222f6d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:53.659 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.656+0000 7f222f6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.660 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.656+0000 7f222f6d49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:13:53.660 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.656+0000 7f222f6d49c0 20 searching for the correct realm 2024-09-19T14:13:53.666 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.660+0000 7f222d9db640 0 -- 172.21.15.153:0/4196934199 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55a5c23a1740 msgr2=0x55a5c23a3bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:53.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.668+0000 7f222c9d9640 0 -- 172.21.15.153:0/4196934199 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x55a5c21fee40 msgr2=0x7f2220103080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:53.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:13:53.679 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:13:53.679 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:13:53.679 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:13:53.679 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:13:53.679 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:13:53.679 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.679 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:53.679 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.679 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:53.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:13:53.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 20 zone default found 2024-09-19T14:13:53.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 4 Realm: () 2024-09-19T14:13:53.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:13:53.681 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:13:53.681 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:13:53.681 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 20 zonegroup default 2024-09-19T14:13:53.681 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.681 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:53.681 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.682 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:53.682 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.682 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:53.682 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 20 started sync module instance, tier type = 2024-09-19T14:13:53.682 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.676+0000 7f222f6d49c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:13:53.696 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.692+0000 7f222f6d49c0 20 add_watcher() i=0 2024-09-19T14:13:53.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.692+0000 7f222f6d49c0 20 add_watcher() i=1 2024-09-19T14:13:53.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.692+0000 7f222f6d49c0 20 add_watcher() i=2 2024-09-19T14:13:53.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.692+0000 7f222f6d49c0 20 add_watcher() i=3 2024-09-19T14:13:53.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.692+0000 7f222f6d49c0 20 add_watcher() i=4 2024-09-19T14:13:53.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.692+0000 7f222f6d49c0 20 add_watcher() i=5 2024-09-19T14:13:53.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.692+0000 7f222f6d49c0 20 add_watcher() i=6 2024-09-19T14:13:53.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.692+0000 7f222f6d49c0 20 add_watcher() i=7 2024-09-19T14:13:53.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.692+0000 7f222f6d49c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:13:53.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.696+0000 7f20e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:53.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.696+0000 7f222f6d49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:13:53.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.696+0000 7f222f6d49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:13:53.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.696+0000 7f222f6d49c0 5 note: GC not initialized 2024-09-19T14:13:53.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.696+0000 7f20e27e4640 20 reqs_thread_entry: start 2024-09-19T14:13:53.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.696+0000 7f222f6d49c0 20 init_complete bucket index max shards: 11 2024-09-19T14:13:53.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.696+0000 7f222f6d49c0 20 Filter name: none 2024-09-19T14:13:53.701 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.696+0000 7f2053fff640 20 reqs_thread_entry: start 2024-09-19T14:13:53.702 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.696+0000 7f222f6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.702 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.696+0000 7f222f6d49c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:13:53.702 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.696+0000 7f222f6d49c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.702 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.700+0000 7f222f6d49c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:13:53.702 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.700+0000 7f222f6d49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:13:53.703 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.700+0000 7f20e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:53.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.704+0000 7f222f6d49c0 20 remove_watcher() i=0 2024-09-19T14:13:53.708 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.704+0000 7f222f6d49c0 2 removed watcher, disabling cache 2024-09-19T14:13:53.710 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.704+0000 7f222f6d49c0 20 remove_watcher() i=1 2024-09-19T14:13:53.712 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.708+0000 7f222f6d49c0 20 remove_watcher() i=2 2024-09-19T14:13:53.714 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.712+0000 7f222f6d49c0 20 remove_watcher() i=3 2024-09-19T14:13:53.716 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.712+0000 7f222f6d49c0 20 remove_watcher() i=4 2024-09-19T14:13:53.717 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.712+0000 7f222f6d49c0 20 remove_watcher() i=5 2024-09-19T14:13:53.718 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.716+0000 7f222f6d49c0 20 remove_watcher() i=6 2024-09-19T14:13:53.719 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.716+0000 7f222f6d49c0 20 remove_watcher() i=7 2024-09-19T14:13:53.733 INFO:tasks.workunit.client.0.smithi153.stderr:rados -p default.rgw.buckets.index setomapval .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-19T14:13:53.760 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:13:53.760 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:13:53.781 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-19T14:13:53.806 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:13:53.807 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:13:53.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.844+0000 7f0b2489b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.844+0000 7f0b2489b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:53.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.844+0000 7f0b2489b9c0 20 realm 2024-09-19T14:13:53.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.844+0000 7f0b2489b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.844+0000 7f0b2489b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:53.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.844+0000 7f0b2489b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:13:53.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.844+0000 7f0b2489b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.844+0000 7f0b2489b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:53.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.844+0000 7f0b2489b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.851 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.848+0000 7f0b2489b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:53.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.848+0000 7f0b2489b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:53.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.848+0000 7f0b2489b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:13:53.852 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.848+0000 7f0b2489b9c0 20 searching for the correct realm 2024-09-19T14:13:53.860 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:53.856+0000 7f0b22ba2640 0 -- 172.21.15.153:0/1869397759 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7f0b18072e80 msgr2=0x7f0b1806f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:54.076 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.072+0000 7f0b223a1640 0 -- 172.21.15.153:0/1869397759 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x56341dafe2a0 msgr2=0x56341db00690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:54.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.080+0000 7f0b2489b9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:13:54.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.080+0000 7f0b2489b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:13:54.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.080+0000 7f0b2489b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:13:54.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.080+0000 7f0b2489b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:13:54.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.080+0000 7f0b2489b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:13:54.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.080+0000 7f0b2489b9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:13:54.084 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.080+0000 7f0b2489b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.085 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.080+0000 7f0b2489b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:54.085 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.080+0000 7f0b2489b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.085 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.080+0000 7f0b2489b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:54.085 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.080+0000 7f0b2489b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.084+0000 7f0b2489b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:13:54.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.084+0000 7f0b2489b9c0 20 zone default found 2024-09-19T14:13:54.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.084+0000 7f0b2489b9c0 4 Realm: () 2024-09-19T14:13:54.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.084+0000 7f0b2489b9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:13:54.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.084+0000 7f0b2489b9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:13:54.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.084+0000 7f0b2489b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:13:54.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.084+0000 7f0b2489b9c0 20 zonegroup default 2024-09-19T14:13:54.087 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.084+0000 7f0b2489b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.084+0000 7f0b2489b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:54.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.084+0000 7f0b2489b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.084+0000 7f0b2489b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:54.088 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.084+0000 7f0b2489b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.084+0000 7f0b2489b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:54.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.084+0000 7f0b2489b9c0 20 started sync module instance, tier type = 2024-09-19T14:13:54.089 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.084+0000 7f0b2489b9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:13:54.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.108+0000 7f0b2489b9c0 20 add_watcher() i=0 2024-09-19T14:13:54.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.108+0000 7f0b2489b9c0 20 add_watcher() i=1 2024-09-19T14:13:54.112 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.108+0000 7f0b2489b9c0 20 add_watcher() i=2 2024-09-19T14:13:54.112 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.108+0000 7f0b2489b9c0 20 add_watcher() i=3 2024-09-19T14:13:54.112 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.108+0000 7f0b2489b9c0 20 add_watcher() i=4 2024-09-19T14:13:54.112 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.108+0000 7f0b2489b9c0 20 add_watcher() i=5 2024-09-19T14:13:54.112 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.108+0000 7f0b2489b9c0 20 add_watcher() i=6 2024-09-19T14:13:54.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.108+0000 7f0b2489b9c0 20 add_watcher() i=7 2024-09-19T14:13:54.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.108+0000 7f0b2489b9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:13:54.116 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.112+0000 7f09d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:54.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.112+0000 7f0b2489b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:13:54.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.112+0000 7f0b2489b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:13:54.118 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.112+0000 7f0b2489b9c0 5 note: GC not initialized 2024-09-19T14:13:54.119 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.112+0000 7f09537fe640 20 reqs_thread_entry: start 2024-09-19T14:13:54.119 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.116+0000 7f0b2489b9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:13:54.119 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.116+0000 7f0b2489b9c0 20 Filter name: none 2024-09-19T14:13:54.119 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.116+0000 7f09517fa640 20 reqs_thread_entry: start 2024-09-19T14:13:54.119 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.116+0000 7f0b2489b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.116+0000 7f0b2489b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:13:54.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.116+0000 7f0b2489b9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.116+0000 7f0b2489b9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:13:54.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.116+0000 7f0b2489b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:13:54.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.116+0000 7f0b2489b9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-19T14:13:54.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.116+0000 7f0b2489b9c0 20 INFO: main: starting shard=0 2024-09-19T14:13:54.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.116+0000 7f0b2489b9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:13:54.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.116+0000 7f0b2489b9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:13:54.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.120+0000 7f0b2489b9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-19T14:13:54.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.120+0000 7f0b2489b9c0 20 INFO: main: starting shard=1 2024-09-19T14:13:54.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.120+0000 7f0b2489b9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:13:54.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.120+0000 7f0b2489b9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:13:54.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.120+0000 7f0b2489b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:54.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.120+0000 7f0b2489b9c0 20 INFO: main: starting shard=2 2024-09-19T14:13:54.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.120+0000 7f0b2489b9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:13:54.124 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.120+0000 7f0b2489b9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:13:54.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.120+0000 7f0b2489b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:54.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.120+0000 7f0b2489b9c0 20 INFO: main: starting shard=3 2024-09-19T14:13:54.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.120+0000 7f0b2489b9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:13:54.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.120+0000 7f0b2489b9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:13:54.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.124+0000 7f0b2489b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:54.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.124+0000 7f0b2489b9c0 20 INFO: main: starting shard=4 2024-09-19T14:13:54.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.124+0000 7f0b2489b9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:13:54.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.124+0000 7f0b2489b9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:13:54.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.124+0000 7f0b2489b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:54.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.124+0000 7f0b2489b9c0 20 INFO: main: starting shard=5 2024-09-19T14:13:54.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.124+0000 7f0b2489b9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:13:54.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.124+0000 7f0b2489b9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:13:54.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.124+0000 7f0b2489b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:54.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.124+0000 7f0b2489b9c0 20 INFO: main: starting shard=6 2024-09-19T14:13:54.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.124+0000 7f0b2489b9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:13:54.128 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.124+0000 7f0b2489b9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:13:54.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.124+0000 7f0b2489b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:54.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.124+0000 7f0b2489b9c0 20 INFO: main: starting shard=7 2024-09-19T14:13:54.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.124+0000 7f0b2489b9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:13:54.130 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.124+0000 7f0b2489b9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:13:54.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.128+0000 7f0b2489b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:54.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.128+0000 7f0b2489b9c0 20 INFO: main: starting shard=8 2024-09-19T14:13:54.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.128+0000 7f0b2489b9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:13:54.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.128+0000 7f0b2489b9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:13:54.132 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.128+0000 7f0b2489b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:54.132 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.128+0000 7f0b2489b9c0 20 INFO: main: starting shard=9 2024-09-19T14:13:54.132 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.128+0000 7f0b2489b9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:13:54.132 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.128+0000 7f0b2489b9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:13:54.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.128+0000 7f0b2489b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:54.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.128+0000 7f0b2489b9c0 20 INFO: main: starting shard=10 2024-09-19T14:13:54.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.128+0000 7f0b2489b9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:13:54.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.128+0000 7f0b2489b9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:13:54.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.128+0000 7f0b2489b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:54.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.128+0000 7f0b2489b9c0 20 INFO: main: starting shard=11 2024-09-19T14:13:54.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.128+0000 7f0b2489b9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:13:54.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.128+0000 7f0b2489b9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:13:54.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.128+0000 7f0b2489b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:54.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.128+0000 7f0b2489b9c0 20 INFO: main: starting shard=12 2024-09-19T14:13:54.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.128+0000 7f0b2489b9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:13:54.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.128+0000 7f0b2489b9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:13:54.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.132+0000 7f0b2489b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:54.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.132+0000 7f0b2489b9c0 20 INFO: main: done 2024-09-19T14:13:54.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.132+0000 7f09d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:54.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.136+0000 7f0b2489b9c0 20 remove_watcher() i=0 2024-09-19T14:13:54.141 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.136+0000 7f0b2489b9c0 2 removed watcher, disabling cache 2024-09-19T14:13:54.143 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.140+0000 7f0b2489b9c0 20 remove_watcher() i=1 2024-09-19T14:13:54.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.140+0000 7f0b2489b9c0 20 remove_watcher() i=2 2024-09-19T14:13:54.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.144+0000 7f0b2489b9c0 20 remove_watcher() i=3 2024-09-19T14:13:54.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.148+0000 7f0b2489b9c0 20 remove_watcher() i=4 2024-09-19T14:13:54.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.148+0000 7f0b2489b9c0 20 remove_watcher() i=5 2024-09-19T14:13:54.154 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.152+0000 7f0b2489b9c0 20 remove_watcher() i=6 2024-09-19T14:13:54.155 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.152+0000 7f0b2489b9c0 20 remove_watcher() i=7 2024-09-19T14:13:54.171 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-19T14:13:54.206 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:13:54.206 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:13:54.252 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.248+0000 7f456e1d39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.248+0000 7f456e1d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:54.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.248+0000 7f456e1d39c0 20 realm 2024-09-19T14:13:54.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.248+0000 7f456e1d39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.253 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.248+0000 7f456e1d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:54.254 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.248+0000 7f456e1d39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:13:54.254 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.248+0000 7f456e1d39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.254 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.248+0000 7f456e1d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:54.254 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.248+0000 7f456e1d39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.255 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.252+0000 7f456e1d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:54.255 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.252+0000 7f456e1d39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.255 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.252+0000 7f456e1d39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:13:54.255 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.252+0000 7f456e1d39c0 20 searching for the correct realm 2024-09-19T14:13:54.258 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.256+0000 7f456b4d8640 0 -- 172.21.15.153:0/95934991 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f455c08e020 msgr2=0x7f455c05edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:54.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.472+0000 7f456bcd9640 0 -- 172.21.15.153:0/95934991 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f4560016410 msgr2=0x7f4560016890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:54.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.688+0000 7f456e1d39c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:13:54.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.688+0000 7f456e1d39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:13:54.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.688+0000 7f456e1d39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:13:54.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.688+0000 7f456e1d39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:13:54.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.688+0000 7f456e1d39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:13:54.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.688+0000 7f456e1d39c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:13:54.693 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.688+0000 7f456e1d39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.688+0000 7f456e1d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:54.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.688+0000 7f456e1d39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.688+0000 7f456e1d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:54.694 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.692+0000 7f456e1d39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.692+0000 7f456e1d39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:13:54.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.692+0000 7f456e1d39c0 20 zone default found 2024-09-19T14:13:54.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.692+0000 7f456e1d39c0 4 Realm: () 2024-09-19T14:13:54.695 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.692+0000 7f456e1d39c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:13:54.696 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.692+0000 7f456e1d39c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:13:54.696 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.692+0000 7f456e1d39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:13:54.696 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.692+0000 7f456e1d39c0 20 zonegroup default 2024-09-19T14:13:54.696 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.692+0000 7f456e1d39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.696 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.692+0000 7f456e1d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:54.696 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.692+0000 7f456e1d39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.692+0000 7f456e1d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:54.697 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.692+0000 7f456e1d39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.692+0000 7f456e1d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:54.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.692+0000 7f456e1d39c0 20 started sync module instance, tier type = 2024-09-19T14:13:54.698 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.692+0000 7f456e1d39c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:13:54.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.716+0000 7f456e1d39c0 20 add_watcher() i=0 2024-09-19T14:13:54.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.716+0000 7f456e1d39c0 20 add_watcher() i=1 2024-09-19T14:13:54.720 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.716+0000 7f456e1d39c0 20 add_watcher() i=2 2024-09-19T14:13:54.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.716+0000 7f456e1d39c0 20 add_watcher() i=3 2024-09-19T14:13:54.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.716+0000 7f456e1d39c0 20 add_watcher() i=4 2024-09-19T14:13:54.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.716+0000 7f456e1d39c0 20 add_watcher() i=5 2024-09-19T14:13:54.721 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.716+0000 7f456e1d39c0 20 add_watcher() i=6 2024-09-19T14:13:54.722 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.716+0000 7f456e1d39c0 20 add_watcher() i=7 2024-09-19T14:13:54.722 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.716+0000 7f456e1d39c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:13:54.725 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.720+0000 7f441dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:54.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.724+0000 7f456e1d39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:13:54.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.724+0000 7f456e1d39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:13:54.727 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.724+0000 7f456e1d39c0 5 note: GC not initialized 2024-09-19T14:13:54.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.724+0000 7f441cfe1640 20 reqs_thread_entry: start 2024-09-19T14:13:54.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.724+0000 7f456e1d39c0 20 init_complete bucket index max shards: 11 2024-09-19T14:13:54.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.724+0000 7f456e1d39c0 20 Filter name: none 2024-09-19T14:13:54.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.724+0000 7f43967fc640 20 reqs_thread_entry: start 2024-09-19T14:13:54.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.724+0000 7f456e1d39c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-19T14:13:54.728 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.724+0000 7f456e1d39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.724+0000 7f456e1d39c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:13:54.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.724+0000 7f456e1d39c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-19T14:13:54.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.724+0000 7f456e1d39c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-19T14:13:54.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.724+0000 7f456e1d39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : miss 2024-09-19T14:13:54.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.724+0000 7f456e1d39c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.729 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.724+0000 7f456e1d39c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:13:54.730 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.724+0000 7f456e1d39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:13:54.730 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.724+0000 7f456e1d39c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:13:54.730 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.724+0000 7f456e1d39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:13:54.730 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.724+0000 7f456e1d39c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:54.730 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.724+0000 7f456e1d39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:13:54.737 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.732+0000 7f456e1d39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:13:54.737 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.732+0000 7f456e1d39c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:13:54.737 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.732+0000 7f456e1d39c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:54.737 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.732+0000 7f456e1d39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17, ofs0, ns] 2024-09-19T14:13:54.737 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.732+0000 7f444a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333534 cookie 94899137309840 notifier 8526 bl.length()=827 2024-09-19T14:13:54.737 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.732+0000 7f444a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:13:54.737 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.732+0000 7f444a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:13:54.737 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.732+0000 7f444a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:54.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.736+0000 7f456e1d39c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_sources= new_sources= 2024-09-19T14:13:54.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.736+0000 7f456e1d39c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential sources added=[] removed=[] 2024-09-19T14:13:54.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.736+0000 7f456e1d39c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_dests= new_dests= 2024-09-19T14:13:54.739 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.736+0000 7f456e1d39c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential dests added=[] removed=[] 2024-09-19T14:13:54.753 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.748+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.0 2024-09-19T14:13:54.753 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.748+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.0 2024-09-19T14:13:54.753 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.748+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:13:54.753 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.748+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:13:54.754 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.748+0000 7f456e1d39c0 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-19T14:13:54.754 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.752+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:13:54.754 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.752+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:13:54.755 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.752+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:13:54.755 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.752+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:13:54.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.752+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:13:54.757 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.752+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:13:54.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.752+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:13:54.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.752+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:13:54.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.756+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:13:54.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.756+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:13:54.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.756+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:13:54.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.756+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:13:54.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.756+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:13:54.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.756+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:13:54.762 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.756+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:13:54.762 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.756+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:13:54.762 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.760+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:13:54.762 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.760+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:13:54.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.760+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:13:54.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.760+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:13:54.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.760+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:13:54.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.760+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:13:54.764 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.760+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:13:54.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.760+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:13:54.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.760+0000 7f456e1d39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : hit (requested=0x17, cached=0x17) 2024-09-19T14:13:54.765 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.760+0000 7f456e1d39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:13:54.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.764+0000 7f456e1d39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:13:54.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.764+0000 7f456e1d39c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:13:54.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.764+0000 7f456e1d39c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:54.767 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.764+0000 7f456e1d39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17, ofs0, ns] 2024-09-19T14:13:54.768 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.764+0000 7f444a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333535 cookie 94899137309840 notifier 8526 bl.length()=827 2024-09-19T14:13:54.768 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.764+0000 7f444a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:13:54.768 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.764+0000 7f444a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:13:54.768 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.764+0000 7f444a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:54.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.768+0000 7f456e1d39c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_sources= new_sources= 2024-09-19T14:13:54.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.768+0000 7f456e1d39c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential sources added=[] removed=[] 2024-09-19T14:13:54.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.768+0000 7f456e1d39c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_dests= new_dests= 2024-09-19T14:13:54.770 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.768+0000 7f456e1d39c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential dests added=[] removed=[] 2024-09-19T14:13:54.777 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.772+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:13:54.777 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.772+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.0 2024-09-19T14:13:54.778 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.772+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:13:54.778 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.772+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.1 2024-09-19T14:13:54.779 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.776+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:13:54.779 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.776+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.2 2024-09-19T14:13:54.780 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.776+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:13:54.780 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.776+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.3 2024-09-19T14:13:54.781 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.776+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:13:54.781 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.776+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.4 2024-09-19T14:13:54.782 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.776+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:13:54.782 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.776+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.5 2024-09-19T14:13:54.782 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.780+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:13:54.782 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.780+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.6 2024-09-19T14:13:54.783 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.780+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:13:54.783 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.780+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.7 2024-09-19T14:13:54.784 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.780+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:13:54.784 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.780+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.8 2024-09-19T14:13:54.784 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.780+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:13:54.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.780+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.9 2024-09-19T14:13:54.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.780+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:13:54.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.780+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.10 2024-09-19T14:13:54.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.780+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:13:54.785 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.780+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.11 2024-09-19T14:13:54.786 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.784+0000 7f456e1d39c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:13:54.786 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.784+0000 7f456e1d39c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.2.12 2024-09-19T14:13:54.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.784+0000 7f456e1d39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 : hit (requested=0x17, cached=0x17) 2024-09-19T14:13:54.787 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.784+0000 7f456e1d39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 2024-09-19T14:13:54.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.784+0000 7f456e1d39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:13:54.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.784+0000 7f456e1d39c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:13:54.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.784+0000 7f456e1d39c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:54.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.784+0000 7f456e1d39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17, ofs0, ns] 2024-09-19T14:13:54.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.784+0000 7f444affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333536 cookie 94899137309840 notifier 8526 bl.length()=795 2024-09-19T14:13:54.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.784+0000 7f444affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 info.flags=0x17 2024-09-19T14:13:54.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.784+0000 7f444affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.17 to cache LRU end 2024-09-19T14:13:54.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.784+0000 7f444affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:54.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.788+0000 7f456e1d39c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_sources= new_sources= 2024-09-19T14:13:54.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.788+0000 7f456e1d39c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential sources added=[] removed=[] 2024-09-19T14:13:54.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.788+0000 7f456e1d39c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): orig_dests= new_dests= 2024-09-19T14:13:54.792 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.788+0000 7f456e1d39c0 20 handle_bi_update(): bucket=:a-bucket[dbb1da81-49d0-421a-b677-974869a7f103.4620.17]): potential dests added=[] removed=[] 2024-09-19T14:13:54.799 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.796+0000 7f456e1d39c0 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-19T14:13:54.803 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.800+0000 7f441dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:54.807 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.804+0000 7f456e1d39c0 20 remove_watcher() i=0 2024-09-19T14:13:54.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.804+0000 7f456e1d39c0 2 removed watcher, disabling cache 2024-09-19T14:13:54.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.804+0000 7f456e1d39c0 20 remove_watcher() i=1 2024-09-19T14:13:54.812 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.808+0000 7f456e1d39c0 20 remove_watcher() i=2 2024-09-19T14:13:54.817 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.812+0000 7f456e1d39c0 20 remove_watcher() i=3 2024-09-19T14:13:54.822 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.816+0000 7f456e1d39c0 20 remove_watcher() i=4 2024-09-19T14:13:54.824 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.820+0000 7f456e1d39c0 20 remove_watcher() i=5 2024-09-19T14:13:54.825 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.820+0000 7f456e1d39c0 20 remove_watcher() i=6 2024-09-19T14:13:54.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.824+0000 7f456e1d39c0 20 remove_watcher() i=7 2024-09-19T14:13:54.845 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-19T14:13:54.871 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:13:54.872 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:13:54.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.912+0000 7f2a8f3ff9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.912+0000 7f2a8f3ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:54.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.912+0000 7f2a8f3ff9c0 20 realm 2024-09-19T14:13:54.917 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.912+0000 7f2a8f3ff9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.918 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.912+0000 7f2a8f3ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:54.918 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.912+0000 7f2a8f3ff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:13:54.918 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.912+0000 7f2a8f3ff9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.918 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.912+0000 7f2a8f3ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:54.918 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.912+0000 7f2a8f3ff9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.919 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.916+0000 7f2a8f3ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:54.919 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.916+0000 7f2a8f3ff9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.920 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.916+0000 7f2a8f3ff9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:13:54.920 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.916+0000 7f2a8f3ff9c0 20 searching for the correct realm 2024-09-19T14:13:54.925 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.920+0000 7f2a8d706640 0 -- 172.21.15.153:0/378503346 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x5597df514230 msgr2=0x5597df5166c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:54.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.928+0000 7f2a8c704640 0 -- 172.21.15.153:0/378503346 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f2a7c043070 msgr2=0x7f2a7c047950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:13:54.939 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.936+0000 7f2a8f3ff9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:13:54.940 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.936+0000 7f2a8f3ff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:13:54.940 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.936+0000 7f2a8f3ff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:13:54.940 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.936+0000 7f2a8f3ff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:13:54.940 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.936+0000 7f2a8f3ff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:13:54.940 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.936+0000 7f2a8f3ff9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:13:54.940 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.936+0000 7f2a8f3ff9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.941 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.936+0000 7f2a8f3ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:54.941 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.936+0000 7f2a8f3ff9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.941 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.936+0000 7f2a8f3ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:54.941 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.936+0000 7f2a8f3ff9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.942 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.936+0000 7f2a8f3ff9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:13:54.942 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.936+0000 7f2a8f3ff9c0 20 zone default found 2024-09-19T14:13:54.942 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.936+0000 7f2a8f3ff9c0 4 Realm: () 2024-09-19T14:13:54.942 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.936+0000 7f2a8f3ff9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:13:54.942 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.936+0000 7f2a8f3ff9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:13:54.943 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.936+0000 7f2a8f3ff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:13:54.943 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.936+0000 7f2a8f3ff9c0 20 zonegroup default 2024-09-19T14:13:54.943 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.936+0000 7f2a8f3ff9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.943 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.936+0000 7f2a8f3ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:54.943 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.936+0000 7f2a8f3ff9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.940+0000 7f2a8f3ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:54.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.940+0000 7f2a8f3ff9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.940+0000 7f2a8f3ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:54.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.940+0000 7f2a8f3ff9c0 20 started sync module instance, tier type = 2024-09-19T14:13:54.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.940+0000 7f2a8f3ff9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:13:54.958 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.956+0000 7f2a8f3ff9c0 20 add_watcher() i=0 2024-09-19T14:13:54.959 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.956+0000 7f2a8f3ff9c0 20 add_watcher() i=1 2024-09-19T14:13:54.959 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.956+0000 7f2a8f3ff9c0 20 add_watcher() i=2 2024-09-19T14:13:54.959 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.956+0000 7f2a8f3ff9c0 20 add_watcher() i=3 2024-09-19T14:13:54.959 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.956+0000 7f2a8f3ff9c0 20 add_watcher() i=4 2024-09-19T14:13:54.959 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.956+0000 7f2a8f3ff9c0 20 add_watcher() i=5 2024-09-19T14:13:54.959 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.956+0000 7f2a8f3ff9c0 20 add_watcher() i=6 2024-09-19T14:13:54.959 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.956+0000 7f2a8f3ff9c0 20 add_watcher() i=7 2024-09-19T14:13:54.959 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.956+0000 7f2a8f3ff9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:13:54.962 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.956+0000 7f29437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:54.962 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.960+0000 7f2a8f3ff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:13:54.962 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.960+0000 7f2a8f3ff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:13:54.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.960+0000 7f2a8f3ff9c0 5 note: GC not initialized 2024-09-19T14:13:54.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.960+0000 7f29427e4640 20 reqs_thread_entry: start 2024-09-19T14:13:54.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.960+0000 7f2a8f3ff9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:13:54.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.960+0000 7f2a8f3ff9c0 20 Filter name: none 2024-09-19T14:13:54.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.960+0000 7f293bfff640 20 reqs_thread_entry: start 2024-09-19T14:13:54.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.960+0000 7f2a8f3ff9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.960+0000 7f2a8f3ff9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-19T14:13:54.964 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.960+0000 7f2a8f3ff9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:54.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.960+0000 7f2a8f3ff9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-19T14:13:54.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.960+0000 7f2a8f3ff9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:13:54.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.960+0000 7f2a8f3ff9c0 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-19T14:13:54.965 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.960+0000 7f2a8f3ff9c0 20 INFO: main: starting shard=0 2024-09-19T14:13:54.966 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.960+0000 7f2a8f3ff9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.0 2024-09-19T14:13:54.966 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.960+0000 7f2a8f3ff9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.17.3.0 2024-09-19T14:13:54.966 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.960+0000 7f2a8f3ff9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:13:54.966 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.960+0000 7f2a8f3ff9c0 20 INFO: main: done 2024-09-19T14:13:54.966 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.964+0000 7f29437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:54.971 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.968+0000 7f2a8f3ff9c0 20 remove_watcher() i=0 2024-09-19T14:13:54.971 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.968+0000 7f2a8f3ff9c0 2 removed watcher, disabling cache 2024-09-19T14:13:54.974 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.968+0000 7f2a8f3ff9c0 20 remove_watcher() i=1 2024-09-19T14:13:54.976 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.972+0000 7f2a8f3ff9c0 20 remove_watcher() i=2 2024-09-19T14:13:54.978 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.972+0000 7f2a8f3ff9c0 20 remove_watcher() i=3 2024-09-19T14:13:54.980 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.976+0000 7f2a8f3ff9c0 20 remove_watcher() i=4 2024-09-19T14:13:54.981 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.976+0000 7f2a8f3ff9c0 20 remove_watcher() i=5 2024-09-19T14:13:54.982 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.980+0000 7f2a8f3ff9c0 20 remove_watcher() i=6 2024-09-19T14:13:54.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:54.980+0000 7f2a8f3ff9c0 20 remove_watcher() i=7 2024-09-19T14:13:54.997 INFO:tasks.workunit.client.0.smithi153.stderr: test: PUT succeeds during reshard 2024-09-19T14:13:54.997 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket myver 2024-09-19T14:13:55.024 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:13:55.024 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:13:55.069 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.064+0000 7f694f2709c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.069 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.064+0000 7f694f2709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:55.069 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.064+0000 7f694f2709c0 20 realm 2024-09-19T14:13:55.069 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.064+0000 7f694f2709c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.069 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.064+0000 7f694f2709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:55.069 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.064+0000 7f694f2709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:13:55.069 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.064+0000 7f694f2709c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.070 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.064+0000 7f694f2709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:55.070 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.064+0000 7f694f2709c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.068+0000 7f694f2709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:55.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.068+0000 7f694f2709c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.071 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.068+0000 7f694f2709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:13:55.072 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.068+0000 7f694f2709c0 20 searching for the correct realm 2024-09-19T14:13:55.077 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.072+0000 7f694c575640 0 -- 172.21.15.153:0/2712581098 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f693c08d070 msgr2=0x7f693c003b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:55.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.080+0000 7f694c575640 0 -- 172.21.15.153:0/2712581098 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f6818082320 msgr2=0x7f6818084750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:55.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.084+0000 7f694f2709c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:13:55.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.084+0000 7f694f2709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:13:55.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.084+0000 7f694f2709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:13:55.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.084+0000 7f694f2709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:13:55.090 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.084+0000 7f694f2709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:13:55.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.084+0000 7f694f2709c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:13:55.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.084+0000 7f694f2709c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.088+0000 7f694f2709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:55.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.088+0000 7f694f2709c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.088+0000 7f694f2709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:55.091 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.088+0000 7f694f2709c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.092 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.088+0000 7f694f2709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:13:55.092 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.088+0000 7f694f2709c0 20 zone default found 2024-09-19T14:13:55.092 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.088+0000 7f694f2709c0 4 Realm: () 2024-09-19T14:13:55.092 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.088+0000 7f694f2709c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:13:55.092 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.088+0000 7f694f2709c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:13:55.092 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.088+0000 7f694f2709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:13:55.092 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.088+0000 7f694f2709c0 20 zonegroup default 2024-09-19T14:13:55.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.088+0000 7f694f2709c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.088+0000 7f694f2709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:55.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.088+0000 7f694f2709c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.093 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.088+0000 7f694f2709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:55.094 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.088+0000 7f694f2709c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.094 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.088+0000 7f694f2709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:55.094 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.088+0000 7f694f2709c0 20 started sync module instance, tier type = 2024-09-19T14:13:55.094 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.088+0000 7f694f2709c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:13:55.109 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.104+0000 7f694f2709c0 20 add_watcher() i=0 2024-09-19T14:13:55.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.104+0000 7f694f2709c0 20 add_watcher() i=1 2024-09-19T14:13:55.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.104+0000 7f694f2709c0 20 add_watcher() i=2 2024-09-19T14:13:55.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.104+0000 7f694f2709c0 20 add_watcher() i=3 2024-09-19T14:13:55.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.104+0000 7f694f2709c0 20 add_watcher() i=4 2024-09-19T14:13:55.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.104+0000 7f694f2709c0 20 add_watcher() i=5 2024-09-19T14:13:55.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.104+0000 7f694f2709c0 20 add_watcher() i=6 2024-09-19T14:13:55.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.108+0000 7f694f2709c0 20 add_watcher() i=7 2024-09-19T14:13:55.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.108+0000 7f694f2709c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:13:55.112 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.108+0000 7f6802fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:55.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.108+0000 7f694f2709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:13:55.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.108+0000 7f694f2709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:13:55.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.108+0000 7f694f2709c0 5 note: GC not initialized 2024-09-19T14:13:55.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.108+0000 7f6801fe3640 20 reqs_thread_entry: start 2024-09-19T14:13:55.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.108+0000 7f694f2709c0 20 init_complete bucket index max shards: 11 2024-09-19T14:13:55.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.108+0000 7f694f2709c0 20 Filter name: none 2024-09-19T14:13:55.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.108+0000 7f67737fe640 20 reqs_thread_entry: start 2024-09-19T14:13:55.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.108+0000 7f694f2709c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.108+0000 7f694f2709c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-19T14:13:55.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.108+0000 7f694f2709c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.112+0000 7f694f2709c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-19T14:13:55.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.112+0000 7f694f2709c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:13:55.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.112+0000 7f694f2709c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.112+0000 7f694f2709c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-19T14:13:55.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.112+0000 7f694f2709c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.116 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.112+0000 7f694f2709c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-19T14:13:55.116 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.112+0000 7f694f2709c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:13:55.119 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.116+0000 7f6802fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:55.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.120+0000 7f694f2709c0 20 remove_watcher() i=0 2024-09-19T14:13:55.123 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.120+0000 7f694f2709c0 2 removed watcher, disabling cache 2024-09-19T14:13:55.125 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.120+0000 7f694f2709c0 20 remove_watcher() i=1 2024-09-19T14:13:55.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.124+0000 7f694f2709c0 20 remove_watcher() i=2 2024-09-19T14:13:55.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.124+0000 7f694f2709c0 20 remove_watcher() i=3 2024-09-19T14:13:55.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.128+0000 7f694f2709c0 20 remove_watcher() i=4 2024-09-19T14:13:55.133 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.128+0000 7f694f2709c0 20 remove_watcher() i=5 2024-09-19T14:13:55.134 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.128+0000 7f694f2709c0 20 remove_watcher() i=6 2024-09-19T14:13:55.135 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.132+0000 7f694f2709c0 20 remove_watcher() i=7 2024-09-19T14:13:55.148 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:55.149 INFO:tasks.workunit.client.0.smithi153.stderr:BUCKET_STATS: 2024-09-19T14:13:55.149 INFO:tasks.workunit.client.0.smithi153.stderr:bucket: myver id: dbb1da81-49d0-421a-b677-974869a7f103.4620.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-19T14:13:55.149 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:13:55.149 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-19T14:13:55.179 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:13:55.179 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:13:55.222 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.216+0000 7f9c16a2d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.220+0000 7f9c16a2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:55.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.220+0000 7f9c16a2d9c0 20 realm 2024-09-19T14:13:55.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.220+0000 7f9c16a2d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.220+0000 7f9c16a2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:55.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.220+0000 7f9c16a2d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:13:55.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.220+0000 7f9c16a2d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.224 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.220+0000 7f9c16a2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:55.225 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.220+0000 7f9c16a2d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.220+0000 7f9c16a2d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:55.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.220+0000 7f9c16a2d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.220+0000 7f9c16a2d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:13:55.226 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.224+0000 7f9c16a2d9c0 20 searching for the correct realm 2024-09-19T14:13:55.233 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.228+0000 7f9c13d32640 0 -- 172.21.15.153:0/3441800910 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f9c0c0ee040 msgr2=0x7f9c0c0df420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:55.239 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.236+0000 7f9c13d32640 0 -- 172.21.15.153:0/3441800910 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f9adc082310 msgr2=0x7f9adc084740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:13:55.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.240+0000 7f9c16a2d9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:13:55.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.240+0000 7f9c16a2d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:13:55.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.240+0000 7f9c16a2d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:13:55.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.240+0000 7f9c16a2d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:13:55.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.240+0000 7f9c16a2d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:13:55.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.240+0000 7f9c16a2d9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:13:55.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.240+0000 7f9c16a2d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.240+0000 7f9c16a2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:55.246 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.240+0000 7f9c16a2d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.247 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.244+0000 7f9c16a2d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:13:55.247 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.244+0000 7f9c16a2d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.244+0000 7f9c16a2d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:13:55.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.244+0000 7f9c16a2d9c0 20 zone default found 2024-09-19T14:13:55.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.244+0000 7f9c16a2d9c0 4 Realm: () 2024-09-19T14:13:55.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.244+0000 7f9c16a2d9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:13:55.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.244+0000 7f9c16a2d9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:13:55.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.244+0000 7f9c16a2d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:13:55.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.244+0000 7f9c16a2d9c0 20 zonegroup default 2024-09-19T14:13:55.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.244+0000 7f9c16a2d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.244+0000 7f9c16a2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:55.248 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.244+0000 7f9c16a2d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.244+0000 7f9c16a2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:55.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.244+0000 7f9c16a2d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.244+0000 7f9c16a2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:13:55.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.244+0000 7f9c16a2d9c0 20 started sync module instance, tier type = 2024-09-19T14:13:55.249 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.244+0000 7f9c16a2d9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:13:55.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.260+0000 7f9c16a2d9c0 20 add_watcher() i=0 2024-09-19T14:13:55.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.260+0000 7f9c16a2d9c0 20 add_watcher() i=1 2024-09-19T14:13:55.264 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.260+0000 7f9c16a2d9c0 20 add_watcher() i=2 2024-09-19T14:13:55.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.260+0000 7f9c16a2d9c0 20 add_watcher() i=3 2024-09-19T14:13:55.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.260+0000 7f9c16a2d9c0 20 add_watcher() i=4 2024-09-19T14:13:55.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.260+0000 7f9c16a2d9c0 20 add_watcher() i=5 2024-09-19T14:13:55.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.260+0000 7f9c16a2d9c0 20 add_watcher() i=6 2024-09-19T14:13:55.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.260+0000 7f9c16a2d9c0 20 add_watcher() i=7 2024-09-19T14:13:55.265 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.260+0000 7f9c16a2d9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:13:55.268 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.264+0000 7f9acb7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:13:55.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.264+0000 7f9c16a2d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:13:55.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.264+0000 7f9c16a2d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:13:55.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.264+0000 7f9c16a2d9c0 5 note: GC not initialized 2024-09-19T14:13:55.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.264+0000 7f9aca7dc640 20 reqs_thread_entry: start 2024-09-19T14:13:55.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.264+0000 7f9c16a2d9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:13:55.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.264+0000 7f9c16a2d9c0 20 Filter name: none 2024-09-19T14:13:55.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.264+0000 7f9ac37fe640 20 reqs_thread_entry: start 2024-09-19T14:13:55.269 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.264+0000 7f9c16a2d9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-19T14:13:55.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.264+0000 7f9c16a2d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.264+0000 7f9c16a2d9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-19T14:13:55.270 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.264+0000 7f9c16a2d9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-19T14:13:55.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.264+0000 7f9c16a2d9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-19T14:13:55.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.264+0000 7f9c16a2d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 : miss 2024-09-19T14:13:55.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.264+0000 7f9c16a2d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:13:55.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.268+0000 7f9c16a2d9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-19T14:13:55.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.268+0000 7f9c16a2d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 info.flags=0x17 2024-09-19T14:13:55.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.268+0000 7f9c16a2d9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 to cache LRU end 2024-09-19T14:13:55.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.268+0000 7f9c16a2d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:13:55.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.268+0000 7f9c16a2d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:55.271 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.268+0000 7f9c16a2d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 2024-09-19T14:13:55.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.276+0000 7f9c16a2d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 info.flags=0x17 2024-09-19T14:13:55.281 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.276+0000 7f9c16a2d9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 to cache LRU end 2024-09-19T14:13:55.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.276+0000 7f9c16a2d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:55.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.276+0000 7f9c16a2d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18, ofs0, ns] 2024-09-19T14:13:55.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.276+0000 7f9aeaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333537 cookie 94367804303600 notifier 8033 bl.length()=821 2024-09-19T14:13:55.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.276+0000 7f9aeaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 info.flags=0x17 2024-09-19T14:13:55.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.276+0000 7f9aeaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 to cache LRU end 2024-09-19T14:13:55.282 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.276+0000 7f9aeaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:13:55.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.280+0000 7f9c16a2d9c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): orig_sources= new_sources= 2024-09-19T14:13:55.283 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.280+0000 7f9c16a2d9c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): potential sources added=[] removed=[] 2024-09-19T14:13:55.284 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.280+0000 7f9c16a2d9c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): orig_dests= new_dests= 2024-09-19T14:13:55.284 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.280+0000 7f9c16a2d9c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): potential dests added=[] removed=[] 2024-09-19T14:13:55.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:13:55.292+0000 7f9c16a2d9c0 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-19T14:13:56.153 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:13:56.153 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:13:56.310 INFO:tasks.workunit.client.0.smithi153.stderr:put object successful 2024-09-19T14:14:00.297 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.0 2024-09-19T14:14:00.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.0 2024-09-19T14:14:00.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.1 2024-09-19T14:14:00.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.1 2024-09-19T14:14:00.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.2 2024-09-19T14:14:00.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.2 2024-09-19T14:14:00.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.3 2024-09-19T14:14:00.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.3 2024-09-19T14:14:00.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.4 2024-09-19T14:14:00.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.4 2024-09-19T14:14:00.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.5 2024-09-19T14:14:00.298 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.5 2024-09-19T14:14:00.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.6 2024-09-19T14:14:00.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.6 2024-09-19T14:14:00.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.7 2024-09-19T14:14:00.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.7 2024-09-19T14:14:00.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.8 2024-09-19T14:14:00.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.8 2024-09-19T14:14:00.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.9 2024-09-19T14:14:00.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.9 2024-09-19T14:14:00.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.10 2024-09-19T14:14:00.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.10 2024-09-19T14:14:00.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.11 2024-09-19T14:14:00.299 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.11 2024-09-19T14:14:00.300 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.12 2024-09-19T14:14:00.300 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.12 2024-09-19T14:14:00.300 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.0 2024-09-19T14:14:00.300 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.292+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.0 2024-09-19T14:14:00.300 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.296+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.1 2024-09-19T14:14:00.300 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.296+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.1 2024-09-19T14:14:00.300 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.296+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.2 2024-09-19T14:14:00.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.296+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.2 2024-09-19T14:14:00.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.296+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.3 2024-09-19T14:14:00.301 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.296+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.3 2024-09-19T14:14:00.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.300+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.4 2024-09-19T14:14:00.302 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.300+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.4 2024-09-19T14:14:00.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.300+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.5 2024-09-19T14:14:00.304 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.300+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.5 2024-09-19T14:14:00.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.300+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.6 2024-09-19T14:14:00.306 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.300+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.6 2024-09-19T14:14:00.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.304+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.7 2024-09-19T14:14:00.307 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.304+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.7 2024-09-19T14:14:00.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.304+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.8 2024-09-19T14:14:00.308 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.304+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.8 2024-09-19T14:14:00.309 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.304+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.9 2024-09-19T14:14:00.310 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.304+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.9 2024-09-19T14:14:00.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.308+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.10 2024-09-19T14:14:00.311 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.308+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.10 2024-09-19T14:14:00.312 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.308+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.11 2024-09-19T14:14:00.312 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.308+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.11 2024-09-19T14:14:00.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.312+0000 7f9c16a2d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 : hit (requested=0x17, cached=0x17) 2024-09-19T14:14:00.316 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.312+0000 7f9c16a2d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 2024-09-19T14:14:00.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.316+0000 7f9c16a2d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 info.flags=0x17 2024-09-19T14:14:00.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.316+0000 7f9c16a2d9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 to cache LRU end 2024-09-19T14:14:00.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.316+0000 7f9c16a2d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:14:00.320 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.316+0000 7f9c16a2d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18, ofs0, ns] 2024-09-19T14:14:00.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.316+0000 7f9aeaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333538 cookie 94367804303600 notifier 8033 bl.length()=821 2024-09-19T14:14:00.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.316+0000 7f9aeaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 info.flags=0x17 2024-09-19T14:14:00.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.316+0000 7f9aeaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 to cache LRU end 2024-09-19T14:14:00.321 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.316+0000 7f9aeaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:14:00.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.320+0000 7f9c16a2d9c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): orig_sources= new_sources= 2024-09-19T14:14:00.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.320+0000 7f9c16a2d9c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): potential sources added=[] removed=[] 2024-09-19T14:14:00.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.320+0000 7f9c16a2d9c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): orig_dests= new_dests= 2024-09-19T14:14:00.326 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.320+0000 7f9c16a2d9c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): potential dests added=[] removed=[] 2024-09-19T14:14:00.332 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.328+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.0 2024-09-19T14:14:00.332 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.328+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.0 2024-09-19T14:14:00.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.328+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.1 2024-09-19T14:14:00.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.328+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.1 2024-09-19T14:14:00.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.328+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.2 2024-09-19T14:14:00.333 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.328+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.2 2024-09-19T14:14:00.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.332+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.3 2024-09-19T14:14:00.334 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.332+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.3 2024-09-19T14:14:00.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.332+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.4 2024-09-19T14:14:00.335 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.332+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.4 2024-09-19T14:14:00.336 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.332+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.5 2024-09-19T14:14:00.336 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.332+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.5 2024-09-19T14:14:00.337 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.332+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.6 2024-09-19T14:14:00.337 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.332+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.6 2024-09-19T14:14:00.338 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.332+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.7 2024-09-19T14:14:00.338 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.332+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.7 2024-09-19T14:14:00.339 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.336+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.8 2024-09-19T14:14:00.339 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.336+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.8 2024-09-19T14:14:00.340 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.336+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.9 2024-09-19T14:14:00.340 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.336+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.9 2024-09-19T14:14:00.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.336+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.10 2024-09-19T14:14:00.341 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.336+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.10 2024-09-19T14:14:00.342 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.336+0000 7f9c16a2d9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.11 2024-09-19T14:14:00.342 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.336+0000 7f9c16a2d9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.1.11 2024-09-19T14:14:00.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.344+0000 7f9c16a2d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 : hit (requested=0x17, cached=0x17) 2024-09-19T14:14:00.347 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.344+0000 7f9c16a2d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 2024-09-19T14:14:00.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.348+0000 7f9c16a2d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 info.flags=0x17 2024-09-19T14:14:00.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.348+0000 7f9c16a2d9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 to cache LRU end 2024-09-19T14:14:00.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.348+0000 7f9c16a2d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:14:00.351 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.348+0000 7f9c16a2d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18, ofs0, ns] 2024-09-19T14:14:00.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.348+0000 7f9aeaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333539 cookie 94367804303600 notifier 8033 bl.length()=789 2024-09-19T14:14:00.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.348+0000 7f9aeaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 info.flags=0x17 2024-09-19T14:14:00.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.348+0000 7f9aeaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 to cache LRU end 2024-09-19T14:14:00.352 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.348+0000 7f9aeaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:14:00.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.352+0000 7f9c16a2d9c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): orig_sources= new_sources= 2024-09-19T14:14:00.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.352+0000 7f9c16a2d9c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): potential sources added=[] removed=[] 2024-09-19T14:14:00.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.352+0000 7f9c16a2d9c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): orig_dests= new_dests= 2024-09-19T14:14:00.356 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.352+0000 7f9c16a2d9c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): potential dests added=[] removed=[] 2024-09-19T14:14:00.364 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.360+0000 7f9c16a2d9c0 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-19T14:14:00.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.364+0000 7f9acb7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:14:00.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.372+0000 7f9c16a2d9c0 20 remove_watcher() i=0 2024-09-19T14:14:00.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.372+0000 7f9c16a2d9c0 2 removed watcher, disabling cache 2024-09-19T14:14:00.377 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.372+0000 7f9c16a2d9c0 20 remove_watcher() i=1 2024-09-19T14:14:00.381 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.376+0000 7f9c16a2d9c0 20 remove_watcher() i=2 2024-09-19T14:14:00.384 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.380+0000 7f9c16a2d9c0 20 remove_watcher() i=3 2024-09-19T14:14:00.386 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.384+0000 7f9c16a2d9c0 20 remove_watcher() i=4 2024-09-19T14:14:00.389 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.384+0000 7f9c16a2d9c0 20 remove_watcher() i=5 2024-09-19T14:14:00.391 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.388+0000 7f9c16a2d9c0 20 remove_watcher() i=6 2024-09-19T14:14:00.394 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:00.388+0000 7f9c16a2d9c0 20 remove_watcher() i=7 2024-09-19T14:14:01.311 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-19T14:14:01.311 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T14:14:01.316 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:14:01.316 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:14:01.412 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:14:01.412 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:14:01.579 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:14:01.579 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:14:01.719 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:14:01.719 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:14:01.796 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:14:01.796 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:14:01.941 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:14:01.942 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:14:02.011 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:14:02.012 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:14:02.160 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:14:02.160 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:14:02.228 INFO:tasks.workunit.client.0.smithi153.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-19T14:14:02.676 INFO:tasks.workunit.client.0.smithi153.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-19T14:14:04.122 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:14:04.122 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:14:04.288 INFO:tasks.workunit.client.0.smithi153.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T14:14:04.289 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-19T14:14:04.324 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:14:04.324 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:14:04.369 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.364+0000 7f223f2a89c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:04.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.368+0000 7f223f2a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:04.371 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.368+0000 7f223f2a89c0 20 realm 2024-09-19T14:14:04.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.368+0000 7f223f2a89c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:04.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.368+0000 7f223f2a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:04.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.368+0000 7f223f2a89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:14:04.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.368+0000 7f223f2a89c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:04.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.368+0000 7f223f2a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:04.372 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.368+0000 7f223f2a89c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:04.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.368+0000 7f223f2a89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:14:04.373 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.368+0000 7f223f2a89c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:04.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.368+0000 7f223f2a89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:14:04.374 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.368+0000 7f223f2a89c0 20 searching for the correct realm 2024-09-19T14:14:04.382 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.376+0000 7f223d5af640 0 -- 172.21.15.153:0/1697881824 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7f222403b040 msgr2=0x7f222402e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:14:04.596 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.592+0000 7f223cdae640 0 -- 172.21.15.153:0/1697881824 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x563733127050 msgr2=0x563733129510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:14:04.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.600+0000 7f223f2a89c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:14:04.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.600+0000 7f223f2a89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:14:04.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.600+0000 7f223f2a89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:14:04.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.600+0000 7f223f2a89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:14:04.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.600+0000 7f223f2a89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:14:04.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.600+0000 7f223f2a89c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:14:04.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.600+0000 7f223f2a89c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:04.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.600+0000 7f223f2a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:04.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.600+0000 7f223f2a89c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:04.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.600+0000 7f223f2a89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:14:04.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.600+0000 7f223f2a89c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:04.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.600+0000 7f223f2a89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:14:04.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.600+0000 7f223f2a89c0 20 zone default found 2024-09-19T14:14:04.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.600+0000 7f223f2a89c0 4 Realm: () 2024-09-19T14:14:04.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.600+0000 7f223f2a89c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:14:04.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.600+0000 7f223f2a89c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:14:04.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.600+0000 7f223f2a89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:14:04.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.600+0000 7f223f2a89c0 20 zonegroup default 2024-09-19T14:14:04.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.604+0000 7f223f2a89c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:04.608 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.604+0000 7f223f2a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:04.608 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.604+0000 7f223f2a89c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:04.608 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.604+0000 7f223f2a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:04.608 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.604+0000 7f223f2a89c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:04.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.604+0000 7f223f2a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:04.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.604+0000 7f223f2a89c0 20 started sync module instance, tier type = 2024-09-19T14:14:04.609 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.604+0000 7f223f2a89c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:14:04.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.628+0000 7f223f2a89c0 20 add_watcher() i=0 2024-09-19T14:14:04.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.628+0000 7f223f2a89c0 20 add_watcher() i=1 2024-09-19T14:14:04.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.628+0000 7f223f2a89c0 20 add_watcher() i=2 2024-09-19T14:14:04.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.628+0000 7f223f2a89c0 20 add_watcher() i=3 2024-09-19T14:14:04.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.628+0000 7f223f2a89c0 20 add_watcher() i=4 2024-09-19T14:14:04.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.628+0000 7f223f2a89c0 20 add_watcher() i=5 2024-09-19T14:14:04.632 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.628+0000 7f223f2a89c0 20 add_watcher() i=6 2024-09-19T14:14:04.634 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.628+0000 7f223f2a89c0 20 add_watcher() i=7 2024-09-19T14:14:04.634 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.628+0000 7f223f2a89c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:14:04.638 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.636+0000 7f20f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:14:04.639 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.636+0000 7f223f2a89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:14:04.640 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.636+0000 7f223f2a89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:14:04.640 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.636+0000 7f223f2a89c0 5 note: GC not initialized 2024-09-19T14:14:04.640 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.636+0000 7f20f1fe3640 20 reqs_thread_entry: start 2024-09-19T14:14:04.641 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.636+0000 7f223f2a89c0 20 init_complete bucket index max shards: 11 2024-09-19T14:14:04.641 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.636+0000 7f223f2a89c0 20 Filter name: none 2024-09-19T14:14:04.641 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.636+0000 7f20637fe640 20 reqs_thread_entry: start 2024-09-19T14:14:04.641 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.636+0000 7f223f2a89c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:04.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.636+0000 7f223f2a89c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-19T14:14:04.642 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.636+0000 7f223f2a89c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:04.643 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.640+0000 7f223f2a89c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-19T14:14:04.643 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.640+0000 7f223f2a89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:14:04.643 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.640+0000 7f223f2a89c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-19T14:14:04.644 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.640+0000 7f223f2a89c0 20 INFO: main: starting shard=0 2024-09-19T14:14:04.644 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.640+0000 7f223f2a89c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.0 2024-09-19T14:14:04.644 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.640+0000 7f223f2a89c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.0 2024-09-19T14:14:04.644 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.640+0000 7f223f2a89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:04.644 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.640+0000 7f223f2a89c0 20 INFO: main: starting shard=1 2024-09-19T14:14:04.644 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.640+0000 7f223f2a89c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.1 2024-09-19T14:14:04.645 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.640+0000 7f223f2a89c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.1 2024-09-19T14:14:04.645 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.640+0000 7f223f2a89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:04.645 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.640+0000 7f223f2a89c0 20 INFO: main: starting shard=2 2024-09-19T14:14:04.646 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.640+0000 7f223f2a89c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.2 2024-09-19T14:14:04.646 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.640+0000 7f223f2a89c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.2 2024-09-19T14:14:04.646 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.644+0000 7f223f2a89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:04.646 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.644+0000 7f223f2a89c0 20 INFO: main: starting shard=3 2024-09-19T14:14:04.647 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.644+0000 7f223f2a89c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.3 2024-09-19T14:14:04.647 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.644+0000 7f223f2a89c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.3 2024-09-19T14:14:04.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.644+0000 7f223f2a89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:04.649 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.644+0000 7f223f2a89c0 20 INFO: main: starting shard=4 2024-09-19T14:14:04.649 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.644+0000 7f223f2a89c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.4 2024-09-19T14:14:04.649 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.644+0000 7f223f2a89c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.4 2024-09-19T14:14:04.649 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.644+0000 7f223f2a89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:04.649 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.644+0000 7f223f2a89c0 20 INFO: main: starting shard=5 2024-09-19T14:14:04.649 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.644+0000 7f223f2a89c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.5 2024-09-19T14:14:04.650 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.644+0000 7f223f2a89c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.5 2024-09-19T14:14:04.651 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.648+0000 7f223f2a89c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-19T14:14:04.651 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.648+0000 7f223f2a89c0 20 INFO: main: starting shard=6 2024-09-19T14:14:04.651 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.648+0000 7f223f2a89c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.6 2024-09-19T14:14:04.651 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.648+0000 7f223f2a89c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.6 2024-09-19T14:14:04.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.648+0000 7f223f2a89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:04.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.648+0000 7f223f2a89c0 20 INFO: main: starting shard=7 2024-09-19T14:14:04.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.648+0000 7f223f2a89c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.7 2024-09-19T14:14:04.652 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.648+0000 7f223f2a89c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.7 2024-09-19T14:14:04.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.648+0000 7f223f2a89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:04.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.648+0000 7f223f2a89c0 20 INFO: main: starting shard=8 2024-09-19T14:14:04.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.648+0000 7f223f2a89c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.8 2024-09-19T14:14:04.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.648+0000 7f223f2a89c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.8 2024-09-19T14:14:04.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.652+0000 7f223f2a89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:04.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.652+0000 7f223f2a89c0 20 INFO: main: starting shard=9 2024-09-19T14:14:04.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.652+0000 7f223f2a89c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.9 2024-09-19T14:14:04.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.652+0000 7f223f2a89c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.9 2024-09-19T14:14:04.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.652+0000 7f223f2a89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:04.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.652+0000 7f223f2a89c0 20 INFO: main: starting shard=10 2024-09-19T14:14:04.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.652+0000 7f223f2a89c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.10 2024-09-19T14:14:04.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.652+0000 7f223f2a89c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.10 2024-09-19T14:14:04.656 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.652+0000 7f223f2a89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:04.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.652+0000 7f223f2a89c0 20 INFO: main: starting shard=11 2024-09-19T14:14:04.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.652+0000 7f223f2a89c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.11 2024-09-19T14:14:04.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.652+0000 7f223f2a89c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.11 2024-09-19T14:14:04.657 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.652+0000 7f223f2a89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:04.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.652+0000 7f223f2a89c0 20 INFO: main: starting shard=12 2024-09-19T14:14:04.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.652+0000 7f223f2a89c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.12 2024-09-19T14:14:04.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.652+0000 7f223f2a89c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.12 2024-09-19T14:14:04.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.656+0000 7f223f2a89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:04.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.656+0000 7f223f2a89c0 20 INFO: main: done 2024-09-19T14:14:04.660 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.656+0000 7f20f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:14:04.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.660+0000 7f223f2a89c0 20 remove_watcher() i=0 2024-09-19T14:14:04.665 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.660+0000 7f223f2a89c0 2 removed watcher, disabling cache 2024-09-19T14:14:04.667 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.664+0000 7f223f2a89c0 20 remove_watcher() i=1 2024-09-19T14:14:04.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.664+0000 7f223f2a89c0 20 remove_watcher() i=2 2024-09-19T14:14:04.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.668+0000 7f223f2a89c0 20 remove_watcher() i=3 2024-09-19T14:14:04.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.672+0000 7f223f2a89c0 20 remove_watcher() i=4 2024-09-19T14:14:04.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.672+0000 7f223f2a89c0 20 remove_watcher() i=5 2024-09-19T14:14:04.678 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.672+0000 7f223f2a89c0 20 remove_watcher() i=6 2024-09-19T14:14:04.680 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.676+0000 7f223f2a89c0 20 remove_watcher() i=7 2024-09-19T14:14:04.702 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:14:04.703 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:14:04.733 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:14:04.733 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:14:04.875 INFO:tasks.workunit.client.0.smithi153.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T14:14:04.876 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-19T14:14:04.912 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:14:04.912 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:14:04.958 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.952+0000 7f7c22e709c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:04.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.956+0000 7f7c22e709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:04.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.956+0000 7f7c22e709c0 20 realm 2024-09-19T14:14:04.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.956+0000 7f7c22e709c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:04.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.956+0000 7f7c22e709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:04.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.956+0000 7f7c22e709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:14:04.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.956+0000 7f7c22e709c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:04.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.956+0000 7f7c22e709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:04.960 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.956+0000 7f7c22e709c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:04.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.956+0000 7f7c22e709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:14:04.962 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.956+0000 7f7c22e709c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:04.962 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.956+0000 7f7c22e709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:14:04.962 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.956+0000 7f7c22e709c0 20 searching for the correct realm 2024-09-19T14:14:04.968 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.964+0000 7f7c21177640 0 -- 172.21.15.153:0/3650400546 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55f89f61d1e0 msgr2=0x55f89f61f5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:14:04.975 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.972+0000 7f7c20175640 0 -- 172.21.15.153:0/3650400546 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f7c100c1020 msgr2=0x7f7c100e1a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:14:04.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:14:04.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:14:04.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:14:04.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:14:04.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:14:04.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:14:04.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:04.983 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:04.984 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:04.984 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:14:04.984 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:04.985 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:14:04.985 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 20 zone default found 2024-09-19T14:14:04.985 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 4 Realm: () 2024-09-19T14:14:04.985 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:14:04.985 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:14:04.985 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:14:04.986 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 20 zonegroup default 2024-09-19T14:14:04.986 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:04.986 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:04.986 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:04.986 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:04.986 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:04.987 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:04.987 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 20 started sync module instance, tier type = 2024-09-19T14:14:04.987 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.980+0000 7f7c22e709c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:14:05.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.996+0000 7f7c22e709c0 20 add_watcher() i=0 2024-09-19T14:14:05.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.996+0000 7f7c22e709c0 20 add_watcher() i=1 2024-09-19T14:14:05.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.996+0000 7f7c22e709c0 20 add_watcher() i=2 2024-09-19T14:14:05.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.996+0000 7f7c22e709c0 20 add_watcher() i=3 2024-09-19T14:14:05.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.996+0000 7f7c22e709c0 20 add_watcher() i=4 2024-09-19T14:14:05.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.996+0000 7f7c22e709c0 20 add_watcher() i=5 2024-09-19T14:14:05.002 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:04.996+0000 7f7c22e709c0 20 add_watcher() i=6 2024-09-19T14:14:05.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.000+0000 7f7c22e709c0 20 add_watcher() i=7 2024-09-19T14:14:05.003 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.000+0000 7f7c22e709c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:14:05.006 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.000+0000 7f7ad6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:14:05.007 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.000+0000 7f7c22e709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:14:05.007 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.000+0000 7f7c22e709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:14:05.007 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.000+0000 7f7c22e709c0 5 note: GC not initialized 2024-09-19T14:14:05.007 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.004+0000 7f7ad5fe3640 20 reqs_thread_entry: start 2024-09-19T14:14:05.007 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.004+0000 7f7c22e709c0 20 init_complete bucket index max shards: 11 2024-09-19T14:14:05.007 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.004+0000 7f7c22e709c0 20 Filter name: none 2024-09-19T14:14:05.007 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.004+0000 7f7a477fe640 20 reqs_thread_entry: start 2024-09-19T14:14:05.007 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.004+0000 7f7c22e709c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:05.008 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.004+0000 7f7c22e709c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-19T14:14:05.008 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.004+0000 7f7c22e709c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:05.008 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.004+0000 7f7c22e709c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-19T14:14:05.008 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.004+0000 7f7c22e709c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:14:05.009 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.004+0000 7f7c22e709c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-19T14:14:05.009 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.004+0000 7f7c22e709c0 20 INFO: main: starting shard=0 2024-09-19T14:14:05.009 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.004+0000 7f7c22e709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.0 2024-09-19T14:14:05.009 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.004+0000 7f7c22e709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.0 2024-09-19T14:14:05.009 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.004+0000 7f7c22e709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:05.009 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.004+0000 7f7c22e709c0 20 INFO: main: starting shard=1 2024-09-19T14:14:05.009 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.004+0000 7f7c22e709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.1 2024-09-19T14:14:05.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.004+0000 7f7c22e709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.1 2024-09-19T14:14:05.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.008+0000 7f7c22e709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:05.010 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.008+0000 7f7c22e709c0 20 INFO: main: starting shard=2 2024-09-19T14:14:05.011 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.008+0000 7f7c22e709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.2 2024-09-19T14:14:05.011 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.008+0000 7f7c22e709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.2 2024-09-19T14:14:05.011 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.008+0000 7f7c22e709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:05.011 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.008+0000 7f7c22e709c0 20 INFO: main: starting shard=3 2024-09-19T14:14:05.011 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.008+0000 7f7c22e709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.3 2024-09-19T14:14:05.011 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.008+0000 7f7c22e709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.3 2024-09-19T14:14:05.012 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.008+0000 7f7c22e709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:05.012 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.008+0000 7f7c22e709c0 20 INFO: main: starting shard=4 2024-09-19T14:14:05.012 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.008+0000 7f7c22e709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.4 2024-09-19T14:14:05.012 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.008+0000 7f7c22e709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.4 2024-09-19T14:14:05.013 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.008+0000 7f7c22e709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:05.013 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.008+0000 7f7c22e709c0 20 INFO: main: starting shard=5 2024-09-19T14:14:05.013 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.008+0000 7f7c22e709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.5 2024-09-19T14:14:05.013 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.008+0000 7f7c22e709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.5 2024-09-19T14:14:05.014 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.008+0000 7f7c22e709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:05.014 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.008+0000 7f7c22e709c0 20 INFO: main: starting shard=6 2024-09-19T14:14:05.014 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.008+0000 7f7c22e709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.6 2024-09-19T14:14:05.014 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.008+0000 7f7c22e709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.6 2024-09-19T14:14:05.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.012+0000 7f7c22e709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:05.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.012+0000 7f7c22e709c0 20 INFO: main: starting shard=7 2024-09-19T14:14:05.015 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.012+0000 7f7c22e709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.7 2024-09-19T14:14:05.016 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.012+0000 7f7c22e709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.7 2024-09-19T14:14:05.017 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.012+0000 7f7c22e709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:05.017 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.012+0000 7f7c22e709c0 20 INFO: main: starting shard=8 2024-09-19T14:14:05.017 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.012+0000 7f7c22e709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.8 2024-09-19T14:14:05.017 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.012+0000 7f7c22e709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.8 2024-09-19T14:14:05.017 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.012+0000 7f7c22e709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:05.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.012+0000 7f7c22e709c0 20 INFO: main: starting shard=9 2024-09-19T14:14:05.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.012+0000 7f7c22e709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.9 2024-09-19T14:14:05.018 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.012+0000 7f7c22e709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.9 2024-09-19T14:14:05.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.016+0000 7f7c22e709c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-19T14:14:05.019 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.016+0000 7f7c22e709c0 20 INFO: main: starting shard=10 2024-09-19T14:14:05.020 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.016+0000 7f7c22e709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.10 2024-09-19T14:14:05.020 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.016+0000 7f7c22e709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.10 2024-09-19T14:14:05.020 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.016+0000 7f7c22e709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:05.020 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.016+0000 7f7c22e709c0 20 INFO: main: starting shard=11 2024-09-19T14:14:05.020 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.016+0000 7f7c22e709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.11 2024-09-19T14:14:05.020 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.016+0000 7f7c22e709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.11 2024-09-19T14:14:05.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.016+0000 7f7c22e709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:05.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.016+0000 7f7c22e709c0 20 INFO: main: starting shard=12 2024-09-19T14:14:05.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.016+0000 7f7c22e709c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.12 2024-09-19T14:14:05.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.016+0000 7f7c22e709c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.12 2024-09-19T14:14:05.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.016+0000 7f7c22e709c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:05.021 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.016+0000 7f7c22e709c0 20 INFO: main: done 2024-09-19T14:14:05.022 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.020+0000 7f7ad6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:14:05.027 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.024+0000 7f7c22e709c0 20 remove_watcher() i=0 2024-09-19T14:14:05.027 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.024+0000 7f7c22e709c0 2 removed watcher, disabling cache 2024-09-19T14:14:05.030 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.024+0000 7f7c22e709c0 20 remove_watcher() i=1 2024-09-19T14:14:05.032 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.028+0000 7f7c22e709c0 20 remove_watcher() i=2 2024-09-19T14:14:05.033 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.028+0000 7f7c22e709c0 20 remove_watcher() i=3 2024-09-19T14:14:05.036 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.032+0000 7f7c22e709c0 20 remove_watcher() i=4 2024-09-19T14:14:05.037 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.032+0000 7f7c22e709c0 20 remove_watcher() i=5 2024-09-19T14:14:05.039 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.036+0000 7f7c22e709c0 20 remove_watcher() i=6 2024-09-19T14:14:05.040 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.036+0000 7f7c22e709c0 20 remove_watcher() i=7 2024-09-19T14:14:05.058 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:14:05.058 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:14:05.086 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:14:05.086 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:14:05.231 INFO:tasks.workunit.client.0.smithi153.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T14:14:05.232 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-19T14:14:05.269 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:14:05.269 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:14:05.314 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.308+0000 7fe17ccf59c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:05.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.312+0000 7fe17ccf59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:05.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.312+0000 7fe17ccf59c0 20 realm 2024-09-19T14:14:05.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.312+0000 7fe17ccf59c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:05.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.312+0000 7fe17ccf59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:05.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.312+0000 7fe17ccf59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:14:05.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.312+0000 7fe17ccf59c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:05.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.312+0000 7fe17ccf59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:05.317 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.312+0000 7fe17ccf59c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:05.318 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.316+0000 7fe17ccf59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:14:05.318 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.316+0000 7fe17ccf59c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:05.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.316+0000 7fe17ccf59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:14:05.319 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.316+0000 7fe17ccf59c0 20 searching for the correct realm 2024-09-19T14:14:05.325 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.320+0000 7fe179ffa640 0 -- 172.21.15.153:0/4171519895 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x557628ed4ec0 msgr2=0x557628ed72b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:14:05.539 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.536+0000 7fe17a7fb640 0 -- 172.21.15.153:0/4171519895 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fe16c0f4480 msgr2=0x7fe16c0f4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:14:05.758 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.752+0000 7fe17ccf59c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:14:05.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.752+0000 7fe17ccf59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:14:05.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.752+0000 7fe17ccf59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:14:05.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.752+0000 7fe17ccf59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:14:05.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.752+0000 7fe17ccf59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:14:05.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.752+0000 7fe17ccf59c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:14:05.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.756+0000 7fe17ccf59c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:05.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.756+0000 7fe17ccf59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:05.759 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.756+0000 7fe17ccf59c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:05.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.756+0000 7fe17ccf59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:14:05.760 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.756+0000 7fe17ccf59c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:05.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.756+0000 7fe17ccf59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:14:05.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.756+0000 7fe17ccf59c0 20 zone default found 2024-09-19T14:14:05.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.756+0000 7fe17ccf59c0 4 Realm: () 2024-09-19T14:14:05.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.756+0000 7fe17ccf59c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:14:05.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.756+0000 7fe17ccf59c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:14:05.761 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.756+0000 7fe17ccf59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:14:05.762 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.756+0000 7fe17ccf59c0 20 zonegroup default 2024-09-19T14:14:05.762 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.756+0000 7fe17ccf59c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:05.762 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.756+0000 7fe17ccf59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:05.762 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.756+0000 7fe17ccf59c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:05.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.760+0000 7fe17ccf59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:05.763 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.760+0000 7fe17ccf59c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:05.764 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.760+0000 7fe17ccf59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:05.764 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.760+0000 7fe17ccf59c0 20 started sync module instance, tier type = 2024-09-19T14:14:05.764 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.760+0000 7fe17ccf59c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:14:05.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.784+0000 7fe17ccf59c0 20 add_watcher() i=0 2024-09-19T14:14:05.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.784+0000 7fe17ccf59c0 20 add_watcher() i=1 2024-09-19T14:14:05.788 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.784+0000 7fe17ccf59c0 20 add_watcher() i=2 2024-09-19T14:14:05.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.784+0000 7fe17ccf59c0 20 add_watcher() i=3 2024-09-19T14:14:05.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.784+0000 7fe17ccf59c0 20 add_watcher() i=4 2024-09-19T14:14:05.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.784+0000 7fe17ccf59c0 20 add_watcher() i=5 2024-09-19T14:14:05.789 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.784+0000 7fe17ccf59c0 20 add_watcher() i=6 2024-09-19T14:14:05.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.788+0000 7fe17ccf59c0 20 add_watcher() i=7 2024-09-19T14:14:05.790 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.788+0000 7fe17ccf59c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:14:05.794 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.788+0000 7fe030fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:14:05.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.792+0000 7fe17ccf59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:14:05.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.792+0000 7fe17ccf59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:14:05.795 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.792+0000 7fe17ccf59c0 5 note: GC not initialized 2024-09-19T14:14:05.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.792+0000 7fdfab7fe640 20 reqs_thread_entry: start 2024-09-19T14:14:05.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.792+0000 7fe17ccf59c0 20 init_complete bucket index max shards: 11 2024-09-19T14:14:05.796 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.792+0000 7fe17ccf59c0 20 Filter name: none 2024-09-19T14:14:05.797 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.792+0000 7fdfa97fa640 20 reqs_thread_entry: start 2024-09-19T14:14:05.797 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.792+0000 7fe17ccf59c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:05.797 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.792+0000 7fe17ccf59c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-19T14:14:05.797 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.792+0000 7fe17ccf59c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:05.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.792+0000 7fe17ccf59c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-19T14:14:05.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.796+0000 7fe17ccf59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:14:05.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.796+0000 7fe17ccf59c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-19T14:14:05.798 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.796+0000 7fe17ccf59c0 20 INFO: main: starting shard=0 2024-09-19T14:14:05.799 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.796+0000 7fe17ccf59c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.0 2024-09-19T14:14:05.799 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.796+0000 7fe17ccf59c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.0 2024-09-19T14:14:05.799 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.796+0000 7fe17ccf59c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-19T14:14:05.799 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.796+0000 7fe17ccf59c0 20 INFO: main: starting shard=1 2024-09-19T14:14:05.799 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.796+0000 7fe17ccf59c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.1 2024-09-19T14:14:05.799 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.796+0000 7fe17ccf59c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.1 2024-09-19T14:14:05.800 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.796+0000 7fe17ccf59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:05.800 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.796+0000 7fe17ccf59c0 20 INFO: main: starting shard=2 2024-09-19T14:14:05.800 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.796+0000 7fe17ccf59c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.2 2024-09-19T14:14:05.800 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.796+0000 7fe17ccf59c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.2 2024-09-19T14:14:05.801 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.796+0000 7fe17ccf59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:05.801 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.796+0000 7fe17ccf59c0 20 INFO: main: starting shard=3 2024-09-19T14:14:05.801 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.796+0000 7fe17ccf59c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.3 2024-09-19T14:14:05.801 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.796+0000 7fe17ccf59c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.3 2024-09-19T14:14:05.802 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.796+0000 7fe17ccf59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:05.802 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.796+0000 7fe17ccf59c0 20 INFO: main: starting shard=4 2024-09-19T14:14:05.802 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.796+0000 7fe17ccf59c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.4 2024-09-19T14:14:05.802 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.796+0000 7fe17ccf59c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.4 2024-09-19T14:14:05.804 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.800+0000 7fe17ccf59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:05.804 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.800+0000 7fe17ccf59c0 20 INFO: main: starting shard=5 2024-09-19T14:14:05.804 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.800+0000 7fe17ccf59c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.5 2024-09-19T14:14:05.804 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.800+0000 7fe17ccf59c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.5 2024-09-19T14:14:05.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.800+0000 7fe17ccf59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:05.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.800+0000 7fe17ccf59c0 20 INFO: main: starting shard=6 2024-09-19T14:14:05.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.800+0000 7fe17ccf59c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.6 2024-09-19T14:14:05.805 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.800+0000 7fe17ccf59c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.6 2024-09-19T14:14:05.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.804+0000 7fe17ccf59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:05.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.804+0000 7fe17ccf59c0 20 INFO: main: starting shard=7 2024-09-19T14:14:05.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.804+0000 7fe17ccf59c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.7 2024-09-19T14:14:05.806 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.804+0000 7fe17ccf59c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.7 2024-09-19T14:14:05.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.804+0000 7fe17ccf59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:05.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.804+0000 7fe17ccf59c0 20 INFO: main: starting shard=8 2024-09-19T14:14:05.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.804+0000 7fe17ccf59c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.8 2024-09-19T14:14:05.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.804+0000 7fe17ccf59c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.8 2024-09-19T14:14:05.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.804+0000 7fe17ccf59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:05.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.804+0000 7fe17ccf59c0 20 INFO: main: starting shard=9 2024-09-19T14:14:05.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.804+0000 7fe17ccf59c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.9 2024-09-19T14:14:05.808 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.804+0000 7fe17ccf59c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.9 2024-09-19T14:14:05.809 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.804+0000 7fe17ccf59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:05.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.804+0000 7fe17ccf59c0 20 INFO: main: starting shard=10 2024-09-19T14:14:05.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.804+0000 7fe17ccf59c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.10 2024-09-19T14:14:05.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.804+0000 7fe17ccf59c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.10 2024-09-19T14:14:05.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.808+0000 7fe17ccf59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:05.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.808+0000 7fe17ccf59c0 20 INFO: main: starting shard=11 2024-09-19T14:14:05.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.808+0000 7fe17ccf59c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.11 2024-09-19T14:14:05.810 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.808+0000 7fe17ccf59c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.11 2024-09-19T14:14:05.811 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.808+0000 7fe17ccf59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:05.812 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.808+0000 7fe17ccf59c0 20 INFO: main: starting shard=12 2024-09-19T14:14:05.812 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.808+0000 7fe17ccf59c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.12 2024-09-19T14:14:05.812 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.808+0000 7fe17ccf59c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.12 2024-09-19T14:14:05.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.808+0000 7fe17ccf59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T14:14:05.813 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.808+0000 7fe17ccf59c0 20 INFO: main: done 2024-09-19T14:14:05.814 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.812+0000 7fe030fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:14:05.819 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.816+0000 7fe17ccf59c0 20 remove_watcher() i=0 2024-09-19T14:14:05.820 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.816+0000 7fe17ccf59c0 2 removed watcher, disabling cache 2024-09-19T14:14:05.822 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.816+0000 7fe17ccf59c0 20 remove_watcher() i=1 2024-09-19T14:14:05.825 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.820+0000 7fe17ccf59c0 20 remove_watcher() i=2 2024-09-19T14:14:05.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.824+0000 7fe17ccf59c0 20 remove_watcher() i=3 2024-09-19T14:14:05.829 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.824+0000 7fe17ccf59c0 20 remove_watcher() i=4 2024-09-19T14:14:05.830 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.828+0000 7fe17ccf59c0 20 remove_watcher() i=5 2024-09-19T14:14:05.832 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.828+0000 7fe17ccf59c0 20 remove_watcher() i=6 2024-09-19T14:14:05.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:05.828+0000 7fe17ccf59c0 20 remove_watcher() i=7 2024-09-19T14:14:05.855 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:14:05.855 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:14:05.882 INFO:tasks.workunit.client.0.smithi153.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-19T14:14:06.319 INFO:tasks.workunit.client.0.smithi153.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-19T14:14:06.756 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-19T14:14:06.784 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:14:06.784 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:14:06.824 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.820+0000 7f78ff6269c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:06.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.820+0000 7f78ff6269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:06.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.820+0000 7f78ff6269c0 20 realm 2024-09-19T14:14:06.826 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.820+0000 7f78ff6269c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:06.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.824+0000 7f78ff6269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:06.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.824+0000 7f78ff6269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:14:06.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.824+0000 7f78ff6269c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:06.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.824+0000 7f78ff6269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:06.827 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.824+0000 7f78ff6269c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:06.828 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.824+0000 7f78ff6269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:14:06.828 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.824+0000 7f78ff6269c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:06.828 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.824+0000 7f78ff6269c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:14:06.828 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.824+0000 7f78ff6269c0 20 searching for the correct realm 2024-09-19T14:14:06.834 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.828+0000 7f78fc92b640 0 -- 172.21.15.153:0/2092878855 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x56272a4e3a70 msgr2=0x56272a4e5ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:14:06.840 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.836+0000 7f78fc92b640 0 -- 172.21.15.153:0/2092878855 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f78f0068040 msgr2=0x7f78f00684b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:14:06.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:14:06.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:14:06.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:14:06.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:14:06.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:14:06.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:14:06.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:06.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:06.847 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:06.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:14:06.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:06.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:14:06.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 20 zone default found 2024-09-19T14:14:06.848 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 4 Realm: () 2024-09-19T14:14:06.849 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:14:06.849 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:14:06.849 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:14:06.849 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 20 zonegroup default 2024-09-19T14:14:06.849 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:06.849 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:06.849 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:06.849 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:06.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:06.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:06.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 20 started sync module instance, tier type = 2024-09-19T14:14:06.850 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.844+0000 7f78ff6269c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:14:06.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.860+0000 7f78ff6269c0 20 add_watcher() i=0 2024-09-19T14:14:06.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.860+0000 7f78ff6269c0 20 add_watcher() i=1 2024-09-19T14:14:06.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.860+0000 7f78ff6269c0 20 add_watcher() i=2 2024-09-19T14:14:06.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.860+0000 7f78ff6269c0 20 add_watcher() i=3 2024-09-19T14:14:06.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.860+0000 7f78ff6269c0 20 add_watcher() i=4 2024-09-19T14:14:06.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.860+0000 7f78ff6269c0 20 add_watcher() i=5 2024-09-19T14:14:06.864 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.860+0000 7f78ff6269c0 20 add_watcher() i=6 2024-09-19T14:14:06.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.860+0000 7f78ff6269c0 20 add_watcher() i=7 2024-09-19T14:14:06.865 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.860+0000 7f78ff6269c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:14:06.867 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.864+0000 7f77b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:14:06.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.864+0000 7f78ff6269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:14:06.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.864+0000 7f78ff6269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:14:06.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.864+0000 7f78ff6269c0 5 note: GC not initialized 2024-09-19T14:14:06.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.864+0000 7f77b27e4640 20 reqs_thread_entry: start 2024-09-19T14:14:06.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.864+0000 7f78ff6269c0 20 init_complete bucket index max shards: 11 2024-09-19T14:14:06.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.864+0000 7f78ff6269c0 20 Filter name: none 2024-09-19T14:14:06.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.864+0000 7f7723fff640 20 reqs_thread_entry: start 2024-09-19T14:14:06.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.864+0000 7f78ff6269c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-19T14:14:06.868 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.864+0000 7f78ff6269c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:06.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.864+0000 7f78ff6269c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-19T14:14:06.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.864+0000 7f78ff6269c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-19T14:14:06.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.864+0000 7f78ff6269c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-19T14:14:06.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.864+0000 7f78ff6269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 : miss 2024-09-19T14:14:06.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.864+0000 7f78ff6269c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:06.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.864+0000 7f78ff6269c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-19T14:14:06.869 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.864+0000 7f78ff6269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 info.flags=0x17 2024-09-19T14:14:06.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.864+0000 7f78ff6269c0 10 adding default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 to cache LRU end 2024-09-19T14:14:06.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.864+0000 7f78ff6269c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:14:06.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.864+0000 7f78ff6269c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:14:06.870 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.864+0000 7f78ff6269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 2024-09-19T14:14:06.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.876+0000 7f78ff6269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 info.flags=0x17 2024-09-19T14:14:06.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.876+0000 7f78ff6269c0 10 moving default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 to cache LRU end 2024-09-19T14:14:06.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.876+0000 7f78ff6269c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:14:06.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.876+0000 7f78ff6269c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18, ofs0, ns] 2024-09-19T14:14:06.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.876+0000 7f77e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333540 cookie 94726213551920 notifier 8676 bl.length()=821 2024-09-19T14:14:06.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.876+0000 7f77e0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 info.flags=0x17 2024-09-19T14:14:06.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.876+0000 7f77e0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 to cache LRU end 2024-09-19T14:14:06.882 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.876+0000 7f77e0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:14:06.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.880+0000 7f78ff6269c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): orig_sources= new_sources= 2024-09-19T14:14:06.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.880+0000 7f78ff6269c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): potential sources added=[] removed=[] 2024-09-19T14:14:06.883 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.880+0000 7f78ff6269c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): orig_dests= new_dests= 2024-09-19T14:14:06.884 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.880+0000 7f78ff6269c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): potential dests added=[] removed=[] 2024-09-19T14:14:06.895 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.0 2024-09-19T14:14:06.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.0 2024-09-19T14:14:06.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.1 2024-09-19T14:14:06.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.1 2024-09-19T14:14:06.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.2 2024-09-19T14:14:06.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.2 2024-09-19T14:14:06.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.3 2024-09-19T14:14:06.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.3 2024-09-19T14:14:06.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.4 2024-09-19T14:14:06.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.4 2024-09-19T14:14:06.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.5 2024-09-19T14:14:06.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.5 2024-09-19T14:14:06.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.6 2024-09-19T14:14:06.896 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.6 2024-09-19T14:14:06.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.7 2024-09-19T14:14:06.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.7 2024-09-19T14:14:06.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.8 2024-09-19T14:14:06.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.8 2024-09-19T14:14:06.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.9 2024-09-19T14:14:06.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.9 2024-09-19T14:14:06.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.10 2024-09-19T14:14:06.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.10 2024-09-19T14:14:06.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.11 2024-09-19T14:14:06.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.11 2024-09-19T14:14:06.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.12 2024-09-19T14:14:06.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.12 2024-09-19T14:14:06.897 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.13 2024-09-19T14:14:06.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.13 2024-09-19T14:14:06.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.14 2024-09-19T14:14:06.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.14 2024-09-19T14:14:06.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.15 2024-09-19T14:14:06.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.15 2024-09-19T14:14:06.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.16 2024-09-19T14:14:06.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.16 2024-09-19T14:14:06.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.0 2024-09-19T14:14:06.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.0 2024-09-19T14:14:06.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.1 2024-09-19T14:14:06.898 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.1 2024-09-19T14:14:06.899 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.2 2024-09-19T14:14:06.899 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.2 2024-09-19T14:14:06.899 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.3 2024-09-19T14:14:06.899 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.892+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.3 2024-09-19T14:14:06.899 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.896+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.4 2024-09-19T14:14:06.899 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.896+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.4 2024-09-19T14:14:06.900 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.896+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.5 2024-09-19T14:14:06.900 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.896+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.5 2024-09-19T14:14:06.900 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.896+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.6 2024-09-19T14:14:06.900 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.896+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.6 2024-09-19T14:14:06.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.896+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.7 2024-09-19T14:14:06.902 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.896+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.7 2024-09-19T14:14:06.903 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.900+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.8 2024-09-19T14:14:06.904 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.900+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.8 2024-09-19T14:14:06.904 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.900+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.9 2024-09-19T14:14:06.904 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.900+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.9 2024-09-19T14:14:06.905 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.900+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.10 2024-09-19T14:14:06.905 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.900+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.10 2024-09-19T14:14:06.906 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.900+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.11 2024-09-19T14:14:06.906 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.900+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.11 2024-09-19T14:14:06.907 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.904+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.12 2024-09-19T14:14:06.907 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.904+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.12 2024-09-19T14:14:06.911 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.908+0000 7f78ff6269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 : hit (requested=0x17, cached=0x17) 2024-09-19T14:14:06.911 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.908+0000 7f78ff6269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 2024-09-19T14:14:06.914 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.908+0000 7f78ff6269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 info.flags=0x17 2024-09-19T14:14:06.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.908+0000 7f78ff6269c0 10 moving default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 to cache LRU end 2024-09-19T14:14:06.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.908+0000 7f78ff6269c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:14:06.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.908+0000 7f78ff6269c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18, ofs0, ns] 2024-09-19T14:14:06.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.908+0000 7f77cffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333541 cookie 94726213551920 notifier 8676 bl.length()=821 2024-09-19T14:14:06.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.908+0000 7f77cffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 info.flags=0x17 2024-09-19T14:14:06.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.908+0000 7f77cffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 to cache LRU end 2024-09-19T14:14:06.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.908+0000 7f77cffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:14:06.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.912+0000 7f78ff6269c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): orig_sources= new_sources= 2024-09-19T14:14:06.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.912+0000 7f78ff6269c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): potential sources added=[] removed=[] 2024-09-19T14:14:06.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.912+0000 7f78ff6269c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): orig_dests= new_dests= 2024-09-19T14:14:06.916 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.912+0000 7f78ff6269c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): potential dests added=[] removed=[] 2024-09-19T14:14:06.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.916+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.0 2024-09-19T14:14:06.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.916+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.0 2024-09-19T14:14:06.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.916+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.1 2024-09-19T14:14:06.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.916+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.1 2024-09-19T14:14:06.923 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.920+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.2 2024-09-19T14:14:06.923 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.920+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.2 2024-09-19T14:14:06.923 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.920+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.3 2024-09-19T14:14:06.923 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.920+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.3 2024-09-19T14:14:06.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.920+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.4 2024-09-19T14:14:06.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.920+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.4 2024-09-19T14:14:06.925 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.920+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.5 2024-09-19T14:14:06.925 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.920+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.5 2024-09-19T14:14:06.925 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.920+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.6 2024-09-19T14:14:06.925 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.920+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.6 2024-09-19T14:14:06.926 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.924+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.7 2024-09-19T14:14:06.926 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.924+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.7 2024-09-19T14:14:06.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.924+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.8 2024-09-19T14:14:06.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.924+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.8 2024-09-19T14:14:06.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.924+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.9 2024-09-19T14:14:06.928 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.924+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.9 2024-09-19T14:14:06.928 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.924+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.10 2024-09-19T14:14:06.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.924+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.10 2024-09-19T14:14:06.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.924+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.11 2024-09-19T14:14:06.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.924+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.11 2024-09-19T14:14:06.930 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.924+0000 7f78ff6269c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.12 2024-09-19T14:14:06.930 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.924+0000 7f78ff6269c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.2.12 2024-09-19T14:14:06.930 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.928+0000 7f78ff6269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 : hit (requested=0x17, cached=0x17) 2024-09-19T14:14:06.930 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.928+0000 7f78ff6269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 2024-09-19T14:14:06.933 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.928+0000 7f78ff6269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 info.flags=0x17 2024-09-19T14:14:06.933 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.928+0000 7f78ff6269c0 10 moving default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 to cache LRU end 2024-09-19T14:14:06.933 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.928+0000 7f78ff6269c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:14:06.933 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.928+0000 7f78ff6269c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18, ofs0, ns] 2024-09-19T14:14:06.936 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.928+0000 7f77e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333542 cookie 94726213551920 notifier 8676 bl.length()=789 2024-09-19T14:14:06.936 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.928+0000 7f77e0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 info.flags=0x17 2024-09-19T14:14:06.936 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.928+0000 7f77e0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 to cache LRU end 2024-09-19T14:14:06.936 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.928+0000 7f77e0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:14:06.936 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.932+0000 7f78ff6269c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): orig_sources= new_sources= 2024-09-19T14:14:06.936 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.932+0000 7f78ff6269c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): potential sources added=[] removed=[] 2024-09-19T14:14:06.937 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.932+0000 7f78ff6269c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): orig_dests= new_dests= 2024-09-19T14:14:06.937 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.932+0000 7f78ff6269c0 20 handle_bi_update(): bucket=:myver[dbb1da81-49d0-421a-b677-974869a7f103.4620.18]): potential dests added=[] removed=[] 2024-09-19T14:14:06.941 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.936+0000 7f78ff6269c0 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-19T14:14:06.944 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.940+0000 7f77b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:14:06.949 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.944+0000 7f78ff6269c0 20 remove_watcher() i=0 2024-09-19T14:14:06.950 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.944+0000 7f78ff6269c0 2 removed watcher, disabling cache 2024-09-19T14:14:06.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.948+0000 7f78ff6269c0 20 remove_watcher() i=1 2024-09-19T14:14:06.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.948+0000 7f78ff6269c0 20 remove_watcher() i=2 2024-09-19T14:14:06.956 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.952+0000 7f78ff6269c0 20 remove_watcher() i=3 2024-09-19T14:14:06.958 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.952+0000 7f78ff6269c0 20 remove_watcher() i=4 2024-09-19T14:14:06.959 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.956+0000 7f78ff6269c0 20 remove_watcher() i=5 2024-09-19T14:14:06.961 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.956+0000 7f78ff6269c0 20 remove_watcher() i=6 2024-09-19T14:14:06.963 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:06.960+0000 7f78ff6269c0 20 remove_watcher() i=7 2024-09-19T14:14:06.983 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-19T14:14:07.018 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:14:07.018 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:14:07.057 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.052+0000 7fc095a1c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.059 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.056+0000 7fc095a1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:07.059 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.056+0000 7fc095a1c9c0 20 realm 2024-09-19T14:14:07.059 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.056+0000 7fc095a1c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.059 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.056+0000 7fc095a1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:07.059 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.056+0000 7fc095a1c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:14:07.059 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.056+0000 7fc095a1c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.059 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.056+0000 7fc095a1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:07.060 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.056+0000 7fc095a1c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.061 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.056+0000 7fc095a1c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:14:07.061 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.056+0000 7fc095a1c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.061 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.056+0000 7fc095a1c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:14:07.061 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.056+0000 7fc095a1c9c0 20 searching for the correct realm 2024-09-19T14:14:07.067 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.064+0000 7fc092d21640 0 -- 172.21.15.153:0/4192123453 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fc08410f070 msgr2=0x7fc084102e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:14:07.072 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.068+0000 7fc093d23640 0 -- 172.21.15.153:0/4192123453 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7fc07c06fba0 msgr2=0x7fc07c0689e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:14:07.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.076+0000 7fc095a1c9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:14:07.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.076+0000 7fc095a1c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:14:07.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.076+0000 7fc095a1c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:14:07.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.076+0000 7fc095a1c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:14:07.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.076+0000 7fc095a1c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:14:07.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.076+0000 7fc095a1c9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:14:07.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.076+0000 7fc095a1c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.076+0000 7fc095a1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:07.080 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.076+0000 7fc095a1c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.076+0000 7fc095a1c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:14:07.081 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.076+0000 7fc095a1c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.076+0000 7fc095a1c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:14:07.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.076+0000 7fc095a1c9c0 20 zone default found 2024-09-19T14:14:07.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.076+0000 7fc095a1c9c0 4 Realm: () 2024-09-19T14:14:07.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.076+0000 7fc095a1c9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:14:07.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.076+0000 7fc095a1c9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:14:07.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.076+0000 7fc095a1c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:14:07.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.076+0000 7fc095a1c9c0 20 zonegroup default 2024-09-19T14:14:07.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.076+0000 7fc095a1c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.076+0000 7fc095a1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:07.082 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.076+0000 7fc095a1c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.080+0000 7fc095a1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:07.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.080+0000 7fc095a1c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.080+0000 7fc095a1c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:07.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.080+0000 7fc095a1c9c0 20 started sync module instance, tier type = 2024-09-19T14:14:07.083 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.080+0000 7fc095a1c9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:14:07.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.092+0000 7fc095a1c9c0 20 add_watcher() i=0 2024-09-19T14:14:07.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.092+0000 7fc095a1c9c0 20 add_watcher() i=1 2024-09-19T14:14:07.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.092+0000 7fc095a1c9c0 20 add_watcher() i=2 2024-09-19T14:14:07.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.092+0000 7fc095a1c9c0 20 add_watcher() i=3 2024-09-19T14:14:07.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.092+0000 7fc095a1c9c0 20 add_watcher() i=4 2024-09-19T14:14:07.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.092+0000 7fc095a1c9c0 20 add_watcher() i=5 2024-09-19T14:14:07.098 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.092+0000 7fc095a1c9c0 20 add_watcher() i=6 2024-09-19T14:14:07.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.096+0000 7fc095a1c9c0 20 add_watcher() i=7 2024-09-19T14:14:07.099 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.096+0000 7fc095a1c9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:14:07.101 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.096+0000 7fbf4a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:14:07.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.096+0000 7fc095a1c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:14:07.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.096+0000 7fc095a1c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:14:07.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.096+0000 7fc095a1c9c0 5 note: GC not initialized 2024-09-19T14:14:07.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.096+0000 7fbf497e2640 20 reqs_thread_entry: start 2024-09-19T14:14:07.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.096+0000 7fc095a1c9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:14:07.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.096+0000 7fc095a1c9c0 20 Filter name: none 2024-09-19T14:14:07.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.096+0000 7fbf427fc640 20 reqs_thread_entry: start 2024-09-19T14:14:07.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.096+0000 7fc095a1c9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-19T14:14:07.102 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.096+0000 7fc095a1c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.096+0000 7fc095a1c9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-19T14:14:07.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.096+0000 7fc095a1c9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-19T14:14:07.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.096+0000 7fc095a1c9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-19T14:14:07.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.096+0000 7fc095a1c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 : miss 2024-09-19T14:14:07.103 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.096+0000 7fc095a1c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.100+0000 7fc095a1c9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-19T14:14:07.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.100+0000 7fc095a1c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 info.flags=0x17 2024-09-19T14:14:07.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.100+0000 7fc095a1c9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 to cache LRU end 2024-09-19T14:14:07.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.100+0000 7fc095a1c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:14:07.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.100+0000 7fc095a1c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-19T14:14:07.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.100+0000 7fc095a1c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:dbb1da81-49d0-421a-b677-974869a7f103.4620.18 2024-09-19T14:14:07.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.100+0000 7fc095a1c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.0 2024-09-19T14:14:07.104 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.100+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.0 2024-09-19T14:14:07.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.100+0000 7fc095a1c9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-19T14:14:07.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.100+0000 7fc095a1c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.1 2024-09-19T14:14:07.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.100+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.1 2024-09-19T14:14:07.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.100+0000 7fc095a1c9c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-19T14:14:07.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.100+0000 7fc095a1c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.2 2024-09-19T14:14:07.105 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.100+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.2 2024-09-19T14:14:07.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.104+0000 7fc095a1c9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-19T14:14:07.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.104+0000 7fc095a1c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.3 2024-09-19T14:14:07.106 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.104+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.3 2024-09-19T14:14:07.107 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.104+0000 7fc095a1c9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-19T14:14:07.107 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.104+0000 7fc095a1c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.4 2024-09-19T14:14:07.107 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.104+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.4 2024-09-19T14:14:07.107 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.104+0000 7fc095a1c9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-19T14:14:07.107 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.104+0000 7fc095a1c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.5 2024-09-19T14:14:07.107 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.104+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.5 2024-09-19T14:14:07.108 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.104+0000 7fc095a1c9c0 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-19T14:14:07.109 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.104+0000 7fc095a1c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.6 2024-09-19T14:14:07.109 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.104+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.6 2024-09-19T14:14:07.109 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.104+0000 7fc095a1c9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-19T14:14:07.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.104+0000 7fc095a1c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.7 2024-09-19T14:14:07.110 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.104+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.7 2024-09-19T14:14:07.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.108+0000 7fc095a1c9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-19T14:14:07.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.108+0000 7fc095a1c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.8 2024-09-19T14:14:07.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.108+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.8 2024-09-19T14:14:07.111 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.108+0000 7fc095a1c9c0 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-19T14:14:07.112 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.108+0000 7fc095a1c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.9 2024-09-19T14:14:07.112 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.108+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.9 2024-09-19T14:14:07.112 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.108+0000 7fc095a1c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.10 2024-09-19T14:14:07.112 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.108+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.10 2024-09-19T14:14:07.112 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.108+0000 7fc095a1c9c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-19T14:14:07.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.108+0000 7fc095a1c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.11 2024-09-19T14:14:07.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.108+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.11 2024-09-19T14:14:07.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.108+0000 7fc095a1c9c0 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-19T14:14:07.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.108+0000 7fc095a1c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.12 2024-09-19T14:14:07.113 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.108+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.12 2024-09-19T14:14:07.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.108+0000 7fc095a1c9c0 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-19T14:14:07.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.108+0000 7fc095a1c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.13 2024-09-19T14:14:07.114 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.108+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.13 2024-09-19T14:14:07.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.112+0000 7fc095a1c9c0 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-19T14:14:07.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.112+0000 7fc095a1c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.14 2024-09-19T14:14:07.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.112+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.14 2024-09-19T14:14:07.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.112+0000 7fc095a1c9c0 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-19T14:14:07.115 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.112+0000 7fc095a1c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.15 2024-09-19T14:14:07.116 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.112+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.15 2024-09-19T14:14:07.116 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.112+0000 7fc095a1c9c0 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-19T14:14:07.116 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.112+0000 7fc095a1c9c0 10 bucket_obj is .dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.16 2024-09-19T14:14:07.116 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.112+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.16 2024-09-19T14:14:07.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.112+0000 7fc095a1c9c0 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-19T14:14:07.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.112+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.9 2024-09-19T14:14:07.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.112+0000 7fc095a1c9c0 20 get_obj_state: octx=0x55e90372a510 obj=myver:x state=0x55e9039dcf58 s->prefetch_data=0 2024-09-19T14:14:07.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.112+0000 7fc095a1c9c0 20 get_obj_state: setting s->obj_tag to r9qtfcdcpb8vpf3gqc799ipdiopkr9kg 2024-09-19T14:14:07.117 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.112+0000 7fc095a1c9c0 20 get_obj_state_impl: setting s->olh_tag to pq82bgu6kcl5v9mzqgstr8zeaz5fbvp1 2024-09-19T14:14:07.118 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.112+0000 7fc095a1c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pq82bgu6kcl5v9mzqgstr8zeaz5fbvp1 2024-09-19T14:14:07.120 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.116+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.9 2024-09-19T14:14:07.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.116+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.9 2024-09-19T14:14:07.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.116+0000 7fc095a1c9c0 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-19T14:14:07.121 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.116+0000 7fc095a1c9c0 20 olh_log_entry: epoch=2 op=3 key=x[7l-osFVeMK-ihUjnwK5Pzy5-bBC4mo7] 2024-09-19T14:14:07.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.116+0000 7fc095a1c9c0 20 get_obj_state: octx=0x55e90372a510 obj=myver:_:7l-osFVeMK-ihUjnwK5Pzy5-bBC4mo7_x state=0x55e9039d7578 s->prefetch_data=0 2024-09-19T14:14:07.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.116+0000 7fc095a1c9c0 10 manifest: total_size = 22 2024-09-19T14:14:07.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.116+0000 7fc095a1c9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.5807417281526730782 2024-09-19T14:14:07.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.116+0000 7fc095a1c9c0 20 get_obj_state: octx=0x55e90372a510 obj=myver:_:7l-osFVeMK-ihUjnwK5Pzy5-bBC4mo7_x state=0x55e9039d7578 s->prefetch_data=0 2024-09-19T14:14:07.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.116+0000 7fc095a1c9c0 20 prepare_atomic_modification: state is not atomic. state=0x55e9039d7578 2024-09-19T14:14:07.122 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.116+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.9 2024-09-19T14:14:07.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.124+0000 7fc095a1c9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:14:07.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.124+0000 7fc095a1c9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-19T14:14:07.126 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.124+0000 7fc095a1c9c0 0 deleting objects inline since gc isn't initialized 2024-09-19T14:14:07.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.124+0000 7fc095a1c9c0 5 delete_objs_inline: removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.18__shadow:7l-osFVeMK-ihUjnwK5Pzy5-bBC4mo7_.X5Jextd9psiKg1KsHyv-V-hkEE9XbWu_0 2024-09-19T14:14:07.127 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.124+0000 7fbf76ffd640 20 handle_completion(): completion ok for obj=x[7l-osFVeMK-ihUjnwK5Pzy5-bBC4mo7] 2024-09-19T14:14:07.129 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.124+0000 7fc095a1c9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-19T14:14:07.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.128+0000 7fc095a1c9c0 20 get_obj_state: octx=0x55e90372a510 obj=myver:x state=0x55e9039dcf58 s->prefetch_data=0 2024-09-19T14:14:07.131 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.128+0000 7fc095a1c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pq82bgu6kcl5v9mzqgstr8zeaz5fbvp1 2024-09-19T14:14:07.136 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.132+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.9 2024-09-19T14:14:07.137 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.132+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.9 2024-09-19T14:14:07.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.132+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.9 2024-09-19T14:14:07.138 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.136+0000 7fc095a1c9c0 20 get_obj_state: octx=0x55e90372a510 obj=myver:y state=0x55e9039dcf58 s->prefetch_data=0 2024-09-19T14:14:07.139 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.136+0000 7fc095a1c9c0 20 get_obj_state: setting s->obj_tag to 3bhsub7zh1i1mngnk627ugzt2j64wosa 2024-09-19T14:14:07.139 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.136+0000 7fc095a1c9c0 20 get_obj_state_impl: setting s->olh_tag to 4akscoww09p7ptp8py6oceqxalvefl4t 2024-09-19T14:14:07.139 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.136+0000 7fc095a1c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4akscoww09p7ptp8py6oceqxalvefl4t 2024-09-19T14:14:07.142 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.140+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.9 2024-09-19T14:14:07.144 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.140+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.9 2024-09-19T14:14:07.144 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.140+0000 7fc095a1c9c0 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-19T14:14:07.144 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.140+0000 7fc095a1c9c0 20 olh_log_entry: epoch=2 op=3 key=y[MzFvuCs0eDrjIWYt.jZDsxKIqV2HFrO] 2024-09-19T14:14:07.144 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.140+0000 7fc095a1c9c0 20 get_obj_state: octx=0x55e90372a510 obj=myver:_:MzFvuCs0eDrjIWYt.jZDsxKIqV2HFrO_y state=0x55e9039d2528 s->prefetch_data=0 2024-09-19T14:14:07.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.140+0000 7fc095a1c9c0 10 manifest: total_size = 22 2024-09-19T14:14:07.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.140+0000 7fc095a1c9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.1052526206854911285 2024-09-19T14:14:07.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.140+0000 7fc095a1c9c0 20 get_obj_state: octx=0x55e90372a510 obj=myver:_:MzFvuCs0eDrjIWYt.jZDsxKIqV2HFrO_y state=0x55e9039d2528 s->prefetch_data=0 2024-09-19T14:14:07.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.140+0000 7fc095a1c9c0 20 prepare_atomic_modification: state is not atomic. state=0x55e9039d2528 2024-09-19T14:14:07.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.140+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.9 2024-09-19T14:14:07.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.144+0000 7fc095a1c9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:14:07.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.144+0000 7fc095a1c9c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-19T14:14:07.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.144+0000 7fc095a1c9c0 0 deleting objects inline since gc isn't initialized 2024-09-19T14:14:07.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.144+0000 7fc095a1c9c0 5 delete_objs_inline: removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.18__shadow:MzFvuCs0eDrjIWYt.jZDsxKIqV2HFrO_.wI6IvZKL9EWh0022mz83Y0MACKt1cV0_0 2024-09-19T14:14:07.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.148+0000 7fbf76ffd640 20 handle_completion(): completion ok for obj=y[MzFvuCs0eDrjIWYt.jZDsxKIqV2HFrO] 2024-09-19T14:14:07.152 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.148+0000 7fc095a1c9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-19T14:14:07.155 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.152+0000 7fc095a1c9c0 20 get_obj_state: octx=0x55e90372a510 obj=myver:y state=0x55e9039dcf58 s->prefetch_data=0 2024-09-19T14:14:07.155 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.152+0000 7fc095a1c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4akscoww09p7ptp8py6oceqxalvefl4t 2024-09-19T14:14:07.162 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.160+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.9 2024-09-19T14:14:07.163 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.160+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.9 2024-09-19T14:14:07.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.160+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.9 2024-09-19T14:14:07.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.160+0000 7fc095a1c9c0 20 get_obj_state: octx=0x55e90372a510 obj=myver:z state=0x55e9039d2528 s->prefetch_data=0 2024-09-19T14:14:07.164 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.160+0000 7fc095a1c9c0 20 get_obj_state: setting s->obj_tag to 1y2ugvmp0xd4r1s6nj0i2tqw76omh7f6 2024-09-19T14:14:07.165 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.160+0000 7fc095a1c9c0 20 get_obj_state_impl: setting s->olh_tag to 1ke359v1ud4rt2ece089wgoz3syra3bl 2024-09-19T14:14:07.165 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.160+0000 7fc095a1c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=1ke359v1ud4rt2ece089wgoz3syra3bl 2024-09-19T14:14:07.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.164+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.9 2024-09-19T14:14:07.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.164+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.9 2024-09-19T14:14:07.168 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.164+0000 7fc095a1c9c0 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-19T14:14:07.169 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.164+0000 7fc095a1c9c0 20 olh_log_entry: epoch=2 op=3 key=z[XRd6.cI-BiB07Ch3XHFL7ZjjUw5sQld] 2024-09-19T14:14:07.169 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.164+0000 7fc095a1c9c0 20 get_obj_state: octx=0x55e90372a510 obj=myver:_:XRd6.cI-BiB07Ch3XHFL7ZjjUw5sQld_z state=0x55e9039d3668 s->prefetch_data=0 2024-09-19T14:14:07.169 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.164+0000 7fc095a1c9c0 10 manifest: total_size = 9 2024-09-19T14:14:07.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.164+0000 7fc095a1c9c0 20 get_obj_state: setting s->obj_tag to dbb1da81-49d0-421a-b677-974869a7f103.4620.12322670553162306311 2024-09-19T14:14:07.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.164+0000 7fc095a1c9c0 20 get_obj_state: octx=0x55e90372a510 obj=myver:_:XRd6.cI-BiB07Ch3XHFL7ZjjUw5sQld_z state=0x55e9039d3668 s->prefetch_data=0 2024-09-19T14:14:07.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.164+0000 7fc095a1c9c0 20 prepare_atomic_modification: state is not atomic. state=0x55e9039d3668 2024-09-19T14:14:07.170 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.164+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.9 2024-09-19T14:14:07.174 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.168+0000 7fc095a1c9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-19T14:14:07.174 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.168+0000 7fc095a1c9c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-19T14:14:07.174 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.168+0000 7fc095a1c9c0 0 deleting objects inline since gc isn't initialized 2024-09-19T14:14:07.174 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.168+0000 7fc095a1c9c0 5 delete_objs_inline: removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.18__shadow:XRd6.cI-BiB07Ch3XHFL7ZjjUw5sQld_.NC1n-Hq1R25CUFmGlhHai_JDDKXFFn4_0 2024-09-19T14:14:07.175 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.172+0000 7fbf76ffd640 20 handle_completion(): completion ok for obj=z[XRd6.cI-BiB07Ch3XHFL7ZjjUw5sQld] 2024-09-19T14:14:07.176 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.172+0000 7fc095a1c9c0 5 delete_objs_inline: refcount put returned error -2 2024-09-19T14:14:07.178 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.176+0000 7fc095a1c9c0 20 get_obj_state: octx=0x55e90372a510 obj=myver:z state=0x55e9039d2528 s->prefetch_data=0 2024-09-19T14:14:07.178 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.176+0000 7fc095a1c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=1ke359v1ud4rt2ece089wgoz3syra3bl 2024-09-19T14:14:07.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.180+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.9 2024-09-19T14:14:07.184 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.180+0000 7fc095a1c9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.18.3.9 2024-09-19T14:14:07.184 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.180+0000 7fc095a1c9c0 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-19T14:14:07.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.180+0000 7fc095a1c9c0 1 NOTICE: finished all shards (3 entries removed) 2024-09-19T14:14:07.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.180+0000 7fbf4a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:14:07.190 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.184+0000 7fc095a1c9c0 20 remove_watcher() i=0 2024-09-19T14:14:07.190 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.184+0000 7fc095a1c9c0 2 removed watcher, disabling cache 2024-09-19T14:14:07.192 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.188+0000 7fc095a1c9c0 20 remove_watcher() i=1 2024-09-19T14:14:07.194 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.188+0000 7fc095a1c9c0 20 remove_watcher() i=2 2024-09-19T14:14:07.196 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.192+0000 7fc095a1c9c0 20 remove_watcher() i=3 2024-09-19T14:14:07.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.192+0000 7fc095a1c9c0 20 remove_watcher() i=4 2024-09-19T14:14:07.199 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.196+0000 7fc095a1c9c0 20 remove_watcher() i=5 2024-09-19T14:14:07.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.196+0000 7fc095a1c9c0 20 remove_watcher() i=6 2024-09-19T14:14:07.201 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.196+0000 7fc095a1c9c0 20 remove_watcher() i=7 2024-09-19T14:14:07.215 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:14:07.215 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:14:07.273 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:14:07.273 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:14:07.525 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket stats --bucket myver 2024-09-19T14:14:07.560 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:14:07.560 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:14:07.602 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.596+0000 7f4cee8559c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.600+0000 7f4cee8559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:07.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.600+0000 7f4cee8559c0 20 realm 2024-09-19T14:14:07.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.600+0000 7f4cee8559c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.600+0000 7f4cee8559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:07.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.600+0000 7f4cee8559c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:14:07.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.600+0000 7f4cee8559c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.604 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.600+0000 7f4cee8559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:07.605 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.600+0000 7f4cee8559c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.600+0000 7f4cee8559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:14:07.606 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.600+0000 7f4cee8559c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.604+0000 7f4cee8559c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:14:07.607 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.604+0000 7f4cee8559c0 20 searching for the correct realm 2024-09-19T14:14:07.612 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.608+0000 7f4cebb5a640 0 -- 172.21.15.153:0/375093158 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x56135ac31ca0 msgr2=0x56135ac34090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:14:07.617 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.612+0000 7f4cec35b640 0 -- 172.21.15.153:0/375093158 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f4ce0118450 msgr2=0x7f4ce01366a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:14:07.626 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.620+0000 7f4cee8559c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:14:07.626 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.620+0000 7f4cee8559c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:14:07.626 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.620+0000 7f4cee8559c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:14:07.626 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.620+0000 7f4cee8559c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:14:07.627 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.620+0000 7f4cee8559c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:14:07.627 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.620+0000 7f4cee8559c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:14:07.627 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.620+0000 7f4cee8559c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.627 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.624+0000 7f4cee8559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:07.627 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.624+0000 7f4cee8559c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.627 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.624+0000 7f4cee8559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:14:07.627 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.624+0000 7f4cee8559c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.624+0000 7f4cee8559c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:14:07.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.624+0000 7f4cee8559c0 20 zone default found 2024-09-19T14:14:07.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.624+0000 7f4cee8559c0 4 Realm: () 2024-09-19T14:14:07.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.624+0000 7f4cee8559c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:14:07.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.624+0000 7f4cee8559c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:14:07.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.624+0000 7f4cee8559c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:14:07.628 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.624+0000 7f4cee8559c0 20 zonegroup default 2024-09-19T14:14:07.629 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.624+0000 7f4cee8559c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.630 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.624+0000 7f4cee8559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:07.630 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.624+0000 7f4cee8559c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.630 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.624+0000 7f4cee8559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:07.630 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.624+0000 7f4cee8559c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.630 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.624+0000 7f4cee8559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:07.630 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.624+0000 7f4cee8559c0 20 started sync module instance, tier type = 2024-09-19T14:14:07.630 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.624+0000 7f4cee8559c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:14:07.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.644+0000 7f4cee8559c0 20 add_watcher() i=0 2024-09-19T14:14:07.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.644+0000 7f4cee8559c0 20 add_watcher() i=1 2024-09-19T14:14:07.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.644+0000 7f4cee8559c0 20 add_watcher() i=2 2024-09-19T14:14:07.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.644+0000 7f4cee8559c0 20 add_watcher() i=3 2024-09-19T14:14:07.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.644+0000 7f4cee8559c0 20 add_watcher() i=4 2024-09-19T14:14:07.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.644+0000 7f4cee8559c0 20 add_watcher() i=5 2024-09-19T14:14:07.648 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.644+0000 7f4cee8559c0 20 add_watcher() i=6 2024-09-19T14:14:07.649 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.644+0000 7f4cee8559c0 20 add_watcher() i=7 2024-09-19T14:14:07.649 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.644+0000 7f4cee8559c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:14:07.651 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.648+0000 7f4ba2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:14:07.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.648+0000 7f4cee8559c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:14:07.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.648+0000 7f4cee8559c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:14:07.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.648+0000 7f4cee8559c0 5 note: GC not initialized 2024-09-19T14:14:07.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.648+0000 7f4ba1fdb640 20 reqs_thread_entry: start 2024-09-19T14:14:07.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.648+0000 7f4cee8559c0 20 init_complete bucket index max shards: 11 2024-09-19T14:14:07.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.648+0000 7f4cee8559c0 20 Filter name: none 2024-09-19T14:14:07.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.648+0000 7f4b137fe640 20 reqs_thread_entry: start 2024-09-19T14:14:07.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.648+0000 7f4cee8559c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.648+0000 7f4cee8559c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-19T14:14:07.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.648+0000 7f4cee8559c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.648+0000 7f4cee8559c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-19T14:14:07.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.648+0000 7f4cee8559c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:14:07.654 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.648+0000 7f4cee8559c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.652+0000 7f4cee8559c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-19T14:14:07.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.652+0000 7f4cee8559c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:07.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.652+0000 7f4cee8559c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-19T14:14:07.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.652+0000 7f4cee8559c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T14:14:07.658 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.656+0000 7f4ba2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:14:07.663 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.660+0000 7f4cee8559c0 20 remove_watcher() i=0 2024-09-19T14:14:07.664 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.660+0000 7f4cee8559c0 2 removed watcher, disabling cache 2024-09-19T14:14:07.668 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.664+0000 7f4cee8559c0 20 remove_watcher() i=1 2024-09-19T14:14:07.670 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.664+0000 7f4cee8559c0 20 remove_watcher() i=2 2024-09-19T14:14:07.672 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.668+0000 7f4cee8559c0 20 remove_watcher() i=3 2024-09-19T14:14:07.674 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.668+0000 7f4cee8559c0 20 remove_watcher() i=4 2024-09-19T14:14:07.675 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.672+0000 7f4cee8559c0 20 remove_watcher() i=5 2024-09-19T14:14:07.676 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.672+0000 7f4cee8559c0 20 remove_watcher() i=6 2024-09-19T14:14:07.677 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T14:14:07.672+0000 7f4cee8559c0 20 remove_watcher() i=7 2024-09-19T14:14:07.691 INFO:tasks.workunit.client.0.smithi153.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-19T14:14:07.691 INFO:tasks.workunit.client.0.smithi153.stderr:Deleting bucket a-bucket 2024-09-19T14:14:07.692 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:14:07.693 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:14:07.720 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:14:07.721 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:14:07.857 INFO:tasks.workunit.client.0.smithi153.stderr:Deleting bucket myver 2024-09-19T14:14:07.859 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:14:07.859 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:14:07.990 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T14:14:07.991 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T14:14:08.453 INFO:tasks.workunit.client.0.smithi153.stderr:Completed resharding tests 2024-09-19T14:14:08.453 INFO:tasks.workunit.client.0.smithi153.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-19T14:14:08.453 INFO:tasks.workunit.client.0.smithi153.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-19T14:14:08.453 INFO:tasks.workunit.client.0.smithi153.stdout:connected to https://localhost:443 2024-09-19T14:14:08.572 INFO:tasks.workunit.client.0.smithi153.stderr:+ deactivate 2024-09-19T14:14:08.572 INFO:tasks.workunit.client.0.smithi153.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-19T14:14:08.572 INFO:tasks.workunit.client.0.smithi153.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-19T14:14:08.572 INFO:tasks.workunit.client.0.smithi153.stderr:+ export PATH 2024-09-19T14:14:08.572 INFO:tasks.workunit.client.0.smithi153.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-19T14:14:08.573 INFO:tasks.workunit.client.0.smithi153.stderr:+ '[' -n '' ']' 2024-09-19T14:14:08.573 INFO:tasks.workunit.client.0.smithi153.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T14:14:08.573 INFO:tasks.workunit.client.0.smithi153.stderr:+ hash -r 2024-09-19T14:14:08.573 INFO:tasks.workunit.client.0.smithi153.stderr:+ '[' -n '' ']' 2024-09-19T14:14:08.573 INFO:tasks.workunit.client.0.smithi153.stderr:+ unset VIRTUAL_ENV 2024-09-19T14:14:08.573 INFO:tasks.workunit.client.0.smithi153.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-19T14:14:08.573 INFO:tasks.workunit.client.0.smithi153.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-19T14:14:08.573 INFO:tasks.workunit.client.0.smithi153.stderr:+ unset -f deactivate 2024-09-19T14:14:08.573 INFO:tasks.workunit.client.0.smithi153.stdout:OK. 2024-09-19T14:14:08.574 INFO:tasks.workunit.client.0.smithi153.stderr:+ echo OK. 2024-09-19T14:14:08.574 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T14:14:08.575 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T14:14:08.631 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-19T14:14:08.631 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T14:14:09.059 DEBUG:teuthology.parallel:result is None 2024-09-19T14:14:09.059 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T14:14:09.071 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T14:14:09.072 DEBUG:teuthology.orchestra.run.smithi153:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T14:14:09.123 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T14:14:09.123 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-19T14:14:09.136 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-19T14:14:09.137 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-19T14:14:09.137 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-19T14:14:09.137 DEBUG:teuthology.orchestra.run.smithi153:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-19T14:14:09.171 INFO:teuthology.orchestra.run.smithi153.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-19T14:14:13.596 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-19T14:14:13.596 DEBUG:teuthology.orchestra.run.smithi153:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-19T14:14:13.684 INFO:teuthology.orchestra.run.smithi153.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required DEB packages. Installing via sudo. 2024-09-19T14:14:13.740 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2024-09-19T14:14:13.958 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2024-09-19T14:14:13.959 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2024-09-19T14:14:14.156 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2024-09-19T14:14:14.157 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-19T14:14:14.157 INFO:teuthology.orchestra.run.smithi153.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-19T14:14:14.157 INFO:teuthology.orchestra.run.smithi153.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-19T14:14:14.157 INFO:teuthology.orchestra.run.smithi153.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-19T14:14:14.157 INFO:teuthology.orchestra.run.smithi153.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-19T14:14:14.157 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-19T14:14:14.158 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2024-09-19T14:14:14.159 INFO:teuthology.orchestra.run.smithi153.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-19T14:14:14.159 INFO:teuthology.orchestra.run.smithi153.stdout: openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-19T14:14:14.160 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2024-09-19T14:14:14.160 INFO:teuthology.orchestra.run.smithi153.stdout: gvfs openjdk-8-demo openjdk-8-source visualvm libnss-mdns fonts-nanum 2024-09-19T14:14:14.160 INFO:teuthology.orchestra.run.smithi153.stdout: fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei 2024-09-19T14:14:14.160 INFO:teuthology.orchestra.run.smithi153.stdout: fonts-wqy-zenhei fonts-indic 2024-09-19T14:14:14.197 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2024-09-19T14:14:14.197 INFO:teuthology.orchestra.run.smithi153.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-19T14:14:14.198 INFO:teuthology.orchestra.run.smithi153.stdout: openjdk-8-jdk openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-19T14:14:14.269 INFO:teuthology.orchestra.run.smithi153.stdout:0 upgraded, 9 newly installed, 0 to remove and 331 not upgraded. 2024-09-19T14:14:14.269 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 46.0 MB of archives. 2024-09-19T14:14:14.269 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 155 MB of additional disk space will be used. 2024-09-19T14:14:14.269 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-common all 2.24.33-2ubuntu2.1 [125 kB] 2024-09-19T14:14:14.345 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-0 amd64 2.24.33-2ubuntu2.1 [2,038 kB] 2024-09-19T14:14:14.427 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail18 amd64 2.24.33-2ubuntu2.1 [15.9 kB] 2024-09-19T14:14:14.427 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail-common amd64 2.24.33-2ubuntu2.1 [132 kB] 2024-09-19T14:14:14.430 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-bin amd64 2.24.33-2ubuntu2.1 [7,936 B] 2024-09-19T14:14:14.431 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre-headless amd64 8u422-b05-1~22.04 [30.8 MB] 2024-09-19T14:14:14.789 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre amd64 8u422-b05-1~22.04 [75.5 kB] 2024-09-19T14:14:14.851 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk-headless amd64 8u422-b05-1~22.04 [8,843 kB] 2024-09-19T14:14:14.941 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk amd64 8u422-b05-1~22.04 [4,012 kB] 2024-09-19T14:14:15.274 INFO:teuthology.orchestra.run.smithi153.stderr:debconf: unable to initialize frontend: Dialog 2024-09-19T14:14:15.274 INFO:teuthology.orchestra.run.smithi153.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-09-19T14:14:15.275 INFO:teuthology.orchestra.run.smithi153.stderr:debconf: falling back to frontend: Readline 2024-09-19T14:14:15.285 INFO:teuthology.orchestra.run.smithi153.stderr:debconf: unable to initialize frontend: Readline 2024-09-19T14:14:15.285 INFO:teuthology.orchestra.run.smithi153.stderr:debconf: (This frontend requires a controlling tty.) 2024-09-19T14:14:15.285 INFO:teuthology.orchestra.run.smithi153.stderr:debconf: falling back to frontend: Teletype 2024-09-19T14:14:15.288 INFO:teuthology.orchestra.run.smithi153.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-09-19T14:14:15.325 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 46.0 MB in 1s (60.1 MB/s) 2024-09-19T14:14:15.444 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libgtk2.0-common. 2024-09-19T14:14:15.519 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 177259 files and directories currently installed.) 2024-09-19T14:14:15.524 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../0-libgtk2.0-common_2.24.33-2ubuntu2.1_all.deb ... 2024-09-19T14:14:15.560 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-19T14:14:15.989 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libgtk2.0-0:amd64. 2024-09-19T14:14:16.017 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../1-libgtk2.0-0_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-19T14:14:16.097 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-19T14:14:16.526 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libgail18:amd64. 2024-09-19T14:14:16.555 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../2-libgail18_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-19T14:14:16.593 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-19T14:14:16.829 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libgail-common:amd64. 2024-09-19T14:14:16.857 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../3-libgail-common_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-19T14:14:16.895 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-19T14:14:17.165 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libgtk2.0-bin. 2024-09-19T14:14:17.182 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../4-libgtk2.0-bin_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-19T14:14:17.223 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-19T14:14:17.626 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package openjdk-8-jre-headless:amd64. 2024-09-19T14:14:17.657 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../5-openjdk-8-jre-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-19T14:14:17.704 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-19T14:14:19.282 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package openjdk-8-jre:amd64. 2024-09-19T14:14:19.310 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../6-openjdk-8-jre_8u422-b05-1~22.04_amd64.deb ... 2024-09-19T14:14:19.352 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-19T14:14:19.837 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package openjdk-8-jdk-headless:amd64. 2024-09-19T14:14:19.865 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../7-openjdk-8-jdk-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-19T14:14:19.907 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-19T14:14:20.707 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package openjdk-8-jdk:amd64. 2024-09-19T14:14:20.735 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../8-openjdk-8-jdk_8u422-b05-1~22.04_amd64.deb ... 2024-09-19T14:14:20.776 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-19T14:14:21.152 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-19T14:14:22.250 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode 2024-09-19T14:14:22.275 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode 2024-09-19T14:14:22.292 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode 2024-09-19T14:14:22.675 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-19T14:14:22.843 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-19T14:14:23.211 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-19T14:14:23.319 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode 2024-09-19T14:14:23.388 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-19T14:14:23.472 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/clhsdb to provide /usr/bin/clhsdb (clhsdb) in auto mode 2024-09-19T14:14:23.501 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode 2024-09-19T14:14:23.527 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/hsdb to provide /usr/bin/hsdb (hsdb) in auto mode 2024-09-19T14:14:23.551 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode 2024-09-19T14:14:23.680 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javah to provide /usr/bin/javah (javah) in auto mode 2024-09-19T14:14:23.821 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode 2024-09-19T14:14:23.941 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode 2024-09-19T14:14:24.041 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode 2024-09-19T14:14:24.084 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode 2024-09-19T14:14:24.136 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode 2024-09-19T14:14:24.161 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode 2024-09-19T14:14:24.187 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode 2024-09-19T14:14:24.242 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-19T14:14:24.359 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-19T14:14:24.502 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-19T14:14:24.596 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode 2024-09-19T14:14:24.696 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-19T14:14:24.823 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-19T14:14:25.940 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-19T14:14:26.041 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-19T14:14:26.293 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-19T14:14:26.771 INFO:teuthology.orchestra.run.smithi153.stdout: Gradle will be installed under /opt/gradle 2024-09-19T14:14:26.800 INFO:teuthology.orchestra.run.smithi153.stderr:--2024-09-19 14:14:26-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-19T14:14:26.814 INFO:teuthology.orchestra.run.smithi153.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4865, ... 2024-09-19T14:14:26.822 INFO:teuthology.orchestra.run.smithi153.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-19T14:14:26.868 INFO:teuthology.orchestra.run.smithi153.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-19T14:14:26.868 INFO:teuthology.orchestra.run.smithi153.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-19T14:14:26.868 INFO:teuthology.orchestra.run.smithi153.stderr:--2024-09-19 14:14:26-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-19T14:14:26.869 INFO:teuthology.orchestra.run.smithi153.stderr:Resolving github.com (github.com)... 140.82.112.4 2024-09-19T14:14:26.879 INFO:teuthology.orchestra.run.smithi153.stderr:Connecting to github.com (github.com)|140.82.112.4|:443... connected. 2024-09-19T14:14:26.991 INFO:teuthology.orchestra.run.smithi153.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-19T14:14:26.991 INFO:teuthology.orchestra.run.smithi153.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240919%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240919T141426Z&X-Amz-Expires=300&X-Amz-Signature=6d24b9123a59c24431118db71656c0978293b116362b02e456f8a3fd360871b6&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-19T14:14:26.991 INFO:teuthology.orchestra.run.smithi153.stderr:--2024-09-19 14:14:26-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240919%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240919T141426Z&X-Amz-Expires=300&X-Amz-Signature=6d24b9123a59c24431118db71656c0978293b116362b02e456f8a3fd360871b6&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-19T14:14:26.994 INFO:teuthology.orchestra.run.smithi153.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.111.133, 185.199.110.133, 185.199.109.133, ... 2024-09-19T14:14:27.006 INFO:teuthology.orchestra.run.smithi153.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.111.133|:443... connected. 2024-09-19T14:14:27.084 INFO:teuthology.orchestra.run.smithi153.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-19T14:14:27.084 INFO:teuthology.orchestra.run.smithi153.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-19T14:14:27.084 INFO:teuthology.orchestra.run.smithi153.stderr:Saving to: 'gradle-6.0.1-bin.zip' 2024-09-19T14:14:27.086 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-19T14:14:27.097 INFO:teuthology.orchestra.run.smithi153.stderr: 0K .......... .......... .......... .......... .......... 0% 3.83M 24s 2024-09-19T14:14:27.109 INFO:teuthology.orchestra.run.smithi153.stderr: 50K .......... .......... .......... .......... .......... 0% 4.20M 23s 2024-09-19T14:14:27.111 INFO:teuthology.orchestra.run.smithi153.stderr: 100K .......... .......... .......... .......... .......... 0% 16.4M 17s 2024-09-19T14:14:27.113 INFO:teuthology.orchestra.run.smithi153.stderr: 150K .......... .......... .......... .......... .......... 0% 27.8M 13s 2024-09-19T14:14:27.121 INFO:teuthology.orchestra.run.smithi153.stderr: 200K .......... .......... .......... .......... .......... 0% 6.73M 13s 2024-09-19T14:14:27.122 INFO:teuthology.orchestra.run.smithi153.stderr: 250K .......... .......... .......... .......... .......... 0% 37.2M 12s 2024-09-19T14:14:27.124 INFO:teuthology.orchestra.run.smithi153.stderr: 300K .......... .......... .......... .......... .......... 0% 26.4M 10s 2024-09-19T14:14:27.126 INFO:teuthology.orchestra.run.smithi153.stderr: 350K .......... .......... .......... .......... .......... 0% 27.6M 10s 2024-09-19T14:14:27.133 INFO:teuthology.orchestra.run.smithi153.stderr: 400K .......... .......... .......... .......... .......... 0% 8.00M 10s 2024-09-19T14:14:27.133 INFO:teuthology.orchestra.run.smithi153.stderr: 450K .......... .......... .......... .......... .......... 0% 68.5M 9s 2024-09-19T14:14:27.134 INFO:teuthology.orchestra.run.smithi153.stderr: 500K .......... .......... .......... .......... .......... 0% 54.3M 8s 2024-09-19T14:14:27.134 INFO:teuthology.orchestra.run.smithi153.stderr: 550K .......... .......... .......... .......... .......... 0% 104M 8s 2024-09-19T14:14:27.139 INFO:teuthology.orchestra.run.smithi153.stderr: 600K .......... .......... .......... .......... .......... 0% 47.5M 7s 2024-09-19T14:14:27.139 INFO:teuthology.orchestra.run.smithi153.stderr: 650K .......... .......... .......... .......... .......... 0% 56.6M 7s 2024-09-19T14:14:27.139 INFO:teuthology.orchestra.run.smithi153.stderr: 700K .......... .......... .......... .......... .......... 0% 144M 6s 2024-09-19T14:14:27.139 INFO:teuthology.orchestra.run.smithi153.stderr: 750K .......... .......... .......... .......... .......... 0% 58.8M 6s 2024-09-19T14:14:27.139 INFO:teuthology.orchestra.run.smithi153.stderr: 800K .......... .......... .......... .......... .......... 0% 64.5M 6s 2024-09-19T14:14:27.139 INFO:teuthology.orchestra.run.smithi153.stderr: 850K .......... .......... .......... .......... .......... 0% 77.8M 6s 2024-09-19T14:14:28.057 INFO:teuthology.orchestra.run.smithi153.stderr: 900K .......... .......... .......... .......... .......... 1% 9.53M 6s 2024-09-19T14:14:28.057 INFO:teuthology.orchestra.run.smithi153.stderr: 950K .......... .......... .......... .......... .......... 1% 133M 5s 2024-09-19T14:14:28.057 INFO:teuthology.orchestra.run.smithi153.stderr: 1000K .......... .......... .......... .......... .......... 1% 101M 5s 2024-09-19T14:14:28.057 INFO:teuthology.orchestra.run.smithi153.stderr: 1050K .......... .......... .......... .......... .......... 1% 100M 5s 2024-09-19T14:14:28.057 INFO:teuthology.orchestra.run.smithi153.stderr: 1100K .......... .......... .......... .......... .......... 1% 93.0M 5s 2024-09-19T14:14:28.057 INFO:teuthology.orchestra.run.smithi153.stderr: 1150K .......... .......... .......... .......... .......... 1% 95.4M 5s 2024-09-19T14:14:28.057 INFO:teuthology.orchestra.run.smithi153.stderr: 1200K .......... .......... .......... .......... .......... 1% 143M 5s 2024-09-19T14:14:28.058 INFO:teuthology.orchestra.run.smithi153.stderr: 1250K .......... .......... .......... .......... .......... 1% 106M 4s 2024-09-19T14:14:28.058 INFO:teuthology.orchestra.run.smithi153.stderr: 1300K .......... .......... .......... .......... .......... 1% 110M 4s 2024-09-19T14:14:28.058 INFO:teuthology.orchestra.run.smithi153.stderr: 1350K .......... .......... .......... .......... .......... 1% 125M 4s 2024-09-19T14:14:28.058 INFO:teuthology.orchestra.run.smithi153.stderr: 1400K .......... .......... .......... .......... .......... 1% 155M 4s 2024-09-19T14:14:28.058 INFO:teuthology.orchestra.run.smithi153.stderr: 1450K .......... .......... .......... .......... .......... 1% 124M 4s 2024-09-19T14:14:28.058 INFO:teuthology.orchestra.run.smithi153.stderr: 1500K .......... .......... .......... .......... .......... 1% 136M 4s 2024-09-19T14:14:28.058 INFO:teuthology.orchestra.run.smithi153.stderr: 1550K .......... .......... .......... .......... .......... 1% 126M 4s 2024-09-19T14:14:28.058 INFO:teuthology.orchestra.run.smithi153.stderr: 1600K .......... .......... .......... .......... .......... 1% 123M 4s 2024-09-19T14:14:28.058 INFO:teuthology.orchestra.run.smithi153.stderr: 1650K .......... .......... .......... .......... .......... 1% 151M 3s 2024-09-19T14:14:28.058 INFO:teuthology.orchestra.run.smithi153.stderr: 1700K .......... .......... .......... .......... .......... 1% 144M 3s 2024-09-19T14:14:28.058 INFO:teuthology.orchestra.run.smithi153.stderr: 1750K .......... .......... .......... .......... .......... 1% 136M 3s 2024-09-19T14:14:28.058 INFO:teuthology.orchestra.run.smithi153.stderr: 1800K .......... .......... .......... .......... .......... 1% 11.0M 3s 2024-09-19T14:14:28.058 INFO:teuthology.orchestra.run.smithi153.stderr: 1850K .......... .......... .......... .......... .......... 2% 131M 3s 2024-09-19T14:14:28.058 INFO:teuthology.orchestra.run.smithi153.stderr: 1900K .......... .......... .......... .......... .......... 2% 147M 3s 2024-09-19T14:14:28.059 INFO:teuthology.orchestra.run.smithi153.stderr: 1950K .......... .......... .......... .......... .......... 2% 112M 3s 2024-09-19T14:14:28.059 INFO:teuthology.orchestra.run.smithi153.stderr: 2000K .......... .......... .......... .......... .......... 2% 143M 3s 2024-09-19T14:14:28.059 INFO:teuthology.orchestra.run.smithi153.stderr: 2050K .......... .......... .......... .......... .......... 2% 142M 3s 2024-09-19T14:14:28.059 INFO:teuthology.orchestra.run.smithi153.stderr: 2100K .......... .......... .......... .......... .......... 2% 136M 3s 2024-09-19T14:14:28.059 INFO:teuthology.orchestra.run.smithi153.stderr: 2150K .......... .......... .......... .......... .......... 2% 130M 3s 2024-09-19T14:14:28.059 INFO:teuthology.orchestra.run.smithi153.stderr: 2200K .......... .......... .......... .......... .......... 2% 146M 3s 2024-09-19T14:14:28.059 INFO:teuthology.orchestra.run.smithi153.stderr: 2250K .......... .......... .......... .......... .......... 2% 145M 3s 2024-09-19T14:14:28.059 INFO:teuthology.orchestra.run.smithi153.stderr: 2300K .......... .......... .......... .......... .......... 2% 142M 3s 2024-09-19T14:14:28.059 INFO:teuthology.orchestra.run.smithi153.stderr: 2350K .......... .......... .......... .......... .......... 2% 106M 3s 2024-09-19T14:14:28.059 INFO:teuthology.orchestra.run.smithi153.stderr: 2400K .......... .......... .......... .......... .......... 2% 133M 3s 2024-09-19T14:14:28.059 INFO:teuthology.orchestra.run.smithi153.stderr: 2450K .......... .......... .......... .......... .......... 2% 137M 3s 2024-09-19T14:14:28.059 INFO:teuthology.orchestra.run.smithi153.stderr: 2500K .......... .......... .......... .......... .......... 2% 137M 3s 2024-09-19T14:14:28.060 INFO:teuthology.orchestra.run.smithi153.stderr: 2550K .......... .......... .......... .......... .......... 2% 132M 3s 2024-09-19T14:14:28.060 INFO:teuthology.orchestra.run.smithi153.stderr: 2600K .......... .......... .......... .......... .......... 2% 132M 3s 2024-09-19T14:14:28.060 INFO:teuthology.orchestra.run.smithi153.stderr: 2650K .......... .......... .......... .......... .......... 2% 142M 3s 2024-09-19T14:14:28.060 INFO:teuthology.orchestra.run.smithi153.stderr: 2700K .......... .......... .......... .......... .......... 2% 137M 3s 2024-09-19T14:14:28.060 INFO:teuthology.orchestra.run.smithi153.stderr: 2750K .......... .......... .......... .......... .......... 3% 118M 2s 2024-09-19T14:14:28.060 INFO:teuthology.orchestra.run.smithi153.stderr: 2800K .......... .......... .......... .......... .......... 3% 131M 2s 2024-09-19T14:14:28.060 INFO:teuthology.orchestra.run.smithi153.stderr: 2850K .......... .......... .......... .......... .......... 3% 142M 2s 2024-09-19T14:14:28.060 INFO:teuthology.orchestra.run.smithi153.stderr: 2900K .......... .......... .......... .......... .......... 3% 148M 2s 2024-09-19T14:14:28.060 INFO:teuthology.orchestra.run.smithi153.stderr: 2950K .......... .......... .......... .......... .......... 3% 136M 2s 2024-09-19T14:14:28.060 INFO:teuthology.orchestra.run.smithi153.stderr: 3000K .......... .......... .......... .......... .......... 3% 155M 2s 2024-09-19T14:14:28.060 INFO:teuthology.orchestra.run.smithi153.stderr: 3050K .......... .......... .......... .......... .......... 3% 154M 2s 2024-09-19T14:14:28.060 INFO:teuthology.orchestra.run.smithi153.stderr: 3100K .......... .......... .......... .......... .......... 3% 149M 2s 2024-09-19T14:14:28.060 INFO:teuthology.orchestra.run.smithi153.stderr: 3150K .......... .......... .......... .......... .......... 3% 129M 2s 2024-09-19T14:14:28.061 INFO:teuthology.orchestra.run.smithi153.stderr: 3200K .......... .......... .......... .......... .......... 3% 155M 2s 2024-09-19T14:14:28.061 INFO:teuthology.orchestra.run.smithi153.stderr: 3250K .......... .......... .......... .......... .......... 3% 154M 2s 2024-09-19T14:14:28.061 INFO:teuthology.orchestra.run.smithi153.stderr: 3300K .......... .......... .......... .......... .......... 3% 155M 2s 2024-09-19T14:14:28.061 INFO:teuthology.orchestra.run.smithi153.stderr: 3350K .......... .......... .......... .......... .......... 3% 136M 2s 2024-09-19T14:14:28.061 INFO:teuthology.orchestra.run.smithi153.stderr: 3400K .......... .......... .......... .......... .......... 3% 152M 2s 2024-09-19T14:14:28.061 INFO:teuthology.orchestra.run.smithi153.stderr: 3450K .......... .......... .......... .......... .......... 3% 128M 2s 2024-09-19T14:14:28.061 INFO:teuthology.orchestra.run.smithi153.stderr: 3500K .......... .......... .......... .......... .......... 3% 138M 2s 2024-09-19T14:14:28.061 INFO:teuthology.orchestra.run.smithi153.stderr: 3550K .......... .......... .......... .......... .......... 3% 111M 2s 2024-09-19T14:14:28.061 INFO:teuthology.orchestra.run.smithi153.stderr: 3600K .......... .......... .......... .......... .......... 3% 132M 2s 2024-09-19T14:14:28.061 INFO:teuthology.orchestra.run.smithi153.stderr: 3650K .......... .......... .......... .......... .......... 3% 138M 2s 2024-09-19T14:14:28.061 INFO:teuthology.orchestra.run.smithi153.stderr: 3700K .......... .......... .......... .......... .......... 4% 136M 2s 2024-09-19T14:14:28.061 INFO:teuthology.orchestra.run.smithi153.stderr: 3750K .......... .......... .......... .......... .......... 4% 127M 2s 2024-09-19T14:14:28.061 INFO:teuthology.orchestra.run.smithi153.stderr: 3800K .......... .......... .......... .......... .......... 4% 142M 2s 2024-09-19T14:14:28.062 INFO:teuthology.orchestra.run.smithi153.stderr: 3850K .......... .......... .......... .......... .......... 4% 130M 2s 2024-09-19T14:14:28.062 INFO:teuthology.orchestra.run.smithi153.stderr: 3900K .......... .......... .......... .......... .......... 4% 137M 2s 2024-09-19T14:14:28.062 INFO:teuthology.orchestra.run.smithi153.stderr: 3950K .......... .......... .......... .......... .......... 4% 115M 2s 2024-09-19T14:14:28.062 INFO:teuthology.orchestra.run.smithi153.stderr: 4000K .......... .......... .......... .......... .......... 4% 123M 2s 2024-09-19T14:14:28.062 INFO:teuthology.orchestra.run.smithi153.stderr: 4050K .......... .......... .......... .......... .......... 4% 131M 2s 2024-09-19T14:14:28.062 INFO:teuthology.orchestra.run.smithi153.stderr: 4100K .......... .......... .......... .......... .......... 4% 148M 2s 2024-09-19T14:14:28.062 INFO:teuthology.orchestra.run.smithi153.stderr: 4150K .......... .......... .......... .......... .......... 4% 131M 2s 2024-09-19T14:14:28.062 INFO:teuthology.orchestra.run.smithi153.stderr: 4200K .......... .......... .......... .......... .......... 4% 100M 2s 2024-09-19T14:14:28.062 INFO:teuthology.orchestra.run.smithi153.stderr: 4250K .......... .......... .......... .......... .......... 4% 136M 2s 2024-09-19T14:14:28.062 INFO:teuthology.orchestra.run.smithi153.stderr: 4300K .......... .......... .......... .......... .......... 4% 144M 2s 2024-09-19T14:14:28.062 INFO:teuthology.orchestra.run.smithi153.stderr: 4350K .......... .......... .......... .......... .......... 4% 119M 2s 2024-09-19T14:14:28.062 INFO:teuthology.orchestra.run.smithi153.stderr: 4400K .......... .......... .......... .......... .......... 4% 141M 2s 2024-09-19T14:14:28.062 INFO:teuthology.orchestra.run.smithi153.stderr: 4450K .......... .......... .......... .......... .......... 4% 148M 2s 2024-09-19T14:14:28.062 INFO:teuthology.orchestra.run.smithi153.stderr: 4500K .......... .......... .......... .......... .......... 4% 152M 2s 2024-09-19T14:14:28.063 INFO:teuthology.orchestra.run.smithi153.stderr: 4550K .......... .......... .......... .......... .......... 4% 131M 2s 2024-09-19T14:14:28.063 INFO:teuthology.orchestra.run.smithi153.stderr: 4600K .......... .......... .......... .......... .......... 5% 135M 2s 2024-09-19T14:14:28.063 INFO:teuthology.orchestra.run.smithi153.stderr: 4650K .......... .......... .......... .......... .......... 5% 144M 2s 2024-09-19T14:14:28.063 INFO:teuthology.orchestra.run.smithi153.stderr: 4700K .......... .......... .......... .......... .......... 5% 156M 2s 2024-09-19T14:14:28.063 INFO:teuthology.orchestra.run.smithi153.stderr: 4750K .......... .......... .......... .......... .......... 5% 124M 2s 2024-09-19T14:14:28.063 INFO:teuthology.orchestra.run.smithi153.stderr: 4800K .......... .......... .......... .......... .......... 5% 153M 2s 2024-09-19T14:14:28.063 INFO:teuthology.orchestra.run.smithi153.stderr: 4850K .......... .......... .......... .......... .......... 5% 130M 2s 2024-09-19T14:14:28.063 INFO:teuthology.orchestra.run.smithi153.stderr: 4900K .......... .......... .......... .......... .......... 5% 142M 2s 2024-09-19T14:14:28.063 INFO:teuthology.orchestra.run.smithi153.stderr: 4950K .......... .......... .......... .......... .......... 5% 139M 2s 2024-09-19T14:14:28.063 INFO:teuthology.orchestra.run.smithi153.stderr: 5000K .......... .......... .......... .......... .......... 5% 152M 2s 2024-09-19T14:14:28.063 INFO:teuthology.orchestra.run.smithi153.stderr: 5050K .......... .......... .......... .......... .......... 5% 133M 2s 2024-09-19T14:14:28.063 INFO:teuthology.orchestra.run.smithi153.stderr: 5100K .......... .......... .......... .......... .......... 5% 134M 2s 2024-09-19T14:14:28.063 INFO:teuthology.orchestra.run.smithi153.stderr: 5150K .......... .......... .......... .......... .......... 5% 112M 2s 2024-09-19T14:14:28.064 INFO:teuthology.orchestra.run.smithi153.stderr: 5200K .......... .......... .......... .......... .......... 5% 148M 2s 2024-09-19T14:14:28.064 INFO:teuthology.orchestra.run.smithi153.stderr: 5250K .......... .......... .......... .......... .......... 5% 137M 2s 2024-09-19T14:14:28.064 INFO:teuthology.orchestra.run.smithi153.stderr: 5300K .......... .......... .......... .......... .......... 5% 142M 2s 2024-09-19T14:14:28.064 INFO:teuthology.orchestra.run.smithi153.stderr: 5350K .......... .......... .......... .......... .......... 5% 136M 2s 2024-09-19T14:14:28.064 INFO:teuthology.orchestra.run.smithi153.stderr: 5400K .......... .......... .......... .......... .......... 5% 144M 2s 2024-09-19T14:14:28.064 INFO:teuthology.orchestra.run.smithi153.stderr: 5450K .......... .......... .......... .......... .......... 5% 140M 2s 2024-09-19T14:14:28.064 INFO:teuthology.orchestra.run.smithi153.stderr: 5500K .......... .......... .......... .......... .......... 5% 144M 2s 2024-09-19T14:14:28.064 INFO:teuthology.orchestra.run.smithi153.stderr: 5550K .......... .......... .......... .......... .......... 6% 123M 2s 2024-09-19T14:14:28.064 INFO:teuthology.orchestra.run.smithi153.stderr: 5600K .......... .......... .......... .......... .......... 6% 151M 2s 2024-09-19T14:14:28.064 INFO:teuthology.orchestra.run.smithi153.stderr: 5650K .......... .......... .......... .......... .......... 6% 145M 1s 2024-09-19T14:14:28.064 INFO:teuthology.orchestra.run.smithi153.stderr: 5700K .......... .......... .......... .......... .......... 6% 133M 1s 2024-09-19T14:14:28.064 INFO:teuthology.orchestra.run.smithi153.stderr: 5750K .......... .......... .......... .......... .......... 6% 134M 1s 2024-09-19T14:14:28.064 INFO:teuthology.orchestra.run.smithi153.stderr: 5800K .......... .......... .......... .......... .......... 6% 128M 1s 2024-09-19T14:14:28.064 INFO:teuthology.orchestra.run.smithi153.stderr: 5850K .......... .......... .......... .......... .......... 6% 141M 1s 2024-09-19T14:14:28.065 INFO:teuthology.orchestra.run.smithi153.stderr: 5900K .......... .......... .......... .......... .......... 6% 153M 1s 2024-09-19T14:14:28.065 INFO:teuthology.orchestra.run.smithi153.stderr: 5950K .......... .......... .......... .......... .......... 6% 120M 1s 2024-09-19T14:14:28.065 INFO:teuthology.orchestra.run.smithi153.stderr: 6000K .......... .......... .......... .......... .......... 6% 139M 1s 2024-09-19T14:14:28.065 INFO:teuthology.orchestra.run.smithi153.stderr: 6050K .......... .......... .......... .......... .......... 6% 141M 1s 2024-09-19T14:14:28.065 INFO:teuthology.orchestra.run.smithi153.stderr: 6100K .......... .......... .......... .......... .......... 6% 150M 1s 2024-09-19T14:14:28.065 INFO:teuthology.orchestra.run.smithi153.stderr: 6150K .......... .......... .......... .......... .......... 6% 139M 1s 2024-09-19T14:14:28.065 INFO:teuthology.orchestra.run.smithi153.stderr: 6200K .......... .......... .......... .......... .......... 6% 124M 1s 2024-09-19T14:14:28.065 INFO:teuthology.orchestra.run.smithi153.stderr: 6250K .......... .......... .......... .......... .......... 6% 137M 1s 2024-09-19T14:14:28.065 INFO:teuthology.orchestra.run.smithi153.stderr: 6300K .......... .......... .......... .......... .......... 6% 155M 1s 2024-09-19T14:14:28.065 INFO:teuthology.orchestra.run.smithi153.stderr: 6350K .......... .......... .......... .......... .......... 6% 133M 1s 2024-09-19T14:14:28.065 INFO:teuthology.orchestra.run.smithi153.stderr: 6400K .......... .......... .......... .......... .......... 6% 159M 1s 2024-09-19T14:14:28.065 INFO:teuthology.orchestra.run.smithi153.stderr: 6450K .......... .......... .......... .......... .......... 6% 164M 1s 2024-09-19T14:14:28.065 INFO:teuthology.orchestra.run.smithi153.stderr: 6500K .......... .......... .......... .......... .......... 7% 163M 1s 2024-09-19T14:14:28.066 INFO:teuthology.orchestra.run.smithi153.stderr: 6550K .......... .......... .......... .......... .......... 7% 145M 1s 2024-09-19T14:14:28.066 INFO:teuthology.orchestra.run.smithi153.stderr: 6600K .......... .......... .......... .......... .......... 7% 161M 1s 2024-09-19T14:14:28.066 INFO:teuthology.orchestra.run.smithi153.stderr: 6650K .......... .......... .......... .......... .......... 7% 156M 1s 2024-09-19T14:14:28.066 INFO:teuthology.orchestra.run.smithi153.stderr: 6700K .......... .......... .......... .......... .......... 7% 160M 1s 2024-09-19T14:14:28.066 INFO:teuthology.orchestra.run.smithi153.stderr: 6750K .......... .......... .......... .......... .......... 7% 120M 1s 2024-09-19T14:14:28.066 INFO:teuthology.orchestra.run.smithi153.stderr: 6800K .......... .......... .......... .......... .......... 7% 147M 1s 2024-09-19T14:14:28.066 INFO:teuthology.orchestra.run.smithi153.stderr: 6850K .......... .......... .......... .......... .......... 7% 140M 1s 2024-09-19T14:14:28.066 INFO:teuthology.orchestra.run.smithi153.stderr: 6900K .......... .......... .......... .......... .......... 7% 150M 1s 2024-09-19T14:14:28.066 INFO:teuthology.orchestra.run.smithi153.stderr: 6950K .......... .......... .......... .......... .......... 7% 145M 1s 2024-09-19T14:14:28.066 INFO:teuthology.orchestra.run.smithi153.stderr: 7000K .......... .......... .......... .......... .......... 7% 171M 1s 2024-09-19T14:14:28.066 INFO:teuthology.orchestra.run.smithi153.stderr: 7050K .......... .......... .......... .......... .......... 7% 174M 1s 2024-09-19T14:14:28.066 INFO:teuthology.orchestra.run.smithi153.stderr: 7100K .......... .......... .......... .......... .......... 7% 158M 1s 2024-09-19T14:14:28.066 INFO:teuthology.orchestra.run.smithi153.stderr: 7150K .......... .......... .......... .......... .......... 7% 138M 1s 2024-09-19T14:14:28.066 INFO:teuthology.orchestra.run.smithi153.stderr: 7200K .......... .......... .......... .......... .......... 7% 155M 1s 2024-09-19T14:14:28.067 INFO:teuthology.orchestra.run.smithi153.stderr: 7250K .......... .......... .......... .......... .......... 7% 167M 1s 2024-09-19T14:14:28.067 INFO:teuthology.orchestra.run.smithi153.stderr: 7300K .......... .......... .......... .......... .......... 7% 178M 1s 2024-09-19T14:14:28.067 INFO:teuthology.orchestra.run.smithi153.stderr: 7350K .......... .......... .......... .......... .......... 7% 146M 1s 2024-09-19T14:14:28.067 INFO:teuthology.orchestra.run.smithi153.stderr: 7400K .......... .......... .......... .......... .......... 8% 178M 1s 2024-09-19T14:14:28.067 INFO:teuthology.orchestra.run.smithi153.stderr: 7450K .......... .......... .......... .......... .......... 8% 164M 1s 2024-09-19T14:14:28.067 INFO:teuthology.orchestra.run.smithi153.stderr: 7500K .......... .......... .......... .......... .......... 8% 150M 1s 2024-09-19T14:14:28.067 INFO:teuthology.orchestra.run.smithi153.stderr: 7550K .......... .......... .......... .......... .......... 8% 156M 1s 2024-09-19T14:14:28.067 INFO:teuthology.orchestra.run.smithi153.stderr: 7600K .......... .......... .......... .......... .......... 8% 173M 1s 2024-09-19T14:14:28.067 INFO:teuthology.orchestra.run.smithi153.stderr: 7650K .......... .......... .......... .......... .......... 8% 176M 1s 2024-09-19T14:14:28.067 INFO:teuthology.orchestra.run.smithi153.stderr: 7700K .......... .......... .......... .......... .......... 8% 189M 1s 2024-09-19T14:14:28.067 INFO:teuthology.orchestra.run.smithi153.stderr: 7750K .......... .......... .......... .......... .......... 8% 168M 1s 2024-09-19T14:14:28.067 INFO:teuthology.orchestra.run.smithi153.stderr: 7800K .......... .......... .......... .......... .......... 8% 184M 1s 2024-09-19T14:14:28.067 INFO:teuthology.orchestra.run.smithi153.stderr: 7850K .......... .......... .......... .......... .......... 8% 168M 1s 2024-09-19T14:14:28.067 INFO:teuthology.orchestra.run.smithi153.stderr: 7900K .......... .......... .......... .......... .......... 8% 178M 1s 2024-09-19T14:14:28.067 INFO:teuthology.orchestra.run.smithi153.stderr: 7950K .......... .......... .......... .......... .......... 8% 154M 1s 2024-09-19T14:14:28.068 INFO:teuthology.orchestra.run.smithi153.stderr: 8000K .......... .......... .......... .......... .......... 8% 175M 1s 2024-09-19T14:14:28.068 INFO:teuthology.orchestra.run.smithi153.stderr: 8050K .......... .......... .......... .......... .......... 8% 162M 1s 2024-09-19T14:14:28.068 INFO:teuthology.orchestra.run.smithi153.stderr: 8100K .......... .......... .......... .......... .......... 8% 178M 1s 2024-09-19T14:14:28.068 INFO:teuthology.orchestra.run.smithi153.stderr: 8150K .......... .......... .......... .......... .......... 8% 152M 1s 2024-09-19T14:14:28.068 INFO:teuthology.orchestra.run.smithi153.stderr: 8200K .......... .......... .......... .......... .......... 8% 171M 1s 2024-09-19T14:14:28.068 INFO:teuthology.orchestra.run.smithi153.stderr: 8250K .......... .......... .......... .......... .......... 8% 169M 1s 2024-09-19T14:14:28.068 INFO:teuthology.orchestra.run.smithi153.stderr: 8300K .......... .......... .......... .......... .......... 8% 138M 1s 2024-09-19T14:14:28.068 INFO:teuthology.orchestra.run.smithi153.stderr: 8350K .......... .......... .......... .......... .......... 9% 165M 1s 2024-09-19T14:14:28.068 INFO:teuthology.orchestra.run.smithi153.stderr: 8400K .......... .......... .......... .......... .......... 9% 196M 1s 2024-09-19T14:14:28.068 INFO:teuthology.orchestra.run.smithi153.stderr: 8450K .......... .......... .......... .......... .......... 9% 184M 1s 2024-09-19T14:14:28.068 INFO:teuthology.orchestra.run.smithi153.stderr: 8500K .......... .......... .......... .......... .......... 9% 199M 1s 2024-09-19T14:14:28.068 INFO:teuthology.orchestra.run.smithi153.stderr: 8550K .......... .......... .......... .......... .......... 9% 168M 1s 2024-09-19T14:14:28.068 INFO:teuthology.orchestra.run.smithi153.stderr: 8600K .......... .......... .......... .......... .......... 9% 201M 1s 2024-09-19T14:14:28.068 INFO:teuthology.orchestra.run.smithi153.stderr: 8650K .......... .......... .......... .......... .......... 9% 196M 1s 2024-09-19T14:14:28.069 INFO:teuthology.orchestra.run.smithi153.stderr: 8700K .......... .......... .......... .......... .......... 9% 173M 1s 2024-09-19T14:14:28.069 INFO:teuthology.orchestra.run.smithi153.stderr: 8750K .......... .......... .......... .......... .......... 9% 150M 1s 2024-09-19T14:14:28.069 INFO:teuthology.orchestra.run.smithi153.stderr: 8800K .......... .......... .......... .......... .......... 9% 175M 1s 2024-09-19T14:14:28.069 INFO:teuthology.orchestra.run.smithi153.stderr: 8850K .......... .......... .......... .......... .......... 9% 183M 1s 2024-09-19T14:14:28.069 INFO:teuthology.orchestra.run.smithi153.stderr: 8900K .......... .......... .......... .......... .......... 9% 168M 1s 2024-09-19T14:14:28.069 INFO:teuthology.orchestra.run.smithi153.stderr: 8950K .......... .......... .......... .......... .......... 9% 173M 1s 2024-09-19T14:14:28.069 INFO:teuthology.orchestra.run.smithi153.stderr: 9000K .......... .......... .......... .......... .......... 9% 209M 1s 2024-09-19T14:14:28.069 INFO:teuthology.orchestra.run.smithi153.stderr: 9050K .......... .......... .......... .......... .......... 9% 205M 1s 2024-09-19T14:14:28.069 INFO:teuthology.orchestra.run.smithi153.stderr: 9100K .......... .......... .......... .......... .......... 9% 199M 1s 2024-09-19T14:14:28.069 INFO:teuthology.orchestra.run.smithi153.stderr: 9150K .......... .......... .......... .......... .......... 9% 164M 1s 2024-09-19T14:14:28.069 INFO:teuthology.orchestra.run.smithi153.stderr: 9200K .......... .......... .......... .......... .......... 9% 163M 1s 2024-09-19T14:14:28.069 INFO:teuthology.orchestra.run.smithi153.stderr: 9250K .......... .......... .......... .......... .......... 10% 190M 1s 2024-09-19T14:14:28.069 INFO:teuthology.orchestra.run.smithi153.stderr: 9300K .......... .......... .......... .......... .......... 10% 199M 1s 2024-09-19T14:14:28.070 INFO:teuthology.orchestra.run.smithi153.stderr: 9350K .......... .......... .......... .......... .......... 10% 189M 1s 2024-09-19T14:14:28.070 INFO:teuthology.orchestra.run.smithi153.stderr: 9400K .......... .......... .......... .......... .......... 10% 170M 1s 2024-09-19T14:14:28.070 INFO:teuthology.orchestra.run.smithi153.stderr: 9450K .......... .......... .......... .......... .......... 10% 172M 1s 2024-09-19T14:14:28.070 INFO:teuthology.orchestra.run.smithi153.stderr: 9500K .......... .......... .......... .......... .......... 10% 187M 1s 2024-09-19T14:14:28.070 INFO:teuthology.orchestra.run.smithi153.stderr: 9550K .......... .......... .......... .......... .......... 10% 171M 1s 2024-09-19T14:14:28.070 INFO:teuthology.orchestra.run.smithi153.stderr: 9600K .......... .......... .......... .......... .......... 10% 206M 1s 2024-09-19T14:14:28.070 INFO:teuthology.orchestra.run.smithi153.stderr: 9650K .......... .......... .......... .......... .......... 10% 181M 1s 2024-09-19T14:14:28.070 INFO:teuthology.orchestra.run.smithi153.stderr: 9700K .......... .......... .......... .......... .......... 10% 203M 1s 2024-09-19T14:14:28.070 INFO:teuthology.orchestra.run.smithi153.stderr: 9750K .......... .......... .......... .......... .......... 10% 175M 1s 2024-09-19T14:14:28.070 INFO:teuthology.orchestra.run.smithi153.stderr: 9800K .......... .......... .......... .......... .......... 10% 207M 1s 2024-09-19T14:14:28.070 INFO:teuthology.orchestra.run.smithi153.stderr: 9850K .......... .......... .......... .......... .......... 10% 209M 1s 2024-09-19T14:14:28.070 INFO:teuthology.orchestra.run.smithi153.stderr: 9900K .......... .......... .......... .......... .......... 10% 191M 1s 2024-09-19T14:14:28.070 INFO:teuthology.orchestra.run.smithi153.stderr: 9950K .......... .......... .......... .......... .......... 10% 166M 1s 2024-09-19T14:14:28.070 INFO:teuthology.orchestra.run.smithi153.stderr: 10000K .......... .......... .......... .......... .......... 10% 203M 1s 2024-09-19T14:14:28.070 INFO:teuthology.orchestra.run.smithi153.stderr: 10050K .......... .......... .......... .......... .......... 10% 217M 1s 2024-09-19T14:14:28.071 INFO:teuthology.orchestra.run.smithi153.stderr: 10100K .......... .......... .......... .......... .......... 10% 206M 1s 2024-09-19T14:14:28.071 INFO:teuthology.orchestra.run.smithi153.stderr: 10150K .......... .......... .......... .......... .......... 10% 187M 1s 2024-09-19T14:14:28.071 INFO:teuthology.orchestra.run.smithi153.stderr: 10200K .......... .......... .......... .......... .......... 11% 207M 1s 2024-09-19T14:14:28.071 INFO:teuthology.orchestra.run.smithi153.stderr: 10250K .......... .......... .......... .......... .......... 11% 228M 1s 2024-09-19T14:14:28.071 INFO:teuthology.orchestra.run.smithi153.stderr: 10300K .......... .......... .......... .......... .......... 11% 205M 1s 2024-09-19T14:14:28.071 INFO:teuthology.orchestra.run.smithi153.stderr: 10350K .......... .......... .......... .......... .......... 11% 157M 1s 2024-09-19T14:14:28.071 INFO:teuthology.orchestra.run.smithi153.stderr: 10400K .......... .......... .......... .......... .......... 11% 200M 1s 2024-09-19T14:14:28.071 INFO:teuthology.orchestra.run.smithi153.stderr: 10450K .......... .......... .......... .......... .......... 11% 204M 1s 2024-09-19T14:14:28.071 INFO:teuthology.orchestra.run.smithi153.stderr: 10500K .......... .......... .......... .......... .......... 11% 200M 1s 2024-09-19T14:14:28.071 INFO:teuthology.orchestra.run.smithi153.stderr: 10550K .......... .......... .......... .......... .......... 11% 216M 1s 2024-09-19T14:14:28.071 INFO:teuthology.orchestra.run.smithi153.stderr: 10600K .......... .......... .......... .......... .......... 11% 217M 1s 2024-09-19T14:14:28.071 INFO:teuthology.orchestra.run.smithi153.stderr: 10650K .......... .......... .......... .......... .......... 11% 228M 1s 2024-09-19T14:14:28.071 INFO:teuthology.orchestra.run.smithi153.stderr: 10700K .......... .......... .......... .......... .......... 11% 245M 1s 2024-09-19T14:14:28.071 INFO:teuthology.orchestra.run.smithi153.stderr: 10750K .......... .......... .......... .......... .......... 11% 213M 1s 2024-09-19T14:14:28.072 INFO:teuthology.orchestra.run.smithi153.stderr: 10800K .......... .......... .......... .......... .......... 11% 244M 1s 2024-09-19T14:14:28.072 INFO:teuthology.orchestra.run.smithi153.stderr: 10850K .......... .......... .......... .......... .......... 11% 247M 1s 2024-09-19T14:14:28.072 INFO:teuthology.orchestra.run.smithi153.stderr: 10900K .......... .......... .......... .......... .......... 11% 238M 1s 2024-09-19T14:14:28.072 INFO:teuthology.orchestra.run.smithi153.stderr: 10950K .......... .......... .......... .......... .......... 11% 205M 1s 2024-09-19T14:14:28.072 INFO:teuthology.orchestra.run.smithi153.stderr: 11000K .......... .......... .......... .......... .......... 11% 238M 1s 2024-09-19T14:14:28.072 INFO:teuthology.orchestra.run.smithi153.stderr: 11050K .......... .......... .......... .......... .......... 11% 205M 1s 2024-09-19T14:14:28.072 INFO:teuthology.orchestra.run.smithi153.stderr: 11100K .......... .......... .......... .......... .......... 12% 214M 1s 2024-09-19T14:14:28.072 INFO:teuthology.orchestra.run.smithi153.stderr: 11150K .......... .......... .......... .......... .......... 12% 168M 1s 2024-09-19T14:14:28.072 INFO:teuthology.orchestra.run.smithi153.stderr: 11200K .......... .......... .......... .......... .......... 12% 210M 1s 2024-09-19T14:14:28.072 INFO:teuthology.orchestra.run.smithi153.stderr: 11250K .......... .......... .......... .......... .......... 12% 196M 1s 2024-09-19T14:14:28.072 INFO:teuthology.orchestra.run.smithi153.stderr: 11300K .......... .......... .......... .......... .......... 12% 218M 1s 2024-09-19T14:14:28.072 INFO:teuthology.orchestra.run.smithi153.stderr: 11350K .......... .......... .......... .......... .......... 12% 184M 1s 2024-09-19T14:14:28.072 INFO:teuthology.orchestra.run.smithi153.stderr: 11400K .......... .......... .......... .......... .......... 12% 231M 1s 2024-09-19T14:14:28.072 INFO:teuthology.orchestra.run.smithi153.stderr: 11450K .......... .......... .......... .......... .......... 12% 200M 1s 2024-09-19T14:14:28.073 INFO:teuthology.orchestra.run.smithi153.stderr: 11500K .......... .......... .......... .......... .......... 12% 253M 1s 2024-09-19T14:14:28.073 INFO:teuthology.orchestra.run.smithi153.stderr: 11550K .......... .......... .......... .......... .......... 12% 198M 1s 2024-09-19T14:14:28.073 INFO:teuthology.orchestra.run.smithi153.stderr: 11600K .......... .......... .......... .......... .......... 12% 256M 1s 2024-09-19T14:14:28.073 INFO:teuthology.orchestra.run.smithi153.stderr: 11650K .......... .......... .......... .......... .......... 12% 232M 1s 2024-09-19T14:14:28.073 INFO:teuthology.orchestra.run.smithi153.stderr: 11700K .......... .......... .......... .......... .......... 12% 240M 1s 2024-09-19T14:14:28.073 INFO:teuthology.orchestra.run.smithi153.stderr: 11750K .......... .......... .......... .......... .......... 12% 223M 1s 2024-09-19T14:14:28.073 INFO:teuthology.orchestra.run.smithi153.stderr: 11800K .......... .......... .......... .......... .......... 12% 227M 1s 2024-09-19T14:14:28.073 INFO:teuthology.orchestra.run.smithi153.stderr: 11850K .......... .......... .......... .......... .......... 12% 227M 1s 2024-09-19T14:14:28.073 INFO:teuthology.orchestra.run.smithi153.stderr: 11900K .......... .......... .......... .......... .......... 12% 225M 1s 2024-09-19T14:14:28.073 INFO:teuthology.orchestra.run.smithi153.stderr: 11950K .......... .......... .......... .......... .......... 12% 182M 1s 2024-09-19T14:14:28.073 INFO:teuthology.orchestra.run.smithi153.stderr: 12000K .......... .......... .......... .......... .......... 12% 249M 1s 2024-09-19T14:14:28.073 INFO:teuthology.orchestra.run.smithi153.stderr: 12050K .......... .......... .......... .......... .......... 13% 248M 1s 2024-09-19T14:14:28.073 INFO:teuthology.orchestra.run.smithi153.stderr: 12100K .......... .......... .......... .......... .......... 13% 242M 1s 2024-09-19T14:14:28.074 INFO:teuthology.orchestra.run.smithi153.stderr: 12150K .......... .......... .......... .......... .......... 13% 224M 1s 2024-09-19T14:14:28.074 INFO:teuthology.orchestra.run.smithi153.stderr: 12200K .......... .......... .......... .......... .......... 13% 240M 1s 2024-09-19T14:14:28.074 INFO:teuthology.orchestra.run.smithi153.stderr: 12250K .......... .......... .......... .......... .......... 13% 218M 1s 2024-09-19T14:14:28.074 INFO:teuthology.orchestra.run.smithi153.stderr: 12300K .......... .......... .......... .......... .......... 13% 235M 1s 2024-09-19T14:14:28.074 INFO:teuthology.orchestra.run.smithi153.stderr: 12350K .......... .......... .......... .......... .......... 13% 172M 1s 2024-09-19T14:14:28.074 INFO:teuthology.orchestra.run.smithi153.stderr: 12400K .......... .......... .......... .......... .......... 13% 189M 1s 2024-09-19T14:14:28.074 INFO:teuthology.orchestra.run.smithi153.stderr: 12450K .......... .......... .......... .......... .......... 13% 259M 1s 2024-09-19T14:14:28.074 INFO:teuthology.orchestra.run.smithi153.stderr: 12500K .......... .......... .......... .......... .......... 13% 245M 1s 2024-09-19T14:14:28.074 INFO:teuthology.orchestra.run.smithi153.stderr: 12550K .......... .......... .......... .......... .......... 13% 231M 1s 2024-09-19T14:14:28.074 INFO:teuthology.orchestra.run.smithi153.stderr: 12600K .......... .......... .......... .......... .......... 13% 254M 1s 2024-09-19T14:14:28.074 INFO:teuthology.orchestra.run.smithi153.stderr: 12650K .......... .......... .......... .......... .......... 13% 257M 1s 2024-09-19T14:14:28.074 INFO:teuthology.orchestra.run.smithi153.stderr: 12700K .......... .......... .......... .......... .......... 13% 265M 1s 2024-09-19T14:14:28.074 INFO:teuthology.orchestra.run.smithi153.stderr: 12750K .......... .......... .......... .......... .......... 13% 214M 1s 2024-09-19T14:14:28.074 INFO:teuthology.orchestra.run.smithi153.stderr: 12800K .......... .......... .......... .......... .......... 13% 260M 1s 2024-09-19T14:14:28.075 INFO:teuthology.orchestra.run.smithi153.stderr: 12850K .......... .......... .......... .......... .......... 13% 250M 1s 2024-09-19T14:14:28.075 INFO:teuthology.orchestra.run.smithi153.stderr: 12900K .......... .......... .......... .......... .......... 13% 262M 1s 2024-09-19T14:14:28.075 INFO:teuthology.orchestra.run.smithi153.stderr: 12950K .......... .......... .......... .......... .......... 13% 215M 1s 2024-09-19T14:14:28.075 INFO:teuthology.orchestra.run.smithi153.stderr: 13000K .......... .......... .......... .......... .......... 14% 227M 1s 2024-09-19T14:14:28.075 INFO:teuthology.orchestra.run.smithi153.stderr: 13050K .......... .......... .......... .......... .......... 14% 231M 1s 2024-09-19T14:14:28.075 INFO:teuthology.orchestra.run.smithi153.stderr: 13100K .......... .......... .......... .......... .......... 14% 251M 1s 2024-09-19T14:14:28.075 INFO:teuthology.orchestra.run.smithi153.stderr: 13150K .......... .......... .......... .......... .......... 14% 221M 1s 2024-09-19T14:14:28.075 INFO:teuthology.orchestra.run.smithi153.stderr: 13200K .......... .......... .......... .......... .......... 14% 219M 1s 2024-09-19T14:14:28.075 INFO:teuthology.orchestra.run.smithi153.stderr: 13250K .......... .......... .......... .......... .......... 14% 228M 1s 2024-09-19T14:14:28.075 INFO:teuthology.orchestra.run.smithi153.stderr: 13300K .......... .......... .......... .......... .......... 14% 257M 1s 2024-09-19T14:14:28.075 INFO:teuthology.orchestra.run.smithi153.stderr: 13350K .......... .......... .......... .......... .......... 14% 235M 1s 2024-09-19T14:14:28.075 INFO:teuthology.orchestra.run.smithi153.stderr: 13400K .......... .......... .......... .......... .......... 14% 274M 1s 2024-09-19T14:14:28.075 INFO:teuthology.orchestra.run.smithi153.stderr: 13450K .......... .......... .......... .......... .......... 14% 273M 1s 2024-09-19T14:14:28.076 INFO:teuthology.orchestra.run.smithi153.stderr: 13500K .......... .......... .......... .......... .......... 14% 272M 1s 2024-09-19T14:14:28.076 INFO:teuthology.orchestra.run.smithi153.stderr: 13550K .......... .......... .......... .......... .......... 14% 225M 1s 2024-09-19T14:14:28.076 INFO:teuthology.orchestra.run.smithi153.stderr: 13600K .......... .......... .......... .......... .......... 14% 265M 1s 2024-09-19T14:14:28.076 INFO:teuthology.orchestra.run.smithi153.stderr: 13650K .......... .......... .......... .......... .......... 14% 248M 1s 2024-09-19T14:14:28.076 INFO:teuthology.orchestra.run.smithi153.stderr: 13700K .......... .......... .......... .......... .......... 14% 275M 1s 2024-09-19T14:14:28.076 INFO:teuthology.orchestra.run.smithi153.stderr: 13750K .......... .......... .......... .......... .......... 14% 248M 1s 2024-09-19T14:14:28.076 INFO:teuthology.orchestra.run.smithi153.stderr: 13800K .......... .......... .......... .......... .......... 14% 255M 1s 2024-09-19T14:14:28.076 INFO:teuthology.orchestra.run.smithi153.stderr: 13850K .......... .......... .......... .......... .......... 14% 229M 1s 2024-09-19T14:14:28.076 INFO:teuthology.orchestra.run.smithi153.stderr: 13900K .......... .......... .......... .......... .......... 15% 241M 1s 2024-09-19T14:14:28.076 INFO:teuthology.orchestra.run.smithi153.stderr: 13950K .......... .......... .......... .......... .......... 15% 200M 1s 2024-09-19T14:14:28.076 INFO:teuthology.orchestra.run.smithi153.stderr: 14000K .......... .......... .......... .......... .......... 15% 247M 1s 2024-09-19T14:14:28.076 INFO:teuthology.orchestra.run.smithi153.stderr: 14050K .......... .......... .......... .......... .......... 15% 245M 1s 2024-09-19T14:14:28.076 INFO:teuthology.orchestra.run.smithi153.stderr: 14100K .......... .......... .......... .......... .......... 15% 242M 1s 2024-09-19T14:14:28.077 INFO:teuthology.orchestra.run.smithi153.stderr: 14150K .......... .......... .......... .......... .......... 15% 247M 1s 2024-09-19T14:14:28.077 INFO:teuthology.orchestra.run.smithi153.stderr: 14200K .......... .......... .......... .......... .......... 15% 227M 1s 2024-09-19T14:14:28.077 INFO:teuthology.orchestra.run.smithi153.stderr: 14250K .......... .......... .......... .......... .......... 15% 279M 1s 2024-09-19T14:14:28.077 INFO:teuthology.orchestra.run.smithi153.stderr: 14300K .......... .......... .......... .......... .......... 15% 280M 1s 2024-09-19T14:14:28.077 INFO:teuthology.orchestra.run.smithi153.stderr: 14350K .......... .......... .......... .......... .......... 15% 236M 1s 2024-09-19T14:14:28.077 INFO:teuthology.orchestra.run.smithi153.stderr: 14400K .......... .......... .......... .......... .......... 15% 255M 1s 2024-09-19T14:14:28.077 INFO:teuthology.orchestra.run.smithi153.stderr: 14450K .......... .......... .......... .......... .......... 15% 258M 1s 2024-09-19T14:14:28.077 INFO:teuthology.orchestra.run.smithi153.stderr: 14500K .......... .......... .......... .......... .......... 15% 226M 1s 2024-09-19T14:14:28.077 INFO:teuthology.orchestra.run.smithi153.stderr: 14550K .......... .......... .......... .......... .......... 15% 278M 1s 2024-09-19T14:14:28.077 INFO:teuthology.orchestra.run.smithi153.stderr: 14600K .......... .......... .......... .......... .......... 15% 274M 1s 2024-09-19T14:14:28.077 INFO:teuthology.orchestra.run.smithi153.stderr: 14650K .......... .......... .......... .......... .......... 15% 225M 1s 2024-09-19T14:14:28.077 INFO:teuthology.orchestra.run.smithi153.stderr: 14700K .......... .......... .......... .......... .......... 15% 278M 1s 2024-09-19T14:14:28.078 INFO:teuthology.orchestra.run.smithi153.stderr: 14750K .......... .......... .......... .......... .......... 15% 280M 1s 2024-09-19T14:14:28.078 INFO:teuthology.orchestra.run.smithi153.stderr: 14800K .......... .......... .......... .......... .......... 15% 261M 1s 2024-09-19T14:14:28.078 INFO:teuthology.orchestra.run.smithi153.stderr: 14850K .......... .......... .......... .......... .......... 16% 221M 1s 2024-09-19T14:14:28.078 INFO:teuthology.orchestra.run.smithi153.stderr: 14900K .......... .......... .......... .......... .......... 16% 290M 1s 2024-09-19T14:14:28.078 INFO:teuthology.orchestra.run.smithi153.stderr: 14950K .......... .......... .......... .......... .......... 16% 288M 1s 2024-09-19T14:14:28.078 INFO:teuthology.orchestra.run.smithi153.stderr: 15000K .......... .......... .......... .......... .......... 16% 299M 1s 2024-09-19T14:14:28.078 INFO:teuthology.orchestra.run.smithi153.stderr: 15050K .......... .......... .......... .......... .......... 16% 262M 1s 2024-09-19T14:14:28.078 INFO:teuthology.orchestra.run.smithi153.stderr: 15100K .......... .......... .......... .......... .......... 16% 284M 1s 2024-09-19T14:14:28.078 INFO:teuthology.orchestra.run.smithi153.stderr: 15150K .......... .......... .......... .......... .......... 16% 233M 1s 2024-09-19T14:14:28.078 INFO:teuthology.orchestra.run.smithi153.stderr: 15200K .......... .......... .......... .......... .......... 16% 282M 1s 2024-09-19T14:14:28.078 INFO:teuthology.orchestra.run.smithi153.stderr: 15250K .......... .......... .......... .......... .......... 16% 262M 1s 2024-09-19T14:14:28.078 INFO:teuthology.orchestra.run.smithi153.stderr: 15300K .......... .......... .......... .......... .......... 16% 291M 1s 2024-09-19T14:14:28.078 INFO:teuthology.orchestra.run.smithi153.stderr: 15350K .......... .......... .......... .......... .......... 16% 226M 1s 2024-09-19T14:14:28.078 INFO:teuthology.orchestra.run.smithi153.stderr: 15400K .......... .......... .......... .......... .......... 16% 268M 1s 2024-09-19T14:14:28.079 INFO:teuthology.orchestra.run.smithi153.stderr: 15450K .......... .......... .......... .......... .......... 16% 290M 1s 2024-09-19T14:14:28.079 INFO:teuthology.orchestra.run.smithi153.stderr: 15500K .......... .......... .......... .......... .......... 16% 283M 1s 2024-09-19T14:14:28.079 INFO:teuthology.orchestra.run.smithi153.stderr: 15550K .......... .......... .......... .......... .......... 16% 277M 1s 2024-09-19T14:14:28.079 INFO:teuthology.orchestra.run.smithi153.stderr: 15600K .......... .......... .......... .......... .......... 16% 286M 1s 2024-09-19T14:14:28.079 INFO:teuthology.orchestra.run.smithi153.stderr: 15650K .......... .......... .......... .......... .......... 16% 312M 1s 2024-09-19T14:14:28.079 INFO:teuthology.orchestra.run.smithi153.stderr: 15700K .......... .......... .......... .......... .......... 16% 297M 1s 2024-09-19T14:14:28.079 INFO:teuthology.orchestra.run.smithi153.stderr: 15750K .......... .......... .......... .......... .......... 17% 50.5M 1s 2024-09-19T14:14:28.079 INFO:teuthology.orchestra.run.smithi153.stderr: 15800K .......... .......... .......... .......... .......... 17% 262M 1s 2024-09-19T14:14:28.079 INFO:teuthology.orchestra.run.smithi153.stderr: 15850K .......... .......... .......... .......... .......... 17% 260M 1s 2024-09-19T14:14:28.079 INFO:teuthology.orchestra.run.smithi153.stderr: 15900K .......... .......... .......... .......... .......... 17% 286M 1s 2024-09-19T14:14:28.079 INFO:teuthology.orchestra.run.smithi153.stderr: 15950K .......... .......... .......... .......... .......... 17% 228M 1s 2024-09-19T14:14:28.079 INFO:teuthology.orchestra.run.smithi153.stderr: 16000K .......... .......... .......... .......... .......... 17% 314M 1s 2024-09-19T14:14:28.079 INFO:teuthology.orchestra.run.smithi153.stderr: 16050K .......... .......... .......... .......... .......... 17% 295M 1s 2024-09-19T14:14:28.080 INFO:teuthology.orchestra.run.smithi153.stderr: 16100K .......... .......... .......... .......... .......... 17% 270M 1s 2024-09-19T14:14:28.080 INFO:teuthology.orchestra.run.smithi153.stderr: 16150K .......... .......... .......... .......... .......... 17% 241M 1s 2024-09-19T14:14:28.080 INFO:teuthology.orchestra.run.smithi153.stderr: 16200K .......... .......... .......... .......... .......... 17% 303M 1s 2024-09-19T14:14:28.080 INFO:teuthology.orchestra.run.smithi153.stderr: 16250K .......... .......... .......... .......... .......... 17% 316M 1s 2024-09-19T14:14:28.080 INFO:teuthology.orchestra.run.smithi153.stderr: 16300K .......... .......... .......... .......... .......... 17% 313M 1s 2024-09-19T14:14:28.080 INFO:teuthology.orchestra.run.smithi153.stderr: 16350K .......... .......... .......... .......... .......... 17% 263M 1s 2024-09-19T14:14:28.080 INFO:teuthology.orchestra.run.smithi153.stderr: 16400K .......... .......... .......... .......... .......... 17% 286M 1s 2024-09-19T14:14:28.080 INFO:teuthology.orchestra.run.smithi153.stderr: 16450K .......... .......... .......... .......... .......... 17% 40.4M 1s 2024-09-19T14:14:28.080 INFO:teuthology.orchestra.run.smithi153.stderr: 16500K .......... .......... .......... .......... .......... 17% 198M 1s 2024-09-19T14:14:28.080 INFO:teuthology.orchestra.run.smithi153.stderr: 16550K .......... .......... .......... .......... .......... 17% 247M 1s 2024-09-19T14:14:28.080 INFO:teuthology.orchestra.run.smithi153.stderr: 16600K .......... .......... .......... .......... .......... 17% 288M 1s 2024-09-19T14:14:28.080 INFO:teuthology.orchestra.run.smithi153.stderr: 16650K .......... .......... .......... .......... .......... 17% 277M 1s 2024-09-19T14:14:28.080 INFO:teuthology.orchestra.run.smithi153.stderr: 16700K .......... .......... .......... .......... .......... 18% 298M 1s 2024-09-19T14:14:28.081 INFO:teuthology.orchestra.run.smithi153.stderr: 16750K .......... .......... .......... .......... .......... 18% 242M 1s 2024-09-19T14:14:28.081 INFO:teuthology.orchestra.run.smithi153.stderr: 16800K .......... .......... .......... .......... .......... 18% 284M 1s 2024-09-19T14:14:28.081 INFO:teuthology.orchestra.run.smithi153.stderr: 16850K .......... .......... .......... .......... .......... 18% 274M 1s 2024-09-19T14:14:28.081 INFO:teuthology.orchestra.run.smithi153.stderr: 16900K .......... .......... .......... .......... .......... 18% 308M 1s 2024-09-19T14:14:28.081 INFO:teuthology.orchestra.run.smithi153.stderr: 16950K .......... .......... .......... .......... .......... 18% 257M 1s 2024-09-19T14:14:28.081 INFO:teuthology.orchestra.run.smithi153.stderr: 17000K .......... .......... .......... .......... .......... 18% 296M 1s 2024-09-19T14:14:28.081 INFO:teuthology.orchestra.run.smithi153.stderr: 17050K .......... .......... .......... .......... .......... 18% 309M 1s 2024-09-19T14:14:28.081 INFO:teuthology.orchestra.run.smithi153.stderr: 17100K .......... .......... .......... .......... .......... 18% 302M 1s 2024-09-19T14:14:28.081 INFO:teuthology.orchestra.run.smithi153.stderr: 17150K .......... .......... .......... .......... .......... 18% 242M 1s 2024-09-19T14:14:28.081 INFO:teuthology.orchestra.run.smithi153.stderr: 17200K .......... .......... .......... .......... .......... 18% 283M 1s 2024-09-19T14:14:28.081 INFO:teuthology.orchestra.run.smithi153.stderr: 17250K .......... .......... .......... .......... .......... 18% 297M 1s 2024-09-19T14:14:28.081 INFO:teuthology.orchestra.run.smithi153.stderr: 17300K .......... .......... .......... .......... .......... 18% 316M 1s 2024-09-19T14:14:28.081 INFO:teuthology.orchestra.run.smithi153.stderr: 17350K .......... .......... .......... .......... .......... 18% 235M 1s 2024-09-19T14:14:28.081 INFO:teuthology.orchestra.run.smithi153.stderr: 17400K .......... .......... .......... .......... .......... 18% 299M 1s 2024-09-19T14:14:28.082 INFO:teuthology.orchestra.run.smithi153.stderr: 17450K .......... .......... .......... .......... .......... 18% 286M 1s 2024-09-19T14:14:28.082 INFO:teuthology.orchestra.run.smithi153.stderr: 17500K .......... .......... .......... .......... .......... 18% 302M 1s 2024-09-19T14:14:28.082 INFO:teuthology.orchestra.run.smithi153.stderr: 17550K .......... .......... .......... .......... .......... 18% 223M 1s 2024-09-19T14:14:28.082 INFO:teuthology.orchestra.run.smithi153.stderr: 17600K .......... .......... .......... .......... .......... 18% 287M 1s 2024-09-19T14:14:28.082 INFO:teuthology.orchestra.run.smithi153.stderr: 17650K .......... .......... .......... .......... .......... 19% 306M 1s 2024-09-19T14:14:28.082 INFO:teuthology.orchestra.run.smithi153.stderr: 17700K .......... .......... .......... .......... .......... 19% 304M 1s 2024-09-19T14:14:28.082 INFO:teuthology.orchestra.run.smithi153.stderr: 17750K .......... .......... .......... .......... .......... 19% 275M 1s 2024-09-19T14:14:28.082 INFO:teuthology.orchestra.run.smithi153.stderr: 17800K .......... .......... .......... .......... .......... 19% 310M 1s 2024-09-19T14:14:28.082 INFO:teuthology.orchestra.run.smithi153.stderr: 17850K .......... .......... .......... .......... .......... 19% 275M 1s 2024-09-19T14:14:28.082 INFO:teuthology.orchestra.run.smithi153.stderr: 17900K .......... .......... .......... .......... .......... 19% 274M 1s 2024-09-19T14:14:28.082 INFO:teuthology.orchestra.run.smithi153.stderr: 17950K .......... .......... .......... .......... .......... 19% 222M 1s 2024-09-19T14:14:28.082 INFO:teuthology.orchestra.run.smithi153.stderr: 18000K .......... .......... .......... .......... .......... 19% 240M 1s 2024-09-19T14:14:28.082 INFO:teuthology.orchestra.run.smithi153.stderr: 18050K .......... .......... .......... .......... .......... 19% 292M 1s 2024-09-19T14:14:28.082 INFO:teuthology.orchestra.run.smithi153.stderr: 18100K .......... .......... .......... .......... .......... 19% 236M 1s 2024-09-19T14:14:28.082 INFO:teuthology.orchestra.run.smithi153.stderr: 18150K .......... .......... .......... .......... .......... 19% 256M 1s 2024-09-19T14:14:28.083 INFO:teuthology.orchestra.run.smithi153.stderr: 18200K .......... .......... .......... .......... .......... 19% 284M 1s 2024-09-19T14:14:28.083 INFO:teuthology.orchestra.run.smithi153.stderr: 18250K .......... .......... .......... .......... .......... 19% 287M 1s 2024-09-19T14:14:28.083 INFO:teuthology.orchestra.run.smithi153.stderr: 18300K .......... .......... .......... .......... .......... 19% 307M 1s 2024-09-19T14:14:28.083 INFO:teuthology.orchestra.run.smithi153.stderr: 18350K .......... .......... .......... .......... .......... 19% 250M 1s 2024-09-19T14:14:28.083 INFO:teuthology.orchestra.run.smithi153.stderr: 18400K .......... .......... .......... .......... .......... 19% 306M 1s 2024-09-19T14:14:28.083 INFO:teuthology.orchestra.run.smithi153.stderr: 18450K .......... .......... .......... .......... .......... 19% 311M 1s 2024-09-19T14:14:28.083 INFO:teuthology.orchestra.run.smithi153.stderr: 18500K .......... .......... .......... .......... .......... 19% 320M 1s 2024-09-19T14:14:28.083 INFO:teuthology.orchestra.run.smithi153.stderr: 18550K .......... .......... .......... .......... .......... 20% 278M 1s 2024-09-19T14:14:28.083 INFO:teuthology.orchestra.run.smithi153.stderr: 18600K .......... .......... .......... .......... .......... 20% 82.0M 1s 2024-09-19T14:14:28.083 INFO:teuthology.orchestra.run.smithi153.stderr: 18650K .......... .......... .......... .......... .......... 20% 270M 1s 2024-09-19T14:14:28.083 INFO:teuthology.orchestra.run.smithi153.stderr: 18700K .......... .......... .......... .......... .......... 20% 287M 1s 2024-09-19T14:14:28.083 INFO:teuthology.orchestra.run.smithi153.stderr: 18750K .......... .......... .......... .......... .......... 20% 261M 1s 2024-09-19T14:14:28.083 INFO:teuthology.orchestra.run.smithi153.stderr: 18800K .......... .......... .......... .......... .......... 20% 298M 1s 2024-09-19T14:14:28.083 INFO:teuthology.orchestra.run.smithi153.stderr: 18850K .......... .......... .......... .......... .......... 20% 255M 1s 2024-09-19T14:14:28.084 INFO:teuthology.orchestra.run.smithi153.stderr: 18900K .......... .......... .......... .......... .......... 20% 284M 1s 2024-09-19T14:14:28.084 INFO:teuthology.orchestra.run.smithi153.stderr: 18950K .......... .......... .......... .......... .......... 20% 248M 1s 2024-09-19T14:14:28.084 INFO:teuthology.orchestra.run.smithi153.stderr: 19000K .......... .......... .......... .......... .......... 20% 304M 1s 2024-09-19T14:14:28.084 INFO:teuthology.orchestra.run.smithi153.stderr: 19050K .......... .......... .......... .......... .......... 20% 314M 1s 2024-09-19T14:14:28.084 INFO:teuthology.orchestra.run.smithi153.stderr: 19100K .......... .......... .......... .......... .......... 20% 289M 1s 2024-09-19T14:14:28.084 INFO:teuthology.orchestra.run.smithi153.stderr: 19150K .......... .......... .......... .......... .......... 20% 235M 1s 2024-09-19T14:14:28.084 INFO:teuthology.orchestra.run.smithi153.stderr: 19200K .......... .......... .......... .......... .......... 20% 304M 1s 2024-09-19T14:14:28.084 INFO:teuthology.orchestra.run.smithi153.stderr: 19250K .......... .......... .......... .......... .......... 20% 310M 1s 2024-09-19T14:14:28.084 INFO:teuthology.orchestra.run.smithi153.stderr: 19300K .......... .......... .......... .......... .......... 20% 36.1M 1s 2024-09-19T14:14:28.084 INFO:teuthology.orchestra.run.smithi153.stderr: 19350K .......... .......... .......... .......... .......... 20% 231M 1s 2024-09-19T14:14:28.084 INFO:teuthology.orchestra.run.smithi153.stderr: 19400K .......... .......... .......... .......... .......... 20% 312M 1s 2024-09-19T14:14:28.084 INFO:teuthology.orchestra.run.smithi153.stderr: 19450K .......... .......... .......... .......... .......... 20% 287M 1s 2024-09-19T14:14:28.084 INFO:teuthology.orchestra.run.smithi153.stderr: 19500K .......... .......... .......... .......... .......... 21% 251M 1s 2024-09-19T14:14:28.084 INFO:teuthology.orchestra.run.smithi153.stderr: 19550K .......... .......... .......... .......... .......... 21% 238M 1s 2024-09-19T14:14:28.085 INFO:teuthology.orchestra.run.smithi153.stderr: 19600K .......... .......... .......... .......... .......... 21% 271M 1s 2024-09-19T14:14:28.085 INFO:teuthology.orchestra.run.smithi153.stderr: 19650K .......... .......... .......... .......... .......... 21% 275M 1s 2024-09-19T14:14:28.085 INFO:teuthology.orchestra.run.smithi153.stderr: 19700K .......... .......... .......... .......... .......... 21% 290M 1s 2024-09-19T14:14:28.085 INFO:teuthology.orchestra.run.smithi153.stderr: 19750K .......... .......... .......... .......... .......... 21% 247M 1s 2024-09-19T14:14:28.085 INFO:teuthology.orchestra.run.smithi153.stderr: 19800K .......... .......... .......... .......... .......... 21% 267M 1s 2024-09-19T14:14:28.085 INFO:teuthology.orchestra.run.smithi153.stderr: 19850K .......... .......... .......... .......... .......... 21% 279M 1s 2024-09-19T14:14:28.085 INFO:teuthology.orchestra.run.smithi153.stderr: 19900K .......... .......... .......... .......... .......... 21% 301M 1s 2024-09-19T14:14:28.085 INFO:teuthology.orchestra.run.smithi153.stderr: 19950K .......... .......... .......... .......... .......... 21% 205M 1s 2024-09-19T14:14:28.085 INFO:teuthology.orchestra.run.smithi153.stderr: 20000K .......... .......... .......... .......... .......... 21% 309M 1s 2024-09-19T14:14:28.085 INFO:teuthology.orchestra.run.smithi153.stderr: 20050K .......... .......... .......... .......... .......... 21% 290M 1s 2024-09-19T14:14:28.085 INFO:teuthology.orchestra.run.smithi153.stderr: 20100K .......... .......... .......... .......... .......... 21% 295M 1s 2024-09-19T14:14:28.085 INFO:teuthology.orchestra.run.smithi153.stderr: 20150K .......... .......... .......... .......... .......... 21% 272M 1s 2024-09-19T14:14:28.085 INFO:teuthology.orchestra.run.smithi153.stderr: 20200K .......... .......... .......... .......... .......... 21% 312M 1s 2024-09-19T14:14:28.086 INFO:teuthology.orchestra.run.smithi153.stderr: 20250K .......... .......... .......... .......... .......... 21% 259M 1s 2024-09-19T14:14:28.086 INFO:teuthology.orchestra.run.smithi153.stderr: 20300K .......... .......... .......... .......... .......... 21% 284M 1s 2024-09-19T14:14:28.086 INFO:teuthology.orchestra.run.smithi153.stderr: 20350K .......... .......... .......... .......... .......... 21% 242M 1s 2024-09-19T14:14:28.086 INFO:teuthology.orchestra.run.smithi153.stderr: 20400K .......... .......... .......... .......... .......... 22% 260M 1s 2024-09-19T14:14:28.086 INFO:teuthology.orchestra.run.smithi153.stderr: 20450K .......... .......... .......... .......... .......... 22% 310M 1s 2024-09-19T14:14:28.086 INFO:teuthology.orchestra.run.smithi153.stderr: 20500K .......... .......... .......... .......... .......... 22% 307M 1s 2024-09-19T14:14:28.086 INFO:teuthology.orchestra.run.smithi153.stderr: 20550K .......... .......... .......... .......... .......... 22% 283M 1s 2024-09-19T14:14:28.086 INFO:teuthology.orchestra.run.smithi153.stderr: 20600K .......... .......... .......... .......... .......... 22% 225M 1s 2024-09-19T14:14:28.086 INFO:teuthology.orchestra.run.smithi153.stderr: 20650K .......... .......... .......... .......... .......... 22% 284M 1s 2024-09-19T14:14:28.086 INFO:teuthology.orchestra.run.smithi153.stderr: 20700K .......... .......... .......... .......... .......... 22% 268M 1s 2024-09-19T14:14:28.086 INFO:teuthology.orchestra.run.smithi153.stderr: 20750K .......... .......... .......... .......... .......... 22% 218M 1s 2024-09-19T14:14:28.086 INFO:teuthology.orchestra.run.smithi153.stderr: 20800K .......... .......... .......... .......... .......... 22% 302M 1s 2024-09-19T14:14:28.086 INFO:teuthology.orchestra.run.smithi153.stderr: 20850K .......... .......... .......... .......... .......... 22% 279M 1s 2024-09-19T14:14:28.086 INFO:teuthology.orchestra.run.smithi153.stderr: 20900K .......... .......... .......... .......... .......... 22% 290M 1s 2024-09-19T14:14:28.086 INFO:teuthology.orchestra.run.smithi153.stderr: 20950K .......... .......... .......... .......... .......... 22% 254M 1s 2024-09-19T14:14:28.087 INFO:teuthology.orchestra.run.smithi153.stderr: 21000K .......... .......... .......... .......... .......... 22% 285M 1s 2024-09-19T14:14:28.087 INFO:teuthology.orchestra.run.smithi153.stderr: 21050K .......... .......... .......... .......... .......... 22% 265M 1s 2024-09-19T14:14:28.087 INFO:teuthology.orchestra.run.smithi153.stderr: 21100K .......... .......... .......... .......... .......... 22% 313M 1s 2024-09-19T14:14:28.087 INFO:teuthology.orchestra.run.smithi153.stderr: 21150K .......... .......... .......... .......... .......... 22% 251M 1s 2024-09-19T14:14:28.087 INFO:teuthology.orchestra.run.smithi153.stderr: 21200K .......... .......... .......... .......... .......... 22% 318M 1s 2024-09-19T14:14:28.087 INFO:teuthology.orchestra.run.smithi153.stderr: 21250K .......... .......... .......... .......... .......... 22% 311M 1s 2024-09-19T14:14:28.087 INFO:teuthology.orchestra.run.smithi153.stderr: 21300K .......... .......... .......... .......... .......... 22% 313M 1s 2024-09-19T14:14:28.087 INFO:teuthology.orchestra.run.smithi153.stderr: 21350K .......... .......... .......... .......... .......... 23% 63.9M 1s 2024-09-19T14:14:28.087 INFO:teuthology.orchestra.run.smithi153.stderr: 21400K .......... .......... .......... .......... .......... 23% 250M 1s 2024-09-19T14:14:28.087 INFO:teuthology.orchestra.run.smithi153.stderr: 21450K .......... .......... .......... .......... .......... 23% 265M 1s 2024-09-19T14:14:28.087 INFO:teuthology.orchestra.run.smithi153.stderr: 21500K .......... .......... .......... .......... .......... 23% 290M 1s 2024-09-19T14:14:28.087 INFO:teuthology.orchestra.run.smithi153.stderr: 21550K .......... .......... .......... .......... .......... 23% 257M 1s 2024-09-19T14:14:28.087 INFO:teuthology.orchestra.run.smithi153.stderr: 21600K .......... .......... .......... .......... .......... 23% 314M 1s 2024-09-19T14:14:28.088 INFO:teuthology.orchestra.run.smithi153.stderr: 21650K .......... .......... .......... .......... .......... 23% 279M 1s 2024-09-19T14:14:28.088 INFO:teuthology.orchestra.run.smithi153.stderr: 21700K .......... .......... .......... .......... .......... 23% 284M 1s 2024-09-19T14:14:28.088 INFO:teuthology.orchestra.run.smithi153.stderr: 21750K .......... .......... .......... .......... .......... 23% 253M 1s 2024-09-19T14:14:28.088 INFO:teuthology.orchestra.run.smithi153.stderr: 21800K .......... .......... .......... .......... .......... 23% 286M 1s 2024-09-19T14:14:28.088 INFO:teuthology.orchestra.run.smithi153.stderr: 21850K .......... .......... .......... .......... .......... 23% 278M 1s 2024-09-19T14:14:28.088 INFO:teuthology.orchestra.run.smithi153.stderr: 21900K .......... .......... .......... .......... .......... 23% 297M 1s 2024-09-19T14:14:28.088 INFO:teuthology.orchestra.run.smithi153.stderr: 21950K .......... .......... .......... .......... .......... 23% 260M 1s 2024-09-19T14:14:28.088 INFO:teuthology.orchestra.run.smithi153.stderr: 22000K .......... .......... .......... .......... .......... 23% 312M 1s 2024-09-19T14:14:28.088 INFO:teuthology.orchestra.run.smithi153.stderr: 22050K .......... .......... .......... .......... .......... 23% 263M 1s 2024-09-19T14:14:28.088 INFO:teuthology.orchestra.run.smithi153.stderr: 22100K .......... .......... .......... .......... .......... 23% 316M 1s 2024-09-19T14:14:28.088 INFO:teuthology.orchestra.run.smithi153.stderr: 22150K .......... .......... .......... .......... .......... 23% 51.4M 1s 2024-09-19T14:14:28.088 INFO:teuthology.orchestra.run.smithi153.stderr: 22200K .......... .......... .......... .......... .......... 23% 249M 1s 2024-09-19T14:14:28.089 INFO:teuthology.orchestra.run.smithi153.stderr: 22250K .......... .......... .......... .......... .......... 24% 272M 1s 2024-09-19T14:14:28.089 INFO:teuthology.orchestra.run.smithi153.stderr: 22300K .......... .......... .......... .......... .......... 24% 287M 1s 2024-09-19T14:14:28.089 INFO:teuthology.orchestra.run.smithi153.stderr: 22350K .......... .......... .......... .......... .......... 24% 239M 1s 2024-09-19T14:14:28.089 INFO:teuthology.orchestra.run.smithi153.stderr: 22400K .......... .......... .......... .......... .......... 24% 292M 1s 2024-09-19T14:14:28.089 INFO:teuthology.orchestra.run.smithi153.stderr: 22450K .......... .......... .......... .......... .......... 24% 286M 1s 2024-09-19T14:14:28.089 INFO:teuthology.orchestra.run.smithi153.stderr: 22500K .......... .......... .......... .......... .......... 24% 297M 1s 2024-09-19T14:14:28.089 INFO:teuthology.orchestra.run.smithi153.stderr: 22550K .......... .......... .......... .......... .......... 24% 265M 1s 2024-09-19T14:14:28.089 INFO:teuthology.orchestra.run.smithi153.stderr: 22600K .......... .......... .......... .......... .......... 24% 279M 1s 2024-09-19T14:14:28.089 INFO:teuthology.orchestra.run.smithi153.stderr: 22650K .......... .......... .......... .......... .......... 24% 265M 1s 2024-09-19T14:14:28.089 INFO:teuthology.orchestra.run.smithi153.stderr: 22700K .......... .......... .......... .......... .......... 24% 313M 1s 2024-09-19T14:14:28.089 INFO:teuthology.orchestra.run.smithi153.stderr: 22750K .......... .......... .......... .......... .......... 24% 238M 1s 2024-09-19T14:14:28.089 INFO:teuthology.orchestra.run.smithi153.stderr: 22800K .......... .......... .......... .......... .......... 24% 295M 1s 2024-09-19T14:14:28.089 INFO:teuthology.orchestra.run.smithi153.stderr: 22850K .......... .......... .......... .......... .......... 24% 315M 1s 2024-09-19T14:14:28.089 INFO:teuthology.orchestra.run.smithi153.stderr: 22900K .......... .......... .......... .......... .......... 24% 303M 1s 2024-09-19T14:14:28.090 INFO:teuthology.orchestra.run.smithi153.stderr: 22950K .......... .......... .......... .......... .......... 24% 212M 1s 2024-09-19T14:14:28.090 INFO:teuthology.orchestra.run.smithi153.stderr: 23000K .......... .......... .......... .......... .......... 24% 295M 1s 2024-09-19T14:14:28.090 INFO:teuthology.orchestra.run.smithi153.stderr: 23050K .......... .......... .......... .......... .......... 24% 294M 1s 2024-09-19T14:14:28.090 INFO:teuthology.orchestra.run.smithi153.stderr: 23100K .......... .......... .......... .......... .......... 24% 304M 1s 2024-09-19T14:14:28.090 INFO:teuthology.orchestra.run.smithi153.stderr: 23150K .......... .......... .......... .......... .......... 24% 274M 1s 2024-09-19T14:14:28.090 INFO:teuthology.orchestra.run.smithi153.stderr: 23200K .......... .......... .......... .......... .......... 25% 223M 1s 2024-09-19T14:14:28.090 INFO:teuthology.orchestra.run.smithi153.stderr: 23250K .......... .......... .......... .......... .......... 25% 302M 1s 2024-09-19T14:14:28.090 INFO:teuthology.orchestra.run.smithi153.stderr: 23300K .......... .......... .......... .......... .......... 25% 284M 1s 2024-09-19T14:14:28.090 INFO:teuthology.orchestra.run.smithi153.stderr: 23350K .......... .......... .......... .......... .......... 25% 261M 1s 2024-09-19T14:14:28.090 INFO:teuthology.orchestra.run.smithi153.stderr: 23400K .......... .......... .......... .......... .......... 25% 302M 1s 2024-09-19T14:14:28.090 INFO:teuthology.orchestra.run.smithi153.stderr: 23450K .......... .......... .......... .......... .......... 25% 289M 1s 2024-09-19T14:14:28.090 INFO:teuthology.orchestra.run.smithi153.stderr: 23500K .......... .......... .......... .......... .......... 25% 90.4M 1s 2024-09-19T14:14:28.090 INFO:teuthology.orchestra.run.smithi153.stderr: 23550K .......... .......... .......... .......... .......... 25% 232M 1s 2024-09-19T14:14:28.090 INFO:teuthology.orchestra.run.smithi153.stderr: 23600K .......... .......... .......... .......... .......... 25% 316M 1s 2024-09-19T14:14:28.090 INFO:teuthology.orchestra.run.smithi153.stderr: 23650K .......... .......... .......... .......... .......... 25% 301M 1s 2024-09-19T14:14:28.091 INFO:teuthology.orchestra.run.smithi153.stderr: 23700K .......... .......... .......... .......... .......... 25% 294M 1s 2024-09-19T14:14:28.091 INFO:teuthology.orchestra.run.smithi153.stderr: 23750K .......... .......... .......... .......... .......... 25% 235M 1s 2024-09-19T14:14:28.091 INFO:teuthology.orchestra.run.smithi153.stderr: 23800K .......... .......... .......... .......... .......... 25% 293M 1s 2024-09-19T14:14:28.091 INFO:teuthology.orchestra.run.smithi153.stderr: 23850K .......... .......... .......... .......... .......... 25% 303M 1s 2024-09-19T14:14:28.091 INFO:teuthology.orchestra.run.smithi153.stderr: 23900K .......... .......... .......... .......... .......... 25% 288M 1s 2024-09-19T14:14:28.091 INFO:teuthology.orchestra.run.smithi153.stderr: 23950K .......... .......... .......... .......... .......... 25% 283M 1s 2024-09-19T14:14:28.091 INFO:teuthology.orchestra.run.smithi153.stderr: 24000K .......... .......... .......... .......... .......... 25% 266M 1s 2024-09-19T14:14:28.091 INFO:teuthology.orchestra.run.smithi153.stderr: 24050K .......... .......... .......... .......... .......... 25% 316M 1s 2024-09-19T14:14:28.091 INFO:teuthology.orchestra.run.smithi153.stderr: 24100K .......... .......... .......... .......... .......... 25% 322M 1s 2024-09-19T14:14:28.091 INFO:teuthology.orchestra.run.smithi153.stderr: 24150K .......... .......... .......... .......... .......... 26% 56.4M 1s 2024-09-19T14:14:28.091 INFO:teuthology.orchestra.run.smithi153.stderr: 24200K .......... .......... .......... .......... .......... 26% 271M 1s 2024-09-19T14:14:28.091 INFO:teuthology.orchestra.run.smithi153.stderr: 24250K .......... .......... .......... .......... .......... 26% 313M 1s 2024-09-19T14:14:28.091 INFO:teuthology.orchestra.run.smithi153.stderr: 24300K .......... .......... .......... .......... .......... 26% 281M 1s 2024-09-19T14:14:28.091 INFO:teuthology.orchestra.run.smithi153.stderr: 24350K .......... .......... .......... .......... .......... 26% 253M 1s 2024-09-19T14:14:28.092 INFO:teuthology.orchestra.run.smithi153.stderr: 24400K .......... .......... .......... .......... .......... 26% 288M 1s 2024-09-19T14:14:28.092 INFO:teuthology.orchestra.run.smithi153.stderr: 24450K .......... .......... .......... .......... .......... 26% 288M 1s 2024-09-19T14:14:28.092 INFO:teuthology.orchestra.run.smithi153.stderr: 24500K .......... .......... .......... .......... .......... 26% 311M 1s 2024-09-19T14:14:28.092 INFO:teuthology.orchestra.run.smithi153.stderr: 24550K .......... .......... .......... .......... .......... 26% 256M 1s 2024-09-19T14:14:28.092 INFO:teuthology.orchestra.run.smithi153.stderr: 24600K .......... .......... .......... .......... .......... 26% 317M 1s 2024-09-19T14:14:28.092 INFO:teuthology.orchestra.run.smithi153.stderr: 24650K .......... .......... .......... .......... .......... 26% 306M 1s 2024-09-19T14:14:28.092 INFO:teuthology.orchestra.run.smithi153.stderr: 24700K .......... .......... .......... .......... .......... 26% 204M 1s 2024-09-19T14:14:28.092 INFO:teuthology.orchestra.run.smithi153.stderr: 24750K .......... .......... .......... .......... .......... 26% 263M 1s 2024-09-19T14:14:28.092 INFO:teuthology.orchestra.run.smithi153.stderr: 24800K .......... .......... .......... .......... .......... 26% 319M 1s 2024-09-19T14:14:28.092 INFO:teuthology.orchestra.run.smithi153.stderr: 24850K .......... .......... .......... .......... .......... 26% 319M 1s 2024-09-19T14:14:28.092 INFO:teuthology.orchestra.run.smithi153.stderr: 24900K .......... .......... .......... .......... .......... 26% 315M 1s 2024-09-19T14:14:28.092 INFO:teuthology.orchestra.run.smithi153.stderr: 24950K .......... .......... .......... .......... .......... 26% 45.2M 1s 2024-09-19T14:14:28.092 INFO:teuthology.orchestra.run.smithi153.stderr: 25000K .......... .......... .......... .......... .......... 26% 282M 1s 2024-09-19T14:14:28.092 INFO:teuthology.orchestra.run.smithi153.stderr: 25050K .......... .......... .......... .......... .......... 27% 281M 1s 2024-09-19T14:14:28.093 INFO:teuthology.orchestra.run.smithi153.stderr: 25100K .......... .......... .......... .......... .......... 27% 281M 1s 2024-09-19T14:14:28.093 INFO:teuthology.orchestra.run.smithi153.stderr: 25150K .......... .......... .......... .......... .......... 27% 246M 1s 2024-09-19T14:14:28.093 INFO:teuthology.orchestra.run.smithi153.stderr: 25200K .......... .......... .......... .......... .......... 27% 297M 1s 2024-09-19T14:14:28.093 INFO:teuthology.orchestra.run.smithi153.stderr: 25250K .......... .......... .......... .......... .......... 27% 300M 1s 2024-09-19T14:14:28.093 INFO:teuthology.orchestra.run.smithi153.stderr: 25300K .......... .......... .......... .......... .......... 27% 287M 1s 2024-09-19T14:14:28.093 INFO:teuthology.orchestra.run.smithi153.stderr: 25350K .......... .......... .......... .......... .......... 27% 242M 1s 2024-09-19T14:14:28.093 INFO:teuthology.orchestra.run.smithi153.stderr: 25400K .......... .......... .......... .......... .......... 27% 307M 0s 2024-09-19T14:14:28.093 INFO:teuthology.orchestra.run.smithi153.stderr: 25450K .......... .......... .......... .......... .......... 27% 279M 0s 2024-09-19T14:14:28.093 INFO:teuthology.orchestra.run.smithi153.stderr: 25500K .......... .......... .......... .......... .......... 27% 290M 0s 2024-09-19T14:14:28.093 INFO:teuthology.orchestra.run.smithi153.stderr: 25550K .......... .......... .......... .......... .......... 27% 267M 0s 2024-09-19T14:14:28.093 INFO:teuthology.orchestra.run.smithi153.stderr: 25600K .......... .......... .......... .......... .......... 27% 299M 0s 2024-09-19T14:14:28.093 INFO:teuthology.orchestra.run.smithi153.stderr: 25650K .......... .......... .......... .......... .......... 27% 309M 0s 2024-09-19T14:14:28.093 INFO:teuthology.orchestra.run.smithi153.stderr: 25700K .......... .......... .......... .......... .......... 27% 328M 0s 2024-09-19T14:14:28.093 INFO:teuthology.orchestra.run.smithi153.stderr: 25750K .......... .......... .......... .......... .......... 27% 242M 0s 2024-09-19T14:14:28.094 INFO:teuthology.orchestra.run.smithi153.stderr: 25800K .......... .......... .......... .......... .......... 27% 304M 0s 2024-09-19T14:14:28.094 INFO:teuthology.orchestra.run.smithi153.stderr: 25850K .......... .......... .......... .......... .......... 27% 260M 0s 2024-09-19T14:14:28.094 INFO:teuthology.orchestra.run.smithi153.stderr: 25900K .......... .......... .......... .......... .......... 27% 307M 0s 2024-09-19T14:14:28.094 INFO:teuthology.orchestra.run.smithi153.stderr: 25950K .......... .......... .......... .......... .......... 27% 284M 0s 2024-09-19T14:14:28.094 INFO:teuthology.orchestra.run.smithi153.stderr: 26000K .......... .......... .......... .......... .......... 28% 297M 0s 2024-09-19T14:14:28.094 INFO:teuthology.orchestra.run.smithi153.stderr: 26050K .......... .......... .......... .......... .......... 28% 299M 0s 2024-09-19T14:14:28.094 INFO:teuthology.orchestra.run.smithi153.stderr: 26100K .......... .......... .......... .......... .......... 28% 296M 0s 2024-09-19T14:14:28.094 INFO:teuthology.orchestra.run.smithi153.stderr: 26150K .......... .......... .......... .......... .......... 28% 249M 0s 2024-09-19T14:14:28.094 INFO:teuthology.orchestra.run.smithi153.stderr: 26200K .......... .......... .......... .......... .......... 28% 313M 0s 2024-09-19T14:14:28.094 INFO:teuthology.orchestra.run.smithi153.stderr: 26250K .......... .......... .......... .......... .......... 28% 324M 0s 2024-09-19T14:14:28.094 INFO:teuthology.orchestra.run.smithi153.stderr: 26300K .......... .......... .......... .......... .......... 28% 327M 0s 2024-09-19T14:14:28.094 INFO:teuthology.orchestra.run.smithi153.stderr: 26350K .......... .......... .......... .......... .......... 28% 150M 0s 2024-09-19T14:14:28.094 INFO:teuthology.orchestra.run.smithi153.stderr: 26400K .......... .......... .......... .......... .......... 28% 281M 0s 2024-09-19T14:14:28.095 INFO:teuthology.orchestra.run.smithi153.stderr: 26450K .......... .......... .......... .......... .......... 28% 299M 0s 2024-09-19T14:14:28.095 INFO:teuthology.orchestra.run.smithi153.stderr: 26500K .......... .......... .......... .......... .......... 28% 294M 0s 2024-09-19T14:14:28.095 INFO:teuthology.orchestra.run.smithi153.stderr: 26550K .......... .......... .......... .......... .......... 28% 265M 0s 2024-09-19T14:14:28.095 INFO:teuthology.orchestra.run.smithi153.stderr: 26600K .......... .......... .......... .......... .......... 28% 290M 0s 2024-09-19T14:14:28.095 INFO:teuthology.orchestra.run.smithi153.stderr: 26650K .......... .......... .......... .......... .......... 28% 277M 0s 2024-09-19T14:14:28.095 INFO:teuthology.orchestra.run.smithi153.stderr: 26700K .......... .......... .......... .......... .......... 28% 285M 0s 2024-09-19T14:14:28.095 INFO:teuthology.orchestra.run.smithi153.stderr: 26750K .......... .......... .......... .......... .......... 28% 267M 0s 2024-09-19T14:14:28.095 INFO:teuthology.orchestra.run.smithi153.stderr: 26800K .......... .......... .......... .......... .......... 28% 248M 0s 2024-09-19T14:14:28.095 INFO:teuthology.orchestra.run.smithi153.stderr: 26850K .......... .......... .......... .......... .......... 28% 310M 0s 2024-09-19T14:14:28.095 INFO:teuthology.orchestra.run.smithi153.stderr: 26900K .......... .......... .......... .......... .......... 29% 320M 0s 2024-09-19T14:14:28.095 INFO:teuthology.orchestra.run.smithi153.stderr: 26950K .......... .......... .......... .......... .......... 29% 267M 0s 2024-09-19T14:14:28.095 INFO:teuthology.orchestra.run.smithi153.stderr: 27000K .......... .......... .......... .......... .......... 29% 46.3M 0s 2024-09-19T14:14:28.095 INFO:teuthology.orchestra.run.smithi153.stderr: 27050K .......... .......... .......... .......... .......... 29% 265M 0s 2024-09-19T14:14:28.096 INFO:teuthology.orchestra.run.smithi153.stderr: 27100K .......... .......... .......... .......... .......... 29% 288M 0s 2024-09-19T14:14:28.096 INFO:teuthology.orchestra.run.smithi153.stderr: 27150K .......... .......... .......... .......... .......... 29% 242M 0s 2024-09-19T14:14:28.096 INFO:teuthology.orchestra.run.smithi153.stderr: 27200K .......... .......... .......... .......... .......... 29% 288M 0s 2024-09-19T14:14:28.096 INFO:teuthology.orchestra.run.smithi153.stderr: 27250K .......... .......... .......... .......... .......... 29% 297M 0s 2024-09-19T14:14:28.096 INFO:teuthology.orchestra.run.smithi153.stderr: 27300K .......... .......... .......... .......... .......... 29% 284M 0s 2024-09-19T14:14:28.096 INFO:teuthology.orchestra.run.smithi153.stderr: 27350K .......... .......... .......... .......... .......... 29% 281M 0s 2024-09-19T14:14:28.096 INFO:teuthology.orchestra.run.smithi153.stderr: 27400K .......... .......... .......... .......... .......... 29% 313M 0s 2024-09-19T14:14:28.096 INFO:teuthology.orchestra.run.smithi153.stderr: 27450K .......... .......... .......... .......... .......... 29% 309M 0s 2024-09-19T14:14:28.096 INFO:teuthology.orchestra.run.smithi153.stderr: 27500K .......... .......... .......... .......... .......... 29% 297M 0s 2024-09-19T14:14:28.096 INFO:teuthology.orchestra.run.smithi153.stderr: 27550K .......... .......... .......... .......... .......... 29% 227M 0s 2024-09-19T14:14:28.096 INFO:teuthology.orchestra.run.smithi153.stderr: 27600K .......... .......... .......... .......... .......... 29% 291M 0s 2024-09-19T14:14:28.096 INFO:teuthology.orchestra.run.smithi153.stderr: 27650K .......... .......... .......... .......... .......... 29% 312M 0s 2024-09-19T14:14:28.097 INFO:teuthology.orchestra.run.smithi153.stderr: 27700K .......... .......... .......... .......... .......... 29% 309M 0s 2024-09-19T14:14:28.097 INFO:teuthology.orchestra.run.smithi153.stderr: 27750K .......... .......... .......... .......... .......... 29% 283M 0s 2024-09-19T14:14:28.097 INFO:teuthology.orchestra.run.smithi153.stderr: 27800K .......... .......... .......... .......... .......... 29% 322M 0s 2024-09-19T14:14:28.097 INFO:teuthology.orchestra.run.smithi153.stderr: 27850K .......... .......... .......... .......... .......... 30% 47.1M 0s 2024-09-19T14:14:28.097 INFO:teuthology.orchestra.run.smithi153.stderr: 27900K .......... .......... .......... .......... .......... 30% 247M 0s 2024-09-19T14:14:28.097 INFO:teuthology.orchestra.run.smithi153.stderr: 27950K .......... .......... .......... .......... .......... 30% 243M 0s 2024-09-19T14:14:28.097 INFO:teuthology.orchestra.run.smithi153.stderr: 28000K .......... .......... .......... .......... .......... 30% 293M 0s 2024-09-19T14:14:28.097 INFO:teuthology.orchestra.run.smithi153.stderr: 28050K .......... .......... .......... .......... .......... 30% 246M 0s 2024-09-19T14:14:28.097 INFO:teuthology.orchestra.run.smithi153.stderr: 28100K .......... .......... .......... .......... .......... 30% 293M 0s 2024-09-19T14:14:28.097 INFO:teuthology.orchestra.run.smithi153.stderr: 28150K .......... .......... .......... .......... .......... 30% 267M 0s 2024-09-19T14:14:28.097 INFO:teuthology.orchestra.run.smithi153.stderr: 28200K .......... .......... .......... .......... .......... 30% 248M 0s 2024-09-19T14:14:28.097 INFO:teuthology.orchestra.run.smithi153.stderr: 28250K .......... .......... .......... .......... .......... 30% 260M 0s 2024-09-19T14:14:28.098 INFO:teuthology.orchestra.run.smithi153.stderr: 28300K .......... .......... .......... .......... .......... 30% 294M 0s 2024-09-19T14:14:28.098 INFO:teuthology.orchestra.run.smithi153.stderr: 28350K .......... .......... .......... .......... .......... 30% 226M 0s 2024-09-19T14:14:28.098 INFO:teuthology.orchestra.run.smithi153.stderr: 28400K .......... .......... .......... .......... .......... 30% 289M 0s 2024-09-19T14:14:28.098 INFO:teuthology.orchestra.run.smithi153.stderr: 28450K .......... .......... .......... .......... .......... 30% 307M 0s 2024-09-19T14:14:28.098 INFO:teuthology.orchestra.run.smithi153.stderr: 28500K .......... .......... .......... .......... .......... 30% 317M 0s 2024-09-19T14:14:28.098 INFO:teuthology.orchestra.run.smithi153.stderr: 28550K .......... .......... .......... .......... .......... 30% 279M 0s 2024-09-19T14:14:28.098 INFO:teuthology.orchestra.run.smithi153.stderr: 28600K .......... .......... .......... .......... .......... 30% 272M 0s 2024-09-19T14:14:28.098 INFO:teuthology.orchestra.run.smithi153.stderr: 28650K .......... .......... .......... .......... .......... 30% 299M 0s 2024-09-19T14:14:28.098 INFO:teuthology.orchestra.run.smithi153.stderr: 28700K .......... .......... .......... .......... .......... 30% 312M 0s 2024-09-19T14:14:28.098 INFO:teuthology.orchestra.run.smithi153.stderr: 28750K .......... .......... .......... .......... .......... 31% 228M 0s 2024-09-19T14:14:28.098 INFO:teuthology.orchestra.run.smithi153.stderr: 28800K .......... .......... .......... .......... .......... 31% 281M 0s 2024-09-19T14:14:28.098 INFO:teuthology.orchestra.run.smithi153.stderr: 28850K .......... .......... .......... .......... .......... 31% 283M 0s 2024-09-19T14:14:28.098 INFO:teuthology.orchestra.run.smithi153.stderr: 28900K .......... .......... .......... .......... .......... 31% 294M 0s 2024-09-19T14:14:28.099 INFO:teuthology.orchestra.run.smithi153.stderr: 28950K .......... .......... .......... .......... .......... 31% 274M 0s 2024-09-19T14:14:28.099 INFO:teuthology.orchestra.run.smithi153.stderr: 29000K .......... .......... .......... .......... .......... 31% 296M 0s 2024-09-19T14:14:28.099 INFO:teuthology.orchestra.run.smithi153.stderr: 29050K .......... .......... .......... .......... .......... 31% 316M 0s 2024-09-19T14:14:28.099 INFO:teuthology.orchestra.run.smithi153.stderr: 29100K .......... .......... .......... .......... .......... 31% 318M 0s 2024-09-19T14:14:28.099 INFO:teuthology.orchestra.run.smithi153.stderr: 29150K .......... .......... .......... .......... .......... 31% 260M 0s 2024-09-19T14:14:28.099 INFO:teuthology.orchestra.run.smithi153.stderr: 29200K .......... .......... .......... .......... .......... 31% 84.9M 0s 2024-09-19T14:14:28.099 INFO:teuthology.orchestra.run.smithi153.stderr: 29250K .......... .......... .......... .......... .......... 31% 226M 0s 2024-09-19T14:14:28.099 INFO:teuthology.orchestra.run.smithi153.stderr: 29300K .......... .......... .......... .......... .......... 31% 277M 0s 2024-09-19T14:14:28.099 INFO:teuthology.orchestra.run.smithi153.stderr: 29350K .......... .......... .......... .......... .......... 31% 253M 0s 2024-09-19T14:14:28.099 INFO:teuthology.orchestra.run.smithi153.stderr: 29400K .......... .......... .......... .......... .......... 31% 285M 0s 2024-09-19T14:14:28.099 INFO:teuthology.orchestra.run.smithi153.stderr: 29450K .......... .......... .......... .......... .......... 31% 281M 0s 2024-09-19T14:14:28.099 INFO:teuthology.orchestra.run.smithi153.stderr: 29500K .......... .......... .......... .......... .......... 31% 261M 0s 2024-09-19T14:14:28.099 INFO:teuthology.orchestra.run.smithi153.stderr: 29550K .......... .......... .......... .......... .......... 31% 265M 0s 2024-09-19T14:14:28.099 INFO:teuthology.orchestra.run.smithi153.stderr: 29600K .......... .......... .......... .......... .......... 31% 323M 0s 2024-09-19T14:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr: 29650K .......... .......... .......... .......... .......... 31% 313M 0s 2024-09-19T14:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr: 29700K .......... .......... .......... .......... .......... 32% 314M 0s 2024-09-19T14:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr: 29750K .......... .......... .......... .......... .......... 32% 288M 0s 2024-09-19T14:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr: 29800K .......... .......... .......... .......... .......... 32% 286M 0s 2024-09-19T14:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr: 29850K .......... .......... .......... .......... .......... 32% 172M 0s 2024-09-19T14:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr: 29900K .......... .......... .......... .......... .......... 32% 280M 0s 2024-09-19T14:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr: 29950K .......... .......... .......... .......... .......... 32% 242M 0s 2024-09-19T14:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr: 30000K .......... .......... .......... .......... .......... 32% 315M 0s 2024-09-19T14:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr: 30050K .......... .......... .......... .......... .......... 32% 301M 0s 2024-09-19T14:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr: 30100K .......... .......... .......... .......... .......... 32% 284M 0s 2024-09-19T14:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr: 30150K .......... .......... .......... .......... .......... 32% 271M 0s 2024-09-19T14:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr: 30200K .......... .......... .......... .......... .......... 32% 293M 0s 2024-09-19T14:14:28.100 INFO:teuthology.orchestra.run.smithi153.stderr: 30250K .......... .......... .......... .......... .......... 32% 277M 0s 2024-09-19T14:14:28.101 INFO:teuthology.orchestra.run.smithi153.stderr: 30300K .......... .......... .......... .......... .......... 32% 304M 0s 2024-09-19T14:14:28.101 INFO:teuthology.orchestra.run.smithi153.stderr: 30350K .......... .......... .......... .......... .......... 32% 266M 0s 2024-09-19T14:14:28.101 INFO:teuthology.orchestra.run.smithi153.stderr: 30400K .......... .......... .......... .......... .......... 32% 304M 0s 2024-09-19T14:14:28.101 INFO:teuthology.orchestra.run.smithi153.stderr: 30450K .......... .......... .......... .......... .......... 32% 296M 0s 2024-09-19T14:14:28.101 INFO:teuthology.orchestra.run.smithi153.stderr: 30500K .......... .......... .......... .......... .......... 32% 289M 0s 2024-09-19T14:14:28.101 INFO:teuthology.orchestra.run.smithi153.stderr: 30550K .......... .......... .......... .......... .......... 32% 251M 0s 2024-09-19T14:14:28.101 INFO:teuthology.orchestra.run.smithi153.stderr: 30600K .......... .......... .......... .......... .......... 32% 314M 0s 2024-09-19T14:14:28.101 INFO:teuthology.orchestra.run.smithi153.stderr: 30650K .......... .......... .......... .......... .......... 33% 319M 0s 2024-09-19T14:14:28.101 INFO:teuthology.orchestra.run.smithi153.stderr: 30700K .......... .......... .......... .......... .......... 33% 46.0M 0s 2024-09-19T14:14:28.101 INFO:teuthology.orchestra.run.smithi153.stderr: 30750K .......... .......... .......... .......... .......... 33% 234M 0s 2024-09-19T14:14:28.101 INFO:teuthology.orchestra.run.smithi153.stderr: 30800K .......... .......... .......... .......... .......... 33% 296M 0s 2024-09-19T14:14:28.101 INFO:teuthology.orchestra.run.smithi153.stderr: 30850K .......... .......... .......... .......... .......... 33% 299M 0s 2024-09-19T14:14:28.101 INFO:teuthology.orchestra.run.smithi153.stderr: 30900K .......... .......... .......... .......... .......... 33% 261M 0s 2024-09-19T14:14:28.102 INFO:teuthology.orchestra.run.smithi153.stderr: 30950K .......... .......... .......... .......... .......... 33% 305M 0s 2024-09-19T14:14:28.102 INFO:teuthology.orchestra.run.smithi153.stderr: 31000K .......... .......... .......... .......... .......... 33% 316M 0s 2024-09-19T14:14:28.102 INFO:teuthology.orchestra.run.smithi153.stderr: 31050K .......... .......... .......... .......... .......... 33% 282M 0s 2024-09-19T14:14:28.102 INFO:teuthology.orchestra.run.smithi153.stderr: 31100K .......... .......... .......... .......... .......... 33% 237M 0s 2024-09-19T14:14:28.102 INFO:teuthology.orchestra.run.smithi153.stderr: 31150K .......... .......... .......... .......... .......... 33% 312M 0s 2024-09-19T14:14:28.102 INFO:teuthology.orchestra.run.smithi153.stderr: 31200K .......... .......... .......... .......... .......... 33% 288M 0s 2024-09-19T14:14:28.102 INFO:teuthology.orchestra.run.smithi153.stderr: 31250K .......... .......... .......... .......... .......... 33% 294M 0s 2024-09-19T14:14:28.102 INFO:teuthology.orchestra.run.smithi153.stderr: 31300K .......... .......... .......... .......... .......... 33% 268M 0s 2024-09-19T14:14:28.102 INFO:teuthology.orchestra.run.smithi153.stderr: 31350K .......... .......... .......... .......... .......... 33% 297M 0s 2024-09-19T14:14:28.102 INFO:teuthology.orchestra.run.smithi153.stderr: 31400K .......... .......... .......... .......... .......... 33% 276M 0s 2024-09-19T14:14:28.102 INFO:teuthology.orchestra.run.smithi153.stderr: 31450K .......... .......... .......... .......... .......... 33% 307M 0s 2024-09-19T14:14:28.102 INFO:teuthology.orchestra.run.smithi153.stderr: 31500K .......... .......... .......... .......... .......... 33% 158M 0s 2024-09-19T14:14:28.102 INFO:teuthology.orchestra.run.smithi153.stderr: 31550K .......... .......... .......... .......... .......... 34% 276M 0s 2024-09-19T14:14:28.102 INFO:teuthology.orchestra.run.smithi153.stderr: 31600K .......... .......... .......... .......... .......... 34% 289M 0s 2024-09-19T14:14:28.102 INFO:teuthology.orchestra.run.smithi153.stderr: 31650K .......... .......... .......... .......... .......... 34% 311M 0s 2024-09-19T14:14:28.103 INFO:teuthology.orchestra.run.smithi153.stderr: 31700K .......... .......... .......... .......... .......... 34% 279M 0s 2024-09-19T14:14:28.103 INFO:teuthology.orchestra.run.smithi153.stderr: 31750K .......... .......... .......... .......... .......... 34% 281M 0s 2024-09-19T14:14:28.103 INFO:teuthology.orchestra.run.smithi153.stderr: 31800K .......... .......... .......... .......... .......... 34% 282M 0s 2024-09-19T14:14:28.103 INFO:teuthology.orchestra.run.smithi153.stderr: 31850K .......... .......... .......... .......... .......... 34% 292M 0s 2024-09-19T14:14:28.103 INFO:teuthology.orchestra.run.smithi153.stderr: 31900K .......... .......... .......... .......... .......... 34% 259M 0s 2024-09-19T14:14:28.103 INFO:teuthology.orchestra.run.smithi153.stderr: 31950K .......... .......... .......... .......... .......... 34% 205M 0s 2024-09-19T14:14:28.103 INFO:teuthology.orchestra.run.smithi153.stderr: 32000K .......... .......... .......... .......... .......... 34% 294M 0s 2024-09-19T14:14:28.103 INFO:teuthology.orchestra.run.smithi153.stderr: 32050K .......... .......... .......... .......... .......... 34% 326M 0s 2024-09-19T14:14:28.103 INFO:teuthology.orchestra.run.smithi153.stderr: 32100K .......... .......... .......... .......... .......... 34% 66.8M 0s 2024-09-19T14:14:28.103 INFO:teuthology.orchestra.run.smithi153.stderr: 32150K .......... .......... .......... .......... .......... 34% 276M 0s 2024-09-19T14:14:28.103 INFO:teuthology.orchestra.run.smithi153.stderr: 32200K .......... .......... .......... .......... .......... 34% 286M 0s 2024-09-19T14:14:28.103 INFO:teuthology.orchestra.run.smithi153.stderr: 32250K .......... .......... .......... .......... .......... 34% 319M 0s 2024-09-19T14:14:28.103 INFO:teuthology.orchestra.run.smithi153.stderr: 32300K .......... .......... .......... .......... .......... 34% 245M 0s 2024-09-19T14:14:28.103 INFO:teuthology.orchestra.run.smithi153.stderr: 32350K .......... .......... .......... .......... .......... 34% 302M 0s 2024-09-19T14:14:28.104 INFO:teuthology.orchestra.run.smithi153.stderr: 32400K .......... .......... .......... .......... .......... 34% 283M 0s 2024-09-19T14:14:28.104 INFO:teuthology.orchestra.run.smithi153.stderr: 32450K .......... .......... .......... .......... .......... 34% 288M 0s 2024-09-19T14:14:28.104 INFO:teuthology.orchestra.run.smithi153.stderr: 32500K .......... .......... .......... .......... .......... 35% 288M 0s 2024-09-19T14:14:28.104 INFO:teuthology.orchestra.run.smithi153.stderr: 32550K .......... .......... .......... .......... .......... 35% 302M 0s 2024-09-19T14:14:28.104 INFO:teuthology.orchestra.run.smithi153.stderr: 32600K .......... .......... .......... .......... .......... 35% 325M 0s 2024-09-19T14:14:28.104 INFO:teuthology.orchestra.run.smithi153.stderr: 32650K .......... .......... .......... .......... .......... 35% 81.6M 0s 2024-09-19T14:14:28.104 INFO:teuthology.orchestra.run.smithi153.stderr: 32700K .......... .......... .......... .......... .......... 35% 213M 0s 2024-09-19T14:14:28.104 INFO:teuthology.orchestra.run.smithi153.stderr: 32750K .......... .......... .......... .......... .......... 35% 272M 0s 2024-09-19T14:14:28.104 INFO:teuthology.orchestra.run.smithi153.stderr: 32800K .......... .......... .......... .......... .......... 35% 290M 0s 2024-09-19T14:14:28.104 INFO:teuthology.orchestra.run.smithi153.stderr: 32850K .......... .......... .......... .......... .......... 35% 238M 0s 2024-09-19T14:14:28.104 INFO:teuthology.orchestra.run.smithi153.stderr: 32900K .......... .......... .......... .......... .......... 35% 254M 0s 2024-09-19T14:14:28.104 INFO:teuthology.orchestra.run.smithi153.stderr: 32950K .......... .......... .......... .......... .......... 35% 294M 0s 2024-09-19T14:14:28.104 INFO:teuthology.orchestra.run.smithi153.stderr: 33000K .......... .......... .......... .......... .......... 35% 297M 0s 2024-09-19T14:14:28.104 INFO:teuthology.orchestra.run.smithi153.stderr: 33050K .......... .......... .......... .......... .......... 35% 304M 0s 2024-09-19T14:14:28.104 INFO:teuthology.orchestra.run.smithi153.stderr: 33100K .......... .......... .......... .......... .......... 35% 245M 0s 2024-09-19T14:14:28.105 INFO:teuthology.orchestra.run.smithi153.stderr: 33150K .......... .......... .......... .......... .......... 35% 290M 0s 2024-09-19T14:14:28.105 INFO:teuthology.orchestra.run.smithi153.stderr: 33200K .......... .......... .......... .......... .......... 35% 298M 0s 2024-09-19T14:14:28.105 INFO:teuthology.orchestra.run.smithi153.stderr: 33250K .......... .......... .......... .......... .......... 35% 268M 0s 2024-09-19T14:14:28.105 INFO:teuthology.orchestra.run.smithi153.stderr: 33300K .......... .......... .......... .......... .......... 35% 320M 0s 2024-09-19T14:14:28.105 INFO:teuthology.orchestra.run.smithi153.stderr: 33350K .......... .......... .......... .......... .......... 35% 302M 0s 2024-09-19T14:14:28.105 INFO:teuthology.orchestra.run.smithi153.stderr: 33400K .......... .......... .......... .......... .......... 36% 283M 0s 2024-09-19T14:14:28.105 INFO:teuthology.orchestra.run.smithi153.stderr: 33450K .......... .......... .......... .......... .......... 36% 314M 0s 2024-09-19T14:14:28.105 INFO:teuthology.orchestra.run.smithi153.stderr: 33500K .......... .......... .......... .......... .......... 36% 282M 0s 2024-09-19T14:14:28.105 INFO:teuthology.orchestra.run.smithi153.stderr: 33550K .......... .......... .......... .......... .......... 36% 321M 0s 2024-09-19T14:14:28.105 INFO:teuthology.orchestra.run.smithi153.stderr: 33600K .......... .......... .......... .......... .......... 36% 170M 0s 2024-09-19T14:14:28.105 INFO:teuthology.orchestra.run.smithi153.stderr: 33650K .......... .......... .......... .......... .......... 36% 117M 0s 2024-09-19T14:14:28.105 INFO:teuthology.orchestra.run.smithi153.stderr: 33700K .......... .......... .......... .......... .......... 36% 218M 0s 2024-09-19T14:14:28.106 INFO:teuthology.orchestra.run.smithi153.stderr: 33750K .......... .......... .......... .......... .......... 36% 280M 0s 2024-09-19T14:14:28.106 INFO:teuthology.orchestra.run.smithi153.stderr: 33800K .......... .......... .......... .......... .......... 36% 319M 0s 2024-09-19T14:14:28.106 INFO:teuthology.orchestra.run.smithi153.stderr: 33850K .......... .......... .......... .......... .......... 36% 299M 0s 2024-09-19T14:14:28.106 INFO:teuthology.orchestra.run.smithi153.stderr: 33900K .......... .......... .......... .......... .......... 36% 255M 0s 2024-09-19T14:14:28.106 INFO:teuthology.orchestra.run.smithi153.stderr: 33950K .......... .......... .......... .......... .......... 36% 315M 0s 2024-09-19T14:14:28.106 INFO:teuthology.orchestra.run.smithi153.stderr: 34000K .......... .......... .......... .......... .......... 36% 307M 0s 2024-09-19T14:14:28.106 INFO:teuthology.orchestra.run.smithi153.stderr: 34050K .......... .......... .......... .......... .......... 36% 295M 0s 2024-09-19T14:14:28.106 INFO:teuthology.orchestra.run.smithi153.stderr: 34100K .......... .......... .......... .......... .......... 36% 280M 0s 2024-09-19T14:14:28.106 INFO:teuthology.orchestra.run.smithi153.stderr: 34150K .......... .......... .......... .......... .......... 36% 317M 0s 2024-09-19T14:14:28.106 INFO:teuthology.orchestra.run.smithi153.stderr: 34200K .......... .......... .......... .......... .......... 36% 308M 0s 2024-09-19T14:14:28.106 INFO:teuthology.orchestra.run.smithi153.stderr: 34250K .......... .......... .......... .......... .......... 36% 316M 0s 2024-09-19T14:14:28.106 INFO:teuthology.orchestra.run.smithi153.stderr: 34300K .......... .......... .......... .......... .......... 36% 253M 0s 2024-09-19T14:14:28.106 INFO:teuthology.orchestra.run.smithi153.stderr: 34350K .......... .......... .......... .......... .......... 37% 293M 0s 2024-09-19T14:14:28.106 INFO:teuthology.orchestra.run.smithi153.stderr: 34400K .......... .......... .......... .......... .......... 37% 320M 0s 2024-09-19T14:14:28.107 INFO:teuthology.orchestra.run.smithi153.stderr: 34450K .......... .......... .......... .......... .......... 37% 313M 0s 2024-09-19T14:14:28.107 INFO:teuthology.orchestra.run.smithi153.stderr: 34500K .......... .......... .......... .......... .......... 37% 261M 0s 2024-09-19T14:14:28.107 INFO:teuthology.orchestra.run.smithi153.stderr: 34550K .......... .......... .......... .......... .......... 37% 301M 0s 2024-09-19T14:14:28.107 INFO:teuthology.orchestra.run.smithi153.stderr: 34600K .......... .......... .......... .......... .......... 37% 266M 0s 2024-09-19T14:14:28.107 INFO:teuthology.orchestra.run.smithi153.stderr: 34650K .......... .......... .......... .......... .......... 37% 143M 0s 2024-09-19T14:14:28.107 INFO:teuthology.orchestra.run.smithi153.stderr: 34700K .......... .......... .......... .......... .......... 37% 246M 0s 2024-09-19T14:14:28.107 INFO:teuthology.orchestra.run.smithi153.stderr: 34750K .......... .......... .......... .......... .......... 37% 328M 0s 2024-09-19T14:14:28.107 INFO:teuthology.orchestra.run.smithi153.stderr: 34800K .......... .......... .......... .......... .......... 37% 324M 0s 2024-09-19T14:14:28.107 INFO:teuthology.orchestra.run.smithi153.stderr: 34850K .......... .......... .......... .......... .......... 37% 313M 0s 2024-09-19T14:14:28.107 INFO:teuthology.orchestra.run.smithi153.stderr: 34900K .......... .......... .......... .......... .......... 37% 170M 0s 2024-09-19T14:14:28.107 INFO:teuthology.orchestra.run.smithi153.stderr: 34950K .......... .......... .......... .......... .......... 37% 294M 0s 2024-09-19T14:14:28.107 INFO:teuthology.orchestra.run.smithi153.stderr: 35000K .......... .......... .......... .......... .......... 37% 63.1M 0s 2024-09-19T14:14:28.107 INFO:teuthology.orchestra.run.smithi153.stderr: 35050K .......... .......... .......... .......... .......... 37% 234M 0s 2024-09-19T14:14:28.107 INFO:teuthology.orchestra.run.smithi153.stderr: 35100K .......... .......... .......... .......... .......... 37% 187M 0s 2024-09-19T14:14:28.107 INFO:teuthology.orchestra.run.smithi153.stderr: 35150K .......... .......... .......... .......... .......... 37% 290M 0s 2024-09-19T14:14:28.108 INFO:teuthology.orchestra.run.smithi153.stderr: 35200K .......... .......... .......... .......... .......... 37% 217M 0s 2024-09-19T14:14:28.108 INFO:teuthology.orchestra.run.smithi153.stderr: 35250K .......... .......... .......... .......... .......... 37% 250M 0s 2024-09-19T14:14:28.108 INFO:teuthology.orchestra.run.smithi153.stderr: 35300K .......... .......... .......... .......... .......... 38% 293M 0s 2024-09-19T14:14:28.108 INFO:teuthology.orchestra.run.smithi153.stderr: 35350K .......... .......... .......... .......... .......... 38% 328M 0s 2024-09-19T14:14:28.108 INFO:teuthology.orchestra.run.smithi153.stderr: 35400K .......... .......... .......... .......... .......... 38% 325M 0s 2024-09-19T14:14:28.108 INFO:teuthology.orchestra.run.smithi153.stderr: 35450K .......... .......... .......... .......... .......... 38% 335M 0s 2024-09-19T14:14:28.108 INFO:teuthology.orchestra.run.smithi153.stderr: 35500K .......... .......... .......... .......... .......... 38% 75.2M 0s 2024-09-19T14:14:28.108 INFO:teuthology.orchestra.run.smithi153.stderr: 35550K .......... .......... .......... .......... .......... 38% 246M 0s 2024-09-19T14:14:28.108 INFO:teuthology.orchestra.run.smithi153.stderr: 35600K .......... .......... .......... .......... .......... 38% 233M 0s 2024-09-19T14:14:28.108 INFO:teuthology.orchestra.run.smithi153.stderr: 35650K .......... .......... .......... .......... .......... 38% 278M 0s 2024-09-19T14:14:28.108 INFO:teuthology.orchestra.run.smithi153.stderr: 35700K .......... .......... .......... .......... .......... 38% 244M 0s 2024-09-19T14:14:28.108 INFO:teuthology.orchestra.run.smithi153.stderr: 35750K .......... .......... .......... .......... .......... 38% 282M 0s 2024-09-19T14:14:28.108 INFO:teuthology.orchestra.run.smithi153.stderr: 35800K .......... .......... .......... .......... .......... 38% 311M 0s 2024-09-19T14:14:28.108 INFO:teuthology.orchestra.run.smithi153.stderr: 35850K .......... .......... .......... .......... .......... 38% 328M 0s 2024-09-19T14:14:28.109 INFO:teuthology.orchestra.run.smithi153.stderr: 35900K .......... .......... .......... .......... .......... 38% 297M 0s 2024-09-19T14:14:28.109 INFO:teuthology.orchestra.run.smithi153.stderr: 35950K .......... .......... .......... .......... .......... 38% 298M 0s 2024-09-19T14:14:28.109 INFO:teuthology.orchestra.run.smithi153.stderr: 36000K .......... .......... .......... .......... .......... 38% 296M 0s 2024-09-19T14:14:28.109 INFO:teuthology.orchestra.run.smithi153.stderr: 36050K .......... .......... .......... .......... .......... 38% 289M 0s 2024-09-19T14:14:28.109 INFO:teuthology.orchestra.run.smithi153.stderr: 36100K .......... .......... .......... .......... .......... 38% 235M 0s 2024-09-19T14:14:28.109 INFO:teuthology.orchestra.run.smithi153.stderr: 36150K .......... .......... .......... .......... .......... 38% 311M 0s 2024-09-19T14:14:28.109 INFO:teuthology.orchestra.run.smithi153.stderr: 36200K .......... .......... .......... .......... .......... 39% 301M 0s 2024-09-19T14:14:28.109 INFO:teuthology.orchestra.run.smithi153.stderr: 36250K .......... .......... .......... .......... .......... 39% 333M 0s 2024-09-19T14:14:28.109 INFO:teuthology.orchestra.run.smithi153.stderr: 36300K .......... .......... .......... .......... .......... 39% 304M 0s 2024-09-19T14:14:28.109 INFO:teuthology.orchestra.run.smithi153.stderr: 36350K .......... .......... .......... .......... .......... 39% 330M 0s 2024-09-19T14:14:28.109 INFO:teuthology.orchestra.run.smithi153.stderr: 36400K .......... .......... .......... .......... .......... 39% 114M 0s 2024-09-19T14:14:28.109 INFO:teuthology.orchestra.run.smithi153.stderr: 36450K .......... .......... .......... .......... .......... 39% 274M 0s 2024-09-19T14:14:28.109 INFO:teuthology.orchestra.run.smithi153.stderr: 36500K .......... .......... .......... .......... .......... 39% 244M 0s 2024-09-19T14:14:28.109 INFO:teuthology.orchestra.run.smithi153.stderr: 36550K .......... .......... .......... .......... .......... 39% 313M 0s 2024-09-19T14:14:28.110 INFO:teuthology.orchestra.run.smithi153.stderr: 36600K .......... .......... .......... .......... .......... 39% 327M 0s 2024-09-19T14:14:28.110 INFO:teuthology.orchestra.run.smithi153.stderr: 36650K .......... .......... .......... .......... .......... 39% 293M 0s 2024-09-19T14:14:28.110 INFO:teuthology.orchestra.run.smithi153.stderr: 36700K .......... .......... .......... .......... .......... 39% 265M 0s 2024-09-19T14:14:28.110 INFO:teuthology.orchestra.run.smithi153.stderr: 36750K .......... .......... .......... .......... .......... 39% 293M 0s 2024-09-19T14:14:28.110 INFO:teuthology.orchestra.run.smithi153.stderr: 36800K .......... .......... .......... .......... .......... 39% 302M 0s 2024-09-19T14:14:28.110 INFO:teuthology.orchestra.run.smithi153.stderr: 36850K .......... .......... .......... .......... .......... 39% 314M 0s 2024-09-19T14:14:28.110 INFO:teuthology.orchestra.run.smithi153.stderr: 36900K .......... .......... .......... .......... .......... 39% 273M 0s 2024-09-19T14:14:28.110 INFO:teuthology.orchestra.run.smithi153.stderr: 36950K .......... .......... .......... .......... .......... 39% 255M 0s 2024-09-19T14:14:28.110 INFO:teuthology.orchestra.run.smithi153.stderr: 37000K .......... .......... .......... .......... .......... 39% 282M 0s 2024-09-19T14:14:28.110 INFO:teuthology.orchestra.run.smithi153.stderr: 37050K .......... .......... .......... .......... .......... 39% 326M 0s 2024-09-19T14:14:28.110 INFO:teuthology.orchestra.run.smithi153.stderr: 37100K .......... .......... .......... .......... .......... 39% 290M 0s 2024-09-19T14:14:28.110 INFO:teuthology.orchestra.run.smithi153.stderr: 37150K .......... .......... .......... .......... .......... 40% 281M 0s 2024-09-19T14:14:28.110 INFO:teuthology.orchestra.run.smithi153.stderr: 37200K .......... .......... .......... .......... .......... 40% 309M 0s 2024-09-19T14:14:28.110 INFO:teuthology.orchestra.run.smithi153.stderr: 37250K .......... .......... .......... .......... .......... 40% 293M 0s 2024-09-19T14:14:28.110 INFO:teuthology.orchestra.run.smithi153.stderr: 37300K .......... .......... .......... .......... .......... 40% 255M 0s 2024-09-19T14:14:28.111 INFO:teuthology.orchestra.run.smithi153.stderr: 37350K .......... .......... .......... .......... .......... 40% 311M 0s 2024-09-19T14:14:28.111 INFO:teuthology.orchestra.run.smithi153.stderr: 37400K .......... .......... .......... .......... .......... 40% 310M 0s 2024-09-19T14:14:28.111 INFO:teuthology.orchestra.run.smithi153.stderr: 37450K .......... .......... .......... .......... .......... 40% 302M 0s 2024-09-19T14:14:28.111 INFO:teuthology.orchestra.run.smithi153.stderr: 37500K .......... .......... .......... .......... .......... 40% 292M 0s 2024-09-19T14:14:28.111 INFO:teuthology.orchestra.run.smithi153.stderr: 37550K .......... .......... .......... .......... .......... 40% 307M 0s 2024-09-19T14:14:28.111 INFO:teuthology.orchestra.run.smithi153.stderr: 37600K .......... .......... .......... .......... .......... 40% 324M 0s 2024-09-19T14:14:28.111 INFO:teuthology.orchestra.run.smithi153.stderr: 37650K .......... .......... .......... .......... .......... 40% 324M 0s 2024-09-19T14:14:28.111 INFO:teuthology.orchestra.run.smithi153.stderr: 37700K .......... .......... .......... .......... .......... 40% 254M 0s 2024-09-19T14:14:28.111 INFO:teuthology.orchestra.run.smithi153.stderr: 37750K .......... .......... .......... .......... .......... 40% 108M 0s 2024-09-19T14:14:28.111 INFO:teuthology.orchestra.run.smithi153.stderr: 37800K .......... .......... .......... .......... .......... 40% 252M 0s 2024-09-19T14:14:28.111 INFO:teuthology.orchestra.run.smithi153.stderr: 37850K .......... .......... .......... .......... .......... 40% 285M 0s 2024-09-19T14:14:28.111 INFO:teuthology.orchestra.run.smithi153.stderr: 37900K .......... .......... .......... .......... .......... 40% 297M 0s 2024-09-19T14:14:28.111 INFO:teuthology.orchestra.run.smithi153.stderr: 37950K .......... .......... .......... .......... .......... 40% 329M 0s 2024-09-19T14:14:28.111 INFO:teuthology.orchestra.run.smithi153.stderr: 38000K .......... .......... .......... .......... .......... 40% 110M 0s 2024-09-19T14:14:28.112 INFO:teuthology.orchestra.run.smithi153.stderr: 38050K .......... .......... .......... .......... .......... 41% 330M 0s 2024-09-19T14:14:28.112 INFO:teuthology.orchestra.run.smithi153.stderr: 38100K .......... .......... .......... .......... .......... 41% 165M 0s 2024-09-19T14:14:28.112 INFO:teuthology.orchestra.run.smithi153.stderr: 38150K .......... .......... .......... .......... .......... 41% 323M 0s 2024-09-19T14:14:28.112 INFO:teuthology.orchestra.run.smithi153.stderr: 38200K .......... .......... .......... .......... .......... 41% 255M 0s 2024-09-19T14:14:28.112 INFO:teuthology.orchestra.run.smithi153.stderr: 38250K .......... .......... .......... .......... .......... 41% 159M 0s 2024-09-19T14:14:28.112 INFO:teuthology.orchestra.run.smithi153.stderr: 38300K .......... .......... .......... .......... .......... 41% 258M 0s 2024-09-19T14:14:28.112 INFO:teuthology.orchestra.run.smithi153.stderr: 38350K .......... .......... .......... .......... .......... 41% 339M 0s 2024-09-19T14:14:28.112 INFO:teuthology.orchestra.run.smithi153.stderr: 38400K .......... .......... .......... .......... .......... 41% 47.0M 0s 2024-09-19T14:14:28.112 INFO:teuthology.orchestra.run.smithi153.stderr: 38450K .......... .......... .......... .......... .......... 41% 287M 0s 2024-09-19T14:14:28.112 INFO:teuthology.orchestra.run.smithi153.stderr: 38500K .......... .......... .......... .......... .......... 41% 259M 0s 2024-09-19T14:14:28.112 INFO:teuthology.orchestra.run.smithi153.stderr: 38550K .......... .......... .......... .......... .......... 41% 328M 0s 2024-09-19T14:14:28.112 INFO:teuthology.orchestra.run.smithi153.stderr: 38600K .......... .......... .......... .......... .......... 41% 262M 0s 2024-09-19T14:14:28.112 INFO:teuthology.orchestra.run.smithi153.stderr: 38650K .......... .......... .......... .......... .......... 41% 295M 0s 2024-09-19T14:14:28.113 INFO:teuthology.orchestra.run.smithi153.stderr: 38700K .......... .......... .......... .......... .......... 41% 282M 0s 2024-09-19T14:14:28.113 INFO:teuthology.orchestra.run.smithi153.stderr: 38750K .......... .......... .......... .......... .......... 41% 326M 0s 2024-09-19T14:14:28.113 INFO:teuthology.orchestra.run.smithi153.stderr: 38800K .......... .......... .......... .......... .......... 41% 325M 0s 2024-09-19T14:14:28.113 INFO:teuthology.orchestra.run.smithi153.stderr: 38850K .......... .......... .......... .......... .......... 41% 329M 0s 2024-09-19T14:14:28.113 INFO:teuthology.orchestra.run.smithi153.stderr: 38900K .......... .......... .......... .......... .......... 41% 247M 0s 2024-09-19T14:14:28.113 INFO:teuthology.orchestra.run.smithi153.stderr: 38950K .......... .......... .......... .......... .......... 41% 303M 0s 2024-09-19T14:14:28.113 INFO:teuthology.orchestra.run.smithi153.stderr: 39000K .......... .......... .......... .......... .......... 42% 303M 0s 2024-09-19T14:14:28.113 INFO:teuthology.orchestra.run.smithi153.stderr: 39050K .......... .......... .......... .......... .......... 42% 291M 0s 2024-09-19T14:14:28.113 INFO:teuthology.orchestra.run.smithi153.stderr: 39100K .......... .......... .......... .......... .......... 42% 289M 0s 2024-09-19T14:14:28.113 INFO:teuthology.orchestra.run.smithi153.stderr: 39150K .......... .......... .......... .......... .......... 42% 331M 0s 2024-09-19T14:14:28.113 INFO:teuthology.orchestra.run.smithi153.stderr: 39200K .......... .......... .......... .......... .......... 42% 325M 0s 2024-09-19T14:14:28.113 INFO:teuthology.orchestra.run.smithi153.stderr: 39250K .......... .......... .......... .......... .......... 42% 336M 0s 2024-09-19T14:14:28.113 INFO:teuthology.orchestra.run.smithi153.stderr: 39300K .......... .......... .......... .......... .......... 42% 78.3M 0s 2024-09-19T14:14:28.114 INFO:teuthology.orchestra.run.smithi153.stderr: 39350K .......... .......... .......... .......... .......... 42% 310M 0s 2024-09-19T14:14:28.114 INFO:teuthology.orchestra.run.smithi153.stderr: 39400K .......... .......... .......... .......... .......... 42% 301M 0s 2024-09-19T14:14:28.114 INFO:teuthology.orchestra.run.smithi153.stderr: 39450K .......... .......... .......... .......... .......... 42% 317M 0s 2024-09-19T14:14:28.114 INFO:teuthology.orchestra.run.smithi153.stderr: 39500K .......... .......... .......... .......... .......... 42% 300M 0s 2024-09-19T14:14:28.114 INFO:teuthology.orchestra.run.smithi153.stderr: 39550K .......... .......... .......... .......... .......... 42% 300M 0s 2024-09-19T14:14:28.114 INFO:teuthology.orchestra.run.smithi153.stderr: 39600K .......... .......... .......... .......... .......... 42% 319M 0s 2024-09-19T14:14:28.114 INFO:teuthology.orchestra.run.smithi153.stderr: 39650K .......... .......... .......... .......... .......... 42% 329M 0s 2024-09-19T14:14:28.114 INFO:teuthology.orchestra.run.smithi153.stderr: 39700K .......... .......... .......... .......... .......... 42% 219M 0s 2024-09-19T14:14:28.114 INFO:teuthology.orchestra.run.smithi153.stderr: 39750K .......... .......... .......... .......... .......... 42% 312M 0s 2024-09-19T14:14:28.114 INFO:teuthology.orchestra.run.smithi153.stderr: 39800K .......... .......... .......... .......... .......... 42% 336M 0s 2024-09-19T14:14:28.114 INFO:teuthology.orchestra.run.smithi153.stderr: 39850K .......... .......... .......... .......... .......... 42% 323M 0s 2024-09-19T14:14:28.114 INFO:teuthology.orchestra.run.smithi153.stderr: 39900K .......... .......... .......... .......... .......... 43% 306M 0s 2024-09-19T14:14:28.114 INFO:teuthology.orchestra.run.smithi153.stderr: 39950K .......... .......... .......... .......... .......... 43% 309M 0s 2024-09-19T14:14:28.114 INFO:teuthology.orchestra.run.smithi153.stderr: 40000K .......... .......... .......... .......... .......... 43% 317M 0s 2024-09-19T14:14:28.115 INFO:teuthology.orchestra.run.smithi153.stderr: 40050K .......... .......... .......... .......... .......... 43% 342M 0s 2024-09-19T14:14:28.115 INFO:teuthology.orchestra.run.smithi153.stderr: 40100K .......... .......... .......... .......... .......... 43% 270M 0s 2024-09-19T14:14:28.115 INFO:teuthology.orchestra.run.smithi153.stderr: 40150K .......... .......... .......... .......... .......... 43% 322M 0s 2024-09-19T14:14:28.115 INFO:teuthology.orchestra.run.smithi153.stderr: 40200K .......... .......... .......... .......... .......... 43% 331M 0s 2024-09-19T14:14:28.115 INFO:teuthology.orchestra.run.smithi153.stderr: 40250K .......... .......... .......... .......... .......... 43% 338M 0s 2024-09-19T14:14:28.115 INFO:teuthology.orchestra.run.smithi153.stderr: 40300K .......... .......... .......... .......... .......... 43% 274M 0s 2024-09-19T14:14:28.115 INFO:teuthology.orchestra.run.smithi153.stderr: 40350K .......... .......... .......... .......... .......... 43% 329M 0s 2024-09-19T14:14:28.115 INFO:teuthology.orchestra.run.smithi153.stderr: 40400K .......... .......... .......... .......... .......... 43% 272M 0s 2024-09-19T14:14:28.115 INFO:teuthology.orchestra.run.smithi153.stderr: 40450K .......... .......... .......... .......... .......... 43% 294M 0s 2024-09-19T14:14:28.115 INFO:teuthology.orchestra.run.smithi153.stderr: 40500K .......... .......... .......... .......... .......... 43% 276M 0s 2024-09-19T14:14:28.115 INFO:teuthology.orchestra.run.smithi153.stderr: 40550K .......... .......... .......... .......... .......... 43% 320M 0s 2024-09-19T14:14:28.115 INFO:teuthology.orchestra.run.smithi153.stderr: 40600K .......... .......... .......... .......... .......... 43% 300M 0s 2024-09-19T14:14:28.115 INFO:teuthology.orchestra.run.smithi153.stderr: 40650K .......... .......... .......... .......... .......... 43% 340M 0s 2024-09-19T14:14:28.115 INFO:teuthology.orchestra.run.smithi153.stderr: 40700K .......... .......... .......... .......... .......... 43% 281M 0s 2024-09-19T14:14:28.115 INFO:teuthology.orchestra.run.smithi153.stderr: 40750K .......... .......... .......... .......... .......... 43% 252M 0s 2024-09-19T14:14:28.116 INFO:teuthology.orchestra.run.smithi153.stderr: 40800K .......... .......... .......... .......... .......... 43% 91.7M 0s 2024-09-19T14:14:28.116 INFO:teuthology.orchestra.run.smithi153.stderr: 40850K .......... .......... .......... .......... .......... 44% 175M 0s 2024-09-19T14:14:28.116 INFO:teuthology.orchestra.run.smithi153.stderr: 40900K .......... .......... .......... .......... .......... 44% 314M 0s 2024-09-19T14:14:28.116 INFO:teuthology.orchestra.run.smithi153.stderr: 40950K .......... .......... .......... .......... .......... 44% 358M 0s 2024-09-19T14:14:28.116 INFO:teuthology.orchestra.run.smithi153.stderr: 41000K .......... .......... .......... .......... .......... 44% 315M 0s 2024-09-19T14:14:28.116 INFO:teuthology.orchestra.run.smithi153.stderr: 41050K .......... .......... .......... .......... .......... 44% 239M 0s 2024-09-19T14:14:28.116 INFO:teuthology.orchestra.run.smithi153.stderr: 41100K .......... .......... .......... .......... .......... 44% 276M 0s 2024-09-19T14:14:28.116 INFO:teuthology.orchestra.run.smithi153.stderr: 41150K .......... .......... .......... .......... .......... 44% 352M 0s 2024-09-19T14:14:28.116 INFO:teuthology.orchestra.run.smithi153.stderr: 41200K .......... .......... .......... .......... .......... 44% 249M 0s 2024-09-19T14:14:28.116 INFO:teuthology.orchestra.run.smithi153.stderr: 41250K .......... .......... .......... .......... .......... 44% 311M 0s 2024-09-19T14:14:28.116 INFO:teuthology.orchestra.run.smithi153.stderr: 41300K .......... .......... .......... .......... .......... 44% 201M 0s 2024-09-19T14:14:28.116 INFO:teuthology.orchestra.run.smithi153.stderr: 41350K .......... .......... .......... .......... .......... 44% 316M 0s 2024-09-19T14:14:28.116 INFO:teuthology.orchestra.run.smithi153.stderr: 41400K .......... .......... .......... .......... .......... 44% 51.8M 0s 2024-09-19T14:14:28.117 INFO:teuthology.orchestra.run.smithi153.stderr: 41450K .......... .......... .......... .......... .......... 44% 126M 0s 2024-09-19T14:14:28.117 INFO:teuthology.orchestra.run.smithi153.stderr: 41500K .......... .......... .......... .......... .......... 44% 250M 0s 2024-09-19T14:14:28.117 INFO:teuthology.orchestra.run.smithi153.stderr: 41550K .......... .......... .......... .......... .......... 44% 289M 0s 2024-09-19T14:14:28.117 INFO:teuthology.orchestra.run.smithi153.stderr: 41600K .......... .......... .......... .......... .......... 44% 338M 0s 2024-09-19T14:14:28.117 INFO:teuthology.orchestra.run.smithi153.stderr: 41650K .......... .......... .......... .......... .......... 44% 300M 0s 2024-09-19T14:14:28.117 INFO:teuthology.orchestra.run.smithi153.stderr: 41700K .......... .......... .......... .......... .......... 44% 290M 0s 2024-09-19T14:14:28.117 INFO:teuthology.orchestra.run.smithi153.stderr: 41750K .......... .......... .......... .......... .......... 44% 307M 0s 2024-09-19T14:14:28.117 INFO:teuthology.orchestra.run.smithi153.stderr: 41800K .......... .......... .......... .......... .......... 45% 317M 0s 2024-09-19T14:14:28.117 INFO:teuthology.orchestra.run.smithi153.stderr: 41850K .......... .......... .......... .......... .......... 45% 334M 0s 2024-09-19T14:14:28.117 INFO:teuthology.orchestra.run.smithi153.stderr: 41900K .......... .......... .......... .......... .......... 45% 252M 0s 2024-09-19T14:14:28.117 INFO:teuthology.orchestra.run.smithi153.stderr: 41950K .......... .......... .......... .......... .......... 45% 121M 0s 2024-09-19T14:14:28.117 INFO:teuthology.orchestra.run.smithi153.stderr: 42000K .......... .......... .......... .......... .......... 45% 299M 0s 2024-09-19T14:14:28.117 INFO:teuthology.orchestra.run.smithi153.stderr: 42050K .......... .......... .......... .......... .......... 45% 300M 0s 2024-09-19T14:14:28.117 INFO:teuthology.orchestra.run.smithi153.stderr: 42100K .......... .......... .......... .......... .......... 45% 299M 0s 2024-09-19T14:14:28.118 INFO:teuthology.orchestra.run.smithi153.stderr: 42150K .......... .......... .......... .......... .......... 45% 345M 0s 2024-09-19T14:14:28.118 INFO:teuthology.orchestra.run.smithi153.stderr: 42200K .......... .......... .......... .......... .......... 45% 153M 0s 2024-09-19T14:14:28.118 INFO:teuthology.orchestra.run.smithi153.stderr: 42250K .......... .......... .......... .......... .......... 45% 292M 0s 2024-09-19T14:14:28.118 INFO:teuthology.orchestra.run.smithi153.stderr: 42300K .......... .......... .......... .......... .......... 45% 278M 0s 2024-09-19T14:14:28.118 INFO:teuthology.orchestra.run.smithi153.stderr: 42350K .......... .......... .......... .......... .......... 45% 316M 0s 2024-09-19T14:14:28.118 INFO:teuthology.orchestra.run.smithi153.stderr: 42400K .......... .......... .......... .......... .......... 45% 327M 0s 2024-09-19T14:14:28.118 INFO:teuthology.orchestra.run.smithi153.stderr: 42450K .......... .......... .......... .......... .......... 45% 313M 0s 2024-09-19T14:14:28.118 INFO:teuthology.orchestra.run.smithi153.stderr: 42500K .......... .......... .......... .......... .......... 45% 306M 0s 2024-09-19T14:14:28.118 INFO:teuthology.orchestra.run.smithi153.stderr: 42550K .......... .......... .......... .......... .......... 45% 320M 0s 2024-09-19T14:14:28.118 INFO:teuthology.orchestra.run.smithi153.stderr: 42600K .......... .......... .......... .......... .......... 45% 308M 0s 2024-09-19T14:14:28.118 INFO:teuthology.orchestra.run.smithi153.stderr: 42650K .......... .......... .......... .......... .......... 45% 325M 0s 2024-09-19T14:14:28.118 INFO:teuthology.orchestra.run.smithi153.stderr: 42700K .......... .......... .......... .......... .......... 46% 215M 0s 2024-09-19T14:14:28.118 INFO:teuthology.orchestra.run.smithi153.stderr: 42750K .......... .......... .......... .......... .......... 46% 296M 0s 2024-09-19T14:14:28.118 INFO:teuthology.orchestra.run.smithi153.stderr: 42800K .......... .......... .......... .......... .......... 46% 339M 0s 2024-09-19T14:14:28.119 INFO:teuthology.orchestra.run.smithi153.stderr: 42850K .......... .......... .......... .......... .......... 46% 187M 0s 2024-09-19T14:14:28.119 INFO:teuthology.orchestra.run.smithi153.stderr: 42900K .......... .......... .......... .......... .......... 46% 272M 0s 2024-09-19T14:14:28.119 INFO:teuthology.orchestra.run.smithi153.stderr: 42950K .......... .......... .......... .......... .......... 46% 311M 0s 2024-09-19T14:14:28.119 INFO:teuthology.orchestra.run.smithi153.stderr: 43000K .......... .......... .......... .......... .......... 46% 356M 0s 2024-09-19T14:14:28.119 INFO:teuthology.orchestra.run.smithi153.stderr: 43050K .......... .......... .......... .......... .......... 46% 315M 0s 2024-09-19T14:14:28.119 INFO:teuthology.orchestra.run.smithi153.stderr: 43100K .......... .......... .......... .......... .......... 46% 263M 0s 2024-09-19T14:14:28.119 INFO:teuthology.orchestra.run.smithi153.stderr: 43150K .......... .......... .......... .......... .......... 46% 324M 0s 2024-09-19T14:14:28.119 INFO:teuthology.orchestra.run.smithi153.stderr: 43200K .......... .......... .......... .......... .......... 46% 338M 0s 2024-09-19T14:14:28.119 INFO:teuthology.orchestra.run.smithi153.stderr: 43250K .......... .......... .......... .......... .......... 46% 316M 0s 2024-09-19T14:14:28.119 INFO:teuthology.orchestra.run.smithi153.stderr: 43300K .......... .......... .......... .......... .......... 46% 308M 0s 2024-09-19T14:14:28.119 INFO:teuthology.orchestra.run.smithi153.stderr: 43350K .......... .......... .......... .......... .......... 46% 309M 0s 2024-09-19T14:14:28.119 INFO:teuthology.orchestra.run.smithi153.stderr: 43400K .......... .......... .......... .......... .......... 46% 315M 0s 2024-09-19T14:14:28.119 INFO:teuthology.orchestra.run.smithi153.stderr: 43450K .......... .......... .......... .......... .......... 46% 329M 0s 2024-09-19T14:14:28.119 INFO:teuthology.orchestra.run.smithi153.stderr: 43500K .......... .......... .......... .......... .......... 46% 263M 0s 2024-09-19T14:14:28.119 INFO:teuthology.orchestra.run.smithi153.stderr: 43550K .......... .......... .......... .......... .......... 46% 310M 0s 2024-09-19T14:14:28.119 INFO:teuthology.orchestra.run.smithi153.stderr: 43600K .......... .......... .......... .......... .......... 46% 334M 0s 2024-09-19T14:14:28.120 INFO:teuthology.orchestra.run.smithi153.stderr: 43650K .......... .......... .......... .......... .......... 47% 325M 0s 2024-09-19T14:14:28.120 INFO:teuthology.orchestra.run.smithi153.stderr: 43700K .......... .......... .......... .......... .......... 47% 309M 0s 2024-09-19T14:14:28.120 INFO:teuthology.orchestra.run.smithi153.stderr: 43750K .......... .......... .......... .......... .......... 47% 352M 0s 2024-09-19T14:14:28.120 INFO:teuthology.orchestra.run.smithi153.stderr: 43800K .......... .......... .......... .......... .......... 47% 265M 0s 2024-09-19T14:14:28.120 INFO:teuthology.orchestra.run.smithi153.stderr: 43850K .......... .......... .......... .......... .......... 47% 74.6M 0s 2024-09-19T14:14:28.120 INFO:teuthology.orchestra.run.smithi153.stderr: 43900K .......... .......... .......... .......... .......... 47% 242M 0s 2024-09-19T14:14:28.120 INFO:teuthology.orchestra.run.smithi153.stderr: 43950K .......... .......... .......... .......... .......... 47% 318M 0s 2024-09-19T14:14:28.120 INFO:teuthology.orchestra.run.smithi153.stderr: 44000K .......... .......... .......... .......... .......... 47% 348M 0s 2024-09-19T14:14:28.120 INFO:teuthology.orchestra.run.smithi153.stderr: 44050K .......... .......... .......... .......... .......... 47% 347M 0s 2024-09-19T14:14:28.120 INFO:teuthology.orchestra.run.smithi153.stderr: 44100K .......... .......... .......... .......... .......... 47% 265M 0s 2024-09-19T14:14:28.120 INFO:teuthology.orchestra.run.smithi153.stderr: 44150K .......... .......... .......... .......... .......... 47% 298M 0s 2024-09-19T14:14:28.120 INFO:teuthology.orchestra.run.smithi153.stderr: 44200K .......... .......... .......... .......... .......... 47% 330M 0s 2024-09-19T14:14:28.120 INFO:teuthology.orchestra.run.smithi153.stderr: 44250K .......... .......... .......... .......... .......... 47% 320M 0s 2024-09-19T14:14:28.121 INFO:teuthology.orchestra.run.smithi153.stderr: 44300K .......... .......... .......... .......... .......... 47% 281M 0s 2024-09-19T14:14:28.121 INFO:teuthology.orchestra.run.smithi153.stderr: 44350K .......... .......... .......... .......... .......... 47% 60.2M 0s 2024-09-19T14:14:28.121 INFO:teuthology.orchestra.run.smithi153.stderr: 44400K .......... .......... .......... .......... .......... 47% 272M 0s 2024-09-19T14:14:28.121 INFO:teuthology.orchestra.run.smithi153.stderr: 44450K .......... .......... .......... .......... .......... 47% 125M 0s 2024-09-19T14:14:28.121 INFO:teuthology.orchestra.run.smithi153.stderr: 44500K .......... .......... .......... .......... .......... 47% 92.7M 0s 2024-09-19T14:14:28.121 INFO:teuthology.orchestra.run.smithi153.stderr: 44550K .......... .......... .......... .......... .......... 48% 180M 0s 2024-09-19T14:14:28.121 INFO:teuthology.orchestra.run.smithi153.stderr: 44600K .......... .......... .......... .......... .......... 48% 240M 0s 2024-09-19T14:14:28.121 INFO:teuthology.orchestra.run.smithi153.stderr: 44650K .......... .......... .......... .......... .......... 48% 277M 0s 2024-09-19T14:14:28.121 INFO:teuthology.orchestra.run.smithi153.stderr: 44700K .......... .......... .......... .......... .......... 48% 253M 0s 2024-09-19T14:14:28.121 INFO:teuthology.orchestra.run.smithi153.stderr: 44750K .......... .......... .......... .......... .......... 48% 323M 0s 2024-09-19T14:14:28.121 INFO:teuthology.orchestra.run.smithi153.stderr: 44800K .......... .......... .......... .......... .......... 48% 321M 0s 2024-09-19T14:14:28.121 INFO:teuthology.orchestra.run.smithi153.stderr: 44850K .......... .......... .......... .......... .......... 48% 328M 0s 2024-09-19T14:14:28.122 INFO:teuthology.orchestra.run.smithi153.stderr: 44900K .......... .......... .......... .......... .......... 48% 286M 0s 2024-09-19T14:14:28.122 INFO:teuthology.orchestra.run.smithi153.stderr: 44950K .......... .......... .......... .......... .......... 48% 328M 0s 2024-09-19T14:14:28.122 INFO:teuthology.orchestra.run.smithi153.stderr: 45000K .......... .......... .......... .......... .......... 48% 326M 0s 2024-09-19T14:14:28.122 INFO:teuthology.orchestra.run.smithi153.stderr: 45050K .......... .......... .......... .......... .......... 48% 302M 0s 2024-09-19T14:14:28.122 INFO:teuthology.orchestra.run.smithi153.stderr: 45100K .......... .......... .......... .......... .......... 48% 136M 0s 2024-09-19T14:14:28.122 INFO:teuthology.orchestra.run.smithi153.stderr: 45150K .......... .......... .......... .......... .......... 48% 234M 0s 2024-09-19T14:14:28.122 INFO:teuthology.orchestra.run.smithi153.stderr: 45200K .......... .......... .......... .......... .......... 48% 325M 0s 2024-09-19T14:14:28.122 INFO:teuthology.orchestra.run.smithi153.stderr: 45250K .......... .......... .......... .......... .......... 48% 330M 0s 2024-09-19T14:14:28.122 INFO:teuthology.orchestra.run.smithi153.stderr: 45300K .......... .......... .......... .......... .......... 48% 291M 0s 2024-09-19T14:14:28.122 INFO:teuthology.orchestra.run.smithi153.stderr: 45350K .......... .......... .......... .......... .......... 48% 305M 0s 2024-09-19T14:14:28.122 INFO:teuthology.orchestra.run.smithi153.stderr: 45400K .......... .......... .......... .......... .......... 48% 338M 0s 2024-09-19T14:14:28.122 INFO:teuthology.orchestra.run.smithi153.stderr: 45450K .......... .......... .......... .......... .......... 48% 343M 0s 2024-09-19T14:14:28.122 INFO:teuthology.orchestra.run.smithi153.stderr: 45500K .......... .......... .......... .......... .......... 49% 279M 0s 2024-09-19T14:14:28.122 INFO:teuthology.orchestra.run.smithi153.stderr: 45550K .......... .......... .......... .......... .......... 49% 343M 0s 2024-09-19T14:14:28.123 INFO:teuthology.orchestra.run.smithi153.stderr: 45600K .......... .......... .......... .......... .......... 49% 352M 0s 2024-09-19T14:14:28.123 INFO:teuthology.orchestra.run.smithi153.stderr: 45650K .......... .......... .......... .......... .......... 49% 164M 0s 2024-09-19T14:14:28.123 INFO:teuthology.orchestra.run.smithi153.stderr: 45700K .......... .......... .......... .......... .......... 49% 281M 0s 2024-09-19T14:14:28.123 INFO:teuthology.orchestra.run.smithi153.stderr: 45750K .......... .......... .......... .......... .......... 49% 308M 0s 2024-09-19T14:14:28.123 INFO:teuthology.orchestra.run.smithi153.stderr: 45800K .......... .......... .......... .......... .......... 49% 304M 0s 2024-09-19T14:14:28.123 INFO:teuthology.orchestra.run.smithi153.stderr: 45850K .......... .......... .......... .......... .......... 49% 333M 0s 2024-09-19T14:14:28.123 INFO:teuthology.orchestra.run.smithi153.stderr: 45900K .......... .......... .......... .......... .......... 49% 287M 0s 2024-09-19T14:14:28.123 INFO:teuthology.orchestra.run.smithi153.stderr: 45950K .......... .......... .......... .......... .......... 49% 310M 0s 2024-09-19T14:14:28.123 INFO:teuthology.orchestra.run.smithi153.stderr: 46000K .......... .......... .......... .......... .......... 49% 346M 0s 2024-09-19T14:14:28.123 INFO:teuthology.orchestra.run.smithi153.stderr: 46050K .......... .......... .......... .......... .......... 49% 352M 0s 2024-09-19T14:14:28.123 INFO:teuthology.orchestra.run.smithi153.stderr: 46100K .......... .......... .......... .......... .......... 49% 298M 0s 2024-09-19T14:14:28.123 INFO:teuthology.orchestra.run.smithi153.stderr: 46150K .......... .......... .......... .......... .......... 49% 311M 0s 2024-09-19T14:14:28.123 INFO:teuthology.orchestra.run.smithi153.stderr: 46200K .......... .......... .......... .......... .......... 49% 256M 0s 2024-09-19T14:14:28.123 INFO:teuthology.orchestra.run.smithi153.stderr: 46250K .......... .......... .......... .......... .......... 49% 331M 0s 2024-09-19T14:14:28.124 INFO:teuthology.orchestra.run.smithi153.stderr: 46300K .......... .......... .......... .......... .......... 49% 158M 0s 2024-09-19T14:14:28.124 INFO:teuthology.orchestra.run.smithi153.stderr: 46350K .......... .......... .......... .......... .......... 49% 336M 0s 2024-09-19T14:14:28.124 INFO:teuthology.orchestra.run.smithi153.stderr: 46400K .......... .......... .......... .......... .......... 49% 343M 0s 2024-09-19T14:14:28.124 INFO:teuthology.orchestra.run.smithi153.stderr: 46450K .......... .......... .......... .......... .......... 50% 171M 0s 2024-09-19T14:14:28.124 INFO:teuthology.orchestra.run.smithi153.stderr: 46500K .......... .......... .......... .......... .......... 50% 277M 0s 2024-09-19T14:14:28.124 INFO:teuthology.orchestra.run.smithi153.stderr: 46550K .......... .......... .......... .......... .......... 50% 345M 0s 2024-09-19T14:14:28.124 INFO:teuthology.orchestra.run.smithi153.stderr: 46600K .......... .......... .......... .......... .......... 50% 321M 0s 2024-09-19T14:14:28.124 INFO:teuthology.orchestra.run.smithi153.stderr: 46650K .......... .......... .......... .......... .......... 50% 354M 0s 2024-09-19T14:14:28.124 INFO:teuthology.orchestra.run.smithi153.stderr: 46700K .......... .......... .......... .......... .......... 50% 81.3M 0s 2024-09-19T14:14:28.124 INFO:teuthology.orchestra.run.smithi153.stderr: 46750K .......... .......... .......... .......... .......... 50% 253M 0s 2024-09-19T14:14:28.124 INFO:teuthology.orchestra.run.smithi153.stderr: 46800K .......... .......... .......... .......... .......... 50% 338M 0s 2024-09-19T14:14:28.124 INFO:teuthology.orchestra.run.smithi153.stderr: 46850K .......... .......... .......... .......... .......... 50% 304M 0s 2024-09-19T14:14:28.124 INFO:teuthology.orchestra.run.smithi153.stderr: 46900K .......... .......... .......... .......... .......... 50% 308M 0s 2024-09-19T14:14:28.124 INFO:teuthology.orchestra.run.smithi153.stderr: 46950K .......... .......... .......... .......... .......... 50% 330M 0s 2024-09-19T14:14:28.124 INFO:teuthology.orchestra.run.smithi153.stderr: 47000K .......... .......... .......... .......... .......... 50% 331M 0s 2024-09-19T14:14:28.125 INFO:teuthology.orchestra.run.smithi153.stderr: 47050K .......... .......... .......... .......... .......... 50% 332M 0s 2024-09-19T14:14:28.125 INFO:teuthology.orchestra.run.smithi153.stderr: 47100K .......... .......... .......... .......... .......... 50% 284M 0s 2024-09-19T14:14:28.125 INFO:teuthology.orchestra.run.smithi153.stderr: 47150K .......... .......... .......... .......... .......... 50% 308M 0s 2024-09-19T14:14:28.125 INFO:teuthology.orchestra.run.smithi153.stderr: 47200K .......... .......... .......... .......... .......... 50% 329M 0s 2024-09-19T14:14:28.125 INFO:teuthology.orchestra.run.smithi153.stderr: 47250K .......... .......... .......... .......... .......... 50% 352M 0s 2024-09-19T14:14:28.125 INFO:teuthology.orchestra.run.smithi153.stderr: 47300K .......... .......... .......... .......... .......... 50% 313M 0s 2024-09-19T14:14:28.125 INFO:teuthology.orchestra.run.smithi153.stderr: 47350K .......... .......... .......... .......... .......... 51% 151M 0s 2024-09-19T14:14:28.125 INFO:teuthology.orchestra.run.smithi153.stderr: 47400K .......... .......... .......... .......... .......... 51% 271M 0s 2024-09-19T14:14:28.125 INFO:teuthology.orchestra.run.smithi153.stderr: 47450K .......... .......... .......... .......... .......... 51% 97.6M 0s 2024-09-19T14:14:28.125 INFO:teuthology.orchestra.run.smithi153.stderr: 47500K .......... .......... .......... .......... .......... 51% 54.9M 0s 2024-09-19T14:14:28.125 INFO:teuthology.orchestra.run.smithi153.stderr: 47550K .......... .......... .......... .......... .......... 51% 72.9M 0s 2024-09-19T14:14:28.125 INFO:teuthology.orchestra.run.smithi153.stderr: 47600K .......... .......... .......... .......... .......... 51% 329M 0s 2024-09-19T14:14:28.125 INFO:teuthology.orchestra.run.smithi153.stderr: 47650K .......... .......... .......... .......... .......... 51% 301M 0s 2024-09-19T14:14:28.125 INFO:teuthology.orchestra.run.smithi153.stderr: 47700K .......... .......... .......... .......... .......... 51% 305M 0s 2024-09-19T14:14:28.126 INFO:teuthology.orchestra.run.smithi153.stderr: 47750K .......... .......... .......... .......... .......... 51% 319M 0s 2024-09-19T14:14:28.126 INFO:teuthology.orchestra.run.smithi153.stderr: 47800K .......... .......... .......... .......... .......... 51% 335M 0s 2024-09-19T14:14:28.126 INFO:teuthology.orchestra.run.smithi153.stderr: 47850K .......... .......... .......... .......... .......... 51% 341M 0s 2024-09-19T14:14:28.126 INFO:teuthology.orchestra.run.smithi153.stderr: 47900K .......... .......... .......... .......... .......... 51% 278M 0s 2024-09-19T14:14:28.126 INFO:teuthology.orchestra.run.smithi153.stderr: 47950K .......... .......... .......... .......... .......... 51% 291M 0s 2024-09-19T14:14:28.126 INFO:teuthology.orchestra.run.smithi153.stderr: 48000K .......... .......... .......... .......... .......... 51% 327M 0s 2024-09-19T14:14:28.126 INFO:teuthology.orchestra.run.smithi153.stderr: 48050K .......... .......... .......... .......... .......... 51% 355M 0s 2024-09-19T14:14:28.126 INFO:teuthology.orchestra.run.smithi153.stderr: 48100K .......... .......... .......... .......... .......... 51% 290M 0s 2024-09-19T14:14:28.126 INFO:teuthology.orchestra.run.smithi153.stderr: 48150K .......... .......... .......... .......... .......... 51% 330M 0s 2024-09-19T14:14:28.126 INFO:teuthology.orchestra.run.smithi153.stderr: 48200K .......... .......... .......... .......... .......... 51% 329M 0s 2024-09-19T14:14:28.126 INFO:teuthology.orchestra.run.smithi153.stderr: 48250K .......... .......... .......... .......... .......... 51% 307M 0s 2024-09-19T14:14:28.126 INFO:teuthology.orchestra.run.smithi153.stderr: 48300K .......... .......... .......... .......... .......... 52% 303M 0s 2024-09-19T14:14:28.126 INFO:teuthology.orchestra.run.smithi153.stderr: 48350K .......... .......... .......... .......... .......... 52% 327M 0s 2024-09-19T14:14:28.126 INFO:teuthology.orchestra.run.smithi153.stderr: 48400K .......... .......... .......... .......... .......... 52% 343M 0s 2024-09-19T14:14:28.126 INFO:teuthology.orchestra.run.smithi153.stderr: 48450K .......... .......... .......... .......... .......... 52% 341M 0s 2024-09-19T14:14:28.126 INFO:teuthology.orchestra.run.smithi153.stderr: 48500K .......... .......... .......... .......... .......... 52% 324M 0s 2024-09-19T14:14:28.127 INFO:teuthology.orchestra.run.smithi153.stderr: 48550K .......... .......... .......... .......... .......... 52% 313M 0s 2024-09-19T14:14:28.127 INFO:teuthology.orchestra.run.smithi153.stderr: 48600K .......... .......... .......... .......... .......... 52% 344M 0s 2024-09-19T14:14:28.127 INFO:teuthology.orchestra.run.smithi153.stderr: 48650K .......... .......... .......... .......... .......... 52% 336M 0s 2024-09-19T14:14:28.127 INFO:teuthology.orchestra.run.smithi153.stderr: 48700K .......... .......... .......... .......... .......... 52% 275M 0s 2024-09-19T14:14:28.127 INFO:teuthology.orchestra.run.smithi153.stderr: 48750K .......... .......... .......... .......... .......... 52% 354M 0s 2024-09-19T14:14:28.127 INFO:teuthology.orchestra.run.smithi153.stderr: 48800K .......... .......... .......... .......... .......... 52% 311M 0s 2024-09-19T14:14:28.127 INFO:teuthology.orchestra.run.smithi153.stderr: 48850K .......... .......... .......... .......... .......... 52% 322M 0s 2024-09-19T14:14:28.127 INFO:teuthology.orchestra.run.smithi153.stderr: 48900K .......... .......... .......... .......... .......... 52% 298M 0s 2024-09-19T14:14:28.127 INFO:teuthology.orchestra.run.smithi153.stderr: 48950K .......... .......... .......... .......... .......... 52% 329M 0s 2024-09-19T14:14:28.127 INFO:teuthology.orchestra.run.smithi153.stderr: 49000K .......... .......... .......... .......... .......... 52% 335M 0s 2024-09-19T14:14:28.127 INFO:teuthology.orchestra.run.smithi153.stderr: 49050K .......... .......... .......... .......... .......... 52% 337M 0s 2024-09-19T14:14:28.127 INFO:teuthology.orchestra.run.smithi153.stderr: 49100K .......... .......... .......... .......... .......... 52% 209M 0s 2024-09-19T14:14:28.127 INFO:teuthology.orchestra.run.smithi153.stderr: 49150K .......... .......... .......... .......... .......... 52% 341M 0s 2024-09-19T14:14:28.127 INFO:teuthology.orchestra.run.smithi153.stderr: 49200K .......... .......... .......... .......... .......... 53% 336M 0s 2024-09-19T14:14:28.127 INFO:teuthology.orchestra.run.smithi153.stderr: 49250K .......... .......... .......... .......... .......... 53% 291M 0s 2024-09-19T14:14:28.127 INFO:teuthology.orchestra.run.smithi153.stderr: 49300K .......... .......... .......... .......... .......... 53% 320M 0s 2024-09-19T14:14:28.128 INFO:teuthology.orchestra.run.smithi153.stderr: 49350K .......... .......... .......... .......... .......... 53% 205M 0s 2024-09-19T14:14:28.128 INFO:teuthology.orchestra.run.smithi153.stderr: 49400K .......... .......... .......... .......... .......... 53% 105M 0s 2024-09-19T14:14:28.128 INFO:teuthology.orchestra.run.smithi153.stderr: 49450K .......... .......... .......... .......... .......... 53% 339M 0s 2024-09-19T14:14:28.128 INFO:teuthology.orchestra.run.smithi153.stderr: 49500K .......... .......... .......... .......... .......... 53% 275M 0s 2024-09-19T14:14:28.128 INFO:teuthology.orchestra.run.smithi153.stderr: 49550K .......... .......... .......... .......... .......... 53% 336M 0s 2024-09-19T14:14:28.128 INFO:teuthology.orchestra.run.smithi153.stderr: 49600K .......... .......... .......... .......... .......... 53% 360M 0s 2024-09-19T14:14:28.128 INFO:teuthology.orchestra.run.smithi153.stderr: 49650K .......... .......... .......... .......... .......... 53% 106M 0s 2024-09-19T14:14:28.128 INFO:teuthology.orchestra.run.smithi153.stderr: 49700K .......... .......... .......... .......... .......... 53% 300M 0s 2024-09-19T14:14:28.128 INFO:teuthology.orchestra.run.smithi153.stderr: 49750K .......... .......... .......... .......... .......... 53% 360M 0s 2024-09-19T14:14:28.128 INFO:teuthology.orchestra.run.smithi153.stderr: 49800K .......... .......... .......... .......... .......... 53% 341M 0s 2024-09-19T14:14:28.128 INFO:teuthology.orchestra.run.smithi153.stderr: 49850K .......... .......... .......... .......... .......... 53% 341M 0s 2024-09-19T14:14:28.128 INFO:teuthology.orchestra.run.smithi153.stderr: 49900K .......... .......... .......... .......... .......... 53% 278M 0s 2024-09-19T14:14:28.128 INFO:teuthology.orchestra.run.smithi153.stderr: 49950K .......... .......... .......... .......... .......... 53% 271M 0s 2024-09-19T14:14:28.129 INFO:teuthology.orchestra.run.smithi153.stderr: 50000K .......... .......... .......... .......... .......... 53% 330M 0s 2024-09-19T14:14:28.129 INFO:teuthology.orchestra.run.smithi153.stderr: 50050K .......... .......... .......... .......... .......... 53% 363M 0s 2024-09-19T14:14:28.129 INFO:teuthology.orchestra.run.smithi153.stderr: 50100K .......... .......... .......... .......... .......... 53% 288M 0s 2024-09-19T14:14:28.129 INFO:teuthology.orchestra.run.smithi153.stderr: 50150K .......... .......... .......... .......... .......... 54% 307M 0s 2024-09-19T14:14:28.129 INFO:teuthology.orchestra.run.smithi153.stderr: 50200K .......... .......... .......... .......... .......... 54% 340M 0s 2024-09-19T14:14:28.129 INFO:teuthology.orchestra.run.smithi153.stderr: 50250K .......... .......... .......... .......... .......... 54% 356M 0s 2024-09-19T14:14:28.129 INFO:teuthology.orchestra.run.smithi153.stderr: 50300K .......... .......... .......... .......... .......... 54% 115M 0s 2024-09-19T14:14:28.129 INFO:teuthology.orchestra.run.smithi153.stderr: 50350K .......... .......... .......... .......... .......... 54% 340M 0s 2024-09-19T14:14:28.129 INFO:teuthology.orchestra.run.smithi153.stderr: 50400K .......... .......... .......... .......... .......... 54% 279M 0s 2024-09-19T14:14:28.129 INFO:teuthology.orchestra.run.smithi153.stderr: 50450K .......... .......... .......... .......... .......... 54% 54.0M 0s 2024-09-19T14:14:28.129 INFO:teuthology.orchestra.run.smithi153.stderr: 50500K .......... .......... .......... .......... .......... 54% 231M 0s 2024-09-19T14:14:28.129 INFO:teuthology.orchestra.run.smithi153.stderr: 50550K .......... .......... .......... .......... .......... 54% 70.8M 0s 2024-09-19T14:14:28.129 INFO:teuthology.orchestra.run.smithi153.stderr: 50600K .......... .......... .......... .......... .......... 54% 106M 0s 2024-09-19T14:14:28.129 INFO:teuthology.orchestra.run.smithi153.stderr: 50650K .......... .......... .......... .......... .......... 54% 317M 0s 2024-09-19T14:14:28.129 INFO:teuthology.orchestra.run.smithi153.stderr: 50700K .......... .......... .......... .......... .......... 54% 223M 0s 2024-09-19T14:14:28.129 INFO:teuthology.orchestra.run.smithi153.stderr: 50750K .......... .......... .......... .......... .......... 54% 306M 0s 2024-09-19T14:14:28.130 INFO:teuthology.orchestra.run.smithi153.stderr: 50800K .......... .......... .......... .......... .......... 54% 350M 0s 2024-09-19T14:14:28.130 INFO:teuthology.orchestra.run.smithi153.stderr: 50850K .......... .......... .......... .......... .......... 54% 357M 0s 2024-09-19T14:14:28.130 INFO:teuthology.orchestra.run.smithi153.stderr: 50900K .......... .......... .......... .......... .......... 54% 111M 0s 2024-09-19T14:14:28.130 INFO:teuthology.orchestra.run.smithi153.stderr: 50950K .......... .......... .......... .......... .......... 54% 216M 0s 2024-09-19T14:14:28.130 INFO:teuthology.orchestra.run.smithi153.stderr: 51000K .......... .......... .......... .......... .......... 54% 333M 0s 2024-09-19T14:14:28.130 INFO:teuthology.orchestra.run.smithi153.stderr: 51050K .......... .......... .......... .......... .......... 55% 308M 0s 2024-09-19T14:14:28.130 INFO:teuthology.orchestra.run.smithi153.stderr: 51100K .......... .......... .......... .......... .......... 55% 271M 0s 2024-09-19T14:14:28.130 INFO:teuthology.orchestra.run.smithi153.stderr: 51150K .......... .......... .......... .......... .......... 55% 342M 0s 2024-09-19T14:14:28.130 INFO:teuthology.orchestra.run.smithi153.stderr: 51200K .......... .......... .......... .......... .......... 55% 315M 0s 2024-09-19T14:14:28.130 INFO:teuthology.orchestra.run.smithi153.stderr: 51250K .......... .......... .......... .......... .......... 55% 403M 0s 2024-09-19T14:14:28.130 INFO:teuthology.orchestra.run.smithi153.stderr: 51300K .......... .......... .......... .......... .......... 55% 324M 0s 2024-09-19T14:14:28.130 INFO:teuthology.orchestra.run.smithi153.stderr: 51350K .......... .......... .......... .......... .......... 55% 352M 0s 2024-09-19T14:14:28.130 INFO:teuthology.orchestra.run.smithi153.stderr: 51400K .......... .......... .......... .......... .......... 55% 313M 0s 2024-09-19T14:14:28.130 INFO:teuthology.orchestra.run.smithi153.stderr: 51450K .......... .......... .......... .......... .......... 55% 330M 0s 2024-09-19T14:14:28.130 INFO:teuthology.orchestra.run.smithi153.stderr: 51500K .......... .......... .......... .......... .......... 55% 257M 0s 2024-09-19T14:14:28.131 INFO:teuthology.orchestra.run.smithi153.stderr: 51550K .......... .......... .......... .......... .......... 55% 312M 0s 2024-09-19T14:14:28.131 INFO:teuthology.orchestra.run.smithi153.stderr: 51600K .......... .......... .......... .......... .......... 55% 354M 0s 2024-09-19T14:14:28.131 INFO:teuthology.orchestra.run.smithi153.stderr: 51650K .......... .......... .......... .......... .......... 55% 339M 0s 2024-09-19T14:14:28.131 INFO:teuthology.orchestra.run.smithi153.stderr: 51700K .......... .......... .......... .......... .......... 55% 291M 0s 2024-09-19T14:14:28.131 INFO:teuthology.orchestra.run.smithi153.stderr: 51750K .......... .......... .......... .......... .......... 55% 331M 0s 2024-09-19T14:14:28.131 INFO:teuthology.orchestra.run.smithi153.stderr: 51800K .......... .......... .......... .......... .......... 55% 299M 0s 2024-09-19T14:14:28.131 INFO:teuthology.orchestra.run.smithi153.stderr: 51850K .......... .......... .......... .......... .......... 55% 338M 0s 2024-09-19T14:14:28.131 INFO:teuthology.orchestra.run.smithi153.stderr: 51900K .......... .......... .......... .......... .......... 55% 281M 0s 2024-09-19T14:14:28.131 INFO:teuthology.orchestra.run.smithi153.stderr: 51950K .......... .......... .......... .......... .......... 55% 311M 0s 2024-09-19T14:14:28.131 INFO:teuthology.orchestra.run.smithi153.stderr: 52000K .......... .......... .......... .......... .......... 56% 289M 0s 2024-09-19T14:14:28.131 INFO:teuthology.orchestra.run.smithi153.stderr: 52050K .......... .......... .......... .......... .......... 56% 355M 0s 2024-09-19T14:14:28.131 INFO:teuthology.orchestra.run.smithi153.stderr: 52100K .......... .......... .......... .......... .......... 56% 329M 0s 2024-09-19T14:14:28.131 INFO:teuthology.orchestra.run.smithi153.stderr: 52150K .......... .......... .......... .......... .......... 56% 316M 0s 2024-09-19T14:14:28.131 INFO:teuthology.orchestra.run.smithi153.stderr: 52200K .......... .......... .......... .......... .......... 56% 319M 0s 2024-09-19T14:14:28.131 INFO:teuthology.orchestra.run.smithi153.stderr: 52250K .......... .......... .......... .......... .......... 56% 358M 0s 2024-09-19T14:14:28.132 INFO:teuthology.orchestra.run.smithi153.stderr: 52300K .......... .......... .......... .......... .......... 56% 323M 0s 2024-09-19T14:14:28.132 INFO:teuthology.orchestra.run.smithi153.stderr: 52350K .......... .......... .......... .......... .......... 56% 351M 0s 2024-09-19T14:14:28.132 INFO:teuthology.orchestra.run.smithi153.stderr: 52400K .......... .......... .......... .......... .......... 56% 274M 0s 2024-09-19T14:14:28.132 INFO:teuthology.orchestra.run.smithi153.stderr: 52450K .......... .......... .......... .......... .......... 56% 320M 0s 2024-09-19T14:14:28.132 INFO:teuthology.orchestra.run.smithi153.stderr: 52500K .......... .......... .......... .......... .......... 56% 358M 0s 2024-09-19T14:14:28.132 INFO:teuthology.orchestra.run.smithi153.stderr: 52550K .......... .......... .......... .......... .......... 56% 117M 0s 2024-09-19T14:14:28.132 INFO:teuthology.orchestra.run.smithi153.stderr: 52600K .......... .......... .......... .......... .......... 56% 246M 0s 2024-09-19T14:14:28.132 INFO:teuthology.orchestra.run.smithi153.stderr: 52650K .......... .......... .......... .......... .......... 56% 336M 0s 2024-09-19T14:14:28.132 INFO:teuthology.orchestra.run.smithi153.stderr: 52700K .......... .......... .......... .......... .......... 56% 339M 0s 2024-09-19T14:14:28.132 INFO:teuthology.orchestra.run.smithi153.stderr: 52750K .......... .......... .......... .......... .......... 56% 330M 0s 2024-09-19T14:14:28.132 INFO:teuthology.orchestra.run.smithi153.stderr: 52800K .......... .......... .......... .......... .......... 56% 114M 0s 2024-09-19T14:14:28.132 INFO:teuthology.orchestra.run.smithi153.stderr: 52850K .......... .......... .......... .......... .......... 56% 306M 0s 2024-09-19T14:14:28.132 INFO:teuthology.orchestra.run.smithi153.stderr: 52900K .......... .......... .......... .......... .......... 56% 301M 0s 2024-09-19T14:14:28.132 INFO:teuthology.orchestra.run.smithi153.stderr: 52950K .......... .......... .......... .......... .......... 57% 322M 0s 2024-09-19T14:14:28.133 INFO:teuthology.orchestra.run.smithi153.stderr: 53000K .......... .......... .......... .......... .......... 57% 310M 0s 2024-09-19T14:14:28.133 INFO:teuthology.orchestra.run.smithi153.stderr: 53050K .......... .......... .......... .......... .......... 57% 347M 0s 2024-09-19T14:14:28.133 INFO:teuthology.orchestra.run.smithi153.stderr: 53100K .......... .......... .......... .......... .......... 57% 285M 0s 2024-09-19T14:14:28.133 INFO:teuthology.orchestra.run.smithi153.stderr: 53150K .......... .......... .......... .......... .......... 57% 363M 0s 2024-09-19T14:14:28.133 INFO:teuthology.orchestra.run.smithi153.stderr: 53200K .......... .......... .......... .......... .......... 57% 330M 0s 2024-09-19T14:14:28.133 INFO:teuthology.orchestra.run.smithi153.stderr: 53250K .......... .......... .......... .......... .......... 57% 343M 0s 2024-09-19T14:14:28.133 INFO:teuthology.orchestra.run.smithi153.stderr: 53300K .......... .......... .......... .......... .......... 57% 317M 0s 2024-09-19T14:14:28.133 INFO:teuthology.orchestra.run.smithi153.stderr: 53350K .......... .......... .......... .......... .......... 57% 232M 0s 2024-09-19T14:14:28.133 INFO:teuthology.orchestra.run.smithi153.stderr: 53400K .......... .......... .......... .......... .......... 57% 347M 0s 2024-09-19T14:14:28.133 INFO:teuthology.orchestra.run.smithi153.stderr: 53450K .......... .......... .......... .......... .......... 57% 80.6M 0s 2024-09-19T14:14:28.133 INFO:teuthology.orchestra.run.smithi153.stderr: 53500K .......... .......... .......... .......... .......... 57% 71.7M 0s 2024-09-19T14:14:28.133 INFO:teuthology.orchestra.run.smithi153.stderr: 53550K .......... .......... .......... .......... .......... 57% 265M 0s 2024-09-19T14:14:28.133 INFO:teuthology.orchestra.run.smithi153.stderr: 53600K .......... .......... .......... .......... .......... 57% 104M 0s 2024-09-19T14:14:28.134 INFO:teuthology.orchestra.run.smithi153.stderr: 53650K .......... .......... .......... .......... .......... 57% 97.9M 0s 2024-09-19T14:14:28.134 INFO:teuthology.orchestra.run.smithi153.stderr: 53700K .......... .......... .......... .......... .......... 57% 275M 0s 2024-09-19T14:14:28.134 INFO:teuthology.orchestra.run.smithi153.stderr: 53750K .......... .......... .......... .......... .......... 57% 358M 0s 2024-09-19T14:14:28.134 INFO:teuthology.orchestra.run.smithi153.stderr: 53800K .......... .......... .......... .......... .......... 57% 370M 0s 2024-09-19T14:14:28.134 INFO:teuthology.orchestra.run.smithi153.stderr: 53850K .......... .......... .......... .......... .......... 58% 125M 0s 2024-09-19T14:14:28.134 INFO:teuthology.orchestra.run.smithi153.stderr: 53900K .......... .......... .......... .......... .......... 58% 263M 0s 2024-09-19T14:14:28.134 INFO:teuthology.orchestra.run.smithi153.stderr: 53950K .......... .......... .......... .......... .......... 58% 330M 0s 2024-09-19T14:14:28.134 INFO:teuthology.orchestra.run.smithi153.stderr: 54000K .......... .......... .......... .......... .......... 58% 347M 0s 2024-09-19T14:14:28.134 INFO:teuthology.orchestra.run.smithi153.stderr: 54050K .......... .......... .......... .......... .......... 58% 327M 0s 2024-09-19T14:14:28.134 INFO:teuthology.orchestra.run.smithi153.stderr: 54100K .......... .......... .......... .......... .......... 58% 295M 0s 2024-09-19T14:14:28.134 INFO:teuthology.orchestra.run.smithi153.stderr: 54150K .......... .......... .......... .......... .......... 58% 347M 0s 2024-09-19T14:14:28.134 INFO:teuthology.orchestra.run.smithi153.stderr: 54200K .......... .......... .......... .......... .......... 58% 325M 0s 2024-09-19T14:14:28.134 INFO:teuthology.orchestra.run.smithi153.stderr: 54250K .......... .......... .......... .......... .......... 58% 326M 0s 2024-09-19T14:14:28.134 INFO:teuthology.orchestra.run.smithi153.stderr: 54300K .......... .......... .......... .......... .......... 58% 289M 0s 2024-09-19T14:14:28.134 INFO:teuthology.orchestra.run.smithi153.stderr: 54350K .......... .......... .......... .......... .......... 58% 328M 0s 2024-09-19T14:14:28.135 INFO:teuthology.orchestra.run.smithi153.stderr: 54400K .......... .......... .......... .......... .......... 58% 356M 0s 2024-09-19T14:14:28.135 INFO:teuthology.orchestra.run.smithi153.stderr: 54450K .......... .......... .......... .......... .......... 58% 357M 0s 2024-09-19T14:14:28.135 INFO:teuthology.orchestra.run.smithi153.stderr: 54500K .......... .......... .......... .......... .......... 58% 314M 0s 2024-09-19T14:14:28.135 INFO:teuthology.orchestra.run.smithi153.stderr: 54550K .......... .......... .......... .......... .......... 58% 353M 0s 2024-09-19T14:14:28.135 INFO:teuthology.orchestra.run.smithi153.stderr: 54600K .......... .......... .......... .......... .......... 58% 352M 0s 2024-09-19T14:14:28.135 INFO:teuthology.orchestra.run.smithi153.stderr: 54650K .......... .......... .......... .......... .......... 58% 330M 0s 2024-09-19T14:14:28.135 INFO:teuthology.orchestra.run.smithi153.stderr: 54700K .......... .......... .......... .......... .......... 58% 293M 0s 2024-09-19T14:14:28.135 INFO:teuthology.orchestra.run.smithi153.stderr: 54750K .......... .......... .......... .......... .......... 58% 351M 0s 2024-09-19T14:14:28.135 INFO:teuthology.orchestra.run.smithi153.stderr: 54800K .......... .......... .......... .......... .......... 59% 340M 0s 2024-09-19T14:14:28.135 INFO:teuthology.orchestra.run.smithi153.stderr: 54850K .......... .......... .......... .......... .......... 59% 136M 0s 2024-09-19T14:14:28.135 INFO:teuthology.orchestra.run.smithi153.stderr: 54900K .......... .......... .......... .......... .......... 59% 296M 0s 2024-09-19T14:14:28.135 INFO:teuthology.orchestra.run.smithi153.stderr: 54950K .......... .......... .......... .......... .......... 59% 321M 0s 2024-09-19T14:14:28.135 INFO:teuthology.orchestra.run.smithi153.stderr: 55000K .......... .......... .......... .......... .......... 59% 334M 0s 2024-09-19T14:14:28.135 INFO:teuthology.orchestra.run.smithi153.stderr: 55050K .......... .......... .......... .......... .......... 59% 320M 0s 2024-09-19T14:14:28.136 INFO:teuthology.orchestra.run.smithi153.stderr: 55100K .......... .......... .......... .......... .......... 59% 283M 0s 2024-09-19T14:14:28.136 INFO:teuthology.orchestra.run.smithi153.stderr: 55150K .......... .......... .......... .......... .......... 59% 365M 0s 2024-09-19T14:14:28.136 INFO:teuthology.orchestra.run.smithi153.stderr: 55200K .......... .......... .......... .......... .......... 59% 350M 0s 2024-09-19T14:14:28.136 INFO:teuthology.orchestra.run.smithi153.stderr: 55250K .......... .......... .......... .......... .......... 59% 327M 0s 2024-09-19T14:14:28.136 INFO:teuthology.orchestra.run.smithi153.stderr: 55300K .......... .......... .......... .......... .......... 59% 286M 0s 2024-09-19T14:14:28.136 INFO:teuthology.orchestra.run.smithi153.stderr: 55350K .......... .......... .......... .......... .......... 59% 349M 0s 2024-09-19T14:14:28.136 INFO:teuthology.orchestra.run.smithi153.stderr: 55400K .......... .......... .......... .......... .......... 59% 349M 0s 2024-09-19T14:14:28.136 INFO:teuthology.orchestra.run.smithi153.stderr: 55450K .......... .......... .......... .......... .......... 59% 359M 0s 2024-09-19T14:14:28.136 INFO:teuthology.orchestra.run.smithi153.stderr: 55500K .......... .......... .......... .......... .......... 59% 121M 0s 2024-09-19T14:14:28.136 INFO:teuthology.orchestra.run.smithi153.stderr: 55550K .......... .......... .......... .......... .......... 59% 330M 0s 2024-09-19T14:14:28.136 INFO:teuthology.orchestra.run.smithi153.stderr: 55600K .......... .......... .......... .......... .......... 59% 347M 0s 2024-09-19T14:14:28.136 INFO:teuthology.orchestra.run.smithi153.stderr: 55650K .......... .......... .......... .......... .......... 59% 332M 0s 2024-09-19T14:14:28.136 INFO:teuthology.orchestra.run.smithi153.stderr: 55700K .......... .......... .......... .......... .......... 60% 237M 0s 2024-09-19T14:14:28.136 INFO:teuthology.orchestra.run.smithi153.stderr: 55750K .......... .......... .......... .......... .......... 60% 342M 0s 2024-09-19T14:14:28.137 INFO:teuthology.orchestra.run.smithi153.stderr: 55800K .......... .......... .......... .......... .......... 60% 256M 0s 2024-09-19T14:14:28.137 INFO:teuthology.orchestra.run.smithi153.stderr: 55850K .......... .......... .......... .......... .......... 60% 221M 0s 2024-09-19T14:14:28.137 INFO:teuthology.orchestra.run.smithi153.stderr: 55900K .......... .......... .......... .......... .......... 60% 199M 0s 2024-09-19T14:14:28.137 INFO:teuthology.orchestra.run.smithi153.stderr: 55950K .......... .......... .......... .......... .......... 60% 246M 0s 2024-09-19T14:14:28.137 INFO:teuthology.orchestra.run.smithi153.stderr: 56000K .......... .......... .......... .......... .......... 60% 318M 0s 2024-09-19T14:14:28.137 INFO:teuthology.orchestra.run.smithi153.stderr: 56050K .......... .......... .......... .......... .......... 60% 329M 0s 2024-09-19T14:14:28.137 INFO:teuthology.orchestra.run.smithi153.stderr: 56100K .......... .......... .......... .......... .......... 60% 307M 0s 2024-09-19T14:14:28.137 INFO:teuthology.orchestra.run.smithi153.stderr: 56150K .......... .......... .......... .......... .......... 60% 353M 0s 2024-09-19T14:14:28.137 INFO:teuthology.orchestra.run.smithi153.stderr: 56200K .......... .......... .......... .......... .......... 60% 340M 0s 2024-09-19T14:14:28.137 INFO:teuthology.orchestra.run.smithi153.stderr: 56250K .......... .......... .......... .......... .......... 60% 346M 0s 2024-09-19T14:14:28.137 INFO:teuthology.orchestra.run.smithi153.stderr: 56300K .......... .......... .......... .......... .......... 60% 290M 0s 2024-09-19T14:14:28.137 INFO:teuthology.orchestra.run.smithi153.stderr: 56350K .......... .......... .......... .......... .......... 60% 358M 0s 2024-09-19T14:14:28.137 INFO:teuthology.orchestra.run.smithi153.stderr: 56400K .......... .......... .......... .......... .......... 60% 70.8M 0s 2024-09-19T14:14:28.138 INFO:teuthology.orchestra.run.smithi153.stderr: 56450K .......... .......... .......... .......... .......... 60% 354M 0s 2024-09-19T14:14:28.138 INFO:teuthology.orchestra.run.smithi153.stderr: 56500K .......... .......... .......... .......... .......... 60% 103M 0s 2024-09-19T14:14:28.138 INFO:teuthology.orchestra.run.smithi153.stderr: 56550K .......... .......... .......... .......... .......... 60% 350M 0s 2024-09-19T14:14:28.138 INFO:teuthology.orchestra.run.smithi153.stderr: 56600K .......... .......... .......... .......... .......... 60% 73.6M 0s 2024-09-19T14:14:28.138 INFO:teuthology.orchestra.run.smithi153.stderr: 56650K .......... .......... .......... .......... .......... 61% 137M 0s 2024-09-19T14:14:28.138 INFO:teuthology.orchestra.run.smithi153.stderr: 56700K .......... .......... .......... .......... .......... 61% 140M 0s 2024-09-19T14:14:28.138 INFO:teuthology.orchestra.run.smithi153.stderr: 56750K .......... .......... .......... .......... .......... 61% 105M 0s 2024-09-19T14:14:28.138 INFO:teuthology.orchestra.run.smithi153.stderr: 56800K .......... .......... .......... .......... .......... 61% 306M 0s 2024-09-19T14:14:28.138 INFO:teuthology.orchestra.run.smithi153.stderr: 56850K .......... .......... .......... .......... .......... 61% 329M 0s 2024-09-19T14:14:28.138 INFO:teuthology.orchestra.run.smithi153.stderr: 56900K .......... .......... .......... .......... .......... 61% 304M 0s 2024-09-19T14:14:28.138 INFO:teuthology.orchestra.run.smithi153.stderr: 56950K .......... .......... .......... .......... .......... 61% 354M 0s 2024-09-19T14:14:28.138 INFO:teuthology.orchestra.run.smithi153.stderr: 57000K .......... .......... .......... .......... .......... 61% 354M 0s 2024-09-19T14:14:28.138 INFO:teuthology.orchestra.run.smithi153.stderr: 57050K .......... .......... .......... .......... .......... 61% 328M 0s 2024-09-19T14:14:28.138 INFO:teuthology.orchestra.run.smithi153.stderr: 57100K .......... .......... .......... .......... .......... 61% 302M 0s 2024-09-19T14:14:28.139 INFO:teuthology.orchestra.run.smithi153.stderr: 57150K .......... .......... .......... .......... .......... 61% 348M 0s 2024-09-19T14:14:28.139 INFO:teuthology.orchestra.run.smithi153.stderr: 57200K .......... .......... .......... .......... .......... 61% 339M 0s 2024-09-19T14:14:28.139 INFO:teuthology.orchestra.run.smithi153.stderr: 57250K .......... .......... .......... .......... .......... 61% 341M 0s 2024-09-19T14:14:28.139 INFO:teuthology.orchestra.run.smithi153.stderr: 57300K .......... .......... .......... .......... .......... 61% 328M 0s 2024-09-19T14:14:28.139 INFO:teuthology.orchestra.run.smithi153.stderr: 57350K .......... .......... .......... .......... .......... 61% 343M 0s 2024-09-19T14:14:28.139 INFO:teuthology.orchestra.run.smithi153.stderr: 57400K .......... .......... .......... .......... .......... 61% 356M 0s 2024-09-19T14:14:28.139 INFO:teuthology.orchestra.run.smithi153.stderr: 57450K .......... .......... .......... .......... .......... 61% 304M 0s 2024-09-19T14:14:28.139 INFO:teuthology.orchestra.run.smithi153.stderr: 57500K .......... .......... .......... .......... .......... 61% 294M 0s 2024-09-19T14:14:28.139 INFO:teuthology.orchestra.run.smithi153.stderr: 57550K .......... .......... .......... .......... .......... 62% 348M 0s 2024-09-19T14:14:28.139 INFO:teuthology.orchestra.run.smithi153.stderr: 57600K .......... .......... .......... .......... .......... 62% 340M 0s 2024-09-19T14:14:28.139 INFO:teuthology.orchestra.run.smithi153.stderr: 57650K .......... .......... .......... .......... .......... 62% 353M 0s 2024-09-19T14:14:28.139 INFO:teuthology.orchestra.run.smithi153.stderr: 57700K .......... .......... .......... .......... .......... 62% 314M 0s 2024-09-19T14:14:28.139 INFO:teuthology.orchestra.run.smithi153.stderr: 57750K .......... .......... .......... .......... .......... 62% 359M 0s 2024-09-19T14:14:28.140 INFO:teuthology.orchestra.run.smithi153.stderr: 57800K .......... .......... .......... .......... .......... 62% 146M 0s 2024-09-19T14:14:28.140 INFO:teuthology.orchestra.run.smithi153.stderr: 57850K .......... .......... .......... .......... .......... 62% 330M 0s 2024-09-19T14:14:28.140 INFO:teuthology.orchestra.run.smithi153.stderr: 57900K .......... .......... .......... .......... .......... 62% 278M 0s 2024-09-19T14:14:28.140 INFO:teuthology.orchestra.run.smithi153.stderr: 57950K .......... .......... .......... .......... .......... 62% 318M 0s 2024-09-19T14:14:28.140 INFO:teuthology.orchestra.run.smithi153.stderr: 58000K .......... .......... .......... .......... .......... 62% 345M 0s 2024-09-19T14:14:28.140 INFO:teuthology.orchestra.run.smithi153.stderr: 58050K .......... .......... .......... .......... .......... 62% 338M 0s 2024-09-19T14:14:28.140 INFO:teuthology.orchestra.run.smithi153.stderr: 58100K .......... .......... .......... .......... .......... 62% 302M 0s 2024-09-19T14:14:28.140 INFO:teuthology.orchestra.run.smithi153.stderr: 58150K .......... .......... .......... .......... .......... 62% 338M 0s 2024-09-19T14:14:28.140 INFO:teuthology.orchestra.run.smithi153.stderr: 58200K .......... .......... .......... .......... .......... 62% 333M 0s 2024-09-19T14:14:28.140 INFO:teuthology.orchestra.run.smithi153.stderr: 58250K .......... .......... .......... .......... .......... 62% 349M 0s 2024-09-19T14:14:28.140 INFO:teuthology.orchestra.run.smithi153.stderr: 58300K .......... .......... .......... .......... .......... 62% 229M 0s 2024-09-19T14:14:28.140 INFO:teuthology.orchestra.run.smithi153.stderr: 58350K .......... .......... .......... .......... .......... 62% 324M 0s 2024-09-19T14:14:28.140 INFO:teuthology.orchestra.run.smithi153.stderr: 58400K .......... .......... .......... .......... .......... 62% 109M 0s 2024-09-19T14:14:28.140 INFO:teuthology.orchestra.run.smithi153.stderr: 58450K .......... .......... .......... .......... .......... 62% 324M 0s 2024-09-19T14:14:28.141 INFO:teuthology.orchestra.run.smithi153.stderr: 58500K .......... .......... .......... .......... .......... 63% 312M 0s 2024-09-19T14:14:28.141 INFO:teuthology.orchestra.run.smithi153.stderr: 58550K .......... .......... .......... .......... .......... 63% 205M 0s 2024-09-19T14:14:28.141 INFO:teuthology.orchestra.run.smithi153.stderr: 58600K .......... .......... .......... .......... .......... 63% 326M 0s 2024-09-19T14:14:28.141 INFO:teuthology.orchestra.run.smithi153.stderr: 58650K .......... .......... .......... .......... .......... 63% 343M 0s 2024-09-19T14:14:28.141 INFO:teuthology.orchestra.run.smithi153.stderr: 58700K .......... .......... .......... .......... .......... 63% 292M 0s 2024-09-19T14:14:28.141 INFO:teuthology.orchestra.run.smithi153.stderr: 58750K .......... .......... .......... .......... .......... 63% 325M 0s 2024-09-19T14:14:28.141 INFO:teuthology.orchestra.run.smithi153.stderr: 58800K .......... .......... .......... .......... .......... 63% 336M 0s 2024-09-19T14:14:28.141 INFO:teuthology.orchestra.run.smithi153.stderr: 58850K .......... .......... .......... .......... .......... 63% 280M 0s 2024-09-19T14:14:28.141 INFO:teuthology.orchestra.run.smithi153.stderr: 58900K .......... .......... .......... .......... .......... 63% 308M 0s 2024-09-19T14:14:28.141 INFO:teuthology.orchestra.run.smithi153.stderr: 58950K .......... .......... .......... .......... .......... 63% 333M 0s 2024-09-19T14:14:28.141 INFO:teuthology.orchestra.run.smithi153.stderr: 59000K .......... .......... .......... .......... .......... 63% 312M 0s 2024-09-19T14:14:28.141 INFO:teuthology.orchestra.run.smithi153.stderr: 59050K .......... .......... .......... .......... .......... 63% 341M 0s 2024-09-19T14:14:28.141 INFO:teuthology.orchestra.run.smithi153.stderr: 59100K .......... .......... .......... .......... .......... 63% 270M 0s 2024-09-19T14:14:28.142 INFO:teuthology.orchestra.run.smithi153.stderr: 59150K .......... .......... .......... .......... .......... 63% 327M 0s 2024-09-19T14:14:28.142 INFO:teuthology.orchestra.run.smithi153.stderr: 59200K .......... .......... .......... .......... .......... 63% 352M 0s 2024-09-19T14:14:28.142 INFO:teuthology.orchestra.run.smithi153.stderr: 59250K .......... .......... .......... .......... .......... 63% 320M 0s 2024-09-19T14:14:28.142 INFO:teuthology.orchestra.run.smithi153.stderr: 59300K .......... .......... .......... .......... .......... 63% 64.4M 0s 2024-09-19T14:14:28.142 INFO:teuthology.orchestra.run.smithi153.stderr: 59350K .......... .......... .......... .......... .......... 63% 321M 0s 2024-09-19T14:14:28.142 INFO:teuthology.orchestra.run.smithi153.stderr: 59400K .......... .......... .......... .......... .......... 63% 363M 0s 2024-09-19T14:14:28.142 INFO:teuthology.orchestra.run.smithi153.stderr: 59450K .......... .......... .......... .......... .......... 64% 375M 0s 2024-09-19T14:14:28.142 INFO:teuthology.orchestra.run.smithi153.stderr: 59500K .......... .......... .......... .......... .......... 64% 278M 0s 2024-09-19T14:14:28.142 INFO:teuthology.orchestra.run.smithi153.stderr: 59550K .......... .......... .......... .......... .......... 64% 108M 0s 2024-09-19T14:14:28.142 INFO:teuthology.orchestra.run.smithi153.stderr: 59600K .......... .......... .......... .......... .......... 64% 337M 0s 2024-09-19T14:14:28.142 INFO:teuthology.orchestra.run.smithi153.stderr: 59650K .......... .......... .......... .......... .......... 64% 73.4M 0s 2024-09-19T14:14:28.142 INFO:teuthology.orchestra.run.smithi153.stderr: 59700K .......... .......... .......... .......... .......... 64% 209M 0s 2024-09-19T14:14:28.142 INFO:teuthology.orchestra.run.smithi153.stderr: 59750K .......... .......... .......... .......... .......... 64% 73.6M 0s 2024-09-19T14:14:28.142 INFO:teuthology.orchestra.run.smithi153.stderr: 59800K .......... .......... .......... .......... .......... 64% 303M 0s 2024-09-19T14:14:28.142 INFO:teuthology.orchestra.run.smithi153.stderr: 59850K .......... .......... .......... .......... .......... 64% 151M 0s 2024-09-19T14:14:28.143 INFO:teuthology.orchestra.run.smithi153.stderr: 59900K .......... .......... .......... .......... .......... 64% 294M 0s 2024-09-19T14:14:28.143 INFO:teuthology.orchestra.run.smithi153.stderr: 59950K .......... .......... .......... .......... .......... 64% 338M 0s 2024-09-19T14:14:28.143 INFO:teuthology.orchestra.run.smithi153.stderr: 60000K .......... .......... .......... .......... .......... 64% 351M 0s 2024-09-19T14:14:28.143 INFO:teuthology.orchestra.run.smithi153.stderr: 60050K .......... .......... .......... .......... .......... 64% 366M 0s 2024-09-19T14:14:28.143 INFO:teuthology.orchestra.run.smithi153.stderr: 60100K .......... .......... .......... .......... .......... 64% 312M 0s 2024-09-19T14:14:28.143 INFO:teuthology.orchestra.run.smithi153.stderr: 60150K .......... .......... .......... .......... .......... 64% 360M 0s 2024-09-19T14:14:28.143 INFO:teuthology.orchestra.run.smithi153.stderr: 60200K .......... .......... .......... .......... .......... 64% 359M 0s 2024-09-19T14:14:28.143 INFO:teuthology.orchestra.run.smithi153.stderr: 60250K .......... .......... .......... .......... .......... 64% 332M 0s 2024-09-19T14:14:28.143 INFO:teuthology.orchestra.run.smithi153.stderr: 60300K .......... .......... .......... .......... .......... 64% 298M 0s 2024-09-19T14:14:28.143 INFO:teuthology.orchestra.run.smithi153.stderr: 60350K .......... .......... .......... .......... .......... 65% 346M 0s 2024-09-19T14:14:28.143 INFO:teuthology.orchestra.run.smithi153.stderr: 60400K .......... .......... .......... .......... .......... 65% 334M 0s 2024-09-19T14:14:28.143 INFO:teuthology.orchestra.run.smithi153.stderr: 60450K .......... .......... .......... .......... .......... 65% 371M 0s 2024-09-19T14:14:28.143 INFO:teuthology.orchestra.run.smithi153.stderr: 60500K .......... .......... .......... .......... .......... 65% 300M 0s 2024-09-19T14:14:28.143 INFO:teuthology.orchestra.run.smithi153.stderr: 60550K .......... .......... .......... .......... .......... 65% 354M 0s 2024-09-19T14:14:28.144 INFO:teuthology.orchestra.run.smithi153.stderr: 60600K .......... .......... .......... .......... .......... 65% 361M 0s 2024-09-19T14:14:28.144 INFO:teuthology.orchestra.run.smithi153.stderr: 60650K .......... .......... .......... .......... .......... 65% 376M 0s 2024-09-19T14:14:28.144 INFO:teuthology.orchestra.run.smithi153.stderr: 60700K .......... .......... .......... .......... .......... 65% 96.1M 0s 2024-09-19T14:14:28.144 INFO:teuthology.orchestra.run.smithi153.stderr: 60750K .......... .......... .......... .......... .......... 65% 290M 0s 2024-09-19T14:14:28.144 INFO:teuthology.orchestra.run.smithi153.stderr: 60800K .......... .......... .......... .......... .......... 65% 332M 0s 2024-09-19T14:14:28.144 INFO:teuthology.orchestra.run.smithi153.stderr: 60850K .......... .......... .......... .......... .......... 65% 340M 0s 2024-09-19T14:14:28.144 INFO:teuthology.orchestra.run.smithi153.stderr: 60900K .......... .......... .......... .......... .......... 65% 314M 0s 2024-09-19T14:14:28.144 INFO:teuthology.orchestra.run.smithi153.stderr: 60950K .......... .......... .......... .......... .......... 65% 346M 0s 2024-09-19T14:14:28.144 INFO:teuthology.orchestra.run.smithi153.stderr: 61000K .......... .......... .......... .......... .......... 65% 329M 0s 2024-09-19T14:14:28.144 INFO:teuthology.orchestra.run.smithi153.stderr: 61050K .......... .......... .......... .......... .......... 65% 369M 0s 2024-09-19T14:14:28.144 INFO:teuthology.orchestra.run.smithi153.stderr: 61100K .......... .......... .......... .......... .......... 65% 234M 0s 2024-09-19T14:14:28.144 INFO:teuthology.orchestra.run.smithi153.stderr: 61150K .......... .......... .......... .......... .......... 65% 263M 0s 2024-09-19T14:14:28.144 INFO:teuthology.orchestra.run.smithi153.stderr: 61200K .......... .......... .......... .......... .......... 65% 308M 0s 2024-09-19T14:14:28.145 INFO:teuthology.orchestra.run.smithi153.stderr: 61250K .......... .......... .......... .......... .......... 65% 342M 0s 2024-09-19T14:14:28.145 INFO:teuthology.orchestra.run.smithi153.stderr: 61300K .......... .......... .......... .......... .......... 66% 260M 0s 2024-09-19T14:14:28.145 INFO:teuthology.orchestra.run.smithi153.stderr: 61350K .......... .......... .......... .......... .......... 66% 293M 0s 2024-09-19T14:14:28.145 INFO:teuthology.orchestra.run.smithi153.stderr: 61400K .......... .......... .......... .......... .......... 66% 317M 0s 2024-09-19T14:14:28.145 INFO:teuthology.orchestra.run.smithi153.stderr: 61450K .......... .......... .......... .......... .......... 66% 404M 0s 2024-09-19T14:14:28.145 INFO:teuthology.orchestra.run.smithi153.stderr: 61500K .......... .......... .......... .......... .......... 66% 390M 0s 2024-09-19T14:14:28.145 INFO:teuthology.orchestra.run.smithi153.stderr: 61550K .......... .......... .......... .......... .......... 66% 233M 0s 2024-09-19T14:14:28.145 INFO:teuthology.orchestra.run.smithi153.stderr: 61600K .......... .......... .......... .......... .......... 66% 213M 0s 2024-09-19T14:14:28.145 INFO:teuthology.orchestra.run.smithi153.stderr: 61650K .......... .......... .......... .......... .......... 66% 365M 0s 2024-09-19T14:14:28.145 INFO:teuthology.orchestra.run.smithi153.stderr: 61700K .......... .......... .......... .......... .......... 66% 367M 0s 2024-09-19T14:14:28.145 INFO:teuthology.orchestra.run.smithi153.stderr: 61750K .......... .......... .......... .......... .......... 66% 374M 0s 2024-09-19T14:14:28.145 INFO:teuthology.orchestra.run.smithi153.stderr: 61800K .......... .......... .......... .......... .......... 66% 314M 0s 2024-09-19T14:14:28.145 INFO:teuthology.orchestra.run.smithi153.stderr: 61850K .......... .......... .......... .......... .......... 66% 353M 0s 2024-09-19T14:14:28.145 INFO:teuthology.orchestra.run.smithi153.stderr: 61900K .......... .......... .......... .......... .......... 66% 377M 0s 2024-09-19T14:14:28.146 INFO:teuthology.orchestra.run.smithi153.stderr: 61950K .......... .......... .......... .......... .......... 66% 88.8M 0s 2024-09-19T14:14:28.146 INFO:teuthology.orchestra.run.smithi153.stderr: 62000K .......... .......... .......... .......... .......... 66% 337M 0s 2024-09-19T14:14:28.146 INFO:teuthology.orchestra.run.smithi153.stderr: 62050K .......... .......... .......... .......... .......... 66% 362M 0s 2024-09-19T14:14:28.146 INFO:teuthology.orchestra.run.smithi153.stderr: 62100K .......... .......... .......... .......... .......... 66% 323M 0s 2024-09-19T14:14:28.146 INFO:teuthology.orchestra.run.smithi153.stderr: 62150K .......... .......... .......... .......... .......... 66% 319M 0s 2024-09-19T14:14:28.146 INFO:teuthology.orchestra.run.smithi153.stderr: 62200K .......... .......... .......... .......... .......... 67% 375M 0s 2024-09-19T14:14:28.146 INFO:teuthology.orchestra.run.smithi153.stderr: 62250K .......... .......... .......... .......... .......... 67% 371M 0s 2024-09-19T14:14:28.146 INFO:teuthology.orchestra.run.smithi153.stderr: 62300K .......... .......... .......... .......... .......... 67% 101M 0s 2024-09-19T14:14:28.146 INFO:teuthology.orchestra.run.smithi153.stderr: 62350K .......... .......... .......... .......... .......... 67% 146M 0s 2024-09-19T14:14:28.146 INFO:teuthology.orchestra.run.smithi153.stderr: 62400K .......... .......... .......... .......... .......... 67% 332M 0s 2024-09-19T14:14:28.146 INFO:teuthology.orchestra.run.smithi153.stderr: 62450K .......... .......... .......... .......... .......... 67% 346M 0s 2024-09-19T14:14:28.146 INFO:teuthology.orchestra.run.smithi153.stderr: 62500K .......... .......... .......... .......... .......... 67% 354M 0s 2024-09-19T14:14:28.146 INFO:teuthology.orchestra.run.smithi153.stderr: 62550K .......... .......... .......... .......... .......... 67% 319M 0s 2024-09-19T14:14:28.146 INFO:teuthology.orchestra.run.smithi153.stderr: 62600K .......... .......... .......... .......... .......... 67% 367M 0s 2024-09-19T14:14:28.146 INFO:teuthology.orchestra.run.smithi153.stderr: 62650K .......... .......... .......... .......... .......... 67% 79.3M 0s 2024-09-19T14:14:28.147 INFO:teuthology.orchestra.run.smithi153.stderr: 62700K .......... .......... .......... .......... .......... 67% 206M 0s 2024-09-19T14:14:28.147 INFO:teuthology.orchestra.run.smithi153.stderr: 62750K .......... .......... .......... .......... .......... 67% 48.5M 0s 2024-09-19T14:14:28.147 INFO:teuthology.orchestra.run.smithi153.stderr: 62800K .......... .......... .......... .......... .......... 67% 258M 0s 2024-09-19T14:14:28.147 INFO:teuthology.orchestra.run.smithi153.stderr: 62850K .......... .......... .......... .......... .......... 67% 366M 0s 2024-09-19T14:14:28.147 INFO:teuthology.orchestra.run.smithi153.stderr: 62900K .......... .......... .......... .......... .......... 67% 171M 0s 2024-09-19T14:14:28.147 INFO:teuthology.orchestra.run.smithi153.stderr: 62950K .......... .......... .......... .......... .......... 67% 306M 0s 2024-09-19T14:14:28.147 INFO:teuthology.orchestra.run.smithi153.stderr: 63000K .......... .......... .......... .......... .......... 67% 353M 0s 2024-09-19T14:14:28.147 INFO:teuthology.orchestra.run.smithi153.stderr: 63050K .......... .......... .......... .......... .......... 67% 348M 0s 2024-09-19T14:14:28.147 INFO:teuthology.orchestra.run.smithi153.stderr: 63100K .......... .......... .......... .......... .......... 67% 356M 0s 2024-09-19T14:14:28.147 INFO:teuthology.orchestra.run.smithi153.stderr: 63150K .......... .......... .......... .......... .......... 68% 299M 0s 2024-09-19T14:14:28.147 INFO:teuthology.orchestra.run.smithi153.stderr: 63200K .......... .......... .......... .......... .......... 68% 357M 0s 2024-09-19T14:14:28.147 INFO:teuthology.orchestra.run.smithi153.stderr: 63250K .......... .......... .......... .......... .......... 68% 323M 0s 2024-09-19T14:14:28.147 INFO:teuthology.orchestra.run.smithi153.stderr: 63300K .......... .......... .......... .......... .......... 68% 376M 0s 2024-09-19T14:14:28.147 INFO:teuthology.orchestra.run.smithi153.stderr: 63350K .......... .......... .......... .......... .......... 68% 293M 0s 2024-09-19T14:14:28.147 INFO:teuthology.orchestra.run.smithi153.stderr: 63400K .......... .......... .......... .......... .......... 68% 352M 0s 2024-09-19T14:14:28.147 INFO:teuthology.orchestra.run.smithi153.stderr: 63450K .......... .......... .......... .......... .......... 68% 366M 0s 2024-09-19T14:14:28.148 INFO:teuthology.orchestra.run.smithi153.stderr: 63500K .......... .......... .......... .......... .......... 68% 342M 0s 2024-09-19T14:14:28.148 INFO:teuthology.orchestra.run.smithi153.stderr: 63550K .......... .......... .......... .......... .......... 68% 284M 0s 2024-09-19T14:14:28.148 INFO:teuthology.orchestra.run.smithi153.stderr: 63600K .......... .......... .......... .......... .......... 68% 363M 0s 2024-09-19T14:14:28.148 INFO:teuthology.orchestra.run.smithi153.stderr: 63650K .......... .......... .......... .......... .......... 68% 376M 0s 2024-09-19T14:14:28.148 INFO:teuthology.orchestra.run.smithi153.stderr: 63700K .......... .......... .......... .......... .......... 68% 176M 0s 2024-09-19T14:14:28.148 INFO:teuthology.orchestra.run.smithi153.stderr: 63750K .......... .......... .......... .......... .......... 68% 294M 0s 2024-09-19T14:14:28.148 INFO:teuthology.orchestra.run.smithi153.stderr: 63800K .......... .......... .......... .......... .......... 68% 377M 0s 2024-09-19T14:14:28.148 INFO:teuthology.orchestra.run.smithi153.stderr: 63850K .......... .......... .......... .......... .......... 68% 279M 0s 2024-09-19T14:14:28.148 INFO:teuthology.orchestra.run.smithi153.stderr: 63900K .......... .......... .......... .......... .......... 68% 337M 0s 2024-09-19T14:14:28.148 INFO:teuthology.orchestra.run.smithi153.stderr: 63950K .......... .......... .......... .......... .......... 68% 193M 0s 2024-09-19T14:14:28.148 INFO:teuthology.orchestra.run.smithi153.stderr: 64000K .......... .......... .......... .......... .......... 68% 250M 0s 2024-09-19T14:14:28.148 INFO:teuthology.orchestra.run.smithi153.stderr: 64050K .......... .......... .......... .......... .......... 68% 297M 0s 2024-09-19T14:14:28.148 INFO:teuthology.orchestra.run.smithi153.stderr: 64100K .......... .......... .......... .......... .......... 69% 342M 0s 2024-09-19T14:14:28.148 INFO:teuthology.orchestra.run.smithi153.stderr: 64150K .......... .......... .......... .......... .......... 69% 321M 0s 2024-09-19T14:14:28.149 INFO:teuthology.orchestra.run.smithi153.stderr: 64200K .......... .......... .......... .......... .......... 69% 327M 0s 2024-09-19T14:14:28.149 INFO:teuthology.orchestra.run.smithi153.stderr: 64250K .......... .......... .......... .......... .......... 69% 376M 0s 2024-09-19T14:14:28.149 INFO:teuthology.orchestra.run.smithi153.stderr: 64300K .......... .......... .......... .......... .......... 69% 110M 0s 2024-09-19T14:14:28.149 INFO:teuthology.orchestra.run.smithi153.stderr: 64350K .......... .......... .......... .......... .......... 69% 266M 0s 2024-09-19T14:14:28.149 INFO:teuthology.orchestra.run.smithi153.stderr: 64400K .......... .......... .......... .......... .......... 69% 376M 0s 2024-09-19T14:14:28.149 INFO:teuthology.orchestra.run.smithi153.stderr: 64450K .......... .......... .......... .......... .......... 69% 344M 0s 2024-09-19T14:14:28.149 INFO:teuthology.orchestra.run.smithi153.stderr: 64500K .......... .......... .......... .......... .......... 69% 369M 0s 2024-09-19T14:14:28.149 INFO:teuthology.orchestra.run.smithi153.stderr: 64550K .......... .......... .......... .......... .......... 69% 312M 0s 2024-09-19T14:14:28.149 INFO:teuthology.orchestra.run.smithi153.stderr: 64600K .......... .......... .......... .......... .......... 69% 378M 0s 2024-09-19T14:14:28.149 INFO:teuthology.orchestra.run.smithi153.stderr: 64650K .......... .......... .......... .......... .......... 69% 372M 0s 2024-09-19T14:14:28.149 INFO:teuthology.orchestra.run.smithi153.stderr: 64700K .......... .......... .......... .......... .......... 69% 364M 0s 2024-09-19T14:14:28.149 INFO:teuthology.orchestra.run.smithi153.stderr: 64750K .......... .......... .......... .......... .......... 69% 276M 0s 2024-09-19T14:14:28.149 INFO:teuthology.orchestra.run.smithi153.stderr: 64800K .......... .......... .......... .......... .......... 69% 362M 0s 2024-09-19T14:14:28.149 INFO:teuthology.orchestra.run.smithi153.stderr: 64850K .......... .......... .......... .......... .......... 69% 379M 0s 2024-09-19T14:14:28.150 INFO:teuthology.orchestra.run.smithi153.stderr: 64900K .......... .......... .......... .......... .......... 69% 155M 0s 2024-09-19T14:14:28.150 INFO:teuthology.orchestra.run.smithi153.stderr: 64950K .......... .......... .......... .......... .......... 69% 308M 0s 2024-09-19T14:14:28.150 INFO:teuthology.orchestra.run.smithi153.stderr: 65000K .......... .......... .......... .......... .......... 70% 151M 0s 2024-09-19T14:14:28.150 INFO:teuthology.orchestra.run.smithi153.stderr: 65050K .......... .......... .......... .......... .......... 70% 327M 0s 2024-09-19T14:14:28.150 INFO:teuthology.orchestra.run.smithi153.stderr: 65100K .......... .......... .......... .......... .......... 70% 359M 0s 2024-09-19T14:14:28.150 INFO:teuthology.orchestra.run.smithi153.stderr: 65150K .......... .......... .......... .......... .......... 70% 354M 0s 2024-09-19T14:14:28.150 INFO:teuthology.orchestra.run.smithi153.stderr: 65200K .......... .......... .......... .......... .......... 70% 78.8M 0s 2024-09-19T14:14:28.150 INFO:teuthology.orchestra.run.smithi153.stderr: 65250K .......... .......... .......... .......... .......... 70% 292M 0s 2024-09-19T14:14:28.150 INFO:teuthology.orchestra.run.smithi153.stderr: 65300K .......... .......... .......... .......... .......... 70% 350M 0s 2024-09-19T14:14:28.150 INFO:teuthology.orchestra.run.smithi153.stderr: 65350K .......... .......... .......... .......... .......... 70% 361M 0s 2024-09-19T14:14:28.150 INFO:teuthology.orchestra.run.smithi153.stderr: 65400K .......... .......... .......... .......... .......... 70% 349M 0s 2024-09-19T14:14:28.150 INFO:teuthology.orchestra.run.smithi153.stderr: 65450K .......... .......... .......... .......... .......... 70% 334M 0s 2024-09-19T14:14:28.150 INFO:teuthology.orchestra.run.smithi153.stderr: 65500K .......... .......... .......... .......... .......... 70% 347M 0s 2024-09-19T14:14:28.150 INFO:teuthology.orchestra.run.smithi153.stderr: 65550K .......... .......... .......... .......... .......... 70% 364M 0s 2024-09-19T14:14:28.150 INFO:teuthology.orchestra.run.smithi153.stderr: 65600K .......... .......... .......... .......... .......... 70% 130M 0s 2024-09-19T14:14:28.150 INFO:teuthology.orchestra.run.smithi153.stderr: 65650K .......... .......... .......... .......... .......... 70% 177M 0s 2024-09-19T14:14:28.151 INFO:teuthology.orchestra.run.smithi153.stderr: 65700K .......... .......... .......... .......... .......... 70% 247M 0s 2024-09-19T14:14:28.151 INFO:teuthology.orchestra.run.smithi153.stderr: 65750K .......... .......... .......... .......... .......... 70% 53.5M 0s 2024-09-19T14:14:28.151 INFO:teuthology.orchestra.run.smithi153.stderr: 65800K .......... .......... .......... .......... .......... 70% 90.3M 0s 2024-09-19T14:14:28.151 INFO:teuthology.orchestra.run.smithi153.stderr: 65850K .......... .......... .......... .......... .......... 70% 281M 0s 2024-09-19T14:14:28.151 INFO:teuthology.orchestra.run.smithi153.stderr: 65900K .......... .......... .......... .......... .......... 70% 348M 0s 2024-09-19T14:14:28.151 INFO:teuthology.orchestra.run.smithi153.stderr: 65950K .......... .......... .......... .......... .......... 71% 322M 0s 2024-09-19T14:14:28.151 INFO:teuthology.orchestra.run.smithi153.stderr: 66000K .......... .......... .......... .......... .......... 71% 365M 0s 2024-09-19T14:14:28.151 INFO:teuthology.orchestra.run.smithi153.stderr: 66050K .......... .......... .......... .......... .......... 71% 297M 0s 2024-09-19T14:14:28.151 INFO:teuthology.orchestra.run.smithi153.stderr: 66100K .......... .......... .......... .......... .......... 71% 354M 0s 2024-09-19T14:14:28.151 INFO:teuthology.orchestra.run.smithi153.stderr: 66150K .......... .......... .......... .......... .......... 71% 374M 0s 2024-09-19T14:14:28.151 INFO:teuthology.orchestra.run.smithi153.stderr: 66200K .......... .......... .......... .......... .......... 71% 376M 0s 2024-09-19T14:14:28.151 INFO:teuthology.orchestra.run.smithi153.stderr: 66250K .......... .......... .......... .......... .......... 71% 331M 0s 2024-09-19T14:14:28.151 INFO:teuthology.orchestra.run.smithi153.stderr: 66300K .......... .......... .......... .......... .......... 71% 168M 0s 2024-09-19T14:14:28.151 INFO:teuthology.orchestra.run.smithi153.stderr: 66350K .......... .......... .......... .......... .......... 71% 187M 0s 2024-09-19T14:14:28.152 INFO:teuthology.orchestra.run.smithi153.stderr: 66400K .......... .......... .......... .......... .......... 71% 354M 0s 2024-09-19T14:14:28.152 INFO:teuthology.orchestra.run.smithi153.stderr: 66450K .......... .......... .......... .......... .......... 71% 291M 0s 2024-09-19T14:14:28.152 INFO:teuthology.orchestra.run.smithi153.stderr: 66500K .......... .......... .......... .......... .......... 71% 367M 0s 2024-09-19T14:14:28.152 INFO:teuthology.orchestra.run.smithi153.stderr: 66550K .......... .......... .......... .......... .......... 71% 352M 0s 2024-09-19T14:14:28.152 INFO:teuthology.orchestra.run.smithi153.stderr: 66600K .......... .......... .......... .......... .......... 71% 341M 0s 2024-09-19T14:14:28.152 INFO:teuthology.orchestra.run.smithi153.stderr: 66650K .......... .......... .......... .......... .......... 71% 309M 0s 2024-09-19T14:14:28.152 INFO:teuthology.orchestra.run.smithi153.stderr: 66700K .......... .......... .......... .......... .......... 71% 338M 0s 2024-09-19T14:14:28.152 INFO:teuthology.orchestra.run.smithi153.stderr: 66750K .......... .......... .......... .......... .......... 71% 348M 0s 2024-09-19T14:14:28.152 INFO:teuthology.orchestra.run.smithi153.stderr: 66800K .......... .......... .......... .......... .......... 71% 365M 0s 2024-09-19T14:14:28.152 INFO:teuthology.orchestra.run.smithi153.stderr: 66850K .......... .......... .......... .......... .......... 72% 304M 0s 2024-09-19T14:14:28.152 INFO:teuthology.orchestra.run.smithi153.stderr: 66900K .......... .......... .......... .......... .......... 72% 361M 0s 2024-09-19T14:14:28.152 INFO:teuthology.orchestra.run.smithi153.stderr: 66950K .......... .......... .......... .......... .......... 72% 213M 0s 2024-09-19T14:14:28.152 INFO:teuthology.orchestra.run.smithi153.stderr: 67000K .......... .......... .......... .......... .......... 72% 341M 0s 2024-09-19T14:14:28.152 INFO:teuthology.orchestra.run.smithi153.stderr: 67050K .......... .......... .......... .......... .......... 72% 261M 0s 2024-09-19T14:14:28.153 INFO:teuthology.orchestra.run.smithi153.stderr: 67100K .......... .......... .......... .......... .......... 72% 318M 0s 2024-09-19T14:14:28.153 INFO:teuthology.orchestra.run.smithi153.stderr: 67150K .......... .......... .......... .......... .......... 72% 295M 0s 2024-09-19T14:14:28.153 INFO:teuthology.orchestra.run.smithi153.stderr: 67200K .......... .......... .......... .......... .......... 72% 379M 0s 2024-09-19T14:14:28.153 INFO:teuthology.orchestra.run.smithi153.stderr: 67250K .......... .......... .......... .......... .......... 72% 141M 0s 2024-09-19T14:14:28.153 INFO:teuthology.orchestra.run.smithi153.stderr: 67300K .......... .......... .......... .......... .......... 72% 320M 0s 2024-09-19T14:14:28.153 INFO:teuthology.orchestra.run.smithi153.stderr: 67350K .......... .......... .......... .......... .......... 72% 329M 0s 2024-09-19T14:14:28.153 INFO:teuthology.orchestra.run.smithi153.stderr: 67400K .......... .......... .......... .......... .......... 72% 355M 0s 2024-09-19T14:14:28.153 INFO:teuthology.orchestra.run.smithi153.stderr: 67450K .......... .......... .......... .......... .......... 72% 372M 0s 2024-09-19T14:14:28.153 INFO:teuthology.orchestra.run.smithi153.stderr: 67500K .......... .......... .......... .......... .......... 72% 232M 0s 2024-09-19T14:14:28.153 INFO:teuthology.orchestra.run.smithi153.stderr: 67550K .......... .......... .......... .......... .......... 72% 281M 0s 2024-09-19T14:14:28.153 INFO:teuthology.orchestra.run.smithi153.stderr: 67600K .......... .......... .......... .......... .......... 72% 339M 0s 2024-09-19T14:14:28.153 INFO:teuthology.orchestra.run.smithi153.stderr: 67650K .......... .......... .......... .......... .......... 72% 355M 0s 2024-09-19T14:14:28.153 INFO:teuthology.orchestra.run.smithi153.stderr: 67700K .......... .......... .......... .......... .......... 72% 335M 0s 2024-09-19T14:14:28.153 INFO:teuthology.orchestra.run.smithi153.stderr: 67750K .......... .......... .......... .......... .......... 72% 336M 0s 2024-09-19T14:14:28.154 INFO:teuthology.orchestra.run.smithi153.stderr: 67800K .......... .......... .......... .......... .......... 73% 356M 0s 2024-09-19T14:14:28.154 INFO:teuthology.orchestra.run.smithi153.stderr: 67850K .......... .......... .......... .......... .......... 73% 228M 0s 2024-09-19T14:14:28.154 INFO:teuthology.orchestra.run.smithi153.stderr: 67900K .......... .......... .......... .......... .......... 73% 342M 0s 2024-09-19T14:14:28.154 INFO:teuthology.orchestra.run.smithi153.stderr: 67950K .......... .......... .......... .......... .......... 73% 250M 0s 2024-09-19T14:14:28.154 INFO:teuthology.orchestra.run.smithi153.stderr: 68000K .......... .......... .......... .......... .......... 73% 335M 0s 2024-09-19T14:14:28.154 INFO:teuthology.orchestra.run.smithi153.stderr: 68050K .......... .......... .......... .......... .......... 73% 177M 0s 2024-09-19T14:14:28.154 INFO:teuthology.orchestra.run.smithi153.stderr: 68100K .......... .......... .......... .......... .......... 73% 336M 0s 2024-09-19T14:14:28.154 INFO:teuthology.orchestra.run.smithi153.stderr: 68150K .......... .......... .......... .......... .......... 73% 89.0M 0s 2024-09-19T14:14:28.154 INFO:teuthology.orchestra.run.smithi153.stderr: 68200K .......... .......... .......... .......... .......... 73% 322M 0s 2024-09-19T14:14:28.154 INFO:teuthology.orchestra.run.smithi153.stderr: 68250K .......... .......... .......... .......... .......... 73% 355M 0s 2024-09-19T14:14:28.154 INFO:teuthology.orchestra.run.smithi153.stderr: 68300K .......... .......... .......... .......... .......... 73% 198M 0s 2024-09-19T14:14:28.154 INFO:teuthology.orchestra.run.smithi153.stderr: 68350K .......... .......... .......... .......... .......... 73% 200M 0s 2024-09-19T14:14:28.154 INFO:teuthology.orchestra.run.smithi153.stderr: 68400K .......... .......... .......... .......... .......... 73% 359M 0s 2024-09-19T14:14:28.154 INFO:teuthology.orchestra.run.smithi153.stderr: 68450K .......... .......... .......... .......... .......... 73% 347M 0s 2024-09-19T14:14:28.154 INFO:teuthology.orchestra.run.smithi153.stderr: 68500K .......... .......... .......... .......... .......... 73% 381M 0s 2024-09-19T14:14:28.155 INFO:teuthology.orchestra.run.smithi153.stderr: 68550K .......... .......... .......... .......... .......... 73% 138M 0s 2024-09-19T14:14:28.155 INFO:teuthology.orchestra.run.smithi153.stderr: 68600K .......... .......... .......... .......... .......... 73% 310M 0s 2024-09-19T14:14:28.155 INFO:teuthology.orchestra.run.smithi153.stderr: 68650K .......... .......... .......... .......... .......... 73% 339M 0s 2024-09-19T14:14:28.155 INFO:teuthology.orchestra.run.smithi153.stderr: 68700K .......... .......... .......... .......... .......... 74% 362M 0s 2024-09-19T14:14:28.155 INFO:teuthology.orchestra.run.smithi153.stderr: 68750K .......... .......... .......... .......... .......... 74% 306M 0s 2024-09-19T14:14:28.155 INFO:teuthology.orchestra.run.smithi153.stderr: 68800K .......... .......... .......... .......... .......... 74% 52.9M 0s 2024-09-19T14:14:28.155 INFO:teuthology.orchestra.run.smithi153.stderr: 68850K .......... .......... .......... .......... .......... 74% 63.6M 0s 2024-09-19T14:14:28.155 INFO:teuthology.orchestra.run.smithi153.stderr: 68900K .......... .......... .......... .......... .......... 74% 293M 0s 2024-09-19T14:14:28.155 INFO:teuthology.orchestra.run.smithi153.stderr: 68950K .......... .......... .......... .......... .......... 74% 315M 0s 2024-09-19T14:14:28.155 INFO:teuthology.orchestra.run.smithi153.stderr: 69000K .......... .......... .......... .......... .......... 74% 359M 0s 2024-09-19T14:14:28.155 INFO:teuthology.orchestra.run.smithi153.stderr: 69050K .......... .......... .......... .......... .......... 74% 337M 0s 2024-09-19T14:14:28.155 INFO:teuthology.orchestra.run.smithi153.stderr: 69100K .......... .......... .......... .......... .......... 74% 359M 0s 2024-09-19T14:14:28.155 INFO:teuthology.orchestra.run.smithi153.stderr: 69150K .......... .......... .......... .......... .......... 74% 286M 0s 2024-09-19T14:14:28.155 INFO:teuthology.orchestra.run.smithi153.stderr: 69200K .......... .......... .......... .......... .......... 74% 375M 0s 2024-09-19T14:14:28.155 INFO:teuthology.orchestra.run.smithi153.stderr: 69250K .......... .......... .......... .......... .......... 74% 366M 0s 2024-09-19T14:14:28.156 INFO:teuthology.orchestra.run.smithi153.stderr: 69300K .......... .......... .......... .......... .......... 74% 349M 0s 2024-09-19T14:14:28.156 INFO:teuthology.orchestra.run.smithi153.stderr: 69350K .......... .......... .......... .......... .......... 74% 170M 0s 2024-09-19T14:14:28.156 INFO:teuthology.orchestra.run.smithi153.stderr: 69400K .......... .......... .......... .......... .......... 74% 352M 0s 2024-09-19T14:14:28.156 INFO:teuthology.orchestra.run.smithi153.stderr: 69450K .......... .......... .......... .......... .......... 74% 335M 0s 2024-09-19T14:14:28.156 INFO:teuthology.orchestra.run.smithi153.stderr: 69500K .......... .......... .......... .......... .......... 74% 232M 0s 2024-09-19T14:14:28.156 INFO:teuthology.orchestra.run.smithi153.stderr: 69550K .......... .......... .......... .......... .......... 74% 276M 0s 2024-09-19T14:14:28.156 INFO:teuthology.orchestra.run.smithi153.stderr: 69600K .......... .......... .......... .......... .......... 74% 341M 0s 2024-09-19T14:14:28.156 INFO:teuthology.orchestra.run.smithi153.stderr: 69650K .......... .......... .......... .......... .......... 75% 325M 0s 2024-09-19T14:14:28.156 INFO:teuthology.orchestra.run.smithi153.stderr: 69700K .......... .......... .......... .......... .......... 75% 326M 0s 2024-09-19T14:14:28.156 INFO:teuthology.orchestra.run.smithi153.stderr: 69750K .......... .......... .......... .......... .......... 75% 257M 0s 2024-09-19T14:14:28.156 INFO:teuthology.orchestra.run.smithi153.stderr: 69800K .......... .......... .......... .......... .......... 75% 324M 0s 2024-09-19T14:14:28.156 INFO:teuthology.orchestra.run.smithi153.stderr: 69850K .......... .......... .......... .......... .......... 75% 378M 0s 2024-09-19T14:14:28.156 INFO:teuthology.orchestra.run.smithi153.stderr: 69900K .......... .......... .......... .......... .......... 75% 361M 0s 2024-09-19T14:14:28.156 INFO:teuthology.orchestra.run.smithi153.stderr: 69950K .......... .......... .......... .......... .......... 75% 199M 0s 2024-09-19T14:14:28.157 INFO:teuthology.orchestra.run.smithi153.stderr: 70000K .......... .......... .......... .......... .......... 75% 355M 0s 2024-09-19T14:14:28.157 INFO:teuthology.orchestra.run.smithi153.stderr: 70050K .......... .......... .......... .......... .......... 75% 370M 0s 2024-09-19T14:14:28.157 INFO:teuthology.orchestra.run.smithi153.stderr: 70100K .......... .......... .......... .......... .......... 75% 253M 0s 2024-09-19T14:14:28.157 INFO:teuthology.orchestra.run.smithi153.stderr: 70150K .......... .......... .......... .......... .......... 75% 277M 0s 2024-09-19T14:14:28.157 INFO:teuthology.orchestra.run.smithi153.stderr: 70200K .......... .......... .......... .......... .......... 75% 181M 0s 2024-09-19T14:14:28.157 INFO:teuthology.orchestra.run.smithi153.stderr: 70250K .......... .......... .......... .......... .......... 75% 323M 0s 2024-09-19T14:14:28.157 INFO:teuthology.orchestra.run.smithi153.stderr: 70300K .......... .......... .......... .......... .......... 75% 353M 0s 2024-09-19T14:14:28.157 INFO:teuthology.orchestra.run.smithi153.stderr: 70350K .......... .......... .......... .......... .......... 75% 308M 0s 2024-09-19T14:14:28.157 INFO:teuthology.orchestra.run.smithi153.stderr: 70400K .......... .......... .......... .......... .......... 75% 370M 0s 2024-09-19T14:14:28.157 INFO:teuthology.orchestra.run.smithi153.stderr: 70450K .......... .......... .......... .......... .......... 75% 359M 0s 2024-09-19T14:14:28.157 INFO:teuthology.orchestra.run.smithi153.stderr: 70500K .......... .......... .......... .......... .......... 75% 332M 0s 2024-09-19T14:14:28.157 INFO:teuthology.orchestra.run.smithi153.stderr: 70550K .......... .......... .......... .......... .......... 75% 282M 0s 2024-09-19T14:14:28.158 INFO:teuthology.orchestra.run.smithi153.stderr: 70600K .......... .......... .......... .......... .......... 76% 329M 0s 2024-09-19T14:14:28.158 INFO:teuthology.orchestra.run.smithi153.stderr: 70650K .......... .......... .......... .......... .......... 76% 340M 0s 2024-09-19T14:14:28.158 INFO:teuthology.orchestra.run.smithi153.stderr: 70700K .......... .......... .......... .......... .......... 76% 331M 0s 2024-09-19T14:14:28.158 INFO:teuthology.orchestra.run.smithi153.stderr: 70750K .......... .......... .......... .......... .......... 76% 325M 0s 2024-09-19T14:14:28.158 INFO:teuthology.orchestra.run.smithi153.stderr: 70800K .......... .......... .......... .......... .......... 76% 385M 0s 2024-09-19T14:14:28.158 INFO:teuthology.orchestra.run.smithi153.stderr: 70850K .......... .......... .......... .......... .......... 76% 320M 0s 2024-09-19T14:14:28.158 INFO:teuthology.orchestra.run.smithi153.stderr: 70900K .......... .......... .......... .......... .......... 76% 359M 0s 2024-09-19T14:14:28.158 INFO:teuthology.orchestra.run.smithi153.stderr: 70950K .......... .......... .......... .......... .......... 76% 202M 0s 2024-09-19T14:14:28.158 INFO:teuthology.orchestra.run.smithi153.stderr: 71000K .......... .......... .......... .......... .......... 76% 282M 0s 2024-09-19T14:14:28.158 INFO:teuthology.orchestra.run.smithi153.stderr: 71050K .......... .......... .......... .......... .......... 76% 337M 0s 2024-09-19T14:14:28.158 INFO:teuthology.orchestra.run.smithi153.stderr: 71100K .......... .......... .......... .......... .......... 76% 270M 0s 2024-09-19T14:14:28.158 INFO:teuthology.orchestra.run.smithi153.stderr: 71150K .......... .......... .......... .......... .......... 76% 105M 0s 2024-09-19T14:14:28.158 INFO:teuthology.orchestra.run.smithi153.stderr: 71200K .......... .......... .......... .......... .......... 76% 87.3M 0s 2024-09-19T14:14:28.158 INFO:teuthology.orchestra.run.smithi153.stderr: 71250K .......... .......... .......... .......... .......... 76% 340M 0s 2024-09-19T14:14:28.159 INFO:teuthology.orchestra.run.smithi153.stderr: 71300K .......... .......... .......... .......... .......... 76% 212M 0s 2024-09-19T14:14:28.159 INFO:teuthology.orchestra.run.smithi153.stderr: 71350K .......... .......... .......... .......... .......... 76% 267M 0s 2024-09-19T14:14:28.159 INFO:teuthology.orchestra.run.smithi153.stderr: 71400K .......... .......... .......... .......... .......... 76% 349M 0s 2024-09-19T14:14:28.159 INFO:teuthology.orchestra.run.smithi153.stderr: 71450K .......... .......... .......... .......... .......... 76% 120M 0s 2024-09-19T14:14:28.159 INFO:teuthology.orchestra.run.smithi153.stderr: 71500K .......... .......... .......... .......... .......... 77% 263M 0s 2024-09-19T14:14:28.159 INFO:teuthology.orchestra.run.smithi153.stderr: 71550K .......... .......... .......... .......... .......... 77% 303M 0s 2024-09-19T14:14:28.159 INFO:teuthology.orchestra.run.smithi153.stderr: 71600K .......... .......... .......... .......... .......... 77% 323M 0s 2024-09-19T14:14:28.159 INFO:teuthology.orchestra.run.smithi153.stderr: 71650K .......... .......... .......... .......... .......... 77% 345M 0s 2024-09-19T14:14:28.159 INFO:teuthology.orchestra.run.smithi153.stderr: 71700K .......... .......... .......... .......... .......... 77% 384M 0s 2024-09-19T14:14:28.159 INFO:teuthology.orchestra.run.smithi153.stderr: 71750K .......... .......... .......... .......... .......... 77% 373M 0s 2024-09-19T14:14:28.159 INFO:teuthology.orchestra.run.smithi153.stderr: 71800K .......... .......... .......... .......... .......... 77% 106M 0s 2024-09-19T14:14:28.159 INFO:teuthology.orchestra.run.smithi153.stderr: 71850K .......... .......... .......... .......... .......... 77% 132M 0s 2024-09-19T14:14:28.159 INFO:teuthology.orchestra.run.smithi153.stderr: 71900K .......... .......... .......... .......... .......... 77% 52.9M 0s 2024-09-19T14:14:28.160 INFO:teuthology.orchestra.run.smithi153.stderr: 71950K .......... .......... .......... .......... .......... 77% 256M 0s 2024-09-19T14:14:28.160 INFO:teuthology.orchestra.run.smithi153.stderr: 72000K .......... .......... .......... .......... .......... 77% 326M 0s 2024-09-19T14:14:28.160 INFO:teuthology.orchestra.run.smithi153.stderr: 72050K .......... .......... .......... .......... .......... 77% 339M 0s 2024-09-19T14:14:28.160 INFO:teuthology.orchestra.run.smithi153.stderr: 72100K .......... .......... .......... .......... .......... 77% 310M 0s 2024-09-19T14:14:28.160 INFO:teuthology.orchestra.run.smithi153.stderr: 72150K .......... .......... .......... .......... .......... 77% 367M 0s 2024-09-19T14:14:28.160 INFO:teuthology.orchestra.run.smithi153.stderr: 72200K .......... .......... .......... .......... .......... 77% 334M 0s 2024-09-19T14:14:28.160 INFO:teuthology.orchestra.run.smithi153.stderr: 72250K .......... .......... .......... .......... .......... 77% 330M 0s 2024-09-19T14:14:28.160 INFO:teuthology.orchestra.run.smithi153.stderr: 72300K .......... .......... .......... .......... .......... 77% 320M 0s 2024-09-19T14:14:28.160 INFO:teuthology.orchestra.run.smithi153.stderr: 72350K .......... .......... .......... .......... .......... 77% 347M 0s 2024-09-19T14:14:28.160 INFO:teuthology.orchestra.run.smithi153.stderr: 72400K .......... .......... .......... .......... .......... 77% 345M 0s 2024-09-19T14:14:28.160 INFO:teuthology.orchestra.run.smithi153.stderr: 72450K .......... .......... .......... .......... .......... 78% 334M 0s 2024-09-19T14:14:28.160 INFO:teuthology.orchestra.run.smithi153.stderr: 72500K .......... .......... .......... .......... .......... 78% 330M 0s 2024-09-19T14:14:28.160 INFO:teuthology.orchestra.run.smithi153.stderr: 72550K .......... .......... .......... .......... .......... 78% 284M 0s 2024-09-19T14:14:28.161 INFO:teuthology.orchestra.run.smithi153.stderr: 72600K .......... .......... .......... .......... .......... 78% 337M 0s 2024-09-19T14:14:28.161 INFO:teuthology.orchestra.run.smithi153.stderr: 72650K .......... .......... .......... .......... .......... 78% 372M 0s 2024-09-19T14:14:28.161 INFO:teuthology.orchestra.run.smithi153.stderr: 72700K .......... .......... .......... .......... .......... 78% 114M 0s 2024-09-19T14:14:28.161 INFO:teuthology.orchestra.run.smithi153.stderr: 72750K .......... .......... .......... .......... .......... 78% 339M 0s 2024-09-19T14:14:28.161 INFO:teuthology.orchestra.run.smithi153.stderr: 72800K .......... .......... .......... .......... .......... 78% 352M 0s 2024-09-19T14:14:28.161 INFO:teuthology.orchestra.run.smithi153.stderr: 72850K .......... .......... .......... .......... .......... 78% 331M 0s 2024-09-19T14:14:28.161 INFO:teuthology.orchestra.run.smithi153.stderr: 72900K .......... .......... .......... .......... .......... 78% 313M 0s 2024-09-19T14:14:28.161 INFO:teuthology.orchestra.run.smithi153.stderr: 72950K .......... .......... .......... .......... .......... 78% 352M 0s 2024-09-19T14:14:28.161 INFO:teuthology.orchestra.run.smithi153.stderr: 73000K .......... .......... .......... .......... .......... 78% 359M 0s 2024-09-19T14:14:28.161 INFO:teuthology.orchestra.run.smithi153.stderr: 73050K .......... .......... .......... .......... .......... 78% 316M 0s 2024-09-19T14:14:28.161 INFO:teuthology.orchestra.run.smithi153.stderr: 73100K .......... .......... .......... .......... .......... 78% 283M 0s 2024-09-19T14:14:28.161 INFO:teuthology.orchestra.run.smithi153.stderr: 73150K .......... .......... .......... .......... .......... 78% 365M 0s 2024-09-19T14:14:28.161 INFO:teuthology.orchestra.run.smithi153.stderr: 73200K .......... .......... .......... .......... .......... 78% 335M 0s 2024-09-19T14:14:28.161 INFO:teuthology.orchestra.run.smithi153.stderr: 73250K .......... .......... .......... .......... .......... 78% 375M 0s 2024-09-19T14:14:28.161 INFO:teuthology.orchestra.run.smithi153.stderr: 73300K .......... .......... .......... .......... .......... 78% 323M 0s 2024-09-19T14:14:28.162 INFO:teuthology.orchestra.run.smithi153.stderr: 73350K .......... .......... .......... .......... .......... 79% 349M 0s 2024-09-19T14:14:28.162 INFO:teuthology.orchestra.run.smithi153.stderr: 73400K .......... .......... .......... .......... .......... 79% 349M 0s 2024-09-19T14:14:28.162 INFO:teuthology.orchestra.run.smithi153.stderr: 73450K .......... .......... .......... .......... .......... 79% 357M 0s 2024-09-19T14:14:28.162 INFO:teuthology.orchestra.run.smithi153.stderr: 73500K .......... .......... .......... .......... .......... 79% 289M 0s 2024-09-19T14:14:28.162 INFO:teuthology.orchestra.run.smithi153.stderr: 73550K .......... .......... .......... .......... .......... 79% 206M 0s 2024-09-19T14:14:28.162 INFO:teuthology.orchestra.run.smithi153.stderr: 73600K .......... .......... .......... .......... .......... 79% 291M 0s 2024-09-19T14:14:28.162 INFO:teuthology.orchestra.run.smithi153.stderr: 73650K .......... .......... .......... .......... .......... 79% 363M 0s 2024-09-19T14:14:28.162 INFO:teuthology.orchestra.run.smithi153.stderr: 73700K .......... .......... .......... .......... .......... 79% 296M 0s 2024-09-19T14:14:28.162 INFO:teuthology.orchestra.run.smithi153.stderr: 73750K .......... .......... .......... .......... .......... 79% 353M 0s 2024-09-19T14:14:28.162 INFO:teuthology.orchestra.run.smithi153.stderr: 73800K .......... .......... .......... .......... .......... 79% 391M 0s 2024-09-19T14:14:28.162 INFO:teuthology.orchestra.run.smithi153.stderr: 73850K .......... .......... .......... .......... .......... 79% 268M 0s 2024-09-19T14:14:28.162 INFO:teuthology.orchestra.run.smithi153.stderr: 73900K .......... .......... .......... .......... .......... 79% 281M 0s 2024-09-19T14:14:28.162 INFO:teuthology.orchestra.run.smithi153.stderr: 73950K .......... .......... .......... .......... .......... 79% 359M 0s 2024-09-19T14:14:28.162 INFO:teuthology.orchestra.run.smithi153.stderr: 74000K .......... .......... .......... .......... .......... 79% 364M 0s 2024-09-19T14:14:28.163 INFO:teuthology.orchestra.run.smithi153.stderr: 74050K .......... .......... .......... .......... .......... 79% 363M 0s 2024-09-19T14:14:28.163 INFO:teuthology.orchestra.run.smithi153.stderr: 74100K .......... .......... .......... .......... .......... 79% 274M 0s 2024-09-19T14:14:28.163 INFO:teuthology.orchestra.run.smithi153.stderr: 74150K .......... .......... .......... .......... .......... 79% 73.4M 0s 2024-09-19T14:14:28.163 INFO:teuthology.orchestra.run.smithi153.stderr: 74200K .......... .......... .......... .......... .......... 79% 117M 0s 2024-09-19T14:14:28.163 INFO:teuthology.orchestra.run.smithi153.stderr: 74250K .......... .......... .......... .......... .......... 79% 268M 0s 2024-09-19T14:14:28.163 INFO:teuthology.orchestra.run.smithi153.stderr: 74300K .......... .......... .......... .......... .......... 80% 233M 0s 2024-09-19T14:14:28.163 INFO:teuthology.orchestra.run.smithi153.stderr: 74350K .......... .......... .......... .......... .......... 80% 207M 0s 2024-09-19T14:14:28.163 INFO:teuthology.orchestra.run.smithi153.stderr: 74400K .......... .......... .......... .......... .......... 80% 377M 0s 2024-09-19T14:14:28.163 INFO:teuthology.orchestra.run.smithi153.stderr: 74450K .......... .......... .......... .......... .......... 80% 325M 0s 2024-09-19T14:14:28.163 INFO:teuthology.orchestra.run.smithi153.stderr: 74500K .......... .......... .......... .......... .......... 80% 318M 0s 2024-09-19T14:14:28.163 INFO:teuthology.orchestra.run.smithi153.stderr: 74550K .......... .......... .......... .......... .......... 80% 139M 0s 2024-09-19T14:14:28.163 INFO:teuthology.orchestra.run.smithi153.stderr: 74600K .......... .......... .......... .......... .......... 80% 299M 0s 2024-09-19T14:14:28.163 INFO:teuthology.orchestra.run.smithi153.stderr: 74650K .......... .......... .......... .......... .......... 80% 381M 0s 2024-09-19T14:14:28.164 INFO:teuthology.orchestra.run.smithi153.stderr: 74700K .......... .......... .......... .......... .......... 80% 134M 0s 2024-09-19T14:14:28.164 INFO:teuthology.orchestra.run.smithi153.stderr: 74750K .......... .......... .......... .......... .......... 80% 316M 0s 2024-09-19T14:14:28.164 INFO:teuthology.orchestra.run.smithi153.stderr: 74800K .......... .......... .......... .......... .......... 80% 381M 0s 2024-09-19T14:14:28.164 INFO:teuthology.orchestra.run.smithi153.stderr: 74850K .......... .......... .......... .......... .......... 80% 202M 0s 2024-09-19T14:14:28.164 INFO:teuthology.orchestra.run.smithi153.stderr: 74900K .......... .......... .......... .......... .......... 80% 50.6M 0s 2024-09-19T14:14:28.164 INFO:teuthology.orchestra.run.smithi153.stderr: 74950K .......... .......... .......... .......... .......... 80% 189M 0s 2024-09-19T14:14:28.164 INFO:teuthology.orchestra.run.smithi153.stderr: 75000K .......... .......... .......... .......... .......... 80% 348M 0s 2024-09-19T14:14:28.164 INFO:teuthology.orchestra.run.smithi153.stderr: 75050K .......... .......... .......... .......... .......... 80% 282M 0s 2024-09-19T14:14:28.164 INFO:teuthology.orchestra.run.smithi153.stderr: 75100K .......... .......... .......... .......... .......... 80% 295M 0s 2024-09-19T14:14:28.164 INFO:teuthology.orchestra.run.smithi153.stderr: 75150K .......... .......... .......... .......... .......... 80% 349M 0s 2024-09-19T14:14:28.164 INFO:teuthology.orchestra.run.smithi153.stderr: 75200K .......... .......... .......... .......... .......... 81% 359M 0s 2024-09-19T14:14:28.164 INFO:teuthology.orchestra.run.smithi153.stderr: 75250K .......... .......... .......... .......... .......... 81% 377M 0s 2024-09-19T14:14:28.165 INFO:teuthology.orchestra.run.smithi153.stderr: 75300K .......... .......... .......... .......... .......... 81% 322M 0s 2024-09-19T14:14:28.165 INFO:teuthology.orchestra.run.smithi153.stderr: 75350K .......... .......... .......... .......... .......... 81% 358M 0s 2024-09-19T14:14:28.165 INFO:teuthology.orchestra.run.smithi153.stderr: 75400K .......... .......... .......... .......... .......... 81% 215M 0s 2024-09-19T14:14:28.165 INFO:teuthology.orchestra.run.smithi153.stderr: 75450K .......... .......... .......... .......... .......... 81% 327M 0s 2024-09-19T14:14:28.165 INFO:teuthology.orchestra.run.smithi153.stderr: 75500K .......... .......... .......... .......... .......... 81% 289M 0s 2024-09-19T14:14:28.165 INFO:teuthology.orchestra.run.smithi153.stderr: 75550K .......... .......... .......... .......... .......... 81% 380M 0s 2024-09-19T14:14:28.165 INFO:teuthology.orchestra.run.smithi153.stderr: 75600K .......... .......... .......... .......... .......... 81% 262M 0s 2024-09-19T14:14:28.165 INFO:teuthology.orchestra.run.smithi153.stderr: 75650K .......... .......... .......... .......... .......... 81% 303M 0s 2024-09-19T14:14:28.165 INFO:teuthology.orchestra.run.smithi153.stderr: 75700K .......... .......... .......... .......... .......... 81% 320M 0s 2024-09-19T14:14:28.165 INFO:teuthology.orchestra.run.smithi153.stderr: 75750K .......... .......... .......... .......... .......... 81% 148M 0s 2024-09-19T14:14:28.165 INFO:teuthology.orchestra.run.smithi153.stderr: 75800K .......... .......... .......... .......... .......... 81% 318M 0s 2024-09-19T14:14:28.165 INFO:teuthology.orchestra.run.smithi153.stderr: 75850K .......... .......... .......... .......... .......... 81% 342M 0s 2024-09-19T14:14:28.165 INFO:teuthology.orchestra.run.smithi153.stderr: 75900K .......... .......... .......... .......... .......... 81% 289M 0s 2024-09-19T14:14:28.165 INFO:teuthology.orchestra.run.smithi153.stderr: 75950K .......... .......... .......... .......... .......... 81% 372M 0s 2024-09-19T14:14:28.166 INFO:teuthology.orchestra.run.smithi153.stderr: 76000K .......... .......... .......... .......... .......... 81% 152M 0s 2024-09-19T14:14:28.166 INFO:teuthology.orchestra.run.smithi153.stderr: 76050K .......... .......... .......... .......... .......... 81% 342M 0s 2024-09-19T14:14:28.166 INFO:teuthology.orchestra.run.smithi153.stderr: 76100K .......... .......... .......... .......... .......... 81% 311M 0s 2024-09-19T14:14:28.166 INFO:teuthology.orchestra.run.smithi153.stderr: 76150K .......... .......... .......... .......... .......... 82% 351M 0s 2024-09-19T14:14:28.166 INFO:teuthology.orchestra.run.smithi153.stderr: 76200K .......... .......... .......... .......... .......... 82% 378M 0s 2024-09-19T14:14:28.166 INFO:teuthology.orchestra.run.smithi153.stderr: 76250K .......... .......... .......... .......... .......... 82% 341M 0s 2024-09-19T14:14:28.166 INFO:teuthology.orchestra.run.smithi153.stderr: 76300K .......... .......... .......... .......... .......... 82% 318M 0s 2024-09-19T14:14:28.166 INFO:teuthology.orchestra.run.smithi153.stderr: 76350K .......... .......... .......... .......... .......... 82% 352M 0s 2024-09-19T14:14:28.166 INFO:teuthology.orchestra.run.smithi153.stderr: 76400K .......... .......... .......... .......... .......... 82% 358M 0s 2024-09-19T14:14:28.166 INFO:teuthology.orchestra.run.smithi153.stderr: 76450K .......... .......... .......... .......... .......... 82% 382M 0s 2024-09-19T14:14:28.166 INFO:teuthology.orchestra.run.smithi153.stderr: 76500K .......... .......... .......... .......... .......... 82% 347M 0s 2024-09-19T14:14:28.166 INFO:teuthology.orchestra.run.smithi153.stderr: 76550K .......... .......... .......... .......... .......... 82% 135M 0s 2024-09-19T14:14:28.166 INFO:teuthology.orchestra.run.smithi153.stderr: 76600K .......... .......... .......... .......... .......... 82% 342M 0s 2024-09-19T14:14:28.166 INFO:teuthology.orchestra.run.smithi153.stderr: 76650K .......... .......... .......... .......... .......... 82% 347M 0s 2024-09-19T14:14:28.167 INFO:teuthology.orchestra.run.smithi153.stderr: 76700K .......... .......... .......... .......... .......... 82% 295M 0s 2024-09-19T14:14:28.167 INFO:teuthology.orchestra.run.smithi153.stderr: 76750K .......... .......... .......... .......... .......... 82% 363M 0s 2024-09-19T14:14:28.167 INFO:teuthology.orchestra.run.smithi153.stderr: 76800K .......... .......... .......... .......... .......... 82% 384M 0s 2024-09-19T14:14:28.167 INFO:teuthology.orchestra.run.smithi153.stderr: 76850K .......... .......... .......... .......... .......... 82% 396M 0s 2024-09-19T14:14:28.167 INFO:teuthology.orchestra.run.smithi153.stderr: 76900K .......... .......... .......... .......... .......... 82% 342M 0s 2024-09-19T14:14:28.167 INFO:teuthology.orchestra.run.smithi153.stderr: 76950K .......... .......... .......... .......... .......... 82% 277M 0s 2024-09-19T14:14:28.167 INFO:teuthology.orchestra.run.smithi153.stderr: 77000K .......... .......... .......... .......... .......... 82% 344M 0s 2024-09-19T14:14:28.167 INFO:teuthology.orchestra.run.smithi153.stderr: 77050K .......... .......... .......... .......... .......... 82% 381M 0s 2024-09-19T14:14:28.167 INFO:teuthology.orchestra.run.smithi153.stderr: 77100K .......... .......... .......... .......... .......... 83% 316M 0s 2024-09-19T14:14:28.167 INFO:teuthology.orchestra.run.smithi153.stderr: 77150K .......... .......... .......... .......... .......... 83% 121M 0s 2024-09-19T14:14:28.167 INFO:teuthology.orchestra.run.smithi153.stderr: 77200K .......... .......... .......... .......... .......... 83% 121M 0s 2024-09-19T14:14:28.167 INFO:teuthology.orchestra.run.smithi153.stderr: 77250K .......... .......... .......... .......... .......... 83% 96.2M 0s 2024-09-19T14:14:28.167 INFO:teuthology.orchestra.run.smithi153.stderr: 77300K .......... .......... .......... .......... .......... 83% 255M 0s 2024-09-19T14:14:28.167 INFO:teuthology.orchestra.run.smithi153.stderr: 77350K .......... .......... .......... .......... .......... 83% 325M 0s 2024-09-19T14:14:28.167 INFO:teuthology.orchestra.run.smithi153.stderr: 77400K .......... .......... .......... .......... .......... 83% 318M 0s 2024-09-19T14:14:28.168 INFO:teuthology.orchestra.run.smithi153.stderr: 77450K .......... .......... .......... .......... .......... 83% 386M 0s 2024-09-19T14:14:28.168 INFO:teuthology.orchestra.run.smithi153.stderr: 77500K .......... .......... .......... .......... .......... 83% 301M 0s 2024-09-19T14:14:28.168 INFO:teuthology.orchestra.run.smithi153.stderr: 77550K .......... .......... .......... .......... .......... 83% 169M 0s 2024-09-19T14:14:28.168 INFO:teuthology.orchestra.run.smithi153.stderr: 77600K .......... .......... .......... .......... .......... 83% 242M 0s 2024-09-19T14:14:28.168 INFO:teuthology.orchestra.run.smithi153.stderr: 77650K .......... .......... .......... .......... .......... 83% 350M 0s 2024-09-19T14:14:28.168 INFO:teuthology.orchestra.run.smithi153.stderr: 77700K .......... .......... .......... .......... .......... 83% 245M 0s 2024-09-19T14:14:28.168 INFO:teuthology.orchestra.run.smithi153.stderr: 77750K .......... .......... .......... .......... .......... 83% 352M 0s 2024-09-19T14:14:28.168 INFO:teuthology.orchestra.run.smithi153.stderr: 77800K .......... .......... .......... .......... .......... 83% 366M 0s 2024-09-19T14:14:28.168 INFO:teuthology.orchestra.run.smithi153.stderr: 77850K .......... .......... .......... .......... .......... 83% 350M 0s 2024-09-19T14:14:28.168 INFO:teuthology.orchestra.run.smithi153.stderr: 77900K .......... .......... .......... .......... .......... 83% 48.6M 0s 2024-09-19T14:14:28.168 INFO:teuthology.orchestra.run.smithi153.stderr: 77950K .......... .......... .......... .......... .......... 83% 206M 0s 2024-09-19T14:14:28.168 INFO:teuthology.orchestra.run.smithi153.stderr: 78000K .......... .......... .......... .......... .......... 84% 315M 0s 2024-09-19T14:14:28.168 INFO:teuthology.orchestra.run.smithi153.stderr: 78050K .......... .......... .......... .......... .......... 84% 319M 0s 2024-09-19T14:14:28.168 INFO:teuthology.orchestra.run.smithi153.stderr: 78100K .......... .......... .......... .......... .......... 84% 167M 0s 2024-09-19T14:14:28.169 INFO:teuthology.orchestra.run.smithi153.stderr: 78150K .......... .......... .......... .......... .......... 84% 244M 0s 2024-09-19T14:14:28.169 INFO:teuthology.orchestra.run.smithi153.stderr: 78200K .......... .......... .......... .......... .......... 84% 295M 0s 2024-09-19T14:14:28.169 INFO:teuthology.orchestra.run.smithi153.stderr: 78250K .......... .......... .......... .......... .......... 84% 220M 0s 2024-09-19T14:14:28.169 INFO:teuthology.orchestra.run.smithi153.stderr: 78300K .......... .......... .......... .......... .......... 84% 294M 0s 2024-09-19T14:14:28.169 INFO:teuthology.orchestra.run.smithi153.stderr: 78350K .......... .......... .......... .......... .......... 84% 377M 0s 2024-09-19T14:14:28.169 INFO:teuthology.orchestra.run.smithi153.stderr: 78400K .......... .......... .......... .......... .......... 84% 373M 0s 2024-09-19T14:14:28.169 INFO:teuthology.orchestra.run.smithi153.stderr: 78450K .......... .......... .......... .......... .......... 84% 177M 0s 2024-09-19T14:14:28.169 INFO:teuthology.orchestra.run.smithi153.stderr: 78500K .......... .......... .......... .......... .......... 84% 313M 0s 2024-09-19T14:14:28.169 INFO:teuthology.orchestra.run.smithi153.stderr: 78550K .......... .......... .......... .......... .......... 84% 361M 0s 2024-09-19T14:14:28.169 INFO:teuthology.orchestra.run.smithi153.stderr: 78600K .......... .......... .......... .......... .......... 84% 370M 0s 2024-09-19T14:14:28.169 INFO:teuthology.orchestra.run.smithi153.stderr: 78650K .......... .......... .......... .......... .......... 84% 370M 0s 2024-09-19T14:14:28.169 INFO:teuthology.orchestra.run.smithi153.stderr: 78700K .......... .......... .......... .......... .......... 84% 219M 0s 2024-09-19T14:14:28.169 INFO:teuthology.orchestra.run.smithi153.stderr: 78750K .......... .......... .......... .......... .......... 84% 312M 0s 2024-09-19T14:14:28.170 INFO:teuthology.orchestra.run.smithi153.stderr: 78800K .......... .......... .......... .......... .......... 84% 364M 0s 2024-09-19T14:14:28.170 INFO:teuthology.orchestra.run.smithi153.stderr: 78850K .......... .......... .......... .......... .......... 84% 148M 0s 2024-09-19T14:14:28.170 INFO:teuthology.orchestra.run.smithi153.stderr: 78900K .......... .......... .......... .......... .......... 84% 309M 0s 2024-09-19T14:14:28.170 INFO:teuthology.orchestra.run.smithi153.stderr: 78950K .......... .......... .......... .......... .......... 85% 379M 0s 2024-09-19T14:14:28.170 INFO:teuthology.orchestra.run.smithi153.stderr: 79000K .......... .......... .......... .......... .......... 85% 354M 0s 2024-09-19T14:14:28.170 INFO:teuthology.orchestra.run.smithi153.stderr: 79050K .......... .......... .......... .......... .......... 85% 219M 0s 2024-09-19T14:14:28.170 INFO:teuthology.orchestra.run.smithi153.stderr: 79100K .......... .......... .......... .......... .......... 85% 207M 0s 2024-09-19T14:14:28.170 INFO:teuthology.orchestra.run.smithi153.stderr: 79150K .......... .......... .......... .......... .......... 85% 125M 0s 2024-09-19T14:14:28.170 INFO:teuthology.orchestra.run.smithi153.stderr: 79200K .......... .......... .......... .......... .......... 85% 295M 0s 2024-09-19T14:14:28.170 INFO:teuthology.orchestra.run.smithi153.stderr: 79250K .......... .......... .......... .......... .......... 85% 340M 0s 2024-09-19T14:14:28.170 INFO:teuthology.orchestra.run.smithi153.stderr: 79300K .......... .......... .......... .......... .......... 85% 316M 0s 2024-09-19T14:14:28.170 INFO:teuthology.orchestra.run.smithi153.stderr: 79350K .......... .......... .......... .......... .......... 85% 382M 0s 2024-09-19T14:14:28.170 INFO:teuthology.orchestra.run.smithi153.stderr: 79400K .......... .......... .......... .......... .......... 85% 382M 0s 2024-09-19T14:14:28.170 INFO:teuthology.orchestra.run.smithi153.stderr: 79450K .......... .......... .......... .......... .......... 85% 370M 0s 2024-09-19T14:14:28.170 INFO:teuthology.orchestra.run.smithi153.stderr: 79500K .......... .......... .......... .......... .......... 85% 76.8M 0s 2024-09-19T14:14:28.171 INFO:teuthology.orchestra.run.smithi153.stderr: 79550K .......... .......... .......... .......... .......... 85% 334M 0s 2024-09-19T14:14:28.171 INFO:teuthology.orchestra.run.smithi153.stderr: 79600K .......... .......... .......... .......... .......... 85% 335M 0s 2024-09-19T14:14:28.171 INFO:teuthology.orchestra.run.smithi153.stderr: 79650K .......... .......... .......... .......... .......... 85% 335M 0s 2024-09-19T14:14:28.171 INFO:teuthology.orchestra.run.smithi153.stderr: 79700K .......... .......... .......... .......... .......... 85% 338M 0s 2024-09-19T14:14:28.171 INFO:teuthology.orchestra.run.smithi153.stderr: 79750K .......... .......... .......... .......... .......... 85% 360M 0s 2024-09-19T14:14:28.171 INFO:teuthology.orchestra.run.smithi153.stderr: 79800K .......... .......... .......... .......... .......... 85% 369M 0s 2024-09-19T14:14:28.171 INFO:teuthology.orchestra.run.smithi153.stderr: 79850K .......... .......... .......... .......... .......... 86% 380M 0s 2024-09-19T14:14:28.171 INFO:teuthology.orchestra.run.smithi153.stderr: 79900K .......... .......... .......... .......... .......... 86% 312M 0s 2024-09-19T14:14:28.171 INFO:teuthology.orchestra.run.smithi153.stderr: 79950K .......... .......... .......... .......... .......... 86% 345M 0s 2024-09-19T14:14:28.171 INFO:teuthology.orchestra.run.smithi153.stderr: 80000K .......... .......... .......... .......... .......... 86% 381M 0s 2024-09-19T14:14:28.171 INFO:teuthology.orchestra.run.smithi153.stderr: 80050K .......... .......... .......... .......... .......... 86% 380M 0s 2024-09-19T14:14:28.171 INFO:teuthology.orchestra.run.smithi153.stderr: 80100K .......... .......... .......... .......... .......... 86% 324M 0s 2024-09-19T14:14:28.171 INFO:teuthology.orchestra.run.smithi153.stderr: 80150K .......... .......... .......... .......... .......... 86% 361M 0s 2024-09-19T14:14:28.171 INFO:teuthology.orchestra.run.smithi153.stderr: 80200K .......... .......... .......... .......... .......... 86% 387M 0s 2024-09-19T14:14:28.172 INFO:teuthology.orchestra.run.smithi153.stderr: 80250K .......... .......... .......... .......... .......... 86% 161M 0s 2024-09-19T14:14:28.172 INFO:teuthology.orchestra.run.smithi153.stderr: 80300K .......... .......... .......... .......... .......... 86% 170M 0s 2024-09-19T14:14:28.172 INFO:teuthology.orchestra.run.smithi153.stderr: 80350K .......... .......... .......... .......... .......... 86% 328M 0s 2024-09-19T14:14:28.172 INFO:teuthology.orchestra.run.smithi153.stderr: 80400K .......... .......... .......... .......... .......... 86% 339M 0s 2024-09-19T14:14:28.172 INFO:teuthology.orchestra.run.smithi153.stderr: 80450K .......... .......... .......... .......... .......... 86% 368M 0s 2024-09-19T14:14:28.172 INFO:teuthology.orchestra.run.smithi153.stderr: 80500K .......... .......... .......... .......... .......... 86% 174M 0s 2024-09-19T14:14:28.172 INFO:teuthology.orchestra.run.smithi153.stderr: 80550K .......... .......... .......... .......... .......... 86% 284M 0s 2024-09-19T14:14:28.172 INFO:teuthology.orchestra.run.smithi153.stderr: 80600K .......... .......... .......... .......... .......... 86% 341M 0s 2024-09-19T14:14:28.172 INFO:teuthology.orchestra.run.smithi153.stderr: 80650K .......... .......... .......... .......... .......... 86% 216M 0s 2024-09-19T14:14:28.172 INFO:teuthology.orchestra.run.smithi153.stderr: 80700K .......... .......... .......... .......... .......... 86% 302M 0s 2024-09-19T14:14:28.172 INFO:teuthology.orchestra.run.smithi153.stderr: 80750K .......... .......... .......... .......... .......... 86% 295M 0s 2024-09-19T14:14:28.172 INFO:teuthology.orchestra.run.smithi153.stderr: 80800K .......... .......... .......... .......... .......... 87% 344M 0s 2024-09-19T14:14:28.172 INFO:teuthology.orchestra.run.smithi153.stderr: 80850K .......... .......... .......... .......... .......... 87% 381M 0s 2024-09-19T14:14:28.172 INFO:teuthology.orchestra.run.smithi153.stderr: 80900K .......... .......... .......... .......... .......... 87% 61.2M 0s 2024-09-19T14:14:28.172 INFO:teuthology.orchestra.run.smithi153.stderr: 80950K .......... .......... .......... .......... .......... 87% 167M 0s 2024-09-19T14:14:28.173 INFO:teuthology.orchestra.run.smithi153.stderr: 81000K .......... .......... .......... .......... .......... 87% 136M 0s 2024-09-19T14:14:28.173 INFO:teuthology.orchestra.run.smithi153.stderr: 81050K .......... .......... .......... .......... .......... 87% 325M 0s 2024-09-19T14:14:28.173 INFO:teuthology.orchestra.run.smithi153.stderr: 81100K .......... .......... .......... .......... .......... 87% 306M 0s 2024-09-19T14:14:28.173 INFO:teuthology.orchestra.run.smithi153.stderr: 81150K .......... .......... .......... .......... .......... 87% 351M 0s 2024-09-19T14:14:28.173 INFO:teuthology.orchestra.run.smithi153.stderr: 81200K .......... .......... .......... .......... .......... 87% 268M 0s 2024-09-19T14:14:28.173 INFO:teuthology.orchestra.run.smithi153.stderr: 81250K .......... .......... .......... .......... .......... 87% 128M 0s 2024-09-19T14:14:28.173 INFO:teuthology.orchestra.run.smithi153.stderr: 81300K .......... .......... .......... .......... .......... 87% 286M 0s 2024-09-19T14:14:28.173 INFO:teuthology.orchestra.run.smithi153.stderr: 81350K .......... .......... .......... .......... .......... 87% 334M 0s 2024-09-19T14:14:28.173 INFO:teuthology.orchestra.run.smithi153.stderr: 81400K .......... .......... .......... .......... .......... 87% 369M 0s 2024-09-19T14:14:28.173 INFO:teuthology.orchestra.run.smithi153.stderr: 81450K .......... .......... .......... .......... .......... 87% 354M 0s 2024-09-19T14:14:28.173 INFO:teuthology.orchestra.run.smithi153.stderr: 81500K .......... .......... .......... .......... .......... 87% 208M 0s 2024-09-19T14:14:28.173 INFO:teuthology.orchestra.run.smithi153.stderr: 81550K .......... .......... .......... .......... .......... 87% 281M 0s 2024-09-19T14:14:28.173 INFO:teuthology.orchestra.run.smithi153.stderr: 81600K .......... .......... .......... .......... .......... 87% 380M 0s 2024-09-19T14:14:28.173 INFO:teuthology.orchestra.run.smithi153.stderr: 81650K .......... .......... .......... .......... .......... 87% 178M 0s 2024-09-19T14:14:28.174 INFO:teuthology.orchestra.run.smithi153.stderr: 81700K .......... .......... .......... .......... .......... 87% 254M 0s 2024-09-19T14:14:28.174 INFO:teuthology.orchestra.run.smithi153.stderr: 81750K .......... .......... .......... .......... .......... 88% 330M 0s 2024-09-19T14:14:28.174 INFO:teuthology.orchestra.run.smithi153.stderr: 81800K .......... .......... .......... .......... .......... 88% 359M 0s 2024-09-19T14:14:28.174 INFO:teuthology.orchestra.run.smithi153.stderr: 81850K .......... .......... .......... .......... .......... 88% 365M 0s 2024-09-19T14:14:28.174 INFO:teuthology.orchestra.run.smithi153.stderr: 81900K .......... .......... .......... .......... .......... 88% 336M 0s 2024-09-19T14:14:28.174 INFO:teuthology.orchestra.run.smithi153.stderr: 81950K .......... .......... .......... .......... .......... 88% 313M 0s 2024-09-19T14:14:28.174 INFO:teuthology.orchestra.run.smithi153.stderr: 82000K .......... .......... .......... .......... .......... 88% 300M 0s 2024-09-19T14:14:28.174 INFO:teuthology.orchestra.run.smithi153.stderr: 82050K .......... .......... .......... .......... .......... 88% 342M 0s 2024-09-19T14:14:28.174 INFO:teuthology.orchestra.run.smithi153.stderr: 82100K .......... .......... .......... .......... .......... 88% 131M 0s 2024-09-19T14:14:28.174 INFO:teuthology.orchestra.run.smithi153.stderr: 82150K .......... .......... .......... .......... .......... 88% 232M 0s 2024-09-19T14:14:28.174 INFO:teuthology.orchestra.run.smithi153.stderr: 82200K .......... .......... .......... .......... .......... 88% 365M 0s 2024-09-19T14:14:28.174 INFO:teuthology.orchestra.run.smithi153.stderr: 82250K .......... .......... .......... .......... .......... 88% 88.9M 0s 2024-09-19T14:14:28.174 INFO:teuthology.orchestra.run.smithi153.stderr: 82300K .......... .......... .......... .......... .......... 88% 287M 0s 2024-09-19T14:14:28.175 INFO:teuthology.orchestra.run.smithi153.stderr: 82350K .......... .......... .......... .......... .......... 88% 362M 0s 2024-09-19T14:14:28.175 INFO:teuthology.orchestra.run.smithi153.stderr: 82400K .......... .......... .......... .......... .......... 88% 99.1M 0s 2024-09-19T14:14:28.175 INFO:teuthology.orchestra.run.smithi153.stderr: 82450K .......... .......... .......... .......... .......... 88% 326M 0s 2024-09-19T14:14:28.175 INFO:teuthology.orchestra.run.smithi153.stderr: 82500K .......... .......... .......... .......... .......... 88% 286M 0s 2024-09-19T14:14:28.175 INFO:teuthology.orchestra.run.smithi153.stderr: 82550K .......... .......... .......... .......... .......... 88% 357M 0s 2024-09-19T14:14:28.175 INFO:teuthology.orchestra.run.smithi153.stderr: 82600K .......... .......... .......... .......... .......... 88% 345M 0s 2024-09-19T14:14:28.175 INFO:teuthology.orchestra.run.smithi153.stderr: 82650K .......... .......... .......... .......... .......... 89% 325M 0s 2024-09-19T14:14:28.175 INFO:teuthology.orchestra.run.smithi153.stderr: 82700K .......... .......... .......... .......... .......... 89% 292M 0s 2024-09-19T14:14:28.175 INFO:teuthology.orchestra.run.smithi153.stderr: 82750K .......... .......... .......... .......... .......... 89% 375M 0s 2024-09-19T14:14:28.175 INFO:teuthology.orchestra.run.smithi153.stderr: 82800K .......... .......... .......... .......... .......... 89% 370M 0s 2024-09-19T14:14:28.175 INFO:teuthology.orchestra.run.smithi153.stderr: 82850K .......... .......... .......... .......... .......... 89% 333M 0s 2024-09-19T14:14:28.175 INFO:teuthology.orchestra.run.smithi153.stderr: 82900K .......... .......... .......... .......... .......... 89% 312M 0s 2024-09-19T14:14:28.175 INFO:teuthology.orchestra.run.smithi153.stderr: 82950K .......... .......... .......... .......... .......... 89% 387M 0s 2024-09-19T14:14:28.175 INFO:teuthology.orchestra.run.smithi153.stderr: 83000K .......... .......... .......... .......... .......... 89% 371M 0s 2024-09-19T14:14:28.176 INFO:teuthology.orchestra.run.smithi153.stderr: 83050K .......... .......... .......... .......... .......... 89% 366M 0s 2024-09-19T14:14:28.176 INFO:teuthology.orchestra.run.smithi153.stderr: 83100K .......... .......... .......... .......... .......... 89% 325M 0s 2024-09-19T14:14:28.176 INFO:teuthology.orchestra.run.smithi153.stderr: 83150K .......... .......... .......... .......... .......... 89% 192M 0s 2024-09-19T14:14:28.176 INFO:teuthology.orchestra.run.smithi153.stderr: 83200K .......... .......... .......... .......... .......... 89% 334M 0s 2024-09-19T14:14:28.176 INFO:teuthology.orchestra.run.smithi153.stderr: 83250K .......... .......... .......... .......... .......... 89% 356M 0s 2024-09-19T14:14:28.176 INFO:teuthology.orchestra.run.smithi153.stderr: 83300K .......... .......... .......... .......... .......... 89% 329M 0s 2024-09-19T14:14:28.176 INFO:teuthology.orchestra.run.smithi153.stderr: 83350K .......... .......... .......... .......... .......... 89% 364M 0s 2024-09-19T14:14:28.176 INFO:teuthology.orchestra.run.smithi153.stderr: 83400K .......... .......... .......... .......... .......... 89% 394M 0s 2024-09-19T14:14:28.176 INFO:teuthology.orchestra.run.smithi153.stderr: 83450K .......... .......... .......... .......... .......... 89% 380M 0s 2024-09-19T14:14:28.176 INFO:teuthology.orchestra.run.smithi153.stderr: 83500K .......... .......... .......... .......... .......... 89% 176M 0s 2024-09-19T14:14:28.176 INFO:teuthology.orchestra.run.smithi153.stderr: 83550K .......... .......... .......... .......... .......... 89% 342M 0s 2024-09-19T14:14:28.176 INFO:teuthology.orchestra.run.smithi153.stderr: 83600K .......... .......... .......... .......... .......... 90% 367M 0s 2024-09-19T14:14:28.176 INFO:teuthology.orchestra.run.smithi153.stderr: 83650K .......... .......... .......... .......... .......... 90% 239M 0s 2024-09-19T14:14:28.176 INFO:teuthology.orchestra.run.smithi153.stderr: 83700K .......... .......... .......... .......... .......... 90% 16.7M 0s 2024-09-19T14:14:28.177 INFO:teuthology.orchestra.run.smithi153.stderr: 83750K .......... .......... .......... .......... .......... 90% 283M 0s 2024-09-19T14:14:28.177 INFO:teuthology.orchestra.run.smithi153.stderr: 83800K .......... .......... .......... .......... .......... 90% 243M 0s 2024-09-19T14:14:28.177 INFO:teuthology.orchestra.run.smithi153.stderr: 83850K .......... .......... .......... .......... .......... 90% 381M 0s 2024-09-19T14:14:28.177 INFO:teuthology.orchestra.run.smithi153.stderr: 83900K .......... .......... .......... .......... .......... 90% 177M 0s 2024-09-19T14:14:28.177 INFO:teuthology.orchestra.run.smithi153.stderr: 83950K .......... .......... .......... .......... .......... 90% 310M 0s 2024-09-19T14:14:28.177 INFO:teuthology.orchestra.run.smithi153.stderr: 84000K .......... .......... .......... .......... .......... 90% 382M 0s 2024-09-19T14:14:28.177 INFO:teuthology.orchestra.run.smithi153.stderr: 84050K .......... .......... .......... .......... .......... 90% 334M 0s 2024-09-19T14:14:28.177 INFO:teuthology.orchestra.run.smithi153.stderr: 84100K .......... .......... .......... .......... .......... 90% 328M 0s 2024-09-19T14:14:28.177 INFO:teuthology.orchestra.run.smithi153.stderr: 84150K .......... .......... .......... .......... .......... 90% 347M 0s 2024-09-19T14:14:28.177 INFO:teuthology.orchestra.run.smithi153.stderr: 84200K .......... .......... .......... .......... .......... 90% 336M 0s 2024-09-19T14:14:28.177 INFO:teuthology.orchestra.run.smithi153.stderr: 84250K .......... .......... .......... .......... .......... 90% 332M 0s 2024-09-19T14:14:28.177 INFO:teuthology.orchestra.run.smithi153.stderr: 84300K .......... .......... .......... .......... .......... 90% 287M 0s 2024-09-19T14:14:28.177 INFO:teuthology.orchestra.run.smithi153.stderr: 84350K .......... .......... .......... .......... .......... 90% 336M 0s 2024-09-19T14:14:28.178 INFO:teuthology.orchestra.run.smithi153.stderr: 84400K .......... .......... .......... .......... .......... 90% 337M 0s 2024-09-19T14:14:28.178 INFO:teuthology.orchestra.run.smithi153.stderr: 84450K .......... .......... .......... .......... .......... 90% 308M 0s 2024-09-19T14:14:28.178 INFO:teuthology.orchestra.run.smithi153.stderr: 84500K .......... .......... .......... .......... .......... 91% 324M 0s 2024-09-19T14:14:28.178 INFO:teuthology.orchestra.run.smithi153.stderr: 84550K .......... .......... .......... .......... .......... 91% 326M 0s 2024-09-19T14:14:28.178 INFO:teuthology.orchestra.run.smithi153.stderr: 84600K .......... .......... .......... .......... .......... 91% 333M 0s 2024-09-19T14:14:28.178 INFO:teuthology.orchestra.run.smithi153.stderr: 84650K .......... .......... .......... .......... .......... 91% 360M 0s 2024-09-19T14:14:28.178 INFO:teuthology.orchestra.run.smithi153.stderr: 84700K .......... .......... .......... .......... .......... 91% 278M 0s 2024-09-19T14:14:28.178 INFO:teuthology.orchestra.run.smithi153.stderr: 84750K .......... .......... .......... .......... .......... 91% 326M 0s 2024-09-19T14:14:28.178 INFO:teuthology.orchestra.run.smithi153.stderr: 84800K .......... .......... .......... .......... .......... 91% 362M 0s 2024-09-19T14:14:28.178 INFO:teuthology.orchestra.run.smithi153.stderr: 84850K .......... .......... .......... .......... .......... 91% 385M 0s 2024-09-19T14:14:28.178 INFO:teuthology.orchestra.run.smithi153.stderr: 84900K .......... .......... .......... .......... .......... 91% 346M 0s 2024-09-19T14:14:28.178 INFO:teuthology.orchestra.run.smithi153.stderr: 84950K .......... .......... .......... .......... .......... 91% 381M 0s 2024-09-19T14:14:28.178 INFO:teuthology.orchestra.run.smithi153.stderr: 85000K .......... .......... .......... .......... .......... 91% 388M 0s 2024-09-19T14:14:28.179 INFO:teuthology.orchestra.run.smithi153.stderr: 85050K .......... .......... .......... .......... .......... 91% 379M 0s 2024-09-19T14:14:28.179 INFO:teuthology.orchestra.run.smithi153.stderr: 85100K .......... .......... .......... .......... .......... 91% 285M 0s 2024-09-19T14:14:28.179 INFO:teuthology.orchestra.run.smithi153.stderr: 85150K .......... .......... .......... .......... .......... 91% 325M 0s 2024-09-19T14:14:28.179 INFO:teuthology.orchestra.run.smithi153.stderr: 85200K .......... .......... .......... .......... .......... 91% 371M 0s 2024-09-19T14:14:28.179 INFO:teuthology.orchestra.run.smithi153.stderr: 85250K .......... .......... .......... .......... .......... 91% 381M 0s 2024-09-19T14:14:28.179 INFO:teuthology.orchestra.run.smithi153.stderr: 85300K .......... .......... .......... .......... .......... 91% 328M 0s 2024-09-19T14:14:28.179 INFO:teuthology.orchestra.run.smithi153.stderr: 85350K .......... .......... .......... .......... .......... 91% 379M 0s 2024-09-19T14:14:28.179 INFO:teuthology.orchestra.run.smithi153.stderr: 85400K .......... .......... .......... .......... .......... 91% 359M 0s 2024-09-19T14:14:28.179 INFO:teuthology.orchestra.run.smithi153.stderr: 85450K .......... .......... .......... .......... .......... 92% 354M 0s 2024-09-19T14:14:28.179 INFO:teuthology.orchestra.run.smithi153.stderr: 85500K .......... .......... .......... .......... .......... 92% 307M 0s 2024-09-19T14:14:28.179 INFO:teuthology.orchestra.run.smithi153.stderr: 85550K .......... .......... .......... .......... .......... 92% 334M 0s 2024-09-19T14:14:28.179 INFO:teuthology.orchestra.run.smithi153.stderr: 85600K .......... .......... .......... .......... .......... 92% 383M 0s 2024-09-19T14:14:28.179 INFO:teuthology.orchestra.run.smithi153.stderr: 85650K .......... .......... .......... .......... .......... 92% 87.9M 0s 2024-09-19T14:14:28.179 INFO:teuthology.orchestra.run.smithi153.stderr: 85700K .......... .......... .......... .......... .......... 92% 253M 0s 2024-09-19T14:14:28.180 INFO:teuthology.orchestra.run.smithi153.stderr: 85750K .......... .......... .......... .......... .......... 92% 362M 0s 2024-09-19T14:14:28.180 INFO:teuthology.orchestra.run.smithi153.stderr: 85800K .......... .......... .......... .......... .......... 92% 333M 0s 2024-09-19T14:14:28.180 INFO:teuthology.orchestra.run.smithi153.stderr: 85850K .......... .......... .......... .......... .......... 92% 363M 0s 2024-09-19T14:14:28.180 INFO:teuthology.orchestra.run.smithi153.stderr: 85900K .......... .......... .......... .......... .......... 92% 312M 0s 2024-09-19T14:14:28.180 INFO:teuthology.orchestra.run.smithi153.stderr: 85950K .......... .......... .......... .......... .......... 92% 362M 0s 2024-09-19T14:14:28.180 INFO:teuthology.orchestra.run.smithi153.stderr: 86000K .......... .......... .......... .......... .......... 92% 350M 0s 2024-09-19T14:14:28.180 INFO:teuthology.orchestra.run.smithi153.stderr: 86050K .......... .......... .......... .......... .......... 92% 326M 0s 2024-09-19T14:14:28.180 INFO:teuthology.orchestra.run.smithi153.stderr: 86100K .......... .......... .......... .......... .......... 92% 251M 0s 2024-09-19T14:14:28.180 INFO:teuthology.orchestra.run.smithi153.stderr: 86150K .......... .......... .......... .......... .......... 92% 371M 0s 2024-09-19T14:14:28.180 INFO:teuthology.orchestra.run.smithi153.stderr: 86200K .......... .......... .......... .......... .......... 92% 377M 0s 2024-09-19T14:14:28.180 INFO:teuthology.orchestra.run.smithi153.stderr: 86250K .......... .......... .......... .......... .......... 92% 347M 0s 2024-09-19T14:14:28.180 INFO:teuthology.orchestra.run.smithi153.stderr: 86300K .......... .......... .......... .......... .......... 92% 287M 0s 2024-09-19T14:14:28.180 INFO:teuthology.orchestra.run.smithi153.stderr: 86350K .......... .......... .......... .......... .......... 93% 373M 0s 2024-09-19T14:14:28.181 INFO:teuthology.orchestra.run.smithi153.stderr: 86400K .......... .......... .......... .......... .......... 93% 346M 0s 2024-09-19T14:14:28.181 INFO:teuthology.orchestra.run.smithi153.stderr: 86450K .......... .......... .......... .......... .......... 93% 329M 0s 2024-09-19T14:14:28.181 INFO:teuthology.orchestra.run.smithi153.stderr: 86500K .......... .......... .......... .......... .......... 93% 346M 0s 2024-09-19T14:14:28.181 INFO:teuthology.orchestra.run.smithi153.stderr: 86550K .......... .......... .......... .......... .......... 93% 386M 0s 2024-09-19T14:14:28.181 INFO:teuthology.orchestra.run.smithi153.stderr: 86600K .......... .......... .......... .......... .......... 93% 386M 0s 2024-09-19T14:14:28.181 INFO:teuthology.orchestra.run.smithi153.stderr: 86650K .......... .......... .......... .......... .......... 93% 390M 0s 2024-09-19T14:14:28.181 INFO:teuthology.orchestra.run.smithi153.stderr: 86700K .......... .......... .......... .......... .......... 93% 18.4M 0s 2024-09-19T14:14:28.181 INFO:teuthology.orchestra.run.smithi153.stderr: 86750K .......... .......... .......... .......... .......... 93% 38.2M 0s 2024-09-19T14:14:28.181 INFO:teuthology.orchestra.run.smithi153.stderr: 86800K .......... .......... .......... .......... .......... 93% 353M 0s 2024-09-19T14:14:28.181 INFO:teuthology.orchestra.run.smithi153.stderr: 86850K .......... .......... .......... .......... .......... 93% 289M 0s 2024-09-19T14:14:28.181 INFO:teuthology.orchestra.run.smithi153.stderr: 86900K .......... .......... .......... .......... .......... 93% 215M 0s 2024-09-19T14:14:28.181 INFO:teuthology.orchestra.run.smithi153.stderr: 86950K .......... .......... .......... .......... .......... 93% 306M 0s 2024-09-19T14:14:28.181 INFO:teuthology.orchestra.run.smithi153.stderr: 87000K .......... .......... .......... .......... .......... 93% 346M 0s 2024-09-19T14:14:28.182 INFO:teuthology.orchestra.run.smithi153.stderr: 87050K .......... .......... .......... .......... .......... 93% 332M 0s 2024-09-19T14:14:28.182 INFO:teuthology.orchestra.run.smithi153.stderr: 87100K .......... .......... .......... .......... .......... 93% 274M 0s 2024-09-19T14:14:28.182 INFO:teuthology.orchestra.run.smithi153.stderr: 87150K .......... .......... .......... .......... .......... 93% 311M 0s 2024-09-19T14:14:28.182 INFO:teuthology.orchestra.run.smithi153.stderr: 87200K .......... .......... .......... .......... .......... 93% 333M 0s 2024-09-19T14:14:28.182 INFO:teuthology.orchestra.run.smithi153.stderr: 87250K .......... .......... .......... .......... .......... 93% 322M 0s 2024-09-19T14:14:28.182 INFO:teuthology.orchestra.run.smithi153.stderr: 87300K .......... .......... .......... .......... .......... 94% 287M 0s 2024-09-19T14:14:28.182 INFO:teuthology.orchestra.run.smithi153.stderr: 87350K .......... .......... .......... .......... .......... 94% 312M 0s 2024-09-19T14:14:28.182 INFO:teuthology.orchestra.run.smithi153.stderr: 87400K .......... .......... .......... .......... .......... 94% 328M 0s 2024-09-19T14:14:28.182 INFO:teuthology.orchestra.run.smithi153.stderr: 87450K .......... .......... .......... .......... .......... 94% 305M 0s 2024-09-19T14:14:28.182 INFO:teuthology.orchestra.run.smithi153.stderr: 87500K .......... .......... .......... .......... .......... 94% 273M 0s 2024-09-19T14:14:28.182 INFO:teuthology.orchestra.run.smithi153.stderr: 87550K .......... .......... .......... .......... .......... 94% 316M 0s 2024-09-19T14:14:28.182 INFO:teuthology.orchestra.run.smithi153.stderr: 87600K .......... .......... .......... .......... .......... 94% 312M 0s 2024-09-19T14:14:28.182 INFO:teuthology.orchestra.run.smithi153.stderr: 87650K .......... .......... .......... .......... .......... 94% 323M 0s 2024-09-19T14:14:28.183 INFO:teuthology.orchestra.run.smithi153.stderr: 87700K .......... .......... .......... .......... .......... 94% 283M 0s 2024-09-19T14:14:28.183 INFO:teuthology.orchestra.run.smithi153.stderr: 87750K .......... .......... .......... .......... .......... 94% 338M 0s 2024-09-19T14:14:28.183 INFO:teuthology.orchestra.run.smithi153.stderr: 87800K .......... .......... .......... .......... .......... 94% 322M 0s 2024-09-19T14:14:28.183 INFO:teuthology.orchestra.run.smithi153.stderr: 87850K .......... .......... .......... .......... .......... 94% 344M 0s 2024-09-19T14:14:28.183 INFO:teuthology.orchestra.run.smithi153.stderr: 87900K .......... .......... .......... .......... .......... 94% 279M 0s 2024-09-19T14:14:28.183 INFO:teuthology.orchestra.run.smithi153.stderr: 87950K .......... .......... .......... .......... .......... 94% 341M 0s 2024-09-19T14:14:28.183 INFO:teuthology.orchestra.run.smithi153.stderr: 88000K .......... .......... .......... .......... .......... 94% 350M 0s 2024-09-19T14:14:28.183 INFO:teuthology.orchestra.run.smithi153.stderr: 88050K .......... .......... .......... .......... .......... 94% 323M 0s 2024-09-19T14:14:28.183 INFO:teuthology.orchestra.run.smithi153.stderr: 88100K .......... .......... .......... .......... .......... 94% 326M 0s 2024-09-19T14:14:28.183 INFO:teuthology.orchestra.run.smithi153.stderr: 88150K .......... .......... .......... .......... .......... 94% 371M 0s 2024-09-19T14:14:28.183 INFO:teuthology.orchestra.run.smithi153.stderr: 88200K .......... .......... .......... .......... .......... 94% 359M 0s 2024-09-19T14:14:28.183 INFO:teuthology.orchestra.run.smithi153.stderr: 88250K .......... .......... .......... .......... .......... 95% 372M 0s 2024-09-19T14:14:28.183 INFO:teuthology.orchestra.run.smithi153.stderr: 88300K .......... .......... .......... .......... .......... 95% 284M 0s 2024-09-19T14:14:28.183 INFO:teuthology.orchestra.run.smithi153.stderr: 88350K .......... .......... .......... .......... .......... 95% 312M 0s 2024-09-19T14:14:28.184 INFO:teuthology.orchestra.run.smithi153.stderr: 88400K .......... .......... .......... .......... .......... 95% 340M 0s 2024-09-19T14:14:28.184 INFO:teuthology.orchestra.run.smithi153.stderr: 88450K .......... .......... .......... .......... .......... 95% 344M 0s 2024-09-19T14:14:28.184 INFO:teuthology.orchestra.run.smithi153.stderr: 88500K .......... .......... .......... .......... .......... 95% 294M 0s 2024-09-19T14:14:28.184 INFO:teuthology.orchestra.run.smithi153.stderr: 88550K .......... .......... .......... .......... .......... 95% 353M 0s 2024-09-19T14:14:28.184 INFO:teuthology.orchestra.run.smithi153.stderr: 88600K .......... .......... .......... .......... .......... 95% 337M 0s 2024-09-19T14:14:28.184 INFO:teuthology.orchestra.run.smithi153.stderr: 88650K .......... .......... .......... .......... .......... 95% 364M 0s 2024-09-19T14:14:28.184 INFO:teuthology.orchestra.run.smithi153.stderr: 88700K .......... .......... .......... .......... .......... 95% 283M 0s 2024-09-19T14:14:28.184 INFO:teuthology.orchestra.run.smithi153.stderr: 88750K .......... .......... .......... .......... .......... 95% 342M 0s 2024-09-19T14:14:28.184 INFO:teuthology.orchestra.run.smithi153.stderr: 88800K .......... .......... .......... .......... .......... 95% 367M 0s 2024-09-19T14:14:28.184 INFO:teuthology.orchestra.run.smithi153.stderr: 88850K .......... .......... .......... .......... .......... 95% 376M 0s 2024-09-19T14:14:28.184 INFO:teuthology.orchestra.run.smithi153.stderr: 88900K .......... .......... .......... .......... .......... 95% 316M 0s 2024-09-19T14:14:28.184 INFO:teuthology.orchestra.run.smithi153.stderr: 88950K .......... .......... .......... .......... .......... 95% 320M 0s 2024-09-19T14:14:28.184 INFO:teuthology.orchestra.run.smithi153.stderr: 89000K .......... .......... .......... .......... .......... 95% 365M 0s 2024-09-19T14:14:28.184 INFO:teuthology.orchestra.run.smithi153.stderr: 89050K .......... .......... .......... .......... .......... 95% 350M 0s 2024-09-19T14:14:28.185 INFO:teuthology.orchestra.run.smithi153.stderr: 89100K .......... .......... .......... .......... .......... 95% 295M 0s 2024-09-19T14:14:28.185 INFO:teuthology.orchestra.run.smithi153.stderr: 89150K .......... .......... .......... .......... .......... 96% 309M 0s 2024-09-19T14:14:28.185 INFO:teuthology.orchestra.run.smithi153.stderr: 89200K .......... .......... .......... .......... .......... 96% 334M 0s 2024-09-19T14:14:28.185 INFO:teuthology.orchestra.run.smithi153.stderr: 89250K .......... .......... .......... .......... .......... 96% 386M 0s 2024-09-19T14:14:28.185 INFO:teuthology.orchestra.run.smithi153.stderr: 89300K .......... .......... .......... .......... .......... 96% 339M 0s 2024-09-19T14:14:28.185 INFO:teuthology.orchestra.run.smithi153.stderr: 89350K .......... .......... .......... .......... .......... 96% 382M 0s 2024-09-19T14:14:28.185 INFO:teuthology.orchestra.run.smithi153.stderr: 89400K .......... .......... .......... .......... .......... 96% 388M 0s 2024-09-19T14:14:28.185 INFO:teuthology.orchestra.run.smithi153.stderr: 89450K .......... .......... .......... .......... .......... 96% 377M 0s 2024-09-19T14:14:28.185 INFO:teuthology.orchestra.run.smithi153.stderr: 89500K .......... .......... .......... .......... .......... 96% 311M 0s 2024-09-19T14:14:28.185 INFO:teuthology.orchestra.run.smithi153.stderr: 89550K .......... .......... .......... .......... .......... 96% 26.0M 0s 2024-09-19T14:14:28.185 INFO:teuthology.orchestra.run.smithi153.stderr: 89600K .......... .......... .......... .......... .......... 96% 325M 0s 2024-09-19T14:14:28.185 INFO:teuthology.orchestra.run.smithi153.stderr: 89650K .......... .......... .......... .......... .......... 96% 349M 0s 2024-09-19T14:14:28.185 INFO:teuthology.orchestra.run.smithi153.stderr: 89700K .......... .......... .......... .......... .......... 96% 336M 0s 2024-09-19T14:14:28.185 INFO:teuthology.orchestra.run.smithi153.stderr: 89750K .......... .......... .......... .......... .......... 96% 43.2M 0s 2024-09-19T14:14:28.186 INFO:teuthology.orchestra.run.smithi153.stderr: 89800K .......... .......... .......... .......... .......... 96% 183M 0s 2024-09-19T14:14:28.186 INFO:teuthology.orchestra.run.smithi153.stderr: 89850K .......... .......... .......... .......... .......... 96% 341M 0s 2024-09-19T14:14:28.186 INFO:teuthology.orchestra.run.smithi153.stderr: 89900K .......... .......... .......... .......... .......... 96% 245M 0s 2024-09-19T14:14:28.186 INFO:teuthology.orchestra.run.smithi153.stderr: 89950K .......... .......... .......... .......... .......... 96% 320M 0s 2024-09-19T14:14:28.186 INFO:teuthology.orchestra.run.smithi153.stderr: 90000K .......... .......... .......... .......... .......... 96% 338M 0s 2024-09-19T14:14:28.186 INFO:teuthology.orchestra.run.smithi153.stderr: 90050K .......... .......... .......... .......... .......... 96% 361M 0s 2024-09-19T14:14:28.186 INFO:teuthology.orchestra.run.smithi153.stderr: 90100K .......... .......... .......... .......... .......... 97% 175M 0s 2024-09-19T14:14:28.186 INFO:teuthology.orchestra.run.smithi153.stderr: 90150K .......... .......... .......... .......... .......... 97% 325M 0s 2024-09-19T14:14:28.186 INFO:teuthology.orchestra.run.smithi153.stderr: 90200K .......... .......... .......... .......... .......... 97% 229M 0s 2024-09-19T14:14:28.186 INFO:teuthology.orchestra.run.smithi153.stderr: 90250K .......... .......... .......... .......... .......... 97% 317M 0s 2024-09-19T14:14:28.186 INFO:teuthology.orchestra.run.smithi153.stderr: 90300K .......... .......... .......... .......... .......... 97% 300M 0s 2024-09-19T14:14:28.186 INFO:teuthology.orchestra.run.smithi153.stderr: 90350K .......... .......... .......... .......... .......... 97% 335M 0s 2024-09-19T14:14:28.186 INFO:teuthology.orchestra.run.smithi153.stderr: 90400K .......... .......... .......... .......... .......... 97% 355M 0s 2024-09-19T14:14:28.186 INFO:teuthology.orchestra.run.smithi153.stderr: 90450K .......... .......... .......... .......... .......... 97% 340M 0s 2024-09-19T14:14:28.187 INFO:teuthology.orchestra.run.smithi153.stderr: 90500K .......... .......... .......... .......... .......... 97% 310M 0s 2024-09-19T14:14:28.187 INFO:teuthology.orchestra.run.smithi153.stderr: 90550K .......... .......... .......... .......... .......... 97% 331M 0s 2024-09-19T14:14:28.187 INFO:teuthology.orchestra.run.smithi153.stderr: 90600K .......... .......... .......... .......... .......... 97% 381M 0s 2024-09-19T14:14:28.187 INFO:teuthology.orchestra.run.smithi153.stderr: 90650K .......... .......... .......... .......... .......... 97% 351M 0s 2024-09-19T14:14:28.187 INFO:teuthology.orchestra.run.smithi153.stderr: 90700K .......... .......... .......... .......... .......... 97% 282M 0s 2024-09-19T14:14:28.187 INFO:teuthology.orchestra.run.smithi153.stderr: 90750K .......... .......... .......... .......... .......... 97% 328M 0s 2024-09-19T14:14:28.187 INFO:teuthology.orchestra.run.smithi153.stderr: 90800K .......... .......... .......... .......... .......... 97% 374M 0s 2024-09-19T14:14:28.187 INFO:teuthology.orchestra.run.smithi153.stderr: 90850K .......... .......... .......... .......... .......... 97% 315M 0s 2024-09-19T14:14:28.187 INFO:teuthology.orchestra.run.smithi153.stderr: 90900K .......... .......... .......... .......... .......... 97% 325M 0s 2024-09-19T14:14:28.187 INFO:teuthology.orchestra.run.smithi153.stderr: 90950K .......... .......... .......... .......... .......... 97% 378M 0s 2024-09-19T14:14:28.187 INFO:teuthology.orchestra.run.smithi153.stderr: 91000K .......... .......... .......... .......... .......... 98% 362M 0s 2024-09-19T14:14:28.187 INFO:teuthology.orchestra.run.smithi153.stderr: 91050K .......... .......... .......... .......... .......... 98% 356M 0s 2024-09-19T14:14:28.187 INFO:teuthology.orchestra.run.smithi153.stderr: 91100K .......... .......... .......... .......... .......... 98% 316M 0s 2024-09-19T14:14:28.187 INFO:teuthology.orchestra.run.smithi153.stderr: 91150K .......... .......... .......... .......... .......... 98% 374M 0s 2024-09-19T14:14:28.188 INFO:teuthology.orchestra.run.smithi153.stderr: 91200K .......... .......... .......... .......... .......... 98% 184M 0s 2024-09-19T14:14:28.188 INFO:teuthology.orchestra.run.smithi153.stderr: 91250K .......... .......... .......... .......... .......... 98% 335M 0s 2024-09-19T14:14:28.188 INFO:teuthology.orchestra.run.smithi153.stderr: 91300K .......... .......... .......... .......... .......... 98% 311M 0s 2024-09-19T14:14:28.188 INFO:teuthology.orchestra.run.smithi153.stderr: 91350K .......... .......... .......... .......... .......... 98% 346M 0s 2024-09-19T14:14:28.188 INFO:teuthology.orchestra.run.smithi153.stderr: 91400K .......... .......... .......... .......... .......... 98% 353M 0s 2024-09-19T14:14:28.188 INFO:teuthology.orchestra.run.smithi153.stderr: 91450K .......... .......... .......... .......... .......... 98% 373M 0s 2024-09-19T14:14:28.188 INFO:teuthology.orchestra.run.smithi153.stderr: 91500K .......... .......... .......... .......... .......... 98% 311M 0s 2024-09-19T14:14:28.188 INFO:teuthology.orchestra.run.smithi153.stderr: 91550K .......... .......... .......... .......... .......... 98% 361M 0s 2024-09-19T14:14:28.188 INFO:teuthology.orchestra.run.smithi153.stderr: 91600K .......... .......... .......... .......... .......... 98% 251M 0s 2024-09-19T14:14:28.188 INFO:teuthology.orchestra.run.smithi153.stderr: 91650K .......... .......... .......... .......... .......... 98% 341M 0s 2024-09-19T14:14:28.188 INFO:teuthology.orchestra.run.smithi153.stderr: 91700K .......... .......... .......... .......... .......... 98% 296M 0s 2024-09-19T14:14:28.188 INFO:teuthology.orchestra.run.smithi153.stderr: 91750K .......... .......... .......... .......... .......... 98% 325M 0s 2024-09-19T14:14:28.188 INFO:teuthology.orchestra.run.smithi153.stderr: 91800K .......... .......... .......... .......... .......... 98% 381M 0s 2024-09-19T14:14:28.188 INFO:teuthology.orchestra.run.smithi153.stderr: 91850K .......... .......... .......... .......... .......... 98% 359M 0s 2024-09-19T14:14:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: 91900K .......... .......... .......... .......... .......... 98% 313M 0s 2024-09-19T14:14:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: 91950K .......... .......... .......... .......... .......... 99% 230M 0s 2024-09-19T14:14:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: 92000K .......... .......... .......... .......... .......... 99% 320M 0s 2024-09-19T14:14:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: 92050K .......... .......... .......... .......... .......... 99% 342M 0s 2024-09-19T14:14:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: 92100K .......... .......... .......... .......... .......... 99% 311M 0s 2024-09-19T14:14:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: 92150K .......... .......... .......... .......... .......... 99% 344M 0s 2024-09-19T14:14:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: 92200K .......... .......... .......... .......... .......... 99% 352M 0s 2024-09-19T14:14:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: 92250K .......... .......... .......... .......... .......... 99% 368M 0s 2024-09-19T14:14:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: 92300K .......... .......... .......... .......... .......... 99% 22.6M 0s 2024-09-19T14:14:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: 92350K .......... .......... .......... .......... .......... 99% 311M 0s 2024-09-19T14:14:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: 92400K .......... .......... .......... .......... .......... 99% 330M 0s 2024-09-19T14:14:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: 92450K .......... .......... .......... .......... .......... 99% 331M 0s 2024-09-19T14:14:28.189 INFO:teuthology.orchestra.run.smithi153.stderr: 92500K .......... .......... .......... .......... .......... 99% 368M 0s 2024-09-19T14:14:28.190 INFO:teuthology.orchestra.run.smithi153.stderr: 92550K .......... .......... .......... .......... .......... 99% 338M 0s 2024-09-19T14:14:28.190 INFO:teuthology.orchestra.run.smithi153.stderr: 92600K .......... .......... .......... .......... .......... 99% 384M 0s 2024-09-19T14:14:28.190 INFO:teuthology.orchestra.run.smithi153.stderr: 92650K .......... .......... .......... .......... .......... 99% 164M 0s 2024-09-19T14:14:28.190 INFO:teuthology.orchestra.run.smithi153.stderr: 92700K .......... .......... .......... .......... .......... 99% 358M 0s 2024-09-19T14:14:28.190 INFO:teuthology.orchestra.run.smithi153.stderr: 92750K .......... .......... .......... .......... .......... 99% 310M 0s 2024-09-19T14:14:28.190 INFO:teuthology.orchestra.run.smithi153.stderr: 92800K .......... .......... .......... .......... .......... 99% 139M 0s 2024-09-19T14:14:28.190 INFO:teuthology.orchestra.run.smithi153.stderr: 92850K .......... .......... .......... .......... .......... 99% 198M 0s 2024-09-19T14:14:28.190 INFO:teuthology.orchestra.run.smithi153.stderr: 92900K 100% 134G=0.5s 2024-09-19T14:14:28.190 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-19T14:14:28.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19 14:14:27 (198 MB/s) - 'gradle-6.0.1-bin.zip' saved [95129672/95129672] 2024-09-19T14:14:28.190 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-19T14:14:28.212 INFO:teuthology.orchestra.run.smithi153.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-19T14:14:28.212 INFO:teuthology.orchestra.run.smithi153.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-19T14:14:28.212 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-19T14:14:28.212 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-19T14:14:28.212 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-19T14:14:28.212 INFO:teuthology.orchestra.run.smithi153.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-19T14:14:28.212 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-19T14:14:28.213 INFO:teuthology.orchestra.run.smithi153.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-19T14:14:28.213 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-19T14:14:28.213 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-19T14:14:28.213 INFO:teuthology.orchestra.run.smithi153.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-19T14:14:28.213 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-19T14:14:28.213 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-19T14:14:28.213 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-19T14:14:28.213 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-19T14:14:28.213 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-19T14:14:28.213 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-19T14:14:28.213 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-19T14:14:28.213 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-19T14:14:28.214 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-19T14:14:28.214 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-19T14:14:28.214 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-19T14:14:28.214 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-19T14:14:28.214 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-19T14:14:28.214 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-19T14:14:28.214 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-19T14:14:28.214 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-19T14:14:28.214 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-19T14:14:28.214 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-19T14:14:28.214 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-19T14:14:28.214 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-19T14:14:28.214 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-19T14:14:28.215 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-19T14:14:28.215 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-19T14:14:28.215 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-19T14:14:28.215 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-19T14:14:28.215 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-19T14:14:28.215 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-19T14:14:28.215 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-19T14:14:28.215 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-19T14:14:28.215 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-19T14:14:28.215 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-19T14:14:28.215 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-19T14:14:28.215 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-19T14:14:28.215 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-19T14:14:28.216 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-19T14:14:28.216 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-19T14:14:28.216 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-19T14:14:28.216 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-19T14:14:28.216 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-19T14:14:28.216 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-19T14:14:28.216 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-19T14:14:28.216 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-19T14:14:28.216 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-19T14:14:28.216 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-19T14:14:28.216 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-19T14:14:28.216 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-19T14:14:28.217 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-19T14:14:28.217 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-19T14:14:28.217 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-19T14:14:28.217 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-19T14:14:28.217 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-19T14:14:28.217 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-19T14:14:28.217 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-19T14:14:28.217 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-19T14:14:28.217 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-19T14:14:28.217 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-19T14:14:28.217 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-19T14:14:28.217 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-19T14:14:28.217 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-19T14:14:28.218 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-19T14:14:28.218 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-19T14:14:28.218 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-19T14:14:28.218 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-19T14:14:28.218 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-19T14:14:28.218 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-19T14:14:28.218 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-19T14:14:28.218 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-19T14:14:28.218 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-19T14:14:28.218 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-19T14:14:28.218 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-19T14:14:28.218 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-19T14:14:28.218 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-19T14:14:28.218 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-19T14:14:28.219 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-19T14:14:28.219 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-19T14:14:28.219 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-19T14:14:28.219 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-19T14:14:28.219 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-19T14:14:28.219 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-19T14:14:28.219 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-19T14:14:28.219 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-19T14:14:28.219 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-19T14:14:28.219 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-19T14:14:28.219 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-19T14:14:28.219 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-19T14:14:28.220 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-19T14:14:28.220 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-19T14:14:28.220 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-19T14:14:28.220 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-19T14:14:28.220 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-19T14:14:28.220 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-19T14:14:28.220 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-19T14:14:28.220 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-19T14:14:28.220 INFO:teuthology.orchestra.run.smithi153.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-19T14:14:28.220 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-19T14:14:28.220 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-19T14:14:28.220 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-19T14:14:28.220 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-19T14:14:28.220 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-19T14:14:28.221 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-19T14:14:28.221 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-19T14:14:28.221 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-19T14:14:28.221 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-19T14:14:28.221 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-19T14:14:28.221 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-19T14:14:28.221 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-19T14:14:28.221 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-19T14:14:28.221 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-19T14:14:28.221 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-19T14:14:28.221 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-19T14:14:28.221 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-19T14:14:28.221 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-19T14:14:28.222 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-19T14:14:28.222 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-19T14:14:28.222 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-19T14:14:28.222 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-19T14:14:28.222 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-19T14:14:28.222 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-19T14:14:28.222 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-19T14:14:28.222 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-19T14:14:28.222 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-19T14:14:28.222 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-19T14:14:28.222 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-19T14:14:28.222 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-19T14:14:28.222 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-19T14:14:28.223 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-19T14:14:28.223 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-19T14:14:28.223 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-19T14:14:28.223 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-19T14:14:28.223 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-19T14:14:28.223 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-19T14:14:28.223 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-19T14:14:28.223 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-19T14:14:28.223 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-19T14:14:28.223 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-19T14:14:28.223 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-19T14:14:28.223 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-19T14:14:28.223 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-19T14:14:28.224 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-19T14:14:28.224 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-19T14:14:28.224 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-19T14:14:28.224 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-19T14:14:28.224 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-19T14:14:28.224 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-19T14:14:28.224 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-19T14:14:28.224 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-19T14:14:28.224 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-19T14:14:28.224 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-19T14:14:28.224 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-19T14:14:28.224 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-19T14:14:28.224 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-19T14:14:28.225 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-19T14:14:28.225 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-19T14:14:28.225 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-19T14:14:28.225 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-19T14:14:28.225 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-19T14:14:28.225 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-19T14:14:28.225 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-19T14:14:28.225 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-19T14:14:28.225 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-19T14:14:28.225 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-19T14:14:28.225 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-19T14:14:28.225 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-19T14:14:28.225 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-19T14:14:28.225 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-19T14:14:28.226 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-19T14:14:28.226 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-19T14:14:28.226 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-19T14:14:28.226 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-19T14:14:28.226 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-19T14:14:28.226 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-19T14:14:28.226 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-19T14:14:28.226 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-19T14:14:28.226 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-19T14:14:28.226 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-19T14:14:28.226 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-19T14:14:28.226 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-19T14:14:28.226 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-19T14:14:28.227 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-19T14:14:28.227 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-19T14:14:28.227 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-19T14:14:28.227 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-19T14:14:28.227 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-19T14:14:28.227 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-19T14:14:28.227 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-19T14:14:28.227 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-19T14:14:28.249 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-19T14:14:28.253 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-19T14:14:28.253 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-19T14:14:28.253 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-19T14:14:28.253 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-19T14:14:28.253 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-19T14:14:28.254 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-19T14:14:28.254 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-19T14:14:28.263 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-19T14:14:28.263 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-19T14:14:28.263 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-19T14:14:28.263 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-19T14:14:28.263 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-19T14:14:28.263 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-19T14:14:28.263 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-19T14:14:28.263 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-19T14:14:28.263 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-19T14:14:28.263 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-19T14:14:28.263 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-19T14:14:28.264 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-19T14:14:28.264 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-19T14:14:28.265 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-19T14:14:28.265 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-19T14:14:28.266 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-19T14:14:28.267 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-19T14:14:28.271 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-19T14:14:28.272 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-19T14:14:28.273 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-19T14:14:28.273 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-19T14:14:28.273 INFO:teuthology.orchestra.run.smithi153.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-19T14:14:28.305 INFO:teuthology.orchestra.run.smithi153.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2024-09-19T14:14:28.706 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:14:28.706 INFO:teuthology.orchestra.run.smithi153.stdout:Welcome to Gradle 6.0.1! 2024-09-19T14:14:28.707 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:14:28.707 INFO:teuthology.orchestra.run.smithi153.stdout:Here are the highlights of this release: 2024-09-19T14:14:28.707 INFO:teuthology.orchestra.run.smithi153.stdout: - Substantial improvements in dependency management, including 2024-09-19T14:14:28.707 INFO:teuthology.orchestra.run.smithi153.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-19T14:14:28.707 INFO:teuthology.orchestra.run.smithi153.stdout: - Advanced control of transitive versions 2024-09-19T14:14:28.707 INFO:teuthology.orchestra.run.smithi153.stdout: - Support for optional features and dependencies 2024-09-19T14:14:28.707 INFO:teuthology.orchestra.run.smithi153.stdout: - Rules to tweak published metadata 2024-09-19T14:14:28.707 INFO:teuthology.orchestra.run.smithi153.stdout: - Support for Java 13 2024-09-19T14:14:28.707 INFO:teuthology.orchestra.run.smithi153.stdout: - Faster incremental Java and Groovy compilation 2024-09-19T14:14:28.707 INFO:teuthology.orchestra.run.smithi153.stdout: - New Zinc compiler for Scala 2024-09-19T14:14:28.707 INFO:teuthology.orchestra.run.smithi153.stdout: - VS2019 support 2024-09-19T14:14:28.707 INFO:teuthology.orchestra.run.smithi153.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-19T14:14:28.707 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:14:28.707 INFO:teuthology.orchestra.run.smithi153.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-19T14:14:28.708 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:14:28.708 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:14:28.710 INFO:teuthology.orchestra.run.smithi153.stdout:------------------------------------------------------------ 2024-09-19T14:14:28.710 INFO:teuthology.orchestra.run.smithi153.stdout:Gradle 6.0.1 2024-09-19T14:14:28.710 INFO:teuthology.orchestra.run.smithi153.stdout:------------------------------------------------------------ 2024-09-19T14:14:28.710 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:14:28.710 INFO:teuthology.orchestra.run.smithi153.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-19T14:14:28.710 INFO:teuthology.orchestra.run.smithi153.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-19T14:14:28.710 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:14:28.710 INFO:teuthology.orchestra.run.smithi153.stdout:Kotlin: 1.3.50 2024-09-19T14:14:28.710 INFO:teuthology.orchestra.run.smithi153.stdout:Groovy: 2.5.8 2024-09-19T14:14:28.710 INFO:teuthology.orchestra.run.smithi153.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-19T14:14:28.710 INFO:teuthology.orchestra.run.smithi153.stdout:JVM: 11.0.17 (Ubuntu 11.0.17+8-post-Ubuntu-1ubuntu222.04) 2024-09-19T14:14:28.710 INFO:teuthology.orchestra.run.smithi153.stdout:OS: Linux 5.15.0-122-generic amd64 2024-09-19T14:14:28.710 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:14:28.724 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-19T14:14:28.724 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-19T14:14:28.724 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi153.front.sepia.ceph.com 2024-09-19T14:14:28.724 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-19T14:14:28.724 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi196.front.sepia.ceph.com 2024-09-19T14:14:28.725 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-19T14:14:29.033 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-19T14:14:29.034 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-19T14:14:29.034 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'NETIUJHVXMQJURHIFQFN', 'access_secret': 'GqRVsD3fRlDOo7ht3SZ46/rydpOyndAGFVoMjapzYuSMkjEHSdAT4g==', 'region': 'mexico', 'endpoint': 'smithi153.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi153.front.sepia.ceph.com'} 2024-09-19T14:14:29.034 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-19T14:14:29.034 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'NETIUJHVXMQJURHIFQFN', '--secret', 'GqRVsD3fRlDOo7ht3SZ46/rydpOyndAGFVoMjapzYuSMkjEHSdAT4g==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-19T14:14:29.034 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key NETIUJHVXMQJURHIFQFN --secret GqRVsD3fRlDOo7ht3SZ46/rydpOyndAGFVoMjapzYuSMkjEHSdAT4g== --email tester.client.0_test@test.test --cluster ceph 2024-09-19T14:14:29.080 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:14:29.080 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:14:29.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.116+0000 7f69b53a09c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.120+0000 7f69b53a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:29.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.120+0000 7f69b53a09c0 20 realm 2024-09-19T14:14:29.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.120+0000 7f69b53a09c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.120+0000 7f69b53a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:29.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.120+0000 7f69b53a09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:14:29.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.120+0000 7f69b53a09c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.120+0000 7f69b53a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:29.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.120+0000 7f69b53a09c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.120+0000 7f69b53a09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:14:29.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.120+0000 7f69b53a09c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.120+0000 7f69b53a09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:14:29.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.120+0000 7f69b53a09c0 20 searching for the correct realm 2024-09-19T14:14:29.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.128+0000 7f69b36a7640 0 -- 172.21.15.153:0/2324283688 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55ff09c9f740 msgr2=0x55ff09ca1bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:14:29.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.132+0000 7f69b26a5640 0 -- 172.21.15.153:0/2324283688 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f699c064de0 msgr2=0x7f699c06efe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:14:29.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.140+0000 7f69b53a09c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:14:29.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.140+0000 7f69b53a09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:14:29.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.140+0000 7f69b53a09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:14:29.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.140+0000 7f69b53a09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:14:29.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.140+0000 7f69b53a09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:14:29.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.140+0000 7f69b53a09c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:14:29.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.140+0000 7f69b53a09c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.140+0000 7f69b53a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:29.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.140+0000 7f69b53a09c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.140+0000 7f69b53a09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:14:29.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.140+0000 7f69b53a09c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.140+0000 7f69b53a09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:14:29.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.140+0000 7f69b53a09c0 20 zone default found 2024-09-19T14:14:29.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.140+0000 7f69b53a09c0 4 Realm: () 2024-09-19T14:14:29.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.140+0000 7f69b53a09c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:14:29.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.140+0000 7f69b53a09c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:14:29.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.140+0000 7f69b53a09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:14:29.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.140+0000 7f69b53a09c0 20 zonegroup default 2024-09-19T14:14:29.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.140+0000 7f69b53a09c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.140+0000 7f69b53a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:29.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.140+0000 7f69b53a09c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.144+0000 7f69b53a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:29.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.144+0000 7f69b53a09c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.144+0000 7f69b53a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:29.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.144+0000 7f69b53a09c0 20 started sync module instance, tier type = 2024-09-19T14:14:29.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.144+0000 7f69b53a09c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:14:29.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.160+0000 7f69b53a09c0 20 add_watcher() i=0 2024-09-19T14:14:29.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.160+0000 7f69b53a09c0 20 add_watcher() i=1 2024-09-19T14:14:29.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.160+0000 7f69b53a09c0 20 add_watcher() i=2 2024-09-19T14:14:29.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.160+0000 7f69b53a09c0 20 add_watcher() i=3 2024-09-19T14:14:29.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.160+0000 7f69b53a09c0 20 add_watcher() i=4 2024-09-19T14:14:29.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.160+0000 7f69b53a09c0 20 add_watcher() i=5 2024-09-19T14:14:29.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.160+0000 7f69b53a09c0 20 add_watcher() i=6 2024-09-19T14:14:29.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.160+0000 7f69b53a09c0 20 add_watcher() i=7 2024-09-19T14:14:29.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.160+0000 7f69b53a09c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:14:29.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.160+0000 7f6869fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:14:29.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.160+0000 7f69b53a09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:14:29.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.160+0000 7f69b53a09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:14:29.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.160+0000 7f69b53a09c0 5 note: GC not initialized 2024-09-19T14:14:29.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.160+0000 7f6868fe1640 20 reqs_thread_entry: start 2024-09-19T14:14:29.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.160+0000 7f69b53a09c0 20 init_complete bucket index max shards: 11 2024-09-19T14:14:29.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.160+0000 7f69b53a09c0 20 Filter name: none 2024-09-19T14:14:29.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.164+0000 7f6861ffb640 20 reqs_thread_entry: start 2024-09-19T14:14:29.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.164+0000 7f69b53a09c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-19T14:14:29.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.164+0000 7f69b53a09c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.164+0000 7f69b53a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:29.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.164+0000 7f69b53a09c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-19T14:14:29.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.164+0000 7f69b53a09c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-19T14:14:29.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.164+0000 7f69b53a09c0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-19T14:14:29.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.164+0000 7f69b53a09c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.164+0000 7f69b53a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:29.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.164+0000 7f69b53a09c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-19T14:14:29.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.164+0000 7f69b53a09c0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-19T14:14:29.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.164+0000 7f69b53a09c0 10 cache get: name=default.rgw.meta+users.keys+NETIUJHVXMQJURHIFQFN : miss 2024-09-19T14:14:29.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.164+0000 7f69b53a09c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.164+0000 7f69b53a09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:29.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.164+0000 7f69b53a09c0 10 cache put: name=default.rgw.meta+users.keys+NETIUJHVXMQJURHIFQFN info.flags=0x0 2024-09-19T14:14:29.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.164+0000 7f69b53a09c0 10 adding default.rgw.meta+users.keys+NETIUJHVXMQJURHIFQFN to cache LRU end 2024-09-19T14:14:29.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.164+0000 7f69b53a09c0 10 cache get: name=default.rgw.meta+users.keys+NETIUJHVXMQJURHIFQFN : hit (negative entry) 2024-09-19T14:14:29.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.164+0000 7f69b53a09c0 10 cache get: name=default.rgw.meta+users.keys+NETIUJHVXMQJURHIFQFN : hit (negative entry) 2024-09-19T14:14:29.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.168+0000 7f69b53a09c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-19T14:14:29.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.168+0000 7f69b53a09c0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-19T14:14:29.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.168+0000 7f69b53a09c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-19T14:14:29.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.168+0000 7f68967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333545 cookie 94553869320688 notifier 8730 bl.length()=670 2024-09-19T14:14:29.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.168+0000 7f68967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-19T14:14:29.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.168+0000 7f68967fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-19T14:14:29.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.172+0000 7f69b53a09c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-19T14:14:29.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.172+0000 7f69b53a09c0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-19T14:14:29.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.172+0000 7f69b53a09c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-19T14:14:29.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.172+0000 7f68967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333492 cookie 94553869310960 notifier 8730 bl.length()=200 2024-09-19T14:14:29.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.172+0000 7f68967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-19T14:14:29.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.172+0000 7f68967fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-19T14:14:29.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.176+0000 7f69b53a09c0 10 cache put: name=default.rgw.meta+users.keys+NETIUJHVXMQJURHIFQFN info.flags=0x7 2024-09-19T14:14:29.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.176+0000 7f69b53a09c0 10 moving default.rgw.meta+users.keys+NETIUJHVXMQJURHIFQFN to cache LRU end 2024-09-19T14:14:29.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.176+0000 7f69b53a09c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:NETIUJHVXMQJURHIFQFN, ofs0, ns] 2024-09-19T14:14:29.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.176+0000 7f68967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333493 cookie 94553869310960 notifier 8730 bl.length()=189 2024-09-19T14:14:29.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.176+0000 7f68967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NETIUJHVXMQJURHIFQFN info.flags=0x7 2024-09-19T14:14:29.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.176+0000 7f68967fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NETIUJHVXMQJURHIFQFN to cache LRU end 2024-09-19T14:14:29.181 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-19T14:14:29.181 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "tester.client.0", 2024-09-19T14:14:29.181 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Ms. tester.client.0", 2024-09-19T14:14:29.181 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "tester.client.0_test@test.test", 2024-09-19T14:14:29.181 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2024-09-19T14:14:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 1000, 2024-09-19T14:14:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2024-09-19T14:14:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2024-09-19T14:14:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-19T14:14:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "tester.client.0", 2024-09-19T14:14:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "NETIUJHVXMQJURHIFQFN", 2024-09-19T14:14:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "GqRVsD3fRlDOo7ht3SZ46/rydpOyndAGFVoMjapzYuSMkjEHSdAT4g==", 2024-09-19T14:14:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: "active": true, 2024-09-19T14:14:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: "create_date": "2024-09-19T14:14:29.169590Z" 2024-09-19T14:14:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-19T14:14:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-19T14:14:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2024-09-19T14:14:29.182 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2024-09-19T14:14:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2024-09-19T14:14:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2024-09-19T14:14:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2024-09-19T14:14:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2024-09-19T14:14:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2024-09-19T14:14:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2024-09-19T14:14:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:14:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2024-09-19T14:14:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:14:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2024-09-19T14:14:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:14:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2024-09-19T14:14:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2024-09-19T14:14:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:14:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2024-09-19T14:14:29.184 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:14:29.184 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2024-09-19T14:14:29.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:14:29.184 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2024-09-19T14:14:29.184 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2024-09-19T14:14:29.184 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [], 2024-09-19T14:14:29.184 INFO:teuthology.orchestra.run.smithi153.stdout: "account_id": "", 2024-09-19T14:14:29.184 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "/", 2024-09-19T14:14:29.184 INFO:teuthology.orchestra.run.smithi153.stdout: "create_date": "2024-09-19T14:14:29.169576Z", 2024-09-19T14:14:29.184 INFO:teuthology.orchestra.run.smithi153.stdout: "tags": [], 2024-09-19T14:14:29.184 INFO:teuthology.orchestra.run.smithi153.stdout: "group_ids": [] 2024-09-19T14:14:29.184 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-19T14:14:29.185 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:14:29.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.176+0000 7f6869fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:14:29.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.180+0000 7f69b53a09c0 20 remove_watcher() i=0 2024-09-19T14:14:29.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.180+0000 7f69b53a09c0 2 removed watcher, disabling cache 2024-09-19T14:14:29.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.184+0000 7f69b53a09c0 20 remove_watcher() i=1 2024-09-19T14:14:29.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.184+0000 7f69b53a09c0 20 remove_watcher() i=2 2024-09-19T14:14:29.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.188+0000 7f69b53a09c0 20 remove_watcher() i=3 2024-09-19T14:14:29.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.188+0000 7f69b53a09c0 20 remove_watcher() i=4 2024-09-19T14:14:29.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.192+0000 7f69b53a09c0 20 remove_watcher() i=5 2024-09-19T14:14:29.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.192+0000 7f69b53a09c0 20 remove_watcher() i=6 2024-09-19T14:14:29.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.192+0000 7f69b53a09c0 20 remove_watcher() i=7 2024-09-19T14:14:29.210 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T14:14:29.210 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-19T14:14:29.216 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-19T14:14:29.216 DEBUG:teuthology.orchestra.run.smithi153:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-19T14:14:29.263 DEBUG:teuthology.orchestra.run.smithi153:> radosgw-admin gc process --include-all 2024-09-19T14:14:29.335 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:14:29.336 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:14:29.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.376+0000 7f72ef1f29c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.380+0000 7f72ef1f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:29.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.380+0000 7f72ef1f29c0 20 realm 2024-09-19T14:14:29.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.380+0000 7f72ef1f29c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.380+0000 7f72ef1f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:29.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.380+0000 7f72ef1f29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:14:29.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.380+0000 7f72ef1f29c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.380+0000 7f72ef1f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:29.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.380+0000 7f72ef1f29c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.380+0000 7f72ef1f29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:14:29.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.380+0000 7f72ef1f29c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.380+0000 7f72ef1f29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:14:29.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.380+0000 7f72ef1f29c0 20 searching for the correct realm 2024-09-19T14:14:29.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.388+0000 7f72ec4f7640 0 -- 172.21.15.153:0/1677910847 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x5608ed55da90 msgr2=0x5608ed55fea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:14:29.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.392+0000 7f72eccf8640 0 -- 172.21.15.153:0/1677910847 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f72e005a040 msgr2=0x7f72e005a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:14:29.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.400+0000 7f72ef1f29c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:14:29.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.400+0000 7f72ef1f29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:14:29.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.400+0000 7f72ef1f29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:14:29.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.400+0000 7f72ef1f29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:14:29.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.400+0000 7f72ef1f29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:14:29.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.400+0000 7f72ef1f29c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:14:29.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.400+0000 7f72ef1f29c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.400+0000 7f72ef1f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:29.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.400+0000 7f72ef1f29c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.400+0000 7f72ef1f29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:14:29.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.400+0000 7f72ef1f29c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.400+0000 7f72ef1f29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:14:29.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.400+0000 7f72ef1f29c0 20 zone default found 2024-09-19T14:14:29.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.400+0000 7f72ef1f29c0 4 Realm: () 2024-09-19T14:14:29.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.400+0000 7f72ef1f29c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:14:29.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.400+0000 7f72ef1f29c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:14:29.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.400+0000 7f72ef1f29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:14:29.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.400+0000 7f72ef1f29c0 20 zonegroup default 2024-09-19T14:14:29.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.400+0000 7f72ef1f29c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.404+0000 7f72ef1f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:29.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.404+0000 7f72ef1f29c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.404+0000 7f72ef1f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:29.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.404+0000 7f72ef1f29c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:29.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.404+0000 7f72ef1f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:29.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.404+0000 7f72ef1f29c0 20 started sync module instance, tier type = 2024-09-19T14:14:29.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.404+0000 7f72ef1f29c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:14:29.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.428+0000 7f72ef1f29c0 20 add_watcher() i=0 2024-09-19T14:14:29.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.428+0000 7f72ef1f29c0 20 add_watcher() i=1 2024-09-19T14:14:29.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.428+0000 7f72ef1f29c0 20 add_watcher() i=2 2024-09-19T14:14:29.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.428+0000 7f72ef1f29c0 20 add_watcher() i=3 2024-09-19T14:14:29.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.428+0000 7f72ef1f29c0 20 add_watcher() i=4 2024-09-19T14:14:29.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.428+0000 7f72ef1f29c0 20 add_watcher() i=5 2024-09-19T14:14:29.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.428+0000 7f72ef1f29c0 20 add_watcher() i=6 2024-09-19T14:14:29.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.428+0000 7f72ef1f29c0 20 add_watcher() i=7 2024-09-19T14:14:29.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.428+0000 7f72ef1f29c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:14:29.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.432+0000 7f71a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:14:29.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.432+0000 7f72ef1f29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:14:29.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.432+0000 7f72ef1f29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:14:29.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.508+0000 7f71a1fe3640 20 reqs_thread_entry: start 2024-09-19T14:14:29.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.512+0000 7f72ef1f29c0 20 init_complete bucket index max shards: 11 2024-09-19T14:14:29.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.512+0000 7f72ef1f29c0 20 Filter name: none 2024-09-19T14:14:29.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.512+0000 7f71137fe640 20 reqs_thread_entry: start 2024-09-19T14:14:29.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.512+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:14:29.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-19T14:14:29.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6649574451367894515', time=2024-09-19T16:04:23.231578+0000, chain.objs.size()=1 2024-09-19T14:14:29.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.4__shadow_.F5Shp80EjVR2IDfckPv_OS_-sSNTHQL_0 2024-09-19T14:14:29.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='_YDuyuca_-DqspIs-865M1BXHBrNcSqD', time=2024-09-19T16:04:23.757407+0000, chain.objs.size()=1 2024-09-19T14:14:29.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__shadow_.uWumSjRdaScGQrsFAV3Tv6zAZUDokwS_0 2024-09-19T14:14:29.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1664484185205603701', time=2024-09-19T16:04:24.043217+0000, chain.objs.size()=1 2024-09-19T14:14:29.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.13__shadow_.B9FNgk0S2dkX-ZWKcMjj7tFY21P1Cxi_0 2024-09-19T14:14:29.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13893922930355606861', time=2024-09-19T16:06:06.852838+0000, chain.objs.size()=1 2024-09-19T14:14:29.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.19__shadow_.ZxUA2JB5pfoZBCaG1cosIyrx2af_rNO_0 2024-09-19T14:14:29.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10503001340847025638', time=2024-09-19T16:06:11.385658+0000, chain.objs.size()=1 2024-09-19T14:14:29.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.20__shadow_.Sip24rtnKy_VjaTJD3LH3YocaOOBvC4_0 2024-09-19T14:14:29.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16887394267170522345', time=2024-09-19T16:06:46.358355+0000, chain.objs.size()=1 2024-09-19T14:14:29.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.21__shadow_.wmf7C2MmBBlLnpPAMlJjOhjNh30FxwS_0 2024-09-19T14:14:29.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12194036345474949891', time=2024-09-19T16:06:46.473223+0000, chain.objs.size()=1 2024-09-19T14:14:29.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.21__shadow_.OX1KcNO2jqmCa-7RkbhdzB3aB-SgYRO_0 2024-09-19T14:14:29.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15113110408889233423', time=2024-09-19T16:06:46.474821+0000, chain.objs.size()=1 2024-09-19T14:14:29.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.21__shadow_.b5PgHktuSmxhBMRNKdpNtnAi8AB6kuw_0 2024-09-19T14:14:29.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1924077385785847951', time=2024-09-19T16:06:51.156632+0000, chain.objs.size()=1 2024-09-19T14:14:29.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.22__shadow_.-CDR2VI1PMsxs95o7wPwKCxWlNXt9zo_0 2024-09-19T14:14:29.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13321234828196019756', time=2024-09-19T16:06:51.347026+0000, chain.objs.size()=1 2024-09-19T14:14:29.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.22__shadow_.uoSsbSVinN1mX-5N2F7Ju9BtDJ4aQVT_0 2024-09-19T14:14:29.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7800861122399175905', time=2024-09-19T16:07:34.895707+0000, chain.objs.size()=1 2024-09-19T14:14:29.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.25__shadow_.8ULGZ3hZHIYA09lhzRf7kZWbNyUxpAH_0 2024-09-19T14:14:29.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15072405787645394781', time=2024-09-19T16:07:34.898604+0000, chain.objs.size()=1 2024-09-19T14:14:29.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.516+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.25__shadow_.v-c0Unrr7YZL0e6zTZ-BhisxrahRNBH_0 2024-09-19T14:14:29.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.524+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.879624923782023293', time=2024-09-19T16:07:39.186281+0000, chain.objs.size()=1 2024-09-19T14:14:29.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.524+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.26__shadow_.eHfoKI1D6grO8LBBUyRI1cjafAOFhmj_0 2024-09-19T14:14:29.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.524+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16166102803732517372', time=2024-09-19T16:08:13.814775+0000, chain.objs.size()=1 2024-09-19T14:14:29.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.524+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.27__shadow_.POx-30Imo1zyVdhFf61h57cMnTdQmSB_0 2024-09-19T14:14:29.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.524+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10312244570766556824', time=2024-09-19T16:08:58.139724+0000, chain.objs.size()=1 2024-09-19T14:14:29.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.524+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.30__shadow_.f_Q1GcnYS94ant8N2SvlNWAEoJaDN1O_0 2024-09-19T14:14:29.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.532+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.536+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:14:29.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.540+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.540+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.544+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-19T14:14:29.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.544+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8653622387482853806', time=2024-09-19T16:04:23.221340+0000, chain.objs.size()=1 2024-09-19T14:14:29.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.544+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.4__shadow_.oYYWuqu75os4UolXPPP1wLLsM_nrSvl_0 2024-09-19T14:14:29.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.544+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10064598267397148524', time=2024-09-19T16:04:23.383525+0000, chain.objs.size()=4 2024-09-19T14:14:29.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.544+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.12__multipart_foo.2~_4ig7ItERt0z7_fG9W5LmIoC59khzWQ.1 2024-09-19T14:14:29.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.544+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.12__multipart_foo.2~_4ig7ItERt0z7_fG9W5LmIoC59khzWQ.2 2024-09-19T14:14:29.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.544+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.12__multipart_foo.2~_4ig7ItERt0z7_fG9W5LmIoC59khzWQ.3 2024-09-19T14:14:29.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.544+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.12__multipart_foo.2~_4ig7ItERt0z7_fG9W5LmIoC59khzWQ.4 2024-09-19T14:14:29.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.544+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.250964799312123171', time=2024-09-19T16:04:24.366229+0000, chain.objs.size()=1 2024-09-19T14:14:29.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.544+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.8__shadow_.bTAUpyYkEVfUoX9qBSxq3OCK48zG58h_0 2024-09-19T14:14:29.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.544+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18174919466468691447', time=2024-09-19T16:06:06.831981+0000, chain.objs.size()=1 2024-09-19T14:14:29.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.544+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.19__shadow_.4GWSrRYp1gGkw0oPEpYpKSq_ZqP8v7E_0 2024-09-19T14:14:29.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.544+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5336458994567579008', time=2024-09-19T16:06:11.300742+0000, chain.objs.size()=1 2024-09-19T14:14:29.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.544+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.20__shadow_.AC3o6XRpuRsklWKgGbRIlEI573pxVLA_0 2024-09-19T14:14:29.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.544+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2044484809149801540', time=2024-09-19T16:06:51.386685+0000, chain.objs.size()=1 2024-09-19T14:14:29.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.544+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.22__shadow_.hJn5tSfT0XrPbGUQqDTaIY8JOfaE7mW_0 2024-09-19T14:14:29.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.544+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12226743677178829612', time=2024-09-19T16:06:55.318679+0000, chain.objs.size()=1 2024-09-19T14:14:29.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.544+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.23__shadow_.OnxbB0car1WWTT1BF22AFSUkCnQRD_J_0 2024-09-19T14:14:29.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.544+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5061788594888482139', time=2024-09-19T16:06:55.568280+0000, chain.objs.size()=1 2024-09-19T14:14:29.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.544+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.23__shadow_.3PIb68-RHg-X04VoiksGuQ6HfEsYv3l_0 2024-09-19T14:14:29.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.544+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10408110651012192287', time=2024-09-19T16:06:58.915297+0000, chain.objs.size()=1 2024-09-19T14:14:29.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.544+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.24__shadow_.OawQDvl1Le-Pxu6eChnZumAdS5PbsZK_0 2024-09-19T14:14:29.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.548+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2969671166970476219', time=2024-09-19T16:07:29.984092+0000, chain.objs.size()=1 2024-09-19T14:14:29.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.548+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.24__shadow_.xauphXeoLvPRubs8Zf3Jyu4PHq93kev_0 2024-09-19T14:14:29.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.552+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15503491014928670350', time=2024-09-19T16:07:29.987289+0000, chain.objs.size()=1 2024-09-19T14:14:29.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.552+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.24__shadow_.IGSxFGbKgPIFLFphT09t60holCKdZGe_0 2024-09-19T14:14:29.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.552+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5305045117419111582', time=2024-09-19T16:07:39.249555+0000, chain.objs.size()=1 2024-09-19T14:14:29.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.552+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.26__shadow_.N82lbisGeLUFeBOY9BV2AELduq9zuLJ_0 2024-09-19T14:14:29.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.552+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8740026935069574610', time=2024-09-19T16:08:13.757695+0000, chain.objs.size()=1 2024-09-19T14:14:29.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.552+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.27__shadow_.dXoALRCtdBcb6djKg-WHIUJyI7WS3IN_0 2024-09-19T14:14:29.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.556+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12540954291143574504', time=2024-09-19T16:08:53.259423+0000, chain.objs.size()=1 2024-09-19T14:14:29.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.556+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.29__shadow_.RcLjN7L4Tx79davi14-KX0RtbmEdDZg_0 2024-09-19T14:14:29.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.556+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.64940095872635978', time=2024-09-19T16:08:53.428105+0000, chain.objs.size()=1 2024-09-19T14:14:29.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.556+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.29__shadow_.KVqbL9xKlR2BbFC7JD5IKDuqKZrksnw_0 2024-09-19T14:14:29.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.556+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3683179678593752101', time=2024-09-19T16:08:58.122892+0000, chain.objs.size()=1 2024-09-19T14:14:29.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.556+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.30__shadow_.F69Ew4KZ5DO3YyB80fghwRwZlAdk_VD_0 2024-09-19T14:14:29.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.556+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13923710406625895713', time=2024-09-19T16:09:02.219381+0000, chain.objs.size()=1 2024-09-19T14:14:29.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.556+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.31__shadow_.jDcVqklHFZm8P2gKeZafLHrWIu92UJR_0 2024-09-19T14:14:29.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.556+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1707336405687597629', time=2024-09-19T16:09:02.479314+0000, chain.objs.size()=1 2024-09-19T14:14:29.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.556+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.31__shadow_.5FppUM3YbEI-1GqPFFan0htY0mSczOn_0 2024-09-19T14:14:29.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.556+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7139771112546438203', time=2024-09-19T16:09:38.170508+0000, chain.objs.size()=1 2024-09-19T14:14:29.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.556+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.32__shadow_.EcK1UJc8-R7qSKeE4mf09G-a_8u9IJH_0 2024-09-19T14:14:29.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.556+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9156812105012980524', time=2024-09-19T16:09:44.186807+0000, chain.objs.size()=1 2024-09-19T14:14:29.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.556+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.33__shadow_.XBzS1swOGENwqItUzs4omSMdeV1Ggwj_0 2024-09-19T14:14:29.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.556+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12138544203615881059', time=2024-09-19T16:10:24.061758+0000, chain.objs.size()=1 2024-09-19T14:14:29.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.556+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.35__shadow_.oTBgjweDtSWaGuQhlXUZnY-UAqYg2KE_0 2024-09-19T14:14:29.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.568+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14208471880869238256', time=2024-09-19T16:10:24.104528+0000, chain.objs.size()=1 2024-09-19T14:14:29.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.568+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.35__shadow_.Kg42TIraOovv3cpzpQJtFiKcvOWbgnW_0 2024-09-19T14:14:29.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.568+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10894967029855925419', time=2024-09-19T16:10:59.977115+0000, chain.objs.size()=1 2024-09-19T14:14:29.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.568+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.36__shadow_.HIpvTUzAV39RM-9hSXeWhHdiFBb6BYi_0 2024-09-19T14:14:29.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.568+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18218632104482234773', time=2024-09-19T16:10:59.979013+0000, chain.objs.size()=1 2024-09-19T14:14:29.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.568+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.36__shadow_.O4WocvuWRMCK070DVBO5k5E0dsjaX4p_0 2024-09-19T14:14:29.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.568+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9713216239521588513', time=2024-09-19T16:11:05.385150+0000, chain.objs.size()=1 2024-09-19T14:14:29.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.568+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.37__shadow_.XPJwS-ar7GOgYVy9WAcT1Eh5JhwiDLy_0 2024-09-19T14:14:29.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.572+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.576+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:14:29.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-19T14:14:29.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.422249476256398722', time=2024-09-19T16:04:23.214610+0000, chain.objs.size()=1 2024-09-19T14:14:29.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.4__shadow_.8MI1i38uRC7vo0S56CRoSniIUD_dIyJ_0 2024-09-19T14:14:29.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13606628105662687129', time=2024-09-19T16:04:23.267692+0000, chain.objs.size()=1 2024-09-19T14:14:29.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.4__shadow_.-6iBglF2QHoSR8PMSVCLwZqQHiK1KwP_0 2024-09-19T14:14:29.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='_jWQmW-Ex7G4WEFdD-PtpJsFWQltv8N8', time=2024-09-19T16:04:23.641693+0000, chain.objs.size()=1 2024-09-19T14:14:29.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.15__shadow_.md40X0lwf3bpMJ0udrwTITixRe3NvYC_0 2024-09-19T14:14:29.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='_o9-waX3UtRdxCavWAcOqN6rbtOZY22L', time=2024-09-19T16:04:23.802513+0000, chain.objs.size()=2 2024-09-19T14:14:29.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__shadow_.b3WIX43Km5Ep9sylj9caA-GDUsDRg3j_0 2024-09-19T14:14:29.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__shadow_.b3WIX43Km5Ep9sylj9caA-GDUsDRg3j_1 2024-09-19T14:14:29.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9316444066538509302', time=2024-09-19T16:07:29.988561+0000, chain.objs.size()=1 2024-09-19T14:14:29.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.24__shadow_.gX8X9-sKS4UxDTaQK_vEVjTKZSFQIf8_0 2024-09-19T14:14:29.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4058672890214374361', time=2024-09-19T16:07:30.103145+0000, chain.objs.size()=1 2024-09-19T14:14:29.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.24__shadow_.-rgAbWAkiQbQn2PNIY4IMwGVMixcIA-_0 2024-09-19T14:14:29.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17330177788422175966', time=2024-09-19T16:08:13.800892+0000, chain.objs.size()=1 2024-09-19T14:14:29.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.27__shadow_.zkD-8Is5lqhws7NS9v2bZ-Lscas5L8n_0 2024-09-19T14:14:29.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2650849433590262666', time=2024-09-19T16:08:13.802747+0000, chain.objs.size()=1 2024-09-19T14:14:29.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.27__shadow_.RD2AgJTQLQ3NBSgOd_scRpRghuap4Br_0 2024-09-19T14:14:29.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9487999538994924053', time=2024-09-19T16:08:18.364918+0000, chain.objs.size()=1 2024-09-19T14:14:29.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.28__shadow_.aLQIcv8rRwBtA9PRRW63Ry2KCgeQh2R_0 2024-09-19T14:14:29.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14167358768531714507', time=2024-09-19T16:09:02.265575+0000, chain.objs.size()=1 2024-09-19T14:14:29.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.31__shadow_.VNFghi3UkMxDjujGCwHA76R5C_tPohm_0 2024-09-19T14:14:29.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1035130188306785690', time=2024-09-19T16:10:19.556850+0000, chain.objs.size()=1 2024-09-19T14:14:29.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.580+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.34__shadow_.dkw23xaur1JBUjP-VgTId0c55cYOEbn_0 2024-09-19T14:14:29.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.588+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10180608649223325275', time=2024-09-19T16:10:19.563901+0000, chain.objs.size()=1 2024-09-19T14:14:29.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.592+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.34__shadow_.2MNkZXIFb13sGxvhLuzdirL_M8IXZRF_0 2024-09-19T14:14:29.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.592+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11719439404615514582', time=2024-09-19T16:10:23.957626+0000, chain.objs.size()=1 2024-09-19T14:14:29.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.592+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.35__shadow_.iQVAhSMiXYxgpTsNtJJ95H69N1p-C0u_0 2024-09-19T14:14:29.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.592+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7008612131526347489', time=2024-09-19T16:10:24.109873+0000, chain.objs.size()=1 2024-09-19T14:14:29.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.592+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.35__shadow_.bkX-zPQ_mq1lG-WcBmQaaPRz-1GXqth_0 2024-09-19T14:14:29.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.592+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3425808294867318817', time=2024-09-19T16:10:59.950317+0000, chain.objs.size()=1 2024-09-19T14:14:29.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.592+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.36__shadow_.YA3hJPFjfoIy5ihcaqHi_lo_yxsnRAD_0 2024-09-19T14:14:29.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.592+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5100973410734144574', time=2024-09-19T16:11:44.989346+0000, chain.objs.size()=1 2024-09-19T14:14:29.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.592+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.39__shadow_.wSMqSNH8wZgtoNNw3xU-ysYge8wv3x7_0 2024-09-19T14:14:29.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.596+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.600+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:14:29.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-19T14:14:29.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10186407353569373784', time=2024-09-19T16:04:24.296307+0000, chain.objs.size()=1 2024-09-19T14:14:29.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.7__shadow_.6FM8c5jx8ZHNKVOMHkfVSdJvH9Vpqrb_0 2024-09-19T14:14:29.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11819407702504252678', time=2024-09-19T16:04:24.377403+0000, chain.objs.size()=1 2024-09-19T14:14:29.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.8__shadow_.6HWrhRJyXnXGhKuKvRyOaGWV8Wxbfax_0 2024-09-19T14:14:29.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2426249319098713078', time=2024-09-19T16:06:55.572812+0000, chain.objs.size()=1 2024-09-19T14:14:29.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.23__shadow_.foUjsw4cNzohlnazuFnf7JdDLO82EO__0 2024-09-19T14:14:29.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11092507064520179164', time=2024-09-19T16:07:35.004137+0000, chain.objs.size()=1 2024-09-19T14:14:29.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.25__shadow_.CXhprPX7f_WMCDxJ3GSByRSgmiRoAyP_0 2024-09-19T14:14:29.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5117134811944269168', time=2024-09-19T16:07:39.369709+0000, chain.objs.size()=1 2024-09-19T14:14:29.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.26__shadow_.2D21NWX8As6DKOxeJMnFJuslpAzcB3V_0 2024-09-19T14:14:29.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3037656738463218560', time=2024-09-19T16:08:18.304003+0000, chain.objs.size()=1 2024-09-19T14:14:29.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.28__shadow_.gE65W-uVULXB9eJ3wYD9ynhk9icAaoN_0 2024-09-19T14:14:29.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18007369131749867399', time=2024-09-19T16:08:18.305805+0000, chain.objs.size()=1 2024-09-19T14:14:29.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.28__shadow_.E1Ew2zuJKo2x4FEdQ9y9nbJdl5xazUL_0 2024-09-19T14:14:29.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4969118102692118192', time=2024-09-19T16:08:58.315598+0000, chain.objs.size()=1 2024-09-19T14:14:29.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.30__shadow_.7QlJvLtXaSiyS5knXiwMMaK8t1b_0b__0 2024-09-19T14:14:29.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10277890237212652900', time=2024-09-19T16:08:58.317222+0000, chain.objs.size()=1 2024-09-19T14:14:29.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.30__shadow_.uhyMVxnHR24GJ1026_t0o0M3iMuliW-_0 2024-09-19T14:14:29.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12895776245374981077', time=2024-09-19T16:09:36.784346+0000, chain.objs.size()=1 2024-09-19T14:14:29.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.32__shadow_.RSsWp5DkmnN2jcP_FbNc_e2krtAvi7j_0 2024-09-19T14:14:29.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3887301769934364201', time=2024-09-19T16:09:38.189922+0000, chain.objs.size()=1 2024-09-19T14:14:29.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.32__shadow_.psmKaXWq4k7riMJka76dztKPI8rc5Ei_0 2024-09-19T14:14:29.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9005250044312761116', time=2024-09-19T16:09:44.146499+0000, chain.objs.size()=1 2024-09-19T14:14:29.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.604+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.33__shadow_.vWMHny0IJGMwgRW7AoF9BxDbBijiWrI_0 2024-09-19T14:14:29.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.608+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16501289856375870587', time=2024-09-19T16:10:19.547429+0000, chain.objs.size()=1 2024-09-19T14:14:29.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.608+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.34__shadow_.c0MPjzT8Y99hejRhHZbnfDknqtDNRVQ_0 2024-09-19T14:14:29.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.612+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13877481750638948168', time=2024-09-19T16:11:00.063984+0000, chain.objs.size()=1 2024-09-19T14:14:29.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.612+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.36__shadow_.CDGJw5_YqiqSYOPt5aBl6Wcf-5sFdnH_0 2024-09-19T14:14:29.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.612+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17925231446370979832', time=2024-09-19T16:11:05.391507+0000, chain.objs.size()=1 2024-09-19T14:14:29.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.612+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.37__shadow_.B6wZR28OdmyaoT07M_DVF1B2UkbNYLY_0 2024-09-19T14:14:29.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.612+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15813356870401650336', time=2024-09-19T16:11:09.287877+0000, chain.objs.size()=1 2024-09-19T14:14:29.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.612+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.38__shadow_.sqnSQUdp2EFmdpfYPkN33HyoUOnRqGO_0 2024-09-19T14:14:29.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.616+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.620+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:14:29.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.620+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.620+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-19T14:14:29.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='_yjWzopCcb_nwM_lt0gPc1TAj3wFj6GR', time=2024-09-19T16:04:23.586464+0000, chain.objs.size()=1 2024-09-19T14:14:29.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.15__shadow_.f90KQDYtvCJ2CnPBw13R_Eo2PfTyHCW_0 2024-09-19T14:14:29.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5953696540504761295', time=2024-09-19T16:04:23.664693+0000, chain.objs.size()=1 2024-09-19T14:14:29.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.15__shadow_.UuB97-xnlolQi464p3aH_ShFoTd6SMO_0 2024-09-19T14:14:29.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16690996911054858959', time=2024-09-19T16:04:23.675170+0000, chain.objs.size()=1 2024-09-19T14:14:29.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.15__shadow_.O6aUo8iWv9ZHXZ9eQ78caatLsx9I3oP_0 2024-09-19T14:14:29.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17387971593349415563', time=2024-09-19T16:06:46.477077+0000, chain.objs.size()=1 2024-09-19T14:14:29.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.21__shadow_.7-S-QsE4OVkm9YJwuqcnq3UdThbVNul_0 2024-09-19T14:14:29.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4630884743345966497', time=2024-09-19T16:06:46.542512+0000, chain.objs.size()=1 2024-09-19T14:14:29.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.21__shadow_.SdcdeJcohP9yObIQAS1XoLu6Zpk23Nc_0 2024-09-19T14:14:29.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13999121706117979701', time=2024-09-19T16:06:51.414743+0000, chain.objs.size()=1 2024-09-19T14:14:29.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.22__shadow_.q2rAeg71Xac5zUpdhrLubaBGttStnAm_0 2024-09-19T14:14:29.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4866979375487925773', time=2024-09-19T16:06:55.417663+0000, chain.objs.size()=1 2024-09-19T14:14:29.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.23__shadow_.H2nVM7VmcZ1UenIUODhvfCt9vP9Xy5q_0 2024-09-19T14:14:29.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.355142515919060401', time=2024-09-19T16:07:34.837113+0000, chain.objs.size()=1 2024-09-19T14:14:29.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.25__shadow_.Z9XnOzMURyLiU0_ZqsjWzP32pqEa-gq_0 2024-09-19T14:14:29.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7161005809629541112', time=2024-09-19T16:08:18.311145+0000, chain.objs.size()=1 2024-09-19T14:14:29.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.28__shadow_.yqqgYK-g2eSryms_O1YanfHG2m17A54_0 2024-09-19T14:14:29.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1938933003640442771', time=2024-09-19T16:08:18.488373+0000, chain.objs.size()=1 2024-09-19T14:14:29.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.28__shadow_.6Jp2fmIkH12TzRnxZsquweOVFcBTDAF_0 2024-09-19T14:14:29.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10753491954879089173', time=2024-09-19T16:08:53.193259+0000, chain.objs.size()=1 2024-09-19T14:14:29.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.29__shadow_.fZyWR_JMWcu7G4JNDRBniZbQZOEBuJf_0 2024-09-19T14:14:29.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.806070439081722061', time=2024-09-19T16:09:02.224924+0000, chain.objs.size()=1 2024-09-19T14:14:29.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.624+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.31__shadow_.y1Udq839hR7rGQ2WcOSeoS4lkfA9FIs_0 2024-09-19T14:14:29.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.628+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15741909740781015170', time=2024-09-19T16:11:05.277679+0000, chain.objs.size()=1 2024-09-19T14:14:29.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.628+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.37__shadow_.oLmDvSkcyoLVGJs8kAYCUmTVMUBME1t_0 2024-09-19T14:14:29.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.632+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.636+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:14:29.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.636+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.636+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-19T14:14:29.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6345412191740900574', time=2024-09-19T16:06:06.859154+0000, chain.objs.size()=1 2024-09-19T14:14:29.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.19__shadow_.83amOVeQbUCAJ4NiotoM_oL0pMU2ZxT_0 2024-09-19T14:14:29.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5518634108022287194', time=2024-09-19T16:07:29.879020+0000, chain.objs.size()=1 2024-09-19T14:14:29.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.24__shadow_.SYMAWLotrMzlxIwQSds3idQMKyUZCK2_0 2024-09-19T14:14:29.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.565436931587050303', time=2024-09-19T16:07:34.953148+0000, chain.objs.size()=1 2024-09-19T14:14:29.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.25__shadow_.QLxazPDVj18xUUjH1AJ1o04Hg9fQsTg_0 2024-09-19T14:14:29.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8926819129401008985', time=2024-09-19T16:07:39.210363+0000, chain.objs.size()=1 2024-09-19T14:14:29.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.26__shadow_.iTM9afMOIG-dkHC2Qk3XdFKFVRnlNA0_0 2024-09-19T14:14:29.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11643073474599490827', time=2024-09-19T16:08:18.338942+0000, chain.objs.size()=1 2024-09-19T14:14:29.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.28__shadow_.SJdxtaOO7pDKO2lSTHAeK8YPEO2IdQ6_0 2024-09-19T14:14:29.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2913008379664400803', time=2024-09-19T16:08:53.355762+0000, chain.objs.size()=1 2024-09-19T14:14:29.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.29__shadow_.2EOaLIki65tv3KipXLW86gRMo1w6zP__0 2024-09-19T14:14:29.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6150737115956140853', time=2024-09-19T16:08:58.191015+0000, chain.objs.size()=1 2024-09-19T14:14:29.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.30__shadow_.v3aWXQ7rdbUmZ44thBIMaplbDhAUyLy_0 2024-09-19T14:14:29.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1009549618179182768', time=2024-09-19T16:08:58.236685+0000, chain.objs.size()=1 2024-09-19T14:14:29.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.30__shadow_.YBfWdamhtZw8PntrnigdglRQfAknKK2_0 2024-09-19T14:14:29.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9482600155915626341', time=2024-09-19T16:09:38.333245+0000, chain.objs.size()=1 2024-09-19T14:14:29.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.32__shadow_.b3C43WrTTPQZdnv4qq0lxfhFkrqQl5m_0 2024-09-19T14:14:29.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16149022719008552584', time=2024-09-19T16:09:38.345425+0000, chain.objs.size()=1 2024-09-19T14:14:29.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.32__shadow_.wqC26VeLuMTFfKc9Pp3Isu1MKhpLu2S_0 2024-09-19T14:14:29.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12789669751236081061', time=2024-09-19T16:10:19.441323+0000, chain.objs.size()=1 2024-09-19T14:14:29.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.34__shadow_.MEelN5AW6_idpacoRfHK4dF7EBBbmq__0 2024-09-19T14:14:29.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2907404807947014139', time=2024-09-19T16:11:00.093029+0000, chain.objs.size()=1 2024-09-19T14:14:29.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.640+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.36__shadow_.G-hqnA-3VYjzeqVrm6kkPCBDcUk2t8a_0 2024-09-19T14:14:29.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.644+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14807325495772351393', time=2024-09-19T16:11:05.232261+0000, chain.objs.size()=1 2024-09-19T14:14:29.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.644+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.37__shadow_.gRXle1Aqfn7xTQGEq8wcfAo_BsKI71v_0 2024-09-19T14:14:29.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.644+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15370508559061312899', time=2024-09-19T16:11:05.234009+0000, chain.objs.size()=1 2024-09-19T14:14:29.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.644+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.37__shadow_.bk9LiVV8p7erUjlZ4uIbaw8KGRHuRXh_0 2024-09-19T14:14:29.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.648+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.652+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:14:29.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.652+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.652+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.656+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-19T14:14:29.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.656+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='_yrz33Dcw5nSjxu2hXq6h4kFB9xpukRu', time=2024-09-19T16:04:23.574363+0000, chain.objs.size()=1 2024-09-19T14:14:29.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.656+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.15__shadow_.JShZudM-p6IvYxoB-3CR0wtIVTSKySO_0 2024-09-19T14:14:29.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.656+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14420163408792039922', time=2024-09-19T16:04:23.850230+0000, chain.objs.size()=3 2024-09-19T14:14:29.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.656+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-STANDARD.2~gdE6JUtwpyru8uk8HI9hGMJGNYHW-Gl.1 2024-09-19T14:14:29.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.656+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-STANDARD.2~gdE6JUtwpyru8uk8HI9hGMJGNYHW-Gl.2 2024-09-19T14:14:29.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.656+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-STANDARD.2~gdE6JUtwpyru8uk8HI9hGMJGNYHW-Gl.3 2024-09-19T14:14:29.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.656+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10245400797347235918', time=2024-09-19T16:04:23.947220+0000, chain.objs.size()=3 2024-09-19T14:14:29.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.656+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.14__multipart_foo-FROZEN.2~SlHG5aw_nWTzoNJau2m2IdAarGjxCtF.1 2024-09-19T14:14:29.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.656+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.14__multipart_foo-FROZEN.2~SlHG5aw_nWTzoNJau2m2IdAarGjxCtF.2 2024-09-19T14:14:29.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.656+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.14__multipart_foo-FROZEN.2~SlHG5aw_nWTzoNJau2m2IdAarGjxCtF.3 2024-09-19T14:14:29.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.656+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9366072031057718561', time=2024-09-19T16:06:07.005556+0000, chain.objs.size()=1 2024-09-19T14:14:29.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.656+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.19__shadow_.BJFpxqThc-MzxaeBs2gX5qT5iTh_tEm_0 2024-09-19T14:14:29.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.656+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.263870858272854718', time=2024-09-19T16:06:11.381235+0000, chain.objs.size()=1 2024-09-19T14:14:29.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.656+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.20__shadow_._l3_R-Ksdo3WlwaGeTyY5OuNu2XVyyk_0 2024-09-19T14:14:29.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.656+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16225149602159134291', time=2024-09-19T16:06:51.320681+0000, chain.objs.size()=1 2024-09-19T14:14:29.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.656+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.22__shadow_.m6gie5gPBBfPQGhdHDTvMjqHPWzUHgp_0 2024-09-19T14:14:29.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.656+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4591495060252071961', time=2024-09-19T16:07:39.125246+0000, chain.objs.size()=1 2024-09-19T14:14:29.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.656+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.26__shadow_.J2ZEb6XWBT1_OUjh_nrUUF-jXbOlvg7_0 2024-09-19T14:14:29.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.656+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5631312632157913702', time=2024-09-19T16:08:53.338515+0000, chain.objs.size()=1 2024-09-19T14:14:29.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.656+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.29__shadow_.U3jZDGHTJXn2QXSGdLrqmGVV8DaoTma_0 2024-09-19T14:14:29.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.660+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12221285617944654581', time=2024-09-19T16:09:02.284309+0000, chain.objs.size()=1 2024-09-19T14:14:29.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.660+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.31__shadow_.MyNKjt9yxgWV2aU7AJiJprNETcVmgYB_0 2024-09-19T14:14:29.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.660+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1723118347862644417', time=2024-09-19T16:09:38.189969+0000, chain.objs.size()=1 2024-09-19T14:14:29.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.660+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.32__shadow_.2-WRvR1lpcUjK99ef_uYr2JiCWCtAdm_0 2024-09-19T14:14:29.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.660+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9473373811063839689', time=2024-09-19T16:10:19.548290+0000, chain.objs.size()=1 2024-09-19T14:14:29.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.660+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.34__shadow_.D_OSNot9A5xxJdoevxrZg1QsRQ-eWla_0 2024-09-19T14:14:29.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.660+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6689257603283711024', time=2024-09-19T16:10:59.960455+0000, chain.objs.size()=1 2024-09-19T14:14:29.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.660+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.36__shadow_.1fXjLfuHJAzElENwui2qN87d6wwwdnH_0 2024-09-19T14:14:29.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.660+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12596891906201646362', time=2024-09-19T16:11:05.338389+0000, chain.objs.size()=1 2024-09-19T14:14:29.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.660+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.37__shadow_.wKZyF5ZuK2KytySZFjQmX-V-rDDv2nH_0 2024-09-19T14:14:29.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.660+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14795723369021759134', time=2024-09-19T16:11:09.071353+0000, chain.objs.size()=1 2024-09-19T14:14:29.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.660+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.38__shadow_.dgYynr8CN9-Ic7PdhbL7UJ8l6qZw9xJ_0 2024-09-19T14:14:29.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.660+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12207995409807872682', time=2024-09-19T16:14:07.446799+0000, chain.objs.size()=1 2024-09-19T14:14:29.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.660+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.18__shadow:FBK6mYqX8dmcDtpD3PppEUfoI0WfliK_.Eg3MisEmdw4YM8-LKGQOsRpyYb8Airo_0 2024-09-19T14:14:29.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.664+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.668+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:14:29.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-19T14:14:29.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12245280293347640221', time=2024-09-19T16:06:06.949517+0000, chain.objs.size()=1 2024-09-19T14:14:29.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.19__shadow_.KsO6-FtjDHpohVCdRni2-l4ozE90A5c_0 2024-09-19T14:14:29.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5425517451131774355', time=2024-09-19T16:06:46.343983+0000, chain.objs.size()=1 2024-09-19T14:14:29.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.21__shadow_.9k_OPE284GPHjcBDQRQTzjdAhd4wadN_0 2024-09-19T14:14:29.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1700925603582381018', time=2024-09-19T16:07:34.782857+0000, chain.objs.size()=1 2024-09-19T14:14:29.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.25__shadow_.RujNAVrUOSLOaBBJObl20UafYBeXzEx_0 2024-09-19T14:14:29.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14657654036488541790', time=2024-09-19T16:07:34.947534+0000, chain.objs.size()=1 2024-09-19T14:14:29.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.25__shadow_.QGIlOiHoBSarD_9_gW0qgFVfH0Dodxe_0 2024-09-19T14:14:29.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2806310938498294282', time=2024-09-19T16:08:13.868646+0000, chain.objs.size()=1 2024-09-19T14:14:29.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.27__shadow_.5rz3xn7n0v3RetgrqLg617yH222sRxd_0 2024-09-19T14:14:29.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15253567126266187127', time=2024-09-19T16:08:13.916716+0000, chain.objs.size()=1 2024-09-19T14:14:29.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.27__shadow_.PBYDHJZFkEs6Ez7DsvPiO31F2AQ6tMY_0 2024-09-19T14:14:29.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15190839327377870772', time=2024-09-19T16:08:17.100448+0000, chain.objs.size()=1 2024-09-19T14:14:29.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.28__shadow_.ZOj9lafvS_Z63d_zOYRQAR5BdbAoU9x_0 2024-09-19T14:14:29.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.797110893243731576', time=2024-09-19T16:08:18.379306+0000, chain.objs.size()=1 2024-09-19T14:14:29.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.28__shadow_.v66ajHXHgmFimWDqV3aPZaa0n0mQtz4_0 2024-09-19T14:14:29.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13986041259382962289', time=2024-09-19T16:08:53.206261+0000, chain.objs.size()=1 2024-09-19T14:14:29.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.29__shadow_.eXOpRQgdq-_Ib70XlQTjai4WcQi_z5M_0 2024-09-19T14:14:29.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17614488126507837728', time=2024-09-19T16:08:53.351435+0000, chain.objs.size()=1 2024-09-19T14:14:29.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.29__shadow_.zaUV9Yqt97rRQDi_dgASMWZbEwfrz9F_0 2024-09-19T14:14:29.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5020071856681077373', time=2024-09-19T16:08:58.130830+0000, chain.objs.size()=1 2024-09-19T14:14:29.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.30__shadow_.1vHJZUCdJN-Ky7rcC3lx-wKjLzOQ1Tm_0 2024-09-19T14:14:29.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17497870257605982272', time=2024-09-19T16:09:02.153933+0000, chain.objs.size()=1 2024-09-19T14:14:29.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.672+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.31__shadow_.9XR2Z8vhAm3LcNFfHG3fAghP6D3Y56r_0 2024-09-19T14:14:29.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.676+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5254364688697842041', time=2024-09-19T16:09:02.316906+0000, chain.objs.size()=1 2024-09-19T14:14:29.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.676+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.31__shadow_.lrlC9HJNoevHNleNjnsJbLLJM59ZAMq_0 2024-09-19T14:14:29.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.676+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1888089976922357529', time=2024-09-19T16:09:38.126028+0000, chain.objs.size()=1 2024-09-19T14:14:29.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.676+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.32__shadow_.xTbqaFVGOVzjvEmkraQSsti942NDDKl_0 2024-09-19T14:14:29.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.676+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8814334803731347267', time=2024-09-19T16:09:44.191831+0000, chain.objs.size()=1 2024-09-19T14:14:29.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.676+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.33__shadow_.uv5U6doCiANxw8gH5ILKLOGeX3q4orB_0 2024-09-19T14:14:29.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.676+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9804164865854619418', time=2024-09-19T16:09:44.222593+0000, chain.objs.size()=1 2024-09-19T14:14:29.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.676+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.33__shadow_.PCz7_2tpcNn1C8f249aW5WrhCiUY1nB_0 2024-09-19T14:14:29.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.676+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14373862648329882449', time=2024-09-19T16:10:59.882709+0000, chain.objs.size()=1 2024-09-19T14:14:29.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.676+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.36__shadow_.zSd-rs-BpK7L5xEcb_CEhh5MXcrvvkv_0 2024-09-19T14:14:29.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.676+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7794486623789134065', time=2024-09-19T16:11:03.772054+0000, chain.objs.size()=1 2024-09-19T14:14:29.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.676+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.37__shadow_.uOxI9PIQe0VIVGhFLQbzVrIUCPSkpS3_0 2024-09-19T14:14:29.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.676+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6083345633283767756', time=2024-09-19T16:11:05.274403+0000, chain.objs.size()=1 2024-09-19T14:14:29.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.676+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.37__shadow_.V38n01_POlVsZYD3HBayhwWFxbg8mJO_0 2024-09-19T14:14:29.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.676+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7829695327513311739', time=2024-09-19T16:11:45.026497+0000, chain.objs.size()=1 2024-09-19T14:14:29.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.676+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.39__shadow_.e_ImuihXa8yZcDsPTkg0N4IfodlfBgn_0 2024-09-19T14:14:29.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.676+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1677056509710902718', time=2024-09-19T16:11:45.163987+0000, chain.objs.size()=1 2024-09-19T14:14:29.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.676+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.39__shadow_.fwSNpGZEDybqFOrU2SuEG2UGp5M3GuB_0 2024-09-19T14:14:29.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.680+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11298543680432264295', time=2024-09-19T16:13:53.351366+0000, chain.objs.size()=1 2024-09-19T14:14:29.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.680+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.17__shadow_.uK2AYXN4RwE4ObBg4jL2gRMzM3w8nzO_0 2024-09-19T14:14:29.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.684+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:14:29.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-19T14:14:29.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17827615660066138635', time=2024-09-19T16:04:23.205524+0000, chain.objs.size()=1 2024-09-19T14:14:29.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.4__shadow_.foVxOdlrfeIn-uH3JsxqyOVgKyICnGW_0 2024-09-19T14:14:29.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15680809577583621058', time=2024-09-19T16:06:06.890982+0000, chain.objs.size()=1 2024-09-19T14:14:29.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.19__shadow_.wWGRxX4SAd1kNJPkhbCESo8v4AYyHsO_0 2024-09-19T14:14:29.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15012715922355577047', time=2024-09-19T16:06:11.379735+0000, chain.objs.size()=1 2024-09-19T14:14:29.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.20__shadow_.YKFiYQ7G56whOawngR9KzM9LdJrsmyV_0 2024-09-19T14:14:29.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16816283726033388134', time=2024-09-19T16:06:11.382942+0000, chain.objs.size()=1 2024-09-19T14:14:29.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.20__shadow_.9hWbWUPBMPJNd4iV9iDWynd5brQ35m7_0 2024-09-19T14:14:29.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17178068813044055171', time=2024-09-19T16:06:11.544471+0000, chain.objs.size()=1 2024-09-19T14:14:29.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.20__shadow_.dGpf5GzxEeJgxBNIpNYvfxZJwNGg7zi_0 2024-09-19T14:14:29.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9711625901618517168', time=2024-09-19T16:06:14.899023+0000, chain.objs.size()=1 2024-09-19T14:14:29.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.21__shadow_.PBty3TV7pUnlk_I6UDqaCCOWDog97Ca_0 2024-09-19T14:14:29.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12664338648355692861', time=2024-09-19T16:06:51.304558+0000, chain.objs.size()=1 2024-09-19T14:14:29.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.22__shadow_.U_dd1QfGS8ZlGatFSutzOF6CKEOGx6w_0 2024-09-19T14:14:29.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5915278100998310935', time=2024-09-19T16:06:55.428612+0000, chain.objs.size()=1 2024-09-19T14:14:29.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.23__shadow_.9J1TpBwGLVEXZNMQxikAl-bDjbapEyn_0 2024-09-19T14:14:29.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3949219701304294325', time=2024-09-19T16:07:29.984260+0000, chain.objs.size()=1 2024-09-19T14:14:29.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.24__shadow_.quoqBnuBm98r6HE4DG6lV-Dhq6wcTZQ_0 2024-09-19T14:14:29.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.938038364195004216', time=2024-09-19T16:08:18.290297+0000, chain.objs.size()=1 2024-09-19T14:14:29.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.28__shadow_.xfA8taiLsaJoEy9rU7dozjzTWFWgVAJ_0 2024-09-19T14:14:29.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5246427093227975161', time=2024-09-19T16:08:18.313360+0000, chain.objs.size()=1 2024-09-19T14:14:29.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.28__shadow_.D303ixfJc6JQngwY9Z1CKMnSLXUiKGo_0 2024-09-19T14:14:29.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13567593550423737910', time=2024-09-19T16:08:18.512685+0000, chain.objs.size()=1 2024-09-19T14:14:29.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.688+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.28__shadow_.IOopiD34Ekyq4E3Zf8bjbmelw7OegMw_0 2024-09-19T14:14:29.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.692+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14347946694466515899', time=2024-09-19T16:08:53.219802+0000, chain.objs.size()=1 2024-09-19T14:14:29.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.692+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.29__shadow_.anlkRRTBY2PT6IpQ1VJLiWHEoiJXYQg_0 2024-09-19T14:14:29.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.692+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.642857200573046615', time=2024-09-19T16:08:53.386455+0000, chain.objs.size()=1 2024-09-19T14:14:29.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.692+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.29__shadow_.GXlYdlPyVMRrOTtDTBE8ZS4XAs8BPha_0 2024-09-19T14:14:29.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.692+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18002977989395818146', time=2024-09-19T16:08:58.168765+0000, chain.objs.size()=1 2024-09-19T14:14:29.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.692+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.30__shadow_.URVcB_X5L17nQdL-np4b6OilbHXihyq_0 2024-09-19T14:14:29.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.692+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11453862305692639656', time=2024-09-19T16:10:24.061692+0000, chain.objs.size()=1 2024-09-19T14:14:29.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.692+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.35__shadow_.K5n1cgv0ZbMaq72m6MwxFhu89V8pWUL_0 2024-09-19T14:14:29.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.692+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.588354809460325912', time=2024-09-19T16:10:59.908809+0000, chain.objs.size()=1 2024-09-19T14:14:29.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.692+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.36__shadow_.EmyMBjJhCRHMaTrvXycjgoYUwV1jL_k_0 2024-09-19T14:14:29.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.692+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15226396883960653290', time=2024-09-19T16:13:53.287666+0000, chain.objs.size()=1 2024-09-19T14:14:29.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.692+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.17__shadow_.eQsHVM5GGArg9eytShtMgDQ1ahuvwpH_0 2024-09-19T14:14:29.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.696+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.700+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:14:29.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.704+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.704+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.704+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-19T14:14:29.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.704+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9584243089690217844', time=2024-09-19T16:04:23.971429+0000, chain.objs.size()=3 2024-09-19T14:14:29.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.704+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.14__multipart_foo-LUKEWARM.2~KKUr_aEY_XhDUpVNtuu4-YsWy7tdDpM.1 2024-09-19T14:14:29.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.704+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.14__multipart_foo-LUKEWARM.2~KKUr_aEY_XhDUpVNtuu4-YsWy7tdDpM.2 2024-09-19T14:14:29.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.704+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.14__multipart_foo-LUKEWARM.2~KKUr_aEY_XhDUpVNtuu4-YsWy7tdDpM.3 2024-09-19T14:14:29.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.704+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10669439981153778405', time=2024-09-19T16:04:24.031925+0000, chain.objs.size()=2 2024-09-19T14:14:29.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.704+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.13__shadow_.v_ROaMStbxv22YtJjTCrk3JIbzpvQNE_0 2024-09-19T14:14:29.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.704+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.13__shadow_.v_ROaMStbxv22YtJjTCrk3JIbzpvQNE_1 2024-09-19T14:14:29.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.704+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16570442096144780556', time=2024-09-19T16:06:11.400143+0000, chain.objs.size()=1 2024-09-19T14:14:29.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.704+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.20__shadow_.vHGqB2OIVoUJwpZlv5zyzj6hOmr4ZlC_0 2024-09-19T14:14:29.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.704+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15751323064202260432', time=2024-09-19T16:06:51.319465+0000, chain.objs.size()=1 2024-09-19T14:14:29.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.704+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.22__shadow_.yiUx_-Vov1NtZwxz0T0EkTvrDF1XAVF_0 2024-09-19T14:14:29.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.704+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9615474665525196488', time=2024-09-19T16:08:13.642327+0000, chain.objs.size()=1 2024-09-19T14:14:29.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.704+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.27__shadow_.0AQP8Z38qnzjws_GEAgx6uU2XIdqqjO_0 2024-09-19T14:14:29.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.704+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5753710290221844449', time=2024-09-19T16:08:13.931707+0000, chain.objs.size()=1 2024-09-19T14:14:29.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.704+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.27__shadow_.gjzjqHovA5LX36dukUG2a28g0tkm6nO_0 2024-09-19T14:14:29.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.704+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1919393274977482273', time=2024-09-19T16:08:18.373571+0000, chain.objs.size()=1 2024-09-19T14:14:29.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.704+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.28__shadow_.0ZgN0b_RbAeEQvIUZztJW8noWO-tCUB_0 2024-09-19T14:14:29.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.704+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9154105809909438693', time=2024-09-19T16:08:18.375765+0000, chain.objs.size()=1 2024-09-19T14:14:29.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.704+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.28__shadow_.iqAquJ8rbhhT3x7hNiBGfy2DtqP8TRQ_0 2024-09-19T14:14:29.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.704+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16584169711468864013', time=2024-09-19T16:08:53.214233+0000, chain.objs.size()=1 2024-09-19T14:14:29.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.704+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.29__shadow_.iRFATUyh6IUrq7nvYKSZF3iNl3_FD29_0 2024-09-19T14:14:29.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.708+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10890123999719020029', time=2024-09-19T16:08:53.216390+0000, chain.objs.size()=1 2024-09-19T14:14:29.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.708+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.29__shadow_.tyVYcNe0fCYI_PcNpZWJ9zEfsfrK9C6_0 2024-09-19T14:14:29.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.708+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9927197108154944824', time=2024-09-19T16:09:02.301537+0000, chain.objs.size()=1 2024-09-19T14:14:29.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.708+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.31__shadow_.YyBFfElIK4lY7ergncZLpzSu8_-enn-_0 2024-09-19T14:14:29.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.708+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16170167060010095518', time=2024-09-19T16:09:38.086772+0000, chain.objs.size()=1 2024-09-19T14:14:29.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.708+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.32__shadow_.z7Pz3ncwvDFWZlRgiGfmTSBD5VgIrXz_0 2024-09-19T14:14:29.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.708+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12918734472634268103', time=2024-09-19T16:09:44.405211+0000, chain.objs.size()=1 2024-09-19T14:14:29.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.708+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.33__shadow_.tev0p96oUVyaTHIAIN-XgyJPaCpCIwZ_0 2024-09-19T14:14:29.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.708+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.851264281172815725', time=2024-09-19T16:10:19.645840+0000, chain.objs.size()=1 2024-09-19T14:14:29.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.708+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.34__shadow_.8f6Dtp-d6Eo9ZY61Jrpkfco_ntzAjsT_0 2024-09-19T14:14:29.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.708+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14375242750233589194', time=2024-09-19T16:11:05.183810+0000, chain.objs.size()=1 2024-09-19T14:14:29.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.708+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.37__shadow_.2yEBdVgegU2SHuyNr3Kj0Nu1WpOFOl9_0 2024-09-19T14:14:29.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.708+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12047920807636455192', time=2024-09-19T16:11:09.315899+0000, chain.objs.size()=1 2024-09-19T14:14:29.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.708+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.38__shadow_.l9yhLE7VtUoQlAFt622WltZLUafq02e_0 2024-09-19T14:14:29.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.712+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.716+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:14:29.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.716+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.716+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.720+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-19T14:14:29.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.720+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='_rxaSZkGLR4OtZyoeClZ4C88yts-KM86', time=2024-09-19T16:04:23.609556+0000, chain.objs.size()=1 2024-09-19T14:14:29.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.720+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.15__shadow_.W3vTGh9laMCueUC3fvKBDOoD2aYRDXP_0 2024-09-19T14:14:29.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.720+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.145143576985899222', time=2024-09-19T16:06:06.997487+0000, chain.objs.size()=1 2024-09-19T14:14:29.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.720+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.19__shadow_.cgLFTPoOn-RDzkW8cqxdOluJWvYv484_0 2024-09-19T14:14:29.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.720+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16428459388568346005', time=2024-09-19T16:06:46.357438+0000, chain.objs.size()=1 2024-09-19T14:14:29.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.720+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.21__shadow_.WQq6gYLEIHeWdQ0fT6KNK6JdGlyRmfA_0 2024-09-19T14:14:29.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.720+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3528077057518941292', time=2024-09-19T16:07:29.930159+0000, chain.objs.size()=1 2024-09-19T14:14:29.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.720+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.24__shadow_.qFy4xy7ifOE7KTuthBT1MG-3z7YTXgs_0 2024-09-19T14:14:29.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.720+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15859958255157239179', time=2024-09-19T16:08:53.212417+0000, chain.objs.size()=1 2024-09-19T14:14:29.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.720+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.29__shadow_.4y7BxmReFWShxWZ7PrR5afq38vSrFmH_0 2024-09-19T14:14:29.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.720+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6823697009358485825', time=2024-09-19T16:09:38.189913+0000, chain.objs.size()=1 2024-09-19T14:14:29.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.720+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.32__shadow_.wYLWlWUEpEKGNMvQLzE_3v9N0XQ-7fn_0 2024-09-19T14:14:29.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.720+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2548288632352019915', time=2024-09-19T16:10:19.547404+0000, chain.objs.size()=1 2024-09-19T14:14:29.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.720+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.34__shadow_.XgRP7hTao_sRakuM4WMUj5vViojs5Hf_0 2024-09-19T14:14:29.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.720+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14072807957151092913', time=2024-09-19T16:11:00.123454+0000, chain.objs.size()=1 2024-09-19T14:14:29.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.720+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.36__shadow_.QL1l2e_UbGfb4ctY16cImWN9H1_2HQ3_0 2024-09-19T14:14:29.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.720+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3400372968785354097', time=2024-09-19T16:11:00.138660+0000, chain.objs.size()=1 2024-09-19T14:14:29.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.720+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.36__shadow_.mnSY0eEWLRgM1M6jdd3M34-D_cQDERQ_0 2024-09-19T14:14:29.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.720+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5640912096623440904', time=2024-09-19T16:11:09.174614+0000, chain.objs.size()=1 2024-09-19T14:14:29.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.720+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.38__shadow_.ge1EKJ8_GzUscoj2pxG3szk_O1rk-PQ_0 2024-09-19T14:14:29.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.724+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.724+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:14:29.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-19T14:14:29.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='_CD9XUJKmV65ekQVR3R1LWhMAlJ_0Jr3', time=2024-09-19T16:04:23.687429+0000, chain.objs.size()=1 2024-09-19T14:14:29.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.15__shadow_.LaAyIMbiFzi3xEw5ARAWdLxLekfR3Tz_0 2024-09-19T14:14:29.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6092624059316557370', time=2024-09-19T16:06:07.020198+0000, chain.objs.size()=1 2024-09-19T14:14:29.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.19__shadow_.XSVIPUoRYXUOcL5XeNWc44sI2zmaB0l_0 2024-09-19T14:14:29.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2017871697181840817', time=2024-09-19T16:06:11.409264+0000, chain.objs.size()=1 2024-09-19T14:14:29.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.20__shadow_.0nWc-2wYBfxnsYkG6vJwT1yubTWvM2j_0 2024-09-19T14:14:29.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5392614561594143095', time=2024-09-19T16:06:46.462344+0000, chain.objs.size()=1 2024-09-19T14:14:29.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.21__shadow_.I-LU5BOvKKcK3w2Y_wkfori1narP3sT_0 2024-09-19T14:14:29.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5310391620447254622', time=2024-09-19T16:06:51.313331+0000, chain.objs.size()=1 2024-09-19T14:14:29.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.22__shadow_.S8PHXGcNP4D9PO54AdS0Yvke2UoJ2zm_0 2024-09-19T14:14:29.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.751664333299312066', time=2024-09-19T16:06:51.374661+0000, chain.objs.size()=1 2024-09-19T14:14:29.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.22__shadow_.EPOx5hcLhcsdVonfPfa_YUROFPNw_ei_0 2024-09-19T14:14:29.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12177443794893843781', time=2024-09-19T16:06:55.558504+0000, chain.objs.size()=1 2024-09-19T14:14:29.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.23__shadow_.eLVTz74lXGTwnM901L6kokaCQswmjsb_0 2024-09-19T14:14:29.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1259124342595478656', time=2024-09-19T16:07:29.894315+0000, chain.objs.size()=1 2024-09-19T14:14:29.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.24__shadow_.zNkVoneZe5Ws2xExsKzQ9StkoPk14u0_0 2024-09-19T14:14:29.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12666296408553786141', time=2024-09-19T16:07:35.003544+0000, chain.objs.size()=1 2024-09-19T14:14:29.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.25__shadow_.2DoTTGbP0SkDL-TgSHaKNYMCfS_dSHD_0 2024-09-19T14:14:29.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6495246375724035799', time=2024-09-19T16:08:58.134833+0000, chain.objs.size()=1 2024-09-19T14:14:29.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.30__shadow_.FFegIp24yCr4Gj6SONKRX8um4q2ok7b_0 2024-09-19T14:14:29.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4622647309567834045', time=2024-09-19T16:08:58.172154+0000, chain.objs.size()=1 2024-09-19T14:14:29.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.30__shadow_.r3xsCzjqvLNDw8ZmIY70T9_lYdt5Vie_0 2024-09-19T14:14:29.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12518466701493598758', time=2024-09-19T16:10:19.512494+0000, chain.objs.size()=1 2024-09-19T14:14:29.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.728+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.34__shadow_.tNiRAIvTlpSbHqX2ttQSTl-vNyBmUG6_0 2024-09-19T14:14:29.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.732+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8909304442125334257', time=2024-09-19T16:10:19.514071+0000, chain.objs.size()=1 2024-09-19T14:14:29.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.732+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.34__shadow_.ZER3TxhHRcWLdtuVDwHuYvr_23oDrAh_0 2024-09-19T14:14:29.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.732+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13614149625067252100', time=2024-09-19T16:10:23.240067+0000, chain.objs.size()=1 2024-09-19T14:14:29.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.732+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.35__shadow_.m3KM-DGWi2S-nsDzF23pD6AGg4cQcvi_0 2024-09-19T14:14:29.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.732+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3391704679843802190', time=2024-09-19T16:10:23.957172+0000, chain.objs.size()=1 2024-09-19T14:14:29.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.732+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.35__shadow_.lUq1oRSWx2DMFKw0gGPyMsA7OPP0pso_0 2024-09-19T14:14:29.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.732+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4038193043835535470', time=2024-09-19T16:11:45.230921+0000, chain.objs.size()=1 2024-09-19T14:14:29.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.732+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.39__shadow_.tRSRn789WzKrUWR9jFw8XhPC-QaqLQ4_0 2024-09-19T14:14:29.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.736+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:14:29.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-19T14:14:29.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4178344867688157240', time=2024-09-19T16:04:23.241355+0000, chain.objs.size()=1 2024-09-19T14:14:29.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.4__shadow_.32O873Awlq-uHJCb-Df06YqN8YfFVi6_0 2024-09-19T14:14:29.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9795390011498088292', time=2024-09-19T16:04:23.326966+0000, chain.objs.size()=4 2024-09-19T14:14:29.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.11__multipart_foo.2~u1x7piUIbzltodLQxlcFMYVShpwBwb1.1 2024-09-19T14:14:29.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.11__multipart_foo.2~u1x7piUIbzltodLQxlcFMYVShpwBwb1.2 2024-09-19T14:14:29.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.11__multipart_foo.2~u1x7piUIbzltodLQxlcFMYVShpwBwb1.3 2024-09-19T14:14:29.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.11__multipart_foo.2~u1x7piUIbzltodLQxlcFMYVShpwBwb1.4 2024-09-19T14:14:29.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9103820038083936033', time=2024-09-19T16:04:24.353777+0000, chain.objs.size()=1 2024-09-19T14:14:29.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.8__shadow_.FhFLdtFO4UqXKVq7Q47JUg7do4rtGtc_0 2024-09-19T14:14:29.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10837133678707843827', time=2024-09-19T16:06:11.379588+0000, chain.objs.size()=1 2024-09-19T14:14:29.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.20__shadow_.lpxIvRA4aj6WuaZAAQW93W9H_dkDrGJ_0 2024-09-19T14:14:29.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11028070830236379635', time=2024-09-19T16:06:55.317041+0000, chain.objs.size()=1 2024-09-19T14:14:29.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.23__shadow_.8ZhF1alpz2IinfwEKuygEF_Z2NRnFhx_0 2024-09-19T14:14:29.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1016390498052638042', time=2024-09-19T16:07:29.985857+0000, chain.objs.size()=1 2024-09-19T14:14:29.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.24__shadow_.clFEh4dwnOLCOaL6JNUR1prlisyV3Qt_0 2024-09-19T14:14:29.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16569926459810993920', time=2024-09-19T16:08:53.292419+0000, chain.objs.size()=1 2024-09-19T14:14:29.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.29__shadow_.zj8lo9eNWzmycyzHI3forwEG3xmnUlf_0 2024-09-19T14:14:29.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11679849799966948012', time=2024-09-19T16:08:58.125542+0000, chain.objs.size()=1 2024-09-19T14:14:29.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.30__shadow_.SEdSo53rPe9WA-yj4O-74mmnXSfvEvO_0 2024-09-19T14:14:29.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5137472794443166073', time=2024-09-19T16:09:02.256681+0000, chain.objs.size()=1 2024-09-19T14:14:29.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.740+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.31__shadow_.0zO6GidOzhX118gQoelULdBluIMrcr0_0 2024-09-19T14:14:29.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.744+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16550702506057143901', time=2024-09-19T16:09:44.244376+0000, chain.objs.size()=1 2024-09-19T14:14:29.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.744+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.33__shadow_.Cjh97a_S-8RsXQ9veTfHmzzZKiQ2Gmh_0 2024-09-19T14:14:29.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.744+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9402563505522571661', time=2024-09-19T16:10:19.407309+0000, chain.objs.size()=1 2024-09-19T14:14:29.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.744+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.34__shadow_.aa3_CMDakgiPBpR5Ou3Sd97JIrxvVeJ_0 2024-09-19T14:14:29.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.744+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9623504504729538336', time=2024-09-19T16:10:19.512733+0000, chain.objs.size()=1 2024-09-19T14:14:29.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.744+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.34__shadow_.3wo2_sZkIf5syWcc9eyVuTR765xjQqX_0 2024-09-19T14:14:29.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.744+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14662347102373813284', time=2024-09-19T16:10:23.980908+0000, chain.objs.size()=1 2024-09-19T14:14:29.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.744+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.35__shadow_.CgKgsr72m_XLiuSJ2ElDX0UPbDAt3_h_0 2024-09-19T14:14:29.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.744+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4177378254111706539', time=2024-09-19T16:10:24.063953+0000, chain.objs.size()=1 2024-09-19T14:14:29.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.744+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.35__shadow_.RH5UBiPP_kgmVXVJQPi0-XufUPcnspo_0 2024-09-19T14:14:29.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.744+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12442706070250292101', time=2024-09-19T16:10:24.223860+0000, chain.objs.size()=1 2024-09-19T14:14:29.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.744+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.35__shadow_.mReLGRHxVUpy9ZJ_yS9OMOSV1U86rnW_0 2024-09-19T14:14:29.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.744+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15905021909328353818', time=2024-09-19T16:11:05.275877+0000, chain.objs.size()=1 2024-09-19T14:14:29.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.744+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.37__shadow_.A4DHto0VcG6Sy_IEXh2YDZM1IFOtyaS_0 2024-09-19T14:14:29.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.744+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7161384371009429564', time=2024-09-19T16:11:09.052684+0000, chain.objs.size()=1 2024-09-19T14:14:29.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.744+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.38__shadow_.SKl3tpjXw8y7AwOGj6Lv_FHEUktXxm3_0 2024-09-19T14:14:29.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.744+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11537750631293430012', time=2024-09-19T16:11:09.145664+0000, chain.objs.size()=1 2024-09-19T14:14:29.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.744+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.38__shadow_.MkjM4n6gqVFgN0Js8C0SBmcSUtXgG5Q_0 2024-09-19T14:14:29.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.744+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3695081312937540170', time=2024-09-19T16:11:09.188907+0000, chain.objs.size()=1 2024-09-19T14:14:29.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.744+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.38__shadow_._wWJF2-t1N05vjNlicEY6dH_8n5ye9n_0 2024-09-19T14:14:29.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.744+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11876778872899806904', time=2024-09-19T16:11:09.190550+0000, chain.objs.size()=1 2024-09-19T14:14:29.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.744+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.38__shadow_.HXnrim85Zhinz-3MEAMVN9HucbbK0QP_0 2024-09-19T14:14:29.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.748+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16115584412510428493', time=2024-09-19T16:11:09.192355+0000, chain.objs.size()=1 2024-09-19T14:14:29.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.748+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.38__shadow_.EFKfYnI8A1sE6H8kAACIy-WZARnEJ1J_0 2024-09-19T14:14:29.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.748+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4058902200312762507', time=2024-09-19T16:11:09.246067+0000, chain.objs.size()=1 2024-09-19T14:14:29.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.748+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.38__shadow_.tQ4DaSJhVm_Wh9tUf1pbm_qvpMPTmxm_0 2024-09-19T14:14:29.755 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.752+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10579905507491620207', time=2024-09-19T16:11:45.065402+0000, chain.objs.size()=1 2024-09-19T14:14:29.755 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.752+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.39__shadow_.yCtuhS6DM1dgHVs0SYNcG0YmVjmmWyx_0 2024-09-19T14:14:29.755 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.752+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7397261315325435524', time=2024-09-19T16:11:45.260963+0000, chain.objs.size()=1 2024-09-19T14:14:29.755 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.752+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.39__shadow_.P5VMUU1RmQA-Zj4PinWAz-of1zMH6CD_0 2024-09-19T14:14:29.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.752+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.760 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.756+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:14:29.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.756+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-19T14:14:29.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4845246784719762108', time=2024-09-19T16:06:55.476416+0000, chain.objs.size()=1 2024-09-19T14:14:29.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.23__shadow_.1qOv65yibEUPXNTG-Fwa64DIfxwH9FH_0 2024-09-19T14:14:29.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7238038862808840188', time=2024-09-19T16:07:39.212022+0000, chain.objs.size()=1 2024-09-19T14:14:29.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.26__shadow_.eQDQfC1AkkAMhJz-A8MXwL4bXWGFY89_0 2024-09-19T14:14:29.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6967075063944359774', time=2024-09-19T16:08:13.754337+0000, chain.objs.size()=1 2024-09-19T14:14:29.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.27__shadow_.Jd0ferPjXYOOlrlzKhvTErG-9WILNop_0 2024-09-19T14:14:29.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10451284981529666656', time=2024-09-19T16:08:13.879083+0000, chain.objs.size()=1 2024-09-19T14:14:29.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.27__shadow_.s7jXrLR711RB-J2j0sPL0YhyswWrvgs_0 2024-09-19T14:14:29.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18367147899282181114', time=2024-09-19T16:08:18.373274+0000, chain.objs.size()=1 2024-09-19T14:14:29.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.28__shadow_.IYSIvEybOz1bXlVxb-w_yNp5BIULcCz_0 2024-09-19T14:14:29.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4706006761642028667', time=2024-09-19T16:08:58.110341+0000, chain.objs.size()=1 2024-09-19T14:14:29.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.30__shadow_.wGtJ74Ku1ppgH-QaZgVLSHLClH4BEgS_0 2024-09-19T14:14:29.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.934332871490638315', time=2024-09-19T16:09:02.371746+0000, chain.objs.size()=1 2024-09-19T14:14:29.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.31__shadow_.UfzPWciVr9HTFW6knwrqqytPukojias_0 2024-09-19T14:14:29.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6380802019948301980', time=2024-09-19T16:09:02.471909+0000, chain.objs.size()=1 2024-09-19T14:14:29.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.31__shadow_.og5D59pR0LxjefzxZt5Y5DSVaO2QNjd_0 2024-09-19T14:14:29.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2265938292159923459', time=2024-09-19T16:09:44.301783+0000, chain.objs.size()=1 2024-09-19T14:14:29.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.33__shadow_.VKydCMAGTB2n_d6RFPL4kPL78uNloRy_0 2024-09-19T14:14:29.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3924070609115242228', time=2024-09-19T16:10:19.393658+0000, chain.objs.size()=1 2024-09-19T14:14:29.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.34__shadow_.Kd5k-Ze-isup0y_ZMw6GNOE55OBnJqT_0 2024-09-19T14:14:29.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11417672664563972965', time=2024-09-19T16:10:19.645990+0000, chain.objs.size()=1 2024-09-19T14:14:29.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.34__shadow_.WYP0IYcpDpqoXQxNcwxXoEmHHY2pxl3_0 2024-09-19T14:14:29.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14411211402828123114', time=2024-09-19T16:11:08.926260+0000, chain.objs.size()=1 2024-09-19T14:14:29.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.760+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.38__shadow_.XXlqUgxFCmgjFa5BjKs_5ejXNxrPAKX_0 2024-09-19T14:14:29.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.764+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10011267277651593861', time=2024-09-19T16:11:08.970347+0000, chain.objs.size()=1 2024-09-19T14:14:29.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.764+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.38__shadow_.Zx8VAz2wBVkb_8MBmWFHPPhyDBtDGsa_0 2024-09-19T14:14:29.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.764+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:14:29.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-19T14:14:29.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='_zSMA_wKPHNnahRuC98JWrDsiNbGNmAF', time=2024-09-19T16:04:23.874353+0000, chain.objs.size()=1 2024-09-19T14:14:29.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__shadow_.hFiCNPVeqi4YHzYJQ6ZUdjlRuvYfzbU_0 2024-09-19T14:14:29.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8181728488263774033', time=2024-09-19T16:06:06.928245+0000, chain.objs.size()=1 2024-09-19T14:14:29.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.19__shadow_.ivo_VAS2J93slxhO7vEMS54EtH8UAC4_0 2024-09-19T14:14:29.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16029852968875727809', time=2024-09-19T16:06:11.304025+0000, chain.objs.size()=1 2024-09-19T14:14:29.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.20__shadow_.YW9-4WHGXuG3l3kLqptudzvlDwJx_dH_0 2024-09-19T14:14:29.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8071977675118395468', time=2024-09-19T16:06:11.419150+0000, chain.objs.size()=1 2024-09-19T14:14:29.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.20__shadow_.UdFLctUezv71seu66CvlVNdWA5CKHS__0 2024-09-19T14:14:29.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13910343670162953900', time=2024-09-19T16:07:29.868135+0000, chain.objs.size()=1 2024-09-19T14:14:29.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.24__shadow_.QeBE_E6xDfg31CTDzG_RSfhSNw4ePVt_0 2024-09-19T14:14:29.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15461954458451790449', time=2024-09-19T16:07:29.869937+0000, chain.objs.size()=1 2024-09-19T14:14:29.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.24__shadow_.uzr5K4qJllT8EDwp4goJ0zCUHMJ-nFn_0 2024-09-19T14:14:29.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5221332498157902039', time=2024-09-19T16:07:29.964511+0000, chain.objs.size()=1 2024-09-19T14:14:29.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.24__shadow_.Y66neb_W2RFNMdUedwXZsznOVyNTcgL_0 2024-09-19T14:14:29.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1245760309835623976', time=2024-09-19T16:07:39.208443+0000, chain.objs.size()=1 2024-09-19T14:14:29.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.26__shadow_.dKJ_ypMMzmVHZV7VHYD44iPVufHPaoY_0 2024-09-19T14:14:29.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2304018360757463262', time=2024-09-19T16:08:13.754337+0000, chain.objs.size()=1 2024-09-19T14:14:29.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.27__shadow_.hFBR440k97HWkEuvTaoVWzWblhpx8k0_0 2024-09-19T14:14:29.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2571636220770956724', time=2024-09-19T16:08:13.846979+0000, chain.objs.size()=1 2024-09-19T14:14:29.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.27__shadow_.dEx1LMFKLD__38WTk0-X8VmhiUa-TAA_0 2024-09-19T14:14:29.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17295756111401566415', time=2024-09-19T16:08:18.286936+0000, chain.objs.size()=1 2024-09-19T14:14:29.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.28__shadow_.aDNq81RIF9tVCp6IKsWSwgJ-rgrWL8q_0 2024-09-19T14:14:29.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1453428650279493862', time=2024-09-19T16:08:18.421940+0000, chain.objs.size()=1 2024-09-19T14:14:29.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.768+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.28__shadow_.T_it6WgMo_TfVvt0otVfaVUDO90mXCX_0 2024-09-19T14:14:29.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.772+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9649284663549259884', time=2024-09-19T16:08:53.214414+0000, chain.objs.size()=1 2024-09-19T14:14:29.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.772+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.29__shadow_.JnJD0wKicV2QChiww8afj4sm6tNrXnj_0 2024-09-19T14:14:29.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.772+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14739372239866425796', time=2024-09-19T16:08:53.300492+0000, chain.objs.size()=1 2024-09-19T14:14:29.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.772+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.29__shadow_.P3OvCThgHAyG0Mudl0jQ4Tw6pEFtMVJ_0 2024-09-19T14:14:29.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.772+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5274009902583053899', time=2024-09-19T16:08:58.112136+0000, chain.objs.size()=1 2024-09-19T14:14:29.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.772+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.30__shadow_.oHMYP78Vm0B8GnI43fHL4ziVEt5Ti-b_0 2024-09-19T14:14:29.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.772+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8426608136734408031', time=2024-09-19T16:11:05.204898+0000, chain.objs.size()=1 2024-09-19T14:14:29.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.772+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.37__shadow_.tO6A2cs5WfeiI0rLiGJGCZ62pv34Npt_0 2024-09-19T14:14:29.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.776+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16413860311117883371', time=2024-09-19T16:11:09.242411+0000, chain.objs.size()=1 2024-09-19T14:14:29.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.776+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.38__shadow_.SQAgzJ_5_ugjhaMoZu3UXk9xXOHBXe1_0 2024-09-19T14:14:29.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.776+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1894766276656078983', time=2024-09-19T16:11:45.122374+0000, chain.objs.size()=1 2024-09-19T14:14:29.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.776+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.39__shadow_.Y30JNlqqgd-U6Q4Wk8xTByQZeIQZ6Fl_0 2024-09-19T14:14:29.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.776+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18201559905379933401', time=2024-09-19T16:13:53.344025+0000, chain.objs.size()=1 2024-09-19T14:14:29.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.776+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.17__shadow_.hReUTfGkq0HFT_HLkxwCeddYpQTCxlU_0 2024-09-19T14:14:29.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.776+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6555982159634533071', time=2024-09-19T16:13:53.396234+0000, chain.objs.size()=1 2024-09-19T14:14:29.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.776+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.17__shadow_.0y3F29JaseGU56tV9cu8y5r8oNMDg7c_0 2024-09-19T14:14:29.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.780+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.784+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:14:29.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.784+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.784+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.788+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-19T14:14:29.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.788+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='_FEOgOSUtqc6U6EsHypUZOU2lTrSzK00', time=2024-09-19T16:04:23.768310+0000, chain.objs.size()=2 2024-09-19T14:14:29.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.788+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__shadow_.vq_4kcHnDyOXnLdCsQkJYlBhyCP7A64_0 2024-09-19T14:14:29.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.788+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__shadow_.vq_4kcHnDyOXnLdCsQkJYlBhyCP7A64_1 2024-09-19T14:14:29.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.788+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2099809046538452114', time=2024-09-19T16:04:24.054439+0000, chain.objs.size()=2 2024-09-19T14:14:29.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.788+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.13__shadow_.FHOOy68yFN6XB2dISjQQc77sqEP47zB_0 2024-09-19T14:14:29.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.788+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.13__shadow_.FHOOy68yFN6XB2dISjQQc77sqEP47zB_1 2024-09-19T14:14:29.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.788+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14359439494116546381', time=2024-09-19T16:06:46.497160+0000, chain.objs.size()=1 2024-09-19T14:14:29.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.788+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.21__shadow_.3Dm5_eS_mV9FxVcqmdMgV0fWPmmk0VB_0 2024-09-19T14:14:29.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.788+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15214290113931076496', time=2024-09-19T16:06:51.313872+0000, chain.objs.size()=1 2024-09-19T14:14:29.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.788+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.22__shadow_.qPaFC0ElpoEmspE7OsJ9skuOL2gSjUB_0 2024-09-19T14:14:29.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.788+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4393512391384397250', time=2024-09-19T16:06:55.387822+0000, chain.objs.size()=1 2024-09-19T14:14:29.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.788+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.23__shadow_.FoucSx2zLH_fNJBBxnPIWjjWUf8iuWE_0 2024-09-19T14:14:29.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.788+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17389448773011100173', time=2024-09-19T16:07:29.869065+0000, chain.objs.size()=1 2024-09-19T14:14:29.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.788+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.24__shadow_.pCmYQ9eKID5QuJ9er8Cw3EjnFFAGh8D_0 2024-09-19T14:14:29.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.788+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12986326110938879418', time=2024-09-19T16:07:39.191640+0000, chain.objs.size()=1 2024-09-19T14:14:29.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.788+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.26__shadow_.R08TH8owZ_sa-6gmniZxt-7tYehpx4t_0 2024-09-19T14:14:29.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.788+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8342089320033086434', time=2024-09-19T16:07:39.256943+0000, chain.objs.size()=1 2024-09-19T14:14:29.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.788+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.26__shadow_.eE_2924a52Wh5vfcjIdmgK3IzSnPBzD_0 2024-09-19T14:14:29.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.788+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10579146610896502737', time=2024-09-19T16:08:56.815965+0000, chain.objs.size()=1 2024-09-19T14:14:29.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.788+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.30__shadow_.lxP_o0h0vENh8bmIRyDhVzSLizkrnpF_0 2024-09-19T14:14:29.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.788+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7704656018404508979', time=2024-09-19T16:09:38.174977+0000, chain.objs.size()=1 2024-09-19T14:14:29.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.788+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.32__shadow_.9W1prI7AypbVfuVGAPp9X5-EstmsD9R_0 2024-09-19T14:14:29.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.792+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8424797858277424979', time=2024-09-19T16:10:59.969574+0000, chain.objs.size()=1 2024-09-19T14:14:29.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.792+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.36__shadow_.ThHyk6TlUjNPU40FG3v45awq9sYFd3w_0 2024-09-19T14:14:29.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.792+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13296552662735479349', time=2024-09-19T16:11:00.032418+0000, chain.objs.size()=1 2024-09-19T14:14:29.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.792+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.36__shadow_.7epg9s2DzkdfZuyhGJ4zRRbzxyWIrB-_0 2024-09-19T14:14:29.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.792+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17838477354430508318', time=2024-09-19T16:11:12.978339+0000, chain.objs.size()=1 2024-09-19T14:14:29.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.792+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.39__shadow_.KKYfGXQc-GLDpiY1CrbGNzOk8BZo0QL_0 2024-09-19T14:14:29.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.792+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13032304548763028409', time=2024-09-19T16:11:45.260827+0000, chain.objs.size()=1 2024-09-19T14:14:29.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.792+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.39__shadow_.k3xwcaQKjLC_UPMNSqY-1S6vMYS6rR8_0 2024-09-19T14:14:29.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.792+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1396175978958952982', time=2024-09-19T16:13:53.344178+0000, chain.objs.size()=1 2024-09-19T14:14:29.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.792+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.17__shadow_.FCsjDzvs3y6AIXaJiQ6EL-Hk4-qCpol_0 2024-09-19T14:14:29.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.796+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.796+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:14:29.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-19T14:14:29.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16507384580774396040', time=2024-09-19T16:04:24.274078+0000, chain.objs.size()=1 2024-09-19T14:14:29.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.7__shadow_.T7lgQTNhW-7BRTL0keb9SnIR3V9Kf4p_0 2024-09-19T14:14:29.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7169725913462023003', time=2024-09-19T16:06:11.419100+0000, chain.objs.size()=1 2024-09-19T14:14:29.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.20__shadow_.Ia4MO0_BYzoDBJ9gNG9d_qRzDp5cv2__0 2024-09-19T14:14:29.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7625945917696347777', time=2024-09-19T16:06:11.575259+0000, chain.objs.size()=1 2024-09-19T14:14:29.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.20__shadow_.ZgRIag0B5arSf0PTWRjmrJOyR9l7xMQ_0 2024-09-19T14:14:29.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.332757046358126164', time=2024-09-19T16:06:51.195448+0000, chain.objs.size()=1 2024-09-19T14:14:29.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.22__shadow_.aVTs1n2tMoZNJqeRLT60sjQI2G2IqnX_0 2024-09-19T14:14:29.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8066847676643456141', time=2024-09-19T16:08:13.778442+0000, chain.objs.size()=1 2024-09-19T14:14:29.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.27__shadow_.RLyl75JFpXShXzKmMRN90V2UOXgO3B1_0 2024-09-19T14:14:29.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12423858601243392483', time=2024-09-19T16:08:13.868678+0000, chain.objs.size()=1 2024-09-19T14:14:29.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.27__shadow_.JOITRzIaDbco5fLGqOAd_YxeGGBaTbd_0 2024-09-19T14:14:29.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.282151316292613775', time=2024-09-19T16:08:53.206465+0000, chain.objs.size()=1 2024-09-19T14:14:29.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.29__shadow_.4Avrb4Sk8gAoQ7SW7rvJLIKYUWUkGzL_0 2024-09-19T14:14:29.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12455756351046463028', time=2024-09-19T16:09:44.191893+0000, chain.objs.size()=1 2024-09-19T14:14:29.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.33__shadow_.UGxlzGqxM6BdNWgVvzHCebv67U9HJ-R_0 2024-09-19T14:14:29.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18173234700823201239', time=2024-09-19T16:10:24.174471+0000, chain.objs.size()=1 2024-09-19T14:14:29.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.35__shadow_.y2Vy3v8M2Sz4g8RTEAY6unJkjD89CFl_0 2024-09-19T14:14:29.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2807283111953417800', time=2024-09-19T16:10:59.949702+0000, chain.objs.size()=1 2024-09-19T14:14:29.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.36__shadow_.DlgeF4HFEyZBYjUiU61yUhMroZKab62_0 2024-09-19T14:14:29.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8871952303166379664', time=2024-09-19T16:10:59.951833+0000, chain.objs.size()=1 2024-09-19T14:14:29.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.36__shadow_.IwgEp-45YNd4cABaf-ZNQS0k_g8RzW5_0 2024-09-19T14:14:29.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15065300507516149341', time=2024-09-19T16:11:00.066951+0000, chain.objs.size()=1 2024-09-19T14:14:29.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.36__shadow_.8X6iW5R5Hd1HJkv6Kd2b8FsTinjmdSA_0 2024-09-19T14:14:29.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11687943555227255693', time=2024-09-19T16:11:45.161372+0000, chain.objs.size()=1 2024-09-19T14:14:29.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.800+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.39__shadow_.U6SuKx4L2R4c_a34tKMJYj7M211mFb8_0 2024-09-19T14:14:29.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.804+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:14:29.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-19T14:14:29.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3832944856944814271', time=2024-09-19T16:04:23.598175+0000, chain.objs.size()=1 2024-09-19T14:14:29.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.15__shadow_.II241UZMDUfUVydqDso3Pr7AkHHtThe_0 2024-09-19T14:14:29.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1190598363351224324', time=2024-09-19T16:04:23.653353+0000, chain.objs.size()=1 2024-09-19T14:14:29.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.15__shadow_.O6aUo8iWv9ZHXZ9eQ78caatLsx9I3oP_0 2024-09-19T14:14:29.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15292356329578381096', time=2024-09-19T16:06:46.560830+0000, chain.objs.size()=1 2024-09-19T14:14:29.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.21__shadow_.8KpkJwOzRpK5I3TYniOg04PltAVhUGy_0 2024-09-19T14:14:29.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15617715853208081703', time=2024-09-19T16:06:51.123570+0000, chain.objs.size()=1 2024-09-19T14:14:29.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.22__shadow_.s0jNjMz9QSiHU-B3sQZzyUsQLNpdd3u_0 2024-09-19T14:14:29.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15132158007758365823', time=2024-09-19T16:06:55.313317+0000, chain.objs.size()=1 2024-09-19T14:14:29.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.23__shadow_.htf72hIS9zUhjttIvTaMXjzMc9ZGooo_0 2024-09-19T14:14:29.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8990932547121695842', time=2024-09-19T16:07:34.901527+0000, chain.objs.size()=1 2024-09-19T14:14:29.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.25__shadow_.V1wcbAc-W1ZgQnk-P21fufDLJWJrXxD_0 2024-09-19T14:14:29.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12216282742906531042', time=2024-09-19T16:07:39.211905+0000, chain.objs.size()=1 2024-09-19T14:14:29.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.26__shadow_.V-z9aHioqNeWXbkXwDec9_WbeVT3tGV_0 2024-09-19T14:14:29.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13989083786484946683', time=2024-09-19T16:08:53.316147+0000, chain.objs.size()=1 2024-09-19T14:14:29.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.29__shadow_.QraoKXC0K_4Z2vSOaqxE1YOep7PZtPJ_0 2024-09-19T14:14:29.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4565450838334131368', time=2024-09-19T16:08:58.178092+0000, chain.objs.size()=1 2024-09-19T14:14:29.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.30__shadow_.xWTIwpCmdL1ihhcfeKJXGoCKLAjDwsm_0 2024-09-19T14:14:29.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13753852675012691389', time=2024-09-19T16:08:58.234000+0000, chain.objs.size()=1 2024-09-19T14:14:29.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.30__shadow_.Z8_1zJJ2oF7qxulgu9sQCtBO_LXrsQF_0 2024-09-19T14:14:29.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17873171633011138042', time=2024-09-19T16:09:02.301811+0000, chain.objs.size()=1 2024-09-19T14:14:29.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.31__shadow_.q8BwO2P-vTZQBivpZ9IHJz306n2TJLv_0 2024-09-19T14:14:29.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3569797717062173236', time=2024-09-19T16:09:48.436104+0000, chain.objs.size()=1 2024-09-19T14:14:29.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.808+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.34__shadow_.SySiO-oMP5-SQwV4lwDuVtQhMEFEoXI_0 2024-09-19T14:14:29.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.812+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8068689325787039811', time=2024-09-19T16:10:24.245375+0000, chain.objs.size()=1 2024-09-19T14:14:29.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.812+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.35__shadow_.vrBUqMhIe2Z7eHqo2KN0PQppEj_7-Uj_0 2024-09-19T14:14:29.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.812+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13694606277156453579', time=2024-09-19T16:11:00.032471+0000, chain.objs.size()=1 2024-09-19T14:14:29.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.812+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.36__shadow_.cAMctlVPiKBoirBoglk4x_2FjApsvRu_0 2024-09-19T14:14:29.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.812+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11079819200195491035', time=2024-09-19T16:11:05.183741+0000, chain.objs.size()=1 2024-09-19T14:14:29.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.812+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.37__shadow_.fJlm5VlQzFgNCP7jBGe9XfOS4_iChTV_0 2024-09-19T14:14:29.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.816+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:14:29.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-19T14:14:29.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15913883814763264558', time=2024-09-19T16:04:23.250375+0000, chain.objs.size()=1 2024-09-19T14:14:29.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.4__shadow_.BNgTuocLWablOeVrDysMgA7OfcavrLv_0 2024-09-19T14:14:29.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1352903799730838121', time=2024-09-19T16:04:23.451391+0000, chain.objs.size()=4 2024-09-19T14:14:29.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.10__multipart_foo.2~KjLH4T3u1TLtO0Ki4dLyZVrkJ3Akqhb.1 2024-09-19T14:14:29.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.10__multipart_foo.2~KjLH4T3u1TLtO0Ki4dLyZVrkJ3Akqhb.2 2024-09-19T14:14:29.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.10__multipart_foo.2~KjLH4T3u1TLtO0Ki4dLyZVrkJ3Akqhb.3 2024-09-19T14:14:29.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.10__multipart_foo.2~KjLH4T3u1TLtO0Ki4dLyZVrkJ3Akqhb.4 2024-09-19T14:14:29.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8244892573344155480', time=2024-09-19T16:04:24.285037+0000, chain.objs.size()=1 2024-09-19T14:14:29.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.7__shadow_.EU56b7y7mPUlTXXOkvrNomlRw07yElg_0 2024-09-19T14:14:29.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7826179310921431287', time=2024-09-19T16:06:06.895199+0000, chain.objs.size()=1 2024-09-19T14:14:29.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.19__shadow_.wWQYy9BgM9YLv4sxE6VqNv0rgtFYnlw_0 2024-09-19T14:14:29.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12439297735773626428', time=2024-09-19T16:06:11.587191+0000, chain.objs.size()=1 2024-09-19T14:14:29.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.20__shadow_.OeUHYrHtklDsDOfjNtPsJUvH1IDZm0S_0 2024-09-19T14:14:29.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10039564747239975528', time=2024-09-19T16:06:46.613720+0000, chain.objs.size()=1 2024-09-19T14:14:29.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.21__shadow_.WuNy3eluBj33qqRTkDXI585JZKDzGZf_0 2024-09-19T14:14:29.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16237006117518404830', time=2024-09-19T16:07:34.739817+0000, chain.objs.size()=1 2024-09-19T14:14:29.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.25__shadow_.HQzdrfSaQr-hvGz0usYOsxH8XwBBB6o_0 2024-09-19T14:14:29.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17376471436362833103', time=2024-09-19T16:08:58.098289+0000, chain.objs.size()=1 2024-09-19T14:14:29.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.30__shadow_.mfBhzPekgyDAmPgwA2zSSqdtz6xz10F_0 2024-09-19T14:14:29.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5350733387129534860', time=2024-09-19T16:09:02.198549+0000, chain.objs.size()=1 2024-09-19T14:14:29.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.820+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.31__shadow_.cBzmSf_K5deCbOUgI7hlfgJumNx9rpD_0 2024-09-19T14:14:29.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.824+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6885356068138808611', time=2024-09-19T16:09:38.298522+0000, chain.objs.size()=1 2024-09-19T14:14:29.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.824+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.32__shadow_.RM2Saz-5BYjslD2pl-oCwl2WP2-uDdT_0 2024-09-19T14:14:29.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.824+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3510638013799239842', time=2024-09-19T16:09:44.148340+0000, chain.objs.size()=1 2024-09-19T14:14:29.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.824+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.33__shadow_.PHjHIuvX-YA73-gj3GAL0m4P_d9ClOk_0 2024-09-19T14:14:29.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.824+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14478241081066676130', time=2024-09-19T16:11:09.174529+0000, chain.objs.size()=1 2024-09-19T14:14:29.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.824+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.38__shadow_.c242xedHw65qcG33mfGZINg8Q7OTmG-_0 2024-09-19T14:14:29.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.824+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15755729135979458941', time=2024-09-19T16:11:45.135928+0000, chain.objs.size()=1 2024-09-19T14:14:29.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.824+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.39__shadow_.DClFN6_p1FHtOfB9vUc5OLX48OGGGI3_0 2024-09-19T14:14:29.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.824+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14479528428130800093', time=2024-09-19T16:13:53.343800+0000, chain.objs.size()=1 2024-09-19T14:14:29.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.824+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.17__shadow_.ehRZVE0q2rhGFkrESGLxKdkMdq0E7cc_0 2024-09-19T14:14:29.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.824+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14763697928841753209', time=2024-09-19T16:13:53.346146+0000, chain.objs.size()=1 2024-09-19T14:14:29.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.824+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.17__shadow_.3tl1zC1MsVfD9QOvJLxmlXI6Xl_z014_0 2024-09-19T14:14:29.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.828+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:14:29.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-19T14:14:29.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12873270689736215533', time=2024-09-19T16:04:24.193515+0000, chain.objs.size()=1 2024-09-19T14:14:29.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.7__shadow_.ZbgAF5BvFJYKS6iAQjDdW-Bvkr0yNiQ_0 2024-09-19T14:14:29.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1694657573749814818', time=2024-09-19T16:06:06.927807+0000, chain.objs.size()=1 2024-09-19T14:14:29.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.19__shadow_.Euv1hO-GF8ffOJchuvJvzfvXHmKqLRE_0 2024-09-19T14:14:29.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4358540621385215872', time=2024-09-19T16:06:06.969630+0000, chain.objs.size()=1 2024-09-19T14:14:29.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.19__shadow_.t62wqo63ZPprJ14rvp88Y4AWLSs3hHL_0 2024-09-19T14:14:29.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12160323191131331789', time=2024-09-19T16:06:51.127624+0000, chain.objs.size()=1 2024-09-19T14:14:29.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.22__shadow_.NbCclgjJdQQQHd10_NKxP36rbUIL-Xg_0 2024-09-19T14:14:29.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17800693299442910488', time=2024-09-19T16:06:51.306532+0000, chain.objs.size()=1 2024-09-19T14:14:29.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.22__shadow_.Na2q_vcjwPFxzlMYDWI9-Isnez4q-za_0 2024-09-19T14:14:29.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15931289439080916422', time=2024-09-19T16:06:55.432902+0000, chain.objs.size()=1 2024-09-19T14:14:29.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.23__shadow_.ofVCmkUI6aaFvfGCfQokFuXugm7N64O_0 2024-09-19T14:14:29.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2869982540213266378', time=2024-09-19T16:09:02.356219+0000, chain.objs.size()=1 2024-09-19T14:14:29.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.31__shadow_.kwAamI4NYFdSsniB7N-aoINRtv0caX7_0 2024-09-19T14:14:29.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15366679653800897188', time=2024-09-19T16:09:38.069311+0000, chain.objs.size()=1 2024-09-19T14:14:29.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.32__shadow_.0kvZvRoT3bSFyRTfQyC_OaKDNpFRx9c_0 2024-09-19T14:14:29.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2352332132309368799', time=2024-09-19T16:09:44.244459+0000, chain.objs.size()=1 2024-09-19T14:14:29.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.33__shadow_.bO3nJk0rAv8zec-0IQnRH0SK57malrO_0 2024-09-19T14:14:29.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7214467219225123724', time=2024-09-19T16:10:23.968912+0000, chain.objs.size()=1 2024-09-19T14:14:29.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.35__shadow_.0rTshLWigrfGYsVqbUbaf80EplOA923_0 2024-09-19T14:14:29.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13070486280032030038', time=2024-09-19T16:10:24.062945+0000, chain.objs.size()=1 2024-09-19T14:14:29.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.832+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.35__shadow_.IQ-1DKAMgnLCTfXtc4N3Jsgny8VUyVy_0 2024-09-19T14:14:29.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.836+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.840+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:14:29.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.840+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.840+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-19T14:14:29.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16035617935989659688', time=2024-09-19T16:04:23.519399+0000, chain.objs.size()=4 2024-09-19T14:14:29.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.9__multipart_foo.2~4HLHgNSjQr0ts2lY2GB8ozQb6QuyqEb.1 2024-09-19T14:14:29.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.9__multipart_foo.2~4HLHgNSjQr0ts2lY2GB8ozQb6QuyqEb.2 2024-09-19T14:14:29.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.9__multipart_foo.2~4HLHgNSjQr0ts2lY2GB8ozQb6QuyqEb.3 2024-09-19T14:14:29.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.9__multipart_foo.2~4HLHgNSjQr0ts2lY2GB8ozQb6QuyqEb.4 2024-09-19T14:14:29.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4375565395087513192', time=2024-09-19T16:06:55.348270+0000, chain.objs.size()=1 2024-09-19T14:14:29.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.23__shadow_.C6ur8S90goUoxYc_ag6ViPRl1UYKGV6_0 2024-09-19T14:14:29.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15990857261919973360', time=2024-09-19T16:07:29.984881+0000, chain.objs.size()=1 2024-09-19T14:14:29.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.24__shadow_.Hv9l16QYqdEFm0m9ugSNO2mDOOTJbYY_0 2024-09-19T14:14:29.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14022717841944362630', time=2024-09-19T16:07:39.390218+0000, chain.objs.size()=1 2024-09-19T14:14:29.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.26__shadow_.eM0uVc0rjgFb96EbKueMVcNn88s9RtY_0 2024-09-19T14:14:29.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.984504312539506902', time=2024-09-19T16:07:42.727148+0000, chain.objs.size()=1 2024-09-19T14:14:29.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.27__shadow_.31dhEVbgSMLziDPHRcZd4esk558qaES_0 2024-09-19T14:14:29.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14760735649536696519', time=2024-09-19T16:08:13.799067+0000, chain.objs.size()=1 2024-09-19T14:14:29.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.27__shadow_.mXVLNCvgQmC1N01lKdW-cX6fWsj8McQ_0 2024-09-19T14:14:29.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17255217418927729271', time=2024-09-19T16:08:18.504162+0000, chain.objs.size()=1 2024-09-19T14:14:29.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.28__shadow_.ne-_5_TfCAD5ljdmhHsjw2ShnzBcxGX_0 2024-09-19T14:14:29.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2292628626096690415', time=2024-09-19T16:09:02.263961+0000, chain.objs.size()=1 2024-09-19T14:14:29.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.31__shadow_.RqI-8k0tXM3U1zYR9yP2RswbyXbJJgK_0 2024-09-19T14:14:29.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3970262626596944334', time=2024-09-19T16:09:02.320281+0000, chain.objs.size()=1 2024-09-19T14:14:29.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.31__shadow_.zDH29uP7_U8eI__Dt2qRX37TQz02oRS_0 2024-09-19T14:14:29.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13052383985092370026', time=2024-09-19T16:09:44.255442+0000, chain.objs.size()=1 2024-09-19T14:14:29.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.33__shadow_.AD9y9iw7lDwbQi5bMxVom6FCk71Usq__0 2024-09-19T14:14:29.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15797107174710400647', time=2024-09-19T16:13:53.349831+0000, chain.objs.size()=1 2024-09-19T14:14:29.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.844+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.17__shadow_.ofxKQphOJQL5ehHNbli4t9kaxbGKFDV_0 2024-09-19T14:14:29.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.848+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:14:29.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-19T14:14:29.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9056505395412840070', time=2024-09-19T16:04:23.838365+0000, chain.objs.size()=3 2024-09-19T14:14:29.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-LUKEWARM.2~TFTCNQOpN5N-SocSR7HizO4F2TDXQ8_.1 2024-09-19T14:14:29.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-LUKEWARM.2~TFTCNQOpN5N-SocSR7HizO4F2TDXQ8_.2 2024-09-19T14:14:29.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-LUKEWARM.2~TFTCNQOpN5N-SocSR7HizO4F2TDXQ8_.3 2024-09-19T14:14:29.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8283889162922612918', time=2024-09-19T16:06:11.304007+0000, chain.objs.size()=1 2024-09-19T14:14:29.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.20__shadow_.kUq7zGHf0TaYvGOq9X9__xJP8p1Vp1Z_0 2024-09-19T14:14:29.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10017374397422717224', time=2024-09-19T16:06:11.396874+0000, chain.objs.size()=1 2024-09-19T14:14:29.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.20__shadow_.L72KQoJQaFX2tn138KNtg7R0wcWjAP4_0 2024-09-19T14:14:29.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6521975096231400130', time=2024-09-19T16:06:49.980011+0000, chain.objs.size()=1 2024-09-19T14:14:29.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.22__shadow_.tcrBmA9STwna1QyEjcqQk2TpZR_1nDk_0 2024-09-19T14:14:29.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7913132551316411756', time=2024-09-19T16:06:51.317357+0000, chain.objs.size()=1 2024-09-19T14:14:29.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.22__shadow_.KOAzfKw2R4ah0Cnmm6OVrlCtY55bdEl_0 2024-09-19T14:14:29.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11615804984148232240', time=2024-09-19T16:07:34.901573+0000, chain.objs.size()=1 2024-09-19T14:14:29.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.25__shadow_.E_FX5cFnZR-k9kMLPcolMak9DrQmqxf_0 2024-09-19T14:14:29.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9072753169091201130', time=2024-09-19T16:07:39.194663+0000, chain.objs.size()=1 2024-09-19T14:14:29.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.26__shadow_.UmfFUi5dnfe2Fh75iK9T9ca96K_qllH_0 2024-09-19T14:14:29.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8027801673079575173', time=2024-09-19T16:09:38.176344+0000, chain.objs.size()=1 2024-09-19T14:14:29.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.32__shadow_.EyaePXq2MUg550p3thtIPdSAFWsKnZn_0 2024-09-19T14:14:29.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5958062417515981003', time=2024-09-19T16:09:44.215587+0000, chain.objs.size()=1 2024-09-19T14:14:29.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.33__shadow_.wjYAfUUAQ7fpRx386qQBPJ4PafZFKTF_0 2024-09-19T14:14:29.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7569578345130045818', time=2024-09-19T16:10:19.518894+0000, chain.objs.size()=1 2024-09-19T14:14:29.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.852+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.34__shadow_.-sFnXHaVwcMeQ7VPMh6Jvh-50ng0mCj_0 2024-09-19T14:14:29.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.856+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12584467095649964368', time=2024-09-19T16:11:09.239431+0000, chain.objs.size()=1 2024-09-19T14:14:29.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.856+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.38__shadow_.fqRWSYvfwjQq7YJr3r8Vm3gBTFTi-Rz_0 2024-09-19T14:14:29.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.856+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8322403700926834575', time=2024-09-19T16:11:45.122362+0000, chain.objs.size()=1 2024-09-19T14:14:29.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.856+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.39__shadow_.Bm_6PSxF1kGhZZXk2jFym7mGxurAgF6_0 2024-09-19T14:14:29.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.860+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.860+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:14:29.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-19T14:14:29.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8553580146858518014', time=2024-09-19T16:04:23.698108+0000, chain.objs.size()=1 2024-09-19T14:14:29.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.15__shadow_.II241UZMDUfUVydqDso3Pr7AkHHtThe_0 2024-09-19T14:14:29.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16829568395766518552', time=2024-09-19T16:06:46.357893+0000, chain.objs.size()=1 2024-09-19T14:14:29.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.21__shadow_.1IDwExn5-0nmdjj34g-fSJHCtj3-jeV_0 2024-09-19T14:14:29.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14334480560945106981', time=2024-09-19T16:06:55.410798+0000, chain.objs.size()=1 2024-09-19T14:14:29.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.23__shadow_.EKVcvdlT-nSv3hOR7bWGUbjwFoqfGPe_0 2024-09-19T14:14:29.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14944783529416569151', time=2024-09-19T16:07:34.947941+0000, chain.objs.size()=1 2024-09-19T14:14:29.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.25__shadow_.14Z38BqSBg56QoAvmVqtnk_1lOQCAEM_0 2024-09-19T14:14:29.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3284162955317049660', time=2024-09-19T16:08:13.878285+0000, chain.objs.size()=1 2024-09-19T14:14:29.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.27__shadow_.L94skDWRst8RQMfkMET5SOH6-P-onhq_0 2024-09-19T14:14:29.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1608146203048043629', time=2024-09-19T16:08:53.421904+0000, chain.objs.size()=1 2024-09-19T14:14:29.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.29__shadow_.smRmOIY42I5wv-v0xN9Y7tfvi_yUuMF_0 2024-09-19T14:14:29.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2308491236978770501', time=2024-09-19T16:09:44.256861+0000, chain.objs.size()=1 2024-09-19T14:14:29.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.33__shadow_.ks5gsJ0e-m8vXRPFi4G1ApCuDDcINE-_0 2024-09-19T14:14:29.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16798477036678600831', time=2024-09-19T16:09:44.298105+0000, chain.objs.size()=1 2024-09-19T14:14:29.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.33__shadow_._IqD-MhDtogdreJR-QllR8-kUAb6fJy_0 2024-09-19T14:14:29.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15600285058037620226', time=2024-09-19T16:10:24.006423+0000, chain.objs.size()=1 2024-09-19T14:14:29.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.35__shadow_.nYZ0HJDcoSDqqrNj57DrCX16YxcQsBp_0 2024-09-19T14:14:29.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15923852440999180625', time=2024-09-19T16:11:09.174481+0000, chain.objs.size()=1 2024-09-19T14:14:29.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.38__shadow_.dB8FXlGB2TTLx4fcjhGycyEhqYFKEZF_0 2024-09-19T14:14:29.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1694016763909590106', time=2024-09-19T16:11:45.018646+0000, chain.objs.size()=1 2024-09-19T14:14:29.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.39__shadow_.LYFZCw5-cCymOc0yE1lDhtFRTOkkdMV_0 2024-09-19T14:14:29.869 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18439994683798164396', time=2024-09-19T16:11:45.020966+0000, chain.objs.size()=1 2024-09-19T14:14:29.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.864+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.39__shadow_.fzLsePCHYRYSxLwQY02iVxuNCaHU4Ft_0 2024-09-19T14:14:29.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.868+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14369640555064009709', time=2024-09-19T16:11:45.135759+0000, chain.objs.size()=1 2024-09-19T14:14:29.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.868+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.39__shadow_.rPuuBOjvWXV1NCU7kRL1hgZmrzXES19_0 2024-09-19T14:14:29.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.868+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16872610025788483886', time=2024-09-19T16:13:53.344070+0000, chain.objs.size()=1 2024-09-19T14:14:29.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.868+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.17__shadow_.kmehRakkWLLRnL4rfkhF0I-ntEH7Ui-_0 2024-09-19T14:14:29.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.872+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.872+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:14:29.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.876+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.876+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.876+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-19T14:14:29.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.876+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='_haeBKhhDH9oevNwKbx-HPwYet0k6yas', time=2024-09-19T16:04:23.791304+0000, chain.objs.size()=2 2024-09-19T14:14:29.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.876+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__shadow_.zJFJTBE2lTIKUrmJmHJu2X9Yzdbt6ZY_0 2024-09-19T14:14:29.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.876+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__shadow_.zJFJTBE2lTIKUrmJmHJu2X9Yzdbt6ZY_1 2024-09-19T14:14:29.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.876+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14041222050183837016', time=2024-09-19T16:04:23.813820+0000, chain.objs.size()=3 2024-09-19T14:14:29.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.876+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-STANDARD.2~gdE6JUtwpyru8uk8HI9hGMJGNYHW-Gl.1 2024-09-19T14:14:29.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.876+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-STANDARD.2~gdE6JUtwpyru8uk8HI9hGMJGNYHW-Gl.2 2024-09-19T14:14:29.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.876+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-STANDARD.2~gdE6JUtwpyru8uk8HI9hGMJGNYHW-Gl.3 2024-09-19T14:14:29.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.876+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16737895103995574191', time=2024-09-19T16:04:23.886164+0000, chain.objs.size()=3 2024-09-19T14:14:29.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.876+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-FROZEN.2~aNp3UJLE-ddNB0MK-NwhIY1m03unpN0.1 2024-09-19T14:14:29.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.876+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-FROZEN.2~aNp3UJLE-ddNB0MK-NwhIY1m03unpN0.2 2024-09-19T14:14:29.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.876+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-FROZEN.2~aNp3UJLE-ddNB0MK-NwhIY1m03unpN0.3 2024-09-19T14:14:29.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.876+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15415161046353177993', time=2024-09-19T16:04:24.390998+0000, chain.objs.size()=1 2024-09-19T14:14:29.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.876+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.8__shadow_.Da7ZHDtoI-_hpRFTPRTla3kCoX3yW8Y_0 2024-09-19T14:14:29.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.876+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18106778920605758361', time=2024-09-19T16:06:05.248714+0000, chain.objs.size()=1 2024-09-19T14:14:29.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.876+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.19__shadow_.4yGP9xg6Ntr3xARq0LboodrTA-4YVmh_0 2024-09-19T14:14:29.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.876+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4192888316286885362', time=2024-09-19T16:06:06.978552+0000, chain.objs.size()=1 2024-09-19T14:14:29.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.876+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.19__shadow_.yqqWYKBkgnDV9YDPES5EJ3uKFNT5SK-_0 2024-09-19T14:14:29.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.876+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5677171353274309302', time=2024-09-19T16:06:46.405295+0000, chain.objs.size()=1 2024-09-19T14:14:29.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.876+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.21__shadow_.BaySPCM3CT-l8_U_TWITkh18Oe-mYuh_0 2024-09-19T14:14:29.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.880+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1623416299227603326', time=2024-09-19T16:06:46.609460+0000, chain.objs.size()=1 2024-09-19T14:14:29.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.880+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.21__shadow_.nOiVjZ9TK2K3IS9WLzhclY8uzPujZtw_0 2024-09-19T14:14:29.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.880+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2815926086159629743', time=2024-09-19T16:06:51.325444+0000, chain.objs.size()=1 2024-09-19T14:14:29.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.880+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.22__shadow_.HzCV7DGQ_qTBI8e91-vX7AF5xqZhowI_0 2024-09-19T14:14:29.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.880+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5987038767832618166', time=2024-09-19T16:07:39.342619+0000, chain.objs.size()=1 2024-09-19T14:14:29.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.880+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.26__shadow_.fKt9RO9T6KyN_NiRLm4qwadhAk3WIRw_0 2024-09-19T14:14:29.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.880+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11657196590787019194', time=2024-09-19T16:08:13.662249+0000, chain.objs.size()=1 2024-09-19T14:14:29.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.880+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.27__shadow_.MlY6WR6silkz4WDzWJiBjuyK0vpn5GX_0 2024-09-19T14:14:29.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.880+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9664068350876181469', time=2024-09-19T16:08:21.832849+0000, chain.objs.size()=1 2024-09-19T14:14:29.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.880+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.29__shadow_.D3cKDUXwCLxcQnp6TFFfGJ6gPqgvT7m_0 2024-09-19T14:14:29.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.880+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17791918569641405636', time=2024-09-19T16:09:38.223707+0000, chain.objs.size()=1 2024-09-19T14:14:29.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.880+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.32__shadow_.U0AnDpEMaxYWB32Mk0GP4_EFqfUe_Ef_0 2024-09-19T14:14:29.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.880+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7429297465090200560', time=2024-09-19T16:09:44.413591+0000, chain.objs.size()=1 2024-09-19T14:14:29.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.880+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.33__shadow_.NotRVi3QZgfO1RNvkgRQlGYAwmFgBpj_0 2024-09-19T14:14:29.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.880+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3069338267183161994', time=2024-09-19T16:10:19.559573+0000, chain.objs.size()=1 2024-09-19T14:14:29.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.880+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.34__shadow_.6sCk2u3FhCTL5VrrvX2iBzsKp4dSPnS_0 2024-09-19T14:14:29.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.880+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9706585275669930342', time=2024-09-19T16:10:24.076986+0000, chain.objs.size()=1 2024-09-19T14:14:29.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.880+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.35__shadow_.hqqFTJCFbCoDfuYqXTomLddrpzwsVQ0_0 2024-09-19T14:14:29.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.880+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11432514491170675425', time=2024-09-19T16:11:00.029647+0000, chain.objs.size()=1 2024-09-19T14:14:29.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.880+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.36__shadow_.Np1qPrr8CqKeQMnhPRp87EuDRojKXHO_0 2024-09-19T14:14:29.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.880+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18401994066274867428', time=2024-09-19T16:13:53.299429+0000, chain.objs.size()=1 2024-09-19T14:14:29.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.880+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.17__shadow_.N957QRRWOqGW4PY48YOE3DCT-ZdArMt_0 2024-09-19T14:14:29.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.884+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13794946588696165318', time=2024-09-19T16:13:53.398039+0000, chain.objs.size()=1 2024-09-19T14:14:29.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.884+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.17__shadow_.nGPxJyywz14vJ8KvajS4RtGb5ExoZus_0 2024-09-19T14:14:29.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.888+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.888+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:14:29.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-19T14:14:29.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4766458164952537867', time=2024-09-19T16:04:23.275864+0000, chain.objs.size()=1 2024-09-19T14:14:29.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.4__shadow_.ungRs7FWqQ-6Pa_M91RDr_Icma6cME-_0 2024-09-19T14:14:29.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='_ZStxhGynjSJ0z0GIC14XU-uEhnHGtnx', time=2024-09-19T16:04:23.824514+0000, chain.objs.size()=2 2024-09-19T14:14:29.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__shadow_.BH1J5u-QHCV16PU1xTD0BL6wzgSDflk_0 2024-09-19T14:14:29.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__shadow_.BH1J5u-QHCV16PU1xTD0BL6wzgSDflk_1 2024-09-19T14:14:29.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13257864237324560570', time=2024-09-19T16:06:06.926424+0000, chain.objs.size()=1 2024-09-19T14:14:29.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.19__shadow_.7d86hDDlMSUaMEC6cJ93VAqgka_i6tK_0 2024-09-19T14:14:29.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17909411785497959746', time=2024-09-19T16:06:06.967597+0000, chain.objs.size()=1 2024-09-19T14:14:29.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.19__shadow_.wFARdzOy8Xj6Ky7NqE1ew4nPi9Km3GY_0 2024-09-19T14:14:29.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1052739434322406914', time=2024-09-19T16:06:46.462049+0000, chain.objs.size()=1 2024-09-19T14:14:29.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.21__shadow_.474Ip5XhgOw2sxzN3a4Kdd792jPeAED_0 2024-09-19T14:14:29.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17037669238506655344', time=2024-09-19T16:06:55.430933+0000, chain.objs.size()=1 2024-09-19T14:14:29.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.23__shadow_.xv6GAW8EVzdcgzq3RfHJCTFPLbu2nIR_0 2024-09-19T14:14:29.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2196595341465767566', time=2024-09-19T16:08:13.757695+0000, chain.objs.size()=1 2024-09-19T14:14:29.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.27__shadow_.5Y5iAD3ZiP5c585klI-VD66LfTaDReH_0 2024-09-19T14:14:29.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16088481346166564949', time=2024-09-19T16:09:02.187358+0000, chain.objs.size()=1 2024-09-19T14:14:29.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.31__shadow_.Ng-DpEUiChz5VxSAlykSwlzccpTHwtJ_0 2024-09-19T14:14:29.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16603280968693924692', time=2024-09-19T16:09:02.424019+0000, chain.objs.size()=1 2024-09-19T14:14:29.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.31__shadow_.IeT8rBrhGsgi9pv5GvW_gPeNQZhMoXi_0 2024-09-19T14:14:29.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14291405500783589796', time=2024-09-19T16:09:38.323685+0000, chain.objs.size()=1 2024-09-19T14:14:29.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.32__shadow_.hG6yDyb7vUGVPJiZQmYLr502l86z1oa_0 2024-09-19T14:14:29.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9547510897604570262', time=2024-09-19T16:13:53.342910+0000, chain.objs.size()=1 2024-09-19T14:14:29.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.892+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.17__shadow_.fnT3LeAEYjP-qR-3wlAVAm8tzgvoC6F_0 2024-09-19T14:14:29.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.896+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:14:29.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-19T14:14:29.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3490275289947623924', time=2024-09-19T16:04:23.258356+0000, chain.objs.size()=1 2024-09-19T14:14:29.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.4__shadow_.gdG2oG44r7k5gdAOZr4fLvYvb--elMF_0 2024-09-19T14:14:29.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6397289982962329278', time=2024-09-19T16:06:11.422937+0000, chain.objs.size()=1 2024-09-19T14:14:29.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.20__shadow_.KSAnUCn8YrBmd49g1kIEZvbwgzzxNLU_0 2024-09-19T14:14:29.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13149638263318436850', time=2024-09-19T16:06:46.481596+0000, chain.objs.size()=1 2024-09-19T14:14:29.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.21__shadow_.JX2oeru-UGUsIxPor3gbFvH-pn4l9bT_0 2024-09-19T14:14:29.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17325861572358948689', time=2024-09-19T16:07:33.963036+0000, chain.objs.size()=1 2024-09-19T14:14:29.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.25__shadow_.73-DruZfTKahGPmsW6TybjoRWGX8DWT_0 2024-09-19T14:14:29.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10067477857197262449', time=2024-09-19T16:07:35.005027+0000, chain.objs.size()=1 2024-09-19T14:14:29.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.25__shadow_.-rjJJ8YpY6bd5wVstOoocKaiXlZ-oJl_0 2024-09-19T14:14:29.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11716200681872127302', time=2024-09-19T16:07:39.097843+0000, chain.objs.size()=1 2024-09-19T14:14:29.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.26__shadow_.ZgXmiBlVUeDKI5MgZ5JGbj2eqfLwEZN_0 2024-09-19T14:14:29.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12228564160557965320', time=2024-09-19T16:07:39.210365+0000, chain.objs.size()=1 2024-09-19T14:14:29.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.26__shadow_.CKZiMThCvWrSCu10d3kM7TYIwodoXV4_0 2024-09-19T14:14:29.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4673559260312975128', time=2024-09-19T16:08:58.087023+0000, chain.objs.size()=1 2024-09-19T14:14:29.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.30__shadow_.yj8CANINY2_eodPw1sNq7TYWTnAOIVL_0 2024-09-19T14:14:29.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8663857883600080989', time=2024-09-19T16:09:02.266952+0000, chain.objs.size()=1 2024-09-19T14:14:29.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.31__shadow_.oZTer3Hu6ItG2bksy5sxetSgnogIaO0_0 2024-09-19T14:14:29.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12514388787113139532', time=2024-09-19T16:09:38.127167+0000, chain.objs.size()=1 2024-09-19T14:14:29.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.32__shadow_.c7Iy3cbj6o-Ex-uWqflSfhTY5bwNwmn_0 2024-09-19T14:14:29.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.190435029415099901', time=2024-09-19T16:09:38.223536+0000, chain.objs.size()=1 2024-09-19T14:14:29.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.32__shadow_.MdNoKKjz6sDYQpSq0PyzMJL94RB7Ttc_0 2024-09-19T14:14:29.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13765457956441449105', time=2024-09-19T16:09:44.391829+0000, chain.objs.size()=1 2024-09-19T14:14:29.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.900+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.33__shadow_.L6UbZAJqVA6ap4t-ym_2Kvc5ovUw4wv_0 2024-09-19T14:14:29.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.904+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13764882834345097563', time=2024-09-19T16:10:19.552882+0000, chain.objs.size()=1 2024-09-19T14:14:29.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.904+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.34__shadow_.nDjhEONnU278gD9Z3RTRRgqxA_HscsG_0 2024-09-19T14:14:29.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.904+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10718187646597958', time=2024-09-19T16:10:24.077273+0000, chain.objs.size()=1 2024-09-19T14:14:29.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.904+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.35__shadow_.zDZ5KgQntSjU35xFGEacYjzNZwIVvkF_0 2024-09-19T14:14:29.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.904+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11225107527301941075', time=2024-09-19T16:10:28.236052+0000, chain.objs.size()=1 2024-09-19T14:14:29.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.904+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.36__shadow_.656myWXjnfKIpw0ZTCV52A-wuE67OpB_0 2024-09-19T14:14:29.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.904+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13420661399767934107', time=2024-09-19T16:11:00.029211+0000, chain.objs.size()=1 2024-09-19T14:14:29.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.904+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.36__shadow_.CZTPfk1JwPL9yPmMGx6mqHRB1tBwE4A_0 2024-09-19T14:14:29.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.904+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10185421945068958427', time=2024-09-19T16:11:45.120264+0000, chain.objs.size()=1 2024-09-19T14:14:29.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.904+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.39__shadow_.y5Wwi5uFgl3giXgOjh7lIVWqCHrZtYF_0 2024-09-19T14:14:29.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.904+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14727637045397747039', time=2024-09-19T16:14:01.545044+0000, chain.objs.size()=1 2024-09-19T14:14:29.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.904+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.18__shadow:.fqjllZeY-csz-1R8ZSz8rNtN8RwjG0_.4p8eQA1GbsDcHOWibhKMT3yPsNUIJx2_0 2024-09-19T14:14:29.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.904+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2511061346921902289', time=2024-09-19T16:14:07.476264+0000, chain.objs.size()=1 2024-09-19T14:14:29.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.904+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.18__shadow:zAXzuShn1kGaSxNlAXcodPLae45cZHv_.JuPfkOXggcwtdh5wzBl6xwnHnvX-rLe_0 2024-09-19T14:14:29.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.908+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.912+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:14:29.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.912+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.912+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-19T14:14:29.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8965639490797258725', time=2024-09-19T16:06:46.405559+0000, chain.objs.size()=1 2024-09-19T14:14:29.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.21__shadow_.h3RCbv1RZERDkck5P0zx0Jf0Wi29PWg_0 2024-09-19T14:14:29.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6472747447271668213', time=2024-09-19T16:06:51.383477+0000, chain.objs.size()=1 2024-09-19T14:14:29.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.22__shadow_.8m-f-yPIAJg4ZLRbufOZQNkohPLAXR8_0 2024-09-19T14:14:29.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5607709390252531796', time=2024-09-19T16:07:29.850866+0000, chain.objs.size()=1 2024-09-19T14:14:29.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.24__shadow_.TcZAhT7xa1AyK--9nnyko1t1Oc_NcXs_0 2024-09-19T14:14:29.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6030963566005931980', time=2024-09-19T16:07:29.988479+0000, chain.objs.size()=1 2024-09-19T14:14:29.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.24__shadow_.KOWiusdaBedXMoj7LKd90TF0bvn0ble_0 2024-09-19T14:14:29.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5530786291243943579', time=2024-09-19T16:07:29.990117+0000, chain.objs.size()=1 2024-09-19T14:14:29.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.24__shadow_.HQllRgZZ3Q9WjfkBVMrv-1UaUf1pdKD_0 2024-09-19T14:14:29.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1839681161295386312', time=2024-09-19T16:07:34.788352+0000, chain.objs.size()=1 2024-09-19T14:14:29.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.25__shadow_.bcl2TGkE6MQ-4CUd4LoNQeXsAlLVaJb_0 2024-09-19T14:14:29.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14809491434664375299', time=2024-09-19T16:07:34.952164+0000, chain.objs.size()=1 2024-09-19T14:14:29.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.25__shadow_.o62tm4IPvrh_DyL0Vv6HOzvFeMacNTf_0 2024-09-19T14:14:29.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5942706382663293152', time=2024-09-19T16:08:58.316202+0000, chain.objs.size()=1 2024-09-19T14:14:29.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.30__shadow_.La9lcYWGdt2phX5oMBksY45wFknHjKG_0 2024-09-19T14:14:29.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14798248578297085387', time=2024-09-19T16:09:44.335722+0000, chain.objs.size()=1 2024-09-19T14:14:29.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.33__shadow_.ytuTInrFqScLw5aDgwwjBXq9Z3LY-Rq_0 2024-09-19T14:14:29.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3739771383634833217', time=2024-09-19T16:10:24.244271+0000, chain.objs.size()=1 2024-09-19T14:14:29.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.35__shadow_.3pJRG4_ybXoowBlhgbyi85lE4vywgHM_0 2024-09-19T14:14:29.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14755482438223249511', time=2024-09-19T16:11:05.328867+0000, chain.objs.size()=1 2024-09-19T14:14:29.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.37__shadow_._jhbGDhjQ60jZQv_VHC5CV2K6W6PALq_0 2024-09-19T14:14:29.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12048212255660450893', time=2024-09-19T16:11:05.339383+0000, chain.objs.size()=1 2024-09-19T14:14:29.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.37__shadow_.hqzCjE1DBqu1_uZQYVh5WmZGKcgRh-Q_0 2024-09-19T14:14:29.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5626756628341588092', time=2024-09-19T16:11:09.177571+0000, chain.objs.size()=1 2024-09-19T14:14:29.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.38__shadow_.C77b78zFniOT_-KwDfgM-lTS9EK5JYI_0 2024-09-19T14:14:29.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7446376589881462857', time=2024-09-19T16:11:09.291496+0000, chain.objs.size()=1 2024-09-19T14:14:29.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.38__shadow_.dLBPJZbW6Z4QfjI2BsFtybmV4GMxK1d_0 2024-09-19T14:14:29.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7286921459985769071', time=2024-09-19T16:11:45.120178+0000, chain.objs.size()=1 2024-09-19T14:14:29.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.916+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.39__shadow_.zbhrcq8QIZLLN3qHkMSCm92UelyByLv_0 2024-09-19T14:14:29.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.920+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:14:29.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-19T14:14:29.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10524623683236933189', time=2024-09-19T16:04:23.778911+0000, chain.objs.size()=3 2024-09-19T14:14:29.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-FROZEN.2~aNp3UJLE-ddNB0MK-NwhIY1m03unpN0.1 2024-09-19T14:14:29.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-FROZEN.2~aNp3UJLE-ddNB0MK-NwhIY1m03unpN0.2 2024-09-19T14:14:29.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-FROZEN.2~aNp3UJLE-ddNB0MK-NwhIY1m03unpN0.3 2024-09-19T14:14:29.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4385536128021373652', time=2024-09-19T16:06:06.949464+0000, chain.objs.size()=1 2024-09-19T14:14:29.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.19__shadow_.x3OaqB1skVbqsbOEdKYBPPGlL5cMY7j_0 2024-09-19T14:14:29.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8361571847873980824', time=2024-09-19T16:06:11.419100+0000, chain.objs.size()=1 2024-09-19T14:14:29.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.20__shadow_.TLJUtt4weLLnO4ZIA2pCNH0THShbBui_0 2024-09-19T14:14:29.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11762862574600496679', time=2024-09-19T16:06:51.392627+0000, chain.objs.size()=1 2024-09-19T14:14:29.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.22__shadow_.L_yINPo7EZ50Miikqdu3JRdNU7RIuC-_0 2024-09-19T14:14:29.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2005176411095570314', time=2024-09-19T16:06:55.323215+0000, chain.objs.size()=1 2024-09-19T14:14:29.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.23__shadow_.-bT0ci7qTyobkLFUqLrwZk2tFf90IEH_0 2024-09-19T14:14:29.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2748461566996833310', time=2024-09-19T16:07:39.216659+0000, chain.objs.size()=1 2024-09-19T14:14:29.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.26__shadow_.8hoB1ohRLtxVRqqp2BPsKYhD75IoO5M_0 2024-09-19T14:14:29.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9022320186109628514', time=2024-09-19T16:08:18.379266+0000, chain.objs.size()=1 2024-09-19T14:14:29.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.28__shadow_.zlbfDyxsWkbKyVmsgv2tz07BNbp6ZK3_0 2024-09-19T14:14:29.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16394095505079927590', time=2024-09-19T16:08:53.351182+0000, chain.objs.size()=1 2024-09-19T14:14:29.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.29__shadow_.bNvxU3rVJjMvs7BgLMB5f6id7rwTPyY_0 2024-09-19T14:14:29.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1490075197899575351', time=2024-09-19T16:09:42.889324+0000, chain.objs.size()=1 2024-09-19T14:14:29.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.33__shadow_.jufLcNMnhXTyyy0NWqwgPXSTcRagmLR_0 2024-09-19T14:14:29.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9741034842278923004', time=2024-09-19T16:09:44.279055+0000, chain.objs.size()=1 2024-09-19T14:14:29.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.924+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.33__shadow_.eQ4oAwUir9_fXr4Tz0vPYiunEy3GoCz_0 2024-09-19T14:14:29.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.928+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16923436370723050224', time=2024-09-19T16:09:44.317632+0000, chain.objs.size()=1 2024-09-19T14:14:29.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.928+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.33__shadow_.bPxpEnwHnahTgzIaV0qJNWQCKGAtCLJ_0 2024-09-19T14:14:29.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.928+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9814038055022903712', time=2024-09-19T16:10:19.621188+0000, chain.objs.size()=1 2024-09-19T14:14:29.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.928+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.34__shadow_.dN7k9e4fR1_d9XHG37BBJ_BTsPwSmcJ_0 2024-09-19T14:14:29.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.928+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.232504082251839747', time=2024-09-19T16:11:45.167617+0000, chain.objs.size()=1 2024-09-19T14:14:29.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.928+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.39__shadow_.T2l6IcnKIylN7uDg992Y42OyfN7OwnJ_0 2024-09-19T14:14:29.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.932+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.936+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:14:29.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.936+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.936+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.936+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-19T14:14:29.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.936+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7058007794479037573', time=2024-09-19T16:04:23.631229+0000, chain.objs.size()=1 2024-09-19T14:14:29.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.936+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.15__shadow_.UuB97-xnlolQi464p3aH_ShFoTd6SMO_0 2024-09-19T14:14:29.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.936+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.77841423889869566', time=2024-09-19T16:04:23.959673+0000, chain.objs.size()=3 2024-09-19T14:14:29.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.936+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.14__multipart_foo-STANDARD.2~CMEEgGQhoOEmqp8vbXSEZRgCDE0sXZj.1 2024-09-19T14:14:29.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.936+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.14__multipart_foo-STANDARD.2~CMEEgGQhoOEmqp8vbXSEZRgCDE0sXZj.2 2024-09-19T14:14:29.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.936+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.14__multipart_foo-STANDARD.2~CMEEgGQhoOEmqp8vbXSEZRgCDE0sXZj.3 2024-09-19T14:14:29.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.936+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9106034207688633866', time=2024-09-19T16:06:06.894020+0000, chain.objs.size()=1 2024-09-19T14:14:29.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.936+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.19__shadow_.xZPdPPOP3vRs4kbp5CYGHOhtnRKwxCv_0 2024-09-19T14:14:29.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.936+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16364519336411729385', time=2024-09-19T16:06:46.388163+0000, chain.objs.size()=1 2024-09-19T14:14:29.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.936+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.21__shadow_.c3_jB2Jskjw-YnwvaGsIXg-ax-XVM0I_0 2024-09-19T14:14:29.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.936+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.191228704780053706', time=2024-09-19T16:06:46.390111+0000, chain.objs.size()=1 2024-09-19T14:14:29.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.936+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.21__shadow_.6rBG5E3qUhGdzVXS1YD3Su5Gz3T2ZfR_0 2024-09-19T14:14:29.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.936+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8421782509941173753', time=2024-09-19T16:06:55.387601+0000, chain.objs.size()=1 2024-09-19T14:14:29.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.936+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.23__shadow_.kU6Vqpw1mox1dDAEUjiWAWOhNnYTcMY_0 2024-09-19T14:14:29.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.936+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10844274091944500347', time=2024-09-19T16:07:34.800651+0000, chain.objs.size()=1 2024-09-19T14:14:29.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.936+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.25__shadow_.GLAolJqQCGtEDF5UJA1JNNWbb0zAEOe_0 2024-09-19T14:14:29.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.936+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8173182265395487905', time=2024-09-19T16:07:39.211946+0000, chain.objs.size()=1 2024-09-19T14:14:29.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.936+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.26__shadow_.UZI52pRNOGPx06bb8hkpVRtMEC1F-_h_0 2024-09-19T14:14:29.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.936+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15929745235930076876', time=2024-09-19T16:07:39.370056+0000, chain.objs.size()=1 2024-09-19T14:14:29.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.936+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.26__shadow_.LHjvEivlao-3PHHV6_ynG8pqOXleB77_0 2024-09-19T14:14:29.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.940+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13644218226326859082', time=2024-09-19T16:08:18.370672+0000, chain.objs.size()=1 2024-09-19T14:14:29.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.940+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.28__shadow_.xsVWPpKp1SAzxIYXu-nF6shRkEs8Dbf_0 2024-09-19T14:14:29.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.940+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16954068942109156319', time=2024-09-19T16:08:58.107067+0000, chain.objs.size()=1 2024-09-19T14:14:29.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.940+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.30__shadow_.cR8JGMkd_6Njn_xng1kiQd83NsJWscX_0 2024-09-19T14:14:29.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.940+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18082363478996498266', time=2024-09-19T16:09:38.253969+0000, chain.objs.size()=1 2024-09-19T14:14:29.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.940+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.32__shadow_.4UUUOSNxOVfOVlZM9_qkEz0-vDdHnCh_0 2024-09-19T14:14:29.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.940+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15223033363523440821', time=2024-09-19T16:10:19.519006+0000, chain.objs.size()=1 2024-09-19T14:14:29.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.940+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.34__shadow_.B5PGbXWtkt80j2T8ghG8W2nb-I9LM76_0 2024-09-19T14:14:29.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.940+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6591672012982739460', time=2024-09-19T16:10:23.967003+0000, chain.objs.size()=1 2024-09-19T14:14:29.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.940+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.35__shadow_.qtm1RDQpmJGUp3zvvWiP8jYrknHM95T_0 2024-09-19T14:14:29.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.944+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3412017989709994578', time=2024-09-19T16:11:05.376555+0000, chain.objs.size()=1 2024-09-19T14:14:29.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.944+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.37__shadow_.loUwZXBUYznzwC1ytjAordN37ByPjeJ_0 2024-09-19T14:14:29.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.944+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:14:29.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-19T14:14:29.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16566962821138150481', time=2024-09-19T16:06:51.197423+0000, chain.objs.size()=1 2024-09-19T14:14:29.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.22__shadow_.ipL8kQ9FZYsp-yqaXvb7_EWjUt0YpI6_0 2024-09-19T14:14:29.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11940988114238223880', time=2024-09-19T16:06:55.318313+0000, chain.objs.size()=1 2024-09-19T14:14:29.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.23__shadow_.TDURck8foL770PAt0xBJk6svOu4kSIU_0 2024-09-19T14:14:29.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10218010378262740544', time=2024-09-19T16:06:55.335050+0000, chain.objs.size()=1 2024-09-19T14:14:29.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.23__shadow_.GSPIB9omH0e1Mkq0xvu7Xxg7PDX5_uI_0 2024-09-19T14:14:29.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4191088820429693629', time=2024-09-19T16:06:55.415248+0000, chain.objs.size()=1 2024-09-19T14:14:29.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.23__shadow_.PysGDNlv08vsFbFAYR0Ne2rUbH9dj0__0 2024-09-19T14:14:29.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5841953237783963534', time=2024-09-19T16:07:30.092576+0000, chain.objs.size()=1 2024-09-19T14:14:29.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.24__shadow_.vinnXUl3SlAE6y9g7Xm3BvWqiPKy7aT_0 2024-09-19T14:14:29.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6477160844172911905', time=2024-09-19T16:07:39.216715+0000, chain.objs.size()=1 2024-09-19T14:14:29.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.26__shadow_.mljETHoUfoOWhAVUzUBg9KPw6QXsVlq_0 2024-09-19T14:14:29.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15334582414090745661', time=2024-09-19T16:08:18.379208+0000, chain.objs.size()=1 2024-09-19T14:14:29.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.28__shadow_.iX7PLsqSD9-MdhUYQ8P9Y2dbVtsCb2l_0 2024-09-19T14:14:29.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3919996223078027281', time=2024-09-19T16:09:02.448079+0000, chain.objs.size()=1 2024-09-19T14:14:29.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.31__shadow_.PxW890Q3uHbVk8pHBdvlyFD2u-m1vcS_0 2024-09-19T14:14:29.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5246579993112728308', time=2024-09-19T16:09:38.230569+0000, chain.objs.size()=1 2024-09-19T14:14:29.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.32__shadow_.iZAt3CozPLWdKWMy8tkAZodfJGco5iP_0 2024-09-19T14:14:29.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14615743424087740637', time=2024-09-19T16:09:38.232760+0000, chain.objs.size()=1 2024-09-19T14:14:29.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.32__shadow_.hMsq-xZ6LAYq-CmcU-ShSiLwPMkUfSx_0 2024-09-19T14:14:29.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4492720416130210697', time=2024-09-19T16:11:05.159251+0000, chain.objs.size()=1 2024-09-19T14:14:29.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.37__shadow_.5YPZFunMqSmumMaoQGZnoK7PEBaate__0 2024-09-19T14:14:29.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5335538502858357388', time=2024-09-19T16:11:05.170975+0000, chain.objs.size()=1 2024-09-19T14:14:29.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.948+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.37__shadow_.muj_yewlO7L8tBmA-oTP2PaEkBGa9KA_0 2024-09-19T14:14:29.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.952+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11042282676847625056', time=2024-09-19T16:11:45.165923+0000, chain.objs.size()=1 2024-09-19T14:14:29.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.952+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.39__shadow_.bXp4kGdic4m3UN316xezcllPwlAtcCo_0 2024-09-19T14:14:29.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.956+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.956+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:14:29.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-19T14:14:29.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='_X_RZ0V85I-VsmZEdc1OPWFuuzcCFUck', time=2024-09-19T16:04:23.620116+0000, chain.objs.size()=1 2024-09-19T14:14:29.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.15__shadow_.OqLjgMi5vpSKiPoyhQ84gx4uo3r_mwH_0 2024-09-19T14:14:29.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8105432631187531668', time=2024-09-19T16:04:23.862088+0000, chain.objs.size()=3 2024-09-19T14:14:29.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-LUKEWARM.2~TFTCNQOpN5N-SocSR7HizO4F2TDXQ8_.1 2024-09-19T14:14:29.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-LUKEWARM.2~TFTCNQOpN5N-SocSR7HizO4F2TDXQ8_.2 2024-09-19T14:14:29.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.16__multipart_foo-LUKEWARM.2~TFTCNQOpN5N-SocSR7HizO4F2TDXQ8_.3 2024-09-19T14:14:29.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6705834545831507924', time=2024-09-19T16:06:06.895724+0000, chain.objs.size()=1 2024-09-19T14:14:29.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.19__shadow_.BWsKsfqtKoPr1K668Yu9EsrXqzu2CB0_0 2024-09-19T14:14:29.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10989844299960411167', time=2024-09-19T16:06:11.380563+0000, chain.objs.size()=1 2024-09-19T14:14:29.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.20__shadow_.iMtrF_6dIEy7TZZLxQ1T9tkGf1ZS9EZ_0 2024-09-19T14:14:29.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1419194456490949376', time=2024-09-19T16:06:11.579109+0000, chain.objs.size()=1 2024-09-19T14:14:29.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.20__shadow_._AN39Ky-M4WP0p-HkPZCsQTagrMJ5nK_0 2024-09-19T14:14:29.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12475778861433796521', time=2024-09-19T16:06:55.542892+0000, chain.objs.size()=1 2024-09-19T14:14:29.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.23__shadow_.D2pOn3Qn3w6GdgWuLzAzJ_QXYsFd6vn_0 2024-09-19T14:14:29.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16125986333470278623', time=2024-09-19T16:07:30.086423+0000, chain.objs.size()=1 2024-09-19T14:14:29.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.24__shadow_.48roKUegoxBiPBrqT0oD5OQMCi27CF9_0 2024-09-19T14:14:29.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9244007890551674591', time=2024-09-19T16:07:34.793405+0000, chain.objs.size()=1 2024-09-19T14:14:29.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.25__shadow_.UD4etyyTHGX62b59pSDts6ldVmA2kuU_0 2024-09-19T14:14:29.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13603332667432336119', time=2024-09-19T16:07:39.256686+0000, chain.objs.size()=1 2024-09-19T14:14:29.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.26__shadow_.UAVYCK15tvmNdJcIkRdr1aI5c-Q-cTp_0 2024-09-19T14:14:29.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4770723126622453393', time=2024-09-19T16:08:13.679962+0000, chain.objs.size()=1 2024-09-19T14:14:29.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.960+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.27__shadow_.PVMAkKPg6xnnksZ64W2NIp8K0uq8Sgy_0 2024-09-19T14:14:29.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.964+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4958256681060322846', time=2024-09-19T16:10:24.166792+0000, chain.objs.size()=1 2024-09-19T14:14:29.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.964+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.35__shadow_.WzD8AJC0sf15r__dhWhvGtWlTXDTbGO_0 2024-09-19T14:14:29.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.964+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16957641607615503264', time=2024-09-19T16:11:05.240832+0000, chain.objs.size()=1 2024-09-19T14:14:29.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.964+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.37__shadow_.zJcvu1417Uyi1tyTEjODn0LYP8daYiJ_0 2024-09-19T14:14:29.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.964+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2578774956809759451', time=2024-09-19T16:11:09.071465+0000, chain.objs.size()=1 2024-09-19T14:14:29.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.964+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.38__shadow_.AJKcagx3nAcoZPQB4nURtveJJsVR_Nz_0 2024-09-19T14:14:29.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.964+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5177128475533171000', time=2024-09-19T16:11:45.135860+0000, chain.objs.size()=1 2024-09-19T14:14:29.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.964+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.39__shadow_.Hv4CuIAMA6Aabd630JszlnTEuh-xpDJ_0 2024-09-19T14:14:29.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.964+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16755197081351362463', time=2024-09-19T16:14:07.446936+0000, chain.objs.size()=1 2024-09-19T14:14:29.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.964+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.18__shadow:BRRR.hFIILBB0tlii9PWj1.ST1U416G_.MZh-nDFAJWOQ3qLjiVBMcyuoJrhLLYS_0 2024-09-19T14:14:29.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.968+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.972+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:14:29.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.972+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:29.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.972+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:29.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.972+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-19T14:14:29.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.972+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6873714728029927766', time=2024-09-19T16:06:06.949297+0000, chain.objs.size()=1 2024-09-19T14:14:29.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.972+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.19__shadow_.wGunDFoj5YqA2qDiDLl5zGh1UDctRUt_0 2024-09-19T14:14:29.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.972+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.534932168690421309', time=2024-09-19T16:07:34.947427+0000, chain.objs.size()=1 2024-09-19T14:14:29.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.972+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.25__shadow_.aRkHxUWOBX78hi93PyBlVz-YWFSzv3A_0 2024-09-19T14:14:29.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.972+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4712719059925860566', time=2024-09-19T16:07:34.950325+0000, chain.objs.size()=1 2024-09-19T14:14:29.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.972+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.25__shadow_.FrzffJYMrq0EqavPFOnmuXG6z7PTT29_0 2024-09-19T14:14:29.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.972+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12477123299797480295', time=2024-09-19T16:10:19.520865+0000, chain.objs.size()=1 2024-09-19T14:14:29.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.972+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.34__shadow_.eJpj2qzPXEgD02XdC9GPpS2FykEO7LL_0 2024-09-19T14:14:29.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.972+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15472551872820378528', time=2024-09-19T16:11:00.152277+0000, chain.objs.size()=1 2024-09-19T14:14:29.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.972+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.36__shadow_.yLdy81bQ6ijgmf20z0La2rHgbNBE3fC_0 2024-09-19T14:14:29.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.972+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4589376441532529910', time=2024-09-19T16:11:05.159085+0000, chain.objs.size()=1 2024-09-19T14:14:29.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.972+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.37__shadow_.bjuy5wIaP8OVcXBK1Pkj9LK8XUu6n7p_0 2024-09-19T14:14:29.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.972+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12392559922461742142', time=2024-09-19T16:11:05.274080+0000, chain.objs.size()=1 2024-09-19T14:14:29.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.972+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.37__shadow_.jECobcr4077HPiQ-TB8Oh_nUB3ZW8xX_0 2024-09-19T14:14:29.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.972+0000 7f72ef1f29c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15029085040547034872', time=2024-09-19T16:11:09.286390+0000, chain.objs.size()=1 2024-09-19T14:14:29.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.972+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.38__shadow_.POsiq0nfqrQqNr_nccEvV-s_AnRJD7D_0 2024-09-19T14:14:29.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.976+0000 7f72ef1f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:14:29.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.980+0000 7f71a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:14:29.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.980+0000 7f72ef1f29c0 20 remove_watcher() i=0 2024-09-19T14:14:29.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.980+0000 7f72ef1f29c0 2 removed watcher, disabling cache 2024-09-19T14:14:29.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.980+0000 7f72ef1f29c0 20 remove_watcher() i=1 2024-09-19T14:14:29.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.984+0000 7f72ef1f29c0 20 remove_watcher() i=2 2024-09-19T14:14:29.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.984+0000 7f72ef1f29c0 20 remove_watcher() i=3 2024-09-19T14:14:29.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.984+0000 7f72ef1f29c0 20 remove_watcher() i=4 2024-09-19T14:14:29.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.988+0000 7f72ef1f29c0 20 remove_watcher() i=5 2024-09-19T14:14:29.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.988+0000 7f72ef1f29c0 20 remove_watcher() i=6 2024-09-19T14:14:29.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:29.988+0000 7f72ef1f29c0 20 remove_watcher() i=7 2024-09-19T14:14:30.004 DEBUG:teuthology.orchestra.run.smithi153:> radosgw-admin gc process --include-all 2024-09-19T14:14:30.068 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:14:30.068 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:14:30.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.104+0000 7f3205d129c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:30.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.104+0000 7f3205d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:30.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.104+0000 7f3205d129c0 20 realm 2024-09-19T14:14:30.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.104+0000 7f3205d129c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:30.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.104+0000 7f3205d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:30.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.104+0000 7f3205d129c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:14:30.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.104+0000 7f3205d129c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:30.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.104+0000 7f3205d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:30.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.104+0000 7f3205d129c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:30.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.108+0000 7f3205d129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:14:30.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.108+0000 7f3205d129c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:30.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.108+0000 7f3205d129c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:14:30.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.108+0000 7f3205d129c0 20 searching for the correct realm 2024-09-19T14:14:30.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.112+0000 7f3204019640 0 -- 172.21.15.153:0/173691303 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7f31ec02d070 msgr2=0x7f31ec06f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:14:30.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.328+0000 7f3203818640 0 -- 172.21.15.153:0/173691303 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x56399e23a500 msgr2=0x56399e23c8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:14:30.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.336+0000 7f3205d129c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:14:30.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.336+0000 7f3205d129c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:14:30.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.336+0000 7f3205d129c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:14:30.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.336+0000 7f3205d129c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:14:30.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.336+0000 7f3205d129c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:14:30.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.336+0000 7f3205d129c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:14:30.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.336+0000 7f3205d129c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:30.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.336+0000 7f3205d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:30.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.336+0000 7f3205d129c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:30.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.336+0000 7f3205d129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:14:30.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.336+0000 7f3205d129c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:30.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.336+0000 7f3205d129c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:14:30.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.336+0000 7f3205d129c0 20 zone default found 2024-09-19T14:14:30.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.336+0000 7f3205d129c0 4 Realm: () 2024-09-19T14:14:30.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.336+0000 7f3205d129c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:14:30.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.336+0000 7f3205d129c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:14:30.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.336+0000 7f3205d129c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:14:30.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.336+0000 7f3205d129c0 20 zonegroup default 2024-09-19T14:14:30.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.336+0000 7f3205d129c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:30.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.336+0000 7f3205d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:30.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.336+0000 7f3205d129c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:30.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.340+0000 7f3205d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:30.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.340+0000 7f3205d129c0 20 rados->read ofs=0 len=0 2024-09-19T14:14:30.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.340+0000 7f3205d129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:14:30.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.340+0000 7f3205d129c0 20 started sync module instance, tier type = 2024-09-19T14:14:30.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.340+0000 7f3205d129c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:14:30.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.360+0000 7f3205d129c0 20 add_watcher() i=0 2024-09-19T14:14:30.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.360+0000 7f3205d129c0 20 add_watcher() i=1 2024-09-19T14:14:30.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.360+0000 7f3205d129c0 20 add_watcher() i=2 2024-09-19T14:14:30.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.360+0000 7f3205d129c0 20 add_watcher() i=3 2024-09-19T14:14:30.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.360+0000 7f3205d129c0 20 add_watcher() i=4 2024-09-19T14:14:30.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.360+0000 7f3205d129c0 20 add_watcher() i=5 2024-09-19T14:14:30.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.360+0000 7f3205d129c0 20 add_watcher() i=6 2024-09-19T14:14:30.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.364+0000 7f3205d129c0 20 add_watcher() i=7 2024-09-19T14:14:30.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.364+0000 7f3205d129c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:14:30.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.368+0000 7f30b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:14:30.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.368+0000 7f3205d129c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:14:30.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.368+0000 7f3205d129c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:14:30.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.452+0000 7f30b8fe1640 20 reqs_thread_entry: start 2024-09-19T14:14:30.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.452+0000 7f3205d129c0 20 init_complete bucket index max shards: 11 2024-09-19T14:14:30.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.452+0000 7f3205d129c0 20 Filter name: none 2024-09-19T14:14:30.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.452+0000 7f30327fc640 20 reqs_thread_entry: start 2024-09-19T14:14:30.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.452+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:14:30.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.456+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.456+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.460+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.460+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:14:30.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.464+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.464+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.468+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.468+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:14:30.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.472+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.476+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.476+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.476+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:14:30.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.480+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.480+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.480+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.484+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:14:30.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.484+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.488+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.488+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.488+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:14:30.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.492+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.496+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.496+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.496+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:14:30.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.500+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.500+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.504+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.504+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:14:30.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.508+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.508+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.508+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.512+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:14:30.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.516+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.516+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.516+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.516+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:14:30.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.520+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.524+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.524+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.528+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:14:30.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.532+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.532+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.532+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.536+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:14:30.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.540+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.540+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.540+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.544+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:14:30.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.548+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.548+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.548+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.552+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:14:30.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.556+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.556+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.556+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.560+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:14:30.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.564+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.564+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.564+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.572+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:14:30.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.576+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.576+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.576+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.580+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:14:30.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.584+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.584+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.584+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.588+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:14:30.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.592+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.592+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.592+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.596+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:14:30.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.600+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.600+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.600+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.604+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:14:30.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.608+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.612+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.612+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.616+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:14:30.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.620+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.620+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.620+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.624+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:14:30.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.628+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.632+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.632+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.632+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:14:30.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.636+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.640+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.640+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.644+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:14:30.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.648+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.648+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.648+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.652+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:14:30.661 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.656+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.660+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.660+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.664+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:14:30.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.668+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.668+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.672+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.672+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:14:30.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.676+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.680+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.680+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.684+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:14:30.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.684+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.688+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.688+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.692+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:14:30.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.696+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.696+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.696+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.700+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:14:30.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.704+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.708+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.708+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.708+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:14:30.717 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.712+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.712+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.716+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.716+0000 7f3205d129c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:14:30.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.720+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.724+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:14:30.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.724+0000 7f3205d129c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:14:30.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.728+0000 7f30b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:14:30.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.732+0000 7f3205d129c0 20 remove_watcher() i=0 2024-09-19T14:14:30.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.732+0000 7f3205d129c0 2 removed watcher, disabling cache 2024-09-19T14:14:30.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.736+0000 7f3205d129c0 20 remove_watcher() i=1 2024-09-19T14:14:30.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.740+0000 7f3205d129c0 20 remove_watcher() i=2 2024-09-19T14:14:30.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.740+0000 7f3205d129c0 20 remove_watcher() i=3 2024-09-19T14:14:30.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.744+0000 7f3205d129c0 20 remove_watcher() i=4 2024-09-19T14:14:30.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.744+0000 7f3205d129c0 20 remove_watcher() i=5 2024-09-19T14:14:30.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.748+0000 7f3205d129c0 20 remove_watcher() i=6 2024-09-19T14:14:30.754 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:14:30.748+0000 7f3205d129c0 20 remove_watcher() i=7 2024-09-19T14:14:30.779 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-19T14:14:31.418 INFO:teuthology.orchestra.run.smithi153.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-19T14:14:36.114 INFO:teuthology.orchestra.run.smithi153.stdout:> Task :clean UP-TO-DATE 2024-09-19T14:14:54.513 INFO:teuthology.orchestra.run.smithi153.stdout:> Task :compileJava 2024-09-19T14:14:54.613 INFO:teuthology.orchestra.run.smithi153.stdout:> Task :processResources 2024-09-19T14:14:54.613 INFO:teuthology.orchestra.run.smithi153.stdout:> Task :classes 2024-09-19T14:14:55.313 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:14:55.313 INFO:teuthology.orchestra.run.smithi153.stdout:> Task :compileTestJava 2024-09-19T14:14:55.314 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:14:55.314 INFO:teuthology.orchestra.run.smithi153.stdout:> Task :processTestResources NO-SOURCE 2024-09-19T14:14:55.314 INFO:teuthology.orchestra.run.smithi153.stdout:> Task :testClasses 2024-09-19T14:14:55.314 INFO:teuthology.orchestra.run.smithi153.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-19T14:14:55.314 INFO:teuthology.orchestra.run.smithi153.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-19T14:15:01.813 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:15:01.813 INFO:teuthology.orchestra.run.smithi153.stdout:> Task :test 2024-09-19T14:15:01.813 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:15:01.813 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-19T14:15:12.613 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:15:12.613 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-19T14:15:13.513 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:15:13.513 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-19T14:15:13.712 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:15:13.713 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-19T14:15:14.512 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:15:14.513 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-19T14:15:35.313 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:15:35.313 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-19T14:15:36.113 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:15:36.113 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-19T14:15:36.213 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:15:36.213 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-19T14:15:36.413 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:15:36.413 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-19T14:15:36.613 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:15:36.613 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-19T14:15:37.413 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:15:37.413 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-19T14:15:59.013 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:15:59.013 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-19T14:16:00.613 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:16:00.613 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-19T14:16:01.113 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:16:01.113 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-19T14:16:01.113 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19 14:16:01,038 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-19T14:16:42.913 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:16:42.914 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-19T14:16:44.413 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:16:44.413 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-19T14:16:44.613 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:16:44.613 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-19T14:16:45.313 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:16:45.313 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-19T14:16:45.613 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:16:45.613 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-19T14:16:47.013 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:16:47.013 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-19T14:16:59.313 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:16:59.313 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-19T14:17:00.213 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:17:00.213 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-19T14:17:00.313 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:17:00.313 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-19T14:17:00.513 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:17:00.513 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-19T14:17:27.514 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:17:27.514 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-19T14:17:32.113 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:17:32.113 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests STANDARD_OUT 2024-09-19T14:17:32.113 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19 14:17:32,092 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-19T14:17:32.114 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19 14:17:32,098 [s3-transfer-manager-worker-10] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-19T14:17:33.213 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:17:33.213 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-19T14:18:02.813 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:18:02.814 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-19T14:18:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:18:04.013 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-19T14:18:09.713 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:18:09.714 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-19T14:18:10.613 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:18:10.613 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-19T14:21:02.814 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:21:02.814 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-19T14:21:03.613 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:21:03.614 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-19T14:21:19.913 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:21:19.914 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-19T14:21:20.814 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:21:20.814 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-19T14:21:41.314 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:21:41.314 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-19T14:21:42.214 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:21:42.214 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-19T14:21:46.614 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:21:46.614 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-19T14:22:08.414 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:08.414 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-19T14:22:08.714 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:08.714 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-19T14:22:09.614 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:09.614 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-19T14:22:09.814 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:09.814 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-19T14:22:10.714 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:10.714 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-19T14:22:11.014 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:11.014 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-19T14:22:11.914 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:11.914 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-19T14:22:12.114 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:12.114 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-19T14:22:13.014 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:13.014 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-19T14:22:13.314 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:13.314 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-19T14:22:14.213 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:14.214 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-19T14:22:14.514 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:14.514 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-19T14:22:15.314 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:15.314 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-19T14:22:15.614 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:15.614 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-19T14:22:16.414 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:16.414 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-19T14:22:43.714 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:43.714 INFO:teuthology.orchestra.run.smithi153.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-19T14:22:44.715 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:44.715 INFO:teuthology.orchestra.run.smithi153.stdout:---------------------------------------------------------------------- 2024-09-19T14:22:44.715 INFO:teuthology.orchestra.run.smithi153.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-19T14:22:44.715 INFO:teuthology.orchestra.run.smithi153.stdout:---------------------------------------------------------------------- 2024-09-19T14:22:44.715 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:44.715 INFO:teuthology.orchestra.run.smithi153.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-19T14:22:44.715 INFO:teuthology.orchestra.run.smithi153.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-19T14:22:44.715 INFO:teuthology.orchestra.run.smithi153.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-19T14:22:44.716 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:44.716 INFO:teuthology.orchestra.run.smithi153.stdout:BUILD SUCCESSFUL in 8m 13s 2024-09-19T14:22:44.716 INFO:teuthology.orchestra.run.smithi153.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-19T14:22:45.066 DEBUG:teuthology.orchestra.run.smithi153:> radosgw-admin gc process --include-all 2024-09-19T14:22:45.097 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:22:45.098 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:22:45.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.138+0000 7f44060ee9c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:45.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.142+0000 7f44060ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:45.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.142+0000 7f44060ee9c0 20 realm 2024-09-19T14:22:45.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.142+0000 7f44060ee9c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:45.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.142+0000 7f44060ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:45.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.142+0000 7f44060ee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:22:45.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.142+0000 7f44060ee9c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:45.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.142+0000 7f44060ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:45.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.142+0000 7f44060ee9c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:45.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.142+0000 7f44060ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:22:45.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.142+0000 7f44060ee9c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:45.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.142+0000 7f44060ee9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:22:45.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.142+0000 7f44060ee9c0 20 searching for the correct realm 2024-09-19T14:22:45.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.150+0000 7f44033f3640 0 -- 172.21.15.153:0/2708722280 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x5593122d6360 msgr2=0x5593122d87e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:22:45.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.154+0000 7f4403bf4640 0 -- 172.21.15.153:0/2708722280 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f43f804ec80 msgr2=0x7f43f8001000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:22:45.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.162+0000 7f44060ee9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:22:45.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.162+0000 7f44060ee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:22:45.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.162+0000 7f44060ee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:22:45.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.162+0000 7f44060ee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:22:45.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.162+0000 7f44060ee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:22:45.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.162+0000 7f44060ee9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:22:45.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.162+0000 7f44060ee9c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:45.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.162+0000 7f44060ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:45.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.162+0000 7f44060ee9c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:45.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.162+0000 7f44060ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:22:45.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.162+0000 7f44060ee9c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:45.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.166+0000 7f44060ee9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:22:45.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.166+0000 7f44060ee9c0 20 zone default found 2024-09-19T14:22:45.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.166+0000 7f44060ee9c0 4 Realm: () 2024-09-19T14:22:45.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.166+0000 7f44060ee9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:22:45.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.166+0000 7f44060ee9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:22:45.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.166+0000 7f44060ee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:22:45.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.166+0000 7f44060ee9c0 20 zonegroup default 2024-09-19T14:22:45.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.166+0000 7f44060ee9c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:45.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.166+0000 7f44060ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:45.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.166+0000 7f44060ee9c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:45.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.166+0000 7f44060ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:45.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.166+0000 7f44060ee9c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:45.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.166+0000 7f44060ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:45.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.166+0000 7f44060ee9c0 20 started sync module instance, tier type = 2024-09-19T14:22:45.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.166+0000 7f44060ee9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:22:45.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.182+0000 7f44060ee9c0 20 add_watcher() i=0 2024-09-19T14:22:45.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.182+0000 7f44060ee9c0 20 add_watcher() i=1 2024-09-19T14:22:45.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.182+0000 7f44060ee9c0 20 add_watcher() i=2 2024-09-19T14:22:45.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.182+0000 7f44060ee9c0 20 add_watcher() i=3 2024-09-19T14:22:45.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.182+0000 7f44060ee9c0 20 add_watcher() i=4 2024-09-19T14:22:45.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.182+0000 7f44060ee9c0 20 add_watcher() i=5 2024-09-19T14:22:45.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.182+0000 7f44060ee9c0 20 add_watcher() i=6 2024-09-19T14:22:45.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.182+0000 7f44060ee9c0 20 add_watcher() i=7 2024-09-19T14:22:45.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.182+0000 7f44060ee9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:22:45.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.186+0000 7f42b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:22:45.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.186+0000 7f44060ee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:22:45.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.186+0000 7f44060ee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:22:45.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.266+0000 7f42b8fe1640 20 reqs_thread_entry: start 2024-09-19T14:22:45.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.266+0000 7f44060ee9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:22:45.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.266+0000 7f44060ee9c0 20 Filter name: none 2024-09-19T14:22:45.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.266+0000 7f42327fc640 20 reqs_thread_entry: start 2024-09-19T14:22:45.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.266+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:22:45.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.270+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.270+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.270+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:22:45.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.270+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17385202118782546472', time=2024-09-19T16:18:03.091499+0000, chain.objs.size()=1 2024-09-19T14:22:45.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.270+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.53__shadow_.6D4C-ngNGbnr5RCJ6j3xqqMIGPHTjzu_0 2024-09-19T14:22:45.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.274+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:45.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.278+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:22:45.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.282+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.282+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.282+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-19T14:22:45.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.282+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4682357228216881893', time=2024-09-19T16:16:38.266912+0000, chain.objs.size()=5 2024-09-19T14:22:45.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.282+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__multipart_key1.2~XbL0qt5jEKDz_1kwibztn6Rio0QPsnT.1 2024-09-19T14:22:45.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.282+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__shadow_key1.2~XbL0qt5jEKDz_1kwibztn6Rio0QPsnT.1_1 2024-09-19T14:22:45.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.282+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__multipart_key1.2~XbL0qt5jEKDz_1kwibztn6Rio0QPsnT.2 2024-09-19T14:22:45.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.282+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__shadow_key1.2~XbL0qt5jEKDz_1kwibztn6Rio0QPsnT.2_1 2024-09-19T14:22:45.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.286+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__multipart_key1.2~XbL0qt5jEKDz_1kwibztn6Rio0QPsnT.3 2024-09-19T14:22:45.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.286+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85', time=2024-09-19T16:21:59.788596+0000, chain.objs.size()=56 2024-09-19T14:22:45.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.286+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.1 2024-09-19T14:22:45.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.286+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.2 2024-09-19T14:22:45.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.286+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.3 2024-09-19T14:22:45.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.286+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.4 2024-09-19T14:22:45.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.286+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.5 2024-09-19T14:22:45.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.286+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.6 2024-09-19T14:22:45.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.286+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.7 2024-09-19T14:22:45.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.290+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.8 2024-09-19T14:22:45.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.290+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.9 2024-09-19T14:22:45.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.290+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.10 2024-09-19T14:22:45.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.294+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.11 2024-09-19T14:22:45.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.294+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.12 2024-09-19T14:22:45.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.302+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.13 2024-09-19T14:22:45.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.302+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.14 2024-09-19T14:22:45.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.302+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.15 2024-09-19T14:22:45.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.302+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.16 2024-09-19T14:22:45.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.302+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.17 2024-09-19T14:22:45.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.302+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.18 2024-09-19T14:22:45.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.302+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.19 2024-09-19T14:22:45.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.302+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.20 2024-09-19T14:22:45.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.302+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.21 2024-09-19T14:22:45.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.302+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.22 2024-09-19T14:22:45.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.302+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.23 2024-09-19T14:22:45.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.306+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.24 2024-09-19T14:22:45.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.310+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.25 2024-09-19T14:22:45.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.310+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.26 2024-09-19T14:22:45.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.314+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.27 2024-09-19T14:22:45.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.314+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.28 2024-09-19T14:22:45.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.314+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.29 2024-09-19T14:22:45.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.314+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.30 2024-09-19T14:22:45.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.314+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.31 2024-09-19T14:22:45.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.314+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.32 2024-09-19T14:22:45.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.314+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.33 2024-09-19T14:22:45.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.314+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.34 2024-09-19T14:22:45.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.318+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.35 2024-09-19T14:22:45.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.318+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.36 2024-09-19T14:22:45.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.318+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.37 2024-09-19T14:22:45.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.318+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.38 2024-09-19T14:22:45.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.318+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.39 2024-09-19T14:22:45.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.322+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.40 2024-09-19T14:22:45.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.322+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.41 2024-09-19T14:22:45.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.322+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.42 2024-09-19T14:22:45.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.322+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.43 2024-09-19T14:22:45.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.326+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.44 2024-09-19T14:22:45.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.326+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.45 2024-09-19T14:22:45.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.326+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.46 2024-09-19T14:22:45.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.326+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.47 2024-09-19T14:22:45.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.330+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.48 2024-09-19T14:22:45.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.330+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.49 2024-09-19T14:22:45.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.330+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.50 2024-09-19T14:22:45.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.330+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.51 2024-09-19T14:22:45.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.330+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.52 2024-09-19T14:22:45.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.334+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.53 2024-09-19T14:22:45.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.334+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.55 2024-09-19T14:22:45.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.334+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.56 2024-09-19T14:22:45.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.334+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.60 2024-09-19T14:22:45.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.334+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85', time=2024-09-19T16:22:01.608198+0000, chain.objs.size()=4 2024-09-19T14:22:45.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.334+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.54 2024-09-19T14:22:45.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.334+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.57 2024-09-19T14:22:45.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.338+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.58 2024-09-19T14:22:45.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.338+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.59 2024-09-19T14:22:45.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.338+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85', time=2024-09-19T16:22:03.308409+0000, chain.objs.size()=9 2024-09-19T14:22:45.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.338+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.61 2024-09-19T14:22:45.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.338+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.62 2024-09-19T14:22:45.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.342+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.63 2024-09-19T14:22:45.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.342+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.64 2024-09-19T14:22:45.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.342+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.65 2024-09-19T14:22:45.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.342+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.66 2024-09-19T14:22:45.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.342+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.67 2024-09-19T14:22:45.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.342+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.68 2024-09-19T14:22:45.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.342+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.69 2024-09-19T14:22:45.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.354+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85', time=2024-09-19T16:22:05.373190+0000, chain.objs.size()=7 2024-09-19T14:22:45.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.354+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.70 2024-09-19T14:22:45.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.354+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.71 2024-09-19T14:22:45.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.354+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.72 2024-09-19T14:22:45.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.354+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.73 2024-09-19T14:22:45.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.354+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.74 2024-09-19T14:22:45.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.354+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.75 2024-09-19T14:22:45.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.354+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.76 2024-09-19T14:22:45.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.354+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85', time=2024-09-19T16:22:06.969358+0000, chain.objs.size()=8 2024-09-19T14:22:45.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.354+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.77 2024-09-19T14:22:45.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.354+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.78 2024-09-19T14:22:45.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.354+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.79 2024-09-19T14:22:45.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.354+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.80 2024-09-19T14:22:45.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.358+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.81 2024-09-19T14:22:45.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.358+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.82 2024-09-19T14:22:45.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.358+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.83 2024-09-19T14:22:45.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.358+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.84 2024-09-19T14:22:45.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.358+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85', time=2024-09-19T16:22:07.838772+0000, chain.objs.size()=4 2024-09-19T14:22:45.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.358+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.85 2024-09-19T14:22:45.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.358+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.86 2024-09-19T14:22:45.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.358+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.87 2024-09-19T14:22:45.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.362+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.89 2024-09-19T14:22:45.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.362+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85', time=2024-09-19T16:22:08.101062+0000, chain.objs.size()=4 2024-09-19T14:22:45.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.362+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.88 2024-09-19T14:22:45.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.362+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.90 2024-09-19T14:22:45.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.362+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.91 2024-09-19T14:22:45.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.366+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.58__multipart_key1.2~UJaqqYi2iE-jMv8NuYHdufWKFBtNb85.92 2024-09-19T14:22:45.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.370+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:45.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.374+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:22:45.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.378+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.378+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.378+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.378+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:22:45.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.382+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.382+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.382+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.382+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:22:45.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.386+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.386+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.386+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:22:45.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.386+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14711864240837127766', time=2024-09-19T16:16:59.565703+0000, chain.objs.size()=5 2024-09-19T14:22:45.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.386+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.51__multipart_key1.2~NEz3UwLYPfH3LA59bujBdE1SwARI82K.1 2024-09-19T14:22:45.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.386+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.51__multipart_key1.2~NEz3UwLYPfH3LA59bujBdE1SwARI82K.2 2024-09-19T14:22:45.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.386+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.51__multipart_key1.2~NEz3UwLYPfH3LA59bujBdE1SwARI82K.3 2024-09-19T14:22:45.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.386+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.51__multipart_key1.2~NEz3UwLYPfH3LA59bujBdE1SwARI82K.4 2024-09-19T14:22:45.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.386+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.51__multipart_key1.2~NEz3UwLYPfH3LA59bujBdE1SwARI82K.5 2024-09-19T14:22:45.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.390+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:45.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.394+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:22:45.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.398+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.398+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.398+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.398+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:22:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.402+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.402+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.402+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:22:45.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.402+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15805116494547897274', time=2024-09-19T16:21:03.010943+0000, chain.objs.size()=11 2024-09-19T14:22:45.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.402+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~J98yNVNz69_kQKShsZFesciqOibGTMb.1 2024-09-19T14:22:45.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.402+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__shadow_key1.2~J98yNVNz69_kQKShsZFesciqOibGTMb.1_1 2024-09-19T14:22:45.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.402+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~J98yNVNz69_kQKShsZFesciqOibGTMb.2 2024-09-19T14:22:45.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.402+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__shadow_key1.2~J98yNVNz69_kQKShsZFesciqOibGTMb.2_1 2024-09-19T14:22:45.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.402+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~J98yNVNz69_kQKShsZFesciqOibGTMb.3 2024-09-19T14:22:45.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.402+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__shadow_key1.2~J98yNVNz69_kQKShsZFesciqOibGTMb.3_1 2024-09-19T14:22:45.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.402+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~J98yNVNz69_kQKShsZFesciqOibGTMb.4 2024-09-19T14:22:45.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.402+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__shadow_key1.2~J98yNVNz69_kQKShsZFesciqOibGTMb.4_1 2024-09-19T14:22:45.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.402+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~J98yNVNz69_kQKShsZFesciqOibGTMb.5 2024-09-19T14:22:45.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.402+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__shadow_key1.2~J98yNVNz69_kQKShsZFesciqOibGTMb.5_1 2024-09-19T14:22:45.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.402+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~J98yNVNz69_kQKShsZFesciqOibGTMb.6 2024-09-19T14:22:45.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.410+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:45.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.414+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:22:45.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.418+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.418+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.418+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:22:45.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.418+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5975398623881489642', time=2024-09-19T16:19:01.130556+0000, chain.objs.size()=11 2024-09-19T14:22:45.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.418+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~e13VicJiSIQbstHZ8jT-QrGjClapqLi.1 2024-09-19T14:22:45.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.418+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~e13VicJiSIQbstHZ8jT-QrGjClapqLi.2 2024-09-19T14:22:45.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.418+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~e13VicJiSIQbstHZ8jT-QrGjClapqLi.3 2024-09-19T14:22:45.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.418+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~e13VicJiSIQbstHZ8jT-QrGjClapqLi.4 2024-09-19T14:22:45.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.418+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~e13VicJiSIQbstHZ8jT-QrGjClapqLi.5 2024-09-19T14:22:45.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.418+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~e13VicJiSIQbstHZ8jT-QrGjClapqLi.6 2024-09-19T14:22:45.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.418+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~e13VicJiSIQbstHZ8jT-QrGjClapqLi.7 2024-09-19T14:22:45.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.418+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~e13VicJiSIQbstHZ8jT-QrGjClapqLi.8 2024-09-19T14:22:45.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.418+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~e13VicJiSIQbstHZ8jT-QrGjClapqLi.9 2024-09-19T14:22:45.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.418+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~e13VicJiSIQbstHZ8jT-QrGjClapqLi.10 2024-09-19T14:22:45.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.418+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~e13VicJiSIQbstHZ8jT-QrGjClapqLi.11 2024-09-19T14:22:45.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.426+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:45.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.430+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:22:45.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.434+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.434+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.434+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:22:45.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.434+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16792886740809031419', time=2024-09-19T16:16:43.123437+0000, chain.objs.size()=5 2024-09-19T14:22:45.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.434+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__multipart_key1.2~h3kcipy364mYDwO31d1Xwt1Sxetg3lH.1 2024-09-19T14:22:45.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.434+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__shadow_key1.2~h3kcipy364mYDwO31d1Xwt1Sxetg3lH.1_1 2024-09-19T14:22:45.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.434+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__multipart_key1.2~h3kcipy364mYDwO31d1Xwt1Sxetg3lH.2 2024-09-19T14:22:45.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.434+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__shadow_key1.2~h3kcipy364mYDwO31d1Xwt1Sxetg3lH.2_1 2024-09-19T14:22:45.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.434+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__multipart_key1.2~h3kcipy364mYDwO31d1Xwt1Sxetg3lH.3 2024-09-19T14:22:45.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.434+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11486302735302718272', time=2024-09-19T16:22:08.915845+0000, chain.objs.size()=1 2024-09-19T14:22:45.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.434+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.59__shadow_.zD6WOc7mpgX8nDk3gvWMYduRLhaEetV_0 2024-09-19T14:22:45.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.438+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:45.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.442+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:22:45.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.446+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.446+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.446+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:22:45.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.446+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4879430374807632102', time=2024-09-19T16:15:59.301526+0000, chain.objs.size()=5 2024-09-19T14:22:45.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.446+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.44__multipart_key1.2~v0sabLYyfQo801_lrlegFEHuNGp0Vu7.1 2024-09-19T14:22:45.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.446+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.44__multipart_key1.2~v0sabLYyfQo801_lrlegFEHuNGp0Vu7.2 2024-09-19T14:22:45.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.446+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.44__multipart_key1.2~v0sabLYyfQo801_lrlegFEHuNGp0Vu7.3 2024-09-19T14:22:45.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.446+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.44__multipart_key1.2~v0sabLYyfQo801_lrlegFEHuNGp0Vu7.4 2024-09-19T14:22:45.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.446+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.44__multipart_key1.2~v0sabLYyfQo801_lrlegFEHuNGp0Vu7.5 2024-09-19T14:22:45.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.450+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:45.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.454+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:22:45.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.454+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.454+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.454+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:22:45.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.454+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13855972897205497114', time=2024-09-19T16:21:02.664571+0000, chain.objs.size()=11 2024-09-19T14:22:45.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.454+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~vwCC-nVKvFqkbJYQKQCje30xsDCPQgv.1 2024-09-19T14:22:45.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.454+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__shadow_key1.2~vwCC-nVKvFqkbJYQKQCje30xsDCPQgv.1_1 2024-09-19T14:22:45.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.454+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~vwCC-nVKvFqkbJYQKQCje30xsDCPQgv.2 2024-09-19T14:22:45.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.454+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__shadow_key1.2~vwCC-nVKvFqkbJYQKQCje30xsDCPQgv.2_1 2024-09-19T14:22:45.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.454+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~vwCC-nVKvFqkbJYQKQCje30xsDCPQgv.3 2024-09-19T14:22:45.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.454+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__shadow_key1.2~vwCC-nVKvFqkbJYQKQCje30xsDCPQgv.3_1 2024-09-19T14:22:45.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.454+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~vwCC-nVKvFqkbJYQKQCje30xsDCPQgv.4 2024-09-19T14:22:45.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.454+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__shadow_key1.2~vwCC-nVKvFqkbJYQKQCje30xsDCPQgv.4_1 2024-09-19T14:22:45.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.454+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~vwCC-nVKvFqkbJYQKQCje30xsDCPQgv.5 2024-09-19T14:22:45.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.454+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__shadow_key1.2~vwCC-nVKvFqkbJYQKQCje30xsDCPQgv.5_1 2024-09-19T14:22:45.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.454+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~vwCC-nVKvFqkbJYQKQCje30xsDCPQgv.6 2024-09-19T14:22:45.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.462+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:45.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.470+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:22:45.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.470+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.470+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.470+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:22:45.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.470+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17564061991905226535', time=2024-09-19T16:21:41.532933+0000, chain.objs.size()=5 2024-09-19T14:22:45.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.470+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.57__multipart_key1.2~w_RjyidZoBiSVdmMeJ8umjr75ZFJSUb.1 2024-09-19T14:22:45.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.470+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.57__multipart_key1.2~w_RjyidZoBiSVdmMeJ8umjr75ZFJSUb.2 2024-09-19T14:22:45.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.470+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.57__multipart_key1.2~w_RjyidZoBiSVdmMeJ8umjr75ZFJSUb.3 2024-09-19T14:22:45.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.470+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.57__multipart_key1.2~w_RjyidZoBiSVdmMeJ8umjr75ZFJSUb.4 2024-09-19T14:22:45.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.470+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.57__multipart_key1.2~w_RjyidZoBiSVdmMeJ8umjr75ZFJSUb.5 2024-09-19T14:22:45.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.474+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:45.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.478+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:22:45.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.482+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.482+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.482+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:22:45.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.482+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16752108419497146270', time=2024-09-19T16:16:32.866747+0000, chain.objs.size()=5 2024-09-19T14:22:45.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.482+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__multipart_key1.2~t3lxbchLxATDEfyX8UHJ0ZdZXzF8h0l.1 2024-09-19T14:22:45.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.482+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__multipart_key1.2~t3lxbchLxATDEfyX8UHJ0ZdZXzF8h0l.2 2024-09-19T14:22:45.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.482+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__multipart_key1.2~t3lxbchLxATDEfyX8UHJ0ZdZXzF8h0l.3 2024-09-19T14:22:45.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.482+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__multipart_key1.2~t3lxbchLxATDEfyX8UHJ0ZdZXzF8h0l.4 2024-09-19T14:22:45.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.482+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__multipart_key1.2~t3lxbchLxATDEfyX8UHJ0ZdZXzF8h0l.5 2024-09-19T14:22:45.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.482+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8096681727903552851', time=2024-09-19T16:22:43.962727+0000, chain.objs.size()=11 2024-09-19T14:22:45.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.482+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.66__multipart_key1.2~KrUJXKJOfySBgLZI2J9R8KTdf61OpVp.1 2024-09-19T14:22:45.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.482+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.66__multipart_key1.2~KrUJXKJOfySBgLZI2J9R8KTdf61OpVp.2 2024-09-19T14:22:45.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.482+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.66__multipart_key1.2~KrUJXKJOfySBgLZI2J9R8KTdf61OpVp.3 2024-09-19T14:22:45.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.482+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.66__multipart_key1.2~KrUJXKJOfySBgLZI2J9R8KTdf61OpVp.4 2024-09-19T14:22:45.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.482+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.66__multipart_key1.2~KrUJXKJOfySBgLZI2J9R8KTdf61OpVp.5 2024-09-19T14:22:45.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.482+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.66__multipart_key1.2~KrUJXKJOfySBgLZI2J9R8KTdf61OpVp.6 2024-09-19T14:22:45.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.482+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.66__multipart_key1.2~KrUJXKJOfySBgLZI2J9R8KTdf61OpVp.7 2024-09-19T14:22:45.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.486+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.66__multipart_key1.2~KrUJXKJOfySBgLZI2J9R8KTdf61OpVp.8 2024-09-19T14:22:45.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.490+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.66__multipart_key1.2~KrUJXKJOfySBgLZI2J9R8KTdf61OpVp.9 2024-09-19T14:22:45.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.490+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.66__multipart_key1.2~KrUJXKJOfySBgLZI2J9R8KTdf61OpVp.10 2024-09-19T14:22:45.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.490+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.66__multipart_key1.2~KrUJXKJOfySBgLZI2J9R8KTdf61OpVp.11 2024-09-19T14:22:45.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.494+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:45.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.498+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:22:45.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.498+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.498+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.498+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.502+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:22:45.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.502+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.502+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.502+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:22:45.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.502+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1181395814951940559', time=2024-09-19T16:15:35.532900+0000, chain.objs.size()=5 2024-09-19T14:22:45.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.502+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.42__multipart_key1.2~FhUKxqaRyLjL8KS-bkoZiu8Z-A2jKIL.1 2024-09-19T14:22:45.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.502+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.42__multipart_key1.2~FhUKxqaRyLjL8KS-bkoZiu8Z-A2jKIL.2 2024-09-19T14:22:45.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.502+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.42__multipart_key1.2~FhUKxqaRyLjL8KS-bkoZiu8Z-A2jKIL.3 2024-09-19T14:22:45.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.502+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.42__multipart_key1.2~FhUKxqaRyLjL8KS-bkoZiu8Z-A2jKIL.4 2024-09-19T14:22:45.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.502+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.42__multipart_key1.2~FhUKxqaRyLjL8KS-bkoZiu8Z-A2jKIL.5 2024-09-19T14:22:45.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.502+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4239843211829561606', time=2024-09-19T16:19:50.914326+0000, chain.objs.size()=10 2024-09-19T14:22:45.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.502+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~hbzglLJlHHKqSIVzQMfjri6dpt6wvGu.1 2024-09-19T14:22:45.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.502+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~hbzglLJlHHKqSIVzQMfjri6dpt6wvGu.2 2024-09-19T14:22:45.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.502+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~hbzglLJlHHKqSIVzQMfjri6dpt6wvGu.3 2024-09-19T14:22:45.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.502+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~hbzglLJlHHKqSIVzQMfjri6dpt6wvGu.4 2024-09-19T14:22:45.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.502+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~hbzglLJlHHKqSIVzQMfjri6dpt6wvGu.5 2024-09-19T14:22:45.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.502+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~hbzglLJlHHKqSIVzQMfjri6dpt6wvGu.6 2024-09-19T14:22:45.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.502+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~hbzglLJlHHKqSIVzQMfjri6dpt6wvGu.7 2024-09-19T14:22:45.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.506+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~hbzglLJlHHKqSIVzQMfjri6dpt6wvGu.8 2024-09-19T14:22:45.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.506+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~hbzglLJlHHKqSIVzQMfjri6dpt6wvGu.9 2024-09-19T14:22:45.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.506+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~hbzglLJlHHKqSIVzQMfjri6dpt6wvGu.10 2024-09-19T14:22:45.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.514+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:45.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.518+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:22:45.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.518+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.518+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.518+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.522+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:22:45.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.522+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.522+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.522+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-19T14:22:45.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.522+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11865234913346484603', time=2024-09-19T16:16:28.482766+0000, chain.objs.size()=5 2024-09-19T14:22:45.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.522+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__multipart_key1.2~gWy9Rdnoc5djlnCdBrahC9EhYdEsKmc.1 2024-09-19T14:22:45.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.522+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__multipart_key1.2~gWy9Rdnoc5djlnCdBrahC9EhYdEsKmc.2 2024-09-19T14:22:45.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.522+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__multipart_key1.2~gWy9Rdnoc5djlnCdBrahC9EhYdEsKmc.3 2024-09-19T14:22:45.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.522+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__multipart_key1.2~gWy9Rdnoc5djlnCdBrahC9EhYdEsKmc.4 2024-09-19T14:22:45.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.522+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__multipart_key1.2~gWy9Rdnoc5djlnCdBrahC9EhYdEsKmc.5 2024-09-19T14:22:45.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.522+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~eEW6vJ3FYGyfdgjdW9QTnYSerg2-c-e', time=2024-09-19T16:18:10.208825+0000, chain.objs.size()=3 2024-09-19T14:22:45.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.522+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.54__multipart_key1.2~eEW6vJ3FYGyfdgjdW9QTnYSerg2-c-e.7 2024-09-19T14:22:45.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.522+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.54__multipart_key1.2~eEW6vJ3FYGyfdgjdW9QTnYSerg2-c-e.10 2024-09-19T14:22:45.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.522+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.54__multipart_key1.2~eEW6vJ3FYGyfdgjdW9QTnYSerg2-c-e.13 2024-09-19T14:22:45.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.522+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13101228401858745022', time=2024-09-19T16:20:16.288482+0000, chain.objs.size()=11 2024-09-19T14:22:45.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.522+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~rucYWXOW85tvBOXC_v-vwxTNDoxkWiK.1 2024-09-19T14:22:45.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.522+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__shadow_key1.2~rucYWXOW85tvBOXC_v-vwxTNDoxkWiK.1_1 2024-09-19T14:22:45.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.522+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~rucYWXOW85tvBOXC_v-vwxTNDoxkWiK.2 2024-09-19T14:22:45.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.522+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__shadow_key1.2~rucYWXOW85tvBOXC_v-vwxTNDoxkWiK.2_1 2024-09-19T14:22:45.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.526+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~rucYWXOW85tvBOXC_v-vwxTNDoxkWiK.3 2024-09-19T14:22:45.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.526+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__shadow_key1.2~rucYWXOW85tvBOXC_v-vwxTNDoxkWiK.3_1 2024-09-19T14:22:45.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.526+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~rucYWXOW85tvBOXC_v-vwxTNDoxkWiK.4 2024-09-19T14:22:45.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.530+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__shadow_key1.2~rucYWXOW85tvBOXC_v-vwxTNDoxkWiK.4_1 2024-09-19T14:22:45.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.530+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~rucYWXOW85tvBOXC_v-vwxTNDoxkWiK.5 2024-09-19T14:22:45.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.530+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__shadow_key1.2~rucYWXOW85tvBOXC_v-vwxTNDoxkWiK.5_1 2024-09-19T14:22:45.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.530+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~rucYWXOW85tvBOXC_v-vwxTNDoxkWiK.6 2024-09-19T14:22:45.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.530+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7136153570723124917', time=2024-09-19T16:22:13.566025+0000, chain.objs.size()=1 2024-09-19T14:22:45.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.530+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.63__shadow_.eLqYJ6z8Lt5xxCkOp4gpHFD2ZOZ8CGt_0 2024-09-19T14:22:45.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.534+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:45.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.538+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:22:45.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.538+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.538+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.542+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:22:45.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.542+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15393893060865553131', time=2024-09-19T16:22:10.060330+0000, chain.objs.size()=1 2024-09-19T14:22:45.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.542+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.60__shadow_.mdYN31trJ0u-3SKFsA3vSi7WpgX6MV4_0 2024-09-19T14:22:45.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.542+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:45.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.546+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:22:45.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.546+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.546+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.546+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:22:45.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.546+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14664680883458742311', time=2024-09-19T16:17:30.751527+0000, chain.objs.size()=5 2024-09-19T14:22:45.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.546+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.52__multipart_key1.2~9VF1-F5miLN-dYLRlnG0yDfuMytWQnN.1 2024-09-19T14:22:45.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.546+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.52__multipart_key1.2~9VF1-F5miLN-dYLRlnG0yDfuMytWQnN.2 2024-09-19T14:22:45.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.546+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.52__multipart_key1.2~9VF1-F5miLN-dYLRlnG0yDfuMytWQnN.3 2024-09-19T14:22:45.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.546+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.52__multipart_key1.2~9VF1-F5miLN-dYLRlnG0yDfuMytWQnN.4 2024-09-19T14:22:45.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.546+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.52__multipart_key1.2~9VF1-F5miLN-dYLRlnG0yDfuMytWQnN.5 2024-09-19T14:22:45.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.550+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:45.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.554+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:22:45.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.558+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.558+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.558+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:22:45.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.558+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14499915959907665873', time=2024-09-19T16:16:22.711958+0000, chain.objs.size()=5 2024-09-19T14:22:45.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.558+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__multipart_key1.2~FHqqMx0Z-qt0QbyUOqS-npFgVR3SbS1.1 2024-09-19T14:22:45.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.558+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__multipart_key1.2~FHqqMx0Z-qt0QbyUOqS-npFgVR3SbS1.2 2024-09-19T14:22:45.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.558+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__multipart_key1.2~FHqqMx0Z-qt0QbyUOqS-npFgVR3SbS1.3 2024-09-19T14:22:45.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.558+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__multipart_key1.2~FHqqMx0Z-qt0QbyUOqS-npFgVR3SbS1.4 2024-09-19T14:22:45.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.558+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__multipart_key1.2~FHqqMx0Z-qt0QbyUOqS-npFgVR3SbS1.5 2024-09-19T14:22:45.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.558+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17720177642631279187', time=2024-09-19T16:22:14.727973+0000, chain.objs.size()=1 2024-09-19T14:22:45.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.558+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.64__shadow_.uUhcx_ndcSKz5rCg52emcTHCIpUU6fE_0 2024-09-19T14:22:45.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.562+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:45.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.566+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:22:45.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.566+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.566+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.566+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:22:45.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.566+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6146173705410752846', time=2024-09-19T16:18:03.173266+0000, chain.objs.size()=5 2024-09-19T14:22:45.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.566+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.53__multipart_file2.mpg.2~XsxepnzkbZe8h2femmbX1ISxgdQfaPn.1 2024-09-19T14:22:45.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.566+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.53__multipart_file2.mpg.2~XsxepnzkbZe8h2femmbX1ISxgdQfaPn.2 2024-09-19T14:22:45.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.566+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.53__multipart_file2.mpg.2~XsxepnzkbZe8h2femmbX1ISxgdQfaPn.3 2024-09-19T14:22:45.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.566+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.53__multipart_file2.mpg.2~XsxepnzkbZe8h2femmbX1ISxgdQfaPn.4 2024-09-19T14:22:45.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.566+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.53__multipart_file2.mpg.2~XsxepnzkbZe8h2femmbX1ISxgdQfaPn.5 2024-09-19T14:22:45.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.566+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8174315303814561553', time=2024-09-19T16:21:20.048099+0000, chain.objs.size()=5 2024-09-19T14:22:45.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.566+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.56__multipart_key1.2~yurpc-RbEyygrbYXNt9SnQy0qeIhF0w.1 2024-09-19T14:22:45.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.566+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.56__multipart_key1.2~yurpc-RbEyygrbYXNt9SnQy0qeIhF0w.2 2024-09-19T14:22:45.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.566+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.56__multipart_key1.2~yurpc-RbEyygrbYXNt9SnQy0qeIhF0w.3 2024-09-19T14:22:45.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.566+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.56__multipart_key1.2~yurpc-RbEyygrbYXNt9SnQy0qeIhF0w.4 2024-09-19T14:22:45.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.566+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.56__multipart_key1.2~yurpc-RbEyygrbYXNt9SnQy0qeIhF0w.5 2024-09-19T14:22:45.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.574+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:45.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.574+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:22:45.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.578+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.578+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.578+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.578+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:22:45.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.582+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.582+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.582+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.582+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:22:45.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.582+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.586+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.586+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-19T14:22:45.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.586+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12537597732902830661', time=2024-09-19T16:16:42.770730+0000, chain.objs.size()=5 2024-09-19T14:22:45.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.586+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__multipart_key1.2~Vf3EgWhtr97F8Gge0BKw6SlyqZaokuE.1 2024-09-19T14:22:45.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.586+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__shadow_key1.2~Vf3EgWhtr97F8Gge0BKw6SlyqZaokuE.1_1 2024-09-19T14:22:45.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.586+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__multipart_key1.2~Vf3EgWhtr97F8Gge0BKw6SlyqZaokuE.2 2024-09-19T14:22:45.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.586+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__shadow_key1.2~Vf3EgWhtr97F8Gge0BKw6SlyqZaokuE.2_1 2024-09-19T14:22:45.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.586+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.47__multipart_key1.2~Vf3EgWhtr97F8Gge0BKw6SlyqZaokuE.3 2024-09-19T14:22:45.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.586+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13610776266930464438', time=2024-09-19T16:16:43.787801+0000, chain.objs.size()=4 2024-09-19T14:22:45.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.586+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.46__shadow_.xj3Ans-Nm9vFEKuE-tCJCpkCVq9c6vA_0 2024-09-19T14:22:45.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.586+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.46__shadow_.xj3Ans-Nm9vFEKuE-tCJCpkCVq9c6vA_1 2024-09-19T14:22:45.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.586+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.46__shadow_.xj3Ans-Nm9vFEKuE-tCJCpkCVq9c6vA_2 2024-09-19T14:22:45.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.586+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.46__shadow_.xj3Ans-Nm9vFEKuE-tCJCpkCVq9c6vA_3 2024-09-19T14:22:45.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.586+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4231767540670568638', time=2024-09-19T16:21:16.062329+0000, chain.objs.size()=1 2024-09-19T14:22:45.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.586+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.56__shadow_.iykun7LH2R3ftvoyrLSwlXoXhPgAi5z_0 2024-09-19T14:22:45.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.590+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:45.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.594+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:22:45.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.594+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.594+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.594+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.598+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:22:45.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.598+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.598+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.598+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-19T14:22:45.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.598+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12626781135338399260', time=2024-09-19T16:18:03.241613+0000, chain.objs.size()=1 2024-09-19T14:22:45.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.598+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.53__shadow_.5Fjfv_TKxepseDulQDGL-WjnQVMwC7A_0 2024-09-19T14:22:45.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.598+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16308061455008877417', time=2024-09-19T16:19:26.555533+0000, chain.objs.size()=11 2024-09-19T14:22:45.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.598+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~j747uZDv_-w-wHhBIvC7aVMpLTpmeiA.1 2024-09-19T14:22:45.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.598+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~j747uZDv_-w-wHhBIvC7aVMpLTpmeiA.2 2024-09-19T14:22:45.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.598+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~j747uZDv_-w-wHhBIvC7aVMpLTpmeiA.3 2024-09-19T14:22:45.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.598+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~j747uZDv_-w-wHhBIvC7aVMpLTpmeiA.4 2024-09-19T14:22:45.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.598+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~j747uZDv_-w-wHhBIvC7aVMpLTpmeiA.5 2024-09-19T14:22:45.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.602+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~j747uZDv_-w-wHhBIvC7aVMpLTpmeiA.6 2024-09-19T14:22:45.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.602+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~j747uZDv_-w-wHhBIvC7aVMpLTpmeiA.7 2024-09-19T14:22:45.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.602+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~j747uZDv_-w-wHhBIvC7aVMpLTpmeiA.8 2024-09-19T14:22:45.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.602+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~j747uZDv_-w-wHhBIvC7aVMpLTpmeiA.9 2024-09-19T14:22:45.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.602+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~j747uZDv_-w-wHhBIvC7aVMpLTpmeiA.10 2024-09-19T14:22:45.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.602+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.55__multipart_key1.2~j747uZDv_-w-wHhBIvC7aVMpLTpmeiA.11 2024-09-19T14:22:45.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.602+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2600232631012414609', time=2024-09-19T16:22:12.411269+0000, chain.objs.size()=1 2024-09-19T14:22:45.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.602+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.62__shadow_.NgZlk4h4HGAw7LEwChY7M4ARyzlr-91_0 2024-09-19T14:22:45.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.610+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:45.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.610+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:22:45.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.614+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.614+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.614+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:22:45.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.614+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8631700949819837421', time=2024-09-19T16:18:03.338538+0000, chain.objs.size()=1 2024-09-19T14:22:45.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.614+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.53__shadow_.zbGUCEDQqUDC4HoOHQnfon9C9BX0JHJ_0 2024-09-19T14:22:45.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.614+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:45.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.618+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:22:45.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.618+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.618+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.622+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:22:45.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.622+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8177131454303793405', time=2024-09-19T16:16:00.005856+0000, chain.objs.size()=5 2024-09-19T14:22:45.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.622+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.44__multipart_key1.2~v0sabLYyfQo801_lrlegFEHuNGp0Vu7.1 2024-09-19T14:22:45.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.622+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.44__multipart_key1.2~v0sabLYyfQo801_lrlegFEHuNGp0Vu7.2 2024-09-19T14:22:45.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.622+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.44__multipart_key1.2~v0sabLYyfQo801_lrlegFEHuNGp0Vu7.3 2024-09-19T14:22:45.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.622+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.44__multipart_key1.2~v0sabLYyfQo801_lrlegFEHuNGp0Vu7.4 2024-09-19T14:22:45.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.622+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.44__multipart_key1.2~v0sabLYyfQo801_lrlegFEHuNGp0Vu7.5 2024-09-19T14:22:45.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.622+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:45.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.626+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:22:45.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.626+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.626+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.630+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:22:45.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.630+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5150316904458329929', time=2024-09-19T16:18:02.996380+0000, chain.objs.size()=5 2024-09-19T14:22:45.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.630+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.53__multipart_file.mpg.2~M3bE2QyVmEKQIlPHqnjACpx57Vkow1m.1 2024-09-19T14:22:45.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.630+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.53__multipart_file.mpg.2~M3bE2QyVmEKQIlPHqnjACpx57Vkow1m.2 2024-09-19T14:22:45.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.630+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.53__multipart_file.mpg.2~M3bE2QyVmEKQIlPHqnjACpx57Vkow1m.3 2024-09-19T14:22:45.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.630+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.53__multipart_file.mpg.2~M3bE2QyVmEKQIlPHqnjACpx57Vkow1m.4 2024-09-19T14:22:45.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.630+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.53__multipart_file.mpg.2~M3bE2QyVmEKQIlPHqnjACpx57Vkow1m.5 2024-09-19T14:22:45.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.630+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:45.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.634+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:22:45.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.634+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.634+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.638+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:22:45.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.638+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8886347149028744286', time=2024-09-19T16:22:11.238512+0000, chain.objs.size()=1 2024-09-19T14:22:45.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.638+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.61__shadow_.L1umg9IyvdGpbxFGaoeboeKxeHi8BGT_0 2024-09-19T14:22:45.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.638+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:45.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.642+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:22:45.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.642+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.642+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.646+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.646+0000 7f44060ee9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:22:45.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.646+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.646+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.650+0000 7f44060ee9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:22:45.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.650+0000 7f44060ee9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~J8QSMSE_gd_9rM4FRtP98MB2APXLTVY', time=2024-09-19T16:15:12.544940+0000, chain.objs.size()=5 2024-09-19T14:22:45.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.650+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.40__multipart_key1.2~J8QSMSE_gd_9rM4FRtP98MB2APXLTVY.1 2024-09-19T14:22:45.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.650+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.40__multipart_key1.2~J8QSMSE_gd_9rM4FRtP98MB2APXLTVY.2 2024-09-19T14:22:45.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.650+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.40__multipart_key1.2~J8QSMSE_gd_9rM4FRtP98MB2APXLTVY.3 2024-09-19T14:22:45.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.650+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.40__multipart_key1.2~J8QSMSE_gd_9rM4FRtP98MB2APXLTVY.4 2024-09-19T14:22:45.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.650+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.40__multipart_key1.2~J8QSMSE_gd_9rM4FRtP98MB2APXLTVY.5 2024-09-19T14:22:45.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.650+0000 7f44060ee9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:45.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.654+0000 7f42b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:22:45.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.658+0000 7f44060ee9c0 20 remove_watcher() i=0 2024-09-19T14:22:45.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.658+0000 7f44060ee9c0 2 removed watcher, disabling cache 2024-09-19T14:22:45.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.658+0000 7f44060ee9c0 20 remove_watcher() i=1 2024-09-19T14:22:45.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.662+0000 7f44060ee9c0 20 remove_watcher() i=2 2024-09-19T14:22:45.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.662+0000 7f44060ee9c0 20 remove_watcher() i=3 2024-09-19T14:22:45.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.662+0000 7f44060ee9c0 20 remove_watcher() i=4 2024-09-19T14:22:45.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.666+0000 7f44060ee9c0 20 remove_watcher() i=5 2024-09-19T14:22:45.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.666+0000 7f44060ee9c0 20 remove_watcher() i=6 2024-09-19T14:22:45.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.666+0000 7f44060ee9c0 20 remove_watcher() i=7 2024-09-19T14:22:45.684 DEBUG:teuthology.orchestra.run.smithi153:> radosgw-admin gc process --include-all 2024-09-19T14:22:45.761 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:22:45.761 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:22:45.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.802+0000 7f7d6c2309c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:45.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.806+0000 7f7d6c2309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:45.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.806+0000 7f7d6c2309c0 20 realm 2024-09-19T14:22:45.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.806+0000 7f7d6c2309c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:45.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.806+0000 7f7d6c2309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:45.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.806+0000 7f7d6c2309c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:22:45.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.806+0000 7f7d6c2309c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:45.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.806+0000 7f7d6c2309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:45.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.806+0000 7f7d6c2309c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:45.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.806+0000 7f7d6c2309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:22:45.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.806+0000 7f7d6c2309c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:45.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.806+0000 7f7d6c2309c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:22:45.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.806+0000 7f7d6c2309c0 20 searching for the correct realm 2024-09-19T14:22:45.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.814+0000 7f7d69535640 0 -- 172.21.15.153:0/2807842149 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f7d5c116b80 msgr2=0x7f7d5c12d710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:22:45.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.822+0000 7f7d69535640 0 -- 172.21.15.153:0/2807842149 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f7c34082340 msgr2=0x7f7c34084770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:22:45.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.826+0000 7f7d6c2309c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:22:45.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.826+0000 7f7d6c2309c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:22:45.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.826+0000 7f7d6c2309c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:22:45.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.826+0000 7f7d6c2309c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:22:45.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.826+0000 7f7d6c2309c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:22:45.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.826+0000 7f7d6c2309c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:22:45.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.826+0000 7f7d6c2309c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:45.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.826+0000 7f7d6c2309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:45.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.826+0000 7f7d6c2309c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:45.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.830+0000 7f7d6c2309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:22:45.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.830+0000 7f7d6c2309c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:45.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.830+0000 7f7d6c2309c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:22:45.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.830+0000 7f7d6c2309c0 20 zone default found 2024-09-19T14:22:45.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.830+0000 7f7d6c2309c0 4 Realm: () 2024-09-19T14:22:45.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.830+0000 7f7d6c2309c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:22:45.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.830+0000 7f7d6c2309c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:22:45.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.830+0000 7f7d6c2309c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:22:45.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.830+0000 7f7d6c2309c0 20 zonegroup default 2024-09-19T14:22:45.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.830+0000 7f7d6c2309c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:45.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.830+0000 7f7d6c2309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:45.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.830+0000 7f7d6c2309c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:45.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.830+0000 7f7d6c2309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:45.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.830+0000 7f7d6c2309c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:45.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.830+0000 7f7d6c2309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:45.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.830+0000 7f7d6c2309c0 20 started sync module instance, tier type = 2024-09-19T14:22:45.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.830+0000 7f7d6c2309c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:22:45.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.846+0000 7f7d6c2309c0 20 add_watcher() i=0 2024-09-19T14:22:45.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.846+0000 7f7d6c2309c0 20 add_watcher() i=1 2024-09-19T14:22:45.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.846+0000 7f7d6c2309c0 20 add_watcher() i=2 2024-09-19T14:22:45.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.846+0000 7f7d6c2309c0 20 add_watcher() i=3 2024-09-19T14:22:45.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.846+0000 7f7d6c2309c0 20 add_watcher() i=4 2024-09-19T14:22:45.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.846+0000 7f7d6c2309c0 20 add_watcher() i=5 2024-09-19T14:22:45.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.846+0000 7f7d6c2309c0 20 add_watcher() i=6 2024-09-19T14:22:45.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.846+0000 7f7d6c2309c0 20 add_watcher() i=7 2024-09-19T14:22:45.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.846+0000 7f7d6c2309c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:22:45.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.850+0000 7f7c1b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:22:45.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.850+0000 7f7d6c2309c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:22:45.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.850+0000 7f7d6c2309c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:22:45.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.922+0000 7f7c1a7fc640 20 reqs_thread_entry: start 2024-09-19T14:22:45.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.922+0000 7f7d6c2309c0 20 init_complete bucket index max shards: 11 2024-09-19T14:22:45.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.922+0000 7f7d6c2309c0 20 Filter name: none 2024-09-19T14:22:45.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.922+0000 7f7b8bfff640 20 reqs_thread_entry: start 2024-09-19T14:22:45.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.922+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:22:45.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.926+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.926+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.926+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.932 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.930+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:22:45.936 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.934+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.934+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.934+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.938+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:22:45.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.938+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.942+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.942+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.946 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.942+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:22:45.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.946+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.946+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.946+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.950+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:22:45.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.950+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.954+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.954+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.954+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:22:45.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.958+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.958+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.958+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.958+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:22:45.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.962+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.962+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.962+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.969 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.966+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:22:45.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.970+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.970+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.970+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.974+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:22:45.980 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.978+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.982 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.978+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.978+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.982+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:22:45.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.986+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.986+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.990 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.986+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.990+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:22:45.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.994+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:45.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.994+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:45.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.994+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.002 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:45.998+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:22:46.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.002+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.002+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.002+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.009 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.006+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:22:46.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.010+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.010+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.014+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.018+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:22:46.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.022+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.022+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.022+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.026+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:22:46.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.030+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.030+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.034+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.034+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:22:46.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.038+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.042+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.042+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.042+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:22:46.051 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.046+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.050+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.050+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.054+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:22:46.060 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.058+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.058+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.058+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.062+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:22:46.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.066+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.066+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.066+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.070+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:22:46.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.074+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.074+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.074+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.078+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:22:46.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.082+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.082+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.086+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.086+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:22:46.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.090+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.094+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.094+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.098+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:22:46.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.098+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.102+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.102+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.106+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:22:46.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.110+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.110+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.110+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.114+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:22:46.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.118+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.118+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.122+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.122+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:22:46.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.126+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.130+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.130+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.130+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:22:46.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.134+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.138+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.138+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.138+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:22:46.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.142+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.146+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.146+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.146+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:22:46.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.150+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.154+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.154+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.154+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:22:46.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.158+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.158+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.158+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.162+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:22:46.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.166+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.166+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.166+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.170+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:22:46.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.174+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.178+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.178+0000 7f7d6c2309c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.182+0000 7f7c1b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:22:46.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.190+0000 7f7d6c2309c0 20 remove_watcher() i=0 2024-09-19T14:22:46.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.190+0000 7f7d6c2309c0 2 removed watcher, disabling cache 2024-09-19T14:22:46.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.190+0000 7f7d6c2309c0 20 remove_watcher() i=1 2024-09-19T14:22:46.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.194+0000 7f7d6c2309c0 20 remove_watcher() i=2 2024-09-19T14:22:46.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.198+0000 7f7d6c2309c0 20 remove_watcher() i=3 2024-09-19T14:22:46.203 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.198+0000 7f7d6c2309c0 20 remove_watcher() i=4 2024-09-19T14:22:46.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.202+0000 7f7d6c2309c0 20 remove_watcher() i=5 2024-09-19T14:22:46.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.202+0000 7f7d6c2309c0 20 remove_watcher() i=6 2024-09-19T14:22:46.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.206+0000 7f7d6c2309c0 20 remove_watcher() i=7 2024-09-19T14:22:46.230 DEBUG:teuthology.orchestra.run.smithi153:> radosgw-admin gc process --include-all 2024-09-19T14:22:46.303 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:22:46.304 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:22:46.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.346+0000 7f97373069c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:46.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.350+0000 7f97373069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:46.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.350+0000 7f97373069c0 20 realm 2024-09-19T14:22:46.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.350+0000 7f97373069c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:46.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.350+0000 7f97373069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:46.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.350+0000 7f97373069c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:22:46.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.350+0000 7f97373069c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:46.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.350+0000 7f97373069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:46.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.350+0000 7f97373069c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:46.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.350+0000 7f97373069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:22:46.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.350+0000 7f97373069c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:46.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.350+0000 7f97373069c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:22:46.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.350+0000 7f97373069c0 20 searching for the correct realm 2024-09-19T14:22:46.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.358+0000 7f973460b640 0 -- 172.21.15.153:0/288747378 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f9724056040 msgr2=0x7f972406f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:22:46.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.366+0000 7f973460b640 0 -- 172.21.15.153:0/288747378 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f9600082340 msgr2=0x7f9600084770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:22:46.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.370+0000 7f97373069c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:22:46.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.370+0000 7f97373069c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:22:46.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.370+0000 7f97373069c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:22:46.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.370+0000 7f97373069c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:22:46.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.370+0000 7f97373069c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:22:46.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.370+0000 7f97373069c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:22:46.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.370+0000 7f97373069c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:46.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.370+0000 7f97373069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:46.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.370+0000 7f97373069c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:46.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.370+0000 7f97373069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:22:46.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.370+0000 7f97373069c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.374+0000 7f97373069c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:22:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.374+0000 7f97373069c0 20 zone default found 2024-09-19T14:22:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.374+0000 7f97373069c0 4 Realm: () 2024-09-19T14:22:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.374+0000 7f97373069c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:22:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.374+0000 7f97373069c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:22:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.374+0000 7f97373069c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:22:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.374+0000 7f97373069c0 20 zonegroup default 2024-09-19T14:22:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.374+0000 7f97373069c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.374+0000 7f97373069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.374+0000 7f97373069c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.374+0000 7f97373069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.374+0000 7f97373069c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.374+0000 7f97373069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:46.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.374+0000 7f97373069c0 20 started sync module instance, tier type = 2024-09-19T14:22:46.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.374+0000 7f97373069c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:22:46.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.390+0000 7f97373069c0 20 add_watcher() i=0 2024-09-19T14:22:46.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.390+0000 7f97373069c0 20 add_watcher() i=1 2024-09-19T14:22:46.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.390+0000 7f97373069c0 20 add_watcher() i=2 2024-09-19T14:22:46.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.390+0000 7f97373069c0 20 add_watcher() i=3 2024-09-19T14:22:46.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.390+0000 7f97373069c0 20 add_watcher() i=4 2024-09-19T14:22:46.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.390+0000 7f97373069c0 20 add_watcher() i=5 2024-09-19T14:22:46.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.390+0000 7f97373069c0 20 add_watcher() i=6 2024-09-19T14:22:46.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.390+0000 7f97373069c0 20 add_watcher() i=7 2024-09-19T14:22:46.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.390+0000 7f97373069c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:22:46.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.394+0000 7f95eafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:22:46.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.394+0000 7f97373069c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:22:46.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.394+0000 7f97373069c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:22:46.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.470+0000 7f95e9fe3640 20 reqs_thread_entry: start 2024-09-19T14:22:46.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.470+0000 7f97373069c0 20 init_complete bucket index max shards: 11 2024-09-19T14:22:46.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.470+0000 7f97373069c0 20 Filter name: none 2024-09-19T14:22:46.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.470+0000 7f955b7fe640 20 reqs_thread_entry: start 2024-09-19T14:22:46.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.470+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:22:46.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.474+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.478+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.478+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.482+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:22:46.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.482+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.486+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.486+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.486+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:22:46.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.490+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.490+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.490+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.494+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:22:46.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.498+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.498+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.498+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.502+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:22:46.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.506+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.506+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.510+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.510+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:22:46.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.514+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.518+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.518+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.522+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:22:46.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.526+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.526+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.526+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.530+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:22:46.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.534+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.534+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.534+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.538+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:22:46.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.542+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.542+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.542+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.546+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:22:46.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.550+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.550+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.550+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.554+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:22:46.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.558+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.558+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.558+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.562+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:22:46.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.566+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.570+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.570+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.574+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:22:46.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.578+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.578+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.578+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.582+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:22:46.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.586+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.586+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.590+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.590+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:22:46.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.594+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.598+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.598+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.602+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:22:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.606+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.606+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.606+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.610+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:22:46.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.614+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.618+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.618+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.622+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:22:46.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.626+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.626+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.626+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.630+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:22:46.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.634+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.634+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.634+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.638+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:22:46.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.642+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.642+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.642+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.650 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.646+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:22:46.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.650+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.650+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.654+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.654+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:22:46.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.658+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.658+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.662+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.662+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:22:46.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.670+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.670+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.670+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.674+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:22:46.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.678+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.678+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.682+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.682+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:22:46.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.686+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.686+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.686+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.690+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:22:46.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.694+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.694+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.698+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.698+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:22:46.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.702+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.702+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.706+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.706+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:22:46.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.710+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.710+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.714+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.714+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:22:46.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.718+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.718+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.722+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.722+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:22:46.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.726+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.730+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.730+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.730+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:22:46.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.734+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.738+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.738+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.738+0000 7f97373069c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:22:46.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.742+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.746+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:46.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.746+0000 7f97373069c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:46.754 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.750+0000 7f95eafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:22:46.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.754+0000 7f97373069c0 20 remove_watcher() i=0 2024-09-19T14:22:46.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.754+0000 7f97373069c0 2 removed watcher, disabling cache 2024-09-19T14:22:46.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.758+0000 7f97373069c0 20 remove_watcher() i=1 2024-09-19T14:22:46.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.762+0000 7f97373069c0 20 remove_watcher() i=2 2024-09-19T14:22:46.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.762+0000 7f97373069c0 20 remove_watcher() i=3 2024-09-19T14:22:46.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.766+0000 7f97373069c0 20 remove_watcher() i=4 2024-09-19T14:22:46.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.766+0000 7f97373069c0 20 remove_watcher() i=5 2024-09-19T14:22:46.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.770+0000 7f97373069c0 20 remove_watcher() i=6 2024-09-19T14:22:46.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.770+0000 7f97373069c0 20 remove_watcher() i=7 2024-09-19T14:22:46.794 DEBUG:teuthology.orchestra.run.smithi153:> radosgw-admin gc process --include-all 2024-09-19T14:22:46.866 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:22:46.867 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:22:46.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.910+0000 7fcd96dc29c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:46.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.910+0000 7fcd96dc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:46.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.910+0000 7fcd96dc29c0 20 realm 2024-09-19T14:22:46.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.910+0000 7fcd96dc29c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:46.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.910+0000 7fcd96dc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:46.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.910+0000 7fcd96dc29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:22:46.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.910+0000 7fcd96dc29c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:46.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.910+0000 7fcd96dc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:46.915 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.910+0000 7fcd96dc29c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:46.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.914+0000 7fcd96dc29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:22:46.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.914+0000 7fcd96dc29c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:46.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.914+0000 7fcd96dc29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:22:46.917 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.914+0000 7fcd96dc29c0 20 searching for the correct realm 2024-09-19T14:22:46.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:46.918+0000 7fcd950c9640 0 -- 172.21.15.153:0/3692752929 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7fcd8803d040 msgr2=0x7fcd880840c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:22:47.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.134+0000 7fcd948c8640 0 -- 172.21.15.153:0/3692752929 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x5595484f5fa0 msgr2=0x5595484f83d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:22:47.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.142+0000 7fcd96dc29c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:22:47.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.142+0000 7fcd96dc29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:22:47.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.142+0000 7fcd96dc29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:22:47.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.142+0000 7fcd96dc29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:22:47.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.142+0000 7fcd96dc29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:22:47.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.142+0000 7fcd96dc29c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:22:47.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.142+0000 7fcd96dc29c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:47.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.142+0000 7fcd96dc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:47.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.142+0000 7fcd96dc29c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:47.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.142+0000 7fcd96dc29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:22:47.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.142+0000 7fcd96dc29c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:47.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.146+0000 7fcd96dc29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:22:47.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.146+0000 7fcd96dc29c0 20 zone default found 2024-09-19T14:22:47.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.146+0000 7fcd96dc29c0 4 Realm: () 2024-09-19T14:22:47.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.146+0000 7fcd96dc29c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:22:47.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.146+0000 7fcd96dc29c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:22:47.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.146+0000 7fcd96dc29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:22:47.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.146+0000 7fcd96dc29c0 20 zonegroup default 2024-09-19T14:22:47.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.146+0000 7fcd96dc29c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:47.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.146+0000 7fcd96dc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:47.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.146+0000 7fcd96dc29c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:47.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.146+0000 7fcd96dc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:47.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.146+0000 7fcd96dc29c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:47.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.146+0000 7fcd96dc29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:47.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.146+0000 7fcd96dc29c0 20 started sync module instance, tier type = 2024-09-19T14:22:47.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.146+0000 7fcd96dc29c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:22:47.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.170+0000 7fcd96dc29c0 20 add_watcher() i=0 2024-09-19T14:22:47.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.170+0000 7fcd96dc29c0 20 add_watcher() i=1 2024-09-19T14:22:47.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.170+0000 7fcd96dc29c0 20 add_watcher() i=2 2024-09-19T14:22:47.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.170+0000 7fcd96dc29c0 20 add_watcher() i=3 2024-09-19T14:22:47.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.170+0000 7fcd96dc29c0 20 add_watcher() i=4 2024-09-19T14:22:47.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.170+0000 7fcd96dc29c0 20 add_watcher() i=5 2024-09-19T14:22:47.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.170+0000 7fcd96dc29c0 20 add_watcher() i=6 2024-09-19T14:22:47.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.174+0000 7fcd96dc29c0 20 add_watcher() i=7 2024-09-19T14:22:47.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.174+0000 7fcd96dc29c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:22:47.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.178+0000 7fcc4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:22:47.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.178+0000 7fcd96dc29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:22:47.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.178+0000 7fcd96dc29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:22:47.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.266+0000 7fcc4a7e4640 20 reqs_thread_entry: start 2024-09-19T14:22:47.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.266+0000 7fcd96dc29c0 20 init_complete bucket index max shards: 11 2024-09-19T14:22:47.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.266+0000 7fcd96dc29c0 20 Filter name: none 2024-09-19T14:22:47.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.266+0000 7fcc437fe640 20 reqs_thread_entry: start 2024-09-19T14:22:47.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.266+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:22:47.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.270+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.270+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.274+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.274+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:22:47.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.278+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.278+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.282+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.282+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:22:47.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.286+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.290+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.290+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.294+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:22:47.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.294+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.294+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.294+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.298+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:22:47.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.298+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.302+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.302+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.306+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:22:47.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.306+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.306+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.306+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.310+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:22:47.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.314+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.314+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.314+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.314+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:22:47.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.318+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.322+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.322+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.326+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:22:47.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.330+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.330+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.330+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.334+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:22:47.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.338+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.338+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.338+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.342+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:22:47.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.342+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.346+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.346+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.350+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:22:47.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.350+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.350+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.354+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.354+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:22:47.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.358+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.362+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.362+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.362+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:22:47.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.366+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.370+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.370+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.374+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:22:47.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.374+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.374+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.378+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.378+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:22:47.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.382+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.382+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.386+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.386+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:22:47.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.390+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.390+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.390+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.394+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:22:47.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.394+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.398+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.398+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.398+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:22:47.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.402+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.402+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.402+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.402+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:22:47.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.406+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.410+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.410+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.414+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:22:47.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.418+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.418+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.418+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.422+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:22:47.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.422+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.426+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.426+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.426+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:22:47.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.430+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.430+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.434+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.434+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:22:47.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.434+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.438+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.438+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.438+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:22:47.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.442+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.446+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.446+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.450+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:22:47.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.454+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.454+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.454+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.458+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:22:47.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.462+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.462+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.462+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.462+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:22:47.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.466+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.470+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.470+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.474+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:22:47.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.478+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.478+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.478+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.482+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:22:47.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.486+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.486+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.486+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.490+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:22:47.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.490+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.494+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.494+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.498+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:22:47.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.498+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.498+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:47.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.502+0000 7fcd96dc29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:47.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.506+0000 7fcc4b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:22:47.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.510+0000 7fcd96dc29c0 20 remove_watcher() i=0 2024-09-19T14:22:47.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.510+0000 7fcd96dc29c0 2 removed watcher, disabling cache 2024-09-19T14:22:47.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.514+0000 7fcd96dc29c0 20 remove_watcher() i=1 2024-09-19T14:22:47.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.514+0000 7fcd96dc29c0 20 remove_watcher() i=2 2024-09-19T14:22:47.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.518+0000 7fcd96dc29c0 20 remove_watcher() i=3 2024-09-19T14:22:47.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.522+0000 7fcd96dc29c0 20 remove_watcher() i=4 2024-09-19T14:22:47.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.522+0000 7fcd96dc29c0 20 remove_watcher() i=5 2024-09-19T14:22:47.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.526+0000 7fcd96dc29c0 20 remove_watcher() i=6 2024-09-19T14:22:47.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:47.526+0000 7fcd96dc29c0 20 remove_watcher() i=7 2024-09-19T14:22:47.547 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-19T14:22:48.254 INFO:teuthology.orchestra.run.smithi153.stdout:> Task :clean 2024-09-19T14:22:49.151 INFO:teuthology.orchestra.run.smithi153.stdout:> Task :compileJava 2024-09-19T14:22:49.151 INFO:teuthology.orchestra.run.smithi153.stdout:> Task :processResources 2024-09-19T14:22:49.152 INFO:teuthology.orchestra.run.smithi153.stdout:> Task :classes 2024-09-19T14:22:49.651 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:49.651 INFO:teuthology.orchestra.run.smithi153.stdout:> Task :compileTestJava 2024-09-19T14:22:49.652 INFO:teuthology.orchestra.run.smithi153.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-19T14:22:49.652 INFO:teuthology.orchestra.run.smithi153.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-19T14:22:49.653 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:49.653 INFO:teuthology.orchestra.run.smithi153.stdout:> Task :processTestResources NO-SOURCE 2024-09-19T14:22:49.653 INFO:teuthology.orchestra.run.smithi153.stdout:> Task :testClasses 2024-09-19T14:22:51.651 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:51.652 INFO:teuthology.orchestra.run.smithi153.stdout:> Task :test 2024-09-19T14:22:51.652 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:51.652 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Bucket tests STANDARD_OUT 2024-09-19T14:22:51.653 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19 14:22:51,054 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-19T14:22:51.653 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:51.653 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-19T14:22:51.653 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:51.653 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-19T14:22:52.251 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:52.251 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-19T14:22:52.351 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:52.351 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-19T14:22:53.051 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:53.051 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-19T14:22:53.151 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:53.151 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-19T14:22:53.851 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:53.851 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-19T14:22:54.451 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:54.451 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-19T14:22:54.552 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:54.552 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-19T14:22:54.951 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:54.951 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-19T14:22:55.751 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:55.751 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-19T14:22:55.851 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:55.852 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-19T14:22:55.951 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:55.951 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-19T14:22:56.352 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:56.352 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-19T14:22:57.651 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:57.651 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-19T14:22:57.951 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:57.951 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-19T14:22:58.651 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:58.651 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-19T14:22:58.652 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:58.652 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-19T14:22:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:58.852 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------- 2024-09-19T14:22:58.852 INFO:teuthology.orchestra.run.smithi153.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-19T14:22:58.852 INFO:teuthology.orchestra.run.smithi153.stdout:-------------------------------------------------------------------- 2024-09-19T14:22:58.852 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:58.852 INFO:teuthology.orchestra.run.smithi153.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-19T14:22:58.853 INFO:teuthology.orchestra.run.smithi153.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-19T14:22:58.853 INFO:teuthology.orchestra.run.smithi153.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-19T14:22:58.853 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:22:58.853 INFO:teuthology.orchestra.run.smithi153.stdout:BUILD SUCCESSFUL in 11s 2024-09-19T14:22:58.853 INFO:teuthology.orchestra.run.smithi153.stdout:5 actionable tasks: 5 executed 2024-09-19T14:22:58.870 DEBUG:teuthology.orchestra.run.smithi153:> radosgw-admin gc process --include-all 2024-09-19T14:22:58.895 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:22:58.895 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:22:58.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:58.933+0000 7f347bb809c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:58.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:58.937+0000 7f347bb809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:58.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:58.937+0000 7f347bb809c0 20 realm 2024-09-19T14:22:58.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:58.937+0000 7f347bb809c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:58.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:58.937+0000 7f347bb809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:58.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:58.937+0000 7f347bb809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:22:58.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:58.937+0000 7f347bb809c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:58.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:58.937+0000 7f347bb809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:58.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:58.937+0000 7f347bb809c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:58.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:58.941+0000 7f347bb809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:22:58.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:58.941+0000 7f347bb809c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:58.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:58.941+0000 7f347bb809c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:22:58.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:58.941+0000 7f347bb809c0 20 searching for the correct realm 2024-09-19T14:22:58.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:58.941+0000 7f3479686640 0 -- 172.21.15.153:0/1443468296 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x5651868fe4b0 msgr2=0x7f34740f78b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:22:59.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.153+0000 7f3479e87640 0 -- 172.21.15.153:0/1443468296 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f3470019430 msgr2=0x7f3470019850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:22:59.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.169+0000 7f347bb809c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:22:59.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.169+0000 7f347bb809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:22:59.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.169+0000 7f347bb809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:22:59.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.169+0000 7f347bb809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:22:59.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.169+0000 7f347bb809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:22:59.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.169+0000 7f347bb809c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:22:59.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.169+0000 7f347bb809c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:59.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.169+0000 7f347bb809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:59.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.169+0000 7f347bb809c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:59.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.169+0000 7f347bb809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:22:59.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.169+0000 7f347bb809c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:59.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.173+0000 7f347bb809c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:22:59.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.173+0000 7f347bb809c0 20 zone default found 2024-09-19T14:22:59.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.173+0000 7f347bb809c0 4 Realm: () 2024-09-19T14:22:59.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.173+0000 7f347bb809c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:22:59.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.173+0000 7f347bb809c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:22:59.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.173+0000 7f347bb809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:22:59.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.173+0000 7f347bb809c0 20 zonegroup default 2024-09-19T14:22:59.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.173+0000 7f347bb809c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:59.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.173+0000 7f347bb809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:59.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.173+0000 7f347bb809c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:59.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.173+0000 7f347bb809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:59.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.173+0000 7f347bb809c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:59.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.173+0000 7f347bb809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:59.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.173+0000 7f347bb809c0 20 started sync module instance, tier type = 2024-09-19T14:22:59.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.173+0000 7f347bb809c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:22:59.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.197+0000 7f347bb809c0 20 add_watcher() i=0 2024-09-19T14:22:59.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.197+0000 7f347bb809c0 20 add_watcher() i=1 2024-09-19T14:22:59.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.197+0000 7f347bb809c0 20 add_watcher() i=2 2024-09-19T14:22:59.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.197+0000 7f347bb809c0 20 add_watcher() i=3 2024-09-19T14:22:59.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.197+0000 7f347bb809c0 20 add_watcher() i=4 2024-09-19T14:22:59.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.197+0000 7f347bb809c0 20 add_watcher() i=5 2024-09-19T14:22:59.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.197+0000 7f347bb809c0 20 add_watcher() i=6 2024-09-19T14:22:59.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.201+0000 7f347bb809c0 20 add_watcher() i=7 2024-09-19T14:22:59.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.201+0000 7f347bb809c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:22:59.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.205+0000 7f332f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:22:59.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.205+0000 7f347bb809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:22:59.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.205+0000 7f347bb809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:22:59.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.293+0000 7f332e7e4640 20 reqs_thread_entry: start 2024-09-19T14:22:59.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.293+0000 7f347bb809c0 20 init_complete bucket index max shards: 11 2024-09-19T14:22:59.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.293+0000 7f347bb809c0 20 Filter name: none 2024-09-19T14:22:59.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.293+0000 7f329ffff640 20 reqs_thread_entry: start 2024-09-19T14:22:59.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.293+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:22:59.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.297+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.297+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.297+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.301+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:22:59.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.305+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.305+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.305+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.309+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:22:59.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.313+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.313+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.313+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.313+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:22:59.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.317+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.317+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.317+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.321+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:22:59.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.321+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.321+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.325+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.325+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:22:59.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.329+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.329+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.329+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.329+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:22:59.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.333+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.333+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.333+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.337+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:22:59.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.341+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.341+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.341+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.345+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:22:59.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.349+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.349+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.349+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:22:59.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.349+0000 7f347bb809c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16705569320844696239', time=2024-09-19T16:22:57.111289+0000, chain.objs.size()=1 2024-09-19T14:22:59.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.349+0000 7f347bb809c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.72__shadow_.xxv2yic05Pu5wdsTwJ_vymSFWgJrXFA_0 2024-09-19T14:22:59.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.353+0000 7f347bb809c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:59.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.357+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:22:59.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.357+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.361+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.361+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.361+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:22:59.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.365+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.369+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.369+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.369+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:22:59.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.373+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.373+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.377+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.377+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:22:59.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.381+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.381+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.381+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.385+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:22:59.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.389+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.389+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.389+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.393+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:22:59.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.393+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.397+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.397+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:22:59.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.397+0000 7f347bb809c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14820654732582366114', time=2024-09-19T16:22:55.135591+0000, chain.objs.size()=1 2024-09-19T14:22:59.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.397+0000 7f347bb809c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.71__shadow_.iFK-ckKhrB1hGnH-DE1X1mQgr4kfX37_0 2024-09-19T14:22:59.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.401+0000 7f347bb809c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:22:59.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.405+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:22:59.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.409+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.409+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.409+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.413+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:22:59.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.417+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.417+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.421+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.421+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:22:59.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.425+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.429+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.429+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.429+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:22:59.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.433+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.437+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.437+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.441+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:22:59.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.441+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.445+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.445+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.445+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:22:59.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.449+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.453+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.453+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.457+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:22:59.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.461+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.461+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.465+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.465+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:22:59.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.469+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.473+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.473+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.477+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:22:59.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.477+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.481+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.481+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.485+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:22:59.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.489+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.489+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.489+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.493+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:22:59.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.497+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.497+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.497+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.501+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:22:59.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.505+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.505+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.505+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.509+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:22:59.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.513+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.517+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.517+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.517+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:22:59.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.521+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.525+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.525+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.529+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:22:59.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.533+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.533+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.533+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.537+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:22:59.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.541+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.541+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.541+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.545+0000 7f347bb809c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:22:59.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.549+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.553+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:22:59.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.553+0000 7f347bb809c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:22:59.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.557+0000 7f332f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:22:59.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.561+0000 7f347bb809c0 20 remove_watcher() i=0 2024-09-19T14:22:59.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.561+0000 7f347bb809c0 2 removed watcher, disabling cache 2024-09-19T14:22:59.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.565+0000 7f347bb809c0 20 remove_watcher() i=1 2024-09-19T14:22:59.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.569+0000 7f347bb809c0 20 remove_watcher() i=2 2024-09-19T14:22:59.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.569+0000 7f347bb809c0 20 remove_watcher() i=3 2024-09-19T14:22:59.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.573+0000 7f347bb809c0 20 remove_watcher() i=4 2024-09-19T14:22:59.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.573+0000 7f347bb809c0 20 remove_watcher() i=5 2024-09-19T14:22:59.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.577+0000 7f347bb809c0 20 remove_watcher() i=6 2024-09-19T14:22:59.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.577+0000 7f347bb809c0 20 remove_watcher() i=7 2024-09-19T14:22:59.602 DEBUG:teuthology.orchestra.run.smithi153:> radosgw-admin gc process --include-all 2024-09-19T14:22:59.675 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:22:59.675 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:22:59.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.717+0000 7ff0b8e0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:59.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.717+0000 7ff0b8e0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:59.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.717+0000 7ff0b8e0a9c0 20 realm 2024-09-19T14:22:59.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.717+0000 7ff0b8e0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:59.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.721+0000 7ff0b8e0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:59.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.721+0000 7ff0b8e0a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:22:59.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.721+0000 7ff0b8e0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:59.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.721+0000 7ff0b8e0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:59.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.721+0000 7ff0b8e0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:59.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.721+0000 7ff0b8e0a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:22:59.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.721+0000 7ff0b8e0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:59.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.721+0000 7ff0b8e0a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:22:59.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.721+0000 7ff0b8e0a9c0 20 searching for the correct realm 2024-09-19T14:22:59.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.725+0000 7ff0b7111640 0 -- 172.21.15.153:0/1112682060 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7ff0ac018070 msgr2=0x7ff0ac0528b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:22:59.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.733+0000 7ff0b6910640 0 -- 172.21.15.153:0/1112682060 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7ff0ac04e050 msgr2=0x7ff0ac0733b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:22:59.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.949+0000 7ff0b8e0a9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:22:59.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.949+0000 7ff0b8e0a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:22:59.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.949+0000 7ff0b8e0a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:22:59.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.949+0000 7ff0b8e0a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:22:59.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.949+0000 7ff0b8e0a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:22:59.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.949+0000 7ff0b8e0a9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:22:59.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.949+0000 7ff0b8e0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:59.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.949+0000 7ff0b8e0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:59.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.949+0000 7ff0b8e0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:59.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.953+0000 7ff0b8e0a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:22:59.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.953+0000 7ff0b8e0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:59.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.953+0000 7ff0b8e0a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:22:59.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.953+0000 7ff0b8e0a9c0 20 zone default found 2024-09-19T14:22:59.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.953+0000 7ff0b8e0a9c0 4 Realm: () 2024-09-19T14:22:59.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.953+0000 7ff0b8e0a9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:22:59.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.953+0000 7ff0b8e0a9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:22:59.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.953+0000 7ff0b8e0a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:22:59.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.953+0000 7ff0b8e0a9c0 20 zonegroup default 2024-09-19T14:22:59.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.953+0000 7ff0b8e0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:59.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.953+0000 7ff0b8e0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:59.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.953+0000 7ff0b8e0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:59.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.957+0000 7ff0b8e0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:59.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.957+0000 7ff0b8e0a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:22:59.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.957+0000 7ff0b8e0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:22:59.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.957+0000 7ff0b8e0a9c0 20 started sync module instance, tier type = 2024-09-19T14:22:59.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.957+0000 7ff0b8e0a9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:22:59.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.981+0000 7ff0b8e0a9c0 20 add_watcher() i=0 2024-09-19T14:22:59.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.981+0000 7ff0b8e0a9c0 20 add_watcher() i=1 2024-09-19T14:22:59.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.981+0000 7ff0b8e0a9c0 20 add_watcher() i=2 2024-09-19T14:22:59.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.981+0000 7ff0b8e0a9c0 20 add_watcher() i=3 2024-09-19T14:22:59.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.981+0000 7ff0b8e0a9c0 20 add_watcher() i=4 2024-09-19T14:22:59.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.981+0000 7ff0b8e0a9c0 20 add_watcher() i=5 2024-09-19T14:22:59.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.981+0000 7ff0b8e0a9c0 20 add_watcher() i=6 2024-09-19T14:22:59.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.985+0000 7ff0b8e0a9c0 20 add_watcher() i=7 2024-09-19T14:22:59.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.985+0000 7ff0b8e0a9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:22:59.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.989+0000 7fef6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:22:59.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.989+0000 7ff0b8e0a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:22:59.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:22:59.989+0000 7ff0b8e0a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:23:00.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.077+0000 7feee7fff640 20 reqs_thread_entry: start 2024-09-19T14:23:00.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.077+0000 7ff0b8e0a9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:23:00.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.077+0000 7ff0b8e0a9c0 20 Filter name: none 2024-09-19T14:23:00.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.077+0000 7feee5ffb640 20 reqs_thread_entry: start 2024-09-19T14:23:00.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.077+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:23:00.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.081+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.085+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.085+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.085+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:23:00.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.089+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.089+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.089+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.089+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:23:00.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.093+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.093+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.093+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.093+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:23:00.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.097+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.101+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.101+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.101+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:23:00.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.105+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.105+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.110 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.105+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.105+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:23:00.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.109+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.109+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.109+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.113+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:23:00.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.113+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.117+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.117+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.117+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:23:00.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.121+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.121+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.121+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.125+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:23:00.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.129+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.129+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.129+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.129+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:23:00.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.133+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.133+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.133+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.137+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:23:00.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.137+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.137+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.137+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.141+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:23:00.148 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.145+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.145+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.145+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.149+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:23:00.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.149+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.153+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.153+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.153+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:23:00.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.157+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.157+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.157+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.161+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:23:00.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.165+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.165+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.165+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.165+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:23:00.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.169+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.169+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.169+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.173+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:23:00.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.177+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.177+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.177+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.177+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:23:00.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.181+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.181+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.181+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.185+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:23:00.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.189+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.189+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.189+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.193+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:23:00.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.197+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.197+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.203 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.197+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.201+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:23:00.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.205+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.205+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.209+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.209+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:23:00.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.213+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.213+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.217+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.217+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:23:00.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.221+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.225+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.225+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.225+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:23:00.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.229+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.236 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.233+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.233+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.233+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:23:00.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.237+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.241+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.241+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.245+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:23:00.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.245+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.249+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.249+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.253+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:23:00.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.257+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.257+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.261+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.261+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:23:00.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.265+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.269+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.269+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.269+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:23:00.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.273+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.277+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.277+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.277+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:23:00.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.281+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.281+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.281+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.285+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:23:00.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.289+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.289+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.289+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.293+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:23:00.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.293+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.297+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.297+0000 7ff0b8e0a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.301+0000 7fef6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:23:00.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.305+0000 7ff0b8e0a9c0 20 remove_watcher() i=0 2024-09-19T14:23:00.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.305+0000 7ff0b8e0a9c0 2 removed watcher, disabling cache 2024-09-19T14:23:00.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.309+0000 7ff0b8e0a9c0 20 remove_watcher() i=1 2024-09-19T14:23:00.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.309+0000 7ff0b8e0a9c0 20 remove_watcher() i=2 2024-09-19T14:23:00.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.313+0000 7ff0b8e0a9c0 20 remove_watcher() i=3 2024-09-19T14:23:00.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.317+0000 7ff0b8e0a9c0 20 remove_watcher() i=4 2024-09-19T14:23:00.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.317+0000 7ff0b8e0a9c0 20 remove_watcher() i=5 2024-09-19T14:23:00.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.321+0000 7ff0b8e0a9c0 20 remove_watcher() i=6 2024-09-19T14:23:00.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.321+0000 7ff0b8e0a9c0 20 remove_watcher() i=7 2024-09-19T14:23:00.348 DEBUG:teuthology.orchestra.run.smithi153:> radosgw-admin gc process --include-all 2024-09-19T14:23:00.422 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:23:00.422 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:23:00.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.465+0000 7f9b28af29c0 20 rados->read ofs=0 len=0 2024-09-19T14:23:00.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.465+0000 7f9b28af29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:23:00.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.465+0000 7f9b28af29c0 20 realm 2024-09-19T14:23:00.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.465+0000 7f9b28af29c0 20 rados->read ofs=0 len=0 2024-09-19T14:23:00.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.465+0000 7f9b28af29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:23:00.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.465+0000 7f9b28af29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:23:00.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.465+0000 7f9b28af29c0 20 rados->read ofs=0 len=0 2024-09-19T14:23:00.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.465+0000 7f9b28af29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:23:00.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.465+0000 7f9b28af29c0 20 rados->read ofs=0 len=0 2024-09-19T14:23:00.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.469+0000 7f9b28af29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:23:00.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.469+0000 7f9b28af29c0 20 rados->read ofs=0 len=0 2024-09-19T14:23:00.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.469+0000 7f9b28af29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:23:00.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.469+0000 7f9b28af29c0 20 searching for the correct realm 2024-09-19T14:23:00.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.473+0000 7f9b26df9640 0 -- 172.21.15.153:0/3471706762 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x5577a32df650 msgr2=0x5577a32e1b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:23:00.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.481+0000 7f9b265f8640 0 -- 172.21.15.153:0/3471706762 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f9b100854f0 msgr2=0x7f9b10052a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:23:00.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.485+0000 7f9b28af29c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:23:00.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.485+0000 7f9b28af29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:23:00.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.485+0000 7f9b28af29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:23:00.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.485+0000 7f9b28af29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:23:00.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.485+0000 7f9b28af29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:23:00.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.485+0000 7f9b28af29c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:23:00.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.485+0000 7f9b28af29c0 20 rados->read ofs=0 len=0 2024-09-19T14:23:00.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.485+0000 7f9b28af29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:23:00.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.485+0000 7f9b28af29c0 20 rados->read ofs=0 len=0 2024-09-19T14:23:00.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.489+0000 7f9b28af29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:23:00.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.489+0000 7f9b28af29c0 20 rados->read ofs=0 len=0 2024-09-19T14:23:00.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.489+0000 7f9b28af29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:23:00.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.489+0000 7f9b28af29c0 20 zone default found 2024-09-19T14:23:00.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.489+0000 7f9b28af29c0 4 Realm: () 2024-09-19T14:23:00.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.489+0000 7f9b28af29c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:23:00.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.489+0000 7f9b28af29c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:23:00.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.489+0000 7f9b28af29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:23:00.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.489+0000 7f9b28af29c0 20 zonegroup default 2024-09-19T14:23:00.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.489+0000 7f9b28af29c0 20 rados->read ofs=0 len=0 2024-09-19T14:23:00.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.489+0000 7f9b28af29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:23:00.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.489+0000 7f9b28af29c0 20 rados->read ofs=0 len=0 2024-09-19T14:23:00.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.489+0000 7f9b28af29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:23:00.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.489+0000 7f9b28af29c0 20 rados->read ofs=0 len=0 2024-09-19T14:23:00.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.489+0000 7f9b28af29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:23:00.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.489+0000 7f9b28af29c0 20 started sync module instance, tier type = 2024-09-19T14:23:00.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.489+0000 7f9b28af29c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:23:00.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.505+0000 7f9b28af29c0 20 add_watcher() i=0 2024-09-19T14:23:00.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.505+0000 7f9b28af29c0 20 add_watcher() i=1 2024-09-19T14:23:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.505+0000 7f9b28af29c0 20 add_watcher() i=2 2024-09-19T14:23:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.505+0000 7f9b28af29c0 20 add_watcher() i=3 2024-09-19T14:23:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.505+0000 7f9b28af29c0 20 add_watcher() i=4 2024-09-19T14:23:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.505+0000 7f9b28af29c0 20 add_watcher() i=5 2024-09-19T14:23:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.505+0000 7f9b28af29c0 20 add_watcher() i=6 2024-09-19T14:23:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.505+0000 7f9b28af29c0 20 add_watcher() i=7 2024-09-19T14:23:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.505+0000 7f9b28af29c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:23:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.509+0000 7f99dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:23:00.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.509+0000 7f9b28af29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:23:00.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.509+0000 7f9b28af29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:23:00.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.581+0000 7f99577fe640 20 reqs_thread_entry: start 2024-09-19T14:23:00.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.581+0000 7f9b28af29c0 20 init_complete bucket index max shards: 11 2024-09-19T14:23:00.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.581+0000 7f9b28af29c0 20 Filter name: none 2024-09-19T14:23:00.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.581+0000 7f99557fa640 20 reqs_thread_entry: start 2024-09-19T14:23:00.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.581+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:23:00.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.585+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.585+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.585+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.589+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:23:00.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.589+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.589+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.589+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.593+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:23:00.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.597+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.597+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.597+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.597+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:23:00.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.601+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.605+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.605+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.609+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:23:00.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.609+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.613+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.613+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.613+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:23:00.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.617+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.617+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.621+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.621+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:23:00.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.625+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.625+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.625+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.629+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:23:00.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.633+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.633+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.633+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.637+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:23:00.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.641+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.641+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.641+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.645+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:23:00.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.649+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.649+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.649+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.653+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:23:00.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.657+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.657+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.657+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.661+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:23:00.668 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.665+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.665+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.665+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.669+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:23:00.676 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.673+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.673+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.673+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.673+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:23:00.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.677+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.677+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.677+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.681+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:23:00.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.685+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.685+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.685+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.689+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:23:00.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.693+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.693+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.697+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.701+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:23:00.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.701+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.701+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.705+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.705+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:23:00.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.709+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.709+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.717 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.713+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.717+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:23:00.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.717+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.721+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.721+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.728 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.725+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:23:00.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.729+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.734 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.729+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.729+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.733+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:23:00.742 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.737+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.741+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.741+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.745+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:23:00.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.745+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.749+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.749+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.756 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.753+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:23:00.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.757+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.761+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.761+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.767 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.765+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:23:00.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.769+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.769+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.769+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.773+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:23:00.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.777+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.777+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.777+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.781+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:23:00.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.785+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.785+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.785+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.789+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:23:00.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.793+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.793+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.793+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.797+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:23:00.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.801+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.801+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.801+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.805+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:23:00.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.809+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.809+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.813+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.813+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:23:00.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.817+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.817+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.817+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.821+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:23:00.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.825+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.825+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.825+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.829+0000 7f9b28af29c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:23:00.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.833+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.839 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.833+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:00.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.837+0000 7f9b28af29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:00.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.841+0000 7f99dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:23:00.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.845+0000 7f9b28af29c0 20 remove_watcher() i=0 2024-09-19T14:23:00.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.845+0000 7f9b28af29c0 2 removed watcher, disabling cache 2024-09-19T14:23:00.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.849+0000 7f9b28af29c0 20 remove_watcher() i=1 2024-09-19T14:23:00.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.849+0000 7f9b28af29c0 20 remove_watcher() i=2 2024-09-19T14:23:00.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.853+0000 7f9b28af29c0 20 remove_watcher() i=3 2024-09-19T14:23:00.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.857+0000 7f9b28af29c0 20 remove_watcher() i=4 2024-09-19T14:23:00.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.857+0000 7f9b28af29c0 20 remove_watcher() i=5 2024-09-19T14:23:00.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.861+0000 7f9b28af29c0 20 remove_watcher() i=6 2024-09-19T14:23:00.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:00.861+0000 7f9b28af29c0 20 remove_watcher() i=7 2024-09-19T14:23:00.886 DEBUG:teuthology.orchestra.run.smithi153:> radosgw-admin gc process --include-all 2024-09-19T14:23:00.958 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:23:00.958 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:23:01.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.001+0000 7f52589939c0 20 rados->read ofs=0 len=0 2024-09-19T14:23:01.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.001+0000 7f52589939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:23:01.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.001+0000 7f52589939c0 20 realm 2024-09-19T14:23:01.007 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.001+0000 7f52589939c0 20 rados->read ofs=0 len=0 2024-09-19T14:23:01.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.001+0000 7f52589939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:23:01.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.001+0000 7f52589939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:23:01.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.001+0000 7f52589939c0 20 rados->read ofs=0 len=0 2024-09-19T14:23:01.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.005+0000 7f52589939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:23:01.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.005+0000 7f52589939c0 20 rados->read ofs=0 len=0 2024-09-19T14:23:01.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.005+0000 7f52589939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:23:01.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.005+0000 7f52589939c0 20 rados->read ofs=0 len=0 2024-09-19T14:23:01.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.005+0000 7f52589939c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:23:01.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.005+0000 7f52589939c0 20 searching for the correct realm 2024-09-19T14:23:01.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.009+0000 7f5255c98640 0 -- 172.21.15.153:0/1442937175 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x5602afbe0750 msgr2=0x5602afbe2bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:23:01.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.017+0000 7f5256499640 0 -- 172.21.15.153:0/1442937175 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f524c0a0310 msgr2=0x7f524c086870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:23:01.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.233+0000 7f52589939c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:23:01.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.233+0000 7f52589939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:23:01.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.233+0000 7f52589939c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:23:01.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.233+0000 7f52589939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:23:01.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.233+0000 7f52589939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:23:01.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.233+0000 7f52589939c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:23:01.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.233+0000 7f52589939c0 20 rados->read ofs=0 len=0 2024-09-19T14:23:01.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.233+0000 7f52589939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:23:01.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.233+0000 7f52589939c0 20 rados->read ofs=0 len=0 2024-09-19T14:23:01.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.237+0000 7f52589939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:23:01.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.237+0000 7f52589939c0 20 rados->read ofs=0 len=0 2024-09-19T14:23:01.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.237+0000 7f52589939c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:23:01.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.237+0000 7f52589939c0 20 zone default found 2024-09-19T14:23:01.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.237+0000 7f52589939c0 4 Realm: () 2024-09-19T14:23:01.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.237+0000 7f52589939c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:23:01.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.237+0000 7f52589939c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:23:01.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.237+0000 7f52589939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:23:01.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.237+0000 7f52589939c0 20 zonegroup default 2024-09-19T14:23:01.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.237+0000 7f52589939c0 20 rados->read ofs=0 len=0 2024-09-19T14:23:01.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.237+0000 7f52589939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:23:01.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.237+0000 7f52589939c0 20 rados->read ofs=0 len=0 2024-09-19T14:23:01.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.237+0000 7f52589939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:23:01.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.237+0000 7f52589939c0 20 rados->read ofs=0 len=0 2024-09-19T14:23:01.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.241+0000 7f52589939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:23:01.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.241+0000 7f52589939c0 20 started sync module instance, tier type = 2024-09-19T14:23:01.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.241+0000 7f52589939c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:23:01.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.261+0000 7f52589939c0 20 add_watcher() i=0 2024-09-19T14:23:01.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.261+0000 7f52589939c0 20 add_watcher() i=1 2024-09-19T14:23:01.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.261+0000 7f52589939c0 20 add_watcher() i=2 2024-09-19T14:23:01.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.261+0000 7f52589939c0 20 add_watcher() i=3 2024-09-19T14:23:01.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.261+0000 7f52589939c0 20 add_watcher() i=4 2024-09-19T14:23:01.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.261+0000 7f52589939c0 20 add_watcher() i=5 2024-09-19T14:23:01.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.261+0000 7f52589939c0 20 add_watcher() i=6 2024-09-19T14:23:01.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.265+0000 7f52589939c0 20 add_watcher() i=7 2024-09-19T14:23:01.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.265+0000 7f52589939c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:23:01.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.269+0000 7f510d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:23:01.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.269+0000 7f52589939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:23:01.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.269+0000 7f52589939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:23:01.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.361+0000 7f51077fe640 20 reqs_thread_entry: start 2024-09-19T14:23:01.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.361+0000 7f52589939c0 20 init_complete bucket index max shards: 11 2024-09-19T14:23:01.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.361+0000 7f52589939c0 20 Filter name: none 2024-09-19T14:23:01.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.361+0000 7f51057fa640 20 reqs_thread_entry: start 2024-09-19T14:23:01.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.361+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:23:01.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.365+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.365+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.365+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.369+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:23:01.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.369+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.373+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.373+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.377+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:23:01.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.381+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.381+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.381+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.381+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:23:01.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.385+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.385+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.385+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.389+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:23:01.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.393+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.393+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.393+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.393+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:23:01.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.397+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.401+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.401+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.405+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:23:01.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.405+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.409+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.409+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.409+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:23:01.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.413+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.413+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.417+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.417+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:23:01.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.421+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.421+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.421+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.425+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:23:01.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.425+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.429+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.429+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.429+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:23:01.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.433+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.433+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.433+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.437+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:23:01.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.441+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.441+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.441+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.441+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:23:01.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.449+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.449+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.449+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.453+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:23:01.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.453+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.453+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.457+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.457+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:23:01.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.461+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.465+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.465+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.465+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:23:01.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.469+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.469+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.473+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.473+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:23:01.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.477+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.477+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.481+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.481+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:23:01.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.485+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.485+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.489+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.489+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:23:01.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.493+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.497+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.497+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.497+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:23:01.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.501+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.505+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.505+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.509+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:23:01.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.513+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.513+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.513+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.517+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:23:01.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.521+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.521+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.521+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.525+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:23:01.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.529+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.529+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.529+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.533+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:23:01.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.537+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.537+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.541+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.541+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:23:01.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.545+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.545+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.549+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.549+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:23:01.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.553+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.557+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.557+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.561+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:23:01.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.561+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.565+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.565+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.569+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:23:01.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.569+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.573+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.573+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.573+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:23:01.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.577+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.577+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.581+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.581+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:23:01.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.585+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.585+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.589+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.589+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:23:01.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.593+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.593+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.593+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.597+0000 7f52589939c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:23:01.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.601+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.601+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:23:01.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.601+0000 7f52589939c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:23:01.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.609+0000 7f510d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:23:01.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.613+0000 7f52589939c0 20 remove_watcher() i=0 2024-09-19T14:23:01.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.613+0000 7f52589939c0 2 removed watcher, disabling cache 2024-09-19T14:23:01.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.617+0000 7f52589939c0 20 remove_watcher() i=1 2024-09-19T14:23:01.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.617+0000 7f52589939c0 20 remove_watcher() i=2 2024-09-19T14:23:01.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.621+0000 7f52589939c0 20 remove_watcher() i=3 2024-09-19T14:23:01.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.621+0000 7f52589939c0 20 remove_watcher() i=4 2024-09-19T14:23:01.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.625+0000 7f52589939c0 20 remove_watcher() i=5 2024-09-19T14:23:01.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.625+0000 7f52589939c0 20 remove_watcher() i=6 2024-09-19T14:23:01.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:23:01.629+0000 7f52589939c0 20 remove_watcher() i=7 2024-09-19T14:23:01.650 DEBUG:teuthology.orchestra.run.smithi153:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-19T14:23:02.413 INFO:teuthology.orchestra.run.smithi153.stdout:> Task :clean 2024-09-19T14:23:03.110 INFO:teuthology.orchestra.run.smithi153.stdout:> Task :compileJava 2024-09-19T14:23:03.111 INFO:teuthology.orchestra.run.smithi153.stdout:> Task :processResources 2024-09-19T14:23:03.210 INFO:teuthology.orchestra.run.smithi153.stdout:> Task :classes 2024-09-19T14:23:03.610 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:03.610 INFO:teuthology.orchestra.run.smithi153.stdout:> Task :compileTestJava 2024-09-19T14:23:03.611 INFO:teuthology.orchestra.run.smithi153.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-19T14:23:03.611 INFO:teuthology.orchestra.run.smithi153.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-19T14:23:03.612 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:03.612 INFO:teuthology.orchestra.run.smithi153.stdout:> Task :processTestResources NO-SOURCE 2024-09-19T14:23:03.612 INFO:teuthology.orchestra.run.smithi153.stdout:> Task :testClasses 2024-09-19T14:23:05.611 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:05.611 INFO:teuthology.orchestra.run.smithi153.stdout:> Task :test 2024-09-19T14:23:05.611 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:05.611 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests STANDARD_OUT 2024-09-19T14:23:05.612 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19 14:23:04,961 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-19T14:23:05.612 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:05.612 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-19T14:23:05.612 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:05.612 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-19T14:23:07.110 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:07.110 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-19T14:23:07.310 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:07.310 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-19T14:23:08.110 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:08.110 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-19T14:23:08.310 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:08.310 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-19T14:23:09.010 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:09.010 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-19T14:23:21.111 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:21.111 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-19T14:23:21.810 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:21.810 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-19T14:23:22.010 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:22.011 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-19T14:23:22.710 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:22.710 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-19T14:23:23.211 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:23.211 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-19T14:23:23.910 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:23.910 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-19T14:23:24.012 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:24.012 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-19T14:23:24.110 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:24.110 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-19T14:23:24.310 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:24.311 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-19T14:23:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:25.010 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-19T14:23:33.610 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:33.611 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-19T14:23:34.310 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:34.311 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-19T14:23:34.610 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:34.611 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-19T14:23:35.310 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:35.311 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-19T14:23:35.711 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:35.711 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-19T14:23:36.410 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:36.410 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-19T14:23:36.611 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:36.611 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-19T14:23:37.410 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:37.410 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-19T14:23:37.610 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:37.611 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-19T14:23:38.310 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:38.310 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-19T14:23:38.510 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:38.511 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-19T14:23:39.110 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:39.111 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-19T14:23:39.310 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:39.310 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-19T14:23:40.010 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:40.011 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-19T14:23:40.410 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:40.411 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-19T14:23:41.110 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:41.110 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-19T14:23:53.211 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:53.211 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-19T14:23:54.610 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:23:54.611 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-19T14:24:41.510 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:24:41.511 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-19T14:24:42.810 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:24:42.810 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-19T14:24:43.010 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:24:43.010 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-19T14:24:43.710 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:24:43.710 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-19T14:24:43.910 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:24:43.911 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-19T14:24:45.110 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:24:45.110 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-19T14:24:57.310 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:24:57.310 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-19T14:24:58.111 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:24:58.111 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-19T14:24:58.111 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:24:58.111 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-19T14:24:58.310 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:24:58.310 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-19T14:25:15.710 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:25:15.710 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-19T14:25:19.510 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:25:19.510 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-19T14:25:43.811 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:25:43.811 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-19T14:25:44.810 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:25:44.810 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-19T14:25:55.210 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:25:55.211 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-19T14:25:56.010 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:25:56.010 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-19T14:27:09.611 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:27:09.611 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-19T14:27:10.310 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:27:10.310 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-19T14:27:25.010 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:27:25.010 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-19T14:27:25.710 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:27:25.710 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-19T14:27:36.310 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:27:36.311 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-19T14:27:37.010 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:27:37.010 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-19T14:27:41.410 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:27:41.410 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-19T14:28:30.610 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:30.611 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-19T14:28:30.710 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:30.711 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-19T14:28:30.810 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:30.810 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-19T14:28:31.010 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:31.010 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-19T14:28:31.810 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:31.810 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-19T14:28:32.010 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:32.010 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-19T14:28:32.710 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:32.710 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-19T14:28:32.910 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:32.910 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-19T14:28:33.610 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:33.610 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-19T14:28:33.810 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:33.810 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-19T14:28:34.510 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:34.510 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-19T14:28:34.710 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:34.710 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-19T14:28:35.410 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:35.410 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-19T14:28:35.610 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:35.610 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-19T14:28:36.410 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:36.410 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-19T14:28:36.910 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:36.910 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-19T14:28:37.910 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:37.910 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-19T14:28:38.510 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:38.510 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-19T14:28:39.410 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:39.410 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-19T14:28:40.010 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:40.010 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-19T14:28:41.010 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:41.010 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-19T14:28:41.510 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:41.510 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-19T14:28:42.510 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:42.510 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-19T14:28:43.110 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:43.110 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-19T14:28:44.110 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:44.110 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-19T14:28:44.610 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:44.610 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-19T14:28:45.610 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:45.610 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-19T14:28:46.210 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:46.210 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-19T14:28:47.210 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:47.210 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-19T14:28:47.710 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:47.710 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-19T14:28:48.710 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:48.710 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-19T14:28:49.210 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:49.210 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-19T14:28:50.310 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:50.310 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-19T14:28:50.810 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:50.810 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-19T14:28:51.810 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:51.810 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-19T14:28:52.410 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:52.410 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-19T14:28:53.410 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:53.410 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-19T14:28:53.810 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:53.810 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-19T14:28:54.710 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:54.710 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-19T14:28:55.310 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:55.310 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-19T14:28:56.210 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:56.210 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-19T14:28:56.710 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:56.710 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-19T14:28:57.710 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:57.710 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-19T14:28:58.210 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:58.210 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-19T14:28:59.210 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:59.210 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-19T14:28:59.710 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:28:59.710 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-19T14:29:00.810 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:00.810 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-19T14:29:01.310 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:01.310 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-19T14:29:02.310 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:02.310 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-19T14:29:02.810 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:02.810 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-19T14:29:03.810 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:03.810 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-19T14:29:04.210 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:04.210 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-19T14:29:05.210 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:05.210 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-19T14:29:05.710 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:05.710 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-19T14:29:06.610 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:06.610 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-19T14:29:07.010 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:07.010 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-19T14:29:07.910 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:07.910 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-19T14:29:08.410 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:08.410 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-19T14:29:09.410 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:09.410 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-19T14:29:09.510 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:09.510 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-19T14:29:10.210 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:10.210 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-19T14:29:10.410 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:10.410 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-19T14:29:11.110 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:11.110 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-19T14:29:11.410 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:11.410 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-19T14:29:12.210 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:12.210 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-19T14:29:12.510 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:12.510 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-19T14:29:13.310 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:13.310 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-19T14:29:13.910 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:13.910 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-19T14:29:14.610 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:14.610 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-19T14:29:14.710 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:14.710 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-19T14:29:14.810 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:14.810 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-19T14:29:15.110 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:15.110 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-19T14:29:15.910 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:15.910 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-19T14:29:16.210 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:16.210 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-19T14:29:16.910 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:16.910 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-19T14:29:17.410 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:17.410 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-19T14:29:18.010 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:18.010 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-19T14:29:18.210 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:18.210 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-19T14:29:18.910 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:18.910 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-19T14:29:31.210 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:31.210 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-19T14:29:32.010 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:32.010 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-19T14:29:45.110 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:45.110 INFO:teuthology.orchestra.run.smithi153.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-19T14:29:45.910 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:45.910 INFO:teuthology.orchestra.run.smithi153.stdout:---------------------------------------------------------------------- 2024-09-19T14:29:45.910 INFO:teuthology.orchestra.run.smithi153.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-19T14:29:45.910 INFO:teuthology.orchestra.run.smithi153.stdout:---------------------------------------------------------------------- 2024-09-19T14:29:45.910 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:45.910 INFO:teuthology.orchestra.run.smithi153.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-19T14:29:45.910 INFO:teuthology.orchestra.run.smithi153.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-19T14:29:45.911 INFO:teuthology.orchestra.run.smithi153.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-19T14:29:45.911 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:45.911 INFO:teuthology.orchestra.run.smithi153.stdout:BUILD SUCCESSFUL in 6m 44s 2024-09-19T14:29:45.911 INFO:teuthology.orchestra.run.smithi153.stdout:5 actionable tasks: 5 executed 2024-09-19T14:29:45.925 DEBUG:teuthology.orchestra.run.smithi153:> radosgw-admin gc process --include-all 2024-09-19T14:29:45.951 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:29:45.951 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:29:45.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:45.990+0000 7f970e3e69c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:45.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:45.994+0000 7f970e3e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:45.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:45.994+0000 7f970e3e69c0 20 realm 2024-09-19T14:29:45.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:45.994+0000 7f970e3e69c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:45.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:45.994+0000 7f970e3e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:45.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:45.994+0000 7f970e3e69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:29:45.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:45.994+0000 7f970e3e69c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:45.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:45.994+0000 7f970e3e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:45.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:45.994+0000 7f970e3e69c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:45.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:45.994+0000 7f970e3e69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:45.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:45.994+0000 7f970e3e69c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:45.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:45.998+0000 7f970e3e69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:29:45.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:45.998+0000 7f970e3e69c0 20 searching for the correct realm 2024-09-19T14:29:46.005 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.002+0000 7f970b6eb640 0 -- 172.21.15.153:0/277160065 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f96fc046040 msgr2=0x7f96fc04e160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:29:46.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.010+0000 7f970b6eb640 0 -- 172.21.15.153:0/277160065 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f95d4082310 msgr2=0x7f95d4084740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:46.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:29:46.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:29:46.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:29:46.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:29:46.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:29:46.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:29:46.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:46.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:46.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:46.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:46.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:46.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:29:46.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 20 zone default found 2024-09-19T14:29:46.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 4 Realm: () 2024-09-19T14:29:46.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:29:46.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:29:46.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:29:46.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 20 zonegroup default 2024-09-19T14:29:46.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:46.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:46.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:46.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:46.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:46.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:46.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 20 started sync module instance, tier type = 2024-09-19T14:29:46.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.018+0000 7f970e3e69c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:29:46.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.034+0000 7f970e3e69c0 20 add_watcher() i=0 2024-09-19T14:29:46.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.034+0000 7f970e3e69c0 20 add_watcher() i=1 2024-09-19T14:29:46.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.034+0000 7f970e3e69c0 20 add_watcher() i=2 2024-09-19T14:29:46.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.034+0000 7f970e3e69c0 20 add_watcher() i=3 2024-09-19T14:29:46.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.034+0000 7f970e3e69c0 20 add_watcher() i=4 2024-09-19T14:29:46.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.034+0000 7f970e3e69c0 20 add_watcher() i=5 2024-09-19T14:29:46.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.034+0000 7f970e3e69c0 20 add_watcher() i=6 2024-09-19T14:29:46.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.034+0000 7f970e3e69c0 20 add_watcher() i=7 2024-09-19T14:29:46.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.034+0000 7f970e3e69c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:29:46.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.038+0000 7f95c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:46.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.038+0000 7f970e3e69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:29:46.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.038+0000 7f970e3e69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:29:46.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.106+0000 7f95c0fe1640 20 reqs_thread_entry: start 2024-09-19T14:29:46.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.106+0000 7f970e3e69c0 20 init_complete bucket index max shards: 11 2024-09-19T14:29:46.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.106+0000 7f970e3e69c0 20 Filter name: none 2024-09-19T14:29:46.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.106+0000 7f953a7fc640 20 reqs_thread_entry: start 2024-09-19T14:29:46.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.106+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:29:46.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.110+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.114+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.114+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-19T14:29:46.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.114+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15387838410972997917', time=2024-09-19T16:24:15.317302+0000, chain.objs.size()=5 2024-09-19T14:29:46.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.114+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__multipart_key1.2~nClKHkjjXpsO_mKwMYtFC9ClzOWuOad.1 2024-09-19T14:29:46.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.114+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__multipart_key1.2~nClKHkjjXpsO_mKwMYtFC9ClzOWuOad.2 2024-09-19T14:29:46.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.114+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__multipart_key1.2~nClKHkjjXpsO_mKwMYtFC9ClzOWuOad.3 2024-09-19T14:29:46.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.114+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__multipart_key1.2~nClKHkjjXpsO_mKwMYtFC9ClzOWuOad.4 2024-09-19T14:29:46.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.114+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__multipart_key1.2~nClKHkjjXpsO_mKwMYtFC9ClzOWuOad.5 2024-09-19T14:29:46.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.114+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13281280165650413198', time=2024-09-19T16:24:28.483833+0000, chain.objs.size()=5 2024-09-19T14:29:46.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.114+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__multipart_key1.2~Oi0CCvmIwxjYmJgdJ-3MTZ6NW87RkXy.1 2024-09-19T14:29:46.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.114+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__shadow_key1.2~Oi0CCvmIwxjYmJgdJ-3MTZ6NW87RkXy.1_1 2024-09-19T14:29:46.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.114+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__multipart_key1.2~Oi0CCvmIwxjYmJgdJ-3MTZ6NW87RkXy.2 2024-09-19T14:29:46.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.114+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__shadow_key1.2~Oi0CCvmIwxjYmJgdJ-3MTZ6NW87RkXy.2_1 2024-09-19T14:29:46.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.114+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__multipart_key1.2~Oi0CCvmIwxjYmJgdJ-3MTZ6NW87RkXy.3 2024-09-19T14:29:46.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.114+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14407193921257928567', time=2024-09-19T16:27:21.289136+0000, chain.objs.size()=1 2024-09-19T14:29:46.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.114+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.103__shadow_.oulAzGeFYNvMbf8ySx5S_Kka18t0D_c_0 2024-09-19T14:29:46.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.114+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5917566404466163587', time=2024-09-19T16:29:03.229488+0000, chain.objs.size()=1 2024-09-19T14:29:46.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.114+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.129__shadow_.qKGBdnFIeaGKrAmIXrX1YZKFNITVpVZ_0 2024-09-19T14:29:46.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.130+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.138+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:29:46.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.142+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.142+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.142+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:29:46.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.142+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~l8bfun_NcoFW_OdA3Pjr5kZTqsidGgF', time=2024-09-19T16:23:21.047154+0000, chain.objs.size()=5 2024-09-19T14:29:46.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.142+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.79__multipart_key1.2~l8bfun_NcoFW_OdA3Pjr5kZTqsidGgF.1 2024-09-19T14:29:46.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.142+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.79__multipart_key1.2~l8bfun_NcoFW_OdA3Pjr5kZTqsidGgF.2 2024-09-19T14:29:46.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.142+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.79__multipart_key1.2~l8bfun_NcoFW_OdA3Pjr5kZTqsidGgF.3 2024-09-19T14:29:46.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.142+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.79__multipart_key1.2~l8bfun_NcoFW_OdA3Pjr5kZTqsidGgF.4 2024-09-19T14:29:46.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.142+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.79__multipart_key1.2~l8bfun_NcoFW_OdA3Pjr5kZTqsidGgF.5 2024-09-19T14:29:46.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.146+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.154+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:29:46.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.158+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.158+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.158+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-19T14:29:46.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.158+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3736930496087900064', time=2024-09-19T16:24:57.498436+0000, chain.objs.size()=5 2024-09-19T14:29:46.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.158+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.98__multipart_key1.2~tadRgTsJYDpR3nrwmaH3bi5lEjKO0eb.1 2024-09-19T14:29:46.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.158+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.98__multipart_key1.2~tadRgTsJYDpR3nrwmaH3bi5lEjKO0eb.2 2024-09-19T14:29:46.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.158+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.98__multipart_key1.2~tadRgTsJYDpR3nrwmaH3bi5lEjKO0eb.3 2024-09-19T14:29:46.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.158+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.98__multipart_key1.2~tadRgTsJYDpR3nrwmaH3bi5lEjKO0eb.4 2024-09-19T14:29:46.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.158+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.98__multipart_key1.2~tadRgTsJYDpR3nrwmaH3bi5lEjKO0eb.5 2024-09-19T14:29:46.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.158+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12230792473600646611', time=2024-09-19T16:28:41.703717+0000, chain.objs.size()=1 2024-09-19T14:29:46.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.158+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.115__shadow_.9eENX90VU5lSnT1rEmzjeSGdOq9Qg6n_0 2024-09-19T14:29:46.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.158+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9787652204437882167', time=2024-09-19T16:28:44.814170+0000, chain.objs.size()=1 2024-09-19T14:29:46.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.158+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.117__shadow_.2bey8UllpDARL0UUKZqUtmyRUJWLMoN_0 2024-09-19T14:29:46.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.158+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17364155635081645842', time=2024-09-19T16:28:51.116262+0000, chain.objs.size()=1 2024-09-19T14:29:46.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.158+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.121__shadow_.pVEI-3j8_6hGdfhaaRLqv1y4y5m8JWN_0 2024-09-19T14:29:46.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.158+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.97395283105810804', time=2024-09-19T16:29:07.355842+0000, chain.objs.size()=1 2024-09-19T14:29:46.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.158+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.132__shadow_.82tngOw_Pu31h8GF3ohqejNpTJdgJSZ_0 2024-09-19T14:29:46.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.158+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14250360212952856340', time=2024-09-19T16:29:45.319325+0000, chain.objs.size()=1 2024-09-19T14:29:46.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.158+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.144__shadow_.CRaDJZKfOGL9Nt1yRhOsvIr9dwGv9a9_0 2024-09-19T14:29:46.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.170+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.174+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:29:46.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.178+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.182+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.182+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-19T14:29:46.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.182+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4503011135221586775', time=2024-09-19T16:25:44.084323+0000, chain.objs.size()=5 2024-09-19T14:29:46.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.182+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.100__multipart_file2.mpg.2~Dv8DoU3WHc2Jt-s22TN4kx59w5ZTWoM.1 2024-09-19T14:29:46.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.182+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.100__multipart_file2.mpg.2~Dv8DoU3WHc2Jt-s22TN4kx59w5ZTWoM.2 2024-09-19T14:29:46.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.182+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.100__multipart_file2.mpg.2~Dv8DoU3WHc2Jt-s22TN4kx59w5ZTWoM.3 2024-09-19T14:29:46.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.182+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.100__multipart_file2.mpg.2~Dv8DoU3WHc2Jt-s22TN4kx59w5ZTWoM.4 2024-09-19T14:29:46.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.182+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.100__multipart_file2.mpg.2~Dv8DoU3WHc2Jt-s22TN4kx59w5ZTWoM.5 2024-09-19T14:29:46.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.182+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16311177362201357627', time=2024-09-19T16:28:41.829517+0000, chain.objs.size()=1 2024-09-19T14:29:46.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.182+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.115__shadow_.g3rEjWoac1gqh20UGiPC3BICogoOAHP_0 2024-09-19T14:29:46.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.182+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9175495661752787205', time=2024-09-19T16:28:56.865792+0000, chain.objs.size()=1 2024-09-19T14:29:46.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.182+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.125__shadow_.xSuG1Hg3FMbQkmpsEOKk-GkX-ctsu2m_0 2024-09-19T14:29:46.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.182+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10466555155019225855', time=2024-09-19T16:28:59.952729+0000, chain.objs.size()=1 2024-09-19T14:29:46.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.182+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.127__shadow_.Sy5LutoO5wqzYfxK7ad9fBXp8TXoACO_0 2024-09-19T14:29:46.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.182+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13798291543991978408', time=2024-09-19T16:29:07.282031+0000, chain.objs.size()=1 2024-09-19T14:29:46.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.182+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.132__shadow_.58hnFBu9PUsBnlsibfb1DXTUQdM0L4M_0 2024-09-19T14:29:46.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.190+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.198+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:29:46.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.198+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.198+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.198+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-19T14:29:46.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.198+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1229169354847354445', time=2024-09-19T16:24:20.300164+0000, chain.objs.size()=5 2024-09-19T14:29:46.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.198+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__multipart_key1.2~Pg2LVQ5tNerafSAstR8EIg5D8iX_gdZ.1 2024-09-19T14:29:46.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.198+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__multipart_key1.2~Pg2LVQ5tNerafSAstR8EIg5D8iX_gdZ.2 2024-09-19T14:29:46.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.198+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__multipart_key1.2~Pg2LVQ5tNerafSAstR8EIg5D8iX_gdZ.3 2024-09-19T14:29:46.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.198+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__multipart_key1.2~Pg2LVQ5tNerafSAstR8EIg5D8iX_gdZ.4 2024-09-19T14:29:46.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.198+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__multipart_key1.2~Pg2LVQ5tNerafSAstR8EIg5D8iX_gdZ.5 2024-09-19T14:29:46.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.198+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10092473862669021988', time=2024-09-19T16:28:43.524215+0000, chain.objs.size()=1 2024-09-19T14:29:46.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.198+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.116__shadow_.mABEL5r06mLqLbI9jIjFRXRtKkMjzx2_0 2024-09-19T14:29:46.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.198+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3326812013666187976', time=2024-09-19T16:28:49.442305+0000, chain.objs.size()=1 2024-09-19T14:29:46.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.198+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.120__shadow_.zFxVbjXHTKI9ukRp5L74aMI0NDtynJW_0 2024-09-19T14:29:46.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.198+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2085840258323478139', time=2024-09-19T16:28:56.938566+0000, chain.objs.size()=1 2024-09-19T14:29:46.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.198+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.125__shadow_.nCHsuPS99LEWCKCme-v4Jn4RjKrvOH2_0 2024-09-19T14:29:46.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.198+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16639668944374445457', time=2024-09-19T16:28:58.406816+0000, chain.objs.size()=1 2024-09-19T14:29:46.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.198+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.126__shadow_.b1owde_fTbS9xVFVW5TeSdeD9KpRoLU_0 2024-09-19T14:29:46.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.198+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9093849874237678812', time=2024-09-19T16:29:00.114873+0000, chain.objs.size()=1 2024-09-19T14:29:46.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.198+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.127__shadow_.JPccG7iChHQC5M0uqezl4DELgnJ_jtm_0 2024-09-19T14:29:46.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.198+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15195451005143440407', time=2024-09-19T16:29:04.442631+0000, chain.objs.size()=1 2024-09-19T14:29:46.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.198+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.130__shadow_.w4L9Xlti-tv6tmBxsmS7OT6SEv6NI20_0 2024-09-19T14:29:46.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.210+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.214+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:29:46.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.218+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.218+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.218+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-19T14:29:46.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.218+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16558200297729220481', time=2024-09-19T16:23:53.376212+0000, chain.objs.size()=5 2024-09-19T14:29:46.223 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.218+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.91__multipart_key1.2~nsuFtEHm0Nbta1TteD0PyIFTOq7Lgdy.1 2024-09-19T14:29:46.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.218+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.91__multipart_key1.2~nsuFtEHm0Nbta1TteD0PyIFTOq7Lgdy.2 2024-09-19T14:29:46.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.218+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.91__multipart_key1.2~nsuFtEHm0Nbta1TteD0PyIFTOq7Lgdy.3 2024-09-19T14:29:46.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.218+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.91__multipart_key1.2~nsuFtEHm0Nbta1TteD0PyIFTOq7Lgdy.4 2024-09-19T14:29:46.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.218+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.91__multipart_key1.2~nsuFtEHm0Nbta1TteD0PyIFTOq7Lgdy.5 2024-09-19T14:29:46.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.218+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2803285217734855066', time=2024-09-19T16:24:41.419701+0000, chain.objs.size()=5 2024-09-19T14:29:46.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.218+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__multipart_key1.2~Jfrko3ZcdaNoI_lQ8aVgVKq1ditGslT.1 2024-09-19T14:29:46.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.218+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__shadow_key1.2~Jfrko3ZcdaNoI_lQ8aVgVKq1ditGslT.1_1 2024-09-19T14:29:46.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.218+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__multipart_key1.2~Jfrko3ZcdaNoI_lQ8aVgVKq1ditGslT.2 2024-09-19T14:29:46.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.218+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__shadow_key1.2~Jfrko3ZcdaNoI_lQ8aVgVKq1ditGslT.2_1 2024-09-19T14:29:46.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.218+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__multipart_key1.2~Jfrko3ZcdaNoI_lQ8aVgVKq1ditGslT.3 2024-09-19T14:29:46.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.218+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~BMgGAUNbPvgS5asWRCL3_PFMIkFgWNd', time=2024-09-19T16:25:55.715761+0000, chain.objs.size()=5 2024-09-19T14:29:46.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.218+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.101__multipart_key1.2~BMgGAUNbPvgS5asWRCL3_PFMIkFgWNd.7 2024-09-19T14:29:46.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.222+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.101__multipart_key1.2~BMgGAUNbPvgS5asWRCL3_PFMIkFgWNd.8 2024-09-19T14:29:46.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.226+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.101__multipart_key1.2~BMgGAUNbPvgS5asWRCL3_PFMIkFgWNd.9 2024-09-19T14:29:46.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.226+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.101__multipart_key1.2~BMgGAUNbPvgS5asWRCL3_PFMIkFgWNd.10 2024-09-19T14:29:46.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.226+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.101__multipart_key1.2~BMgGAUNbPvgS5asWRCL3_PFMIkFgWNd.11 2024-09-19T14:29:46.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.226+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9029911660341449960', time=2024-09-19T16:28:37.263173+0000, chain.objs.size()=1 2024-09-19T14:29:46.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.226+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.112__shadow_.uPr21lrkJbwJphXYCre1kTk-j4kNicv_0 2024-09-19T14:29:46.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.230+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10679314866847420569', time=2024-09-19T16:28:49.519737+0000, chain.objs.size()=1 2024-09-19T14:29:46.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.230+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.120__shadow_.t_lIie67ar4tBs_CAbuBS5xeeHjNdl-_0 2024-09-19T14:29:46.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.230+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1620272485266736381', time=2024-09-19T16:29:01.568420+0000, chain.objs.size()=1 2024-09-19T14:29:46.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.230+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.128__shadow_.idisLixbAahPro_4x_tdFuLSK5nEWDp_0 2024-09-19T14:29:46.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.230+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16071908915517219802', time=2024-09-19T16:29:05.930811+0000, chain.objs.size()=1 2024-09-19T14:29:46.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.230+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.131__shadow_.nVjgb8yYPoueWcY144lVwWWeM7mn5zN_0 2024-09-19T14:29:46.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.234+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.238+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:29:46.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.242+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.242+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.242+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:29:46.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.242+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.468126043101558752', time=2024-09-19T16:26:48.511189+0000, chain.objs.size()=5 2024-09-19T14:29:46.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.242+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__multipart_key1.2~xpLX_r1flHWxSZgGv9QpyNBaZFe2n7P.1 2024-09-19T14:29:46.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.242+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__multipart_key1.2~xpLX_r1flHWxSZgGv9QpyNBaZFe2n7P.2 2024-09-19T14:29:46.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.242+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__multipart_key1.2~xpLX_r1flHWxSZgGv9QpyNBaZFe2n7P.3 2024-09-19T14:29:46.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.242+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__multipart_key1.2~xpLX_r1flHWxSZgGv9QpyNBaZFe2n7P.4 2024-09-19T14:29:46.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.242+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__multipart_key1.2~xpLX_r1flHWxSZgGv9QpyNBaZFe2n7P.5 2024-09-19T14:29:46.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.242+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7514962965428474167', time=2024-09-19T16:28:58.631049+0000, chain.objs.size()=1 2024-09-19T14:29:46.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.242+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.126__shadow_.JzE6FESsshepDthlri_q7dFLt_zQYoE_0 2024-09-19T14:29:46.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.250+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.254+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:29:46.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.254+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.258+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.258+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-19T14:29:46.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.258+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf', time=2024-09-19T16:27:53.421789+0000, chain.objs.size()=1 2024-09-19T14:29:46.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.258+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.19 2024-09-19T14:29:46.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.258+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf', time=2024-09-19T16:27:53.790010+0000, chain.objs.size()=55 2024-09-19T14:29:46.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.258+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.1 2024-09-19T14:29:46.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.258+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.2 2024-09-19T14:29:46.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.258+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.3 2024-09-19T14:29:46.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.258+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.4 2024-09-19T14:29:46.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.258+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.5 2024-09-19T14:29:46.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.258+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.6 2024-09-19T14:29:46.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.258+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.7 2024-09-19T14:29:46.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.258+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.8 2024-09-19T14:29:46.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.258+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.9 2024-09-19T14:29:46.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.258+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.10 2024-09-19T14:29:46.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.258+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.11 2024-09-19T14:29:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.266+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.12 2024-09-19T14:29:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.266+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.13 2024-09-19T14:29:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.266+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.14 2024-09-19T14:29:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.266+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.15 2024-09-19T14:29:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.266+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.16 2024-09-19T14:29:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.266+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.17 2024-09-19T14:29:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.266+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.18 2024-09-19T14:29:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.266+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.HdnrXf4EbyxO86ucmU1qIOrKVHq2-iIF.19 2024-09-19T14:29:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.266+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.20 2024-09-19T14:29:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.266+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.21 2024-09-19T14:29:46.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.266+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.22 2024-09-19T14:29:46.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.274+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.23 2024-09-19T14:29:46.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.274+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.24 2024-09-19T14:29:46.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.274+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.25 2024-09-19T14:29:46.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.274+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.26 2024-09-19T14:29:46.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.274+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.27 2024-09-19T14:29:46.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.274+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.28 2024-09-19T14:29:46.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.274+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.29 2024-09-19T14:29:46.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.274+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.30 2024-09-19T14:29:46.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.274+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.31 2024-09-19T14:29:46.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.274+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.32 2024-09-19T14:29:46.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.274+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.33 2024-09-19T14:29:46.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.278+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.34 2024-09-19T14:29:46.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.278+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.35 2024-09-19T14:29:46.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.282+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.36 2024-09-19T14:29:46.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.282+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.37 2024-09-19T14:29:46.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.282+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.38 2024-09-19T14:29:46.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.282+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.39 2024-09-19T14:29:46.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.282+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.40 2024-09-19T14:29:46.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.282+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.41 2024-09-19T14:29:46.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.282+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.42 2024-09-19T14:29:46.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.282+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.43 2024-09-19T14:29:46.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.282+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.44 2024-09-19T14:29:46.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.282+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.45 2024-09-19T14:29:46.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.282+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.46 2024-09-19T14:29:46.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.286+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.47 2024-09-19T14:29:46.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.286+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.48 2024-09-19T14:29:46.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.286+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.49 2024-09-19T14:29:46.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.286+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.50 2024-09-19T14:29:46.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.286+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.51 2024-09-19T14:29:46.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.286+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.52 2024-09-19T14:29:46.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.286+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.53 2024-09-19T14:29:46.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.290+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.54 2024-09-19T14:29:46.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.290+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.56 2024-09-19T14:29:46.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.290+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf', time=2024-09-19T16:27:55.459199+0000, chain.objs.size()=8 2024-09-19T14:29:46.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.290+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.55 2024-09-19T14:29:46.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.290+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.57 2024-09-19T14:29:46.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.294+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.58 2024-09-19T14:29:46.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.294+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.59 2024-09-19T14:29:46.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.294+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.60 2024-09-19T14:29:46.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.294+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.61 2024-09-19T14:29:46.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.294+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.62 2024-09-19T14:29:46.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.294+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.63 2024-09-19T14:29:46.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.294+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf', time=2024-09-19T16:27:57.302025+0000, chain.objs.size()=10 2024-09-19T14:29:46.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.294+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.64 2024-09-19T14:29:46.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.294+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.65 2024-09-19T14:29:46.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.294+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.66 2024-09-19T14:29:46.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.294+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.67 2024-09-19T14:29:46.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.294+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.68 2024-09-19T14:29:46.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.294+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.69 2024-09-19T14:29:46.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.298+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.70 2024-09-19T14:29:46.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.298+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.71 2024-09-19T14:29:46.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.298+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.72 2024-09-19T14:29:46.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.298+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.73 2024-09-19T14:29:46.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.298+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf', time=2024-09-19T16:27:58.420513+0000, chain.objs.size()=5 2024-09-19T14:29:46.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.298+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.74 2024-09-19T14:29:46.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.302+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.75 2024-09-19T14:29:46.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.302+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.76 2024-09-19T14:29:46.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.302+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.77 2024-09-19T14:29:46.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.302+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.78 2024-09-19T14:29:46.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.302+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf', time=2024-09-19T16:27:59.825804+0000, chain.objs.size()=5 2024-09-19T14:29:46.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.302+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.79 2024-09-19T14:29:46.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.302+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.80 2024-09-19T14:29:46.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.302+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.81 2024-09-19T14:29:46.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.302+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.82 2024-09-19T14:29:46.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.302+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.83 2024-09-19T14:29:46.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.306+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf', time=2024-09-19T16:28:01.300258+0000, chain.objs.size()=7 2024-09-19T14:29:46.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.306+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.84 2024-09-19T14:29:46.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.306+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.85 2024-09-19T14:29:46.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.306+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.86 2024-09-19T14:29:46.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.306+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.87 2024-09-19T14:29:46.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.306+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.88 2024-09-19T14:29:46.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.306+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.89 2024-09-19T14:29:46.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.306+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.90 2024-09-19T14:29:46.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.306+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf', time=2024-09-19T16:28:03.212506+0000, chain.objs.size()=6 2024-09-19T14:29:46.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.306+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.91 2024-09-19T14:29:46.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.306+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.92 2024-09-19T14:29:46.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.306+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.93 2024-09-19T14:29:46.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.306+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.94 2024-09-19T14:29:46.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.310+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.95 2024-09-19T14:29:46.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.310+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.96 2024-09-19T14:29:46.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.310+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf', time=2024-09-19T16:28:04.686040+0000, chain.objs.size()=6 2024-09-19T14:29:46.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.310+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.97 2024-09-19T14:29:46.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.310+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.98 2024-09-19T14:29:46.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.310+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.99 2024-09-19T14:29:46.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.310+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.100 2024-09-19T14:29:46.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.310+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.101 2024-09-19T14:29:46.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.310+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.102 2024-09-19T14:29:46.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.310+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf', time=2024-09-19T16:28:06.446063+0000, chain.objs.size()=8 2024-09-19T14:29:46.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.310+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.103 2024-09-19T14:29:46.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.310+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.104 2024-09-19T14:29:46.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.310+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.105 2024-09-19T14:29:46.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.314+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.106 2024-09-19T14:29:46.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.314+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.107 2024-09-19T14:29:46.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.314+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.108 2024-09-19T14:29:46.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.314+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.109 2024-09-19T14:29:46.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.318+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.111 2024-09-19T14:29:46.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.318+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf', time=2024-09-19T16:28:08.346697+0000, chain.objs.size()=8 2024-09-19T14:29:46.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.318+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.110 2024-09-19T14:29:46.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.318+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.112 2024-09-19T14:29:46.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.318+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.113 2024-09-19T14:29:46.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.318+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.114 2024-09-19T14:29:46.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.318+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.115 2024-09-19T14:29:46.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.318+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.116 2024-09-19T14:29:46.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.318+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.118 2024-09-19T14:29:46.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.318+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.119 2024-09-19T14:29:46.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.322+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf', time=2024-09-19T16:28:09.626664+0000, chain.objs.size()=3 2024-09-19T14:29:46.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.322+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.117 2024-09-19T14:29:46.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.322+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.120 2024-09-19T14:29:46.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.322+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.121 2024-09-19T14:29:46.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.322+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf', time=2024-09-19T16:28:10.943430+0000, chain.objs.size()=9 2024-09-19T14:29:46.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.322+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.122 2024-09-19T14:29:46.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.322+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.123 2024-09-19T14:29:46.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.322+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.124 2024-09-19T14:29:46.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.322+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.125 2024-09-19T14:29:46.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.322+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.126 2024-09-19T14:29:46.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.322+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.127 2024-09-19T14:29:46.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.322+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.128 2024-09-19T14:29:46.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.326+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.129 2024-09-19T14:29:46.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.326+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.130 2024-09-19T14:29:46.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.326+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf', time=2024-09-19T16:28:12.341362+0000, chain.objs.size()=1 2024-09-19T14:29:46.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.326+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.131 2024-09-19T14:29:46.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.326+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf', time=2024-09-19T16:28:13.949026+0000, chain.objs.size()=10 2024-09-19T14:29:46.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.326+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.132 2024-09-19T14:29:46.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.326+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.133 2024-09-19T14:29:46.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.326+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.134 2024-09-19T14:29:46.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.326+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.135 2024-09-19T14:29:46.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.326+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.136 2024-09-19T14:29:46.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.326+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.137 2024-09-19T14:29:46.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.326+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.138 2024-09-19T14:29:46.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.330+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.139 2024-09-19T14:29:46.332 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.330+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.140 2024-09-19T14:29:46.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.330+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.141 2024-09-19T14:29:46.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.330+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf', time=2024-09-19T16:28:16.219531+0000, chain.objs.size()=10 2024-09-19T14:29:46.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.330+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.142 2024-09-19T14:29:46.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.330+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.143 2024-09-19T14:29:46.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.330+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.144 2024-09-19T14:29:46.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.330+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.145 2024-09-19T14:29:46.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.330+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.146 2024-09-19T14:29:46.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.330+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.147 2024-09-19T14:29:46.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.334+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.148 2024-09-19T14:29:46.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.334+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.149 2024-09-19T14:29:46.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.334+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.150 2024-09-19T14:29:46.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.334+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.151 2024-09-19T14:29:46.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.334+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf', time=2024-09-19T16:28:30.063291+0000, chain.objs.size()=1 2024-09-19T14:29:46.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.334+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.19 2024-09-19T14:29:46.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.334+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf', time=2024-09-19T16:28:30.277711+0000, chain.objs.size()=212 2024-09-19T14:29:46.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.334+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.1 2024-09-19T14:29:46.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.334+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.2 2024-09-19T14:29:46.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.334+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.3 2024-09-19T14:29:46.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.334+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.4 2024-09-19T14:29:46.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.334+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.5 2024-09-19T14:29:46.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.338+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.6 2024-09-19T14:29:46.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.338+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.7 2024-09-19T14:29:46.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.338+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.8 2024-09-19T14:29:46.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.338+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.9 2024-09-19T14:29:46.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.338+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.10 2024-09-19T14:29:46.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.338+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.11 2024-09-19T14:29:46.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.338+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.12 2024-09-19T14:29:46.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.338+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.13 2024-09-19T14:29:46.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.338+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.14 2024-09-19T14:29:46.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.338+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.15 2024-09-19T14:29:46.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.338+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.16 2024-09-19T14:29:46.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.338+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.17 2024-09-19T14:29:46.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.338+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.18 2024-09-19T14:29:46.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.342+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.HdnrXf4EbyxO86ucmU1qIOrKVHq2-iIF.19 2024-09-19T14:29:46.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.342+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.20 2024-09-19T14:29:46.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.342+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.21 2024-09-19T14:29:46.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.342+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.22 2024-09-19T14:29:46.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.342+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.23 2024-09-19T14:29:46.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.342+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.24 2024-09-19T14:29:46.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.342+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.25 2024-09-19T14:29:46.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.342+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.26 2024-09-19T14:29:46.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.342+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.27 2024-09-19T14:29:46.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.342+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.28 2024-09-19T14:29:46.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.342+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.29 2024-09-19T14:29:46.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.342+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.30 2024-09-19T14:29:46.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.342+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.31 2024-09-19T14:29:46.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.346+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.32 2024-09-19T14:29:46.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.346+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.33 2024-09-19T14:29:46.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.346+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.34 2024-09-19T14:29:46.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.346+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.35 2024-09-19T14:29:46.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.346+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.36 2024-09-19T14:29:46.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.346+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.37 2024-09-19T14:29:46.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.346+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.38 2024-09-19T14:29:46.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.346+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.39 2024-09-19T14:29:46.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.346+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.40 2024-09-19T14:29:46.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.346+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.41 2024-09-19T14:29:46.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.346+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.42 2024-09-19T14:29:46.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.346+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.43 2024-09-19T14:29:46.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.346+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.44 2024-09-19T14:29:46.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.350+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.45 2024-09-19T14:29:46.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.350+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.46 2024-09-19T14:29:46.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.350+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.47 2024-09-19T14:29:46.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.350+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.48 2024-09-19T14:29:46.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.350+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.49 2024-09-19T14:29:46.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.350+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.50 2024-09-19T14:29:46.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.350+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.51 2024-09-19T14:29:46.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.350+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.52 2024-09-19T14:29:46.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.350+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.53 2024-09-19T14:29:46.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.350+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.54 2024-09-19T14:29:46.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.350+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.55 2024-09-19T14:29:46.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.350+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.56 2024-09-19T14:29:46.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.350+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.57 2024-09-19T14:29:46.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.350+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.58 2024-09-19T14:29:46.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.350+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.59 2024-09-19T14:29:46.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.350+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.60 2024-09-19T14:29:46.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.350+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.61 2024-09-19T14:29:46.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.350+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.62 2024-09-19T14:29:46.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.350+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.63 2024-09-19T14:29:46.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.350+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.64 2024-09-19T14:29:46.355 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.354+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.65 2024-09-19T14:29:46.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.354+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.66 2024-09-19T14:29:46.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.354+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.67 2024-09-19T14:29:46.357 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.354+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.68 2024-09-19T14:29:46.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.354+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.69 2024-09-19T14:29:46.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.354+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.70 2024-09-19T14:29:46.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.354+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.71 2024-09-19T14:29:46.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.354+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.72 2024-09-19T14:29:46.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.354+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.73 2024-09-19T14:29:46.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.354+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.74 2024-09-19T14:29:46.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.354+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.75 2024-09-19T14:29:46.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.358+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.76 2024-09-19T14:29:46.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.358+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.77 2024-09-19T14:29:46.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.358+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.78 2024-09-19T14:29:46.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.358+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.79 2024-09-19T14:29:46.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.358+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.80 2024-09-19T14:29:46.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.358+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.81 2024-09-19T14:29:46.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.358+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.82 2024-09-19T14:29:46.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.358+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.83 2024-09-19T14:29:46.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.358+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.84 2024-09-19T14:29:46.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.358+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.85 2024-09-19T14:29:46.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.358+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.86 2024-09-19T14:29:46.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.358+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.87 2024-09-19T14:29:46.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.358+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.88 2024-09-19T14:29:46.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.358+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.89 2024-09-19T14:29:46.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.358+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.90 2024-09-19T14:29:46.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.358+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.91 2024-09-19T14:29:46.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.362+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.92 2024-09-19T14:29:46.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.362+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.93 2024-09-19T14:29:46.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.362+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.94 2024-09-19T14:29:46.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.362+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.95 2024-09-19T14:29:46.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.362+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.96 2024-09-19T14:29:46.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.362+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.97 2024-09-19T14:29:46.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.362+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.98 2024-09-19T14:29:46.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.362+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.99 2024-09-19T14:29:46.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.362+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.100 2024-09-19T14:29:46.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.362+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.101 2024-09-19T14:29:46.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.362+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.102 2024-09-19T14:29:46.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.362+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.103 2024-09-19T14:29:46.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.362+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.104 2024-09-19T14:29:46.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.366+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.105 2024-09-19T14:29:46.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.366+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.106 2024-09-19T14:29:46.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.366+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.107 2024-09-19T14:29:46.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.366+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.108 2024-09-19T14:29:46.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.366+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.109 2024-09-19T14:29:46.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.366+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.110 2024-09-19T14:29:46.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.366+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.111 2024-09-19T14:29:46.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.366+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.112 2024-09-19T14:29:46.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.366+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.113 2024-09-19T14:29:46.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.366+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.114 2024-09-19T14:29:46.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.366+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.115 2024-09-19T14:29:46.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.366+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.116 2024-09-19T14:29:46.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.366+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.117 2024-09-19T14:29:46.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.366+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.118 2024-09-19T14:29:46.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.366+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.119 2024-09-19T14:29:46.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.366+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.120 2024-09-19T14:29:46.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.366+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.121 2024-09-19T14:29:46.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.370+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.122 2024-09-19T14:29:46.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.370+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.123 2024-09-19T14:29:46.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.370+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.124 2024-09-19T14:29:46.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.370+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.125 2024-09-19T14:29:46.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.370+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.126 2024-09-19T14:29:46.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.370+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.127 2024-09-19T14:29:46.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.370+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.128 2024-09-19T14:29:46.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.370+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.129 2024-09-19T14:29:46.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.370+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.130 2024-09-19T14:29:46.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.370+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.131 2024-09-19T14:29:46.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.370+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.132 2024-09-19T14:29:46.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.370+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.133 2024-09-19T14:29:46.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.370+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.134 2024-09-19T14:29:46.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.374+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.135 2024-09-19T14:29:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.374+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.136 2024-09-19T14:29:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.374+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.137 2024-09-19T14:29:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.374+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.138 2024-09-19T14:29:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.374+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.139 2024-09-19T14:29:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.374+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.140 2024-09-19T14:29:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.374+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.141 2024-09-19T14:29:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.374+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.142 2024-09-19T14:29:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.374+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.143 2024-09-19T14:29:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.374+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.144 2024-09-19T14:29:46.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.374+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.145 2024-09-19T14:29:46.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.374+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.146 2024-09-19T14:29:46.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.374+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.147 2024-09-19T14:29:46.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.374+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.148 2024-09-19T14:29:46.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.378+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.149 2024-09-19T14:29:46.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.378+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.150 2024-09-19T14:29:46.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.378+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.151 2024-09-19T14:29:46.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.378+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.152 2024-09-19T14:29:46.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.378+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.153 2024-09-19T14:29:46.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.378+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.154 2024-09-19T14:29:46.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.378+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.155 2024-09-19T14:29:46.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.378+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.156 2024-09-19T14:29:46.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.378+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.157 2024-09-19T14:29:46.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.378+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.158 2024-09-19T14:29:46.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.378+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.159 2024-09-19T14:29:46.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.378+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.160 2024-09-19T14:29:46.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.378+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.161 2024-09-19T14:29:46.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.378+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.162 2024-09-19T14:29:46.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.378+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.163 2024-09-19T14:29:46.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.378+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.164 2024-09-19T14:29:46.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.378+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.165 2024-09-19T14:29:46.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.382+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.166 2024-09-19T14:29:46.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.382+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.167 2024-09-19T14:29:46.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.382+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.168 2024-09-19T14:29:46.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.382+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.169 2024-09-19T14:29:46.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.382+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.170 2024-09-19T14:29:46.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.382+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.171 2024-09-19T14:29:46.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.382+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.172 2024-09-19T14:29:46.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.382+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.173 2024-09-19T14:29:46.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.382+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.174 2024-09-19T14:29:46.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.382+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.175 2024-09-19T14:29:46.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.382+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.176 2024-09-19T14:29:46.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.386+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.177 2024-09-19T14:29:46.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.386+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.178 2024-09-19T14:29:46.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.386+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.179 2024-09-19T14:29:46.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.390+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.180 2024-09-19T14:29:46.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.390+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.181 2024-09-19T14:29:46.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.390+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.182 2024-09-19T14:29:46.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.390+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.183 2024-09-19T14:29:46.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.390+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.184 2024-09-19T14:29:46.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.390+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.185 2024-09-19T14:29:46.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.390+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.186 2024-09-19T14:29:46.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.390+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.187 2024-09-19T14:29:46.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.390+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.188 2024-09-19T14:29:46.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.390+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.189 2024-09-19T14:29:46.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.390+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.190 2024-09-19T14:29:46.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.394+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.191 2024-09-19T14:29:46.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.394+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.192 2024-09-19T14:29:46.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.394+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.193 2024-09-19T14:29:46.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.394+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.194 2024-09-19T14:29:46.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.394+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.195 2024-09-19T14:29:46.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.394+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.196 2024-09-19T14:29:46.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.394+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.197 2024-09-19T14:29:46.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.394+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.198 2024-09-19T14:29:46.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.394+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.199 2024-09-19T14:29:46.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.394+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.200 2024-09-19T14:29:46.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.394+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.201 2024-09-19T14:29:46.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.398+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.202 2024-09-19T14:29:46.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.398+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.203 2024-09-19T14:29:46.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.398+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.204 2024-09-19T14:29:46.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.398+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.205 2024-09-19T14:29:46.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.398+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.206 2024-09-19T14:29:46.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.398+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.207 2024-09-19T14:29:46.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.398+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.208 2024-09-19T14:29:46.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.398+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.209 2024-09-19T14:29:46.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.402+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.210 2024-09-19T14:29:46.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.402+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.211 2024-09-19T14:29:46.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.402+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.105__multipart_key1.2~IDHld7o-8UQ7-OxkLOe4-EjWQYABJLf.212 2024-09-19T14:29:46.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.402+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17488596953361789869', time=2024-09-19T16:28:38.805582+0000, chain.objs.size()=1 2024-09-19T14:29:46.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.402+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.113__shadow_.MXEiwevBWb1XTwCief8bcymoOw5kUlF_0 2024-09-19T14:29:46.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.402+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15178124810425043654', time=2024-09-19T16:28:46.523454+0000, chain.objs.size()=1 2024-09-19T14:29:46.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.402+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.118__shadow_.U5FT-cSjggyHNzY6-XBF_IVn8L-9YVc_0 2024-09-19T14:29:46.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.402+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11785951734962403115', time=2024-09-19T16:28:47.938876+0000, chain.objs.size()=1 2024-09-19T14:29:46.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.402+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.119__shadow_.t3MzZ9jsA92tq6p1neUVtssueIESwbA_0 2024-09-19T14:29:46.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.406+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16659552146407376034', time=2024-09-19T16:28:48.164205+0000, chain.objs.size()=1 2024-09-19T14:29:46.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.406+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.119__shadow_.xI-wnT8is_G92Z1mQpapKKqI98wX2ui_0 2024-09-19T14:29:46.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.406+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6975568213486450460', time=2024-09-19T16:29:00.183219+0000, chain.objs.size()=1 2024-09-19T14:29:46.408 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.406+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.127__shadow_.vJN-qBn5PlZx0t9Vv5o57Qrrl3XhF8y_0 2024-09-19T14:29:46.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.410+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.410+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:29:46.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.414+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.414+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.414+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-19T14:29:46.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.414+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2901670960262146683', time=2024-09-19T16:28:37.132829+0000, chain.objs.size()=1 2024-09-19T14:29:46.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.414+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.112__shadow_.eAv4D9R_8RHh5SsbUVvwSJilF0Ulau0_0 2024-09-19T14:29:46.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.414+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17635364738627888346', time=2024-09-19T16:28:55.451288+0000, chain.objs.size()=1 2024-09-19T14:29:46.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.414+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.124__shadow_.--f0D2b1TypJrPNokF4AK__aJxJpT5O_0 2024-09-19T14:29:46.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.414+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1712149753073224847', time=2024-09-19T16:28:58.555083+0000, chain.objs.size()=1 2024-09-19T14:29:46.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.414+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.126__shadow_.GgPiqGN8vdtLa0nPNxXl2Gn5e2jPEuE_0 2024-09-19T14:29:46.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.414+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.418+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:29:46.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.418+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.418+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.422+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-19T14:29:46.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.422+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10171307227755684937', time=2024-09-19T16:24:41.730745+0000, chain.objs.size()=4 2024-09-19T14:29:46.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.422+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.93__shadow_.cADwnXlj5hbH2i32JWhlMhJTyuZnvDG_0 2024-09-19T14:29:46.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.422+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.93__shadow_.cADwnXlj5hbH2i32JWhlMhJTyuZnvDG_1 2024-09-19T14:29:46.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.422+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.93__shadow_.cADwnXlj5hbH2i32JWhlMhJTyuZnvDG_2 2024-09-19T14:29:46.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.422+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.93__shadow_.cADwnXlj5hbH2i32JWhlMhJTyuZnvDG_3 2024-09-19T14:29:46.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.422+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10056732737747500224', time=2024-09-19T16:28:43.377313+0000, chain.objs.size()=1 2024-09-19T14:29:46.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.422+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.116__shadow_.qzXNqrtWzWLlOQvAqaUFxLxe7l5OT_v_0 2024-09-19T14:29:46.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.422+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5316430718141529210', time=2024-09-19T16:28:55.511721+0000, chain.objs.size()=1 2024-09-19T14:29:46.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.422+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.124__shadow_.ilMCZk89w6FchIvVH5nE49UjA9VKkfe_0 2024-09-19T14:29:46.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.422+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15517619117612250583', time=2024-09-19T16:29:03.154205+0000, chain.objs.size()=1 2024-09-19T14:29:46.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.422+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.129__shadow_.jgC_sjbry0zGNIeobvj-M0nc1jIdtqQ_0 2024-09-19T14:29:46.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.426+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.426+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:29:46.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.430+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.432 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.430+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.430+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-19T14:29:46.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.430+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14575925026888395094', time=2024-09-19T16:25:43.936896+0000, chain.objs.size()=5 2024-09-19T14:29:46.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.430+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.100__multipart_file.mpg.2~UGUEZF16FNXKnsnw9sGFwMIhZTC2QLh.1 2024-09-19T14:29:46.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.430+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.100__multipart_file.mpg.2~UGUEZF16FNXKnsnw9sGFwMIhZTC2QLh.2 2024-09-19T14:29:46.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.430+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.100__multipart_file.mpg.2~UGUEZF16FNXKnsnw9sGFwMIhZTC2QLh.3 2024-09-19T14:29:46.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.430+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.100__multipart_file.mpg.2~UGUEZF16FNXKnsnw9sGFwMIhZTC2QLh.4 2024-09-19T14:29:46.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.430+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.100__multipart_file.mpg.2~UGUEZF16FNXKnsnw9sGFwMIhZTC2QLh.5 2024-09-19T14:29:46.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.430+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16772038342549932315', time=2024-09-19T16:27:09.803982+0000, chain.objs.size()=5 2024-09-19T14:29:46.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.430+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__multipart_key1.2~Ho-63pNj6EwG039G8tUaBSdln3acNSR.1 2024-09-19T14:29:46.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.430+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__shadow_key1.2~Ho-63pNj6EwG039G8tUaBSdln3acNSR.1_1 2024-09-19T14:29:46.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.430+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__multipart_key1.2~Ho-63pNj6EwG039G8tUaBSdln3acNSR.2 2024-09-19T14:29:46.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.430+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__shadow_key1.2~Ho-63pNj6EwG039G8tUaBSdln3acNSR.2_1 2024-09-19T14:29:46.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.430+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__multipart_key1.2~Ho-63pNj6EwG039G8tUaBSdln3acNSR.3 2024-09-19T14:29:46.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.430+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8275463524352263193', time=2024-09-19T16:28:38.649157+0000, chain.objs.size()=1 2024-09-19T14:29:46.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.430+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.113__shadow_.fVw0aRwfywkyBSE6GbeqAhW3XkSJtO1_0 2024-09-19T14:29:46.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.430+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16853125427757152804', time=2024-09-19T16:28:49.666430+0000, chain.objs.size()=1 2024-09-19T14:29:46.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.430+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.120__shadow_.ifdcb_t5Tkh2MK7uxQNSm1qwqT73O--_0 2024-09-19T14:29:46.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.434+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7618260486024689869', time=2024-09-19T16:29:01.715116+0000, chain.objs.size()=1 2024-09-19T14:29:46.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.434+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.128__shadow_.-xR7NsTelDHU0cqKD6OG2e58XWA4Yvg_0 2024-09-19T14:29:46.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.438+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.438+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:29:46.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.442+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.442+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.442+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-19T14:29:46.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.442+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9238607036434566574', time=2024-09-19T16:23:07.537616+0000, chain.objs.size()=1 2024-09-19T14:29:46.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.442+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.77__shadow_.k9gTOEs0ee1SbbozH5s2uWKuCuni7s1_0 2024-09-19T14:29:46.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.442+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10653856562510608749', time=2024-09-19T16:28:43.293158+0000, chain.objs.size()=1 2024-09-19T14:29:46.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.442+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.116__shadow_.fujKhoG5gRhMv82yUYrv1jb2pm8whDH_0 2024-09-19T14:29:46.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.442+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9330069606871043957', time=2024-09-19T16:28:51.042007+0000, chain.objs.size()=1 2024-09-19T14:29:46.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.442+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.121__shadow_.BzFNwf4bzy3SN3w7rUJYvwlR_rgaYTK_0 2024-09-19T14:29:46.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.442+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.446+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:29:46.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.446+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.446+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.450+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-19T14:29:46.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.450+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8867229780017411175', time=2024-09-19T16:28:40.417462+0000, chain.objs.size()=1 2024-09-19T14:29:46.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.450+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.114__shadow_.IzvRfk9AJoFbFh1UZ2aiiUqQc0CpkD5_0 2024-09-19T14:29:46.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.450+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6242820554543636390', time=2024-09-19T16:28:43.448810+0000, chain.objs.size()=1 2024-09-19T14:29:46.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.450+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.116__shadow_.JEY0PSBvH4AudGBk_h1oMlQgW8SQV_s_0 2024-09-19T14:29:46.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.450+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12087169013400489281', time=2024-09-19T16:28:52.580421+0000, chain.objs.size()=1 2024-09-19T14:29:46.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.450+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.122__shadow_.ypzus_9UUKojDj8hR912yOO4Gkgq6t0_0 2024-09-19T14:29:46.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.450+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.454+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:29:46.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.454+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.454+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.454+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-19T14:29:46.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.454+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16082469876065618206', time=2024-09-19T16:23:35.857354+0000, chain.objs.size()=1 2024-09-19T14:29:46.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.454+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.85__shadow_.j4i2m4r1w5udlvNQ3KItoWYOe-0HV_y_0 2024-09-19T14:29:46.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.454+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16004652551425832206', time=2024-09-19T16:25:18.605102+0000, chain.objs.size()=5 2024-09-19T14:29:46.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.454+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.99__multipart_key1.2~-5rbBpeD6Dsg-4xbktACfxduFLv-4ux.1 2024-09-19T14:29:46.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.454+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.99__multipart_key1.2~-5rbBpeD6Dsg-4xbktACfxduFLv-4ux.2 2024-09-19T14:29:46.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.454+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.99__multipart_key1.2~-5rbBpeD6Dsg-4xbktACfxduFLv-4ux.3 2024-09-19T14:29:46.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.454+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.99__multipart_key1.2~-5rbBpeD6Dsg-4xbktACfxduFLv-4ux.4 2024-09-19T14:29:46.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.454+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.99__multipart_key1.2~-5rbBpeD6Dsg-4xbktACfxduFLv-4ux.5 2024-09-19T14:29:46.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.454+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4528347483007672725', time=2024-09-19T16:26:18.069032+0000, chain.objs.size()=5 2024-09-19T14:29:46.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.454+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__multipart_key1.2~eOBQ7vYRmvHZ3J29khSLR_Z9_9z_Gmh.1 2024-09-19T14:29:46.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.454+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__multipart_key1.2~eOBQ7vYRmvHZ3J29khSLR_Z9_9z_Gmh.2 2024-09-19T14:29:46.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.454+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__multipart_key1.2~eOBQ7vYRmvHZ3J29khSLR_Z9_9z_Gmh.3 2024-09-19T14:29:46.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.454+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__multipart_key1.2~eOBQ7vYRmvHZ3J29khSLR_Z9_9z_Gmh.4 2024-09-19T14:29:46.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.454+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__multipart_key1.2~eOBQ7vYRmvHZ3J29khSLR_Z9_9z_Gmh.5 2024-09-19T14:29:46.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.454+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9428611418993774155', time=2024-09-19T16:28:49.592173+0000, chain.objs.size()=1 2024-09-19T14:29:46.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.454+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.120__shadow_.ytbThF1JDWsWAheI9DXV_o7khPxFYI7_0 2024-09-19T14:29:46.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.458+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1298364639115344346', time=2024-09-19T16:29:16.385417+0000, chain.objs.size()=1 2024-09-19T14:29:46.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.458+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.140__shadow_.kQyqgXe4rwYh8d7WLKStXpHCwKH0zt4_0 2024-09-19T14:29:46.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.458+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5563433175105072256', time=2024-09-19T16:29:31.402002+0000, chain.objs.size()=5 2024-09-19T14:29:46.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.458+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.143__multipart_key1.2~hytBemYhd5s1A3xEVTqpzR-3-jeB7kk.1 2024-09-19T14:29:46.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.458+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.143__multipart_key1.2~hytBemYhd5s1A3xEVTqpzR-3-jeB7kk.2 2024-09-19T14:29:46.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.458+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.143__multipart_key1.2~hytBemYhd5s1A3xEVTqpzR-3-jeB7kk.3 2024-09-19T14:29:46.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.458+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.143__multipart_key1.2~hytBemYhd5s1A3xEVTqpzR-3-jeB7kk.4 2024-09-19T14:29:46.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.458+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.143__multipart_key1.2~hytBemYhd5s1A3xEVTqpzR-3-jeB7kk.5 2024-09-19T14:29:46.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.458+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2175943476005642469', time=2024-09-19T16:29:45.231880+0000, chain.objs.size()=5 2024-09-19T14:29:46.463 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.458+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.144__multipart_key1/data/file.mpg.2~9CPIrvouHS0xy8CtkYNC93lFjbwBjC6.1 2024-09-19T14:29:46.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.458+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.144__multipart_key1/data/file.mpg.2~9CPIrvouHS0xy8CtkYNC93lFjbwBjC6.2 2024-09-19T14:29:46.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.458+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.144__multipart_key1/data/file.mpg.2~9CPIrvouHS0xy8CtkYNC93lFjbwBjC6.3 2024-09-19T14:29:46.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.458+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.144__multipart_key1/data/file.mpg.2~9CPIrvouHS0xy8CtkYNC93lFjbwBjC6.4 2024-09-19T14:29:46.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.462+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.144__multipart_key1/data/file.mpg.2~9CPIrvouHS0xy8CtkYNC93lFjbwBjC6.5 2024-09-19T14:29:46.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.470+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.470+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:29:46.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.474+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.474+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.474+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-19T14:29:46.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.474+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4483189635171671794', time=2024-09-19T16:27:36.441350+0000, chain.objs.size()=5 2024-09-19T14:29:46.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.474+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.104__multipart_key1.2~pOR0prgCPTyrnAdANMqAAxQkwhw07xO.1 2024-09-19T14:29:46.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.474+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.104__multipart_key1.2~pOR0prgCPTyrnAdANMqAAxQkwhw07xO.2 2024-09-19T14:29:46.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.474+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.104__multipart_key1.2~pOR0prgCPTyrnAdANMqAAxQkwhw07xO.3 2024-09-19T14:29:46.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.474+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.104__multipart_key1.2~pOR0prgCPTyrnAdANMqAAxQkwhw07xO.4 2024-09-19T14:29:46.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.474+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.104__multipart_key1.2~pOR0prgCPTyrnAdANMqAAxQkwhw07xO.5 2024-09-19T14:29:46.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.474+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15837008267857190314', time=2024-09-19T16:28:38.882658+0000, chain.objs.size()=1 2024-09-19T14:29:46.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.474+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.113__shadow_._SlbwLnZKqqWAPZe7hGIRwaa4JIVsS4_0 2024-09-19T14:29:46.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.474+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2687856608813932798', time=2024-09-19T16:29:06.005355+0000, chain.objs.size()=1 2024-09-19T14:29:46.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.474+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.131__shadow_.wG9nPdP3zKwYO0t-vZap-sYoAfda2Lt_0 2024-09-19T14:29:46.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.474+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10568885441411343133', time=2024-09-19T16:29:08.692519+0000, chain.objs.size()=1 2024-09-19T14:29:46.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.474+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.133__shadow_.HH4zfs3Uk_MNN1BOdHjmwGWBXon_55J_0 2024-09-19T14:29:46.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.478+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.482+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:29:46.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.482+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.482+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.482+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-19T14:29:46.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.482+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17904685491338195789', time=2024-09-19T16:24:24.378905+0000, chain.objs.size()=5 2024-09-19T14:29:46.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.482+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__multipart_key1.2~wBlGE03A_fkY8HGuTpU2YtYDsxYOfVw.1 2024-09-19T14:29:46.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.482+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__multipart_key1.2~wBlGE03A_fkY8HGuTpU2YtYDsxYOfVw.2 2024-09-19T14:29:46.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.482+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__multipart_key1.2~wBlGE03A_fkY8HGuTpU2YtYDsxYOfVw.3 2024-09-19T14:29:46.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.482+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__multipart_key1.2~wBlGE03A_fkY8HGuTpU2YtYDsxYOfVw.4 2024-09-19T14:29:46.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.482+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__multipart_key1.2~wBlGE03A_fkY8HGuTpU2YtYDsxYOfVw.5 2024-09-19T14:29:46.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.482+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13764376189595690832', time=2024-09-19T16:27:25.107524+0000, chain.objs.size()=5 2024-09-19T14:29:46.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.482+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.103__multipart_key1.2~iYRxmfrJTLr625zkkbH7hg1q-qp_NDg.1 2024-09-19T14:29:46.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.482+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.103__multipart_key1.2~iYRxmfrJTLr625zkkbH7hg1q-qp_NDg.2 2024-09-19T14:29:46.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.482+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.103__multipart_key1.2~iYRxmfrJTLr625zkkbH7hg1q-qp_NDg.3 2024-09-19T14:29:46.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.482+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.103__multipart_key1.2~iYRxmfrJTLr625zkkbH7hg1q-qp_NDg.4 2024-09-19T14:29:46.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.482+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.103__multipart_key1.2~iYRxmfrJTLr625zkkbH7hg1q-qp_NDg.5 2024-09-19T14:29:46.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.482+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2388029413861658921', time=2024-09-19T16:28:45.057551+0000, chain.objs.size()=1 2024-09-19T14:29:46.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.482+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.117__shadow_.maYfhYM2mP6sQ2eqc83tJZz22tY4QTX_0 2024-09-19T14:29:46.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.482+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14129353351344905084', time=2024-09-19T16:29:08.614736+0000, chain.objs.size()=1 2024-09-19T14:29:46.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.482+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.133__shadow_.6knWfCAmycVDOcWImp1GnTE0aDOEG-m_0 2024-09-19T14:29:46.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.490+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.494+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:29:46.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.494+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.494+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.494+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-19T14:29:46.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.494+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18343065264408157853', time=2024-09-19T16:27:09.512686+0000, chain.objs.size()=5 2024-09-19T14:29:46.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.494+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__multipart_key1.2~hD4dBxG5cx8GyG53HsC11SIpawKSXYy.1 2024-09-19T14:29:46.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.494+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__shadow_key1.2~hD4dBxG5cx8GyG53HsC11SIpawKSXYy.1_1 2024-09-19T14:29:46.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.494+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__multipart_key1.2~hD4dBxG5cx8GyG53HsC11SIpawKSXYy.2 2024-09-19T14:29:46.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.494+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__shadow_key1.2~hD4dBxG5cx8GyG53HsC11SIpawKSXYy.2_1 2024-09-19T14:29:46.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.494+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__multipart_key1.2~hD4dBxG5cx8GyG53HsC11SIpawKSXYy.3 2024-09-19T14:29:46.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.494+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6007954464460913384', time=2024-09-19T16:28:46.592238+0000, chain.objs.size()=1 2024-09-19T14:29:46.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.494+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.118__shadow_.CqkPtKWgT5NkkyZYq9PejMmycvgMCUk_0 2024-09-19T14:29:46.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.494+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.81154432968927022', time=2024-09-19T16:28:57.079848+0000, chain.objs.size()=1 2024-09-19T14:29:46.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.494+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.125__shadow_.p0ody7cGz7OeBwqtyHCWpsocUg1mHNn_0 2024-09-19T14:29:46.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.494+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7972787158943792136', time=2024-09-19T16:29:00.045072+0000, chain.objs.size()=1 2024-09-19T14:29:46.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.494+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.127__shadow_.reMG6TPvlmvf8-06uamTE0vJgzAzGTc_0 2024-09-19T14:29:46.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.494+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7640467137517886896', time=2024-09-19T16:29:15.333586+0000, chain.objs.size()=1 2024-09-19T14:29:46.499 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.494+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.139__shadow_.vNrAOV7KqRYhPjUmf10CfiPSl7rdMUG_0 2024-09-19T14:29:46.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.498+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.502+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:29:46.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.502+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.502+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.502+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:29:46.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.502+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.427052124794785900', time=2024-09-19T16:29:01.641544+0000, chain.objs.size()=1 2024-09-19T14:29:46.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.502+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.128__shadow_.x7L1nKIsRTMHhwVWRNdLpzgRhbkcmTh_0 2024-09-19T14:29:46.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.506+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.506+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:29:46.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.510+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.510+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.510+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-19T14:29:46.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.510+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5325362473176157422', time=2024-09-19T16:25:44.155539+0000, chain.objs.size()=1 2024-09-19T14:29:46.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.510+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.100__shadow_.b_FSu8IXzuZnitFEINxtX5jUZcOfzlM_0 2024-09-19T14:29:46.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.510+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13624723111985809659', time=2024-09-19T16:28:40.343694+0000, chain.objs.size()=1 2024-09-19T14:29:46.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.510+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.114__shadow_.f54W47zLMLQbvEx0vN_We7GHgGgt7od_0 2024-09-19T14:29:46.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.510+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18016992695465478167', time=2024-09-19T16:29:07.186199+0000, chain.objs.size()=1 2024-09-19T14:29:46.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.510+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.132__shadow_.4sRq4HFy8VHNQGV5R3Ar9Eg4vuSOSOx_0 2024-09-19T14:29:46.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.510+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8507011547992361928', time=2024-09-19T16:29:11.631810+0000, chain.objs.size()=1 2024-09-19T14:29:46.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.510+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.136__shadow_.MLiQb0ALwT7whbn_lsTW3OQATK769gE_0 2024-09-19T14:29:46.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.510+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11158874788629047230', time=2024-09-19T16:29:13.620755+0000, chain.objs.size()=1 2024-09-19T14:29:46.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.510+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.138__shadow_.lkQDdYvsYQ5MUd7BMUmGqnIo2h30q0u_0 2024-09-19T14:29:46.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.514+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.514+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:29:46.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.518+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.518+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.518+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-19T14:29:46.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.518+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11152513797796854760', time=2024-09-19T16:25:44.220430+0000, chain.objs.size()=1 2024-09-19T14:29:46.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.518+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.100__shadow_.avUp2ELmOXxc2TzhksTSOIkk2OeJFo8_0 2024-09-19T14:29:46.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.518+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1201665887044012245', time=2024-09-19T16:28:54.094210+0000, chain.objs.size()=1 2024-09-19T14:29:46.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.518+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.123__shadow_.95FNaxgBZywdZmFH6MPoTgZm158Pnv4_0 2024-09-19T14:29:46.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.518+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15638937128413370168', time=2024-09-19T16:28:55.586681+0000, chain.objs.size()=1 2024-09-19T14:29:46.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.518+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.124__shadow_.VEkaH2p8jiIg8FdTA1yMaOJ4UBDjCJm_0 2024-09-19T14:29:46.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.522+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.522+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:29:46.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.526+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.526+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.526+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-19T14:29:46.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.526+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5643501105989742140', time=2024-09-19T16:28:31.202104+0000, chain.objs.size()=1 2024-09-19T14:29:46.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.526+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.106__shadow_.B9dOJpc0w3tt1l3eKa5dq68vdoSAC8d_0 2024-09-19T14:29:46.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.526+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5421435744265531937', time=2024-09-19T16:28:51.190304+0000, chain.objs.size()=1 2024-09-19T14:29:46.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.526+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.121__shadow_.gbGmJ_xXkFYqOFk_cGINUVfWlE5g1mX_0 2024-09-19T14:29:46.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.526+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10723397970164127731', time=2024-09-19T16:29:05.855748+0000, chain.objs.size()=1 2024-09-19T14:29:46.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.526+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.131__shadow_.njAJTD7LCVdsknVGfXbyJdBjh_tt1NQ_0 2024-09-19T14:29:46.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.526+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.530+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:29:46.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.530+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.530+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.530+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-19T14:29:46.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.530+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9951622423971287813', time=2024-09-19T16:23:34.820704+0000, chain.objs.size()=1 2024-09-19T14:29:46.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.530+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.84__shadow_.gZjYxLb0Az_NwynzBxMaPid57vEu_-e_0 2024-09-19T14:29:46.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.530+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4864430054077513236', time=2024-09-19T16:23:53.992380+0000, chain.objs.size()=5 2024-09-19T14:29:46.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.530+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.91__multipart_key1.2~nsuFtEHm0Nbta1TteD0PyIFTOq7Lgdy.1 2024-09-19T14:29:46.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.530+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.91__multipart_key1.2~nsuFtEHm0Nbta1TteD0PyIFTOq7Lgdy.2 2024-09-19T14:29:46.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.530+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.91__multipart_key1.2~nsuFtEHm0Nbta1TteD0PyIFTOq7Lgdy.3 2024-09-19T14:29:46.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.530+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.91__multipart_key1.2~nsuFtEHm0Nbta1TteD0PyIFTOq7Lgdy.4 2024-09-19T14:29:46.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.530+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.91__multipart_key1.2~nsuFtEHm0Nbta1TteD0PyIFTOq7Lgdy.5 2024-09-19T14:29:46.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.530+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1478872061700664127', time=2024-09-19T16:28:44.888242+0000, chain.objs.size()=1 2024-09-19T14:29:46.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.530+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.117__shadow_.qeyL2NkprLLTYHCqD6-JJxopGVHhyGl_0 2024-09-19T14:29:46.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.530+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9777830467232951300', time=2024-09-19T16:28:46.446821+0000, chain.objs.size()=1 2024-09-19T14:29:46.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.530+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.118__shadow_.JgC29AgJ5-6GfjI9GJlsokZJ2GKF15l_0 2024-09-19T14:29:46.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.538+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.538+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:29:46.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.542+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.542+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.542+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-19T14:29:46.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.542+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6694494300318674462', time=2024-09-19T16:23:33.755157+0000, chain.objs.size()=2 2024-09-19T14:29:46.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.542+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.83__shadow_.2DMpGtswwUa_rseWrMGDADiDJkYCnne_0 2024-09-19T14:29:46.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.542+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.83__shadow_.2DMpGtswwUa_rseWrMGDADiDJkYCnne_1 2024-09-19T14:29:46.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.542+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.346675853647557017', time=2024-09-19T16:28:40.268383+0000, chain.objs.size()=1 2024-09-19T14:29:46.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.542+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.114__shadow_.rDdiwOmAw0MtmeidWzwy5jxqeviZLN9_0 2024-09-19T14:29:46.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.542+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13972367116820158532', time=2024-09-19T16:28:51.262741+0000, chain.objs.size()=1 2024-09-19T14:29:46.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.542+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.121__shadow_.XVkZ-DlBEAOj6P2ua7Po9Xy0DBtoXhF_0 2024-09-19T14:29:46.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.546+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.546+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:29:46.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.550+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.550+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.550+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-19T14:29:46.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.550+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1351138887220941500', time=2024-09-19T16:28:52.793849+0000, chain.objs.size()=1 2024-09-19T14:29:46.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.550+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.122__shadow_.A_PatPRd50FPqDbz1RZ2aXOnXZzr0DJ_0 2024-09-19T14:29:46.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.550+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14728782586564474859', time=2024-09-19T16:28:54.171047+0000, chain.objs.size()=1 2024-09-19T14:29:46.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.550+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.123__shadow_.7I-oKKJDV1zEsvk8AFVOFLO5J65ObJG_0 2024-09-19T14:29:46.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.550+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3812677862220908540', time=2024-09-19T16:29:03.006935+0000, chain.objs.size()=1 2024-09-19T14:29:46.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.550+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.129__shadow_.e5zEVwe8gR0wzte0-7vJWBLLS11xsCB_0 2024-09-19T14:29:46.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.550+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.554+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:29:46.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.554+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.558+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.558+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-19T14:29:46.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.558+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4048772951780447499', time=2024-09-19T16:28:44.983151+0000, chain.objs.size()=1 2024-09-19T14:29:46.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.558+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.117__shadow_.WEd6k8ycjTpzRZKaTmHptFQWfEAx0jB_0 2024-09-19T14:29:46.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.558+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14468405544023834285', time=2024-09-19T16:28:48.016019+0000, chain.objs.size()=1 2024-09-19T14:29:46.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.558+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.119__shadow_.vA5KI64WW24g4_mrR4SIbaLat6fI6Dz_0 2024-09-19T14:29:46.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.558+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.562+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:29:46.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.562+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.566+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.566+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:29:46.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.566+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3403282711639328595', time=2024-09-19T16:25:44.004346+0000, chain.objs.size()=1 2024-09-19T14:29:46.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.566+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.100__shadow_.G7OBPCVHWLROVN8cBK14a-CvTNCgzCh_0 2024-09-19T14:29:46.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.566+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.570+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:29:46.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.570+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.570+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.570+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-19T14:29:46.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.570+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15949271628615241050', time=2024-09-19T16:23:23.362776+0000, chain.objs.size()=1 2024-09-19T14:29:46.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.570+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.81__shadow_.Dj4j1fwhNuRFX6Sbwe7q1AbzJOiYuvx_0 2024-09-19T14:29:46.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.570+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10956948688301798318', time=2024-09-19T16:28:38.723730+0000, chain.objs.size()=1 2024-09-19T14:29:46.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.570+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.113__shadow_.eM5aVDqtgZYSrmnLGwiIZ4uA-i8TfwK_0 2024-09-19T14:29:46.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.570+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7778143586990677925', time=2024-09-19T16:28:58.481016+0000, chain.objs.size()=1 2024-09-19T14:29:46.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.570+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.126__shadow_.RwCo3gZ5biCsnxilcagj0j67Q63sZsh_0 2024-09-19T14:29:46.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.570+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9800815256925341483', time=2024-09-19T16:29:04.515899+0000, chain.objs.size()=1 2024-09-19T14:29:46.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.570+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.130__shadow_.0Z3-NiqIYo8c1MWHRyja3h4JlgX9nZR_0 2024-09-19T14:29:46.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.574+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.578+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:29:46.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.578+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.578+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.578+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-19T14:29:46.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.578+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3586267009707262152', time=2024-09-19T16:28:46.381352+0000, chain.objs.size()=1 2024-09-19T14:29:46.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.578+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.118__shadow_.1cuRPw-Y3cgsfW0xf36zysGSodSfzRu_0 2024-09-19T14:29:46.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.578+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12490786816528025802', time=2024-09-19T16:28:52.654565+0000, chain.objs.size()=1 2024-09-19T14:29:46.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.578+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.122__shadow_.iQAaYs0olGFVt0E9m5gyrMQLHcASofT_0 2024-09-19T14:29:46.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.578+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16884589549973702265', time=2024-09-19T16:29:03.083140+0000, chain.objs.size()=1 2024-09-19T14:29:46.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.578+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.129__shadow_.oM-27nf-et_eC6PQ6YSxdn-JigGiW0L_0 2024-09-19T14:29:46.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.578+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4536369707175391429', time=2024-09-19T16:29:12.695927+0000, chain.objs.size()=1 2024-09-19T14:29:46.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.578+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.137__shadow_.9t6kSPSgYuTh655AbhHqAX-IZSgAcTd_0 2024-09-19T14:29:46.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.582+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.586+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:29:46.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.586+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.586+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.586+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-19T14:29:46.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.586+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17415426899160098332', time=2024-09-19T16:24:42.293832+0000, chain.objs.size()=5 2024-09-19T14:29:46.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.586+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__multipart_key1.2~_ZQ7hFxsDdu5M2QS_-zcuILUCkb0H1F.1 2024-09-19T14:29:46.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.586+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__shadow_key1.2~_ZQ7hFxsDdu5M2QS_-zcuILUCkb0H1F.1_1 2024-09-19T14:29:46.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.586+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__multipart_key1.2~_ZQ7hFxsDdu5M2QS_-zcuILUCkb0H1F.2 2024-09-19T14:29:46.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.586+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__shadow_key1.2~_ZQ7hFxsDdu5M2QS_-zcuILUCkb0H1F.2_1 2024-09-19T14:29:46.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.586+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.94__multipart_key1.2~_ZQ7hFxsDdu5M2QS_-zcuILUCkb0H1F.3 2024-09-19T14:29:46.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.586+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2216926323113187691', time=2024-09-19T16:28:57.005588+0000, chain.objs.size()=1 2024-09-19T14:29:46.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.586+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.125__shadow_.fvZCqOK2eGVidCdeaxqsa1Iydl6iksy_0 2024-09-19T14:29:46.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.586+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12498141348444865946', time=2024-09-19T16:29:01.493648+0000, chain.objs.size()=1 2024-09-19T14:29:46.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.586+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.128__shadow_.niAlqdnSZ30biybhpAecxugIHfVGbT8_0 2024-09-19T14:29:46.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.594+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.594+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:29:46.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.598+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.598+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.598+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T14:29:46.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.598+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3822375518997148714', time=2024-09-19T16:28:52.726500+0000, chain.objs.size()=1 2024-09-19T14:29:46.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.598+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.122__shadow_.qRjGYfyD5DSCerFmFg6fMpDlUZTgMeX_0 2024-09-19T14:29:46.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.598+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.602+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:29:46.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.602+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.602+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.602+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-19T14:29:46.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.602+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3326213578304918666', time=2024-09-19T16:26:28.906453+0000, chain.objs.size()=5 2024-09-19T14:29:46.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.602+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__multipart_key1.2~SzVuJJ0ECUzr91MFV2EBryswnZCzDew.1 2024-09-19T14:29:46.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.602+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__multipart_key1.2~SzVuJJ0ECUzr91MFV2EBryswnZCzDew.2 2024-09-19T14:29:46.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.602+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__multipart_key1.2~SzVuJJ0ECUzr91MFV2EBryswnZCzDew.3 2024-09-19T14:29:46.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.602+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__multipart_key1.2~SzVuJJ0ECUzr91MFV2EBryswnZCzDew.4 2024-09-19T14:29:46.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.602+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__multipart_key1.2~SzVuJJ0ECUzr91MFV2EBryswnZCzDew.5 2024-09-19T14:29:46.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.602+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3955763261887515396', time=2024-09-19T16:26:59.760898+0000, chain.objs.size()=5 2024-09-19T14:29:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.602+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__multipart_key1.2~lGYuUL-EmUMgOdsW-w-aN7M6WQKyEYO.1 2024-09-19T14:29:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.602+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__shadow_key1.2~lGYuUL-EmUMgOdsW-w-aN7M6WQKyEYO.1_1 2024-09-19T14:29:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.602+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__multipart_key1.2~lGYuUL-EmUMgOdsW-w-aN7M6WQKyEYO.2 2024-09-19T14:29:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.602+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__shadow_key1.2~lGYuUL-EmUMgOdsW-w-aN7M6WQKyEYO.2_1 2024-09-19T14:29:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.602+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.102__multipart_key1.2~lGYuUL-EmUMgOdsW-w-aN7M6WQKyEYO.3 2024-09-19T14:29:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.602+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7778648760702274351', time=2024-09-19T16:28:37.335559+0000, chain.objs.size()=1 2024-09-19T14:29:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.602+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.112__shadow_.FACup6HWby-CJvMq50vId-ffXsX50Mp_0 2024-09-19T14:29:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.602+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8661048538539801500', time=2024-09-19T16:28:41.908664+0000, chain.objs.size()=1 2024-09-19T14:29:46.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.602+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.115__shadow_.z1Q0C5NRYhfC3d_YFJNV7CAarBOJ4rR_0 2024-09-19T14:29:46.609 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.606+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17481958151133461442', time=2024-09-19T16:28:48.089702+0000, chain.objs.size()=1 2024-09-19T14:29:46.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.606+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.119__shadow_.EMJX8ooOOB_BVEBMIRBCIcLpSbzubbE_0 2024-09-19T14:29:46.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.606+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13272335493400560191', time=2024-09-19T16:29:13.790176+0000, chain.objs.size()=1 2024-09-19T14:29:46.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.610+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.138__shadow_.jVn2U6JYlUTIasdvnvdZ5MUiuxqPKiC_0 2024-09-19T14:29:46.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.610+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.614+0000 7f970e3e69c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:29:46.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.614+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:46.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.618+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:46.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.618+0000 7f970e3e69c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-19T14:29:46.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.618+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2659939416458284724', time=2024-09-19T16:23:40.238326+0000, chain.objs.size()=1 2024-09-19T14:29:46.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.618+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.90__shadow_.IPg7lSIxg8y_3Zm6Svps7x7cU3WPf1y_0 2024-09-19T14:29:46.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.618+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13909433838645980972', time=2024-09-19T16:28:37.199040+0000, chain.objs.size()=1 2024-09-19T14:29:46.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.618+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.112__shadow_.OxWy_tvaqjAM9V8ZkkiY9xkKB0BS3xf_0 2024-09-19T14:29:46.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.618+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.542967625755931399', time=2024-09-19T16:28:40.194977+0000, chain.objs.size()=1 2024-09-19T14:29:46.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.618+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.114__shadow_.QdbQ5arJL5RAQ0xunVSIne96K9_IciA_0 2024-09-19T14:29:46.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.618+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10012918561617521346', time=2024-09-19T16:28:41.766455+0000, chain.objs.size()=1 2024-09-19T14:29:46.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.618+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.115__shadow_.Y69H83U_uZ7bSofg7NTadLZggoKP9A3_0 2024-09-19T14:29:46.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.618+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11545744648042698561', time=2024-09-19T16:28:54.030767+0000, chain.objs.size()=1 2024-09-19T14:29:46.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.618+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.123__shadow_.hG6j4NXOTDvWqYkT0cHXnJkYtRot_dy_0 2024-09-19T14:29:46.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.618+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7711412434937630504', time=2024-09-19T16:29:04.588424+0000, chain.objs.size()=1 2024-09-19T14:29:46.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.618+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.130__shadow_.PKRoSVvcHC2AeYCePLfaVm5iYtJArrX_0 2024-09-19T14:29:46.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.618+0000 7f970e3e69c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9434824142099690599', time=2024-09-19T16:29:08.765280+0000, chain.objs.size()=1 2024-09-19T14:29:46.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.618+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.133__shadow_.kNTWpif0fzrZHXwI5CD7FSaJ_hZqtQs_0 2024-09-19T14:29:46.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.622+0000 7f970e3e69c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T14:29:46.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.622+0000 7f95c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:46.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.626+0000 7f970e3e69c0 20 remove_watcher() i=0 2024-09-19T14:29:46.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.626+0000 7f970e3e69c0 2 removed watcher, disabling cache 2024-09-19T14:29:46.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.626+0000 7f970e3e69c0 20 remove_watcher() i=1 2024-09-19T14:29:46.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.626+0000 7f970e3e69c0 20 remove_watcher() i=2 2024-09-19T14:29:46.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.630+0000 7f970e3e69c0 20 remove_watcher() i=3 2024-09-19T14:29:46.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.630+0000 7f970e3e69c0 20 remove_watcher() i=4 2024-09-19T14:29:46.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.630+0000 7f970e3e69c0 20 remove_watcher() i=5 2024-09-19T14:29:46.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.634+0000 7f970e3e69c0 20 remove_watcher() i=6 2024-09-19T14:29:46.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.634+0000 7f970e3e69c0 20 remove_watcher() i=7 2024-09-19T14:29:46.649 DEBUG:teuthology.orchestra.run.smithi153:> radosgw-admin gc process --include-all 2024-09-19T14:29:46.718 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:29:46.718 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:29:46.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.754+0000 7f9de3d869c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:46.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.758+0000 7f9de3d869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:46.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.758+0000 7f9de3d869c0 20 realm 2024-09-19T14:29:46.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.758+0000 7f9de3d869c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:46.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.758+0000 7f9de3d869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:46.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.758+0000 7f9de3d869c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:29:46.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.758+0000 7f9de3d869c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:46.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.758+0000 7f9de3d869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:46.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.758+0000 7f9de3d869c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:46.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.758+0000 7f9de3d869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:46.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.758+0000 7f9de3d869c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:46.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.758+0000 7f9de3d869c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:29:46.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.758+0000 7f9de3d869c0 20 searching for the correct realm 2024-09-19T14:29:46.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.766+0000 7f9de208d640 0 -- 172.21.15.153:0/4019186272 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7f9dd8101930 msgr2=0x7f9dd812da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:46.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.982+0000 7f9de188c640 0 -- 172.21.15.153:0/4019186272 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x5575b63c9220 msgr2=0x5575b63cb6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:46.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.990+0000 7f9de3d869c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:29:46.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.990+0000 7f9de3d869c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:29:46.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.990+0000 7f9de3d869c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:29:46.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.990+0000 7f9de3d869c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:29:46.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.990+0000 7f9de3d869c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:29:46.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.990+0000 7f9de3d869c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:29:46.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.990+0000 7f9de3d869c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:46.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.990+0000 7f9de3d869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:46.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.990+0000 7f9de3d869c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:46.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.990+0000 7f9de3d869c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:46.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.990+0000 7f9de3d869c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:46.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.990+0000 7f9de3d869c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:29:46.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.990+0000 7f9de3d869c0 20 zone default found 2024-09-19T14:29:46.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.990+0000 7f9de3d869c0 4 Realm: () 2024-09-19T14:29:46.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.990+0000 7f9de3d869c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:29:46.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.990+0000 7f9de3d869c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:29:46.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.990+0000 7f9de3d869c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:29:46.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.990+0000 7f9de3d869c0 20 zonegroup default 2024-09-19T14:29:46.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.990+0000 7f9de3d869c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:46.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.994+0000 7f9de3d869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:46.996 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.994+0000 7f9de3d869c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:46.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.994+0000 7f9de3d869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:46.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.994+0000 7f9de3d869c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:46.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.994+0000 7f9de3d869c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:46.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.994+0000 7f9de3d869c0 20 started sync module instance, tier type = 2024-09-19T14:29:46.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:46.994+0000 7f9de3d869c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:29:47.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.018+0000 7f9de3d869c0 20 add_watcher() i=0 2024-09-19T14:29:47.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.018+0000 7f9de3d869c0 20 add_watcher() i=1 2024-09-19T14:29:47.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.018+0000 7f9de3d869c0 20 add_watcher() i=2 2024-09-19T14:29:47.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.018+0000 7f9de3d869c0 20 add_watcher() i=3 2024-09-19T14:29:47.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.018+0000 7f9de3d869c0 20 add_watcher() i=4 2024-09-19T14:29:47.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.018+0000 7f9de3d869c0 20 add_watcher() i=5 2024-09-19T14:29:47.021 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.018+0000 7f9de3d869c0 20 add_watcher() i=6 2024-09-19T14:29:47.022 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.018+0000 7f9de3d869c0 20 add_watcher() i=7 2024-09-19T14:29:47.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.018+0000 7f9de3d869c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:29:47.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.022+0000 7f9c937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:47.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.026+0000 7f9de3d869c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:29:47.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.026+0000 7f9de3d869c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:29:47.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.126+0000 7f9c927fc640 20 reqs_thread_entry: start 2024-09-19T14:29:47.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.126+0000 7f9de3d869c0 20 init_complete bucket index max shards: 11 2024-09-19T14:29:47.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.126+0000 7f9de3d869c0 20 Filter name: none 2024-09-19T14:29:47.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.126+0000 7f9c03fff640 20 reqs_thread_entry: start 2024-09-19T14:29:47.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.126+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T14:29:47.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.130+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.130+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.130+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.134+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T14:29:47.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.134+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.138+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.138+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.142+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T14:29:47.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.142+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.142+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.146+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.146+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T14:29:47.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.150+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.150+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.154+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.154+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T14:29:47.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.158+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.158+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.158+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.162+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T14:29:47.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.162+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.162+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.162+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.166+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T14:29:47.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.170+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.170+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.170+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.176 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.174+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T14:29:47.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.174+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.174+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.178+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.178+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T14:29:47.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.182+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.182+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.182+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.186+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T14:29:47.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.186+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.186+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.190+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.190+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T14:29:47.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.194+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.194+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.198+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.198+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T14:29:47.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.202+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.202+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.202+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.209 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.206+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T14:29:47.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.210+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.210+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.214+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.214+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T14:29:47.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.218+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.218+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.218+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.218+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T14:29:47.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.222+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.222+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.226+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.226+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T14:29:47.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.230+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.230+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.235 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.234+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.234+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T14:29:47.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.238+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.238+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.238+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.242+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T14:29:47.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.246+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.246+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.246+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.246+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T14:29:47.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.250+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.250+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.254+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.254+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T14:29:47.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.258+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.258+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.258+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.258+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T14:29:47.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.262+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.262+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.262+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.266+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T14:29:47.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.270+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.270+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.270+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.274+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T14:29:47.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.278+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.278+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.278+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.282+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T14:29:47.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.282+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.286+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.286+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.286+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T14:29:47.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.290+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.290+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.290+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.294+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T14:29:47.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.298+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.298+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.298+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.302+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T14:29:47.308 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.306+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.306+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.306+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.310+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T14:29:47.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.314+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.314+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.314+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.318+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T14:29:47.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.322+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.322+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.322+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.326+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T14:29:47.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.330+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.330+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.330+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.334+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T14:29:47.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.338+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.338+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.338+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.338+0000 7f9de3d869c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T14:29:47.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.342+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.346+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T14:29:47.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.346+0000 7f9de3d869c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T14:29:47.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.350+0000 7f9c937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:47.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.354+0000 7f9de3d869c0 20 remove_watcher() i=0 2024-09-19T14:29:47.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.354+0000 7f9de3d869c0 2 removed watcher, disabling cache 2024-09-19T14:29:47.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.358+0000 7f9de3d869c0 20 remove_watcher() i=1 2024-09-19T14:29:47.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.358+0000 7f9de3d869c0 20 remove_watcher() i=2 2024-09-19T14:29:47.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.362+0000 7f9de3d869c0 20 remove_watcher() i=3 2024-09-19T14:29:47.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.362+0000 7f9de3d869c0 20 remove_watcher() i=4 2024-09-19T14:29:47.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.366+0000 7f9de3d869c0 20 remove_watcher() i=5 2024-09-19T14:29:47.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.366+0000 7f9de3d869c0 20 remove_watcher() i=6 2024-09-19T14:29:47.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:47.366+0000 7f9de3d869c0 20 remove_watcher() i=7 2024-09-19T14:29:47.390 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-19T14:29:47.407 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-19T14:29:47.408 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-19T14:29:47.408 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-19T14:29:47.408 DEBUG:teuthology.orchestra.run.smithi153:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-19T14:29:47.435 INFO:teuthology.orchestra.run.smithi153.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-19T14:29:48.445 INFO:tasks.s3tests:Creating rgw users... 2024-09-19T14:29:48.446 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-09-19T14:29:48.446 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.foo.client.0 --email foo+test@test.test --access-key DITVQTLCNOWDFBTPVJEN --secret 74s16JRm32AJXftJsnSSa0I6l/rU1PHTMM+T4ejk5n8vOSsQ4uX8iw== --cluster ceph 2024-09-19T14:29:48.532 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:29:48.532 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:29:48.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.570+0000 7f1ff1c059c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:48.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.570+0000 7f1ff1c059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:48.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.570+0000 7f1ff1c059c0 20 realm 2024-09-19T14:29:48.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.570+0000 7f1ff1c059c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:48.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.570+0000 7f1ff1c059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:48.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.570+0000 7f1ff1c059c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:29:48.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.570+0000 7f1ff1c059c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:48.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.570+0000 7f1ff1c059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:48.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.570+0000 7f1ff1c059c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:48.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.574+0000 7f1ff1c059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:48.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.574+0000 7f1ff1c059c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:48.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.574+0000 7f1ff1c059c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:29:48.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.574+0000 7f1ff1c059c0 20 searching for the correct realm 2024-09-19T14:29:48.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.578+0000 7f1feff0c640 0 -- 172.21.15.153:0/759758075 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f1fe4064580 msgr2=0x7f1fe406e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:48.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.586+0000 7f1fef70b640 0 -- 172.21.15.153:0/759758075 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f1fe4063c80 msgr2=0x7f1fe4099740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:48.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.802+0000 7f1ff1c059c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:29:48.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.802+0000 7f1ff1c059c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:29:48.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.802+0000 7f1ff1c059c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:29:48.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.802+0000 7f1ff1c059c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:29:48.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.802+0000 7f1ff1c059c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:29:48.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.802+0000 7f1ff1c059c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:29:48.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.802+0000 7f1ff1c059c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:48.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.802+0000 7f1ff1c059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:48.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.802+0000 7f1ff1c059c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:48.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.806+0000 7f1ff1c059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:48.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.806+0000 7f1ff1c059c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:48.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.806+0000 7f1ff1c059c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:29:48.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.806+0000 7f1ff1c059c0 20 zone default found 2024-09-19T14:29:48.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.806+0000 7f1ff1c059c0 4 Realm: () 2024-09-19T14:29:48.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.806+0000 7f1ff1c059c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:29:48.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.806+0000 7f1ff1c059c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:29:48.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.806+0000 7f1ff1c059c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:29:48.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.806+0000 7f1ff1c059c0 20 zonegroup default 2024-09-19T14:29:48.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.806+0000 7f1ff1c059c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:48.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.806+0000 7f1ff1c059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:48.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.806+0000 7f1ff1c059c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:48.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.806+0000 7f1ff1c059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:48.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.806+0000 7f1ff1c059c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:48.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.806+0000 7f1ff1c059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:48.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.806+0000 7f1ff1c059c0 20 started sync module instance, tier type = 2024-09-19T14:29:48.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.806+0000 7f1ff1c059c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:29:48.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.830+0000 7f1ff1c059c0 20 add_watcher() i=0 2024-09-19T14:29:48.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.830+0000 7f1ff1c059c0 20 add_watcher() i=1 2024-09-19T14:29:48.834 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.830+0000 7f1ff1c059c0 20 add_watcher() i=2 2024-09-19T14:29:48.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.830+0000 7f1ff1c059c0 20 add_watcher() i=3 2024-09-19T14:29:48.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.830+0000 7f1ff1c059c0 20 add_watcher() i=4 2024-09-19T14:29:48.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.830+0000 7f1ff1c059c0 20 add_watcher() i=5 2024-09-19T14:29:48.835 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.830+0000 7f1ff1c059c0 20 add_watcher() i=6 2024-09-19T14:29:48.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.834+0000 7f1ff1c059c0 20 add_watcher() i=7 2024-09-19T14:29:48.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.834+0000 7f1ff1c059c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:29:48.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.838+0000 7f1ea5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:48.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.838+0000 7f1ff1c059c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:29:48.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.838+0000 7f1ff1c059c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:29:48.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.838+0000 7f1ff1c059c0 5 note: GC not initialized 2024-09-19T14:29:48.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.838+0000 7f1ea4fe1640 20 reqs_thread_entry: start 2024-09-19T14:29:48.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.838+0000 7f1ff1c059c0 20 init_complete bucket index max shards: 11 2024-09-19T14:29:48.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.838+0000 7f1ff1c059c0 20 Filter name: none 2024-09-19T14:29:48.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.838+0000 7f1e1e7fc640 20 reqs_thread_entry: start 2024-09-19T14:29:48.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.838+0000 7f1ff1c059c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-19T14:29:48.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.838+0000 7f1ff1c059c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:48.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.842+0000 7f1ff1c059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:48.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.842+0000 7f1ff1c059c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-19T14:29:48.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.842+0000 7f1ff1c059c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-19T14:29:48.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.842+0000 7f1ff1c059c0 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-19T14:29:48.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.842+0000 7f1ff1c059c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:48.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.842+0000 7f1ff1c059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:48.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.842+0000 7f1ff1c059c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-19T14:29:48.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.842+0000 7f1ff1c059c0 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-19T14:29:48.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.842+0000 7f1ff1c059c0 10 cache get: name=default.rgw.meta+users.keys+DITVQTLCNOWDFBTPVJEN : miss 2024-09-19T14:29:48.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.842+0000 7f1ff1c059c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:48.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.842+0000 7f1ff1c059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:48.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.842+0000 7f1ff1c059c0 10 cache put: name=default.rgw.meta+users.keys+DITVQTLCNOWDFBTPVJEN info.flags=0x0 2024-09-19T14:29:48.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.842+0000 7f1ff1c059c0 10 adding default.rgw.meta+users.keys+DITVQTLCNOWDFBTPVJEN to cache LRU end 2024-09-19T14:29:48.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.842+0000 7f1ff1c059c0 10 cache get: name=default.rgw.meta+users.keys+DITVQTLCNOWDFBTPVJEN : hit (negative entry) 2024-09-19T14:29:48.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.842+0000 7f1ff1c059c0 10 cache get: name=default.rgw.meta+users.keys+DITVQTLCNOWDFBTPVJEN : hit (negative entry) 2024-09-19T14:29:48.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.842+0000 7f1ff1c059c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-19T14:29:48.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.842+0000 7f1ff1c059c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-19T14:29:48.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.842+0000 7f1ff1c059c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-19T14:29:48.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.842+0000 7f1ed2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333618 cookie 94231106262688 notifier 8408 bl.length()=645 2024-09-19T14:29:48.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.842+0000 7f1ed2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-19T14:29:48.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.842+0000 7f1ed2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-19T14:29:48.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.846+0000 7f1ff1c059c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-19T14:29:48.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.846+0000 7f1ff1c059c0 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-19T14:29:48.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.846+0000 7f1ff1c059c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-19T14:29:48.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.850+0000 7f1ed27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333619 cookie 94231106271696 notifier 8408 bl.length()=185 2024-09-19T14:29:48.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.850+0000 7f1ed27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-19T14:29:48.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.850+0000 7f1ed27fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-19T14:29:48.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.854+0000 7f1ff1c059c0 10 cache put: name=default.rgw.meta+users.keys+DITVQTLCNOWDFBTPVJEN info.flags=0x7 2024-09-19T14:29:48.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.854+0000 7f1ff1c059c0 10 moving default.rgw.meta+users.keys+DITVQTLCNOWDFBTPVJEN to cache LRU end 2024-09-19T14:29:48.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.854+0000 7f1ff1c059c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:DITVQTLCNOWDFBTPVJEN, ofs0, ns] 2024-09-19T14:29:48.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.854+0000 7f1ed27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333566 cookie 94231106274672 notifier 8408 bl.length()=186 2024-09-19T14:29:48.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.854+0000 7f1ed27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+DITVQTLCNOWDFBTPVJEN info.flags=0x7 2024-09-19T14:29:48.857 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.854+0000 7f1ed27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+DITVQTLCNOWDFBTPVJEN to cache LRU end 2024-09-19T14:29:48.859 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-19T14:29:48.859 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foo.client.0", 2024-09-19T14:29:48.860 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Mr.foo.client.0", 2024-09-19T14:29:48.860 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foo+test@test.test", 2024-09-19T14:29:48.860 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2024-09-19T14:29:48.860 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 1000, 2024-09-19T14:29:48.860 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2024-09-19T14:29:48.860 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2024-09-19T14:29:48.860 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-19T14:29:48.860 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foo.client.0", 2024-09-19T14:29:48.861 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "DITVQTLCNOWDFBTPVJEN", 2024-09-19T14:29:48.861 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "74s16JRm32AJXftJsnSSa0I6l/rU1PHTMM+T4ejk5n8vOSsQ4uX8iw==", 2024-09-19T14:29:48.861 INFO:teuthology.orchestra.run.smithi153.stdout: "active": true, 2024-09-19T14:29:48.861 INFO:teuthology.orchestra.run.smithi153.stdout: "create_date": "2024-09-19T14:29:48.844994Z" 2024-09-19T14:29:48.861 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-19T14:29:48.861 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-19T14:29:48.861 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2024-09-19T14:29:48.861 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2024-09-19T14:29:48.862 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2024-09-19T14:29:48.862 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2024-09-19T14:29:48.862 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2024-09-19T14:29:48.862 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2024-09-19T14:29:48.862 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2024-09-19T14:29:48.862 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2024-09-19T14:29:48.862 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:29:48.862 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2024-09-19T14:29:48.862 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:29:48.863 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2024-09-19T14:29:48.863 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:29:48.863 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2024-09-19T14:29:48.863 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2024-09-19T14:29:48.863 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:29:48.863 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2024-09-19T14:29:48.863 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:29:48.864 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2024-09-19T14:29:48.864 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:29:48.864 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2024-09-19T14:29:48.864 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2024-09-19T14:29:48.864 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [], 2024-09-19T14:29:48.864 INFO:teuthology.orchestra.run.smithi153.stdout: "account_id": "", 2024-09-19T14:29:48.864 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "/", 2024-09-19T14:29:48.864 INFO:teuthology.orchestra.run.smithi153.stdout: "create_date": "2024-09-19T14:29:48.844962Z", 2024-09-19T14:29:48.865 INFO:teuthology.orchestra.run.smithi153.stdout: "tags": [], 2024-09-19T14:29:48.865 INFO:teuthology.orchestra.run.smithi153.stdout: "group_ids": [] 2024-09-19T14:29:48.865 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-19T14:29:48.865 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:48.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.858+0000 7f1ea5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:48.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.862+0000 7f1ff1c059c0 20 remove_watcher() i=0 2024-09-19T14:29:48.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.862+0000 7f1ff1c059c0 2 removed watcher, disabling cache 2024-09-19T14:29:48.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.866+0000 7f1ff1c059c0 20 remove_watcher() i=1 2024-09-19T14:29:48.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.866+0000 7f1ff1c059c0 20 remove_watcher() i=2 2024-09-19T14:29:48.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.870+0000 7f1ff1c059c0 20 remove_watcher() i=3 2024-09-19T14:29:48.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.870+0000 7f1ff1c059c0 20 remove_watcher() i=4 2024-09-19T14:29:48.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.874+0000 7f1ff1c059c0 20 remove_watcher() i=5 2024-09-19T14:29:48.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.874+0000 7f1ff1c059c0 20 remove_watcher() i=6 2024-09-19T14:29:48.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.878+0000 7f1ff1c059c0 20 remove_watcher() i=7 2024-09-19T14:29:48.903 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 6841415080 --totp-seed XM7GIPPDLL644TO4G7TRIRS2K7S5GH64L653BWCEQLEICU6O4EMS5RZ6KPI7M6L5 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-19T14:29:48.950 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:29:48.950 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:29:48.991 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.986+0000 7f17b0d499c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:48.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.990+0000 7f17b0d499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:48.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.990+0000 7f17b0d499c0 20 realm 2024-09-19T14:29:48.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.990+0000 7f17b0d499c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:48.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.990+0000 7f17b0d499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:48.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.990+0000 7f17b0d499c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:29:48.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.990+0000 7f17b0d499c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:48.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.990+0000 7f17b0d499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:48.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.990+0000 7f17b0d499c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:48.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.990+0000 7f17b0d499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:48.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.990+0000 7f17b0d499c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:48.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.994+0000 7f17b0d499c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:29:48.995 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.994+0000 7f17b0d499c0 20 searching for the correct realm 2024-09-19T14:29:49.001 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:48.998+0000 7f17af050640 0 -- 172.21.15.153:0/1777255097 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x560ada706b90 msgr2=0x560ada709020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:49.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.006+0000 7f17ae84f640 0 -- 172.21.15.153:0/1777255097 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f1798073740 msgr2=0x7f179805dfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:49.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.014+0000 7f17b0d499c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:29:49.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.014+0000 7f17b0d499c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:29:49.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.014+0000 7f17b0d499c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:29:49.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.014+0000 7f17b0d499c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:29:49.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.014+0000 7f17b0d499c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:29:49.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.014+0000 7f17b0d499c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:29:49.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.014+0000 7f17b0d499c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:49.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.014+0000 7f17b0d499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:49.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.014+0000 7f17b0d499c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:49.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.014+0000 7f17b0d499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:49.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.014+0000 7f17b0d499c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:49.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.014+0000 7f17b0d499c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:29:49.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.014+0000 7f17b0d499c0 20 zone default found 2024-09-19T14:29:49.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.014+0000 7f17b0d499c0 4 Realm: () 2024-09-19T14:29:49.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.014+0000 7f17b0d499c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:29:49.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.014+0000 7f17b0d499c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:29:49.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.014+0000 7f17b0d499c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:29:49.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.014+0000 7f17b0d499c0 20 zonegroup default 2024-09-19T14:29:49.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.014+0000 7f17b0d499c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:49.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.014+0000 7f17b0d499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:49.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.014+0000 7f17b0d499c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:49.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.014+0000 7f17b0d499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:49.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.014+0000 7f17b0d499c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:49.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.018+0000 7f17b0d499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:49.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.018+0000 7f17b0d499c0 20 started sync module instance, tier type = 2024-09-19T14:29:49.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.018+0000 7f17b0d499c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:29:49.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.030+0000 7f17b0d499c0 20 add_watcher() i=0 2024-09-19T14:29:49.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.030+0000 7f17b0d499c0 20 add_watcher() i=1 2024-09-19T14:29:49.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.030+0000 7f17b0d499c0 20 add_watcher() i=2 2024-09-19T14:29:49.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.030+0000 7f17b0d499c0 20 add_watcher() i=3 2024-09-19T14:29:49.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.030+0000 7f17b0d499c0 20 add_watcher() i=4 2024-09-19T14:29:49.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.030+0000 7f17b0d499c0 20 add_watcher() i=5 2024-09-19T14:29:49.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.030+0000 7f17b0d499c0 20 add_watcher() i=6 2024-09-19T14:29:49.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.034+0000 7f17b0d499c0 20 add_watcher() i=7 2024-09-19T14:29:49.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.034+0000 7f17b0d499c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:29:49.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.034+0000 7f16657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:49.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.034+0000 7f17b0d499c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:29:49.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.034+0000 7f17b0d499c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:29:49.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.034+0000 7f17b0d499c0 5 note: GC not initialized 2024-09-19T14:29:49.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.034+0000 7f15dffff640 20 reqs_thread_entry: start 2024-09-19T14:29:49.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.034+0000 7f17b0d499c0 20 init_complete bucket index max shards: 11 2024-09-19T14:29:49.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.034+0000 7f17b0d499c0 20 Filter name: none 2024-09-19T14:29:49.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.038+0000 7f15ddffb640 20 reqs_thread_entry: start 2024-09-19T14:29:49.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.038+0000 7f17b0d499c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-19T14:29:49.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.038+0000 7f17b0d499c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:49.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.038+0000 7f17b0d499c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-19T14:29:49.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.038+0000 7f17b0d499c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-19T14:29:49.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.038+0000 7f17b0d499c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-19T14:29:49.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:49.038+0000 7f17b0d499c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:29:51.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.062+0000 7f17b0d499c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-19T14:29:51.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.062+0000 7f17b0d499c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-19T14:29:51.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.062+0000 7f17b0d499c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-19T14:29:51.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.062+0000 7f1691ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268212 cookie 94604614470672 notifier 8423 bl.length()=659 2024-09-19T14:29:51.064 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.062+0000 7f1691ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-19T14:29:51.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.062+0000 7f1691ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-19T14:29:51.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.066+0000 7f16657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:51.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.070+0000 7f17b0d499c0 20 remove_watcher() i=0 2024-09-19T14:29:51.075 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.070+0000 7f17b0d499c0 2 removed watcher, disabling cache 2024-09-19T14:29:51.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.074+0000 7f17b0d499c0 20 remove_watcher() i=1 2024-09-19T14:29:51.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.078+0000 7f17b0d499c0 20 remove_watcher() i=2 2024-09-19T14:29:51.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.082+0000 7f17b0d499c0 20 remove_watcher() i=3 2024-09-19T14:29:51.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.082+0000 7f17b0d499c0 20 remove_watcher() i=4 2024-09-19T14:29:51.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.086+0000 7f17b0d499c0 20 remove_watcher() i=5 2024-09-19T14:29:51.090 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.086+0000 7f17b0d499c0 20 remove_watcher() i=6 2024-09-19T14:29:51.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.090+0000 7f17b0d499c0 20 remove_watcher() i=7 2024-09-19T14:29:51.112 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-19T14:29:51.112 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key GIYUGQUXCLHYUCLVSPZE --secret YUeTXbVwbDFkE5gRjuf+17B1PehR5MQUk+yijg76OakVx1QaorEZtw== --cluster ceph 2024-09-19T14:29:51.199 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:29:51.200 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:29:51.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.238+0000 7fc0ef22d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.242+0000 7fc0ef22d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.242+0000 7fc0ef22d9c0 20 realm 2024-09-19T14:29:51.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.242+0000 7fc0ef22d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.242+0000 7fc0ef22d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.242+0000 7fc0ef22d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:29:51.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.242+0000 7fc0ef22d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.242+0000 7fc0ef22d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.242+0000 7fc0ef22d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.242+0000 7fc0ef22d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:51.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.242+0000 7fc0ef22d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.246+0000 7fc0ef22d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:29:51.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.246+0000 7fc0ef22d9c0 20 searching for the correct realm 2024-09-19T14:29:51.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.246+0000 7fc0ecd33640 0 -- 172.21.15.153:0/2407994727 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x7fc0d4003cc0 msgr2=0x7fc0e40973c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:51.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.254+0000 7fc0ed534640 0 -- 172.21.15.153:0/2407994727 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7fc0e00fe840 msgr2=0x7fc0e00fd2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:51.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.262+0000 7fc0ef22d9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:29:51.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.262+0000 7fc0ef22d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:29:51.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.262+0000 7fc0ef22d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:29:51.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.262+0000 7fc0ef22d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:29:51.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.262+0000 7fc0ef22d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:29:51.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.262+0000 7fc0ef22d9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:29:51.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.262+0000 7fc0ef22d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.262+0000 7fc0ef22d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.262+0000 7fc0ef22d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.262+0000 7fc0ef22d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:51.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.262+0000 7fc0ef22d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.266+0000 7fc0ef22d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:29:51.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.266+0000 7fc0ef22d9c0 20 zone default found 2024-09-19T14:29:51.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.266+0000 7fc0ef22d9c0 4 Realm: () 2024-09-19T14:29:51.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.266+0000 7fc0ef22d9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:29:51.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.266+0000 7fc0ef22d9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:29:51.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.266+0000 7fc0ef22d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:29:51.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.266+0000 7fc0ef22d9c0 20 zonegroup default 2024-09-19T14:29:51.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.266+0000 7fc0ef22d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.266+0000 7fc0ef22d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.266+0000 7fc0ef22d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.266+0000 7fc0ef22d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.266+0000 7fc0ef22d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.266+0000 7fc0ef22d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.266+0000 7fc0ef22d9c0 20 started sync module instance, tier type = 2024-09-19T14:29:51.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.266+0000 7fc0ef22d9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:29:51.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.282+0000 7fc0ef22d9c0 20 add_watcher() i=0 2024-09-19T14:29:51.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.282+0000 7fc0ef22d9c0 20 add_watcher() i=1 2024-09-19T14:29:51.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.282+0000 7fc0ef22d9c0 20 add_watcher() i=2 2024-09-19T14:29:51.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.282+0000 7fc0ef22d9c0 20 add_watcher() i=3 2024-09-19T14:29:51.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.282+0000 7fc0ef22d9c0 20 add_watcher() i=4 2024-09-19T14:29:51.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.282+0000 7fc0ef22d9c0 20 add_watcher() i=5 2024-09-19T14:29:51.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.282+0000 7fc0ef22d9c0 20 add_watcher() i=6 2024-09-19T14:29:51.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.282+0000 7fc0ef22d9c0 20 add_watcher() i=7 2024-09-19T14:29:51.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.282+0000 7fc0ef22d9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:29:51.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fbfa2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:51.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fc0ef22d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:29:51.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fc0ef22d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:29:51.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fc0ef22d9c0 5 note: GC not initialized 2024-09-19T14:29:51.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fbfa1fe3640 20 reqs_thread_entry: start 2024-09-19T14:29:51.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fc0ef22d9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:29:51.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fc0ef22d9c0 20 Filter name: none 2024-09-19T14:29:51.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fbf137fe640 20 reqs_thread_entry: start 2024-09-19T14:29:51.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fc0ef22d9c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-19T14:29:51.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fc0ef22d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fc0ef22d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fc0ef22d9c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-19T14:29:51.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fc0ef22d9c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-19T14:29:51.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fc0ef22d9c0 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-19T14:29:51.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fc0ef22d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fc0ef22d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fc0ef22d9c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-19T14:29:51.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fc0ef22d9c0 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-19T14:29:51.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fc0ef22d9c0 10 cache get: name=default.rgw.meta+users.keys+GIYUGQUXCLHYUCLVSPZE : miss 2024-09-19T14:29:51.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fc0ef22d9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fc0ef22d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fc0ef22d9c0 10 cache put: name=default.rgw.meta+users.keys+GIYUGQUXCLHYUCLVSPZE info.flags=0x0 2024-09-19T14:29:51.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fc0ef22d9c0 10 adding default.rgw.meta+users.keys+GIYUGQUXCLHYUCLVSPZE to cache LRU end 2024-09-19T14:29:51.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fc0ef22d9c0 10 cache get: name=default.rgw.meta+users.keys+GIYUGQUXCLHYUCLVSPZE : hit (negative entry) 2024-09-19T14:29:51.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.286+0000 7fc0ef22d9c0 10 cache get: name=default.rgw.meta+users.keys+GIYUGQUXCLHYUCLVSPZE : hit (negative entry) 2024-09-19T14:29:51.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.290+0000 7fc0ef22d9c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-19T14:29:51.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.290+0000 7fc0ef22d9c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-19T14:29:51.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.290+0000 7fc0ef22d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-19T14:29:51.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.290+0000 7fbfc3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268142 cookie 94478581613552 notifier 8997 bl.length()=645 2024-09-19T14:29:51.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.290+0000 7fbfc3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-19T14:29:51.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.290+0000 7fbfc3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-19T14:29:51.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.294+0000 7fc0ef22d9c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-19T14:29:51.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.294+0000 7fc0ef22d9c0 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-19T14:29:51.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.294+0000 7fc0ef22d9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-19T14:29:51.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.298+0000 7fbfc3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268236 cookie 94478581618160 notifier 8997 bl.length()=185 2024-09-19T14:29:51.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.298+0000 7fbfc3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-19T14:29:51.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.298+0000 7fbfc3fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-19T14:29:51.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.298+0000 7fc0ef22d9c0 10 cache put: name=default.rgw.meta+users.keys+GIYUGQUXCLHYUCLVSPZE info.flags=0x7 2024-09-19T14:29:51.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.298+0000 7fc0ef22d9c0 10 moving default.rgw.meta+users.keys+GIYUGQUXCLHYUCLVSPZE to cache LRU end 2024-09-19T14:29:51.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.298+0000 7fc0ef22d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:GIYUGQUXCLHYUCLVSPZE, ofs0, ns] 2024-09-19T14:29:51.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.302+0000 7fbfc37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268213 cookie 94478581620656 notifier 8997 bl.length()=186 2024-09-19T14:29:51.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.302+0000 7fbfc37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+GIYUGQUXCLHYUCLVSPZE info.flags=0x7 2024-09-19T14:29:51.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.302+0000 7fbfc37fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+GIYUGQUXCLHYUCLVSPZE to cache LRU end 2024-09-19T14:29:51.305 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-19T14:29:51.305 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "bar.client.0", 2024-09-19T14:29:51.305 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Mr.bar.client.0", 2024-09-19T14:29:51.305 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "bar+test@test.test", 2024-09-19T14:29:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2024-09-19T14:29:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 1000, 2024-09-19T14:29:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2024-09-19T14:29:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2024-09-19T14:29:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-19T14:29:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "bar.client.0", 2024-09-19T14:29:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "GIYUGQUXCLHYUCLVSPZE", 2024-09-19T14:29:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "YUeTXbVwbDFkE5gRjuf+17B1PehR5MQUk+yijg76OakVx1QaorEZtw==", 2024-09-19T14:29:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: "active": true, 2024-09-19T14:29:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: "create_date": "2024-09-19T14:29:51.291385Z" 2024-09-19T14:29:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-19T14:29:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-19T14:29:51.306 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2024-09-19T14:29:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2024-09-19T14:29:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2024-09-19T14:29:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2024-09-19T14:29:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2024-09-19T14:29:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2024-09-19T14:29:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2024-09-19T14:29:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2024-09-19T14:29:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:29:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2024-09-19T14:29:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:29:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2024-09-19T14:29:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:29:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2024-09-19T14:29:51.307 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2024-09-19T14:29:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:29:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2024-09-19T14:29:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:29:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2024-09-19T14:29:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:29:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2024-09-19T14:29:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2024-09-19T14:29:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [], 2024-09-19T14:29:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: "account_id": "", 2024-09-19T14:29:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "/", 2024-09-19T14:29:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: "create_date": "2024-09-19T14:29:51.291365Z", 2024-09-19T14:29:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: "tags": [], 2024-09-19T14:29:51.308 INFO:teuthology.orchestra.run.smithi153.stdout: "group_ids": [] 2024-09-19T14:29:51.308 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-19T14:29:51.309 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:51.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.302+0000 7fbfa2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:51.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.310+0000 7fc0ef22d9c0 20 remove_watcher() i=0 2024-09-19T14:29:51.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.310+0000 7fc0ef22d9c0 2 removed watcher, disabling cache 2024-09-19T14:29:51.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.310+0000 7fc0ef22d9c0 20 remove_watcher() i=1 2024-09-19T14:29:51.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.314+0000 7fc0ef22d9c0 20 remove_watcher() i=2 2024-09-19T14:29:51.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.314+0000 7fc0ef22d9c0 20 remove_watcher() i=3 2024-09-19T14:29:51.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.318+0000 7fc0ef22d9c0 20 remove_watcher() i=4 2024-09-19T14:29:51.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.318+0000 7fc0ef22d9c0 20 remove_watcher() i=5 2024-09-19T14:29:51.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.318+0000 7fc0ef22d9c0 20 remove_watcher() i=6 2024-09-19T14:29:51.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.322+0000 7fc0ef22d9c0 20 remove_watcher() i=7 2024-09-19T14:29:51.338 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 2795193734 --totp-seed GMH6O64WDNCI7CBGXJUY7VLLPTTANJTQESI6PMOJY5RYSL3VKZLUKNSG4FHX6RKH --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-19T14:29:51.378 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:29:51.378 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:29:51.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.414+0000 7f0f587029c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.418+0000 7f0f587029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.418+0000 7f0f587029c0 20 realm 2024-09-19T14:29:51.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.418+0000 7f0f587029c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.418+0000 7f0f587029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.418+0000 7f0f587029c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:29:51.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.418+0000 7f0f587029c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.418+0000 7f0f587029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.418+0000 7f0f587029c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.418+0000 7f0f587029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:51.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.418+0000 7f0f587029c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.418+0000 7f0f587029c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:29:51.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.418+0000 7f0f587029c0 20 searching for the correct realm 2024-09-19T14:29:51.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.426+0000 7f0f56a09640 0 -- 172.21.15.153:0/1023343198 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7f0f400d7910 msgr2=0x7f0f400b2400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:51.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.430+0000 7f0f56208640 0 -- 172.21.15.153:0/1023343198 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f0f400f4910 msgr2=0x7f0f400b13f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:51.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.646+0000 7f0f587029c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:29:51.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.646+0000 7f0f587029c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:29:51.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.646+0000 7f0f587029c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:29:51.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.646+0000 7f0f587029c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:29:51.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.646+0000 7f0f587029c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:29:51.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.646+0000 7f0f587029c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:29:51.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.646+0000 7f0f587029c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.650+0000 7f0f587029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.650+0000 7f0f587029c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.650+0000 7f0f587029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:51.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.650+0000 7f0f587029c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.650+0000 7f0f587029c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:29:51.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.650+0000 7f0f587029c0 20 zone default found 2024-09-19T14:29:51.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.650+0000 7f0f587029c0 4 Realm: () 2024-09-19T14:29:51.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.650+0000 7f0f587029c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:29:51.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.650+0000 7f0f587029c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:29:51.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.650+0000 7f0f587029c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:29:51.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.650+0000 7f0f587029c0 20 zonegroup default 2024-09-19T14:29:51.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.650+0000 7f0f587029c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.650+0000 7f0f587029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.650+0000 7f0f587029c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.654+0000 7f0f587029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.654+0000 7f0f587029c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.654+0000 7f0f587029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.654+0000 7f0f587029c0 20 started sync module instance, tier type = 2024-09-19T14:29:51.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.654+0000 7f0f587029c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:29:51.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.678+0000 7f0f587029c0 20 add_watcher() i=0 2024-09-19T14:29:51.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.678+0000 7f0f587029c0 20 add_watcher() i=1 2024-09-19T14:29:51.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.678+0000 7f0f587029c0 20 add_watcher() i=2 2024-09-19T14:29:51.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.678+0000 7f0f587029c0 20 add_watcher() i=3 2024-09-19T14:29:51.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.678+0000 7f0f587029c0 20 add_watcher() i=4 2024-09-19T14:29:51.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.678+0000 7f0f587029c0 20 add_watcher() i=5 2024-09-19T14:29:51.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.678+0000 7f0f587029c0 20 add_watcher() i=6 2024-09-19T14:29:51.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.678+0000 7f0f587029c0 20 add_watcher() i=7 2024-09-19T14:29:51.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.678+0000 7f0f587029c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:29:51.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.682+0000 7f0e0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:51.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.686+0000 7f0f587029c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:29:51.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.686+0000 7f0f587029c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:29:51.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.686+0000 7f0f587029c0 5 note: GC not initialized 2024-09-19T14:29:51.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.686+0000 7f0d877fe640 20 reqs_thread_entry: start 2024-09-19T14:29:51.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.686+0000 7f0f587029c0 20 init_complete bucket index max shards: 11 2024-09-19T14:29:51.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.686+0000 7f0f587029c0 20 Filter name: none 2024-09-19T14:29:51.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.686+0000 7f0d857fa640 20 reqs_thread_entry: start 2024-09-19T14:29:51.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.686+0000 7f0f587029c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-19T14:29:51.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.686+0000 7f0f587029c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.686+0000 7f0f587029c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-19T14:29:51.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.686+0000 7f0f587029c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-19T14:29:51.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.686+0000 7f0f587029c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-19T14:29:51.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.686+0000 7f0f587029c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:29:51.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.694+0000 7f0f587029c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-19T14:29:51.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.694+0000 7f0f587029c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-19T14:29:51.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.694+0000 7f0f587029c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-19T14:29:51.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.694+0000 7f0e39ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268143 cookie 94922099872640 notifier 8456 bl.length()=659 2024-09-19T14:29:51.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.694+0000 7f0e39ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-19T14:29:51.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.694+0000 7f0e39ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-19T14:29:51.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.698+0000 7f0e0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:51.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.702+0000 7f0f587029c0 20 remove_watcher() i=0 2024-09-19T14:29:51.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.702+0000 7f0f587029c0 2 removed watcher, disabling cache 2024-09-19T14:29:51.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.706+0000 7f0f587029c0 20 remove_watcher() i=1 2024-09-19T14:29:51.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.706+0000 7f0f587029c0 20 remove_watcher() i=2 2024-09-19T14:29:51.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.710+0000 7f0f587029c0 20 remove_watcher() i=3 2024-09-19T14:29:51.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.714+0000 7f0f587029c0 20 remove_watcher() i=4 2024-09-19T14:29:51.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.714+0000 7f0f587029c0 20 remove_watcher() i=5 2024-09-19T14:29:51.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.718+0000 7f0f587029c0 20 remove_watcher() i=6 2024-09-19T14:29:51.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.718+0000 7f0f587029c0 20 remove_watcher() i=7 2024-09-19T14:29:51.738 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-09-19T14:29:51.738 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr.testx$tenanteduser.client.0' --email 'testx$tenanteduser+test@test.test' --access-key JCIYEPNAGTMCYPQVHRKZ --secret e8xCkGi6Wsi6PakMxrPSL5b7K3mjKAlkVIruqWuXc4XWj156NDGbqA== --cluster ceph 2024-09-19T14:29:51.824 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:29:51.824 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:29:51.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.862+0000 7f976804c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.862+0000 7f976804c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.862+0000 7f976804c9c0 20 realm 2024-09-19T14:29:51.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.862+0000 7f976804c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.862+0000 7f976804c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.862+0000 7f976804c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:29:51.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.862+0000 7f976804c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.862+0000 7f976804c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.862+0000 7f976804c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.866+0000 7f976804c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:51.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.866+0000 7f976804c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.866+0000 7f976804c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:29:51.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.866+0000 7f976804c9c0 20 searching for the correct realm 2024-09-19T14:29:51.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.870+0000 7f9766353640 0 -- 172.21.15.153:0/654004504 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x561bc12ce580 msgr2=0x561bc12d0a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:51.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.878+0000 7f9765351640 0 -- 172.21.15.153:0/654004504 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f97580f4f00 msgr2=0x7f9758102400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:51.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.882+0000 7f976804c9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:29:51.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.882+0000 7f976804c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:29:51.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.882+0000 7f976804c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:29:51.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.882+0000 7f976804c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:29:51.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.882+0000 7f976804c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:29:51.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.882+0000 7f976804c9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:29:51.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.882+0000 7f976804c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.886+0000 7f976804c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.886+0000 7f976804c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.886+0000 7f976804c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:51.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.886+0000 7f976804c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.886+0000 7f976804c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:29:51.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.886+0000 7f976804c9c0 20 zone default found 2024-09-19T14:29:51.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.886+0000 7f976804c9c0 4 Realm: () 2024-09-19T14:29:51.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.886+0000 7f976804c9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:29:51.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.886+0000 7f976804c9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:29:51.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.886+0000 7f976804c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:29:51.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.886+0000 7f976804c9c0 20 zonegroup default 2024-09-19T14:29:51.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.886+0000 7f976804c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.886+0000 7f976804c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.886+0000 7f976804c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.886+0000 7f976804c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.890 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.886+0000 7f976804c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.886+0000 7f976804c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.886+0000 7f976804c9c0 20 started sync module instance, tier type = 2024-09-19T14:29:51.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.886+0000 7f976804c9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:29:51.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.902+0000 7f976804c9c0 20 add_watcher() i=0 2024-09-19T14:29:51.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.902+0000 7f976804c9c0 20 add_watcher() i=1 2024-09-19T14:29:51.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.902+0000 7f976804c9c0 20 add_watcher() i=2 2024-09-19T14:29:51.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.902+0000 7f976804c9c0 20 add_watcher() i=3 2024-09-19T14:29:51.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.902+0000 7f976804c9c0 20 add_watcher() i=4 2024-09-19T14:29:51.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.902+0000 7f976804c9c0 20 add_watcher() i=5 2024-09-19T14:29:51.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.902+0000 7f976804c9c0 20 add_watcher() i=6 2024-09-19T14:29:51.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.902+0000 7f976804c9c0 20 add_watcher() i=7 2024-09-19T14:29:51.906 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.902+0000 7f976804c9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:29:51.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f96177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:51.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f976804c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:29:51.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f976804c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:29:51.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f976804c9c0 5 note: GC not initialized 2024-09-19T14:29:51.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f96167fc640 20 reqs_thread_entry: start 2024-09-19T14:29:51.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f976804c9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:29:51.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f976804c9c0 20 Filter name: none 2024-09-19T14:29:51.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f9587fff640 20 reqs_thread_entry: start 2024-09-19T14:29:51.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f976804c9c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-19T14:29:51.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f976804c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f976804c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f976804c9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-19T14:29:51.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f976804c9c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-19T14:29:51.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f976804c9c0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-19T14:29:51.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f976804c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f976804c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f976804c9c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-19T14:29:51.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f976804c9c0 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-19T14:29:51.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f976804c9c0 10 cache get: name=default.rgw.meta+users.keys+JCIYEPNAGTMCYPQVHRKZ : miss 2024-09-19T14:29:51.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f976804c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:51.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f976804c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:51.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f976804c9c0 10 cache put: name=default.rgw.meta+users.keys+JCIYEPNAGTMCYPQVHRKZ info.flags=0x0 2024-09-19T14:29:51.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f976804c9c0 10 adding default.rgw.meta+users.keys+JCIYEPNAGTMCYPQVHRKZ to cache LRU end 2024-09-19T14:29:51.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f976804c9c0 10 cache get: name=default.rgw.meta+users.keys+JCIYEPNAGTMCYPQVHRKZ : hit (negative entry) 2024-09-19T14:29:51.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.906+0000 7f976804c9c0 10 cache get: name=default.rgw.meta+users.keys+JCIYEPNAGTMCYPQVHRKZ : hit (negative entry) 2024-09-19T14:29:51.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.910+0000 7f976804c9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-19T14:29:51.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.910+0000 7f976804c9c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-19T14:29:51.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.910+0000 7f976804c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-19T14:29:51.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.910+0000 7f96497fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268237 cookie 94677205114560 notifier 8471 bl.length()=719 2024-09-19T14:29:51.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.910+0000 7f96497fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-19T14:29:51.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.910+0000 7f96497fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-19T14:29:51.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.914+0000 7f976804c9c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-19T14:29:51.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.914+0000 7f976804c9c0 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-19T14:29:51.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.914+0000 7f976804c9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-19T14:29:51.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.914+0000 7f9648ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268099 cookie 94677205121312 notifier 8471 bl.length()=215 2024-09-19T14:29:51.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.914+0000 7f9648ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-19T14:29:51.918 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.914+0000 7f9648ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-19T14:29:51.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.918+0000 7f976804c9c0 10 cache put: name=default.rgw.meta+users.keys+JCIYEPNAGTMCYPQVHRKZ info.flags=0x7 2024-09-19T14:29:51.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.918+0000 7f976804c9c0 10 moving default.rgw.meta+users.keys+JCIYEPNAGTMCYPQVHRKZ to cache LRU end 2024-09-19T14:29:51.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.918+0000 7f976804c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:JCIYEPNAGTMCYPQVHRKZ, ofs0, ns] 2024-09-19T14:29:51.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.918+0000 7f9648ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268214 cookie 94677205110864 notifier 8471 bl.length()=201 2024-09-19T14:29:51.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.918+0000 7f9648ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+JCIYEPNAGTMCYPQVHRKZ info.flags=0x7 2024-09-19T14:29:51.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.918+0000 7f9648ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+JCIYEPNAGTMCYPQVHRKZ to cache LRU end 2024-09-19T14:29:51.923 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-19T14:29:51.923 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-19T14:29:51.923 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Mr.testx$tenanteduser.client.0", 2024-09-19T14:29:51.924 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-19T14:29:51.924 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2024-09-19T14:29:51.924 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 1000, 2024-09-19T14:29:51.924 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2024-09-19T14:29:51.924 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2024-09-19T14:29:51.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-19T14:29:51.924 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "testx$tenanteduser.client.0", 2024-09-19T14:29:51.924 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "JCIYEPNAGTMCYPQVHRKZ", 2024-09-19T14:29:51.924 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "e8xCkGi6Wsi6PakMxrPSL5b7K3mjKAlkVIruqWuXc4XWj156NDGbqA==", 2024-09-19T14:29:51.924 INFO:teuthology.orchestra.run.smithi153.stdout: "active": true, 2024-09-19T14:29:51.924 INFO:teuthology.orchestra.run.smithi153.stdout: "create_date": "2024-09-19T14:29:51.911404Z" 2024-09-19T14:29:51.925 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-19T14:29:51.925 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-19T14:29:51.925 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2024-09-19T14:29:51.925 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2024-09-19T14:29:51.925 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2024-09-19T14:29:51.925 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2024-09-19T14:29:51.925 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2024-09-19T14:29:51.925 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2024-09-19T14:29:51.925 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2024-09-19T14:29:51.925 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2024-09-19T14:29:51.925 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:29:51.925 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2024-09-19T14:29:51.926 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:29:51.926 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2024-09-19T14:29:51.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:29:51.926 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2024-09-19T14:29:51.926 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2024-09-19T14:29:51.926 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:29:51.926 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2024-09-19T14:29:51.926 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:29:51.926 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2024-09-19T14:29:51.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:29:51.926 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2024-09-19T14:29:51.926 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2024-09-19T14:29:51.927 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [], 2024-09-19T14:29:51.927 INFO:teuthology.orchestra.run.smithi153.stdout: "account_id": "", 2024-09-19T14:29:51.927 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "/", 2024-09-19T14:29:51.927 INFO:teuthology.orchestra.run.smithi153.stdout: "create_date": "2024-09-19T14:29:51.911390Z", 2024-09-19T14:29:51.927 INFO:teuthology.orchestra.run.smithi153.stdout: "tags": [], 2024-09-19T14:29:51.927 INFO:teuthology.orchestra.run.smithi153.stdout: "group_ids": [] 2024-09-19T14:29:51.927 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-19T14:29:51.927 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:51.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.922+0000 7f96177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:51.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.926+0000 7f976804c9c0 20 remove_watcher() i=0 2024-09-19T14:29:51.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.926+0000 7f976804c9c0 2 removed watcher, disabling cache 2024-09-19T14:29:51.931 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.926+0000 7f976804c9c0 20 remove_watcher() i=1 2024-09-19T14:29:51.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.930+0000 7f976804c9c0 20 remove_watcher() i=2 2024-09-19T14:29:51.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.930+0000 7f976804c9c0 20 remove_watcher() i=3 2024-09-19T14:29:51.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.934+0000 7f976804c9c0 20 remove_watcher() i=4 2024-09-19T14:29:51.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.934+0000 7f976804c9c0 20 remove_watcher() i=5 2024-09-19T14:29:51.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.938+0000 7f976804c9c0 20 remove_watcher() i=6 2024-09-19T14:29:51.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:51.938+0000 7f976804c9c0 20 remove_watcher() i=7 2024-09-19T14:29:51.955 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 7740478158 --totp-seed 2KGYPUYUWVZILYUTGQORXJS7LODY4JEOSTVTMQFZCEJTHKNVAAPO6S766SQRQOC5 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-19T14:29:52.046 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:29:52.046 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:29:52.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.098+0000 7f732a5da9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.098+0000 7f732a5da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.098+0000 7f732a5da9c0 20 realm 2024-09-19T14:29:52.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.098+0000 7f732a5da9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.098+0000 7f732a5da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.098+0000 7f732a5da9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:29:52.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.098+0000 7f732a5da9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.098+0000 7f732a5da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.098+0000 7f732a5da9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.102+0000 7f732a5da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:52.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.102+0000 7f732a5da9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.102+0000 7f732a5da9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:29:52.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.102+0000 7f732a5da9c0 20 searching for the correct realm 2024-09-19T14:29:52.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.114+0000 7f73278df640 0 -- 172.21.15.153:0/3795507219 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x562e36cc4f20 msgr2=0x562e36cc7370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:52.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.126+0000 7f73280e0640 0 -- 172.21.15.153:0/3795507219 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f731c0dcf90 msgr2=0x7f731c009950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:52.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.134+0000 7f732a5da9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:29:52.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.134+0000 7f732a5da9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:29:52.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.134+0000 7f732a5da9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:29:52.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.134+0000 7f732a5da9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:29:52.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.134+0000 7f732a5da9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:29:52.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.134+0000 7f732a5da9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:29:52.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.134+0000 7f732a5da9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.134+0000 7f732a5da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.134+0000 7f732a5da9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.134+0000 7f732a5da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:52.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.134+0000 7f732a5da9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.134+0000 7f732a5da9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:29:52.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.134+0000 7f732a5da9c0 20 zone default found 2024-09-19T14:29:52.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.134+0000 7f732a5da9c0 4 Realm: () 2024-09-19T14:29:52.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.134+0000 7f732a5da9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:29:52.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.134+0000 7f732a5da9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:29:52.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.134+0000 7f732a5da9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:29:52.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.134+0000 7f732a5da9c0 20 zonegroup default 2024-09-19T14:29:52.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.134+0000 7f732a5da9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.134+0000 7f732a5da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.134+0000 7f732a5da9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.138+0000 7f732a5da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.138+0000 7f732a5da9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.138+0000 7f732a5da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.138+0000 7f732a5da9c0 20 started sync module instance, tier type = 2024-09-19T14:29:52.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.138+0000 7f732a5da9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:29:52.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.154+0000 7f732a5da9c0 20 add_watcher() i=0 2024-09-19T14:29:52.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.154+0000 7f732a5da9c0 20 add_watcher() i=1 2024-09-19T14:29:52.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.154+0000 7f732a5da9c0 20 add_watcher() i=2 2024-09-19T14:29:52.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.154+0000 7f732a5da9c0 20 add_watcher() i=3 2024-09-19T14:29:52.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.154+0000 7f732a5da9c0 20 add_watcher() i=4 2024-09-19T14:29:52.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.154+0000 7f732a5da9c0 20 add_watcher() i=5 2024-09-19T14:29:52.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.154+0000 7f732a5da9c0 20 add_watcher() i=6 2024-09-19T14:29:52.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.154+0000 7f732a5da9c0 20 add_watcher() i=7 2024-09-19T14:29:52.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.154+0000 7f732a5da9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:29:52.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.158+0000 7f71defdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:52.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.158+0000 7f732a5da9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:29:52.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.158+0000 7f732a5da9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:29:52.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.158+0000 7f732a5da9c0 5 note: GC not initialized 2024-09-19T14:29:52.160 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.158+0000 7f71ddfdb640 20 reqs_thread_entry: start 2024-09-19T14:29:52.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.158+0000 7f732a5da9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:29:52.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.158+0000 7f732a5da9c0 20 Filter name: none 2024-09-19T14:29:52.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.158+0000 7f714f7fe640 20 reqs_thread_entry: start 2024-09-19T14:29:52.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.158+0000 7f732a5da9c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-19T14:29:52.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.158+0000 7f732a5da9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.158+0000 7f732a5da9c0 20 rados_obj.operate() r=0 bl.length=519 2024-09-19T14:29:52.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.158+0000 7f732a5da9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-19T14:29:52.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.158+0000 7f732a5da9c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-19T14:29:52.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.158+0000 7f732a5da9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:29:52.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.162+0000 7f732a5da9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-19T14:29:52.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.162+0000 7f732a5da9c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-19T14:29:52.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.162+0000 7f732a5da9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-19T14:29:52.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.162+0000 7f71ff7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235534 cookie 94756487868928 notifier 9054 bl.length()=733 2024-09-19T14:29:52.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.162+0000 7f71ff7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-19T14:29:52.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.162+0000 7f71ff7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-19T14:29:52.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.166+0000 7f71defdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:52.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.170+0000 7f732a5da9c0 20 remove_watcher() i=0 2024-09-19T14:29:52.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.170+0000 7f732a5da9c0 2 removed watcher, disabling cache 2024-09-19T14:29:52.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.170+0000 7f732a5da9c0 20 remove_watcher() i=1 2024-09-19T14:29:52.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.174+0000 7f732a5da9c0 20 remove_watcher() i=2 2024-09-19T14:29:52.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.178+0000 7f732a5da9c0 20 remove_watcher() i=3 2024-09-19T14:29:52.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.178+0000 7f732a5da9c0 20 remove_watcher() i=4 2024-09-19T14:29:52.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.178+0000 7f732a5da9c0 20 remove_watcher() i=5 2024-09-19T14:29:52.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.182+0000 7f732a5da9c0 20 remove_watcher() i=6 2024-09-19T14:29:52.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.182+0000 7f732a5da9c0 20 remove_watcher() i=7 2024-09-19T14:29:52.199 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-19T14:29:52.199 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key CNZDOVDXOVTPRBROGROI --secret T39hVe0kn11hkh1HA6qtGSSEttftW/+iBKHASHJbJ/qN2pZs1wTk6A== --cluster ceph 2024-09-19T14:29:52.237 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:29:52.237 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:29:52.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.274+0000 7fee163ca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.274+0000 7fee163ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.274+0000 7fee163ca9c0 20 realm 2024-09-19T14:29:52.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.274+0000 7fee163ca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.274+0000 7fee163ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.274+0000 7fee163ca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:29:52.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.274+0000 7fee163ca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.274+0000 7fee163ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.274+0000 7fee163ca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.278+0000 7fee163ca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:52.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.278+0000 7fee163ca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.278+0000 7fee163ca9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:29:52.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.278+0000 7fee163ca9c0 20 searching for the correct realm 2024-09-19T14:29:52.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.282+0000 7fee136cf640 0 -- 172.21.15.153:0/3845916159 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fee04027070 msgr2=0x7fee040951d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:52.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.290+0000 7fee136cf640 0 -- 172.21.15.153:0/3845916159 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fecdc083070 msgr2=0x7fecdc0854a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:52.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.294+0000 7fee163ca9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:29:52.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.294+0000 7fee163ca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:29:52.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.294+0000 7fee163ca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:29:52.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.294+0000 7fee163ca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:29:52.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.294+0000 7fee163ca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:29:52.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.294+0000 7fee163ca9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:29:52.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.294+0000 7fee163ca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.294+0000 7fee163ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.299 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.294+0000 7fee163ca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.298+0000 7fee163ca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:52.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.298+0000 7fee163ca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.300 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.298+0000 7fee163ca9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:29:52.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.298+0000 7fee163ca9c0 20 zone default found 2024-09-19T14:29:52.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.298+0000 7fee163ca9c0 4 Realm: () 2024-09-19T14:29:52.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.298+0000 7fee163ca9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:29:52.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.298+0000 7fee163ca9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:29:52.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.298+0000 7fee163ca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:29:52.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.298+0000 7fee163ca9c0 20 zonegroup default 2024-09-19T14:29:52.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.298+0000 7fee163ca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.298+0000 7fee163ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.298+0000 7fee163ca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.298+0000 7fee163ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.298+0000 7fee163ca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.298+0000 7fee163ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.298+0000 7fee163ca9c0 20 started sync module instance, tier type = 2024-09-19T14:29:52.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.298+0000 7fee163ca9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:29:52.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.314+0000 7fee163ca9c0 20 add_watcher() i=0 2024-09-19T14:29:52.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.314+0000 7fee163ca9c0 20 add_watcher() i=1 2024-09-19T14:29:52.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.314+0000 7fee163ca9c0 20 add_watcher() i=2 2024-09-19T14:29:52.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.314+0000 7fee163ca9c0 20 add_watcher() i=3 2024-09-19T14:29:52.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.314+0000 7fee163ca9c0 20 add_watcher() i=4 2024-09-19T14:29:52.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.314+0000 7fee163ca9c0 20 add_watcher() i=5 2024-09-19T14:29:52.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.314+0000 7fee163ca9c0 20 add_watcher() i=6 2024-09-19T14:29:52.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.314+0000 7fee163ca9c0 20 add_watcher() i=7 2024-09-19T14:29:52.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.314+0000 7fee163ca9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:29:52.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fecc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:52.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fee163ca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:29:52.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fee163ca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:29:52.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fee163ca9c0 5 note: GC not initialized 2024-09-19T14:29:52.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fecc8fe1640 20 reqs_thread_entry: start 2024-09-19T14:29:52.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fee163ca9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:29:52.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fee163ca9c0 20 Filter name: none 2024-09-19T14:29:52.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fec427fc640 20 reqs_thread_entry: start 2024-09-19T14:29:52.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fee163ca9c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-19T14:29:52.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fee163ca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fee163ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fee163ca9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-19T14:29:52.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fee163ca9c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-19T14:29:52.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fee163ca9c0 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-19T14:29:52.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fee163ca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fee163ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fee163ca9c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-19T14:29:52.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fee163ca9c0 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-19T14:29:52.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fee163ca9c0 10 cache get: name=default.rgw.meta+users.keys+CNZDOVDXOVTPRBROGROI : miss 2024-09-19T14:29:52.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fee163ca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fee163ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fee163ca9c0 10 cache put: name=default.rgw.meta+users.keys+CNZDOVDXOVTPRBROGROI info.flags=0x0 2024-09-19T14:29:52.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fee163ca9c0 10 adding default.rgw.meta+users.keys+CNZDOVDXOVTPRBROGROI to cache LRU end 2024-09-19T14:29:52.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fee163ca9c0 10 cache get: name=default.rgw.meta+users.keys+CNZDOVDXOVTPRBROGROI : hit (negative entry) 2024-09-19T14:29:52.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.318+0000 7fee163ca9c0 10 cache get: name=default.rgw.meta+users.keys+CNZDOVDXOVTPRBROGROI : hit (negative entry) 2024-09-19T14:29:52.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.322+0000 7fee163ca9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-19T14:29:52.324 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.322+0000 7fee163ca9c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-19T14:29:52.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.322+0000 7fee163ca9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-19T14:29:52.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.322+0000 7fecf2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235396 cookie 94387021532272 notifier 8507 bl.length()=660 2024-09-19T14:29:52.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.322+0000 7fecf2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-19T14:29:52.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.322+0000 7fecf2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-19T14:29:52.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.326+0000 7fee163ca9c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-19T14:29:52.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.326+0000 7fee163ca9c0 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-19T14:29:52.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.326+0000 7fee163ca9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-19T14:29:52.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.326+0000 7fecf2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235440 cookie 94387021520400 notifier 8507 bl.length()=191 2024-09-19T14:29:52.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.326+0000 7fecf2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-19T14:29:52.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.326+0000 7fecf2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-19T14:29:52.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.330+0000 7fee163ca9c0 10 cache put: name=default.rgw.meta+users.keys+CNZDOVDXOVTPRBROGROI info.flags=0x7 2024-09-19T14:29:52.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.330+0000 7fee163ca9c0 10 moving default.rgw.meta+users.keys+CNZDOVDXOVTPRBROGROI to cache LRU end 2024-09-19T14:29:52.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.330+0000 7fee163ca9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:CNZDOVDXOVTPRBROGROI, ofs0, ns] 2024-09-19T14:29:52.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.334+0000 7fecf2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235511 cookie 94387021516112 notifier 8507 bl.length()=189 2024-09-19T14:29:52.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.334+0000 7fecf2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+CNZDOVDXOVTPRBROGROI info.flags=0x7 2024-09-19T14:29:52.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.334+0000 7fecf2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+CNZDOVDXOVTPRBROGROI to cache LRU end 2024-09-19T14:29:52.337 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-19T14:29:52.337 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foobar.client.0", 2024-09-19T14:29:52.337 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Mr.foobar.client.0", 2024-09-19T14:29:52.337 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foobar+test@test.test", 2024-09-19T14:29:52.337 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2024-09-19T14:29:52.337 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 1000, 2024-09-19T14:29:52.337 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2024-09-19T14:29:52.337 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2024-09-19T14:29:52.338 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-19T14:29:52.338 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foobar.client.0", 2024-09-19T14:29:52.338 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "CNZDOVDXOVTPRBROGROI", 2024-09-19T14:29:52.338 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "T39hVe0kn11hkh1HA6qtGSSEttftW/+iBKHASHJbJ/qN2pZs1wTk6A==", 2024-09-19T14:29:52.338 INFO:teuthology.orchestra.run.smithi153.stdout: "active": true, 2024-09-19T14:29:52.338 INFO:teuthology.orchestra.run.smithi153.stdout: "create_date": "2024-09-19T14:29:52.323352Z" 2024-09-19T14:29:52.338 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-19T14:29:52.338 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-19T14:29:52.338 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2024-09-19T14:29:52.338 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2024-09-19T14:29:52.338 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2024-09-19T14:29:52.338 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2024-09-19T14:29:52.338 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2024-09-19T14:29:52.339 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2024-09-19T14:29:52.339 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2024-09-19T14:29:52.339 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2024-09-19T14:29:52.339 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:29:52.339 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2024-09-19T14:29:52.339 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:29:52.339 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2024-09-19T14:29:52.339 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:29:52.339 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2024-09-19T14:29:52.339 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2024-09-19T14:29:52.339 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:29:52.339 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2024-09-19T14:29:52.339 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:29:52.340 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2024-09-19T14:29:52.340 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:29:52.340 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2024-09-19T14:29:52.340 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2024-09-19T14:29:52.340 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [], 2024-09-19T14:29:52.340 INFO:teuthology.orchestra.run.smithi153.stdout: "account_id": "", 2024-09-19T14:29:52.340 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "/", 2024-09-19T14:29:52.340 INFO:teuthology.orchestra.run.smithi153.stdout: "create_date": "2024-09-19T14:29:52.323336Z", 2024-09-19T14:29:52.340 INFO:teuthology.orchestra.run.smithi153.stdout: "tags": [], 2024-09-19T14:29:52.340 INFO:teuthology.orchestra.run.smithi153.stdout: "group_ids": [] 2024-09-19T14:29:52.340 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-19T14:29:52.340 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:52.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.334+0000 7fecc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:52.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.342+0000 7fee163ca9c0 20 remove_watcher() i=0 2024-09-19T14:29:52.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.342+0000 7fee163ca9c0 2 removed watcher, disabling cache 2024-09-19T14:29:52.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.342+0000 7fee163ca9c0 20 remove_watcher() i=1 2024-09-19T14:29:52.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.346+0000 7fee163ca9c0 20 remove_watcher() i=2 2024-09-19T14:29:52.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.346+0000 7fee163ca9c0 20 remove_watcher() i=3 2024-09-19T14:29:52.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.346+0000 7fee163ca9c0 20 remove_watcher() i=4 2024-09-19T14:29:52.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.350+0000 7fee163ca9c0 20 remove_watcher() i=5 2024-09-19T14:29:52.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.350+0000 7fee163ca9c0 20 remove_watcher() i=6 2024-09-19T14:29:52.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.350+0000 7fee163ca9c0 20 remove_watcher() i=7 2024-09-19T14:29:52.369 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 0974264362 --totp-seed AL3NVTQFQ5BPWFCH6GZR55UGQOBA42WOUBWS4JTGM44ZHZ3BQBCHSXH5S2SFD6M4 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-19T14:29:52.451 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:29:52.451 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:29:52.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.490+0000 7fdd1d79c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.490+0000 7fdd1d79c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.490+0000 7fdd1d79c9c0 20 realm 2024-09-19T14:29:52.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.490+0000 7fdd1d79c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.490+0000 7fdd1d79c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.490+0000 7fdd1d79c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:29:52.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.490+0000 7fdd1d79c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.490+0000 7fdd1d79c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.490+0000 7fdd1d79c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.494+0000 7fdd1d79c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:52.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.494+0000 7fdd1d79c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.494+0000 7fdd1d79c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:29:52.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.494+0000 7fdd1d79c9c0 20 searching for the correct realm 2024-09-19T14:29:52.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.502+0000 7fdd1aaa1640 0 -- 172.21.15.153:0/1659205453 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fdd140ca040 msgr2=0x7fdd140b2930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:52.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.506+0000 7fdd1aaa1640 0 -- 172.21.15.153:0/1659205453 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7fdbe4082ff0 msgr2=0x7fdbe4085420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:52.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:29:52.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:29:52.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:29:52.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:29:52.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:29:52.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:29:52.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:52.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:29:52.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 20 zone default found 2024-09-19T14:29:52.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 4 Realm: () 2024-09-19T14:29:52.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:29:52.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:29:52.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:29:52.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 20 zonegroup default 2024-09-19T14:29:52.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 20 started sync module instance, tier type = 2024-09-19T14:29:52.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.514+0000 7fdd1d79c9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:29:52.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.530+0000 7fdd1d79c9c0 20 add_watcher() i=0 2024-09-19T14:29:52.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.530+0000 7fdd1d79c9c0 20 add_watcher() i=1 2024-09-19T14:29:52.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.530+0000 7fdd1d79c9c0 20 add_watcher() i=2 2024-09-19T14:29:52.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.530+0000 7fdd1d79c9c0 20 add_watcher() i=3 2024-09-19T14:29:52.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.530+0000 7fdd1d79c9c0 20 add_watcher() i=4 2024-09-19T14:29:52.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.530+0000 7fdd1d79c9c0 20 add_watcher() i=5 2024-09-19T14:29:52.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.530+0000 7fdd1d79c9c0 20 add_watcher() i=6 2024-09-19T14:29:52.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.530+0000 7fdd1d79c9c0 20 add_watcher() i=7 2024-09-19T14:29:52.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.530+0000 7fdd1d79c9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:29:52.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.534+0000 7fdbd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:52.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.534+0000 7fdd1d79c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:29:52.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.534+0000 7fdd1d79c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:29:52.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.534+0000 7fdd1d79c9c0 5 note: GC not initialized 2024-09-19T14:29:52.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.534+0000 7fdbd0fe1640 20 reqs_thread_entry: start 2024-09-19T14:29:52.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.534+0000 7fdd1d79c9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:29:52.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.534+0000 7fdd1d79c9c0 20 Filter name: none 2024-09-19T14:29:52.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.534+0000 7fdb4a7fc640 20 reqs_thread_entry: start 2024-09-19T14:29:52.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.534+0000 7fdd1d79c9c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-19T14:29:52.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.534+0000 7fdd1d79c9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.534+0000 7fdd1d79c9c0 20 rados_obj.operate() r=0 bl.length=472 2024-09-19T14:29:52.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.534+0000 7fdd1d79c9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-19T14:29:52.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.534+0000 7fdd1d79c9c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-19T14:29:52.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.534+0000 7fdd1d79c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:29:52.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.538+0000 7fdd1d79c9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-19T14:29:52.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.538+0000 7fdd1d79c9c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-19T14:29:52.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.538+0000 7fdd1d79c9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-19T14:29:52.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.542+0000 7fdbfeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235397 cookie 94330607521248 notifier 8525 bl.length()=674 2024-09-19T14:29:52.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.542+0000 7fdbfeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-19T14:29:52.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.542+0000 7fdbfeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-19T14:29:52.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.542+0000 7fdbd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:52.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.546+0000 7fdd1d79c9c0 20 remove_watcher() i=0 2024-09-19T14:29:52.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.546+0000 7fdd1d79c9c0 2 removed watcher, disabling cache 2024-09-19T14:29:52.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.550+0000 7fdd1d79c9c0 20 remove_watcher() i=1 2024-09-19T14:29:52.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.554+0000 7fdd1d79c9c0 20 remove_watcher() i=2 2024-09-19T14:29:52.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.554+0000 7fdd1d79c9c0 20 remove_watcher() i=3 2024-09-19T14:29:52.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.558+0000 7fdd1d79c9c0 20 remove_watcher() i=4 2024-09-19T14:29:52.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.558+0000 7fdd1d79c9c0 20 remove_watcher() i=5 2024-09-19T14:29:52.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.558+0000 7fdd1d79c9c0 20 remove_watcher() i=6 2024-09-19T14:29:52.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.562+0000 7fdd1d79c9c0 20 remove_watcher() i=7 2024-09-19T14:29:52.578 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-19T14:29:52.655 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:29:52.655 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:29:52.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.694+0000 7f0d3218a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.694+0000 7f0d3218a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.694+0000 7f0d3218a9c0 20 realm 2024-09-19T14:29:52.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.694+0000 7f0d3218a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.699 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.694+0000 7f0d3218a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.694+0000 7f0d3218a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:29:52.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.694+0000 7f0d3218a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.698+0000 7f0d3218a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.698+0000 7f0d3218a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.698+0000 7f0d3218a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:52.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.698+0000 7f0d3218a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.698+0000 7f0d3218a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:29:52.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.698+0000 7f0d3218a9c0 20 searching for the correct realm 2024-09-19T14:29:52.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.706+0000 7f0d2f48f640 0 -- 172.21.15.153:0/3627984145 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f0d280de070 msgr2=0x7f0d280ce3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:52.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.710+0000 7f0d2f48f640 0 -- 172.21.15.153:0/3627984145 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f0bf8082ff0 msgr2=0x7f0bf8085420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:52.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.718+0000 7f0d3218a9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:29:52.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.718+0000 7f0d3218a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:29:52.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.718+0000 7f0d3218a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:29:52.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.718+0000 7f0d3218a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:29:52.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.718+0000 7f0d3218a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:29:52.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.718+0000 7f0d3218a9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:29:52.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.718+0000 7f0d3218a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.718+0000 7f0d3218a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.718+0000 7f0d3218a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.718+0000 7f0d3218a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:52.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.718+0000 7f0d3218a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.718+0000 7f0d3218a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:29:52.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.718+0000 7f0d3218a9c0 20 zone default found 2024-09-19T14:29:52.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.718+0000 7f0d3218a9c0 4 Realm: () 2024-09-19T14:29:52.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.718+0000 7f0d3218a9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:29:52.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.718+0000 7f0d3218a9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:29:52.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.718+0000 7f0d3218a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:29:52.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.718+0000 7f0d3218a9c0 20 zonegroup default 2024-09-19T14:29:52.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.718+0000 7f0d3218a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.722+0000 7f0d3218a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.722+0000 7f0d3218a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.722+0000 7f0d3218a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.722+0000 7f0d3218a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.722+0000 7f0d3218a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.722+0000 7f0d3218a9c0 20 started sync module instance, tier type = 2024-09-19T14:29:52.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.722+0000 7f0d3218a9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:29:52.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.738+0000 7f0d3218a9c0 20 add_watcher() i=0 2024-09-19T14:29:52.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.738+0000 7f0d3218a9c0 20 add_watcher() i=1 2024-09-19T14:29:52.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.738+0000 7f0d3218a9c0 20 add_watcher() i=2 2024-09-19T14:29:52.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.738+0000 7f0d3218a9c0 20 add_watcher() i=3 2024-09-19T14:29:52.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.738+0000 7f0d3218a9c0 20 add_watcher() i=4 2024-09-19T14:29:52.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.738+0000 7f0d3218a9c0 20 add_watcher() i=5 2024-09-19T14:29:52.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.738+0000 7f0d3218a9c0 20 add_watcher() i=6 2024-09-19T14:29:52.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.738+0000 7f0d3218a9c0 20 add_watcher() i=7 2024-09-19T14:29:52.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.738+0000 7f0d3218a9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:29:52.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.742+0000 7f0be5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:52.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.742+0000 7f0d3218a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:29:52.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.742+0000 7f0d3218a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:29:52.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.742+0000 7f0d3218a9c0 5 note: GC not initialized 2024-09-19T14:29:52.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.742+0000 7f0be4fe1640 20 reqs_thread_entry: start 2024-09-19T14:29:52.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.742+0000 7f0d3218a9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:29:52.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.742+0000 7f0d3218a9c0 20 Filter name: none 2024-09-19T14:29:52.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.742+0000 7f0b5e7fc640 20 reqs_thread_entry: start 2024-09-19T14:29:52.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.742+0000 7f0d3218a9c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-19T14:29:52.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.742+0000 7f0d3218a9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.742+0000 7f0d3218a9c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-19T14:29:52.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.742+0000 7f0d3218a9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-19T14:29:52.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.742+0000 7f0d3218a9c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-19T14:29:52.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.742+0000 7f0d3218a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:29:52.746 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.742+0000 7f0d3218a9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-19T14:29:52.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.742+0000 7f0d3218a9c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-19T14:29:52.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.742+0000 7f0d3218a9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-19T14:29:52.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.742+0000 7f0c0effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235398 cookie 94175540936064 notifier 8540 bl.length()=727 2024-09-19T14:29:52.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.742+0000 7f0c0effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-19T14:29:52.747 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.742+0000 7f0c0effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-19T14:29:52.749 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-19T14:29:52.749 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "foobar.client.0", 2024-09-19T14:29:52.749 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Mr.foobar.client.0", 2024-09-19T14:29:52.749 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "foobar+test@test.test", 2024-09-19T14:29:52.749 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2024-09-19T14:29:52.749 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 1000, 2024-09-19T14:29:52.749 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2024-09-19T14:29:52.749 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2024-09-19T14:29:52.749 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-19T14:29:52.750 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "foobar.client.0", 2024-09-19T14:29:52.750 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "CNZDOVDXOVTPRBROGROI", 2024-09-19T14:29:52.750 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "T39hVe0kn11hkh1HA6qtGSSEttftW/+iBKHASHJbJ/qN2pZs1wTk6A==", 2024-09-19T14:29:52.750 INFO:teuthology.orchestra.run.smithi153.stdout: "active": true, 2024-09-19T14:29:52.750 INFO:teuthology.orchestra.run.smithi153.stdout: "create_date": "2024-09-19T14:29:52.323352Z" 2024-09-19T14:29:52.750 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-19T14:29:52.750 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-19T14:29:52.750 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2024-09-19T14:29:52.750 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [ 2024-09-19T14:29:52.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-19T14:29:52.750 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "oidc-provider", 2024-09-19T14:29:52.750 INFO:teuthology.orchestra.run.smithi153.stdout: "perm": "*" 2024-09-19T14:29:52.750 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:29:52.750 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-19T14:29:52.751 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "roles", 2024-09-19T14:29:52.751 INFO:teuthology.orchestra.run.smithi153.stdout: "perm": "*" 2024-09-19T14:29:52.751 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:29:52.751 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-19T14:29:52.751 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "user-policy", 2024-09-19T14:29:52.751 INFO:teuthology.orchestra.run.smithi153.stdout: "perm": "*" 2024-09-19T14:29:52.751 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-19T14:29:52.751 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-19T14:29:52.751 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2024-09-19T14:29:52.751 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2024-09-19T14:29:52.751 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2024-09-19T14:29:52.751 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2024-09-19T14:29:52.751 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2024-09-19T14:29:52.751 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2024-09-19T14:29:52.751 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:29:52.752 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2024-09-19T14:29:52.752 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:29:52.752 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2024-09-19T14:29:52.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:29:52.752 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2024-09-19T14:29:52.752 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2024-09-19T14:29:52.752 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:29:52.752 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2024-09-19T14:29:52.752 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:29:52.752 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2024-09-19T14:29:52.752 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:29:52.752 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2024-09-19T14:29:52.752 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "rgw", 2024-09-19T14:29:52.752 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [ 2024-09-19T14:29:52.753 INFO:teuthology.orchestra.run.smithi153.stdout: "0974264362" 2024-09-19T14:29:52.753 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-19T14:29:52.753 INFO:teuthology.orchestra.run.smithi153.stdout: "account_id": "", 2024-09-19T14:29:52.753 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "/", 2024-09-19T14:29:52.753 INFO:teuthology.orchestra.run.smithi153.stdout: "create_date": "2024-09-19T14:29:52.323336Z", 2024-09-19T14:29:52.753 INFO:teuthology.orchestra.run.smithi153.stdout: "tags": [], 2024-09-19T14:29:52.753 INFO:teuthology.orchestra.run.smithi153.stdout: "group_ids": [] 2024-09-19T14:29:52.753 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-19T14:29:52.753 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:52.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.746+0000 7f0be5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:52.754 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.750+0000 7f0d3218a9c0 20 remove_watcher() i=0 2024-09-19T14:29:52.755 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.750+0000 7f0d3218a9c0 2 removed watcher, disabling cache 2024-09-19T14:29:52.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.754+0000 7f0d3218a9c0 20 remove_watcher() i=1 2024-09-19T14:29:52.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.754+0000 7f0d3218a9c0 20 remove_watcher() i=2 2024-09-19T14:29:52.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.758+0000 7f0d3218a9c0 20 remove_watcher() i=3 2024-09-19T14:29:52.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.758+0000 7f0d3218a9c0 20 remove_watcher() i=4 2024-09-19T14:29:52.764 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.762+0000 7f0d3218a9c0 20 remove_watcher() i=5 2024-09-19T14:29:52.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.762+0000 7f0d3218a9c0 20 remove_watcher() i=6 2024-09-19T14:29:52.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.762+0000 7f0d3218a9c0 20 remove_watcher() i=7 2024-09-19T14:29:52.780 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-19T14:29:52.858 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:29:52.858 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:29:52.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.898+0000 7fdaaafc99c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.898+0000 7fdaaafc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.898+0000 7fdaaafc99c0 20 realm 2024-09-19T14:29:52.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.898+0000 7fdaaafc99c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.898+0000 7fdaaafc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.898+0000 7fdaaafc99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:29:52.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.898+0000 7fdaaafc99c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.898+0000 7fdaaafc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:52.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.898+0000 7fdaaafc99c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.902+0000 7fdaaafc99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:52.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.902+0000 7fdaaafc99c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:52.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.902+0000 7fdaaafc99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:29:52.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:52.902+0000 7fdaaafc99c0 20 searching for the correct realm 2024-09-19T14:29:53.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.114+0000 7fdaa92d0640 0 -- 172.21.15.153:0/944104754 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7fda90030040 msgr2=0x7fda9003c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:53.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.122+0000 7fdaa8acf640 0 -- 172.21.15.153:0/944104754 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fda90008030 msgr2=0x7fda9004c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:53.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.342+0000 7fdaaafc99c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:29:53.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.342+0000 7fdaaafc99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:29:53.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.342+0000 7fdaaafc99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:29:53.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.342+0000 7fdaaafc99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:29:53.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.342+0000 7fdaaafc99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:29:53.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.342+0000 7fdaaafc99c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:29:53.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.342+0000 7fdaaafc99c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.342+0000 7fdaaafc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.342+0000 7fdaaafc99c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.342+0000 7fdaaafc99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:53.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.342+0000 7fdaaafc99c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.342+0000 7fdaaafc99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:29:53.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.342+0000 7fdaaafc99c0 20 zone default found 2024-09-19T14:29:53.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.342+0000 7fdaaafc99c0 4 Realm: () 2024-09-19T14:29:53.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.342+0000 7fdaaafc99c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:29:53.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.342+0000 7fdaaafc99c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:29:53.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.342+0000 7fdaaafc99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:29:53.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.342+0000 7fdaaafc99c0 20 zonegroup default 2024-09-19T14:29:53.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.342+0000 7fdaaafc99c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.342+0000 7fdaaafc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.342+0000 7fdaaafc99c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.346+0000 7fdaaafc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.346+0000 7fdaaafc99c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.346+0000 7fdaaafc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.346+0000 7fdaaafc99c0 20 started sync module instance, tier type = 2024-09-19T14:29:53.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.346+0000 7fdaaafc99c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:29:53.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.370+0000 7fdaaafc99c0 20 add_watcher() i=0 2024-09-19T14:29:53.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.370+0000 7fdaaafc99c0 20 add_watcher() i=1 2024-09-19T14:29:53.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.370+0000 7fdaaafc99c0 20 add_watcher() i=2 2024-09-19T14:29:53.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.370+0000 7fdaaafc99c0 20 add_watcher() i=3 2024-09-19T14:29:53.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.370+0000 7fdaaafc99c0 20 add_watcher() i=4 2024-09-19T14:29:53.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.370+0000 7fdaaafc99c0 20 add_watcher() i=5 2024-09-19T14:29:53.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.370+0000 7fdaaafc99c0 20 add_watcher() i=6 2024-09-19T14:29:53.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.374+0000 7fdaaafc99c0 20 add_watcher() i=7 2024-09-19T14:29:53.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.374+0000 7fdaaafc99c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:29:53.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.378+0000 7fd95f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:53.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.378+0000 7fdaaafc99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:29:53.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.378+0000 7fdaaafc99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:29:53.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.378+0000 7fdaaafc99c0 5 note: GC not initialized 2024-09-19T14:29:53.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.378+0000 7fd95e7e4640 20 reqs_thread_entry: start 2024-09-19T14:29:53.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.378+0000 7fdaaafc99c0 20 init_complete bucket index max shards: 11 2024-09-19T14:29:53.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.378+0000 7fdaaafc99c0 20 Filter name: none 2024-09-19T14:29:53.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.378+0000 7fd957fff640 20 reqs_thread_entry: start 2024-09-19T14:29:53.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.378+0000 7fdaaafc99c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-19T14:29:53.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.378+0000 7fdaaafc99c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.378+0000 7fdaaafc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.378+0000 7fdaaafc99c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-19T14:29:53.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.378+0000 7fdaaafc99c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-19T14:29:53.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.378+0000 7fdaaafc99c0 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-19T14:29:53.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.378+0000 7fdaaafc99c0 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-19T14:29:53.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.378+0000 7fdaaafc99c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.378+0000 7fdaaafc99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.378+0000 7fdaaafc99c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-19T14:29:53.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.382+0000 7fdaaafc99c0 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-19T14:29:53.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.382+0000 7fdaaafc99c0 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-19T14:29:53.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.382+0000 7fdaaafc99c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-19T14:29:53.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.382+0000 7fdaaafc99c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-19T14:29:53.386 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.382+0000 7fdaaafc99c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-19T14:29:53.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.382+0000 7fd97f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235441 cookie 94676595155856 notifier 8558 bl.length()=384 2024-09-19T14:29:53.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.382+0000 7fd97f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-19T14:29:53.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.382+0000 7fd97f7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-19T14:29:53.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.390+0000 7fdaaafc99c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-19T14:29:53.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.390+0000 7fdaaafc99c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-19T14:29:53.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.390+0000 7fdaaafc99c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-19T14:29:53.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.390+0000 7fd97f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235512 cookie 94676595162336 notifier 8558 bl.length()=225 2024-09-19T14:29:53.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.390+0000 7fd97f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-19T14:29:53.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.390+0000 7fd97f7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-19T14:29:53.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.394+0000 7fdaaafc99c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-19T14:29:53.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.394+0000 7fdaaafc99c0 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-19T14:29:53.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.394+0000 7fdaaafc99c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-19T14:29:53.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.398+0000 7fd97ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235455 cookie 94676595148944 notifier 8558 bl.length()=234 2024-09-19T14:29:53.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.398+0000 7fd97ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-19T14:29:53.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.398+0000 7fd97ffff640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-19T14:29:53.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.402+0000 7fd95f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:53.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.406+0000 7fdaaafc99c0 20 remove_watcher() i=0 2024-09-19T14:29:53.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.406+0000 7fdaaafc99c0 2 removed watcher, disabling cache 2024-09-19T14:29:53.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.406+0000 7fdaaafc99c0 20 remove_watcher() i=1 2024-09-19T14:29:53.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.410+0000 7fdaaafc99c0 20 remove_watcher() i=2 2024-09-19T14:29:53.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.414+0000 7fdaaafc99c0 20 remove_watcher() i=3 2024-09-19T14:29:53.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.414+0000 7fdaaafc99c0 20 remove_watcher() i=4 2024-09-19T14:29:53.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.414+0000 7fdaaafc99c0 20 remove_watcher() i=5 2024-09-19T14:29:53.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.418+0000 7fdaaafc99c0 20 remove_watcher() i=6 2024-09-19T14:29:53.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.418+0000 7fdaaafc99c0 20 remove_watcher() i=7 2024-09-19T14:29:53.436 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-19T14:29:53.436 INFO:teuthology.orchestra.run.smithi153.stdout: "id": "RGW88888888888888888", 2024-09-19T14:29:53.436 INFO:teuthology.orchestra.run.smithi153.stdout: "tenant": "", 2024-09-19T14:29:53.436 INFO:teuthology.orchestra.run.smithi153.stdout: "name": "Mr.RGW88888888888888888", 2024-09-19T14:29:53.436 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-19T14:29:53.436 INFO:teuthology.orchestra.run.smithi153.stdout: "quota": { 2024-09-19T14:29:53.436 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2024-09-19T14:29:53.437 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:29:53.437 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2024-09-19T14:29:53.437 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:29:53.437 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2024-09-19T14:29:53.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:29:53.437 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2024-09-19T14:29:53.437 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2024-09-19T14:29:53.437 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:29:53.437 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2024-09-19T14:29:53.437 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:29:53.437 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2024-09-19T14:29:53.437 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:29:53.437 INFO:teuthology.orchestra.run.smithi153.stdout: "max_users": 1000, 2024-09-19T14:29:53.437 INFO:teuthology.orchestra.run.smithi153.stdout: "max_roles": 1000, 2024-09-19T14:29:53.437 INFO:teuthology.orchestra.run.smithi153.stdout: "max_groups": 1000, 2024-09-19T14:29:53.437 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 1000, 2024-09-19T14:29:53.438 INFO:teuthology.orchestra.run.smithi153.stdout: "max_access_keys": 4 2024-09-19T14:29:53.438 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-19T14:29:53.439 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-19T14:29:53.439 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key BTCEUKEQATTCTXNLUEHD --secret SiLx4G79b3gzCpNzhfpULDCScpOGoP+DY6oHLdU47nXZz6imJFqnIQ== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-19T14:29:53.531 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:29:53.531 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:29:53.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.570+0000 7f0905d139c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.570+0000 7f0905d139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.570+0000 7f0905d139c0 20 realm 2024-09-19T14:29:53.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.570+0000 7f0905d139c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.570+0000 7f0905d139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.570+0000 7f0905d139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:29:53.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.570+0000 7f0905d139c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.570+0000 7f0905d139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.570+0000 7f0905d139c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.574+0000 7f0905d139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:53.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.574+0000 7f0905d139c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.574+0000 7f0905d139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:29:53.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.574+0000 7f0905d139c0 20 searching for the correct realm 2024-09-19T14:29:53.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.578+0000 7f0903018640 0 -- 172.21.15.153:0/2018477453 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f08fc017070 msgr2=0x7f08fc052040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:53.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.586+0000 7f0903018640 0 -- 172.21.15.153:0/2018477453 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f07cc083070 msgr2=0x7f07cc0854a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:53.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.590+0000 7f0905d139c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:29:53.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.590+0000 7f0905d139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:29:53.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.590+0000 7f0905d139c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:29:53.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.590+0000 7f0905d139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:29:53.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.590+0000 7f0905d139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:29:53.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.590+0000 7f0905d139c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:29:53.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.590+0000 7f0905d139c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.590+0000 7f0905d139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.590+0000 7f0905d139c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.594+0000 7f0905d139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:53.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.594+0000 7f0905d139c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.594+0000 7f0905d139c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:29:53.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.594+0000 7f0905d139c0 20 zone default found 2024-09-19T14:29:53.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.594+0000 7f0905d139c0 4 Realm: () 2024-09-19T14:29:53.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.594+0000 7f0905d139c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:29:53.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.594+0000 7f0905d139c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:29:53.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.594+0000 7f0905d139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:29:53.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.594+0000 7f0905d139c0 20 zonegroup default 2024-09-19T14:29:53.597 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.594+0000 7f0905d139c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.594+0000 7f0905d139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.594+0000 7f0905d139c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.594+0000 7f0905d139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.594+0000 7f0905d139c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.594+0000 7f0905d139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.594+0000 7f0905d139c0 20 started sync module instance, tier type = 2024-09-19T14:29:53.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.594+0000 7f0905d139c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:29:53.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.610+0000 7f0905d139c0 20 add_watcher() i=0 2024-09-19T14:29:53.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.610+0000 7f0905d139c0 20 add_watcher() i=1 2024-09-19T14:29:53.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.610+0000 7f0905d139c0 20 add_watcher() i=2 2024-09-19T14:29:53.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.610+0000 7f0905d139c0 20 add_watcher() i=3 2024-09-19T14:29:53.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.610+0000 7f0905d139c0 20 add_watcher() i=4 2024-09-19T14:29:53.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.610+0000 7f0905d139c0 20 add_watcher() i=5 2024-09-19T14:29:53.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.610+0000 7f0905d139c0 20 add_watcher() i=6 2024-09-19T14:29:53.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.610+0000 7f0905d139c0 20 add_watcher() i=7 2024-09-19T14:29:53.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.610+0000 7f0905d139c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:29:53.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.614+0000 7f07b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:53.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.614+0000 7f0905d139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:29:53.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.614+0000 7f0905d139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:29:53.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.614+0000 7f0905d139c0 5 note: GC not initialized 2024-09-19T14:29:53.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.614+0000 7f07b8fe1640 20 reqs_thread_entry: start 2024-09-19T14:29:53.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.614+0000 7f0905d139c0 20 init_complete bucket index max shards: 11 2024-09-19T14:29:53.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.614+0000 7f0905d139c0 20 Filter name: none 2024-09-19T14:29:53.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.614+0000 7f07327fc640 20 reqs_thread_entry: start 2024-09-19T14:29:53.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.614+0000 7f0905d139c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-19T14:29:53.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.614+0000 7f0905d139c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.614+0000 7f0905d139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.614+0000 7f0905d139c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-19T14:29:53.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.614+0000 7f0905d139c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-19T14:29:53.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.614+0000 7f0905d139c0 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-19T14:29:53.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.614+0000 7f0905d139c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.614+0000 7f0905d139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.614+0000 7f0905d139c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-19T14:29:53.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.614+0000 7f0905d139c0 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-19T14:29:53.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.614+0000 7f0905d139c0 10 cache get: name=default.rgw.meta+users.keys+BTCEUKEQATTCTXNLUEHD : miss 2024-09-19T14:29:53.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.614+0000 7f0905d139c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.618+0000 7f0905d139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.618+0000 7f0905d139c0 10 cache put: name=default.rgw.meta+users.keys+BTCEUKEQATTCTXNLUEHD info.flags=0x0 2024-09-19T14:29:53.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.618+0000 7f0905d139c0 10 adding default.rgw.meta+users.keys+BTCEUKEQATTCTXNLUEHD to cache LRU end 2024-09-19T14:29:53.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.618+0000 7f0905d139c0 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-19T14:29:53.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.618+0000 7f0905d139c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.618+0000 7f0905d139c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-19T14:29:53.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.618+0000 7f0905d139c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-19T14:29:53.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.618+0000 7f0905d139c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-19T14:29:53.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.618+0000 7f0905d139c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:29:53.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.618+0000 7f0905d139c0 10 cache get: name=default.rgw.meta+users.keys+BTCEUKEQATTCTXNLUEHD : hit (negative entry) 2024-09-19T14:29:53.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.618+0000 7f0905d139c0 10 cache get: name=default.rgw.meta+users.keys+BTCEUKEQATTCTXNLUEHD : hit (negative entry) 2024-09-19T14:29:53.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.618+0000 7f0905d139c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-19T14:29:53.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.618+0000 7f0905d139c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-19T14:29:53.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.618+0000 7f0905d139c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-19T14:29:53.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.622+0000 7f07e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235442 cookie 94849917459056 notifier 8573 bl.length()=681 2024-09-19T14:29:53.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.622+0000 7f07e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-19T14:29:53.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.622+0000 7f07e2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-19T14:29:53.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.626+0000 7f0905d139c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-19T14:29:53.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.626+0000 7f0905d139c0 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-19T14:29:53.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.626+0000 7f0905d139c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-19T14:29:53.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.626+0000 7f07e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235535 cookie 94849917469936 notifier 8573 bl.length()=189 2024-09-19T14:29:53.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.626+0000 7f07e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-19T14:29:53.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.626+0000 7f07e2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-19T14:29:53.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.630+0000 7f0905d139c0 10 cache put: name=default.rgw.meta+users.keys+BTCEUKEQATTCTXNLUEHD info.flags=0x7 2024-09-19T14:29:53.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.630+0000 7f0905d139c0 10 moving default.rgw.meta+users.keys+BTCEUKEQATTCTXNLUEHD to cache LRU end 2024-09-19T14:29:53.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.630+0000 7f0905d139c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:BTCEUKEQATTCTXNLUEHD, ofs0, ns] 2024-09-19T14:29:53.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.630+0000 7f07e27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235536 cookie 94849917469936 notifier 8573 bl.length()=188 2024-09-19T14:29:53.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.630+0000 7f07e27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+BTCEUKEQATTCTXNLUEHD info.flags=0x7 2024-09-19T14:29:53.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.630+0000 7f07e27fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+BTCEUKEQATTCTXNLUEHD to cache LRU end 2024-09-19T14:29:53.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.634+0000 7f0905d139c0 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-19T14:29:53.636 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-19T14:29:53.636 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "root1.client.0", 2024-09-19T14:29:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-19T14:29:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "root1+test@test.test", 2024-09-19T14:29:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2024-09-19T14:29:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 1000, 2024-09-19T14:29:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2024-09-19T14:29:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2024-09-19T14:29:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-19T14:29:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "root1.client.0", 2024-09-19T14:29:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "BTCEUKEQATTCTXNLUEHD", 2024-09-19T14:29:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "SiLx4G79b3gzCpNzhfpULDCScpOGoP+DY6oHLdU47nXZz6imJFqnIQ==", 2024-09-19T14:29:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: "active": true, 2024-09-19T14:29:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: "create_date": "2024-09-19T14:29:53.621350Z" 2024-09-19T14:29:53.637 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-19T14:29:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-19T14:29:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2024-09-19T14:29:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2024-09-19T14:29:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2024-09-19T14:29:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2024-09-19T14:29:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2024-09-19T14:29:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2024-09-19T14:29:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2024-09-19T14:29:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2024-09-19T14:29:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:29:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2024-09-19T14:29:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:29:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2024-09-19T14:29:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:29:53.638 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2024-09-19T14:29:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2024-09-19T14:29:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:29:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2024-09-19T14:29:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:29:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2024-09-19T14:29:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:29:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2024-09-19T14:29:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "root", 2024-09-19T14:29:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [], 2024-09-19T14:29:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: "account_id": "RGW88888888888888888", 2024-09-19T14:29:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "/", 2024-09-19T14:29:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: "create_date": "2024-09-19T14:29:53.621317Z", 2024-09-19T14:29:53.639 INFO:teuthology.orchestra.run.smithi153.stdout: "tags": [], 2024-09-19T14:29:53.640 INFO:teuthology.orchestra.run.smithi153.stdout: "group_ids": [] 2024-09-19T14:29:53.640 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-19T14:29:53.640 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:53.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.634+0000 7f07b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:53.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.638+0000 7f0905d139c0 20 remove_watcher() i=0 2024-09-19T14:29:53.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.638+0000 7f0905d139c0 2 removed watcher, disabling cache 2024-09-19T14:29:53.644 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.642+0000 7f0905d139c0 20 remove_watcher() i=1 2024-09-19T14:29:53.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.642+0000 7f0905d139c0 20 remove_watcher() i=2 2024-09-19T14:29:53.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.646+0000 7f0905d139c0 20 remove_watcher() i=3 2024-09-19T14:29:53.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.650+0000 7f0905d139c0 20 remove_watcher() i=4 2024-09-19T14:29:53.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.650+0000 7f0905d139c0 20 remove_watcher() i=5 2024-09-19T14:29:53.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.650+0000 7f0905d139c0 20 remove_watcher() i=6 2024-09-19T14:29:53.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.650+0000 7f0905d139c0 20 remove_watcher() i=7 2024-09-19T14:29:53.669 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 1573214699 --totp-seed 7SG6XOHMJS5FREUV6R4MPUEPJCCLUS47ALRZ6CLOGTHFVJTSPEO7EVHAPJ62YIXX --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-19T14:29:53.709 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:29:53.709 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:29:53.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.746+0000 7f1e9e3d59c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.746+0000 7f1e9e3d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.746+0000 7f1e9e3d59c0 20 realm 2024-09-19T14:29:53.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.746+0000 7f1e9e3d59c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.746+0000 7f1e9e3d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.746+0000 7f1e9e3d59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:29:53.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.746+0000 7f1e9e3d59c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.746+0000 7f1e9e3d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.746+0000 7f1e9e3d59c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.750+0000 7f1e9e3d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:53.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.750+0000 7f1e9e3d59c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.750+0000 7f1e9e3d59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:29:53.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.750+0000 7f1e9e3d59c0 20 searching for the correct realm 2024-09-19T14:29:53.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.758+0000 7f1e9b6da640 0 -- 172.21.15.153:0/3395238140 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f1e8c115020 msgr2=0x7f1e8c10b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:53.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.762+0000 7f1e9b6da640 0 -- 172.21.15.153:0/3395238140 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f1d640830a0 msgr2=0x7f1d640854d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:53.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:29:53.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:29:53.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:29:53.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:29:53.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:29:53.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:29:53.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:53.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:29:53.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 20 zone default found 2024-09-19T14:29:53.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 4 Realm: () 2024-09-19T14:29:53.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:29:53.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:29:53.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:29:53.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 20 zonegroup default 2024-09-19T14:29:53.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 20 started sync module instance, tier type = 2024-09-19T14:29:53.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.770+0000 7f1e9e3d59c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:29:53.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.786+0000 7f1e9e3d59c0 20 add_watcher() i=0 2024-09-19T14:29:53.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.786+0000 7f1e9e3d59c0 20 add_watcher() i=1 2024-09-19T14:29:53.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.786+0000 7f1e9e3d59c0 20 add_watcher() i=2 2024-09-19T14:29:53.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.786+0000 7f1e9e3d59c0 20 add_watcher() i=3 2024-09-19T14:29:53.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.786+0000 7f1e9e3d59c0 20 add_watcher() i=4 2024-09-19T14:29:53.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.786+0000 7f1e9e3d59c0 20 add_watcher() i=5 2024-09-19T14:29:53.790 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.786+0000 7f1e9e3d59c0 20 add_watcher() i=6 2024-09-19T14:29:53.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.786+0000 7f1e9e3d59c0 20 add_watcher() i=7 2024-09-19T14:29:53.791 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.786+0000 7f1e9e3d59c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:29:53.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.790+0000 7f1d51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:53.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.790+0000 7f1e9e3d59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:29:53.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.790+0000 7f1e9e3d59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:29:53.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.790+0000 7f1e9e3d59c0 5 note: GC not initialized 2024-09-19T14:29:53.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.790+0000 7f1d50fe1640 20 reqs_thread_entry: start 2024-09-19T14:29:53.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.790+0000 7f1e9e3d59c0 20 init_complete bucket index max shards: 11 2024-09-19T14:29:53.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.790+0000 7f1e9e3d59c0 20 Filter name: none 2024-09-19T14:29:53.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.790+0000 7f1cca7fc640 20 reqs_thread_entry: start 2024-09-19T14:29:53.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.790+0000 7f1e9e3d59c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-19T14:29:53.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.790+0000 7f1e9e3d59c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.790+0000 7f1e9e3d59c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-19T14:29:53.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.790+0000 7f1e9e3d59c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-19T14:29:53.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.790+0000 7f1e9e3d59c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-19T14:29:53.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.790+0000 7f1e9e3d59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:29:53.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.794+0000 7f1e9e3d59c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-19T14:29:53.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.794+0000 7f1e9e3d59c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-19T14:29:53.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.794+0000 7f1e9e3d59c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-19T14:29:53.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.794+0000 7f1d7affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235443 cookie 94724022380048 notifier 9165 bl.length()=695 2024-09-19T14:29:53.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.794+0000 7f1d7affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-19T14:29:53.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.794+0000 7f1d7affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-19T14:29:53.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.798+0000 7f1d51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:53.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.802+0000 7f1e9e3d59c0 20 remove_watcher() i=0 2024-09-19T14:29:53.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.802+0000 7f1e9e3d59c0 2 removed watcher, disabling cache 2024-09-19T14:29:53.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.806+0000 7f1e9e3d59c0 20 remove_watcher() i=1 2024-09-19T14:29:53.811 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.806+0000 7f1e9e3d59c0 20 remove_watcher() i=2 2024-09-19T14:29:53.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.810+0000 7f1e9e3d59c0 20 remove_watcher() i=3 2024-09-19T14:29:53.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.810+0000 7f1e9e3d59c0 20 remove_watcher() i=4 2024-09-19T14:29:53.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.814+0000 7f1e9e3d59c0 20 remove_watcher() i=5 2024-09-19T14:29:53.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.814+0000 7f1e9e3d59c0 20 remove_watcher() i=6 2024-09-19T14:29:53.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.814+0000 7f1e9e3d59c0 20 remove_watcher() i=7 2024-09-19T14:29:53.833 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-19T14:29:53.914 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:29:53.914 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:29:53.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.950+0000 7ff8b13c39c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.954+0000 7ff8b13c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.954+0000 7ff8b13c39c0 20 realm 2024-09-19T14:29:53.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.954+0000 7ff8b13c39c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.954+0000 7ff8b13c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.954+0000 7ff8b13c39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:29:53.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.954+0000 7ff8b13c39c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.954+0000 7ff8b13c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:53.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.954+0000 7ff8b13c39c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.954+0000 7ff8b13c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:53.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.954+0000 7ff8b13c39c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:53.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.954+0000 7ff8b13c39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:29:53.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.954+0000 7ff8b13c39c0 20 searching for the correct realm 2024-09-19T14:29:53.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:53.962+0000 7ff8af6ca640 0 -- 172.21.15.153:0/2685069090 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7ff89803f950 msgr2=0x7ff89803c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:54.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.178+0000 7ff8aeec9640 0 -- 172.21.15.153:0/2685069090 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x55f6df67da70 msgr2=0x55f6df67fe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:54.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.186+0000 7ff8b13c39c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:29:54.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.186+0000 7ff8b13c39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:29:54.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.186+0000 7ff8b13c39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:29:54.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.186+0000 7ff8b13c39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:29:54.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.186+0000 7ff8b13c39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:29:54.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.186+0000 7ff8b13c39c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:29:54.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.186+0000 7ff8b13c39c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.186+0000 7ff8b13c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:54.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.186+0000 7ff8b13c39c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.186+0000 7ff8b13c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:54.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.186+0000 7ff8b13c39c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.190+0000 7ff8b13c39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:29:54.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.190+0000 7ff8b13c39c0 20 zone default found 2024-09-19T14:29:54.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.190+0000 7ff8b13c39c0 4 Realm: () 2024-09-19T14:29:54.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.190+0000 7ff8b13c39c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:29:54.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.190+0000 7ff8b13c39c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:29:54.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.190+0000 7ff8b13c39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:29:54.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.190+0000 7ff8b13c39c0 20 zonegroup default 2024-09-19T14:29:54.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.190+0000 7ff8b13c39c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.190+0000 7ff8b13c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:54.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.190+0000 7ff8b13c39c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.190+0000 7ff8b13c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:54.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.190+0000 7ff8b13c39c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.190+0000 7ff8b13c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:54.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.190+0000 7ff8b13c39c0 20 started sync module instance, tier type = 2024-09-19T14:29:54.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.190+0000 7ff8b13c39c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:29:54.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.214+0000 7ff8b13c39c0 20 add_watcher() i=0 2024-09-19T14:29:54.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.214+0000 7ff8b13c39c0 20 add_watcher() i=1 2024-09-19T14:29:54.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.214+0000 7ff8b13c39c0 20 add_watcher() i=2 2024-09-19T14:29:54.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.214+0000 7ff8b13c39c0 20 add_watcher() i=3 2024-09-19T14:29:54.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.214+0000 7ff8b13c39c0 20 add_watcher() i=4 2024-09-19T14:29:54.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.214+0000 7ff8b13c39c0 20 add_watcher() i=5 2024-09-19T14:29:54.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.214+0000 7ff8b13c39c0 20 add_watcher() i=6 2024-09-19T14:29:54.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.218+0000 7ff8b13c39c0 20 add_watcher() i=7 2024-09-19T14:29:54.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.218+0000 7ff8b13c39c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:29:54.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.222+0000 7ff765fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:54.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.222+0000 7ff8b13c39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:29:54.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.222+0000 7ff8b13c39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:29:54.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.222+0000 7ff8b13c39c0 5 note: GC not initialized 2024-09-19T14:29:54.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.222+0000 7ff764fe1640 20 reqs_thread_entry: start 2024-09-19T14:29:54.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.222+0000 7ff8b13c39c0 20 init_complete bucket index max shards: 11 2024-09-19T14:29:54.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.222+0000 7ff8b13c39c0 20 Filter name: none 2024-09-19T14:29:54.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.222+0000 7ff75dffb640 20 reqs_thread_entry: start 2024-09-19T14:29:54.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.222+0000 7ff8b13c39c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-19T14:29:54.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.222+0000 7ff8b13c39c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.222+0000 7ff8b13c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:54.227 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.222+0000 7ff8b13c39c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-19T14:29:54.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.222+0000 7ff8b13c39c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-19T14:29:54.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.222+0000 7ff8b13c39c0 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-19T14:29:54.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.222+0000 7ff8b13c39c0 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-19T14:29:54.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.222+0000 7ff8b13c39c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.226+0000 7ff8b13c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:54.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.226+0000 7ff8b13c39c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-19T14:29:54.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.226+0000 7ff8b13c39c0 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-19T14:29:54.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.226+0000 7ff8b13c39c0 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-19T14:29:54.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.230+0000 7ff8b13c39c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-19T14:29:54.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.230+0000 7ff8b13c39c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-19T14:29:54.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.230+0000 7ff8b13c39c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-19T14:29:54.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.230+0000 7ff791ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235444 cookie 94518798474720 notifier 9183 bl.length()=384 2024-09-19T14:29:54.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.230+0000 7ff791ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-19T14:29:54.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.230+0000 7ff791ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-19T14:29:54.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.234+0000 7ff8b13c39c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-19T14:29:54.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.234+0000 7ff8b13c39c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-19T14:29:54.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.234+0000 7ff8b13c39c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-19T14:29:54.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.234+0000 7ff791ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235513 cookie 94518798487152 notifier 9183 bl.length()=225 2024-09-19T14:29:54.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.234+0000 7ff791ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-19T14:29:54.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.234+0000 7ff791ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-19T14:29:54.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.242+0000 7ff8b13c39c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-19T14:29:54.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.242+0000 7ff8b13c39c0 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-19T14:29:54.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.242+0000 7ff8b13c39c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-19T14:29:54.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.242+0000 7ff791ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235456 cookie 94518798482384 notifier 9183 bl.length()=234 2024-09-19T14:29:54.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.242+0000 7ff791ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-19T14:29:54.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.242+0000 7ff791ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-19T14:29:54.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.246+0000 7ff765fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:54.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.250+0000 7ff8b13c39c0 20 remove_watcher() i=0 2024-09-19T14:29:54.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.250+0000 7ff8b13c39c0 2 removed watcher, disabling cache 2024-09-19T14:29:54.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.250+0000 7ff8b13c39c0 20 remove_watcher() i=1 2024-09-19T14:29:54.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.254+0000 7ff8b13c39c0 20 remove_watcher() i=2 2024-09-19T14:29:54.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.258+0000 7ff8b13c39c0 20 remove_watcher() i=3 2024-09-19T14:29:54.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.258+0000 7ff8b13c39c0 20 remove_watcher() i=4 2024-09-19T14:29:54.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.262+0000 7ff8b13c39c0 20 remove_watcher() i=5 2024-09-19T14:29:54.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.262+0000 7ff8b13c39c0 20 remove_watcher() i=6 2024-09-19T14:29:54.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.262+0000 7ff8b13c39c0 20 remove_watcher() i=7 2024-09-19T14:29:54.280 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-19T14:29:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: "id": "RGW99999999999999999", 2024-09-19T14:29:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: "tenant": "", 2024-09-19T14:29:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: "name": "Mr.RGW99999999999999999", 2024-09-19T14:29:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-19T14:29:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: "quota": { 2024-09-19T14:29:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2024-09-19T14:29:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:29:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2024-09-19T14:29:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:29:54.280 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2024-09-19T14:29:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:29:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2024-09-19T14:29:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2024-09-19T14:29:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:29:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2024-09-19T14:29:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:29:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2024-09-19T14:29:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:29:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: "max_users": 1000, 2024-09-19T14:29:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: "max_roles": 1000, 2024-09-19T14:29:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: "max_groups": 1000, 2024-09-19T14:29:54.281 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 1000, 2024-09-19T14:29:54.282 INFO:teuthology.orchestra.run.smithi153.stdout: "max_access_keys": 4 2024-09-19T14:29:54.282 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-19T14:29:54.283 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-19T14:29:54.283 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key ALVMZTMLLDNQEGKOWJDD --secret FBEvoi/DFFt2BXcBAcwwnqXU9CMV4wJCsA7FvOQFENc9H2uKBs7ynA== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-19T14:29:54.368 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:29:54.368 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:29:54.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.406+0000 7f2fc92b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.406+0000 7f2fc92b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:54.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.406+0000 7f2fc92b79c0 20 realm 2024-09-19T14:29:54.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.406+0000 7f2fc92b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.410+0000 7f2fc92b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:54.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.410+0000 7f2fc92b79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:29:54.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.410+0000 7f2fc92b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.410+0000 7f2fc92b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:54.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.410+0000 7f2fc92b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.410+0000 7f2fc92b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:54.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.410+0000 7f2fc92b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.410+0000 7f2fc92b79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:29:54.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.410+0000 7f2fc92b79c0 20 searching for the correct realm 2024-09-19T14:29:54.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.418+0000 7f2fc65bc640 0 -- 172.21.15.153:0/3122060951 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f2fb8040060 msgr2=0x7f2fb809c320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:29:54.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.422+0000 7f2fc65bc640 0 -- 172.21.15.153:0/3122060951 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f2e90083070 msgr2=0x7f2e900854a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:54.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.430+0000 7f2fc92b79c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:29:54.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.430+0000 7f2fc92b79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:29:54.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.430+0000 7f2fc92b79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:29:54.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.430+0000 7f2fc92b79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:29:54.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.430+0000 7f2fc92b79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:29:54.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.430+0000 7f2fc92b79c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:29:54.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.430+0000 7f2fc92b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.430+0000 7f2fc92b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:54.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.430+0000 7f2fc92b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.430+0000 7f2fc92b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:54.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.430+0000 7f2fc92b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.430+0000 7f2fc92b79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:29:54.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.430+0000 7f2fc92b79c0 20 zone default found 2024-09-19T14:29:54.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.430+0000 7f2fc92b79c0 4 Realm: () 2024-09-19T14:29:54.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.430+0000 7f2fc92b79c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:29:54.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.430+0000 7f2fc92b79c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:29:54.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.430+0000 7f2fc92b79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:29:54.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.430+0000 7f2fc92b79c0 20 zonegroup default 2024-09-19T14:29:54.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.430+0000 7f2fc92b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.434+0000 7f2fc92b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:54.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.434+0000 7f2fc92b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.434+0000 7f2fc92b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:54.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.434+0000 7f2fc92b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.434+0000 7f2fc92b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:54.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.434+0000 7f2fc92b79c0 20 started sync module instance, tier type = 2024-09-19T14:29:54.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.434+0000 7f2fc92b79c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:29:54.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.450+0000 7f2fc92b79c0 20 add_watcher() i=0 2024-09-19T14:29:54.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.450+0000 7f2fc92b79c0 20 add_watcher() i=1 2024-09-19T14:29:54.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.450+0000 7f2fc92b79c0 20 add_watcher() i=2 2024-09-19T14:29:54.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.450+0000 7f2fc92b79c0 20 add_watcher() i=3 2024-09-19T14:29:54.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.450+0000 7f2fc92b79c0 20 add_watcher() i=4 2024-09-19T14:29:54.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.450+0000 7f2fc92b79c0 20 add_watcher() i=5 2024-09-19T14:29:54.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.450+0000 7f2fc92b79c0 20 add_watcher() i=6 2024-09-19T14:29:54.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.450+0000 7f2fc92b79c0 20 add_watcher() i=7 2024-09-19T14:29:54.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.450+0000 7f2fc92b79c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:29:54.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2e7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:54.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:29:54.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:29:54.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 5 note: GC not initialized 2024-09-19T14:29:54.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2df7fff640 20 reqs_thread_entry: start 2024-09-19T14:29:54.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 20 init_complete bucket index max shards: 11 2024-09-19T14:29:54.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 20 Filter name: none 2024-09-19T14:29:54.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2df5ffb640 20 reqs_thread_entry: start 2024-09-19T14:29:54.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-19T14:29:54.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:54.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-19T14:29:54.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-19T14:29:54.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-19T14:29:54.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:54.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-19T14:29:54.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-19T14:29:54.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 10 cache get: name=default.rgw.meta+users.keys+ALVMZTMLLDNQEGKOWJDD : miss 2024-09-19T14:29:54.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:54.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 10 cache put: name=default.rgw.meta+users.keys+ALVMZTMLLDNQEGKOWJDD info.flags=0x0 2024-09-19T14:29:54.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 10 adding default.rgw.meta+users.keys+ALVMZTMLLDNQEGKOWJDD to cache LRU end 2024-09-19T14:29:54.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-19T14:29:54.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-19T14:29:54.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-19T14:29:54.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-19T14:29:54.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:29:54.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 10 cache get: name=default.rgw.meta+users.keys+ALVMZTMLLDNQEGKOWJDD : hit (negative entry) 2024-09-19T14:29:54.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.454+0000 7f2fc92b79c0 10 cache get: name=default.rgw.meta+users.keys+ALVMZTMLLDNQEGKOWJDD : hit (negative entry) 2024-09-19T14:29:54.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.458+0000 7f2fc92b79c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-19T14:29:54.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.458+0000 7f2fc92b79c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-19T14:29:54.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.458+0000 7f2fc92b79c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-19T14:29:54.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.458+0000 7f2eaa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235445 cookie 94283463656624 notifier 8621 bl.length()=681 2024-09-19T14:29:54.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.458+0000 7f2eaa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-19T14:29:54.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.458+0000 7f2eaa7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-19T14:29:54.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.462+0000 7f2fc92b79c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-19T14:29:54.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.462+0000 7f2fc92b79c0 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-19T14:29:54.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.462+0000 7f2fc92b79c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-19T14:29:54.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.466+0000 7f2ea9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235537 cookie 94283463650192 notifier 8621 bl.length()=189 2024-09-19T14:29:54.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.466+0000 7f2ea9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-19T14:29:54.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.466+0000 7f2ea9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-19T14:29:54.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.470+0000 7f2fc92b79c0 10 cache put: name=default.rgw.meta+users.keys+ALVMZTMLLDNQEGKOWJDD info.flags=0x7 2024-09-19T14:29:54.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.470+0000 7f2fc92b79c0 10 moving default.rgw.meta+users.keys+ALVMZTMLLDNQEGKOWJDD to cache LRU end 2024-09-19T14:29:54.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.470+0000 7f2fc92b79c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:ALVMZTMLLDNQEGKOWJDD, ofs0, ns] 2024-09-19T14:29:54.472 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.470+0000 7f2ea9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235538 cookie 94283463665200 notifier 8621 bl.length()=188 2024-09-19T14:29:54.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.470+0000 7f2ea9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ALVMZTMLLDNQEGKOWJDD info.flags=0x7 2024-09-19T14:29:54.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.470+0000 7f2ea9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ALVMZTMLLDNQEGKOWJDD to cache LRU end 2024-09-19T14:29:54.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.474+0000 7f2fc92b79c0 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-19T14:29:54.477 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-19T14:29:54.477 INFO:teuthology.orchestra.run.smithi153.stdout: "user_id": "root2.client.0", 2024-09-19T14:29:54.477 INFO:teuthology.orchestra.run.smithi153.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-19T14:29:54.477 INFO:teuthology.orchestra.run.smithi153.stdout: "email": "root2+test@test.test", 2024-09-19T14:29:54.477 INFO:teuthology.orchestra.run.smithi153.stdout: "suspended": 0, 2024-09-19T14:29:54.477 INFO:teuthology.orchestra.run.smithi153.stdout: "max_buckets": 1000, 2024-09-19T14:29:54.477 INFO:teuthology.orchestra.run.smithi153.stdout: "subusers": [], 2024-09-19T14:29:54.477 INFO:teuthology.orchestra.run.smithi153.stdout: "keys": [ 2024-09-19T14:29:54.477 INFO:teuthology.orchestra.run.smithi153.stdout: { 2024-09-19T14:29:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: "user": "root2.client.0", 2024-09-19T14:29:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: "access_key": "ALVMZTMLLDNQEGKOWJDD", 2024-09-19T14:29:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: "secret_key": "FBEvoi/DFFt2BXcBAcwwnqXU9CMV4wJCsA7FvOQFENc9H2uKBs7ynA==", 2024-09-19T14:29:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: "active": true, 2024-09-19T14:29:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: "create_date": "2024-09-19T14:29:54.459540Z" 2024-09-19T14:29:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: } 2024-09-19T14:29:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2024-09-19T14:29:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: "swift_keys": [], 2024-09-19T14:29:54.478 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": [], 2024-09-19T14:29:54.480 INFO:teuthology.orchestra.run.smithi153.stdout: "op_mask": "read, write, delete", 2024-09-19T14:29:54.480 INFO:teuthology.orchestra.run.smithi153.stdout: "default_placement": "", 2024-09-19T14:29:54.480 INFO:teuthology.orchestra.run.smithi153.stdout: "default_storage_class": "", 2024-09-19T14:29:54.480 INFO:teuthology.orchestra.run.smithi153.stdout: "placement_tags": [], 2024-09-19T14:29:54.480 INFO:teuthology.orchestra.run.smithi153.stdout: "bucket_quota": { 2024-09-19T14:29:54.480 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2024-09-19T14:29:54.480 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:29:54.480 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2024-09-19T14:29:54.480 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:29:54.480 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2024-09-19T14:29:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:29:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: "user_quota": { 2024-09-19T14:29:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: "enabled": false, 2024-09-19T14:29:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: "check_on_raw": false, 2024-09-19T14:29:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size": -1, 2024-09-19T14:29:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: "max_size_kb": 0, 2024-09-19T14:29:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: "max_objects": -1 2024-09-19T14:29:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2024-09-19T14:29:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: "temp_url_keys": [], 2024-09-19T14:29:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: "type": "root", 2024-09-19T14:29:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: "mfa_ids": [], 2024-09-19T14:29:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: "account_id": "RGW99999999999999999", 2024-09-19T14:29:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "/", 2024-09-19T14:29:54.481 INFO:teuthology.orchestra.run.smithi153.stdout: "create_date": "2024-09-19T14:29:54.459523Z", 2024-09-19T14:29:54.482 INFO:teuthology.orchestra.run.smithi153.stdout: "tags": [], 2024-09-19T14:29:54.482 INFO:teuthology.orchestra.run.smithi153.stdout: "group_ids": [] 2024-09-19T14:29:54.482 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-19T14:29:54.482 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:29:54.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.474+0000 7f2e7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:54.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.478+0000 7f2fc92b79c0 20 remove_watcher() i=0 2024-09-19T14:29:54.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.478+0000 7f2fc92b79c0 2 removed watcher, disabling cache 2024-09-19T14:29:54.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.482+0000 7f2fc92b79c0 20 remove_watcher() i=1 2024-09-19T14:29:54.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.482+0000 7f2fc92b79c0 20 remove_watcher() i=2 2024-09-19T14:29:54.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.486+0000 7f2fc92b79c0 20 remove_watcher() i=3 2024-09-19T14:29:54.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.486+0000 7f2fc92b79c0 20 remove_watcher() i=4 2024-09-19T14:29:54.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.490+0000 7f2fc92b79c0 20 remove_watcher() i=5 2024-09-19T14:29:54.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.490+0000 7f2fc92b79c0 20 remove_watcher() i=6 2024-09-19T14:29:54.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.490+0000 7f2fc92b79c0 20 remove_watcher() i=7 2024-09-19T14:29:54.509 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 2169802854 --totp-seed UM3IHYU3DQIGCKMKJ2U6XI6PRVRRX4HUKBEXCTIOX2J2RT7S5EY7SNUYLYY6ZWON --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-19T14:29:54.549 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T14:29:54.549 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T14:29:54.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.586+0000 7fc36beca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.590+0000 7fc36beca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:54.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.590+0000 7fc36beca9c0 20 realm 2024-09-19T14:29:54.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.590+0000 7fc36beca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.590+0000 7fc36beca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:54.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.590+0000 7fc36beca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T14:29:54.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.590+0000 7fc36beca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.590+0000 7fc36beca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:54.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.590+0000 7fc36beca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.590+0000 7fc36beca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:54.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.590+0000 7fc36beca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.590+0000 7fc36beca9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T14:29:54.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.590+0000 7fc36beca9c0 20 searching for the correct realm 2024-09-19T14:29:54.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.598+0000 7fc36a1d1640 0 -- 172.21.15.153:0/368253443 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x5639e99612f0 msgr2=0x5639e9963760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T14:29:54.606 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.602+0000 7fc3699d0640 0 -- 172.21.15.153:0/368253443 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7fc35c06ff80 msgr2=0x7fc35c06c6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T14:29:54.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.610+0000 7fc36beca9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T14:29:54.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.610+0000 7fc36beca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T14:29:54.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.610+0000 7fc36beca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T14:29:54.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.610+0000 7fc36beca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T14:29:54.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.610+0000 7fc36beca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T14:29:54.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.610+0000 7fc36beca9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T14:29:54.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.610+0000 7fc36beca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.610+0000 7fc36beca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:54.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.610+0000 7fc36beca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.614+0000 7fc36beca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T14:29:54.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.614+0000 7fc36beca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.614+0000 7fc36beca9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T14:29:54.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.614+0000 7fc36beca9c0 20 zone default found 2024-09-19T14:29:54.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.614+0000 7fc36beca9c0 4 Realm: () 2024-09-19T14:29:54.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.614+0000 7fc36beca9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T14:29:54.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.614+0000 7fc36beca9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T14:29:54.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.614+0000 7fc36beca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T14:29:54.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.614+0000 7fc36beca9c0 20 zonegroup default 2024-09-19T14:29:54.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.614+0000 7fc36beca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.614+0000 7fc36beca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:54.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.614+0000 7fc36beca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.614+0000 7fc36beca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:54.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.614+0000 7fc36beca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.614+0000 7fc36beca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T14:29:54.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.614+0000 7fc36beca9c0 20 started sync module instance, tier type = 2024-09-19T14:29:54.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.614+0000 7fc36beca9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T14:29:54.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.634+0000 7fc36beca9c0 20 add_watcher() i=0 2024-09-19T14:29:54.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.634+0000 7fc36beca9c0 20 add_watcher() i=1 2024-09-19T14:29:54.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.634+0000 7fc36beca9c0 20 add_watcher() i=2 2024-09-19T14:29:54.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.634+0000 7fc36beca9c0 20 add_watcher() i=3 2024-09-19T14:29:54.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.634+0000 7fc36beca9c0 20 add_watcher() i=4 2024-09-19T14:29:54.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.634+0000 7fc36beca9c0 20 add_watcher() i=5 2024-09-19T14:29:54.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.634+0000 7fc36beca9c0 20 add_watcher() i=6 2024-09-19T14:29:54.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.634+0000 7fc36beca9c0 20 add_watcher() i=7 2024-09-19T14:29:54.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.634+0000 7fc36beca9c0 2 all 8 watchers are set, enabling cache 2024-09-19T14:29:54.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.638+0000 7fc21b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:54.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.638+0000 7fc36beca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T14:29:54.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.638+0000 7fc36beca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T14:29:54.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.638+0000 7fc36beca9c0 5 note: GC not initialized 2024-09-19T14:29:54.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.638+0000 7fc21a7fc640 20 reqs_thread_entry: start 2024-09-19T14:29:54.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.638+0000 7fc36beca9c0 20 init_complete bucket index max shards: 11 2024-09-19T14:29:54.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.638+0000 7fc36beca9c0 20 Filter name: none 2024-09-19T14:29:54.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.638+0000 7fc18bfff640 20 reqs_thread_entry: start 2024-09-19T14:29:54.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.638+0000 7fc36beca9c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-19T14:29:54.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.638+0000 7fc36beca9c0 20 rados->read ofs=0 len=0 2024-09-19T14:29:54.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.638+0000 7fc36beca9c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-19T14:29:54.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.638+0000 7fc36beca9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-19T14:29:54.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.638+0000 7fc36beca9c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-19T14:29:54.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.638+0000 7fc36beca9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T14:29:54.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.642+0000 7fc36beca9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-19T14:29:54.645 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.642+0000 7fc36beca9c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-19T14:29:54.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.642+0000 7fc36beca9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-19T14:29:54.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.642+0000 7fc24d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235446 cookie 94806732056976 notifier 8639 bl.length()=695 2024-09-19T14:29:54.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.642+0000 7fc24d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-19T14:29:54.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.642+0000 7fc24d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-19T14:29:54.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.646+0000 7fc21b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T14:29:54.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.650+0000 7fc36beca9c0 20 remove_watcher() i=0 2024-09-19T14:29:54.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.650+0000 7fc36beca9c0 2 removed watcher, disabling cache 2024-09-19T14:29:54.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.654+0000 7fc36beca9c0 20 remove_watcher() i=1 2024-09-19T14:29:54.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.654+0000 7fc36beca9c0 20 remove_watcher() i=2 2024-09-19T14:29:54.660 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.658+0000 7fc36beca9c0 20 remove_watcher() i=3 2024-09-19T14:29:54.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.658+0000 7fc36beca9c0 20 remove_watcher() i=4 2024-09-19T14:29:54.664 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.662+0000 7fc36beca9c0 20 remove_watcher() i=5 2024-09-19T14:29:54.665 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.662+0000 7fc36beca9c0 20 remove_watcher() i=6 2024-09-19T14:29:54.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T14:29:54.662+0000 7fc36beca9c0 20 remove_watcher() i=7 2024-09-19T14:29:54.680 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-19T14:29:54.681 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T14:29:54.681 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-19T14:29:54.732 INFO:tasks.s3tests:Configuring boto... 2024-09-19T14:29:54.733 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T14:29:54.733 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-19T14:29:54.781 DEBUG:teuthology.orchestra.run.smithi153:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-19T14:29:54.954 INFO:teuthology.orchestra.run.smithi153.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-19T14:29:55.147 INFO:teuthology.orchestra.run.smithi153.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-19T14:29:55.452 INFO:teuthology.orchestra.run.smithi153.stdout:py installdeps: -rrequirements.txt 2024-09-19T14:31:52.757 INFO:teuthology.orchestra.run.smithi153.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-19T14:31:54.646 INFO:teuthology.orchestra.run.smithi153.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.1,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.10,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.6,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.8.0,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=4c6c4e7b14b144382197cf1266017b21da95917102e5ebc41a715a3cfa5cee8e,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.20.0,urllib3==1.26.20,virtualenv==20.26.5,zope.event==5.0,zope.interface==7.0.3 2024-09-19T14:31:54.647 INFO:teuthology.orchestra.run.smithi153.stdout:py run-test-pre: PYTHONHASHSEED='2854459572' 2024-09-19T14:31:54.647 INFO:teuthology.orchestra.run.smithi153.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-19T14:31:54.809 INFO:teuthology.orchestra.run.smithi153.stdout:============================= test session starts ============================== 2024-09-19T14:31:54.809 INFO:teuthology.orchestra.run.smithi153.stdout:platform linux -- Python 3.10.6, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-19T14:31:54.809 INFO:teuthology.orchestra.run.smithi153.stdout:cachedir: .tox/py/.pytest_cache 2024-09-19T14:31:54.809 INFO:teuthology.orchestra.run.smithi153.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-19T14:31:54.809 INFO:teuthology.orchestra.run.smithi153.stdout:configfile: pytest.ini 2024-09-19T14:31:56.594 INFO:teuthology.orchestra.run.smithi153.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-19T14:31:56.594 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T14:31:57.883 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-19T14:31:58.760 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-19T14:31:59.641 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-19T14:32:00.532 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-19T14:32:01.390 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-19T14:32:02.119 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-19T14:32:03.144 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-19T14:32:03.894 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-19T14:32:04.069 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-19T14:32:04.242 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-19T14:32:05.126 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-19T14:32:06.013 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-19T14:32:06.873 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-19T14:32:07.713 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-19T14:32:07.901 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-19T14:32:08.078 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-19T14:32:08.209 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-19T14:32:08.364 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-19T14:32:08.492 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-19T14:32:08.621 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-19T14:32:08.740 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-19T14:32:08.872 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-19T14:32:09.001 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-19T14:32:09.130 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-19T14:32:09.254 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-19T14:32:09.383 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-19T14:32:09.511 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-19T14:32:09.637 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-19T14:32:09.765 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-19T14:32:09.892 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-19T14:32:10.020 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-19T14:32:10.150 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-19T14:32:10.278 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-19T14:32:10.409 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-19T14:32:10.551 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-19T14:32:10.678 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-19T14:32:10.805 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-19T14:32:10.934 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-19T14:32:11.061 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-19T14:32:11.193 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-19T14:32:11.320 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-19T14:32:11.448 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-19T14:32:11.575 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-19T14:32:11.700 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-19T14:32:11.828 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-19T14:32:11.955 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-19T14:32:12.083 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-19T14:32:12.215 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-19T14:32:12.344 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-19T14:32:12.471 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-19T14:32:12.599 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-19T14:32:12.726 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-19T14:32:12.858 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-19T14:32:14.585 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-19T14:32:31.777 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-19T14:32:50.373 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-19T14:33:17.239 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-19T14:33:51.570 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-19T14:34:01.271 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-19T14:34:12.325 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-19T14:34:15.610 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-19T14:34:16.713 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-19T14:34:19.592 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-19T14:34:22.415 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-19T14:34:24.482 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-19T14:34:25.781 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-19T14:34:26.755 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-19T14:34:26.757 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-19T14:34:26.759 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-19T14:34:26.761 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-19T14:34:26.767 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-19T14:34:26.770 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-19T14:34:26.772 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-19T14:34:26.774 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-19T14:34:26.776 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-19T14:34:26.779 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-19T14:34:26.781 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-19T14:34:26.784 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-19T14:34:26.786 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-19T14:34:26.788 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-19T14:34:26.791 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-19T14:34:26.793 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-19T14:34:26.795 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-19T14:34:26.796 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-19T14:34:26.798 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-19T14:34:26.800 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-19T14:34:26.802 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-19T14:34:26.804 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-19T14:34:26.806 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-19T14:34:26.807 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-19T14:34:26.809 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-19T14:34:26.811 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-19T14:34:26.812 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-19T14:34:26.814 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-19T14:34:26.914 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-19T14:34:26.928 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-19T14:34:29.303 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-19T14:34:42.148 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-19T14:34:43.775 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-19T14:34:45.808 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-19T14:34:47.849 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-19T14:34:49.884 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-19T14:34:51.943 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-19T14:34:53.624 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-19T14:34:55.656 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-19T14:34:57.517 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-19T14:34:59.309 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-19T14:35:00.930 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-19T14:35:02.298 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-19T14:35:03.797 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-19T14:35:04.725 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-19T14:35:06.391 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-19T14:35:08.263 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-19T14:35:10.151 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-19T14:35:11.813 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-19T14:35:13.513 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-19T14:35:15.185 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-19T14:35:16.932 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-19T14:35:18.530 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-19T14:35:20.011 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-19T14:35:21.536 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-19T14:35:22.480 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-19T14:35:23.408 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-19T14:35:24.350 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-19T14:35:25.269 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-19T14:35:26.220 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-19T14:35:28.001 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-19T14:35:28.965 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-19T14:35:30.152 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-19T14:35:31.396 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-19T14:35:32.626 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-19T14:35:33.571 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-19T14:35:34.834 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-19T14:35:36.053 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-19T14:35:37.596 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-19T14:35:38.791 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-19T14:35:40.046 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-19T14:35:41.340 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-19T14:35:43.208 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-19T14:35:45.395 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-19T14:35:47.381 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-19T14:35:49.596 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-19T14:35:51.989 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-19T14:35:56.352 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-19T14:36:00.756 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-19T14:36:03.280 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-19T14:36:05.656 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-19T14:36:07.656 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-19T14:36:09.792 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-19T14:36:11.324 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-19T14:36:14.232 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-19T14:36:16.161 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-19T14:36:18.512 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-19T14:36:22.769 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-19T14:36:28.216 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-19T14:36:31.549 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-19T14:36:34.566 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-19T14:36:36.997 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-19T14:36:38.661 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-19T14:36:41.372 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-19T14:36:43.402 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-19T14:36:46.019 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-19T14:36:47.888 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-19T14:36:51.190 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-19T14:36:54.449 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-19T14:36:58.019 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-19T14:37:01.587 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-19T14:37:04.280 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-19T14:37:06.718 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-19T14:37:08.709 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-19T14:37:12.960 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-19T14:37:16.234 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-19T14:37:19.960 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-19T14:37:23.356 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-19T14:37:26.765 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-19T14:37:30.185 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-19T14:37:33.068 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-19T14:37:35.098 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-19T14:37:37.392 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-19T14:37:41.356 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-19T14:37:46.387 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-19T14:37:48.754 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-19T14:37:52.095 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-19T14:37:55.428 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-19T14:37:58.968 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-19T14:38:02.902 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-19T14:38:07.035 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-19T14:38:10.910 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-19T14:38:14.509 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-19T14:38:16.865 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-19T14:38:18.813 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-19T14:38:20.653 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-19T14:38:22.602 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-19T14:38:26.580 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-19T14:38:30.405 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-19T14:38:34.064 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-19T14:38:37.822 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-19T14:38:41.581 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-19T14:38:45.457 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-19T14:38:49.256 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-19T14:38:53.019 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-19T14:38:56.736 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-19T14:39:00.531 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-19T14:39:04.342 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-19T14:39:08.080 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-19T14:39:10.784 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-19T14:39:13.532 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-19T14:39:16.108 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-19T14:39:18.780 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-19T14:39:20.922 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-19T14:39:23.484 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-19T14:39:25.727 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-19T14:39:28.046 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-19T14:39:30.348 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-19T14:39:32.597 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-19T14:39:34.985 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-19T14:39:37.245 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-19T14:39:39.583 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-19T14:39:43.484 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-19T14:39:47.327 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-19T14:39:49.378 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-19T14:39:51.273 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-19T14:39:53.641 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-19T14:39:55.925 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-19T14:39:59.880 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-19T14:40:03.736 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-19T14:40:06.001 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-19T14:40:08.317 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-19T14:40:10.706 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-19T14:40:13.044 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-19T14:40:15.338 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-19T14:40:17.668 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-19T14:40:20.073 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-19T14:40:22.313 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-19T14:40:24.618 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-19T14:40:26.828 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-19T14:40:29.148 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-19T14:40:31.523 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-19T14:40:33.760 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-19T14:40:36.016 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-19T14:40:38.139 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-19T14:40:40.513 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-19T14:40:42.795 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-19T14:43:01.113 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-19T14:43:03.333 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-19T14:43:05.523 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-19T14:43:07.793 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-19T14:43:09.976 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-19T14:43:12.197 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-19T14:43:14.398 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-19T14:43:16.606 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-19T14:43:18.760 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-19T14:43:20.940 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-19T14:43:23.188 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-19T14:43:25.402 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-19T14:43:27.626 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-19T14:43:29.911 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-19T14:43:32.221 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-19T14:43:34.483 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-19T14:43:36.833 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-19T14:43:39.218 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-19T14:43:41.528 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-19T14:43:43.820 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-19T14:43:46.163 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-19T14:43:48.419 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-19T14:43:50.739 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-19T14:43:53.325 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-19T14:43:55.782 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-19T14:43:58.046 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-19T14:44:00.380 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-19T14:44:02.742 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-19T14:44:05.005 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-19T14:44:06.030 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-19T14:44:08.015 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-19T14:44:13.948 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-19T14:44:19.633 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-19T14:44:21.973 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-19T14:44:24.289 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-19T14:44:26.702 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-19T14:44:28.977 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-19T14:44:31.556 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-19T14:44:34.085 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-19T14:44:36.441 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-19T14:44:38.722 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-19T14:44:41.032 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-19T14:44:43.452 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-19T14:44:45.734 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-19T14:44:48.088 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-19T14:44:50.809 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-19T14:44:54.517 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-19T14:44:56.370 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-19T14:44:58.360 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-19T14:45:00.011 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-19T14:45:01.626 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-19T14:45:02.617 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-19T14:45:03.576 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-19T14:45:04.557 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-19T14:45:06.501 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-19T14:45:15.502 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-19T14:45:16.473 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-19T14:45:18.390 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-19T14:45:19.972 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-19T14:45:21.684 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-19T14:45:23.381 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-19T14:45:29.035 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-19T14:45:31.558 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-19T14:45:34.110 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-19T14:47:51.077 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-19T14:50:07.579 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-19T14:50:09.477 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-19T14:50:11.379 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-19T14:50:13.355 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-19T14:50:15.249 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-19T14:50:17.408 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-19T14:50:19.347 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-19T14:50:21.347 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-19T14:50:23.606 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-19T14:50:25.506 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-19T14:50:27.521 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-19T14:50:29.569 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-19T14:50:31.785 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-19T14:50:33.750 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-19T14:50:35.422 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-19T14:50:37.261 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-19T14:50:39.065 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-19T14:50:42.656 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-19T14:50:44.671 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-19T14:50:46.588 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-19T14:50:48.429 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-19T14:50:50.670 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-19T14:50:52.673 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-19T14:50:54.337 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-19T14:50:56.017 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-19T14:50:57.738 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-19T14:50:59.405 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-19T14:51:01.025 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-19T14:51:02.732 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-19T14:51:04.787 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-19T14:51:06.483 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-19T14:51:08.162 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-19T14:51:09.765 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-19T14:51:11.485 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-19T14:51:14.037 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-19T14:51:15.863 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-19T14:51:17.834 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-19T14:51:19.693 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-19T14:51:21.456 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-19T14:51:23.163 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-19T14:51:24.846 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-19T14:51:26.492 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-19T14:51:30.201 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-19T14:51:31.861 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-19T14:51:33.895 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-19T14:51:35.822 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-19T14:51:37.838 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-19T14:51:39.782 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-19T14:51:41.733 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-19T14:51:44.898 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-19T14:51:46.819 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-19T14:51:48.838 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-19T14:51:50.989 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-19T14:51:53.215 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-19T14:51:55.311 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-19T14:51:57.260 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-19T14:51:59.521 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-19T14:52:01.639 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-19T14:52:03.550 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-19T14:52:05.745 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-19T14:52:07.603 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-19T14:52:09.473 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-19T14:52:11.323 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-19T14:52:13.328 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-19T14:52:15.029 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-19T14:52:15.949 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-19T14:52:18.482 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-19T14:52:20.329 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-19T14:52:22.146 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-19T14:52:27.072 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-19T14:52:28.992 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-19T14:52:30.952 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-19T14:52:32.872 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-19T14:52:34.689 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-19T14:52:36.469 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-19T14:52:38.396 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-19T14:52:40.462 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-19T14:52:42.496 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-19T14:52:44.419 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-19T14:52:46.305 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-19T14:52:48.204 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-19T14:52:50.163 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-19T14:52:52.200 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-19T14:52:54.044 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-19T14:52:56.030 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-19T14:52:58.092 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-19T14:53:00.110 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-19T14:53:01.007 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-19T14:53:02.036 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-19T14:53:02.973 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-19T14:53:04.553 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-19T14:53:05.986 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-19T14:53:07.495 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-19T14:53:08.964 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-19T14:53:10.598 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-19T14:53:11.575 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-19T14:53:12.591 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-19T14:53:14.117 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-19T14:53:15.125 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-19T14:53:16.056 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-19T14:53:16.999 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-19T14:53:17.975 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-19T14:53:19.619 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-19T14:53:21.302 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-19T14:53:22.999 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-19T14:53:24.579 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-19T14:53:26.152 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-19T14:53:27.935 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-19T14:53:29.516 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-19T14:53:31.277 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-19T14:53:32.810 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-19T14:53:34.578 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-19T14:53:36.538 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-19T14:53:38.526 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-19T14:53:40.651 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-19T14:53:42.668 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-19T14:53:44.565 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-19T14:53:46.717 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-19T14:53:48.853 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-19T14:53:50.926 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-19T14:53:53.316 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-19T14:53:54.958 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-19T14:53:57.112 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-19T14:53:59.246 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-19T14:54:01.425 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-19T14:54:03.631 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-19T14:54:05.745 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-19T14:54:08.850 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-19T14:54:11.531 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-19T14:54:14.236 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-19T14:54:17.054 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-19T14:54:19.824 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-19T14:54:21.628 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-19T14:54:23.617 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-19T14:54:25.619 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-19T14:54:27.617 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-19T14:54:29.459 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-19T14:54:31.674 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-19T14:54:34.721 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-19T14:54:37.634 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-19T14:54:40.633 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-19T14:54:43.633 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-19T14:54:46.534 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-19T14:54:49.587 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-19T14:54:52.548 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-19T14:54:55.597 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-19T14:54:58.685 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-19T14:55:01.563 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-19T14:55:04.472 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-19T14:55:07.499 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-19T14:55:11.774 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-19T14:55:15.852 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-19T14:55:16.832 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-19T14:55:17.836 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-19T14:55:18.842 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-19T14:55:20.691 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-19T14:55:22.517 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-19T14:55:24.046 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-19T14:55:25.493 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-19T14:55:28.007 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-19T14:55:33.920 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-19T14:55:36.684 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-19T14:55:38.880 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-19T14:55:47.189 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-19T14:55:49.481 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-19T14:55:51.662 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-19T14:55:53.751 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-19T14:55:55.844 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-19T14:55:58.887 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-19T14:56:01.338 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-19T14:56:04.133 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-19T14:56:06.737 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-19T14:56:10.807 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-19T14:56:14.676 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-19T14:56:16.309 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-19T14:56:18.226 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-19T14:56:24.337 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-19T14:56:26.906 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-19T14:57:08.809 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-19T14:57:10.775 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-19T14:57:13.247 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-19T14:57:21.227 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-19T14:57:23.480 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-19T14:57:27.326 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-19T14:57:50.062 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-19T14:58:26.982 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-19T14:59:15.826 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-19T15:02:38.126 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-19T15:03:04.156 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-19T15:03:40.042 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-19T15:03:43.284 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-19T15:03:55.263 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-19T15:04:05.928 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-19T15:04:12.586 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-19T15:04:14.521 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-19T15:04:24.697 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-19T15:04:27.083 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-19T15:04:29.263 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-19T15:04:31.284 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-19T15:04:59.458 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-19T15:05:05.632 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-19T15:05:07.697 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-19T15:05:09.711 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-19T15:05:11.813 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-19T15:05:22.065 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-19T15:05:27.191 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-19T15:05:32.122 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-19T15:05:34.321 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-19T15:05:36.424 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-19T15:05:38.642 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-19T15:05:40.807 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-19T15:05:42.876 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-19T15:05:44.993 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-19T15:05:46.993 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-19T15:05:50.877 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-19T15:05:58.066 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-19T15:06:10.623 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-19T15:06:15.455 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-19T15:06:24.650 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-19T15:06:39.821 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-19T15:06:44.136 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-19T15:06:52.609 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-19T15:07:07.891 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-19T15:07:12.451 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-19T15:07:14.743 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-19T15:07:17.942 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-19T15:07:19.880 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-19T15:07:30.137 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-19T15:07:32.131 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-19T15:07:34.087 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-19T15:07:36.024 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-19T15:07:37.967 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-19T15:07:40.777 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-19T15:08:05.379 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-19T15:08:09.055 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-19T15:08:11.579 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-19T15:08:14.771 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-19T15:08:18.012 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-19T15:08:29.017 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-19T15:08:32.332 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-19T15:08:44.944 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-19T15:09:28.861 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-19T15:10:25.314 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-19T15:10:31.550 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-19T15:10:37.485 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-19T15:10:40.364 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-19T15:10:43.416 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-19T15:10:45.771 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-19T15:10:49.105 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-19T15:10:52.390 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-19T15:10:58.041 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-19T15:10:59.955 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-19T15:11:01.824 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-19T15:11:03.672 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-19T15:11:05.436 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-19T15:11:07.192 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-19T15:11:09.024 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-19T15:11:10.843 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-19T15:11:12.516 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-19T15:11:14.680 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-19T15:11:16.712 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-19T15:11:18.603 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-19T15:11:20.534 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-19T15:11:22.240 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-19T15:11:23.981 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-19T15:11:25.971 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-19T15:11:27.868 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-19T15:11:30.636 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-19T15:11:32.559 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-19T15:11:34.647 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-19T15:11:36.843 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-19T15:11:38.802 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-19T15:11:40.603 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-19T15:11:42.381 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-19T15:11:44.109 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-19T15:11:45.916 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-19T15:12:52.910 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-19T15:13:59.050 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-19T15:14:19.251 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-19T15:14:21.288 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-19T15:15:24.637 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-19T15:16:27.136 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-19T15:16:29.286 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-19T15:16:31.301 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-19T15:16:33.043 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-19T15:16:34.677 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-19T15:17:22.595 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-19T15:17:40.367 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-19T15:17:58.420 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-19T15:18:00.513 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-19T15:18:02.555 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-19T15:18:04.523 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-19T15:18:07.345 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-19T15:18:09.326 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-19T15:18:11.293 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-19T15:18:13.514 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-19T15:18:15.650 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-19T15:18:18.050 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-19T15:18:20.429 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-19T15:18:22.623 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-19T15:18:24.675 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-19T15:18:28.143 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-19T15:18:31.560 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-19T15:18:36.802 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-19T15:18:41.967 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-19T15:18:47.224 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-19T15:18:52.998 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-19T15:18:58.318 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-19T15:19:03.489 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-19T15:19:08.927 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-19T15:19:13.879 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-19T15:19:19.296 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-19T15:19:21.396 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-19T15:19:23.410 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-19T15:19:25.468 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-19T15:19:30.876 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-19T15:19:36.213 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-19T15:19:41.742 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-19T15:19:46.470 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-19T15:20:35.334 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-19T15:20:38.405 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-19T15:20:41.617 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-19T15:20:44.677 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-19T15:20:48.589 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-19T15:20:52.232 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-19T15:20:54.301 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-19T15:20:57.757 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-19T15:20:59.407 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-19T15:21:01.028 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-19T15:21:02.718 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-19T15:21:04.353 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-19T15:21:06.496 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-19T15:21:08.292 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-19T15:21:11.291 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-19T15:21:12.998 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-19T15:21:14.602 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-19T15:21:16.474 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-19T15:21:18.241 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-19T15:21:20.108 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-19T15:21:21.839 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-19T15:21:23.455 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-19T15:21:25.114 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-19T15:21:26.788 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-19T15:21:28.367 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-19T15:21:30.516 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-19T15:21:32.383 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-19T15:21:34.397 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-19T15:21:36.485 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-19T15:21:38.511 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-19T15:21:40.355 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-19T15:21:42.710 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-19T15:21:44.815 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-19T15:21:47.065 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-19T15:21:49.070 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-19T15:21:51.294 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-19T15:21:53.436 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-19T15:21:55.739 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-19T15:21:58.067 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-19T15:22:00.301 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-19T15:22:02.405 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-19T15:22:04.222 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-19T15:22:06.287 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-19T15:22:08.559 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-19T15:22:10.332 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-19T15:22:12.502 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-19T15:22:14.841 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-19T15:22:16.812 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-19T15:22:19.016 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-19T15:22:21.120 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-19T15:22:32.534 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-19T15:22:34.487 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-19T15:22:45.229 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-19T15:22:47.401 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-19T15:22:49.481 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-19T15:22:51.226 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-19T15:22:53.049 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-19T15:22:54.845 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-19T15:22:56.771 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-19T15:22:58.644 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-19T15:23:00.466 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-19T15:23:02.257 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-19T15:23:04.073 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-19T15:23:06.102 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-19T15:23:07.984 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-19T15:23:10.004 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-19T15:23:11.981 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-19T15:23:13.778 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-19T15:23:15.585 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-19T15:23:18.238 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-19T15:23:44.686 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-19T15:23:46.436 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-19T15:23:48.349 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-19T15:23:50.320 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-19T15:23:52.502 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-19T15:23:57.494 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-19T15:23:59.520 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-19T15:24:02.745 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-19T15:24:13.613 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-19T15:24:17.527 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-19T15:24:42.762 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-19T15:25:05.868 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-19T15:25:08.181 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-19T15:25:11.496 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-19T15:25:30.689 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-19T15:25:57.610 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-19T15:26:06.139 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-19T15:26:10.968 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-19T15:26:15.890 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-19T15:26:24.497 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-19T15:26:26.854 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-19T15:26:34.312 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-19T15:26:42.878 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-19T15:27:03.606 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-19T15:27:10.490 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-19T15:27:14.695 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-19T15:27:18.382 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-19T15:27:21.041 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-19T15:27:36.355 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-19T15:27:42.399 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-19T15:27:45.794 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-19T15:27:49.025 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-19T15:27:58.225 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-19T15:28:04.263 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-19T15:28:11.735 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-19T15:28:20.125 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-19T15:28:20.934 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-19T15:28:28.288 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-19T15:28:35.703 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-19T15:28:40.318 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-19T15:28:46.653 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-19T15:28:49.902 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-19T15:29:41.945 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-19T15:29:42.731 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-19T15:29:45.162 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-19T15:29:47.011 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-19T15:29:48.991 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-19T15:29:51.447 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-19T15:29:51.562 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-19T15:29:51.562 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:29:51.562 INFO:teuthology.orchestra.run.smithi153.stdout:=============================== warnings summary =============================== 2024-09-19T15:29:51.562 INFO:teuthology.orchestra.run.smithi153.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-19T15:29:51.562 INFO:teuthology.orchestra.run.smithi153.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-19T15:29:51.562 INFO:teuthology.orchestra.run.smithi153.stdout: import imp 2024-09-19T15:29:51.563 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:29:51.563 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py:120 2024-09-19T15:29:51.563 INFO:teuthology.orchestra.run.smithi153.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-19T15:29:51.563 INFO:teuthology.orchestra.run.smithi153.stdout: if boto_type is 'S3Connection': 2024-09-19T15:29:51.563 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:29:51.563 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_headers.py:124 2024-09-19T15:29:51.563 INFO:teuthology.orchestra.run.smithi153.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-19T15:29:51.563 INFO:teuthology.orchestra.run.smithi153.stdout: elif boto_type is 'HTTPRequest': 2024-09-19T15:29:51.563 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:29:51.563 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3.py:359 2024-09-19T15:29:51.563 INFO:teuthology.orchestra.run.smithi153.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence '\W' 2024-09-19T15:29:51.563 INFO:teuthology.orchestra.run.smithi153.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-19T15:29:51.564 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:29:51.564 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py:176 2024-09-19T15:29:51.564 INFO:teuthology.orchestra.run.smithi153.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-19T15:29:51.564 INFO:teuthology.orchestra.run.smithi153.stdout: if k is 'BucketName': 2024-09-19T15:29:51.564 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:29:51.564 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py:253 2024-09-19T15:29:51.564 INFO:teuthology.orchestra.run.smithi153.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-19T15:29:51.564 INFO:teuthology.orchestra.run.smithi153.stdout: @pytest.mark.timeout(10) 2024-09-19T15:29:51.564 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:29:51.564 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-19T15:29:51.564 INFO:teuthology.orchestra.run.smithi153.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-19T15:29:51.564 INFO:teuthology.orchestra.run.smithi153.stdout: @pytest.mark.s3website_routing_rules 2024-09-19T15:29:51.565 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:29:51.565 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-19T15:29:51.565 INFO:teuthology.orchestra.run.smithi153.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence '\$' 2024-09-19T15:29:51.565 INFO:teuthology.orchestra.run.smithi153.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-19T15:29:51.565 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:29:51.565 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-19T15:29:51.565 INFO:teuthology.orchestra.run.smithi153.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence '\$' 2024-09-19T15:29:51.565 INFO:teuthology.orchestra.run.smithi153.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-19T15:29:51.565 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:29:51.565 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-19T15:29:51.565 INFO:teuthology.orchestra.run.smithi153.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence '\$' 2024-09-19T15:29:51.565 INFO:teuthology.orchestra.run.smithi153.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-19T15:29:51.566 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:29:51.566 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-19T15:29:51.566 INFO:teuthology.orchestra.run.smithi153.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence '\$' 2024-09-19T15:29:51.566 INFO:teuthology.orchestra.run.smithi153.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-19T15:29:51.566 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:29:51.566 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-19T15:29:51.566 INFO:teuthology.orchestra.run.smithi153.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence '\$' 2024-09-19T15:29:51.566 INFO:teuthology.orchestra.run.smithi153.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-19T15:29:51.566 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:29:51.566 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-19T15:29:51.566 INFO:teuthology.orchestra.run.smithi153.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence '\$' 2024-09-19T15:29:51.566 INFO:teuthology.orchestra.run.smithi153.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-19T15:29:51.566 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:29:51.566 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-19T15:29:51.567 INFO:teuthology.orchestra.run.smithi153.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence '\$' 2024-09-19T15:29:51.567 INFO:teuthology.orchestra.run.smithi153.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-19T15:29:51.567 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:29:51.567 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-19T15:29:51.567 INFO:teuthology.orchestra.run.smithi153.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence '\$' 2024-09-19T15:29:51.567 INFO:teuthology.orchestra.run.smithi153.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-19T15:29:51.567 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:29:51.567 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-19T15:29:51.567 INFO:teuthology.orchestra.run.smithi153.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence '\$' 2024-09-19T15:29:51.568 INFO:teuthology.orchestra.run.smithi153.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-19T15:29:51.568 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:29:51.568 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-19T15:29:51.568 INFO:teuthology.orchestra.run.smithi153.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence '\$' 2024-09-19T15:29:51.568 INFO:teuthology.orchestra.run.smithi153.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-19T15:29:51.568 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:29:51.568 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-19T15:29:51.568 INFO:teuthology.orchestra.run.smithi153.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence '\$' 2024-09-19T15:29:51.568 INFO:teuthology.orchestra.run.smithi153.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-19T15:29:51.568 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:29:51.568 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-09-19T15:29:51.568 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_iam.py: 82 warnings 2024-09-19T15:29:51.568 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py: 497 warnings 2024-09-19T15:29:51.568 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-09-19T15:29:51.569 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_sns.py: 3 warnings 2024-09-19T15:29:51.569 INFO:teuthology.orchestra.run.smithi153.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi153.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-19T15:29:51.569 INFO:teuthology.orchestra.run.smithi153.stdout: warnings.warn( 2024-09-19T15:29:51.569 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:29:51.569 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-19T15:29:51.569 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-19T15:29:51.569 INFO:teuthology.orchestra.run.smithi153.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:6540: DeprecationWarning: ssl.wrap_socket() is deprecated, use SSLContext.wrap_socket() 2024-09-19T15:29:51.569 INFO:teuthology.orchestra.run.smithi153.stdout: s = ssl.wrap_socket(s); 2024-09-19T15:29:51.569 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:29:51.569 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-19T15:29:51.569 INFO:teuthology.orchestra.run.smithi153.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-19T15:29:51.569 INFO:teuthology.orchestra.run.smithi153.stdout: /usr/lib/python3.10/ssl.py:1434: DeprecationWarning: ssl.PROTOCOL_TLS is deprecated 2024-09-19T15:29:51.570 INFO:teuthology.orchestra.run.smithi153.stdout: context = SSLContext(ssl_version) 2024-09-19T15:29:51.570 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:29:51.570 INFO:teuthology.orchestra.run.smithi153.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-19T15:29:51.570 INFO:teuthology.orchestra.run.smithi153.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 666 warnings in 3476.75s (0:57:56) = 2024-09-19T15:29:51.753 INFO:teuthology.orchestra.run.smithi153.stdout:___________________________________ summary ____________________________________ 2024-09-19T15:29:51.753 INFO:teuthology.orchestra.run.smithi153.stdout: py: commands succeeded 2024-09-19T15:29:51.753 INFO:teuthology.orchestra.run.smithi153.stdout: congratulations :) 2024-09-19T15:29:51.793 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-19T15:29:51.794 DEBUG:teuthology.orchestra.run.smithi153:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-19T15:29:51.896 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T15:29:51.897 INFO:tasks.s3tests:Cleaning up boto... 2024-09-19T15:29:51.897 DEBUG:teuthology.orchestra.run.smithi153:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-19T15:29:51.902 INFO:tasks.s3tests:Removing s3-tests... 2024-09-19T15:29:51.903 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-19T15:29:52.088 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T15:29:52.099 INFO:tasks.workunit:Pulling workunits from ref 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T15:29:52.099 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T15:29:52.099 DEBUG:teuthology.orchestra.run.smithi153:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T15:29:52.105 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T15:29:52.105 INFO:teuthology.orchestra.run.smithi153.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-19T15:29:52.106 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T15:29:52.156 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-19T15:29:52.157 DEBUG:teuthology.orchestra.run.smithi153:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-19T15:29:52.205 INFO:tasks.workunit:timeout=3h 2024-09-19T15:29:52.205 INFO:tasks.workunit:cleanup=True 2024-09-19T15:29:52.205 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T15:29:52.255 INFO:tasks.workunit.client.0.smithi153.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T15:30:51.223 INFO:tasks.workunit.client.0.smithi153.stderr:Note: switching to '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'. 2024-09-19T15:30:51.223 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T15:30:51.223 INFO:tasks.workunit.client.0.smithi153.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T15:30:51.223 INFO:tasks.workunit.client.0.smithi153.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T15:30:51.223 INFO:tasks.workunit.client.0.smithi153.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T15:30:51.223 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T15:30:51.223 INFO:tasks.workunit.client.0.smithi153.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T15:30:51.223 INFO:tasks.workunit.client.0.smithi153.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T15:30:51.224 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T15:30:51.224 INFO:tasks.workunit.client.0.smithi153.stderr: git switch -c 2024-09-19T15:30:51.224 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T15:30:51.224 INFO:tasks.workunit.client.0.smithi153.stderr:Or undo this operation with: 2024-09-19T15:30:51.224 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T15:30:51.224 INFO:tasks.workunit.client.0.smithi153.stderr: git switch - 2024-09-19T15:30:51.224 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T15:30:51.224 INFO:tasks.workunit.client.0.smithi153.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T15:30:51.224 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T15:30:51.224 INFO:tasks.workunit.client.0.smithi153.stderr:HEAD is now at 08af21e0d16 rgw_log_backing: error code not returned 2024-09-19T15:30:51.230 DEBUG:teuthology.orchestra.run.smithi153:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T15:30:51.276 INFO:tasks.workunit.client.0.smithi153.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T15:30:51.280 INFO:tasks.workunit.client.0.smithi153.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T15:30:51.280 INFO:tasks.workunit.client.0.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T15:30:51.332 INFO:tasks.workunit.client.0.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T15:30:51.381 INFO:tasks.workunit.client.0.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T15:30:51.428 INFO:tasks.workunit.client.0.smithi153.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T15:30:51.429 INFO:tasks.workunit.client.0.smithi153.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T15:30:51.429 INFO:tasks.workunit.client.0.smithi153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T15:30:51.473 INFO:tasks.workunit.client.0.smithi153.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T15:30:51.477 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2024-09-19T15:30:51.477 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T15:30:51.524 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-19T15:30:51.525 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-19T15:30:51.525 DEBUG:teuthology.orchestra.run.smithi153:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-19T15:30:51.577 INFO:tasks.workunit.client.0.smithi153.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-19T15:30:51.579 INFO:tasks.workunit.client.0.smithi153.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T15:30:51.579 INFO:tasks.workunit.client.0.smithi153.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T15:30:54.566 INFO:tasks.workunit.client.0.smithi153.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-19T15:30:54.566 INFO:tasks.workunit.client.0.smithi153.stderr:++ deactivate nondestructive 2024-09-19T15:30:54.566 INFO:tasks.workunit.client.0.smithi153.stderr:++ '[' -n '' ']' 2024-09-19T15:30:54.566 INFO:tasks.workunit.client.0.smithi153.stderr:++ '[' -n '' ']' 2024-09-19T15:30:54.567 INFO:tasks.workunit.client.0.smithi153.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T15:30:54.567 INFO:tasks.workunit.client.0.smithi153.stderr:++ hash -r 2024-09-19T15:30:54.567 INFO:tasks.workunit.client.0.smithi153.stderr:++ '[' -n '' ']' 2024-09-19T15:30:54.567 INFO:tasks.workunit.client.0.smithi153.stderr:++ unset VIRTUAL_ENV 2024-09-19T15:30:54.567 INFO:tasks.workunit.client.0.smithi153.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-19T15:30:54.567 INFO:tasks.workunit.client.0.smithi153.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-19T15:30:54.567 INFO:tasks.workunit.client.0.smithi153.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-19T15:30:54.567 INFO:tasks.workunit.client.0.smithi153.stderr:++ export VIRTUAL_ENV 2024-09-19T15:30:54.567 INFO:tasks.workunit.client.0.smithi153.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-19T15:30:54.567 INFO:tasks.workunit.client.0.smithi153.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-19T15:30:54.567 INFO:tasks.workunit.client.0.smithi153.stderr:++ export PATH 2024-09-19T15:30:54.567 INFO:tasks.workunit.client.0.smithi153.stderr:++ '[' -n '' ']' 2024-09-19T15:30:54.567 INFO:tasks.workunit.client.0.smithi153.stderr:++ '[' -z '' ']' 2024-09-19T15:30:54.567 INFO:tasks.workunit.client.0.smithi153.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-19T15:30:54.567 INFO:tasks.workunit.client.0.smithi153.stderr:++ PS1='(rgw) ' 2024-09-19T15:30:54.568 INFO:tasks.workunit.client.0.smithi153.stderr:++ export PS1 2024-09-19T15:30:54.568 INFO:tasks.workunit.client.0.smithi153.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-19T15:30:54.568 INFO:tasks.workunit.client.0.smithi153.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-19T15:30:54.568 INFO:tasks.workunit.client.0.smithi153.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T15:30:54.568 INFO:tasks.workunit.client.0.smithi153.stderr:++ hash -r 2024-09-19T15:30:54.568 INFO:tasks.workunit.client.0.smithi153.stderr:+ pip install pip --upgrade 2024-09-19T15:30:54.963 INFO:tasks.workunit.client.0.smithi153.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-19T15:30:55.201 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting pip 2024-09-19T15:30:55.207 INFO:tasks.workunit.client.0.smithi153.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-19T15:30:55.241 INFO:tasks.workunit.client.0.smithi153.stdout:Installing collected packages: pip 2024-09-19T15:30:55.241 INFO:tasks.workunit.client.0.smithi153.stdout: Attempting uninstall: pip 2024-09-19T15:30:55.241 INFO:tasks.workunit.client.0.smithi153.stdout: Found existing installation: pip 22.0.2 2024-09-19T15:30:55.498 INFO:tasks.workunit.client.0.smithi153.stdout: Uninstalling pip-22.0.2: 2024-09-19T15:30:55.504 INFO:tasks.workunit.client.0.smithi153.stdout: Successfully uninstalled pip-22.0.2 2024-09-19T15:30:56.540 INFO:tasks.workunit.client.0.smithi153.stdout:Successfully installed pip-24.2 2024-09-19T15:30:56.612 INFO:tasks.workunit.client.0.smithi153.stderr:+ pip install boto3 2024-09-19T15:30:57.605 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting boto3 2024-09-19T15:30:57.607 INFO:tasks.workunit.client.0.smithi153.stdout: Using cached boto3-1.35.22-py3-none-any.whl.metadata (6.6 kB) 2024-09-19T15:30:58.106 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting botocore<1.36.0,>=1.35.22 (from boto3) 2024-09-19T15:30:58.107 INFO:tasks.workunit.client.0.smithi153.stdout: Using cached botocore-1.35.22-py3-none-any.whl.metadata (5.7 kB) 2024-09-19T15:30:58.161 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-19T15:30:58.162 INFO:tasks.workunit.client.0.smithi153.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-19T15:30:58.208 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-19T15:30:58.209 INFO:tasks.workunit.client.0.smithi153.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-19T15:30:58.275 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T15:30:58.277 INFO:tasks.workunit.client.0.smithi153.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-19T15:30:58.374 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T15:30:58.375 INFO:tasks.workunit.client.0.smithi153.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-19T15:30:58.515 INFO:tasks.workunit.client.0.smithi153.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.22->boto3) 2024-09-19T15:30:58.516 INFO:tasks.workunit.client.0.smithi153.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-19T15:30:58.519 INFO:tasks.workunit.client.0.smithi153.stdout:Using cached boto3-1.35.22-py3-none-any.whl (139 kB) 2024-09-19T15:30:58.521 INFO:tasks.workunit.client.0.smithi153.stdout:Using cached botocore-1.35.22-py3-none-any.whl (12.6 MB) 2024-09-19T15:30:58.530 INFO:tasks.workunit.client.0.smithi153.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-19T15:30:58.531 INFO:tasks.workunit.client.0.smithi153.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-19T15:30:58.533 INFO:tasks.workunit.client.0.smithi153.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-19T15:30:58.534 INFO:tasks.workunit.client.0.smithi153.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-19T15:30:58.535 INFO:tasks.workunit.client.0.smithi153.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-19T15:30:58.602 INFO:tasks.workunit.client.0.smithi153.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-19T15:30:59.720 INFO:tasks.workunit.client.0.smithi153.stdout:Successfully installed boto3-1.35.22 botocore-1.35.22 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-19T15:30:59.928 INFO:tasks.workunit.client.0.smithi153.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-19T15:31:00.097 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-19T15:31:00.135 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T15:31:00.135 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T15:31:00.178 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.172+0000 7f7a4b33d9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:00.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.172+0000 7f7a4b33d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:00.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.172+0000 7f7a4b33d9c0 20 realm 2024-09-19T15:31:00.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.176+0000 7f7a4b33d9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:00.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.176+0000 7f7a4b33d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:00.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.176+0000 7f7a4b33d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T15:31:00.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.176+0000 7f7a4b33d9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:00.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.176+0000 7f7a4b33d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:00.180 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.176+0000 7f7a4b33d9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:00.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.176+0000 7f7a4b33d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T15:31:00.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.176+0000 7f7a4b33d9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:00.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.176+0000 7f7a4b33d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T15:31:00.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.176+0000 7f7a4b33d9c0 20 searching for the correct realm 2024-09-19T15:31:00.394 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.388+0000 7f7a48642640 0 -- 172.21.15.153:0/2555706677 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x56059f307960 msgr2=0x56059f309e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T15:31:00.404 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.400+0000 7f7a48e43640 0 -- 172.21.15.153:0/2555706677 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f7a3c05e1b0 msgr2=0x7f7a3c064040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T15:31:00.415 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.408+0000 7f7a4b33d9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T15:31:00.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.408+0000 7f7a4b33d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T15:31:00.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.408+0000 7f7a4b33d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T15:31:00.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.408+0000 7f7a4b33d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T15:31:00.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.408+0000 7f7a4b33d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T15:31:00.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.408+0000 7f7a4b33d9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T15:31:00.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.408+0000 7f7a4b33d9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:00.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.412+0000 7f7a4b33d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:00.416 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.412+0000 7f7a4b33d9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:00.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.412+0000 7f7a4b33d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T15:31:00.417 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.412+0000 7f7a4b33d9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:00.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.412+0000 7f7a4b33d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T15:31:00.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.412+0000 7f7a4b33d9c0 20 zone default found 2024-09-19T15:31:00.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.412+0000 7f7a4b33d9c0 4 Realm: () 2024-09-19T15:31:00.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.412+0000 7f7a4b33d9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T15:31:00.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.412+0000 7f7a4b33d9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T15:31:00.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.412+0000 7f7a4b33d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T15:31:00.418 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.412+0000 7f7a4b33d9c0 20 zonegroup default 2024-09-19T15:31:00.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.412+0000 7f7a4b33d9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:00.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.412+0000 7f7a4b33d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:00.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.412+0000 7f7a4b33d9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:00.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.412+0000 7f7a4b33d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:00.419 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.412+0000 7f7a4b33d9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:00.420 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.416+0000 7f7a4b33d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:00.420 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.416+0000 7f7a4b33d9c0 20 started sync module instance, tier type = 2024-09-19T15:31:00.420 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.416+0000 7f7a4b33d9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T15:31:00.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.436+0000 7f7a4b33d9c0 20 add_watcher() i=0 2024-09-19T15:31:00.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.436+0000 7f7a4b33d9c0 20 add_watcher() i=1 2024-09-19T15:31:00.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.436+0000 7f7a4b33d9c0 20 add_watcher() i=2 2024-09-19T15:31:00.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.436+0000 7f7a4b33d9c0 20 add_watcher() i=3 2024-09-19T15:31:00.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.436+0000 7f7a4b33d9c0 20 add_watcher() i=4 2024-09-19T15:31:00.443 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.436+0000 7f7a4b33d9c0 20 add_watcher() i=5 2024-09-19T15:31:00.444 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.436+0000 7f7a4b33d9c0 20 add_watcher() i=6 2024-09-19T15:31:00.445 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.440+0000 7f7a4b33d9c0 20 add_watcher() i=7 2024-09-19T15:31:00.445 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.440+0000 7f7a4b33d9c0 2 all 8 watchers are set, enabling cache 2024-09-19T15:31:00.449 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.444+0000 7f78fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T15:31:00.450 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.444+0000 7f7a4b33d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T15:31:00.450 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.444+0000 7f7a4b33d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T15:31:00.451 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.444+0000 7f7a4b33d9c0 5 note: GC not initialized 2024-09-19T15:31:00.451 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.444+0000 7f78fdfe3640 20 reqs_thread_entry: start 2024-09-19T15:31:00.451 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.444+0000 7f7a4b33d9c0 20 init_complete bucket index max shards: 11 2024-09-19T15:31:00.451 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.444+0000 7f7a4b33d9c0 20 Filter name: none 2024-09-19T15:31:00.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.448+0000 7f786f7fe640 20 reqs_thread_entry: start 2024-09-19T15:31:00.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.448+0000 7f7a4b33d9c0 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-19T15:31:00.452 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.448+0000 7f7a4b33d9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:00.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.448+0000 7f7a4b33d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:00.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.448+0000 7f7a4b33d9c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-19T15:31:00.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.448+0000 7f7a4b33d9c0 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-19T15:31:00.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.448+0000 7f7a4b33d9c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-19T15:31:00.453 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.448+0000 7f7a4b33d9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:00.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.448+0000 7f7a4b33d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:00.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.448+0000 7f7a4b33d9c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-19T15:31:00.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.448+0000 7f7a4b33d9c0 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-19T15:31:00.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.448+0000 7f7a4b33d9c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-19T15:31:00.454 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.448+0000 7f7a4b33d9c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-19T15:31:00.457 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.452+0000 7f7a4b33d9c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-19T15:31:00.457 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.452+0000 7f7a4b33d9c0 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-19T15:31:00.457 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.452+0000 7f7a4b33d9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-19T15:31:00.458 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.452+0000 7f791ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235588 cookie 94582145610384 notifier 9237 bl.length()=613 2024-09-19T15:31:00.458 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.452+0000 7f791ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-19T15:31:00.458 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.452+0000 7f791ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-19T15:31:00.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.456+0000 7f7a4b33d9c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-19T15:31:00.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.456+0000 7f7a4b33d9c0 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-19T15:31:00.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.456+0000 7f7a4b33d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-19T15:31:00.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.456+0000 7f791ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051236711 cookie 94582145607696 notifier 9237 bl.length()=191 2024-09-19T15:31:00.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.456+0000 7f791ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-19T15:31:00.463 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.456+0000 7f791ffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-19T15:31:00.467 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.460+0000 7f78fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T15:31:00.472 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.468+0000 7f7a4b33d9c0 20 remove_watcher() i=0 2024-09-19T15:31:00.472 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.468+0000 7f7a4b33d9c0 2 removed watcher, disabling cache 2024-09-19T15:31:00.474 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.468+0000 7f7a4b33d9c0 20 remove_watcher() i=1 2024-09-19T15:31:00.476 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.472+0000 7f7a4b33d9c0 20 remove_watcher() i=2 2024-09-19T15:31:00.478 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.472+0000 7f7a4b33d9c0 20 remove_watcher() i=3 2024-09-19T15:31:00.481 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.476+0000 7f7a4b33d9c0 20 remove_watcher() i=4 2024-09-19T15:31:00.482 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.476+0000 7f7a4b33d9c0 20 remove_watcher() i=5 2024-09-19T15:31:00.483 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.476+0000 7f7a4b33d9c0 20 remove_watcher() i=6 2024-09-19T15:31:00.485 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:00.480+0000 7f7a4b33d9c0 20 remove_watcher() i=7 2024-09-19T15:31:00.751 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T15:31:00.751 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T15:31:00.802 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T15:31:00.802 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T15:31:00.895 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T15:31:00.896 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T15:31:01.022 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T15:31:01.022 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T15:31:01.099 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-19T15:31:01.099 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T15:31:01.108 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T15:31:01.108 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T15:31:01.211 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T15:31:01.211 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T15:31:01.309 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T15:31:01.309 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T15:31:01.427 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-19T15:31:01.461 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T15:31:01.461 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T15:31:01.507 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.500+0000 7f28615d49c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:01.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.504+0000 7f28615d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:01.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.504+0000 7f28615d49c0 20 realm 2024-09-19T15:31:01.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.504+0000 7f28615d49c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:01.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.504+0000 7f28615d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:01.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.504+0000 7f28615d49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T15:31:01.509 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.504+0000 7f28615d49c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:01.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.504+0000 7f28615d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:01.510 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.504+0000 7f28615d49c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:01.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.504+0000 7f28615d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T15:31:01.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.504+0000 7f28615d49c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:01.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.504+0000 7f28615d49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T15:31:01.511 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.504+0000 7f28615d49c0 20 searching for the correct realm 2024-09-19T15:31:01.517 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.512+0000 7f285e8d9640 0 -- 172.21.15.153:0/2562012882 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x5606433ef6f0 msgr2=0x5606433f1ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T15:31:01.523 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.516+0000 7f285f0da640 0 -- 172.21.15.153:0/2562012882 >> [v2:172.21.15.153:6808/4220035009,v1:172.21.15.153:6809/4220035009] conn(0x7f28540b6b90 msgr2=0x7f28540e4930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T15:31:01.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T15:31:01.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T15:31:01.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T15:31:01.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T15:31:01.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T15:31:01.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T15:31:01.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:01.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:01.532 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:01.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T15:31:01.533 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:01.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T15:31:01.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 20 zone default found 2024-09-19T15:31:01.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 4 Realm: () 2024-09-19T15:31:01.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T15:31:01.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T15:31:01.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T15:31:01.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 20 zonegroup default 2024-09-19T15:31:01.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:01.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:01.534 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:01.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:01.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:01.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:01.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 20 started sync module instance, tier type = 2024-09-19T15:31:01.535 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.528+0000 7f28615d49c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T15:31:01.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.544+0000 7f28615d49c0 20 add_watcher() i=0 2024-09-19T15:31:01.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.544+0000 7f28615d49c0 20 add_watcher() i=1 2024-09-19T15:31:01.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.544+0000 7f28615d49c0 20 add_watcher() i=2 2024-09-19T15:31:01.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.544+0000 7f28615d49c0 20 add_watcher() i=3 2024-09-19T15:31:01.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.544+0000 7f28615d49c0 20 add_watcher() i=4 2024-09-19T15:31:01.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.544+0000 7f28615d49c0 20 add_watcher() i=5 2024-09-19T15:31:01.550 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.544+0000 7f28615d49c0 20 add_watcher() i=6 2024-09-19T15:31:01.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.544+0000 7f28615d49c0 20 add_watcher() i=7 2024-09-19T15:31:01.551 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.544+0000 7f28615d49c0 2 all 8 watchers are set, enabling cache 2024-09-19T15:31:01.553 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.548+0000 7f2715fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T15:31:01.554 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.548+0000 7f28615d49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T15:31:01.554 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.548+0000 7f28615d49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T15:31:01.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.548+0000 7f28615d49c0 5 note: GC not initialized 2024-09-19T15:31:01.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.548+0000 7f2714fe1640 20 reqs_thread_entry: start 2024-09-19T15:31:01.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.548+0000 7f28615d49c0 20 init_complete bucket index max shards: 11 2024-09-19T15:31:01.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.548+0000 7f28615d49c0 20 Filter name: none 2024-09-19T15:31:01.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.548+0000 7f268e7fc640 20 reqs_thread_entry: start 2024-09-19T15:31:01.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.548+0000 7f28615d49c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:01.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.548+0000 7f28615d49c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-19T15:31:01.555 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.548+0000 7f28615d49c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:01.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.552+0000 7f28615d49c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-19T15:31:01.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.552+0000 7f28615d49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T15:31:01.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.552+0000 7f28615d49c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T15:31:01.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.552+0000 7f28615d49c0 20 INFO: main: starting shard=0 2024-09-19T15:31:01.556 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.552+0000 7f28615d49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.0 2024-09-19T15:31:01.557 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.552+0000 7f28615d49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T15:31:01.557 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.552+0000 7f28615d49c0 20 INFO: main: starting shard=1 2024-09-19T15:31:01.557 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.552+0000 7f28615d49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.1 2024-09-19T15:31:01.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.552+0000 7f28615d49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T15:31:01.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.552+0000 7f28615d49c0 20 INFO: main: starting shard=2 2024-09-19T15:31:01.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.552+0000 7f28615d49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.2 2024-09-19T15:31:01.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.552+0000 7f28615d49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T15:31:01.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.552+0000 7f28615d49c0 20 INFO: main: starting shard=3 2024-09-19T15:31:01.558 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.552+0000 7f28615d49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.3 2024-09-19T15:31:01.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.552+0000 7f28615d49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T15:31:01.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.552+0000 7f28615d49c0 20 INFO: main: starting shard=4 2024-09-19T15:31:01.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.552+0000 7f28615d49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.4 2024-09-19T15:31:01.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.552+0000 7f28615d49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T15:31:01.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.552+0000 7f28615d49c0 20 INFO: main: starting shard=5 2024-09-19T15:31:01.559 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.552+0000 7f28615d49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.5 2024-09-19T15:31:01.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.556+0000 7f28615d49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T15:31:01.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.556+0000 7f28615d49c0 20 INFO: main: starting shard=6 2024-09-19T15:31:01.560 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.556+0000 7f28615d49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.6 2024-09-19T15:31:01.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.556+0000 7f28615d49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T15:31:01.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.556+0000 7f28615d49c0 20 INFO: main: starting shard=7 2024-09-19T15:31:01.561 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.556+0000 7f28615d49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.7 2024-09-19T15:31:01.562 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.556+0000 7f28615d49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T15:31:01.562 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.556+0000 7f28615d49c0 20 INFO: main: starting shard=8 2024-09-19T15:31:01.562 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.556+0000 7f28615d49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.8 2024-09-19T15:31:01.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.556+0000 7f28615d49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T15:31:01.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.556+0000 7f28615d49c0 20 INFO: main: starting shard=9 2024-09-19T15:31:01.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.556+0000 7f28615d49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.9 2024-09-19T15:31:01.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.556+0000 7f28615d49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T15:31:01.563 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.556+0000 7f28615d49c0 20 INFO: main: starting shard=10 2024-09-19T15:31:01.564 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.556+0000 7f28615d49c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.10 2024-09-19T15:31:01.564 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.560+0000 7f28615d49c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T15:31:01.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.560+0000 7f28615d49c0 20 INFO: main: done 2024-09-19T15:31:01.565 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.560+0000 7f2715fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T15:31:01.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.564+0000 7f28615d49c0 20 remove_watcher() i=0 2024-09-19T15:31:01.570 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.564+0000 7f28615d49c0 2 removed watcher, disabling cache 2024-09-19T15:31:01.572 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.568+0000 7f28615d49c0 20 remove_watcher() i=1 2024-09-19T15:31:01.574 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.568+0000 7f28615d49c0 20 remove_watcher() i=2 2024-09-19T15:31:01.576 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.572+0000 7f28615d49c0 20 remove_watcher() i=3 2024-09-19T15:31:01.578 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.572+0000 7f28615d49c0 20 remove_watcher() i=4 2024-09-19T15:31:01.580 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.576+0000 7f28615d49c0 20 remove_watcher() i=5 2024-09-19T15:31:01.581 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.576+0000 7f28615d49c0 20 remove_watcher() i=6 2024-09-19T15:31:01.583 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.576+0000 7f28615d49c0 20 remove_watcher() i=7 2024-09-19T15:31:01.598 INFO:tasks.workunit.client.0.smithi153.stderr:rados -p default.rgw.buckets.data ls | grep 25740e69-b7db-4691-8dc1-759f6abcc01d 2024-09-19T15:31:01.620 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T15:31:01.620 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T15:31:01.816 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:01.812+0000 7fdc8fac7640 0 -- 172.21.15.153:0/359841238 >> [v2:172.21.15.196:6810/3095707395,v1:172.21.15.196:6811/3095707395] conn(0x7fdc800802f0 msgr2=0x7fdc80080770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T15:31:01.840 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-19T15:31:01.840 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T15:31:01.841 INFO:tasks.workunit.client.0.smithi153.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-19T15:31:03.290 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T15:31:03.290 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T15:31:03.380 INFO:tasks.workunit.client.0.smithi153.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-19T15:31:03.842 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-19T15:31:03.867 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T15:31:03.867 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T15:31:03.909 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:03.904+0000 7efe89a139c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:03.911 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:03.904+0000 7efe89a139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:03.911 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:03.904+0000 7efe89a139c0 20 realm 2024-09-19T15:31:03.911 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:03.904+0000 7efe89a139c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:03.911 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:03.904+0000 7efe89a139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:03.911 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:03.904+0000 7efe89a139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T15:31:03.911 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:03.904+0000 7efe89a139c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:03.911 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:03.904+0000 7efe89a139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:03.911 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:03.904+0000 7efe89a139c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:03.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:03.908+0000 7efe89a139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T15:31:03.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:03.908+0000 7efe89a139c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:03.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:03.908+0000 7efe89a139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T15:31:03.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:03.908+0000 7efe89a139c0 20 searching for the correct realm 2024-09-19T15:31:03.920 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:03.916+0000 7efe87d1a640 0 -- 172.21.15.153:0/1545749224 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7efe7c008040 msgr2=0x7efe7c02a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T15:31:04.137 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.132+0000 7efe87519640 0 -- 172.21.15.153:0/1545749224 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x5571b52bef90 msgr2=0x5571b52c1430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T15:31:04.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.140+0000 7efe89a139c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T15:31:04.145 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.140+0000 7efe89a139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T15:31:04.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.140+0000 7efe89a139c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T15:31:04.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.140+0000 7efe89a139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T15:31:04.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.140+0000 7efe89a139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T15:31:04.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.140+0000 7efe89a139c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T15:31:04.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.140+0000 7efe89a139c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:04.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.140+0000 7efe89a139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:04.146 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.140+0000 7efe89a139c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:04.147 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.140+0000 7efe89a139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T15:31:04.147 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.140+0000 7efe89a139c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:04.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.144+0000 7efe89a139c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T15:31:04.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.144+0000 7efe89a139c0 20 zone default found 2024-09-19T15:31:04.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.144+0000 7efe89a139c0 4 Realm: () 2024-09-19T15:31:04.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.144+0000 7efe89a139c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T15:31:04.148 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.144+0000 7efe89a139c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T15:31:04.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.144+0000 7efe89a139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T15:31:04.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.144+0000 7efe89a139c0 20 zonegroup default 2024-09-19T15:31:04.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.144+0000 7efe89a139c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:04.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.144+0000 7efe89a139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:04.149 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.144+0000 7efe89a139c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:04.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.144+0000 7efe89a139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:04.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.144+0000 7efe89a139c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:04.150 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.144+0000 7efe89a139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:04.151 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.144+0000 7efe89a139c0 20 started sync module instance, tier type = 2024-09-19T15:31:04.151 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.144+0000 7efe89a139c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T15:31:04.172 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.168+0000 7efe89a139c0 20 add_watcher() i=0 2024-09-19T15:31:04.172 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.168+0000 7efe89a139c0 20 add_watcher() i=1 2024-09-19T15:31:04.172 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.168+0000 7efe89a139c0 20 add_watcher() i=2 2024-09-19T15:31:04.172 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.168+0000 7efe89a139c0 20 add_watcher() i=3 2024-09-19T15:31:04.172 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.168+0000 7efe89a139c0 20 add_watcher() i=4 2024-09-19T15:31:04.173 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.168+0000 7efe89a139c0 20 add_watcher() i=5 2024-09-19T15:31:04.173 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.168+0000 7efe89a139c0 20 add_watcher() i=6 2024-09-19T15:31:04.174 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.168+0000 7efe89a139c0 20 add_watcher() i=7 2024-09-19T15:31:04.174 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.168+0000 7efe89a139c0 2 all 8 watchers are set, enabling cache 2024-09-19T15:31:04.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.172+0000 7efd3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T15:31:04.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.172+0000 7efe89a139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T15:31:04.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.172+0000 7efe89a139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T15:31:04.179 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.172+0000 7efe89a139c0 5 note: GC not initialized 2024-09-19T15:31:04.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.176+0000 7efd3cfe1640 20 reqs_thread_entry: start 2024-09-19T15:31:04.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.176+0000 7efe89a139c0 20 init_complete bucket index max shards: 11 2024-09-19T15:31:04.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.176+0000 7efe89a139c0 20 Filter name: none 2024-09-19T15:31:04.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.176+0000 7efcb67fc640 20 reqs_thread_entry: start 2024-09-19T15:31:04.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.176+0000 7efe89a139c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:04.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.176+0000 7efe89a139c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-19T15:31:04.181 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.176+0000 7efe89a139c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:04.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.176+0000 7efe89a139c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-19T15:31:04.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.176+0000 7efe89a139c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T15:31:04.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.176+0000 7efe89a139c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-19T15:31:04.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.176+0000 7efe89a139c0 20 INFO: main: starting shard=0 2024-09-19T15:31:04.182 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.176+0000 7efe89a139c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.0 2024-09-19T15:31:04.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.176+0000 7efe89a139c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T15:31:04.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.176+0000 7efe89a139c0 20 INFO: main: starting shard=1 2024-09-19T15:31:04.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.176+0000 7efe89a139c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.1 2024-09-19T15:31:04.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.176+0000 7efe89a139c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T15:31:04.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.176+0000 7efe89a139c0 20 INFO: main: starting shard=2 2024-09-19T15:31:04.183 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.176+0000 7efe89a139c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.2 2024-09-19T15:31:04.184 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.180+0000 7efe89a139c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T15:31:04.184 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.180+0000 7efe89a139c0 20 INFO: main: starting shard=3 2024-09-19T15:31:04.184 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.180+0000 7efe89a139c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.3 2024-09-19T15:31:04.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.180+0000 7efe89a139c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T15:31:04.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.180+0000 7efe89a139c0 20 INFO: main: starting shard=4 2024-09-19T15:31:04.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.180+0000 7efe89a139c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.4 2024-09-19T15:31:04.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.180+0000 7efe89a139c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T15:31:04.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.180+0000 7efe89a139c0 20 INFO: main: starting shard=5 2024-09-19T15:31:04.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.180+0000 7efe89a139c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.5 2024-09-19T15:31:04.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.180+0000 7efe89a139c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T15:31:04.185 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.180+0000 7efe89a139c0 20 INFO: main: starting shard=6 2024-09-19T15:31:04.186 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.180+0000 7efe89a139c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.6 2024-09-19T15:31:04.186 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.180+0000 7efe89a139c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T15:31:04.186 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.180+0000 7efe89a139c0 20 INFO: main: starting shard=7 2024-09-19T15:31:04.187 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.180+0000 7efe89a139c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.7 2024-09-19T15:31:04.187 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.180+0000 7efe89a139c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T15:31:04.187 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.180+0000 7efe89a139c0 20 INFO: main: starting shard=8 2024-09-19T15:31:04.187 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.180+0000 7efe89a139c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.8 2024-09-19T15:31:04.188 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.184+0000 7efe89a139c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T15:31:04.188 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.184+0000 7efe89a139c0 20 INFO: main: starting shard=9 2024-09-19T15:31:04.188 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.184+0000 7efe89a139c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.9 2024-09-19T15:31:04.189 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.184+0000 7efe89a139c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T15:31:04.189 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.184+0000 7efe89a139c0 20 INFO: main: starting shard=10 2024-09-19T15:31:04.189 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.184+0000 7efe89a139c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.10 2024-09-19T15:31:04.190 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.184+0000 7efe89a139c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-19T15:31:04.190 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.184+0000 7efe89a139c0 20 INFO: main: done 2024-09-19T15:31:04.191 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.184+0000 7efd3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T15:31:04.196 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.192+0000 7efe89a139c0 20 remove_watcher() i=0 2024-09-19T15:31:04.196 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.192+0000 7efe89a139c0 2 removed watcher, disabling cache 2024-09-19T15:31:04.198 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.192+0000 7efe89a139c0 20 remove_watcher() i=1 2024-09-19T15:31:04.200 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.196+0000 7efe89a139c0 20 remove_watcher() i=2 2024-09-19T15:31:04.202 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.196+0000 7efe89a139c0 20 remove_watcher() i=3 2024-09-19T15:31:04.204 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.200+0000 7efe89a139c0 20 remove_watcher() i=4 2024-09-19T15:31:04.206 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.200+0000 7efe89a139c0 20 remove_watcher() i=5 2024-09-19T15:31:04.207 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.204+0000 7efe89a139c0 20 remove_watcher() i=6 2024-09-19T15:31:04.209 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.204+0000 7efe89a139c0 20 remove_watcher() i=7 2024-09-19T15:31:04.224 INFO:tasks.workunit.client.0.smithi153.stderr:rados -p default.rgw.buckets.data ls | grep e4f90903-ca8f-4565-a627-5769b0393f5e 2024-09-19T15:31:04.248 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T15:31:04.248 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T15:31:04.412 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:04.404+0000 7fd83f128640 0 -- 172.21.15.153:0/963073580 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x7fd8340c0880 msgr2=0x7fd8340a9380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T15:31:04.440 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-19T15:31:04.440 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T15:31:04.442 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T15:31:04.442 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T15:31:04.497 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T15:31:04.497 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T15:31:04.611 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T15:31:04.611 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T15:31:04.692 INFO:tasks.workunit.client.0.smithi153.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-19T15:31:06.140 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T15:31:06.140 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T15:31:06.321 INFO:tasks.workunit.client.0.smithi153.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-19T15:31:06.321 INFO:tasks.workunit.client.0.smithi153.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-19T15:31:06.770 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T15:31:06.770 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T15:31:06.917 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T15:31:06.917 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T15:31:06.994 INFO:tasks.workunit.client.0.smithi153.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-19T15:31:06.995 INFO:tasks.workunit.client.0.smithi153.stderr: 2024-09-19T15:31:06.998 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T15:31:06.998 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T15:31:07.144 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T15:31:07.144 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T15:31:07.308 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T15:31:07.308 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T15:31:07.402 INFO:tasks.workunit.client.0.smithi153.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-19T15:31:08.850 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T15:31:08.850 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T15:31:08.997 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T15:31:08.997 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T15:31:11.135 INFO:tasks.workunit.client.0.smithi153.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-19T15:31:11.580 INFO:tasks.workunit.client.0.smithi153.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-19T15:31:11.611 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T15:31:11.611 INFO:tasks.workunit.client.0.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T15:31:11.651 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.644+0000 7f3fabd6b9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:11.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.648+0000 7f3fabd6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:11.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.648+0000 7f3fabd6b9c0 20 realm 2024-09-19T15:31:11.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.648+0000 7f3fabd6b9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:11.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.648+0000 7f3fabd6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:11.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.648+0000 7f3fabd6b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T15:31:11.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.648+0000 7f3fabd6b9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:11.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.648+0000 7f3fabd6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:11.653 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.648+0000 7f3fabd6b9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:11.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.648+0000 7f3fabd6b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T15:31:11.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.648+0000 7f3fabd6b9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:11.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.648+0000 7f3fabd6b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T15:31:11.655 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.648+0000 7f3fabd6b9c0 20 searching for the correct realm 2024-09-19T15:31:11.661 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.656+0000 7f3faa072640 0 -- 172.21.15.153:0/3530933253 >> [v2:172.21.15.196:6818/638579357,v1:172.21.15.196:6819/638579357] conn(0x7f3fa006e590 msgr2=0x7f3fa006bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T15:31:11.878 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.872+0000 7f3fa9871640 0 -- 172.21.15.153:0/3530933253 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x55e7da72bb00 msgr2=0x55e7da72dfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T15:31:11.885 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.880+0000 7f3fabd6b9c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T15:31:11.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.880+0000 7f3fabd6b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T15:31:11.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.880+0000 7f3fabd6b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T15:31:11.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.880+0000 7f3fabd6b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T15:31:11.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.880+0000 7f3fabd6b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T15:31:11.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.880+0000 7f3fabd6b9c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T15:31:11.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.880+0000 7f3fabd6b9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:11.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.880+0000 7f3fabd6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:11.886 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.880+0000 7f3fabd6b9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:11.887 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.880+0000 7f3fabd6b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T15:31:11.887 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.880+0000 7f3fabd6b9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:11.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.884+0000 7f3fabd6b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T15:31:11.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.884+0000 7f3fabd6b9c0 20 zone default found 2024-09-19T15:31:11.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.884+0000 7f3fabd6b9c0 4 Realm: () 2024-09-19T15:31:11.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.884+0000 7f3fabd6b9c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T15:31:11.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.884+0000 7f3fabd6b9c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T15:31:11.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.884+0000 7f3fabd6b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T15:31:11.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.884+0000 7f3fabd6b9c0 20 zonegroup default 2024-09-19T15:31:11.888 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.884+0000 7f3fabd6b9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:11.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.884+0000 7f3fabd6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:11.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.884+0000 7f3fabd6b9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:11.889 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.884+0000 7f3fabd6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:11.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.884+0000 7f3fabd6b9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:11.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.884+0000 7f3fabd6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:11.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.884+0000 7f3fabd6b9c0 20 started sync module instance, tier type = 2024-09-19T15:31:11.890 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.884+0000 7f3fabd6b9c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T15:31:11.912 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.908+0000 7f3fabd6b9c0 20 add_watcher() i=0 2024-09-19T15:31:11.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.908+0000 7f3fabd6b9c0 20 add_watcher() i=1 2024-09-19T15:31:11.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.908+0000 7f3fabd6b9c0 20 add_watcher() i=2 2024-09-19T15:31:11.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.908+0000 7f3fabd6b9c0 20 add_watcher() i=3 2024-09-19T15:31:11.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.908+0000 7f3fabd6b9c0 20 add_watcher() i=4 2024-09-19T15:31:11.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.908+0000 7f3fabd6b9c0 20 add_watcher() i=5 2024-09-19T15:31:11.913 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.908+0000 7f3fabd6b9c0 20 add_watcher() i=6 2024-09-19T15:31:11.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.908+0000 7f3fabd6b9c0 20 add_watcher() i=7 2024-09-19T15:31:11.915 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.908+0000 7f3fabd6b9c0 2 all 8 watchers are set, enabling cache 2024-09-19T15:31:11.920 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.916+0000 7f3e5bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T15:31:11.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.916+0000 7f3fabd6b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T15:31:11.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.916+0000 7f3fabd6b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T15:31:11.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.916+0000 7f3fabd6b9c0 5 note: GC not initialized 2024-09-19T15:31:11.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.916+0000 7f3e5affd640 20 reqs_thread_entry: start 2024-09-19T15:31:11.921 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.916+0000 7f3fabd6b9c0 20 init_complete bucket index max shards: 11 2024-09-19T15:31:11.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.916+0000 7f3fabd6b9c0 20 Filter name: none 2024-09-19T15:31:11.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.916+0000 7f3e58ff9640 20 reqs_thread_entry: start 2024-09-19T15:31:11.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.916+0000 7f3fabd6b9c0 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-19T15:31:11.922 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.916+0000 7f3fabd6b9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:11.923 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.916+0000 7f3fabd6b9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-19T15:31:11.923 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.916+0000 7f3fabd6b9c0 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-19T15:31:11.923 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.916+0000 7f3fabd6b9c0 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-19T15:31:11.923 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.916+0000 7f3fabd6b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.782 : miss 2024-09-19T15:31:11.923 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.916+0000 7f3fabd6b9c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:11.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.920+0000 7f3fabd6b9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-19T15:31:11.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.920+0000 7f3fabd6b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.782 info.flags=0x17 2024-09-19T15:31:11.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.920+0000 7f3fabd6b9c0 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.782 to cache LRU end 2024-09-19T15:31:11.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.920+0000 7f3fabd6b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T15:31:11.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.920+0000 7f3fabd6b9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-19T15:31:11.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.920+0000 7f3fabd6b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:dbb1da81-49d0-421a-b677-974869a7f103.4620.782 2024-09-19T15:31:11.924 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.920+0000 7f3fabd6b9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.0 2024-09-19T15:31:11.926 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.920+0000 7f3fabd6b9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-19T15:31:11.926 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.920+0000 7f3fabd6b9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.1 2024-09-19T15:31:11.926 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.920+0000 7f3fabd6b9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-19T15:31:11.926 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.920+0000 7f3fabd6b9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.2 2024-09-19T15:31:11.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.920+0000 7f3fabd6b9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-19T15:31:11.927 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.920+0000 7f3fabd6b9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.3 2024-09-19T15:31:11.928 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.924+0000 7f3fabd6b9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-19T15:31:11.928 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.924+0000 7f3fabd6b9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.4 2024-09-19T15:31:11.928 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.924+0000 7f3fabd6b9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-19T15:31:11.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.924+0000 7f3fabd6b9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.5 2024-09-19T15:31:11.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.924+0000 7f3fabd6b9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-19T15:31:11.929 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.924+0000 7f3fabd6b9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.6 2024-09-19T15:31:11.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.924+0000 7f3fabd6b9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-19T15:31:11.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.924+0000 7f3fabd6b9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.7 2024-09-19T15:31:11.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.924+0000 7f3fabd6b9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-19T15:31:11.931 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.924+0000 7f3fabd6b9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.8 2024-09-19T15:31:11.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.928+0000 7f3fabd6b9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-19T15:31:11.932 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.928+0000 7f3fabd6b9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.9 2024-09-19T15:31:11.933 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.928+0000 7f3fabd6b9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-19T15:31:11.933 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.928+0000 7f3fabd6b9c0 20 bucket index object: :.dir.dbb1da81-49d0-421a-b677-974869a7f103.4620.782.10 2024-09-19T15:31:11.934 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.928+0000 7f3fabd6b9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-19T15:31:11.934 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.928+0000 7f3fabd6b9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-19T15:31:11.935 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.928+0000 7f3e5bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T15:31:11.941 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.936+0000 7f3fabd6b9c0 20 remove_watcher() i=0 2024-09-19T15:31:11.941 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.936+0000 7f3fabd6b9c0 2 removed watcher, disabling cache 2024-09-19T15:31:11.943 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.936+0000 7f3fabd6b9c0 20 remove_watcher() i=1 2024-09-19T15:31:11.945 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.940+0000 7f3fabd6b9c0 20 remove_watcher() i=2 2024-09-19T15:31:11.948 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.944+0000 7f3fabd6b9c0 20 remove_watcher() i=3 2024-09-19T15:31:11.950 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.944+0000 7f3fabd6b9c0 20 remove_watcher() i=4 2024-09-19T15:31:11.951 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.944+0000 7f3fabd6b9c0 20 remove_watcher() i=5 2024-09-19T15:31:11.954 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.948+0000 7f3fabd6b9c0 20 remove_watcher() i=6 2024-09-19T15:31:11.956 INFO:tasks.workunit.client.0.smithi153.stderr:2024-09-19T15:31:11.952+0000 7f3fabd6b9c0 20 remove_watcher() i=7 2024-09-19T15:31:11.973 INFO:tasks.workunit.client.0.smithi153.stderr:Deleting bucket versioning-bucket 2024-09-19T15:31:11.975 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T15:31:11.975 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T15:31:12.027 INFO:tasks.workunit.client.0.smithi153.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-19T15:31:12.027 INFO:tasks.workunit.client.0.smithi153.stderr: warnings.warn( 2024-09-19T15:31:12.359 INFO:tasks.workunit.client.0.smithi153.stderr:Completed bucket versioning tests 2024-09-19T15:31:12.360 INFO:tasks.workunit.client.0.smithi153.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-19T15:31:12.360 INFO:tasks.workunit.client.0.smithi153.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-19T15:31:12.360 INFO:tasks.workunit.client.0.smithi153.stdout:connected to https://localhost:443 2024-09-19T15:31:12.456 INFO:tasks.workunit.client.0.smithi153.stderr:+ deactivate 2024-09-19T15:31:12.456 INFO:tasks.workunit.client.0.smithi153.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-19T15:31:12.456 INFO:tasks.workunit.client.0.smithi153.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-19T15:31:12.456 INFO:tasks.workunit.client.0.smithi153.stderr:+ export PATH 2024-09-19T15:31:12.456 INFO:tasks.workunit.client.0.smithi153.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-19T15:31:12.456 INFO:tasks.workunit.client.0.smithi153.stderr:+ '[' -n '' ']' 2024-09-19T15:31:12.456 INFO:tasks.workunit.client.0.smithi153.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-19T15:31:12.456 INFO:tasks.workunit.client.0.smithi153.stderr:+ hash -r 2024-09-19T15:31:12.456 INFO:tasks.workunit.client.0.smithi153.stderr:+ '[' -n '' ']' 2024-09-19T15:31:12.457 INFO:tasks.workunit.client.0.smithi153.stderr:+ unset VIRTUAL_ENV 2024-09-19T15:31:12.457 INFO:tasks.workunit.client.0.smithi153.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-19T15:31:12.457 INFO:tasks.workunit.client.0.smithi153.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-19T15:31:12.457 INFO:tasks.workunit.client.0.smithi153.stderr:+ unset -f deactivate 2024-09-19T15:31:12.457 INFO:tasks.workunit.client.0.smithi153.stderr:+ echo OK. 2024-09-19T15:31:12.458 INFO:tasks.workunit.client.0.smithi153.stdout:OK. 2024-09-19T15:31:12.458 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T15:31:12.458 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T15:31:12.513 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-19T15:31:12.513 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T15:31:12.897 DEBUG:teuthology.parallel:result is None 2024-09-19T15:31:12.898 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T15:31:12.909 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T15:31:12.909 DEBUG:teuthology.orchestra.run.smithi153:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-19T15:31:12.955 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T15:31:12.956 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-19T15:31:12.966 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-19T15:31:12.991 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-19T15:31:12.991 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-19T15:31:12.991 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-19T15:31:13.052 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-19T15:31:13.052 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-19T15:31:13.087 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T15:31:13.087 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T15:31:13.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.124+0000 7faaf86439c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.124+0000 7faaf86439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.124+0000 7faaf86439c0 20 realm 2024-09-19T15:31:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.124+0000 7faaf86439c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.124+0000 7faaf86439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.124+0000 7faaf86439c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T15:31:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.124+0000 7faaf86439c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.124+0000 7faaf86439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:13.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.124+0000 7faaf86439c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.128+0000 7faaf86439c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T15:31:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.128+0000 7faaf86439c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.128+0000 7faaf86439c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T15:31:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.128+0000 7faaf86439c0 20 searching for the correct realm 2024-09-19T15:31:13.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.132+0000 7faaf694a640 0 -- 172.21.15.153:0/3499452416 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x5630446a8d80 msgr2=0x5630446ab210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T15:31:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.140+0000 7faaf5948640 0 -- 172.21.15.153:0/3499452416 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7faae812ebb0 msgr2=0x7faae8113ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-19T15:31:13.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.148+0000 7faaf86439c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T15:31:13.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.148+0000 7faaf86439c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T15:31:13.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.148+0000 7faaf86439c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T15:31:13.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.148+0000 7faaf86439c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T15:31:13.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.148+0000 7faaf86439c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T15:31:13.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.148+0000 7faaf86439c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T15:31:13.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.148+0000 7faaf86439c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:13.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.148+0000 7faaf86439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:13.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.148+0000 7faaf86439c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.148+0000 7faaf86439c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T15:31:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.148+0000 7faaf86439c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.152+0000 7faaf86439c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T15:31:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.152+0000 7faaf86439c0 20 zone default found 2024-09-19T15:31:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.152+0000 7faaf86439c0 4 Realm: () 2024-09-19T15:31:13.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.152+0000 7faaf86439c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T15:31:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.152+0000 7faaf86439c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T15:31:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.152+0000 7faaf86439c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T15:31:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.152+0000 7faaf86439c0 20 zonegroup default 2024-09-19T15:31:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.152+0000 7faaf86439c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.152+0000 7faaf86439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:13.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.152+0000 7faaf86439c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:13.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.152+0000 7faaf86439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:13.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.152+0000 7faaf86439c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:13.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.152+0000 7faaf86439c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:13.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.152+0000 7faaf86439c0 20 started sync module instance, tier type = 2024-09-19T15:31:13.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.152+0000 7faaf86439c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T15:31:13.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.168+0000 7faaf86439c0 20 add_watcher() i=0 2024-09-19T15:31:13.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.168+0000 7faaf86439c0 20 add_watcher() i=1 2024-09-19T15:31:13.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.168+0000 7faaf86439c0 20 add_watcher() i=2 2024-09-19T15:31:13.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.168+0000 7faaf86439c0 20 add_watcher() i=3 2024-09-19T15:31:13.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.168+0000 7faaf86439c0 20 add_watcher() i=4 2024-09-19T15:31:13.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.168+0000 7faaf86439c0 20 add_watcher() i=5 2024-09-19T15:31:13.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.168+0000 7faaf86439c0 20 add_watcher() i=6 2024-09-19T15:31:13.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.168+0000 7faaf86439c0 20 add_watcher() i=7 2024-09-19T15:31:13.174 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.168+0000 7faaf86439c0 2 all 8 watchers are set, enabling cache 2024-09-19T15:31:13.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.172+0000 7fa9acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T15:31:13.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.172+0000 7faaf86439c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T15:31:13.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.172+0000 7faaf86439c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T15:31:13.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.248+0000 7fa9277fe640 20 reqs_thread_entry: start 2024-09-19T15:31:13.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.248+0000 7faaf86439c0 20 init_complete bucket index max shards: 11 2024-09-19T15:31:13.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.248+0000 7faaf86439c0 20 Filter name: none 2024-09-19T15:31:13.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.248+0000 7fa9257fa640 20 reqs_thread_entry: start 2024-09-19T15:31:13.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.248+0000 7faaf86439c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-19T15:31:13.254 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.248+0000 7faaf86439c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.248+0000 7faaf86439c0 20 rados_obj.operate() r=0 bl.length=482 2024-09-19T15:31:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.248+0000 7faaf86439c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-19T15:31:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.248+0000 7faaf86439c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-19T15:31:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.248+0000 7faaf86439c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T15:31:13.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.252+0000 7faaf86439c0 10 removing key index: NETIUJHVXMQJURHIFQFN 2024-09-19T15:31:13.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.252+0000 7faaf86439c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:NETIUJHVXMQJURHIFQFN, ofs0, ns] 2024-09-19T15:31:13.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.256+0000 7fa9d9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235563 cookie 94765306310432 notifier 9366 bl.length()=170 2024-09-19T15:31:13.262 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.256+0000 7faaf86439c0 10 removing email index: tester.client.0_test@test.test 2024-09-19T15:31:13.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.256+0000 7faaf86439c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-19T15:31:13.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.260+0000 7fa9d9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235564 cookie 94765306310432 notifier 9366 bl.length()=181 2024-09-19T15:31:13.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.260+0000 7faaf86439c0 10 removing user buckets index 2024-09-19T15:31:13.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.264+0000 7faaf86439c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-19T15:31:13.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.264+0000 7fa9d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235589 cookie 94765306322112 notifier 9366 bl.length()=172 2024-09-19T15:31:13.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.264+0000 7faaf86439c0 10 removing user index: tester.client.0 2024-09-19T15:31:13.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.268+0000 7faaf86439c0 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-19T15:31:13.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.268+0000 7faaf86439c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-19T15:31:13.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.268+0000 7fa9d9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051236719 cookie 94765306308128 notifier 9366 bl.length()=164 2024-09-19T15:31:13.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.272+0000 7fa9acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T15:31:13.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.276+0000 7faaf86439c0 20 remove_watcher() i=0 2024-09-19T15:31:13.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.276+0000 7faaf86439c0 2 removed watcher, disabling cache 2024-09-19T15:31:13.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.280+0000 7faaf86439c0 20 remove_watcher() i=1 2024-09-19T15:31:13.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.284+0000 7faaf86439c0 20 remove_watcher() i=2 2024-09-19T15:31:13.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.284+0000 7faaf86439c0 20 remove_watcher() i=3 2024-09-19T15:31:13.293 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.288+0000 7faaf86439c0 20 remove_watcher() i=4 2024-09-19T15:31:13.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.288+0000 7faaf86439c0 20 remove_watcher() i=5 2024-09-19T15:31:13.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.292+0000 7faaf86439c0 20 remove_watcher() i=6 2024-09-19T15:31:13.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:13.292+0000 7faaf86439c0 20 remove_watcher() i=7 2024-09-19T15:31:13.313 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-19T15:31:13.324 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-19T15:31:13.360 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-19T15:31:13.404 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-19T15:31:13.414 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-19T15:31:13.414 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T15:31:13.463 INFO:tasks.rgw.client.0.smithi153.stdout:2024-09-19T15:31:13.452+0000 e574640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 39231) UID: 0 2024-09-19T15:31:13.468 INFO:tasks.rgw.client.0.smithi153.stdout:2024-09-19T15:31:13.456+0000 8edcf80 -1 shutting down 2024-09-19T15:31:37.795 INFO:tasks.rgw.client.0.smithi153.stderr:==00:01:50:50.295 39234== could not unlink /tmp/vgdb-pipe-from-vgdb-to-39234-by-root-on-??? 2024-09-19T15:31:37.796 INFO:tasks.rgw.client.0.smithi153.stderr:==00:01:50:50.295 39234== could not unlink /tmp/vgdb-pipe-to-vgdb-from-39234-by-root-on-??? 2024-09-19T15:31:37.796 INFO:tasks.rgw.client.0.smithi153.stderr:==00:01:50:50.295 39234== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-39234-by-root-on-??? 2024-09-19T15:31:37.854 INFO:tasks.rgw.client.0:Stopped 2024-09-19T15:31:37.854 DEBUG:teuthology.orchestra.run.smithi153:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-19T15:31:37.900 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f /etc/ceph/vault-root-token 2024-09-19T15:31:37.955 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-19T15:31:38.010 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-19T15:31:38.010 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-19T15:31:38.011 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-19T15:31:38.086 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setuser ceph since I am not root 2024-09-19T15:31:38.086 INFO:teuthology.orchestra.run.smithi153.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T15:31:38.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.120+0000 7f91ef1549c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:38.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.124+0000 7f91ef1549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:38.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.124+0000 7f91ef1549c0 20 realm 2024-09-19T15:31:38.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.124+0000 7f91ef1549c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:38.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.124+0000 7f91ef1549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:38.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.124+0000 7f91ef1549c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T15:31:38.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.124+0000 7f91ef1549c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:38.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.124+0000 7f91ef1549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:38.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.124+0000 7f91ef1549c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:38.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.124+0000 7f91ef1549c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T15:31:38.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.124+0000 7f91ef1549c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:38.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.124+0000 7f91ef1549c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-19T15:31:38.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.124+0000 7f91ef1549c0 20 searching for the correct realm 2024-09-19T15:31:38.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.132+0000 7f91ed45b640 0 -- 172.21.15.153:0/159143849 >> [v2:172.21.15.153:6800/2952519065,v1:172.21.15.153:6801/2952519065] conn(0x55f89a40ede0 msgr2=0x55f89a411210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T15:31:38.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.136+0000 7f91ec459640 0 -- 172.21.15.153:0/159143849 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x7f91dc046970 msgr2=0x7f91dc044440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T15:31:38.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.144+0000 7f91ef1549c0 20 RGWRados::pool_iterate: got zone_info.dbb1da81-49d0-421a-b677-974869a7f103 2024-09-19T15:31:38.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.144+0000 7f91ef1549c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T15:31:38.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.144+0000 7f91ef1549c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T15:31:38.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.144+0000 7f91ef1549c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T15:31:38.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.144+0000 7f91ef1549c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T15:31:38.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.144+0000 7f91ef1549c0 20 RGWRados::pool_iterate: got zonegroup_info.be95b11d-3bce-4c5d-be5a-65bf49e88fc0 2024-09-19T15:31:38.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.144+0000 7f91ef1549c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:38.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.144+0000 7f91ef1549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:38.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.144+0000 7f91ef1549c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:38.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.144+0000 7f91ef1549c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T15:31:38.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.144+0000 7f91ef1549c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:38.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.144+0000 7f91ef1549c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-19T15:31:38.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.144+0000 7f91ef1549c0 20 zone default found 2024-09-19T15:31:38.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.144+0000 7f91ef1549c0 4 Realm: () 2024-09-19T15:31:38.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.144+0000 7f91ef1549c0 4 ZoneGroup: default (be95b11d-3bce-4c5d-be5a-65bf49e88fc0) 2024-09-19T15:31:38.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.144+0000 7f91ef1549c0 4 Zone: default (dbb1da81-49d0-421a-b677-974869a7f103) 2024-09-19T15:31:38.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.144+0000 7f91ef1549c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T15:31:38.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.144+0000 7f91ef1549c0 20 zonegroup default 2024-09-19T15:31:38.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.144+0000 7f91ef1549c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:38.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.148+0000 7f91ef1549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:38.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.148+0000 7f91ef1549c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:38.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.148+0000 7f91ef1549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:38.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.148+0000 7f91ef1549c0 20 rados->read ofs=0 len=0 2024-09-19T15:31:38.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.148+0000 7f91ef1549c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T15:31:38.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.148+0000 7f91ef1549c0 20 started sync module instance, tier type = 2024-09-19T15:31:38.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.148+0000 7f91ef1549c0 20 started zone id=dbb1da81-49d0-421a-b677-974869a7f103 (name=default) with tier type = 2024-09-19T15:31:38.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.164+0000 7f91ef1549c0 20 add_watcher() i=0 2024-09-19T15:31:38.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.164+0000 7f91ef1549c0 20 add_watcher() i=1 2024-09-19T15:31:38.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.164+0000 7f91ef1549c0 20 add_watcher() i=2 2024-09-19T15:31:38.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.164+0000 7f91ef1549c0 20 add_watcher() i=3 2024-09-19T15:31:38.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.164+0000 7f91ef1549c0 20 add_watcher() i=4 2024-09-19T15:31:38.170 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.164+0000 7f91ef1549c0 20 add_watcher() i=5 2024-09-19T15:31:38.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.164+0000 7f91ef1549c0 20 add_watcher() i=6 2024-09-19T15:31:38.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.164+0000 7f91ef1549c0 20 add_watcher() i=7 2024-09-19T15:31:38.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.164+0000 7f91ef1549c0 2 all 8 watchers are set, enabling cache 2024-09-19T15:31:38.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.168+0000 7f90a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T15:31:38.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.168+0000 7f91ef1549c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T15:31:38.173 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.168+0000 7f91ef1549c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T15:31:38.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.240+0000 7f90a1fe3640 20 reqs_thread_entry: start 2024-09-19T15:31:38.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.240+0000 7f91ef1549c0 20 init_complete bucket index max shards: 11 2024-09-19T15:31:38.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.240+0000 7f91ef1549c0 20 Filter name: none 2024-09-19T15:31:38.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.240+0000 7f90137fe640 20 reqs_thread_entry: start 2024-09-19T15:31:38.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.240+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T15:31:38.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:38.248 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:38.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47304' 2024-09-19T15:31:38.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7689044791777973426', time=2024-09-19T16:32:14.119555+0000, chain.objs.size()=1 2024-09-19T15:31:38.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.157__shadow:jW8GIKgls.KbnWGAApJdV56oAhyf.3M_.lp7BBhgYrgDND-wY9X6ZWa8Z9nXT_of_0 2024-09-19T15:31:38.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='_6vI_5kXFQdkr8t-F8mBt6QbTBaVFpnc', time=2024-09-19T16:33:51.055917+0000, chain.objs.size()=2 2024-09-19T15:31:38.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.161__shadow_.Brjf16p4W8PI_gXOAO8R2gbdNidspOe_0 2024-09-19T15:31:38.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.161__shadow_.Brjf16p4W8PI_gXOAO8R2gbdNidspOe_1 2024-09-19T15:31:38.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16648696267474249881', time=2024-09-19T16:39:31.665337+0000, chain.objs.size()=1 2024-09-19T15:31:38.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.233__shadow_.7rz8S-J4efpO65ylxxHeW93tbk-8Xo-_0 2024-09-19T15:31:38.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13475600287527764296', time=2024-09-19T16:42:30.144108+0000, chain.objs.size()=1 2024-09-19T15:31:38.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.FVc5xlu0TS3tWiMyHltsuwYvZE1E1M2_0 2024-09-19T15:31:38.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4650882437218065122', time=2024-09-19T16:42:31.240583+0000, chain.objs.size()=1 2024-09-19T15:31:38.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.8EG-8evB6CuxvGEjDeN2gk43qsOuWi__0 2024-09-19T15:31:38.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6691429956759588041', time=2024-09-19T16:42:33.176253+0000, chain.objs.size()=1 2024-09-19T15:31:38.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.mr8zkZ74dx1NMLztfk1Q5tH2LMlWirv_0 2024-09-19T15:31:38.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7761451600696113362', time=2024-09-19T16:42:34.078999+0000, chain.objs.size()=1 2024-09-19T15:31:38.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.vPHIZ590T4_WfqFUy8gmckqYuzu4VQV_0 2024-09-19T15:31:38.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.825665725728918928', time=2024-09-19T16:42:34.529684+0000, chain.objs.size()=1 2024-09-19T15:31:38.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.L09dnPBnWNom3CccHs6mavbVX4wXFlQ_0 2024-09-19T15:31:38.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9371167270090325630', time=2024-09-19T16:42:34.533796+0000, chain.objs.size()=1 2024-09-19T15:31:38.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.D_8ur8BPsBStaZ7bFbn15cFBK3pJCmY_0 2024-09-19T15:31:38.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6806311520005081289', time=2024-09-19T16:42:35.297732+0000, chain.objs.size()=1 2024-09-19T15:31:38.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.1WQA18sKQEaWl5pvt4Wxb95hJpR0d3__0 2024-09-19T15:31:38.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10193129588337801714', time=2024-09-19T16:42:35.791536+0000, chain.objs.size()=1 2024-09-19T15:31:38.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.244+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ghYxA60DXclMraPUETre1iqSABcc6yX_0 2024-09-19T15:31:38.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.248+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5728317209768791145', time=2024-09-19T16:42:36.938481+0000, chain.objs.size()=1 2024-09-19T15:31:38.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.248+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Nq2Aytmr3uX227eV8ElBaqKOuB3ZTkq_0 2024-09-19T15:31:38.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.252+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12994000446475696675', time=2024-09-19T16:42:37.500151+0000, chain.objs.size()=1 2024-09-19T15:31:38.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.252+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.fsHVwB3PGQcDZpdKbSj0zy4QzG0qQmd_0 2024-09-19T15:31:38.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.252+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7545726038269608619', time=2024-09-19T16:42:37.703768+0000, chain.objs.size()=1 2024-09-19T15:31:38.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.252+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.60amHkmPiTdlOOh9jJwrFTKM9R6_6PS_0 2024-09-19T15:31:38.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.252+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3396265444668648907', time=2024-09-19T16:42:38.422229+0000, chain.objs.size()=1 2024-09-19T15:31:38.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.252+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.FF6sd2YvYzOkQtvbqqprb4TrAtJ_HcA_0 2024-09-19T15:31:38.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.252+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4073823651941244495', time=2024-09-19T16:42:39.256694+0000, chain.objs.size()=1 2024-09-19T15:31:38.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.252+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.0T0WCu1HSVEkLYeYea6m9EFMVj1I2Mr_0 2024-09-19T15:31:38.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.252+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5334151863963254905', time=2024-09-19T16:42:39.663213+0000, chain.objs.size()=1 2024-09-19T15:31:38.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.252+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.1qOTj5zUmYVSJ0EQqNp3lpWirQ9NSCX_0 2024-09-19T15:31:38.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.252+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18087434363226467862', time=2024-09-19T16:42:41.093177+0000, chain.objs.size()=1 2024-09-19T15:31:38.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.252+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.eWWjgNsIwW8vaCHO1HL7Nqk99dWp9O0_0 2024-09-19T15:31:38.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.252+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9312143643193596581', time=2024-09-19T16:42:41.444345+0000, chain.objs.size()=1 2024-09-19T15:31:38.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.252+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.CJ_oPL8xy-g_FyC7yaw2gyOlLTAarvf_0 2024-09-19T15:31:38.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.252+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18283492203815496048', time=2024-09-19T16:42:41.580170+0000, chain.objs.size()=1 2024-09-19T15:31:38.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.252+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.RdMkEQq6r7SjmywejBexhoOekUlmbh2_0 2024-09-19T15:31:38.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.252+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10438083237526528833', time=2024-09-19T16:42:42.967165+0000, chain.objs.size()=1 2024-09-19T15:31:38.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.252+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Sg-o36gNLPGR78FRcjOvNBKJ2Jgqdyg_0 2024-09-19T15:31:38.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.252+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8475162570072096272', time=2024-09-19T16:42:43.459472+0000, chain.objs.size()=1 2024-09-19T15:31:38.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.252+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.jn5oounNW-g6apIauyzlppdEAT_yZ-O_0 2024-09-19T15:31:38.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.252+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6305553314158015981', time=2024-09-19T16:42:45.686563+0000, chain.objs.size()=1 2024-09-19T15:31:38.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.252+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.zdffjKuK0vom8OeNh1qDXboDtrp7Ie5_0 2024-09-19T15:31:38.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.256+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11082205423241499128', time=2024-09-19T16:42:46.204071+0000, chain.objs.size()=1 2024-09-19T15:31:38.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.256+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.eYObjwg69sfSc1m0dsylVeomKLDatl-_0 2024-09-19T15:31:38.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.264+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17829227784361305665', time=2024-09-19T16:42:46.207517+0000, chain.objs.size()=1 2024-09-19T15:31:38.269 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.264+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.wFcZVUZTRfF2RoL_Fh5iLK9FHkUeF_p_0 2024-09-19T15:31:38.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.264+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2352405774394919881', time=2024-09-19T16:42:48.458384+0000, chain.objs.size()=1 2024-09-19T15:31:38.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.264+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.bwJ1XIBbdNS2_IfcDm1ZOHJ4iwJPEt-_0 2024-09-19T15:31:38.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.264+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1575599454985554695', time=2024-09-19T16:42:50.316374+0000, chain.objs.size()=1 2024-09-19T15:31:38.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.264+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.GxLZsE-TGNAMnyWpNPPGIQq9u39NmzP_0 2024-09-19T15:31:38.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.264+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5510412228589935821', time=2024-09-19T16:42:51.763868+0000, chain.objs.size()=1 2024-09-19T15:31:38.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.264+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.lW_-_eVWVaaZRif38YKJmiF3ZKDhSo__0 2024-09-19T15:31:38.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.264+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17993789981722118450', time=2024-09-19T16:42:54.215520+0000, chain.objs.size()=1 2024-09-19T15:31:38.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.264+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Wx0lwiguyIthujdnXU3TmIRul4fLxVh_0 2024-09-19T15:31:38.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.264+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10584699578913198103', time=2024-09-19T16:42:57.899645+0000, chain.objs.size()=1 2024-09-19T15:31:38.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.264+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.1RUgpYCdn6IYrTduJF_F6-wj0JtFBEr_0 2024-09-19T15:31:38.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.264+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7376124898600564160', time=2024-09-19T16:42:57.903577+0000, chain.objs.size()=1 2024-09-19T15:31:38.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.264+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.5KLq8O5jOm5nsnwJijtSWSDmce5n969_0 2024-09-19T15:31:38.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.272+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.819451800022748804', time=2024-09-19T16:42:59.710517+0000, chain.objs.size()=1 2024-09-19T15:31:38.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.272+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.kXDi0xzxW6D-ekGOzFgGAbRgvlWyJVZ_0 2024-09-19T15:31:38.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.272+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7676879158760963096', time=2024-09-19T16:44:04.109348+0000, chain.objs.size()=1 2024-09-19T15:31:38.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.272+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.290__shadow_.Y5ICIeja3oJfYcPPI7tGL9OSuAFIYIr_0 2024-09-19T15:31:38.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.272+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2607723531355520706', time=2024-09-19T16:44:12.901443+0000, chain.objs.size()=1 2024-09-19T15:31:38.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.272+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_.hE5ctfW73E0Dg278rVCs4mB83sOaaCu_0 2024-09-19T15:31:38.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.272+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1184339698768116851', time=2024-09-19T16:44:18.316297+0000, chain.objs.size()=1 2024-09-19T15:31:38.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.272+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.GnpIVhZRcbjJC_3qZBoz3IDC9wxwKbA_0 2024-09-19T15:31:38.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.272+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14047119052068120694', time=2024-09-19T16:44:20.945638+0000, chain.objs.size()=1 2024-09-19T15:31:38.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.272+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.294__shadow_.TAzR9CsQyKS40o8cpUvTYIovmwND-2c_0 2024-09-19T15:31:38.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.272+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13484133429970808007', time=2024-09-19T16:44:30.491289+0000, chain.objs.size()=1 2024-09-19T15:31:38.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.272+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.298__shadow_.TfHA1ghupYcd4vyxN1jSCMzEoRf6PN7_0 2024-09-19T15:31:38.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12031708302358050557', time=2024-09-19T16:44:40.079413+0000, chain.objs.size()=1 2024-09-19T15:31:38.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.302__shadow_.OOZ18QFiGMMmW-2kIrDIe5TQDHBQZ5q_0 2024-09-19T15:31:38.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4162579886471688246', time=2024-09-19T16:45:32.448288+0000, chain.objs.size()=1 2024-09-19T15:31:38.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.322__shadow_.zRmQk5CizLEOJASrMNBlCsIjRnH13YL_0 2024-09-19T15:31:38.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10311481905308127533', time=2024-09-19T16:47:19.687756+0000, chain.objs.size()=1 2024-09-19T15:31:38.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.tVsFeTltDVYNKKl20I9iaJnBUXVYmmg_0 2024-09-19T15:31:38.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4931761331574686478', time=2024-09-19T16:47:20.427423+0000, chain.objs.size()=1 2024-09-19T15:31:38.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.cf9ecmWIPSpCKpMWTDtEdkW16W01M_I_0 2024-09-19T15:31:38.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5706385754016161515', time=2024-09-19T16:47:20.531355+0000, chain.objs.size()=1 2024-09-19T15:31:38.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.aCQWixFa7MzoqXghtoYNbA_uhUus1_q_0 2024-09-19T15:31:38.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2592309529023105026', time=2024-09-19T16:47:20.657625+0000, chain.objs.size()=1 2024-09-19T15:31:38.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.yWqt1SrfkgTAxjMZvmijCZFSf9z4io__0 2024-09-19T15:31:38.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14804177361040573012', time=2024-09-19T16:47:20.808611+0000, chain.objs.size()=1 2024-09-19T15:31:38.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.zGiFFvsM4zCmZHVhmiVK1BonW5oot-7_0 2024-09-19T15:31:38.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1900565043279640629', time=2024-09-19T16:47:22.794337+0000, chain.objs.size()=1 2024-09-19T15:31:38.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.PKVmLZA8dlSIcy4bMXehMr4ZH-0QW6T_0 2024-09-19T15:31:38.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7960554470225136881', time=2024-09-19T16:47:22.885399+0000, chain.objs.size()=1 2024-09-19T15:31:38.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.3lwij1HeFJB4Zlpvmfqbk-TszfC9MVy_0 2024-09-19T15:31:38.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4365330403632892464', time=2024-09-19T16:47:23.340337+0000, chain.objs.size()=1 2024-09-19T15:31:38.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.T3X7RFSuBIoy7x19zD46fiaWTM1AZD3_0 2024-09-19T15:31:38.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11701901210799881316', time=2024-09-19T16:47:23.756487+0000, chain.objs.size()=1 2024-09-19T15:31:38.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.22OoxSKD7Ap0lvB7rLS6lON2_u2DRg3_0 2024-09-19T15:31:38.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.516152968722939367', time=2024-09-19T16:47:24.492863+0000, chain.objs.size()=1 2024-09-19T15:31:38.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.coOBfMAj0exVLe42CRMT-3ACYlq9jh3_0 2024-09-19T15:31:38.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16191573960859540397', time=2024-09-19T16:47:25.186701+0000, chain.objs.size()=1 2024-09-19T15:31:38.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.jvMxutwMiScf-vkrM1Yaj5O7PIwb0HE_0 2024-09-19T15:31:38.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8470838657367228637', time=2024-09-19T16:47:25.188813+0000, chain.objs.size()=1 2024-09-19T15:31:38.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.FOKl9TLWjqJfEO2BGysPCoepNBvRtHA_0 2024-09-19T15:31:38.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13743883838321714122', time=2024-09-19T16:47:26.695125+0000, chain.objs.size()=1 2024-09-19T15:31:38.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.HHie9ERVm5XfKBlElbuxIoDZfsshrdh_0 2024-09-19T15:31:38.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5379329934811021737', time=2024-09-19T16:47:29.128946+0000, chain.objs.size()=1 2024-09-19T15:31:38.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.JbzeN4gIoZ-4tMHo7UKlJV4nrFl7yo1_0 2024-09-19T15:31:38.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.300+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1716586388076870452', time=2024-09-19T16:47:29.426939+0000, chain.objs.size()=1 2024-09-19T15:31:38.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.300+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.OpTKYmhP0PUpl-Ztc1XyrYV-Cg-Iz64_0 2024-09-19T15:31:38.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.300+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16387698449125110632', time=2024-09-19T16:47:29.589582+0000, chain.objs.size()=1 2024-09-19T15:31:38.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.300+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.mgdpPIszvDC1Y36QlNAh5hnx4iKJf1h_0 2024-09-19T15:31:38.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.300+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12047552573586262023', time=2024-09-19T16:47:31.580739+0000, chain.objs.size()=1 2024-09-19T15:31:38.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.300+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.S9SQ6NmtKHH_D7vri2XppAMGKGYkobZ_0 2024-09-19T15:31:38.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.300+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.387700516883923055', time=2024-09-19T16:47:31.899229+0000, chain.objs.size()=1 2024-09-19T15:31:38.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.300+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ZSFsvbZtD3z2dmSUQac7IF1XvjzTFZm_0 2024-09-19T15:31:38.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.300+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14757790288240208563', time=2024-09-19T16:47:33.392326+0000, chain.objs.size()=1 2024-09-19T15:31:38.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.300+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Q-MBJ_aWVcrLV0XPkCJyTXVHtdgBlD3_0 2024-09-19T15:31:38.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.300+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.175854199275969602', time=2024-09-19T16:47:35.840419+0000, chain.objs.size()=1 2024-09-19T15:31:38.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.300+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.MLJWWXy33_SS_bBnbw-VbnDvGcPurzH_0 2024-09-19T15:31:38.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.300+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15466390002525205930', time=2024-09-19T16:47:36.727213+0000, chain.objs.size()=1 2024-09-19T15:31:38.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.300+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.gNheHRXpJ7_jprMHVZfiSExIIgjecUp_0 2024-09-19T15:31:38.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.300+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8557362567324128087', time=2024-09-19T16:47:36.967346+0000, chain.objs.size()=1 2024-09-19T15:31:38.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.300+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.dW569coOEq8I57XQlc2oGUL4yqAhAeB_0 2024-09-19T15:31:38.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.300+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6431720814777386774', time=2024-09-19T16:47:39.523758+0000, chain.objs.size()=1 2024-09-19T15:31:38.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.300+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.KuS3l-SUDIaJ2kFR8S6qB9013loNkBE_0 2024-09-19T15:31:38.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.300+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8578011013963548814', time=2024-09-19T16:47:39.525537+0000, chain.objs.size()=1 2024-09-19T15:31:38.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.300+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.M5nFOcc2vWqibL7mJPgrqeMhnQYoPMt_0 2024-09-19T15:31:38.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.300+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8617594246978271333', time=2024-09-19T16:47:39.835194+0000, chain.objs.size()=1 2024-09-19T15:31:38.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.300+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.JA5Chf2BTiwIpkB_9vG4txoidjhwTLn_0 2024-09-19T15:31:38.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12378856475107756747', time=2024-09-19T16:47:39.985676+0000, chain.objs.size()=1 2024-09-19T15:31:38.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.308+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Vwql9Ff68etINKmAV_843sL6LXw8QIE_0 2024-09-19T15:31:38.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7206510206056160818', time=2024-09-19T16:47:40.453791+0000, chain.objs.size()=1 2024-09-19T15:31:38.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.308+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.mTd3Hb5uemez4nXgA17O34CUekGgIX-_0 2024-09-19T15:31:38.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8506485891421444788', time=2024-09-19T16:47:40.839065+0000, chain.objs.size()=1 2024-09-19T15:31:38.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.fShkKib7i1TnV3ha2pnDZ0zhEoEAoUj_0 2024-09-19T15:31:38.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6937482176985134964', time=2024-09-19T16:47:41.027437+0000, chain.objs.size()=1 2024-09-19T15:31:38.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.eaZdfwek00dCY_foB4axxSsN5qNPY7d_0 2024-09-19T15:31:38.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9769720741011774658', time=2024-09-19T16:47:43.465487+0000, chain.objs.size()=1 2024-09-19T15:31:38.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.E8yec1M1wH-m9vP8yTZpAiKOYpfmgXD_0 2024-09-19T15:31:38.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12091585268624852722', time=2024-09-19T16:47:44.019001+0000, chain.objs.size()=1 2024-09-19T15:31:38.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.rDu0b3xD2qc3SbpQCpPupDfUt3IF7gC_0 2024-09-19T15:31:38.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8715788365892641307', time=2024-09-19T16:47:45.111608+0000, chain.objs.size()=1 2024-09-19T15:31:38.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.qUKYF2VfvGpzWmib2VQaWOAzTlLKdTt_0 2024-09-19T15:31:38.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4134656528642239609', time=2024-09-19T16:47:45.113715+0000, chain.objs.size()=1 2024-09-19T15:31:38.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.dDlrZGoIRI2GcqjQgxnbfCHxoAl0A6A_0 2024-09-19T15:31:38.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4788049278390841086', time=2024-09-19T16:47:45.546528+0000, chain.objs.size()=1 2024-09-19T15:31:38.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.645JtImdoub46QBS4ZJoFhqOs-AYePs_0 2024-09-19T15:31:38.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13692979783935755526', time=2024-09-19T16:47:46.342539+0000, chain.objs.size()=1 2024-09-19T15:31:38.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.DfRFnq9DKVcLmSnquX7Ne5YQx5n0cjz_0 2024-09-19T15:31:38.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16917523206750340462', time=2024-09-19T16:47:46.402829+0000, chain.objs.size()=1 2024-09-19T15:31:38.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.5vc1mT9OUPcE7W_t0rFrAJItDKh0Ooi_0 2024-09-19T15:31:38.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9599843538011979790', time=2024-09-19T16:47:46.585955+0000, chain.objs.size()=1 2024-09-19T15:31:38.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ff-LpKUvzoidguGlm5QoTjSAkeOM6HN_0 2024-09-19T15:31:38.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1926825902895796215', time=2024-09-19T16:47:47.553260+0000, chain.objs.size()=1 2024-09-19T15:31:38.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.eGMx_wKRoLi1NZJTMIobXCR4oKG9qAZ_0 2024-09-19T15:31:38.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11845072147557048421', time=2024-09-19T16:47:47.876667+0000, chain.objs.size()=1 2024-09-19T15:31:38.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.fqdQD_G5OuGjZ7fFur7zJn0l_ZS6OXN_0 2024-09-19T15:31:38.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.320+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.456953796549163480', time=2024-09-19T16:49:36.414298+0000, chain.objs.size()=1 2024-09-19T15:31:38.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.320+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.DT4s1LwxdELvca4slfdbwSDElUSL6X1_0 2024-09-19T15:31:38.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.320+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4856227729784286881', time=2024-09-19T16:49:39.287599+0000, chain.objs.size()=1 2024-09-19T15:31:38.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.320+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.iasTvEW91tDWSSkekiALfrt8DVYWtZf_0 2024-09-19T15:31:38.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.320+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2346156734908842754', time=2024-09-19T16:49:39.563219+0000, chain.objs.size()=1 2024-09-19T15:31:38.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.320+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.BmD5A4GiOjp5-quguqvSKcudKdX_BXy_0 2024-09-19T15:31:38.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.320+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5908932750411917664', time=2024-09-19T16:49:39.625586+0000, chain.objs.size()=1 2024-09-19T15:31:38.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.320+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.iemwb4iqd66II3koKmjByRE6_ZXH89a_0 2024-09-19T15:31:38.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.320+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10546274119227766886', time=2024-09-19T16:49:40.396971+0000, chain.objs.size()=1 2024-09-19T15:31:38.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.320+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.dCadcKkXeBh7_SkkMOzJKrNZkcfNKUW_0 2024-09-19T15:31:38.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.320+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14978909431199770206', time=2024-09-19T16:49:40.708773+0000, chain.objs.size()=1 2024-09-19T15:31:38.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.320+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.cYCDUZHdNdxA7HeYasb5VX34BhWWecS_0 2024-09-19T15:31:38.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.320+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9966001517917829680', time=2024-09-19T16:49:41.366836+0000, chain.objs.size()=1 2024-09-19T15:31:38.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.320+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.pr9JQh9dMcMu5vdHAFzVDuvBEzXgxqc_0 2024-09-19T15:31:38.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.320+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13671907704176955589', time=2024-09-19T16:49:41.870734+0000, chain.objs.size()=1 2024-09-19T15:31:38.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.320+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.JYOveO94Z0PXTBtsQrbZCQYaakeJfQB_0 2024-09-19T15:31:38.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.324+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12306832159642834706', time=2024-09-19T16:49:42.042917+0000, chain.objs.size()=1 2024-09-19T15:31:38.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.324+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.OCu7DsFwRN_xYXL0lKG-VU4QcWAt_hl_0 2024-09-19T15:31:38.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.324+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.834671668314196478', time=2024-09-19T16:49:43.813669+0000, chain.objs.size()=1 2024-09-19T15:31:38.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.324+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.YlZx0PJdzjsvyQeYC_RAdr6G35tOaH__0 2024-09-19T15:31:38.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.328+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17116293589521728256', time=2024-09-19T16:49:44.472612+0000, chain.objs.size()=1 2024-09-19T15:31:38.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.328+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.pgZRr3HFdHwRM22_we_a_50pTJ7nYFf_0 2024-09-19T15:31:38.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.328+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13341353069858547083', time=2024-09-19T16:49:45.592335+0000, chain.objs.size()=1 2024-09-19T15:31:38.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.328+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ulwz3DQKENE9fEBIKLDoR5mkmic2zpk_0 2024-09-19T15:31:38.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.328+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16257123315495728805', time=2024-09-19T16:49:46.645295+0000, chain.objs.size()=1 2024-09-19T15:31:38.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.328+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.a6vkq5eb3xpACSqoB0NGLQIEwmhLKm-_0 2024-09-19T15:31:38.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.328+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16163816398655081978', time=2024-09-19T16:49:48.819450+0000, chain.objs.size()=1 2024-09-19T15:31:38.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.328+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.CvvZYie1Jbi7NEx6HltDOtroa25eR8b_0 2024-09-19T15:31:38.334 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.328+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5913344339117779930', time=2024-09-19T16:49:50.664412+0000, chain.objs.size()=1 2024-09-19T15:31:38.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.328+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.LSaQgvqZ7uTi1bSHQT3KHmdANCSuNSd_0 2024-09-19T15:31:38.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.328+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12300181105924438720', time=2024-09-19T16:49:51.986587+0000, chain.objs.size()=1 2024-09-19T15:31:38.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.328+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.65CXoEpgmosCyg6ykjKTC6Hwsmcy6fO_0 2024-09-19T15:31:38.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.328+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11901581038538160498', time=2024-09-19T16:49:52.762944+0000, chain.objs.size()=1 2024-09-19T15:31:38.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.328+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.i0qK1uG0JqvBrsOaTf-It8gPWlDa1bE_0 2024-09-19T15:31:38.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13011744942069864645', time=2024-09-19T16:49:53.217871+0000, chain.objs.size()=1 2024-09-19T15:31:38.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Dfs9NLZDTtlxKXAUfmu8SpwAeRq_qER_0 2024-09-19T15:31:38.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11378727030876297923', time=2024-09-19T16:49:53.349999+0000, chain.objs.size()=1 2024-09-19T15:31:38.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.BQ-rYFsrQnNwbZYevJ0xIyHrw4WOxBW_0 2024-09-19T15:31:38.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12104370584372597538', time=2024-09-19T16:49:54.211102+0000, chain.objs.size()=1 2024-09-19T15:31:38.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.bRcaCaqGys-Qew0y64uApqE9rF9fVHG_0 2024-09-19T15:31:38.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3153933096810517979', time=2024-09-19T16:49:54.214964+0000, chain.objs.size()=1 2024-09-19T15:31:38.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.TAYzY8eAyjDNR9ax6USvS9KQyXOiKZI_0 2024-09-19T15:31:38.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8684920656091917624', time=2024-09-19T16:49:55.150714+0000, chain.objs.size()=1 2024-09-19T15:31:38.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.XNUvQVCHWpevnswD8piCMfxz8ZXNpjZ_0 2024-09-19T15:31:38.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.336+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47304 2024-09-19T15:31:38.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-19T15:31:38.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4713971361930092022', time=2024-09-19T16:49:55.152187+0000, chain.objs.size()=1 2024-09-19T15:31:38.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.vWieNH8g3fCrFqjd9RvklcDpB3MxX2S_0 2024-09-19T15:31:38.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2505226169428160028', time=2024-09-19T16:49:59.014685+0000, chain.objs.size()=1 2024-09-19T15:31:38.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.9tIj8wFeBrbRQtV_J6J23l435yitXXW_0 2024-09-19T15:31:38.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9108889726156153308', time=2024-09-19T16:49:59.017362+0000, chain.objs.size()=1 2024-09-19T15:31:38.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.DSDIbdnO8zaLkopYuAmb6KzWDJCSskn_0 2024-09-19T15:31:38.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8639917905033650065', time=2024-09-19T16:49:59.231972+0000, chain.objs.size()=1 2024-09-19T15:31:38.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.yazmfcYR-mlRPZBtQmAL1op0eecYM8Q_0 2024-09-19T15:31:38.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2835947829889301515', time=2024-09-19T16:49:59.313998+0000, chain.objs.size()=1 2024-09-19T15:31:38.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.K_EJNZ5FAwZbp7venaWmS4_f468RQo8_0 2024-09-19T15:31:38.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2745574119492578664', time=2024-09-19T16:50:00.990368+0000, chain.objs.size()=1 2024-09-19T15:31:38.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.YTMGHgI6IBG58LuNsX7-gNhbmuJ8Yz4_0 2024-09-19T15:31:38.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.798504560907799922', time=2024-09-19T16:50:01.559214+0000, chain.objs.size()=1 2024-09-19T15:31:38.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.LswW7tcDXKHwYIGkN9UhZ2zfN9kPTFW_0 2024-09-19T15:31:38.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10409106910832413459', time=2024-09-19T16:50:02.334664+0000, chain.objs.size()=1 2024-09-19T15:31:38.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.cnQqorDzC6JMhpl9HCzl_46P6NJsZrN_0 2024-09-19T15:31:38.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10334124050565722495', time=2024-09-19T16:50:03.075734+0000, chain.objs.size()=1 2024-09-19T15:31:38.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.cpzpLdTGrlAmF8avBDd-06Pp9ybVO4N_0 2024-09-19T15:31:38.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15824694227526391319', time=2024-09-19T16:50:03.139045+0000, chain.objs.size()=1 2024-09-19T15:31:38.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.uHPxXrusNnnSf3xL-pPv1llPUZhJAcc_0 2024-09-19T15:31:38.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14699838446607132243', time=2024-09-19T16:50:03.198552+0000, chain.objs.size()=1 2024-09-19T15:31:38.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.zE9IZ9zIqRDm3mm9wwaCLp6jKaKOHku_0 2024-09-19T15:31:38.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3671493374120386342', time=2024-09-19T16:50:05.316327+0000, chain.objs.size()=1 2024-09-19T15:31:38.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.jVHL-iuc_RTTMM98oSlK7cw_3wk8enb_0 2024-09-19T15:31:38.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.344+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.718908521772705870', time=2024-09-19T16:50:06.216196+0000, chain.objs.size()=1 2024-09-19T15:31:38.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.344+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Ou-z2egSFyRfIi40q8hrwalBgZGFbme_0 2024-09-19T15:31:38.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.344+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9826034669016743871', time=2024-09-19T16:50:36.349952+0000, chain.objs.size()=1 2024-09-19T15:31:38.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.344+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.339__shadow_._oUqJFQu3HXk3-I5mNcE9JUWD2yfhBk_0 2024-09-19T15:31:38.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.344+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16061586505761641997', time=2024-09-19T16:54:24.661059+0000, chain.objs.size()=1 2024-09-19T15:31:38.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.344+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.451__shadow_.uezJZbFffSxSZg8c6Rq_kDdm4ILkQ0o_0 2024-09-19T15:31:38.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.344+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5826741779104289808', time=2024-09-19T16:55:48.452179+0000, chain.objs.size()=1 2024-09-19T15:31:38.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.344+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.487__shadow_.7ciDSPOLTB4o1ql_jo1cSeJ5RoVN_iD_0 2024-09-19T15:31:38.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.344+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16705000314829634841', time=2024-09-19T16:56:09.265972+0000, chain.objs.size()=1 2024-09-19T15:31:38.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.344+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.497__shadow_.3sWqFBSDtS3DLDhV9BK4NkGQGbuMz_5_0 2024-09-19T15:31:38.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.344+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1888338300989739731', time=2024-09-19T16:57:06.483500+0000, chain.objs.size()=6 2024-09-19T15:31:38.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.344+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.1 2024-09-19T15:31:38.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.348+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.2 2024-09-19T15:31:38.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.348+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.3 2024-09-19T15:31:38.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.348+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.4 2024-09-19T15:31:38.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.348+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.5 2024-09-19T15:31:38.354 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.348+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.6 2024-09-19T15:31:38.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.352+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8196718552531746177', time=2024-09-19T17:00:48.348265+0000, chain.objs.size()=6 2024-09-19T15:31:38.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.352+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~fJ_lIzQ9BKqSVIjHylAxHBm0ue_zlDs.1 2024-09-19T15:31:38.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.352+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.Y6xiFarScP5FooDPOUzU-H1vJcJvMz3p.2 2024-09-19T15:31:38.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.352+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~fJ_lIzQ9BKqSVIjHylAxHBm0ue_zlDs.3 2024-09-19T15:31:38.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.352+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~fJ_lIzQ9BKqSVIjHylAxHBm0ue_zlDs.4 2024-09-19T15:31:38.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.352+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~fJ_lIzQ9BKqSVIjHylAxHBm0ue_zlDs.5 2024-09-19T15:31:38.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.352+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~fJ_lIzQ9BKqSVIjHylAxHBm0ue_zlDs.6 2024-09-19T15:31:38.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.352+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.901687121509748822', time=2024-09-19T17:03:34.678182+0000, chain.objs.size()=3 2024-09-19T15:31:38.358 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.352+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.525__multipart_mymultipart.2~AZ3iYo34L4t2ACYkmLmbvuAtwBy0asd.1 2024-09-19T15:31:38.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.356+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.525__multipart_mymultipart.2~AZ3iYo34L4t2ACYkmLmbvuAtwBy0asd.2 2024-09-19T15:31:38.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.356+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.525__multipart_mymultipart.2~AZ3iYo34L4t2ACYkmLmbvuAtwBy0asd.3 2024-09-19T15:31:38.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.356+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~v5mKFQLUXqOcMtbs_p_bP3FmVujdskB', time=2024-09-19T17:04:23.395505+0000, chain.objs.size()=1 2024-09-19T15:31:38.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.356+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.531__multipart_mymultipart2.2~v5mKFQLUXqOcMtbs_p_bP3FmVujdskB.1 2024-09-19T15:31:38.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.356+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14027301172703969471', time=2024-09-19T17:06:50.386703+0000, chain.objs.size()=1 2024-09-19T15:31:38.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.356+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.557__shadow_.3o4wTvKD3yeVEXtAJqT2BdPn5mPneSd_0 2024-09-19T15:31:38.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.356+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13626844629830963260', time=2024-09-19T17:07:50.566759+0000, chain.objs.size()=1 2024-09-19T15:31:38.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.356+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:dqTLPSWRiZGkX4VZ2vZke832nW7ygiN_.hXZNyM7_3g-ZIC6NkHshFCNiFQPyCDF_0 2024-09-19T15:31:38.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.360+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15064850326996153339', time=2024-09-19T17:08:03.436745+0000, chain.objs.size()=1 2024-09-19T15:31:38.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.360+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:bbQNZSIEnu5cnyAmhiQCQj8BIoCGN9e_.zE4NBRzHZtiea-mUSH4tm9Z5_bqKIbK_0 2024-09-19T15:31:38.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.360+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6033477829471449292', time=2024-09-19T17:08:56.012924+0000, chain.objs.size()=1 2024-09-19T15:31:38.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.360+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:xwPbdHZWaK8vd8hDM4kwATnQbkvsTsg_.KHTmyKq6xLogIJFk5pRI_g9-0E9Gwkm_0 2024-09-19T15:31:38.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.360+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1959641333329978597', time=2024-09-19T17:09:06.446419+0000, chain.objs.size()=1 2024-09-19T15:31:38.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.360+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:vjVRsYRPqTEb..ioD-GZW8Onk1vKPZS_.SImhdVB9Vcn83djKwXau0AU0LjwT0Sm_0 2024-09-19T15:31:38.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.360+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13237915109175206540', time=2024-09-19T17:10:30.332836+0000, chain.objs.size()=1 2024-09-19T15:31:38.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.360+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.579__shadow:G2cNE.R4i6-nCpA9j8YotqHcy1d8.OD_.a6V4PV0mhT_HVF0HD7Ybt2WCD4EvrCP_0 2024-09-19T15:31:38.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.360+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4265195884914091262', time=2024-09-19T17:20:47.634245+0000, chain.objs.size()=1 2024-09-19T15:31:38.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.360+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.666__shadow_.jIaz_FlQExbHpuHb9IFgCd-MfbKizZj_0 2024-09-19T15:31:38.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.360+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11554014820465236998', time=2024-09-19T17:22:11.545647+0000, chain.objs.size()=1 2024-09-19T15:31:38.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.360+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.710__shadow:HWUbfG2zhnx6I3556990ct25KQxx.wN_.9jul8YZzttNpln88QqUZNHGPii0rEIR_0 2024-09-19T15:31:38.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.364+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11757828434103261107', time=2024-09-19T17:27:17.456440+0000, chain.objs.size()=1 2024-09-19T15:31:38.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.364+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.764__shadow_.hARP-4UXokLIQ2ifEDn0A0gpUxUOYlT_0 2024-09-19T15:31:38.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:38.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T15:31:38.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:38.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:38.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51547' 2024-09-19T15:31:38.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17950467190203327285', time=2024-09-19T16:34:15.175513+0000, chain.objs.size()=1 2024-09-19T15:31:38.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.166__shadow_.vRrZQUIznXk3ZgkwpOmoRnFm6zfZAYy_0 2024-09-19T15:31:38.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12384385702506961004', time=2024-09-19T16:35:07.277902+0000, chain.objs.size()=1 2024-09-19T15:31:38.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.188__shadow_.9gEIGGhQddjXuii4eBZ_S8OTEN_Hx4x_0 2024-09-19T15:31:38.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16178719828459762390', time=2024-09-19T16:35:51.183139+0000, chain.objs.size()=1 2024-09-19T15:31:38.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.200__shadow_.cg22HFGiPfmOYRCMU6jRMJvPr-sohhF_0 2024-09-19T15:31:38.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.935157513812141186', time=2024-09-19T16:39:52.634438+0000, chain.objs.size()=1 2024-09-19T15:31:38.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.241__shadow_.O1OGOIZQSmfzJib6QCnCwvpf-AEbTwD_0 2024-09-19T15:31:38.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18334907696171872471', time=2024-09-19T16:40:05.055765+0000, chain.objs.size()=1 2024-09-19T15:31:38.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.245__shadow_.5ulB37SpebCvY-47A5uRlGN1IOLoe7e_0 2024-09-19T15:31:38.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7627102832025457879', time=2024-09-19T16:40:12.055872+0000, chain.objs.size()=1 2024-09-19T15:31:38.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.248__shadow_.20h_vdqej4U5JcE2WKCIYC5qRdrhl6y_0 2024-09-19T15:31:38.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11142156317211379012', time=2024-09-19T16:40:21.375407+0000, chain.objs.size()=1 2024-09-19T15:31:38.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.252__shadow_.bveP2FoLFWKgoGGMSAdCgF6nLmJ6MaS_0 2024-09-19T15:31:38.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2003629482766672717', time=2024-09-19T16:40:28.171074+0000, chain.objs.size()=1 2024-09-19T15:31:38.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.255__shadow_.SGAClq6icqUZDJE-J7YeFLqeVPLoMO-_0 2024-09-19T15:31:38.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16934695603928794714', time=2024-09-19T16:42:29.673278+0000, chain.objs.size()=1 2024-09-19T15:31:38.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.-uh7tmoqwJwXev9-oi_lBR4JsoOwyHF_0 2024-09-19T15:31:38.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1689355972808643555', time=2024-09-19T16:42:29.937864+0000, chain.objs.size()=1 2024-09-19T15:31:38.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.UtlkEQICCbbEl8idqB1yddTx3yBY_wX_0 2024-09-19T15:31:38.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2125591649213689176', time=2024-09-19T16:42:30.563648+0000, chain.objs.size()=1 2024-09-19T15:31:38.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.yRKw6Fk_LQR61uiUXLAmx3lAcNZnHiH_0 2024-09-19T15:31:38.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8262728168055040163', time=2024-09-19T16:42:31.372912+0000, chain.objs.size()=1 2024-09-19T15:31:38.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.376+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ygSJ4y0nUZl1q0P70F6Uaa6NkS7TL7I_0 2024-09-19T15:31:38.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.39850616148658708', time=2024-09-19T16:42:32.644988+0000, chain.objs.size()=1 2024-09-19T15:31:38.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.xtPyHdPnHJw6JabBYD7e5cNfTBzbFVV_0 2024-09-19T15:31:38.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8680359758122059627', time=2024-09-19T16:42:32.651494+0000, chain.objs.size()=1 2024-09-19T15:31:38.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.mHBYmx-qGjfe5NnAc-NmO9vlWKosg0W_0 2024-09-19T15:31:38.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3566852894788315789', time=2024-09-19T16:42:33.033573+0000, chain.objs.size()=1 2024-09-19T15:31:38.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.-cFNunssVjeqm25ktSbrOhpkU2Mn-CN_0 2024-09-19T15:31:38.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2211500167145742428', time=2024-09-19T16:42:33.827079+0000, chain.objs.size()=1 2024-09-19T15:31:38.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.F6T-Wbz0kst325OkMh858GBoh5SNSCC_0 2024-09-19T15:31:38.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5437116676609271417', time=2024-09-19T16:42:35.054735+0000, chain.objs.size()=1 2024-09-19T15:31:38.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.XprDG53nsxPKRQ86HcLLzPTUDOR79TS_0 2024-09-19T15:31:38.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15986753223196503389', time=2024-09-19T16:42:35.593205+0000, chain.objs.size()=1 2024-09-19T15:31:38.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.GFtq4OHJUJROgjnbFHARBcBCHcMNCaW_0 2024-09-19T15:31:38.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5646800613733451585', time=2024-09-19T16:42:36.815379+0000, chain.objs.size()=1 2024-09-19T15:31:38.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.3P2M5JDTIeGH_XvXEExf3AX3IlSOdP2_0 2024-09-19T15:31:38.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4378085061664170252', time=2024-09-19T16:42:37.518865+0000, chain.objs.size()=1 2024-09-19T15:31:38.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Nuah8gjk1IJCUM-NIV9BP7lT2HwWE7m_0 2024-09-19T15:31:38.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4197700072374693713', time=2024-09-19T16:42:38.635344+0000, chain.objs.size()=1 2024-09-19T15:31:38.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.UY7nPLSAwmf6xz3PhqayAYtGnLytro1_0 2024-09-19T15:31:38.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11977696488396330433', time=2024-09-19T16:42:38.826979+0000, chain.objs.size()=1 2024-09-19T15:31:38.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.NGHFeUaIIVswFOibuIbc-K-l5d6Es1l_0 2024-09-19T15:31:38.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18010260354559935225', time=2024-09-19T16:42:39.339920+0000, chain.objs.size()=1 2024-09-19T15:31:38.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.F7phAoB-kh-FEfSI7nUfuGRdaCWr5Zw_0 2024-09-19T15:31:38.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17504731989708836176', time=2024-09-19T16:42:41.118738+0000, chain.objs.size()=1 2024-09-19T15:31:38.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.fV5LxIIycx3OeM8tLzPQH4W5su3qN_j_0 2024-09-19T15:31:38.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16628494745744138408', time=2024-09-19T16:42:41.407348+0000, chain.objs.size()=1 2024-09-19T15:31:38.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Aurk_SmZ1xGzcovGKF1HblH0fIezm38_0 2024-09-19T15:31:38.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7341768943683818221', time=2024-09-19T16:42:42.061415+0000, chain.objs.size()=1 2024-09-19T15:31:38.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.7EAytoAjLYE4CNtmzcG8o55jQPmow3c_0 2024-09-19T15:31:38.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1899117928624298019', time=2024-09-19T16:42:42.520811+0000, chain.objs.size()=1 2024-09-19T15:31:38.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.bBFdAuEmwjHzmWTaCUO7gmnwruDYD4w_0 2024-09-19T15:31:38.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10232796296842632796', time=2024-09-19T16:42:43.610999+0000, chain.objs.size()=1 2024-09-19T15:31:38.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.8CyH93ekd-JhHcZVe2P3pVssE9RIW6B_0 2024-09-19T15:31:38.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.356189080937393098', time=2024-09-19T16:42:46.061475+0000, chain.objs.size()=1 2024-09-19T15:31:38.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.kaMVBfOxXdnnQVqyePp-f2tsPkXnEYo_0 2024-09-19T15:31:38.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10930810075148946563', time=2024-09-19T16:42:46.470328+0000, chain.objs.size()=1 2024-09-19T15:31:38.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.xL60XsfGth6mADXJw1nPpOmAj76wTQ5_0 2024-09-19T15:31:38.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8331230868394400781', time=2024-09-19T16:42:47.787328+0000, chain.objs.size()=1 2024-09-19T15:31:38.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.mglKfBVaAAng4mIZfPQQ0bpa16WeUCT_0 2024-09-19T15:31:38.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.826456744635812372', time=2024-09-19T16:42:48.207180+0000, chain.objs.size()=1 2024-09-19T15:31:38.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.1zNpb_IABE3oUGqxtg9D37_7qDoWBK__0 2024-09-19T15:31:38.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5041611260455972805', time=2024-09-19T16:42:49.929814+0000, chain.objs.size()=1 2024-09-19T15:31:38.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.wd5kT8gCIDkDI-TAKz3oEkWcl1a3PiQ_0 2024-09-19T15:31:38.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10453031017510581407', time=2024-09-19T16:42:50.754379+0000, chain.objs.size()=1 2024-09-19T15:31:38.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.YvJW4wdrCGZeqHV_u_V8JLflDoL3Hit_0 2024-09-19T15:31:38.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.688808839739042619', time=2024-09-19T16:42:51.313344+0000, chain.objs.size()=1 2024-09-19T15:31:38.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Q-hu7s40SSk8vNoiVkJI7Ui1TRwQpgv_0 2024-09-19T15:31:38.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10276174592658132199', time=2024-09-19T16:42:51.660971+0000, chain.objs.size()=1 2024-09-19T15:31:38.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Uun6Mdx_daeuL_XeqtVnZLzJ3z1kxZw_0 2024-09-19T15:31:38.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8184990388979550542', time=2024-09-19T16:42:51.959310+0000, chain.objs.size()=1 2024-09-19T15:31:38.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.qNkOsdEdUU6ZGaHD53vJ4OU7aPmD9n9_0 2024-09-19T15:31:38.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13085809406587776117', time=2024-09-19T16:42:53.543582+0000, chain.objs.size()=1 2024-09-19T15:31:38.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.SQ0lI-KjlZEamwXb6O6HQGr9lGgUbDP_0 2024-09-19T15:31:38.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4035085288554791654', time=2024-09-19T16:42:54.310737+0000, chain.objs.size()=1 2024-09-19T15:31:38.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.mqqdmT4KbZeQZ1kAQ68WMyyek_F1yCa_0 2024-09-19T15:31:38.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.545194280928262974', time=2024-09-19T16:42:55.076826+0000, chain.objs.size()=1 2024-09-19T15:31:38.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.vwTGGfHI2NyDcRk5EvLn0vdf3WOaMGA_0 2024-09-19T15:31:38.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8251175274899833382', time=2024-09-19T16:42:55.451787+0000, chain.objs.size()=1 2024-09-19T15:31:38.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.0_fA5xBwnlRWv4wYRRoPhWfEdiy6AqT_0 2024-09-19T15:31:38.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4943143068943772353', time=2024-09-19T16:42:55.695845+0000, chain.objs.size()=1 2024-09-19T15:31:38.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.9a319qXo8lUmvpyEjSGVXQjrVjihxzv_0 2024-09-19T15:31:38.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1706222273862512193', time=2024-09-19T16:42:56.589168+0000, chain.objs.size()=1 2024-09-19T15:31:38.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.jOYnNIDgWB0Brk8EFkIS5VAFoHGOyi6_0 2024-09-19T15:31:38.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2672960304415755440', time=2024-09-19T16:42:57.377646+0000, chain.objs.size()=1 2024-09-19T15:31:38.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.zpB_DTyVtNtYsjDU7ctInOzjkfaDxmB_0 2024-09-19T15:31:38.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13012309292303943939', time=2024-09-19T16:42:57.878122+0000, chain.objs.size()=1 2024-09-19T15:31:38.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.lj3C8DnslIi-DAT8m9iZr2rRoi7s2bw_0 2024-09-19T15:31:38.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4682867607469576391', time=2024-09-19T16:42:58.252759+0000, chain.objs.size()=1 2024-09-19T15:31:38.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.KrXPb9Dg109ek_kh2sNN_8mjH6D5isI_0 2024-09-19T15:31:38.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8758986142820044724', time=2024-09-19T16:42:58.409328+0000, chain.objs.size()=1 2024-09-19T15:31:38.400 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.A6uvIpbRd6-se0nG_kDaVZmSt-sTnnF_0 2024-09-19T15:31:38.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17180243528770430488', time=2024-09-19T16:42:59.273906+0000, chain.objs.size()=1 2024-09-19T15:31:38.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.hmro5KPa3axAMKLI1Q11diwoK8D6N0h_0 2024-09-19T15:31:38.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16557287451121594735', time=2024-09-19T16:43:17.807720+0000, chain.objs.size()=1 2024-09-19T15:31:38.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.270__shadow_.eb6JeBeA6AO4BV5oyU6fVj1017ImGCO_0 2024-09-19T15:31:38.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13433921989578485036', time=2024-09-19T16:43:31.271011+0000, chain.objs.size()=1 2024-09-19T15:31:38.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.276__shadow_.Q7stFJ0hkB4O_IegFesFuMSOz4bHYS9_0 2024-09-19T15:31:38.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18274533514830169504', time=2024-09-19T16:43:57.153563+0000, chain.objs.size()=1 2024-09-19T15:31:38.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.287__shadow_.7GCsnZjZ9TaVnv0HdVvQXQgRUmnVDxc_0 2024-09-19T15:31:38.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15782730868219446774', time=2024-09-19T16:44:07.057051+0000, chain.objs.size()=1 2024-09-19T15:31:38.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.291__shadow_.LzS23-d6CgxTbuvJbR-8oluNAHXBUot_0 2024-09-19T15:31:38.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11556454460437513013', time=2024-09-19T16:44:18.291850+0000, chain.objs.size()=1 2024-09-19T15:31:38.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.ibKs72Cq7NRX6ZBd8c7UdrqcImSihDu_0 2024-09-19T15:31:38.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8909030317987492907', time=2024-09-19T16:44:18.598665+0000, chain.objs.size()=1 2024-09-19T15:31:38.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.9wRG4i-U2HOYlEf8CZNzfH05Dgb1ZVW_0 2024-09-19T15:31:38.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.400+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9147270526422163937', time=2024-09-19T16:44:27.997201+0000, chain.objs.size()=1 2024-09-19T15:31:38.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.400+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.297__shadow_.rA7QHhbVEh7_vK-ZF_yabK-uHkHoXql_0 2024-09-19T15:31:38.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.400+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14220332577411907592', time=2024-09-19T16:45:26.592510+0000, chain.objs.size()=1 2024-09-19T15:31:38.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.400+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.319__shadow:jx0RuLCuq0Oqg-dNKP-8OZT1yBbpAyP_.llpM52FHV6HyaVuUQjltVtp7faeideg_0 2024-09-19T15:31:38.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.400+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7592116315140648944', time=2024-09-19T16:45:32.423649+0000, chain.objs.size()=1 2024-09-19T15:31:38.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.400+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.322__shadow_.GMWy4UDg2_JkOvxaTLGAMt9JGYuVL3S_0 2024-09-19T15:31:38.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.400+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16021454687313665657', time=2024-09-19T16:47:17.947231+0000, chain.objs.size()=1 2024-09-19T15:31:38.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.400+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.MaPmP7wchtNXBAz4KjjTe0QufvX6bWA_0 2024-09-19T15:31:38.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.400+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17344634557460119649', time=2024-09-19T16:47:18.125002+0000, chain.objs.size()=1 2024-09-19T15:31:38.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.400+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.NyRBZhqRORfer1lTth5kE4qL8Mj482S_0 2024-09-19T15:31:38.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.400+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16896439697994146465', time=2024-09-19T16:47:19.114351+0000, chain.objs.size()=1 2024-09-19T15:31:38.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.400+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.WQh_s5rfDHVzMfcKRBOn_D4LF7SVFOo_0 2024-09-19T15:31:38.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.400+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3098258984353046933', time=2024-09-19T16:47:20.029025+0000, chain.objs.size()=1 2024-09-19T15:31:38.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.400+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.fAdJxZSevhhBNDGI-B29b_JG2EJRhpm_0 2024-09-19T15:31:38.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.400+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12673673968117983804', time=2024-09-19T16:47:21.124920+0000, chain.objs.size()=1 2024-09-19T15:31:38.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.400+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.j74Bzx6BJZUrDduELsaOQ1WSy2jbewS_0 2024-09-19T15:31:38.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.404+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5943461849700203987', time=2024-09-19T16:47:21.324030+0000, chain.objs.size()=1 2024-09-19T15:31:38.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.404+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.vg4gJcmTUqPZprbU5DoZD1xoe--I5IO_0 2024-09-19T15:31:38.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.404+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.88377284452990112', time=2024-09-19T16:47:22.342509+0000, chain.objs.size()=1 2024-09-19T15:31:38.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.404+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.zg-Do6jDJb29sEnS2vlWPterdN2HxmW_0 2024-09-19T15:31:38.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.404+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15425704637917929339', time=2024-09-19T16:47:24.744901+0000, chain.objs.size()=1 2024-09-19T15:31:38.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.404+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.jXfuuz27pTk43Bu19M8o5FtgGvk3uOa_0 2024-09-19T15:31:38.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.404+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6318088772523038347', time=2024-09-19T16:47:24.960577+0000, chain.objs.size()=1 2024-09-19T15:31:38.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.404+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.98Mj6NBvDs3ZPU98mgQVEKUk1MDVcPh_0 2024-09-19T15:31:38.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.404+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12899264600013543242', time=2024-09-19T16:47:26.682799+0000, chain.objs.size()=1 2024-09-19T15:31:38.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.404+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Arh7M1C3Rw8D9Q0rhJNObLPBHOqg-6v_0 2024-09-19T15:31:38.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.404+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15368090460666097733', time=2024-09-19T16:47:27.487901+0000, chain.objs.size()=1 2024-09-19T15:31:38.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.404+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.eOBOaF57dZzTIOYGXJzTaERdVwC1hIT_0 2024-09-19T15:31:38.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.404+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17448203792698651629', time=2024-09-19T16:47:27.998168+0000, chain.objs.size()=1 2024-09-19T15:31:38.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.404+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Ua4MNsg4g_m9qeAX4NyUWVlmy7J3GUy_0 2024-09-19T15:31:38.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.404+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5427661030249081625', time=2024-09-19T16:47:29.719413+0000, chain.objs.size()=1 2024-09-19T15:31:38.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.404+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.DrKnsRA5gmL5xnAhoqbC-tDkABynGGo_0 2024-09-19T15:31:38.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.404+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15299988559073799576', time=2024-09-19T16:47:31.089096+0000, chain.objs.size()=1 2024-09-19T15:31:38.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.404+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.rD4eyvS3w71pFhJ7lH65LPsRGQbO8QZ_0 2024-09-19T15:31:38.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.404+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16381482919236118923', time=2024-09-19T16:47:31.193602+0000, chain.objs.size()=1 2024-09-19T15:31:38.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.404+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.etyERkf4zy1AU6djdfj8O6yUYxIhHor_0 2024-09-19T15:31:38.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.404+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12612034438706780600', time=2024-09-19T16:47:31.890099+0000, chain.objs.size()=1 2024-09-19T15:31:38.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.404+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.PnCREb4QrItH8_Q2jrrxuHc-101v-dR_0 2024-09-19T15:31:38.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17023079504830663713', time=2024-09-19T16:47:33.122530+0000, chain.objs.size()=1 2024-09-19T15:31:38.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.7xerbqm9q_YIwFHJInAXl4h153KlSLg_0 2024-09-19T15:31:38.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11946941786511961775', time=2024-09-19T16:47:33.262137+0000, chain.objs.size()=1 2024-09-19T15:31:38.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.HNT5gntHC09DAl-TtBlsan20fYT-uAu_0 2024-09-19T15:31:38.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4324617656247322864', time=2024-09-19T16:47:36.174192+0000, chain.objs.size()=1 2024-09-19T15:31:38.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Lm34XgVo65sTL5r4PIOm9UJ1gqivDCG_0 2024-09-19T15:31:38.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10763495422162354712', time=2024-09-19T16:47:37.383496+0000, chain.objs.size()=1 2024-09-19T15:31:38.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.5mjrg4izP-FnnzStp1KzkQWN595PYHT_0 2024-09-19T15:31:38.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3776747497411951157', time=2024-09-19T16:47:37.886675+0000, chain.objs.size()=1 2024-09-19T15:31:38.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.VGxqLlUCuaBOgjjqn4TiSnNdOO4gRZ6_0 2024-09-19T15:31:38.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4458966107087911303', time=2024-09-19T16:47:38.385448+0000, chain.objs.size()=1 2024-09-19T15:31:38.414 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.vEiKEePTMe8JQ3yULB9PcUQi5cF6QWF_0 2024-09-19T15:31:38.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2820576816220953989', time=2024-09-19T16:47:39.521234+0000, chain.objs.size()=1 2024-09-19T15:31:38.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.gGmXW1FhFEB7ciDzRxMJyVFaRUJbgoA_0 2024-09-19T15:31:38.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13446472327974146239', time=2024-09-19T16:47:40.971535+0000, chain.objs.size()=1 2024-09-19T15:31:38.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.BSkGngT8zABztdxMtuUDjFVe0Chtrg4_0 2024-09-19T15:31:38.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8992464750040004024', time=2024-09-19T16:47:43.513404+0000, chain.objs.size()=1 2024-09-19T15:31:38.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.5jcnZRKUd439cUXR3ow2pGqUyzpSOWO_0 2024-09-19T15:31:38.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18182589414662083225', time=2024-09-19T16:47:45.120919+0000, chain.objs.size()=1 2024-09-19T15:31:38.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.jVbdOV2jws-OpCSxprcFz3W81hAOuCO_0 2024-09-19T15:31:38.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15617438344609526425', time=2024-09-19T16:47:45.983944+0000, chain.objs.size()=1 2024-09-19T15:31:38.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.69AUzPGvNug2pvr8Gn7giJNdviU7pbw_0 2024-09-19T15:31:38.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.412+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8454719776666073443', time=2024-09-19T16:47:46.391338+0000, chain.objs.size()=1 2024-09-19T15:31:38.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.412+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.L1KezgbaiXjpJgmyvP5HuAsIvP15vBH_0 2024-09-19T15:31:38.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.412+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10650198690628771317', time=2024-09-19T16:47:46.528548+0000, chain.objs.size()=1 2024-09-19T15:31:38.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.412+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.b40oiUv4RW5cr1hvHTcrCd3fioIs7QB_0 2024-09-19T15:31:38.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.412+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12654830912224515101', time=2024-09-19T16:47:46.683391+0000, chain.objs.size()=1 2024-09-19T15:31:38.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.412+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.XcHGRfVzXGDTmFGGSXBsc-lhH142BMw_0 2024-09-19T15:31:38.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.412+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14962073985432427078', time=2024-09-19T16:47:47.490895+0000, chain.objs.size()=1 2024-09-19T15:31:38.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.412+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.BcH6lzGoc-NdwyB_ipZG9fQMM02UypO_0 2024-09-19T15:31:38.418 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.412+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15263689678892089681', time=2024-09-19T16:47:47.515890+0000, chain.objs.size()=1 2024-09-19T15:31:38.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.412+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.A8fkCCBsA7nzxX7wbegHctCfh69XFWl_0 2024-09-19T15:31:38.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.412+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9973570454132413697', time=2024-09-19T16:47:48.018576+0000, chain.objs.size()=1 2024-09-19T15:31:38.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.412+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.x8BaHYKF8eU5jH-7AyIHK3q7xczvZJV_0 2024-09-19T15:31:38.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.412+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17267182578482434339', time=2024-09-19T16:47:48.731379+0000, chain.objs.size()=1 2024-09-19T15:31:38.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.412+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.G4-CxrdwEpy9QUgzjmZhIKllV88C01h_0 2024-09-19T15:31:38.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9817401650622632036', time=2024-09-19T16:47:49.938707+0000, chain.objs.size()=1 2024-09-19T15:31:38.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.0xSnw9ozL8Yaf-_BiFrCsZnRT2To225_0 2024-09-19T15:31:38.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1843568083428040271', time=2024-09-19T16:49:37.045500+0000, chain.objs.size()=1 2024-09-19T15:31:38.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ayay4iacXkW3bO8uB9rXtlm0kaBfSmc_0 2024-09-19T15:31:38.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7121881808849223990', time=2024-09-19T16:49:37.947498+0000, chain.objs.size()=1 2024-09-19T15:31:38.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.VoPn80iVbDglGW26d4DtOect40QF_g__0 2024-09-19T15:31:38.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8473449861150694822', time=2024-09-19T16:49:40.489389+0000, chain.objs.size()=1 2024-09-19T15:31:38.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ixwi2X3HRx8cPcZi1LJCkVixDwkbic3_0 2024-09-19T15:31:38.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11310289590928203522', time=2024-09-19T16:49:41.733867+0000, chain.objs.size()=1 2024-09-19T15:31:38.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.gUeXEs9YcB0jlCnblQvU4TnSI6HGYMx_0 2024-09-19T15:31:38.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18022427834427318329', time=2024-09-19T16:49:44.529096+0000, chain.objs.size()=1 2024-09-19T15:31:38.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.SkvzcN0PK9_PBAXStZzMg09pFANhOHy_0 2024-09-19T15:31:38.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17549382862080360614', time=2024-09-19T16:49:45.612131+0000, chain.objs.size()=1 2024-09-19T15:31:38.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.FYzfLnzEaiFj9TpOVs4Fp-iAD5SolvK_0 2024-09-19T15:31:38.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10896878264456687648', time=2024-09-19T16:49:45.712190+0000, chain.objs.size()=1 2024-09-19T15:31:38.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.DWjyfbCWGKvmay4DCRQ1S3RddI_VcMd_0 2024-09-19T15:31:38.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.420+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11840155309977073874', time=2024-09-19T16:49:46.212061+0000, chain.objs.size()=1 2024-09-19T15:31:38.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.420+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.kxDVoNUw2cxzUt_y4GTr6ZbMlvL7vd8_0 2024-09-19T15:31:38.430 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.424+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51547 2024-09-19T15:31:38.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=40, truncated=0, next_marker='' 2024-09-19T15:31:38.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4240010265889817282', time=2024-09-19T16:49:47.789220+0000, chain.objs.size()=1 2024-09-19T15:31:38.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.FUMN6SbIA-59HYp2PIBe9Cz_EtbDNt5_0 2024-09-19T15:31:38.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10518410406075899871', time=2024-09-19T16:49:48.309393+0000, chain.objs.size()=1 2024-09-19T15:31:38.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.MFCnU14FSXq3eEYYay9ab83maBVw7FS_0 2024-09-19T15:31:38.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10604995957885819039', time=2024-09-19T16:49:50.972709+0000, chain.objs.size()=1 2024-09-19T15:31:38.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.L_LENjjXjy_VUx7sMqZbaPRVuVZwolC_0 2024-09-19T15:31:38.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.924592509520372977', time=2024-09-19T16:49:51.085580+0000, chain.objs.size()=1 2024-09-19T15:31:38.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.3TQ96dxHpnQ-hkBj4F-mAZHWa6SLM9c_0 2024-09-19T15:31:38.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9378077780518468976', time=2024-09-19T16:49:52.543137+0000, chain.objs.size()=1 2024-09-19T15:31:38.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Rc8fxT6h9csF72H0zWXFmFZ25UW14va_0 2024-09-19T15:31:38.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15469544006375705554', time=2024-09-19T16:49:53.547662+0000, chain.objs.size()=1 2024-09-19T15:31:38.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.owKeAGWvNjh97LoGQYzVSWb7Faimbk-_0 2024-09-19T15:31:38.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4561650651597273626', time=2024-09-19T16:49:54.618773+0000, chain.objs.size()=1 2024-09-19T15:31:38.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.XCGxQ9oc5ftmuIv8PRqOXRlIh5c8VXF_0 2024-09-19T15:31:38.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15000346884538159916', time=2024-09-19T16:49:56.172546+0000, chain.objs.size()=1 2024-09-19T15:31:38.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.6btye8dsTl55LbJcVt9Ah4N7SZr1eXP_0 2024-09-19T15:31:38.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17402643580587758000', time=2024-09-19T16:49:56.703548+0000, chain.objs.size()=1 2024-09-19T15:31:38.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.9NhbbFx7mQUXzbDGUaRuYuaSGc5PGq4_0 2024-09-19T15:31:38.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13050664610329579270', time=2024-09-19T16:49:58.924305+0000, chain.objs.size()=1 2024-09-19T15:31:38.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.-qUjTNtlO9Q8ioBXMwDcn74doHOYsAN_0 2024-09-19T15:31:38.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9831851519741620230', time=2024-09-19T16:49:59.067051+0000, chain.objs.size()=1 2024-09-19T15:31:38.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.LB-X9aGN0dzX31wWE5xCTOo1iZcRDh6_0 2024-09-19T15:31:38.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12256559124642518789', time=2024-09-19T16:50:01.354354+0000, chain.objs.size()=1 2024-09-19T15:31:38.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.428+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.K3yhBJtacYfa7tCBeSwf3PIOKB35Fey_0 2024-09-19T15:31:38.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.432+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7882610382928611197', time=2024-09-19T16:50:01.576320+0000, chain.objs.size()=1 2024-09-19T15:31:38.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.432+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.idBX2E9fmtJBx3Pq9oLDf8or8y-UILa_0 2024-09-19T15:31:38.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.432+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5361974366581428850', time=2024-09-19T16:50:02.784630+0000, chain.objs.size()=1 2024-09-19T15:31:38.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.432+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.3Dhx1pscrl3AiyO2VuWbF9obNz3QDHp_0 2024-09-19T15:31:38.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.432+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10074675756873545326', time=2024-09-19T16:50:03.248174+0000, chain.objs.size()=1 2024-09-19T15:31:38.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.432+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.qeORCAq71NVMkVg6LdXUEzu3gI-Zor1_0 2024-09-19T15:31:38.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.432+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.465266201715610615', time=2024-09-19T16:50:04.462795+0000, chain.objs.size()=1 2024-09-19T15:31:38.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.432+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.RfS_pIMUiEKJjlOp8sqA1q8w-mmQ-wb_0 2024-09-19T15:31:38.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.432+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11724606110315713844', time=2024-09-19T16:50:04.907851+0000, chain.objs.size()=1 2024-09-19T15:31:38.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.432+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.tP9aziZqMPl6QdYF_n1You4d4hfuNTD_0 2024-09-19T15:31:38.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.432+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4257500179600266202', time=2024-09-19T16:50:06.411563+0000, chain.objs.size()=1 2024-09-19T15:31:38.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.432+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.R8vbeinLihBb5w75IBoewpand3GVojw_0 2024-09-19T15:31:38.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.432+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18395517827683364260', time=2024-09-19T16:50:06.476033+0000, chain.objs.size()=1 2024-09-19T15:31:38.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.432+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.1CS_GmUPgJpaK4cWjqDa4VUcrNPvPr2_0 2024-09-19T15:31:38.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.432+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15094496899319202696', time=2024-09-19T16:51:40.792082+0000, chain.objs.size()=1 2024-09-19T15:31:38.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.432+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.373__shadow_.CE0vvLHhK2-pLqvzqg0sTuzZKAcQdbv_0 2024-09-19T15:31:38.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.432+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10415155627181217034', time=2024-09-19T16:52:17.531484+0000, chain.objs.size()=1 2024-09-19T15:31:38.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.432+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.390__shadow_.33QXa3I5sSrRVYPAOu6opNS3TXBuj0S_0 2024-09-19T15:31:38.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.432+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1746721278380460638', time=2024-09-19T16:52:55.081850+0000, chain.objs.size()=1 2024-09-19T15:31:38.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.432+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.409__shadow_.1EbUNgLLQAljFfPdRcavT_k3y9KByNW_0 2024-09-19T15:31:38.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.432+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6864702186175741341', time=2024-09-19T16:54:16.095389+0000, chain.objs.size()=1 2024-09-19T15:31:38.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.432+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.447__shadow_.cpHmaeiPtL8qXvQL23Y4OanWbcH0zqt_0 2024-09-19T15:31:38.442 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.436+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3611950135866515348', time=2024-09-19T16:55:00.603643+0000, chain.objs.size()=1 2024-09-19T15:31:38.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.436+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.464__shadow_.-TtlV6PNROh6bnahzmwkqv2pvI_11d7_0 2024-09-19T15:31:38.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.440+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13328926101068909824', time=2024-09-19T16:55:35.684013+0000, chain.objs.size()=1 2024-09-19T15:31:38.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.440+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.484__shadow_.u2zoiO57yvN0xRirnnJnyf1Ot6xQZUJ_0 2024-09-19T15:31:38.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.440+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16496492323183579261', time=2024-09-19T16:59:07.871339+0000, chain.objs.size()=3 2024-09-19T15:31:38.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.440+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.521__multipart_mymultipart.2~QWmb7ZqJLbk4ZELcmWjjIlmhTcrcZZn.1 2024-09-19T15:31:38.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.440+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.521__multipart_mymultipart.2~QWmb7ZqJLbk4ZELcmWjjIlmhTcrcZZn.2 2024-09-19T15:31:38.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.440+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.521__multipart_mymultipart.2~QWmb7ZqJLbk4ZELcmWjjIlmhTcrcZZn.3 2024-09-19T15:31:38.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.440+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13925345489848405766', time=2024-09-19T17:07:58.249843+0000, chain.objs.size()=1 2024-09-19T15:31:38.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.440+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:ZnsrcrwXDWEpJSc8thHC2ERN1IRrkFe_.Slegtx8-dPdOyj7S_8CcBnUCRl-sBn6_0 2024-09-19T15:31:38.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.440+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.317872211759868279', time=2024-09-19T17:08:07.625143+0000, chain.objs.size()=1 2024-09-19T15:31:38.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.440+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.570__shadow:ibwmrmYbBCC0eK5f3lPnHqg8pS3GfDs_.c3nM7tpf2VQzC5bQ0zmUrokFS7emnrI_0 2024-09-19T15:31:38.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.440+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3580452579215396324', time=2024-09-19T17:08:34.694200+0000, chain.objs.size()=1 2024-09-19T15:31:38.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.440+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.576__shadow:rTYfUn-zuswEt25ibGK4STI3opue9L3_.f9DGqfiQ91KOO3GSaah69j3Lk0aF1M8_0 2024-09-19T15:31:38.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.440+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13822300708580503633', time=2024-09-19T17:08:42.401027+0000, chain.objs.size()=1 2024-09-19T15:31:38.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.440+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.576__shadow:xDSSj-Z-rem5XH7BNLnPK3V.GjnYC7p_.651SOnS3TV5VHjzspe8DY9Pjx2X7M4y_0 2024-09-19T15:31:38.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.440+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10481734695399683448', time=2024-09-19T17:10:36.509854+0000, chain.objs.size()=1 2024-09-19T15:31:38.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.440+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.580__shadow:VGr3t5gpx74PQq3rgN4SSfKjuVTp2ny_.kzn6JVRO5EL0TOJ-c8jE-8QAM9bzvvM_0 2024-09-19T15:31:38.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.440+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7688850041404375409', time=2024-09-19T17:10:51.293960+0000, chain.objs.size()=1 2024-09-19T15:31:38.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.440+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.586__shadow:mWImS4npJ4YrnBfHELITiKEaXS9F3Va_.mzhFnQeWzSRIKvLB33pCayKh2iuIJa5_0 2024-09-19T15:31:38.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7831772493031609531', time=2024-09-19T17:10:56.164179+0000, chain.objs.size()=1 2024-09-19T15:31:38.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.587__shadow:aHRTP8E3sjRSyQQC-iS30RXbjKv9zPL_.Idvx0SGKhnQSzgHC0TLsiQll9hQPQCV_0 2024-09-19T15:31:38.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.963777069813481505', time=2024-09-19T17:10:56.406093+0000, chain.objs.size()=1 2024-09-19T15:31:38.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.587__shadow:5.1x9fAsPVl2L370Ou6OPqjRD4uqwr6_.IVTRoKewmVUpvPGH9yXZcNlB6_H3x6U_0 2024-09-19T15:31:38.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10219134489522431071', time=2024-09-19T17:16:28.299322+0000, chain.objs.size()=1 2024-09-19T15:31:38.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.619__shadow_.nSv31BlFVxNFb9WKhPNZQtmQRuS5Jbu_0 2024-09-19T15:31:38.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.486342975910400810', time=2024-09-19T17:19:07.916035+0000, chain.objs.size()=2 2024-09-19T15:31:38.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.648__shadow_.Gv5_9ygpUO7WImn9md-npiUnl6M3UNn_0 2024-09-19T15:31:38.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.648__shadow_.Gv5_9ygpUO7WImn9md-npiUnl6M3UNn_1 2024-09-19T15:31:38.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1439448055107029293', time=2024-09-19T17:20:47.014722+0000, chain.objs.size()=1 2024-09-19T15:31:38.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.666__shadow_.jIaz_FlQExbHpuHb9IFgCd-MfbKizZj_0 2024-09-19T15:31:38.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12592303756451022989', time=2024-09-19T17:20:51.265434+0000, chain.objs.size()=1 2024-09-19T15:31:38.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.668__shadow_.ajoODr_HS9ocv6wbvAcxVM9kkJpmNG8_0 2024-09-19T15:31:38.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.448+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17119526471063883376', time=2024-09-19T17:21:29.148978+0000, chain.objs.size()=1 2024-09-19T15:31:38.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.448+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.690__shadow:waawUJuwtO3LuBnMlZw8Nkjqtdhhu7q_.BPCRAm73gEN_1z7Icht2YinZDY_TZe2_0 2024-09-19T15:31:38.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.448+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4985111696069328107', time=2024-09-19T17:21:58.858098+0000, chain.objs.size()=1 2024-09-19T15:31:38.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.448+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.704__shadow:UXKipRDKgFq5PHFjiLlSFT1QhH3q1Ym_.g538hJcpRG0C5V03ric8TG49fjoglE1_0 2024-09-19T15:31:38.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.452+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:38.461 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.456+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T15:31:38.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:38.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:38.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44898' 2024-09-19T15:31:38.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6515520401364441458', time=2024-09-19T16:32:31.208681+0000, chain.objs.size()=2 2024-09-19T15:31:38.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.158__shadow_.n6-BKwMz8HQSWGozBrIhIQLLPDi7LxU_0 2024-09-19T15:31:38.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.158__shadow_.n6-BKwMz8HQSWGozBrIhIQLLPDi7LxU_1 2024-09-19T15:31:38.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='_0uVOZyKed3mORC-ykCto6irGec-cZzz', time=2024-09-19T16:34:11.871851+0000, chain.objs.size()=1 2024-09-19T15:31:38.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.165__shadow_.ZhkQTs28B7DxtU-zAUtAN3NeFpU5nKh_0 2024-09-19T15:31:38.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~3a1x-NmoIB4gwwevLCSnEXRjTIfb_vW', time=2024-09-19T16:35:59.690661+0000, chain.objs.size()=1 2024-09-19T15:31:38.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.202__multipart_mymultipart.2~3a1x-NmoIB4gwwevLCSnEXRjTIfb_vW.1 2024-09-19T15:31:38.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14658801179690607548', time=2024-09-19T16:40:12.050747+0000, chain.objs.size()=1 2024-09-19T15:31:38.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.248__shadow_.YPg0-dtMPfB_8xRM73zj9WPpvBKVTcL_0 2024-09-19T15:31:38.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13066900566312930665', time=2024-09-19T16:42:29.060140+0000, chain.objs.size()=1 2024-09-19T15:31:38.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.EFlad4rKRF6Gro5NPIujLqjXfpQRXk1_0 2024-09-19T15:31:38.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13635690965887572944', time=2024-09-19T16:42:30.340878+0000, chain.objs.size()=1 2024-09-19T15:31:38.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.SijCpjqjpcH3ExRkTNA9OIDXjYDuQrj_0 2024-09-19T15:31:38.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13314067249078632786', time=2024-09-19T16:42:32.692840+0000, chain.objs.size()=1 2024-09-19T15:31:38.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.yTu4faMeIneT6Cdsa27q_L2iZk870X0_0 2024-09-19T15:31:38.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17204319068302973843', time=2024-09-19T16:42:34.407486+0000, chain.objs.size()=1 2024-09-19T15:31:38.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.DkIKCkPDWVIX67nilC24pcQTY6YXE_4_0 2024-09-19T15:31:38.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14781174963991985488', time=2024-09-19T16:42:35.848753+0000, chain.objs.size()=1 2024-09-19T15:31:38.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.-f_zdlqvaCVgQDjt5SCjuDkkuU-ndYU_0 2024-09-19T15:31:38.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7004680994506866713', time=2024-09-19T16:42:37.531788+0000, chain.objs.size()=1 2024-09-19T15:31:38.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.uKUxXiT32LamtA_jZ3DulC_9J1wYFHu_0 2024-09-19T15:31:38.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12205702248693995344', time=2024-09-19T16:42:37.639313+0000, chain.objs.size()=1 2024-09-19T15:31:38.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Z__nadGA0ne4D6bF7spgS_AXcLyd-p5_0 2024-09-19T15:31:38.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.216622539005766013', time=2024-09-19T16:42:38.461058+0000, chain.objs.size()=1 2024-09-19T15:31:38.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.L-hN4b_7LrCj1Fcz0BIQrGmZlEE-PG5_0 2024-09-19T15:31:38.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16894523521994825077', time=2024-09-19T16:42:39.126782+0000, chain.objs.size()=1 2024-09-19T15:31:38.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ZOZBbHrWpv_wf-uQC11SZSI_l8DG3Ig_0 2024-09-19T15:31:38.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15883714725514960347', time=2024-09-19T16:42:42.718825+0000, chain.objs.size()=1 2024-09-19T15:31:38.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.fCqUUty1ohgffIKd9PJOy-dnhVAfgmc_0 2024-09-19T15:31:38.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10624091022957447292', time=2024-09-19T16:42:43.829212+0000, chain.objs.size()=1 2024-09-19T15:31:38.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.FbJdfWkBOrNsk5Isc7NvMsSAdP3mTbD_0 2024-09-19T15:31:38.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.468+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6469024982871205447', time=2024-09-19T16:42:43.937780+0000, chain.objs.size()=1 2024-09-19T15:31:38.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.CMhUFVBQOFSEatlDSOtaxe_AHhHrtt3_0 2024-09-19T15:31:38.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.468+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11094994675357591099', time=2024-09-19T16:42:45.187520+0000, chain.objs.size()=1 2024-09-19T15:31:38.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.jcSYtpxWQ53T93J1PccDMAh693taIgH_0 2024-09-19T15:31:38.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.468+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11491341005443308157', time=2024-09-19T16:42:45.322965+0000, chain.objs.size()=1 2024-09-19T15:31:38.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.p5IZ_dVf2nMw6elnv1cokKTqg_GRZvO_0 2024-09-19T15:31:38.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.468+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2826009068942185319', time=2024-09-19T16:42:46.285898+0000, chain.objs.size()=1 2024-09-19T15:31:38.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.2HNGRKl6_dCTca1bRJO9HhGdZqWyQkD_0 2024-09-19T15:31:38.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.468+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13782231794715796569', time=2024-09-19T16:42:49.269474+0000, chain.objs.size()=1 2024-09-19T15:31:38.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.xA0fyc2_AGxvaubFOr5lkw0YLcGHRI7_0 2024-09-19T15:31:38.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.468+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2124473160110184603', time=2024-09-19T16:42:49.665658+0000, chain.objs.size()=1 2024-09-19T15:31:38.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.l-bYjYNac3ITVx_6mVIraQINU9ZkRe2_0 2024-09-19T15:31:38.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.468+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5853435297784228563', time=2024-09-19T16:42:49.778685+0000, chain.objs.size()=1 2024-09-19T15:31:38.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ANMFihoMA9n79kl2a0Gc1A6DQjN90A1_0 2024-09-19T15:31:38.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.468+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16329054311328465731', time=2024-09-19T16:42:51.363036+0000, chain.objs.size()=1 2024-09-19T15:31:38.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.GpkVDasZE41o0XU6RpcqHpDN05AxtuS_0 2024-09-19T15:31:38.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.468+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14264280783340159106', time=2024-09-19T16:42:51.895968+0000, chain.objs.size()=1 2024-09-19T15:31:38.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.f9OSNmmXkxa3DP0g8CcvyT-wX13e-Qn_0 2024-09-19T15:31:38.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.472+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1933413996195911147', time=2024-09-19T16:42:52.299136+0000, chain.objs.size()=1 2024-09-19T15:31:38.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.MGD68pNZoDwo0bQ5MlKjwjNxM1YJsMt_0 2024-09-19T15:31:38.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.472+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7716985018223480378', time=2024-09-19T16:42:54.236573+0000, chain.objs.size()=1 2024-09-19T15:31:38.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.tJReRF1_78nkkZxLQsN_kSk6b-W61VK_0 2024-09-19T15:31:38.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.472+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3203392637164182548', time=2024-09-19T16:42:54.924709+0000, chain.objs.size()=1 2024-09-19T15:31:38.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.BTn6DgqzMGW7fKa3Ij6obzlVaiqpjLF_0 2024-09-19T15:31:38.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.472+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13116412200732584108', time=2024-09-19T16:42:55.632548+0000, chain.objs.size()=1 2024-09-19T15:31:38.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.zSs1SF2YROR99PUL_sywkrygJQvqPbX_0 2024-09-19T15:31:38.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.472+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3534559102951686178', time=2024-09-19T16:42:56.250563+0000, chain.objs.size()=1 2024-09-19T15:31:38.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.CDlQlqWwb397ZXvteYGLcUpK9pkResx_0 2024-09-19T15:31:38.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.472+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10220405103263042064', time=2024-09-19T16:42:56.253854+0000, chain.objs.size()=1 2024-09-19T15:31:38.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.bdXQQDSCd0J7Vi_ScOHUUQ4Y5zANBI6_0 2024-09-19T15:31:38.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.472+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10083312456083416797', time=2024-09-19T16:42:56.520797+0000, chain.objs.size()=1 2024-09-19T15:31:38.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.RNp_FeOeDP4MSlQqHSVTPx7QVKrAoFO_0 2024-09-19T15:31:38.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.472+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16218069400540178985', time=2024-09-19T16:42:57.405781+0000, chain.objs.size()=1 2024-09-19T15:31:38.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.WLrUQrqJeFTdd5E6WVFia6MeBenHlOn_0 2024-09-19T15:31:38.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.472+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18030130540592620169', time=2024-09-19T16:42:58.401065+0000, chain.objs.size()=1 2024-09-19T15:31:38.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.jbTvY2QQ_nIllj1i8x0Bv1s5Nytzjuc_0 2024-09-19T15:31:38.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.472+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16374050317087810417', time=2024-09-19T16:42:59.715901+0000, chain.objs.size()=1 2024-09-19T15:31:38.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.5iuedOljtN0YuH8oqp2_PZEadkQGoVv_0 2024-09-19T15:31:38.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.472+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4526866465762661798', time=2024-09-19T16:42:59.924018+0000, chain.objs.size()=1 2024-09-19T15:31:38.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.AF1u35D8amu9LldhD8nmudRIxidlvaH_0 2024-09-19T15:31:38.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.476+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14447076625358339195', time=2024-09-19T16:43:00.052849+0000, chain.objs.size()=1 2024-09-19T15:31:38.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.476+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.5-t0BsqcO0JPF_XYFWaD-YJ1IW9unQT_0 2024-09-19T15:31:38.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.476+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11517108128935279995', time=2024-09-19T16:43:15.612067+0000, chain.objs.size()=1 2024-09-19T15:31:38.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.476+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.269__shadow_.NlWhIyfY7Ty_w8DdMXE64zWVo-vaH95_0 2024-09-19T15:31:38.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.476+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11292058153901301902', time=2024-09-19T16:43:15.629225+0000, chain.objs.size()=1 2024-09-19T15:31:38.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.476+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.269__shadow_.NKr2oOOO5Gx8AhNU_t4oMxj7RQqTrV6_0 2024-09-19T15:31:38.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.476+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12731474567736656693', time=2024-09-19T16:43:26.665575+0000, chain.objs.size()=1 2024-09-19T15:31:38.482 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.476+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.274__shadow_.-4Zh8ZrLiUFSG13_o65kejlQ8Y0AG50_0 2024-09-19T15:31:38.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.476+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6288352359518537735', time=2024-09-19T16:43:40.536732+0000, chain.objs.size()=1 2024-09-19T15:31:38.483 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.476+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.280__shadow_.p8KZwNQgZ6b99JmlhDqqusowpkOEOSB_0 2024-09-19T15:31:38.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.480+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4107596730137503109', time=2024-09-19T16:44:18.359039+0000, chain.objs.size()=1 2024-09-19T15:31:38.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.480+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.O6Sp0CAB1mcMHSa1ilGGVpOVwq5ka42_0 2024-09-19T15:31:38.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.480+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11558667893449555467', time=2024-09-19T16:44:18.361314+0000, chain.objs.size()=1 2024-09-19T15:31:38.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.480+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.M0swELQTXTswqGlm605CM0zAm1-rtIU_0 2024-09-19T15:31:38.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.480+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15277893431574144551', time=2024-09-19T16:44:23.286161+0000, chain.objs.size()=1 2024-09-19T15:31:38.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.480+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.295__shadow_.ma21OTnu1pRrOjJCRs5aq1mjOj5x1Rb_0 2024-09-19T15:31:38.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.480+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2522759862082843806', time=2024-09-19T16:44:40.043706+0000, chain.objs.size()=1 2024-09-19T15:31:38.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.480+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.302__shadow_.8dmmWV6QVL70HYmWKUhssseXLNVTtWV_0 2024-09-19T15:31:38.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.480+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10126315710272287021', time=2024-09-19T16:44:49.869308+0000, chain.objs.size()=1 2024-09-19T15:31:38.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.480+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.306__shadow_.72E-jihYarU0ohiq5hOhrts7l_S1_9r_0 2024-09-19T15:31:38.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.480+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13802016598277970686', time=2024-09-19T16:47:18.490794+0000, chain.objs.size()=1 2024-09-19T15:31:38.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.480+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.4WfDTWQQ34zcBMTlsnhbQ1DM9otJYUk_0 2024-09-19T15:31:38.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.480+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2931707370489963195', time=2024-09-19T16:47:18.500233+0000, chain.objs.size()=1 2024-09-19T15:31:38.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.480+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.-U_8tRpeagOurasgMdwRyuPOLL_uH-I_0 2024-09-19T15:31:38.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.480+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4485390651336095002', time=2024-09-19T16:47:19.715520+0000, chain.objs.size()=1 2024-09-19T15:31:38.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.480+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.z-lnTbCInt-2UpdPQiodVmAsG_dkFzb_0 2024-09-19T15:31:38.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.480+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9576893239324365240', time=2024-09-19T16:47:20.124896+0000, chain.objs.size()=1 2024-09-19T15:31:38.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.480+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.se4q1Q5rHGgQ_V7DI0ULFxIIQhtz8nI_0 2024-09-19T15:31:38.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.480+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3831819598919881842', time=2024-09-19T16:47:20.149041+0000, chain.objs.size()=1 2024-09-19T15:31:38.487 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.480+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.lx6nX1rRaXYRHJ8GQZAUZwN4EyCsY9X_0 2024-09-19T15:31:38.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.484+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4926975474342358113', time=2024-09-19T16:47:23.698185+0000, chain.objs.size()=1 2024-09-19T15:31:38.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ka23kz1fCDKvMysRqMT-Di5-kUWNKPB_0 2024-09-19T15:31:38.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.484+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12339607807631125263', time=2024-09-19T16:47:24.915280+0000, chain.objs.size()=1 2024-09-19T15:31:38.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.tpWk0vJKnJiW0-CyH7n419tzElt56FF_0 2024-09-19T15:31:38.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.484+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14361417215331350296', time=2024-09-19T16:47:26.690396+0000, chain.objs.size()=1 2024-09-19T15:31:38.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.1AQA2yngAdWkI1AsDSStBElyrboOsx6_0 2024-09-19T15:31:38.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.484+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11834702361793976983', time=2024-09-19T16:47:26.749971+0000, chain.objs.size()=1 2024-09-19T15:31:38.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.m7gOp36RomXjpMgQRc8IHMcBW1WkQCq_0 2024-09-19T15:31:38.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.484+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9422962184974272158', time=2024-09-19T16:47:26.832815+0000, chain.objs.size()=1 2024-09-19T15:31:38.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.r9qeIcODpjqNEEqzKpf7SQqzp287DyX_0 2024-09-19T15:31:38.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.484+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11168055026646124778', time=2024-09-19T16:47:27.199834+0000, chain.objs.size()=1 2024-09-19T15:31:38.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.FbOnayknSKnBiMBoMIzc_4cRQlx9sGK_0 2024-09-19T15:31:38.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.484+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1852109345570279969', time=2024-09-19T16:47:27.201719+0000, chain.objs.size()=1 2024-09-19T15:31:38.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.7ubmrFfvtkuk5AKhQAFffNRsBtqFDR8_0 2024-09-19T15:31:38.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.484+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4282837833066610770', time=2024-09-19T16:47:28.040210+0000, chain.objs.size()=1 2024-09-19T15:31:38.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.dlTLflkuy943FEKangJK_0y8N-uVb_g_0 2024-09-19T15:31:38.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.484+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.499034224695802867', time=2024-09-19T16:47:28.286000+0000, chain.objs.size()=1 2024-09-19T15:31:38.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.UoGXxB18YY9vzgxPj4WQHriqpJlpWl6_0 2024-09-19T15:31:38.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.484+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18043392987991062943', time=2024-09-19T16:47:28.679828+0000, chain.objs.size()=1 2024-09-19T15:31:38.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.k5aBrAZPSIQz0tGONb6bZ6reUlSfae0_0 2024-09-19T15:31:38.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.484+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14343549605683712289', time=2024-09-19T16:47:29.696011+0000, chain.objs.size()=1 2024-09-19T15:31:38.492 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_._0zdukwl7azASyMQByWt6AhidiCVvs1_0 2024-09-19T15:31:38.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.488+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13148361595774048850', time=2024-09-19T16:47:31.091872+0000, chain.objs.size()=1 2024-09-19T15:31:38.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.488+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.alhkgb00ArEiHx4WgIa3u30ByGpQLeF_0 2024-09-19T15:31:38.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.492+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8977367330076885957', time=2024-09-19T16:47:31.467892+0000, chain.objs.size()=1 2024-09-19T15:31:38.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.492+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.3CIybYVBcgUFgjudOIhV9olHw6IBTb9_0 2024-09-19T15:31:38.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.492+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4380125262257170555', time=2024-09-19T16:47:31.972702+0000, chain.objs.size()=1 2024-09-19T15:31:38.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.492+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.f-MxRhJBSQnhgcIoVJY-JfsyKDHS3Zv_0 2024-09-19T15:31:38.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.492+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9727906665198820408', time=2024-09-19T16:47:32.920422+0000, chain.objs.size()=1 2024-09-19T15:31:38.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.492+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.sVKobfZmbIF3fRMwvyhlUmNT6yidhkX_0 2024-09-19T15:31:38.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.492+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3715145620126190402', time=2024-09-19T16:47:33.409128+0000, chain.objs.size()=1 2024-09-19T15:31:38.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.492+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.KQU4qXUEhxyJJKIJvZR4yz2AHhIxmmW_0 2024-09-19T15:31:38.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.492+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4567107969943792372', time=2024-09-19T16:47:35.499140+0000, chain.objs.size()=1 2024-09-19T15:31:38.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.492+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.aleCUPntg0HGwgV8USc0-j7ugGPfrEY_0 2024-09-19T15:31:38.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.492+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16185280962039190360', time=2024-09-19T16:47:35.893897+0000, chain.objs.size()=1 2024-09-19T15:31:38.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.492+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.uCO50UcBOMo3rowzA7zCGd8I-CR6Fq5_0 2024-09-19T15:31:38.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.492+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4051505753482080709', time=2024-09-19T16:47:36.029054+0000, chain.objs.size()=1 2024-09-19T15:31:38.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.492+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.0t7_JIh2j9zT6nNvMCizelsd3wgLo5u_0 2024-09-19T15:31:38.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.492+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17516943701643066527', time=2024-09-19T16:47:37.170385+0000, chain.objs.size()=1 2024-09-19T15:31:38.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.492+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.HlRQRZa94LReY_2bbSNIEWRBjYd_Eh-_0 2024-09-19T15:31:38.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.492+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8872692692602593180', time=2024-09-19T16:47:37.172397+0000, chain.objs.size()=1 2024-09-19T15:31:38.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.492+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.4etd1fGkzuEN14cM8VEnkhZUKsfJDs3_0 2024-09-19T15:31:38.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.492+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11080848585210199732', time=2024-09-19T16:47:37.594866+0000, chain.objs.size()=1 2024-09-19T15:31:38.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.492+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.3rG7S4wgb8UG1pmjw-i3h0EdhsIJZ_i_0 2024-09-19T15:31:38.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.492+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1762630629609900269', time=2024-09-19T16:47:40.618297+0000, chain.objs.size()=1 2024-09-19T15:31:38.498 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.492+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ycAxyIho7V2Sd58tSWV5Q9cUcDl9tRY_0 2024-09-19T15:31:38.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.496+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11302913852444390003', time=2024-09-19T16:47:41.348514+0000, chain.objs.size()=1 2024-09-19T15:31:38.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.496+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.jrrjAZ1Jka24LfwDdG9VwzZ_M27Vhvk_0 2024-09-19T15:31:38.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.496+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.725103530147368711', time=2024-09-19T16:47:44.192432+0000, chain.objs.size()=1 2024-09-19T15:31:38.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.496+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.YE22Ll8l6MW3dgf1_QVw8P7iTLNn2iU_0 2024-09-19T15:31:38.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.496+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3528721694204973250', time=2024-09-19T16:47:45.054437+0000, chain.objs.size()=1 2024-09-19T15:31:38.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.496+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.tmZ-UaxtGSxsHE-QLfiL2ewWocYc4T8_0 2024-09-19T15:31:38.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.496+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11230783218527024032', time=2024-09-19T16:47:45.158419+0000, chain.objs.size()=1 2024-09-19T15:31:38.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.496+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.fTDxDA8FSFw4leLnGfcJfeqLJnNgAMO_0 2024-09-19T15:31:38.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.496+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10126621321061770257', time=2024-09-19T16:47:46.363137+0000, chain.objs.size()=1 2024-09-19T15:31:38.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.496+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.oqIbbeQlYOiwCfdL950UDHOB5r_WgFu_0 2024-09-19T15:31:38.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.496+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8689958138099858064', time=2024-09-19T16:47:47.762454+0000, chain.objs.size()=1 2024-09-19T15:31:38.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.496+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.c54Fkf03w4Xn2urfaR_CtkgEo7tTyou_0 2024-09-19T15:31:38.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.496+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6460577349601232902', time=2024-09-19T16:47:48.269096+0000, chain.objs.size()=1 2024-09-19T15:31:38.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.496+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.0llWwtOb3TEi1Pee6HK4z3LEWxH0ne5_0 2024-09-19T15:31:38.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.496+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12039811431457852389', time=2024-09-19T16:47:49.774361+0000, chain.objs.size()=1 2024-09-19T15:31:38.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.496+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.boyYenZfz608qQ4F9IGifNWKZRRlwG3_0 2024-09-19T15:31:38.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.496+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13719220006072540976', time=2024-09-19T16:47:50.011200+0000, chain.objs.size()=1 2024-09-19T15:31:38.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.496+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.hayABBik73apTC3nWrb0sJJpOKiygXD_0 2024-09-19T15:31:38.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.496+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3019881086932478466', time=2024-09-19T16:49:38.105743+0000, chain.objs.size()=1 2024-09-19T15:31:38.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.496+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.utdMCaLXesxor_8Cx6295w8AxeXmgfq_0 2024-09-19T15:31:38.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.496+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14990570283497767009', time=2024-09-19T16:49:39.549247+0000, chain.objs.size()=1 2024-09-19T15:31:38.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.496+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.rvZuzmayuZuR6-Pmrf5CH8rBO5Fh06n_0 2024-09-19T15:31:38.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.500+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7887994729209737003', time=2024-09-19T16:49:40.552143+0000, chain.objs.size()=1 2024-09-19T15:31:38.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.500+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.jhnADx_sLnLGXt6TVsMpXhu4pBWyfkx_0 2024-09-19T15:31:38.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.500+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7572966843145043936', time=2024-09-19T16:49:42.387871+0000, chain.objs.size()=1 2024-09-19T15:31:38.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.500+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.vqPN6amBkm9nFI3NR7eTRVGXLjywH-z_0 2024-09-19T15:31:38.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.500+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11336291586544736776', time=2024-09-19T16:49:45.039115+0000, chain.objs.size()=1 2024-09-19T15:31:38.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.500+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.-v8fp29Zx9eFkw2jJcYs1Lvko8NXOfB_0 2024-09-19T15:31:38.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.500+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7467411223674863833', time=2024-09-19T16:49:45.348066+0000, chain.objs.size()=1 2024-09-19T15:31:38.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.500+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.jwTUKRy5XSfLG-zAsGjHuSJe8vdRjQB_0 2024-09-19T15:31:38.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.500+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11416600320950219262', time=2024-09-19T16:49:46.099037+0000, chain.objs.size()=1 2024-09-19T15:31:38.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.500+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.fowzoZ-ZrHnplG7vW4yfXeo52SPXZJe_0 2024-09-19T15:31:38.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12286917161718180205', time=2024-09-19T16:49:46.737645+0000, chain.objs.size()=1 2024-09-19T15:31:38.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.IMeLSf33E7_aL7-y6ws69YGXH_HT6Oa_0 2024-09-19T15:31:38.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5126996756800181554', time=2024-09-19T16:49:48.295585+0000, chain.objs.size()=1 2024-09-19T15:31:38.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.tqQesEHfeG7_r8r9IxAgOzlPSSWvZ1a_0 2024-09-19T15:31:38.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10546670829133966835', time=2024-09-19T16:49:50.650783+0000, chain.objs.size()=1 2024-09-19T15:31:38.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.S3DUiHcdGfAvivuD9ys3SAwY3CZQCcy_0 2024-09-19T15:31:38.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10460917047199570851', time=2024-09-19T16:49:54.029175+0000, chain.objs.size()=1 2024-09-19T15:31:38.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.4LVW9Te5GcAnxAMncyOJLX1iTw6JDxT_0 2024-09-19T15:31:38.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9332438705748439828', time=2024-09-19T16:49:54.379092+0000, chain.objs.size()=1 2024-09-19T15:31:38.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.x-vikxBgbTiv8-W6yWI1SfGbB-zNSe9_0 2024-09-19T15:31:38.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4979003691528018108', time=2024-09-19T16:49:58.075883+0000, chain.objs.size()=1 2024-09-19T15:31:38.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.C5Z2LatYKHj_QigFLjqEXbNzqpdcjqv_0 2024-09-19T15:31:38.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2261705192954212288', time=2024-09-19T16:49:58.077928+0000, chain.objs.size()=1 2024-09-19T15:31:38.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.xG4N_lijy_2MJ4RUzMIIKz-pR-idPV2_0 2024-09-19T15:31:38.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14246907152484239230', time=2024-09-19T16:49:58.189022+0000, chain.objs.size()=1 2024-09-19T15:31:38.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.tV9rCeSSJzpM7D1Z-ztrxZKTsZi7TcP_0 2024-09-19T15:31:38.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.508+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15540433054316100539', time=2024-09-19T16:49:58.445923+0000, chain.objs.size()=1 2024-09-19T15:31:38.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.508+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.r5k7AHrW14eIF41iRntBflqtSNDzK2H_0 2024-09-19T15:31:38.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.508+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3546486202355845921', time=2024-09-19T16:49:58.916183+0000, chain.objs.size()=1 2024-09-19T15:31:38.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.508+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.GnELdvbGzJZ2MxzCfDDuy96QJVrnH6F_0 2024-09-19T15:31:38.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.508+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.839274560655429696', time=2024-09-19T16:50:00.451363+0000, chain.objs.size()=1 2024-09-19T15:31:38.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.508+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.vEE7hfH2MUIPOBRDQ9MiaodlU-j1XJx_0 2024-09-19T15:31:38.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44898 2024-09-19T15:31:38.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-19T15:31:38.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7065969944469084055', time=2024-09-19T16:50:02.307084+0000, chain.objs.size()=1 2024-09-19T15:31:38.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.l0Nao6L0FVRB2J0CmF6KsPNmZIZCE6L_0 2024-09-19T15:31:38.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7204783843326896000', time=2024-09-19T16:50:06.480585+0000, chain.objs.size()=1 2024-09-19T15:31:38.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ohh1KUj7tUJrTLSa_eiMkMnGc_v5Hpp_0 2024-09-19T15:31:38.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15287414439258121851', time=2024-09-19T16:50:06.482639+0000, chain.objs.size()=1 2024-09-19T15:31:38.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.dluxTgoB8pWOAhUZm6p2lXr83MjR58r_0 2024-09-19T15:31:38.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3483690518830709783', time=2024-09-19T16:55:32.891079+0000, chain.objs.size()=1 2024-09-19T15:31:38.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.483__shadow_.mSv1tVAPg72pgQ5UC4ONmpPb0CAiD-8_0 2024-09-19T15:31:38.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13749182061244672816', time=2024-09-19T16:55:35.696088+0000, chain.objs.size()=1 2024-09-19T15:31:38.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.484__shadow_.1VAhOPC6X_TuXNHqZCyqW2PCsEUu2pN_0 2024-09-19T15:31:38.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10000588546030835678', time=2024-09-19T16:56:05.153885+0000, chain.objs.size()=1 2024-09-19T15:31:38.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.496__shadow_.ihPBH__OsaWgmhU7lpiXoObXeOS75vM_0 2024-09-19T15:31:38.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14763164622874222483', time=2024-09-19T16:56:05.790989+0000, chain.objs.size()=1 2024-09-19T15:31:38.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.496__shadow_.ihPBH__OsaWgmhU7lpiXoObXeOS75vM_0 2024-09-19T15:31:38.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8333127502139599869', time=2024-09-19T16:57:07.786537+0000, chain.objs.size()=6 2024-09-19T15:31:38.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.1 2024-09-19T15:31:38.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.2 2024-09-19T15:31:38.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.3 2024-09-19T15:31:38.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.4 2024-09-19T15:31:38.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.5 2024-09-19T15:31:38.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.520+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.6 2024-09-19T15:31:38.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.520+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3767695370681914583', time=2024-09-19T16:57:36.577645+0000, chain.objs.size()=1 2024-09-19T15:31:38.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.520+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.518__multipart_mymultipart.2~RzWAOq6Bl4KAyIN_nvg5OYFIWIzga5U.1 2024-09-19T15:31:38.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.520+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9049527367570454404', time=2024-09-19T16:59:14.278008+0000, chain.objs.size()=3 2024-09-19T15:31:38.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.520+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.520__shadow:p.pA4bdA-DATpDHqmO04uvUOldUJUk1_.sV144kLVRnvGJwIYzgL3u7CZptvZEXe_0 2024-09-19T15:31:38.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.520+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.520__shadow:p.pA4bdA-DATpDHqmO04uvUOldUJUk1_.sV144kLVRnvGJwIYzgL3u7CZptvZEXe_1 2024-09-19T15:31:38.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.520+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.520__shadow:p.pA4bdA-DATpDHqmO04uvUOldUJUk1_.sV144kLVRnvGJwIYzgL3u7CZptvZEXe_2 2024-09-19T15:31:38.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.520+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17499036880784657193', time=2024-09-19T17:07:18.925005+0000, chain.objs.size()=1 2024-09-19T15:31:38.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.520+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.562__shadow_.ZVvXFnEgyQtVBrEqpUzxdsPhdsxW0B1_0 2024-09-19T15:31:38.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.520+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4137392540857050054', time=2024-09-19T17:08:13.015982+0000, chain.objs.size()=1 2024-09-19T15:31:38.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.520+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.572__shadow:cXBpQFCAQfQ.00-9qFHe1CWkOD3rnTh_.d9CHPULuh1DgYJSY_cCuVkyM-Mewq6A_0 2024-09-19T15:31:38.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.520+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.347704920832198670', time=2024-09-19T17:08:27.531177+0000, chain.objs.size()=1 2024-09-19T15:31:38.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.520+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.574__shadow:-QZx82I6VEH4uWFsonWE-y9WevgG9HQ_.yIh0PMkcRkkLd7byH8AH3MOiGjnyxBe_0 2024-09-19T15:31:38.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.520+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15649174973896092933', time=2024-09-19T17:10:35.683406+0000, chain.objs.size()=1 2024-09-19T15:31:38.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.520+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.580__shadow:XdUISp7PpZQqiYQfjwQ9PbR3ZNzvxbp_.WxiQilZ-crESV_z27FPP5RO7Xcaowx__0 2024-09-19T15:31:38.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.520+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.975188900106432075', time=2024-09-19T17:20:43.640973+0000, chain.objs.size()=1 2024-09-19T15:31:38.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.520+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.665__shadow_.LJpHwjTNC4FMuyulAxPX9QwHZoPe6HR_0 2024-09-19T15:31:38.527 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.520+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3321790775351690834', time=2024-09-19T17:25:56.672867+0000, chain.objs.size()=1 2024-09-19T15:31:38.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.520+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.752__shadow_.qAcK6j35tKOOBFR5dnKvuK8unU-4c0E_0 2024-09-19T15:31:38.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.524+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7899025032424673528', time=2024-09-19T17:29:40.973181+0000, chain.objs.size()=3 2024-09-19T15:31:38.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.524+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.779__shadow_.EQbHahzTD_cTq-mQUr8ehBaOHxKCgQF_0 2024-09-19T15:31:38.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.524+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.779__shadow_.EQbHahzTD_cTq-mQUr8ehBaOHxKCgQF_1 2024-09-19T15:31:38.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.524+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.779__shadow_.EQbHahzTD_cTq-mQUr8ehBaOHxKCgQF_2 2024-09-19T15:31:38.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.532+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:38.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T15:31:38.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:38.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:38.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47892' 2024-09-19T15:31:38.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6530232319226223783', time=2024-09-19T16:34:56.554389+0000, chain.objs.size()=1 2024-09-19T15:31:38.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.182__shadow_.Bf1jqSLu40qvr9uikpvIpuX99yIgIed_0 2024-09-19T15:31:38.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2019386303481420311', time=2024-09-19T16:42:28.127320+0000, chain.objs.size()=1 2024-09-19T15:31:38.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.9ItpbLwO-09CYpEQq4xLx0kRCNdGMoU_0 2024-09-19T15:31:38.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10097963110052275938', time=2024-09-19T16:42:29.211243+0000, chain.objs.size()=1 2024-09-19T15:31:38.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.-4d2uPsBTRM42Z7bfHdha7glf-ilNzx_0 2024-09-19T15:31:38.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8697835779652061284', time=2024-09-19T16:42:29.690934+0000, chain.objs.size()=1 2024-09-19T15:31:38.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.h8J5-Rcx3H7xZqs2pZW1GdUiyno-6fv_0 2024-09-19T15:31:38.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1884180832454999120', time=2024-09-19T16:42:30.771339+0000, chain.objs.size()=1 2024-09-19T15:31:38.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.XnzwGW2PGEVqq9dcMlkeRqiSXpA7cwc_0 2024-09-19T15:31:38.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17064898114017057440', time=2024-09-19T16:42:31.061988+0000, chain.objs.size()=1 2024-09-19T15:31:38.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.fbW8wBsLzq-yPfr42YtGRXRdcQvSc8c_0 2024-09-19T15:31:38.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7987663515210261577', time=2024-09-19T16:42:35.734974+0000, chain.objs.size()=1 2024-09-19T15:31:38.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.YC1vGQvo3zIGBSRQAbC4Xz3wLd3p8K__0 2024-09-19T15:31:38.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7774469935275528655', time=2024-09-19T16:42:35.775743+0000, chain.objs.size()=1 2024-09-19T15:31:38.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ow2LQGe7Vji-xcF_h4e6K_3ocPoBK9Z_0 2024-09-19T15:31:38.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5429442502134988135', time=2024-09-19T16:42:37.297759+0000, chain.objs.size()=1 2024-09-19T15:31:38.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.2BWJdrjmoAcKikxfopDJfgAweuM8liv_0 2024-09-19T15:31:38.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7397014264725805145', time=2024-09-19T16:42:38.731002+0000, chain.objs.size()=1 2024-09-19T15:31:38.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.6cQEg7KOlv0u_GpuDTWviPzHGkG-XlK_0 2024-09-19T15:31:38.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7198865579040610363', time=2024-09-19T16:42:39.656352+0000, chain.objs.size()=1 2024-09-19T15:31:38.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.AFXa5EFNYq15AFm83azi8XA3ySK4qCk_0 2024-09-19T15:31:38.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10038052597680914266', time=2024-09-19T16:42:42.639132+0000, chain.objs.size()=1 2024-09-19T15:31:38.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Q0L3vry4X7VCmmXCHa5CWTBUwOZpRdV_0 2024-09-19T15:31:38.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.540+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7391175627608833101', time=2024-09-19T16:42:44.212913+0000, chain.objs.size()=1 2024-09-19T15:31:38.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.540+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.jFXBIdCIRdk8k87NOzsxPclPndKzmwj_0 2024-09-19T15:31:38.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.540+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12347246194010359300', time=2024-09-19T16:42:45.542757+0000, chain.objs.size()=1 2024-09-19T15:31:38.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.540+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.SCMSkk2Hy5CFw1e9HD8nabnv6gdMSmr_0 2024-09-19T15:31:38.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.540+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13586287299200694529', time=2024-09-19T16:42:50.849434+0000, chain.objs.size()=1 2024-09-19T15:31:38.546 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.540+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.AuGthuS059C8PAuIqkxJLlyAg_hVxda_0 2024-09-19T15:31:38.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.544+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1038358557950489057', time=2024-09-19T16:42:51.344007+0000, chain.objs.size()=1 2024-09-19T15:31:38.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.544+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.fYK0ckC9iblZBw2gpaBLN8cn1xoJsYI_0 2024-09-19T15:31:38.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.544+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6804309315137595915', time=2024-09-19T16:42:52.227872+0000, chain.objs.size()=1 2024-09-19T15:31:38.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.544+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.mjj9KPzyFKyaSMvZaDHF_kJokY-5hYE_0 2024-09-19T15:31:38.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.544+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13847152163649288096', time=2024-09-19T16:42:53.347559+0000, chain.objs.size()=1 2024-09-19T15:31:38.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.544+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.QPKmtGVkTnBXl3pSUsTpDWKmvZEj_3S_0 2024-09-19T15:31:38.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.544+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9934363229119524207', time=2024-09-19T16:42:53.384459+0000, chain.objs.size()=1 2024-09-19T15:31:38.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.544+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Z46a37im8boWxIToknpRZ2ZM4AY6X6E_0 2024-09-19T15:31:38.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.544+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10773394568168614417', time=2024-09-19T16:42:53.442362+0000, chain.objs.size()=1 2024-09-19T15:31:38.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.544+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.c8ljc2aIqKEWk1FqrkPcupv1wDj9gAe_0 2024-09-19T15:31:38.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.544+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5380916924760886855', time=2024-09-19T16:42:54.204639+0000, chain.objs.size()=1 2024-09-19T15:31:38.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.544+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Wjjp1bJbKKopr5Ua173B0xijCdtmDrx_0 2024-09-19T15:31:38.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.544+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8123513781837731442', time=2024-09-19T16:42:57.792474+0000, chain.objs.size()=1 2024-09-19T15:31:38.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.544+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.5hG4S6SuCc0LG3zByypVE8fi1t79uZo_0 2024-09-19T15:31:38.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.544+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6711962384687018637', time=2024-09-19T16:42:58.363720+0000, chain.objs.size()=1 2024-09-19T15:31:38.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.544+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.dGrCSazd24BkNloyEq-tHng0xMv7nrT_0 2024-09-19T15:31:38.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.544+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11793050276235227041', time=2024-09-19T16:43:13.431422+0000, chain.objs.size()=1 2024-09-19T15:31:38.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.544+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.268__shadow_.G1lQUQc_UMQMSn4uVlMrcNFgY0m3_IN_0 2024-09-19T15:31:38.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.544+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2992147673370614032', time=2024-09-19T16:43:31.257793+0000, chain.objs.size()=1 2024-09-19T15:31:38.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.544+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.276__shadow_.nDh5fT-yuZPSTBQz4YXeJUzlQgOGJVU_0 2024-09-19T15:31:38.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8305645178625717907', time=2024-09-19T16:43:40.531437+0000, chain.objs.size()=1 2024-09-19T15:31:38.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.280__shadow_.0SjwJ2lItsRO8djPvN9mCKmTRrhmUa5_0 2024-09-19T15:31:38.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5594646428466202710', time=2024-09-19T16:43:47.513160+0000, chain.objs.size()=1 2024-09-19T15:31:38.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.283__shadow_.vmp5k6q7TRhH5ys7-B9BvbvFQpTAZMD_0 2024-09-19T15:31:38.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7663295844729835780', time=2024-09-19T16:44:12.735105+0000, chain.objs.size()=1 2024-09-19T15:31:38.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_.dcJ7Tt__3fe0udwGkXRH8H7tIBgknaS_0 2024-09-19T15:31:38.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1214417933714739185', time=2024-09-19T16:47:17.895044+0000, chain.objs.size()=1 2024-09-19T15:31:38.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.9vfu6HN2T6p_07bwrtWhElCd-xQQcuM_0 2024-09-19T15:31:38.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9140669784344380835', time=2024-09-19T16:47:18.450118+0000, chain.objs.size()=1 2024-09-19T15:31:38.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.0UQxoeaFDM_n-rymsUN-PnwChY79-ZH_0 2024-09-19T15:31:38.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13751138923787576742', time=2024-09-19T16:47:19.006376+0000, chain.objs.size()=1 2024-09-19T15:31:38.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.drxhhWozJoJCk5N14_8p2vfPdXdp0sc_0 2024-09-19T15:31:38.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4935337675749309412', time=2024-09-19T16:47:19.662975+0000, chain.objs.size()=1 2024-09-19T15:31:38.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Q5kguNCGZnmhk0dffvx467URwl6cnmQ_0 2024-09-19T15:31:38.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1590344775069366176', time=2024-09-19T16:47:19.866504+0000, chain.objs.size()=1 2024-09-19T15:31:38.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.wHFWvm2K7vgyIZ4wteC7cff3enWtNHO_0 2024-09-19T15:31:38.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14755999972947453405', time=2024-09-19T16:47:21.052612+0000, chain.objs.size()=1 2024-09-19T15:31:38.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.5U85dtdqH9-0WAugyDRJeJHI22L-ti3_0 2024-09-19T15:31:38.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12789902946162771878', time=2024-09-19T16:47:25.319666+0000, chain.objs.size()=1 2024-09-19T15:31:38.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.IqCqpXf9CeyExxYChw-BAz9HHNdIKSf_0 2024-09-19T15:31:38.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9968852578174408694', time=2024-09-19T16:47:25.627201+0000, chain.objs.size()=1 2024-09-19T15:31:38.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.uuO3AnJOKgqZQQEbMj5XIWG9fXIas9a_0 2024-09-19T15:31:38.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5466843788789310086', time=2024-09-19T16:47:27.792575+0000, chain.objs.size()=1 2024-09-19T15:31:38.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.scKYOeEqXDXsczxtYc2c0Fg4wUwn2Hd_0 2024-09-19T15:31:38.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12052097966602866166', time=2024-09-19T16:47:31.107486+0000, chain.objs.size()=1 2024-09-19T15:31:38.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.6D7BYZF0ZR8xiwDjEqR4YKn8LX1kJ8Z_0 2024-09-19T15:31:38.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6144249368909710058', time=2024-09-19T16:47:31.111042+0000, chain.objs.size()=1 2024-09-19T15:31:38.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.P9Aj3_dXVMi9tiE9BQm85tkJNFSwUtN_0 2024-09-19T15:31:38.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14671704184905694929', time=2024-09-19T16:47:31.478457+0000, chain.objs.size()=1 2024-09-19T15:31:38.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.VzONxjaTzMlJzi18uCo_A3rZlutVAMg_0 2024-09-19T15:31:38.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10408052148804851661', time=2024-09-19T16:47:32.807377+0000, chain.objs.size()=1 2024-09-19T15:31:38.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.JMOtcQU7LPX5ynik3A144gdtUk87Z16_0 2024-09-19T15:31:38.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1084931750320114110', time=2024-09-19T16:47:34.371850+0000, chain.objs.size()=1 2024-09-19T15:31:38.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.kUL7tWyxcUhxlflyDejTceMqUwSr4t6_0 2024-09-19T15:31:38.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11311188120150292311', time=2024-09-19T16:47:35.231729+0000, chain.objs.size()=1 2024-09-19T15:31:38.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.09PO2L6tkyNoQy5-lWyjyVl8BPILrcL_0 2024-09-19T15:31:38.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7337751146431040277', time=2024-09-19T16:47:36.217916+0000, chain.objs.size()=1 2024-09-19T15:31:38.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ECK_fe_Wea0XvszcwVRgy7raA67dgIc_0 2024-09-19T15:31:38.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1531560942368236819', time=2024-09-19T16:47:38.151758+0000, chain.objs.size()=1 2024-09-19T15:31:38.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.JWYoQ8LbWPIAim-yBqF3roEsi75SU7A_0 2024-09-19T15:31:38.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14049702469343242318', time=2024-09-19T16:47:38.522657+0000, chain.objs.size()=1 2024-09-19T15:31:38.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.uFBv0OgaGjWLAGbZcP2MGCyUgr9LtK7_0 2024-09-19T15:31:38.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9654422970703451868', time=2024-09-19T16:47:39.577018+0000, chain.objs.size()=1 2024-09-19T15:31:38.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Ey03H6m7ai3zkKrmz0Xsk9a_DJ8nDSY_0 2024-09-19T15:31:38.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10333059575393611778', time=2024-09-19T16:47:40.126595+0000, chain.objs.size()=1 2024-09-19T15:31:38.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.o5ZzlZ2hTdXv18O4w6uFMcWfzDMHWs6_0 2024-09-19T15:31:38.562 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4955047456383157974', time=2024-09-19T16:47:40.450643+0000, chain.objs.size()=1 2024-09-19T15:31:38.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.0SrOapTPQsFTGIAJThFIQ9GI9JSyckb_0 2024-09-19T15:31:38.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1282030550951292663', time=2024-09-19T16:47:40.621102+0000, chain.objs.size()=1 2024-09-19T15:31:38.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.xCK4AdlKTjlgfO7y1RdZ5W9cTUmVbPY_0 2024-09-19T15:31:38.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10761353112217831971', time=2024-09-19T16:47:40.938863+0000, chain.objs.size()=1 2024-09-19T15:31:38.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.5R6tXvMXaLF5k5GIN3S7YmiGmaUioM7_0 2024-09-19T15:31:38.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13402728884066604628', time=2024-09-19T16:47:41.526610+0000, chain.objs.size()=1 2024-09-19T15:31:38.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.n8M2zZd5DNzKKchTnw1Lq-RaEZzY6fv_0 2024-09-19T15:31:38.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13480497058863506011', time=2024-09-19T16:47:41.797512+0000, chain.objs.size()=1 2024-09-19T15:31:38.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.aV87pomn05N2aNoNodDXMyJM3nSau4l_0 2024-09-19T15:31:38.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10271220066445207502', time=2024-09-19T16:47:44.367552+0000, chain.objs.size()=1 2024-09-19T15:31:38.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.TaejeYAnhF52sBXWS8HtVcNepSOE36C_0 2024-09-19T15:31:38.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15920929445919910664', time=2024-09-19T16:47:45.053192+0000, chain.objs.size()=1 2024-09-19T15:31:38.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.4y6PFKPGDo7dwFryb2-GUT2IXSNV8Vr_0 2024-09-19T15:31:38.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16031379055712745847', time=2024-09-19T16:47:45.326767+0000, chain.objs.size()=1 2024-09-19T15:31:38.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.DU68gtxMs6HYm1FvjXd-9DdF2FwO5pI_0 2024-09-19T15:31:38.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3532058218413991056', time=2024-09-19T16:47:46.061673+0000, chain.objs.size()=1 2024-09-19T15:31:38.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.LFDs8cLXUjfDdYvpAvdsepGNipTv5Ng_0 2024-09-19T15:31:38.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.575838403719305756', time=2024-09-19T16:47:47.473310+0000, chain.objs.size()=1 2024-09-19T15:31:38.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.hMe_OjfdMqhWY0vOMBUVg8Vfn3GWiJF_0 2024-09-19T15:31:38.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16820209212979193873', time=2024-09-19T16:47:47.857547+0000, chain.objs.size()=1 2024-09-19T15:31:38.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Ru7hyGkeWGnid9ycjqm0eSmZ9VCqqJF_0 2024-09-19T15:31:38.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18372279789705036340', time=2024-09-19T16:47:48.637678+0000, chain.objs.size()=1 2024-09-19T15:31:38.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.9rffgxsCa6mH2dLyFzf5DoffBeQBK1V_0 2024-09-19T15:31:38.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.993436589416761999', time=2024-09-19T16:47:49.952292+0000, chain.objs.size()=1 2024-09-19T15:31:38.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Q9lQ9GuyEriTJfZY3pSTCcLh7ITzaSQ_0 2024-09-19T15:31:38.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18219663097974782767', time=2024-09-19T16:49:35.493428+0000, chain.objs.size()=1 2024-09-19T15:31:38.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.OC9gx1AYtMU9wMWOxEJQmt2smk0e-XT_0 2024-09-19T15:31:38.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.564+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18218703186747229073', time=2024-09-19T16:49:36.250254+0000, chain.objs.size()=1 2024-09-19T15:31:38.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.564+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.afSh0pI82RgmCQD_tlqfn_pfI7sZE2J_0 2024-09-19T15:31:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.566380229751099589', time=2024-09-19T16:49:36.642690+0000, chain.objs.size()=1 2024-09-19T15:31:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Ykbpv6gK7lkEYGEhzt5NGZLBYTy5rFe_0 2024-09-19T15:31:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2296743243407391864', time=2024-09-19T16:49:37.073659+0000, chain.objs.size()=1 2024-09-19T15:31:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.e-SHjEGfBpHuUxwEzxwpoHkFFf8dvLX_0 2024-09-19T15:31:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8980789472981464420', time=2024-09-19T16:49:37.510913+0000, chain.objs.size()=1 2024-09-19T15:31:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.RpMRgB43IN_dUYBQ7jyDADwT17a71yU_0 2024-09-19T15:31:38.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5022065018424138358', time=2024-09-19T16:49:38.113773+0000, chain.objs.size()=1 2024-09-19T15:31:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.SI1fAmuHiDGcfDl-bqbJPY4lAnqLA76_0 2024-09-19T15:31:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13547755495292813946', time=2024-09-19T16:49:40.367582+0000, chain.objs.size()=1 2024-09-19T15:31:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.jEinNUxfDT-jATOXUwe74G9ChQyc7B1_0 2024-09-19T15:31:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4363150937635515111', time=2024-09-19T16:49:44.021460+0000, chain.objs.size()=1 2024-09-19T15:31:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.eKeV34WiIRR5LXmJsIjDx-sRqjFvUpy_0 2024-09-19T15:31:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17501456555445204861', time=2024-09-19T16:49:44.843680+0000, chain.objs.size()=1 2024-09-19T15:31:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.h3fT49mKhzqzFSTWHSdKJYmtePutXm6_0 2024-09-19T15:31:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1510765237327752976', time=2024-09-19T16:49:46.821601+0000, chain.objs.size()=1 2024-09-19T15:31:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.mAMfym7Hz-UVaKL2iyv-5aANZbC5EKw_0 2024-09-19T15:31:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.251099357395524051', time=2024-09-19T16:49:47.925662+0000, chain.objs.size()=1 2024-09-19T15:31:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.kZ7FBWVTibakFyiaW3fnEk34SK0Cqlo_0 2024-09-19T15:31:38.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3742835540361380227', time=2024-09-19T16:49:48.311171+0000, chain.objs.size()=1 2024-09-19T15:31:38.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.7RqLfIgBBshsrPjeOAIOIWLGXexS4dK_0 2024-09-19T15:31:38.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8786970440269848142', time=2024-09-19T16:49:48.510463+0000, chain.objs.size()=1 2024-09-19T15:31:38.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.RJSaYBZMN-4pW_dtsKGZHWUv-UgkbrX_0 2024-09-19T15:31:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18204824810448843657', time=2024-09-19T16:49:48.760900+0000, chain.objs.size()=1 2024-09-19T15:31:38.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.uWHs_daaUGznCqnxvzQRbMbjz4HKaja_0 2024-09-19T15:31:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9997894568989892255', time=2024-09-19T16:49:49.546637+0000, chain.objs.size()=1 2024-09-19T15:31:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.FzMZPUnAq-2YiAt8GXkCYWH37r9nGA3_0 2024-09-19T15:31:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3895431899557344796', time=2024-09-19T16:49:50.481797+0000, chain.objs.size()=1 2024-09-19T15:31:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.KoKk61skJYTIV9QZM4Yo7e02xTuIn8O_0 2024-09-19T15:31:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18183061967841798581', time=2024-09-19T16:49:51.951178+0000, chain.objs.size()=1 2024-09-19T15:31:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Mlswk4rSAMvUGWecyuA1bTWNR_VHUhY_0 2024-09-19T15:31:38.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15704130655109465582', time=2024-09-19T16:49:52.067274+0000, chain.objs.size()=1 2024-09-19T15:31:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.3U7bLjF2OMnkVod3mEgY4efoCRPTkEe_0 2024-09-19T15:31:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7441596878795430978', time=2024-09-19T16:49:52.497090+0000, chain.objs.size()=1 2024-09-19T15:31:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ZLBdX0-e1H6sixlIeyLaHHnzKcyeYVf_0 2024-09-19T15:31:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6015191169470381971', time=2024-09-19T16:49:54.767650+0000, chain.objs.size()=1 2024-09-19T15:31:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.t5hcIpZOA8kh4WibEJX3O3Lef64UVdd_0 2024-09-19T15:31:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4530414602518834577', time=2024-09-19T16:49:56.163617+0000, chain.objs.size()=1 2024-09-19T15:31:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.S9aTf2DnPVAp8_YJ7ufCzQJdp1WLGH2_0 2024-09-19T15:31:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4236607989511929522', time=2024-09-19T16:49:56.165096+0000, chain.objs.size()=1 2024-09-19T15:31:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.t9MjrR-Rv58NvoKmh41Ya-oThlSXNSt_0 2024-09-19T15:31:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.916624007223986521', time=2024-09-19T16:49:57.042188+0000, chain.objs.size()=1 2024-09-19T15:31:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Mr1TO_581aqPAMx64BANxqP5wlUoB-F_0 2024-09-19T15:31:38.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13954347487762936302', time=2024-09-19T16:49:57.797739+0000, chain.objs.size()=1 2024-09-19T15:31:38.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.X0eWUgsrzk4IQy-PFPu2R4FFuP5hAnl_0 2024-09-19T15:31:38.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.576+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17476214135033949031', time=2024-09-19T16:50:00.091438+0000, chain.objs.size()=1 2024-09-19T15:31:38.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.576+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.x3fARN79Q9LQTmswgL9XvBLDvrtzALm_0 2024-09-19T15:31:38.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.576+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.169223467354360355', time=2024-09-19T16:50:00.858444+0000, chain.objs.size()=1 2024-09-19T15:31:38.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.576+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.bcRHpKRGCWeDma7F0-MfTA9qtVqwyQC_0 2024-09-19T15:31:38.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.576+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4342688140262772587', time=2024-09-19T16:50:01.336670+0000, chain.objs.size()=1 2024-09-19T15:31:38.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.576+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.nUdBCVOGnRo6VndMxIoh8aWOx2q2yST_0 2024-09-19T15:31:38.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.576+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2111570597280190540', time=2024-09-19T16:50:02.049930+0000, chain.objs.size()=1 2024-09-19T15:31:38.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.576+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ppkmq3pnqzyDzjgyAL3pbQAxWlnvEu7_0 2024-09-19T15:31:38.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.576+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9347435371432804494', time=2024-09-19T16:50:02.059270+0000, chain.objs.size()=1 2024-09-19T15:31:38.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.576+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.WSdoPhR0u016CFdyhLDB2QMbdRFKSOw_0 2024-09-19T15:31:38.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.576+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4054888674438385580', time=2024-09-19T16:50:02.070828+0000, chain.objs.size()=1 2024-09-19T15:31:38.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.576+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Yqd9d7Xp35gkxnpCNMbp_oZC5pKr-Fr_0 2024-09-19T15:31:38.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.576+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15252607150613636649', time=2024-09-19T16:50:03.956605+0000, chain.objs.size()=1 2024-09-19T15:31:38.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.576+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.hbN8eoXl1kjBZF598RHpc6GymXwtvqv_0 2024-09-19T15:31:38.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.576+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14299136650592391621', time=2024-09-19T16:50:04.821590+0000, chain.objs.size()=1 2024-09-19T15:31:38.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.576+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.VNMZwJCBYrAvy4RQBpolJQNqzZkWpaE_0 2024-09-19T15:31:38.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.576+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.378627638857009142', time=2024-09-19T16:50:05.274635+0000, chain.objs.size()=1 2024-09-19T15:31:38.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.576+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.YaNgNUuxkqqHaltspEXcRvxvxWteQG1_0 2024-09-19T15:31:38.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.576+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17758286099037307197', time=2024-09-19T16:50:05.951464+0000, chain.objs.size()=1 2024-09-19T15:31:38.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.576+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.9g60M0F-706WOnXxKQmQs-M7wGW86s0_0 2024-09-19T15:31:38.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.576+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2413336527724061376', time=2024-09-19T16:52:57.465666+0000, chain.objs.size()=1 2024-09-19T15:31:38.582 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.576+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.410__shadow_.SxRTuegprgoZrjKWB6W0FskMp84TbJx_0 2024-09-19T15:31:38.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.580+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14635501933654368222', time=2024-09-19T16:54:04.805757+0000, chain.objs.size()=1 2024-09-19T15:31:38.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.580+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.443__shadow_.QocG6iMURXzbB3FWvYnPm2noRTnw2Y3_0 2024-09-19T15:31:38.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.580+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1502209801682523478', time=2024-09-19T16:54:22.649448+0000, chain.objs.size()=1 2024-09-19T15:31:38.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.580+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.450__shadow_.eIq51soHthndV2bJFygu2tTLG91dzvN_0 2024-09-19T15:31:38.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.580+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11228967358716380439', time=2024-09-19T16:55:59.992385+0000, chain.objs.size()=1 2024-09-19T15:31:38.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.580+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.493__shadow_.J0QXIDJfxY3jFaMjMu46Tt9GeofTFji_0 2024-09-19T15:31:38.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.580+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9363430996345442947', time=2024-09-19T16:56:09.254214+0000, chain.objs.size()=1 2024-09-19T15:31:38.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.580+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.497__shadow_.3sWqFBSDtS3DLDhV9BK4NkGQGbuMz_5_0 2024-09-19T15:31:38.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.584+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47892 2024-09-19T15:31:38.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.584+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-19T15:31:38.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.584+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15389985134030951573', time=2024-09-19T17:06:22.350502+0000, chain.objs.size()=1 2024-09-19T15:31:38.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.584+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.554__shadow_.X6ZMNEKAwAP2W--Kfmmxh6pUu7L7nIJ_0 2024-09-19T15:31:38.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.584+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.592858899600700700', time=2024-09-19T17:07:33.142456+0000, chain.objs.size()=1 2024-09-19T15:31:38.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.584+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.565__shadow_.apjmZLbQxQ_6ZOxSG-R_ytQ2cCJ4qVQ_0 2024-09-19T15:31:38.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.584+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1151709870355585900', time=2024-09-19T17:08:43.563698+0000, chain.objs.size()=1 2024-09-19T15:31:38.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.584+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.576__shadow:NBinL1ZuRCvs07EWK1jfHxrNo5lJn.I_.upgFThjdIG6ZkV7R11tkU-h1njiBoAt_0 2024-09-19T15:31:38.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.584+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14873825748576675448', time=2024-09-19T17:08:54.181436+0000, chain.objs.size()=1 2024-09-19T15:31:38.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.584+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:lG3js8Uqf5hX4ofETTEoaQfVeupB6Lq_.pAjZiCEeSLH7tpVEq5lbqRTJgvA7-vN_0 2024-09-19T15:31:38.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.584+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15832012419440548991', time=2024-09-19T17:10:48.090079+0000, chain.objs.size()=1 2024-09-19T15:31:38.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.584+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.585__shadow:yNkDbhYk2ly.R.j4f.szPVelQFi90K5_.Hn8e3ja37GzZlPd-lpKxry7FB61GQ2W_0 2024-09-19T15:31:38.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.584+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3539065020614946469', time=2024-09-19T17:20:37.440376+0000, chain.objs.size()=1 2024-09-19T15:31:38.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.584+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.663__shadow_.ISZF1T5gyiAwaYpk-xaDGNqejKbrkYq_0 2024-09-19T15:31:38.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.584+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1172979140048481656', time=2024-09-19T17:21:35.113978+0000, chain.objs.size()=1 2024-09-19T15:31:38.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.584+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.693__shadow:rPwjHthsSvnYtzlC2a94cNpXlSWNPGy_.5f6wpUojf8A_3811OHZtDIk1RaLIoUP_0 2024-09-19T15:31:38.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.584+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4863364775740233097', time=2024-09-19T17:22:19.737163+0000, chain.objs.size()=1 2024-09-19T15:31:38.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.584+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.714__shadow:umar-273GRnrtq12D5rFLj7qJSArmne_.jOrn8Ko-1OucV2aCZ7uHkhzydF6ArIe_0 2024-09-19T15:31:38.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:38.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T15:31:38.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:38.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:38.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48968' 2024-09-19T15:31:38.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='_ndsdl_z9_ysUOk_OKQAegQ0D8uL_GrN', time=2024-09-19T16:33:06.359854+0000, chain.objs.size()=2 2024-09-19T15:31:38.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.160__shadow_.cDBZ_u3p1Fk4Lr2g63WRdyIW9YFo6Vl_0 2024-09-19T15:31:38.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.160__shadow_.cDBZ_u3p1Fk4Lr2g63WRdyIW9YFo6Vl_1 2024-09-19T15:31:38.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='_yrdUyIeCd-Dydr041P0W8adzyl45dag', time=2024-09-19T16:33:15.013754+0000, chain.objs.size()=2 2024-09-19T15:31:38.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.160__shadow_.w1KUVGHXf-K4uijHJJK52SZ3VpTPpYE_0 2024-09-19T15:31:38.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.160__shadow_.w1KUVGHXf-K4uijHJJK52SZ3VpTPpYE_1 2024-09-19T15:31:38.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='_NNj-Lg2uE5fZGqE3c2o_dKAKIo-Wg-t', time=2024-09-19T16:33:16.810919+0000, chain.objs.size()=2 2024-09-19T15:31:38.607 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.160__shadow_.q6NwLsfFnBy4ZDe3XNsj4SdSWyv1jiQ_0 2024-09-19T15:31:38.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.160__shadow_.q6NwLsfFnBy4ZDe3XNsj4SdSWyv1jiQ_1 2024-09-19T15:31:38.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8041878027444756271', time=2024-09-19T16:39:42.449026+0000, chain.objs.size()=1 2024-09-19T15:31:38.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.237__shadow_.JgBNQRjlXGAWSbchgQCTCloOcqe-aal_0 2024-09-19T15:31:38.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15646942395917511984', time=2024-09-19T16:39:50.322098+0000, chain.objs.size()=1 2024-09-19T15:31:38.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.240__shadow_.4nSwfKNEFrKUfBi58CONGW0gtulmMWK_0 2024-09-19T15:31:38.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12675437396705067402', time=2024-09-19T16:42:28.809625+0000, chain.objs.size()=1 2024-09-19T15:31:38.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.FvLRz_I1o0HTsaXTsYsyipPehiPM0EK_0 2024-09-19T15:31:38.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1817525676147982463', time=2024-09-19T16:42:30.489969+0000, chain.objs.size()=1 2024-09-19T15:31:38.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ipUSXdrGHmwtZld-1FuaguoaJJ_V8ho_0 2024-09-19T15:31:38.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16147041428647978977', time=2024-09-19T16:42:30.493569+0000, chain.objs.size()=1 2024-09-19T15:31:38.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.9xUa1DF3qe0LxN9xoBaJoE6044ruVO1_0 2024-09-19T15:31:38.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1077734516368971663', time=2024-09-19T16:42:33.051887+0000, chain.objs.size()=1 2024-09-19T15:31:38.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.600+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.LL-2Rpv0C6N7fAy2_Q-s7WybKBbifE9_0 2024-09-19T15:31:38.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.604+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.58895150534627871', time=2024-09-19T16:42:33.621654+0000, chain.objs.size()=1 2024-09-19T15:31:38.610 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.604+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.LRWxbrkUZqwK2qleJcBzF8TGbzDH5LQ_0 2024-09-19T15:31:38.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.608+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11417487904362499110', time=2024-09-19T16:42:34.078854+0000, chain.objs.size()=1 2024-09-19T15:31:38.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.608+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.61ckwH1NHM9gUKBzG-zZCDrkOL2u-1s_0 2024-09-19T15:31:38.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.608+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10548822461377972855', time=2024-09-19T16:42:35.297744+0000, chain.objs.size()=1 2024-09-19T15:31:38.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.608+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Liu17gOts-yP1ff-42KfvJ5HFXPklWY_0 2024-09-19T15:31:38.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.608+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1724304034402840619', time=2024-09-19T16:42:37.703984+0000, chain.objs.size()=1 2024-09-19T15:31:38.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.608+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.xzxVY8JhQBkWg3fCaDyycmT7XIwKRMv_0 2024-09-19T15:31:38.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.608+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.397940535637121062', time=2024-09-19T16:42:38.108085+0000, chain.objs.size()=1 2024-09-19T15:31:38.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.608+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.XAveEn9PBcR2Nn9aXSeJTy7R7okGhEv_0 2024-09-19T15:31:38.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.608+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8574522472492447238', time=2024-09-19T16:42:38.422231+0000, chain.objs.size()=1 2024-09-19T15:31:38.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.608+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.LtECRDHOeDPKrxSMKJ96JTJjH-Ku0Wb_0 2024-09-19T15:31:38.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.608+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10454282907194725887', time=2024-09-19T16:42:39.660749+0000, chain.objs.size()=1 2024-09-19T15:31:38.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.608+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.8ATQD4yWWABILGMMgL9xLbv6WfyV9zj_0 2024-09-19T15:31:38.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.608+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16873792166805415379', time=2024-09-19T16:42:41.577769+0000, chain.objs.size()=1 2024-09-19T15:31:38.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.608+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.V2K7AuaMOteuzvJn-Pm5YAIl2g0vSnp_0 2024-09-19T15:31:38.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.608+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7360237857753330746', time=2024-09-19T16:42:41.911542+0000, chain.objs.size()=1 2024-09-19T15:31:38.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.608+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.-MoUlgLmJ3ZsZIPAfpZZ4t48NKq9k8d_0 2024-09-19T15:31:38.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.608+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9933585084477829692', time=2024-09-19T16:42:42.197980+0000, chain.objs.size()=1 2024-09-19T15:31:38.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.608+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.abBbggQDf4zGfzVTj2jhEH7iJJevrJV_0 2024-09-19T15:31:38.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.608+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4722188310701403307', time=2024-09-19T16:42:42.832227+0000, chain.objs.size()=1 2024-09-19T15:31:38.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.608+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.KUO296gCCnMayd-jKZ9N53zSpXl8twQ_0 2024-09-19T15:31:38.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.608+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1561831415112927160', time=2024-09-19T16:42:43.131300+0000, chain.objs.size()=1 2024-09-19T15:31:38.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.608+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.a_JSDfG0d6WatRWYayeEu8USxdMGurh_0 2024-09-19T15:31:38.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.612+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3548976420258807798', time=2024-09-19T16:42:43.348169+0000, chain.objs.size()=1 2024-09-19T15:31:38.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.612+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.CwG7gwHbqekyH90efeseSEpYkSgK_OS_0 2024-09-19T15:31:38.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.612+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1511561708738313393', time=2024-09-19T16:42:43.731699+0000, chain.objs.size()=1 2024-09-19T15:31:38.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.612+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.wt9BEO_kJEsOmf4bcE2LUzH_atZiNtf_0 2024-09-19T15:31:38.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.612+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16127239376362166364', time=2024-09-19T16:42:44.058039+0000, chain.objs.size()=1 2024-09-19T15:31:38.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.612+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.VejLE3Q_BeaEQnIl_cFM-6TLxMV6Jvl_0 2024-09-19T15:31:38.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.612+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5876473828675455071', time=2024-09-19T16:42:47.127567+0000, chain.objs.size()=1 2024-09-19T15:31:38.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.612+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.STnUxYMSO1ZoHT-HP2CQ7trISUWsH6a_0 2024-09-19T15:31:38.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.616+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7392364430172186606', time=2024-09-19T16:42:51.269245+0000, chain.objs.size()=1 2024-09-19T15:31:38.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.616+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.dw9Fro-p3SM8cQ2Yed8ZcOPImcg63TY_0 2024-09-19T15:31:38.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.616+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1101318441507778834', time=2024-09-19T16:42:51.422713+0000, chain.objs.size()=1 2024-09-19T15:31:38.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.616+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.kEk_0WkkeBBRY_8BQW-3ZGAvtYce9p2_0 2024-09-19T15:31:38.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.616+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9245096812868942260', time=2024-09-19T16:42:51.424631+0000, chain.objs.size()=1 2024-09-19T15:31:38.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.616+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.wFMfDI0LsCyCSGMHODqJkFEs1Fv9K7K_0 2024-09-19T15:31:38.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.616+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.536359384606566421', time=2024-09-19T16:42:51.961349+0000, chain.objs.size()=1 2024-09-19T15:31:38.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.616+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.MDQxTobh_NotaEsdrjswPEYvSNdkdNW_0 2024-09-19T15:31:38.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.616+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.730763241821597701', time=2024-09-19T16:42:52.506640+0000, chain.objs.size()=1 2024-09-19T15:31:38.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.616+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.3eEuCtk_PSxqCUqq3yYDOkA81yeldCL_0 2024-09-19T15:31:38.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.616+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2403729108916856262', time=2024-09-19T16:42:52.508913+0000, chain.objs.size()=1 2024-09-19T15:31:38.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.616+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.L3y9wbtL-mEOPvdkytJ_yBdfO97nHav_0 2024-09-19T15:31:38.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.616+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5369527578797679195', time=2024-09-19T16:42:53.830665+0000, chain.objs.size()=1 2024-09-19T15:31:38.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.616+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.TV19UQ-6Yav1nyVA5gNMUfoJg9UKXfU_0 2024-09-19T15:31:38.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.616+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9084142137094312256', time=2024-09-19T16:42:57.424399+0000, chain.objs.size()=1 2024-09-19T15:31:38.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.616+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ND_ekQaMSUosGGoGatIPrqRPl0AJsR8_0 2024-09-19T15:31:38.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.620+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5041978115810891954', time=2024-09-19T16:42:59.808742+0000, chain.objs.size()=1 2024-09-19T15:31:38.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.620+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.42ufdXjn7Sdn4fKHqmx_V7DfnG1j1mp_0 2024-09-19T15:31:38.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.620+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1823335953373988995', time=2024-09-19T16:42:59.919235+0000, chain.objs.size()=1 2024-09-19T15:31:38.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.620+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.BTEmFbBJAfJ4Gqlcr2vnAB72TbHsb_y_0 2024-09-19T15:31:38.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.620+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16201540712327560995', time=2024-09-19T16:43:15.613906+0000, chain.objs.size()=1 2024-09-19T15:31:38.624 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.620+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.269__shadow_.K1b_VfcHOe1vsciOC5-suPlcF-LtjvV_0 2024-09-19T15:31:38.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.620+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13239794189251702806', time=2024-09-19T16:43:24.444740+0000, chain.objs.size()=1 2024-09-19T15:31:38.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.620+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.273__shadow_.FNHXP2HIzAP6-4MDqjNcCfkExKMvKcF_0 2024-09-19T15:31:38.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.620+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7789439926856766608', time=2024-09-19T16:43:24.454076+0000, chain.objs.size()=1 2024-09-19T15:31:38.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.620+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.273__shadow_.bZny10gWywaWUSlBxw8z4vuz4f3a-4f_0 2024-09-19T15:31:38.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.620+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3144872730121243244', time=2024-09-19T16:43:45.175139+0000, chain.objs.size()=1 2024-09-19T15:31:38.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.620+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.282__shadow_.m2vDunGj9HErFZ8qe4F84jzaIfvaq5x_0 2024-09-19T15:31:38.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.620+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16079643537834254128', time=2024-09-19T16:44:01.759592+0000, chain.objs.size()=1 2024-09-19T15:31:38.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.620+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.289__shadow_.Q7DTMjyDbbdUO5gHtATM3U38i65MNIW_0 2024-09-19T15:31:38.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.620+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1780378397994758611', time=2024-09-19T16:44:12.312822+0000, chain.objs.size()=1 2024-09-19T15:31:38.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.620+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_.vxEHFvtXET5h-9lPBHTZw_JL-pp8lAL_0 2024-09-19T15:31:38.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.620+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1965808967516383853', time=2024-09-19T16:44:12.721877+0000, chain.objs.size()=1 2024-09-19T15:31:38.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.620+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_.mM_BuVlsQKtlgXm_HqvMSZZtPw_e2Tn_0 2024-09-19T15:31:38.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.620+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12189042672476267457', time=2024-09-19T16:44:12.903450+0000, chain.objs.size()=1 2024-09-19T15:31:38.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.620+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_.3pSttRvBD4tYq2bCZapA8MkWIDdO01G_0 2024-09-19T15:31:38.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.624+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17221784816190808348', time=2024-09-19T16:44:18.316358+0000, chain.objs.size()=1 2024-09-19T15:31:38.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.624+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.q0p-RQ9KAB_-PGq15-SZA4txJ8G9IUf_0 2024-09-19T15:31:38.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.624+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9079749025482347602', time=2024-09-19T16:47:19.047232+0000, chain.objs.size()=1 2024-09-19T15:31:38.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.624+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.YIhqJYUw0ZILeer4EZWtE74mbMvLUON_0 2024-09-19T15:31:38.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.624+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12997404060746383460', time=2024-09-19T16:47:21.005599+0000, chain.objs.size()=1 2024-09-19T15:31:38.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.624+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Wl74iB1EweZ1WAjkohlm3Z1G_O_AIgr_0 2024-09-19T15:31:38.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.624+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15759074447760330423', time=2024-09-19T16:47:21.322857+0000, chain.objs.size()=1 2024-09-19T15:31:38.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.624+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Ne8tk-NFufa7tnbQUHerXodnPOocUwg_0 2024-09-19T15:31:38.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.624+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1198563904244486093', time=2024-09-19T16:47:24.092346+0000, chain.objs.size()=1 2024-09-19T15:31:38.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.624+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.6Oj9xsqsslrLx0wKQK80tbhpj1f4CJO_0 2024-09-19T15:31:38.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.624+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9393051074955403643', time=2024-09-19T16:47:24.230138+0000, chain.objs.size()=1 2024-09-19T15:31:38.631 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.624+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.vrzpEEJMlRSmoPpmkAFXwFGWyWdyBfj_0 2024-09-19T15:31:38.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.628+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15864513984093523611', time=2024-09-19T16:47:24.406466+0000, chain.objs.size()=1 2024-09-19T15:31:38.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.628+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_._pQKTtsos75Q-oupKk2Y0BDeslX-rui_0 2024-09-19T15:31:38.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.628+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14855906521608149133', time=2024-09-19T16:47:24.944686+0000, chain.objs.size()=1 2024-09-19T15:31:38.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.628+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.BnQNUPGnhP69SkADOyuf5Vr3iIjYUp5_0 2024-09-19T15:31:38.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.628+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17166042587166468595', time=2024-09-19T16:47:27.635485+0000, chain.objs.size()=1 2024-09-19T15:31:38.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.628+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.FwuxZY_3xGCRID3OLFzK-cOIc35Hro7_0 2024-09-19T15:31:38.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.628+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9348205825875360010', time=2024-09-19T16:47:28.313188+0000, chain.objs.size()=1 2024-09-19T15:31:38.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.628+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.zf_SfkRDS4NZSLRdIu-bcWgzWl9nuDX_0 2024-09-19T15:31:38.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.628+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17424238948224475418', time=2024-09-19T16:47:29.128851+0000, chain.objs.size()=1 2024-09-19T15:31:38.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.628+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.sTII4FXde6M6mc7j1n0VMZaAc_AazOi_0 2024-09-19T15:31:38.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.628+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11255891278424937464', time=2024-09-19T16:47:29.131084+0000, chain.objs.size()=1 2024-09-19T15:31:38.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.628+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.k9OObpvJOTAXkAk4lXzKRgBLYO_3rGZ_0 2024-09-19T15:31:38.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.628+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16191511326861311393', time=2024-09-19T16:47:29.319047+0000, chain.objs.size()=1 2024-09-19T15:31:38.634 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.628+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.OpDHNoyR3y0zzrmiEqDGgAYnkOZxj5B_0 2024-09-19T15:31:38.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.632+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10098093929337371339', time=2024-09-19T16:47:31.898889+0000, chain.objs.size()=1 2024-09-19T15:31:38.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.632+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.FkKcEx5iMx0EKOqyBYEuTR6meXCzr4g_0 2024-09-19T15:31:38.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.632+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17092589943380149982', time=2024-09-19T16:47:32.332078+0000, chain.objs.size()=1 2024-09-19T15:31:38.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.632+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.2war-bhznJJD7pBnWR1zdLkeW797Buz_0 2024-09-19T15:31:38.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.632+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11715098350562031101', time=2024-09-19T16:47:33.651405+0000, chain.objs.size()=1 2024-09-19T15:31:38.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.632+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.M6SfgIVbYRf6Or0QQw5Nqsv4PZNDDIT_0 2024-09-19T15:31:38.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.632+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1594772955363745126', time=2024-09-19T16:47:36.391024+0000, chain.objs.size()=1 2024-09-19T15:31:38.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.632+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.LhQK7VZzSVAfRcBUMM4y-yO9dMwG2_P_0 2024-09-19T15:31:38.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.632+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16839974081294662791', time=2024-09-19T16:47:36.932902+0000, chain.objs.size()=1 2024-09-19T15:31:38.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.632+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ftrubJVmNcKcBZ7Re311PyZe1iegYdc_0 2024-09-19T15:31:38.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.632+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13130503205345855572', time=2024-09-19T16:47:37.477924+0000, chain.objs.size()=1 2024-09-19T15:31:38.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.632+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.yo-OLLnEYhkQYe4X49zYRrgaTogAJ5L_0 2024-09-19T15:31:38.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.632+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6689586396340584395', time=2024-09-19T16:47:40.216667+0000, chain.objs.size()=1 2024-09-19T15:31:38.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.632+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.MMaRONEhyq08jNkf8hrgRDW7zPhnet5_0 2024-09-19T15:31:38.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.632+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5411943343435089050', time=2024-09-19T16:47:41.445041+0000, chain.objs.size()=1 2024-09-19T15:31:38.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.632+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.UocN3YWm80vksygJEouDhepf29xXgik_0 2024-09-19T15:31:38.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.632+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9806570169442152416', time=2024-09-19T16:47:41.700444+0000, chain.objs.size()=1 2024-09-19T15:31:38.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.632+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.8AkBKKetKhCDJB7CekfFhk0Sl53NhqT_0 2024-09-19T15:31:38.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.632+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4508754010998358643', time=2024-09-19T16:47:43.612536+0000, chain.objs.size()=1 2024-09-19T15:31:38.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.632+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Ydc_wCRF3-vF1I0fe140PvzXvW1JH4p_0 2024-09-19T15:31:38.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.636+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1915197396249622498', time=2024-09-19T16:47:44.252701+0000, chain.objs.size()=1 2024-09-19T15:31:38.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.636+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.XuLnQs0XKSKhwAHTkQMUvX25_KmI7Et_0 2024-09-19T15:31:38.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.636+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2781393396250586004', time=2024-09-19T16:47:46.403160+0000, chain.objs.size()=1 2024-09-19T15:31:38.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.636+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.gH8NhfgH82_35ZaHXyBEkML2WGIB_6v_0 2024-09-19T15:31:38.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.636+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15150936870568276644', time=2024-09-19T16:47:46.499462+0000, chain.objs.size()=1 2024-09-19T15:31:38.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.636+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.mu-kHZvJfhhzKZ8MhcX5UB5UX--aYPE_0 2024-09-19T15:31:38.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.636+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8383653005883189084', time=2024-09-19T16:47:47.553761+0000, chain.objs.size()=1 2024-09-19T15:31:38.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.636+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ZVSW4eZkcJSK4quT9DzVlgKDYF80Y5A_0 2024-09-19T15:31:38.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.640+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2838282246634364630', time=2024-09-19T16:47:48.007221+0000, chain.objs.size()=1 2024-09-19T15:31:38.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.640+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.H9nnPHS9xCerkAHbxKy87HywxneJ-LR_0 2024-09-19T15:31:38.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.640+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2779739593266627150', time=2024-09-19T16:49:34.989331+0000, chain.objs.size()=1 2024-09-19T15:31:38.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.640+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.0p1GH0hib96D-MVQ_oxbiLnLxGkH6dZ_0 2024-09-19T15:31:38.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.640+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8061446586301298294', time=2024-09-19T16:49:36.841283+0000, chain.objs.size()=1 2024-09-19T15:31:38.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.640+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.jUv7JpemQ2VlUFd733MmG3GXeODngo1_0 2024-09-19T15:31:38.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.640+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14480568385290238909', time=2024-09-19T16:49:36.842973+0000, chain.objs.size()=1 2024-09-19T15:31:38.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.640+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.QBKCHTSaH3UR1FoCCERIXyM800Al18p_0 2024-09-19T15:31:38.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.640+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1031396621328980914', time=2024-09-19T16:49:37.131482+0000, chain.objs.size()=1 2024-09-19T15:31:38.646 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.640+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.s6MAUFD_69-F5FLCxcLLUWBWBqmwpXI_0 2024-09-19T15:31:38.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.640+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14670604327516120584', time=2024-09-19T16:49:41.177721+0000, chain.objs.size()=1 2024-09-19T15:31:38.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.640+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.iuySir3rO354bNNm9tRItj7OK9M-o_K_0 2024-09-19T15:31:38.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.640+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16314590577946552969', time=2024-09-19T16:49:41.726836+0000, chain.objs.size()=1 2024-09-19T15:31:38.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.640+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.vl_vYYoHuLPlQbFOSEHpQ66WmpA4GRY_0 2024-09-19T15:31:38.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.640+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13922521361394991019', time=2024-09-19T16:49:41.875344+0000, chain.objs.size()=1 2024-09-19T15:31:38.647 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.640+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ZlvzRqPnlSbM6w8i1EHBby0C3OtpKtw_0 2024-09-19T15:31:38.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.644+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6947228038704043629', time=2024-09-19T16:49:43.649564+0000, chain.objs.size()=1 2024-09-19T15:31:38.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.644+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.CZe6jKJfpCm9kzPZwMMYfbr3c2xNVuj_0 2024-09-19T15:31:38.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.644+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4830631083468275995', time=2024-09-19T16:49:43.651244+0000, chain.objs.size()=1 2024-09-19T15:31:38.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.644+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.FpO4ux8bKAYA4AxJOIc4KUmVkrkrLG1_0 2024-09-19T15:31:38.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.644+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6938426729289431996', time=2024-09-19T16:49:44.023611+0000, chain.objs.size()=1 2024-09-19T15:31:38.649 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.644+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.mB1EMqQGXB5Z1I_jnLYtZUXX3T7lqJv_0 2024-09-19T15:31:38.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.644+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7042927125019452906', time=2024-09-19T16:49:44.283753+0000, chain.objs.size()=1 2024-09-19T15:31:38.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.644+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.QWjqpOrJP48vZVPWq81i33BLuiMQh_8_0 2024-09-19T15:31:38.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.644+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9444813762300052000', time=2024-09-19T16:49:46.543727+0000, chain.objs.size()=1 2024-09-19T15:31:38.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.644+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Pf6Q-o_4-hJgjApCrv6LLFMG_QqVct1_0 2024-09-19T15:31:38.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.644+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1557736088798811816', time=2024-09-19T16:49:48.664941+0000, chain.objs.size()=1 2024-09-19T15:31:38.651 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.644+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.bXu23cMm_zCOdOuErJjSBEwvx8jssVQ_0 2024-09-19T15:31:38.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.644+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15364100018274090103', time=2024-09-19T16:49:48.819732+0000, chain.objs.size()=1 2024-09-19T15:31:38.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.644+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.r8AqoXd80RqBGpk6MuNguiX0IM8BFd__0 2024-09-19T15:31:38.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.644+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13666238150508150500', time=2024-09-19T16:49:51.048344+0000, chain.objs.size()=1 2024-09-19T15:31:38.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.644+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.dBwQ_2wwQpESm7RG8rTnIEIdmV5xYs9_0 2024-09-19T15:31:38.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.644+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2505699160697950990', time=2024-09-19T16:49:53.104367+0000, chain.objs.size()=1 2024-09-19T15:31:38.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.644+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.N91-3NJktw3Q4SLHWtrXLhQgBaoEE6Q_0 2024-09-19T15:31:38.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.644+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7755621113343343647', time=2024-09-19T16:49:53.217712+0000, chain.objs.size()=1 2024-09-19T15:31:38.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.644+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.MRfJtQspf5priWXsrmOkEzYQa8mhUtm_0 2024-09-19T15:31:38.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.644+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15202777926646956330', time=2024-09-19T16:49:53.790058+0000, chain.objs.size()=1 2024-09-19T15:31:38.652 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.644+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.EI4pXijWtf38mZPEWFevxG8fwtIvq-q_0 2024-09-19T15:31:38.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.648+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17332155247641924615', time=2024-09-19T16:49:53.981524+0000, chain.objs.size()=1 2024-09-19T15:31:38.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.648+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.h1UigpMULVwOO8V5VFBBnXdkBKXCXEM_0 2024-09-19T15:31:38.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.648+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6746408253300231233', time=2024-09-19T16:49:54.898160+0000, chain.objs.size()=1 2024-09-19T15:31:38.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.648+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.VfmHELqHgQ69o92Ffx832ysXDQbgwpv_0 2024-09-19T15:31:38.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.648+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12977199367158102906', time=2024-09-19T16:49:56.508878+0000, chain.objs.size()=1 2024-09-19T15:31:38.653 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.648+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.O5Tsazk62tm_tt4FgVDJynlkcMLuptE_0 2024-09-19T15:31:38.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.652+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4618071563779844006', time=2024-09-19T16:49:58.451696+0000, chain.objs.size()=1 2024-09-19T15:31:38.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.652+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.EMDnaPHc_BbkwhYx1xeOeqggMx--QqO_0 2024-09-19T15:31:38.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.652+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13721648287914921074', time=2024-09-19T16:49:58.749554+0000, chain.objs.size()=1 2024-09-19T15:31:38.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.652+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.9vVnkXDRfb9x_C6I7qnADu00L-APyd6_0 2024-09-19T15:31:38.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.652+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10951248917154135872', time=2024-09-19T16:50:00.451405+0000, chain.objs.size()=1 2024-09-19T15:31:38.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.652+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.MK6Mp_M9mjSuQjWvTubqdZIy_KZ1RBZ_0 2024-09-19T15:31:38.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.652+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3021167652306454343', time=2024-09-19T16:50:02.334641+0000, chain.objs.size()=1 2024-09-19T15:31:38.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.652+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.oC-uw-e678rY8jvNylKVilX5Qd6ps1z_0 2024-09-19T15:31:38.657 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.652+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1843629497645995165', time=2024-09-19T16:50:02.531612+0000, chain.objs.size()=1 2024-09-19T15:31:38.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.652+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.eCz5bh6YiguMH5MBrOtBIXPQajeRQpS_0 2024-09-19T15:31:38.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.652+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17185971361306529091', time=2024-09-19T16:50:02.533965+0000, chain.objs.size()=1 2024-09-19T15:31:38.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.652+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.bmFol2vVXpwVgkLuETuaGlphEjQxJJH_0 2024-09-19T15:31:38.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.652+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.343836312583407895', time=2024-09-19T16:50:02.643338+0000, chain.objs.size()=1 2024-09-19T15:31:38.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.652+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.qFti0z1_aWpp_2RqzQrGr9cx2bxB2IS_0 2024-09-19T15:31:38.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.652+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17102217514331606048', time=2024-09-19T16:50:04.452151+0000, chain.objs.size()=1 2024-09-19T15:31:38.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.652+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.wd50rQ521SxVrK3M-uQS7qkIZhY7xPz_0 2024-09-19T15:31:38.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.656+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48968 2024-09-19T15:31:38.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=34, truncated=0, next_marker='' 2024-09-19T15:31:38.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3981158966586122266', time=2024-09-19T16:50:05.270353+0000, chain.objs.size()=1 2024-09-19T15:31:38.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.nbW1ZW_gw1az7S_gys1IOoiwCTa0sYc_0 2024-09-19T15:31:38.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3495953199540674830', time=2024-09-19T16:50:05.373149+0000, chain.objs.size()=1 2024-09-19T15:31:38.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.HPngCWIRny3_MO9BJ9c2DSRf8_G3IyB_0 2024-09-19T15:31:38.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2728331999416916861', time=2024-09-19T16:50:05.994115+0000, chain.objs.size()=1 2024-09-19T15:31:38.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_._u0cuemqNPGIUMD0nxfKVrRcF-TrtWg_0 2024-09-19T15:31:38.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7330840449170357520', time=2024-09-19T16:50:06.216384+0000, chain.objs.size()=1 2024-09-19T15:31:38.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.6lCTE3h4Y8iHNFqiQ-qLkk2RqaSXEhi_0 2024-09-19T15:31:38.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6627704944560849382', time=2024-09-19T16:50:06.332600+0000, chain.objs.size()=1 2024-09-19T15:31:38.666 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.l9QjOkJh0cgyaAiMvIc39cLW8Evv1O8_0 2024-09-19T15:31:38.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4993657667680078040', time=2024-09-19T16:50:18.377759+0000, chain.objs.size()=1 2024-09-19T15:31:38.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.330__shadow_.x_QQ6NQ3P80JevAS9Cvpte3MWGAR3Q4_0 2024-09-19T15:31:38.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17176959287607441420', time=2024-09-19T16:50:22.633332+0000, chain.objs.size()=1 2024-09-19T15:31:38.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.332__shadow_.HpRORSxSBmOC_EDQOYvd3R2DMQEDBvV_0 2024-09-19T15:31:38.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3066029349092450697', time=2024-09-19T16:51:49.523883+0000, chain.objs.size()=1 2024-09-19T15:31:38.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.377__shadow_.3BmdBAgI33S0rgqhGSd2yKvbvjLTVBe_0 2024-09-19T15:31:38.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3634615613716532155', time=2024-09-19T16:51:53.851804+0000, chain.objs.size()=1 2024-09-19T15:31:38.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.379__shadow_.3goqoRPtbBqGhJeCJ_uYBHLIexsEwv8_0 2024-09-19T15:31:38.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13297598192658593700', time=2024-09-19T16:53:35.579984+0000, chain.objs.size()=1 2024-09-19T15:31:38.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.429__shadow_.ULPX9MyprSfVBvdpmiNQM7i3NIyKy5c_0 2024-09-19T15:31:38.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8548423860830533514', time=2024-09-19T16:54:59.957588+0000, chain.objs.size()=1 2024-09-19T15:31:38.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.464__shadow_.XZbp00uOD9cui-f7yEDR9sg7byyEkXq_0 2024-09-19T15:31:38.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11443311717571429242', time=2024-09-19T16:55:32.889334+0000, chain.objs.size()=1 2024-09-19T15:31:38.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.660+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.483__shadow_.cEghmAzpGYFxb2CZX9RXL4ssZu8on38_0 2024-09-19T15:31:38.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.664+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.928357887422388042', time=2024-09-19T16:57:42.021928+0000, chain.objs.size()=1 2024-09-19T15:31:38.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.664+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.518__multipart_mymultipart.2~YMWPIE05LI-vV-Fj4vVy3Zy7qkQAL92.1 2024-09-19T15:31:38.669 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.664+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IS5sM1ptgjhKvuAaIm9wT-mcSgJoHL0', time=2024-09-19T17:02:16.358882+0000, chain.objs.size()=1 2024-09-19T15:31:38.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.664+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~IS5sM1ptgjhKvuAaIm9wT-mcSgJoHL0.1 2024-09-19T15:31:38.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.664+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IS5sM1ptgjhKvuAaIm9wT-mcSgJoHL0', time=2024-09-19T17:02:16.368702+0000, chain.objs.size()=1 2024-09-19T15:31:38.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.664+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~IS5sM1ptgjhKvuAaIm9wT-mcSgJoHL0.2 2024-09-19T15:31:38.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.664+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IS5sM1ptgjhKvuAaIm9wT-mcSgJoHL0', time=2024-09-19T17:02:16.378295+0000, chain.objs.size()=1 2024-09-19T15:31:38.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.664+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~IS5sM1ptgjhKvuAaIm9wT-mcSgJoHL0.3 2024-09-19T15:31:38.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.664+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IS5sM1ptgjhKvuAaIm9wT-mcSgJoHL0', time=2024-09-19T17:02:16.388063+0000, chain.objs.size()=1 2024-09-19T15:31:38.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.664+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~IS5sM1ptgjhKvuAaIm9wT-mcSgJoHL0.4 2024-09-19T15:31:38.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.664+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IS5sM1ptgjhKvuAaIm9wT-mcSgJoHL0', time=2024-09-19T17:02:16.397944+0000, chain.objs.size()=1 2024-09-19T15:31:38.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.664+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~IS5sM1ptgjhKvuAaIm9wT-mcSgJoHL0.5 2024-09-19T15:31:38.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.664+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~IS5sM1ptgjhKvuAaIm9wT-mcSgJoHL0', time=2024-09-19T17:02:16.407658+0000, chain.objs.size()=1 2024-09-19T15:31:38.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.664+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~IS5sM1ptgjhKvuAaIm9wT-mcSgJoHL0.6 2024-09-19T15:31:38.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.664+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2948515244498990256', time=2024-09-19T17:05:06.739431+0000, chain.objs.size()=1 2024-09-19T15:31:38.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.664+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.537__shadow_.8uaDRAn8sRM72PnFkVn4Rz16yYGp0hD_0 2024-09-19T15:31:38.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.668+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5018241754647412678', time=2024-09-19T17:09:01.732918+0000, chain.objs.size()=1 2024-09-19T15:31:38.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.668+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:dC0yohCMTG5oPBoMMQrwAOFG.CuAvHi_.PwMTI6x8u9Lm2aMco0gvidsJq4V3ofZ_0 2024-09-19T15:31:38.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.668+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1299505039165970878', time=2024-09-19T17:09:02.817377+0000, chain.objs.size()=1 2024-09-19T15:31:38.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.668+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:fBEtELhtd-8N7cs29hu2pePbeEgKJaD_.TA3TseiKLCDmD0K-VlPOuUIGBMwKqR0_0 2024-09-19T15:31:38.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.668+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14603024635756512502', time=2024-09-19T17:09:05.322834+0000, chain.objs.size()=1 2024-09-19T15:31:38.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.668+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:iXT6JLYrwERSg2afJ9QfjRUIPm37ftY_._CIpS0xweou8hohZLj40kUuuLhP-9VB_0 2024-09-19T15:31:38.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.672+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14684616009905142781', time=2024-09-19T17:09:12.152942+0000, chain.objs.size()=1 2024-09-19T15:31:38.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.672+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:r5DauxnR5X5.p5RR3LtMc4AYtnepTiU_.6xtftf-qyGhcbd9kXzmjAGKn5s-o6hD_0 2024-09-19T15:31:38.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.672+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6654266327537915047', time=2024-09-19T17:10:29.784147+0000, chain.objs.size()=1 2024-09-19T15:31:38.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.672+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.579__shadow:LpSOcyQREgNr9BzTQVHHtibzbZ0YxL4_.yIGG3VVwi4jjyhq_Mov_LLt_0TFl3ww_0 2024-09-19T15:31:38.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.672+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7827694952316229127', time=2024-09-19T17:10:30.472622+0000, chain.objs.size()=1 2024-09-19T15:31:38.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.672+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.579__shadow:0.mfgnDXhNyw379O9mq398bTpvyD5RB_.97Yv8ZO5cRjaxCin2Yg94CeBj5enLEH_0 2024-09-19T15:31:38.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.672+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8693741439040637061', time=2024-09-19T17:10:38.600271+0000, chain.objs.size()=1 2024-09-19T15:31:38.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.672+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.582__shadow:b1vWHIcRac7H535FbiI1ykPJQJdXKO5_.VafLYyPjwP9JeedMCubdnHe3Zzaw_I0_0 2024-09-19T15:31:38.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.672+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15109230698063100638', time=2024-09-19T17:10:48.154844+0000, chain.objs.size()=1 2024-09-19T15:31:38.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.672+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.585__shadow:Yr-QLnzwpki2dpvKqOGIBsLQdqtLpZq_.dSPe9aHFmODxEW6D9ubp-18uF24fXqS_0 2024-09-19T15:31:38.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.672+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4157918242813061854', time=2024-09-19T17:12:51.933782+0000, chain.objs.size()=6 2024-09-19T15:31:38.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.672+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.613__multipart_multipart_enc.2~KtqnLDnXBRPwSIDCTsr8pDe769TmfHN.1 2024-09-19T15:31:38.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.672+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.613__multipart_multipart_enc.2~KtqnLDnXBRPwSIDCTsr8pDe769TmfHN.2 2024-09-19T15:31:38.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.672+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.613__multipart_multipart_enc.2~KtqnLDnXBRPwSIDCTsr8pDe769TmfHN.3 2024-09-19T15:31:38.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.672+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.613__multipart_multipart_enc.2~KtqnLDnXBRPwSIDCTsr8pDe769TmfHN.4 2024-09-19T15:31:38.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.672+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.613__multipart_multipart_enc.2~KtqnLDnXBRPwSIDCTsr8pDe769TmfHN.5 2024-09-19T15:31:38.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.672+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.613__multipart_multipart_enc.2~KtqnLDnXBRPwSIDCTsr8pDe769TmfHN.6 2024-09-19T15:31:38.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.676+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8970446919671654281', time=2024-09-19T17:15:23.187171+0000, chain.objs.size()=1 2024-09-19T15:31:38.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.676+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.617__shadow_.-6_eqCfQtVjNkrdSXjFsjVbAbwLB78S_0 2024-09-19T15:31:38.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.676+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~bpiV_cEW5hBrmoUeJ6R0akEdEOGMTUh', time=2024-09-19T17:17:39.544390+0000, chain.objs.size()=6 2024-09-19T15:31:38.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.676+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.624__multipart_multipart_enc.2~bpiV_cEW5hBrmoUeJ6R0akEdEOGMTUh.1 2024-09-19T15:31:38.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.676+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.624__multipart_multipart_enc.2~bpiV_cEW5hBrmoUeJ6R0akEdEOGMTUh.2 2024-09-19T15:31:38.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.676+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.624__multipart_multipart_enc.2~bpiV_cEW5hBrmoUeJ6R0akEdEOGMTUh.3 2024-09-19T15:31:38.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.676+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.624__multipart_multipart_enc.2~bpiV_cEW5hBrmoUeJ6R0akEdEOGMTUh.4 2024-09-19T15:31:38.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.676+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.624__multipart_multipart_enc.2~bpiV_cEW5hBrmoUeJ6R0akEdEOGMTUh.5 2024-09-19T15:31:38.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.676+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.624__multipart_multipart_enc.2~bpiV_cEW5hBrmoUeJ6R0akEdEOGMTUh.6 2024-09-19T15:31:38.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.676+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8012960686145566642', time=2024-09-19T17:21:10.351883+0000, chain.objs.size()=1 2024-09-19T15:31:38.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.676+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.679__shadow_.-miqcweKkImLyp7KIy5D_UeaI8qJyJB_0 2024-09-19T15:31:38.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.676+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8823716015578318820', time=2024-09-19T17:22:44.242603+0000, chain.objs.size()=1 2024-09-19T15:31:38.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.676+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.717__shadow:dNX1DTk6uJ7uSxc3ZVrhMdW3zNLfWvY_.4FiJwskLYKI5r_97T3_1m78KjEpL8kP_0 2024-09-19T15:31:38.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.676+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5122973275113704519', time=2024-09-19T17:28:03.346930+0000, chain.objs.size()=1 2024-09-19T15:31:38.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.676+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.771__shadow_.gC7F_2r2Gz8hI4mnHTllwAYkLjkOE5l_0 2024-09-19T15:31:38.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.684+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:38.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T15:31:38.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:38.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:38.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44825' 2024-09-19T15:31:38.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7961491459032855253', time=2024-09-19T16:32:49.857620+0000, chain.objs.size()=3 2024-09-19T15:31:38.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.159__multipart_mymultipart-LUKEWARM.2~d2gjQIsY1kkq_-jIId0tWwOjsYwDdqW.1 2024-09-19T15:31:38.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.159__multipart_mymultipart-LUKEWARM.2~d2gjQIsY1kkq_-jIId0tWwOjsYwDdqW.2 2024-09-19T15:31:38.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.159__multipart_mymultipart-LUKEWARM.2~d2gjQIsY1kkq_-jIId0tWwOjsYwDdqW.3 2024-09-19T15:31:38.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15334770681160476071', time=2024-09-19T16:32:56.186172+0000, chain.objs.size()=2 2024-09-19T15:31:38.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.160__shadow_.EsCod8Fgpmb0JSfLh_uktaQx61REKBm_0 2024-09-19T15:31:38.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.160__shadow_.EsCod8Fgpmb0JSfLh_uktaQx61REKBm_1 2024-09-19T15:31:38.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11675472728035866815', time=2024-09-19T16:39:27.088267+0000, chain.objs.size()=1 2024-09-19T15:31:38.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.231__shadow_.ZytBD1DetqWwljrkRJjwTAD4DIM0cIZ_0 2024-09-19T15:31:38.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15208897383808182178', time=2024-09-19T16:39:34.059245+0000, chain.objs.size()=1 2024-09-19T15:31:38.696 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.234__shadow_.zUAMr6V55N2z8KIcKrwBBtmiGO6LT3Q_0 2024-09-19T15:31:38.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6965674773388877570', time=2024-09-19T16:39:52.630940+0000, chain.objs.size()=1 2024-09-19T15:31:38.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.241__shadow_.YK3WD6WyjKAUjMxH8ayd6aIgQ7PTWvh_0 2024-09-19T15:31:38.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8464997022339624205', time=2024-09-19T16:40:21.383968+0000, chain.objs.size()=1 2024-09-19T15:31:38.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.252__shadow_.CXUo0I_XxX6EsrE25GSgktxer1_SUIM_0 2024-09-19T15:31:38.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13205307260429812044', time=2024-09-19T16:40:23.670905+0000, chain.objs.size()=1 2024-09-19T15:31:38.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.253__shadow_.iF4pFHOhqnfTRLw9K7ZIqLId4ZscCQt_0 2024-09-19T15:31:38.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4589117689202931134', time=2024-09-19T16:40:30.535380+0000, chain.objs.size()=1 2024-09-19T15:31:38.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.256__shadow_.kB7_vAhR2w3b3LeFVFslx1FTk2cBJ8s_0 2024-09-19T15:31:38.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14057162737739886823', time=2024-09-19T16:42:28.130328+0000, chain.objs.size()=1 2024-09-19T15:31:38.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.688+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.EmTRd5mPaOTtiFFLMevS-6luDTUhtLC_0 2024-09-19T15:31:38.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.696+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3914974662638445383', time=2024-09-19T16:42:28.132716+0000, chain.objs.size()=1 2024-09-19T15:31:38.700 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.696+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ornPUSOV2x50qVxQn1sSkPpDFTw2N6v_0 2024-09-19T15:31:38.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.696+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8902058215098840262', time=2024-09-19T16:42:28.448638+0000, chain.objs.size()=1 2024-09-19T15:31:38.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.696+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Z22F_MV9zguZOR-eReKWFmMuPJ_FTK4_0 2024-09-19T15:31:38.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.696+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14457147595023360689', time=2024-09-19T16:42:28.522786+0000, chain.objs.size()=1 2024-09-19T15:31:38.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.696+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.f5JwZ23EEvV_C-npjOyTCWPcvkxs3lk_0 2024-09-19T15:31:38.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.696+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4279275546429953174', time=2024-09-19T16:42:28.804303+0000, chain.objs.size()=1 2024-09-19T15:31:38.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.696+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.HGVHU_xtrw0ZkC9vneQyOJ2JSpilAqO_0 2024-09-19T15:31:38.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.696+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5023265524864943907', time=2024-09-19T16:42:29.645888+0000, chain.objs.size()=1 2024-09-19T15:31:38.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.696+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_._df_-V93I9vLL61EMmxTaPe7IiXNQrb_0 2024-09-19T15:31:38.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.696+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11737728289427051211', time=2024-09-19T16:42:30.559561+0000, chain.objs.size()=1 2024-09-19T15:31:38.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.696+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.7EDwUurKoko0u0pFxFvCFcRl8i0d18A_0 2024-09-19T15:31:38.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.696+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6328245504766150849', time=2024-09-19T16:42:31.428564+0000, chain.objs.size()=1 2024-09-19T15:31:38.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.696+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.PWIHF92RGC61VIrhes1tJaYVdvywuUR_0 2024-09-19T15:31:38.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.696+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9353189671911986322', time=2024-09-19T16:42:32.648049+0000, chain.objs.size()=1 2024-09-19T15:31:38.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.696+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.4nMSMfCP8H3BJWlITdxDSzkCsSBTQ7__0 2024-09-19T15:31:38.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.696+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13836118703608668855', time=2024-09-19T16:42:33.170041+0000, chain.objs.size()=1 2024-09-19T15:31:38.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.696+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.eRDXF-3SNJ0VPGKkXwg_I7Js8LsgDGQ_0 2024-09-19T15:31:38.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.696+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14264113018457253487', time=2024-09-19T16:42:33.172184+0000, chain.objs.size()=1 2024-09-19T15:31:38.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.696+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.2Nsf0daILiPpmKMT0d9sJnK8ewDr3Vg_0 2024-09-19T15:31:38.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.696+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6445618467039838318', time=2024-09-19T16:42:34.421431+0000, chain.objs.size()=1 2024-09-19T15:31:38.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.696+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.rStlk8vY31-Ovxa5c7iOzIZlmRw7PDU_0 2024-09-19T15:31:38.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.696+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.492212032371289599', time=2024-09-19T16:42:35.051392+0000, chain.objs.size()=1 2024-09-19T15:31:38.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.696+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.bhQCwH-w68Z1tqhgEZoUzflL948elOA_0 2024-09-19T15:31:38.704 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.700+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13193930273331728205', time=2024-09-19T16:42:37.326044+0000, chain.objs.size()=1 2024-09-19T15:31:38.705 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.700+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.AHgV8XWj14rB31fSiHJy1iZSq5qhbEM_0 2024-09-19T15:31:38.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.704+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.492976213965038708', time=2024-09-19T16:42:37.836925+0000, chain.objs.size()=1 2024-09-19T15:31:38.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.704+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.LrrWhPoHwLtq4GUU0eGPTXOFegWvkxG_0 2024-09-19T15:31:38.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.704+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5122848303472325831', time=2024-09-19T16:42:42.417586+0000, chain.objs.size()=1 2024-09-19T15:31:38.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.704+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.1A4VO0pGRMJbxXmHxUH4MIwx8MAM6f-_0 2024-09-19T15:31:38.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.704+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12696422223520461949', time=2024-09-19T16:42:42.707664+0000, chain.objs.size()=1 2024-09-19T15:31:38.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.704+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Zqp9MXhLaLPMkx8nALcFpHRG0csdbmB_0 2024-09-19T15:31:38.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.704+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10801336708037024992', time=2024-09-19T16:42:42.709711+0000, chain.objs.size()=1 2024-09-19T15:31:38.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.704+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.vK5fT4iGzLKSlmboWQ6U--UPNSVT_Za_0 2024-09-19T15:31:38.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.704+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15750915245276217114', time=2024-09-19T16:42:42.711916+0000, chain.objs.size()=1 2024-09-19T15:31:38.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.704+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.jYCtLUbQsHYHDWiswJd-Sx2anMeqaOo_0 2024-09-19T15:31:38.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.704+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.545549952100822899', time=2024-09-19T16:42:43.163976+0000, chain.objs.size()=1 2024-09-19T15:31:38.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.704+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.FI-1WLYpR_GRLBO9YQdxNw5qxWhTbN1_0 2024-09-19T15:31:38.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.704+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1140071036379733706', time=2024-09-19T16:42:45.289924+0000, chain.objs.size()=1 2024-09-19T15:31:38.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.704+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.o1IFOQSUyHIl_EF7SOV0PvzPP39MZXq_0 2024-09-19T15:31:38.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.704+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17320346720327776814', time=2024-09-19T16:42:46.656549+0000, chain.objs.size()=1 2024-09-19T15:31:38.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.704+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_._7qofdd3R1Nw2fpGx-lN6N53UNzo_Db_0 2024-09-19T15:31:38.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.704+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8334595610759371007', time=2024-09-19T16:42:48.293714+0000, chain.objs.size()=1 2024-09-19T15:31:38.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.704+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_._9_xr-BKQbH-Yyvb5A3p0POpfCEdxTI_0 2024-09-19T15:31:38.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.704+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10770454839765831486', time=2024-09-19T16:42:48.421106+0000, chain.objs.size()=1 2024-09-19T15:31:38.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.704+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.qhd0be9FAea5_aumv3mttxQCxcXCFj0_0 2024-09-19T15:31:38.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.704+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11257372366537446534', time=2024-09-19T16:42:49.304023+0000, chain.objs.size()=1 2024-09-19T15:31:38.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.704+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.kcfqKiyZ9FAucT0m-hJKyCxbVzFE0ql_0 2024-09-19T15:31:38.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.708+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7517194433149320915', time=2024-09-19T16:42:49.306278+0000, chain.objs.size()=1 2024-09-19T15:31:38.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.708+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Ddn4FWC0XFVv_KL6kPAds9DSvVopHpv_0 2024-09-19T15:31:38.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.708+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.475390257591830269', time=2024-09-19T16:42:50.733374+0000, chain.objs.size()=1 2024-09-19T15:31:38.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.708+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.jx_810bf5EoQrG6eEVS68tA979t45xf_0 2024-09-19T15:31:38.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.708+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15985956152633316585', time=2024-09-19T16:42:52.107241+0000, chain.objs.size()=1 2024-09-19T15:31:38.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.708+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.oJOtEZynmyPOKu_39LQkWONnu2po7dE_0 2024-09-19T15:31:38.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.708+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14633673876041134783', time=2024-09-19T16:42:54.959580+0000, chain.objs.size()=1 2024-09-19T15:31:38.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.708+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.dSPB7dDWK6TDJPBkhJc4bVwmjRz8Ciq_0 2024-09-19T15:31:38.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.708+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12097394800668185257', time=2024-09-19T16:42:56.615845+0000, chain.objs.size()=1 2024-09-19T15:31:38.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.708+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.rwe6gXMpGNVbk6ZxF5a6M7mskih2hkG_0 2024-09-19T15:31:38.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.708+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2954179700001719923', time=2024-09-19T16:42:58.711562+0000, chain.objs.size()=1 2024-09-19T15:31:38.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.708+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.cX85S6JvIfipWwYbJp4QEGh6fR2Dnhc_0 2024-09-19T15:31:38.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.708+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15943257989538836777', time=2024-09-19T16:43:00.001984+0000, chain.objs.size()=1 2024-09-19T15:31:38.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.708+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.dlTXCuEjrj3Fzj3TNxWPSZpWToFKgx2_0 2024-09-19T15:31:38.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.708+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3200644169446744703', time=2024-09-19T16:43:02.353454+0000, chain.objs.size()=1 2024-09-19T15:31:38.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.708+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.263__shadow_.fMkJy6qEVQCNvFAV8Mm4Uhs4AkOKfR3_0 2024-09-19T15:31:38.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.708+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12164284706692220703', time=2024-09-19T16:43:38.191408+0000, chain.objs.size()=1 2024-09-19T15:31:38.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.708+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.279__shadow_.ETMFugTHwnKzcZEOVINyO71LTxri8fk_0 2024-09-19T15:31:38.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.708+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11775228663899791841', time=2024-09-19T16:43:45.140858+0000, chain.objs.size()=1 2024-09-19T15:31:38.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.708+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.282__shadow_.W5yudqtLczOcJaYVMgBkUET4hjaJtGX_0 2024-09-19T15:31:38.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.708+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3986164541032315226', time=2024-09-19T16:43:49.781374+0000, chain.objs.size()=1 2024-09-19T15:31:38.716 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.708+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.284__shadow_.8ZJ9tkevbDzkws_6_ACP6aeUVyO7NvL_0 2024-09-19T15:31:38.717 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.712+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7267600239493918129', time=2024-09-19T16:44:04.090859+0000, chain.objs.size()=1 2024-09-19T15:31:38.717 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.712+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.290__shadow_.CaMUt2MSwqj7ccpu1EBoz7xvpVZPWjJ_0 2024-09-19T15:31:38.717 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.712+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6975807799374489405', time=2024-09-19T16:44:04.100094+0000, chain.objs.size()=1 2024-09-19T15:31:38.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.712+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.290__shadow_.q24ugkM66XzSNphsJt0zuTkZGqQZKfl_0 2024-09-19T15:31:38.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.712+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4563661736379115349', time=2024-09-19T16:44:12.335587+0000, chain.objs.size()=1 2024-09-19T15:31:38.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.712+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_.f033X0oJRgpvF5WLJEJJnFmUODrjWNp_0 2024-09-19T15:31:38.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.712+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18187698679020148837', time=2024-09-19T16:44:18.247135+0000, chain.objs.size()=1 2024-09-19T15:31:38.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.712+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.iTCYeLWIfSfe3GDoIYeQcb371mDPSn6_0 2024-09-19T15:31:38.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.712+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12119801809658646278', time=2024-09-19T16:44:33.108313+0000, chain.objs.size()=1 2024-09-19T15:31:38.719 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.712+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.299__shadow_.axfhEF1tzImFijMoGshe3DpLZCcoqQG_0 2024-09-19T15:31:38.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.716+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.587740012293088389', time=2024-09-19T16:44:49.846820+0000, chain.objs.size()=1 2024-09-19T15:31:38.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.716+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.306__shadow_.nw7eS4psFBpmwSyl66cJJm56Tfq2GMG_0 2024-09-19T15:31:38.720 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.716+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.750161716494744865', time=2024-09-19T16:47:18.595371+0000, chain.objs.size()=1 2024-09-19T15:31:38.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.716+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.EN3Apj-lPrRZFT-AjXA3Cye6ExnShtY_0 2024-09-19T15:31:38.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.716+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3721342215503704816', time=2024-09-19T16:47:19.090285+0000, chain.objs.size()=1 2024-09-19T15:31:38.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.716+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.8mEmkALBY9HBpA6ehYIdP3bW8MAiEtt_0 2024-09-19T15:31:38.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.716+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15777383604976143372', time=2024-09-19T16:47:20.450337+0000, chain.objs.size()=1 2024-09-19T15:31:38.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.716+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.9-KACZOy23JoKwbqsa8QSUEThqPC11F_0 2024-09-19T15:31:38.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.716+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4741574022779375098', time=2024-09-19T16:47:20.549879+0000, chain.objs.size()=1 2024-09-19T15:31:38.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.716+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.L_5LKAjB6Ziq-zsRVgJuWVwOu2ruAQE_0 2024-09-19T15:31:38.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.716+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.72300443220702846', time=2024-09-19T16:47:21.285642+0000, chain.objs.size()=1 2024-09-19T15:31:38.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.716+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.5kFd_PfP48xg8KDhoNUCjPUiuC4kv4A_0 2024-09-19T15:31:38.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.716+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4519129625077659523', time=2024-09-19T16:47:24.078469+0000, chain.objs.size()=1 2024-09-19T15:31:38.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.716+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.sEvf_SXLe9gQDr1BeWgLtqiHBGxFin5_0 2024-09-19T15:31:38.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.716+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12180031015392267668', time=2024-09-19T16:47:26.687419+0000, chain.objs.size()=1 2024-09-19T15:31:38.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.716+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.kp0WmZWtFaXzOEef4QXJ3zkK1_JOAjV_0 2024-09-19T15:31:38.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6331945553556885201', time=2024-09-19T16:47:27.384403+0000, chain.objs.size()=1 2024-09-19T15:31:38.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.6gKecanFpLMLRQlg51GK4oICRrcjLvr_0 2024-09-19T15:31:38.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1486554806849255332', time=2024-09-19T16:47:29.322991+0000, chain.objs.size()=1 2024-09-19T15:31:38.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.EOic5xuB-q8ULe-TZyP1YfcyNDO2RXL_0 2024-09-19T15:31:38.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17236364301994638263', time=2024-09-19T16:47:29.514584+0000, chain.objs.size()=1 2024-09-19T15:31:38.724 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.FvOo1Fc4ZarhNYdLgz9lWfUYK3YVN-U_0 2024-09-19T15:31:38.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9965117394128779615', time=2024-09-19T16:47:29.903805+0000, chain.objs.size()=1 2024-09-19T15:31:38.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.aXzdTRNMYnz92ahpcbFEBBJBtsrqpDQ_0 2024-09-19T15:31:38.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18147336472428556945', time=2024-09-19T16:47:31.520150+0000, chain.objs.size()=1 2024-09-19T15:31:38.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.i8-41C_PQf0BdecKf8aQEPIdRhf8UD7_0 2024-09-19T15:31:38.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13535435787708319484', time=2024-09-19T16:47:32.574534+0000, chain.objs.size()=1 2024-09-19T15:31:38.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.33H5lykJbXCntEkmJbcPD47RuS_5ML__0 2024-09-19T15:31:38.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8580498167383347454', time=2024-09-19T16:47:32.904390+0000, chain.objs.size()=1 2024-09-19T15:31:38.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.HtzsgdW0xYvl8-qlljV07KZUTGgzHg__0 2024-09-19T15:31:38.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6747838815022098925', time=2024-09-19T16:47:33.262276+0000, chain.objs.size()=1 2024-09-19T15:31:38.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.TvqTlXDCdzKsa7MYxWKCD7PikpSNzLY_0 2024-09-19T15:31:38.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4428956362373236498', time=2024-09-19T16:47:33.320898+0000, chain.objs.size()=1 2024-09-19T15:31:38.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.p7wBVHCwQPuJx99HWsjbIebN7udqdu-_0 2024-09-19T15:31:38.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12900927572824436406', time=2024-09-19T16:47:34.374887+0000, chain.objs.size()=1 2024-09-19T15:31:38.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.TwFIouFvhomBxrZODau2cOiSc5ZPJcI_0 2024-09-19T15:31:38.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9210590844308018393', time=2024-09-19T16:47:35.373370+0000, chain.objs.size()=1 2024-09-19T15:31:38.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.-jDEF_lOPpp7yq4pZxcQhUV1RAmcgR3_0 2024-09-19T15:31:38.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9181832471729878895', time=2024-09-19T16:47:37.269954+0000, chain.objs.size()=1 2024-09-19T15:31:38.727 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.sx4neiO7Sck4jHJsIvochTc5S7gfPhr_0 2024-09-19T15:31:38.728 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10775392497362697868', time=2024-09-19T16:47:37.894795+0000, chain.objs.size()=1 2024-09-19T15:31:38.728 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.720+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.k7SkEup5jHV7LTUZWbWLAmEfAHdPeM1_0 2024-09-19T15:31:38.728 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.724+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13950117964145496182', time=2024-09-19T16:47:38.385523+0000, chain.objs.size()=1 2024-09-19T15:31:38.728 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.724+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.m2kT_G2c6J9pQ7Kl4V25nlw9lQc-1AX_0 2024-09-19T15:31:38.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.724+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6874223685637322378', time=2024-09-19T16:47:40.131075+0000, chain.objs.size()=1 2024-09-19T15:31:38.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.724+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Gl0sPglRSJDyM8WScrWV4GS-wqU38f9_0 2024-09-19T15:31:38.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.724+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4611627700905136653', time=2024-09-19T16:47:40.531667+0000, chain.objs.size()=1 2024-09-19T15:31:38.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.724+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.NZuFXkjCDZxFY2TnInmVfZl5KeFE-F7_0 2024-09-19T15:31:38.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.724+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16468011416253985981', time=2024-09-19T16:47:41.953146+0000, chain.objs.size()=1 2024-09-19T15:31:38.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.724+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.gGHhnyPnGjLcgSi7BU2cYLkwxitgW84_0 2024-09-19T15:31:38.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.724+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9005890993740498467', time=2024-09-19T16:47:42.301654+0000, chain.objs.size()=1 2024-09-19T15:31:38.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.724+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Wt7qBPsZbD_r6qZ4yZqrAbVBEbKlOwk_0 2024-09-19T15:31:38.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.724+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8704460945252496355', time=2024-09-19T16:47:44.002453+0000, chain.objs.size()=1 2024-09-19T15:31:38.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.724+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.OQAsd_y3Cl29cfKLhH8yTZ9n12SmBqF_0 2024-09-19T15:31:38.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.724+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1147872306373343693', time=2024-09-19T16:47:44.441718+0000, chain.objs.size()=1 2024-09-19T15:31:38.730 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.724+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_._X4MhSJQ7IPT4KTF9MgFwBdBWusjl6I_0 2024-09-19T15:31:38.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.724+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1431135381503025533', time=2024-09-19T16:47:44.598236+0000, chain.objs.size()=1 2024-09-19T15:31:38.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.724+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.r9y2Ut0N07hmuUx-7GjzJUZZRku2T-H_0 2024-09-19T15:31:38.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.724+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17772680837524665975', time=2024-09-19T16:47:44.697849+0000, chain.objs.size()=1 2024-09-19T15:31:38.731 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.724+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.05lG6Q1u2kVRnlKn-tKH1OpwSg1Y496_0 2024-09-19T15:31:38.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.728+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2867726180814668907', time=2024-09-19T16:47:45.332679+0000, chain.objs.size()=1 2024-09-19T15:31:38.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.728+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.h_QpPI_WzFHskxcX_1-W59qtRJeWY79_0 2024-09-19T15:31:38.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.728+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7013531475239350687', time=2024-09-19T16:47:46.134535+0000, chain.objs.size()=1 2024-09-19T15:31:38.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.728+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.0n5sLMK5-GjGqo-P3kXE6yrh5JeHCLu_0 2024-09-19T15:31:38.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.728+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3646033300243201250', time=2024-09-19T16:47:46.618399+0000, chain.objs.size()=1 2024-09-19T15:31:38.733 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.728+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.jHi_kLGyqZPIAKFqT5ftQrUSMZJz15Y_0 2024-09-19T15:31:38.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.728+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6570332215079966278', time=2024-09-19T16:47:47.875698+0000, chain.objs.size()=1 2024-09-19T15:31:38.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.728+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.NQQ-upPqWgwMDpuoz7VIGBqbo5LZi01_0 2024-09-19T15:31:38.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.732+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6416084853240633567', time=2024-09-19T16:47:48.991200+0000, chain.objs.size()=1 2024-09-19T15:31:38.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.732+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.fK8zv0qnOdEypZhAK3l5-8YKQ6iXGvF_0 2024-09-19T15:31:38.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.732+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3510070989927096563', time=2024-09-19T16:49:34.893237+0000, chain.objs.size()=1 2024-09-19T15:31:38.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.732+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.vQaHHV3QqOF65yQ3qjVbvYINrYdxTtN_0 2024-09-19T15:31:38.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.732+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16752755072686086789', time=2024-09-19T16:49:34.907785+0000, chain.objs.size()=1 2024-09-19T15:31:38.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.732+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.D2uls8TJnhPOpscyUBjv5TAwPT5XaKF_0 2024-09-19T15:31:38.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.732+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8181357711573044512', time=2024-09-19T16:49:36.027536+0000, chain.objs.size()=1 2024-09-19T15:31:38.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.732+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.MWdQqR-BLMFrLF78ARNiONfRwJkWjzm_0 2024-09-19T15:31:38.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.732+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11849659000217398182', time=2024-09-19T16:49:36.637472+0000, chain.objs.size()=1 2024-09-19T15:31:38.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.732+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.KmrzuA4oWeha1SWqnT1JzxDb-mn4MPK_0 2024-09-19T15:31:38.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.732+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13269822975852911168', time=2024-09-19T16:49:36.732038+0000, chain.objs.size()=1 2024-09-19T15:31:38.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.732+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.NxuezRM_oeNVOzOUpwbRQtAxg-ULnzP_0 2024-09-19T15:31:38.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.732+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15705644617158925982', time=2024-09-19T16:49:37.625764+0000, chain.objs.size()=1 2024-09-19T15:31:38.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.732+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ta9uhupOp0dd2IM2snp42F1egeqbfDu_0 2024-09-19T15:31:38.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.732+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12775686836763127252', time=2024-09-19T16:49:38.115153+0000, chain.objs.size()=1 2024-09-19T15:31:38.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.732+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.hYWcsIj4VMyjEaTWB1Ymx-Ca4XEBaeY_0 2024-09-19T15:31:38.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.732+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9719039852725391369', time=2024-09-19T16:49:39.429942+0000, chain.objs.size()=1 2024-09-19T15:31:38.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.732+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.MljoTNCZawEqbF02hbF3UPsaE1I0kWS_0 2024-09-19T15:31:38.739 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.732+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12406772383258133927', time=2024-09-19T16:49:40.488220+0000, chain.objs.size()=1 2024-09-19T15:31:38.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.732+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.NbM6Ixw_pVk-H8A-_UrLiKkWy9YnyUj_0 2024-09-19T15:31:38.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.732+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15399718419987224276', time=2024-09-19T16:49:40.693265+0000, chain.objs.size()=1 2024-09-19T15:31:38.740 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.732+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.m9uZp7PEvbbpzk7jOhFg7UMAOmTz5ke_0 2024-09-19T15:31:38.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.736+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12411814003499447298', time=2024-09-19T16:49:41.313506+0000, chain.objs.size()=1 2024-09-19T15:31:38.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.736+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.-fCbX6I6GuE44UVUOtGsvuyfGxBqm5J_0 2024-09-19T15:31:38.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.736+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.798036358564002344', time=2024-09-19T16:49:41.737278+0000, chain.objs.size()=1 2024-09-19T15:31:38.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.736+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.yz-XeZNcy0h8EzeogP3IamAtLeJX31p_0 2024-09-19T15:31:38.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.736+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4586195078526259066', time=2024-09-19T16:49:42.139943+0000, chain.objs.size()=1 2024-09-19T15:31:38.741 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.736+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.YjodqcwNeVvdMwwc-Bke27ggvUSkGpT_0 2024-09-19T15:31:38.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.736+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15539403544746365568', time=2024-09-19T16:49:42.433071+0000, chain.objs.size()=1 2024-09-19T15:31:38.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.736+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.H_YU68t4HArzA6sPBmcSYIsBkgH9oqd_0 2024-09-19T15:31:38.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.736+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11031690684917680802', time=2024-09-19T16:49:47.872091+0000, chain.objs.size()=1 2024-09-19T15:31:38.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.736+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.sFntZul5pxji_htPiY22L21HHnHGoK6_0 2024-09-19T15:31:38.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.736+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10976846093902741843', time=2024-09-19T16:49:50.891384+0000, chain.objs.size()=1 2024-09-19T15:31:38.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.736+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_._VAW_DHvTUeOHwAtgXsXQ2LYgRfaVkA_0 2024-09-19T15:31:38.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.740+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44825 2024-09-19T15:31:38.749 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-19T15:31:38.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16333929846032210923', time=2024-09-19T16:49:52.412417+0000, chain.objs.size()=1 2024-09-19T15:31:38.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.bHa2vjM7bEe__WzIRSFxZ2Mv7zTNtY9_0 2024-09-19T15:31:38.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9841642019404961759', time=2024-09-19T16:49:55.171749+0000, chain.objs.size()=1 2024-09-19T15:31:38.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ympwYTSPCHkGPdXwYjOBRDtaSVqkV5f_0 2024-09-19T15:31:38.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3777561148826135574', time=2024-09-19T16:49:56.703176+0000, chain.objs.size()=1 2024-09-19T15:31:38.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.n9cMzDAAbv0xhJYIkybD4f9SMWKxi1L_0 2024-09-19T15:31:38.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12108925265328660906', time=2024-09-19T16:49:58.922090+0000, chain.objs.size()=1 2024-09-19T15:31:38.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ufDotmJTzy3bmfAiUWDdGdXHid02OLo_0 2024-09-19T15:31:38.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6590741211123842987', time=2024-09-19T16:50:00.092805+0000, chain.objs.size()=1 2024-09-19T15:31:38.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.hQQ6msG3xx08gPEwwmV-_J5JMKLe2Oi_0 2024-09-19T15:31:38.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11318468788789051520', time=2024-09-19T16:50:00.103964+0000, chain.objs.size()=1 2024-09-19T15:31:38.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.SCRtWD76NH4yhTjdEToABz0uve_rpyK_0 2024-09-19T15:31:38.750 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16689165413145899814', time=2024-09-19T16:50:00.441439+0000, chain.objs.size()=1 2024-09-19T15:31:38.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.D_gySf9CBeoKkLI-wxT72aniwivPFSS_0 2024-09-19T15:31:38.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3109001004959655479', time=2024-09-19T16:50:01.157930+0000, chain.objs.size()=1 2024-09-19T15:31:38.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.r0VGE-2-JH_72Ig85nB1dZlBW0TqZKg_0 2024-09-19T15:31:38.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16508135978297931634', time=2024-09-19T16:50:01.934197+0000, chain.objs.size()=1 2024-09-19T15:31:38.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.wtdRPsAd3BCtEiEL4C18jJRdvBx2bCh_0 2024-09-19T15:31:38.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7928646034459829014', time=2024-09-19T16:50:03.933801+0000, chain.objs.size()=1 2024-09-19T15:31:38.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.u0UEVyXL6eiKs6XyFWLGYSNsTImKyMb_0 2024-09-19T15:31:38.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1044258534122900140', time=2024-09-19T16:50:04.340654+0000, chain.objs.size()=1 2024-09-19T15:31:38.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.mTohbIs0xrXCQI1CZPoB91UE92pDSUC_0 2024-09-19T15:31:38.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16983966413352631025', time=2024-09-19T16:50:05.632513+0000, chain.objs.size()=1 2024-09-19T15:31:38.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.744+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.yb8Cy4inscBRp2pY59stFxO9XVP8xoX_0 2024-09-19T15:31:38.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.748+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1649471679557897707', time=2024-09-19T16:50:06.531861+0000, chain.objs.size()=1 2024-09-19T15:31:38.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.748+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.yiiJBCY_zGhQ2hzYqxJypO_IhBs5rR8_0 2024-09-19T15:31:38.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.748+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16483981739316287188', time=2024-09-19T16:50:30.779729+0000, chain.objs.size()=1 2024-09-19T15:31:38.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.748+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.336__shadow_.eMQeKoQYKWa8wENy6LuIMA32rZSUur9_0 2024-09-19T15:31:38.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.748+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3439490204939261075', time=2024-09-19T16:54:36.726315+0000, chain.objs.size()=1 2024-09-19T15:31:38.754 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.748+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.456__shadow_.7IdT09tdbxyudO3Af1gBrRfMpjKgxvg_0 2024-09-19T15:31:38.756 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.752+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7318333889718931175', time=2024-09-19T16:55:32.869735+0000, chain.objs.size()=1 2024-09-19T15:31:38.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.752+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.483__shadow_.agk9usdNI07DK33xm7Q9-B7fh0QvrJ0_0 2024-09-19T15:31:38.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.752+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14498260346580808334', time=2024-09-19T17:07:46.775743+0000, chain.objs.size()=1 2024-09-19T15:31:38.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.752+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:wgfVS-cPpUcRg40dGoDb39x0J8ylQmR_.gGFXjgMHUoCo74nBtH4LwLVk66Vzet6_0 2024-09-19T15:31:38.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.752+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2287410809885709753', time=2024-09-19T17:08:43.058968+0000, chain.objs.size()=1 2024-09-19T15:31:38.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.752+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.576__shadow:kjx8i.raHkYXQhul-c8a2qsBRN-R-5p_.gBv3jr0BH5FXu33SO8Qv6E2VxXYGXUF_0 2024-09-19T15:31:38.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.752+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14060265854419652159', time=2024-09-19T17:10:35.637749+0000, chain.objs.size()=1 2024-09-19T15:31:38.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.752+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.580__shadow:XpqhCiBE8OpDZ7-SorngDfEDxvS0GLp_.k7KmdDTKR1NdGKPG-6n0-_CFgl9kXFN_0 2024-09-19T15:31:38.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.752+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13450509149933437310', time=2024-09-19T17:10:35.664061+0000, chain.objs.size()=1 2024-09-19T15:31:38.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.752+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.580__shadow:VGr3t5gpx74PQq3rgN4SSfKjuVTp2ny_.kzn6JVRO5EL0TOJ-c8jE-8QAM9bzvvM_0 2024-09-19T15:31:38.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.752+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6072313547643455241', time=2024-09-19T17:10:56.254105+0000, chain.objs.size()=1 2024-09-19T15:31:38.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.752+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.587__shadow:YkhBxONjFzgqrv93mW8sQdgYToYHC20_.FNlgbYNcMifBwgzKqfNSZJmK56Rm-3v_0 2024-09-19T15:31:38.757 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.752+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12363272599047007408', time=2024-09-19T17:10:56.320047+0000, chain.objs.size()=1 2024-09-19T15:31:38.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.752+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.587__shadow:lD0xpqvVHfTppKlCBT3UjN5H8dyCmqd_.HtrdnYb-BqFSGQEU0kLa9x1KHc7gmA9_0 2024-09-19T15:31:38.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.752+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10025693994568198262', time=2024-09-19T17:18:30.020592+0000, chain.objs.size()=1 2024-09-19T15:31:38.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.752+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.640__shadow_.GTUGPP94KIx_uVU7NJuJhOciO_bk1j2_0 2024-09-19T15:31:38.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.752+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3925087877932378293', time=2024-09-19T17:19:29.928088+0000, chain.objs.size()=1 2024-09-19T15:31:38.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.752+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.654__shadow_.EWT-ygDlwmPOMa_jHMEg3PbeCfj8uAH_0 2024-09-19T15:31:38.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.752+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7241401648800897731', time=2024-09-19T17:20:47.014906+0000, chain.objs.size()=1 2024-09-19T15:31:38.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.752+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.666__shadow_.iO0wtd2SwkngzmEJHBdex50ublZAx39_0 2024-09-19T15:31:38.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.752+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4101109051811086810', time=2024-09-19T17:20:47.646179+0000, chain.objs.size()=1 2024-09-19T15:31:38.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.752+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.666__shadow_.P1JL4TgCICnEyPelSjrtDVFMw91Wucx_0 2024-09-19T15:31:38.761 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.756+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14872053455107721866', time=2024-09-19T17:20:56.245113+0000, chain.objs.size()=1 2024-09-19T15:31:38.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.756+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.671__shadow_.tL_4ZaMWZ3tCQlz_Bqhf2PIegE9S2mq_0 2024-09-19T15:31:38.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.756+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8450713771338299728', time=2024-09-19T17:22:01.429540+0000, chain.objs.size()=1 2024-09-19T15:31:38.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.756+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.705__shadow:cllKB36EPyxkkAdmLe5w63fHn70fVhb_.TYYIw9jJJ5UdM3g08aITM9wKBXddjVw_0 2024-09-19T15:31:38.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.756+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1383136820067628142', time=2024-09-19T17:22:15.456881+0000, chain.objs.size()=1 2024-09-19T15:31:38.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.756+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.712__shadow:M-zFWNRN18FTNQl4b-V1YJjopGdy7sC_.IMnwVWSbA--xmAfuXipj-4o33hN4rn4_0 2024-09-19T15:31:38.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.760+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:38.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T15:31:38.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:38.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:38.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49094' 2024-09-19T15:31:38.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10336533215359053181', time=2024-09-19T16:32:31.284624+0000, chain.objs.size()=2 2024-09-19T15:31:38.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.158__shadow_.k6mCa5WdC2pp3aZoEF6FahomIaYP-T8_0 2024-09-19T15:31:38.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.158__shadow_.k6mCa5WdC2pp3aZoEF6FahomIaYP-T8_1 2024-09-19T15:31:38.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15968921979321536484', time=2024-09-19T16:34:50.971579+0000, chain.objs.size()=1 2024-09-19T15:31:38.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.179__shadow_.DbKsjiVZ0PRFGOow6g9ikOW6HJPQDXc_0 2024-09-19T15:31:38.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15432776975390208953', time=2024-09-19T16:39:24.752869+0000, chain.objs.size()=1 2024-09-19T15:31:38.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.230__shadow_.XXq9-tcTsZTb6R1e8D3Jmcjh0pKP7zN_0 2024-09-19T15:31:38.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1103576128061656259', time=2024-09-19T16:39:42.443697+0000, chain.objs.size()=1 2024-09-19T15:31:38.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.237__shadow_.SdXBbJYjMnjv9GlzmwVkUmvttd_MIAm_0 2024-09-19T15:31:38.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14137052853439531048', time=2024-09-19T16:42:28.454536+0000, chain.objs.size()=1 2024-09-19T15:31:38.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.G3S-s-kfWiqIJbozJGZ8f1dfbTotGKH_0 2024-09-19T15:31:38.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16591843306118024985', time=2024-09-19T16:42:28.584269+0000, chain.objs.size()=1 2024-09-19T15:31:38.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.4tz1CnAqbWEIzWbqEEYDBcD_qvKCzwT_0 2024-09-19T15:31:38.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5055592779053632164', time=2024-09-19T16:42:28.977612+0000, chain.objs.size()=1 2024-09-19T15:31:38.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.wcB-XwMzW0K95jFvmnYQeWBauylRylg_0 2024-09-19T15:31:38.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3654348671107790784', time=2024-09-19T16:42:33.998252+0000, chain.objs.size()=1 2024-09-19T15:31:38.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.q-LLwbZ5SnkIf89CSRgwkWYXX4kKXJn_0 2024-09-19T15:31:38.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1289199545271478160', time=2024-09-19T16:42:37.307033+0000, chain.objs.size()=1 2024-09-19T15:31:38.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.zr6-tDTu87iQr38lxWerk2RPtnq1l8P_0 2024-09-19T15:31:38.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15341992450304294043', time=2024-09-19T16:42:37.834880+0000, chain.objs.size()=1 2024-09-19T15:31:38.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.eeLaGgYNBH8cZ2GlihC7NMAbeN3aH0d_0 2024-09-19T15:31:38.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10139294103490793773', time=2024-09-19T16:42:39.441336+0000, chain.objs.size()=1 2024-09-19T15:31:38.773 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.764+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.yc0jWNi4pmVSwldWtv7lpIzxPwQIUdd_0 2024-09-19T15:31:38.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.768+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9262147206251643870', time=2024-09-19T16:42:40.008798+0000, chain.objs.size()=1 2024-09-19T15:31:38.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.768+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.M4N761vmCnVmLBx69GvPGTk3MAYf-BQ_0 2024-09-19T15:31:38.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.768+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14720121858972017965', time=2024-09-19T16:42:40.049940+0000, chain.objs.size()=1 2024-09-19T15:31:38.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.768+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.hQfbnwB4SG46ayqvqkUJ9rpvuG8Cg-__0 2024-09-19T15:31:38.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.772+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5422778752393897207', time=2024-09-19T16:42:41.582430+0000, chain.objs.size()=1 2024-09-19T15:31:38.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.772+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.0EexqZz2O6WQ5og5ITCxS3eog18OtST_0 2024-09-19T15:31:38.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.772+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9956640028715018479', time=2024-09-19T16:42:43.142540+0000, chain.objs.size()=1 2024-09-19T15:31:38.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.772+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.2gYQQwJDfzMGA7pghx1Mo0lF1I0ZkDD_0 2024-09-19T15:31:38.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.772+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1398632536939797731', time=2024-09-19T16:42:43.730230+0000, chain.objs.size()=1 2024-09-19T15:31:38.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.772+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.MHT-dB3RRQvtS3GOJJITrhgvHYqO1Gn_0 2024-09-19T15:31:38.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.772+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11058002062334492760', time=2024-09-19T16:42:43.917055+0000, chain.objs.size()=1 2024-09-19T15:31:38.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.772+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.wcaXo9Sz0QgmMoSqEmKFQ9QzD7WhLl0_0 2024-09-19T15:31:38.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.772+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.669841671204393234', time=2024-09-19T16:42:44.090812+0000, chain.objs.size()=1 2024-09-19T15:31:38.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.772+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.4OkZ_gRg3k9PIe5lB9_lr3VrRMK7gtR_0 2024-09-19T15:31:38.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.772+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7881198669818236292', time=2024-09-19T16:42:45.183928+0000, chain.objs.size()=1 2024-09-19T15:31:38.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.772+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.58OzHOFbg9Kqup_NxAtF8iMNco1ICIz_0 2024-09-19T15:31:38.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.772+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.245699158266054199', time=2024-09-19T16:42:48.055343+0000, chain.objs.size()=1 2024-09-19T15:31:38.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.772+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.uEbq8Cveik5aSUvyqQc7-DXXnDwLe_C_0 2024-09-19T15:31:38.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.772+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7236448874948342682', time=2024-09-19T16:42:49.723188+0000, chain.objs.size()=1 2024-09-19T15:31:38.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.772+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_._Z7JQTMID7NnM3IthAsep1H6mr8rWzm_0 2024-09-19T15:31:38.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.772+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.917437091698051346', time=2024-09-19T16:42:50.730739+0000, chain.objs.size()=1 2024-09-19T15:31:38.777 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.772+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.dEMswfLuqizTtmjvFlrfCUwgFxtWFqp_0 2024-09-19T15:31:38.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.772+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.27646920833619406', time=2024-09-19T16:42:50.996907+0000, chain.objs.size()=1 2024-09-19T15:31:38.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.772+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.NilRyvIMZ9_cUbGgO6jUMfa96t0qShO_0 2024-09-19T15:31:38.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.772+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13002994487613480505', time=2024-09-19T16:42:51.000367+0000, chain.objs.size()=1 2024-09-19T15:31:38.778 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.772+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Syvsf9nbybMm4aZOBKmRP6hLKFeCBFe_0 2024-09-19T15:31:38.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.776+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5304888970513673499', time=2024-09-19T16:42:53.370555+0000, chain.objs.size()=1 2024-09-19T15:31:38.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.776+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.eNBm5ZWLUuA0ypCULCY208ikuAY7hfL_0 2024-09-19T15:31:38.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.776+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7346233137560777175', time=2024-09-19T16:42:53.950888+0000, chain.objs.size()=1 2024-09-19T15:31:38.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.776+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.0WZs97QWtrMXV8-4PHeqyBvHOpa-64m_0 2024-09-19T15:31:38.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.776+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1173220650096943295', time=2024-09-19T16:42:53.962175+0000, chain.objs.size()=1 2024-09-19T15:31:38.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.776+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.dDfnQvP7xeszO63WsoYwVWMotUzETol_0 2024-09-19T15:31:38.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.776+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4760588367603975987', time=2024-09-19T16:42:54.146175+0000, chain.objs.size()=1 2024-09-19T15:31:38.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.776+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Hfz-1GCg-xks6lNiw7yiqELJtE5w85E_0 2024-09-19T15:31:38.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.776+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9434033885555441164', time=2024-09-19T16:42:54.519979+0000, chain.objs.size()=1 2024-09-19T15:31:38.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.776+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.R_68WpymYNyZgc2GiMg18_QtE65hI-R_0 2024-09-19T15:31:38.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.776+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6432896317870418044', time=2024-09-19T16:42:55.156585+0000, chain.objs.size()=1 2024-09-19T15:31:38.781 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.776+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.KvIEDVcl5tT8nHjXghufci51xclYTsF_0 2024-09-19T15:31:38.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.776+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2275420004880594959', time=2024-09-19T16:42:56.608265+0000, chain.objs.size()=1 2024-09-19T15:31:38.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.776+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.qZtLWJRN4MmDGHia_O_v_K7wUESflyG_0 2024-09-19T15:31:38.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.776+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.128684051172870550', time=2024-09-19T16:42:58.234329+0000, chain.objs.size()=1 2024-09-19T15:31:38.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.776+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Bpha9GYq0s_rv5CRMVmhWJzQvXWx6s8_0 2024-09-19T15:31:38.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.776+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13452203671673485497', time=2024-09-19T16:43:00.034393+0000, chain.objs.size()=1 2024-09-19T15:31:38.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.776+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.-x5NboBydOXbNvKhokIxloFXqziBbeO_0 2024-09-19T15:31:38.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.776+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13019088584011907626', time=2024-09-19T16:43:06.848489+0000, chain.objs.size()=1 2024-09-19T15:31:38.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.776+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.265__shadow_.HwnMUIfKUbMR-9YsA4oVoVCSRpQJYLc_0 2024-09-19T15:31:38.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.776+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4519988202201320700', time=2024-09-19T16:43:09.010071+0000, chain.objs.size()=1 2024-09-19T15:31:38.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.776+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.266__shadow_.HmbaKPbv3zOCsvq9F34MK2APhi_xOru_0 2024-09-19T15:31:38.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.776+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11462859443526076712', time=2024-09-19T16:43:59.408841+0000, chain.objs.size()=1 2024-09-19T15:31:38.784 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.776+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.288__shadow_.vl7zQ471fDd7HeyvcMs_iRhfr4zkk0M_0 2024-09-19T15:31:38.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.780+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16529321465408170854', time=2024-09-19T16:44:12.441834+0000, chain.objs.size()=1 2024-09-19T15:31:38.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.780+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_.xsLBgeFR-jXhRX8dVPftxKjmTScUkHB_0 2024-09-19T15:31:38.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.780+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9319436561174939702', time=2024-09-19T16:44:18.529734+0000, chain.objs.size()=1 2024-09-19T15:31:38.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.780+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.6AZGTnXfvJjB1FzBfChshXJbD1ryf3C_0 2024-09-19T15:31:38.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.780+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.369035155915454643', time=2024-09-19T16:44:33.089611+0000, chain.objs.size()=1 2024-09-19T15:31:38.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.780+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.299__shadow_.goJ-RyXsrHdl6GS5ss_MEjcHbgfsmPS_0 2024-09-19T15:31:38.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.780+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2079359338180987431', time=2024-09-19T16:44:33.118949+0000, chain.objs.size()=1 2024-09-19T15:31:38.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.780+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.299__shadow_.m5tVzRsmdRzsCuNKCQXeqZWGZRjabxW_0 2024-09-19T15:31:38.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.780+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18290744798180816382', time=2024-09-19T16:44:37.843275+0000, chain.objs.size()=1 2024-09-19T15:31:38.786 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.780+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.301__shadow_.7hwylq0x4jkZd9ASkYDYZxtwZ7XSloe_0 2024-09-19T15:31:38.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.784+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11657576928149782277', time=2024-09-19T16:45:26.269775+0000, chain.objs.size()=1 2024-09-19T15:31:38.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.784+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.319__shadow:t7sNXB1dSubt6su5DlwJuye8YtbJbq-_.yJtySLnHRVeqthHrUOJowerdLtgRfo__0 2024-09-19T15:31:38.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.784+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18020518695786981422', time=2024-09-19T16:47:22.966451+0000, chain.objs.size()=1 2024-09-19T15:31:38.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.784+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Fbb8q8O9bSY6QC4IApEetoLfaILSqCh_0 2024-09-19T15:31:38.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.784+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4566276483538345790', time=2024-09-19T16:47:24.397906+0000, chain.objs.size()=1 2024-09-19T15:31:38.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.784+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.OXP4XqbRSBTOCNI9io36uQjFmpZv3Db_0 2024-09-19T15:31:38.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.784+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8669535964993184941', time=2024-09-19T16:47:25.704779+0000, chain.objs.size()=1 2024-09-19T15:31:38.789 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.784+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.wn1kK-AVNw2Z2WgQPlau5CF-QQoH9gr_0 2024-09-19T15:31:38.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.788+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6121184962785525353', time=2024-09-19T16:47:27.112225+0000, chain.objs.size()=1 2024-09-19T15:31:38.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.788+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.4uGg6sY3wVfYI0C2Vpd0A31cF3URRtT_0 2024-09-19T15:31:38.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.788+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14564459910666704235', time=2024-09-19T16:47:27.873175+0000, chain.objs.size()=1 2024-09-19T15:31:38.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.788+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.zPS0ssSPLUm1JLTFr0rc9_UQBwXtrZ1_0 2024-09-19T15:31:38.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.788+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13802088198090574159', time=2024-09-19T16:47:28.633777+0000, chain.objs.size()=1 2024-09-19T15:31:38.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.788+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ija4x9wGFon9wOgQDDoxHjZgqmwwgJD_0 2024-09-19T15:31:38.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.788+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3113942790052392527', time=2024-09-19T16:47:28.949247+0000, chain.objs.size()=1 2024-09-19T15:31:38.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.788+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.o3xEZ6SYk7fuyzs1SSJylu7Iw7tfeBi_0 2024-09-19T15:31:38.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.788+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6443775355448429349', time=2024-09-19T16:47:31.089852+0000, chain.objs.size()=1 2024-09-19T15:31:38.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.788+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.YaXV6AeRiJ5YDO38sVvU5Va9A5kjm4k_0 2024-09-19T15:31:38.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.788+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1473715996865209480', time=2024-09-19T16:47:31.443697+0000, chain.objs.size()=1 2024-09-19T15:31:38.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.788+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Ze7OuFe2SwK6wzMm9urRrwYyjZPm2Xd_0 2024-09-19T15:31:38.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.788+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17248232465396382680', time=2024-09-19T16:47:31.891889+0000, chain.objs.size()=1 2024-09-19T15:31:38.793 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.788+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.WkGft5EFTYT-QPJ3_1aV_WxjSvbJBQL_0 2024-09-19T15:31:38.794 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.788+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12766348480435195767', time=2024-09-19T16:47:32.017333+0000, chain.objs.size()=1 2024-09-19T15:31:38.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.788+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.lCJV0XWNMgfQfqhOMG2M8FBoOUF1bNZ_0 2024-09-19T15:31:38.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.788+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5495501885981297202', time=2024-09-19T16:47:32.575152+0000, chain.objs.size()=1 2024-09-19T15:31:38.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.788+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.MXlWRlEB22Tzrevs-pqRuiFf4XiN9AC_0 2024-09-19T15:31:38.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.788+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6510599917328697717', time=2024-09-19T16:47:32.905103+0000, chain.objs.size()=1 2024-09-19T15:31:38.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.788+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.qgLi5ftb1aYBgoSD6_KPOT9iByE_GiM_0 2024-09-19T15:31:38.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.788+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6840737099034013941', time=2024-09-19T16:47:33.707852+0000, chain.objs.size()=1 2024-09-19T15:31:38.795 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.788+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.1afLsPZ1yOG69sF3srijNBbBrEUxRlz_0 2024-09-19T15:31:38.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.792+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12364717531841889770', time=2024-09-19T16:47:33.957341+0000, chain.objs.size()=1 2024-09-19T15:31:38.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.792+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.v5y-DGfQBXk3A869myXusREvsWdtLPn_0 2024-09-19T15:31:38.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.792+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2533983764611118734', time=2024-09-19T16:47:35.901565+0000, chain.objs.size()=1 2024-09-19T15:31:38.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.792+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.qEV_x8am5wRIGC_S0uz0FbEFLEt2r0V_0 2024-09-19T15:31:38.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.792+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2190352448125986925', time=2024-09-19T16:47:36.174803+0000, chain.objs.size()=1 2024-09-19T15:31:38.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.792+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.gm9LmOKpYM5Uf5kKHv_lJS-Z2q4R0Z-_0 2024-09-19T15:31:38.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.792+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6949158347403846210', time=2024-09-19T16:47:36.176853+0000, chain.objs.size()=1 2024-09-19T15:31:38.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.792+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.U-QH61aIv1SlXucCaqbNpn4juYZDwtX_0 2024-09-19T15:31:38.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.792+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2430466350706018097', time=2024-09-19T16:47:36.974117+0000, chain.objs.size()=1 2024-09-19T15:31:38.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.792+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.PtQtQu4_idW5L8dQiYUHhnk5CqhJwj-_0 2024-09-19T15:31:38.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.792+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9211437945189258738', time=2024-09-19T16:47:37.644542+0000, chain.objs.size()=1 2024-09-19T15:31:38.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.792+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.M4-xFgbuaoHJHEOmDlUgvCwjDHHfJPx_0 2024-09-19T15:31:38.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.792+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11807025562786554988', time=2024-09-19T16:47:38.260798+0000, chain.objs.size()=1 2024-09-19T15:31:38.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.792+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.WXeVDiuIvK3LYfOkmxyiyR3Qe7ukZaA_0 2024-09-19T15:31:38.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.792+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7535896999563154358', time=2024-09-19T16:47:38.263847+0000, chain.objs.size()=1 2024-09-19T15:31:38.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.792+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.0U9F63QBw6kBZNARBUrLG_3j8VFm5OD_0 2024-09-19T15:31:38.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.796+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11990878408822786613', time=2024-09-19T16:47:38.531006+0000, chain.objs.size()=1 2024-09-19T15:31:38.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.796+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.eoFXaVVbjfYoVRX05MEtZbGuZ2OqaBi_0 2024-09-19T15:31:38.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.796+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.370537723327511425', time=2024-09-19T16:47:40.968562+0000, chain.objs.size()=1 2024-09-19T15:31:38.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.796+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.6eKZ3mQvLN-oA86-j79aDEaK2fH2EJG_0 2024-09-19T15:31:38.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.796+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9444672658635270376', time=2024-09-19T16:47:42.305231+0000, chain.objs.size()=1 2024-09-19T15:31:38.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.796+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.b_neOOYXPFPCtp9GODmdS4QzunewnAN_0 2024-09-19T15:31:38.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.796+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13799672537108373148', time=2024-09-19T16:47:43.998372+0000, chain.objs.size()=1 2024-09-19T15:31:38.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.796+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Q-4jIIMrT72sIu74qBK6QxqeoXA1gSD_0 2024-09-19T15:31:38.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.796+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12720293479924896420', time=2024-09-19T16:47:44.597095+0000, chain.objs.size()=1 2024-09-19T15:31:38.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.796+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Vz6wsoLi4AbeqwDJLCDRL9FGNeKsuhR_0 2024-09-19T15:31:38.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.796+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4609690767166436567', time=2024-09-19T16:47:44.817264+0000, chain.objs.size()=1 2024-09-19T15:31:38.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.796+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.hVr8XlzdvWWj2BNEHKiDKJkl4haFbvJ_0 2024-09-19T15:31:38.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.796+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9848886004440966016', time=2024-09-19T16:47:50.007345+0000, chain.objs.size()=1 2024-09-19T15:31:38.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.796+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.H7aKpmrPEm6xwBvRvNPKabugtwVit32_0 2024-09-19T15:31:38.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.796+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16307603363097229369', time=2024-09-19T16:49:36.316232+0000, chain.objs.size()=1 2024-09-19T15:31:38.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.796+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ZgS8kW__svnN8cFDz-mrBQVoih5nr-0_0 2024-09-19T15:31:38.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.796+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17868305663274393706', time=2024-09-19T16:49:36.411577+0000, chain.objs.size()=1 2024-09-19T15:31:38.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.796+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.7SPPAd8zk1xmFbYK-vpVv2Ch-k1-CzG_0 2024-09-19T15:31:38.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.796+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9372095625946222942', time=2024-09-19T16:49:37.267607+0000, chain.objs.size()=1 2024-09-19T15:31:38.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.796+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Av-ZuFjrb3WAj_1qDzpD3AcoAbfkMTv_0 2024-09-19T15:31:38.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.796+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6381734391630029596', time=2024-09-19T16:49:38.115041+0000, chain.objs.size()=1 2024-09-19T15:31:38.805 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.796+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.KRbZUsGEekBGoa_nD6GJf4YVre2L8NR_0 2024-09-19T15:31:38.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.800+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2555141063630411876', time=2024-09-19T16:49:39.278388+0000, chain.objs.size()=1 2024-09-19T15:31:38.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.800+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.1hzVzAQSplQA9FNK65UQxSMaiOppodz_0 2024-09-19T15:31:38.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.800+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13001732070882098613', time=2024-09-19T16:49:40.163790+0000, chain.objs.size()=1 2024-09-19T15:31:38.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.800+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.fw-FFqF4t05umNheqmyLxQnQ2l2Cffk_0 2024-09-19T15:31:38.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.800+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.835804255758191802', time=2024-09-19T16:49:41.073691+0000, chain.objs.size()=1 2024-09-19T15:31:38.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.800+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.DXksP-yrDOmDMWck_q-PZUVdR2eCEOH_0 2024-09-19T15:31:38.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.800+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15228241024204779246', time=2024-09-19T16:49:41.320584+0000, chain.objs.size()=1 2024-09-19T15:31:38.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.800+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.osIJCYqc-euryJKu0JIomKxguXFDON2_0 2024-09-19T15:31:38.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.800+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17637407531253935420', time=2024-09-19T16:49:42.292331+0000, chain.objs.size()=1 2024-09-19T15:31:38.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.800+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.tDy3GHZAHz8rAhasQ_nX_yaLnPAs1cO_0 2024-09-19T15:31:38.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.804+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5798075940173169627', time=2024-09-19T16:49:44.020511+0000, chain.objs.size()=1 2024-09-19T15:31:38.808 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.804+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.zlzeXO0SVY8CTQfSmm0lS5itXOAgLSu_0 2024-09-19T15:31:38.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.804+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4745454231825612979', time=2024-09-19T16:49:44.434927+0000, chain.objs.size()=1 2024-09-19T15:31:38.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.804+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.xyz6ErcCz0vvTIUZIQJKzvhjZwhhDJG_0 2024-09-19T15:31:38.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.804+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10635050847355016810', time=2024-09-19T16:49:46.180696+0000, chain.objs.size()=1 2024-09-19T15:31:38.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.804+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.beOv32sziOqCTMzj_0McDMI9MGDsEKm_0 2024-09-19T15:31:38.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.804+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9902187148225224885', time=2024-09-19T16:49:46.512759+0000, chain.objs.size()=1 2024-09-19T15:31:38.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.804+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.odgzoLMbWR0NgW_epj0iGgdxmKicx6Q_0 2024-09-19T15:31:38.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.804+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15253796417037071196', time=2024-09-19T16:49:48.828785+0000, chain.objs.size()=1 2024-09-19T15:31:38.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.804+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_._PQGLQ9YjGA5i351WxgCzx2Tt612btL_0 2024-09-19T15:31:38.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.804+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11564287354522793878', time=2024-09-19T16:49:49.377869+0000, chain.objs.size()=1 2024-09-19T15:31:38.809 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.804+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.uzTkKRklleN0IWPPAK0-fCk0yuxHhks_0 2024-09-19T15:31:38.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12342959944168453185', time=2024-09-19T16:49:51.084151+0000, chain.objs.size()=1 2024-09-19T15:31:38.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.808+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.YVhmBIyNgbMRsjB8euksW1MTSRSokOF_0 2024-09-19T15:31:38.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9422409622370179381', time=2024-09-19T16:49:52.057154+0000, chain.objs.size()=1 2024-09-19T15:31:38.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.808+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.269EO8f80AzSUGPYMeOoriWqIL890qL_0 2024-09-19T15:31:38.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5466472767283528923', time=2024-09-19T16:49:52.963580+0000, chain.objs.size()=1 2024-09-19T15:31:38.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.808+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.d4gcT0oM8dqUuQPu2KRRPJoJddIbz_d_0 2024-09-19T15:31:38.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13650540660935918390', time=2024-09-19T16:49:53.255233+0000, chain.objs.size()=1 2024-09-19T15:31:38.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.808+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.MTBDlSR4z0WgGoBtXIjHxPEKp-5tpAx_0 2024-09-19T15:31:38.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15221518422213773853', time=2024-09-19T16:49:53.259611+0000, chain.objs.size()=1 2024-09-19T15:31:38.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.808+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.cRnjF2bfDH4nF_TDMjEB10V4vebfSId_0 2024-09-19T15:31:38.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11396300862461948724', time=2024-09-19T16:49:53.795746+0000, chain.objs.size()=1 2024-09-19T15:31:38.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.808+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.bfNGYHWgBUi-8lg1j3sZIluTEKg6AsY_0 2024-09-19T15:31:38.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4432767522837392264', time=2024-09-19T16:49:54.633586+0000, chain.objs.size()=1 2024-09-19T15:31:38.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.808+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.tsSqWb9LAXlnRivqEKO6BNTRhW-Isb5_0 2024-09-19T15:31:38.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7346879820814740842', time=2024-09-19T16:49:55.171865+0000, chain.objs.size()=1 2024-09-19T15:31:38.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.808+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.7hpcDlyEhWbC0ujd0Tv3B7FZQekTl8s_0 2024-09-19T15:31:38.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3633667634001495329', time=2024-09-19T16:49:56.496967+0000, chain.objs.size()=1 2024-09-19T15:31:38.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.808+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.htEfoa5ZxDAh4G5vyGVs7wvFMWheZxe_0 2024-09-19T15:31:38.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11989640802164138230', time=2024-09-19T16:49:56.933628+0000, chain.objs.size()=1 2024-09-19T15:31:38.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.808+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ghc6PygtZDquokayyi7XGpxN5bhgqTM_0 2024-09-19T15:31:38.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17945383049453044514', time=2024-09-19T16:50:00.439462+0000, chain.objs.size()=1 2024-09-19T15:31:38.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.808+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ZNN_H6kUJnW1jYJwSS7QlWRS-zRbvvc_0 2024-09-19T15:31:38.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.812+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1937801049709097888', time=2024-09-19T16:50:00.961279+0000, chain.objs.size()=1 2024-09-19T15:31:38.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.812+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.y5a_5EgeevGpNOZiFCS05QyXQkKNK1F_0 2024-09-19T15:31:38.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.812+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9189192819077945763', time=2024-09-19T16:50:01.352413+0000, chain.objs.size()=1 2024-09-19T15:31:38.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.812+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.McHoCFO8XxDCQgmCPf4POudckM1SQPA_0 2024-09-19T15:31:38.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.812+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4004392325160946293', time=2024-09-19T16:50:01.567379+0000, chain.objs.size()=1 2024-09-19T15:31:38.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.812+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.YoaBCR2dvYnv4rlF2wZReaUGvIsqwf7_0 2024-09-19T15:31:38.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.812+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49094 2024-09-19T15:31:38.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.816+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-19T15:31:38.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.816+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1594861361514893777', time=2024-09-19T16:50:02.220950+0000, chain.objs.size()=1 2024-09-19T15:31:38.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.816+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.2koQB53K5uSslr8UZAMGxP6XEd9BgxN_0 2024-09-19T15:31:38.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.816+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.269518756547091755', time=2024-09-19T16:50:03.177179+0000, chain.objs.size()=1 2024-09-19T15:31:38.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.816+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.GtmoqXRbAC0CMZKaJHVmwRAi1qG7fhG_0 2024-09-19T15:31:38.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.816+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3394219370661926455', time=2024-09-19T16:50:04.344581+0000, chain.objs.size()=1 2024-09-19T15:31:38.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.816+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.XDucOvrgXOAHO_Dfu9ZTW44fHQRmzsd_0 2024-09-19T15:31:38.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.816+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18270513535716931312', time=2024-09-19T16:50:05.632468+0000, chain.objs.size()=1 2024-09-19T15:31:38.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.816+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Hahe0As-b9ogt8Rs4cRDabuy_JaC5GM_0 2024-09-19T15:31:38.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.816+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18121137224600414735', time=2024-09-19T16:50:06.328594+0000, chain.objs.size()=1 2024-09-19T15:31:38.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.816+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.U4v5p6G9GndSTRd6f4oUBfhYBic4Uqu_0 2024-09-19T15:31:38.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.816+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12699786287275289027', time=2024-09-19T16:50:06.501601+0000, chain.objs.size()=1 2024-09-19T15:31:38.823 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.816+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.m1o9y28FfSXfZHeWxV5_sXrkVjy3dwW_0 2024-09-19T15:31:38.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.816+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17795866364821900333', time=2024-09-19T16:50:06.565651+0000, chain.objs.size()=1 2024-09-19T15:31:38.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.816+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.fnK_-xqSsopIUOEkTg4aZWtok33mTM__0 2024-09-19T15:31:38.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.816+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.96717405260283665', time=2024-09-19T16:54:36.718089+0000, chain.objs.size()=1 2024-09-19T15:31:38.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.816+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.456__shadow_.xb3DcUwm39mpW2ZQiuVrTVjzFokaZHT_0 2024-09-19T15:31:38.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.816+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14035095542778623969', time=2024-09-19T16:55:32.929042+0000, chain.objs.size()=1 2024-09-19T15:31:38.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.816+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.483__shadow_.1FeB5elWkYmPqyxBYY6HXFW3xizt9x5_0 2024-09-19T15:31:38.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.816+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.854067840866874832', time=2024-09-19T16:56:13.680157+0000, chain.objs.size()=1 2024-09-19T15:31:38.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.816+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.500__shadow_.V-hEci4_fEq1vPzohBOqX5jYmg4U7hR_0 2024-09-19T15:31:38.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.816+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11771357603205466934', time=2024-09-19T16:57:06.511863+0000, chain.objs.size()=6 2024-09-19T15:31:38.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.816+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.1 2024-09-19T15:31:38.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.816+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.2 2024-09-19T15:31:38.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.820+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.3 2024-09-19T15:31:38.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.820+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.4 2024-09-19T15:31:38.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.820+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.5 2024-09-19T15:31:38.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.820+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.6 2024-09-19T15:31:38.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.820+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3403703838625679154', time=2024-09-19T17:03:54.309295+0000, chain.objs.size()=4 2024-09-19T15:31:38.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.820+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.527__multipart_mymultipart.2~MPsSY89CJmAYij9upoaoWhBDAOeiUB6.1 2024-09-19T15:31:38.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.820+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.527__multipart_mymultipart.2~MPsSY89CJmAYij9upoaoWhBDAOeiUB6.2 2024-09-19T15:31:38.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.820+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.527__multipart_mymultipart.2~MPsSY89CJmAYij9upoaoWhBDAOeiUB6.3 2024-09-19T15:31:38.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.820+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.527__multipart_mymultipart.2~MPsSY89CJmAYij9upoaoWhBDAOeiUB6.4 2024-09-19T15:31:38.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.820+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~dutOEXblPFFhsoo17kuKQCq2wBGm2JJ', time=2024-09-19T17:04:28.403645+0000, chain.objs.size()=1 2024-09-19T15:31:38.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.820+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.533__multipart_mymultipart.2~dutOEXblPFFhsoo17kuKQCq2wBGm2JJ.1 2024-09-19T15:31:38.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.820+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~D3ONVC0FHjGk5e-Nxytnn6x8gfyOTeq', time=2024-09-19T17:04:41.754743+0000, chain.objs.size()=1 2024-09-19T15:31:38.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.820+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.535__multipart_mymultipart.2~D3ONVC0FHjGk5e-Nxytnn6x8gfyOTeq.3 2024-09-19T15:31:38.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.824+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5029727785376015304', time=2024-09-19T17:07:59.611943+0000, chain.objs.size()=1 2024-09-19T15:31:38.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.824+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:eNIjTQ9F6tuINiLYLFBNUt2Go8YIycd_.WjdhNAz2ISknN87iMrkYiLRSG4nu_0W_0 2024-09-19T15:31:38.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.828+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9107108855570390444', time=2024-09-19T17:08:36.134085+0000, chain.objs.size()=1 2024-09-19T15:31:38.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.828+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.576__shadow:54zdQCFxoPNqpOOVLba1XyPgQOB8K6p_.fb57arMtIZJd4IKc06KWdjwerdPXsH-_0 2024-09-19T15:31:38.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.828+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7637535545994303576', time=2024-09-19T17:09:13.307614+0000, chain.objs.size()=1 2024-09-19T15:31:38.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.828+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:gcjsFhOBDFMpKK0UNwT73tPaN.KtUWP_.QL2_K3y1ijnuQDN-VpZZfyhNlN9Fy-W_0 2024-09-19T15:31:38.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.828+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5592443118771295698', time=2024-09-19T17:19:02.491709+0000, chain.objs.size()=1 2024-09-19T15:31:38.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.828+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.647__shadow_.5W6Q7_aHJfUQIuq5vJaEsJgE8oFt6Gc_0 2024-09-19T15:31:38.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.828+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16468932511410834894', time=2024-09-19T17:24:16.495895+0000, chain.objs.size()=1 2024-09-19T15:31:38.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.828+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.744__shadow_.9sYGOK0a19rw8jS9Q8UP2eQ7d5iA-y3_0 2024-09-19T15:31:38.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.828+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10706740412596825664', time=2024-09-19T17:28:39.383977+0000, chain.objs.size()=1 2024-09-19T15:31:38.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.828+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.776__shadow_.yzcgja9W6mR7hRRG8VszJ3je_IuC5WZ_0 2024-09-19T15:31:38.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.832+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:38.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T15:31:38.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:38.842 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:38.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45458' 2024-09-19T15:31:38.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='_1dj-ZHE0PEubOzyZTeQT-AwIXdHBY_V', time=2024-09-19T16:34:00.768447+0000, chain.objs.size()=1 2024-09-19T15:31:38.843 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.163__shadow_.SKdosQbApDIL-kpuj0sguLQOxZN1723_0 2024-09-19T15:31:38.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17690896349397799671', time=2024-09-19T16:39:42.447414+0000, chain.objs.size()=1 2024-09-19T15:31:38.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.237__shadow_.Ue1YfDCh5amm4vDwPd1mnCQ2iQTAOTJ_0 2024-09-19T15:31:38.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2081359674723061889', time=2024-09-19T16:39:52.632636+0000, chain.objs.size()=1 2024-09-19T15:31:38.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.241__shadow_.Sz0AENEmSAQLoUe-tKKc25xJr_k2GiD_0 2024-09-19T15:31:38.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11819449692580610187', time=2024-09-19T16:39:58.934301+0000, chain.objs.size()=1 2024-09-19T15:31:38.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.243__shadow_.sTy7oLWBJspOz1p23AND1EvED5Y40e8_0 2024-09-19T15:31:38.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7788776856026846098', time=2024-09-19T16:40:02.758130+0000, chain.objs.size()=1 2024-09-19T15:31:38.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.244__shadow_.FwjLlBr0jCfbKoqkcJ5aLLlPJGGVxMN_0 2024-09-19T15:31:38.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13717484267356298360', time=2024-09-19T16:40:02.759558+0000, chain.objs.size()=1 2024-09-19T15:31:38.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.244__shadow_.avIHLwMHQqUIOmJPsJ9jk35pcw4Qgrx_0 2024-09-19T15:31:38.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8985312860560926672', time=2024-09-19T16:40:37.214911+0000, chain.objs.size()=1 2024-09-19T15:31:38.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.259__shadow_.GbklcNN_LoIA6izeUTXSobbwWLqyXrS_0 2024-09-19T15:31:38.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7766657760274635140', time=2024-09-19T16:42:28.126356+0000, chain.objs.size()=1 2024-09-19T15:31:38.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.d-hluLUi7PuUSXtA4AKgj5ynqBVCp64_0 2024-09-19T15:31:38.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.934071301640445203', time=2024-09-19T16:42:28.522670+0000, chain.objs.size()=1 2024-09-19T15:31:38.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.K-AB9VNqN053wvDd5kvX9GCwYblgwd-_0 2024-09-19T15:31:38.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4553417613752568465', time=2024-09-19T16:42:29.278724+0000, chain.objs.size()=1 2024-09-19T15:31:38.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.JDMbCq-Oqtv2ibAuylb0HgSj01Etb4y_0 2024-09-19T15:31:38.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15195829098368230105', time=2024-09-19T16:42:29.489222+0000, chain.objs.size()=1 2024-09-19T15:31:38.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.UxGRoLCTKv9wEQK8Dw2NxTmmpoaqRA2_0 2024-09-19T15:31:38.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.570094961002414296', time=2024-09-19T16:42:29.934499+0000, chain.objs.size()=1 2024-09-19T15:31:38.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.836+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.BlWsuGeQgBS7O2wxkTPvlWmAVlXFtty_0 2024-09-19T15:31:38.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.840+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2120312618502295749', time=2024-09-19T16:42:30.362240+0000, chain.objs.size()=1 2024-09-19T15:31:38.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.840+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.tkDG46HTwrO2FVxsnJ5oFcZaok1cfzZ_0 2024-09-19T15:31:38.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.840+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15089859457990698420', time=2024-09-19T16:42:30.844606+0000, chain.objs.size()=1 2024-09-19T15:31:38.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.840+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.tacLKwL6-9XEPLSHHC0sMFvL38ECYmc_0 2024-09-19T15:31:38.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.840+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10322744228767023890', time=2024-09-19T16:42:31.047313+0000, chain.objs.size()=1 2024-09-19T15:31:38.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.840+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.vYU3gjp9klaj4tIvmjM1wU-LfZPZpat_0 2024-09-19T15:31:38.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.840+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.41285625343947757', time=2024-09-19T16:42:32.947785+0000, chain.objs.size()=1 2024-09-19T15:31:38.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.840+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.AwXv4FEdEL2SOxI-S73bBxsmqRm3h2l_0 2024-09-19T15:31:38.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.844+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17943838528472154730', time=2024-09-19T16:42:32.950692+0000, chain.objs.size()=1 2024-09-19T15:31:38.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.844+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.hCV-CWF9O7G1MuIMF1hrj4lgStNlQUt_0 2024-09-19T15:31:38.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.844+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3798084825689203389', time=2024-09-19T16:42:33.731423+0000, chain.objs.size()=1 2024-09-19T15:31:38.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.844+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.tYa8ACjc4bIOGne_gf7LeOKjaU-sY9o_0 2024-09-19T15:31:38.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.844+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14915902626905082832', time=2024-09-19T16:42:34.160518+0000, chain.objs.size()=1 2024-09-19T15:31:38.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.844+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.IRPcqVbk133qlAiRpD9BB1Uxdy2Lw6e_0 2024-09-19T15:31:38.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.844+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13001567419874866650', time=2024-09-19T16:42:35.204583+0000, chain.objs.size()=1 2024-09-19T15:31:38.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.844+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.HuBv_Ui52XMGjie1j3c-ZPxeki4Ggkj_0 2024-09-19T15:31:38.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.844+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3082746212032279618', time=2024-09-19T16:42:35.314952+0000, chain.objs.size()=1 2024-09-19T15:31:38.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.844+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.SrN3Boibr3dC7evyLy9IzhCZqgXRYt0_0 2024-09-19T15:31:38.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.844+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17886989162031704962', time=2024-09-19T16:42:37.835819+0000, chain.objs.size()=1 2024-09-19T15:31:38.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.844+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.-b06FvczFXLpW5sjWui231A7g-DR2S__0 2024-09-19T15:31:38.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.844+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16160105852882133362', time=2024-09-19T16:42:38.619269+0000, chain.objs.size()=1 2024-09-19T15:31:38.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.844+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.D1MnNM6BSzmLTqHwMWq6lYRYIt-qVVm_0 2024-09-19T15:31:38.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.844+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9761672145538476308', time=2024-09-19T16:42:39.852535+0000, chain.objs.size()=1 2024-09-19T15:31:38.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.844+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.uEm3Ok8eHydQaHba9Rb_2N8zssmeKjO_0 2024-09-19T15:31:38.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.848+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17356295025355518559', time=2024-09-19T16:42:41.584782+0000, chain.objs.size()=1 2024-09-19T15:31:38.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.848+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.bVwGUdMEIa0HAo1G0KOxq_KEjGM99Qj_0 2024-09-19T15:31:38.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.848+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15793326942547752181', time=2024-09-19T16:42:41.586626+0000, chain.objs.size()=1 2024-09-19T15:31:38.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.848+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.MvjinzQlXu3ZgUIMIAeF-wmyBbFpHMC_0 2024-09-19T15:31:38.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.848+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15189497661437271821', time=2024-09-19T16:42:42.708903+0000, chain.objs.size()=1 2024-09-19T15:31:38.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.848+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.JNJGWQ_v2g6GmLR1cSM8QsIUfiohoWR_0 2024-09-19T15:31:38.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.848+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8639620965850996043', time=2024-09-19T16:42:43.080407+0000, chain.objs.size()=1 2024-09-19T15:31:38.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.848+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.6FrmOGm7VwwkCkexzj6ulnEvtw_xiop_0 2024-09-19T15:31:38.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.848+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14059627335962427604', time=2024-09-19T16:42:43.482955+0000, chain.objs.size()=1 2024-09-19T15:31:38.855 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.848+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.P8LkAk7LOcTSg5T4LOjOFeBwnD9uVfX_0 2024-09-19T15:31:38.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.848+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1718708842232221561', time=2024-09-19T16:42:45.295407+0000, chain.objs.size()=1 2024-09-19T15:31:38.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.848+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Pu7h42megon_lpGelm87UrG8BScKHQ__0 2024-09-19T15:31:38.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.848+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1873791592485323955', time=2024-09-19T16:42:46.063748+0000, chain.objs.size()=1 2024-09-19T15:31:38.856 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.848+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.uS8oz5rqENezaTojy2ZoOSS6a_ozbMW_0 2024-09-19T15:31:38.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.852+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13405912420343350714', time=2024-09-19T16:42:46.551687+0000, chain.objs.size()=1 2024-09-19T15:31:38.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.852+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.-Fwhe3RTZgJYXelSStYq35kzLoKnKGY_0 2024-09-19T15:31:38.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.852+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14811492016021501399', time=2024-09-19T16:42:47.053048+0000, chain.objs.size()=1 2024-09-19T15:31:38.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.852+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.vSJZ_cUOPCKnSuoiz5vQw0q4ELBAq8g_0 2024-09-19T15:31:38.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.852+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6069026701562416684', time=2024-09-19T16:42:47.676684+0000, chain.objs.size()=1 2024-09-19T15:31:38.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.852+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.7r4xmM578FEkwYV-xRzvtTWUlpcaBOr_0 2024-09-19T15:31:38.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.852+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16453877118031598843', time=2024-09-19T16:42:50.276582+0000, chain.objs.size()=1 2024-09-19T15:31:38.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.852+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.g3IOAQ2wVoh0B_dxJoBjpBLkkk1vXoK_0 2024-09-19T15:31:38.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.852+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17384108937971880504', time=2024-09-19T16:42:50.483672+0000, chain.objs.size()=1 2024-09-19T15:31:38.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.852+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.wwc27by31S7f7vmeNFoXadVjMsnNwma_0 2024-09-19T15:31:38.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.852+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17453139730147655158', time=2024-09-19T16:42:50.751029+0000, chain.objs.size()=1 2024-09-19T15:31:38.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.852+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.DCiqhmsJFkrvWmNuZN18Kd1etTTQ1fQ_0 2024-09-19T15:31:38.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.852+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10798341209047460845', time=2024-09-19T16:42:52.365808+0000, chain.objs.size()=1 2024-09-19T15:31:38.859 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.852+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.zx9UHuGTw4ClbjnldpZd8KJXWGzxvTf_0 2024-09-19T15:31:38.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2262492825252908157', time=2024-09-19T16:42:52.558479+0000, chain.objs.size()=1 2024-09-19T15:31:38.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.H5M3mf6zBztpRxWvDSiBVaDm32YicXz_0 2024-09-19T15:31:38.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4125643144967875608', time=2024-09-19T16:42:53.540165+0000, chain.objs.size()=1 2024-09-19T15:31:38.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.niFIrI9Aatn1ZIWH2Ylmt82LaswELjb_0 2024-09-19T15:31:38.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11608657445505072666', time=2024-09-19T16:42:54.299296+0000, chain.objs.size()=1 2024-09-19T15:31:38.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.vW3K0ajl79fR_Ks71pC0hEKP3WKYiN6_0 2024-09-19T15:31:38.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8273056691744407659', time=2024-09-19T16:42:54.962193+0000, chain.objs.size()=1 2024-09-19T15:31:38.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.PzDl-1Q6UIvOKjHZNkmrxXxZ62j9ZIp_0 2024-09-19T15:31:38.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15845246640093037533', time=2024-09-19T16:42:55.149902+0000, chain.objs.size()=1 2024-09-19T15:31:38.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.s98__R30zqnC045DBrgWbrYk8EiDRDI_0 2024-09-19T15:31:38.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15240266925809797419', time=2024-09-19T16:42:55.773344+0000, chain.objs.size()=1 2024-09-19T15:31:38.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.PHH04RuXlStqcpS3wP1kkjU3wesjD_d_0 2024-09-19T15:31:38.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3729025566247423767', time=2024-09-19T16:42:56.438035+0000, chain.objs.size()=1 2024-09-19T15:31:38.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.0ZFNJ7RhB0OdTkS0Yr0ut0zrAQoAC9C_0 2024-09-19T15:31:38.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18038488543636202659', time=2024-09-19T16:42:59.090663+0000, chain.objs.size()=1 2024-09-19T15:31:38.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.NsG4TV8Ic3hblRIzUUaDl_SnN1NpQKZ_0 2024-09-19T15:31:38.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14385583617755560534', time=2024-09-19T16:42:59.275770+0000, chain.objs.size()=1 2024-09-19T15:31:38.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.5d6OdLYwYmTyhaAFCoEq_bsIG_Pa6Ey_0 2024-09-19T15:31:38.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7751341969580436509', time=2024-09-19T16:42:59.721075+0000, chain.objs.size()=1 2024-09-19T15:31:38.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.MezG6ulFRBgB8e8MilPTxP4Q1sxIM6y_0 2024-09-19T15:31:38.863 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6236185888401197247', time=2024-09-19T16:43:02.339729+0000, chain.objs.size()=1 2024-09-19T15:31:38.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.263__shadow_.2ybBI5q7tzbPoMZHyJvcoHFZnnur6H4_0 2024-09-19T15:31:38.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7057478534402360299', time=2024-09-19T16:43:09.024158+0000, chain.objs.size()=1 2024-09-19T15:31:38.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.266__shadow_.iXFl_SJyUKT1RihpmwyQGfAlLP7Khtv_0 2024-09-19T15:31:38.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15259827448719644316', time=2024-09-19T16:43:19.967311+0000, chain.objs.size()=1 2024-09-19T15:31:38.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.271__shadow_.gAwWHp5KPpGrvyooxxra3Y3ZQRxIWFU_0 2024-09-19T15:31:38.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7726363549989886587', time=2024-09-19T16:43:54.838765+0000, chain.objs.size()=1 2024-09-19T15:31:38.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.286__shadow_.xKiwsrAMvtJuir64-ayHNfKUg81zqUJ_0 2024-09-19T15:31:38.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.860+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7805261814687739649', time=2024-09-19T16:43:57.167203+0000, chain.objs.size()=1 2024-09-19T15:31:38.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.860+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.287__shadow_.vdVvVk52aLAG_v8O1vKfSkK5R_NYDco_0 2024-09-19T15:31:38.866 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.860+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2552776620533998109', time=2024-09-19T16:44:12.398349+0000, chain.objs.size()=1 2024-09-19T15:31:38.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.860+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_.boo2QzsKSvTqcJyz0mcmPHbQsC_h-LT_0 2024-09-19T15:31:38.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.860+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6219318859344675042', time=2024-09-19T16:44:12.892279+0000, chain.objs.size()=1 2024-09-19T15:31:38.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.860+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_.3LiqJpMqy5ShZl2KEjpAbd_KXArwtz-_0 2024-09-19T15:31:38.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.860+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10242457611468706851', time=2024-09-19T16:44:33.108447+0000, chain.objs.size()=1 2024-09-19T15:31:38.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.860+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.299__shadow_.Qy0rWGrFPIZ4KxCvM4S6fnmWoe0rwus_0 2024-09-19T15:31:38.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.860+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15417537558402137620', time=2024-09-19T16:45:26.595071+0000, chain.objs.size()=1 2024-09-19T15:31:38.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.860+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.319__shadow:wWAPPMti5.5UriDa1We.It0iFbEqRmv_.CoL_JkfksJkZBqbm-nOmgO_F-6bLshe_0 2024-09-19T15:31:38.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.860+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9176557585694359758', time=2024-09-19T16:47:19.564003+0000, chain.objs.size()=1 2024-09-19T15:31:38.867 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.860+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.oXZtd46CMCd4KIclK6nl-ix3a_oREwO_0 2024-09-19T15:31:38.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.864+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12930495200883333030', time=2024-09-19T16:47:23.216357+0000, chain.objs.size()=1 2024-09-19T15:31:38.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.864+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.cDfoFiLNA4XLHxHMDEybNMEaMiIsXwB_0 2024-09-19T15:31:38.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.864+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8226045924682445714', time=2024-09-19T16:47:23.927823+0000, chain.objs.size()=1 2024-09-19T15:31:38.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.864+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.up8wKXwpvrF0qGWSFLuMjglD9cbXjpr_0 2024-09-19T15:31:38.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.864+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15776779672013714382', time=2024-09-19T16:47:24.958597+0000, chain.objs.size()=1 2024-09-19T15:31:38.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.864+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.G0i_6EDfDN_ftv9GWQblkQg4ow5g8VB_0 2024-09-19T15:31:38.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.864+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7680552041670966998', time=2024-09-19T16:47:25.704196+0000, chain.objs.size()=1 2024-09-19T15:31:38.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.864+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_._hEybletPMF38dyvZt16uCWfPfysbZR_0 2024-09-19T15:31:38.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.864+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2231951999381171934', time=2024-09-19T16:47:27.999810+0000, chain.objs.size()=1 2024-09-19T15:31:38.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.864+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.9HUMlqHuMYkA7tMsDSspq3WWX8gMK6J_0 2024-09-19T15:31:38.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.864+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13563481980416179268', time=2024-09-19T16:47:28.151667+0000, chain.objs.size()=1 2024-09-19T15:31:38.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.864+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.XnDLWFOrnhELwx8rx94ktuZbgQhyWs2_0 2024-09-19T15:31:38.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.864+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17151041553466182527', time=2024-09-19T16:47:28.634002+0000, chain.objs.size()=1 2024-09-19T15:31:38.871 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.864+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.MB7Qhrlwitp7k9jx7NJUD_aH5KMKEyY_0 2024-09-19T15:31:38.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.864+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4869340234406083483', time=2024-09-19T16:47:34.264430+0000, chain.objs.size()=1 2024-09-19T15:31:38.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.864+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.YFve7AWXNLJA5ugAnJJSEnMrMYzOk-8_0 2024-09-19T15:31:38.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.864+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2147437529220767209', time=2024-09-19T16:47:36.634455+0000, chain.objs.size()=1 2024-09-19T15:31:38.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.864+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.7NAyBcXSAKUnQMSz5UARUl17P2MfQoe_0 2024-09-19T15:31:38.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.864+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1700918372948355767', time=2024-09-19T16:47:37.329631+0000, chain.objs.size()=1 2024-09-19T15:31:38.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.864+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.hQj2VpNLtSODP7Cw9_MbqKP7C86qW_O_0 2024-09-19T15:31:38.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.864+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6946192619213062002', time=2024-09-19T16:47:37.883604+0000, chain.objs.size()=1 2024-09-19T15:31:38.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.864+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.4l4tPM6SXZg9lgUmVBWkrbQhbNFw5Wu_0 2024-09-19T15:31:38.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.868+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9586481974877629254', time=2024-09-19T16:47:39.389882+0000, chain.objs.size()=1 2024-09-19T15:31:38.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.868+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.hUgP-TSpZckSRdfo_S0dMwxy15i6nbS_0 2024-09-19T15:31:38.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.868+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3201322844014956711', time=2024-09-19T16:47:42.043143+0000, chain.objs.size()=1 2024-09-19T15:31:38.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.868+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.QWd-CE3SDPj6mmPO7s3Wk3gwbW_OXCW_0 2024-09-19T15:31:38.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.872+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3294216882418476146', time=2024-09-19T16:47:42.661449+0000, chain.objs.size()=1 2024-09-19T15:31:38.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.872+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.wJWtWYETG5T4UIjxd5lvUijctcX2Cy7_0 2024-09-19T15:31:38.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.872+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8855126583428571367', time=2024-09-19T16:47:44.441892+0000, chain.objs.size()=1 2024-09-19T15:31:38.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.872+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.FU4XIyA8O68p1gp7_laglKa567vYmjb_0 2024-09-19T15:31:38.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.872+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2108015036614951740', time=2024-09-19T16:47:45.113732+0000, chain.objs.size()=1 2024-09-19T15:31:38.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.872+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.So8LgCZpR0-pyw2-8zgWYUqWsyLV8zn_0 2024-09-19T15:31:38.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.872+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5829016963491858277', time=2024-09-19T16:47:47.669006+0000, chain.objs.size()=1 2024-09-19T15:31:38.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.872+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.tykEnt39TEKbtFYcCQWci1dsdJc8YMB_0 2024-09-19T15:31:38.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.872+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3520261190964769070', time=2024-09-19T16:47:48.263656+0000, chain.objs.size()=1 2024-09-19T15:31:38.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.872+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.mNLegFMflknCDj9Qz6LE9gC61X5XLca_0 2024-09-19T15:31:38.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.872+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3326396349920973043', time=2024-09-19T16:47:48.382197+0000, chain.objs.size()=1 2024-09-19T15:31:38.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.872+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.mBagnyC4MBXCyOYHXhcB_U8o1zTn53-_0 2024-09-19T15:31:38.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.872+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16473064974450317579', time=2024-09-19T16:49:34.907833+0000, chain.objs.size()=1 2024-09-19T15:31:38.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.872+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Bc3V2t-B2w0QWLAZ0NLfKokYHXHmJL5_0 2024-09-19T15:31:38.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.872+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3485076088270569866', time=2024-09-19T16:49:36.528963+0000, chain.objs.size()=1 2024-09-19T15:31:38.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.872+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.nBTacaaiwjAOjcBsD20K3LW-mkb7w7e_0 2024-09-19T15:31:38.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.872+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14021230047187938841', time=2024-09-19T16:49:37.043526+0000, chain.objs.size()=1 2024-09-19T15:31:38.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.872+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.b_NUOAbi3R32GTcxqhA9NEUBO5olyuO_0 2024-09-19T15:31:38.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.872+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11986948663383582575', time=2024-09-19T16:49:37.521760+0000, chain.objs.size()=1 2024-09-19T15:31:38.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.872+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.aaDAfY0CdsL5k59gmk4Soj0Gu9xeqN0_0 2024-09-19T15:31:38.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.872+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12233742011785515652', time=2024-09-19T16:49:40.043014+0000, chain.objs.size()=1 2024-09-19T15:31:38.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.872+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.UT2xG2bcXJkqIfF59-rS3JoBV6lX_cD_0 2024-09-19T15:31:38.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.872+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18290480971307647167', time=2024-09-19T16:49:40.608000+0000, chain.objs.size()=1 2024-09-19T15:31:38.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.872+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.eSzFfZ2yCKgMtP9Kx8UMQhECPm8yWvl_0 2024-09-19T15:31:38.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.876+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16432558833788347009', time=2024-09-19T16:49:43.647778+0000, chain.objs.size()=1 2024-09-19T15:31:38.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.876+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.u8xBQzEVzzshh5AqwCQAuOdroJ8hMmT_0 2024-09-19T15:31:38.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.876+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15627423083541358157', time=2024-09-19T16:49:44.105158+0000, chain.objs.size()=1 2024-09-19T15:31:38.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.876+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.wm-SZqllKqKtQlEYm1lJ_sUv2-Gp_qH_0 2024-09-19T15:31:38.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.876+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4522522510436083120', time=2024-09-19T16:49:44.719924+0000, chain.objs.size()=1 2024-09-19T15:31:38.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.876+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.TbYplM70OK_6dJ-yyjjFSMbrDAPBcxA_0 2024-09-19T15:31:38.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.876+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4322390041142288798', time=2024-09-19T16:49:45.963428+0000, chain.objs.size()=1 2024-09-19T15:31:38.881 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.876+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.wXfFaU04Bhr7kSde8DOS9mcaGJ4yjBq_0 2024-09-19T15:31:38.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.876+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2486240532389598037', time=2024-09-19T16:49:48.317258+0000, chain.objs.size()=1 2024-09-19T15:31:38.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.876+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.pQuYzwwqSHhFhl3tdlz3ajBMtROacR__0 2024-09-19T15:31:38.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.876+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4560467855592703968', time=2024-09-19T16:49:49.723526+0000, chain.objs.size()=1 2024-09-19T15:31:38.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.876+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.kLS8I8hzQpGAym0VD6nv8E2CUVH5IIq_0 2024-09-19T15:31:38.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.876+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6938452705454911484', time=2024-09-19T16:49:49.725617+0000, chain.objs.size()=1 2024-09-19T15:31:38.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.876+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.9M1jKrkKbn0HZukSOsJUzJyZYcPWSoh_0 2024-09-19T15:31:38.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.876+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15346404747685322605', time=2024-09-19T16:49:49.727502+0000, chain.objs.size()=1 2024-09-19T15:31:38.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.876+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.nN1RuYxlHEImfK25GkgvgZKlYwx_3vd_0 2024-09-19T15:31:38.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.876+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2070032376490459564', time=2024-09-19T16:49:50.144098+0000, chain.objs.size()=1 2024-09-19T15:31:38.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.876+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.I7ZFYUVl5u3dQk23VTJDweouO254LcI_0 2024-09-19T15:31:38.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.876+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17707532943065679552', time=2024-09-19T16:49:50.146998+0000, chain.objs.size()=1 2024-09-19T15:31:38.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.876+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.b7b4XzMQP3x17pKXSPE_jUJJ3GXqxT6_0 2024-09-19T15:31:38.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.876+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10518363259850954709', time=2024-09-19T16:49:52.069816+0000, chain.objs.size()=1 2024-09-19T15:31:38.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.876+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.n3TAj-E2t-0IKyLPoheLxbpW6SmR2E-_0 2024-09-19T15:31:38.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.880+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16910281364919788299', time=2024-09-19T16:49:52.503594+0000, chain.objs.size()=1 2024-09-19T15:31:38.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.880+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.-6-U62wAgM5iYGey2-qfVZvUIt6zprJ_0 2024-09-19T15:31:38.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.880+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1390355363665782514', time=2024-09-19T16:49:53.054596+0000, chain.objs.size()=1 2024-09-19T15:31:38.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.880+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.o7zWwkE7wzjRgPZVwCDuDqQlSSRg1D3_0 2024-09-19T15:31:38.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.880+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11014994287657168971', time=2024-09-19T16:49:54.615052+0000, chain.objs.size()=1 2024-09-19T15:31:38.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.880+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.B6Ofi_77zysZmiQNvHeq4_2ePo0EFhH_0 2024-09-19T15:31:38.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.880+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4835597644273756110', time=2024-09-19T16:49:54.820700+0000, chain.objs.size()=1 2024-09-19T15:31:38.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.880+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.RH6hBJOEtEOZTLVR0U9FH_8o_VGO0JG_0 2024-09-19T15:31:38.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.884+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10219960338739205334', time=2024-09-19T16:49:55.109737+0000, chain.objs.size()=1 2024-09-19T15:31:38.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.884+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.BgbhE9jATUWD5TpwrwioGWkyH2NQxYS_0 2024-09-19T15:31:38.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.884+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1937273116787700568', time=2024-09-19T16:49:57.009109+0000, chain.objs.size()=1 2024-09-19T15:31:38.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.884+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.-KgnxzCUzoo7MHNKTJ96nfzWQWHi498_0 2024-09-19T15:31:38.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.884+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45458 2024-09-19T15:31:38.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-19T15:31:38.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11015230398889491768', time=2024-09-19T16:50:00.089695+0000, chain.objs.size()=1 2024-09-19T15:31:38.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.HRTOAjnTT1JqQr_KFke2ZtubfL3YSIu_0 2024-09-19T15:31:38.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4155161840081450174', time=2024-09-19T16:50:00.102182+0000, chain.objs.size()=1 2024-09-19T15:31:38.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.SgadpLmv-K38jHCthLh5xXBayrXYSV5_0 2024-09-19T15:31:38.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1200601594409440033', time=2024-09-19T16:50:04.728214+0000, chain.objs.size()=1 2024-09-19T15:31:38.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.F1vsHr1ro6iIxSfZsoB53TUX4UguiuG_0 2024-09-19T15:31:38.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15749688311694820141', time=2024-09-19T16:50:05.253872+0000, chain.objs.size()=1 2024-09-19T15:31:38.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.BxFOASApIp4TYUVH1untNicJR3mMUyO_0 2024-09-19T15:31:38.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1242052287375707635', time=2024-09-19T16:50:05.854408+0000, chain.objs.size()=1 2024-09-19T15:31:38.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.QJiBihTRvPD5G13y0Uq6jMrWK6xX3_f_0 2024-09-19T15:31:38.894 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12340146630527319746', time=2024-09-19T16:50:05.855891+0000, chain.objs.size()=1 2024-09-19T15:31:38.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.LN30FPIYhnq6witHd4ODjjopR0Tzd9y_0 2024-09-19T15:31:38.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10607765400240181335', time=2024-09-19T16:50:06.109340+0000, chain.objs.size()=1 2024-09-19T15:31:38.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.rQhFxTkknFPjBmaYHWq2_DwcSwBwuUf_0 2024-09-19T15:31:38.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7055144697482419494', time=2024-09-19T16:50:06.414542+0000, chain.objs.size()=1 2024-09-19T15:31:38.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.iIHQL4Z0XXTldCp4vkO3Rh4EPMQCgc1_0 2024-09-19T15:31:38.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16965970900725512791', time=2024-09-19T16:54:48.639548+0000, chain.objs.size()=1 2024-09-19T15:31:38.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.460__shadow_.RGDcoHRAgmh7kro3pSH3tnBab0vSO8m_0 2024-09-19T15:31:38.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11083854613394484938', time=2024-09-19T16:55:35.697164+0000, chain.objs.size()=1 2024-09-19T15:31:38.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.484__shadow_.qThpxcbHoEZm5HVk14E5O83d32L7L5l_0 2024-09-19T15:31:38.895 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2211503452821435518', time=2024-09-19T16:57:22.485238+0000, chain.objs.size()=1 2024-09-19T15:31:38.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.514__shadow_.aNDlbo3hLWth-AYnJOEN2AsAaea5e9c_0 2024-09-19T15:31:38.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16715781583154522415', time=2024-09-19T17:00:11.061160+0000, chain.objs.size()=6 2024-09-19T15:31:38.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.888+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.ODt0nlK2bMJ_ytzmZNFBrqMXvJ0OXJMr.1 2024-09-19T15:31:38.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.892+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~7uvJYqm0_ocq_Fl5CDCFmXKfCXeQK70.2 2024-09-19T15:31:38.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.892+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~7uvJYqm0_ocq_Fl5CDCFmXKfCXeQK70.3 2024-09-19T15:31:38.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.892+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~7uvJYqm0_ocq_Fl5CDCFmXKfCXeQK70.4 2024-09-19T15:31:38.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.892+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~7uvJYqm0_ocq_Fl5CDCFmXKfCXeQK70.5 2024-09-19T15:31:38.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.892+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~7uvJYqm0_ocq_Fl5CDCFmXKfCXeQK70.6 2024-09-19T15:31:38.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.892+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1151978883442349110', time=2024-09-19T17:06:51.635699+0000, chain.objs.size()=1 2024-09-19T15:31:38.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.892+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.557__shadow_.utb2Vpt-2IMG2mgxN-KLari36ukulrg_0 2024-09-19T15:31:38.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.892+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11930183738808445220', time=2024-09-19T17:07:11.517325+0000, chain.objs.size()=1 2024-09-19T15:31:38.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.892+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.559__shadow_.yuG9K6q2fHDuqsltSPleAY1jfrYyg2e_0 2024-09-19T15:31:38.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.892+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8528503863524824429', time=2024-09-19T17:09:26.978549+0000, chain.objs.size()=1 2024-09-19T15:31:38.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.892+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:QlqhBwzM2dRZetmDeLJ.auxjPNtQICR_.tOyxIpc0Cb4zkNfqoZmvhtM4v7x0E6t_0 2024-09-19T15:31:38.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.892+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2529817781237081978', time=2024-09-19T17:10:29.758061+0000, chain.objs.size()=1 2024-09-19T15:31:38.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.892+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.579__shadow:RFrREj-bWwYRvS6-GM1lVMLPva0Kicc_.Ntv0fHM5XAWgV1AhVcQVnENEUAj3TL1_0 2024-09-19T15:31:38.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.892+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13893203887073879359', time=2024-09-19T17:11:26.985215+0000, chain.objs.size()=1 2024-09-19T15:31:38.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.892+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.603__shadow_.Jjvb-S_lUeEEAD3QwVW0Zu85qP14R7d_0 2024-09-19T15:31:38.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.892+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6497835138127768134', time=2024-09-19T17:11:35.691906+0000, chain.objs.size()=1 2024-09-19T15:31:38.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.892+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.607__shadow_.eKQIAjIdN2Y992jzIQ0O5qMiMqQaWAF_0 2024-09-19T15:31:38.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.896+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8951680813014417474', time=2024-09-19T17:13:58.050165+0000, chain.objs.size()=6 2024-09-19T15:31:38.901 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.896+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.614__multipart_multipart_enc.2~dZRQBivH0CdBFsCJuxasXLRzrv3QHNj.1 2024-09-19T15:31:38.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.900+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.614__multipart_multipart_enc.2~dZRQBivH0CdBFsCJuxasXLRzrv3QHNj.2 2024-09-19T15:31:38.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.900+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.614__multipart_multipart_enc.2~dZRQBivH0CdBFsCJuxasXLRzrv3QHNj.3 2024-09-19T15:31:38.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.900+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.614__multipart_multipart_enc.2~dZRQBivH0CdBFsCJuxasXLRzrv3QHNj.4 2024-09-19T15:31:38.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.900+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.614__multipart_multipart_enc.2~dZRQBivH0CdBFsCJuxasXLRzrv3QHNj.5 2024-09-19T15:31:38.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.900+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.614__multipart_multipart_enc.2~dZRQBivH0CdBFsCJuxasXLRzrv3QHNj.6 2024-09-19T15:31:38.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.900+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14598112711657574419', time=2024-09-19T17:18:41.018456+0000, chain.objs.size()=1 2024-09-19T15:31:38.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.900+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.643__shadow_.LrkP8r3bg1_QBACXfPHmb8Q6ornNcVp_0 2024-09-19T15:31:38.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.900+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6908121041832313361', time=2024-09-19T17:18:57.309045+0000, chain.objs.size()=1 2024-09-19T15:31:38.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.900+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.646__shadow_.NkJDTWW5vXnN7csEuK0ekhK_s65AeoM_0 2024-09-19T15:31:38.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.900+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3361881999598604115', time=2024-09-19T17:21:37.197972+0000, chain.objs.size()=1 2024-09-19T15:31:38.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.900+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.694__shadow:Tz.CS0YcyYp61AsIfwhBi6K5dNTOkOq_.Otx8iBcg80nDyUlVNrIOMZA_UNUYCNL_0 2024-09-19T15:31:38.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.900+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7789593979949263016', time=2024-09-19T17:21:43.512324+0000, chain.objs.size()=1 2024-09-19T15:31:38.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.900+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.697__shadow:eM3V7P5SpuaL4yV2BIw0xmUJagul3Bz_.8MKvDUK3_kpIbsup1okKIQU4BrVNMNH_0 2024-09-19T15:31:38.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.900+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15677156679312849580', time=2024-09-19T17:27:48.072349+0000, chain.objs.size()=1 2024-09-19T15:31:38.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.900+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.769__shadow_.RR2ZNN5BVUJRmi2yELvDDEG2aQ9l9wn_0 2024-09-19T15:31:38.914 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.908+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:38.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.912+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T15:31:38.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:38.922 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:38.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47808' 2024-09-19T15:31:38.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2720268865365551701', time=2024-09-19T16:34:54.715976+0000, chain.objs.size()=1 2024-09-19T15:31:38.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.181__shadow_.76yrTX-hW7MA69GKCfiuaFBr2sjX3Pw_0 2024-09-19T15:31:38.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.525766376908907898', time=2024-09-19T16:36:04.390032+0000, chain.objs.size()=1 2024-09-19T15:31:38.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.204__shadow_.1Fq2Ixs3bC44KEWjTNrOIfmSz57Fc7T_0 2024-09-19T15:31:38.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7681941057849054146', time=2024-09-19T16:39:38.657375+0000, chain.objs.size()=1 2024-09-19T15:31:38.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.236__shadow_.TWIPKazp7JLYkgHu_sVHFRSx6JLH_Az_0 2024-09-19T15:31:38.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2913181775293477382', time=2024-09-19T16:40:05.028159+0000, chain.objs.size()=1 2024-09-19T15:31:38.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.245__shadow_.Z6tBLO9TnPhhZotEcwp0OLGNdumZqJu_0 2024-09-19T15:31:38.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15013681462181818054', time=2024-09-19T16:40:05.036045+0000, chain.objs.size()=1 2024-09-19T15:31:38.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.245__shadow_.qwUYyS5T0R1x_0LixVQ5qeA9KO747WZ_0 2024-09-19T15:31:38.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9429690748426518273', time=2024-09-19T16:40:23.653191+0000, chain.objs.size()=1 2024-09-19T15:31:38.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.253__shadow_.lmtYA1KosfuSaBzCPz_gQEfQEfgDN8X_0 2024-09-19T15:31:38.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.88053866589733794', time=2024-09-19T16:40:35.080427+0000, chain.objs.size()=1 2024-09-19T15:31:38.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.258__shadow_.L4OGTzL_kC92GdPIhTAep3wIOMTqHco_0 2024-09-19T15:31:38.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.281481032008671638', time=2024-09-19T16:42:29.841676+0000, chain.objs.size()=1 2024-09-19T15:31:38.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.lQST2tsvC8w8f8otqG29aHMWOqIHxP3_0 2024-09-19T15:31:38.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.359405583493576381', time=2024-09-19T16:42:33.822984+0000, chain.objs.size()=1 2024-09-19T15:31:38.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.c987vfzaE68OurPP0lstDrMgxRrY2En_0 2024-09-19T15:31:38.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11758287634125159709', time=2024-09-19T16:42:33.919148+0000, chain.objs.size()=1 2024-09-19T15:31:38.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.JG_bys0eDgIvP9HRfWiCO5b9UlDaE6__0 2024-09-19T15:31:38.925 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17965419741933369619', time=2024-09-19T16:42:34.084759+0000, chain.objs.size()=1 2024-09-19T15:31:38.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.DxwJ0VUIfzfrOy-mqrXLAhi8LglwEA6_0 2024-09-19T15:31:38.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15561500592111425575', time=2024-09-19T16:42:34.787827+0000, chain.objs.size()=1 2024-09-19T15:31:38.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.916+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.PXeFw4occ9mkDhoNOxQp5Kzsx4XVIvg_0 2024-09-19T15:31:38.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.920+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15798125781420335737', time=2024-09-19T16:42:34.817219+0000, chain.objs.size()=1 2024-09-19T15:31:38.926 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.920+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.TQ7v39FZvBK8BfXdSgbeRT-m9nQNgwf_0 2024-09-19T15:31:38.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.920+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12126575266607879164', time=2024-09-19T16:42:36.835561+0000, chain.objs.size()=1 2024-09-19T15:31:38.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.920+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.iJG8hzvZdLJdjLGUWQE2XD5SUAA4lqY_0 2024-09-19T15:31:38.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.920+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13358896175007716360', time=2024-09-19T16:42:36.889659+0000, chain.objs.size()=1 2024-09-19T15:31:38.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.920+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.izPosciKqiiCNZsV1DMNzIiQacMr5c8_0 2024-09-19T15:31:38.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.920+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14582201614510266499', time=2024-09-19T16:42:37.228469+0000, chain.objs.size()=1 2024-09-19T15:31:38.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.920+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.mCZ3ZT9AUkx8Caqtg-VkfZf6bSgrUJY_0 2024-09-19T15:31:38.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.920+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8517755402564357336', time=2024-09-19T16:42:38.876149+0000, chain.objs.size()=1 2024-09-19T15:31:38.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.920+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.qszLw6u9FecBMU7aU3Vo61vpoDjpbJa_0 2024-09-19T15:31:38.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.920+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11268241534203392657', time=2024-09-19T16:42:39.536714+0000, chain.objs.size()=1 2024-09-19T15:31:38.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.920+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.IWo4jF0jc-ufpqhdRLJ8s3PTvrTSBxJ_0 2024-09-19T15:31:38.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.920+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17848789866356481440', time=2024-09-19T16:42:41.027882+0000, chain.objs.size()=1 2024-09-19T15:31:38.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.920+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.wfl4xgsow_jYBgr2DeYO9LVts-CJywu_0 2024-09-19T15:31:38.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.920+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7158606587763307816', time=2024-09-19T16:42:43.265537+0000, chain.objs.size()=1 2024-09-19T15:31:38.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.920+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.boKCCTzj2Pgt8PcZJPWGD2iIA-x25xa_0 2024-09-19T15:31:38.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.920+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3791350309365701558', time=2024-09-19T16:42:43.896427+0000, chain.objs.size()=1 2024-09-19T15:31:38.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.920+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.gUwiE2phPIoCep9kV-_QFt9R_ZLzL5G_0 2024-09-19T15:31:38.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.924+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8292050658937210031', time=2024-09-19T16:42:45.813205+0000, chain.objs.size()=1 2024-09-19T15:31:38.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.924+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.nTjalcRFTodMF9mWxNzseVTrJUID4RS_0 2024-09-19T15:31:38.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.924+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10890886703832457474', time=2024-09-19T16:42:46.306908+0000, chain.objs.size()=1 2024-09-19T15:31:38.929 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.924+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.iAxbOA2quFmip8UCvKTefOBwhFhMnSW_0 2024-09-19T15:31:38.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.924+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14462090301393792074', time=2024-09-19T16:42:47.260817+0000, chain.objs.size()=1 2024-09-19T15:31:38.930 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.924+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.m4-Vvq8GMiSH3P_ZJQzVGdmMdRguS8j_0 2024-09-19T15:31:38.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.928+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7088081925552311030', time=2024-09-19T16:42:48.073291+0000, chain.objs.size()=1 2024-09-19T15:31:38.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.928+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.OjbjNGko1M2emBkpke4rZOO0TkIBJ9P_0 2024-09-19T15:31:38.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.928+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14845990326595793061', time=2024-09-19T16:42:48.275093+0000, chain.objs.size()=1 2024-09-19T15:31:38.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.928+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.9u99QEQfnEfmxtVklVndCnJFN3iXJEQ_0 2024-09-19T15:31:38.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.928+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17816135857088849709', time=2024-09-19T16:42:49.262518+0000, chain.objs.size()=1 2024-09-19T15:31:38.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.928+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.82z-wTgz5CdEhXytDbxPabKSeBbWRbP_0 2024-09-19T15:31:38.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.928+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12842519005089983340', time=2024-09-19T16:42:49.820332+0000, chain.objs.size()=1 2024-09-19T15:31:38.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.928+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.9tq0IsOwRn4cqfsST1oUyt5WAcZ-OgY_0 2024-09-19T15:31:38.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.928+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11118115210701115865', time=2024-09-19T16:42:50.314210+0000, chain.objs.size()=1 2024-09-19T15:31:38.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.928+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.M_IA-X6FVdT4HWx-usBEtpZFnjq1CrC_0 2024-09-19T15:31:38.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.928+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11452755273504051838', time=2024-09-19T16:42:50.459717+0000, chain.objs.size()=1 2024-09-19T15:31:38.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.928+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.WNinREzsNPQD7KuncdcWY1EyVS5hg7z_0 2024-09-19T15:31:38.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.928+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11950621519948410747', time=2024-09-19T16:42:53.382365+0000, chain.objs.size()=1 2024-09-19T15:31:38.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.928+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.JHejmCo5bmkaieiGTmNOoLqxo8l6OAu_0 2024-09-19T15:31:38.934 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.928+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1196774926844496348', time=2024-09-19T16:42:55.629001+0000, chain.objs.size()=1 2024-09-19T15:31:38.935 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.928+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.lp1wtf8eF6QlSdUc6n1dNJ3LTf-wBx3_0 2024-09-19T15:31:38.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.932+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14053043849050784357', time=2024-09-19T16:42:55.631053+0000, chain.objs.size()=1 2024-09-19T15:31:38.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.932+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.cZ5iAgArgVFys_Iw63QQesUGdl7a-2H_0 2024-09-19T15:31:38.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.932+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3480758197156972443', time=2024-09-19T16:42:56.231015+0000, chain.objs.size()=1 2024-09-19T15:31:38.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.932+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.G1EwyKIigfc-7z1_J7cD6CsEEClFan3_0 2024-09-19T15:31:38.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.932+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2114311078443443678', time=2024-09-19T16:42:57.380238+0000, chain.objs.size()=1 2024-09-19T15:31:38.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.932+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.2Ofj7VzeVUOvM2rSvK-bZ5M8XUUhaVY_0 2024-09-19T15:31:38.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.932+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5043394897022335939', time=2024-09-19T16:42:58.203201+0000, chain.objs.size()=1 2024-09-19T15:31:38.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.932+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.gBtGwmGHfsS5gxuojeCOpoTNX15fo33_0 2024-09-19T15:31:38.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.932+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12315126650360502915', time=2024-09-19T16:42:59.785825+0000, chain.objs.size()=1 2024-09-19T15:31:38.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.932+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.i8b2L8heY7j1HaekN__N2lzY-mSyGKW_0 2024-09-19T15:31:38.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.932+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9140914305188477580', time=2024-09-19T16:42:59.952918+0000, chain.objs.size()=1 2024-09-19T15:31:38.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.932+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Pjx_pPiNGp5mvA2QhRA9mVpdj8BPgT__0 2024-09-19T15:31:38.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11271998397266111577', time=2024-09-19T16:47:18.046172+0000, chain.objs.size()=1 2024-09-19T15:31:38.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.P6yDCXkPVLts-TnClILzv0SHKRv_e0W_0 2024-09-19T15:31:38.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7162495298763839124', time=2024-09-19T16:47:18.576662+0000, chain.objs.size()=1 2024-09-19T15:31:38.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.aw4l_mtfJX64zzY4XRTYvpJcMGx_dWb_0 2024-09-19T15:31:38.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14434667343382432844', time=2024-09-19T16:47:19.115041+0000, chain.objs.size()=1 2024-09-19T15:31:38.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.2AUKgqow_cRwgQtKI9XC8DSIDgCDNLE_0 2024-09-19T15:31:38.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4160009665586850307', time=2024-09-19T16:47:19.408209+0000, chain.objs.size()=1 2024-09-19T15:31:38.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.wW6S_zLpNyjyDxsPu0JcV8_-FblPLdZ_0 2024-09-19T15:31:38.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4815366888619977948', time=2024-09-19T16:47:19.608851+0000, chain.objs.size()=1 2024-09-19T15:31:38.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.-fUWTpuJoBAK8nwwlC4NzC1ZqVbsJAx_0 2024-09-19T15:31:38.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8226551416224109184', time=2024-09-19T16:47:20.952477+0000, chain.objs.size()=1 2024-09-19T15:31:38.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_._PosCJdReGbhjMSeuL8GeNUR8cVLXVP_0 2024-09-19T15:31:38.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7888717895692317459', time=2024-09-19T16:47:21.210657+0000, chain.objs.size()=1 2024-09-19T15:31:38.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_._G3Ux3V6e3Fu32wNPirjYN7KA_8iw90_0 2024-09-19T15:31:38.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11363162426484597000', time=2024-09-19T16:47:22.819495+0000, chain.objs.size()=1 2024-09-19T15:31:38.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.6v_6z-7mCZZ1BoU0ZLCXMVAgdmyC4_2_0 2024-09-19T15:31:38.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.940+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16792815478153999067', time=2024-09-19T16:47:23.432718+0000, chain.objs.size()=1 2024-09-19T15:31:38.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.940+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.qcHB5Ffk9Gbb8RalWi72OkmO39_H5VC_0 2024-09-19T15:31:38.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.940+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.737134817683523008', time=2024-09-19T16:47:23.517637+0000, chain.objs.size()=1 2024-09-19T15:31:38.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.940+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.m67sXqdk0h_H5JcTwGWU1Wy97ZXskZi_0 2024-09-19T15:31:38.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.940+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15066209428492930197', time=2024-09-19T16:47:23.852532+0000, chain.objs.size()=1 2024-09-19T15:31:38.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.940+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.whujMizHea8pspcPxpMY-f6Sx4vLTA6_0 2024-09-19T15:31:38.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.944+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16408336884117419473', time=2024-09-19T16:47:24.451974+0000, chain.objs.size()=1 2024-09-19T15:31:38.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.944+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.qbfgYx_Yle7_Xf7L4nrbQGaX46EyVCu_0 2024-09-19T15:31:38.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.944+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13234129821796491712', time=2024-09-19T16:47:24.508419+0000, chain.objs.size()=1 2024-09-19T15:31:38.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.944+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.w-3R7C0DEyKOzON89GWNcyx9wPw4DWX_0 2024-09-19T15:31:38.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.944+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1051558626903256734', time=2024-09-19T16:47:24.875878+0000, chain.objs.size()=1 2024-09-19T15:31:38.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.944+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.z0opyMrRcL54IKdTZx5AcUfknQEOLOQ_0 2024-09-19T15:31:38.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.944+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11822920532205460878', time=2024-09-19T16:47:26.836312+0000, chain.objs.size()=1 2024-09-19T15:31:38.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.944+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.WY4A5pcxzoy_en_iY9_1IKDvk85d7ZC_0 2024-09-19T15:31:38.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.944+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.668818726543543084', time=2024-09-19T16:47:27.382421+0000, chain.objs.size()=1 2024-09-19T15:31:38.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.944+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.px4eTVwrGkUgjZAiNVLZVvK4bu2EBul_0 2024-09-19T15:31:38.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.944+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6461073578973425777', time=2024-09-19T16:47:28.287075+0000, chain.objs.size()=1 2024-09-19T15:31:38.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.944+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.sM1Ve7r90IPfk09NyedL-SUlmcqBHh8_0 2024-09-19T15:31:38.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.944+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3403916847048128577', time=2024-09-19T16:47:31.098147+0000, chain.objs.size()=1 2024-09-19T15:31:38.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.944+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.MuH0VVpOUeaNMvw214enr3sTce8uXZY_0 2024-09-19T15:31:38.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.944+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1099047320191067441', time=2024-09-19T16:47:31.183439+0000, chain.objs.size()=1 2024-09-19T15:31:38.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.944+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Lg0SjXe9wQMyiQHksEXCKvxbye2TNgY_0 2024-09-19T15:31:38.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.944+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13976068638796186836', time=2024-09-19T16:47:32.592008+0000, chain.objs.size()=1 2024-09-19T15:31:38.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.944+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.qwPwIIk5lUpEYjqL25v_ME92yGT2U_a_0 2024-09-19T15:31:38.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.944+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8750238080679165226', time=2024-09-19T16:47:33.810202+0000, chain.objs.size()=1 2024-09-19T15:31:38.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.944+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.iI5Ycqwtqnx52QDirya3i8QcsjcNjw__0 2024-09-19T15:31:38.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.944+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9500381992247671075', time=2024-09-19T16:47:34.309538+0000, chain.objs.size()=1 2024-09-19T15:31:38.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.944+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.pagyouX2KrkfDyPj2yYW448fYFzhifq_0 2024-09-19T15:31:38.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.948+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13770382791313110624', time=2024-09-19T16:47:35.786286+0000, chain.objs.size()=1 2024-09-19T15:31:38.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.948+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.SPkFWDHF8WU9IWA_rPBL4E-TuEcBLym_0 2024-09-19T15:31:38.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.948+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14955586921291123531', time=2024-09-19T16:47:35.824444+0000, chain.objs.size()=1 2024-09-19T15:31:38.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.948+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.MpqV_e6WiwvpQBOXs3MFIG83bamdf_Y_0 2024-09-19T15:31:38.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.948+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18444906053841985605', time=2024-09-19T16:47:35.898296+0000, chain.objs.size()=1 2024-09-19T15:31:38.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.948+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.D2pjDGJned4UTAXX848dqNB_iP0r9g0_0 2024-09-19T15:31:38.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.948+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5387243785368379796', time=2024-09-19T16:47:36.539005+0000, chain.objs.size()=1 2024-09-19T15:31:38.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.948+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.wujhdpbJJldP-NccubifjUUF5s8Atac_0 2024-09-19T15:31:38.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.948+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12324239156213276037', time=2024-09-19T16:47:40.373352+0000, chain.objs.size()=1 2024-09-19T15:31:38.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.948+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.DW_xGygldpYZpYq_vaWylhv4FWbgIV1_0 2024-09-19T15:31:38.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.948+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14873604422884971556', time=2024-09-19T16:47:41.312753+0000, chain.objs.size()=1 2024-09-19T15:31:38.956 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.948+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.h22uSc28lpj2fimXvI8lWOrlb6Babiq_0 2024-09-19T15:31:38.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.952+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9860907791435116241', time=2024-09-19T16:47:41.411367+0000, chain.objs.size()=1 2024-09-19T15:31:38.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.952+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Vhl-TAdpbHgUB23fYroovurqP4UZueQ_0 2024-09-19T15:31:38.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.952+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15526088099184243207', time=2024-09-19T16:47:41.659771+0000, chain.objs.size()=1 2024-09-19T15:31:38.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.952+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.YmLVgmBo0EU4Og3hwflIXkc-lAlNNpE_0 2024-09-19T15:31:38.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.952+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2283504083503878228', time=2024-09-19T16:47:41.964709+0000, chain.objs.size()=1 2024-09-19T15:31:38.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.952+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.wV_s1zp4gICC6dC_2PYCOcQba2M64ww_0 2024-09-19T15:31:38.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.952+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12863388524016037699', time=2024-09-19T16:47:45.026162+0000, chain.objs.size()=1 2024-09-19T15:31:38.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.952+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.MDte9bDCQhJuij0LA3tKd7CR1pdpTCp_0 2024-09-19T15:31:38.957 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.952+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8087076061456717385', time=2024-09-19T16:47:46.641044+0000, chain.objs.size()=1 2024-09-19T15:31:38.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.952+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.hf8hkgSr2S0_39Xe6Avkft5QLHUVE5H_0 2024-09-19T15:31:38.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.956+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13654641776911271828', time=2024-09-19T16:47:46.700976+0000, chain.objs.size()=1 2024-09-19T15:31:38.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.956+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.EflZfzA5UuFYjRuctHE9zTTjcnGiUc1_0 2024-09-19T15:31:38.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.956+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8083122830952576145', time=2024-09-19T16:47:46.703260+0000, chain.objs.size()=1 2024-09-19T15:31:38.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.956+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.-eQLf68QnlDZiMlsq6y4cEVnyt2fLzM_0 2024-09-19T15:31:38.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.956+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11810357938024714404', time=2024-09-19T16:47:48.375847+0000, chain.objs.size()=1 2024-09-19T15:31:38.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.956+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.mn_u_ddfFhsunMzaUM35rtarUBLCnZD_0 2024-09-19T15:31:38.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.956+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3119784032087414060', time=2024-09-19T16:47:48.967331+0000, chain.objs.size()=1 2024-09-19T15:31:38.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.956+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.XgJJaTmh__G6WoIfeSaLLj90LSDaz7F_0 2024-09-19T15:31:38.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.956+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17193341945789255410', time=2024-09-19T16:47:49.268263+0000, chain.objs.size()=1 2024-09-19T15:31:38.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.956+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.82dXz7uAwPwmZz16ZxMbyENUx5FUPnp_0 2024-09-19T15:31:38.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.956+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5742616412403480506', time=2024-09-19T16:49:35.211563+0000, chain.objs.size()=1 2024-09-19T15:31:38.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.956+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Uu42LgYtavd51VdDpvVnkTDfXGjvH0g_0 2024-09-19T15:31:38.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.960+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13552298281243868147', time=2024-09-19T16:49:35.645968+0000, chain.objs.size()=1 2024-09-19T15:31:38.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.960+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ulniC5g14C6VZ7Vh-nY9dmz-7RfoDKY_0 2024-09-19T15:31:38.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.960+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16956145910057395629', time=2024-09-19T16:49:38.152581+0000, chain.objs.size()=1 2024-09-19T15:31:38.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.960+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.QRQBHvAaKdGDS9YHUvodDiOQp7txXIQ_0 2024-09-19T15:31:38.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.960+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8652964470654037302', time=2024-09-19T16:49:42.243850+0000, chain.objs.size()=1 2024-09-19T15:31:38.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.960+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Ru0Gs6sfid3fOmORf1Dy6UDILrulWUg_0 2024-09-19T15:31:38.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.960+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15520580174989549516', time=2024-09-19T16:49:43.582141+0000, chain.objs.size()=1 2024-09-19T15:31:38.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.960+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.2ld3VvCdVzYhIOuRCZQ7RLB59-XS2H8_0 2024-09-19T15:31:38.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.960+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14228541516006529187', time=2024-09-19T16:49:43.583754+0000, chain.objs.size()=1 2024-09-19T15:31:38.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.960+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.LLRybkalOFTxaGCdG8ZrQlYfGPn6hGs_0 2024-09-19T15:31:38.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.960+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16896395521762310996', time=2024-09-19T16:49:45.673123+0000, chain.objs.size()=1 2024-09-19T15:31:38.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.960+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.poRY_rvg1Hie_aWC96XuMbRnMNmUyPE_0 2024-09-19T15:31:38.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.960+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15988538960018309557', time=2024-09-19T16:49:45.967410+0000, chain.objs.size()=1 2024-09-19T15:31:38.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.960+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.1FouQjHIjYuP4rwUAMGG20AwZoElF_R_0 2024-09-19T15:31:38.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.964+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1781845054904223521', time=2024-09-19T16:49:46.141297+0000, chain.objs.size()=1 2024-09-19T15:31:38.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.964+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.nnYimlsn5YHz7NRGC9M9cPl2zh9QG_n_0 2024-09-19T15:31:38.970 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.964+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6051192060341733133', time=2024-09-19T16:49:46.644812+0000, chain.objs.size()=1 2024-09-19T15:31:38.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.964+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.WhGKPOMwqYp-2rY2AbFEFPqANGhinb6_0 2024-09-19T15:31:38.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.964+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5423694708582178897', time=2024-09-19T16:49:46.789196+0000, chain.objs.size()=1 2024-09-19T15:31:38.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.964+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.lXux7bMV0Em9c2hHmxRes01LTf6Uf-m_0 2024-09-19T15:31:38.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.964+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16765287573943002180', time=2024-09-19T16:49:47.788365+0000, chain.objs.size()=1 2024-09-19T15:31:38.971 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.964+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.nWx5KBKsNzvtxabg-wNnSX50pmSXtvF_0 2024-09-19T15:31:38.972 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.968+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1776781059855707149', time=2024-09-19T16:49:50.061622+0000, chain.objs.size()=1 2024-09-19T15:31:38.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.968+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.eTlO_SY3Ijumcxn5iS1Q7e1eE7VvHZD_0 2024-09-19T15:31:38.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.968+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15171704623742864239', time=2024-09-19T16:49:52.783210+0000, chain.objs.size()=1 2024-09-19T15:31:38.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.968+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.7-cd8QVD0IUcQiRABg56O6_GQe-Kptn_0 2024-09-19T15:31:38.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.968+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3370430984152472801', time=2024-09-19T16:49:53.626455+0000, chain.objs.size()=1 2024-09-19T15:31:38.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.968+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.bcHn33mSi9yJ2305VVHYHk0YPmfS01Z_0 2024-09-19T15:31:38.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.968+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7973550685549903080', time=2024-09-19T16:49:56.932376+0000, chain.objs.size()=1 2024-09-19T15:31:38.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.968+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.SYLw0bt3nkiW2Odv0o6Alw3kAAIpiHG_0 2024-09-19T15:31:38.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.968+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15760053327859385466', time=2024-09-19T16:49:57.241139+0000, chain.objs.size()=1 2024-09-19T15:31:38.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.968+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.RcWxcNzQ9uQxgPSBuwxakngXsoRCyys_0 2024-09-19T15:31:38.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.968+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16134297991306568114', time=2024-09-19T16:49:58.055302+0000, chain.objs.size()=1 2024-09-19T15:31:38.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.968+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.oMDWYN3T6Nr16FYWGLcUbuov3giUpd6_0 2024-09-19T15:31:38.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.968+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10860243085704021147', time=2024-09-19T16:49:58.328895+0000, chain.objs.size()=1 2024-09-19T15:31:38.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.968+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.wOSUlWMEcEfSKVzmgfqz7W7LPaEJXwd_0 2024-09-19T15:31:38.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.972+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15450100084150454745', time=2024-09-19T16:49:58.802289+0000, chain.objs.size()=1 2024-09-19T15:31:38.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.972+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.3u8APEVf8HsMCvetBY6fwYXumM8B2sF_0 2024-09-19T15:31:38.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.972+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4605769092033951709', time=2024-09-19T16:50:00.095582+0000, chain.objs.size()=1 2024-09-19T15:31:38.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.972+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.bZIu3-Ke5q7_z5S_8SSBBeXy6yKgF38_0 2024-09-19T15:31:38.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.972+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13910298394410903301', time=2024-09-19T16:50:01.237178+0000, chain.objs.size()=1 2024-09-19T15:31:38.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.972+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.P0xDraAB2fD3e8RAv0SPYS1Cg111LxZ_0 2024-09-19T15:31:38.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.972+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3070929704606448469', time=2024-09-19T16:50:01.567256+0000, chain.objs.size()=1 2024-09-19T15:31:38.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.972+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.TAfUbxU0Y-38dt4q6SegtmRoVoXIxYs_0 2024-09-19T15:31:38.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.972+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3263408776492842284', time=2024-09-19T16:50:02.697920+0000, chain.objs.size()=1 2024-09-19T15:31:38.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.972+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.W_LrkFjxGMItHsNBzxx24McX-j3iwIj_0 2024-09-19T15:31:38.983 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.976+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47808 2024-09-19T15:31:38.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-19T15:31:38.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1112238431919445655', time=2024-09-19T16:50:04.812395+0000, chain.objs.size()=1 2024-09-19T15:31:38.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.m9R6MC0_iUv20xiY3-WiixcejIomI1N_0 2024-09-19T15:31:38.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14083061118607046474', time=2024-09-19T16:50:04.892458+0000, chain.objs.size()=1 2024-09-19T15:31:38.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.EXtxY4o8GV0h4Rn5CIIntCIAvl92b4Q_0 2024-09-19T15:31:38.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4410074808239146864', time=2024-09-19T16:50:05.173731+0000, chain.objs.size()=1 2024-09-19T15:31:38.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.wEyadFECGS0yVWOFhnPNMb1t64MKydE_0 2024-09-19T15:31:38.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14046101340865891311', time=2024-09-19T16:50:05.363571+0000, chain.objs.size()=1 2024-09-19T15:31:38.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.4De_U8M2n2GpArp24j8szayReqa8vUA_0 2024-09-19T15:31:38.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4976781200359064900', time=2024-09-19T16:50:05.365809+0000, chain.objs.size()=1 2024-09-19T15:31:38.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.6bMmDuChZhcq94MtBXSamQfMc-IOkUr_0 2024-09-19T15:31:38.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5338936091242756249', time=2024-09-19T16:50:06.130999+0000, chain.objs.size()=1 2024-09-19T15:31:38.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.px7qScGXJ6ZVHVLU1st_JY0UGXaANdb_0 2024-09-19T15:31:38.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2576518032618526035', time=2024-09-19T16:50:10.354784+0000, chain.objs.size()=1 2024-09-19T15:31:38.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.326__shadow_.oPyKiaJ9-zkXUmkbSham47AclNiiKTI_0 2024-09-19T15:31:38.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13742832604637396603', time=2024-09-19T16:52:04.787725+0000, chain.objs.size()=1 2024-09-19T15:31:38.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.384__shadow_.Sj7pvvdVW_slRnYMAqLWZisFMUD0vDJ_0 2024-09-19T15:31:38.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17377437744994219478', time=2024-09-19T16:54:54.640995+0000, chain.objs.size()=1 2024-09-19T15:31:38.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.462__shadow_.fiRboPboYCwp0iQ5ysEdwAnrMZ6uLKn_0 2024-09-19T15:31:38.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2851435401292236069', time=2024-09-19T16:55:32.866847+0000, chain.objs.size()=1 2024-09-19T15:31:38.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.483__shadow_.xyQmKiaI_YYFCBskeNA94d1sd54BLtd_0 2024-09-19T15:31:38.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2629734397379901370', time=2024-09-19T16:55:37.250450+0000, chain.objs.size()=1 2024-09-19T15:31:38.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.485__shadow_.sNZCDuh9QqeeYAe6BQSFBREjS4lMq2m_0 2024-09-19T15:31:38.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7924354063676699301', time=2024-09-19T16:55:50.723621+0000, chain.objs.size()=1 2024-09-19T15:31:38.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.980+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.488__shadow_.TjRRxa5eTTjRTVaEE_ZfdVczdBEBw3o_0 2024-09-19T15:31:38.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.988+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8827312531224696783', time=2024-09-19T16:56:22.045464+0000, chain.objs.size()=1 2024-09-19T15:31:38.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.988+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.503__shadow:vjdbIfRxBe4w.PbHfN6JGIQynOLNKTv_.1FlZE6YVJFffVLJR2xeEpNz8BJZrUMj_0 2024-09-19T15:31:38.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.988+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14711868280285479859', time=2024-09-19T16:57:48.500869+0000, chain.objs.size()=1 2024-09-19T15:31:38.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.988+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.517__shadow_.VcLOr8T_gAyUhQCKscfe9UzQPx0IEVH_0 2024-09-19T15:31:38.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.988+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~fJ_lIzQ9BKqSVIjHylAxHBm0ue_zlDs', time=2024-09-19T17:00:11.004354+0000, chain.objs.size()=1 2024-09-19T15:31:38.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.988+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~fJ_lIzQ9BKqSVIjHylAxHBm0ue_zlDs.2 2024-09-19T15:31:38.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.988+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11905426737252118669', time=2024-09-19T17:03:14.291301+0000, chain.objs.size()=1 2024-09-19T15:31:38.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.988+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.525__multipart_mymultipart.2~Ky0L5JXdDWseEOvNhiabDbZuVOJxunY.1 2024-09-19T15:31:38.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.988+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2784392685578449696', time=2024-09-19T17:07:31.180535+0000, chain.objs.size()=1 2024-09-19T15:31:38.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.988+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.564__shadow_.S2sdS_JiozyW9oZHih9muXR9xD_o-Hw_0 2024-09-19T15:31:38.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.988+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12439805134295692162', time=2024-09-19T17:07:55.776918+0000, chain.objs.size()=1 2024-09-19T15:31:38.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.988+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:ZgTaAVWduKhv5CBfGnllIyC0h2Sa4F4_.lDYzFSBAw73HgQ5TyfomeqfDSIp38DL_0 2024-09-19T15:31:38.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.988+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6770221855760004013', time=2024-09-19T17:08:20.555272+0000, chain.objs.size()=1 2024-09-19T15:31:38.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.988+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.574__shadow_.PChKglzL5ovs64JSSsDEwM9tRlgyJ3A_0 2024-09-19T15:31:38.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.988+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12096022721826170920', time=2024-09-19T17:10:36.505578+0000, chain.objs.size()=1 2024-09-19T15:31:38.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.988+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.580__shadow:XdUISp7PpZQqiYQfjwQ9PbR3ZNzvxbp_.WxiQilZ-crESV_z27FPP5RO7Xcaowx__0 2024-09-19T15:31:38.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.988+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9326371308293195606', time=2024-09-19T17:10:38.645565+0000, chain.objs.size()=1 2024-09-19T15:31:38.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.988+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.582__shadow:Hp14feDkkvhYthz15DJky7IcSHC.9Gi_.27P57vvONxGIN72DTDqN3r-BWXdcdQN_0 2024-09-19T15:31:38.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.988+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8917512115842189035', time=2024-09-19T17:18:06.299599+0000, chain.objs.size()=1 2024-09-19T15:31:38.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.988+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.629__shadow_.LbFMiqq90bLtYJTmXzn6X2M8CGHQiWO_0 2024-09-19T15:31:38.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.988+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3430191701924736364', time=2024-09-19T17:20:43.637405+0000, chain.objs.size()=1 2024-09-19T15:31:38.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.988+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.665__shadow_.WPoGp5rFxnyCzviDIiOobH8sGSzSwaN_0 2024-09-19T15:31:38.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.992+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~swj_Sb06691LxPmuPlUrx6BnPwiGClW', time=2024-09-19T17:24:01.868697+0000, chain.objs.size()=1 2024-09-19T15:31:38.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.992+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.742__multipart_mymultipart.2~swj_Sb06691LxPmuPlUrx6BnPwiGClW.1 2024-09-19T15:31:38.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.992+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~Oc3RENgGRbNSOZ6O3R96aarpsw4pbYy', time=2024-09-19T17:24:01.919030+0000, chain.objs.size()=1 2024-09-19T15:31:38.999 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:38.992+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.742__multipart_mymultipart2.2~Oc3RENgGRbNSOZ6O3R96aarpsw4pbYy.1 2024-09-19T15:31:39.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.000+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:39.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.004+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T15:31:39.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.004+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:39.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.004+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:39.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.008+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43264' 2024-09-19T15:31:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.008+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15226630053117355477', time=2024-09-19T16:32:00.087300+0000, chain.objs.size()=1 2024-09-19T15:31:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.008+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.148__shadow_.dkQAOiB3SihjOoU-J9XqjAbjcu-0BPR_0 2024-09-19T15:31:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.008+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6533024035455284595', time=2024-09-19T16:32:49.779364+0000, chain.objs.size()=3 2024-09-19T15:31:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.008+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.159__multipart_mymultipart-FROZEN.2~LHeLGPoGiNgaRvoVszi0swBpwfAO0lo.1 2024-09-19T15:31:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.008+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.159__multipart_mymultipart-FROZEN.2~LHeLGPoGiNgaRvoVszi0swBpwfAO0lo.2 2024-09-19T15:31:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.008+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.159__multipart_mymultipart-FROZEN.2~LHeLGPoGiNgaRvoVszi0swBpwfAO0lo.3 2024-09-19T15:31:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.008+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8812552195817701120', time=2024-09-19T16:36:02.052254+0000, chain.objs.size()=1 2024-09-19T15:31:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.008+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.203__shadow_.GZ-G31nq07yvk0A1oYDjjFOLfSTRvZF_0 2024-09-19T15:31:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.008+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4379115848996674758', time=2024-09-19T16:39:27.076690+0000, chain.objs.size()=1 2024-09-19T15:31:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.008+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.231__shadow_.0v2b4jV55iq84A-fFXxcG73IciuRPid_0 2024-09-19T15:31:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.008+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6463209229519060571', time=2024-09-19T16:39:52.656011+0000, chain.objs.size()=1 2024-09-19T15:31:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.008+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.241__shadow_.vKizfgbqn18ErXCpzU9BozjRgNlWqY__0 2024-09-19T15:31:39.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.008+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3513494230204406509', time=2024-09-19T16:39:54.948046+0000, chain.objs.size()=1 2024-09-19T15:31:39.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.008+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.242__shadow_.ts3a9YxW1xPOel0gx6RtY8aXPd-eTCI_0 2024-09-19T15:31:39.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.008+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10377620549101155924', time=2024-09-19T16:39:54.974587+0000, chain.objs.size()=1 2024-09-19T15:31:39.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.008+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.242__shadow_.5qN9lj9nq9BBuOtVnJOu4CcrkSBUqwz_0 2024-09-19T15:31:39.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.008+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16796724330561279062', time=2024-09-19T16:40:09.698364+0000, chain.objs.size()=1 2024-09-19T15:31:39.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.008+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.247__shadow_.2Tx0ENmCrt7JamTL2vTr2E_fmUvV7i3_0 2024-09-19T15:31:39.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.008+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17595074398138972905', time=2024-09-19T16:40:12.076178+0000, chain.objs.size()=1 2024-09-19T15:31:39.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.008+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.248__shadow_.j7Tbk8yk7dA5AyYI7-6Hg2knj5J_Du3_0 2024-09-19T15:31:39.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.008+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4269660123888559729', time=2024-09-19T16:40:23.646299+0000, chain.objs.size()=1 2024-09-19T15:31:39.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.008+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.253__shadow_.kCi280SfkFm9i-LCe8mJPuYRjNltiDP_0 2024-09-19T15:31:39.015 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.012+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13667536752622165442', time=2024-09-19T16:42:28.639189+0000, chain.objs.size()=1 2024-09-19T15:31:39.016 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.012+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.l4d6XhznUa7m79AYQWhwzFqryI_Jjs5_0 2024-09-19T15:31:39.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.012+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10224469378868124287', time=2024-09-19T16:42:29.077908+0000, chain.objs.size()=1 2024-09-19T15:31:39.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.012+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Bufrk5DBbV0lUJiE3ZktTQ2ojWK-3ZX_0 2024-09-19T15:31:39.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.012+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6335401820243661834', time=2024-09-19T16:42:29.156876+0000, chain.objs.size()=1 2024-09-19T15:31:39.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.012+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.sotw337E-5CkcNGBIQA43ibNiaHGMuU_0 2024-09-19T15:31:39.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.012+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5031980721658890693', time=2024-09-19T16:42:29.278766+0000, chain.objs.size()=1 2024-09-19T15:31:39.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.012+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.0fwYnZIWQOLYCPIo6-XTclBadMsz8o1_0 2024-09-19T15:31:39.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.012+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.794369900975370624', time=2024-09-19T16:42:30.058600+0000, chain.objs.size()=1 2024-09-19T15:31:39.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.012+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.3mRn5phz3pblVRUno9iB1MODCqLUVsV_0 2024-09-19T15:31:39.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.012+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2072320297703214776', time=2024-09-19T16:42:30.157248+0000, chain.objs.size()=1 2024-09-19T15:31:39.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.012+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.B3uAMTLhYjqMlhdES_2wco_-MP_8U1u_0 2024-09-19T15:31:39.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.012+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5814432753187031762', time=2024-09-19T16:42:30.369562+0000, chain.objs.size()=1 2024-09-19T15:31:39.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.012+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.mL_TnqwtHry17Zm6WWqqj7xCN0z-sY2_0 2024-09-19T15:31:39.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.012+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1290934435725041841', time=2024-09-19T16:42:34.160576+0000, chain.objs.size()=1 2024-09-19T15:31:39.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.012+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.2gM2JxYsOp4Hh-78LaiXITceijNdgj5_0 2024-09-19T15:31:39.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.012+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6034869463452588647', time=2024-09-19T16:42:35.144284+0000, chain.objs.size()=1 2024-09-19T15:31:39.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.012+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.6cnViCqlEGpe-9Fh91VAP9YfxGofjjf_0 2024-09-19T15:31:39.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.012+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6481004036753841425', time=2024-09-19T16:42:35.204571+0000, chain.objs.size()=1 2024-09-19T15:31:39.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.012+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.rpNbuFnJb_J3ETc2FhnAguiil9rQDZY_0 2024-09-19T15:31:39.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.012+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15758197730700342755', time=2024-09-19T16:42:39.706295+0000, chain.objs.size()=1 2024-09-19T15:31:39.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.012+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.xf_kdp3QIid2fBN-ZVv4F-_I-rRyAcJ_0 2024-09-19T15:31:39.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.016+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5952038635794937211', time=2024-09-19T16:42:44.084373+0000, chain.objs.size()=1 2024-09-19T15:31:39.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.016+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.LgH67ZGH_W9Y1xbiFmkbWJGOB5ImBub_0 2024-09-19T15:31:39.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.016+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18418949520810042361', time=2024-09-19T16:42:45.287918+0000, chain.objs.size()=1 2024-09-19T15:31:39.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.016+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.AEkEdCRlDNjFlzyODzfAD2T5ZDIZH_C_0 2024-09-19T15:31:39.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.016+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5698239170244693228', time=2024-09-19T16:42:47.793176+0000, chain.objs.size()=1 2024-09-19T15:31:39.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.016+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.2_j0DH8h0qpEE3YNnofQk25WNk1twAp_0 2024-09-19T15:31:39.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.016+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3147864327102484290', time=2024-09-19T16:42:49.303787+0000, chain.objs.size()=1 2024-09-19T15:31:39.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.016+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.0sK2e-noSMEqwh-l6WShDZg8YS55FwO_0 2024-09-19T15:31:39.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.020+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14649348387358519793', time=2024-09-19T16:42:51.000091+0000, chain.objs.size()=1 2024-09-19T15:31:39.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.020+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.vur-x4LokR1owQ__nUd0P-cGmekSGri_0 2024-09-19T15:31:39.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.020+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1687026050782028569', time=2024-09-19T16:42:51.141119+0000, chain.objs.size()=1 2024-09-19T15:31:39.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.020+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.yktuzWW_lfLdeQn1Qv8BbMrMrhzRjvL_0 2024-09-19T15:31:39.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.020+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4013829320479701780', time=2024-09-19T16:42:51.667743+0000, chain.objs.size()=1 2024-09-19T15:31:39.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.020+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.mOmqTkS4FKIYrFzUX8KyzFLksNyOfQu_0 2024-09-19T15:31:39.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.020+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6774966201808575888', time=2024-09-19T16:42:52.503591+0000, chain.objs.size()=1 2024-09-19T15:31:39.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.020+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.i45xpuyRVDfvCuIeqn5emPfaGtvrHvT_0 2024-09-19T15:31:39.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.020+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5419716247095198554', time=2024-09-19T16:42:54.670496+0000, chain.objs.size()=1 2024-09-19T15:31:39.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.020+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Flxkpf36IJ6tRKgQYtP8Vxe-Dmt9sao_0 2024-09-19T15:31:39.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.020+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7712412079218565604', time=2024-09-19T16:42:57.382298+0000, chain.objs.size()=1 2024-09-19T15:31:39.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.020+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.JCbsb0AQokYFUAGXHhUWU4Ij4NO4kl3_0 2024-09-19T15:31:39.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.020+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17333045528314790237', time=2024-09-19T16:42:57.384326+0000, chain.objs.size()=1 2024-09-19T15:31:39.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.020+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.M9cAYKOUJrrwnIyB2TjmDpfx9pHNBPB_0 2024-09-19T15:31:39.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.020+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15195737470966385148', time=2024-09-19T16:42:57.546899+0000, chain.objs.size()=1 2024-09-19T15:31:39.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.020+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.qt52TVXHodJGOgkrBOxFUstJwdosFDs_0 2024-09-19T15:31:39.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.024+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11385243657508820662', time=2024-09-19T16:42:58.707235+0000, chain.objs.size()=1 2024-09-19T15:31:39.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.024+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Z7y2kL7VdjVZ0s8rPXV08TvlasCNltn_0 2024-09-19T15:31:39.028 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.024+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.777204180375824749', time=2024-09-19T16:43:00.007142+0000, chain.objs.size()=1 2024-09-19T15:31:39.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.024+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.csJXAWMacLRmwpRKrQzfgJD0g6FvBTd_0 2024-09-19T15:31:39.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.024+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15269312262430986754', time=2024-09-19T16:43:35.844478+0000, chain.objs.size()=1 2024-09-19T15:31:39.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.024+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.278__shadow_.NIHPGwBXnM0jnWfNF1SQRx2BqsYDnZz_0 2024-09-19T15:31:39.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.024+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10872996547577546614', time=2024-09-19T16:43:40.551033+0000, chain.objs.size()=1 2024-09-19T15:31:39.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.024+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.280__shadow_.yuHmpLhdOqu1SAAr1P8lxCqyOX2QmbC_0 2024-09-19T15:31:39.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.028+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18055256789819370511', time=2024-09-19T16:43:40.552437+0000, chain.objs.size()=1 2024-09-19T15:31:39.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.028+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.280__shadow_.3lqeRidJWQVNO38ooQ7GkdSd2my8xeI_0 2024-09-19T15:31:39.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.028+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3686447581573294745', time=2024-09-19T16:43:54.815439+0000, chain.objs.size()=1 2024-09-19T15:31:39.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.028+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.286__shadow_.heDsmPKs0HtuQU3KSLqybuyQgORfFvE_0 2024-09-19T15:31:39.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.028+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3885202306918862910', time=2024-09-19T16:43:57.153629+0000, chain.objs.size()=1 2024-09-19T15:31:39.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.028+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.287__shadow_.UYiU_WbADn-01WAgwrlyfHJSG8lxHQC_0 2024-09-19T15:31:39.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.028+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15055377865707433363', time=2024-09-19T16:44:12.441644+0000, chain.objs.size()=1 2024-09-19T15:31:39.033 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.028+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_.geBOEUGTk5_d84icwlb-JBwj1Yv_cby_0 2024-09-19T15:31:39.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.028+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10588159940883338607', time=2024-09-19T16:44:12.892171+0000, chain.objs.size()=1 2024-09-19T15:31:39.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.028+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_.CtYq4hk_eiBzZ_53skQAR15avoEuM33_0 2024-09-19T15:31:39.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.028+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16589256551627216205', time=2024-09-19T16:44:25.686992+0000, chain.objs.size()=1 2024-09-19T15:31:39.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.028+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.296__shadow_.2jd43vxwLA754eIvsjQLNZqWWHxbrnZ_0 2024-09-19T15:31:39.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.028+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6857204229146146686', time=2024-09-19T16:44:30.473594+0000, chain.objs.size()=1 2024-09-19T15:31:39.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.028+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.298__shadow_.9kywHQJ6GAL0sm5LuXj2qr3rNLCp8VH_0 2024-09-19T15:31:39.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.028+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4366820169794732107', time=2024-09-19T16:44:37.820983+0000, chain.objs.size()=1 2024-09-19T15:31:39.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.028+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.301__shadow_.naZcQQX_bFgstHQVSLyfFG_p3kGXnJC_0 2024-09-19T15:31:39.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.028+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3993277824895748997', time=2024-09-19T16:47:19.088914+0000, chain.objs.size()=1 2024-09-19T15:31:39.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.028+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.9oDrM74zwWAaefpUkzK2cUV1vAwHAZZ_0 2024-09-19T15:31:39.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.032+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1050642284164893504', time=2024-09-19T16:47:19.564037+0000, chain.objs.size()=1 2024-09-19T15:31:39.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.032+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.bxhmZnIwoUWGktop4ex20LZ8CdSmHiz_0 2024-09-19T15:31:39.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.032+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16301600931825689303', time=2024-09-19T16:47:20.028867+0000, chain.objs.size()=1 2024-09-19T15:31:39.037 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.032+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.NIQDF-W1bEl0Vnh2mMd_BizYqyB2yx7_0 2024-09-19T15:31:39.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.036+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14801321799623044510', time=2024-09-19T16:47:22.476221+0000, chain.objs.size()=1 2024-09-19T15:31:39.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.036+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.7VBr8iZaTugROfNzmduGf_GFvX4nKLw_0 2024-09-19T15:31:39.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.036+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13148228403500936078', time=2024-09-19T16:47:23.211607+0000, chain.objs.size()=1 2024-09-19T15:31:39.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.036+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.fZY88hfKCHPZ9vuM4Y3jXKUX6l-hsuI_0 2024-09-19T15:31:39.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.036+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1237046221151910938', time=2024-09-19T16:47:27.214796+0000, chain.objs.size()=1 2024-09-19T15:31:39.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.036+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.5hMojn825SheQ236KJSkD4RhNNAjtz5_0 2024-09-19T15:31:39.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.036+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8898277388078583121', time=2024-09-19T16:47:27.269199+0000, chain.objs.size()=1 2024-09-19T15:31:39.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.036+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.XWCKHZyuN26CCRxmDW_GxsINapxncva_0 2024-09-19T15:31:39.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.036+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17598064236317342944', time=2024-09-19T16:47:27.876953+0000, chain.objs.size()=1 2024-09-19T15:31:39.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.036+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.x3GM4hQwS4w4tc6xjv66CIkJYkiWD7E_0 2024-09-19T15:31:39.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.036+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.450009368498865452', time=2024-09-19T16:47:28.949420+0000, chain.objs.size()=1 2024-09-19T15:31:39.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.036+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.2FVCkcc_r8zxVjh9xT11r9hg4bgCmsJ_0 2024-09-19T15:31:39.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.036+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6647033496619246866', time=2024-09-19T16:47:29.321693+0000, chain.objs.size()=1 2024-09-19T15:31:39.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.036+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.z0sA0n8eTkTo80lZNYtbq72HbOxKZMk_0 2024-09-19T15:31:39.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.036+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8699628665502875489', time=2024-09-19T16:47:29.719414+0000, chain.objs.size()=1 2024-09-19T15:31:39.041 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.036+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ypiocQm2Mp-6olr-IhBO_npbXpI2KJl_0 2024-09-19T15:31:39.042 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.036+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7342300916053567634', time=2024-09-19T16:47:30.018096+0000, chain.objs.size()=1 2024-09-19T15:31:39.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.036+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.PsJ92dUdFRDdEMtzaCwbAymXnPl6E_R_0 2024-09-19T15:31:39.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.036+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14852300937067358151', time=2024-09-19T16:47:31.000759+0000, chain.objs.size()=1 2024-09-19T15:31:39.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.036+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Dw2ihd-ytQ45oevlFfqDKA0ZOwd7LtP_0 2024-09-19T15:31:39.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.036+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14117736507773708416', time=2024-09-19T16:47:32.018742+0000, chain.objs.size()=1 2024-09-19T15:31:39.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.036+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.oxpWezXvTULDlt5Ab-1QJ1kyllKmNCb_0 2024-09-19T15:31:39.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.040+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3606145173704146797', time=2024-09-19T16:47:32.458340+0000, chain.objs.size()=1 2024-09-19T15:31:39.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.040+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.4LMSHnJVk000bu3CI2miOhsoT5doFEF_0 2024-09-19T15:31:39.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.040+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8408073683098553593', time=2024-09-19T16:47:32.900320+0000, chain.objs.size()=1 2024-09-19T15:31:39.045 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.040+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.EOsv2TsRKbSJookk8aBl6rvj5UA5RHB_0 2024-09-19T15:31:39.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.040+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17289005239714597730', time=2024-09-19T16:47:33.321045+0000, chain.objs.size()=1 2024-09-19T15:31:39.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.040+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.l2SR9GIygmQ7F4QNLmbmrQIpQJnLjXJ_0 2024-09-19T15:31:39.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.040+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17012041990309206014', time=2024-09-19T16:47:33.588518+0000, chain.objs.size()=1 2024-09-19T15:31:39.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.040+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ks_jlC39--fKN0f5tQePaXkA_61hd-h_0 2024-09-19T15:31:39.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.040+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17694756243089752172', time=2024-09-19T16:47:34.333584+0000, chain.objs.size()=1 2024-09-19T15:31:39.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.040+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.A7ZPOr4IGvO-HQ606UF8QAN4GFG58VW_0 2024-09-19T15:31:39.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.040+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15022932602073851850', time=2024-09-19T16:47:35.373051+0000, chain.objs.size()=1 2024-09-19T15:31:39.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.040+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.AKcZ3qMv8b7_Ql9UqKRItayDguCE0cj_0 2024-09-19T15:31:39.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.040+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2554065069265871267', time=2024-09-19T16:47:37.165815+0000, chain.objs.size()=1 2024-09-19T15:31:39.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.040+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.zxQrX1J5gcYHDEU4G84EZHWnGRZWIjh_0 2024-09-19T15:31:39.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.044+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13405583541386442417', time=2024-09-19T16:47:39.520689+0000, chain.objs.size()=1 2024-09-19T15:31:39.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.044+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ub0ertV5UGM6goLbCpZ1p3xKqHeE7B-_0 2024-09-19T15:31:39.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.044+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7034418066794006396', time=2024-09-19T16:47:40.007311+0000, chain.objs.size()=1 2024-09-19T15:31:39.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.044+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.IOeOnSZUaI6RFLESDoShmFx9zNoFTX0_0 2024-09-19T15:31:39.048 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.044+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9531086193511386985', time=2024-09-19T16:47:40.209540+0000, chain.objs.size()=1 2024-09-19T15:31:39.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.044+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.HId2juKhwyD7PedCJjpjz0ju7AtGtJ-_0 2024-09-19T15:31:39.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.044+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12047779259439096603', time=2024-09-19T16:47:40.749265+0000, chain.objs.size()=1 2024-09-19T15:31:39.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.044+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ZPYYG565d4N3hRxKz6U1O96jEtR6Pdp_0 2024-09-19T15:31:39.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.044+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8626234143816317321', time=2024-09-19T16:47:40.864149+0000, chain.objs.size()=1 2024-09-19T15:31:39.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.044+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Ypu3QtN6skIN6gUpHvyk12LG5ApSqxf_0 2024-09-19T15:31:39.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.044+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13523361264545544938', time=2024-09-19T16:47:40.956485+0000, chain.objs.size()=1 2024-09-19T15:31:39.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.044+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.TlqD9DUxL_6z36OSD0KjVL72_ElpGvr_0 2024-09-19T15:31:39.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.048+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9471476417103480239', time=2024-09-19T16:47:41.140461+0000, chain.objs.size()=1 2024-09-19T15:31:39.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.048+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.U3wTNyLoBrqRJ1yhLX9EDCy3yeR_m_t_0 2024-09-19T15:31:39.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.048+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12888094041396504028', time=2024-09-19T16:47:41.807937+0000, chain.objs.size()=1 2024-09-19T15:31:39.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.048+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.H_dGVU41pQIlxF1UN9F1GjSd3F2wy9I_0 2024-09-19T15:31:39.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.048+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2300596535682951843', time=2024-09-19T16:47:41.952205+0000, chain.objs.size()=1 2024-09-19T15:31:39.053 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.048+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Zjp0mpMAshrmpJ9fZDVUPcZBMCnjS78_0 2024-09-19T15:31:39.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.048+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7053819998942899696', time=2024-09-19T16:47:41.954128+0000, chain.objs.size()=1 2024-09-19T15:31:39.054 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.048+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.NLGZlk2Ra768s9UiNGh9qrxu1Z_SSB0_0 2024-09-19T15:31:39.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.052+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1130972830732477111', time=2024-09-19T16:47:42.661421+0000, chain.objs.size()=1 2024-09-19T15:31:39.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.052+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.HZx_OzF5fCDrCDMRZtooehGUtYvhUkI_0 2024-09-19T15:31:39.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.052+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5009887009362034195', time=2024-09-19T16:47:44.598220+0000, chain.objs.size()=1 2024-09-19T15:31:39.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.052+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.a6xg1iNvvQCX4773fLRDDLj4C6OWO_4_0 2024-09-19T15:31:39.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.052+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5014426458097367628', time=2024-09-19T16:47:46.133052+0000, chain.objs.size()=1 2024-09-19T15:31:39.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.052+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.puqJhx1JBuYy0XC2GAdauDAFrQu0-Ao_0 2024-09-19T15:31:39.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.052+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15981795885905485715', time=2024-09-19T16:47:47.494029+0000, chain.objs.size()=1 2024-09-19T15:31:39.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.052+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.DtEIleSyp8vfSKYErMwN7PDZl1Khu2p_0 2024-09-19T15:31:39.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.052+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10223540814704699840', time=2024-09-19T16:47:48.451920+0000, chain.objs.size()=1 2024-09-19T15:31:39.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.052+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Q9FdvaKDj8kBVmFv0DM7GZohbvsNbeK_0 2024-09-19T15:31:39.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.052+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3695463086978089504', time=2024-09-19T16:47:48.855178+0000, chain.objs.size()=1 2024-09-19T15:31:39.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.052+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.huP0_piE0m9NTfyJXunQyKNQQtSfzlS_0 2024-09-19T15:31:39.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.052+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5675782884708837669', time=2024-09-19T16:47:48.995892+0000, chain.objs.size()=1 2024-09-19T15:31:39.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.052+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.qFCo_iCsqfLpK3iRngqnIfltLmbPAj0_0 2024-09-19T15:31:39.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.052+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4024664742323512655', time=2024-09-19T16:47:49.135665+0000, chain.objs.size()=1 2024-09-19T15:31:39.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.052+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.XOhVBleJNW0OBGv9t7NO86F5-W9Gt-E_0 2024-09-19T15:31:39.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.052+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17149959580460380766', time=2024-09-19T16:49:36.314999+0000, chain.objs.size()=1 2024-09-19T15:31:39.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.052+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.LiwLPHXnc2UT8hyBeffIWQ7cc4vMw4P_0 2024-09-19T15:31:39.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.052+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4031813457796920473', time=2024-09-19T16:49:37.267848+0000, chain.objs.size()=1 2024-09-19T15:31:39.059 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.052+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.jvlwFueYWS9LuOQQSmUTGuYCxAKsw4B_0 2024-09-19T15:31:39.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.056+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14314160275997443249', time=2024-09-19T16:49:37.947258+0000, chain.objs.size()=1 2024-09-19T15:31:39.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.056+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.9KzUbyhxz9dCM2fQHDAe8EBRYba-Hsl_0 2024-09-19T15:31:39.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.056+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1491252532810493030', time=2024-09-19T16:49:40.693382+0000, chain.objs.size()=1 2024-09-19T15:31:39.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.056+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.26ncJ94A1g_HNvqY3kgHuzBnIere6Rx_0 2024-09-19T15:31:39.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.056+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3001938759301579230', time=2024-09-19T16:49:40.931516+0000, chain.objs.size()=1 2024-09-19T15:31:39.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.056+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.LNomJ1e--uVN6tVg46oRUdSXHava2D6_0 2024-09-19T15:31:39.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.056+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9973518716551483215', time=2024-09-19T16:49:40.966315+0000, chain.objs.size()=1 2024-09-19T15:31:39.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.056+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.TlaKEaLUdMTj4FkMwl77ukdscqzNbfX_0 2024-09-19T15:31:39.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.056+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11084370408643321902', time=2024-09-19T16:49:42.292584+0000, chain.objs.size()=1 2024-09-19T15:31:39.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.056+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.obN2zsW1FNRonr0B89LnIG97uZkXWRo_0 2024-09-19T15:31:39.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.056+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17050996896903853916', time=2024-09-19T16:49:43.741379+0000, chain.objs.size()=1 2024-09-19T15:31:39.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.056+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.c_4qSGCFPUtJpz-2q8uSNMd4sPDxODa_0 2024-09-19T15:31:39.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.056+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.187469801591921242', time=2024-09-19T16:49:43.812655+0000, chain.objs.size()=1 2024-09-19T15:31:39.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.056+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Z-d4lBkFEh1URqeZ_l1GxihA4BGLKxS_0 2024-09-19T15:31:39.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.056+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9036498027051200680', time=2024-09-19T16:49:44.719984+0000, chain.objs.size()=1 2024-09-19T15:31:39.063 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.056+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.pwIGkx6sBPZe37AL5wm3UjjFqy-7vfy_0 2024-09-19T15:31:39.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.060+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18423434521818907238', time=2024-09-19T16:49:46.509731+0000, chain.objs.size()=1 2024-09-19T15:31:39.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.060+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Xs5I6Pdiz6g9KGykTQyHZPeC4B1Q2Xl_0 2024-09-19T15:31:39.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.060+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10236142718881238479', time=2024-09-19T16:49:46.592062+0000, chain.objs.size()=1 2024-09-19T15:31:39.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.060+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.V9dDJrSNrEQshxDUpClYeqVboGiZ5i5_0 2024-09-19T15:31:39.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.060+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15307762414076626565', time=2024-09-19T16:49:46.870788+0000, chain.objs.size()=1 2024-09-19T15:31:39.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.060+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.4dkBm5dfJBvvF4nFvsG7oW-dUnFm1sg_0 2024-09-19T15:31:39.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.060+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12917882297209457319', time=2024-09-19T16:49:47.875526+0000, chain.objs.size()=1 2024-09-19T15:31:39.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.060+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.u6_hEDagTE6z6e3h2y7GW6VMzW3qiKe_0 2024-09-19T15:31:39.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.060+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6899906773141567420', time=2024-09-19T16:49:48.828215+0000, chain.objs.size()=1 2024-09-19T15:31:39.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.060+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.NBjpZAzV8pUPkXxJO35lBmYBXupA91E_0 2024-09-19T15:31:39.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.060+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8741866554825247001', time=2024-09-19T16:49:49.189036+0000, chain.objs.size()=1 2024-09-19T15:31:39.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.060+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.PEEKglL-qAS2cu3EnzbUlt9SIvmGydA_0 2024-09-19T15:31:39.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.068+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43264 2024-09-19T15:31:39.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-19T15:31:39.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8346260191118154218', time=2024-09-19T16:49:49.609492+0000, chain.objs.size()=1 2024-09-19T15:31:39.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.rzRIlPJJrMmfH-rJHi4GuxNTB2X4L_q_0 2024-09-19T15:31:39.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15295483135335643475', time=2024-09-19T16:49:51.976123+0000, chain.objs.size()=1 2024-09-19T15:31:39.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.QGlmoSobaTltVo4tmmGZCHfo-PnUy4K_0 2024-09-19T15:31:39.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12240389719698205864', time=2024-09-19T16:49:53.352053+0000, chain.objs.size()=1 2024-09-19T15:31:39.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.n6W1SwU6NFQ9rs_CiVUO0oazNllBmsK_0 2024-09-19T15:31:39.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12280275221991706751', time=2024-09-19T16:49:53.451255+0000, chain.objs.size()=1 2024-09-19T15:31:39.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.3RHL4WMlOltASZz5bICgeU9A-t00b8F_0 2024-09-19T15:31:39.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8017718844917069019', time=2024-09-19T16:49:53.452970+0000, chain.objs.size()=1 2024-09-19T15:31:39.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_._VIvmVNB18eY6pSiPjHZP_lpzBMSpm1_0 2024-09-19T15:31:39.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13557467050692002742', time=2024-09-19T16:49:54.633702+0000, chain.objs.size()=1 2024-09-19T15:31:39.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ldRBcRLMqtxJumfiut8YS9ioNg50zq4_0 2024-09-19T15:31:39.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12997510993383940142', time=2024-09-19T16:49:57.764444+0000, chain.objs.size()=1 2024-09-19T15:31:39.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Dp_hBK8GQttXoDiq6ixI-po8qc-2qgw_0 2024-09-19T15:31:39.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2034339400676594513', time=2024-09-19T16:49:58.505684+0000, chain.objs.size()=1 2024-09-19T15:31:39.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.axFcsNN3RgmwxZK0z-oGcdj6YCF5veW_0 2024-09-19T15:31:39.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9305354795108617044', time=2024-09-19T16:50:00.358792+0000, chain.objs.size()=1 2024-09-19T15:31:39.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.CDfeNgS1_Ey5W6f49XlGHQ_elchrex1_0 2024-09-19T15:31:39.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15185178668655942009', time=2024-09-19T16:50:02.787965+0000, chain.objs.size()=1 2024-09-19T15:31:39.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.FufBBclYN8rUUdeF52XiWtniJJjQJYA_0 2024-09-19T15:31:39.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5250357564522315507', time=2024-09-19T16:50:02.909788+0000, chain.objs.size()=1 2024-09-19T15:31:39.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.hnEAOCmFoKLelR5jTvNE4hfB7ylrGly_0 2024-09-19T15:31:39.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13472336222131547969', time=2024-09-19T16:50:03.194247+0000, chain.objs.size()=1 2024-09-19T15:31:39.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.072+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.NRXze2srgFUWj-CS2a-7KjqjiYRxLr-_0 2024-09-19T15:31:39.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.076+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2010512545991526270', time=2024-09-19T16:50:04.115490+0000, chain.objs.size()=1 2024-09-19T15:31:39.080 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.076+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.2fJmWyPMAcb-WhLsYSrld4zOJiHYatx_0 2024-09-19T15:31:39.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.076+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15932534650038668878', time=2024-09-19T16:50:04.349591+0000, chain.objs.size()=1 2024-09-19T15:31:39.081 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.076+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.QaaZUny4L-NsTR9WSJFTZAkW5mCW36s_0 2024-09-19T15:31:39.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.076+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6728743840145472892', time=2024-09-19T16:50:14.277678+0000, chain.objs.size()=1 2024-09-19T15:31:39.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.076+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.328__shadow_.QcvGFYIcQ3nBbXQkVmeLXnBL1ewTxel_0 2024-09-19T15:31:39.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.076+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4008433036243557747', time=2024-09-19T16:51:36.792590+0000, chain.objs.size()=1 2024-09-19T15:31:39.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.076+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.371__shadow_.ANR_uHVM4uTH1CqB3xwj4o6ZvswxECn_0 2024-09-19T15:31:39.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.076+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10361532948891599128', time=2024-09-19T16:53:58.285896+0000, chain.objs.size()=1 2024-09-19T15:31:39.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.076+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.440__shadow_.DzKTxXB69LQvV0k2_93dPTvTbJKhjSw_0 2024-09-19T15:31:39.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.076+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16054910498087982151', time=2024-09-19T17:04:04.974136+0000, chain.objs.size()=2 2024-09-19T15:31:39.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.076+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.528__multipart_mymultipart.2~jal_Rq46vuyA7bm13iy1krKvB_v-tTJ.1 2024-09-19T15:31:39.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.076+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.528__multipart_mymultipart.2~jal_Rq46vuyA7bm13iy1krKvB_v-tTJ.2 2024-09-19T15:31:39.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.080+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~KN28XBrZ2b-2GAGnptuD2uiwt0zbHE-', time=2024-09-19T17:04:23.124293+0000, chain.objs.size()=1 2024-09-19T15:31:39.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.080+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.531__multipart_mymultipart.2~KN28XBrZ2b-2GAGnptuD2uiwt0zbHE-.1 2024-09-19T15:31:39.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.080+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10327558372875335977', time=2024-09-19T17:05:55.868871+0000, chain.objs.size()=1 2024-09-19T15:31:39.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.080+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.551__shadow_.SmTLKrAbMyddAJcX32gWGMChQrMPNOA_0 2024-09-19T15:31:39.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.080+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.64572920540166138', time=2024-09-19T17:06:38.798697+0000, chain.objs.size()=1 2024-09-19T15:31:39.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.080+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.555__shadow_.SBbKFYNXBBnu9NhAihj2jNyK93K04SR_0 2024-09-19T15:31:39.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.080+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5210212461636536909', time=2024-09-19T17:08:06.817115+0000, chain.objs.size()=1 2024-09-19T15:31:39.085 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.080+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.570__shadow:cbP2vHiBh0ZH4.xoaJbHY.lUOoWGJXm_.jqSWmJRFWdqAhlZijocDIDGFKFXPdfQ_0 2024-09-19T15:31:39.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.080+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5318945647332186952', time=2024-09-19T17:08:53.316009+0000, chain.objs.size()=1 2024-09-19T15:31:39.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.080+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:KfOzzizGoiCr1GhFJhZQd2AjANZb.D4_.-vKdrG8aP3rtEMD8Rgm3PxXUVZfJoI8_0 2024-09-19T15:31:39.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.080+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12270306962978368147', time=2024-09-19T17:09:15.137818+0000, chain.objs.size()=1 2024-09-19T15:31:39.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.080+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:Mlnu05hFSghlpSE3ggcJiqkE9NfntZs_.-YYuoRIz5n6d8eIF5fjdDZgouI5DCcO_0 2024-09-19T15:31:39.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.080+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9623700747615934382', time=2024-09-19T17:10:41.708148+0000, chain.objs.size()=1 2024-09-19T15:31:39.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.080+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.583__shadow:9AUkgQHEUw7Wc..XMp2W7kxI1-wqXWS_.56CVMw9KlxttIL02bRKSsmO9KnSnshP_0 2024-09-19T15:31:39.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.080+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16314591058986654441', time=2024-09-19T17:11:31.649009+0000, chain.objs.size()=1 2024-09-19T15:31:39.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.080+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.605__shadow_._O0W60NjHKXv1sIqdoap7hbDwtfcSht_0 2024-09-19T15:31:39.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.080+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11841460820600046117', time=2024-09-19T17:18:10.331572+0000, chain.objs.size()=1 2024-09-19T15:31:39.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.080+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.631__shadow_.XSwY3asc-Hv09E3KX97SWFoUh42OJMQ_0 2024-09-19T15:31:39.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.080+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16683946518889691746', time=2024-09-19T17:18:30.603156+0000, chain.objs.size()=1 2024-09-19T15:31:39.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.080+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.641__shadow_.QC9UDUBNJ_AFNx-torWzheeAxAbmZ6j_0 2024-09-19T15:31:39.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.080+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16767514523322895816', time=2024-09-19T17:19:24.505676+0000, chain.objs.size()=1 2024-09-19T15:31:39.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.080+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.653__shadow_.VvG-q5TK9zTP0JV4diGihTDoSSTa5Y5_0 2024-09-19T15:31:39.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.084+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8936227071186119029', time=2024-09-19T17:21:39.388223+0000, chain.objs.size()=1 2024-09-19T15:31:39.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.084+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.695__shadow_.9J-eE7QSgo_HnlFDB1PkqSugjM9fgjY_0 2024-09-19T15:31:39.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.084+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11922736437019535929', time=2024-09-19T17:22:13.874701+0000, chain.objs.size()=1 2024-09-19T15:31:39.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.084+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.711__multipart_file1.2~eT32IqhJgrO-OdgDPFJz3Hk5aOvKu55.1 2024-09-19T15:31:39.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.084+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6243267125115370899', time=2024-09-19T17:26:23.503349+0000, chain.objs.size()=1 2024-09-19T15:31:39.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.084+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.757__shadow_.s9aVo_ADgxAFGrSZpxaydW190zRkeb0_0 2024-09-19T15:31:39.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.088+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:39.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.088+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T15:31:39.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:39.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:39.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51187' 2024-09-19T15:31:39.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='_qJazxIk_9VBQZUSgR7gyWWDhn8iqe_V', time=2024-09-19T16:33:51.129770+0000, chain.objs.size()=2 2024-09-19T15:31:39.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.161__shadow_.IS8kpmwBsKoSQrZOabWzRcaVvt_sNWs_0 2024-09-19T15:31:39.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.161__shadow_.IS8kpmwBsKoSQrZOabWzRcaVvt_sNWs_1 2024-09-19T15:31:39.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='_ea1KUobDLbVJgyjnonyNart0i-GIEfS', time=2024-09-19T16:34:11.799581+0000, chain.objs.size()=1 2024-09-19T15:31:39.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.165__shadow_.z1DwQ-pn4vFHdMzigIhAQuhxVWkeOI7_0 2024-09-19T15:31:39.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13802703444085406359', time=2024-09-19T16:34:48.944737+0000, chain.objs.size()=1 2024-09-19T15:31:39.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.178__shadow_.bEAvX0onfUXYBhq2IYyTaAfCsHsQEDe_0 2024-09-19T15:31:39.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.172519390919813743', time=2024-09-19T16:40:09.721995+0000, chain.objs.size()=1 2024-09-19T15:31:39.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.247__shadow_.b5ziDvzA9EwjisZzEx6HcPXW3C00Lvy_0 2024-09-19T15:31:39.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17664806097955149476', time=2024-09-19T16:40:12.050988+0000, chain.objs.size()=1 2024-09-19T15:31:39.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.248__shadow_.KBAH0limN6aNJAJyrRLRa4kAPJ8ljL6_0 2024-09-19T15:31:39.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9727767193634399870', time=2024-09-19T16:42:28.141337+0000, chain.objs.size()=1 2024-09-19T15:31:39.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.VckmSInMSLCi60AJWxCU2G1QF_dVpup_0 2024-09-19T15:31:39.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9730207013996713937', time=2024-09-19T16:42:28.542639+0000, chain.objs.size()=1 2024-09-19T15:31:39.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.LkVyXpRNxgEalpobVhz50gB0ifkNIuh_0 2024-09-19T15:31:39.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1021502867696358692', time=2024-09-19T16:42:28.544244+0000, chain.objs.size()=1 2024-09-19T15:31:39.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ZLiaQFNNv_JkCYr7w3X7dA_uqfw6dQN_0 2024-09-19T15:31:39.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15547281377426125911', time=2024-09-19T16:42:28.724475+0000, chain.objs.size()=1 2024-09-19T15:31:39.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.-tw1Hpyq31QGnBuHGbzrkU5gpEkqw2D_0 2024-09-19T15:31:39.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4403743489420713495', time=2024-09-19T16:42:28.963446+0000, chain.objs.size()=1 2024-09-19T15:31:39.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.PoKWktDBtnaQzNJfKlKt08WR2uSEJSX_0 2024-09-19T15:31:39.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12606011960518511779', time=2024-09-19T16:42:29.687706+0000, chain.objs.size()=1 2024-09-19T15:31:39.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.092+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.E-RjTK0Wke8MX4vEYrDmAwVwU2ci3wg_0 2024-09-19T15:31:39.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.096+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2364712719384238970', time=2024-09-19T16:42:30.858588+0000, chain.objs.size()=1 2024-09-19T15:31:39.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.096+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.doGkLWJqGLCclHq4Vb1DXL4Wl1IItD4_0 2024-09-19T15:31:39.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.096+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11532385389176350900', time=2024-09-19T16:42:34.869208+0000, chain.objs.size()=1 2024-09-19T15:31:39.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.096+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.UnvHYUhI-K_xj9ss04W43DXKIsRuk0B_0 2024-09-19T15:31:39.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.096+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13118300899463609361', time=2024-09-19T16:42:35.755093+0000, chain.objs.size()=1 2024-09-19T15:31:39.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.096+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.J6XvgijqL3VHXoQUk1l9qxlf0s9Q5ig_0 2024-09-19T15:31:39.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.096+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12329811320736537576', time=2024-09-19T16:42:36.917865+0000, chain.objs.size()=1 2024-09-19T15:31:39.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.096+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.M0C5rPElIjVvyMum-1CoWpusZEDyuCF_0 2024-09-19T15:31:39.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.096+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1947878859163045381', time=2024-09-19T16:42:36.920175+0000, chain.objs.size()=1 2024-09-19T15:31:39.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.096+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.AHUZwpcBW8yzrCkRL6V2hz5iV9D6iZg_0 2024-09-19T15:31:39.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.096+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15951656301165905271', time=2024-09-19T16:42:37.217660+0000, chain.objs.size()=1 2024-09-19T15:31:39.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.096+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.opSzn-yrgnlDjTL7qjub94QyMHWksL8_0 2024-09-19T15:31:39.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.096+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5542925396187841194', time=2024-09-19T16:42:37.716627+0000, chain.objs.size()=1 2024-09-19T15:31:39.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.096+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.8WHwxHHwDOK8HzwhVgAPWzkmAdbSQ0S_0 2024-09-19T15:31:39.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.096+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3782729858144240679', time=2024-09-19T16:42:38.527744+0000, chain.objs.size()=1 2024-09-19T15:31:39.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.096+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.iX6Z_8_epB573oYorzlSPUdHiLQ4JNS_0 2024-09-19T15:31:39.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.096+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11940217125068038761', time=2024-09-19T16:42:40.005482+0000, chain.objs.size()=1 2024-09-19T15:31:39.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.096+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.oM4oBB-OqrdGZ3RHByD7GPC7mAdGONR_0 2024-09-19T15:31:39.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.096+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5165342252158728057', time=2024-09-19T16:42:41.142817+0000, chain.objs.size()=1 2024-09-19T15:31:39.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.096+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.5J-1EELFHIpoZ0d2GcT8P0r2PXz90C9_0 2024-09-19T15:31:39.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.096+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18288694886590767613', time=2024-09-19T16:42:41.474504+0000, chain.objs.size()=1 2024-09-19T15:31:39.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.096+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.L8lsN6yy9BGv3fPrRUFjvwupmFRyXCN_0 2024-09-19T15:31:39.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.100+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8024527417793692555', time=2024-09-19T16:42:42.363159+0000, chain.objs.size()=1 2024-09-19T15:31:39.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.100+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.wTeR8x9WkmDAs5OV-fmLfuios6k1gv3_0 2024-09-19T15:31:39.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.100+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10553809041182659030', time=2024-09-19T16:42:42.718683+0000, chain.objs.size()=1 2024-09-19T15:31:39.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.100+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.SWvDC0w_TojKl7HUQR_WHKsQlJUY6Yz_0 2024-09-19T15:31:39.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.100+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1241763944637366972', time=2024-09-19T16:42:43.608021+0000, chain.objs.size()=1 2024-09-19T15:31:39.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.100+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.qQ8PbeUFc3MpDhFw65s1SPvW-3LrztZ_0 2024-09-19T15:31:39.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.100+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15850484997145851140', time=2024-09-19T16:42:45.778559+0000, chain.objs.size()=1 2024-09-19T15:31:39.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.100+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.y7eEM6e87k6LHi2vwulxTwJ08UEK_IO_0 2024-09-19T15:31:39.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.100+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8914998395694286332', time=2024-09-19T16:42:46.343713+0000, chain.objs.size()=1 2024-09-19T15:31:39.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.100+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.15kkbJ6j3sIfA2ONRc_ANTewbecMLwv_0 2024-09-19T15:31:39.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.100+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14714040728251376808', time=2024-09-19T16:42:46.577287+0000, chain.objs.size()=1 2024-09-19T15:31:39.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.100+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.SsJJaw1K61neiQwnErurZ2zW73SdFqY_0 2024-09-19T15:31:39.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.100+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6107978129206330726', time=2024-09-19T16:42:47.049657+0000, chain.objs.size()=1 2024-09-19T15:31:39.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.100+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.mSfMJbkEOOqUrk1kW6h18NV1TQjV1LD_0 2024-09-19T15:31:39.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.100+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8572192638513334019', time=2024-09-19T16:42:47.307991+0000, chain.objs.size()=1 2024-09-19T15:31:39.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.100+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.fb3nJzIU3WLFqgWI8L5mfoBsc5NLblt_0 2024-09-19T15:31:39.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.100+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.323260230266768715', time=2024-09-19T16:42:47.782349+0000, chain.objs.size()=1 2024-09-19T15:31:39.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.100+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.0ri8goB9xwykjdj9dH5HYDmK0OP9teB_0 2024-09-19T15:31:39.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.100+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2155993937683701916', time=2024-09-19T16:42:50.401080+0000, chain.objs.size()=1 2024-09-19T15:31:39.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.100+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.6OTn97olIaABfJae1xzOPION6FwOevc_0 2024-09-19T15:31:39.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.100+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18177962629230809929', time=2024-09-19T16:42:51.709530+0000, chain.objs.size()=1 2024-09-19T15:31:39.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.100+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.2KaIk_a-dLwG_3XXc2n1VQi5ITXf3m3_0 2024-09-19T15:31:39.108 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.104+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8116109803722960973', time=2024-09-19T16:42:53.351379+0000, chain.objs.size()=1 2024-09-19T15:31:39.108 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.104+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ShCaRS_6awPGL4dI4vCsPISOyppWL_6_0 2024-09-19T15:31:39.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.104+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17160145553069678122', time=2024-09-19T16:42:53.353627+0000, chain.objs.size()=1 2024-09-19T15:31:39.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.104+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ppKBg782XCPsHmnZfj0h6jpptXSTzgq_0 2024-09-19T15:31:39.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.104+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14685980765770612388', time=2024-09-19T16:42:54.518194+0000, chain.objs.size()=1 2024-09-19T15:31:39.111 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.104+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ZItRPNT25gGXtMMbnjxWleLdetn_zOj_0 2024-09-19T15:31:39.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.104+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4671775849234159559', time=2024-09-19T16:42:54.659858+0000, chain.objs.size()=1 2024-09-19T15:31:39.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.104+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.OyFdmneKXGN3QQ9-y2v18q54P7nGCmm_0 2024-09-19T15:31:39.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.104+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1369637187686652877', time=2024-09-19T16:42:54.799418+0000, chain.objs.size()=1 2024-09-19T15:31:39.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.104+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.csm6rH3X1eFe5nf6orXD6N8tM5N9Io7_0 2024-09-19T15:31:39.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.104+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10939702481532791262', time=2024-09-19T16:42:54.851095+0000, chain.objs.size()=1 2024-09-19T15:31:39.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.104+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.3rWedFHrXeOC29rzGuqgJS1nbF5At6p_0 2024-09-19T15:31:39.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.104+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11080403404071258314', time=2024-09-19T16:42:55.258794+0000, chain.objs.size()=1 2024-09-19T15:31:39.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.104+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.THM6rFfHlh76Lmr7UEi4yyNOv8wHe0p_0 2024-09-19T15:31:39.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.104+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5174522964773405718', time=2024-09-19T16:42:58.400647+0000, chain.objs.size()=1 2024-09-19T15:31:39.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.104+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.NmPQfrS7hNUzKqGiBiaBOiWRKLU1X7A_0 2024-09-19T15:31:39.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.104+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16732892662752525352', time=2024-09-19T16:42:58.403936+0000, chain.objs.size()=1 2024-09-19T15:31:39.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.104+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.wnhEV_-aEamHjzUTbnIUyKNxvSknHaZ_0 2024-09-19T15:31:39.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.104+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.861635462811181613', time=2024-09-19T16:42:59.461391+0000, chain.objs.size()=1 2024-09-19T15:31:39.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.104+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.-Vf7OK1dlSkDGtJYEGdnJivk1S8-yGN_0 2024-09-19T15:31:39.113 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.108+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2724430508641189750', time=2024-09-19T16:43:19.967470+0000, chain.objs.size()=1 2024-09-19T15:31:39.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.108+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.271__shadow_.emDP6OCtBFb0zt_EFJ5mbO-D3yHDDoX_0 2024-09-19T15:31:39.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.108+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17960387987309154136', time=2024-09-19T16:43:31.257100+0000, chain.objs.size()=1 2024-09-19T15:31:39.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.108+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.276__shadow_.lVNmI7RDncjWJAXBSvdEtAMHEfN4XkJ_0 2024-09-19T15:31:39.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.108+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13610138783568458229', time=2024-09-19T16:43:33.497460+0000, chain.objs.size()=1 2024-09-19T15:31:39.114 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.108+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.277__shadow_.w4lWipoR1Ex6Pf4iBERN1h88ng8dCUw_0 2024-09-19T15:31:39.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.112+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17195741416765541254', time=2024-09-19T16:43:47.503168+0000, chain.objs.size()=1 2024-09-19T15:31:39.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.112+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.283__shadow_.cThqYi9OdZeC4tFbLdYmMddGSfNWuj2_0 2024-09-19T15:31:39.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.112+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11950440028242609552', time=2024-09-19T16:44:25.699853+0000, chain.objs.size()=1 2024-09-19T15:31:39.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.112+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.296__shadow_.MGriOpUYydZx4TM11SsIrJJm2U-i8JA_0 2024-09-19T15:31:39.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.112+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8416124823359888748', time=2024-09-19T16:44:25.717221+0000, chain.objs.size()=1 2024-09-19T15:31:39.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.112+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.296__shadow_.LEApfJBUKZLL9fTA0IS3z4OtS0NciEI_0 2024-09-19T15:31:39.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.112+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3207846445728950794', time=2024-09-19T16:47:17.970698+0000, chain.objs.size()=1 2024-09-19T15:31:39.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.112+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.6Kh-mYac8uHvrHAiARGUq_xb2eWodEr_0 2024-09-19T15:31:39.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.112+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14377997331884816730', time=2024-09-19T16:47:20.436339+0000, chain.objs.size()=1 2024-09-19T15:31:39.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.112+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.6vrGI2bnj7KUfg36d-i9t5XUC8x5H6Y_0 2024-09-19T15:31:39.117 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.112+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3365531850566232786', time=2024-09-19T16:47:20.625913+0000, chain.objs.size()=1 2024-09-19T15:31:39.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.112+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.tIpRVHradDJZPmgTbnxIAz8Wn2m96zx_0 2024-09-19T15:31:39.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.112+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10913108533858856305', time=2024-09-19T16:47:20.790925+0000, chain.objs.size()=1 2024-09-19T15:31:39.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.112+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Xh7Uo6OGZrJ3rjqFaICXY8MACL7LHqQ_0 2024-09-19T15:31:39.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.112+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2428356302660783969', time=2024-09-19T16:47:23.434815+0000, chain.objs.size()=1 2024-09-19T15:31:39.118 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.112+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.XoO2E3jqoV39hj_6il280lJRGrK2XLr_0 2024-09-19T15:31:39.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.112+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7961860459740710143', time=2024-09-19T16:47:24.288528+0000, chain.objs.size()=1 2024-09-19T15:31:39.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.112+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.RhUG-Kxh0DAh1Atw-b1i6QFp3LX36wr_0 2024-09-19T15:31:39.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.112+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2942308704046894805', time=2024-09-19T16:47:26.749965+0000, chain.objs.size()=1 2024-09-19T15:31:39.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.112+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.lR-5ijWg_-PP4SUpOooG9M38Uh6MBt3_0 2024-09-19T15:31:39.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.112+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2189834638521725047', time=2024-09-19T16:47:27.718018+0000, chain.objs.size()=1 2024-09-19T15:31:39.119 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.112+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.nZnHNSTAUK-PaeUwEb944cA0aKVbBnr_0 2024-09-19T15:31:39.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.116+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9547305506366227630', time=2024-09-19T16:47:28.285969+0000, chain.objs.size()=1 2024-09-19T15:31:39.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.116+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_._DAcj0UtpJXb8fxAJvZPskupU7n0xiH_0 2024-09-19T15:31:39.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.116+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1698779971454657486', time=2024-09-19T16:47:31.972673+0000, chain.objs.size()=1 2024-09-19T15:31:39.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.116+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.bGMPAPiG6beydvfINKmbkDm1AWIUwW6_0 2024-09-19T15:31:39.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.116+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8420567686114848053', time=2024-09-19T16:47:36.263759+0000, chain.objs.size()=1 2024-09-19T15:31:39.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.116+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ybJGItaWfZxf8dEGCCew7qb0o9NF9-s_0 2024-09-19T15:31:39.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.116+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15234717157568760217', time=2024-09-19T16:47:38.379707+0000, chain.objs.size()=1 2024-09-19T15:31:39.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.116+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Fw_s9QtzZzf_dPHzHZh5Ht4vu7fVS9T_0 2024-09-19T15:31:39.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.116+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13199542037763326258', time=2024-09-19T16:47:39.470580+0000, chain.objs.size()=1 2024-09-19T15:31:39.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.116+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.7-irk2DXK_PF-0_EBWZ_VvsbEVOjlLy_0 2024-09-19T15:31:39.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.116+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11788208556073597981', time=2024-09-19T16:47:39.867223+0000, chain.objs.size()=1 2024-09-19T15:31:39.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.116+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.VcW6LpWK8HY6YmXtYDOuEhbA4Lt4yYE_0 2024-09-19T15:31:39.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.116+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12707526475913497529', time=2024-09-19T16:47:40.846969+0000, chain.objs.size()=1 2024-09-19T15:31:39.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.116+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.N5IftQPl1G5G4LUhJhHwEmXmuIGyuz5_0 2024-09-19T15:31:39.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.116+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16623009301584186721', time=2024-09-19T16:47:42.652179+0000, chain.objs.size()=1 2024-09-19T15:31:39.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.116+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.qRouSHrpSp8dKRyo3dxDNJpQWD5Dajl_0 2024-09-19T15:31:39.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.120+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6323481908523518282', time=2024-09-19T16:47:43.406305+0000, chain.objs.size()=1 2024-09-19T15:31:39.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.120+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.TiAGBJAHz0-IWody_ck64yC1bfGUxfn_0 2024-09-19T15:31:39.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.120+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15098220742414956288', time=2024-09-19T16:47:43.703814+0000, chain.objs.size()=1 2024-09-19T15:31:39.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.120+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.FrxIvY5TVDtAgtM-VAQ4iU-x1GNkwiZ_0 2024-09-19T15:31:39.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.120+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2262314432390260641', time=2024-09-19T16:47:44.932712+0000, chain.objs.size()=1 2024-09-19T15:31:39.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.120+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.jVTHS08OFpFCGhxSp7P3NaEFnFi326s_0 2024-09-19T15:31:39.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.120+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17904363791475318677', time=2024-09-19T16:47:45.850448+0000, chain.objs.size()=1 2024-09-19T15:31:39.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.120+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.8OIrotZZvshKR5j7gFFx7cboGzXk9cC_0 2024-09-19T15:31:39.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.120+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16996251945614933251', time=2024-09-19T16:47:46.680417+0000, chain.objs.size()=1 2024-09-19T15:31:39.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.120+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.y4AswOSIUPUGFdwgFym_w0IdUhDQBYV_0 2024-09-19T15:31:39.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.120+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17668259235733766088', time=2024-09-19T16:47:49.774701+0000, chain.objs.size()=1 2024-09-19T15:31:39.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.120+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.qkKJus_szWLmiSp_o9oMhLV1UYXL8E4_0 2024-09-19T15:31:39.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.120+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12364969837375128640', time=2024-09-19T16:49:35.756750+0000, chain.objs.size()=1 2024-09-19T15:31:39.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.120+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.pV-D5X7vaD9rKdzDgOFRmZuOAXRcnP9_0 2024-09-19T15:31:39.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.124+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17504251473597457902', time=2024-09-19T16:49:36.163924+0000, chain.objs.size()=1 2024-09-19T15:31:39.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.124+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.3TWe4ZOqrLFK3jrWBNrfcCqBPoXNXCk_0 2024-09-19T15:31:39.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.124+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13329650169501697346', time=2024-09-19T16:49:36.640195+0000, chain.objs.size()=1 2024-09-19T15:31:39.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.124+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.WdkhnKbIffwPIGqSaikC6m6mrweLpZ4_0 2024-09-19T15:31:39.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.124+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1695854682844903721', time=2024-09-19T16:49:37.051761+0000, chain.objs.size()=1 2024-09-19T15:31:39.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.124+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.-UIGHkKBYlUG5YQOquBvCw_Ou5dY65g_0 2024-09-19T15:31:39.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.124+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5904262858204051299', time=2024-09-19T16:49:37.600479+0000, chain.objs.size()=1 2024-09-19T15:31:39.129 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.124+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.FhenPpO_l8tYczMvzkJxkjFWTgijCV-_0 2024-09-19T15:31:39.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.124+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4769367598566430327', time=2024-09-19T16:49:39.840192+0000, chain.objs.size()=1 2024-09-19T15:31:39.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.124+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.NxtvTbSrNKk7DeyPeByiRn6Bu7r0IR5_0 2024-09-19T15:31:39.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.124+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5016071452034468276', time=2024-09-19T16:49:42.165978+0000, chain.objs.size()=1 2024-09-19T15:31:39.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.128+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.cdQ455iEyL04hpIT-lGNMZW-U7v_NLl_0 2024-09-19T15:31:39.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1319203281279885471', time=2024-09-19T16:49:42.555913+0000, chain.objs.size()=1 2024-09-19T15:31:39.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.128+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.oJdX76UqwMA7uOS8Z635rnychuIUs0R_0 2024-09-19T15:31:39.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15398993941381850231', time=2024-09-19T16:49:45.039053+0000, chain.objs.size()=1 2024-09-19T15:31:39.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.128+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.pxpOdrjjBddJt9OpvndODP4JGS1q9aA_0 2024-09-19T15:31:39.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6984570509615958816', time=2024-09-19T16:49:45.041635+0000, chain.objs.size()=1 2024-09-19T15:31:39.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.128+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.pl7JEuoDhDcNsNNVP84gpIas3AnB5O7_0 2024-09-19T15:31:39.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5758188548079270100', time=2024-09-19T16:49:46.342815+0000, chain.objs.size()=1 2024-09-19T15:31:39.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.128+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.G3oTaVQdV966NBS8EmD-KRmIVoQbkAb_0 2024-09-19T15:31:39.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18088397888697283955', time=2024-09-19T16:49:46.422756+0000, chain.objs.size()=1 2024-09-19T15:31:39.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.128+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.mSgtRtyQmFAOovnPTV5r0gScQ94BBkj_0 2024-09-19T15:31:39.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17563620158719491344', time=2024-09-19T16:49:48.893188+0000, chain.objs.size()=1 2024-09-19T15:31:39.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.128+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.8vfNr2TdAZu8PjHCq_898ssc7Igt0RZ_0 2024-09-19T15:31:39.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8064371664456007665', time=2024-09-19T16:49:49.843042+0000, chain.objs.size()=1 2024-09-19T15:31:39.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.128+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.hTFz0gBE_2Cby2hdVZUYeTHrq4W45kV_0 2024-09-19T15:31:39.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.897290376327017692', time=2024-09-19T16:49:50.089956+0000, chain.objs.size()=1 2024-09-19T15:31:39.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.128+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.WoommGNj4PnrN_JkngchYg-JWnBSmaF_0 2024-09-19T15:31:39.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8549788865806055669', time=2024-09-19T16:49:50.250276+0000, chain.objs.size()=1 2024-09-19T15:31:39.135 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.128+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.1na_PSYQuQmOwftvM16l0FFXXlkjx5n_0 2024-09-19T15:31:39.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.132+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14478933278445223873', time=2024-09-19T16:49:56.052210+0000, chain.objs.size()=1 2024-09-19T15:31:39.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.132+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.xSctRL-4TFcZo-6l0ibfbsnPg2N3fj6_0 2024-09-19T15:31:39.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.132+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9420070476829101954', time=2024-09-19T16:49:57.582685+0000, chain.objs.size()=1 2024-09-19T15:31:39.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.132+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Ed_hpGCxeWfA5ntdFcNr4_Cek8ggKWR_0 2024-09-19T15:31:39.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.132+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7936244400020620943', time=2024-09-19T16:49:57.781002+0000, chain.objs.size()=1 2024-09-19T15:31:39.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.132+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.E2tiI_uDKYuN84pPlYMXaCaZMcQ7v1R_0 2024-09-19T15:31:39.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.132+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3788736453419159112', time=2024-09-19T16:49:57.783580+0000, chain.objs.size()=1 2024-09-19T15:31:39.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.132+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ff2pA-2-mg4MRO1wVFJ39-3HnefzA1m_0 2024-09-19T15:31:39.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.132+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7379435944864207574', time=2024-09-19T16:49:58.604558+0000, chain.objs.size()=1 2024-09-19T15:31:39.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.132+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.24d0HDhWEjn2t93OUJQNSjbkKwdhNUH_0 2024-09-19T15:31:39.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.136+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4647105181491061320', time=2024-09-19T16:50:00.077606+0000, chain.objs.size()=1 2024-09-19T15:31:39.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.136+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.7iArfIz9qU7IHSD8XZb4iZ5BNWYWMyj_0 2024-09-19T15:31:39.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.136+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17557821641205982246', time=2024-09-19T16:50:00.079442+0000, chain.objs.size()=1 2024-09-19T15:31:39.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.136+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.hkTIjBZHxcNqAyLuj8pajp-Hkz_H4Hv_0 2024-09-19T15:31:39.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.136+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.388817562867140018', time=2024-09-19T16:50:00.866235+0000, chain.objs.size()=1 2024-09-19T15:31:39.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.136+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.5TiE4cZ7jZYs6ivF5vfEnYNAfSmje2C_0 2024-09-19T15:31:39.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.136+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7235180821028288471', time=2024-09-19T16:50:01.824177+0000, chain.objs.size()=1 2024-09-19T15:31:39.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.136+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.jFhT1iuLXyX1cwy5bCzFoYJhQPB6GYy_0 2024-09-19T15:31:39.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.136+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3949363180104576967', time=2024-09-19T16:50:02.306784+0000, chain.objs.size()=1 2024-09-19T15:31:39.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.136+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.sNAbwgdgDD0RD4VT98LMq0pKcTfVKS2_0 2024-09-19T15:31:39.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.136+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11915485831239635073', time=2024-09-19T16:50:02.779567+0000, chain.objs.size()=1 2024-09-19T15:31:39.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.136+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.butwdZk9ezfdt3JOuvxQHZKat1HOETF_0 2024-09-19T15:31:39.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.136+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7981580320741685087', time=2024-09-19T16:50:03.919394+0000, chain.objs.size()=1 2024-09-19T15:31:39.143 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.136+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.rV6uOYGsPMltgAhmLeSNWrWPdsywsb2_0 2024-09-19T15:31:39.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.136+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13975072097653423127', time=2024-09-19T16:50:04.007937+0000, chain.objs.size()=1 2024-09-19T15:31:39.144 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.136+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.kpqw64F_gDA_1U6g-K_wPg8QPwfxdj7_0 2024-09-19T15:31:39.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.144+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51187 2024-09-19T15:31:39.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-19T15:31:39.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10623874894216856466', time=2024-09-19T16:50:04.509629+0000, chain.objs.size()=1 2024-09-19T15:31:39.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.g5zC1T4Py1cnTG92BHS_OFXIKL9IAqo_0 2024-09-19T15:31:39.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11940899579237031243', time=2024-09-19T16:50:04.915724+0000, chain.objs.size()=1 2024-09-19T15:31:39.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.90PS96nR1m58MIruB_R9yTuV3vwtvG2_0 2024-09-19T15:31:39.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4622735732899003126', time=2024-09-19T16:50:05.490330+0000, chain.objs.size()=1 2024-09-19T15:31:39.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.7Q8ghhgN7375cNfBCAfiY96hGOCdJve_0 2024-09-19T15:31:39.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9090323996323718184', time=2024-09-19T16:50:06.480401+0000, chain.objs.size()=1 2024-09-19T15:31:39.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.EZRwM8-n4BHJ6axTjvAD1-81UaT0aO5_0 2024-09-19T15:31:39.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15264433862961620454', time=2024-09-19T16:50:43.711631+0000, chain.objs.size()=1 2024-09-19T15:31:39.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.342__shadow_.jz7Hz01WZdXNlxa6Mz7e_K9wyAiL3VB_0 2024-09-19T15:31:39.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2426130469981125893', time=2024-09-19T16:51:32.940648+0000, chain.objs.size()=1 2024-09-19T15:31:39.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.369__shadow_.JlB-VQFuCpj4uKALMi560hjhN19xQPD_0 2024-09-19T15:31:39.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16961502373192639683', time=2024-09-19T16:51:54.358612+0000, chain.objs.size()=1 2024-09-19T15:31:39.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.379__shadow_.voGX7vUlXKUTc22ves8AINb4mdrMsPd_0 2024-09-19T15:31:39.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3405401469946383285', time=2024-09-19T16:52:51.263543+0000, chain.objs.size()=1 2024-09-19T15:31:39.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.407__shadow_.Gi4SPEK1JMZdnbn2iJAzrU7xwa_53pE_0 2024-09-19T15:31:39.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9263360915525234463', time=2024-09-19T16:53:41.648856+0000, chain.objs.size()=1 2024-09-19T15:31:39.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.432__shadow_.P8PFcJ1ETfl6FGcONDgfbAupuFuMt82_0 2024-09-19T15:31:39.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14266697857377674997', time=2024-09-19T16:54:33.771899+0000, chain.objs.size()=1 2024-09-19T15:31:39.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.455__shadow_.JLynrX1cBydXLwE2ZW4JxRDcpzc5HIc_0 2024-09-19T15:31:39.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17708467962615482523', time=2024-09-19T16:54:45.629851+0000, chain.objs.size()=1 2024-09-19T15:31:39.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.459__shadow_.Ak_PgXFX4tfQk70DQWzWX_0cER1xGFn_0 2024-09-19T15:31:39.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8936598983904588187', time=2024-09-19T16:55:35.713842+0000, chain.objs.size()=1 2024-09-19T15:31:39.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.148+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.484__shadow_.6hY4cSnCxxr3O_CHCIQqHbNORO5sI_H_0 2024-09-19T15:31:39.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.152+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18242428838325949238', time=2024-09-19T16:55:46.266382+0000, chain.objs.size()=1 2024-09-19T15:31:39.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.152+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.486__shadow_.uUqkkQ40Q1Y5jJnIDLiF8b_oVjXZjQT_0 2024-09-19T15:31:39.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.152+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14309632187539489380', time=2024-09-19T16:59:14.908817+0000, chain.objs.size()=3 2024-09-19T15:31:39.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.152+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.521__multipart_mymultipart.2~JAwVnrtcEL-EEQR2qCUQCV4xk37BExm.1 2024-09-19T15:31:39.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.152+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.521__multipart_mymultipart.2~JAwVnrtcEL-EEQR2qCUQCV4xk37BExm.2 2024-09-19T15:31:39.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.156+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.521__multipart_mymultipart.2~JAwVnrtcEL-EEQR2qCUQCV4xk37BExm.3 2024-09-19T15:31:39.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.156+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11633586895642776023', time=2024-09-19T17:01:30.062192+0000, chain.objs.size()=6 2024-09-19T15:31:39.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.156+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~DvLZlPzeitX03VWP4SfemqOWR5pbGd-.1 2024-09-19T15:31:39.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.156+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~DvLZlPzeitX03VWP4SfemqOWR5pbGd-.2 2024-09-19T15:31:39.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.156+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.aoPAFyFoe5WnW5Jl24pDkkPr8CkJSrbk.3 2024-09-19T15:31:39.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.156+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~DvLZlPzeitX03VWP4SfemqOWR5pbGd-.4 2024-09-19T15:31:39.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.156+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~DvLZlPzeitX03VWP4SfemqOWR5pbGd-.5 2024-09-19T15:31:39.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.160+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~DvLZlPzeitX03VWP4SfemqOWR5pbGd-.6 2024-09-19T15:31:39.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.160+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13038250932420245628', time=2024-09-19T17:03:17.965985+0000, chain.objs.size()=2 2024-09-19T15:31:39.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.160+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.525__multipart_mymultipart.2~gSk9yM0L8MOBtWX7uFqIU5k37-ZhbKX.1 2024-09-19T15:31:39.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.160+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.525__multipart_mymultipart.2~gSk9yM0L8MOBtWX7uFqIU5k37-ZhbKX.2 2024-09-19T15:31:39.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.160+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3309016364611229546', time=2024-09-19T17:06:37.164905+0000, chain.objs.size()=2 2024-09-19T15:31:39.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.160+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.555__shadow_.eNqJpdcYUXvHrn8EYh1J4vFgDYxUKJG_0 2024-09-19T15:31:39.165 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.160+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.555__shadow_.eNqJpdcYUXvHrn8EYh1J4vFgDYxUKJG_1 2024-09-19T15:31:39.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.160+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5782922816195801193', time=2024-09-19T17:09:23.803820+0000, chain.objs.size()=1 2024-09-19T15:31:39.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.160+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:gbaF7QAl-xqluxZZAGkkiJfWxHLGwBy_.RZ4zQpWZAOr3jo8ovH0cInhjo0BEysA_0 2024-09-19T15:31:39.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.164+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.731361322845292266', time=2024-09-19T17:10:36.524717+0000, chain.objs.size()=1 2024-09-19T15:31:39.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.164+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.580__shadow:VGr3t5gpx74PQq3rgN4SSfKjuVTp2ny_.kzn6JVRO5EL0TOJ-c8jE-8QAM9bzvvM_0 2024-09-19T15:31:39.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.164+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7586064980988793162', time=2024-09-19T17:15:23.615661+0000, chain.objs.size()=1 2024-09-19T15:31:39.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.164+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.617__shadow_.hqZq55tgM38lT6esrUMk1QrfCG5eAeZ_0 2024-09-19T15:31:39.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.164+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.156269046683427248', time=2024-09-19T17:22:31.592049+0000, chain.objs.size()=1 2024-09-19T15:31:39.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.164+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.715__shadow:Bzp0LlHRja7D5.HVVaumT499rh1pPvu_.SNbljmTFeXguD0YPBNZXV_0xzbIYS92_0 2024-09-19T15:31:39.175 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.168+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:39.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T15:31:39.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:39.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:39.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43684' 2024-09-19T15:31:39.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5155601376935871258', time=2024-09-19T16:34:58.388580+0000, chain.objs.size()=1 2024-09-19T15:31:39.186 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.183__shadow_.8TZ8dgDR3poZ0NJ2FXBjGlDE96PYAO7_0 2024-09-19T15:31:39.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3378512895947782187', time=2024-09-19T16:39:36.273764+0000, chain.objs.size()=1 2024-09-19T15:31:39.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.235__shadow_.H-0h1IMG7zhFDpB9CFu05xp5mnkNzdN_0 2024-09-19T15:31:39.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12546097140261241389', time=2024-09-19T16:40:05.054435+0000, chain.objs.size()=1 2024-09-19T15:31:39.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.245__shadow_.yJDBy65OxpervrhbhguZqGWTm48GAr6_0 2024-09-19T15:31:39.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14340164236576874192', time=2024-09-19T16:40:07.376346+0000, chain.objs.size()=1 2024-09-19T15:31:39.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.246__shadow_.KH2KS7nmnP6Qf4Ru27y2uBOTxmfgE9k_0 2024-09-19T15:31:39.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1152002651977362914', time=2024-09-19T16:40:09.693083+0000, chain.objs.size()=1 2024-09-19T15:31:39.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.247__shadow_.73RpI3S3Rzfo2biQBuqMLbXcITnt2ZH_0 2024-09-19T15:31:39.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14030845476171833645', time=2024-09-19T16:40:16.688724+0000, chain.objs.size()=1 2024-09-19T15:31:39.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.250__shadow_.wHGkylw1xMvQd4_t-5S4QQNm33yhPUW_0 2024-09-19T15:31:39.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.633396458194298660', time=2024-09-19T16:42:28.732269+0000, chain.objs.size()=1 2024-09-19T15:31:39.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.sjw9s6dmZdCeNdVeVadZVtnjDnyEKjS_0 2024-09-19T15:31:39.187 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5442063884140652290', time=2024-09-19T16:42:31.410422+0000, chain.objs.size()=1 2024-09-19T15:31:39.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.w3HyvYLW6o_OYpLq9ZwTqa6y63700MO_0 2024-09-19T15:31:39.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9671348048844719116', time=2024-09-19T16:42:33.480195+0000, chain.objs.size()=1 2024-09-19T15:31:39.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.bxAY3dhxglq_adDaZtlICCQ_wbZ-bQ__0 2024-09-19T15:31:39.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9016487196918847860', time=2024-09-19T16:42:34.531832+0000, chain.objs.size()=1 2024-09-19T15:31:39.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ylGlgbg86-14KZlbuhtK-mbds7Y_p6T_0 2024-09-19T15:31:39.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5181174018491801704', time=2024-09-19T16:42:34.837890+0000, chain.objs.size()=1 2024-09-19T15:31:39.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.zM19BnySfq7_tFmmn6wJIeAI-BF0WLA_0 2024-09-19T15:31:39.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15096305532790838750', time=2024-09-19T16:42:35.676996+0000, chain.objs.size()=1 2024-09-19T15:31:39.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.180+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Qm2zLpxRSqwCv4v9Dn0nHRX46qTwnHA_0 2024-09-19T15:31:39.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.184+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10072795106974217917', time=2024-09-19T16:42:38.108082+0000, chain.objs.size()=1 2024-09-19T15:31:39.189 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.184+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.e3yKoyvJArJHLXZOCGV0jJmINA2d81S_0 2024-09-19T15:31:39.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.184+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16658006564561262468', time=2024-09-19T16:42:38.220455+0000, chain.objs.size()=1 2024-09-19T15:31:39.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.184+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.M8SeUT0WfohSHW9oH2hkDThs-opCrlD_0 2024-09-19T15:31:39.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.184+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4643732998037004643', time=2024-09-19T16:42:39.897222+0000, chain.objs.size()=1 2024-09-19T15:31:39.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.184+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.RCsLDt9bMkFJIkRXeoejYcuW3NTcyq7_0 2024-09-19T15:31:39.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.184+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10917946049214581585', time=2024-09-19T16:42:39.966212+0000, chain.objs.size()=1 2024-09-19T15:31:39.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.184+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.HAeBtaongheFbLrYa3ZtJBAyawBWHEi_0 2024-09-19T15:31:39.190 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.184+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9302979285942385774', time=2024-09-19T16:42:41.094885+0000, chain.objs.size()=1 2024-09-19T15:31:39.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.184+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ARRrZvc2vsyvFcJM6tOTpAteItabmsX_0 2024-09-19T15:31:39.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.184+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3465121344407531241', time=2024-09-19T16:42:41.202136+0000, chain.objs.size()=1 2024-09-19T15:31:39.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.184+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Wr4rpkMrs3YaUT9B03EJpFPpVKnu3hd_0 2024-09-19T15:31:39.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.184+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14175678531034713620', time=2024-09-19T16:42:41.577751+0000, chain.objs.size()=1 2024-09-19T15:31:39.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.184+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.p7PM-MkLY1B-dINmlyYCsMGnc7iWP8K_0 2024-09-19T15:31:39.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.188+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18034714120462279558', time=2024-09-19T16:42:41.849933+0000, chain.objs.size()=1 2024-09-19T15:31:39.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.188+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.X5rGZHJeSNgOPd0iP3uorwlSbbmta4p_0 2024-09-19T15:31:39.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.188+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17778125743318566381', time=2024-09-19T16:42:42.113947+0000, chain.objs.size()=1 2024-09-19T15:31:39.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.188+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.aO-PeYs10JOMhUKN9FL10OyLe2UR8GU_0 2024-09-19T15:31:39.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.188+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16892290379223608183', time=2024-09-19T16:42:42.115408+0000, chain.objs.size()=1 2024-09-19T15:31:39.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.188+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.yb6BwpUK84BH7_QrnumWysK8YCg6Vio_0 2024-09-19T15:31:39.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.188+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5205921332673584772', time=2024-09-19T16:42:44.057879+0000, chain.objs.size()=1 2024-09-19T15:31:39.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.188+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.NmIXGsMa27wZ99RUBT2aNdvgec4Tipx_0 2024-09-19T15:31:39.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.188+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16679035984223546754', time=2024-09-19T16:42:50.868761+0000, chain.objs.size()=1 2024-09-19T15:31:39.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.188+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.VYoRczVn95zqwSDVMTcp9Yb7dNkfD6i_0 2024-09-19T15:31:39.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.188+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10048255621443791636', time=2024-09-19T16:42:51.541182+0000, chain.objs.size()=1 2024-09-19T15:31:39.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.188+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.v1OqeminjVWn2asTdo0ajukvVOgIOv6_0 2024-09-19T15:31:39.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.188+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12143984861653868625', time=2024-09-19T16:42:52.559184+0000, chain.objs.size()=1 2024-09-19T15:31:39.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.188+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.gj5vDNLWbWI1Wwv09ocM0dlLd_v_Ns3_0 2024-09-19T15:31:39.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.188+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15454349963924705658', time=2024-09-19T16:42:53.372448+0000, chain.objs.size()=1 2024-09-19T15:31:39.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.188+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.chZ-MNXkKv6fmo5nMiPOp6VC8uD-yGk_0 2024-09-19T15:31:39.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.188+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3848417391549593725', time=2024-09-19T16:42:54.151984+0000, chain.objs.size()=1 2024-09-19T15:31:39.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.188+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.QZAfWqALbEuKR1JhPzIehU0H0WPo1zG_0 2024-09-19T15:31:39.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.192+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1663568009972275805', time=2024-09-19T16:42:54.367251+0000, chain.objs.size()=1 2024-09-19T15:31:39.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.192+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.vXG2f6jOKZC0OdRK989Lk6OQ134PKVs_0 2024-09-19T15:31:39.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.192+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9489840904668464733', time=2024-09-19T16:42:54.710128+0000, chain.objs.size()=1 2024-09-19T15:31:39.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.192+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.LxwfupFEO2olc8FRhHEZfzuthty-e4m_0 2024-09-19T15:31:39.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.192+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3737989761423894997', time=2024-09-19T16:42:55.017834+0000, chain.objs.size()=1 2024-09-19T15:31:39.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.192+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.6g_SCXbMIQuHvlhhrjNsTRVlzLNH2yG_0 2024-09-19T15:31:39.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.192+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4221526746669723904', time=2024-09-19T16:42:55.787748+0000, chain.objs.size()=1 2024-09-19T15:31:39.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.192+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.NyNPt9YQIkthf4hSo2jTjI5qpmhxzIl_0 2024-09-19T15:31:39.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.192+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10709710356330982305', time=2024-09-19T16:43:11.256754+0000, chain.objs.size()=1 2024-09-19T15:31:39.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.192+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.267__shadow_.XcpCiSrqF8Opw0btV8SYxJBQxI0rIH3_0 2024-09-19T15:31:39.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.192+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14367980655326264788', time=2024-09-19T16:43:33.495666+0000, chain.objs.size()=1 2024-09-19T15:31:39.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.192+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.277__shadow_.1PueyG99SxaMio-9AfyHqqlihRjz8ER_0 2024-09-19T15:31:39.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.196+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1206843328098976054', time=2024-09-19T16:44:01.792836+0000, chain.objs.size()=1 2024-09-19T15:31:39.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.196+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.289__shadow_.4BxLUweVv9m0ThjRVorUFauD6cLCCL0_0 2024-09-19T15:31:39.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.196+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10829518500366005361', time=2024-09-19T16:44:12.390413+0000, chain.objs.size()=1 2024-09-19T15:31:39.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.196+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_.TJJWodd2459zLcXID8r9WAoq_iBOToU_0 2024-09-19T15:31:39.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.196+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12994503949431940667', time=2024-09-19T16:44:42.490547+0000, chain.objs.size()=1 2024-09-19T15:31:39.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.196+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.303__shadow_.GpwZO0GhYCgREVas_0b1h9VfoNpv-87_0 2024-09-19T15:31:39.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.196+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14780950840107191337', time=2024-09-19T16:45:26.239877+0000, chain.objs.size()=1 2024-09-19T15:31:39.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.196+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.319__shadow:Ko64m.HSXbJ-s..gw6KbY9mihklbuMw_.kHBQmQMc2sa0QUbMzA81qUQwJSEw7Vw_0 2024-09-19T15:31:39.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.196+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10642978081135197965', time=2024-09-19T16:47:18.620169+0000, chain.objs.size()=1 2024-09-19T15:31:39.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.196+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.0jAlVyHItpBWb_cEqC-j8IkXOVxKMRp_0 2024-09-19T15:31:39.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.196+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.736722381631488934', time=2024-09-19T16:47:19.989851+0000, chain.objs.size()=1 2024-09-19T15:31:39.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.196+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Cps0eCYFikjl7ICEMwhV7XSeFUZyKiq_0 2024-09-19T15:31:39.203 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.196+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11246377920137573750', time=2024-09-19T16:47:20.429423+0000, chain.objs.size()=1 2024-09-19T15:31:39.203 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.196+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.tfUjdqHxd76P6a1enGVjcjzfBwd848m_0 2024-09-19T15:31:39.203 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.196+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8367635811476000699', time=2024-09-19T16:47:21.072804+0000, chain.objs.size()=1 2024-09-19T15:31:39.203 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.196+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.fvC_qNiEF-_Y2Bl-To4pWT7tlxhuo9I_0 2024-09-19T15:31:39.203 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.196+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3681466976114852010', time=2024-09-19T16:47:23.227848+0000, chain.objs.size()=1 2024-09-19T15:31:39.203 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.196+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.x4gyYDGd4yaYecwrKRSzyLvx0jrf4qa_0 2024-09-19T15:31:39.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.200+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7945621099969140743', time=2024-09-19T16:47:23.437012+0000, chain.objs.size()=1 2024-09-19T15:31:39.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.200+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.3dZQblXfFweP7L7-uy3gbRINA_KXvmW_0 2024-09-19T15:31:39.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.200+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8789112947784429365', time=2024-09-19T16:47:23.564997+0000, chain.objs.size()=1 2024-09-19T15:31:39.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.200+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.sxpdfQG0N1jM0nlZnniC7O2xwjjS8Dj_0 2024-09-19T15:31:39.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.200+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13750333875260207043', time=2024-09-19T16:47:24.623983+0000, chain.objs.size()=1 2024-09-19T15:31:39.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.200+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.zqWCfpoVlWIx_JJ5xm7eOXJNRPZbga-_0 2024-09-19T15:31:39.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.200+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9273367397899152820', time=2024-09-19T16:47:25.315272+0000, chain.objs.size()=1 2024-09-19T15:31:39.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.200+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.WVLHr8iWOXdkgKy5nE4Dx7jWJrJ9jOB_0 2024-09-19T15:31:39.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.200+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.901805156724647514', time=2024-09-19T16:47:27.845236+0000, chain.objs.size()=1 2024-09-19T15:31:39.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.200+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.1SYH0dj9y5DmRqPCPGNov2jfUh9rb8n_0 2024-09-19T15:31:39.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.200+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11933727181128627741', time=2024-09-19T16:47:27.958750+0000, chain.objs.size()=1 2024-09-19T15:31:39.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.200+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.1wuou6SYpMw3GbRxt0-P1Rr2UVIWiwf_0 2024-09-19T15:31:39.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.200+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6521240217281349012', time=2024-09-19T16:47:28.557675+0000, chain.objs.size()=1 2024-09-19T15:31:39.206 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.200+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.BThZwvmH0jywJnYJZHh9-76ycEJNVRh_0 2024-09-19T15:31:39.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.200+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7130635480261286724', time=2024-09-19T16:47:29.054830+0000, chain.objs.size()=1 2024-09-19T15:31:39.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.200+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.4EPkpQlPYaxGSsEJ-eRKN12UCVI7_GN_0 2024-09-19T15:31:39.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.200+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5836548936928628452', time=2024-09-19T16:47:29.131062+0000, chain.objs.size()=1 2024-09-19T15:31:39.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.200+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.a8MhuifUTL_GFirPMn40MDhsM1o-aDa_0 2024-09-19T15:31:39.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.204+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8972940592902828229', time=2024-09-19T16:47:31.582521+0000, chain.objs.size()=1 2024-09-19T15:31:39.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.204+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.QwiktBDZdNgW7QEnnbYb7WyWIeK1xD5_0 2024-09-19T15:31:39.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.204+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9282342289775380443', time=2024-09-19T16:47:32.468448+0000, chain.objs.size()=1 2024-09-19T15:31:39.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.204+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.eU7Y6mq9mNBUUMLbfb0ZIhnKeFyXxFz_0 2024-09-19T15:31:39.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.204+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6782490506521245206', time=2024-09-19T16:47:33.021104+0000, chain.objs.size()=1 2024-09-19T15:31:39.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.204+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.bw6ZXsvE16YDOs76W1n2faNtowUPhV6_0 2024-09-19T15:31:39.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.204+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7000437041833866080', time=2024-09-19T16:47:33.550087+0000, chain.objs.size()=1 2024-09-19T15:31:39.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.204+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.4cakpT6fwH5flj7rpz1Z2D3znYAUB4p_0 2024-09-19T15:31:39.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.204+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8772415328596159777', time=2024-09-19T16:47:35.300471+0000, chain.objs.size()=1 2024-09-19T15:31:39.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.204+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.it4GoSn5Jlt5-gTcnEn-Jxyww0fM9ed_0 2024-09-19T15:31:39.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.204+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8696453352005363940', time=2024-09-19T16:47:36.729528+0000, chain.objs.size()=1 2024-09-19T15:31:39.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.204+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.wrojd517CG9t3ORlSq4TZJ-hHdWb3e2_0 2024-09-19T15:31:39.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.204+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16182538603960541300', time=2024-09-19T16:47:36.932716+0000, chain.objs.size()=1 2024-09-19T15:31:39.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.204+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.N9p6r6F3Tcxkue-shSgmEl1VYO4NTU1_0 2024-09-19T15:31:39.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.204+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3364323297441229846', time=2024-09-19T16:47:37.785239+0000, chain.objs.size()=1 2024-09-19T15:31:39.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.204+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.kFNdejD4k1DJUntgpRDUCQIRg1-C29h_0 2024-09-19T15:31:39.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.204+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7823110942946479138', time=2024-09-19T16:47:37.915933+0000, chain.objs.size()=1 2024-09-19T15:31:39.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.204+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.qdrcAbmL9WZp1hREaj9cD6IuDDf-5GQ_0 2024-09-19T15:31:39.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.208+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10570753481188010526', time=2024-09-19T16:47:39.983431+0000, chain.objs.size()=1 2024-09-19T15:31:39.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.208+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.32QzSi9Rpf7GTLY2Euu2zOumP9IHFzr_0 2024-09-19T15:31:39.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.208+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.741543625376298639', time=2024-09-19T16:47:40.076312+0000, chain.objs.size()=1 2024-09-19T15:31:39.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.208+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.-mrY0Oi1x5zxHAkp6EeyCWnw8KM09mc_0 2024-09-19T15:31:39.213 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.208+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11533452988961603926', time=2024-09-19T16:47:41.273096+0000, chain.objs.size()=1 2024-09-19T15:31:39.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.208+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.0fwhHhSsAMCHT8Kr_syPxFQbNc_3Q2x_0 2024-09-19T15:31:39.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.212+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11445226510580458898', time=2024-09-19T16:47:41.834442+0000, chain.objs.size()=1 2024-09-19T15:31:39.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.212+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.NfoHphHeJJAfe0NHut1H7IazaTcWPNn_0 2024-09-19T15:31:39.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.212+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.37796072400132818', time=2024-09-19T16:47:42.179736+0000, chain.objs.size()=1 2024-09-19T15:31:39.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.212+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.i5Feif9ZXDIWi_52cY-_Xx1dWAlOnu4_0 2024-09-19T15:31:39.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.212+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1290392851143264800', time=2024-09-19T16:47:43.754893+0000, chain.objs.size()=1 2024-09-19T15:31:39.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.212+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.7dOc46M9U7nrIqOMTawS1h0cb9mJGW2_0 2024-09-19T15:31:39.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.212+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7935634241454361900', time=2024-09-19T16:47:44.020701+0000, chain.objs.size()=1 2024-09-19T15:31:39.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.212+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.LZR9RFhi4swzV_WOWRT0s8beZGV-9JY_0 2024-09-19T15:31:39.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.212+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6791733112246478780', time=2024-09-19T16:47:44.022858+0000, chain.objs.size()=1 2024-09-19T15:31:39.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.212+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.dxGO4KKnX762nZX4wkWb0v1kAD8mBKw_0 2024-09-19T15:31:39.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.212+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8065017407104756112', time=2024-09-19T16:47:44.602378+0000, chain.objs.size()=1 2024-09-19T15:31:39.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.212+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.j5QG0K8OL67KkIZyJsu5aWkauuvb75y_0 2024-09-19T15:31:39.217 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.212+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5222641318079072355', time=2024-09-19T16:47:45.548419+0000, chain.objs.size()=1 2024-09-19T15:31:39.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.212+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.n-uLXqBi1drG3GDPPopmey7dR6UBg0h_0 2024-09-19T15:31:39.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.212+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17557110620985947152', time=2024-09-19T16:47:45.778521+0000, chain.objs.size()=1 2024-09-19T15:31:39.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.212+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.dlqtqUqNJMmfCihbCniOCFoGUu4nQVn_0 2024-09-19T15:31:39.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.212+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15972321816138926442', time=2024-09-19T16:47:46.404859+0000, chain.objs.size()=1 2024-09-19T15:31:39.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.212+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.X7PyN5uRUliGWGMEh2kf2ienyAVtIRW_0 2024-09-19T15:31:39.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.212+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11565657906491986132', time=2024-09-19T16:47:48.006964+0000, chain.objs.size()=1 2024-09-19T15:31:39.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.212+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ezkz8tuJ0qQ5_AfYnQFr6s3iEN6OFXd_0 2024-09-19T15:31:39.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.212+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14522961173820302117', time=2024-09-19T16:47:48.262542+0000, chain.objs.size()=1 2024-09-19T15:31:39.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.212+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.m_wiI4CB8hOvlYcZQ7UJ74uf0N9rujs_0 2024-09-19T15:31:39.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.216+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5917280443305825301', time=2024-09-19T16:47:48.813755+0000, chain.objs.size()=1 2024-09-19T15:31:39.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.216+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.eAocznMucAqgFXqCyEaSn8KcMeBRDI4_0 2024-09-19T15:31:39.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.216+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6004070553123894531', time=2024-09-19T16:47:49.645777+0000, chain.objs.size()=1 2024-09-19T15:31:39.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.216+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.gysaqW_rvC30TzE8L_l3jzITBRRelWe_0 2024-09-19T15:31:39.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.216+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6659400945286328777', time=2024-09-19T16:47:49.647841+0000, chain.objs.size()=1 2024-09-19T15:31:39.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.216+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.GkEpspVw4wRXNJ09nbKCKu9V63cViWM_0 2024-09-19T15:31:39.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.216+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13403463541824125893', time=2024-09-19T16:49:36.718768+0000, chain.objs.size()=1 2024-09-19T15:31:39.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.216+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.0vJfK8surwC934fw-uZd1Q95IPKhp4n_0 2024-09-19T15:31:39.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.216+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6078750446174159902', time=2024-09-19T16:49:41.872847+0000, chain.objs.size()=1 2024-09-19T15:31:39.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.216+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.N8pnQrh_miThRY8T4cOr_cdEvGDd_vX_0 2024-09-19T15:31:39.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.216+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10989352389211629275', time=2024-09-19T16:49:44.343315+0000, chain.objs.size()=1 2024-09-19T15:31:39.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.216+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.df6c5J-YCEJQ6KQWYB5u0dBfjUT_DJK_0 2024-09-19T15:31:39.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.216+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3180015917901600794', time=2024-09-19T16:49:45.121000+0000, chain.objs.size()=1 2024-09-19T15:31:39.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.216+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.of3tyQAUvFtOHQiSBq2atVXLWSX4STO_0 2024-09-19T15:31:39.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.216+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4781294152505491814', time=2024-09-19T16:49:45.594756+0000, chain.objs.size()=1 2024-09-19T15:31:39.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.216+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.STzKtvtamHaPoLZ_6UgLTIYcwAQdIzY_0 2024-09-19T15:31:39.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.220+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1707514046925069789', time=2024-09-19T16:49:48.593154+0000, chain.objs.size()=1 2024-09-19T15:31:39.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.220+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.BJFR7luFTA0nv9uuL-0aWxsRP2B9h1h_0 2024-09-19T15:31:39.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.220+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12458396352811003943', time=2024-09-19T16:49:49.201151+0000, chain.objs.size()=1 2024-09-19T15:31:39.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.220+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.5Igb8gzeKdTHrZQPFSHBxEienrZIBez_0 2024-09-19T15:31:39.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.220+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3563408974081626647', time=2024-09-19T16:49:49.770699+0000, chain.objs.size()=1 2024-09-19T15:31:39.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.220+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.yBxyYdojhfUPIH2rs7Xo0S1CIqwqtLQ_0 2024-09-19T15:31:39.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.224+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12565775971118561315', time=2024-09-19T16:49:50.969999+0000, chain.objs.size()=1 2024-09-19T15:31:39.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.224+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Awg39JlFV6zq6KZmJa9YYrDg5jh1I2K_0 2024-09-19T15:31:39.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.224+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3649118564751700797', time=2024-09-19T16:49:52.092024+0000, chain.objs.size()=1 2024-09-19T15:31:39.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.224+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.urVNY9rb67il50NMGkHe-azozsguDi8_0 2024-09-19T15:31:39.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.224+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17509877263354514498', time=2024-09-19T16:49:52.499518+0000, chain.objs.size()=1 2024-09-19T15:31:39.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.224+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.SXCyHDVL5LjCP3M-0rd5OKz-NGk3c6R_0 2024-09-19T15:31:39.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.224+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2741868055553075459', time=2024-09-19T16:49:53.790023+0000, chain.objs.size()=1 2024-09-19T15:31:39.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.224+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.IawdlWTxK7NU4OAeU1EIUtYXc-rrLKp_0 2024-09-19T15:31:39.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.224+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5199851671752863088', time=2024-09-19T16:49:55.033749+0000, chain.objs.size()=1 2024-09-19T15:31:39.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.224+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.mpwPX3YQCoAjJj0jINMagANdpsiHeks_0 2024-09-19T15:31:39.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.224+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5397584609940342076', time=2024-09-19T16:49:56.111488+0000, chain.objs.size()=1 2024-09-19T15:31:39.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.224+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.PxJNlZbYuRkSmxupcrXrY2u7OBWEWc6_0 2024-09-19T15:31:39.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.224+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18193248260428646628', time=2024-09-19T16:49:56.508975+0000, chain.objs.size()=1 2024-09-19T15:31:39.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.224+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.HHTxvItKmHffSQxliaFaRrCzoNe8GUA_0 2024-09-19T15:31:39.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.224+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16209236149203829430', time=2024-09-19T16:49:56.713198+0000, chain.objs.size()=1 2024-09-19T15:31:39.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.224+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.DL6aHmHpWBBkCNGrimbG3LIg7ZPJIri_0 2024-09-19T15:31:39.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.224+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14396522970031311603', time=2024-09-19T16:49:57.333799+0000, chain.objs.size()=1 2024-09-19T15:31:39.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.224+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.MqTGh7mtcFk35L3FA6ZqD1Vj0n3R_wl_0 2024-09-19T15:31:39.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.224+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14006031866503566014', time=2024-09-19T16:50:00.143041+0000, chain.objs.size()=1 2024-09-19T15:31:39.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.224+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.PJkoUmbPmhgQ0yqloYOOPFqxdLwJ1Ux_0 2024-09-19T15:31:39.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.224+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16380862291605168311', time=2024-09-19T16:50:00.986944+0000, chain.objs.size()=1 2024-09-19T15:31:39.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.224+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.snEdSTEigLu6-7Gv2mVschHUGE5gZl7_0 2024-09-19T15:31:39.232 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.228+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10610265288337666265', time=2024-09-19T16:50:00.988673+0000, chain.objs.size()=1 2024-09-19T15:31:39.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.228+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.D4louPUKG1vRCuuFhbitJPh7Nc8zBxA_0 2024-09-19T15:31:39.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.228+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5961590530977930010', time=2024-09-19T16:50:01.561114+0000, chain.objs.size()=1 2024-09-19T15:31:39.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.228+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.yL-9eUidwOOxACxihnxPFtyCLFOkDeb_0 2024-09-19T15:31:39.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.228+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4296445637192920904', time=2024-09-19T16:50:01.773889+0000, chain.objs.size()=1 2024-09-19T15:31:39.233 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.228+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.uAmx5FGdUYAz78mqidNLxJ7uk-9PT85_0 2024-09-19T15:31:39.240 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.236+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43684 2024-09-19T15:31:39.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.240+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-19T15:31:39.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.240+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12244227015242891446', time=2024-09-19T16:50:04.167154+0000, chain.objs.size()=1 2024-09-19T15:31:39.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.240+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.6XfQbo7u10bi7xzi9XdrWZFKEo2xtWQ_0 2024-09-19T15:31:39.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.240+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8224865179540808671', time=2024-09-19T16:54:39.683116+0000, chain.objs.size()=1 2024-09-19T15:31:39.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.240+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.457__shadow_.p3MwwlUUaDhuK10UMA7eaOPcbkiqE5h_0 2024-09-19T15:31:39.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.240+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3851815085161514783', time=2024-09-19T16:56:13.678213+0000, chain.objs.size()=1 2024-09-19T15:31:39.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.240+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.500__shadow_.V-hEci4_fEq1vPzohBOqX5jYmg4U7hR_0 2024-09-19T15:31:39.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.240+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6115623860037114023', time=2024-09-19T16:57:07.161385+0000, chain.objs.size()=6 2024-09-19T15:31:39.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.240+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.1 2024-09-19T15:31:39.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.240+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.2 2024-09-19T15:31:39.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.240+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.3 2024-09-19T15:31:39.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.240+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.4 2024-09-19T15:31:39.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.240+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.5 2024-09-19T15:31:39.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.240+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.6 2024-09-19T15:31:39.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.240+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~evpZT-0Nk6UPwroP-vgJ5en2YMbzL3o', time=2024-09-19T17:01:29.936797+0000, chain.objs.size()=1 2024-09-19T15:31:39.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.240+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~evpZT-0Nk6UPwroP-vgJ5en2YMbzL3o.2 2024-09-19T15:31:39.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.240+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~evpZT-0Nk6UPwroP-vgJ5en2YMbzL3o', time=2024-09-19T17:01:29.946802+0000, chain.objs.size()=1 2024-09-19T15:31:39.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.240+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~evpZT-0Nk6UPwroP-vgJ5en2YMbzL3o.3 2024-09-19T15:31:39.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.240+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1667087346599873401', time=2024-09-19T17:02:44.074074+0000, chain.objs.size()=1 2024-09-19T15:31:39.246 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.240+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.523__multipart_mymultipart.2~dq4Q4JBCZ70fitzSn_UCBwuHq7AuKHY.1 2024-09-19T15:31:39.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.240+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9782787755131458555', time=2024-09-19T17:02:57.769922+0000, chain.objs.size()=3 2024-09-19T15:31:39.247 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.240+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.523__multipart_mymultipart.2~GP_kWThf8NpxAYe5TijZJGi0J0BKV34.1 2024-09-19T15:31:39.249 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.244+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.523__multipart_mymultipart.2~GP_kWThf8NpxAYe5TijZJGi0J0BKV34.2 2024-09-19T15:31:39.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.244+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.523__multipart_mymultipart.2~GP_kWThf8NpxAYe5TijZJGi0J0BKV34.3 2024-09-19T15:31:39.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.244+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.332777892145023435', time=2024-09-19T17:06:07.822069+0000, chain.objs.size()=2 2024-09-19T15:31:39.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.244+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.552__shadow_.CSKRwYm5L4yHFH6DuLu_7lk1d8uuYAM_0 2024-09-19T15:31:39.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.244+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.552__shadow_.CSKRwYm5L4yHFH6DuLu_7lk1d8uuYAM_1 2024-09-19T15:31:39.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.244+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9205008839937698014', time=2024-09-19T17:07:42.142000+0000, chain.objs.size()=1 2024-09-19T15:31:39.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.244+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:MfqS1h5WJ5oRy-Vf-4QXO7kYUx2Gn4C_.jDwgoKVfjR7hJRDLHRan5OsUwtfaMb7_0 2024-09-19T15:31:39.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.244+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18005554818139549966', time=2024-09-19T17:07:48.631904+0000, chain.objs.size()=1 2024-09-19T15:31:39.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.244+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:wmXIbetgSGpgDJHb6KgurNcOGna2oq6_.vtVGeVNpj7Tru2s5N84V3tWqV6hL12n_0 2024-09-19T15:31:39.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.244+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14742834725714531123', time=2024-09-19T17:08:31.040992+0000, chain.objs.size()=1 2024-09-19T15:31:39.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.244+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.575__shadow:j2oBKdPk2jKeTEBPawd-dRY0HGeHc2I_.tkUuveuFcMNiqO6Y298jy3HeAi-siP3_0 2024-09-19T15:31:39.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.244+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17510473136747743379', time=2024-09-19T17:08:57.729558+0000, chain.objs.size()=1 2024-09-19T15:31:39.251 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.244+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:hr4med4fxASoMUnqhEJifGxJeAKzboJ_.Qln4745smQaw3LetMUareWR0PxU1Gv4_0 2024-09-19T15:31:39.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.244+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5827164875348555768', time=2024-09-19T17:09:16.475201+0000, chain.objs.size()=1 2024-09-19T15:31:39.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.244+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:hzFq0k1OTWnIt.H.-5QNwH7tEYx7b.._.CIeUJUQoVbzGFZaOy4M29EUgRhnFK7K_0 2024-09-19T15:31:39.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.244+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.465302563193280811', time=2024-09-19T17:09:26.361796+0000, chain.objs.size()=1 2024-09-19T15:31:39.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.244+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:hDL8KNNe1SJdkTI.8p5yFa9CFanU.lK_.Cgq1mL-S1i5PAbvDWHYe4d26rWUkhHt_0 2024-09-19T15:31:39.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.244+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11713054494923276598', time=2024-09-19T17:11:13.613663+0000, chain.objs.size()=1 2024-09-19T15:31:39.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.244+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.596__shadow_.21ByqpC-gHYOVudRaNgY9H3quDabIPb_0 2024-09-19T15:31:39.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.248+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1577814889468019345', time=2024-09-19T17:11:33.678920+0000, chain.objs.size()=1 2024-09-19T15:31:39.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.248+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.606__shadow_.ZXL1v4EICXP1ePv85ilg8kddjIZqDSu_0 2024-09-19T15:31:39.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.248+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7855900014960118204', time=2024-09-19T17:11:37.851839+0000, chain.objs.size()=1 2024-09-19T15:31:39.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.248+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.608__shadow_.6fPbD3g7QT4zZTqDjdW0Ea2h0VG7HHX_0 2024-09-19T15:31:39.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.248+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1504074860728562107', time=2024-09-19T17:20:34.308664+0000, chain.objs.size()=6 2024-09-19T15:31:39.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.248+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.662__multipart_foo.2~laa0sIP-Xsn3IcIra08-fu2v4P0cabz.1 2024-09-19T15:31:39.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.248+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.662__multipart_foo.2~laa0sIP-Xsn3IcIra08-fu2v4P0cabz.2 2024-09-19T15:31:39.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.252+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.662__multipart_foo.2~laa0sIP-Xsn3IcIra08-fu2v4P0cabz.3 2024-09-19T15:31:39.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.252+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.662__multipart_foo.2~laa0sIP-Xsn3IcIra08-fu2v4P0cabz.4 2024-09-19T15:31:39.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.252+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.662__multipart_foo.2~laa0sIP-Xsn3IcIra08-fu2v4P0cabz.5 2024-09-19T15:31:39.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.252+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.662__multipart_foo.2~laa0sIP-Xsn3IcIra08-fu2v4P0cabz.6 2024-09-19T15:31:39.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.252+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9157625389204587478', time=2024-09-19T17:21:47.772673+0000, chain.objs.size()=1 2024-09-19T15:31:39.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.252+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.699__shadow:XC8l5ZdRZcXh1Kkd6aGKfQ7aNROvh-e_.nUM1keTbGvJM8JNS5W8kOR6MkKAAhXF_0 2024-09-19T15:31:39.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.252+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13616797834578541187', time=2024-09-19T17:21:52.233416+0000, chain.objs.size()=1 2024-09-19T15:31:39.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.252+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.701__shadow:cEK6Ws-rrpH2Dz6S.EUr55zegrqoe9d_.EJCBHCC1LqhAqSL2ubw4cbG_WhnxZek_0 2024-09-19T15:31:39.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.252+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15889466053853515223', time=2024-09-19T17:22:46.456562+0000, chain.objs.size()=1 2024-09-19T15:31:39.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.252+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.718__shadow_.DjTZAp6P9nlmxDVfPecGfzItO_11ZkK_0 2024-09-19T15:31:39.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.260+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:39.272 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T15:31:39.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:39.273 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:39.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50363' 2024-09-19T15:31:39.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='_n82g9Y7Mvyfmjkiu5JgG4pLAIroX63H', time=2024-09-19T16:34:00.843672+0000, chain.objs.size()=1 2024-09-19T15:31:39.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.163__shadow_.eth4IzPOwXu2DeDgLU9nJ51iKr-tu1v_0 2024-09-19T15:31:39.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16013713023342629138', time=2024-09-19T16:35:48.290721+0000, chain.objs.size()=1 2024-09-19T15:31:39.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.199__shadow_.zF5I19tBtO2kGTk-tH9GyhqzULaII-y_0 2024-09-19T15:31:39.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.663309936906166834', time=2024-09-19T16:40:02.755153+0000, chain.objs.size()=1 2024-09-19T15:31:39.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.244__shadow_.phScOkuhdgbQ7L2st1PuMVhhGHWgl8x_0 2024-09-19T15:31:39.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6072124831746130154', time=2024-09-19T16:40:02.756455+0000, chain.objs.size()=1 2024-09-19T15:31:39.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.244__shadow_.jMlKMGPwxPjQUqs0Jqp8yxOOzWyJnqH_0 2024-09-19T15:31:39.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1831292156935281120', time=2024-09-19T16:40:25.937114+0000, chain.objs.size()=1 2024-09-19T15:31:39.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.254__shadow_.--TBCfdihAjhKHss1oIW6JYpcF_mOXB_0 2024-09-19T15:31:39.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14932948096069245713', time=2024-09-19T16:40:25.938650+0000, chain.objs.size()=1 2024-09-19T15:31:39.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.254__shadow_.M7uh0nW3N5mH608N4HRPeeDeY7eYeiS_0 2024-09-19T15:31:39.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17742935211743221993', time=2024-09-19T16:42:32.698426+0000, chain.objs.size()=1 2024-09-19T15:31:39.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Z0MFOT2SIwM3swisE9dyeaGMtAj9CZc_0 2024-09-19T15:31:39.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17123829445639317455', time=2024-09-19T16:42:34.532993+0000, chain.objs.size()=1 2024-09-19T15:31:39.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.F2ygrsOYqHFH36iRvS3sQV37-wi7n4H_0 2024-09-19T15:31:39.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8431534442643879855', time=2024-09-19T16:42:35.810484+0000, chain.objs.size()=1 2024-09-19T15:31:39.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.LvVa2fddaLPcZ8f4aG0wmKnCpCeOLkH_0 2024-09-19T15:31:39.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15208204406886969996', time=2024-09-19T16:42:36.926497+0000, chain.objs.size()=1 2024-09-19T15:31:39.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.-Mt1Fkv8ZS9EhWOUriY41IYVtlZAroc_0 2024-09-19T15:31:39.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14841084997470746141', time=2024-09-19T16:42:37.084588+0000, chain.objs.size()=1 2024-09-19T15:31:39.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.QFnP0io2hx25OKczIdSFdNYkgcDKiAd_0 2024-09-19T15:31:39.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18330563133102648788', time=2024-09-19T16:42:38.602515+0000, chain.objs.size()=1 2024-09-19T15:31:39.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.268+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.lawuPsHG4YFRu_AuHRpeVHO_0PvIhIK_0 2024-09-19T15:31:39.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.272+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16619013572046063805', time=2024-09-19T16:42:38.930139+0000, chain.objs.size()=1 2024-09-19T15:31:39.277 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.272+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.m5XN_jFDdnfup_lO3bat8eJRSzWPlt8_0 2024-09-19T15:31:39.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.272+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11491095543994012998', time=2024-09-19T16:42:38.932650+0000, chain.objs.size()=1 2024-09-19T15:31:39.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.272+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.t0_aXEdDSX83W4NuswtQYqHpwFLrmL-_0 2024-09-19T15:31:39.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.272+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8489588004930913426', time=2024-09-19T16:42:39.171214+0000, chain.objs.size()=1 2024-09-19T15:31:39.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.272+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.wsb4AyYUrzR7knCGIkgd1Tgpx7HXnIz_0 2024-09-19T15:31:39.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.272+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2603720120208294215', time=2024-09-19T16:42:39.430290+0000, chain.objs.size()=1 2024-09-19T15:31:39.279 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.272+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.kq3PHp-0mlzJNOjmR9Mr4MSlDkyLh3U_0 2024-09-19T15:31:39.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12090640400637972293', time=2024-09-19T16:42:39.496760+0000, chain.objs.size()=1 2024-09-19T15:31:39.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.j54TmIqlUOGfL-orxAFQO0OBhnb64YA_0 2024-09-19T15:31:39.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9638566417920166501', time=2024-09-19T16:42:39.768022+0000, chain.objs.size()=1 2024-09-19T15:31:39.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Pn7riXF85YwRje9iOpCGNe9vLY_Y2S-_0 2024-09-19T15:31:39.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5823253025030643385', time=2024-09-19T16:42:41.126496+0000, chain.objs.size()=1 2024-09-19T15:31:39.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.mrIkrEKDhCa13_KGEJaXGeyLncmSZdt_0 2024-09-19T15:31:39.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12098356732693648418', time=2024-09-19T16:42:41.136403+0000, chain.objs.size()=1 2024-09-19T15:31:39.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.AotlBrt1oM-q0PVQ669lIzYAJpAEQYb_0 2024-09-19T15:31:39.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14836500288015848474', time=2024-09-19T16:42:44.065762+0000, chain.objs.size()=1 2024-09-19T15:31:39.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.wo-Oz4ArXfXRp_zP1Mh_LddRK_h4g_u_0 2024-09-19T15:31:39.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13892406702693185352', time=2024-09-19T16:42:45.679921+0000, chain.objs.size()=1 2024-09-19T15:31:39.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.TfJtk2XdfT70ZR2Qe0t0eoND27OCJO3_0 2024-09-19T15:31:39.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12309740225298955411', time=2024-09-19T16:42:46.657089+0000, chain.objs.size()=1 2024-09-19T15:31:39.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.WjDyU1YKkQhA5gfe7mZ6lK-obesxkUI_0 2024-09-19T15:31:39.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14337015264319935947', time=2024-09-19T16:42:47.283807+0000, chain.objs.size()=1 2024-09-19T15:31:39.283 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.dDD09-QKC9xdvXpGedq0nbNyhXfgr4N_0 2024-09-19T15:31:39.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4911555297946123252', time=2024-09-19T16:42:47.800918+0000, chain.objs.size()=1 2024-09-19T15:31:39.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.AK_xEIFXPs-qXU1P0Kh2hxOYKgA1g4V_0 2024-09-19T15:31:39.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6901710645604682367', time=2024-09-19T16:42:49.357421+0000, chain.objs.size()=1 2024-09-19T15:31:39.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.tbGHzvvyxpXB_MyAWIYBiYmlB394oY6_0 2024-09-19T15:31:39.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8395364687369407944', time=2024-09-19T16:42:49.682263+0000, chain.objs.size()=1 2024-09-19T15:31:39.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.2t1_lJGyaK29lUtp_amDuYUQZb1ByFf_0 2024-09-19T15:31:39.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.280+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17333399206606912972', time=2024-09-19T16:42:51.134257+0000, chain.objs.size()=1 2024-09-19T15:31:39.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.280+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.LyqWfy3ol-UezxD68lrH82DIi4vJDJi_0 2024-09-19T15:31:39.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.280+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6672748824547792797', time=2024-09-19T16:42:52.117777+0000, chain.objs.size()=1 2024-09-19T15:31:39.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.280+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Psdv6HnmHTjBaM0fz6kEh3AYuorRgMk_0 2024-09-19T15:31:39.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14973569074317940458', time=2024-09-19T16:42:54.711808+0000, chain.objs.size()=1 2024-09-19T15:31:39.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.xrzg7czQ96y0-3P-5_XlLcOlH0w_Tgx_0 2024-09-19T15:31:39.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17397160236683249347', time=2024-09-19T16:42:55.342952+0000, chain.objs.size()=1 2024-09-19T15:31:39.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.7nNLho0761oBS3IPGFEXbu3QhBuH9Xv_0 2024-09-19T15:31:39.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11527446054381630725', time=2024-09-19T16:42:56.334084+0000, chain.objs.size()=1 2024-09-19T15:31:39.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.6eYV-GOUjBcF-764j9aGdvN3TOtHKZq_0 2024-09-19T15:31:39.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9465551265783241831', time=2024-09-19T16:42:56.539585+0000, chain.objs.size()=1 2024-09-19T15:31:39.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.6cFzMjLRqyZig5Ecn5PN1F9gmHr8BeT_0 2024-09-19T15:31:39.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13361543531961325606', time=2024-09-19T16:42:57.406100+0000, chain.objs.size()=1 2024-09-19T15:31:39.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.5iw2PrEsl8PiY2bm7aUw6janm6trDn8_0 2024-09-19T15:31:39.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17442964114933059427', time=2024-09-19T16:42:57.853747+0000, chain.objs.size()=1 2024-09-19T15:31:39.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Jkimv0WVJdZqm8fO6EHy0zdm-okv4O5_0 2024-09-19T15:31:39.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13199718336813032099', time=2024-09-19T16:42:58.028601+0000, chain.objs.size()=1 2024-09-19T15:31:39.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.aKv-4_1RHd4rksVYTGDOHof3ibiombs_0 2024-09-19T15:31:39.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4717541383863381324', time=2024-09-19T16:42:59.122590+0000, chain.objs.size()=1 2024-09-19T15:31:39.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.T5kcihZohrVqqQILVjk7Ou5g4uXMnyO_0 2024-09-19T15:31:39.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1253050910663961504', time=2024-09-19T16:42:59.259769+0000, chain.objs.size()=1 2024-09-19T15:31:39.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.tzyDRT2RreIOqKGkly5yvXIa2WARjW7_0 2024-09-19T15:31:39.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.288+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12406109965268367935', time=2024-09-19T16:42:59.842929+0000, chain.objs.size()=1 2024-09-19T15:31:39.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.288+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.UUWLTOy6-zbsL1bzrSR6uOBfHyDNb1U_0 2024-09-19T15:31:39.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.288+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12702096834552817047', time=2024-09-19T16:42:59.920305+0000, chain.objs.size()=1 2024-09-19T15:31:39.292 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.288+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.UMVs3FnYN_nPQJspmgttK14FHvz7iml_0 2024-09-19T15:31:39.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.288+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17609343703272355600', time=2024-09-19T16:43:19.965937+0000, chain.objs.size()=1 2024-09-19T15:31:39.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.288+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.271__shadow_.eAjmIMkFpeghCKoPOtDRK7ueIZscTVl_0 2024-09-19T15:31:39.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.288+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11097756657295379673', time=2024-09-19T16:43:33.516245+0000, chain.objs.size()=1 2024-09-19T15:31:39.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.288+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.277__shadow_.ZRf4aU7Ya8t8pM7oIKFXWhbd49mybcj_0 2024-09-19T15:31:39.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.288+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10598361235908368118', time=2024-09-19T16:43:33.518234+0000, chain.objs.size()=1 2024-09-19T15:31:39.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.288+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.277__shadow_.fBGMuJAFTgQ28F32MJ2BkdQMEq88fuM_0 2024-09-19T15:31:39.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.288+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18345453022916973035', time=2024-09-19T16:43:42.847961+0000, chain.objs.size()=1 2024-09-19T15:31:39.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.288+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.281__shadow_.8__05Kbb2D7VGdgeDd1efVCb6cbh1CE_0 2024-09-19T15:31:39.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.288+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7100528423711067871', time=2024-09-19T16:43:49.810975+0000, chain.objs.size()=1 2024-09-19T15:31:39.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.288+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.284__shadow_.vhNSCGo3eI_EsXXlFHI-KZRHS5WNujn_0 2024-09-19T15:31:39.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.288+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1375477027403878601', time=2024-09-19T16:43:54.829340+0000, chain.objs.size()=1 2024-09-19T15:31:39.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.288+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.286__shadow_.NiiQkW0Lfqu4n9XoERSoxU5QpfwhMnH_0 2024-09-19T15:31:39.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.288+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1157177181021712455', time=2024-09-19T16:44:18.308691+0000, chain.objs.size()=1 2024-09-19T15:31:39.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.288+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.JApMzMZooPlwjB9wf1YnipyqmdTGc6r_0 2024-09-19T15:31:39.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.288+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1243206034141649562', time=2024-09-19T16:44:47.119617+0000, chain.objs.size()=1 2024-09-19T15:31:39.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.288+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.305__shadow_.eqJr-zQE3X8LggsX0QloqeJth3oFiTx_0 2024-09-19T15:31:39.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.288+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16486299809287918873', time=2024-09-19T16:47:18.482435+0000, chain.objs.size()=1 2024-09-19T15:31:39.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.288+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.N5afcSIoYBELALfRLQ93KSNokfij-MI_0 2024-09-19T15:31:39.297 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.292+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.564625406198314356', time=2024-09-19T16:47:19.557657+0000, chain.objs.size()=1 2024-09-19T15:31:39.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.292+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.aVzOBVdsGj3Hr0Irv6WSABFdDCm9zyu_0 2024-09-19T15:31:39.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.292+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6012005953848298445', time=2024-09-19T16:47:20.445177+0000, chain.objs.size()=1 2024-09-19T15:31:39.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.292+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.HA1Tsd00ZnICVE1Mpx8dQ9S_e-xoKGT_0 2024-09-19T15:31:39.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.296+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6818895842595428023', time=2024-09-19T16:47:20.999317+0000, chain.objs.size()=1 2024-09-19T15:31:39.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.296+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.G9gkBT81wPFWs6nLY15ujjO3e-kAl9t_0 2024-09-19T15:31:39.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.296+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16682359509612322551', time=2024-09-19T16:47:21.341122+0000, chain.objs.size()=1 2024-09-19T15:31:39.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.296+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.fzrE55vrliDzjq9zweh2wZt1ihw1vB1_0 2024-09-19T15:31:39.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.296+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13597747776821406908', time=2024-09-19T16:47:23.001409+0000, chain.objs.size()=1 2024-09-19T15:31:39.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.296+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.JwpUVgcvvwTr1U9BVyDQJ1K8krTKg1z_0 2024-09-19T15:31:39.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.296+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14489658655923321669', time=2024-09-19T16:47:26.674706+0000, chain.objs.size()=1 2024-09-19T15:31:39.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.296+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.RtBdHJq8SkkD4NzQmrpuwU8Vh5oEYyH_0 2024-09-19T15:31:39.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.296+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13389894936023584368', time=2024-09-19T16:47:28.899183+0000, chain.objs.size()=1 2024-09-19T15:31:39.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.296+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.c1exVLPIJoC32hiviThssEskFV6b63j_0 2024-09-19T15:31:39.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.296+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12662993067521768091', time=2024-09-19T16:47:32.947527+0000, chain.objs.size()=1 2024-09-19T15:31:39.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.296+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.SxK2o_oELTZCMw21N6bqtzXEWd_H0st_0 2024-09-19T15:31:39.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.296+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4285792944015155346', time=2024-09-19T16:47:33.885003+0000, chain.objs.size()=1 2024-09-19T15:31:39.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.296+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.zCtdDdB2f1rB2XdBfamb2Y7Yq3umnRD_0 2024-09-19T15:31:39.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.296+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6428593375507473954', time=2024-09-19T16:47:35.732722+0000, chain.objs.size()=1 2024-09-19T15:31:39.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.296+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.nrNTwQsUOecb6V6EHxMxwWJDX9z8WZn_0 2024-09-19T15:31:39.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.296+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2353991813002067514', time=2024-09-19T16:47:36.620533+0000, chain.objs.size()=1 2024-09-19T15:31:39.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.296+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.bik0389qNC8p6_PtqdGxko3m9uKs1bz_0 2024-09-19T15:31:39.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.296+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2879538062524524294', time=2024-09-19T16:47:36.781966+0000, chain.objs.size()=1 2024-09-19T15:31:39.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.296+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.rHtYn7kMu_iJILh8H-15yUKD1wQJXHI_0 2024-09-19T15:31:39.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.296+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16571477620863284380', time=2024-09-19T16:47:37.931699+0000, chain.objs.size()=1 2024-09-19T15:31:39.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.296+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ADFVr8vkxOh6I_7-cc1yQM3DMp0UjV9_0 2024-09-19T15:31:39.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.300+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18148569565041253122', time=2024-09-19T16:47:38.426919+0000, chain.objs.size()=1 2024-09-19T15:31:39.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.300+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.e5GaI9b1mDYdcmeQ0owJwDMeAAM6oWq_0 2024-09-19T15:31:39.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.300+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2863166139697474851', time=2024-09-19T16:47:44.826708+0000, chain.objs.size()=1 2024-09-19T15:31:39.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.300+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.j4B8UBNK5BqGfvmo7vhSNNFLlV56szY_0 2024-09-19T15:31:39.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.300+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6068917258496813639', time=2024-09-19T16:47:49.635094+0000, chain.objs.size()=1 2024-09-19T15:31:39.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.300+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.JCzYIaWPwDOX8tG8VRUMWZTGMbru52J_0 2024-09-19T15:31:39.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.300+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10346193069684836002', time=2024-09-19T16:49:38.143742+0000, chain.objs.size()=1 2024-09-19T15:31:39.307 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.300+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.4WAXKBGnKmr43YDXazH2-J46ZaSCLQF_0 2024-09-19T15:31:39.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.304+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2624932008689085811', time=2024-09-19T16:49:40.804700+0000, chain.objs.size()=1 2024-09-19T15:31:39.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.304+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_._KH56FrcHzalXXmWhQXlB-REcVKSqgz_0 2024-09-19T15:31:39.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.304+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2945115074819046889', time=2024-09-19T16:49:41.622971+0000, chain.objs.size()=1 2024-09-19T15:31:39.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.304+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.pLj5l7XJHRj0i-T_2ofcuj3Fj3fHQbb_0 2024-09-19T15:31:39.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.304+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8153875538384194260', time=2024-09-19T16:49:41.714069+0000, chain.objs.size()=1 2024-09-19T15:31:39.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.304+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ZIZHI2FNv19N5s5OIUd4q5kCSzZ82f0_0 2024-09-19T15:31:39.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.304+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12811063573807767170', time=2024-09-19T16:49:43.707214+0000, chain.objs.size()=1 2024-09-19T15:31:39.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.304+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_._0gVhgSLlUqQb87p59t-tnbj3NhagN8_0 2024-09-19T15:31:39.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.304+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7460778228287777124', time=2024-09-19T16:49:43.713677+0000, chain.objs.size()=1 2024-09-19T15:31:39.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.304+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.6qYk6f5HDYwknueZU8jefL95tZSsy7Y_0 2024-09-19T15:31:39.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.304+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15154061823032664890', time=2024-09-19T16:49:44.981654+0000, chain.objs.size()=1 2024-09-19T15:31:39.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.304+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.5z2fur8a65sqqGhFp9vX3bk25QXvARr_0 2024-09-19T15:31:39.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.304+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17749623243271918186', time=2024-09-19T16:49:45.225091+0000, chain.objs.size()=1 2024-09-19T15:31:39.310 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.304+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.yU1UN5z7gOZ8u39e22BuqkKl5_vdFQc_0 2024-09-19T15:31:39.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4224200672498920860', time=2024-09-19T16:49:45.708601+0000, chain.objs.size()=1 2024-09-19T15:31:39.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.308+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.bUHxUtVjHQI2tLAvJii62EGFDgDUkeM_0 2024-09-19T15:31:39.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17739106431037832556', time=2024-09-19T16:49:46.729044+0000, chain.objs.size()=1 2024-09-19T15:31:39.313 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.308+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.7r6i4N0ug6qEwdjqOCMDxr4ztUpH3WK_0 2024-09-19T15:31:39.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4226801619820240323', time=2024-09-19T16:49:47.916269+0000, chain.objs.size()=1 2024-09-19T15:31:39.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.308+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.uAON7VSOe1wSaZqG6rPtqtSB-D6wd66_0 2024-09-19T15:31:39.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13544419769953964656', time=2024-09-19T16:49:47.925179+0000, chain.objs.size()=1 2024-09-19T15:31:39.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.308+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.PvbVnysLSN05FBllEKwljdZOb1yNl20_0 2024-09-19T15:31:39.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15399113383209562444', time=2024-09-19T16:49:48.982114+0000, chain.objs.size()=1 2024-09-19T15:31:39.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.308+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.B5S0lGfQZ79nFRxdN2x6YYHqf1ZRTut_0 2024-09-19T15:31:39.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14288275997765741643', time=2024-09-19T16:49:49.706364+0000, chain.objs.size()=1 2024-09-19T15:31:39.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.308+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.uCseDMEn_DBrzQXbpofQtYzZqVDVRDw_0 2024-09-19T15:31:39.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15483166877365193936', time=2024-09-19T16:49:50.043445+0000, chain.objs.size()=1 2024-09-19T15:31:39.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.308+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.jVDTU7n5TIcR5ryoAaVcqIVn4L45iCn_0 2024-09-19T15:31:39.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3485668040327971569', time=2024-09-19T16:49:51.028121+0000, chain.objs.size()=1 2024-09-19T15:31:39.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.308+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.UJHcRAjpzGh2wZfBfRQB-1ck2q3rWC1_0 2024-09-19T15:31:39.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1371924795364341951', time=2024-09-19T16:49:52.093929+0000, chain.objs.size()=1 2024-09-19T15:31:39.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.308+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.WyjlsP5HfO7qH3R-vf4pGxtUoY17RB5_0 2024-09-19T15:31:39.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6751951682119931179', time=2024-09-19T16:49:52.426673+0000, chain.objs.size()=1 2024-09-19T15:31:39.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.308+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Nk9WWBfn10T_Q1GqR6nicp71o-S0VQD_0 2024-09-19T15:31:39.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.312+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7304245079851122677', time=2024-09-19T16:49:52.428370+0000, chain.objs.size()=1 2024-09-19T15:31:39.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.312+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.bdaUua2_x5ID9dJrzr2BOr_mEswZkOc_0 2024-09-19T15:31:39.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.312+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18311550227103351409', time=2024-09-19T16:49:52.829999+0000, chain.objs.size()=1 2024-09-19T15:31:39.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.312+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.j5JKcZAZxEn9XB58cVQk3w24-sUXT4k_0 2024-09-19T15:31:39.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17195663582759122722', time=2024-09-19T16:49:53.753302+0000, chain.objs.size()=1 2024-09-19T15:31:39.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.LuRoJmNOmArMs3cLrixo6kK7mG9Y8hD_0 2024-09-19T15:31:39.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7161089171302142472', time=2024-09-19T16:49:53.779037+0000, chain.objs.size()=1 2024-09-19T15:31:39.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.8NSBklgD0DuP3S_m5p4FQc1CIt475wn_0 2024-09-19T15:31:39.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15016320944251266149', time=2024-09-19T16:49:56.705926+0000, chain.objs.size()=1 2024-09-19T15:31:39.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.6kiNC73DH7cPcF2ROM_6kSzJOGAYhzF_0 2024-09-19T15:31:39.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15797482216337029826', time=2024-09-19T16:49:57.761292+0000, chain.objs.size()=1 2024-09-19T15:31:39.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.bUpo0h6hyCZ3v4XETl3d_G94uzY3J8V_0 2024-09-19T15:31:39.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18378507291909070330', time=2024-09-19T16:49:58.461828+0000, chain.objs.size()=1 2024-09-19T15:31:39.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.3OHHL5DRl4R5bz3ox7yUYCG7Hk6fsDQ_0 2024-09-19T15:31:39.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11415698521084923748', time=2024-09-19T16:49:58.761240+0000, chain.objs.size()=1 2024-09-19T15:31:39.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.f1tSl59mUhRmTKex4ND690bLsIGhZdx_0 2024-09-19T15:31:39.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1658383338283286745', time=2024-09-19T16:50:00.143242+0000, chain.objs.size()=1 2024-09-19T15:31:39.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_._4ycs1_CgHs4b_hOyQlEXyJjk9TYU49_0 2024-09-19T15:31:39.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9661947823028736701', time=2024-09-19T16:50:00.856420+0000, chain.objs.size()=1 2024-09-19T15:31:39.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.p2CP-AIJP7a6db3fSiMXFqUV_affRLj_0 2024-09-19T15:31:39.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16268614010595298541', time=2024-09-19T16:50:00.860766+0000, chain.objs.size()=1 2024-09-19T15:31:39.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.0CbIh8ufuhZJQIOK7oL8leOBTMTIR4F_0 2024-09-19T15:31:39.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17492296244084847506', time=2024-09-19T16:50:00.957448+0000, chain.objs.size()=1 2024-09-19T15:31:39.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.AgAPgy38bgEqO1T2g7XizccNsUolWgJ_0 2024-09-19T15:31:39.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4017591240905970709', time=2024-09-19T16:50:00.959357+0000, chain.objs.size()=1 2024-09-19T15:31:39.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.vzbGvHVc8mII4EGsrdKzxtEkqq68gaA_0 2024-09-19T15:31:39.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.320+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11549384678490772469', time=2024-09-19T16:50:01.909494+0000, chain.objs.size()=1 2024-09-19T15:31:39.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.320+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.8aBrpaYXFZC1affrlRJkMbLtj32wWPr_0 2024-09-19T15:31:39.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.320+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1558816103284200441', time=2024-09-19T16:50:01.911088+0000, chain.objs.size()=1 2024-09-19T15:31:39.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.320+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.UxOqQb1247Z8c6ds3tJIVve2zqQAW5b_0 2024-09-19T15:31:39.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.320+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2467796653880366586', time=2024-09-19T16:50:01.973785+0000, chain.objs.size()=1 2024-09-19T15:31:39.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.320+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.FtLY-4pV7ki8VxAN6Z_3CaFpdfBmCc2_0 2024-09-19T15:31:39.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.320+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18398766693071391059', time=2024-09-19T16:50:02.086170+0000, chain.objs.size()=1 2024-09-19T15:31:39.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.320+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.RWQUKVZIoLRjn1p1zg3PEL-pqrq3kcf_0 2024-09-19T15:31:39.333 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.328+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50363 2024-09-19T15:31:39.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-19T15:31:39.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4282871407088692972', time=2024-09-19T16:50:02.086974+0000, chain.objs.size()=1 2024-09-19T15:31:39.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.2HYxg4qkNh0_63ffONtGcoyFKpjw8qj_0 2024-09-19T15:31:39.337 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2152132530003930050', time=2024-09-19T16:50:03.201574+0000, chain.objs.size()=1 2024-09-19T15:31:39.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.YmJZbHvf6R_5cJtgGyPI1JjKtcNJ6pQ_0 2024-09-19T15:31:39.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5114380672678134950', time=2024-09-19T16:50:03.957370+0000, chain.objs.size()=1 2024-09-19T15:31:39.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.-jKHk6Tdk3SBK_EA2RuxZ_HW2L5Yp6R_0 2024-09-19T15:31:39.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10506496902497108071', time=2024-09-19T16:50:04.523952+0000, chain.objs.size()=1 2024-09-19T15:31:39.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Dv5hqZDBeGslFahXiljZ_X_1HtoF6YD_0 2024-09-19T15:31:39.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2029154368207529349', time=2024-09-19T16:50:04.920242+0000, chain.objs.size()=1 2024-09-19T15:31:39.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.1EKJmmCE8jtAMGq2Xe0uNDM8bNlLvCe_0 2024-09-19T15:31:39.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15977250553018911062', time=2024-09-19T16:50:05.266913+0000, chain.objs.size()=1 2024-09-19T15:31:39.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.192M-_XyhA872rWzNfuMaoWJzcGJtVo_0 2024-09-19T15:31:39.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11510626152222549605', time=2024-09-19T16:54:42.625658+0000, chain.objs.size()=1 2024-09-19T15:31:39.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.458__shadow_.ahd0E-btH7jPyZhHw_uGGaWVroKJhnu_0 2024-09-19T15:31:39.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17302797411049798820', time=2024-09-19T16:54:54.634488+0000, chain.objs.size()=1 2024-09-19T15:31:39.338 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.462__shadow_.t-JBewE8gpkiOf_UD0vosRguMRmbR0e_0 2024-09-19T15:31:39.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6658804659573012920', time=2024-09-19T16:54:57.655988+0000, chain.objs.size()=1 2024-09-19T15:31:39.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.463__shadow_.nzm6Maypw_8gttiRSY86E7Q5Gd1cQlF_0 2024-09-19T15:31:39.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.967345184766368543', time=2024-09-19T16:55:35.666033+0000, chain.objs.size()=1 2024-09-19T15:31:39.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.484__shadow_.-3GR6Uq_8GgHCtFOyGf1GzK_ue2Relh_0 2024-09-19T15:31:39.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12417695204075397802', time=2024-09-19T16:56:13.055200+0000, chain.objs.size()=1 2024-09-19T15:31:39.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.499__shadow_.P97EvhhF7Bjl-ra-TAKtHEp8-J94epE_0 2024-09-19T15:31:39.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6537911548916573427', time=2024-09-19T16:59:14.331192+0000, chain.objs.size()=1 2024-09-19T15:31:39.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.520__shadow:OyBq4-TpcaK0LC-1MpCJypR-OX705UQ_.76QxBinb6qPkT-3ZdjCkCKAgj4UJBMu_0 2024-09-19T15:31:39.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.336+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~fxOGZkR1lxkeDTELh8qC5VRJ_yXFKLs', time=2024-09-19T17:04:11.149703+0000, chain.objs.size()=2 2024-09-19T15:31:39.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.336+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.529__multipart_mymultipart.2~fxOGZkR1lxkeDTELh8qC5VRJ_yXFKLs.1 2024-09-19T15:31:39.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.336+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.529__multipart_mymultipart.2~fxOGZkR1lxkeDTELh8qC5VRJ_yXFKLs.2 2024-09-19T15:31:39.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.336+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1000867452089703575', time=2024-09-19T17:05:04.674382+0000, chain.objs.size()=1 2024-09-19T15:31:39.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.336+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.536__multipart_mymultipart.2~hM-m2YrtJF77dKzhURPGL6SmYY46ouC.1 2024-09-19T15:31:39.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.336+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1009366891660621098', time=2024-09-19T17:07:49.729339+0000, chain.objs.size()=1 2024-09-19T15:31:39.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.336+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:b9QO.dj8LD5VnM3o--L5g.3L-IEQa23_.u6phIL8H3SV7_T4HjRjgWyvSbmSdgX9_0 2024-09-19T15:31:39.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.336+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4510783669511635169', time=2024-09-19T17:07:58.984819+0000, chain.objs.size()=1 2024-09-19T15:31:39.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.336+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:c3HYK81c0dozbvDFjczrk5xR6LmoZDY_.Di7lBPlReEXvXZA6G_zBkNFK3znqrYi_0 2024-09-19T15:31:39.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.336+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18427819891691738827', time=2024-09-19T17:08:07.340151+0000, chain.objs.size()=1 2024-09-19T15:31:39.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.336+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.570__shadow:5yXZPHAikHz4AMKmvCUnEGb9xdgLWr0_.J4mqeHytTWSA5DmSJa6ZvO0lnC2nkUi_0 2024-09-19T15:31:39.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.336+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2185550259152713495', time=2024-09-19T17:08:26.367603+0000, chain.objs.size()=1 2024-09-19T15:31:39.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.336+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.574__shadow:t0eX7z5GAAYol2PE.H52H0i8Y3sioNu_.thveliNQEXmuh2QqSL4o8XoKNNopOO3_0 2024-09-19T15:31:39.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.336+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17264183213992054792', time=2024-09-19T17:11:13.626430+0000, chain.objs.size()=1 2024-09-19T15:31:39.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.336+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.596__shadow_.MzfKNdJfzZhmVM9CcBYkOE6ZDmOstsx_0 2024-09-19T15:31:39.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.336+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6365209300480670381', time=2024-09-19T17:16:30.371337+0000, chain.objs.size()=1 2024-09-19T15:31:39.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.336+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.620__shadow_.B2ooBxMaJJJubVvRE7vyf9zxkSfQmmS_0 2024-09-19T15:31:39.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.336+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17664561989431139707', time=2024-09-19T17:18:46.269654+0000, chain.objs.size()=1 2024-09-19T15:31:39.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.336+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.644__shadow_.8s3-z7EwS9Yo2cV9TilZgVRXsNua3iu_0 2024-09-19T15:31:39.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.336+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3276878824907577021', time=2024-09-19T17:22:33.572136+0000, chain.objs.size()=1 2024-09-19T15:31:39.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.336+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.716__shadow:ttkEAFa1YxPOChcPxe5-7XCdqVqV9Fa_.q6B4fnvA6E5VHde0ko-BkyhVqNZDkxT_0 2024-09-19T15:31:39.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6621457706827652322', time=2024-09-19T17:23:51.526158+0000, chain.objs.size()=1 2024-09-19T15:31:39.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.739__shadow_.P6g2Z56pSjZLAgU8GTHk3dAiNAZMW-J_0 2024-09-19T15:31:39.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8671816279759335627', time=2024-09-19T17:23:58.641297+0000, chain.objs.size()=1 2024-09-19T15:31:39.348 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.741__shadow_.o05KG3F5FVtb0wT3MFUr7G6D1FLnaZ8_0 2024-09-19T15:31:39.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.344+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17803518445811523151', time=2024-09-19T17:26:14.977199+0000, chain.objs.size()=1 2024-09-19T15:31:39.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.344+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.756__shadow_.cryiUiaX8JteyvV5Tvim68EDIJ31Y5Q_0 2024-09-19T15:31:39.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.344+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12147220685271644355', time=2024-09-19T17:26:33.362708+0000, chain.objs.size()=1 2024-09-19T15:31:39.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.344+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.759__shadow_.vK-hck1BOx9f119eE8Ut-U6eK2CPX97_0 2024-09-19T15:31:39.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.352+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:39.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T15:31:39.361 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:39.362 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:39.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43540' 2024-09-19T15:31:39.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18194962030215255054', time=2024-09-19T16:32:02.716395+0000, chain.objs.size()=1 2024-09-19T15:31:39.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.151__shadow_.fTotHxVATTkIARFXgekAzfVu6AANqgU_0 2024-09-19T15:31:39.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13948132000823953653', time=2024-09-19T16:39:42.424624+0000, chain.objs.size()=1 2024-09-19T15:31:39.363 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.237__shadow_.ZmTam4ROd2kHRwOaZFc9du0wzjiGUbv_0 2024-09-19T15:31:39.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16943725961446739227', time=2024-09-19T16:39:54.948325+0000, chain.objs.size()=1 2024-09-19T15:31:39.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.242__shadow_.wl202UmDEQz7VSWbGprqyLUBpPtRmcE_0 2024-09-19T15:31:39.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9437325320844947782', time=2024-09-19T16:40:19.103823+0000, chain.objs.size()=1 2024-09-19T15:31:39.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.251__shadow_.5bgFb8zJ6m0aAbKpxcvhsiilEoYJlqj_0 2024-09-19T15:31:39.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15465594946317444040', time=2024-09-19T16:42:29.487735+0000, chain.objs.size()=1 2024-09-19T15:31:39.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.2xdZbB7ZsprnxRj0xOeVgFa694Ou3A-_0 2024-09-19T15:31:39.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12871300199155436869', time=2024-09-19T16:42:30.561590+0000, chain.objs.size()=1 2024-09-19T15:31:39.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.mBH-27vPNPheaECCl2PtMayNIPMKOPl_0 2024-09-19T15:31:39.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8551929872217803439', time=2024-09-19T16:42:31.473260+0000, chain.objs.size()=1 2024-09-19T15:31:39.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.uau6ejrkhFM4KbcbsZAPu5SigBDUEFj_0 2024-09-19T15:31:39.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13672533792901558180', time=2024-09-19T16:42:34.645343+0000, chain.objs.size()=1 2024-09-19T15:31:39.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.WHMObINZ6hr6CN9es3x7B-azvujtOKZ_0 2024-09-19T15:31:39.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8818454233590563889', time=2024-09-19T16:42:35.090177+0000, chain.objs.size()=1 2024-09-19T15:31:39.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.XMM1InVfYTXkrg9UbvPL4I4WTULg6YS_0 2024-09-19T15:31:39.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5052330511115278192', time=2024-09-19T16:42:36.817304+0000, chain.objs.size()=1 2024-09-19T15:31:39.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.hguJ7ogeQUh6yvP_3hsRhR-ylFngDd0_0 2024-09-19T15:31:39.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6893227307992161438', time=2024-09-19T16:42:37.930498+0000, chain.objs.size()=1 2024-09-19T15:31:39.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.GyB2SdOuJUmoH3fCDmawUyEbbMRmOIB_0 2024-09-19T15:31:39.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.775356829618521558', time=2024-09-19T16:42:38.616120+0000, chain.objs.size()=1 2024-09-19T15:31:39.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.356+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.kEaMWC66PA9AulujuehWt8saxV0qomP_0 2024-09-19T15:31:39.365 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.360+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14723130498516854019', time=2024-09-19T16:42:43.916937+0000, chain.objs.size()=1 2024-09-19T15:31:39.366 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.360+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.1qTSFothtmMpB2PnCwnDCtAvgavY3vD_0 2024-09-19T15:31:39.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.360+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.684368738669665872', time=2024-09-19T16:42:45.282353+0000, chain.objs.size()=1 2024-09-19T15:31:39.368 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.360+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Av2D0tnq6wL1hL3obdsaEB5J5EiUL3z_0 2024-09-19T15:31:39.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.360+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9966091008556707096', time=2024-09-19T16:42:45.543389+0000, chain.objs.size()=1 2024-09-19T15:31:39.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.360+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Cni_l4MzHU-rZrlKB7cRhmX2siunzyN_0 2024-09-19T15:31:39.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.360+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14140629584164235522', time=2024-09-19T16:42:47.077538+0000, chain.objs.size()=1 2024-09-19T15:31:39.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.360+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.o9mmm5YXV7Tx4c_AgZHlalue3CDRs6a_0 2024-09-19T15:31:39.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.364+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12253483809503617991', time=2024-09-19T16:42:47.529598+0000, chain.objs.size()=1 2024-09-19T15:31:39.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.364+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Vn9NelCbyad4Xk2qd_71JlSSiOmJC73_0 2024-09-19T15:31:39.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.364+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2071420327508322024', time=2024-09-19T16:42:48.277670+0000, chain.objs.size()=1 2024-09-19T15:31:39.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.364+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.tiwlX6VuLy8MkIpiFeDZBQh4QZzq_Tn_0 2024-09-19T15:31:39.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.364+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10774906099247562021', time=2024-09-19T16:42:50.147712+0000, chain.objs.size()=1 2024-09-19T15:31:39.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.364+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.GKjTwxeXzbA3zF7Xl8Wx9OSWf1xjrQk_0 2024-09-19T15:31:39.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.364+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8768246154036449863', time=2024-09-19T16:42:50.302807+0000, chain.objs.size()=1 2024-09-19T15:31:39.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.364+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Ir6JbDFhgdZspAoOWIGaDXrV1-9Z2sU_0 2024-09-19T15:31:39.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.364+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17142590385410464344', time=2024-09-19T16:42:50.619952+0000, chain.objs.size()=1 2024-09-19T15:31:39.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.364+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.HSaOVkEtIZX9ejbOa6AmNdZuPy1WcZa_0 2024-09-19T15:31:39.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.364+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.596789688725108090', time=2024-09-19T16:42:51.163368+0000, chain.objs.size()=1 2024-09-19T15:31:39.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.364+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.lkLZ4SmjtGgG3-nrHthDEnJt8NaL04L_0 2024-09-19T15:31:39.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.364+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1660152455599087146', time=2024-09-19T16:42:51.498093+0000, chain.objs.size()=1 2024-09-19T15:31:39.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.364+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.3DsL0F4gxYs0KgsAigStm2Softv4Xiy_0 2024-09-19T15:31:39.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.364+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.105295357447762868', time=2024-09-19T16:42:51.502411+0000, chain.objs.size()=1 2024-09-19T15:31:39.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.364+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.lJ-R9-sqvZeAVEeGGV_0iUxVuHgH6K2_0 2024-09-19T15:31:39.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.364+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16436405842477581510', time=2024-09-19T16:42:53.367722+0000, chain.objs.size()=1 2024-09-19T15:31:39.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.364+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.bhQwud9z-wNeeimZ1Rb-7641le789Bl_0 2024-09-19T15:31:39.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12199487567067682570', time=2024-09-19T16:42:53.639007+0000, chain.objs.size()=1 2024-09-19T15:31:39.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.D43lQ6DzIb0OHDCXN4zvfYES_igLUmL_0 2024-09-19T15:31:39.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13135406739160523784', time=2024-09-19T16:42:53.949941+0000, chain.objs.size()=1 2024-09-19T15:31:39.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.zo2_unSi3h5SCy8JNd-qMX4DvH6jODT_0 2024-09-19T15:31:39.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8802260241913564567', time=2024-09-19T16:42:53.963496+0000, chain.objs.size()=1 2024-09-19T15:31:39.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.bJO3Magf7DgLUld4IexCMy-OVodBE5G_0 2024-09-19T15:31:39.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10018920718009003428', time=2024-09-19T16:42:54.668624+0000, chain.objs.size()=1 2024-09-19T15:31:39.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.GJ9j9Z891qYeB1Dn8FCPQWifbftw7Kz_0 2024-09-19T15:31:39.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8059114304171668655', time=2024-09-19T16:42:55.078352+0000, chain.objs.size()=1 2024-09-19T15:31:39.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.kSR7TEl31H1LH9v305eEkLzI9RFjbue_0 2024-09-19T15:31:39.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8719257616367156778', time=2024-09-19T16:42:55.266247+0000, chain.objs.size()=1 2024-09-19T15:31:39.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Dy5XEwkyDzQBtnLU1DzsUBPH4t354Cx_0 2024-09-19T15:31:39.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15909330991395093035', time=2024-09-19T16:42:55.992928+0000, chain.objs.size()=1 2024-09-19T15:31:39.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.PMALNKekfudNTpytd79sj0EWhjpZVxN_0 2024-09-19T15:31:39.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2295059119864537103', time=2024-09-19T16:42:58.157962+0000, chain.objs.size()=1 2024-09-19T15:31:39.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.eZjjzKXymt1StnVnOcYOPl2aj_vfdWI_0 2024-09-19T15:31:39.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6022651976889656985', time=2024-09-19T16:42:58.703425+0000, chain.objs.size()=1 2024-09-19T15:31:39.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.q6T-3cy3S8FYEP4D0EW48Cb6nhdlKXI_0 2024-09-19T15:31:39.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2862414256838820073', time=2024-09-19T16:42:58.776873+0000, chain.objs.size()=1 2024-09-19T15:31:39.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.1WYcCW0-g75zKMzhgZBDTKCsKtM2GCI_0 2024-09-19T15:31:39.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16143586197056420690', time=2024-09-19T16:43:02.350770+0000, chain.objs.size()=1 2024-09-19T15:31:39.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.263__shadow_.rARMZgWZ7YYIDL2jHycxfABtBNC9KN2_0 2024-09-19T15:31:39.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14358426217502735637', time=2024-09-19T16:43:04.554746+0000, chain.objs.size()=1 2024-09-19T15:31:39.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.372+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.264__shadow_.zTdZ7jGxYvet7yoiIJ-lxWRsjKJzSk3_0 2024-09-19T15:31:39.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5554517689533875972', time=2024-09-19T16:43:52.292649+0000, chain.objs.size()=1 2024-09-19T15:31:39.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.372+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.285__shadow_.7uwAHvp6q6ZoC0vKCLuOzzRxXcl85p7_0 2024-09-19T15:31:39.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12983218349215634243', time=2024-09-19T16:43:54.837181+0000, chain.objs.size()=1 2024-09-19T15:31:39.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.372+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.286__shadow_.u4c1DYCeaXmmZlpulCBLFAwSEtiZ0lp_0 2024-09-19T15:31:39.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14279645133314600973', time=2024-09-19T16:44:01.773522+0000, chain.objs.size()=1 2024-09-19T15:31:39.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.372+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.289__shadow_.Trk0jNHB9CUgduvwAW7EAq_d9vFQCcX_0 2024-09-19T15:31:39.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17929666354784261225', time=2024-09-19T16:44:18.615569+0000, chain.objs.size()=1 2024-09-19T15:31:39.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.372+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.BPSIlU-t9-FSkJ-F06USgqm355DHhtC_0 2024-09-19T15:31:39.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15649387477655935901', time=2024-09-19T16:44:27.995399+0000, chain.objs.size()=1 2024-09-19T15:31:39.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.372+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.297__shadow_.JptNOUqsJR_I4Uowhu1gJHnlLeADkwX_0 2024-09-19T15:31:39.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12371146338590887527', time=2024-09-19T16:47:18.067052+0000, chain.objs.size()=1 2024-09-19T15:31:39.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.372+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.cCmlWpHTSMp4Gg7kpeQIhm3HjHPdmGG_0 2024-09-19T15:31:39.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6207007056709348073', time=2024-09-19T16:47:19.337065+0000, chain.objs.size()=1 2024-09-19T15:31:39.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.372+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.aC31naY2v-vE-aYu7O6ueQPUy6S75fH_0 2024-09-19T15:31:39.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14821845051281039437', time=2024-09-19T16:47:20.756810+0000, chain.objs.size()=1 2024-09-19T15:31:39.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.372+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.07Awgn8t1HJAFFCeUDAZ_oiasB39fqb_0 2024-09-19T15:31:39.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10658794439152521337', time=2024-09-19T16:47:20.962212+0000, chain.objs.size()=1 2024-09-19T15:31:39.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.372+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.uKcLgwzOVDii2bAJH4RnywNBX4dK361_0 2024-09-19T15:31:39.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16541596277348194898', time=2024-09-19T16:47:21.122250+0000, chain.objs.size()=1 2024-09-19T15:31:39.380 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.372+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.zwAk5uQmvDDGltTt5EFtp0rYFoIlAQd_0 2024-09-19T15:31:39.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11563935501606056193', time=2024-09-19T16:47:22.472154+0000, chain.objs.size()=1 2024-09-19T15:31:39.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.376+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.SmAN7t7t46MbW2rDwCcjzIxcoLkNqdo_0 2024-09-19T15:31:39.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13901880860507263198', time=2024-09-19T16:47:22.852559+0000, chain.objs.size()=1 2024-09-19T15:31:39.381 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.376+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.eylOm284H00qno3wXwIdEP8T4ttiUe9_0 2024-09-19T15:31:39.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10696609113201578041', time=2024-09-19T16:47:23.348598+0000, chain.objs.size()=1 2024-09-19T15:31:39.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Wp1U45jGfWlb4iKQzD8Z-DXib-2RQPL_0 2024-09-19T15:31:39.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17293050887900750631', time=2024-09-19T16:47:24.297085+0000, chain.objs.size()=1 2024-09-19T15:31:39.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.FDnXBvBA_XSMvZC0j1IwHwLIf0Xy4Rc_0 2024-09-19T15:31:39.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1852269087391493180', time=2024-09-19T16:47:24.398041+0000, chain.objs.size()=1 2024-09-19T15:31:39.385 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.zivID5agEgLnaONKJZXOU7w1IhjcLAX_0 2024-09-19T15:31:39.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15495264159737769376', time=2024-09-19T16:47:24.461921+0000, chain.objs.size()=1 2024-09-19T15:31:39.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.xS6nkeEdSF84rFcx1VzGOQ00wozjRUv_0 2024-09-19T15:31:39.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6717499948682964634', time=2024-09-19T16:47:24.799518+0000, chain.objs.size()=1 2024-09-19T15:31:39.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.rMsRdfLpUOwDtpxzpHQv9LNaBAb82qE_0 2024-09-19T15:31:39.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11906779037614960876', time=2024-09-19T16:47:27.886166+0000, chain.objs.size()=1 2024-09-19T15:31:39.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.gjVFCsbWB2vVHEPQpaACwAMR_l6NEP9_0 2024-09-19T15:31:39.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2316483619480194317', time=2024-09-19T16:47:29.825029+0000, chain.objs.size()=1 2024-09-19T15:31:39.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.rNZR0COWFCKEEMsB4X2WkXJaEPl-AKS_0 2024-09-19T15:31:39.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8569875208496854134', time=2024-09-19T16:47:31.888422+0000, chain.objs.size()=1 2024-09-19T15:31:39.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.cHukc0zlXhBliTav2j5oT34ajSm_M7-_0 2024-09-19T15:31:39.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13202159254548077649', time=2024-09-19T16:47:32.458233+0000, chain.objs.size()=1 2024-09-19T15:31:39.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.tf0cc5oxBIRKtEmiBK85LDyxt3bE3Wd_0 2024-09-19T15:31:39.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3868986453687252048', time=2024-09-19T16:47:33.445855+0000, chain.objs.size()=1 2024-09-19T15:31:39.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ebFOzFvbC5G4t6V0zn8rv3YE7M09-V2_0 2024-09-19T15:31:39.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18253331019516359330', time=2024-09-19T16:47:33.590721+0000, chain.objs.size()=1 2024-09-19T15:31:39.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.sEJokRF2dq7t_OBAQH6zBP-BX-Jya64_0 2024-09-19T15:31:39.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14793897332206451968', time=2024-09-19T16:47:33.957317+0000, chain.objs.size()=1 2024-09-19T15:31:39.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.p0NVDUN9ko2TooJ7aPv81oNUnkl0P8N_0 2024-09-19T15:31:39.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.384+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8071498082432211984', time=2024-09-19T16:47:34.399158+0000, chain.objs.size()=1 2024-09-19T15:31:39.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.384+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.mgmp8JLFBcm0dfubZaYJgQKam8xlCnh_0 2024-09-19T15:31:39.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.384+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8455507215689728542', time=2024-09-19T16:47:37.381278+0000, chain.objs.size()=1 2024-09-19T15:31:39.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.384+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.6HlXtDHdJ_l_8NKYWWlLROIlKgu2Op__0 2024-09-19T15:31:39.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14825290208947972701', time=2024-09-19T16:47:38.531165+0000, chain.objs.size()=1 2024-09-19T15:31:39.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.SgYrmEOcVpvADpPzTbvTeXNfRwu9b69_0 2024-09-19T15:31:39.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11478486991156055065', time=2024-09-19T16:47:40.346906+0000, chain.objs.size()=1 2024-09-19T15:31:39.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.gcaWUzq2iVrJdAIuUSdbME9wFskfTLt_0 2024-09-19T15:31:39.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2273898335452025548', time=2024-09-19T16:47:40.459051+0000, chain.objs.size()=1 2024-09-19T15:31:39.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.pIXzB80ZvT9gBgz9XZYhTkAgK4aYymq_0 2024-09-19T15:31:39.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7616231482499051508', time=2024-09-19T16:47:40.462541+0000, chain.objs.size()=1 2024-09-19T15:31:39.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.zwIeCnYQLgFdLKQ6thweprlnPRiRvbV_0 2024-09-19T15:31:39.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1106409694779561941', time=2024-09-19T16:47:41.312512+0000, chain.objs.size()=1 2024-09-19T15:31:39.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_._lhmiQ2ifw4-8L-4IkJCXz9t4Bb5c2b_0 2024-09-19T15:31:39.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15272802977172529960', time=2024-09-19T16:47:41.811350+0000, chain.objs.size()=1 2024-09-19T15:31:39.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.xP5-ONz67bfEhExAQZzk8D8zpAL9213_0 2024-09-19T15:31:39.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5050392074126261006', time=2024-09-19T16:47:42.718913+0000, chain.objs.size()=1 2024-09-19T15:31:39.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.sv0d5xNmZZKNjaYRG00A39tWq3WseyC_0 2024-09-19T15:31:39.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8008242365654984674', time=2024-09-19T16:47:43.517877+0000, chain.objs.size()=1 2024-09-19T15:31:39.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.E4jZ-VPdqrdM0JBK0zXJZ4x9Gi1qqYl_0 2024-09-19T15:31:39.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9066825672700468046', time=2024-09-19T16:47:43.519494+0000, chain.objs.size()=1 2024-09-19T15:31:39.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.xJzMX8YshP0O1phFsf9GC76b3G3dkUD_0 2024-09-19T15:31:39.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5736555073047014197', time=2024-09-19T16:47:44.245645+0000, chain.objs.size()=1 2024-09-19T15:31:39.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_._l_fS41XXSLh9sIMPcUe8CvY64rJlJ2_0 2024-09-19T15:31:39.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.312916427111678124', time=2024-09-19T16:47:45.344196+0000, chain.objs.size()=1 2024-09-19T15:31:39.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.DnHa1fpTN0b8XgrWOXim79-mBLuOpHb_0 2024-09-19T15:31:39.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10542039748701787539', time=2024-09-19T16:47:45.650099+0000, chain.objs.size()=1 2024-09-19T15:31:39.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.FWtb0MWoS6bn3pMiITC4jmMd11Ciszp_0 2024-09-19T15:31:39.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8404243699792910476', time=2024-09-19T16:47:46.685114+0000, chain.objs.size()=1 2024-09-19T15:31:39.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.2IOqzaD0vozGuRvEfTDHWE7QTImgiWQ_0 2024-09-19T15:31:39.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16008662368566926802', time=2024-09-19T16:47:48.017049+0000, chain.objs.size()=1 2024-09-19T15:31:39.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.WPHB77pjteD9r8loQFSmeJIfPo5OlP__0 2024-09-19T15:31:39.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7602412287018149866', time=2024-09-19T16:47:48.451831+0000, chain.objs.size()=1 2024-09-19T15:31:39.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ARC1wEK44Qujv5dseQw53lXhBIV6Hmh_0 2024-09-19T15:31:39.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6943930139438173481', time=2024-09-19T16:47:48.621533+0000, chain.objs.size()=1 2024-09-19T15:31:39.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.g2L8iCowJHhutalA4rEnS45UWR7iIU2_0 2024-09-19T15:31:39.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15661637754403284420', time=2024-09-19T16:47:48.856510+0000, chain.objs.size()=1 2024-09-19T15:31:39.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.w_eIVRU8wKq8S92MknVx4SkS9rSFsAN_0 2024-09-19T15:31:39.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1395144618243827525', time=2024-09-19T16:47:48.859109+0000, chain.objs.size()=1 2024-09-19T15:31:39.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.w8L9eqVMKKTJnR6VXbBmB-UlS7AK3Nk_0 2024-09-19T15:31:39.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13503608583295146795', time=2024-09-19T16:47:49.680925+0000, chain.objs.size()=1 2024-09-19T15:31:39.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Dukc8L7ooHjdRnErG9vWBfTA_k-3YjR_0 2024-09-19T15:31:39.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4020097300919757561', time=2024-09-19T16:49:34.785939+0000, chain.objs.size()=1 2024-09-19T15:31:39.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.O0bWQVBpVz0NRb8REMIo8zj4qnUwHBn_0 2024-09-19T15:31:39.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14967674080346563529', time=2024-09-19T16:49:34.936819+0000, chain.objs.size()=1 2024-09-19T15:31:39.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Dkm67AEmFMhusAPX6O5B7kgdL6ZrZQi_0 2024-09-19T15:31:39.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4886099074537267195', time=2024-09-19T16:49:35.578588+0000, chain.objs.size()=1 2024-09-19T15:31:39.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.TDEDbwClmyGxziLJl-6e_AqHZ9WPFdZ_0 2024-09-19T15:31:39.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18231128600746555166', time=2024-09-19T16:49:35.580906+0000, chain.objs.size()=1 2024-09-19T15:31:39.399 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.3lzXQaaF2P4bncWCbg4DFwX_LphYP53_0 2024-09-19T15:31:39.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9551737436196380712', time=2024-09-19T16:49:35.908769+0000, chain.objs.size()=1 2024-09-19T15:31:39.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.L-6Uz_r2jyh0v4QtnGjV_C7_Yrbq94Q_0 2024-09-19T15:31:39.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15514547841921701878', time=2024-09-19T16:49:36.098779+0000, chain.objs.size()=1 2024-09-19T15:31:39.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.TZ67lbevxeIKrDJrZgqRWk8u_AJF6bk_0 2024-09-19T15:31:39.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13230656581266134567', time=2024-09-19T16:49:36.187009+0000, chain.objs.size()=1 2024-09-19T15:31:39.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.qlpF1dU0NIJ89NbGVm-izEzLn0o94l7_0 2024-09-19T15:31:39.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15735907223609456984', time=2024-09-19T16:49:36.637504+0000, chain.objs.size()=1 2024-09-19T15:31:39.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.tp-g_lxAMRfiEwgi6YEAktmB7Hjn3ka_0 2024-09-19T15:31:39.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2329406154064401280', time=2024-09-19T16:49:36.958663+0000, chain.objs.size()=1 2024-09-19T15:31:39.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.4w6XYuZjeAYkuOn0UBHe3jGvUUL3FAq_0 2024-09-19T15:31:39.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18425902369209633408', time=2024-09-19T16:49:37.881446+0000, chain.objs.size()=1 2024-09-19T15:31:39.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.35TiMra5yn_1QUUJ70hf_PDlUzkhdxr_0 2024-09-19T15:31:39.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10684205642361880702', time=2024-09-19T16:49:41.433145+0000, chain.objs.size()=1 2024-09-19T15:31:39.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.E-_OrIi0rW7kJfqljrbKYQicmmGlgQi_0 2024-09-19T15:31:39.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12388218017998096079', time=2024-09-19T16:49:41.737124+0000, chain.objs.size()=1 2024-09-19T15:31:39.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.TMJP-1MeTdWZU1pQ7T-i6qeEZOfFGAW_0 2024-09-19T15:31:39.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14806976187643650513', time=2024-09-19T16:49:42.507617+0000, chain.objs.size()=1 2024-09-19T15:31:39.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.VRfEcDt-lmZxru_4-hsITjiQ161ugOi_0 2024-09-19T15:31:39.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1406227614677379311', time=2024-09-19T16:49:45.217810+0000, chain.objs.size()=1 2024-09-19T15:31:39.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.JSJoSlWk0v84_0LvU86zPZnO4NBwno-_0 2024-09-19T15:31:39.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13002554617243159356', time=2024-09-19T16:49:45.609717+0000, chain.objs.size()=1 2024-09-19T15:31:39.404 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.EXP21PyUiIb99WbV0ax319fcBfC9_p3_0 2024-09-19T15:31:39.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.400+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16009957785937769945', time=2024-09-19T16:49:46.179582+0000, chain.objs.size()=1 2024-09-19T15:31:39.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.400+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.335uLOPj1fPyZGaOp4cyqNRWtmq2F5C_0 2024-09-19T15:31:39.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.400+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10713453840465879035', time=2024-09-19T16:49:46.741274+0000, chain.objs.size()=1 2024-09-19T15:31:39.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.400+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.uE38uzpIl-Z45NQNqrvAOtpJl9qGAMG_0 2024-09-19T15:31:39.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.400+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16045179718264738099', time=2024-09-19T16:49:47.787175+0000, chain.objs.size()=1 2024-09-19T15:31:39.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.400+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Sswwy-tRq3a3lp3SGVdwIgWsxJkHqVu_0 2024-09-19T15:31:39.412 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43540 2024-09-19T15:31:39.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=38, truncated=0, next_marker='' 2024-09-19T15:31:39.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12255188933453402639', time=2024-09-19T16:49:48.175961+0000, chain.objs.size()=1 2024-09-19T15:31:39.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.A21IKkWqgYMFw5mRQK5NJ5cFY_EHoqv_0 2024-09-19T15:31:39.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16640321900477215531', time=2024-09-19T16:49:49.755060+0000, chain.objs.size()=1 2024-09-19T15:31:39.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.QCgmp8xL1VQj5zE1uxlJetrk_0TL2Hl_0 2024-09-19T15:31:39.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8662264532753890891', time=2024-09-19T16:49:51.083719+0000, chain.objs.size()=1 2024-09-19T15:31:39.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.fPmTp6mXBZMGiOnkLQ99GPyqxCiaA2q_0 2024-09-19T15:31:39.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12373455700448182297', time=2024-09-19T16:49:53.689995+0000, chain.objs.size()=1 2024-09-19T15:31:39.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.B1zKVtr31t2cvjQMRLYKSt4BegiFBlC_0 2024-09-19T15:31:39.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7617766794998015634', time=2024-09-19T16:49:54.110545+0000, chain.objs.size()=1 2024-09-19T15:31:39.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.oNDgGaTZuUw59wvxHuIKxvm7cC-VNwL_0 2024-09-19T15:31:39.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6788362805707818025', time=2024-09-19T16:49:54.822138+0000, chain.objs.size()=1 2024-09-19T15:31:39.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.T78Z5XJ9f4GhbCwe2gA6xIKQi2eBMO3_0 2024-09-19T15:31:39.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1794303076550427966', time=2024-09-19T16:49:55.170287+0000, chain.objs.size()=1 2024-09-19T15:31:39.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.OAh5NeBaMJI8qEs3oWx7P3doIWUAKwf_0 2024-09-19T15:31:39.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9183173875675422580', time=2024-09-19T16:49:55.207704+0000, chain.objs.size()=1 2024-09-19T15:31:39.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.MDX273xv5NwYo5MJm32U5JoYCXED551_0 2024-09-19T15:31:39.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6882128503807775119', time=2024-09-19T16:49:56.113472+0000, chain.objs.size()=1 2024-09-19T15:31:39.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.lVi8bgsqFU3JDuN7iuRet66SZ7T0k1b_0 2024-09-19T15:31:39.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4434591508789766815', time=2024-09-19T16:49:56.498305+0000, chain.objs.size()=1 2024-09-19T15:31:39.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.s3sIcghqOLjbu_hkyPQCDWmgTO-mfrL_0 2024-09-19T15:31:39.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15819598312031124749', time=2024-09-19T16:49:57.104131+0000, chain.objs.size()=1 2024-09-19T15:31:39.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.gsYP9HlyzAZ9eGXS_0R4vMEcbqLP0X9_0 2024-09-19T15:31:39.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4491901123232336249', time=2024-09-19T16:50:00.092828+0000, chain.objs.size()=1 2024-09-19T15:31:39.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.PybMpNaEGBABqo5NeeSESNTzkIDP-2i_0 2024-09-19T15:31:39.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.868241204270019299', time=2024-09-19T16:50:00.100456+0000, chain.objs.size()=1 2024-09-19T15:31:39.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.sIS7CLX6HWbWavOLb-zesfqipCxT7Mu_0 2024-09-19T15:31:39.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2267776468795274628', time=2024-09-19T16:50:02.826483+0000, chain.objs.size()=1 2024-09-19T15:31:39.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.f-qFzGoRQW4MWCIEg-QtA1F7N0wxyxq_0 2024-09-19T15:31:39.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5748687694687044205', time=2024-09-19T16:50:03.929266+0000, chain.objs.size()=1 2024-09-19T15:31:39.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ZqNlJlasB-NN0kU7cQ2M-tSyXbhHU2a_0 2024-09-19T15:31:39.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4857704522895889951', time=2024-09-19T16:50:06.416299+0000, chain.objs.size()=1 2024-09-19T15:31:39.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.kU7cAXqhJ68iO9ClWKaQ57nItHiEFPL_0 2024-09-19T15:31:39.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6883285890586984881', time=2024-09-19T16:50:24.640351+0000, chain.objs.size()=1 2024-09-19T15:31:39.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.333__shadow_.naV1w_SMvt-QEdLU6meNU1MhctbotyM_0 2024-09-19T15:31:39.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8745063482914801189', time=2024-09-19T16:50:26.561532+0000, chain.objs.size()=1 2024-09-19T15:31:39.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.334__shadow_._D9cE6kEsT4pr3vmQsKyZFvJpADEQjX_0 2024-09-19T15:31:39.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14388545261400483136', time=2024-09-19T16:50:32.713378+0000, chain.objs.size()=1 2024-09-19T15:31:39.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.337__shadow_.eqaXVoVURX-LQfUzKSWTUoBOApNKWy4_0 2024-09-19T15:31:39.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3653757648918068424', time=2024-09-19T16:50:38.124322+0000, chain.objs.size()=1 2024-09-19T15:31:39.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.340__shadow_.9aqJNH5DvTPPHYTEomw4pqIc5ixar2M_0 2024-09-19T15:31:39.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14299699205516092207', time=2024-09-19T16:51:52.220740+0000, chain.objs.size()=1 2024-09-19T15:31:39.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.378__shadow_.4mdgX_f2LEKF5jlJVyUI9Y-LRkOosEH_0 2024-09-19T15:31:39.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13596237910055310379', time=2024-09-19T16:55:27.082664+0000, chain.objs.size()=1 2024-09-19T15:31:39.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.481__shadow_.eBwJMRXbCXjKBscS5U6ZoS00xKGhBoP_0 2024-09-19T15:31:39.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3502242708672788742', time=2024-09-19T16:55:32.875821+0000, chain.objs.size()=1 2024-09-19T15:31:39.422 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.483__shadow_.Sd72efMTmy6GTzEX4aUDlsukWOp0Sqf_0 2024-09-19T15:31:39.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.420+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9343142490109482709', time=2024-09-19T16:57:49.098634+0000, chain.objs.size()=1 2024-09-19T15:31:39.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.420+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.518__multipart_mymultipart.2~n2jyv4TpmDLAVpSXoOfrXabgan5Mkih.1 2024-09-19T15:31:39.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.420+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8008987395839693929', time=2024-09-19T17:02:37.219399+0000, chain.objs.size()=6 2024-09-19T15:31:39.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.420+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.AMRKw0urK7pY-u_lGjrRKeBFvP7OZ3wo.1 2024-09-19T15:31:39.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.420+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.wrGlokGBJqRzFBqgoGWPjdWGt7aV0MDn.2 2024-09-19T15:31:39.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.424+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.--OyYoyfThLjXbsUDCBTuy4OjpnBufJ9.3 2024-09-19T15:31:39.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.424+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.hVhi0ZTzZBun3WzVVuFxX70ah0kU-fki.4 2024-09-19T15:31:39.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.424+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.gKKrbnn63-2vDXkLnKBar3GaIHgKkaCP.5 2024-09-19T15:31:39.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.424+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.FvszY2wYzDycp_vQ4U-ke38E7f-V-zNF.6 2024-09-19T15:31:39.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.424+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10827506219426411317', time=2024-09-19T17:06:42.282500+0000, chain.objs.size()=1 2024-09-19T15:31:39.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.424+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.556__shadow_.JI0g6Qt_-ZLXUy6dM08nxpyN0qSEu_7_0 2024-09-19T15:31:39.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.424+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14090074563026919822', time=2024-09-19T17:07:44.288685+0000, chain.objs.size()=1 2024-09-19T15:31:39.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.424+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:gS9jOHGcHTpnSjDlyN6S2IJ9DQPFRwz_.o0MuD135SQMa3MKYjw-XQJzW8nc-RR5_0 2024-09-19T15:31:39.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.424+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13890679021398625586', time=2024-09-19T17:08:10.063816+0000, chain.objs.size()=1 2024-09-19T15:31:39.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.424+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.571__shadow_.iZxmkGNqwNfjwK_0SbjXe-i9aN-1649_0 2024-09-19T15:31:39.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.424+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9499055655165305638', time=2024-09-19T17:10:19.369531+0000, chain.objs.size()=4 2024-09-19T15:31:39.429 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.424+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.578__multipart_testobj.2~uhYVOOF878GR9t4tKCT75X6KcY1fg2c.1 2024-09-19T15:31:39.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.424+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.578__multipart_testobj.2~uhYVOOF878GR9t4tKCT75X6KcY1fg2c.2 2024-09-19T15:31:39.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.424+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.578__multipart_testobj.2~uhYVOOF878GR9t4tKCT75X6KcY1fg2c.3 2024-09-19T15:31:39.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.424+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.578__multipart_testobj.2~uhYVOOF878GR9t4tKCT75X6KcY1fg2c.4 2024-09-19T15:31:39.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.424+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10777115793461315802', time=2024-09-19T17:10:30.153661+0000, chain.objs.size()=1 2024-09-19T15:31:39.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.424+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.579__shadow:bxm942KgzQICXyw7ywK5FzKWdZGnN9f_.14i8kgJlslE5F9r3Qiyadih0dJjmZ4t_0 2024-09-19T15:31:39.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.424+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2295643467622834733', time=2024-09-19T17:10:56.044260+0000, chain.objs.size()=1 2024-09-19T15:31:39.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.424+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.587__shadow:Ry8hUn.Z4oRhqVS0fxlA0.iBx8IanBU_.tluTLJQ_YwI7CDQaRZTjCqByAqtH3BC_0 2024-09-19T15:31:39.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.424+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16871366646648617839', time=2024-09-19T17:14:20.334204+0000, chain.objs.size()=1 2024-09-19T15:31:39.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.424+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.616__shadow_.NEBk4zARxHtsvfNRzE3JnhUoqAfmRwA_0 2024-09-19T15:31:39.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.428+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15933751226225364226', time=2024-09-19T17:20:40.636843+0000, chain.objs.size()=1 2024-09-19T15:31:39.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.428+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.664__shadow_.TyV9E1z4mQWzLROKrc1q2KvzX54NmG2_0 2024-09-19T15:31:39.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.428+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7150380331725033229', time=2024-09-19T17:20:43.618502+0000, chain.objs.size()=1 2024-09-19T15:31:39.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.428+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.665__shadow_.HX4Mt8fjHbE_59hJ87aSAjCOrYFZB7r_0 2024-09-19T15:31:39.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.428+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13216263169934055743', time=2024-09-19T17:21:54.362160+0000, chain.objs.size()=1 2024-09-19T15:31:39.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.428+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.702__multipart_file1.2~q40lZO1hpOzp1XsNmbd8eVcN7eg1coI.1 2024-09-19T15:31:39.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.428+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5378165678177862828', time=2024-09-19T17:22:09.443361+0000, chain.objs.size()=1 2024-09-19T15:31:39.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.428+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.709__shadow_.-svldC0kLb-PbAFySjsVyDblPO1w23E_0 2024-09-19T15:31:39.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.428+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1414639863582404581', time=2024-09-19T17:26:05.187533+0000, chain.objs.size()=1 2024-09-19T15:31:39.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.428+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.753__shadow_.PzkH3k-Jr7hnD0Icn7TxAXcO2svDvPC_0 2024-09-19T15:31:39.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.428+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9808047928928959336', time=2024-09-19T17:27:35.377401+0000, chain.objs.size()=1 2024-09-19T15:31:39.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.428+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.766__shadow_.Xoh4CIJ8bstqEaAmW2P-RBgkOr684hY_0 2024-09-19T15:31:39.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.436+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:39.446 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.440+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T15:31:39.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:39.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:39.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46964' 2024-09-19T15:31:39.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16520450173248780051', time=2024-09-19T16:35:44.136440+0000, chain.objs.size()=1 2024-09-19T15:31:39.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.197__shadow_.J2V_aY3PlikuBxJNhVEa3GAHxw3fglW_0 2024-09-19T15:31:39.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.154850850269184736', time=2024-09-19T16:39:58.934738+0000, chain.objs.size()=1 2024-09-19T15:31:39.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.243__shadow_.VWHhdE4mn8ZJbtMZDBWbRyTdOYVFCX-_0 2024-09-19T15:31:39.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6843195813105313502', time=2024-09-19T16:40:14.372508+0000, chain.objs.size()=1 2024-09-19T15:31:39.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.249__shadow_.G93SGgcmAw_UcdY3N5-ZNsyfTZDSYCg_0 2024-09-19T15:31:39.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13782407769492934007', time=2024-09-19T16:40:32.717705+0000, chain.objs.size()=1 2024-09-19T15:31:39.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.257__shadow_.BslRPPJs2tmh62tgx44RFA0SHDQ5sgr_0 2024-09-19T15:31:39.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12639282487101243886', time=2024-09-19T16:40:41.814714+0000, chain.objs.size()=1 2024-09-19T15:31:39.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.261__shadow_.kvFyniEi2_91010G_MNB7WELJ_R_4Ll_0 2024-09-19T15:31:39.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10111575464732045979', time=2024-09-19T16:42:28.558291+0000, chain.objs.size()=1 2024-09-19T15:31:39.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Uzw31ikWaawOoLlZAcJ2zVb8iH8x15X_0 2024-09-19T15:31:39.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14557226261550363461', time=2024-09-19T16:42:29.041704+0000, chain.objs.size()=1 2024-09-19T15:31:39.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Gww_rOHc4Wq_eBwStmXQUeeWgGXy7oF_0 2024-09-19T15:31:39.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4470934228045741058', time=2024-09-19T16:42:29.687699+0000, chain.objs.size()=1 2024-09-19T15:31:39.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ivQfRKWHXK-nVLNEegwHNQnVHiwzyPb_0 2024-09-19T15:31:39.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2074377815739851265', time=2024-09-19T16:42:30.443522+0000, chain.objs.size()=1 2024-09-19T15:31:39.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.nfp48uD8vtEHGz4YV5xsCqCdCPmFR5r_0 2024-09-19T15:31:39.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2897114943560818355', time=2024-09-19T16:42:30.858660+0000, chain.objs.size()=1 2024-09-19T15:31:39.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.GZz9EHcPHtjw5UwexgrCIeyo63RGmnN_0 2024-09-19T15:31:39.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3747426707350140065', time=2024-09-19T16:42:31.202195+0000, chain.objs.size()=1 2024-09-19T15:31:39.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.nvPqBIC9K-RLwqQPP-Z3bVW4kKp63hb_0 2024-09-19T15:31:39.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7238068354432561237', time=2024-09-19T16:42:33.012713+0000, chain.objs.size()=1 2024-09-19T15:31:39.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.QfsoQVr6eqij23s0k-cJI0KrQ6JYyMR_0 2024-09-19T15:31:39.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1345787230191711260', time=2024-09-19T16:42:33.591237+0000, chain.objs.size()=1 2024-09-19T15:31:39.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.V7CWXXqsgUxYs3PHHa7QNzQnBt6aUhC_0 2024-09-19T15:31:39.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.448+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6333688784902208334', time=2024-09-19T16:42:33.593867+0000, chain.objs.size()=1 2024-09-19T15:31:39.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.448+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.PYGoLjnUbu6IQBFoqxU5D40CmwTR0yj_0 2024-09-19T15:31:39.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.448+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3856424971911723422', time=2024-09-19T16:42:34.540402+0000, chain.objs.size()=1 2024-09-19T15:31:39.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.448+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.fxqE5DNv3s2tP8zBuYVMranV1NsOfco_0 2024-09-19T15:31:39.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.448+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8848627723067296297', time=2024-09-19T16:42:35.578361+0000, chain.objs.size()=1 2024-09-19T15:31:39.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.448+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.fLT0nnIX6E5RNPV2I85ifrCA4qVfBVC_0 2024-09-19T15:31:39.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.448+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15796316819381130374', time=2024-09-19T16:42:38.816574+0000, chain.objs.size()=1 2024-09-19T15:31:39.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.448+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.H7keGEY6xSSQzsXqquCYfuwRZlYKfW7_0 2024-09-19T15:31:39.453 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.448+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2124617474288143462', time=2024-09-19T16:42:39.128232+0000, chain.objs.size()=1 2024-09-19T15:31:39.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.448+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.-zvoPNcJWe6Dj_kC6lju4dYLFIl09dA_0 2024-09-19T15:31:39.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.448+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6431380809620631484', time=2024-09-19T16:42:39.845438+0000, chain.objs.size()=1 2024-09-19T15:31:39.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.448+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.YlblICbcRfMRgkQZEic_GSzqUbZdCNO_0 2024-09-19T15:31:39.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.448+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11550054627764627132', time=2024-09-19T16:42:41.942346+0000, chain.objs.size()=1 2024-09-19T15:31:39.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.448+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Nsxf6lIu_CxjmACtugvve6mLq9DFSqb_0 2024-09-19T15:31:39.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.448+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5259941176139498663', time=2024-09-19T16:42:43.497289+0000, chain.objs.size()=1 2024-09-19T15:31:39.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.448+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.9IvoxT4i9VqrBzAj_vUhNjOlYZFC2iM_0 2024-09-19T15:31:39.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.448+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8894577601282904035', time=2024-09-19T16:42:45.985467+0000, chain.objs.size()=1 2024-09-19T15:31:39.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.448+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.hn3PntvYt1dFtg-EPxpnbi-bgd6bf3Y_0 2024-09-19T15:31:39.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.448+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5857204839689621995', time=2024-09-19T16:42:46.468041+0000, chain.objs.size()=1 2024-09-19T15:31:39.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.448+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.4PGw4zanT6P-Qk7MIrDbF0o_j_R0Cuz_0 2024-09-19T15:31:39.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.452+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8246000655660481621', time=2024-09-19T16:42:47.590973+0000, chain.objs.size()=1 2024-09-19T15:31:39.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.452+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Kxixf9uomcZWJxp-u9_N97qWt97Mefn_0 2024-09-19T15:31:39.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.452+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10475606034051499236', time=2024-09-19T16:42:47.780462+0000, chain.objs.size()=1 2024-09-19T15:31:39.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.452+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.RxUi1VnW5vYh2AqdtIx662fNGaTXPUT_0 2024-09-19T15:31:39.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.452+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4915682737982029564', time=2024-09-19T16:42:48.160711+0000, chain.objs.size()=1 2024-09-19T15:31:39.457 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.452+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.xsjIx3XLycvkzXHuJzLVUrEEEQ2vJRH_0 2024-09-19T15:31:39.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.452+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11459312790692716956', time=2024-09-19T16:42:49.429530+0000, chain.objs.size()=1 2024-09-19T15:31:39.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.452+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.t8B8_svLOBi88Gqa5fLdnccCT5fIZ_N_0 2024-09-19T15:31:39.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.452+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8692481146187219992', time=2024-09-19T16:42:50.873459+0000, chain.objs.size()=1 2024-09-19T15:31:39.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.452+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.91qI2mLJbM_Hw3sW4xycQ--bRv-PEK8_0 2024-09-19T15:31:39.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.452+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14399683424973172039', time=2024-09-19T16:42:51.711147+0000, chain.objs.size()=1 2024-09-19T15:31:39.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.452+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.1CqvFCwtWXvGoADk3PCEw88FkzmHV8e_0 2024-09-19T15:31:39.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.452+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12379682811807117035', time=2024-09-19T16:42:52.543470+0000, chain.objs.size()=1 2024-09-19T15:31:39.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.452+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.9r92UOWZcEpOk2p6Ud_qUm7sA6PHeWO_0 2024-09-19T15:31:39.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.452+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9794806168402397117', time=2024-09-19T16:42:55.072411+0000, chain.objs.size()=1 2024-09-19T15:31:39.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.452+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.EmWjMeNRXR4lYARW5VatbCXUjT22KUl_0 2024-09-19T15:31:39.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.452+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14480975671636186689', time=2024-09-19T16:42:55.358072+0000, chain.objs.size()=1 2024-09-19T15:31:39.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.452+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.T4huXhPIROnKVbb_Aeo5YBWW8QzD6Zy_0 2024-09-19T15:31:39.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.452+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8811069387557329197', time=2024-09-19T16:42:55.448613+0000, chain.objs.size()=1 2024-09-19T15:31:39.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.452+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.rW7vTap7RqmBG5MxXORExto7bReCrbB_0 2024-09-19T15:31:39.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.452+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5576702962660046578', time=2024-09-19T16:42:55.634240+0000, chain.objs.size()=1 2024-09-19T15:31:39.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.452+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.nNJpTI1HAhn8L1KSbl2U8DaAEjPRAZ-_0 2024-09-19T15:31:39.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.456+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12353156995732570762', time=2024-09-19T16:42:55.906427+0000, chain.objs.size()=1 2024-09-19T15:31:39.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.456+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.3Fc-d59qUgWdmY0akLfCX993t-v-6xB_0 2024-09-19T15:31:39.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.456+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5050203779139041513', time=2024-09-19T16:42:55.941918+0000, chain.objs.size()=1 2024-09-19T15:31:39.460 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.456+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.vTp9tEbsnXMzQdAEwyDC3iLR6qyO1Eu_0 2024-09-19T15:31:39.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.456+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2078621244422741366', time=2024-09-19T16:42:59.461456+0000, chain.objs.size()=1 2024-09-19T15:31:39.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.456+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.tFzJw6-52q05MnupZuCFlvnCsN1X9J4_0 2024-09-19T15:31:39.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.456+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9811986912915112180', time=2024-09-19T16:43:35.821688+0000, chain.objs.size()=1 2024-09-19T15:31:39.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.456+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.278__shadow_.GaGCdD9mvDhycbRxBKCYbT9MK1bGo7d_0 2024-09-19T15:31:39.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.456+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15929281384422213882', time=2024-09-19T16:43:38.172265+0000, chain.objs.size()=1 2024-09-19T15:31:39.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.456+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.279__shadow_.3g5jOWBNy08TycUGS0zAnyRvmBY_cuA_0 2024-09-19T15:31:39.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.456+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.896723887182487210', time=2024-09-19T16:43:47.536506+0000, chain.objs.size()=1 2024-09-19T15:31:39.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.456+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.283__shadow_.3CBEXzhVMOPxVHksuJcQoTx_a6-r7Cl_0 2024-09-19T15:31:39.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15421676818280537244', time=2024-09-19T16:44:12.444119+0000, chain.objs.size()=1 2024-09-19T15:31:39.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_.Fqcot7i_4tllPVsBFJoAgN29whvEaeg_0 2024-09-19T15:31:39.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10076088567356651714', time=2024-09-19T16:44:18.176407+0000, chain.objs.size()=1 2024-09-19T15:31:39.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.l1k0a-YOfp9hlveSF55NlmJWbYYXJNU_0 2024-09-19T15:31:39.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16045504976535865832', time=2024-09-19T16:44:18.567310+0000, chain.objs.size()=1 2024-09-19T15:31:39.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.zMYYGBOWhhaoKGEOXBDCqxbJHb7tmu1_0 2024-09-19T15:31:39.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.393586901525983907', time=2024-09-19T16:44:18.598775+0000, chain.objs.size()=1 2024-09-19T15:31:39.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.Fpdvc_uHmAvI8nlN6XL8dnPfZOmN5dp_0 2024-09-19T15:31:39.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16714860513767678938', time=2024-09-19T16:44:20.920501+0000, chain.objs.size()=1 2024-09-19T15:31:39.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.294__shadow_.0hqLvop1XNa7tgjkvUnZX6U1NMpBL-__0 2024-09-19T15:31:39.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16683543450234650464', time=2024-09-19T16:44:20.943375+0000, chain.objs.size()=1 2024-09-19T15:31:39.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.294__shadow_.evFqFc9N_i40EnSYTwSUmOjIN07jzC8_0 2024-09-19T15:31:39.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13941410096770595485', time=2024-09-19T16:44:37.831520+0000, chain.objs.size()=1 2024-09-19T15:31:39.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.301__shadow_.WNjimh_sQ9Jn5KvpKa-cIYQ8NyY27-a_0 2024-09-19T15:31:39.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2504717405095806186', time=2024-09-19T16:47:18.404357+0000, chain.objs.size()=1 2024-09-19T15:31:39.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.3HtFyujxHfMzKBwtoLRe3cqVW_Viz_d_0 2024-09-19T15:31:39.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16328727755967064386', time=2024-09-19T16:47:20.436502+0000, chain.objs.size()=1 2024-09-19T15:31:39.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.kmOtVNYLk1W4d-ghdn3AMkiBscen7hX_0 2024-09-19T15:31:39.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17973921743472327571', time=2024-09-19T16:47:21.115306+0000, chain.objs.size()=1 2024-09-19T15:31:39.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.8P9EUcMol9EjdtxVIb4tfqSKiMUz_Ku_0 2024-09-19T15:31:39.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18055990633674203283', time=2024-09-19T16:47:22.873495+0000, chain.objs.size()=1 2024-09-19T15:31:39.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Jryln8yMRkvV22VvoMVgbqThYDSjTT1_0 2024-09-19T15:31:39.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15927915632116534083', time=2024-09-19T16:47:23.823030+0000, chain.objs.size()=1 2024-09-19T15:31:39.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.IYeW11nYPZ61eMK82OyWEPd_A8VjekE_0 2024-09-19T15:31:39.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13592398327422642352', time=2024-09-19T16:47:23.825123+0000, chain.objs.size()=1 2024-09-19T15:31:39.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.7NwVqlFUVWKLrBgVfiSSHXnmlIYGRHh_0 2024-09-19T15:31:39.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4279341717361411463', time=2024-09-19T16:47:25.199128+0000, chain.objs.size()=1 2024-09-19T15:31:39.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.4dquDDTQmqrUjrEsBLyQoDEZpDuKuWI_0 2024-09-19T15:31:39.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18337774821879340378', time=2024-09-19T16:47:25.631024+0000, chain.objs.size()=1 2024-09-19T15:31:39.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.i0UZcYMFMjVEp2nuw5XU8S4xxryoAo3_0 2024-09-19T15:31:39.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1059072958623805514', time=2024-09-19T16:47:25.699571+0000, chain.objs.size()=1 2024-09-19T15:31:39.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ui1JAltKD-DDyNLUqsc1L_ydhDb4EdQ_0 2024-09-19T15:31:39.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16548554230356362726', time=2024-09-19T16:47:28.286091+0000, chain.objs.size()=1 2024-09-19T15:31:39.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.1_wZwtiNJGR81z13dXJCd61vTSEvmQh_0 2024-09-19T15:31:39.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14755985442959388407', time=2024-09-19T16:47:30.995888+0000, chain.objs.size()=1 2024-09-19T15:31:39.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.TgP7oxcIqhYbw_EhMTBXXDjU-j6mgZM_0 2024-09-19T15:31:39.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3371059903282672446', time=2024-09-19T16:47:33.086539+0000, chain.objs.size()=1 2024-09-19T15:31:39.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.27bjamHvBi0qLZSMECUmeMQIyqOAnWr_0 2024-09-19T15:31:39.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.468+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2182913038401242409', time=2024-09-19T16:47:35.499689+0000, chain.objs.size()=1 2024-09-19T15:31:39.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Qqo19mnXKt8EnRHHr7dS6e3f2Bbyz6B_0 2024-09-19T15:31:39.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.468+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1745480435438646390', time=2024-09-19T16:47:35.894130+0000, chain.objs.size()=1 2024-09-19T15:31:39.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.iYPHTtoyffu2LYg4dDkfW4zsQ789FtM_0 2024-09-19T15:31:39.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.468+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9233490648817481555', time=2024-09-19T16:47:36.922529+0000, chain.objs.size()=1 2024-09-19T15:31:39.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.OP0TrUOnF_Bi8a8C32A08SPu7o_vTx__0 2024-09-19T15:31:39.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.468+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17460087360121145415', time=2024-09-19T16:47:37.059162+0000, chain.objs.size()=1 2024-09-19T15:31:39.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.RJQ1_rw1VA1U9X9UtT0rr66EIUSY8UG_0 2024-09-19T15:31:39.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.468+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10122512407512271976', time=2024-09-19T16:47:37.595022+0000, chain.objs.size()=1 2024-09-19T15:31:39.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.jOzZkQrvHBAAtpDXGMEJ6d50zeqBRAh_0 2024-09-19T15:31:39.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.468+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4234056009495939365', time=2024-09-19T16:47:38.431040+0000, chain.objs.size()=1 2024-09-19T15:31:39.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.x26vbvkO5eGWjPBguDnjC3CGoPvocgt_0 2024-09-19T15:31:39.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.472+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3150598455959397454', time=2024-09-19T16:47:40.618437+0000, chain.objs.size()=1 2024-09-19T15:31:39.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.0dk0yogH1YjoGf496B7dEr2x103OFMp_0 2024-09-19T15:31:39.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.472+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9677301551465938030', time=2024-09-19T16:47:41.348355+0000, chain.objs.size()=1 2024-09-19T15:31:39.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Y0prUGi2RXLu8X1kKs63-GZWNlZoLwJ_0 2024-09-19T15:31:39.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.472+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2758635086250986913', time=2024-09-19T16:47:43.980044+0000, chain.objs.size()=1 2024-09-19T15:31:39.476 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.xDJ2F53VqcCq6NZKJ0K66i5jxyJCqQ5_0 2024-09-19T15:31:39.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.472+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18268171508230262765', time=2024-09-19T16:47:45.998606+0000, chain.objs.size()=1 2024-09-19T15:31:39.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.lo_OFrI5YKLBRxymDwmLxrQMrT6au6d_0 2024-09-19T15:31:39.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.472+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6293356505876929450', time=2024-09-19T16:47:46.135553+0000, chain.objs.size()=1 2024-09-19T15:31:39.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.scUyOxzQQxe_UsuorvrfulYyZ-RjPvn_0 2024-09-19T15:31:39.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.472+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12072056240956632717', time=2024-09-19T16:47:46.241576+0000, chain.objs.size()=1 2024-09-19T15:31:39.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.06liaYqq-dPcBrjZI0ywnwKCqlQLxUH_0 2024-09-19T15:31:39.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.472+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12296012953574944434', time=2024-09-19T16:47:46.363117+0000, chain.objs.size()=1 2024-09-19T15:31:39.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Kf7qPN_vkkrsW3gBB6p_oRLSorlt2VP_0 2024-09-19T15:31:39.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.472+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6072987916473242178', time=2024-09-19T16:47:46.523973+0000, chain.objs.size()=1 2024-09-19T15:31:39.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.JIGROh7UMEzXg8N1cd6RKKdV_c37oC5_0 2024-09-19T15:31:39.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.472+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.313597384472854865', time=2024-09-19T16:47:47.566872+0000, chain.objs.size()=1 2024-09-19T15:31:39.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.mI57unImCWMat4fj0d9RzB1AAqeMON-_0 2024-09-19T15:31:39.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.472+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.711545606014097214', time=2024-09-19T16:47:48.350120+0000, chain.objs.size()=1 2024-09-19T15:31:39.479 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.gPxhGaOxq_jA74eC_iSAJewEjU8GlVa_0 2024-09-19T15:31:39.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.476+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.694522279727105216', time=2024-09-19T16:47:48.434703+0000, chain.objs.size()=1 2024-09-19T15:31:39.480 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.476+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.m0-IrtG4btm89jtySczB7-6dRw0CZyk_0 2024-09-19T15:31:39.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.480+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13491616513412265184', time=2024-09-19T16:47:50.011473+0000, chain.objs.size()=1 2024-09-19T15:31:39.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.480+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.elmHTkIwADoos9v1Tm0Y9ECbsRkynr0_0 2024-09-19T15:31:39.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.480+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18384458376444779166', time=2024-09-19T16:49:36.015222+0000, chain.objs.size()=1 2024-09-19T15:31:39.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.480+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.27skGk0j7utEweDTqfuJYDaNAQLGChT_0 2024-09-19T15:31:39.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.484+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10225443759953713489', time=2024-09-19T16:49:37.163198+0000, chain.objs.size()=1 2024-09-19T15:31:39.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.V-9jMBSHLqAtazgf_q6Q4qVkSxItOqb_0 2024-09-19T15:31:39.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.484+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8552091609066937487', time=2024-09-19T16:49:37.466935+0000, chain.objs.size()=1 2024-09-19T15:31:39.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Cb3dlm5xetVc_RiPi6soSmqYaQcBmNc_0 2024-09-19T15:31:39.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.484+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1135347104470468049', time=2024-09-19T16:49:37.600667+0000, chain.objs.size()=1 2024-09-19T15:31:39.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.36v00H-oL6WXPgzWvhK6vDRMJ-VFjS-_0 2024-09-19T15:31:39.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.484+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14053229622872488834', time=2024-09-19T16:49:40.268385+0000, chain.objs.size()=1 2024-09-19T15:31:39.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.D_u65Un8NTCbJcLYBd_PwIDZGteSQhw_0 2024-09-19T15:31:39.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.484+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7391217349247633985', time=2024-09-19T16:49:40.551599+0000, chain.objs.size()=1 2024-09-19T15:31:39.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Rrdne1Oq08lH9nAAg9B9v-QSirtMynH_0 2024-09-19T15:31:39.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.484+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8073525735180048602', time=2024-09-19T16:49:40.844248+0000, chain.objs.size()=1 2024-09-19T15:31:39.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.WX2pU2S_OiJsnzY4zYo-Oh-THlC-3Cz_0 2024-09-19T15:31:39.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.484+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.365438751939100236', time=2024-09-19T16:49:41.344248+0000, chain.objs.size()=1 2024-09-19T15:31:39.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.nYGX83INelsvIzraOuOf_3BcE1FqnAm_0 2024-09-19T15:31:39.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.484+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8370770696129967264', time=2024-09-19T16:49:42.165915+0000, chain.objs.size()=1 2024-09-19T15:31:39.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.sbb02j_qpVCx6zOjSTU6Zj-huevxhmL_0 2024-09-19T15:31:39.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.484+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.310254851557569565', time=2024-09-19T16:49:42.294764+0000, chain.objs.size()=1 2024-09-19T15:31:39.489 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.BNIFtYVAMiiT_M2G3BVYO37U95jW3UT_0 2024-09-19T15:31:39.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.484+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1748177816267807818', time=2024-09-19T16:49:44.526924+0000, chain.objs.size()=1 2024-09-19T15:31:39.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.qB8nndKOtmuLgTUPkIqyuIloLxEqDA4_0 2024-09-19T15:31:39.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.484+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2486365828303545128', time=2024-09-19T16:49:47.823833+0000, chain.objs.size()=1 2024-09-19T15:31:39.491 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.s5pyfljrnQ4ojyG2yGCLqu_cwwuFVyw_0 2024-09-19T15:31:39.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.488+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8869583453399036341', time=2024-09-19T16:49:48.295669+0000, chain.objs.size()=1 2024-09-19T15:31:39.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.488+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.FIgNkDyJ_-alTJUK8gyOHUbWUWtwdN2_0 2024-09-19T15:31:39.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.488+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5247352945098327469', time=2024-09-19T16:49:48.299002+0000, chain.objs.size()=1 2024-09-19T15:31:39.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.488+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.tEwK3CN8hAkZO3FhvFaEx5kDlI5M65j_0 2024-09-19T15:31:39.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.488+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8042956023279719076', time=2024-09-19T16:49:48.706717+0000, chain.objs.size()=1 2024-09-19T15:31:39.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.488+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.7nWClPFnWULxfb7TYNc7huL5oS5Tbit_0 2024-09-19T15:31:39.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.488+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7819674873501462970', time=2024-09-19T16:49:50.377047+0000, chain.objs.size()=1 2024-09-19T15:31:39.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.488+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ShCjxRrito6Tcc6xlN8tVrKS8qvWK42_0 2024-09-19T15:31:39.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.488+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13555056036900765217', time=2024-09-19T16:49:50.494687+0000, chain.objs.size()=1 2024-09-19T15:31:39.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.488+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.HD2c9gHZfqLuUjO4H24P5HQKfNeBHJI_0 2024-09-19T15:31:39.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.488+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15277949354633441124', time=2024-09-19T16:49:50.913911+0000, chain.objs.size()=1 2024-09-19T15:31:39.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.488+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.QtIxoqNiLtdKOJt955JOXMg_QdDHSah_0 2024-09-19T15:31:39.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.488+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3752648992509563420', time=2024-09-19T16:49:51.060082+0000, chain.objs.size()=1 2024-09-19T15:31:39.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.488+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.lWOnGMN3XX4V-N7VPLHlZQsjOpwmUL8_0 2024-09-19T15:31:39.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.488+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16775995734909968275', time=2024-09-19T16:49:54.297291+0000, chain.objs.size()=1 2024-09-19T15:31:39.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.488+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.w1q_rMcD_NeHS_9KYogjEYbP-uEWex1_0 2024-09-19T15:31:39.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.488+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13095397899473488942', time=2024-09-19T16:49:56.830918+0000, chain.objs.size()=1 2024-09-19T15:31:39.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.488+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.pwkOUEKOCkWMtVRjux7CMp9z0Z149rf_0 2024-09-19T15:31:39.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.492+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3610461086969827007', time=2024-09-19T16:49:57.311179+0000, chain.objs.size()=1 2024-09-19T15:31:39.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.492+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.5XZUl1iQcfSjYTjFy1iV3WfDSpUr0_m_0 2024-09-19T15:31:39.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.492+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.684898965121546996', time=2024-09-19T16:49:57.687108+0000, chain.objs.size()=1 2024-09-19T15:31:39.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.492+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.3wFiQ7JIVIpLtkCIwd5rU1ZppQ2rpVS_0 2024-09-19T15:31:39.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.500+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46964 2024-09-19T15:31:39.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-19T15:31:39.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.439582457076243761', time=2024-09-19T16:49:58.447030+0000, chain.objs.size()=1 2024-09-19T15:31:39.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Fkx8wNZrmbk1PvpGq0bxa3ZJ4-rOi71_0 2024-09-19T15:31:39.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.428328809519177524', time=2024-09-19T16:49:59.063604+0000, chain.objs.size()=1 2024-09-19T15:31:39.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.niFqvHKs7MPHyLpCeMH_Xpoz_6LVBQs_0 2024-09-19T15:31:39.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4053213570397433419', time=2024-09-19T16:49:59.279933+0000, chain.objs.size()=1 2024-09-19T15:31:39.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ogqyttzAomKM33oi5J1pDiHrmrAXMLz_0 2024-09-19T15:31:39.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7097752796555400935', time=2024-09-19T16:50:00.978778+0000, chain.objs.size()=1 2024-09-19T15:31:39.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.sw3z51fwUvRGXBO0k3MCu9N3q9PZk77_0 2024-09-19T15:31:39.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6892078511214763676', time=2024-09-19T16:50:02.306704+0000, chain.objs.size()=1 2024-09-19T15:31:39.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.rHU4RxLVMwvGEQW-gF4HclRKP_pDjeP_0 2024-09-19T15:31:39.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13438901899246764193', time=2024-09-19T16:50:02.439034+0000, chain.objs.size()=1 2024-09-19T15:31:39.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.o4vEUWf6Ro4qOT2Ki07hn17PFpW-39P_0 2024-09-19T15:31:39.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6832987291741276452', time=2024-09-19T16:50:03.974542+0000, chain.objs.size()=1 2024-09-19T15:31:39.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.I5cAxFdRBvXVkMJSSKfXBBvmturqJWW_0 2024-09-19T15:31:39.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2689140955819940726', time=2024-09-19T16:50:04.360785+0000, chain.objs.size()=1 2024-09-19T15:31:39.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.1Kh6bLyEKCfI5-dHa-6hgcLfPKMbyYm_0 2024-09-19T15:31:39.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18314581015967859705', time=2024-09-19T16:50:05.362683+0000, chain.objs.size()=1 2024-09-19T15:31:39.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.DtGXwid6U9CckqZV9Twax4_5hF0m5w1_0 2024-09-19T15:31:39.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16483938913862253462', time=2024-09-19T16:50:05.843466+0000, chain.objs.size()=1 2024-09-19T15:31:39.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.9GoOamEG4Z0H-xRNi2sjj3aOUrlO5xA_0 2024-09-19T15:31:39.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8373108196685697693', time=2024-09-19T16:50:06.095111+0000, chain.objs.size()=1 2024-09-19T15:31:39.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.kdx7qXwjJYQu3fT-MfqbhxHx3f47woI_0 2024-09-19T15:31:39.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18092346106935367893', time=2024-09-19T16:50:28.615089+0000, chain.objs.size()=1 2024-09-19T15:31:39.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.335__shadow_.V2Q5Y6ZDwwjonmk0ZHEVxIOmYiq43GA_0 2024-09-19T15:31:39.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.508+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17997381317597403777', time=2024-09-19T16:55:32.926606+0000, chain.objs.size()=1 2024-09-19T15:31:39.513 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.508+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.483__shadow_.vFMaGMB-AvReNhED-BYOHGJWjFNwQUA_0 2024-09-19T15:31:39.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.508+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6581202138666055051', time=2024-09-19T17:02:47.152241+0000, chain.objs.size()=2 2024-09-19T15:31:39.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.508+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.523__multipart_mymultipart.2~seBQiPIE-dEhvevVeOmXIbLZ8IQ9LZs.1 2024-09-19T15:31:39.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.508+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.523__multipart_mymultipart.2~seBQiPIE-dEhvevVeOmXIbLZ8IQ9LZs.2 2024-09-19T15:31:39.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.508+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15147658464164018377', time=2024-09-19T17:04:58.458728+0000, chain.objs.size()=4 2024-09-19T15:31:39.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.508+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.535__multipart_mymultipart.2~D3ONVC0FHjGk5e-Nxytnn6x8gfyOTeq.1 2024-09-19T15:31:39.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.508+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.535__multipart_mymultipart.2~D3ONVC0FHjGk5e-Nxytnn6x8gfyOTeq.2 2024-09-19T15:31:39.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.508+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.535__multipart_mymultipart._PpI1KW66tuFA772MSf-hAWSQ7hfzf-m.3 2024-09-19T15:31:39.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.508+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.535__multipart_mymultipart.2~D3ONVC0FHjGk5e-Nxytnn6x8gfyOTeq.4 2024-09-19T15:31:39.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.508+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7372736254555552044', time=2024-09-19T17:05:49.930613+0000, chain.objs.size()=1 2024-09-19T15:31:39.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.512+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.550__shadow_.5Vt91s0oY_xQdExneOlO4CBlZpIXOCo_0 2024-09-19T15:31:39.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.512+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6744770034727059800', time=2024-09-19T17:05:57.107824+0000, chain.objs.size()=1 2024-09-19T15:31:39.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.512+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.551__shadow_.vuPDnhmdkQjOG7xS-6CiesT9XfdwIUC_0 2024-09-19T15:31:39.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.512+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17819695706312493150', time=2024-09-19T17:07:15.560612+0000, chain.objs.size()=1 2024-09-19T15:31:39.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.512+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.561__multipart_mymultipart.2~SYvYHH3irLqcAX3pHTBfXAbYakqt_Po.1 2024-09-19T15:31:39.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.512+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11346981182370286686', time=2024-09-19T17:09:08.211766+0000, chain.objs.size()=1 2024-09-19T15:31:39.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.512+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:OIu.MkSHDTIsQsdEv2ApGeuvVQJXEdF_.4C4lQR_M9nRN4YvL5VAqDmCQTg21IcX_0 2024-09-19T15:31:39.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.512+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11149155575243259842', time=2024-09-19T17:09:15.862601+0000, chain.objs.size()=1 2024-09-19T15:31:39.517 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.512+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:bdTdl5NAWNXKPqeh2IRjx-KfiCuHK3p_.irbs9BO6eicgjU4kM4b8wpVRT1jKJ7v_0 2024-09-19T15:31:39.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.512+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16192426473441922302', time=2024-09-19T17:17:59.570834+0000, chain.objs.size()=1 2024-09-19T15:31:39.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.512+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.626__shadow_.cTw5U_vhw03LSuGP9na5o9PqZRl1kur_0 2024-09-19T15:31:39.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.512+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7556121761543151391', time=2024-09-19T17:20:33.073587+0000, chain.objs.size()=6 2024-09-19T15:31:39.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.512+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.660__multipart_bar.2~0Ujs_WqkF0jskB6Fy_2G3NnbmiA4dZS.1 2024-09-19T15:31:39.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.512+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.660__multipart_bar.2~0Ujs_WqkF0jskB6Fy_2G3NnbmiA4dZS.2 2024-09-19T15:31:39.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.660__multipart_bar.2~0Ujs_WqkF0jskB6Fy_2G3NnbmiA4dZS.3 2024-09-19T15:31:39.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.660__multipart_bar.2~0Ujs_WqkF0jskB6Fy_2G3NnbmiA4dZS.4 2024-09-19T15:31:39.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.660__multipart_bar.2~0Ujs_WqkF0jskB6Fy_2G3NnbmiA4dZS.5 2024-09-19T15:31:39.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.660__multipart_bar.2~0Ujs_WqkF0jskB6Fy_2G3NnbmiA4dZS.6 2024-09-19T15:31:39.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4764954444332737824', time=2024-09-19T17:21:41.251254+0000, chain.objs.size()=1 2024-09-19T15:31:39.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.696__shadow:MCpj6cPug1CtzLnRaZUECKzOiihGnFS_.0msi4nrgPcepyWdvrZfh2O1VMAHnpQI_0 2024-09-19T15:31:39.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8955781411442161739', time=2024-09-19T17:22:05.257835+0000, chain.objs.size()=1 2024-09-19T15:31:39.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.707__shadow:VhFqNs8P.fFv0QPZqh755fIelYK3maB_.85L925KOZlyzItnoN4lKwiazRvf5Lzf_0 2024-09-19T15:31:39.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6202811272471508230', time=2024-09-19T17:24:12.579717+0000, chain.objs.size()=3 2024-09-19T15:31:39.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.743__multipart_mymultipart3.2~uevbW-BLCEYwMVFElptLpt6n3-szZaj.1 2024-09-19T15:31:39.522 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.743__multipart_mymultipart3.2~uevbW-BLCEYwMVFElptLpt6n3-szZaj.2 2024-09-19T15:31:39.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.743__multipart_mymultipart3.2~uevbW-BLCEYwMVFElptLpt6n3-szZaj.3 2024-09-19T15:31:39.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.520+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4286783208014094936', time=2024-09-19T17:25:04.935547+0000, chain.objs.size()=1 2024-09-19T15:31:39.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.520+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.746__shadow_.tvApddu8sKbtCBQLDxS4RZvScEXaUFX_0 2024-09-19T15:31:39.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.520+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7863803817362856676', time=2024-09-19T17:25:29.746058+0000, chain.objs.size()=1 2024-09-19T15:31:39.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.520+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.750__shadow_.PoSHzYQHS84-PeyIv9MEfKIKrfY8qve_0 2024-09-19T15:31:39.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.520+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1409838527166810992', time=2024-09-19T17:27:57.312023+0000, chain.objs.size()=1 2024-09-19T15:31:39.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.520+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.770__shadow_.aseraKCXhavwTw30MSKe1X4ui_ni0Pm_0 2024-09-19T15:31:39.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.524+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:39.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.524+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T15:31:39.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:39.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:39.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50661' 2024-09-19T15:31:39.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='_Y4Z3zK5BbYTOsXXIwqQlyNFUEMlO-UK', time=2024-09-19T16:33:16.735963+0000, chain.objs.size()=2 2024-09-19T15:31:39.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.160__shadow_.wtN0TgOEr0MmvjA98gD4B8kbLgHQZeE_0 2024-09-19T15:31:39.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.160__shadow_.wtN0TgOEr0MmvjA98gD4B8kbLgHQZeE_1 2024-09-19T15:31:39.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8200008684288477824', time=2024-09-19T16:39:46.340173+0000, chain.objs.size()=1 2024-09-19T15:31:39.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.238__shadow_.D75CS_a0uKcivqOFatsP6EyVAMqnNVn_0 2024-09-19T15:31:39.534 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17669936525930179403', time=2024-09-19T16:40:19.084859+0000, chain.objs.size()=1 2024-09-19T15:31:39.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.251__shadow_.O6xgLslpbj3eupl8HDDUYb6porm2LfM_0 2024-09-19T15:31:39.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18373389639414218494', time=2024-09-19T16:42:28.563058+0000, chain.objs.size()=1 2024-09-19T15:31:39.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.wcfvsLHpn3feZG0XxuDjFMvFmUOlwy7_0 2024-09-19T15:31:39.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12790412483595288800', time=2024-09-19T16:42:29.075750+0000, chain.objs.size()=1 2024-09-19T15:31:39.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.jN1ouqK7YDIcSb4JvDg6b2IYut9YGVM_0 2024-09-19T15:31:39.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6388451165304805547', time=2024-09-19T16:42:29.420054+0000, chain.objs.size()=1 2024-09-19T15:31:39.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.lHgDh7KB7qVUwDaN7muwzoyQfHrww6R_0 2024-09-19T15:31:39.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1883855561298868669', time=2024-09-19T16:42:29.422467+0000, chain.objs.size()=1 2024-09-19T15:31:39.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.YdciklVtWRM-5mDAk5olwYZmYCYktdz_0 2024-09-19T15:31:39.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9691264517807183922', time=2024-09-19T16:42:30.485742+0000, chain.objs.size()=1 2024-09-19T15:31:39.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.TT8OmkTTvCY5kuNLieIM0YEbwoJPfA1_0 2024-09-19T15:31:39.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11758634854883420273', time=2024-09-19T16:42:34.427231+0000, chain.objs.size()=1 2024-09-19T15:31:39.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.wBNIxCJ8OFkuz5I8qvwRwEYy7wpFuyq_0 2024-09-19T15:31:39.535 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8434279723470645448', time=2024-09-19T16:42:34.773942+0000, chain.objs.size()=1 2024-09-19T15:31:39.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.d5wIRa3HtDSswLs1G2luj7ip06UcQ-D_0 2024-09-19T15:31:39.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18158925761421457976', time=2024-09-19T16:42:35.582055+0000, chain.objs.size()=1 2024-09-19T15:31:39.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.528+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.qNE17RpWWBmrnSg0cFWzuVJd9Mi5uLd_0 2024-09-19T15:31:39.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.532+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2606187355561391280', time=2024-09-19T16:42:38.746170+0000, chain.objs.size()=1 2024-09-19T15:31:39.537 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.532+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.RcwWEWTSrNB-Ykzt-Z1JpCnQHAhKhZP_0 2024-09-19T15:31:39.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.532+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11589935822172219301', time=2024-09-19T16:42:39.427792+0000, chain.objs.size()=1 2024-09-19T15:31:39.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.532+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.pac-QChstzJR5FGrvrLaUYuZMgxrkhe_0 2024-09-19T15:31:39.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.532+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9919745962340207857', time=2024-09-19T16:42:41.601821+0000, chain.objs.size()=1 2024-09-19T15:31:39.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.532+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.VA6UqzLNiqGMaYCctl3B0TAbaodz5Vy_0 2024-09-19T15:31:39.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.532+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7006101104344012848', time=2024-09-19T16:42:42.948694+0000, chain.objs.size()=1 2024-09-19T15:31:39.538 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.532+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.s-8cDmw7tc7KHiQQz62BQxQL1iKiUOs_0 2024-09-19T15:31:39.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.532+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4289387520468624250', time=2024-09-19T16:42:44.251497+0000, chain.objs.size()=1 2024-09-19T15:31:39.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.532+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.uhtPR-cFVq6_xXbYLDOH2zCntdHVQSd_0 2024-09-19T15:31:39.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.532+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4151712320841080061', time=2024-09-19T16:42:45.153270+0000, chain.objs.size()=1 2024-09-19T15:31:39.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.532+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Zq5xFNu9NKmM_IkHvpzlbdNwBeYZL-s_0 2024-09-19T15:31:39.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.532+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2581821658652624477', time=2024-09-19T16:42:46.655027+0000, chain.objs.size()=1 2024-09-19T15:31:39.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.532+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.NO3uZGW_ldyU5TkE56JoJba_hvm_aD5_0 2024-09-19T15:31:39.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.532+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16445557563836126865', time=2024-09-19T16:42:47.289574+0000, chain.objs.size()=1 2024-09-19T15:31:39.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.532+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.9iQZcHovriAJ7XLCFmQbRGLQxC3Bjqo_0 2024-09-19T15:31:39.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.532+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14287486563714165707', time=2024-09-19T16:42:47.634683+0000, chain.objs.size()=1 2024-09-19T15:31:39.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.532+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.7z6w_Q-jsdy8kgdcruxLg86YWNaaie3_0 2024-09-19T15:31:39.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12559347035519519572', time=2024-09-19T16:42:47.681822+0000, chain.objs.size()=1 2024-09-19T15:31:39.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.MANXIQs3fzV08ZeakKbO0DTWq4-RV5L_0 2024-09-19T15:31:39.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11291183000221644018', time=2024-09-19T16:42:49.793491+0000, chain.objs.size()=1 2024-09-19T15:31:39.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.fIGLlM3jWZ8ppFc5h3RgLu9ore8HO6m_0 2024-09-19T15:31:39.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13571022120797172202', time=2024-09-19T16:42:49.797482+0000, chain.objs.size()=1 2024-09-19T15:31:39.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.5tH6_Im1Wb6PrLEYS7kqpWbR6Djmgbu_0 2024-09-19T15:31:39.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10471353390444182118', time=2024-09-19T16:42:49.901648+0000, chain.objs.size()=1 2024-09-19T15:31:39.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.txcPq9Ob27z8mRUIlUvIo5-r8uQKsgY_0 2024-09-19T15:31:39.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2153066821551062648', time=2024-09-19T16:42:51.758922+0000, chain.objs.size()=1 2024-09-19T15:31:39.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.NA6rCuFeEmF41dne7TfcdkTTsJ2AZAL_0 2024-09-19T15:31:39.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7361779640671159761', time=2024-09-19T16:42:51.760629+0000, chain.objs.size()=1 2024-09-19T15:31:39.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.e_sAqoIVn7pYqX76ehxUsOTKQOSqYSS_0 2024-09-19T15:31:39.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3634974864772330425', time=2024-09-19T16:42:51.865221+0000, chain.objs.size()=1 2024-09-19T15:31:39.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ygNjXGXUmlV72Ac9FPtw5FVHC1TGS71_0 2024-09-19T15:31:39.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16231762318699443321', time=2024-09-19T16:42:53.333503+0000, chain.objs.size()=1 2024-09-19T15:31:39.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_._dZ9dHj28tTml5FHnWnURN_RwwL39YQ_0 2024-09-19T15:31:39.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15084812851253333183', time=2024-09-19T16:42:53.965059+0000, chain.objs.size()=1 2024-09-19T15:31:39.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.hSovF2gWhib0IswxlFU5H9TGIWJlxiJ_0 2024-09-19T15:31:39.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2647969367045064981', time=2024-09-19T16:42:54.207476+0000, chain.objs.size()=1 2024-09-19T15:31:39.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.giCmYhrULAezf-74S7s1qIO_48CPS_L_0 2024-09-19T15:31:39.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16156917497614370744', time=2024-09-19T16:42:58.229569+0000, chain.objs.size()=1 2024-09-19T15:31:39.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ma3iICMC1napOSOl_sKLfRWfYWpeWdq_0 2024-09-19T15:31:39.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.540+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.596400870883072916', time=2024-09-19T16:42:58.648002+0000, chain.objs.size()=1 2024-09-19T15:31:39.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.540+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.hs0IYJogxw6r_wPxDeRN7IgvozzsdG4_0 2024-09-19T15:31:39.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.540+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7759790953628210797', time=2024-09-19T16:42:59.817908+0000, chain.objs.size()=1 2024-09-19T15:31:39.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.540+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Kn8vc82tqc_SnQxoA3TFDEJQ5ApPAEB_0 2024-09-19T15:31:39.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.540+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10772483927043970708', time=2024-09-19T16:42:59.994431+0000, chain.objs.size()=1 2024-09-19T15:31:39.545 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.540+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.U147VDVFFTHmh4rQ0kHGq41ju6_7MCH_0 2024-09-19T15:31:39.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.540+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16176406190929065697', time=2024-09-19T16:43:17.808478+0000, chain.objs.size()=1 2024-09-19T15:31:39.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.540+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.270__shadow_.1haLrEZy1ueN3RTyhiwwZ_vLYZk1WVg_0 2024-09-19T15:31:39.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.540+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7236082279440995152', time=2024-09-19T16:43:38.204811+0000, chain.objs.size()=1 2024-09-19T15:31:39.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.540+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.279__shadow_.GiBZUSc47Rm_5g8N7rFL0p_GEYNnt2O_0 2024-09-19T15:31:39.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.540+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17225248579801683210', time=2024-09-19T16:43:45.150224+0000, chain.objs.size()=1 2024-09-19T15:31:39.548 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.540+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.282__shadow_.RlSjDuZ0hctxNF-uetfTzG4kbkmHhqG_0 2024-09-19T15:31:39.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.544+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3020832189113173954', time=2024-09-19T16:44:12.668983+0000, chain.objs.size()=1 2024-09-19T15:31:39.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.544+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_.h1Gs2kndrIUKnSlPbCbQBNHiKOuu3Sq_0 2024-09-19T15:31:39.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.544+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17869828241095671542', time=2024-09-19T16:44:18.198803+0000, chain.objs.size()=1 2024-09-19T15:31:39.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.544+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.sR1C_Gq0-3uV2XB_vKY0l_4ooaaLAUt_0 2024-09-19T15:31:39.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.544+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.371824550696542568', time=2024-09-19T16:44:18.573733+0000, chain.objs.size()=1 2024-09-19T15:31:39.549 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.544+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.EZqGr5GIgsZhvUY18q1n-ZgWhjQYXXI_0 2024-09-19T15:31:39.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.544+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1313476159566436811', time=2024-09-19T16:44:20.941239+0000, chain.objs.size()=1 2024-09-19T15:31:39.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.544+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.294__shadow_.9NCnGIda85XpaW8LcH4K4XsaZG__H_m_0 2024-09-19T15:31:39.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.544+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2305012200344673903', time=2024-09-19T16:44:30.465671+0000, chain.objs.size()=1 2024-09-19T15:31:39.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.544+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.298__shadow_.wzHP0i9jzhZvB7XzvOyhQ4-K8O-Vl0A_0 2024-09-19T15:31:39.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.544+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1878388905620380279', time=2024-09-19T16:44:49.857573+0000, chain.objs.size()=1 2024-09-19T15:31:39.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.544+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.306__shadow_.ktSjd9wNLjSLqaII7-9eb219VAbQWGg_0 2024-09-19T15:31:39.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.544+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.22052542565688841', time=2024-09-19T16:45:05.553641+0000, chain.objs.size()=1 2024-09-19T15:31:39.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.544+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.313__shadow_.UcxSeDCr545TCfdGvb5snEytuSqF9D1_0 2024-09-19T15:31:39.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.544+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16881957083788250927', time=2024-09-19T16:47:18.482996+0000, chain.objs.size()=1 2024-09-19T15:31:39.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.544+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.q1gOHzvTe6zRZ1L2421kajMGDLvop1o_0 2024-09-19T15:31:39.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.544+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13167836630985862723', time=2024-09-19T16:47:20.035080+0000, chain.objs.size()=1 2024-09-19T15:31:39.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.544+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.1QZCp2bmwyHQUgrYZifZ3wg4V5DcyY__0 2024-09-19T15:31:39.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.544+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9351655194790698413', time=2024-09-19T16:47:20.114825+0000, chain.objs.size()=1 2024-09-19T15:31:39.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.544+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.XCehUybHYklZuYVpYibttJ5h0r5chaC_0 2024-09-19T15:31:39.551 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.544+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3718121128034037572', time=2024-09-19T16:47:22.494516+0000, chain.objs.size()=1 2024-09-19T15:31:39.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.544+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.3UW2AR-BjAuCgwXtkXZ0-v5erEJaVq5_0 2024-09-19T15:31:39.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12017621049428087290', time=2024-09-19T16:47:23.002498+0000, chain.objs.size()=1 2024-09-19T15:31:39.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.KhoFHSTj3vdA9iAZ_vTlh3JOXZii0R9_0 2024-09-19T15:31:39.552 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1413763163702420537', time=2024-09-19T16:47:23.675000+0000, chain.objs.size()=1 2024-09-19T15:31:39.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.VuTwJwcZ55cWKuZ5cKSq8y_umWMif06_0 2024-09-19T15:31:39.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3850853297018581973', time=2024-09-19T16:47:23.677866+0000, chain.objs.size()=1 2024-09-19T15:31:39.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.3o7d8vI0-7XETumb-MJ7UkmyNH4NTWu_0 2024-09-19T15:31:39.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10244525980825149155', time=2024-09-19T16:47:24.512846+0000, chain.objs.size()=1 2024-09-19T15:31:39.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.zMtmcgROcHWXE5NV1x6arXl2bks6hjf_0 2024-09-19T15:31:39.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10897883170113732598', time=2024-09-19T16:47:24.828039+0000, chain.objs.size()=1 2024-09-19T15:31:39.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.WMFaWLFPigPXePBgj08jRLlXZZs3o1n_0 2024-09-19T15:31:39.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9519971957388728602', time=2024-09-19T16:47:25.011089+0000, chain.objs.size()=1 2024-09-19T15:31:39.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.7Z7MPAj56w45mSG3IRIrE1D4nglSC1r_0 2024-09-19T15:31:39.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5449072281934444282', time=2024-09-19T16:47:25.202207+0000, chain.objs.size()=1 2024-09-19T15:31:39.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.fg2vlgfTEKTqgFt9Bn0V7SDeVdfIH8l_0 2024-09-19T15:31:39.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9219892377445682287', time=2024-09-19T16:47:25.203927+0000, chain.objs.size()=1 2024-09-19T15:31:39.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ka-1Ry6WgvuH4hYjzIJBNJ8jI6j77SK_0 2024-09-19T15:31:39.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8577834384198773211', time=2024-09-19T16:47:28.418275+0000, chain.objs.size()=1 2024-09-19T15:31:39.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.i8uWcr4-95ol9dTFNFRpU5R0l0cF87r_0 2024-09-19T15:31:39.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18260643176954244072', time=2024-09-19T16:47:29.451865+0000, chain.objs.size()=1 2024-09-19T15:31:39.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.BtCEOUOzfVyMSdfJTgv-C_KS4tijlFc_0 2024-09-19T15:31:39.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9058799048304321145', time=2024-09-19T16:47:29.921487+0000, chain.objs.size()=1 2024-09-19T15:31:39.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.V2uZjAA-lww4TBncPmnzaorKLQnvpqX_0 2024-09-19T15:31:39.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4330802103214774657', time=2024-09-19T16:47:30.001771+0000, chain.objs.size()=1 2024-09-19T15:31:39.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.3bGYh2mFI4EJnuGo9sLaU3mk1EeCHBH_0 2024-09-19T15:31:39.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15953395690632934793', time=2024-09-19T16:47:31.038348+0000, chain.objs.size()=1 2024-09-19T15:31:39.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.hdNPpu552GcahUXI1P2iohOw_Q9KSh0_0 2024-09-19T15:31:39.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3819861579804199805', time=2024-09-19T16:47:33.703163+0000, chain.objs.size()=1 2024-09-19T15:31:39.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.oncXGhRStCM1AOZpaKRIWTlvkSOm94E_0 2024-09-19T15:31:39.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1295792539167626838', time=2024-09-19T16:47:35.506952+0000, chain.objs.size()=1 2024-09-19T15:31:39.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.C5EkhSOderhUYcqmb1XPN6amnRw7vC8_0 2024-09-19T15:31:39.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12149690078862696685', time=2024-09-19T16:47:40.403601+0000, chain.objs.size()=1 2024-09-19T15:31:39.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.mKKH3KNFsvRjk-_bsA2XDTWtb9mOJ1b_0 2024-09-19T15:31:39.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6555219902201206656', time=2024-09-19T16:47:44.397396+0000, chain.objs.size()=1 2024-09-19T15:31:39.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.e7ekSw_NnHpZF-AKHA0ZtGhGXUmG8HH_0 2024-09-19T15:31:39.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5720967166127897771', time=2024-09-19T16:47:47.415174+0000, chain.objs.size()=1 2024-09-19T15:31:39.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Je64wbx1qSnKZWNMrnRyjXpSQyUjE0S_0 2024-09-19T15:31:39.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13417573828843948038', time=2024-09-19T16:47:48.256778+0000, chain.objs.size()=1 2024-09-19T15:31:39.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.v2jls5_5FBTTLtQncus0EOGUmOgxOoF_0 2024-09-19T15:31:39.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9500570776865010658', time=2024-09-19T16:47:49.318058+0000, chain.objs.size()=1 2024-09-19T15:31:39.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Imkrof0TYmCu1pku2P66IVLy9VpAvP7_0 2024-09-19T15:31:39.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8665343245238508335', time=2024-09-19T16:47:49.859316+0000, chain.objs.size()=1 2024-09-19T15:31:39.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.3RazYrPxe4LtIUZkWTVqkYt8QZPkF2W_0 2024-09-19T15:31:39.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9672210796414260019', time=2024-09-19T16:49:35.077088+0000, chain.objs.size()=1 2024-09-19T15:31:39.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ySY0vVieVXQ6doW4BAS6oB6htd7zE58_0 2024-09-19T15:31:39.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2011593477459608326', time=2024-09-19T16:49:36.396121+0000, chain.objs.size()=1 2024-09-19T15:31:39.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.I_3hLULp64VTc-ngek4F6fGLg_v4yqQ_0 2024-09-19T15:31:39.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17196206258271129887', time=2024-09-19T16:49:37.172804+0000, chain.objs.size()=1 2024-09-19T15:31:39.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.R0uLiCGdaqcZ1zDGHJ_3O7THLm8EHmK_0 2024-09-19T15:31:39.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14831637266797226107', time=2024-09-19T16:49:37.612880+0000, chain.objs.size()=1 2024-09-19T15:31:39.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.tPgM6KKoEY-akA7r4g5-dEN6q_awGkZ_0 2024-09-19T15:31:39.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11972778121796050156', time=2024-09-19T16:49:38.096017+0000, chain.objs.size()=1 2024-09-19T15:31:39.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.qctma4pSHmXzxjwUaBWPtTQ508KDTBq_0 2024-09-19T15:31:39.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12632002797722691245', time=2024-09-19T16:49:39.931169+0000, chain.objs.size()=1 2024-09-19T15:31:39.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.8rK8sMARn0kdfKBBB-V_37wP3ssbMOm_0 2024-09-19T15:31:39.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1973920139005365364', time=2024-09-19T16:49:40.577393+0000, chain.objs.size()=1 2024-09-19T15:31:39.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.pOdMKI983zuC-KiieCyo7RWiYC8fsUe_0 2024-09-19T15:31:39.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15081051892907250392', time=2024-09-19T16:49:41.904206+0000, chain.objs.size()=1 2024-09-19T15:31:39.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.BhjJXP2xmnCLFL3B6OIPX1P3AWSpE-t_0 2024-09-19T15:31:39.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12772269295952002762', time=2024-09-19T16:49:44.054498+0000, chain.objs.size()=1 2024-09-19T15:31:39.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.o7fzJE9O1Sa9f9gz8AokbjDal6LeXF-_0 2024-09-19T15:31:39.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8745425974548799842', time=2024-09-19T16:49:44.445623+0000, chain.objs.size()=1 2024-09-19T15:31:39.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.yNAxsD_Gdqb8XUygsCblLerWF6wI3yq_0 2024-09-19T15:31:39.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4090097575732621736', time=2024-09-19T16:49:44.716582+0000, chain.objs.size()=1 2024-09-19T15:31:39.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.BoCU7eJnbyJMrATUifEVa946_9n0yE2_0 2024-09-19T15:31:39.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6038856235766322100', time=2024-09-19T16:49:45.970586+0000, chain.objs.size()=1 2024-09-19T15:31:39.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.kQ-siucAk1msx8qBUUWPuNR0US-4WVx_0 2024-09-19T15:31:39.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.289284653515277660', time=2024-09-19T16:49:47.751259+0000, chain.objs.size()=1 2024-09-19T15:31:39.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.J06lsD-1D7JldP59fvFylspU-L9CfCD_0 2024-09-19T15:31:39.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14524879525237582394', time=2024-09-19T16:49:47.789563+0000, chain.objs.size()=1 2024-09-19T15:31:39.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.BpXBB1MoixF-R4F73vbOWLeiRSMDKfu_0 2024-09-19T15:31:39.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1337530715872053903', time=2024-09-19T16:49:48.324585+0000, chain.objs.size()=1 2024-09-19T15:31:39.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.9WlILRW25hXdnd7A1f1x6x_yqaIcUjy_0 2024-09-19T15:31:39.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11068657609540360355', time=2024-09-19T16:49:48.710404+0000, chain.objs.size()=1 2024-09-19T15:31:39.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.THHe1pBZdAy5HzCkfgTjqmZbUA9yAFG_0 2024-09-19T15:31:39.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6192457318081793114', time=2024-09-19T16:49:50.678582+0000, chain.objs.size()=1 2024-09-19T15:31:39.567 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.VU_zCNOjsTErUOy8q9JzZBj3jkQeqlZ_0 2024-09-19T15:31:39.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.564+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.806270955494036383', time=2024-09-19T16:49:51.023870+0000, chain.objs.size()=1 2024-09-19T15:31:39.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.564+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.xcpK4-gOwD-4PeYI08ILa6CDXjiav-L_0 2024-09-19T15:31:39.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.564+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3925542527400816988', time=2024-09-19T16:49:53.546555+0000, chain.objs.size()=1 2024-09-19T15:31:39.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.564+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.l_SFMDaQLS63ll8r-oq5B1momU2zR1G_0 2024-09-19T15:31:39.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.564+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2316511620738600984', time=2024-09-19T16:49:53.753433+0000, chain.objs.size()=1 2024-09-19T15:31:39.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.564+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.GHbNkMHmVxroR3RcyF4MFBUziU-0pxU_0 2024-09-19T15:31:39.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.564+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3739996785282396903', time=2024-09-19T16:49:53.869567+0000, chain.objs.size()=1 2024-09-19T15:31:39.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.564+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.g4QxE-NjM2uPZI0kSL2AcBOUAaS-hhO_0 2024-09-19T15:31:39.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.564+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8912711075781641154', time=2024-09-19T16:49:54.406409+0000, chain.objs.size()=1 2024-09-19T15:31:39.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.564+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ftkBWscLukLoYNiGKDOxXxlaExHu6O0_0 2024-09-19T15:31:39.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.564+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.159462981157366760', time=2024-09-19T16:49:54.758083+0000, chain.objs.size()=1 2024-09-19T15:31:39.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.564+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.4gaspTirVhRTIEBsJ6s124e3Jf2jVEv_0 2024-09-19T15:31:39.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.564+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8316256330554720633', time=2024-09-19T16:49:56.435464+0000, chain.objs.size()=1 2024-09-19T15:31:39.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.564+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Rv76-4Dp3SRHfM_8nHoTU6fn-TXrkQV_0 2024-09-19T15:31:39.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.564+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2805641472412024738', time=2024-09-19T16:49:56.704789+0000, chain.objs.size()=1 2024-09-19T15:31:39.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.564+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.NTjB6hUzyjt9xzcrYJDcpA5ZyWl_aQX_0 2024-09-19T15:31:39.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.564+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16512436670080400980', time=2024-09-19T16:49:57.010584+0000, chain.objs.size()=1 2024-09-19T15:31:39.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.564+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ClbTp2IlOlOyKhHlalX90BJNH1sbYnQ_0 2024-09-19T15:31:39.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.564+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11370516745798892297', time=2024-09-19T16:49:57.106885+0000, chain.objs.size()=1 2024-09-19T15:31:39.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.564+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.j4HcjoC0L6thPvJrBWGUT6uynaoUNnH_0 2024-09-19T15:31:39.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.564+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15943363582136110787', time=2024-09-19T16:49:57.466502+0000, chain.objs.size()=1 2024-09-19T15:31:39.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.564+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.6auWNUVCV9Eitci-py9BmCPCtnHpMUn_0 2024-09-19T15:31:39.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.564+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6292811418721913566', time=2024-09-19T16:49:57.493138+0000, chain.objs.size()=1 2024-09-19T15:31:39.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.564+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.dE6rLdaIz7iTqrrf1p93TpDTCJsr4YZ_0 2024-09-19T15:31:39.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6718964105901902252', time=2024-09-19T16:50:03.013603+0000, chain.objs.size()=1 2024-09-19T15:31:39.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.lFFNim79qrtlBQZMv8Ds3iutcEz9lcR_0 2024-09-19T15:31:39.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1889423209628660743', time=2024-09-19T16:50:06.017601+0000, chain.objs.size()=1 2024-09-19T15:31:39.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_._jd9m5ow2npWJEQ0wnXshj9VkdX8XnM_0 2024-09-19T15:31:39.575 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50661 2024-09-19T15:31:39.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-19T15:31:39.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9976852781872499142', time=2024-09-19T16:50:06.533447+0000, chain.objs.size()=1 2024-09-19T15:31:39.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.LnbwKpLRiF5xByQGPWtsPzw9Jx5PV1L_0 2024-09-19T15:31:39.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18410653666429586497', time=2024-09-19T16:50:41.702128+0000, chain.objs.size()=1 2024-09-19T15:31:39.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.341__shadow_.fQV3zL9TK5jdprIMlOmhivzi9Utr4O2_0 2024-09-19T15:31:39.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14028239458601961455', time=2024-09-19T16:53:47.355743+0000, chain.objs.size()=1 2024-09-19T15:31:39.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.435__shadow_.-_s9vW5fFLzih6v7s3Q5Gfyt4mOpRfg_0 2024-09-19T15:31:39.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6716715782449999907', time=2024-09-19T16:55:00.602543+0000, chain.objs.size()=1 2024-09-19T15:31:39.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.464__shadow_.Wlk-bKKpYN9f6A7ieKXoDdZmb8Bwl9g_0 2024-09-19T15:31:39.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8063818079641699260', time=2024-09-19T16:56:22.735427+0000, chain.objs.size()=1 2024-09-19T15:31:39.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.503__shadow:vjdbIfRxBe4w.PbHfN6JGIQynOLNKTv_.1FlZE6YVJFffVLJR2xeEpNz8BJZrUMj_0 2024-09-19T15:31:39.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11821605065770405333', time=2024-09-19T16:57:48.503165+0000, chain.objs.size()=1 2024-09-19T15:31:39.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.517__shadow_.GbZL_wONsZyMFIhzH-SH5mrALYjVz1p_0 2024-09-19T15:31:39.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5059103201406849357', time=2024-09-19T17:03:02.697824+0000, chain.objs.size()=3 2024-09-19T15:31:39.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.523__multipart_mymultipart.2~4Z8q0fK-S5rwKkOJ8mQa0Fh6LIJ1m00.1 2024-09-19T15:31:39.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.523__multipart_mymultipart.2~4Z8q0fK-S5rwKkOJ8mQa0Fh6LIJ1m00.2 2024-09-19T15:31:39.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.523__multipart_mymultipart.2~4Z8q0fK-S5rwKkOJ8mQa0Fh6LIJ1m00.3 2024-09-19T15:31:39.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vodGgEJfOx-QZpoMMk01t-Ex6y5YDep', time=2024-09-19T17:03:42.480447+0000, chain.objs.size()=10 2024-09-19T15:31:39.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.526__multipart_mymultipart.2~vodGgEJfOx-QZpoMMk01t-Ex6y5YDep.1 2024-09-19T15:31:39.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.526__multipart_mymultipart.2~vodGgEJfOx-QZpoMMk01t-Ex6y5YDep.2 2024-09-19T15:31:39.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.526__multipart_mymultipart.2~vodGgEJfOx-QZpoMMk01t-Ex6y5YDep.3 2024-09-19T15:31:39.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.576+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.526__multipart_mymultipart.2~vodGgEJfOx-QZpoMMk01t-Ex6y5YDep.4 2024-09-19T15:31:39.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.576+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.526__multipart_mymultipart.2~vodGgEJfOx-QZpoMMk01t-Ex6y5YDep.5 2024-09-19T15:31:39.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.576+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.526__multipart_mymultipart.2~vodGgEJfOx-QZpoMMk01t-Ex6y5YDep.6 2024-09-19T15:31:39.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.580+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.526__multipart_mymultipart.2~vodGgEJfOx-QZpoMMk01t-Ex6y5YDep.7 2024-09-19T15:31:39.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.580+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.526__multipart_mymultipart.2~vodGgEJfOx-QZpoMMk01t-Ex6y5YDep.8 2024-09-19T15:31:39.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.580+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.526__multipart_mymultipart.2~vodGgEJfOx-QZpoMMk01t-Ex6y5YDep.9 2024-09-19T15:31:39.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.580+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.526__multipart_mymultipart.2~vodGgEJfOx-QZpoMMk01t-Ex6y5YDep.10 2024-09-19T15:31:39.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.580+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12409114247534784852', time=2024-09-19T17:07:51.290184+0000, chain.objs.size()=1 2024-09-19T15:31:39.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.580+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:mK.nA7rLGPqbC.zwEpHFBbbL8AyYnFM_.MTftNgbb_r9CmT-LIsWrzLWKCkxV6hN_0 2024-09-19T15:31:39.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.580+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.902081600162978104', time=2024-09-19T17:08:22.761001+0000, chain.objs.size()=1 2024-09-19T15:31:39.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.580+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.574__shadow:tIk0mi9oBcsGvAtjXO948-A2KuRv2AZ_.eZvOp7HK0FoCtalnPBQNaowUeKjc0R9_0 2024-09-19T15:31:39.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.580+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4213756813002724093', time=2024-09-19T17:20:50.654920+0000, chain.objs.size()=1 2024-09-19T15:31:39.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.580+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.668__shadow_.VnvD0WknMxoT2SMl4l1qeWLSxb9xdls_0 2024-09-19T15:31:39.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.580+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18292705339391996297', time=2024-09-19T17:20:56.815487+0000, chain.objs.size()=1 2024-09-19T15:31:39.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.580+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.672__shadow_.LpVVU9Z5rpdH4EyWaYxI90Uz2mCscao_0 2024-09-19T15:31:39.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.584+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:39.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.584+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T15:31:39.592 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.588+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:39.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.588+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:39.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.588+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49152' 2024-09-19T15:31:39.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.588+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8127721381623046885', time=2024-09-19T16:33:13.202724+0000, chain.objs.size()=2 2024-09-19T15:31:39.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.588+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.160__shadow_.IRou7E5cdqznQTJx0r8_DOczVcgXDN4_0 2024-09-19T15:31:39.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.588+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.160__shadow_.IRou7E5cdqznQTJx0r8_DOczVcgXDN4_1 2024-09-19T15:31:39.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.588+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10044398515207427129', time=2024-09-19T16:33:24.913898+0000, chain.objs.size()=3 2024-09-19T15:31:39.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.588+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.161__multipart_foo-STANDARD.2~lG5WabQt5IzrPGLgCn-OOgpfru4RwK6.1 2024-09-19T15:31:39.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.588+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.161__multipart_foo-STANDARD.2~lG5WabQt5IzrPGLgCn-OOgpfru4RwK6.2 2024-09-19T15:31:39.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.588+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.161__multipart_foo-STANDARD.2~lG5WabQt5IzrPGLgCn-OOgpfru4RwK6.3 2024-09-19T15:31:39.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.588+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4235016972998715029', time=2024-09-19T16:39:38.678761+0000, chain.objs.size()=1 2024-09-19T15:31:39.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.588+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.236__shadow_.5esmSNEc2F_GYddSIvOdQRgzuvnhw3v_0 2024-09-19T15:31:39.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.588+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3266698279031941202', time=2024-09-19T16:40:37.198387+0000, chain.objs.size()=1 2024-09-19T15:31:39.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.588+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.259__shadow_.MuciKFIsQ4e7qdIcDAFC6Wxm8sRC7xl_0 2024-09-19T15:31:39.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.588+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11790795871062024994', time=2024-09-19T16:40:41.798772+0000, chain.objs.size()=1 2024-09-19T15:31:39.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.588+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.261__shadow_.XHlVAQJFBW42Bu86BiE4yqFPf0WbbFi_0 2024-09-19T15:31:39.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.588+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.85310892178454723', time=2024-09-19T16:42:28.124646+0000, chain.objs.size()=1 2024-09-19T15:31:39.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.588+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.sd12pjA-rSJXFKTBXVZRHwYDL4sGLWl_0 2024-09-19T15:31:39.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.588+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4145384176028316226', time=2024-09-19T16:42:30.142508+0000, chain.objs.size()=1 2024-09-19T15:31:39.595 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.588+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.fcaSQzPJRjxIeK4tVrafg9LcfHoycHV_0 2024-09-19T15:31:39.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.588+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3198540817307923029', time=2024-09-19T16:42:31.332100+0000, chain.objs.size()=1 2024-09-19T15:31:39.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.588+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.9QDmzz_fJCrNU6yqoMc9kMf7Mqzmfot_0 2024-09-19T15:31:39.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.588+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6341799836131181283', time=2024-09-19T16:42:32.639329+0000, chain.objs.size()=1 2024-09-19T15:31:39.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.588+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.6vdjIhJmtpsvUkpIytLTUetItW19sya_0 2024-09-19T15:31:39.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.592+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6597575053638313780', time=2024-09-19T16:42:33.482981+0000, chain.objs.size()=1 2024-09-19T15:31:39.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Tfph1ZKU8FRUlSiNfnXCmW3d5kup75N_0 2024-09-19T15:31:39.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.592+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12893507013858668324', time=2024-09-19T16:42:33.928394+0000, chain.objs.size()=1 2024-09-19T15:31:39.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.wzPE5G1jFSO6CKR4v4EZ7GXvri8JRsq_0 2024-09-19T15:31:39.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.592+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5388853740688089296', time=2024-09-19T16:42:34.279745+0000, chain.objs.size()=1 2024-09-19T15:31:39.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.H7GKQcgo-5edouRglzbI9vESwPNcdZs_0 2024-09-19T15:31:39.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.592+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13866540665330331528', time=2024-09-19T16:42:37.705708+0000, chain.objs.size()=1 2024-09-19T15:31:39.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.NDW_T-2GZcfsaOtfGsOU6XLetFtt4_R_0 2024-09-19T15:31:39.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.592+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13062500348621967034', time=2024-09-19T16:42:39.174694+0000, chain.objs.size()=1 2024-09-19T15:31:39.598 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.6ojz7BKJkyfDonaWCSNogCGrthqAyiJ_0 2024-09-19T15:31:39.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.592+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5935538541550850916', time=2024-09-19T16:42:39.437137+0000, chain.objs.size()=1 2024-09-19T15:31:39.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.z9OpKecgnDC1qnpqkucGz1-ZZxx6azA_0 2024-09-19T15:31:39.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.592+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2556140609126309332', time=2024-09-19T16:42:39.538795+0000, chain.objs.size()=1 2024-09-19T15:31:39.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.1MUzkWMnEcWU6lVek4O5l5oqgHmFa7s_0 2024-09-19T15:31:39.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.592+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6289758538520245259', time=2024-09-19T16:42:39.660658+0000, chain.objs.size()=1 2024-09-19T15:31:39.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.6RfiENf9p-G3JlZt6-OtpN8wxcYvUmt_0 2024-09-19T15:31:39.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.592+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4709718617390253613', time=2024-09-19T16:42:39.894717+0000, chain.objs.size()=1 2024-09-19T15:31:39.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.MDxd4fp82RWAYo3G8uWTh6hCQbK3dqf_0 2024-09-19T15:31:39.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.592+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5068312600332578192', time=2024-09-19T16:42:41.836966+0000, chain.objs.size()=1 2024-09-19T15:31:39.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.gWfvuVTmsqB2oWH9MB1iyrJ3EsUDDAQ_0 2024-09-19T15:31:39.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.592+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13980910902275430505', time=2024-09-19T16:42:42.965274+0000, chain.objs.size()=1 2024-09-19T15:31:39.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.XA6kjsYo9zIpuevwrgVf2j16xtI8T_1_0 2024-09-19T15:31:39.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.596+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8298139299466952135', time=2024-09-19T16:42:46.674833+0000, chain.objs.size()=1 2024-09-19T15:31:39.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.596+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.7TNvYAKDGyQCpxc11_UwUKJV5N1uZnB_0 2024-09-19T15:31:39.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.596+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10995654156276312105', time=2024-09-19T16:42:51.422889+0000, chain.objs.size()=1 2024-09-19T15:31:39.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.596+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.dk2xciyvi_HfQJ8xuJ-sa_YHECFunrZ_0 2024-09-19T15:31:39.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.596+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5575282945165419922', time=2024-09-19T16:42:51.538683+0000, chain.objs.size()=1 2024-09-19T15:31:39.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.596+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.2uExuySBtLkAEKywQ6WrFTiMa_Pp2pG_0 2024-09-19T15:31:39.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.596+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12542106815981758674', time=2024-09-19T16:42:52.170243+0000, chain.objs.size()=1 2024-09-19T15:31:39.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.596+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.pgjMorSL-QOe0nhLtaWYX7iOgiKPW78_0 2024-09-19T15:31:39.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.596+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8606017454290523115', time=2024-09-19T16:42:52.236108+0000, chain.objs.size()=1 2024-09-19T15:31:39.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.596+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.mDhS3NFAY-Idh9-nWKrmCKeMx56TIFg_0 2024-09-19T15:31:39.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.596+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13136427555648408205', time=2024-09-19T16:42:54.518535+0000, chain.objs.size()=1 2024-09-19T15:31:39.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.596+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.a9AyiDFD-f-3y6TE0PAvXFz-q_h0pPt_0 2024-09-19T15:31:39.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.596+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10336144796952102265', time=2024-09-19T16:42:55.456725+0000, chain.objs.size()=1 2024-09-19T15:31:39.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.596+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.EexzmEVV2aOGENQmgHE2nN-j9mJLvoo_0 2024-09-19T15:31:39.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.596+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18272890041323389580', time=2024-09-19T16:42:57.342108+0000, chain.objs.size()=1 2024-09-19T15:31:39.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.596+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.H12gqkJuobKwmB0aty-SOuFP5g2uFYN_0 2024-09-19T15:31:39.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.596+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.523117368527450295', time=2024-09-19T16:42:57.901539+0000, chain.objs.size()=1 2024-09-19T15:31:39.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.596+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.lQNeDAOg4x14TQoHG0Zm6Dto_xc6ZU6_0 2024-09-19T15:31:39.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.596+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9649206732905304161', time=2024-09-19T16:42:58.406581+0000, chain.objs.size()=1 2024-09-19T15:31:39.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.596+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Ivvi3YAfNLU-VofTVYodtFgEbq9muuh_0 2024-09-19T15:31:39.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.596+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4971124224600413032', time=2024-09-19T16:43:06.846704+0000, chain.objs.size()=1 2024-09-19T15:31:39.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.596+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.265__shadow_._8VJG6IGIB80OQZgdYi7noPoQGXeWYl_0 2024-09-19T15:31:39.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.604+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.746015101427293716', time=2024-09-19T16:43:22.225891+0000, chain.objs.size()=1 2024-09-19T15:31:39.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.604+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.272__shadow_.JAYwhyPkbcCksJWEkgGH7GKJqTrZjrv_0 2024-09-19T15:31:39.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.604+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11963580435337791983', time=2024-09-19T16:43:35.841141+0000, chain.objs.size()=1 2024-09-19T15:31:39.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.604+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.278__shadow_.aT0NnpR7vB8wcf_DzCecEE6olfRvWln_0 2024-09-19T15:31:39.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.604+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10858786010941577523', time=2024-09-19T16:43:52.272548+0000, chain.objs.size()=1 2024-09-19T15:31:39.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.604+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.285__shadow_.IisCkdQaqSGS3_5jUepK0QQGm0Yis12_0 2024-09-19T15:31:39.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.604+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.113323994051851036', time=2024-09-19T16:44:12.924588+0000, chain.objs.size()=1 2024-09-19T15:31:39.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.604+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_.t3av00xhO45ZyP0j5tfuJ4lUSFhpm1x_0 2024-09-19T15:31:39.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.604+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18366994799679885838', time=2024-09-19T16:44:18.318681+0000, chain.objs.size()=1 2024-09-19T15:31:39.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.604+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.Rem4LFRIPeMch0lBGAwADh2e7YJLWzo_0 2024-09-19T15:31:39.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.604+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9379641519480929463', time=2024-09-19T16:44:18.573991+0000, chain.objs.size()=1 2024-09-19T15:31:39.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.604+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.spD72c1LOVpvvhdBo6SPWoEiMcO6DWW_0 2024-09-19T15:31:39.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.604+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11028128585113562617', time=2024-09-19T16:44:23.323551+0000, chain.objs.size()=1 2024-09-19T15:31:39.612 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.604+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.295__shadow_.YWbMe3dArfoM4U1mnxgKgdNE17bnq1L_0 2024-09-19T15:31:39.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.604+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5153682731311028920', time=2024-09-19T16:44:37.840966+0000, chain.objs.size()=1 2024-09-19T15:31:39.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.604+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.301__shadow_.mPamrTiJxe29Udb9Sgu_KxitL3Vyv3T_0 2024-09-19T15:31:39.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.604+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15517889814346814', time=2024-09-19T16:44:42.462738+0000, chain.objs.size()=1 2024-09-19T15:31:39.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.604+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.303__shadow_.c87NBY5m9rWWufUIJFXHvvGOqVrxeHZ_0 2024-09-19T15:31:39.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.604+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8989167011836667851', time=2024-09-19T16:45:29.912973+0000, chain.objs.size()=1 2024-09-19T15:31:39.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.604+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.321__shadow_.WyQeHYr_-k-7Vcvn3w_SgAwrj61pNX2_0 2024-09-19T15:31:39.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.604+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18016535088888932497', time=2024-09-19T16:45:29.927369+0000, chain.objs.size()=1 2024-09-19T15:31:39.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.604+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.321__shadow_.gaZdnCS6U6jZLBxBrs8E7B6sSJmzRNL_0 2024-09-19T15:31:39.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.608+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9035900414182604869', time=2024-09-19T16:47:18.134271+0000, chain.objs.size()=1 2024-09-19T15:31:39.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.608+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.utw6XrhbumCLBhjnTtO0C2pFZWpRQ1o_0 2024-09-19T15:31:39.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.608+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15245173332980071745', time=2024-09-19T16:47:18.984194+0000, chain.objs.size()=1 2024-09-19T15:31:39.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.608+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.S9ku4xe4Tlz1Fsaj8pCoKA0faOENMPH_0 2024-09-19T15:31:39.616 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.612+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10805326770321452441', time=2024-09-19T16:47:19.259314+0000, chain.objs.size()=1 2024-09-19T15:31:39.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.612+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.iqs4_hkTvpGsKPdNLPZI2g_Zg301Y5x_0 2024-09-19T15:31:39.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.612+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9934829737085447562', time=2024-09-19T16:47:19.992035+0000, chain.objs.size()=1 2024-09-19T15:31:39.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.612+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.dj4hGFGDbc5muDlslHiE4tJ4oMOYORk_0 2024-09-19T15:31:39.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.612+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18119925194672161582', time=2024-09-19T16:47:20.047921+0000, chain.objs.size()=1 2024-09-19T15:31:39.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.612+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_._QKtCNHUUUl-kN9LM5Uot9wP1NLaDAO_0 2024-09-19T15:31:39.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.612+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10767633116512924099', time=2024-09-19T16:47:21.227635+0000, chain.objs.size()=1 2024-09-19T15:31:39.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.612+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.wQTppMncLOcTcFvdfjg8IL1ML-XWYi0_0 2024-09-19T15:31:39.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.612+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3462118601898939125', time=2024-09-19T16:47:21.322937+0000, chain.objs.size()=1 2024-09-19T15:31:39.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.612+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.7kegTRyMW9NWGeaWuZWUia6Y8ZoWqC1_0 2024-09-19T15:31:39.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.612+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4646572212681101715', time=2024-09-19T16:47:21.324813+0000, chain.objs.size()=1 2024-09-19T15:31:39.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.612+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.mYUEKXl08Nz5uvOwvybGabDH4fTYRD2_0 2024-09-19T15:31:39.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.612+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12194269115196567820', time=2024-09-19T16:47:22.469789+0000, chain.objs.size()=1 2024-09-19T15:31:39.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.612+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.uaEq3nUVxGRT5XW7E3Z676ApVuRQRVM_0 2024-09-19T15:31:39.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.612+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5320519820999348566', time=2024-09-19T16:47:22.472360+0000, chain.objs.size()=1 2024-09-19T15:31:39.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.612+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.1-nJq1ijBSiBR21l9ZAN4ubGQ4ar7i9_0 2024-09-19T15:31:39.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.612+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5913757964885064966', time=2024-09-19T16:47:22.883311+0000, chain.objs.size()=1 2024-09-19T15:31:39.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.612+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.oPIw01aSCIagqJDUApmnqD_E6gvnOIS_0 2024-09-19T15:31:39.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.612+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5369067390925589019', time=2024-09-19T16:47:23.562966+0000, chain.objs.size()=1 2024-09-19T15:31:39.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.612+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.LJALIgoUVHkS3Vw8ij08VTULdsC55V0_0 2024-09-19T15:31:39.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.616+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.217423082077185318', time=2024-09-19T16:47:23.619011+0000, chain.objs.size()=1 2024-09-19T15:31:39.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.616+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.JmE8PHt9o7lysxlRUGnb5N8rFGSyVoY_0 2024-09-19T15:31:39.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.616+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15173866555399042847', time=2024-09-19T16:47:25.312939+0000, chain.objs.size()=1 2024-09-19T15:31:39.621 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.616+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.wIyHZNrf1RVTXhZCA34l-MxvBDv04qy_0 2024-09-19T15:31:39.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.616+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17705464745509290294', time=2024-09-19T16:47:25.733371+0000, chain.objs.size()=1 2024-09-19T15:31:39.622 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.616+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.gelOVWqtPzaYovIZ4iWTsCqBdC111ku_0 2024-09-19T15:31:39.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.616+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16287558905255249410', time=2024-09-19T16:47:26.814715+0000, chain.objs.size()=1 2024-09-19T15:31:39.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.616+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.fa2ycqXAjLG1-K4WjeoSO6eMDq3Ke94_0 2024-09-19T15:31:39.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.616+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16282785260857997256', time=2024-09-19T16:47:26.816528+0000, chain.objs.size()=1 2024-09-19T15:31:39.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.616+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.HnRDkNRzljATiRZ5wV3akfvk8geaJ6x_0 2024-09-19T15:31:39.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.616+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11902751703312671159', time=2024-09-19T16:47:28.776411+0000, chain.objs.size()=1 2024-09-19T15:31:39.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.616+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.nDB82-yQ1DFliTWjQ6PKtUU2GgHR5qo_0 2024-09-19T15:31:39.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.616+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14260186973161346774', time=2024-09-19T16:47:28.852762+0000, chain.objs.size()=1 2024-09-19T15:31:39.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.616+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.KKhGQAqP9UmDQNy6R-9AYDolADyOJAJ_0 2024-09-19T15:31:39.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.616+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1331799011392638541', time=2024-09-19T16:47:28.854094+0000, chain.objs.size()=1 2024-09-19T15:31:39.623 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.616+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.BtEHv04CE39JA531itgwthyYdoAiyVX_0 2024-09-19T15:31:39.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.620+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6027442715390515019', time=2024-09-19T16:47:31.127323+0000, chain.objs.size()=1 2024-09-19T15:31:39.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.620+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.8T9SSrRcIndDpLtlOJUVB6zHstc09ty_0 2024-09-19T15:31:39.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.620+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12412182505987197092', time=2024-09-19T16:47:31.481064+0000, chain.objs.size()=1 2024-09-19T15:31:39.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.620+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.t1Cbz5qQ50PjA1yPKd9m6LejUL5FDvW_0 2024-09-19T15:31:39.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.620+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4528200632631678873', time=2024-09-19T16:47:35.380429+0000, chain.objs.size()=1 2024-09-19T15:31:39.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.620+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.L-aT76IQkX27b3UQGSuP1I9nWFl6y4k_0 2024-09-19T15:31:39.625 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.620+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11767541885745349902', time=2024-09-19T16:47:35.721723+0000, chain.objs.size()=1 2024-09-19T15:31:39.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.620+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.cUP0MEXQ4gQlZA_McPlQE2po7gK1Vyw_0 2024-09-19T15:31:39.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.620+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1790186900154397639', time=2024-09-19T16:47:36.148457+0000, chain.objs.size()=1 2024-09-19T15:31:39.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.620+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.kg6AseuTlvBwnfQHxfyOnr5mXI0gr4J_0 2024-09-19T15:31:39.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.620+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4900050229626004781', time=2024-09-19T16:47:39.481577+0000, chain.objs.size()=1 2024-09-19T15:31:39.626 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.620+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.BqAuHROSal62wGD-IpI0-XKmDJsEkBZ_0 2024-09-19T15:31:39.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.620+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9912810461449292950', time=2024-09-19T16:47:42.638075+0000, chain.objs.size()=1 2024-09-19T15:31:39.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.620+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.n0SjauV9M8sPrInkIu_KqNkUVRUPA-i_0 2024-09-19T15:31:39.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.620+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6242188326115238672', time=2024-09-19T16:47:42.639972+0000, chain.objs.size()=1 2024-09-19T15:31:39.627 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.620+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.yBSy19AqjZhD3Gq_8T42HJntMOFP_wO_0 2024-09-19T15:31:39.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.620+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2520093325802688817', time=2024-09-19T16:47:44.968570+0000, chain.objs.size()=1 2024-09-19T15:31:39.628 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.620+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.f992_KABMNbj_A_o_LigKhAGlO0qqXc_0 2024-09-19T15:31:39.629 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.624+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.507623021760586526', time=2024-09-19T16:47:45.870893+0000, chain.objs.size()=1 2024-09-19T15:31:39.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.624+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.awrdlXThrBTwTkAoVVJOoiHMRIdxtRE_0 2024-09-19T15:31:39.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.624+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6637370423190301804', time=2024-09-19T16:47:47.551180+0000, chain.objs.size()=1 2024-09-19T15:31:39.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.624+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.n-rT9NiNw4ptuIUVVDH5kTIw4yMXyQK_0 2024-09-19T15:31:39.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.624+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1167338931973383618', time=2024-09-19T16:47:48.009081+0000, chain.objs.size()=1 2024-09-19T15:31:39.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.624+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.M6S8jpZKBCpLu5f1lWynR2H4a-m2E8r_0 2024-09-19T15:31:39.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.624+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3937255306259767331', time=2024-09-19T16:47:48.857205+0000, chain.objs.size()=1 2024-09-19T15:31:39.630 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.624+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.yP76ETXBegfujplPSCUz-0je5XbDGbo_0 2024-09-19T15:31:39.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.628+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3024467241655181002', time=2024-09-19T16:47:48.980697+0000, chain.objs.size()=1 2024-09-19T15:31:39.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.628+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.H6m_ChKjHHCSKV0e4G3jMHgACO4OFri_0 2024-09-19T15:31:39.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.628+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1305449827230351518', time=2024-09-19T16:47:48.982514+0000, chain.objs.size()=1 2024-09-19T15:31:39.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.628+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.YKVTT7d4waTgfi7Yb8YbxrLH1w8IAtp_0 2024-09-19T15:31:39.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.628+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13452615089810304849', time=2024-09-19T16:47:50.002970+0000, chain.objs.size()=1 2024-09-19T15:31:39.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.628+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.7g9XFDXmLEUhX-p8lT5hLWVlEPIo5M6_0 2024-09-19T15:31:39.632 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.628+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2318550713221350733', time=2024-09-19T16:47:50.005362+0000, chain.objs.size()=1 2024-09-19T15:31:39.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.628+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.4E-qV-h9EZL1YrXN5ePGEC1rObdv2lf_0 2024-09-19T15:31:39.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.628+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17989070301863749733', time=2024-09-19T16:49:34.846904+0000, chain.objs.size()=1 2024-09-19T15:31:39.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.628+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ctRY0ht1-OD7SYFCXrgpeUj6_F7ktwo_0 2024-09-19T15:31:39.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.628+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7334886136011518575', time=2024-09-19T16:49:35.557857+0000, chain.objs.size()=1 2024-09-19T15:31:39.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.628+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.LMVqu-EufkLA2Wg86a1QnZNtTBXsyDD_0 2024-09-19T15:31:39.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.628+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16379307666634630356', time=2024-09-19T16:49:35.949375+0000, chain.objs.size()=1 2024-09-19T15:31:39.633 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.628+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.UYQyR_tBZmykc4r38SteV2fr7kCRUfU_0 2024-09-19T15:31:39.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.628+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14780510752839324435', time=2024-09-19T16:49:35.951105+0000, chain.objs.size()=1 2024-09-19T15:31:39.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.628+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.gl81lqElZ2dKIxxHDHSlpg5JlOGTJa3_0 2024-09-19T15:31:39.635 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.628+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7275622725656692099', time=2024-09-19T16:49:36.416600+0000, chain.objs.size()=1 2024-09-19T15:31:39.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.628+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.HkyXC03pjTwdJ_jceTgHNfavcReake0_0 2024-09-19T15:31:39.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.628+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14905619359640261858', time=2024-09-19T16:49:36.720567+0000, chain.objs.size()=1 2024-09-19T15:31:39.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.628+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Wu5IAs1FYWNjrjpdTSViYcOZTQX8Qt8_0 2024-09-19T15:31:39.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.628+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16218579685302853551', time=2024-09-19T16:49:37.512046+0000, chain.objs.size()=1 2024-09-19T15:31:39.636 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.628+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.gqcitaxFhKGIQjALg6ZpH_c7Zkkr-TU_0 2024-09-19T15:31:39.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.632+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2475644651336333400', time=2024-09-19T16:49:37.588180+0000, chain.objs.size()=1 2024-09-19T15:31:39.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.632+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.AoPaunMe9eMFkHDTZOq8npJBMgMUSEt_0 2024-09-19T15:31:39.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.632+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6481651276210405613', time=2024-09-19T16:49:38.178887+0000, chain.objs.size()=1 2024-09-19T15:31:39.637 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.632+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.7MX_oqTD9eS5RrJgRAR1utKK0dMA-4G_0 2024-09-19T15:31:39.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.632+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3698550318597020805', time=2024-09-19T16:49:41.874699+0000, chain.objs.size()=1 2024-09-19T15:31:39.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.632+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.sFoiBmpIPYasvCT7dAZzYPD-tQ2Mx4Y_0 2024-09-19T15:31:39.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.632+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18231829742464489654', time=2024-09-19T16:49:42.167409+0000, chain.objs.size()=1 2024-09-19T15:31:39.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.632+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.UAnbB32rFnhXLmdn53za7gl_JIb8vvm_0 2024-09-19T15:31:39.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.632+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14247687498313898070', time=2024-09-19T16:49:42.532908+0000, chain.objs.size()=1 2024-09-19T15:31:39.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.632+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Vlb-59T6P4X4pbks7GLcmFwREsaW2GL_0 2024-09-19T15:31:39.638 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.632+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7867337647471011569', time=2024-09-19T16:49:44.474503+0000, chain.objs.size()=1 2024-09-19T15:31:39.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.632+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.HUu673UlNFho-iH4CI1vz7BVR3no7c-_0 2024-09-19T15:31:39.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.632+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7304940348155335016', time=2024-09-19T16:49:44.615008+0000, chain.objs.size()=1 2024-09-19T15:31:39.639 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.632+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.cB6Zr33-o-5G17iy9fvCgmf9Ev4cPdz_0 2024-09-19T15:31:39.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.636+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1447260004620392049', time=2024-09-19T16:49:44.808836+0000, chain.objs.size()=1 2024-09-19T15:31:39.640 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.636+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.b1Ij7WR6mX3YLCkXph35V7UU6crEN63_0 2024-09-19T15:31:39.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.636+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12250817932506102073', time=2024-09-19T16:49:49.207446+0000, chain.objs.size()=1 2024-09-19T15:31:39.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.636+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.FpgxgM_IiiLguqVgPGJP9Y6C0rmXcBE_0 2024-09-19T15:31:39.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.636+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6037271520019436709', time=2024-09-19T16:49:49.523235+0000, chain.objs.size()=1 2024-09-19T15:31:39.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.636+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ccU8hm7yaa8HeXH4ajXhG7AJaRwfCLL_0 2024-09-19T15:31:39.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.636+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6702507011059386376', time=2024-09-19T16:49:49.995660+0000, chain.objs.size()=1 2024-09-19T15:31:39.641 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.636+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.vSzbfv-eLJ554YN78TsJuWr7NzegiP4_0 2024-09-19T15:31:39.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.636+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14414199969686224977', time=2024-09-19T16:49:52.590299+0000, chain.objs.size()=1 2024-09-19T15:31:39.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.636+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.lN-DWR9fJMD9ousDCPSDieH4srm6RHY_0 2024-09-19T15:31:39.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.636+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12296133849260446522', time=2024-09-19T16:49:53.585634+0000, chain.objs.size()=1 2024-09-19T15:31:39.642 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.636+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.GuZPF4w81scg-JBeSRAYud0hiIME-Fp_0 2024-09-19T15:31:39.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.636+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18442864145986125167', time=2024-09-19T16:49:54.213264+0000, chain.objs.size()=1 2024-09-19T15:31:39.643 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.636+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.8NEWtGTpzXEiMmqrd_L0bAwE7lbN9zy_0 2024-09-19T15:31:39.648 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.644+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49152 2024-09-19T15:31:39.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-19T15:31:39.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3823548584677165829', time=2024-09-19T16:49:54.428994+0000, chain.objs.size()=1 2024-09-19T15:31:39.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.crKMF2JiNG3du1RQ48npDFOHnjfnNmp_0 2024-09-19T15:31:39.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7558090987246163238', time=2024-09-19T16:49:54.651512+0000, chain.objs.size()=1 2024-09-19T15:31:39.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.NY5cqw4dgGsrWLTJoXEIZvPjzES8Et7_0 2024-09-19T15:31:39.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1347165624832557870', time=2024-09-19T16:49:56.109021+0000, chain.objs.size()=1 2024-09-19T15:31:39.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.viCdVJM2Jt-FndeCDuUOvRA4H6LKC9p_0 2024-09-19T15:31:39.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17166460969647257026', time=2024-09-19T16:49:56.863974+0000, chain.objs.size()=1 2024-09-19T15:31:39.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.7Tf8L0Njm6Vlh-3z8r_o5AsSfpZzOz8_0 2024-09-19T15:31:39.654 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9751368335284338742', time=2024-09-19T16:49:57.335267+0000, chain.objs.size()=1 2024-09-19T15:31:39.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.HSgBx52hz60nKLyVr8mxE-O5rya0Nu0_0 2024-09-19T15:31:39.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5706203240100144692', time=2024-09-19T16:49:57.584498+0000, chain.objs.size()=1 2024-09-19T15:31:39.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.SSQmLH3Sq-B1vHhFqrp5FSonwwvWg5s_0 2024-09-19T15:31:39.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9446399899692220471', time=2024-09-19T16:49:58.928505+0000, chain.objs.size()=1 2024-09-19T15:31:39.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.e5NpWUS4043B6RQIjzjpy30EjZfVFEt_0 2024-09-19T15:31:39.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13702907169572972181', time=2024-09-19T16:50:01.025443+0000, chain.objs.size()=1 2024-09-19T15:31:39.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.GOMsIUrjuQdN205aXHzXxz8cYkuPiiH_0 2024-09-19T15:31:39.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1757683671188571944', time=2024-09-19T16:50:04.165025+0000, chain.objs.size()=1 2024-09-19T15:31:39.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.UPIvRzCpbevnL5YYvgnl6onv-M12WGG_0 2024-09-19T15:31:39.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14209754688117421383', time=2024-09-19T16:50:05.040475+0000, chain.objs.size()=1 2024-09-19T15:31:39.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.CEd9shhq1daiM8_ssya3rATp2t0zdPD_0 2024-09-19T15:31:39.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2596779222648724113', time=2024-09-19T16:50:05.270399+0000, chain.objs.size()=1 2024-09-19T15:31:39.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.2rB5yUGlx6bsgqPsU6HCZCfqGT5GEgd_0 2024-09-19T15:31:39.655 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16029471083165154919', time=2024-09-19T16:55:52.791261+0000, chain.objs.size()=1 2024-09-19T15:31:39.656 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.648+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.489__shadow_.SJhYeVG94DnZMGHwEoOnhLnSpEI0zLw_0 2024-09-19T15:31:39.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.652+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15147207066011282330', time=2024-09-19T16:56:05.791897+0000, chain.objs.size()=1 2024-09-19T15:31:39.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.652+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.496__shadow_.ihPBH__OsaWgmhU7lpiXoObXeOS75vM_0 2024-09-19T15:31:39.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.652+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~7uvJYqm0_ocq_Fl5CDCFmXKfCXeQK70', time=2024-09-19T16:59:32.622069+0000, chain.objs.size()=1 2024-09-19T15:31:39.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.652+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~7uvJYqm0_ocq_Fl5CDCFmXKfCXeQK70.1 2024-09-19T15:31:39.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.652+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4396376746816297593', time=2024-09-19T17:07:13.784830+0000, chain.objs.size()=1 2024-09-19T15:31:39.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.652+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.560__shadow_.AWcLIHc-3zuodYYLZ5PVooYSA2Ry9_-_0 2024-09-19T15:31:39.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.652+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16930579345927747173', time=2024-09-19T17:07:35.067742+0000, chain.objs.size()=1 2024-09-19T15:31:39.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.652+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.566__shadow_.ZyY7Rgf2K1yjcJbYIAYr6OmigmmMMon_0 2024-09-19T15:31:39.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.652+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17865025530279771227', time=2024-09-19T17:08:01.172550+0000, chain.objs.size()=1 2024-09-19T15:31:39.658 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.652+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:poHJWHjNdLu9XQm6D0FtEOyK-.bB3gk_.Gs3LKdI1FRQuTf21snCQcRyT9-7VXSR_0 2024-09-19T15:31:39.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.652+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13340364126572386088', time=2024-09-19T17:08:40.810036+0000, chain.objs.size()=1 2024-09-19T15:31:39.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.652+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.576__shadow:vjmkdcVARoOQ3IUM9iKg9x8JcqGWjq-_.K224Kux4JSel9K-KviCxRAPeY2ldeiw_0 2024-09-19T15:31:39.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.652+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12170170442789144749', time=2024-09-19T17:10:41.645968+0000, chain.objs.size()=1 2024-09-19T15:31:39.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.652+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.583__shadow:AquaTQBfI7oKvmG9L78d1fNuXEQRF.g_.UFvTm0krJCa-AVKShLBBi0t3tNimT2v_0 2024-09-19T15:31:39.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.652+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3231212393129260300', time=2024-09-19T17:14:18.220860+0000, chain.objs.size()=6 2024-09-19T15:31:39.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.652+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.615__multipart_multipart_enc.2~7J1aZ704cJy0aqh5Kd1A32JIZHNMoTJ.1 2024-09-19T15:31:39.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.652+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.615__multipart_multipart_enc.2~7J1aZ704cJy0aqh5Kd1A32JIZHNMoTJ.2 2024-09-19T15:31:39.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.652+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.615__multipart_multipart_enc.2~7J1aZ704cJy0aqh5Kd1A32JIZHNMoTJ.3 2024-09-19T15:31:39.659 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.652+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.615__multipart_multipart_enc.2~7J1aZ704cJy0aqh5Kd1A32JIZHNMoTJ.4 2024-09-19T15:31:39.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.656+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.615__multipart_multipart_enc.2~7J1aZ704cJy0aqh5Kd1A32JIZHNMoTJ.5 2024-09-19T15:31:39.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.656+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.615__multipart_multipart_enc.2~7J1aZ704cJy0aqh5Kd1A32JIZHNMoTJ.6 2024-09-19T15:31:39.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.656+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5989842688306753377', time=2024-09-19T17:20:50.667271+0000, chain.objs.size()=1 2024-09-19T15:31:39.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.656+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.668__shadow_.ajoODr_HS9ocv6wbvAcxVM9kkJpmNG8_0 2024-09-19T15:31:39.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.656+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5033906660195271419', time=2024-09-19T17:21:33.429406+0000, chain.objs.size()=1 2024-09-19T15:31:39.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.656+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.692__shadow:Mr8vfTlYRQewutMObVxj3Gb3S-kG81d_.uLfmO2wC9lz_P5B5wz4a_3Zvsk1jt7b_0 2024-09-19T15:31:39.662 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.656+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16215143972342912581', time=2024-09-19T17:27:02.663335+0000, chain.objs.size()=1 2024-09-19T15:31:39.663 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.656+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.761__shadow_.w2fSmGXbwwjxLr71fozMRJAqkVIUKhF_0 2024-09-19T15:31:39.667 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.660+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:39.670 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.664+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T15:31:39.671 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.664+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:39.672 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.668+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:39.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.668+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49813' 2024-09-19T15:31:39.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.668+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='_UpjUIjmxNOlDEkyFY9mcUCs4EQs91LA', time=2024-09-19T16:32:57.888315+0000, chain.objs.size()=2 2024-09-19T15:31:39.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.668+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.160__shadow_.itBBvzQOZPjgGk1Tg_H4V5y6-KGdNL5_0 2024-09-19T15:31:39.673 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.668+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.160__shadow_.itBBvzQOZPjgGk1Tg_H4V5y6-KGdNL5_1 2024-09-19T15:31:39.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.668+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1034298197238732653', time=2024-09-19T16:33:04.686461+0000, chain.objs.size()=2 2024-09-19T15:31:39.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.668+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.160__shadow_.6vrCHmfJ2YWYfiCxrNavFkHfhbcSVbe_0 2024-09-19T15:31:39.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.668+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.160__shadow_.6vrCHmfJ2YWYfiCxrNavFkHfhbcSVbe_1 2024-09-19T15:31:39.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.668+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='_cROLA2ZNINs1hXHUKz1JYQIInobBJAz', time=2024-09-19T16:33:38.195766+0000, chain.objs.size()=2 2024-09-19T15:31:39.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.668+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.161__shadow_.jBokwE8Hqx9pAtXleAIuNriAsWBUHjE_0 2024-09-19T15:31:39.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.668+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.161__shadow_.jBokwE8Hqx9pAtXleAIuNriAsWBUHjE_1 2024-09-19T15:31:39.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.668+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.998153065204454840', time=2024-09-19T16:34:00.264812+0000, chain.objs.size()=1 2024-09-19T15:31:39.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.668+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.162__shadow_.RrXoxrXLete-MNwx3GD7mnnuadP_y93_0 2024-09-19T15:31:39.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.668+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.931638482129607916', time=2024-09-19T16:39:31.667899+0000, chain.objs.size()=1 2024-09-19T15:31:39.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.668+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.233__shadow_.E0UrPPNf3AtYOLEOGe4GzhnPjOQsQ6a_0 2024-09-19T15:31:39.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.668+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7989164205706922437', time=2024-09-19T16:40:28.166726+0000, chain.objs.size()=1 2024-09-19T15:31:39.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.668+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.255__shadow_.oKmtAOHt49yiPfLoNU4R2Sfylc6uUa9_0 2024-09-19T15:31:39.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.668+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5831107407005456968', time=2024-09-19T16:40:28.168114+0000, chain.objs.size()=1 2024-09-19T15:31:39.674 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.668+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.255__shadow_.JNwt0v_rvsMSxK1KZqds3ujounwdky3_0 2024-09-19T15:31:39.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.668+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2928573782926270242', time=2024-09-19T16:40:39.534107+0000, chain.objs.size()=1 2024-09-19T15:31:39.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.668+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.260__shadow_.Va8Da_FEX7Z1XECMCmKuWCtAURuoAZO_0 2024-09-19T15:31:39.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.668+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9531878457968559975', time=2024-09-19T16:40:41.829522+0000, chain.objs.size()=1 2024-09-19T15:31:39.675 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.668+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.261__shadow_.1UTFt3yienGK-ujNuDUnJRBB4q0T8GS_0 2024-09-19T15:31:39.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.672+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13345652595548270450', time=2024-09-19T16:42:30.301831+0000, chain.objs.size()=1 2024-09-19T15:31:39.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.672+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.42ZFS0KlBG9DPV3x-BLyLMmQv4_mVpF_0 2024-09-19T15:31:39.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.672+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7409817312384807188', time=2024-09-19T16:42:31.144069+0000, chain.objs.size()=1 2024-09-19T15:31:39.677 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.672+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.8gCc6e-VwqFnnpR6cA0LHHM6brkU5D5_0 2024-09-19T15:31:39.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.672+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11035027258519209027', time=2024-09-19T16:42:32.755120+0000, chain.objs.size()=1 2024-09-19T15:31:39.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.672+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Q7gQEhzqmn7ZIwgYEYQ9-DFiHLt0nbB_0 2024-09-19T15:31:39.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.672+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10536317476044361753', time=2024-09-19T16:42:33.175968+0000, chain.objs.size()=1 2024-09-19T15:31:39.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.672+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.a439JaNHxmWFlOjuhN5D8PJUO0Auw1b_0 2024-09-19T15:31:39.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.672+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10500086624382001992', time=2024-09-19T16:42:35.299967+0000, chain.objs.size()=1 2024-09-19T15:31:39.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.672+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_._Gur3UGVO7BuiARsQfr558RYD07eo0j_0 2024-09-19T15:31:39.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.672+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11402421659663457244', time=2024-09-19T16:42:36.928306+0000, chain.objs.size()=1 2024-09-19T15:31:39.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.672+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.JF3zpcvEkQFlp_wf6VK1vLgWuIaon1P_0 2024-09-19T15:31:39.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.672+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8276891431763554171', time=2024-09-19T16:42:38.086681+0000, chain.objs.size()=1 2024-09-19T15:31:39.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.672+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.M-8_YthBTvK4Hww3YApg6KCHDU5tqMH_0 2024-09-19T15:31:39.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.672+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15415665640239652109', time=2024-09-19T16:42:38.217219+0000, chain.objs.size()=1 2024-09-19T15:31:39.678 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.672+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.aHXnaaEiwooF9YjpmXqX7qHMoYopurj_0 2024-09-19T15:31:39.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.672+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6997601160110488870', time=2024-09-19T16:42:38.604398+0000, chain.objs.size()=1 2024-09-19T15:31:39.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.672+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.jgabNoBQfqMWmfA-cD0Qt05vWZnSkce_0 2024-09-19T15:31:39.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.672+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7034128620240432891', time=2024-09-19T16:42:39.041061+0000, chain.objs.size()=1 2024-09-19T15:31:39.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.672+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.6Fjjj9zR-X9Wbdo8oq4ZfX_cDDetPhX_0 2024-09-19T15:31:39.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.672+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10015827026708726309', time=2024-09-19T16:42:39.983534+0000, chain.objs.size()=1 2024-09-19T15:31:39.679 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.672+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ch4g2wkKuusQ2JhTEZUHvZpMFMvASug_0 2024-09-19T15:31:39.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.676+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10418653001321681799', time=2024-09-19T16:42:41.131114+0000, chain.objs.size()=1 2024-09-19T15:31:39.680 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.676+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.zkNUv1OhcoIDtV_9uTCkaFVBl6K-M80_0 2024-09-19T15:31:39.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.676+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16781661974985557579', time=2024-09-19T16:42:41.786290+0000, chain.objs.size()=1 2024-09-19T15:31:39.681 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.676+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.-W95LuzvlKkdzK0UNMss14fXiGbNYsx_0 2024-09-19T15:31:39.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.676+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16387000249482796754', time=2024-09-19T16:42:42.370362+0000, chain.objs.size()=1 2024-09-19T15:31:39.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.676+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Ph6cZW2UjYzlO4ZW4WlzKBBX0i3Pfyj_0 2024-09-19T15:31:39.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.676+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3985441582857261905', time=2024-09-19T16:42:42.578785+0000, chain.objs.size()=1 2024-09-19T15:31:39.682 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.676+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.mFgndx377AXMYryv5XRgCIGOzeyyBaM_0 2024-09-19T15:31:39.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.676+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14246976463061376611', time=2024-09-19T16:42:43.167253+0000, chain.objs.size()=1 2024-09-19T15:31:39.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.676+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.cuS7CWc5W5qyFZ_zoABLk98GJUd7tl3_0 2024-09-19T15:31:39.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.676+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5107967570599933176', time=2024-09-19T16:42:46.655168+0000, chain.objs.size()=1 2024-09-19T15:31:39.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.676+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.klaIlLkGNdNprU1afzqMaERSHyJQvp3_0 2024-09-19T15:31:39.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.676+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14674593825007912088', time=2024-09-19T16:42:46.786333+0000, chain.objs.size()=1 2024-09-19T15:31:39.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.676+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.00uqUT2lq42-_tySJsrhoFb4kuy2GyP_0 2024-09-19T15:31:39.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.676+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7405789909362502975', time=2024-09-19T16:42:46.992055+0000, chain.objs.size()=1 2024-09-19T15:31:39.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.676+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.4FYxiViYKAaZgYmFAsCgA_w-gi--wS2_0 2024-09-19T15:31:39.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.676+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6442945608518349697', time=2024-09-19T16:42:46.993681+0000, chain.objs.size()=1 2024-09-19T15:31:39.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.676+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.cDFjCnpwsWcopmp3VbX1vOL4RmZxGbP_0 2024-09-19T15:31:39.683 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.676+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13257312903090726909', time=2024-09-19T16:42:48.141770+0000, chain.objs.size()=1 2024-09-19T15:31:39.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.676+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.YnVOGVSk6bx188_ysJe_lD0ToDfy5Rn_0 2024-09-19T15:31:39.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.676+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17144531502480046874', time=2024-09-19T16:42:49.695484+0000, chain.objs.size()=1 2024-09-19T15:31:39.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.676+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.fgemlD4CQuFHWO5Ei9b40aNE_5wUP6J_0 2024-09-19T15:31:39.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.680+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5171555254439703391', time=2024-09-19T16:42:50.229959+0000, chain.objs.size()=1 2024-09-19T15:31:39.684 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.680+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.WkZcVnw4nevaXRcCOeVL065rc5fkOzo_0 2024-09-19T15:31:39.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.680+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3334465056736013738', time=2024-09-19T16:42:50.625007+0000, chain.objs.size()=1 2024-09-19T15:31:39.685 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.680+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.HpblIjqvYmalM9cuNFykzH7hDYvV5fT_0 2024-09-19T15:31:39.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.680+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8123293441848735477', time=2024-09-19T16:42:51.004826+0000, chain.objs.size()=1 2024-09-19T15:31:39.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.680+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.yvdocgZtneOUt-N103Y2lWptzQDj66q_0 2024-09-19T15:31:39.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.680+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4055546870442277780', time=2024-09-19T16:42:53.837842+0000, chain.objs.size()=1 2024-09-19T15:31:39.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.680+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.jxixHIkUjkFqh8NHWsRrrsVwiwwqBdp_0 2024-09-19T15:31:39.686 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.680+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4652567894358701196', time=2024-09-19T16:42:53.842815+0000, chain.objs.size()=1 2024-09-19T15:31:39.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.680+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.OCHpEpDSaF-7h283zEwYxPDqc7M77sl_0 2024-09-19T15:31:39.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.680+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17934001419458981289', time=2024-09-19T16:42:53.966092+0000, chain.objs.size()=1 2024-09-19T15:31:39.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.680+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.VPjJyfcLdVmk8OTVXDin7Eur52EwGev_0 2024-09-19T15:31:39.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.680+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17513132785993945597', time=2024-09-19T16:42:54.773896+0000, chain.objs.size()=1 2024-09-19T15:31:39.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.680+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.8-EeHR8MOVWlhYsVCRvlJTk_H5S8MBC_0 2024-09-19T15:31:39.687 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.680+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3343914372264851280', time=2024-09-19T16:42:58.026615+0000, chain.objs.size()=1 2024-09-19T15:31:39.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.680+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.6JPJg3Gs11-hMYT5dO85KtpuawOVBxU_0 2024-09-19T15:31:39.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.680+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15683946710670578720', time=2024-09-19T16:42:58.740517+0000, chain.objs.size()=1 2024-09-19T15:31:39.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.680+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.QWaPrBndOSJr-fSGqyGVgCSwFJ8K-fw_0 2024-09-19T15:31:39.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.680+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12033678163721196492', time=2024-09-19T16:42:59.255988+0000, chain.objs.size()=1 2024-09-19T15:31:39.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.680+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.q8ZohWFXstDzB7sjX_3GrOZ1ioWDAN0_0 2024-09-19T15:31:39.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.684+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12013579913140386142', time=2024-09-19T16:42:59.342233+0000, chain.objs.size()=1 2024-09-19T15:31:39.688 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.684+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.yq-yqBHuYWhCIzKG7Nc11T52O0zY9c8_0 2024-09-19T15:31:39.689 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.684+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8795397831200567515', time=2024-09-19T16:43:09.023454+0000, chain.objs.size()=1 2024-09-19T15:31:39.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.684+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.266__shadow_.KnZJU5Pi2iXmWtXlgBOIt3yZwhR1m1w_0 2024-09-19T15:31:39.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.684+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12435017640668001805', time=2024-09-19T16:43:35.840566+0000, chain.objs.size()=1 2024-09-19T15:31:39.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.684+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.278__shadow_.IKbco2Hjk-Y_tYzdA9NE6Ila_lylKUm_0 2024-09-19T15:31:39.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.684+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.269545810757798649', time=2024-09-19T16:43:49.809005+0000, chain.objs.size()=1 2024-09-19T15:31:39.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.684+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.284__shadow_.j1ItYggQ_-ig43mbGZESL8ZMh94ojTA_0 2024-09-19T15:31:39.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.684+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8060668516822119634', time=2024-09-19T16:44:18.295147+0000, chain.objs.size()=1 2024-09-19T15:31:39.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.684+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.etw0-1K0ofCUBxcmaSQjfAF332wNmdi_0 2024-09-19T15:31:39.690 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.684+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16860446581074435163', time=2024-09-19T16:44:53.464338+0000, chain.objs.size()=1 2024-09-19T15:31:39.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.684+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.307__shadow:GX...3AQD4ck0ViHkcy9a83f1v4ERMx_.wGVRRw0yPBMBa4FIETv61ocQKbsd2oW_0 2024-09-19T15:31:39.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.684+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16701641617678439810', time=2024-09-19T16:45:32.435491+0000, chain.objs.size()=1 2024-09-19T15:31:39.691 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.684+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.322__shadow_.U7NgpRjTuKlpARsacCbpUcdUnio56BC_0 2024-09-19T15:31:39.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.688+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7476429331850224434', time=2024-09-19T16:47:18.043922+0000, chain.objs.size()=1 2024-09-19T15:31:39.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.688+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.SjbXhMQfHDNur8n0AEqSnIL672oOEN3_0 2024-09-19T15:31:39.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.688+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10338353685853186171', time=2024-09-19T16:47:18.045514+0000, chain.objs.size()=1 2024-09-19T15:31:39.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.688+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.gAZMdTD-enxatWBYlrhAtJxFEBfBwWy_0 2024-09-19T15:31:39.692 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.688+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6279502458611176071', time=2024-09-19T16:47:20.115210+0000, chain.objs.size()=1 2024-09-19T15:31:39.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.688+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.CYumCXLm9kI6ZCeSjcvzHazw4EpBjE4_0 2024-09-19T15:31:39.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.688+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16289645197650472452', time=2024-09-19T16:47:20.852895+0000, chain.objs.size()=1 2024-09-19T15:31:39.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.688+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.CiWrEqF-m3zNbof5H0U8BPQgLgx32m5_0 2024-09-19T15:31:39.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.688+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12903805154711626776', time=2024-09-19T16:47:23.331197+0000, chain.objs.size()=1 2024-09-19T15:31:39.693 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.688+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.F6iFL2IIT5Qc1jCLRH8vZAj0VcGO-WD_0 2024-09-19T15:31:39.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.688+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4387580816890320725', time=2024-09-19T16:47:24.510344+0000, chain.objs.size()=1 2024-09-19T15:31:39.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.688+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.pKoaUzBGMj7JNLWw2YNSSS9uqUm1sAG_0 2024-09-19T15:31:39.694 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.688+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5946646483349681556', time=2024-09-19T16:47:25.336725+0000, chain.objs.size()=1 2024-09-19T15:31:39.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.688+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.MqLdSjzFFtW_bt7FBwWpxVQ2F3MGlp6_0 2024-09-19T15:31:39.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.688+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12297707168222427842', time=2024-09-19T16:47:25.550760+0000, chain.objs.size()=1 2024-09-19T15:31:39.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.688+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.6aeuj7lnvsxqZNkonnCq7KWCQYYm3bo_0 2024-09-19T15:31:39.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.688+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10105384442118207100', time=2024-09-19T16:47:27.003777+0000, chain.objs.size()=1 2024-09-19T15:31:39.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.688+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.A6Qa9idQsTgQEvFiWFeKi9f-uCkzdne_0 2024-09-19T15:31:39.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.688+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4429251512688013171', time=2024-09-19T16:47:27.614558+0000, chain.objs.size()=1 2024-09-19T15:31:39.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.688+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.4cz5ZGMsoV0b1oX4Tn9FzUqheTFg6iI_0 2024-09-19T15:31:39.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.688+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9266264928848000357', time=2024-09-19T16:47:27.850758+0000, chain.objs.size()=1 2024-09-19T15:31:39.695 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.688+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.3BjQlY0QI5VgjAvM8pCaLZX2Pv3YiA4_0 2024-09-19T15:31:39.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.692+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12091738829939745393', time=2024-09-19T16:47:35.776976+0000, chain.objs.size()=1 2024-09-19T15:31:39.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.692+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.IyHy6-FY5HzK9784R4AVj91n221B3ai_0 2024-09-19T15:31:39.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.692+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14502331633774869602', time=2024-09-19T16:47:41.131694+0000, chain.objs.size()=1 2024-09-19T15:31:39.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.692+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.prLmJJYbXaWkeK-ejG5rdbvnhjhZcCx_0 2024-09-19T15:31:39.697 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.692+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8131255759343817293', time=2024-09-19T16:47:41.662404+0000, chain.objs.size()=1 2024-09-19T15:31:39.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.692+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.DiIXu8yrDNb9jqeeAlrJ6gEbCX6ezcG_0 2024-09-19T15:31:39.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.692+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17561453165404745015', time=2024-09-19T16:47:42.172254+0000, chain.objs.size()=1 2024-09-19T15:31:39.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.692+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.c7mJchmTpjYch_4m2K5CrZtCLLVgYwb_0 2024-09-19T15:31:39.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.692+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11038008251143213159', time=2024-09-19T16:47:42.366575+0000, chain.objs.size()=1 2024-09-19T15:31:39.698 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.692+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.kJtVXios8UuFLsCvNsMGeH-qHF00sGf_0 2024-09-19T15:31:39.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.696+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1332708774189596973', time=2024-09-19T16:47:43.504217+0000, chain.objs.size()=1 2024-09-19T15:31:39.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.696+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.zDjFAz9FU1y8_VaCrx-zPLJOIET5NMg_0 2024-09-19T15:31:39.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.696+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12895729996805225269', time=2024-09-19T16:47:43.615580+0000, chain.objs.size()=1 2024-09-19T15:31:39.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.696+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.acMXGrVoO7Y4E4oAnK6E_bDuSCDXk56_0 2024-09-19T15:31:39.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.696+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14235414449471745939', time=2024-09-19T16:47:43.903953+0000, chain.objs.size()=1 2024-09-19T15:31:39.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.696+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.QQpVVfVLjLQgWPTFlAgJcEFQvxdMZgR_0 2024-09-19T15:31:39.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.696+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6383298523585072982', time=2024-09-19T16:47:44.398567+0000, chain.objs.size()=1 2024-09-19T15:31:39.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.696+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.RaAfg8JEbw-6Kmu0pRGynFB7W3smoKn_0 2024-09-19T15:31:39.701 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.696+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5177770726346199675', time=2024-09-19T16:47:45.793184+0000, chain.objs.size()=1 2024-09-19T15:31:39.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.696+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.zrh_-Gr5RpEePrU0vICizHy-VqoQrJG_0 2024-09-19T15:31:39.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.696+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7727593528726909108', time=2024-09-19T16:47:47.908495+0000, chain.objs.size()=1 2024-09-19T15:31:39.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.696+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.HRzT6g5CcXPdQASqh7JVUwURYfojYEJ_0 2024-09-19T15:31:39.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.696+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15370022663461299860', time=2024-09-19T16:47:48.045716+0000, chain.objs.size()=1 2024-09-19T15:31:39.702 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.696+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ehHbFFYQe87_6SfmHoUNw_kHYpIl0OT_0 2024-09-19T15:31:39.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.696+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14911755739105057346', time=2024-09-19T16:47:49.062602+0000, chain.objs.size()=1 2024-09-19T15:31:39.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.696+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.9OTAKgkRN8tvk5r2CP9ZYWnqWn_EcZW_0 2024-09-19T15:31:39.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.696+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11653428891437031242', time=2024-09-19T16:49:34.804895+0000, chain.objs.size()=1 2024-09-19T15:31:39.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.696+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.dnmc12WQ4avJ6rcajKPm9KjZkKkV6V6_0 2024-09-19T15:31:39.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.696+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1956440464577093154', time=2024-09-19T16:49:35.574579+0000, chain.objs.size()=1 2024-09-19T15:31:39.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.696+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.dTrHDIB_aH_9A6Jn80Cs7SovLQ-7nc8_0 2024-09-19T15:31:39.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.696+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.66815029125757501', time=2024-09-19T16:49:37.178598+0000, chain.objs.size()=1 2024-09-19T15:31:39.703 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.696+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.9oFBolMlHTwsumUJGpfPq5deZIPY1Yf_0 2024-09-19T15:31:39.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.700+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15310750663104661384', time=2024-09-19T16:49:37.788740+0000, chain.objs.size()=1 2024-09-19T15:31:39.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.700+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.NRo55zevZYisRhj5zm8hvfhPbbHDBV4_0 2024-09-19T15:31:39.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.700+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17005555929050614018', time=2024-09-19T16:49:37.887453+0000, chain.objs.size()=1 2024-09-19T15:31:39.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.700+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.GRPxq7UKm8hmDDYxoXHRL_Z9lAqhCb9_0 2024-09-19T15:31:39.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.700+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4434444512383758965', time=2024-09-19T16:49:39.336642+0000, chain.objs.size()=1 2024-09-19T15:31:39.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.700+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.vintJLYqOlh1OBXNnbh1aQdeWSX3E8g_0 2024-09-19T15:31:39.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.700+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14176950160543038882', time=2024-09-19T16:49:42.031729+0000, chain.objs.size()=1 2024-09-19T15:31:39.706 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.700+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.VtOfj1cRiRtOo8PFQN1sM0Mhu8cY_fl_0 2024-09-19T15:31:39.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.700+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13554934361672598690', time=2024-09-19T16:49:44.715829+0000, chain.objs.size()=1 2024-09-19T15:31:39.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.700+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.OMlTXyHJrz5M7XbwIYeSkqU-aYRk1M__0 2024-09-19T15:31:39.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.700+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4872747946107617786', time=2024-09-19T16:49:45.970416+0000, chain.objs.size()=1 2024-09-19T15:31:39.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.700+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.nFufEIy1NzRej10VIfv5AgqEmVtXRff_0 2024-09-19T15:31:39.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.700+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8597460225482398556', time=2024-09-19T16:49:46.867599+0000, chain.objs.size()=1 2024-09-19T15:31:39.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.700+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.qtqMEhECgv2PSZqLoZc1zQBrnVMV0vH_0 2024-09-19T15:31:39.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.700+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6462593139556567148', time=2024-09-19T16:49:48.330569+0000, chain.objs.size()=1 2024-09-19T15:31:39.707 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.700+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Tyy-YvKOrljtozF0A32-OHHgxiiPFzO_0 2024-09-19T15:31:39.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.700+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6224639684709901561', time=2024-09-19T16:49:49.311786+0000, chain.objs.size()=1 2024-09-19T15:31:39.708 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.700+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.z6YimvvdorC5hCOOA_1IJVf3MdioFyX_0 2024-09-19T15:31:39.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.704+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14166851481679672329', time=2024-09-19T16:49:49.576323+0000, chain.objs.size()=1 2024-09-19T15:31:39.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.704+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.xYXUsHlWiXkb4BEK69uBilkvl7KMgsU_0 2024-09-19T15:31:39.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.704+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17176327377009110746', time=2024-09-19T16:49:49.699422+0000, chain.objs.size()=1 2024-09-19T15:31:39.709 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.704+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.fLsnaynDsZXrtznY03mnThPzf7_JSoN_0 2024-09-19T15:31:39.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.704+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5308345106202922499', time=2024-09-19T16:49:50.149992+0000, chain.objs.size()=1 2024-09-19T15:31:39.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.704+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ixrWZL_vXnXGElVBEf3m7HUBJHhyOmf_0 2024-09-19T15:31:39.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.704+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14348676410825478005', time=2024-09-19T16:49:52.565234+0000, chain.objs.size()=1 2024-09-19T15:31:39.710 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.704+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.b4fAajpI_cZudWckZ8xKV5nx55hKXtY_0 2024-09-19T15:31:39.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.704+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6121165227256362283', time=2024-09-19T16:49:52.828324+0000, chain.objs.size()=1 2024-09-19T15:31:39.711 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.704+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.H1fHO-GiKnFYxIw-vIDPfeX4fO4tiy__0 2024-09-19T15:31:39.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.708+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17636184087360774572', time=2024-09-19T16:49:54.059894+0000, chain.objs.size()=1 2024-09-19T15:31:39.712 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.708+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.OmTcZ_SvTSCHuBXBmoJ6LgRsmNWFWMj_0 2024-09-19T15:31:39.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.708+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.778079233122961342', time=2024-09-19T16:49:54.997986+0000, chain.objs.size()=1 2024-09-19T15:31:39.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.708+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.7sOcOCvwYYyQGFQGjeOaPcvnTWV52Ac_0 2024-09-19T15:31:39.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.708+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1781431128486891871', time=2024-09-19T16:49:55.168619+0000, chain.objs.size()=1 2024-09-19T15:31:39.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.708+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.RPChso1yCa0UV9UcMugTXsplu9_Drsb_0 2024-09-19T15:31:39.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.708+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17645656834267071603', time=2024-09-19T16:49:56.178319+0000, chain.objs.size()=1 2024-09-19T15:31:39.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.708+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.IxPV10FvknsxXtpKCVcmKepX22NceQU_0 2024-09-19T15:31:39.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.708+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1477936037120665958', time=2024-09-19T16:49:57.756783+0000, chain.objs.size()=1 2024-09-19T15:31:39.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.708+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.i-GomIwfdIDzhIo3uLhyGIMRVIeKv3J_0 2024-09-19T15:31:39.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.708+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4603756175434223577', time=2024-09-19T16:49:58.061705+0000, chain.objs.size()=1 2024-09-19T15:31:39.713 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.708+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.OQCHQ87P0Hpsr0o7wo6f6AGJgqDuKVY_0 2024-09-19T15:31:39.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.708+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17725408749722563466', time=2024-09-19T16:49:59.270802+0000, chain.objs.size()=1 2024-09-19T15:31:39.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.708+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.MjfdfzLWvNte7TmVnmx0H_h286F4Fgr_0 2024-09-19T15:31:39.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.708+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6042842273634883821', time=2024-09-19T16:49:59.962819+0000, chain.objs.size()=1 2024-09-19T15:31:39.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.708+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.an8yW1GIdpPHKWFl3uIhVhyLIgcnTQ3_0 2024-09-19T15:31:39.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.708+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8522071092489990434', time=2024-09-19T16:50:00.437389+0000, chain.objs.size()=1 2024-09-19T15:31:39.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.708+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.R85DPdzjQmZTgkEljtpQDvEt0knCwmW_0 2024-09-19T15:31:39.714 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.708+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12971129525847343170', time=2024-09-19T16:50:01.548504+0000, chain.objs.size()=1 2024-09-19T15:31:39.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.708+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.pO8k4d98MeJVMHnthxGVUsjg6yPchPC_0 2024-09-19T15:31:39.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.708+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18052483114741615352', time=2024-09-19T16:50:04.079722+0000, chain.objs.size()=1 2024-09-19T15:31:39.715 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.708+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.d_sRvfE5HB7YSGG75nrUAyELdBCA25y_0 2024-09-19T15:31:39.718 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.712+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49813 2024-09-19T15:31:39.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.716+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-19T15:31:39.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.716+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13968463731949031875', time=2024-09-19T16:50:04.513196+0000, chain.objs.size()=1 2024-09-19T15:31:39.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.716+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.EEGyu0FYME7j6gEGupmHfpvprg0uBQ3_0 2024-09-19T15:31:39.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.716+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16780923649297279396', time=2024-09-19T16:50:04.619479+0000, chain.objs.size()=1 2024-09-19T15:31:39.721 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.716+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.FwdCWoysNsnII8PJTzuBYwaWskkd2bn_0 2024-09-19T15:31:39.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.716+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3304041535929022187', time=2024-09-19T16:50:04.815461+0000, chain.objs.size()=1 2024-09-19T15:31:39.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.716+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.FHKrDyRtEzXWtl7bVKlwBPEtFX_Ee05_0 2024-09-19T15:31:39.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.716+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2286333537758399609', time=2024-09-19T16:50:24.133371+0000, chain.objs.size()=1 2024-09-19T15:31:39.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.716+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.333__shadow_.Genm-1KwNQJSUaJxP9Cb59uJx_AuY95_0 2024-09-19T15:31:39.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.716+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1096144990508656699', time=2024-09-19T16:51:03.838546+0000, chain.objs.size()=1 2024-09-19T15:31:39.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.716+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.353__shadow_.6ZBc9-7oRu-yxxceWCE5oeCEhLgoJH7_0 2024-09-19T15:31:39.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.716+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5080945976128272352', time=2024-09-19T16:51:58.558260+0000, chain.objs.size()=1 2024-09-19T15:31:39.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.716+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.381__shadow_.GtUwHw8rO9H9LCoLHZFD23qxg4o8DTD_0 2024-09-19T15:31:39.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.716+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8657616190713070381', time=2024-09-19T16:52:26.146257+0000, chain.objs.size()=1 2024-09-19T15:31:39.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.716+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.394__shadow:jrkiKF0UnlWpWgT8iNBRz3kHDmEB0Gb_.9C54hhufIGmXh74tCamfPHSM-6LA94P_0 2024-09-19T15:31:39.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.716+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5669498712115349462', time=2024-09-19T16:55:03.455016+0000, chain.objs.size()=1 2024-09-19T15:31:39.722 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.716+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.465__shadow_.mEBaW2aa0LIJQnGvivOMCalW9VHLN9t_0 2024-09-19T15:31:39.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.716+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15807680975164024344', time=2024-09-19T16:56:13.063379+0000, chain.objs.size()=1 2024-09-19T15:31:39.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.716+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.499__shadow_.P97EvhhF7Bjl-ra-TAKtHEp8-J94epE_0 2024-09-19T15:31:39.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.716+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~1bbHHnshQiAlv_0BuBu5kgXGA4Oqmp1', time=2024-09-19T17:04:23.226547+0000, chain.objs.size()=2 2024-09-19T15:31:39.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.716+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.531__multipart_mymultipart.2~1bbHHnshQiAlv_0BuBu5kgXGA4Oqmp1.1 2024-09-19T15:31:39.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.716+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.531__multipart_mymultipart.2~1bbHHnshQiAlv_0BuBu5kgXGA4Oqmp1.2 2024-09-19T15:31:39.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.716+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.169680062458209468', time=2024-09-19T17:06:13.527252+0000, chain.objs.size()=1 2024-09-19T15:31:39.723 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.716+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.553__shadow_.7DHEcuy73L-deIqQJ5091Us4B5oRM6P_0 2024-09-19T15:31:39.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.720+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6859885671226945948', time=2024-09-19T17:19:18.338025+0000, chain.objs.size()=1 2024-09-19T15:31:39.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.720+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.650__shadow_.qX3u4wNsmjziGogr87XBDJQp80AGM7w_0 2024-09-19T15:31:39.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.720+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1508867793974883107', time=2024-09-19T17:21:45.794267+0000, chain.objs.size()=1 2024-09-19T15:31:39.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.720+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.698__shadow:bAWSeY-B1QeSOQtD0dmkSPOO.WGbPiT_.CKizsW_PLcyuCtbLBSdqMr_Qd_pS98V_0 2024-09-19T15:31:39.725 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.720+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13028415513489928698', time=2024-09-19T17:21:49.908714+0000, chain.objs.size()=1 2024-09-19T15:31:39.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.720+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.700__shadow:WYTzrh.0O-oSQztjh-hW-pB5TVVWvFm_.5wVf1rE2bRvqM7H7HFGVzYp28_2q8wS_0 2024-09-19T15:31:39.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.720+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1192072794212329094', time=2024-09-19T17:23:17.293299+0000, chain.objs.size()=1 2024-09-19T15:31:39.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.720+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.734__shadow_.ARSPh7cU63lqd6oZRE_620aMcdozlDB_0 2024-09-19T15:31:39.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.720+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18287899347195420604', time=2024-09-19T17:26:09.993922+0000, chain.objs.size()=1 2024-09-19T15:31:39.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.720+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.755__shadow_.o7DkzVOhUkeDmSl3B-pKvX74egdaxMi_0 2024-09-19T15:31:39.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.720+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4316591467793767922', time=2024-09-19T17:31:07.269417+0000, chain.objs.size()=1 2024-09-19T15:31:39.726 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.720+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.782__shadow_.R_NpN0ELPdKx4ldWo2AmMo9_k-OO9er_0 2024-09-19T15:31:39.729 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.724+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:39.732 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.728+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T15:31:39.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.728+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:39.735 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.728+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:39.736 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44624' 2024-09-19T15:31:39.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17043216577924663397', time=2024-09-19T16:39:54.971910+0000, chain.objs.size()=1 2024-09-19T15:31:39.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.242__shadow_.TN7MW0VPt-ozlJNOyL6-fHNAgllRTLK_0 2024-09-19T15:31:39.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10043138634674080230', time=2024-09-19T16:42:28.164759+0000, chain.objs.size()=1 2024-09-19T15:31:39.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.THv-NzUtCTahqDv1Wq6K5cBXUGYeK9o_0 2024-09-19T15:31:39.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5535621940421792008', time=2024-09-19T16:42:31.143880+0000, chain.objs.size()=1 2024-09-19T15:31:39.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Ivy_7v-1o484BIM9KOWPW24Tp98qkwp_0 2024-09-19T15:31:39.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17868298475590377515', time=2024-09-19T16:42:31.331832+0000, chain.objs.size()=1 2024-09-19T15:31:39.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.T_fHZh6VNyrkoAIWS4hrtcRN3e8RzEd_0 2024-09-19T15:31:39.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1714557756068827266', time=2024-09-19T16:42:31.475247+0000, chain.objs.size()=1 2024-09-19T15:31:39.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.cmGWPrhjeqK-er15o_hvdypwN7LY9Su_0 2024-09-19T15:31:39.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12681037145871647726', time=2024-09-19T16:42:33.296100+0000, chain.objs.size()=1 2024-09-19T15:31:39.737 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.iny3YftKc9Cc_-28Z-9lcovTJtUChIT_0 2024-09-19T15:31:39.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1741510357793434559', time=2024-09-19T16:42:33.484859+0000, chain.objs.size()=1 2024-09-19T15:31:39.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.i5DYVcG_UJkQG9-PP-J3cuED9I8oNND_0 2024-09-19T15:31:39.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10373675223546182177', time=2024-09-19T16:42:33.979709+0000, chain.objs.size()=1 2024-09-19T15:31:39.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.8-R9aAjkp5XKbUNcfNk7GDk30jvRzDe_0 2024-09-19T15:31:39.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6437855942249418163', time=2024-09-19T16:42:34.157989+0000, chain.objs.size()=1 2024-09-19T15:31:39.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.lzvFqptDl2lUOOekoGoYYzOulMKS6Q__0 2024-09-19T15:31:39.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10912655443475746488', time=2024-09-19T16:42:34.914118+0000, chain.objs.size()=1 2024-09-19T15:31:39.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.y5fGhv9MdttEwjWDcHiA9--EJSNkNM5_0 2024-09-19T15:31:39.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9130030470094437467', time=2024-09-19T16:42:37.711389+0000, chain.objs.size()=1 2024-09-19T15:31:39.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.pGTqss1pNf_TqFO2lcdB-TSOUilCT9Q_0 2024-09-19T15:31:39.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13763777230244310990', time=2024-09-19T16:42:37.968938+0000, chain.objs.size()=1 2024-09-19T15:31:39.738 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.732+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.7ppnq2tScUibdESxXEFQr1Z-bY77UbC_0 2024-09-19T15:31:39.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.736+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14903481209404099772', time=2024-09-19T16:42:38.219385+0000, chain.objs.size()=1 2024-09-19T15:31:39.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.736+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.5dr2alHLZdQ0vDjLEt8fNGurlSaI1CB_0 2024-09-19T15:31:39.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.736+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11597388565727276494', time=2024-09-19T16:42:38.998280+0000, chain.objs.size()=1 2024-09-19T15:31:39.743 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.736+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.40c4lps3ER1XMYw_cEQmi0LZ7TUrvPj_0 2024-09-19T15:31:39.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.736+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7698686944257505362', time=2024-09-19T16:42:45.155276+0000, chain.objs.size()=1 2024-09-19T15:31:39.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.736+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.pVbOvZbe1VLRPMiwFHghLBYCfkdQLVJ_0 2024-09-19T15:31:39.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.736+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3113432741514767791', time=2024-09-19T16:42:45.177983+0000, chain.objs.size()=1 2024-09-19T15:31:39.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.736+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.S730wmiUP_k5spFmxKz9R620OQKByLP_0 2024-09-19T15:31:39.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.736+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6079528646650866195', time=2024-09-19T16:42:45.412976+0000, chain.objs.size()=1 2024-09-19T15:31:39.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.736+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.CDDsqn-s4bA2PfwgMUX8epJBqHcQxVJ_0 2024-09-19T15:31:39.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.736+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9589329614165986639', time=2024-09-19T16:42:45.681337+0000, chain.objs.size()=1 2024-09-19T15:31:39.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.736+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.HKNNR5fm_3oOIlMU5qF2I5CBpPBfS-1_0 2024-09-19T15:31:39.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.736+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.825453133921557387', time=2024-09-19T16:42:46.251244+0000, chain.objs.size()=1 2024-09-19T15:31:39.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.736+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.LAjL3ca7pijxZA4FE1ZYyhbRIS3DHrD_0 2024-09-19T15:31:39.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.736+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10910150143677119998', time=2024-09-19T16:42:46.860005+0000, chain.objs.size()=1 2024-09-19T15:31:39.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.736+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.9Pj93n_pOftq97I8c5dt5lzr7aWKcUY_0 2024-09-19T15:31:39.744 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.736+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1131657039409356500', time=2024-09-19T16:42:46.861867+0000, chain.objs.size()=1 2024-09-19T15:31:39.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.736+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.4U5cTRK8tUVR0WPS3GE_w0EL6yAA626_0 2024-09-19T15:31:39.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.736+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13211673635045656991', time=2024-09-19T16:42:47.437874+0000, chain.objs.size()=1 2024-09-19T15:31:39.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.736+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.2GS6NuTpjKMsv07xdnXfGwD_AQu1oxe_0 2024-09-19T15:31:39.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.736+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15201293466958736050', time=2024-09-19T16:42:50.532141+0000, chain.objs.size()=1 2024-09-19T15:31:39.745 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.736+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.3dEN-A5kIkJbcWk6QsI_Q_j_uj_v_r1_0 2024-09-19T15:31:39.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.744+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3402423550395527396', time=2024-09-19T16:42:53.841552+0000, chain.objs.size()=1 2024-09-19T15:31:39.748 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.744+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Pd1ASUmX-swu5qJKTFYxc6tSiWbj3Ol_0 2024-09-19T15:31:39.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.744+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7169626542173561334', time=2024-09-19T16:42:55.128438+0000, chain.objs.size()=1 2024-09-19T15:31:39.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.744+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.v357c3Km2oKXCUmMMI2w2L_7pq3IL6Z_0 2024-09-19T15:31:39.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.744+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11246078137664319956', time=2024-09-19T16:42:55.789819+0000, chain.objs.size()=1 2024-09-19T15:31:39.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.744+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.W9RCZjK0yWEB_v0ryiozyIVLe-R9xZM_0 2024-09-19T15:31:39.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.744+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14865285259534598830', time=2024-09-19T16:42:55.914948+0000, chain.objs.size()=1 2024-09-19T15:31:39.751 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.744+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.V1xZnlFaqPWMMIOyMqXTixQm_D9YnIQ_0 2024-09-19T15:31:39.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.744+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17595535651171287769', time=2024-09-19T16:42:57.717338+0000, chain.objs.size()=1 2024-09-19T15:31:39.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.744+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.30_4iACRPArJZYBMWDB7oAR-NmvJx0B_0 2024-09-19T15:31:39.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.744+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3134585148528012193', time=2024-09-19T16:42:57.856693+0000, chain.objs.size()=1 2024-09-19T15:31:39.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.744+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.gpHJ9dqqfCN8CUEA3xn3PF2cCbPkId1_0 2024-09-19T15:31:39.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.744+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6786517228785905818', time=2024-09-19T16:42:58.614683+0000, chain.objs.size()=1 2024-09-19T15:31:39.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.744+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.vk1N96pUXvVdCPJ1VxV5b2G1CfrW-R0_0 2024-09-19T15:31:39.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.744+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13657974242344433464', time=2024-09-19T16:42:59.102225+0000, chain.objs.size()=1 2024-09-19T15:31:39.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.744+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.9FXvZTAQA47ielmwdQsUio065iKtET-_0 2024-09-19T15:31:39.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.744+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13495487078033968642', time=2024-09-19T16:42:59.834638+0000, chain.objs.size()=1 2024-09-19T15:31:39.752 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.744+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.lCmZlY54LXhjFFjSXPXewu4M7EK2m94_0 2024-09-19T15:31:39.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.744+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3013200266710303447', time=2024-09-19T16:42:59.991195+0000, chain.objs.size()=1 2024-09-19T15:31:39.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.744+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.jErf2MNVvVqTQSY6ec1NxSbCaJKqaGD_0 2024-09-19T15:31:39.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.744+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7190470533761730882', time=2024-09-19T16:43:00.028368+0000, chain.objs.size()=1 2024-09-19T15:31:39.753 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.744+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Gs020dAU6dFPUtyNj7ZJJmAYmZLHaJs_0 2024-09-19T15:31:39.754 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.748+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1962586494908924424', time=2024-09-19T16:43:13.421697+0000, chain.objs.size()=1 2024-09-19T15:31:39.754 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.748+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.268__shadow_.j8F5y_kLGqTER4LfbT3utHTAsoBQZZB_0 2024-09-19T15:31:39.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.752+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13457476710858615054', time=2024-09-19T16:43:28.969493+0000, chain.objs.size()=1 2024-09-19T15:31:39.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.752+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.275__shadow_.QY-Hn9rse_oRRKjUdBStKJXtbXBCGfv_0 2024-09-19T15:31:39.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.752+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6383445062573501149', time=2024-09-19T16:43:28.971165+0000, chain.objs.size()=1 2024-09-19T15:31:39.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.752+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.275__shadow_.LEgu1Olx0EdXPUOJfZb047Tpd0aeqWl_0 2024-09-19T15:31:39.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.752+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.617150303731295968', time=2024-09-19T16:44:12.894587+0000, chain.objs.size()=1 2024-09-19T15:31:39.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.752+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_._UK4QIAOfgua3oZzSS5HfQkQSHHKkxe_0 2024-09-19T15:31:39.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.752+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4750904830643214288', time=2024-09-19T16:44:25.716442+0000, chain.objs.size()=1 2024-09-19T15:31:39.758 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.752+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.296__shadow_.xHCQeMAy3F4F95BYcNbgOIhgb7gzpUA_0 2024-09-19T15:31:39.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.752+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16942646170301397714', time=2024-09-19T16:47:19.228238+0000, chain.objs.size()=1 2024-09-19T15:31:39.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.752+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.wx2XvRy6vw8X4HD6hlpcFIP_aEGLszy_0 2024-09-19T15:31:39.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.752+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3693690495006572955', time=2024-09-19T16:47:19.516108+0000, chain.objs.size()=1 2024-09-19T15:31:39.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.752+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.eggkJ1FUC-G-8yF6MxE7Ut2MjNoeW5p_0 2024-09-19T15:31:39.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.752+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13718974967680835058', time=2024-09-19T16:47:23.326789+0000, chain.objs.size()=1 2024-09-19T15:31:39.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.752+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Dih7gSWXqKrNK3cV9p2-kQyF6aUEK-t_0 2024-09-19T15:31:39.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.752+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15126171940440277617', time=2024-09-19T16:47:24.099170+0000, chain.objs.size()=1 2024-09-19T15:31:39.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.752+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.YLul19p23f-sHFblAhHUYrNJIYZVc21_0 2024-09-19T15:31:39.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.752+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15844783151512734290', time=2024-09-19T16:47:24.631427+0000, chain.objs.size()=1 2024-09-19T15:31:39.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.752+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Av_MwfWrp0WyD4fb7SMbjHt2N1cOAPF_0 2024-09-19T15:31:39.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.752+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10672829578688991653', time=2024-09-19T16:47:25.554076+0000, chain.objs.size()=1 2024-09-19T15:31:39.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.752+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ycVN0bydkUZQBNe2tdrKD6Zu1fNatKw_0 2024-09-19T15:31:39.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.752+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8550261513475774151', time=2024-09-19T16:47:25.701530+0000, chain.objs.size()=1 2024-09-19T15:31:39.759 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.752+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.AGEVohq1rekVv1YfImqXceZZt_rQ4WA_0 2024-09-19T15:31:39.762 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.756+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.785076427406906839', time=2024-09-19T16:47:27.614564+0000, chain.objs.size()=1 2024-09-19T15:31:39.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.756+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.fyiNGSuBcsLJUeIsxVhEhzrOD_NG2CU_0 2024-09-19T15:31:39.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.756+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5512466299888345245', time=2024-09-19T16:47:27.715372+0000, chain.objs.size()=1 2024-09-19T15:31:39.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.756+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.xo6P66e9YOTS5PCK_1oNcrMYRTZhAEN_0 2024-09-19T15:31:39.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.756+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9057131301599920962', time=2024-09-19T16:47:29.454326+0000, chain.objs.size()=1 2024-09-19T15:31:39.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.756+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.-IggaL0vMyZqO7VwuX6RG06amdKdHSB_0 2024-09-19T15:31:39.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.756+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5886287192776119691', time=2024-09-19T16:47:31.656666+0000, chain.objs.size()=1 2024-09-19T15:31:39.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.756+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Hg-77WE6qMT_bVBppg_B1XRr4DOT814_0 2024-09-19T15:31:39.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.756+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11745951665667218325', time=2024-09-19T16:47:32.462405+0000, chain.objs.size()=1 2024-09-19T15:31:39.763 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.756+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.m93mzD9X4yxZvla3vrafNNV6eqC3gTV_0 2024-09-19T15:31:39.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.760+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10416779801101425847', time=2024-09-19T16:47:34.257434+0000, chain.objs.size()=1 2024-09-19T15:31:39.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.760+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.E6MPmKIGl7oViMuOVCqC2Q2FbwX14hU_0 2024-09-19T15:31:39.765 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.760+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11815506662703603891', time=2024-09-19T16:47:34.259329+0000, chain.objs.size()=1 2024-09-19T15:31:39.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.760+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.6pHLrpOMeQgVH5m3Ihnabo1fAZK20ut_0 2024-09-19T15:31:39.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.760+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5063465157082241887', time=2024-09-19T16:47:34.261486+0000, chain.objs.size()=1 2024-09-19T15:31:39.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.760+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.4lqT9BWyHN7HRjSJCUfUjg5ehqEoHJ-_0 2024-09-19T15:31:39.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.760+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11921494159547419077', time=2024-09-19T16:47:34.373018+0000, chain.objs.size()=1 2024-09-19T15:31:39.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.760+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.EpX9JV4bMKPoy1r1lynosQjfExaxO9-_0 2024-09-19T15:31:39.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.760+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1363061610019178029', time=2024-09-19T16:47:36.399159+0000, chain.objs.size()=1 2024-09-19T15:31:39.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.760+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Q_OAQHsazdaIgTDJfcpoCmV504eqrIy_0 2024-09-19T15:31:39.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.760+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8645146699266946463', time=2024-09-19T16:47:36.400893+0000, chain.objs.size()=1 2024-09-19T15:31:39.766 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.760+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ht9SkqkGX9kl8Dhna-gzVF0zVoWj4Fh_0 2024-09-19T15:31:39.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3385906954757960249', time=2024-09-19T16:47:36.402567+0000, chain.objs.size()=1 2024-09-19T15:31:39.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.764+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.-jafoFxpIuULflP4P7P58erxYCq9kAc_0 2024-09-19T15:31:39.768 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1410973878443872521', time=2024-09-19T16:47:36.625255+0000, chain.objs.size()=1 2024-09-19T15:31:39.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.764+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.2cA6anq01w-IdAcgJjAJ8_twI7KVsQc_0 2024-09-19T15:31:39.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1444951924820884526', time=2024-09-19T16:47:36.628420+0000, chain.objs.size()=1 2024-09-19T15:31:39.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.764+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.QWIyog6G4_Q9_-nYpEveuCanpEW2clc_0 2024-09-19T15:31:39.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6973360037555500144', time=2024-09-19T16:47:36.868849+0000, chain.objs.size()=1 2024-09-19T15:31:39.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.764+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.sGT6cqdQBnOY4IiISVrsYpCrFWkhXwB_0 2024-09-19T15:31:39.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5215298799279766293', time=2024-09-19T16:47:41.354459+0000, chain.objs.size()=1 2024-09-19T15:31:39.769 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.764+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.7NoAnyFfc_n7CObzKpj3YKpwJV0Nitg_0 2024-09-19T15:31:39.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7159435499315711251', time=2024-09-19T16:47:42.231988+0000, chain.objs.size()=1 2024-09-19T15:31:39.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.764+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.aqFayfbJbYQOLVwhrIe30pB3jGy42wW_0 2024-09-19T15:31:39.771 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15389963813646454189', time=2024-09-19T16:47:42.308267+0000, chain.objs.size()=1 2024-09-19T15:31:39.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.764+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.CVbMF8CHpPA7NcT1RNSq4Wk_u7Xh8mC_0 2024-09-19T15:31:39.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13684040830479592052', time=2024-09-19T16:47:42.583392+0000, chain.objs.size()=1 2024-09-19T15:31:39.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.764+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.h01oIqdsVWNHdQKiREbCIpvV15U9q8I_0 2024-09-19T15:31:39.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11161352465129346781', time=2024-09-19T16:47:42.719675+0000, chain.objs.size()=1 2024-09-19T15:31:39.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.764+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.l6ZX24U6XQr-oS8tCoaq8DS-lVL4UE4_0 2024-09-19T15:31:39.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11174193482743858317', time=2024-09-19T16:47:43.504023+0000, chain.objs.size()=1 2024-09-19T15:31:39.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.764+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.0xkqmhkM_sScRquDtc9SGPbP0ohbah2_0 2024-09-19T15:31:39.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.764+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11207334588064273120', time=2024-09-19T16:47:43.506525+0000, chain.objs.size()=1 2024-09-19T15:31:39.772 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.764+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.2F5PcWF8bMl8LeKsgbTd7JyYL6C1fvb_0 2024-09-19T15:31:39.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.768+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4315200780860328340', time=2024-09-19T16:47:44.011179+0000, chain.objs.size()=1 2024-09-19T15:31:39.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.768+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.-7nkqGD3D5Opx5ZLh6KLkdN8wGTpIbv_0 2024-09-19T15:31:39.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.768+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.541699951943457369', time=2024-09-19T16:47:44.013280+0000, chain.objs.size()=1 2024-09-19T15:31:39.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.768+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.CUsFBj3sW8DAfIncDyNMIgiRak4kxes_0 2024-09-19T15:31:39.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.768+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6465512052237475956', time=2024-09-19T16:47:44.628588+0000, chain.objs.size()=1 2024-09-19T15:31:39.774 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.768+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.XvO50nMls5CEuUVhaTH21yagNNxdmHc_0 2024-09-19T15:31:39.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.768+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3073189676100824692', time=2024-09-19T16:47:47.552668+0000, chain.objs.size()=1 2024-09-19T15:31:39.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.768+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.IQRlHyq80BgTRGlPa4EXDZThTVvVvF8_0 2024-09-19T15:31:39.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.768+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18393154606514708250', time=2024-09-19T16:47:47.879649+0000, chain.objs.size()=1 2024-09-19T15:31:39.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.768+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.mlV7GndaSp8jxu7Cy20lv0bKVbKOyTH_0 2024-09-19T15:31:39.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.768+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3941095363490035471', time=2024-09-19T16:47:48.454775+0000, chain.objs.size()=1 2024-09-19T15:31:39.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.768+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.H8t9yfLuWTMqiI_cSUUJIynKhCS0vMA_0 2024-09-19T15:31:39.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.768+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17696142061639664803', time=2024-09-19T16:47:49.434673+0000, chain.objs.size()=1 2024-09-19T15:31:39.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.768+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.7IUKfkGdYWi2RG3EcKCZjLP0IL-sryI_0 2024-09-19T15:31:39.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.768+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9264856744080869731', time=2024-09-19T16:47:49.487073+0000, chain.objs.size()=1 2024-09-19T15:31:39.775 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.768+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.YsK-ZxaatryColtKBCgy_NM25wF2b7s_0 2024-09-19T15:31:39.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.768+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2017126883894677315', time=2024-09-19T16:49:34.957553+0000, chain.objs.size()=1 2024-09-19T15:31:39.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.768+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.7NMwGA6X9mYAWoVNbx4cl8kApON9P6A_0 2024-09-19T15:31:39.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.768+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16995556638655729564', time=2024-09-19T16:49:36.318832+0000, chain.objs.size()=1 2024-09-19T15:31:39.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.768+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.XeSbGzuzqxNMvQt6d2vLYQXTsXGkMpN_0 2024-09-19T15:31:39.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.772+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4835694840144258890', time=2024-09-19T16:49:36.733282+0000, chain.objs.size()=1 2024-09-19T15:31:39.776 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.772+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.EgVomG8C6vIrP631HwxAoAL-WusaC4H_0 2024-09-19T15:31:39.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.772+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13334743207346340090', time=2024-09-19T16:49:37.168809+0000, chain.objs.size()=1 2024-09-19T15:31:39.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.772+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.KKLRO0qb0TblptrWnPeJJa1dq7Tg7ez_0 2024-09-19T15:31:39.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.772+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12326627872507310063', time=2024-09-19T16:49:40.128439+0000, chain.objs.size()=1 2024-09-19T15:31:39.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.772+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.UD-2hRm2bHWoBciR-BEaG0moYu7uEsm_0 2024-09-19T15:31:39.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.772+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6637268827091370827', time=2024-09-19T16:49:40.576774+0000, chain.objs.size()=1 2024-09-19T15:31:39.779 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.772+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.af0-5Tbs7BW9pbqFigpQs-TKuKcKkzi_0 2024-09-19T15:31:39.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.772+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2882533462729067603', time=2024-09-19T16:49:40.815129+0000, chain.objs.size()=1 2024-09-19T15:31:39.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.772+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.TMrw1bLQMXR7zqlUwlHybkQcaxwYW82_0 2024-09-19T15:31:39.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.772+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4885570437235721291', time=2024-09-19T16:49:40.816662+0000, chain.objs.size()=1 2024-09-19T15:31:39.780 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.772+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.FrOr25yTQ5dpHpvqhwss_rJOMEtgVpF_0 2024-09-19T15:31:39.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.776+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8369429803289531393', time=2024-09-19T16:49:41.452142+0000, chain.objs.size()=1 2024-09-19T15:31:39.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.776+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.MPPjaKSaOtzYOahKwveEPfhfqCyvKtG_0 2024-09-19T15:31:39.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.776+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2838278331741038811', time=2024-09-19T16:49:44.053132+0000, chain.objs.size()=1 2024-09-19T15:31:39.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.776+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.zjdfqC-dpJKZaFtzQnZwYEBE6_8vjMl_0 2024-09-19T15:31:39.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.776+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13867251541667836271', time=2024-09-19T16:49:44.714958+0000, chain.objs.size()=1 2024-09-19T15:31:39.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.776+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.g8G193yi_m0Mx8jiVti8OhjkV5P1wss_0 2024-09-19T15:31:39.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.776+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7459627760755026928', time=2024-09-19T16:49:45.086451+0000, chain.objs.size()=1 2024-09-19T15:31:39.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.776+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.x9u2-KXR2FqGhwLiE9GHOhtyLPqvBk1_0 2024-09-19T15:31:39.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.776+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2793714753115445176', time=2024-09-19T16:49:45.692459+0000, chain.objs.size()=1 2024-09-19T15:31:39.782 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.776+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.97gybZlMdR7CF_HPj1yvlc5oIwduZm2_0 2024-09-19T15:31:39.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.776+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12413371317140535603', time=2024-09-19T16:49:45.708466+0000, chain.objs.size()=1 2024-09-19T15:31:39.783 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.776+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.WvGEDoipd7BySu-0fCPF80DcNvGG5ME_0 2024-09-19T15:31:39.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.780+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13725987658328049403', time=2024-09-19T16:49:45.847831+0000, chain.objs.size()=1 2024-09-19T15:31:39.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.780+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.8merkGo2fPPtj8g1erGx2ohkvvKw6HH_0 2024-09-19T15:31:39.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.780+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9646844967741972091', time=2024-09-19T16:49:49.154834+0000, chain.objs.size()=1 2024-09-19T15:31:39.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.780+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.QEhB5BLhR37iUtQdkrazq4zINW9UecZ_0 2024-09-19T15:31:39.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.780+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9768902788154182882', time=2024-09-19T16:49:49.249523+0000, chain.objs.size()=1 2024-09-19T15:31:39.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.780+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.IOblL6mrh3R_cBXN13sysi1zA-WmZ4v_0 2024-09-19T15:31:39.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.780+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.450928475070294887', time=2024-09-19T16:49:52.344750+0000, chain.objs.size()=1 2024-09-19T15:31:39.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.780+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.h_DQA7ajLE7GZGD7n-_KHBWBF4_7LG2_0 2024-09-19T15:31:39.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.780+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2364688602954134974', time=2024-09-19T16:49:52.563305+0000, chain.objs.size()=1 2024-09-19T15:31:39.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.780+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.xZTnxGqxeWUXGBTU7kN0QKqIsn9jo_a_0 2024-09-19T15:31:39.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.780+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7280224445462677979', time=2024-09-19T16:49:55.001919+0000, chain.objs.size()=1 2024-09-19T15:31:39.785 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.780+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.FC6WIov-N4gIVKZR4COOVt9ZQDoWJgS_0 2024-09-19T15:31:39.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.780+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1385944556650068334', time=2024-09-19T16:49:55.157896+0000, chain.objs.size()=1 2024-09-19T15:31:39.787 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.780+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.0Pb7XSxHluJw3EjIeYD8wM4XXWCTgYR_0 2024-09-19T15:31:39.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.780+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10708110515738423241', time=2024-09-19T16:49:56.500623+0000, chain.objs.size()=1 2024-09-19T15:31:39.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.780+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.e3fK_G4PZRGVhHXkaUpURcX5XGslOpE_0 2024-09-19T15:31:39.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.780+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6208651234596276581', time=2024-09-19T16:49:58.198081+0000, chain.objs.size()=1 2024-09-19T15:31:39.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.784+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.jSlmv79KQkXCzHISp6C6kD1kltM51o6_0 2024-09-19T15:31:39.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.784+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16479350459166565763', time=2024-09-19T16:49:59.179289+0000, chain.objs.size()=1 2024-09-19T15:31:39.788 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.784+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.K8aCQpenm5Mhvpp_8Ff9UXlARfu1huj_0 2024-09-19T15:31:39.792 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.788+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44624 2024-09-19T15:31:39.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.788+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-19T15:31:39.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.788+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11853421990098909511', time=2024-09-19T16:50:01.445412+0000, chain.objs.size()=1 2024-09-19T15:31:39.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.jv1IpgNAMr7vC208eiW_lMTvSUzDZsi_0 2024-09-19T15:31:39.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15927350951167385027', time=2024-09-19T16:50:02.830115+0000, chain.objs.size()=1 2024-09-19T15:31:39.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.AflaTPsrqfLSjkvPNfPH5u6VmkIR4RW_0 2024-09-19T15:31:39.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13925973485553410621', time=2024-09-19T16:50:02.907381+0000, chain.objs.size()=1 2024-09-19T15:31:39.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.bPoQrAet1kXYsJ-WPQ8GKfu4xkcn2Pw_0 2024-09-19T15:31:39.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16538699194009407641', time=2024-09-19T16:50:05.802020+0000, chain.objs.size()=1 2024-09-19T15:31:39.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.vJIzXpNxtEOD8OUdegFQm0tSIop4_qG_0 2024-09-19T15:31:39.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12124414065101854576', time=2024-09-19T16:50:06.533267+0000, chain.objs.size()=1 2024-09-19T15:31:39.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.u4njeJiaGP-O4-Aw-hB8mApqFpEmBmc_0 2024-09-19T15:31:39.796 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.300519188318312197', time=2024-09-19T16:50:16.159591+0000, chain.objs.size()=1 2024-09-19T15:31:39.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.329__shadow_.EEA7GH0KWtVq8rrzQg84zJBJlNC6J2H_0 2024-09-19T15:31:39.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14897263536309655969', time=2024-09-19T16:50:22.131225+0000, chain.objs.size()=1 2024-09-19T15:31:39.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.332__shadow_.zZ63vI0JcYZaZ28-2ikfJjOMJk55U8m_0 2024-09-19T15:31:39.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3184244082151254165', time=2024-09-19T16:51:45.843884+0000, chain.objs.size()=1 2024-09-19T15:31:39.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.375__shadow_.9cslG2Z9OiKsl-IEAsuUj3xKKxNMeMr_0 2024-09-19T15:31:39.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3058249015080773813', time=2024-09-19T16:52:00.672766+0000, chain.objs.size()=1 2024-09-19T15:31:39.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.382__shadow_.RaZsPie48nsDVbQnYkneHo_dagdupFL_0 2024-09-19T15:31:39.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8135042219257779459', time=2024-09-19T16:54:00.463020+0000, chain.objs.size()=1 2024-09-19T15:31:39.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.441__shadow_.eugZeVRtiKJM6aO6D-afajKZfo6ZimY_0 2024-09-19T15:31:39.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11978102589322028157', time=2024-09-19T16:54:51.621280+0000, chain.objs.size()=1 2024-09-19T15:31:39.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.461__shadow_.V0K_zoA94ecBR8jz-osFmxYEA5pZ1yM_0 2024-09-19T15:31:39.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16298842478231145008', time=2024-09-19T16:54:57.663007+0000, chain.objs.size()=1 2024-09-19T15:31:39.797 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.463__shadow_.eEWV9kdg-KwqXZ0YcZarmqga54haQQu_0 2024-09-19T15:31:39.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16183127620384823752', time=2024-09-19T16:58:26.052845+0000, chain.objs.size()=6 2024-09-19T15:31:39.798 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.519__multipart_mymultipart.2~HaxkdUHc6M6dtr-ciQ2k0B5pR9OzYFA.1 2024-09-19T15:31:39.799 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.792+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.519__multipart_mymultipart.2~HaxkdUHc6M6dtr-ciQ2k0B5pR9OzYFA.2 2024-09-19T15:31:39.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.796+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.519__multipart_mymultipart.2~HaxkdUHc6M6dtr-ciQ2k0B5pR9OzYFA.3 2024-09-19T15:31:39.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.796+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.519__multipart_mymultipart.2~HaxkdUHc6M6dtr-ciQ2k0B5pR9OzYFA.4 2024-09-19T15:31:39.800 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.796+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.519__multipart_mymultipart.2~HaxkdUHc6M6dtr-ciQ2k0B5pR9OzYFA.5 2024-09-19T15:31:39.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.796+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.519__multipart_mymultipart.2~HaxkdUHc6M6dtr-ciQ2k0B5pR9OzYFA.6 2024-09-19T15:31:39.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.796+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~Q1nfhf_vdwcEuiIhx1gmLvpBlNx4SbL', time=2024-09-19T17:04:30.514326+0000, chain.objs.size()=1 2024-09-19T15:31:39.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.796+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.534__multipart_mymultipart.2~Q1nfhf_vdwcEuiIhx1gmLvpBlNx4SbL.1 2024-09-19T15:31:39.801 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.796+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13585205899577513719', time=2024-09-19T17:07:42.976701+0000, chain.objs.size()=1 2024-09-19T15:31:39.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.796+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:VAOrp2rlO5VQ34cXGC-2WB5i.slJvOI_.Hj3jXD1VCnyPeK5ySQYg8BH2iVg0_Ye_0 2024-09-19T15:31:39.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.796+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4390671896830046996', time=2024-09-19T17:07:56.275008+0000, chain.objs.size()=1 2024-09-19T15:31:39.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.796+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:NuafXrWSvrhO6qG.6ibpcU9Ll5EGuxX_.0ItkTvDCrqXaJrTGCiYSQm8a77EKjYS_0 2024-09-19T15:31:39.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.796+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4391481059968284643', time=2024-09-19T17:08:00.107546+0000, chain.objs.size()=1 2024-09-19T15:31:39.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.796+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:bXzUttzYqcnEpWuOGuymI9JzXwVTFvq_.uqaBmNhy4iDm0SNhRnKfYYPvkRFa6WB_0 2024-09-19T15:31:39.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.796+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.119990913503593786', time=2024-09-19T17:08:16.420459+0000, chain.objs.size()=1 2024-09-19T15:31:39.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.796+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.573__shadow_.tCG1rntiov27Qte6r7N3XFAGhzZdMOp_0 2024-09-19T15:31:39.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.796+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.255862498368060582', time=2024-09-19T17:08:37.418401+0000, chain.objs.size()=1 2024-09-19T15:31:39.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.796+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.576__shadow:dwGVLcBshQ7yWkUK6Pa79OcIiWAEa9z_.u_JYPLWArG-w47EtRscQSFRYugQYpPK_0 2024-09-19T15:31:39.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.796+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10798796494176033628', time=2024-09-19T17:09:04.587912+0000, chain.objs.size()=1 2024-09-19T15:31:39.802 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.796+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:AXrpk1ANtjVKGOwc9QX1ylaU2iYNziB_.U-1pD9ZLo2BItYK6WZPMA2rv9GyK9WJ_0 2024-09-19T15:31:39.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.796+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4665483975704063700', time=2024-09-19T17:09:14.288720+0000, chain.objs.size()=1 2024-09-19T15:31:39.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.796+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:NBQQA4AlGeBe1ekgAvFbDWzVpDXkEw3_.IFMXU8upBTiljL4KQZDd_rgDtmq-KsP_0 2024-09-19T15:31:39.803 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.796+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18327800945004816726', time=2024-09-19T17:10:30.125902+0000, chain.objs.size()=1 2024-09-19T15:31:39.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.796+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.579__shadow:wTkmbDvWmIh9Mpqltkq3P3Z9sOCAntD_.sw9WKd5N9Rshv6SbYpwQQrHuMUHzMp3_0 2024-09-19T15:31:39.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.800+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15435670796675824909', time=2024-09-19T17:10:35.831125+0000, chain.objs.size()=1 2024-09-19T15:31:39.804 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.800+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.580__shadow:XpqhCiBE8OpDZ7-SorngDfEDxvS0GLp_.k7KmdDTKR1NdGKPG-6n0-_CFgl9kXFN_0 2024-09-19T15:31:39.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.800+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7808627409610406522', time=2024-09-19T17:16:26.181328+0000, chain.objs.size()=1 2024-09-19T15:31:39.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.800+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.618__shadow_.-EalNbPS7qhAB5YogKlB6RBquSMy4Xj_0 2024-09-19T15:31:39.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.800+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15346161953431590072', time=2024-09-19T17:19:22.397552+0000, chain.objs.size()=1 2024-09-19T15:31:39.806 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.800+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.652__shadow_.KECR8KBRag2DHrz-xlo8k1A6Ruf_Hdt_0 2024-09-19T15:31:39.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.800+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12809294400656954991', time=2024-09-19T17:20:37.428547+0000, chain.objs.size()=1 2024-09-19T15:31:39.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.800+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.663__shadow_.8HIK63SuTSJxCxkR8nUkQ4zoyjHiV5K_0 2024-09-19T15:31:39.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.800+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13817603594656895040', time=2024-09-19T17:22:03.280301+0000, chain.objs.size()=1 2024-09-19T15:31:39.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.800+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.706__shadow_.6k8MUTn0AxVtp0-Q8ANP7HVRnjY0UeV_0 2024-09-19T15:31:39.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.800+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5794420870779440166', time=2024-09-19T17:27:09.557140+0000, chain.objs.size()=1 2024-09-19T15:31:39.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.800+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.762__shadow_._CB1wvUYPQbxZNlW9t3oHRVnlQzgH_L_0 2024-09-19T15:31:39.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.800+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13563251467717537442', time=2024-09-19T17:28:45.707080+0000, chain.objs.size()=1 2024-09-19T15:31:39.807 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.800+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.777__shadow_.XeZoLxAOZWdvQ-8siizKhiBF45djGSv_0 2024-09-19T15:31:39.810 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.804+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:39.812 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T15:31:39.813 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:39.814 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:39.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/140886' 2024-09-19T15:31:39.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14115449580853646137', time=2024-09-19T16:39:31.660213+0000, chain.objs.size()=1 2024-09-19T15:31:39.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.233__shadow_.rNlDYHB0BGL7dz2zIDbPXSdgs1axP2W_0 2024-09-19T15:31:39.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14731634495083732808', time=2024-09-19T16:39:36.259463+0000, chain.objs.size()=1 2024-09-19T15:31:39.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.235__shadow_.alYU-JrScu4-10zlKRBoenRiZ92FBVe_0 2024-09-19T15:31:39.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17017923053445127526', time=2024-09-19T16:39:46.345340+0000, chain.objs.size()=1 2024-09-19T15:31:39.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.238__shadow_.ERbSesKqE7CXstk1FfJ9kc0RHvhMRda_0 2024-09-19T15:31:39.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15477888323408783', time=2024-09-19T16:40:07.377606+0000, chain.objs.size()=1 2024-09-19T15:31:39.815 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.246__shadow_.PQubXJ4Ax7ZVaHQfrVptgt6M9euZ_TN_0 2024-09-19T15:31:39.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18439784915953898550', time=2024-09-19T16:40:16.671128+0000, chain.objs.size()=1 2024-09-19T15:31:39.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.250__shadow_.X_4OTFTcRoY71lrWecAC0Twld6xnKqd_0 2024-09-19T15:31:39.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17980326429496254038', time=2024-09-19T16:42:28.637735+0000, chain.objs.size()=1 2024-09-19T15:31:39.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.chBvXlgVOlovJIR04tc7llyO2YOg1B5_0 2024-09-19T15:31:39.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4087191243109366602', time=2024-09-19T16:42:29.152313+0000, chain.objs.size()=1 2024-09-19T15:31:39.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.g3FSmZoXd8i7jC02K8MDgOp2gzsh5UF_0 2024-09-19T15:31:39.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6947664498843645414', time=2024-09-19T16:42:29.369567+0000, chain.objs.size()=1 2024-09-19T15:31:39.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.KD6FdeISWAb8qTYwV6O0-UFWKiO_9al_0 2024-09-19T15:31:39.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18387182135021987987', time=2024-09-19T16:42:29.497995+0000, chain.objs.size()=1 2024-09-19T15:31:39.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.MIRBG7NgVUFYkF2riCciaDrIpah0uRB_0 2024-09-19T15:31:39.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8439380597544441189', time=2024-09-19T16:42:29.625636+0000, chain.objs.size()=1 2024-09-19T15:31:39.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.k_a_N3boieMeyqkLx7DPT5sG_9evjzo_0 2024-09-19T15:31:39.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3546928808641744192', time=2024-09-19T16:42:31.041530+0000, chain.objs.size()=1 2024-09-19T15:31:39.816 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.itnrF49f5eeA2H6xCvCHZnUApdpYJ28_0 2024-09-19T15:31:39.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3036887894645985988', time=2024-09-19T16:42:31.362883+0000, chain.objs.size()=1 2024-09-19T15:31:39.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.808+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.jTsBf2WqvSvqAvWtYEo-s7QTZ21MHRn_0 2024-09-19T15:31:39.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.812+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11714451023057948340', time=2024-09-19T16:42:33.027238+0000, chain.objs.size()=1 2024-09-19T15:31:39.817 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.812+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Jmo5R7_haVVR043eY7RXVnKtP8a535m_0 2024-09-19T15:31:39.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.812+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8405229043868329049', time=2024-09-19T16:42:33.919324+0000, chain.objs.size()=1 2024-09-19T15:31:39.818 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.812+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.cZ3SNlthwsjdJRQ_rWPWkeHnTfS9QjD_0 2024-09-19T15:31:39.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.812+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16408324765772363194', time=2024-09-19T16:42:34.272659+0000, chain.objs.size()=1 2024-09-19T15:31:39.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.812+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.SJJ8oXcadL0G75IWgBHTrgn0sjhBq4J_0 2024-09-19T15:31:39.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.812+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6037126714063874113', time=2024-09-19T16:42:34.508653+0000, chain.objs.size()=1 2024-09-19T15:31:39.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.812+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.z2JkXV1ZYN7BUjdLOwDAttlALO1Y_pE_0 2024-09-19T15:31:39.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.812+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7718335624208448362', time=2024-09-19T16:42:34.639087+0000, chain.objs.size()=1 2024-09-19T15:31:39.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.812+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.sWt92Z2iq8c58G-6FOF3ZPX0EWzKE0e_0 2024-09-19T15:31:39.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.812+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1556861031756657511', time=2024-09-19T16:42:35.306774+0000, chain.objs.size()=1 2024-09-19T15:31:39.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.812+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.qshxbs1yv2dxxtB0kXU9_poPa_CpPDr_0 2024-09-19T15:31:39.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.812+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16477183165201772820', time=2024-09-19T16:42:37.327935+0000, chain.objs.size()=1 2024-09-19T15:31:39.819 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.812+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.RydtHfp3av9y-dpuHQjmT6vm3inl7iV_0 2024-09-19T15:31:39.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.812+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4435654929539155109', time=2024-09-19T16:42:39.306606+0000, chain.objs.size()=1 2024-09-19T15:31:39.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.812+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.2h9oB1USQVTQXOOFu0VBrBI3ry8S3mC_0 2024-09-19T15:31:39.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.812+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14080938930741768343', time=2024-09-19T16:42:42.237088+0000, chain.objs.size()=1 2024-09-19T15:31:39.820 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.812+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.gBTpU1snRX8Rb0yQ9epW4Hr1l7iTIvv_0 2024-09-19T15:31:39.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.816+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4524116116834827125', time=2024-09-19T16:42:42.869652+0000, chain.objs.size()=1 2024-09-19T15:31:39.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.816+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.NOXC7NE6mC-1tXvZ7qvtEVy--f0p6M8_0 2024-09-19T15:31:39.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.816+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14209486654290864741', time=2024-09-19T16:42:43.193925+0000, chain.objs.size()=1 2024-09-19T15:31:39.821 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.816+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.C8VsOcSAJi5Bu_09i_-mKfFBO-rqeZM_0 2024-09-19T15:31:39.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.816+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.578923150680196130', time=2024-09-19T16:42:43.265643+0000, chain.objs.size()=1 2024-09-19T15:31:39.822 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.816+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.plYKofAVRNsRCatc5A1D6sJbdqEGpmO_0 2024-09-19T15:31:39.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.816+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1974049324042632838', time=2024-09-19T16:42:44.220575+0000, chain.objs.size()=1 2024-09-19T15:31:39.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.816+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.DFzN1AzcTlhB8rB4a6W2J5hT-Oo8-Ae_0 2024-09-19T15:31:39.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.820+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.99190838299688088', time=2024-09-19T16:42:45.280403+0000, chain.objs.size()=1 2024-09-19T15:31:39.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.820+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Ur6drZRVtvxDIzyJxxefhIuQ8Sa0Rqt_0 2024-09-19T15:31:39.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.820+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12138033070590527558', time=2024-09-19T16:42:45.285723+0000, chain.objs.size()=1 2024-09-19T15:31:39.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.820+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.weGP8JfassGICvcFuBllUaR2gqYWg8h_0 2024-09-19T15:31:39.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.820+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2744221114749587873', time=2024-09-19T16:42:47.193996+0000, chain.objs.size()=1 2024-09-19T15:31:39.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.820+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.6gWw0P9a2AU_1ZZj1tRQRsP7X4pZ4R6_0 2024-09-19T15:31:39.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.820+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14264223457963066724', time=2024-09-19T16:42:47.496666+0000, chain.objs.size()=1 2024-09-19T15:31:39.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.820+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.qY8zkddf75SQFj1dPcuZIVTok54gqXI_0 2024-09-19T15:31:39.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.820+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6436700606333141016', time=2024-09-19T16:42:49.300655+0000, chain.objs.size()=1 2024-09-19T15:31:39.824 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.820+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.IqpCUpKv1XR8iZRCu_BCIEyGwFmrwf2_0 2024-09-19T15:31:39.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.820+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7090948071999572369', time=2024-09-19T16:42:49.789474+0000, chain.objs.size()=1 2024-09-19T15:31:39.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.820+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.s1rSmPUA8NjOT1-gRxwDygSUmSg_F-C_0 2024-09-19T15:31:39.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.820+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4574710413607944548', time=2024-09-19T16:42:51.882634+0000, chain.objs.size()=1 2024-09-19T15:31:39.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.820+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.vOi0LJrOYzXsu6lmquPdJQ5D3oPiTPy_0 2024-09-19T15:31:39.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.820+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6841034368931737725', time=2024-09-19T16:42:52.154444+0000, chain.objs.size()=1 2024-09-19T15:31:39.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.820+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.vHBi4mCYrQVG9n13-54Y1p3CLwSlgNd_0 2024-09-19T15:31:39.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.820+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3777351462586886942', time=2024-09-19T16:42:58.203210+0000, chain.objs.size()=1 2024-09-19T15:31:39.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.820+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.TgoRr4zi5cuLLb3g9ELgpwEMxPr-sw__0 2024-09-19T15:31:39.825 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.820+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14621551839430837612', time=2024-09-19T16:42:58.874063+0000, chain.objs.size()=1 2024-09-19T15:31:39.826 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.820+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.dHNoReNZhxxICtd3jvAGud6dkhccGpA_0 2024-09-19T15:31:39.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.820+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15447483251768301247', time=2024-09-19T16:42:59.606677+0000, chain.objs.size()=1 2024-09-19T15:31:39.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.820+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.zBgN7WmefEhgKgcKBN-YWlqiCymhqAg_0 2024-09-19T15:31:39.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.820+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12469042569127403253', time=2024-09-19T16:43:31.259478+0000, chain.objs.size()=1 2024-09-19T15:31:39.827 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.820+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.276__shadow_.lSJmjvHnzqZ53td6ShWwqmf_yRhBtSk_0 2024-09-19T15:31:39.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.824+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11454689490654678879', time=2024-09-19T16:43:42.862372+0000, chain.objs.size()=1 2024-09-19T15:31:39.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.824+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.281__shadow_.8WcCPbupzKpw47oVFj8J64VV8EqmX8v_0 2024-09-19T15:31:39.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.824+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1584034183925305163', time=2024-09-19T16:43:42.864225+0000, chain.objs.size()=1 2024-09-19T15:31:39.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.824+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.281__shadow_.PkfrWx8Z8iaw3Ijynizk_XH59XN9Owm_0 2024-09-19T15:31:39.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.824+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17518376709367933380', time=2024-09-19T16:44:42.474859+0000, chain.objs.size()=1 2024-09-19T15:31:39.828 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.824+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.303__shadow_.RD9AVpjvC_Dk-QIMufigKrTRH-dCNGC_0 2024-09-19T15:31:39.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.824+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7687032624655886585', time=2024-09-19T16:47:18.383556+0000, chain.objs.size()=1 2024-09-19T15:31:39.829 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.824+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.TqFe-vqvwdGqJED9QE-xQCdVIuTyB49_0 2024-09-19T15:31:39.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.824+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16090185883848725928', time=2024-09-19T16:47:18.576410+0000, chain.objs.size()=1 2024-09-19T15:31:39.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.824+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.sRVolAXytHScshRDMVeU6fzSnKm_e0m_0 2024-09-19T15:31:39.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.824+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13736978159769590026', time=2024-09-19T16:47:18.578176+0000, chain.objs.size()=1 2024-09-19T15:31:39.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.824+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.dJHciS7UVwgSMMRUNXFfDKN8Zi0-9Rf_0 2024-09-19T15:31:39.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.824+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6447314552160216289', time=2024-09-19T16:47:18.717898+0000, chain.objs.size()=1 2024-09-19T15:31:39.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.824+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.X6YiU7k3UlVSxNK9_kT2nYHlOOAZAf1_0 2024-09-19T15:31:39.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.824+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4508449796084169857', time=2024-09-19T16:47:18.985089+0000, chain.objs.size()=1 2024-09-19T15:31:39.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.824+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.sid7t9lkeAfO4P_a3tUU-ZTrksGDqxi_0 2024-09-19T15:31:39.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.824+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14725618755751885501', time=2024-09-19T16:47:20.617077+0000, chain.objs.size()=1 2024-09-19T15:31:39.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.824+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.u78CypHEsi28bnX7lwDVlwchvdHlI6x_0 2024-09-19T15:31:39.830 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.824+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17375389751122092044', time=2024-09-19T16:47:22.401036+0000, chain.objs.size()=1 2024-09-19T15:31:39.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.824+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.auiKq0ScxWq1uM-lcl9epIG0zaV54lj_0 2024-09-19T15:31:39.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.824+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14594457530593821402', time=2024-09-19T16:47:23.432771+0000, chain.objs.size()=1 2024-09-19T15:31:39.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.824+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.xii48c_q5oIOPFy963bXZ3KuFMaSlOj_0 2024-09-19T15:31:39.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.824+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13720663826462205490', time=2024-09-19T16:47:27.171486+0000, chain.objs.size()=1 2024-09-19T15:31:39.831 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.824+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.1QVq8Y_xayCKlxRj20hZgMDO_8sRfFy_0 2024-09-19T15:31:39.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.828+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1290418185206108841', time=2024-09-19T16:47:27.382576+0000, chain.objs.size()=1 2024-09-19T15:31:39.832 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.828+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.3TzL1-E8mjJA2cJieP5b7Q7fq8J0oUO_0 2024-09-19T15:31:39.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.828+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6867914090933471557', time=2024-09-19T16:47:27.622231+0000, chain.objs.size()=1 2024-09-19T15:31:39.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.828+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.sRu3Ec5Dy_Z3db-eaP3nmZ4V46KCk5Y_0 2024-09-19T15:31:39.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.828+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.605583490478152841', time=2024-09-19T16:47:28.678311+0000, chain.objs.size()=1 2024-09-19T15:31:39.833 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.828+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Scgy5XGIMA0QLY1-pjNIm9-pflFZb3R_0 2024-09-19T15:31:39.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.832+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5312946675683876669', time=2024-09-19T16:47:29.198422+0000, chain.objs.size()=1 2024-09-19T15:31:39.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.832+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.8EGZOvzl5PZUfV5BjoXSIfmQNr4Vwb__0 2024-09-19T15:31:39.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.832+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11965255943108829308', time=2024-09-19T16:47:29.588660+0000, chain.objs.size()=1 2024-09-19T15:31:39.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.832+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.pdClf5sxPYfe4_BtGZ_HEKZ7gc9hWO6_0 2024-09-19T15:31:39.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.832+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10852818618287428605', time=2024-09-19T16:47:29.942398+0000, chain.objs.size()=1 2024-09-19T15:31:39.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.832+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.TeBa5Z8Kp7BAAYUlrAioTJn6yzUqgwT_0 2024-09-19T15:31:39.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.832+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13144983264026212040', time=2024-09-19T16:47:31.098347+0000, chain.objs.size()=1 2024-09-19T15:31:39.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.832+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.s8RCTWdcrVTy-nYIH368ROGBWyKRKks_0 2024-09-19T15:31:39.836 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.832+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14805517729890898351', time=2024-09-19T16:47:34.055151+0000, chain.objs.size()=1 2024-09-19T15:31:39.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.832+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.6PjkvVUtJ-roRVfhbWWDfyVXPwPZBqn_0 2024-09-19T15:31:39.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.832+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10734921607920663293', time=2024-09-19T16:47:35.318564+0000, chain.objs.size()=1 2024-09-19T15:31:39.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.832+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.LiI3bHZhnZ21vkv-fU8YhEc7hGPPoM7_0 2024-09-19T15:31:39.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.832+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8128142369021884805', time=2024-09-19T16:47:35.382344+0000, chain.objs.size()=1 2024-09-19T15:31:39.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.832+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.FynyHSdgcBAYmXnYu3bRPpBnPKZoSMW_0 2024-09-19T15:31:39.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.832+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1554468192261770531', time=2024-09-19T16:47:35.384731+0000, chain.objs.size()=1 2024-09-19T15:31:39.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.832+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.1zR1vcEEUm7bOllStTNPhNa1KwbZ0Ka_0 2024-09-19T15:31:39.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.832+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10839503552832886425', time=2024-09-19T16:47:38.174240+0000, chain.objs.size()=1 2024-09-19T15:31:39.837 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.832+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.wgUFIE0i-8Y5X4L_EPuziHdhx5k7ukt_0 2024-09-19T15:31:39.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.832+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16852126251631316458', time=2024-09-19T16:47:38.393144+0000, chain.objs.size()=1 2024-09-19T15:31:39.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.832+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.liEEnehdbadWS_On-jgpVE-kXBFgAY2_0 2024-09-19T15:31:39.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.832+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14955169752148107851', time=2024-09-19T16:47:39.390683+0000, chain.objs.size()=1 2024-09-19T15:31:39.838 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.832+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.1wBQEaTZHkZsERp7nu4lityJnzUmD0j_0 2024-09-19T15:31:39.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7401018708820766335', time=2024-09-19T16:47:39.950233+0000, chain.objs.size()=1 2024-09-19T15:31:39.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.836+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.q8uw-Oz4Gqz2ZZBcMTqdOGrzT65DjWH_0 2024-09-19T15:31:39.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11566848089898114110', time=2024-09-19T16:47:40.955170+0000, chain.objs.size()=1 2024-09-19T15:31:39.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.836+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.yIDV3Y2hzdehsfjSXrIv0fffZ5kY5iw_0 2024-09-19T15:31:39.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9464389551790619274', time=2024-09-19T16:47:41.803977+0000, chain.objs.size()=1 2024-09-19T15:31:39.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.836+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.p6cox0soJMDMvz7gBGWzwPZ7dzi6NNA_0 2024-09-19T15:31:39.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1036176903650150097', time=2024-09-19T16:47:42.642305+0000, chain.objs.size()=1 2024-09-19T15:31:39.840 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.836+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.OubrLlH1H6iX_3eqITX0Lbexfnlw1r7_0 2024-09-19T15:31:39.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6741996658151867608', time=2024-09-19T16:47:44.681900+0000, chain.objs.size()=1 2024-09-19T15:31:39.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.836+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.APWllLLCGZe6IFSCut8oodsHCMFAX98_0 2024-09-19T15:31:39.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17518849125107619744', time=2024-09-19T16:47:45.873043+0000, chain.objs.size()=1 2024-09-19T15:31:39.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.836+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.d9OHDGpcEDesiBA7UTY0EJgHMeCDRs9_0 2024-09-19T15:31:39.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14139902792700873596', time=2024-09-19T16:49:34.903495+0000, chain.objs.size()=1 2024-09-19T15:31:39.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.836+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.OXt93qh6cXbRDxSp1iUOzJR-xZbFqqx_0 2024-09-19T15:31:39.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8598420471720022918', time=2024-09-19T16:49:35.807750+0000, chain.objs.size()=1 2024-09-19T15:31:39.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.836+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.XTeoBBHpOL1X74i2BtNNkFM8SF0j52i_0 2024-09-19T15:31:39.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.836+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10181095889158638698', time=2024-09-19T16:49:35.906536+0000, chain.objs.size()=1 2024-09-19T15:31:39.841 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.836+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.0PLE4HEKCxzBi8HXu0fhuTir16YM-yd_0 2024-09-19T15:31:39.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.840+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4615234692058741157', time=2024-09-19T16:49:36.056200+0000, chain.objs.size()=1 2024-09-19T15:31:39.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.840+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.sHilHwxNxUFzhmDrMSi6u4WwNG_iJay_0 2024-09-19T15:31:39.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.840+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18008240114983645557', time=2024-09-19T16:49:37.970635+0000, chain.objs.size()=1 2024-09-19T15:31:39.844 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.840+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.2A1F7BiOvxh4JQcI-Lt-f0QTFa9LKp-_0 2024-09-19T15:31:39.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.840+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13756930253617069649', time=2024-09-19T16:49:39.268958+0000, chain.objs.size()=1 2024-09-19T15:31:39.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.840+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.tQKYmNiahvKbpj4sBQDWTGaiiXpx7Tu_0 2024-09-19T15:31:39.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.840+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10349090539573704799', time=2024-09-19T16:49:39.713076+0000, chain.objs.size()=1 2024-09-19T15:31:39.845 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.840+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.T2Zd8v5i9PAyJZBapRo-PE-lXBxVQzW_0 2024-09-19T15:31:39.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.840+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6255403998806297847', time=2024-09-19T16:49:40.030336+0000, chain.objs.size()=1 2024-09-19T15:31:39.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.840+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.kubPBvB5XlIuPh9-wPAw41z-TCXSLlN_0 2024-09-19T15:31:39.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.840+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15997796697031718163', time=2024-09-19T16:49:40.914798+0000, chain.objs.size()=1 2024-09-19T15:31:39.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.840+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.PN7ki827xzV4BNREvnFpsaWAIJakfML_0 2024-09-19T15:31:39.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.840+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15857561273133961556', time=2024-09-19T16:49:41.007182+0000, chain.objs.size()=1 2024-09-19T15:31:39.846 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.840+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.hHo_Mb_2Q778XSTfuaYS9xyIlXLjZa8_0 2024-09-19T15:31:39.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.840+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18187285008155371094', time=2024-09-19T16:49:44.226125+0000, chain.objs.size()=1 2024-09-19T15:31:39.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.840+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Z6ze86ur0KIb60qkEQtqkl5F6mFzeY7_0 2024-09-19T15:31:39.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.840+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4301224025418673735', time=2024-09-19T16:49:44.830870+0000, chain.objs.size()=1 2024-09-19T15:31:39.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.840+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.la6Ca2goMj1r60p6t1buMMcEsX9iynA_0 2024-09-19T15:31:39.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.840+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8152521187158419438', time=2024-09-19T16:49:45.080678+0000, chain.objs.size()=1 2024-09-19T15:31:39.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.840+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.H_d3pLFS6RYWj55_wfZ-4tVQpUUq_vG_0 2024-09-19T15:31:39.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.840+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7125439201332349199', time=2024-09-19T16:49:46.141237+0000, chain.objs.size()=1 2024-09-19T15:31:39.847 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.840+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ybKDkOEfsuLjNhgi6R89fLNIqAK_fvq_0 2024-09-19T15:31:39.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.844+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4138603331677525020', time=2024-09-19T16:49:46.797946+0000, chain.objs.size()=1 2024-09-19T15:31:39.848 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.844+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.jhx5JE5R4yJIBdzoksrQS9WzPLNnm7e_0 2024-09-19T15:31:39.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.844+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2331155606718536754', time=2024-09-19T16:49:47.788503+0000, chain.objs.size()=1 2024-09-19T15:31:39.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.844+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.5PzWLYQIDLkCiQDo9OSJRPgkvVzOiIf_0 2024-09-19T15:31:39.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.844+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12322007420054872664', time=2024-09-19T16:49:48.051463+0000, chain.objs.size()=1 2024-09-19T15:31:39.849 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.844+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.qSJSLJvCS5ouLnKwm5Wz2Yi59-2EJQK_0 2024-09-19T15:31:39.850 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.844+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3977307302115905661', time=2024-09-19T16:49:48.658296+0000, chain.objs.size()=1 2024-09-19T15:31:39.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.844+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.6_ng8a2-QHT9oGb7TpIuVl5SB-WC_vU_0 2024-09-19T15:31:39.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.844+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10423524322629538205', time=2024-09-19T16:49:48.659992+0000, chain.objs.size()=1 2024-09-19T15:31:39.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.844+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.1BIN4nsr0G5059Mv_kRt_g52WO6G3mF_0 2024-09-19T15:31:39.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.844+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15890443963282348704', time=2024-09-19T16:49:49.104838+0000, chain.objs.size()=1 2024-09-19T15:31:39.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.844+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.dyxbhX-ekofRrsbNcy8ON2dgQJlaudh_0 2024-09-19T15:31:39.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.844+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.508248717492606218', time=2024-09-19T16:49:50.234026+0000, chain.objs.size()=1 2024-09-19T15:31:39.851 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.844+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.rRaWD0z91pS_G92NeLmpkGTzljLRLpU_0 2024-09-19T15:31:39.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.848+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17277851360733593773', time=2024-09-19T16:49:51.952398+0000, chain.objs.size()=1 2024-09-19T15:31:39.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.848+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Nc5mbZwGj88IX-IOUZ2cJhjCSEAfco9_0 2024-09-19T15:31:39.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.848+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12178427206218854654', time=2024-09-19T16:49:52.068350+0000, chain.objs.size()=1 2024-09-19T15:31:39.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.848+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.JXJKjvMpdRj1S7TMaOJw2BlPUZaFmkJ_0 2024-09-19T15:31:39.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.848+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10142816839611591662', time=2024-09-19T16:49:53.141771+0000, chain.objs.size()=1 2024-09-19T15:31:39.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.848+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.GLSNdSLpTfErEUChG_MLVsPy8sh9kV0_0 2024-09-19T15:31:39.852 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.848+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6352235736990699232', time=2024-09-19T16:49:57.025950+0000, chain.objs.size()=1 2024-09-19T15:31:39.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.848+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ejBVJuO7sbw7lPNyEZkjiyiogfvglg__0 2024-09-19T15:31:39.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.848+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7927582214275356462', time=2024-09-19T16:49:57.389161+0000, chain.objs.size()=1 2024-09-19T15:31:39.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.848+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.DO_xb1sQRPBMdS4SSX4aTQTOnkR5jqW_0 2024-09-19T15:31:39.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.848+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.390450328936644478', time=2024-09-19T16:50:00.428644+0000, chain.objs.size()=1 2024-09-19T15:31:39.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.848+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Myu6ob2QVff_KnDAc0nwSBMJCQgrzDY_0 2024-09-19T15:31:39.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.848+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8041035326791944123', time=2024-09-19T16:50:02.698028+0000, chain.objs.size()=1 2024-09-19T15:31:39.853 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.848+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ere86Gf_wkGu_ht4Wm2a-Y0IdBnx95F_0 2024-09-19T15:31:39.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.848+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2783942255948401146', time=2024-09-19T16:50:04.847579+0000, chain.objs.size()=1 2024-09-19T15:31:39.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.848+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.WGruS1kWB6wbawQaoNWObTU2I4t07lO_0 2024-09-19T15:31:39.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.848+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1334449054869314490', time=2024-09-19T16:50:04.936175+0000, chain.objs.size()=1 2024-09-19T15:31:39.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.848+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.T1iRGsD0mxE4Q8pOia-MW9s4-D268wI_0 2024-09-19T15:31:39.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.848+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15739396538180721640', time=2024-09-19T16:50:06.427290+0000, chain.objs.size()=1 2024-09-19T15:31:39.854 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.848+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.x1r9OtSImKQGJ_Wm7D9iS9NNDFRtsPu_0 2024-09-19T15:31:39.858 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.852+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/140886 2024-09-19T15:31:39.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-19T15:31:39.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7911096357959273557', time=2024-09-19T16:50:06.429013+0000, chain.objs.size()=1 2024-09-19T15:31:39.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.bwrj2VqrXkza5qESqzI8l4485PWTMBf_0 2024-09-19T15:31:39.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17140928011752197567', time=2024-09-19T16:51:29.240850+0000, chain.objs.size()=1 2024-09-19T15:31:39.860 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.367__shadow_.dgeTLYXj8Koyd3iw0Q8GbmND95b25ar_0 2024-09-19T15:31:39.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2465105118547438224', time=2024-09-19T16:51:58.004139+0000, chain.objs.size()=1 2024-09-19T15:31:39.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.381__shadow_.sUgjvRKtqub02V_CSRO3pt_g-WNsBOb_0 2024-09-19T15:31:39.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8838671646824010756', time=2024-09-19T16:55:50.723902+0000, chain.objs.size()=1 2024-09-19T15:31:39.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.488__shadow_.TjRRxa5eTTjRTVaEE_ZfdVczdBEBw3o_0 2024-09-19T15:31:39.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4921683904375802813', time=2024-09-19T17:03:03.160879+0000, chain.objs.size()=2 2024-09-19T15:31:39.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.523__multipart_mymultipart.2~FEg2q5vhsnWI7FsJW6-98f6gSomABjC.1 2024-09-19T15:31:39.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.523__multipart_mymultipart.2~FEg2q5vhsnWI7FsJW6-98f6gSomABjC.2 2024-09-19T15:31:39.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5614011253954751817', time=2024-09-19T17:06:23.693398+0000, chain.objs.size()=1 2024-09-19T15:31:39.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.554__shadow_.1kVlapME1SpnNxGJGJrpJqZTrsB6EQb_0 2024-09-19T15:31:39.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2564015811118014750', time=2024-09-19T17:06:43.177084+0000, chain.objs.size()=1 2024-09-19T15:31:39.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.556__shadow_.oOou57ocUYc8GcL1qOFekTezlQa7kmW_0 2024-09-19T15:31:39.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8153218439753033543', time=2024-09-19T17:06:49.977683+0000, chain.objs.size()=1 2024-09-19T15:31:39.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.557__shadow_.TLFwZtiFNra5Co0yYd7E2Z7GBOsvRVK_0 2024-09-19T15:31:39.861 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5426684061425446558', time=2024-09-19T17:07:04.508150+0000, chain.objs.size()=1 2024-09-19T15:31:39.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.558__shadow_.UaSuUTJl6vm6_Yvkc6UhYg_EVbwaamF_0 2024-09-19T15:31:39.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9429492542724708185', time=2024-09-19T17:08:23.855241+0000, chain.objs.size()=1 2024-09-19T15:31:39.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.574__shadow:JYAZoPN6m8zyGGkXVa.LDEk1rBFJIoq_.2vMVFr_UWjSDTH1B-6PbH7rSib-y6q-_0 2024-09-19T15:31:39.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10168090104571853931', time=2024-09-19T17:08:30.777132+0000, chain.objs.size()=1 2024-09-19T15:31:39.862 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.575__shadow_.4JAd3OeYG6nBwuDgGztFvaGz2zij6vd_0 2024-09-19T15:31:39.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6519680150544663155', time=2024-09-19T17:08:59.224697+0000, chain.objs.size()=1 2024-09-19T15:31:39.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:WTJG-B2dMnITdTfcyTL1bzt2xg62s5T_.8VoZ75yUUvds3mQmS8YcR9i8y1mmwY1_0 2024-09-19T15:31:39.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5617682721661957192', time=2024-09-19T17:09:22.697117+0000, chain.objs.size()=1 2024-09-19T15:31:39.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:.cye31TQLPo00oA3DXx.9Bd5OVsPlv1_.c8EJMvB20JMncPP8nDj0wybYpFVQzUX_0 2024-09-19T15:31:39.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5735687905921541020', time=2024-09-19T17:09:25.624385+0000, chain.objs.size()=1 2024-09-19T15:31:39.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:1RvmAYdVnV8WQF6FCatpqNtsvgZ5WvB_.vF3E-VrdMxcSuESPP4V9O3qsrYudW5M_0 2024-09-19T15:31:39.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.335805650886392548', time=2024-09-19T17:10:48.038461+0000, chain.objs.size()=1 2024-09-19T15:31:39.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.585__shadow:90AuQ2NMxwWvtNMtyb.yHAfJ3NxsMog_.27LG56T5mV1tVhlEXZcvexR9j7RbPFD_0 2024-09-19T15:31:39.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3848292364073203259', time=2024-09-19T17:19:20.430061+0000, chain.objs.size()=1 2024-09-19T15:31:39.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.651__shadow_._YnBa4a6XQimy2lYgwrF9Zoz9aVvsKC_0 2024-09-19T15:31:39.864 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.856+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3565174170061599870', time=2024-09-19T17:21:10.341756+0000, chain.objs.size()=1 2024-09-19T15:31:39.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.860+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.679__shadow_.ugWvZHUK7sAq_Ut1Ku66BypKT6Qj7lB_0 2024-09-19T15:31:39.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.860+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10968079350655421698', time=2024-09-19T17:21:41.734727+0000, chain.objs.size()=1 2024-09-19T15:31:39.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.860+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.696__shadow:NMmvyt8oztkMTPfoQv09jS57fZ-Y-YS_.2OvA-Oomx5RTLgmAphsyB5HQOQxcLxw_0 2024-09-19T15:31:39.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.860+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4553113735995950800', time=2024-09-19T17:27:13.687516+0000, chain.objs.size()=1 2024-09-19T15:31:39.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.860+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.763__shadow_.JvX2HHYccL2yIKkysOZZ09Rt_5fdNTJ_0 2024-09-19T15:31:39.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.860+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1648637001966777967', time=2024-09-19T17:28:34.700971+0000, chain.objs.size()=1 2024-09-19T15:31:39.865 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.860+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.775__shadow_.maBPWHGB2X0RPS02XV0tFThJo11bFle_0 2024-09-19T15:31:39.868 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.864+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:39.870 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.864+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T15:31:39.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.868+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:39.872 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.868+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:39.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.868+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45323' 2024-09-19T15:31:39.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.868+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7954347723612997942', time=2024-09-19T16:32:49.933104+0000, chain.objs.size()=3 2024-09-19T15:31:39.873 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.868+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.159__multipart_mymultipart-STANDARD.2~HnvxXtL00JeNGB-ONmPOJ4pYT71Pej_.1 2024-09-19T15:31:39.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.868+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.159__multipart_mymultipart-STANDARD.2~HnvxXtL00JeNGB-ONmPOJ4pYT71Pej_.2 2024-09-19T15:31:39.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.868+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.159__multipart_mymultipart-STANDARD.2~HnvxXtL00JeNGB-ONmPOJ4pYT71Pej_.3 2024-09-19T15:31:39.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.868+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11800376016613477008', time=2024-09-19T16:33:36.377670+0000, chain.objs.size()=3 2024-09-19T15:31:39.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.868+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.161__multipart_foo-LUKEWARM.2~oLien4mZfgEeoGP66qUeR8RBlVSZNhX.1 2024-09-19T15:31:39.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.868+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.161__multipart_foo-LUKEWARM.2~oLien4mZfgEeoGP66qUeR8RBlVSZNhX.2 2024-09-19T15:31:39.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.868+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.161__multipart_foo-LUKEWARM.2~oLien4mZfgEeoGP66qUeR8RBlVSZNhX.3 2024-09-19T15:31:39.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.868+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13187635547921013956', time=2024-09-19T16:34:11.247490+0000, chain.objs.size()=2 2024-09-19T15:31:39.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.868+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.164__multipart_foo.2~gSpTAvgk1IIhLSM8v6d61jCY4P3WVO8.1 2024-09-19T15:31:39.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.868+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.164__multipart_foo.2~gSpTAvgk1IIhLSM8v6d61jCY4P3WVO8.2 2024-09-19T15:31:39.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.868+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3116298535771971644', time=2024-09-19T16:40:41.824866+0000, chain.objs.size()=1 2024-09-19T15:31:39.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.868+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.261__shadow_.lNIlEal-roYCTcl67KpaVVU052vJZyp_0 2024-09-19T15:31:39.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.868+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17033425116181135730', time=2024-09-19T16:42:29.429402+0000, chain.objs.size()=1 2024-09-19T15:31:39.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.868+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Gqrsj1Fe5lIb2Snu-Wh68eQMDRHPKDn_0 2024-09-19T15:31:39.874 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.868+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.520352090176466366', time=2024-09-19T16:42:30.154210+0000, chain.objs.size()=1 2024-09-19T15:31:39.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.868+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.AxXsBiuBo9mSaNB6Fy4nkSpLQVlXOrr_0 2024-09-19T15:31:39.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.868+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7579775295761658910', time=2024-09-19T16:42:30.841168+0000, chain.objs.size()=1 2024-09-19T15:31:39.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.868+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.V5JTn5O8qLB9-MYgdFbDtu3mTv71qp2_0 2024-09-19T15:31:39.875 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.872+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3409382132621327953', time=2024-09-19T16:42:33.032382+0000, chain.objs.size()=1 2024-09-19T15:31:39.876 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.872+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.shEyUO7zWYug1ym9K2WCl4bUPTmmBwV_0 2024-09-19T15:31:39.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.872+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14381176062055549002', time=2024-09-19T16:42:33.034774+0000, chain.objs.size()=1 2024-09-19T15:31:39.877 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.872+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.gbsIaUY-dY9Sg3gL_UODZdmjDwYeCkn_0 2024-09-19T15:31:39.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.872+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8438958641622915772', time=2024-09-19T16:42:33.411557+0000, chain.objs.size()=1 2024-09-19T15:31:39.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.872+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ddUIlqpOQsTtL9qkAL1aPPp4QfgUPyD_0 2024-09-19T15:31:39.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.872+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1133949043020472865', time=2024-09-19T16:42:34.511769+0000, chain.objs.size()=1 2024-09-19T15:31:39.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.872+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.PM9FGXSlbrF6E1x9gm_261BiW1Aiy0W_0 2024-09-19T15:31:39.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.872+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11326174905185072724', time=2024-09-19T16:42:35.459740+0000, chain.objs.size()=1 2024-09-19T15:31:39.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.872+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ff-Lh60hAyPh9Vgxla5-2YqTmT_kYxS_0 2024-09-19T15:31:39.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.872+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.568429875051075380', time=2024-09-19T16:42:35.593884+0000, chain.objs.size()=1 2024-09-19T15:31:39.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.872+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.MLzME5R5jF_uZt3UgrX1xy5HtBi7lI5_0 2024-09-19T15:31:39.878 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.872+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16521929244858380560', time=2024-09-19T16:42:36.814786+0000, chain.objs.size()=1 2024-09-19T15:31:39.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.872+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.adivGFUNc1GwmRTX2r2cYOQUQI67aVq_0 2024-09-19T15:31:39.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.872+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2585053749914612893', time=2024-09-19T16:42:37.694824+0000, chain.objs.size()=1 2024-09-19T15:31:39.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.872+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.9-b7KgB-_IRoV-eLUGjyeXEsiVBCQ7K_0 2024-09-19T15:31:39.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.872+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8168911164021777252', time=2024-09-19T16:42:37.951668+0000, chain.objs.size()=1 2024-09-19T15:31:39.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.872+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.O4KsQt7vs6s4Zlt7PouDdYQ6kNqt04A_0 2024-09-19T15:31:39.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.872+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16758992848532287931', time=2024-09-19T16:42:38.273399+0000, chain.objs.size()=1 2024-09-19T15:31:39.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.872+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.QPWKisns6mF5g_24svujowTsuY9sYHy_0 2024-09-19T15:31:39.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.872+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2264764176352168021', time=2024-09-19T16:42:38.395528+0000, chain.objs.size()=1 2024-09-19T15:31:39.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.872+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.JRowZwz3sPu5nhS8ZBTi_v-Qwk49sU3_0 2024-09-19T15:31:39.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.872+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14921460096082727686', time=2024-09-19T16:42:38.743831+0000, chain.objs.size()=1 2024-09-19T15:31:39.879 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.872+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.y7t4WoYpY2S2hYSeFLk5j4A-a2juzpu_0 2024-09-19T15:31:39.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.876+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6137477359375782494', time=2024-09-19T16:42:38.937568+0000, chain.objs.size()=1 2024-09-19T15:31:39.880 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.876+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.d87KFOC7B93i9UmFhfnDzDWw2-L6nr8_0 2024-09-19T15:31:39.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.876+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15973194513078066094', time=2024-09-19T16:42:39.132848+0000, chain.objs.size()=1 2024-09-19T15:31:39.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.876+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.-f4bxZxlvw-JlYHgVu2q_qEHJPmxSUj_0 2024-09-19T15:31:39.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.876+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7799258728428561418', time=2024-09-19T16:42:42.061900+0000, chain.objs.size()=1 2024-09-19T15:31:39.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.876+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.cDbGoTHaaZNZ-N5SOEvMcKG74jTKUKT_0 2024-09-19T15:31:39.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.876+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10629652946051048474', time=2024-09-19T16:42:42.535373+0000, chain.objs.size()=1 2024-09-19T15:31:39.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.876+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.lr_MH6rJOo5kxJbOOEeJ1mYCJP_KNly_0 2024-09-19T15:31:39.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.876+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6660589541689638794', time=2024-09-19T16:42:44.146573+0000, chain.objs.size()=1 2024-09-19T15:31:39.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.876+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.aXfGbcujOw_t-b67956F4Us8OpjLT93_0 2024-09-19T15:31:39.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.876+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7054760400128821079', time=2024-09-19T16:42:45.606407+0000, chain.objs.size()=1 2024-09-19T15:31:39.882 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.876+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.f6rM7dQQPr-tJ__jn9SRHCpY2EFA-GQ_0 2024-09-19T15:31:39.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.876+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8391719436347749599', time=2024-09-19T16:42:45.828707+0000, chain.objs.size()=1 2024-09-19T15:31:39.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.876+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.FQEGcdtIKML8g72nWgin0Q96A-izwwY_0 2024-09-19T15:31:39.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.876+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3729979406491180024', time=2024-09-19T16:42:47.529558+0000, chain.objs.size()=1 2024-09-19T15:31:39.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.876+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.F-PoGZIOPVnzgYL_oRZlFc66q4dpI-X_0 2024-09-19T15:31:39.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.876+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1286887834048687808', time=2024-09-19T16:42:47.622066+0000, chain.objs.size()=1 2024-09-19T15:31:39.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.876+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.A7meqbomO2rsfc50j9KCodm523IFGhg_0 2024-09-19T15:31:39.883 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.876+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3852520526175372983', time=2024-09-19T16:42:48.137815+0000, chain.objs.size()=1 2024-09-19T15:31:39.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.876+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.bHWKgrVa1KAFC9bzHLyczrsaTCb-9SY_0 2024-09-19T15:31:39.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.876+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14352709573443997164', time=2024-09-19T16:42:48.279436+0000, chain.objs.size()=1 2024-09-19T15:31:39.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.876+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Fu2k__1ZVVx2Pf9Dtx1bttBkVJhCrQD_0 2024-09-19T15:31:39.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.876+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17125673723323472403', time=2024-09-19T16:42:49.307970+0000, chain.objs.size()=1 2024-09-19T15:31:39.884 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.876+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.qI5WonbXvrVasVm_A33VOf6AUenMbQT_0 2024-09-19T15:31:39.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.880+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2515833520281344138', time=2024-09-19T16:42:49.364017+0000, chain.objs.size()=1 2024-09-19T15:31:39.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.880+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.nV8Optc3bXL9P_Z7i03bBEWKTNrEjtk_0 2024-09-19T15:31:39.885 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.880+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12514461557313506696', time=2024-09-19T16:42:50.147742+0000, chain.objs.size()=1 2024-09-19T15:31:39.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.880+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.qs6O8VReChsDs6YLfx4C2brBMKoeKlp_0 2024-09-19T15:31:39.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.880+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10448935306793868170', time=2024-09-19T16:42:50.476461+0000, chain.objs.size()=1 2024-09-19T15:31:39.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.880+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.R3RrT6SUkju4GTar-UKPa-Wt_Ci5Y0Z_0 2024-09-19T15:31:39.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.880+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5060447727818051704', time=2024-09-19T16:42:51.163425+0000, chain.objs.size()=1 2024-09-19T15:31:39.886 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.880+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.KCchfARLtlhZ9QASkiLDPsZxCXQuaeK_0 2024-09-19T15:31:39.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.880+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4615208430275701420', time=2024-09-19T16:42:54.368992+0000, chain.objs.size()=1 2024-09-19T15:31:39.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.880+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.4_m7S6VJnMAjMWOiqk3qQu0AFUvHYlS_0 2024-09-19T15:31:39.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.880+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11700263503331817697', time=2024-09-19T16:42:54.520120+0000, chain.objs.size()=1 2024-09-19T15:31:39.887 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.880+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.yS6mxgT-STVvtf_JxnAtbY_yLmoMzLB_0 2024-09-19T15:31:39.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.884+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6059845920227724527', time=2024-09-19T16:42:55.263470+0000, chain.objs.size()=1 2024-09-19T15:31:39.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.884+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.yaETX6orOXqH7bGQk-JyA67Y0wnVhv2_0 2024-09-19T15:31:39.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.884+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15733983411098524728', time=2024-09-19T16:42:55.583315+0000, chain.objs.size()=1 2024-09-19T15:31:39.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.884+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.WOxq0W-itNnnARhKBb1MoDTv-Furt7c_0 2024-09-19T15:31:39.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.884+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13488115061168440172', time=2024-09-19T16:42:56.332843+0000, chain.objs.size()=1 2024-09-19T15:31:39.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.884+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.9bqzdgcAbcR1XCJH1uRosegYwNnm3ey_0 2024-09-19T15:31:39.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.884+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3337210019732712287', time=2024-09-19T16:42:57.883035+0000, chain.objs.size()=1 2024-09-19T15:31:39.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.884+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.j4Pe5Pt8ud8Vp8f6daiJgLvvQvhgCfu_0 2024-09-19T15:31:39.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.884+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6688716323646998309', time=2024-09-19T16:42:58.707264+0000, chain.objs.size()=1 2024-09-19T15:31:39.888 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.884+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.fCuDRtQ8Zb0xlQvbc9hhOAKR99hbhka_0 2024-09-19T15:31:39.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.884+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7496656816860812677', time=2024-09-19T16:42:59.090677+0000, chain.objs.size()=1 2024-09-19T15:31:39.889 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.884+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.JlUXoT3RLdcj9TuDVcsJIZYBRo121jW_0 2024-09-19T15:31:39.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.884+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8065139138167934417', time=2024-09-19T16:42:59.504821+0000, chain.objs.size()=1 2024-09-19T15:31:39.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.884+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.GJeyXVVYjqT1DchzcujjHlQOl1IPrKL_0 2024-09-19T15:31:39.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.884+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4475519998365845701', time=2024-09-19T16:42:59.999830+0000, chain.objs.size()=1 2024-09-19T15:31:39.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.884+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.n0-4FDeEb6e5-wKXu7_M57AaQnZtqSr_0 2024-09-19T15:31:39.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.884+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14918187236672139518', time=2024-09-19T16:43:11.239803+0000, chain.objs.size()=1 2024-09-19T15:31:39.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.884+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.267__shadow_.XOKjFWJb02QdoAMuJg1r5EIWecQUqOj_0 2024-09-19T15:31:39.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.884+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12534538251284769832', time=2024-09-19T16:44:12.398290+0000, chain.objs.size()=1 2024-09-19T15:31:39.891 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.884+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_.pC71qfRpnjrDUFkSPSJUBfeUQcleveb_0 2024-09-19T15:31:39.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.888+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3997990778782698918', time=2024-09-19T16:44:27.996945+0000, chain.objs.size()=1 2024-09-19T15:31:39.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.888+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.297__shadow_.z5MrQwnTCsQ6CFTJ0uUJf6i3GyCXyFC_0 2024-09-19T15:31:39.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.888+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16691964271961467304', time=2024-09-19T16:44:44.804011+0000, chain.objs.size()=1 2024-09-19T15:31:39.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.888+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.304__shadow_.d7YuVCrkDIgWMJVLiFNkfkroH-_ngSD_0 2024-09-19T15:31:39.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.888+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14613355592563893247', time=2024-09-19T16:47:18.913168+0000, chain.objs.size()=1 2024-09-19T15:31:39.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.888+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Bb1fzNadeW29Ywr7LsBXerCypoOfQWQ_0 2024-09-19T15:31:39.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.888+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3586118941698528255', time=2024-09-19T16:47:20.759881+0000, chain.objs.size()=1 2024-09-19T15:31:39.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.888+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.nJXxKMuvjxRXucZnHCYtHfuBRfaLtIL_0 2024-09-19T15:31:39.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.888+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13487122037631401671', time=2024-09-19T16:47:25.621891+0000, chain.objs.size()=1 2024-09-19T15:31:39.892 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.888+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.k1w9MqRdBAcR53qoYHI6pHqO9vS__l-_0 2024-09-19T15:31:39.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.888+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12258950286939551976', time=2024-09-19T16:47:27.642770+0000, chain.objs.size()=1 2024-09-19T15:31:39.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.888+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.8HzOXP4HxCw29Qu5r8TB5KJi27kD5aZ_0 2024-09-19T15:31:39.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.888+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3584613625485891633', time=2024-09-19T16:47:29.436055+0000, chain.objs.size()=1 2024-09-19T15:31:39.893 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.888+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.RU2VJts_nM_cd3hFQyLTSL-ObxBsm1J_0 2024-09-19T15:31:39.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.892+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11480897418679668921', time=2024-09-19T16:47:29.960368+0000, chain.objs.size()=1 2024-09-19T15:31:39.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.892+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.72jjJpfGhpwXczoFlkPeftF8G12oyIn_0 2024-09-19T15:31:39.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.892+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7497078753454834017', time=2024-09-19T16:47:31.520073+0000, chain.objs.size()=1 2024-09-19T15:31:39.896 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.892+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.SbdhmDb5305cppbA2KJByEoeQfxM_yu_0 2024-09-19T15:31:39.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.892+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16768022570390098356', time=2024-09-19T16:47:35.266375+0000, chain.objs.size()=1 2024-09-19T15:31:39.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.892+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.FOb4QPqPjASsfPmVYFP8Fydez4tQent_0 2024-09-19T15:31:39.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.892+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16080971345954429870', time=2024-09-19T16:47:36.396360+0000, chain.objs.size()=1 2024-09-19T15:31:39.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.892+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.uJQRep-4AkgyPmK-U3Pzx2qElFhxxM1_0 2024-09-19T15:31:39.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.892+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12372226920016395744', time=2024-09-19T16:47:37.792501+0000, chain.objs.size()=1 2024-09-19T15:31:39.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.892+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.OaokpWOIwZO0Sxi54s91QK4egCgLIqN_0 2024-09-19T15:31:39.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.892+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16224224018726338608', time=2024-09-19T16:47:38.081536+0000, chain.objs.size()=1 2024-09-19T15:31:39.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.892+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.x3e8ffmQ3G9o9s3fOzrvzDFQH5uD-yb_0 2024-09-19T15:31:39.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.892+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13225920481619302212', time=2024-09-19T16:47:38.433362+0000, chain.objs.size()=1 2024-09-19T15:31:39.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.892+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.FwcNFa6OFqxdRa_H-EId_Dn7rLtM4dJ_0 2024-09-19T15:31:39.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.892+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8206792663989930410', time=2024-09-19T16:47:39.656496+0000, chain.objs.size()=1 2024-09-19T15:31:39.897 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.892+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.4oAy5fBOgn0z-SZ-3j7FB7ZRpApPoDa_0 2024-09-19T15:31:39.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.892+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10385050327286368735', time=2024-09-19T16:47:40.668029+0000, chain.objs.size()=1 2024-09-19T15:31:39.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.892+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.6tvEf-_v56dcS8Jhd1_ABFLoERGWXie_0 2024-09-19T15:31:39.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.892+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14606434683938556475', time=2024-09-19T16:47:40.669542+0000, chain.objs.size()=1 2024-09-19T15:31:39.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.892+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.XaHzOE8EKjE5rk906J-qUp74i9_p2eC_0 2024-09-19T15:31:39.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.892+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9510129410904424971', time=2024-09-19T16:47:42.094256+0000, chain.objs.size()=1 2024-09-19T15:31:39.898 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.892+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.pREDQBSrDIW_vSftL3IS0p8Zfg7gkYc_0 2024-09-19T15:31:39.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.892+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11448816998193065290', time=2024-09-19T16:47:44.816104+0000, chain.objs.size()=1 2024-09-19T15:31:39.899 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.892+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.4sViUdc-UmUofg42gWEpeWPAy5Vjdld_0 2024-09-19T15:31:39.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.896+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8115707845325653892', time=2024-09-19T16:47:46.134784+0000, chain.objs.size()=1 2024-09-19T15:31:39.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.896+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.NZocdg-T149HUUVZenyK7_zK-bhlIWw_0 2024-09-19T15:31:39.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.896+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3101765878363019847', time=2024-09-19T16:47:46.391339+0000, chain.objs.size()=1 2024-09-19T15:31:39.900 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.896+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.llgMjgMlKDNay-4pEzLCCeeo5srrkU6_0 2024-09-19T15:31:39.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.896+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5879829463491004124', time=2024-09-19T16:47:48.731480+0000, chain.objs.size()=1 2024-09-19T15:31:39.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.896+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.vAPMUI0PtIkbwtBD4E9OiXBDSGZ7ZYd_0 2024-09-19T15:31:39.902 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.896+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11752807307458787521', time=2024-09-19T16:47:49.854635+0000, chain.objs.size()=1 2024-09-19T15:31:39.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.896+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.iOOqXNccZrlVet5q_fVjDXIBrH0K2Pw_0 2024-09-19T15:31:39.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.896+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2482516195368757061', time=2024-09-19T16:49:35.347650+0000, chain.objs.size()=1 2024-09-19T15:31:39.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.896+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.XmVsCONs0Nn6OjcgYYRxLG69yzxZTlZ_0 2024-09-19T15:31:39.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.896+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.81355935083949271', time=2024-09-19T16:49:35.672080+0000, chain.objs.size()=1 2024-09-19T15:31:39.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.896+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.XjpFp2m2cnJ_DO2sRDg0Xrr6VS__6k1_0 2024-09-19T15:31:39.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.896+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4823553523274894685', time=2024-09-19T16:49:35.779455+0000, chain.objs.size()=1 2024-09-19T15:31:39.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.896+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.CF9JTCilkBdal_KMf1zby3__0hW88tM_0 2024-09-19T15:31:39.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.896+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11590110001638978031', time=2024-09-19T16:49:39.278859+0000, chain.objs.size()=1 2024-09-19T15:31:39.903 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.896+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.4FVsLRppBL0KZsVZbfLPx5caOq2cDXr_0 2024-09-19T15:31:39.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.896+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5466502540229809315', time=2024-09-19T16:49:40.042952+0000, chain.objs.size()=1 2024-09-19T15:31:39.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.896+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.TpQ3ZkVNRzPVCrAE7i_6wdVYKBI9-li_0 2024-09-19T15:31:39.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.896+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11384203848526929909', time=2024-09-19T16:49:41.313715+0000, chain.objs.size()=1 2024-09-19T15:31:39.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.896+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.b0KSvc58TVZOCUZbSyI96qU4o03vY1q_0 2024-09-19T15:31:39.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.896+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13566271596389797046', time=2024-09-19T16:49:41.431755+0000, chain.objs.size()=1 2024-09-19T15:31:39.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.896+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.5ToyvX_-kLw3g-7bP3grR8rJDmvvAIB_0 2024-09-19T15:31:39.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.896+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6242706840099649134', time=2024-09-19T16:49:41.658045+0000, chain.objs.size()=1 2024-09-19T15:31:39.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.896+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Z1lh-RsyNRHU-C4ZJMUEXwFOZIIwhQa_0 2024-09-19T15:31:39.904 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.900+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17741373330368653351', time=2024-09-19T16:49:42.127168+0000, chain.objs.size()=1 2024-09-19T15:31:39.905 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.900+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.5FK9SYCi1JD3x5OVGvI8Rg4wHzNpVKJ_0 2024-09-19T15:31:39.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.900+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16201799127499588650', time=2024-09-19T16:49:44.832076+0000, chain.objs.size()=1 2024-09-19T15:31:39.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.900+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.08gO-ZtAl-L3j4U0DiE2jr2VxkDNPY9_0 2024-09-19T15:31:39.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.900+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3958338353303363933', time=2024-09-19T16:49:46.626545+0000, chain.objs.size()=1 2024-09-19T15:31:39.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.900+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.fhIi77o49CkNMS5EV60sY0cYwMkqSVr_0 2024-09-19T15:31:39.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.900+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8739025289318217314', time=2024-09-19T16:49:47.875506+0000, chain.objs.size()=1 2024-09-19T15:31:39.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.900+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.vbKS9v8jEkY0cDsHJYIDlLiV0J83-M-_0 2024-09-19T15:31:39.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.900+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7944031777833783667', time=2024-09-19T16:49:48.313315+0000, chain.objs.size()=1 2024-09-19T15:31:39.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.900+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.HY8bHxcn-D-UArZ-F5d5Cj8jH7q_Y8F_0 2024-09-19T15:31:39.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.900+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5029120609687902284', time=2024-09-19T16:49:48.317037+0000, chain.objs.size()=1 2024-09-19T15:31:39.907 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.900+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.uaELX-XYFDKVkJVEhedoqcog3RiEpuE_0 2024-09-19T15:31:39.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.900+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15797680520823877558', time=2024-09-19T16:49:50.683227+0000, chain.objs.size()=1 2024-09-19T15:31:39.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.900+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.YtbP3o72lvfW8CKUVMVPxS6NXSdBhEI_0 2024-09-19T15:31:39.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.900+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5407883968426040573', time=2024-09-19T16:49:50.685454+0000, chain.objs.size()=1 2024-09-19T15:31:39.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.900+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Ew16zXbRPvhZOUWTqaHmC-4p91x_ynZ_0 2024-09-19T15:31:39.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.900+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17046223864544214061', time=2024-09-19T16:49:53.795308+0000, chain.objs.size()=1 2024-09-19T15:31:39.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.900+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.J7xHo6FSm08otgkghuIB7PJJkL3p5nd_0 2024-09-19T15:31:39.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.900+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12493617827720392414', time=2024-09-19T16:49:57.675278+0000, chain.objs.size()=1 2024-09-19T15:31:39.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.900+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.qxm_mH0kXdImznuj339GV_5VCIJHYDj_0 2024-09-19T15:31:39.908 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.900+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17724873098684538064', time=2024-09-19T16:49:57.764349+0000, chain.objs.size()=1 2024-09-19T15:31:39.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.900+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.cnFprhz_CZZ5tynSz1SNFFcEiGvxUEv_0 2024-09-19T15:31:39.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.904+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1496840500789588196', time=2024-09-19T16:49:58.056709+0000, chain.objs.size()=1 2024-09-19T15:31:39.909 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.904+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.vQFZ87HC_679h9KB-Br-xqyZUAoNypt_0 2024-09-19T15:31:39.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.904+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14830582771059737287', time=2024-09-19T16:49:58.217976+0000, chain.objs.size()=1 2024-09-19T15:31:39.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.904+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.71hq4HRmw2kgG3N4kdt1em8LAsXhq6l_0 2024-09-19T15:31:39.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.904+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8616118828266941377', time=2024-09-19T16:49:59.281057+0000, chain.objs.size()=1 2024-09-19T15:31:39.910 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.904+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.a8RLq2upv0PpPtsk9O9rpHb3wbj0eCT_0 2024-09-19T15:31:39.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.904+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11664017997126366664', time=2024-09-19T16:50:00.090767+0000, chain.objs.size()=1 2024-09-19T15:31:39.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.904+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.B4lUUkvsPxuP-yIlJAgRDITk3D-NEZR_0 2024-09-19T15:31:39.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.904+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9848697599931206614', time=2024-09-19T16:50:01.696850+0000, chain.objs.size()=1 2024-09-19T15:31:39.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.904+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.WHKh3mJlaeTfjGvP4mg0ZWkAIQiCQZk_0 2024-09-19T15:31:39.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.904+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9309694060294223176', time=2024-09-19T16:50:02.649411+0000, chain.objs.size()=1 2024-09-19T15:31:39.911 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.904+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.-InUba31Sod0W8QbPhBHOIY-6xIe1_5_0 2024-09-19T15:31:39.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.904+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9693579211908086685', time=2024-09-19T16:50:03.074854+0000, chain.objs.size()=1 2024-09-19T15:31:39.912 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.904+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.XuhupMqNMJx6pM3gMxMxULqTkxZoNfM_0 2024-09-19T15:31:39.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.904+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1274648080053558989', time=2024-09-19T16:50:03.932482+0000, chain.objs.size()=1 2024-09-19T15:31:39.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.904+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.bMn8MIY-UlU-A-4w3nlGkkqGXFaXdZ5_0 2024-09-19T15:31:39.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.908+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12634371529377509653', time=2024-09-19T16:50:04.353401+0000, chain.objs.size()=1 2024-09-19T15:31:39.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.908+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.4X7mE7JHBUcsYS3lbH7ZasWBRj-9MYY_0 2024-09-19T15:31:39.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.908+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11022680567591505814', time=2024-09-19T16:50:04.615893+0000, chain.objs.size()=1 2024-09-19T15:31:39.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.908+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.AXgJey257BNc5fTA_nqZqAQQ-mVSiCK_0 2024-09-19T15:31:39.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.908+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15908812988515790387', time=2024-09-19T16:50:04.618274+0000, chain.objs.size()=1 2024-09-19T15:31:39.913 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.908+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.bOP_RkDuyoRH-ylT4ze1uGnn5PB0y_3_0 2024-09-19T15:31:39.916 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45323 2024-09-19T15:31:39.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-19T15:31:39.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9099580674619403461', time=2024-09-19T16:50:04.907545+0000, chain.objs.size()=1 2024-09-19T15:31:39.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.hvzFOmzy0wUzVp0nKY5i47u85LU3WBI_0 2024-09-19T15:31:39.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5102162110217459529', time=2024-09-19T16:50:06.011532+0000, chain.objs.size()=1 2024-09-19T15:31:39.919 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.GWkOZmg-TcJuRXH_icVNN5zIxna9lUc_0 2024-09-19T15:31:39.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4098007320269096853', time=2024-09-19T16:50:06.106423+0000, chain.objs.size()=1 2024-09-19T15:31:39.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.q6Gv8xwwOdlSOlLuCymZ607YV5mAHSn_0 2024-09-19T15:31:39.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17969840569186180691', time=2024-09-19T16:50:06.146767+0000, chain.objs.size()=1 2024-09-19T15:31:39.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Ti6JCluaGPcGy3ZIqc0eRJh5G-fofaN_0 2024-09-19T15:31:39.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11701312568040677686', time=2024-09-19T16:53:43.640030+0000, chain.objs.size()=1 2024-09-19T15:31:39.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.433__shadow_.zpDULML331haveGdyM40EM5LF_b2SrM_0 2024-09-19T15:31:39.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15004384565497632187', time=2024-09-19T16:53:45.203018+0000, chain.objs.size()=1 2024-09-19T15:31:39.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.434__shadow_.WtX3GjVwRjQp6giayPuyczZIhTGTMfW_0 2024-09-19T15:31:39.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5656289269323087634', time=2024-09-19T16:54:33.776254+0000, chain.objs.size()=1 2024-09-19T15:31:39.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.455__shadow_.GJJHaaDWphHqh5Icj3AxRBknocppaCu_0 2024-09-19T15:31:39.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2069596852661055287', time=2024-09-19T16:54:39.693590+0000, chain.objs.size()=1 2024-09-19T15:31:39.920 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.457__shadow_.OqWWdmF77j7WbvJz2lI2Xcp1yTgbL5Q_0 2024-09-19T15:31:39.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16143545160470264313', time=2024-09-19T16:55:32.872380+0000, chain.objs.size()=1 2024-09-19T15:31:39.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.483__shadow_.4J1NKUY_OuMlixQXdgY2LA6cBc8avxZ_0 2024-09-19T15:31:39.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13782829420469395098', time=2024-09-19T16:57:48.500187+0000, chain.objs.size()=1 2024-09-19T15:31:39.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.517__shadow_.6ahF1UcuTcQRwUlM8mrJ5voILAmVRAB_0 2024-09-19T15:31:39.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4567532092693291672', time=2024-09-19T17:02:16.459727+0000, chain.objs.size()=6 2024-09-19T15:31:39.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~evpZT-0Nk6UPwroP-vgJ5en2YMbzL3o.1 2024-09-19T15:31:39.921 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.912+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.RzmPcgyLfV07DZzjn1AKhKlCIHXwK7nv.2 2024-09-19T15:31:39.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.916+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.dejJtyPF2oILdmIpYxB9ZdZcyTIl_tKK.3 2024-09-19T15:31:39.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.916+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~evpZT-0Nk6UPwroP-vgJ5en2YMbzL3o.4 2024-09-19T15:31:39.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.916+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~evpZT-0Nk6UPwroP-vgJ5en2YMbzL3o.5 2024-09-19T15:31:39.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.916+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~evpZT-0Nk6UPwroP-vgJ5en2YMbzL3o.6 2024-09-19T15:31:39.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.916+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11410270118832021453', time=2024-09-19T17:03:23.029957+0000, chain.objs.size()=2 2024-09-19T15:31:39.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.916+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.525__multipart_mymultipart.2~KlkGiRR9YyJNC7x4-T-JawH9QKHuqMH.1 2024-09-19T15:31:39.923 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.916+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.525__multipart_mymultipart.2~KlkGiRR9YyJNC7x4-T-JawH9QKHuqMH.2 2024-09-19T15:31:39.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.916+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.695877951665658633', time=2024-09-19T17:07:54.430541+0000, chain.objs.size()=1 2024-09-19T15:31:39.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.916+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:QXENVYYwa6y63U.m5dBXvM57Wpzmscb_.uhETcp6Y6Sem54EONONnQ5WVJNe6z-9_0 2024-09-19T15:31:39.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.916+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16918647711002613888', time=2024-09-19T17:07:57.409438+0000, chain.objs.size()=1 2024-09-19T15:31:39.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.916+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:6PxBJQ.H16t7pSQS5KJPjW-Br3W9fYG_.1COBv0IvhzW0sxUb_cGKd3leQWwGNeX_0 2024-09-19T15:31:39.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.916+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1950318698852863525', time=2024-09-19T17:08:25.635968+0000, chain.objs.size()=1 2024-09-19T15:31:39.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.916+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.574__shadow:1JoYQI6kZDV3hFf5QnK9PLjk.kdcvLg_.YB0dAnx8VU_Y72Y3cDjh6TMhI6a93yV_0 2024-09-19T15:31:39.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.916+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4413792550286096677', time=2024-09-19T17:08:48.724055+0000, chain.objs.size()=1 2024-09-19T15:31:39.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.916+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:BJxC3RBIpkzDlcD-80O7k3pZTULzK8V_.hq5s8dXi1XEQ3k5ya8zKMhRUNl5EtAa_0 2024-09-19T15:31:39.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.916+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16356360801800240153', time=2024-09-19T17:10:29.958233+0000, chain.objs.size()=1 2024-09-19T15:31:39.924 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.916+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.579__shadow:iiP1RQ5s4R9bfKOUYKlqZA32.NBMNPg_.cKfZDXfmWP-0jMlseZM4HEs6Yj3k8aM_0 2024-09-19T15:31:39.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.920+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16884638276758997641', time=2024-09-19T17:10:30.440684+0000, chain.objs.size()=1 2024-09-19T15:31:39.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.920+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.579__shadow:dq4gupNyR3uQf.wrlHvkS.S3lShadQv_.9VZ_1tXAXLnSE4dMlf5ZppG_yKaKJ8n_0 2024-09-19T15:31:39.927 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.920+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4494088431901367958', time=2024-09-19T17:17:21.797751+0000, chain.objs.size()=6 2024-09-19T15:31:39.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.920+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.623__multipart_multipart_enc.2~qxyfnjQ9eCcXPhotuRRkCshHypybYSW.1 2024-09-19T15:31:39.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.920+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.623__multipart_multipart_enc.2~qxyfnjQ9eCcXPhotuRRkCshHypybYSW.2 2024-09-19T15:31:39.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.920+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.623__multipart_multipart_enc.2~qxyfnjQ9eCcXPhotuRRkCshHypybYSW.3 2024-09-19T15:31:39.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.920+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.623__multipart_multipart_enc.2~qxyfnjQ9eCcXPhotuRRkCshHypybYSW.4 2024-09-19T15:31:39.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.920+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.623__multipart_multipart_enc.2~qxyfnjQ9eCcXPhotuRRkCshHypybYSW.5 2024-09-19T15:31:39.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.920+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.623__multipart_multipart_enc.2~qxyfnjQ9eCcXPhotuRRkCshHypybYSW.6 2024-09-19T15:31:39.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.920+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.883438942569298808', time=2024-09-19T17:18:08.362340+0000, chain.objs.size()=1 2024-09-19T15:31:39.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.920+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.630__shadow_.EYkpldn0Ab2RIhGSa9IY4Q9CKFaiXxj_0 2024-09-19T15:31:39.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.920+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4929528117935971441', time=2024-09-19T17:19:40.776340+0000, chain.objs.size()=1 2024-09-19T15:31:39.928 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.920+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.656__shadow_.OCuBdfmKXJr4pDQUfknv4D-5etqZ3-c_0 2024-09-19T15:31:39.933 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.928+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:39.937 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.932+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T15:31:39.938 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.932+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:39.939 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.932+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:39.940 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47535' 2024-09-19T15:31:39.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2396304972215333482', time=2024-09-19T16:34:25.347581+0000, chain.objs.size()=1 2024-09-19T15:31:39.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.171__shadow_.NKJquwVqXDIgiZlN-7bkE2qMYPp_a7q_0 2024-09-19T15:31:39.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15212540824486975450', time=2024-09-19T16:39:48.429227+0000, chain.objs.size()=1 2024-09-19T15:31:39.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.239__shadow_.7lIBnEx9QDxopO8hT2oOx_iabJLTg2U_0 2024-09-19T15:31:39.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1115165784277134753', time=2024-09-19T16:40:02.726555+0000, chain.objs.size()=1 2024-09-19T15:31:39.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.244__shadow_.NtttMMDmEwxBSSJmMDeqmvFvzcrn-Ue_0 2024-09-19T15:31:39.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11125812150827701400', time=2024-09-19T16:40:07.346252+0000, chain.objs.size()=1 2024-09-19T15:31:39.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.246__shadow_.2faL1pOeXYKNCNXaBQCPs7UsFyYf2jS_0 2024-09-19T15:31:39.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12259916574095950627', time=2024-09-19T16:40:30.504855+0000, chain.objs.size()=1 2024-09-19T15:31:39.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.256__shadow_.r7v0k8-pUytKWmdOW45tCMv8b7nfXfT_0 2024-09-19T15:31:39.941 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16918554256077900234', time=2024-09-19T16:40:35.067479+0000, chain.objs.size()=1 2024-09-19T15:31:39.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.258__shadow_.19JvkDW0ndrMw3-4x26VGxdSVGz3Gas_0 2024-09-19T15:31:39.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1914885770311370409', time=2024-09-19T16:42:33.585087+0000, chain.objs.size()=1 2024-09-19T15:31:39.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.xx3s9B9pnMxla_qFw32V5p9a8CWN8Tp_0 2024-09-19T15:31:39.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16529592149250286498', time=2024-09-19T16:42:33.626509+0000, chain.objs.size()=1 2024-09-19T15:31:39.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.7rCBjLsC9fDeorFSCWmNJKBPhn_j666_0 2024-09-19T15:31:39.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7484577536984534736', time=2024-09-19T16:42:34.818887+0000, chain.objs.size()=1 2024-09-19T15:31:39.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.rtMoegpeiEOKXbBt-TPkbhzvDdaI-ps_0 2024-09-19T15:31:39.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10792977163088134054', time=2024-09-19T16:42:36.889713+0000, chain.objs.size()=1 2024-09-19T15:31:39.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.YoNfX4IQ6XDKZSC3rXbmDoPsrnXt-Fe_0 2024-09-19T15:31:39.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5082373859917058347', time=2024-09-19T16:42:36.974967+0000, chain.objs.size()=1 2024-09-19T15:31:39.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ceiZNXZFHMS2gLuq9OcPghayJJc56nI_0 2024-09-19T15:31:39.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14767260945628564825', time=2024-09-19T16:42:37.356513+0000, chain.objs.size()=1 2024-09-19T15:31:39.942 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.dKMZZfH74N0ScPLzsZFn-FnANJw6dRJ_0 2024-09-19T15:31:39.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6970960396926678513', time=2024-09-19T16:42:38.076203+0000, chain.objs.size()=1 2024-09-19T15:31:39.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_._fBRUk3xNsOW2jOY_koJAa2iwadrrQM_0 2024-09-19T15:31:39.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17377704294897963097', time=2024-09-19T16:42:38.390857+0000, chain.objs.size()=1 2024-09-19T15:31:39.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.dALt-aF6-S92njyB3j-duKmn2KzDBO3_0 2024-09-19T15:31:39.943 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4919015443935258742', time=2024-09-19T16:42:38.598165+0000, chain.objs.size()=1 2024-09-19T15:31:39.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.smq4DmtbKR1fMoxnrIsmPg2W8K4V_R2_0 2024-09-19T15:31:39.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4912857398338376131', time=2024-09-19T16:42:39.119977+0000, chain.objs.size()=1 2024-09-19T15:31:39.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.tGFqo6KfhTYJ4feguVpRx1XW96M-F8__0 2024-09-19T15:31:39.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15970229871522511104', time=2024-09-19T16:42:41.027940+0000, chain.objs.size()=1 2024-09-19T15:31:39.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.95M594K-3iOcmoVzXgXiDhVPLx4p359_0 2024-09-19T15:31:39.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2085272841458751961', time=2024-09-19T16:42:43.627485+0000, chain.objs.size()=1 2024-09-19T15:31:39.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.TgcSN-TQtUpp98pdf8Cq2_eKSSL0dt4_0 2024-09-19T15:31:39.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12586215755876432685', time=2024-09-19T16:42:46.262890+0000, chain.objs.size()=1 2024-09-19T15:31:39.944 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ryGCM5rUzx0lTiqJ6EK4upYeB5K7CfR_0 2024-09-19T15:31:39.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3234748523210400356', time=2024-09-19T16:42:46.597437+0000, chain.objs.size()=1 2024-09-19T15:31:39.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.936+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.-kLBIeDbk2tyJy1RGfibqoDCxUZZFKG_0 2024-09-19T15:31:39.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.940+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15996206326916156829', time=2024-09-19T16:42:47.010915+0000, chain.objs.size()=1 2024-09-19T15:31:39.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.940+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.N92eG-J5zyJ1Z3ZJkGU7ih65fJJ6btQ_0 2024-09-19T15:31:39.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.940+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2845159567443023667', time=2024-09-19T16:42:47.119894+0000, chain.objs.size()=1 2024-09-19T15:31:39.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.940+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.PI0odtSu_cAGJbKxAE_wbPy0LbLqaIh_0 2024-09-19T15:31:39.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.940+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5798455871658347093', time=2024-09-19T16:42:48.384524+0000, chain.objs.size()=1 2024-09-19T15:31:39.945 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.940+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.T2LlK5lfMXiT4chQRBWcV70cYDsY6Sw_0 2024-09-19T15:31:39.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.940+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11710471537213268722', time=2024-09-19T16:42:51.679447+0000, chain.objs.size()=1 2024-09-19T15:31:39.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.940+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.S62SXOfT-KAK92Gqdo1d65um9smYedZ_0 2024-09-19T15:31:39.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.940+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3540823022468402142', time=2024-09-19T16:42:52.496251+0000, chain.objs.size()=1 2024-09-19T15:31:39.947 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.940+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.WqWZ5LSsqX-pbNT8ZvG6hPEGgTL3CWn_0 2024-09-19T15:31:39.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.940+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3871877603482287666', time=2024-09-19T16:42:54.912584+0000, chain.objs.size()=1 2024-09-19T15:31:39.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.940+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.sKtXiBDg7tWVDaIqKiH8GgjUBuDM8LU_0 2024-09-19T15:31:39.948 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.944+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8359943080450303044', time=2024-09-19T16:42:55.122120+0000, chain.objs.size()=1 2024-09-19T15:31:39.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.944+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.gQABxG9K4B6hVnaEHJElu9ZAyAVRzA2_0 2024-09-19T15:31:39.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.944+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18402149345590139305', time=2024-09-19T16:42:57.898333+0000, chain.objs.size()=1 2024-09-19T15:31:39.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.944+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.sGysd3fx4lFQyBUoifkcETk1OLJx8oU_0 2024-09-19T15:31:39.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.944+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9632289450190698109', time=2024-09-19T16:42:59.606911+0000, chain.objs.size()=1 2024-09-19T15:31:39.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.944+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Q6U5GG-6i6wgfjASqHfQma_hCDJFESD_0 2024-09-19T15:31:39.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.944+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2454322995517370356', time=2024-09-19T16:43:17.804237+0000, chain.objs.size()=1 2024-09-19T15:31:39.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.944+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.270__shadow_.vfkwGco1WQr1TciLDllp3y7PJ1qjP2i_0 2024-09-19T15:31:39.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.944+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11458452143378619087', time=2024-09-19T16:43:24.429797+0000, chain.objs.size()=1 2024-09-19T15:31:39.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.944+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.273__shadow_.DfDUbnhyKZfJDrQfQTMN3n7IHyZsZDu_0 2024-09-19T15:31:39.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.944+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15602615635051873377', time=2024-09-19T16:43:26.675720+0000, chain.objs.size()=1 2024-09-19T15:31:39.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.944+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.274__shadow_.amRE2j3Kt85LgrQzufqPTojayK8_mmj_0 2024-09-19T15:31:39.949 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.944+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9400007234800676410', time=2024-09-19T16:43:28.972323+0000, chain.objs.size()=1 2024-09-19T15:31:39.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.944+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.275__shadow_.9qUnFb-u8CxUY97Izc5PD3mG5uAQxBx_0 2024-09-19T15:31:39.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.944+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10824756493273708014', time=2024-09-19T16:44:01.776111+0000, chain.objs.size()=1 2024-09-19T15:31:39.950 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.944+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.289__shadow_.eDxD9-AtvDNepNYgaQXN_O42lX81g8y_0 2024-09-19T15:31:39.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.944+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16381994189701501416', time=2024-09-19T16:44:35.484255+0000, chain.objs.size()=1 2024-09-19T15:31:39.951 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.944+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.300__shadow_.VjqFk-S6pFjbkuMxGyFPyNehPv0ZBoH_0 2024-09-19T15:31:39.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.948+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11492233064246532057', time=2024-09-19T16:45:26.511159+0000, chain.objs.size()=1 2024-09-19T15:31:39.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.948+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.319__shadow:zQINYU3183byHdIwK.haekLauLCO9Z._.qG0OC4Phe6a8Iy0wGGziMHj9fVy2qw3_0 2024-09-19T15:31:39.952 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.948+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15088451088538512030', time=2024-09-19T16:47:17.952813+0000, chain.objs.size()=1 2024-09-19T15:31:39.953 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.948+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.9I_hxgvBSgx118O8emvl4kUC-R-wkQ8_0 2024-09-19T15:31:39.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.948+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2511101155137799550', time=2024-09-19T16:47:19.382510+0000, chain.objs.size()=1 2024-09-19T15:31:39.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.948+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.oIoYHpPdOVXaboClSJ8BTLCwTvozg9G_0 2024-09-19T15:31:39.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.948+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5740030162575278181', time=2024-09-19T16:47:19.546909+0000, chain.objs.size()=1 2024-09-19T15:31:39.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.948+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.BcdlABzbJ1BqG3SGdmlmAXNSUFe1gxs_0 2024-09-19T15:31:39.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.948+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15531937817403569537', time=2024-09-19T16:47:20.144164+0000, chain.objs.size()=1 2024-09-19T15:31:39.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.948+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.8jV5kJVNFi9xOnvV2wRn4y2-Pf6tGG__0 2024-09-19T15:31:39.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.948+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12659444065322912753', time=2024-09-19T16:47:20.336093+0000, chain.objs.size()=1 2024-09-19T15:31:39.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.948+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.d1ExAyMkAA-O1Uy0Kv33kXJlWKnOK_a_0 2024-09-19T15:31:39.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.948+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16755364642221708241', time=2024-09-19T16:47:21.210624+0000, chain.objs.size()=1 2024-09-19T15:31:39.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.948+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Y6aH_VSiGfC0nkO6ru3fPHK3vyqoPRv_0 2024-09-19T15:31:39.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.948+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13034199131645294882', time=2024-09-19T16:47:22.755246+0000, chain.objs.size()=1 2024-09-19T15:31:39.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.948+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Qg9YIVdOMwyS-nk33dRoQfQQXw9sEot_0 2024-09-19T15:31:39.954 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.948+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7821105630645855079', time=2024-09-19T16:47:22.856916+0000, chain.objs.size()=1 2024-09-19T15:31:39.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.948+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.T3nCAPN-wXqjHQ_eQlXD_0HPcEOqGRY_0 2024-09-19T15:31:39.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.948+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12512911869446510188', time=2024-09-19T16:47:24.055328+0000, chain.objs.size()=1 2024-09-19T15:31:39.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.948+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.q4yJ7FARdgYFnzR7d8Wxur65tGO0517_0 2024-09-19T15:31:39.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.948+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4723271666697496800', time=2024-09-19T16:47:24.300087+0000, chain.objs.size()=1 2024-09-19T15:31:39.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.948+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.U2oAv-eCN-7DM23FbYsWt2EmX2_Jyca_0 2024-09-19T15:31:39.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.948+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7089921367065429016', time=2024-09-19T16:47:24.708414+0000, chain.objs.size()=1 2024-09-19T15:31:39.955 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.948+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.EhqPnvcwiwQ4XEd9H0gF3Vsy_sIp1SF_0 2024-09-19T15:31:39.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.952+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1123616572225272755', time=2024-09-19T16:47:25.507457+0000, chain.objs.size()=1 2024-09-19T15:31:39.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.952+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Ms9e51fxIF68KjYaX0i77HDabSPz5Ug_0 2024-09-19T15:31:39.958 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.952+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15042515441808406323', time=2024-09-19T16:47:25.621991+0000, chain.objs.size()=1 2024-09-19T15:31:39.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.952+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.2JdYmICySXnFiILte2jZuPnhkTmwqq2_0 2024-09-19T15:31:39.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.952+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13938826372402925888', time=2024-09-19T16:47:25.725533+0000, chain.objs.size()=1 2024-09-19T15:31:39.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.952+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.7TMJ0VXzilDwC-E3Be5Vj3N0l4GJetJ_0 2024-09-19T15:31:39.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.952+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17040998169154071342', time=2024-09-19T16:47:29.106601+0000, chain.objs.size()=1 2024-09-19T15:31:39.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.952+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.vfnNzsuxNMgM-PuHxgcAgeTBYoyHOm5_0 2024-09-19T15:31:39.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.952+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15371472284249671121', time=2024-09-19T16:47:29.810999+0000, chain.objs.size()=1 2024-09-19T15:31:39.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.952+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.x-gBR03x_rfTv2PNmfYSIBNSucHwiK8_0 2024-09-19T15:31:39.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.952+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16956743896591070262', time=2024-09-19T16:47:29.812982+0000, chain.objs.size()=1 2024-09-19T15:31:39.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.952+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.lfCa-qK-Mdlr8oRQR7H_mF9o95KL4Zv_0 2024-09-19T15:31:39.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.952+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5803175652449237101', time=2024-09-19T16:47:29.981260+0000, chain.objs.size()=1 2024-09-19T15:31:39.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.952+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.oD8HGaeC7W-uN3IMdlwQzifrQOreziF_0 2024-09-19T15:31:39.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.952+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16675697048371520229', time=2024-09-19T16:47:32.387879+0000, chain.objs.size()=1 2024-09-19T15:31:39.959 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.952+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.leXwcoa4JxkP_qJGoxHCP_HvLC4bZ6D_0 2024-09-19T15:31:39.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.952+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5992930701615832764', time=2024-09-19T16:47:32.816325+0000, chain.objs.size()=1 2024-09-19T15:31:39.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.952+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.9YH5G5nj9D5TY38F-PuiQGLkLKim-Q7_0 2024-09-19T15:31:39.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.956+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8311574070891745441', time=2024-09-19T16:47:36.538697+0000, chain.objs.size()=1 2024-09-19T15:31:39.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.956+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.vjkeEDmbZ6XfsnS-8mfDi-YnoTV6TAe_0 2024-09-19T15:31:39.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.956+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12183118049441140487', time=2024-09-19T16:47:37.642455+0000, chain.objs.size()=1 2024-09-19T15:31:39.960 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.956+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.6Lv2GEJGMqeD_JBD1ot64PzUUYUOZp7_0 2024-09-19T15:31:39.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.956+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18022473297011908339', time=2024-09-19T16:47:38.489329+0000, chain.objs.size()=1 2024-09-19T15:31:39.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.956+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.No3cIJkOwPU3a6U4VS4WENjn1SyGXMv_0 2024-09-19T15:31:39.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.956+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9863708540051082371', time=2024-09-19T16:47:39.818987+0000, chain.objs.size()=1 2024-09-19T15:31:39.961 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.956+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.pJYEyv1sVk3-rlDzicoGIfzld1cISal_0 2024-09-19T15:31:39.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.956+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1620966692705724938', time=2024-09-19T16:47:42.517536+0000, chain.objs.size()=1 2024-09-19T15:31:39.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.956+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.XLipha8ykwt_zT7ZOoIeHdOtb0lYhIs_0 2024-09-19T15:31:39.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.956+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5433131008110770806', time=2024-09-19T16:47:42.523646+0000, chain.objs.size()=1 2024-09-19T15:31:39.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.956+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Tno9lL2x0i2H7KbneRyuOYBCpppk4_X_0 2024-09-19T15:31:39.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.956+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2029873718581804824', time=2024-09-19T16:47:42.586883+0000, chain.objs.size()=1 2024-09-19T15:31:39.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.956+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.VeBe1ItinU0TdUDS4fXAZWKApAEq54__0 2024-09-19T15:31:39.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.956+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16383374016725150177', time=2024-09-19T16:47:44.613836+0000, chain.objs.size()=1 2024-09-19T15:31:39.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.956+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.vfssH4_dC0gm1My-cbqT6D8Yo1DAjA0_0 2024-09-19T15:31:39.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.956+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9023148891501988461', time=2024-09-19T16:47:44.615362+0000, chain.objs.size()=1 2024-09-19T15:31:39.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.956+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Yv_VIO7Vpn9XE76y3imdXad-Z0g7as0_0 2024-09-19T15:31:39.962 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.956+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5496061460174369024', time=2024-09-19T16:47:45.369381+0000, chain.objs.size()=1 2024-09-19T15:31:39.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.956+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.mCeK6vUdtZcNBKZuRwOG0Hvzbv1jghw_0 2024-09-19T15:31:39.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.956+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5311682536657148277', time=2024-09-19T16:47:45.519939+0000, chain.objs.size()=1 2024-09-19T15:31:39.963 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.956+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.4GMSxZHgTdd6-BjR6nT1uRG-U-S3fUm_0 2024-09-19T15:31:39.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.960+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2403113414094429385', time=2024-09-19T16:47:47.469676+0000, chain.objs.size()=1 2024-09-19T15:31:39.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.960+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.iy9tfOfG9vx0Ubn8lMRCCoyuLUTnCGX_0 2024-09-19T15:31:39.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.960+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11757955387887557914', time=2024-09-19T16:47:48.003308+0000, chain.objs.size()=1 2024-09-19T15:31:39.964 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.960+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.VU9ZPLvAcxXUQwNK-5PSIjoP1ePjYH4_0 2024-09-19T15:31:39.965 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.960+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17870957040348850968', time=2024-09-19T16:47:48.553730+0000, chain.objs.size()=1 2024-09-19T15:31:39.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.960+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.PX8-T6kpJXTEqbEdGNORmBts4by2W19_0 2024-09-19T15:31:39.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.960+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9849204332728131918', time=2024-09-19T16:47:48.555475+0000, chain.objs.size()=1 2024-09-19T15:31:39.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.960+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.3QnTXl-lHQldxUtVRtv2zyshr_fKkRC_0 2024-09-19T15:31:39.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.960+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8482462196844837759', time=2024-09-19T16:47:49.175217+0000, chain.objs.size()=1 2024-09-19T15:31:39.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.960+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.WJW75r18ovLlunYC2bEbd70n92fyzOE_0 2024-09-19T15:31:39.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.960+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6359610378101781268', time=2024-09-19T16:47:49.300237+0000, chain.objs.size()=1 2024-09-19T15:31:39.966 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.960+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.y38P_bxE7wg6k7F80DNzndc1_tSKZVi_0 2024-09-19T15:31:39.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.960+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11437829277764611302', time=2024-09-19T16:47:49.337432+0000, chain.objs.size()=1 2024-09-19T15:31:39.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.960+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.kBZjfVbTDp9v1FveEMEK0I8mXeKJXZH_0 2024-09-19T15:31:39.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.960+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6996494458636970814', time=2024-09-19T16:47:49.472335+0000, chain.objs.size()=1 2024-09-19T15:31:39.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.960+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.rdfsAU7XUcpCX82-oDGzJ5M9RNSsVBl_0 2024-09-19T15:31:39.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.960+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7717589986281127714', time=2024-09-19T16:47:49.915439+0000, chain.objs.size()=1 2024-09-19T15:31:39.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.960+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.s1m43Pd3K9ylkcg2BZPzfvL1yIv7kQo_0 2024-09-19T15:31:39.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.960+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13718691630766050338', time=2024-09-19T16:47:49.917220+0000, chain.objs.size()=1 2024-09-19T15:31:39.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.960+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.3gB-py8mpjjRxOxMJZQ09-yauc6JAus_0 2024-09-19T15:31:39.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.960+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7075125524885943451', time=2024-09-19T16:49:36.394829+0000, chain.objs.size()=1 2024-09-19T15:31:39.967 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.960+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ezLkG0v-mwCYCfApUyk8Jpbs_fOcIg6_0 2024-09-19T15:31:39.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.964+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.72339871329019926', time=2024-09-19T16:49:37.970480+0000, chain.objs.size()=1 2024-09-19T15:31:39.968 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.964+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.RSbzVd7ptNd6ed2-Ztq977Y5lxIAoUY_0 2024-09-19T15:31:39.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.964+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3325616613981459661', time=2024-09-19T16:49:37.972754+0000, chain.objs.size()=1 2024-09-19T15:31:39.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.964+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.LDtMB1a82UUloZMJX-7XoWU0XBcH0hv_0 2024-09-19T15:31:39.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.964+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3003902180310866618', time=2024-09-19T16:49:38.115329+0000, chain.objs.size()=1 2024-09-19T15:31:39.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.964+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.mzKnLDyjACCRZM-JYDuOqsRFGYivzLt_0 2024-09-19T15:31:39.973 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.964+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4860109914530941522', time=2024-09-19T16:49:39.768555+0000, chain.objs.size()=1 2024-09-19T15:31:39.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.964+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.VKutYAucYJ2vRXyAS_90gvMM47yv5mS_0 2024-09-19T15:31:39.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.964+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5519510234519650287', time=2024-09-19T16:49:42.388895+0000, chain.objs.size()=1 2024-09-19T15:31:39.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.964+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.I3-theLEfDZu-Z69Ce2Xg25kXoE49Fg_0 2024-09-19T15:31:39.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.964+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.368119745192304821', time=2024-09-19T16:49:42.503032+0000, chain.objs.size()=1 2024-09-19T15:31:39.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.964+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.CGNDjPzhPWdYCIISmYhWi-Ups9NuBqh_0 2024-09-19T15:31:39.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.964+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13006979793184404559', time=2024-09-19T16:49:45.417808+0000, chain.objs.size()=1 2024-09-19T15:31:39.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.964+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.1M1zz-GYUsru59SynunizBC6YiGf5Ku_0 2024-09-19T15:31:39.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.964+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.156076347172761846', time=2024-09-19T16:49:46.187600+0000, chain.objs.size()=1 2024-09-19T15:31:39.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.964+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.zOWjqwN4L-acJNv1cNVQZwziXMBh-Ak_0 2024-09-19T15:31:39.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.964+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6549849076582932938', time=2024-09-19T16:49:48.690075+0000, chain.objs.size()=1 2024-09-19T15:31:39.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.964+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.CNlf25Dk-MpiTsoFxBu_Eij0fGB9cZ0_0 2024-09-19T15:31:39.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.964+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15609309567911831220', time=2024-09-19T16:49:49.946981+0000, chain.objs.size()=1 2024-09-19T15:31:39.974 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.964+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.e5TxITo1R9t7W2Y6NCxeQ43Ea8tBdt6_0 2024-09-19T15:31:39.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.968+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13928859848569936502', time=2024-09-19T16:49:50.869745+0000, chain.objs.size()=1 2024-09-19T15:31:39.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.968+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.sHOE44IB98E0jnJMXfvRMN8KV6k_4rJ_0 2024-09-19T15:31:39.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.968+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.446858626701537129', time=2024-09-19T16:49:54.953257+0000, chain.objs.size()=1 2024-09-19T15:31:39.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.968+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.lEHfPFqjmWGZYaIEB5mtrq80pyVoRFk_0 2024-09-19T15:31:39.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.968+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14210272959434280656', time=2024-09-19T16:49:56.256494+0000, chain.objs.size()=1 2024-09-19T15:31:39.975 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.968+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.yHyk5fllfN6ufcBcQUA3IK-5leEgXXy_0 2024-09-19T15:31:39.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.968+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9895993591560868272', time=2024-09-19T16:49:56.562764+0000, chain.objs.size()=1 2024-09-19T15:31:39.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.968+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.hQ2YnQNiMwLOKujJ4kZcaKxlgi7dFnc_0 2024-09-19T15:31:39.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.968+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13338708272725494619', time=2024-09-19T16:49:57.163586+0000, chain.objs.size()=1 2024-09-19T15:31:39.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.968+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Baa-0lR--LdrGt7s2ELDwFZtTb-3b72_0 2024-09-19T15:31:39.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.968+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5438852520553036230', time=2024-09-19T16:49:57.469235+0000, chain.objs.size()=1 2024-09-19T15:31:39.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.968+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.eAiEo-TMFNFaJS9HL4_7W97KMshBKvV_0 2024-09-19T15:31:39.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.968+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17100978185377611165', time=2024-09-19T16:49:57.995581+0000, chain.objs.size()=1 2024-09-19T15:31:39.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.968+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.syZG4EVU5-UUOaHcIVVWUCtshsKIM1S_0 2024-09-19T15:31:39.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.968+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12946454640413338433', time=2024-09-19T16:49:59.223525+0000, chain.objs.size()=1 2024-09-19T15:31:39.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.968+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.fwF4dz90nBL0nBsPNT456TZO8T4r1vP_0 2024-09-19T15:31:39.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.968+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7815887896039891631', time=2024-09-19T16:49:59.291326+0000, chain.objs.size()=1 2024-09-19T15:31:39.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.968+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ke6JBzYD83WqZ4Ro6tkSRcyZUNh03Jm_0 2024-09-19T15:31:39.976 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.968+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5349331086513645454', time=2024-09-19T16:50:00.146099+0000, chain.objs.size()=1 2024-09-19T15:31:39.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.968+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.nA1QkXI1ApOib61sxt-riPzeaYOQ-gQ_0 2024-09-19T15:31:39.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.968+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2312737017174639831', time=2024-09-19T16:50:02.335796+0000, chain.objs.size()=1 2024-09-19T15:31:39.977 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.968+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.uhgyxQfKxYuIT4yvdEw9ZQWM3TqfLk6_0 2024-09-19T15:31:39.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.972+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11591808300832323045', time=2024-09-19T16:50:02.540784+0000, chain.objs.size()=1 2024-09-19T15:31:39.978 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.972+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.5WKo6KSAMkNsOaxj4wMNwjyugJTDFhU_0 2024-09-19T15:31:39.981 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47535 2024-09-19T15:31:39.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=37, truncated=0, next_marker='' 2024-09-19T15:31:39.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3170870922514474235', time=2024-09-19T16:50:02.772049+0000, chain.objs.size()=1 2024-09-19T15:31:39.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.1FPkH3V80v-JpA2e0JCATmPF2LxRRhv_0 2024-09-19T15:31:39.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2049393816943124449', time=2024-09-19T16:50:04.334869+0000, chain.objs.size()=1 2024-09-19T15:31:39.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.M5qK0GLthyo2rjEmcM-8GTuU6XM0O5b_0 2024-09-19T15:31:39.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11053459742391036860', time=2024-09-19T16:50:04.748598+0000, chain.objs.size()=1 2024-09-19T15:31:39.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.dKY4yhNoEijJqHzIWZK567im-txzRC__0 2024-09-19T15:31:39.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13297303160456341942', time=2024-09-19T16:50:05.681960+0000, chain.objs.size()=1 2024-09-19T15:31:39.984 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.-ouItZM2AvqmfH77Xuz73k1ZlFDrDzO_0 2024-09-19T15:31:39.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15954527326734212632', time=2024-09-19T16:50:51.737276+0000, chain.objs.size()=1 2024-09-19T15:31:39.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.346__shadow_.pDpd4mI4wj6QSHVSka8vb3CpcXEzFyZ_0 2024-09-19T15:31:39.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12628507697785206207', time=2024-09-19T16:52:17.521710+0000, chain.objs.size()=1 2024-09-19T15:31:39.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.390__shadow_.JAugqqLGtkckvucnav8EDit3-DVntZw_0 2024-09-19T15:31:39.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10167207215595564341', time=2024-09-19T16:52:53.027924+0000, chain.objs.size()=1 2024-09-19T15:31:39.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.408__shadow_.oLYbodlkOSPCshdp1_4WrFwdTnnOFiM_0 2024-09-19T15:31:39.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10982691145603566998', time=2024-09-19T16:53:39.705216+0000, chain.objs.size()=1 2024-09-19T15:31:39.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.431__shadow_.7-Q1focy_IpSiDq7cXzNHafgoZk9xNf_0 2024-09-19T15:31:39.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6859785664278350191', time=2024-09-19T16:53:49.979804+0000, chain.objs.size()=1 2024-09-19T15:31:39.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.436__shadow_.UGZ-oL-89oUmLmDrfPR7hvYyFLK9iNy_0 2024-09-19T15:31:39.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2400338048933817715', time=2024-09-19T16:54:45.637764+0000, chain.objs.size()=1 2024-09-19T15:31:39.985 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.459__shadow_.ncJ2W82CqDzPMCw4aB73PrgbUHvq61W_0 2024-09-19T15:31:39.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10720033513416717754', time=2024-09-19T16:54:51.626569+0000, chain.objs.size()=1 2024-09-19T15:31:39.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.461__shadow_.zsV9xlAcToNvjJUYAKqwBQnSl99f0lY_0 2024-09-19T15:31:39.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13955422309592229573', time=2024-09-19T16:55:02.514571+0000, chain.objs.size()=1 2024-09-19T15:31:39.986 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.976+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.465__shadow_.Kq-m5sOvVMbFxbi8rV2fBu4AXHcQ_sw_0 2024-09-19T15:31:39.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.980+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15914048669783039556', time=2024-09-19T16:55:03.451482+0000, chain.objs.size()=1 2024-09-19T15:31:39.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.980+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.465__shadow_.2QTtuoM4aS-GkmJILU0fJr_EDgaYRa-_0 2024-09-19T15:31:39.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.980+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5709049573708243459', time=2024-09-19T16:55:54.312082+0000, chain.objs.size()=1 2024-09-19T15:31:39.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.980+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.490__shadow_.L6KJox2LKnmeR_rWJZ83ZwCYzrliIUt_0 2024-09-19T15:31:39.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.980+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5709049573708243459', time=2024-09-19T16:55:54.904355+0000, chain.objs.size()=1 2024-09-19T15:31:39.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.980+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.490__shadow_.L6KJox2LKnmeR_rWJZ83ZwCYzrliIUt_0 2024-09-19T15:31:39.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.980+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7687777568940577720', time=2024-09-19T16:56:22.060401+0000, chain.objs.size()=1 2024-09-19T15:31:39.987 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.980+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.503__shadow:vjdbIfRxBe4w.PbHfN6JGIQynOLNKTv_.1FlZE6YVJFffVLJR2xeEpNz8BJZrUMj_0 2024-09-19T15:31:39.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.984+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17855141088209113213', time=2024-09-19T16:59:14.241039+0000, chain.objs.size()=1 2024-09-19T15:31:39.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.984+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.520__shadow:hD5SyRcack1KE9wXoDOhwr08FxYCKMH_.68Mi-LBUN-M43tVHHTkzXlh4XO4-GC-_0 2024-09-19T15:31:39.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.984+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13594950758413710833', time=2024-09-19T17:03:38.522263+0000, chain.objs.size()=1 2024-09-19T15:31:39.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.984+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.524__shadow_.JjJP4FJbqkoZeYPMIsRrC9XB2h_nuB4_0 2024-09-19T15:31:39.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.984+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.676247400913523053', time=2024-09-19T17:03:39.116065+0000, chain.objs.size()=2 2024-09-19T15:31:39.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.984+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.525__multipart_mymultipart.2~07lZQAdQ4lAJMpppsUsuxNWRFlXiCuD.1 2024-09-19T15:31:39.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.984+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.525__multipart_mymultipart.2~07lZQAdQ4lAJMpppsUsuxNWRFlXiCuD.2 2024-09-19T15:31:39.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.984+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.450153141506693349', time=2024-09-19T17:04:03.196822+0000, chain.objs.size()=1 2024-09-19T15:31:39.988 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.984+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.528__shadow_.7v_28yHslA08ydKn3w55D5SVBCtG9sY_0 2024-09-19T15:31:39.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.984+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16803135901471641041', time=2024-09-19T17:07:05.157439+0000, chain.objs.size()=1 2024-09-19T15:31:39.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.984+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.558__shadow_.AcYPjEaEaaPa3STnCVwwi-dxFMoZ4j8_0 2024-09-19T15:31:39.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.984+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1349799635070851721', time=2024-09-19T17:07:29.174103+0000, chain.objs.size()=1 2024-09-19T15:31:39.989 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.984+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.563__shadow_.gAPZklYwlwz073fBbpkwxtbKkN_zc3n_0 2024-09-19T15:31:39.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.988+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18360047678664019748', time=2024-09-19T17:07:51.956108+0000, chain.objs.size()=1 2024-09-19T15:31:39.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.988+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:9yB9iJmuj7gMUSciq8.1UIshAjUVeha_.mxWsxPJrk_BZnYf7oBm9P-jrq6FvESM_0 2024-09-19T15:31:39.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.988+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9855630923256678985', time=2024-09-19T17:07:53.584104+0000, chain.objs.size()=1 2024-09-19T15:31:39.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.988+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:QO9j6b2bMje5xwMBrMslIsPeprj3pLH_.BD9_yhjRPB4vrICUvR-S_77nvs_EUqd_0 2024-09-19T15:31:39.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.988+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14769788081211797419', time=2024-09-19T17:08:02.808519+0000, chain.objs.size()=1 2024-09-19T15:31:39.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.988+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:WJY01odCWKyUTW1uOOB7bfRbZKGFFbb_.2QG5OQU_INewQqYmJLIZEryLbgTIdHj_0 2024-09-19T15:31:39.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.988+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1640122396747661358', time=2024-09-19T17:08:16.077311+0000, chain.objs.size()=1 2024-09-19T15:31:39.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.988+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.573__shadow_.dkqxgO414ITDyIJjvuZN9e7QZbo9AKB_0 2024-09-19T15:31:39.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.988+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16174046371401144045', time=2024-09-19T17:08:20.255585+0000, chain.objs.size()=1 2024-09-19T15:31:39.992 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.988+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.574__shadow_.dMHMWrHSLbm6SM_8YSFkEVA121Xv8yU_0 2024-09-19T15:31:39.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.988+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13457247480217760475', time=2024-09-19T17:08:55.513449+0000, chain.objs.size()=1 2024-09-19T15:31:39.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.988+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:enUREHqeZfjlnjPkGhztbZx.uXByysk_.bE3fU3HQFUge46o3T8z-TRNUD-4CZZN_0 2024-09-19T15:31:39.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.988+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3676799776872553707', time=2024-09-19T17:09:16.965072+0000, chain.objs.size()=1 2024-09-19T15:31:39.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.988+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:1gwjTXyt7tIcDDIUk2rjEtByxmgZ24a_.XcF3EmJqJTQw_-HPXLwwOOieZJbJuwj_0 2024-09-19T15:31:39.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.988+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18028285951520899536', time=2024-09-19T17:09:21.504503+0000, chain.objs.size()=1 2024-09-19T15:31:39.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.988+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:US5G7cgIZW-c09c3WTA86xsvQGBX7HZ_.tsqQkpSCtsEOSTpa2_Zzr0sOjrvBQg5_0 2024-09-19T15:31:39.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.988+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2730312531709813753', time=2024-09-19T17:10:30.018059+0000, chain.objs.size()=1 2024-09-19T15:31:39.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.988+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.579__shadow:BpGN5K0I6Tzhl.8Aaq5oMIGhnC6OJqe_.iETwg2iqZziK5z4pT3wSYyI21-PBqsW_0 2024-09-19T15:31:39.993 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.988+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6339423568897273298', time=2024-09-19T17:10:35.679886+0000, chain.objs.size()=1 2024-09-19T15:31:39.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.988+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.580__shadow:VGr3t5gpx74PQq3rgN4SSfKjuVTp2ny_.kzn6JVRO5EL0TOJ-c8jE-8QAM9bzvvM_0 2024-09-19T15:31:39.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.988+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8483232979854979390', time=2024-09-19T17:10:35.758658+0000, chain.objs.size()=1 2024-09-19T15:31:39.994 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.988+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.580__shadow:XdUISp7PpZQqiYQfjwQ9PbR3ZNzvxbp_.WxiQilZ-crESV_z27FPP5RO7Xcaowx__0 2024-09-19T15:31:39.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.992+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14154937488470760439', time=2024-09-19T17:10:55.951745+0000, chain.objs.size()=1 2024-09-19T15:31:39.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.992+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.587__shadow:DdSMFu.K-87IQJtplbEmFO4NX2SQYof_.POr1yQzgC4EAN0Hjtvu_5H7Ccib54_Y_0 2024-09-19T15:31:39.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.992+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9954644990056561572', time=2024-09-19T17:18:01.521366+0000, chain.objs.size()=1 2024-09-19T15:31:39.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.992+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.627__shadow_.H1-kglDZdOV23PyVuzK4AkrshkRQoJ9_0 2024-09-19T15:31:39.997 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.992+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9479650742285783574', time=2024-09-19T17:23:56.457207+0000, chain.objs.size()=1 2024-09-19T15:31:39.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.992+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.740__shadow_.CE1y6sR0godWzZhGWOZqpTcXDmWYfvD_0 2024-09-19T15:31:39.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.992+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4055982340584153926', time=2024-09-19T17:25:09.561658+0000, chain.objs.size()=1 2024-09-19T15:31:39.998 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.992+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.748__shadow_.R7-BUmBPeHvlAercJ6x2r3YXZtS7Dtu_0 2024-09-19T15:31:40.003 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:39.996+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:40.004 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.000+0000 7f91ec459640 0 -- 172.21.15.153:0/159143849 >> [v2:172.21.15.153:6824/2028182193,v1:172.21.15.153:6825/2028182193] conn(0x55f89a40ede0 msgr2=0x7f90b8087d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T15:31:40.006 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.000+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T15:31:40.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:40.008 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:40.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48256' 2024-09-19T15:31:40.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='_GxHFbOcFyZbwUSuR-hXWCx6OTsK_G2M', time=2024-09-19T16:33:27.083962+0000, chain.objs.size()=2 2024-09-19T15:31:40.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.161__shadow_._heDvMP2zcWll1-6j_8FlF4IeIyZTy2_0 2024-09-19T15:31:40.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.161__shadow_._heDvMP2zcWll1-6j_8FlF4IeIyZTy2_1 2024-09-19T15:31:40.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2915248418059555474', time=2024-09-19T16:34:46.879885+0000, chain.objs.size()=1 2024-09-19T15:31:40.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.177__shadow_.oGsvUS-R7cbVuzvAAW2qSux3HYpPPn8_0 2024-09-19T15:31:40.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8106499462167639326', time=2024-09-19T16:39:31.645921+0000, chain.objs.size()=1 2024-09-19T15:31:40.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.233__shadow_.N9ACCpJjtHu4vZagdpGPZBJ1BWG33AI_0 2024-09-19T15:31:40.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.363940765145526509', time=2024-09-19T16:40:21.351317+0000, chain.objs.size()=1 2024-09-19T15:31:40.010 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.252__shadow_.1kT_v7qVkcFZdcGWHSFjTFrG8VEghPY_0 2024-09-19T15:31:40.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13439655180128197068', time=2024-09-19T16:42:28.141364+0000, chain.objs.size()=1 2024-09-19T15:31:40.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.pT78acjv-EZ3woXW5tCPulGjRXKfwCo_0 2024-09-19T15:31:40.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11779379088633046612', time=2024-09-19T16:42:29.922121+0000, chain.objs.size()=1 2024-09-19T15:31:40.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.-5Z7eEBcRX44ne8ZCr-Pdks9RiTDuDN_0 2024-09-19T15:31:40.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16893290197452079976', time=2024-09-19T16:42:30.066600+0000, chain.objs.size()=1 2024-09-19T15:31:40.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.91gp3K8K4SZkbSsVDATC0cRQUu9Sy9-_0 2024-09-19T15:31:40.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1780915376188063967', time=2024-09-19T16:42:32.690892+0000, chain.objs.size()=1 2024-09-19T15:31:40.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.mawKu731j1CtLaL2U1E76cYfWjwnCS-_0 2024-09-19T15:31:40.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10847561861450733694', time=2024-09-19T16:42:33.159314+0000, chain.objs.size()=1 2024-09-19T15:31:40.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.tEoYFffrpAoLedev-J8DNavHYTmNCwY_0 2024-09-19T15:31:40.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5602389129679941222', time=2024-09-19T16:42:33.161315+0000, chain.objs.size()=1 2024-09-19T15:31:40.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.DQJ1mbHdruPNh4jV3ZNb82_eCltqypJ_0 2024-09-19T15:31:40.011 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17889965376467184363', time=2024-09-19T16:42:34.270934+0000, chain.objs.size()=1 2024-09-19T15:31:40.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.004+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.KCrhH357GX6m3ZWJc_AEKhTm7HZzuVJ_0 2024-09-19T15:31:40.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.008+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.629387869423463180', time=2024-09-19T16:42:35.666215+0000, chain.objs.size()=1 2024-09-19T15:31:40.012 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.008+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Yv65jAjfbDdmum2OmWvfVdnoBVnWpZA_0 2024-09-19T15:31:40.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.008+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12059440569154673089', time=2024-09-19T16:42:36.797943+0000, chain.objs.size()=1 2024-09-19T15:31:40.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.008+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.d-Idc8lYDuulWXxfxazH64eE4T3ByVs_0 2024-09-19T15:31:40.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.008+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2149175915805068374', time=2024-09-19T16:42:41.600915+0000, chain.objs.size()=1 2024-09-19T15:31:40.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.008+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.gmv16rdOCC5NA7l-VyQ9Jjmdc9l759m_0 2024-09-19T15:31:40.013 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.008+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10045630345089840136', time=2024-09-19T16:42:43.092440+0000, chain.objs.size()=1 2024-09-19T15:31:40.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.008+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ryyjXypW29Rs_pFRKu2OGie4z_9I-0p_0 2024-09-19T15:31:40.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.008+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11341357376903631856', time=2024-09-19T16:42:43.497396+0000, chain.objs.size()=1 2024-09-19T15:31:40.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.008+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.gViL8lr82MCMf64taA9VhdBhObvQN_6_0 2024-09-19T15:31:40.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.008+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5215329830661312143', time=2024-09-19T16:42:43.608352+0000, chain.objs.size()=1 2024-09-19T15:31:40.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.008+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.NPq5S5LHOqtQ29AHnqkCTN1O0dFU-UD_0 2024-09-19T15:31:40.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.008+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9304216619868459820', time=2024-09-19T16:42:44.153148+0000, chain.objs.size()=1 2024-09-19T15:31:40.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.008+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.o3vzDsCQI0KNEqcZappP0K2FUqeOZCO_0 2024-09-19T15:31:40.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.008+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8358263258350855642', time=2024-09-19T16:42:45.592526+0000, chain.objs.size()=1 2024-09-19T15:31:40.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.008+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.mqdofOFeM0bZbITSouyzx9zryRGpe89_0 2024-09-19T15:31:40.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.008+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15600120222345332499', time=2024-09-19T16:42:45.947998+0000, chain.objs.size()=1 2024-09-19T15:31:40.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.008+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.VrMYj4Esw386HNs7NXGwn-uD_MjjsXk_0 2024-09-19T15:31:40.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.008+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12396475442857945508', time=2024-09-19T16:42:46.170896+0000, chain.objs.size()=1 2024-09-19T15:31:40.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.008+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.yUnYi6JsUl0e_W0eHIHaugD1uSJZL0h_0 2024-09-19T15:31:40.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.008+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.76140650776002696', time=2024-09-19T16:42:46.466684+0000, chain.objs.size()=1 2024-09-19T15:31:40.014 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.008+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.vXhDivHgIzetsY2hxHrvr2LZB3wmcpN_0 2024-09-19T15:31:40.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.012+0000 7f91ecc5a640 0 -- 172.21.15.153:0/159143849 >> [v2:172.21.15.196:6800/2881705388,v1:172.21.15.196:6801/2881705388] conn(0x55f89a413150 msgr2=0x55f89a415540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T15:31:40.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.012+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4475582503514030719', time=2024-09-19T16:42:47.342242+0000, chain.objs.size()=1 2024-09-19T15:31:40.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.012+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.e7BLLNeFp4XGmgYwr6tSPsFoKlgQ-Hd_0 2024-09-19T15:31:40.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.012+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15440387534458573016', time=2024-09-19T16:42:48.177280+0000, chain.objs.size()=1 2024-09-19T15:31:40.017 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.012+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.jl0CCvo5Au_rTRGA7Ei0YNwRHPZP0uh_0 2024-09-19T15:31:40.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.012+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10332950344930553580', time=2024-09-19T16:42:48.179001+0000, chain.objs.size()=1 2024-09-19T15:31:40.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.012+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.MOhX7CThBmPZfjph869YeWTHAzFxFt1_0 2024-09-19T15:31:40.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.012+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12388429551087717485', time=2024-09-19T16:42:48.456326+0000, chain.objs.size()=1 2024-09-19T15:31:40.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.012+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.UfGcqXel8G45Ja7BcTh8oIutTEr8Map_0 2024-09-19T15:31:40.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.012+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4148507066892252786', time=2024-09-19T16:42:49.428053+0000, chain.objs.size()=1 2024-09-19T15:31:40.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.012+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.xo5fXYl_XUs9tEZVM8B_wJwdqcUI2hC_0 2024-09-19T15:31:40.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.012+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4370313019151742401', time=2024-09-19T16:42:49.430852+0000, chain.objs.size()=1 2024-09-19T15:31:40.018 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.012+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.4iL2UvLyVlY_FsqtxwWIH6h_7fSVMF2_0 2024-09-19T15:31:40.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.012+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13774967150725434452', time=2024-09-19T16:42:49.776872+0000, chain.objs.size()=1 2024-09-19T15:31:40.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.012+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.sFwLFkbSf4K8YyNm4MWTiQAcunOxedK_0 2024-09-19T15:31:40.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.012+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3826197580173620714', time=2024-09-19T16:42:52.406182+0000, chain.objs.size()=1 2024-09-19T15:31:40.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.012+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.966GXcpOuMybkKSiCegZlzMV-lwJzCd_0 2024-09-19T15:31:40.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.012+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13876173884207978984', time=2024-09-19T16:42:52.447058+0000, chain.objs.size()=1 2024-09-19T15:31:40.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.012+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.W_N52P5OpjlPmMjW3Ce3cgU7_dWwlUd_0 2024-09-19T15:31:40.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.012+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8858840159324659166', time=2024-09-19T16:42:53.975214+0000, chain.objs.size()=1 2024-09-19T15:31:40.019 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.012+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.SouesJs6Y7Wojn1n3VX6bSbUqfEJ7pm_0 2024-09-19T15:31:40.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.012+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16642736960159306508', time=2024-09-19T16:42:54.343967+0000, chain.objs.size()=1 2024-09-19T15:31:40.020 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.012+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.4uLyT2T_2uJyGA1tvX-iGwo8mJ398pE_0 2024-09-19T15:31:40.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.016+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3813576896105603784', time=2024-09-19T16:42:55.635764+0000, chain.objs.size()=1 2024-09-19T15:31:40.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.016+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.jhuP0LsOjsY25PANV8cipO3ynBk-jkx_0 2024-09-19T15:31:40.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.016+0000 7f91ecc5a640 0 -- 172.21.15.153:0/159143849 >> [v2:172.21.15.153:6816/795993612,v1:172.21.15.153:6817/795993612] conn(0x7f91e405cdb0 msgr2=0x7f91e4073960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T15:31:40.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.016+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11465173431099347244', time=2024-09-19T16:42:56.014850+0000, chain.objs.size()=1 2024-09-19T15:31:40.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.016+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.3tlMcav7FovTGc4aR8EmGEwWGhTqCOP_0 2024-09-19T15:31:40.023 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.016+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9477786434864920301', time=2024-09-19T16:42:56.431369+0000, chain.objs.size()=1 2024-09-19T15:31:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.016+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.92KLnF6X2tgJuHVOFxqEHwK1Z8a2hPn_0 2024-09-19T15:31:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.016+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15514267015434946715', time=2024-09-19T16:42:56.522762+0000, chain.objs.size()=1 2024-09-19T15:31:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.016+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.OR6PkGur-KoXEoGn6no-kDwcDNsGQab_0 2024-09-19T15:31:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.016+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18076081213383412323', time=2024-09-19T16:42:56.595189+0000, chain.objs.size()=1 2024-09-19T15:31:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.016+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.wp9tSVNcfpHI8X2UbwpI8KTti1k-rSw_0 2024-09-19T15:31:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.016+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1099158360996990712', time=2024-09-19T16:42:57.404408+0000, chain.objs.size()=1 2024-09-19T15:31:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.016+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ktiBFBPctjweLkWdlN9DTruOBJdv2DO_0 2024-09-19T15:31:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.016+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11617963157678601292', time=2024-09-19T16:42:57.407424+0000, chain.objs.size()=1 2024-09-19T15:31:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.016+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.S0qVLf42A3kpK9uM7btuo4RB8gFr79j_0 2024-09-19T15:31:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.016+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2583564896440448969', time=2024-09-19T16:42:57.709955+0000, chain.objs.size()=1 2024-09-19T15:31:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.016+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.hz3Y6etQi_kFnjHLiy_MrO8DCykBmmB_0 2024-09-19T15:31:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.016+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3931483855841967845', time=2024-09-19T16:42:58.759102+0000, chain.objs.size()=1 2024-09-19T15:31:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.016+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.NNEyah1ive8P8CZQaqDvtbwL7k3cuYA_0 2024-09-19T15:31:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.016+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8501814577568278537', time=2024-09-19T16:43:22.208416+0000, chain.objs.size()=1 2024-09-19T15:31:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.016+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.272__shadow_.-RFgmEkveZWvXdviGRflxgzuec8CkMs_0 2024-09-19T15:31:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.016+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10607227438491668505', time=2024-09-19T16:43:38.177176+0000, chain.objs.size()=1 2024-09-19T15:31:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.016+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.279__shadow_.htkWHnpQixHYFxvLIddb9h4LEYzD4Uw_0 2024-09-19T15:31:40.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.020+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9710437781960324523', time=2024-09-19T16:43:52.282697+0000, chain.objs.size()=1 2024-09-19T15:31:40.026 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.020+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.285__shadow_.kvvgbB7p41e_JcLxrz4fh5OTbG9YtNW_0 2024-09-19T15:31:40.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.020+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14779561375101509512', time=2024-09-19T16:44:18.363351+0000, chain.objs.size()=1 2024-09-19T15:31:40.027 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.020+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.qxejC4i5SosZHa-UPNgXlP_CflpEIGZ_0 2024-09-19T15:31:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.024+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7933424180018030656', time=2024-09-19T16:44:18.615963+0000, chain.objs.size()=1 2024-09-19T15:31:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.024+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.aZSyOPYi9-HHZlrmlGpigM8L6jXbcG5_0 2024-09-19T15:31:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.024+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2040988229584521191', time=2024-09-19T16:44:18.632372+0000, chain.objs.size()=1 2024-09-19T15:31:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.024+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.3G8O-oqo_w3TZqteX3PArVPpgwFZb6D_0 2024-09-19T15:31:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.024+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7985864831108224272', time=2024-09-19T16:44:30.490153+0000, chain.objs.size()=1 2024-09-19T15:31:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.024+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.298__shadow_.AAuNwKDvnXddpRB4XxrdJN03tluxiIM_0 2024-09-19T15:31:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.024+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12234006412041305818', time=2024-09-19T16:44:44.784716+0000, chain.objs.size()=1 2024-09-19T15:31:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.024+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.304__shadow_.mQVn6vEW-4J1Ny7vxfw1FksxVjMvOZq_0 2024-09-19T15:31:40.029 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.024+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.938173701821069535', time=2024-09-19T16:45:29.930459+0000, chain.objs.size()=1 2024-09-19T15:31:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.024+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.321__shadow_.fdCic__Anvwl7gJklJ75uzM3FLF6ciA_0 2024-09-19T15:31:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.024+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15823716608010102187', time=2024-09-19T16:47:18.404237+0000, chain.objs.size()=1 2024-09-19T15:31:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.024+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.26HesIqsSUIdoUuLRct5Lk2LhN4ZMZt_0 2024-09-19T15:31:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.024+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17404795680986862774', time=2024-09-19T16:47:18.993004+0000, chain.objs.size()=1 2024-09-19T15:31:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.024+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.RLRWDLHwI1wXn7uiSq1IHkIXpBTzisz_0 2024-09-19T15:31:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.024+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7205600118986633983', time=2024-09-19T16:47:19.511152+0000, chain.objs.size()=1 2024-09-19T15:31:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.024+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.wE_3qluPpu0WdrC-ha0obsY9nMMTOdQ_0 2024-09-19T15:31:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.024+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5291179059183324574', time=2024-09-19T16:47:23.011744+0000, chain.objs.size()=1 2024-09-19T15:31:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.024+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.h2oj7w41fi1PR68QsKBGNg1VaHPB1b__0 2024-09-19T15:31:40.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.024+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16422545238892928316', time=2024-09-19T16:47:25.091127+0000, chain.objs.size()=1 2024-09-19T15:31:40.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.024+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.IEe-u8492XNw2AUBFoPo1A73G-AIZDp_0 2024-09-19T15:31:40.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.024+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7067486730481640150', time=2024-09-19T16:47:25.630840+0000, chain.objs.size()=1 2024-09-19T15:31:40.031 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.024+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.AUd0V6SZcSf_YstZbXADRm3bHspDG8Q_0 2024-09-19T15:31:40.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.028+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2427946894584405431', time=2024-09-19T16:47:26.831110+0000, chain.objs.size()=1 2024-09-19T15:31:40.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.028+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.FRbm-NgBYLYKzHwtqZAgfsLRFnuAdSV_0 2024-09-19T15:31:40.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.028+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6684985696597330496', time=2024-09-19T16:47:27.267108+0000, chain.objs.size()=1 2024-09-19T15:31:40.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.028+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.yDo6s9y2FJTLHPsqXwJZ66ZVSTsgBzd_0 2024-09-19T15:31:40.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.028+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14941473941305733324', time=2024-09-19T16:47:28.400055+0000, chain.objs.size()=1 2024-09-19T15:31:40.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.028+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.fMUbLVhMC6z34HsHENYs55hgHt-ZcSu_0 2024-09-19T15:31:40.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.028+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11062273930365865134', time=2024-09-19T16:47:28.681727+0000, chain.objs.size()=1 2024-09-19T15:31:40.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.028+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.6pkehf55g0l2hOwldzsCMA6dh0-L4y2_0 2024-09-19T15:31:40.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.028+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15738402859656044974', time=2024-09-19T16:47:31.090235+0000, chain.objs.size()=1 2024-09-19T15:31:40.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.028+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.lyOlZHwC-30r3kGdWNyLHJL7l_pvQik_0 2024-09-19T15:31:40.034 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.028+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12434161406467334851', time=2024-09-19T16:47:31.465080+0000, chain.objs.size()=1 2024-09-19T15:31:40.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.028+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.BiNtAlQioNOmcM_y5pIGpyeI5yMp5Jb_0 2024-09-19T15:31:40.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.028+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7991783262899545243', time=2024-09-19T16:47:31.584640+0000, chain.objs.size()=1 2024-09-19T15:31:40.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.028+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.wQ2Qv8R1D-KBv0k-5vb2S6JDCgGkQhZ_0 2024-09-19T15:31:40.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.028+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7710375226578771528', time=2024-09-19T16:47:32.579146+0000, chain.objs.size()=1 2024-09-19T15:31:40.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.028+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.BW5zLNslMWAqBVDTh3YF-uYlXg2_Hhf_0 2024-09-19T15:31:40.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.028+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11899983444231058466', time=2024-09-19T16:47:32.581359+0000, chain.objs.size()=1 2024-09-19T15:31:40.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.028+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.6_XPpAZ960mROg2lWHi9AdgkLzg1lPo_0 2024-09-19T15:31:40.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.028+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13943087176511964406', time=2024-09-19T16:47:32.916270+0000, chain.objs.size()=1 2024-09-19T15:31:40.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.028+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.P9e_xtuBSTC9fBq80T6YwbP1BdjgbSk_0 2024-09-19T15:31:40.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.028+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13538755387466267197', time=2024-09-19T16:47:32.918402+0000, chain.objs.size()=1 2024-09-19T15:31:40.035 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.028+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.VCDqNqrJMLEUqzBcm0vfvajzb4QcAZf_0 2024-09-19T15:31:40.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.032+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9575530759809375813', time=2024-09-19T16:47:33.259302+0000, chain.objs.size()=1 2024-09-19T15:31:40.036 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.032+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.rM1Y8DAcKXQkJpLWj3S3kBgmVHM0Kb0_0 2024-09-19T15:31:40.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.032+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5054445178433986723', time=2024-09-19T16:47:33.714312+0000, chain.objs.size()=1 2024-09-19T15:31:40.038 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.032+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.o3apl97tQgsWeepZDpg9WC-Cx_aiKV0_0 2024-09-19T15:31:40.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.032+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1394889718530041431', time=2024-09-19T16:47:33.967673+0000, chain.objs.size()=1 2024-09-19T15:31:40.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.032+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.d9-HMZ8HKyPQ6K5zTOrXa6VP2B1FpvF_0 2024-09-19T15:31:40.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.032+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14344159940344991672', time=2024-09-19T16:47:37.752944+0000, chain.objs.size()=1 2024-09-19T15:31:40.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.032+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.WT41iM4_lC1HljWdcY1fQvZ8_mjjMN4_0 2024-09-19T15:31:40.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.032+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6372062268634175592', time=2024-09-19T16:47:39.867421+0000, chain.objs.size()=1 2024-09-19T15:31:40.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.032+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.97WpJX0hAU6K4ej8UZkwborE7haYaUn_0 2024-09-19T15:31:40.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.032+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15148305907633142406', time=2024-09-19T16:47:39.952602+0000, chain.objs.size()=1 2024-09-19T15:31:40.039 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.032+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.eUjaQvadJWgthBgB171VOe0pW5EbTQq_0 2024-09-19T15:31:40.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.032+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4394756835684487985', time=2024-09-19T16:47:43.930163+0000, chain.objs.size()=1 2024-09-19T15:31:40.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.032+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Dx00pOkSeq69f5FFsVnmkOy3FYph7UE_0 2024-09-19T15:31:40.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.032+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5407594229812405460', time=2024-09-19T16:47:44.054985+0000, chain.objs.size()=1 2024-09-19T15:31:40.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.032+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.WMwreIBEqcwxW22DXNOqtP3IJXS2eKX_0 2024-09-19T15:31:40.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.032+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2725372872642525175', time=2024-09-19T16:47:45.521798+0000, chain.objs.size()=1 2024-09-19T15:31:40.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.032+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.jYjHtlvHj2ubb6ZPb8lyNEk1MRrdjY7_0 2024-09-19T15:31:40.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.032+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9372743507505422577', time=2024-09-19T16:47:47.567055+0000, chain.objs.size()=1 2024-09-19T15:31:40.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.032+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.EHTsig6sFXrIaO3DAH6J6vxQ0r5y7CU_0 2024-09-19T15:31:40.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.032+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17578985475069137061', time=2024-09-19T16:47:48.350305+0000, chain.objs.size()=1 2024-09-19T15:31:40.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.032+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.6t_AxGaZld5wafBTrSqx4xP6zWgMIj7_0 2024-09-19T15:31:40.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.032+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16838346752696288521', time=2024-09-19T16:47:48.824036+0000, chain.objs.size()=1 2024-09-19T15:31:40.040 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.032+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.IjuvsRvjOmcchBMDaiUruQhU7BKsbM7_0 2024-09-19T15:31:40.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.036+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3766193271424956555', time=2024-09-19T16:49:35.329869+0000, chain.objs.size()=1 2024-09-19T15:31:40.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.036+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.cCjWPwhSpnpeHvVk3adA_ch4T_LRcdX_0 2024-09-19T15:31:40.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.036+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16078286968240511357', time=2024-09-19T16:49:37.943942+0000, chain.objs.size()=1 2024-09-19T15:31:40.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.036+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.C-qU19k97gR8UHLTdy_4g-PjZG46lpp_0 2024-09-19T15:31:40.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.036+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12096913633864152918', time=2024-09-19T16:49:39.436891+0000, chain.objs.size()=1 2024-09-19T15:31:40.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.036+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.lahBhRM4iQ8YbWION2-Uev0G9wBnMwI_0 2024-09-19T15:31:40.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.036+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10923327777692655184', time=2024-09-19T16:49:39.656440+0000, chain.objs.size()=1 2024-09-19T15:31:40.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.036+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.zxu2wAXDQoaYC81b6AahnjdOg2D-pjH_0 2024-09-19T15:31:40.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.036+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11171949379130346117', time=2024-09-19T16:49:39.838285+0000, chain.objs.size()=1 2024-09-19T15:31:40.043 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.036+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.GrL4EP35JsgkQ0Qk9wE0PB-oJQ_cGaK_0 2024-09-19T15:31:40.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.036+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11776119601707779275', time=2024-09-19T16:49:41.192814+0000, chain.objs.size()=1 2024-09-19T15:31:40.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.036+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.glbUU9g30V1frocpszfaJK7tVb4e9IF_0 2024-09-19T15:31:40.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.036+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13169071602661438469', time=2024-09-19T16:49:42.475406+0000, chain.objs.size()=1 2024-09-19T15:31:40.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.036+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.8gkterOoY-RohNbRl4kuHeCVkEUlxzE_0 2024-09-19T15:31:40.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.036+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7545251107806908598', time=2024-09-19T16:49:42.514961+0000, chain.objs.size()=1 2024-09-19T15:31:40.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.036+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.7zA6RYWTNCb03NTOAkSTQ-ernn0AUIJ_0 2024-09-19T15:31:40.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.036+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6000771163492710001', time=2024-09-19T16:49:49.219684+0000, chain.objs.size()=1 2024-09-19T15:31:40.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.036+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.RkRF9H0JtxTkAYXQ5LfcHmEbhHqZxA0_0 2024-09-19T15:31:40.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.036+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4980593928498568162', time=2024-09-19T16:49:50.250491+0000, chain.objs.size()=1 2024-09-19T15:31:40.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.036+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.XShJsWKoQAGg_fdjl7XwEGZBK8nlQOr_0 2024-09-19T15:31:40.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.036+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2254958276963094835', time=2024-09-19T16:49:50.316240+0000, chain.objs.size()=1 2024-09-19T15:31:40.044 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.036+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.VhMAIxatF1tYTJAnEsbwOkeNEYDGyRp_0 2024-09-19T15:31:40.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.040+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.50498297060366964', time=2024-09-19T16:49:50.494917+0000, chain.objs.size()=1 2024-09-19T15:31:40.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.040+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.xjFyhfEVJNo8RYkUC4JPbBucBE_thVL_0 2024-09-19T15:31:40.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.040+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6152271904464994447', time=2024-09-19T16:49:52.495717+0000, chain.objs.size()=1 2024-09-19T15:31:40.046 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.040+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Qso9jarOGwBrfeVqPXIR56CRTcRdnaS_0 2024-09-19T15:31:40.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.040+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15312155551458596655', time=2024-09-19T16:49:52.761089+0000, chain.objs.size()=1 2024-09-19T15:31:40.047 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.040+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.KHGQLmDr_t3UiBpahBbEyh6MlaSdGKq_0 2024-09-19T15:31:40.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.044+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5074304380001854572', time=2024-09-19T16:49:53.524810+0000, chain.objs.size()=1 2024-09-19T15:31:40.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.044+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Y89fhlb1K4A6adXBUpK8yjSheNvuPls_0 2024-09-19T15:31:40.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.044+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3283674005971392455', time=2024-09-19T16:49:54.195900+0000, chain.objs.size()=1 2024-09-19T15:31:40.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.044+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.jinA5Y7kyqQwKEHuIKaUJ3ONAiB9wHc_0 2024-09-19T15:31:40.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.044+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17559583523592739684', time=2024-09-19T16:49:55.106364+0000, chain.objs.size()=1 2024-09-19T15:31:40.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.044+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.oUC3lw0q-jF8OnxjlEZglv-1DeDA3ud_0 2024-09-19T15:31:40.049 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.044+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14398803877507587317', time=2024-09-19T16:49:56.574474+0000, chain.objs.size()=1 2024-09-19T15:31:40.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.044+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.VHCThmQdQnloi3uZT-QBOqX5nMPhMGp_0 2024-09-19T15:31:40.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.044+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1445100454542215818', time=2024-09-19T16:49:57.207485+0000, chain.objs.size()=1 2024-09-19T15:31:40.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.044+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.mqijq2hkup4_-vWDnRL9Zm6n4POkpP__0 2024-09-19T15:31:40.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.044+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.648482277359969621', time=2024-09-19T16:49:57.582813+0000, chain.objs.size()=1 2024-09-19T15:31:40.050 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.044+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.qZHHxl2NW5fzXqa_DBZTiAtO3Lrpscc_0 2024-09-19T15:31:40.052 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48256 2024-09-19T15:31:40.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-19T15:31:40.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12548583438975859735', time=2024-09-19T16:49:58.184450+0000, chain.objs.size()=1 2024-09-19T15:31:40.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.onDisZlTk5SdGTUpX206nbBiUrI5fgq_0 2024-09-19T15:31:40.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5166385993213965059', time=2024-09-19T16:50:00.449325+0000, chain.objs.size()=1 2024-09-19T15:31:40.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.dOz0GXmc93UeGCAHamI-RMRf8tuqiQv_0 2024-09-19T15:31:40.055 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17637395999176502810', time=2024-09-19T16:50:02.069140+0000, chain.objs.size()=1 2024-09-19T15:31:40.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.UUEEQlGSergRzlrAgzpspE3exUyeAdH_0 2024-09-19T15:31:40.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9635175869042235768', time=2024-09-19T16:50:03.014683+0000, chain.objs.size()=1 2024-09-19T15:31:40.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.L-IWmYwAPe4jGdYxmIoF8lNJ8PDCgAo_0 2024-09-19T15:31:40.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6627729748191081532', time=2024-09-19T16:50:03.175990+0000, chain.objs.size()=1 2024-09-19T15:31:40.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.0C9kvh-gaZa8HterTDmvFvHJXRxdwuW_0 2024-09-19T15:31:40.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7971028912275284821', time=2024-09-19T16:50:03.919304+0000, chain.objs.size()=1 2024-09-19T15:31:40.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ceUiRqZZ-wNC9jwT24tYcTlCGD60BBn_0 2024-09-19T15:31:40.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2559680984815844969', time=2024-09-19T16:50:03.921132+0000, chain.objs.size()=1 2024-09-19T15:31:40.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.H0QXUfinVoIqyvz0mCJ83gVL3v38Ucu_0 2024-09-19T15:31:40.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5349779722980798943', time=2024-09-19T16:50:20.304261+0000, chain.objs.size()=1 2024-09-19T15:31:40.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.331__shadow_.L5jJE_JzBGY5Z7BhJDEC1Nc2e8kxcuZ_0 2024-09-19T15:31:40.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17260469539310946155', time=2024-09-19T16:51:43.922226+0000, chain.objs.size()=1 2024-09-19T15:31:40.056 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.374__shadow_.Ho3IAV5PRAaeoc3E1yMRvgLinR033Li_0 2024-09-19T15:31:40.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17996064805329610815', time=2024-09-19T16:53:37.589744+0000, chain.objs.size()=1 2024-09-19T15:31:40.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.430__shadow_.bI4MoSVLZzUNDfnN0XzNQ_USzaJ8KvS_0 2024-09-19T15:31:40.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10153163335732250315', time=2024-09-19T16:53:56.141459+0000, chain.objs.size()=1 2024-09-19T15:31:40.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.439__shadow_.ayT7o-_gzzfc90bmSpCAf91j5S9V5Qn_0 2024-09-19T15:31:40.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1851250716906607920', time=2024-09-19T16:55:57.946717+0000, chain.objs.size()=1 2024-09-19T15:31:40.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.048+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.491__shadow_.ewYzCGwj5Qdv1ke9ibPDQ1PZY3wUUOZ_0 2024-09-19T15:31:40.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.052+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10066187127819908205', time=2024-09-19T16:56:22.028821+0000, chain.objs.size()=1 2024-09-19T15:31:40.057 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.052+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.503__shadow:vjdbIfRxBe4w.PbHfN6JGIQynOLNKTv_.1FlZE6YVJFffVLJR2xeEpNz8BJZrUMj_0 2024-09-19T15:31:40.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.056+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~vVZOrIIXJBCHg5JR3MTrAW2EPcR0WF6', time=2024-09-19T17:07:16.198597+0000, chain.objs.size()=1 2024-09-19T15:31:40.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.056+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.561__multipart_mymultipart.2~vVZOrIIXJBCHg5JR3MTrAW2EPcR0WF6.1 2024-09-19T15:31:40.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.056+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8590362062169671164', time=2024-09-19T17:08:13.280794+0000, chain.objs.size()=1 2024-09-19T15:31:40.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.056+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.572__shadow_.g8YlprElCngIQ57p_iSoEwu3IpfCrBR_0 2024-09-19T15:31:40.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.056+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17627858099253962212', time=2024-09-19T17:08:21.527919+0000, chain.objs.size()=1 2024-09-19T15:31:40.061 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.056+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.574__shadow:rJ38HyKt-SkbxGfSM3rskG407rhHJss_.7bD4pwQiDL33181ORomu6_PO48-qo8o_0 2024-09-19T15:31:40.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.056+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14348789513231852962', time=2024-09-19T17:08:24.790487+0000, chain.objs.size()=1 2024-09-19T15:31:40.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.056+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.574__shadow:7xsRwJ431S2zmIRDpfQt0U1iXjqB0T6_.lMFJpEj6iOhBTl42Muz0EGCmQYIakoD_0 2024-09-19T15:31:40.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.056+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14190891722747252917', time=2024-09-19T17:09:24.764750+0000, chain.objs.size()=1 2024-09-19T15:31:40.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.056+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:TnNvYJlBn3rJ.x2Ugo6v8E9kWoO7DEK_.FbydnvlQWiSdbHx_SpX5XbGqgGn8nDy_0 2024-09-19T15:31:40.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.056+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3924362231086774622', time=2024-09-19T17:10:51.357594+0000, chain.objs.size()=1 2024-09-19T15:31:40.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.056+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.586__shadow:PN0p0NL0U1deVjYXredHR55yZRZLrXc_.1OXcmEdFknT3KWc3f22RBS6HxrsEy89_0 2024-09-19T15:31:40.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.056+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15294522352222905863', time=2024-09-19T17:10:55.211156+0000, chain.objs.size()=1 2024-09-19T15:31:40.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.056+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.587__shadow:ler9ifSP.YZqSdn-MoB9cAJOLEYPVwk_.4FxdZ7syW8RMkRricrrA9gl13Bf8w2p_0 2024-09-19T15:31:40.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.056+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2551084755252010283', time=2024-09-19T17:27:20.105226+0000, chain.objs.size()=1 2024-09-19T15:31:40.062 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.056+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.765__shadow_.BEaDBDdZ3w5ZWqLlv2Vt6_hgOk18jW5_0 2024-09-19T15:31:40.065 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.060+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:40.067 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.060+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T15:31:40.068 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:40.069 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:40.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43041' 2024-09-19T15:31:40.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5084281508192080872', time=2024-09-19T16:39:46.322227+0000, chain.objs.size()=1 2024-09-19T15:31:40.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.238__shadow_.g-hLZLDVNVHT4W6AYd42-XfI1tI6Gon_0 2024-09-19T15:31:40.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6672737941015496993', time=2024-09-19T16:40:25.933887+0000, chain.objs.size()=1 2024-09-19T15:31:40.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.254__shadow_.YLPcHBZFaFEJQbLJQxNqhFYqlbR8lb0_0 2024-09-19T15:31:40.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6868682000588007074', time=2024-09-19T16:40:37.208758+0000, chain.objs.size()=1 2024-09-19T15:31:40.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.259__shadow_.O8XSyQI5JhvSqsBrwhh9Cloux2-c3SB_0 2024-09-19T15:31:40.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17604394857198129088', time=2024-09-19T16:42:28.250943+0000, chain.objs.size()=1 2024-09-19T15:31:40.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.TqnpmXkdqNLZp0vkktPIJGFrX3MKHth_0 2024-09-19T15:31:40.070 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16206726698286827291', time=2024-09-19T16:42:29.077135+0000, chain.objs.size()=1 2024-09-19T15:31:40.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.UOT_6duhgpwGh0YRG-kf3xkyOUusqBl_0 2024-09-19T15:31:40.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10048495628241936175', time=2024-09-19T16:42:29.152311+0000, chain.objs.size()=1 2024-09-19T15:31:40.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.MOTNh8KOSyqj4z3kjCrjaInVMtYvjTy_0 2024-09-19T15:31:40.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4084733351530740540', time=2024-09-19T16:42:30.858893+0000, chain.objs.size()=1 2024-09-19T15:31:40.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ipaqzyQu5CQp7h1GgEq5Xb3EQpS_5-T_0 2024-09-19T15:31:40.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4284125633253347122', time=2024-09-19T16:42:31.144467+0000, chain.objs.size()=1 2024-09-19T15:31:40.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.zkSN8j5zO9jG-SnYlVWbx988RfkUjt5_0 2024-09-19T15:31:40.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11323763105408669401', time=2024-09-19T16:42:31.239570+0000, chain.objs.size()=1 2024-09-19T15:31:40.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ishvw9lvVsAF3OniJgmFt5jhx2ESqQT_0 2024-09-19T15:31:40.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9067141462642098502', time=2024-09-19T16:42:32.651191+0000, chain.objs.size()=1 2024-09-19T15:31:40.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.spp4JBhVtwLjE3oiMGqFsvK_IHWA8sv_0 2024-09-19T15:31:40.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17757647063032473469', time=2024-09-19T16:42:33.477429+0000, chain.objs.size()=1 2024-09-19T15:31:40.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.KjuHifAvVzCAiwhVPJGszHizl9HhgF8_0 2024-09-19T15:31:40.071 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5224025609756162903', time=2024-09-19T16:42:34.569089+0000, chain.objs.size()=1 2024-09-19T15:31:40.072 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.064+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.y0v-TlFrBYLNQ8G8GTLDvOz8NGUp1sX_0 2024-09-19T15:31:40.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.068+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3049590031258701561', time=2024-09-19T16:42:34.871400+0000, chain.objs.size()=1 2024-09-19T15:31:40.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.068+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.uaUf_p6SzzP9AYxBpTB0HSYnH57xWjv_0 2024-09-19T15:31:40.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.068+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15413798006340570333', time=2024-09-19T16:42:37.228292+0000, chain.objs.size()=1 2024-09-19T15:31:40.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.068+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Bo08RD1cCsNlOgge6RO74WpXxqsCpB0_0 2024-09-19T15:31:40.073 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.068+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15942023443068333919', time=2024-09-19T16:42:37.663253+0000, chain.objs.size()=1 2024-09-19T15:31:40.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.068+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.lB2yUd8eX12qLmyd1bj1NFzlJ9AcYPe_0 2024-09-19T15:31:40.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.068+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2154015567923761195', time=2024-09-19T16:42:38.629625+0000, chain.objs.size()=1 2024-09-19T15:31:40.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.068+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.eW33jA-SDa9fKIArwA9Gx85Dw1qE2I4_0 2024-09-19T15:31:40.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.068+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4819028507890089059', time=2024-09-19T16:42:39.892875+0000, chain.objs.size()=1 2024-09-19T15:31:40.074 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.068+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.4H_vEXgNj_aXPXzdqE9BufEjUeHZMLy_0 2024-09-19T15:31:40.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.072+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10258121404611347744', time=2024-09-19T16:42:40.033066+0000, chain.objs.size()=1 2024-09-19T15:31:40.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.072+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.AKgqJMaij-nS01CjvgpJXqXtbCzTOFn_0 2024-09-19T15:31:40.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.072+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5119835817754178454', time=2024-09-19T16:42:41.835424+0000, chain.objs.size()=1 2024-09-19T15:31:40.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.072+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.YSHGbEOEc-So3IjxZtsL0frKjULHNRI_0 2024-09-19T15:31:40.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.072+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11048448945223742204', time=2024-09-19T16:42:42.273048+0000, chain.objs.size()=1 2024-09-19T15:31:40.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.072+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.X2FJNYTwMTFMRQyz8YA0fc3-ZqqPJ-2_0 2024-09-19T15:31:40.077 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.072+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18409621569121805661', time=2024-09-19T16:42:42.382271+0000, chain.objs.size()=1 2024-09-19T15:31:40.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.072+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.SQ4wmZwGO1AGgxTfdC0w0rOf_qaazEW_0 2024-09-19T15:31:40.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.072+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12384773684971319961', time=2024-09-19T16:42:43.627360+0000, chain.objs.size()=1 2024-09-19T15:31:40.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.072+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ri1NM1KcYUnSdIJDZ0JG6Ve_s7RQiOH_0 2024-09-19T15:31:40.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.072+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1346641102141879914', time=2024-09-19T16:42:44.056054+0000, chain.objs.size()=1 2024-09-19T15:31:40.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.072+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.AcJ-Vuxts0-f0ouyXrYOa7tcaf4Ju7F_0 2024-09-19T15:31:40.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.072+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7963435524620559752', time=2024-09-19T16:42:44.191171+0000, chain.objs.size()=1 2024-09-19T15:31:40.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.072+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.TgQa4vqIdjdp0ovEYdVSo8KqpB90EQh_0 2024-09-19T15:31:40.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.072+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7411820741327533966', time=2024-09-19T16:42:44.220424+0000, chain.objs.size()=1 2024-09-19T15:31:40.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.072+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.uPKQgs9_aIYnickHo16Xaprfy77YNmj_0 2024-09-19T15:31:40.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.072+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2814886129000190927', time=2024-09-19T16:42:45.119526+0000, chain.objs.size()=1 2024-09-19T15:31:40.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.072+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.KCsXkxoIHwfEyCu6-WAtF9EUWGmqCId_0 2024-09-19T15:31:40.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.072+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.646363501872894501', time=2024-09-19T16:42:45.764446+0000, chain.objs.size()=1 2024-09-19T15:31:40.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.072+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.fmqfULwaY_cDDMAc_jAiGHnvXMkyH6P_0 2024-09-19T15:31:40.078 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.072+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4317326482036364385', time=2024-09-19T16:42:46.120856+0000, chain.objs.size()=1 2024-09-19T15:31:40.079 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.072+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.5U7dyasejXGKiYcX4v0ntmQuBkL6h9h_0 2024-09-19T15:31:40.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.076+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10662955983643121742', time=2024-09-19T16:42:46.122420+0000, chain.objs.size()=1 2024-09-19T15:31:40.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.076+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.dNWkb6mjlwQua7eGBjCulZaZCqGsqNg_0 2024-09-19T15:31:40.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.076+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8275495060396415498', time=2024-09-19T16:42:46.869340+0000, chain.objs.size()=1 2024-09-19T15:31:40.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.076+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.P2CqPg1iZKz_ptEPg5a2D3_vvw3s4qf_0 2024-09-19T15:31:40.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.076+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8985906895693767785', time=2024-09-19T16:42:47.120069+0000, chain.objs.size()=1 2024-09-19T15:31:40.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.076+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.rjrNXa_Tc-re2IkNmWPCzc5gsqHF2Pd_0 2024-09-19T15:31:40.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.076+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11610440347626264068', time=2024-09-19T16:42:47.958303+0000, chain.objs.size()=1 2024-09-19T15:31:40.082 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.076+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.IpA230NPs5Bc9yJbaj56RQk3H09SW1T_0 2024-09-19T15:31:40.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.076+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7100940561260522172', time=2024-09-19T16:42:48.127427+0000, chain.objs.size()=1 2024-09-19T15:31:40.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.076+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.y3d53ENm1yKD1Bomq1gTpCKkomla9fN_0 2024-09-19T15:31:40.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.076+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14803224641792053221', time=2024-09-19T16:42:49.926913+0000, chain.objs.size()=1 2024-09-19T15:31:40.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.076+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.mo1KTNNs2o4UkA5pw9Fy4B4wOirq6bs_0 2024-09-19T15:31:40.083 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.076+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2922950550842236363', time=2024-09-19T16:42:50.314002+0000, chain.objs.size()=1 2024-09-19T15:31:40.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.076+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.t8bFGgCHM21NLwS6suMfdH5PsWIvejH_0 2024-09-19T15:31:40.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.076+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13082062535844665006', time=2024-09-19T16:42:51.037557+0000, chain.objs.size()=1 2024-09-19T15:31:40.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.076+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.oFLukopvFGljmc8Ws-tY_NKJHaP6g5t_0 2024-09-19T15:31:40.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.076+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9551471290022722257', time=2024-09-19T16:42:53.740946+0000, chain.objs.size()=1 2024-09-19T15:31:40.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.076+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.3JjybDfSqlejCUvR_c6M9rQOge7zZQ6_0 2024-09-19T15:31:40.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.076+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15841055481571173452', time=2024-09-19T16:42:54.659008+0000, chain.objs.size()=1 2024-09-19T15:31:40.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.076+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.kut3sfuDxRXSRiPzqVZ8MutU7BW6Go5_0 2024-09-19T15:31:40.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.076+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2520418010691195599', time=2024-09-19T16:42:55.264009+0000, chain.objs.size()=1 2024-09-19T15:31:40.084 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.076+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.2V9z30-ag61cfq696pcBU7OKpPcGtUT_0 2024-09-19T15:31:40.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.080+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12151306167443699953', time=2024-09-19T16:42:56.011333+0000, chain.objs.size()=1 2024-09-19T15:31:40.086 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.080+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.FqczmIiu_gwn1y2lquHcPeLPdToKS3s_0 2024-09-19T15:31:40.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.080+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13945035025995467091', time=2024-09-19T16:42:56.577813+0000, chain.objs.size()=1 2024-09-19T15:31:40.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.080+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.eL2PnRiVtJ4XrWMYD6l5NanbKk0EXgg_0 2024-09-19T15:31:40.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.080+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1548235664906676521', time=2024-09-19T16:42:57.805360+0000, chain.objs.size()=1 2024-09-19T15:31:40.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.080+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.xHf2EzkNWKhM4rFfPJxMm0vsmr3WDpF_0 2024-09-19T15:31:40.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.080+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5582059438680293350', time=2024-09-19T16:42:58.647382+0000, chain.objs.size()=1 2024-09-19T15:31:40.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.080+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.RZ71dxZ1XuiU9MYQTTbubtScjsTiZaE_0 2024-09-19T15:31:40.087 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.080+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16070446991698736498', time=2024-09-19T16:42:58.873921+0000, chain.objs.size()=1 2024-09-19T15:31:40.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.080+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.en0UJLSh4UPtnyqF-_mLQvELoNb_PWa_0 2024-09-19T15:31:40.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.080+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16406396913813078845', time=2024-09-19T16:42:59.510052+0000, chain.objs.size()=1 2024-09-19T15:31:40.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.080+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.owIiShQOSmGM4v01ftQmH52yWCfrzZI_0 2024-09-19T15:31:40.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.080+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12472938736249507377', time=2024-09-19T16:43:22.226741+0000, chain.objs.size()=1 2024-09-19T15:31:40.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.080+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.272__shadow_.wE8MDL3s5om3s5MD97czj87dS4vi4TW_0 2024-09-19T15:31:40.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.084+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.640142401367710904', time=2024-09-19T16:44:12.673123+0000, chain.objs.size()=1 2024-09-19T15:31:40.088 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.084+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_._8kSl-2qmrz-1g5Nmqfio8fKO1UqbKT_0 2024-09-19T15:31:40.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.084+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2055080114672961579', time=2024-09-19T16:44:12.828960+0000, chain.objs.size()=1 2024-09-19T15:31:40.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.084+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_.yjtMsg2ZlXQ7LV9Xm0FYT8voz-_X1Pz_0 2024-09-19T15:31:40.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.084+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12316763591170904813', time=2024-09-19T16:44:44.808420+0000, chain.objs.size()=1 2024-09-19T15:31:40.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.084+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.304__shadow_.hQhlIy1eOnx7qLAaafO8KzqioX78xH6_0 2024-09-19T15:31:40.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.084+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13135705892416144849', time=2024-09-19T16:44:53.489116+0000, chain.objs.size()=1 2024-09-19T15:31:40.089 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.084+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.307__shadow:yvsuwKCDVX2KcgTOvGZiyoiqKUybLKh_.xqrNLfY4w36OXlKDl2RkKXg0TOltPfY_0 2024-09-19T15:31:40.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.084+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1980145416398930046', time=2024-09-19T16:47:18.285138+0000, chain.objs.size()=1 2024-09-19T15:31:40.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.084+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.i97OXca2Qi7RYcT7jkPt2C2T6iFq9hI_0 2024-09-19T15:31:40.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.084+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10778977330606611511', time=2024-09-19T16:47:19.114991+0000, chain.objs.size()=1 2024-09-19T15:31:40.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.084+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.AQiRygCjhQOMZXBWeLtrpVnEDFHva1m_0 2024-09-19T15:31:40.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.084+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2401058120868262204', time=2024-09-19T16:47:19.880588+0000, chain.objs.size()=1 2024-09-19T15:31:40.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.084+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.eptSwLnkJy4KdZlmzn4Ltl7aeJE7zos_0 2024-09-19T15:31:40.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.084+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17917229612720062363', time=2024-09-19T16:47:20.531907+0000, chain.objs.size()=1 2024-09-19T15:31:40.091 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.084+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.VaqN_FqdZ5QgdyL_8umx53iU6SCuSYr_0 2024-09-19T15:31:40.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.084+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14808087738173191443', time=2024-09-19T16:47:20.843359+0000, chain.objs.size()=1 2024-09-19T15:31:40.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.084+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.pAnZ-cgN8JyEPZZkZQquix0OhfzzZ2P_0 2024-09-19T15:31:40.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.088+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10003200756992031126', time=2024-09-19T16:47:21.210647+0000, chain.objs.size()=1 2024-09-19T15:31:40.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.088+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ZwTuj4yeIIFA19j4cS6KZOzNYiHnA4C_0 2024-09-19T15:31:40.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.088+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2280888518146975194', time=2024-09-19T16:47:22.400960+0000, chain.objs.size()=1 2024-09-19T15:31:40.092 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.088+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.g1SDvGRPJ8MnPMmjgIMIDxLAJRow_em_0 2024-09-19T15:31:40.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.088+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17034385121898692550', time=2024-09-19T16:47:22.492528+0000, chain.objs.size()=1 2024-09-19T15:31:40.093 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.088+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.aN8G3dmlCFIp9JGG7-0roh79tXK3NHo_0 2024-09-19T15:31:40.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.088+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8710294443400901176', time=2024-09-19T16:47:22.494105+0000, chain.objs.size()=1 2024-09-19T15:31:40.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.088+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.OZY6btniQYByWTcIey1h4uc32sJDHzW_0 2024-09-19T15:31:40.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.088+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13489081105657287634', time=2024-09-19T16:47:24.055221+0000, chain.objs.size()=1 2024-09-19T15:31:40.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.088+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.nh7KO0A2IVe33Xbv7UJHYMzF6tOFvAg_0 2024-09-19T15:31:40.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.088+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8628520808741324334', time=2024-09-19T16:47:29.630154+0000, chain.objs.size()=1 2024-09-19T15:31:40.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.088+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ZaV9Rl_h1Vx2wcORDH7qiJKgllv-V_Z_0 2024-09-19T15:31:40.094 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.088+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3781109852522427945', time=2024-09-19T16:47:29.981320+0000, chain.objs.size()=1 2024-09-19T15:31:40.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.088+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Y2cJJO61qRtY7vXPiHoCu-DEfJXVEii_0 2024-09-19T15:31:40.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.088+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14654560680198335339', time=2024-09-19T16:47:32.898445+0000, chain.objs.size()=1 2024-09-19T15:31:40.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.088+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.at2egb_aTbR9H2I7iGEEu7kUZkLEdlG_0 2024-09-19T15:31:40.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.088+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1723856765893458885', time=2024-09-19T16:47:34.057048+0000, chain.objs.size()=1 2024-09-19T15:31:40.095 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.088+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.nGYDEE4yrWH1Q772KxDKzKmj61TJKt3_0 2024-09-19T15:31:40.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16165961949177788296', time=2024-09-19T16:47:34.309769+0000, chain.objs.size()=1 2024-09-19T15:31:40.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.092+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ypdX34cY9tuD2_klhUnxqCiwAgA2z38_0 2024-09-19T15:31:40.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1354780410181813437', time=2024-09-19T16:47:36.213532+0000, chain.objs.size()=1 2024-09-19T15:31:40.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.092+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.m68hp5_vwejt4KWWpitCEKonePrtziy_0 2024-09-19T15:31:40.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8956758214908278731', time=2024-09-19T16:47:37.279389+0000, chain.objs.size()=1 2024-09-19T15:31:40.096 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.092+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.L6AvTev8cywy644avXZhf6JXKellQCC_0 2024-09-19T15:31:40.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3221048011489534212', time=2024-09-19T16:47:38.084797+0000, chain.objs.size()=1 2024-09-19T15:31:40.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.092+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.tmHahKXW2rRitYoPn5kBXFb5kmrVBsQ_0 2024-09-19T15:31:40.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15111750160627214663', time=2024-09-19T16:47:38.536969+0000, chain.objs.size()=1 2024-09-19T15:31:40.097 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.092+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.lD48vT7lJfMPT8uUXsVLta55OEchbHQ_0 2024-09-19T15:31:40.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10426272073081824748', time=2024-09-19T16:47:39.868214+0000, chain.objs.size()=1 2024-09-19T15:31:40.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.092+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.TSpqc2_IpT8bZOFmo7AaCfZw24C-md4_0 2024-09-19T15:31:40.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15149841808547213848', time=2024-09-19T16:47:40.211140+0000, chain.objs.size()=1 2024-09-19T15:31:40.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.092+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.3z03RCUR6MSnNrXxR6h525vpjtOVuys_0 2024-09-19T15:31:40.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.84887278386579590', time=2024-09-19T16:47:41.562010+0000, chain.objs.size()=1 2024-09-19T15:31:40.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.092+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.hvbRH_uRPjQjFzD6-ab48RcYV76Oksv_0 2024-09-19T15:31:40.098 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11703841803879353314', time=2024-09-19T16:47:43.452074+0000, chain.objs.size()=1 2024-09-19T15:31:40.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.092+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.OB3QqyDEcJvtM5Dg4qJgSI6B2SfiyfC_0 2024-09-19T15:31:40.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14910164097669227836', time=2024-09-19T16:47:43.785086+0000, chain.objs.size()=1 2024-09-19T15:31:40.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.092+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.I3JMm4iq9b_eRyaxy6jZPIgKbr3E9FO_0 2024-09-19T15:31:40.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.092+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18304286607470688567', time=2024-09-19T16:47:44.324739+0000, chain.objs.size()=1 2024-09-19T15:31:40.099 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.092+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.rrYxbqKX119rcaowLJr3ijOAY4rGIhb_0 2024-09-19T15:31:40.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.096+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17422344970937336691', time=2024-09-19T16:47:45.026210+0000, chain.objs.size()=1 2024-09-19T15:31:40.100 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.096+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.F7jxSfReo9ZfLo_mhUB8xY4C7mfUSMe_0 2024-09-19T15:31:40.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.096+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2907335838822465591', time=2024-09-19T16:47:46.335646+0000, chain.objs.size()=1 2024-09-19T15:31:40.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.096+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Mp520IoAk44ZP-zgD72F3Ki4imlWrZC_0 2024-09-19T15:31:40.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.096+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10920110474118786126', time=2024-09-19T16:47:47.469820+0000, chain.objs.size()=1 2024-09-19T15:31:40.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.096+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.GLQJKpEmkcZGo7wZ4QLaf9BmKLO_GVW_0 2024-09-19T15:31:40.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.096+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7740171037298318473', time=2024-09-19T16:47:47.669381+0000, chain.objs.size()=1 2024-09-19T15:31:40.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.096+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.DXMgseotQlPJPtLvP2VJiOQrL8QYTKb_0 2024-09-19T15:31:40.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.096+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4227080749781637616', time=2024-09-19T16:47:47.746406+0000, chain.objs.size()=1 2024-09-19T15:31:40.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.096+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.gg-gHtUxd7Edl8KD7cFS5du2e4KXGrw_0 2024-09-19T15:31:40.101 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.096+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2003294906491062611', time=2024-09-19T16:47:48.347178+0000, chain.objs.size()=1 2024-09-19T15:31:40.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.096+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.q2oxO0BOB7wDJd0sP7nsY8GGVp5Pv-2_0 2024-09-19T15:31:40.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.096+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2967698651296770376', time=2024-09-19T16:47:49.537587+0000, chain.objs.size()=1 2024-09-19T15:31:40.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.096+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.eUaaxzetyZ6uL5VVDZpys8s_jWGyO-2_0 2024-09-19T15:31:40.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.096+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15005532889824930289', time=2024-09-19T16:49:36.745616+0000, chain.objs.size()=1 2024-09-19T15:31:40.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.096+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.VR_XjpipsgwG5242RtpsY6iiSyCx7-J_0 2024-09-19T15:31:40.102 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.096+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10711248791295605093', time=2024-09-19T16:49:39.268814+0000, chain.objs.size()=1 2024-09-19T15:31:40.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.096+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Xg11rZrJxjQqBEWOVcIqkosZE-F6mbr_0 2024-09-19T15:31:40.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.096+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3754137710691181999', time=2024-09-19T16:49:39.542283+0000, chain.objs.size()=1 2024-09-19T15:31:40.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.096+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.UUAbS77qxhqTxJATIAlCVT8zlOQBIta_0 2024-09-19T15:31:40.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.096+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16421356483574601583', time=2024-09-19T16:49:40.145472+0000, chain.objs.size()=1 2024-09-19T15:31:40.103 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.096+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.qKMLKu-90NQUMQy3CMqBzjrCyNJP5AQ_0 2024-09-19T15:31:40.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.100+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17201021080989585122', time=2024-09-19T16:49:41.706084+0000, chain.objs.size()=1 2024-09-19T15:31:40.104 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.100+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.jxZ_YxNJYqwyafCe0ZflwghisSbtMtv_0 2024-09-19T15:31:40.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.100+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13429103327129219837', time=2024-09-19T16:49:42.388678+0000, chain.objs.size()=1 2024-09-19T15:31:40.105 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.100+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.cMCfjlBvZfCmpT_EIZ5_f2OtSRkT2l8_0 2024-09-19T15:31:40.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.100+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8073745059401330298', time=2024-09-19T16:49:42.530636+0000, chain.objs.size()=1 2024-09-19T15:31:40.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.100+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.9U5MSUxeVXL3-yRArdkvVAvA3xVMAFU_0 2024-09-19T15:31:40.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.100+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13676662834972802430', time=2024-09-19T16:49:44.599540+0000, chain.objs.size()=1 2024-09-19T15:31:40.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.100+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.zUabruKwNwVIZd8iK62iCjFcjY4L_u8_0 2024-09-19T15:31:40.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.100+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15092899266357109316', time=2024-09-19T16:49:45.201960+0000, chain.objs.size()=1 2024-09-19T15:31:40.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.100+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.fpdwjLNh547eO5I4sD7ir6pOxI2_xFx_0 2024-09-19T15:31:40.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.100+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16785691789650870511', time=2024-09-19T16:49:46.862057+0000, chain.objs.size()=1 2024-09-19T15:31:40.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.100+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.FnIboyoDB7wSMnPtvjWQIPm9kGsZCJx_0 2024-09-19T15:31:40.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.100+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6730844387648702948', time=2024-09-19T16:49:48.775058+0000, chain.objs.size()=1 2024-09-19T15:31:40.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.100+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ecYYmhatFOI_P3-s6aOM3AX1zLuPcNk_0 2024-09-19T15:31:40.106 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.100+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10151231631157153284', time=2024-09-19T16:49:50.064965+0000, chain.objs.size()=1 2024-09-19T15:31:40.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.100+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.X_P62xGTghbE1OF9xZAssSfQgrrN_4K_0 2024-09-19T15:31:40.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.100+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16838624742334945271', time=2024-09-19T16:49:50.813648+0000, chain.objs.size()=1 2024-09-19T15:31:40.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.100+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.nRb9AO6fO9w5yf20_ltDhiFL-rTD4pw_0 2024-09-19T15:31:40.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.100+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7873052803311919307', time=2024-09-19T16:49:52.068536+0000, chain.objs.size()=1 2024-09-19T15:31:40.107 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.100+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.f-eb0RvY0jujuNUXtpCr3ZXzPJVVMrr_0 2024-09-19T15:31:40.108 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.104+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9695900872500475786', time=2024-09-19T16:49:53.093922+0000, chain.objs.size()=1 2024-09-19T15:31:40.108 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.104+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.cGBqteKYU3iHoMlYfEoOctAjaf_IxCx_0 2024-09-19T15:31:40.108 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.104+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4148820554713414432', time=2024-09-19T16:49:53.875207+0000, chain.objs.size()=1 2024-09-19T15:31:40.108 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.104+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.QUaGyzjlKMyskYhF_jq21fq4jibo5zb_0 2024-09-19T15:31:40.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.104+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1665347007937660459', time=2024-09-19T16:49:56.063181+0000, chain.objs.size()=1 2024-09-19T15:31:40.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.104+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.kHhpk9WvIfHOcbo0a1ewNOm2d4NkIlr_0 2024-09-19T15:31:40.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.104+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12469962268408957716', time=2024-09-19T16:49:57.936181+0000, chain.objs.size()=1 2024-09-19T15:31:40.109 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.104+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.W8sCXqv6lD-mKJkO_CulbruUbyuYofh_0 2024-09-19T15:31:40.112 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43041 2024-09-19T15:31:40.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-19T15:31:40.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16497216097408804722', time=2024-09-19T16:49:58.582308+0000, chain.objs.size()=1 2024-09-19T15:31:40.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.QQaUxMVG6BOz4rWaTsyOH-9A2SkzQDw_0 2024-09-19T15:31:40.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11407786197400387772', time=2024-09-19T16:49:58.802106+0000, chain.objs.size()=1 2024-09-19T15:31:40.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.fxkgQIfDA5pu1HCzfHhFcz4I2NUZiHX_0 2024-09-19T15:31:40.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13369545795112333675', time=2024-09-19T16:49:59.073547+0000, chain.objs.size()=1 2024-09-19T15:31:40.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.9Bh3Yl-_LwBWQLbLb8crgFz-nn1kb63_0 2024-09-19T15:31:40.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8015502371044368311', time=2024-09-19T16:49:59.291388+0000, chain.objs.size()=1 2024-09-19T15:31:40.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ta9p31ULzvvt07p7Sx1msf8RlI_olcC_0 2024-09-19T15:31:40.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8780902624052015585', time=2024-09-19T16:50:00.328492+0000, chain.objs.size()=1 2024-09-19T15:31:40.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.uGphCGePwWyKWM6GlJpunShX_uxDWZd_0 2024-09-19T15:31:40.115 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4843551092591967036', time=2024-09-19T16:50:00.428643+0000, chain.objs.size()=1 2024-09-19T15:31:40.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.h2BRCYfkTBJ0dYoXDGgITfSNrF-2F5__0 2024-09-19T15:31:40.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16059215175631275459', time=2024-09-19T16:50:01.334606+0000, chain.objs.size()=1 2024-09-19T15:31:40.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.VWRWLx0M288oBjh_iwVMeKyKTnPduDu_0 2024-09-19T15:31:40.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10958660244015456507', time=2024-09-19T16:50:02.335841+0000, chain.objs.size()=1 2024-09-19T15:31:40.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.yAcNX4uksrKPDQ4t_10DWI2M-2rExjU_0 2024-09-19T15:31:40.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13472663357318071624', time=2024-09-19T16:50:02.338089+0000, chain.objs.size()=1 2024-09-19T15:31:40.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.btKAQMTsKLdw8CHxKF0fMOXPoomiTw7_0 2024-09-19T15:31:40.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5734626729310126111', time=2024-09-19T16:50:02.697998+0000, chain.objs.size()=1 2024-09-19T15:31:40.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.WresJkcXLYFT91wBqHOg2vEPGdbftJw_0 2024-09-19T15:31:40.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13965015209148871954', time=2024-09-19T16:50:03.009093+0000, chain.objs.size()=1 2024-09-19T15:31:40.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.6hjZ9NfcNsI_k-x0vnkH8NZgHjz31IV_0 2024-09-19T15:31:40.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5774233108084731064', time=2024-09-19T16:50:03.195243+0000, chain.objs.size()=1 2024-09-19T15:31:40.116 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.108+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.VfaHIHP19Syk9Ac65Sodvnvcw5Na8rD_0 2024-09-19T15:31:40.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.112+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4618942839073683772', time=2024-09-19T16:50:03.908258+0000, chain.objs.size()=1 2024-09-19T15:31:40.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.112+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.vrDTMf0X_Gc22wJMvJpYnXk5P6jzfiX_0 2024-09-19T15:31:40.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.112+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14444485339641574585', time=2024-09-19T16:50:04.812452+0000, chain.objs.size()=1 2024-09-19T15:31:40.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.112+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.bOmYiAlnivWw6G3m9m6YfBgr1DUV0gc_0 2024-09-19T15:31:40.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.112+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7956507780501264275', time=2024-09-19T16:50:05.085667+0000, chain.objs.size()=1 2024-09-19T15:31:40.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.112+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.6ordcfG3Qk88NUeDCgM4Akom-ZuLIg7_0 2024-09-19T15:31:40.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.112+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5280597723150611300', time=2024-09-19T16:50:05.652461+0000, chain.objs.size()=1 2024-09-19T15:31:40.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.112+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.oO_un9iq-G_TN44nzN3PxAZLbd5PF7F_0 2024-09-19T15:31:40.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.112+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5169256750344715795', time=2024-09-19T16:50:15.968105+0000, chain.objs.size()=1 2024-09-19T15:31:40.120 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.112+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.329__shadow_.fuHPQ6iKSDTpCESzAu6UN2ichI7Bn74_0 2024-09-19T15:31:40.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.112+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14912748519974544658', time=2024-09-19T16:50:45.539380+0000, chain.objs.size()=1 2024-09-19T15:31:40.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.112+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.343__shadow_.mfATF6yJz2mtccmZb8KmdGlai8vj6rE_0 2024-09-19T15:31:40.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.112+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12447112011029962977', time=2024-09-19T16:54:07.882355+0000, chain.objs.size()=1 2024-09-19T15:31:40.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.112+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.444__shadow_.r9zfRW0AGZsvh9_Mx6bFYQ0mIesVmO__0 2024-09-19T15:31:40.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.112+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5985920128404081883', time=2024-09-19T16:54:42.618210+0000, chain.objs.size()=1 2024-09-19T15:31:40.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.112+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.458__shadow_.ax_REvuB8cqQNGAD1Nq6uXoKBFd7Yuk_0 2024-09-19T15:31:40.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.112+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8850534368459607271', time=2024-09-19T16:54:59.732333+0000, chain.objs.size()=1 2024-09-19T15:31:40.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.112+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.464__shadow_.c41mxcv6OOwxX1p-QqbJi6pkuFIY4aU_0 2024-09-19T15:31:40.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.112+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10378507346528269974', time=2024-09-19T16:55:06.517424+0000, chain.objs.size()=1 2024-09-19T15:31:40.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.112+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.466__shadow_.jCCZJ8Ql571fZOnVFVmQly73_ij-cdn_0 2024-09-19T15:31:40.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.112+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13731333819903603610', time=2024-09-19T17:07:45.869699+0000, chain.objs.size()=1 2024-09-19T15:31:40.121 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.112+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:R41iXA9CZv5cYiyO5sLvPJM5mATxOHT_.NY4_zU6nfr_fBNZC61P6R101w9HEyHt_0 2024-09-19T15:31:40.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.116+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13488368545679427739', time=2024-09-19T17:08:54.906995+0000, chain.objs.size()=1 2024-09-19T15:31:40.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.116+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:0R-dJqFDTXbKdoqcR3DGocDVD-WLUTC_.DyRcClvnNa2c5hBLtX16Og-mG2WEw9m_0 2024-09-19T15:31:40.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.116+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14976405467146425482', time=2024-09-19T17:11:24.983948+0000, chain.objs.size()=1 2024-09-19T15:31:40.123 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.116+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.602__shadow_.06pYOshyk7Xzgir5MmLr7IcCxAYqKMU_0 2024-09-19T15:31:40.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.116+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16593225589882191978', time=2024-09-19T17:20:33.683988+0000, chain.objs.size()=6 2024-09-19T15:31:40.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.116+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.661__multipart_baz.2~tx9TwTU0ckYaIN3214SWh8iOvWi3IDm.1 2024-09-19T15:31:40.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.120+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.661__multipart_baz.2~tx9TwTU0ckYaIN3214SWh8iOvWi3IDm.2 2024-09-19T15:31:40.124 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.120+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.661__multipart_baz.2~tx9TwTU0ckYaIN3214SWh8iOvWi3IDm.3 2024-09-19T15:31:40.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.120+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.661__multipart_baz.2~tx9TwTU0ckYaIN3214SWh8iOvWi3IDm.4 2024-09-19T15:31:40.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.120+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.661__multipart_baz.2~tx9TwTU0ckYaIN3214SWh8iOvWi3IDm.5 2024-09-19T15:31:40.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.120+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.661__multipart_baz.2~tx9TwTU0ckYaIN3214SWh8iOvWi3IDm.6 2024-09-19T15:31:40.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.120+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16817701209477497056', time=2024-09-19T17:20:40.630964+0000, chain.objs.size()=1 2024-09-19T15:31:40.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.120+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.664__shadow_.2w81Rs7a0yansj_hLllRfgIXv4pV0Vd_0 2024-09-19T15:31:40.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.120+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10006943515271757936', time=2024-09-19T17:21:10.355330+0000, chain.objs.size()=1 2024-09-19T15:31:40.125 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.120+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.679__shadow_.T8fX2fEjol3VtCkmCd769_XG7Wlrw32_0 2024-09-19T15:31:40.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.120+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11272972585076660009', time=2024-09-19T17:22:17.707252+0000, chain.objs.size()=1 2024-09-19T15:31:40.126 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.120+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.713__shadow:ewhkXWBNrvNDequezdN4VCzdM.S5Rk9_.2TSi8gonF8Of-42cqQmvdgekEEovZ0i_0 2024-09-19T15:31:40.127 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.124+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6476380380230728150', time=2024-09-19T17:22:46.443694+0000, chain.objs.size()=1 2024-09-19T15:31:40.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.124+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.718__shadow_.DjTZAp6P9nlmxDVfPecGfzItO_11ZkK_0 2024-09-19T15:31:40.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.124+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13522868277899019287', time=2024-09-19T17:25:07.168767+0000, chain.objs.size()=1 2024-09-19T15:31:40.128 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.124+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.747__shadow_.pibPbq1rGb6Nvz1gUBeLTrB9gqvAmAa_0 2024-09-19T15:31:40.130 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.124+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:40.132 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T15:31:40.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:40.134 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:40.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48547' 2024-09-19T15:31:40.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8889061611076508876', time=2024-09-19T16:39:22.042382+0000, chain.objs.size()=1 2024-09-19T15:31:40.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.228__shadow_.SdPp4ewLBrYDHOqbNlcFOsnpeb6kusA_0 2024-09-19T15:31:40.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16841966807095131817', time=2024-09-19T16:39:34.036478+0000, chain.objs.size()=1 2024-09-19T15:31:40.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.234__shadow_.jLdBpL8Sq4ARGvY3RyUu8_yPvkxP4UP_0 2024-09-19T15:31:40.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2017786035536254294', time=2024-09-19T16:39:46.341347+0000, chain.objs.size()=1 2024-09-19T15:31:40.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.238__shadow_.QMG4dvsMQnwNSZ1ORmwIvDVpX2wGRG4_0 2024-09-19T15:31:40.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4526342772007158700', time=2024-09-19T16:40:07.379139+0000, chain.objs.size()=1 2024-09-19T15:31:40.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.246__shadow_.58tcA0TU-JmiDxCSxzMjtgB6_cwcHUv_0 2024-09-19T15:31:40.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15477363111360577706', time=2024-09-19T16:40:09.726702+0000, chain.objs.size()=1 2024-09-19T15:31:40.136 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.247__shadow_.c8qY7z0N87NC1M-5EVH2Tg9DTbl9yKX_0 2024-09-19T15:31:40.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2504565916118833854', time=2024-09-19T16:40:28.163335+0000, chain.objs.size()=1 2024-09-19T15:31:40.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.255__shadow_.wKNBwPDCXT36iZ7xDIXKFrwoIr9K51l_0 2024-09-19T15:31:40.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15417077005454953628', time=2024-09-19T16:40:39.514650+0000, chain.objs.size()=1 2024-09-19T15:31:40.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.260__shadow_.-mwFD9sJjP4rjho8xc56_LrMJxDHOQ5_0 2024-09-19T15:31:40.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4756987687954219657', time=2024-09-19T16:42:29.423248+0000, chain.objs.size()=1 2024-09-19T15:31:40.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.W0NnxUo52JQsuNcAd4jpozh5qAWdwqq_0 2024-09-19T15:31:40.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1678936642062620954', time=2024-09-19T16:42:29.537374+0000, chain.objs.size()=1 2024-09-19T15:31:40.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.MXiYlWylsJDdvJTjbtZgXtCqoo_Ak0u_0 2024-09-19T15:31:40.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7803210623187437698', time=2024-09-19T16:42:29.791341+0000, chain.objs.size()=1 2024-09-19T15:31:40.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.o_31wbi4S1NeGSQIxF6Ut9LPvrdUwG6_0 2024-09-19T15:31:40.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2825773000659871582', time=2024-09-19T16:42:29.954325+0000, chain.objs.size()=1 2024-09-19T15:31:40.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.oRITvhLOkxqXj3TSFtxDxiExJ7IE1U9_0 2024-09-19T15:31:40.137 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16574914510653490400', time=2024-09-19T16:42:30.080883+0000, chain.objs.size()=1 2024-09-19T15:31:40.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.128+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ErZx88zJAFeCNTHfZjx5m67Z9sV6Zpf_0 2024-09-19T15:31:40.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.132+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11077451252378354778', time=2024-09-19T16:42:30.818904+0000, chain.objs.size()=1 2024-09-19T15:31:40.138 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.132+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.hpfFSk_RZIy2uNAK3L6HqKMjVH6v_Tt_0 2024-09-19T15:31:40.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.132+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5257347446567218539', time=2024-09-19T16:42:31.442151+0000, chain.objs.size()=1 2024-09-19T15:31:40.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.132+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.OrqLXIbIUuURlttpWS9Vqh_EDLtXw48_0 2024-09-19T15:31:40.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.132+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4953728618372374413', time=2024-09-19T16:42:32.662369+0000, chain.objs.size()=1 2024-09-19T15:31:40.139 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.132+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Y4qLnJ29Lu_mgT5NG9-61FRGRbII0Rq_0 2024-09-19T15:31:40.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.132+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15937599873457444366', time=2024-09-19T16:42:33.287398+0000, chain.objs.size()=1 2024-09-19T15:31:40.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.132+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.CBjCxkbap-jOvlu_f1ZciGvtiQ3avWv_0 2024-09-19T15:31:40.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.132+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1277500967833023506', time=2024-09-19T16:42:33.603397+0000, chain.objs.size()=1 2024-09-19T15:31:40.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.132+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.1hGSQUxIcwXh6hLM929xkQseFz92ORT_0 2024-09-19T15:31:40.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.132+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1356134319022494941', time=2024-09-19T16:42:35.617365+0000, chain.objs.size()=1 2024-09-19T15:31:40.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.132+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.zYAj9pc6RwQNgAnG7zu4IZmAs8Exeg9_0 2024-09-19T15:31:40.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.132+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14072944424362379704', time=2024-09-19T16:42:36.802999+0000, chain.objs.size()=1 2024-09-19T15:31:40.140 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.132+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.E7WJuKlRdEynj63nF2W858o0k4J9dYF_0 2024-09-19T15:31:40.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.132+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1816198233102900537', time=2024-09-19T16:42:36.897836+0000, chain.objs.size()=1 2024-09-19T15:31:40.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.132+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.4baZd0Gtg7AXWVL0zmHWCkeWBE2f53R_0 2024-09-19T15:31:40.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.132+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18185726025906414002', time=2024-09-19T16:42:37.295453+0000, chain.objs.size()=1 2024-09-19T15:31:40.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.132+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.UIXPiYxW57U8b1Yiv-SwfZOmTQG3BSL_0 2024-09-19T15:31:40.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.132+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6519249095663701571', time=2024-09-19T16:42:37.314842+0000, chain.objs.size()=1 2024-09-19T15:31:40.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.132+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.LvJ0rCAYN3X7HfArIINXPBf2NY9hX6e_0 2024-09-19T15:31:40.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.136+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7093191720342988533', time=2024-09-19T16:42:42.002472+0000, chain.objs.size()=1 2024-09-19T15:31:40.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.136+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Xa2agqxHcDGbJeIL8ZoynTG4f7EmL5l_0 2024-09-19T15:31:40.141 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.136+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16798861213772173878', time=2024-09-19T16:42:42.454307+0000, chain.objs.size()=1 2024-09-19T15:31:40.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.136+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.NI7LX5jwmP4a_GkDWqcW1L1jWMGsx92_0 2024-09-19T15:31:40.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.136+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14677984431868338246', time=2024-09-19T16:42:42.580016+0000, chain.objs.size()=1 2024-09-19T15:31:40.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.136+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.7h7lFn8hBzh_0_dUHc3s-N8WgPJIS0v_0 2024-09-19T15:31:40.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.136+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1997131702598108700', time=2024-09-19T16:42:43.486370+0000, chain.objs.size()=1 2024-09-19T15:31:40.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.136+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.jx_N7L_uCfgVTOb_UeqZTRpJzCdtEPe_0 2024-09-19T15:31:40.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.136+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7627676719309048946', time=2024-09-19T16:42:44.239311+0000, chain.objs.size()=1 2024-09-19T15:31:40.142 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.136+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.asNoxLUj3_e_3HdnR1pSBsbXDiO6oLH_0 2024-09-19T15:31:40.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.140+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1829253515427609695', time=2024-09-19T16:42:45.681314+0000, chain.objs.size()=1 2024-09-19T15:31:40.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.140+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.YqntFGK9tUcqwDdPEM3DE-UZE_HdfId_0 2024-09-19T15:31:40.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.140+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9735783832153440321', time=2024-09-19T16:42:46.061998+0000, chain.objs.size()=1 2024-09-19T15:31:40.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.140+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.0otlwWjDpVnSGx7e_tdXrQmvLVpDATC_0 2024-09-19T15:31:40.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.140+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5013157169364552942', time=2024-09-19T16:42:49.696441+0000, chain.objs.size()=1 2024-09-19T15:31:40.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.140+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.HeoAnp4gs76h3zC_6OLMQnaKbXys8n1_0 2024-09-19T15:31:40.145 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.140+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.481809121413730636', time=2024-09-19T16:42:50.152685+0000, chain.objs.size()=1 2024-09-19T15:31:40.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.140+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.QkMKPXnJm7xTqfi3p93S4x8_0jE7xkx_0 2024-09-19T15:31:40.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.140+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5681814339449000030', time=2024-09-19T16:42:50.679217+0000, chain.objs.size()=1 2024-09-19T15:31:40.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.140+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ERS3WHkYiYtL7vrv8XhywJAihkrdhgy_0 2024-09-19T15:31:40.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.140+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13710532091124365908', time=2024-09-19T16:42:52.447942+0000, chain.objs.size()=1 2024-09-19T15:31:40.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.140+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.vOmFVQOy0dc1IZKnaeTE33fssBPeiT__0 2024-09-19T15:31:40.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.140+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4206246806348087655', time=2024-09-19T16:42:52.532382+0000, chain.objs.size()=1 2024-09-19T15:31:40.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.140+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.22aaxUnvNmt6n6lbvLNek-_R35JZQgr_0 2024-09-19T15:31:40.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.140+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9613899516892846018', time=2024-09-19T16:42:53.811368+0000, chain.objs.size()=1 2024-09-19T15:31:40.146 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.140+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.NO-SHBkpsTtjOGR3y91x2tgpV9nKw3g_0 2024-09-19T15:31:40.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.140+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1563714341362734749', time=2024-09-19T16:42:54.597741+0000, chain.objs.size()=1 2024-09-19T15:31:40.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.140+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.4rVDY0OlvrxJyF21m-GE_LBfoH0RbAM_0 2024-09-19T15:31:40.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.140+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4226158733347077560', time=2024-09-19T16:42:55.811984+0000, chain.objs.size()=1 2024-09-19T15:31:40.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.140+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.mJII6cne0NZwqz7PHga83kDXbdcHTN4_0 2024-09-19T15:31:40.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.140+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5208294696486880301', time=2024-09-19T16:42:56.143672+0000, chain.objs.size()=1 2024-09-19T15:31:40.147 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.140+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.WSLav-QUaHGuWjO9FXc2k5TwfbSFNTS_0 2024-09-19T15:31:40.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.144+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15831718497496031434', time=2024-09-19T16:42:56.288955+0000, chain.objs.size()=1 2024-09-19T15:31:40.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.144+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.7uJxOSA1BolHDTKDbfXh9lWE8UtNw1r_0 2024-09-19T15:31:40.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.144+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13118832865390857415', time=2024-09-19T16:42:58.692387+0000, chain.objs.size()=1 2024-09-19T15:31:40.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.144+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.FkDNFWTE7fmgSbWEVtBByBuzloA_Ayu_0 2024-09-19T15:31:40.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.144+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2040192393834094862', time=2024-09-19T16:42:58.962062+0000, chain.objs.size()=1 2024-09-19T15:31:40.149 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.144+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.W5TvirOIKrrceNUZsdIDpcRXtI0vT5o_0 2024-09-19T15:31:40.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.144+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9203705199787620334', time=2024-09-19T16:43:49.802732+0000, chain.objs.size()=1 2024-09-19T15:31:40.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.144+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.284__shadow_.8WTOiKtIecdZ2mSHZCDEENKwoJY7i59_0 2024-09-19T15:31:40.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.144+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4028214199792464029', time=2024-09-19T16:43:59.409786+0000, chain.objs.size()=1 2024-09-19T15:31:40.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.144+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.288__shadow_.ETIurQITZpEHBK-UFnWl40-EPW8FIkF_0 2024-09-19T15:31:40.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.144+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1211090012392536097', time=2024-09-19T16:44:23.303331+0000, chain.objs.size()=1 2024-09-19T15:31:40.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.144+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.295__shadow_.kQFgN_6-kv700apSmZzUP-1p8oC6yHv_0 2024-09-19T15:31:40.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.144+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16386495891821372468', time=2024-09-19T16:44:53.461909+0000, chain.objs.size()=1 2024-09-19T15:31:40.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.144+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.307__shadow:6z855-OAxADPqwRtmydsNdlcsfAvtwE_.Kt7cDIaJ_blHcSydIOJNr46vK3J3njl_0 2024-09-19T15:31:40.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.144+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9843399288960746153', time=2024-09-19T16:47:18.720771+0000, chain.objs.size()=1 2024-09-19T15:31:40.150 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.144+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.IL-lbE01dXQZkzDjil3RhO8LJUXQHc6_0 2024-09-19T15:31:40.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.144+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15250793537088450088', time=2024-09-19T16:47:18.724359+0000, chain.objs.size()=1 2024-09-19T15:31:40.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.144+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.y6bRPLApTEJJ_3GfL2XJnHj0qSpkE0j_0 2024-09-19T15:31:40.151 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.144+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8784442544471455186', time=2024-09-19T16:47:18.921226+0000, chain.objs.size()=1 2024-09-19T15:31:40.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.144+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.RI3vJ04tMfOxIkSSjfmO5qVdF3E5pZl_0 2024-09-19T15:31:40.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.144+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5158609138153022035', time=2024-09-19T16:47:19.663039+0000, chain.objs.size()=1 2024-09-19T15:31:40.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.144+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.y_Q3RtA4t9xbtdPIC-QKRhZMapjAG6f_0 2024-09-19T15:31:40.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.148+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3390903209052187189', time=2024-09-19T16:47:19.868713+0000, chain.objs.size()=1 2024-09-19T15:31:40.152 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.148+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.SvyANXWAF7tbaQdDe81WV2wxUqFKHxK_0 2024-09-19T15:31:40.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.148+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16256200837348571354', time=2024-09-19T16:47:20.103791+0000, chain.objs.size()=1 2024-09-19T15:31:40.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.148+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.2sNEOe71II3UbK7NFC-8wi-6ZC1TA4I_0 2024-09-19T15:31:40.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.148+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4772759448829635578', time=2024-09-19T16:47:23.008417+0000, chain.objs.size()=1 2024-09-19T15:31:40.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.148+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.vn_1c16RgKv5d6znP-Az_1SmLoi80Ik_0 2024-09-19T15:31:40.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.148+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15677504765513792703', time=2024-09-19T16:47:23.212158+0000, chain.objs.size()=1 2024-09-19T15:31:40.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.148+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.BXrCgzXrptmhVDznncKqMEv9IfF2-Ik_0 2024-09-19T15:31:40.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.148+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13685446479048687685', time=2024-09-19T16:47:23.327885+0000, chain.objs.size()=1 2024-09-19T15:31:40.153 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.148+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.5kKUlGbJWrWgbQgtj6C6UTerQkl9L2X_0 2024-09-19T15:31:40.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.148+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5588491898327561660', time=2024-09-19T16:47:24.215795+0000, chain.objs.size()=1 2024-09-19T15:31:40.154 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.148+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.fRNotPyGewROO4hsqU2Ee0_SKGSaqso_0 2024-09-19T15:31:40.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.148+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7857611055273650867', time=2024-09-19T16:47:25.660512+0000, chain.objs.size()=1 2024-09-19T15:31:40.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.148+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.BUAEPsUUf2ZtQw8HLAWfVb_bDulZ9HQ_0 2024-09-19T15:31:40.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.148+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13925744519055094955', time=2024-09-19T16:47:27.092976+0000, chain.objs.size()=1 2024-09-19T15:31:40.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.148+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.3UnhnoOqBqD6gWXT-ZzWyKcVI_-t0Cf_0 2024-09-19T15:31:40.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.148+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8775924964964211172', time=2024-09-19T16:47:28.588122+0000, chain.objs.size()=1 2024-09-19T15:31:40.155 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.148+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.qaOmb6YuayFRhGT9rm2QYoRF9326Ojk_0 2024-09-19T15:31:40.156 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.152+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4601626035374751181', time=2024-09-19T16:47:28.839137+0000, chain.objs.size()=1 2024-09-19T15:31:40.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.152+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.zmLbolBDA724EExQR9W6mFHuiSCAs5j_0 2024-09-19T15:31:40.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.152+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15283668210617646187', time=2024-09-19T16:47:28.944313+0000, chain.objs.size()=1 2024-09-19T15:31:40.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.152+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Lf2TDR_rjPYxWiSRBEqK3yqTyTvezzt_0 2024-09-19T15:31:40.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.152+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4309205668270332098', time=2024-09-19T16:47:29.566930+0000, chain.objs.size()=1 2024-09-19T15:31:40.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.152+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.xjIqbNXAX2z9lGwjDudE7RZdKHQw08a_0 2024-09-19T15:31:40.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.152+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3382654698466718163', time=2024-09-19T16:47:29.859606+0000, chain.objs.size()=1 2024-09-19T15:31:40.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.152+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.OoghaZQM4-hpN3FxQSEiR9nSAe7ug_D_0 2024-09-19T15:31:40.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.152+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13287769467487188771', time=2024-09-19T16:47:29.967331+0000, chain.objs.size()=1 2024-09-19T15:31:40.157 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.152+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.vdaqkl69VBX0QkpslsgbJixnpu-r-nA_0 2024-09-19T15:31:40.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.152+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15529822059154630882', time=2024-09-19T16:47:31.019273+0000, chain.objs.size()=1 2024-09-19T15:31:40.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.152+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.6npvGDSJq15zF565BD7KMMTasfb8phr_0 2024-09-19T15:31:40.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.152+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11118505368583433711', time=2024-09-19T16:47:33.414684+0000, chain.objs.size()=1 2024-09-19T15:31:40.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.152+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.QPe3M5z_o1z6T8gNc5gKf1FPDcEnVRm_0 2024-09-19T15:31:40.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.152+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4520066364775325347', time=2024-09-19T16:47:33.969253+0000, chain.objs.size()=1 2024-09-19T15:31:40.158 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.152+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.SIN0_tPc1z0nhIjFd4IcPiKRclhlgEH_0 2024-09-19T15:31:40.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.152+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5795120161351984168', time=2024-09-19T16:47:34.334927+0000, chain.objs.size()=1 2024-09-19T15:31:40.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.152+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.k1xB66iDSad8Coe9D9Lf2MBQXHO94Gc_0 2024-09-19T15:31:40.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.152+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7197924342477012763', time=2024-09-19T16:47:35.686052+0000, chain.objs.size()=1 2024-09-19T15:31:40.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.152+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.gyioAdkbBfBh4NC2YovP7fiuHSoJHyx_0 2024-09-19T15:31:40.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.152+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4490453546864396244', time=2024-09-19T16:47:37.155396+0000, chain.objs.size()=1 2024-09-19T15:31:40.159 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.152+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.2pcl_48FllBaQvcsVR-NxruAtZCdgEz_0 2024-09-19T15:31:40.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.156+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15350291663375475205', time=2024-09-19T16:47:37.380439+0000, chain.objs.size()=1 2024-09-19T15:31:40.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.156+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.QiwipsgBHIWeu5ViUtJpfLCwOPsXhyw_0 2024-09-19T15:31:40.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.156+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14638632248427370803', time=2024-09-19T16:47:37.494315+0000, chain.objs.size()=1 2024-09-19T15:31:40.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.156+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.tkJLVPUemjuI1j5qhCX0cBQzrmf1J44_0 2024-09-19T15:31:40.161 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.156+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7695341649656637504', time=2024-09-19T16:47:37.590512+0000, chain.objs.size()=1 2024-09-19T15:31:40.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.156+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.oZQ34EVK0VNGtVWyPOAdRDEPd74pdZF_0 2024-09-19T15:31:40.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.156+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6078061016923696076', time=2024-09-19T16:47:44.388736+0000, chain.objs.size()=1 2024-09-19T15:31:40.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.156+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.y9SyvYOywplX5JuDBYq3ZxnQVsafFkt_0 2024-09-19T15:31:40.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.156+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10235731148271903770', time=2024-09-19T16:47:44.522425+0000, chain.objs.size()=1 2024-09-19T15:31:40.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.156+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.DI2egq1V6h0DsqpjxmunyI7nAVM_wIM_0 2024-09-19T15:31:40.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.156+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7258502869224337751', time=2024-09-19T16:47:44.941209+0000, chain.objs.size()=1 2024-09-19T15:31:40.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.156+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.hQV51EgqtD4hm3QEHCpRKf-_bDS2ffr_0 2024-09-19T15:31:40.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.156+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3419793397355649086', time=2024-09-19T16:47:45.518125+0000, chain.objs.size()=1 2024-09-19T15:31:40.162 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.156+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.768FfzKFdKTCQTAi1x1LQM4vwghGKyp_0 2024-09-19T15:31:40.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.156+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12218614030743434136', time=2024-09-19T16:47:45.608483+0000, chain.objs.size()=1 2024-09-19T15:31:40.163 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.156+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_._-ySRBBxa5PDScThcaZeBUoZ2tKGDei_0 2024-09-19T15:31:40.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2253540675406460998', time=2024-09-19T16:47:46.695316+0000, chain.objs.size()=1 2024-09-19T15:31:40.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Uf5jkvhTVuwvmNN33UWuH0lTorFZ0F6_0 2024-09-19T15:31:40.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7227625366821548388', time=2024-09-19T16:47:47.338324+0000, chain.objs.size()=1 2024-09-19T15:31:40.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Xg1b7OxfD5WNn_705H4LRn9D7B70d0V_0 2024-09-19T15:31:40.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5003130047363780802', time=2024-09-19T16:47:48.298028+0000, chain.objs.size()=1 2024-09-19T15:31:40.164 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.WRi9vk2ciffXnohhDyaJLBaG4ZKRIHP_0 2024-09-19T15:31:40.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7380373120504465357', time=2024-09-19T16:49:34.902563+0000, chain.objs.size()=1 2024-09-19T15:31:40.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.drX6ybwI4yg-Bmoyd67aYBJ-ICLNT5T_0 2024-09-19T15:31:40.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6296761784460467310', time=2024-09-19T16:49:34.955200+0000, chain.objs.size()=1 2024-09-19T15:31:40.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.CF1XTFtCyQkj9qszcRWrNQYnDkbtn8B_0 2024-09-19T15:31:40.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2234610766004671163', time=2024-09-19T16:49:35.472994+0000, chain.objs.size()=1 2024-09-19T15:31:40.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.fRmZUwTWS5muAccnVWMcgTu9ASpl9XQ_0 2024-09-19T15:31:40.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4253204407741334679', time=2024-09-19T16:49:35.933733+0000, chain.objs.size()=1 2024-09-19T15:31:40.166 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.m_WezcVAr6lLFDGcVWaABPrb_JR3uGd_0 2024-09-19T15:31:40.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9587855763130004179', time=2024-09-19T16:49:37.504146+0000, chain.objs.size()=1 2024-09-19T15:31:40.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.o-R-dEqPnZFGu-irayTV7yieC9FzqaX_0 2024-09-19T15:31:40.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7296809623674712134', time=2024-09-19T16:49:37.625758+0000, chain.objs.size()=1 2024-09-19T15:31:40.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.TdEdnUpGiVEGaLcTphxixXRkjGe0x3s_0 2024-09-19T15:31:40.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11046482375978790718', time=2024-09-19T16:49:39.711404+0000, chain.objs.size()=1 2024-09-19T15:31:40.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.3HDK6UQOvGqvOvMbnpCDh2Z6gdRUurH_0 2024-09-19T15:31:40.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17324915725111861692', time=2024-09-19T16:49:39.953441+0000, chain.objs.size()=1 2024-09-19T15:31:40.167 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.yCtNxKLGugFofMN2HsYAE6PzgLSqz_y_0 2024-09-19T15:31:40.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5013937036301593957', time=2024-09-19T16:49:41.078656+0000, chain.objs.size()=1 2024-09-19T15:31:40.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.lq5v285PSOtilx-lO3QO_ATwO3m2nkA_0 2024-09-19T15:31:40.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12839356138505114185', time=2024-09-19T16:49:42.150269+0000, chain.objs.size()=1 2024-09-19T15:31:40.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.160+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.w-OFCnrhqTzTk4dYnqISSZ-vq8NUXA2_0 2024-09-19T15:31:40.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.164+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14665058985273517015', time=2024-09-19T16:49:43.574317+0000, chain.objs.size()=1 2024-09-19T15:31:40.168 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.164+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.LvdvTQ61Gbw3VWAOWqgQYZ_zzayTLpl_0 2024-09-19T15:31:40.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.164+0000 7f91ec459640 0 -- 172.21.15.153:0/159143849 >> [v2:172.21.15.196:6826/138851534,v1:172.21.15.196:6827/138851534] conn(0x55f89a4184d0 msgr2=0x7f90b808df70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-19T15:31:40.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.164+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7714778429295381635', time=2024-09-19T16:49:44.226008+0000, chain.objs.size()=1 2024-09-19T15:31:40.169 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.164+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.501qA598bnX9C3Jq4VQEpSGToaEMMfX_0 2024-09-19T15:31:40.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.164+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2710244116352796932', time=2024-09-19T16:49:45.688415+0000, chain.objs.size()=1 2024-09-19T15:31:40.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.164+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.E2UJoaDs_RUG7KbDNcLYGTYw48KWUl4_0 2024-09-19T15:31:40.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.164+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4037620234597171809', time=2024-09-19T16:49:46.217882+0000, chain.objs.size()=1 2024-09-19T15:31:40.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.164+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Zj83W2Gi8n4Omimm2wS1QwG6rvfkouG_0 2024-09-19T15:31:40.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.164+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5720790285105585973', time=2024-09-19T16:49:46.556898+0000, chain.objs.size()=1 2024-09-19T15:31:40.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.164+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.kXZpA2ZHO3oax1_0UmbQ2zarp_BnFKC_0 2024-09-19T15:31:40.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.164+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6753492258142488802', time=2024-09-19T16:49:46.821534+0000, chain.objs.size()=1 2024-09-19T15:31:40.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.164+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.xW7mz78w3ImQT6dSxC2lwtlOenJ9Igo_0 2024-09-19T15:31:40.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.164+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6283288600695071193', time=2024-09-19T16:49:48.839694+0000, chain.objs.size()=1 2024-09-19T15:31:40.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.164+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.tV3SqYcZkjGF3feu_iY0Kg-bZC5zhMx_0 2024-09-19T15:31:40.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.164+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17511169246872133294', time=2024-09-19T16:49:49.012352+0000, chain.objs.size()=1 2024-09-19T15:31:40.171 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.164+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.sxWYLSyONCGbIJcXbMC5LZf4DNBacRu_0 2024-09-19T15:31:40.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.164+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11309642744464222233', time=2024-09-19T16:49:49.847222+0000, chain.objs.size()=1 2024-09-19T15:31:40.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.164+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.NOVy76xLKboRQR2fin7R6mxjR355FqM_0 2024-09-19T15:31:40.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.164+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10088226244212748084', time=2024-09-19T16:49:50.481761+0000, chain.objs.size()=1 2024-09-19T15:31:40.172 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.164+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.jLom-wOHEm_AtdQqmoXnZB5Qt4VXyqm_0 2024-09-19T15:31:40.177 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.168+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48547 2024-09-19T15:31:40.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-19T15:31:40.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9236043103431071825', time=2024-09-19T16:49:52.063885+0000, chain.objs.size()=1 2024-09-19T15:31:40.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.8IAOrmyG2JX2Dp6Pxqw-saOLkCE5mja_0 2024-09-19T15:31:40.178 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8530430431278837884', time=2024-09-19T16:49:52.355567+0000, chain.objs.size()=1 2024-09-19T15:31:40.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.YbXTf3PU_CltPIG8zEcueuMeXuVl7gF_0 2024-09-19T15:31:40.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11970663660637385113', time=2024-09-19T16:49:54.056701+0000, chain.objs.size()=1 2024-09-19T15:31:40.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.1Ia9QydeeBzywVQERIYnC9mUQLDoh_f_0 2024-09-19T15:31:40.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17679911845925024277', time=2024-09-19T16:49:55.215178+0000, chain.objs.size()=1 2024-09-19T15:31:40.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.0WazutEFC3GDyYYTECHUCBW1I1AkNBC_0 2024-09-19T15:31:40.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8490885554769706398', time=2024-09-19T16:49:58.401029+0000, chain.objs.size()=1 2024-09-19T15:31:40.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.diXKNE_Q-8WHmCR0KIKvxREj6Vhwl4R_0 2024-09-19T15:31:40.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4444296565852568027', time=2024-09-19T16:49:58.687541+0000, chain.objs.size()=1 2024-09-19T15:31:40.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.kz6nPE9DRZiqCgiJpWDkg1GWGNd9rCQ_0 2024-09-19T15:31:40.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.482757799066414687', time=2024-09-19T16:50:00.426599+0000, chain.objs.size()=1 2024-09-19T15:31:40.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.jxv7RlrSJK70RQ-8tkFXWn63d7qhA_y_0 2024-09-19T15:31:40.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2672018294751994760', time=2024-09-19T16:50:00.618069+0000, chain.objs.size()=1 2024-09-19T15:31:40.179 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.jZaw7CnkUK-7S5SgPFMdGtO9FahwP9m_0 2024-09-19T15:31:40.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13962796875540795754', time=2024-09-19T16:50:01.503307+0000, chain.objs.size()=1 2024-09-19T15:31:40.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.AkO9ZBDJwt4X6hW_DDIknwHO_K4ohRj_0 2024-09-19T15:31:40.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3233448989081205618', time=2024-09-19T16:50:02.363539+0000, chain.objs.size()=1 2024-09-19T15:31:40.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.cCEIB6blW9mUMN3hG5qiScopDR_jeYj_0 2024-09-19T15:31:40.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16890153287705186232', time=2024-09-19T16:50:05.626275+0000, chain.objs.size()=1 2024-09-19T15:31:40.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.uLlA34cEkJYqpXz73wOxcr7huKrsZZI_0 2024-09-19T15:31:40.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4352409133926452318', time=2024-09-19T16:50:05.971504+0000, chain.objs.size()=1 2024-09-19T15:31:40.180 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.172+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.4Tojm19_BEG2kZvVs1xF5P65EYXYEcl_0 2024-09-19T15:31:40.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.176+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18278837204523271238', time=2024-09-19T16:50:06.132879+0000, chain.objs.size()=1 2024-09-19T15:31:40.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.176+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.E_CDWwxUPjfn-PFSGkAmWKszJ1dT584_0 2024-09-19T15:31:40.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.176+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17339948919778931888', time=2024-09-19T16:56:23.368020+0000, chain.objs.size()=1 2024-09-19T15:31:40.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.176+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.503__shadow:vjdbIfRxBe4w.PbHfN6JGIQynOLNKTv_.1FlZE6YVJFffVLJR2xeEpNz8BJZrUMj_0 2024-09-19T15:31:40.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.176+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13194900939241533717', time=2024-09-19T16:57:12.264160+0000, chain.objs.size()=1 2024-09-19T15:31:40.181 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.176+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.511__multipart_mymultipart.2~I582NU0qIht5hl5Ad8mvyZAwV9vGM3x.1 2024-09-19T15:31:40.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.176+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~DvLZlPzeitX03VWP4SfemqOWR5pbGd-', time=2024-09-19T17:00:48.297652+0000, chain.objs.size()=1 2024-09-19T15:31:40.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.176+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.522__multipart_mymultipart.2~DvLZlPzeitX03VWP4SfemqOWR5pbGd-.3 2024-09-19T15:31:40.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.176+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11344698629908663974', time=2024-09-19T17:06:09.686563+0000, chain.objs.size()=2 2024-09-19T15:31:40.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.176+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.552__shadow_.pKzViSzJQHutMH44O_huIbKGE0MTo7N_0 2024-09-19T15:31:40.182 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.176+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.552__shadow_.pKzViSzJQHutMH44O_huIbKGE0MTo7N_1 2024-09-19T15:31:40.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.176+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1498951485145003026', time=2024-09-19T17:06:42.104293+0000, chain.objs.size()=1 2024-09-19T15:31:40.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.176+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.556__shadow_.02atBpQ_J_mwNeakXSo1FMQ7DVoDIxQ_0 2024-09-19T15:31:40.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.176+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13093091368021791226', time=2024-09-19T17:09:18.733412+0000, chain.objs.size()=1 2024-09-19T15:31:40.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.176+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:K8hFTwp9S2FDCQ5HXzwjJzjtexme3ue_.m4WQqHZ7yixMFP8-OCis2eFdirkkrPW_0 2024-09-19T15:31:40.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.176+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6625898849434748774', time=2024-09-19T17:09:20.172496+0000, chain.objs.size()=1 2024-09-19T15:31:40.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.176+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:UiBzX3Ha1N1ak1fqvsnM2h163UeklMV_.inIEP7N_kQsbDeZz_r2ed_MvgDxGMH7_0 2024-09-19T15:31:40.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.176+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7270864027862592825', time=2024-09-19T17:18:51.975560+0000, chain.objs.size()=1 2024-09-19T15:31:40.183 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.176+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.645__shadow_.BuAK7vhyKy_FDEEF89R9ZgqwwTDFBFc_0 2024-09-19T15:31:40.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.176+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.483692502933634261', time=2024-09-19T17:19:12.876530+0000, chain.objs.size()=1 2024-09-19T15:31:40.184 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.176+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.649__shadow_.pidC2RNXwsbf01zS7gcvvUDTALXCZ3e_0 2024-09-19T15:31:40.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.180+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11562089074273947792', time=2024-09-19T17:21:59.027010+0000, chain.objs.size()=1 2024-09-19T15:31:40.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.180+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.704__shadow:Oj409mG6wL89Hbzh2zYadC3PbSDzH9T_.lo8SUx9paR7YAlKA2HIO4q_hPTXI2xI_0 2024-09-19T15:31:40.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.180+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9502314437710424391', time=2024-09-19T17:24:41.749064+0000, chain.objs.size()=1 2024-09-19T15:31:40.185 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.180+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.745__shadow_.5_CWr68otWk8ds3_zChd5CPBhwnEVVW_0 2024-09-19T15:31:40.188 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.184+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:40.191 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.184+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T15:31:40.192 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:40.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:40.193 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53527' 2024-09-19T15:31:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5521899730356348752', time=2024-09-19T16:39:36.292216+0000, chain.objs.size()=1 2024-09-19T15:31:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.235__shadow_.9v2eh_sq6aRf0HbIECwlIdcpLGvokwZ_0 2024-09-19T15:31:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2958808392413395483', time=2024-09-19T16:39:38.654657+0000, chain.objs.size()=1 2024-09-19T15:31:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.236__shadow_.cQQpwg1aEfubeB8k1c-QSlT_FF4eBwF_0 2024-09-19T15:31:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5202757860493587871', time=2024-09-19T16:40:16.688724+0000, chain.objs.size()=1 2024-09-19T15:31:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.250__shadow_.ybzwVXOq8Yc2hr98RmJpy-9bLR-EYTw_0 2024-09-19T15:31:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16566452005942864024', time=2024-09-19T16:40:19.118408+0000, chain.objs.size()=1 2024-09-19T15:31:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.251__shadow_.wui4yrn4IZuleBsLd8aABmErOjG27pE_0 2024-09-19T15:31:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2746366710369803704', time=2024-09-19T16:40:35.059987+0000, chain.objs.size()=1 2024-09-19T15:31:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.258__shadow_.KAr97ZLm3Hru0jdGgRuPl3ERyK_CUBg_0 2024-09-19T15:31:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14429085521549634164', time=2024-09-19T16:42:28.124795+0000, chain.objs.size()=1 2024-09-19T15:31:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.JTNwLf3EQe8Y1zII1RE79s1vDaszXf9_0 2024-09-19T15:31:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13631912372267770117', time=2024-09-19T16:42:28.733267+0000, chain.objs.size()=1 2024-09-19T15:31:40.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ZhV8zCOWvY-qRG6v2fbYR0foBpfOAme_0 2024-09-19T15:31:40.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13385401853970531658', time=2024-09-19T16:42:28.811027+0000, chain.objs.size()=1 2024-09-19T15:31:40.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.I52erPyXYj-gBVBN4DhYAeVk_7JNZli_0 2024-09-19T15:31:40.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2160942547532878598', time=2024-09-19T16:42:30.491737+0000, chain.objs.size()=1 2024-09-19T15:31:40.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.HutyKLK3C5VxN0D11ohSlFFOcLb0B8M_0 2024-09-19T15:31:40.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14192440998294162449', time=2024-09-19T16:42:31.240397+0000, chain.objs.size()=1 2024-09-19T15:31:40.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.uC1F4GtQ3WdD-ZFAePwY0AKct1Vr9In_0 2024-09-19T15:31:40.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16469918828303958676', time=2024-09-19T16:42:31.431851+0000, chain.objs.size()=1 2024-09-19T15:31:40.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.8mvIdl8QKbrrNd1wcnxxdC0bR0Fy20p_0 2024-09-19T15:31:40.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10135718298338767736', time=2024-09-19T16:42:33.050469+0000, chain.objs.size()=1 2024-09-19T15:31:40.195 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.188+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.6i76FGpYiNCF4tMzrwo0vq_Cbl0BrI0_0 2024-09-19T15:31:40.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.192+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16715288852060550671', time=2024-09-19T16:42:34.416093+0000, chain.objs.size()=1 2024-09-19T15:31:40.196 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.192+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.MlIeiBkdzFhx0YBThAizgci-_UVnlF6_0 2024-09-19T15:31:40.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.192+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7260656659706299036', time=2024-09-19T16:42:35.584459+0000, chain.objs.size()=1 2024-09-19T15:31:40.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.192+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.MA5oTgiJDHF68dBw2-gSGgtrvrQW1yK_0 2024-09-19T15:31:40.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.192+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15143450228718568846', time=2024-09-19T16:42:38.988150+0000, chain.objs.size()=1 2024-09-19T15:31:40.197 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.192+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.tcj7XmBoIKwoYjkb5bnPkqeohoRnDrz_0 2024-09-19T15:31:40.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.192+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15902239438088743171', time=2024-09-19T16:42:39.174680+0000, chain.objs.size()=1 2024-09-19T15:31:40.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.192+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.57tOUJPz1gcmc-CG6ef4vJniXWIboai_0 2024-09-19T15:31:40.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.192+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18119173485761060303', time=2024-09-19T16:42:41.093146+0000, chain.objs.size()=1 2024-09-19T15:31:40.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.192+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.r7C-nPMzVtONsTgzUz9ciF_mVASPzMt_0 2024-09-19T15:31:40.198 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.192+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.744957715154178352', time=2024-09-19T16:42:41.094936+0000, chain.objs.size()=1 2024-09-19T15:31:40.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.192+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.zy4MCK61cprVht8nCF9F8JAltATsW-R_0 2024-09-19T15:31:40.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.192+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13550978695902926942', time=2024-09-19T16:42:41.112291+0000, chain.objs.size()=1 2024-09-19T15:31:40.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.192+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.SBRke1sulS9fY-c0FSX1c8cHj-xAeAo_0 2024-09-19T15:31:40.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.192+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12390059703649187450', time=2024-09-19T16:42:41.579712+0000, chain.objs.size()=1 2024-09-19T15:31:40.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.192+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.mC4GKr5lomTB1llPJbwbTi-pAm4IX7N_0 2024-09-19T15:31:40.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.192+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16980892120423945855', time=2024-09-19T16:42:41.582026+0000, chain.objs.size()=1 2024-09-19T15:31:40.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.192+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.XxLi9wdnGu6QgNdAa4qMINgtFUJk9aV_0 2024-09-19T15:31:40.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.192+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6654918497655519323', time=2024-09-19T16:42:42.422071+0000, chain.objs.size()=1 2024-09-19T15:31:40.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.192+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.iWW_xdtrr4PGrJsu90Eq9P_eyzEDUjp_0 2024-09-19T15:31:40.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.192+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8896777775627149667', time=2024-09-19T16:42:42.724062+0000, chain.objs.size()=1 2024-09-19T15:31:40.199 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.192+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.2rA0pygtud29OGibQA5QgDDZYj_dsgE_0 2024-09-19T15:31:40.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.192+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15374487780763453604', time=2024-09-19T16:42:42.965526+0000, chain.objs.size()=1 2024-09-19T15:31:40.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.192+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.IQDZH_TRg2uRVK7NlQyqWupanh1paid_0 2024-09-19T15:31:40.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.196+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12777398532064298080', time=2024-09-19T16:42:47.290511+0000, chain.objs.size()=1 2024-09-19T15:31:40.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.196+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.YFxAahAzWcHKds_maXT6GFKunmZ1ct9_0 2024-09-19T15:31:40.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.196+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2136277817628516098', time=2024-09-19T16:42:51.882202+0000, chain.objs.size()=1 2024-09-19T15:31:40.200 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.196+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.HYvlDn6zMEYsV2mX8PHJ_v4bYTRFf2o_0 2024-09-19T15:31:40.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.196+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7282613597699303964', time=2024-09-19T16:42:52.235945+0000, chain.objs.size()=1 2024-09-19T15:31:40.201 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.196+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.0i1Ovklt0S-0nkaWB7kgDZ_hne3Plnq_0 2024-09-19T15:31:40.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.196+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13731167068640928613', time=2024-09-19T16:42:52.237877+0000, chain.objs.size()=1 2024-09-19T15:31:40.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.196+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.pL4SUdlW4IIrNg6s16UMgQ0x3qSS6-v_0 2024-09-19T15:31:40.202 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.196+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2862979429565572866', time=2024-09-19T16:42:52.239793+0000, chain.objs.size()=1 2024-09-19T15:31:40.203 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.196+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.K9j86FHnn9b_dLGdASHMwj74Ykg66fU_0 2024-09-19T15:31:40.203 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.196+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4135574943718523178', time=2024-09-19T16:42:53.372370+0000, chain.objs.size()=1 2024-09-19T15:31:40.203 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.196+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.uEVx-0pmJngZqCpHtNTTN_tzZ9zf-Ok_0 2024-09-19T15:31:40.203 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.196+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15725821610138846483', time=2024-09-19T16:42:54.151935+0000, chain.objs.size()=1 2024-09-19T15:31:40.203 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.196+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.fVjBzVb4lX7a7CG1RbqgsC79frVv_uX_0 2024-09-19T15:31:40.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.200+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1982418874196134303', time=2024-09-19T16:42:56.361508+0000, chain.objs.size()=1 2024-09-19T15:31:40.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.200+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ongpU9X_0il0JxoDwifz6JWafBdBvt1_0 2024-09-19T15:31:40.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.200+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3902263347608810494', time=2024-09-19T16:42:58.254176+0000, chain.objs.size()=1 2024-09-19T15:31:40.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.200+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_._yCumE41mhyFnNo_6IA_PlpP5el_ldR_0 2024-09-19T15:31:40.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.200+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16183817760457937521', time=2024-09-19T16:42:58.406541+0000, chain.objs.size()=1 2024-09-19T15:31:40.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.200+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.X7v53AD-m15q5QhTyuMABlJXWypm5au_0 2024-09-19T15:31:40.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.200+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9739893331970562271', time=2024-09-19T16:42:58.729323+0000, chain.objs.size()=1 2024-09-19T15:31:40.204 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.200+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.7Nwc4QGHov3a716QGNo-Jx3dzSi1NdP_0 2024-09-19T15:31:40.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.200+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14698194891495335105', time=2024-09-19T16:42:59.206905+0000, chain.objs.size()=1 2024-09-19T15:31:40.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.200+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.WAEPypTX2PNqHca1akVjmljxEEWBHVg_0 2024-09-19T15:31:40.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.200+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5894332025828607579', time=2024-09-19T16:43:47.517702+0000, chain.objs.size()=1 2024-09-19T15:31:40.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.200+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.283__shadow_.F7dUIQLxtHP2iJ2fIZwGdRppQ0DVPfQ_0 2024-09-19T15:31:40.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.200+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6376524742363271693', time=2024-09-19T16:43:57.136142+0000, chain.objs.size()=1 2024-09-19T15:31:40.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.200+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.287__shadow_.pLH3yb35sz0zJC2R53RdbRRh4DSFgHz_0 2024-09-19T15:31:40.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.200+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15589725626509527552', time=2024-09-19T16:44:12.723483+0000, chain.objs.size()=1 2024-09-19T15:31:40.205 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.200+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_.nblP2B_EPBN4hyS7q4ou417to4wTCti_0 2024-09-19T15:31:40.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.200+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7002703492337092198', time=2024-09-19T16:44:12.901353+0000, chain.objs.size()=1 2024-09-19T15:31:40.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.200+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_.KcAGM9J4GLkgVPE6mTKzOVFN-b9glO2_0 2024-09-19T15:31:40.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.200+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.81482379910621911', time=2024-09-19T16:47:19.687766+0000, chain.objs.size()=1 2024-09-19T15:31:40.207 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.200+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.fViFoSEss_UFlbJmwPWtg3bit1UQFPh_0 2024-09-19T15:31:40.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.204+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6755390019325425715', time=2024-09-19T16:47:20.298789+0000, chain.objs.size()=1 2024-09-19T15:31:40.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.204+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.vhntVlbAP0y0vxbrME2uXu1QAcFtMvQ_0 2024-09-19T15:31:40.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.204+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2983053251619155623', time=2024-09-19T16:47:21.227522+0000, chain.objs.size()=1 2024-09-19T15:31:40.208 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.204+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.2LDOWuxdTV8bC7U2wW1L-xk9gi1g0Ld_0 2024-09-19T15:31:40.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.204+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14728233502911115942', time=2024-09-19T16:47:21.282180+0000, chain.objs.size()=1 2024-09-19T15:31:40.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.204+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.tHm7Hh2mvCeIkYzZvSX7VkzAxlctGyx_0 2024-09-19T15:31:40.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.204+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14385611943286535604', time=2024-09-19T16:47:22.469698+0000, chain.objs.size()=1 2024-09-19T15:31:40.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.204+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.m2yQncr6wOzVyw0Cco43GJTJYoC-rMm_0 2024-09-19T15:31:40.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.204+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1528295315739174355', time=2024-09-19T16:47:22.471932+0000, chain.objs.size()=1 2024-09-19T15:31:40.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.204+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.snN7s5ZVi78O0rEMpnsyHS4PWnTxd7c_0 2024-09-19T15:31:40.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.204+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16993597617874870373', time=2024-09-19T16:47:22.474130+0000, chain.objs.size()=1 2024-09-19T15:31:40.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.204+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.SCLty25K3kbahPdhGrMeH7x6fvhstD9_0 2024-09-19T15:31:40.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.204+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4468221299313299910', time=2024-09-19T16:47:27.220382+0000, chain.objs.size()=1 2024-09-19T15:31:40.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.204+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_._VgOtsYjLBxEbrLncleVBSqzb52Hpjg_0 2024-09-19T15:31:40.210 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.204+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.797388876439886967', time=2024-09-19T16:47:27.958710+0000, chain.objs.size()=1 2024-09-19T15:31:40.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.204+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.D4Kh5nFcePX-eAL6w3kqND5vubLBpEi_0 2024-09-19T15:31:40.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.204+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7021094791445232397', time=2024-09-19T16:47:31.580530+0000, chain.objs.size()=1 2024-09-19T15:31:40.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.204+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Lo528zuMRX5r6zeq6Kq_JUtp_eNoRwD_0 2024-09-19T15:31:40.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.204+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2607644393816327203', time=2024-09-19T16:47:32.010627+0000, chain.objs.size()=1 2024-09-19T15:31:40.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.204+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.tKfrV45dQHXo2bSgKr2NBZj4pDmMNxa_0 2024-09-19T15:31:40.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.204+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2099148211256519983', time=2024-09-19T16:47:32.012586+0000, chain.objs.size()=1 2024-09-19T15:31:40.211 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.204+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.4h2oqz8rj8UeyQsvfHKDxlqPQSWqaBG_0 2024-09-19T15:31:40.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15802687671535403020', time=2024-09-19T16:47:32.340139+0000, chain.objs.size()=1 2024-09-19T15:31:40.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.fjxgMV4h6A6kjReP3k17SHOaJWB3S07_0 2024-09-19T15:31:40.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14327359709290076838', time=2024-09-19T16:47:35.380739+0000, chain.objs.size()=1 2024-09-19T15:31:40.212 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.bFsV2xz3xdBrPtVHpDMQMYFk2Dxzv04_0 2024-09-19T15:31:40.214 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15590514631061012888', time=2024-09-19T16:47:36.016318+0000, chain.objs.size()=1 2024-09-19T15:31:40.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.uYRjr84hC0HgTKt6N93NONVwVZmrkGE_0 2024-09-19T15:31:40.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2884681517237318925', time=2024-09-19T16:47:36.230896+0000, chain.objs.size()=1 2024-09-19T15:31:40.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.nU2L8G-E9oZqSrI_kw8qvi22xmUC6D7_0 2024-09-19T15:31:40.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.742065611868941602', time=2024-09-19T16:47:38.472120+0000, chain.objs.size()=1 2024-09-19T15:31:40.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.R3WNGPocZmH6ji37k8bMnTyc7HWUT5z_0 2024-09-19T15:31:40.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8786963327748347806', time=2024-09-19T16:47:39.481369+0000, chain.objs.size()=1 2024-09-19T15:31:40.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.KG5aN-3pFKnyWN2Qh3uXmrhmJif10Ma_0 2024-09-19T15:31:40.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.582468955250876951', time=2024-09-19T16:47:40.351967+0000, chain.objs.size()=1 2024-09-19T15:31:40.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.wMumzHL0sbF62ocCNb2WBujWvmzSUin_0 2024-09-19T15:31:40.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17516225188793950916', time=2024-09-19T16:47:41.027297+0000, chain.objs.size()=1 2024-09-19T15:31:40.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.0I_mb134IEIUn2zxP1rJo3mhlG_1Mod_0 2024-09-19T15:31:40.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14492800251516220665', time=2024-09-19T16:47:41.536450+0000, chain.objs.size()=1 2024-09-19T15:31:40.215 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.nJtytptndnQ64-XlLLoAcxOBxVjtIHo_0 2024-09-19T15:31:40.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17133301413002950047', time=2024-09-19T16:47:41.538446+0000, chain.objs.size()=1 2024-09-19T15:31:40.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.K1r3v2kDEe7w3dvz2i539wdiv1I2G6y_0 2024-09-19T15:31:40.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4988269380735620979', time=2024-09-19T16:47:45.546786+0000, chain.objs.size()=1 2024-09-19T15:31:40.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.GlqCtq4A-29ve0F5tYsRrONwnMNyZrw_0 2024-09-19T15:31:40.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17656229423530439808', time=2024-09-19T16:47:45.654246+0000, chain.objs.size()=1 2024-09-19T15:31:40.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.grW3aw2SYYmGqea6X--ndq74A3CmxFa_0 2024-09-19T15:31:40.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16062630983409534378', time=2024-09-19T16:47:46.101661+0000, chain.objs.size()=1 2024-09-19T15:31:40.216 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.208+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.sphvlcpehcEGbreFVJ7VYEqR0oH2vbS_0 2024-09-19T15:31:40.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.212+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16870961540015646660', time=2024-09-19T16:47:47.550873+0000, chain.objs.size()=1 2024-09-19T15:31:40.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.212+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.V7lVSxqQR1D6PNi4hlX0TI2YBd9rfIa_0 2024-09-19T15:31:40.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.212+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7558755821173955661', time=2024-09-19T16:47:49.540731+0000, chain.objs.size()=1 2024-09-19T15:31:40.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.212+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.f5QKo4RaypG4EYrMQxaMedhqcf3uQeT_0 2024-09-19T15:31:40.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.212+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17755267591727889608', time=2024-09-19T16:47:49.645617+0000, chain.objs.size()=1 2024-09-19T15:31:40.218 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.212+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Y2v2vVfwQyH0udMQ_Kfq8fmL-7JXhUX_0 2024-09-19T15:31:40.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.212+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2109459159802163321', time=2024-09-19T16:47:50.003071+0000, chain.objs.size()=1 2024-09-19T15:31:40.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.212+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.SMBZTT5yvvQ9Zo-xdfkohMWVPSbCX7v_0 2024-09-19T15:31:40.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.212+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.610318368197227439', time=2024-09-19T16:49:34.991382+0000, chain.objs.size()=1 2024-09-19T15:31:40.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.212+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.HQjVxHkCzbjdr5KRuR-rPc6vb2_URFO_0 2024-09-19T15:31:40.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.212+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9650721642002464334', time=2024-09-19T16:49:35.557126+0000, chain.objs.size()=1 2024-09-19T15:31:40.219 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.212+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.d19deGngpgtq-xEdhvggXHZt7QRiYWt_0 2024-09-19T15:31:40.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.216+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13677501783942323187', time=2024-09-19T16:49:35.830604+0000, chain.objs.size()=1 2024-09-19T15:31:40.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.216+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.rVsSW10MnPD8fPPA1ARqIVt3flUXsxy_0 2024-09-19T15:31:40.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.216+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16590706110138074329', time=2024-09-19T16:49:36.089842+0000, chain.objs.size()=1 2024-09-19T15:31:40.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.216+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.vG--NEH8xoJNpCrYQk6IF1bHqu92c07_0 2024-09-19T15:31:40.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.216+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8222942129392520424', time=2024-09-19T16:49:36.414082+0000, chain.objs.size()=1 2024-09-19T15:31:40.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.216+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.K5vlVjcBuxSRhkr_znm9fmIih1fKquL_0 2024-09-19T15:31:40.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.216+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6013730989422283309', time=2024-09-19T16:49:37.274185+0000, chain.objs.size()=1 2024-09-19T15:31:40.220 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.216+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.w-ybUs6TfixmJU-ihEPylrrWITJEf_j_0 2024-09-19T15:31:40.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.216+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9792867606858353657', time=2024-09-19T16:49:37.791050+0000, chain.objs.size()=1 2024-09-19T15:31:40.221 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.216+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Mez2qN1PRKBCYAApTdkv_asaaLYqubT_0 2024-09-19T15:31:40.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.216+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9665543404512417609', time=2024-09-19T16:49:38.139649+0000, chain.objs.size()=1 2024-09-19T15:31:40.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.216+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.yCNQLUI_ZkA1N8nGX95XHRhXUfNOOcp_0 2024-09-19T15:31:40.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.216+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.123523178083918442', time=2024-09-19T16:49:39.503598+0000, chain.objs.size()=1 2024-09-19T15:31:40.222 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.216+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.bvc5p6BZanlLm9JQ0btQB8RCLlSF51O_0 2024-09-19T15:31:40.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.220+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14512360987028612409', time=2024-09-19T16:49:39.781365+0000, chain.objs.size()=1 2024-09-19T15:31:40.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.220+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.-SR5PZSutLYCaJMm-ybMXNSYY3IKepb_0 2024-09-19T15:31:40.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.220+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12180800357429605336', time=2024-09-19T16:49:41.079545+0000, chain.objs.size()=1 2024-09-19T15:31:40.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.220+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Mi1A_s5IxgpKELiSjpmkFatiakIxuUU_0 2024-09-19T15:31:40.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.220+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2488739172789336580', time=2024-09-19T16:49:42.167495+0000, chain.objs.size()=1 2024-09-19T15:31:40.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.220+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Nu6kCjebDHYV8Rvf6OaIYodgHJvU0eQ_0 2024-09-19T15:31:40.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.220+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2821144351198205082', time=2024-09-19T16:49:43.539660+0000, chain.objs.size()=1 2024-09-19T15:31:40.224 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.220+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.EnfwWFVdPY8GJ_tH2G_1TCAaP70OBI2_0 2024-09-19T15:31:40.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.220+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10699467885132283778', time=2024-09-19T16:49:44.028345+0000, chain.objs.size()=1 2024-09-19T15:31:40.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.220+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_._qssr27JRqOQu28KNkwftRcV220NjBR_0 2024-09-19T15:31:40.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.220+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3932766534240106986', time=2024-09-19T16:49:44.976783+0000, chain.objs.size()=1 2024-09-19T15:31:40.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.220+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.xSczJRbXfS6yOKK2YGseHJXDC5JEaZZ_0 2024-09-19T15:31:40.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.220+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10979982151091955746', time=2024-09-19T16:49:46.215509+0000, chain.objs.size()=1 2024-09-19T15:31:40.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.220+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.KHRKnF_8Utru1OxMJrgGFbKA8gi_MHZ_0 2024-09-19T15:31:40.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.220+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3148732804203233797', time=2024-09-19T16:49:48.507288+0000, chain.objs.size()=1 2024-09-19T15:31:40.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.220+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.5Z8vNIPqpSp9jalNVSnIjjCdAoRQ0Ft_0 2024-09-19T15:31:40.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.220+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1536804459864638985', time=2024-09-19T16:49:49.661256+0000, chain.objs.size()=1 2024-09-19T15:31:40.225 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.220+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.i5ZbmBunpXrXrca0eX6UJpA16aPn7jn_0 2024-09-19T15:31:40.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.220+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16735670761681230497', time=2024-09-19T16:49:50.219703+0000, chain.objs.size()=1 2024-09-19T15:31:40.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.220+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.3ytbx_Jbn2mobYTomfExljS7ufB6k-I_0 2024-09-19T15:31:40.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.220+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8975021357631868443', time=2024-09-19T16:49:52.499707+0000, chain.objs.size()=1 2024-09-19T15:31:40.226 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.220+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ntlwpVQO7G29Ev_bUEo5sKPBktN3YP4_0 2024-09-19T15:31:40.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.224+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16482515973619510273', time=2024-09-19T16:49:53.106015+0000, chain.objs.size()=1 2024-09-19T15:31:40.228 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.224+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.KT-vwotpTGG4wPOkPn6uw9O7G8bpB_Q_0 2024-09-19T15:31:40.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.224+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3479947582308428568', time=2024-09-19T16:49:53.866470+0000, chain.objs.size()=1 2024-09-19T15:31:40.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.224+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.PMnBuk3E0BAVdb7V1sBaIOFAAn0FgIM_0 2024-09-19T15:31:40.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.224+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.777590249417280083', time=2024-09-19T16:49:54.094742+0000, chain.objs.size()=1 2024-09-19T15:31:40.229 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.224+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.CAgKOoU-IezFSNkJCjho-Dkuizs3TsM_0 2024-09-19T15:31:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.224+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3340766396448123227', time=2024-09-19T16:49:56.044172+0000, chain.objs.size()=1 2024-09-19T15:31:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.224+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.EHENtoAf8fbq96oxhDRyjQfG5lcwoCY_0 2024-09-19T15:31:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.224+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7991998167564894665', time=2024-09-19T16:49:56.109021+0000, chain.objs.size()=1 2024-09-19T15:31:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.224+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.90WxfRhWHfjhhqBYjGu0ayy0viA0fIO_0 2024-09-19T15:31:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.224+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10084558652743877180', time=2024-09-19T16:49:57.453731+0000, chain.objs.size()=1 2024-09-19T15:31:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.224+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.xjr4DrMnBJYaVHbI-IYJbVbpTO9t5mD_0 2024-09-19T15:31:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.224+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3080388174929733956', time=2024-09-19T16:49:57.455305+0000, chain.objs.size()=1 2024-09-19T15:31:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.224+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.LIdCiLiK8K7c0LmZSyD8oIqMKOS1sX6_0 2024-09-19T15:31:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.224+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2107386467527325934', time=2024-09-19T16:49:58.112727+0000, chain.objs.size()=1 2024-09-19T15:31:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.224+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.cNBjSPtjDg_NX0O5l5OcMjLGKYBmkVz_0 2024-09-19T15:31:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.224+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13417708146407281376', time=2024-09-19T16:49:58.322691+0000, chain.objs.size()=1 2024-09-19T15:31:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.224+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.0IXmJQiirILAgvuceagxMSk3Q8AinU9_0 2024-09-19T15:31:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.224+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5746635006378926513', time=2024-09-19T16:49:58.751581+0000, chain.objs.size()=1 2024-09-19T15:31:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.224+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.6eR-EfRJQ6WIgIvGhIe3HO4ZelO8qF4_0 2024-09-19T15:31:40.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.224+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17558198609140517766', time=2024-09-19T16:49:59.014682+0000, chain.objs.size()=1 2024-09-19T15:31:40.231 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.224+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.4t3-lyT3AXqe5KSKsbbdpFRd2W7k5TD_0 2024-09-19T15:31:40.234 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.228+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/53527 2024-09-19T15:31:40.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-19T15:31:40.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1045123489322906727', time=2024-09-19T16:50:00.478289+0000, chain.objs.size()=1 2024-09-19T15:31:40.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.mhBDske-KbrzCMOazhJVC1TiZbHDlek_0 2024-09-19T15:31:40.237 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11779476471336088803', time=2024-09-19T16:50:01.236044+0000, chain.objs.size()=1 2024-09-19T15:31:40.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.NjX5Nw7XRQz-5bF1UmWgxX1Dc-SFDY8_0 2024-09-19T15:31:40.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10056838890842392467', time=2024-09-19T16:50:01.374167+0000, chain.objs.size()=1 2024-09-19T15:31:40.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.CzEfhMw9-3uT1omOce3I0ZjDkbGGQ5A_0 2024-09-19T15:31:40.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15505659983943833439', time=2024-09-19T16:50:01.681385+0000, chain.objs.size()=1 2024-09-19T15:31:40.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.9SMaC7TzLqagAlB_bTuTu_EARPP5y2k_0 2024-09-19T15:31:40.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18028991261537230103', time=2024-09-19T16:51:34.865361+0000, chain.objs.size()=1 2024-09-19T15:31:40.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.370__shadow_.bekPnXeZHrNB3dTqLJE4wduzqEWYyxk_0 2024-09-19T15:31:40.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17149164708937674640', time=2024-09-19T17:07:16.991673+0000, chain.objs.size()=1 2024-09-19T15:31:40.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.561__multipart_mymultipart.4pvGtzxHsDDDoZY3cE3zKll8ekwVoNm_.1 2024-09-19T15:31:40.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6602926869582560736', time=2024-09-19T17:07:43.680748+0000, chain.objs.size()=1 2024-09-19T15:31:40.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:marDaK7o8ZmBskXeWfXQ5TjocOtUEXc_.Mquzc7qTxuD905tI3z2kg1c6N4Bwu4n_0 2024-09-19T15:31:40.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16008432259598370140', time=2024-09-19T17:07:44.776545+0000, chain.objs.size()=1 2024-09-19T15:31:40.238 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:nNnoRXcFdsFRachq5.31T7n39yu8wKY_.ZI_BNqyaJ64CvCaVGS2lASqkeXUFmSS_0 2024-09-19T15:31:40.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12936436948087072222', time=2024-09-19T17:09:03.738176+0000, chain.objs.size()=1 2024-09-19T15:31:40.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:fODStijcA3XSyhhTLv0Vou14776TG2E_.ELYiVg8GxSM_LKiDLO3ffyni1gymE7P_0 2024-09-19T15:31:40.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1814192250782118336', time=2024-09-19T17:18:27.172205+0000, chain.objs.size()=1 2024-09-19T15:31:40.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.639__shadow_.LpkXrbOPIh0Bhh1h5E8ifJtCnS6Y9xk_0 2024-09-19T15:31:40.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13211740572634777001', time=2024-09-19T17:21:31.419259+0000, chain.objs.size()=1 2024-09-19T15:31:40.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.691__shadow_.PTH7cmFl7nlEtoH-SaDYPGARJtNUJ9z_0 2024-09-19T15:31:40.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16265024096365313100', time=2024-09-19T17:21:56.781614+0000, chain.objs.size()=1 2024-09-19T15:31:40.239 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.232+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.703__shadow:CvDjLxTEzopdFNE9r7AUzqZ-mzskGIg_.zC3HFJMKijI8jZ_wMXuYeF4rjY1uL-G_0 2024-09-19T15:31:40.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.236+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6636332710168836373', time=2024-09-19T17:22:07.567047+0000, chain.objs.size()=1 2024-09-19T15:31:40.241 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.236+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.708__shadow:wS2OVaOTi2ZMixHqYjAnlTOwyTPfqNw_.MXpPRipK2Iiza1J1WgTXSfA2mnDGSQS_0 2024-09-19T15:31:40.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.236+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8515309174060691517', time=2024-09-19T17:23:43.748290+0000, chain.objs.size()=10 2024-09-19T15:31:40.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.236+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.735__multipart_foo.2~7RtPGUEkU-f-_fCjIrYjnwsbffJSvzA.1 2024-09-19T15:31:40.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.236+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.735__multipart_foo.2~7RtPGUEkU-f-_fCjIrYjnwsbffJSvzA.2 2024-09-19T15:31:40.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.236+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.735__multipart_foo.2~7RtPGUEkU-f-_fCjIrYjnwsbffJSvzA.3 2024-09-19T15:31:40.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.236+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.735__multipart_foo.2~7RtPGUEkU-f-_fCjIrYjnwsbffJSvzA.4 2024-09-19T15:31:40.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.236+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.735__multipart_foo.2~7RtPGUEkU-f-_fCjIrYjnwsbffJSvzA.5 2024-09-19T15:31:40.242 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.236+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.735__multipart_foo.2~7RtPGUEkU-f-_fCjIrYjnwsbffJSvzA.6 2024-09-19T15:31:40.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.236+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.735__multipart_foo.2~7RtPGUEkU-f-_fCjIrYjnwsbffJSvzA.7 2024-09-19T15:31:40.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.236+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.735__multipart_foo.2~7RtPGUEkU-f-_fCjIrYjnwsbffJSvzA.8 2024-09-19T15:31:40.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.236+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.735__multipart_foo.2~7RtPGUEkU-f-_fCjIrYjnwsbffJSvzA.9 2024-09-19T15:31:40.243 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.236+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.735__multipart_foo.2~7RtPGUEkU-f-_fCjIrYjnwsbffJSvzA.10 2024-09-19T15:31:40.244 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.240+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2606471671736382568', time=2024-09-19T17:28:19.114111+0000, chain.objs.size()=1 2024-09-19T15:31:40.245 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.240+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.773__shadow_.Y4bmP5ZBCOR6v-il_YRDIrvjajg1BzY_0 2024-09-19T15:31:40.250 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.244+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:40.252 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T15:31:40.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:40.253 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:40.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46203' 2024-09-19T15:31:40.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='_xbGp67wZJyqmULHPE4QOMVv9SzIubkY', time=2024-09-19T16:33:49.283705+0000, chain.objs.size()=2 2024-09-19T15:31:40.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.161__shadow_.A5CRlcGB2t_S56ZneiwP7oPusEBUveu_0 2024-09-19T15:31:40.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.161__shadow_.A5CRlcGB2t_S56ZneiwP7oPusEBUveu_1 2024-09-19T15:31:40.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2528702440369241503', time=2024-09-19T16:34:44.855997+0000, chain.objs.size()=1 2024-09-19T15:31:40.255 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.176__shadow_.pC2zlqPBvFb1KVFko20xflz4My-gizp_0 2024-09-19T15:31:40.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18095138147436997108', time=2024-09-19T16:39:24.731544+0000, chain.objs.size()=1 2024-09-19T15:31:40.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.230__shadow_.rDvvAOjyPxfgrArhzaPmEGMBOQ0_bsC_0 2024-09-19T15:31:40.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1664889964006216669', time=2024-09-19T16:39:38.674898+0000, chain.objs.size()=1 2024-09-19T15:31:40.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.236__shadow_.CZ3pgegWFScf4gt65QzmWRB2wD_FIh8_0 2024-09-19T15:31:40.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15333736689757295689', time=2024-09-19T16:40:30.538546+0000, chain.objs.size()=1 2024-09-19T15:31:40.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.256__shadow_.w_nlcHOSw0Gmpk5PALYgy2MOs6jDEuf_0 2024-09-19T15:31:40.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12121927579554696819', time=2024-09-19T16:42:28.160724+0000, chain.objs.size()=1 2024-09-19T15:31:40.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.qOUcyDyB0lT0dtIBqIGlj6xA3cggmjH_0 2024-09-19T15:31:40.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3494254732842294482', time=2024-09-19T16:42:29.074124+0000, chain.objs.size()=1 2024-09-19T15:31:40.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.q5EXyhCunDgfSTsjKNcQZk6qcdfc9oZ_0 2024-09-19T15:31:40.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12181350401015666744', time=2024-09-19T16:42:33.178476+0000, chain.objs.size()=1 2024-09-19T15:31:40.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.6rAL8L2QhG0-moNn7NIKACIgeOD8VA9_0 2024-09-19T15:31:40.256 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4153611473604310518', time=2024-09-19T16:42:33.530893+0000, chain.objs.size()=1 2024-09-19T15:31:40.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.f9WVh6rKW7Kbisrm5bsHf-Ukp-5qpKP_0 2024-09-19T15:31:40.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4283453530036521294', time=2024-09-19T16:42:35.680362+0000, chain.objs.size()=1 2024-09-19T15:31:40.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.SE-uJFOG_3q27P4YbLTacHsfs4ZWBRG_0 2024-09-19T15:31:40.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4997853847057984429', time=2024-09-19T16:42:35.743931+0000, chain.objs.size()=1 2024-09-19T15:31:40.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.248+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.arSqdA5PdMdKWIUgd9y5BvRFOv9dInB_0 2024-09-19T15:31:40.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.252+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5576423246431025616', time=2024-09-19T16:42:37.838383+0000, chain.objs.size()=1 2024-09-19T15:31:40.257 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.252+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.V2ropCY0AI6GpYyxJLBTf4R-qfogaWu_0 2024-09-19T15:31:40.258 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.252+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1448474454781638927', time=2024-09-19T16:42:39.985517+0000, chain.objs.size()=1 2024-09-19T15:31:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.252+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.OQtPIOXhLr__VWGXj-FHpOG-YIMe7fG_0 2024-09-19T15:31:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.252+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13721216631733849456', time=2024-09-19T16:42:40.048331+0000, chain.objs.size()=1 2024-09-19T15:31:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.252+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.wAqUPs3_GRseWnwYcZ3cfiO15gnxmPc_0 2024-09-19T15:31:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.252+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12676870913387558422', time=2024-09-19T16:42:41.129657+0000, chain.objs.size()=1 2024-09-19T15:31:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.252+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.3OxNmet0FU4amfZ5lIC0yiLdOsEMMu1_0 2024-09-19T15:31:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.252+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9047579668411983429', time=2024-09-19T16:42:41.137931+0000, chain.objs.size()=1 2024-09-19T15:31:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.252+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.PtHOWt3ilunqriUxInOoey_n-_HJAHO_0 2024-09-19T15:31:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.252+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18167069723094856344', time=2024-09-19T16:42:41.954475+0000, chain.objs.size()=1 2024-09-19T15:31:40.259 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.252+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_._MIk7bfXoVzUWqD9OnCbBfeJ3gofJnB_0 2024-09-19T15:31:40.260 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.256+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.688049378351289204', time=2024-09-19T16:42:43.056492+0000, chain.objs.size()=1 2024-09-19T15:31:40.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.256+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.zMpMxyGwEDFFR10VwOTwEPwkTClrI3__0 2024-09-19T15:31:40.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.256+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9901537009643049147', time=2024-09-19T16:42:43.924220+0000, chain.objs.size()=1 2024-09-19T15:31:40.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.256+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.QfWFbtPrOp9yubXxw-cqkjmnCJC06-S_0 2024-09-19T15:31:40.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.256+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.608890435015931025', time=2024-09-19T16:42:43.925937+0000, chain.objs.size()=1 2024-09-19T15:31:40.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.256+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Wn-L4AWEMcn2rdfV1M8zn5jFUKCgdAN_0 2024-09-19T15:31:40.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.256+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5319073092894087496', time=2024-09-19T16:42:45.830274+0000, chain.objs.size()=1 2024-09-19T15:31:40.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.256+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.mYslYKW5zlzFoGGO1FNDwy88msdazcW_0 2024-09-19T15:31:40.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.256+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8801135918051329193', time=2024-09-19T16:42:46.390617+0000, chain.objs.size()=1 2024-09-19T15:31:40.261 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.256+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.8Fm9FJ1dZ6v242qapqN53x7SXixKSCK_0 2024-09-19T15:31:40.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.256+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18177089257976528035', time=2024-09-19T16:42:47.285482+0000, chain.objs.size()=1 2024-09-19T15:31:40.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.256+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.uJVbdKKhf9HmIwUju-QMlCItDHE_L_0_0 2024-09-19T15:31:40.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.256+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16178354207917603716', time=2024-09-19T16:42:47.855939+0000, chain.objs.size()=1 2024-09-19T15:31:40.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.256+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.0PpdmnKfAYyIlUiw2XumXW1YYZafDQD_0 2024-09-19T15:31:40.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.256+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5447690397605361547', time=2024-09-19T16:42:48.301327+0000, chain.objs.size()=1 2024-09-19T15:31:40.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.256+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.soNEtqC67RQPO5yFeNshVW5rC956N4q_0 2024-09-19T15:31:40.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.256+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8100883671172691898', time=2024-09-19T16:42:49.788769+0000, chain.objs.size()=1 2024-09-19T15:31:40.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.256+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.4gHwH21H_jAPDQo0_pBTF1R6xDaVofF_0 2024-09-19T15:31:40.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.256+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5035276022449212711', time=2024-09-19T16:42:51.132623+0000, chain.objs.size()=1 2024-09-19T15:31:40.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.256+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.OSzo0HHN3-bM-RZcjn2G4on3yYF8go3_0 2024-09-19T15:31:40.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.256+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15553651924635334231', time=2024-09-19T16:42:52.511460+0000, chain.objs.size()=1 2024-09-19T15:31:40.263 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.256+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Q9YOpIMco5Ip6TMbEsHEp4fLR-a1dv-_0 2024-09-19T15:31:40.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.256+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7523691496052733630', time=2024-09-19T16:42:53.334453+0000, chain.objs.size()=1 2024-09-19T15:31:40.264 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.256+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Oe1qpUYetGgD1OZw3VXbuXTb7wKVEup_0 2024-09-19T15:31:40.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.260+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4722561348710126643', time=2024-09-19T16:42:53.487781+0000, chain.objs.size()=1 2024-09-19T15:31:40.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.260+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.79bXUszD-M_Gx_1sxu2_beAxcBMApmH_0 2024-09-19T15:31:40.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.260+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4051149893329497726', time=2024-09-19T16:42:56.249444+0000, chain.objs.size()=1 2024-09-19T15:31:40.265 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.260+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.BrJC014pYJSCg6cIVAGrDklb080rAhr_0 2024-09-19T15:31:40.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.260+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10251323038804360511', time=2024-09-19T16:42:56.444906+0000, chain.objs.size()=1 2024-09-19T15:31:40.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.260+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.uKF-xt0M6RbDCbXjx-oxZvXtEVoXGTq_0 2024-09-19T15:31:40.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.260+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2434419510342661194', time=2024-09-19T16:42:59.254344+0000, chain.objs.size()=1 2024-09-19T15:31:40.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.260+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.drvg9hgeYcXqg_C_vpHVBljOIYxuMn3_0 2024-09-19T15:31:40.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.260+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14022898635712516600', time=2024-09-19T16:42:59.438490+0000, chain.objs.size()=1 2024-09-19T15:31:40.266 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.260+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.3B1yB-vPTGCc8osL-ENQvqiSxGYSwko_0 2024-09-19T15:31:40.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.260+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15166170326095107255', time=2024-09-19T16:43:11.249882+0000, chain.objs.size()=1 2024-09-19T15:31:40.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.260+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.267__shadow_.iOIt_VFvExFgyFGpo8EZhpyXO9kImqG_0 2024-09-19T15:31:40.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.260+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8767627676053452704', time=2024-09-19T16:44:35.472564+0000, chain.objs.size()=1 2024-09-19T15:31:40.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.260+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.300__shadow_.hm3pESY41dpBvYVfYupuOZtUHkJd0jk_0 2024-09-19T15:31:40.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.260+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.817799051461512373', time=2024-09-19T16:44:40.060529+0000, chain.objs.size()=1 2024-09-19T15:31:40.267 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.260+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.302__shadow_.cHIUI7Xe0XvRRbVcBWOUkIUnxi9apjt_0 2024-09-19T15:31:40.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.260+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2682237757630839845', time=2024-09-19T16:44:42.481887+0000, chain.objs.size()=1 2024-09-19T15:31:40.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.260+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.303__shadow_.TOIZnOJAOhpAJQgkv3McyBEvSw9xi07_0 2024-09-19T15:31:40.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.260+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5766428455777924408', time=2024-09-19T16:47:18.135324+0000, chain.objs.size()=1 2024-09-19T15:31:40.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.260+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.5UDHzbUWVynLYg11SscYjbEGzK4GM-Q_0 2024-09-19T15:31:40.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.264+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16553758719179532070', time=2024-09-19T16:47:18.224831+0000, chain.objs.size()=1 2024-09-19T15:31:40.268 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.264+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Lwxa8WZp521vYxWepVweFP699Q57tQY_0 2024-09-19T15:31:40.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.264+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6810981386442942218', time=2024-09-19T16:47:22.312463+0000, chain.objs.size()=1 2024-09-19T15:31:40.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.264+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ShGir1W08raxZGF2-qtnVeDwnSjisfq_0 2024-09-19T15:31:40.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.264+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18018855860416117250', time=2024-09-19T16:47:23.006096+0000, chain.objs.size()=1 2024-09-19T15:31:40.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.264+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.hF68_-N01O7Dhplad76m_-S-owQU1eF_0 2024-09-19T15:31:40.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.264+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1691937813818432677', time=2024-09-19T16:47:23.975425+0000, chain.objs.size()=1 2024-09-19T15:31:40.270 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.264+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.zpLxqwWaR7EJ_e4MO7-2veKRF7qxRbZ_0 2024-09-19T15:31:40.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.264+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7828047752280666585', time=2024-09-19T16:47:23.977132+0000, chain.objs.size()=1 2024-09-19T15:31:40.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.264+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.H8IwFoV3wt2aPMIES6ZODpSooEBV5ux_0 2024-09-19T15:31:40.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.264+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12327808667041457525', time=2024-09-19T16:47:25.208392+0000, chain.objs.size()=1 2024-09-19T15:31:40.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.264+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.XH87582MO9GzpNdTWPLUWE-QmONZW9r_0 2024-09-19T15:31:40.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.264+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14959906874005155834', time=2024-09-19T16:47:26.671597+0000, chain.objs.size()=1 2024-09-19T15:31:40.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.264+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.eI_dRXbQ4uXoHzt2LsakgPF4LsAWLhC_0 2024-09-19T15:31:40.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.264+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7792439216184630300', time=2024-09-19T16:47:27.331372+0000, chain.objs.size()=1 2024-09-19T15:31:40.271 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.264+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ZVdKJuIeLEfjVtn4b0-RW9s2nEviO6f_0 2024-09-19T15:31:40.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13848957120600131808', time=2024-09-19T16:47:28.169682+0000, chain.objs.size()=1 2024-09-19T15:31:40.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.268+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.JLvVtrnnTtT31yZtLaPQn_A49o6cmvE_0 2024-09-19T15:31:40.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7514859610526672183', time=2024-09-19T16:47:28.417209+0000, chain.objs.size()=1 2024-09-19T15:31:40.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.268+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.0_KIOLJTLWrlgBjgnqiNnGJuZ3WEJ3e_0 2024-09-19T15:31:40.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10297233568369167930', time=2024-09-19T16:47:28.419054+0000, chain.objs.size()=1 2024-09-19T15:31:40.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.268+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.6lVSNknq08dnqsJt9yxTi2g-2iC6fhV_0 2024-09-19T15:31:40.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12522696983178715593', time=2024-09-19T16:47:29.721854+0000, chain.objs.size()=1 2024-09-19T15:31:40.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.268+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.JNiCrbS8Fr-1ZzpI7GFWzXNE_xqNiB2_0 2024-09-19T15:31:40.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10685948029739542612', time=2024-09-19T16:47:31.564453+0000, chain.objs.size()=1 2024-09-19T15:31:40.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.268+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.UYT9D6ktm6LBf72r_nJHIKb2UJh8lCx_0 2024-09-19T15:31:40.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.319534031363018182', time=2024-09-19T16:47:31.565847+0000, chain.objs.size()=1 2024-09-19T15:31:40.274 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.268+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.MufZUdS3aBaDV-OEfYuHYw2JkvUxSNL_0 2024-09-19T15:31:40.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1638991802184103224', time=2024-09-19T16:47:31.999322+0000, chain.objs.size()=1 2024-09-19T15:31:40.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.268+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.FJkEpsfqzyy7WhYN1HiEJaBaeHsnaUn_0 2024-09-19T15:31:40.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16348621753484772194', time=2024-09-19T16:47:33.092164+0000, chain.objs.size()=1 2024-09-19T15:31:40.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.268+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.HyGBjRTUm95nOefpFtE52yHpxbW2-j-_0 2024-09-19T15:31:40.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7687541781980823326', time=2024-09-19T16:47:34.373283+0000, chain.objs.size()=1 2024-09-19T15:31:40.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.268+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.jyFD2nVTGU6XOzauXz9X4GdHctnqtPe_0 2024-09-19T15:31:40.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17610868321219046980', time=2024-09-19T16:47:35.726752+0000, chain.objs.size()=1 2024-09-19T15:31:40.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.268+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.QfhD7PiT-DV1pBjZvGZhHJ5usNpKSpq_0 2024-09-19T15:31:40.275 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.268+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1559519590072629605', time=2024-09-19T16:47:35.730937+0000, chain.objs.size()=1 2024-09-19T15:31:40.276 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.268+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.UpqNIOUVxFTvrs-j_Ou9ripeQBLHC-4_0 2024-09-19T15:31:40.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.272+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10785880348405674340', time=2024-09-19T16:47:36.739884+0000, chain.objs.size()=1 2024-09-19T15:31:40.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.272+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.xXg4lk1cknyz64Tg0XEdhzgPRzoHa7W_0 2024-09-19T15:31:40.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.272+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.439879389816396424', time=2024-09-19T16:47:37.162809+0000, chain.objs.size()=1 2024-09-19T15:31:40.278 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.272+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ZAUGJHINKnC-U9E5xDC831Wkb_Rrbxm_0 2024-09-19T15:31:40.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1565783758699398117', time=2024-09-19T16:47:37.324343+0000, chain.objs.size()=1 2024-09-19T15:31:40.280 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.qGbxsYUGDeKAYhqrZPQTDrqeanA8iz8_0 2024-09-19T15:31:40.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10567090109557529767', time=2024-09-19T16:47:38.271150+0000, chain.objs.size()=1 2024-09-19T15:31:40.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.AnhckK_pa149irMWOGCNTBRwo7fw3IQ_0 2024-09-19T15:31:40.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14075539399484939374', time=2024-09-19T16:47:41.354038+0000, chain.objs.size()=1 2024-09-19T15:31:40.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.6OH8Mn2Yg7rYFEb3XD7pAhNBf3BHVV5_0 2024-09-19T15:31:40.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3447762391717224426', time=2024-09-19T16:47:42.694746+0000, chain.objs.size()=1 2024-09-19T15:31:40.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.YbnUvxkeQ59FAEUEOO5LvCF55wkV7do_0 2024-09-19T15:31:40.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9168075551614613800', time=2024-09-19T16:47:43.501772+0000, chain.objs.size()=1 2024-09-19T15:31:40.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.sBoA6HUNHbpQDDhhYZB2QhsxRtG7wii_0 2024-09-19T15:31:40.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8856786861126412822', time=2024-09-19T16:47:44.524690+0000, chain.objs.size()=1 2024-09-19T15:31:40.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Av1k-jxugLSQgzjh65XZYGiDRahUXxK_0 2024-09-19T15:31:40.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15867830010410717532', time=2024-09-19T16:47:45.548417+0000, chain.objs.size()=1 2024-09-19T15:31:40.281 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.mbxetJNiimRa5ISEvrf5KhIvCTOe1Ry_0 2024-09-19T15:31:40.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18294425667644988185', time=2024-09-19T16:47:45.791336+0000, chain.objs.size()=1 2024-09-19T15:31:40.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.WpliyxpC6_XoCvk7LRk6yxTwz27EJdY_0 2024-09-19T15:31:40.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4449544556592430598', time=2024-09-19T16:47:45.889589+0000, chain.objs.size()=1 2024-09-19T15:31:40.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.FWJrtbyXcygdBc8TppNASXiJB6-zDxk_0 2024-09-19T15:31:40.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15431364545014682746', time=2024-09-19T16:47:48.618868+0000, chain.objs.size()=1 2024-09-19T15:31:40.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.-x7B0nvnc-nOp2NTaPraGJSYHnHT9iW_0 2024-09-19T15:31:40.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.276+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6823438102408854433', time=2024-09-19T16:47:48.966850+0000, chain.objs.size()=1 2024-09-19T15:31:40.282 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.276+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Y-VMaHfO54Ev5RfgeHWPRqTSV3FTUo7_0 2024-09-19T15:31:40.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.280+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6081141419491170031', time=2024-09-19T16:47:49.637144+0000, chain.objs.size()=1 2024-09-19T15:31:40.284 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.280+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.M1GE4FxldxMSAFyf4dV2mR4kNzNtLfy_0 2024-09-19T15:31:40.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.280+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12649354798954031699', time=2024-09-19T16:47:49.782188+0000, chain.objs.size()=1 2024-09-19T15:31:40.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.280+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.z4Rxmpo2kUb9gW6GF7j_alTUGvedVn6_0 2024-09-19T15:31:40.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.280+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12589566891678532703', time=2024-09-19T16:49:36.318926+0000, chain.objs.size()=1 2024-09-19T15:31:40.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.280+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.MUUOxAAjQJXH7itXhyfXeU6_OS5ne2U_0 2024-09-19T15:31:40.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.280+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11755122450387284961', time=2024-09-19T16:49:37.180662+0000, chain.objs.size()=1 2024-09-19T15:31:40.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.280+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.y0Kg-2q1nV-IMp3tprIjbqsgWeiVKFt_0 2024-09-19T15:31:40.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.280+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14748192743640086343', time=2024-09-19T16:49:39.431584+0000, chain.objs.size()=1 2024-09-19T15:31:40.285 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.280+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.YM0R1k-MTHMChnDTAMunio2cc0-L-Iu_0 2024-09-19T15:31:40.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.280+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8620478988631955199', time=2024-09-19T16:49:39.726981+0000, chain.objs.size()=1 2024-09-19T15:31:40.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.280+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.DT0aOyGEc5KxC4NrOZgkAyidPqOIYgr_0 2024-09-19T15:31:40.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.280+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3452002792424458991', time=2024-09-19T16:49:41.332532+0000, chain.objs.size()=1 2024-09-19T15:31:40.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.280+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.vOFd8xNkAiyXgtCtZrvVtgUbsPWWCdF_0 2024-09-19T15:31:40.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.280+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10503683406318452933', time=2024-09-19T16:49:41.334581+0000, chain.objs.size()=1 2024-09-19T15:31:40.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.280+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.IVlh3cTExdhPpJd7PezANc6uqkB-F6o_0 2024-09-19T15:31:40.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.280+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7852643906053063436', time=2024-09-19T16:49:43.576065+0000, chain.objs.size()=1 2024-09-19T15:31:40.286 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.280+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.aKdXr7Ph6CcT6rVOrI7mIG2-MfvwV8P_0 2024-09-19T15:31:40.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.280+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10472709373770301220', time=2024-09-19T16:49:44.054377+0000, chain.objs.size()=1 2024-09-19T15:31:40.287 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.280+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.p7GuH9kTRs3m1tqOQg8LypDMyJN4JpG_0 2024-09-19T15:31:40.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16894042054540729318', time=2024-09-19T16:49:44.177161+0000, chain.objs.size()=1 2024-09-19T15:31:40.288 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.pZs7ccRbULpf-J5_gOT8R4mYjmRJB_z_0 2024-09-19T15:31:40.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9426607629270971273', time=2024-09-19T16:49:45.846230+0000, chain.objs.size()=1 2024-09-19T15:31:40.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.UlVXErfeB_wk2PTcmQ-NLlP6i7W2pl7_0 2024-09-19T15:31:40.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12548725751683396398', time=2024-09-19T16:49:49.313787+0000, chain.objs.size()=1 2024-09-19T15:31:40.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.R4SPR6SaddLY7eNDlR0-AdLMQ5hSiBe_0 2024-09-19T15:31:40.289 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9003693673424354872', time=2024-09-19T16:49:50.969059+0000, chain.objs.size()=1 2024-09-19T15:31:40.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.mmJr1gMQRs89xT62vk9ChArodbRWm2u_0 2024-09-19T15:31:40.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14907624571008364626', time=2024-09-19T16:49:52.095802+0000, chain.objs.size()=1 2024-09-19T15:31:40.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.a4Q24HBO4L9QxmWY7bM7XNrbpWYWmJ7_0 2024-09-19T15:31:40.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10138233755814553722', time=2024-09-19T16:49:54.201706+0000, chain.objs.size()=1 2024-09-19T15:31:40.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.rtm2thBXZIu1eqre3BEEiNaY2D8SP-A_0 2024-09-19T15:31:40.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16723698221167468468', time=2024-09-19T16:49:54.640670+0000, chain.objs.size()=1 2024-09-19T15:31:40.290 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.gZW7MfeZb0hbv_CGUG_vsyFaRGtTNKJ_0 2024-09-19T15:31:40.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2644566987587138671', time=2024-09-19T16:49:56.581903+0000, chain.objs.size()=1 2024-09-19T15:31:40.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ucazkubUcNhCTNpTsgmf-ifWiN4Qy-n_0 2024-09-19T15:31:40.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15229773789768189308', time=2024-09-19T16:49:56.869506+0000, chain.objs.size()=1 2024-09-19T15:31:40.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.aOtnaCPyBNYPbGzvgHxUOAOXCmBsS8l_0 2024-09-19T15:31:40.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11220621673735396357', time=2024-09-19T16:49:57.461614+0000, chain.objs.size()=1 2024-09-19T15:31:40.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.QXCIgyah7c_sAx_xugX-af07bB7nrPP_0 2024-09-19T15:31:40.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.284+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15794052698915895761', time=2024-09-19T16:49:57.977450+0000, chain.objs.size()=1 2024-09-19T15:31:40.291 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.284+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ZBpOI6AB_p910k3pVeA-AUTvb50ExK2_0 2024-09-19T15:31:40.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.288+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11755966222642823156', time=2024-09-19T16:49:58.201807+0000, chain.objs.size()=1 2024-09-19T15:31:40.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.288+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.NBQ8OFV2JetndromteTa0ew9a2Kfwau_0 2024-09-19T15:31:40.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.288+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10453978331500460997', time=2024-09-19T16:50:01.341896+0000, chain.objs.size()=1 2024-09-19T15:31:40.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.288+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.1sXumwASXQvUwMYiqElvFW5988mTDqe_0 2024-09-19T15:31:40.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.288+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2282394489347249981', time=2024-09-19T16:50:03.095382+0000, chain.objs.size()=1 2024-09-19T15:31:40.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.288+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.GXrRh3cRInGKqI9v_QMyxl-eMSHDM-o_0 2024-09-19T15:31:40.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.288+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3956536993415778996', time=2024-09-19T16:50:04.617108+0000, chain.objs.size()=1 2024-09-19T15:31:40.294 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.288+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.7suX0KqMRoEfR15WhtviBrKhn6UcGCV_0 2024-09-19T15:31:40.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.288+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12579129015118597994', time=2024-09-19T16:50:05.480889+0000, chain.objs.size()=1 2024-09-19T15:31:40.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.288+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.hFUF1KX9nBUnMrX8-YwvdeKQoFZuvlV_0 2024-09-19T15:31:40.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.288+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14860349616293157362', time=2024-09-19T16:54:02.699260+0000, chain.objs.size()=1 2024-09-19T15:31:40.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.288+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.442__shadow_.iS1x9Z_a1O8Rbid-9e_5HVsDfv_HJxS_0 2024-09-19T15:31:40.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.288+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7384626599489458692', time=2024-09-19T16:55:48.461427+0000, chain.objs.size()=1 2024-09-19T15:31:40.295 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.288+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.487__shadow_.7ciDSPOLTB4o1ql_jo1cSeJ5RoVN_iD_0 2024-09-19T15:31:40.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.288+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3114625508363957534', time=2024-09-19T16:56:22.043325+0000, chain.objs.size()=1 2024-09-19T15:31:40.296 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.288+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.503__shadow:vjdbIfRxBe4w.PbHfN6JGIQynOLNKTv_.1FlZE6YVJFffVLJR2xeEpNz8BJZrUMj_0 2024-09-19T15:31:40.298 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.292+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46203 2024-09-19T15:31:40.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.296+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-19T15:31:40.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.296+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17107277175724225072', time=2024-09-19T16:57:48.516109+0000, chain.objs.size()=1 2024-09-19T15:31:40.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.296+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.517__shadow_.zsUq2TNH4SgFoN1P-Ik9wE3__GExR_O_0 2024-09-19T15:31:40.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.296+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4780671781104156560', time=2024-09-19T17:08:20.094079+0000, chain.objs.size()=1 2024-09-19T15:31:40.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.296+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.574__shadow_.i1i4ukNSXOLl06i0bMdZikLQrqqFJxG_0 2024-09-19T15:31:40.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.296+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5544160290553417438', time=2024-09-19T17:08:26.982819+0000, chain.objs.size()=1 2024-09-19T15:31:40.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.296+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.574__shadow:xcpmHtg8GzHxo9YiqkoN5OsCeSTOHH-_.m6vIyFq1fhNBpAvFVa3kwOkxtQ2DU4u_0 2024-09-19T15:31:40.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.296+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.425817279821720075', time=2024-09-19T17:08:30.527931+0000, chain.objs.size()=1 2024-09-19T15:31:40.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.296+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.575__shadow_.4JAd3OeYG6nBwuDgGztFvaGz2zij6vd_0 2024-09-19T15:31:40.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.296+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13940046214937810249', time=2024-09-19T17:08:50.029568+0000, chain.objs.size()=1 2024-09-19T15:31:40.301 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.296+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:DPurI-9E.m1.5NN0KXiYP1YhEMg6Lyo_.ujbuwV_L3nue0LJ16EmOdFP7Gf6cb7m_0 2024-09-19T15:31:40.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.296+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13435110577391776435', time=2024-09-19T17:10:12.448640+0000, chain.objs.size()=4 2024-09-19T15:31:40.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.296+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.578__multipart_testobj.2~8AyjLfZHrRYVZjVGumu_VxlytHGPrBc.1 2024-09-19T15:31:40.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.296+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.578__multipart_testobj.2~8AyjLfZHrRYVZjVGumu_VxlytHGPrBc.2 2024-09-19T15:31:40.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.296+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.578__multipart_testobj.2~8AyjLfZHrRYVZjVGumu_VxlytHGPrBc.3 2024-09-19T15:31:40.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.296+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.578__multipart_testobj.2~8AyjLfZHrRYVZjVGumu_VxlytHGPrBc.4 2024-09-19T15:31:40.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.296+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9256739278268043671', time=2024-09-19T17:10:51.244770+0000, chain.objs.size()=1 2024-09-19T15:31:40.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.296+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.586__shadow:g-SelNQA3fTLnp2ILhSwtnEUP1n3ItD_.yRmcSNkxk8Xx16sHc1OUPV3i4DPOaoO_0 2024-09-19T15:31:40.302 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.296+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11551431987310255396', time=2024-09-19T17:10:56.485851+0000, chain.objs.size()=1 2024-09-19T15:31:40.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.296+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.587__shadow:2HUaX8cVIT3FkKnPqWUIBvRoF7qeDIs_.1n80eAaOpP56GhsKlg35r_HrfiYniIX_0 2024-09-19T15:31:40.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.296+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5496905333362428510', time=2024-09-19T17:20:40.618049+0000, chain.objs.size()=1 2024-09-19T15:31:40.303 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.296+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.664__shadow_.UP4kKEKosB9WXZ_3k9OuRo-9nd8LXxc_0 2024-09-19T15:31:40.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.300+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16098866952565473638', time=2024-09-19T17:22:48.584385+0000, chain.objs.size()=1 2024-09-19T15:31:40.304 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.300+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.719__shadow_.H93y1YQpmGq_-Y1q875kmBTZuSA4onP_0 2024-09-19T15:31:40.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.300+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6422622113057508730', time=2024-09-19T17:24:01.644553+0000, chain.objs.size()=1 2024-09-19T15:31:40.305 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.300+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.742__multipart_mymultipart3.2~QLnI_1K3p5dZBg8ScMnQrEZfJPTMMWB.1 2024-09-19T15:31:40.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.300+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2929545582716314938', time=2024-09-19T17:26:25.893202+0000, chain.objs.size()=1 2024-09-19T15:31:40.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.300+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.758__shadow_.ltgFcMVw6KbJr-JxXqisXmPkg3xkBj-_0 2024-09-19T15:31:40.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.300+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5014555866474682214', time=2024-09-19T17:27:41.376024+0000, chain.objs.size()=1 2024-09-19T15:31:40.306 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.300+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.767__shadow_.L8mBOHGhLV2VPHn56eGcp8psjZYswKh_0 2024-09-19T15:31:40.309 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.304+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:40.311 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.304+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T15:31:40.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:40.312 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:40.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49901' 2024-09-19T15:31:40.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='_dLiwT625NZAfJD6hcL5Vp_QADC1DLgT', time=2024-09-19T16:33:50.981740+0000, chain.objs.size()=2 2024-09-19T15:31:40.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.161__shadow_.gDwZpvr0iUKvlHO_eoogtYX_bPy2zgC_0 2024-09-19T15:31:40.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.161__shadow_.gDwZpvr0iUKvlHO_eoogtYX_bPy2zgC_1 2024-09-19T15:31:40.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11942816266341460445', time=2024-09-19T16:34:24.041215+0000, chain.objs.size()=1 2024-09-19T15:31:40.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.170__shadow_.9huH8_1rorb_BvZL6bcd_s2kd4BorC5_0 2024-09-19T15:31:40.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16528480179958157233', time=2024-09-19T16:39:34.035442+0000, chain.objs.size()=1 2024-09-19T15:31:40.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.234__shadow_.eq_LJ6JREZKengGqgKdwQDp2GuuyxDS_0 2024-09-19T15:31:40.314 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12653213651108264495', time=2024-09-19T16:39:36.275538+0000, chain.objs.size()=1 2024-09-19T15:31:40.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.235__shadow_.RGMvvvvKfsupEcK4XxC-bvmq6XRxclp_0 2024-09-19T15:31:40.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.297061472068712983', time=2024-09-19T16:40:16.665171+0000, chain.objs.size()=1 2024-09-19T15:31:40.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.250__shadow_.tWkgPxl6Kgd4LPCdOHt_NXD3La2sYAx_0 2024-09-19T15:31:40.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18091451237054051016', time=2024-09-19T16:42:28.036993+0000, chain.objs.size()=1 2024-09-19T15:31:40.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.nwMXieFPEhIFKEcuMzZ3z8KvnJfPtIK_0 2024-09-19T15:31:40.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17104941096813794529', time=2024-09-19T16:42:28.821965+0000, chain.objs.size()=1 2024-09-19T15:31:40.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.JZXF8hR5BOzYlvTTFRH7y00NybMgF6V_0 2024-09-19T15:31:40.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3622437295414345954', time=2024-09-19T16:42:28.882080+0000, chain.objs.size()=1 2024-09-19T15:31:40.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Xr4e5umVGsqUoU74Uv4cpJD0kBX4lHt_0 2024-09-19T15:31:40.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4942438841267686904', time=2024-09-19T16:42:31.202533+0000, chain.objs.size()=1 2024-09-19T15:31:40.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.fxUqCc_r00IPpfl1ubSbnkG4Cns5zhU_0 2024-09-19T15:31:40.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2746020125271677228', time=2024-09-19T16:42:35.212614+0000, chain.objs.size()=1 2024-09-19T15:31:40.315 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.EkC_XfNiK-Soa-h6cmNX5WotmzEWTHH_0 2024-09-19T15:31:40.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12493899345702293443', time=2024-09-19T16:42:38.132564+0000, chain.objs.size()=1 2024-09-19T15:31:40.316 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.308+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.edaPMB_Ir7BsXtIBPoNioVLrn-bCJ20_0 2024-09-19T15:31:40.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.312+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16302709858109676667', time=2024-09-19T16:42:41.601084+0000, chain.objs.size()=1 2024-09-19T15:31:40.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.312+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.uNc7qy5mU1pZVvmxW2Eh3TdCzM2AVb1_0 2024-09-19T15:31:40.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.312+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9320680490074904911', time=2024-09-19T16:42:42.048371+0000, chain.objs.size()=1 2024-09-19T15:31:40.317 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.312+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ndfO9JqfCBsC6adHOHgB_J7CBFuLoP4_0 2024-09-19T15:31:40.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.312+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12121359756812385024', time=2024-09-19T16:42:42.050215+0000, chain.objs.size()=1 2024-09-19T15:31:40.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.312+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.YBADFCJiHWOvrzmNPkOrKW0nrAa6BVN_0 2024-09-19T15:31:40.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.312+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14768190493347196746', time=2024-09-19T16:42:42.839082+0000, chain.objs.size()=1 2024-09-19T15:31:40.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.312+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.u8Pgq_OVe9Zq3QzHX0EfhMAfBjKEyHH_0 2024-09-19T15:31:40.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.312+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4274448848033992849', time=2024-09-19T16:42:44.153416+0000, chain.objs.size()=1 2024-09-19T15:31:40.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.312+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.wSJdwnxt0LI6k3A2CrXp9mPDJFaOcVG_0 2024-09-19T15:31:40.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.312+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13927846219766068272', time=2024-09-19T16:42:45.947994+0000, chain.objs.size()=1 2024-09-19T15:31:40.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.312+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.DzAsa1hJ1kogVaDUxlCMS6Y9nR4Tccd_0 2024-09-19T15:31:40.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.312+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16047653630196743541', time=2024-09-19T16:42:46.170569+0000, chain.objs.size()=1 2024-09-19T15:31:40.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.312+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.3qZ5w2CDoSSuOuQfsJhCqn4ixRNVSUC_0 2024-09-19T15:31:40.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.312+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12792131488988018446', time=2024-09-19T16:42:46.579420+0000, chain.objs.size()=1 2024-09-19T15:31:40.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.312+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.-b58dx8IcH3LwlWLPFG7ZYVqFmqolZr_0 2024-09-19T15:31:40.318 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.312+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17712316030022440353', time=2024-09-19T16:42:46.673551+0000, chain.objs.size()=1 2024-09-19T15:31:40.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.312+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.zcby4BCcjqCDvFmIlJ8KNW-8A20NraS_0 2024-09-19T15:31:40.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.312+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6538322352868246415', time=2024-09-19T16:42:47.504673+0000, chain.objs.size()=1 2024-09-19T15:31:40.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.312+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.oeGsueGH3Pvx1ey-B-rJMm0mh3WyQBR_0 2024-09-19T15:31:40.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.312+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9834679876623410128', time=2024-09-19T16:42:47.780201+0000, chain.objs.size()=1 2024-09-19T15:31:40.319 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.312+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.exQchaRHa_2oq70VUH72IymADNQkRO4_0 2024-09-19T15:31:40.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17074449229657385800', time=2024-09-19T16:42:48.414786+0000, chain.objs.size()=1 2024-09-19T15:31:40.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.M9TDWuNn-DsWB356iDnmsHodk5rHsxK_0 2024-09-19T15:31:40.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15588874610734961388', time=2024-09-19T16:42:48.456465+0000, chain.objs.size()=1 2024-09-19T15:31:40.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.EHeS9yw7WXw194eNsg9Z2E1Ap_O9FZZ_0 2024-09-19T15:31:40.320 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17212703614456609', time=2024-09-19T16:42:50.136073+0000, chain.objs.size()=1 2024-09-19T15:31:40.321 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.5ERRz6OkbtxFghusN4UnIYw4OQodyVI_0 2024-09-19T15:31:40.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3498872878879245359', time=2024-09-19T16:42:50.262702+0000, chain.objs.size()=1 2024-09-19T15:31:40.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.olJ-1cWsNMihn1Maj7oWB60Qm_SNHHJ_0 2024-09-19T15:31:40.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10557259035020629256', time=2024-09-19T16:42:51.131487+0000, chain.objs.size()=1 2024-09-19T15:31:40.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.gWrbsg13JfVAmsMCOR0eeyP8gqOfUq8_0 2024-09-19T15:31:40.322 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3036210652460592937', time=2024-09-19T16:42:52.019735+0000, chain.objs.size()=1 2024-09-19T15:31:40.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ScFqQrjv7EbkiEcD170JxaLltCiXeNs_0 2024-09-19T15:31:40.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2923165511342597563', time=2024-09-19T16:42:55.632265+0000, chain.objs.size()=1 2024-09-19T15:31:40.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.V_XagGrDcFBy-Uj0IDysS6ibNzpkq0L_0 2024-09-19T15:31:40.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4847520841669592752', time=2024-09-19T16:42:59.606095+0000, chain.objs.size()=1 2024-09-19T15:31:40.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.PN6xLVhcXoFk3_wfd-TgXijQlvewfOY_0 2024-09-19T15:31:40.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11821144873603297445', time=2024-09-19T16:43:59.403906+0000, chain.objs.size()=1 2024-09-19T15:31:40.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.288__shadow_.xnpAanEgGhimQBESwZy9CSicLTE4B8v_0 2024-09-19T15:31:40.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14179046683630403210', time=2024-09-19T16:44:12.443907+0000, chain.objs.size()=1 2024-09-19T15:31:40.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_.EohAGQhowc787Nn-YlUqvki32tr7RtG_0 2024-09-19T15:31:40.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.316+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2834488347778850078', time=2024-09-19T16:44:12.446072+0000, chain.objs.size()=1 2024-09-19T15:31:40.323 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.316+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_.SiwitHWOrs1_DJc0B0SjprbwsKzkGsT_0 2024-09-19T15:31:40.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.320+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6029638775123892703', time=2024-09-19T16:44:12.723521+0000, chain.objs.size()=1 2024-09-19T15:31:40.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.320+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_.6xI4CMYEWwS-huzsF7GxZjjSEOfvKtQ_0 2024-09-19T15:31:40.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.320+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4330203399415948722', time=2024-09-19T16:44:23.305232+0000, chain.objs.size()=1 2024-09-19T15:31:40.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.320+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.295__shadow_.CeNP7yefwVUyOIfuOHQxz48eNPUubXg_0 2024-09-19T15:31:40.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.320+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1673130022029902687', time=2024-09-19T16:44:44.784987+0000, chain.objs.size()=1 2024-09-19T15:31:40.325 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.320+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.304__shadow_.idcVe8Exfe3Dy8Ntz-biFe2Fe1Y9qaB_0 2024-09-19T15:31:40.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.320+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17630415211796018233', time=2024-09-19T16:44:47.126053+0000, chain.objs.size()=1 2024-09-19T15:31:40.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.320+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.305__shadow_.pl3o0Ldg0FBfyUz6Zp2rg7eYX5rqoez_0 2024-09-19T15:31:40.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.320+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.225907186347367968', time=2024-09-19T16:47:18.992831+0000, chain.objs.size()=1 2024-09-19T15:31:40.326 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.320+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.4b6nVWc46c0wO8glkJYtPr_INFyj7OW_0 2024-09-19T15:31:40.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.320+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17702771578076017652', time=2024-09-19T16:47:19.247454+0000, chain.objs.size()=1 2024-09-19T15:31:40.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.320+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.CItc7WDszJEkkdTtHY0HTkPkPCUembr_0 2024-09-19T15:31:40.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.320+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14277996211599171788', time=2024-09-19T16:47:22.450337+0000, chain.objs.size()=1 2024-09-19T15:31:40.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.320+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.tOLOZ46NEZKOkoQJuFPItqlkHrS27qO_0 2024-09-19T15:31:40.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.320+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10516442870455744535', time=2024-09-19T16:47:22.796289+0000, chain.objs.size()=1 2024-09-19T15:31:40.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.320+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.P8FKayFcNOpNdk68T1t6up7hzIS9jIE_0 2024-09-19T15:31:40.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.320+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6833599054490357080', time=2024-09-19T16:47:23.219925+0000, chain.objs.size()=1 2024-09-19T15:31:40.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.320+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.WaLS_PMqIBGpLAWD2hsfvnANbCl5Caj_0 2024-09-19T15:31:40.327 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.320+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17666341831364185584', time=2024-09-19T16:47:24.585386+0000, chain.objs.size()=1 2024-09-19T15:31:40.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.320+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.DanuDln2bkbTcZPRDLobh1-6m0phMAo_0 2024-09-19T15:31:40.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.320+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2151356423340165432', time=2024-09-19T16:47:24.915249+0000, chain.objs.size()=1 2024-09-19T15:31:40.328 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.320+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ALTRX05Z2IjD9hdlvh1O5eIt3IiipdS_0 2024-09-19T15:31:40.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.324+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18391666992148322513', time=2024-09-19T16:47:25.547650+0000, chain.objs.size()=1 2024-09-19T15:31:40.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.324+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.06-bYbVXJd_YShV8pTEYg2x5vhMW01u_0 2024-09-19T15:31:40.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.324+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5825964283007732099', time=2024-09-19T16:47:27.199651+0000, chain.objs.size()=1 2024-09-19T15:31:40.329 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.324+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.mvzgG0Jo32JpCAuHmfNtQ7uCvsUdwsJ_0 2024-09-19T15:31:40.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.324+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16408886161045819160', time=2024-09-19T16:47:28.288084+0000, chain.objs.size()=1 2024-09-19T15:31:40.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.324+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.rFAr3_UxnBg0diqhN9E_3gb0hpYMlKj_0 2024-09-19T15:31:40.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.324+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10116713310173640568', time=2024-09-19T16:47:28.539568+0000, chain.objs.size()=1 2024-09-19T15:31:40.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.324+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.9YniIrot5I_2eOC_5nQUJ6dxtucbcE6_0 2024-09-19T15:31:40.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.324+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12296422827658921273', time=2024-09-19T16:47:28.950206+0000, chain.objs.size()=1 2024-09-19T15:31:40.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.324+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.0BIMdCFm5yncI4ove_VuidhHrfOsnZI_0 2024-09-19T15:31:40.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.324+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7596462082957626760', time=2024-09-19T16:47:29.593539+0000, chain.objs.size()=1 2024-09-19T15:31:40.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.324+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.GUvOhYFnY3YJyVf_qg7Cu_uDedY8UsR_0 2024-09-19T15:31:40.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.324+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9892304527234951015', time=2024-09-19T16:47:32.189700+0000, chain.objs.size()=1 2024-09-19T15:31:40.330 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.324+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.AmRj862IEtLOYNRxmoiafLoCHC7Vck0_0 2024-09-19T15:31:40.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.324+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15978315970943703840', time=2024-09-19T16:47:32.316843+0000, chain.objs.size()=1 2024-09-19T15:31:40.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.324+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.AkKQeoxAFOUukTSoWZjvPbvIAY6gzvo_0 2024-09-19T15:31:40.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.324+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14391643778134278146', time=2024-09-19T16:47:32.444598+0000, chain.objs.size()=1 2024-09-19T15:31:40.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.324+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.U4WnVWrcyPRmxbCNdBrsfxEkVXk6ZIN_0 2024-09-19T15:31:40.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.324+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11765349652857779464', time=2024-09-19T16:47:33.714131+0000, chain.objs.size()=1 2024-09-19T15:31:40.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.324+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.9rjRfkkqzi7jvVabb5SBWypPoRMaQb-_0 2024-09-19T15:31:40.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.324+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.24747829581908594', time=2024-09-19T16:47:33.814706+0000, chain.objs.size()=1 2024-09-19T15:31:40.331 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.324+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.rUfP_1eiGF5d5wLc4Dwohc1G_meFyyl_0 2024-09-19T15:31:40.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.328+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9766551393270521543', time=2024-09-19T16:47:36.639464+0000, chain.objs.size()=1 2024-09-19T15:31:40.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.328+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.0Dhs4L6ZrC9DuEZLCLhD_uvMTog0dWW_0 2024-09-19T15:31:40.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.328+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14819739678344291490', time=2024-09-19T16:47:36.853807+0000, chain.objs.size()=1 2024-09-19T15:31:40.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.328+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.35_EoY5fu3GPhGZ7vNYh-yB-rheXApX_0 2024-09-19T15:31:40.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.328+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17669994635144953936', time=2024-09-19T16:47:38.378137+0000, chain.objs.size()=1 2024-09-19T15:31:40.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.328+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.7rbx8ZMd6wlH0aoSC0wT_kHY6agpzzw_0 2024-09-19T15:31:40.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.328+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3449633163114451229', time=2024-09-19T16:47:39.472555+0000, chain.objs.size()=1 2024-09-19T15:31:40.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.328+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.E-5aqahUcwgNp5hnSbzhwkfAuNKwdy-_0 2024-09-19T15:31:40.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.328+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.920668540857404315', time=2024-09-19T16:47:41.085226+0000, chain.objs.size()=1 2024-09-19T15:31:40.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.328+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.NorvWrfoYDIJPOWU5yIP1eCCF4g14JL_0 2024-09-19T15:31:40.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.328+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4802785059277657147', time=2024-09-19T16:47:42.334896+0000, chain.objs.size()=1 2024-09-19T15:31:40.335 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.328+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.FkoPUoA1EP3HlSx2ehL7O0_SECVhy9-_0 2024-09-19T15:31:40.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.328+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15105501174828665667', time=2024-09-19T16:47:42.440302+0000, chain.objs.size()=1 2024-09-19T15:31:40.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.328+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.47tq8EEwpjK3BRN8086gw2wTmh7ZaDz_0 2024-09-19T15:31:40.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.328+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12640655826526024134', time=2024-09-19T16:47:43.896553+0000, chain.objs.size()=1 2024-09-19T15:31:40.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.328+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.gUqqYvHG9tsYFGE6M1tWkDQ0IhII88j_0 2024-09-19T15:31:40.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.328+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7746869001016609791', time=2024-09-19T16:47:48.024070+0000, chain.objs.size()=1 2024-09-19T15:31:40.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.328+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.J-qElyt-olC5Y30qPs3JzH1EhWRaR-i_0 2024-09-19T15:31:40.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.328+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2452897132526510634', time=2024-09-19T16:47:49.293826+0000, chain.objs.size()=1 2024-09-19T15:31:40.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.328+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.FNqDh_dHk4bvXU9oxbUYzZ42UqGwrI7_0 2024-09-19T15:31:40.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.328+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11338155685658072914', time=2024-09-19T16:49:35.664445+0000, chain.objs.size()=1 2024-09-19T15:31:40.336 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.328+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.2f041cUgmuYQ0Di04OBHiKrs3jzJ16x_0 2024-09-19T15:31:40.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15737204348243160262', time=2024-09-19T16:49:36.540019+0000, chain.objs.size()=1 2024-09-19T15:31:40.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.U47a3eeybOOom4eV8_V1XX1WRp-ZvYy_0 2024-09-19T15:31:40.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13942813350876686023', time=2024-09-19T16:49:37.466915+0000, chain.objs.size()=1 2024-09-19T15:31:40.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.FbAwue8guNpniAgmDUtE7Xwd4NmClFZ_0 2024-09-19T15:31:40.339 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4852520312919498286', time=2024-09-19T16:49:39.838019+0000, chain.objs.size()=1 2024-09-19T15:31:40.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.VL5c7cYJrr4WMOlglYc9omBvh-B9RbG_0 2024-09-19T15:31:40.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17916752934191976794', time=2024-09-19T16:49:39.876600+0000, chain.objs.size()=1 2024-09-19T15:31:40.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.RV4c5rlMqXnWtGmUaL1Dp_4ALIN6HkB_0 2024-09-19T15:31:40.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13987342588822535735', time=2024-09-19T16:49:40.268315+0000, chain.objs.size()=1 2024-09-19T15:31:40.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.uGHHAgOLDsK0R7qs3l2ZkaHsWoWjt_B_0 2024-09-19T15:31:40.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12645542556149630815', time=2024-09-19T16:49:41.103451+0000, chain.objs.size()=1 2024-09-19T15:31:40.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.e16q6B7h6gs76X2OpS09djXovHIXiid_0 2024-09-19T15:31:40.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9666964087732184695', time=2024-09-19T16:49:41.192777+0000, chain.objs.size()=1 2024-09-19T15:31:40.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.oNOVVqvVJ8KccUvxemlneWclHvn5Mri_0 2024-09-19T15:31:40.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3729999498505418292', time=2024-09-19T16:49:41.194801+0000, chain.objs.size()=1 2024-09-19T15:31:40.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_._-3OEhh122pW1ai2YcwEa12DwMC5BAk_0 2024-09-19T15:31:40.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12128962269196551696', time=2024-09-19T16:49:42.475855+0000, chain.objs.size()=1 2024-09-19T15:31:40.340 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.iYelRVPC05Fu0Hkei34OwO26E8OFYYn_0 2024-09-19T15:31:40.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8864332879216145617', time=2024-09-19T16:49:43.693051+0000, chain.objs.size()=1 2024-09-19T15:31:40.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.lcT-FTXvw59G81u7_zhO3TWdCmlaZF1_0 2024-09-19T15:31:40.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.332+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15550773999148071381', time=2024-09-19T16:49:45.246267+0000, chain.objs.size()=1 2024-09-19T15:31:40.341 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.332+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.gHoVZNwXSNSRVNP_2lodB4FSvZFR4vd_0 2024-09-19T15:31:40.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.336+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4993268589990471247', time=2024-09-19T16:49:45.740547+0000, chain.objs.size()=1 2024-09-19T15:31:40.342 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.336+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.W1dEjQwnNvMfv_kIwgmpa74-CsYhzQ2_0 2024-09-19T15:31:40.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.336+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8994486293149051857', time=2024-09-19T16:49:48.295585+0000, chain.objs.size()=1 2024-09-19T15:31:40.343 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.336+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.7wETZakwKvjg3QosvLuHsJo7VSWDn5I_0 2024-09-19T15:31:40.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9466839158312497662', time=2024-09-19T16:49:49.221785+0000, chain.objs.size()=1 2024-09-19T15:31:40.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Way8YpyFTlGn8pw9uXeoB1Qq3I0tKuR_0 2024-09-19T15:31:40.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2060446340345264971', time=2024-09-19T16:49:50.316281+0000, chain.objs.size()=1 2024-09-19T15:31:40.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.F08ly49upRmUPePH1CvV2Q-V3qQHYje_0 2024-09-19T15:31:40.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2642304114819667251', time=2024-09-19T16:49:53.320380+0000, chain.objs.size()=1 2024-09-19T15:31:40.344 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.umgjRgPFznRTdu-uay_Os6CDYMpT_Qg_0 2024-09-19T15:31:40.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10783010113117550489', time=2024-09-19T16:49:53.322451+0000, chain.objs.size()=1 2024-09-19T15:31:40.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.BkupU61JXIQ52zqaGjEj47XkidnQPkP_0 2024-09-19T15:31:40.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8161680414031048028', time=2024-09-19T16:49:54.195766+0000, chain.objs.size()=1 2024-09-19T15:31:40.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.TNlVtNXY_aYeH4vBMNaIgbnHdzE9Pk6_0 2024-09-19T15:31:40.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9137928693290999045', time=2024-09-19T16:49:54.297454+0000, chain.objs.size()=1 2024-09-19T15:31:40.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.eTwiLsFrsK9piO11O-4X-mtuSPIbxaq_0 2024-09-19T15:31:40.345 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14443926109048558437', time=2024-09-19T16:49:56.680778+0000, chain.objs.size()=1 2024-09-19T15:31:40.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.IetIw8YGFcssKlgZxnBn6vUspP9x__q_0 2024-09-19T15:31:40.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3692576730404064982', time=2024-09-19T16:49:57.091747+0000, chain.objs.size()=1 2024-09-19T15:31:40.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.KP57fcrVZFlE_jdvWmOpez3dthPbrfe_0 2024-09-19T15:31:40.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.722157277638192760', time=2024-09-19T16:49:57.311178+0000, chain.objs.size()=1 2024-09-19T15:31:40.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.TX7mH2eiltTgOkr81vucBIsaVKwxqlY_0 2024-09-19T15:31:40.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10327149733604102807', time=2024-09-19T16:49:59.234096+0000, chain.objs.size()=1 2024-09-19T15:31:40.346 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.AnlEJs2f3M_0HUiwOfTO4Ph9PgX5kP8_0 2024-09-19T15:31:40.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7274911679666651569', time=2024-09-19T16:49:59.279933+0000, chain.objs.size()=1 2024-09-19T15:31:40.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.davBaQw5PAsR7_UGPdbNPGWyrW0dfu6_0 2024-09-19T15:31:40.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15576629919636291122', time=2024-09-19T16:50:00.449394+0000, chain.objs.size()=1 2024-09-19T15:31:40.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.OvpYPhY-JAt_DJRBHN6ayRJschf6m3u_0 2024-09-19T15:31:40.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8423656197644032536', time=2024-09-19T16:50:00.539658+0000, chain.objs.size()=1 2024-09-19T15:31:40.347 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.340+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.sK_XruaWH_uUYOxb3PZBlpi_qLkpW_M_0 2024-09-19T15:31:40.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.344+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17529539893468416992', time=2024-09-19T16:50:01.856696+0000, chain.objs.size()=1 2024-09-19T15:31:40.349 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.344+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.DtLsBPKOdeUILHr1M3Xc3lx0Yp2ycXA_0 2024-09-19T15:31:40.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.344+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12521515050469311235', time=2024-09-19T16:50:02.308847+0000, chain.objs.size()=1 2024-09-19T15:31:40.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.344+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.oZ8F604HYjPHlW1Z_8YHJVQM1ZIfiTR_0 2024-09-19T15:31:40.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.344+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7618374681508778597', time=2024-09-19T16:50:47.479847+0000, chain.objs.size()=1 2024-09-19T15:31:40.350 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.344+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.344__shadow_.hRFzJNe2YJp7eQKRuoEJ6Qg4f7lmTIJ_0 2024-09-19T15:31:40.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.344+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8101404753567644148', time=2024-09-19T16:54:48.641216+0000, chain.objs.size()=1 2024-09-19T15:31:40.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.344+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.460__shadow_.MCAfHmqn8tJQjzMI30I8Vu1ptioVN4n_0 2024-09-19T15:31:40.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.344+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17087869769596677075', time=2024-09-19T16:55:03.433855+0000, chain.objs.size()=1 2024-09-19T15:31:40.351 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.344+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.465__shadow_.lN7SjO1ABXY1YWG4c2-p_V0ViryHAGo_0 2024-09-19T15:31:40.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.348+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2307043980588381187', time=2024-09-19T16:56:03.160796+0000, chain.objs.size()=1 2024-09-19T15:31:40.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.348+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.495__shadow_.dn9bpY7ZjgnJOY4DqhvZH0Bh_rTkmQ4_0 2024-09-19T15:31:40.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.348+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13391841694576856929', time=2024-09-19T16:57:06.485512+0000, chain.objs.size()=6 2024-09-19T15:31:40.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.348+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.1 2024-09-19T15:31:40.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.348+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.2 2024-09-19T15:31:40.352 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.348+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.3 2024-09-19T15:31:40.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.348+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.4 2024-09-19T15:31:40.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.348+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.5 2024-09-19T15:31:40.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.348+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.6 2024-09-19T15:31:40.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.348+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7317947337489857110', time=2024-09-19T16:57:26.377583+0000, chain.objs.size()=1 2024-09-19T15:31:40.353 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.348+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.516__multipart_mymultipartcopy.2~0HC80MTbDZHePxaD6WoSSJ9T3QED4FE.1 2024-09-19T15:31:40.356 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.352+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49901 2024-09-19T15:31:40.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.352+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-19T15:31:40.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.352+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16358516656030136771', time=2024-09-19T16:57:47.078510+0000, chain.objs.size()=1 2024-09-19T15:31:40.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.352+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.518__multipart_mymultipart.2~OzS1Mp7CqFs_lYK2QexRlzxyMNJDvtm.1 2024-09-19T15:31:40.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.352+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17419574523552762391', time=2024-09-19T16:58:58.316034+0000, chain.objs.size()=3 2024-09-19T15:31:40.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.352+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.521__multipart_mymultipart.2~8JHrP-RqV0bqHuzHIXrt9TqPkTAtXZA.1 2024-09-19T15:31:40.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.352+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.521__multipart_mymultipart.2~8JHrP-RqV0bqHuzHIXrt9TqPkTAtXZA.2 2024-09-19T15:31:40.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.352+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.521__multipart_mymultipart.2~8JHrP-RqV0bqHuzHIXrt9TqPkTAtXZA.3 2024-09-19T15:31:40.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.352+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18045258143674605151', time=2024-09-19T17:07:06.913518+0000, chain.objs.size()=1 2024-09-19T15:31:40.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.352+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.558__shadow_.-WYUv1DArzGTPmbhxxyS5h_3sAY6IRy_0 2024-09-19T15:31:40.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.352+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4402060987240700749', time=2024-09-19T17:07:10.527813+0000, chain.objs.size()=1 2024-09-19T15:31:40.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.352+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.559__shadow_.NxXdEjwZokxfwKs3wBNSkzduz5jnPrS_0 2024-09-19T15:31:40.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.352+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16671653893433393261', time=2024-09-19T17:07:48.124368+0000, chain.objs.size()=1 2024-09-19T15:31:40.359 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.352+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:HT0CyTyUZ5arR6zm4s1rOWTc9A.uViS_.CqtQa_VZnmtS4PNGO0ePoctGHWImbXw_0 2024-09-19T15:31:40.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.352+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12033374803512188000', time=2024-09-19T17:08:38.721183+0000, chain.objs.size()=1 2024-09-19T15:31:40.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.352+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.576__shadow:wIVYlhihUTca-eeZZ6XK2QbojWLAZB4_.TauGoHlTaHwfJ4R3x9RLK0Ml9PAVIKk_0 2024-09-19T15:31:40.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.352+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13759971264583734225', time=2024-09-19T17:08:41.657640+0000, chain.objs.size()=1 2024-09-19T15:31:40.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.352+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.576__shadow:gPVw.n.mhV0l3pjQlwQOxHsjVwCEI31_.aAKK3_X6MRGIl9OkngwuYxpdxU9Gkj__0 2024-09-19T15:31:40.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.352+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15226329093813853439', time=2024-09-19T17:08:51.241923+0000, chain.objs.size()=1 2024-09-19T15:31:40.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.352+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:u-.D1SAs2twkYchVfTqWFTA0H2anaHH_.nyoDO8XkATKpv_9OCZsTEYxV4ybl6nA_0 2024-09-19T15:31:40.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.352+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13075554069713863667', time=2024-09-19T17:10:30.277047+0000, chain.objs.size()=1 2024-09-19T15:31:40.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.352+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.579__shadow:oKk0kRnqsa1hOGJX.-3HA8X.xSs-POj_.RupqwSSNDpdeJjYJHlDncxS2x6-soxg_0 2024-09-19T15:31:40.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.352+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.883955418575779373', time=2024-09-19T17:11:29.607187+0000, chain.objs.size()=1 2024-09-19T15:31:40.360 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.352+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.604__shadow_.IUblLYLmeCEEC0p9h0Kq9Zry3Z0mWOR_0 2024-09-19T15:31:40.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.360+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1413055216555533686', time=2024-09-19T17:18:21.603422+0000, chain.objs.size()=1 2024-09-19T15:31:40.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.360+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.636__shadow_.GhoNSvVYZ3_6gtGWEJV2HWTpx9jID9a_0 2024-09-19T15:31:40.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.360+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1830568363382551582', time=2024-09-19T17:18:26.586915+0000, chain.objs.size()=1 2024-09-19T15:31:40.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.360+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.638__shadow_.sDWZWVcLcT-nLoQIcRN-W5Wj2ha0vbi_0 2024-09-19T15:31:40.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.360+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16195406924895812278', time=2024-09-19T17:19:35.284186+0000, chain.objs.size()=1 2024-09-19T15:31:40.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.360+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.655__shadow_.TWFp6EoCMAm70AU2DT3TM-lEdyTYXlA_0 2024-09-19T15:31:40.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.360+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7482639093553016191', time=2024-09-19T17:20:47.014723+0000, chain.objs.size()=1 2024-09-19T15:31:40.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.360+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.666__shadow_.P1JL4TgCICnEyPelSjrtDVFMw91Wucx_0 2024-09-19T15:31:40.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.360+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.409421990042258345', time=2024-09-19T17:25:10.567052+0000, chain.objs.size()=1 2024-09-19T15:31:40.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.360+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.748__shadow_.cqjcUK5VEW8Kt4OZur7UiMxZvvMmysI_0 2024-09-19T15:31:40.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.360+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12643339826279846113', time=2024-09-19T17:28:27.346662+0000, chain.objs.size()=1 2024-09-19T15:31:40.364 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.360+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.774__shadow_.uR2_0_23MJU18WxH9p4SCK8TW85eN77_0 2024-09-19T15:31:40.367 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.360+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:40.369 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.364+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T15:31:40.370 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.364+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:40.371 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.364+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:40.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44832' 2024-09-19T15:31:40.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='_1VR3se1SvyMmK0AP4SaTt4XJGHbLQi_', time=2024-09-19T16:33:16.662830+0000, chain.objs.size()=2 2024-09-19T15:31:40.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.160__shadow_.gjwkM7k8jioIl3aJ0HP-wt3RNDwWoBV_0 2024-09-19T15:31:40.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:dbb1da81-49d0-421a-b677-974869a7f103.4620.160__shadow_.gjwkM7k8jioIl3aJ0HP-wt3RNDwWoBV_1 2024-09-19T15:31:40.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2360363255718981541', time=2024-09-19T16:39:24.740240+0000, chain.objs.size()=1 2024-09-19T15:31:40.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.230__shadow_.3HCGOnLrPtRQIRh_DI4GdrRKu1H_D38_0 2024-09-19T15:31:40.372 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17369701838471914258', time=2024-09-19T16:39:42.415115+0000, chain.objs.size()=1 2024-09-19T15:31:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.237__shadow_.ozf2RiLTQ772IAbZVUTVQAEL8bC9a_E_0 2024-09-19T15:31:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6527851039726258496', time=2024-09-19T16:39:58.915402+0000, chain.objs.size()=1 2024-09-19T15:31:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.243__shadow_.Tia2V6rCa5KZb0Ku0aRzhYBkmyroTFj_0 2024-09-19T15:31:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1444017684813745994', time=2024-09-19T16:40:21.362677+0000, chain.objs.size()=1 2024-09-19T15:31:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.252__shadow_.FcuT6ZpIP0D1TAtsNiRle4Ow5p0FKxt_0 2024-09-19T15:31:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8250044094068651579', time=2024-09-19T16:40:25.930800+0000, chain.objs.size()=1 2024-09-19T15:31:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.254__shadow_.pEiaYGHFlV7IGdLdYgQIoRmawjXYXvk_0 2024-09-19T15:31:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15385285114539230071', time=2024-09-19T16:42:30.038196+0000, chain.objs.size()=1 2024-09-19T15:31:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.-_-YKfHlXGT0miBm2LzVB-3RXo5ZoBf_0 2024-09-19T15:31:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10432001943595853248', time=2024-09-19T16:42:30.836577+0000, chain.objs.size()=1 2024-09-19T15:31:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.0fVP86CeDkugoTQlZg_O0rMVJWKNk-z_0 2024-09-19T15:31:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2752186730805365497', time=2024-09-19T16:42:31.195033+0000, chain.objs.size()=1 2024-09-19T15:31:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.YYwr4qDuylYgsS8we_IwTMKvWJffpQ4_0 2024-09-19T15:31:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8785765615205631610', time=2024-09-19T16:42:32.661579+0000, chain.objs.size()=1 2024-09-19T15:31:40.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.4UDalNPmoqrGLb9rFvvAKWmA8WBOPug_0 2024-09-19T15:31:40.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18025970291044792923', time=2024-09-19T16:42:34.032752+0000, chain.objs.size()=1 2024-09-19T15:31:40.374 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_._URnqf-dnbwq2-8OsF-yEsc-CjJKR70_0 2024-09-19T15:31:40.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.842668818266642760', time=2024-09-19T16:42:34.192331+0000, chain.objs.size()=1 2024-09-19T15:31:40.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.6UpZK5eEigjFxUv7H52En9ameReWr08_0 2024-09-19T15:31:40.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7346501203599840612', time=2024-09-19T16:42:35.586248+0000, chain.objs.size()=1 2024-09-19T15:31:40.375 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.368+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Dq209OFWMj_ACLRcIp06TZMUl28Z0Dt_0 2024-09-19T15:31:40.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.114277778460595515', time=2024-09-19T16:42:35.831267+0000, chain.objs.size()=1 2024-09-19T15:31:40.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.gEr3IvSvuh9MaHbaFhZAwT2oe6E6r9r_0 2024-09-19T15:31:40.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12781580329631670728', time=2024-09-19T16:42:38.085662+0000, chain.objs.size()=1 2024-09-19T15:31:40.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.935M9BxPa1tGxbzFOq-jnBCIigvU6Zj_0 2024-09-19T15:31:40.376 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4586830006362726205', time=2024-09-19T16:42:38.210880+0000, chain.objs.size()=1 2024-09-19T15:31:40.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Vpm_El1UY6Evoqv6-atT5nC5E5nVjqk_0 2024-09-19T15:31:40.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7523293252831210239', time=2024-09-19T16:42:39.225536+0000, chain.objs.size()=1 2024-09-19T15:31:40.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.AraFLX7PRh2i_9icdFCm7anwzzuWkNp_0 2024-09-19T15:31:40.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10562086358339204598', time=2024-09-19T16:42:39.760672+0000, chain.objs.size()=1 2024-09-19T15:31:40.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.zxWs3j7C9Av_JSCt9ZONm3-8A9kmUY0_0 2024-09-19T15:31:40.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6714561768627991510', time=2024-09-19T16:42:39.912874+0000, chain.objs.size()=1 2024-09-19T15:31:40.377 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.3xDYIcTOk_VhjRgUZJI9oGQB5t7ist-_0 2024-09-19T15:31:40.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7028794100264817591', time=2024-09-19T16:42:41.914945+0000, chain.objs.size()=1 2024-09-19T15:31:40.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.T2CZYovR3E3favgfwJJ_of5tzZg_m0m_0 2024-09-19T15:31:40.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13942672064674382700', time=2024-09-19T16:42:42.018601+0000, chain.objs.size()=1 2024-09-19T15:31:40.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ffGq_pYFcLkspC7SLZ4JqIWgAG5oBMG_0 2024-09-19T15:31:40.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15235370528139134526', time=2024-09-19T16:42:43.461712+0000, chain.objs.size()=1 2024-09-19T15:31:40.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.8mC9qESUOws-Nn75Zb7SA39bHiYlO7W_0 2024-09-19T15:31:40.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5015093411608107162', time=2024-09-19T16:42:43.817930+0000, chain.objs.size()=1 2024-09-19T15:31:40.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.IgBURABjj3sCEEmSJ8Ya4pxAmWq-2Qq_0 2024-09-19T15:31:40.378 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12166796006607129681', time=2024-09-19T16:42:44.130541+0000, chain.objs.size()=1 2024-09-19T15:31:40.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.6BCjx9Fkl5zHvRwlZ_Fg8-lxe30PzQX_0 2024-09-19T15:31:40.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14145565178013166571', time=2024-09-19T16:42:45.606767+0000, chain.objs.size()=1 2024-09-19T15:31:40.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Zgd_EDcq-HUKvXRclWZ3XQMOUWezhmp_0 2024-09-19T15:31:40.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13794310370211925926', time=2024-09-19T16:42:45.908354+0000, chain.objs.size()=1 2024-09-19T15:31:40.379 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.372+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.nJfYdsIvmZ4X-yQPAxf7Xx4aFb3Mnkm_0 2024-09-19T15:31:40.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2920086579812933913', time=2024-09-19T16:42:46.666295+0000, chain.objs.size()=1 2024-09-19T15:31:40.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.376+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.nS1V6hYQ88FgGOKD2mNKFhLoXBiU5rz_0 2024-09-19T15:31:40.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13535860754425480007', time=2024-09-19T16:42:47.796774+0000, chain.objs.size()=1 2024-09-19T15:31:40.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.376+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.gzCI2N4SA9c2atY1SRlBq3CPjF4ZvnB_0 2024-09-19T15:31:40.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10483611582878200395', time=2024-09-19T16:42:47.798685+0000, chain.objs.size()=1 2024-09-19T15:31:40.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.376+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.NZRSM-rTdK0OAwsKxRuJTCceDkq7LWl_0 2024-09-19T15:31:40.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9640499462535546204', time=2024-09-19T16:42:49.428324+0000, chain.objs.size()=1 2024-09-19T15:31:40.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.376+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.iac-_5LTncbCMsPA-1VllNyn9w-OtOO_0 2024-09-19T15:31:40.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9502939167067240233', time=2024-09-19T16:42:50.243612+0000, chain.objs.size()=1 2024-09-19T15:31:40.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.376+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ZPqQw46poxvatl7bdgH4hX0AWIbOQd6_0 2024-09-19T15:31:40.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.281542145576579918', time=2024-09-19T16:42:50.468915+0000, chain.objs.size()=1 2024-09-19T15:31:40.382 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.376+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.-KY2cM7Q7DTFKp08VrEDz40NDGLSXSp_0 2024-09-19T15:31:40.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2974689012234274427', time=2024-09-19T16:42:51.482557+0000, chain.objs.size()=1 2024-09-19T15:31:40.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.376+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.8-4EQVVVJEsag2iVp-nElMXRvcfzwGS_0 2024-09-19T15:31:40.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9327591642605683704', time=2024-09-19T16:42:53.716228+0000, chain.objs.size()=1 2024-09-19T15:31:40.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.376+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.iZQGDeKaI8j_rEW8sXfFVe5BSkzUR6z_0 2024-09-19T15:31:40.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15302145409743906386', time=2024-09-19T16:42:54.928976+0000, chain.objs.size()=1 2024-09-19T15:31:40.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.376+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_._Wjcp2uksrdgh-c7057fn-28HN5HmRN_0 2024-09-19T15:31:40.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.376+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15210021707670417552', time=2024-09-19T16:42:56.312098+0000, chain.objs.size()=1 2024-09-19T15:31:40.383 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.376+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.yEWuGzJZ-ExSv8FQR018jRL8QoXkDND_0 2024-09-19T15:31:40.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15767056936727184074', time=2024-09-19T16:42:57.556379+0000, chain.objs.size()=1 2024-09-19T15:31:40.384 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.YY_M6lPiyHf4qneDO-Su7IwWDCsieir_0 2024-09-19T15:31:40.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10959475815295045906', time=2024-09-19T16:42:59.589340+0000, chain.objs.size()=1 2024-09-19T15:31:40.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.HDqKx9hWbso78DItUncXYDxg0Dn3wu3_0 2024-09-19T15:31:40.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2823672695824192715', time=2024-09-19T16:43:04.569438+0000, chain.objs.size()=1 2024-09-19T15:31:40.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.264__shadow_.wtd0cwJNWvW6blXkuSKR6-yWCw1yJaJ_0 2024-09-19T15:31:40.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12922999215259154229', time=2024-09-19T16:43:06.836016+0000, chain.objs.size()=1 2024-09-19T15:31:40.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.265__shadow_.drYNMYYoZ_nDKhwlyR4QVxlaosjfvyb_0 2024-09-19T15:31:40.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14575128922700412140', time=2024-09-19T16:43:26.661787+0000, chain.objs.size()=1 2024-09-19T15:31:40.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.274__shadow_.YaJlbEiqitvp899ObaEYsKn5j3jWtpg_0 2024-09-19T15:31:40.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14492126022273946367', time=2024-09-19T16:44:18.460279+0000, chain.objs.size()=1 2024-09-19T15:31:40.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.zaKS1H8ofBjgmwAF9lQkVgrnUgucYrk_0 2024-09-19T15:31:40.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17131869090330727701', time=2024-09-19T16:44:35.483347+0000, chain.objs.size()=1 2024-09-19T15:31:40.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.300__shadow_.9G6RpS23DnhJ4Fm5ObQFN8gBNlKHfZR_0 2024-09-19T15:31:40.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15945002492204428086', time=2024-09-19T16:44:35.498330+0000, chain.objs.size()=1 2024-09-19T15:31:40.387 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.300__shadow_.2AX-cKQwqK2-cabzxc_TO5UH-zcuZhu_0 2024-09-19T15:31:40.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7138764978519134137', time=2024-09-19T16:47:18.049678+0000, chain.objs.size()=1 2024-09-19T15:31:40.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.V1iAtZ9lslyCTwJl8BtQMcxijCZZ4yF_0 2024-09-19T15:31:40.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9008893392649018103', time=2024-09-19T16:47:18.052177+0000, chain.objs.size()=1 2024-09-19T15:31:40.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.MwmCTeNKKLPRNjnlJjx2Cx57Wz--WY1_0 2024-09-19T15:31:40.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14562123668546239264', time=2024-09-19T16:47:18.054209+0000, chain.objs.size()=1 2024-09-19T15:31:40.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.kj2UMk1QbEj4MKBY1qNxzeIQLoLKS6f_0 2024-09-19T15:31:40.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.380+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16226728788092353207', time=2024-09-19T16:47:19.408632+0000, chain.objs.size()=1 2024-09-19T15:31:40.388 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.380+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.U5wqzhs09zzo4KFJ0cSYNwUQNKd0Cc2_0 2024-09-19T15:31:40.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.384+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4048403452852487513', time=2024-09-19T16:47:21.229018+0000, chain.objs.size()=1 2024-09-19T15:31:40.389 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.384+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.uM8xNNSeWkYAEcJLsJMhgAtj7_E7nE2_0 2024-09-19T15:31:40.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.384+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3245942755872433442', time=2024-09-19T16:47:23.823994+0000, chain.objs.size()=1 2024-09-19T15:31:40.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.384+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.-ZfB5ulvGjeCv6dopWue8GTEmc0XeVt_0 2024-09-19T15:31:40.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.384+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15671003394724471270', time=2024-09-19T16:47:25.230141+0000, chain.objs.size()=1 2024-09-19T15:31:40.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.384+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.LyKnHdYaEJDvLyJDzugwU0IbdUePe7y_0 2024-09-19T15:31:40.390 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.384+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5143555696851680955', time=2024-09-19T16:47:27.259730+0000, chain.objs.size()=1 2024-09-19T15:31:40.391 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.384+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.pn0gnR3Vd-ZaGmriUbNJPURVWzHbOZA_0 2024-09-19T15:31:40.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.384+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2156435940521956088', time=2024-09-19T16:47:28.201158+0000, chain.objs.size()=1 2024-09-19T15:31:40.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.384+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.lAxyHzvc6n0wuRJ08JCFQTKhLgfy49L_0 2024-09-19T15:31:40.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.384+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14379122671514766373', time=2024-09-19T16:47:28.712299+0000, chain.objs.size()=1 2024-09-19T15:31:40.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.384+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.KEMEjM57jhpy-f8vHmIv4eO4n1HQOgL_0 2024-09-19T15:31:40.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.384+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7470915673829321233', time=2024-09-19T16:47:31.171951+0000, chain.objs.size()=1 2024-09-19T15:31:40.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.384+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.qRtx3OQtIcbl2piUhuxESjrM2u_rACW_0 2024-09-19T15:31:40.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.384+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5359947276478694112', time=2024-09-19T16:47:31.977898+0000, chain.objs.size()=1 2024-09-19T15:31:40.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.384+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.YFjKhpmSoniQm6k_Htuu5Wk8uUuTaaE_0 2024-09-19T15:31:40.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9717430795060871223', time=2024-09-19T16:47:31.979816+0000, chain.objs.size()=1 2024-09-19T15:31:40.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.MNNkGxMrs83B8KplnV4WOZHMBqzWczI_0 2024-09-19T15:31:40.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5262547116399371351', time=2024-09-19T16:47:32.817056+0000, chain.objs.size()=1 2024-09-19T15:31:40.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.3kOjMLXQuhzS9klo-O78TeuyQb79w1k_0 2024-09-19T15:31:40.392 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9127648769684400198', time=2024-09-19T16:47:33.298050+0000, chain.objs.size()=1 2024-09-19T15:31:40.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ymQVZDsFXJygrlL8tVVjKizYMAGUwx5_0 2024-09-19T15:31:40.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3320170696714845892', time=2024-09-19T16:47:33.439193+0000, chain.objs.size()=1 2024-09-19T15:31:40.393 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.J7-SA3M-JWF-Rdg3E99JO7LQ9yqQZEA_0 2024-09-19T15:31:40.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16508782199839297906', time=2024-09-19T16:47:36.151607+0000, chain.objs.size()=1 2024-09-19T15:31:40.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.15Hu49KsTzCDNl6tO3tnKmsAn72rRJX_0 2024-09-19T15:31:40.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6899615662275142840', time=2024-09-19T16:47:36.400400+0000, chain.objs.size()=1 2024-09-19T15:31:40.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.HvnLYb8ZpKRhcGC1bTLTtncHoOj3_Du_0 2024-09-19T15:31:40.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14266004796703928342', time=2024-09-19T16:47:36.773834+0000, chain.objs.size()=1 2024-09-19T15:31:40.394 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.LDGsMckN14gCt3AYH_Bxr11koAWcvpn_0 2024-09-19T15:31:40.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.388+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7307161181453938508', time=2024-09-19T16:47:37.684604+0000, chain.objs.size()=1 2024-09-19T15:31:40.395 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.388+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.AcwLmbgfcKcNN0mQYOSAMh1Qb1F9H90_0 2024-09-19T15:31:40.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4818103822112482730', time=2024-09-19T16:47:38.153374+0000, chain.objs.size()=1 2024-09-19T15:31:40.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.SOiyuo_REn9IbzD_yRmp2pJ_ccKxOsE_0 2024-09-19T15:31:40.396 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18199626542934486654', time=2024-09-19T16:47:39.452654+0000, chain.objs.size()=1 2024-09-19T15:31:40.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.RHBCMyDL8Y1MXeSkR4iBqyjpqap8TyZ_0 2024-09-19T15:31:40.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9422674203016007599', time=2024-09-19T16:47:39.525505+0000, chain.objs.size()=1 2024-09-19T15:31:40.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.A84N7Ieo94_uovTFseM7LT2pwX44lph_0 2024-09-19T15:31:40.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10826836285185043019', time=2024-09-19T16:47:39.942479+0000, chain.objs.size()=1 2024-09-19T15:31:40.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.kRrA9W9W-TUMs33RMZ0YlMVfMRA01EI_0 2024-09-19T15:31:40.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6914472295897451929', time=2024-09-19T16:47:41.332400+0000, chain.objs.size()=1 2024-09-19T15:31:40.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.A0_sN8fYtkHOIJgPPUZDziWZfLT5A1V_0 2024-09-19T15:31:40.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15312022906798099398', time=2024-09-19T16:47:41.867434+0000, chain.objs.size()=1 2024-09-19T15:31:40.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.mDmwHx9HfgJQrAeO8FLfI92l8d9Edlp_0 2024-09-19T15:31:40.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1127659353498320901', time=2024-09-19T16:47:45.344133+0000, chain.objs.size()=1 2024-09-19T15:31:40.397 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.rB18gUZ897fQMlLZEAfEkiTlwfuiPNN_0 2024-09-19T15:31:40.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.392+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15575244861301538853', time=2024-09-19T16:47:45.509001+0000, chain.objs.size()=1 2024-09-19T15:31:40.398 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.392+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.TTY0fxh3fxTK_SxZaYgAn4x1y4wHDH4_0 2024-09-19T15:31:40.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11975269245944186393', time=2024-09-19T16:47:45.969828+0000, chain.objs.size()=1 2024-09-19T15:31:40.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.b4cYEN1pZtC3V6hc3VJtNPvdXqXhlA4_0 2024-09-19T15:31:40.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14359090997742999929', time=2024-09-19T16:47:46.474440+0000, chain.objs.size()=1 2024-09-19T15:31:40.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.sMT5ZucvpN7V45-8QIanT3rwk0pIR6j_0 2024-09-19T15:31:40.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15796054083438191283', time=2024-09-19T16:47:48.954626+0000, chain.objs.size()=1 2024-09-19T15:31:40.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.pu3GTxd4vkDreOxdSElJI_CnHPZ-3hI_0 2024-09-19T15:31:40.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14676830223389798924', time=2024-09-19T16:49:34.813537+0000, chain.objs.size()=1 2024-09-19T15:31:40.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.e8ibqvzc_u12DhhsjaPiHrcl3q2zJSK_0 2024-09-19T15:31:40.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13957870140131233330', time=2024-09-19T16:49:34.960051+0000, chain.objs.size()=1 2024-09-19T15:31:40.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.gwu8hiHHsVAfJuctHa7bmW_eHrKg0gu_0 2024-09-19T15:31:40.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8750564399815516741', time=2024-09-19T16:49:35.332447+0000, chain.objs.size()=1 2024-09-19T15:31:40.401 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.MO4jfm-MdaYB645Nc8Oxwtda7rVmFgB_0 2024-09-19T15:31:40.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8954888978973859017', time=2024-09-19T16:49:35.531871+0000, chain.objs.size()=1 2024-09-19T15:31:40.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.LrrF0IbctQAorgndGxvBxezdVlS81jx_0 2024-09-19T15:31:40.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2971390732860824098', time=2024-09-19T16:49:36.757972+0000, chain.objs.size()=1 2024-09-19T15:31:40.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.bV0do4h8Oq6Yf-PNcvViUePbYWLefmg_0 2024-09-19T15:31:40.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18402991865852913401', time=2024-09-19T16:49:37.150447+0000, chain.objs.size()=1 2024-09-19T15:31:40.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.dmgft6VcMl9tRjbjx2YDLmB_TTX48y4_0 2024-09-19T15:31:40.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8778026002097527706', time=2024-09-19T16:49:37.152434+0000, chain.objs.size()=1 2024-09-19T15:31:40.402 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.jncf0mJObY9P7TJtmAnZWvkiVhZqLq9_0 2024-09-19T15:31:40.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.396+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7631588638346975825', time=2024-09-19T16:49:39.339935+0000, chain.objs.size()=1 2024-09-19T15:31:40.403 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.396+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Rivb3-OuKp1svouarOmpnZvDPqwcqvH_0 2024-09-19T15:31:40.405 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.400+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9235223698863173821', time=2024-09-19T16:49:40.131996+0000, chain.objs.size()=1 2024-09-19T15:31:40.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.400+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.4l-w4lSNToHt-attsgJbLs4jEwM-Sb__0 2024-09-19T15:31:40.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.400+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16247520496634494017', time=2024-09-19T16:49:40.243805+0000, chain.objs.size()=1 2024-09-19T15:31:40.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.400+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.fdvtu-a4-ezYtz8WpkHrbumVfxg2UuQ_0 2024-09-19T15:31:40.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.400+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8998083283393029933', time=2024-09-19T16:49:40.724651+0000, chain.objs.size()=1 2024-09-19T15:31:40.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.400+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.XAAjQCTT7xekz3Ybtgi_RFF8wQVn64P_0 2024-09-19T15:31:40.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.400+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7810114064044089768', time=2024-09-19T16:49:41.077513+0000, chain.objs.size()=1 2024-09-19T15:31:40.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.400+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ogiW2p0H5FJvj-Sga3uuvnRngFyLOGD_0 2024-09-19T15:31:40.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.400+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2240893847667929246', time=2024-09-19T16:49:42.556574+0000, chain.objs.size()=1 2024-09-19T15:31:40.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.400+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.xudg73f3pIVg3e-S5tI3PXLQk-l6-zd_0 2024-09-19T15:31:40.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.400+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7996382059957414590', time=2024-09-19T16:49:43.736354+0000, chain.objs.size()=1 2024-09-19T15:31:40.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.400+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.RJuFAvVcLWnHhrs95Vgu3qC04gnozJw_0 2024-09-19T15:31:40.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.400+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1637890667031759344', time=2024-09-19T16:49:44.221466+0000, chain.objs.size()=1 2024-09-19T15:31:40.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.400+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.AixeJxuf36zPwvsnJvtvtkb7c7x2_DI_0 2024-09-19T15:31:40.406 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.400+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4767627178299200171', time=2024-09-19T16:49:45.103464+0000, chain.objs.size()=1 2024-09-19T15:31:40.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.400+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.OyvEOsVC7J3YY6mxTaXdSGotATbALJz_0 2024-09-19T15:31:40.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.400+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13176909240575220011', time=2024-09-19T16:49:45.249908+0000, chain.objs.size()=1 2024-09-19T15:31:40.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.400+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ETHRAaZKsCjEQ7ogi4VmE1TgsTzeGqg_0 2024-09-19T15:31:40.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.400+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9810597608971964330', time=2024-09-19T16:49:45.677924+0000, chain.objs.size()=1 2024-09-19T15:31:40.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.400+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.GKreygmZ-SgiTZBDavmcGRNtYt9uUOc_0 2024-09-19T15:31:40.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.400+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9042951759837973214', time=2024-09-19T16:49:45.962444+0000, chain.objs.size()=1 2024-09-19T15:31:40.407 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.400+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.cJF14i0OI5V28jQ32f5ugiec__wxCW4_0 2024-09-19T15:31:40.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.404+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1929304670326325890', time=2024-09-19T16:49:46.212130+0000, chain.objs.size()=1 2024-09-19T15:31:40.409 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.404+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Knj3kDeQqxqXuwB9KGt3hW_1nZBgV1j_0 2024-09-19T15:31:40.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.404+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8667296182150584177', time=2024-09-19T16:49:46.874710+0000, chain.objs.size()=1 2024-09-19T15:31:40.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.404+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.DgkKgPktfeDhGTQc0E8geeaLg-T0G4C_0 2024-09-19T15:31:40.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.404+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.585109098750464570', time=2024-09-19T16:49:47.926439+0000, chain.objs.size()=1 2024-09-19T15:31:40.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.404+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.4xEfQso72tlyeJCvCE4PzHBC4-ZIIiN_0 2024-09-19T15:31:40.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.404+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11066364873631572711', time=2024-09-19T16:49:49.118405+0000, chain.objs.size()=1 2024-09-19T15:31:40.410 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.404+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.KVIwVaqXskyIndM2EcL3__1CpM-IGru_0 2024-09-19T15:31:40.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.404+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10202435334871354394', time=2024-09-19T16:49:49.718006+0000, chain.objs.size()=1 2024-09-19T15:31:40.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.404+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ksbTLfwSOq9KihG0QnPVJKCAIWsQRuL_0 2024-09-19T15:31:40.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.404+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4462403385575682510', time=2024-09-19T16:49:51.065703+0000, chain.objs.size()=1 2024-09-19T15:31:40.411 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.404+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.roeT34rM2u2C1aHKFWNYzPgW3oKhH6o_0 2024-09-19T15:31:40.413 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44832 2024-09-19T15:31:40.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-19T15:31:40.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16826192282386649691', time=2024-09-19T16:49:52.070116+0000, chain.objs.size()=1 2024-09-19T15:31:40.415 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.PXMIY01sTtl_WWmMEUO5Lkgn2FPvtMb_0 2024-09-19T15:31:40.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1660889258709560958', time=2024-09-19T16:49:52.740650+0000, chain.objs.size()=1 2024-09-19T15:31:40.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.FPwOFssJoRLD52FZMvuPBw_Ua6ZpO04_0 2024-09-19T15:31:40.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.286407924185767131', time=2024-09-19T16:49:52.829010+0000, chain.objs.size()=1 2024-09-19T15:31:40.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.dt7FkYBtlrzpURuqeqSJqAgjF3LCi3c_0 2024-09-19T15:31:40.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10768647703102011173', time=2024-09-19T16:49:53.331645+0000, chain.objs.size()=1 2024-09-19T15:31:40.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.EDRk71R27fCpfJUegCckYHn_6kVk_1A_0 2024-09-19T15:31:40.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10532398873985025138', time=2024-09-19T16:49:54.606018+0000, chain.objs.size()=1 2024-09-19T15:31:40.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.52bW-W3Ehq8FYzX7hCxcL-lvTUDBB1n_0 2024-09-19T15:31:40.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4314122823680373689', time=2024-09-19T16:49:56.122818+0000, chain.objs.size()=1 2024-09-19T15:31:40.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.nZfAh439fD-W_W9lPIXKdXdjcx0GrXb_0 2024-09-19T15:31:40.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17695998795441927008', time=2024-09-19T16:49:56.235737+0000, chain.objs.size()=1 2024-09-19T15:31:40.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.eLj2iTZnsrpSzZWwilGOhfYNIKkJRpc_0 2024-09-19T15:31:40.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.228592448831473117', time=2024-09-19T16:49:58.186989+0000, chain.objs.size()=1 2024-09-19T15:31:40.416 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.KdMnGAeaDN9GspTjttTvE8umHB6uj4g_0 2024-09-19T15:31:40.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7947706926356748678', time=2024-09-19T16:49:58.679912+0000, chain.objs.size()=1 2024-09-19T15:31:40.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.VRtgSjPOpr3zLRnOG5IQC0MCLb4JyIm_0 2024-09-19T15:31:40.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7844500807674830368', time=2024-09-19T16:50:00.450014+0000, chain.objs.size()=1 2024-09-19T15:31:40.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.phcSs9qMrMUnGV3YxLnNvoHqgr2MVun_0 2024-09-19T15:31:40.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10363933321818092038', time=2024-09-19T16:50:00.867461+0000, chain.objs.size()=1 2024-09-19T15:31:40.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.n4kAXQ3ZR7ENQSvBuC2EQObVj1nSJXB_0 2024-09-19T15:31:40.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10743242751266470491', time=2024-09-19T16:50:01.121431+0000, chain.objs.size()=1 2024-09-19T15:31:40.417 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.408+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.0Uc-f4DffQpCVja7-BFzJmqowyht5Zc_0 2024-09-19T15:31:40.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.412+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16566286858863010612', time=2024-09-19T16:50:01.373391+0000, chain.objs.size()=1 2024-09-19T15:31:40.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.412+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.tMaw7gVcNHPv5tD0OhQMD0MuD-XnKPk_0 2024-09-19T15:31:40.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.412+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10282056145424173801', time=2024-09-19T16:50:03.202531+0000, chain.objs.size()=1 2024-09-19T15:31:40.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.412+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.OIJ3ZXftJ0k8PSB6W7ZAKy0UC8M9TDc_0 2024-09-19T15:31:40.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.412+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12290747832223968282', time=2024-09-19T16:50:04.082030+0000, chain.objs.size()=1 2024-09-19T15:31:40.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.412+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_._hotnhtsenyIrUnedLLnbfm3nsSSgh7_0 2024-09-19T15:31:40.419 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.412+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3390585935187743710', time=2024-09-19T16:50:05.271117+0000, chain.objs.size()=1 2024-09-19T15:31:40.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.412+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.PWU3Wnwc5sXQk80irSzWrVVS3jdkGxR_0 2024-09-19T15:31:40.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6136121212839628964', time=2024-09-19T16:50:06.330298+0000, chain.objs.size()=1 2024-09-19T15:31:40.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.EmJrBkkGKZOKBxDwkr1zT541mifWq9J_0 2024-09-19T15:31:40.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7609812936507218185', time=2024-09-19T16:50:49.496402+0000, chain.objs.size()=1 2024-09-19T15:31:40.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.345__shadow_.P-H3dlIrg8J-V1k_F-x-TomoBrnRhc2_0 2024-09-19T15:31:40.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14194098716171447122', time=2024-09-19T16:51:47.883292+0000, chain.objs.size()=1 2024-09-19T15:31:40.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.376__shadow_.Ko3bOHJ1QDoOs5cIPPj-GJBXJUBhv-8_0 2024-09-19T15:31:40.420 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9318039715210200916', time=2024-09-19T16:55:00.588635+0000, chain.objs.size()=1 2024-09-19T15:31:40.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.464__shadow_.bklIA2rD4U0hT8NhNQP-bIQZDbVb8Pq_0 2024-09-19T15:31:40.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2481826145490645512', time=2024-09-19T16:55:02.747722+0000, chain.objs.size()=1 2024-09-19T15:31:40.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.465__shadow_.JVTa1ZcB65jJEqbed8jAYA7D3SpgANC_0 2024-09-19T15:31:40.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13634827756605434646', time=2024-09-19T16:55:32.894639+0000, chain.objs.size()=1 2024-09-19T15:31:40.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.483__shadow_.fkw1bLvEMVk5XXVcPP7fLQLSZm9h3Ig_0 2024-09-19T15:31:40.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.416+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4838201080548083794', time=2024-09-19T16:56:03.171020+0000, chain.objs.size()=1 2024-09-19T15:31:40.421 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.416+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.495__shadow_.dn9bpY7ZjgnJOY4DqhvZH0Bh_rTkmQ4_0 2024-09-19T15:31:40.423 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.420+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17479033794538921085', time=2024-09-19T16:56:09.930797+0000, chain.objs.size()=1 2024-09-19T15:31:40.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.420+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.498__shadow_.iqBVneEthG4QYAjsSySr_y_T-7_7A49_0 2024-09-19T15:31:40.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.420+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12147741076171450739', time=2024-09-19T17:06:14.456892+0000, chain.objs.size()=1 2024-09-19T15:31:40.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.420+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.553__shadow_.kwNCk5P6QRzlvtch00015zCSLXUfzoQ_0 2024-09-19T15:31:40.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.420+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.524612265067872155', time=2024-09-19T17:10:23.958956+0000, chain.objs.size()=4 2024-09-19T15:31:40.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.420+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.578__multipart_testobj.2~Eia11Mr5jeQKCfeM4eI04hXo-OymoPR.1 2024-09-19T15:31:40.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.420+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.578__multipart_testobj.2~Eia11Mr5jeQKCfeM4eI04hXo-OymoPR.2 2024-09-19T15:31:40.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.420+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.578__multipart_testobj.2~Eia11Mr5jeQKCfeM4eI04hXo-OymoPR.3 2024-09-19T15:31:40.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.420+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.578__multipart_testobj.2~Eia11Mr5jeQKCfeM4eI04hXo-OymoPR.4 2024-09-19T15:31:40.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.420+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12379285522075794776', time=2024-09-19T17:10:56.552992+0000, chain.objs.size()=1 2024-09-19T15:31:40.424 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.420+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.587__shadow:.Y3eOFKBugX8VFTlYbUoOGa6fxnHX3B_.dF3DCTggwHjUQ6VVPikTuqh2ZePbNFx_0 2024-09-19T15:31:40.425 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.420+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15202822871683937167', time=2024-09-19T17:18:12.557479+0000, chain.objs.size()=1 2024-09-19T15:31:40.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.420+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.632__shadow_.0MNd9qBwHpgbh0lrKY8cLTH8aT7eBrX_0 2024-09-19T15:31:40.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.420+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3002340298936297976', time=2024-09-19T17:18:17.047590+0000, chain.objs.size()=1 2024-09-19T15:31:40.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.420+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.634__shadow_.wumle2Pd6Jb-w6E34WtPk6lqB_0Ka54_0 2024-09-19T15:31:40.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.420+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10255214311772932248', time=2024-09-19T17:18:35.827489+0000, chain.objs.size()=1 2024-09-19T15:31:40.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.420+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.642__shadow_.0wUJ20-3ZQxULxQbnOfURx32KXO4eWR_0 2024-09-19T15:31:40.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.420+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16443094679318947578', time=2024-09-19T17:20:37.444167+0000, chain.objs.size()=1 2024-09-19T15:31:40.426 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.420+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.663__shadow_.oPlmByHCPR6SfuZjoxiAO1PEcjxN4_K_0 2024-09-19T15:31:40.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.420+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7842065462703460353', time=2024-09-19T17:26:41.779717+0000, chain.objs.size()=1 2024-09-19T15:31:40.427 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.420+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.760__shadow_.aQwThMEt7YUncAIlUq49Y4MxaoRmS3a_0 2024-09-19T15:31:40.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.424+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9007545675052142598', time=2024-09-19T17:27:44.842890+0000, chain.objs.size()=1 2024-09-19T15:31:40.428 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.424+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.768__shadow_.8V8o3IGe-EWH12xxcXKcOeQXuk367x8_0 2024-09-19T15:31:40.431 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.424+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:40.433 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.428+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T15:31:40.434 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.428+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:40.435 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.428+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:40.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.428+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/69547' 2024-09-19T15:31:40.436 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.428+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6568037963035858816', time=2024-09-19T16:35:09.170810+0000, chain.objs.size()=1 2024-09-19T15:31:40.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.428+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.189__shadow_.hYA01PhaU-dGioLQHmbdOE8mnXHXMaM_0 2024-09-19T15:31:40.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.432+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~gYCtsnp22QMQzRNK1d9JtrdN7955-Ej', time=2024-09-19T16:35:55.026368+0000, chain.objs.size()=1 2024-09-19T15:31:40.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.432+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.201__multipart_mymultipart.2~gYCtsnp22QMQzRNK1d9JtrdN7955-Ej.1 2024-09-19T15:31:40.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.432+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4015628829221896231', time=2024-09-19T16:39:27.076102+0000, chain.objs.size()=1 2024-09-19T15:31:40.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.432+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.231__shadow_.UvCqgXHnZo4ut1ATVqDUojxzPM0jxbT_0 2024-09-19T15:31:40.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.432+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16696636807742391312', time=2024-09-19T16:39:58.917526+0000, chain.objs.size()=1 2024-09-19T15:31:40.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.432+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.243__shadow_.shdgON9hxphOPysOxbefTKSn06K3Qh1_0 2024-09-19T15:31:40.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.432+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4216751145899542261', time=2024-09-19T16:40:23.656358+0000, chain.objs.size()=1 2024-09-19T15:31:40.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.432+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.253__shadow_.hfaQ-D9Xwz1K2vunmHUT60PJO6TNM63_0 2024-09-19T15:31:40.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.432+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14360032680986708559', time=2024-09-19T16:40:30.518787+0000, chain.objs.size()=1 2024-09-19T15:31:40.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.432+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.256__shadow_.3wz8-qktf_xyc4IznY7RJFCj_yCi_6B_0 2024-09-19T15:31:40.437 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.432+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9146904025404836339', time=2024-09-19T16:40:32.715038+0000, chain.objs.size()=1 2024-09-19T15:31:40.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.432+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.257__shadow_.jIZ-EWyHuq0WZU2UYUu_7ucX7HCjkzA_0 2024-09-19T15:31:40.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.432+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.414079888460094705', time=2024-09-19T16:42:28.164201+0000, chain.objs.size()=1 2024-09-19T15:31:40.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.432+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.jq_CvHOFFJ3xWc6IeP1OcE1iKDG2jAu_0 2024-09-19T15:31:40.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.432+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7109425825180949442', time=2024-09-19T16:42:29.676041+0000, chain.objs.size()=1 2024-09-19T15:31:40.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.432+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.uNhw9wKUoLROodcOe4IPWihhO1_5LGx_0 2024-09-19T15:31:40.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.432+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14598881287037250366', time=2024-09-19T16:42:30.057254+0000, chain.objs.size()=1 2024-09-19T15:31:40.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.432+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.i6Gr7sUsqAQe3LXQCY__SXNpdniHk03_0 2024-09-19T15:31:40.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.432+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16621304806852034802', time=2024-09-19T16:42:31.222531+0000, chain.objs.size()=1 2024-09-19T15:31:40.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.432+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.9IKylCUfCX3uNiYh_XQjZ_xaOSgQOyF_0 2024-09-19T15:31:40.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.432+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11430698377954961572', time=2024-09-19T16:42:33.982661+0000, chain.objs.size()=1 2024-09-19T15:31:40.438 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.432+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.1yxoLvDFB-50e2z21lnuBu9mwKzAYwb_0 2024-09-19T15:31:40.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.432+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13782253800152938460', time=2024-09-19T16:42:34.914545+0000, chain.objs.size()=1 2024-09-19T15:31:40.439 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.432+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.LzsJPadFUHQ2U11jf7d3FEZkvMNjgVn_0 2024-09-19T15:31:40.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3950176015468589244', time=2024-09-19T16:42:34.916140+0000, chain.objs.size()=1 2024-09-19T15:31:40.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.WXF1RQOvXcWTIsQXToFWyHefQWvBTKL_0 2024-09-19T15:31:40.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1435345285556343851', time=2024-09-19T16:42:35.582155+0000, chain.objs.size()=1 2024-09-19T15:31:40.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.fC3rMxAhTiuYkiMR02LLudsVH5JIE6K_0 2024-09-19T15:31:40.440 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6208431979095009381', time=2024-09-19T16:42:35.824802+0000, chain.objs.size()=1 2024-09-19T15:31:40.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.6I67OFF2KugZFbnLRVnsbkay83YYvun_0 2024-09-19T15:31:40.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9194158385590699333', time=2024-09-19T16:42:36.927328+0000, chain.objs.size()=1 2024-09-19T15:31:40.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.2Pj0xt5rYkKzmaFo7xtKhWRLyZQY5Cp_0 2024-09-19T15:31:40.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16179272384621353808', time=2024-09-19T16:42:37.292829+0000, chain.objs.size()=1 2024-09-19T15:31:40.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.o3pP1xuDL03hHaRovooxD-U7tTOFMlA_0 2024-09-19T15:31:40.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13759142091036275524', time=2024-09-19T16:42:39.504505+0000, chain.objs.size()=1 2024-09-19T15:31:40.441 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.9Kn_JAiES7uUTWGTQ9-AAMyrNID2Shc_0 2024-09-19T15:31:40.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14279862157562897506', time=2024-09-19T16:42:39.658409+0000, chain.objs.size()=1 2024-09-19T15:31:40.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_._3ekDXxh3eoF9_M37vRD8NVJ_iQluuh_0 2024-09-19T15:31:40.443 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4568685560284174709', time=2024-09-19T16:42:39.983265+0000, chain.objs.size()=1 2024-09-19T15:31:40.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.2fTfTKzbZW5SMIiltjLsfxd8n0BdfEN_0 2024-09-19T15:31:40.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1968590764440852258', time=2024-09-19T16:42:42.128394+0000, chain.objs.size()=1 2024-09-19T15:31:40.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.UFkR4YOawLYpcgYyO3BG6EJFR_bwWUz_0 2024-09-19T15:31:40.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10208086776521322075', time=2024-09-19T16:42:43.620590+0000, chain.objs.size()=1 2024-09-19T15:31:40.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.lSDcRSy70h3-igb6SplWx9S4mExbd69_0 2024-09-19T15:31:40.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.791378946096765025', time=2024-09-19T16:42:49.440112+0000, chain.objs.size()=1 2024-09-19T15:31:40.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.cTtC6RylNT59JGtuz0XDh4KFig4y09r_0 2024-09-19T15:31:40.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3550951966055652824', time=2024-09-19T16:42:50.032976+0000, chain.objs.size()=1 2024-09-19T15:31:40.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.991_0lv2rjZOeJJMAxJWi1JtR-rDoVt_0 2024-09-19T15:31:40.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7466110682367939832', time=2024-09-19T16:42:52.259096+0000, chain.objs.size()=1 2024-09-19T15:31:40.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.r5BuWQtiMzIIi7mvY9dFC8IdsB-XJih_0 2024-09-19T15:31:40.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14840389411336466758', time=2024-09-19T16:42:52.296349+0000, chain.objs.size()=1 2024-09-19T15:31:40.444 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.436+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.mCQIMQ2iuvjq_uW5IeGLqwkJcWTg9O-_0 2024-09-19T15:31:40.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.440+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.83225308458397977', time=2024-09-19T16:42:55.488874+0000, chain.objs.size()=1 2024-09-19T15:31:40.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.440+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Gylr2hhAUea8974yixduHK-FbIKRSk1_0 2024-09-19T15:31:40.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.440+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.33653546173544181', time=2024-09-19T16:42:55.940582+0000, chain.objs.size()=1 2024-09-19T15:31:40.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.440+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.3AgNxZagL2GClV0z3eH9MsoqeyLLald_0 2024-09-19T15:31:40.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.440+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3244141215594810453', time=2024-09-19T16:42:56.155823+0000, chain.objs.size()=1 2024-09-19T15:31:40.445 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.440+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.HQvXP25mCc4whmOHY9bkkR9WETD_Rb-_0 2024-09-19T15:31:40.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.440+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7058725952990578439', time=2024-09-19T16:42:56.444845+0000, chain.objs.size()=1 2024-09-19T15:31:40.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.440+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.rI9hskoejoqGbk3X98NWkv-frya3mOH_0 2024-09-19T15:31:40.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.440+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3325340926463271721', time=2024-09-19T16:42:57.406942+0000, chain.objs.size()=1 2024-09-19T15:31:40.447 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.440+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ynC5EDVqjeDrQcDtonbgOhpwGS8FckR_0 2024-09-19T15:31:40.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4923416610821422599', time=2024-09-19T16:42:57.409336+0000, chain.objs.size()=1 2024-09-19T15:31:40.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.WkK-Cn3cdySlY2ywv6PdK3wdFsQi-3O_0 2024-09-19T15:31:40.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10840302068663878098', time=2024-09-19T16:42:57.852897+0000, chain.objs.size()=1 2024-09-19T15:31:40.448 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.D8xj1YEr6N8CI90VHhq0YTEseZRZSaF_0 2024-09-19T15:31:40.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.926564133981390825', time=2024-09-19T16:42:58.957719+0000, chain.objs.size()=1 2024-09-19T15:31:40.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.beT8Kdiud_KYMDvRv7YgFo-Wu4whpam_0 2024-09-19T15:31:40.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2866405311268456808', time=2024-09-19T16:43:04.572070+0000, chain.objs.size()=1 2024-09-19T15:31:40.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.264__shadow_.LmEbbWjg9-QQpNug9g1jsRgHkrx-53w_0 2024-09-19T15:31:40.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9599863024431090312', time=2024-09-19T16:43:28.950285+0000, chain.objs.size()=1 2024-09-19T15:31:40.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.275__shadow_.HxDukYeVNa3q941mwzEsno-zh-c-MMb_0 2024-09-19T15:31:40.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13004828672045506353', time=2024-09-19T16:47:18.870145+0000, chain.objs.size()=1 2024-09-19T15:31:40.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.i_HrrqDT9_sLrIF3r4OUBj5A-UiCD25_0 2024-09-19T15:31:40.449 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9660099849496302140', time=2024-09-19T16:47:20.035062+0000, chain.objs.size()=1 2024-09-19T15:31:40.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.QebflepRU3G7k7aK2MpTeIs8GLUtcvD_0 2024-09-19T15:31:40.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5043397184110318384', time=2024-09-19T16:47:24.512845+0000, chain.objs.size()=1 2024-09-19T15:31:40.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.L03C0qoioykznupuZAEHesrw8XM_1mW_0 2024-09-19T15:31:40.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2377775157180457524', time=2024-09-19T16:47:25.089000+0000, chain.objs.size()=1 2024-09-19T15:31:40.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.EXT5Ur2kVe_er4RvUFK-6sExwwPTHq4_0 2024-09-19T15:31:40.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10718637122722075004', time=2024-09-19T16:47:25.656767+0000, chain.objs.size()=1 2024-09-19T15:31:40.450 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.KVn2bxMBN2uo_rGwz_zcc6SBSLAqYx6_0 2024-09-19T15:31:40.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10047278929647698200', time=2024-09-19T16:47:26.674640+0000, chain.objs.size()=1 2024-09-19T15:31:40.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.OFjSazMHvG2VsY8u1Yg_5fnLU7urX6S_0 2024-09-19T15:31:40.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10655480306930726962', time=2024-09-19T16:47:28.035351+0000, chain.objs.size()=1 2024-09-19T15:31:40.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.0DkctNNFdDL2ZvRPBVr9sG28NypLRQm_0 2024-09-19T15:31:40.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1172897721863807067', time=2024-09-19T16:47:29.295678+0000, chain.objs.size()=1 2024-09-19T15:31:40.451 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.444+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Ftb_6GCuqQJJfYP2iOCC_QRqcje-Bo9_0 2024-09-19T15:31:40.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.448+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16056830621193136153', time=2024-09-19T16:47:31.559861+0000, chain.objs.size()=1 2024-09-19T15:31:40.452 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.448+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.broFH-mek3Ksi0XF1hvp-9OvSLXKjxn_0 2024-09-19T15:31:40.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.448+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8683833529085028663', time=2024-09-19T16:47:32.325001+0000, chain.objs.size()=1 2024-09-19T15:31:40.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.448+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.kCKCm2aWsST1AHlXcVZ2O4a1bsYo844_0 2024-09-19T15:31:40.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.448+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1877464587065351413', time=2024-09-19T16:47:32.465861+0000, chain.objs.size()=1 2024-09-19T15:31:40.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.448+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.i_EcwxY2fwZFGkClvZrG2DkdWCt4pna_0 2024-09-19T15:31:40.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.448+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3285581735851432194', time=2024-09-19T16:47:33.553846+0000, chain.objs.size()=1 2024-09-19T15:31:40.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.448+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.9WKAe0pzmlS1GpGv0tJwFsO8fKVTRs1_0 2024-09-19T15:31:40.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.448+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1382082706585203150', time=2024-09-19T16:47:34.116518+0000, chain.objs.size()=1 2024-09-19T15:31:40.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.448+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.cj1NmS3Ruiqn4xCDmP_8E4kWuUkLd0o_0 2024-09-19T15:31:40.454 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.448+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2221245105439473109', time=2024-09-19T16:47:34.396808+0000, chain.objs.size()=1 2024-09-19T15:31:40.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.448+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.NfS38OmUC5H9RYl1EYlKPcoaexmnlUJ_0 2024-09-19T15:31:40.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.448+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13973684539628143566', time=2024-09-19T16:47:35.508689+0000, chain.objs.size()=1 2024-09-19T15:31:40.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.448+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.DqD-MhccOP5uUHuMavpsOY8Nn7prJZS_0 2024-09-19T15:31:40.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.448+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4297127417046771144', time=2024-09-19T16:47:36.151133+0000, chain.objs.size()=1 2024-09-19T15:31:40.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.448+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ORMthOKs1yISZbE5lc-EiXW5l-9Q61m_0 2024-09-19T15:31:40.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.448+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8527698683999927097', time=2024-09-19T16:47:37.278873+0000, chain.objs.size()=1 2024-09-19T15:31:40.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.448+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.6LuOThdMzE3o1m8_eXJ96Alfa1JSQIm_0 2024-09-19T15:31:40.455 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.452+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4884876191141724580', time=2024-09-19T16:47:37.798887+0000, chain.objs.size()=1 2024-09-19T15:31:40.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.452+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.AJVa79yoPgztzUe1yANCGCiLAHgCXf4_0 2024-09-19T15:31:40.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.452+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1707069144961204067', time=2024-09-19T16:47:40.403652+0000, chain.objs.size()=1 2024-09-19T15:31:40.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.452+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.hHjTEdygRAPH1l_viEUh-hm91358B4R_0 2024-09-19T15:31:40.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.452+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10728600582071901153', time=2024-09-19T16:47:41.094267+0000, chain.objs.size()=1 2024-09-19T15:31:40.456 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.452+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.gEaldlknTFjdQZL61fLQ23A1N8b6paB_0 2024-09-19T15:31:40.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.452+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17957293179308641457', time=2024-09-19T16:47:41.728413+0000, chain.objs.size()=1 2024-09-19T15:31:40.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.452+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.hZEewvMKode83SXxJUELpZEsdLJY3i7_0 2024-09-19T15:31:40.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.452+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3847411145852266103', time=2024-09-19T16:47:42.172839+0000, chain.objs.size()=1 2024-09-19T15:31:40.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.452+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.baJSf0vyo_0a3JmlNPsqG2RCDeGeRNw_0 2024-09-19T15:31:40.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.452+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8538148509252382298', time=2024-09-19T16:47:42.308493+0000, chain.objs.size()=1 2024-09-19T15:31:40.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.452+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.jce_f3lsiaNz_Nm0Y2JoPXEjr6lyV-4_0 2024-09-19T15:31:40.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.452+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3152952889556182982', time=2024-09-19T16:47:42.434750+0000, chain.objs.size()=1 2024-09-19T15:31:40.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.452+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.RfdB_XGFKAZ7QvsDEknv7p58Tm_mmkG_0 2024-09-19T15:31:40.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.452+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6050690110028316660', time=2024-09-19T16:47:42.659048+0000, chain.objs.size()=1 2024-09-19T15:31:40.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.452+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.TItovWt38gAk1iIo-0L3MckVnnmEsFQ_0 2024-09-19T15:31:40.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.452+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12692917927986037165', time=2024-09-19T16:47:43.504121+0000, chain.objs.size()=1 2024-09-19T15:31:40.458 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.452+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.VNXDvP1rQmMSK0piE1KCSlOgz7y8Htu_0 2024-09-19T15:31:40.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.452+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17069762887596049455', time=2024-09-19T16:47:45.128003+0000, chain.objs.size()=1 2024-09-19T15:31:40.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.452+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.BKKGUX6Yg6waobyzueyDiyULtpODwiI_0 2024-09-19T15:31:40.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.452+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12616072662983867480', time=2024-09-19T16:47:45.859763+0000, chain.objs.size()=1 2024-09-19T15:31:40.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.452+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.b9f5KBNujIHPSYfZ0bZHhzHy_aHAbUk_0 2024-09-19T15:31:40.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.452+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17669705031823847362', time=2024-09-19T16:47:46.006370+0000, chain.objs.size()=1 2024-09-19T15:31:40.459 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.452+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.m4c4tVQV0EO6OClWXbw2sERWtPQppcr_0 2024-09-19T15:31:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.456+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16851925273506404741', time=2024-09-19T16:47:46.661521+0000, chain.objs.size()=1 2024-09-19T15:31:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.456+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.dRmfgwgX6DBKej9sjgyr2Pa2Q99UKlG_0 2024-09-19T15:31:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.456+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11147103786737815151', time=2024-09-19T16:49:35.337248+0000, chain.objs.size()=1 2024-09-19T15:31:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.456+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.jsJrwHLOLLXnKainOcHViLxfub3sLO8_0 2024-09-19T15:31:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.456+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7738351844566955018', time=2024-09-19T16:49:35.340769+0000, chain.objs.size()=1 2024-09-19T15:31:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.456+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.GDQssmmqhApiQgsjp1sRy6zl_N0fHi8_0 2024-09-19T15:31:40.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2627145199033577076', time=2024-09-19T16:49:37.788624+0000, chain.objs.size()=1 2024-09-19T15:31:40.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.8NWCljvgTv5_jnNTRA_xpf9Fz8u7GEb_0 2024-09-19T15:31:40.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16862988555885814793', time=2024-09-19T16:49:38.096197+0000, chain.objs.size()=1 2024-09-19T15:31:40.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.8oE5bmbBaiMS3iAQrgukCLTN70lfg-P_0 2024-09-19T15:31:40.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5703915164267356864', time=2024-09-19T16:49:41.581992+0000, chain.objs.size()=1 2024-09-19T15:31:40.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.LFTj8wgF-A5VVJeXNAsgDfU0bHjcuYo_0 2024-09-19T15:31:40.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14546021160388554548', time=2024-09-19T16:49:43.578440+0000, chain.objs.size()=1 2024-09-19T15:31:40.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.CrHG3Ly6HlMjrLx3Ds2V1Oufa_VYvo2_0 2024-09-19T15:31:40.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14036664650492200150', time=2024-09-19T16:49:43.706118+0000, chain.objs.size()=1 2024-09-19T15:31:40.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.NEBrBR6hVXcIxQLmMxjPr7VfQY3gLqB_0 2024-09-19T15:31:40.464 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.529895775465227346', time=2024-09-19T16:49:44.176003+0000, chain.objs.size()=1 2024-09-19T15:31:40.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.g4y6m_aQtsECA95DncDvE0P6k5E6Tn9_0 2024-09-19T15:31:40.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11921160281209456196', time=2024-09-19T16:49:46.062822+0000, chain.objs.size()=1 2024-09-19T15:31:40.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.R99NvzSs5pAZc38BqV9ixWcpTmckt1g_0 2024-09-19T15:31:40.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2492516153636282398', time=2024-09-19T16:49:46.379102+0000, chain.objs.size()=1 2024-09-19T15:31:40.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Mj5Kdo8InzYGJeB5CgkDsU1XBaIvBZh_0 2024-09-19T15:31:40.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2874115877285416628', time=2024-09-19T16:49:46.543226+0000, chain.objs.size()=1 2024-09-19T15:31:40.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.AC5ytKcA4WJN0l4dxycOG07nsEc-p-l_0 2024-09-19T15:31:40.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18401885301819424337', time=2024-09-19T16:49:48.320857+0000, chain.objs.size()=1 2024-09-19T15:31:40.465 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.JStvd1ywsWpE6cxpHIOYZCN4nFSZPYy_0 2024-09-19T15:31:40.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9861516693713593473', time=2024-09-19T16:49:48.985489+0000, chain.objs.size()=1 2024-09-19T15:31:40.466 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.c055TF0iAziFu6ptX3FUaLQPmiPbNoL_0 2024-09-19T15:31:40.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7458758306541554500', time=2024-09-19T16:49:50.473623+0000, chain.objs.size()=1 2024-09-19T15:31:40.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.qqsdTFGYl24ZFb_W0LDx1hvfPI9ab2f_0 2024-09-19T15:31:40.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13865353997382445111', time=2024-09-19T16:49:50.954289+0000, chain.objs.size()=1 2024-09-19T15:31:40.467 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.460+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.-_l-0WX7emJVG-PERmVXGQoSYXaOIC0_0 2024-09-19T15:31:40.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5573250168481502446', time=2024-09-19T16:49:54.295466+0000, chain.objs.size()=1 2024-09-19T15:31:40.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.8gDB_luAcaUWyNl-Y19AxG4fdh84TW3_0 2024-09-19T15:31:40.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9539983987973851455', time=2024-09-19T16:49:54.514378+0000, chain.objs.size()=1 2024-09-19T15:31:40.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.V5-ygcNQfxh6CEMpCTW_9fFzCC_rT9c_0 2024-09-19T15:31:40.468 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2079874955187269990', time=2024-09-19T16:49:55.052639+0000, chain.objs.size()=1 2024-09-19T15:31:40.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.RbLFbwzgBU_rop7E8A0bRiQkEK5Bypv_0 2024-09-19T15:31:40.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.323618098332275253', time=2024-09-19T16:49:55.188547+0000, chain.objs.size()=1 2024-09-19T15:31:40.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.k8QxFv3O_LrA6-GBCYRVRgIO8bvlATG_0 2024-09-19T15:31:40.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3960384405835098661', time=2024-09-19T16:49:58.688423+0000, chain.objs.size()=1 2024-09-19T15:31:40.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.vcGMk5MGzQmnDUE3CRThvNojWO3Pef6_0 2024-09-19T15:31:40.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16478690695487359679', time=2024-09-19T16:49:58.873391+0000, chain.objs.size()=1 2024-09-19T15:31:40.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.6GguYx3nnyHyXBqqx0eW85bkfN3Ecs-_0 2024-09-19T15:31:40.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18038812668027091208', time=2024-09-19T16:50:01.766965+0000, chain.objs.size()=1 2024-09-19T15:31:40.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.dqXotLLWT7T9eUctdiF5yCf3V7Xm2SX_0 2024-09-19T15:31:40.469 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12660613521054668375', time=2024-09-19T16:50:03.099796+0000, chain.objs.size()=1 2024-09-19T15:31:40.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Lj_KJYB8HjmG4hWyvtzlzchq_YRhaP-_0 2024-09-19T15:31:40.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15294735616197909193', time=2024-09-19T16:50:04.448344+0000, chain.objs.size()=1 2024-09-19T15:31:40.470 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.gX2IHTPCwK3AP_ReUScrBW0sSesFBlO_0 2024-09-19T15:31:40.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.464+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9439344381443488753', time=2024-09-19T16:50:05.360634+0000, chain.objs.size()=1 2024-09-19T15:31:40.471 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.464+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.wMqk44txEEHegwt0AU6p98Lja2-Ep-1_0 2024-09-19T15:31:40.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.468+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13178501947171291015', time=2024-09-19T16:51:38.826458+0000, chain.objs.size()=1 2024-09-19T15:31:40.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.372__shadow_.28OyIVAPmeah_BbOhMlztcCApUg0_Ic_0 2024-09-19T15:31:40.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.468+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12450845852887825737', time=2024-09-19T16:55:06.516189+0000, chain.objs.size()=1 2024-09-19T15:31:40.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.466__shadow_.axOiuw_JbE36HEdhX0HoNUum4TMY8cw_0 2024-09-19T15:31:40.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.468+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8680908923380435758', time=2024-09-19T16:55:06.518726+0000, chain.objs.size()=1 2024-09-19T15:31:40.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.466__shadow_.lr7FDinPa0xCi739JFf3hDjyiFl-dU2_0 2024-09-19T15:31:40.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.468+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7892056099246706317', time=2024-09-19T16:57:07.805662+0000, chain.objs.size()=6 2024-09-19T15:31:40.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.1 2024-09-19T15:31:40.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.2 2024-09-19T15:31:40.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.3 2024-09-19T15:31:40.473 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.4 2024-09-19T15:31:40.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.5 2024-09-19T15:31:40.474 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.507__multipart_srcmultipart.2~VX9FHNuFlsJxmp_XSUWlwdPAzSou_wW.6 2024-09-19T15:31:40.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.468+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12095044041444658006', time=2024-09-19T17:02:52.193253+0000, chain.objs.size()=2 2024-09-19T15:31:40.475 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.468+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.523__multipart_mymultipart.2~MLV8_fORciFj-6jgxT2d605vcpG71J9.1 2024-09-19T15:31:40.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.523__multipart_mymultipart.2~MLV8_fORciFj-6jgxT2d605vcpG71J9.2 2024-09-19T15:31:40.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.472+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12062927521475439445', time=2024-09-19T17:05:48.973725+0000, chain.objs.size()=1 2024-09-19T15:31:40.477 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.550__shadow_.a7rdfgALUQGaeStgJY3Xts2bc-Oo32F_0 2024-09-19T15:31:40.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.472+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1974441801225439924', time=2024-09-19T17:07:55.163117+0000, chain.objs.size()=1 2024-09-19T15:31:40.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:DF1pYviA.1qXhm7HRpS1zyYrZ-5qJJf_.nyK4MB6X3MPn3Yy4UuzLeguBviCnE1N_0 2024-09-19T15:31:40.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.472+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12030190790490358154', time=2024-09-19T17:08:02.073141+0000, chain.objs.size()=1 2024-09-19T15:31:40.478 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.472+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:k0mpDnvtbLQnudvfuYn0YKBEMSrygkT_.UL6orYRUB3t3srM59XtOJ2iM8urLeWA_0 2024-09-19T15:31:40.481 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.476+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/69547 2024-09-19T15:31:40.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.476+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-19T15:31:40.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.476+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1734946524805937168', time=2024-09-19T17:08:07.764605+0000, chain.objs.size()=1 2024-09-19T15:31:40.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.476+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.570__shadow:wfxcwPHk05n7mZC.AAgNUr5CkfPt3Nq_.dn5e-rWwBBuYgwQJnxEz5wax_Ed8git_0 2024-09-19T15:31:40.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.476+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17649875324027184209', time=2024-09-19T17:08:47.260366+0000, chain.objs.size()=1 2024-09-19T15:31:40.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.476+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:GRPuBz4MX6xiqSGLl6iSwG.5mLcq3w7_.yivWthcJpxSkhNss1TKfq7wTliA46dr_0 2024-09-19T15:31:40.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.476+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5687451742888506450', time=2024-09-19T17:08:52.321816+0000, chain.objs.size()=1 2024-09-19T15:31:40.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.476+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:0azmAdXVJvOgtjPK03MUVAvUEA0tsOY_.GD_v1kGJwf0npQze1JmO3DAHKP8Ox7R_0 2024-09-19T15:31:40.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.476+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13224068268920973429', time=2024-09-19T17:09:00.535287+0000, chain.objs.size()=1 2024-09-19T15:31:40.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.476+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:tao--GVemD9HZ0jTpLT14Z306wG0bOX_.iBNnT8yafU1tepxYZpMVWlAdQa99H9S_0 2024-09-19T15:31:40.484 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.476+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15783602074793272044', time=2024-09-19T17:09:10.965264+0000, chain.objs.size()=1 2024-09-19T15:31:40.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.476+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:ioCHLEwT4zqV7CIUVQoIEL1h2V5rB8a_.7dcW3MyhFpLdxLdjTcceN2iemUIi8Si_0 2024-09-19T15:31:40.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.476+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='2~Oc5vQxw-vLKpp2-4fVzpOzbTq2_viri', time=2024-09-19T17:17:57.653728+0000, chain.objs.size()=6 2024-09-19T15:31:40.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.476+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.625__multipart_multipart_enc.2~Oc5vQxw-vLKpp2-4fVzpOzbTq2_viri.1 2024-09-19T15:31:40.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.476+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.625__multipart_multipart_enc.2~Oc5vQxw-vLKpp2-4fVzpOzbTq2_viri.2 2024-09-19T15:31:40.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.476+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.625__multipart_multipart_enc.2~Oc5vQxw-vLKpp2-4fVzpOzbTq2_viri.3 2024-09-19T15:31:40.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.476+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.625__multipart_multipart_enc.2~Oc5vQxw-vLKpp2-4fVzpOzbTq2_viri.4 2024-09-19T15:31:40.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.476+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.625__multipart_multipart_enc.2~Oc5vQxw-vLKpp2-4fVzpOzbTq2_viri.5 2024-09-19T15:31:40.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.476+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.625__multipart_multipart_enc.2~Oc5vQxw-vLKpp2-4fVzpOzbTq2_viri.6 2024-09-19T15:31:40.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.476+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18261507395561595280', time=2024-09-19T17:18:14.672438+0000, chain.objs.size()=1 2024-09-19T15:31:40.485 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.476+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.633__shadow_.EIu9gDbQj-J13LYKXJvOK1OWu0VdW6G_0 2024-09-19T15:31:40.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.480+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.205371305239208948', time=2024-09-19T17:18:19.481545+0000, chain.objs.size()=1 2024-09-19T15:31:40.486 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.480+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.635__shadow_.5EZCCAAewgnZMTVtYbdnuk0OfCOmrzR_0 2024-09-19T15:31:40.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.484+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9044669008575315500', time=2024-09-19T17:28:10.790360+0000, chain.objs.size()=1 2024-09-19T15:31:40.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.772__shadow_.T1G5Qep0phNTFmEFyrIBf9Wc1gsOaGA_0 2024-09-19T15:31:40.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.484+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17044378830939916463', time=2024-09-19T17:28:49.006940+0000, chain.objs.size()=1 2024-09-19T15:31:40.488 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.778__shadow_.kwyUYT4ekN64Y4NC-5fPAjTFGYAyTQ3_0 2024-09-19T15:31:40.490 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.484+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:40.493 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T15:31:40.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:40.494 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:40.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45708' 2024-09-19T15:31:40.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13613632960080748477', time=2024-09-19T16:32:31.356066+0000, chain.objs.size()=1 2024-09-19T15:31:40.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.158__shadow_.zlIqaWb64jGcFmFpkbJljaykVUXfMMo_0 2024-09-19T15:31:40.495 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.181214465634515919', time=2024-09-19T16:33:47.464097+0000, chain.objs.size()=3 2024-09-19T15:31:40.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.161__multipart_foo-FROZEN.2~C99lAifMi_PKe85Gz2Cr0CYAfzbAvX4.1 2024-09-19T15:31:40.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.161__multipart_foo-FROZEN.2~C99lAifMi_PKe85Gz2Cr0CYAfzbAvX4.2 2024-09-19T15:31:40.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:dbb1da81-49d0-421a-b677-974869a7f103.4620.161__multipart_foo-FROZEN.2~C99lAifMi_PKe85Gz2Cr0CYAfzbAvX4.3 2024-09-19T15:31:40.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11915526418998196773', time=2024-09-19T16:34:13.631699+0000, chain.objs.size()=1 2024-09-19T15:31:40.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.166__shadow_.6xgv7UaxYtudPkL-r0DCvvEFaHc_zLf_0 2024-09-19T15:31:40.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11788191251514947707', time=2024-09-19T16:39:34.060260+0000, chain.objs.size()=1 2024-09-19T15:31:40.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.234__shadow_.DVVvET8Fn9DPSqzzqjbQ5glnZSgdHRL_0 2024-09-19T15:31:40.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11901884896967274086', time=2024-09-19T16:39:46.358699+0000, chain.objs.size()=1 2024-09-19T15:31:40.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.238__shadow_.sIKZOKf5-K5U_-HmHRYJySYEvfOIE7q_0 2024-09-19T15:31:40.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1581757653054952663', time=2024-09-19T16:40:14.379476+0000, chain.objs.size()=1 2024-09-19T15:31:40.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.249__shadow_.bXFz08HpvaJJyeAD44lsCmryJnKFed0_0 2024-09-19T15:31:40.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15841667817702875031', time=2024-09-19T16:40:39.537460+0000, chain.objs.size()=1 2024-09-19T15:31:40.496 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.260__shadow_.aphpbwLkXF9bAwNO5dt3kUH-Tpa5T6y_0 2024-09-19T15:31:40.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15675608069491080478', time=2024-09-19T16:42:28.037156+0000, chain.objs.size()=1 2024-09-19T15:31:40.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.h6_7nSC0NXY1LVO_Rnqsl-Ds3n5qmQd_0 2024-09-19T15:31:40.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16828341717737675486', time=2024-09-19T16:42:30.858494+0000, chain.objs.size()=1 2024-09-19T15:31:40.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.oYv0U2-ub4dFCfuerkOojT2TW9k3KXH_0 2024-09-19T15:31:40.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10055624453566148307', time=2024-09-19T16:42:32.561279+0000, chain.objs.size()=1 2024-09-19T15:31:40.497 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.488+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.C98z19IkcD7ym9FzZ3ypf_ElyBiIj7q_0 2024-09-19T15:31:40.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.492+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1290890719058320120', time=2024-09-19T16:42:32.691114+0000, chain.objs.size()=1 2024-09-19T15:31:40.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.492+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ioYS4dHWEUTQYXkIwRomzzXP6v8rrX__0 2024-09-19T15:31:40.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.492+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4193453675846177566', time=2024-09-19T16:42:33.453757+0000, chain.objs.size()=1 2024-09-19T15:31:40.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.492+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.7DimrBuXljkEqrtaiSJmyv8l8qMpzQj_0 2024-09-19T15:31:40.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.492+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15599541473120715840', time=2024-09-19T16:42:33.591234+0000, chain.objs.size()=1 2024-09-19T15:31:40.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.492+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.mgW4cCidaajDDrQczh9L1OLeHTEBU5y_0 2024-09-19T15:31:40.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.492+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3267514443021655629', time=2024-09-19T16:42:33.881728+0000, chain.objs.size()=1 2024-09-19T15:31:40.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.492+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.98H3eTGbbKMVVc-258H7ie4RPL3kF7r_0 2024-09-19T15:31:40.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.496+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15702449997632341963', time=2024-09-19T16:42:35.302732+0000, chain.objs.size()=1 2024-09-19T15:31:40.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.496+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.J8AADOH3n__utb30z_Rdcyk4BbXhoXd_0 2024-09-19T15:31:40.500 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.496+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13103744409094630170', time=2024-09-19T16:42:37.639344+0000, chain.objs.size()=1 2024-09-19T15:31:40.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.496+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.xGGXpLdFI8JWLo1wm_r3feDgfTjKsI1_0 2024-09-19T15:31:40.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.496+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17210827317536229429', time=2024-09-19T16:42:41.142739+0000, chain.objs.size()=1 2024-09-19T15:31:40.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.496+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Tk8IIAP-DoVVO_dR5ihMun40dVRBWXf_0 2024-09-19T15:31:40.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.496+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5344387731598077263', time=2024-09-19T16:42:41.600382+0000, chain.objs.size()=1 2024-09-19T15:31:40.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.496+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.zXTByWltp51M8pDY90hjtWIVML1LUak_0 2024-09-19T15:31:40.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.496+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17323994230519928521', time=2024-09-19T16:42:43.004112+0000, chain.objs.size()=1 2024-09-19T15:31:40.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.496+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.6ZCe2K2GA_OKIiqHeecHFZ2LRAkNo-X_0 2024-09-19T15:31:40.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.496+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14968733218980048541', time=2024-09-19T16:42:43.296016+0000, chain.objs.size()=1 2024-09-19T15:31:40.501 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.496+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.AOUPOag5k69GhS5Eu0dMQwdDUClWTLE_0 2024-09-19T15:31:40.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.496+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16206615154965781212', time=2024-09-19T16:42:46.774810+0000, chain.objs.size()=1 2024-09-19T15:31:40.502 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.496+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.yYNxMEGKmvWgMV79TMVv-qAHDm-IM3J_0 2024-09-19T15:31:40.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.496+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4521259975592176313', time=2024-09-19T16:42:48.321470+0000, chain.objs.size()=1 2024-09-19T15:31:40.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.496+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.2mNAcxvIJ21KUUSG7aS0EVs5jFe9oW7_0 2024-09-19T15:31:40.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.496+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1076451071313170801', time=2024-09-19T16:42:48.323371+0000, chain.objs.size()=1 2024-09-19T15:31:40.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.496+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Ll5yDYxHfIZY8zGcYJ7TmSpVaRVInYx_0 2024-09-19T15:31:40.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.496+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5959197345735453291', time=2024-09-19T16:42:49.269731+0000, chain.objs.size()=1 2024-09-19T15:31:40.503 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.496+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.uEfAWX4ko7RtwgH1rUzrblARo8KPoWu_0 2024-09-19T15:31:40.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.500+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7838530427847568133', time=2024-09-19T16:42:50.790737+0000, chain.objs.size()=1 2024-09-19T15:31:40.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.500+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Oh3_U8Vv5ACuBEkZh_8WzK8qGMU2s7g_0 2024-09-19T15:31:40.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.500+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6359319260792855329', time=2024-09-19T16:42:51.214575+0000, chain.objs.size()=1 2024-09-19T15:31:40.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.500+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.d09b3vQ22l4jzfAz5mnyjltvfivaiT__0 2024-09-19T15:31:40.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.500+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15521102167924693838', time=2024-09-19T16:42:53.353571+0000, chain.objs.size()=1 2024-09-19T15:31:40.504 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.500+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.NDJMlyCtlN4sRRascbEbZwjKUPflNUR_0 2024-09-19T15:31:40.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.500+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10984371672083162984', time=2024-09-19T16:42:53.825553+0000, chain.objs.size()=1 2024-09-19T15:31:40.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.500+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.86aQNed9nHWx1yZggiHJo30kSwjR7zi_0 2024-09-19T15:31:40.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.500+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.601222157577891681', time=2024-09-19T16:42:54.517698+0000, chain.objs.size()=1 2024-09-19T15:31:40.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.500+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.JJLR-wTe8dMm372hyjGNTkj5UX3CXFm_0 2024-09-19T15:31:40.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.500+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3196032002051054978', time=2024-09-19T16:42:57.404386+0000, chain.objs.size()=1 2024-09-19T15:31:40.505 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.500+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.6sn1IKV99SRAO1fFt3KrWfHKlIrdRr0_0 2024-09-19T15:31:40.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.500+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15698543694308099679', time=2024-09-19T16:42:57.552721+0000, chain.objs.size()=1 2024-09-19T15:31:40.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.500+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.aU5BXMQcciUp3SlX_wZQaGle7r6C_eL_0 2024-09-19T15:31:40.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.500+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5496143707294218471', time=2024-09-19T16:42:58.403879+0000, chain.objs.size()=1 2024-09-19T15:31:40.506 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.500+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.2cwdblL_SWzZainbLX8SdD2K5Y3ED8x_0 2024-09-19T15:31:40.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.500+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7554303981867102816', time=2024-09-19T16:42:59.092745+0000, chain.objs.size()=1 2024-09-19T15:31:40.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.500+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.R3D1_iF2FutoXoR02wKAthMxyDhPle5_0 2024-09-19T15:31:40.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.500+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8530559186816014758', time=2024-09-19T16:42:59.152253+0000, chain.objs.size()=1 2024-09-19T15:31:40.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.500+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.FWZm13XrGxlqGBigIawNriXOb0d9Ene_0 2024-09-19T15:31:40.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.500+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10381939361492447684', time=2024-09-19T16:42:59.605924+0000, chain.objs.size()=1 2024-09-19T15:31:40.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.500+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.LN0SMykkulKQDWjDZ8dczMs76QFoydz_0 2024-09-19T15:31:40.507 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.500+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7285078047744313488', time=2024-09-19T16:43:45.159069+0000, chain.objs.size()=1 2024-09-19T15:31:40.508 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.500+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.282__shadow_.Ym1OzIYAOQBCmUOwX-LMCe_Cp5EVraX_0 2024-09-19T15:31:40.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11386278074117090738', time=2024-09-19T16:44:12.902304+0000, chain.objs.size()=1 2024-09-19T15:31:40.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_.jomcatYtCPBd1X0un0deEF2YyXGehkk_0 2024-09-19T15:31:40.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14313283204599864030', time=2024-09-19T16:44:12.922419+0000, chain.objs.size()=1 2024-09-19T15:31:40.509 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.292__shadow_.oN4_7qFSki5ddfYicGIAujwhpEbzuL5_0 2024-09-19T15:31:40.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.986574215211272648', time=2024-09-19T16:44:18.358913+0000, chain.objs.size()=1 2024-09-19T15:31:40.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.mZhLF_lZR5iLwCKMI5rTX5gGSU_OJ4m_0 2024-09-19T15:31:40.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2868327639856576041', time=2024-09-19T16:44:18.360825+0000, chain.objs.size()=1 2024-09-19T15:31:40.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.zGASq_H8engH2jY9QcdBaWWtEnXTBK3_0 2024-09-19T15:31:40.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17968295865667752402', time=2024-09-19T16:44:18.485455+0000, chain.objs.size()=1 2024-09-19T15:31:40.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.P15Z0bmvj3lFpGG3dd8i3BuihrutCpj_0 2024-09-19T15:31:40.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11774054941084619302', time=2024-09-19T16:44:47.126283+0000, chain.objs.size()=1 2024-09-19T15:31:40.510 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.305__shadow_.guoGRUF1vQ48UJH7NSkeYn_1qtlbTmA_0 2024-09-19T15:31:40.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4752542344836237137', time=2024-09-19T16:45:17.375993+0000, chain.objs.size()=1 2024-09-19T15:31:40.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.315__shadow_.chomHu51C4j4ZzArp4c30Ks4_SldbL8_0 2024-09-19T15:31:40.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10998150563275579528', time=2024-09-19T16:47:19.337097+0000, chain.objs.size()=1 2024-09-19T15:31:40.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.-adpBPrQUPPUf0Y7KgHXgna8MWH_pa4_0 2024-09-19T15:31:40.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10106589267182423632', time=2024-09-19T16:47:20.790960+0000, chain.objs.size()=1 2024-09-19T15:31:40.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.u90JO35XD_eb-OSdMY-bNAbXrw22g4J_0 2024-09-19T15:31:40.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.504+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10122273858866935024', time=2024-09-19T16:47:22.759540+0000, chain.objs.size()=1 2024-09-19T15:31:40.511 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.504+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.qe5rOeMsR5lN6VJEt9GApxW7a2D8W4d_0 2024-09-19T15:31:40.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.508+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4686051510968899940', time=2024-09-19T16:47:23.930302+0000, chain.objs.size()=1 2024-09-19T15:31:40.512 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.508+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.yY_bpz6BoDj6-ED8hZ146H4XInuwzAE_0 2024-09-19T15:31:40.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.508+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2141459757696928942', time=2024-09-19T16:47:24.763770+0000, chain.objs.size()=1 2024-09-19T15:31:40.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.508+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.BirhaJchAFb-uGO8276wV7y-Jdg-Vi-_0 2024-09-19T15:31:40.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.508+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3803631340467054296', time=2024-09-19T16:47:25.330496+0000, chain.objs.size()=1 2024-09-19T15:31:40.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.508+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.BIlrO1GG3QSJKEOkr_CmFYEuo6L1vx9_0 2024-09-19T15:31:40.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.508+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.423003427157989739', time=2024-09-19T16:47:26.831101+0000, chain.objs.size()=1 2024-09-19T15:31:40.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.508+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.zaUeGPma-gaSMubyug1xNfWV9ieI3Ew_0 2024-09-19T15:31:40.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.508+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.483714551320785212', time=2024-09-19T16:47:27.199925+0000, chain.objs.size()=1 2024-09-19T15:31:40.514 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.508+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.PYhPqtpef3SELd9G-xuPbYBAURll7qU_0 2024-09-19T15:31:40.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.508+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5336939787706532525', time=2024-09-19T16:47:27.586336+0000, chain.objs.size()=1 2024-09-19T15:31:40.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.508+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.8snwVBXmqnheGWn_aU34VZq7NqbgffG_0 2024-09-19T15:31:40.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.508+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15046314625662552514', time=2024-09-19T16:47:28.204571+0000, chain.objs.size()=1 2024-09-19T15:31:40.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.508+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.YZvrSGeodvB5vtMbLSoB8Hwccnb_7Bh_0 2024-09-19T15:31:40.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.508+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3331385083668630383', time=2024-09-19T16:47:29.867124+0000, chain.objs.size()=1 2024-09-19T15:31:40.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.508+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.R8lj8ZNq5pRgoXanrSiNAbkG2FQK6o-_0 2024-09-19T15:31:40.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.508+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5038209183795627174', time=2024-09-19T16:47:31.464970+0000, chain.objs.size()=1 2024-09-19T15:31:40.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.508+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.HyLQ0v7JaKN4Bb5uoxuUCFiVsfhWT8U_0 2024-09-19T15:31:40.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.508+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2281188156737698637', time=2024-09-19T16:47:31.972658+0000, chain.objs.size()=1 2024-09-19T15:31:40.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.508+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.0zVy2By4kX7H4fw7rfjbWP862buCeUI_0 2024-09-19T15:31:40.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.508+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16019513501524068631', time=2024-09-19T16:47:32.916523+0000, chain.objs.size()=1 2024-09-19T15:31:40.515 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.508+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.lfVR9wGulurIuhXk1ReMNo6Jx1Kajx1_0 2024-09-19T15:31:40.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.512+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14813518060291498720', time=2024-09-19T16:47:35.498807+0000, chain.objs.size()=1 2024-09-19T15:31:40.516 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.512+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.mqwyJBfw2x-99SKM1njQ93PKC6K99ox_0 2024-09-19T15:31:40.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.512+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5419366814411471400', time=2024-09-19T16:47:35.772184+0000, chain.objs.size()=1 2024-09-19T15:31:40.518 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.512+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.BPQ0f0jQ55fCIM-nDiy4wo33AyqUVod_0 2024-09-19T15:31:40.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.512+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15189557555224905991', time=2024-09-19T16:47:36.914653+0000, chain.objs.size()=1 2024-09-19T15:31:40.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.512+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Vx5bN02ezGeWA8RkI7fj8tOr-9memr8_0 2024-09-19T15:31:40.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.512+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9989725082126092723', time=2024-09-19T16:47:37.993510+0000, chain.objs.size()=1 2024-09-19T15:31:40.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.512+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.N-ttXzdIDjT145BMeDA9cDEBsCmMPy0_0 2024-09-19T15:31:40.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.512+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8144267683634397187', time=2024-09-19T16:47:38.537437+0000, chain.objs.size()=1 2024-09-19T15:31:40.519 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.512+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.AKmfTByrGnUlkDu4yVYdx8s6ehOwPtT_0 2024-09-19T15:31:40.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3671004931584819239', time=2024-09-19T16:47:39.469891+0000, chain.objs.size()=1 2024-09-19T15:31:40.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.Ry4YYqo1vHhkqapFET2g3YRgk0Y2jTc_0 2024-09-19T15:31:40.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11020117083415605742', time=2024-09-19T16:47:39.867420+0000, chain.objs.size()=1 2024-09-19T15:31:40.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.GqS3dOMvOIOuZnwejtCNsk3mCLrnfwL_0 2024-09-19T15:31:40.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14349701887389362242', time=2024-09-19T16:47:40.483468+0000, chain.objs.size()=1 2024-09-19T15:31:40.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.I5w_qBd5_Qsl9IUfjnAfO9rG8guKRV2_0 2024-09-19T15:31:40.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12456806998463156878', time=2024-09-19T16:47:40.847042+0000, chain.objs.size()=1 2024-09-19T15:31:40.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.0vubOm1XCkCY2gkp4Q15DxHfSLA0Z4N_0 2024-09-19T15:31:40.520 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8725882290189988112', time=2024-09-19T16:47:42.652232+0000, chain.objs.size()=1 2024-09-19T15:31:40.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.LJQG7OsggQ6NSMdv7ZyZpdQbsIKRMPL_0 2024-09-19T15:31:40.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11692577017237437366', time=2024-09-19T16:47:43.607038+0000, chain.objs.size()=1 2024-09-19T15:31:40.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.xL6Ba8TfoYslEipW_k8dPSyQy6awq04_0 2024-09-19T15:31:40.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10672030519540385371', time=2024-09-19T16:47:44.054985+0000, chain.objs.size()=1 2024-09-19T15:31:40.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.vrO4uC2Dhg36visSUIIfgkbuAmaTXCL_0 2024-09-19T15:31:40.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4171183310162040482', time=2024-09-19T16:47:45.158290+0000, chain.objs.size()=1 2024-09-19T15:31:40.521 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ZZLfYoHQpM1L_cjarIXDzjw_XHeecR1_0 2024-09-19T15:31:40.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8999121488192099101', time=2024-09-19T16:47:46.619220+0000, chain.objs.size()=1 2024-09-19T15:31:40.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.PsAH_wlT2fGm0kvLLPXPdnpvOwJUzGr_0 2024-09-19T15:31:40.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6332404049198635219', time=2024-09-19T16:47:49.428893+0000, chain.objs.size()=1 2024-09-19T15:31:40.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.eHx92NrcALBlWgUs50vhUVJEhj3Ldf2_0 2024-09-19T15:31:40.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3011306656645742183', time=2024-09-19T16:47:49.486914+0000, chain.objs.size()=1 2024-09-19T15:31:40.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.YQ1n-XiVQXhkoXTBZ59HHoDa_t65m5y_0 2024-09-19T15:31:40.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12118187247950465093', time=2024-09-19T16:49:39.210037+0000, chain.objs.size()=1 2024-09-19T15:31:40.523 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ZMX0Zm_9pP9BWluxNuZDGtu4BD--p4-_0 2024-09-19T15:31:40.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14717541138957482115', time=2024-09-19T16:49:39.212759+0000, chain.objs.size()=1 2024-09-19T15:31:40.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.v2LZkcNGki93xMQx0upShCJgHewvF0g_0 2024-09-19T15:31:40.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8343375539659472572', time=2024-09-19T16:49:40.268616+0000, chain.objs.size()=1 2024-09-19T15:31:40.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.jbWcBZ3B7OlN9xkgQNQqQeFSj2zCtJg_0 2024-09-19T15:31:40.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5640843569883985674', time=2024-09-19T16:49:44.109620+0000, chain.objs.size()=1 2024-09-19T15:31:40.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.516+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.YkpwjiWzs01QTUVRKYDvRyLcFAhh0fw_0 2024-09-19T15:31:40.524 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.520+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7762883523933251450', time=2024-09-19T16:49:44.273560+0000, chain.objs.size()=1 2024-09-19T15:31:40.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.520+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.RFlM0ue2Dx-EfBHOcBW_ObYjoXkGXBR_0 2024-09-19T15:31:40.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.520+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7350268439089747522', time=2024-09-19T16:49:44.526999+0000, chain.objs.size()=1 2024-09-19T15:31:40.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.520+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.QadwSi57Duw1VH_0OQOUrJR_5eJ_VOE_0 2024-09-19T15:31:40.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.520+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14130754075695461988', time=2024-09-19T16:49:44.947085+0000, chain.objs.size()=1 2024-09-19T15:31:40.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.520+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.f-KxelORvxX8Jara2972Pr8QRKYnvD6_0 2024-09-19T15:31:40.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.520+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16072503717307722636', time=2024-09-19T16:49:45.347871+0000, chain.objs.size()=1 2024-09-19T15:31:40.525 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.520+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.FrWEVDSWRFXr2Tz_udss8l9aWRAwV7H_0 2024-09-19T15:31:40.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.520+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9862055641164814230', time=2024-09-19T16:49:45.349636+0000, chain.objs.size()=1 2024-09-19T15:31:40.526 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.520+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.6h7Q9u0RgPD1gxd4T8ai7a_TKqMuCyj_0 2024-09-19T15:31:40.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.520+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5616939254857577721', time=2024-09-19T16:49:46.737762+0000, chain.objs.size()=1 2024-09-19T15:31:40.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.520+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.BB_fA65zH8pOSBOBobmM824j1pmtix1_0 2024-09-19T15:31:40.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.520+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.291932354068942580', time=2024-09-19T16:49:47.823608+0000, chain.objs.size()=1 2024-09-19T15:31:40.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.520+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.VVF-8Zcho5-XwJutL6UyYCMcf_KWjt3_0 2024-09-19T15:31:40.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.520+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9631320744948789380', time=2024-09-19T16:49:48.194765+0000, chain.objs.size()=1 2024-09-19T15:31:40.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.520+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.FfWcR1JeSu3VF0oGBVH9loHcAb_8VWl_0 2024-09-19T15:31:40.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.524+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15391041790153912917', time=2024-09-19T16:49:49.219513+0000, chain.objs.size()=1 2024-09-19T15:31:40.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.524+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.w4dXOLolxK6iAcPzM39S205tjOQa4eu_0 2024-09-19T15:31:40.528 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.524+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7680524270195108802', time=2024-09-19T16:49:49.223698+0000, chain.objs.size()=1 2024-09-19T15:31:40.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.524+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.85RGqQ0T36pHrsHjz0xzyfOQFm3vruT_0 2024-09-19T15:31:40.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.524+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9894243063008989039', time=2024-09-19T16:49:49.318974+0000, chain.objs.size()=1 2024-09-19T15:31:40.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.524+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.s5jLv-EB5O6pX4pqjv7qaHdXKYq9LMS_0 2024-09-19T15:31:40.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.524+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7542355179823348249', time=2024-09-19T16:49:50.140778+0000, chain.objs.size()=1 2024-09-19T15:31:40.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.524+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.CFBZAigUWBOnTJE8fHPWtOBejwSEUC3_0 2024-09-19T15:31:40.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.524+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4437587849599508538', time=2024-09-19T16:49:52.077190+0000, chain.objs.size()=1 2024-09-19T15:31:40.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.524+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.JfGQN2mvZk-Xh_EISIDqg6jY5XjN-70_0 2024-09-19T15:31:40.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.524+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2152953094222072674', time=2024-09-19T16:49:52.761686+0000, chain.objs.size()=1 2024-09-19T15:31:40.529 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.524+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.RDmXWUB8eF4JWITLcNsY8s-lmTiWkEu_0 2024-09-19T15:31:40.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.524+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9684537994480351351', time=2024-09-19T16:49:52.836528+0000, chain.objs.size()=1 2024-09-19T15:31:40.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.524+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.-Bct0nVYtGBKaedidxOAjPs0HZw3V4V_0 2024-09-19T15:31:40.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.524+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2383412146152393321', time=2024-09-19T16:49:53.320315+0000, chain.objs.size()=1 2024-09-19T15:31:40.530 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.524+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.E9R0PMBnCeu59-IeWamOznbIT8rb7DK_0 2024-09-19T15:31:40.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.524+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14527842169617699288', time=2024-09-19T16:49:54.521255+0000, chain.objs.size()=1 2024-09-19T15:31:40.531 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.524+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.TeACPphrNQUZWzw4CimIYMSvzlPhgS9_0 2024-09-19T15:31:40.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.528+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15254336487631028872', time=2024-09-19T16:49:54.696556+0000, chain.objs.size()=1 2024-09-19T15:31:40.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.528+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.5TfcldxSH-YYr6S9SPirp1h2jwZ01If_0 2024-09-19T15:31:40.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.528+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13431435772468883904', time=2024-09-19T16:49:56.180877+0000, chain.objs.size()=1 2024-09-19T15:31:40.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.528+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.D5fYv8Nv8uFBEkmMm4Ll6uBa9m8mMqT_0 2024-09-19T15:31:40.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.528+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12505357014392396492', time=2024-09-19T16:49:56.183020+0000, chain.objs.size()=1 2024-09-19T15:31:40.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.528+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.YHW1Df081cYUlZZcSLCa414HWLfAkVy_0 2024-09-19T15:31:40.532 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.528+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12459698796803329302', time=2024-09-19T16:49:58.504237+0000, chain.objs.size()=1 2024-09-19T15:31:40.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.528+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.90kDYGTK9WhZNfKd9lT680TOYqAb5oj_0 2024-09-19T15:31:40.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.528+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16182659244093489481', time=2024-09-19T16:49:58.915907+0000, chain.objs.size()=1 2024-09-19T15:31:40.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.528+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.9h6CCkgv4h9QSV6ecZtmTgA2r4gm2KK_0 2024-09-19T15:31:40.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.528+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11295250960937486783', time=2024-09-19T16:50:00.079629+0000, chain.objs.size()=1 2024-09-19T15:31:40.533 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.528+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.bNScAn3TMUq1TKQV08W1SJNxlLzkEJK_0 2024-09-19T15:31:40.536 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45708 2024-09-19T15:31:40.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-19T15:31:40.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8174891018621038123', time=2024-09-19T16:50:01.488364+0000, chain.objs.size()=1 2024-09-19T15:31:40.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.guIG_yaBAeigpzc1VvgIKbRg4-07uXb_0 2024-09-19T15:31:40.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4901668755620022204', time=2024-09-19T16:50:01.917639+0000, chain.objs.size()=1 2024-09-19T15:31:40.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.uuA27D0ZAcEVeHf4FrsqYn0HFrMSKgw_0 2024-09-19T15:31:40.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12379599965534641201', time=2024-09-19T16:50:04.509602+0000, chain.objs.size()=1 2024-09-19T15:31:40.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.vtaca2VuYoiMNSRZaFIbi-X1E0BBlXA_0 2024-09-19T15:31:40.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6167671905094456567', time=2024-09-19T16:50:05.275103+0000, chain.objs.size()=1 2024-09-19T15:31:40.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.H1qL54v8DvGyo86KQLlDsN2Gt_46u3U_0 2024-09-19T15:31:40.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15505072019794772957', time=2024-09-19T16:50:05.679665+0000, chain.objs.size()=1 2024-09-19T15:31:40.539 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.4SkZ3KS7TjbbhRPRBEu1nrLp_QnXxNh_0 2024-09-19T15:31:40.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12287973152116001119', time=2024-09-19T16:50:06.198964+0000, chain.objs.size()=1 2024-09-19T15:31:40.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.tPwM6sgLi8Okiiat10ui-M66QehMmu9_0 2024-09-19T15:31:40.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1369607558622902836', time=2024-09-19T16:52:17.509690+0000, chain.objs.size()=1 2024-09-19T15:31:40.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.390__shadow_.BfMfyqSYnrp2xpplL-DO7b1QTGf_Oms_0 2024-09-19T15:31:40.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14166170552235984671', time=2024-09-19T16:53:52.272686+0000, chain.objs.size()=1 2024-09-19T15:31:40.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.437__shadow_.v-u9VcVQDvcM67ldB4FpmtFiL9hNe_v_0 2024-09-19T15:31:40.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13710573613045624663', time=2024-09-19T16:55:32.926420+0000, chain.objs.size()=1 2024-09-19T15:31:40.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.483__shadow_.LhURKq29NNMAqAUWQlvqqI0LVTOStwA_0 2024-09-19T15:31:40.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2694469868671856437', time=2024-09-19T16:56:09.921432+0000, chain.objs.size()=1 2024-09-19T15:31:40.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.498__shadow_.iqBVneEthG4QYAjsSySr_y_T-7_7A49_0 2024-09-19T15:31:40.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16497682985482308258', time=2024-09-19T16:57:25.792517+0000, chain.objs.size()=1 2024-09-19T15:31:40.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.515__shadow_.fD9v4lOLqellveseIF8oxx1KRj9_oh7_0 2024-09-19T15:31:40.540 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11524905730998099452', time=2024-09-19T17:07:52.459764+0000, chain.objs.size()=1 2024-09-19T15:31:40.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.532+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:zeu8ibOhyZwkIfU.9pepSCJNghda.RM_.Yf77tHJx5sm8RQyob_-96DqecwU4tFp_0 2024-09-19T15:31:40.541 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16470681968359988080', time=2024-09-19T17:08:03.932142+0000, chain.objs.size()=1 2024-09-19T15:31:40.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:Hq8DjrqhpqdBafKbSZtED2S074CGOlk_.Z80NYcf6XaoSNGbZRvjheQE39ei3YLo_0 2024-09-19T15:31:40.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11502431737173491649', time=2024-09-19T17:08:07.480250+0000, chain.objs.size()=1 2024-09-19T15:31:40.542 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.570__shadow:wUru7jsUjGNy0OoNWiQXTIz-Bfqihh4_.hAo5x1EzlGaLl3SYihVpsukIMWvAmyF_0 2024-09-19T15:31:40.543 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11616412795496479348', time=2024-09-19T17:09:09.648380+0000, chain.objs.size()=1 2024-09-19T15:31:40.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:qZfwGZFbiRtq3MqlJ0gcL.hJtzABnhc_.4g6FQwhs6l60CkbiXanZicOjY_0xCcv_0 2024-09-19T15:31:40.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10165996791997666838', time=2024-09-19T17:10:36.524758+0000, chain.objs.size()=1 2024-09-19T15:31:40.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.580__shadow:XpqhCiBE8OpDZ7-SorngDfEDxvS0GLp_.k7KmdDTKR1NdGKPG-6n0-_CFgl9kXFN_0 2024-09-19T15:31:40.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.536+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8842588612488018991', time=2024-09-19T17:16:25.730534+0000, chain.objs.size()=1 2024-09-19T15:31:40.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.536+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.618__shadow_.L7gQdKfUmcpmULYKzC1XzGEIN2tUW_l_0 2024-09-19T15:31:40.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.540+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16868673341775316205', time=2024-09-19T17:18:24.050988+0000, chain.objs.size()=1 2024-09-19T15:31:40.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.540+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.637__shadow_.tT04_wej4Lk60c6zRVRozTehl7NOmag_0 2024-09-19T15:31:40.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.540+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12218224184248681975', time=2024-09-19T17:20:53.394779+0000, chain.objs.size()=1 2024-09-19T15:31:40.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.540+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.670__shadow_.dOhmQ_z0XLzGMz6F2G72ct46TzTSM6e_0 2024-09-19T15:31:40.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.540+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12874222646622091315', time=2024-09-19T17:22:48.568806+0000, chain.objs.size()=1 2024-09-19T15:31:40.544 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.540+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.719__shadow_.H93y1YQpmGq_-Y1q875kmBTZuSA4onP_0 2024-09-19T15:31:40.547 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.540+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:40.550 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.544+0000 7f91ef1549c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T15:31:40.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T15:31:40.553 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T15:31:40.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46888' 2024-09-19T15:31:40.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17342383485207637464', time=2024-09-19T16:31:59.206778+0000, chain.objs.size()=1 2024-09-19T15:31:40.554 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.147__shadow_.YlzzQxcrURP1gByJTsqraZ5kBm9aZQZ_0 2024-09-19T15:31:40.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12592780542354131208', time=2024-09-19T16:39:58.898289+0000, chain.objs.size()=1 2024-09-19T15:31:40.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.243__shadow_.YKPk6Qp_2UatHBo3BYdHh0Ok4fZasYV_0 2024-09-19T15:31:40.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13838949358315960269', time=2024-09-19T16:40:14.390020+0000, chain.objs.size()=1 2024-09-19T15:31:40.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.249__shadow_.bL0k6WZ38oQPIQs7eBYK_9diL2abK-B_0 2024-09-19T15:31:40.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7775890051555176149', time=2024-09-19T16:40:14.391005+0000, chain.objs.size()=1 2024-09-19T15:31:40.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.249__shadow_.CRGiXAXDfiUPEDFlU43ypsI2-eutasA_0 2024-09-19T15:31:40.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15763595092981714194', time=2024-09-19T16:40:19.114138+0000, chain.objs.size()=1 2024-09-19T15:31:40.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.251__shadow_.XWCcnysbo4AOhMtHDeRrCPT72bcjBz1_0 2024-09-19T15:31:40.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5488820662029020213', time=2024-09-19T16:40:32.732948+0000, chain.objs.size()=1 2024-09-19T15:31:40.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.257__shadow_.zxHfesaAwI2FmhmizLnAymWzqbWHZun_0 2024-09-19T15:31:40.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6299143740423058486', time=2024-09-19T16:40:39.516105+0000, chain.objs.size()=1 2024-09-19T15:31:40.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.260__shadow_.Abt5BP4PTJGyfe8Cqw3s2S5t6VJDC1S_0 2024-09-19T15:31:40.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15985236733539026614', time=2024-09-19T16:42:28.133332+0000, chain.objs.size()=1 2024-09-19T15:31:40.555 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ql-u6RcjER8apFpv4ahiSIuf6ioS0AZ_0 2024-09-19T15:31:40.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7736060465878470476', time=2024-09-19T16:42:28.134787+0000, chain.objs.size()=1 2024-09-19T15:31:40.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.lldxfzrm0FBIdBQ83uoe7yRoVIBIm3B_0 2024-09-19T15:31:40.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11380675142354855874', time=2024-09-19T16:42:29.497834+0000, chain.objs.size()=1 2024-09-19T15:31:40.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.x66okQf5ZDV37s8ZiZJKbrH3VAyneF4_0 2024-09-19T15:31:40.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2074045307507194204', time=2024-09-19T16:42:29.950820+0000, chain.objs.size()=1 2024-09-19T15:31:40.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.GeV577JFnApiKdQz3nQEsz3q7uU-iXw_0 2024-09-19T15:31:40.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3776313287852824116', time=2024-09-19T16:42:30.563685+0000, chain.objs.size()=1 2024-09-19T15:31:40.556 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.548+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.7moAZ8QL9VIRDnBvz1CjpDoswpYQNlL_0 2024-09-19T15:31:40.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12640063608178549453', time=2024-09-19T16:42:31.476295+0000, chain.objs.size()=1 2024-09-19T15:31:40.557 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.WDnUgHM0POHvl5z8eSU_0-U4syegWhm_0 2024-09-19T15:31:40.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15454621794532063204', time=2024-09-19T16:42:32.555482+0000, chain.objs.size()=1 2024-09-19T15:31:40.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.YxQtxZAskcWADDO-7k7-kqPe7TEWVv5_0 2024-09-19T15:31:40.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2045386166630003736', time=2024-09-19T16:42:32.557173+0000, chain.objs.size()=1 2024-09-19T15:31:40.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.c4l7-jRNNBa-Rjdv89XKKnFW8g2s2d7_0 2024-09-19T15:31:40.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.585560288595673482', time=2024-09-19T16:42:32.651166+0000, chain.objs.size()=1 2024-09-19T15:31:40.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.NHUm6Qbu4DewSYzCAt56HyXage_-1nD_0 2024-09-19T15:31:40.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7445593445858713758', time=2024-09-19T16:42:34.817159+0000, chain.objs.size()=1 2024-09-19T15:31:40.558 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.4LCpf0tRSl6vDQYr9i9LYlbiLlxJ9dS_0 2024-09-19T15:31:40.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18069572012807439252', time=2024-09-19T16:42:37.283595+0000, chain.objs.size()=1 2024-09-19T15:31:40.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.slmxAEDvmf-XtShmoYFrwWvn_Oof8My_0 2024-09-19T15:31:40.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3821556432259317754', time=2024-09-19T16:42:37.398729+0000, chain.objs.size()=1 2024-09-19T15:31:40.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.C7EJaFpQXBcKDeyruBuAeqZCga3T76T_0 2024-09-19T15:31:40.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3324220985649460920', time=2024-09-19T16:42:38.388971+0000, chain.objs.size()=1 2024-09-19T15:31:40.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.nQL-CaQ3XoZgTZoyPJWNg_zsSqk2PyS_0 2024-09-19T15:31:40.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15770534796531015622', time=2024-09-19T16:42:43.334520+0000, chain.objs.size()=1 2024-09-19T15:31:40.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.LOAAhkU33PyvtbXp1Ovt80zQO3l5MFx_0 2024-09-19T15:31:40.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3468528669558984004', time=2024-09-19T16:42:45.285888+0000, chain.objs.size()=1 2024-09-19T15:31:40.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.rym39mh-QBbaBRy1KELtMpFA7q1Nkzu_0 2024-09-19T15:31:40.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.552+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8556868352307343320', time=2024-09-19T16:42:47.958205+0000, chain.objs.size()=1 2024-09-19T15:31:40.559 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.552+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.2K4Ei1Z2C4LgKJfAnOLwdlyku9EeXFe_0 2024-09-19T15:31:40.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18183492618992658195', time=2024-09-19T16:42:48.413376+0000, chain.objs.size()=1 2024-09-19T15:31:40.560 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.OQkBMxyTjEaGqZs1T-bfsDBTpueB7do_0 2024-09-19T15:31:40.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8971949832831267190', time=2024-09-19T16:42:49.300763+0000, chain.objs.size()=1 2024-09-19T15:31:40.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.p8lg5KsLrVTmGrrW8sAE4AGMMUCKnZ2_0 2024-09-19T15:31:40.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4482852924280628212', time=2024-09-19T16:42:49.820245+0000, chain.objs.size()=1 2024-09-19T15:31:40.561 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.3vus0-J0dJjFVPafc9Fu-CeO7DOoIXH_0 2024-09-19T15:31:40.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11100599127550146687', time=2024-09-19T16:42:50.851039+0000, chain.objs.size()=1 2024-09-19T15:31:40.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.-u033N8xW6Kslk4HrqWWcUr2iNk_Rqe_0 2024-09-19T15:31:40.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2825732999168933551', time=2024-09-19T16:42:52.154298+0000, chain.objs.size()=1 2024-09-19T15:31:40.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.-7orIwchy4IjtJpc19aLL04yV3smUbu_0 2024-09-19T15:31:40.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1170390010422171858', time=2024-09-19T16:42:54.308361+0000, chain.objs.size()=1 2024-09-19T15:31:40.563 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.ZBy_wHeDd2kunCiVtqDsiQVALBAxGNp_0 2024-09-19T15:31:40.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.556+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6352733729460780826', time=2024-09-19T16:42:56.011060+0000, chain.objs.size()=1 2024-09-19T15:31:40.564 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.556+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.rKfV8FRKjOIUuHlO5azkJdD7zq8QF-b_0 2024-09-19T15:31:40.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7246736014156480415', time=2024-09-19T16:42:56.351284+0000, chain.objs.size()=1 2024-09-19T15:31:40.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.goSy3_KvoQlEiXsPWimzs3nLrA_piqo_0 2024-09-19T15:31:40.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10017218873292410511', time=2024-09-19T16:42:56.564940+0000, chain.objs.size()=1 2024-09-19T15:31:40.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Io3tN1tnn5mNm0OJR0Ov2NI6T0KBiCt_0 2024-09-19T15:31:40.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14231356122442918526', time=2024-09-19T16:42:57.876150+0000, chain.objs.size()=1 2024-09-19T15:31:40.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.Vodl6u4uQ5adq0jiZlLRCeQgXi57lZt_0 2024-09-19T15:31:40.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9334049047618230868', time=2024-09-19T16:42:58.874147+0000, chain.objs.size()=1 2024-09-19T15:31:40.565 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.xXkKIWV039sQPLlNDnEJp7yfYl1JFST_0 2024-09-19T15:31:40.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15681529698910575966', time=2024-09-19T16:42:59.127788+0000, chain.objs.size()=1 2024-09-19T15:31:40.566 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.262__shadow_.w4pQ2WT9DrpDdtUop2N9G-gBpfEMwRH_0 2024-09-19T15:31:40.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.284603297949993181', time=2024-09-19T16:43:13.419889+0000, chain.objs.size()=1 2024-09-19T15:31:40.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.268__shadow_.-Y_YhxSxubiAjTwKcAcPboa-Yvn35ke_0 2024-09-19T15:31:40.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.560+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2812942948182673064', time=2024-09-19T16:43:42.862558+0000, chain.objs.size()=1 2024-09-19T15:31:40.568 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.560+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.281__shadow_.YaO9bdLrLSVVM5b2MzB_w2TjkQ7Z3Zm_0 2024-09-19T15:31:40.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.564+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17385518370436774323', time=2024-09-19T16:43:52.262172+0000, chain.objs.size()=1 2024-09-19T15:31:40.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.564+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.285__shadow_.N1n-f2Rs5gNTFhkfj6pI-duHVulOWmB_0 2024-09-19T15:31:40.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.564+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6880407003019535893', time=2024-09-19T16:43:59.385276+0000, chain.objs.size()=1 2024-09-19T15:31:40.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.564+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.288__shadow_.J9HcOmdq4FUJi7Bm96eVfIrtvaPR0Nv_0 2024-09-19T15:31:40.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.564+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4580308880716737625', time=2024-09-19T16:44:04.105811+0000, chain.objs.size()=1 2024-09-19T15:31:40.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.564+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.290__shadow_.CxsBXvytF09sg1jqZ4-X5q52Z791Zag_0 2024-09-19T15:31:40.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.564+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1687953579850234670', time=2024-09-19T16:44:18.224131+0000, chain.objs.size()=1 2024-09-19T15:31:40.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.564+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.293__shadow_.cIZJ50uC8Kj0TJkFUpb4hOXTcdLXHTj_0 2024-09-19T15:31:40.569 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.564+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3100017755011647974', time=2024-09-19T16:44:28.001888+0000, chain.objs.size()=1 2024-09-19T15:31:40.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.564+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.297__shadow_.9MdBDvGBdv8gmaqAiE-VshoT1XWdSYU_0 2024-09-19T15:31:40.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.564+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2143993264914005587', time=2024-09-19T16:44:40.060834+0000, chain.objs.size()=1 2024-09-19T15:31:40.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.564+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.302__shadow_.SwaLuhkZGF5eHHtGfG2uvAkbYlY4J6K_0 2024-09-19T15:31:40.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.564+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10592649617000689665', time=2024-09-19T16:44:47.104188+0000, chain.objs.size()=1 2024-09-19T15:31:40.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.564+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.305__shadow_.UCSQ-ijvu2s1e7exMqwyTLMgpCHHnqJ_0 2024-09-19T15:31:40.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.564+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8577265895731320986', time=2024-09-19T16:47:17.969081+0000, chain.objs.size()=1 2024-09-19T15:31:40.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.564+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.b6dzZNFca8ms3PmVMLMD4gybj4w74mW_0 2024-09-19T15:31:40.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.564+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7242835751751012420', time=2024-09-19T16:47:19.967572+0000, chain.objs.size()=1 2024-09-19T15:31:40.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.564+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.c43fukKfFOe4wPcTsPLetBOe4tPrXgh_0 2024-09-19T15:31:40.570 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.564+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16211032788885435479', time=2024-09-19T16:47:20.753532+0000, chain.objs.size()=1 2024-09-19T15:31:40.571 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.564+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.hwPvG3Qguwt1pS6osa4Fkl8QvG_BAcT_0 2024-09-19T15:31:40.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13589417233866116929', time=2024-09-19T16:47:22.411327+0000, chain.objs.size()=1 2024-09-19T15:31:40.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.QA8uK0Q12HNM44eb7x82a11oeh8po9f_0 2024-09-19T15:31:40.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1882199271509385241', time=2024-09-19T16:47:26.836474+0000, chain.objs.size()=1 2024-09-19T15:31:40.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.i7gxlMOOE9TviYTpGW6mrK7efVUx6Ru_0 2024-09-19T15:31:40.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11454814148760991429', time=2024-09-19T16:47:27.530331+0000, chain.objs.size()=1 2024-09-19T15:31:40.572 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.vgTWBIE8VBujKO84baGmUJrWV8D0Ovz_0 2024-09-19T15:31:40.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5142924527141006566', time=2024-09-19T16:47:27.786615+0000, chain.objs.size()=1 2024-09-19T15:31:40.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.GyK9vCI2zB6LdGCsg1lxZqgcar87MCN_0 2024-09-19T15:31:40.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15978795361764861548', time=2024-09-19T16:47:29.423115+0000, chain.objs.size()=1 2024-09-19T15:31:40.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.MgjnwvATLSmDFqAOHUZHEZ15JgJO99Z_0 2024-09-19T15:31:40.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14625415609361107778', time=2024-09-19T16:47:33.621321+0000, chain.objs.size()=1 2024-09-19T15:31:40.573 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.tl1UYoXgcAGKHtVtAFoXfPn4JiykI3M_0 2024-09-19T15:31:40.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14836753405304258578', time=2024-09-19T16:47:34.055005+0000, chain.objs.size()=1 2024-09-19T15:31:40.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.J34W-oJbFe3aDOP41mHyuWXC31jQQDw_0 2024-09-19T15:31:40.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.7519860720319423356', time=2024-09-19T16:47:34.057039+0000, chain.objs.size()=1 2024-09-19T15:31:40.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.TTZppLB3JSPzjZ1oeHagTqGPmg-mUIJ_0 2024-09-19T15:31:40.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2462280345843904383', time=2024-09-19T16:47:34.157855+0000, chain.objs.size()=1 2024-09-19T15:31:40.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.wp-1mvbK4A3xaEsdItQqOWY7_nsIrS5_0 2024-09-19T15:31:40.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14335670194591118991', time=2024-09-19T16:47:35.288894+0000, chain.objs.size()=1 2024-09-19T15:31:40.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.OS_FRd-VxbWCo9hL160KW-0DD2aBGMv_0 2024-09-19T15:31:40.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.568+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8578983232516181845', time=2024-09-19T16:47:36.540924+0000, chain.objs.size()=1 2024-09-19T15:31:40.574 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.568+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.9p5z-soHnMpgxwUqzquPXGiWFdhPWYh_0 2024-09-19T15:31:40.576 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3965275522802147627', time=2024-09-19T16:47:37.748961+0000, chain.objs.size()=1 2024-09-19T15:31:40.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.YUUvIEzgPQzGSSeMPDD1-90cgs7viAL_0 2024-09-19T15:31:40.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12394582642401055025', time=2024-09-19T16:47:37.750714+0000, chain.objs.size()=1 2024-09-19T15:31:40.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.ZobojyaO12HSUbaHhT_CBfUy5q9FI6L_0 2024-09-19T15:31:40.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17591692645422897660', time=2024-09-19T16:47:38.084778+0000, chain.objs.size()=1 2024-09-19T15:31:40.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.mfXcNU5LNoBNQqfNe09-H_W91BTvGtD_0 2024-09-19T15:31:40.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9850824303989954210', time=2024-09-19T16:47:38.266917+0000, chain.objs.size()=1 2024-09-19T15:31:40.577 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.CrwOeEqAZqm1jh-z5BqFA_fc2599mnu_0 2024-09-19T15:31:40.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4962774815853660254', time=2024-09-19T16:47:39.460903+0000, chain.objs.size()=1 2024-09-19T15:31:40.578 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.pUQLQQpMSuXEuiA2ZV0HkdJUbdDulMt_0 2024-09-19T15:31:40.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.18143923984686015170', time=2024-09-19T16:47:40.132702+0000, chain.objs.size()=1 2024-09-19T15:31:40.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.5VNZWo_hyTR_shtYo-DWmDa3M95XJ9T_0 2024-09-19T15:31:40.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6256252377450307727', time=2024-09-19T16:47:40.626184+0000, chain.objs.size()=1 2024-09-19T15:31:40.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.1X3VQZWpJCAdJaG_j9kQRpqVdAelO03_0 2024-09-19T15:31:40.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14477336899623378239', time=2024-09-19T16:47:41.803977+0000, chain.objs.size()=1 2024-09-19T15:31:40.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.qcTbRu3U90p_xfZEAaPcQPtFC5k6Ckr_0 2024-09-19T15:31:40.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16661659114936960560', time=2024-09-19T16:47:42.208059+0000, chain.objs.size()=1 2024-09-19T15:31:40.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.VWNth571nkYyOY84gbX6A6O5xcZ-UWt_0 2024-09-19T15:31:40.579 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5949125463382756078', time=2024-09-19T16:47:42.210093+0000, chain.objs.size()=1 2024-09-19T15:31:40.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.IBWnL-R-EvudQRLAsSm0iYuGlIwuFtS_0 2024-09-19T15:31:40.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.572+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2322025553639562169', time=2024-09-19T16:47:43.512310+0000, chain.objs.size()=1 2024-09-19T15:31:40.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.572+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.cjH6ABR1vNNE9yuBIpbOTW2qS0c6Tu0_0 2024-09-19T15:31:40.580 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.576+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.970885085858304067', time=2024-09-19T16:47:47.430830+0000, chain.objs.size()=1 2024-09-19T15:31:40.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.576+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.5iMcWtfd6o8S72GsaI-wDahlW6R4LaK_0 2024-09-19T15:31:40.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.576+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6171001166456942327', time=2024-09-19T16:47:47.909611+0000, chain.objs.size()=1 2024-09-19T15:31:40.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.576+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.FLZy5eTpyMIILCALdsIvSs9D17bZr9C_0 2024-09-19T15:31:40.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.576+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1052978736740402869', time=2024-09-19T16:47:50.009461+0000, chain.objs.size()=1 2024-09-19T15:31:40.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.576+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.323__shadow_.H_3kwZXNZpqb9-7f_ctQbLijiPJl-AM_0 2024-09-19T15:31:40.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.576+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17258522679825152303', time=2024-09-19T16:49:34.846302+0000, chain.objs.size()=1 2024-09-19T15:31:40.581 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.576+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.cDToN2U-5qsA8ekTABWwDuTCblKYRZn_0 2024-09-19T15:31:40.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.576+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13559799249069097908', time=2024-09-19T16:49:35.263004+0000, chain.objs.size()=1 2024-09-19T15:31:40.583 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.576+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.xhZQzOvgJ91Z8IyNrOcvuC2umPruBIy_0 2024-09-19T15:31:40.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.576+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9351586150503634010', time=2024-09-19T16:49:36.842682+0000, chain.objs.size()=1 2024-09-19T15:31:40.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.576+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.PH_MeGbPvU1kb8FHMTPfC3h-YOEEpYO_0 2024-09-19T15:31:40.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.576+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.9368271838179386730', time=2024-09-19T16:49:37.602984+0000, chain.objs.size()=1 2024-09-19T15:31:40.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.576+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.sCkCEv-DynKfRep_pFLqTUYmctgDMWW_0 2024-09-19T15:31:40.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.576+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12591587953747495870', time=2024-09-19T16:49:39.198547+0000, chain.objs.size()=1 2024-09-19T15:31:40.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.576+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Srn8wVRslB6fC6PQTz_0GTLOGylNOKk_0 2024-09-19T15:31:40.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.576+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14053751714592653994', time=2024-09-19T16:49:39.931142+0000, chain.objs.size()=1 2024-09-19T15:31:40.584 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.576+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.oTRyRZ3iNMnCRMXupWVsT_EkcvI2VRx_0 2024-09-19T15:31:40.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.580+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5815993462026353066', time=2024-09-19T16:49:40.275277+0000, chain.objs.size()=1 2024-09-19T15:31:40.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.580+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_._V1PcHoJIy1DjQfVBrt7pbJ1g1nsw6l_0 2024-09-19T15:31:40.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.580+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4452701770956107457', time=2024-09-19T16:49:40.277484+0000, chain.objs.size()=1 2024-09-19T15:31:40.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.580+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Ur6fEVPa6Tp23cpN00Kc6B3ReFzLojk_0 2024-09-19T15:31:40.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.580+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11793849986076453776', time=2024-09-19T16:49:41.576830+0000, chain.objs.size()=1 2024-09-19T15:31:40.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.580+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.E4DysmhTx6MuHR1RWOoN0_NY_RrTYuZ_0 2024-09-19T15:31:40.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.580+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17224025535343606620', time=2024-09-19T16:49:41.824199+0000, chain.objs.size()=1 2024-09-19T15:31:40.585 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.580+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.r3zN4azmnGibknDVxiBgTBicBvaEA0f_0 2024-09-19T15:31:40.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.580+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16215173313641601920', time=2024-09-19T16:49:41.883319+0000, chain.objs.size()=1 2024-09-19T15:31:40.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.580+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.komdjALnvGZwz96sKwhOmmShppf0fvh_0 2024-09-19T15:31:40.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.580+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1080779281166428083', time=2024-09-19T16:49:42.461127+0000, chain.objs.size()=1 2024-09-19T15:31:40.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.580+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.JkzKv08lhMI4YJEZuYrCVsNep8c-Qd4_0 2024-09-19T15:31:40.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.580+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3274806708162844232', time=2024-09-19T16:49:44.704975+0000, chain.objs.size()=1 2024-09-19T15:31:40.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.580+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.ngDRUlF2El-x8wz1zqGchoaE41tiRbR_0 2024-09-19T15:31:40.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.580+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16334559765897638472', time=2024-09-19T16:49:46.494372+0000, chain.objs.size()=1 2024-09-19T15:31:40.586 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.580+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.S2IwBrLPShUTE1Pt-lv4FkEO_zcNiCW_0 2024-09-19T15:31:40.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.580+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13722310422434644076', time=2024-09-19T16:49:46.861987+0000, chain.objs.size()=1 2024-09-19T15:31:40.587 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.580+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.q2x5qZ83xX4nADtvu9zJ-xeHYGUSx2J_0 2024-09-19T15:31:40.588 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.584+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16077307750983885193', time=2024-09-19T16:49:48.200983+0000, chain.objs.size()=1 2024-09-19T15:31:40.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.584+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.IhCk3IVUywIMZL72rrPMtPM7X292hi6_0 2024-09-19T15:31:40.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.584+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.15599492544470394688', time=2024-09-19T16:49:49.690071+0000, chain.objs.size()=1 2024-09-19T15:31:40.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.584+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Y1JV1Hx7KM734QtJz283JbNHxi5uc4R_0 2024-09-19T15:31:40.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.584+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16230990620854108712', time=2024-09-19T16:49:50.517974+0000, chain.objs.size()=1 2024-09-19T15:31:40.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.584+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.DB_UtvttY7rDXGIRJxRjzEdqoqO7529_0 2024-09-19T15:31:40.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.584+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16455044971728016527', time=2024-09-19T16:49:50.674234+0000, chain.objs.size()=1 2024-09-19T15:31:40.589 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.584+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.RB4MfMlAQdXUM5CBHW1scFKGm4H9P7f_0 2024-09-19T15:31:40.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.584+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1124789210552716529', time=2024-09-19T16:49:50.869729+0000, chain.objs.size()=1 2024-09-19T15:31:40.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.584+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.oqD52NgSZcuFGhWoAQyrdiR7qRCMpFV_0 2024-09-19T15:31:40.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.584+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.16903562465219563878', time=2024-09-19T16:49:52.068599+0000, chain.objs.size()=1 2024-09-19T15:31:40.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.584+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.TuyagNvJ4Oy75hfAHaYF7a1wKfc2aqh_0 2024-09-19T15:31:40.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.584+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17863433837303930845', time=2024-09-19T16:49:52.438213+0000, chain.objs.size()=1 2024-09-19T15:31:40.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.584+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.QBKv3M-dwRo9py8BenlUYnrjtKOe3ze_0 2024-09-19T15:31:40.590 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.584+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1438012934241716688', time=2024-09-19T16:49:53.117810+0000, chain.objs.size()=1 2024-09-19T15:31:40.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.584+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.8-G-hfeDkf3oxD7Pu3QJ0yYow0aSec2_0 2024-09-19T15:31:40.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.584+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.17504499329509758156', time=2024-09-19T16:49:53.749057+0000, chain.objs.size()=1 2024-09-19T15:31:40.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.584+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.qjdjeUpY-QeDFY0vFCTBSjK8BdX9xUD_0 2024-09-19T15:31:40.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.584+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5474226452962084530', time=2024-09-19T16:49:54.633357+0000, chain.objs.size()=1 2024-09-19T15:31:40.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.584+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.Ff0PYtWq7ClPNrgSGYyl3lN-TJd0Y4w_0 2024-09-19T15:31:40.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.584+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1629260640105778538', time=2024-09-19T16:49:54.905722+0000, chain.objs.size()=1 2024-09-19T15:31:40.591 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.584+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.xUxjN0SPNsHi2fhUEY0IOuSIo0lSwO0_0 2024-09-19T15:31:40.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.588+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13540710742463853117', time=2024-09-19T16:49:56.562970+0000, chain.objs.size()=1 2024-09-19T15:31:40.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.588+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.v2Adh0vR9JHprHY8jp6dgkm9gvQOftX_0 2024-09-19T15:31:40.593 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.588+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8410867463075549738', time=2024-09-19T16:49:59.291385+0000, chain.objs.size()=1 2024-09-19T15:31:40.594 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.588+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.9XOk5sU9XQ_E6eb4mR3tYbd2eC7yZVD_0 2024-09-19T15:31:40.596 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46888 2024-09-19T15:31:40.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-19T15:31:40.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.6946168663845508787', time=2024-09-19T16:50:00.874428+0000, chain.objs.size()=1 2024-09-19T15:31:40.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.qufY2K0vHvK3kbKtWjdPe5cpU9iWP0V_0 2024-09-19T15:31:40.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10826886266110586141', time=2024-09-19T16:50:03.163380+0000, chain.objs.size()=1 2024-09-19T15:31:40.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.324__shadow_.rI0yRFZI2NU6TTtHQly-iyy7ae2KNyx_0 2024-09-19T15:31:40.599 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10477932133527324688', time=2024-09-19T16:50:12.395239+0000, chain.objs.size()=1 2024-09-19T15:31:40.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.327__shadow_.SbaSWSUMczqeEnlHMUm2pVjX8YWYfML_0 2024-09-19T15:31:40.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5642055374324691262', time=2024-09-19T16:51:50.040833+0000, chain.objs.size()=1 2024-09-19T15:31:40.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.377__shadow_.Tq-eaP0FEzuLJUB6CiJSwQ9VyxqklMn_0 2024-09-19T15:31:40.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.3633729909367131876', time=2024-09-19T16:52:02.669039+0000, chain.objs.size()=1 2024-09-19T15:31:40.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.383__shadow_.ddf7T2OzlKjVgkQE1hpFRcaLxu8LwGw_0 2024-09-19T15:31:40.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.13798851953562726447', time=2024-09-19T16:54:30.710776+0000, chain.objs.size()=1 2024-09-19T15:31:40.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.454__shadow_.cCx0nPlQmYPwM_d8GnKuFLZWEHe5hfK_0 2024-09-19T15:31:40.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.2452487022217467159', time=2024-09-19T16:55:05.585651+0000, chain.objs.size()=1 2024-09-19T15:31:40.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.466__shadow_.OSPLH_CPDa2m_sbsYYcoh2s28SA8wOq_0 2024-09-19T15:31:40.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1042871942472824429', time=2024-09-19T16:55:05.814969+0000, chain.objs.size()=1 2024-09-19T15:31:40.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.466__shadow_.pUSzFMmgvKaO4fR-0kQRV0p43cG5AOD_0 2024-09-19T15:31:40.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8166854562967817388', time=2024-09-19T16:55:27.091358+0000, chain.objs.size()=1 2024-09-19T15:31:40.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.481__shadow_.ok_LZ-2OUPCXMkSao_XNJehA0rqg-Ct_0 2024-09-19T15:31:40.600 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.10775075528443318715', time=2024-09-19T16:55:32.836179+0000, chain.objs.size()=1 2024-09-19T15:31:40.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.483__shadow_.r9At4H3mCg5jeNI_HOG0uJVd3kxLADs_0 2024-09-19T15:31:40.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.1744265070442189728', time=2024-09-19T16:55:32.934958+0000, chain.objs.size()=1 2024-09-19T15:31:40.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.483__shadow_.xPsE5ZNhUcT9v7SqCJCQEzfS8MKV8OG_0 2024-09-19T15:31:40.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12651047125948616920', time=2024-09-19T16:55:46.253161+0000, chain.objs.size()=1 2024-09-19T15:31:40.601 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.592+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.486__shadow_.uUqkkQ40Q1Y5jJnIDLiF8b_oVjXZjQT_0 2024-09-19T15:31:40.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.596+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.5640189355345950142', time=2024-09-19T16:55:57.331512+0000, chain.objs.size()=1 2024-09-19T15:31:40.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.596+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.491__shadow_.ewYzCGwj5Qdv1ke9ibPDQ1PZY3wUUOZ_0 2024-09-19T15:31:40.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.596+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.11693695139118364476', time=2024-09-19T16:57:19.599833+0000, chain.objs.size()=1 2024-09-19T15:31:40.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.596+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.512__shadow_.hMov3BxwkVF05p8YQYDhmdQCPsmueLH_0 2024-09-19T15:31:40.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.596+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.137834318673626030', time=2024-09-19T16:57:20.183375+0000, chain.objs.size()=1 2024-09-19T15:31:40.602 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.596+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.513__multipart_mymultipart.2~2t-Ev3ItlAW7e9W1dp_KGXqRgEIjCTV.1 2024-09-19T15:31:40.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.596+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.79781836579303512', time=2024-09-19T17:03:28.940023+0000, chain.objs.size()=3 2024-09-19T15:31:40.603 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.596+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.525__multipart_mymultipart.2~H_D-6CBKG9ZBqBbHUmigCeZB8hSqubW.1 2024-09-19T15:31:40.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.596+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.525__multipart_mymultipart.2~H_D-6CBKG9ZBqBbHUmigCeZB8hSqubW.2 2024-09-19T15:31:40.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.596+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.525__multipart_mymultipart.2~H_D-6CBKG9ZBqBbHUmigCeZB8hSqubW.3 2024-09-19T15:31:40.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.596+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.4224893801892682011', time=2024-09-19T17:07:47.501038+0000, chain.objs.size()=1 2024-09-19T15:31:40.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.596+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.569__shadow:xcypZMphh1ubYm3IkLqwWRLTPnbgmbV_.WuQB3aigFv8m3PkD9eN2k0u_ukvsuBb_0 2024-09-19T15:31:40.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.596+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.986326509624004104', time=2024-09-19T17:08:39.836571+0000, chain.objs.size()=1 2024-09-19T15:31:40.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.596+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.576__shadow:.SovTl.SXFSgPR5gcOIYW9BZJUAtBQl_.9LkHy6ofmN3kuLSHs7Rdkiv3z5Hd-la_0 2024-09-19T15:31:40.604 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.600+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.8656534305754787193', time=2024-09-19T17:09:05.945271+0000, chain.objs.size()=1 2024-09-19T15:31:40.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.600+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:iBrt5AzNJPzTP.4BL9bhcFYhVyPFcIF_.-U__4zejcsThntcFMgRs3lE-leVn7zi_0 2024-09-19T15:31:40.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.600+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.14324637610730701380', time=2024-09-19T17:09:27.477958+0000, chain.objs.size()=1 2024-09-19T15:31:40.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.600+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.577__shadow:Z0HKpKNDypP7SVwQbaEFOzFybLH20Dr_.AfeNZ78ajb-rqK7w2ZUWqVJQ7MqXx2J_0 2024-09-19T15:31:40.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.600+0000 7f91ef1549c0 20 garbage collection: RGWGC::process iterating over entry tag='dbb1da81-49d0-421a-b677-974869a7f103.4620.12015182382273516484', time=2024-09-19T17:18:03.579369+0000, chain.objs.size()=1 2024-09-19T15:31:40.605 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.600+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:dbb1da81-49d0-421a-b677-974869a7f103.4620.628__shadow_.PO91uME3tRGKpiIRlFg-3oy5A7xB73w_0 2024-09-19T15:31:40.608 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.604+0000 7f91ef1549c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T15:31:40.611 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.604+0000 7f90a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T15:31:40.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.608+0000 7f91ef1549c0 20 remove_watcher() i=0 2024-09-19T15:31:40.613 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.608+0000 7f91ef1549c0 2 removed watcher, disabling cache 2024-09-19T15:31:40.614 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.608+0000 7f91ef1549c0 20 remove_watcher() i=1 2024-09-19T15:31:40.615 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.608+0000 7f91ef1549c0 20 remove_watcher() i=2 2024-09-19T15:31:40.617 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.612+0000 7f91ef1549c0 20 remove_watcher() i=3 2024-09-19T15:31:40.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.612+0000 7f91ef1549c0 20 remove_watcher() i=4 2024-09-19T15:31:40.618 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.612+0000 7f91ef1549c0 20 remove_watcher() i=5 2024-09-19T15:31:40.619 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.616+0000 7f91ef1549c0 20 remove_watcher() i=6 2024-09-19T15:31:40.620 INFO:teuthology.orchestra.run.smithi153.stderr:2024-09-19T15:31:40.616+0000 7f91ef1549c0 20 remove_watcher() i=7 2024-09-19T15:31:40.632 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-19T15:31:40.642 DEBUG:teuthology.orchestra.run.smithi153:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-09-19T15:31:40.681 DEBUG:teuthology.orchestra.run.smithi153:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-19T15:31:40.727 DEBUG:teuthology.orchestra.run.smithi153:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-09-19T15:31:40.776 DEBUG:teuthology.orchestra.run.smithi153:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-19T15:31:40.824 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm /usr/local/share/ca-certificates/root.crt 2024-09-19T15:31:40.880 DEBUG:teuthology.orchestra.run.smithi153:> sudo update-ca-certificates 2024-09-19T15:31:40.936 INFO:teuthology.orchestra.run.smithi153.stdout:Updating certificates in /etc/ssl/certs... 2024-09-19T15:31:41.290 INFO:teuthology.orchestra.run.smithi153.stdout:0 added, 0 removed; done. 2024-09-19T15:31:41.290 INFO:teuthology.orchestra.run.smithi153.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-09-19T15:31:41.292 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:31:41.500 INFO:teuthology.orchestra.run.smithi153.stdout:done. 2024-09-19T15:31:41.501 INFO:teuthology.orchestra.run.smithi153.stdout:done. 2024-09-19T15:31:41.504 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-19T15:31:41.515 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T15:31:41.515 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T15:31:41.876 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:31:41.889 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-19T15:31:41.893 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":3603,"stamp":"2024-09-19T15:31:40.638156+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":793977031,"num_objects":4824,"num_object_clones":0,"num_object_copies":13983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4824,"num_whiteouts":0,"num_read":311889,"num_read_kb":3025534,"num_write":162979,"num_write_kb":2491823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13781,"ondisk_log_size":13781,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2873136,"kb_used_data":1327152,"kb_used_omap":12,"kb_used_meta":1545843,"kb_avail":752101584,"statfs":{"total":773094113280,"available":770152022016,"internally_reserved":0,"allocated":1359003648,"data_stored":1342865424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1582943794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008748"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.609067+0000","last_change":"2024-09-19T14:29:51.038023+0000","last_active":"2024-09-19T15:27:22.609067+0000","last_peered":"2024-09-19T15:27:22.609067+0000","last_clean":"2024-09-19T15:27:22.609067+0000","last_became_active":"2024-09-19T14:29:51.036952+0000","last_became_peered":"2024-09-19T14:29:51.036952+0000","last_unstale":"2024-09-19T15:27:22.609067+0000","last_undegraded":"2024-09-19T15:27:22.609067+0000","last_fullsized":"2024-09-19T15:27:22.609067+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:10:00.951609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:37.612687+0000","last_change":"2024-09-19T14:02:36.913041+0000","last_active":"2024-09-19T15:27:37.612687+0000","last_peered":"2024-09-19T15:27:37.612687+0000","last_clean":"2024-09-19T15:27:37.612687+0000","last_became_active":"2024-09-19T14:02:36.912307+0000","last_became_peered":"2024-09-19T14:02:36.912307+0000","last_unstale":"2024-09-19T15:27:37.612687+0000","last_undegraded":"2024-09-19T15:27:37.612687+0000","last_fullsized":"2024-09-19T15:27:37.612687+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:18:44.440160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"268'9","reported_seq":81,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:33.223470+0000","last_change":"2024-09-19T14:02:29.740551+0000","last_active":"2024-09-19T15:27:33.223470+0000","last_peered":"2024-09-19T15:27:33.223470+0000","last_clean":"2024-09-19T15:27:33.223470+0000","last_became_active":"2024-09-19T14:02:29.739721+0000","last_became_peered":"2024-09-19T14:02:29.739721+0000","last_unstale":"2024-09-19T15:27:33.223470+0000","last_undegraded":"2024-09-19T15:27:33.223470+0000","last_fullsized":"2024-09-19T15:27:33.223470+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:40.747086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":13312,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'35","reported_seq":168,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.179075+0000","last_change":"2024-09-19T13:56:23.181765+0000","last_active":"2024-09-19T15:28:07.179075+0000","last_peered":"2024-09-19T15:28:07.179075+0000","last_clean":"2024-09-19T15:28:07.179075+0000","last_became_active":"2024-09-19T13:56:23.180176+0000","last_became_peered":"2024-09-19T13:56:23.180176+0000","last_unstale":"2024-09-19T15:28:07.179075+0000","last_undegraded":"2024-09-19T15:28:07.179075+0000","last_fullsized":"2024-09-19T15:28:07.179075+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:39.781109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":165,"num_write":94,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.537242+0000","last_change":"2024-09-19T14:29:51.039282+0000","last_active":"2024-09-19T15:27:22.537242+0000","last_peered":"2024-09-19T15:27:22.537242+0000","last_clean":"2024-09-19T15:27:22.537242+0000","last_became_active":"2024-09-19T14:29:51.038289+0000","last_became_peered":"2024-09-19T14:29:51.038289+0000","last_unstale":"2024-09-19T15:27:22.537242+0000","last_undegraded":"2024-09-19T15:27:22.537242+0000","last_fullsized":"2024-09-19T15:27:22.537242+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:16.350420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'1","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:37.593193+0000","last_change":"2024-09-19T14:02:36.915848+0000","last_active":"2024-09-19T15:27:37.593193+0000","last_peered":"2024-09-19T15:27:37.593193+0000","last_clean":"2024-09-19T15:27:37.593193+0000","last_became_active":"2024-09-19T14:02:36.914769+0000","last_became_peered":"2024-09-19T14:02:36.914769+0000","last_unstale":"2024-09-19T15:27:37.593193+0000","last_undegraded":"2024-09-19T15:27:37.593193+0000","last_fullsized":"2024-09-19T15:27:37.593193+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:22.428331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"268'4","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.371625+0000","last_change":"2024-09-19T14:02:29.748087+0000","last_active":"2024-09-19T15:27:32.371625+0000","last_peered":"2024-09-19T15:27:32.371625+0000","last_clean":"2024-09-19T15:27:32.371625+0000","last_became_active":"2024-09-19T14:02:29.747492+0000","last_became_peered":"2024-09-19T14:02:29.747492+0000","last_unstale":"2024-09-19T15:27:32.371625+0000","last_undegraded":"2024-09-19T15:27:32.371625+0000","last_fullsized":"2024-09-19T15:27:32.371625+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:00.163612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":15360,"num_write":9,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'26","reported_seq":153,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.554031+0000","last_change":"2024-09-19T13:56:23.182940+0000","last_active":"2024-09-19T15:28:42.554031+0000","last_peered":"2024-09-19T15:28:42.554031+0000","last_clean":"2024-09-19T15:28:42.554031+0000","last_became_active":"2024-09-19T13:56:23.173377+0000","last_became_peered":"2024-09-19T13:56:23.173377+0000","last_unstale":"2024-09-19T15:28:42.554031+0000","last_undegraded":"2024-09-19T15:28:42.554031+0000","last_fullsized":"2024-09-19T15:28:42.554031+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:53.676663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":124,"num_write":71,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:52.379379+0000","last_change":"2024-09-19T14:29:51.044849+0000","last_active":"2024-09-19T15:27:52.379379+0000","last_peered":"2024-09-19T15:27:52.379379+0000","last_clean":"2024-09-19T15:27:52.379379+0000","last_became_active":"2024-09-19T14:29:51.039043+0000","last_became_peered":"2024-09-19T14:29:51.039043+0000","last_unstale":"2024-09-19T15:27:52.379379+0000","last_undegraded":"2024-09-19T15:27:52.379379+0000","last_fullsized":"2024-09-19T15:27:52.379379+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:50.442880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"268'2","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.178182+0000","last_change":"2024-09-19T14:02:37.054013+0000","last_active":"2024-09-19T15:28:02.178182+0000","last_peered":"2024-09-19T15:28:02.178182+0000","last_clean":"2024-09-19T15:28:02.178182+0000","last_became_active":"2024-09-19T14:02:37.051665+0000","last_became_peered":"2024-09-19T14:02:37.051665+0000","last_unstale":"2024-09-19T15:28:02.178182+0000","last_undegraded":"2024-09-19T15:28:02.178182+0000","last_fullsized":"2024-09-19T15:28:02.178182+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:50.720956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:52.556050+0000","last_change":"2024-09-19T14:02:29.725591+0000","last_active":"2024-09-19T15:28:52.556050+0000","last_peered":"2024-09-19T15:28:52.556050+0000","last_clean":"2024-09-19T15:28:52.556050+0000","last_became_active":"2024-09-19T14:02:29.724866+0000","last_became_peered":"2024-09-19T14:02:29.724866+0000","last_unstale":"2024-09-19T15:28:52.556050+0000","last_undegraded":"2024-09-19T15:28:52.556050+0000","last_fullsized":"2024-09-19T15:28:52.556050+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:44.282362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'36","reported_seq":169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.190273+0000","last_change":"2024-09-19T13:56:23.181435+0000","last_active":"2024-09-19T15:28:57.190273+0000","last_peered":"2024-09-19T15:28:57.190273+0000","last_clean":"2024-09-19T15:28:57.190273+0000","last_became_active":"2024-09-19T13:56:23.180159+0000","last_became_peered":"2024-09-19T13:56:23.180159+0000","last_unstale":"2024-09-19T15:28:57.190273+0000","last_undegraded":"2024-09-19T15:28:57.190273+0000","last_fullsized":"2024-09-19T15:28:57.190273+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:34:32.230609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":283,"num_read_kb":171,"num_write":89,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:03.230461+0000","last_change":"2024-09-19T14:29:51.030209+0000","last_active":"2024-09-19T15:28:03.230461+0000","last_peered":"2024-09-19T15:28:03.230461+0000","last_clean":"2024-09-19T15:28:03.230461+0000","last_became_active":"2024-09-19T14:29:51.029426+0000","last_became_peered":"2024-09-19T14:29:51.029426+0000","last_unstale":"2024-09-19T15:28:03.230461+0000","last_undegraded":"2024-09-19T15:28:03.230461+0000","last_fullsized":"2024-09-19T15:28:03.230461+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:42:56.183067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"268'2","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:48.241073+0000","last_change":"2024-09-19T14:02:37.053245+0000","last_active":"2024-09-19T15:28:48.241073+0000","last_peered":"2024-09-19T15:28:48.241073+0000","last_clean":"2024-09-19T15:28:48.241073+0000","last_became_active":"2024-09-19T14:02:37.052510+0000","last_became_peered":"2024-09-19T14:02:37.052510+0000","last_unstale":"2024-09-19T15:28:48.241073+0000","last_undegraded":"2024-09-19T15:28:48.241073+0000","last_fullsized":"2024-09-19T15:28:48.241073+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:25.091691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.597885+0000","last_change":"2024-09-19T14:02:29.736849+0000","last_active":"2024-09-19T15:27:57.597885+0000","last_peered":"2024-09-19T15:27:57.597885+0000","last_clean":"2024-09-19T15:27:57.597885+0000","last_became_active":"2024-09-19T14:02:29.736074+0000","last_became_peered":"2024-09-19T14:02:29.736074+0000","last_unstale":"2024-09-19T15:27:57.597885+0000","last_undegraded":"2024-09-19T15:27:57.597885+0000","last_fullsized":"2024-09-19T15:27:57.597885+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:49.441598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'63","reported_seq":244,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:53.242175+0000","last_change":"2024-09-19T13:56:23.179692+0000","last_active":"2024-09-19T15:28:53.242175+0000","last_peered":"2024-09-19T15:28:53.242175+0000","last_clean":"2024-09-19T15:28:53.242175+0000","last_became_active":"2024-09-19T13:56:23.179235+0000","last_became_peered":"2024-09-19T13:56:23.179235+0000","last_unstale":"2024-09-19T15:28:53.242175+0000","last_undegraded":"2024-09-19T15:28:53.242175+0000","last_fullsized":"2024-09-19T15:28:53.242175+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:47.927569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":508,"num_read_kb":362,"num_write":155,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:03.230734+0000","last_change":"2024-09-19T14:29:51.053238+0000","last_active":"2024-09-19T15:28:03.230734+0000","last_peered":"2024-09-19T15:28:03.230734+0000","last_clean":"2024-09-19T15:28:03.230734+0000","last_became_active":"2024-09-19T14:29:51.052562+0000","last_became_peered":"2024-09-19T14:29:51.052562+0000","last_unstale":"2024-09-19T15:28:03.230734+0000","last_undegraded":"2024-09-19T15:28:03.230734+0000","last_fullsized":"2024-09-19T15:28:03.230734+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:06:42.849046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"268'6","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.611337+0000","last_change":"2024-09-19T14:02:36.931028+0000","last_active":"2024-09-19T15:27:32.611337+0000","last_peered":"2024-09-19T15:27:32.611337+0000","last_clean":"2024-09-19T15:27:32.611337+0000","last_became_active":"2024-09-19T14:02:36.930344+0000","last_became_peered":"2024-09-19T14:02:36.930344+0000","last_unstale":"2024-09-19T15:27:32.611337+0000","last_undegraded":"2024-09-19T15:27:32.611337+0000","last_fullsized":"2024-09-19T15:27:32.611337+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:10:56.230063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'7","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:07.166400+0000","last_change":"2024-09-19T14:02:29.741351+0000","last_active":"2024-09-19T15:27:07.166400+0000","last_peered":"2024-09-19T15:27:07.166400+0000","last_clean":"2024-09-19T15:27:07.166400+0000","last_became_active":"2024-09-19T14:02:29.740291+0000","last_became_peered":"2024-09-19T14:02:29.740291+0000","last_unstale":"2024-09-19T15:27:07.166400+0000","last_undegraded":"2024-09-19T15:27:07.166400+0000","last_fullsized":"2024-09-19T15:27:07.166400+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:33:40.597174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":26626,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'10","reported_seq":101,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:53.242112+0000","last_change":"2024-09-19T13:56:23.170087+0000","last_active":"2024-09-19T15:28:53.242112+0000","last_peered":"2024-09-19T15:28:53.242112+0000","last_clean":"2024-09-19T15:28:53.242112+0000","last_became_active":"2024-09-19T13:56:23.169371+0000","last_became_peered":"2024-09-19T13:56:23.169371+0000","last_unstale":"2024-09-19T15:28:53.242112+0000","last_undegraded":"2024-09-19T15:28:53.242112+0000","last_fullsized":"2024-09-19T15:28:53.242112+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:41:15.161070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":43,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381528+0000","last_change":"2024-09-19T14:29:51.049819+0000","last_active":"2024-09-19T15:28:12.381528+0000","last_peered":"2024-09-19T15:28:12.381528+0000","last_clean":"2024-09-19T15:28:12.381528+0000","last_became_active":"2024-09-19T14:29:51.049146+0000","last_became_peered":"2024-09-19T14:29:51.049146+0000","last_unstale":"2024-09-19T15:28:12.381528+0000","last_undegraded":"2024-09-19T15:28:12.381528+0000","last_fullsized":"2024-09-19T15:28:12.381528+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:39.379659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:12.568908+0000","last_change":"2024-09-19T14:02:36.928119+0000","last_active":"2024-09-19T15:27:12.568908+0000","last_peered":"2024-09-19T15:27:12.568908+0000","last_clean":"2024-09-19T15:27:12.568908+0000","last_became_active":"2024-09-19T14:02:36.927382+0000","last_became_peered":"2024-09-19T14:02:36.927382+0000","last_unstale":"2024-09-19T15:27:12.568908+0000","last_undegraded":"2024-09-19T15:27:12.568908+0000","last_fullsized":"2024-09-19T15:27:12.568908+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:18.568506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"268'1","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:27.590718+0000","last_change":"2024-09-19T14:02:29.723753+0000","last_active":"2024-09-19T15:27:27.590718+0000","last_peered":"2024-09-19T15:27:27.590718+0000","last_clean":"2024-09-19T15:27:27.590718+0000","last_became_active":"2024-09-19T14:02:29.722193+0000","last_became_peered":"2024-09-19T14:02:29.722193+0000","last_unstale":"2024-09-19T15:27:27.590718+0000","last_undegraded":"2024-09-19T15:27:27.590718+0000","last_fullsized":"2024-09-19T15:27:27.590718+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:12.251421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'21","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:52.392809+0000","last_change":"2024-09-19T13:56:23.175249+0000","last_active":"2024-09-19T15:28:52.392809+0000","last_peered":"2024-09-19T15:28:52.392809+0000","last_clean":"2024-09-19T15:28:52.392809+0000","last_became_active":"2024-09-19T13:56:23.174511+0000","last_became_peered":"2024-09-19T13:56:23.174511+0000","last_unstale":"2024-09-19T15:28:52.392809+0000","last_undegraded":"2024-09-19T15:28:52.392809+0000","last_fullsized":"2024-09-19T15:28:52.392809+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:24.782915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":102,"num_write":56,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.629613+0000","last_change":"2024-09-19T14:29:51.041850+0000","last_active":"2024-09-19T15:27:22.629613+0000","last_peered":"2024-09-19T15:27:22.629613+0000","last_clean":"2024-09-19T15:27:22.629613+0000","last_became_active":"2024-09-19T14:29:51.039919+0000","last_became_peered":"2024-09-19T14:29:51.039919+0000","last_unstale":"2024-09-19T15:27:22.629613+0000","last_undegraded":"2024-09-19T15:27:22.629613+0000","last_fullsized":"2024-09-19T15:27:22.629613+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:56.764514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"265'8","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:37.574384+0000","last_change":"2024-09-19T14:02:36.919460+0000","last_active":"2024-09-19T15:27:37.574384+0000","last_peered":"2024-09-19T15:27:37.574384+0000","last_clean":"2024-09-19T15:27:37.574384+0000","last_became_active":"2024-09-19T14:02:36.918707+0000","last_became_peered":"2024-09-19T14:02:36.918707+0000","last_unstale":"2024-09-19T15:27:37.574384+0000","last_undegraded":"2024-09-19T15:27:37.574384+0000","last_fullsized":"2024-09-19T15:27:37.574384+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:50.554567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9218,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.591968+0000","last_change":"2024-09-19T14:02:29.740667+0000","last_active":"2024-09-19T15:27:32.591968+0000","last_peered":"2024-09-19T15:27:32.591968+0000","last_clean":"2024-09-19T15:27:32.591968+0000","last_became_active":"2024-09-19T14:02:29.739955+0000","last_became_peered":"2024-09-19T14:02:29.739955+0000","last_unstale":"2024-09-19T15:27:32.591968+0000","last_undegraded":"2024-09-19T15:27:32.591968+0000","last_fullsized":"2024-09-19T15:27:32.591968+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:34:51.448763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'12","reported_seq":107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:47.187823+0000","last_change":"2024-09-19T13:56:23.179307+0000","last_active":"2024-09-19T15:28:47.187823+0000","last_peered":"2024-09-19T15:28:47.187823+0000","last_clean":"2024-09-19T15:28:47.187823+0000","last_became_active":"2024-09-19T13:56:23.170272+0000","last_became_peered":"2024-09-19T13:56:23.170272+0000","last_unstale":"2024-09-19T15:28:47.187823+0000","last_undegraded":"2024-09-19T15:28:47.187823+0000","last_fullsized":"2024-09-19T15:28:47.187823+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:47:57.598767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.629764+0000","last_change":"2024-09-19T14:29:51.059050+0000","last_active":"2024-09-19T15:27:22.629764+0000","last_peered":"2024-09-19T15:27:22.629764+0000","last_clean":"2024-09-19T15:27:22.629764+0000","last_became_active":"2024-09-19T14:29:51.058380+0000","last_became_peered":"2024-09-19T14:29:51.058380+0000","last_unstale":"2024-09-19T15:27:22.629764+0000","last_undegraded":"2024-09-19T15:27:22.629764+0000","last_fullsized":"2024-09-19T15:27:22.629764+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:35.762726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:38.224574+0000","last_change":"2024-09-19T14:02:36.926259+0000","last_active":"2024-09-19T15:27:38.224574+0000","last_peered":"2024-09-19T15:27:38.224574+0000","last_clean":"2024-09-19T15:27:38.224574+0000","last_became_active":"2024-09-19T14:02:36.924268+0000","last_became_peered":"2024-09-19T14:02:36.924268+0000","last_unstale":"2024-09-19T15:27:38.224574+0000","last_undegraded":"2024-09-19T15:27:38.224574+0000","last_fullsized":"2024-09-19T15:27:38.224574+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:52.337740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.171539+0000","last_change":"2024-09-19T14:02:29.745987+0000","last_active":"2024-09-19T15:27:32.171539+0000","last_peered":"2024-09-19T15:27:32.171539+0000","last_clean":"2024-09-19T15:27:32.171539+0000","last_became_active":"2024-09-19T14:02:29.741114+0000","last_became_peered":"2024-09-19T14:02:29.741114+0000","last_unstale":"2024-09-19T15:27:32.171539+0000","last_undegraded":"2024-09-19T15:27:32.171539+0000","last_fullsized":"2024-09-19T15:27:32.171539+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:21.115185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"268'44","reported_seq":192,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381292+0000","last_change":"2024-09-19T13:56:23.177841+0000","last_active":"2024-09-19T15:28:12.381292+0000","last_peered":"2024-09-19T15:28:12.381292+0000","last_clean":"2024-09-19T15:28:12.381292+0000","last_became_active":"2024-09-19T13:56:23.177082+0000","last_became_peered":"2024-09-19T13:56:23.177082+0000","last_unstale":"2024-09-19T15:28:12.381292+0000","last_undegraded":"2024-09-19T15:28:12.381292+0000","last_fullsized":"2024-09-19T15:28:12.381292+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:57:48.702504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":229,"num_write":111,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381366+0000","last_change":"2024-09-19T14:29:51.037911+0000","last_active":"2024-09-19T15:28:12.381366+0000","last_peered":"2024-09-19T15:28:12.381366+0000","last_clean":"2024-09-19T15:28:12.381366+0000","last_became_active":"2024-09-19T14:29:51.036980+0000","last_became_peered":"2024-09-19T14:29:51.036980+0000","last_unstale":"2024-09-19T15:28:12.381366+0000","last_undegraded":"2024-09-19T15:28:12.381366+0000","last_fullsized":"2024-09-19T15:28:12.381366+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:55.591300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:13.218778+0000","last_change":"2024-09-19T14:02:37.052547+0000","last_active":"2024-09-19T15:27:13.218778+0000","last_peered":"2024-09-19T15:27:13.218778+0000","last_clean":"2024-09-19T15:27:13.218778+0000","last_became_active":"2024-09-19T14:02:37.051627+0000","last_became_peered":"2024-09-19T14:02:37.051627+0000","last_unstale":"2024-09-19T15:27:13.218778+0000","last_undegraded":"2024-09-19T15:27:13.218778+0000","last_fullsized":"2024-09-19T15:27:13.218778+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:03.602347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'9","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.634582+0000","last_change":"2024-09-19T14:02:29.725819+0000","last_active":"2024-09-19T15:29:12.634582+0000","last_peered":"2024-09-19T15:29:12.634582+0000","last_clean":"2024-09-19T15:29:12.634582+0000","last_became_active":"2024-09-19T14:02:29.725042+0000","last_became_peered":"2024-09-19T14:02:29.725042+0000","last_unstale":"2024-09-19T15:29:12.634582+0000","last_undegraded":"2024-09-19T15:29:12.634582+0000","last_fullsized":"2024-09-19T15:29:12.634582+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:36.488155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":17453,"num_write":14,"num_write_kb":14381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'39","reported_seq":180,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:17.181387+0000","last_change":"2024-09-19T13:56:23.180645+0000","last_active":"2024-09-19T15:28:17.181387+0000","last_peered":"2024-09-19T15:28:17.181387+0000","last_clean":"2024-09-19T15:28:17.181387+0000","last_became_active":"2024-09-19T13:56:23.179656+0000","last_became_peered":"2024-09-19T13:56:23.179656+0000","last_unstale":"2024-09-19T15:28:17.181387+0000","last_undegraded":"2024-09-19T15:28:17.181387+0000","last_fullsized":"2024-09-19T15:28:17.181387+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:23.453827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":202,"num_write":114,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.547652+0000","last_change":"2024-09-19T14:29:51.035627+0000","last_active":"2024-09-19T15:28:12.547652+0000","last_peered":"2024-09-19T15:28:12.547652+0000","last_clean":"2024-09-19T15:28:12.547652+0000","last_became_active":"2024-09-19T14:29:51.034910+0000","last_became_peered":"2024-09-19T14:29:51.034910+0000","last_unstale":"2024-09-19T15:28:12.547652+0000","last_undegraded":"2024-09-19T15:28:12.547652+0000","last_fullsized":"2024-09-19T15:28:12.547652+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:52.799048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"268'3","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:08.245768+0000","last_change":"2024-09-19T14:02:37.050424+0000","last_active":"2024-09-19T15:29:08.245768+0000","last_peered":"2024-09-19T15:29:08.245768+0000","last_clean":"2024-09-19T15:29:08.245768+0000","last_became_active":"2024-09-19T14:02:37.049593+0000","last_became_peered":"2024-09-19T14:02:37.049593+0000","last_unstale":"2024-09-19T15:29:08.245768+0000","last_undegraded":"2024-09-19T15:29:08.245768+0000","last_fullsized":"2024-09-19T15:29:08.245768+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:09.018084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5827243,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":8,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"268'6","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:07.625930+0000","last_change":"2024-09-19T14:02:29.738371+0000","last_active":"2024-09-19T15:27:07.625930+0000","last_peered":"2024-09-19T15:27:07.625930+0000","last_clean":"2024-09-19T15:27:07.625930+0000","last_became_active":"2024-09-19T14:02:29.737689+0000","last_became_peered":"2024-09-19T14:02:29.737689+0000","last_unstale":"2024-09-19T15:27:07.625930+0000","last_undegraded":"2024-09-19T15:27:07.625930+0000","last_fullsized":"2024-09-19T15:27:07.625930+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:43.480539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5718,"num_write":6,"num_write_kb":5718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'32","reported_seq":159,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:13.233083+0000","last_change":"2024-09-19T13:56:23.172875+0000","last_active":"2024-09-19T15:28:13.233083+0000","last_peered":"2024-09-19T15:28:13.233083+0000","last_clean":"2024-09-19T15:28:13.233083+0000","last_became_active":"2024-09-19T13:56:23.172185+0000","last_became_peered":"2024-09-19T13:56:23.172185+0000","last_unstale":"2024-09-19T15:28:13.233083+0000","last_undegraded":"2024-09-19T15:28:13.233083+0000","last_fullsized":"2024-09-19T15:28:13.233083+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:08:40.622542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":246,"num_read_kb":158,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.641708+0000","last_change":"2024-09-19T14:29:51.040551+0000","last_active":"2024-09-19T15:28:12.641708+0000","last_peered":"2024-09-19T15:28:12.641708+0000","last_clean":"2024-09-19T15:28:12.641708+0000","last_became_active":"2024-09-19T14:29:51.039877+0000","last_became_peered":"2024-09-19T14:29:51.039877+0000","last_unstale":"2024-09-19T15:28:12.641708+0000","last_undegraded":"2024-09-19T15:28:12.641708+0000","last_fullsized":"2024-09-19T15:28:12.641708+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:34:37.191773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"268'9","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:13.218849+0000","last_change":"2024-09-19T14:02:37.055970+0000","last_active":"2024-09-19T15:27:13.218849+0000","last_peered":"2024-09-19T15:27:13.218849+0000","last_clean":"2024-09-19T15:27:13.218849+0000","last_became_active":"2024-09-19T14:02:37.055184+0000","last_became_peered":"2024-09-19T14:02:37.055184+0000","last_unstale":"2024-09-19T15:27:13.218849+0000","last_undegraded":"2024-09-19T15:27:13.218849+0000","last_fullsized":"2024-09-19T15:27:13.218849+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:47.611898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":24576,"num_write":19,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"268'2","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:07.533527+0000","last_change":"2024-09-19T14:02:29.733490+0000","last_active":"2024-09-19T15:27:07.533527+0000","last_peered":"2024-09-19T15:27:07.533527+0000","last_clean":"2024-09-19T15:27:07.533527+0000","last_became_active":"2024-09-19T14:02:29.732063+0000","last_became_peered":"2024-09-19T14:02:29.732063+0000","last_unstale":"2024-09-19T15:27:07.533527+0000","last_undegraded":"2024-09-19T15:27:07.533527+0000","last_fullsized":"2024-09-19T15:27:07.533527+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:16:28.644404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'18","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.547747+0000","last_change":"2024-09-19T13:56:23.181555+0000","last_active":"2024-09-19T15:28:12.547747+0000","last_peered":"2024-09-19T15:28:12.547747+0000","last_clean":"2024-09-19T15:28:12.547747+0000","last_became_active":"2024-09-19T13:56:23.172998+0000","last_became_peered":"2024-09-19T13:56:23.172998+0000","last_unstale":"2024-09-19T15:28:12.547747+0000","last_undegraded":"2024-09-19T15:28:12.547747+0000","last_fullsized":"2024-09-19T15:28:12.547747+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:40:22.358000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.620591+0000","last_change":"2024-09-19T14:29:51.021155+0000","last_active":"2024-09-19T15:28:12.620591+0000","last_peered":"2024-09-19T15:28:12.620591+0000","last_clean":"2024-09-19T15:28:12.620591+0000","last_became_active":"2024-09-19T14:29:51.020277+0000","last_became_peered":"2024-09-19T14:29:51.020277+0000","last_unstale":"2024-09-19T15:28:12.620591+0000","last_undegraded":"2024-09-19T15:28:12.620591+0000","last_fullsized":"2024-09-19T15:28:12.620591+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:00.755087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"268'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:12.587546+0000","last_change":"2024-09-19T14:02:36.916711+0000","last_active":"2024-09-19T15:27:12.587546+0000","last_peered":"2024-09-19T15:27:12.587546+0000","last_clean":"2024-09-19T15:27:12.587546+0000","last_became_active":"2024-09-19T14:02:36.915962+0000","last_became_peered":"2024-09-19T14:02:36.915962+0000","last_unstale":"2024-09-19T15:27:12.587546+0000","last_undegraded":"2024-09-19T15:27:12.587546+0000","last_fullsized":"2024-09-19T15:27:12.587546+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:52.527680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:07.166557+0000","last_change":"2024-09-19T14:02:29.746541+0000","last_active":"2024-09-19T15:27:07.166557+0000","last_peered":"2024-09-19T15:27:07.166557+0000","last_clean":"2024-09-19T15:27:07.166557+0000","last_became_active":"2024-09-19T14:02:29.741726+0000","last_became_peered":"2024-09-19T14:02:29.741726+0000","last_unstale":"2024-09-19T15:27:07.166557+0000","last_undegraded":"2024-09-19T15:27:07.166557+0000","last_fullsized":"2024-09-19T15:27:07.166557+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:18.927081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'18","reported_seq":120,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:42.634520+0000","last_change":"2024-09-19T13:56:23.176208+0000","last_active":"2024-09-19T15:27:42.634520+0000","last_peered":"2024-09-19T15:27:42.634520+0000","last_clean":"2024-09-19T15:27:42.634520+0000","last_became_active":"2024-09-19T13:56:23.175483+0000","last_became_peered":"2024-09-19T13:56:23.175483+0000","last_unstale":"2024-09-19T15:27:42.634520+0000","last_undegraded":"2024-09-19T15:27:42.634520+0000","last_fullsized":"2024-09-19T15:27:42.634520+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:44:12.241473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":81,"num_write":47,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:53.228080+0000","last_change":"2024-09-19T14:29:51.055111+0000","last_active":"2024-09-19T15:27:53.228080+0000","last_peered":"2024-09-19T15:27:53.228080+0000","last_clean":"2024-09-19T15:27:53.228080+0000","last_became_active":"2024-09-19T14:29:51.054440+0000","last_became_peered":"2024-09-19T14:29:51.054440+0000","last_unstale":"2024-09-19T15:27:53.228080+0000","last_undegraded":"2024-09-19T15:27:53.228080+0000","last_fullsized":"2024-09-19T15:27:53.228080+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:41:52.609606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391603+0000","last_change":"2024-09-19T14:02:36.918632+0000","last_active":"2024-09-19T15:28:57.391603+0000","last_peered":"2024-09-19T15:28:57.391603+0000","last_clean":"2024-09-19T15:28:57.391603+0000","last_became_active":"2024-09-19T14:02:36.917886+0000","last_became_peered":"2024-09-19T14:02:36.917886+0000","last_unstale":"2024-09-19T15:28:57.391603+0000","last_undegraded":"2024-09-19T15:28:57.391603+0000","last_fullsized":"2024-09-19T15:28:57.391603+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:45:01.058163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"268'2","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:52.610272+0000","last_change":"2024-09-19T14:02:29.730814+0000","last_active":"2024-09-19T15:28:52.610272+0000","last_peered":"2024-09-19T15:28:52.610272+0000","last_clean":"2024-09-19T15:28:52.610272+0000","last_became_active":"2024-09-19T14:02:29.730095+0000","last_became_peered":"2024-09-19T14:02:29.730095+0000","last_unstale":"2024-09-19T15:28:52.610272+0000","last_undegraded":"2024-09-19T15:28:52.610272+0000","last_fullsized":"2024-09-19T15:28:52.610272+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:08.221591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'29","reported_seq":148,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.629547+0000","last_change":"2024-09-19T13:56:23.184572+0000","last_active":"2024-09-19T15:27:22.629547+0000","last_peered":"2024-09-19T15:27:22.629547+0000","last_clean":"2024-09-19T15:27:22.629547+0000","last_became_active":"2024-09-19T13:56:23.183825+0000","last_became_peered":"2024-09-19T13:56:23.183825+0000","last_unstale":"2024-09-19T15:27:22.629547+0000","last_undegraded":"2024-09-19T15:27:22.629547+0000","last_fullsized":"2024-09-19T15:27:22.629547+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:11.504818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":139,"num_write":76,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:52.175719+0000","last_change":"2024-09-19T14:29:51.036785+0000","last_active":"2024-09-19T15:27:52.175719+0000","last_peered":"2024-09-19T15:27:52.175719+0000","last_clean":"2024-09-19T15:27:52.175719+0000","last_became_active":"2024-09-19T14:29:51.036062+0000","last_became_peered":"2024-09-19T14:29:51.036062+0000","last_unstale":"2024-09-19T15:27:52.175719+0000","last_undegraded":"2024-09-19T15:27:52.175719+0000","last_fullsized":"2024-09-19T15:27:52.175719+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:13:16.540530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'3","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391538+0000","last_change":"2024-09-19T14:02:36.911361+0000","last_active":"2024-09-19T15:28:57.391538+0000","last_peered":"2024-09-19T15:28:57.391538+0000","last_clean":"2024-09-19T15:28:57.391538+0000","last_became_active":"2024-09-19T14:02:36.910298+0000","last_became_peered":"2024-09-19T14:02:36.910298+0000","last_unstale":"2024-09-19T15:28:57.391538+0000","last_undegraded":"2024-09-19T15:28:57.391538+0000","last_fullsized":"2024-09-19T15:28:57.391538+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:11:03.122123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'2","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:53.242045+0000","last_change":"2024-09-19T14:02:29.734818+0000","last_active":"2024-09-19T15:28:53.242045+0000","last_peered":"2024-09-19T15:28:53.242045+0000","last_clean":"2024-09-19T15:28:53.242045+0000","last_became_active":"2024-09-19T14:02:29.732413+0000","last_became_peered":"2024-09-19T14:02:29.732413+0000","last_unstale":"2024-09-19T15:28:53.242045+0000","last_undegraded":"2024-09-19T15:28:53.242045+0000","last_fullsized":"2024-09-19T15:28:53.242045+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:35.923776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"268'52","reported_seq":214,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:27.170202+0000","last_change":"2024-09-19T13:56:23.162178+0000","last_active":"2024-09-19T15:27:27.170202+0000","last_peered":"2024-09-19T15:27:27.170202+0000","last_clean":"2024-09-19T15:27:27.170202+0000","last_became_active":"2024-09-19T13:56:23.161268+0000","last_became_peered":"2024-09-19T13:56:23.161268+0000","last_unstale":"2024-09-19T15:27:27.170202+0000","last_undegraded":"2024-09-19T15:27:27.170202+0000","last_fullsized":"2024-09-19T15:27:27.170202+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:49.310248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":413,"num_read_kb":272,"num_write":131,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:32.184540+0000","last_change":"2024-09-19T14:29:51.057255+0000","last_active":"2024-09-19T15:28:32.184540+0000","last_peered":"2024-09-19T15:28:32.184540+0000","last_clean":"2024-09-19T15:28:32.184540+0000","last_became_active":"2024-09-19T14:29:51.055396+0000","last_became_peered":"2024-09-19T14:29:51.055396+0000","last_unstale":"2024-09-19T15:28:32.184540+0000","last_undegraded":"2024-09-19T15:28:32.184540+0000","last_fullsized":"2024-09-19T15:28:32.184540+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:09.497977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:58.243369+0000","last_change":"2024-09-19T14:02:36.927347+0000","last_active":"2024-09-19T15:28:58.243369+0000","last_peered":"2024-09-19T15:28:58.243369+0000","last_clean":"2024-09-19T15:28:58.243369+0000","last_became_active":"2024-09-19T14:02:36.926038+0000","last_became_peered":"2024-09-19T14:02:36.926038+0000","last_unstale":"2024-09-19T15:28:58.243369+0000","last_undegraded":"2024-09-19T15:28:58.243369+0000","last_fullsized":"2024-09-19T15:28:58.243369+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:13:52.343458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"268'4","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:52.392853+0000","last_change":"2024-09-19T14:02:29.741324+0000","last_active":"2024-09-19T15:28:52.392853+0000","last_peered":"2024-09-19T15:28:52.392853+0000","last_clean":"2024-09-19T15:28:52.392853+0000","last_became_active":"2024-09-19T14:02:29.740451+0000","last_became_peered":"2024-09-19T14:02:29.740451+0000","last_unstale":"2024-09-19T15:28:52.392853+0000","last_undegraded":"2024-09-19T15:28:52.392853+0000","last_fullsized":"2024-09-19T15:28:52.392853+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:22.134435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":9,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'35","reported_seq":173,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.589590+0000","last_change":"2024-09-19T13:56:23.176932+0000","last_active":"2024-09-19T15:27:22.589590+0000","last_peered":"2024-09-19T15:27:22.589590+0000","last_clean":"2024-09-19T15:27:22.589590+0000","last_became_active":"2024-09-19T13:56:23.170486+0000","last_became_peered":"2024-09-19T13:56:23.170486+0000","last_unstale":"2024-09-19T15:27:22.589590+0000","last_undegraded":"2024-09-19T15:27:22.589590+0000","last_fullsized":"2024-09-19T15:27:22.589590+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:43:58.374761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":196,"num_write":86,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:53.227989+0000","last_change":"2024-09-19T14:29:51.045330+0000","last_active":"2024-09-19T15:27:53.227989+0000","last_peered":"2024-09-19T15:27:53.227989+0000","last_clean":"2024-09-19T15:27:53.227989+0000","last_became_active":"2024-09-19T14:29:51.044154+0000","last_became_peered":"2024-09-19T14:29:51.044154+0000","last_unstale":"2024-09-19T15:27:53.227989+0000","last_undegraded":"2024-09-19T15:27:53.227989+0000","last_fullsized":"2024-09-19T15:27:53.227989+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:18.797951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.394100+0000","last_change":"2024-09-19T14:02:36.923267+0000","last_active":"2024-09-19T15:28:57.394100+0000","last_peered":"2024-09-19T15:28:57.394100+0000","last_clean":"2024-09-19T15:28:57.394100+0000","last_became_active":"2024-09-19T14:02:36.918735+0000","last_became_peered":"2024-09-19T14:02:36.918735+0000","last_unstale":"2024-09-19T15:28:57.394100+0000","last_undegraded":"2024-09-19T15:28:57.394100+0000","last_fullsized":"2024-09-19T15:28:57.394100+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:11.400154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:52.629773+0000","last_change":"2024-09-19T14:02:29.742726+0000","last_active":"2024-09-19T15:28:52.629773+0000","last_peered":"2024-09-19T15:28:52.629773+0000","last_clean":"2024-09-19T15:28:52.629773+0000","last_became_active":"2024-09-19T14:02:29.742091+0000","last_became_peered":"2024-09-19T14:02:29.742091+0000","last_unstale":"2024-09-19T15:28:52.629773+0000","last_undegraded":"2024-09-19T15:28:52.629773+0000","last_fullsized":"2024-09-19T15:28:52.629773+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:13:04.562095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'40","reported_seq":180,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:23.220896+0000","last_change":"2024-09-19T13:56:23.173987+0000","last_active":"2024-09-19T15:27:23.220896+0000","last_peered":"2024-09-19T15:27:23.220896+0000","last_clean":"2024-09-19T15:27:23.220896+0000","last_became_active":"2024-09-19T13:56:23.173245+0000","last_became_peered":"2024-09-19T13:56:23.173245+0000","last_unstale":"2024-09-19T15:27:23.220896+0000","last_undegraded":"2024-09-19T15:27:23.220896+0000","last_fullsized":"2024-09-19T15:27:23.220896+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:55:35.220716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":315,"num_read_kb":214,"num_write":104,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.552846+0000","last_change":"2024-09-19T14:29:51.044619+0000","last_active":"2024-09-19T15:28:37.552846+0000","last_peered":"2024-09-19T15:28:37.552846+0000","last_clean":"2024-09-19T15:28:37.552846+0000","last_became_active":"2024-09-19T14:29:51.043979+0000","last_became_peered":"2024-09-19T14:29:51.043979+0000","last_unstale":"2024-09-19T15:28:37.552846+0000","last_undegraded":"2024-09-19T15:28:37.552846+0000","last_fullsized":"2024-09-19T15:28:37.552846+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:31:38.625664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"268'1","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:08.231736+0000","last_change":"2024-09-19T14:02:36.926635+0000","last_active":"2024-09-19T15:28:08.231736+0000","last_peered":"2024-09-19T15:28:08.231736+0000","last_clean":"2024-09-19T15:28:08.231736+0000","last_became_active":"2024-09-19T14:02:36.925870+0000","last_became_peered":"2024-09-19T14:02:36.925870+0000","last_unstale":"2024-09-19T15:28:08.231736+0000","last_undegraded":"2024-09-19T15:28:08.231736+0000","last_fullsized":"2024-09-19T15:28:08.231736+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:50:58.009640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.639477+0000","last_change":"2024-09-19T14:02:29.745325+0000","last_active":"2024-09-19T15:28:02.639477+0000","last_peered":"2024-09-19T15:28:02.639477+0000","last_clean":"2024-09-19T15:28:02.639477+0000","last_became_active":"2024-09-19T14:02:29.744169+0000","last_became_peered":"2024-09-19T14:02:29.744169+0000","last_unstale":"2024-09-19T15:28:02.639477+0000","last_undegraded":"2024-09-19T15:28:02.639477+0000","last_fullsized":"2024-09-19T15:28:02.639477+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:49:32.607973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'31","reported_seq":167,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:48.241100+0000","last_change":"2024-09-19T13:56:23.167169+0000","last_active":"2024-09-19T15:28:48.241100+0000","last_peered":"2024-09-19T15:28:48.241100+0000","last_clean":"2024-09-19T15:28:48.241100+0000","last_became_active":"2024-09-19T13:56:23.160134+0000","last_became_peered":"2024-09-19T13:56:23.160134+0000","last_unstale":"2024-09-19T15:28:48.241100+0000","last_undegraded":"2024-09-19T15:28:48.241100+0000","last_fullsized":"2024-09-19T15:28:48.241100+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:17.424039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":163,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644264+0000","last_change":"2024-09-19T14:29:51.059018+0000","last_active":"2024-09-19T15:28:22.644264+0000","last_peered":"2024-09-19T15:28:22.644264+0000","last_clean":"2024-09-19T15:28:22.644264+0000","last_became_active":"2024-09-19T14:29:51.058494+0000","last_became_peered":"2024-09-19T14:29:51.058494+0000","last_unstale":"2024-09-19T15:28:22.644264+0000","last_undegraded":"2024-09-19T15:28:22.644264+0000","last_fullsized":"2024-09-19T15:28:22.644264+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:29.224657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:08.231677+0000","last_change":"2024-09-19T14:02:36.924847+0000","last_active":"2024-09-19T15:28:08.231677+0000","last_peered":"2024-09-19T15:28:08.231677+0000","last_clean":"2024-09-19T15:28:08.231677+0000","last_became_active":"2024-09-19T14:02:36.924213+0000","last_became_peered":"2024-09-19T14:02:36.924213+0000","last_unstale":"2024-09-19T15:28:08.231677+0000","last_undegraded":"2024-09-19T15:28:08.231677+0000","last_fullsized":"2024-09-19T15:28:08.231677+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:25.039869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.545625+0000","last_change":"2024-09-19T14:02:29.752025+0000","last_active":"2024-09-19T15:28:02.545625+0000","last_peered":"2024-09-19T15:28:02.545625+0000","last_clean":"2024-09-19T15:28:02.545625+0000","last_became_active":"2024-09-19T14:02:29.751229+0000","last_became_peered":"2024-09-19T14:02:29.751229+0000","last_unstale":"2024-09-19T15:28:02.545625+0000","last_undegraded":"2024-09-19T15:28:02.545625+0000","last_fullsized":"2024-09-19T15:28:02.545625+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:04.084148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"268'30","reported_seq":156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.626409+0000","last_change":"2024-09-19T13:56:23.168672+0000","last_active":"2024-09-19T15:28:37.626409+0000","last_peered":"2024-09-19T15:28:37.626409+0000","last_clean":"2024-09-19T15:28:37.626409+0000","last_became_active":"2024-09-19T13:56:23.166406+0000","last_became_peered":"2024-09-19T13:56:23.166406+0000","last_unstale":"2024-09-19T15:28:37.626409+0000","last_undegraded":"2024-09-19T15:28:37.626409+0000","last_fullsized":"2024-09-19T15:28:37.626409+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:17.132230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":158,"num_write":72,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.386230+0000","last_change":"2024-09-19T14:29:51.051349+0000","last_active":"2024-09-19T15:28:22.386230+0000","last_peered":"2024-09-19T15:28:22.386230+0000","last_clean":"2024-09-19T15:28:22.386230+0000","last_became_active":"2024-09-19T14:29:51.050808+0000","last_became_peered":"2024-09-19T14:29:51.050808+0000","last_unstale":"2024-09-19T15:28:22.386230+0000","last_undegraded":"2024-09-19T15:28:22.386230+0000","last_fullsized":"2024-09-19T15:28:22.386230+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:22:11.404680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"268'2","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:32.386279+0000","last_change":"2024-09-19T14:02:37.053056+0000","last_active":"2024-09-19T15:28:32.386279+0000","last_peered":"2024-09-19T15:28:32.386279+0000","last_clean":"2024-09-19T15:28:32.386279+0000","last_became_active":"2024-09-19T14:02:37.052121+0000","last_became_peered":"2024-09-19T14:02:37.052121+0000","last_unstale":"2024-09-19T15:28:32.386279+0000","last_undegraded":"2024-09-19T15:28:32.386279+0000","last_fullsized":"2024-09-19T15:28:32.386279+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:00.496165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.178139+0000","last_change":"2024-09-19T14:02:29.749448+0000","last_active":"2024-09-19T15:28:02.178139+0000","last_peered":"2024-09-19T15:28:02.178139+0000","last_clean":"2024-09-19T15:28:02.178139+0000","last_became_active":"2024-09-19T14:02:29.748469+0000","last_became_peered":"2024-09-19T14:02:29.748469+0000","last_unstale":"2024-09-19T15:28:02.178139+0000","last_undegraded":"2024-09-19T15:28:02.178139+0000","last_fullsized":"2024-09-19T15:28:02.178139+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:25.962511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"268'120","reported_seq":440,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.389638+0000","last_change":"2024-09-19T13:56:23.172759+0000","last_active":"2024-09-19T15:28:37.389638+0000","last_peered":"2024-09-19T15:28:37.389638+0000","last_clean":"2024-09-19T15:28:37.389638+0000","last_became_active":"2024-09-19T13:56:23.164737+0000","last_became_peered":"2024-09-19T13:56:23.164737+0000","last_unstale":"2024-09-19T15:28:37.389638+0000","last_undegraded":"2024-09-19T15:28:37.389638+0000","last_fullsized":"2024-09-19T15:28:37.389638+0000","mapping_epoch":255,"log_start":"265'100","ondisk_log_start":"265'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:31:33.872663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1135,"num_read_kb":1191,"num_write":240,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644185+0000","last_change":"2024-09-19T14:29:51.024362+0000","last_active":"2024-09-19T15:28:22.644185+0000","last_peered":"2024-09-19T15:28:22.644185+0000","last_clean":"2024-09-19T15:28:22.644185+0000","last_became_active":"2024-09-19T14:29:51.022975+0000","last_became_peered":"2024-09-19T14:29:51.022975+0000","last_unstale":"2024-09-19T15:28:22.644185+0000","last_undegraded":"2024-09-19T15:28:22.644185+0000","last_fullsized":"2024-09-19T15:28:22.644185+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:44:44.124646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"268'2","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:08.231787+0000","last_change":"2024-09-19T14:02:36.926595+0000","last_active":"2024-09-19T15:28:08.231787+0000","last_peered":"2024-09-19T15:28:08.231787+0000","last_clean":"2024-09-19T15:28:08.231787+0000","last_became_active":"2024-09-19T14:02:36.924349+0000","last_became_peered":"2024-09-19T14:02:36.924349+0000","last_unstale":"2024-09-19T15:28:08.231787+0000","last_undegraded":"2024-09-19T15:28:08.231787+0000","last_fullsized":"2024-09-19T15:28:08.231787+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:10.123769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:27.385058+0000","last_change":"2024-09-19T14:02:29.731121+0000","last_active":"2024-09-19T15:28:27.385058+0000","last_peered":"2024-09-19T15:28:27.385058+0000","last_clean":"2024-09-19T15:28:27.385058+0000","last_became_active":"2024-09-19T14:02:29.730280+0000","last_became_peered":"2024-09-19T14:02:29.730280+0000","last_unstale":"2024-09-19T15:28:27.385058+0000","last_undegraded":"2024-09-19T15:28:27.385058+0000","last_fullsized":"2024-09-19T15:28:27.385058+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:25.212771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'28","reported_seq":149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.552907+0000","last_change":"2024-09-19T13:56:23.183786+0000","last_active":"2024-09-19T15:28:37.552907+0000","last_peered":"2024-09-19T15:28:37.552907+0000","last_clean":"2024-09-19T15:28:37.552907+0000","last_became_active":"2024-09-19T13:56:23.182103+0000","last_became_peered":"2024-09-19T13:56:23.182103+0000","last_unstale":"2024-09-19T15:28:37.552907+0000","last_undegraded":"2024-09-19T15:28:37.552907+0000","last_fullsized":"2024-09-19T15:28:37.552907+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:32.317900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":141,"num_write":72,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:23.235388+0000","last_change":"2024-09-19T14:29:51.030844+0000","last_active":"2024-09-19T15:28:23.235388+0000","last_peered":"2024-09-19T15:28:23.235388+0000","last_clean":"2024-09-19T15:28:23.235388+0000","last_became_active":"2024-09-19T14:29:51.030200+0000","last_became_peered":"2024-09-19T14:29:51.030200+0000","last_unstale":"2024-09-19T15:28:23.235388+0000","last_undegraded":"2024-09-19T15:28:23.235388+0000","last_fullsized":"2024-09-19T15:28:23.235388+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:34:22.342028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"265'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:17.616101+0000","last_change":"2024-09-19T14:02:36.929045+0000","last_active":"2024-09-19T15:29:17.616101+0000","last_peered":"2024-09-19T15:29:17.616101+0000","last_clean":"2024-09-19T15:29:17.616101+0000","last_became_active":"2024-09-19T14:02:36.927585+0000","last_became_peered":"2024-09-19T14:02:36.927585+0000","last_unstale":"2024-09-19T15:29:17.616101+0000","last_undegraded":"2024-09-19T15:29:17.616101+0000","last_fullsized":"2024-09-19T15:29:17.616101+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:44:02.469367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"265'5","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.194026+0000","last_change":"2024-09-19T14:02:29.740714+0000","last_active":"2024-09-19T15:29:12.194026+0000","last_peered":"2024-09-19T15:29:12.194026+0000","last_clean":"2024-09-19T15:29:12.194026+0000","last_became_active":"2024-09-19T14:02:29.739469+0000","last_became_peered":"2024-09-19T14:02:29.739469+0000","last_unstale":"2024-09-19T15:29:12.194026+0000","last_undegraded":"2024-09-19T15:29:12.194026+0000","last_fullsized":"2024-09-19T15:29:12.194026+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:23.314643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'26","reported_seq":145,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.186692+0000","last_change":"2024-09-19T13:56:23.180908+0000","last_active":"2024-09-19T15:28:42.186692+0000","last_peered":"2024-09-19T15:28:42.186692+0000","last_clean":"2024-09-19T15:28:42.186692+0000","last_became_active":"2024-09-19T13:56:23.170897+0000","last_became_peered":"2024-09-19T13:56:23.170897+0000","last_unstale":"2024-09-19T15:28:42.186692+0000","last_undegraded":"2024-09-19T15:28:42.186692+0000","last_fullsized":"2024-09-19T15:28:42.186692+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:59.535564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":129,"num_write":67,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:32.646832+0000","last_change":"2024-09-19T14:29:51.047203+0000","last_active":"2024-09-19T15:28:32.646832+0000","last_peered":"2024-09-19T15:28:32.646832+0000","last_clean":"2024-09-19T15:28:32.646832+0000","last_became_active":"2024-09-19T14:29:51.046273+0000","last_became_peered":"2024-09-19T14:29:51.046273+0000","last_unstale":"2024-09-19T15:28:32.646832+0000","last_undegraded":"2024-09-19T15:28:32.646832+0000","last_fullsized":"2024-09-19T15:28:32.646832+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:15.605088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"268'7","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:17.657525+0000","last_change":"2024-09-19T14:02:37.051538+0000","last_active":"2024-09-19T15:29:17.657525+0000","last_peered":"2024-09-19T15:29:17.657525+0000","last_clean":"2024-09-19T15:29:17.657525+0000","last_became_active":"2024-09-19T14:02:37.050689+0000","last_became_peered":"2024-09-19T14:02:37.050689+0000","last_unstale":"2024-09-19T15:29:17.657525+0000","last_undegraded":"2024-09-19T15:29:17.657525+0000","last_fullsized":"2024-09-19T15:29:17.657525+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:21.698768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":32770,"num_write":7,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"265'5","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.395204+0000","last_change":"2024-09-19T14:02:29.731282+0000","last_active":"2024-09-19T15:29:12.395204+0000","last_peered":"2024-09-19T15:29:12.395204+0000","last_clean":"2024-09-19T15:29:12.395204+0000","last_became_active":"2024-09-19T14:02:29.730624+0000","last_became_peered":"2024-09-19T14:02:29.730624+0000","last_unstale":"2024-09-19T15:29:12.395204+0000","last_undegraded":"2024-09-19T15:29:12.395204+0000","last_fullsized":"2024-09-19T15:29:12.395204+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:58.498165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'5","reported_seq":90,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:42.634441+0000","last_change":"2024-09-19T13:56:23.182572+0000","last_active":"2024-09-19T15:27:42.634441+0000","last_peered":"2024-09-19T15:27:42.634441+0000","last_clean":"2024-09-19T15:27:42.634441+0000","last_became_active":"2024-09-19T13:56:23.181867+0000","last_became_peered":"2024-09-19T13:56:23.181867+0000","last_unstale":"2024-09-19T15:27:42.634441+0000","last_undegraded":"2024-09-19T15:27:42.634441+0000","last_fullsized":"2024-09-19T15:27:42.634441+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:12.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644309+0000","last_change":"2024-09-19T14:29:51.037068+0000","last_active":"2024-09-19T15:28:22.644309+0000","last_peered":"2024-09-19T15:28:22.644309+0000","last_clean":"2024-09-19T15:28:22.644309+0000","last_became_active":"2024-09-19T14:29:51.036292+0000","last_became_peered":"2024-09-19T14:29:51.036292+0000","last_unstale":"2024-09-19T15:28:22.644309+0000","last_undegraded":"2024-09-19T15:28:22.644309+0000","last_fullsized":"2024-09-19T15:28:22.644309+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:12.187433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"268'1","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.380067+0000","last_change":"2024-09-19T14:02:36.924261+0000","last_active":"2024-09-19T15:28:07.380067+0000","last_peered":"2024-09-19T15:28:07.380067+0000","last_clean":"2024-09-19T15:28:07.380067+0000","last_became_active":"2024-09-19T14:02:36.923500+0000","last_became_peered":"2024-09-19T14:02:36.923500+0000","last_unstale":"2024-09-19T15:28:07.380067+0000","last_undegraded":"2024-09-19T15:28:07.380067+0000","last_fullsized":"2024-09-19T15:28:07.380067+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:28:12.672018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'2","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.171466+0000","last_change":"2024-09-19T14:02:29.746888+0000","last_active":"2024-09-19T15:27:32.171466+0000","last_peered":"2024-09-19T15:27:32.171466+0000","last_clean":"2024-09-19T15:27:32.171466+0000","last_became_active":"2024-09-19T14:02:29.746148+0000","last_became_peered":"2024-09-19T14:02:29.746148+0000","last_unstale":"2024-09-19T15:27:32.171466+0000","last_undegraded":"2024-09-19T15:27:32.171466+0000","last_fullsized":"2024-09-19T15:27:32.171466+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:05.741943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'41","reported_seq":187,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:23.220986+0000","last_change":"2024-09-19T13:56:23.174360+0000","last_active":"2024-09-19T15:27:23.220986+0000","last_peered":"2024-09-19T15:27:23.220986+0000","last_clean":"2024-09-19T15:27:23.220986+0000","last_became_active":"2024-09-19T13:56:23.173918+0000","last_became_peered":"2024-09-19T13:56:23.173918+0000","last_unstale":"2024-09-19T15:27:23.220986+0000","last_undegraded":"2024-09-19T15:27:23.220986+0000","last_fullsized":"2024-09-19T15:27:23.220986+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:23.496354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":206,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.182455+0000","last_change":"2024-09-19T14:29:51.034137+0000","last_active":"2024-09-19T15:28:22.182455+0000","last_peered":"2024-09-19T15:28:22.182455+0000","last_clean":"2024-09-19T15:28:22.182455+0000","last_became_active":"2024-09-19T14:29:51.033329+0000","last_became_peered":"2024-09-19T14:29:51.033329+0000","last_unstale":"2024-09-19T15:28:22.182455+0000","last_undegraded":"2024-09-19T15:28:22.182455+0000","last_fullsized":"2024-09-19T15:28:22.182455+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:09.961864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'5","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:27.630988+0000","last_change":"2024-09-19T14:03:07.396429+0000","last_active":"2024-09-19T15:27:27.630988+0000","last_peered":"2024-09-19T15:27:27.630988+0000","last_clean":"2024-09-19T15:27:27.630988+0000","last_became_active":"2024-09-19T14:03:07.395844+0000","last_became_peered":"2024-09-19T14:03:07.395844+0000","last_unstale":"2024-09-19T15:27:27.630988+0000","last_undegraded":"2024-09-19T15:27:27.630988+0000","last_fullsized":"2024-09-19T15:27:27.630988+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:30.854364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5147,"num_write":5,"num_write_kb":5147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'3","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.598913+0000","last_change":"2024-09-19T14:02:29.733169+0000","last_active":"2024-09-19T15:28:02.598913+0000","last_peered":"2024-09-19T15:28:02.598913+0000","last_clean":"2024-09-19T15:28:02.598913+0000","last_became_active":"2024-09-19T14:02:29.732416+0000","last_became_peered":"2024-09-19T14:02:29.732416+0000","last_unstale":"2024-09-19T15:28:02.598913+0000","last_undegraded":"2024-09-19T15:28:02.598913+0000","last_fullsized":"2024-09-19T15:28:02.598913+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:49:13.647937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'38","reported_seq":187,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.570948+0000","last_change":"2024-09-19T13:56:23.173200+0000","last_active":"2024-09-19T15:27:22.570948+0000","last_peered":"2024-09-19T15:27:22.570948+0000","last_clean":"2024-09-19T15:27:22.570948+0000","last_became_active":"2024-09-19T13:56:23.172437+0000","last_became_peered":"2024-09-19T13:56:23.172437+0000","last_unstale":"2024-09-19T15:27:22.570948+0000","last_undegraded":"2024-09-19T15:27:22.570948+0000","last_fullsized":"2024-09-19T15:27:22.570948+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:43:47.758946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":311,"num_read_kb":193,"num_write":96,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.641824+0000","last_change":"2024-09-19T14:29:51.037099+0000","last_active":"2024-09-19T15:28:12.641824+0000","last_peered":"2024-09-19T15:28:12.641824+0000","last_clean":"2024-09-19T15:28:12.641824+0000","last_became_active":"2024-09-19T14:29:51.036386+0000","last_became_peered":"2024-09-19T14:29:51.036386+0000","last_unstale":"2024-09-19T15:28:12.641824+0000","last_undegraded":"2024-09-19T15:28:12.641824+0000","last_fullsized":"2024-09-19T15:28:12.641824+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:47.754572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:32.184569+0000","last_change":"2024-09-19T14:02:36.913472+0000","last_active":"2024-09-19T15:28:32.184569+0000","last_peered":"2024-09-19T15:28:32.184569+0000","last_clean":"2024-09-19T15:28:32.184569+0000","last_became_active":"2024-09-19T14:02:36.912757+0000","last_became_peered":"2024-09-19T14:02:36.912757+0000","last_unstale":"2024-09-19T15:28:32.184569+0000","last_undegraded":"2024-09-19T15:28:32.184569+0000","last_fullsized":"2024-09-19T15:28:32.184569+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:28.705324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"268'2","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.638148+0000","last_change":"2024-09-19T14:02:29.726496+0000","last_active":"2024-09-19T15:27:57.638148+0000","last_peered":"2024-09-19T15:27:57.638148+0000","last_clean":"2024-09-19T15:27:57.638148+0000","last_became_active":"2024-09-19T14:02:29.725707+0000","last_became_peered":"2024-09-19T14:02:29.725707+0000","last_unstale":"2024-09-19T15:27:57.638148+0000","last_undegraded":"2024-09-19T15:27:57.638148+0000","last_fullsized":"2024-09-19T15:27:57.638148+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:19.846245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'2","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:27.170452+0000","last_change":"2024-09-19T13:56:23.181807+0000","last_active":"2024-09-19T15:27:27.170452+0000","last_peered":"2024-09-19T15:27:27.170452+0000","last_clean":"2024-09-19T15:27:27.170452+0000","last_became_active":"2024-09-19T13:56:23.180518+0000","last_became_peered":"2024-09-19T13:56:23.180518+0000","last_unstale":"2024-09-19T15:27:27.170452+0000","last_undegraded":"2024-09-19T15:27:27.170452+0000","last_fullsized":"2024-09-19T15:27:27.170452+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:39.826441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.620670+0000","last_change":"2024-09-19T14:29:51.030804+0000","last_active":"2024-09-19T15:28:12.620670+0000","last_peered":"2024-09-19T15:28:12.620670+0000","last_clean":"2024-09-19T15:28:12.620670+0000","last_became_active":"2024-09-19T14:29:51.030021+0000","last_became_peered":"2024-09-19T14:29:51.030021+0000","last_unstale":"2024-09-19T15:28:12.620670+0000","last_undegraded":"2024-09-19T15:28:12.620670+0000","last_fullsized":"2024-09-19T15:28:12.620670+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:03.409322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"265'3","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.178084+0000","last_change":"2024-09-19T14:02:37.052572+0000","last_active":"2024-09-19T15:28:02.178084+0000","last_peered":"2024-09-19T15:28:02.178084+0000","last_clean":"2024-09-19T15:28:02.178084+0000","last_became_active":"2024-09-19T14:02:37.051567+0000","last_became_peered":"2024-09-19T14:02:37.051567+0000","last_unstale":"2024-09-19T15:28:02.178084+0000","last_undegraded":"2024-09-19T15:28:02.178084+0000","last_fullsized":"2024-09-19T15:28:02.178084+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:19:54.029118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:17.548757+0000","last_change":"2024-09-19T14:02:29.748318+0000","last_active":"2024-09-19T15:28:17.548757+0000","last_peered":"2024-09-19T15:28:17.548757+0000","last_clean":"2024-09-19T15:28:17.548757+0000","last_became_active":"2024-09-19T14:02:29.747539+0000","last_became_peered":"2024-09-19T14:02:29.747539+0000","last_unstale":"2024-09-19T15:28:17.548757+0000","last_undegraded":"2024-09-19T15:28:17.548757+0000","last_fullsized":"2024-09-19T15:28:17.548757+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:42:39.905932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"268'12","reported_seq":109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.571118+0000","last_change":"2024-09-19T13:56:23.174992+0000","last_active":"2024-09-19T15:27:22.571118+0000","last_peered":"2024-09-19T15:27:22.571118+0000","last_clean":"2024-09-19T15:27:22.571118+0000","last_became_active":"2024-09-19T13:56:23.173882+0000","last_became_peered":"2024-09-19T13:56:23.173882+0000","last_unstale":"2024-09-19T15:27:22.571118+0000","last_undegraded":"2024-09-19T15:27:22.571118+0000","last_fullsized":"2024-09-19T15:27:22.571118+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:21.063143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":61,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381230+0000","last_change":"2024-09-19T14:29:51.050041+0000","last_active":"2024-09-19T15:28:12.381230+0000","last_peered":"2024-09-19T15:28:12.381230+0000","last_clean":"2024-09-19T15:28:12.381230+0000","last_became_active":"2024-09-19T14:29:51.049356+0000","last_became_peered":"2024-09-19T14:29:51.049356+0000","last_unstale":"2024-09-19T15:28:12.381230+0000","last_undegraded":"2024-09-19T15:28:12.381230+0000","last_fullsized":"2024-09-19T15:28:12.381230+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:28.752706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"268'7","reported_seq":81,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:17.657742+0000","last_change":"2024-09-19T14:02:37.057637+0000","last_active":"2024-09-19T15:29:17.657742+0000","last_peered":"2024-09-19T15:29:17.657742+0000","last_clean":"2024-09-19T15:29:17.657742+0000","last_became_active":"2024-09-19T14:02:37.056814+0000","last_became_peered":"2024-09-19T14:02:37.056814+0000","last_unstale":"2024-09-19T15:29:17.657742+0000","last_undegraded":"2024-09-19T15:29:17.657742+0000","last_fullsized":"2024-09-19T15:29:17.657742+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:04:44.022820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":17,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.634682+0000","last_change":"2024-09-19T14:02:29.724061+0000","last_active":"2024-09-19T15:29:12.634682+0000","last_peered":"2024-09-19T15:29:12.634682+0000","last_clean":"2024-09-19T15:29:12.634682+0000","last_became_active":"2024-09-19T14:02:29.723298+0000","last_became_peered":"2024-09-19T14:02:29.723298+0000","last_unstale":"2024-09-19T15:29:12.634682+0000","last_undegraded":"2024-09-19T15:29:12.634682+0000","last_fullsized":"2024-09-19T15:29:12.634682+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:04:40.406319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'20","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644346+0000","last_change":"2024-09-19T13:56:23.190217+0000","last_active":"2024-09-19T15:28:22.644346+0000","last_peered":"2024-09-19T15:28:22.644346+0000","last_clean":"2024-09-19T15:28:22.644346+0000","last_became_active":"2024-09-19T13:56:23.189485+0000","last_became_peered":"2024-09-19T13:56:23.189485+0000","last_unstale":"2024-09-19T15:28:22.644346+0000","last_undegraded":"2024-09-19T15:28:22.644346+0000","last_fullsized":"2024-09-19T15:28:22.644346+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:26:00.955840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":106,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.601092+0000","last_change":"2024-09-19T14:29:51.029750+0000","last_active":"2024-09-19T15:28:12.601092+0000","last_peered":"2024-09-19T15:28:12.601092+0000","last_clean":"2024-09-19T15:28:12.601092+0000","last_became_active":"2024-09-19T14:29:51.028866+0000","last_became_peered":"2024-09-19T14:29:51.028866+0000","last_unstale":"2024-09-19T15:28:12.601092+0000","last_undegraded":"2024-09-19T15:28:12.601092+0000","last_fullsized":"2024-09-19T15:28:12.601092+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:57:37.166340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'3","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:17.616296+0000","last_change":"2024-09-19T14:02:36.917356+0000","last_active":"2024-09-19T15:29:17.616296+0000","last_peered":"2024-09-19T15:29:17.616296+0000","last_clean":"2024-09-19T15:29:17.616296+0000","last_became_active":"2024-09-19T14:02:36.916389+0000","last_became_peered":"2024-09-19T14:02:36.916389+0000","last_unstale":"2024-09-19T15:29:17.616296+0000","last_undegraded":"2024-09-19T15:29:17.616296+0000","last_fullsized":"2024-09-19T15:29:17.616296+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:02.036578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6339878,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":12336,"num_write":3,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"268'7","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.656562+0000","last_change":"2024-09-19T14:02:29.741915+0000","last_active":"2024-09-19T15:29:12.656562+0000","last_peered":"2024-09-19T15:29:12.656562+0000","last_clean":"2024-09-19T15:29:12.656562+0000","last_became_active":"2024-09-19T14:02:29.740227+0000","last_became_peered":"2024-09-19T14:02:29.740227+0000","last_unstale":"2024-09-19T15:29:12.656562+0000","last_undegraded":"2024-09-19T15:29:12.656562+0000","last_fullsized":"2024-09-19T15:29:12.656562+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:46.277985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":9218,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'41","reported_seq":190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.378845+0000","last_change":"2024-09-19T13:56:23.174685+0000","last_active":"2024-09-19T15:28:02.378845+0000","last_peered":"2024-09-19T15:28:02.378845+0000","last_clean":"2024-09-19T15:28:02.378845+0000","last_became_active":"2024-09-19T13:56:23.173938+0000","last_became_peered":"2024-09-19T13:56:23.173938+0000","last_unstale":"2024-09-19T15:28:02.378845+0000","last_undegraded":"2024-09-19T15:28:02.378845+0000","last_fullsized":"2024-09-19T15:28:02.378845+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:20.591650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":330,"num_read_kb":229,"num_write":110,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.549879+0000","last_change":"2024-09-19T14:29:51.026777+0000","last_active":"2024-09-19T15:28:22.549879+0000","last_peered":"2024-09-19T15:28:22.549879+0000","last_clean":"2024-09-19T15:28:22.549879+0000","last_became_active":"2024-09-19T14:29:51.025959+0000","last_became_peered":"2024-09-19T14:29:51.025959+0000","last_unstale":"2024-09-19T15:28:22.549879+0000","last_undegraded":"2024-09-19T15:28:22.549879+0000","last_fullsized":"2024-09-19T15:28:22.549879+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:11:23.290380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.378636+0000","last_change":"2024-09-19T14:02:36.912701+0000","last_active":"2024-09-19T15:28:02.378636+0000","last_peered":"2024-09-19T15:28:02.378636+0000","last_clean":"2024-09-19T15:28:02.378636+0000","last_became_active":"2024-09-19T14:02:36.911804+0000","last_became_peered":"2024-09-19T14:02:36.911804+0000","last_unstale":"2024-09-19T15:28:02.378636+0000","last_undegraded":"2024-09-19T15:28:02.378636+0000","last_fullsized":"2024-09-19T15:28:02.378636+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:12.422526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"268'6","reported_seq":87,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:52.651438+0000","last_change":"2024-09-19T14:02:29.748278+0000","last_active":"2024-09-19T15:28:52.651438+0000","last_peered":"2024-09-19T15:28:52.651438+0000","last_clean":"2024-09-19T15:28:52.651438+0000","last_became_active":"2024-09-19T14:02:29.747553+0000","last_became_peered":"2024-09-19T14:02:29.747553+0000","last_unstale":"2024-09-19T15:28:52.651438+0000","last_undegraded":"2024-09-19T15:28:52.651438+0000","last_fullsized":"2024-09-19T15:28:52.651438+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:20:14.376148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":21504,"num_write":6,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'275","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.618334+0000","last_change":"2024-09-19T13:56:23.186164+0000","last_active":"2024-09-19T15:28:02.618334+0000","last_peered":"2024-09-19T15:28:02.618334+0000","last_clean":"2024-09-19T15:28:02.618334+0000","last_became_active":"2024-09-19T13:56:23.185522+0000","last_became_peered":"2024-09-19T13:56:23.185522+0000","last_unstale":"2024-09-19T15:28:02.618334+0000","last_undegraded":"2024-09-19T15:28:02.618334+0000","last_fullsized":"2024-09-19T15:28:02.618334+0000","mapping_epoch":255,"log_start":"265'200","ondisk_log_start":"265'200","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:23.817224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2606,"num_read_kb":3112,"num_write":537,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.182535+0000","last_change":"2024-09-19T14:29:51.043009+0000","last_active":"2024-09-19T15:28:22.182535+0000","last_peered":"2024-09-19T15:28:22.182535+0000","last_clean":"2024-09-19T15:28:22.182535+0000","last_became_active":"2024-09-19T14:29:51.042287+0000","last_became_peered":"2024-09-19T14:29:51.042287+0000","last_unstale":"2024-09-19T15:28:22.182535+0000","last_undegraded":"2024-09-19T15:28:22.182535+0000","last_fullsized":"2024-09-19T15:28:22.182535+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:00:55.357725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"268'2","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.630840+0000","last_change":"2024-09-19T14:02:36.913575+0000","last_active":"2024-09-19T15:28:57.630840+0000","last_peered":"2024-09-19T15:28:57.630840+0000","last_clean":"2024-09-19T15:28:57.630840+0000","last_became_active":"2024-09-19T14:02:36.912642+0000","last_became_peered":"2024-09-19T14:02:36.912642+0000","last_unstale":"2024-09-19T15:28:57.630840+0000","last_undegraded":"2024-09-19T15:28:57.630840+0000","last_fullsized":"2024-09-19T15:28:57.630840+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:53.289654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.637948+0000","last_change":"2024-09-19T14:02:29.740640+0000","last_active":"2024-09-19T15:27:57.637948+0000","last_peered":"2024-09-19T15:27:57.637948+0000","last_clean":"2024-09-19T15:27:57.637948+0000","last_became_active":"2024-09-19T14:02:29.739397+0000","last_became_peered":"2024-09-19T14:02:29.739397+0000","last_unstale":"2024-09-19T15:27:57.637948+0000","last_undegraded":"2024-09-19T15:27:57.637948+0000","last_fullsized":"2024-09-19T15:27:57.637948+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:38.568040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'26","reported_seq":155,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.598838+0000","last_change":"2024-09-19T13:56:23.179600+0000","last_active":"2024-09-19T15:28:02.598838+0000","last_peered":"2024-09-19T15:28:02.598838+0000","last_clean":"2024-09-19T15:28:02.598838+0000","last_became_active":"2024-09-19T13:56:23.178722+0000","last_became_peered":"2024-09-19T13:56:23.178722+0000","last_unstale":"2024-09-19T15:28:02.598838+0000","last_undegraded":"2024-09-19T15:28:02.598838+0000","last_fullsized":"2024-09-19T15:28:02.598838+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:17.896929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":137,"num_write":65,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.180147+0000","last_change":"2024-09-19T14:29:51.040094+0000","last_active":"2024-09-19T15:28:12.180147+0000","last_peered":"2024-09-19T15:28:12.180147+0000","last_clean":"2024-09-19T15:28:12.180147+0000","last_became_active":"2024-09-19T14:29:51.037398+0000","last_became_peered":"2024-09-19T14:29:51.037398+0000","last_unstale":"2024-09-19T15:28:12.180147+0000","last_undegraded":"2024-09-19T15:28:12.180147+0000","last_fullsized":"2024-09-19T15:28:12.180147+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:38.720027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.382027+0000","last_change":"2024-09-19T14:02:36.929646+0000","last_active":"2024-09-19T15:28:02.382027+0000","last_peered":"2024-09-19T15:28:02.382027+0000","last_clean":"2024-09-19T15:28:02.382027+0000","last_became_active":"2024-09-19T14:02:36.928598+0000","last_became_peered":"2024-09-19T14:02:36.928598+0000","last_unstale":"2024-09-19T15:28:02.382027+0000","last_undegraded":"2024-09-19T15:28:02.382027+0000","last_fullsized":"2024-09-19T15:28:02.382027+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:55:11.565586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"268'1","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.377203+0000","last_change":"2024-09-19T14:02:29.738035+0000","last_active":"2024-09-19T15:27:57.377203+0000","last_peered":"2024-09-19T15:27:57.377203+0000","last_clean":"2024-09-19T15:27:57.377203+0000","last_became_active":"2024-09-19T14:02:29.737082+0000","last_became_peered":"2024-09-19T14:02:29.737082+0000","last_unstale":"2024-09-19T15:27:57.377203+0000","last_undegraded":"2024-09-19T15:27:57.377203+0000","last_fullsized":"2024-09-19T15:27:57.377203+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:59.761712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'51","reported_seq":222,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.381862+0000","last_change":"2024-09-19T13:56:23.173928+0000","last_active":"2024-09-19T15:28:02.381862+0000","last_peered":"2024-09-19T15:28:02.381862+0000","last_clean":"2024-09-19T15:28:02.381862+0000","last_became_active":"2024-09-19T13:56:23.173172+0000","last_became_peered":"2024-09-19T13:56:23.173172+0000","last_unstale":"2024-09-19T15:28:02.381862+0000","last_undegraded":"2024-09-19T15:28:02.381862+0000","last_fullsized":"2024-09-19T15:28:02.381862+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:40:50.508754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":432,"num_read_kb":295,"num_write":119,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644369+0000","last_change":"2024-09-19T14:29:51.048750+0000","last_active":"2024-09-19T15:28:22.644369+0000","last_peered":"2024-09-19T15:28:22.644369+0000","last_clean":"2024-09-19T15:28:22.644369+0000","last_became_active":"2024-09-19T14:29:51.047826+0000","last_became_peered":"2024-09-19T14:29:51.047826+0000","last_unstale":"2024-09-19T15:28:22.644369+0000","last_undegraded":"2024-09-19T15:28:22.644369+0000","last_fullsized":"2024-09-19T15:28:22.644369+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:01.510352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'5","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.598789+0000","last_change":"2024-09-19T14:02:36.910670+0000","last_active":"2024-09-19T15:28:02.598789+0000","last_peered":"2024-09-19T15:28:02.598789+0000","last_clean":"2024-09-19T15:28:02.598789+0000","last_became_active":"2024-09-19T14:02:36.910154+0000","last_became_peered":"2024-09-19T14:02:36.910154+0000","last_unstale":"2024-09-19T15:28:02.598789+0000","last_undegraded":"2024-09-19T15:28:02.598789+0000","last_fullsized":"2024-09-19T15:28:02.598789+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:30:56.428703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"268'1","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.380620+0000","last_change":"2024-09-19T14:02:29.723856+0000","last_active":"2024-09-19T15:27:57.380620+0000","last_peered":"2024-09-19T15:27:57.380620+0000","last_clean":"2024-09-19T15:27:57.380620+0000","last_became_active":"2024-09-19T14:02:29.723084+0000","last_became_peered":"2024-09-19T14:02:29.723084+0000","last_unstale":"2024-09-19T15:27:57.380620+0000","last_undegraded":"2024-09-19T15:27:57.380620+0000","last_fullsized":"2024-09-19T15:27:57.380620+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:57:24.394062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'52","reported_seq":217,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.648963+0000","last_change":"2024-09-19T13:56:23.182198+0000","last_active":"2024-09-19T15:28:42.648963+0000","last_peered":"2024-09-19T15:28:42.648963+0000","last_clean":"2024-09-19T15:28:42.648963+0000","last_became_active":"2024-09-19T13:56:23.181354+0000","last_became_peered":"2024-09-19T13:56:23.181354+0000","last_unstale":"2024-09-19T15:28:42.648963+0000","last_undegraded":"2024-09-19T15:28:42.648963+0000","last_fullsized":"2024-09-19T15:28:42.648963+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:38.576519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":381,"num_read_kb":254,"num_write":133,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'321","reported_seq":1026,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.652800+0000","last_change":"2024-09-19T13:40:34.279763+0000","last_active":"2024-09-19T15:28:57.652800+0000","last_peered":"2024-09-19T15:28:57.652800+0000","last_clean":"2024-09-19T15:28:57.652800+0000","last_became_active":"2024-09-19T13:40:34.278366+0000","last_became_peered":"2024-09-19T13:40:34.278366+0000","last_unstale":"2024-09-19T15:28:57.652800+0000","last_undegraded":"2024-09-19T15:28:57.652800+0000","last_fullsized":"2024-09-19T15:28:57.652800+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:54.618095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17350441,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":601,"num_read_kb":97880,"num_write":1200,"num_write_kb":51204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'896","reported_seq":2622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:46.037523+0000","last_change":"2024-09-19T13:40:36.233984+0000","last_active":"2024-09-19T15:28:46.037523+0000","last_peered":"2024-09-19T15:28:46.037523+0000","last_clean":"2024-09-19T15:28:46.037523+0000","last_became_active":"2024-09-19T13:40:36.233265+0000","last_became_peered":"2024-09-19T13:40:36.233265+0000","last_unstale":"2024-09-19T15:28:46.037523+0000","last_undegraded":"2024-09-19T15:28:46.037523+0000","last_fullsized":"2024-09-19T15:28:46.037523+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":800,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:51:51.439880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4503,"num_read_kb":4037,"num_write":1205,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'240","reported_seq":863,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391835+0000","last_change":"2024-09-19T13:40:34.240880+0000","last_active":"2024-09-19T15:28:57.391835+0000","last_peered":"2024-09-19T15:28:57.391835+0000","last_clean":"2024-09-19T15:28:57.391835+0000","last_became_active":"2024-09-19T13:40:34.240412+0000","last_became_peered":"2024-09-19T13:40:34.240412+0000","last_unstale":"2024-09-19T15:28:57.391835+0000","last_undegraded":"2024-09-19T15:28:57.391835+0000","last_fullsized":"2024-09-19T15:28:57.391835+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:44.406577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5270659,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":406,"num_read_kb":36190,"num_write":899,"num_write_kb":29274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'618","reported_seq":2321,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.314706+0000","last_change":"2024-09-19T13:40:36.233243+0000","last_active":"2024-09-19T15:29:41.314706+0000","last_peered":"2024-09-19T15:29:41.314706+0000","last_clean":"2024-09-19T15:29:41.314706+0000","last_became_active":"2024-09-19T13:40:36.232504+0000","last_became_peered":"2024-09-19T13:40:36.232504+0000","last_unstale":"2024-09-19T15:29:41.314706+0000","last_undegraded":"2024-09-19T15:29:41.314706+0000","last_fullsized":"2024-09-19T15:29:41.314706+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":600,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:48.735786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3362,"num_read_kb":3070,"num_write":813,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'303","reported_seq":984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.190331+0000","last_change":"2024-09-19T13:40:34.216282+0000","last_active":"2024-09-19T15:28:57.190331+0000","last_peered":"2024-09-19T15:28:57.190331+0000","last_clean":"2024-09-19T15:28:57.190331+0000","last_became_active":"2024-09-19T13:40:34.215960+0000","last_became_peered":"2024-09-19T13:40:34.215960+0000","last_unstale":"2024-09-19T15:28:57.190331+0000","last_undegraded":"2024-09-19T15:28:57.190331+0000","last_fullsized":"2024-09-19T15:28:57.190331+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:04.475058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16859419,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":626,"num_read_kb":31785,"num_write":1130,"num_write_kb":29902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'838","reported_seq":2388,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.242934+0000","last_change":"2024-09-19T13:40:36.227193+0000","last_active":"2024-09-19T15:31:12.242934+0000","last_peered":"2024-09-19T15:31:12.242934+0000","last_clean":"2024-09-19T15:31:12.242934+0000","last_became_active":"2024-09-19T13:40:36.220563+0000","last_became_peered":"2024-09-19T13:40:36.220563+0000","last_unstale":"2024-09-19T15:31:12.242934+0000","last_undegraded":"2024-09-19T15:31:12.242934+0000","last_fullsized":"2024-09-19T15:31:12.242934+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:33.303811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4017,"num_read_kb":3603,"num_write":1098,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'295","reported_seq":968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.632193+0000","last_change":"2024-09-19T13:40:34.242237+0000","last_active":"2024-09-19T15:29:02.632193+0000","last_peered":"2024-09-19T15:29:02.632193+0000","last_clean":"2024-09-19T15:29:02.632193+0000","last_became_active":"2024-09-19T13:40:34.239843+0000","last_became_peered":"2024-09-19T13:40:34.239843+0000","last_unstale":"2024-09-19T15:29:02.632193+0000","last_undegraded":"2024-09-19T15:29:02.632193+0000","last_fullsized":"2024-09-19T15:29:02.632193+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:31.305832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1917338,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":516,"num_read_kb":4189,"num_write":1092,"num_write_kb":27975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'1555","reported_seq":3224,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.276379+0000","last_change":"2024-09-19T13:40:36.226610+0000","last_active":"2024-09-19T15:31:12.276379+0000","last_peered":"2024-09-19T15:31:12.276379+0000","last_clean":"2024-09-19T15:31:12.276379+0000","last_became_active":"2024-09-19T13:40:36.225954+0000","last_became_peered":"2024-09-19T13:40:36.225954+0000","last_unstale":"2024-09-19T15:31:12.276379+0000","last_undegraded":"2024-09-19T15:31:12.276379+0000","last_fullsized":"2024-09-19T15:31:12.276379+0000","mapping_epoch":27,"log_start":"268'1500","ondisk_log_start":"268'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:17.018995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7021,"num_read_kb":6136,"num_write":2176,"num_write_kb":944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'248","reported_seq":951,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.640693+0000","last_change":"2024-09-19T13:40:34.275994+0000","last_active":"2024-09-19T15:28:07.640693+0000","last_peered":"2024-09-19T15:28:07.640693+0000","last_clean":"2024-09-19T15:28:07.640693+0000","last_became_active":"2024-09-19T13:40:34.267254+0000","last_became_peered":"2024-09-19T13:40:34.267254+0000","last_unstale":"2024-09-19T15:28:07.640693+0000","last_undegraded":"2024-09-19T15:28:07.640693+0000","last_fullsized":"2024-09-19T15:28:07.640693+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:10:14.953671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1175961,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":599,"num_read_kb":4762,"num_write":856,"num_write_kb":10224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"268'447","reported_seq":2099,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:07.396639+0000","last_change":"2024-09-19T13:40:36.221236+0000","last_active":"2024-09-19T15:29:07.396639+0000","last_peered":"2024-09-19T15:29:07.396639+0000","last_clean":"2024-09-19T15:29:07.396639+0000","last_became_active":"2024-09-19T13:40:36.220431+0000","last_became_peered":"2024-09-19T13:40:36.220431+0000","last_unstale":"2024-09-19T15:29:07.396639+0000","last_undegraded":"2024-09-19T15:29:07.396639+0000","last_fullsized":"2024-09-19T15:29:07.396639+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:52:16.868711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2602,"num_read_kb":2484,"num_write":543,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'257","reported_seq":903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:06.208639+0000","last_change":"2024-09-19T13:40:34.226045+0000","last_active":"2024-09-19T15:31:06.208639+0000","last_peered":"2024-09-19T15:31:06.208639+0000","last_clean":"2024-09-19T15:31:06.208639+0000","last_became_active":"2024-09-19T13:40:34.218957+0000","last_became_peered":"2024-09-19T13:40:34.218957+0000","last_unstale":"2024-09-19T15:31:06.208639+0000","last_undegraded":"2024-09-19T15:31:06.208639+0000","last_fullsized":"2024-09-19T15:31:06.208639+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:01.849971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6885246,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":447,"num_read_kb":8139,"num_write":914,"num_write_kb":24727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'795","reported_seq":2558,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.611809+0000","last_change":"2024-09-19T13:40:36.231857+0000","last_active":"2024-09-19T15:28:57.611809+0000","last_peered":"2024-09-19T15:28:57.611809+0000","last_clean":"2024-09-19T15:28:57.611809+0000","last_became_active":"2024-09-19T13:40:36.228785+0000","last_became_peered":"2024-09-19T13:40:36.228785+0000","last_unstale":"2024-09-19T15:28:57.611809+0000","last_undegraded":"2024-09-19T15:28:57.611809+0000","last_fullsized":"2024-09-19T15:28:57.611809+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:24:05.926374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4179,"num_read_kb":3830,"num_write":1044,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'280","reported_seq":928,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.640604+0000","last_change":"2024-09-19T13:40:34.268730+0000","last_active":"2024-09-19T15:28:07.640604+0000","last_peered":"2024-09-19T15:28:07.640604+0000","last_clean":"2024-09-19T15:28:07.640604+0000","last_became_active":"2024-09-19T13:40:34.267647+0000","last_became_peered":"2024-09-19T13:40:34.267647+0000","last_unstale":"2024-09-19T15:28:07.640604+0000","last_undegraded":"2024-09-19T15:28:07.640604+0000","last_fullsized":"2024-09-19T15:28:07.640604+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:41.507634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22424101,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":484,"num_read_kb":19591,"num_write":1013,"num_write_kb":28817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"268'1154","reported_seq":2774,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.631097+0000","last_change":"2024-09-19T13:40:36.231346+0000","last_active":"2024-09-19T15:28:57.631097+0000","last_peered":"2024-09-19T15:28:57.631097+0000","last_clean":"2024-09-19T15:28:57.631097+0000","last_became_active":"2024-09-19T13:40:36.230581+0000","last_became_peered":"2024-09-19T13:40:36.230581+0000","last_unstale":"2024-09-19T15:28:57.631097+0000","last_undegraded":"2024-09-19T15:28:57.631097+0000","last_fullsized":"2024-09-19T15:28:57.631097+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":1100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:33:28.578391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5418,"num_read_kb":4799,"num_write":1598,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'320","reported_seq":1063,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:08.231546+0000","last_change":"2024-09-19T13:40:34.237921+0000","last_active":"2024-09-19T15:28:08.231546+0000","last_peered":"2024-09-19T15:28:08.231546+0000","last_clean":"2024-09-19T15:28:08.231546+0000","last_became_active":"2024-09-19T13:40:34.237561+0000","last_became_peered":"2024-09-19T13:40:34.237561+0000","last_unstale":"2024-09-19T15:28:08.231546+0000","last_undegraded":"2024-09-19T15:28:08.231546+0000","last_fullsized":"2024-09-19T15:28:08.231546+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:55.737645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19811415,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":785,"num_read_kb":72182,"num_write":1114,"num_write_kb":41551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'651","reported_seq":2356,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.323183+0000","last_change":"2024-09-19T13:40:36.223002+0000","last_active":"2024-09-19T15:31:12.323183+0000","last_peered":"2024-09-19T15:31:12.323183+0000","last_clean":"2024-09-19T15:31:12.323183+0000","last_became_active":"2024-09-19T13:40:36.221587+0000","last_became_peered":"2024-09-19T13:40:36.221587+0000","last_unstale":"2024-09-19T15:31:12.323183+0000","last_undegraded":"2024-09-19T15:31:12.323183+0000","last_fullsized":"2024-09-19T15:31:12.323183+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":600,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:09:30.633730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3331,"num_read_kb":3024,"num_write":858,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'1220","reported_seq":3029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.597578+0000","last_change":"2024-09-19T13:40:36.228802+0000","last_active":"2024-09-19T15:27:57.597578+0000","last_peered":"2024-09-19T15:27:57.597578+0000","last_clean":"2024-09-19T15:27:57.597578+0000","last_became_active":"2024-09-19T13:40:36.220889+0000","last_became_peered":"2024-09-19T13:40:36.220889+0000","last_unstale":"2024-09-19T15:27:57.597578+0000","last_undegraded":"2024-09-19T15:27:57.597578+0000","last_fullsized":"2024-09-19T15:27:57.597578+0000","mapping_epoch":27,"log_start":"268'1200","ondisk_log_start":"268'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":1200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:58.428789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5895,"num_read_kb":5235,"num_write":1696,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'346","reported_seq":1076,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.629874+0000","last_change":"2024-09-19T13:40:34.280286+0000","last_active":"2024-09-19T15:27:22.629874+0000","last_peered":"2024-09-19T15:27:22.629874+0000","last_clean":"2024-09-19T15:27:22.629874+0000","last_became_active":"2024-09-19T13:40:34.278991+0000","last_became_peered":"2024-09-19T13:40:34.278991+0000","last_unstale":"2024-09-19T15:27:22.629874+0000","last_undegraded":"2024-09-19T15:27:22.629874+0000","last_fullsized":"2024-09-19T15:27:22.629874+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:34.156634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3264053,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":897,"num_read_kb":8273,"num_write":1205,"num_write_kb":26935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'1133","reported_seq":2648,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:39.715402+0000","last_change":"2024-09-19T13:40:36.233737+0000","last_active":"2024-09-19T15:28:39.715402+0000","last_peered":"2024-09-19T15:28:39.715402+0000","last_clean":"2024-09-19T15:28:39.715402+0000","last_became_active":"2024-09-19T13:40:36.233032+0000","last_became_peered":"2024-09-19T13:40:36.233032+0000","last_unstale":"2024-09-19T15:28:39.715402+0000","last_undegraded":"2024-09-19T15:28:39.715402+0000","last_fullsized":"2024-09-19T15:28:39.715402+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":1100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:01.168529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5185,"num_read_kb":4564,"num_write":1576,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'292","reported_seq":951,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:26:57.565745+0000","last_change":"2024-09-19T13:40:34.258739+0000","last_active":"2024-09-19T15:26:57.565745+0000","last_peered":"2024-09-19T15:26:57.565745+0000","last_clean":"2024-09-19T15:26:57.565745+0000","last_became_active":"2024-09-19T13:40:34.257994+0000","last_became_peered":"2024-09-19T13:40:34.257994+0000","last_unstale":"2024-09-19T15:26:57.565745+0000","last_undegraded":"2024-09-19T15:26:57.565745+0000","last_fullsized":"2024-09-19T15:26:57.565745+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:29.815057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5607532,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":540,"num_read_kb":26261,"num_write":1133,"num_write_kb":39497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"268'589","reported_seq":2568,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:46.037916+0000","last_change":"2024-09-19T13:40:36.232300+0000","last_active":"2024-09-19T15:28:46.037916+0000","last_peered":"2024-09-19T15:28:46.037916+0000","last_clean":"2024-09-19T15:28:46.037916+0000","last_became_active":"2024-09-19T13:40:36.231554+0000","last_became_peered":"2024-09-19T13:40:36.231554+0000","last_unstale":"2024-09-19T15:28:46.037916+0000","last_undegraded":"2024-09-19T15:28:46.037916+0000","last_fullsized":"2024-09-19T15:28:46.037916+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":500,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:04.811846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3450,"num_read_kb":3252,"num_write":736,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'289","reported_seq":929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:45.700438+0000","last_change":"2024-09-19T13:40:34.265083+0000","last_active":"2024-09-19T15:28:45.700438+0000","last_peered":"2024-09-19T15:28:45.700438+0000","last_clean":"2024-09-19T15:28:45.700438+0000","last_became_active":"2024-09-19T13:40:34.264349+0000","last_became_peered":"2024-09-19T13:40:34.264349+0000","last_unstale":"2024-09-19T15:28:45.700438+0000","last_undegraded":"2024-09-19T15:28:45.700438+0000","last_fullsized":"2024-09-19T15:28:45.700438+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:55.371080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13285940,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":525,"num_read_kb":18139,"num_write":1073,"num_write_kb":28020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'533","reported_seq":2156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.231056+0000","last_change":"2024-09-19T13:40:36.222241+0000","last_active":"2024-09-19T15:29:41.231056+0000","last_peered":"2024-09-19T15:29:41.231056+0000","last_clean":"2024-09-19T15:29:41.231056+0000","last_became_active":"2024-09-19T13:40:36.221266+0000","last_became_peered":"2024-09-19T13:40:36.221266+0000","last_unstale":"2024-09-19T15:29:41.231056+0000","last_undegraded":"2024-09-19T15:29:41.231056+0000","last_fullsized":"2024-09-19T15:29:41.231056+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:17.944396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2921,"num_read_kb":2700,"num_write":709,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'275","reported_seq":1122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:26:57.583847+0000","last_change":"2024-09-19T13:40:34.266244+0000","last_active":"2024-09-19T15:26:57.583847+0000","last_peered":"2024-09-19T15:26:57.583847+0000","last_clean":"2024-09-19T15:26:57.583847+0000","last_became_active":"2024-09-19T13:40:34.262084+0000","last_became_peered":"2024-09-19T13:40:34.262084+0000","last_unstale":"2024-09-19T15:26:57.583847+0000","last_undegraded":"2024-09-19T15:26:57.583847+0000","last_fullsized":"2024-09-19T15:26:57.583847+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:10:19.847500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213551,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":1101,"num_read_kb":45011,"num_write":949,"num_write_kb":26916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"268'461","reported_seq":2066,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.328055+0000","last_change":"2024-09-19T13:40:36.216484+0000","last_active":"2024-09-19T15:29:48.328055+0000","last_peered":"2024-09-19T15:29:48.328055+0000","last_clean":"2024-09-19T15:29:48.328055+0000","last_became_active":"2024-09-19T13:40:36.216082+0000","last_became_peered":"2024-09-19T13:40:36.216082+0000","last_unstale":"2024-09-19T15:29:48.328055+0000","last_undegraded":"2024-09-19T15:29:48.328055+0000","last_fullsized":"2024-09-19T15:29:48.328055+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:42.568128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2409,"num_read_kb":2273,"num_write":537,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'264","reported_seq":910,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:40.941556+0000","last_change":"2024-09-19T13:40:34.238078+0000","last_active":"2024-09-19T15:29:40.941556+0000","last_peered":"2024-09-19T15:29:40.941556+0000","last_clean":"2024-09-19T15:29:40.941556+0000","last_became_active":"2024-09-19T13:40:34.237589+0000","last_became_peered":"2024-09-19T13:40:34.237589+0000","last_unstale":"2024-09-19T15:29:40.941556+0000","last_undegraded":"2024-09-19T15:29:40.941556+0000","last_fullsized":"2024-09-19T15:29:40.941556+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:46.977541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10513849,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":396,"num_read_kb":27576,"num_write":885,"num_write_kb":52672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'576","reported_seq":2260,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.332414+0000","last_change":"2024-09-19T13:40:36.229601+0000","last_active":"2024-09-19T15:29:48.332414+0000","last_peered":"2024-09-19T15:29:48.332414+0000","last_clean":"2024-09-19T15:29:48.332414+0000","last_became_active":"2024-09-19T13:40:36.220183+0000","last_became_peered":"2024-09-19T13:40:36.220183+0000","last_unstale":"2024-09-19T15:29:48.332414+0000","last_undegraded":"2024-09-19T15:29:48.332414+0000","last_fullsized":"2024-09-19T15:29:48.332414+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:46:00.909462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3052,"num_read_kb":2823,"num_write":743,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'321","reported_seq":1027,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:52.216398+0000","last_change":"2024-09-19T13:40:34.225269+0000","last_active":"2024-09-19T15:30:52.216398+0000","last_peered":"2024-09-19T15:30:52.216398+0000","last_clean":"2024-09-19T15:30:52.216398+0000","last_became_active":"2024-09-19T13:40:34.224813+0000","last_became_peered":"2024-09-19T13:40:34.224813+0000","last_unstale":"2024-09-19T15:30:52.216398+0000","last_undegraded":"2024-09-19T15:30:52.216398+0000","last_fullsized":"2024-09-19T15:30:52.216398+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:19.334744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6377975,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":767,"num_read_kb":1243,"num_write":1421,"num_write_kb":25860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'139","reported_seq":664,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.886707+0000","last_change":"2024-09-19T13:40:44.242817+0000","last_active":"2024-09-19T15:29:50.886707+0000","last_peered":"2024-09-19T15:29:50.886707+0000","last_clean":"2024-09-19T15:29:50.886707+0000","last_became_active":"2024-09-19T13:40:44.242028+0000","last_became_peered":"2024-09-19T13:40:44.242028+0000","last_unstale":"2024-09-19T15:29:50.886707+0000","last_undegraded":"2024-09-19T15:29:50.886707+0000","last_fullsized":"2024-09-19T15:29:50.886707+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:07.663672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":180,"num_write":320,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'408","reported_seq":1932,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:35.019802+0000","last_change":"2024-09-19T13:40:36.219418+0000","last_active":"2024-09-19T15:28:35.019802+0000","last_peered":"2024-09-19T15:28:35.019802+0000","last_clean":"2024-09-19T15:28:35.019802+0000","last_became_active":"2024-09-19T13:40:36.218091+0000","last_became_peered":"2024-09-19T13:40:36.218091+0000","last_unstale":"2024-09-19T15:28:35.019802+0000","last_undegraded":"2024-09-19T15:28:35.019802+0000","last_fullsized":"2024-09-19T15:28:35.019802+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:59.320209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2211,"num_read_kb":2096,"num_write":485,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"268'290","reported_seq":924,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:07.278533+0000","last_change":"2024-09-19T13:41:05.387127+0000","last_active":"2024-09-19T15:31:07.278533+0000","last_peered":"2024-09-19T15:31:07.278533+0000","last_clean":"2024-09-19T15:31:07.278533+0000","last_became_active":"2024-09-19T13:41:05.386216+0000","last_became_peered":"2024-09-19T13:41:05.386216+0000","last_unstale":"2024-09-19T15:31:07.278533+0000","last_undegraded":"2024-09-19T15:31:07.278533+0000","last_fullsized":"2024-09-19T15:31:07.278533+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:44:15.979639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24444010,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":558,"num_read_kb":13820,"num_write":1110,"num_write_kb":52710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:02.604412+0000","last_change":"2024-09-19T13:40:38.223574+0000","last_active":"2024-09-19T15:27:02.604412+0000","last_peered":"2024-09-19T15:27:02.604412+0000","last_clean":"2024-09-19T15:27:02.604412+0000","last_became_active":"2024-09-19T13:40:38.222863+0000","last_became_peered":"2024-09-19T13:40:38.222863+0000","last_unstale":"2024-09-19T15:27:02.604412+0000","last_undegraded":"2024-09-19T15:27:02.604412+0000","last_fullsized":"2024-09-19T15:27:02.604412+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:15:56.276142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'379","reported_seq":1019,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.316958+0000","last_change":"2024-09-19T13:40:40.231128+0000","last_active":"2024-09-19T15:31:17.316958+0000","last_peered":"2024-09-19T15:31:17.316958+0000","last_clean":"2024-09-19T15:31:17.316958+0000","last_became_active":"2024-09-19T13:40:40.230368+0000","last_became_peered":"2024-09-19T13:40:40.230368+0000","last_unstale":"2024-09-19T15:31:17.316958+0000","last_undegraded":"2024-09-19T15:31:17.316958+0000","last_fullsized":"2024-09-19T15:31:17.316958+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:13:15.313671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59496,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":610,"num_read_kb":1122,"num_write":484,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:02.624637+0000","last_change":"2024-09-19T13:40:42.240924+0000","last_active":"2024-09-19T15:27:02.624637+0000","last_peered":"2024-09-19T15:27:02.624637+0000","last_clean":"2024-09-19T15:27:02.624637+0000","last_became_active":"2024-09-19T13:40:42.240244+0000","last_became_peered":"2024-09-19T13:40:42.240244+0000","last_unstale":"2024-09-19T15:27:02.624637+0000","last_undegraded":"2024-09-19T15:27:02.624637+0000","last_fullsized":"2024-09-19T15:27:02.624637+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:06.922385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'2486","reported_seq":4344,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:45.480776+0000","last_change":"2024-09-19T13:40:44.263920+0000","last_active":"2024-09-19T15:29:45.480776+0000","last_peered":"2024-09-19T15:29:45.480776+0000","last_clean":"2024-09-19T15:29:45.480776+0000","last_became_active":"2024-09-19T13:40:44.263152+0000","last_became_peered":"2024-09-19T13:40:44.263152+0000","last_unstale":"2024-09-19T15:29:45.480776+0000","last_undegraded":"2024-09-19T15:29:45.480776+0000","last_fullsized":"2024-09-19T15:29:45.480776+0000","mapping_epoch":35,"log_start":"268'2400","ondisk_log_start":"268'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":2400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:49:06.263897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6208,"num_read_kb":6212,"num_write":5020,"num_write_kb":1848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'368","reported_seq":1865,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:35.016803+0000","last_change":"2024-09-19T13:40:36.242921+0000","last_active":"2024-09-19T15:28:35.016803+0000","last_peered":"2024-09-19T15:28:35.016803+0000","last_clean":"2024-09-19T15:28:35.016803+0000","last_became_active":"2024-09-19T13:40:36.242260+0000","last_became_peered":"2024-09-19T13:40:36.242260+0000","last_unstale":"2024-09-19T15:28:35.016803+0000","last_undegraded":"2024-09-19T15:28:35.016803+0000","last_fullsized":"2024-09-19T15:28:35.016803+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:56.906330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2141,"num_read_kb":2035,"num_write":405,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'250","reported_seq":904,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.176678+0000","last_change":"2024-09-19T13:40:34.255205+0000","last_active":"2024-09-19T15:27:57.176678+0000","last_peered":"2024-09-19T15:27:57.176678+0000","last_clean":"2024-09-19T15:27:57.176678+0000","last_became_active":"2024-09-19T13:40:34.254811+0000","last_became_peered":"2024-09-19T13:40:34.254811+0000","last_unstale":"2024-09-19T15:27:57.176678+0000","last_undegraded":"2024-09-19T15:27:57.176678+0000","last_fullsized":"2024-09-19T15:27:57.176678+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:45.032111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5568747,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":529,"num_read_kb":3104,"num_write":980,"num_write_kb":15827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:13.233018+0000","last_change":"2024-09-19T13:40:38.234491+0000","last_active":"2024-09-19T15:28:13.233018+0000","last_peered":"2024-09-19T15:28:13.233018+0000","last_clean":"2024-09-19T15:28:13.233018+0000","last_became_active":"2024-09-19T13:40:38.233854+0000","last_became_peered":"2024-09-19T13:40:38.233854+0000","last_unstale":"2024-09-19T15:28:13.233018+0000","last_undegraded":"2024-09-19T15:28:13.233018+0000","last_fullsized":"2024-09-19T15:28:13.233018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:58.032011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'125","reported_seq":693,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.055494+0000","last_change":"2024-09-19T13:40:40.245668+0000","last_active":"2024-09-19T15:31:18.055494+0000","last_peered":"2024-09-19T15:31:18.055494+0000","last_clean":"2024-09-19T15:31:18.055494+0000","last_became_active":"2024-09-19T13:40:40.244841+0000","last_became_peered":"2024-09-19T13:40:40.244841+0000","last_unstale":"2024-09-19T15:31:18.055494+0000","last_undegraded":"2024-09-19T15:31:18.055494+0000","last_fullsized":"2024-09-19T15:31:18.055494+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:42.542622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":152,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:02.585177+0000","last_change":"2024-09-19T13:40:42.235946+0000","last_active":"2024-09-19T15:27:02.585177+0000","last_peered":"2024-09-19T15:27:02.585177+0000","last_clean":"2024-09-19T15:27:02.585177+0000","last_became_active":"2024-09-19T13:40:42.235151+0000","last_became_peered":"2024-09-19T13:40:42.235151+0000","last_unstale":"2024-09-19T15:27:02.585177+0000","last_undegraded":"2024-09-19T15:27:02.585177+0000","last_fullsized":"2024-09-19T15:27:02.585177+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:38.338083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'95","reported_seq":615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:17.181187+0000","last_change":"2024-09-19T13:40:44.263112+0000","last_active":"2024-09-19T15:28:17.181187+0000","last_peered":"2024-09-19T15:28:17.181187+0000","last_clean":"2024-09-19T15:28:17.181187+0000","last_became_active":"2024-09-19T13:40:44.262343+0000","last_became_peered":"2024-09-19T13:40:44.262343+0000","last_unstale":"2024-09-19T15:28:17.181187+0000","last_undegraded":"2024-09-19T15:28:17.181187+0000","last_fullsized":"2024-09-19T15:28:17.181187+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:52.097942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":127,"num_write":220,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'737","reported_seq":2237,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:49.328720+0000","last_change":"2024-09-19T13:40:36.225854+0000","last_active":"2024-09-19T15:28:49.328720+0000","last_peered":"2024-09-19T15:28:49.328720+0000","last_clean":"2024-09-19T15:28:49.328720+0000","last_became_active":"2024-09-19T13:40:36.225170+0000","last_became_peered":"2024-09-19T13:40:36.225170+0000","last_unstale":"2024-09-19T15:28:49.328720+0000","last_undegraded":"2024-09-19T15:28:49.328720+0000","last_fullsized":"2024-09-19T15:28:49.328720+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:12:27.103294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3445,"num_read_kb":3119,"num_write":970,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'275","reported_seq":906,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.637993+0000","last_change":"2024-09-19T13:40:34.274237+0000","last_active":"2024-09-19T15:27:57.637993+0000","last_peered":"2024-09-19T15:27:57.637993+0000","last_clean":"2024-09-19T15:27:57.637993+0000","last_became_active":"2024-09-19T13:40:34.273656+0000","last_became_peered":"2024-09-19T13:40:34.273656+0000","last_unstale":"2024-09-19T15:27:57.637993+0000","last_undegraded":"2024-09-19T15:27:57.637993+0000","last_fullsized":"2024-09-19T15:27:57.637993+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:26.259004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6859781,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":441,"num_read_kb":12420,"num_write":964,"num_write_kb":39158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:03.216447+0000","last_change":"2024-09-19T13:40:38.220743+0000","last_active":"2024-09-19T15:27:03.216447+0000","last_peered":"2024-09-19T15:27:03.216447+0000","last_clean":"2024-09-19T15:27:03.216447+0000","last_became_active":"2024-09-19T13:40:38.220474+0000","last_became_peered":"2024-09-19T13:40:38.220474+0000","last_unstale":"2024-09-19T15:27:03.216447+0000","last_undegraded":"2024-09-19T15:27:03.216447+0000","last_fullsized":"2024-09-19T15:27:03.216447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:08.656145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'187","reported_seq":780,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.159010+0000","last_change":"2024-09-19T13:40:40.248851+0000","last_active":"2024-09-19T15:31:18.159010+0000","last_peered":"2024-09-19T15:31:18.159010+0000","last_clean":"2024-09-19T15:31:18.159010+0000","last_became_active":"2024-09-19T13:40:40.247893+0000","last_became_peered":"2024-09-19T13:40:40.247893+0000","last_unstale":"2024-09-19T15:31:18.159010+0000","last_undegraded":"2024-09-19T15:31:18.159010+0000","last_fullsized":"2024-09-19T15:31:18.159010+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:37:12.351165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":225,"num_write":160,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'758","reported_seq":3177,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:16.995115+0000","last_change":"2024-09-19T13:40:42.239953+0000","last_active":"2024-09-19T15:31:16.995115+0000","last_peered":"2024-09-19T15:31:16.995115+0000","last_clean":"2024-09-19T15:31:16.995115+0000","last_became_active":"2024-09-19T13:40:42.239059+0000","last_became_peered":"2024-09-19T13:40:42.239059+0000","last_unstale":"2024-09-19T15:31:16.995115+0000","last_undegraded":"2024-09-19T15:31:16.995115+0000","last_fullsized":"2024-09-19T15:31:16.995115+0000","mapping_epoch":33,"log_start":"268'701","ondisk_log_start":"268'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":701,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:40.662697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'225","reported_seq":1068,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:51.070933+0000","last_change":"2024-09-19T13:40:44.278447+0000","last_active":"2024-09-19T15:29:51.070933+0000","last_peered":"2024-09-19T15:29:51.070933+0000","last_clean":"2024-09-19T15:29:51.070933+0000","last_became_active":"2024-09-19T13:40:44.277966+0000","last_became_peered":"2024-09-19T13:40:44.277966+0000","last_unstale":"2024-09-19T15:29:51.070933+0000","last_undegraded":"2024-09-19T15:29:51.070933+0000","last_fullsized":"2024-09-19T15:29:51.070933+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:46.773156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":650,"num_read_kb":649,"num_write":494,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'747","reported_seq":2159,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:26:58.215034+0000","last_change":"2024-09-19T13:40:36.238808+0000","last_active":"2024-09-19T15:26:58.215034+0000","last_peered":"2024-09-19T15:26:58.215034+0000","last_clean":"2024-09-19T15:26:58.215034+0000","last_became_active":"2024-09-19T13:40:36.238400+0000","last_became_peered":"2024-09-19T13:40:36.238400+0000","last_unstale":"2024-09-19T15:26:58.215034+0000","last_undegraded":"2024-09-19T15:26:58.215034+0000","last_fullsized":"2024-09-19T15:26:58.215034+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:37.752219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3489,"num_read_kb":3124,"num_write":1003,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'331","reported_seq":1013,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.380516+0000","last_change":"2024-09-19T13:40:34.258945+0000","last_active":"2024-09-19T15:27:57.380516+0000","last_peered":"2024-09-19T15:27:57.380516+0000","last_clean":"2024-09-19T15:27:57.380516+0000","last_became_active":"2024-09-19T13:40:34.257596+0000","last_became_peered":"2024-09-19T13:40:34.257596+0000","last_unstale":"2024-09-19T15:27:57.380516+0000","last_undegraded":"2024-09-19T15:27:57.380516+0000","last_fullsized":"2024-09-19T15:27:57.380516+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:10:14.579685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764711,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":674,"num_read_kb":35384,"num_write":1267,"num_write_kb":23932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:02.604463+0000","last_change":"2024-09-19T13:40:38.212988+0000","last_active":"2024-09-19T15:27:02.604463+0000","last_peered":"2024-09-19T15:27:02.604463+0000","last_clean":"2024-09-19T15:27:02.604463+0000","last_became_active":"2024-09-19T13:40:38.212327+0000","last_became_peered":"2024-09-19T13:40:38.212327+0000","last_unstale":"2024-09-19T15:27:02.604463+0000","last_undegraded":"2024-09-19T15:27:02.604463+0000","last_fullsized":"2024-09-19T15:27:02.604463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:22:45.697525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'309","reported_seq":924,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.172539+0000","last_change":"2024-09-19T13:40:40.226231+0000","last_active":"2024-09-19T15:31:18.172539+0000","last_peered":"2024-09-19T15:31:18.172539+0000","last_clean":"2024-09-19T15:31:18.172539+0000","last_became_active":"2024-09-19T13:40:40.225512+0000","last_became_peered":"2024-09-19T13:40:40.225512+0000","last_unstale":"2024-09-19T15:31:18.172539+0000","last_undegraded":"2024-09-19T15:31:18.172539+0000","last_fullsized":"2024-09-19T15:31:18.172539+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:59:24.943872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54478,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":500,"num_read_kb":991,"num_write":404,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'782","reported_seq":2989,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:16.987151+0000","last_change":"2024-09-19T13:40:42.264377+0000","last_active":"2024-09-19T15:31:16.987151+0000","last_peered":"2024-09-19T15:31:16.987151+0000","last_clean":"2024-09-19T15:31:16.987151+0000","last_became_active":"2024-09-19T13:40:42.263635+0000","last_became_peered":"2024-09-19T13:40:42.263635+0000","last_unstale":"2024-09-19T15:31:16.987151+0000","last_undegraded":"2024-09-19T15:31:16.987151+0000","last_fullsized":"2024-09-19T15:31:16.987151+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:30.524751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'499","reported_seq":2102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.630887+0000","last_change":"2024-09-19T13:40:36.241060+0000","last_active":"2024-09-19T15:28:57.630887+0000","last_peered":"2024-09-19T15:28:57.630887+0000","last_clean":"2024-09-19T15:28:57.630887+0000","last_became_active":"2024-09-19T13:40:36.235739+0000","last_became_peered":"2024-09-19T13:40:36.235739+0000","last_unstale":"2024-09-19T15:28:57.630887+0000","last_undegraded":"2024-09-19T15:28:57.630887+0000","last_fullsized":"2024-09-19T15:28:57.630887+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:36:20.856962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2574,"num_read_kb":2392,"num_write":618,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'308","reported_seq":1023,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.654151+0000","last_change":"2024-09-19T13:41:05.310671+0000","last_active":"2024-09-19T15:29:02.654151+0000","last_peered":"2024-09-19T15:29:02.654151+0000","last_clean":"2024-09-19T15:29:02.654151+0000","last_became_active":"2024-09-19T13:41:05.309594+0000","last_became_peered":"2024-09-19T13:41:05.309594+0000","last_unstale":"2024-09-19T15:29:02.654151+0000","last_undegraded":"2024-09-19T15:29:02.654151+0000","last_fullsized":"2024-09-19T15:29:02.654151+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:17.208658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329623,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":709,"num_read_kb":65184,"num_write":1123,"num_write_kb":23524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.653933+0000","last_change":"2024-09-19T13:40:38.234609+0000","last_active":"2024-09-19T15:29:02.653933+0000","last_peered":"2024-09-19T15:29:02.653933+0000","last_clean":"2024-09-19T15:29:02.653933+0000","last_became_active":"2024-09-19T13:40:38.233892+0000","last_became_peered":"2024-09-19T13:40:38.233892+0000","last_unstale":"2024-09-19T15:29:02.653933+0000","last_undegraded":"2024-09-19T15:29:02.653933+0000","last_fullsized":"2024-09-19T15:29:02.653933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:30.027284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'453","reported_seq":1155,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.358994+0000","last_change":"2024-09-19T13:40:40.233291+0000","last_active":"2024-09-19T15:31:18.358994+0000","last_peered":"2024-09-19T15:31:18.358994+0000","last_clean":"2024-09-19T15:31:18.358994+0000","last_became_active":"2024-09-19T13:40:40.232582+0000","last_became_peered":"2024-09-19T13:40:40.232582+0000","last_unstale":"2024-09-19T15:31:18.358994+0000","last_undegraded":"2024-09-19T15:31:18.358994+0000","last_fullsized":"2024-09-19T15:31:18.358994+0000","mapping_epoch":31,"log_start":"268'400","ondisk_log_start":"268'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:05.930746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56133,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":727,"num_read_kb":1218,"num_write":554,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.388312+0000","last_change":"2024-09-19T13:40:42.240589+0000","last_active":"2024-09-19T15:28:42.388312+0000","last_peered":"2024-09-19T15:28:42.388312+0000","last_clean":"2024-09-19T15:28:42.388312+0000","last_became_active":"2024-09-19T13:40:42.239961+0000","last_became_peered":"2024-09-19T13:40:42.239961+0000","last_unstale":"2024-09-19T15:28:42.388312+0000","last_undegraded":"2024-09-19T15:28:42.388312+0000","last_fullsized":"2024-09-19T15:28:42.388312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:04.578390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'544","reported_seq":1392,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.257388+0000","last_change":"2024-09-19T13:40:44.264532+0000","last_active":"2024-09-19T15:31:13.257388+0000","last_peered":"2024-09-19T15:31:13.257388+0000","last_clean":"2024-09-19T15:31:13.257388+0000","last_became_active":"2024-09-19T13:40:44.263313+0000","last_became_peered":"2024-09-19T13:40:44.263313+0000","last_unstale":"2024-09-19T15:31:13.257388+0000","last_undegraded":"2024-09-19T15:31:13.257388+0000","last_fullsized":"2024-09-19T15:31:13.257388+0000","mapping_epoch":35,"log_start":"268'500","ondisk_log_start":"268'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:17.459491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1297,"num_read_kb":1297,"num_write":1122,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'466","reported_seq":2113,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.656141+0000","last_change":"2024-09-19T13:40:36.219545+0000","last_active":"2024-09-19T15:29:50.656141+0000","last_peered":"2024-09-19T15:29:50.656141+0000","last_clean":"2024-09-19T15:29:50.656141+0000","last_became_active":"2024-09-19T13:40:36.218822+0000","last_became_peered":"2024-09-19T13:40:36.218822+0000","last_unstale":"2024-09-19T15:29:50.656141+0000","last_undegraded":"2024-09-19T15:29:50.656141+0000","last_fullsized":"2024-09-19T15:29:50.656141+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:28.807691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2519,"num_read_kb":2376,"num_write":558,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'257","reported_seq":910,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.648062+0000","last_change":"2024-09-19T13:40:34.279254+0000","last_active":"2024-09-19T15:28:37.648062+0000","last_peered":"2024-09-19T15:28:37.648062+0000","last_clean":"2024-09-19T15:28:37.648062+0000","last_became_active":"2024-09-19T13:40:34.278684+0000","last_became_peered":"2024-09-19T13:40:34.278684+0000","last_unstale":"2024-09-19T15:28:37.648062+0000","last_undegraded":"2024-09-19T15:28:37.648062+0000","last_fullsized":"2024-09-19T15:28:37.648062+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:10.126915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31819,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":476,"num_read_kb":16871,"num_write":931,"num_write_kb":22319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.557575+0000","last_change":"2024-09-19T13:40:38.229050+0000","last_active":"2024-09-19T15:29:02.557575+0000","last_peered":"2024-09-19T15:29:02.557575+0000","last_clean":"2024-09-19T15:29:02.557575+0000","last_became_active":"2024-09-19T13:40:38.228765+0000","last_became_peered":"2024-09-19T13:40:38.228765+0000","last_unstale":"2024-09-19T15:29:02.557575+0000","last_undegraded":"2024-09-19T15:29:02.557575+0000","last_fullsized":"2024-09-19T15:29:02.557575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:11.148186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'309","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.120871+0000","last_change":"2024-09-19T13:40:40.228045+0000","last_active":"2024-09-19T15:31:18.120871+0000","last_peered":"2024-09-19T15:31:18.120871+0000","last_clean":"2024-09-19T15:31:18.120871+0000","last_became_active":"2024-09-19T13:40:40.226899+0000","last_became_peered":"2024-09-19T13:40:40.226899+0000","last_unstale":"2024-09-19T15:31:18.120871+0000","last_undegraded":"2024-09-19T15:31:18.120871+0000","last_fullsized":"2024-09-19T15:31:18.120871+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:59.398796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54712,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":512,"num_read_kb":1018,"num_write":414,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:13.246852+0000","last_change":"2024-09-19T13:40:42.250224+0000","last_active":"2024-09-19T15:29:13.246852+0000","last_peered":"2024-09-19T15:29:13.246852+0000","last_clean":"2024-09-19T15:29:13.246852+0000","last_became_active":"2024-09-19T13:40:42.245030+0000","last_became_peered":"2024-09-19T13:40:42.245030+0000","last_unstale":"2024-09-19T15:29:13.246852+0000","last_undegraded":"2024-09-19T15:29:13.246852+0000","last_fullsized":"2024-09-19T15:29:13.246852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:07:01.322432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'125","reported_seq":635,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:37.403378+0000","last_change":"2024-09-19T13:40:44.254756+0000","last_active":"2024-09-19T15:29:37.403378+0000","last_peered":"2024-09-19T15:29:37.403378+0000","last_clean":"2024-09-19T15:29:37.403378+0000","last_became_active":"2024-09-19T13:40:44.254015+0000","last_became_peered":"2024-09-19T13:40:44.254015+0000","last_unstale":"2024-09-19T15:29:37.403378+0000","last_undegraded":"2024-09-19T15:29:37.403378+0000","last_fullsized":"2024-09-19T15:29:37.403378+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:31:55.327099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":134,"num_write":317,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'412","reported_seq":1974,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.381038+0000","last_change":"2024-09-19T13:42:05.614112+0000","last_active":"2024-09-19T15:29:48.381038+0000","last_peered":"2024-09-19T15:29:48.381038+0000","last_clean":"2024-09-19T15:29:48.381038+0000","last_became_active":"2024-09-19T13:42:05.613410+0000","last_became_peered":"2024-09-19T13:42:05.613410+0000","last_unstale":"2024-09-19T15:29:48.381038+0000","last_undegraded":"2024-09-19T15:29:48.381038+0000","last_fullsized":"2024-09-19T15:29:48.381038+0000","mapping_epoch":40,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:38:56.362442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2294,"num_read_kb":2176,"num_write":469,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'301","reported_seq":1017,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:11.104149+0000","last_change":"2024-09-19T13:40:34.268729+0000","last_active":"2024-09-19T15:31:11.104149+0000","last_peered":"2024-09-19T15:31:11.104149+0000","last_clean":"2024-09-19T15:31:11.104149+0000","last_became_active":"2024-09-19T13:40:34.268005+0000","last_became_peered":"2024-09-19T13:40:34.268005+0000","last_unstale":"2024-09-19T15:31:11.104149+0000","last_undegraded":"2024-09-19T15:31:11.104149+0000","last_fullsized":"2024-09-19T15:31:11.104149+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:39.540040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2146130,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":705,"num_read_kb":24616,"num_write":1210,"num_write_kb":39661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.553914+0000","last_change":"2024-09-19T13:40:38.232016+0000","last_active":"2024-09-19T15:28:42.553914+0000","last_peered":"2024-09-19T15:28:42.553914+0000","last_clean":"2024-09-19T15:28:42.553914+0000","last_became_active":"2024-09-19T13:40:38.231698+0000","last_became_peered":"2024-09-19T13:40:38.231698+0000","last_unstale":"2024-09-19T15:28:42.553914+0000","last_undegraded":"2024-09-19T15:28:42.553914+0000","last_fullsized":"2024-09-19T15:28:42.553914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:45.837641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'388","reported_seq":1045,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.964587+0000","last_change":"2024-09-19T13:40:40.219381+0000","last_active":"2024-09-19T15:31:17.964587+0000","last_peered":"2024-09-19T15:31:17.964587+0000","last_clean":"2024-09-19T15:31:17.964587+0000","last_became_active":"2024-09-19T13:40:40.218529+0000","last_became_peered":"2024-09-19T13:40:40.218529+0000","last_unstale":"2024-09-19T15:31:17.964587+0000","last_undegraded":"2024-09-19T15:31:17.964587+0000","last_fullsized":"2024-09-19T15:31:17.964587+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:35.038776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55706,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":602,"num_read_kb":1059,"num_write":472,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'797","reported_seq":3175,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:16.984268+0000","last_change":"2024-09-19T13:40:42.238099+0000","last_active":"2024-09-19T15:31:16.984268+0000","last_peered":"2024-09-19T15:31:16.984268+0000","last_clean":"2024-09-19T15:31:16.984268+0000","last_became_active":"2024-09-19T13:40:42.237168+0000","last_became_peered":"2024-09-19T13:40:42.237168+0000","last_unstale":"2024-09-19T15:31:16.984268+0000","last_undegraded":"2024-09-19T15:31:16.984268+0000","last_fullsized":"2024-09-19T15:31:16.984268+0000","mapping_epoch":33,"log_start":"268'701","ondisk_log_start":"268'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":701,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:55.917452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'185","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.287972+0000","last_change":"2024-09-19T13:40:44.262160+0000","last_active":"2024-09-19T15:31:12.287972+0000","last_peered":"2024-09-19T15:31:12.287972+0000","last_clean":"2024-09-19T15:31:12.287972+0000","last_became_active":"2024-09-19T13:40:44.259964+0000","last_became_peered":"2024-09-19T13:40:44.259964+0000","last_unstale":"2024-09-19T15:31:12.287972+0000","last_undegraded":"2024-09-19T15:31:12.287972+0000","last_fullsized":"2024-09-19T15:31:12.287972+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:49.811154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":275,"num_read_kb":244,"num_write":336,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'515","reported_seq":2206,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.656869+0000","last_change":"2024-09-19T13:40:36.221790+0000","last_active":"2024-09-19T15:29:50.656869+0000","last_peered":"2024-09-19T15:29:50.656869+0000","last_clean":"2024-09-19T15:29:50.656869+0000","last_became_active":"2024-09-19T13:40:36.221248+0000","last_became_peered":"2024-09-19T13:40:36.221248+0000","last_unstale":"2024-09-19T15:29:50.656869+0000","last_undegraded":"2024-09-19T15:29:50.656869+0000","last_fullsized":"2024-09-19T15:29:50.656869+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:23.331064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2802,"num_read_kb":2611,"num_write":645,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'240","reported_seq":886,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.626335+0000","last_change":"2024-09-19T13:40:34.260828+0000","last_active":"2024-09-19T15:28:37.626335+0000","last_peered":"2024-09-19T15:28:37.626335+0000","last_clean":"2024-09-19T15:28:37.626335+0000","last_became_active":"2024-09-19T13:40:34.259994+0000","last_became_peered":"2024-09-19T13:40:34.259994+0000","last_unstale":"2024-09-19T15:28:37.626335+0000","last_undegraded":"2024-09-19T15:28:37.626335+0000","last_fullsized":"2024-09-19T15:28:37.626335+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:04.707136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1312319,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":460,"num_read_kb":7460,"num_write":922,"num_write_kb":22776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:22.561854+0000","last_change":"2024-09-19T13:40:38.245831+0000","last_active":"2024-09-19T15:29:22.561854+0000","last_peered":"2024-09-19T15:29:22.561854+0000","last_clean":"2024-09-19T15:29:22.561854+0000","last_became_active":"2024-09-19T13:40:38.245245+0000","last_became_peered":"2024-09-19T13:40:38.245245+0000","last_unstale":"2024-09-19T15:29:22.561854+0000","last_undegraded":"2024-09-19T15:29:22.561854+0000","last_fullsized":"2024-09-19T15:29:22.561854+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:31:40.598604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'504","reported_seq":1173,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.237819+0000","last_change":"2024-09-19T13:40:40.231208+0000","last_active":"2024-09-19T15:31:17.237819+0000","last_peered":"2024-09-19T15:31:17.237819+0000","last_clean":"2024-09-19T15:31:17.237819+0000","last_became_active":"2024-09-19T13:40:40.230404+0000","last_became_peered":"2024-09-19T13:40:40.230404+0000","last_unstale":"2024-09-19T15:31:17.237819+0000","last_undegraded":"2024-09-19T15:31:17.237819+0000","last_fullsized":"2024-09-19T15:31:17.237819+0000","mapping_epoch":31,"log_start":"268'400","ondisk_log_start":"268'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:12:10.298800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108879,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":861,"num_read_kb":1808,"num_write":702,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.557534+0000","last_change":"2024-09-19T13:40:42.250031+0000","last_active":"2024-09-19T15:29:02.557534+0000","last_peered":"2024-09-19T15:29:02.557534+0000","last_clean":"2024-09-19T15:29:02.557534+0000","last_became_active":"2024-09-19T13:40:42.248721+0000","last_became_peered":"2024-09-19T13:40:42.248721+0000","last_unstale":"2024-09-19T15:29:02.557534+0000","last_undegraded":"2024-09-19T15:29:02.557534+0000","last_fullsized":"2024-09-19T15:29:02.557534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:31.801182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'162","reported_seq":711,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:46.507086+0000","last_change":"2024-09-19T13:40:44.256561+0000","last_active":"2024-09-19T15:29:46.507086+0000","last_peered":"2024-09-19T15:29:46.507086+0000","last_clean":"2024-09-19T15:29:46.507086+0000","last_became_active":"2024-09-19T13:40:44.255644+0000","last_became_peered":"2024-09-19T13:40:44.255644+0000","last_unstale":"2024-09-19T15:29:46.507086+0000","last_undegraded":"2024-09-19T15:29:46.507086+0000","last_fullsized":"2024-09-19T15:29:46.507086+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:41.469474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":234,"num_write":369,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'795","reported_seq":2371,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.393505+0000","last_change":"2024-09-19T13:40:36.235347+0000","last_active":"2024-09-19T15:29:48.393505+0000","last_peered":"2024-09-19T15:29:48.393505+0000","last_clean":"2024-09-19T15:29:48.393505+0000","last_became_active":"2024-09-19T13:40:36.231071+0000","last_became_peered":"2024-09-19T13:40:36.231071+0000","last_unstale":"2024-09-19T15:29:48.393505+0000","last_undegraded":"2024-09-19T15:29:48.393505+0000","last_fullsized":"2024-09-19T15:29:48.393505+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:57.506822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3782,"num_read_kb":3405,"num_write":1031,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'280","reported_seq":936,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:38.640172+0000","last_change":"2024-09-19T13:40:34.230219+0000","last_active":"2024-09-19T15:28:38.640172+0000","last_peered":"2024-09-19T15:28:38.640172+0000","last_clean":"2024-09-19T15:28:38.640172+0000","last_became_active":"2024-09-19T13:40:34.229859+0000","last_became_peered":"2024-09-19T13:40:34.229859+0000","last_unstale":"2024-09-19T15:28:38.640172+0000","last_undegraded":"2024-09-19T15:28:38.640172+0000","last_fullsized":"2024-09-19T15:28:38.640172+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:22:23.963676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2160673,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":517,"num_read_kb":8832,"num_write":963,"num_write_kb":25070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.553962+0000","last_change":"2024-09-19T13:40:38.233850+0000","last_active":"2024-09-19T15:28:42.553962+0000","last_peered":"2024-09-19T15:28:42.553962+0000","last_clean":"2024-09-19T15:28:42.553962+0000","last_became_active":"2024-09-19T13:40:38.233312+0000","last_became_peered":"2024-09-19T13:40:38.233312+0000","last_unstale":"2024-09-19T15:28:42.553962+0000","last_undegraded":"2024-09-19T15:28:42.553962+0000","last_fullsized":"2024-09-19T15:28:42.553962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:06:31.511312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'324","reported_seq":949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.236829+0000","last_change":"2024-09-19T13:40:40.248769+0000","last_active":"2024-09-19T15:31:18.236829+0000","last_peered":"2024-09-19T15:31:18.236829+0000","last_clean":"2024-09-19T15:31:18.236829+0000","last_became_active":"2024-09-19T13:40:40.247025+0000","last_became_peered":"2024-09-19T13:40:40.247025+0000","last_unstale":"2024-09-19T15:31:18.236829+0000","last_undegraded":"2024-09-19T15:31:18.236829+0000","last_fullsized":"2024-09-19T15:31:18.236829+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:56.478380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50870,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":544,"num_read_kb":997,"num_write":470,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:17.195848+0000","last_change":"2024-09-19T13:40:42.244143+0000","last_active":"2024-09-19T15:29:17.195848+0000","last_peered":"2024-09-19T15:29:17.195848+0000","last_clean":"2024-09-19T15:29:17.195848+0000","last_became_active":"2024-09-19T13:40:42.243325+0000","last_became_peered":"2024-09-19T13:40:42.243325+0000","last_unstale":"2024-09-19T15:29:17.195848+0000","last_undegraded":"2024-09-19T15:29:17.195848+0000","last_fullsized":"2024-09-19T15:29:17.195848+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:23.365075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'144","reported_seq":676,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:00.462703+0000","last_change":"2024-09-19T13:40:44.268565+0000","last_active":"2024-09-19T15:31:00.462703+0000","last_peered":"2024-09-19T15:31:00.462703+0000","last_clean":"2024-09-19T15:31:00.462703+0000","last_became_active":"2024-09-19T13:40:44.267716+0000","last_became_peered":"2024-09-19T13:40:44.267716+0000","last_unstale":"2024-09-19T15:31:00.462703+0000","last_undegraded":"2024-09-19T15:31:00.462703+0000","last_fullsized":"2024-09-19T15:31:00.462703+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:15.203052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":190,"num_read_kb":181,"num_write":368,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'1168","reported_seq":2989,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.606972+0000","last_change":"2024-09-19T13:40:36.217087+0000","last_active":"2024-09-19T15:28:37.606972+0000","last_peered":"2024-09-19T15:28:37.606972+0000","last_clean":"2024-09-19T15:28:37.606972+0000","last_became_active":"2024-09-19T13:40:36.216332+0000","last_became_peered":"2024-09-19T13:40:36.216332+0000","last_unstale":"2024-09-19T15:28:37.606972+0000","last_undegraded":"2024-09-19T15:28:37.606972+0000","last_fullsized":"2024-09-19T15:28:37.606972+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":1100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:37.143369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5686,"num_read_kb":5084,"num_write":1563,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'307","reported_seq":977,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:26.076668+0000","last_change":"2024-09-19T13:41:05.315224+0000","last_active":"2024-09-19T15:29:26.076668+0000","last_peered":"2024-09-19T15:29:26.076668+0000","last_clean":"2024-09-19T15:29:26.076668+0000","last_became_active":"2024-09-19T13:41:05.314782+0000","last_became_peered":"2024-09-19T13:41:05.314782+0000","last_unstale":"2024-09-19T15:29:26.076668+0000","last_undegraded":"2024-09-19T15:29:26.076668+0000","last_fullsized":"2024-09-19T15:29:26.076668+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:05:31.081233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13086870,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":575,"num_read_kb":47078,"num_write":1087,"num_write_kb":40849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.388400+0000","last_change":"2024-09-19T13:40:38.247209+0000","last_active":"2024-09-19T15:28:42.388400+0000","last_peered":"2024-09-19T15:28:42.388400+0000","last_clean":"2024-09-19T15:28:42.388400+0000","last_became_active":"2024-09-19T13:40:38.246684+0000","last_became_peered":"2024-09-19T13:40:38.246684+0000","last_unstale":"2024-09-19T15:28:42.388400+0000","last_undegraded":"2024-09-19T15:28:42.388400+0000","last_fullsized":"2024-09-19T15:28:42.388400+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:06.464294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'381","reported_seq":1029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.366563+0000","last_change":"2024-09-19T13:40:40.222514+0000","last_active":"2024-09-19T15:31:18.366563+0000","last_peered":"2024-09-19T15:31:18.366563+0000","last_clean":"2024-09-19T15:31:18.366563+0000","last_became_active":"2024-09-19T13:40:40.221766+0000","last_became_peered":"2024-09-19T13:40:40.221766+0000","last_unstale":"2024-09-19T15:31:18.366563+0000","last_undegraded":"2024-09-19T15:31:18.366563+0000","last_fullsized":"2024-09-19T15:31:18.366563+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:00.029066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56658,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":619,"num_read_kb":1125,"num_write":486,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'740","reported_seq":3072,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:16.987601+0000","last_change":"2024-09-19T13:40:42.246641+0000","last_active":"2024-09-19T15:31:16.987601+0000","last_peered":"2024-09-19T15:31:16.987601+0000","last_clean":"2024-09-19T15:31:16.987601+0000","last_became_active":"2024-09-19T13:40:42.246030+0000","last_became_peered":"2024-09-19T13:40:42.246030+0000","last_unstale":"2024-09-19T15:31:16.987601+0000","last_undegraded":"2024-09-19T15:31:16.987601+0000","last_fullsized":"2024-09-19T15:31:16.987601+0000","mapping_epoch":33,"log_start":"268'702","ondisk_log_start":"268'702","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":702,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:14.301444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'123","reported_seq":645,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:45.486708+0000","last_change":"2024-09-19T13:40:44.250279+0000","last_active":"2024-09-19T15:29:45.486708+0000","last_peered":"2024-09-19T15:29:45.486708+0000","last_clean":"2024-09-19T15:29:45.486708+0000","last_became_active":"2024-09-19T13:40:44.249529+0000","last_became_peered":"2024-09-19T13:40:44.249529+0000","last_unstale":"2024-09-19T15:29:45.486708+0000","last_undegraded":"2024-09-19T15:29:45.486708+0000","last_fullsized":"2024-09-19T15:29:45.486708+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:10.551071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1650,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":290,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'1316","reported_seq":3126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.313578+0000","last_change":"2024-09-19T13:40:36.219605+0000","last_active":"2024-09-19T15:29:41.313578+0000","last_peered":"2024-09-19T15:29:41.313578+0000","last_clean":"2024-09-19T15:29:41.313578+0000","last_became_active":"2024-09-19T13:40:36.218760+0000","last_became_peered":"2024-09-19T13:40:36.218760+0000","last_unstale":"2024-09-19T15:29:41.313578+0000","last_undegraded":"2024-09-19T15:29:41.313578+0000","last_fullsized":"2024-09-19T15:29:41.313578+0000","mapping_epoch":27,"log_start":"268'1300","ondisk_log_start":"268'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":1300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:53:31.922716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6184,"num_read_kb":5469,"num_write":1814,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'333","reported_seq":1042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.611459+0000","last_change":"2024-09-19T13:40:34.266782+0000","last_active":"2024-09-19T15:28:57.611459+0000","last_peered":"2024-09-19T15:28:57.611459+0000","last_clean":"2024-09-19T15:28:57.611459+0000","last_became_active":"2024-09-19T13:40:34.264354+0000","last_became_peered":"2024-09-19T13:40:34.264354+0000","last_unstale":"2024-09-19T15:28:57.611459+0000","last_undegraded":"2024-09-19T15:28:57.611459+0000","last_fullsized":"2024-09-19T15:28:57.611459+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:30.107330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":546702,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":676,"num_read_kb":5535,"num_write":1229,"num_write_kb":30004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1481,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.156035+0000","last_change":"2024-09-19T13:40:38.226450+0000","last_active":"2024-09-19T15:31:13.156035+0000","last_peered":"2024-09-19T15:31:13.156035+0000","last_clean":"2024-09-19T15:31:13.156035+0000","last_became_active":"2024-09-19T13:40:38.225663+0000","last_became_peered":"2024-09-19T13:40:38.225663+0000","last_unstale":"2024-09-19T15:31:13.156035+0000","last_undegraded":"2024-09-19T15:31:13.156035+0000","last_fullsized":"2024-09-19T15:31:13.156035+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:47:48.193799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":944,"num_read_kb":944,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'147","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.976337+0000","last_change":"2024-09-19T13:40:40.220948+0000","last_active":"2024-09-19T15:31:17.976337+0000","last_peered":"2024-09-19T15:31:17.976337+0000","last_clean":"2024-09-19T15:31:17.976337+0000","last_became_active":"2024-09-19T13:40:40.220534+0000","last_became_peered":"2024-09-19T13:40:40.220534+0000","last_unstale":"2024-09-19T15:31:17.976337+0000","last_undegraded":"2024-09-19T15:31:17.976337+0000","last_fullsized":"2024-09-19T15:31:17.976337+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:55.268748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":176,"num_write":122,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'762","reported_seq":5678,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:16.985841+0000","last_change":"2024-09-19T13:40:42.249926+0000","last_active":"2024-09-19T15:31:16.985841+0000","last_peered":"2024-09-19T15:31:16.985841+0000","last_clean":"2024-09-19T15:31:16.985841+0000","last_became_active":"2024-09-19T13:40:42.240074+0000","last_became_peered":"2024-09-19T13:40:42.240074+0000","last_unstale":"2024-09-19T15:31:16.985841+0000","last_undegraded":"2024-09-19T15:31:16.985841+0000","last_fullsized":"2024-09-19T15:31:16.985841+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:40:31.249282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'114","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:07.614003+0000","last_change":"2024-09-19T13:40:44.252306+0000","last_active":"2024-09-19T15:29:07.614003+0000","last_peered":"2024-09-19T15:29:07.614003+0000","last_clean":"2024-09-19T15:29:07.614003+0000","last_became_active":"2024-09-19T13:40:44.251353+0000","last_became_peered":"2024-09-19T13:40:44.251353+0000","last_unstale":"2024-09-19T15:29:07.614003+0000","last_undegraded":"2024-09-19T15:29:07.614003+0000","last_fullsized":"2024-09-19T15:29:07.614003+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:54.088845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'1842","reported_seq":3612,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.383231+0000","last_change":"2024-09-19T13:40:36.221951+0000","last_active":"2024-09-19T15:29:48.383231+0000","last_peered":"2024-09-19T15:29:48.383231+0000","last_clean":"2024-09-19T15:29:48.383231+0000","last_became_active":"2024-09-19T13:40:36.221638+0000","last_became_peered":"2024-09-19T13:40:36.221638+0000","last_unstale":"2024-09-19T15:29:48.383231+0000","last_undegraded":"2024-09-19T15:29:48.383231+0000","last_fullsized":"2024-09-19T15:29:48.383231+0000","mapping_epoch":27,"log_start":"268'1800","ondisk_log_start":"268'1800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":1800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:09:05.373765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8811,"num_read_kb":7740,"num_write":2693,"num_write_kb":1220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"268'296","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:58.243167+0000","last_change":"2024-09-19T13:40:34.236641+0000","last_active":"2024-09-19T15:28:58.243167+0000","last_peered":"2024-09-19T15:28:58.243167+0000","last_clean":"2024-09-19T15:28:58.243167+0000","last_became_active":"2024-09-19T13:40:34.236257+0000","last_became_peered":"2024-09-19T13:40:34.236257+0000","last_unstale":"2024-09-19T15:28:58.243167+0000","last_undegraded":"2024-09-19T15:28:58.243167+0000","last_fullsized":"2024-09-19T15:28:58.243167+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:57.681584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7567963,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":603,"num_read_kb":21601,"num_write":1159,"num_write_kb":27464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.608313+0000","last_change":"2024-09-19T13:40:38.236430+0000","last_active":"2024-09-19T15:28:42.608313+0000","last_peered":"2024-09-19T15:28:42.608313+0000","last_clean":"2024-09-19T15:28:42.608313+0000","last_became_active":"2024-09-19T13:40:38.235737+0000","last_became_peered":"2024-09-19T13:40:38.235737+0000","last_unstale":"2024-09-19T15:28:42.608313+0000","last_undegraded":"2024-09-19T15:28:42.608313+0000","last_fullsized":"2024-09-19T15:28:42.608313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:01.868972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'544","reported_seq":1232,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.223974+0000","last_change":"2024-09-19T13:40:40.236361+0000","last_active":"2024-09-19T15:31:18.223974+0000","last_peered":"2024-09-19T15:31:18.223974+0000","last_clean":"2024-09-19T15:31:18.223974+0000","last_became_active":"2024-09-19T13:40:40.235679+0000","last_became_peered":"2024-09-19T13:40:40.235679+0000","last_unstale":"2024-09-19T15:31:18.223974+0000","last_undegraded":"2024-09-19T15:31:18.223974+0000","last_fullsized":"2024-09-19T15:31:18.223974+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:05.212537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57782,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1475,"num_read_kb":1962,"num_write":2108,"num_write_kb":1881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.390727+0000","last_change":"2024-09-19T13:40:42.252473+0000","last_active":"2024-09-19T15:28:42.390727+0000","last_peered":"2024-09-19T15:28:42.390727+0000","last_clean":"2024-09-19T15:28:42.390727+0000","last_became_active":"2024-09-19T13:40:42.250462+0000","last_became_peered":"2024-09-19T13:40:42.250462+0000","last_unstale":"2024-09-19T15:28:42.390727+0000","last_undegraded":"2024-09-19T15:28:42.390727+0000","last_fullsized":"2024-09-19T15:28:42.390727+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:28:26.494633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'145","reported_seq":676,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:07.394194+0000","last_change":"2024-09-19T13:40:44.267433+0000","last_active":"2024-09-19T15:29:07.394194+0000","last_peered":"2024-09-19T15:29:07.394194+0000","last_clean":"2024-09-19T15:29:07.394194+0000","last_became_active":"2024-09-19T13:40:44.266642+0000","last_became_peered":"2024-09-19T13:40:44.266642+0000","last_unstale":"2024-09-19T15:29:07.394194+0000","last_undegraded":"2024-09-19T15:29:07.394194+0000","last_fullsized":"2024-09-19T15:29:07.394194+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:58.071145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":208,"num_write":352,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'499","reported_seq":2070,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:27.401142+0000","last_change":"2024-09-19T13:40:36.219246+0000","last_active":"2024-09-19T15:29:27.401142+0000","last_peered":"2024-09-19T15:29:27.401142+0000","last_clean":"2024-09-19T15:29:27.401142+0000","last_became_active":"2024-09-19T13:40:36.218550+0000","last_became_peered":"2024-09-19T13:40:36.218550+0000","last_unstale":"2024-09-19T15:29:27.401142+0000","last_undegraded":"2024-09-19T15:29:27.401142+0000","last_fullsized":"2024-09-19T15:29:27.401142+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:10.154764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2652,"num_read_kb":2446,"num_write":622,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":653,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.648997+0000","last_change":"2024-09-19T13:40:13.616691+0000","last_active":"2024-09-19T15:28:42.648997+0000","last_peered":"2024-09-19T15:28:42.648997+0000","last_clean":"2024-09-19T15:28:42.648997+0000","last_became_active":"2024-09-19T13:40:13.615965+0000","last_became_peered":"2024-09-19T13:40:13.615965+0000","last_unstale":"2024-09-19T15:28:42.648997+0000","last_undegraded":"2024-09-19T15:28:42.648997+0000","last_fullsized":"2024-09-19T15:28:42.648997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:12.602317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:12.602317+0000","last_clean_scrub_stamp":"2024-09-19T13:40:12.602317+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:03.931360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":566,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.627501+0000","last_change":"2024-09-19T13:40:22.120433+0000","last_active":"2024-09-19T15:28:42.627501+0000","last_peered":"2024-09-19T15:28:42.627501+0000","last_clean":"2024-09-19T15:28:42.627501+0000","last_became_active":"2024-09-19T13:40:20.100760+0000","last_became_peered":"2024-09-19T13:40:20.100760+0000","last_unstale":"2024-09-19T15:28:42.627501+0000","last_undegraded":"2024-09-19T15:28:42.627501+0000","last_fullsized":"2024-09-19T15:28:42.627501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:10.051308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001106569,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'251","reported_seq":935,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:58.243311+0000","last_change":"2024-09-19T13:40:34.241552+0000","last_active":"2024-09-19T15:28:58.243311+0000","last_peered":"2024-09-19T15:28:58.243311+0000","last_clean":"2024-09-19T15:28:58.243311+0000","last_became_active":"2024-09-19T13:40:34.241162+0000","last_became_peered":"2024-09-19T13:40:34.241162+0000","last_unstale":"2024-09-19T15:28:58.243311+0000","last_undegraded":"2024-09-19T15:28:58.243311+0000","last_fullsized":"2024-09-19T15:28:58.243311+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:44.355824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11368506,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":479,"num_read_kb":104180,"num_write":903,"num_write_kb":16810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.654042+0000","last_change":"2024-09-19T13:40:38.232446+0000","last_active":"2024-09-19T15:29:02.654042+0000","last_peered":"2024-09-19T15:29:02.654042+0000","last_clean":"2024-09-19T15:29:02.654042+0000","last_became_active":"2024-09-19T13:40:38.231762+0000","last_became_peered":"2024-09-19T13:40:38.231762+0000","last_unstale":"2024-09-19T15:29:02.654042+0000","last_undegraded":"2024-09-19T15:29:02.654042+0000","last_fullsized":"2024-09-19T15:29:02.654042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:39.721678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'741","reported_seq":1485,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.850025+0000","last_change":"2024-09-19T13:40:40.240118+0000","last_active":"2024-09-19T15:31:17.850025+0000","last_peered":"2024-09-19T15:31:17.850025+0000","last_clean":"2024-09-19T15:31:17.850025+0000","last_became_active":"2024-09-19T13:40:40.239392+0000","last_became_peered":"2024-09-19T13:40:40.239392+0000","last_unstale":"2024-09-19T15:31:17.850025+0000","last_undegraded":"2024-09-19T15:31:17.850025+0000","last_fullsized":"2024-09-19T15:31:17.850025+0000","mapping_epoch":31,"log_start":"268'700","ondisk_log_start":"268'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:00.876178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167212,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1427,"num_read_kb":2885,"num_write":1376,"num_write_kb":1210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.192068+0000","last_change":"2024-09-19T13:40:42.240498+0000","last_active":"2024-09-19T15:29:02.192068+0000","last_peered":"2024-09-19T15:29:02.192068+0000","last_clean":"2024-09-19T15:29:02.192068+0000","last_became_active":"2024-09-19T13:40:42.239749+0000","last_became_peered":"2024-09-19T13:40:42.239749+0000","last_unstale":"2024-09-19T15:29:02.192068+0000","last_undegraded":"2024-09-19T15:29:02.192068+0000","last_fullsized":"2024-09-19T15:29:02.192068+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:55:48.115594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'200","reported_seq":921,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.733071+0000","last_change":"2024-09-19T13:40:44.265188+0000","last_active":"2024-09-19T15:29:50.733071+0000","last_peered":"2024-09-19T15:29:50.733071+0000","last_clean":"2024-09-19T15:29:50.733071+0000","last_became_active":"2024-09-19T13:40:44.264456+0000","last_became_peered":"2024-09-19T13:40:44.264456+0000","last_unstale":"2024-09-19T15:29:50.733071+0000","last_undegraded":"2024-09-19T15:29:50.733071+0000","last_fullsized":"2024-09-19T15:29:50.733071+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:46.004583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":469,"num_write":408,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'750","reported_seq":2265,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.375238+0000","last_change":"2024-09-19T13:40:36.223322+0000","last_active":"2024-09-19T15:29:48.375238+0000","last_peered":"2024-09-19T15:29:48.375238+0000","last_clean":"2024-09-19T15:29:48.375238+0000","last_became_active":"2024-09-19T13:40:36.221186+0000","last_became_peered":"2024-09-19T13:40:36.221186+0000","last_unstale":"2024-09-19T15:29:48.375238+0000","last_undegraded":"2024-09-19T15:29:48.375238+0000","last_fullsized":"2024-09-19T15:29:48.375238+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:28:28.786321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3545,"num_read_kb":3202,"num_write":973,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":562,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:47.650225+0000","last_change":"2024-09-19T13:40:23.121191+0000","last_active":"2024-09-19T15:28:47.650225+0000","last_peered":"2024-09-19T15:28:47.650225+0000","last_clean":"2024-09-19T15:28:47.650225+0000","last_became_active":"2024-09-19T13:40:20.099608+0000","last_became_peered":"2024-09-19T13:40:20.099608+0000","last_unstale":"2024-09-19T15:28:47.650225+0000","last_undegraded":"2024-09-19T15:28:47.650225+0000","last_fullsized":"2024-09-19T15:28:47.650225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:29.188183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001034798,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'247","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.190076+0000","last_change":"2024-09-19T13:40:34.265231+0000","last_active":"2024-09-19T15:28:57.190076+0000","last_peered":"2024-09-19T15:28:57.190076+0000","last_clean":"2024-09-19T15:28:57.190076+0000","last_became_active":"2024-09-19T13:40:34.264819+0000","last_became_peered":"2024-09-19T13:40:34.264819+0000","last_unstale":"2024-09-19T15:28:57.190076+0000","last_undegraded":"2024-09-19T15:28:57.190076+0000","last_fullsized":"2024-09-19T15:28:57.190076+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:02:26.810163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11443637,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":516,"num_read_kb":52358,"num_write":908,"num_write_kb":38982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.632334+0000","last_change":"2024-09-19T13:40:38.223702+0000","last_active":"2024-09-19T15:29:02.632334+0000","last_peered":"2024-09-19T15:29:02.632334+0000","last_clean":"2024-09-19T15:29:02.632334+0000","last_became_active":"2024-09-19T13:40:38.222905+0000","last_became_peered":"2024-09-19T13:40:38.222905+0000","last_unstale":"2024-09-19T15:29:02.632334+0000","last_undegraded":"2024-09-19T15:29:02.632334+0000","last_fullsized":"2024-09-19T15:29:02.632334+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:40:37.494887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'1421","reported_seq":3725,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.202506+0000","last_change":"2024-09-19T13:40:40.241249+0000","last_active":"2024-09-19T15:31:18.202506+0000","last_peered":"2024-09-19T15:31:18.202506+0000","last_clean":"2024-09-19T15:31:18.202506+0000","last_became_active":"2024-09-19T13:40:40.240768+0000","last_became_peered":"2024-09-19T13:40:40.240768+0000","last_unstale":"2024-09-19T15:31:18.202506+0000","last_undegraded":"2024-09-19T15:31:18.202506+0000","last_fullsized":"2024-09-19T15:31:18.202506+0000","mapping_epoch":31,"log_start":"268'1400","ondisk_log_start":"268'1400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":1400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:22:28.103563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174352,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2198,"num_read_kb":3702,"num_write":1336,"num_write_kb":1096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:27.660131+0000","last_change":"2024-09-19T13:40:42.252880+0000","last_active":"2024-09-19T15:29:27.660131+0000","last_peered":"2024-09-19T15:29:27.660131+0000","last_clean":"2024-09-19T15:29:27.660131+0000","last_became_active":"2024-09-19T13:40:42.250172+0000","last_became_peered":"2024-09-19T13:40:42.250172+0000","last_unstale":"2024-09-19T15:29:27.660131+0000","last_undegraded":"2024-09-19T15:29:27.660131+0000","last_fullsized":"2024-09-19T15:29:27.660131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:36:32.481597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'250","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:37.400055+0000","last_change":"2024-09-19T13:40:44.273159+0000","last_active":"2024-09-19T15:29:37.400055+0000","last_peered":"2024-09-19T15:29:37.400055+0000","last_clean":"2024-09-19T15:29:37.400055+0000","last_became_active":"2024-09-19T13:40:44.272356+0000","last_became_peered":"2024-09-19T13:40:44.272356+0000","last_unstale":"2024-09-19T15:29:37.400055+0000","last_undegraded":"2024-09-19T15:29:37.400055+0000","last_fullsized":"2024-09-19T15:29:37.400055+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:13:14.438529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":580,"num_read_kb":531,"num_write":551,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'464","reported_seq":2138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391925+0000","last_change":"2024-09-19T13:40:36.242222+0000","last_active":"2024-09-19T15:28:57.391925+0000","last_peered":"2024-09-19T15:28:57.391925+0000","last_clean":"2024-09-19T15:28:57.391925+0000","last_became_active":"2024-09-19T13:40:36.241832+0000","last_became_peered":"2024-09-19T13:40:36.241832+0000","last_unstale":"2024-09-19T15:28:57.391925+0000","last_undegraded":"2024-09-19T15:28:57.391925+0000","last_fullsized":"2024-09-19T15:28:57.391925+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:08.294812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2706,"num_read_kb":2545,"num_write":558,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":553,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.553858+0000","last_change":"2024-09-19T13:40:22.375307+0000","last_active":"2024-09-19T15:28:42.553858+0000","last_peered":"2024-09-19T15:28:42.553858+0000","last_clean":"2024-09-19T15:28:42.553858+0000","last_became_active":"2024-09-19T13:40:20.096900+0000","last_became_peered":"2024-09-19T13:40:20.096900+0000","last_unstale":"2024-09-19T15:28:42.553858+0000","last_undegraded":"2024-09-19T15:28:42.553858+0000","last_fullsized":"2024-09-19T15:28:42.553858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:28.240242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074274699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'266","reported_seq":929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:07.394076+0000","last_change":"2024-09-19T13:40:34.235882+0000","last_active":"2024-09-19T15:29:07.394076+0000","last_peered":"2024-09-19T15:29:07.394076+0000","last_clean":"2024-09-19T15:29:07.394076+0000","last_became_active":"2024-09-19T13:40:34.235483+0000","last_became_peered":"2024-09-19T13:40:34.235483+0000","last_unstale":"2024-09-19T15:29:07.394076+0000","last_undegraded":"2024-09-19T15:29:07.394076+0000","last_fullsized":"2024-09-19T15:29:07.394076+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:16:09.641672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":663473,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":543,"num_read_kb":5125,"num_write":935,"num_write_kb":29541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.557673+0000","last_change":"2024-09-19T13:40:38.228915+0000","last_active":"2024-09-19T15:29:02.557673+0000","last_peered":"2024-09-19T15:29:02.557673+0000","last_clean":"2024-09-19T15:29:02.557673+0000","last_became_active":"2024-09-19T13:40:38.228364+0000","last_became_peered":"2024-09-19T13:40:38.228364+0000","last_unstale":"2024-09-19T15:29:02.557673+0000","last_undegraded":"2024-09-19T15:29:02.557673+0000","last_fullsized":"2024-09-19T15:29:02.557673+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:20.446950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'367","reported_seq":2304,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.215985+0000","last_change":"2024-09-19T13:40:40.232258+0000","last_active":"2024-09-19T15:31:18.215985+0000","last_peered":"2024-09-19T15:31:18.215985+0000","last_clean":"2024-09-19T15:31:18.215985+0000","last_became_active":"2024-09-19T13:40:40.231491+0000","last_became_peered":"2024-09-19T13:40:40.231491+0000","last_unstale":"2024-09-19T15:31:18.215985+0000","last_undegraded":"2024-09-19T15:31:18.215985+0000","last_fullsized":"2024-09-19T15:31:18.215985+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:37.420062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":364,"num_read_kb":356,"num_write":351,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.191956+0000","last_change":"2024-09-19T13:40:42.227173+0000","last_active":"2024-09-19T15:29:02.191956+0000","last_peered":"2024-09-19T15:29:02.191956+0000","last_clean":"2024-09-19T15:29:02.191956+0000","last_became_active":"2024-09-19T13:40:42.226706+0000","last_became_peered":"2024-09-19T13:40:42.226706+0000","last_unstale":"2024-09-19T15:29:02.191956+0000","last_undegraded":"2024-09-19T15:29:02.191956+0000","last_fullsized":"2024-09-19T15:29:02.191956+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:12:31.408133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'257","reported_seq":907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:51.222389+0000","last_change":"2024-09-19T13:40:44.241756+0000","last_active":"2024-09-19T15:29:51.222389+0000","last_peered":"2024-09-19T15:29:51.222389+0000","last_clean":"2024-09-19T15:29:51.222389+0000","last_became_active":"2024-09-19T13:40:44.240277+0000","last_became_peered":"2024-09-19T13:40:44.240277+0000","last_unstale":"2024-09-19T15:29:51.222389+0000","last_undegraded":"2024-09-19T15:29:51.222389+0000","last_fullsized":"2024-09-19T15:29:51.222389+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:50.745130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":590,"num_read_kb":596,"num_write":565,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'478","reported_seq":2079,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.652407+0000","last_change":"2024-09-19T13:40:36.221661+0000","last_active":"2024-09-19T15:29:50.652407+0000","last_peered":"2024-09-19T15:29:50.652407+0000","last_clean":"2024-09-19T15:29:50.652407+0000","last_became_active":"2024-09-19T13:40:36.220514+0000","last_became_peered":"2024-09-19T13:40:36.220514+0000","last_unstale":"2024-09-19T15:29:50.652407+0000","last_undegraded":"2024-09-19T15:29:50.652407+0000","last_fullsized":"2024-09-19T15:29:50.652407+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:03.001074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2550,"num_read_kb":2381,"num_write":569,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":567,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.627408+0000","last_change":"2024-09-19T13:40:22.121910+0000","last_active":"2024-09-19T15:28:42.627408+0000","last_peered":"2024-09-19T15:28:42.627408+0000","last_clean":"2024-09-19T15:28:42.627408+0000","last_became_active":"2024-09-19T13:40:20.101198+0000","last_became_peered":"2024-09-19T13:40:20.101198+0000","last_unstale":"2024-09-19T15:28:42.627408+0000","last_undegraded":"2024-09-19T15:28:42.627408+0000","last_fullsized":"2024-09-19T15:28:42.627408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:03:31.869167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026053059999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'266","reported_seq":929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.611715+0000","last_change":"2024-09-19T13:40:34.229956+0000","last_active":"2024-09-19T15:28:57.611715+0000","last_peered":"2024-09-19T15:28:57.611715+0000","last_clean":"2024-09-19T15:28:57.611715+0000","last_became_active":"2024-09-19T13:40:34.228632+0000","last_became_peered":"2024-09-19T13:40:34.228632+0000","last_unstale":"2024-09-19T15:28:57.611715+0000","last_undegraded":"2024-09-19T15:28:57.611715+0000","last_fullsized":"2024-09-19T15:28:57.611715+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:27:09.603584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6020926,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":521,"num_read_kb":6956,"num_write":932,"num_write_kb":25273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.171630+0000","last_change":"2024-09-19T13:40:38.229900+0000","last_active":"2024-09-19T15:27:32.171630+0000","last_peered":"2024-09-19T15:27:32.171630+0000","last_clean":"2024-09-19T15:27:32.171630+0000","last_became_active":"2024-09-19T13:40:38.229144+0000","last_became_peered":"2024-09-19T13:40:38.229144+0000","last_unstale":"2024-09-19T15:27:32.171630+0000","last_undegraded":"2024-09-19T15:27:32.171630+0000","last_fullsized":"2024-09-19T15:27:32.171630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:43.905801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'214","reported_seq":829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.912084+0000","last_change":"2024-09-19T13:40:40.249690+0000","last_active":"2024-09-19T15:31:17.912084+0000","last_peered":"2024-09-19T15:31:17.912084+0000","last_clean":"2024-09-19T15:31:17.912084+0000","last_became_active":"2024-09-19T13:40:40.249102+0000","last_became_peered":"2024-09-19T13:40:40.249102+0000","last_unstale":"2024-09-19T15:31:17.912084+0000","last_undegraded":"2024-09-19T15:31:17.912084+0000","last_fullsized":"2024-09-19T15:31:17.912084+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:09.297865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":198,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.395494+0000","last_change":"2024-09-19T13:40:42.254540+0000","last_active":"2024-09-19T15:29:02.395494+0000","last_peered":"2024-09-19T15:29:02.395494+0000","last_clean":"2024-09-19T15:29:02.395494+0000","last_became_active":"2024-09-19T13:40:42.250662+0000","last_became_peered":"2024-09-19T13:40:42.250662+0000","last_unstale":"2024-09-19T15:29:02.395494+0000","last_undegraded":"2024-09-19T15:29:02.395494+0000","last_fullsized":"2024-09-19T15:29:02.395494+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:12.417076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'126","reported_seq":718,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:43.404178+0000","last_change":"2024-09-19T13:40:44.267544+0000","last_active":"2024-09-19T15:29:43.404178+0000","last_peered":"2024-09-19T15:29:43.404178+0000","last_clean":"2024-09-19T15:29:43.404178+0000","last_became_active":"2024-09-19T13:40:44.266678+0000","last_became_peered":"2024-09-19T13:40:44.266678+0000","last_unstale":"2024-09-19T15:29:43.404178+0000","last_undegraded":"2024-09-19T15:29:43.404178+0000","last_fullsized":"2024-09-19T15:29:43.404178+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:56:44.218291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":283,"num_read_kb":273,"num_write":324,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'759","reported_seq":2286,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391645+0000","last_change":"2024-09-19T13:40:36.244736+0000","last_active":"2024-09-19T15:28:57.391645+0000","last_peered":"2024-09-19T15:28:57.391645+0000","last_clean":"2024-09-19T15:28:57.391645+0000","last_became_active":"2024-09-19T13:40:36.244403+0000","last_became_peered":"2024-09-19T13:40:36.244403+0000","last_unstale":"2024-09-19T15:28:57.391645+0000","last_undegraded":"2024-09-19T15:28:57.391645+0000","last_fullsized":"2024-09-19T15:28:57.391645+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:21.219635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3619,"num_read_kb":3269,"num_write":981,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'271","reported_seq":986,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:22.636959+0000","last_change":"2024-09-19T13:40:34.226710+0000","last_active":"2024-09-19T15:29:22.636959+0000","last_peered":"2024-09-19T15:29:22.636959+0000","last_clean":"2024-09-19T15:29:22.636959+0000","last_became_active":"2024-09-19T13:40:34.225452+0000","last_became_peered":"2024-09-19T13:40:34.225452+0000","last_unstale":"2024-09-19T15:29:22.636959+0000","last_undegraded":"2024-09-19T15:29:22.636959+0000","last_fullsized":"2024-09-19T15:29:22.636959+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:24:16.701686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1201774,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":543,"num_read_kb":97113,"num_write":1048,"num_write_kb":15979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":551,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.388367+0000","last_change":"2024-09-19T13:40:22.113821+0000","last_active":"2024-09-19T15:28:42.388367+0000","last_peered":"2024-09-19T15:28:42.388367+0000","last_clean":"2024-09-19T15:28:42.388367+0000","last_became_active":"2024-09-19T13:40:20.095294+0000","last_became_peered":"2024-09-19T13:40:20.095294+0000","last_unstale":"2024-09-19T15:28:42.388367+0000","last_undegraded":"2024-09-19T15:28:42.388367+0000","last_fullsized":"2024-09-19T15:28:42.388367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:38.696147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088577700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.191905+0000","last_change":"2024-09-19T13:40:38.230538+0000","last_active":"2024-09-19T15:29:02.191905+0000","last_peered":"2024-09-19T15:29:02.191905+0000","last_clean":"2024-09-19T15:29:02.191905+0000","last_became_active":"2024-09-19T13:40:38.229743+0000","last_became_peered":"2024-09-19T13:40:38.229743+0000","last_unstale":"2024-09-19T15:29:02.191905+0000","last_undegraded":"2024-09-19T15:29:02.191905+0000","last_fullsized":"2024-09-19T15:29:02.191905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:00.135611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'612","reported_seq":1337,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.082458+0000","last_change":"2024-09-19T13:40:40.224386+0000","last_active":"2024-09-19T15:31:18.082458+0000","last_peered":"2024-09-19T15:31:18.082458+0000","last_clean":"2024-09-19T15:31:18.082458+0000","last_became_active":"2024-09-19T13:40:40.223632+0000","last_became_peered":"2024-09-19T13:40:40.223632+0000","last_unstale":"2024-09-19T15:31:18.082458+0000","last_undegraded":"2024-09-19T15:31:18.082458+0000","last_fullsized":"2024-09-19T15:31:18.082458+0000","mapping_epoch":31,"log_start":"268'600","ondisk_log_start":"268'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:52.387211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116930,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1037,"num_read_kb":2015,"num_write":834,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.612861+0000","last_change":"2024-09-19T13:40:42.246177+0000","last_active":"2024-09-19T15:29:02.612861+0000","last_peered":"2024-09-19T15:29:02.612861+0000","last_clean":"2024-09-19T15:29:02.612861+0000","last_became_active":"2024-09-19T13:40:42.245476+0000","last_became_peered":"2024-09-19T13:40:42.245476+0000","last_unstale":"2024-09-19T15:29:02.612861+0000","last_undegraded":"2024-09-19T15:29:02.612861+0000","last_fullsized":"2024-09-19T15:29:02.612861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:33:09.183782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'141","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:11.923727+0000","last_change":"2024-09-19T13:40:44.275185+0000","last_active":"2024-09-19T15:31:11.923727+0000","last_peered":"2024-09-19T15:31:11.923727+0000","last_clean":"2024-09-19T15:31:11.923727+0000","last_became_active":"2024-09-19T13:40:44.274333+0000","last_became_peered":"2024-09-19T13:40:44.274333+0000","last_unstale":"2024-09-19T15:31:11.923727+0000","last_undegraded":"2024-09-19T15:31:11.923727+0000","last_fullsized":"2024-09-19T15:31:11.923727+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:10.763011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":236,"num_read_kb":218,"num_write":346,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'455","reported_seq":2038,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.656021+0000","last_change":"2024-09-19T13:40:36.242002+0000","last_active":"2024-09-19T15:29:50.656021+0000","last_peered":"2024-09-19T15:29:50.656021+0000","last_clean":"2024-09-19T15:29:50.656021+0000","last_became_active":"2024-09-19T13:40:36.241654+0000","last_became_peered":"2024-09-19T13:40:36.241654+0000","last_unstale":"2024-09-19T15:29:50.656021+0000","last_undegraded":"2024-09-19T15:29:50.656021+0000","last_fullsized":"2024-09-19T15:29:50.656021+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:39:35.530454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2406,"num_read_kb":2267,"num_write":541,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'252","reported_seq":903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391716+0000","last_change":"2024-09-19T13:40:34.249506+0000","last_active":"2024-09-19T15:28:57.391716+0000","last_peered":"2024-09-19T15:28:57.391716+0000","last_clean":"2024-09-19T15:28:57.391716+0000","last_became_active":"2024-09-19T13:40:34.248944+0000","last_became_peered":"2024-09-19T13:40:34.248944+0000","last_unstale":"2024-09-19T15:28:57.391716+0000","last_undegraded":"2024-09-19T15:28:57.391716+0000","last_fullsized":"2024-09-19T15:28:57.391716+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:14:45.859987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6359178,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":423,"num_read_kb":60020,"num_write":866,"num_write_kb":13648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":560,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:07.655294+0000","last_change":"2024-09-19T13:40:23.121258+0000","last_active":"2024-09-19T15:29:07.655294+0000","last_peered":"2024-09-19T15:29:07.655294+0000","last_clean":"2024-09-19T15:29:07.655294+0000","last_became_active":"2024-09-19T13:40:20.096321+0000","last_became_peered":"2024-09-19T13:40:20.096321+0000","last_unstale":"2024-09-19T15:29:07.655294+0000","last_undegraded":"2024-09-19T15:29:07.655294+0000","last_fullsized":"2024-09-19T15:29:07.655294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:56.853216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001025329,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.395362+0000","last_change":"2024-09-19T13:40:38.230448+0000","last_active":"2024-09-19T15:29:02.395362+0000","last_peered":"2024-09-19T15:29:02.395362+0000","last_clean":"2024-09-19T15:29:02.395362+0000","last_became_active":"2024-09-19T13:40:38.229784+0000","last_became_peered":"2024-09-19T13:40:38.229784+0000","last_unstale":"2024-09-19T15:29:02.395362+0000","last_undegraded":"2024-09-19T15:29:02.395362+0000","last_fullsized":"2024-09-19T15:29:02.395362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:28:13.132545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'339","reported_seq":975,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.261784+0000","last_change":"2024-09-19T13:40:40.240170+0000","last_active":"2024-09-19T15:31:18.261784+0000","last_peered":"2024-09-19T15:31:18.261784+0000","last_clean":"2024-09-19T15:31:18.261784+0000","last_became_active":"2024-09-19T13:40:40.239406+0000","last_became_peered":"2024-09-19T13:40:40.239406+0000","last_unstale":"2024-09-19T15:31:18.261784+0000","last_undegraded":"2024-09-19T15:31:18.261784+0000","last_fullsized":"2024-09-19T15:31:18.261784+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:48:52.979382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":438,"num_read_kb":429,"num_write":416,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'781","reported_seq":3357,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:16.991134+0000","last_change":"2024-09-19T13:40:42.245618+0000","last_active":"2024-09-19T15:31:16.991134+0000","last_peered":"2024-09-19T15:31:16.991134+0000","last_clean":"2024-09-19T15:31:16.991134+0000","last_became_active":"2024-09-19T13:40:42.244921+0000","last_became_peered":"2024-09-19T13:40:42.244921+0000","last_unstale":"2024-09-19T15:31:16.991134+0000","last_undegraded":"2024-09-19T15:31:16.991134+0000","last_fullsized":"2024-09-19T15:31:16.991134+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:59.793708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'142","reported_seq":702,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.263529+0000","last_change":"2024-09-19T13:40:44.279820+0000","last_active":"2024-09-19T15:31:13.263529+0000","last_peered":"2024-09-19T15:31:13.263529+0000","last_clean":"2024-09-19T15:31:13.263529+0000","last_became_active":"2024-09-19T13:40:44.277602+0000","last_became_peered":"2024-09-19T13:40:44.277602+0000","last_unstale":"2024-09-19T15:31:13.263529+0000","last_undegraded":"2024-09-19T15:31:13.263529+0000","last_fullsized":"2024-09-19T15:31:13.263529+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:34:45.143706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":303,"num_read_kb":269,"num_write":341,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'434","reported_seq":1934,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:48.240820+0000","last_change":"2024-09-19T13:40:36.235651+0000","last_active":"2024-09-19T15:28:48.240820+0000","last_peered":"2024-09-19T15:28:48.240820+0000","last_clean":"2024-09-19T15:28:48.240820+0000","last_became_active":"2024-09-19T13:40:36.235186+0000","last_became_peered":"2024-09-19T13:40:36.235186+0000","last_unstale":"2024-09-19T15:28:48.240820+0000","last_undegraded":"2024-09-19T15:28:48.240820+0000","last_fullsized":"2024-09-19T15:28:48.240820+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:14.271645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2268,"num_read_kb":2120,"num_write":492,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'347","reported_seq":1184,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:58.243544+0000","last_change":"2024-09-19T13:40:34.236743+0000","last_active":"2024-09-19T15:28:58.243544+0000","last_peered":"2024-09-19T15:28:58.243544+0000","last_clean":"2024-09-19T15:28:58.243544+0000","last_became_active":"2024-09-19T13:40:34.236325+0000","last_became_peered":"2024-09-19T13:40:34.236325+0000","last_unstale":"2024-09-19T15:28:58.243544+0000","last_undegraded":"2024-09-19T15:28:58.243544+0000","last_fullsized":"2024-09-19T15:28:58.243544+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:08.160460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26215291,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":790,"num_read_kb":111535,"num_write":1242,"num_write_kb":62709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":549,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.388450+0000","last_change":"2024-09-19T13:40:22.113992+0000","last_active":"2024-09-19T15:28:42.388450+0000","last_peered":"2024-09-19T15:28:42.388450+0000","last_clean":"2024-09-19T15:28:42.388450+0000","last_became_active":"2024-09-19T13:40:20.101186+0000","last_became_peered":"2024-09-19T13:40:20.101186+0000","last_unstale":"2024-09-19T15:28:42.388450+0000","last_undegraded":"2024-09-19T15:28:42.388450+0000","last_fullsized":"2024-09-19T15:28:42.388450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:40.208910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010323750000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.612811+0000","last_change":"2024-09-19T13:40:38.235854+0000","last_active":"2024-09-19T15:29:02.612811+0000","last_peered":"2024-09-19T15:29:02.612811+0000","last_clean":"2024-09-19T15:29:02.612811+0000","last_became_active":"2024-09-19T13:40:38.235109+0000","last_became_peered":"2024-09-19T13:40:38.235109+0000","last_unstale":"2024-09-19T15:29:02.612811+0000","last_undegraded":"2024-09-19T15:29:02.612811+0000","last_fullsized":"2024-09-19T15:29:02.612811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:18.997643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'193","reported_seq":793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.185499+0000","last_change":"2024-09-19T13:40:40.248167+0000","last_active":"2024-09-19T15:31:18.185499+0000","last_peered":"2024-09-19T15:31:18.185499+0000","last_clean":"2024-09-19T15:31:18.185499+0000","last_became_active":"2024-09-19T13:40:40.244484+0000","last_became_peered":"2024-09-19T13:40:40.244484+0000","last_unstale":"2024-09-19T15:31:18.185499+0000","last_undegraded":"2024-09-19T15:31:18.185499+0000","last_fullsized":"2024-09-19T15:31:18.185499+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:26.251998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":238,"num_read_kb":228,"num_write":166,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'782","reported_seq":5105,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:16.987086+0000","last_change":"2024-09-19T13:40:42.258379+0000","last_active":"2024-09-19T15:31:16.987086+0000","last_peered":"2024-09-19T15:31:16.987086+0000","last_clean":"2024-09-19T15:31:16.987086+0000","last_became_active":"2024-09-19T13:40:42.257799+0000","last_became_peered":"2024-09-19T13:40:42.257799+0000","last_unstale":"2024-09-19T15:31:16.987086+0000","last_undegraded":"2024-09-19T15:31:16.987086+0000","last_fullsized":"2024-09-19T15:31:16.987086+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:03:48.981520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'191","reported_seq":724,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.522019+0000","last_change":"2024-09-19T13:40:44.259985+0000","last_active":"2024-09-19T15:29:48.522019+0000","last_peered":"2024-09-19T15:29:48.522019+0000","last_clean":"2024-09-19T15:29:48.522019+0000","last_became_active":"2024-09-19T13:40:44.259077+0000","last_became_peered":"2024-09-19T13:40:44.259077+0000","last_unstale":"2024-09-19T15:29:48.522019+0000","last_undegraded":"2024-09-19T15:29:48.522019+0000","last_fullsized":"2024-09-19T15:29:48.522019+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:06:05.199311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":211,"num_read_kb":198,"num_write":423,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'428","reported_seq":1954,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.611513+0000","last_change":"2024-09-19T13:40:36.243340+0000","last_active":"2024-09-19T15:28:57.611513+0000","last_peered":"2024-09-19T15:28:57.611513+0000","last_clean":"2024-09-19T15:28:57.611513+0000","last_became_active":"2024-09-19T13:40:36.242739+0000","last_became_peered":"2024-09-19T13:40:36.242739+0000","last_unstale":"2024-09-19T15:28:57.611513+0000","last_undegraded":"2024-09-19T15:28:57.611513+0000","last_fullsized":"2024-09-19T15:28:57.611513+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:12.677759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2240,"num_read_kb":2109,"num_write":493,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'249","reported_seq":901,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:06.812877+0000","last_change":"2024-09-19T13:41:05.316778+0000","last_active":"2024-09-19T15:31:06.812877+0000","last_peered":"2024-09-19T15:31:06.812877+0000","last_clean":"2024-09-19T15:31:06.812877+0000","last_became_active":"2024-09-19T13:41:05.316287+0000","last_became_peered":"2024-09-19T13:41:05.316287+0000","last_unstale":"2024-09-19T15:31:06.812877+0000","last_undegraded":"2024-09-19T15:31:06.812877+0000","last_fullsized":"2024-09-19T15:31:06.812877+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:28.207137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6290137,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":584,"num_read_kb":12872,"num_write":961,"num_write_kb":31603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":546,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.390813+0000","last_change":"2024-09-19T13:40:22.308878+0000","last_active":"2024-09-19T15:28:42.390813+0000","last_peered":"2024-09-19T15:28:42.390813+0000","last_clean":"2024-09-19T15:28:42.390813+0000","last_became_active":"2024-09-19T13:40:20.103134+0000","last_became_peered":"2024-09-19T13:40:20.103134+0000","last_unstale":"2024-09-19T15:28:42.390813+0000","last_undegraded":"2024-09-19T15:28:42.390813+0000","last_fullsized":"2024-09-19T15:28:42.390813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:38.150405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093870599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:53.241996+0000","last_change":"2024-09-19T13:40:38.221807+0000","last_active":"2024-09-19T15:28:53.241996+0000","last_peered":"2024-09-19T15:28:53.241996+0000","last_clean":"2024-09-19T15:28:53.241996+0000","last_became_active":"2024-09-19T13:40:38.221430+0000","last_became_peered":"2024-09-19T13:40:38.221430+0000","last_unstale":"2024-09-19T15:28:53.241996+0000","last_undegraded":"2024-09-19T15:28:53.241996+0000","last_fullsized":"2024-09-19T15:28:53.241996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:13.637760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'825","reported_seq":1602,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.147205+0000","last_change":"2024-09-19T13:40:40.230230+0000","last_active":"2024-09-19T15:31:18.147205+0000","last_peered":"2024-09-19T15:31:18.147205+0000","last_clean":"2024-09-19T15:31:18.147205+0000","last_became_active":"2024-09-19T13:40:40.229426+0000","last_became_peered":"2024-09-19T13:40:40.229426+0000","last_unstale":"2024-09-19T15:31:18.147205+0000","last_undegraded":"2024-09-19T15:31:18.147205+0000","last_fullsized":"2024-09-19T15:31:18.147205+0000","mapping_epoch":31,"log_start":"268'800","ondisk_log_start":"268'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:41:10.280326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181238,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1441,"num_read_kb":2990,"num_write":1182,"num_write_kb":940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:03.244490+0000","last_change":"2024-09-19T13:40:42.245759+0000","last_active":"2024-09-19T15:29:03.244490+0000","last_peered":"2024-09-19T15:29:03.244490+0000","last_clean":"2024-09-19T15:29:03.244490+0000","last_became_active":"2024-09-19T13:40:42.244291+0000","last_became_peered":"2024-09-19T13:40:42.244291+0000","last_unstale":"2024-09-19T15:29:03.244490+0000","last_undegraded":"2024-09-19T15:29:03.244490+0000","last_fullsized":"2024-09-19T15:29:03.244490+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:28.425275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'152","reported_seq":709,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:47.628704+0000","last_change":"2024-09-19T13:40:44.274189+0000","last_active":"2024-09-19T15:28:47.628704+0000","last_peered":"2024-09-19T15:28:47.628704+0000","last_clean":"2024-09-19T15:28:47.628704+0000","last_became_active":"2024-09-19T13:40:44.273409+0000","last_became_peered":"2024-09-19T13:40:44.273409+0000","last_unstale":"2024-09-19T15:28:47.628704+0000","last_undegraded":"2024-09-19T15:28:47.628704+0000","last_fullsized":"2024-09-19T15:28:47.628704+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:21.357101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":293,"num_read_kb":268,"num_write":395,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'157","reported_seq":741,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:51.129484+0000","last_change":"2024-09-19T13:40:44.264292+0000","last_active":"2024-09-19T15:29:51.129484+0000","last_peered":"2024-09-19T15:29:51.129484+0000","last_clean":"2024-09-19T15:29:51.129484+0000","last_became_active":"2024-09-19T13:40:44.263575+0000","last_became_peered":"2024-09-19T13:40:44.263575+0000","last_unstale":"2024-09-19T15:29:51.129484+0000","last_undegraded":"2024-09-19T15:29:51.129484+0000","last_fullsized":"2024-09-19T15:29:51.129484+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:21.299012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":274,"num_read_kb":267,"num_write":381,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'488","reported_seq":2271,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:49.327444+0000","last_change":"2024-09-19T13:40:36.228857+0000","last_active":"2024-09-19T15:28:49.327444+0000","last_peered":"2024-09-19T15:28:49.327444+0000","last_clean":"2024-09-19T15:28:49.327444+0000","last_became_active":"2024-09-19T13:40:36.221019+0000","last_became_peered":"2024-09-19T13:40:36.221019+0000","last_unstale":"2024-09-19T15:28:49.327444+0000","last_undegraded":"2024-09-19T15:28:49.327444+0000","last_fullsized":"2024-09-19T15:28:49.327444+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:18:02.656810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2720,"num_read_kb":2588,"num_write":552,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'326","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:17.602405+0000","last_change":"2024-09-19T13:40:34.268385+0000","last_active":"2024-09-19T15:28:17.602405+0000","last_peered":"2024-09-19T15:28:17.602405+0000","last_clean":"2024-09-19T15:28:17.602405+0000","last_became_active":"2024-09-19T13:40:34.263276+0000","last_became_peered":"2024-09-19T13:40:34.263276+0000","last_unstale":"2024-09-19T15:28:17.602405+0000","last_undegraded":"2024-09-19T15:28:17.602405+0000","last_fullsized":"2024-09-19T15:28:17.602405+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:53.534025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141461,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":617,"num_read_kb":11371,"num_write":1159,"num_write_kb":39217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"37'5","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.117589+0000","last_change":"2024-09-19T13:40:38.216204+0000","last_active":"2024-09-19T15:31:13.117589+0000","last_peered":"2024-09-19T15:31:13.117589+0000","last_clean":"2024-09-19T15:31:13.117589+0000","last_became_active":"2024-09-19T13:40:38.215364+0000","last_became_peered":"2024-09-19T13:40:38.215364+0000","last_unstale":"2024-09-19T15:31:13.117589+0000","last_undegraded":"2024-09-19T15:31:13.117589+0000","last_fullsized":"2024-09-19T15:31:13.117589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:27.296619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":720,"num_read_kb":1179,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'355","reported_seq":984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.274430+0000","last_change":"2024-09-19T13:40:40.230669+0000","last_active":"2024-09-19T15:31:18.274430+0000","last_peered":"2024-09-19T15:31:18.274430+0000","last_clean":"2024-09-19T15:31:18.274430+0000","last_became_active":"2024-09-19T13:40:40.229872+0000","last_became_peered":"2024-09-19T13:40:40.229872+0000","last_unstale":"2024-09-19T15:31:18.274430+0000","last_undegraded":"2024-09-19T15:31:18.274430+0000","last_fullsized":"2024-09-19T15:31:18.274430+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:36.305353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148208,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":572,"num_read_kb":1295,"num_write":462,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:03.230352+0000","last_change":"2024-09-19T13:40:42.243067+0000","last_active":"2024-09-19T15:28:03.230352+0000","last_peered":"2024-09-19T15:28:03.230352+0000","last_clean":"2024-09-19T15:28:03.230352+0000","last_became_active":"2024-09-19T13:40:42.242368+0000","last_became_peered":"2024-09-19T13:40:42.242368+0000","last_unstale":"2024-09-19T15:28:03.230352+0000","last_undegraded":"2024-09-19T15:28:03.230352+0000","last_fullsized":"2024-09-19T15:28:03.230352+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:59.628504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'121","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:46.522969+0000","last_change":"2024-09-19T13:40:44.269881+0000","last_active":"2024-09-19T15:29:46.522969+0000","last_peered":"2024-09-19T15:29:46.522969+0000","last_clean":"2024-09-19T15:29:46.522969+0000","last_became_active":"2024-09-19T13:40:44.268946+0000","last_became_peered":"2024-09-19T13:40:44.268946+0000","last_unstale":"2024-09-19T15:29:46.522969+0000","last_undegraded":"2024-09-19T15:29:46.522969+0000","last_fullsized":"2024-09-19T15:29:46.522969+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:40.184840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":128,"num_write":265,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'468","reported_seq":2032,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:19.439069+0000","last_change":"2024-09-19T13:40:36.226704+0000","last_active":"2024-09-19T15:28:19.439069+0000","last_peered":"2024-09-19T15:28:19.439069+0000","last_clean":"2024-09-19T15:28:19.439069+0000","last_became_active":"2024-09-19T13:40:36.226164+0000","last_became_peered":"2024-09-19T13:40:36.226164+0000","last_unstale":"2024-09-19T15:28:19.439069+0000","last_undegraded":"2024-09-19T15:28:19.439069+0000","last_fullsized":"2024-09-19T15:28:19.439069+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:08.833158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2492,"num_read_kb":2321,"num_write":561,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'252","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:26.080136+0000","last_change":"2024-09-19T13:41:05.389078+0000","last_active":"2024-09-19T15:29:26.080136+0000","last_peered":"2024-09-19T15:29:26.080136+0000","last_clean":"2024-09-19T15:29:26.080136+0000","last_became_active":"2024-09-19T13:41:05.387779+0000","last_became_peered":"2024-09-19T13:41:05.387779+0000","last_unstale":"2024-09-19T15:29:26.080136+0000","last_undegraded":"2024-09-19T15:29:26.080136+0000","last_fullsized":"2024-09-19T15:29:26.080136+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:33:11.159579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14914337,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":835,"num_read_kb":29706,"num_write":955,"num_write_kb":41961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:03.230639+0000","last_change":"2024-09-19T13:40:38.229142+0000","last_active":"2024-09-19T15:28:03.230639+0000","last_peered":"2024-09-19T15:28:03.230639+0000","last_clean":"2024-09-19T15:28:03.230639+0000","last_became_active":"2024-09-19T13:40:38.228856+0000","last_became_peered":"2024-09-19T13:40:38.228856+0000","last_unstale":"2024-09-19T15:28:03.230639+0000","last_undegraded":"2024-09-19T15:28:03.230639+0000","last_fullsized":"2024-09-19T15:28:03.230639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:01.786775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'85","reported_seq":624,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.250690+0000","last_change":"2024-09-19T13:40:40.236243+0000","last_active":"2024-09-19T15:31:17.250690+0000","last_peered":"2024-09-19T15:31:17.250690+0000","last_clean":"2024-09-19T15:31:17.250690+0000","last_became_active":"2024-09-19T13:40:40.235528+0000","last_became_peered":"2024-09-19T13:40:40.235528+0000","last_unstale":"2024-09-19T15:31:17.250690+0000","last_undegraded":"2024-09-19T15:31:17.250690+0000","last_fullsized":"2024-09-19T15:31:17.250690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:33:05.231869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":75,"num_write":58,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.639370+0000","last_change":"2024-09-19T13:40:42.243881+0000","last_active":"2024-09-19T15:28:02.639370+0000","last_peered":"2024-09-19T15:28:02.639370+0000","last_clean":"2024-09-19T15:28:02.639370+0000","last_became_active":"2024-09-19T13:40:42.243224+0000","last_became_peered":"2024-09-19T13:40:42.243224+0000","last_unstale":"2024-09-19T15:28:02.639370+0000","last_undegraded":"2024-09-19T15:28:02.639370+0000","last_fullsized":"2024-09-19T15:28:02.639370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:08:53.998486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'210","reported_seq":756,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.410376+0000","last_change":"2024-09-19T13:40:44.259510+0000","last_active":"2024-09-19T15:29:48.410376+0000","last_peered":"2024-09-19T15:29:48.410376+0000","last_clean":"2024-09-19T15:29:48.410376+0000","last_became_active":"2024-09-19T13:40:44.258721+0000","last_became_peered":"2024-09-19T13:40:44.258721+0000","last_unstale":"2024-09-19T15:29:48.410376+0000","last_undegraded":"2024-09-19T15:29:48.410376+0000","last_fullsized":"2024-09-19T15:29:48.410376+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:08.449777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":369,"num_read_kb":358,"num_write":477,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'367","reported_seq":1888,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.249898+0000","last_change":"2024-09-19T13:40:36.240148+0000","last_active":"2024-09-19T15:31:12.249898+0000","last_peered":"2024-09-19T15:31:12.249898+0000","last_clean":"2024-09-19T15:31:12.249898+0000","last_became_active":"2024-09-19T13:40:36.239629+0000","last_became_peered":"2024-09-19T13:40:36.239629+0000","last_unstale":"2024-09-19T15:31:12.249898+0000","last_undegraded":"2024-09-19T15:31:12.249898+0000","last_fullsized":"2024-09-19T15:31:12.249898+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:24.215137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2075,"num_read_kb":1985,"num_write":419,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'267","reported_seq":941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:40.662828+0000","last_change":"2024-09-19T13:40:34.257051+0000","last_active":"2024-09-19T15:27:40.662828+0000","last_peered":"2024-09-19T15:27:40.662828+0000","last_clean":"2024-09-19T15:27:40.662828+0000","last_became_active":"2024-09-19T13:40:34.256236+0000","last_became_peered":"2024-09-19T13:40:34.256236+0000","last_unstale":"2024-09-19T15:27:40.662828+0000","last_undegraded":"2024-09-19T15:27:40.662828+0000","last_fullsized":"2024-09-19T15:27:40.662828+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:27:07.032068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8287774,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":501,"num_read_kb":16816,"num_write":923,"num_write_kb":29952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.639311+0000","last_change":"2024-09-19T13:40:38.252067+0000","last_active":"2024-09-19T15:28:02.639311+0000","last_peered":"2024-09-19T15:28:02.639311+0000","last_clean":"2024-09-19T15:28:02.639311+0000","last_became_active":"2024-09-19T13:40:38.249269+0000","last_became_peered":"2024-09-19T13:40:38.249269+0000","last_unstale":"2024-09-19T15:28:02.639311+0000","last_undegraded":"2024-09-19T15:28:02.639311+0000","last_fullsized":"2024-09-19T15:28:02.639311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:17.524647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'352","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.108327+0000","last_change":"2024-09-19T13:40:40.230649+0000","last_active":"2024-09-19T15:31:18.108327+0000","last_peered":"2024-09-19T15:31:18.108327+0000","last_clean":"2024-09-19T15:31:18.108327+0000","last_became_active":"2024-09-19T13:40:40.229852+0000","last_became_peered":"2024-09-19T13:40:40.229852+0000","last_unstale":"2024-09-19T15:31:18.108327+0000","last_undegraded":"2024-09-19T15:31:18.108327+0000","last_fullsized":"2024-09-19T15:31:18.108327+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:48.815571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56415,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":573,"num_read_kb":1060,"num_write":448,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.381985+0000","last_change":"2024-09-19T13:40:42.250045+0000","last_active":"2024-09-19T15:28:02.381985+0000","last_peered":"2024-09-19T15:28:02.381985+0000","last_clean":"2024-09-19T15:28:02.381985+0000","last_became_active":"2024-09-19T13:40:42.240135+0000","last_became_peered":"2024-09-19T13:40:42.240135+0000","last_unstale":"2024-09-19T15:28:02.381985+0000","last_undegraded":"2024-09-19T15:28:02.381985+0000","last_fullsized":"2024-09-19T15:28:02.381985+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:14.195144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'85","reported_seq":635,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:45.986381+0000","last_change":"2024-09-19T13:40:44.269896+0000","last_active":"2024-09-19T15:28:45.986381+0000","last_peered":"2024-09-19T15:28:45.986381+0000","last_clean":"2024-09-19T15:28:45.986381+0000","last_became_active":"2024-09-19T13:40:44.269134+0000","last_became_peered":"2024-09-19T13:40:44.269134+0000","last_unstale":"2024-09-19T15:28:45.986381+0000","last_undegraded":"2024-09-19T15:28:45.986381+0000","last_fullsized":"2024-09-19T15:28:45.986381+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:09.390631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":160,"num_write":196,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'609","reported_seq":2425,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.655880+0000","last_change":"2024-09-19T13:40:36.219585+0000","last_active":"2024-09-19T15:29:50.655880+0000","last_peered":"2024-09-19T15:29:50.655880+0000","last_clean":"2024-09-19T15:29:50.655880+0000","last_became_active":"2024-09-19T13:40:36.217925+0000","last_became_peered":"2024-09-19T13:40:36.217925+0000","last_unstale":"2024-09-19T15:29:50.655880+0000","last_undegraded":"2024-09-19T15:29:50.655880+0000","last_fullsized":"2024-09-19T15:29:50.655880+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":500,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:53.942689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3256,"num_read_kb":3011,"num_write":769,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'282","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:26.609546+0000","last_change":"2024-09-19T13:40:34.228238+0000","last_active":"2024-09-19T15:28:26.609546+0000","last_peered":"2024-09-19T15:28:26.609546+0000","last_clean":"2024-09-19T15:28:26.609546+0000","last_became_active":"2024-09-19T13:40:34.227791+0000","last_became_peered":"2024-09-19T13:40:34.227791+0000","last_unstale":"2024-09-19T15:28:26.609546+0000","last_undegraded":"2024-09-19T15:28:26.609546+0000","last_fullsized":"2024-09-19T15:28:26.609546+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:08.249649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6537694,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":454,"num_read_kb":35857,"num_write":975,"num_write_kb":31805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.381920+0000","last_change":"2024-09-19T13:40:38.246952+0000","last_active":"2024-09-19T15:28:02.381920+0000","last_peered":"2024-09-19T15:28:02.381920+0000","last_clean":"2024-09-19T15:28:02.381920+0000","last_became_active":"2024-09-19T13:40:38.246129+0000","last_became_peered":"2024-09-19T13:40:38.246129+0000","last_unstale":"2024-09-19T15:28:02.381920+0000","last_undegraded":"2024-09-19T15:28:02.381920+0000","last_fullsized":"2024-09-19T15:28:02.381920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:34.896613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'310","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.692762+0000","last_change":"2024-09-19T13:40:40.219645+0000","last_active":"2024-09-19T15:31:17.692762+0000","last_peered":"2024-09-19T15:31:17.692762+0000","last_clean":"2024-09-19T15:31:17.692762+0000","last_became_active":"2024-09-19T13:40:40.218434+0000","last_became_peered":"2024-09-19T13:40:40.218434+0000","last_unstale":"2024-09-19T15:31:17.692762+0000","last_undegraded":"2024-09-19T15:31:17.692762+0000","last_fullsized":"2024-09-19T15:31:17.692762+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:27.205776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54978,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":1000,"num_write":408,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.178023+0000","last_change":"2024-09-19T13:40:42.240830+0000","last_active":"2024-09-19T15:28:02.178023+0000","last_peered":"2024-09-19T15:28:02.178023+0000","last_clean":"2024-09-19T15:28:02.178023+0000","last_became_active":"2024-09-19T13:40:42.238908+0000","last_became_peered":"2024-09-19T13:40:42.238908+0000","last_unstale":"2024-09-19T15:28:02.178023+0000","last_undegraded":"2024-09-19T15:28:02.178023+0000","last_fullsized":"2024-09-19T15:28:02.178023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:27.434117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'522","reported_seq":2138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.266057+0000","last_change":"2024-09-19T13:40:36.244240+0000","last_active":"2024-09-19T15:31:12.266057+0000","last_peered":"2024-09-19T15:31:12.266057+0000","last_clean":"2024-09-19T15:31:12.266057+0000","last_became_active":"2024-09-19T13:40:36.243653+0000","last_became_peered":"2024-09-19T13:40:36.243653+0000","last_unstale":"2024-09-19T15:31:12.266057+0000","last_undegraded":"2024-09-19T15:31:12.266057+0000","last_fullsized":"2024-09-19T15:31:12.266057+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:58.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2759,"num_read_kb":2556,"num_write":676,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'296","reported_seq":938,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:26:58.214536+0000","last_change":"2024-09-19T13:40:34.220157+0000","last_active":"2024-09-19T15:26:58.214536+0000","last_peered":"2024-09-19T15:26:58.214536+0000","last_clean":"2024-09-19T15:26:58.214536+0000","last_became_active":"2024-09-19T13:40:34.219131+0000","last_became_peered":"2024-09-19T13:40:34.219131+0000","last_unstale":"2024-09-19T15:26:58.214536+0000","last_undegraded":"2024-09-19T15:26:58.214536+0000","last_fullsized":"2024-09-19T15:26:58.214536+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:20.075063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14133446,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":465,"num_read_kb":16977,"num_write":1113,"num_write_kb":67471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:17.195724+0000","last_change":"2024-09-19T13:40:38.232297+0000","last_active":"2024-09-19T15:29:17.195724+0000","last_peered":"2024-09-19T15:29:17.195724+0000","last_clean":"2024-09-19T15:29:17.195724+0000","last_became_active":"2024-09-19T13:40:38.231992+0000","last_became_peered":"2024-09-19T13:40:38.231992+0000","last_unstale":"2024-09-19T15:29:17.195724+0000","last_undegraded":"2024-09-19T15:29:17.195724+0000","last_fullsized":"2024-09-19T15:29:17.195724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:52.322584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'553","reported_seq":1214,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.325890+0000","last_change":"2024-09-19T13:40:40.242437+0000","last_active":"2024-09-19T15:31:18.325890+0000","last_peered":"2024-09-19T15:31:18.325890+0000","last_clean":"2024-09-19T15:31:18.325890+0000","last_became_active":"2024-09-19T13:40:40.241045+0000","last_became_peered":"2024-09-19T13:40:40.241045+0000","last_unstale":"2024-09-19T15:31:18.325890+0000","last_undegraded":"2024-09-19T15:31:18.325890+0000","last_fullsized":"2024-09-19T15:31:18.325890+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:12.858930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124726,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":2048,"num_write":852,"num_write_kb":745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.620732+0000","last_change":"2024-09-19T13:40:42.266732+0000","last_active":"2024-09-19T15:28:12.620732+0000","last_peered":"2024-09-19T15:28:12.620732+0000","last_clean":"2024-09-19T15:28:12.620732+0000","last_became_active":"2024-09-19T13:40:42.266161+0000","last_became_peered":"2024-09-19T13:40:42.266161+0000","last_unstale":"2024-09-19T15:28:12.620732+0000","last_undegraded":"2024-09-19T15:28:12.620732+0000","last_fullsized":"2024-09-19T15:28:12.620732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:36.831314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'153","reported_seq":684,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:08.231621+0000","last_change":"2024-09-19T13:40:44.280809+0000","last_active":"2024-09-19T15:28:08.231621+0000","last_peered":"2024-09-19T15:28:08.231621+0000","last_clean":"2024-09-19T15:28:08.231621+0000","last_became_active":"2024-09-19T13:40:44.280362+0000","last_became_peered":"2024-09-19T13:40:44.280362+0000","last_unstale":"2024-09-19T15:28:08.231621+0000","last_undegraded":"2024-09-19T15:28:08.231621+0000","last_fullsized":"2024-09-19T15:28:08.231621+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:26:28.134421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":216,"num_read_kb":226,"num_write":329,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'908","reported_seq":2606,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.194253+0000","last_change":"2024-09-19T13:40:36.234854+0000","last_active":"2024-09-19T15:29:12.194253+0000","last_peered":"2024-09-19T15:29:12.194253+0000","last_clean":"2024-09-19T15:29:12.194253+0000","last_became_active":"2024-09-19T13:40:36.234428+0000","last_became_peered":"2024-09-19T13:40:36.234428+0000","last_unstale":"2024-09-19T15:29:12.194253+0000","last_undegraded":"2024-09-19T15:29:12.194253+0000","last_fullsized":"2024-09-19T15:29:12.194253+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":800,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:32.532292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4426,"num_read_kb":3975,"num_write":1248,"num_write_kb":508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'320","reported_seq":1030,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:27.370254+0000","last_change":"2024-09-19T13:40:34.250086+0000","last_active":"2024-09-19T15:27:27.370254+0000","last_peered":"2024-09-19T15:27:27.370254+0000","last_clean":"2024-09-19T15:27:27.370254+0000","last_became_active":"2024-09-19T13:40:34.249719+0000","last_became_peered":"2024-09-19T13:40:34.249719+0000","last_unstale":"2024-09-19T15:27:27.370254+0000","last_undegraded":"2024-09-19T15:27:27.370254+0000","last_fullsized":"2024-09-19T15:27:27.370254+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:25:54.224688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27268747,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":624,"num_read_kb":108324,"num_write":1235,"num_write_kb":34137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"37'3","reported_seq":998,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.121055+0000","last_change":"2024-09-19T13:40:38.246559+0000","last_active":"2024-09-19T15:31:13.121055+0000","last_peered":"2024-09-19T15:31:13.121055+0000","last_clean":"2024-09-19T15:31:13.121055+0000","last_became_active":"2024-09-19T13:40:38.245835+0000","last_became_peered":"2024-09-19T13:40:38.245835+0000","last_unstale":"2024-09-19T15:31:13.121055+0000","last_undegraded":"2024-09-19T15:31:13.121055+0000","last_fullsized":"2024-09-19T15:31:13.121055+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:31:52.188595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":718,"num_read_kb":716,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'382","reported_seq":1032,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.925493+0000","last_change":"2024-09-19T13:40:40.238081+0000","last_active":"2024-09-19T15:31:17.925493+0000","last_peered":"2024-09-19T15:31:17.925493+0000","last_clean":"2024-09-19T15:31:17.925493+0000","last_became_active":"2024-09-19T13:40:40.237537+0000","last_became_peered":"2024-09-19T13:40:40.237537+0000","last_unstale":"2024-09-19T15:31:17.925493+0000","last_undegraded":"2024-09-19T15:31:17.925493+0000","last_fullsized":"2024-09-19T15:31:17.925493+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:45.292548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58124,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":640,"num_read_kb":1140,"num_write":530,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381450+0000","last_change":"2024-09-19T13:40:42.252696+0000","last_active":"2024-09-19T15:28:12.381450+0000","last_peered":"2024-09-19T15:28:12.381450+0000","last_clean":"2024-09-19T15:28:12.381450+0000","last_became_active":"2024-09-19T13:40:42.251896+0000","last_became_peered":"2024-09-19T13:40:42.251896+0000","last_unstale":"2024-09-19T15:28:12.381450+0000","last_undegraded":"2024-09-19T15:28:12.381450+0000","last_fullsized":"2024-09-19T15:28:12.381450+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:38.583676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'201","reported_seq":1087,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:43.276093+0000","last_change":"2024-09-19T13:40:44.269379+0000","last_active":"2024-09-19T15:29:43.276093+0000","last_peered":"2024-09-19T15:29:43.276093+0000","last_clean":"2024-09-19T15:29:43.276093+0000","last_became_active":"2024-09-19T13:40:44.268710+0000","last_became_peered":"2024-09-19T13:40:44.268710+0000","last_unstale":"2024-09-19T15:29:43.276093+0000","last_undegraded":"2024-09-19T15:29:43.276093+0000","last_fullsized":"2024-09-19T15:29:43.276093+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:25.122775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":655,"num_read_kb":652,"num_write":565,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'581","reported_seq":2263,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:49.326176+0000","last_change":"2024-09-19T13:40:36.218790+0000","last_active":"2024-09-19T15:28:49.326176+0000","last_peered":"2024-09-19T15:28:49.326176+0000","last_clean":"2024-09-19T15:28:49.326176+0000","last_became_active":"2024-09-19T13:40:36.217961+0000","last_became_peered":"2024-09-19T13:40:36.217961+0000","last_unstale":"2024-09-19T15:28:49.326176+0000","last_undegraded":"2024-09-19T15:28:49.326176+0000","last_fullsized":"2024-09-19T15:28:49.326176+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:06.866384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2994,"num_read_kb":2751,"num_write":739,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'286","reported_seq":1084,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.600035+0000","last_change":"2024-09-19T13:40:34.254466+0000","last_active":"2024-09-19T15:28:07.600035+0000","last_peered":"2024-09-19T15:28:07.600035+0000","last_clean":"2024-09-19T15:28:07.600035+0000","last_became_active":"2024-09-19T13:40:34.253708+0000","last_became_peered":"2024-09-19T13:40:34.253708+0000","last_unstale":"2024-09-19T15:28:07.600035+0000","last_undegraded":"2024-09-19T15:28:07.600035+0000","last_fullsized":"2024-09-19T15:28:07.600035+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:37:08.846663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11538842,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":683,"num_read_kb":54804,"num_write":1014,"num_write_kb":28785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.601276+0000","last_change":"2024-09-19T13:40:38.245697+0000","last_active":"2024-09-19T15:28:12.601276+0000","last_peered":"2024-09-19T15:28:12.601276+0000","last_clean":"2024-09-19T15:28:12.601276+0000","last_became_active":"2024-09-19T13:40:38.245018+0000","last_became_peered":"2024-09-19T13:40:38.245018+0000","last_unstale":"2024-09-19T15:28:12.601276+0000","last_undegraded":"2024-09-19T15:28:12.601276+0000","last_fullsized":"2024-09-19T15:28:12.601276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:48.463235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'344","reported_seq":978,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.287171+0000","last_change":"2024-09-19T13:40:40.234381+0000","last_active":"2024-09-19T15:31:18.287171+0000","last_peered":"2024-09-19T15:31:18.287171+0000","last_clean":"2024-09-19T15:31:18.287171+0000","last_became_active":"2024-09-19T13:40:40.229201+0000","last_became_peered":"2024-09-19T13:40:40.229201+0000","last_unstale":"2024-09-19T15:31:18.287171+0000","last_undegraded":"2024-09-19T15:31:18.287171+0000","last_fullsized":"2024-09-19T15:31:18.287171+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:53.097533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54800,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":554,"num_read_kb":1032,"num_write":448,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.395355+0000","last_change":"2024-09-19T13:40:42.247045+0000","last_active":"2024-09-19T15:29:12.395355+0000","last_peered":"2024-09-19T15:29:12.395355+0000","last_clean":"2024-09-19T15:29:12.395355+0000","last_became_active":"2024-09-19T13:40:42.246286+0000","last_became_peered":"2024-09-19T13:40:42.246286+0000","last_unstale":"2024-09-19T15:29:12.395355+0000","last_undegraded":"2024-09-19T15:29:12.395355+0000","last_fullsized":"2024-09-19T15:29:12.395355+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:20:14.165507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'161","reported_seq":725,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.256170+0000","last_change":"2024-09-19T13:40:44.270342+0000","last_active":"2024-09-19T15:31:13.256170+0000","last_peered":"2024-09-19T15:31:13.256170+0000","last_clean":"2024-09-19T15:31:13.256170+0000","last_became_active":"2024-09-19T13:40:44.267428+0000","last_became_peered":"2024-09-19T13:40:44.267428+0000","last_unstale":"2024-09-19T15:31:13.256170+0000","last_undegraded":"2024-09-19T15:31:13.256170+0000","last_fullsized":"2024-09-19T15:31:13.256170+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:14.956268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":325,"num_read_kb":284,"num_write":406,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'372","reported_seq":2097,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.308591+0000","last_change":"2024-09-19T13:40:36.231144+0000","last_active":"2024-09-19T15:29:41.308591+0000","last_peered":"2024-09-19T15:29:41.308591+0000","last_clean":"2024-09-19T15:29:41.308591+0000","last_became_active":"2024-09-19T13:40:36.230842+0000","last_became_peered":"2024-09-19T13:40:36.230842+0000","last_unstale":"2024-09-19T15:29:41.308591+0000","last_undegraded":"2024-09-19T15:29:41.308591+0000","last_fullsized":"2024-09-19T15:29:41.308591+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:13.952447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2340,"num_read_kb":2286,"num_write":408,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'326","reported_seq":1108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.178946+0000","last_change":"2024-09-19T13:41:05.307783+0000","last_active":"2024-09-19T15:28:07.178946+0000","last_peered":"2024-09-19T15:28:07.178946+0000","last_clean":"2024-09-19T15:28:07.178946+0000","last_became_active":"2024-09-19T13:41:05.307368+0000","last_became_peered":"2024-09-19T13:41:05.307368+0000","last_unstale":"2024-09-19T15:28:07.178946+0000","last_undegraded":"2024-09-19T15:28:07.178946+0000","last_fullsized":"2024-09-19T15:28:07.178946+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:24.705807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16825708,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":933,"num_read_kb":73578,"num_write":1175,"num_write_kb":59214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381473+0000","last_change":"2024-09-19T13:40:38.245965+0000","last_active":"2024-09-19T15:28:12.381473+0000","last_peered":"2024-09-19T15:28:12.381473+0000","last_clean":"2024-09-19T15:28:12.381473+0000","last_became_active":"2024-09-19T13:40:38.245287+0000","last_became_peered":"2024-09-19T13:40:38.245287+0000","last_unstale":"2024-09-19T15:28:12.381473+0000","last_undegraded":"2024-09-19T15:28:12.381473+0000","last_fullsized":"2024-09-19T15:28:12.381473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:07.416511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'172","reported_seq":758,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.249753+0000","last_change":"2024-09-19T13:40:40.247785+0000","last_active":"2024-09-19T15:31:18.249753+0000","last_peered":"2024-09-19T15:31:18.249753+0000","last_clean":"2024-09-19T15:31:18.249753+0000","last_became_active":"2024-09-19T13:40:40.246680+0000","last_became_peered":"2024-09-19T13:40:40.246680+0000","last_unstale":"2024-09-19T15:31:18.249753+0000","last_undegraded":"2024-09-19T15:31:18.249753+0000","last_fullsized":"2024-09-19T15:31:18.249753+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:04.960514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":223,"num_read_kb":217,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'762","reported_seq":2970,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:16.985823+0000","last_change":"2024-09-19T13:40:42.253045+0000","last_active":"2024-09-19T15:31:16.985823+0000","last_peered":"2024-09-19T15:31:16.985823+0000","last_clean":"2024-09-19T15:31:16.985823+0000","last_became_active":"2024-09-19T13:40:42.250436+0000","last_became_peered":"2024-09-19T13:40:42.250436+0000","last_unstale":"2024-09-19T15:31:16.985823+0000","last_undegraded":"2024-09-19T15:31:16.985823+0000","last_fullsized":"2024-09-19T15:31:16.985823+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:00.593974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'100","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:27.673954+0000","last_change":"2024-09-19T13:40:44.269427+0000","last_active":"2024-09-19T15:30:27.673954+0000","last_peered":"2024-09-19T15:30:27.673954+0000","last_clean":"2024-09-19T15:30:27.673954+0000","last_became_active":"2024-09-19T13:40:44.268630+0000","last_became_peered":"2024-09-19T13:40:44.268630+0000","last_unstale":"2024-09-19T15:30:27.673954+0000","last_undegraded":"2024-09-19T15:30:27.673954+0000","last_fullsized":"2024-09-19T15:30:27.673954+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:59.722843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":162,"num_read_kb":149,"num_write":244,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'1161","reported_seq":2729,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:39.716195+0000","last_change":"2024-09-19T13:41:05.321007+0000","last_active":"2024-09-19T15:28:39.716195+0000","last_peered":"2024-09-19T15:28:39.716195+0000","last_clean":"2024-09-19T15:28:39.716195+0000","last_became_active":"2024-09-19T13:41:05.320040+0000","last_became_peered":"2024-09-19T13:41:05.320040+0000","last_unstale":"2024-09-19T15:28:39.716195+0000","last_undegraded":"2024-09-19T15:28:39.716195+0000","last_fullsized":"2024-09-19T15:28:39.716195+0000","mapping_epoch":38,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":1100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:24.769399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5194,"num_read_kb":4574,"num_write":1598,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'310","reported_seq":972,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:34.691501+0000","last_change":"2024-09-19T13:40:34.252303+0000","last_active":"2024-09-19T15:28:34.691501+0000","last_peered":"2024-09-19T15:28:34.691501+0000","last_clean":"2024-09-19T15:28:34.691501+0000","last_became_active":"2024-09-19T13:40:34.251475+0000","last_became_peered":"2024-09-19T13:40:34.251475+0000","last_unstale":"2024-09-19T15:28:34.691501+0000","last_undegraded":"2024-09-19T15:28:34.691501+0000","last_fullsized":"2024-09-19T15:28:34.691501+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:25:30.036187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":651958,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":566,"num_read_kb":3575,"num_write":1084,"num_write_kb":19359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.641848+0000","last_change":"2024-09-19T13:40:38.246925+0000","last_active":"2024-09-19T15:28:12.641848+0000","last_peered":"2024-09-19T15:28:12.641848+0000","last_clean":"2024-09-19T15:28:12.641848+0000","last_became_active":"2024-09-19T13:40:38.246205+0000","last_became_peered":"2024-09-19T13:40:38.246205+0000","last_unstale":"2024-09-19T15:28:12.641848+0000","last_undegraded":"2024-09-19T15:28:12.641848+0000","last_fullsized":"2024-09-19T15:28:12.641848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:54.953146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'378","reported_seq":1034,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.313921+0000","last_change":"2024-09-19T13:40:40.242303+0000","last_active":"2024-09-19T15:31:18.313921+0000","last_peered":"2024-09-19T15:31:18.313921+0000","last_clean":"2024-09-19T15:31:18.313921+0000","last_became_active":"2024-09-19T13:40:40.241730+0000","last_became_peered":"2024-09-19T13:40:40.241730+0000","last_unstale":"2024-09-19T15:31:18.313921+0000","last_undegraded":"2024-09-19T15:31:18.313921+0000","last_fullsized":"2024-09-19T15:31:18.313921+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:27.316298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74538,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":595,"num_read_kb":1098,"num_write":464,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:02.165536+0000","last_change":"2024-09-19T13:40:42.240898+0000","last_active":"2024-09-19T15:27:02.165536+0000","last_peered":"2024-09-19T15:27:02.165536+0000","last_clean":"2024-09-19T15:27:02.165536+0000","last_became_active":"2024-09-19T13:40:42.240191+0000","last_became_peered":"2024-09-19T13:40:42.240191+0000","last_unstale":"2024-09-19T15:27:02.165536+0000","last_undegraded":"2024-09-19T15:27:02.165536+0000","last_fullsized":"2024-09-19T15:27:02.165536+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:00.682593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'128","reported_seq":652,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:49.771957+0000","last_change":"2024-09-19T13:40:44.274954+0000","last_active":"2024-09-19T15:29:49.771957+0000","last_peered":"2024-09-19T15:29:49.771957+0000","last_clean":"2024-09-19T15:29:49.771957+0000","last_became_active":"2024-09-19T13:40:44.274449+0000","last_became_peered":"2024-09-19T13:40:44.274449+0000","last_unstale":"2024-09-19T15:29:49.771957+0000","last_undegraded":"2024-09-19T15:29:49.771957+0000","last_fullsized":"2024-09-19T15:29:49.771957+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:28.625729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":153,"num_write":303,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'796","reported_seq":2343,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.600083+0000","last_change":"2024-09-19T13:40:36.231742+0000","last_active":"2024-09-19T15:28:07.600083+0000","last_peered":"2024-09-19T15:28:07.600083+0000","last_clean":"2024-09-19T15:28:07.600083+0000","last_became_active":"2024-09-19T13:40:36.227359+0000","last_became_peered":"2024-09-19T13:40:36.227359+0000","last_unstale":"2024-09-19T15:28:07.600083+0000","last_undegraded":"2024-09-19T15:28:07.600083+0000","last_fullsized":"2024-09-19T15:28:07.600083+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:05:00.421649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3854,"num_read_kb":3454,"num_write":1058,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'352","reported_seq":1109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.619557+0000","last_change":"2024-09-19T13:41:05.314078+0000","last_active":"2024-09-19T15:28:07.619557+0000","last_peered":"2024-09-19T15:28:07.619557+0000","last_clean":"2024-09-19T15:28:07.619557+0000","last_became_active":"2024-09-19T13:41:05.313209+0000","last_became_peered":"2024-09-19T13:41:05.313209+0000","last_unstale":"2024-09-19T15:28:07.619557+0000","last_undegraded":"2024-09-19T15:28:07.619557+0000","last_fullsized":"2024-09-19T15:28:07.619557+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:11.443410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6789559,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":704,"num_read_kb":102227,"num_write":1351,"num_write_kb":49987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.620697+0000","last_change":"2024-09-19T13:40:38.230747+0000","last_active":"2024-09-19T15:28:12.620697+0000","last_peered":"2024-09-19T15:28:12.620697+0000","last_clean":"2024-09-19T15:28:12.620697+0000","last_became_active":"2024-09-19T13:40:38.229929+0000","last_became_peered":"2024-09-19T13:40:38.229929+0000","last_unstale":"2024-09-19T15:28:12.620697+0000","last_undegraded":"2024-09-19T15:28:12.620697+0000","last_fullsized":"2024-09-19T15:28:12.620697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:58:25.811713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'297","reported_seq":903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.130777+0000","last_change":"2024-09-19T13:40:40.241834+0000","last_active":"2024-09-19T15:31:17.130777+0000","last_peered":"2024-09-19T15:31:17.130777+0000","last_clean":"2024-09-19T15:31:17.130777+0000","last_became_active":"2024-09-19T13:40:40.241404+0000","last_became_peered":"2024-09-19T13:40:40.241404+0000","last_unstale":"2024-09-19T15:31:17.130777+0000","last_undegraded":"2024-09-19T15:31:17.130777+0000","last_fullsized":"2024-09-19T15:31:17.130777+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:41.176371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52682,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":954,"num_write":388,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:27.572162+0000","last_change":"2024-09-19T13:40:42.254516+0000","last_active":"2024-09-19T15:27:27.572162+0000","last_peered":"2024-09-19T15:27:27.572162+0000","last_clean":"2024-09-19T15:27:27.572162+0000","last_became_active":"2024-09-19T13:40:42.251413+0000","last_became_peered":"2024-09-19T13:40:42.251413+0000","last_unstale":"2024-09-19T15:27:27.572162+0000","last_undegraded":"2024-09-19T15:27:27.572162+0000","last_fullsized":"2024-09-19T15:27:27.572162+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:44:42.558167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'161","reported_seq":716,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.091208+0000","last_change":"2024-09-19T13:40:44.278568+0000","last_active":"2024-09-19T15:29:50.091208+0000","last_peered":"2024-09-19T15:29:50.091208+0000","last_clean":"2024-09-19T15:29:50.091208+0000","last_became_active":"2024-09-19T13:40:44.277774+0000","last_became_peered":"2024-09-19T13:40:44.277774+0000","last_unstale":"2024-09-19T15:29:50.091208+0000","last_undegraded":"2024-09-19T15:29:50.091208+0000","last_fullsized":"2024-09-19T15:29:50.091208+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:30.389728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":980,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216,"num_read_kb":207,"num_write":371,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'464","reported_seq":2234,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.261421+0000","last_change":"2024-09-19T13:40:36.223086+0000","last_active":"2024-09-19T15:31:12.261421+0000","last_peered":"2024-09-19T15:31:12.261421+0000","last_clean":"2024-09-19T15:31:12.261421+0000","last_became_active":"2024-09-19T13:40:36.222632+0000","last_became_peered":"2024-09-19T13:40:36.222632+0000","last_unstale":"2024-09-19T15:31:12.261421+0000","last_undegraded":"2024-09-19T15:31:12.261421+0000","last_fullsized":"2024-09-19T15:31:12.261421+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:02.744559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2809,"num_read_kb":2663,"num_write":534,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'322","reported_seq":1024,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:48.241025+0000","last_change":"2024-09-19T13:40:34.258460+0000","last_active":"2024-09-19T15:28:48.241025+0000","last_peered":"2024-09-19T15:28:48.241025+0000","last_clean":"2024-09-19T15:28:48.241025+0000","last_became_active":"2024-09-19T13:40:34.258068+0000","last_became_peered":"2024-09-19T13:40:34.258068+0000","last_unstale":"2024-09-19T15:28:48.241025+0000","last_undegraded":"2024-09-19T15:28:48.241025+0000","last_fullsized":"2024-09-19T15:28:48.241025+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:06:27.239604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16694649,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":691,"num_read_kb":11973,"num_write":1120,"num_write_kb":32337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:02.584884+0000","last_change":"2024-09-19T13:40:38.240655+0000","last_active":"2024-09-19T15:27:02.584884+0000","last_peered":"2024-09-19T15:27:02.584884+0000","last_clean":"2024-09-19T15:27:02.584884+0000","last_became_active":"2024-09-19T13:40:38.236724+0000","last_became_peered":"2024-09-19T13:40:38.236724+0000","last_unstale":"2024-09-19T15:27:02.584884+0000","last_undegraded":"2024-09-19T15:27:02.584884+0000","last_fullsized":"2024-09-19T15:27:02.584884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:37:16.998791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'271","reported_seq":860,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.600944+0000","last_change":"2024-09-19T13:40:40.223389+0000","last_active":"2024-09-19T15:31:17.600944+0000","last_peered":"2024-09-19T15:31:17.600944+0000","last_clean":"2024-09-19T15:31:17.600944+0000","last_became_active":"2024-09-19T13:40:40.222807+0000","last_became_peered":"2024-09-19T13:40:40.222807+0000","last_unstale":"2024-09-19T15:31:17.600944+0000","last_undegraded":"2024-09-19T15:31:17.600944+0000","last_fullsized":"2024-09-19T15:31:17.600944+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:53.228422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60899,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":460,"num_read_kb":996,"num_write":388,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.601222+0000","last_change":"2024-09-19T13:40:42.251870+0000","last_active":"2024-09-19T15:28:12.601222+0000","last_peered":"2024-09-19T15:28:12.601222+0000","last_clean":"2024-09-19T15:28:12.601222+0000","last_became_active":"2024-09-19T13:40:42.251057+0000","last_became_peered":"2024-09-19T13:40:42.251057+0000","last_unstale":"2024-09-19T15:28:12.601222+0000","last_undegraded":"2024-09-19T15:28:12.601222+0000","last_fullsized":"2024-09-19T15:28:12.601222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:37.359054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'143","reported_seq":1274,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:42.301571+0000","last_change":"2024-09-19T13:40:44.271381+0000","last_active":"2024-09-19T15:29:42.301571+0000","last_peered":"2024-09-19T15:29:42.301571+0000","last_clean":"2024-09-19T15:29:42.301571+0000","last_became_active":"2024-09-19T13:40:44.270656+0000","last_became_peered":"2024-09-19T13:40:44.270656+0000","last_unstale":"2024-09-19T15:29:42.301571+0000","last_undegraded":"2024-09-19T15:29:42.301571+0000","last_fullsized":"2024-09-19T15:29:42.301571+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:12:45.652710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":816,"num_read_kb":810,"num_write":350,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'465","reported_seq":1994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:39.716302+0000","last_change":"2024-09-19T13:40:36.218077+0000","last_active":"2024-09-19T15:28:39.716302+0000","last_peered":"2024-09-19T15:28:39.716302+0000","last_clean":"2024-09-19T15:28:39.716302+0000","last_became_active":"2024-09-19T13:40:36.217230+0000","last_became_peered":"2024-09-19T13:40:36.217230+0000","last_unstale":"2024-09-19T15:28:39.716302+0000","last_undegraded":"2024-09-19T15:28:39.716302+0000","last_fullsized":"2024-09-19T15:28:39.716302+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:27.690091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2437,"num_read_kb":2267,"num_write":569,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'269","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.190467+0000","last_change":"2024-09-19T13:40:34.258755+0000","last_active":"2024-09-19T15:28:57.190467+0000","last_peered":"2024-09-19T15:28:57.190467+0000","last_clean":"2024-09-19T15:28:57.190467+0000","last_became_active":"2024-09-19T13:40:34.258416+0000","last_became_peered":"2024-09-19T13:40:34.258416+0000","last_unstale":"2024-09-19T15:28:57.190467+0000","last_undegraded":"2024-09-19T15:28:57.190467+0000","last_fullsized":"2024-09-19T15:28:57.190467+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:47.238199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6644580,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":493,"num_read_kb":6695,"num_write":986,"num_write_kb":15020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.371514+0000","last_change":"2024-09-19T13:40:38.217596+0000","last_active":"2024-09-19T15:27:32.371514+0000","last_peered":"2024-09-19T15:27:32.371514+0000","last_clean":"2024-09-19T15:27:32.371514+0000","last_became_active":"2024-09-19T13:40:38.214571+0000","last_became_peered":"2024-09-19T13:40:38.214571+0000","last_unstale":"2024-09-19T15:27:32.371514+0000","last_undegraded":"2024-09-19T15:27:32.371514+0000","last_fullsized":"2024-09-19T15:27:32.371514+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:52.834683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'345","reported_seq":969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.731527+0000","last_change":"2024-09-19T13:40:40.248984+0000","last_active":"2024-09-19T15:31:17.731527+0000","last_peered":"2024-09-19T15:31:17.731527+0000","last_clean":"2024-09-19T15:31:17.731527+0000","last_became_active":"2024-09-19T13:40:40.245368+0000","last_became_peered":"2024-09-19T13:40:40.245368+0000","last_unstale":"2024-09-19T15:31:17.731527+0000","last_undegraded":"2024-09-19T15:31:17.731527+0000","last_fullsized":"2024-09-19T15:31:17.731527+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:10.651187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57046,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":558,"num_read_kb":1054,"num_write":446,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.180073+0000","last_change":"2024-09-19T13:40:42.240218+0000","last_active":"2024-09-19T15:28:12.180073+0000","last_peered":"2024-09-19T15:28:12.180073+0000","last_clean":"2024-09-19T15:28:12.180073+0000","last_became_active":"2024-09-19T13:40:42.239391+0000","last_became_peered":"2024-09-19T13:40:42.239391+0000","last_unstale":"2024-09-19T15:28:12.180073+0000","last_undegraded":"2024-09-19T15:28:12.180073+0000","last_fullsized":"2024-09-19T15:28:12.180073+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:58.943534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'128","reported_seq":656,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.238755+0000","last_change":"2024-09-19T13:40:44.249845+0000","last_active":"2024-09-19T15:31:12.238755+0000","last_peered":"2024-09-19T15:31:12.238755+0000","last_clean":"2024-09-19T15:31:12.238755+0000","last_became_active":"2024-09-19T13:40:44.249201+0000","last_became_peered":"2024-09-19T13:40:44.249201+0000","last_unstale":"2024-09-19T15:31:12.238755+0000","last_undegraded":"2024-09-19T15:31:12.238755+0000","last_fullsized":"2024-09-19T15:31:12.238755+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:40.297816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":210,"num_read_kb":190,"num_write":320,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'403","reported_seq":2077,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391896+0000","last_change":"2024-09-19T13:40:36.226270+0000","last_active":"2024-09-19T15:28:57.391896+0000","last_peered":"2024-09-19T15:28:57.391896+0000","last_clean":"2024-09-19T15:28:57.391896+0000","last_became_active":"2024-09-19T13:40:36.225885+0000","last_became_peered":"2024-09-19T13:40:36.225885+0000","last_unstale":"2024-09-19T15:28:57.391896+0000","last_undegraded":"2024-09-19T15:28:57.391896+0000","last_fullsized":"2024-09-19T15:28:57.391896+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:53.469735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2307,"num_read_kb":2225,"num_write":450,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'260","reported_seq":893,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.393967+0000","last_change":"2024-09-19T13:40:34.262660+0000","last_active":"2024-09-19T15:28:57.393967+0000","last_peered":"2024-09-19T15:28:57.393967+0000","last_clean":"2024-09-19T15:28:57.393967+0000","last_became_active":"2024-09-19T13:40:34.249068+0000","last_became_peered":"2024-09-19T13:40:34.249068+0000","last_unstale":"2024-09-19T15:28:57.393967+0000","last_undegraded":"2024-09-19T15:28:57.393967+0000","last_fullsized":"2024-09-19T15:28:57.393967+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:53.622353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10494794,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":421,"num_read_kb":27093,"num_write":933,"num_write_kb":27581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"268'459","reported_seq":2102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.313338+0000","last_change":"2024-09-19T13:40:36.222782+0000","last_active":"2024-09-19T15:29:41.313338+0000","last_peered":"2024-09-19T15:29:41.313338+0000","last_clean":"2024-09-19T15:29:41.313338+0000","last_became_active":"2024-09-19T13:40:36.220569+0000","last_became_peered":"2024-09-19T13:40:36.220569+0000","last_unstale":"2024-09-19T15:29:41.313338+0000","last_undegraded":"2024-09-19T15:29:41.313338+0000","last_fullsized":"2024-09-19T15:29:41.313338+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:10:08.215249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2535,"num_read_kb":2389,"num_write":539,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"268'352","reported_seq":1068,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.556612+0000","last_change":"2024-09-19T13:40:34.239840+0000","last_active":"2024-09-19T15:28:57.556612+0000","last_peered":"2024-09-19T15:28:57.556612+0000","last_clean":"2024-09-19T15:28:57.556612+0000","last_became_active":"2024-09-19T13:40:34.239357+0000","last_became_peered":"2024-09-19T13:40:34.239357+0000","last_unstale":"2024-09-19T15:28:57.556612+0000","last_undegraded":"2024-09-19T15:28:57.556612+0000","last_fullsized":"2024-09-19T15:28:57.556612+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:11:55.800088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34624490,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":723,"num_read_kb":92888,"num_write":1339,"num_write_kb":63384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'594","reported_seq":2305,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.631054+0000","last_change":"2024-09-19T13:40:36.242232+0000","last_active":"2024-09-19T15:28:57.631054+0000","last_peered":"2024-09-19T15:28:57.631054+0000","last_clean":"2024-09-19T15:28:57.631054+0000","last_became_active":"2024-09-19T13:40:36.241566+0000","last_became_peered":"2024-09-19T13:40:36.241566+0000","last_unstale":"2024-09-19T15:28:57.631054+0000","last_undegraded":"2024-09-19T15:28:57.631054+0000","last_fullsized":"2024-09-19T15:28:57.631054+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":500,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:03.964274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3019,"num_read_kb":2776,"num_write":751,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'304","reported_seq":985,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.630953+0000","last_change":"2024-09-19T13:40:34.227009+0000","last_active":"2024-09-19T15:28:57.630953+0000","last_peered":"2024-09-19T15:28:57.630953+0000","last_clean":"2024-09-19T15:28:57.630953+0000","last_became_active":"2024-09-19T13:40:34.221057+0000","last_became_peered":"2024-09-19T13:40:34.221057+0000","last_unstale":"2024-09-19T15:28:57.630953+0000","last_undegraded":"2024-09-19T15:28:57.630953+0000","last_fullsized":"2024-09-19T15:28:57.630953+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:25:54.224688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339543,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":614,"num_read_kb":11742,"num_write":1076,"num_write_kb":23593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'495","reported_seq":2263,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.311749+0000","last_change":"2024-09-19T13:40:36.238558+0000","last_active":"2024-09-19T15:29:41.311749+0000","last_peered":"2024-09-19T15:29:41.311749+0000","last_clean":"2024-09-19T15:29:41.311749+0000","last_became_active":"2024-09-19T13:40:36.238166+0000","last_became_peered":"2024-09-19T13:40:36.238166+0000","last_unstale":"2024-09-19T15:29:41.311749+0000","last_undegraded":"2024-09-19T15:29:41.311749+0000","last_fullsized":"2024-09-19T15:29:41.311749+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:30:49.066869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2902,"num_read_kb":2744,"num_write":591,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'279","reported_seq":993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:32.198770+0000","last_change":"2024-09-19T13:40:34.232529+0000","last_active":"2024-09-19T15:29:32.198770+0000","last_peered":"2024-09-19T15:29:32.198770+0000","last_clean":"2024-09-19T15:29:32.198770+0000","last_became_active":"2024-09-19T13:40:34.232099+0000","last_became_peered":"2024-09-19T13:40:34.232099+0000","last_unstale":"2024-09-19T15:29:32.198770+0000","last_undegraded":"2024-09-19T15:29:32.198770+0000","last_fullsized":"2024-09-19T15:29:32.198770+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:31.553740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7201098,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":692,"num_read_kb":12572,"num_write":969,"num_write_kb":46357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"268'463","reported_seq":2045,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:08.245703+0000","last_change":"2024-09-19T13:40:36.239180+0000","last_active":"2024-09-19T15:29:08.245703+0000","last_peered":"2024-09-19T15:29:08.245703+0000","last_clean":"2024-09-19T15:29:08.245703+0000","last_became_active":"2024-09-19T13:40:36.238644+0000","last_became_peered":"2024-09-19T13:40:36.238644+0000","last_unstale":"2024-09-19T15:29:08.245703+0000","last_undegraded":"2024-09-19T15:29:08.245703+0000","last_fullsized":"2024-09-19T15:29:08.245703+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:20.371624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2315,"num_read_kb":2185,"num_write":554,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'335","reported_seq":1047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:58.243409+0000","last_change":"2024-09-19T13:40:34.249999+0000","last_active":"2024-09-19T15:28:58.243409+0000","last_peered":"2024-09-19T15:28:58.243409+0000","last_clean":"2024-09-19T15:28:58.243409+0000","last_became_active":"2024-09-19T13:40:34.249600+0000","last_became_peered":"2024-09-19T13:40:34.249600+0000","last_unstale":"2024-09-19T15:28:58.243409+0000","last_undegraded":"2024-09-19T15:28:58.243409+0000","last_fullsized":"2024-09-19T15:28:58.243409+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:21.988391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18897188,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":652,"num_read_kb":53970,"num_write":1297,"num_write_kb":53250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'832","reported_seq":2486,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.611644+0000","last_change":"2024-09-19T13:40:36.217498+0000","last_active":"2024-09-19T15:28:57.611644+0000","last_peered":"2024-09-19T15:28:57.611644+0000","last_clean":"2024-09-19T15:28:57.611644+0000","last_became_active":"2024-09-19T13:40:36.216697+0000","last_became_peered":"2024-09-19T13:40:36.216697+0000","last_unstale":"2024-09-19T15:28:57.611644+0000","last_undegraded":"2024-09-19T15:28:57.611644+0000","last_fullsized":"2024-09-19T15:28:57.611644+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:18:43.576589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4198,"num_read_kb":3766,"num_write":1106,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'259","reported_seq":955,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:26.073871+0000","last_change":"2024-09-19T13:40:34.217279+0000","last_active":"2024-09-19T15:29:26.073871+0000","last_peered":"2024-09-19T15:29:26.073871+0000","last_clean":"2024-09-19T15:29:26.073871+0000","last_became_active":"2024-09-19T13:40:34.216774+0000","last_became_peered":"2024-09-19T13:40:34.216774+0000","last_unstale":"2024-09-19T15:29:26.073871+0000","last_undegraded":"2024-09-19T15:29:26.073871+0000","last_fullsized":"2024-09-19T15:29:26.073871+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:06.986984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14304161,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":580,"num_read_kb":47831,"num_write":910,"num_write_kb":20035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'563","reported_seq":2253,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.655516+0000","last_change":"2024-09-19T13:40:36.220200+0000","last_active":"2024-09-19T15:29:50.655516+0000","last_peered":"2024-09-19T15:29:50.655516+0000","last_clean":"2024-09-19T15:29:50.655516+0000","last_became_active":"2024-09-19T13:40:36.218090+0000","last_became_peered":"2024-09-19T13:40:36.218090+0000","last_unstale":"2024-09-19T15:29:50.655516+0000","last_undegraded":"2024-09-19T15:29:50.655516+0000","last_fullsized":"2024-09-19T15:29:50.655516+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:34:01.490693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2933,"num_read_kb":2699,"num_write":698,"num_write_kb":201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'285","reported_seq":1066,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.394246+0000","last_change":"2024-09-19T13:40:34.273323+0000","last_active":"2024-09-19T15:28:57.394246+0000","last_peered":"2024-09-19T15:28:57.394246+0000","last_clean":"2024-09-19T15:28:57.394246+0000","last_became_active":"2024-09-19T13:40:34.272629+0000","last_became_peered":"2024-09-19T13:40:34.272629+0000","last_unstale":"2024-09-19T15:28:57.394246+0000","last_undegraded":"2024-09-19T15:28:57.394246+0000","last_fullsized":"2024-09-19T15:28:57.394246+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:34.984552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7211816,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":866,"num_read_kb":42229,"num_write":1130,"num_write_kb":17971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'338","reported_seq":1780,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.312852+0000","last_change":"2024-09-19T13:40:36.225078+0000","last_active":"2024-09-19T15:29:41.312852+0000","last_peered":"2024-09-19T15:29:41.312852+0000","last_clean":"2024-09-19T15:29:41.312852+0000","last_became_active":"2024-09-19T13:40:36.224228+0000","last_became_peered":"2024-09-19T13:40:36.224228+0000","last_unstale":"2024-09-19T15:29:41.312852+0000","last_undegraded":"2024-09-19T15:29:41.312852+0000","last_fullsized":"2024-09-19T15:29:41.312852+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:01.743464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1855,"num_read_kb":1782,"num_write":368,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'316","reported_seq":1072,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:58.243579+0000","last_change":"2024-09-19T13:40:34.245539+0000","last_active":"2024-09-19T15:28:58.243579+0000","last_peered":"2024-09-19T15:28:58.243579+0000","last_clean":"2024-09-19T15:28:58.243579+0000","last_became_active":"2024-09-19T13:40:34.245197+0000","last_became_peered":"2024-09-19T13:40:34.245197+0000","last_unstale":"2024-09-19T15:28:58.243579+0000","last_undegraded":"2024-09-19T15:28:58.243579+0000","last_fullsized":"2024-09-19T15:28:58.243579+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:24:09.091484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13009608,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":681,"num_read_kb":129992,"num_write":1154,"num_write_kb":46426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"268'494","reported_seq":2038,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.313857+0000","last_change":"2024-09-19T13:40:36.227530+0000","last_active":"2024-09-19T15:29:41.313857+0000","last_peered":"2024-09-19T15:29:41.313857+0000","last_clean":"2024-09-19T15:29:41.313857+0000","last_became_active":"2024-09-19T13:40:36.226839+0000","last_became_peered":"2024-09-19T13:40:36.226839+0000","last_unstale":"2024-09-19T15:29:41.313857+0000","last_undegraded":"2024-09-19T15:29:41.313857+0000","last_fullsized":"2024-09-19T15:29:41.313857+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:28.265909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2632,"num_read_kb":2421,"num_write":626,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'288","reported_seq":1104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:22.636764+0000","last_change":"2024-09-19T13:40:34.229368+0000","last_active":"2024-09-19T15:29:22.636764+0000","last_peered":"2024-09-19T15:29:22.636764+0000","last_clean":"2024-09-19T15:29:22.636764+0000","last_became_active":"2024-09-19T13:40:34.228472+0000","last_became_peered":"2024-09-19T13:40:34.228472+0000","last_unstale":"2024-09-19T15:29:22.636764+0000","last_undegraded":"2024-09-19T15:29:22.636764+0000","last_fullsized":"2024-09-19T15:29:22.636764+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:51.349525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13958374,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":1059,"num_read_kb":37188,"num_write":1152,"num_write_kb":31649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'800","reported_seq":2500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.280835+0000","last_change":"2024-09-19T13:40:36.219439+0000","last_active":"2024-09-19T15:31:12.280835+0000","last_peered":"2024-09-19T15:31:12.280835+0000","last_clean":"2024-09-19T15:31:12.280835+0000","last_became_active":"2024-09-19T13:40:36.217870+0000","last_became_peered":"2024-09-19T13:40:36.217870+0000","last_unstale":"2024-09-19T15:31:12.280835+0000","last_undegraded":"2024-09-19T15:31:12.280835+0000","last_fullsized":"2024-09-19T15:31:12.280835+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:00:58.023208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3954,"num_read_kb":3588,"num_write":1044,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'246","reported_seq":938,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:07.558639+0000","last_change":"2024-09-19T13:41:05.311322+0000","last_active":"2024-09-19T15:29:07.558639+0000","last_peered":"2024-09-19T15:29:07.558639+0000","last_clean":"2024-09-19T15:29:07.558639+0000","last_became_active":"2024-09-19T13:41:05.310802+0000","last_became_peered":"2024-09-19T13:41:05.310802+0000","last_unstale":"2024-09-19T15:29:07.558639+0000","last_undegraded":"2024-09-19T15:29:07.558639+0000","last_fullsized":"2024-09-19T15:29:07.558639+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:42.603416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6381131,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":695,"num_read_kb":21770,"num_write":907,"num_write_kb":19448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"268'360","reported_seq":1959,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.653018+0000","last_change":"2024-09-19T13:40:36.216178+0000","last_active":"2024-09-19T15:29:50.653018+0000","last_peered":"2024-09-19T15:29:50.653018+0000","last_clean":"2024-09-19T15:29:50.653018+0000","last_became_active":"2024-09-19T13:40:36.215821+0000","last_became_peered":"2024-09-19T13:40:36.215821+0000","last_unstale":"2024-09-19T15:29:50.653018+0000","last_undegraded":"2024-09-19T15:29:50.653018+0000","last_fullsized":"2024-09-19T15:29:50.653018+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:38:26.917147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2112,"num_read_kb":2049,"num_write":394,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'393","reported_seq":1128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.626248+0000","last_change":"2024-09-19T13:40:34.262686+0000","last_active":"2024-09-19T15:28:37.626248+0000","last_peered":"2024-09-19T15:28:37.626248+0000","last_clean":"2024-09-19T15:28:37.626248+0000","last_became_active":"2024-09-19T13:40:34.261812+0000","last_became_peered":"2024-09-19T13:40:34.261812+0000","last_unstale":"2024-09-19T15:28:37.626248+0000","last_undegraded":"2024-09-19T15:28:37.626248+0000","last_fullsized":"2024-09-19T15:28:37.626248+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:29.120216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8078291,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":878,"num_read_kb":21060,"num_write":1181,"num_write_kb":41159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'746","reported_seq":2331,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.606887+0000","last_change":"2024-09-19T13:40:36.217355+0000","last_active":"2024-09-19T15:28:37.606887+0000","last_peered":"2024-09-19T15:28:37.606887+0000","last_clean":"2024-09-19T15:28:37.606887+0000","last_became_active":"2024-09-19T13:40:36.216597+0000","last_became_peered":"2024-09-19T13:40:36.216597+0000","last_unstale":"2024-09-19T15:28:37.606887+0000","last_undegraded":"2024-09-19T15:28:37.606887+0000","last_fullsized":"2024-09-19T15:28:37.606887+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:59:18.319568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3535,"num_read_kb":3206,"num_write":942,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'313","reported_seq":1020,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.185593+0000","last_change":"2024-09-19T13:40:34.255731+0000","last_active":"2024-09-19T15:28:37.185593+0000","last_peered":"2024-09-19T15:28:37.185593+0000","last_clean":"2024-09-19T15:28:37.185593+0000","last_became_active":"2024-09-19T13:40:34.255374+0000","last_became_peered":"2024-09-19T13:40:34.255374+0000","last_unstale":"2024-09-19T15:28:37.185593+0000","last_undegraded":"2024-09-19T15:28:37.185593+0000","last_fullsized":"2024-09-19T15:28:37.185593+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:19:13.519227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22345661,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":596,"num_read_kb":82609,"num_write":1139,"num_write_kb":54973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'1055","reported_seq":2691,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.652822+0000","last_change":"2024-09-19T13:40:36.239660+0000","last_active":"2024-09-19T15:29:50.652822+0000","last_peered":"2024-09-19T15:29:50.652822+0000","last_clean":"2024-09-19T15:29:50.652822+0000","last_became_active":"2024-09-19T13:40:36.238907+0000","last_became_peered":"2024-09-19T13:40:36.238907+0000","last_unstale":"2024-09-19T15:29:50.652822+0000","last_undegraded":"2024-09-19T15:29:50.652822+0000","last_fullsized":"2024-09-19T15:29:50.652822+0000","mapping_epoch":27,"log_start":"268'1000","ondisk_log_start":"268'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1000,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:58:06.626307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5049,"num_read_kb":4427,"num_write":1568,"num_write_kb":756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'357","reported_seq":1034,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.389587+0000","last_change":"2024-09-19T13:40:34.273536+0000","last_active":"2024-09-19T15:28:37.389587+0000","last_peered":"2024-09-19T15:28:37.389587+0000","last_clean":"2024-09-19T15:28:37.389587+0000","last_became_active":"2024-09-19T13:40:34.272618+0000","last_became_peered":"2024-09-19T13:40:34.272618+0000","last_unstale":"2024-09-19T15:28:37.389587+0000","last_undegraded":"2024-09-19T15:28:37.389587+0000","last_fullsized":"2024-09-19T15:28:37.389587+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:56:58.613614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6343085,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":725,"num_read_kb":25154,"num_write":1290,"num_write_kb":33238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'500","reported_seq":2189,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.257325+0000","last_change":"2024-09-19T13:40:36.227186+0000","last_active":"2024-09-19T15:31:12.257325+0000","last_peered":"2024-09-19T15:31:12.257325+0000","last_clean":"2024-09-19T15:31:12.257325+0000","last_became_active":"2024-09-19T13:40:36.226572+0000","last_became_peered":"2024-09-19T13:40:36.226572+0000","last_unstale":"2024-09-19T15:31:12.257325+0000","last_undegraded":"2024-09-19T15:31:12.257325+0000","last_fullsized":"2024-09-19T15:31:12.257325+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:15.302809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2633,"num_read_kb":2478,"num_write":570,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'373","reported_seq":1128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.654080+0000","last_change":"2024-09-19T13:40:34.276063+0000","last_active":"2024-09-19T15:29:02.654080+0000","last_peered":"2024-09-19T15:29:02.654080+0000","last_clean":"2024-09-19T15:29:02.654080+0000","last_became_active":"2024-09-19T13:40:34.274523+0000","last_became_peered":"2024-09-19T13:40:34.274523+0000","last_unstale":"2024-09-19T15:29:02.654080+0000","last_undegraded":"2024-09-19T15:29:02.654080+0000","last_fullsized":"2024-09-19T15:29:02.654080+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:32.241517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31527398,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":810,"num_read_kb":117453,"num_write":1286,"num_write_kb":54900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"268'906","reported_seq":2407,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.374609+0000","last_change":"2024-09-19T13:40:36.221889+0000","last_active":"2024-09-19T15:29:48.374609+0000","last_peered":"2024-09-19T15:29:48.374609+0000","last_clean":"2024-09-19T15:29:48.374609+0000","last_became_active":"2024-09-19T13:40:36.219017+0000","last_became_peered":"2024-09-19T13:40:36.219017+0000","last_unstale":"2024-09-19T15:29:48.374609+0000","last_undegraded":"2024-09-19T15:29:48.374609+0000","last_fullsized":"2024-09-19T15:29:48.374609+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":800,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:53.854378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5981,"num_read_kb":5463,"num_write":1432,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'285","reported_seq":962,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.544686+0000","last_change":"2024-09-19T13:40:34.258686+0000","last_active":"2024-09-19T15:27:57.544686+0000","last_peered":"2024-09-19T15:27:57.544686+0000","last_clean":"2024-09-19T15:27:57.544686+0000","last_became_active":"2024-09-19T13:40:34.258251+0000","last_became_peered":"2024-09-19T13:40:34.258251+0000","last_unstale":"2024-09-19T15:27:57.544686+0000","last_undegraded":"2024-09-19T15:27:57.544686+0000","last_fullsized":"2024-09-19T15:27:57.544686+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:47.902849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":650123,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":602,"num_read_kb":8561,"num_write":1115,"num_write_kb":30274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'817","reported_seq":2512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.331001+0000","last_change":"2024-09-19T13:40:36.236629+0000","last_active":"2024-09-19T15:31:12.331001+0000","last_peered":"2024-09-19T15:31:12.331001+0000","last_clean":"2024-09-19T15:31:12.331001+0000","last_became_active":"2024-09-19T13:40:36.234463+0000","last_became_peered":"2024-09-19T13:40:36.234463+0000","last_unstale":"2024-09-19T15:31:12.331001+0000","last_undegraded":"2024-09-19T15:31:12.331001+0000","last_fullsized":"2024-09-19T15:31:12.331001+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:20.810918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4113,"num_read_kb":3717,"num_write":1084,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'272","reported_seq":933,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:03.359481+0000","last_change":"2024-09-19T13:40:34.258670+0000","last_active":"2024-09-19T15:31:03.359481+0000","last_peered":"2024-09-19T15:31:03.359481+0000","last_clean":"2024-09-19T15:31:03.359481+0000","last_became_active":"2024-09-19T13:40:34.257895+0000","last_became_peered":"2024-09-19T13:40:34.257895+0000","last_unstale":"2024-09-19T15:31:03.359481+0000","last_undegraded":"2024-09-19T15:31:03.359481+0000","last_fullsized":"2024-09-19T15:31:03.359481+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:39:05.564293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5892898,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":556,"num_read_kb":2702,"num_write":1030,"num_write_kb":37833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'304","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:01.405523+0000","last_change":"2024-09-19T13:41:05.314325+0000","last_active":"2024-09-19T15:31:01.405523+0000","last_peered":"2024-09-19T15:31:01.405523+0000","last_clean":"2024-09-19T15:31:01.405523+0000","last_became_active":"2024-09-19T13:41:05.313139+0000","last_became_peered":"2024-09-19T13:41:05.313139+0000","last_unstale":"2024-09-19T15:31:01.405523+0000","last_undegraded":"2024-09-19T15:31:01.405523+0000","last_fullsized":"2024-09-19T15:31:01.405523+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:38.914445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5266270,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":575,"num_read_kb":5598,"num_write":1087,"num_write_kb":52319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'584","reported_seq":2285,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.253632+0000","last_change":"2024-09-19T13:40:36.225847+0000","last_active":"2024-09-19T15:31:12.253632+0000","last_peered":"2024-09-19T15:31:12.253632+0000","last_clean":"2024-09-19T15:31:12.253632+0000","last_became_active":"2024-09-19T13:40:36.225131+0000","last_became_peered":"2024-09-19T13:40:36.225131+0000","last_unstale":"2024-09-19T15:31:12.253632+0000","last_undegraded":"2024-09-19T15:31:12.253632+0000","last_fullsized":"2024-09-19T15:31:12.253632+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:19.360510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3409,"num_read_kb":3161,"num_write":806,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'353","reported_seq":1115,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.377100+0000","last_change":"2024-09-19T13:40:34.252937+0000","last_active":"2024-09-19T15:27:57.377100+0000","last_peered":"2024-09-19T15:27:57.377100+0000","last_clean":"2024-09-19T15:27:57.377100+0000","last_became_active":"2024-09-19T13:40:34.252585+0000","last_became_peered":"2024-09-19T13:40:34.252585+0000","last_unstale":"2024-09-19T15:27:57.377100+0000","last_undegraded":"2024-09-19T15:27:57.377100+0000","last_fullsized":"2024-09-19T15:27:57.377100+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:29.120216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11101070,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":1019,"num_read_kb":22295,"num_write":1174,"num_write_kb":33627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'492","reported_seq":2098,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:41.711923+0000","last_change":"2024-09-19T13:40:36.233305+0000","last_active":"2024-09-19T15:27:41.711923+0000","last_peered":"2024-09-19T15:27:41.711923+0000","last_clean":"2024-09-19T15:27:41.711923+0000","last_became_active":"2024-09-19T13:40:36.232695+0000","last_became_peered":"2024-09-19T13:40:36.232695+0000","last_unstale":"2024-09-19T15:27:41.711923+0000","last_undegraded":"2024-09-19T15:27:41.711923+0000","last_fullsized":"2024-09-19T15:27:41.711923+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:37:22.928402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2752,"num_read_kb":2570,"num_write":600,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10865,"num_read_kb":9021,"num_write":3118,"num_write_kb":1011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1008,"ondisk_log_size":1008,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14601,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":16485,"num_read_kb":16147,"num_write":17047,"num_write_kb":4982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":29202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1794,"ondisk_log_size":1794,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":560,"ondisk_log_size":560,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1937016,"num_objects":200,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":20653,"num_read_kb":36694,"num_write":17437,"num_write_kb":12536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3309568,"data_stored":2768730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2006,"ondisk_log_size":2006,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2382,"num_read_kb":2839,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":220859,"num_read_kb":201873,"num_write":56069,"num_write_kb":19197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4108,"ondisk_log_size":4108,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":622395504,"num_objects":4335,"num_object_clones":0,"num_object_copies":13005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4335,"num_whiteouts":0,"num_read":40322,"num_read_kb":2347895,"num_write":68883,"num_write_kb":2178675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":982376448,"data_stored":982376448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4050,"ondisk_log_size":4050,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":84518865,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":126,"num_read_kb":215739,"num_write":141,"num_write_kb":136883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":169041920,"data_stored":169037730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":84518865,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":119,"num_read_kb":195259,"num_write":141,"num_write_kb":136883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":169041920,"data_stored":169037730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543490,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":446112,"kb_used_data":167824,"kb_used_omap":1,"kb_used_meta":278270,"kb_avail":93925728,"statfs":{"total":96636764160,"available":96179945472,"internally_reserved":0,"allocated":171851776,"data_stored":169791032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":284948938},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543485,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":417012,"kb_used_data":165092,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":93954828,"statfs":{"total":96636764160,"available":96209743872,"internally_reserved":0,"allocated":169054208,"data_stored":167070157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":257948102},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543488,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":290804,"kb_used_data":143076,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94081036,"statfs":{"total":96636764160,"available":96338980864,"internally_reserved":0,"allocated":146509824,"data_stored":144406301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543485,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":251284,"kb_used_data":152068,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94120556,"statfs":{"total":96636764160,"available":96379449344,"internally_reserved":0,"allocated":155717632,"data_stored":153772157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543490,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":475420,"kb_used_data":201292,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93896420,"statfs":{"total":96636764160,"available":96149934080,"internally_reserved":0,"allocated":206123008,"data_stored":204084548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":280689095},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543487,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252876,"kb_used_data":159228,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94118964,"statfs":{"total":96636764160,"available":96377819136,"internally_reserved":0,"allocated":163049472,"data_stored":161091191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543486,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310528,"kb_used_data":153072,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94061312,"statfs":{"total":96636764160,"available":96318783488,"internally_reserved":0,"allocated":156745728,"data_stored":154722368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161216965},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543486,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":429100,"kb_used_data":185500,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":93942740,"statfs":{"total":96636764160,"available":96197365760,"internally_reserved":0,"allocated":189952000,"data_stored":187927670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":249428423},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":140603392,"data_stored":140603392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":119525376,"data_stored":119525376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":103538688,"data_stored":103538688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":133615616,"data_stored":133615616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":114589696,"data_stored":114589696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":104255488,"data_stored":104255488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":141369344,"data_stored":141369344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":124878848,"data_stored":124878848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":336653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":382970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":134974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":467412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":78226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":667648,"data_stored":557082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":331776,"data_stored":276237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":643072,"data_stored":535176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32505856,"data_stored":32505856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29360128,"data_stored":29360128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22069248,"data_stored":22068518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12120064,"data_stored":12118699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16826368,"data_stored":16825638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":23654400,"data_stored":23653035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11583488,"data_stored":11582758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":43577344,"data_stored":43575979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38334464,"data_stored":38333099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14729216,"data_stored":14728486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T15:31:41.908 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T15:31:42.279 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:31:42.291 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-19T15:31:42.303 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":3603,"stamp":"2024-09-19T15:31:40.638156+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":793977031,"num_objects":4824,"num_object_clones":0,"num_object_copies":13983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4824,"num_whiteouts":0,"num_read":311889,"num_read_kb":3025534,"num_write":162979,"num_write_kb":2491823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13781,"ondisk_log_size":13781,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2873136,"kb_used_data":1327152,"kb_used_omap":12,"kb_used_meta":1545843,"kb_avail":752101584,"statfs":{"total":773094113280,"available":770152022016,"internally_reserved":0,"allocated":1359003648,"data_stored":1342865424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1582943794},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008748"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.609067+0000","last_change":"2024-09-19T14:29:51.038023+0000","last_active":"2024-09-19T15:27:22.609067+0000","last_peered":"2024-09-19T15:27:22.609067+0000","last_clean":"2024-09-19T15:27:22.609067+0000","last_became_active":"2024-09-19T14:29:51.036952+0000","last_became_peered":"2024-09-19T14:29:51.036952+0000","last_unstale":"2024-09-19T15:27:22.609067+0000","last_undegraded":"2024-09-19T15:27:22.609067+0000","last_fullsized":"2024-09-19T15:27:22.609067+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:10:00.951609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:37.612687+0000","last_change":"2024-09-19T14:02:36.913041+0000","last_active":"2024-09-19T15:27:37.612687+0000","last_peered":"2024-09-19T15:27:37.612687+0000","last_clean":"2024-09-19T15:27:37.612687+0000","last_became_active":"2024-09-19T14:02:36.912307+0000","last_became_peered":"2024-09-19T14:02:36.912307+0000","last_unstale":"2024-09-19T15:27:37.612687+0000","last_undegraded":"2024-09-19T15:27:37.612687+0000","last_fullsized":"2024-09-19T15:27:37.612687+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:18:44.440160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"268'9","reported_seq":81,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:33.223470+0000","last_change":"2024-09-19T14:02:29.740551+0000","last_active":"2024-09-19T15:27:33.223470+0000","last_peered":"2024-09-19T15:27:33.223470+0000","last_clean":"2024-09-19T15:27:33.223470+0000","last_became_active":"2024-09-19T14:02:29.739721+0000","last_became_peered":"2024-09-19T14:02:29.739721+0000","last_unstale":"2024-09-19T15:27:33.223470+0000","last_undegraded":"2024-09-19T15:27:33.223470+0000","last_fullsized":"2024-09-19T15:27:33.223470+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:40.747086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":13312,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'35","reported_seq":168,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.179075+0000","last_change":"2024-09-19T13:56:23.181765+0000","last_active":"2024-09-19T15:28:07.179075+0000","last_peered":"2024-09-19T15:28:07.179075+0000","last_clean":"2024-09-19T15:28:07.179075+0000","last_became_active":"2024-09-19T13:56:23.180176+0000","last_became_peered":"2024-09-19T13:56:23.180176+0000","last_unstale":"2024-09-19T15:28:07.179075+0000","last_undegraded":"2024-09-19T15:28:07.179075+0000","last_fullsized":"2024-09-19T15:28:07.179075+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:39.781109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":165,"num_write":94,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.537242+0000","last_change":"2024-09-19T14:29:51.039282+0000","last_active":"2024-09-19T15:27:22.537242+0000","last_peered":"2024-09-19T15:27:22.537242+0000","last_clean":"2024-09-19T15:27:22.537242+0000","last_became_active":"2024-09-19T14:29:51.038289+0000","last_became_peered":"2024-09-19T14:29:51.038289+0000","last_unstale":"2024-09-19T15:27:22.537242+0000","last_undegraded":"2024-09-19T15:27:22.537242+0000","last_fullsized":"2024-09-19T15:27:22.537242+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:16.350420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'1","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:37.593193+0000","last_change":"2024-09-19T14:02:36.915848+0000","last_active":"2024-09-19T15:27:37.593193+0000","last_peered":"2024-09-19T15:27:37.593193+0000","last_clean":"2024-09-19T15:27:37.593193+0000","last_became_active":"2024-09-19T14:02:36.914769+0000","last_became_peered":"2024-09-19T14:02:36.914769+0000","last_unstale":"2024-09-19T15:27:37.593193+0000","last_undegraded":"2024-09-19T15:27:37.593193+0000","last_fullsized":"2024-09-19T15:27:37.593193+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:22.428331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"268'4","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.371625+0000","last_change":"2024-09-19T14:02:29.748087+0000","last_active":"2024-09-19T15:27:32.371625+0000","last_peered":"2024-09-19T15:27:32.371625+0000","last_clean":"2024-09-19T15:27:32.371625+0000","last_became_active":"2024-09-19T14:02:29.747492+0000","last_became_peered":"2024-09-19T14:02:29.747492+0000","last_unstale":"2024-09-19T15:27:32.371625+0000","last_undegraded":"2024-09-19T15:27:32.371625+0000","last_fullsized":"2024-09-19T15:27:32.371625+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:00.163612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":15360,"num_write":9,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'26","reported_seq":153,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.554031+0000","last_change":"2024-09-19T13:56:23.182940+0000","last_active":"2024-09-19T15:28:42.554031+0000","last_peered":"2024-09-19T15:28:42.554031+0000","last_clean":"2024-09-19T15:28:42.554031+0000","last_became_active":"2024-09-19T13:56:23.173377+0000","last_became_peered":"2024-09-19T13:56:23.173377+0000","last_unstale":"2024-09-19T15:28:42.554031+0000","last_undegraded":"2024-09-19T15:28:42.554031+0000","last_fullsized":"2024-09-19T15:28:42.554031+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:53.676663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":124,"num_write":71,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:52.379379+0000","last_change":"2024-09-19T14:29:51.044849+0000","last_active":"2024-09-19T15:27:52.379379+0000","last_peered":"2024-09-19T15:27:52.379379+0000","last_clean":"2024-09-19T15:27:52.379379+0000","last_became_active":"2024-09-19T14:29:51.039043+0000","last_became_peered":"2024-09-19T14:29:51.039043+0000","last_unstale":"2024-09-19T15:27:52.379379+0000","last_undegraded":"2024-09-19T15:27:52.379379+0000","last_fullsized":"2024-09-19T15:27:52.379379+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:50.442880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"268'2","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.178182+0000","last_change":"2024-09-19T14:02:37.054013+0000","last_active":"2024-09-19T15:28:02.178182+0000","last_peered":"2024-09-19T15:28:02.178182+0000","last_clean":"2024-09-19T15:28:02.178182+0000","last_became_active":"2024-09-19T14:02:37.051665+0000","last_became_peered":"2024-09-19T14:02:37.051665+0000","last_unstale":"2024-09-19T15:28:02.178182+0000","last_undegraded":"2024-09-19T15:28:02.178182+0000","last_fullsized":"2024-09-19T15:28:02.178182+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:50.720956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:52.556050+0000","last_change":"2024-09-19T14:02:29.725591+0000","last_active":"2024-09-19T15:28:52.556050+0000","last_peered":"2024-09-19T15:28:52.556050+0000","last_clean":"2024-09-19T15:28:52.556050+0000","last_became_active":"2024-09-19T14:02:29.724866+0000","last_became_peered":"2024-09-19T14:02:29.724866+0000","last_unstale":"2024-09-19T15:28:52.556050+0000","last_undegraded":"2024-09-19T15:28:52.556050+0000","last_fullsized":"2024-09-19T15:28:52.556050+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:44.282362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'36","reported_seq":169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.190273+0000","last_change":"2024-09-19T13:56:23.181435+0000","last_active":"2024-09-19T15:28:57.190273+0000","last_peered":"2024-09-19T15:28:57.190273+0000","last_clean":"2024-09-19T15:28:57.190273+0000","last_became_active":"2024-09-19T13:56:23.180159+0000","last_became_peered":"2024-09-19T13:56:23.180159+0000","last_unstale":"2024-09-19T15:28:57.190273+0000","last_undegraded":"2024-09-19T15:28:57.190273+0000","last_fullsized":"2024-09-19T15:28:57.190273+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:34:32.230609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":283,"num_read_kb":171,"num_write":89,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:03.230461+0000","last_change":"2024-09-19T14:29:51.030209+0000","last_active":"2024-09-19T15:28:03.230461+0000","last_peered":"2024-09-19T15:28:03.230461+0000","last_clean":"2024-09-19T15:28:03.230461+0000","last_became_active":"2024-09-19T14:29:51.029426+0000","last_became_peered":"2024-09-19T14:29:51.029426+0000","last_unstale":"2024-09-19T15:28:03.230461+0000","last_undegraded":"2024-09-19T15:28:03.230461+0000","last_fullsized":"2024-09-19T15:28:03.230461+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:42:56.183067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"268'2","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:48.241073+0000","last_change":"2024-09-19T14:02:37.053245+0000","last_active":"2024-09-19T15:28:48.241073+0000","last_peered":"2024-09-19T15:28:48.241073+0000","last_clean":"2024-09-19T15:28:48.241073+0000","last_became_active":"2024-09-19T14:02:37.052510+0000","last_became_peered":"2024-09-19T14:02:37.052510+0000","last_unstale":"2024-09-19T15:28:48.241073+0000","last_undegraded":"2024-09-19T15:28:48.241073+0000","last_fullsized":"2024-09-19T15:28:48.241073+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:25.091691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.597885+0000","last_change":"2024-09-19T14:02:29.736849+0000","last_active":"2024-09-19T15:27:57.597885+0000","last_peered":"2024-09-19T15:27:57.597885+0000","last_clean":"2024-09-19T15:27:57.597885+0000","last_became_active":"2024-09-19T14:02:29.736074+0000","last_became_peered":"2024-09-19T14:02:29.736074+0000","last_unstale":"2024-09-19T15:27:57.597885+0000","last_undegraded":"2024-09-19T15:27:57.597885+0000","last_fullsized":"2024-09-19T15:27:57.597885+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:49.441598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'63","reported_seq":244,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:53.242175+0000","last_change":"2024-09-19T13:56:23.179692+0000","last_active":"2024-09-19T15:28:53.242175+0000","last_peered":"2024-09-19T15:28:53.242175+0000","last_clean":"2024-09-19T15:28:53.242175+0000","last_became_active":"2024-09-19T13:56:23.179235+0000","last_became_peered":"2024-09-19T13:56:23.179235+0000","last_unstale":"2024-09-19T15:28:53.242175+0000","last_undegraded":"2024-09-19T15:28:53.242175+0000","last_fullsized":"2024-09-19T15:28:53.242175+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:47.927569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":508,"num_read_kb":362,"num_write":155,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:03.230734+0000","last_change":"2024-09-19T14:29:51.053238+0000","last_active":"2024-09-19T15:28:03.230734+0000","last_peered":"2024-09-19T15:28:03.230734+0000","last_clean":"2024-09-19T15:28:03.230734+0000","last_became_active":"2024-09-19T14:29:51.052562+0000","last_became_peered":"2024-09-19T14:29:51.052562+0000","last_unstale":"2024-09-19T15:28:03.230734+0000","last_undegraded":"2024-09-19T15:28:03.230734+0000","last_fullsized":"2024-09-19T15:28:03.230734+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:06:42.849046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"268'6","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.611337+0000","last_change":"2024-09-19T14:02:36.931028+0000","last_active":"2024-09-19T15:27:32.611337+0000","last_peered":"2024-09-19T15:27:32.611337+0000","last_clean":"2024-09-19T15:27:32.611337+0000","last_became_active":"2024-09-19T14:02:36.930344+0000","last_became_peered":"2024-09-19T14:02:36.930344+0000","last_unstale":"2024-09-19T15:27:32.611337+0000","last_undegraded":"2024-09-19T15:27:32.611337+0000","last_fullsized":"2024-09-19T15:27:32.611337+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:10:56.230063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'7","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:07.166400+0000","last_change":"2024-09-19T14:02:29.741351+0000","last_active":"2024-09-19T15:27:07.166400+0000","last_peered":"2024-09-19T15:27:07.166400+0000","last_clean":"2024-09-19T15:27:07.166400+0000","last_became_active":"2024-09-19T14:02:29.740291+0000","last_became_peered":"2024-09-19T14:02:29.740291+0000","last_unstale":"2024-09-19T15:27:07.166400+0000","last_undegraded":"2024-09-19T15:27:07.166400+0000","last_fullsized":"2024-09-19T15:27:07.166400+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:33:40.597174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":26626,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'10","reported_seq":101,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:53.242112+0000","last_change":"2024-09-19T13:56:23.170087+0000","last_active":"2024-09-19T15:28:53.242112+0000","last_peered":"2024-09-19T15:28:53.242112+0000","last_clean":"2024-09-19T15:28:53.242112+0000","last_became_active":"2024-09-19T13:56:23.169371+0000","last_became_peered":"2024-09-19T13:56:23.169371+0000","last_unstale":"2024-09-19T15:28:53.242112+0000","last_undegraded":"2024-09-19T15:28:53.242112+0000","last_fullsized":"2024-09-19T15:28:53.242112+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:41:15.161070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":43,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381528+0000","last_change":"2024-09-19T14:29:51.049819+0000","last_active":"2024-09-19T15:28:12.381528+0000","last_peered":"2024-09-19T15:28:12.381528+0000","last_clean":"2024-09-19T15:28:12.381528+0000","last_became_active":"2024-09-19T14:29:51.049146+0000","last_became_peered":"2024-09-19T14:29:51.049146+0000","last_unstale":"2024-09-19T15:28:12.381528+0000","last_undegraded":"2024-09-19T15:28:12.381528+0000","last_fullsized":"2024-09-19T15:28:12.381528+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:39.379659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:12.568908+0000","last_change":"2024-09-19T14:02:36.928119+0000","last_active":"2024-09-19T15:27:12.568908+0000","last_peered":"2024-09-19T15:27:12.568908+0000","last_clean":"2024-09-19T15:27:12.568908+0000","last_became_active":"2024-09-19T14:02:36.927382+0000","last_became_peered":"2024-09-19T14:02:36.927382+0000","last_unstale":"2024-09-19T15:27:12.568908+0000","last_undegraded":"2024-09-19T15:27:12.568908+0000","last_fullsized":"2024-09-19T15:27:12.568908+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:18.568506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"268'1","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:27.590718+0000","last_change":"2024-09-19T14:02:29.723753+0000","last_active":"2024-09-19T15:27:27.590718+0000","last_peered":"2024-09-19T15:27:27.590718+0000","last_clean":"2024-09-19T15:27:27.590718+0000","last_became_active":"2024-09-19T14:02:29.722193+0000","last_became_peered":"2024-09-19T14:02:29.722193+0000","last_unstale":"2024-09-19T15:27:27.590718+0000","last_undegraded":"2024-09-19T15:27:27.590718+0000","last_fullsized":"2024-09-19T15:27:27.590718+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:12.251421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'21","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:52.392809+0000","last_change":"2024-09-19T13:56:23.175249+0000","last_active":"2024-09-19T15:28:52.392809+0000","last_peered":"2024-09-19T15:28:52.392809+0000","last_clean":"2024-09-19T15:28:52.392809+0000","last_became_active":"2024-09-19T13:56:23.174511+0000","last_became_peered":"2024-09-19T13:56:23.174511+0000","last_unstale":"2024-09-19T15:28:52.392809+0000","last_undegraded":"2024-09-19T15:28:52.392809+0000","last_fullsized":"2024-09-19T15:28:52.392809+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:24.782915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":102,"num_write":56,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.629613+0000","last_change":"2024-09-19T14:29:51.041850+0000","last_active":"2024-09-19T15:27:22.629613+0000","last_peered":"2024-09-19T15:27:22.629613+0000","last_clean":"2024-09-19T15:27:22.629613+0000","last_became_active":"2024-09-19T14:29:51.039919+0000","last_became_peered":"2024-09-19T14:29:51.039919+0000","last_unstale":"2024-09-19T15:27:22.629613+0000","last_undegraded":"2024-09-19T15:27:22.629613+0000","last_fullsized":"2024-09-19T15:27:22.629613+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:56.764514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"265'8","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:37.574384+0000","last_change":"2024-09-19T14:02:36.919460+0000","last_active":"2024-09-19T15:27:37.574384+0000","last_peered":"2024-09-19T15:27:37.574384+0000","last_clean":"2024-09-19T15:27:37.574384+0000","last_became_active":"2024-09-19T14:02:36.918707+0000","last_became_peered":"2024-09-19T14:02:36.918707+0000","last_unstale":"2024-09-19T15:27:37.574384+0000","last_undegraded":"2024-09-19T15:27:37.574384+0000","last_fullsized":"2024-09-19T15:27:37.574384+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:50.554567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9218,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.591968+0000","last_change":"2024-09-19T14:02:29.740667+0000","last_active":"2024-09-19T15:27:32.591968+0000","last_peered":"2024-09-19T15:27:32.591968+0000","last_clean":"2024-09-19T15:27:32.591968+0000","last_became_active":"2024-09-19T14:02:29.739955+0000","last_became_peered":"2024-09-19T14:02:29.739955+0000","last_unstale":"2024-09-19T15:27:32.591968+0000","last_undegraded":"2024-09-19T15:27:32.591968+0000","last_fullsized":"2024-09-19T15:27:32.591968+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:34:51.448763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'12","reported_seq":107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:47.187823+0000","last_change":"2024-09-19T13:56:23.179307+0000","last_active":"2024-09-19T15:28:47.187823+0000","last_peered":"2024-09-19T15:28:47.187823+0000","last_clean":"2024-09-19T15:28:47.187823+0000","last_became_active":"2024-09-19T13:56:23.170272+0000","last_became_peered":"2024-09-19T13:56:23.170272+0000","last_unstale":"2024-09-19T15:28:47.187823+0000","last_undegraded":"2024-09-19T15:28:47.187823+0000","last_fullsized":"2024-09-19T15:28:47.187823+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:47:57.598767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.629764+0000","last_change":"2024-09-19T14:29:51.059050+0000","last_active":"2024-09-19T15:27:22.629764+0000","last_peered":"2024-09-19T15:27:22.629764+0000","last_clean":"2024-09-19T15:27:22.629764+0000","last_became_active":"2024-09-19T14:29:51.058380+0000","last_became_peered":"2024-09-19T14:29:51.058380+0000","last_unstale":"2024-09-19T15:27:22.629764+0000","last_undegraded":"2024-09-19T15:27:22.629764+0000","last_fullsized":"2024-09-19T15:27:22.629764+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:35.762726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:38.224574+0000","last_change":"2024-09-19T14:02:36.926259+0000","last_active":"2024-09-19T15:27:38.224574+0000","last_peered":"2024-09-19T15:27:38.224574+0000","last_clean":"2024-09-19T15:27:38.224574+0000","last_became_active":"2024-09-19T14:02:36.924268+0000","last_became_peered":"2024-09-19T14:02:36.924268+0000","last_unstale":"2024-09-19T15:27:38.224574+0000","last_undegraded":"2024-09-19T15:27:38.224574+0000","last_fullsized":"2024-09-19T15:27:38.224574+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:52.337740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.171539+0000","last_change":"2024-09-19T14:02:29.745987+0000","last_active":"2024-09-19T15:27:32.171539+0000","last_peered":"2024-09-19T15:27:32.171539+0000","last_clean":"2024-09-19T15:27:32.171539+0000","last_became_active":"2024-09-19T14:02:29.741114+0000","last_became_peered":"2024-09-19T14:02:29.741114+0000","last_unstale":"2024-09-19T15:27:32.171539+0000","last_undegraded":"2024-09-19T15:27:32.171539+0000","last_fullsized":"2024-09-19T15:27:32.171539+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:21.115185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"268'44","reported_seq":192,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381292+0000","last_change":"2024-09-19T13:56:23.177841+0000","last_active":"2024-09-19T15:28:12.381292+0000","last_peered":"2024-09-19T15:28:12.381292+0000","last_clean":"2024-09-19T15:28:12.381292+0000","last_became_active":"2024-09-19T13:56:23.177082+0000","last_became_peered":"2024-09-19T13:56:23.177082+0000","last_unstale":"2024-09-19T15:28:12.381292+0000","last_undegraded":"2024-09-19T15:28:12.381292+0000","last_fullsized":"2024-09-19T15:28:12.381292+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:57:48.702504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":229,"num_write":111,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381366+0000","last_change":"2024-09-19T14:29:51.037911+0000","last_active":"2024-09-19T15:28:12.381366+0000","last_peered":"2024-09-19T15:28:12.381366+0000","last_clean":"2024-09-19T15:28:12.381366+0000","last_became_active":"2024-09-19T14:29:51.036980+0000","last_became_peered":"2024-09-19T14:29:51.036980+0000","last_unstale":"2024-09-19T15:28:12.381366+0000","last_undegraded":"2024-09-19T15:28:12.381366+0000","last_fullsized":"2024-09-19T15:28:12.381366+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:55.591300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:13.218778+0000","last_change":"2024-09-19T14:02:37.052547+0000","last_active":"2024-09-19T15:27:13.218778+0000","last_peered":"2024-09-19T15:27:13.218778+0000","last_clean":"2024-09-19T15:27:13.218778+0000","last_became_active":"2024-09-19T14:02:37.051627+0000","last_became_peered":"2024-09-19T14:02:37.051627+0000","last_unstale":"2024-09-19T15:27:13.218778+0000","last_undegraded":"2024-09-19T15:27:13.218778+0000","last_fullsized":"2024-09-19T15:27:13.218778+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:03.602347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'9","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.634582+0000","last_change":"2024-09-19T14:02:29.725819+0000","last_active":"2024-09-19T15:29:12.634582+0000","last_peered":"2024-09-19T15:29:12.634582+0000","last_clean":"2024-09-19T15:29:12.634582+0000","last_became_active":"2024-09-19T14:02:29.725042+0000","last_became_peered":"2024-09-19T14:02:29.725042+0000","last_unstale":"2024-09-19T15:29:12.634582+0000","last_undegraded":"2024-09-19T15:29:12.634582+0000","last_fullsized":"2024-09-19T15:29:12.634582+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:36.488155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":17453,"num_write":14,"num_write_kb":14381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'39","reported_seq":180,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:17.181387+0000","last_change":"2024-09-19T13:56:23.180645+0000","last_active":"2024-09-19T15:28:17.181387+0000","last_peered":"2024-09-19T15:28:17.181387+0000","last_clean":"2024-09-19T15:28:17.181387+0000","last_became_active":"2024-09-19T13:56:23.179656+0000","last_became_peered":"2024-09-19T13:56:23.179656+0000","last_unstale":"2024-09-19T15:28:17.181387+0000","last_undegraded":"2024-09-19T15:28:17.181387+0000","last_fullsized":"2024-09-19T15:28:17.181387+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:23.453827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":202,"num_write":114,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.547652+0000","last_change":"2024-09-19T14:29:51.035627+0000","last_active":"2024-09-19T15:28:12.547652+0000","last_peered":"2024-09-19T15:28:12.547652+0000","last_clean":"2024-09-19T15:28:12.547652+0000","last_became_active":"2024-09-19T14:29:51.034910+0000","last_became_peered":"2024-09-19T14:29:51.034910+0000","last_unstale":"2024-09-19T15:28:12.547652+0000","last_undegraded":"2024-09-19T15:28:12.547652+0000","last_fullsized":"2024-09-19T15:28:12.547652+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:52.799048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"268'3","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:08.245768+0000","last_change":"2024-09-19T14:02:37.050424+0000","last_active":"2024-09-19T15:29:08.245768+0000","last_peered":"2024-09-19T15:29:08.245768+0000","last_clean":"2024-09-19T15:29:08.245768+0000","last_became_active":"2024-09-19T14:02:37.049593+0000","last_became_peered":"2024-09-19T14:02:37.049593+0000","last_unstale":"2024-09-19T15:29:08.245768+0000","last_undegraded":"2024-09-19T15:29:08.245768+0000","last_fullsized":"2024-09-19T15:29:08.245768+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:09.018084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5827243,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":8,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"268'6","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:07.625930+0000","last_change":"2024-09-19T14:02:29.738371+0000","last_active":"2024-09-19T15:27:07.625930+0000","last_peered":"2024-09-19T15:27:07.625930+0000","last_clean":"2024-09-19T15:27:07.625930+0000","last_became_active":"2024-09-19T14:02:29.737689+0000","last_became_peered":"2024-09-19T14:02:29.737689+0000","last_unstale":"2024-09-19T15:27:07.625930+0000","last_undegraded":"2024-09-19T15:27:07.625930+0000","last_fullsized":"2024-09-19T15:27:07.625930+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:43.480539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5718,"num_write":6,"num_write_kb":5718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'32","reported_seq":159,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:13.233083+0000","last_change":"2024-09-19T13:56:23.172875+0000","last_active":"2024-09-19T15:28:13.233083+0000","last_peered":"2024-09-19T15:28:13.233083+0000","last_clean":"2024-09-19T15:28:13.233083+0000","last_became_active":"2024-09-19T13:56:23.172185+0000","last_became_peered":"2024-09-19T13:56:23.172185+0000","last_unstale":"2024-09-19T15:28:13.233083+0000","last_undegraded":"2024-09-19T15:28:13.233083+0000","last_fullsized":"2024-09-19T15:28:13.233083+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:08:40.622542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":246,"num_read_kb":158,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.641708+0000","last_change":"2024-09-19T14:29:51.040551+0000","last_active":"2024-09-19T15:28:12.641708+0000","last_peered":"2024-09-19T15:28:12.641708+0000","last_clean":"2024-09-19T15:28:12.641708+0000","last_became_active":"2024-09-19T14:29:51.039877+0000","last_became_peered":"2024-09-19T14:29:51.039877+0000","last_unstale":"2024-09-19T15:28:12.641708+0000","last_undegraded":"2024-09-19T15:28:12.641708+0000","last_fullsized":"2024-09-19T15:28:12.641708+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:34:37.191773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"268'9","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:13.218849+0000","last_change":"2024-09-19T14:02:37.055970+0000","last_active":"2024-09-19T15:27:13.218849+0000","last_peered":"2024-09-19T15:27:13.218849+0000","last_clean":"2024-09-19T15:27:13.218849+0000","last_became_active":"2024-09-19T14:02:37.055184+0000","last_became_peered":"2024-09-19T14:02:37.055184+0000","last_unstale":"2024-09-19T15:27:13.218849+0000","last_undegraded":"2024-09-19T15:27:13.218849+0000","last_fullsized":"2024-09-19T15:27:13.218849+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:47.611898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":24576,"num_write":19,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"268'2","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:07.533527+0000","last_change":"2024-09-19T14:02:29.733490+0000","last_active":"2024-09-19T15:27:07.533527+0000","last_peered":"2024-09-19T15:27:07.533527+0000","last_clean":"2024-09-19T15:27:07.533527+0000","last_became_active":"2024-09-19T14:02:29.732063+0000","last_became_peered":"2024-09-19T14:02:29.732063+0000","last_unstale":"2024-09-19T15:27:07.533527+0000","last_undegraded":"2024-09-19T15:27:07.533527+0000","last_fullsized":"2024-09-19T15:27:07.533527+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:16:28.644404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'18","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.547747+0000","last_change":"2024-09-19T13:56:23.181555+0000","last_active":"2024-09-19T15:28:12.547747+0000","last_peered":"2024-09-19T15:28:12.547747+0000","last_clean":"2024-09-19T15:28:12.547747+0000","last_became_active":"2024-09-19T13:56:23.172998+0000","last_became_peered":"2024-09-19T13:56:23.172998+0000","last_unstale":"2024-09-19T15:28:12.547747+0000","last_undegraded":"2024-09-19T15:28:12.547747+0000","last_fullsized":"2024-09-19T15:28:12.547747+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:40:22.358000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.620591+0000","last_change":"2024-09-19T14:29:51.021155+0000","last_active":"2024-09-19T15:28:12.620591+0000","last_peered":"2024-09-19T15:28:12.620591+0000","last_clean":"2024-09-19T15:28:12.620591+0000","last_became_active":"2024-09-19T14:29:51.020277+0000","last_became_peered":"2024-09-19T14:29:51.020277+0000","last_unstale":"2024-09-19T15:28:12.620591+0000","last_undegraded":"2024-09-19T15:28:12.620591+0000","last_fullsized":"2024-09-19T15:28:12.620591+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:00.755087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"268'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:12.587546+0000","last_change":"2024-09-19T14:02:36.916711+0000","last_active":"2024-09-19T15:27:12.587546+0000","last_peered":"2024-09-19T15:27:12.587546+0000","last_clean":"2024-09-19T15:27:12.587546+0000","last_became_active":"2024-09-19T14:02:36.915962+0000","last_became_peered":"2024-09-19T14:02:36.915962+0000","last_unstale":"2024-09-19T15:27:12.587546+0000","last_undegraded":"2024-09-19T15:27:12.587546+0000","last_fullsized":"2024-09-19T15:27:12.587546+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:52.527680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:07.166557+0000","last_change":"2024-09-19T14:02:29.746541+0000","last_active":"2024-09-19T15:27:07.166557+0000","last_peered":"2024-09-19T15:27:07.166557+0000","last_clean":"2024-09-19T15:27:07.166557+0000","last_became_active":"2024-09-19T14:02:29.741726+0000","last_became_peered":"2024-09-19T14:02:29.741726+0000","last_unstale":"2024-09-19T15:27:07.166557+0000","last_undegraded":"2024-09-19T15:27:07.166557+0000","last_fullsized":"2024-09-19T15:27:07.166557+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:18.927081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'18","reported_seq":120,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:42.634520+0000","last_change":"2024-09-19T13:56:23.176208+0000","last_active":"2024-09-19T15:27:42.634520+0000","last_peered":"2024-09-19T15:27:42.634520+0000","last_clean":"2024-09-19T15:27:42.634520+0000","last_became_active":"2024-09-19T13:56:23.175483+0000","last_became_peered":"2024-09-19T13:56:23.175483+0000","last_unstale":"2024-09-19T15:27:42.634520+0000","last_undegraded":"2024-09-19T15:27:42.634520+0000","last_fullsized":"2024-09-19T15:27:42.634520+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:44:12.241473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":81,"num_write":47,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:53.228080+0000","last_change":"2024-09-19T14:29:51.055111+0000","last_active":"2024-09-19T15:27:53.228080+0000","last_peered":"2024-09-19T15:27:53.228080+0000","last_clean":"2024-09-19T15:27:53.228080+0000","last_became_active":"2024-09-19T14:29:51.054440+0000","last_became_peered":"2024-09-19T14:29:51.054440+0000","last_unstale":"2024-09-19T15:27:53.228080+0000","last_undegraded":"2024-09-19T15:27:53.228080+0000","last_fullsized":"2024-09-19T15:27:53.228080+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:41:52.609606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391603+0000","last_change":"2024-09-19T14:02:36.918632+0000","last_active":"2024-09-19T15:28:57.391603+0000","last_peered":"2024-09-19T15:28:57.391603+0000","last_clean":"2024-09-19T15:28:57.391603+0000","last_became_active":"2024-09-19T14:02:36.917886+0000","last_became_peered":"2024-09-19T14:02:36.917886+0000","last_unstale":"2024-09-19T15:28:57.391603+0000","last_undegraded":"2024-09-19T15:28:57.391603+0000","last_fullsized":"2024-09-19T15:28:57.391603+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:45:01.058163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"268'2","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:52.610272+0000","last_change":"2024-09-19T14:02:29.730814+0000","last_active":"2024-09-19T15:28:52.610272+0000","last_peered":"2024-09-19T15:28:52.610272+0000","last_clean":"2024-09-19T15:28:52.610272+0000","last_became_active":"2024-09-19T14:02:29.730095+0000","last_became_peered":"2024-09-19T14:02:29.730095+0000","last_unstale":"2024-09-19T15:28:52.610272+0000","last_undegraded":"2024-09-19T15:28:52.610272+0000","last_fullsized":"2024-09-19T15:28:52.610272+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:08.221591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'29","reported_seq":148,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.629547+0000","last_change":"2024-09-19T13:56:23.184572+0000","last_active":"2024-09-19T15:27:22.629547+0000","last_peered":"2024-09-19T15:27:22.629547+0000","last_clean":"2024-09-19T15:27:22.629547+0000","last_became_active":"2024-09-19T13:56:23.183825+0000","last_became_peered":"2024-09-19T13:56:23.183825+0000","last_unstale":"2024-09-19T15:27:22.629547+0000","last_undegraded":"2024-09-19T15:27:22.629547+0000","last_fullsized":"2024-09-19T15:27:22.629547+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:11.504818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":139,"num_write":76,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:52.175719+0000","last_change":"2024-09-19T14:29:51.036785+0000","last_active":"2024-09-19T15:27:52.175719+0000","last_peered":"2024-09-19T15:27:52.175719+0000","last_clean":"2024-09-19T15:27:52.175719+0000","last_became_active":"2024-09-19T14:29:51.036062+0000","last_became_peered":"2024-09-19T14:29:51.036062+0000","last_unstale":"2024-09-19T15:27:52.175719+0000","last_undegraded":"2024-09-19T15:27:52.175719+0000","last_fullsized":"2024-09-19T15:27:52.175719+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:13:16.540530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'3","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391538+0000","last_change":"2024-09-19T14:02:36.911361+0000","last_active":"2024-09-19T15:28:57.391538+0000","last_peered":"2024-09-19T15:28:57.391538+0000","last_clean":"2024-09-19T15:28:57.391538+0000","last_became_active":"2024-09-19T14:02:36.910298+0000","last_became_peered":"2024-09-19T14:02:36.910298+0000","last_unstale":"2024-09-19T15:28:57.391538+0000","last_undegraded":"2024-09-19T15:28:57.391538+0000","last_fullsized":"2024-09-19T15:28:57.391538+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:11:03.122123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'2","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:53.242045+0000","last_change":"2024-09-19T14:02:29.734818+0000","last_active":"2024-09-19T15:28:53.242045+0000","last_peered":"2024-09-19T15:28:53.242045+0000","last_clean":"2024-09-19T15:28:53.242045+0000","last_became_active":"2024-09-19T14:02:29.732413+0000","last_became_peered":"2024-09-19T14:02:29.732413+0000","last_unstale":"2024-09-19T15:28:53.242045+0000","last_undegraded":"2024-09-19T15:28:53.242045+0000","last_fullsized":"2024-09-19T15:28:53.242045+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:35.923776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"268'52","reported_seq":214,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:27.170202+0000","last_change":"2024-09-19T13:56:23.162178+0000","last_active":"2024-09-19T15:27:27.170202+0000","last_peered":"2024-09-19T15:27:27.170202+0000","last_clean":"2024-09-19T15:27:27.170202+0000","last_became_active":"2024-09-19T13:56:23.161268+0000","last_became_peered":"2024-09-19T13:56:23.161268+0000","last_unstale":"2024-09-19T15:27:27.170202+0000","last_undegraded":"2024-09-19T15:27:27.170202+0000","last_fullsized":"2024-09-19T15:27:27.170202+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:49.310248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":413,"num_read_kb":272,"num_write":131,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:32.184540+0000","last_change":"2024-09-19T14:29:51.057255+0000","last_active":"2024-09-19T15:28:32.184540+0000","last_peered":"2024-09-19T15:28:32.184540+0000","last_clean":"2024-09-19T15:28:32.184540+0000","last_became_active":"2024-09-19T14:29:51.055396+0000","last_became_peered":"2024-09-19T14:29:51.055396+0000","last_unstale":"2024-09-19T15:28:32.184540+0000","last_undegraded":"2024-09-19T15:28:32.184540+0000","last_fullsized":"2024-09-19T15:28:32.184540+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:09.497977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:58.243369+0000","last_change":"2024-09-19T14:02:36.927347+0000","last_active":"2024-09-19T15:28:58.243369+0000","last_peered":"2024-09-19T15:28:58.243369+0000","last_clean":"2024-09-19T15:28:58.243369+0000","last_became_active":"2024-09-19T14:02:36.926038+0000","last_became_peered":"2024-09-19T14:02:36.926038+0000","last_unstale":"2024-09-19T15:28:58.243369+0000","last_undegraded":"2024-09-19T15:28:58.243369+0000","last_fullsized":"2024-09-19T15:28:58.243369+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:13:52.343458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"268'4","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:52.392853+0000","last_change":"2024-09-19T14:02:29.741324+0000","last_active":"2024-09-19T15:28:52.392853+0000","last_peered":"2024-09-19T15:28:52.392853+0000","last_clean":"2024-09-19T15:28:52.392853+0000","last_became_active":"2024-09-19T14:02:29.740451+0000","last_became_peered":"2024-09-19T14:02:29.740451+0000","last_unstale":"2024-09-19T15:28:52.392853+0000","last_undegraded":"2024-09-19T15:28:52.392853+0000","last_fullsized":"2024-09-19T15:28:52.392853+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:22.134435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":9,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'35","reported_seq":173,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.589590+0000","last_change":"2024-09-19T13:56:23.176932+0000","last_active":"2024-09-19T15:27:22.589590+0000","last_peered":"2024-09-19T15:27:22.589590+0000","last_clean":"2024-09-19T15:27:22.589590+0000","last_became_active":"2024-09-19T13:56:23.170486+0000","last_became_peered":"2024-09-19T13:56:23.170486+0000","last_unstale":"2024-09-19T15:27:22.589590+0000","last_undegraded":"2024-09-19T15:27:22.589590+0000","last_fullsized":"2024-09-19T15:27:22.589590+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:43:58.374761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":196,"num_write":86,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:53.227989+0000","last_change":"2024-09-19T14:29:51.045330+0000","last_active":"2024-09-19T15:27:53.227989+0000","last_peered":"2024-09-19T15:27:53.227989+0000","last_clean":"2024-09-19T15:27:53.227989+0000","last_became_active":"2024-09-19T14:29:51.044154+0000","last_became_peered":"2024-09-19T14:29:51.044154+0000","last_unstale":"2024-09-19T15:27:53.227989+0000","last_undegraded":"2024-09-19T15:27:53.227989+0000","last_fullsized":"2024-09-19T15:27:53.227989+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:18.797951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.394100+0000","last_change":"2024-09-19T14:02:36.923267+0000","last_active":"2024-09-19T15:28:57.394100+0000","last_peered":"2024-09-19T15:28:57.394100+0000","last_clean":"2024-09-19T15:28:57.394100+0000","last_became_active":"2024-09-19T14:02:36.918735+0000","last_became_peered":"2024-09-19T14:02:36.918735+0000","last_unstale":"2024-09-19T15:28:57.394100+0000","last_undegraded":"2024-09-19T15:28:57.394100+0000","last_fullsized":"2024-09-19T15:28:57.394100+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:11.400154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:52.629773+0000","last_change":"2024-09-19T14:02:29.742726+0000","last_active":"2024-09-19T15:28:52.629773+0000","last_peered":"2024-09-19T15:28:52.629773+0000","last_clean":"2024-09-19T15:28:52.629773+0000","last_became_active":"2024-09-19T14:02:29.742091+0000","last_became_peered":"2024-09-19T14:02:29.742091+0000","last_unstale":"2024-09-19T15:28:52.629773+0000","last_undegraded":"2024-09-19T15:28:52.629773+0000","last_fullsized":"2024-09-19T15:28:52.629773+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:13:04.562095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'40","reported_seq":180,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:23.220896+0000","last_change":"2024-09-19T13:56:23.173987+0000","last_active":"2024-09-19T15:27:23.220896+0000","last_peered":"2024-09-19T15:27:23.220896+0000","last_clean":"2024-09-19T15:27:23.220896+0000","last_became_active":"2024-09-19T13:56:23.173245+0000","last_became_peered":"2024-09-19T13:56:23.173245+0000","last_unstale":"2024-09-19T15:27:23.220896+0000","last_undegraded":"2024-09-19T15:27:23.220896+0000","last_fullsized":"2024-09-19T15:27:23.220896+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:55:35.220716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":315,"num_read_kb":214,"num_write":104,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.552846+0000","last_change":"2024-09-19T14:29:51.044619+0000","last_active":"2024-09-19T15:28:37.552846+0000","last_peered":"2024-09-19T15:28:37.552846+0000","last_clean":"2024-09-19T15:28:37.552846+0000","last_became_active":"2024-09-19T14:29:51.043979+0000","last_became_peered":"2024-09-19T14:29:51.043979+0000","last_unstale":"2024-09-19T15:28:37.552846+0000","last_undegraded":"2024-09-19T15:28:37.552846+0000","last_fullsized":"2024-09-19T15:28:37.552846+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:31:38.625664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"268'1","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:08.231736+0000","last_change":"2024-09-19T14:02:36.926635+0000","last_active":"2024-09-19T15:28:08.231736+0000","last_peered":"2024-09-19T15:28:08.231736+0000","last_clean":"2024-09-19T15:28:08.231736+0000","last_became_active":"2024-09-19T14:02:36.925870+0000","last_became_peered":"2024-09-19T14:02:36.925870+0000","last_unstale":"2024-09-19T15:28:08.231736+0000","last_undegraded":"2024-09-19T15:28:08.231736+0000","last_fullsized":"2024-09-19T15:28:08.231736+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:50:58.009640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.639477+0000","last_change":"2024-09-19T14:02:29.745325+0000","last_active":"2024-09-19T15:28:02.639477+0000","last_peered":"2024-09-19T15:28:02.639477+0000","last_clean":"2024-09-19T15:28:02.639477+0000","last_became_active":"2024-09-19T14:02:29.744169+0000","last_became_peered":"2024-09-19T14:02:29.744169+0000","last_unstale":"2024-09-19T15:28:02.639477+0000","last_undegraded":"2024-09-19T15:28:02.639477+0000","last_fullsized":"2024-09-19T15:28:02.639477+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:49:32.607973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'31","reported_seq":167,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:48.241100+0000","last_change":"2024-09-19T13:56:23.167169+0000","last_active":"2024-09-19T15:28:48.241100+0000","last_peered":"2024-09-19T15:28:48.241100+0000","last_clean":"2024-09-19T15:28:48.241100+0000","last_became_active":"2024-09-19T13:56:23.160134+0000","last_became_peered":"2024-09-19T13:56:23.160134+0000","last_unstale":"2024-09-19T15:28:48.241100+0000","last_undegraded":"2024-09-19T15:28:48.241100+0000","last_fullsized":"2024-09-19T15:28:48.241100+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:17.424039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":163,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644264+0000","last_change":"2024-09-19T14:29:51.059018+0000","last_active":"2024-09-19T15:28:22.644264+0000","last_peered":"2024-09-19T15:28:22.644264+0000","last_clean":"2024-09-19T15:28:22.644264+0000","last_became_active":"2024-09-19T14:29:51.058494+0000","last_became_peered":"2024-09-19T14:29:51.058494+0000","last_unstale":"2024-09-19T15:28:22.644264+0000","last_undegraded":"2024-09-19T15:28:22.644264+0000","last_fullsized":"2024-09-19T15:28:22.644264+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:29.224657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:08.231677+0000","last_change":"2024-09-19T14:02:36.924847+0000","last_active":"2024-09-19T15:28:08.231677+0000","last_peered":"2024-09-19T15:28:08.231677+0000","last_clean":"2024-09-19T15:28:08.231677+0000","last_became_active":"2024-09-19T14:02:36.924213+0000","last_became_peered":"2024-09-19T14:02:36.924213+0000","last_unstale":"2024-09-19T15:28:08.231677+0000","last_undegraded":"2024-09-19T15:28:08.231677+0000","last_fullsized":"2024-09-19T15:28:08.231677+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:25.039869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.545625+0000","last_change":"2024-09-19T14:02:29.752025+0000","last_active":"2024-09-19T15:28:02.545625+0000","last_peered":"2024-09-19T15:28:02.545625+0000","last_clean":"2024-09-19T15:28:02.545625+0000","last_became_active":"2024-09-19T14:02:29.751229+0000","last_became_peered":"2024-09-19T14:02:29.751229+0000","last_unstale":"2024-09-19T15:28:02.545625+0000","last_undegraded":"2024-09-19T15:28:02.545625+0000","last_fullsized":"2024-09-19T15:28:02.545625+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:04.084148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"268'30","reported_seq":156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.626409+0000","last_change":"2024-09-19T13:56:23.168672+0000","last_active":"2024-09-19T15:28:37.626409+0000","last_peered":"2024-09-19T15:28:37.626409+0000","last_clean":"2024-09-19T15:28:37.626409+0000","last_became_active":"2024-09-19T13:56:23.166406+0000","last_became_peered":"2024-09-19T13:56:23.166406+0000","last_unstale":"2024-09-19T15:28:37.626409+0000","last_undegraded":"2024-09-19T15:28:37.626409+0000","last_fullsized":"2024-09-19T15:28:37.626409+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:17.132230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":158,"num_write":72,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.386230+0000","last_change":"2024-09-19T14:29:51.051349+0000","last_active":"2024-09-19T15:28:22.386230+0000","last_peered":"2024-09-19T15:28:22.386230+0000","last_clean":"2024-09-19T15:28:22.386230+0000","last_became_active":"2024-09-19T14:29:51.050808+0000","last_became_peered":"2024-09-19T14:29:51.050808+0000","last_unstale":"2024-09-19T15:28:22.386230+0000","last_undegraded":"2024-09-19T15:28:22.386230+0000","last_fullsized":"2024-09-19T15:28:22.386230+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:22:11.404680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"268'2","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:32.386279+0000","last_change":"2024-09-19T14:02:37.053056+0000","last_active":"2024-09-19T15:28:32.386279+0000","last_peered":"2024-09-19T15:28:32.386279+0000","last_clean":"2024-09-19T15:28:32.386279+0000","last_became_active":"2024-09-19T14:02:37.052121+0000","last_became_peered":"2024-09-19T14:02:37.052121+0000","last_unstale":"2024-09-19T15:28:32.386279+0000","last_undegraded":"2024-09-19T15:28:32.386279+0000","last_fullsized":"2024-09-19T15:28:32.386279+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:00.496165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.178139+0000","last_change":"2024-09-19T14:02:29.749448+0000","last_active":"2024-09-19T15:28:02.178139+0000","last_peered":"2024-09-19T15:28:02.178139+0000","last_clean":"2024-09-19T15:28:02.178139+0000","last_became_active":"2024-09-19T14:02:29.748469+0000","last_became_peered":"2024-09-19T14:02:29.748469+0000","last_unstale":"2024-09-19T15:28:02.178139+0000","last_undegraded":"2024-09-19T15:28:02.178139+0000","last_fullsized":"2024-09-19T15:28:02.178139+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:25.962511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"268'120","reported_seq":440,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.389638+0000","last_change":"2024-09-19T13:56:23.172759+0000","last_active":"2024-09-19T15:28:37.389638+0000","last_peered":"2024-09-19T15:28:37.389638+0000","last_clean":"2024-09-19T15:28:37.389638+0000","last_became_active":"2024-09-19T13:56:23.164737+0000","last_became_peered":"2024-09-19T13:56:23.164737+0000","last_unstale":"2024-09-19T15:28:37.389638+0000","last_undegraded":"2024-09-19T15:28:37.389638+0000","last_fullsized":"2024-09-19T15:28:37.389638+0000","mapping_epoch":255,"log_start":"265'100","ondisk_log_start":"265'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:31:33.872663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1135,"num_read_kb":1191,"num_write":240,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644185+0000","last_change":"2024-09-19T14:29:51.024362+0000","last_active":"2024-09-19T15:28:22.644185+0000","last_peered":"2024-09-19T15:28:22.644185+0000","last_clean":"2024-09-19T15:28:22.644185+0000","last_became_active":"2024-09-19T14:29:51.022975+0000","last_became_peered":"2024-09-19T14:29:51.022975+0000","last_unstale":"2024-09-19T15:28:22.644185+0000","last_undegraded":"2024-09-19T15:28:22.644185+0000","last_fullsized":"2024-09-19T15:28:22.644185+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:44:44.124646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"268'2","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:08.231787+0000","last_change":"2024-09-19T14:02:36.926595+0000","last_active":"2024-09-19T15:28:08.231787+0000","last_peered":"2024-09-19T15:28:08.231787+0000","last_clean":"2024-09-19T15:28:08.231787+0000","last_became_active":"2024-09-19T14:02:36.924349+0000","last_became_peered":"2024-09-19T14:02:36.924349+0000","last_unstale":"2024-09-19T15:28:08.231787+0000","last_undegraded":"2024-09-19T15:28:08.231787+0000","last_fullsized":"2024-09-19T15:28:08.231787+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:10.123769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:27.385058+0000","last_change":"2024-09-19T14:02:29.731121+0000","last_active":"2024-09-19T15:28:27.385058+0000","last_peered":"2024-09-19T15:28:27.385058+0000","last_clean":"2024-09-19T15:28:27.385058+0000","last_became_active":"2024-09-19T14:02:29.730280+0000","last_became_peered":"2024-09-19T14:02:29.730280+0000","last_unstale":"2024-09-19T15:28:27.385058+0000","last_undegraded":"2024-09-19T15:28:27.385058+0000","last_fullsized":"2024-09-19T15:28:27.385058+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:25.212771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'28","reported_seq":149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.552907+0000","last_change":"2024-09-19T13:56:23.183786+0000","last_active":"2024-09-19T15:28:37.552907+0000","last_peered":"2024-09-19T15:28:37.552907+0000","last_clean":"2024-09-19T15:28:37.552907+0000","last_became_active":"2024-09-19T13:56:23.182103+0000","last_became_peered":"2024-09-19T13:56:23.182103+0000","last_unstale":"2024-09-19T15:28:37.552907+0000","last_undegraded":"2024-09-19T15:28:37.552907+0000","last_fullsized":"2024-09-19T15:28:37.552907+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:32.317900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":141,"num_write":72,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:23.235388+0000","last_change":"2024-09-19T14:29:51.030844+0000","last_active":"2024-09-19T15:28:23.235388+0000","last_peered":"2024-09-19T15:28:23.235388+0000","last_clean":"2024-09-19T15:28:23.235388+0000","last_became_active":"2024-09-19T14:29:51.030200+0000","last_became_peered":"2024-09-19T14:29:51.030200+0000","last_unstale":"2024-09-19T15:28:23.235388+0000","last_undegraded":"2024-09-19T15:28:23.235388+0000","last_fullsized":"2024-09-19T15:28:23.235388+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:34:22.342028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"265'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:17.616101+0000","last_change":"2024-09-19T14:02:36.929045+0000","last_active":"2024-09-19T15:29:17.616101+0000","last_peered":"2024-09-19T15:29:17.616101+0000","last_clean":"2024-09-19T15:29:17.616101+0000","last_became_active":"2024-09-19T14:02:36.927585+0000","last_became_peered":"2024-09-19T14:02:36.927585+0000","last_unstale":"2024-09-19T15:29:17.616101+0000","last_undegraded":"2024-09-19T15:29:17.616101+0000","last_fullsized":"2024-09-19T15:29:17.616101+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:44:02.469367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"265'5","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.194026+0000","last_change":"2024-09-19T14:02:29.740714+0000","last_active":"2024-09-19T15:29:12.194026+0000","last_peered":"2024-09-19T15:29:12.194026+0000","last_clean":"2024-09-19T15:29:12.194026+0000","last_became_active":"2024-09-19T14:02:29.739469+0000","last_became_peered":"2024-09-19T14:02:29.739469+0000","last_unstale":"2024-09-19T15:29:12.194026+0000","last_undegraded":"2024-09-19T15:29:12.194026+0000","last_fullsized":"2024-09-19T15:29:12.194026+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:23.314643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'26","reported_seq":145,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.186692+0000","last_change":"2024-09-19T13:56:23.180908+0000","last_active":"2024-09-19T15:28:42.186692+0000","last_peered":"2024-09-19T15:28:42.186692+0000","last_clean":"2024-09-19T15:28:42.186692+0000","last_became_active":"2024-09-19T13:56:23.170897+0000","last_became_peered":"2024-09-19T13:56:23.170897+0000","last_unstale":"2024-09-19T15:28:42.186692+0000","last_undegraded":"2024-09-19T15:28:42.186692+0000","last_fullsized":"2024-09-19T15:28:42.186692+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:59.535564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":129,"num_write":67,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:32.646832+0000","last_change":"2024-09-19T14:29:51.047203+0000","last_active":"2024-09-19T15:28:32.646832+0000","last_peered":"2024-09-19T15:28:32.646832+0000","last_clean":"2024-09-19T15:28:32.646832+0000","last_became_active":"2024-09-19T14:29:51.046273+0000","last_became_peered":"2024-09-19T14:29:51.046273+0000","last_unstale":"2024-09-19T15:28:32.646832+0000","last_undegraded":"2024-09-19T15:28:32.646832+0000","last_fullsized":"2024-09-19T15:28:32.646832+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:15.605088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"268'7","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:17.657525+0000","last_change":"2024-09-19T14:02:37.051538+0000","last_active":"2024-09-19T15:29:17.657525+0000","last_peered":"2024-09-19T15:29:17.657525+0000","last_clean":"2024-09-19T15:29:17.657525+0000","last_became_active":"2024-09-19T14:02:37.050689+0000","last_became_peered":"2024-09-19T14:02:37.050689+0000","last_unstale":"2024-09-19T15:29:17.657525+0000","last_undegraded":"2024-09-19T15:29:17.657525+0000","last_fullsized":"2024-09-19T15:29:17.657525+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:21.698768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":32770,"num_write":7,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"265'5","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.395204+0000","last_change":"2024-09-19T14:02:29.731282+0000","last_active":"2024-09-19T15:29:12.395204+0000","last_peered":"2024-09-19T15:29:12.395204+0000","last_clean":"2024-09-19T15:29:12.395204+0000","last_became_active":"2024-09-19T14:02:29.730624+0000","last_became_peered":"2024-09-19T14:02:29.730624+0000","last_unstale":"2024-09-19T15:29:12.395204+0000","last_undegraded":"2024-09-19T15:29:12.395204+0000","last_fullsized":"2024-09-19T15:29:12.395204+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:58.498165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'5","reported_seq":90,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:42.634441+0000","last_change":"2024-09-19T13:56:23.182572+0000","last_active":"2024-09-19T15:27:42.634441+0000","last_peered":"2024-09-19T15:27:42.634441+0000","last_clean":"2024-09-19T15:27:42.634441+0000","last_became_active":"2024-09-19T13:56:23.181867+0000","last_became_peered":"2024-09-19T13:56:23.181867+0000","last_unstale":"2024-09-19T15:27:42.634441+0000","last_undegraded":"2024-09-19T15:27:42.634441+0000","last_fullsized":"2024-09-19T15:27:42.634441+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:12.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644309+0000","last_change":"2024-09-19T14:29:51.037068+0000","last_active":"2024-09-19T15:28:22.644309+0000","last_peered":"2024-09-19T15:28:22.644309+0000","last_clean":"2024-09-19T15:28:22.644309+0000","last_became_active":"2024-09-19T14:29:51.036292+0000","last_became_peered":"2024-09-19T14:29:51.036292+0000","last_unstale":"2024-09-19T15:28:22.644309+0000","last_undegraded":"2024-09-19T15:28:22.644309+0000","last_fullsized":"2024-09-19T15:28:22.644309+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:12.187433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"268'1","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.380067+0000","last_change":"2024-09-19T14:02:36.924261+0000","last_active":"2024-09-19T15:28:07.380067+0000","last_peered":"2024-09-19T15:28:07.380067+0000","last_clean":"2024-09-19T15:28:07.380067+0000","last_became_active":"2024-09-19T14:02:36.923500+0000","last_became_peered":"2024-09-19T14:02:36.923500+0000","last_unstale":"2024-09-19T15:28:07.380067+0000","last_undegraded":"2024-09-19T15:28:07.380067+0000","last_fullsized":"2024-09-19T15:28:07.380067+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:28:12.672018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'2","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.171466+0000","last_change":"2024-09-19T14:02:29.746888+0000","last_active":"2024-09-19T15:27:32.171466+0000","last_peered":"2024-09-19T15:27:32.171466+0000","last_clean":"2024-09-19T15:27:32.171466+0000","last_became_active":"2024-09-19T14:02:29.746148+0000","last_became_peered":"2024-09-19T14:02:29.746148+0000","last_unstale":"2024-09-19T15:27:32.171466+0000","last_undegraded":"2024-09-19T15:27:32.171466+0000","last_fullsized":"2024-09-19T15:27:32.171466+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:05.741943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'41","reported_seq":187,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:23.220986+0000","last_change":"2024-09-19T13:56:23.174360+0000","last_active":"2024-09-19T15:27:23.220986+0000","last_peered":"2024-09-19T15:27:23.220986+0000","last_clean":"2024-09-19T15:27:23.220986+0000","last_became_active":"2024-09-19T13:56:23.173918+0000","last_became_peered":"2024-09-19T13:56:23.173918+0000","last_unstale":"2024-09-19T15:27:23.220986+0000","last_undegraded":"2024-09-19T15:27:23.220986+0000","last_fullsized":"2024-09-19T15:27:23.220986+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:23.496354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":206,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.182455+0000","last_change":"2024-09-19T14:29:51.034137+0000","last_active":"2024-09-19T15:28:22.182455+0000","last_peered":"2024-09-19T15:28:22.182455+0000","last_clean":"2024-09-19T15:28:22.182455+0000","last_became_active":"2024-09-19T14:29:51.033329+0000","last_became_peered":"2024-09-19T14:29:51.033329+0000","last_unstale":"2024-09-19T15:28:22.182455+0000","last_undegraded":"2024-09-19T15:28:22.182455+0000","last_fullsized":"2024-09-19T15:28:22.182455+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:09.961864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'5","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:27.630988+0000","last_change":"2024-09-19T14:03:07.396429+0000","last_active":"2024-09-19T15:27:27.630988+0000","last_peered":"2024-09-19T15:27:27.630988+0000","last_clean":"2024-09-19T15:27:27.630988+0000","last_became_active":"2024-09-19T14:03:07.395844+0000","last_became_peered":"2024-09-19T14:03:07.395844+0000","last_unstale":"2024-09-19T15:27:27.630988+0000","last_undegraded":"2024-09-19T15:27:27.630988+0000","last_fullsized":"2024-09-19T15:27:27.630988+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:30.854364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5147,"num_write":5,"num_write_kb":5147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'3","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.598913+0000","last_change":"2024-09-19T14:02:29.733169+0000","last_active":"2024-09-19T15:28:02.598913+0000","last_peered":"2024-09-19T15:28:02.598913+0000","last_clean":"2024-09-19T15:28:02.598913+0000","last_became_active":"2024-09-19T14:02:29.732416+0000","last_became_peered":"2024-09-19T14:02:29.732416+0000","last_unstale":"2024-09-19T15:28:02.598913+0000","last_undegraded":"2024-09-19T15:28:02.598913+0000","last_fullsized":"2024-09-19T15:28:02.598913+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:49:13.647937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'38","reported_seq":187,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.570948+0000","last_change":"2024-09-19T13:56:23.173200+0000","last_active":"2024-09-19T15:27:22.570948+0000","last_peered":"2024-09-19T15:27:22.570948+0000","last_clean":"2024-09-19T15:27:22.570948+0000","last_became_active":"2024-09-19T13:56:23.172437+0000","last_became_peered":"2024-09-19T13:56:23.172437+0000","last_unstale":"2024-09-19T15:27:22.570948+0000","last_undegraded":"2024-09-19T15:27:22.570948+0000","last_fullsized":"2024-09-19T15:27:22.570948+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:43:47.758946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":311,"num_read_kb":193,"num_write":96,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.641824+0000","last_change":"2024-09-19T14:29:51.037099+0000","last_active":"2024-09-19T15:28:12.641824+0000","last_peered":"2024-09-19T15:28:12.641824+0000","last_clean":"2024-09-19T15:28:12.641824+0000","last_became_active":"2024-09-19T14:29:51.036386+0000","last_became_peered":"2024-09-19T14:29:51.036386+0000","last_unstale":"2024-09-19T15:28:12.641824+0000","last_undegraded":"2024-09-19T15:28:12.641824+0000","last_fullsized":"2024-09-19T15:28:12.641824+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:47.754572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:32.184569+0000","last_change":"2024-09-19T14:02:36.913472+0000","last_active":"2024-09-19T15:28:32.184569+0000","last_peered":"2024-09-19T15:28:32.184569+0000","last_clean":"2024-09-19T15:28:32.184569+0000","last_became_active":"2024-09-19T14:02:36.912757+0000","last_became_peered":"2024-09-19T14:02:36.912757+0000","last_unstale":"2024-09-19T15:28:32.184569+0000","last_undegraded":"2024-09-19T15:28:32.184569+0000","last_fullsized":"2024-09-19T15:28:32.184569+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:28.705324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"268'2","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.638148+0000","last_change":"2024-09-19T14:02:29.726496+0000","last_active":"2024-09-19T15:27:57.638148+0000","last_peered":"2024-09-19T15:27:57.638148+0000","last_clean":"2024-09-19T15:27:57.638148+0000","last_became_active":"2024-09-19T14:02:29.725707+0000","last_became_peered":"2024-09-19T14:02:29.725707+0000","last_unstale":"2024-09-19T15:27:57.638148+0000","last_undegraded":"2024-09-19T15:27:57.638148+0000","last_fullsized":"2024-09-19T15:27:57.638148+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:19.846245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'2","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:27.170452+0000","last_change":"2024-09-19T13:56:23.181807+0000","last_active":"2024-09-19T15:27:27.170452+0000","last_peered":"2024-09-19T15:27:27.170452+0000","last_clean":"2024-09-19T15:27:27.170452+0000","last_became_active":"2024-09-19T13:56:23.180518+0000","last_became_peered":"2024-09-19T13:56:23.180518+0000","last_unstale":"2024-09-19T15:27:27.170452+0000","last_undegraded":"2024-09-19T15:27:27.170452+0000","last_fullsized":"2024-09-19T15:27:27.170452+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:39.826441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.620670+0000","last_change":"2024-09-19T14:29:51.030804+0000","last_active":"2024-09-19T15:28:12.620670+0000","last_peered":"2024-09-19T15:28:12.620670+0000","last_clean":"2024-09-19T15:28:12.620670+0000","last_became_active":"2024-09-19T14:29:51.030021+0000","last_became_peered":"2024-09-19T14:29:51.030021+0000","last_unstale":"2024-09-19T15:28:12.620670+0000","last_undegraded":"2024-09-19T15:28:12.620670+0000","last_fullsized":"2024-09-19T15:28:12.620670+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:03.409322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"265'3","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.178084+0000","last_change":"2024-09-19T14:02:37.052572+0000","last_active":"2024-09-19T15:28:02.178084+0000","last_peered":"2024-09-19T15:28:02.178084+0000","last_clean":"2024-09-19T15:28:02.178084+0000","last_became_active":"2024-09-19T14:02:37.051567+0000","last_became_peered":"2024-09-19T14:02:37.051567+0000","last_unstale":"2024-09-19T15:28:02.178084+0000","last_undegraded":"2024-09-19T15:28:02.178084+0000","last_fullsized":"2024-09-19T15:28:02.178084+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:19:54.029118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:17.548757+0000","last_change":"2024-09-19T14:02:29.748318+0000","last_active":"2024-09-19T15:28:17.548757+0000","last_peered":"2024-09-19T15:28:17.548757+0000","last_clean":"2024-09-19T15:28:17.548757+0000","last_became_active":"2024-09-19T14:02:29.747539+0000","last_became_peered":"2024-09-19T14:02:29.747539+0000","last_unstale":"2024-09-19T15:28:17.548757+0000","last_undegraded":"2024-09-19T15:28:17.548757+0000","last_fullsized":"2024-09-19T15:28:17.548757+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:42:39.905932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"268'12","reported_seq":109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.571118+0000","last_change":"2024-09-19T13:56:23.174992+0000","last_active":"2024-09-19T15:27:22.571118+0000","last_peered":"2024-09-19T15:27:22.571118+0000","last_clean":"2024-09-19T15:27:22.571118+0000","last_became_active":"2024-09-19T13:56:23.173882+0000","last_became_peered":"2024-09-19T13:56:23.173882+0000","last_unstale":"2024-09-19T15:27:22.571118+0000","last_undegraded":"2024-09-19T15:27:22.571118+0000","last_fullsized":"2024-09-19T15:27:22.571118+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:21.063143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":61,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381230+0000","last_change":"2024-09-19T14:29:51.050041+0000","last_active":"2024-09-19T15:28:12.381230+0000","last_peered":"2024-09-19T15:28:12.381230+0000","last_clean":"2024-09-19T15:28:12.381230+0000","last_became_active":"2024-09-19T14:29:51.049356+0000","last_became_peered":"2024-09-19T14:29:51.049356+0000","last_unstale":"2024-09-19T15:28:12.381230+0000","last_undegraded":"2024-09-19T15:28:12.381230+0000","last_fullsized":"2024-09-19T15:28:12.381230+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:28.752706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"268'7","reported_seq":81,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:17.657742+0000","last_change":"2024-09-19T14:02:37.057637+0000","last_active":"2024-09-19T15:29:17.657742+0000","last_peered":"2024-09-19T15:29:17.657742+0000","last_clean":"2024-09-19T15:29:17.657742+0000","last_became_active":"2024-09-19T14:02:37.056814+0000","last_became_peered":"2024-09-19T14:02:37.056814+0000","last_unstale":"2024-09-19T15:29:17.657742+0000","last_undegraded":"2024-09-19T15:29:17.657742+0000","last_fullsized":"2024-09-19T15:29:17.657742+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:04:44.022820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":17,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.634682+0000","last_change":"2024-09-19T14:02:29.724061+0000","last_active":"2024-09-19T15:29:12.634682+0000","last_peered":"2024-09-19T15:29:12.634682+0000","last_clean":"2024-09-19T15:29:12.634682+0000","last_became_active":"2024-09-19T14:02:29.723298+0000","last_became_peered":"2024-09-19T14:02:29.723298+0000","last_unstale":"2024-09-19T15:29:12.634682+0000","last_undegraded":"2024-09-19T15:29:12.634682+0000","last_fullsized":"2024-09-19T15:29:12.634682+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:04:40.406319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'20","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644346+0000","last_change":"2024-09-19T13:56:23.190217+0000","last_active":"2024-09-19T15:28:22.644346+0000","last_peered":"2024-09-19T15:28:22.644346+0000","last_clean":"2024-09-19T15:28:22.644346+0000","last_became_active":"2024-09-19T13:56:23.189485+0000","last_became_peered":"2024-09-19T13:56:23.189485+0000","last_unstale":"2024-09-19T15:28:22.644346+0000","last_undegraded":"2024-09-19T15:28:22.644346+0000","last_fullsized":"2024-09-19T15:28:22.644346+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:26:00.955840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":106,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.601092+0000","last_change":"2024-09-19T14:29:51.029750+0000","last_active":"2024-09-19T15:28:12.601092+0000","last_peered":"2024-09-19T15:28:12.601092+0000","last_clean":"2024-09-19T15:28:12.601092+0000","last_became_active":"2024-09-19T14:29:51.028866+0000","last_became_peered":"2024-09-19T14:29:51.028866+0000","last_unstale":"2024-09-19T15:28:12.601092+0000","last_undegraded":"2024-09-19T15:28:12.601092+0000","last_fullsized":"2024-09-19T15:28:12.601092+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:57:37.166340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'3","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:17.616296+0000","last_change":"2024-09-19T14:02:36.917356+0000","last_active":"2024-09-19T15:29:17.616296+0000","last_peered":"2024-09-19T15:29:17.616296+0000","last_clean":"2024-09-19T15:29:17.616296+0000","last_became_active":"2024-09-19T14:02:36.916389+0000","last_became_peered":"2024-09-19T14:02:36.916389+0000","last_unstale":"2024-09-19T15:29:17.616296+0000","last_undegraded":"2024-09-19T15:29:17.616296+0000","last_fullsized":"2024-09-19T15:29:17.616296+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:02.036578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6339878,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":12336,"num_write":3,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"268'7","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.656562+0000","last_change":"2024-09-19T14:02:29.741915+0000","last_active":"2024-09-19T15:29:12.656562+0000","last_peered":"2024-09-19T15:29:12.656562+0000","last_clean":"2024-09-19T15:29:12.656562+0000","last_became_active":"2024-09-19T14:02:29.740227+0000","last_became_peered":"2024-09-19T14:02:29.740227+0000","last_unstale":"2024-09-19T15:29:12.656562+0000","last_undegraded":"2024-09-19T15:29:12.656562+0000","last_fullsized":"2024-09-19T15:29:12.656562+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:46.277985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":9218,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'41","reported_seq":190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.378845+0000","last_change":"2024-09-19T13:56:23.174685+0000","last_active":"2024-09-19T15:28:02.378845+0000","last_peered":"2024-09-19T15:28:02.378845+0000","last_clean":"2024-09-19T15:28:02.378845+0000","last_became_active":"2024-09-19T13:56:23.173938+0000","last_became_peered":"2024-09-19T13:56:23.173938+0000","last_unstale":"2024-09-19T15:28:02.378845+0000","last_undegraded":"2024-09-19T15:28:02.378845+0000","last_fullsized":"2024-09-19T15:28:02.378845+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:20.591650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":330,"num_read_kb":229,"num_write":110,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.549879+0000","last_change":"2024-09-19T14:29:51.026777+0000","last_active":"2024-09-19T15:28:22.549879+0000","last_peered":"2024-09-19T15:28:22.549879+0000","last_clean":"2024-09-19T15:28:22.549879+0000","last_became_active":"2024-09-19T14:29:51.025959+0000","last_became_peered":"2024-09-19T14:29:51.025959+0000","last_unstale":"2024-09-19T15:28:22.549879+0000","last_undegraded":"2024-09-19T15:28:22.549879+0000","last_fullsized":"2024-09-19T15:28:22.549879+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:11:23.290380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.378636+0000","last_change":"2024-09-19T14:02:36.912701+0000","last_active":"2024-09-19T15:28:02.378636+0000","last_peered":"2024-09-19T15:28:02.378636+0000","last_clean":"2024-09-19T15:28:02.378636+0000","last_became_active":"2024-09-19T14:02:36.911804+0000","last_became_peered":"2024-09-19T14:02:36.911804+0000","last_unstale":"2024-09-19T15:28:02.378636+0000","last_undegraded":"2024-09-19T15:28:02.378636+0000","last_fullsized":"2024-09-19T15:28:02.378636+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:12.422526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"268'6","reported_seq":87,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:52.651438+0000","last_change":"2024-09-19T14:02:29.748278+0000","last_active":"2024-09-19T15:28:52.651438+0000","last_peered":"2024-09-19T15:28:52.651438+0000","last_clean":"2024-09-19T15:28:52.651438+0000","last_became_active":"2024-09-19T14:02:29.747553+0000","last_became_peered":"2024-09-19T14:02:29.747553+0000","last_unstale":"2024-09-19T15:28:52.651438+0000","last_undegraded":"2024-09-19T15:28:52.651438+0000","last_fullsized":"2024-09-19T15:28:52.651438+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:20:14.376148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":21504,"num_write":6,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'275","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.618334+0000","last_change":"2024-09-19T13:56:23.186164+0000","last_active":"2024-09-19T15:28:02.618334+0000","last_peered":"2024-09-19T15:28:02.618334+0000","last_clean":"2024-09-19T15:28:02.618334+0000","last_became_active":"2024-09-19T13:56:23.185522+0000","last_became_peered":"2024-09-19T13:56:23.185522+0000","last_unstale":"2024-09-19T15:28:02.618334+0000","last_undegraded":"2024-09-19T15:28:02.618334+0000","last_fullsized":"2024-09-19T15:28:02.618334+0000","mapping_epoch":255,"log_start":"265'200","ondisk_log_start":"265'200","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:23.817224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2606,"num_read_kb":3112,"num_write":537,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.182535+0000","last_change":"2024-09-19T14:29:51.043009+0000","last_active":"2024-09-19T15:28:22.182535+0000","last_peered":"2024-09-19T15:28:22.182535+0000","last_clean":"2024-09-19T15:28:22.182535+0000","last_became_active":"2024-09-19T14:29:51.042287+0000","last_became_peered":"2024-09-19T14:29:51.042287+0000","last_unstale":"2024-09-19T15:28:22.182535+0000","last_undegraded":"2024-09-19T15:28:22.182535+0000","last_fullsized":"2024-09-19T15:28:22.182535+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:00:55.357725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"268'2","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.630840+0000","last_change":"2024-09-19T14:02:36.913575+0000","last_active":"2024-09-19T15:28:57.630840+0000","last_peered":"2024-09-19T15:28:57.630840+0000","last_clean":"2024-09-19T15:28:57.630840+0000","last_became_active":"2024-09-19T14:02:36.912642+0000","last_became_peered":"2024-09-19T14:02:36.912642+0000","last_unstale":"2024-09-19T15:28:57.630840+0000","last_undegraded":"2024-09-19T15:28:57.630840+0000","last_fullsized":"2024-09-19T15:28:57.630840+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:53.289654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.637948+0000","last_change":"2024-09-19T14:02:29.740640+0000","last_active":"2024-09-19T15:27:57.637948+0000","last_peered":"2024-09-19T15:27:57.637948+0000","last_clean":"2024-09-19T15:27:57.637948+0000","last_became_active":"2024-09-19T14:02:29.739397+0000","last_became_peered":"2024-09-19T14:02:29.739397+0000","last_unstale":"2024-09-19T15:27:57.637948+0000","last_undegraded":"2024-09-19T15:27:57.637948+0000","last_fullsized":"2024-09-19T15:27:57.637948+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:38.568040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'26","reported_seq":155,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.598838+0000","last_change":"2024-09-19T13:56:23.179600+0000","last_active":"2024-09-19T15:28:02.598838+0000","last_peered":"2024-09-19T15:28:02.598838+0000","last_clean":"2024-09-19T15:28:02.598838+0000","last_became_active":"2024-09-19T13:56:23.178722+0000","last_became_peered":"2024-09-19T13:56:23.178722+0000","last_unstale":"2024-09-19T15:28:02.598838+0000","last_undegraded":"2024-09-19T15:28:02.598838+0000","last_fullsized":"2024-09-19T15:28:02.598838+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:17.896929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":137,"num_write":65,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.180147+0000","last_change":"2024-09-19T14:29:51.040094+0000","last_active":"2024-09-19T15:28:12.180147+0000","last_peered":"2024-09-19T15:28:12.180147+0000","last_clean":"2024-09-19T15:28:12.180147+0000","last_became_active":"2024-09-19T14:29:51.037398+0000","last_became_peered":"2024-09-19T14:29:51.037398+0000","last_unstale":"2024-09-19T15:28:12.180147+0000","last_undegraded":"2024-09-19T15:28:12.180147+0000","last_fullsized":"2024-09-19T15:28:12.180147+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:38.720027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.382027+0000","last_change":"2024-09-19T14:02:36.929646+0000","last_active":"2024-09-19T15:28:02.382027+0000","last_peered":"2024-09-19T15:28:02.382027+0000","last_clean":"2024-09-19T15:28:02.382027+0000","last_became_active":"2024-09-19T14:02:36.928598+0000","last_became_peered":"2024-09-19T14:02:36.928598+0000","last_unstale":"2024-09-19T15:28:02.382027+0000","last_undegraded":"2024-09-19T15:28:02.382027+0000","last_fullsized":"2024-09-19T15:28:02.382027+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:55:11.565586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"268'1","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.377203+0000","last_change":"2024-09-19T14:02:29.738035+0000","last_active":"2024-09-19T15:27:57.377203+0000","last_peered":"2024-09-19T15:27:57.377203+0000","last_clean":"2024-09-19T15:27:57.377203+0000","last_became_active":"2024-09-19T14:02:29.737082+0000","last_became_peered":"2024-09-19T14:02:29.737082+0000","last_unstale":"2024-09-19T15:27:57.377203+0000","last_undegraded":"2024-09-19T15:27:57.377203+0000","last_fullsized":"2024-09-19T15:27:57.377203+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:59.761712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'51","reported_seq":222,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.381862+0000","last_change":"2024-09-19T13:56:23.173928+0000","last_active":"2024-09-19T15:28:02.381862+0000","last_peered":"2024-09-19T15:28:02.381862+0000","last_clean":"2024-09-19T15:28:02.381862+0000","last_became_active":"2024-09-19T13:56:23.173172+0000","last_became_peered":"2024-09-19T13:56:23.173172+0000","last_unstale":"2024-09-19T15:28:02.381862+0000","last_undegraded":"2024-09-19T15:28:02.381862+0000","last_fullsized":"2024-09-19T15:28:02.381862+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:40:50.508754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":432,"num_read_kb":295,"num_write":119,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644369+0000","last_change":"2024-09-19T14:29:51.048750+0000","last_active":"2024-09-19T15:28:22.644369+0000","last_peered":"2024-09-19T15:28:22.644369+0000","last_clean":"2024-09-19T15:28:22.644369+0000","last_became_active":"2024-09-19T14:29:51.047826+0000","last_became_peered":"2024-09-19T14:29:51.047826+0000","last_unstale":"2024-09-19T15:28:22.644369+0000","last_undegraded":"2024-09-19T15:28:22.644369+0000","last_fullsized":"2024-09-19T15:28:22.644369+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:01.510352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'5","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.598789+0000","last_change":"2024-09-19T14:02:36.910670+0000","last_active":"2024-09-19T15:28:02.598789+0000","last_peered":"2024-09-19T15:28:02.598789+0000","last_clean":"2024-09-19T15:28:02.598789+0000","last_became_active":"2024-09-19T14:02:36.910154+0000","last_became_peered":"2024-09-19T14:02:36.910154+0000","last_unstale":"2024-09-19T15:28:02.598789+0000","last_undegraded":"2024-09-19T15:28:02.598789+0000","last_fullsized":"2024-09-19T15:28:02.598789+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:30:56.428703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"268'1","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.380620+0000","last_change":"2024-09-19T14:02:29.723856+0000","last_active":"2024-09-19T15:27:57.380620+0000","last_peered":"2024-09-19T15:27:57.380620+0000","last_clean":"2024-09-19T15:27:57.380620+0000","last_became_active":"2024-09-19T14:02:29.723084+0000","last_became_peered":"2024-09-19T14:02:29.723084+0000","last_unstale":"2024-09-19T15:27:57.380620+0000","last_undegraded":"2024-09-19T15:27:57.380620+0000","last_fullsized":"2024-09-19T15:27:57.380620+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:57:24.394062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'52","reported_seq":217,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.648963+0000","last_change":"2024-09-19T13:56:23.182198+0000","last_active":"2024-09-19T15:28:42.648963+0000","last_peered":"2024-09-19T15:28:42.648963+0000","last_clean":"2024-09-19T15:28:42.648963+0000","last_became_active":"2024-09-19T13:56:23.181354+0000","last_became_peered":"2024-09-19T13:56:23.181354+0000","last_unstale":"2024-09-19T15:28:42.648963+0000","last_undegraded":"2024-09-19T15:28:42.648963+0000","last_fullsized":"2024-09-19T15:28:42.648963+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:38.576519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":381,"num_read_kb":254,"num_write":133,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'321","reported_seq":1026,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.652800+0000","last_change":"2024-09-19T13:40:34.279763+0000","last_active":"2024-09-19T15:28:57.652800+0000","last_peered":"2024-09-19T15:28:57.652800+0000","last_clean":"2024-09-19T15:28:57.652800+0000","last_became_active":"2024-09-19T13:40:34.278366+0000","last_became_peered":"2024-09-19T13:40:34.278366+0000","last_unstale":"2024-09-19T15:28:57.652800+0000","last_undegraded":"2024-09-19T15:28:57.652800+0000","last_fullsized":"2024-09-19T15:28:57.652800+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:54.618095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17350441,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":601,"num_read_kb":97880,"num_write":1200,"num_write_kb":51204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'896","reported_seq":2622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:46.037523+0000","last_change":"2024-09-19T13:40:36.233984+0000","last_active":"2024-09-19T15:28:46.037523+0000","last_peered":"2024-09-19T15:28:46.037523+0000","last_clean":"2024-09-19T15:28:46.037523+0000","last_became_active":"2024-09-19T13:40:36.233265+0000","last_became_peered":"2024-09-19T13:40:36.233265+0000","last_unstale":"2024-09-19T15:28:46.037523+0000","last_undegraded":"2024-09-19T15:28:46.037523+0000","last_fullsized":"2024-09-19T15:28:46.037523+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":800,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:51:51.439880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4503,"num_read_kb":4037,"num_write":1205,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'240","reported_seq":863,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391835+0000","last_change":"2024-09-19T13:40:34.240880+0000","last_active":"2024-09-19T15:28:57.391835+0000","last_peered":"2024-09-19T15:28:57.391835+0000","last_clean":"2024-09-19T15:28:57.391835+0000","last_became_active":"2024-09-19T13:40:34.240412+0000","last_became_peered":"2024-09-19T13:40:34.240412+0000","last_unstale":"2024-09-19T15:28:57.391835+0000","last_undegraded":"2024-09-19T15:28:57.391835+0000","last_fullsized":"2024-09-19T15:28:57.391835+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:44.406577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5270659,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":406,"num_read_kb":36190,"num_write":899,"num_write_kb":29274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'618","reported_seq":2321,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.314706+0000","last_change":"2024-09-19T13:40:36.233243+0000","last_active":"2024-09-19T15:29:41.314706+0000","last_peered":"2024-09-19T15:29:41.314706+0000","last_clean":"2024-09-19T15:29:41.314706+0000","last_became_active":"2024-09-19T13:40:36.232504+0000","last_became_peered":"2024-09-19T13:40:36.232504+0000","last_unstale":"2024-09-19T15:29:41.314706+0000","last_undegraded":"2024-09-19T15:29:41.314706+0000","last_fullsized":"2024-09-19T15:29:41.314706+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":600,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:48.735786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3362,"num_read_kb":3070,"num_write":813,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'303","reported_seq":984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.190331+0000","last_change":"2024-09-19T13:40:34.216282+0000","last_active":"2024-09-19T15:28:57.190331+0000","last_peered":"2024-09-19T15:28:57.190331+0000","last_clean":"2024-09-19T15:28:57.190331+0000","last_became_active":"2024-09-19T13:40:34.215960+0000","last_became_peered":"2024-09-19T13:40:34.215960+0000","last_unstale":"2024-09-19T15:28:57.190331+0000","last_undegraded":"2024-09-19T15:28:57.190331+0000","last_fullsized":"2024-09-19T15:28:57.190331+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:04.475058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16859419,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":626,"num_read_kb":31785,"num_write":1130,"num_write_kb":29902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'838","reported_seq":2388,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.242934+0000","last_change":"2024-09-19T13:40:36.227193+0000","last_active":"2024-09-19T15:31:12.242934+0000","last_peered":"2024-09-19T15:31:12.242934+0000","last_clean":"2024-09-19T15:31:12.242934+0000","last_became_active":"2024-09-19T13:40:36.220563+0000","last_became_peered":"2024-09-19T13:40:36.220563+0000","last_unstale":"2024-09-19T15:31:12.242934+0000","last_undegraded":"2024-09-19T15:31:12.242934+0000","last_fullsized":"2024-09-19T15:31:12.242934+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:33.303811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4017,"num_read_kb":3603,"num_write":1098,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'295","reported_seq":968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.632193+0000","last_change":"2024-09-19T13:40:34.242237+0000","last_active":"2024-09-19T15:29:02.632193+0000","last_peered":"2024-09-19T15:29:02.632193+0000","last_clean":"2024-09-19T15:29:02.632193+0000","last_became_active":"2024-09-19T13:40:34.239843+0000","last_became_peered":"2024-09-19T13:40:34.239843+0000","last_unstale":"2024-09-19T15:29:02.632193+0000","last_undegraded":"2024-09-19T15:29:02.632193+0000","last_fullsized":"2024-09-19T15:29:02.632193+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:31.305832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1917338,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":516,"num_read_kb":4189,"num_write":1092,"num_write_kb":27975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'1555","reported_seq":3224,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.276379+0000","last_change":"2024-09-19T13:40:36.226610+0000","last_active":"2024-09-19T15:31:12.276379+0000","last_peered":"2024-09-19T15:31:12.276379+0000","last_clean":"2024-09-19T15:31:12.276379+0000","last_became_active":"2024-09-19T13:40:36.225954+0000","last_became_peered":"2024-09-19T13:40:36.225954+0000","last_unstale":"2024-09-19T15:31:12.276379+0000","last_undegraded":"2024-09-19T15:31:12.276379+0000","last_fullsized":"2024-09-19T15:31:12.276379+0000","mapping_epoch":27,"log_start":"268'1500","ondisk_log_start":"268'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:17.018995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7021,"num_read_kb":6136,"num_write":2176,"num_write_kb":944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'248","reported_seq":951,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.640693+0000","last_change":"2024-09-19T13:40:34.275994+0000","last_active":"2024-09-19T15:28:07.640693+0000","last_peered":"2024-09-19T15:28:07.640693+0000","last_clean":"2024-09-19T15:28:07.640693+0000","last_became_active":"2024-09-19T13:40:34.267254+0000","last_became_peered":"2024-09-19T13:40:34.267254+0000","last_unstale":"2024-09-19T15:28:07.640693+0000","last_undegraded":"2024-09-19T15:28:07.640693+0000","last_fullsized":"2024-09-19T15:28:07.640693+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:10:14.953671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1175961,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":599,"num_read_kb":4762,"num_write":856,"num_write_kb":10224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"268'447","reported_seq":2099,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:07.396639+0000","last_change":"2024-09-19T13:40:36.221236+0000","last_active":"2024-09-19T15:29:07.396639+0000","last_peered":"2024-09-19T15:29:07.396639+0000","last_clean":"2024-09-19T15:29:07.396639+0000","last_became_active":"2024-09-19T13:40:36.220431+0000","last_became_peered":"2024-09-19T13:40:36.220431+0000","last_unstale":"2024-09-19T15:29:07.396639+0000","last_undegraded":"2024-09-19T15:29:07.396639+0000","last_fullsized":"2024-09-19T15:29:07.396639+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:52:16.868711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2602,"num_read_kb":2484,"num_write":543,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'257","reported_seq":903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:06.208639+0000","last_change":"2024-09-19T13:40:34.226045+0000","last_active":"2024-09-19T15:31:06.208639+0000","last_peered":"2024-09-19T15:31:06.208639+0000","last_clean":"2024-09-19T15:31:06.208639+0000","last_became_active":"2024-09-19T13:40:34.218957+0000","last_became_peered":"2024-09-19T13:40:34.218957+0000","last_unstale":"2024-09-19T15:31:06.208639+0000","last_undegraded":"2024-09-19T15:31:06.208639+0000","last_fullsized":"2024-09-19T15:31:06.208639+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:01.849971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6885246,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":447,"num_read_kb":8139,"num_write":914,"num_write_kb":24727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'795","reported_seq":2558,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.611809+0000","last_change":"2024-09-19T13:40:36.231857+0000","last_active":"2024-09-19T15:28:57.611809+0000","last_peered":"2024-09-19T15:28:57.611809+0000","last_clean":"2024-09-19T15:28:57.611809+0000","last_became_active":"2024-09-19T13:40:36.228785+0000","last_became_peered":"2024-09-19T13:40:36.228785+0000","last_unstale":"2024-09-19T15:28:57.611809+0000","last_undegraded":"2024-09-19T15:28:57.611809+0000","last_fullsized":"2024-09-19T15:28:57.611809+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:24:05.926374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4179,"num_read_kb":3830,"num_write":1044,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'280","reported_seq":928,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.640604+0000","last_change":"2024-09-19T13:40:34.268730+0000","last_active":"2024-09-19T15:28:07.640604+0000","last_peered":"2024-09-19T15:28:07.640604+0000","last_clean":"2024-09-19T15:28:07.640604+0000","last_became_active":"2024-09-19T13:40:34.267647+0000","last_became_peered":"2024-09-19T13:40:34.267647+0000","last_unstale":"2024-09-19T15:28:07.640604+0000","last_undegraded":"2024-09-19T15:28:07.640604+0000","last_fullsized":"2024-09-19T15:28:07.640604+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:41.507634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22424101,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":484,"num_read_kb":19591,"num_write":1013,"num_write_kb":28817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"268'1154","reported_seq":2774,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.631097+0000","last_change":"2024-09-19T13:40:36.231346+0000","last_active":"2024-09-19T15:28:57.631097+0000","last_peered":"2024-09-19T15:28:57.631097+0000","last_clean":"2024-09-19T15:28:57.631097+0000","last_became_active":"2024-09-19T13:40:36.230581+0000","last_became_peered":"2024-09-19T13:40:36.230581+0000","last_unstale":"2024-09-19T15:28:57.631097+0000","last_undegraded":"2024-09-19T15:28:57.631097+0000","last_fullsized":"2024-09-19T15:28:57.631097+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":1100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:33:28.578391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5418,"num_read_kb":4799,"num_write":1598,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'320","reported_seq":1063,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:08.231546+0000","last_change":"2024-09-19T13:40:34.237921+0000","last_active":"2024-09-19T15:28:08.231546+0000","last_peered":"2024-09-19T15:28:08.231546+0000","last_clean":"2024-09-19T15:28:08.231546+0000","last_became_active":"2024-09-19T13:40:34.237561+0000","last_became_peered":"2024-09-19T13:40:34.237561+0000","last_unstale":"2024-09-19T15:28:08.231546+0000","last_undegraded":"2024-09-19T15:28:08.231546+0000","last_fullsized":"2024-09-19T15:28:08.231546+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:55.737645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19811415,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":785,"num_read_kb":72182,"num_write":1114,"num_write_kb":41551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'651","reported_seq":2356,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.323183+0000","last_change":"2024-09-19T13:40:36.223002+0000","last_active":"2024-09-19T15:31:12.323183+0000","last_peered":"2024-09-19T15:31:12.323183+0000","last_clean":"2024-09-19T15:31:12.323183+0000","last_became_active":"2024-09-19T13:40:36.221587+0000","last_became_peered":"2024-09-19T13:40:36.221587+0000","last_unstale":"2024-09-19T15:31:12.323183+0000","last_undegraded":"2024-09-19T15:31:12.323183+0000","last_fullsized":"2024-09-19T15:31:12.323183+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":600,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:09:30.633730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3331,"num_read_kb":3024,"num_write":858,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'1220","reported_seq":3029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.597578+0000","last_change":"2024-09-19T13:40:36.228802+0000","last_active":"2024-09-19T15:27:57.597578+0000","last_peered":"2024-09-19T15:27:57.597578+0000","last_clean":"2024-09-19T15:27:57.597578+0000","last_became_active":"2024-09-19T13:40:36.220889+0000","last_became_peered":"2024-09-19T13:40:36.220889+0000","last_unstale":"2024-09-19T15:27:57.597578+0000","last_undegraded":"2024-09-19T15:27:57.597578+0000","last_fullsized":"2024-09-19T15:27:57.597578+0000","mapping_epoch":27,"log_start":"268'1200","ondisk_log_start":"268'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":1200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:58.428789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5895,"num_read_kb":5235,"num_write":1696,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'346","reported_seq":1076,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.629874+0000","last_change":"2024-09-19T13:40:34.280286+0000","last_active":"2024-09-19T15:27:22.629874+0000","last_peered":"2024-09-19T15:27:22.629874+0000","last_clean":"2024-09-19T15:27:22.629874+0000","last_became_active":"2024-09-19T13:40:34.278991+0000","last_became_peered":"2024-09-19T13:40:34.278991+0000","last_unstale":"2024-09-19T15:27:22.629874+0000","last_undegraded":"2024-09-19T15:27:22.629874+0000","last_fullsized":"2024-09-19T15:27:22.629874+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:34.156634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3264053,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":897,"num_read_kb":8273,"num_write":1205,"num_write_kb":26935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'1133","reported_seq":2648,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:39.715402+0000","last_change":"2024-09-19T13:40:36.233737+0000","last_active":"2024-09-19T15:28:39.715402+0000","last_peered":"2024-09-19T15:28:39.715402+0000","last_clean":"2024-09-19T15:28:39.715402+0000","last_became_active":"2024-09-19T13:40:36.233032+0000","last_became_peered":"2024-09-19T13:40:36.233032+0000","last_unstale":"2024-09-19T15:28:39.715402+0000","last_undegraded":"2024-09-19T15:28:39.715402+0000","last_fullsized":"2024-09-19T15:28:39.715402+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":1100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:01.168529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5185,"num_read_kb":4564,"num_write":1576,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'292","reported_seq":951,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:26:57.565745+0000","last_change":"2024-09-19T13:40:34.258739+0000","last_active":"2024-09-19T15:26:57.565745+0000","last_peered":"2024-09-19T15:26:57.565745+0000","last_clean":"2024-09-19T15:26:57.565745+0000","last_became_active":"2024-09-19T13:40:34.257994+0000","last_became_peered":"2024-09-19T13:40:34.257994+0000","last_unstale":"2024-09-19T15:26:57.565745+0000","last_undegraded":"2024-09-19T15:26:57.565745+0000","last_fullsized":"2024-09-19T15:26:57.565745+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:29.815057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5607532,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":540,"num_read_kb":26261,"num_write":1133,"num_write_kb":39497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"268'589","reported_seq":2568,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:46.037916+0000","last_change":"2024-09-19T13:40:36.232300+0000","last_active":"2024-09-19T15:28:46.037916+0000","last_peered":"2024-09-19T15:28:46.037916+0000","last_clean":"2024-09-19T15:28:46.037916+0000","last_became_active":"2024-09-19T13:40:36.231554+0000","last_became_peered":"2024-09-19T13:40:36.231554+0000","last_unstale":"2024-09-19T15:28:46.037916+0000","last_undegraded":"2024-09-19T15:28:46.037916+0000","last_fullsized":"2024-09-19T15:28:46.037916+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":500,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:04.811846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3450,"num_read_kb":3252,"num_write":736,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'289","reported_seq":929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:45.700438+0000","last_change":"2024-09-19T13:40:34.265083+0000","last_active":"2024-09-19T15:28:45.700438+0000","last_peered":"2024-09-19T15:28:45.700438+0000","last_clean":"2024-09-19T15:28:45.700438+0000","last_became_active":"2024-09-19T13:40:34.264349+0000","last_became_peered":"2024-09-19T13:40:34.264349+0000","last_unstale":"2024-09-19T15:28:45.700438+0000","last_undegraded":"2024-09-19T15:28:45.700438+0000","last_fullsized":"2024-09-19T15:28:45.700438+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:55.371080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13285940,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":525,"num_read_kb":18139,"num_write":1073,"num_write_kb":28020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'533","reported_seq":2156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.231056+0000","last_change":"2024-09-19T13:40:36.222241+0000","last_active":"2024-09-19T15:29:41.231056+0000","last_peered":"2024-09-19T15:29:41.231056+0000","last_clean":"2024-09-19T15:29:41.231056+0000","last_became_active":"2024-09-19T13:40:36.221266+0000","last_became_peered":"2024-09-19T13:40:36.221266+0000","last_unstale":"2024-09-19T15:29:41.231056+0000","last_undegraded":"2024-09-19T15:29:41.231056+0000","last_fullsized":"2024-09-19T15:29:41.231056+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:17.944396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2921,"num_read_kb":2700,"num_write":709,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'275","reported_seq":1122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:26:57.583847+0000","last_change":"2024-09-19T13:40:34.266244+0000","last_active":"2024-09-19T15:26:57.583847+0000","last_peered":"2024-09-19T15:26:57.583847+0000","last_clean":"2024-09-19T15:26:57.583847+0000","last_became_active":"2024-09-19T13:40:34.262084+0000","last_became_peered":"2024-09-19T13:40:34.262084+0000","last_unstale":"2024-09-19T15:26:57.583847+0000","last_undegraded":"2024-09-19T15:26:57.583847+0000","last_fullsized":"2024-09-19T15:26:57.583847+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:10:19.847500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213551,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":1101,"num_read_kb":45011,"num_write":949,"num_write_kb":26916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"268'461","reported_seq":2066,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.328055+0000","last_change":"2024-09-19T13:40:36.216484+0000","last_active":"2024-09-19T15:29:48.328055+0000","last_peered":"2024-09-19T15:29:48.328055+0000","last_clean":"2024-09-19T15:29:48.328055+0000","last_became_active":"2024-09-19T13:40:36.216082+0000","last_became_peered":"2024-09-19T13:40:36.216082+0000","last_unstale":"2024-09-19T15:29:48.328055+0000","last_undegraded":"2024-09-19T15:29:48.328055+0000","last_fullsized":"2024-09-19T15:29:48.328055+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:42.568128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2409,"num_read_kb":2273,"num_write":537,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'264","reported_seq":910,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:40.941556+0000","last_change":"2024-09-19T13:40:34.238078+0000","last_active":"2024-09-19T15:29:40.941556+0000","last_peered":"2024-09-19T15:29:40.941556+0000","last_clean":"2024-09-19T15:29:40.941556+0000","last_became_active":"2024-09-19T13:40:34.237589+0000","last_became_peered":"2024-09-19T13:40:34.237589+0000","last_unstale":"2024-09-19T15:29:40.941556+0000","last_undegraded":"2024-09-19T15:29:40.941556+0000","last_fullsized":"2024-09-19T15:29:40.941556+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:46.977541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10513849,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":396,"num_read_kb":27576,"num_write":885,"num_write_kb":52672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'576","reported_seq":2260,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.332414+0000","last_change":"2024-09-19T13:40:36.229601+0000","last_active":"2024-09-19T15:29:48.332414+0000","last_peered":"2024-09-19T15:29:48.332414+0000","last_clean":"2024-09-19T15:29:48.332414+0000","last_became_active":"2024-09-19T13:40:36.220183+0000","last_became_peered":"2024-09-19T13:40:36.220183+0000","last_unstale":"2024-09-19T15:29:48.332414+0000","last_undegraded":"2024-09-19T15:29:48.332414+0000","last_fullsized":"2024-09-19T15:29:48.332414+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:46:00.909462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3052,"num_read_kb":2823,"num_write":743,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'321","reported_seq":1027,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:52.216398+0000","last_change":"2024-09-19T13:40:34.225269+0000","last_active":"2024-09-19T15:30:52.216398+0000","last_peered":"2024-09-19T15:30:52.216398+0000","last_clean":"2024-09-19T15:30:52.216398+0000","last_became_active":"2024-09-19T13:40:34.224813+0000","last_became_peered":"2024-09-19T13:40:34.224813+0000","last_unstale":"2024-09-19T15:30:52.216398+0000","last_undegraded":"2024-09-19T15:30:52.216398+0000","last_fullsized":"2024-09-19T15:30:52.216398+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:19.334744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6377975,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":767,"num_read_kb":1243,"num_write":1421,"num_write_kb":25860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'139","reported_seq":664,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.886707+0000","last_change":"2024-09-19T13:40:44.242817+0000","last_active":"2024-09-19T15:29:50.886707+0000","last_peered":"2024-09-19T15:29:50.886707+0000","last_clean":"2024-09-19T15:29:50.886707+0000","last_became_active":"2024-09-19T13:40:44.242028+0000","last_became_peered":"2024-09-19T13:40:44.242028+0000","last_unstale":"2024-09-19T15:29:50.886707+0000","last_undegraded":"2024-09-19T15:29:50.886707+0000","last_fullsized":"2024-09-19T15:29:50.886707+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:07.663672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":180,"num_write":320,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'408","reported_seq":1932,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:35.019802+0000","last_change":"2024-09-19T13:40:36.219418+0000","last_active":"2024-09-19T15:28:35.019802+0000","last_peered":"2024-09-19T15:28:35.019802+0000","last_clean":"2024-09-19T15:28:35.019802+0000","last_became_active":"2024-09-19T13:40:36.218091+0000","last_became_peered":"2024-09-19T13:40:36.218091+0000","last_unstale":"2024-09-19T15:28:35.019802+0000","last_undegraded":"2024-09-19T15:28:35.019802+0000","last_fullsized":"2024-09-19T15:28:35.019802+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:59.320209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2211,"num_read_kb":2096,"num_write":485,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"268'290","reported_seq":924,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:07.278533+0000","last_change":"2024-09-19T13:41:05.387127+0000","last_active":"2024-09-19T15:31:07.278533+0000","last_peered":"2024-09-19T15:31:07.278533+0000","last_clean":"2024-09-19T15:31:07.278533+0000","last_became_active":"2024-09-19T13:41:05.386216+0000","last_became_peered":"2024-09-19T13:41:05.386216+0000","last_unstale":"2024-09-19T15:31:07.278533+0000","last_undegraded":"2024-09-19T15:31:07.278533+0000","last_fullsized":"2024-09-19T15:31:07.278533+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:44:15.979639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24444010,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":558,"num_read_kb":13820,"num_write":1110,"num_write_kb":52710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:02.604412+0000","last_change":"2024-09-19T13:40:38.223574+0000","last_active":"2024-09-19T15:27:02.604412+0000","last_peered":"2024-09-19T15:27:02.604412+0000","last_clean":"2024-09-19T15:27:02.604412+0000","last_became_active":"2024-09-19T13:40:38.222863+0000","last_became_peered":"2024-09-19T13:40:38.222863+0000","last_unstale":"2024-09-19T15:27:02.604412+0000","last_undegraded":"2024-09-19T15:27:02.604412+0000","last_fullsized":"2024-09-19T15:27:02.604412+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:15:56.276142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'379","reported_seq":1019,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.316958+0000","last_change":"2024-09-19T13:40:40.231128+0000","last_active":"2024-09-19T15:31:17.316958+0000","last_peered":"2024-09-19T15:31:17.316958+0000","last_clean":"2024-09-19T15:31:17.316958+0000","last_became_active":"2024-09-19T13:40:40.230368+0000","last_became_peered":"2024-09-19T13:40:40.230368+0000","last_unstale":"2024-09-19T15:31:17.316958+0000","last_undegraded":"2024-09-19T15:31:17.316958+0000","last_fullsized":"2024-09-19T15:31:17.316958+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:13:15.313671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59496,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":610,"num_read_kb":1122,"num_write":484,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:02.624637+0000","last_change":"2024-09-19T13:40:42.240924+0000","last_active":"2024-09-19T15:27:02.624637+0000","last_peered":"2024-09-19T15:27:02.624637+0000","last_clean":"2024-09-19T15:27:02.624637+0000","last_became_active":"2024-09-19T13:40:42.240244+0000","last_became_peered":"2024-09-19T13:40:42.240244+0000","last_unstale":"2024-09-19T15:27:02.624637+0000","last_undegraded":"2024-09-19T15:27:02.624637+0000","last_fullsized":"2024-09-19T15:27:02.624637+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:06.922385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'2486","reported_seq":4344,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:45.480776+0000","last_change":"2024-09-19T13:40:44.263920+0000","last_active":"2024-09-19T15:29:45.480776+0000","last_peered":"2024-09-19T15:29:45.480776+0000","last_clean":"2024-09-19T15:29:45.480776+0000","last_became_active":"2024-09-19T13:40:44.263152+0000","last_became_peered":"2024-09-19T13:40:44.263152+0000","last_unstale":"2024-09-19T15:29:45.480776+0000","last_undegraded":"2024-09-19T15:29:45.480776+0000","last_fullsized":"2024-09-19T15:29:45.480776+0000","mapping_epoch":35,"log_start":"268'2400","ondisk_log_start":"268'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":2400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:49:06.263897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6208,"num_read_kb":6212,"num_write":5020,"num_write_kb":1848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'368","reported_seq":1865,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:35.016803+0000","last_change":"2024-09-19T13:40:36.242921+0000","last_active":"2024-09-19T15:28:35.016803+0000","last_peered":"2024-09-19T15:28:35.016803+0000","last_clean":"2024-09-19T15:28:35.016803+0000","last_became_active":"2024-09-19T13:40:36.242260+0000","last_became_peered":"2024-09-19T13:40:36.242260+0000","last_unstale":"2024-09-19T15:28:35.016803+0000","last_undegraded":"2024-09-19T15:28:35.016803+0000","last_fullsized":"2024-09-19T15:28:35.016803+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:56.906330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2141,"num_read_kb":2035,"num_write":405,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'250","reported_seq":904,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.176678+0000","last_change":"2024-09-19T13:40:34.255205+0000","last_active":"2024-09-19T15:27:57.176678+0000","last_peered":"2024-09-19T15:27:57.176678+0000","last_clean":"2024-09-19T15:27:57.176678+0000","last_became_active":"2024-09-19T13:40:34.254811+0000","last_became_peered":"2024-09-19T13:40:34.254811+0000","last_unstale":"2024-09-19T15:27:57.176678+0000","last_undegraded":"2024-09-19T15:27:57.176678+0000","last_fullsized":"2024-09-19T15:27:57.176678+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:45.032111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5568747,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":529,"num_read_kb":3104,"num_write":980,"num_write_kb":15827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:13.233018+0000","last_change":"2024-09-19T13:40:38.234491+0000","last_active":"2024-09-19T15:28:13.233018+0000","last_peered":"2024-09-19T15:28:13.233018+0000","last_clean":"2024-09-19T15:28:13.233018+0000","last_became_active":"2024-09-19T13:40:38.233854+0000","last_became_peered":"2024-09-19T13:40:38.233854+0000","last_unstale":"2024-09-19T15:28:13.233018+0000","last_undegraded":"2024-09-19T15:28:13.233018+0000","last_fullsized":"2024-09-19T15:28:13.233018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:58.032011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'125","reported_seq":693,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.055494+0000","last_change":"2024-09-19T13:40:40.245668+0000","last_active":"2024-09-19T15:31:18.055494+0000","last_peered":"2024-09-19T15:31:18.055494+0000","last_clean":"2024-09-19T15:31:18.055494+0000","last_became_active":"2024-09-19T13:40:40.244841+0000","last_became_peered":"2024-09-19T13:40:40.244841+0000","last_unstale":"2024-09-19T15:31:18.055494+0000","last_undegraded":"2024-09-19T15:31:18.055494+0000","last_fullsized":"2024-09-19T15:31:18.055494+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:42.542622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":152,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:02.585177+0000","last_change":"2024-09-19T13:40:42.235946+0000","last_active":"2024-09-19T15:27:02.585177+0000","last_peered":"2024-09-19T15:27:02.585177+0000","last_clean":"2024-09-19T15:27:02.585177+0000","last_became_active":"2024-09-19T13:40:42.235151+0000","last_became_peered":"2024-09-19T13:40:42.235151+0000","last_unstale":"2024-09-19T15:27:02.585177+0000","last_undegraded":"2024-09-19T15:27:02.585177+0000","last_fullsized":"2024-09-19T15:27:02.585177+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:38.338083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'95","reported_seq":615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:17.181187+0000","last_change":"2024-09-19T13:40:44.263112+0000","last_active":"2024-09-19T15:28:17.181187+0000","last_peered":"2024-09-19T15:28:17.181187+0000","last_clean":"2024-09-19T15:28:17.181187+0000","last_became_active":"2024-09-19T13:40:44.262343+0000","last_became_peered":"2024-09-19T13:40:44.262343+0000","last_unstale":"2024-09-19T15:28:17.181187+0000","last_undegraded":"2024-09-19T15:28:17.181187+0000","last_fullsized":"2024-09-19T15:28:17.181187+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:52.097942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":127,"num_write":220,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'737","reported_seq":2237,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:49.328720+0000","last_change":"2024-09-19T13:40:36.225854+0000","last_active":"2024-09-19T15:28:49.328720+0000","last_peered":"2024-09-19T15:28:49.328720+0000","last_clean":"2024-09-19T15:28:49.328720+0000","last_became_active":"2024-09-19T13:40:36.225170+0000","last_became_peered":"2024-09-19T13:40:36.225170+0000","last_unstale":"2024-09-19T15:28:49.328720+0000","last_undegraded":"2024-09-19T15:28:49.328720+0000","last_fullsized":"2024-09-19T15:28:49.328720+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:12:27.103294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3445,"num_read_kb":3119,"num_write":970,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'275","reported_seq":906,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.637993+0000","last_change":"2024-09-19T13:40:34.274237+0000","last_active":"2024-09-19T15:27:57.637993+0000","last_peered":"2024-09-19T15:27:57.637993+0000","last_clean":"2024-09-19T15:27:57.637993+0000","last_became_active":"2024-09-19T13:40:34.273656+0000","last_became_peered":"2024-09-19T13:40:34.273656+0000","last_unstale":"2024-09-19T15:27:57.637993+0000","last_undegraded":"2024-09-19T15:27:57.637993+0000","last_fullsized":"2024-09-19T15:27:57.637993+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:26.259004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6859781,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":441,"num_read_kb":12420,"num_write":964,"num_write_kb":39158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:03.216447+0000","last_change":"2024-09-19T13:40:38.220743+0000","last_active":"2024-09-19T15:27:03.216447+0000","last_peered":"2024-09-19T15:27:03.216447+0000","last_clean":"2024-09-19T15:27:03.216447+0000","last_became_active":"2024-09-19T13:40:38.220474+0000","last_became_peered":"2024-09-19T13:40:38.220474+0000","last_unstale":"2024-09-19T15:27:03.216447+0000","last_undegraded":"2024-09-19T15:27:03.216447+0000","last_fullsized":"2024-09-19T15:27:03.216447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:08.656145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'187","reported_seq":780,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.159010+0000","last_change":"2024-09-19T13:40:40.248851+0000","last_active":"2024-09-19T15:31:18.159010+0000","last_peered":"2024-09-19T15:31:18.159010+0000","last_clean":"2024-09-19T15:31:18.159010+0000","last_became_active":"2024-09-19T13:40:40.247893+0000","last_became_peered":"2024-09-19T13:40:40.247893+0000","last_unstale":"2024-09-19T15:31:18.159010+0000","last_undegraded":"2024-09-19T15:31:18.159010+0000","last_fullsized":"2024-09-19T15:31:18.159010+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:37:12.351165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":225,"num_write":160,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'758","reported_seq":3177,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:16.995115+0000","last_change":"2024-09-19T13:40:42.239953+0000","last_active":"2024-09-19T15:31:16.995115+0000","last_peered":"2024-09-19T15:31:16.995115+0000","last_clean":"2024-09-19T15:31:16.995115+0000","last_became_active":"2024-09-19T13:40:42.239059+0000","last_became_peered":"2024-09-19T13:40:42.239059+0000","last_unstale":"2024-09-19T15:31:16.995115+0000","last_undegraded":"2024-09-19T15:31:16.995115+0000","last_fullsized":"2024-09-19T15:31:16.995115+0000","mapping_epoch":33,"log_start":"268'701","ondisk_log_start":"268'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":701,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:40.662697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'225","reported_seq":1068,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:51.070933+0000","last_change":"2024-09-19T13:40:44.278447+0000","last_active":"2024-09-19T15:29:51.070933+0000","last_peered":"2024-09-19T15:29:51.070933+0000","last_clean":"2024-09-19T15:29:51.070933+0000","last_became_active":"2024-09-19T13:40:44.277966+0000","last_became_peered":"2024-09-19T13:40:44.277966+0000","last_unstale":"2024-09-19T15:29:51.070933+0000","last_undegraded":"2024-09-19T15:29:51.070933+0000","last_fullsized":"2024-09-19T15:29:51.070933+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:46.773156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":650,"num_read_kb":649,"num_write":494,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'747","reported_seq":2159,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:26:58.215034+0000","last_change":"2024-09-19T13:40:36.238808+0000","last_active":"2024-09-19T15:26:58.215034+0000","last_peered":"2024-09-19T15:26:58.215034+0000","last_clean":"2024-09-19T15:26:58.215034+0000","last_became_active":"2024-09-19T13:40:36.238400+0000","last_became_peered":"2024-09-19T13:40:36.238400+0000","last_unstale":"2024-09-19T15:26:58.215034+0000","last_undegraded":"2024-09-19T15:26:58.215034+0000","last_fullsized":"2024-09-19T15:26:58.215034+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:37.752219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3489,"num_read_kb":3124,"num_write":1003,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'331","reported_seq":1013,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.380516+0000","last_change":"2024-09-19T13:40:34.258945+0000","last_active":"2024-09-19T15:27:57.380516+0000","last_peered":"2024-09-19T15:27:57.380516+0000","last_clean":"2024-09-19T15:27:57.380516+0000","last_became_active":"2024-09-19T13:40:34.257596+0000","last_became_peered":"2024-09-19T13:40:34.257596+0000","last_unstale":"2024-09-19T15:27:57.380516+0000","last_undegraded":"2024-09-19T15:27:57.380516+0000","last_fullsized":"2024-09-19T15:27:57.380516+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:10:14.579685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764711,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":674,"num_read_kb":35384,"num_write":1267,"num_write_kb":23932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:02.604463+0000","last_change":"2024-09-19T13:40:38.212988+0000","last_active":"2024-09-19T15:27:02.604463+0000","last_peered":"2024-09-19T15:27:02.604463+0000","last_clean":"2024-09-19T15:27:02.604463+0000","last_became_active":"2024-09-19T13:40:38.212327+0000","last_became_peered":"2024-09-19T13:40:38.212327+0000","last_unstale":"2024-09-19T15:27:02.604463+0000","last_undegraded":"2024-09-19T15:27:02.604463+0000","last_fullsized":"2024-09-19T15:27:02.604463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:22:45.697525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'309","reported_seq":924,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.172539+0000","last_change":"2024-09-19T13:40:40.226231+0000","last_active":"2024-09-19T15:31:18.172539+0000","last_peered":"2024-09-19T15:31:18.172539+0000","last_clean":"2024-09-19T15:31:18.172539+0000","last_became_active":"2024-09-19T13:40:40.225512+0000","last_became_peered":"2024-09-19T13:40:40.225512+0000","last_unstale":"2024-09-19T15:31:18.172539+0000","last_undegraded":"2024-09-19T15:31:18.172539+0000","last_fullsized":"2024-09-19T15:31:18.172539+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:59:24.943872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54478,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":500,"num_read_kb":991,"num_write":404,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'782","reported_seq":2989,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:16.987151+0000","last_change":"2024-09-19T13:40:42.264377+0000","last_active":"2024-09-19T15:31:16.987151+0000","last_peered":"2024-09-19T15:31:16.987151+0000","last_clean":"2024-09-19T15:31:16.987151+0000","last_became_active":"2024-09-19T13:40:42.263635+0000","last_became_peered":"2024-09-19T13:40:42.263635+0000","last_unstale":"2024-09-19T15:31:16.987151+0000","last_undegraded":"2024-09-19T15:31:16.987151+0000","last_fullsized":"2024-09-19T15:31:16.987151+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:30.524751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'499","reported_seq":2102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.630887+0000","last_change":"2024-09-19T13:40:36.241060+0000","last_active":"2024-09-19T15:28:57.630887+0000","last_peered":"2024-09-19T15:28:57.630887+0000","last_clean":"2024-09-19T15:28:57.630887+0000","last_became_active":"2024-09-19T13:40:36.235739+0000","last_became_peered":"2024-09-19T13:40:36.235739+0000","last_unstale":"2024-09-19T15:28:57.630887+0000","last_undegraded":"2024-09-19T15:28:57.630887+0000","last_fullsized":"2024-09-19T15:28:57.630887+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:36:20.856962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2574,"num_read_kb":2392,"num_write":618,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'308","reported_seq":1023,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.654151+0000","last_change":"2024-09-19T13:41:05.310671+0000","last_active":"2024-09-19T15:29:02.654151+0000","last_peered":"2024-09-19T15:29:02.654151+0000","last_clean":"2024-09-19T15:29:02.654151+0000","last_became_active":"2024-09-19T13:41:05.309594+0000","last_became_peered":"2024-09-19T13:41:05.309594+0000","last_unstale":"2024-09-19T15:29:02.654151+0000","last_undegraded":"2024-09-19T15:29:02.654151+0000","last_fullsized":"2024-09-19T15:29:02.654151+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:17.208658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329623,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":709,"num_read_kb":65184,"num_write":1123,"num_write_kb":23524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.653933+0000","last_change":"2024-09-19T13:40:38.234609+0000","last_active":"2024-09-19T15:29:02.653933+0000","last_peered":"2024-09-19T15:29:02.653933+0000","last_clean":"2024-09-19T15:29:02.653933+0000","last_became_active":"2024-09-19T13:40:38.233892+0000","last_became_peered":"2024-09-19T13:40:38.233892+0000","last_unstale":"2024-09-19T15:29:02.653933+0000","last_undegraded":"2024-09-19T15:29:02.653933+0000","last_fullsized":"2024-09-19T15:29:02.653933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:30.027284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'453","reported_seq":1155,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.358994+0000","last_change":"2024-09-19T13:40:40.233291+0000","last_active":"2024-09-19T15:31:18.358994+0000","last_peered":"2024-09-19T15:31:18.358994+0000","last_clean":"2024-09-19T15:31:18.358994+0000","last_became_active":"2024-09-19T13:40:40.232582+0000","last_became_peered":"2024-09-19T13:40:40.232582+0000","last_unstale":"2024-09-19T15:31:18.358994+0000","last_undegraded":"2024-09-19T15:31:18.358994+0000","last_fullsized":"2024-09-19T15:31:18.358994+0000","mapping_epoch":31,"log_start":"268'400","ondisk_log_start":"268'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:05.930746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56133,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":727,"num_read_kb":1218,"num_write":554,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.388312+0000","last_change":"2024-09-19T13:40:42.240589+0000","last_active":"2024-09-19T15:28:42.388312+0000","last_peered":"2024-09-19T15:28:42.388312+0000","last_clean":"2024-09-19T15:28:42.388312+0000","last_became_active":"2024-09-19T13:40:42.239961+0000","last_became_peered":"2024-09-19T13:40:42.239961+0000","last_unstale":"2024-09-19T15:28:42.388312+0000","last_undegraded":"2024-09-19T15:28:42.388312+0000","last_fullsized":"2024-09-19T15:28:42.388312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:04.578390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'544","reported_seq":1392,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.257388+0000","last_change":"2024-09-19T13:40:44.264532+0000","last_active":"2024-09-19T15:31:13.257388+0000","last_peered":"2024-09-19T15:31:13.257388+0000","last_clean":"2024-09-19T15:31:13.257388+0000","last_became_active":"2024-09-19T13:40:44.263313+0000","last_became_peered":"2024-09-19T13:40:44.263313+0000","last_unstale":"2024-09-19T15:31:13.257388+0000","last_undegraded":"2024-09-19T15:31:13.257388+0000","last_fullsized":"2024-09-19T15:31:13.257388+0000","mapping_epoch":35,"log_start":"268'500","ondisk_log_start":"268'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:17.459491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1297,"num_read_kb":1297,"num_write":1122,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'466","reported_seq":2113,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.656141+0000","last_change":"2024-09-19T13:40:36.219545+0000","last_active":"2024-09-19T15:29:50.656141+0000","last_peered":"2024-09-19T15:29:50.656141+0000","last_clean":"2024-09-19T15:29:50.656141+0000","last_became_active":"2024-09-19T13:40:36.218822+0000","last_became_peered":"2024-09-19T13:40:36.218822+0000","last_unstale":"2024-09-19T15:29:50.656141+0000","last_undegraded":"2024-09-19T15:29:50.656141+0000","last_fullsized":"2024-09-19T15:29:50.656141+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:28.807691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2519,"num_read_kb":2376,"num_write":558,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'257","reported_seq":910,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.648062+0000","last_change":"2024-09-19T13:40:34.279254+0000","last_active":"2024-09-19T15:28:37.648062+0000","last_peered":"2024-09-19T15:28:37.648062+0000","last_clean":"2024-09-19T15:28:37.648062+0000","last_became_active":"2024-09-19T13:40:34.278684+0000","last_became_peered":"2024-09-19T13:40:34.278684+0000","last_unstale":"2024-09-19T15:28:37.648062+0000","last_undegraded":"2024-09-19T15:28:37.648062+0000","last_fullsized":"2024-09-19T15:28:37.648062+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:10.126915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31819,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":476,"num_read_kb":16871,"num_write":931,"num_write_kb":22319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.557575+0000","last_change":"2024-09-19T13:40:38.229050+0000","last_active":"2024-09-19T15:29:02.557575+0000","last_peered":"2024-09-19T15:29:02.557575+0000","last_clean":"2024-09-19T15:29:02.557575+0000","last_became_active":"2024-09-19T13:40:38.228765+0000","last_became_peered":"2024-09-19T13:40:38.228765+0000","last_unstale":"2024-09-19T15:29:02.557575+0000","last_undegraded":"2024-09-19T15:29:02.557575+0000","last_fullsized":"2024-09-19T15:29:02.557575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:11.148186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'309","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.120871+0000","last_change":"2024-09-19T13:40:40.228045+0000","last_active":"2024-09-19T15:31:18.120871+0000","last_peered":"2024-09-19T15:31:18.120871+0000","last_clean":"2024-09-19T15:31:18.120871+0000","last_became_active":"2024-09-19T13:40:40.226899+0000","last_became_peered":"2024-09-19T13:40:40.226899+0000","last_unstale":"2024-09-19T15:31:18.120871+0000","last_undegraded":"2024-09-19T15:31:18.120871+0000","last_fullsized":"2024-09-19T15:31:18.120871+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:59.398796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54712,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":512,"num_read_kb":1018,"num_write":414,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:13.246852+0000","last_change":"2024-09-19T13:40:42.250224+0000","last_active":"2024-09-19T15:29:13.246852+0000","last_peered":"2024-09-19T15:29:13.246852+0000","last_clean":"2024-09-19T15:29:13.246852+0000","last_became_active":"2024-09-19T13:40:42.245030+0000","last_became_peered":"2024-09-19T13:40:42.245030+0000","last_unstale":"2024-09-19T15:29:13.246852+0000","last_undegraded":"2024-09-19T15:29:13.246852+0000","last_fullsized":"2024-09-19T15:29:13.246852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:07:01.322432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'125","reported_seq":635,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:37.403378+0000","last_change":"2024-09-19T13:40:44.254756+0000","last_active":"2024-09-19T15:29:37.403378+0000","last_peered":"2024-09-19T15:29:37.403378+0000","last_clean":"2024-09-19T15:29:37.403378+0000","last_became_active":"2024-09-19T13:40:44.254015+0000","last_became_peered":"2024-09-19T13:40:44.254015+0000","last_unstale":"2024-09-19T15:29:37.403378+0000","last_undegraded":"2024-09-19T15:29:37.403378+0000","last_fullsized":"2024-09-19T15:29:37.403378+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:31:55.327099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":134,"num_write":317,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'412","reported_seq":1974,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.381038+0000","last_change":"2024-09-19T13:42:05.614112+0000","last_active":"2024-09-19T15:29:48.381038+0000","last_peered":"2024-09-19T15:29:48.381038+0000","last_clean":"2024-09-19T15:29:48.381038+0000","last_became_active":"2024-09-19T13:42:05.613410+0000","last_became_peered":"2024-09-19T13:42:05.613410+0000","last_unstale":"2024-09-19T15:29:48.381038+0000","last_undegraded":"2024-09-19T15:29:48.381038+0000","last_fullsized":"2024-09-19T15:29:48.381038+0000","mapping_epoch":40,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:38:56.362442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2294,"num_read_kb":2176,"num_write":469,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'301","reported_seq":1017,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:11.104149+0000","last_change":"2024-09-19T13:40:34.268729+0000","last_active":"2024-09-19T15:31:11.104149+0000","last_peered":"2024-09-19T15:31:11.104149+0000","last_clean":"2024-09-19T15:31:11.104149+0000","last_became_active":"2024-09-19T13:40:34.268005+0000","last_became_peered":"2024-09-19T13:40:34.268005+0000","last_unstale":"2024-09-19T15:31:11.104149+0000","last_undegraded":"2024-09-19T15:31:11.104149+0000","last_fullsized":"2024-09-19T15:31:11.104149+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:39.540040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2146130,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":705,"num_read_kb":24616,"num_write":1210,"num_write_kb":39661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.553914+0000","last_change":"2024-09-19T13:40:38.232016+0000","last_active":"2024-09-19T15:28:42.553914+0000","last_peered":"2024-09-19T15:28:42.553914+0000","last_clean":"2024-09-19T15:28:42.553914+0000","last_became_active":"2024-09-19T13:40:38.231698+0000","last_became_peered":"2024-09-19T13:40:38.231698+0000","last_unstale":"2024-09-19T15:28:42.553914+0000","last_undegraded":"2024-09-19T15:28:42.553914+0000","last_fullsized":"2024-09-19T15:28:42.553914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:45.837641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'388","reported_seq":1045,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.964587+0000","last_change":"2024-09-19T13:40:40.219381+0000","last_active":"2024-09-19T15:31:17.964587+0000","last_peered":"2024-09-19T15:31:17.964587+0000","last_clean":"2024-09-19T15:31:17.964587+0000","last_became_active":"2024-09-19T13:40:40.218529+0000","last_became_peered":"2024-09-19T13:40:40.218529+0000","last_unstale":"2024-09-19T15:31:17.964587+0000","last_undegraded":"2024-09-19T15:31:17.964587+0000","last_fullsized":"2024-09-19T15:31:17.964587+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:35.038776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55706,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":602,"num_read_kb":1059,"num_write":472,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'797","reported_seq":3175,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:16.984268+0000","last_change":"2024-09-19T13:40:42.238099+0000","last_active":"2024-09-19T15:31:16.984268+0000","last_peered":"2024-09-19T15:31:16.984268+0000","last_clean":"2024-09-19T15:31:16.984268+0000","last_became_active":"2024-09-19T13:40:42.237168+0000","last_became_peered":"2024-09-19T13:40:42.237168+0000","last_unstale":"2024-09-19T15:31:16.984268+0000","last_undegraded":"2024-09-19T15:31:16.984268+0000","last_fullsized":"2024-09-19T15:31:16.984268+0000","mapping_epoch":33,"log_start":"268'701","ondisk_log_start":"268'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":701,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:55.917452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'185","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.287972+0000","last_change":"2024-09-19T13:40:44.262160+0000","last_active":"2024-09-19T15:31:12.287972+0000","last_peered":"2024-09-19T15:31:12.287972+0000","last_clean":"2024-09-19T15:31:12.287972+0000","last_became_active":"2024-09-19T13:40:44.259964+0000","last_became_peered":"2024-09-19T13:40:44.259964+0000","last_unstale":"2024-09-19T15:31:12.287972+0000","last_undegraded":"2024-09-19T15:31:12.287972+0000","last_fullsized":"2024-09-19T15:31:12.287972+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:49.811154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":275,"num_read_kb":244,"num_write":336,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'515","reported_seq":2206,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.656869+0000","last_change":"2024-09-19T13:40:36.221790+0000","last_active":"2024-09-19T15:29:50.656869+0000","last_peered":"2024-09-19T15:29:50.656869+0000","last_clean":"2024-09-19T15:29:50.656869+0000","last_became_active":"2024-09-19T13:40:36.221248+0000","last_became_peered":"2024-09-19T13:40:36.221248+0000","last_unstale":"2024-09-19T15:29:50.656869+0000","last_undegraded":"2024-09-19T15:29:50.656869+0000","last_fullsized":"2024-09-19T15:29:50.656869+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:23.331064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2802,"num_read_kb":2611,"num_write":645,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'240","reported_seq":886,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.626335+0000","last_change":"2024-09-19T13:40:34.260828+0000","last_active":"2024-09-19T15:28:37.626335+0000","last_peered":"2024-09-19T15:28:37.626335+0000","last_clean":"2024-09-19T15:28:37.626335+0000","last_became_active":"2024-09-19T13:40:34.259994+0000","last_became_peered":"2024-09-19T13:40:34.259994+0000","last_unstale":"2024-09-19T15:28:37.626335+0000","last_undegraded":"2024-09-19T15:28:37.626335+0000","last_fullsized":"2024-09-19T15:28:37.626335+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:04.707136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1312319,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":460,"num_read_kb":7460,"num_write":922,"num_write_kb":22776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:22.561854+0000","last_change":"2024-09-19T13:40:38.245831+0000","last_active":"2024-09-19T15:29:22.561854+0000","last_peered":"2024-09-19T15:29:22.561854+0000","last_clean":"2024-09-19T15:29:22.561854+0000","last_became_active":"2024-09-19T13:40:38.245245+0000","last_became_peered":"2024-09-19T13:40:38.245245+0000","last_unstale":"2024-09-19T15:29:22.561854+0000","last_undegraded":"2024-09-19T15:29:22.561854+0000","last_fullsized":"2024-09-19T15:29:22.561854+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:31:40.598604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'504","reported_seq":1173,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.237819+0000","last_change":"2024-09-19T13:40:40.231208+0000","last_active":"2024-09-19T15:31:17.237819+0000","last_peered":"2024-09-19T15:31:17.237819+0000","last_clean":"2024-09-19T15:31:17.237819+0000","last_became_active":"2024-09-19T13:40:40.230404+0000","last_became_peered":"2024-09-19T13:40:40.230404+0000","last_unstale":"2024-09-19T15:31:17.237819+0000","last_undegraded":"2024-09-19T15:31:17.237819+0000","last_fullsized":"2024-09-19T15:31:17.237819+0000","mapping_epoch":31,"log_start":"268'400","ondisk_log_start":"268'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:12:10.298800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108879,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":861,"num_read_kb":1808,"num_write":702,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.557534+0000","last_change":"2024-09-19T13:40:42.250031+0000","last_active":"2024-09-19T15:29:02.557534+0000","last_peered":"2024-09-19T15:29:02.557534+0000","last_clean":"2024-09-19T15:29:02.557534+0000","last_became_active":"2024-09-19T13:40:42.248721+0000","last_became_peered":"2024-09-19T13:40:42.248721+0000","last_unstale":"2024-09-19T15:29:02.557534+0000","last_undegraded":"2024-09-19T15:29:02.557534+0000","last_fullsized":"2024-09-19T15:29:02.557534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:31.801182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'162","reported_seq":711,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:46.507086+0000","last_change":"2024-09-19T13:40:44.256561+0000","last_active":"2024-09-19T15:29:46.507086+0000","last_peered":"2024-09-19T15:29:46.507086+0000","last_clean":"2024-09-19T15:29:46.507086+0000","last_became_active":"2024-09-19T13:40:44.255644+0000","last_became_peered":"2024-09-19T13:40:44.255644+0000","last_unstale":"2024-09-19T15:29:46.507086+0000","last_undegraded":"2024-09-19T15:29:46.507086+0000","last_fullsized":"2024-09-19T15:29:46.507086+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:41.469474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":234,"num_write":369,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'795","reported_seq":2371,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.393505+0000","last_change":"2024-09-19T13:40:36.235347+0000","last_active":"2024-09-19T15:29:48.393505+0000","last_peered":"2024-09-19T15:29:48.393505+0000","last_clean":"2024-09-19T15:29:48.393505+0000","last_became_active":"2024-09-19T13:40:36.231071+0000","last_became_peered":"2024-09-19T13:40:36.231071+0000","last_unstale":"2024-09-19T15:29:48.393505+0000","last_undegraded":"2024-09-19T15:29:48.393505+0000","last_fullsized":"2024-09-19T15:29:48.393505+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:57.506822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3782,"num_read_kb":3405,"num_write":1031,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'280","reported_seq":936,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:38.640172+0000","last_change":"2024-09-19T13:40:34.230219+0000","last_active":"2024-09-19T15:28:38.640172+0000","last_peered":"2024-09-19T15:28:38.640172+0000","last_clean":"2024-09-19T15:28:38.640172+0000","last_became_active":"2024-09-19T13:40:34.229859+0000","last_became_peered":"2024-09-19T13:40:34.229859+0000","last_unstale":"2024-09-19T15:28:38.640172+0000","last_undegraded":"2024-09-19T15:28:38.640172+0000","last_fullsized":"2024-09-19T15:28:38.640172+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:22:23.963676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2160673,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":517,"num_read_kb":8832,"num_write":963,"num_write_kb":25070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.553962+0000","last_change":"2024-09-19T13:40:38.233850+0000","last_active":"2024-09-19T15:28:42.553962+0000","last_peered":"2024-09-19T15:28:42.553962+0000","last_clean":"2024-09-19T15:28:42.553962+0000","last_became_active":"2024-09-19T13:40:38.233312+0000","last_became_peered":"2024-09-19T13:40:38.233312+0000","last_unstale":"2024-09-19T15:28:42.553962+0000","last_undegraded":"2024-09-19T15:28:42.553962+0000","last_fullsized":"2024-09-19T15:28:42.553962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:06:31.511312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'324","reported_seq":949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.236829+0000","last_change":"2024-09-19T13:40:40.248769+0000","last_active":"2024-09-19T15:31:18.236829+0000","last_peered":"2024-09-19T15:31:18.236829+0000","last_clean":"2024-09-19T15:31:18.236829+0000","last_became_active":"2024-09-19T13:40:40.247025+0000","last_became_peered":"2024-09-19T13:40:40.247025+0000","last_unstale":"2024-09-19T15:31:18.236829+0000","last_undegraded":"2024-09-19T15:31:18.236829+0000","last_fullsized":"2024-09-19T15:31:18.236829+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:56.478380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50870,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":544,"num_read_kb":997,"num_write":470,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:17.195848+0000","last_change":"2024-09-19T13:40:42.244143+0000","last_active":"2024-09-19T15:29:17.195848+0000","last_peered":"2024-09-19T15:29:17.195848+0000","last_clean":"2024-09-19T15:29:17.195848+0000","last_became_active":"2024-09-19T13:40:42.243325+0000","last_became_peered":"2024-09-19T13:40:42.243325+0000","last_unstale":"2024-09-19T15:29:17.195848+0000","last_undegraded":"2024-09-19T15:29:17.195848+0000","last_fullsized":"2024-09-19T15:29:17.195848+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:23.365075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'144","reported_seq":676,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:00.462703+0000","last_change":"2024-09-19T13:40:44.268565+0000","last_active":"2024-09-19T15:31:00.462703+0000","last_peered":"2024-09-19T15:31:00.462703+0000","last_clean":"2024-09-19T15:31:00.462703+0000","last_became_active":"2024-09-19T13:40:44.267716+0000","last_became_peered":"2024-09-19T13:40:44.267716+0000","last_unstale":"2024-09-19T15:31:00.462703+0000","last_undegraded":"2024-09-19T15:31:00.462703+0000","last_fullsized":"2024-09-19T15:31:00.462703+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:15.203052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":190,"num_read_kb":181,"num_write":368,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'1168","reported_seq":2989,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.606972+0000","last_change":"2024-09-19T13:40:36.217087+0000","last_active":"2024-09-19T15:28:37.606972+0000","last_peered":"2024-09-19T15:28:37.606972+0000","last_clean":"2024-09-19T15:28:37.606972+0000","last_became_active":"2024-09-19T13:40:36.216332+0000","last_became_peered":"2024-09-19T13:40:36.216332+0000","last_unstale":"2024-09-19T15:28:37.606972+0000","last_undegraded":"2024-09-19T15:28:37.606972+0000","last_fullsized":"2024-09-19T15:28:37.606972+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":1100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:37.143369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5686,"num_read_kb":5084,"num_write":1563,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'307","reported_seq":977,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:26.076668+0000","last_change":"2024-09-19T13:41:05.315224+0000","last_active":"2024-09-19T15:29:26.076668+0000","last_peered":"2024-09-19T15:29:26.076668+0000","last_clean":"2024-09-19T15:29:26.076668+0000","last_became_active":"2024-09-19T13:41:05.314782+0000","last_became_peered":"2024-09-19T13:41:05.314782+0000","last_unstale":"2024-09-19T15:29:26.076668+0000","last_undegraded":"2024-09-19T15:29:26.076668+0000","last_fullsized":"2024-09-19T15:29:26.076668+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:05:31.081233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13086870,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":575,"num_read_kb":47078,"num_write":1087,"num_write_kb":40849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.388400+0000","last_change":"2024-09-19T13:40:38.247209+0000","last_active":"2024-09-19T15:28:42.388400+0000","last_peered":"2024-09-19T15:28:42.388400+0000","last_clean":"2024-09-19T15:28:42.388400+0000","last_became_active":"2024-09-19T13:40:38.246684+0000","last_became_peered":"2024-09-19T13:40:38.246684+0000","last_unstale":"2024-09-19T15:28:42.388400+0000","last_undegraded":"2024-09-19T15:28:42.388400+0000","last_fullsized":"2024-09-19T15:28:42.388400+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:06.464294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'381","reported_seq":1029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.366563+0000","last_change":"2024-09-19T13:40:40.222514+0000","last_active":"2024-09-19T15:31:18.366563+0000","last_peered":"2024-09-19T15:31:18.366563+0000","last_clean":"2024-09-19T15:31:18.366563+0000","last_became_active":"2024-09-19T13:40:40.221766+0000","last_became_peered":"2024-09-19T13:40:40.221766+0000","last_unstale":"2024-09-19T15:31:18.366563+0000","last_undegraded":"2024-09-19T15:31:18.366563+0000","last_fullsized":"2024-09-19T15:31:18.366563+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:00.029066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56658,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":619,"num_read_kb":1125,"num_write":486,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'740","reported_seq":3072,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:16.987601+0000","last_change":"2024-09-19T13:40:42.246641+0000","last_active":"2024-09-19T15:31:16.987601+0000","last_peered":"2024-09-19T15:31:16.987601+0000","last_clean":"2024-09-19T15:31:16.987601+0000","last_became_active":"2024-09-19T13:40:42.246030+0000","last_became_peered":"2024-09-19T13:40:42.246030+0000","last_unstale":"2024-09-19T15:31:16.987601+0000","last_undegraded":"2024-09-19T15:31:16.987601+0000","last_fullsized":"2024-09-19T15:31:16.987601+0000","mapping_epoch":33,"log_start":"268'702","ondisk_log_start":"268'702","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":702,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:14.301444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'123","reported_seq":645,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:45.486708+0000","last_change":"2024-09-19T13:40:44.250279+0000","last_active":"2024-09-19T15:29:45.486708+0000","last_peered":"2024-09-19T15:29:45.486708+0000","last_clean":"2024-09-19T15:29:45.486708+0000","last_became_active":"2024-09-19T13:40:44.249529+0000","last_became_peered":"2024-09-19T13:40:44.249529+0000","last_unstale":"2024-09-19T15:29:45.486708+0000","last_undegraded":"2024-09-19T15:29:45.486708+0000","last_fullsized":"2024-09-19T15:29:45.486708+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:10.551071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1650,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":290,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'1316","reported_seq":3126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.313578+0000","last_change":"2024-09-19T13:40:36.219605+0000","last_active":"2024-09-19T15:29:41.313578+0000","last_peered":"2024-09-19T15:29:41.313578+0000","last_clean":"2024-09-19T15:29:41.313578+0000","last_became_active":"2024-09-19T13:40:36.218760+0000","last_became_peered":"2024-09-19T13:40:36.218760+0000","last_unstale":"2024-09-19T15:29:41.313578+0000","last_undegraded":"2024-09-19T15:29:41.313578+0000","last_fullsized":"2024-09-19T15:29:41.313578+0000","mapping_epoch":27,"log_start":"268'1300","ondisk_log_start":"268'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":1300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:53:31.922716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6184,"num_read_kb":5469,"num_write":1814,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'333","reported_seq":1042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.611459+0000","last_change":"2024-09-19T13:40:34.266782+0000","last_active":"2024-09-19T15:28:57.611459+0000","last_peered":"2024-09-19T15:28:57.611459+0000","last_clean":"2024-09-19T15:28:57.611459+0000","last_became_active":"2024-09-19T13:40:34.264354+0000","last_became_peered":"2024-09-19T13:40:34.264354+0000","last_unstale":"2024-09-19T15:28:57.611459+0000","last_undegraded":"2024-09-19T15:28:57.611459+0000","last_fullsized":"2024-09-19T15:28:57.611459+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:30.107330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":546702,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":676,"num_read_kb":5535,"num_write":1229,"num_write_kb":30004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1481,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.156035+0000","last_change":"2024-09-19T13:40:38.226450+0000","last_active":"2024-09-19T15:31:13.156035+0000","last_peered":"2024-09-19T15:31:13.156035+0000","last_clean":"2024-09-19T15:31:13.156035+0000","last_became_active":"2024-09-19T13:40:38.225663+0000","last_became_peered":"2024-09-19T13:40:38.225663+0000","last_unstale":"2024-09-19T15:31:13.156035+0000","last_undegraded":"2024-09-19T15:31:13.156035+0000","last_fullsized":"2024-09-19T15:31:13.156035+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:47:48.193799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":944,"num_read_kb":944,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'147","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.976337+0000","last_change":"2024-09-19T13:40:40.220948+0000","last_active":"2024-09-19T15:31:17.976337+0000","last_peered":"2024-09-19T15:31:17.976337+0000","last_clean":"2024-09-19T15:31:17.976337+0000","last_became_active":"2024-09-19T13:40:40.220534+0000","last_became_peered":"2024-09-19T13:40:40.220534+0000","last_unstale":"2024-09-19T15:31:17.976337+0000","last_undegraded":"2024-09-19T15:31:17.976337+0000","last_fullsized":"2024-09-19T15:31:17.976337+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:55.268748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":176,"num_write":122,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'762","reported_seq":5678,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:16.985841+0000","last_change":"2024-09-19T13:40:42.249926+0000","last_active":"2024-09-19T15:31:16.985841+0000","last_peered":"2024-09-19T15:31:16.985841+0000","last_clean":"2024-09-19T15:31:16.985841+0000","last_became_active":"2024-09-19T13:40:42.240074+0000","last_became_peered":"2024-09-19T13:40:42.240074+0000","last_unstale":"2024-09-19T15:31:16.985841+0000","last_undegraded":"2024-09-19T15:31:16.985841+0000","last_fullsized":"2024-09-19T15:31:16.985841+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:40:31.249282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'114","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:07.614003+0000","last_change":"2024-09-19T13:40:44.252306+0000","last_active":"2024-09-19T15:29:07.614003+0000","last_peered":"2024-09-19T15:29:07.614003+0000","last_clean":"2024-09-19T15:29:07.614003+0000","last_became_active":"2024-09-19T13:40:44.251353+0000","last_became_peered":"2024-09-19T13:40:44.251353+0000","last_unstale":"2024-09-19T15:29:07.614003+0000","last_undegraded":"2024-09-19T15:29:07.614003+0000","last_fullsized":"2024-09-19T15:29:07.614003+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:54.088845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'1842","reported_seq":3612,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.383231+0000","last_change":"2024-09-19T13:40:36.221951+0000","last_active":"2024-09-19T15:29:48.383231+0000","last_peered":"2024-09-19T15:29:48.383231+0000","last_clean":"2024-09-19T15:29:48.383231+0000","last_became_active":"2024-09-19T13:40:36.221638+0000","last_became_peered":"2024-09-19T13:40:36.221638+0000","last_unstale":"2024-09-19T15:29:48.383231+0000","last_undegraded":"2024-09-19T15:29:48.383231+0000","last_fullsized":"2024-09-19T15:29:48.383231+0000","mapping_epoch":27,"log_start":"268'1800","ondisk_log_start":"268'1800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":1800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:09:05.373765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8811,"num_read_kb":7740,"num_write":2693,"num_write_kb":1220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"268'296","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:58.243167+0000","last_change":"2024-09-19T13:40:34.236641+0000","last_active":"2024-09-19T15:28:58.243167+0000","last_peered":"2024-09-19T15:28:58.243167+0000","last_clean":"2024-09-19T15:28:58.243167+0000","last_became_active":"2024-09-19T13:40:34.236257+0000","last_became_peered":"2024-09-19T13:40:34.236257+0000","last_unstale":"2024-09-19T15:28:58.243167+0000","last_undegraded":"2024-09-19T15:28:58.243167+0000","last_fullsized":"2024-09-19T15:28:58.243167+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:57.681584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7567963,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":603,"num_read_kb":21601,"num_write":1159,"num_write_kb":27464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.608313+0000","last_change":"2024-09-19T13:40:38.236430+0000","last_active":"2024-09-19T15:28:42.608313+0000","last_peered":"2024-09-19T15:28:42.608313+0000","last_clean":"2024-09-19T15:28:42.608313+0000","last_became_active":"2024-09-19T13:40:38.235737+0000","last_became_peered":"2024-09-19T13:40:38.235737+0000","last_unstale":"2024-09-19T15:28:42.608313+0000","last_undegraded":"2024-09-19T15:28:42.608313+0000","last_fullsized":"2024-09-19T15:28:42.608313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:01.868972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'544","reported_seq":1232,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.223974+0000","last_change":"2024-09-19T13:40:40.236361+0000","last_active":"2024-09-19T15:31:18.223974+0000","last_peered":"2024-09-19T15:31:18.223974+0000","last_clean":"2024-09-19T15:31:18.223974+0000","last_became_active":"2024-09-19T13:40:40.235679+0000","last_became_peered":"2024-09-19T13:40:40.235679+0000","last_unstale":"2024-09-19T15:31:18.223974+0000","last_undegraded":"2024-09-19T15:31:18.223974+0000","last_fullsized":"2024-09-19T15:31:18.223974+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:05.212537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57782,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1475,"num_read_kb":1962,"num_write":2108,"num_write_kb":1881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.390727+0000","last_change":"2024-09-19T13:40:42.252473+0000","last_active":"2024-09-19T15:28:42.390727+0000","last_peered":"2024-09-19T15:28:42.390727+0000","last_clean":"2024-09-19T15:28:42.390727+0000","last_became_active":"2024-09-19T13:40:42.250462+0000","last_became_peered":"2024-09-19T13:40:42.250462+0000","last_unstale":"2024-09-19T15:28:42.390727+0000","last_undegraded":"2024-09-19T15:28:42.390727+0000","last_fullsized":"2024-09-19T15:28:42.390727+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:28:26.494633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'145","reported_seq":676,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:07.394194+0000","last_change":"2024-09-19T13:40:44.267433+0000","last_active":"2024-09-19T15:29:07.394194+0000","last_peered":"2024-09-19T15:29:07.394194+0000","last_clean":"2024-09-19T15:29:07.394194+0000","last_became_active":"2024-09-19T13:40:44.266642+0000","last_became_peered":"2024-09-19T13:40:44.266642+0000","last_unstale":"2024-09-19T15:29:07.394194+0000","last_undegraded":"2024-09-19T15:29:07.394194+0000","last_fullsized":"2024-09-19T15:29:07.394194+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:58.071145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":208,"num_write":352,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'499","reported_seq":2070,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:27.401142+0000","last_change":"2024-09-19T13:40:36.219246+0000","last_active":"2024-09-19T15:29:27.401142+0000","last_peered":"2024-09-19T15:29:27.401142+0000","last_clean":"2024-09-19T15:29:27.401142+0000","last_became_active":"2024-09-19T13:40:36.218550+0000","last_became_peered":"2024-09-19T13:40:36.218550+0000","last_unstale":"2024-09-19T15:29:27.401142+0000","last_undegraded":"2024-09-19T15:29:27.401142+0000","last_fullsized":"2024-09-19T15:29:27.401142+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:10.154764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2652,"num_read_kb":2446,"num_write":622,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":653,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.648997+0000","last_change":"2024-09-19T13:40:13.616691+0000","last_active":"2024-09-19T15:28:42.648997+0000","last_peered":"2024-09-19T15:28:42.648997+0000","last_clean":"2024-09-19T15:28:42.648997+0000","last_became_active":"2024-09-19T13:40:13.615965+0000","last_became_peered":"2024-09-19T13:40:13.615965+0000","last_unstale":"2024-09-19T15:28:42.648997+0000","last_undegraded":"2024-09-19T15:28:42.648997+0000","last_fullsized":"2024-09-19T15:28:42.648997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:12.602317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:12.602317+0000","last_clean_scrub_stamp":"2024-09-19T13:40:12.602317+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:03.931360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":566,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.627501+0000","last_change":"2024-09-19T13:40:22.120433+0000","last_active":"2024-09-19T15:28:42.627501+0000","last_peered":"2024-09-19T15:28:42.627501+0000","last_clean":"2024-09-19T15:28:42.627501+0000","last_became_active":"2024-09-19T13:40:20.100760+0000","last_became_peered":"2024-09-19T13:40:20.100760+0000","last_unstale":"2024-09-19T15:28:42.627501+0000","last_undegraded":"2024-09-19T15:28:42.627501+0000","last_fullsized":"2024-09-19T15:28:42.627501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:10.051308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001106569,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'251","reported_seq":935,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:58.243311+0000","last_change":"2024-09-19T13:40:34.241552+0000","last_active":"2024-09-19T15:28:58.243311+0000","last_peered":"2024-09-19T15:28:58.243311+0000","last_clean":"2024-09-19T15:28:58.243311+0000","last_became_active":"2024-09-19T13:40:34.241162+0000","last_became_peered":"2024-09-19T13:40:34.241162+0000","last_unstale":"2024-09-19T15:28:58.243311+0000","last_undegraded":"2024-09-19T15:28:58.243311+0000","last_fullsized":"2024-09-19T15:28:58.243311+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:44.355824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11368506,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":479,"num_read_kb":104180,"num_write":903,"num_write_kb":16810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.654042+0000","last_change":"2024-09-19T13:40:38.232446+0000","last_active":"2024-09-19T15:29:02.654042+0000","last_peered":"2024-09-19T15:29:02.654042+0000","last_clean":"2024-09-19T15:29:02.654042+0000","last_became_active":"2024-09-19T13:40:38.231762+0000","last_became_peered":"2024-09-19T13:40:38.231762+0000","last_unstale":"2024-09-19T15:29:02.654042+0000","last_undegraded":"2024-09-19T15:29:02.654042+0000","last_fullsized":"2024-09-19T15:29:02.654042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:39.721678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'741","reported_seq":1485,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.850025+0000","last_change":"2024-09-19T13:40:40.240118+0000","last_active":"2024-09-19T15:31:17.850025+0000","last_peered":"2024-09-19T15:31:17.850025+0000","last_clean":"2024-09-19T15:31:17.850025+0000","last_became_active":"2024-09-19T13:40:40.239392+0000","last_became_peered":"2024-09-19T13:40:40.239392+0000","last_unstale":"2024-09-19T15:31:17.850025+0000","last_undegraded":"2024-09-19T15:31:17.850025+0000","last_fullsized":"2024-09-19T15:31:17.850025+0000","mapping_epoch":31,"log_start":"268'700","ondisk_log_start":"268'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:00.876178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167212,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1427,"num_read_kb":2885,"num_write":1376,"num_write_kb":1210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.192068+0000","last_change":"2024-09-19T13:40:42.240498+0000","last_active":"2024-09-19T15:29:02.192068+0000","last_peered":"2024-09-19T15:29:02.192068+0000","last_clean":"2024-09-19T15:29:02.192068+0000","last_became_active":"2024-09-19T13:40:42.239749+0000","last_became_peered":"2024-09-19T13:40:42.239749+0000","last_unstale":"2024-09-19T15:29:02.192068+0000","last_undegraded":"2024-09-19T15:29:02.192068+0000","last_fullsized":"2024-09-19T15:29:02.192068+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:55:48.115594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'200","reported_seq":921,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.733071+0000","last_change":"2024-09-19T13:40:44.265188+0000","last_active":"2024-09-19T15:29:50.733071+0000","last_peered":"2024-09-19T15:29:50.733071+0000","last_clean":"2024-09-19T15:29:50.733071+0000","last_became_active":"2024-09-19T13:40:44.264456+0000","last_became_peered":"2024-09-19T13:40:44.264456+0000","last_unstale":"2024-09-19T15:29:50.733071+0000","last_undegraded":"2024-09-19T15:29:50.733071+0000","last_fullsized":"2024-09-19T15:29:50.733071+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:46.004583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":469,"num_write":408,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'750","reported_seq":2265,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.375238+0000","last_change":"2024-09-19T13:40:36.223322+0000","last_active":"2024-09-19T15:29:48.375238+0000","last_peered":"2024-09-19T15:29:48.375238+0000","last_clean":"2024-09-19T15:29:48.375238+0000","last_became_active":"2024-09-19T13:40:36.221186+0000","last_became_peered":"2024-09-19T13:40:36.221186+0000","last_unstale":"2024-09-19T15:29:48.375238+0000","last_undegraded":"2024-09-19T15:29:48.375238+0000","last_fullsized":"2024-09-19T15:29:48.375238+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:28:28.786321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3545,"num_read_kb":3202,"num_write":973,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":562,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:47.650225+0000","last_change":"2024-09-19T13:40:23.121191+0000","last_active":"2024-09-19T15:28:47.650225+0000","last_peered":"2024-09-19T15:28:47.650225+0000","last_clean":"2024-09-19T15:28:47.650225+0000","last_became_active":"2024-09-19T13:40:20.099608+0000","last_became_peered":"2024-09-19T13:40:20.099608+0000","last_unstale":"2024-09-19T15:28:47.650225+0000","last_undegraded":"2024-09-19T15:28:47.650225+0000","last_fullsized":"2024-09-19T15:28:47.650225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:29.188183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001034798,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'247","reported_seq":930,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.190076+0000","last_change":"2024-09-19T13:40:34.265231+0000","last_active":"2024-09-19T15:28:57.190076+0000","last_peered":"2024-09-19T15:28:57.190076+0000","last_clean":"2024-09-19T15:28:57.190076+0000","last_became_active":"2024-09-19T13:40:34.264819+0000","last_became_peered":"2024-09-19T13:40:34.264819+0000","last_unstale":"2024-09-19T15:28:57.190076+0000","last_undegraded":"2024-09-19T15:28:57.190076+0000","last_fullsized":"2024-09-19T15:28:57.190076+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:02:26.810163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11443637,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":516,"num_read_kb":52358,"num_write":908,"num_write_kb":38982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.632334+0000","last_change":"2024-09-19T13:40:38.223702+0000","last_active":"2024-09-19T15:29:02.632334+0000","last_peered":"2024-09-19T15:29:02.632334+0000","last_clean":"2024-09-19T15:29:02.632334+0000","last_became_active":"2024-09-19T13:40:38.222905+0000","last_became_peered":"2024-09-19T13:40:38.222905+0000","last_unstale":"2024-09-19T15:29:02.632334+0000","last_undegraded":"2024-09-19T15:29:02.632334+0000","last_fullsized":"2024-09-19T15:29:02.632334+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:40:37.494887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'1421","reported_seq":3725,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.202506+0000","last_change":"2024-09-19T13:40:40.241249+0000","last_active":"2024-09-19T15:31:18.202506+0000","last_peered":"2024-09-19T15:31:18.202506+0000","last_clean":"2024-09-19T15:31:18.202506+0000","last_became_active":"2024-09-19T13:40:40.240768+0000","last_became_peered":"2024-09-19T13:40:40.240768+0000","last_unstale":"2024-09-19T15:31:18.202506+0000","last_undegraded":"2024-09-19T15:31:18.202506+0000","last_fullsized":"2024-09-19T15:31:18.202506+0000","mapping_epoch":31,"log_start":"268'1400","ondisk_log_start":"268'1400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":1400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:22:28.103563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174352,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2198,"num_read_kb":3702,"num_write":1336,"num_write_kb":1096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:27.660131+0000","last_change":"2024-09-19T13:40:42.252880+0000","last_active":"2024-09-19T15:29:27.660131+0000","last_peered":"2024-09-19T15:29:27.660131+0000","last_clean":"2024-09-19T15:29:27.660131+0000","last_became_active":"2024-09-19T13:40:42.250172+0000","last_became_peered":"2024-09-19T13:40:42.250172+0000","last_unstale":"2024-09-19T15:29:27.660131+0000","last_undegraded":"2024-09-19T15:29:27.660131+0000","last_fullsized":"2024-09-19T15:29:27.660131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:36:32.481597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'250","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:37.400055+0000","last_change":"2024-09-19T13:40:44.273159+0000","last_active":"2024-09-19T15:29:37.400055+0000","last_peered":"2024-09-19T15:29:37.400055+0000","last_clean":"2024-09-19T15:29:37.400055+0000","last_became_active":"2024-09-19T13:40:44.272356+0000","last_became_peered":"2024-09-19T13:40:44.272356+0000","last_unstale":"2024-09-19T15:29:37.400055+0000","last_undegraded":"2024-09-19T15:29:37.400055+0000","last_fullsized":"2024-09-19T15:29:37.400055+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:13:14.438529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":580,"num_read_kb":531,"num_write":551,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'464","reported_seq":2138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391925+0000","last_change":"2024-09-19T13:40:36.242222+0000","last_active":"2024-09-19T15:28:57.391925+0000","last_peered":"2024-09-19T15:28:57.391925+0000","last_clean":"2024-09-19T15:28:57.391925+0000","last_became_active":"2024-09-19T13:40:36.241832+0000","last_became_peered":"2024-09-19T13:40:36.241832+0000","last_unstale":"2024-09-19T15:28:57.391925+0000","last_undegraded":"2024-09-19T15:28:57.391925+0000","last_fullsized":"2024-09-19T15:28:57.391925+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:08.294812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2706,"num_read_kb":2545,"num_write":558,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":553,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.553858+0000","last_change":"2024-09-19T13:40:22.375307+0000","last_active":"2024-09-19T15:28:42.553858+0000","last_peered":"2024-09-19T15:28:42.553858+0000","last_clean":"2024-09-19T15:28:42.553858+0000","last_became_active":"2024-09-19T13:40:20.096900+0000","last_became_peered":"2024-09-19T13:40:20.096900+0000","last_unstale":"2024-09-19T15:28:42.553858+0000","last_undegraded":"2024-09-19T15:28:42.553858+0000","last_fullsized":"2024-09-19T15:28:42.553858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:28.240242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074274699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'266","reported_seq":929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:07.394076+0000","last_change":"2024-09-19T13:40:34.235882+0000","last_active":"2024-09-19T15:29:07.394076+0000","last_peered":"2024-09-19T15:29:07.394076+0000","last_clean":"2024-09-19T15:29:07.394076+0000","last_became_active":"2024-09-19T13:40:34.235483+0000","last_became_peered":"2024-09-19T13:40:34.235483+0000","last_unstale":"2024-09-19T15:29:07.394076+0000","last_undegraded":"2024-09-19T15:29:07.394076+0000","last_fullsized":"2024-09-19T15:29:07.394076+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:16:09.641672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":663473,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":543,"num_read_kb":5125,"num_write":935,"num_write_kb":29541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.557673+0000","last_change":"2024-09-19T13:40:38.228915+0000","last_active":"2024-09-19T15:29:02.557673+0000","last_peered":"2024-09-19T15:29:02.557673+0000","last_clean":"2024-09-19T15:29:02.557673+0000","last_became_active":"2024-09-19T13:40:38.228364+0000","last_became_peered":"2024-09-19T13:40:38.228364+0000","last_unstale":"2024-09-19T15:29:02.557673+0000","last_undegraded":"2024-09-19T15:29:02.557673+0000","last_fullsized":"2024-09-19T15:29:02.557673+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:20.446950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'367","reported_seq":2304,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.215985+0000","last_change":"2024-09-19T13:40:40.232258+0000","last_active":"2024-09-19T15:31:18.215985+0000","last_peered":"2024-09-19T15:31:18.215985+0000","last_clean":"2024-09-19T15:31:18.215985+0000","last_became_active":"2024-09-19T13:40:40.231491+0000","last_became_peered":"2024-09-19T13:40:40.231491+0000","last_unstale":"2024-09-19T15:31:18.215985+0000","last_undegraded":"2024-09-19T15:31:18.215985+0000","last_fullsized":"2024-09-19T15:31:18.215985+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:37.420062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":364,"num_read_kb":356,"num_write":351,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.191956+0000","last_change":"2024-09-19T13:40:42.227173+0000","last_active":"2024-09-19T15:29:02.191956+0000","last_peered":"2024-09-19T15:29:02.191956+0000","last_clean":"2024-09-19T15:29:02.191956+0000","last_became_active":"2024-09-19T13:40:42.226706+0000","last_became_peered":"2024-09-19T13:40:42.226706+0000","last_unstale":"2024-09-19T15:29:02.191956+0000","last_undegraded":"2024-09-19T15:29:02.191956+0000","last_fullsized":"2024-09-19T15:29:02.191956+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:12:31.408133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'257","reported_seq":907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:51.222389+0000","last_change":"2024-09-19T13:40:44.241756+0000","last_active":"2024-09-19T15:29:51.222389+0000","last_peered":"2024-09-19T15:29:51.222389+0000","last_clean":"2024-09-19T15:29:51.222389+0000","last_became_active":"2024-09-19T13:40:44.240277+0000","last_became_peered":"2024-09-19T13:40:44.240277+0000","last_unstale":"2024-09-19T15:29:51.222389+0000","last_undegraded":"2024-09-19T15:29:51.222389+0000","last_fullsized":"2024-09-19T15:29:51.222389+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:50.745130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":590,"num_read_kb":596,"num_write":565,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'478","reported_seq":2079,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.652407+0000","last_change":"2024-09-19T13:40:36.221661+0000","last_active":"2024-09-19T15:29:50.652407+0000","last_peered":"2024-09-19T15:29:50.652407+0000","last_clean":"2024-09-19T15:29:50.652407+0000","last_became_active":"2024-09-19T13:40:36.220514+0000","last_became_peered":"2024-09-19T13:40:36.220514+0000","last_unstale":"2024-09-19T15:29:50.652407+0000","last_undegraded":"2024-09-19T15:29:50.652407+0000","last_fullsized":"2024-09-19T15:29:50.652407+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:03.001074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2550,"num_read_kb":2381,"num_write":569,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":567,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.627408+0000","last_change":"2024-09-19T13:40:22.121910+0000","last_active":"2024-09-19T15:28:42.627408+0000","last_peered":"2024-09-19T15:28:42.627408+0000","last_clean":"2024-09-19T15:28:42.627408+0000","last_became_active":"2024-09-19T13:40:20.101198+0000","last_became_peered":"2024-09-19T13:40:20.101198+0000","last_unstale":"2024-09-19T15:28:42.627408+0000","last_undegraded":"2024-09-19T15:28:42.627408+0000","last_fullsized":"2024-09-19T15:28:42.627408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:03:31.869167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026053059999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'266","reported_seq":929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.611715+0000","last_change":"2024-09-19T13:40:34.229956+0000","last_active":"2024-09-19T15:28:57.611715+0000","last_peered":"2024-09-19T15:28:57.611715+0000","last_clean":"2024-09-19T15:28:57.611715+0000","last_became_active":"2024-09-19T13:40:34.228632+0000","last_became_peered":"2024-09-19T13:40:34.228632+0000","last_unstale":"2024-09-19T15:28:57.611715+0000","last_undegraded":"2024-09-19T15:28:57.611715+0000","last_fullsized":"2024-09-19T15:28:57.611715+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:27:09.603584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6020926,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":521,"num_read_kb":6956,"num_write":932,"num_write_kb":25273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.171630+0000","last_change":"2024-09-19T13:40:38.229900+0000","last_active":"2024-09-19T15:27:32.171630+0000","last_peered":"2024-09-19T15:27:32.171630+0000","last_clean":"2024-09-19T15:27:32.171630+0000","last_became_active":"2024-09-19T13:40:38.229144+0000","last_became_peered":"2024-09-19T13:40:38.229144+0000","last_unstale":"2024-09-19T15:27:32.171630+0000","last_undegraded":"2024-09-19T15:27:32.171630+0000","last_fullsized":"2024-09-19T15:27:32.171630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:43.905801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'214","reported_seq":829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.912084+0000","last_change":"2024-09-19T13:40:40.249690+0000","last_active":"2024-09-19T15:31:17.912084+0000","last_peered":"2024-09-19T15:31:17.912084+0000","last_clean":"2024-09-19T15:31:17.912084+0000","last_became_active":"2024-09-19T13:40:40.249102+0000","last_became_peered":"2024-09-19T13:40:40.249102+0000","last_unstale":"2024-09-19T15:31:17.912084+0000","last_undegraded":"2024-09-19T15:31:17.912084+0000","last_fullsized":"2024-09-19T15:31:17.912084+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:09.297865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":198,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.395494+0000","last_change":"2024-09-19T13:40:42.254540+0000","last_active":"2024-09-19T15:29:02.395494+0000","last_peered":"2024-09-19T15:29:02.395494+0000","last_clean":"2024-09-19T15:29:02.395494+0000","last_became_active":"2024-09-19T13:40:42.250662+0000","last_became_peered":"2024-09-19T13:40:42.250662+0000","last_unstale":"2024-09-19T15:29:02.395494+0000","last_undegraded":"2024-09-19T15:29:02.395494+0000","last_fullsized":"2024-09-19T15:29:02.395494+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:12.417076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'126","reported_seq":718,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:43.404178+0000","last_change":"2024-09-19T13:40:44.267544+0000","last_active":"2024-09-19T15:29:43.404178+0000","last_peered":"2024-09-19T15:29:43.404178+0000","last_clean":"2024-09-19T15:29:43.404178+0000","last_became_active":"2024-09-19T13:40:44.266678+0000","last_became_peered":"2024-09-19T13:40:44.266678+0000","last_unstale":"2024-09-19T15:29:43.404178+0000","last_undegraded":"2024-09-19T15:29:43.404178+0000","last_fullsized":"2024-09-19T15:29:43.404178+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:56:44.218291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":283,"num_read_kb":273,"num_write":324,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'759","reported_seq":2286,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391645+0000","last_change":"2024-09-19T13:40:36.244736+0000","last_active":"2024-09-19T15:28:57.391645+0000","last_peered":"2024-09-19T15:28:57.391645+0000","last_clean":"2024-09-19T15:28:57.391645+0000","last_became_active":"2024-09-19T13:40:36.244403+0000","last_became_peered":"2024-09-19T13:40:36.244403+0000","last_unstale":"2024-09-19T15:28:57.391645+0000","last_undegraded":"2024-09-19T15:28:57.391645+0000","last_fullsized":"2024-09-19T15:28:57.391645+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:21.219635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3619,"num_read_kb":3269,"num_write":981,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'271","reported_seq":986,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:22.636959+0000","last_change":"2024-09-19T13:40:34.226710+0000","last_active":"2024-09-19T15:29:22.636959+0000","last_peered":"2024-09-19T15:29:22.636959+0000","last_clean":"2024-09-19T15:29:22.636959+0000","last_became_active":"2024-09-19T13:40:34.225452+0000","last_became_peered":"2024-09-19T13:40:34.225452+0000","last_unstale":"2024-09-19T15:29:22.636959+0000","last_undegraded":"2024-09-19T15:29:22.636959+0000","last_fullsized":"2024-09-19T15:29:22.636959+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:24:16.701686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1201774,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":543,"num_read_kb":97113,"num_write":1048,"num_write_kb":15979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":551,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.388367+0000","last_change":"2024-09-19T13:40:22.113821+0000","last_active":"2024-09-19T15:28:42.388367+0000","last_peered":"2024-09-19T15:28:42.388367+0000","last_clean":"2024-09-19T15:28:42.388367+0000","last_became_active":"2024-09-19T13:40:20.095294+0000","last_became_peered":"2024-09-19T13:40:20.095294+0000","last_unstale":"2024-09-19T15:28:42.388367+0000","last_undegraded":"2024-09-19T15:28:42.388367+0000","last_fullsized":"2024-09-19T15:28:42.388367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:38.696147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088577700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.191905+0000","last_change":"2024-09-19T13:40:38.230538+0000","last_active":"2024-09-19T15:29:02.191905+0000","last_peered":"2024-09-19T15:29:02.191905+0000","last_clean":"2024-09-19T15:29:02.191905+0000","last_became_active":"2024-09-19T13:40:38.229743+0000","last_became_peered":"2024-09-19T13:40:38.229743+0000","last_unstale":"2024-09-19T15:29:02.191905+0000","last_undegraded":"2024-09-19T15:29:02.191905+0000","last_fullsized":"2024-09-19T15:29:02.191905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:00.135611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'612","reported_seq":1337,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.082458+0000","last_change":"2024-09-19T13:40:40.224386+0000","last_active":"2024-09-19T15:31:18.082458+0000","last_peered":"2024-09-19T15:31:18.082458+0000","last_clean":"2024-09-19T15:31:18.082458+0000","last_became_active":"2024-09-19T13:40:40.223632+0000","last_became_peered":"2024-09-19T13:40:40.223632+0000","last_unstale":"2024-09-19T15:31:18.082458+0000","last_undegraded":"2024-09-19T15:31:18.082458+0000","last_fullsized":"2024-09-19T15:31:18.082458+0000","mapping_epoch":31,"log_start":"268'600","ondisk_log_start":"268'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:52.387211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116930,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1037,"num_read_kb":2015,"num_write":834,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.612861+0000","last_change":"2024-09-19T13:40:42.246177+0000","last_active":"2024-09-19T15:29:02.612861+0000","last_peered":"2024-09-19T15:29:02.612861+0000","last_clean":"2024-09-19T15:29:02.612861+0000","last_became_active":"2024-09-19T13:40:42.245476+0000","last_became_peered":"2024-09-19T13:40:42.245476+0000","last_unstale":"2024-09-19T15:29:02.612861+0000","last_undegraded":"2024-09-19T15:29:02.612861+0000","last_fullsized":"2024-09-19T15:29:02.612861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:33:09.183782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'141","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:11.923727+0000","last_change":"2024-09-19T13:40:44.275185+0000","last_active":"2024-09-19T15:31:11.923727+0000","last_peered":"2024-09-19T15:31:11.923727+0000","last_clean":"2024-09-19T15:31:11.923727+0000","last_became_active":"2024-09-19T13:40:44.274333+0000","last_became_peered":"2024-09-19T13:40:44.274333+0000","last_unstale":"2024-09-19T15:31:11.923727+0000","last_undegraded":"2024-09-19T15:31:11.923727+0000","last_fullsized":"2024-09-19T15:31:11.923727+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:10.763011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":236,"num_read_kb":218,"num_write":346,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'455","reported_seq":2038,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.656021+0000","last_change":"2024-09-19T13:40:36.242002+0000","last_active":"2024-09-19T15:29:50.656021+0000","last_peered":"2024-09-19T15:29:50.656021+0000","last_clean":"2024-09-19T15:29:50.656021+0000","last_became_active":"2024-09-19T13:40:36.241654+0000","last_became_peered":"2024-09-19T13:40:36.241654+0000","last_unstale":"2024-09-19T15:29:50.656021+0000","last_undegraded":"2024-09-19T15:29:50.656021+0000","last_fullsized":"2024-09-19T15:29:50.656021+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:39:35.530454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2406,"num_read_kb":2267,"num_write":541,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'252","reported_seq":903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391716+0000","last_change":"2024-09-19T13:40:34.249506+0000","last_active":"2024-09-19T15:28:57.391716+0000","last_peered":"2024-09-19T15:28:57.391716+0000","last_clean":"2024-09-19T15:28:57.391716+0000","last_became_active":"2024-09-19T13:40:34.248944+0000","last_became_peered":"2024-09-19T13:40:34.248944+0000","last_unstale":"2024-09-19T15:28:57.391716+0000","last_undegraded":"2024-09-19T15:28:57.391716+0000","last_fullsized":"2024-09-19T15:28:57.391716+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:14:45.859987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6359178,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":423,"num_read_kb":60020,"num_write":866,"num_write_kb":13648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":560,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:07.655294+0000","last_change":"2024-09-19T13:40:23.121258+0000","last_active":"2024-09-19T15:29:07.655294+0000","last_peered":"2024-09-19T15:29:07.655294+0000","last_clean":"2024-09-19T15:29:07.655294+0000","last_became_active":"2024-09-19T13:40:20.096321+0000","last_became_peered":"2024-09-19T13:40:20.096321+0000","last_unstale":"2024-09-19T15:29:07.655294+0000","last_undegraded":"2024-09-19T15:29:07.655294+0000","last_fullsized":"2024-09-19T15:29:07.655294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:56.853216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001025329,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.395362+0000","last_change":"2024-09-19T13:40:38.230448+0000","last_active":"2024-09-19T15:29:02.395362+0000","last_peered":"2024-09-19T15:29:02.395362+0000","last_clean":"2024-09-19T15:29:02.395362+0000","last_became_active":"2024-09-19T13:40:38.229784+0000","last_became_peered":"2024-09-19T13:40:38.229784+0000","last_unstale":"2024-09-19T15:29:02.395362+0000","last_undegraded":"2024-09-19T15:29:02.395362+0000","last_fullsized":"2024-09-19T15:29:02.395362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:28:13.132545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'339","reported_seq":975,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.261784+0000","last_change":"2024-09-19T13:40:40.240170+0000","last_active":"2024-09-19T15:31:18.261784+0000","last_peered":"2024-09-19T15:31:18.261784+0000","last_clean":"2024-09-19T15:31:18.261784+0000","last_became_active":"2024-09-19T13:40:40.239406+0000","last_became_peered":"2024-09-19T13:40:40.239406+0000","last_unstale":"2024-09-19T15:31:18.261784+0000","last_undegraded":"2024-09-19T15:31:18.261784+0000","last_fullsized":"2024-09-19T15:31:18.261784+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:48:52.979382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":438,"num_read_kb":429,"num_write":416,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'781","reported_seq":3357,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:16.991134+0000","last_change":"2024-09-19T13:40:42.245618+0000","last_active":"2024-09-19T15:31:16.991134+0000","last_peered":"2024-09-19T15:31:16.991134+0000","last_clean":"2024-09-19T15:31:16.991134+0000","last_became_active":"2024-09-19T13:40:42.244921+0000","last_became_peered":"2024-09-19T13:40:42.244921+0000","last_unstale":"2024-09-19T15:31:16.991134+0000","last_undegraded":"2024-09-19T15:31:16.991134+0000","last_fullsized":"2024-09-19T15:31:16.991134+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:59.793708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'142","reported_seq":702,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.263529+0000","last_change":"2024-09-19T13:40:44.279820+0000","last_active":"2024-09-19T15:31:13.263529+0000","last_peered":"2024-09-19T15:31:13.263529+0000","last_clean":"2024-09-19T15:31:13.263529+0000","last_became_active":"2024-09-19T13:40:44.277602+0000","last_became_peered":"2024-09-19T13:40:44.277602+0000","last_unstale":"2024-09-19T15:31:13.263529+0000","last_undegraded":"2024-09-19T15:31:13.263529+0000","last_fullsized":"2024-09-19T15:31:13.263529+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:34:45.143706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":303,"num_read_kb":269,"num_write":341,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'434","reported_seq":1934,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:48.240820+0000","last_change":"2024-09-19T13:40:36.235651+0000","last_active":"2024-09-19T15:28:48.240820+0000","last_peered":"2024-09-19T15:28:48.240820+0000","last_clean":"2024-09-19T15:28:48.240820+0000","last_became_active":"2024-09-19T13:40:36.235186+0000","last_became_peered":"2024-09-19T13:40:36.235186+0000","last_unstale":"2024-09-19T15:28:48.240820+0000","last_undegraded":"2024-09-19T15:28:48.240820+0000","last_fullsized":"2024-09-19T15:28:48.240820+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:14.271645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2268,"num_read_kb":2120,"num_write":492,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'347","reported_seq":1184,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:58.243544+0000","last_change":"2024-09-19T13:40:34.236743+0000","last_active":"2024-09-19T15:28:58.243544+0000","last_peered":"2024-09-19T15:28:58.243544+0000","last_clean":"2024-09-19T15:28:58.243544+0000","last_became_active":"2024-09-19T13:40:34.236325+0000","last_became_peered":"2024-09-19T13:40:34.236325+0000","last_unstale":"2024-09-19T15:28:58.243544+0000","last_undegraded":"2024-09-19T15:28:58.243544+0000","last_fullsized":"2024-09-19T15:28:58.243544+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:08.160460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26215291,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":790,"num_read_kb":111535,"num_write":1242,"num_write_kb":62709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":549,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.388450+0000","last_change":"2024-09-19T13:40:22.113992+0000","last_active":"2024-09-19T15:28:42.388450+0000","last_peered":"2024-09-19T15:28:42.388450+0000","last_clean":"2024-09-19T15:28:42.388450+0000","last_became_active":"2024-09-19T13:40:20.101186+0000","last_became_peered":"2024-09-19T13:40:20.101186+0000","last_unstale":"2024-09-19T15:28:42.388450+0000","last_undegraded":"2024-09-19T15:28:42.388450+0000","last_fullsized":"2024-09-19T15:28:42.388450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:40.208910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010323750000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.612811+0000","last_change":"2024-09-19T13:40:38.235854+0000","last_active":"2024-09-19T15:29:02.612811+0000","last_peered":"2024-09-19T15:29:02.612811+0000","last_clean":"2024-09-19T15:29:02.612811+0000","last_became_active":"2024-09-19T13:40:38.235109+0000","last_became_peered":"2024-09-19T13:40:38.235109+0000","last_unstale":"2024-09-19T15:29:02.612811+0000","last_undegraded":"2024-09-19T15:29:02.612811+0000","last_fullsized":"2024-09-19T15:29:02.612811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:18.997643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'193","reported_seq":793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.185499+0000","last_change":"2024-09-19T13:40:40.248167+0000","last_active":"2024-09-19T15:31:18.185499+0000","last_peered":"2024-09-19T15:31:18.185499+0000","last_clean":"2024-09-19T15:31:18.185499+0000","last_became_active":"2024-09-19T13:40:40.244484+0000","last_became_peered":"2024-09-19T13:40:40.244484+0000","last_unstale":"2024-09-19T15:31:18.185499+0000","last_undegraded":"2024-09-19T15:31:18.185499+0000","last_fullsized":"2024-09-19T15:31:18.185499+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:26.251998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":238,"num_read_kb":228,"num_write":166,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'782","reported_seq":5105,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:16.987086+0000","last_change":"2024-09-19T13:40:42.258379+0000","last_active":"2024-09-19T15:31:16.987086+0000","last_peered":"2024-09-19T15:31:16.987086+0000","last_clean":"2024-09-19T15:31:16.987086+0000","last_became_active":"2024-09-19T13:40:42.257799+0000","last_became_peered":"2024-09-19T13:40:42.257799+0000","last_unstale":"2024-09-19T15:31:16.987086+0000","last_undegraded":"2024-09-19T15:31:16.987086+0000","last_fullsized":"2024-09-19T15:31:16.987086+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:03:48.981520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'191","reported_seq":724,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.522019+0000","last_change":"2024-09-19T13:40:44.259985+0000","last_active":"2024-09-19T15:29:48.522019+0000","last_peered":"2024-09-19T15:29:48.522019+0000","last_clean":"2024-09-19T15:29:48.522019+0000","last_became_active":"2024-09-19T13:40:44.259077+0000","last_became_peered":"2024-09-19T13:40:44.259077+0000","last_unstale":"2024-09-19T15:29:48.522019+0000","last_undegraded":"2024-09-19T15:29:48.522019+0000","last_fullsized":"2024-09-19T15:29:48.522019+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:06:05.199311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":211,"num_read_kb":198,"num_write":423,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'428","reported_seq":1954,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.611513+0000","last_change":"2024-09-19T13:40:36.243340+0000","last_active":"2024-09-19T15:28:57.611513+0000","last_peered":"2024-09-19T15:28:57.611513+0000","last_clean":"2024-09-19T15:28:57.611513+0000","last_became_active":"2024-09-19T13:40:36.242739+0000","last_became_peered":"2024-09-19T13:40:36.242739+0000","last_unstale":"2024-09-19T15:28:57.611513+0000","last_undegraded":"2024-09-19T15:28:57.611513+0000","last_fullsized":"2024-09-19T15:28:57.611513+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:12.677759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2240,"num_read_kb":2109,"num_write":493,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'249","reported_seq":901,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:06.812877+0000","last_change":"2024-09-19T13:41:05.316778+0000","last_active":"2024-09-19T15:31:06.812877+0000","last_peered":"2024-09-19T15:31:06.812877+0000","last_clean":"2024-09-19T15:31:06.812877+0000","last_became_active":"2024-09-19T13:41:05.316287+0000","last_became_peered":"2024-09-19T13:41:05.316287+0000","last_unstale":"2024-09-19T15:31:06.812877+0000","last_undegraded":"2024-09-19T15:31:06.812877+0000","last_fullsized":"2024-09-19T15:31:06.812877+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:28.207137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6290137,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":584,"num_read_kb":12872,"num_write":961,"num_write_kb":31603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":546,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.390813+0000","last_change":"2024-09-19T13:40:22.308878+0000","last_active":"2024-09-19T15:28:42.390813+0000","last_peered":"2024-09-19T15:28:42.390813+0000","last_clean":"2024-09-19T15:28:42.390813+0000","last_became_active":"2024-09-19T13:40:20.103134+0000","last_became_peered":"2024-09-19T13:40:20.103134+0000","last_unstale":"2024-09-19T15:28:42.390813+0000","last_undegraded":"2024-09-19T15:28:42.390813+0000","last_fullsized":"2024-09-19T15:28:42.390813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:38.150405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093870599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:53.241996+0000","last_change":"2024-09-19T13:40:38.221807+0000","last_active":"2024-09-19T15:28:53.241996+0000","last_peered":"2024-09-19T15:28:53.241996+0000","last_clean":"2024-09-19T15:28:53.241996+0000","last_became_active":"2024-09-19T13:40:38.221430+0000","last_became_peered":"2024-09-19T13:40:38.221430+0000","last_unstale":"2024-09-19T15:28:53.241996+0000","last_undegraded":"2024-09-19T15:28:53.241996+0000","last_fullsized":"2024-09-19T15:28:53.241996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:13.637760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'825","reported_seq":1602,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.147205+0000","last_change":"2024-09-19T13:40:40.230230+0000","last_active":"2024-09-19T15:31:18.147205+0000","last_peered":"2024-09-19T15:31:18.147205+0000","last_clean":"2024-09-19T15:31:18.147205+0000","last_became_active":"2024-09-19T13:40:40.229426+0000","last_became_peered":"2024-09-19T13:40:40.229426+0000","last_unstale":"2024-09-19T15:31:18.147205+0000","last_undegraded":"2024-09-19T15:31:18.147205+0000","last_fullsized":"2024-09-19T15:31:18.147205+0000","mapping_epoch":31,"log_start":"268'800","ondisk_log_start":"268'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:41:10.280326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181238,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1441,"num_read_kb":2990,"num_write":1182,"num_write_kb":940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:03.244490+0000","last_change":"2024-09-19T13:40:42.245759+0000","last_active":"2024-09-19T15:29:03.244490+0000","last_peered":"2024-09-19T15:29:03.244490+0000","last_clean":"2024-09-19T15:29:03.244490+0000","last_became_active":"2024-09-19T13:40:42.244291+0000","last_became_peered":"2024-09-19T13:40:42.244291+0000","last_unstale":"2024-09-19T15:29:03.244490+0000","last_undegraded":"2024-09-19T15:29:03.244490+0000","last_fullsized":"2024-09-19T15:29:03.244490+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:28.425275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'152","reported_seq":709,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:47.628704+0000","last_change":"2024-09-19T13:40:44.274189+0000","last_active":"2024-09-19T15:28:47.628704+0000","last_peered":"2024-09-19T15:28:47.628704+0000","last_clean":"2024-09-19T15:28:47.628704+0000","last_became_active":"2024-09-19T13:40:44.273409+0000","last_became_peered":"2024-09-19T13:40:44.273409+0000","last_unstale":"2024-09-19T15:28:47.628704+0000","last_undegraded":"2024-09-19T15:28:47.628704+0000","last_fullsized":"2024-09-19T15:28:47.628704+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:21.357101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":293,"num_read_kb":268,"num_write":395,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'157","reported_seq":741,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:51.129484+0000","last_change":"2024-09-19T13:40:44.264292+0000","last_active":"2024-09-19T15:29:51.129484+0000","last_peered":"2024-09-19T15:29:51.129484+0000","last_clean":"2024-09-19T15:29:51.129484+0000","last_became_active":"2024-09-19T13:40:44.263575+0000","last_became_peered":"2024-09-19T13:40:44.263575+0000","last_unstale":"2024-09-19T15:29:51.129484+0000","last_undegraded":"2024-09-19T15:29:51.129484+0000","last_fullsized":"2024-09-19T15:29:51.129484+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:21.299012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":274,"num_read_kb":267,"num_write":381,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'488","reported_seq":2271,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:49.327444+0000","last_change":"2024-09-19T13:40:36.228857+0000","last_active":"2024-09-19T15:28:49.327444+0000","last_peered":"2024-09-19T15:28:49.327444+0000","last_clean":"2024-09-19T15:28:49.327444+0000","last_became_active":"2024-09-19T13:40:36.221019+0000","last_became_peered":"2024-09-19T13:40:36.221019+0000","last_unstale":"2024-09-19T15:28:49.327444+0000","last_undegraded":"2024-09-19T15:28:49.327444+0000","last_fullsized":"2024-09-19T15:28:49.327444+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:18:02.656810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2720,"num_read_kb":2588,"num_write":552,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'326","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:17.602405+0000","last_change":"2024-09-19T13:40:34.268385+0000","last_active":"2024-09-19T15:28:17.602405+0000","last_peered":"2024-09-19T15:28:17.602405+0000","last_clean":"2024-09-19T15:28:17.602405+0000","last_became_active":"2024-09-19T13:40:34.263276+0000","last_became_peered":"2024-09-19T13:40:34.263276+0000","last_unstale":"2024-09-19T15:28:17.602405+0000","last_undegraded":"2024-09-19T15:28:17.602405+0000","last_fullsized":"2024-09-19T15:28:17.602405+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:53.534025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141461,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":617,"num_read_kb":11371,"num_write":1159,"num_write_kb":39217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"37'5","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.117589+0000","last_change":"2024-09-19T13:40:38.216204+0000","last_active":"2024-09-19T15:31:13.117589+0000","last_peered":"2024-09-19T15:31:13.117589+0000","last_clean":"2024-09-19T15:31:13.117589+0000","last_became_active":"2024-09-19T13:40:38.215364+0000","last_became_peered":"2024-09-19T13:40:38.215364+0000","last_unstale":"2024-09-19T15:31:13.117589+0000","last_undegraded":"2024-09-19T15:31:13.117589+0000","last_fullsized":"2024-09-19T15:31:13.117589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:27.296619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":720,"num_read_kb":1179,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'355","reported_seq":984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.274430+0000","last_change":"2024-09-19T13:40:40.230669+0000","last_active":"2024-09-19T15:31:18.274430+0000","last_peered":"2024-09-19T15:31:18.274430+0000","last_clean":"2024-09-19T15:31:18.274430+0000","last_became_active":"2024-09-19T13:40:40.229872+0000","last_became_peered":"2024-09-19T13:40:40.229872+0000","last_unstale":"2024-09-19T15:31:18.274430+0000","last_undegraded":"2024-09-19T15:31:18.274430+0000","last_fullsized":"2024-09-19T15:31:18.274430+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:36.305353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148208,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":572,"num_read_kb":1295,"num_write":462,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:03.230352+0000","last_change":"2024-09-19T13:40:42.243067+0000","last_active":"2024-09-19T15:28:03.230352+0000","last_peered":"2024-09-19T15:28:03.230352+0000","last_clean":"2024-09-19T15:28:03.230352+0000","last_became_active":"2024-09-19T13:40:42.242368+0000","last_became_peered":"2024-09-19T13:40:42.242368+0000","last_unstale":"2024-09-19T15:28:03.230352+0000","last_undegraded":"2024-09-19T15:28:03.230352+0000","last_fullsized":"2024-09-19T15:28:03.230352+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:59.628504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'121","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:46.522969+0000","last_change":"2024-09-19T13:40:44.269881+0000","last_active":"2024-09-19T15:29:46.522969+0000","last_peered":"2024-09-19T15:29:46.522969+0000","last_clean":"2024-09-19T15:29:46.522969+0000","last_became_active":"2024-09-19T13:40:44.268946+0000","last_became_peered":"2024-09-19T13:40:44.268946+0000","last_unstale":"2024-09-19T15:29:46.522969+0000","last_undegraded":"2024-09-19T15:29:46.522969+0000","last_fullsized":"2024-09-19T15:29:46.522969+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:40.184840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":128,"num_write":265,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'468","reported_seq":2032,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:19.439069+0000","last_change":"2024-09-19T13:40:36.226704+0000","last_active":"2024-09-19T15:28:19.439069+0000","last_peered":"2024-09-19T15:28:19.439069+0000","last_clean":"2024-09-19T15:28:19.439069+0000","last_became_active":"2024-09-19T13:40:36.226164+0000","last_became_peered":"2024-09-19T13:40:36.226164+0000","last_unstale":"2024-09-19T15:28:19.439069+0000","last_undegraded":"2024-09-19T15:28:19.439069+0000","last_fullsized":"2024-09-19T15:28:19.439069+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:08.833158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2492,"num_read_kb":2321,"num_write":561,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'252","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:26.080136+0000","last_change":"2024-09-19T13:41:05.389078+0000","last_active":"2024-09-19T15:29:26.080136+0000","last_peered":"2024-09-19T15:29:26.080136+0000","last_clean":"2024-09-19T15:29:26.080136+0000","last_became_active":"2024-09-19T13:41:05.387779+0000","last_became_peered":"2024-09-19T13:41:05.387779+0000","last_unstale":"2024-09-19T15:29:26.080136+0000","last_undegraded":"2024-09-19T15:29:26.080136+0000","last_fullsized":"2024-09-19T15:29:26.080136+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:33:11.159579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14914337,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":835,"num_read_kb":29706,"num_write":955,"num_write_kb":41961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:03.230639+0000","last_change":"2024-09-19T13:40:38.229142+0000","last_active":"2024-09-19T15:28:03.230639+0000","last_peered":"2024-09-19T15:28:03.230639+0000","last_clean":"2024-09-19T15:28:03.230639+0000","last_became_active":"2024-09-19T13:40:38.228856+0000","last_became_peered":"2024-09-19T13:40:38.228856+0000","last_unstale":"2024-09-19T15:28:03.230639+0000","last_undegraded":"2024-09-19T15:28:03.230639+0000","last_fullsized":"2024-09-19T15:28:03.230639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:01.786775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'85","reported_seq":624,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.250690+0000","last_change":"2024-09-19T13:40:40.236243+0000","last_active":"2024-09-19T15:31:17.250690+0000","last_peered":"2024-09-19T15:31:17.250690+0000","last_clean":"2024-09-19T15:31:17.250690+0000","last_became_active":"2024-09-19T13:40:40.235528+0000","last_became_peered":"2024-09-19T13:40:40.235528+0000","last_unstale":"2024-09-19T15:31:17.250690+0000","last_undegraded":"2024-09-19T15:31:17.250690+0000","last_fullsized":"2024-09-19T15:31:17.250690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:33:05.231869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":75,"num_write":58,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.639370+0000","last_change":"2024-09-19T13:40:42.243881+0000","last_active":"2024-09-19T15:28:02.639370+0000","last_peered":"2024-09-19T15:28:02.639370+0000","last_clean":"2024-09-19T15:28:02.639370+0000","last_became_active":"2024-09-19T13:40:42.243224+0000","last_became_peered":"2024-09-19T13:40:42.243224+0000","last_unstale":"2024-09-19T15:28:02.639370+0000","last_undegraded":"2024-09-19T15:28:02.639370+0000","last_fullsized":"2024-09-19T15:28:02.639370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:08:53.998486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'210","reported_seq":756,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.410376+0000","last_change":"2024-09-19T13:40:44.259510+0000","last_active":"2024-09-19T15:29:48.410376+0000","last_peered":"2024-09-19T15:29:48.410376+0000","last_clean":"2024-09-19T15:29:48.410376+0000","last_became_active":"2024-09-19T13:40:44.258721+0000","last_became_peered":"2024-09-19T13:40:44.258721+0000","last_unstale":"2024-09-19T15:29:48.410376+0000","last_undegraded":"2024-09-19T15:29:48.410376+0000","last_fullsized":"2024-09-19T15:29:48.410376+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:08.449777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":369,"num_read_kb":358,"num_write":477,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'367","reported_seq":1888,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.249898+0000","last_change":"2024-09-19T13:40:36.240148+0000","last_active":"2024-09-19T15:31:12.249898+0000","last_peered":"2024-09-19T15:31:12.249898+0000","last_clean":"2024-09-19T15:31:12.249898+0000","last_became_active":"2024-09-19T13:40:36.239629+0000","last_became_peered":"2024-09-19T13:40:36.239629+0000","last_unstale":"2024-09-19T15:31:12.249898+0000","last_undegraded":"2024-09-19T15:31:12.249898+0000","last_fullsized":"2024-09-19T15:31:12.249898+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:24.215137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2075,"num_read_kb":1985,"num_write":419,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'267","reported_seq":941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:40.662828+0000","last_change":"2024-09-19T13:40:34.257051+0000","last_active":"2024-09-19T15:27:40.662828+0000","last_peered":"2024-09-19T15:27:40.662828+0000","last_clean":"2024-09-19T15:27:40.662828+0000","last_became_active":"2024-09-19T13:40:34.256236+0000","last_became_peered":"2024-09-19T13:40:34.256236+0000","last_unstale":"2024-09-19T15:27:40.662828+0000","last_undegraded":"2024-09-19T15:27:40.662828+0000","last_fullsized":"2024-09-19T15:27:40.662828+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:27:07.032068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8287774,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":501,"num_read_kb":16816,"num_write":923,"num_write_kb":29952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.639311+0000","last_change":"2024-09-19T13:40:38.252067+0000","last_active":"2024-09-19T15:28:02.639311+0000","last_peered":"2024-09-19T15:28:02.639311+0000","last_clean":"2024-09-19T15:28:02.639311+0000","last_became_active":"2024-09-19T13:40:38.249269+0000","last_became_peered":"2024-09-19T13:40:38.249269+0000","last_unstale":"2024-09-19T15:28:02.639311+0000","last_undegraded":"2024-09-19T15:28:02.639311+0000","last_fullsized":"2024-09-19T15:28:02.639311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:17.524647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'352","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.108327+0000","last_change":"2024-09-19T13:40:40.230649+0000","last_active":"2024-09-19T15:31:18.108327+0000","last_peered":"2024-09-19T15:31:18.108327+0000","last_clean":"2024-09-19T15:31:18.108327+0000","last_became_active":"2024-09-19T13:40:40.229852+0000","last_became_peered":"2024-09-19T13:40:40.229852+0000","last_unstale":"2024-09-19T15:31:18.108327+0000","last_undegraded":"2024-09-19T15:31:18.108327+0000","last_fullsized":"2024-09-19T15:31:18.108327+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:48.815571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56415,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":573,"num_read_kb":1060,"num_write":448,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.381985+0000","last_change":"2024-09-19T13:40:42.250045+0000","last_active":"2024-09-19T15:28:02.381985+0000","last_peered":"2024-09-19T15:28:02.381985+0000","last_clean":"2024-09-19T15:28:02.381985+0000","last_became_active":"2024-09-19T13:40:42.240135+0000","last_became_peered":"2024-09-19T13:40:42.240135+0000","last_unstale":"2024-09-19T15:28:02.381985+0000","last_undegraded":"2024-09-19T15:28:02.381985+0000","last_fullsized":"2024-09-19T15:28:02.381985+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:14.195144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'85","reported_seq":635,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:45.986381+0000","last_change":"2024-09-19T13:40:44.269896+0000","last_active":"2024-09-19T15:28:45.986381+0000","last_peered":"2024-09-19T15:28:45.986381+0000","last_clean":"2024-09-19T15:28:45.986381+0000","last_became_active":"2024-09-19T13:40:44.269134+0000","last_became_peered":"2024-09-19T13:40:44.269134+0000","last_unstale":"2024-09-19T15:28:45.986381+0000","last_undegraded":"2024-09-19T15:28:45.986381+0000","last_fullsized":"2024-09-19T15:28:45.986381+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:09.390631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":160,"num_write":196,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'609","reported_seq":2425,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.655880+0000","last_change":"2024-09-19T13:40:36.219585+0000","last_active":"2024-09-19T15:29:50.655880+0000","last_peered":"2024-09-19T15:29:50.655880+0000","last_clean":"2024-09-19T15:29:50.655880+0000","last_became_active":"2024-09-19T13:40:36.217925+0000","last_became_peered":"2024-09-19T13:40:36.217925+0000","last_unstale":"2024-09-19T15:29:50.655880+0000","last_undegraded":"2024-09-19T15:29:50.655880+0000","last_fullsized":"2024-09-19T15:29:50.655880+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":500,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:53.942689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3256,"num_read_kb":3011,"num_write":769,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'282","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:26.609546+0000","last_change":"2024-09-19T13:40:34.228238+0000","last_active":"2024-09-19T15:28:26.609546+0000","last_peered":"2024-09-19T15:28:26.609546+0000","last_clean":"2024-09-19T15:28:26.609546+0000","last_became_active":"2024-09-19T13:40:34.227791+0000","last_became_peered":"2024-09-19T13:40:34.227791+0000","last_unstale":"2024-09-19T15:28:26.609546+0000","last_undegraded":"2024-09-19T15:28:26.609546+0000","last_fullsized":"2024-09-19T15:28:26.609546+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:08.249649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6537694,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":454,"num_read_kb":35857,"num_write":975,"num_write_kb":31805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.381920+0000","last_change":"2024-09-19T13:40:38.246952+0000","last_active":"2024-09-19T15:28:02.381920+0000","last_peered":"2024-09-19T15:28:02.381920+0000","last_clean":"2024-09-19T15:28:02.381920+0000","last_became_active":"2024-09-19T13:40:38.246129+0000","last_became_peered":"2024-09-19T13:40:38.246129+0000","last_unstale":"2024-09-19T15:28:02.381920+0000","last_undegraded":"2024-09-19T15:28:02.381920+0000","last_fullsized":"2024-09-19T15:28:02.381920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:34.896613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'310","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.692762+0000","last_change":"2024-09-19T13:40:40.219645+0000","last_active":"2024-09-19T15:31:17.692762+0000","last_peered":"2024-09-19T15:31:17.692762+0000","last_clean":"2024-09-19T15:31:17.692762+0000","last_became_active":"2024-09-19T13:40:40.218434+0000","last_became_peered":"2024-09-19T13:40:40.218434+0000","last_unstale":"2024-09-19T15:31:17.692762+0000","last_undegraded":"2024-09-19T15:31:17.692762+0000","last_fullsized":"2024-09-19T15:31:17.692762+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:27.205776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54978,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":1000,"num_write":408,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.178023+0000","last_change":"2024-09-19T13:40:42.240830+0000","last_active":"2024-09-19T15:28:02.178023+0000","last_peered":"2024-09-19T15:28:02.178023+0000","last_clean":"2024-09-19T15:28:02.178023+0000","last_became_active":"2024-09-19T13:40:42.238908+0000","last_became_peered":"2024-09-19T13:40:42.238908+0000","last_unstale":"2024-09-19T15:28:02.178023+0000","last_undegraded":"2024-09-19T15:28:02.178023+0000","last_fullsized":"2024-09-19T15:28:02.178023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:27.434117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'522","reported_seq":2138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.266057+0000","last_change":"2024-09-19T13:40:36.244240+0000","last_active":"2024-09-19T15:31:12.266057+0000","last_peered":"2024-09-19T15:31:12.266057+0000","last_clean":"2024-09-19T15:31:12.266057+0000","last_became_active":"2024-09-19T13:40:36.243653+0000","last_became_peered":"2024-09-19T13:40:36.243653+0000","last_unstale":"2024-09-19T15:31:12.266057+0000","last_undegraded":"2024-09-19T15:31:12.266057+0000","last_fullsized":"2024-09-19T15:31:12.266057+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:58.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2759,"num_read_kb":2556,"num_write":676,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'296","reported_seq":938,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:26:58.214536+0000","last_change":"2024-09-19T13:40:34.220157+0000","last_active":"2024-09-19T15:26:58.214536+0000","last_peered":"2024-09-19T15:26:58.214536+0000","last_clean":"2024-09-19T15:26:58.214536+0000","last_became_active":"2024-09-19T13:40:34.219131+0000","last_became_peered":"2024-09-19T13:40:34.219131+0000","last_unstale":"2024-09-19T15:26:58.214536+0000","last_undegraded":"2024-09-19T15:26:58.214536+0000","last_fullsized":"2024-09-19T15:26:58.214536+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:20.075063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14133446,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":465,"num_read_kb":16977,"num_write":1113,"num_write_kb":67471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:17.195724+0000","last_change":"2024-09-19T13:40:38.232297+0000","last_active":"2024-09-19T15:29:17.195724+0000","last_peered":"2024-09-19T15:29:17.195724+0000","last_clean":"2024-09-19T15:29:17.195724+0000","last_became_active":"2024-09-19T13:40:38.231992+0000","last_became_peered":"2024-09-19T13:40:38.231992+0000","last_unstale":"2024-09-19T15:29:17.195724+0000","last_undegraded":"2024-09-19T15:29:17.195724+0000","last_fullsized":"2024-09-19T15:29:17.195724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:52.322584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'553","reported_seq":1214,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.325890+0000","last_change":"2024-09-19T13:40:40.242437+0000","last_active":"2024-09-19T15:31:18.325890+0000","last_peered":"2024-09-19T15:31:18.325890+0000","last_clean":"2024-09-19T15:31:18.325890+0000","last_became_active":"2024-09-19T13:40:40.241045+0000","last_became_peered":"2024-09-19T13:40:40.241045+0000","last_unstale":"2024-09-19T15:31:18.325890+0000","last_undegraded":"2024-09-19T15:31:18.325890+0000","last_fullsized":"2024-09-19T15:31:18.325890+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:12.858930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124726,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":2048,"num_write":852,"num_write_kb":745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.620732+0000","last_change":"2024-09-19T13:40:42.266732+0000","last_active":"2024-09-19T15:28:12.620732+0000","last_peered":"2024-09-19T15:28:12.620732+0000","last_clean":"2024-09-19T15:28:12.620732+0000","last_became_active":"2024-09-19T13:40:42.266161+0000","last_became_peered":"2024-09-19T13:40:42.266161+0000","last_unstale":"2024-09-19T15:28:12.620732+0000","last_undegraded":"2024-09-19T15:28:12.620732+0000","last_fullsized":"2024-09-19T15:28:12.620732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:36.831314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'153","reported_seq":684,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:08.231621+0000","last_change":"2024-09-19T13:40:44.280809+0000","last_active":"2024-09-19T15:28:08.231621+0000","last_peered":"2024-09-19T15:28:08.231621+0000","last_clean":"2024-09-19T15:28:08.231621+0000","last_became_active":"2024-09-19T13:40:44.280362+0000","last_became_peered":"2024-09-19T13:40:44.280362+0000","last_unstale":"2024-09-19T15:28:08.231621+0000","last_undegraded":"2024-09-19T15:28:08.231621+0000","last_fullsized":"2024-09-19T15:28:08.231621+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:26:28.134421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":216,"num_read_kb":226,"num_write":329,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'908","reported_seq":2606,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.194253+0000","last_change":"2024-09-19T13:40:36.234854+0000","last_active":"2024-09-19T15:29:12.194253+0000","last_peered":"2024-09-19T15:29:12.194253+0000","last_clean":"2024-09-19T15:29:12.194253+0000","last_became_active":"2024-09-19T13:40:36.234428+0000","last_became_peered":"2024-09-19T13:40:36.234428+0000","last_unstale":"2024-09-19T15:29:12.194253+0000","last_undegraded":"2024-09-19T15:29:12.194253+0000","last_fullsized":"2024-09-19T15:29:12.194253+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":800,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:32.532292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4426,"num_read_kb":3975,"num_write":1248,"num_write_kb":508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'320","reported_seq":1030,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:27.370254+0000","last_change":"2024-09-19T13:40:34.250086+0000","last_active":"2024-09-19T15:27:27.370254+0000","last_peered":"2024-09-19T15:27:27.370254+0000","last_clean":"2024-09-19T15:27:27.370254+0000","last_became_active":"2024-09-19T13:40:34.249719+0000","last_became_peered":"2024-09-19T13:40:34.249719+0000","last_unstale":"2024-09-19T15:27:27.370254+0000","last_undegraded":"2024-09-19T15:27:27.370254+0000","last_fullsized":"2024-09-19T15:27:27.370254+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:25:54.224688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27268747,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":624,"num_read_kb":108324,"num_write":1235,"num_write_kb":34137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"37'3","reported_seq":998,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.121055+0000","last_change":"2024-09-19T13:40:38.246559+0000","last_active":"2024-09-19T15:31:13.121055+0000","last_peered":"2024-09-19T15:31:13.121055+0000","last_clean":"2024-09-19T15:31:13.121055+0000","last_became_active":"2024-09-19T13:40:38.245835+0000","last_became_peered":"2024-09-19T13:40:38.245835+0000","last_unstale":"2024-09-19T15:31:13.121055+0000","last_undegraded":"2024-09-19T15:31:13.121055+0000","last_fullsized":"2024-09-19T15:31:13.121055+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:31:52.188595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":718,"num_read_kb":716,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'382","reported_seq":1032,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.925493+0000","last_change":"2024-09-19T13:40:40.238081+0000","last_active":"2024-09-19T15:31:17.925493+0000","last_peered":"2024-09-19T15:31:17.925493+0000","last_clean":"2024-09-19T15:31:17.925493+0000","last_became_active":"2024-09-19T13:40:40.237537+0000","last_became_peered":"2024-09-19T13:40:40.237537+0000","last_unstale":"2024-09-19T15:31:17.925493+0000","last_undegraded":"2024-09-19T15:31:17.925493+0000","last_fullsized":"2024-09-19T15:31:17.925493+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:45.292548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58124,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":640,"num_read_kb":1140,"num_write":530,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381450+0000","last_change":"2024-09-19T13:40:42.252696+0000","last_active":"2024-09-19T15:28:12.381450+0000","last_peered":"2024-09-19T15:28:12.381450+0000","last_clean":"2024-09-19T15:28:12.381450+0000","last_became_active":"2024-09-19T13:40:42.251896+0000","last_became_peered":"2024-09-19T13:40:42.251896+0000","last_unstale":"2024-09-19T15:28:12.381450+0000","last_undegraded":"2024-09-19T15:28:12.381450+0000","last_fullsized":"2024-09-19T15:28:12.381450+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:38.583676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'201","reported_seq":1087,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:43.276093+0000","last_change":"2024-09-19T13:40:44.269379+0000","last_active":"2024-09-19T15:29:43.276093+0000","last_peered":"2024-09-19T15:29:43.276093+0000","last_clean":"2024-09-19T15:29:43.276093+0000","last_became_active":"2024-09-19T13:40:44.268710+0000","last_became_peered":"2024-09-19T13:40:44.268710+0000","last_unstale":"2024-09-19T15:29:43.276093+0000","last_undegraded":"2024-09-19T15:29:43.276093+0000","last_fullsized":"2024-09-19T15:29:43.276093+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:25.122775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":655,"num_read_kb":652,"num_write":565,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'581","reported_seq":2263,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:49.326176+0000","last_change":"2024-09-19T13:40:36.218790+0000","last_active":"2024-09-19T15:28:49.326176+0000","last_peered":"2024-09-19T15:28:49.326176+0000","last_clean":"2024-09-19T15:28:49.326176+0000","last_became_active":"2024-09-19T13:40:36.217961+0000","last_became_peered":"2024-09-19T13:40:36.217961+0000","last_unstale":"2024-09-19T15:28:49.326176+0000","last_undegraded":"2024-09-19T15:28:49.326176+0000","last_fullsized":"2024-09-19T15:28:49.326176+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:06.866384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2994,"num_read_kb":2751,"num_write":739,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'286","reported_seq":1084,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.600035+0000","last_change":"2024-09-19T13:40:34.254466+0000","last_active":"2024-09-19T15:28:07.600035+0000","last_peered":"2024-09-19T15:28:07.600035+0000","last_clean":"2024-09-19T15:28:07.600035+0000","last_became_active":"2024-09-19T13:40:34.253708+0000","last_became_peered":"2024-09-19T13:40:34.253708+0000","last_unstale":"2024-09-19T15:28:07.600035+0000","last_undegraded":"2024-09-19T15:28:07.600035+0000","last_fullsized":"2024-09-19T15:28:07.600035+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:37:08.846663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11538842,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":683,"num_read_kb":54804,"num_write":1014,"num_write_kb":28785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.601276+0000","last_change":"2024-09-19T13:40:38.245697+0000","last_active":"2024-09-19T15:28:12.601276+0000","last_peered":"2024-09-19T15:28:12.601276+0000","last_clean":"2024-09-19T15:28:12.601276+0000","last_became_active":"2024-09-19T13:40:38.245018+0000","last_became_peered":"2024-09-19T13:40:38.245018+0000","last_unstale":"2024-09-19T15:28:12.601276+0000","last_undegraded":"2024-09-19T15:28:12.601276+0000","last_fullsized":"2024-09-19T15:28:12.601276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:48.463235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'344","reported_seq":978,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.287171+0000","last_change":"2024-09-19T13:40:40.234381+0000","last_active":"2024-09-19T15:31:18.287171+0000","last_peered":"2024-09-19T15:31:18.287171+0000","last_clean":"2024-09-19T15:31:18.287171+0000","last_became_active":"2024-09-19T13:40:40.229201+0000","last_became_peered":"2024-09-19T13:40:40.229201+0000","last_unstale":"2024-09-19T15:31:18.287171+0000","last_undegraded":"2024-09-19T15:31:18.287171+0000","last_fullsized":"2024-09-19T15:31:18.287171+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:53.097533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54800,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":554,"num_read_kb":1032,"num_write":448,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.395355+0000","last_change":"2024-09-19T13:40:42.247045+0000","last_active":"2024-09-19T15:29:12.395355+0000","last_peered":"2024-09-19T15:29:12.395355+0000","last_clean":"2024-09-19T15:29:12.395355+0000","last_became_active":"2024-09-19T13:40:42.246286+0000","last_became_peered":"2024-09-19T13:40:42.246286+0000","last_unstale":"2024-09-19T15:29:12.395355+0000","last_undegraded":"2024-09-19T15:29:12.395355+0000","last_fullsized":"2024-09-19T15:29:12.395355+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:20:14.165507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'161","reported_seq":725,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.256170+0000","last_change":"2024-09-19T13:40:44.270342+0000","last_active":"2024-09-19T15:31:13.256170+0000","last_peered":"2024-09-19T15:31:13.256170+0000","last_clean":"2024-09-19T15:31:13.256170+0000","last_became_active":"2024-09-19T13:40:44.267428+0000","last_became_peered":"2024-09-19T13:40:44.267428+0000","last_unstale":"2024-09-19T15:31:13.256170+0000","last_undegraded":"2024-09-19T15:31:13.256170+0000","last_fullsized":"2024-09-19T15:31:13.256170+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:14.956268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":325,"num_read_kb":284,"num_write":406,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'372","reported_seq":2097,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.308591+0000","last_change":"2024-09-19T13:40:36.231144+0000","last_active":"2024-09-19T15:29:41.308591+0000","last_peered":"2024-09-19T15:29:41.308591+0000","last_clean":"2024-09-19T15:29:41.308591+0000","last_became_active":"2024-09-19T13:40:36.230842+0000","last_became_peered":"2024-09-19T13:40:36.230842+0000","last_unstale":"2024-09-19T15:29:41.308591+0000","last_undegraded":"2024-09-19T15:29:41.308591+0000","last_fullsized":"2024-09-19T15:29:41.308591+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:13.952447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2340,"num_read_kb":2286,"num_write":408,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'326","reported_seq":1108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.178946+0000","last_change":"2024-09-19T13:41:05.307783+0000","last_active":"2024-09-19T15:28:07.178946+0000","last_peered":"2024-09-19T15:28:07.178946+0000","last_clean":"2024-09-19T15:28:07.178946+0000","last_became_active":"2024-09-19T13:41:05.307368+0000","last_became_peered":"2024-09-19T13:41:05.307368+0000","last_unstale":"2024-09-19T15:28:07.178946+0000","last_undegraded":"2024-09-19T15:28:07.178946+0000","last_fullsized":"2024-09-19T15:28:07.178946+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:24.705807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16825708,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":933,"num_read_kb":73578,"num_write":1175,"num_write_kb":59214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381473+0000","last_change":"2024-09-19T13:40:38.245965+0000","last_active":"2024-09-19T15:28:12.381473+0000","last_peered":"2024-09-19T15:28:12.381473+0000","last_clean":"2024-09-19T15:28:12.381473+0000","last_became_active":"2024-09-19T13:40:38.245287+0000","last_became_peered":"2024-09-19T13:40:38.245287+0000","last_unstale":"2024-09-19T15:28:12.381473+0000","last_undegraded":"2024-09-19T15:28:12.381473+0000","last_fullsized":"2024-09-19T15:28:12.381473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:07.416511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'172","reported_seq":758,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.249753+0000","last_change":"2024-09-19T13:40:40.247785+0000","last_active":"2024-09-19T15:31:18.249753+0000","last_peered":"2024-09-19T15:31:18.249753+0000","last_clean":"2024-09-19T15:31:18.249753+0000","last_became_active":"2024-09-19T13:40:40.246680+0000","last_became_peered":"2024-09-19T13:40:40.246680+0000","last_unstale":"2024-09-19T15:31:18.249753+0000","last_undegraded":"2024-09-19T15:31:18.249753+0000","last_fullsized":"2024-09-19T15:31:18.249753+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:04.960514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":223,"num_read_kb":217,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'762","reported_seq":2970,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:16.985823+0000","last_change":"2024-09-19T13:40:42.253045+0000","last_active":"2024-09-19T15:31:16.985823+0000","last_peered":"2024-09-19T15:31:16.985823+0000","last_clean":"2024-09-19T15:31:16.985823+0000","last_became_active":"2024-09-19T13:40:42.250436+0000","last_became_peered":"2024-09-19T13:40:42.250436+0000","last_unstale":"2024-09-19T15:31:16.985823+0000","last_undegraded":"2024-09-19T15:31:16.985823+0000","last_fullsized":"2024-09-19T15:31:16.985823+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:00.593974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'100","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:27.673954+0000","last_change":"2024-09-19T13:40:44.269427+0000","last_active":"2024-09-19T15:30:27.673954+0000","last_peered":"2024-09-19T15:30:27.673954+0000","last_clean":"2024-09-19T15:30:27.673954+0000","last_became_active":"2024-09-19T13:40:44.268630+0000","last_became_peered":"2024-09-19T13:40:44.268630+0000","last_unstale":"2024-09-19T15:30:27.673954+0000","last_undegraded":"2024-09-19T15:30:27.673954+0000","last_fullsized":"2024-09-19T15:30:27.673954+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:59.722843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":162,"num_read_kb":149,"num_write":244,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'1161","reported_seq":2729,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:39.716195+0000","last_change":"2024-09-19T13:41:05.321007+0000","last_active":"2024-09-19T15:28:39.716195+0000","last_peered":"2024-09-19T15:28:39.716195+0000","last_clean":"2024-09-19T15:28:39.716195+0000","last_became_active":"2024-09-19T13:41:05.320040+0000","last_became_peered":"2024-09-19T13:41:05.320040+0000","last_unstale":"2024-09-19T15:28:39.716195+0000","last_undegraded":"2024-09-19T15:28:39.716195+0000","last_fullsized":"2024-09-19T15:28:39.716195+0000","mapping_epoch":38,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":1100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:24.769399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5194,"num_read_kb":4574,"num_write":1598,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'310","reported_seq":972,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:34.691501+0000","last_change":"2024-09-19T13:40:34.252303+0000","last_active":"2024-09-19T15:28:34.691501+0000","last_peered":"2024-09-19T15:28:34.691501+0000","last_clean":"2024-09-19T15:28:34.691501+0000","last_became_active":"2024-09-19T13:40:34.251475+0000","last_became_peered":"2024-09-19T13:40:34.251475+0000","last_unstale":"2024-09-19T15:28:34.691501+0000","last_undegraded":"2024-09-19T15:28:34.691501+0000","last_fullsized":"2024-09-19T15:28:34.691501+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:25:30.036187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":651958,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":566,"num_read_kb":3575,"num_write":1084,"num_write_kb":19359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.641848+0000","last_change":"2024-09-19T13:40:38.246925+0000","last_active":"2024-09-19T15:28:12.641848+0000","last_peered":"2024-09-19T15:28:12.641848+0000","last_clean":"2024-09-19T15:28:12.641848+0000","last_became_active":"2024-09-19T13:40:38.246205+0000","last_became_peered":"2024-09-19T13:40:38.246205+0000","last_unstale":"2024-09-19T15:28:12.641848+0000","last_undegraded":"2024-09-19T15:28:12.641848+0000","last_fullsized":"2024-09-19T15:28:12.641848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:54.953146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'378","reported_seq":1034,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.313921+0000","last_change":"2024-09-19T13:40:40.242303+0000","last_active":"2024-09-19T15:31:18.313921+0000","last_peered":"2024-09-19T15:31:18.313921+0000","last_clean":"2024-09-19T15:31:18.313921+0000","last_became_active":"2024-09-19T13:40:40.241730+0000","last_became_peered":"2024-09-19T13:40:40.241730+0000","last_unstale":"2024-09-19T15:31:18.313921+0000","last_undegraded":"2024-09-19T15:31:18.313921+0000","last_fullsized":"2024-09-19T15:31:18.313921+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:27.316298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74538,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":595,"num_read_kb":1098,"num_write":464,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:02.165536+0000","last_change":"2024-09-19T13:40:42.240898+0000","last_active":"2024-09-19T15:27:02.165536+0000","last_peered":"2024-09-19T15:27:02.165536+0000","last_clean":"2024-09-19T15:27:02.165536+0000","last_became_active":"2024-09-19T13:40:42.240191+0000","last_became_peered":"2024-09-19T13:40:42.240191+0000","last_unstale":"2024-09-19T15:27:02.165536+0000","last_undegraded":"2024-09-19T15:27:02.165536+0000","last_fullsized":"2024-09-19T15:27:02.165536+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:00.682593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'128","reported_seq":652,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:49.771957+0000","last_change":"2024-09-19T13:40:44.274954+0000","last_active":"2024-09-19T15:29:49.771957+0000","last_peered":"2024-09-19T15:29:49.771957+0000","last_clean":"2024-09-19T15:29:49.771957+0000","last_became_active":"2024-09-19T13:40:44.274449+0000","last_became_peered":"2024-09-19T13:40:44.274449+0000","last_unstale":"2024-09-19T15:29:49.771957+0000","last_undegraded":"2024-09-19T15:29:49.771957+0000","last_fullsized":"2024-09-19T15:29:49.771957+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:28.625729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":153,"num_write":303,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'796","reported_seq":2343,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.600083+0000","last_change":"2024-09-19T13:40:36.231742+0000","last_active":"2024-09-19T15:28:07.600083+0000","last_peered":"2024-09-19T15:28:07.600083+0000","last_clean":"2024-09-19T15:28:07.600083+0000","last_became_active":"2024-09-19T13:40:36.227359+0000","last_became_peered":"2024-09-19T13:40:36.227359+0000","last_unstale":"2024-09-19T15:28:07.600083+0000","last_undegraded":"2024-09-19T15:28:07.600083+0000","last_fullsized":"2024-09-19T15:28:07.600083+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:05:00.421649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3854,"num_read_kb":3454,"num_write":1058,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'352","reported_seq":1109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.619557+0000","last_change":"2024-09-19T13:41:05.314078+0000","last_active":"2024-09-19T15:28:07.619557+0000","last_peered":"2024-09-19T15:28:07.619557+0000","last_clean":"2024-09-19T15:28:07.619557+0000","last_became_active":"2024-09-19T13:41:05.313209+0000","last_became_peered":"2024-09-19T13:41:05.313209+0000","last_unstale":"2024-09-19T15:28:07.619557+0000","last_undegraded":"2024-09-19T15:28:07.619557+0000","last_fullsized":"2024-09-19T15:28:07.619557+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:11.443410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6789559,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":704,"num_read_kb":102227,"num_write":1351,"num_write_kb":49987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.620697+0000","last_change":"2024-09-19T13:40:38.230747+0000","last_active":"2024-09-19T15:28:12.620697+0000","last_peered":"2024-09-19T15:28:12.620697+0000","last_clean":"2024-09-19T15:28:12.620697+0000","last_became_active":"2024-09-19T13:40:38.229929+0000","last_became_peered":"2024-09-19T13:40:38.229929+0000","last_unstale":"2024-09-19T15:28:12.620697+0000","last_undegraded":"2024-09-19T15:28:12.620697+0000","last_fullsized":"2024-09-19T15:28:12.620697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:58:25.811713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'297","reported_seq":903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.130777+0000","last_change":"2024-09-19T13:40:40.241834+0000","last_active":"2024-09-19T15:31:17.130777+0000","last_peered":"2024-09-19T15:31:17.130777+0000","last_clean":"2024-09-19T15:31:17.130777+0000","last_became_active":"2024-09-19T13:40:40.241404+0000","last_became_peered":"2024-09-19T13:40:40.241404+0000","last_unstale":"2024-09-19T15:31:17.130777+0000","last_undegraded":"2024-09-19T15:31:17.130777+0000","last_fullsized":"2024-09-19T15:31:17.130777+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:41.176371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52682,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":484,"num_read_kb":954,"num_write":388,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:27.572162+0000","last_change":"2024-09-19T13:40:42.254516+0000","last_active":"2024-09-19T15:27:27.572162+0000","last_peered":"2024-09-19T15:27:27.572162+0000","last_clean":"2024-09-19T15:27:27.572162+0000","last_became_active":"2024-09-19T13:40:42.251413+0000","last_became_peered":"2024-09-19T13:40:42.251413+0000","last_unstale":"2024-09-19T15:27:27.572162+0000","last_undegraded":"2024-09-19T15:27:27.572162+0000","last_fullsized":"2024-09-19T15:27:27.572162+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:44:42.558167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'161","reported_seq":716,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.091208+0000","last_change":"2024-09-19T13:40:44.278568+0000","last_active":"2024-09-19T15:29:50.091208+0000","last_peered":"2024-09-19T15:29:50.091208+0000","last_clean":"2024-09-19T15:29:50.091208+0000","last_became_active":"2024-09-19T13:40:44.277774+0000","last_became_peered":"2024-09-19T13:40:44.277774+0000","last_unstale":"2024-09-19T15:29:50.091208+0000","last_undegraded":"2024-09-19T15:29:50.091208+0000","last_fullsized":"2024-09-19T15:29:50.091208+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:30.389728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":980,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216,"num_read_kb":207,"num_write":371,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'464","reported_seq":2234,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.261421+0000","last_change":"2024-09-19T13:40:36.223086+0000","last_active":"2024-09-19T15:31:12.261421+0000","last_peered":"2024-09-19T15:31:12.261421+0000","last_clean":"2024-09-19T15:31:12.261421+0000","last_became_active":"2024-09-19T13:40:36.222632+0000","last_became_peered":"2024-09-19T13:40:36.222632+0000","last_unstale":"2024-09-19T15:31:12.261421+0000","last_undegraded":"2024-09-19T15:31:12.261421+0000","last_fullsized":"2024-09-19T15:31:12.261421+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:02.744559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2809,"num_read_kb":2663,"num_write":534,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'322","reported_seq":1024,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:48.241025+0000","last_change":"2024-09-19T13:40:34.258460+0000","last_active":"2024-09-19T15:28:48.241025+0000","last_peered":"2024-09-19T15:28:48.241025+0000","last_clean":"2024-09-19T15:28:48.241025+0000","last_became_active":"2024-09-19T13:40:34.258068+0000","last_became_peered":"2024-09-19T13:40:34.258068+0000","last_unstale":"2024-09-19T15:28:48.241025+0000","last_undegraded":"2024-09-19T15:28:48.241025+0000","last_fullsized":"2024-09-19T15:28:48.241025+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:06:27.239604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16694649,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":691,"num_read_kb":11973,"num_write":1120,"num_write_kb":32337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:02.584884+0000","last_change":"2024-09-19T13:40:38.240655+0000","last_active":"2024-09-19T15:27:02.584884+0000","last_peered":"2024-09-19T15:27:02.584884+0000","last_clean":"2024-09-19T15:27:02.584884+0000","last_became_active":"2024-09-19T13:40:38.236724+0000","last_became_peered":"2024-09-19T13:40:38.236724+0000","last_unstale":"2024-09-19T15:27:02.584884+0000","last_undegraded":"2024-09-19T15:27:02.584884+0000","last_fullsized":"2024-09-19T15:27:02.584884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:37:16.998791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'271","reported_seq":860,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.600944+0000","last_change":"2024-09-19T13:40:40.223389+0000","last_active":"2024-09-19T15:31:17.600944+0000","last_peered":"2024-09-19T15:31:17.600944+0000","last_clean":"2024-09-19T15:31:17.600944+0000","last_became_active":"2024-09-19T13:40:40.222807+0000","last_became_peered":"2024-09-19T13:40:40.222807+0000","last_unstale":"2024-09-19T15:31:17.600944+0000","last_undegraded":"2024-09-19T15:31:17.600944+0000","last_fullsized":"2024-09-19T15:31:17.600944+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:53.228422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60899,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":460,"num_read_kb":996,"num_write":388,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.601222+0000","last_change":"2024-09-19T13:40:42.251870+0000","last_active":"2024-09-19T15:28:12.601222+0000","last_peered":"2024-09-19T15:28:12.601222+0000","last_clean":"2024-09-19T15:28:12.601222+0000","last_became_active":"2024-09-19T13:40:42.251057+0000","last_became_peered":"2024-09-19T13:40:42.251057+0000","last_unstale":"2024-09-19T15:28:12.601222+0000","last_undegraded":"2024-09-19T15:28:12.601222+0000","last_fullsized":"2024-09-19T15:28:12.601222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:37.359054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'143","reported_seq":1274,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:42.301571+0000","last_change":"2024-09-19T13:40:44.271381+0000","last_active":"2024-09-19T15:29:42.301571+0000","last_peered":"2024-09-19T15:29:42.301571+0000","last_clean":"2024-09-19T15:29:42.301571+0000","last_became_active":"2024-09-19T13:40:44.270656+0000","last_became_peered":"2024-09-19T13:40:44.270656+0000","last_unstale":"2024-09-19T15:29:42.301571+0000","last_undegraded":"2024-09-19T15:29:42.301571+0000","last_fullsized":"2024-09-19T15:29:42.301571+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:12:45.652710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":816,"num_read_kb":810,"num_write":350,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'465","reported_seq":1994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:39.716302+0000","last_change":"2024-09-19T13:40:36.218077+0000","last_active":"2024-09-19T15:28:39.716302+0000","last_peered":"2024-09-19T15:28:39.716302+0000","last_clean":"2024-09-19T15:28:39.716302+0000","last_became_active":"2024-09-19T13:40:36.217230+0000","last_became_peered":"2024-09-19T13:40:36.217230+0000","last_unstale":"2024-09-19T15:28:39.716302+0000","last_undegraded":"2024-09-19T15:28:39.716302+0000","last_fullsized":"2024-09-19T15:28:39.716302+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:27.690091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2437,"num_read_kb":2267,"num_write":569,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'269","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.190467+0000","last_change":"2024-09-19T13:40:34.258755+0000","last_active":"2024-09-19T15:28:57.190467+0000","last_peered":"2024-09-19T15:28:57.190467+0000","last_clean":"2024-09-19T15:28:57.190467+0000","last_became_active":"2024-09-19T13:40:34.258416+0000","last_became_peered":"2024-09-19T13:40:34.258416+0000","last_unstale":"2024-09-19T15:28:57.190467+0000","last_undegraded":"2024-09-19T15:28:57.190467+0000","last_fullsized":"2024-09-19T15:28:57.190467+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:47.238199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6644580,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":493,"num_read_kb":6695,"num_write":986,"num_write_kb":15020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.371514+0000","last_change":"2024-09-19T13:40:38.217596+0000","last_active":"2024-09-19T15:27:32.371514+0000","last_peered":"2024-09-19T15:27:32.371514+0000","last_clean":"2024-09-19T15:27:32.371514+0000","last_became_active":"2024-09-19T13:40:38.214571+0000","last_became_peered":"2024-09-19T13:40:38.214571+0000","last_unstale":"2024-09-19T15:27:32.371514+0000","last_undegraded":"2024-09-19T15:27:32.371514+0000","last_fullsized":"2024-09-19T15:27:32.371514+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:52.834683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'345","reported_seq":969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.731527+0000","last_change":"2024-09-19T13:40:40.248984+0000","last_active":"2024-09-19T15:31:17.731527+0000","last_peered":"2024-09-19T15:31:17.731527+0000","last_clean":"2024-09-19T15:31:17.731527+0000","last_became_active":"2024-09-19T13:40:40.245368+0000","last_became_peered":"2024-09-19T13:40:40.245368+0000","last_unstale":"2024-09-19T15:31:17.731527+0000","last_undegraded":"2024-09-19T15:31:17.731527+0000","last_fullsized":"2024-09-19T15:31:17.731527+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:10.651187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57046,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":558,"num_read_kb":1054,"num_write":446,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.180073+0000","last_change":"2024-09-19T13:40:42.240218+0000","last_active":"2024-09-19T15:28:12.180073+0000","last_peered":"2024-09-19T15:28:12.180073+0000","last_clean":"2024-09-19T15:28:12.180073+0000","last_became_active":"2024-09-19T13:40:42.239391+0000","last_became_peered":"2024-09-19T13:40:42.239391+0000","last_unstale":"2024-09-19T15:28:12.180073+0000","last_undegraded":"2024-09-19T15:28:12.180073+0000","last_fullsized":"2024-09-19T15:28:12.180073+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:58.943534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'128","reported_seq":656,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.238755+0000","last_change":"2024-09-19T13:40:44.249845+0000","last_active":"2024-09-19T15:31:12.238755+0000","last_peered":"2024-09-19T15:31:12.238755+0000","last_clean":"2024-09-19T15:31:12.238755+0000","last_became_active":"2024-09-19T13:40:44.249201+0000","last_became_peered":"2024-09-19T13:40:44.249201+0000","last_unstale":"2024-09-19T15:31:12.238755+0000","last_undegraded":"2024-09-19T15:31:12.238755+0000","last_fullsized":"2024-09-19T15:31:12.238755+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:40.297816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":210,"num_read_kb":190,"num_write":320,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'403","reported_seq":2077,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391896+0000","last_change":"2024-09-19T13:40:36.226270+0000","last_active":"2024-09-19T15:28:57.391896+0000","last_peered":"2024-09-19T15:28:57.391896+0000","last_clean":"2024-09-19T15:28:57.391896+0000","last_became_active":"2024-09-19T13:40:36.225885+0000","last_became_peered":"2024-09-19T13:40:36.225885+0000","last_unstale":"2024-09-19T15:28:57.391896+0000","last_undegraded":"2024-09-19T15:28:57.391896+0000","last_fullsized":"2024-09-19T15:28:57.391896+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:53.469735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2307,"num_read_kb":2225,"num_write":450,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'260","reported_seq":893,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.393967+0000","last_change":"2024-09-19T13:40:34.262660+0000","last_active":"2024-09-19T15:28:57.393967+0000","last_peered":"2024-09-19T15:28:57.393967+0000","last_clean":"2024-09-19T15:28:57.393967+0000","last_became_active":"2024-09-19T13:40:34.249068+0000","last_became_peered":"2024-09-19T13:40:34.249068+0000","last_unstale":"2024-09-19T15:28:57.393967+0000","last_undegraded":"2024-09-19T15:28:57.393967+0000","last_fullsized":"2024-09-19T15:28:57.393967+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:53.622353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10494794,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":421,"num_read_kb":27093,"num_write":933,"num_write_kb":27581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"268'459","reported_seq":2102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.313338+0000","last_change":"2024-09-19T13:40:36.222782+0000","last_active":"2024-09-19T15:29:41.313338+0000","last_peered":"2024-09-19T15:29:41.313338+0000","last_clean":"2024-09-19T15:29:41.313338+0000","last_became_active":"2024-09-19T13:40:36.220569+0000","last_became_peered":"2024-09-19T13:40:36.220569+0000","last_unstale":"2024-09-19T15:29:41.313338+0000","last_undegraded":"2024-09-19T15:29:41.313338+0000","last_fullsized":"2024-09-19T15:29:41.313338+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:10:08.215249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2535,"num_read_kb":2389,"num_write":539,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"268'352","reported_seq":1068,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.556612+0000","last_change":"2024-09-19T13:40:34.239840+0000","last_active":"2024-09-19T15:28:57.556612+0000","last_peered":"2024-09-19T15:28:57.556612+0000","last_clean":"2024-09-19T15:28:57.556612+0000","last_became_active":"2024-09-19T13:40:34.239357+0000","last_became_peered":"2024-09-19T13:40:34.239357+0000","last_unstale":"2024-09-19T15:28:57.556612+0000","last_undegraded":"2024-09-19T15:28:57.556612+0000","last_fullsized":"2024-09-19T15:28:57.556612+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:11:55.800088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34624490,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":723,"num_read_kb":92888,"num_write":1339,"num_write_kb":63384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'594","reported_seq":2305,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.631054+0000","last_change":"2024-09-19T13:40:36.242232+0000","last_active":"2024-09-19T15:28:57.631054+0000","last_peered":"2024-09-19T15:28:57.631054+0000","last_clean":"2024-09-19T15:28:57.631054+0000","last_became_active":"2024-09-19T13:40:36.241566+0000","last_became_peered":"2024-09-19T13:40:36.241566+0000","last_unstale":"2024-09-19T15:28:57.631054+0000","last_undegraded":"2024-09-19T15:28:57.631054+0000","last_fullsized":"2024-09-19T15:28:57.631054+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":500,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:03.964274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3019,"num_read_kb":2776,"num_write":751,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'304","reported_seq":985,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.630953+0000","last_change":"2024-09-19T13:40:34.227009+0000","last_active":"2024-09-19T15:28:57.630953+0000","last_peered":"2024-09-19T15:28:57.630953+0000","last_clean":"2024-09-19T15:28:57.630953+0000","last_became_active":"2024-09-19T13:40:34.221057+0000","last_became_peered":"2024-09-19T13:40:34.221057+0000","last_unstale":"2024-09-19T15:28:57.630953+0000","last_undegraded":"2024-09-19T15:28:57.630953+0000","last_fullsized":"2024-09-19T15:28:57.630953+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:25:54.224688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339543,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":614,"num_read_kb":11742,"num_write":1076,"num_write_kb":23593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'495","reported_seq":2263,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.311749+0000","last_change":"2024-09-19T13:40:36.238558+0000","last_active":"2024-09-19T15:29:41.311749+0000","last_peered":"2024-09-19T15:29:41.311749+0000","last_clean":"2024-09-19T15:29:41.311749+0000","last_became_active":"2024-09-19T13:40:36.238166+0000","last_became_peered":"2024-09-19T13:40:36.238166+0000","last_unstale":"2024-09-19T15:29:41.311749+0000","last_undegraded":"2024-09-19T15:29:41.311749+0000","last_fullsized":"2024-09-19T15:29:41.311749+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:30:49.066869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2902,"num_read_kb":2744,"num_write":591,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'279","reported_seq":993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:32.198770+0000","last_change":"2024-09-19T13:40:34.232529+0000","last_active":"2024-09-19T15:29:32.198770+0000","last_peered":"2024-09-19T15:29:32.198770+0000","last_clean":"2024-09-19T15:29:32.198770+0000","last_became_active":"2024-09-19T13:40:34.232099+0000","last_became_peered":"2024-09-19T13:40:34.232099+0000","last_unstale":"2024-09-19T15:29:32.198770+0000","last_undegraded":"2024-09-19T15:29:32.198770+0000","last_fullsized":"2024-09-19T15:29:32.198770+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:31.553740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7201098,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":692,"num_read_kb":12572,"num_write":969,"num_write_kb":46357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"268'463","reported_seq":2045,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:08.245703+0000","last_change":"2024-09-19T13:40:36.239180+0000","last_active":"2024-09-19T15:29:08.245703+0000","last_peered":"2024-09-19T15:29:08.245703+0000","last_clean":"2024-09-19T15:29:08.245703+0000","last_became_active":"2024-09-19T13:40:36.238644+0000","last_became_peered":"2024-09-19T13:40:36.238644+0000","last_unstale":"2024-09-19T15:29:08.245703+0000","last_undegraded":"2024-09-19T15:29:08.245703+0000","last_fullsized":"2024-09-19T15:29:08.245703+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:20.371624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2315,"num_read_kb":2185,"num_write":554,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'335","reported_seq":1047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:58.243409+0000","last_change":"2024-09-19T13:40:34.249999+0000","last_active":"2024-09-19T15:28:58.243409+0000","last_peered":"2024-09-19T15:28:58.243409+0000","last_clean":"2024-09-19T15:28:58.243409+0000","last_became_active":"2024-09-19T13:40:34.249600+0000","last_became_peered":"2024-09-19T13:40:34.249600+0000","last_unstale":"2024-09-19T15:28:58.243409+0000","last_undegraded":"2024-09-19T15:28:58.243409+0000","last_fullsized":"2024-09-19T15:28:58.243409+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:21.988391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18897188,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":652,"num_read_kb":53970,"num_write":1297,"num_write_kb":53250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'832","reported_seq":2486,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.611644+0000","last_change":"2024-09-19T13:40:36.217498+0000","last_active":"2024-09-19T15:28:57.611644+0000","last_peered":"2024-09-19T15:28:57.611644+0000","last_clean":"2024-09-19T15:28:57.611644+0000","last_became_active":"2024-09-19T13:40:36.216697+0000","last_became_peered":"2024-09-19T13:40:36.216697+0000","last_unstale":"2024-09-19T15:28:57.611644+0000","last_undegraded":"2024-09-19T15:28:57.611644+0000","last_fullsized":"2024-09-19T15:28:57.611644+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:18:43.576589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4198,"num_read_kb":3766,"num_write":1106,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'259","reported_seq":955,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:26.073871+0000","last_change":"2024-09-19T13:40:34.217279+0000","last_active":"2024-09-19T15:29:26.073871+0000","last_peered":"2024-09-19T15:29:26.073871+0000","last_clean":"2024-09-19T15:29:26.073871+0000","last_became_active":"2024-09-19T13:40:34.216774+0000","last_became_peered":"2024-09-19T13:40:34.216774+0000","last_unstale":"2024-09-19T15:29:26.073871+0000","last_undegraded":"2024-09-19T15:29:26.073871+0000","last_fullsized":"2024-09-19T15:29:26.073871+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:06.986984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14304161,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":580,"num_read_kb":47831,"num_write":910,"num_write_kb":20035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'563","reported_seq":2253,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.655516+0000","last_change":"2024-09-19T13:40:36.220200+0000","last_active":"2024-09-19T15:29:50.655516+0000","last_peered":"2024-09-19T15:29:50.655516+0000","last_clean":"2024-09-19T15:29:50.655516+0000","last_became_active":"2024-09-19T13:40:36.218090+0000","last_became_peered":"2024-09-19T13:40:36.218090+0000","last_unstale":"2024-09-19T15:29:50.655516+0000","last_undegraded":"2024-09-19T15:29:50.655516+0000","last_fullsized":"2024-09-19T15:29:50.655516+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:34:01.490693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2933,"num_read_kb":2699,"num_write":698,"num_write_kb":201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'285","reported_seq":1066,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.394246+0000","last_change":"2024-09-19T13:40:34.273323+0000","last_active":"2024-09-19T15:28:57.394246+0000","last_peered":"2024-09-19T15:28:57.394246+0000","last_clean":"2024-09-19T15:28:57.394246+0000","last_became_active":"2024-09-19T13:40:34.272629+0000","last_became_peered":"2024-09-19T13:40:34.272629+0000","last_unstale":"2024-09-19T15:28:57.394246+0000","last_undegraded":"2024-09-19T15:28:57.394246+0000","last_fullsized":"2024-09-19T15:28:57.394246+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:34.984552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7211816,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":866,"num_read_kb":42229,"num_write":1130,"num_write_kb":17971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'338","reported_seq":1780,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.312852+0000","last_change":"2024-09-19T13:40:36.225078+0000","last_active":"2024-09-19T15:29:41.312852+0000","last_peered":"2024-09-19T15:29:41.312852+0000","last_clean":"2024-09-19T15:29:41.312852+0000","last_became_active":"2024-09-19T13:40:36.224228+0000","last_became_peered":"2024-09-19T13:40:36.224228+0000","last_unstale":"2024-09-19T15:29:41.312852+0000","last_undegraded":"2024-09-19T15:29:41.312852+0000","last_fullsized":"2024-09-19T15:29:41.312852+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:01.743464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1855,"num_read_kb":1782,"num_write":368,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'316","reported_seq":1072,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:58.243579+0000","last_change":"2024-09-19T13:40:34.245539+0000","last_active":"2024-09-19T15:28:58.243579+0000","last_peered":"2024-09-19T15:28:58.243579+0000","last_clean":"2024-09-19T15:28:58.243579+0000","last_became_active":"2024-09-19T13:40:34.245197+0000","last_became_peered":"2024-09-19T13:40:34.245197+0000","last_unstale":"2024-09-19T15:28:58.243579+0000","last_undegraded":"2024-09-19T15:28:58.243579+0000","last_fullsized":"2024-09-19T15:28:58.243579+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:24:09.091484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13009608,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":681,"num_read_kb":129992,"num_write":1154,"num_write_kb":46426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"268'494","reported_seq":2038,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.313857+0000","last_change":"2024-09-19T13:40:36.227530+0000","last_active":"2024-09-19T15:29:41.313857+0000","last_peered":"2024-09-19T15:29:41.313857+0000","last_clean":"2024-09-19T15:29:41.313857+0000","last_became_active":"2024-09-19T13:40:36.226839+0000","last_became_peered":"2024-09-19T13:40:36.226839+0000","last_unstale":"2024-09-19T15:29:41.313857+0000","last_undegraded":"2024-09-19T15:29:41.313857+0000","last_fullsized":"2024-09-19T15:29:41.313857+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:28.265909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2632,"num_read_kb":2421,"num_write":626,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'288","reported_seq":1104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:22.636764+0000","last_change":"2024-09-19T13:40:34.229368+0000","last_active":"2024-09-19T15:29:22.636764+0000","last_peered":"2024-09-19T15:29:22.636764+0000","last_clean":"2024-09-19T15:29:22.636764+0000","last_became_active":"2024-09-19T13:40:34.228472+0000","last_became_peered":"2024-09-19T13:40:34.228472+0000","last_unstale":"2024-09-19T15:29:22.636764+0000","last_undegraded":"2024-09-19T15:29:22.636764+0000","last_fullsized":"2024-09-19T15:29:22.636764+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:51.349525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13958374,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":1059,"num_read_kb":37188,"num_write":1152,"num_write_kb":31649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'800","reported_seq":2500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.280835+0000","last_change":"2024-09-19T13:40:36.219439+0000","last_active":"2024-09-19T15:31:12.280835+0000","last_peered":"2024-09-19T15:31:12.280835+0000","last_clean":"2024-09-19T15:31:12.280835+0000","last_became_active":"2024-09-19T13:40:36.217870+0000","last_became_peered":"2024-09-19T13:40:36.217870+0000","last_unstale":"2024-09-19T15:31:12.280835+0000","last_undegraded":"2024-09-19T15:31:12.280835+0000","last_fullsized":"2024-09-19T15:31:12.280835+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:00:58.023208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3954,"num_read_kb":3588,"num_write":1044,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'246","reported_seq":938,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:07.558639+0000","last_change":"2024-09-19T13:41:05.311322+0000","last_active":"2024-09-19T15:29:07.558639+0000","last_peered":"2024-09-19T15:29:07.558639+0000","last_clean":"2024-09-19T15:29:07.558639+0000","last_became_active":"2024-09-19T13:41:05.310802+0000","last_became_peered":"2024-09-19T13:41:05.310802+0000","last_unstale":"2024-09-19T15:29:07.558639+0000","last_undegraded":"2024-09-19T15:29:07.558639+0000","last_fullsized":"2024-09-19T15:29:07.558639+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:42.603416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6381131,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":695,"num_read_kb":21770,"num_write":907,"num_write_kb":19448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"268'360","reported_seq":1959,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.653018+0000","last_change":"2024-09-19T13:40:36.216178+0000","last_active":"2024-09-19T15:29:50.653018+0000","last_peered":"2024-09-19T15:29:50.653018+0000","last_clean":"2024-09-19T15:29:50.653018+0000","last_became_active":"2024-09-19T13:40:36.215821+0000","last_became_peered":"2024-09-19T13:40:36.215821+0000","last_unstale":"2024-09-19T15:29:50.653018+0000","last_undegraded":"2024-09-19T15:29:50.653018+0000","last_fullsized":"2024-09-19T15:29:50.653018+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:38:26.917147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2112,"num_read_kb":2049,"num_write":394,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'393","reported_seq":1128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.626248+0000","last_change":"2024-09-19T13:40:34.262686+0000","last_active":"2024-09-19T15:28:37.626248+0000","last_peered":"2024-09-19T15:28:37.626248+0000","last_clean":"2024-09-19T15:28:37.626248+0000","last_became_active":"2024-09-19T13:40:34.261812+0000","last_became_peered":"2024-09-19T13:40:34.261812+0000","last_unstale":"2024-09-19T15:28:37.626248+0000","last_undegraded":"2024-09-19T15:28:37.626248+0000","last_fullsized":"2024-09-19T15:28:37.626248+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:29.120216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8078291,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":878,"num_read_kb":21060,"num_write":1181,"num_write_kb":41159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'746","reported_seq":2331,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.606887+0000","last_change":"2024-09-19T13:40:36.217355+0000","last_active":"2024-09-19T15:28:37.606887+0000","last_peered":"2024-09-19T15:28:37.606887+0000","last_clean":"2024-09-19T15:28:37.606887+0000","last_became_active":"2024-09-19T13:40:36.216597+0000","last_became_peered":"2024-09-19T13:40:36.216597+0000","last_unstale":"2024-09-19T15:28:37.606887+0000","last_undegraded":"2024-09-19T15:28:37.606887+0000","last_fullsized":"2024-09-19T15:28:37.606887+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:59:18.319568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3535,"num_read_kb":3206,"num_write":942,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'313","reported_seq":1020,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.185593+0000","last_change":"2024-09-19T13:40:34.255731+0000","last_active":"2024-09-19T15:28:37.185593+0000","last_peered":"2024-09-19T15:28:37.185593+0000","last_clean":"2024-09-19T15:28:37.185593+0000","last_became_active":"2024-09-19T13:40:34.255374+0000","last_became_peered":"2024-09-19T13:40:34.255374+0000","last_unstale":"2024-09-19T15:28:37.185593+0000","last_undegraded":"2024-09-19T15:28:37.185593+0000","last_fullsized":"2024-09-19T15:28:37.185593+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:19:13.519227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22345661,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":596,"num_read_kb":82609,"num_write":1139,"num_write_kb":54973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'1055","reported_seq":2691,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.652822+0000","last_change":"2024-09-19T13:40:36.239660+0000","last_active":"2024-09-19T15:29:50.652822+0000","last_peered":"2024-09-19T15:29:50.652822+0000","last_clean":"2024-09-19T15:29:50.652822+0000","last_became_active":"2024-09-19T13:40:36.238907+0000","last_became_peered":"2024-09-19T13:40:36.238907+0000","last_unstale":"2024-09-19T15:29:50.652822+0000","last_undegraded":"2024-09-19T15:29:50.652822+0000","last_fullsized":"2024-09-19T15:29:50.652822+0000","mapping_epoch":27,"log_start":"268'1000","ondisk_log_start":"268'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1000,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:58:06.626307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5049,"num_read_kb":4427,"num_write":1568,"num_write_kb":756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'357","reported_seq":1034,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.389587+0000","last_change":"2024-09-19T13:40:34.273536+0000","last_active":"2024-09-19T15:28:37.389587+0000","last_peered":"2024-09-19T15:28:37.389587+0000","last_clean":"2024-09-19T15:28:37.389587+0000","last_became_active":"2024-09-19T13:40:34.272618+0000","last_became_peered":"2024-09-19T13:40:34.272618+0000","last_unstale":"2024-09-19T15:28:37.389587+0000","last_undegraded":"2024-09-19T15:28:37.389587+0000","last_fullsized":"2024-09-19T15:28:37.389587+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:56:58.613614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6343085,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":725,"num_read_kb":25154,"num_write":1290,"num_write_kb":33238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'500","reported_seq":2189,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.257325+0000","last_change":"2024-09-19T13:40:36.227186+0000","last_active":"2024-09-19T15:31:12.257325+0000","last_peered":"2024-09-19T15:31:12.257325+0000","last_clean":"2024-09-19T15:31:12.257325+0000","last_became_active":"2024-09-19T13:40:36.226572+0000","last_became_peered":"2024-09-19T13:40:36.226572+0000","last_unstale":"2024-09-19T15:31:12.257325+0000","last_undegraded":"2024-09-19T15:31:12.257325+0000","last_fullsized":"2024-09-19T15:31:12.257325+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:15.302809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2633,"num_read_kb":2478,"num_write":570,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'373","reported_seq":1128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.654080+0000","last_change":"2024-09-19T13:40:34.276063+0000","last_active":"2024-09-19T15:29:02.654080+0000","last_peered":"2024-09-19T15:29:02.654080+0000","last_clean":"2024-09-19T15:29:02.654080+0000","last_became_active":"2024-09-19T13:40:34.274523+0000","last_became_peered":"2024-09-19T13:40:34.274523+0000","last_unstale":"2024-09-19T15:29:02.654080+0000","last_undegraded":"2024-09-19T15:29:02.654080+0000","last_fullsized":"2024-09-19T15:29:02.654080+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:32.241517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31527398,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":810,"num_read_kb":117453,"num_write":1286,"num_write_kb":54900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"268'906","reported_seq":2407,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.374609+0000","last_change":"2024-09-19T13:40:36.221889+0000","last_active":"2024-09-19T15:29:48.374609+0000","last_peered":"2024-09-19T15:29:48.374609+0000","last_clean":"2024-09-19T15:29:48.374609+0000","last_became_active":"2024-09-19T13:40:36.219017+0000","last_became_peered":"2024-09-19T13:40:36.219017+0000","last_unstale":"2024-09-19T15:29:48.374609+0000","last_undegraded":"2024-09-19T15:29:48.374609+0000","last_fullsized":"2024-09-19T15:29:48.374609+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":800,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:53.854378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5981,"num_read_kb":5463,"num_write":1432,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'285","reported_seq":962,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.544686+0000","last_change":"2024-09-19T13:40:34.258686+0000","last_active":"2024-09-19T15:27:57.544686+0000","last_peered":"2024-09-19T15:27:57.544686+0000","last_clean":"2024-09-19T15:27:57.544686+0000","last_became_active":"2024-09-19T13:40:34.258251+0000","last_became_peered":"2024-09-19T13:40:34.258251+0000","last_unstale":"2024-09-19T15:27:57.544686+0000","last_undegraded":"2024-09-19T15:27:57.544686+0000","last_fullsized":"2024-09-19T15:27:57.544686+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:47.902849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":650123,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":602,"num_read_kb":8561,"num_write":1115,"num_write_kb":30274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'817","reported_seq":2512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.331001+0000","last_change":"2024-09-19T13:40:36.236629+0000","last_active":"2024-09-19T15:31:12.331001+0000","last_peered":"2024-09-19T15:31:12.331001+0000","last_clean":"2024-09-19T15:31:12.331001+0000","last_became_active":"2024-09-19T13:40:36.234463+0000","last_became_peered":"2024-09-19T13:40:36.234463+0000","last_unstale":"2024-09-19T15:31:12.331001+0000","last_undegraded":"2024-09-19T15:31:12.331001+0000","last_fullsized":"2024-09-19T15:31:12.331001+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:20.810918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4113,"num_read_kb":3717,"num_write":1084,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'272","reported_seq":933,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:03.359481+0000","last_change":"2024-09-19T13:40:34.258670+0000","last_active":"2024-09-19T15:31:03.359481+0000","last_peered":"2024-09-19T15:31:03.359481+0000","last_clean":"2024-09-19T15:31:03.359481+0000","last_became_active":"2024-09-19T13:40:34.257895+0000","last_became_peered":"2024-09-19T13:40:34.257895+0000","last_unstale":"2024-09-19T15:31:03.359481+0000","last_undegraded":"2024-09-19T15:31:03.359481+0000","last_fullsized":"2024-09-19T15:31:03.359481+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:39:05.564293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5892898,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":556,"num_read_kb":2702,"num_write":1030,"num_write_kb":37833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'304","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:01.405523+0000","last_change":"2024-09-19T13:41:05.314325+0000","last_active":"2024-09-19T15:31:01.405523+0000","last_peered":"2024-09-19T15:31:01.405523+0000","last_clean":"2024-09-19T15:31:01.405523+0000","last_became_active":"2024-09-19T13:41:05.313139+0000","last_became_peered":"2024-09-19T13:41:05.313139+0000","last_unstale":"2024-09-19T15:31:01.405523+0000","last_undegraded":"2024-09-19T15:31:01.405523+0000","last_fullsized":"2024-09-19T15:31:01.405523+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:38.914445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5266270,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":575,"num_read_kb":5598,"num_write":1087,"num_write_kb":52319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'584","reported_seq":2285,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.253632+0000","last_change":"2024-09-19T13:40:36.225847+0000","last_active":"2024-09-19T15:31:12.253632+0000","last_peered":"2024-09-19T15:31:12.253632+0000","last_clean":"2024-09-19T15:31:12.253632+0000","last_became_active":"2024-09-19T13:40:36.225131+0000","last_became_peered":"2024-09-19T13:40:36.225131+0000","last_unstale":"2024-09-19T15:31:12.253632+0000","last_undegraded":"2024-09-19T15:31:12.253632+0000","last_fullsized":"2024-09-19T15:31:12.253632+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:19.360510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3409,"num_read_kb":3161,"num_write":806,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'353","reported_seq":1115,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.377100+0000","last_change":"2024-09-19T13:40:34.252937+0000","last_active":"2024-09-19T15:27:57.377100+0000","last_peered":"2024-09-19T15:27:57.377100+0000","last_clean":"2024-09-19T15:27:57.377100+0000","last_became_active":"2024-09-19T13:40:34.252585+0000","last_became_peered":"2024-09-19T13:40:34.252585+0000","last_unstale":"2024-09-19T15:27:57.377100+0000","last_undegraded":"2024-09-19T15:27:57.377100+0000","last_fullsized":"2024-09-19T15:27:57.377100+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:29.120216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11101070,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":1019,"num_read_kb":22295,"num_write":1174,"num_write_kb":33627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'492","reported_seq":2098,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:41.711923+0000","last_change":"2024-09-19T13:40:36.233305+0000","last_active":"2024-09-19T15:27:41.711923+0000","last_peered":"2024-09-19T15:27:41.711923+0000","last_clean":"2024-09-19T15:27:41.711923+0000","last_became_active":"2024-09-19T13:40:36.232695+0000","last_became_peered":"2024-09-19T13:40:36.232695+0000","last_unstale":"2024-09-19T15:27:41.711923+0000","last_undegraded":"2024-09-19T15:27:41.711923+0000","last_fullsized":"2024-09-19T15:27:41.711923+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:37:22.928402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2752,"num_read_kb":2570,"num_write":600,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10865,"num_read_kb":9021,"num_write":3118,"num_write_kb":1011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1008,"ondisk_log_size":1008,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14601,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":16485,"num_read_kb":16147,"num_write":17047,"num_write_kb":4982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":29202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1794,"ondisk_log_size":1794,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":560,"ondisk_log_size":560,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1937016,"num_objects":200,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":20653,"num_read_kb":36694,"num_write":17437,"num_write_kb":12536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3309568,"data_stored":2768730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2006,"ondisk_log_size":2006,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2382,"num_read_kb":2839,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":220859,"num_read_kb":201873,"num_write":56069,"num_write_kb":19197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4108,"ondisk_log_size":4108,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":622395504,"num_objects":4335,"num_object_clones":0,"num_object_copies":13005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4335,"num_whiteouts":0,"num_read":40322,"num_read_kb":2347895,"num_write":68883,"num_write_kb":2178675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":982376448,"data_stored":982376448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4050,"ondisk_log_size":4050,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":84518865,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":126,"num_read_kb":215739,"num_write":141,"num_write_kb":136883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":169041920,"data_stored":169037730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":84518865,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":119,"num_read_kb":195259,"num_write":141,"num_write_kb":136883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":169041920,"data_stored":169037730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543490,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":446112,"kb_used_data":167824,"kb_used_omap":1,"kb_used_meta":278270,"kb_avail":93925728,"statfs":{"total":96636764160,"available":96179945472,"internally_reserved":0,"allocated":171851776,"data_stored":169791032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":284948938},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543485,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":417012,"kb_used_data":165092,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":93954828,"statfs":{"total":96636764160,"available":96209743872,"internally_reserved":0,"allocated":169054208,"data_stored":167070157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":257948102},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543488,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":290804,"kb_used_data":143076,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94081036,"statfs":{"total":96636764160,"available":96338980864,"internally_reserved":0,"allocated":146509824,"data_stored":144406301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543485,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":251284,"kb_used_data":152068,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94120556,"statfs":{"total":96636764160,"available":96379449344,"internally_reserved":0,"allocated":155717632,"data_stored":153772157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543490,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":475420,"kb_used_data":201292,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93896420,"statfs":{"total":96636764160,"available":96149934080,"internally_reserved":0,"allocated":206123008,"data_stored":204084548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":280689095},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543487,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252876,"kb_used_data":159228,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94118964,"statfs":{"total":96636764160,"available":96377819136,"internally_reserved":0,"allocated":163049472,"data_stored":161091191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543486,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310528,"kb_used_data":153072,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94061312,"statfs":{"total":96636764160,"available":96318783488,"internally_reserved":0,"allocated":156745728,"data_stored":154722368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161216965},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543486,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":429100,"kb_used_data":185500,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":93942740,"statfs":{"total":96636764160,"available":96197365760,"internally_reserved":0,"allocated":189952000,"data_stored":187927670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":249428423},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":140603392,"data_stored":140603392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":119525376,"data_stored":119525376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":103538688,"data_stored":103538688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":133615616,"data_stored":133615616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":114589696,"data_stored":114589696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":104255488,"data_stored":104255488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":141369344,"data_stored":141369344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":124878848,"data_stored":124878848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":336653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":382970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":134974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":467412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":78226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":667648,"data_stored":557082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":331776,"data_stored":276237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":643072,"data_stored":535176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32505856,"data_stored":32505856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29360128,"data_stored":29360128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22069248,"data_stored":22068518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12120064,"data_stored":12118699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16826368,"data_stored":16825638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":23654400,"data_stored":23653035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11583488,"data_stored":11582758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":43577344,"data_stored":43575979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38334464,"data_stored":38333099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14729216,"data_stored":14728486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T15:31:42.317 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T15:31:42.317 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T15:31:42.702 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:31:42.713 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-19T15:31:42.720 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":3604,"stamp":"2024-09-19T15:31:42.638774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":443352066,"num_objects":3095,"num_object_clones":0,"num_object_copies":8808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3095,"num_whiteouts":0,"num_read":313806,"num_read_kb":3027114,"num_write":164803,"num_write_kb":2491847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13910,"ondisk_log_size":13910,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2278752,"kb_used_data":696116,"kb_used_omap":12,"kb_used_meta":1581939,"kb_avail":752695968,"statfs":{"total":773094113280,"available":770760671232,"internally_reserved":0,"allocated":712822784,"data_stored":696800681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1619906098},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[6],"upper_bound":2},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-350624965,"num_objects":-1729,"num_object_clones":0,"num_object_copies":-5175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1729,"num_whiteouts":0,"num_read":1917,"num_read_kb":1580,"num_write":1824,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007020"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.609067+0000","last_change":"2024-09-19T14:29:51.038023+0000","last_active":"2024-09-19T15:27:22.609067+0000","last_peered":"2024-09-19T15:27:22.609067+0000","last_clean":"2024-09-19T15:27:22.609067+0000","last_became_active":"2024-09-19T14:29:51.036952+0000","last_became_peered":"2024-09-19T14:29:51.036952+0000","last_unstale":"2024-09-19T15:27:22.609067+0000","last_undegraded":"2024-09-19T15:27:22.609067+0000","last_fullsized":"2024-09-19T15:27:22.609067+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:10:00.951609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:37.612687+0000","last_change":"2024-09-19T14:02:36.913041+0000","last_active":"2024-09-19T15:27:37.612687+0000","last_peered":"2024-09-19T15:27:37.612687+0000","last_clean":"2024-09-19T15:27:37.612687+0000","last_became_active":"2024-09-19T14:02:36.912307+0000","last_became_peered":"2024-09-19T14:02:36.912307+0000","last_unstale":"2024-09-19T15:27:37.612687+0000","last_undegraded":"2024-09-19T15:27:37.612687+0000","last_fullsized":"2024-09-19T15:27:37.612687+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:18:44.440160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"268'9","reported_seq":81,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:33.223470+0000","last_change":"2024-09-19T14:02:29.740551+0000","last_active":"2024-09-19T15:27:33.223470+0000","last_peered":"2024-09-19T15:27:33.223470+0000","last_clean":"2024-09-19T15:27:33.223470+0000","last_became_active":"2024-09-19T14:02:29.739721+0000","last_became_peered":"2024-09-19T14:02:29.739721+0000","last_unstale":"2024-09-19T15:27:33.223470+0000","last_undegraded":"2024-09-19T15:27:33.223470+0000","last_fullsized":"2024-09-19T15:27:33.223470+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:40.747086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":13312,"num_write":19,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'35","reported_seq":168,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.179075+0000","last_change":"2024-09-19T13:56:23.181765+0000","last_active":"2024-09-19T15:28:07.179075+0000","last_peered":"2024-09-19T15:28:07.179075+0000","last_clean":"2024-09-19T15:28:07.179075+0000","last_became_active":"2024-09-19T13:56:23.180176+0000","last_became_peered":"2024-09-19T13:56:23.180176+0000","last_unstale":"2024-09-19T15:28:07.179075+0000","last_undegraded":"2024-09-19T15:28:07.179075+0000","last_fullsized":"2024-09-19T15:28:07.179075+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:39.781109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":165,"num_write":94,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.537242+0000","last_change":"2024-09-19T14:29:51.039282+0000","last_active":"2024-09-19T15:27:22.537242+0000","last_peered":"2024-09-19T15:27:22.537242+0000","last_clean":"2024-09-19T15:27:22.537242+0000","last_became_active":"2024-09-19T14:29:51.038289+0000","last_became_peered":"2024-09-19T14:29:51.038289+0000","last_unstale":"2024-09-19T15:27:22.537242+0000","last_undegraded":"2024-09-19T15:27:22.537242+0000","last_fullsized":"2024-09-19T15:27:22.537242+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:16.350420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'1","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:37.593193+0000","last_change":"2024-09-19T14:02:36.915848+0000","last_active":"2024-09-19T15:27:37.593193+0000","last_peered":"2024-09-19T15:27:37.593193+0000","last_clean":"2024-09-19T15:27:37.593193+0000","last_became_active":"2024-09-19T14:02:36.914769+0000","last_became_peered":"2024-09-19T14:02:36.914769+0000","last_unstale":"2024-09-19T15:27:37.593193+0000","last_undegraded":"2024-09-19T15:27:37.593193+0000","last_fullsized":"2024-09-19T15:27:37.593193+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:22.428331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"268'6","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.100940+0000","last_change":"2024-09-19T14:02:29.748087+0000","last_active":"2024-09-19T15:31:39.100940+0000","last_peered":"2024-09-19T15:31:39.100940+0000","last_clean":"2024-09-19T15:31:39.100940+0000","last_became_active":"2024-09-19T14:02:29.747492+0000","last_became_peered":"2024-09-19T14:02:29.747492+0000","last_unstale":"2024-09-19T15:31:39.100940+0000","last_undegraded":"2024-09-19T15:31:39.100940+0000","last_fullsized":"2024-09-19T15:31:39.100940+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:00.163612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'26","reported_seq":153,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.554031+0000","last_change":"2024-09-19T13:56:23.182940+0000","last_active":"2024-09-19T15:28:42.554031+0000","last_peered":"2024-09-19T15:28:42.554031+0000","last_clean":"2024-09-19T15:28:42.554031+0000","last_became_active":"2024-09-19T13:56:23.173377+0000","last_became_peered":"2024-09-19T13:56:23.173377+0000","last_unstale":"2024-09-19T15:28:42.554031+0000","last_undegraded":"2024-09-19T15:28:42.554031+0000","last_fullsized":"2024-09-19T15:28:42.554031+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:53.676663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":124,"num_write":71,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:52.379379+0000","last_change":"2024-09-19T14:29:51.044849+0000","last_active":"2024-09-19T15:27:52.379379+0000","last_peered":"2024-09-19T15:27:52.379379+0000","last_clean":"2024-09-19T15:27:52.379379+0000","last_became_active":"2024-09-19T14:29:51.039043+0000","last_became_peered":"2024-09-19T14:29:51.039043+0000","last_unstale":"2024-09-19T15:27:52.379379+0000","last_undegraded":"2024-09-19T15:27:52.379379+0000","last_fullsized":"2024-09-19T15:27:52.379379+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:50.442880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"268'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:07.209630+0000","last_change":"2024-09-19T14:02:37.054013+0000","last_active":"2024-09-19T15:30:07.209630+0000","last_peered":"2024-09-19T15:30:07.209630+0000","last_clean":"2024-09-19T15:30:07.209630+0000","last_became_active":"2024-09-19T14:02:37.051665+0000","last_became_peered":"2024-09-19T14:02:37.051665+0000","last_unstale":"2024-09-19T15:30:07.209630+0000","last_undegraded":"2024-09-19T15:30:07.209630+0000","last_fullsized":"2024-09-19T15:30:07.209630+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:50.720956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:52.556050+0000","last_change":"2024-09-19T14:02:29.725591+0000","last_active":"2024-09-19T15:28:52.556050+0000","last_peered":"2024-09-19T15:28:52.556050+0000","last_clean":"2024-09-19T15:28:52.556050+0000","last_became_active":"2024-09-19T14:02:29.724866+0000","last_became_peered":"2024-09-19T14:02:29.724866+0000","last_unstale":"2024-09-19T15:28:52.556050+0000","last_undegraded":"2024-09-19T15:28:52.556050+0000","last_fullsized":"2024-09-19T15:28:52.556050+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:44.282362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'36","reported_seq":169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.190273+0000","last_change":"2024-09-19T13:56:23.181435+0000","last_active":"2024-09-19T15:28:57.190273+0000","last_peered":"2024-09-19T15:28:57.190273+0000","last_clean":"2024-09-19T15:28:57.190273+0000","last_became_active":"2024-09-19T13:56:23.180159+0000","last_became_peered":"2024-09-19T13:56:23.180159+0000","last_unstale":"2024-09-19T15:28:57.190273+0000","last_undegraded":"2024-09-19T15:28:57.190273+0000","last_fullsized":"2024-09-19T15:28:57.190273+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:34:32.230609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":283,"num_read_kb":171,"num_write":89,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:03.230461+0000","last_change":"2024-09-19T14:29:51.030209+0000","last_active":"2024-09-19T15:28:03.230461+0000","last_peered":"2024-09-19T15:28:03.230461+0000","last_clean":"2024-09-19T15:28:03.230461+0000","last_became_active":"2024-09-19T14:29:51.029426+0000","last_became_peered":"2024-09-19T14:29:51.029426+0000","last_unstale":"2024-09-19T15:28:03.230461+0000","last_undegraded":"2024-09-19T15:28:03.230461+0000","last_fullsized":"2024-09-19T15:28:03.230461+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:42:56.183067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"268'2","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:48.241073+0000","last_change":"2024-09-19T14:02:37.053245+0000","last_active":"2024-09-19T15:28:48.241073+0000","last_peered":"2024-09-19T15:28:48.241073+0000","last_clean":"2024-09-19T15:28:48.241073+0000","last_became_active":"2024-09-19T14:02:37.052510+0000","last_became_peered":"2024-09-19T14:02:37.052510+0000","last_unstale":"2024-09-19T15:28:48.241073+0000","last_undegraded":"2024-09-19T15:28:48.241073+0000","last_fullsized":"2024-09-19T15:28:48.241073+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:25.091691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.597885+0000","last_change":"2024-09-19T14:02:29.736849+0000","last_active":"2024-09-19T15:27:57.597885+0000","last_peered":"2024-09-19T15:27:57.597885+0000","last_clean":"2024-09-19T15:27:57.597885+0000","last_became_active":"2024-09-19T14:02:29.736074+0000","last_became_peered":"2024-09-19T14:02:29.736074+0000","last_unstale":"2024-09-19T15:27:57.597885+0000","last_undegraded":"2024-09-19T15:27:57.597885+0000","last_fullsized":"2024-09-19T15:27:57.597885+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:49.441598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'63","reported_seq":244,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:53.242175+0000","last_change":"2024-09-19T13:56:23.179692+0000","last_active":"2024-09-19T15:28:53.242175+0000","last_peered":"2024-09-19T15:28:53.242175+0000","last_clean":"2024-09-19T15:28:53.242175+0000","last_became_active":"2024-09-19T13:56:23.179235+0000","last_became_peered":"2024-09-19T13:56:23.179235+0000","last_unstale":"2024-09-19T15:28:53.242175+0000","last_undegraded":"2024-09-19T15:28:53.242175+0000","last_fullsized":"2024-09-19T15:28:53.242175+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:47.927569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":508,"num_read_kb":362,"num_write":155,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:03.230734+0000","last_change":"2024-09-19T14:29:51.053238+0000","last_active":"2024-09-19T15:28:03.230734+0000","last_peered":"2024-09-19T15:28:03.230734+0000","last_clean":"2024-09-19T15:28:03.230734+0000","last_became_active":"2024-09-19T14:29:51.052562+0000","last_became_peered":"2024-09-19T14:29:51.052562+0000","last_unstale":"2024-09-19T15:28:03.230734+0000","last_undegraded":"2024-09-19T15:28:03.230734+0000","last_fullsized":"2024-09-19T15:28:03.230734+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:06:42.849046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"268'6","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.611337+0000","last_change":"2024-09-19T14:02:36.931028+0000","last_active":"2024-09-19T15:27:32.611337+0000","last_peered":"2024-09-19T15:27:32.611337+0000","last_clean":"2024-09-19T15:27:32.611337+0000","last_became_active":"2024-09-19T14:02:36.930344+0000","last_became_peered":"2024-09-19T14:02:36.930344+0000","last_unstale":"2024-09-19T15:27:32.611337+0000","last_undegraded":"2024-09-19T15:27:32.611337+0000","last_fullsized":"2024-09-19T15:27:32.611337+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:10:56.230063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":16,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'8","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:32.198661+0000","last_change":"2024-09-19T14:02:29.741351+0000","last_active":"2024-09-19T15:29:32.198661+0000","last_peered":"2024-09-19T15:29:32.198661+0000","last_clean":"2024-09-19T15:29:32.198661+0000","last_became_active":"2024-09-19T14:02:29.740291+0000","last_became_peered":"2024-09-19T14:02:29.740291+0000","last_unstale":"2024-09-19T15:29:32.198661+0000","last_undegraded":"2024-09-19T15:29:32.198661+0000","last_fullsized":"2024-09-19T15:29:32.198661+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:33:40.597174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'10","reported_seq":101,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:53.242112+0000","last_change":"2024-09-19T13:56:23.170087+0000","last_active":"2024-09-19T15:28:53.242112+0000","last_peered":"2024-09-19T15:28:53.242112+0000","last_clean":"2024-09-19T15:28:53.242112+0000","last_became_active":"2024-09-19T13:56:23.169371+0000","last_became_peered":"2024-09-19T13:56:23.169371+0000","last_unstale":"2024-09-19T15:28:53.242112+0000","last_undegraded":"2024-09-19T15:28:53.242112+0000","last_fullsized":"2024-09-19T15:28:53.242112+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:41:15.161070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":43,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381528+0000","last_change":"2024-09-19T14:29:51.049819+0000","last_active":"2024-09-19T15:28:12.381528+0000","last_peered":"2024-09-19T15:28:12.381528+0000","last_clean":"2024-09-19T15:28:12.381528+0000","last_became_active":"2024-09-19T14:29:51.049146+0000","last_became_peered":"2024-09-19T14:29:51.049146+0000","last_unstale":"2024-09-19T15:28:12.381528+0000","last_undegraded":"2024-09-19T15:28:12.381528+0000","last_fullsized":"2024-09-19T15:28:12.381528+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:39.379659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:12.568908+0000","last_change":"2024-09-19T14:02:36.928119+0000","last_active":"2024-09-19T15:27:12.568908+0000","last_peered":"2024-09-19T15:27:12.568908+0000","last_clean":"2024-09-19T15:27:12.568908+0000","last_became_active":"2024-09-19T14:02:36.927382+0000","last_became_peered":"2024-09-19T14:02:36.927382+0000","last_unstale":"2024-09-19T15:27:12.568908+0000","last_undegraded":"2024-09-19T15:27:12.568908+0000","last_fullsized":"2024-09-19T15:27:12.568908+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:18.568506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"268'1","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:27.590718+0000","last_change":"2024-09-19T14:02:29.723753+0000","last_active":"2024-09-19T15:27:27.590718+0000","last_peered":"2024-09-19T15:27:27.590718+0000","last_clean":"2024-09-19T15:27:27.590718+0000","last_became_active":"2024-09-19T14:02:29.722193+0000","last_became_peered":"2024-09-19T14:02:29.722193+0000","last_unstale":"2024-09-19T15:27:27.590718+0000","last_undegraded":"2024-09-19T15:27:27.590718+0000","last_fullsized":"2024-09-19T15:27:27.590718+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:12.251421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'21","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:52.392809+0000","last_change":"2024-09-19T13:56:23.175249+0000","last_active":"2024-09-19T15:28:52.392809+0000","last_peered":"2024-09-19T15:28:52.392809+0000","last_clean":"2024-09-19T15:28:52.392809+0000","last_became_active":"2024-09-19T13:56:23.174511+0000","last_became_peered":"2024-09-19T13:56:23.174511+0000","last_unstale":"2024-09-19T15:28:52.392809+0000","last_undegraded":"2024-09-19T15:28:52.392809+0000","last_fullsized":"2024-09-19T15:28:52.392809+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:24.782915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":102,"num_write":56,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.629613+0000","last_change":"2024-09-19T14:29:51.041850+0000","last_active":"2024-09-19T15:27:22.629613+0000","last_peered":"2024-09-19T15:27:22.629613+0000","last_clean":"2024-09-19T15:27:22.629613+0000","last_became_active":"2024-09-19T14:29:51.039919+0000","last_became_peered":"2024-09-19T14:29:51.039919+0000","last_unstale":"2024-09-19T15:27:22.629613+0000","last_undegraded":"2024-09-19T15:27:22.629613+0000","last_fullsized":"2024-09-19T15:27:22.629613+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:56.764514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"265'8","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:37.574384+0000","last_change":"2024-09-19T14:02:36.919460+0000","last_active":"2024-09-19T15:27:37.574384+0000","last_peered":"2024-09-19T15:27:37.574384+0000","last_clean":"2024-09-19T15:27:37.574384+0000","last_became_active":"2024-09-19T14:02:36.918707+0000","last_became_peered":"2024-09-19T14:02:36.918707+0000","last_unstale":"2024-09-19T15:27:37.574384+0000","last_undegraded":"2024-09-19T15:27:37.574384+0000","last_fullsized":"2024-09-19T15:27:37.574384+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:50.554567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9218,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.591968+0000","last_change":"2024-09-19T14:02:29.740667+0000","last_active":"2024-09-19T15:27:32.591968+0000","last_peered":"2024-09-19T15:27:32.591968+0000","last_clean":"2024-09-19T15:27:32.591968+0000","last_became_active":"2024-09-19T14:02:29.739955+0000","last_became_peered":"2024-09-19T14:02:29.739955+0000","last_unstale":"2024-09-19T15:27:32.591968+0000","last_undegraded":"2024-09-19T15:27:32.591968+0000","last_fullsized":"2024-09-19T15:27:32.591968+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:34:51.448763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'12","reported_seq":107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:47.187823+0000","last_change":"2024-09-19T13:56:23.179307+0000","last_active":"2024-09-19T15:28:47.187823+0000","last_peered":"2024-09-19T15:28:47.187823+0000","last_clean":"2024-09-19T15:28:47.187823+0000","last_became_active":"2024-09-19T13:56:23.170272+0000","last_became_peered":"2024-09-19T13:56:23.170272+0000","last_unstale":"2024-09-19T15:28:47.187823+0000","last_undegraded":"2024-09-19T15:28:47.187823+0000","last_fullsized":"2024-09-19T15:28:47.187823+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:47:57.598767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.629764+0000","last_change":"2024-09-19T14:29:51.059050+0000","last_active":"2024-09-19T15:27:22.629764+0000","last_peered":"2024-09-19T15:27:22.629764+0000","last_clean":"2024-09-19T15:27:22.629764+0000","last_became_active":"2024-09-19T14:29:51.058380+0000","last_became_peered":"2024-09-19T14:29:51.058380+0000","last_unstale":"2024-09-19T15:27:22.629764+0000","last_undegraded":"2024-09-19T15:27:22.629764+0000","last_fullsized":"2024-09-19T15:27:22.629764+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:35.762726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:38.224574+0000","last_change":"2024-09-19T14:02:36.926259+0000","last_active":"2024-09-19T15:27:38.224574+0000","last_peered":"2024-09-19T15:27:38.224574+0000","last_clean":"2024-09-19T15:27:38.224574+0000","last_became_active":"2024-09-19T14:02:36.924268+0000","last_became_peered":"2024-09-19T14:02:36.924268+0000","last_unstale":"2024-09-19T15:27:38.224574+0000","last_undegraded":"2024-09-19T15:27:38.224574+0000","last_fullsized":"2024-09-19T15:27:38.224574+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:52.337740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.171539+0000","last_change":"2024-09-19T14:02:29.745987+0000","last_active":"2024-09-19T15:27:32.171539+0000","last_peered":"2024-09-19T15:27:32.171539+0000","last_clean":"2024-09-19T15:27:32.171539+0000","last_became_active":"2024-09-19T14:02:29.741114+0000","last_became_peered":"2024-09-19T14:02:29.741114+0000","last_unstale":"2024-09-19T15:27:32.171539+0000","last_undegraded":"2024-09-19T15:27:32.171539+0000","last_fullsized":"2024-09-19T15:27:32.171539+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:21.115185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"268'44","reported_seq":192,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381292+0000","last_change":"2024-09-19T13:56:23.177841+0000","last_active":"2024-09-19T15:28:12.381292+0000","last_peered":"2024-09-19T15:28:12.381292+0000","last_clean":"2024-09-19T15:28:12.381292+0000","last_became_active":"2024-09-19T13:56:23.177082+0000","last_became_peered":"2024-09-19T13:56:23.177082+0000","last_unstale":"2024-09-19T15:28:12.381292+0000","last_undegraded":"2024-09-19T15:28:12.381292+0000","last_fullsized":"2024-09-19T15:28:12.381292+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:57:48.702504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":229,"num_write":111,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381366+0000","last_change":"2024-09-19T14:29:51.037911+0000","last_active":"2024-09-19T15:28:12.381366+0000","last_peered":"2024-09-19T15:28:12.381366+0000","last_clean":"2024-09-19T15:28:12.381366+0000","last_became_active":"2024-09-19T14:29:51.036980+0000","last_became_peered":"2024-09-19T14:29:51.036980+0000","last_unstale":"2024-09-19T15:28:12.381366+0000","last_undegraded":"2024-09-19T15:28:12.381366+0000","last_fullsized":"2024-09-19T15:28:12.381366+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:55.591300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:13.218778+0000","last_change":"2024-09-19T14:02:37.052547+0000","last_active":"2024-09-19T15:27:13.218778+0000","last_peered":"2024-09-19T15:27:13.218778+0000","last_clean":"2024-09-19T15:27:13.218778+0000","last_became_active":"2024-09-19T14:02:37.051627+0000","last_became_peered":"2024-09-19T14:02:37.051627+0000","last_unstale":"2024-09-19T15:27:13.218778+0000","last_undegraded":"2024-09-19T15:27:13.218778+0000","last_fullsized":"2024-09-19T15:27:13.218778+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:03.602347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'9","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.634582+0000","last_change":"2024-09-19T14:02:29.725819+0000","last_active":"2024-09-19T15:29:12.634582+0000","last_peered":"2024-09-19T15:29:12.634582+0000","last_clean":"2024-09-19T15:29:12.634582+0000","last_became_active":"2024-09-19T14:02:29.725042+0000","last_became_peered":"2024-09-19T14:02:29.725042+0000","last_unstale":"2024-09-19T15:29:12.634582+0000","last_undegraded":"2024-09-19T15:29:12.634582+0000","last_fullsized":"2024-09-19T15:29:12.634582+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:36.488155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":17453,"num_write":14,"num_write_kb":14381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'39","reported_seq":180,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:17.181387+0000","last_change":"2024-09-19T13:56:23.180645+0000","last_active":"2024-09-19T15:28:17.181387+0000","last_peered":"2024-09-19T15:28:17.181387+0000","last_clean":"2024-09-19T15:28:17.181387+0000","last_became_active":"2024-09-19T13:56:23.179656+0000","last_became_peered":"2024-09-19T13:56:23.179656+0000","last_unstale":"2024-09-19T15:28:17.181387+0000","last_undegraded":"2024-09-19T15:28:17.181387+0000","last_fullsized":"2024-09-19T15:28:17.181387+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:23.453827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":202,"num_write":114,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.547652+0000","last_change":"2024-09-19T14:29:51.035627+0000","last_active":"2024-09-19T15:28:12.547652+0000","last_peered":"2024-09-19T15:28:12.547652+0000","last_clean":"2024-09-19T15:28:12.547652+0000","last_became_active":"2024-09-19T14:29:51.034910+0000","last_became_peered":"2024-09-19T14:29:51.034910+0000","last_unstale":"2024-09-19T15:28:12.547652+0000","last_undegraded":"2024-09-19T15:28:12.547652+0000","last_fullsized":"2024-09-19T15:28:12.547652+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:52.799048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"268'3","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:08.245768+0000","last_change":"2024-09-19T14:02:37.050424+0000","last_active":"2024-09-19T15:29:08.245768+0000","last_peered":"2024-09-19T15:29:08.245768+0000","last_clean":"2024-09-19T15:29:08.245768+0000","last_became_active":"2024-09-19T14:02:37.049593+0000","last_became_peered":"2024-09-19T14:02:37.049593+0000","last_unstale":"2024-09-19T15:29:08.245768+0000","last_undegraded":"2024-09-19T15:29:08.245768+0000","last_fullsized":"2024-09-19T15:29:08.245768+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:09.018084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5827243,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":571,"num_write":8,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"268'6","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:07.625930+0000","last_change":"2024-09-19T14:02:29.738371+0000","last_active":"2024-09-19T15:27:07.625930+0000","last_peered":"2024-09-19T15:27:07.625930+0000","last_clean":"2024-09-19T15:27:07.625930+0000","last_became_active":"2024-09-19T14:02:29.737689+0000","last_became_peered":"2024-09-19T14:02:29.737689+0000","last_unstale":"2024-09-19T15:27:07.625930+0000","last_undegraded":"2024-09-19T15:27:07.625930+0000","last_fullsized":"2024-09-19T15:27:07.625930+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:43.480539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584363,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5718,"num_write":6,"num_write_kb":5718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'32","reported_seq":159,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:13.233083+0000","last_change":"2024-09-19T13:56:23.172875+0000","last_active":"2024-09-19T15:28:13.233083+0000","last_peered":"2024-09-19T15:28:13.233083+0000","last_clean":"2024-09-19T15:28:13.233083+0000","last_became_active":"2024-09-19T13:56:23.172185+0000","last_became_peered":"2024-09-19T13:56:23.172185+0000","last_unstale":"2024-09-19T15:28:13.233083+0000","last_undegraded":"2024-09-19T15:28:13.233083+0000","last_fullsized":"2024-09-19T15:28:13.233083+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:08:40.622542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":246,"num_read_kb":158,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.641708+0000","last_change":"2024-09-19T14:29:51.040551+0000","last_active":"2024-09-19T15:28:12.641708+0000","last_peered":"2024-09-19T15:28:12.641708+0000","last_clean":"2024-09-19T15:28:12.641708+0000","last_became_active":"2024-09-19T14:29:51.039877+0000","last_became_peered":"2024-09-19T14:29:51.039877+0000","last_unstale":"2024-09-19T15:28:12.641708+0000","last_undegraded":"2024-09-19T15:28:12.641708+0000","last_fullsized":"2024-09-19T15:28:12.641708+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:34:37.191773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"268'9","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:13.218849+0000","last_change":"2024-09-19T14:02:37.055970+0000","last_active":"2024-09-19T15:27:13.218849+0000","last_peered":"2024-09-19T15:27:13.218849+0000","last_clean":"2024-09-19T15:27:13.218849+0000","last_became_active":"2024-09-19T14:02:37.055184+0000","last_became_peered":"2024-09-19T14:02:37.055184+0000","last_unstale":"2024-09-19T15:27:13.218849+0000","last_undegraded":"2024-09-19T15:27:13.218849+0000","last_fullsized":"2024-09-19T15:27:13.218849+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:47.611898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":24576,"num_write":19,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"268'3","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:32.563962+0000","last_change":"2024-09-19T14:02:29.733490+0000","last_active":"2024-09-19T15:29:32.563962+0000","last_peered":"2024-09-19T15:29:32.563962+0000","last_clean":"2024-09-19T15:29:32.563962+0000","last_became_active":"2024-09-19T14:02:29.732063+0000","last_became_peered":"2024-09-19T14:02:29.732063+0000","last_unstale":"2024-09-19T15:29:32.563962+0000","last_undegraded":"2024-09-19T15:29:32.563962+0000","last_fullsized":"2024-09-19T15:29:32.563962+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:16:28.644404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'18","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.547747+0000","last_change":"2024-09-19T13:56:23.181555+0000","last_active":"2024-09-19T15:28:12.547747+0000","last_peered":"2024-09-19T15:28:12.547747+0000","last_clean":"2024-09-19T15:28:12.547747+0000","last_became_active":"2024-09-19T13:56:23.172998+0000","last_became_peered":"2024-09-19T13:56:23.172998+0000","last_unstale":"2024-09-19T15:28:12.547747+0000","last_undegraded":"2024-09-19T15:28:12.547747+0000","last_fullsized":"2024-09-19T15:28:12.547747+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:40:22.358000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.620591+0000","last_change":"2024-09-19T14:29:51.021155+0000","last_active":"2024-09-19T15:28:12.620591+0000","last_peered":"2024-09-19T15:28:12.620591+0000","last_clean":"2024-09-19T15:28:12.620591+0000","last_became_active":"2024-09-19T14:29:51.020277+0000","last_became_peered":"2024-09-19T14:29:51.020277+0000","last_unstale":"2024-09-19T15:28:12.620591+0000","last_undegraded":"2024-09-19T15:28:12.620591+0000","last_fullsized":"2024-09-19T15:28:12.620591+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:00.755087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"268'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:12.587546+0000","last_change":"2024-09-19T14:02:36.916711+0000","last_active":"2024-09-19T15:27:12.587546+0000","last_peered":"2024-09-19T15:27:12.587546+0000","last_clean":"2024-09-19T15:27:12.587546+0000","last_became_active":"2024-09-19T14:02:36.915962+0000","last_became_peered":"2024-09-19T14:02:36.915962+0000","last_unstale":"2024-09-19T15:27:12.587546+0000","last_undegraded":"2024-09-19T15:27:12.587546+0000","last_fullsized":"2024-09-19T15:27:12.587546+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:52.527680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:07.166557+0000","last_change":"2024-09-19T14:02:29.746541+0000","last_active":"2024-09-19T15:27:07.166557+0000","last_peered":"2024-09-19T15:27:07.166557+0000","last_clean":"2024-09-19T15:27:07.166557+0000","last_became_active":"2024-09-19T14:02:29.741726+0000","last_became_peered":"2024-09-19T14:02:29.741726+0000","last_unstale":"2024-09-19T15:27:07.166557+0000","last_undegraded":"2024-09-19T15:27:07.166557+0000","last_fullsized":"2024-09-19T15:27:07.166557+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:18.927081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'18","reported_seq":120,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:42.634520+0000","last_change":"2024-09-19T13:56:23.176208+0000","last_active":"2024-09-19T15:27:42.634520+0000","last_peered":"2024-09-19T15:27:42.634520+0000","last_clean":"2024-09-19T15:27:42.634520+0000","last_became_active":"2024-09-19T13:56:23.175483+0000","last_became_peered":"2024-09-19T13:56:23.175483+0000","last_unstale":"2024-09-19T15:27:42.634520+0000","last_undegraded":"2024-09-19T15:27:42.634520+0000","last_fullsized":"2024-09-19T15:27:42.634520+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:44:12.241473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":81,"num_write":47,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:53.228080+0000","last_change":"2024-09-19T14:29:51.055111+0000","last_active":"2024-09-19T15:27:53.228080+0000","last_peered":"2024-09-19T15:27:53.228080+0000","last_clean":"2024-09-19T15:27:53.228080+0000","last_became_active":"2024-09-19T14:29:51.054440+0000","last_became_peered":"2024-09-19T14:29:51.054440+0000","last_unstale":"2024-09-19T15:27:53.228080+0000","last_undegraded":"2024-09-19T15:27:53.228080+0000","last_fullsized":"2024-09-19T15:27:53.228080+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:41:52.609606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391603+0000","last_change":"2024-09-19T14:02:36.918632+0000","last_active":"2024-09-19T15:28:57.391603+0000","last_peered":"2024-09-19T15:28:57.391603+0000","last_clean":"2024-09-19T15:28:57.391603+0000","last_became_active":"2024-09-19T14:02:36.917886+0000","last_became_peered":"2024-09-19T14:02:36.917886+0000","last_unstale":"2024-09-19T15:28:57.391603+0000","last_undegraded":"2024-09-19T15:28:57.391603+0000","last_fullsized":"2024-09-19T15:28:57.391603+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:45:01.058163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"268'2","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:52.610272+0000","last_change":"2024-09-19T14:02:29.730814+0000","last_active":"2024-09-19T15:28:52.610272+0000","last_peered":"2024-09-19T15:28:52.610272+0000","last_clean":"2024-09-19T15:28:52.610272+0000","last_became_active":"2024-09-19T14:02:29.730095+0000","last_became_peered":"2024-09-19T14:02:29.730095+0000","last_unstale":"2024-09-19T15:28:52.610272+0000","last_undegraded":"2024-09-19T15:28:52.610272+0000","last_fullsized":"2024-09-19T15:28:52.610272+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:08.221591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'29","reported_seq":148,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.629547+0000","last_change":"2024-09-19T13:56:23.184572+0000","last_active":"2024-09-19T15:27:22.629547+0000","last_peered":"2024-09-19T15:27:22.629547+0000","last_clean":"2024-09-19T15:27:22.629547+0000","last_became_active":"2024-09-19T13:56:23.183825+0000","last_became_peered":"2024-09-19T13:56:23.183825+0000","last_unstale":"2024-09-19T15:27:22.629547+0000","last_undegraded":"2024-09-19T15:27:22.629547+0000","last_fullsized":"2024-09-19T15:27:22.629547+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:11.504818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":139,"num_write":76,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:52.175719+0000","last_change":"2024-09-19T14:29:51.036785+0000","last_active":"2024-09-19T15:27:52.175719+0000","last_peered":"2024-09-19T15:27:52.175719+0000","last_clean":"2024-09-19T15:27:52.175719+0000","last_became_active":"2024-09-19T14:29:51.036062+0000","last_became_peered":"2024-09-19T14:29:51.036062+0000","last_unstale":"2024-09-19T15:27:52.175719+0000","last_undegraded":"2024-09-19T15:27:52.175719+0000","last_fullsized":"2024-09-19T15:27:52.175719+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:13:16.540530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'3","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391538+0000","last_change":"2024-09-19T14:02:36.911361+0000","last_active":"2024-09-19T15:28:57.391538+0000","last_peered":"2024-09-19T15:28:57.391538+0000","last_clean":"2024-09-19T15:28:57.391538+0000","last_became_active":"2024-09-19T14:02:36.910298+0000","last_became_peered":"2024-09-19T14:02:36.910298+0000","last_unstale":"2024-09-19T15:28:57.391538+0000","last_undegraded":"2024-09-19T15:28:57.391538+0000","last_fullsized":"2024-09-19T15:28:57.391538+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:11:03.122123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'2","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:53.242045+0000","last_change":"2024-09-19T14:02:29.734818+0000","last_active":"2024-09-19T15:28:53.242045+0000","last_peered":"2024-09-19T15:28:53.242045+0000","last_clean":"2024-09-19T15:28:53.242045+0000","last_became_active":"2024-09-19T14:02:29.732413+0000","last_became_peered":"2024-09-19T14:02:29.732413+0000","last_unstale":"2024-09-19T15:28:53.242045+0000","last_undegraded":"2024-09-19T15:28:53.242045+0000","last_fullsized":"2024-09-19T15:28:53.242045+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:35.923776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"268'52","reported_seq":214,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:27.170202+0000","last_change":"2024-09-19T13:56:23.162178+0000","last_active":"2024-09-19T15:27:27.170202+0000","last_peered":"2024-09-19T15:27:27.170202+0000","last_clean":"2024-09-19T15:27:27.170202+0000","last_became_active":"2024-09-19T13:56:23.161268+0000","last_became_peered":"2024-09-19T13:56:23.161268+0000","last_unstale":"2024-09-19T15:27:27.170202+0000","last_undegraded":"2024-09-19T15:27:27.170202+0000","last_fullsized":"2024-09-19T15:27:27.170202+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:49.310248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":413,"num_read_kb":272,"num_write":131,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:32.184540+0000","last_change":"2024-09-19T14:29:51.057255+0000","last_active":"2024-09-19T15:28:32.184540+0000","last_peered":"2024-09-19T15:28:32.184540+0000","last_clean":"2024-09-19T15:28:32.184540+0000","last_became_active":"2024-09-19T14:29:51.055396+0000","last_became_peered":"2024-09-19T14:29:51.055396+0000","last_unstale":"2024-09-19T15:28:32.184540+0000","last_undegraded":"2024-09-19T15:28:32.184540+0000","last_fullsized":"2024-09-19T15:28:32.184540+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:09.497977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:58.243369+0000","last_change":"2024-09-19T14:02:36.927347+0000","last_active":"2024-09-19T15:28:58.243369+0000","last_peered":"2024-09-19T15:28:58.243369+0000","last_clean":"2024-09-19T15:28:58.243369+0000","last_became_active":"2024-09-19T14:02:36.926038+0000","last_became_peered":"2024-09-19T14:02:36.926038+0000","last_unstale":"2024-09-19T15:28:58.243369+0000","last_undegraded":"2024-09-19T15:28:58.243369+0000","last_fullsized":"2024-09-19T15:28:58.243369+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:13:52.343458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"268'6","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.612372+0000","last_change":"2024-09-19T14:02:29.741324+0000","last_active":"2024-09-19T15:31:38.612372+0000","last_peered":"2024-09-19T15:31:38.612372+0000","last_clean":"2024-09-19T15:31:38.612372+0000","last_became_active":"2024-09-19T14:02:29.740451+0000","last_became_peered":"2024-09-19T14:02:29.740451+0000","last_unstale":"2024-09-19T15:31:38.612372+0000","last_undegraded":"2024-09-19T15:31:38.612372+0000","last_fullsized":"2024-09-19T15:31:38.612372+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:22.134435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'35","reported_seq":173,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.589590+0000","last_change":"2024-09-19T13:56:23.176932+0000","last_active":"2024-09-19T15:27:22.589590+0000","last_peered":"2024-09-19T15:27:22.589590+0000","last_clean":"2024-09-19T15:27:22.589590+0000","last_became_active":"2024-09-19T13:56:23.170486+0000","last_became_peered":"2024-09-19T13:56:23.170486+0000","last_unstale":"2024-09-19T15:27:22.589590+0000","last_undegraded":"2024-09-19T15:27:22.589590+0000","last_fullsized":"2024-09-19T15:27:22.589590+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:43:58.374761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":196,"num_write":86,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:53.227989+0000","last_change":"2024-09-19T14:29:51.045330+0000","last_active":"2024-09-19T15:27:53.227989+0000","last_peered":"2024-09-19T15:27:53.227989+0000","last_clean":"2024-09-19T15:27:53.227989+0000","last_became_active":"2024-09-19T14:29:51.044154+0000","last_became_peered":"2024-09-19T14:29:51.044154+0000","last_unstale":"2024-09-19T15:27:53.227989+0000","last_undegraded":"2024-09-19T15:27:53.227989+0000","last_fullsized":"2024-09-19T15:27:53.227989+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:18.797951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.394100+0000","last_change":"2024-09-19T14:02:36.923267+0000","last_active":"2024-09-19T15:28:57.394100+0000","last_peered":"2024-09-19T15:28:57.394100+0000","last_clean":"2024-09-19T15:28:57.394100+0000","last_became_active":"2024-09-19T14:02:36.918735+0000","last_became_peered":"2024-09-19T14:02:36.918735+0000","last_unstale":"2024-09-19T15:28:57.394100+0000","last_undegraded":"2024-09-19T15:28:57.394100+0000","last_fullsized":"2024-09-19T15:28:57.394100+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:11.400154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:52.629773+0000","last_change":"2024-09-19T14:02:29.742726+0000","last_active":"2024-09-19T15:28:52.629773+0000","last_peered":"2024-09-19T15:28:52.629773+0000","last_clean":"2024-09-19T15:28:52.629773+0000","last_became_active":"2024-09-19T14:02:29.742091+0000","last_became_peered":"2024-09-19T14:02:29.742091+0000","last_unstale":"2024-09-19T15:28:52.629773+0000","last_undegraded":"2024-09-19T15:28:52.629773+0000","last_fullsized":"2024-09-19T15:28:52.629773+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:13:04.562095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'40","reported_seq":180,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:23.220896+0000","last_change":"2024-09-19T13:56:23.173987+0000","last_active":"2024-09-19T15:27:23.220896+0000","last_peered":"2024-09-19T15:27:23.220896+0000","last_clean":"2024-09-19T15:27:23.220896+0000","last_became_active":"2024-09-19T13:56:23.173245+0000","last_became_peered":"2024-09-19T13:56:23.173245+0000","last_unstale":"2024-09-19T15:27:23.220896+0000","last_undegraded":"2024-09-19T15:27:23.220896+0000","last_fullsized":"2024-09-19T15:27:23.220896+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:55:35.220716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":315,"num_read_kb":214,"num_write":104,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.552846+0000","last_change":"2024-09-19T14:29:51.044619+0000","last_active":"2024-09-19T15:28:37.552846+0000","last_peered":"2024-09-19T15:28:37.552846+0000","last_clean":"2024-09-19T15:28:37.552846+0000","last_became_active":"2024-09-19T14:29:51.043979+0000","last_became_peered":"2024-09-19T14:29:51.043979+0000","last_unstale":"2024-09-19T15:28:37.552846+0000","last_undegraded":"2024-09-19T15:28:37.552846+0000","last_fullsized":"2024-09-19T15:28:37.552846+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:31:38.625664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"268'1","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:08.231736+0000","last_change":"2024-09-19T14:02:36.926635+0000","last_active":"2024-09-19T15:28:08.231736+0000","last_peered":"2024-09-19T15:28:08.231736+0000","last_clean":"2024-09-19T15:28:08.231736+0000","last_became_active":"2024-09-19T14:02:36.925870+0000","last_became_peered":"2024-09-19T14:02:36.925870+0000","last_unstale":"2024-09-19T15:28:08.231736+0000","last_undegraded":"2024-09-19T15:28:08.231736+0000","last_fullsized":"2024-09-19T15:28:08.231736+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:50:58.009640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.639477+0000","last_change":"2024-09-19T14:02:29.745325+0000","last_active":"2024-09-19T15:28:02.639477+0000","last_peered":"2024-09-19T15:28:02.639477+0000","last_clean":"2024-09-19T15:28:02.639477+0000","last_became_active":"2024-09-19T14:02:29.744169+0000","last_became_peered":"2024-09-19T14:02:29.744169+0000","last_unstale":"2024-09-19T15:28:02.639477+0000","last_undegraded":"2024-09-19T15:28:02.639477+0000","last_fullsized":"2024-09-19T15:28:02.639477+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:49:32.607973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'31","reported_seq":167,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:48.241100+0000","last_change":"2024-09-19T13:56:23.167169+0000","last_active":"2024-09-19T15:28:48.241100+0000","last_peered":"2024-09-19T15:28:48.241100+0000","last_clean":"2024-09-19T15:28:48.241100+0000","last_became_active":"2024-09-19T13:56:23.160134+0000","last_became_peered":"2024-09-19T13:56:23.160134+0000","last_unstale":"2024-09-19T15:28:48.241100+0000","last_undegraded":"2024-09-19T15:28:48.241100+0000","last_fullsized":"2024-09-19T15:28:48.241100+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:17.424039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":163,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644264+0000","last_change":"2024-09-19T14:29:51.059018+0000","last_active":"2024-09-19T15:28:22.644264+0000","last_peered":"2024-09-19T15:28:22.644264+0000","last_clean":"2024-09-19T15:28:22.644264+0000","last_became_active":"2024-09-19T14:29:51.058494+0000","last_became_peered":"2024-09-19T14:29:51.058494+0000","last_unstale":"2024-09-19T15:28:22.644264+0000","last_undegraded":"2024-09-19T15:28:22.644264+0000","last_fullsized":"2024-09-19T15:28:22.644264+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:29.224657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:08.231677+0000","last_change":"2024-09-19T14:02:36.924847+0000","last_active":"2024-09-19T15:28:08.231677+0000","last_peered":"2024-09-19T15:28:08.231677+0000","last_clean":"2024-09-19T15:28:08.231677+0000","last_became_active":"2024-09-19T14:02:36.924213+0000","last_became_peered":"2024-09-19T14:02:36.924213+0000","last_unstale":"2024-09-19T15:28:08.231677+0000","last_undegraded":"2024-09-19T15:28:08.231677+0000","last_fullsized":"2024-09-19T15:28:08.231677+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:25.039869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.545625+0000","last_change":"2024-09-19T14:02:29.752025+0000","last_active":"2024-09-19T15:28:02.545625+0000","last_peered":"2024-09-19T15:28:02.545625+0000","last_clean":"2024-09-19T15:28:02.545625+0000","last_became_active":"2024-09-19T14:02:29.751229+0000","last_became_peered":"2024-09-19T14:02:29.751229+0000","last_unstale":"2024-09-19T15:28:02.545625+0000","last_undegraded":"2024-09-19T15:28:02.545625+0000","last_fullsized":"2024-09-19T15:28:02.545625+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:04.084148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"268'30","reported_seq":156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.626409+0000","last_change":"2024-09-19T13:56:23.168672+0000","last_active":"2024-09-19T15:28:37.626409+0000","last_peered":"2024-09-19T15:28:37.626409+0000","last_clean":"2024-09-19T15:28:37.626409+0000","last_became_active":"2024-09-19T13:56:23.166406+0000","last_became_peered":"2024-09-19T13:56:23.166406+0000","last_unstale":"2024-09-19T15:28:37.626409+0000","last_undegraded":"2024-09-19T15:28:37.626409+0000","last_fullsized":"2024-09-19T15:28:37.626409+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:17.132230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":158,"num_write":72,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.386230+0000","last_change":"2024-09-19T14:29:51.051349+0000","last_active":"2024-09-19T15:28:22.386230+0000","last_peered":"2024-09-19T15:28:22.386230+0000","last_clean":"2024-09-19T15:28:22.386230+0000","last_became_active":"2024-09-19T14:29:51.050808+0000","last_became_peered":"2024-09-19T14:29:51.050808+0000","last_unstale":"2024-09-19T15:28:22.386230+0000","last_undegraded":"2024-09-19T15:28:22.386230+0000","last_fullsized":"2024-09-19T15:28:22.386230+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:22:11.404680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"268'3","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:47.413935+0000","last_change":"2024-09-19T14:02:37.053056+0000","last_active":"2024-09-19T15:30:47.413935+0000","last_peered":"2024-09-19T15:30:47.413935+0000","last_clean":"2024-09-19T15:30:47.413935+0000","last_became_active":"2024-09-19T14:02:37.052121+0000","last_became_peered":"2024-09-19T14:02:37.052121+0000","last_unstale":"2024-09-19T15:30:47.413935+0000","last_undegraded":"2024-09-19T15:30:47.413935+0000","last_fullsized":"2024-09-19T15:30:47.413935+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:00.496165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.178139+0000","last_change":"2024-09-19T14:02:29.749448+0000","last_active":"2024-09-19T15:28:02.178139+0000","last_peered":"2024-09-19T15:28:02.178139+0000","last_clean":"2024-09-19T15:28:02.178139+0000","last_became_active":"2024-09-19T14:02:29.748469+0000","last_became_peered":"2024-09-19T14:02:29.748469+0000","last_unstale":"2024-09-19T15:28:02.178139+0000","last_undegraded":"2024-09-19T15:28:02.178139+0000","last_fullsized":"2024-09-19T15:28:02.178139+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:25.962511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"268'120","reported_seq":440,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.389638+0000","last_change":"2024-09-19T13:56:23.172759+0000","last_active":"2024-09-19T15:28:37.389638+0000","last_peered":"2024-09-19T15:28:37.389638+0000","last_clean":"2024-09-19T15:28:37.389638+0000","last_became_active":"2024-09-19T13:56:23.164737+0000","last_became_peered":"2024-09-19T13:56:23.164737+0000","last_unstale":"2024-09-19T15:28:37.389638+0000","last_undegraded":"2024-09-19T15:28:37.389638+0000","last_fullsized":"2024-09-19T15:28:37.389638+0000","mapping_epoch":255,"log_start":"265'100","ondisk_log_start":"265'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:31:33.872663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1135,"num_read_kb":1191,"num_write":240,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644185+0000","last_change":"2024-09-19T14:29:51.024362+0000","last_active":"2024-09-19T15:28:22.644185+0000","last_peered":"2024-09-19T15:28:22.644185+0000","last_clean":"2024-09-19T15:28:22.644185+0000","last_became_active":"2024-09-19T14:29:51.022975+0000","last_became_peered":"2024-09-19T14:29:51.022975+0000","last_unstale":"2024-09-19T15:28:22.644185+0000","last_undegraded":"2024-09-19T15:28:22.644185+0000","last_fullsized":"2024-09-19T15:28:22.644185+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:44:44.124646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"268'2","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:08.231787+0000","last_change":"2024-09-19T14:02:36.926595+0000","last_active":"2024-09-19T15:28:08.231787+0000","last_peered":"2024-09-19T15:28:08.231787+0000","last_clean":"2024-09-19T15:28:08.231787+0000","last_became_active":"2024-09-19T14:02:36.924349+0000","last_became_peered":"2024-09-19T14:02:36.924349+0000","last_unstale":"2024-09-19T15:28:08.231787+0000","last_undegraded":"2024-09-19T15:28:08.231787+0000","last_fullsized":"2024-09-19T15:28:08.231787+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:10.123769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:27.385058+0000","last_change":"2024-09-19T14:02:29.731121+0000","last_active":"2024-09-19T15:28:27.385058+0000","last_peered":"2024-09-19T15:28:27.385058+0000","last_clean":"2024-09-19T15:28:27.385058+0000","last_became_active":"2024-09-19T14:02:29.730280+0000","last_became_peered":"2024-09-19T14:02:29.730280+0000","last_unstale":"2024-09-19T15:28:27.385058+0000","last_undegraded":"2024-09-19T15:28:27.385058+0000","last_fullsized":"2024-09-19T15:28:27.385058+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:25.212771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'28","reported_seq":149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.552907+0000","last_change":"2024-09-19T13:56:23.183786+0000","last_active":"2024-09-19T15:28:37.552907+0000","last_peered":"2024-09-19T15:28:37.552907+0000","last_clean":"2024-09-19T15:28:37.552907+0000","last_became_active":"2024-09-19T13:56:23.182103+0000","last_became_peered":"2024-09-19T13:56:23.182103+0000","last_unstale":"2024-09-19T15:28:37.552907+0000","last_undegraded":"2024-09-19T15:28:37.552907+0000","last_fullsized":"2024-09-19T15:28:37.552907+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:32.317900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":141,"num_write":72,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:23.235388+0000","last_change":"2024-09-19T14:29:51.030844+0000","last_active":"2024-09-19T15:28:23.235388+0000","last_peered":"2024-09-19T15:28:23.235388+0000","last_clean":"2024-09-19T15:28:23.235388+0000","last_became_active":"2024-09-19T14:29:51.030200+0000","last_became_peered":"2024-09-19T14:29:51.030200+0000","last_unstale":"2024-09-19T15:28:23.235388+0000","last_undegraded":"2024-09-19T15:28:23.235388+0000","last_fullsized":"2024-09-19T15:28:23.235388+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:34:22.342028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"265'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:17.616101+0000","last_change":"2024-09-19T14:02:36.929045+0000","last_active":"2024-09-19T15:29:17.616101+0000","last_peered":"2024-09-19T15:29:17.616101+0000","last_clean":"2024-09-19T15:29:17.616101+0000","last_became_active":"2024-09-19T14:02:36.927585+0000","last_became_peered":"2024-09-19T14:02:36.927585+0000","last_unstale":"2024-09-19T15:29:17.616101+0000","last_undegraded":"2024-09-19T15:29:17.616101+0000","last_fullsized":"2024-09-19T15:29:17.616101+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:44:02.469367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"265'5","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.194026+0000","last_change":"2024-09-19T14:02:29.740714+0000","last_active":"2024-09-19T15:29:12.194026+0000","last_peered":"2024-09-19T15:29:12.194026+0000","last_clean":"2024-09-19T15:29:12.194026+0000","last_became_active":"2024-09-19T14:02:29.739469+0000","last_became_peered":"2024-09-19T14:02:29.739469+0000","last_unstale":"2024-09-19T15:29:12.194026+0000","last_undegraded":"2024-09-19T15:29:12.194026+0000","last_fullsized":"2024-09-19T15:29:12.194026+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:23.314643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'26","reported_seq":145,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.186692+0000","last_change":"2024-09-19T13:56:23.180908+0000","last_active":"2024-09-19T15:28:42.186692+0000","last_peered":"2024-09-19T15:28:42.186692+0000","last_clean":"2024-09-19T15:28:42.186692+0000","last_became_active":"2024-09-19T13:56:23.170897+0000","last_became_peered":"2024-09-19T13:56:23.170897+0000","last_unstale":"2024-09-19T15:28:42.186692+0000","last_undegraded":"2024-09-19T15:28:42.186692+0000","last_fullsized":"2024-09-19T15:28:42.186692+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:59.535564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":129,"num_write":67,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:32.646832+0000","last_change":"2024-09-19T14:29:51.047203+0000","last_active":"2024-09-19T15:28:32.646832+0000","last_peered":"2024-09-19T15:28:32.646832+0000","last_clean":"2024-09-19T15:28:32.646832+0000","last_became_active":"2024-09-19T14:29:51.046273+0000","last_became_peered":"2024-09-19T14:29:51.046273+0000","last_unstale":"2024-09-19T15:28:32.646832+0000","last_undegraded":"2024-09-19T15:28:32.646832+0000","last_fullsized":"2024-09-19T15:28:32.646832+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:15.605088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"268'7","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:17.657525+0000","last_change":"2024-09-19T14:02:37.051538+0000","last_active":"2024-09-19T15:29:17.657525+0000","last_peered":"2024-09-19T15:29:17.657525+0000","last_clean":"2024-09-19T15:29:17.657525+0000","last_became_active":"2024-09-19T14:02:37.050689+0000","last_became_peered":"2024-09-19T14:02:37.050689+0000","last_unstale":"2024-09-19T15:29:17.657525+0000","last_undegraded":"2024-09-19T15:29:17.657525+0000","last_fullsized":"2024-09-19T15:29:17.657525+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:21.698768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":32770,"num_write":7,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"265'5","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.395204+0000","last_change":"2024-09-19T14:02:29.731282+0000","last_active":"2024-09-19T15:29:12.395204+0000","last_peered":"2024-09-19T15:29:12.395204+0000","last_clean":"2024-09-19T15:29:12.395204+0000","last_became_active":"2024-09-19T14:02:29.730624+0000","last_became_peered":"2024-09-19T14:02:29.730624+0000","last_unstale":"2024-09-19T15:29:12.395204+0000","last_undegraded":"2024-09-19T15:29:12.395204+0000","last_fullsized":"2024-09-19T15:29:12.395204+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:58.498165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'5","reported_seq":90,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:42.634441+0000","last_change":"2024-09-19T13:56:23.182572+0000","last_active":"2024-09-19T15:27:42.634441+0000","last_peered":"2024-09-19T15:27:42.634441+0000","last_clean":"2024-09-19T15:27:42.634441+0000","last_became_active":"2024-09-19T13:56:23.181867+0000","last_became_peered":"2024-09-19T13:56:23.181867+0000","last_unstale":"2024-09-19T15:27:42.634441+0000","last_undegraded":"2024-09-19T15:27:42.634441+0000","last_fullsized":"2024-09-19T15:27:42.634441+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:12.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644309+0000","last_change":"2024-09-19T14:29:51.037068+0000","last_active":"2024-09-19T15:28:22.644309+0000","last_peered":"2024-09-19T15:28:22.644309+0000","last_clean":"2024-09-19T15:28:22.644309+0000","last_became_active":"2024-09-19T14:29:51.036292+0000","last_became_peered":"2024-09-19T14:29:51.036292+0000","last_unstale":"2024-09-19T15:28:22.644309+0000","last_undegraded":"2024-09-19T15:28:22.644309+0000","last_fullsized":"2024-09-19T15:28:22.644309+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:12.187433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"268'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:22.410283+0000","last_change":"2024-09-19T14:02:36.924261+0000","last_active":"2024-09-19T15:30:22.410283+0000","last_peered":"2024-09-19T15:30:22.410283+0000","last_clean":"2024-09-19T15:30:22.410283+0000","last_became_active":"2024-09-19T14:02:36.923500+0000","last_became_peered":"2024-09-19T14:02:36.923500+0000","last_unstale":"2024-09-19T15:30:22.410283+0000","last_undegraded":"2024-09-19T15:30:22.410283+0000","last_fullsized":"2024-09-19T15:30:22.410283+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:28:12.672018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'3","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:42.200939+0000","last_change":"2024-09-19T14:02:29.746888+0000","last_active":"2024-09-19T15:29:42.200939+0000","last_peered":"2024-09-19T15:29:42.200939+0000","last_clean":"2024-09-19T15:29:42.200939+0000","last_became_active":"2024-09-19T14:02:29.746148+0000","last_became_peered":"2024-09-19T14:02:29.746148+0000","last_unstale":"2024-09-19T15:29:42.200939+0000","last_undegraded":"2024-09-19T15:29:42.200939+0000","last_fullsized":"2024-09-19T15:29:42.200939+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:05.741943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'41","reported_seq":187,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:23.220986+0000","last_change":"2024-09-19T13:56:23.174360+0000","last_active":"2024-09-19T15:27:23.220986+0000","last_peered":"2024-09-19T15:27:23.220986+0000","last_clean":"2024-09-19T15:27:23.220986+0000","last_became_active":"2024-09-19T13:56:23.173918+0000","last_became_peered":"2024-09-19T13:56:23.173918+0000","last_unstale":"2024-09-19T15:27:23.220986+0000","last_undegraded":"2024-09-19T15:27:23.220986+0000","last_fullsized":"2024-09-19T15:27:23.220986+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:23.496354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":206,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.182455+0000","last_change":"2024-09-19T14:29:51.034137+0000","last_active":"2024-09-19T15:28:22.182455+0000","last_peered":"2024-09-19T15:28:22.182455+0000","last_clean":"2024-09-19T15:28:22.182455+0000","last_became_active":"2024-09-19T14:29:51.033329+0000","last_became_peered":"2024-09-19T14:29:51.033329+0000","last_unstale":"2024-09-19T15:28:22.182455+0000","last_undegraded":"2024-09-19T15:28:22.182455+0000","last_fullsized":"2024-09-19T15:28:22.182455+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:09.961864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'5","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:27.630988+0000","last_change":"2024-09-19T14:03:07.396429+0000","last_active":"2024-09-19T15:27:27.630988+0000","last_peered":"2024-09-19T15:27:27.630988+0000","last_clean":"2024-09-19T15:27:27.630988+0000","last_became_active":"2024-09-19T14:03:07.395844+0000","last_became_peered":"2024-09-19T14:03:07.395844+0000","last_unstale":"2024-09-19T15:27:27.630988+0000","last_undegraded":"2024-09-19T15:27:27.630988+0000","last_fullsized":"2024-09-19T15:27:27.630988+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:30.854364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5147,"num_write":5,"num_write_kb":5147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'3","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.598913+0000","last_change":"2024-09-19T14:02:29.733169+0000","last_active":"2024-09-19T15:28:02.598913+0000","last_peered":"2024-09-19T15:28:02.598913+0000","last_clean":"2024-09-19T15:28:02.598913+0000","last_became_active":"2024-09-19T14:02:29.732416+0000","last_became_peered":"2024-09-19T14:02:29.732416+0000","last_unstale":"2024-09-19T15:28:02.598913+0000","last_undegraded":"2024-09-19T15:28:02.598913+0000","last_fullsized":"2024-09-19T15:28:02.598913+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:49:13.647937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'38","reported_seq":188,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:32.402062+0000","last_change":"2024-09-19T13:56:23.173200+0000","last_active":"2024-09-19T15:29:32.402062+0000","last_peered":"2024-09-19T15:29:32.402062+0000","last_clean":"2024-09-19T15:29:32.402062+0000","last_became_active":"2024-09-19T13:56:23.172437+0000","last_became_peered":"2024-09-19T13:56:23.172437+0000","last_unstale":"2024-09-19T15:29:32.402062+0000","last_undegraded":"2024-09-19T15:29:32.402062+0000","last_fullsized":"2024-09-19T15:29:32.402062+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:43:47.758946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":311,"num_read_kb":193,"num_write":96,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.641824+0000","last_change":"2024-09-19T14:29:51.037099+0000","last_active":"2024-09-19T15:28:12.641824+0000","last_peered":"2024-09-19T15:28:12.641824+0000","last_clean":"2024-09-19T15:28:12.641824+0000","last_became_active":"2024-09-19T14:29:51.036386+0000","last_became_peered":"2024-09-19T14:29:51.036386+0000","last_unstale":"2024-09-19T15:28:12.641824+0000","last_undegraded":"2024-09-19T15:28:12.641824+0000","last_fullsized":"2024-09-19T15:28:12.641824+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:47.754572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:32.184569+0000","last_change":"2024-09-19T14:02:36.913472+0000","last_active":"2024-09-19T15:28:32.184569+0000","last_peered":"2024-09-19T15:28:32.184569+0000","last_clean":"2024-09-19T15:28:32.184569+0000","last_became_active":"2024-09-19T14:02:36.912757+0000","last_became_peered":"2024-09-19T14:02:36.912757+0000","last_unstale":"2024-09-19T15:28:32.184569+0000","last_undegraded":"2024-09-19T15:28:32.184569+0000","last_fullsized":"2024-09-19T15:28:32.184569+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:28.705324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"268'2","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.638148+0000","last_change":"2024-09-19T14:02:29.726496+0000","last_active":"2024-09-19T15:27:57.638148+0000","last_peered":"2024-09-19T15:27:57.638148+0000","last_clean":"2024-09-19T15:27:57.638148+0000","last_became_active":"2024-09-19T14:02:29.725707+0000","last_became_peered":"2024-09-19T14:02:29.725707+0000","last_unstale":"2024-09-19T15:27:57.638148+0000","last_undegraded":"2024-09-19T15:27:57.638148+0000","last_fullsized":"2024-09-19T15:27:57.638148+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:19.846245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'2","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:27.170452+0000","last_change":"2024-09-19T13:56:23.181807+0000","last_active":"2024-09-19T15:27:27.170452+0000","last_peered":"2024-09-19T15:27:27.170452+0000","last_clean":"2024-09-19T15:27:27.170452+0000","last_became_active":"2024-09-19T13:56:23.180518+0000","last_became_peered":"2024-09-19T13:56:23.180518+0000","last_unstale":"2024-09-19T15:27:27.170452+0000","last_undegraded":"2024-09-19T15:27:27.170452+0000","last_fullsized":"2024-09-19T15:27:27.170452+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:39.826441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.620670+0000","last_change":"2024-09-19T14:29:51.030804+0000","last_active":"2024-09-19T15:28:12.620670+0000","last_peered":"2024-09-19T15:28:12.620670+0000","last_clean":"2024-09-19T15:28:12.620670+0000","last_became_active":"2024-09-19T14:29:51.030021+0000","last_became_peered":"2024-09-19T14:29:51.030021+0000","last_unstale":"2024-09-19T15:28:12.620670+0000","last_undegraded":"2024-09-19T15:28:12.620670+0000","last_fullsized":"2024-09-19T15:28:12.620670+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:03.409322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"265'3","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.178084+0000","last_change":"2024-09-19T14:02:37.052572+0000","last_active":"2024-09-19T15:28:02.178084+0000","last_peered":"2024-09-19T15:28:02.178084+0000","last_clean":"2024-09-19T15:28:02.178084+0000","last_became_active":"2024-09-19T14:02:37.051567+0000","last_became_peered":"2024-09-19T14:02:37.051567+0000","last_unstale":"2024-09-19T15:28:02.178084+0000","last_undegraded":"2024-09-19T15:28:02.178084+0000","last_fullsized":"2024-09-19T15:28:02.178084+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:19:54.029118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:17.548757+0000","last_change":"2024-09-19T14:02:29.748318+0000","last_active":"2024-09-19T15:28:17.548757+0000","last_peered":"2024-09-19T15:28:17.548757+0000","last_clean":"2024-09-19T15:28:17.548757+0000","last_became_active":"2024-09-19T14:02:29.747539+0000","last_became_peered":"2024-09-19T14:02:29.747539+0000","last_unstale":"2024-09-19T15:28:17.548757+0000","last_undegraded":"2024-09-19T15:28:17.548757+0000","last_fullsized":"2024-09-19T15:28:17.548757+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:42:39.905932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"268'12","reported_seq":110,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:32.402224+0000","last_change":"2024-09-19T13:56:23.174992+0000","last_active":"2024-09-19T15:29:32.402224+0000","last_peered":"2024-09-19T15:29:32.402224+0000","last_clean":"2024-09-19T15:29:32.402224+0000","last_became_active":"2024-09-19T13:56:23.173882+0000","last_became_peered":"2024-09-19T13:56:23.173882+0000","last_unstale":"2024-09-19T15:29:32.402224+0000","last_undegraded":"2024-09-19T15:29:32.402224+0000","last_fullsized":"2024-09-19T15:29:32.402224+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:21.063143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":61,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381230+0000","last_change":"2024-09-19T14:29:51.050041+0000","last_active":"2024-09-19T15:28:12.381230+0000","last_peered":"2024-09-19T15:28:12.381230+0000","last_clean":"2024-09-19T15:28:12.381230+0000","last_became_active":"2024-09-19T14:29:51.049356+0000","last_became_peered":"2024-09-19T14:29:51.049356+0000","last_unstale":"2024-09-19T15:28:12.381230+0000","last_undegraded":"2024-09-19T15:28:12.381230+0000","last_fullsized":"2024-09-19T15:28:12.381230+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:28.752706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"268'7","reported_seq":81,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:17.657742+0000","last_change":"2024-09-19T14:02:37.057637+0000","last_active":"2024-09-19T15:29:17.657742+0000","last_peered":"2024-09-19T15:29:17.657742+0000","last_clean":"2024-09-19T15:29:17.657742+0000","last_became_active":"2024-09-19T14:02:37.056814+0000","last_became_peered":"2024-09-19T14:02:37.056814+0000","last_unstale":"2024-09-19T15:29:17.657742+0000","last_undegraded":"2024-09-19T15:29:17.657742+0000","last_fullsized":"2024-09-19T15:29:17.657742+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:04:44.022820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":17,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.634682+0000","last_change":"2024-09-19T14:02:29.724061+0000","last_active":"2024-09-19T15:29:12.634682+0000","last_peered":"2024-09-19T15:29:12.634682+0000","last_clean":"2024-09-19T15:29:12.634682+0000","last_became_active":"2024-09-19T14:02:29.723298+0000","last_became_peered":"2024-09-19T14:02:29.723298+0000","last_unstale":"2024-09-19T15:29:12.634682+0000","last_undegraded":"2024-09-19T15:29:12.634682+0000","last_fullsized":"2024-09-19T15:29:12.634682+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:04:40.406319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'20","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644346+0000","last_change":"2024-09-19T13:56:23.190217+0000","last_active":"2024-09-19T15:28:22.644346+0000","last_peered":"2024-09-19T15:28:22.644346+0000","last_clean":"2024-09-19T15:28:22.644346+0000","last_became_active":"2024-09-19T13:56:23.189485+0000","last_became_peered":"2024-09-19T13:56:23.189485+0000","last_unstale":"2024-09-19T15:28:22.644346+0000","last_undegraded":"2024-09-19T15:28:22.644346+0000","last_fullsized":"2024-09-19T15:28:22.644346+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:26:00.955840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":106,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.601092+0000","last_change":"2024-09-19T14:29:51.029750+0000","last_active":"2024-09-19T15:28:12.601092+0000","last_peered":"2024-09-19T15:28:12.601092+0000","last_clean":"2024-09-19T15:28:12.601092+0000","last_became_active":"2024-09-19T14:29:51.028866+0000","last_became_peered":"2024-09-19T14:29:51.028866+0000","last_unstale":"2024-09-19T15:28:12.601092+0000","last_undegraded":"2024-09-19T15:28:12.601092+0000","last_fullsized":"2024-09-19T15:28:12.601092+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:57:37.166340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'3","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:17.616296+0000","last_change":"2024-09-19T14:02:36.917356+0000","last_active":"2024-09-19T15:29:17.616296+0000","last_peered":"2024-09-19T15:29:17.616296+0000","last_clean":"2024-09-19T15:29:17.616296+0000","last_became_active":"2024-09-19T14:02:36.916389+0000","last_became_peered":"2024-09-19T14:02:36.916389+0000","last_unstale":"2024-09-19T15:29:17.616296+0000","last_undegraded":"2024-09-19T15:29:17.616296+0000","last_fullsized":"2024-09-19T15:29:17.616296+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:02.036578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6339878,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":12336,"num_write":3,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"268'7","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.656562+0000","last_change":"2024-09-19T14:02:29.741915+0000","last_active":"2024-09-19T15:29:12.656562+0000","last_peered":"2024-09-19T15:29:12.656562+0000","last_clean":"2024-09-19T15:29:12.656562+0000","last_became_active":"2024-09-19T14:02:29.740227+0000","last_became_peered":"2024-09-19T14:02:29.740227+0000","last_unstale":"2024-09-19T15:29:12.656562+0000","last_undegraded":"2024-09-19T15:29:12.656562+0000","last_fullsized":"2024-09-19T15:29:12.656562+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:46.277985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":9218,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'41","reported_seq":190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.378845+0000","last_change":"2024-09-19T13:56:23.174685+0000","last_active":"2024-09-19T15:28:02.378845+0000","last_peered":"2024-09-19T15:28:02.378845+0000","last_clean":"2024-09-19T15:28:02.378845+0000","last_became_active":"2024-09-19T13:56:23.173938+0000","last_became_peered":"2024-09-19T13:56:23.173938+0000","last_unstale":"2024-09-19T15:28:02.378845+0000","last_undegraded":"2024-09-19T15:28:02.378845+0000","last_fullsized":"2024-09-19T15:28:02.378845+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:20.591650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":330,"num_read_kb":229,"num_write":110,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.549879+0000","last_change":"2024-09-19T14:29:51.026777+0000","last_active":"2024-09-19T15:28:22.549879+0000","last_peered":"2024-09-19T15:28:22.549879+0000","last_clean":"2024-09-19T15:28:22.549879+0000","last_became_active":"2024-09-19T14:29:51.025959+0000","last_became_peered":"2024-09-19T14:29:51.025959+0000","last_unstale":"2024-09-19T15:28:22.549879+0000","last_undegraded":"2024-09-19T15:28:22.549879+0000","last_fullsized":"2024-09-19T15:28:22.549879+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:11:23.290380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.378636+0000","last_change":"2024-09-19T14:02:36.912701+0000","last_active":"2024-09-19T15:28:02.378636+0000","last_peered":"2024-09-19T15:28:02.378636+0000","last_clean":"2024-09-19T15:28:02.378636+0000","last_became_active":"2024-09-19T14:02:36.911804+0000","last_became_peered":"2024-09-19T14:02:36.911804+0000","last_unstale":"2024-09-19T15:28:02.378636+0000","last_undegraded":"2024-09-19T15:28:02.378636+0000","last_fullsized":"2024-09-19T15:28:02.378636+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:12.422526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"268'6","reported_seq":87,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:52.651438+0000","last_change":"2024-09-19T14:02:29.748278+0000","last_active":"2024-09-19T15:28:52.651438+0000","last_peered":"2024-09-19T15:28:52.651438+0000","last_clean":"2024-09-19T15:28:52.651438+0000","last_became_active":"2024-09-19T14:02:29.747553+0000","last_became_peered":"2024-09-19T14:02:29.747553+0000","last_unstale":"2024-09-19T15:28:52.651438+0000","last_undegraded":"2024-09-19T15:28:52.651438+0000","last_fullsized":"2024-09-19T15:28:52.651438+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:20:14.376148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":21504,"num_write":6,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'275","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.618334+0000","last_change":"2024-09-19T13:56:23.186164+0000","last_active":"2024-09-19T15:28:02.618334+0000","last_peered":"2024-09-19T15:28:02.618334+0000","last_clean":"2024-09-19T15:28:02.618334+0000","last_became_active":"2024-09-19T13:56:23.185522+0000","last_became_peered":"2024-09-19T13:56:23.185522+0000","last_unstale":"2024-09-19T15:28:02.618334+0000","last_undegraded":"2024-09-19T15:28:02.618334+0000","last_fullsized":"2024-09-19T15:28:02.618334+0000","mapping_epoch":255,"log_start":"265'200","ondisk_log_start":"265'200","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:23.817224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2606,"num_read_kb":3112,"num_write":537,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.182535+0000","last_change":"2024-09-19T14:29:51.043009+0000","last_active":"2024-09-19T15:28:22.182535+0000","last_peered":"2024-09-19T15:28:22.182535+0000","last_clean":"2024-09-19T15:28:22.182535+0000","last_became_active":"2024-09-19T14:29:51.042287+0000","last_became_peered":"2024-09-19T14:29:51.042287+0000","last_unstale":"2024-09-19T15:28:22.182535+0000","last_undegraded":"2024-09-19T15:28:22.182535+0000","last_fullsized":"2024-09-19T15:28:22.182535+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:00:55.357725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"268'2","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.630840+0000","last_change":"2024-09-19T14:02:36.913575+0000","last_active":"2024-09-19T15:28:57.630840+0000","last_peered":"2024-09-19T15:28:57.630840+0000","last_clean":"2024-09-19T15:28:57.630840+0000","last_became_active":"2024-09-19T14:02:36.912642+0000","last_became_peered":"2024-09-19T14:02:36.912642+0000","last_unstale":"2024-09-19T15:28:57.630840+0000","last_undegraded":"2024-09-19T15:28:57.630840+0000","last_fullsized":"2024-09-19T15:28:57.630840+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:53.289654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.637948+0000","last_change":"2024-09-19T14:02:29.740640+0000","last_active":"2024-09-19T15:27:57.637948+0000","last_peered":"2024-09-19T15:27:57.637948+0000","last_clean":"2024-09-19T15:27:57.637948+0000","last_became_active":"2024-09-19T14:02:29.739397+0000","last_became_peered":"2024-09-19T14:02:29.739397+0000","last_unstale":"2024-09-19T15:27:57.637948+0000","last_undegraded":"2024-09-19T15:27:57.637948+0000","last_fullsized":"2024-09-19T15:27:57.637948+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:38.568040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'26","reported_seq":155,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.598838+0000","last_change":"2024-09-19T13:56:23.179600+0000","last_active":"2024-09-19T15:28:02.598838+0000","last_peered":"2024-09-19T15:28:02.598838+0000","last_clean":"2024-09-19T15:28:02.598838+0000","last_became_active":"2024-09-19T13:56:23.178722+0000","last_became_peered":"2024-09-19T13:56:23.178722+0000","last_unstale":"2024-09-19T15:28:02.598838+0000","last_undegraded":"2024-09-19T15:28:02.598838+0000","last_fullsized":"2024-09-19T15:28:02.598838+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:17.896929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":137,"num_write":65,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.180147+0000","last_change":"2024-09-19T14:29:51.040094+0000","last_active":"2024-09-19T15:28:12.180147+0000","last_peered":"2024-09-19T15:28:12.180147+0000","last_clean":"2024-09-19T15:28:12.180147+0000","last_became_active":"2024-09-19T14:29:51.037398+0000","last_became_peered":"2024-09-19T14:29:51.037398+0000","last_unstale":"2024-09-19T15:28:12.180147+0000","last_undegraded":"2024-09-19T15:28:12.180147+0000","last_fullsized":"2024-09-19T15:28:12.180147+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:38.720027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.382027+0000","last_change":"2024-09-19T14:02:36.929646+0000","last_active":"2024-09-19T15:28:02.382027+0000","last_peered":"2024-09-19T15:28:02.382027+0000","last_clean":"2024-09-19T15:28:02.382027+0000","last_became_active":"2024-09-19T14:02:36.928598+0000","last_became_peered":"2024-09-19T14:02:36.928598+0000","last_unstale":"2024-09-19T15:28:02.382027+0000","last_undegraded":"2024-09-19T15:28:02.382027+0000","last_fullsized":"2024-09-19T15:28:02.382027+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:55:11.565586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"268'2","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:02.405667+0000","last_change":"2024-09-19T14:02:29.738035+0000","last_active":"2024-09-19T15:30:02.405667+0000","last_peered":"2024-09-19T15:30:02.405667+0000","last_clean":"2024-09-19T15:30:02.405667+0000","last_became_active":"2024-09-19T14:02:29.737082+0000","last_became_peered":"2024-09-19T14:02:29.737082+0000","last_unstale":"2024-09-19T15:30:02.405667+0000","last_undegraded":"2024-09-19T15:30:02.405667+0000","last_fullsized":"2024-09-19T15:30:02.405667+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:59.761712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'51","reported_seq":222,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.381862+0000","last_change":"2024-09-19T13:56:23.173928+0000","last_active":"2024-09-19T15:28:02.381862+0000","last_peered":"2024-09-19T15:28:02.381862+0000","last_clean":"2024-09-19T15:28:02.381862+0000","last_became_active":"2024-09-19T13:56:23.173172+0000","last_became_peered":"2024-09-19T13:56:23.173172+0000","last_unstale":"2024-09-19T15:28:02.381862+0000","last_undegraded":"2024-09-19T15:28:02.381862+0000","last_fullsized":"2024-09-19T15:28:02.381862+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:40:50.508754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":432,"num_read_kb":295,"num_write":119,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644369+0000","last_change":"2024-09-19T14:29:51.048750+0000","last_active":"2024-09-19T15:28:22.644369+0000","last_peered":"2024-09-19T15:28:22.644369+0000","last_clean":"2024-09-19T15:28:22.644369+0000","last_became_active":"2024-09-19T14:29:51.047826+0000","last_became_peered":"2024-09-19T14:29:51.047826+0000","last_unstale":"2024-09-19T15:28:22.644369+0000","last_undegraded":"2024-09-19T15:28:22.644369+0000","last_fullsized":"2024-09-19T15:28:22.644369+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:01.510352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'5","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.598789+0000","last_change":"2024-09-19T14:02:36.910670+0000","last_active":"2024-09-19T15:28:02.598789+0000","last_peered":"2024-09-19T15:28:02.598789+0000","last_clean":"2024-09-19T15:28:02.598789+0000","last_became_active":"2024-09-19T14:02:36.910154+0000","last_became_peered":"2024-09-19T14:02:36.910154+0000","last_unstale":"2024-09-19T15:28:02.598789+0000","last_undegraded":"2024-09-19T15:28:02.598789+0000","last_fullsized":"2024-09-19T15:28:02.598789+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:30:56.428703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"268'2","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:02.408592+0000","last_change":"2024-09-19T14:02:29.723856+0000","last_active":"2024-09-19T15:30:02.408592+0000","last_peered":"2024-09-19T15:30:02.408592+0000","last_clean":"2024-09-19T15:30:02.408592+0000","last_became_active":"2024-09-19T14:02:29.723084+0000","last_became_peered":"2024-09-19T14:02:29.723084+0000","last_unstale":"2024-09-19T15:30:02.408592+0000","last_undegraded":"2024-09-19T15:30:02.408592+0000","last_fullsized":"2024-09-19T15:30:02.408592+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:57:24.394062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'52","reported_seq":217,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.648963+0000","last_change":"2024-09-19T13:56:23.182198+0000","last_active":"2024-09-19T15:28:42.648963+0000","last_peered":"2024-09-19T15:28:42.648963+0000","last_clean":"2024-09-19T15:28:42.648963+0000","last_became_active":"2024-09-19T13:56:23.181354+0000","last_became_peered":"2024-09-19T13:56:23.181354+0000","last_unstale":"2024-09-19T15:28:42.648963+0000","last_undegraded":"2024-09-19T15:28:42.648963+0000","last_fullsized":"2024-09-19T15:28:42.648963+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:38.576519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":381,"num_read_kb":254,"num_write":133,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'321","reported_seq":1026,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.652800+0000","last_change":"2024-09-19T13:40:34.279763+0000","last_active":"2024-09-19T15:28:57.652800+0000","last_peered":"2024-09-19T15:28:57.652800+0000","last_clean":"2024-09-19T15:28:57.652800+0000","last_became_active":"2024-09-19T13:40:34.278366+0000","last_became_peered":"2024-09-19T13:40:34.278366+0000","last_unstale":"2024-09-19T15:28:57.652800+0000","last_undegraded":"2024-09-19T15:28:57.652800+0000","last_fullsized":"2024-09-19T15:28:57.652800+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:54.618095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17350441,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":601,"num_read_kb":97880,"num_write":1200,"num_write_kb":51204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'896","reported_seq":2622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:46.037523+0000","last_change":"2024-09-19T13:40:36.233984+0000","last_active":"2024-09-19T15:28:46.037523+0000","last_peered":"2024-09-19T15:28:46.037523+0000","last_clean":"2024-09-19T15:28:46.037523+0000","last_became_active":"2024-09-19T13:40:36.233265+0000","last_became_peered":"2024-09-19T13:40:36.233265+0000","last_unstale":"2024-09-19T15:28:46.037523+0000","last_undegraded":"2024-09-19T15:28:46.037523+0000","last_fullsized":"2024-09-19T15:28:46.037523+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":800,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:51:51.439880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4503,"num_read_kb":4037,"num_write":1205,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'293","reported_seq":916,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.476093+0000","last_change":"2024-09-19T13:40:34.240880+0000","last_active":"2024-09-19T15:31:40.476093+0000","last_peered":"2024-09-19T15:31:40.476093+0000","last_clean":"2024-09-19T15:31:40.476093+0000","last_became_active":"2024-09-19T13:40:34.240412+0000","last_became_peered":"2024-09-19T13:40:34.240412+0000","last_unstale":"2024-09-19T15:31:40.476093+0000","last_undegraded":"2024-09-19T15:31:40.476093+0000","last_fullsized":"2024-09-19T15:31:40.476093+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:44.406577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":459,"num_read_kb":36198,"num_write":952,"num_write_kb":29274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'618","reported_seq":2321,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.314706+0000","last_change":"2024-09-19T13:40:36.233243+0000","last_active":"2024-09-19T15:29:41.314706+0000","last_peered":"2024-09-19T15:29:41.314706+0000","last_clean":"2024-09-19T15:29:41.314706+0000","last_became_active":"2024-09-19T13:40:36.232504+0000","last_became_peered":"2024-09-19T13:40:36.232504+0000","last_unstale":"2024-09-19T15:29:41.314706+0000","last_undegraded":"2024-09-19T15:29:41.314706+0000","last_fullsized":"2024-09-19T15:29:41.314706+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":600,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:48.735786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3362,"num_read_kb":3070,"num_write":813,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'361","reported_seq":1042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.396201+0000","last_change":"2024-09-19T13:40:34.216282+0000","last_active":"2024-09-19T15:31:40.396201+0000","last_peered":"2024-09-19T15:31:40.396201+0000","last_clean":"2024-09-19T15:31:40.396201+0000","last_became_active":"2024-09-19T13:40:34.215960+0000","last_became_peered":"2024-09-19T13:40:34.215960+0000","last_unstale":"2024-09-19T15:31:40.396201+0000","last_undegraded":"2024-09-19T15:31:40.396201+0000","last_fullsized":"2024-09-19T15:31:40.396201+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:04.475058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":684,"num_read_kb":31785,"num_write":1188,"num_write_kb":29902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'838","reported_seq":2388,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.242934+0000","last_change":"2024-09-19T13:40:36.227193+0000","last_active":"2024-09-19T15:31:12.242934+0000","last_peered":"2024-09-19T15:31:12.242934+0000","last_clean":"2024-09-19T15:31:12.242934+0000","last_became_active":"2024-09-19T13:40:36.220563+0000","last_became_peered":"2024-09-19T13:40:36.220563+0000","last_unstale":"2024-09-19T15:31:12.242934+0000","last_undegraded":"2024-09-19T15:31:12.242934+0000","last_fullsized":"2024-09-19T15:31:12.242934+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:33.303811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4017,"num_read_kb":3603,"num_write":1098,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'295","reported_seq":968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.632193+0000","last_change":"2024-09-19T13:40:34.242237+0000","last_active":"2024-09-19T15:29:02.632193+0000","last_peered":"2024-09-19T15:29:02.632193+0000","last_clean":"2024-09-19T15:29:02.632193+0000","last_became_active":"2024-09-19T13:40:34.239843+0000","last_became_peered":"2024-09-19T13:40:34.239843+0000","last_unstale":"2024-09-19T15:29:02.632193+0000","last_undegraded":"2024-09-19T15:29:02.632193+0000","last_fullsized":"2024-09-19T15:29:02.632193+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:31.305832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1917338,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":516,"num_read_kb":4189,"num_write":1092,"num_write_kb":27975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'1555","reported_seq":3224,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.276379+0000","last_change":"2024-09-19T13:40:36.226610+0000","last_active":"2024-09-19T15:31:12.276379+0000","last_peered":"2024-09-19T15:31:12.276379+0000","last_clean":"2024-09-19T15:31:12.276379+0000","last_became_active":"2024-09-19T13:40:36.225954+0000","last_became_peered":"2024-09-19T13:40:36.225954+0000","last_unstale":"2024-09-19T15:31:12.276379+0000","last_undegraded":"2024-09-19T15:31:12.276379+0000","last_fullsized":"2024-09-19T15:31:12.276379+0000","mapping_epoch":27,"log_start":"268'1500","ondisk_log_start":"268'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:17.018995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7021,"num_read_kb":6136,"num_write":2176,"num_write_kb":944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'248","reported_seq":951,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.640693+0000","last_change":"2024-09-19T13:40:34.275994+0000","last_active":"2024-09-19T15:28:07.640693+0000","last_peered":"2024-09-19T15:28:07.640693+0000","last_clean":"2024-09-19T15:28:07.640693+0000","last_became_active":"2024-09-19T13:40:34.267254+0000","last_became_peered":"2024-09-19T13:40:34.267254+0000","last_unstale":"2024-09-19T15:28:07.640693+0000","last_undegraded":"2024-09-19T15:28:07.640693+0000","last_fullsized":"2024-09-19T15:28:07.640693+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:10:14.953671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1175961,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":599,"num_read_kb":4762,"num_write":856,"num_write_kb":10224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"268'447","reported_seq":2099,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:07.396639+0000","last_change":"2024-09-19T13:40:36.221236+0000","last_active":"2024-09-19T15:29:07.396639+0000","last_peered":"2024-09-19T15:29:07.396639+0000","last_clean":"2024-09-19T15:29:07.396639+0000","last_became_active":"2024-09-19T13:40:36.220431+0000","last_became_peered":"2024-09-19T13:40:36.220431+0000","last_unstale":"2024-09-19T15:29:07.396639+0000","last_undegraded":"2024-09-19T15:29:07.396639+0000","last_fullsized":"2024-09-19T15:29:07.396639+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:52:16.868711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2602,"num_read_kb":2484,"num_write":543,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'257","reported_seq":903,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:06.208639+0000","last_change":"2024-09-19T13:40:34.226045+0000","last_active":"2024-09-19T15:31:06.208639+0000","last_peered":"2024-09-19T15:31:06.208639+0000","last_clean":"2024-09-19T15:31:06.208639+0000","last_became_active":"2024-09-19T13:40:34.218957+0000","last_became_peered":"2024-09-19T13:40:34.218957+0000","last_unstale":"2024-09-19T15:31:06.208639+0000","last_undegraded":"2024-09-19T15:31:06.208639+0000","last_fullsized":"2024-09-19T15:31:06.208639+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:01.849971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6885246,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":447,"num_read_kb":8139,"num_write":914,"num_write_kb":24727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'795","reported_seq":2558,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.611809+0000","last_change":"2024-09-19T13:40:36.231857+0000","last_active":"2024-09-19T15:28:57.611809+0000","last_peered":"2024-09-19T15:28:57.611809+0000","last_clean":"2024-09-19T15:28:57.611809+0000","last_became_active":"2024-09-19T13:40:36.228785+0000","last_became_peered":"2024-09-19T13:40:36.228785+0000","last_unstale":"2024-09-19T15:28:57.611809+0000","last_undegraded":"2024-09-19T15:28:57.611809+0000","last_fullsized":"2024-09-19T15:28:57.611809+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:24:05.926374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4179,"num_read_kb":3830,"num_write":1044,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'280","reported_seq":928,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.640604+0000","last_change":"2024-09-19T13:40:34.268730+0000","last_active":"2024-09-19T15:28:07.640604+0000","last_peered":"2024-09-19T15:28:07.640604+0000","last_clean":"2024-09-19T15:28:07.640604+0000","last_became_active":"2024-09-19T13:40:34.267647+0000","last_became_peered":"2024-09-19T13:40:34.267647+0000","last_unstale":"2024-09-19T15:28:07.640604+0000","last_undegraded":"2024-09-19T15:28:07.640604+0000","last_fullsized":"2024-09-19T15:28:07.640604+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:41.507634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22424101,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":484,"num_read_kb":19591,"num_write":1013,"num_write_kb":28817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"268'1154","reported_seq":2774,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.631097+0000","last_change":"2024-09-19T13:40:36.231346+0000","last_active":"2024-09-19T15:28:57.631097+0000","last_peered":"2024-09-19T15:28:57.631097+0000","last_clean":"2024-09-19T15:28:57.631097+0000","last_became_active":"2024-09-19T13:40:36.230581+0000","last_became_peered":"2024-09-19T13:40:36.230581+0000","last_unstale":"2024-09-19T15:28:57.631097+0000","last_undegraded":"2024-09-19T15:28:57.631097+0000","last_fullsized":"2024-09-19T15:28:57.631097+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":1100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:33:28.578391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5418,"num_read_kb":4799,"num_write":1598,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'320","reported_seq":1063,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:08.231546+0000","last_change":"2024-09-19T13:40:34.237921+0000","last_active":"2024-09-19T15:28:08.231546+0000","last_peered":"2024-09-19T15:28:08.231546+0000","last_clean":"2024-09-19T15:28:08.231546+0000","last_became_active":"2024-09-19T13:40:34.237561+0000","last_became_peered":"2024-09-19T13:40:34.237561+0000","last_unstale":"2024-09-19T15:28:08.231546+0000","last_undegraded":"2024-09-19T15:28:08.231546+0000","last_fullsized":"2024-09-19T15:28:08.231546+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:55.737645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19811415,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":785,"num_read_kb":72182,"num_write":1114,"num_write_kb":41551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'651","reported_seq":2356,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.323183+0000","last_change":"2024-09-19T13:40:36.223002+0000","last_active":"2024-09-19T15:31:12.323183+0000","last_peered":"2024-09-19T15:31:12.323183+0000","last_clean":"2024-09-19T15:31:12.323183+0000","last_became_active":"2024-09-19T13:40:36.221587+0000","last_became_peered":"2024-09-19T13:40:36.221587+0000","last_unstale":"2024-09-19T15:31:12.323183+0000","last_undegraded":"2024-09-19T15:31:12.323183+0000","last_fullsized":"2024-09-19T15:31:12.323183+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":600,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:09:30.633730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3331,"num_read_kb":3024,"num_write":858,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'1220","reported_seq":3029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.597578+0000","last_change":"2024-09-19T13:40:36.228802+0000","last_active":"2024-09-19T15:27:57.597578+0000","last_peered":"2024-09-19T15:27:57.597578+0000","last_clean":"2024-09-19T15:27:57.597578+0000","last_became_active":"2024-09-19T13:40:36.220889+0000","last_became_peered":"2024-09-19T13:40:36.220889+0000","last_unstale":"2024-09-19T15:27:57.597578+0000","last_undegraded":"2024-09-19T15:27:57.597578+0000","last_fullsized":"2024-09-19T15:27:57.597578+0000","mapping_epoch":27,"log_start":"268'1200","ondisk_log_start":"268'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":1200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:58.428789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5895,"num_read_kb":5235,"num_write":1696,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'346","reported_seq":1076,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.629874+0000","last_change":"2024-09-19T13:40:34.280286+0000","last_active":"2024-09-19T15:27:22.629874+0000","last_peered":"2024-09-19T15:27:22.629874+0000","last_clean":"2024-09-19T15:27:22.629874+0000","last_became_active":"2024-09-19T13:40:34.278991+0000","last_became_peered":"2024-09-19T13:40:34.278991+0000","last_unstale":"2024-09-19T15:27:22.629874+0000","last_undegraded":"2024-09-19T15:27:22.629874+0000","last_fullsized":"2024-09-19T15:27:22.629874+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:34.156634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3264053,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":897,"num_read_kb":8273,"num_write":1205,"num_write_kb":26935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'1133","reported_seq":2648,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:39.715402+0000","last_change":"2024-09-19T13:40:36.233737+0000","last_active":"2024-09-19T15:28:39.715402+0000","last_peered":"2024-09-19T15:28:39.715402+0000","last_clean":"2024-09-19T15:28:39.715402+0000","last_became_active":"2024-09-19T13:40:36.233032+0000","last_became_peered":"2024-09-19T13:40:36.233032+0000","last_unstale":"2024-09-19T15:28:39.715402+0000","last_undegraded":"2024-09-19T15:28:39.715402+0000","last_fullsized":"2024-09-19T15:28:39.715402+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":1100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:01.168529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5185,"num_read_kb":4564,"num_write":1576,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'361","reported_seq":1020,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.507998+0000","last_change":"2024-09-19T13:40:34.258739+0000","last_active":"2024-09-19T15:31:40.507998+0000","last_peered":"2024-09-19T15:31:40.507998+0000","last_clean":"2024-09-19T15:31:40.507998+0000","last_became_active":"2024-09-19T13:40:34.257994+0000","last_became_peered":"2024-09-19T13:40:34.257994+0000","last_unstale":"2024-09-19T15:31:40.507998+0000","last_undegraded":"2024-09-19T15:31:40.507998+0000","last_fullsized":"2024-09-19T15:31:40.507998+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:29.815057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":609,"num_read_kb":26261,"num_write":1202,"num_write_kb":39497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"268'589","reported_seq":2568,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:46.037916+0000","last_change":"2024-09-19T13:40:36.232300+0000","last_active":"2024-09-19T15:28:46.037916+0000","last_peered":"2024-09-19T15:28:46.037916+0000","last_clean":"2024-09-19T15:28:46.037916+0000","last_became_active":"2024-09-19T13:40:36.231554+0000","last_became_peered":"2024-09-19T13:40:36.231554+0000","last_unstale":"2024-09-19T15:28:46.037916+0000","last_undegraded":"2024-09-19T15:28:46.037916+0000","last_fullsized":"2024-09-19T15:28:46.037916+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":500,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:04.811846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3450,"num_read_kb":3252,"num_write":736,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'354","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.463558+0000","last_change":"2024-09-19T13:40:34.265083+0000","last_active":"2024-09-19T15:31:40.463558+0000","last_peered":"2024-09-19T15:31:40.463558+0000","last_clean":"2024-09-19T15:31:40.463558+0000","last_became_active":"2024-09-19T13:40:34.264349+0000","last_became_peered":"2024-09-19T13:40:34.264349+0000","last_unstale":"2024-09-19T15:31:40.463558+0000","last_undegraded":"2024-09-19T15:31:40.463558+0000","last_fullsized":"2024-09-19T15:31:40.463558+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:55.371080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":590,"num_read_kb":18139,"num_write":1138,"num_write_kb":28020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'533","reported_seq":2156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.231056+0000","last_change":"2024-09-19T13:40:36.222241+0000","last_active":"2024-09-19T15:29:41.231056+0000","last_peered":"2024-09-19T15:29:41.231056+0000","last_clean":"2024-09-19T15:29:41.231056+0000","last_became_active":"2024-09-19T13:40:36.221266+0000","last_became_peered":"2024-09-19T13:40:36.221266+0000","last_unstale":"2024-09-19T15:29:41.231056+0000","last_undegraded":"2024-09-19T15:29:41.231056+0000","last_fullsized":"2024-09-19T15:29:41.231056+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:17.944396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2921,"num_read_kb":2700,"num_write":709,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'275","reported_seq":1122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:26:57.583847+0000","last_change":"2024-09-19T13:40:34.266244+0000","last_active":"2024-09-19T15:26:57.583847+0000","last_peered":"2024-09-19T15:26:57.583847+0000","last_clean":"2024-09-19T15:26:57.583847+0000","last_became_active":"2024-09-19T13:40:34.262084+0000","last_became_peered":"2024-09-19T13:40:34.262084+0000","last_unstale":"2024-09-19T15:26:57.583847+0000","last_undegraded":"2024-09-19T15:26:57.583847+0000","last_fullsized":"2024-09-19T15:26:57.583847+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:10:19.847500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213551,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":1101,"num_read_kb":45011,"num_write":949,"num_write_kb":26916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"268'461","reported_seq":2066,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.328055+0000","last_change":"2024-09-19T13:40:36.216484+0000","last_active":"2024-09-19T15:29:48.328055+0000","last_peered":"2024-09-19T15:29:48.328055+0000","last_clean":"2024-09-19T15:29:48.328055+0000","last_became_active":"2024-09-19T13:40:36.216082+0000","last_became_peered":"2024-09-19T13:40:36.216082+0000","last_unstale":"2024-09-19T15:29:48.328055+0000","last_undegraded":"2024-09-19T15:29:48.328055+0000","last_fullsized":"2024-09-19T15:29:48.328055+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:42.568128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2409,"num_read_kb":2273,"num_write":537,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'264","reported_seq":910,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:40.941556+0000","last_change":"2024-09-19T13:40:34.238078+0000","last_active":"2024-09-19T15:29:40.941556+0000","last_peered":"2024-09-19T15:29:40.941556+0000","last_clean":"2024-09-19T15:29:40.941556+0000","last_became_active":"2024-09-19T13:40:34.237589+0000","last_became_peered":"2024-09-19T13:40:34.237589+0000","last_unstale":"2024-09-19T15:29:40.941556+0000","last_undegraded":"2024-09-19T15:29:40.941556+0000","last_fullsized":"2024-09-19T15:29:40.941556+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:46.977541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10513849,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":396,"num_read_kb":27576,"num_write":885,"num_write_kb":52672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'576","reported_seq":2260,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.332414+0000","last_change":"2024-09-19T13:40:36.229601+0000","last_active":"2024-09-19T15:29:48.332414+0000","last_peered":"2024-09-19T15:29:48.332414+0000","last_clean":"2024-09-19T15:29:48.332414+0000","last_became_active":"2024-09-19T13:40:36.220183+0000","last_became_peered":"2024-09-19T13:40:36.220183+0000","last_unstale":"2024-09-19T15:29:48.332414+0000","last_undegraded":"2024-09-19T15:29:48.332414+0000","last_fullsized":"2024-09-19T15:29:48.332414+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:46:00.909462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3052,"num_read_kb":2823,"num_write":743,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'385","reported_seq":1091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.561519+0000","last_change":"2024-09-19T13:40:34.225269+0000","last_active":"2024-09-19T15:31:40.561519+0000","last_peered":"2024-09-19T15:31:40.561519+0000","last_clean":"2024-09-19T15:31:40.561519+0000","last_became_active":"2024-09-19T13:40:34.224813+0000","last_became_peered":"2024-09-19T13:40:34.224813+0000","last_unstale":"2024-09-19T15:31:40.561519+0000","last_undegraded":"2024-09-19T15:31:40.561519+0000","last_fullsized":"2024-09-19T15:31:40.561519+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:19.334744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":831,"num_read_kb":1243,"num_write":1485,"num_write_kb":25860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'139","reported_seq":664,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.886707+0000","last_change":"2024-09-19T13:40:44.242817+0000","last_active":"2024-09-19T15:29:50.886707+0000","last_peered":"2024-09-19T15:29:50.886707+0000","last_clean":"2024-09-19T15:29:50.886707+0000","last_became_active":"2024-09-19T13:40:44.242028+0000","last_became_peered":"2024-09-19T13:40:44.242028+0000","last_unstale":"2024-09-19T15:29:50.886707+0000","last_undegraded":"2024-09-19T15:29:50.886707+0000","last_fullsized":"2024-09-19T15:29:50.886707+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:07.663672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":180,"num_write":320,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'408","reported_seq":1932,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:35.019802+0000","last_change":"2024-09-19T13:40:36.219418+0000","last_active":"2024-09-19T15:28:35.019802+0000","last_peered":"2024-09-19T15:28:35.019802+0000","last_clean":"2024-09-19T15:28:35.019802+0000","last_became_active":"2024-09-19T13:40:36.218091+0000","last_became_peered":"2024-09-19T13:40:36.218091+0000","last_unstale":"2024-09-19T15:28:35.019802+0000","last_undegraded":"2024-09-19T15:28:35.019802+0000","last_fullsized":"2024-09-19T15:28:35.019802+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:59.320209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2211,"num_read_kb":2096,"num_write":485,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"268'348","reported_seq":982,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.567828+0000","last_change":"2024-09-19T13:41:05.387127+0000","last_active":"2024-09-19T15:31:40.567828+0000","last_peered":"2024-09-19T15:31:40.567828+0000","last_clean":"2024-09-19T15:31:40.567828+0000","last_became_active":"2024-09-19T13:41:05.386216+0000","last_became_peered":"2024-09-19T13:41:05.386216+0000","last_unstale":"2024-09-19T15:31:40.567828+0000","last_undegraded":"2024-09-19T15:31:40.567828+0000","last_fullsized":"2024-09-19T15:31:40.567828+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:44:15.979639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":616,"num_read_kb":13820,"num_write":1168,"num_write_kb":52710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:02.604412+0000","last_change":"2024-09-19T13:40:38.223574+0000","last_active":"2024-09-19T15:27:02.604412+0000","last_peered":"2024-09-19T15:27:02.604412+0000","last_clean":"2024-09-19T15:27:02.604412+0000","last_became_active":"2024-09-19T13:40:38.222863+0000","last_became_peered":"2024-09-19T13:40:38.222863+0000","last_unstale":"2024-09-19T15:27:02.604412+0000","last_undegraded":"2024-09-19T15:27:02.604412+0000","last_fullsized":"2024-09-19T15:27:02.604412+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:15:56.276142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'384","reported_seq":1029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.530361+0000","last_change":"2024-09-19T13:40:40.231128+0000","last_active":"2024-09-19T15:31:39.530361+0000","last_peered":"2024-09-19T15:31:39.530361+0000","last_clean":"2024-09-19T15:31:39.530361+0000","last_became_active":"2024-09-19T13:40:40.230368+0000","last_became_peered":"2024-09-19T13:40:40.230368+0000","last_unstale":"2024-09-19T15:31:39.530361+0000","last_undegraded":"2024-09-19T15:31:39.530361+0000","last_fullsized":"2024-09-19T15:31:39.530361+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:13:15.313671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46964,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":623,"num_read_kb":1259,"num_write":490,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:02.624637+0000","last_change":"2024-09-19T13:40:42.240924+0000","last_active":"2024-09-19T15:27:02.624637+0000","last_peered":"2024-09-19T15:27:02.624637+0000","last_clean":"2024-09-19T15:27:02.624637+0000","last_became_active":"2024-09-19T13:40:42.240244+0000","last_became_peered":"2024-09-19T13:40:42.240244+0000","last_unstale":"2024-09-19T15:27:02.624637+0000","last_undegraded":"2024-09-19T15:27:02.624637+0000","last_fullsized":"2024-09-19T15:27:02.624637+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:06.922385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'2486","reported_seq":4344,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:45.480776+0000","last_change":"2024-09-19T13:40:44.263920+0000","last_active":"2024-09-19T15:29:45.480776+0000","last_peered":"2024-09-19T15:29:45.480776+0000","last_clean":"2024-09-19T15:29:45.480776+0000","last_became_active":"2024-09-19T13:40:44.263152+0000","last_became_peered":"2024-09-19T13:40:44.263152+0000","last_unstale":"2024-09-19T15:29:45.480776+0000","last_undegraded":"2024-09-19T15:29:45.480776+0000","last_fullsized":"2024-09-19T15:29:45.480776+0000","mapping_epoch":35,"log_start":"268'2400","ondisk_log_start":"268'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":2400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:49:06.263897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6208,"num_read_kb":6212,"num_write":5020,"num_write_kb":1848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'368","reported_seq":1865,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:35.016803+0000","last_change":"2024-09-19T13:40:36.242921+0000","last_active":"2024-09-19T15:28:35.016803+0000","last_peered":"2024-09-19T15:28:35.016803+0000","last_clean":"2024-09-19T15:28:35.016803+0000","last_became_active":"2024-09-19T13:40:36.242260+0000","last_became_peered":"2024-09-19T13:40:36.242260+0000","last_unstale":"2024-09-19T15:28:35.016803+0000","last_undegraded":"2024-09-19T15:28:35.016803+0000","last_fullsized":"2024-09-19T15:28:35.016803+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:56.906330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2141,"num_read_kb":2035,"num_write":405,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'304","reported_seq":958,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.589796+0000","last_change":"2024-09-19T13:40:34.255205+0000","last_active":"2024-09-19T15:31:40.589796+0000","last_peered":"2024-09-19T15:31:40.589796+0000","last_clean":"2024-09-19T15:31:40.589796+0000","last_became_active":"2024-09-19T13:40:34.254811+0000","last_became_peered":"2024-09-19T13:40:34.254811+0000","last_unstale":"2024-09-19T15:31:40.589796+0000","last_undegraded":"2024-09-19T15:31:40.589796+0000","last_fullsized":"2024-09-19T15:31:40.589796+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:45.032111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":583,"num_read_kb":3104,"num_write":1034,"num_write_kb":15827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:13.233018+0000","last_change":"2024-09-19T13:40:38.234491+0000","last_active":"2024-09-19T15:28:13.233018+0000","last_peered":"2024-09-19T15:28:13.233018+0000","last_clean":"2024-09-19T15:28:13.233018+0000","last_became_active":"2024-09-19T13:40:38.233854+0000","last_became_peered":"2024-09-19T13:40:38.233854+0000","last_unstale":"2024-09-19T15:28:13.233018+0000","last_undegraded":"2024-09-19T15:28:13.233018+0000","last_fullsized":"2024-09-19T15:28:13.233018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:58.032011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'125","reported_seq":693,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.055494+0000","last_change":"2024-09-19T13:40:40.245668+0000","last_active":"2024-09-19T15:31:18.055494+0000","last_peered":"2024-09-19T15:31:18.055494+0000","last_clean":"2024-09-19T15:31:18.055494+0000","last_became_active":"2024-09-19T13:40:40.244841+0000","last_became_peered":"2024-09-19T13:40:40.244841+0000","last_unstale":"2024-09-19T15:31:18.055494+0000","last_undegraded":"2024-09-19T15:31:18.055494+0000","last_fullsized":"2024-09-19T15:31:18.055494+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:42.542622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":152,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:02.585177+0000","last_change":"2024-09-19T13:40:42.235946+0000","last_active":"2024-09-19T15:27:02.585177+0000","last_peered":"2024-09-19T15:27:02.585177+0000","last_clean":"2024-09-19T15:27:02.585177+0000","last_became_active":"2024-09-19T13:40:42.235151+0000","last_became_peered":"2024-09-19T13:40:42.235151+0000","last_unstale":"2024-09-19T15:27:02.585177+0000","last_undegraded":"2024-09-19T15:27:02.585177+0000","last_fullsized":"2024-09-19T15:27:02.585177+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:38.338083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'95","reported_seq":615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:17.181187+0000","last_change":"2024-09-19T13:40:44.263112+0000","last_active":"2024-09-19T15:28:17.181187+0000","last_peered":"2024-09-19T15:28:17.181187+0000","last_clean":"2024-09-19T15:28:17.181187+0000","last_became_active":"2024-09-19T13:40:44.262343+0000","last_became_peered":"2024-09-19T13:40:44.262343+0000","last_unstale":"2024-09-19T15:28:17.181187+0000","last_undegraded":"2024-09-19T15:28:17.181187+0000","last_fullsized":"2024-09-19T15:28:17.181187+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:52.097942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":127,"num_write":220,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'737","reported_seq":2237,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:49.328720+0000","last_change":"2024-09-19T13:40:36.225854+0000","last_active":"2024-09-19T15:28:49.328720+0000","last_peered":"2024-09-19T15:28:49.328720+0000","last_clean":"2024-09-19T15:28:49.328720+0000","last_became_active":"2024-09-19T13:40:36.225170+0000","last_became_peered":"2024-09-19T13:40:36.225170+0000","last_unstale":"2024-09-19T15:28:49.328720+0000","last_undegraded":"2024-09-19T15:28:49.328720+0000","last_fullsized":"2024-09-19T15:28:49.328720+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:12:27.103294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3445,"num_read_kb":3119,"num_write":970,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'275","reported_seq":906,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.637993+0000","last_change":"2024-09-19T13:40:34.274237+0000","last_active":"2024-09-19T15:27:57.637993+0000","last_peered":"2024-09-19T15:27:57.637993+0000","last_clean":"2024-09-19T15:27:57.637993+0000","last_became_active":"2024-09-19T13:40:34.273656+0000","last_became_peered":"2024-09-19T13:40:34.273656+0000","last_unstale":"2024-09-19T15:27:57.637993+0000","last_undegraded":"2024-09-19T15:27:57.637993+0000","last_fullsized":"2024-09-19T15:27:57.637993+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:26.259004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6859781,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":441,"num_read_kb":12420,"num_write":964,"num_write_kb":39158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:03.216447+0000","last_change":"2024-09-19T13:40:38.220743+0000","last_active":"2024-09-19T15:27:03.216447+0000","last_peered":"2024-09-19T15:27:03.216447+0000","last_clean":"2024-09-19T15:27:03.216447+0000","last_became_active":"2024-09-19T13:40:38.220474+0000","last_became_peered":"2024-09-19T13:40:38.220474+0000","last_unstale":"2024-09-19T15:27:03.216447+0000","last_undegraded":"2024-09-19T15:27:03.216447+0000","last_fullsized":"2024-09-19T15:27:03.216447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:08.656145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'187","reported_seq":780,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.159010+0000","last_change":"2024-09-19T13:40:40.248851+0000","last_active":"2024-09-19T15:31:18.159010+0000","last_peered":"2024-09-19T15:31:18.159010+0000","last_clean":"2024-09-19T15:31:18.159010+0000","last_became_active":"2024-09-19T13:40:40.247893+0000","last_became_peered":"2024-09-19T13:40:40.247893+0000","last_unstale":"2024-09-19T15:31:18.159010+0000","last_undegraded":"2024-09-19T15:31:18.159010+0000","last_fullsized":"2024-09-19T15:31:18.159010+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:37:12.351165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":225,"num_write":160,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'758","reported_seq":3177,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:16.995115+0000","last_change":"2024-09-19T13:40:42.239953+0000","last_active":"2024-09-19T15:31:16.995115+0000","last_peered":"2024-09-19T15:31:16.995115+0000","last_clean":"2024-09-19T15:31:16.995115+0000","last_became_active":"2024-09-19T13:40:42.239059+0000","last_became_peered":"2024-09-19T13:40:42.239059+0000","last_unstale":"2024-09-19T15:31:16.995115+0000","last_undegraded":"2024-09-19T15:31:16.995115+0000","last_fullsized":"2024-09-19T15:31:16.995115+0000","mapping_epoch":33,"log_start":"268'701","ondisk_log_start":"268'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":701,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:40.662697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'225","reported_seq":1068,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:51.070933+0000","last_change":"2024-09-19T13:40:44.278447+0000","last_active":"2024-09-19T15:29:51.070933+0000","last_peered":"2024-09-19T15:29:51.070933+0000","last_clean":"2024-09-19T15:29:51.070933+0000","last_became_active":"2024-09-19T13:40:44.277966+0000","last_became_peered":"2024-09-19T13:40:44.277966+0000","last_unstale":"2024-09-19T15:29:51.070933+0000","last_undegraded":"2024-09-19T15:29:51.070933+0000","last_fullsized":"2024-09-19T15:29:51.070933+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:46.773156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":650,"num_read_kb":649,"num_write":494,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'747","reported_seq":2159,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:26:58.215034+0000","last_change":"2024-09-19T13:40:36.238808+0000","last_active":"2024-09-19T15:26:58.215034+0000","last_peered":"2024-09-19T15:26:58.215034+0000","last_clean":"2024-09-19T15:26:58.215034+0000","last_became_active":"2024-09-19T13:40:36.238400+0000","last_became_peered":"2024-09-19T13:40:36.238400+0000","last_unstale":"2024-09-19T15:26:58.215034+0000","last_undegraded":"2024-09-19T15:26:58.215034+0000","last_fullsized":"2024-09-19T15:26:58.215034+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:37.752219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3489,"num_read_kb":3124,"num_write":1003,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'393","reported_seq":1075,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.558573+0000","last_change":"2024-09-19T13:40:34.258945+0000","last_active":"2024-09-19T15:31:40.558573+0000","last_peered":"2024-09-19T15:31:40.558573+0000","last_clean":"2024-09-19T15:31:40.558573+0000","last_became_active":"2024-09-19T13:40:34.257596+0000","last_became_peered":"2024-09-19T13:40:34.257596+0000","last_unstale":"2024-09-19T15:31:40.558573+0000","last_undegraded":"2024-09-19T15:31:40.558573+0000","last_fullsized":"2024-09-19T15:31:40.558573+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:10:14.579685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":35384,"num_write":1329,"num_write_kb":23932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:02.604463+0000","last_change":"2024-09-19T13:40:38.212988+0000","last_active":"2024-09-19T15:27:02.604463+0000","last_peered":"2024-09-19T15:27:02.604463+0000","last_clean":"2024-09-19T15:27:02.604463+0000","last_became_active":"2024-09-19T13:40:38.212327+0000","last_became_peered":"2024-09-19T13:40:38.212327+0000","last_unstale":"2024-09-19T15:27:02.604463+0000","last_undegraded":"2024-09-19T15:27:02.604463+0000","last_fullsized":"2024-09-19T15:27:02.604463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:22:45.697525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'309","reported_seq":924,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.172539+0000","last_change":"2024-09-19T13:40:40.226231+0000","last_active":"2024-09-19T15:31:18.172539+0000","last_peered":"2024-09-19T15:31:18.172539+0000","last_clean":"2024-09-19T15:31:18.172539+0000","last_became_active":"2024-09-19T13:40:40.225512+0000","last_became_peered":"2024-09-19T13:40:40.225512+0000","last_unstale":"2024-09-19T15:31:18.172539+0000","last_undegraded":"2024-09-19T15:31:18.172539+0000","last_fullsized":"2024-09-19T15:31:18.172539+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:59:24.943872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54478,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":500,"num_read_kb":991,"num_write":404,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'782","reported_seq":2989,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:16.987151+0000","last_change":"2024-09-19T13:40:42.264377+0000","last_active":"2024-09-19T15:31:16.987151+0000","last_peered":"2024-09-19T15:31:16.987151+0000","last_clean":"2024-09-19T15:31:16.987151+0000","last_became_active":"2024-09-19T13:40:42.263635+0000","last_became_peered":"2024-09-19T13:40:42.263635+0000","last_unstale":"2024-09-19T15:31:16.987151+0000","last_undegraded":"2024-09-19T15:31:16.987151+0000","last_fullsized":"2024-09-19T15:31:16.987151+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:30.524751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'499","reported_seq":2102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.630887+0000","last_change":"2024-09-19T13:40:36.241060+0000","last_active":"2024-09-19T15:28:57.630887+0000","last_peered":"2024-09-19T15:28:57.630887+0000","last_clean":"2024-09-19T15:28:57.630887+0000","last_became_active":"2024-09-19T13:40:36.235739+0000","last_became_peered":"2024-09-19T13:40:36.235739+0000","last_unstale":"2024-09-19T15:28:57.630887+0000","last_undegraded":"2024-09-19T15:28:57.630887+0000","last_fullsized":"2024-09-19T15:28:57.630887+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:36:20.856962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2574,"num_read_kb":2392,"num_write":618,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'308","reported_seq":1023,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.654151+0000","last_change":"2024-09-19T13:41:05.310671+0000","last_active":"2024-09-19T15:29:02.654151+0000","last_peered":"2024-09-19T15:29:02.654151+0000","last_clean":"2024-09-19T15:29:02.654151+0000","last_became_active":"2024-09-19T13:41:05.309594+0000","last_became_peered":"2024-09-19T13:41:05.309594+0000","last_unstale":"2024-09-19T15:29:02.654151+0000","last_undegraded":"2024-09-19T15:29:02.654151+0000","last_fullsized":"2024-09-19T15:29:02.654151+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:17.208658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":329623,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":709,"num_read_kb":65184,"num_write":1123,"num_write_kb":23524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.653933+0000","last_change":"2024-09-19T13:40:38.234609+0000","last_active":"2024-09-19T15:29:02.653933+0000","last_peered":"2024-09-19T15:29:02.653933+0000","last_clean":"2024-09-19T15:29:02.653933+0000","last_became_active":"2024-09-19T13:40:38.233892+0000","last_became_peered":"2024-09-19T13:40:38.233892+0000","last_unstale":"2024-09-19T15:29:02.653933+0000","last_undegraded":"2024-09-19T15:29:02.653933+0000","last_fullsized":"2024-09-19T15:29:02.653933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:30.027284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'453","reported_seq":1155,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.358994+0000","last_change":"2024-09-19T13:40:40.233291+0000","last_active":"2024-09-19T15:31:18.358994+0000","last_peered":"2024-09-19T15:31:18.358994+0000","last_clean":"2024-09-19T15:31:18.358994+0000","last_became_active":"2024-09-19T13:40:40.232582+0000","last_became_peered":"2024-09-19T13:40:40.232582+0000","last_unstale":"2024-09-19T15:31:18.358994+0000","last_undegraded":"2024-09-19T15:31:18.358994+0000","last_fullsized":"2024-09-19T15:31:18.358994+0000","mapping_epoch":31,"log_start":"268'400","ondisk_log_start":"268'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:05.930746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56133,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":727,"num_read_kb":1218,"num_write":554,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.388312+0000","last_change":"2024-09-19T13:40:42.240589+0000","last_active":"2024-09-19T15:28:42.388312+0000","last_peered":"2024-09-19T15:28:42.388312+0000","last_clean":"2024-09-19T15:28:42.388312+0000","last_became_active":"2024-09-19T13:40:42.239961+0000","last_became_peered":"2024-09-19T13:40:42.239961+0000","last_unstale":"2024-09-19T15:28:42.388312+0000","last_undegraded":"2024-09-19T15:28:42.388312+0000","last_fullsized":"2024-09-19T15:28:42.388312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:04.578390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'544","reported_seq":1392,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.257388+0000","last_change":"2024-09-19T13:40:44.264532+0000","last_active":"2024-09-19T15:31:13.257388+0000","last_peered":"2024-09-19T15:31:13.257388+0000","last_clean":"2024-09-19T15:31:13.257388+0000","last_became_active":"2024-09-19T13:40:44.263313+0000","last_became_peered":"2024-09-19T13:40:44.263313+0000","last_unstale":"2024-09-19T15:31:13.257388+0000","last_undegraded":"2024-09-19T15:31:13.257388+0000","last_fullsized":"2024-09-19T15:31:13.257388+0000","mapping_epoch":35,"log_start":"268'500","ondisk_log_start":"268'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:17.459491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1297,"num_read_kb":1297,"num_write":1122,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'466","reported_seq":2113,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.656141+0000","last_change":"2024-09-19T13:40:36.219545+0000","last_active":"2024-09-19T15:29:50.656141+0000","last_peered":"2024-09-19T15:29:50.656141+0000","last_clean":"2024-09-19T15:29:50.656141+0000","last_became_active":"2024-09-19T13:40:36.218822+0000","last_became_peered":"2024-09-19T13:40:36.218822+0000","last_unstale":"2024-09-19T15:29:50.656141+0000","last_undegraded":"2024-09-19T15:29:50.656141+0000","last_fullsized":"2024-09-19T15:29:50.656141+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:28.807691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2519,"num_read_kb":2376,"num_write":558,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'257","reported_seq":910,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.648062+0000","last_change":"2024-09-19T13:40:34.279254+0000","last_active":"2024-09-19T15:28:37.648062+0000","last_peered":"2024-09-19T15:28:37.648062+0000","last_clean":"2024-09-19T15:28:37.648062+0000","last_became_active":"2024-09-19T13:40:34.278684+0000","last_became_peered":"2024-09-19T13:40:34.278684+0000","last_unstale":"2024-09-19T15:28:37.648062+0000","last_undegraded":"2024-09-19T15:28:37.648062+0000","last_fullsized":"2024-09-19T15:28:37.648062+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:10.126915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31819,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":476,"num_read_kb":16871,"num_write":931,"num_write_kb":22319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.557575+0000","last_change":"2024-09-19T13:40:38.229050+0000","last_active":"2024-09-19T15:29:02.557575+0000","last_peered":"2024-09-19T15:29:02.557575+0000","last_clean":"2024-09-19T15:29:02.557575+0000","last_became_active":"2024-09-19T13:40:38.228765+0000","last_became_peered":"2024-09-19T13:40:38.228765+0000","last_unstale":"2024-09-19T15:29:02.557575+0000","last_undegraded":"2024-09-19T15:29:02.557575+0000","last_fullsized":"2024-09-19T15:29:02.557575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:11.148186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'309","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.120871+0000","last_change":"2024-09-19T13:40:40.228045+0000","last_active":"2024-09-19T15:31:18.120871+0000","last_peered":"2024-09-19T15:31:18.120871+0000","last_clean":"2024-09-19T15:31:18.120871+0000","last_became_active":"2024-09-19T13:40:40.226899+0000","last_became_peered":"2024-09-19T13:40:40.226899+0000","last_unstale":"2024-09-19T15:31:18.120871+0000","last_undegraded":"2024-09-19T15:31:18.120871+0000","last_fullsized":"2024-09-19T15:31:18.120871+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:59.398796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54712,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":512,"num_read_kb":1018,"num_write":414,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:13.246852+0000","last_change":"2024-09-19T13:40:42.250224+0000","last_active":"2024-09-19T15:29:13.246852+0000","last_peered":"2024-09-19T15:29:13.246852+0000","last_clean":"2024-09-19T15:29:13.246852+0000","last_became_active":"2024-09-19T13:40:42.245030+0000","last_became_peered":"2024-09-19T13:40:42.245030+0000","last_unstale":"2024-09-19T15:29:13.246852+0000","last_undegraded":"2024-09-19T15:29:13.246852+0000","last_fullsized":"2024-09-19T15:29:13.246852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:07:01.322432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'125","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:00.457822+0000","last_change":"2024-09-19T13:40:44.254756+0000","last_active":"2024-09-19T15:31:00.457822+0000","last_peered":"2024-09-19T15:31:00.457822+0000","last_clean":"2024-09-19T15:31:00.457822+0000","last_became_active":"2024-09-19T13:40:44.254015+0000","last_became_peered":"2024-09-19T13:40:44.254015+0000","last_unstale":"2024-09-19T15:31:00.457822+0000","last_undegraded":"2024-09-19T15:31:00.457822+0000","last_fullsized":"2024-09-19T15:31:00.457822+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:31:55.327099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":134,"num_write":317,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'412","reported_seq":1974,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.381038+0000","last_change":"2024-09-19T13:42:05.614112+0000","last_active":"2024-09-19T15:29:48.381038+0000","last_peered":"2024-09-19T15:29:48.381038+0000","last_clean":"2024-09-19T15:29:48.381038+0000","last_became_active":"2024-09-19T13:42:05.613410+0000","last_became_peered":"2024-09-19T13:42:05.613410+0000","last_unstale":"2024-09-19T15:29:48.381038+0000","last_undegraded":"2024-09-19T15:29:48.381038+0000","last_fullsized":"2024-09-19T15:29:48.381038+0000","mapping_epoch":40,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:38:56.362442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2294,"num_read_kb":2176,"num_write":469,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'301","reported_seq":1017,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:11.104149+0000","last_change":"2024-09-19T13:40:34.268729+0000","last_active":"2024-09-19T15:31:11.104149+0000","last_peered":"2024-09-19T15:31:11.104149+0000","last_clean":"2024-09-19T15:31:11.104149+0000","last_became_active":"2024-09-19T13:40:34.268005+0000","last_became_peered":"2024-09-19T13:40:34.268005+0000","last_unstale":"2024-09-19T15:31:11.104149+0000","last_undegraded":"2024-09-19T15:31:11.104149+0000","last_fullsized":"2024-09-19T15:31:11.104149+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:39.540040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2146130,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":705,"num_read_kb":24616,"num_write":1210,"num_write_kb":39661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.553914+0000","last_change":"2024-09-19T13:40:38.232016+0000","last_active":"2024-09-19T15:28:42.553914+0000","last_peered":"2024-09-19T15:28:42.553914+0000","last_clean":"2024-09-19T15:28:42.553914+0000","last_became_active":"2024-09-19T13:40:38.231698+0000","last_became_peered":"2024-09-19T13:40:38.231698+0000","last_unstale":"2024-09-19T15:28:42.553914+0000","last_undegraded":"2024-09-19T15:28:42.553914+0000","last_fullsized":"2024-09-19T15:28:42.553914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:45.837641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'388","reported_seq":1045,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.964587+0000","last_change":"2024-09-19T13:40:40.219381+0000","last_active":"2024-09-19T15:31:17.964587+0000","last_peered":"2024-09-19T15:31:17.964587+0000","last_clean":"2024-09-19T15:31:17.964587+0000","last_became_active":"2024-09-19T13:40:40.218529+0000","last_became_peered":"2024-09-19T13:40:40.218529+0000","last_unstale":"2024-09-19T15:31:17.964587+0000","last_undegraded":"2024-09-19T15:31:17.964587+0000","last_fullsized":"2024-09-19T15:31:17.964587+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:35.038776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55706,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":602,"num_read_kb":1059,"num_write":472,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'802","reported_seq":3180,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.127458+0000","last_change":"2024-09-19T13:40:42.238099+0000","last_active":"2024-09-19T15:31:40.127458+0000","last_peered":"2024-09-19T15:31:40.127458+0000","last_clean":"2024-09-19T15:31:40.127458+0000","last_became_active":"2024-09-19T13:40:42.237168+0000","last_became_peered":"2024-09-19T13:40:42.237168+0000","last_unstale":"2024-09-19T15:31:40.127458+0000","last_undegraded":"2024-09-19T15:31:40.127458+0000","last_fullsized":"2024-09-19T15:31:40.127458+0000","mapping_epoch":33,"log_start":"268'701","ondisk_log_start":"268'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":701,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:55.917452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'185","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.287972+0000","last_change":"2024-09-19T13:40:44.262160+0000","last_active":"2024-09-19T15:31:12.287972+0000","last_peered":"2024-09-19T15:31:12.287972+0000","last_clean":"2024-09-19T15:31:12.287972+0000","last_became_active":"2024-09-19T13:40:44.259964+0000","last_became_peered":"2024-09-19T13:40:44.259964+0000","last_unstale":"2024-09-19T15:31:12.287972+0000","last_undegraded":"2024-09-19T15:31:12.287972+0000","last_fullsized":"2024-09-19T15:31:12.287972+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:49.811154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":275,"num_read_kb":244,"num_write":336,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'515","reported_seq":2206,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.656869+0000","last_change":"2024-09-19T13:40:36.221790+0000","last_active":"2024-09-19T15:29:50.656869+0000","last_peered":"2024-09-19T15:29:50.656869+0000","last_clean":"2024-09-19T15:29:50.656869+0000","last_became_active":"2024-09-19T13:40:36.221248+0000","last_became_peered":"2024-09-19T13:40:36.221248+0000","last_unstale":"2024-09-19T15:29:50.656869+0000","last_undegraded":"2024-09-19T15:29:50.656869+0000","last_fullsized":"2024-09-19T15:29:50.656869+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:23.331064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2802,"num_read_kb":2611,"num_write":645,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'240","reported_seq":886,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.626335+0000","last_change":"2024-09-19T13:40:34.260828+0000","last_active":"2024-09-19T15:28:37.626335+0000","last_peered":"2024-09-19T15:28:37.626335+0000","last_clean":"2024-09-19T15:28:37.626335+0000","last_became_active":"2024-09-19T13:40:34.259994+0000","last_became_peered":"2024-09-19T13:40:34.259994+0000","last_unstale":"2024-09-19T15:28:37.626335+0000","last_undegraded":"2024-09-19T15:28:37.626335+0000","last_fullsized":"2024-09-19T15:28:37.626335+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:04.707136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1312319,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":460,"num_read_kb":7460,"num_write":922,"num_write_kb":22776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:22.561854+0000","last_change":"2024-09-19T13:40:38.245831+0000","last_active":"2024-09-19T15:29:22.561854+0000","last_peered":"2024-09-19T15:29:22.561854+0000","last_clean":"2024-09-19T15:29:22.561854+0000","last_became_active":"2024-09-19T13:40:38.245245+0000","last_became_peered":"2024-09-19T13:40:38.245245+0000","last_unstale":"2024-09-19T15:29:22.561854+0000","last_undegraded":"2024-09-19T15:29:22.561854+0000","last_fullsized":"2024-09-19T15:29:22.561854+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:31:40.598604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'514","reported_seq":1193,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.066494+0000","last_change":"2024-09-19T13:40:40.231208+0000","last_active":"2024-09-19T15:31:40.066494+0000","last_peered":"2024-09-19T15:31:40.066494+0000","last_clean":"2024-09-19T15:31:40.066494+0000","last_became_active":"2024-09-19T13:40:40.230404+0000","last_became_peered":"2024-09-19T13:40:40.230404+0000","last_unstale":"2024-09-19T15:31:40.066494+0000","last_undegraded":"2024-09-19T15:31:40.066494+0000","last_fullsized":"2024-09-19T15:31:40.066494+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:12:10.298800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93154,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":887,"num_read_kb":2046,"num_write":714,"num_write_kb":570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.557534+0000","last_change":"2024-09-19T13:40:42.250031+0000","last_active":"2024-09-19T15:29:02.557534+0000","last_peered":"2024-09-19T15:29:02.557534+0000","last_clean":"2024-09-19T15:29:02.557534+0000","last_became_active":"2024-09-19T13:40:42.248721+0000","last_became_peered":"2024-09-19T13:40:42.248721+0000","last_unstale":"2024-09-19T15:29:02.557534+0000","last_undegraded":"2024-09-19T15:29:02.557534+0000","last_fullsized":"2024-09-19T15:29:02.557534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:31.801182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'162","reported_seq":711,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:46.507086+0000","last_change":"2024-09-19T13:40:44.256561+0000","last_active":"2024-09-19T15:29:46.507086+0000","last_peered":"2024-09-19T15:29:46.507086+0000","last_clean":"2024-09-19T15:29:46.507086+0000","last_became_active":"2024-09-19T13:40:44.255644+0000","last_became_peered":"2024-09-19T13:40:44.255644+0000","last_unstale":"2024-09-19T15:29:46.507086+0000","last_undegraded":"2024-09-19T15:29:46.507086+0000","last_fullsized":"2024-09-19T15:29:46.507086+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:41.469474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":234,"num_write":369,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'795","reported_seq":2371,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.393505+0000","last_change":"2024-09-19T13:40:36.235347+0000","last_active":"2024-09-19T15:29:48.393505+0000","last_peered":"2024-09-19T15:29:48.393505+0000","last_clean":"2024-09-19T15:29:48.393505+0000","last_became_active":"2024-09-19T13:40:36.231071+0000","last_became_peered":"2024-09-19T13:40:36.231071+0000","last_unstale":"2024-09-19T15:29:48.393505+0000","last_undegraded":"2024-09-19T15:29:48.393505+0000","last_fullsized":"2024-09-19T15:29:48.393505+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:57.506822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3782,"num_read_kb":3405,"num_write":1031,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'280","reported_seq":936,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:38.640172+0000","last_change":"2024-09-19T13:40:34.230219+0000","last_active":"2024-09-19T15:28:38.640172+0000","last_peered":"2024-09-19T15:28:38.640172+0000","last_clean":"2024-09-19T15:28:38.640172+0000","last_became_active":"2024-09-19T13:40:34.229859+0000","last_became_peered":"2024-09-19T13:40:34.229859+0000","last_unstale":"2024-09-19T15:28:38.640172+0000","last_undegraded":"2024-09-19T15:28:38.640172+0000","last_fullsized":"2024-09-19T15:28:38.640172+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:22:23.963676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2160673,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":517,"num_read_kb":8832,"num_write":963,"num_write_kb":25070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.553962+0000","last_change":"2024-09-19T13:40:38.233850+0000","last_active":"2024-09-19T15:28:42.553962+0000","last_peered":"2024-09-19T15:28:42.553962+0000","last_clean":"2024-09-19T15:28:42.553962+0000","last_became_active":"2024-09-19T13:40:38.233312+0000","last_became_peered":"2024-09-19T13:40:38.233312+0000","last_unstale":"2024-09-19T15:28:42.553962+0000","last_undegraded":"2024-09-19T15:28:42.553962+0000","last_fullsized":"2024-09-19T15:28:42.553962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:06:31.511312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'324","reported_seq":949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.236829+0000","last_change":"2024-09-19T13:40:40.248769+0000","last_active":"2024-09-19T15:31:18.236829+0000","last_peered":"2024-09-19T15:31:18.236829+0000","last_clean":"2024-09-19T15:31:18.236829+0000","last_became_active":"2024-09-19T13:40:40.247025+0000","last_became_peered":"2024-09-19T13:40:40.247025+0000","last_unstale":"2024-09-19T15:31:18.236829+0000","last_undegraded":"2024-09-19T15:31:18.236829+0000","last_fullsized":"2024-09-19T15:31:18.236829+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:56.478380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50870,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":544,"num_read_kb":997,"num_write":470,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:17.195848+0000","last_change":"2024-09-19T13:40:42.244143+0000","last_active":"2024-09-19T15:29:17.195848+0000","last_peered":"2024-09-19T15:29:17.195848+0000","last_clean":"2024-09-19T15:29:17.195848+0000","last_became_active":"2024-09-19T13:40:42.243325+0000","last_became_peered":"2024-09-19T13:40:42.243325+0000","last_unstale":"2024-09-19T15:29:17.195848+0000","last_undegraded":"2024-09-19T15:29:17.195848+0000","last_fullsized":"2024-09-19T15:29:17.195848+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:23.365075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'144","reported_seq":676,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:00.462703+0000","last_change":"2024-09-19T13:40:44.268565+0000","last_active":"2024-09-19T15:31:00.462703+0000","last_peered":"2024-09-19T15:31:00.462703+0000","last_clean":"2024-09-19T15:31:00.462703+0000","last_became_active":"2024-09-19T13:40:44.267716+0000","last_became_peered":"2024-09-19T13:40:44.267716+0000","last_unstale":"2024-09-19T15:31:00.462703+0000","last_undegraded":"2024-09-19T15:31:00.462703+0000","last_fullsized":"2024-09-19T15:31:00.462703+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:15.203052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":190,"num_read_kb":181,"num_write":368,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'1168","reported_seq":2989,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.606972+0000","last_change":"2024-09-19T13:40:36.217087+0000","last_active":"2024-09-19T15:28:37.606972+0000","last_peered":"2024-09-19T15:28:37.606972+0000","last_clean":"2024-09-19T15:28:37.606972+0000","last_became_active":"2024-09-19T13:40:36.216332+0000","last_became_peered":"2024-09-19T13:40:36.216332+0000","last_unstale":"2024-09-19T15:28:37.606972+0000","last_undegraded":"2024-09-19T15:28:37.606972+0000","last_fullsized":"2024-09-19T15:28:37.606972+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":1100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:37.143369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5686,"num_read_kb":5084,"num_write":1563,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'376","reported_seq":1046,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.601569+0000","last_change":"2024-09-19T13:41:05.315224+0000","last_active":"2024-09-19T15:31:40.601569+0000","last_peered":"2024-09-19T15:31:40.601569+0000","last_clean":"2024-09-19T15:31:40.601569+0000","last_became_active":"2024-09-19T13:41:05.314782+0000","last_became_peered":"2024-09-19T13:41:05.314782+0000","last_unstale":"2024-09-19T15:31:40.601569+0000","last_undegraded":"2024-09-19T15:31:40.601569+0000","last_fullsized":"2024-09-19T15:31:40.601569+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:05:31.081233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":644,"num_read_kb":47078,"num_write":1156,"num_write_kb":40849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.388400+0000","last_change":"2024-09-19T13:40:38.247209+0000","last_active":"2024-09-19T15:28:42.388400+0000","last_peered":"2024-09-19T15:28:42.388400+0000","last_clean":"2024-09-19T15:28:42.388400+0000","last_became_active":"2024-09-19T13:40:38.246684+0000","last_became_peered":"2024-09-19T13:40:38.246684+0000","last_unstale":"2024-09-19T15:28:42.388400+0000","last_undegraded":"2024-09-19T15:28:42.388400+0000","last_fullsized":"2024-09-19T15:28:42.388400+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:06.464294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'386","reported_seq":1039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.432406+0000","last_change":"2024-09-19T13:40:40.222514+0000","last_active":"2024-09-19T15:31:40.432406+0000","last_peered":"2024-09-19T15:31:40.432406+0000","last_clean":"2024-09-19T15:31:40.432406+0000","last_became_active":"2024-09-19T13:40:40.221766+0000","last_became_peered":"2024-09-19T13:40:40.221766+0000","last_unstale":"2024-09-19T15:31:40.432406+0000","last_undegraded":"2024-09-19T15:31:40.432406+0000","last_fullsized":"2024-09-19T15:31:40.432406+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:00.029066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44832,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":632,"num_read_kb":1260,"num_write":492,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'744","reported_seq":3076,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.027114+0000","last_change":"2024-09-19T13:40:42.246641+0000","last_active":"2024-09-19T15:31:40.027114+0000","last_peered":"2024-09-19T15:31:40.027114+0000","last_clean":"2024-09-19T15:31:40.027114+0000","last_became_active":"2024-09-19T13:40:42.246030+0000","last_became_peered":"2024-09-19T13:40:42.246030+0000","last_unstale":"2024-09-19T15:31:40.027114+0000","last_undegraded":"2024-09-19T15:31:40.027114+0000","last_fullsized":"2024-09-19T15:31:40.027114+0000","mapping_epoch":33,"log_start":"268'702","ondisk_log_start":"268'702","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":702,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:14.301444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'123","reported_seq":645,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:45.486708+0000","last_change":"2024-09-19T13:40:44.250279+0000","last_active":"2024-09-19T15:29:45.486708+0000","last_peered":"2024-09-19T15:29:45.486708+0000","last_clean":"2024-09-19T15:29:45.486708+0000","last_became_active":"2024-09-19T13:40:44.249529+0000","last_became_peered":"2024-09-19T13:40:44.249529+0000","last_unstale":"2024-09-19T15:29:45.486708+0000","last_undegraded":"2024-09-19T15:29:45.486708+0000","last_fullsized":"2024-09-19T15:29:45.486708+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:10.551071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1650,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":290,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'1316","reported_seq":3126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.313578+0000","last_change":"2024-09-19T13:40:36.219605+0000","last_active":"2024-09-19T15:29:41.313578+0000","last_peered":"2024-09-19T15:29:41.313578+0000","last_clean":"2024-09-19T15:29:41.313578+0000","last_became_active":"2024-09-19T13:40:36.218760+0000","last_became_peered":"2024-09-19T13:40:36.218760+0000","last_unstale":"2024-09-19T15:29:41.313578+0000","last_undegraded":"2024-09-19T15:29:41.313578+0000","last_fullsized":"2024-09-19T15:29:41.313578+0000","mapping_epoch":27,"log_start":"268'1300","ondisk_log_start":"268'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":1300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:53:31.922716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6184,"num_read_kb":5469,"num_write":1814,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'333","reported_seq":1042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.611459+0000","last_change":"2024-09-19T13:40:34.266782+0000","last_active":"2024-09-19T15:28:57.611459+0000","last_peered":"2024-09-19T15:28:57.611459+0000","last_clean":"2024-09-19T15:28:57.611459+0000","last_became_active":"2024-09-19T13:40:34.264354+0000","last_became_peered":"2024-09-19T13:40:34.264354+0000","last_unstale":"2024-09-19T15:28:57.611459+0000","last_undegraded":"2024-09-19T15:28:57.611459+0000","last_fullsized":"2024-09-19T15:28:57.611459+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:30.107330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":546702,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":676,"num_read_kb":5535,"num_write":1229,"num_write_kb":30004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1481,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.156035+0000","last_change":"2024-09-19T13:40:38.226450+0000","last_active":"2024-09-19T15:31:13.156035+0000","last_peered":"2024-09-19T15:31:13.156035+0000","last_clean":"2024-09-19T15:31:13.156035+0000","last_became_active":"2024-09-19T13:40:38.225663+0000","last_became_peered":"2024-09-19T13:40:38.225663+0000","last_unstale":"2024-09-19T15:31:13.156035+0000","last_undegraded":"2024-09-19T15:31:13.156035+0000","last_fullsized":"2024-09-19T15:31:13.156035+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:47:48.193799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":944,"num_read_kb":944,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'147","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.976337+0000","last_change":"2024-09-19T13:40:40.220948+0000","last_active":"2024-09-19T15:31:17.976337+0000","last_peered":"2024-09-19T15:31:17.976337+0000","last_clean":"2024-09-19T15:31:17.976337+0000","last_became_active":"2024-09-19T13:40:40.220534+0000","last_became_peered":"2024-09-19T13:40:40.220534+0000","last_unstale":"2024-09-19T15:31:17.976337+0000","last_undegraded":"2024-09-19T15:31:17.976337+0000","last_fullsized":"2024-09-19T15:31:17.976337+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:55.268748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":176,"num_write":122,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'765","reported_seq":5681,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.166147+0000","last_change":"2024-09-19T13:40:42.249926+0000","last_active":"2024-09-19T15:31:38.166147+0000","last_peered":"2024-09-19T15:31:38.166147+0000","last_clean":"2024-09-19T15:31:38.166147+0000","last_became_active":"2024-09-19T13:40:42.240074+0000","last_became_peered":"2024-09-19T13:40:42.240074+0000","last_unstale":"2024-09-19T15:31:38.166147+0000","last_undegraded":"2024-09-19T15:31:38.166147+0000","last_fullsized":"2024-09-19T15:31:38.166147+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:40:31.249282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'114","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:07.614003+0000","last_change":"2024-09-19T13:40:44.252306+0000","last_active":"2024-09-19T15:29:07.614003+0000","last_peered":"2024-09-19T15:29:07.614003+0000","last_clean":"2024-09-19T15:29:07.614003+0000","last_became_active":"2024-09-19T13:40:44.251353+0000","last_became_peered":"2024-09-19T13:40:44.251353+0000","last_unstale":"2024-09-19T15:29:07.614003+0000","last_undegraded":"2024-09-19T15:29:07.614003+0000","last_fullsized":"2024-09-19T15:29:07.614003+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:54.088845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'1842","reported_seq":3612,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.383231+0000","last_change":"2024-09-19T13:40:36.221951+0000","last_active":"2024-09-19T15:29:48.383231+0000","last_peered":"2024-09-19T15:29:48.383231+0000","last_clean":"2024-09-19T15:29:48.383231+0000","last_became_active":"2024-09-19T13:40:36.221638+0000","last_became_peered":"2024-09-19T13:40:36.221638+0000","last_unstale":"2024-09-19T15:29:48.383231+0000","last_undegraded":"2024-09-19T15:29:48.383231+0000","last_fullsized":"2024-09-19T15:29:48.383231+0000","mapping_epoch":27,"log_start":"268'1800","ondisk_log_start":"268'1800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":1800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:09:05.373765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8811,"num_read_kb":7740,"num_write":2693,"num_write_kb":1220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"268'296","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:58.243167+0000","last_change":"2024-09-19T13:40:34.236641+0000","last_active":"2024-09-19T15:28:58.243167+0000","last_peered":"2024-09-19T15:28:58.243167+0000","last_clean":"2024-09-19T15:28:58.243167+0000","last_became_active":"2024-09-19T13:40:34.236257+0000","last_became_peered":"2024-09-19T13:40:34.236257+0000","last_unstale":"2024-09-19T15:28:58.243167+0000","last_undegraded":"2024-09-19T15:28:58.243167+0000","last_fullsized":"2024-09-19T15:28:58.243167+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:57.681584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7567963,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":603,"num_read_kb":21601,"num_write":1159,"num_write_kb":27464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.608313+0000","last_change":"2024-09-19T13:40:38.236430+0000","last_active":"2024-09-19T15:28:42.608313+0000","last_peered":"2024-09-19T15:28:42.608313+0000","last_clean":"2024-09-19T15:28:42.608313+0000","last_became_active":"2024-09-19T13:40:38.235737+0000","last_became_peered":"2024-09-19T13:40:38.235737+0000","last_unstale":"2024-09-19T15:28:42.608313+0000","last_undegraded":"2024-09-19T15:28:42.608313+0000","last_fullsized":"2024-09-19T15:28:42.608313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:01.868972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'544","reported_seq":1232,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.223974+0000","last_change":"2024-09-19T13:40:40.236361+0000","last_active":"2024-09-19T15:31:18.223974+0000","last_peered":"2024-09-19T15:31:18.223974+0000","last_clean":"2024-09-19T15:31:18.223974+0000","last_became_active":"2024-09-19T13:40:40.235679+0000","last_became_peered":"2024-09-19T13:40:40.235679+0000","last_unstale":"2024-09-19T15:31:18.223974+0000","last_undegraded":"2024-09-19T15:31:18.223974+0000","last_fullsized":"2024-09-19T15:31:18.223974+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:05.212537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57782,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1475,"num_read_kb":1962,"num_write":2108,"num_write_kb":1881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.390727+0000","last_change":"2024-09-19T13:40:42.252473+0000","last_active":"2024-09-19T15:28:42.390727+0000","last_peered":"2024-09-19T15:28:42.390727+0000","last_clean":"2024-09-19T15:28:42.390727+0000","last_became_active":"2024-09-19T13:40:42.250462+0000","last_became_peered":"2024-09-19T13:40:42.250462+0000","last_unstale":"2024-09-19T15:28:42.390727+0000","last_undegraded":"2024-09-19T15:28:42.390727+0000","last_fullsized":"2024-09-19T15:28:42.390727+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:28:26.494633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'145","reported_seq":676,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:07.394194+0000","last_change":"2024-09-19T13:40:44.267433+0000","last_active":"2024-09-19T15:29:07.394194+0000","last_peered":"2024-09-19T15:29:07.394194+0000","last_clean":"2024-09-19T15:29:07.394194+0000","last_became_active":"2024-09-19T13:40:44.266642+0000","last_became_peered":"2024-09-19T13:40:44.266642+0000","last_unstale":"2024-09-19T15:29:07.394194+0000","last_undegraded":"2024-09-19T15:29:07.394194+0000","last_fullsized":"2024-09-19T15:29:07.394194+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:58.071145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":208,"num_write":352,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'499","reported_seq":2070,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:27.401142+0000","last_change":"2024-09-19T13:40:36.219246+0000","last_active":"2024-09-19T15:29:27.401142+0000","last_peered":"2024-09-19T15:29:27.401142+0000","last_clean":"2024-09-19T15:29:27.401142+0000","last_became_active":"2024-09-19T13:40:36.218550+0000","last_became_peered":"2024-09-19T13:40:36.218550+0000","last_unstale":"2024-09-19T15:29:27.401142+0000","last_undegraded":"2024-09-19T15:29:27.401142+0000","last_fullsized":"2024-09-19T15:29:27.401142+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:10.154764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2652,"num_read_kb":2446,"num_write":622,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":653,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.648997+0000","last_change":"2024-09-19T13:40:13.616691+0000","last_active":"2024-09-19T15:28:42.648997+0000","last_peered":"2024-09-19T15:28:42.648997+0000","last_clean":"2024-09-19T15:28:42.648997+0000","last_became_active":"2024-09-19T13:40:13.615965+0000","last_became_peered":"2024-09-19T13:40:13.615965+0000","last_unstale":"2024-09-19T15:28:42.648997+0000","last_undegraded":"2024-09-19T15:28:42.648997+0000","last_fullsized":"2024-09-19T15:28:42.648997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:12.602317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:12.602317+0000","last_clean_scrub_stamp":"2024-09-19T13:40:12.602317+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:03.931360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":566,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.627501+0000","last_change":"2024-09-19T13:40:22.120433+0000","last_active":"2024-09-19T15:28:42.627501+0000","last_peered":"2024-09-19T15:28:42.627501+0000","last_clean":"2024-09-19T15:28:42.627501+0000","last_became_active":"2024-09-19T13:40:20.100760+0000","last_became_peered":"2024-09-19T13:40:20.100760+0000","last_unstale":"2024-09-19T15:28:42.627501+0000","last_undegraded":"2024-09-19T15:28:42.627501+0000","last_fullsized":"2024-09-19T15:28:42.627501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:10.051308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001106569,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'251","reported_seq":935,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:58.243311+0000","last_change":"2024-09-19T13:40:34.241552+0000","last_active":"2024-09-19T15:28:58.243311+0000","last_peered":"2024-09-19T15:28:58.243311+0000","last_clean":"2024-09-19T15:28:58.243311+0000","last_became_active":"2024-09-19T13:40:34.241162+0000","last_became_peered":"2024-09-19T13:40:34.241162+0000","last_unstale":"2024-09-19T15:28:58.243311+0000","last_undegraded":"2024-09-19T15:28:58.243311+0000","last_fullsized":"2024-09-19T15:28:58.243311+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:44.355824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11368506,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":479,"num_read_kb":104180,"num_write":903,"num_write_kb":16810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.654042+0000","last_change":"2024-09-19T13:40:38.232446+0000","last_active":"2024-09-19T15:29:02.654042+0000","last_peered":"2024-09-19T15:29:02.654042+0000","last_clean":"2024-09-19T15:29:02.654042+0000","last_became_active":"2024-09-19T13:40:38.231762+0000","last_became_peered":"2024-09-19T13:40:38.231762+0000","last_unstale":"2024-09-19T15:29:02.654042+0000","last_undegraded":"2024-09-19T15:29:02.654042+0000","last_fullsized":"2024-09-19T15:29:02.654042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:39.721678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'741","reported_seq":1485,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.850025+0000","last_change":"2024-09-19T13:40:40.240118+0000","last_active":"2024-09-19T15:31:17.850025+0000","last_peered":"2024-09-19T15:31:17.850025+0000","last_clean":"2024-09-19T15:31:17.850025+0000","last_became_active":"2024-09-19T13:40:40.239392+0000","last_became_peered":"2024-09-19T13:40:40.239392+0000","last_unstale":"2024-09-19T15:31:17.850025+0000","last_undegraded":"2024-09-19T15:31:17.850025+0000","last_fullsized":"2024-09-19T15:31:17.850025+0000","mapping_epoch":31,"log_start":"268'700","ondisk_log_start":"268'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":700,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:00.876178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167212,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1427,"num_read_kb":2885,"num_write":1376,"num_write_kb":1210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.192068+0000","last_change":"2024-09-19T13:40:42.240498+0000","last_active":"2024-09-19T15:29:02.192068+0000","last_peered":"2024-09-19T15:29:02.192068+0000","last_clean":"2024-09-19T15:29:02.192068+0000","last_became_active":"2024-09-19T13:40:42.239749+0000","last_became_peered":"2024-09-19T13:40:42.239749+0000","last_unstale":"2024-09-19T15:29:02.192068+0000","last_undegraded":"2024-09-19T15:29:02.192068+0000","last_fullsized":"2024-09-19T15:29:02.192068+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:55:48.115594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'200","reported_seq":921,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.733071+0000","last_change":"2024-09-19T13:40:44.265188+0000","last_active":"2024-09-19T15:29:50.733071+0000","last_peered":"2024-09-19T15:29:50.733071+0000","last_clean":"2024-09-19T15:29:50.733071+0000","last_became_active":"2024-09-19T13:40:44.264456+0000","last_became_peered":"2024-09-19T13:40:44.264456+0000","last_unstale":"2024-09-19T15:29:50.733071+0000","last_undegraded":"2024-09-19T15:29:50.733071+0000","last_fullsized":"2024-09-19T15:29:50.733071+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:46.004583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":469,"num_write":408,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'750","reported_seq":2265,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.375238+0000","last_change":"2024-09-19T13:40:36.223322+0000","last_active":"2024-09-19T15:29:48.375238+0000","last_peered":"2024-09-19T15:29:48.375238+0000","last_clean":"2024-09-19T15:29:48.375238+0000","last_became_active":"2024-09-19T13:40:36.221186+0000","last_became_peered":"2024-09-19T13:40:36.221186+0000","last_unstale":"2024-09-19T15:29:48.375238+0000","last_undegraded":"2024-09-19T15:29:48.375238+0000","last_fullsized":"2024-09-19T15:29:48.375238+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:28:28.786321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3545,"num_read_kb":3202,"num_write":973,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":562,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:47.650225+0000","last_change":"2024-09-19T13:40:23.121191+0000","last_active":"2024-09-19T15:28:47.650225+0000","last_peered":"2024-09-19T15:28:47.650225+0000","last_clean":"2024-09-19T15:28:47.650225+0000","last_became_active":"2024-09-19T13:40:20.099608+0000","last_became_peered":"2024-09-19T13:40:20.099608+0000","last_unstale":"2024-09-19T15:28:47.650225+0000","last_undegraded":"2024-09-19T15:28:47.650225+0000","last_fullsized":"2024-09-19T15:28:47.650225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:29.188183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001034798,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'310","reported_seq":993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.607734+0000","last_change":"2024-09-19T13:40:34.265231+0000","last_active":"2024-09-19T15:31:40.607734+0000","last_peered":"2024-09-19T15:31:40.607734+0000","last_clean":"2024-09-19T15:31:40.607734+0000","last_became_active":"2024-09-19T13:40:34.264819+0000","last_became_peered":"2024-09-19T13:40:34.264819+0000","last_unstale":"2024-09-19T15:31:40.607734+0000","last_undegraded":"2024-09-19T15:31:40.607734+0000","last_fullsized":"2024-09-19T15:31:40.607734+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:02:26.810163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":579,"num_read_kb":52358,"num_write":971,"num_write_kb":38982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.632334+0000","last_change":"2024-09-19T13:40:38.223702+0000","last_active":"2024-09-19T15:29:02.632334+0000","last_peered":"2024-09-19T15:29:02.632334+0000","last_clean":"2024-09-19T15:29:02.632334+0000","last_became_active":"2024-09-19T13:40:38.222905+0000","last_became_peered":"2024-09-19T13:40:38.222905+0000","last_unstale":"2024-09-19T15:29:02.632334+0000","last_undegraded":"2024-09-19T15:29:02.632334+0000","last_fullsized":"2024-09-19T15:29:02.632334+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:40:37.494887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'1438","reported_seq":3758,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.670211+0000","last_change":"2024-09-19T13:40:40.241249+0000","last_active":"2024-09-19T15:31:39.670211+0000","last_peered":"2024-09-19T15:31:39.670211+0000","last_clean":"2024-09-19T15:31:39.670211+0000","last_became_active":"2024-09-19T13:40:40.240768+0000","last_became_peered":"2024-09-19T13:40:40.240768+0000","last_unstale":"2024-09-19T15:31:39.670211+0000","last_undegraded":"2024-09-19T15:31:39.670211+0000","last_fullsized":"2024-09-19T15:31:39.670211+0000","mapping_epoch":31,"log_start":"268'1400","ondisk_log_start":"268'1400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:22:28.103563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140168,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2240,"num_read_kb":4108,"num_write":1354,"num_write_kb":1102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:27.660131+0000","last_change":"2024-09-19T13:40:42.252880+0000","last_active":"2024-09-19T15:29:27.660131+0000","last_peered":"2024-09-19T15:29:27.660131+0000","last_clean":"2024-09-19T15:29:27.660131+0000","last_became_active":"2024-09-19T13:40:42.250172+0000","last_became_peered":"2024-09-19T13:40:42.250172+0000","last_unstale":"2024-09-19T15:29:27.660131+0000","last_undegraded":"2024-09-19T15:29:27.660131+0000","last_fullsized":"2024-09-19T15:29:27.660131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:36:32.481597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'250","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:37.400055+0000","last_change":"2024-09-19T13:40:44.273159+0000","last_active":"2024-09-19T15:29:37.400055+0000","last_peered":"2024-09-19T15:29:37.400055+0000","last_clean":"2024-09-19T15:29:37.400055+0000","last_became_active":"2024-09-19T13:40:44.272356+0000","last_became_peered":"2024-09-19T13:40:44.272356+0000","last_unstale":"2024-09-19T15:29:37.400055+0000","last_undegraded":"2024-09-19T15:29:37.400055+0000","last_fullsized":"2024-09-19T15:29:37.400055+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:13:14.438529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":580,"num_read_kb":531,"num_write":551,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'464","reported_seq":2138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391925+0000","last_change":"2024-09-19T13:40:36.242222+0000","last_active":"2024-09-19T15:28:57.391925+0000","last_peered":"2024-09-19T15:28:57.391925+0000","last_clean":"2024-09-19T15:28:57.391925+0000","last_became_active":"2024-09-19T13:40:36.241832+0000","last_became_peered":"2024-09-19T13:40:36.241832+0000","last_unstale":"2024-09-19T15:28:57.391925+0000","last_undegraded":"2024-09-19T15:28:57.391925+0000","last_fullsized":"2024-09-19T15:28:57.391925+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:08.294812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2706,"num_read_kb":2545,"num_write":558,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":553,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.553858+0000","last_change":"2024-09-19T13:40:22.375307+0000","last_active":"2024-09-19T15:28:42.553858+0000","last_peered":"2024-09-19T15:28:42.553858+0000","last_clean":"2024-09-19T15:28:42.553858+0000","last_became_active":"2024-09-19T13:40:20.096900+0000","last_became_peered":"2024-09-19T13:40:20.096900+0000","last_unstale":"2024-09-19T15:28:42.553858+0000","last_undegraded":"2024-09-19T15:28:42.553858+0000","last_fullsized":"2024-09-19T15:28:42.553858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:28.240242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074274699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'333","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.580511+0000","last_change":"2024-09-19T13:40:34.235882+0000","last_active":"2024-09-19T15:31:40.580511+0000","last_peered":"2024-09-19T15:31:40.580511+0000","last_clean":"2024-09-19T15:31:40.580511+0000","last_became_active":"2024-09-19T13:40:34.235483+0000","last_became_peered":"2024-09-19T13:40:34.235483+0000","last_unstale":"2024-09-19T15:31:40.580511+0000","last_undegraded":"2024-09-19T15:31:40.580511+0000","last_fullsized":"2024-09-19T15:31:40.580511+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:16:09.641672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":610,"num_read_kb":5129,"num_write":1002,"num_write_kb":29541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.557673+0000","last_change":"2024-09-19T13:40:38.228915+0000","last_active":"2024-09-19T15:29:02.557673+0000","last_peered":"2024-09-19T15:29:02.557673+0000","last_clean":"2024-09-19T15:29:02.557673+0000","last_became_active":"2024-09-19T13:40:38.228364+0000","last_became_peered":"2024-09-19T13:40:38.228364+0000","last_unstale":"2024-09-19T15:29:02.557673+0000","last_undegraded":"2024-09-19T15:29:02.557673+0000","last_fullsized":"2024-09-19T15:29:02.557673+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:20.446950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'367","reported_seq":2304,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.215985+0000","last_change":"2024-09-19T13:40:40.232258+0000","last_active":"2024-09-19T15:31:18.215985+0000","last_peered":"2024-09-19T15:31:18.215985+0000","last_clean":"2024-09-19T15:31:18.215985+0000","last_became_active":"2024-09-19T13:40:40.231491+0000","last_became_peered":"2024-09-19T13:40:40.231491+0000","last_unstale":"2024-09-19T15:31:18.215985+0000","last_undegraded":"2024-09-19T15:31:18.215985+0000","last_fullsized":"2024-09-19T15:31:18.215985+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:37.420062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":364,"num_read_kb":356,"num_write":351,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.191956+0000","last_change":"2024-09-19T13:40:42.227173+0000","last_active":"2024-09-19T15:29:02.191956+0000","last_peered":"2024-09-19T15:29:02.191956+0000","last_clean":"2024-09-19T15:29:02.191956+0000","last_became_active":"2024-09-19T13:40:42.226706+0000","last_became_peered":"2024-09-19T13:40:42.226706+0000","last_unstale":"2024-09-19T15:29:02.191956+0000","last_undegraded":"2024-09-19T15:29:02.191956+0000","last_fullsized":"2024-09-19T15:29:02.191956+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:12:31.408133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'257","reported_seq":907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:51.222389+0000","last_change":"2024-09-19T13:40:44.241756+0000","last_active":"2024-09-19T15:29:51.222389+0000","last_peered":"2024-09-19T15:29:51.222389+0000","last_clean":"2024-09-19T15:29:51.222389+0000","last_became_active":"2024-09-19T13:40:44.240277+0000","last_became_peered":"2024-09-19T13:40:44.240277+0000","last_unstale":"2024-09-19T15:29:51.222389+0000","last_undegraded":"2024-09-19T15:29:51.222389+0000","last_fullsized":"2024-09-19T15:29:51.222389+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:50.745130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":590,"num_read_kb":596,"num_write":565,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'478","reported_seq":2079,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.652407+0000","last_change":"2024-09-19T13:40:36.221661+0000","last_active":"2024-09-19T15:29:50.652407+0000","last_peered":"2024-09-19T15:29:50.652407+0000","last_clean":"2024-09-19T15:29:50.652407+0000","last_became_active":"2024-09-19T13:40:36.220514+0000","last_became_peered":"2024-09-19T13:40:36.220514+0000","last_unstale":"2024-09-19T15:29:50.652407+0000","last_undegraded":"2024-09-19T15:29:50.652407+0000","last_fullsized":"2024-09-19T15:29:50.652407+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:03.001074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2550,"num_read_kb":2381,"num_write":569,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":567,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.627408+0000","last_change":"2024-09-19T13:40:22.121910+0000","last_active":"2024-09-19T15:28:42.627408+0000","last_peered":"2024-09-19T15:28:42.627408+0000","last_clean":"2024-09-19T15:28:42.627408+0000","last_became_active":"2024-09-19T13:40:20.101198+0000","last_became_peered":"2024-09-19T13:40:20.101198+0000","last_unstale":"2024-09-19T15:28:42.627408+0000","last_undegraded":"2024-09-19T15:28:42.627408+0000","last_fullsized":"2024-09-19T15:28:42.627408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:03:31.869167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026053059999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'266","reported_seq":929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.611715+0000","last_change":"2024-09-19T13:40:34.229956+0000","last_active":"2024-09-19T15:28:57.611715+0000","last_peered":"2024-09-19T15:28:57.611715+0000","last_clean":"2024-09-19T15:28:57.611715+0000","last_became_active":"2024-09-19T13:40:34.228632+0000","last_became_peered":"2024-09-19T13:40:34.228632+0000","last_unstale":"2024-09-19T15:28:57.611715+0000","last_undegraded":"2024-09-19T15:28:57.611715+0000","last_fullsized":"2024-09-19T15:28:57.611715+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:27:09.603584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6020926,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":521,"num_read_kb":6956,"num_write":932,"num_write_kb":25273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:37.199902+0000","last_change":"2024-09-19T13:40:38.229900+0000","last_active":"2024-09-19T15:29:37.199902+0000","last_peered":"2024-09-19T15:29:37.199902+0000","last_clean":"2024-09-19T15:29:37.199902+0000","last_became_active":"2024-09-19T13:40:38.229144+0000","last_became_peered":"2024-09-19T13:40:38.229144+0000","last_unstale":"2024-09-19T15:29:37.199902+0000","last_undegraded":"2024-09-19T15:29:37.199902+0000","last_fullsized":"2024-09-19T15:29:37.199902+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:43.905801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'214","reported_seq":829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.912084+0000","last_change":"2024-09-19T13:40:40.249690+0000","last_active":"2024-09-19T15:31:17.912084+0000","last_peered":"2024-09-19T15:31:17.912084+0000","last_clean":"2024-09-19T15:31:17.912084+0000","last_became_active":"2024-09-19T13:40:40.249102+0000","last_became_peered":"2024-09-19T13:40:40.249102+0000","last_unstale":"2024-09-19T15:31:17.912084+0000","last_undegraded":"2024-09-19T15:31:17.912084+0000","last_fullsized":"2024-09-19T15:31:17.912084+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:09.297865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":198,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.395494+0000","last_change":"2024-09-19T13:40:42.254540+0000","last_active":"2024-09-19T15:29:02.395494+0000","last_peered":"2024-09-19T15:29:02.395494+0000","last_clean":"2024-09-19T15:29:02.395494+0000","last_became_active":"2024-09-19T13:40:42.250662+0000","last_became_peered":"2024-09-19T13:40:42.250662+0000","last_unstale":"2024-09-19T15:29:02.395494+0000","last_undegraded":"2024-09-19T15:29:02.395494+0000","last_fullsized":"2024-09-19T15:29:02.395494+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:12.417076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'126","reported_seq":718,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:43.404178+0000","last_change":"2024-09-19T13:40:44.267544+0000","last_active":"2024-09-19T15:29:43.404178+0000","last_peered":"2024-09-19T15:29:43.404178+0000","last_clean":"2024-09-19T15:29:43.404178+0000","last_became_active":"2024-09-19T13:40:44.266678+0000","last_became_peered":"2024-09-19T13:40:44.266678+0000","last_unstale":"2024-09-19T15:29:43.404178+0000","last_undegraded":"2024-09-19T15:29:43.404178+0000","last_fullsized":"2024-09-19T15:29:43.404178+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:56:44.218291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":283,"num_read_kb":273,"num_write":324,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'759","reported_seq":2286,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391645+0000","last_change":"2024-09-19T13:40:36.244736+0000","last_active":"2024-09-19T15:28:57.391645+0000","last_peered":"2024-09-19T15:28:57.391645+0000","last_clean":"2024-09-19T15:28:57.391645+0000","last_became_active":"2024-09-19T13:40:36.244403+0000","last_became_peered":"2024-09-19T13:40:36.244403+0000","last_unstale":"2024-09-19T15:28:57.391645+0000","last_undegraded":"2024-09-19T15:28:57.391645+0000","last_fullsized":"2024-09-19T15:28:57.391645+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:21.219635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3619,"num_read_kb":3269,"num_write":981,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'271","reported_seq":986,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:22.636959+0000","last_change":"2024-09-19T13:40:34.226710+0000","last_active":"2024-09-19T15:29:22.636959+0000","last_peered":"2024-09-19T15:29:22.636959+0000","last_clean":"2024-09-19T15:29:22.636959+0000","last_became_active":"2024-09-19T13:40:34.225452+0000","last_became_peered":"2024-09-19T13:40:34.225452+0000","last_unstale":"2024-09-19T15:29:22.636959+0000","last_undegraded":"2024-09-19T15:29:22.636959+0000","last_fullsized":"2024-09-19T15:29:22.636959+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:24:16.701686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1201774,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":543,"num_read_kb":97113,"num_write":1048,"num_write_kb":15979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":551,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.388367+0000","last_change":"2024-09-19T13:40:22.113821+0000","last_active":"2024-09-19T15:28:42.388367+0000","last_peered":"2024-09-19T15:28:42.388367+0000","last_clean":"2024-09-19T15:28:42.388367+0000","last_became_active":"2024-09-19T13:40:20.095294+0000","last_became_peered":"2024-09-19T13:40:20.095294+0000","last_unstale":"2024-09-19T15:28:42.388367+0000","last_undegraded":"2024-09-19T15:28:42.388367+0000","last_fullsized":"2024-09-19T15:28:42.388367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:38.696147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088577700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.191905+0000","last_change":"2024-09-19T13:40:38.230538+0000","last_active":"2024-09-19T15:29:02.191905+0000","last_peered":"2024-09-19T15:29:02.191905+0000","last_clean":"2024-09-19T15:29:02.191905+0000","last_became_active":"2024-09-19T13:40:38.229743+0000","last_became_peered":"2024-09-19T13:40:38.229743+0000","last_unstale":"2024-09-19T15:29:02.191905+0000","last_undegraded":"2024-09-19T15:29:02.191905+0000","last_fullsized":"2024-09-19T15:29:02.191905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:00.135611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'622","reported_seq":1357,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.368618+0000","last_change":"2024-09-19T13:40:40.224386+0000","last_active":"2024-09-19T15:31:40.368618+0000","last_peered":"2024-09-19T15:31:40.368618+0000","last_clean":"2024-09-19T15:31:40.368618+0000","last_became_active":"2024-09-19T13:40:40.223632+0000","last_became_peered":"2024-09-19T13:40:40.223632+0000","last_unstale":"2024-09-19T15:31:40.368618+0000","last_undegraded":"2024-09-19T15:31:40.368618+0000","last_fullsized":"2024-09-19T15:31:40.368618+0000","mapping_epoch":31,"log_start":"268'600","ondisk_log_start":"268'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:52.387211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101088,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1063,"num_read_kb":2259,"num_write":846,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.612861+0000","last_change":"2024-09-19T13:40:42.246177+0000","last_active":"2024-09-19T15:29:02.612861+0000","last_peered":"2024-09-19T15:29:02.612861+0000","last_clean":"2024-09-19T15:29:02.612861+0000","last_became_active":"2024-09-19T13:40:42.245476+0000","last_became_peered":"2024-09-19T13:40:42.245476+0000","last_unstale":"2024-09-19T15:29:02.612861+0000","last_undegraded":"2024-09-19T15:29:02.612861+0000","last_fullsized":"2024-09-19T15:29:02.612861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:33:09.183782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'141","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:11.923727+0000","last_change":"2024-09-19T13:40:44.275185+0000","last_active":"2024-09-19T15:31:11.923727+0000","last_peered":"2024-09-19T15:31:11.923727+0000","last_clean":"2024-09-19T15:31:11.923727+0000","last_became_active":"2024-09-19T13:40:44.274333+0000","last_became_peered":"2024-09-19T13:40:44.274333+0000","last_unstale":"2024-09-19T15:31:11.923727+0000","last_undegraded":"2024-09-19T15:31:11.923727+0000","last_fullsized":"2024-09-19T15:31:11.923727+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:10.763011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":236,"num_read_kb":218,"num_write":346,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'455","reported_seq":2038,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.656021+0000","last_change":"2024-09-19T13:40:36.242002+0000","last_active":"2024-09-19T15:29:50.656021+0000","last_peered":"2024-09-19T15:29:50.656021+0000","last_clean":"2024-09-19T15:29:50.656021+0000","last_became_active":"2024-09-19T13:40:36.241654+0000","last_became_peered":"2024-09-19T13:40:36.241654+0000","last_unstale":"2024-09-19T15:29:50.656021+0000","last_undegraded":"2024-09-19T15:29:50.656021+0000","last_fullsized":"2024-09-19T15:29:50.656021+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:39:35.530454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2406,"num_read_kb":2267,"num_write":541,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'310","reported_seq":961,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.366490+0000","last_change":"2024-09-19T13:40:34.249506+0000","last_active":"2024-09-19T15:31:40.366490+0000","last_peered":"2024-09-19T15:31:40.366490+0000","last_clean":"2024-09-19T15:31:40.366490+0000","last_became_active":"2024-09-19T13:40:34.248944+0000","last_became_peered":"2024-09-19T13:40:34.248944+0000","last_unstale":"2024-09-19T15:31:40.366490+0000","last_undegraded":"2024-09-19T15:31:40.366490+0000","last_fullsized":"2024-09-19T15:31:40.366490+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:14:45.859987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":481,"num_read_kb":60023,"num_write":924,"num_write_kb":13648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":560,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:07.655294+0000","last_change":"2024-09-19T13:40:23.121258+0000","last_active":"2024-09-19T15:29:07.655294+0000","last_peered":"2024-09-19T15:29:07.655294+0000","last_clean":"2024-09-19T15:29:07.655294+0000","last_became_active":"2024-09-19T13:40:20.096321+0000","last_became_peered":"2024-09-19T13:40:20.096321+0000","last_unstale":"2024-09-19T15:29:07.655294+0000","last_undegraded":"2024-09-19T15:29:07.655294+0000","last_fullsized":"2024-09-19T15:29:07.655294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:56.853216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001025329,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.395362+0000","last_change":"2024-09-19T13:40:38.230448+0000","last_active":"2024-09-19T15:29:02.395362+0000","last_peered":"2024-09-19T15:29:02.395362+0000","last_clean":"2024-09-19T15:29:02.395362+0000","last_became_active":"2024-09-19T13:40:38.229784+0000","last_became_peered":"2024-09-19T13:40:38.229784+0000","last_unstale":"2024-09-19T15:29:02.395362+0000","last_undegraded":"2024-09-19T15:29:02.395362+0000","last_fullsized":"2024-09-19T15:29:02.395362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:28:13.132545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'339","reported_seq":975,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.261784+0000","last_change":"2024-09-19T13:40:40.240170+0000","last_active":"2024-09-19T15:31:18.261784+0000","last_peered":"2024-09-19T15:31:18.261784+0000","last_clean":"2024-09-19T15:31:18.261784+0000","last_became_active":"2024-09-19T13:40:40.239406+0000","last_became_peered":"2024-09-19T13:40:40.239406+0000","last_unstale":"2024-09-19T15:31:18.261784+0000","last_undegraded":"2024-09-19T15:31:18.261784+0000","last_fullsized":"2024-09-19T15:31:18.261784+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:48:52.979382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":438,"num_read_kb":429,"num_write":416,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'781","reported_seq":3357,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:16.991134+0000","last_change":"2024-09-19T13:40:42.245618+0000","last_active":"2024-09-19T15:31:16.991134+0000","last_peered":"2024-09-19T15:31:16.991134+0000","last_clean":"2024-09-19T15:31:16.991134+0000","last_became_active":"2024-09-19T13:40:42.244921+0000","last_became_peered":"2024-09-19T13:40:42.244921+0000","last_unstale":"2024-09-19T15:31:16.991134+0000","last_undegraded":"2024-09-19T15:31:16.991134+0000","last_fullsized":"2024-09-19T15:31:16.991134+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:59.793708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'142","reported_seq":702,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.263529+0000","last_change":"2024-09-19T13:40:44.279820+0000","last_active":"2024-09-19T15:31:13.263529+0000","last_peered":"2024-09-19T15:31:13.263529+0000","last_clean":"2024-09-19T15:31:13.263529+0000","last_became_active":"2024-09-19T13:40:44.277602+0000","last_became_peered":"2024-09-19T13:40:44.277602+0000","last_unstale":"2024-09-19T15:31:13.263529+0000","last_undegraded":"2024-09-19T15:31:13.263529+0000","last_fullsized":"2024-09-19T15:31:13.263529+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:34:45.143706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":303,"num_read_kb":269,"num_write":341,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'434","reported_seq":1934,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:48.240820+0000","last_change":"2024-09-19T13:40:36.235651+0000","last_active":"2024-09-19T15:28:48.240820+0000","last_peered":"2024-09-19T15:28:48.240820+0000","last_clean":"2024-09-19T15:28:48.240820+0000","last_became_active":"2024-09-19T13:40:36.235186+0000","last_became_peered":"2024-09-19T13:40:36.235186+0000","last_unstale":"2024-09-19T15:28:48.240820+0000","last_undegraded":"2024-09-19T15:28:48.240820+0000","last_fullsized":"2024-09-19T15:28:48.240820+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:14.271645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2268,"num_read_kb":2120,"num_write":492,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'347","reported_seq":1184,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:58.243544+0000","last_change":"2024-09-19T13:40:34.236743+0000","last_active":"2024-09-19T15:28:58.243544+0000","last_peered":"2024-09-19T15:28:58.243544+0000","last_clean":"2024-09-19T15:28:58.243544+0000","last_became_active":"2024-09-19T13:40:34.236325+0000","last_became_peered":"2024-09-19T13:40:34.236325+0000","last_unstale":"2024-09-19T15:28:58.243544+0000","last_undegraded":"2024-09-19T15:28:58.243544+0000","last_fullsized":"2024-09-19T15:28:58.243544+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:08.160460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26215291,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":790,"num_read_kb":111535,"num_write":1242,"num_write_kb":62709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":549,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.388450+0000","last_change":"2024-09-19T13:40:22.113992+0000","last_active":"2024-09-19T15:28:42.388450+0000","last_peered":"2024-09-19T15:28:42.388450+0000","last_clean":"2024-09-19T15:28:42.388450+0000","last_became_active":"2024-09-19T13:40:20.101186+0000","last_became_peered":"2024-09-19T13:40:20.101186+0000","last_unstale":"2024-09-19T15:28:42.388450+0000","last_undegraded":"2024-09-19T15:28:42.388450+0000","last_fullsized":"2024-09-19T15:28:42.388450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:40.208910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010323750000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.612811+0000","last_change":"2024-09-19T13:40:38.235854+0000","last_active":"2024-09-19T15:29:02.612811+0000","last_peered":"2024-09-19T15:29:02.612811+0000","last_clean":"2024-09-19T15:29:02.612811+0000","last_became_active":"2024-09-19T13:40:38.235109+0000","last_became_peered":"2024-09-19T13:40:38.235109+0000","last_unstale":"2024-09-19T15:29:02.612811+0000","last_undegraded":"2024-09-19T15:29:02.612811+0000","last_fullsized":"2024-09-19T15:29:02.612811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:18.997643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'193","reported_seq":793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.185499+0000","last_change":"2024-09-19T13:40:40.248167+0000","last_active":"2024-09-19T15:31:18.185499+0000","last_peered":"2024-09-19T15:31:18.185499+0000","last_clean":"2024-09-19T15:31:18.185499+0000","last_became_active":"2024-09-19T13:40:40.244484+0000","last_became_peered":"2024-09-19T13:40:40.244484+0000","last_unstale":"2024-09-19T15:31:18.185499+0000","last_undegraded":"2024-09-19T15:31:18.185499+0000","last_fullsized":"2024-09-19T15:31:18.185499+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:26.251998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":238,"num_read_kb":228,"num_write":166,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'782","reported_seq":5105,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:16.987086+0000","last_change":"2024-09-19T13:40:42.258379+0000","last_active":"2024-09-19T15:31:16.987086+0000","last_peered":"2024-09-19T15:31:16.987086+0000","last_clean":"2024-09-19T15:31:16.987086+0000","last_became_active":"2024-09-19T13:40:42.257799+0000","last_became_peered":"2024-09-19T13:40:42.257799+0000","last_unstale":"2024-09-19T15:31:16.987086+0000","last_undegraded":"2024-09-19T15:31:16.987086+0000","last_fullsized":"2024-09-19T15:31:16.987086+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:03:48.981520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'191","reported_seq":724,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.522019+0000","last_change":"2024-09-19T13:40:44.259985+0000","last_active":"2024-09-19T15:29:48.522019+0000","last_peered":"2024-09-19T15:29:48.522019+0000","last_clean":"2024-09-19T15:29:48.522019+0000","last_became_active":"2024-09-19T13:40:44.259077+0000","last_became_peered":"2024-09-19T13:40:44.259077+0000","last_unstale":"2024-09-19T15:29:48.522019+0000","last_undegraded":"2024-09-19T15:29:48.522019+0000","last_fullsized":"2024-09-19T15:29:48.522019+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:06:05.199311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":211,"num_read_kb":198,"num_write":423,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'428","reported_seq":1954,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.611513+0000","last_change":"2024-09-19T13:40:36.243340+0000","last_active":"2024-09-19T15:28:57.611513+0000","last_peered":"2024-09-19T15:28:57.611513+0000","last_clean":"2024-09-19T15:28:57.611513+0000","last_became_active":"2024-09-19T13:40:36.242739+0000","last_became_peered":"2024-09-19T13:40:36.242739+0000","last_unstale":"2024-09-19T15:28:57.611513+0000","last_undegraded":"2024-09-19T15:28:57.611513+0000","last_fullsized":"2024-09-19T15:28:57.611513+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:12.677759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2240,"num_read_kb":2109,"num_write":493,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'308","reported_seq":960,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.546357+0000","last_change":"2024-09-19T13:41:05.316778+0000","last_active":"2024-09-19T15:31:40.546357+0000","last_peered":"2024-09-19T15:31:40.546357+0000","last_clean":"2024-09-19T15:31:40.546357+0000","last_became_active":"2024-09-19T13:41:05.316287+0000","last_became_peered":"2024-09-19T13:41:05.316287+0000","last_unstale":"2024-09-19T15:31:40.546357+0000","last_undegraded":"2024-09-19T15:31:40.546357+0000","last_fullsized":"2024-09-19T15:31:40.546357+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:28.207137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":643,"num_read_kb":12872,"num_write":1020,"num_write_kb":31603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":546,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.390813+0000","last_change":"2024-09-19T13:40:22.308878+0000","last_active":"2024-09-19T15:28:42.390813+0000","last_peered":"2024-09-19T15:28:42.390813+0000","last_clean":"2024-09-19T15:28:42.390813+0000","last_became_active":"2024-09-19T13:40:20.103134+0000","last_became_peered":"2024-09-19T13:40:20.103134+0000","last_unstale":"2024-09-19T15:28:42.390813+0000","last_undegraded":"2024-09-19T15:28:42.390813+0000","last_fullsized":"2024-09-19T15:28:42.390813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:38.150405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093870599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:53.241996+0000","last_change":"2024-09-19T13:40:38.221807+0000","last_active":"2024-09-19T15:28:53.241996+0000","last_peered":"2024-09-19T15:28:53.241996+0000","last_clean":"2024-09-19T15:28:53.241996+0000","last_became_active":"2024-09-19T13:40:38.221430+0000","last_became_peered":"2024-09-19T13:40:38.221430+0000","last_unstale":"2024-09-19T15:28:53.241996+0000","last_undegraded":"2024-09-19T15:28:53.241996+0000","last_fullsized":"2024-09-19T15:28:53.241996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:13.637760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'825","reported_seq":1602,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.147205+0000","last_change":"2024-09-19T13:40:40.230230+0000","last_active":"2024-09-19T15:31:18.147205+0000","last_peered":"2024-09-19T15:31:18.147205+0000","last_clean":"2024-09-19T15:31:18.147205+0000","last_became_active":"2024-09-19T13:40:40.229426+0000","last_became_peered":"2024-09-19T13:40:40.229426+0000","last_unstale":"2024-09-19T15:31:18.147205+0000","last_undegraded":"2024-09-19T15:31:18.147205+0000","last_fullsized":"2024-09-19T15:31:18.147205+0000","mapping_epoch":31,"log_start":"268'800","ondisk_log_start":"268'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":800,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:41:10.280326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181238,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1441,"num_read_kb":2990,"num_write":1182,"num_write_kb":940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:03.244490+0000","last_change":"2024-09-19T13:40:42.245759+0000","last_active":"2024-09-19T15:29:03.244490+0000","last_peered":"2024-09-19T15:29:03.244490+0000","last_clean":"2024-09-19T15:29:03.244490+0000","last_became_active":"2024-09-19T13:40:42.244291+0000","last_became_peered":"2024-09-19T13:40:42.244291+0000","last_unstale":"2024-09-19T15:29:03.244490+0000","last_undegraded":"2024-09-19T15:29:03.244490+0000","last_fullsized":"2024-09-19T15:29:03.244490+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:28.425275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'152","reported_seq":709,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:47.628704+0000","last_change":"2024-09-19T13:40:44.274189+0000","last_active":"2024-09-19T15:28:47.628704+0000","last_peered":"2024-09-19T15:28:47.628704+0000","last_clean":"2024-09-19T15:28:47.628704+0000","last_became_active":"2024-09-19T13:40:44.273409+0000","last_became_peered":"2024-09-19T13:40:44.273409+0000","last_unstale":"2024-09-19T15:28:47.628704+0000","last_undegraded":"2024-09-19T15:28:47.628704+0000","last_fullsized":"2024-09-19T15:28:47.628704+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:21.357101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":293,"num_read_kb":268,"num_write":395,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'157","reported_seq":741,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:51.129484+0000","last_change":"2024-09-19T13:40:44.264292+0000","last_active":"2024-09-19T15:29:51.129484+0000","last_peered":"2024-09-19T15:29:51.129484+0000","last_clean":"2024-09-19T15:29:51.129484+0000","last_became_active":"2024-09-19T13:40:44.263575+0000","last_became_peered":"2024-09-19T13:40:44.263575+0000","last_unstale":"2024-09-19T15:29:51.129484+0000","last_undegraded":"2024-09-19T15:29:51.129484+0000","last_fullsized":"2024-09-19T15:29:51.129484+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:21.299012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":274,"num_read_kb":267,"num_write":381,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'488","reported_seq":2271,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:49.327444+0000","last_change":"2024-09-19T13:40:36.228857+0000","last_active":"2024-09-19T15:28:49.327444+0000","last_peered":"2024-09-19T15:28:49.327444+0000","last_clean":"2024-09-19T15:28:49.327444+0000","last_became_active":"2024-09-19T13:40:36.221019+0000","last_became_peered":"2024-09-19T13:40:36.221019+0000","last_unstale":"2024-09-19T15:28:49.327444+0000","last_undegraded":"2024-09-19T15:28:49.327444+0000","last_fullsized":"2024-09-19T15:28:49.327444+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:18:02.656810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2720,"num_read_kb":2588,"num_write":552,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'326","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:17.602405+0000","last_change":"2024-09-19T13:40:34.268385+0000","last_active":"2024-09-19T15:28:17.602405+0000","last_peered":"2024-09-19T15:28:17.602405+0000","last_clean":"2024-09-19T15:28:17.602405+0000","last_became_active":"2024-09-19T13:40:34.263276+0000","last_became_peered":"2024-09-19T13:40:34.263276+0000","last_unstale":"2024-09-19T15:28:17.602405+0000","last_undegraded":"2024-09-19T15:28:17.602405+0000","last_fullsized":"2024-09-19T15:28:17.602405+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:53.534025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141461,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":617,"num_read_kb":11371,"num_write":1159,"num_write_kb":39217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"37'5","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.114784+0000","last_change":"2024-09-19T13:40:38.216204+0000","last_active":"2024-09-19T15:31:38.114784+0000","last_peered":"2024-09-19T15:31:38.114784+0000","last_clean":"2024-09-19T15:31:38.114784+0000","last_became_active":"2024-09-19T13:40:38.215364+0000","last_became_peered":"2024-09-19T13:40:38.215364+0000","last_unstale":"2024-09-19T15:31:38.114784+0000","last_undegraded":"2024-09-19T15:31:38.114784+0000","last_fullsized":"2024-09-19T15:31:38.114784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:27.296619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":1184,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'355","reported_seq":984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.274430+0000","last_change":"2024-09-19T13:40:40.230669+0000","last_active":"2024-09-19T15:31:18.274430+0000","last_peered":"2024-09-19T15:31:18.274430+0000","last_clean":"2024-09-19T15:31:18.274430+0000","last_became_active":"2024-09-19T13:40:40.229872+0000","last_became_peered":"2024-09-19T13:40:40.229872+0000","last_unstale":"2024-09-19T15:31:18.274430+0000","last_undegraded":"2024-09-19T15:31:18.274430+0000","last_fullsized":"2024-09-19T15:31:18.274430+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:36.305353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":148208,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":572,"num_read_kb":1295,"num_write":462,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:03.230352+0000","last_change":"2024-09-19T13:40:42.243067+0000","last_active":"2024-09-19T15:28:03.230352+0000","last_peered":"2024-09-19T15:28:03.230352+0000","last_clean":"2024-09-19T15:28:03.230352+0000","last_became_active":"2024-09-19T13:40:42.242368+0000","last_became_peered":"2024-09-19T13:40:42.242368+0000","last_unstale":"2024-09-19T15:28:03.230352+0000","last_undegraded":"2024-09-19T15:28:03.230352+0000","last_fullsized":"2024-09-19T15:28:03.230352+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:59.628504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'121","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:46.522969+0000","last_change":"2024-09-19T13:40:44.269881+0000","last_active":"2024-09-19T15:29:46.522969+0000","last_peered":"2024-09-19T15:29:46.522969+0000","last_clean":"2024-09-19T15:29:46.522969+0000","last_became_active":"2024-09-19T13:40:44.268946+0000","last_became_peered":"2024-09-19T13:40:44.268946+0000","last_unstale":"2024-09-19T15:29:46.522969+0000","last_undegraded":"2024-09-19T15:29:46.522969+0000","last_fullsized":"2024-09-19T15:29:46.522969+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:40.184840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":128,"num_write":265,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'468","reported_seq":2032,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:19.439069+0000","last_change":"2024-09-19T13:40:36.226704+0000","last_active":"2024-09-19T15:28:19.439069+0000","last_peered":"2024-09-19T15:28:19.439069+0000","last_clean":"2024-09-19T15:28:19.439069+0000","last_became_active":"2024-09-19T13:40:36.226164+0000","last_became_peered":"2024-09-19T13:40:36.226164+0000","last_unstale":"2024-09-19T15:28:19.439069+0000","last_undegraded":"2024-09-19T15:28:19.439069+0000","last_fullsized":"2024-09-19T15:28:19.439069+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:08.833158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2492,"num_read_kb":2321,"num_write":561,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'252","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:26.080136+0000","last_change":"2024-09-19T13:41:05.389078+0000","last_active":"2024-09-19T15:29:26.080136+0000","last_peered":"2024-09-19T15:29:26.080136+0000","last_clean":"2024-09-19T15:29:26.080136+0000","last_became_active":"2024-09-19T13:41:05.387779+0000","last_became_peered":"2024-09-19T13:41:05.387779+0000","last_unstale":"2024-09-19T15:29:26.080136+0000","last_undegraded":"2024-09-19T15:29:26.080136+0000","last_fullsized":"2024-09-19T15:29:26.080136+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:33:11.159579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14914337,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":835,"num_read_kb":29706,"num_write":955,"num_write_kb":41961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:03.230639+0000","last_change":"2024-09-19T13:40:38.229142+0000","last_active":"2024-09-19T15:28:03.230639+0000","last_peered":"2024-09-19T15:28:03.230639+0000","last_clean":"2024-09-19T15:28:03.230639+0000","last_became_active":"2024-09-19T13:40:38.228856+0000","last_became_peered":"2024-09-19T13:40:38.228856+0000","last_unstale":"2024-09-19T15:28:03.230639+0000","last_undegraded":"2024-09-19T15:28:03.230639+0000","last_fullsized":"2024-09-19T15:28:03.230639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:01.786775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'85","reported_seq":624,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.250690+0000","last_change":"2024-09-19T13:40:40.236243+0000","last_active":"2024-09-19T15:31:17.250690+0000","last_peered":"2024-09-19T15:31:17.250690+0000","last_clean":"2024-09-19T15:31:17.250690+0000","last_became_active":"2024-09-19T13:40:40.235528+0000","last_became_peered":"2024-09-19T13:40:40.235528+0000","last_unstale":"2024-09-19T15:31:17.250690+0000","last_undegraded":"2024-09-19T15:31:17.250690+0000","last_fullsized":"2024-09-19T15:31:17.250690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:33:05.231869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":75,"num_write":58,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.639370+0000","last_change":"2024-09-19T13:40:42.243881+0000","last_active":"2024-09-19T15:28:02.639370+0000","last_peered":"2024-09-19T15:28:02.639370+0000","last_clean":"2024-09-19T15:28:02.639370+0000","last_became_active":"2024-09-19T13:40:42.243224+0000","last_became_peered":"2024-09-19T13:40:42.243224+0000","last_unstale":"2024-09-19T15:28:02.639370+0000","last_undegraded":"2024-09-19T15:28:02.639370+0000","last_fullsized":"2024-09-19T15:28:02.639370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:08:53.998486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'210","reported_seq":756,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.410376+0000","last_change":"2024-09-19T13:40:44.259510+0000","last_active":"2024-09-19T15:29:48.410376+0000","last_peered":"2024-09-19T15:29:48.410376+0000","last_clean":"2024-09-19T15:29:48.410376+0000","last_became_active":"2024-09-19T13:40:44.258721+0000","last_became_peered":"2024-09-19T13:40:44.258721+0000","last_unstale":"2024-09-19T15:29:48.410376+0000","last_undegraded":"2024-09-19T15:29:48.410376+0000","last_fullsized":"2024-09-19T15:29:48.410376+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:08.449777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":369,"num_read_kb":358,"num_write":477,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'367","reported_seq":1888,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.249898+0000","last_change":"2024-09-19T13:40:36.240148+0000","last_active":"2024-09-19T15:31:12.249898+0000","last_peered":"2024-09-19T15:31:12.249898+0000","last_clean":"2024-09-19T15:31:12.249898+0000","last_became_active":"2024-09-19T13:40:36.239629+0000","last_became_peered":"2024-09-19T13:40:36.239629+0000","last_unstale":"2024-09-19T15:31:12.249898+0000","last_undegraded":"2024-09-19T15:31:12.249898+0000","last_fullsized":"2024-09-19T15:31:12.249898+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:24.215137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2075,"num_read_kb":1985,"num_write":419,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'267","reported_seq":941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:40.662828+0000","last_change":"2024-09-19T13:40:34.257051+0000","last_active":"2024-09-19T15:27:40.662828+0000","last_peered":"2024-09-19T15:27:40.662828+0000","last_clean":"2024-09-19T15:27:40.662828+0000","last_became_active":"2024-09-19T13:40:34.256236+0000","last_became_peered":"2024-09-19T13:40:34.256236+0000","last_unstale":"2024-09-19T15:27:40.662828+0000","last_undegraded":"2024-09-19T15:27:40.662828+0000","last_fullsized":"2024-09-19T15:27:40.662828+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:27:07.032068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8287774,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":501,"num_read_kb":16816,"num_write":923,"num_write_kb":29952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.639311+0000","last_change":"2024-09-19T13:40:38.252067+0000","last_active":"2024-09-19T15:28:02.639311+0000","last_peered":"2024-09-19T15:28:02.639311+0000","last_clean":"2024-09-19T15:28:02.639311+0000","last_became_active":"2024-09-19T13:40:38.249269+0000","last_became_peered":"2024-09-19T13:40:38.249269+0000","last_unstale":"2024-09-19T15:28:02.639311+0000","last_undegraded":"2024-09-19T15:28:02.639311+0000","last_fullsized":"2024-09-19T15:28:02.639311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:17.524647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'352","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.108327+0000","last_change":"2024-09-19T13:40:40.230649+0000","last_active":"2024-09-19T15:31:18.108327+0000","last_peered":"2024-09-19T15:31:18.108327+0000","last_clean":"2024-09-19T15:31:18.108327+0000","last_became_active":"2024-09-19T13:40:40.229852+0000","last_became_peered":"2024-09-19T13:40:40.229852+0000","last_unstale":"2024-09-19T15:31:18.108327+0000","last_undegraded":"2024-09-19T15:31:18.108327+0000","last_fullsized":"2024-09-19T15:31:18.108327+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:48.815571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56415,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":573,"num_read_kb":1060,"num_write":448,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.381985+0000","last_change":"2024-09-19T13:40:42.250045+0000","last_active":"2024-09-19T15:28:02.381985+0000","last_peered":"2024-09-19T15:28:02.381985+0000","last_clean":"2024-09-19T15:28:02.381985+0000","last_became_active":"2024-09-19T13:40:42.240135+0000","last_became_peered":"2024-09-19T13:40:42.240135+0000","last_unstale":"2024-09-19T15:28:02.381985+0000","last_undegraded":"2024-09-19T15:28:02.381985+0000","last_fullsized":"2024-09-19T15:28:02.381985+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:14.195144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'85","reported_seq":635,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:45.986381+0000","last_change":"2024-09-19T13:40:44.269896+0000","last_active":"2024-09-19T15:28:45.986381+0000","last_peered":"2024-09-19T15:28:45.986381+0000","last_clean":"2024-09-19T15:28:45.986381+0000","last_became_active":"2024-09-19T13:40:44.269134+0000","last_became_peered":"2024-09-19T13:40:44.269134+0000","last_unstale":"2024-09-19T15:28:45.986381+0000","last_undegraded":"2024-09-19T15:28:45.986381+0000","last_fullsized":"2024-09-19T15:28:45.986381+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:09.390631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":160,"num_write":196,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'609","reported_seq":2425,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.655880+0000","last_change":"2024-09-19T13:40:36.219585+0000","last_active":"2024-09-19T15:29:50.655880+0000","last_peered":"2024-09-19T15:29:50.655880+0000","last_clean":"2024-09-19T15:29:50.655880+0000","last_became_active":"2024-09-19T13:40:36.217925+0000","last_became_peered":"2024-09-19T13:40:36.217925+0000","last_unstale":"2024-09-19T15:29:50.655880+0000","last_undegraded":"2024-09-19T15:29:50.655880+0000","last_fullsized":"2024-09-19T15:29:50.655880+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":500,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:53.942689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3256,"num_read_kb":3011,"num_write":769,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'364","reported_seq":1019,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.561629+0000","last_change":"2024-09-19T13:40:34.228238+0000","last_active":"2024-09-19T15:31:40.561629+0000","last_peered":"2024-09-19T15:31:40.561629+0000","last_clean":"2024-09-19T15:31:40.561629+0000","last_became_active":"2024-09-19T13:40:34.227791+0000","last_became_peered":"2024-09-19T13:40:34.227791+0000","last_unstale":"2024-09-19T15:31:40.561629+0000","last_undegraded":"2024-09-19T15:31:40.561629+0000","last_fullsized":"2024-09-19T15:31:40.561629+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:08.249649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":536,"num_read_kb":35857,"num_write":1057,"num_write_kb":31805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.381920+0000","last_change":"2024-09-19T13:40:38.246952+0000","last_active":"2024-09-19T15:28:02.381920+0000","last_peered":"2024-09-19T15:28:02.381920+0000","last_clean":"2024-09-19T15:28:02.381920+0000","last_became_active":"2024-09-19T13:40:38.246129+0000","last_became_peered":"2024-09-19T13:40:38.246129+0000","last_unstale":"2024-09-19T15:28:02.381920+0000","last_undegraded":"2024-09-19T15:28:02.381920+0000","last_fullsized":"2024-09-19T15:28:02.381920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:34.896613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'310","reported_seq":927,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.692762+0000","last_change":"2024-09-19T13:40:40.219645+0000","last_active":"2024-09-19T15:31:17.692762+0000","last_peered":"2024-09-19T15:31:17.692762+0000","last_clean":"2024-09-19T15:31:17.692762+0000","last_became_active":"2024-09-19T13:40:40.218434+0000","last_became_peered":"2024-09-19T13:40:40.218434+0000","last_unstale":"2024-09-19T15:31:17.692762+0000","last_undegraded":"2024-09-19T15:31:17.692762+0000","last_fullsized":"2024-09-19T15:31:17.692762+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:27.205776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54978,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":505,"num_read_kb":1000,"num_write":408,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.178023+0000","last_change":"2024-09-19T13:40:42.240830+0000","last_active":"2024-09-19T15:28:02.178023+0000","last_peered":"2024-09-19T15:28:02.178023+0000","last_clean":"2024-09-19T15:28:02.178023+0000","last_became_active":"2024-09-19T13:40:42.238908+0000","last_became_peered":"2024-09-19T13:40:42.238908+0000","last_unstale":"2024-09-19T15:28:02.178023+0000","last_undegraded":"2024-09-19T15:28:02.178023+0000","last_fullsized":"2024-09-19T15:28:02.178023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:27.434117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'522","reported_seq":2138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.266057+0000","last_change":"2024-09-19T13:40:36.244240+0000","last_active":"2024-09-19T15:31:12.266057+0000","last_peered":"2024-09-19T15:31:12.266057+0000","last_clean":"2024-09-19T15:31:12.266057+0000","last_became_active":"2024-09-19T13:40:36.243653+0000","last_became_peered":"2024-09-19T13:40:36.243653+0000","last_unstale":"2024-09-19T15:31:12.266057+0000","last_undegraded":"2024-09-19T15:31:12.266057+0000","last_fullsized":"2024-09-19T15:31:12.266057+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:58.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2759,"num_read_kb":2556,"num_write":676,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'296","reported_seq":938,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:26:58.214536+0000","last_change":"2024-09-19T13:40:34.220157+0000","last_active":"2024-09-19T15:26:58.214536+0000","last_peered":"2024-09-19T15:26:58.214536+0000","last_clean":"2024-09-19T15:26:58.214536+0000","last_became_active":"2024-09-19T13:40:34.219131+0000","last_became_peered":"2024-09-19T13:40:34.219131+0000","last_unstale":"2024-09-19T15:26:58.214536+0000","last_undegraded":"2024-09-19T15:26:58.214536+0000","last_fullsized":"2024-09-19T15:26:58.214536+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:20.075063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14133446,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":465,"num_read_kb":16977,"num_write":1113,"num_write_kb":67471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:17.195724+0000","last_change":"2024-09-19T13:40:38.232297+0000","last_active":"2024-09-19T15:29:17.195724+0000","last_peered":"2024-09-19T15:29:17.195724+0000","last_clean":"2024-09-19T15:29:17.195724+0000","last_became_active":"2024-09-19T13:40:38.231992+0000","last_became_peered":"2024-09-19T13:40:38.231992+0000","last_unstale":"2024-09-19T15:29:17.195724+0000","last_undegraded":"2024-09-19T15:29:17.195724+0000","last_fullsized":"2024-09-19T15:29:17.195724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:52.322584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'563","reported_seq":1234,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.251285+0000","last_change":"2024-09-19T13:40:40.242437+0000","last_active":"2024-09-19T15:31:40.251285+0000","last_peered":"2024-09-19T15:31:40.251285+0000","last_clean":"2024-09-19T15:31:40.251285+0000","last_became_active":"2024-09-19T13:40:40.241045+0000","last_became_peered":"2024-09-19T13:40:40.241045+0000","last_unstale":"2024-09-19T15:31:40.251285+0000","last_undegraded":"2024-09-19T15:31:40.251285+0000","last_fullsized":"2024-09-19T15:31:40.251285+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:12.858930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102495,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":998,"num_read_kb":2312,"num_write":864,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.620732+0000","last_change":"2024-09-19T13:40:42.266732+0000","last_active":"2024-09-19T15:28:12.620732+0000","last_peered":"2024-09-19T15:28:12.620732+0000","last_clean":"2024-09-19T15:28:12.620732+0000","last_became_active":"2024-09-19T13:40:42.266161+0000","last_became_peered":"2024-09-19T13:40:42.266161+0000","last_unstale":"2024-09-19T15:28:12.620732+0000","last_undegraded":"2024-09-19T15:28:12.620732+0000","last_fullsized":"2024-09-19T15:28:12.620732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:36.831314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'153","reported_seq":684,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:08.231621+0000","last_change":"2024-09-19T13:40:44.280809+0000","last_active":"2024-09-19T15:28:08.231621+0000","last_peered":"2024-09-19T15:28:08.231621+0000","last_clean":"2024-09-19T15:28:08.231621+0000","last_became_active":"2024-09-19T13:40:44.280362+0000","last_became_peered":"2024-09-19T13:40:44.280362+0000","last_unstale":"2024-09-19T15:28:08.231621+0000","last_undegraded":"2024-09-19T15:28:08.231621+0000","last_fullsized":"2024-09-19T15:28:08.231621+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:26:28.134421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":216,"num_read_kb":226,"num_write":329,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'908","reported_seq":2606,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.194253+0000","last_change":"2024-09-19T13:40:36.234854+0000","last_active":"2024-09-19T15:29:12.194253+0000","last_peered":"2024-09-19T15:29:12.194253+0000","last_clean":"2024-09-19T15:29:12.194253+0000","last_became_active":"2024-09-19T13:40:36.234428+0000","last_became_peered":"2024-09-19T13:40:36.234428+0000","last_unstale":"2024-09-19T15:29:12.194253+0000","last_undegraded":"2024-09-19T15:29:12.194253+0000","last_fullsized":"2024-09-19T15:29:12.194253+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":800,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:32.532292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4426,"num_read_kb":3975,"num_write":1248,"num_write_kb":508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'387","reported_seq":1097,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.531117+0000","last_change":"2024-09-19T13:40:34.250086+0000","last_active":"2024-09-19T15:31:40.531117+0000","last_peered":"2024-09-19T15:31:40.531117+0000","last_clean":"2024-09-19T15:31:40.531117+0000","last_became_active":"2024-09-19T13:40:34.249719+0000","last_became_peered":"2024-09-19T13:40:34.249719+0000","last_unstale":"2024-09-19T15:31:40.531117+0000","last_undegraded":"2024-09-19T15:31:40.531117+0000","last_fullsized":"2024-09-19T15:31:40.531117+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:25:54.224688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2165812,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":691,"num_read_kb":108324,"num_write":1302,"num_write_kb":34137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"37'3","reported_seq":1000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.118413+0000","last_change":"2024-09-19T13:40:38.246559+0000","last_active":"2024-09-19T15:31:38.118413+0000","last_peered":"2024-09-19T15:31:38.118413+0000","last_clean":"2024-09-19T15:31:38.118413+0000","last_became_active":"2024-09-19T13:40:38.245835+0000","last_became_peered":"2024-09-19T13:40:38.245835+0000","last_unstale":"2024-09-19T15:31:38.118413+0000","last_undegraded":"2024-09-19T15:31:38.118413+0000","last_fullsized":"2024-09-19T15:31:38.118413+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:31:52.188595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":719,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'382","reported_seq":1032,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.925493+0000","last_change":"2024-09-19T13:40:40.238081+0000","last_active":"2024-09-19T15:31:17.925493+0000","last_peered":"2024-09-19T15:31:17.925493+0000","last_clean":"2024-09-19T15:31:17.925493+0000","last_became_active":"2024-09-19T13:40:40.237537+0000","last_became_peered":"2024-09-19T13:40:40.237537+0000","last_unstale":"2024-09-19T15:31:17.925493+0000","last_undegraded":"2024-09-19T15:31:17.925493+0000","last_fullsized":"2024-09-19T15:31:17.925493+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:45.292548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58124,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":640,"num_read_kb":1140,"num_write":530,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381450+0000","last_change":"2024-09-19T13:40:42.252696+0000","last_active":"2024-09-19T15:28:12.381450+0000","last_peered":"2024-09-19T15:28:12.381450+0000","last_clean":"2024-09-19T15:28:12.381450+0000","last_became_active":"2024-09-19T13:40:42.251896+0000","last_became_peered":"2024-09-19T13:40:42.251896+0000","last_unstale":"2024-09-19T15:28:12.381450+0000","last_undegraded":"2024-09-19T15:28:12.381450+0000","last_fullsized":"2024-09-19T15:28:12.381450+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:38.583676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'201","reported_seq":1087,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:43.276093+0000","last_change":"2024-09-19T13:40:44.269379+0000","last_active":"2024-09-19T15:29:43.276093+0000","last_peered":"2024-09-19T15:29:43.276093+0000","last_clean":"2024-09-19T15:29:43.276093+0000","last_became_active":"2024-09-19T13:40:44.268710+0000","last_became_peered":"2024-09-19T13:40:44.268710+0000","last_unstale":"2024-09-19T15:29:43.276093+0000","last_undegraded":"2024-09-19T15:29:43.276093+0000","last_fullsized":"2024-09-19T15:29:43.276093+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:25.122775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":655,"num_read_kb":652,"num_write":565,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'581","reported_seq":2263,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:49.326176+0000","last_change":"2024-09-19T13:40:36.218790+0000","last_active":"2024-09-19T15:28:49.326176+0000","last_peered":"2024-09-19T15:28:49.326176+0000","last_clean":"2024-09-19T15:28:49.326176+0000","last_became_active":"2024-09-19T13:40:36.217961+0000","last_became_peered":"2024-09-19T13:40:36.217961+0000","last_unstale":"2024-09-19T15:28:49.326176+0000","last_undegraded":"2024-09-19T15:28:49.326176+0000","last_fullsized":"2024-09-19T15:28:49.326176+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:06.866384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2994,"num_read_kb":2751,"num_write":739,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'286","reported_seq":1084,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.600035+0000","last_change":"2024-09-19T13:40:34.254466+0000","last_active":"2024-09-19T15:28:07.600035+0000","last_peered":"2024-09-19T15:28:07.600035+0000","last_clean":"2024-09-19T15:28:07.600035+0000","last_became_active":"2024-09-19T13:40:34.253708+0000","last_became_peered":"2024-09-19T13:40:34.253708+0000","last_unstale":"2024-09-19T15:28:07.600035+0000","last_undegraded":"2024-09-19T15:28:07.600035+0000","last_fullsized":"2024-09-19T15:28:07.600035+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:37:08.846663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11538842,"num_objects":82,"num_object_clones":0,"num_object_copies":246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":683,"num_read_kb":54804,"num_write":1014,"num_write_kb":28785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.601276+0000","last_change":"2024-09-19T13:40:38.245697+0000","last_active":"2024-09-19T15:28:12.601276+0000","last_peered":"2024-09-19T15:28:12.601276+0000","last_clean":"2024-09-19T15:28:12.601276+0000","last_became_active":"2024-09-19T13:40:38.245018+0000","last_became_peered":"2024-09-19T13:40:38.245018+0000","last_unstale":"2024-09-19T15:28:12.601276+0000","last_undegraded":"2024-09-19T15:28:12.601276+0000","last_fullsized":"2024-09-19T15:28:12.601276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:48.463235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'344","reported_seq":978,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.287171+0000","last_change":"2024-09-19T13:40:40.234381+0000","last_active":"2024-09-19T15:31:18.287171+0000","last_peered":"2024-09-19T15:31:18.287171+0000","last_clean":"2024-09-19T15:31:18.287171+0000","last_became_active":"2024-09-19T13:40:40.229201+0000","last_became_peered":"2024-09-19T13:40:40.229201+0000","last_unstale":"2024-09-19T15:31:18.287171+0000","last_undegraded":"2024-09-19T15:31:18.287171+0000","last_fullsized":"2024-09-19T15:31:18.287171+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:53.097533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54800,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":554,"num_read_kb":1032,"num_write":448,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.395355+0000","last_change":"2024-09-19T13:40:42.247045+0000","last_active":"2024-09-19T15:29:12.395355+0000","last_peered":"2024-09-19T15:29:12.395355+0000","last_clean":"2024-09-19T15:29:12.395355+0000","last_became_active":"2024-09-19T13:40:42.246286+0000","last_became_peered":"2024-09-19T13:40:42.246286+0000","last_unstale":"2024-09-19T15:29:12.395355+0000","last_undegraded":"2024-09-19T15:29:12.395355+0000","last_fullsized":"2024-09-19T15:29:12.395355+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:20:14.165507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'161","reported_seq":725,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.256170+0000","last_change":"2024-09-19T13:40:44.270342+0000","last_active":"2024-09-19T15:31:13.256170+0000","last_peered":"2024-09-19T15:31:13.256170+0000","last_clean":"2024-09-19T15:31:13.256170+0000","last_became_active":"2024-09-19T13:40:44.267428+0000","last_became_peered":"2024-09-19T13:40:44.267428+0000","last_unstale":"2024-09-19T15:31:13.256170+0000","last_undegraded":"2024-09-19T15:31:13.256170+0000","last_fullsized":"2024-09-19T15:31:13.256170+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:14.956268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":325,"num_read_kb":284,"num_write":406,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'372","reported_seq":2097,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.308591+0000","last_change":"2024-09-19T13:40:36.231144+0000","last_active":"2024-09-19T15:29:41.308591+0000","last_peered":"2024-09-19T15:29:41.308591+0000","last_clean":"2024-09-19T15:29:41.308591+0000","last_became_active":"2024-09-19T13:40:36.230842+0000","last_became_peered":"2024-09-19T13:40:36.230842+0000","last_unstale":"2024-09-19T15:29:41.308591+0000","last_undegraded":"2024-09-19T15:29:41.308591+0000","last_fullsized":"2024-09-19T15:29:41.308591+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:13.952447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2340,"num_read_kb":2286,"num_write":408,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'380","reported_seq":1162,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.571339+0000","last_change":"2024-09-19T13:41:05.307783+0000","last_active":"2024-09-19T15:31:40.571339+0000","last_peered":"2024-09-19T15:31:40.571339+0000","last_clean":"2024-09-19T15:31:40.571339+0000","last_became_active":"2024-09-19T13:41:05.307368+0000","last_became_peered":"2024-09-19T13:41:05.307368+0000","last_unstale":"2024-09-19T15:31:40.571339+0000","last_undegraded":"2024-09-19T15:31:40.571339+0000","last_fullsized":"2024-09-19T15:31:40.571339+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:24.705807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":987,"num_read_kb":73584,"num_write":1229,"num_write_kb":59214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381473+0000","last_change":"2024-09-19T13:40:38.245965+0000","last_active":"2024-09-19T15:28:12.381473+0000","last_peered":"2024-09-19T15:28:12.381473+0000","last_clean":"2024-09-19T15:28:12.381473+0000","last_became_active":"2024-09-19T13:40:38.245287+0000","last_became_peered":"2024-09-19T13:40:38.245287+0000","last_unstale":"2024-09-19T15:28:12.381473+0000","last_undegraded":"2024-09-19T15:28:12.381473+0000","last_fullsized":"2024-09-19T15:28:12.381473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:07.416511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'172","reported_seq":758,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.249753+0000","last_change":"2024-09-19T13:40:40.247785+0000","last_active":"2024-09-19T15:31:18.249753+0000","last_peered":"2024-09-19T15:31:18.249753+0000","last_clean":"2024-09-19T15:31:18.249753+0000","last_became_active":"2024-09-19T13:40:40.246680+0000","last_became_peered":"2024-09-19T13:40:40.246680+0000","last_unstale":"2024-09-19T15:31:18.249753+0000","last_undegraded":"2024-09-19T15:31:18.249753+0000","last_fullsized":"2024-09-19T15:31:18.249753+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:04.960514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":223,"num_read_kb":217,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'765","reported_seq":2973,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.158907+0000","last_change":"2024-09-19T13:40:42.253045+0000","last_active":"2024-09-19T15:31:38.158907+0000","last_peered":"2024-09-19T15:31:38.158907+0000","last_clean":"2024-09-19T15:31:38.158907+0000","last_became_active":"2024-09-19T13:40:42.250436+0000","last_became_peered":"2024-09-19T13:40:42.250436+0000","last_unstale":"2024-09-19T15:31:38.158907+0000","last_undegraded":"2024-09-19T15:31:38.158907+0000","last_fullsized":"2024-09-19T15:31:38.158907+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:00.593974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'100","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:27.673954+0000","last_change":"2024-09-19T13:40:44.269427+0000","last_active":"2024-09-19T15:30:27.673954+0000","last_peered":"2024-09-19T15:30:27.673954+0000","last_clean":"2024-09-19T15:30:27.673954+0000","last_became_active":"2024-09-19T13:40:44.268630+0000","last_became_peered":"2024-09-19T13:40:44.268630+0000","last_unstale":"2024-09-19T15:30:27.673954+0000","last_undegraded":"2024-09-19T15:30:27.673954+0000","last_fullsized":"2024-09-19T15:30:27.673954+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:59.722843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":162,"num_read_kb":149,"num_write":244,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'1161","reported_seq":2729,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:39.716195+0000","last_change":"2024-09-19T13:41:05.321007+0000","last_active":"2024-09-19T15:28:39.716195+0000","last_peered":"2024-09-19T15:28:39.716195+0000","last_clean":"2024-09-19T15:28:39.716195+0000","last_became_active":"2024-09-19T13:41:05.320040+0000","last_became_peered":"2024-09-19T13:41:05.320040+0000","last_unstale":"2024-09-19T15:28:39.716195+0000","last_undegraded":"2024-09-19T15:28:39.716195+0000","last_fullsized":"2024-09-19T15:28:39.716195+0000","mapping_epoch":38,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":1100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:24.769399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5194,"num_read_kb":4574,"num_write":1598,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'310","reported_seq":972,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:34.691501+0000","last_change":"2024-09-19T13:40:34.252303+0000","last_active":"2024-09-19T15:28:34.691501+0000","last_peered":"2024-09-19T15:28:34.691501+0000","last_clean":"2024-09-19T15:28:34.691501+0000","last_became_active":"2024-09-19T13:40:34.251475+0000","last_became_peered":"2024-09-19T13:40:34.251475+0000","last_unstale":"2024-09-19T15:28:34.691501+0000","last_undegraded":"2024-09-19T15:28:34.691501+0000","last_fullsized":"2024-09-19T15:28:34.691501+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:25:30.036187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":651958,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":566,"num_read_kb":3575,"num_write":1084,"num_write_kb":19359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.641848+0000","last_change":"2024-09-19T13:40:38.246925+0000","last_active":"2024-09-19T15:28:12.641848+0000","last_peered":"2024-09-19T15:28:12.641848+0000","last_clean":"2024-09-19T15:28:12.641848+0000","last_became_active":"2024-09-19T13:40:38.246205+0000","last_became_peered":"2024-09-19T13:40:38.246205+0000","last_unstale":"2024-09-19T15:28:12.641848+0000","last_undegraded":"2024-09-19T15:28:12.641848+0000","last_fullsized":"2024-09-19T15:28:12.641848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:54.953146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'378","reported_seq":1034,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.313921+0000","last_change":"2024-09-19T13:40:40.242303+0000","last_active":"2024-09-19T15:31:18.313921+0000","last_peered":"2024-09-19T15:31:18.313921+0000","last_clean":"2024-09-19T15:31:18.313921+0000","last_became_active":"2024-09-19T13:40:40.241730+0000","last_became_peered":"2024-09-19T13:40:40.241730+0000","last_unstale":"2024-09-19T15:31:18.313921+0000","last_undegraded":"2024-09-19T15:31:18.313921+0000","last_fullsized":"2024-09-19T15:31:18.313921+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:27.316298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74538,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":595,"num_read_kb":1098,"num_write":464,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:02.165536+0000","last_change":"2024-09-19T13:40:42.240898+0000","last_active":"2024-09-19T15:27:02.165536+0000","last_peered":"2024-09-19T15:27:02.165536+0000","last_clean":"2024-09-19T15:27:02.165536+0000","last_became_active":"2024-09-19T13:40:42.240191+0000","last_became_peered":"2024-09-19T13:40:42.240191+0000","last_unstale":"2024-09-19T15:27:02.165536+0000","last_undegraded":"2024-09-19T15:27:02.165536+0000","last_fullsized":"2024-09-19T15:27:02.165536+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:00.682593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'128","reported_seq":652,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:49.771957+0000","last_change":"2024-09-19T13:40:44.274954+0000","last_active":"2024-09-19T15:29:49.771957+0000","last_peered":"2024-09-19T15:29:49.771957+0000","last_clean":"2024-09-19T15:29:49.771957+0000","last_became_active":"2024-09-19T13:40:44.274449+0000","last_became_peered":"2024-09-19T13:40:44.274449+0000","last_unstale":"2024-09-19T15:29:49.771957+0000","last_undegraded":"2024-09-19T15:29:49.771957+0000","last_fullsized":"2024-09-19T15:29:49.771957+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:28.625729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":153,"num_write":303,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'796","reported_seq":2343,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.600083+0000","last_change":"2024-09-19T13:40:36.231742+0000","last_active":"2024-09-19T15:28:07.600083+0000","last_peered":"2024-09-19T15:28:07.600083+0000","last_clean":"2024-09-19T15:28:07.600083+0000","last_became_active":"2024-09-19T13:40:36.227359+0000","last_became_peered":"2024-09-19T13:40:36.227359+0000","last_unstale":"2024-09-19T15:28:07.600083+0000","last_undegraded":"2024-09-19T15:28:07.600083+0000","last_fullsized":"2024-09-19T15:28:07.600083+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:05:00.421649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3854,"num_read_kb":3454,"num_write":1058,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'352","reported_seq":1109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.619557+0000","last_change":"2024-09-19T13:41:05.314078+0000","last_active":"2024-09-19T15:28:07.619557+0000","last_peered":"2024-09-19T15:28:07.619557+0000","last_clean":"2024-09-19T15:28:07.619557+0000","last_became_active":"2024-09-19T13:41:05.313209+0000","last_became_peered":"2024-09-19T13:41:05.313209+0000","last_unstale":"2024-09-19T15:28:07.619557+0000","last_undegraded":"2024-09-19T15:28:07.619557+0000","last_fullsized":"2024-09-19T15:28:07.619557+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:11.443410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6789559,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":704,"num_read_kb":102227,"num_write":1351,"num_write_kb":49987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.620697+0000","last_change":"2024-09-19T13:40:38.230747+0000","last_active":"2024-09-19T15:28:12.620697+0000","last_peered":"2024-09-19T15:28:12.620697+0000","last_clean":"2024-09-19T15:28:12.620697+0000","last_became_active":"2024-09-19T13:40:38.229929+0000","last_became_peered":"2024-09-19T13:40:38.229929+0000","last_unstale":"2024-09-19T15:28:12.620697+0000","last_undegraded":"2024-09-19T15:28:12.620697+0000","last_fullsized":"2024-09-19T15:28:12.620697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:58:25.811713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'302","reported_seq":913,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.549300+0000","last_change":"2024-09-19T13:40:40.241834+0000","last_active":"2024-09-19T15:31:40.549300+0000","last_peered":"2024-09-19T15:31:40.549300+0000","last_clean":"2024-09-19T15:31:40.549300+0000","last_became_active":"2024-09-19T13:40:40.241404+0000","last_became_peered":"2024-09-19T13:40:40.241404+0000","last_unstale":"2024-09-19T15:31:40.549300+0000","last_undegraded":"2024-09-19T15:31:40.549300+0000","last_fullsized":"2024-09-19T15:31:40.549300+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:41.176371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45708,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":1069,"num_write":394,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:27.572162+0000","last_change":"2024-09-19T13:40:42.254516+0000","last_active":"2024-09-19T15:27:27.572162+0000","last_peered":"2024-09-19T15:27:27.572162+0000","last_clean":"2024-09-19T15:27:27.572162+0000","last_became_active":"2024-09-19T13:40:42.251413+0000","last_became_peered":"2024-09-19T13:40:42.251413+0000","last_unstale":"2024-09-19T15:27:27.572162+0000","last_undegraded":"2024-09-19T15:27:27.572162+0000","last_fullsized":"2024-09-19T15:27:27.572162+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:44:42.558167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'161","reported_seq":716,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.091208+0000","last_change":"2024-09-19T13:40:44.278568+0000","last_active":"2024-09-19T15:29:50.091208+0000","last_peered":"2024-09-19T15:29:50.091208+0000","last_clean":"2024-09-19T15:29:50.091208+0000","last_became_active":"2024-09-19T13:40:44.277774+0000","last_became_peered":"2024-09-19T13:40:44.277774+0000","last_unstale":"2024-09-19T15:29:50.091208+0000","last_undegraded":"2024-09-19T15:29:50.091208+0000","last_fullsized":"2024-09-19T15:29:50.091208+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:30.389728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":980,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216,"num_read_kb":207,"num_write":371,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'464","reported_seq":2234,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.261421+0000","last_change":"2024-09-19T13:40:36.223086+0000","last_active":"2024-09-19T15:31:12.261421+0000","last_peered":"2024-09-19T15:31:12.261421+0000","last_clean":"2024-09-19T15:31:12.261421+0000","last_became_active":"2024-09-19T13:40:36.222632+0000","last_became_peered":"2024-09-19T13:40:36.222632+0000","last_unstale":"2024-09-19T15:31:12.261421+0000","last_undegraded":"2024-09-19T15:31:12.261421+0000","last_fullsized":"2024-09-19T15:31:12.261421+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:02.744559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2809,"num_read_kb":2663,"num_write":534,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'322","reported_seq":1024,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:48.241025+0000","last_change":"2024-09-19T13:40:34.258460+0000","last_active":"2024-09-19T15:28:48.241025+0000","last_peered":"2024-09-19T15:28:48.241025+0000","last_clean":"2024-09-19T15:28:48.241025+0000","last_became_active":"2024-09-19T13:40:34.258068+0000","last_became_peered":"2024-09-19T13:40:34.258068+0000","last_unstale":"2024-09-19T15:28:48.241025+0000","last_undegraded":"2024-09-19T15:28:48.241025+0000","last_fullsized":"2024-09-19T15:28:48.241025+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:06:27.239604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16694649,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":691,"num_read_kb":11973,"num_write":1120,"num_write_kb":32337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:02.584884+0000","last_change":"2024-09-19T13:40:38.240655+0000","last_active":"2024-09-19T15:27:02.584884+0000","last_peered":"2024-09-19T15:27:02.584884+0000","last_clean":"2024-09-19T15:27:02.584884+0000","last_became_active":"2024-09-19T13:40:38.236724+0000","last_became_peered":"2024-09-19T13:40:38.236724+0000","last_unstale":"2024-09-19T15:27:02.584884+0000","last_undegraded":"2024-09-19T15:27:02.584884+0000","last_fullsized":"2024-09-19T15:27:02.584884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:37:16.998791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'271","reported_seq":860,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.600944+0000","last_change":"2024-09-19T13:40:40.223389+0000","last_active":"2024-09-19T15:31:17.600944+0000","last_peered":"2024-09-19T15:31:17.600944+0000","last_clean":"2024-09-19T15:31:17.600944+0000","last_became_active":"2024-09-19T13:40:40.222807+0000","last_became_peered":"2024-09-19T13:40:40.222807+0000","last_unstale":"2024-09-19T15:31:17.600944+0000","last_undegraded":"2024-09-19T15:31:17.600944+0000","last_fullsized":"2024-09-19T15:31:17.600944+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:53.228422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60899,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":460,"num_read_kb":996,"num_write":388,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.601222+0000","last_change":"2024-09-19T13:40:42.251870+0000","last_active":"2024-09-19T15:28:12.601222+0000","last_peered":"2024-09-19T15:28:12.601222+0000","last_clean":"2024-09-19T15:28:12.601222+0000","last_became_active":"2024-09-19T13:40:42.251057+0000","last_became_peered":"2024-09-19T13:40:42.251057+0000","last_unstale":"2024-09-19T15:28:12.601222+0000","last_undegraded":"2024-09-19T15:28:12.601222+0000","last_fullsized":"2024-09-19T15:28:12.601222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:37.359054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'143","reported_seq":1274,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:42.301571+0000","last_change":"2024-09-19T13:40:44.271381+0000","last_active":"2024-09-19T15:29:42.301571+0000","last_peered":"2024-09-19T15:29:42.301571+0000","last_clean":"2024-09-19T15:29:42.301571+0000","last_became_active":"2024-09-19T13:40:44.270656+0000","last_became_peered":"2024-09-19T13:40:44.270656+0000","last_unstale":"2024-09-19T15:29:42.301571+0000","last_undegraded":"2024-09-19T15:29:42.301571+0000","last_fullsized":"2024-09-19T15:29:42.301571+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:12:45.652710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":816,"num_read_kb":810,"num_write":350,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'465","reported_seq":1994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:39.716302+0000","last_change":"2024-09-19T13:40:36.218077+0000","last_active":"2024-09-19T15:28:39.716302+0000","last_peered":"2024-09-19T15:28:39.716302+0000","last_clean":"2024-09-19T15:28:39.716302+0000","last_became_active":"2024-09-19T13:40:36.217230+0000","last_became_peered":"2024-09-19T13:40:36.217230+0000","last_unstale":"2024-09-19T15:28:39.716302+0000","last_undegraded":"2024-09-19T15:28:39.716302+0000","last_fullsized":"2024-09-19T15:28:39.716302+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:27.690091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2437,"num_read_kb":2267,"num_write":569,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'335","reported_seq":993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.581905+0000","last_change":"2024-09-19T13:40:34.258755+0000","last_active":"2024-09-19T15:31:40.581905+0000","last_peered":"2024-09-19T15:31:40.581905+0000","last_clean":"2024-09-19T15:31:40.581905+0000","last_became_active":"2024-09-19T13:40:34.258416+0000","last_became_peered":"2024-09-19T13:40:34.258416+0000","last_unstale":"2024-09-19T15:31:40.581905+0000","last_undegraded":"2024-09-19T15:31:40.581905+0000","last_fullsized":"2024-09-19T15:31:40.581905+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:47.238199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":559,"num_read_kb":6695,"num_write":1052,"num_write_kb":15020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.371514+0000","last_change":"2024-09-19T13:40:38.217596+0000","last_active":"2024-09-19T15:27:32.371514+0000","last_peered":"2024-09-19T15:27:32.371514+0000","last_clean":"2024-09-19T15:27:32.371514+0000","last_became_active":"2024-09-19T13:40:38.214571+0000","last_became_peered":"2024-09-19T13:40:38.214571+0000","last_unstale":"2024-09-19T15:27:32.371514+0000","last_undegraded":"2024-09-19T15:27:32.371514+0000","last_fullsized":"2024-09-19T15:27:32.371514+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:52.834683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'345","reported_seq":969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.731527+0000","last_change":"2024-09-19T13:40:40.248984+0000","last_active":"2024-09-19T15:31:17.731527+0000","last_peered":"2024-09-19T15:31:17.731527+0000","last_clean":"2024-09-19T15:31:17.731527+0000","last_became_active":"2024-09-19T13:40:40.245368+0000","last_became_peered":"2024-09-19T13:40:40.245368+0000","last_unstale":"2024-09-19T15:31:17.731527+0000","last_undegraded":"2024-09-19T15:31:17.731527+0000","last_fullsized":"2024-09-19T15:31:17.731527+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:10.651187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57046,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":558,"num_read_kb":1054,"num_write":446,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.180073+0000","last_change":"2024-09-19T13:40:42.240218+0000","last_active":"2024-09-19T15:28:12.180073+0000","last_peered":"2024-09-19T15:28:12.180073+0000","last_clean":"2024-09-19T15:28:12.180073+0000","last_became_active":"2024-09-19T13:40:42.239391+0000","last_became_peered":"2024-09-19T13:40:42.239391+0000","last_unstale":"2024-09-19T15:28:12.180073+0000","last_undegraded":"2024-09-19T15:28:12.180073+0000","last_fullsized":"2024-09-19T15:28:12.180073+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:58.943534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'128","reported_seq":656,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.238755+0000","last_change":"2024-09-19T13:40:44.249845+0000","last_active":"2024-09-19T15:31:12.238755+0000","last_peered":"2024-09-19T15:31:12.238755+0000","last_clean":"2024-09-19T15:31:12.238755+0000","last_became_active":"2024-09-19T13:40:44.249201+0000","last_became_peered":"2024-09-19T13:40:44.249201+0000","last_unstale":"2024-09-19T15:31:12.238755+0000","last_undegraded":"2024-09-19T15:31:12.238755+0000","last_fullsized":"2024-09-19T15:31:12.238755+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:40.297816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":210,"num_read_kb":190,"num_write":320,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'403","reported_seq":2077,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391896+0000","last_change":"2024-09-19T13:40:36.226270+0000","last_active":"2024-09-19T15:28:57.391896+0000","last_peered":"2024-09-19T15:28:57.391896+0000","last_clean":"2024-09-19T15:28:57.391896+0000","last_became_active":"2024-09-19T13:40:36.225885+0000","last_became_peered":"2024-09-19T13:40:36.225885+0000","last_unstale":"2024-09-19T15:28:57.391896+0000","last_undegraded":"2024-09-19T15:28:57.391896+0000","last_fullsized":"2024-09-19T15:28:57.391896+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:53.469735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2307,"num_read_kb":2225,"num_write":450,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'329","reported_seq":962,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.532480+0000","last_change":"2024-09-19T13:40:34.262660+0000","last_active":"2024-09-19T15:31:40.532480+0000","last_peered":"2024-09-19T15:31:40.532480+0000","last_clean":"2024-09-19T15:31:40.532480+0000","last_became_active":"2024-09-19T13:40:34.249068+0000","last_became_peered":"2024-09-19T13:40:34.249068+0000","last_unstale":"2024-09-19T15:31:40.532480+0000","last_undegraded":"2024-09-19T15:31:40.532480+0000","last_fullsized":"2024-09-19T15:31:40.532480+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:53.622353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":27093,"num_write":1002,"num_write_kb":27581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"268'459","reported_seq":2102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.313338+0000","last_change":"2024-09-19T13:40:36.222782+0000","last_active":"2024-09-19T15:29:41.313338+0000","last_peered":"2024-09-19T15:29:41.313338+0000","last_clean":"2024-09-19T15:29:41.313338+0000","last_became_active":"2024-09-19T13:40:36.220569+0000","last_became_peered":"2024-09-19T13:40:36.220569+0000","last_unstale":"2024-09-19T15:29:41.313338+0000","last_undegraded":"2024-09-19T15:29:41.313338+0000","last_fullsized":"2024-09-19T15:29:41.313338+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:10:08.215249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2535,"num_read_kb":2389,"num_write":539,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"268'416","reported_seq":1132,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.527496+0000","last_change":"2024-09-19T13:40:34.239840+0000","last_active":"2024-09-19T15:31:40.527496+0000","last_peered":"2024-09-19T15:31:40.527496+0000","last_clean":"2024-09-19T15:31:40.527496+0000","last_became_active":"2024-09-19T13:40:34.239357+0000","last_became_peered":"2024-09-19T13:40:34.239357+0000","last_unstale":"2024-09-19T15:31:40.527496+0000","last_undegraded":"2024-09-19T15:31:40.527496+0000","last_fullsized":"2024-09-19T15:31:40.527496+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:11:55.800088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":787,"num_read_kb":92890,"num_write":1403,"num_write_kb":63384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'594","reported_seq":2305,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.631054+0000","last_change":"2024-09-19T13:40:36.242232+0000","last_active":"2024-09-19T15:28:57.631054+0000","last_peered":"2024-09-19T15:28:57.631054+0000","last_clean":"2024-09-19T15:28:57.631054+0000","last_became_active":"2024-09-19T13:40:36.241566+0000","last_became_peered":"2024-09-19T13:40:36.241566+0000","last_unstale":"2024-09-19T15:28:57.631054+0000","last_undegraded":"2024-09-19T15:28:57.631054+0000","last_fullsized":"2024-09-19T15:28:57.631054+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":500,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:03.964274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3019,"num_read_kb":2776,"num_write":751,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'304","reported_seq":985,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.630953+0000","last_change":"2024-09-19T13:40:34.227009+0000","last_active":"2024-09-19T15:28:57.630953+0000","last_peered":"2024-09-19T15:28:57.630953+0000","last_clean":"2024-09-19T15:28:57.630953+0000","last_became_active":"2024-09-19T13:40:34.221057+0000","last_became_peered":"2024-09-19T13:40:34.221057+0000","last_unstale":"2024-09-19T15:28:57.630953+0000","last_undegraded":"2024-09-19T15:28:57.630953+0000","last_fullsized":"2024-09-19T15:28:57.630953+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:25:54.224688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":339543,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":614,"num_read_kb":11742,"num_write":1076,"num_write_kb":23593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'495","reported_seq":2263,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.311749+0000","last_change":"2024-09-19T13:40:36.238558+0000","last_active":"2024-09-19T15:29:41.311749+0000","last_peered":"2024-09-19T15:29:41.311749+0000","last_clean":"2024-09-19T15:29:41.311749+0000","last_became_active":"2024-09-19T13:40:36.238166+0000","last_became_peered":"2024-09-19T13:40:36.238166+0000","last_unstale":"2024-09-19T15:29:41.311749+0000","last_undegraded":"2024-09-19T15:29:41.311749+0000","last_fullsized":"2024-09-19T15:29:41.311749+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:30:49.066869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2902,"num_read_kb":2744,"num_write":591,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'345","reported_seq":1059,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.531177+0000","last_change":"2024-09-19T13:40:34.232529+0000","last_active":"2024-09-19T15:31:40.531177+0000","last_peered":"2024-09-19T15:31:40.531177+0000","last_clean":"2024-09-19T15:31:40.531177+0000","last_became_active":"2024-09-19T13:40:34.232099+0000","last_became_peered":"2024-09-19T13:40:34.232099+0000","last_unstale":"2024-09-19T15:31:40.531177+0000","last_undegraded":"2024-09-19T15:31:40.531177+0000","last_fullsized":"2024-09-19T15:31:40.531177+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:31.553740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136873,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":758,"num_read_kb":12572,"num_write":1035,"num_write_kb":46357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"268'463","reported_seq":2045,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:08.245703+0000","last_change":"2024-09-19T13:40:36.239180+0000","last_active":"2024-09-19T15:29:08.245703+0000","last_peered":"2024-09-19T15:29:08.245703+0000","last_clean":"2024-09-19T15:29:08.245703+0000","last_became_active":"2024-09-19T13:40:36.238644+0000","last_became_peered":"2024-09-19T13:40:36.238644+0000","last_unstale":"2024-09-19T15:29:08.245703+0000","last_undegraded":"2024-09-19T15:29:08.245703+0000","last_fullsized":"2024-09-19T15:29:08.245703+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:20.371624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2315,"num_read_kb":2185,"num_write":554,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'335","reported_seq":1047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:58.243409+0000","last_change":"2024-09-19T13:40:34.249999+0000","last_active":"2024-09-19T15:28:58.243409+0000","last_peered":"2024-09-19T15:28:58.243409+0000","last_clean":"2024-09-19T15:28:58.243409+0000","last_became_active":"2024-09-19T13:40:34.249600+0000","last_became_peered":"2024-09-19T13:40:34.249600+0000","last_unstale":"2024-09-19T15:28:58.243409+0000","last_undegraded":"2024-09-19T15:28:58.243409+0000","last_fullsized":"2024-09-19T15:28:58.243409+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:21.988391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18897188,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":652,"num_read_kb":53970,"num_write":1297,"num_write_kb":53250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'832","reported_seq":2486,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.611644+0000","last_change":"2024-09-19T13:40:36.217498+0000","last_active":"2024-09-19T15:28:57.611644+0000","last_peered":"2024-09-19T15:28:57.611644+0000","last_clean":"2024-09-19T15:28:57.611644+0000","last_became_active":"2024-09-19T13:40:36.216697+0000","last_became_peered":"2024-09-19T13:40:36.216697+0000","last_unstale":"2024-09-19T15:28:57.611644+0000","last_undegraded":"2024-09-19T15:28:57.611644+0000","last_fullsized":"2024-09-19T15:28:57.611644+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:18:43.576589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4198,"num_read_kb":3766,"num_write":1106,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'330","reported_seq":1026,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.506919+0000","last_change":"2024-09-19T13:40:34.217279+0000","last_active":"2024-09-19T15:31:40.506919+0000","last_peered":"2024-09-19T15:31:40.506919+0000","last_clean":"2024-09-19T15:31:40.506919+0000","last_became_active":"2024-09-19T13:40:34.216774+0000","last_became_peered":"2024-09-19T13:40:34.216774+0000","last_unstale":"2024-09-19T15:31:40.506919+0000","last_undegraded":"2024-09-19T15:31:40.506919+0000","last_fullsized":"2024-09-19T15:31:40.506919+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:06.986984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":651,"num_read_kb":47831,"num_write":981,"num_write_kb":20035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'563","reported_seq":2253,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.655516+0000","last_change":"2024-09-19T13:40:36.220200+0000","last_active":"2024-09-19T15:29:50.655516+0000","last_peered":"2024-09-19T15:29:50.655516+0000","last_clean":"2024-09-19T15:29:50.655516+0000","last_became_active":"2024-09-19T13:40:36.218090+0000","last_became_peered":"2024-09-19T13:40:36.218090+0000","last_unstale":"2024-09-19T15:29:50.655516+0000","last_undegraded":"2024-09-19T15:29:50.655516+0000","last_fullsized":"2024-09-19T15:29:50.655516+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:34:01.490693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2933,"num_read_kb":2699,"num_write":698,"num_write_kb":201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'354","reported_seq":1135,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.530130+0000","last_change":"2024-09-19T13:40:34.273323+0000","last_active":"2024-09-19T15:31:40.530130+0000","last_peered":"2024-09-19T15:31:40.530130+0000","last_clean":"2024-09-19T15:31:40.530130+0000","last_became_active":"2024-09-19T13:40:34.272629+0000","last_became_peered":"2024-09-19T13:40:34.272629+0000","last_unstale":"2024-09-19T15:31:40.530130+0000","last_undegraded":"2024-09-19T15:31:40.530130+0000","last_fullsized":"2024-09-19T15:31:40.530130+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:34.984552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174644,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":935,"num_read_kb":42229,"num_write":1199,"num_write_kb":17971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'338","reported_seq":1780,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.312852+0000","last_change":"2024-09-19T13:40:36.225078+0000","last_active":"2024-09-19T15:29:41.312852+0000","last_peered":"2024-09-19T15:29:41.312852+0000","last_clean":"2024-09-19T15:29:41.312852+0000","last_became_active":"2024-09-19T13:40:36.224228+0000","last_became_peered":"2024-09-19T13:40:36.224228+0000","last_unstale":"2024-09-19T15:29:41.312852+0000","last_undegraded":"2024-09-19T15:29:41.312852+0000","last_fullsized":"2024-09-19T15:29:41.312852+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:01.743464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1855,"num_read_kb":1782,"num_write":368,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'316","reported_seq":1072,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:58.243579+0000","last_change":"2024-09-19T13:40:34.245539+0000","last_active":"2024-09-19T15:28:58.243579+0000","last_peered":"2024-09-19T15:28:58.243579+0000","last_clean":"2024-09-19T15:28:58.243579+0000","last_became_active":"2024-09-19T13:40:34.245197+0000","last_became_peered":"2024-09-19T13:40:34.245197+0000","last_unstale":"2024-09-19T15:28:58.243579+0000","last_undegraded":"2024-09-19T15:28:58.243579+0000","last_fullsized":"2024-09-19T15:28:58.243579+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:24:09.091484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13009608,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":681,"num_read_kb":129992,"num_write":1154,"num_write_kb":46426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"268'494","reported_seq":2038,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.313857+0000","last_change":"2024-09-19T13:40:36.227530+0000","last_active":"2024-09-19T15:29:41.313857+0000","last_peered":"2024-09-19T15:29:41.313857+0000","last_clean":"2024-09-19T15:29:41.313857+0000","last_became_active":"2024-09-19T13:40:36.226839+0000","last_became_peered":"2024-09-19T13:40:36.226839+0000","last_unstale":"2024-09-19T15:29:41.313857+0000","last_undegraded":"2024-09-19T15:29:41.313857+0000","last_fullsized":"2024-09-19T15:29:41.313857+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:28.265909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2632,"num_read_kb":2421,"num_write":626,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'288","reported_seq":1104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:22.636764+0000","last_change":"2024-09-19T13:40:34.229368+0000","last_active":"2024-09-19T15:29:22.636764+0000","last_peered":"2024-09-19T15:29:22.636764+0000","last_clean":"2024-09-19T15:29:22.636764+0000","last_became_active":"2024-09-19T13:40:34.228472+0000","last_became_peered":"2024-09-19T13:40:34.228472+0000","last_unstale":"2024-09-19T15:29:22.636764+0000","last_undegraded":"2024-09-19T15:29:22.636764+0000","last_fullsized":"2024-09-19T15:29:22.636764+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:51.349525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13958374,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":1059,"num_read_kb":37188,"num_write":1152,"num_write_kb":31649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'800","reported_seq":2500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.280835+0000","last_change":"2024-09-19T13:40:36.219439+0000","last_active":"2024-09-19T15:31:12.280835+0000","last_peered":"2024-09-19T15:31:12.280835+0000","last_clean":"2024-09-19T15:31:12.280835+0000","last_became_active":"2024-09-19T13:40:36.217870+0000","last_became_peered":"2024-09-19T13:40:36.217870+0000","last_unstale":"2024-09-19T15:31:12.280835+0000","last_undegraded":"2024-09-19T15:31:12.280835+0000","last_fullsized":"2024-09-19T15:31:12.280835+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:00:58.023208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3954,"num_read_kb":3588,"num_write":1044,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'308","reported_seq":1000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.584810+0000","last_change":"2024-09-19T13:41:05.311322+0000","last_active":"2024-09-19T15:31:40.584810+0000","last_peered":"2024-09-19T15:31:40.584810+0000","last_clean":"2024-09-19T15:31:40.584810+0000","last_became_active":"2024-09-19T13:41:05.310802+0000","last_became_peered":"2024-09-19T13:41:05.310802+0000","last_unstale":"2024-09-19T15:31:40.584810+0000","last_undegraded":"2024-09-19T15:31:40.584810+0000","last_fullsized":"2024-09-19T15:31:40.584810+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:42.603416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136937,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":757,"num_read_kb":21770,"num_write":969,"num_write_kb":19448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"268'360","reported_seq":1959,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.653018+0000","last_change":"2024-09-19T13:40:36.216178+0000","last_active":"2024-09-19T15:29:50.653018+0000","last_peered":"2024-09-19T15:29:50.653018+0000","last_clean":"2024-09-19T15:29:50.653018+0000","last_became_active":"2024-09-19T13:40:36.215821+0000","last_became_peered":"2024-09-19T13:40:36.215821+0000","last_unstale":"2024-09-19T15:29:50.653018+0000","last_undegraded":"2024-09-19T15:29:50.653018+0000","last_fullsized":"2024-09-19T15:29:50.653018+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:38:26.917147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2112,"num_read_kb":2049,"num_write":394,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'393","reported_seq":1128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.626248+0000","last_change":"2024-09-19T13:40:34.262686+0000","last_active":"2024-09-19T15:28:37.626248+0000","last_peered":"2024-09-19T15:28:37.626248+0000","last_clean":"2024-09-19T15:28:37.626248+0000","last_became_active":"2024-09-19T13:40:34.261812+0000","last_became_peered":"2024-09-19T13:40:34.261812+0000","last_unstale":"2024-09-19T15:28:37.626248+0000","last_undegraded":"2024-09-19T15:28:37.626248+0000","last_fullsized":"2024-09-19T15:28:37.626248+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:29.120216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8078291,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":878,"num_read_kb":21060,"num_write":1181,"num_write_kb":41159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'746","reported_seq":2331,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.606887+0000","last_change":"2024-09-19T13:40:36.217355+0000","last_active":"2024-09-19T15:28:37.606887+0000","last_peered":"2024-09-19T15:28:37.606887+0000","last_clean":"2024-09-19T15:28:37.606887+0000","last_became_active":"2024-09-19T13:40:36.216597+0000","last_became_peered":"2024-09-19T13:40:36.216597+0000","last_unstale":"2024-09-19T15:28:37.606887+0000","last_undegraded":"2024-09-19T15:28:37.606887+0000","last_fullsized":"2024-09-19T15:28:37.606887+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:59:18.319568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3535,"num_read_kb":3206,"num_write":942,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'389","reported_seq":1096,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.588905+0000","last_change":"2024-09-19T13:40:34.255731+0000","last_active":"2024-09-19T15:31:40.588905+0000","last_peered":"2024-09-19T15:31:40.588905+0000","last_clean":"2024-09-19T15:31:40.588905+0000","last_became_active":"2024-09-19T13:40:34.255374+0000","last_became_peered":"2024-09-19T13:40:34.255374+0000","last_unstale":"2024-09-19T15:31:40.588905+0000","last_undegraded":"2024-09-19T15:31:40.588905+0000","last_fullsized":"2024-09-19T15:31:40.588905+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:19:13.519227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":672,"num_read_kb":82615,"num_write":1215,"num_write_kb":54973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'1055","reported_seq":2691,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.652822+0000","last_change":"2024-09-19T13:40:36.239660+0000","last_active":"2024-09-19T15:29:50.652822+0000","last_peered":"2024-09-19T15:29:50.652822+0000","last_clean":"2024-09-19T15:29:50.652822+0000","last_became_active":"2024-09-19T13:40:36.238907+0000","last_became_peered":"2024-09-19T13:40:36.238907+0000","last_unstale":"2024-09-19T15:29:50.652822+0000","last_undegraded":"2024-09-19T15:29:50.652822+0000","last_fullsized":"2024-09-19T15:29:50.652822+0000","mapping_epoch":27,"log_start":"268'1000","ondisk_log_start":"268'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1000,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:58:06.626307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5049,"num_read_kb":4427,"num_write":1568,"num_write_kb":756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'420","reported_seq":1097,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.506851+0000","last_change":"2024-09-19T13:40:34.273536+0000","last_active":"2024-09-19T15:31:40.506851+0000","last_peered":"2024-09-19T15:31:40.506851+0000","last_clean":"2024-09-19T15:31:40.506851+0000","last_became_active":"2024-09-19T13:40:34.272618+0000","last_became_peered":"2024-09-19T13:40:34.272618+0000","last_unstale":"2024-09-19T15:31:40.506851+0000","last_undegraded":"2024-09-19T15:31:40.506851+0000","last_fullsized":"2024-09-19T15:31:40.506851+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:56:58.613614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":788,"num_read_kb":25154,"num_write":1353,"num_write_kb":33238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'500","reported_seq":2189,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.257325+0000","last_change":"2024-09-19T13:40:36.227186+0000","last_active":"2024-09-19T15:31:12.257325+0000","last_peered":"2024-09-19T15:31:12.257325+0000","last_clean":"2024-09-19T15:31:12.257325+0000","last_became_active":"2024-09-19T13:40:36.226572+0000","last_became_peered":"2024-09-19T13:40:36.226572+0000","last_unstale":"2024-09-19T15:31:12.257325+0000","last_undegraded":"2024-09-19T15:31:12.257325+0000","last_fullsized":"2024-09-19T15:31:12.257325+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:15.302809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2633,"num_read_kb":2478,"num_write":570,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'373","reported_seq":1128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.654080+0000","last_change":"2024-09-19T13:40:34.276063+0000","last_active":"2024-09-19T15:29:02.654080+0000","last_peered":"2024-09-19T15:29:02.654080+0000","last_clean":"2024-09-19T15:29:02.654080+0000","last_became_active":"2024-09-19T13:40:34.274523+0000","last_became_peered":"2024-09-19T13:40:34.274523+0000","last_unstale":"2024-09-19T15:29:02.654080+0000","last_undegraded":"2024-09-19T15:29:02.654080+0000","last_fullsized":"2024-09-19T15:29:02.654080+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:32.241517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31527398,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":810,"num_read_kb":117453,"num_write":1286,"num_write_kb":54900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"268'906","reported_seq":2407,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.374609+0000","last_change":"2024-09-19T13:40:36.221889+0000","last_active":"2024-09-19T15:29:48.374609+0000","last_peered":"2024-09-19T15:29:48.374609+0000","last_clean":"2024-09-19T15:29:48.374609+0000","last_became_active":"2024-09-19T13:40:36.219017+0000","last_became_peered":"2024-09-19T13:40:36.219017+0000","last_unstale":"2024-09-19T15:29:48.374609+0000","last_undegraded":"2024-09-19T15:29:48.374609+0000","last_fullsized":"2024-09-19T15:29:48.374609+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":800,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:53.854378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5981,"num_read_kb":5463,"num_write":1432,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'347","reported_seq":1024,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.583101+0000","last_change":"2024-09-19T13:40:34.258686+0000","last_active":"2024-09-19T15:31:40.583101+0000","last_peered":"2024-09-19T15:31:40.583101+0000","last_clean":"2024-09-19T15:31:40.583101+0000","last_became_active":"2024-09-19T13:40:34.258251+0000","last_became_peered":"2024-09-19T13:40:34.258251+0000","last_unstale":"2024-09-19T15:31:40.583101+0000","last_undegraded":"2024-09-19T15:31:40.583101+0000","last_fullsized":"2024-09-19T15:31:40.583101+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:47.902849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":664,"num_read_kb":8565,"num_write":1177,"num_write_kb":30274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'817","reported_seq":2512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.331001+0000","last_change":"2024-09-19T13:40:36.236629+0000","last_active":"2024-09-19T15:31:12.331001+0000","last_peered":"2024-09-19T15:31:12.331001+0000","last_clean":"2024-09-19T15:31:12.331001+0000","last_became_active":"2024-09-19T13:40:36.234463+0000","last_became_peered":"2024-09-19T13:40:36.234463+0000","last_unstale":"2024-09-19T15:31:12.331001+0000","last_undegraded":"2024-09-19T15:31:12.331001+0000","last_fullsized":"2024-09-19T15:31:12.331001+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:20.810918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4113,"num_read_kb":3717,"num_write":1084,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'272","reported_seq":933,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:03.359481+0000","last_change":"2024-09-19T13:40:34.258670+0000","last_active":"2024-09-19T15:31:03.359481+0000","last_peered":"2024-09-19T15:31:03.359481+0000","last_clean":"2024-09-19T15:31:03.359481+0000","last_became_active":"2024-09-19T13:40:34.257895+0000","last_became_peered":"2024-09-19T13:40:34.257895+0000","last_unstale":"2024-09-19T15:31:03.359481+0000","last_undegraded":"2024-09-19T15:31:03.359481+0000","last_fullsized":"2024-09-19T15:31:03.359481+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:39:05.564293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5892898,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":556,"num_read_kb":2702,"num_write":1030,"num_write_kb":37833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'304","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:01.405523+0000","last_change":"2024-09-19T13:41:05.314325+0000","last_active":"2024-09-19T15:31:01.405523+0000","last_peered":"2024-09-19T15:31:01.405523+0000","last_clean":"2024-09-19T15:31:01.405523+0000","last_became_active":"2024-09-19T13:41:05.313139+0000","last_became_peered":"2024-09-19T13:41:05.313139+0000","last_unstale":"2024-09-19T15:31:01.405523+0000","last_undegraded":"2024-09-19T15:31:01.405523+0000","last_fullsized":"2024-09-19T15:31:01.405523+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:38.914445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5266270,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":575,"num_read_kb":5598,"num_write":1087,"num_write_kb":52319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'584","reported_seq":2285,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.253632+0000","last_change":"2024-09-19T13:40:36.225847+0000","last_active":"2024-09-19T15:31:12.253632+0000","last_peered":"2024-09-19T15:31:12.253632+0000","last_clean":"2024-09-19T15:31:12.253632+0000","last_became_active":"2024-09-19T13:40:36.225131+0000","last_became_peered":"2024-09-19T13:40:36.225131+0000","last_unstale":"2024-09-19T15:31:12.253632+0000","last_undegraded":"2024-09-19T15:31:12.253632+0000","last_fullsized":"2024-09-19T15:31:12.253632+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:19.360510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3409,"num_read_kb":3161,"num_write":806,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'423","reported_seq":1185,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.582951+0000","last_change":"2024-09-19T13:40:34.252937+0000","last_active":"2024-09-19T15:31:40.582951+0000","last_peered":"2024-09-19T15:31:40.582951+0000","last_clean":"2024-09-19T15:31:40.582951+0000","last_became_active":"2024-09-19T13:40:34.252585+0000","last_became_peered":"2024-09-19T13:40:34.252585+0000","last_unstale":"2024-09-19T15:31:40.582951+0000","last_undegraded":"2024-09-19T15:31:40.582951+0000","last_fullsized":"2024-09-19T15:31:40.582951+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:29.120216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1089,"num_read_kb":22295,"num_write":1244,"num_write_kb":33627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'492","reported_seq":2098,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:41.711923+0000","last_change":"2024-09-19T13:40:36.233305+0000","last_active":"2024-09-19T15:27:41.711923+0000","last_peered":"2024-09-19T15:27:41.711923+0000","last_clean":"2024-09-19T15:27:41.711923+0000","last_became_active":"2024-09-19T13:40:36.232695+0000","last_became_peered":"2024-09-19T13:40:36.232695+0000","last_unstale":"2024-09-19T15:27:41.711923+0000","last_undegraded":"2024-09-19T15:27:41.711923+0000","last_fullsized":"2024-09-19T15:27:41.711923+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:37:22.928402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2752,"num_read_kb":2570,"num_write":600,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10865,"num_read_kb":9021,"num_write":3118,"num_write_kb":1011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1008,"ondisk_log_size":1008,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14601,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":16485,"num_read_kb":16147,"num_write":17047,"num_write_kb":4982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":29202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1794,"ondisk_log_size":1794,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":575,"ondisk_log_size":575,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1817702,"num_objects":200,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":20812,"num_read_kb":38233,"num_write":17509,"num_write_kb":12560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2068480,"data_stored":1640938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1968,"ondisk_log_size":1968,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2388,"num_read_kb":2847,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":220859,"num_read_kb":201873,"num_write":56069,"num_write_kb":19197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4108,"ondisk_log_size":4108,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":327464381,"num_objects":2618,"num_object_clones":0,"num_object_copies":7854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2618,"num_whiteouts":0,"num_read":42062,"num_read_kb":2347928,"num_write":70623,"num_write_kb":2178675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":492261376,"data_stored":492261376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4190,"ondisk_log_size":4190,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":70887377,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":129,"num_read_kb":215739,"num_write":144,"num_write_kb":136883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":96055296,"data_stored":96053201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":42575825,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":128,"num_read_kb":195259,"num_write":150,"num_write_kb":136883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":87203840,"data_stored":87200380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":90,"ondisk_log_size":90,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543490,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":446112,"kb_used_data":167824,"kb_used_omap":1,"kb_used_meta":278270,"kb_avail":93925728,"statfs":{"total":96636764160,"available":96179945472,"internally_reserved":0,"allocated":171851776,"data_stored":169791032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":284948938},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543486,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250960,"kb_used_data":7164,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94120880,"statfs":{"total":96636764160,"available":96379781120,"internally_reserved":0,"allocated":7335936,"data_stored":5380296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":249428422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543488,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":290804,"kb_used_data":143076,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94081036,"statfs":{"total":96636764160,"available":96338980864,"internally_reserved":0,"allocated":146509824,"data_stored":144406301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543485,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":251284,"kb_used_data":152068,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94120556,"statfs":{"total":96636764160,"available":96379449344,"internally_reserved":0,"allocated":155717632,"data_stored":153772157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543490,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":475420,"kb_used_data":201292,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93896420,"statfs":{"total":96636764160,"available":96149934080,"internally_reserved":0,"allocated":206123008,"data_stored":204084548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":280689095},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543488,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92516,"kb_used_data":7092,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94279324,"statfs":{"total":96636764160,"available":96542027776,"internally_reserved":0,"allocated":7262208,"data_stored":5318104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543487,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":192720,"kb_used_data":8764,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94179120,"statfs":{"total":96636764160,"available":96439418880,"internally_reserved":0,"allocated":8974336,"data_stored":6990912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543487,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":278936,"kb_used_data":8836,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94092904,"statfs":{"total":96636764160,"available":96351133696,"internally_reserved":0,"allocated":9048064,"data_stored":7057331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":276429255},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4157440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4681728,"data_stored":4681728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3010560,"data_stored":3010560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":133615616,"data_stored":133615616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":114589696,"data_stored":114589696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":104255488,"data_stored":104255488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3072000,"data_stored":3072000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":124878848,"data_stored":124878848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":467412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":78226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":667648,"data_stored":557082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":643072,"data_stored":535176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29360128,"data_stored":29360128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":22069248,"data_stored":22068518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12120064,"data_stored":12118699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":23654400,"data_stored":23653035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38334464,"data_stored":38333099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14729216,"data_stored":14728486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":25165824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T15:31:42.780 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T15:31:43.096 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:31:43.096 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":268,"fsid":"3b892dc0-ee3c-4a62-acaf-b5dc1a676e05","created":"2024-09-19T13:39:59.415855+0000","modified":"2024-09-19T14:29:52.018144+0000","last_up_change":"2024-09-19T13:40:11.599431+0000","last_in_change":"2024-09-19T13:40:02.436813+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":16,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T13:40:12.124782+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-19T13:40:18.340794+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-19T13:40:32.186402+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-19T13:40:34.558939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-19T13:40:36.337451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-19T13:40:38.334001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-19T13:40:40.254946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-19T13:40:42.379788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-19T13:56:22.069679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"257","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-19T14:02:28.680534+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"260","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-19T14:02:35.272611+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"263","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-19T14:29:49.041175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"268","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce8bbbf7-8bf7-46c4-ac60-162b6eb810a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6808","nonce":4220035009},{"type":"v1","addr":"172.21.15.153:6809","nonce":4220035009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6810","nonce":4220035009},{"type":"v1","addr":"172.21.15.153:6811","nonce":4220035009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6814","nonce":4220035009},{"type":"v1","addr":"172.21.15.153:6815","nonce":4220035009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6812","nonce":4220035009},{"type":"v1","addr":"172.21.15.153:6813","nonce":4220035009}]},"public_addr":"172.21.15.153:6809/4220035009","cluster_addr":"172.21.15.153:6811/4220035009","heartbeat_back_addr":"172.21.15.153:6815/4220035009","heartbeat_front_addr":"172.21.15.153:6813/4220035009","state":["exists","up"]},{"osd":1,"uuid":"8635f339-d51b-4aa9-b61e-359098a3eb26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":2952519065},{"type":"v1","addr":"172.21.15.153:6801","nonce":2952519065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6802","nonce":2952519065},{"type":"v1","addr":"172.21.15.153:6803","nonce":2952519065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6806","nonce":2952519065},{"type":"v1","addr":"172.21.15.153:6807","nonce":2952519065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6804","nonce":2952519065},{"type":"v1","addr":"172.21.15.153:6805","nonce":2952519065}]},"public_addr":"172.21.15.153:6801/2952519065","cluster_addr":"172.21.15.153:6803/2952519065","heartbeat_back_addr":"172.21.15.153:6807/2952519065","heartbeat_front_addr":"172.21.15.153:6805/2952519065","state":["exists","up"]},{"osd":2,"uuid":"e0dc4d61-fb7e-44a7-a674-fe3a681bd238","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6816","nonce":795993612},{"type":"v1","addr":"172.21.15.153:6817","nonce":795993612}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":795993612},{"type":"v1","addr":"172.21.15.153:6819","nonce":795993612}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6822","nonce":795993612},{"type":"v1","addr":"172.21.15.153:6823","nonce":795993612}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6820","nonce":795993612},{"type":"v1","addr":"172.21.15.153:6821","nonce":795993612}]},"public_addr":"172.21.15.153:6817/795993612","cluster_addr":"172.21.15.153:6819/795993612","heartbeat_back_addr":"172.21.15.153:6823/795993612","heartbeat_front_addr":"172.21.15.153:6821/795993612","state":["exists","up"]},{"osd":3,"uuid":"83649989-6b85-458b-b1ad-3d907675d1f1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":2028182193},{"type":"v1","addr":"172.21.15.153:6825","nonce":2028182193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":2028182193},{"type":"v1","addr":"172.21.15.153:6827","nonce":2028182193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":2028182193},{"type":"v1","addr":"172.21.15.153:6831","nonce":2028182193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":2028182193},{"type":"v1","addr":"172.21.15.153:6829","nonce":2028182193}]},"public_addr":"172.21.15.153:6825/2028182193","cluster_addr":"172.21.15.153:6827/2028182193","heartbeat_back_addr":"172.21.15.153:6831/2028182193","heartbeat_front_addr":"172.21.15.153:6829/2028182193","state":["exists","up"]},{"osd":4,"uuid":"bedde2b8-933e-48a8-ad6f-fab9979eed30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":138851534},{"type":"v1","addr":"172.21.15.196:6827","nonce":138851534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6828","nonce":138851534},{"type":"v1","addr":"172.21.15.196:6829","nonce":138851534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":138851534},{"type":"v1","addr":"172.21.15.196:6833","nonce":138851534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":138851534},{"type":"v1","addr":"172.21.15.196:6831","nonce":138851534}]},"public_addr":"172.21.15.196:6827/138851534","cluster_addr":"172.21.15.196:6829/138851534","heartbeat_back_addr":"172.21.15.196:6833/138851534","heartbeat_front_addr":"172.21.15.196:6831/138851534","state":["exists","up"]},{"osd":5,"uuid":"adee05a9-01f6-4d19-9bd7-c6abf045ab64","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2881705388},{"type":"v1","addr":"172.21.15.196:6801","nonce":2881705388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2881705388},{"type":"v1","addr":"172.21.15.196:6803","nonce":2881705388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2881705388},{"type":"v1","addr":"172.21.15.196:6807","nonce":2881705388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2881705388},{"type":"v1","addr":"172.21.15.196:6805","nonce":2881705388}]},"public_addr":"172.21.15.196:6801/2881705388","cluster_addr":"172.21.15.196:6803/2881705388","heartbeat_back_addr":"172.21.15.196:6807/2881705388","heartbeat_front_addr":"172.21.15.196:6805/2881705388","state":["exists","up"]},{"osd":6,"uuid":"0cab8a06-6eb0-484f-89ac-1efc8afd346a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":638579357},{"type":"v1","addr":"172.21.15.196:6819","nonce":638579357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6820","nonce":638579357},{"type":"v1","addr":"172.21.15.196:6821","nonce":638579357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6824","nonce":638579357},{"type":"v1","addr":"172.21.15.196:6825","nonce":638579357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":638579357},{"type":"v1","addr":"172.21.15.196:6823","nonce":638579357}]},"public_addr":"172.21.15.196:6819/638579357","cluster_addr":"172.21.15.196:6821/638579357","heartbeat_back_addr":"172.21.15.196:6825/638579357","heartbeat_front_addr":"172.21.15.196:6823/638579357","state":["exists","up"]},{"osd":7,"uuid":"92f735a8-569b-44e9-b61e-ccc5abaf6741","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":3095707395},{"type":"v1","addr":"172.21.15.196:6811","nonce":3095707395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":3095707395},{"type":"v1","addr":"172.21.15.196:6813","nonce":3095707395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":3095707395},{"type":"v1","addr":"172.21.15.196:6817","nonce":3095707395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":3095707395},{"type":"v1","addr":"172.21.15.196:6815","nonce":3095707395}]},"public_addr":"172.21.15.196:6811/3095707395","cluster_addr":"172.21.15.196:6813/3095707395","heartbeat_back_addr":"172.21.15.196:6817/3095707395","heartbeat_front_addr":"172.21.15.196:6815/3095707395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:08.672776+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:08.725276+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:09.373468+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:09.633556+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:09.238299+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:08.567918+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:09.247935+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T13:40:09.051448+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.6","mappings":[{"from":0,"to":2}]},{"pgid":"3.a","mappings":[{"from":6,"to":2}]},{"pgid":"3.f","mappings":[{"from":4,"to":2}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.1b","mappings":[{"from":4,"to":1}]},{"pgid":"3.1d","mappings":[{"from":4,"to":2}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.30","mappings":[{"from":4,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":5}]},{"pgid":"4.1b","mappings":[{"from":3,"to":2}]},{"pgid":"67.a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T15:31:44.118 INFO:tasks.ceph:Scrubbing osd.0 2024-09-19T15:31:44.118 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-19T15:31:44.277 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-19T15:31:44.277 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T15:31:44.278 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-19T15:31:44.294 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-19T15:31:44.593 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 0 to deep-scrub 2024-09-19T15:31:44.613 INFO:tasks.ceph:Scrubbing osd.1 2024-09-19T15:31:44.613 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-19T15:31:44.762 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-19T15:31:44.762 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T15:31:44.762 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-19T15:31:44.779 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-19T15:31:45.074 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 1 to deep-scrub 2024-09-19T15:31:45.093 INFO:tasks.ceph:Scrubbing osd.2 2024-09-19T15:31:45.093 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-19T15:31:45.230 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-19T15:31:45.231 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T15:31:45.231 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-19T15:31:45.246 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-19T15:31:45.549 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 2 to deep-scrub 2024-09-19T15:31:45.569 INFO:tasks.ceph:Scrubbing osd.3 2024-09-19T15:31:45.569 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-19T15:31:45.722 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-19T15:31:45.722 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T15:31:45.722 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-19T15:31:45.737 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-19T15:31:46.028 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 3 to deep-scrub 2024-09-19T15:31:46.048 INFO:tasks.ceph:Scrubbing osd.4 2024-09-19T15:31:46.048 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-19T15:31:46.200 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-19T15:31:46.200 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T15:31:46.200 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-19T15:31:46.217 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-19T15:31:46.523 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 4 to deep-scrub 2024-09-19T15:31:46.544 INFO:tasks.ceph:Scrubbing osd.5 2024-09-19T15:31:46.544 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-19T15:31:46.701 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-19T15:31:46.701 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T15:31:46.701 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-19T15:31:46.718 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-19T15:31:47.015 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 5 to deep-scrub 2024-09-19T15:31:47.033 INFO:tasks.ceph:Scrubbing osd.6 2024-09-19T15:31:47.033 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-19T15:31:47.175 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-19T15:31:47.176 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T15:31:47.176 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-19T15:31:47.191 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-19T15:31:47.482 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 6 to deep-scrub 2024-09-19T15:31:47.500 INFO:tasks.ceph:Scrubbing osd.7 2024-09-19T15:31:47.501 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-19T15:31:47.647 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2024-09-19T15:31:47.647 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T15:31:47.647 INFO:teuthology.orchestra.run.smithi153.stdout:} 2024-09-19T15:31:47.662 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-19T15:31:47.953 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 7 to deep-scrub 2024-09-19T15:31:47.973 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T15:31:48.296 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:31:48.312 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-19T15:31:48.326 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":3606,"stamp":"2024-09-19T15:31:46.642117+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26180412,"num_objects":726,"num_object_clones":0,"num_object_copies":1729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":726,"num_whiteouts":0,"num_read":316475,"num_read_kb":3029670,"num_write":167328,"num_write_kb":2491887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13337,"ondisk_log_size":13337,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1673716,"kb_used_data":71124,"kb_used_omap":12,"kb_used_meta":1601395,"kb_avail":753301004,"statfs":{"total":773094113280,"available":771380228096,"internally_reserved":0,"allocated":72830976,"data_stored":56970846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1639829042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7],"upper_bound":2},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-767796619,"num_objects":-4098,"num_object_clones":0,"num_object_copies":-12254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4098,"num_whiteouts":0,"num_read":4586,"num_read_kb":4136,"num_write":4349,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008147"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.609067+0000","last_change":"2024-09-19T14:29:51.038023+0000","last_active":"2024-09-19T15:27:22.609067+0000","last_peered":"2024-09-19T15:27:22.609067+0000","last_clean":"2024-09-19T15:27:22.609067+0000","last_became_active":"2024-09-19T14:29:51.036952+0000","last_became_peered":"2024-09-19T14:29:51.036952+0000","last_unstale":"2024-09-19T15:27:22.609067+0000","last_undegraded":"2024-09-19T15:27:22.609067+0000","last_fullsized":"2024-09-19T15:27:22.609067+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:10:00.951609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:37.612687+0000","last_change":"2024-09-19T14:02:36.913041+0000","last_active":"2024-09-19T15:27:37.612687+0000","last_peered":"2024-09-19T15:27:37.612687+0000","last_clean":"2024-09-19T15:27:37.612687+0000","last_became_active":"2024-09-19T14:02:36.912307+0000","last_became_peered":"2024-09-19T14:02:36.912307+0000","last_unstale":"2024-09-19T15:27:37.612687+0000","last_undegraded":"2024-09-19T15:27:37.612687+0000","last_fullsized":"2024-09-19T15:27:37.612687+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:18:44.440160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"268'11","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.256849+0000","last_change":"2024-09-19T14:02:29.740551+0000","last_active":"2024-09-19T15:31:38.256849+0000","last_peered":"2024-09-19T15:31:38.256849+0000","last_clean":"2024-09-19T15:31:38.256849+0000","last_became_active":"2024-09-19T14:02:29.739721+0000","last_became_peered":"2024-09-19T14:02:29.739721+0000","last_unstale":"2024-09-19T15:31:38.256849+0000","last_undegraded":"2024-09-19T15:31:38.256849+0000","last_fullsized":"2024-09-19T15:31:38.256849+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:40.747086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":13312,"num_write":21,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'35","reported_seq":168,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.179075+0000","last_change":"2024-09-19T13:56:23.181765+0000","last_active":"2024-09-19T15:28:07.179075+0000","last_peered":"2024-09-19T15:28:07.179075+0000","last_clean":"2024-09-19T15:28:07.179075+0000","last_became_active":"2024-09-19T13:56:23.180176+0000","last_became_peered":"2024-09-19T13:56:23.180176+0000","last_unstale":"2024-09-19T15:28:07.179075+0000","last_undegraded":"2024-09-19T15:28:07.179075+0000","last_fullsized":"2024-09-19T15:28:07.179075+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:39.781109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":165,"num_write":94,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.537242+0000","last_change":"2024-09-19T14:29:51.039282+0000","last_active":"2024-09-19T15:27:22.537242+0000","last_peered":"2024-09-19T15:27:22.537242+0000","last_clean":"2024-09-19T15:27:22.537242+0000","last_became_active":"2024-09-19T14:29:51.038289+0000","last_became_peered":"2024-09-19T14:29:51.038289+0000","last_unstale":"2024-09-19T15:27:22.537242+0000","last_undegraded":"2024-09-19T15:27:22.537242+0000","last_fullsized":"2024-09-19T15:27:22.537242+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:16.350420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'2","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:07.627354+0000","last_change":"2024-09-19T14:02:36.915848+0000","last_active":"2024-09-19T15:30:07.627354+0000","last_peered":"2024-09-19T15:30:07.627354+0000","last_clean":"2024-09-19T15:30:07.627354+0000","last_became_active":"2024-09-19T14:02:36.914769+0000","last_became_peered":"2024-09-19T14:02:36.914769+0000","last_unstale":"2024-09-19T15:30:07.627354+0000","last_undegraded":"2024-09-19T15:30:07.627354+0000","last_fullsized":"2024-09-19T15:30:07.627354+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:22.428331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"268'6","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.100940+0000","last_change":"2024-09-19T14:02:29.748087+0000","last_active":"2024-09-19T15:31:39.100940+0000","last_peered":"2024-09-19T15:31:39.100940+0000","last_clean":"2024-09-19T15:31:39.100940+0000","last_became_active":"2024-09-19T14:02:29.747492+0000","last_became_peered":"2024-09-19T14:02:29.747492+0000","last_unstale":"2024-09-19T15:31:39.100940+0000","last_undegraded":"2024-09-19T15:31:39.100940+0000","last_fullsized":"2024-09-19T15:31:39.100940+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:00.163612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'26","reported_seq":153,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.554031+0000","last_change":"2024-09-19T13:56:23.182940+0000","last_active":"2024-09-19T15:28:42.554031+0000","last_peered":"2024-09-19T15:28:42.554031+0000","last_clean":"2024-09-19T15:28:42.554031+0000","last_became_active":"2024-09-19T13:56:23.173377+0000","last_became_peered":"2024-09-19T13:56:23.173377+0000","last_unstale":"2024-09-19T15:28:42.554031+0000","last_undegraded":"2024-09-19T15:28:42.554031+0000","last_fullsized":"2024-09-19T15:28:42.554031+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:53.676663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":124,"num_write":71,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:52.379379+0000","last_change":"2024-09-19T14:29:51.044849+0000","last_active":"2024-09-19T15:27:52.379379+0000","last_peered":"2024-09-19T15:27:52.379379+0000","last_clean":"2024-09-19T15:27:52.379379+0000","last_became_active":"2024-09-19T14:29:51.039043+0000","last_became_peered":"2024-09-19T14:29:51.039043+0000","last_unstale":"2024-09-19T15:27:52.379379+0000","last_undegraded":"2024-09-19T15:27:52.379379+0000","last_fullsized":"2024-09-19T15:27:52.379379+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:50.442880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"268'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:07.209630+0000","last_change":"2024-09-19T14:02:37.054013+0000","last_active":"2024-09-19T15:30:07.209630+0000","last_peered":"2024-09-19T15:30:07.209630+0000","last_clean":"2024-09-19T15:30:07.209630+0000","last_became_active":"2024-09-19T14:02:37.051665+0000","last_became_peered":"2024-09-19T14:02:37.051665+0000","last_unstale":"2024-09-19T15:30:07.209630+0000","last_undegraded":"2024-09-19T15:30:07.209630+0000","last_fullsized":"2024-09-19T15:30:07.209630+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:50.720956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:52.556050+0000","last_change":"2024-09-19T14:02:29.725591+0000","last_active":"2024-09-19T15:28:52.556050+0000","last_peered":"2024-09-19T15:28:52.556050+0000","last_clean":"2024-09-19T15:28:52.556050+0000","last_became_active":"2024-09-19T14:02:29.724866+0000","last_became_peered":"2024-09-19T14:02:29.724866+0000","last_unstale":"2024-09-19T15:28:52.556050+0000","last_undegraded":"2024-09-19T15:28:52.556050+0000","last_fullsized":"2024-09-19T15:28:52.556050+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:44.282362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'36","reported_seq":169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.190273+0000","last_change":"2024-09-19T13:56:23.181435+0000","last_active":"2024-09-19T15:28:57.190273+0000","last_peered":"2024-09-19T15:28:57.190273+0000","last_clean":"2024-09-19T15:28:57.190273+0000","last_became_active":"2024-09-19T13:56:23.180159+0000","last_became_peered":"2024-09-19T13:56:23.180159+0000","last_unstale":"2024-09-19T15:28:57.190273+0000","last_undegraded":"2024-09-19T15:28:57.190273+0000","last_fullsized":"2024-09-19T15:28:57.190273+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:34:32.230609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":283,"num_read_kb":171,"num_write":89,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:03.230461+0000","last_change":"2024-09-19T14:29:51.030209+0000","last_active":"2024-09-19T15:28:03.230461+0000","last_peered":"2024-09-19T15:28:03.230461+0000","last_clean":"2024-09-19T15:28:03.230461+0000","last_became_active":"2024-09-19T14:29:51.029426+0000","last_became_peered":"2024-09-19T14:29:51.029426+0000","last_unstale":"2024-09-19T15:28:03.230461+0000","last_undegraded":"2024-09-19T15:28:03.230461+0000","last_fullsized":"2024-09-19T15:28:03.230461+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:42:56.183067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"268'3","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:53.047918+0000","last_change":"2024-09-19T14:02:37.053245+0000","last_active":"2024-09-19T15:30:53.047918+0000","last_peered":"2024-09-19T15:30:53.047918+0000","last_clean":"2024-09-19T15:30:53.047918+0000","last_became_active":"2024-09-19T14:02:37.052510+0000","last_became_peered":"2024-09-19T14:02:37.052510+0000","last_unstale":"2024-09-19T15:30:53.047918+0000","last_undegraded":"2024-09-19T15:30:53.047918+0000","last_fullsized":"2024-09-19T15:30:53.047918+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:25.091691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.597885+0000","last_change":"2024-09-19T14:02:29.736849+0000","last_active":"2024-09-19T15:27:57.597885+0000","last_peered":"2024-09-19T15:27:57.597885+0000","last_clean":"2024-09-19T15:27:57.597885+0000","last_became_active":"2024-09-19T14:02:29.736074+0000","last_became_peered":"2024-09-19T14:02:29.736074+0000","last_unstale":"2024-09-19T15:27:57.597885+0000","last_undegraded":"2024-09-19T15:27:57.597885+0000","last_fullsized":"2024-09-19T15:27:57.597885+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:49.441598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'63","reported_seq":244,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:53.242175+0000","last_change":"2024-09-19T13:56:23.179692+0000","last_active":"2024-09-19T15:28:53.242175+0000","last_peered":"2024-09-19T15:28:53.242175+0000","last_clean":"2024-09-19T15:28:53.242175+0000","last_became_active":"2024-09-19T13:56:23.179235+0000","last_became_peered":"2024-09-19T13:56:23.179235+0000","last_unstale":"2024-09-19T15:28:53.242175+0000","last_undegraded":"2024-09-19T15:28:53.242175+0000","last_fullsized":"2024-09-19T15:28:53.242175+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:47.927569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":508,"num_read_kb":362,"num_write":155,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:03.230734+0000","last_change":"2024-09-19T14:29:51.053238+0000","last_active":"2024-09-19T15:28:03.230734+0000","last_peered":"2024-09-19T15:28:03.230734+0000","last_clean":"2024-09-19T15:28:03.230734+0000","last_became_active":"2024-09-19T14:29:51.052562+0000","last_became_peered":"2024-09-19T14:29:51.052562+0000","last_unstale":"2024-09-19T15:28:03.230734+0000","last_undegraded":"2024-09-19T15:28:03.230734+0000","last_fullsized":"2024-09-19T15:28:03.230734+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:06:42.849046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"268'9","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.876210+0000","last_change":"2024-09-19T14:02:36.931028+0000","last_active":"2024-09-19T15:31:39.876210+0000","last_peered":"2024-09-19T15:31:39.876210+0000","last_clean":"2024-09-19T15:31:39.876210+0000","last_became_active":"2024-09-19T14:02:36.930344+0000","last_became_peered":"2024-09-19T14:02:36.930344+0000","last_unstale":"2024-09-19T15:31:39.876210+0000","last_undegraded":"2024-09-19T15:31:39.876210+0000","last_fullsized":"2024-09-19T15:31:39.876210+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:10:56.230063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":19,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'8","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:32.198661+0000","last_change":"2024-09-19T14:02:29.741351+0000","last_active":"2024-09-19T15:29:32.198661+0000","last_peered":"2024-09-19T15:29:32.198661+0000","last_clean":"2024-09-19T15:29:32.198661+0000","last_became_active":"2024-09-19T14:02:29.740291+0000","last_became_peered":"2024-09-19T14:02:29.740291+0000","last_unstale":"2024-09-19T15:29:32.198661+0000","last_undegraded":"2024-09-19T15:29:32.198661+0000","last_fullsized":"2024-09-19T15:29:32.198661+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:33:40.597174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'10","reported_seq":101,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:53.242112+0000","last_change":"2024-09-19T13:56:23.170087+0000","last_active":"2024-09-19T15:28:53.242112+0000","last_peered":"2024-09-19T15:28:53.242112+0000","last_clean":"2024-09-19T15:28:53.242112+0000","last_became_active":"2024-09-19T13:56:23.169371+0000","last_became_peered":"2024-09-19T13:56:23.169371+0000","last_unstale":"2024-09-19T15:28:53.242112+0000","last_undegraded":"2024-09-19T15:28:53.242112+0000","last_fullsized":"2024-09-19T15:28:53.242112+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:41:15.161070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":43,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381528+0000","last_change":"2024-09-19T14:29:51.049819+0000","last_active":"2024-09-19T15:28:12.381528+0000","last_peered":"2024-09-19T15:28:12.381528+0000","last_clean":"2024-09-19T15:28:12.381528+0000","last_became_active":"2024-09-19T14:29:51.049146+0000","last_became_peered":"2024-09-19T14:29:51.049146+0000","last_unstale":"2024-09-19T15:28:12.381528+0000","last_undegraded":"2024-09-19T15:28:12.381528+0000","last_fullsized":"2024-09-19T15:28:12.381528+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:39.379659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:12.568908+0000","last_change":"2024-09-19T14:02:36.928119+0000","last_active":"2024-09-19T15:27:12.568908+0000","last_peered":"2024-09-19T15:27:12.568908+0000","last_clean":"2024-09-19T15:27:12.568908+0000","last_became_active":"2024-09-19T14:02:36.927382+0000","last_became_peered":"2024-09-19T14:02:36.927382+0000","last_unstale":"2024-09-19T15:27:12.568908+0000","last_undegraded":"2024-09-19T15:27:12.568908+0000","last_fullsized":"2024-09-19T15:27:12.568908+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:18.568506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"268'2","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:52.623969+0000","last_change":"2024-09-19T14:02:29.723753+0000","last_active":"2024-09-19T15:29:52.623969+0000","last_peered":"2024-09-19T15:29:52.623969+0000","last_clean":"2024-09-19T15:29:52.623969+0000","last_became_active":"2024-09-19T14:02:29.722193+0000","last_became_peered":"2024-09-19T14:02:29.722193+0000","last_unstale":"2024-09-19T15:29:52.623969+0000","last_undegraded":"2024-09-19T15:29:52.623969+0000","last_fullsized":"2024-09-19T15:29:52.623969+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:12.251421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'21","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:52.392809+0000","last_change":"2024-09-19T13:56:23.175249+0000","last_active":"2024-09-19T15:28:52.392809+0000","last_peered":"2024-09-19T15:28:52.392809+0000","last_clean":"2024-09-19T15:28:52.392809+0000","last_became_active":"2024-09-19T13:56:23.174511+0000","last_became_peered":"2024-09-19T13:56:23.174511+0000","last_unstale":"2024-09-19T15:28:52.392809+0000","last_undegraded":"2024-09-19T15:28:52.392809+0000","last_fullsized":"2024-09-19T15:28:52.392809+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:24.782915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":102,"num_write":56,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.629613+0000","last_change":"2024-09-19T14:29:51.041850+0000","last_active":"2024-09-19T15:27:22.629613+0000","last_peered":"2024-09-19T15:27:22.629613+0000","last_clean":"2024-09-19T15:27:22.629613+0000","last_became_active":"2024-09-19T14:29:51.039919+0000","last_became_peered":"2024-09-19T14:29:51.039919+0000","last_unstale":"2024-09-19T15:27:22.629613+0000","last_undegraded":"2024-09-19T15:27:22.629613+0000","last_fullsized":"2024-09-19T15:27:22.629613+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:56.764514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"265'8","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:37.574384+0000","last_change":"2024-09-19T14:02:36.919460+0000","last_active":"2024-09-19T15:27:37.574384+0000","last_peered":"2024-09-19T15:27:37.574384+0000","last_clean":"2024-09-19T15:27:37.574384+0000","last_became_active":"2024-09-19T14:02:36.918707+0000","last_became_peered":"2024-09-19T14:02:36.918707+0000","last_unstale":"2024-09-19T15:27:37.574384+0000","last_undegraded":"2024-09-19T15:27:37.574384+0000","last_fullsized":"2024-09-19T15:27:37.574384+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:50.554567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9218,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.591968+0000","last_change":"2024-09-19T14:02:29.740667+0000","last_active":"2024-09-19T15:27:32.591968+0000","last_peered":"2024-09-19T15:27:32.591968+0000","last_clean":"2024-09-19T15:27:32.591968+0000","last_became_active":"2024-09-19T14:02:29.739955+0000","last_became_peered":"2024-09-19T14:02:29.739955+0000","last_unstale":"2024-09-19T15:27:32.591968+0000","last_undegraded":"2024-09-19T15:27:32.591968+0000","last_fullsized":"2024-09-19T15:27:32.591968+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:34:51.448763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'12","reported_seq":107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:47.187823+0000","last_change":"2024-09-19T13:56:23.179307+0000","last_active":"2024-09-19T15:28:47.187823+0000","last_peered":"2024-09-19T15:28:47.187823+0000","last_clean":"2024-09-19T15:28:47.187823+0000","last_became_active":"2024-09-19T13:56:23.170272+0000","last_became_peered":"2024-09-19T13:56:23.170272+0000","last_unstale":"2024-09-19T15:28:47.187823+0000","last_undegraded":"2024-09-19T15:28:47.187823+0000","last_fullsized":"2024-09-19T15:28:47.187823+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:47:57.598767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.629764+0000","last_change":"2024-09-19T14:29:51.059050+0000","last_active":"2024-09-19T15:27:22.629764+0000","last_peered":"2024-09-19T15:27:22.629764+0000","last_clean":"2024-09-19T15:27:22.629764+0000","last_became_active":"2024-09-19T14:29:51.058380+0000","last_became_peered":"2024-09-19T14:29:51.058380+0000","last_unstale":"2024-09-19T15:27:22.629764+0000","last_undegraded":"2024-09-19T15:27:22.629764+0000","last_fullsized":"2024-09-19T15:27:22.629764+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:35.762726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:38.224574+0000","last_change":"2024-09-19T14:02:36.926259+0000","last_active":"2024-09-19T15:27:38.224574+0000","last_peered":"2024-09-19T15:27:38.224574+0000","last_clean":"2024-09-19T15:27:38.224574+0000","last_became_active":"2024-09-19T14:02:36.924268+0000","last_became_peered":"2024-09-19T14:02:36.924268+0000","last_unstale":"2024-09-19T15:27:38.224574+0000","last_undegraded":"2024-09-19T15:27:38.224574+0000","last_fullsized":"2024-09-19T15:27:38.224574+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:52.337740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.171539+0000","last_change":"2024-09-19T14:02:29.745987+0000","last_active":"2024-09-19T15:27:32.171539+0000","last_peered":"2024-09-19T15:27:32.171539+0000","last_clean":"2024-09-19T15:27:32.171539+0000","last_became_active":"2024-09-19T14:02:29.741114+0000","last_became_peered":"2024-09-19T14:02:29.741114+0000","last_unstale":"2024-09-19T15:27:32.171539+0000","last_undegraded":"2024-09-19T15:27:32.171539+0000","last_fullsized":"2024-09-19T15:27:32.171539+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:21.115185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"268'44","reported_seq":192,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381292+0000","last_change":"2024-09-19T13:56:23.177841+0000","last_active":"2024-09-19T15:28:12.381292+0000","last_peered":"2024-09-19T15:28:12.381292+0000","last_clean":"2024-09-19T15:28:12.381292+0000","last_became_active":"2024-09-19T13:56:23.177082+0000","last_became_peered":"2024-09-19T13:56:23.177082+0000","last_unstale":"2024-09-19T15:28:12.381292+0000","last_undegraded":"2024-09-19T15:28:12.381292+0000","last_fullsized":"2024-09-19T15:28:12.381292+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:57:48.702504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":229,"num_write":111,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381366+0000","last_change":"2024-09-19T14:29:51.037911+0000","last_active":"2024-09-19T15:28:12.381366+0000","last_peered":"2024-09-19T15:28:12.381366+0000","last_clean":"2024-09-19T15:28:12.381366+0000","last_became_active":"2024-09-19T14:29:51.036980+0000","last_became_peered":"2024-09-19T14:29:51.036980+0000","last_unstale":"2024-09-19T15:28:12.381366+0000","last_undegraded":"2024-09-19T15:28:12.381366+0000","last_fullsized":"2024-09-19T15:28:12.381366+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:55.591300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:13.218778+0000","last_change":"2024-09-19T14:02:37.052547+0000","last_active":"2024-09-19T15:27:13.218778+0000","last_peered":"2024-09-19T15:27:13.218778+0000","last_clean":"2024-09-19T15:27:13.218778+0000","last_became_active":"2024-09-19T14:02:37.051627+0000","last_became_peered":"2024-09-19T14:02:37.051627+0000","last_unstale":"2024-09-19T15:27:13.218778+0000","last_undegraded":"2024-09-19T15:27:13.218778+0000","last_fullsized":"2024-09-19T15:27:13.218778+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:03.602347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'10","reported_seq":87,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:32.668758+0000","last_change":"2024-09-19T14:02:29.725819+0000","last_active":"2024-09-19T15:31:32.668758+0000","last_peered":"2024-09-19T15:31:32.668758+0000","last_clean":"2024-09-19T15:31:32.668758+0000","last_became_active":"2024-09-19T14:02:29.725042+0000","last_became_peered":"2024-09-19T14:02:29.725042+0000","last_unstale":"2024-09-19T15:31:32.668758+0000","last_undegraded":"2024-09-19T15:31:32.668758+0000","last_fullsized":"2024-09-19T15:31:32.668758+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:36.488155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":17453,"num_write":15,"num_write_kb":14381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'39","reported_seq":180,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:17.181387+0000","last_change":"2024-09-19T13:56:23.180645+0000","last_active":"2024-09-19T15:28:17.181387+0000","last_peered":"2024-09-19T15:28:17.181387+0000","last_clean":"2024-09-19T15:28:17.181387+0000","last_became_active":"2024-09-19T13:56:23.179656+0000","last_became_peered":"2024-09-19T13:56:23.179656+0000","last_unstale":"2024-09-19T15:28:17.181387+0000","last_undegraded":"2024-09-19T15:28:17.181387+0000","last_fullsized":"2024-09-19T15:28:17.181387+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:23.453827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":202,"num_write":114,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.547652+0000","last_change":"2024-09-19T14:29:51.035627+0000","last_active":"2024-09-19T15:28:12.547652+0000","last_peered":"2024-09-19T15:28:12.547652+0000","last_clean":"2024-09-19T15:28:12.547652+0000","last_became_active":"2024-09-19T14:29:51.034910+0000","last_became_peered":"2024-09-19T14:29:51.034910+0000","last_unstale":"2024-09-19T15:28:12.547652+0000","last_undegraded":"2024-09-19T15:28:12.547652+0000","last_fullsized":"2024-09-19T15:28:12.547652+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:52.799048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"268'5","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.702266+0000","last_change":"2024-09-19T14:02:37.050424+0000","last_active":"2024-09-19T15:31:38.702266+0000","last_peered":"2024-09-19T15:31:38.702266+0000","last_clean":"2024-09-19T15:31:38.702266+0000","last_became_active":"2024-09-19T14:02:37.049593+0000","last_became_peered":"2024-09-19T14:02:37.049593+0000","last_unstale":"2024-09-19T15:31:38.702266+0000","last_undegraded":"2024-09-19T15:31:38.702266+0000","last_fullsized":"2024-09-19T15:31:38.702266+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:09.018084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":571,"num_write":10,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"268'7","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:32.661280+0000","last_change":"2024-09-19T14:02:29.738371+0000","last_active":"2024-09-19T15:29:32.661280+0000","last_peered":"2024-09-19T15:29:32.661280+0000","last_clean":"2024-09-19T15:29:32.661280+0000","last_became_active":"2024-09-19T14:02:29.737689+0000","last_became_peered":"2024-09-19T14:02:29.737689+0000","last_unstale":"2024-09-19T15:29:32.661280+0000","last_undegraded":"2024-09-19T15:29:32.661280+0000","last_fullsized":"2024-09-19T15:29:32.661280+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:43.480539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5718,"num_write":7,"num_write_kb":5718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'32","reported_seq":159,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:13.233083+0000","last_change":"2024-09-19T13:56:23.172875+0000","last_active":"2024-09-19T15:28:13.233083+0000","last_peered":"2024-09-19T15:28:13.233083+0000","last_clean":"2024-09-19T15:28:13.233083+0000","last_became_active":"2024-09-19T13:56:23.172185+0000","last_became_peered":"2024-09-19T13:56:23.172185+0000","last_unstale":"2024-09-19T15:28:13.233083+0000","last_undegraded":"2024-09-19T15:28:13.233083+0000","last_fullsized":"2024-09-19T15:28:13.233083+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:08:40.622542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":246,"num_read_kb":158,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.641708+0000","last_change":"2024-09-19T14:29:51.040551+0000","last_active":"2024-09-19T15:28:12.641708+0000","last_peered":"2024-09-19T15:28:12.641708+0000","last_clean":"2024-09-19T15:28:12.641708+0000","last_became_active":"2024-09-19T14:29:51.039877+0000","last_became_peered":"2024-09-19T14:29:51.039877+0000","last_unstale":"2024-09-19T15:28:12.641708+0000","last_undegraded":"2024-09-19T15:28:12.641708+0000","last_fullsized":"2024-09-19T15:28:12.641708+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:34:37.191773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"268'11","reported_seq":81,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.677682+0000","last_change":"2024-09-19T14:02:37.055970+0000","last_active":"2024-09-19T15:31:39.677682+0000","last_peered":"2024-09-19T15:31:39.677682+0000","last_clean":"2024-09-19T15:31:39.677682+0000","last_became_active":"2024-09-19T14:02:37.055184+0000","last_became_peered":"2024-09-19T14:02:37.055184+0000","last_unstale":"2024-09-19T15:31:39.677682+0000","last_undegraded":"2024-09-19T15:31:39.677682+0000","last_fullsized":"2024-09-19T15:31:39.677682+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:47.611898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":24576,"num_write":21,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"268'3","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:32.563962+0000","last_change":"2024-09-19T14:02:29.733490+0000","last_active":"2024-09-19T15:29:32.563962+0000","last_peered":"2024-09-19T15:29:32.563962+0000","last_clean":"2024-09-19T15:29:32.563962+0000","last_became_active":"2024-09-19T14:02:29.732063+0000","last_became_peered":"2024-09-19T14:02:29.732063+0000","last_unstale":"2024-09-19T15:29:32.563962+0000","last_undegraded":"2024-09-19T15:29:32.563962+0000","last_fullsized":"2024-09-19T15:29:32.563962+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:16:28.644404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'18","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.547747+0000","last_change":"2024-09-19T13:56:23.181555+0000","last_active":"2024-09-19T15:28:12.547747+0000","last_peered":"2024-09-19T15:28:12.547747+0000","last_clean":"2024-09-19T15:28:12.547747+0000","last_became_active":"2024-09-19T13:56:23.172998+0000","last_became_peered":"2024-09-19T13:56:23.172998+0000","last_unstale":"2024-09-19T15:28:12.547747+0000","last_undegraded":"2024-09-19T15:28:12.547747+0000","last_fullsized":"2024-09-19T15:28:12.547747+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:40:22.358000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.620591+0000","last_change":"2024-09-19T14:29:51.021155+0000","last_active":"2024-09-19T15:28:12.620591+0000","last_peered":"2024-09-19T15:28:12.620591+0000","last_clean":"2024-09-19T15:28:12.620591+0000","last_became_active":"2024-09-19T14:29:51.020277+0000","last_became_peered":"2024-09-19T14:29:51.020277+0000","last_unstale":"2024-09-19T15:28:12.620591+0000","last_undegraded":"2024-09-19T15:28:12.620591+0000","last_fullsized":"2024-09-19T15:28:12.620591+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:00.755087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"268'3","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:37.620944+0000","last_change":"2024-09-19T14:02:36.916711+0000","last_active":"2024-09-19T15:29:37.620944+0000","last_peered":"2024-09-19T15:29:37.620944+0000","last_clean":"2024-09-19T15:29:37.620944+0000","last_became_active":"2024-09-19T14:02:36.915962+0000","last_became_peered":"2024-09-19T14:02:36.915962+0000","last_unstale":"2024-09-19T15:29:37.620944+0000","last_undegraded":"2024-09-19T15:29:37.620944+0000","last_fullsized":"2024-09-19T15:29:37.620944+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:52.527680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:07.166557+0000","last_change":"2024-09-19T14:02:29.746541+0000","last_active":"2024-09-19T15:27:07.166557+0000","last_peered":"2024-09-19T15:27:07.166557+0000","last_clean":"2024-09-19T15:27:07.166557+0000","last_became_active":"2024-09-19T14:02:29.741726+0000","last_became_peered":"2024-09-19T14:02:29.741726+0000","last_unstale":"2024-09-19T15:27:07.166557+0000","last_undegraded":"2024-09-19T15:27:07.166557+0000","last_fullsized":"2024-09-19T15:27:07.166557+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:18.927081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'18","reported_seq":120,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:42.634520+0000","last_change":"2024-09-19T13:56:23.176208+0000","last_active":"2024-09-19T15:27:42.634520+0000","last_peered":"2024-09-19T15:27:42.634520+0000","last_clean":"2024-09-19T15:27:42.634520+0000","last_became_active":"2024-09-19T13:56:23.175483+0000","last_became_peered":"2024-09-19T13:56:23.175483+0000","last_unstale":"2024-09-19T15:27:42.634520+0000","last_undegraded":"2024-09-19T15:27:42.634520+0000","last_fullsized":"2024-09-19T15:27:42.634520+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:44:12.241473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":81,"num_write":47,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:53.228080+0000","last_change":"2024-09-19T14:29:51.055111+0000","last_active":"2024-09-19T15:27:53.228080+0000","last_peered":"2024-09-19T15:27:53.228080+0000","last_clean":"2024-09-19T15:27:53.228080+0000","last_became_active":"2024-09-19T14:29:51.054440+0000","last_became_peered":"2024-09-19T14:29:51.054440+0000","last_unstale":"2024-09-19T15:27:53.228080+0000","last_undegraded":"2024-09-19T15:27:53.228080+0000","last_fullsized":"2024-09-19T15:27:53.228080+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:41:52.609606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391603+0000","last_change":"2024-09-19T14:02:36.918632+0000","last_active":"2024-09-19T15:28:57.391603+0000","last_peered":"2024-09-19T15:28:57.391603+0000","last_clean":"2024-09-19T15:28:57.391603+0000","last_became_active":"2024-09-19T14:02:36.917886+0000","last_became_peered":"2024-09-19T14:02:36.917886+0000","last_unstale":"2024-09-19T15:28:57.391603+0000","last_undegraded":"2024-09-19T15:28:57.391603+0000","last_fullsized":"2024-09-19T15:28:57.391603+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:45:01.058163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"268'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.641739+0000","last_change":"2024-09-19T14:02:29.730814+0000","last_active":"2024-09-19T15:31:12.641739+0000","last_peered":"2024-09-19T15:31:12.641739+0000","last_clean":"2024-09-19T15:31:12.641739+0000","last_became_active":"2024-09-19T14:02:29.730095+0000","last_became_peered":"2024-09-19T14:02:29.730095+0000","last_unstale":"2024-09-19T15:31:12.641739+0000","last_undegraded":"2024-09-19T15:31:12.641739+0000","last_fullsized":"2024-09-19T15:31:12.641739+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:08.221591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'29","reported_seq":148,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.629547+0000","last_change":"2024-09-19T13:56:23.184572+0000","last_active":"2024-09-19T15:27:22.629547+0000","last_peered":"2024-09-19T15:27:22.629547+0000","last_clean":"2024-09-19T15:27:22.629547+0000","last_became_active":"2024-09-19T13:56:23.183825+0000","last_became_peered":"2024-09-19T13:56:23.183825+0000","last_unstale":"2024-09-19T15:27:22.629547+0000","last_undegraded":"2024-09-19T15:27:22.629547+0000","last_fullsized":"2024-09-19T15:27:22.629547+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:11.504818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":139,"num_write":76,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:52.175719+0000","last_change":"2024-09-19T14:29:51.036785+0000","last_active":"2024-09-19T15:27:52.175719+0000","last_peered":"2024-09-19T15:27:52.175719+0000","last_clean":"2024-09-19T15:27:52.175719+0000","last_became_active":"2024-09-19T14:29:51.036062+0000","last_became_peered":"2024-09-19T14:29:51.036062+0000","last_unstale":"2024-09-19T15:27:52.175719+0000","last_undegraded":"2024-09-19T15:27:52.175719+0000","last_fullsized":"2024-09-19T15:27:52.175719+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:13:16.540530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'3","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391538+0000","last_change":"2024-09-19T14:02:36.911361+0000","last_active":"2024-09-19T15:28:57.391538+0000","last_peered":"2024-09-19T15:28:57.391538+0000","last_clean":"2024-09-19T15:28:57.391538+0000","last_became_active":"2024-09-19T14:02:36.910298+0000","last_became_peered":"2024-09-19T14:02:36.910298+0000","last_unstale":"2024-09-19T15:28:57.391538+0000","last_undegraded":"2024-09-19T15:28:57.391538+0000","last_fullsized":"2024-09-19T15:28:57.391538+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:11:03.122123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'3","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.052551+0000","last_change":"2024-09-19T14:02:29.734818+0000","last_active":"2024-09-19T15:31:13.052551+0000","last_peered":"2024-09-19T15:31:13.052551+0000","last_clean":"2024-09-19T15:31:13.052551+0000","last_became_active":"2024-09-19T14:02:29.732413+0000","last_became_peered":"2024-09-19T14:02:29.732413+0000","last_unstale":"2024-09-19T15:31:13.052551+0000","last_undegraded":"2024-09-19T15:31:13.052551+0000","last_fullsized":"2024-09-19T15:31:13.052551+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:35.923776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"268'52","reported_seq":214,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:27.170202+0000","last_change":"2024-09-19T13:56:23.162178+0000","last_active":"2024-09-19T15:27:27.170202+0000","last_peered":"2024-09-19T15:27:27.170202+0000","last_clean":"2024-09-19T15:27:27.170202+0000","last_became_active":"2024-09-19T13:56:23.161268+0000","last_became_peered":"2024-09-19T13:56:23.161268+0000","last_unstale":"2024-09-19T15:27:27.170202+0000","last_undegraded":"2024-09-19T15:27:27.170202+0000","last_fullsized":"2024-09-19T15:27:27.170202+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:49.310248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":413,"num_read_kb":272,"num_write":131,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:32.184540+0000","last_change":"2024-09-19T14:29:51.057255+0000","last_active":"2024-09-19T15:28:32.184540+0000","last_peered":"2024-09-19T15:28:32.184540+0000","last_clean":"2024-09-19T15:28:32.184540+0000","last_became_active":"2024-09-19T14:29:51.055396+0000","last_became_peered":"2024-09-19T14:29:51.055396+0000","last_unstale":"2024-09-19T15:28:32.184540+0000","last_undegraded":"2024-09-19T15:28:32.184540+0000","last_fullsized":"2024-09-19T15:28:32.184540+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:09.497977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:58.243369+0000","last_change":"2024-09-19T14:02:36.927347+0000","last_active":"2024-09-19T15:28:58.243369+0000","last_peered":"2024-09-19T15:28:58.243369+0000","last_clean":"2024-09-19T15:28:58.243369+0000","last_became_active":"2024-09-19T14:02:36.926038+0000","last_became_peered":"2024-09-19T14:02:36.926038+0000","last_unstale":"2024-09-19T15:28:58.243369+0000","last_undegraded":"2024-09-19T15:28:58.243369+0000","last_fullsized":"2024-09-19T15:28:58.243369+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:13:52.343458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"268'6","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.612372+0000","last_change":"2024-09-19T14:02:29.741324+0000","last_active":"2024-09-19T15:31:38.612372+0000","last_peered":"2024-09-19T15:31:38.612372+0000","last_clean":"2024-09-19T15:31:38.612372+0000","last_became_active":"2024-09-19T14:02:29.740451+0000","last_became_peered":"2024-09-19T14:02:29.740451+0000","last_unstale":"2024-09-19T15:31:38.612372+0000","last_undegraded":"2024-09-19T15:31:38.612372+0000","last_fullsized":"2024-09-19T15:31:38.612372+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:22.134435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'35","reported_seq":173,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.589590+0000","last_change":"2024-09-19T13:56:23.176932+0000","last_active":"2024-09-19T15:27:22.589590+0000","last_peered":"2024-09-19T15:27:22.589590+0000","last_clean":"2024-09-19T15:27:22.589590+0000","last_became_active":"2024-09-19T13:56:23.170486+0000","last_became_peered":"2024-09-19T13:56:23.170486+0000","last_unstale":"2024-09-19T15:27:22.589590+0000","last_undegraded":"2024-09-19T15:27:22.589590+0000","last_fullsized":"2024-09-19T15:27:22.589590+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:43:58.374761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":196,"num_write":86,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:53.227989+0000","last_change":"2024-09-19T14:29:51.045330+0000","last_active":"2024-09-19T15:27:53.227989+0000","last_peered":"2024-09-19T15:27:53.227989+0000","last_clean":"2024-09-19T15:27:53.227989+0000","last_became_active":"2024-09-19T14:29:51.044154+0000","last_became_peered":"2024-09-19T14:29:51.044154+0000","last_unstale":"2024-09-19T15:27:53.227989+0000","last_undegraded":"2024-09-19T15:27:53.227989+0000","last_fullsized":"2024-09-19T15:27:53.227989+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:18.797951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.394100+0000","last_change":"2024-09-19T14:02:36.923267+0000","last_active":"2024-09-19T15:28:57.394100+0000","last_peered":"2024-09-19T15:28:57.394100+0000","last_clean":"2024-09-19T15:28:57.394100+0000","last_became_active":"2024-09-19T14:02:36.918735+0000","last_became_peered":"2024-09-19T14:02:36.918735+0000","last_unstale":"2024-09-19T15:28:57.394100+0000","last_undegraded":"2024-09-19T15:28:57.394100+0000","last_fullsized":"2024-09-19T15:28:57.394100+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:11.400154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:52.629773+0000","last_change":"2024-09-19T14:02:29.742726+0000","last_active":"2024-09-19T15:28:52.629773+0000","last_peered":"2024-09-19T15:28:52.629773+0000","last_clean":"2024-09-19T15:28:52.629773+0000","last_became_active":"2024-09-19T14:02:29.742091+0000","last_became_peered":"2024-09-19T14:02:29.742091+0000","last_unstale":"2024-09-19T15:28:52.629773+0000","last_undegraded":"2024-09-19T15:28:52.629773+0000","last_fullsized":"2024-09-19T15:28:52.629773+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:13:04.562095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'40","reported_seq":180,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:23.220896+0000","last_change":"2024-09-19T13:56:23.173987+0000","last_active":"2024-09-19T15:27:23.220896+0000","last_peered":"2024-09-19T15:27:23.220896+0000","last_clean":"2024-09-19T15:27:23.220896+0000","last_became_active":"2024-09-19T13:56:23.173245+0000","last_became_peered":"2024-09-19T13:56:23.173245+0000","last_unstale":"2024-09-19T15:27:23.220896+0000","last_undegraded":"2024-09-19T15:27:23.220896+0000","last_fullsized":"2024-09-19T15:27:23.220896+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:55:35.220716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":315,"num_read_kb":214,"num_write":104,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.552846+0000","last_change":"2024-09-19T14:29:51.044619+0000","last_active":"2024-09-19T15:28:37.552846+0000","last_peered":"2024-09-19T15:28:37.552846+0000","last_clean":"2024-09-19T15:28:37.552846+0000","last_became_active":"2024-09-19T14:29:51.043979+0000","last_became_peered":"2024-09-19T14:29:51.043979+0000","last_unstale":"2024-09-19T15:28:37.552846+0000","last_undegraded":"2024-09-19T15:28:37.552846+0000","last_fullsized":"2024-09-19T15:28:37.552846+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:31:38.625664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"268'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:23.263179+0000","last_change":"2024-09-19T14:02:36.926635+0000","last_active":"2024-09-19T15:30:23.263179+0000","last_peered":"2024-09-19T15:30:23.263179+0000","last_clean":"2024-09-19T15:30:23.263179+0000","last_became_active":"2024-09-19T14:02:36.925870+0000","last_became_peered":"2024-09-19T14:02:36.925870+0000","last_unstale":"2024-09-19T15:30:23.263179+0000","last_undegraded":"2024-09-19T15:30:23.263179+0000","last_fullsized":"2024-09-19T15:30:23.263179+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:50:58.009640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.639477+0000","last_change":"2024-09-19T14:02:29.745325+0000","last_active":"2024-09-19T15:28:02.639477+0000","last_peered":"2024-09-19T15:28:02.639477+0000","last_clean":"2024-09-19T15:28:02.639477+0000","last_became_active":"2024-09-19T14:02:29.744169+0000","last_became_peered":"2024-09-19T14:02:29.744169+0000","last_unstale":"2024-09-19T15:28:02.639477+0000","last_undegraded":"2024-09-19T15:28:02.639477+0000","last_fullsized":"2024-09-19T15:28:02.639477+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:49:32.607973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'31","reported_seq":167,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:48.241100+0000","last_change":"2024-09-19T13:56:23.167169+0000","last_active":"2024-09-19T15:28:48.241100+0000","last_peered":"2024-09-19T15:28:48.241100+0000","last_clean":"2024-09-19T15:28:48.241100+0000","last_became_active":"2024-09-19T13:56:23.160134+0000","last_became_peered":"2024-09-19T13:56:23.160134+0000","last_unstale":"2024-09-19T15:28:48.241100+0000","last_undegraded":"2024-09-19T15:28:48.241100+0000","last_fullsized":"2024-09-19T15:28:48.241100+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:17.424039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":163,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644264+0000","last_change":"2024-09-19T14:29:51.059018+0000","last_active":"2024-09-19T15:28:22.644264+0000","last_peered":"2024-09-19T15:28:22.644264+0000","last_clean":"2024-09-19T15:28:22.644264+0000","last_became_active":"2024-09-19T14:29:51.058494+0000","last_became_peered":"2024-09-19T14:29:51.058494+0000","last_unstale":"2024-09-19T15:28:22.644264+0000","last_undegraded":"2024-09-19T15:28:22.644264+0000","last_fullsized":"2024-09-19T15:28:22.644264+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:29.224657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:08.231677+0000","last_change":"2024-09-19T14:02:36.924847+0000","last_active":"2024-09-19T15:28:08.231677+0000","last_peered":"2024-09-19T15:28:08.231677+0000","last_clean":"2024-09-19T15:28:08.231677+0000","last_became_active":"2024-09-19T14:02:36.924213+0000","last_became_peered":"2024-09-19T14:02:36.924213+0000","last_unstale":"2024-09-19T15:28:08.231677+0000","last_undegraded":"2024-09-19T15:28:08.231677+0000","last_fullsized":"2024-09-19T15:28:08.231677+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:25.039869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.545625+0000","last_change":"2024-09-19T14:02:29.752025+0000","last_active":"2024-09-19T15:28:02.545625+0000","last_peered":"2024-09-19T15:28:02.545625+0000","last_clean":"2024-09-19T15:28:02.545625+0000","last_became_active":"2024-09-19T14:02:29.751229+0000","last_became_peered":"2024-09-19T14:02:29.751229+0000","last_unstale":"2024-09-19T15:28:02.545625+0000","last_undegraded":"2024-09-19T15:28:02.545625+0000","last_fullsized":"2024-09-19T15:28:02.545625+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:04.084148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"268'30","reported_seq":156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.626409+0000","last_change":"2024-09-19T13:56:23.168672+0000","last_active":"2024-09-19T15:28:37.626409+0000","last_peered":"2024-09-19T15:28:37.626409+0000","last_clean":"2024-09-19T15:28:37.626409+0000","last_became_active":"2024-09-19T13:56:23.166406+0000","last_became_peered":"2024-09-19T13:56:23.166406+0000","last_unstale":"2024-09-19T15:28:37.626409+0000","last_undegraded":"2024-09-19T15:28:37.626409+0000","last_fullsized":"2024-09-19T15:28:37.626409+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:17.132230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":158,"num_write":72,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.386230+0000","last_change":"2024-09-19T14:29:51.051349+0000","last_active":"2024-09-19T15:28:22.386230+0000","last_peered":"2024-09-19T15:28:22.386230+0000","last_clean":"2024-09-19T15:28:22.386230+0000","last_became_active":"2024-09-19T14:29:51.050808+0000","last_became_peered":"2024-09-19T14:29:51.050808+0000","last_unstale":"2024-09-19T15:28:22.386230+0000","last_undegraded":"2024-09-19T15:28:22.386230+0000","last_fullsized":"2024-09-19T15:28:22.386230+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:22:11.404680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"268'3","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:47.413935+0000","last_change":"2024-09-19T14:02:37.053056+0000","last_active":"2024-09-19T15:30:47.413935+0000","last_peered":"2024-09-19T15:30:47.413935+0000","last_clean":"2024-09-19T15:30:47.413935+0000","last_became_active":"2024-09-19T14:02:37.052121+0000","last_became_peered":"2024-09-19T14:02:37.052121+0000","last_unstale":"2024-09-19T15:30:47.413935+0000","last_undegraded":"2024-09-19T15:30:47.413935+0000","last_fullsized":"2024-09-19T15:30:47.413935+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:00.496165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.178139+0000","last_change":"2024-09-19T14:02:29.749448+0000","last_active":"2024-09-19T15:28:02.178139+0000","last_peered":"2024-09-19T15:28:02.178139+0000","last_clean":"2024-09-19T15:28:02.178139+0000","last_became_active":"2024-09-19T14:02:29.748469+0000","last_became_peered":"2024-09-19T14:02:29.748469+0000","last_unstale":"2024-09-19T15:28:02.178139+0000","last_undegraded":"2024-09-19T15:28:02.178139+0000","last_fullsized":"2024-09-19T15:28:02.178139+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:25.962511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"268'120","reported_seq":440,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.389638+0000","last_change":"2024-09-19T13:56:23.172759+0000","last_active":"2024-09-19T15:28:37.389638+0000","last_peered":"2024-09-19T15:28:37.389638+0000","last_clean":"2024-09-19T15:28:37.389638+0000","last_became_active":"2024-09-19T13:56:23.164737+0000","last_became_peered":"2024-09-19T13:56:23.164737+0000","last_unstale":"2024-09-19T15:28:37.389638+0000","last_undegraded":"2024-09-19T15:28:37.389638+0000","last_fullsized":"2024-09-19T15:28:37.389638+0000","mapping_epoch":255,"log_start":"265'100","ondisk_log_start":"265'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:31:33.872663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1135,"num_read_kb":1191,"num_write":240,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644185+0000","last_change":"2024-09-19T14:29:51.024362+0000","last_active":"2024-09-19T15:28:22.644185+0000","last_peered":"2024-09-19T15:28:22.644185+0000","last_clean":"2024-09-19T15:28:22.644185+0000","last_became_active":"2024-09-19T14:29:51.022975+0000","last_became_peered":"2024-09-19T14:29:51.022975+0000","last_unstale":"2024-09-19T15:28:22.644185+0000","last_undegraded":"2024-09-19T15:28:22.644185+0000","last_fullsized":"2024-09-19T15:28:22.644185+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:44:44.124646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"268'3","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:23.263213+0000","last_change":"2024-09-19T14:02:36.926595+0000","last_active":"2024-09-19T15:30:23.263213+0000","last_peered":"2024-09-19T15:30:23.263213+0000","last_clean":"2024-09-19T15:30:23.263213+0000","last_became_active":"2024-09-19T14:02:36.924349+0000","last_became_peered":"2024-09-19T14:02:36.924349+0000","last_unstale":"2024-09-19T15:30:23.263213+0000","last_undegraded":"2024-09-19T15:30:23.263213+0000","last_fullsized":"2024-09-19T15:30:23.263213+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:10.123769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:27.385058+0000","last_change":"2024-09-19T14:02:29.731121+0000","last_active":"2024-09-19T15:28:27.385058+0000","last_peered":"2024-09-19T15:28:27.385058+0000","last_clean":"2024-09-19T15:28:27.385058+0000","last_became_active":"2024-09-19T14:02:29.730280+0000","last_became_peered":"2024-09-19T14:02:29.730280+0000","last_unstale":"2024-09-19T15:28:27.385058+0000","last_undegraded":"2024-09-19T15:28:27.385058+0000","last_fullsized":"2024-09-19T15:28:27.385058+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:25.212771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'28","reported_seq":149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.552907+0000","last_change":"2024-09-19T13:56:23.183786+0000","last_active":"2024-09-19T15:28:37.552907+0000","last_peered":"2024-09-19T15:28:37.552907+0000","last_clean":"2024-09-19T15:28:37.552907+0000","last_became_active":"2024-09-19T13:56:23.182103+0000","last_became_peered":"2024-09-19T13:56:23.182103+0000","last_unstale":"2024-09-19T15:28:37.552907+0000","last_undegraded":"2024-09-19T15:28:37.552907+0000","last_fullsized":"2024-09-19T15:28:37.552907+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:32.317900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":141,"num_write":72,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:23.235388+0000","last_change":"2024-09-19T14:29:51.030844+0000","last_active":"2024-09-19T15:28:23.235388+0000","last_peered":"2024-09-19T15:28:23.235388+0000","last_clean":"2024-09-19T15:28:23.235388+0000","last_became_active":"2024-09-19T14:29:51.030200+0000","last_became_peered":"2024-09-19T14:29:51.030200+0000","last_unstale":"2024-09-19T15:28:23.235388+0000","last_undegraded":"2024-09-19T15:28:23.235388+0000","last_fullsized":"2024-09-19T15:28:23.235388+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:34:22.342028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"265'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:17.616101+0000","last_change":"2024-09-19T14:02:36.929045+0000","last_active":"2024-09-19T15:29:17.616101+0000","last_peered":"2024-09-19T15:29:17.616101+0000","last_clean":"2024-09-19T15:29:17.616101+0000","last_became_active":"2024-09-19T14:02:36.927585+0000","last_became_peered":"2024-09-19T14:02:36.927585+0000","last_unstale":"2024-09-19T15:29:17.616101+0000","last_undegraded":"2024-09-19T15:29:17.616101+0000","last_fullsized":"2024-09-19T15:29:17.616101+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:44:02.469367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"265'5","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.194026+0000","last_change":"2024-09-19T14:02:29.740714+0000","last_active":"2024-09-19T15:29:12.194026+0000","last_peered":"2024-09-19T15:29:12.194026+0000","last_clean":"2024-09-19T15:29:12.194026+0000","last_became_active":"2024-09-19T14:02:29.739469+0000","last_became_peered":"2024-09-19T14:02:29.739469+0000","last_unstale":"2024-09-19T15:29:12.194026+0000","last_undegraded":"2024-09-19T15:29:12.194026+0000","last_fullsized":"2024-09-19T15:29:12.194026+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:23.314643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'26","reported_seq":145,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.186692+0000","last_change":"2024-09-19T13:56:23.180908+0000","last_active":"2024-09-19T15:28:42.186692+0000","last_peered":"2024-09-19T15:28:42.186692+0000","last_clean":"2024-09-19T15:28:42.186692+0000","last_became_active":"2024-09-19T13:56:23.170897+0000","last_became_peered":"2024-09-19T13:56:23.170897+0000","last_unstale":"2024-09-19T15:28:42.186692+0000","last_undegraded":"2024-09-19T15:28:42.186692+0000","last_fullsized":"2024-09-19T15:28:42.186692+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:59.535564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":129,"num_write":67,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:32.646832+0000","last_change":"2024-09-19T14:29:51.047203+0000","last_active":"2024-09-19T15:28:32.646832+0000","last_peered":"2024-09-19T15:28:32.646832+0000","last_clean":"2024-09-19T15:28:32.646832+0000","last_became_active":"2024-09-19T14:29:51.046273+0000","last_became_peered":"2024-09-19T14:29:51.046273+0000","last_unstale":"2024-09-19T15:28:32.646832+0000","last_undegraded":"2024-09-19T15:28:32.646832+0000","last_fullsized":"2024-09-19T15:28:32.646832+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:15.605088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"268'8","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:27.688771+0000","last_change":"2024-09-19T14:02:37.051538+0000","last_active":"2024-09-19T15:31:27.688771+0000","last_peered":"2024-09-19T15:31:27.688771+0000","last_clean":"2024-09-19T15:31:27.688771+0000","last_became_active":"2024-09-19T14:02:37.050689+0000","last_became_peered":"2024-09-19T14:02:37.050689+0000","last_unstale":"2024-09-19T15:31:27.688771+0000","last_undegraded":"2024-09-19T15:31:27.688771+0000","last_fullsized":"2024-09-19T15:31:27.688771+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:21.698768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32770,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"265'5","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.395204+0000","last_change":"2024-09-19T14:02:29.731282+0000","last_active":"2024-09-19T15:29:12.395204+0000","last_peered":"2024-09-19T15:29:12.395204+0000","last_clean":"2024-09-19T15:29:12.395204+0000","last_became_active":"2024-09-19T14:02:29.730624+0000","last_became_peered":"2024-09-19T14:02:29.730624+0000","last_unstale":"2024-09-19T15:29:12.395204+0000","last_undegraded":"2024-09-19T15:29:12.395204+0000","last_fullsized":"2024-09-19T15:29:12.395204+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:58.498165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'5","reported_seq":90,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:42.634441+0000","last_change":"2024-09-19T13:56:23.182572+0000","last_active":"2024-09-19T15:27:42.634441+0000","last_peered":"2024-09-19T15:27:42.634441+0000","last_clean":"2024-09-19T15:27:42.634441+0000","last_became_active":"2024-09-19T13:56:23.181867+0000","last_became_peered":"2024-09-19T13:56:23.181867+0000","last_unstale":"2024-09-19T15:27:42.634441+0000","last_undegraded":"2024-09-19T15:27:42.634441+0000","last_fullsized":"2024-09-19T15:27:42.634441+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:12.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644309+0000","last_change":"2024-09-19T14:29:51.037068+0000","last_active":"2024-09-19T15:28:22.644309+0000","last_peered":"2024-09-19T15:28:22.644309+0000","last_clean":"2024-09-19T15:28:22.644309+0000","last_became_active":"2024-09-19T14:29:51.036292+0000","last_became_peered":"2024-09-19T14:29:51.036292+0000","last_unstale":"2024-09-19T15:28:22.644309+0000","last_undegraded":"2024-09-19T15:28:22.644309+0000","last_fullsized":"2024-09-19T15:28:22.644309+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:12.187433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"268'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:22.410283+0000","last_change":"2024-09-19T14:02:36.924261+0000","last_active":"2024-09-19T15:30:22.410283+0000","last_peered":"2024-09-19T15:30:22.410283+0000","last_clean":"2024-09-19T15:30:22.410283+0000","last_became_active":"2024-09-19T14:02:36.923500+0000","last_became_peered":"2024-09-19T14:02:36.923500+0000","last_unstale":"2024-09-19T15:30:22.410283+0000","last_undegraded":"2024-09-19T15:30:22.410283+0000","last_fullsized":"2024-09-19T15:30:22.410283+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:28:12.672018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'3","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:42.200939+0000","last_change":"2024-09-19T14:02:29.746888+0000","last_active":"2024-09-19T15:29:42.200939+0000","last_peered":"2024-09-19T15:29:42.200939+0000","last_clean":"2024-09-19T15:29:42.200939+0000","last_became_active":"2024-09-19T14:02:29.746148+0000","last_became_peered":"2024-09-19T14:02:29.746148+0000","last_unstale":"2024-09-19T15:29:42.200939+0000","last_undegraded":"2024-09-19T15:29:42.200939+0000","last_fullsized":"2024-09-19T15:29:42.200939+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:05.741943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'41","reported_seq":188,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:33.251302+0000","last_change":"2024-09-19T13:56:23.174360+0000","last_active":"2024-09-19T15:29:33.251302+0000","last_peered":"2024-09-19T15:29:33.251302+0000","last_clean":"2024-09-19T15:29:33.251302+0000","last_became_active":"2024-09-19T13:56:23.173918+0000","last_became_peered":"2024-09-19T13:56:23.173918+0000","last_unstale":"2024-09-19T15:29:33.251302+0000","last_undegraded":"2024-09-19T15:29:33.251302+0000","last_fullsized":"2024-09-19T15:29:33.251302+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:23.496354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":206,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.182455+0000","last_change":"2024-09-19T14:29:51.034137+0000","last_active":"2024-09-19T15:28:22.182455+0000","last_peered":"2024-09-19T15:28:22.182455+0000","last_clean":"2024-09-19T15:28:22.182455+0000","last_became_active":"2024-09-19T14:29:51.033329+0000","last_became_peered":"2024-09-19T14:29:51.033329+0000","last_unstale":"2024-09-19T15:28:22.182455+0000","last_undegraded":"2024-09-19T15:28:22.182455+0000","last_fullsized":"2024-09-19T15:28:22.182455+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:09.961864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'5","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:27.630988+0000","last_change":"2024-09-19T14:03:07.396429+0000","last_active":"2024-09-19T15:27:27.630988+0000","last_peered":"2024-09-19T15:27:27.630988+0000","last_clean":"2024-09-19T15:27:27.630988+0000","last_became_active":"2024-09-19T14:03:07.395844+0000","last_became_peered":"2024-09-19T14:03:07.395844+0000","last_unstale":"2024-09-19T15:27:27.630988+0000","last_undegraded":"2024-09-19T15:27:27.630988+0000","last_fullsized":"2024-09-19T15:27:27.630988+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:30.854364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5147,"num_write":5,"num_write_kb":5147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'3","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.598913+0000","last_change":"2024-09-19T14:02:29.733169+0000","last_active":"2024-09-19T15:28:02.598913+0000","last_peered":"2024-09-19T15:28:02.598913+0000","last_clean":"2024-09-19T15:28:02.598913+0000","last_became_active":"2024-09-19T14:02:29.732416+0000","last_became_peered":"2024-09-19T14:02:29.732416+0000","last_unstale":"2024-09-19T15:28:02.598913+0000","last_undegraded":"2024-09-19T15:28:02.598913+0000","last_fullsized":"2024-09-19T15:28:02.598913+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:49:13.647937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'38","reported_seq":188,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:32.402062+0000","last_change":"2024-09-19T13:56:23.173200+0000","last_active":"2024-09-19T15:29:32.402062+0000","last_peered":"2024-09-19T15:29:32.402062+0000","last_clean":"2024-09-19T15:29:32.402062+0000","last_became_active":"2024-09-19T13:56:23.172437+0000","last_became_peered":"2024-09-19T13:56:23.172437+0000","last_unstale":"2024-09-19T15:29:32.402062+0000","last_undegraded":"2024-09-19T15:29:32.402062+0000","last_fullsized":"2024-09-19T15:29:32.402062+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:43:47.758946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":311,"num_read_kb":193,"num_write":96,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.641824+0000","last_change":"2024-09-19T14:29:51.037099+0000","last_active":"2024-09-19T15:28:12.641824+0000","last_peered":"2024-09-19T15:28:12.641824+0000","last_clean":"2024-09-19T15:28:12.641824+0000","last_became_active":"2024-09-19T14:29:51.036386+0000","last_became_peered":"2024-09-19T14:29:51.036386+0000","last_unstale":"2024-09-19T15:28:12.641824+0000","last_undegraded":"2024-09-19T15:28:12.641824+0000","last_fullsized":"2024-09-19T15:28:12.641824+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:47.754572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:32.184569+0000","last_change":"2024-09-19T14:02:36.913472+0000","last_active":"2024-09-19T15:28:32.184569+0000","last_peered":"2024-09-19T15:28:32.184569+0000","last_clean":"2024-09-19T15:28:32.184569+0000","last_became_active":"2024-09-19T14:02:36.912757+0000","last_became_peered":"2024-09-19T14:02:36.912757+0000","last_unstale":"2024-09-19T15:28:32.184569+0000","last_undegraded":"2024-09-19T15:28:32.184569+0000","last_fullsized":"2024-09-19T15:28:32.184569+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:28.705324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"268'3","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:02.668315+0000","last_change":"2024-09-19T14:02:29.726496+0000","last_active":"2024-09-19T15:30:02.668315+0000","last_peered":"2024-09-19T15:30:02.668315+0000","last_clean":"2024-09-19T15:30:02.668315+0000","last_became_active":"2024-09-19T14:02:29.725707+0000","last_became_peered":"2024-09-19T14:02:29.725707+0000","last_unstale":"2024-09-19T15:30:02.668315+0000","last_undegraded":"2024-09-19T15:30:02.668315+0000","last_fullsized":"2024-09-19T15:30:02.668315+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:19.846245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'2","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:27.170452+0000","last_change":"2024-09-19T13:56:23.181807+0000","last_active":"2024-09-19T15:27:27.170452+0000","last_peered":"2024-09-19T15:27:27.170452+0000","last_clean":"2024-09-19T15:27:27.170452+0000","last_became_active":"2024-09-19T13:56:23.180518+0000","last_became_peered":"2024-09-19T13:56:23.180518+0000","last_unstale":"2024-09-19T15:27:27.170452+0000","last_undegraded":"2024-09-19T15:27:27.170452+0000","last_fullsized":"2024-09-19T15:27:27.170452+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:39.826441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.620670+0000","last_change":"2024-09-19T14:29:51.030804+0000","last_active":"2024-09-19T15:28:12.620670+0000","last_peered":"2024-09-19T15:28:12.620670+0000","last_clean":"2024-09-19T15:28:12.620670+0000","last_became_active":"2024-09-19T14:29:51.030021+0000","last_became_peered":"2024-09-19T14:29:51.030021+0000","last_unstale":"2024-09-19T15:28:12.620670+0000","last_undegraded":"2024-09-19T15:28:12.620670+0000","last_fullsized":"2024-09-19T15:28:12.620670+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:03.409322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"265'3","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.178084+0000","last_change":"2024-09-19T14:02:37.052572+0000","last_active":"2024-09-19T15:28:02.178084+0000","last_peered":"2024-09-19T15:28:02.178084+0000","last_clean":"2024-09-19T15:28:02.178084+0000","last_became_active":"2024-09-19T14:02:37.051567+0000","last_became_peered":"2024-09-19T14:02:37.051567+0000","last_unstale":"2024-09-19T15:28:02.178084+0000","last_undegraded":"2024-09-19T15:28:02.178084+0000","last_fullsized":"2024-09-19T15:28:02.178084+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:19:54.029118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:17.548757+0000","last_change":"2024-09-19T14:02:29.748318+0000","last_active":"2024-09-19T15:28:17.548757+0000","last_peered":"2024-09-19T15:28:17.548757+0000","last_clean":"2024-09-19T15:28:17.548757+0000","last_became_active":"2024-09-19T14:02:29.747539+0000","last_became_peered":"2024-09-19T14:02:29.747539+0000","last_unstale":"2024-09-19T15:28:17.548757+0000","last_undegraded":"2024-09-19T15:28:17.548757+0000","last_fullsized":"2024-09-19T15:28:17.548757+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:42:39.905932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"268'12","reported_seq":110,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:32.402224+0000","last_change":"2024-09-19T13:56:23.174992+0000","last_active":"2024-09-19T15:29:32.402224+0000","last_peered":"2024-09-19T15:29:32.402224+0000","last_clean":"2024-09-19T15:29:32.402224+0000","last_became_active":"2024-09-19T13:56:23.173882+0000","last_became_peered":"2024-09-19T13:56:23.173882+0000","last_unstale":"2024-09-19T15:29:32.402224+0000","last_undegraded":"2024-09-19T15:29:32.402224+0000","last_fullsized":"2024-09-19T15:29:32.402224+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:21.063143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":61,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381230+0000","last_change":"2024-09-19T14:29:51.050041+0000","last_active":"2024-09-19T15:28:12.381230+0000","last_peered":"2024-09-19T15:28:12.381230+0000","last_clean":"2024-09-19T15:28:12.381230+0000","last_became_active":"2024-09-19T14:29:51.049356+0000","last_became_peered":"2024-09-19T14:29:51.049356+0000","last_unstale":"2024-09-19T15:28:12.381230+0000","last_undegraded":"2024-09-19T15:28:12.381230+0000","last_fullsized":"2024-09-19T15:28:12.381230+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:28.752706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"268'8","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:27.688992+0000","last_change":"2024-09-19T14:02:37.057637+0000","last_active":"2024-09-19T15:31:27.688992+0000","last_peered":"2024-09-19T15:31:27.688992+0000","last_clean":"2024-09-19T15:31:27.688992+0000","last_became_active":"2024-09-19T14:02:37.056814+0000","last_became_peered":"2024-09-19T14:02:37.056814+0000","last_unstale":"2024-09-19T15:31:27.688992+0000","last_undegraded":"2024-09-19T15:31:27.688992+0000","last_fullsized":"2024-09-19T15:31:27.688992+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:04:44.022820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.634682+0000","last_change":"2024-09-19T14:02:29.724061+0000","last_active":"2024-09-19T15:29:12.634682+0000","last_peered":"2024-09-19T15:29:12.634682+0000","last_clean":"2024-09-19T15:29:12.634682+0000","last_became_active":"2024-09-19T14:02:29.723298+0000","last_became_peered":"2024-09-19T14:02:29.723298+0000","last_unstale":"2024-09-19T15:29:12.634682+0000","last_undegraded":"2024-09-19T15:29:12.634682+0000","last_fullsized":"2024-09-19T15:29:12.634682+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:04:40.406319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'20","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644346+0000","last_change":"2024-09-19T13:56:23.190217+0000","last_active":"2024-09-19T15:28:22.644346+0000","last_peered":"2024-09-19T15:28:22.644346+0000","last_clean":"2024-09-19T15:28:22.644346+0000","last_became_active":"2024-09-19T13:56:23.189485+0000","last_became_peered":"2024-09-19T13:56:23.189485+0000","last_unstale":"2024-09-19T15:28:22.644346+0000","last_undegraded":"2024-09-19T15:28:22.644346+0000","last_fullsized":"2024-09-19T15:28:22.644346+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:26:00.955840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":106,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.601092+0000","last_change":"2024-09-19T14:29:51.029750+0000","last_active":"2024-09-19T15:28:12.601092+0000","last_peered":"2024-09-19T15:28:12.601092+0000","last_clean":"2024-09-19T15:28:12.601092+0000","last_became_active":"2024-09-19T14:29:51.028866+0000","last_became_peered":"2024-09-19T14:29:51.028866+0000","last_unstale":"2024-09-19T15:28:12.601092+0000","last_undegraded":"2024-09-19T15:28:12.601092+0000","last_fullsized":"2024-09-19T15:28:12.601092+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:57:37.166340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'5","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.469786+0000","last_change":"2024-09-19T14:02:36.917356+0000","last_active":"2024-09-19T15:31:38.469786+0000","last_peered":"2024-09-19T15:31:38.469786+0000","last_clean":"2024-09-19T15:31:38.469786+0000","last_became_active":"2024-09-19T14:02:36.916389+0000","last_became_peered":"2024-09-19T14:02:36.916389+0000","last_unstale":"2024-09-19T15:31:38.469786+0000","last_undegraded":"2024-09-19T15:31:38.469786+0000","last_fullsized":"2024-09-19T15:31:38.469786+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:02.036578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12336,"num_write":5,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"268'8","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:22.687755+0000","last_change":"2024-09-19T14:02:29.741915+0000","last_active":"2024-09-19T15:31:22.687755+0000","last_peered":"2024-09-19T15:31:22.687755+0000","last_clean":"2024-09-19T15:31:22.687755+0000","last_became_active":"2024-09-19T14:02:29.740227+0000","last_became_peered":"2024-09-19T14:02:29.740227+0000","last_unstale":"2024-09-19T15:31:22.687755+0000","last_undegraded":"2024-09-19T15:31:22.687755+0000","last_fullsized":"2024-09-19T15:31:22.687755+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:46.277985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":9218,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'41","reported_seq":190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.378845+0000","last_change":"2024-09-19T13:56:23.174685+0000","last_active":"2024-09-19T15:28:02.378845+0000","last_peered":"2024-09-19T15:28:02.378845+0000","last_clean":"2024-09-19T15:28:02.378845+0000","last_became_active":"2024-09-19T13:56:23.173938+0000","last_became_peered":"2024-09-19T13:56:23.173938+0000","last_unstale":"2024-09-19T15:28:02.378845+0000","last_undegraded":"2024-09-19T15:28:02.378845+0000","last_fullsized":"2024-09-19T15:28:02.378845+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:20.591650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":330,"num_read_kb":229,"num_write":110,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.549879+0000","last_change":"2024-09-19T14:29:51.026777+0000","last_active":"2024-09-19T15:28:22.549879+0000","last_peered":"2024-09-19T15:28:22.549879+0000","last_clean":"2024-09-19T15:28:22.549879+0000","last_became_active":"2024-09-19T14:29:51.025959+0000","last_became_peered":"2024-09-19T14:29:51.025959+0000","last_unstale":"2024-09-19T15:28:22.549879+0000","last_undegraded":"2024-09-19T15:28:22.549879+0000","last_fullsized":"2024-09-19T15:28:22.549879+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:11:23.290380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.378636+0000","last_change":"2024-09-19T14:02:36.912701+0000","last_active":"2024-09-19T15:28:02.378636+0000","last_peered":"2024-09-19T15:28:02.378636+0000","last_clean":"2024-09-19T15:28:02.378636+0000","last_became_active":"2024-09-19T14:02:36.911804+0000","last_became_peered":"2024-09-19T14:02:36.911804+0000","last_unstale":"2024-09-19T15:28:02.378636+0000","last_undegraded":"2024-09-19T15:28:02.378636+0000","last_fullsized":"2024-09-19T15:28:02.378636+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:12.422526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"268'8","reported_seq":89,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.538893+0000","last_change":"2024-09-19T14:02:29.748278+0000","last_active":"2024-09-19T15:31:39.538893+0000","last_peered":"2024-09-19T15:31:39.538893+0000","last_clean":"2024-09-19T15:31:39.538893+0000","last_became_active":"2024-09-19T14:02:29.747553+0000","last_became_peered":"2024-09-19T14:02:29.747553+0000","last_unstale":"2024-09-19T15:31:39.538893+0000","last_undegraded":"2024-09-19T15:31:39.538893+0000","last_fullsized":"2024-09-19T15:31:39.538893+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:20:14.376148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":21504,"num_write":8,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'275","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.618334+0000","last_change":"2024-09-19T13:56:23.186164+0000","last_active":"2024-09-19T15:28:02.618334+0000","last_peered":"2024-09-19T15:28:02.618334+0000","last_clean":"2024-09-19T15:28:02.618334+0000","last_became_active":"2024-09-19T13:56:23.185522+0000","last_became_peered":"2024-09-19T13:56:23.185522+0000","last_unstale":"2024-09-19T15:28:02.618334+0000","last_undegraded":"2024-09-19T15:28:02.618334+0000","last_fullsized":"2024-09-19T15:28:02.618334+0000","mapping_epoch":255,"log_start":"265'200","ondisk_log_start":"265'200","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:23.817224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2606,"num_read_kb":3112,"num_write":537,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.182535+0000","last_change":"2024-09-19T14:29:51.043009+0000","last_active":"2024-09-19T15:28:22.182535+0000","last_peered":"2024-09-19T15:28:22.182535+0000","last_clean":"2024-09-19T15:28:22.182535+0000","last_became_active":"2024-09-19T14:29:51.042287+0000","last_became_peered":"2024-09-19T14:29:51.042287+0000","last_unstale":"2024-09-19T15:28:22.182535+0000","last_undegraded":"2024-09-19T15:28:22.182535+0000","last_fullsized":"2024-09-19T15:28:22.182535+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:00:55.357725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"268'3","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:57.659838+0000","last_change":"2024-09-19T14:02:36.913575+0000","last_active":"2024-09-19T15:30:57.659838+0000","last_peered":"2024-09-19T15:30:57.659838+0000","last_clean":"2024-09-19T15:30:57.659838+0000","last_became_active":"2024-09-19T14:02:36.912642+0000","last_became_peered":"2024-09-19T14:02:36.912642+0000","last_unstale":"2024-09-19T15:30:57.659838+0000","last_undegraded":"2024-09-19T15:30:57.659838+0000","last_fullsized":"2024-09-19T15:30:57.659838+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:53.289654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.637948+0000","last_change":"2024-09-19T14:02:29.740640+0000","last_active":"2024-09-19T15:27:57.637948+0000","last_peered":"2024-09-19T15:27:57.637948+0000","last_clean":"2024-09-19T15:27:57.637948+0000","last_became_active":"2024-09-19T14:02:29.739397+0000","last_became_peered":"2024-09-19T14:02:29.739397+0000","last_unstale":"2024-09-19T15:27:57.637948+0000","last_undegraded":"2024-09-19T15:27:57.637948+0000","last_fullsized":"2024-09-19T15:27:57.637948+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:38.568040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'26","reported_seq":155,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.598838+0000","last_change":"2024-09-19T13:56:23.179600+0000","last_active":"2024-09-19T15:28:02.598838+0000","last_peered":"2024-09-19T15:28:02.598838+0000","last_clean":"2024-09-19T15:28:02.598838+0000","last_became_active":"2024-09-19T13:56:23.178722+0000","last_became_peered":"2024-09-19T13:56:23.178722+0000","last_unstale":"2024-09-19T15:28:02.598838+0000","last_undegraded":"2024-09-19T15:28:02.598838+0000","last_fullsized":"2024-09-19T15:28:02.598838+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:17.896929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":137,"num_write":65,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.180147+0000","last_change":"2024-09-19T14:29:51.040094+0000","last_active":"2024-09-19T15:28:12.180147+0000","last_peered":"2024-09-19T15:28:12.180147+0000","last_clean":"2024-09-19T15:28:12.180147+0000","last_became_active":"2024-09-19T14:29:51.037398+0000","last_became_peered":"2024-09-19T14:29:51.037398+0000","last_unstale":"2024-09-19T15:28:12.180147+0000","last_undegraded":"2024-09-19T15:28:12.180147+0000","last_fullsized":"2024-09-19T15:28:12.180147+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:38.720027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.382027+0000","last_change":"2024-09-19T14:02:36.929646+0000","last_active":"2024-09-19T15:28:02.382027+0000","last_peered":"2024-09-19T15:28:02.382027+0000","last_clean":"2024-09-19T15:28:02.382027+0000","last_became_active":"2024-09-19T14:02:36.928598+0000","last_became_peered":"2024-09-19T14:02:36.928598+0000","last_unstale":"2024-09-19T15:28:02.382027+0000","last_undegraded":"2024-09-19T15:28:02.382027+0000","last_fullsized":"2024-09-19T15:28:02.382027+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:55:11.565586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"268'2","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:02.405667+0000","last_change":"2024-09-19T14:02:29.738035+0000","last_active":"2024-09-19T15:30:02.405667+0000","last_peered":"2024-09-19T15:30:02.405667+0000","last_clean":"2024-09-19T15:30:02.405667+0000","last_became_active":"2024-09-19T14:02:29.737082+0000","last_became_peered":"2024-09-19T14:02:29.737082+0000","last_unstale":"2024-09-19T15:30:02.405667+0000","last_undegraded":"2024-09-19T15:30:02.405667+0000","last_fullsized":"2024-09-19T15:30:02.405667+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:59.761712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'51","reported_seq":222,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.381862+0000","last_change":"2024-09-19T13:56:23.173928+0000","last_active":"2024-09-19T15:28:02.381862+0000","last_peered":"2024-09-19T15:28:02.381862+0000","last_clean":"2024-09-19T15:28:02.381862+0000","last_became_active":"2024-09-19T13:56:23.173172+0000","last_became_peered":"2024-09-19T13:56:23.173172+0000","last_unstale":"2024-09-19T15:28:02.381862+0000","last_undegraded":"2024-09-19T15:28:02.381862+0000","last_fullsized":"2024-09-19T15:28:02.381862+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:40:50.508754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":432,"num_read_kb":295,"num_write":119,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644369+0000","last_change":"2024-09-19T14:29:51.048750+0000","last_active":"2024-09-19T15:28:22.644369+0000","last_peered":"2024-09-19T15:28:22.644369+0000","last_clean":"2024-09-19T15:28:22.644369+0000","last_became_active":"2024-09-19T14:29:51.047826+0000","last_became_peered":"2024-09-19T14:29:51.047826+0000","last_unstale":"2024-09-19T15:28:22.644369+0000","last_undegraded":"2024-09-19T15:28:22.644369+0000","last_fullsized":"2024-09-19T15:28:22.644369+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:01.510352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'5","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.598789+0000","last_change":"2024-09-19T14:02:36.910670+0000","last_active":"2024-09-19T15:28:02.598789+0000","last_peered":"2024-09-19T15:28:02.598789+0000","last_clean":"2024-09-19T15:28:02.598789+0000","last_became_active":"2024-09-19T14:02:36.910154+0000","last_became_peered":"2024-09-19T14:02:36.910154+0000","last_unstale":"2024-09-19T15:28:02.598789+0000","last_undegraded":"2024-09-19T15:28:02.598789+0000","last_fullsized":"2024-09-19T15:28:02.598789+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:30:56.428703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"268'2","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:02.408592+0000","last_change":"2024-09-19T14:02:29.723856+0000","last_active":"2024-09-19T15:30:02.408592+0000","last_peered":"2024-09-19T15:30:02.408592+0000","last_clean":"2024-09-19T15:30:02.408592+0000","last_became_active":"2024-09-19T14:02:29.723084+0000","last_became_peered":"2024-09-19T14:02:29.723084+0000","last_unstale":"2024-09-19T15:30:02.408592+0000","last_undegraded":"2024-09-19T15:30:02.408592+0000","last_fullsized":"2024-09-19T15:30:02.408592+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:57:24.394062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'52","reported_seq":217,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.648963+0000","last_change":"2024-09-19T13:56:23.182198+0000","last_active":"2024-09-19T15:28:42.648963+0000","last_peered":"2024-09-19T15:28:42.648963+0000","last_clean":"2024-09-19T15:28:42.648963+0000","last_became_active":"2024-09-19T13:56:23.181354+0000","last_became_peered":"2024-09-19T13:56:23.181354+0000","last_unstale":"2024-09-19T15:28:42.648963+0000","last_undegraded":"2024-09-19T15:28:42.648963+0000","last_fullsized":"2024-09-19T15:28:42.648963+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:38.576519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":381,"num_read_kb":254,"num_write":133,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'384","reported_seq":1089,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.579613+0000","last_change":"2024-09-19T13:40:34.279763+0000","last_active":"2024-09-19T15:31:40.579613+0000","last_peered":"2024-09-19T15:31:40.579613+0000","last_clean":"2024-09-19T15:31:40.579613+0000","last_became_active":"2024-09-19T13:40:34.278366+0000","last_became_peered":"2024-09-19T13:40:34.278366+0000","last_unstale":"2024-09-19T15:31:40.579613+0000","last_undegraded":"2024-09-19T15:31:40.579613+0000","last_fullsized":"2024-09-19T15:31:40.579613+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:54.618095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":664,"num_read_kb":97882,"num_write":1263,"num_write_kb":51204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'896","reported_seq":2622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:46.037523+0000","last_change":"2024-09-19T13:40:36.233984+0000","last_active":"2024-09-19T15:28:46.037523+0000","last_peered":"2024-09-19T15:28:46.037523+0000","last_clean":"2024-09-19T15:28:46.037523+0000","last_became_active":"2024-09-19T13:40:36.233265+0000","last_became_peered":"2024-09-19T13:40:36.233265+0000","last_unstale":"2024-09-19T15:28:46.037523+0000","last_undegraded":"2024-09-19T15:28:46.037523+0000","last_fullsized":"2024-09-19T15:28:46.037523+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":800,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:51:51.439880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4503,"num_read_kb":4037,"num_write":1205,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'293","reported_seq":916,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.476093+0000","last_change":"2024-09-19T13:40:34.240880+0000","last_active":"2024-09-19T15:31:40.476093+0000","last_peered":"2024-09-19T15:31:40.476093+0000","last_clean":"2024-09-19T15:31:40.476093+0000","last_became_active":"2024-09-19T13:40:34.240412+0000","last_became_peered":"2024-09-19T13:40:34.240412+0000","last_unstale":"2024-09-19T15:31:40.476093+0000","last_undegraded":"2024-09-19T15:31:40.476093+0000","last_fullsized":"2024-09-19T15:31:40.476093+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:44.406577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":459,"num_read_kb":36198,"num_write":952,"num_write_kb":29274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'618","reported_seq":2321,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.314706+0000","last_change":"2024-09-19T13:40:36.233243+0000","last_active":"2024-09-19T15:29:41.314706+0000","last_peered":"2024-09-19T15:29:41.314706+0000","last_clean":"2024-09-19T15:29:41.314706+0000","last_became_active":"2024-09-19T13:40:36.232504+0000","last_became_peered":"2024-09-19T13:40:36.232504+0000","last_unstale":"2024-09-19T15:29:41.314706+0000","last_undegraded":"2024-09-19T15:29:41.314706+0000","last_fullsized":"2024-09-19T15:29:41.314706+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":600,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:48.735786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3362,"num_read_kb":3070,"num_write":813,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'361","reported_seq":1042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.396201+0000","last_change":"2024-09-19T13:40:34.216282+0000","last_active":"2024-09-19T15:31:40.396201+0000","last_peered":"2024-09-19T15:31:40.396201+0000","last_clean":"2024-09-19T15:31:40.396201+0000","last_became_active":"2024-09-19T13:40:34.215960+0000","last_became_peered":"2024-09-19T13:40:34.215960+0000","last_unstale":"2024-09-19T15:31:40.396201+0000","last_undegraded":"2024-09-19T15:31:40.396201+0000","last_fullsized":"2024-09-19T15:31:40.396201+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:13:04.475058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":684,"num_read_kb":31785,"num_write":1188,"num_write_kb":29902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'838","reported_seq":2388,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.242934+0000","last_change":"2024-09-19T13:40:36.227193+0000","last_active":"2024-09-19T15:31:12.242934+0000","last_peered":"2024-09-19T15:31:12.242934+0000","last_clean":"2024-09-19T15:31:12.242934+0000","last_became_active":"2024-09-19T13:40:36.220563+0000","last_became_peered":"2024-09-19T13:40:36.220563+0000","last_unstale":"2024-09-19T15:31:12.242934+0000","last_undegraded":"2024-09-19T15:31:12.242934+0000","last_fullsized":"2024-09-19T15:31:12.242934+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:33.303811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4017,"num_read_kb":3603,"num_write":1098,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'358","reported_seq":1031,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.568644+0000","last_change":"2024-09-19T13:40:34.242237+0000","last_active":"2024-09-19T15:31:40.568644+0000","last_peered":"2024-09-19T15:31:40.568644+0000","last_clean":"2024-09-19T15:31:40.568644+0000","last_became_active":"2024-09-19T13:40:34.239843+0000","last_became_peered":"2024-09-19T13:40:34.239843+0000","last_unstale":"2024-09-19T15:31:40.568644+0000","last_undegraded":"2024-09-19T15:31:40.568644+0000","last_fullsized":"2024-09-19T15:31:40.568644+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:31.305832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136873,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":579,"num_read_kb":4189,"num_write":1155,"num_write_kb":27975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'1555","reported_seq":3224,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.276379+0000","last_change":"2024-09-19T13:40:36.226610+0000","last_active":"2024-09-19T15:31:12.276379+0000","last_peered":"2024-09-19T15:31:12.276379+0000","last_clean":"2024-09-19T15:31:12.276379+0000","last_became_active":"2024-09-19T13:40:36.225954+0000","last_became_peered":"2024-09-19T13:40:36.225954+0000","last_unstale":"2024-09-19T15:31:12.276379+0000","last_undegraded":"2024-09-19T15:31:12.276379+0000","last_fullsized":"2024-09-19T15:31:12.276379+0000","mapping_epoch":27,"log_start":"268'1500","ondisk_log_start":"268'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:17.018995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7021,"num_read_kb":6136,"num_write":2176,"num_write_kb":944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'323","reported_seq":1026,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.564014+0000","last_change":"2024-09-19T13:40:34.275994+0000","last_active":"2024-09-19T15:31:40.564014+0000","last_peered":"2024-09-19T15:31:40.564014+0000","last_clean":"2024-09-19T15:31:40.564014+0000","last_became_active":"2024-09-19T13:40:34.267254+0000","last_became_peered":"2024-09-19T13:40:34.267254+0000","last_unstale":"2024-09-19T15:31:40.564014+0000","last_undegraded":"2024-09-19T15:31:40.564014+0000","last_fullsized":"2024-09-19T15:31:40.564014+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:10:14.953671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":674,"num_read_kb":4762,"num_write":931,"num_write_kb":10224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"268'447","reported_seq":2099,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:07.396639+0000","last_change":"2024-09-19T13:40:36.221236+0000","last_active":"2024-09-19T15:29:07.396639+0000","last_peered":"2024-09-19T15:29:07.396639+0000","last_clean":"2024-09-19T15:29:07.396639+0000","last_became_active":"2024-09-19T13:40:36.220431+0000","last_became_peered":"2024-09-19T13:40:36.220431+0000","last_unstale":"2024-09-19T15:29:07.396639+0000","last_undegraded":"2024-09-19T15:29:07.396639+0000","last_fullsized":"2024-09-19T15:29:07.396639+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:52:16.868711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2602,"num_read_kb":2484,"num_write":543,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'313","reported_seq":959,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.520793+0000","last_change":"2024-09-19T13:40:34.226045+0000","last_active":"2024-09-19T15:31:40.520793+0000","last_peered":"2024-09-19T15:31:40.520793+0000","last_clean":"2024-09-19T15:31:40.520793+0000","last_became_active":"2024-09-19T13:40:34.218957+0000","last_became_peered":"2024-09-19T13:40:34.218957+0000","last_unstale":"2024-09-19T15:31:40.520793+0000","last_undegraded":"2024-09-19T15:31:40.520793+0000","last_fullsized":"2024-09-19T15:31:40.520793+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:01.849971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136870,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":503,"num_read_kb":8139,"num_write":970,"num_write_kb":24727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'795","reported_seq":2558,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.611809+0000","last_change":"2024-09-19T13:40:36.231857+0000","last_active":"2024-09-19T15:28:57.611809+0000","last_peered":"2024-09-19T15:28:57.611809+0000","last_clean":"2024-09-19T15:28:57.611809+0000","last_became_active":"2024-09-19T13:40:36.228785+0000","last_became_peered":"2024-09-19T13:40:36.228785+0000","last_unstale":"2024-09-19T15:28:57.611809+0000","last_undegraded":"2024-09-19T15:28:57.611809+0000","last_fullsized":"2024-09-19T15:28:57.611809+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:24:05.926374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4179,"num_read_kb":3830,"num_write":1044,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'342","reported_seq":990,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.579534+0000","last_change":"2024-09-19T13:40:34.268730+0000","last_active":"2024-09-19T15:31:40.579534+0000","last_peered":"2024-09-19T15:31:40.579534+0000","last_clean":"2024-09-19T15:31:40.579534+0000","last_became_active":"2024-09-19T13:40:34.267647+0000","last_became_peered":"2024-09-19T13:40:34.267647+0000","last_unstale":"2024-09-19T15:31:40.579534+0000","last_undegraded":"2024-09-19T15:31:40.579534+0000","last_fullsized":"2024-09-19T15:31:40.579534+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:41.507634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":19593,"num_write":1075,"num_write_kb":28817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"268'1154","reported_seq":2774,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.631097+0000","last_change":"2024-09-19T13:40:36.231346+0000","last_active":"2024-09-19T15:28:57.631097+0000","last_peered":"2024-09-19T15:28:57.631097+0000","last_clean":"2024-09-19T15:28:57.631097+0000","last_became_active":"2024-09-19T13:40:36.230581+0000","last_became_peered":"2024-09-19T13:40:36.230581+0000","last_unstale":"2024-09-19T15:28:57.631097+0000","last_undegraded":"2024-09-19T15:28:57.631097+0000","last_fullsized":"2024-09-19T15:28:57.631097+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":1100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:33:28.578391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5418,"num_read_kb":4799,"num_write":1598,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'386","reported_seq":1129,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.513098+0000","last_change":"2024-09-19T13:40:34.237921+0000","last_active":"2024-09-19T15:31:40.513098+0000","last_peered":"2024-09-19T15:31:40.513098+0000","last_clean":"2024-09-19T15:31:40.513098+0000","last_became_active":"2024-09-19T13:40:34.237561+0000","last_became_peered":"2024-09-19T13:40:34.237561+0000","last_unstale":"2024-09-19T15:31:40.513098+0000","last_undegraded":"2024-09-19T15:31:40.513098+0000","last_fullsized":"2024-09-19T15:31:40.513098+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:55.737645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136898,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":851,"num_read_kb":72188,"num_write":1180,"num_write_kb":41551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'651","reported_seq":2356,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.323183+0000","last_change":"2024-09-19T13:40:36.223002+0000","last_active":"2024-09-19T15:31:12.323183+0000","last_peered":"2024-09-19T15:31:12.323183+0000","last_clean":"2024-09-19T15:31:12.323183+0000","last_became_active":"2024-09-19T13:40:36.221587+0000","last_became_peered":"2024-09-19T13:40:36.221587+0000","last_unstale":"2024-09-19T15:31:12.323183+0000","last_undegraded":"2024-09-19T15:31:12.323183+0000","last_fullsized":"2024-09-19T15:31:12.323183+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":600,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:09:30.633730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3331,"num_read_kb":3024,"num_write":858,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'1220","reported_seq":3029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:57.597578+0000","last_change":"2024-09-19T13:40:36.228802+0000","last_active":"2024-09-19T15:27:57.597578+0000","last_peered":"2024-09-19T15:27:57.597578+0000","last_clean":"2024-09-19T15:27:57.597578+0000","last_became_active":"2024-09-19T13:40:36.220889+0000","last_became_peered":"2024-09-19T13:40:36.220889+0000","last_unstale":"2024-09-19T15:27:57.597578+0000","last_undegraded":"2024-09-19T15:27:57.597578+0000","last_fullsized":"2024-09-19T15:27:57.597578+0000","mapping_epoch":27,"log_start":"268'1200","ondisk_log_start":"268'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":1200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:58.428789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5895,"num_read_kb":5235,"num_write":1696,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'416","reported_seq":1146,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.577064+0000","last_change":"2024-09-19T13:40:34.280286+0000","last_active":"2024-09-19T15:31:40.577064+0000","last_peered":"2024-09-19T15:31:40.577064+0000","last_clean":"2024-09-19T15:31:40.577064+0000","last_became_active":"2024-09-19T13:40:34.278991+0000","last_became_peered":"2024-09-19T13:40:34.278991+0000","last_unstale":"2024-09-19T15:31:40.577064+0000","last_undegraded":"2024-09-19T15:31:40.577064+0000","last_fullsized":"2024-09-19T15:31:40.577064+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:34.156634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136848,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":967,"num_read_kb":8273,"num_write":1275,"num_write_kb":26935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'1133","reported_seq":2648,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:39.715402+0000","last_change":"2024-09-19T13:40:36.233737+0000","last_active":"2024-09-19T15:28:39.715402+0000","last_peered":"2024-09-19T15:28:39.715402+0000","last_clean":"2024-09-19T15:28:39.715402+0000","last_became_active":"2024-09-19T13:40:36.233032+0000","last_became_peered":"2024-09-19T13:40:36.233032+0000","last_unstale":"2024-09-19T15:28:39.715402+0000","last_undegraded":"2024-09-19T15:28:39.715402+0000","last_fullsized":"2024-09-19T15:28:39.715402+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":1100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:01.168529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5185,"num_read_kb":4564,"num_write":1576,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'361","reported_seq":1020,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.507998+0000","last_change":"2024-09-19T13:40:34.258739+0000","last_active":"2024-09-19T15:31:40.507998+0000","last_peered":"2024-09-19T15:31:40.507998+0000","last_clean":"2024-09-19T15:31:40.507998+0000","last_became_active":"2024-09-19T13:40:34.257994+0000","last_became_peered":"2024-09-19T13:40:34.257994+0000","last_unstale":"2024-09-19T15:31:40.507998+0000","last_undegraded":"2024-09-19T15:31:40.507998+0000","last_fullsized":"2024-09-19T15:31:40.507998+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:37:29.815057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":609,"num_read_kb":26261,"num_write":1202,"num_write_kb":39497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"268'589","reported_seq":2568,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:46.037916+0000","last_change":"2024-09-19T13:40:36.232300+0000","last_active":"2024-09-19T15:28:46.037916+0000","last_peered":"2024-09-19T15:28:46.037916+0000","last_clean":"2024-09-19T15:28:46.037916+0000","last_became_active":"2024-09-19T13:40:36.231554+0000","last_became_peered":"2024-09-19T13:40:36.231554+0000","last_unstale":"2024-09-19T15:28:46.037916+0000","last_undegraded":"2024-09-19T15:28:46.037916+0000","last_fullsized":"2024-09-19T15:28:46.037916+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":500,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:04.811846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3450,"num_read_kb":3252,"num_write":736,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'354","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.463558+0000","last_change":"2024-09-19T13:40:34.265083+0000","last_active":"2024-09-19T15:31:40.463558+0000","last_peered":"2024-09-19T15:31:40.463558+0000","last_clean":"2024-09-19T15:31:40.463558+0000","last_became_active":"2024-09-19T13:40:34.264349+0000","last_became_peered":"2024-09-19T13:40:34.264349+0000","last_unstale":"2024-09-19T15:31:40.463558+0000","last_undegraded":"2024-09-19T15:31:40.463558+0000","last_fullsized":"2024-09-19T15:31:40.463558+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:55.371080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":590,"num_read_kb":18139,"num_write":1138,"num_write_kb":28020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'533","reported_seq":2156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.231056+0000","last_change":"2024-09-19T13:40:36.222241+0000","last_active":"2024-09-19T15:29:41.231056+0000","last_peered":"2024-09-19T15:29:41.231056+0000","last_clean":"2024-09-19T15:29:41.231056+0000","last_became_active":"2024-09-19T13:40:36.221266+0000","last_became_peered":"2024-09-19T13:40:36.221266+0000","last_unstale":"2024-09-19T15:29:41.231056+0000","last_undegraded":"2024-09-19T15:29:41.231056+0000","last_fullsized":"2024-09-19T15:29:41.231056+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":500,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:17.944396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2921,"num_read_kb":2700,"num_write":709,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'351","reported_seq":1198,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.535619+0000","last_change":"2024-09-19T13:40:34.266244+0000","last_active":"2024-09-19T15:31:40.535619+0000","last_peered":"2024-09-19T15:31:40.535619+0000","last_clean":"2024-09-19T15:31:40.535619+0000","last_became_active":"2024-09-19T13:40:34.262084+0000","last_became_peered":"2024-09-19T13:40:34.262084+0000","last_unstale":"2024-09-19T15:31:40.535619+0000","last_undegraded":"2024-09-19T15:31:40.535619+0000","last_fullsized":"2024-09-19T15:31:40.535619+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:10:19.847500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1177,"num_read_kb":45013,"num_write":1025,"num_write_kb":26916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"268'461","reported_seq":2066,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.328055+0000","last_change":"2024-09-19T13:40:36.216484+0000","last_active":"2024-09-19T15:29:48.328055+0000","last_peered":"2024-09-19T15:29:48.328055+0000","last_clean":"2024-09-19T15:29:48.328055+0000","last_became_active":"2024-09-19T13:40:36.216082+0000","last_became_peered":"2024-09-19T13:40:36.216082+0000","last_unstale":"2024-09-19T15:29:48.328055+0000","last_undegraded":"2024-09-19T15:29:48.328055+0000","last_fullsized":"2024-09-19T15:29:48.328055+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:42.568128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2409,"num_read_kb":2273,"num_write":537,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'339","reported_seq":985,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.526313+0000","last_change":"2024-09-19T13:40:34.238078+0000","last_active":"2024-09-19T15:31:40.526313+0000","last_peered":"2024-09-19T15:31:40.526313+0000","last_clean":"2024-09-19T15:31:40.526313+0000","last_became_active":"2024-09-19T13:40:34.237589+0000","last_became_peered":"2024-09-19T13:40:34.237589+0000","last_unstale":"2024-09-19T15:31:40.526313+0000","last_undegraded":"2024-09-19T15:31:40.526313+0000","last_fullsized":"2024-09-19T15:31:40.526313+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:46.977541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":471,"num_read_kb":27580,"num_write":960,"num_write_kb":52672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'576","reported_seq":2260,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.332414+0000","last_change":"2024-09-19T13:40:36.229601+0000","last_active":"2024-09-19T15:29:48.332414+0000","last_peered":"2024-09-19T15:29:48.332414+0000","last_clean":"2024-09-19T15:29:48.332414+0000","last_became_active":"2024-09-19T13:40:36.220183+0000","last_became_peered":"2024-09-19T13:40:36.220183+0000","last_unstale":"2024-09-19T15:29:48.332414+0000","last_undegraded":"2024-09-19T15:29:48.332414+0000","last_fullsized":"2024-09-19T15:29:48.332414+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:46:00.909462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3052,"num_read_kb":2823,"num_write":743,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'385","reported_seq":1091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.561519+0000","last_change":"2024-09-19T13:40:34.225269+0000","last_active":"2024-09-19T15:31:40.561519+0000","last_peered":"2024-09-19T15:31:40.561519+0000","last_clean":"2024-09-19T15:31:40.561519+0000","last_became_active":"2024-09-19T13:40:34.224813+0000","last_became_peered":"2024-09-19T13:40:34.224813+0000","last_unstale":"2024-09-19T15:31:40.561519+0000","last_undegraded":"2024-09-19T15:31:40.561519+0000","last_fullsized":"2024-09-19T15:31:40.561519+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:19.334744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":831,"num_read_kb":1243,"num_write":1485,"num_write_kb":25860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'139","reported_seq":664,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.886707+0000","last_change":"2024-09-19T13:40:44.242817+0000","last_active":"2024-09-19T15:29:50.886707+0000","last_peered":"2024-09-19T15:29:50.886707+0000","last_clean":"2024-09-19T15:29:50.886707+0000","last_became_active":"2024-09-19T13:40:44.242028+0000","last_became_peered":"2024-09-19T13:40:44.242028+0000","last_unstale":"2024-09-19T15:29:50.886707+0000","last_undegraded":"2024-09-19T15:29:50.886707+0000","last_fullsized":"2024-09-19T15:29:50.886707+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:07.663672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":180,"num_write":320,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'408","reported_seq":1932,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:35.019802+0000","last_change":"2024-09-19T13:40:36.219418+0000","last_active":"2024-09-19T15:28:35.019802+0000","last_peered":"2024-09-19T15:28:35.019802+0000","last_clean":"2024-09-19T15:28:35.019802+0000","last_became_active":"2024-09-19T13:40:36.218091+0000","last_became_peered":"2024-09-19T13:40:36.218091+0000","last_unstale":"2024-09-19T15:28:35.019802+0000","last_undegraded":"2024-09-19T15:28:35.019802+0000","last_fullsized":"2024-09-19T15:28:35.019802+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:59.320209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2211,"num_read_kb":2096,"num_write":485,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"268'348","reported_seq":982,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.567828+0000","last_change":"2024-09-19T13:41:05.387127+0000","last_active":"2024-09-19T15:31:40.567828+0000","last_peered":"2024-09-19T15:31:40.567828+0000","last_clean":"2024-09-19T15:31:40.567828+0000","last_became_active":"2024-09-19T13:41:05.386216+0000","last_became_peered":"2024-09-19T13:41:05.386216+0000","last_unstale":"2024-09-19T15:31:40.567828+0000","last_undegraded":"2024-09-19T15:31:40.567828+0000","last_fullsized":"2024-09-19T15:31:40.567828+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:44:15.979639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":616,"num_read_kb":13820,"num_write":1168,"num_write_kb":52710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:02.604412+0000","last_change":"2024-09-19T13:40:38.223574+0000","last_active":"2024-09-19T15:27:02.604412+0000","last_peered":"2024-09-19T15:27:02.604412+0000","last_clean":"2024-09-19T15:27:02.604412+0000","last_became_active":"2024-09-19T13:40:38.222863+0000","last_became_peered":"2024-09-19T13:40:38.222863+0000","last_unstale":"2024-09-19T15:27:02.604412+0000","last_undegraded":"2024-09-19T15:27:02.604412+0000","last_fullsized":"2024-09-19T15:27:02.604412+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:15:56.276142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'384","reported_seq":1029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.530361+0000","last_change":"2024-09-19T13:40:40.231128+0000","last_active":"2024-09-19T15:31:39.530361+0000","last_peered":"2024-09-19T15:31:39.530361+0000","last_clean":"2024-09-19T15:31:39.530361+0000","last_became_active":"2024-09-19T13:40:40.230368+0000","last_became_peered":"2024-09-19T13:40:40.230368+0000","last_unstale":"2024-09-19T15:31:39.530361+0000","last_undegraded":"2024-09-19T15:31:39.530361+0000","last_fullsized":"2024-09-19T15:31:39.530361+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:13:15.313671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46964,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":623,"num_read_kb":1259,"num_write":490,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:02.624637+0000","last_change":"2024-09-19T13:40:42.240924+0000","last_active":"2024-09-19T15:27:02.624637+0000","last_peered":"2024-09-19T15:27:02.624637+0000","last_clean":"2024-09-19T15:27:02.624637+0000","last_became_active":"2024-09-19T13:40:42.240244+0000","last_became_peered":"2024-09-19T13:40:42.240244+0000","last_unstale":"2024-09-19T15:27:02.624637+0000","last_undegraded":"2024-09-19T15:27:02.624637+0000","last_fullsized":"2024-09-19T15:27:02.624637+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:06.922385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'2486","reported_seq":4344,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:45.480776+0000","last_change":"2024-09-19T13:40:44.263920+0000","last_active":"2024-09-19T15:29:45.480776+0000","last_peered":"2024-09-19T15:29:45.480776+0000","last_clean":"2024-09-19T15:29:45.480776+0000","last_became_active":"2024-09-19T13:40:44.263152+0000","last_became_peered":"2024-09-19T13:40:44.263152+0000","last_unstale":"2024-09-19T15:29:45.480776+0000","last_undegraded":"2024-09-19T15:29:45.480776+0000","last_fullsized":"2024-09-19T15:29:45.480776+0000","mapping_epoch":35,"log_start":"268'2400","ondisk_log_start":"268'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":2400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:49:06.263897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6208,"num_read_kb":6212,"num_write":5020,"num_write_kb":1848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'368","reported_seq":1865,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:35.016803+0000","last_change":"2024-09-19T13:40:36.242921+0000","last_active":"2024-09-19T15:28:35.016803+0000","last_peered":"2024-09-19T15:28:35.016803+0000","last_clean":"2024-09-19T15:28:35.016803+0000","last_became_active":"2024-09-19T13:40:36.242260+0000","last_became_peered":"2024-09-19T13:40:36.242260+0000","last_unstale":"2024-09-19T15:28:35.016803+0000","last_undegraded":"2024-09-19T15:28:35.016803+0000","last_fullsized":"2024-09-19T15:28:35.016803+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:56.906330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2141,"num_read_kb":2035,"num_write":405,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'304","reported_seq":958,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.589796+0000","last_change":"2024-09-19T13:40:34.255205+0000","last_active":"2024-09-19T15:31:40.589796+0000","last_peered":"2024-09-19T15:31:40.589796+0000","last_clean":"2024-09-19T15:31:40.589796+0000","last_became_active":"2024-09-19T13:40:34.254811+0000","last_became_peered":"2024-09-19T13:40:34.254811+0000","last_unstale":"2024-09-19T15:31:40.589796+0000","last_undegraded":"2024-09-19T15:31:40.589796+0000","last_fullsized":"2024-09-19T15:31:40.589796+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:45.032111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":583,"num_read_kb":3104,"num_write":1034,"num_write_kb":15827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:13.233018+0000","last_change":"2024-09-19T13:40:38.234491+0000","last_active":"2024-09-19T15:28:13.233018+0000","last_peered":"2024-09-19T15:28:13.233018+0000","last_clean":"2024-09-19T15:28:13.233018+0000","last_became_active":"2024-09-19T13:40:38.233854+0000","last_became_peered":"2024-09-19T13:40:38.233854+0000","last_unstale":"2024-09-19T15:28:13.233018+0000","last_undegraded":"2024-09-19T15:28:13.233018+0000","last_fullsized":"2024-09-19T15:28:13.233018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:58.032011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'125","reported_seq":693,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.055494+0000","last_change":"2024-09-19T13:40:40.245668+0000","last_active":"2024-09-19T15:31:18.055494+0000","last_peered":"2024-09-19T15:31:18.055494+0000","last_clean":"2024-09-19T15:31:18.055494+0000","last_became_active":"2024-09-19T13:40:40.244841+0000","last_became_peered":"2024-09-19T13:40:40.244841+0000","last_unstale":"2024-09-19T15:31:18.055494+0000","last_undegraded":"2024-09-19T15:31:18.055494+0000","last_fullsized":"2024-09-19T15:31:18.055494+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:42.542622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":152,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:02.585177+0000","last_change":"2024-09-19T13:40:42.235946+0000","last_active":"2024-09-19T15:27:02.585177+0000","last_peered":"2024-09-19T15:27:02.585177+0000","last_clean":"2024-09-19T15:27:02.585177+0000","last_became_active":"2024-09-19T13:40:42.235151+0000","last_became_peered":"2024-09-19T13:40:42.235151+0000","last_unstale":"2024-09-19T15:27:02.585177+0000","last_undegraded":"2024-09-19T15:27:02.585177+0000","last_fullsized":"2024-09-19T15:27:02.585177+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:38.338083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'95","reported_seq":615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:17.181187+0000","last_change":"2024-09-19T13:40:44.263112+0000","last_active":"2024-09-19T15:28:17.181187+0000","last_peered":"2024-09-19T15:28:17.181187+0000","last_clean":"2024-09-19T15:28:17.181187+0000","last_became_active":"2024-09-19T13:40:44.262343+0000","last_became_peered":"2024-09-19T13:40:44.262343+0000","last_unstale":"2024-09-19T15:28:17.181187+0000","last_undegraded":"2024-09-19T15:28:17.181187+0000","last_fullsized":"2024-09-19T15:28:17.181187+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:52.097942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":127,"num_write":220,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'737","reported_seq":2237,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:49.328720+0000","last_change":"2024-09-19T13:40:36.225854+0000","last_active":"2024-09-19T15:28:49.328720+0000","last_peered":"2024-09-19T15:28:49.328720+0000","last_clean":"2024-09-19T15:28:49.328720+0000","last_became_active":"2024-09-19T13:40:36.225170+0000","last_became_peered":"2024-09-19T13:40:36.225170+0000","last_unstale":"2024-09-19T15:28:49.328720+0000","last_undegraded":"2024-09-19T15:28:49.328720+0000","last_fullsized":"2024-09-19T15:28:49.328720+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":700,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:12:27.103294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3445,"num_read_kb":3119,"num_write":970,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'347","reported_seq":978,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.593200+0000","last_change":"2024-09-19T13:40:34.274237+0000","last_active":"2024-09-19T15:31:40.593200+0000","last_peered":"2024-09-19T15:31:40.593200+0000","last_clean":"2024-09-19T15:31:40.593200+0000","last_became_active":"2024-09-19T13:40:34.273656+0000","last_became_peered":"2024-09-19T13:40:34.273656+0000","last_unstale":"2024-09-19T15:31:40.593200+0000","last_undegraded":"2024-09-19T15:31:40.593200+0000","last_fullsized":"2024-09-19T15:31:40.593200+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:26.259004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136842,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":513,"num_read_kb":12420,"num_write":1036,"num_write_kb":39158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:03.216447+0000","last_change":"2024-09-19T13:40:38.220743+0000","last_active":"2024-09-19T15:27:03.216447+0000","last_peered":"2024-09-19T15:27:03.216447+0000","last_clean":"2024-09-19T15:27:03.216447+0000","last_became_active":"2024-09-19T13:40:38.220474+0000","last_became_peered":"2024-09-19T13:40:38.220474+0000","last_unstale":"2024-09-19T15:27:03.216447+0000","last_undegraded":"2024-09-19T15:27:03.216447+0000","last_fullsized":"2024-09-19T15:27:03.216447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:08.656145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'187","reported_seq":780,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.159010+0000","last_change":"2024-09-19T13:40:40.248851+0000","last_active":"2024-09-19T15:31:18.159010+0000","last_peered":"2024-09-19T15:31:18.159010+0000","last_clean":"2024-09-19T15:31:18.159010+0000","last_became_active":"2024-09-19T13:40:40.247893+0000","last_became_peered":"2024-09-19T13:40:40.247893+0000","last_unstale":"2024-09-19T15:31:18.159010+0000","last_undegraded":"2024-09-19T15:31:18.159010+0000","last_fullsized":"2024-09-19T15:31:18.159010+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:37:12.351165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":225,"num_write":160,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'761","reported_seq":3180,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.162462+0000","last_change":"2024-09-19T13:40:42.239953+0000","last_active":"2024-09-19T15:31:38.162462+0000","last_peered":"2024-09-19T15:31:38.162462+0000","last_clean":"2024-09-19T15:31:38.162462+0000","last_became_active":"2024-09-19T13:40:42.239059+0000","last_became_peered":"2024-09-19T13:40:42.239059+0000","last_unstale":"2024-09-19T15:31:38.162462+0000","last_undegraded":"2024-09-19T15:31:38.162462+0000","last_fullsized":"2024-09-19T15:31:38.162462+0000","mapping_epoch":33,"log_start":"268'701","ondisk_log_start":"268'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":701,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:40.662697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'225","reported_seq":1068,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:51.070933+0000","last_change":"2024-09-19T13:40:44.278447+0000","last_active":"2024-09-19T15:29:51.070933+0000","last_peered":"2024-09-19T15:29:51.070933+0000","last_clean":"2024-09-19T15:29:51.070933+0000","last_became_active":"2024-09-19T13:40:44.277966+0000","last_became_peered":"2024-09-19T13:40:44.277966+0000","last_unstale":"2024-09-19T15:29:51.070933+0000","last_undegraded":"2024-09-19T15:29:51.070933+0000","last_fullsized":"2024-09-19T15:29:51.070933+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:46.773156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":650,"num_read_kb":649,"num_write":494,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'747","reported_seq":2159,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:26:58.215034+0000","last_change":"2024-09-19T13:40:36.238808+0000","last_active":"2024-09-19T15:26:58.215034+0000","last_peered":"2024-09-19T15:26:58.215034+0000","last_clean":"2024-09-19T15:26:58.215034+0000","last_became_active":"2024-09-19T13:40:36.238400+0000","last_became_peered":"2024-09-19T13:40:36.238400+0000","last_unstale":"2024-09-19T15:26:58.215034+0000","last_undegraded":"2024-09-19T15:26:58.215034+0000","last_fullsized":"2024-09-19T15:26:58.215034+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:37.752219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3489,"num_read_kb":3124,"num_write":1003,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'393","reported_seq":1075,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.558573+0000","last_change":"2024-09-19T13:40:34.258945+0000","last_active":"2024-09-19T15:31:40.558573+0000","last_peered":"2024-09-19T15:31:40.558573+0000","last_clean":"2024-09-19T15:31:40.558573+0000","last_became_active":"2024-09-19T13:40:34.257596+0000","last_became_peered":"2024-09-19T13:40:34.257596+0000","last_unstale":"2024-09-19T15:31:40.558573+0000","last_undegraded":"2024-09-19T15:31:40.558573+0000","last_fullsized":"2024-09-19T15:31:40.558573+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:10:14.579685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":35384,"num_write":1329,"num_write_kb":23932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:02.604463+0000","last_change":"2024-09-19T13:40:38.212988+0000","last_active":"2024-09-19T15:27:02.604463+0000","last_peered":"2024-09-19T15:27:02.604463+0000","last_clean":"2024-09-19T15:27:02.604463+0000","last_became_active":"2024-09-19T13:40:38.212327+0000","last_became_peered":"2024-09-19T13:40:38.212327+0000","last_unstale":"2024-09-19T15:27:02.604463+0000","last_undegraded":"2024-09-19T15:27:02.604463+0000","last_fullsized":"2024-09-19T15:27:02.604463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:22:45.697525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'314","reported_seq":934,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.094382+0000","last_change":"2024-09-19T13:40:40.226231+0000","last_active":"2024-09-19T15:31:39.094382+0000","last_peered":"2024-09-19T15:31:39.094382+0000","last_clean":"2024-09-19T15:31:39.094382+0000","last_became_active":"2024-09-19T13:40:40.225512+0000","last_became_peered":"2024-09-19T13:40:40.225512+0000","last_unstale":"2024-09-19T15:31:39.094382+0000","last_undegraded":"2024-09-19T15:31:39.094382+0000","last_fullsized":"2024-09-19T15:31:39.094382+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:59:24.943872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43264,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":513,"num_read_kb":1124,"num_write":410,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'789","reported_seq":2996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.553852+0000","last_change":"2024-09-19T13:40:42.264377+0000","last_active":"2024-09-19T15:31:40.553852+0000","last_peered":"2024-09-19T15:31:40.553852+0000","last_clean":"2024-09-19T15:31:40.553852+0000","last_became_active":"2024-09-19T13:40:42.263635+0000","last_became_peered":"2024-09-19T13:40:42.263635+0000","last_unstale":"2024-09-19T15:31:40.553852+0000","last_undegraded":"2024-09-19T15:31:40.553852+0000","last_fullsized":"2024-09-19T15:31:40.553852+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:30.524751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'499","reported_seq":2102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.630887+0000","last_change":"2024-09-19T13:40:36.241060+0000","last_active":"2024-09-19T15:28:57.630887+0000","last_peered":"2024-09-19T15:28:57.630887+0000","last_clean":"2024-09-19T15:28:57.630887+0000","last_became_active":"2024-09-19T13:40:36.235739+0000","last_became_peered":"2024-09-19T13:40:36.235739+0000","last_unstale":"2024-09-19T15:28:57.630887+0000","last_undegraded":"2024-09-19T15:28:57.630887+0000","last_fullsized":"2024-09-19T15:28:57.630887+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:36:20.856962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2574,"num_read_kb":2392,"num_write":618,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'357","reported_seq":1072,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.548394+0000","last_change":"2024-09-19T13:41:05.310671+0000","last_active":"2024-09-19T15:31:40.548394+0000","last_peered":"2024-09-19T15:31:40.548394+0000","last_clean":"2024-09-19T15:31:40.548394+0000","last_became_active":"2024-09-19T13:41:05.309594+0000","last_became_peered":"2024-09-19T13:41:05.309594+0000","last_unstale":"2024-09-19T15:31:40.548394+0000","last_undegraded":"2024-09-19T15:31:40.548394+0000","last_fullsized":"2024-09-19T15:31:40.548394+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:17.208658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":758,"num_read_kb":65190,"num_write":1172,"num_write_kb":23524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.653933+0000","last_change":"2024-09-19T13:40:38.234609+0000","last_active":"2024-09-19T15:29:02.653933+0000","last_peered":"2024-09-19T15:29:02.653933+0000","last_clean":"2024-09-19T15:29:02.653933+0000","last_became_active":"2024-09-19T13:40:38.233892+0000","last_became_peered":"2024-09-19T13:40:38.233892+0000","last_unstale":"2024-09-19T15:29:02.653933+0000","last_undegraded":"2024-09-19T15:29:02.653933+0000","last_fullsized":"2024-09-19T15:29:02.653933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:30.027284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'458","reported_seq":1165,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.812321+0000","last_change":"2024-09-19T13:40:40.233291+0000","last_active":"2024-09-19T15:31:39.812321+0000","last_peered":"2024-09-19T15:31:39.812321+0000","last_clean":"2024-09-19T15:31:39.812321+0000","last_became_active":"2024-09-19T13:40:40.232582+0000","last_became_peered":"2024-09-19T13:40:40.232582+0000","last_unstale":"2024-09-19T15:31:39.812321+0000","last_undegraded":"2024-09-19T15:31:39.812321+0000","last_fullsized":"2024-09-19T15:31:39.812321+0000","mapping_epoch":31,"log_start":"268'400","ondisk_log_start":"268'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:05.930746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44624,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":740,"num_read_kb":1351,"num_write":560,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.388312+0000","last_change":"2024-09-19T13:40:42.240589+0000","last_active":"2024-09-19T15:28:42.388312+0000","last_peered":"2024-09-19T15:28:42.388312+0000","last_clean":"2024-09-19T15:28:42.388312+0000","last_became_active":"2024-09-19T13:40:42.239961+0000","last_became_peered":"2024-09-19T13:40:42.239961+0000","last_unstale":"2024-09-19T15:28:42.388312+0000","last_undegraded":"2024-09-19T15:28:42.388312+0000","last_fullsized":"2024-09-19T15:28:42.388312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:04.578390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'544","reported_seq":1392,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.257388+0000","last_change":"2024-09-19T13:40:44.264532+0000","last_active":"2024-09-19T15:31:13.257388+0000","last_peered":"2024-09-19T15:31:13.257388+0000","last_clean":"2024-09-19T15:31:13.257388+0000","last_became_active":"2024-09-19T13:40:44.263313+0000","last_became_peered":"2024-09-19T13:40:44.263313+0000","last_unstale":"2024-09-19T15:31:13.257388+0000","last_undegraded":"2024-09-19T15:31:13.257388+0000","last_fullsized":"2024-09-19T15:31:13.257388+0000","mapping_epoch":35,"log_start":"268'500","ondisk_log_start":"268'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:17.459491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1297,"num_read_kb":1297,"num_write":1122,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'466","reported_seq":2113,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.656141+0000","last_change":"2024-09-19T13:40:36.219545+0000","last_active":"2024-09-19T15:29:50.656141+0000","last_peered":"2024-09-19T15:29:50.656141+0000","last_clean":"2024-09-19T15:29:50.656141+0000","last_became_active":"2024-09-19T13:40:36.218822+0000","last_became_peered":"2024-09-19T13:40:36.218822+0000","last_unstale":"2024-09-19T15:29:50.656141+0000","last_undegraded":"2024-09-19T15:29:50.656141+0000","last_fullsized":"2024-09-19T15:29:50.656141+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:28.807691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2519,"num_read_kb":2376,"num_write":558,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'323","reported_seq":976,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.542493+0000","last_change":"2024-09-19T13:40:34.279254+0000","last_active":"2024-09-19T15:31:40.542493+0000","last_peered":"2024-09-19T15:31:40.542493+0000","last_clean":"2024-09-19T15:31:40.542493+0000","last_became_active":"2024-09-19T13:40:34.278684+0000","last_became_peered":"2024-09-19T13:40:34.278684+0000","last_unstale":"2024-09-19T15:31:40.542493+0000","last_undegraded":"2024-09-19T15:31:40.542493+0000","last_fullsized":"2024-09-19T15:31:40.542493+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:10.126915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":542,"num_read_kb":16871,"num_write":997,"num_write_kb":22319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.557575+0000","last_change":"2024-09-19T13:40:38.229050+0000","last_active":"2024-09-19T15:29:02.557575+0000","last_peered":"2024-09-19T15:29:02.557575+0000","last_clean":"2024-09-19T15:29:02.557575+0000","last_became_active":"2024-09-19T13:40:38.228765+0000","last_became_peered":"2024-09-19T13:40:38.228765+0000","last_unstale":"2024-09-19T15:29:02.557575+0000","last_undegraded":"2024-09-19T15:29:02.557575+0000","last_fullsized":"2024-09-19T15:29:02.557575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:11.148186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'314","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.609856+0000","last_change":"2024-09-19T13:40:40.228045+0000","last_active":"2024-09-19T15:31:40.609856+0000","last_peered":"2024-09-19T15:31:40.609856+0000","last_clean":"2024-09-19T15:31:40.609856+0000","last_became_active":"2024-09-19T13:40:40.226899+0000","last_became_peered":"2024-09-19T13:40:40.226899+0000","last_unstale":"2024-09-19T15:31:40.609856+0000","last_undegraded":"2024-09-19T15:31:40.609856+0000","last_fullsized":"2024-09-19T15:31:40.609856+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:59.398796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46888,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":525,"num_read_kb":1137,"num_write":420,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:13.246852+0000","last_change":"2024-09-19T13:40:42.250224+0000","last_active":"2024-09-19T15:29:13.246852+0000","last_peered":"2024-09-19T15:29:13.246852+0000","last_clean":"2024-09-19T15:29:13.246852+0000","last_became_active":"2024-09-19T13:40:42.245030+0000","last_became_peered":"2024-09-19T13:40:42.245030+0000","last_unstale":"2024-09-19T15:29:13.246852+0000","last_undegraded":"2024-09-19T15:29:13.246852+0000","last_fullsized":"2024-09-19T15:29:13.246852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:07:01.322432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'125","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:00.457822+0000","last_change":"2024-09-19T13:40:44.254756+0000","last_active":"2024-09-19T15:31:00.457822+0000","last_peered":"2024-09-19T15:31:00.457822+0000","last_clean":"2024-09-19T15:31:00.457822+0000","last_became_active":"2024-09-19T13:40:44.254015+0000","last_became_peered":"2024-09-19T13:40:44.254015+0000","last_unstale":"2024-09-19T15:31:00.457822+0000","last_undegraded":"2024-09-19T15:31:00.457822+0000","last_fullsized":"2024-09-19T15:31:00.457822+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:31:55.327099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":134,"num_write":317,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'412","reported_seq":1974,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.381038+0000","last_change":"2024-09-19T13:42:05.614112+0000","last_active":"2024-09-19T15:29:48.381038+0000","last_peered":"2024-09-19T15:29:48.381038+0000","last_clean":"2024-09-19T15:29:48.381038+0000","last_became_active":"2024-09-19T13:42:05.613410+0000","last_became_peered":"2024-09-19T13:42:05.613410+0000","last_unstale":"2024-09-19T15:29:48.381038+0000","last_undegraded":"2024-09-19T15:29:48.381038+0000","last_fullsized":"2024-09-19T15:29:48.381038+0000","mapping_epoch":40,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:38:56.362442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2294,"num_read_kb":2176,"num_write":469,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'350","reported_seq":1066,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.575044+0000","last_change":"2024-09-19T13:40:34.268729+0000","last_active":"2024-09-19T15:31:40.575044+0000","last_peered":"2024-09-19T15:31:40.575044+0000","last_clean":"2024-09-19T15:31:40.575044+0000","last_became_active":"2024-09-19T13:40:34.268005+0000","last_became_peered":"2024-09-19T13:40:34.268005+0000","last_unstale":"2024-09-19T15:31:40.575044+0000","last_undegraded":"2024-09-19T15:31:40.575044+0000","last_fullsized":"2024-09-19T15:31:40.575044+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:39.540040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":754,"num_read_kb":24616,"num_write":1259,"num_write_kb":39661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.553914+0000","last_change":"2024-09-19T13:40:38.232016+0000","last_active":"2024-09-19T15:28:42.553914+0000","last_peered":"2024-09-19T15:28:42.553914+0000","last_clean":"2024-09-19T15:28:42.553914+0000","last_became_active":"2024-09-19T13:40:38.231698+0000","last_became_peered":"2024-09-19T13:40:38.231698+0000","last_unstale":"2024-09-19T15:28:42.553914+0000","last_undegraded":"2024-09-19T15:28:42.553914+0000","last_fullsized":"2024-09-19T15:28:42.553914+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:45.837641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'393","reported_seq":1055,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.937331+0000","last_change":"2024-09-19T13:40:40.219381+0000","last_active":"2024-09-19T15:31:39.937331+0000","last_peered":"2024-09-19T15:31:39.937331+0000","last_clean":"2024-09-19T15:31:39.937331+0000","last_became_active":"2024-09-19T13:40:40.218529+0000","last_became_peered":"2024-09-19T13:40:40.218529+0000","last_unstale":"2024-09-19T15:31:39.937331+0000","last_undegraded":"2024-09-19T15:31:39.937331+0000","last_fullsized":"2024-09-19T15:31:39.937331+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:35.038776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45323,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":615,"num_read_kb":1192,"num_write":478,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'802","reported_seq":3180,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.127458+0000","last_change":"2024-09-19T13:40:42.238099+0000","last_active":"2024-09-19T15:31:40.127458+0000","last_peered":"2024-09-19T15:31:40.127458+0000","last_clean":"2024-09-19T15:31:40.127458+0000","last_became_active":"2024-09-19T13:40:42.237168+0000","last_became_peered":"2024-09-19T13:40:42.237168+0000","last_unstale":"2024-09-19T15:31:40.127458+0000","last_undegraded":"2024-09-19T15:31:40.127458+0000","last_fullsized":"2024-09-19T15:31:40.127458+0000","mapping_epoch":33,"log_start":"268'701","ondisk_log_start":"268'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":701,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:55.917452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'185","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.287972+0000","last_change":"2024-09-19T13:40:44.262160+0000","last_active":"2024-09-19T15:31:12.287972+0000","last_peered":"2024-09-19T15:31:12.287972+0000","last_clean":"2024-09-19T15:31:12.287972+0000","last_became_active":"2024-09-19T13:40:44.259964+0000","last_became_peered":"2024-09-19T13:40:44.259964+0000","last_unstale":"2024-09-19T15:31:12.287972+0000","last_undegraded":"2024-09-19T15:31:12.287972+0000","last_fullsized":"2024-09-19T15:31:12.287972+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:49.811154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":275,"num_read_kb":244,"num_write":336,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'515","reported_seq":2206,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.656869+0000","last_change":"2024-09-19T13:40:36.221790+0000","last_active":"2024-09-19T15:29:50.656869+0000","last_peered":"2024-09-19T15:29:50.656869+0000","last_clean":"2024-09-19T15:29:50.656869+0000","last_became_active":"2024-09-19T13:40:36.221248+0000","last_became_peered":"2024-09-19T13:40:36.221248+0000","last_unstale":"2024-09-19T15:29:50.656869+0000","last_undegraded":"2024-09-19T15:29:50.656869+0000","last_fullsized":"2024-09-19T15:29:50.656869+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:23.331064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2802,"num_read_kb":2611,"num_write":645,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'296","reported_seq":942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.547111+0000","last_change":"2024-09-19T13:40:34.260828+0000","last_active":"2024-09-19T15:31:40.547111+0000","last_peered":"2024-09-19T15:31:40.547111+0000","last_clean":"2024-09-19T15:31:40.547111+0000","last_became_active":"2024-09-19T13:40:34.259994+0000","last_became_peered":"2024-09-19T13:40:34.259994+0000","last_unstale":"2024-09-19T15:31:40.547111+0000","last_undegraded":"2024-09-19T15:31:40.547111+0000","last_fullsized":"2024-09-19T15:31:40.547111+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:04.707136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":7460,"num_write":978,"num_write_kb":22776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:22.561854+0000","last_change":"2024-09-19T13:40:38.245831+0000","last_active":"2024-09-19T15:29:22.561854+0000","last_peered":"2024-09-19T15:29:22.561854+0000","last_clean":"2024-09-19T15:29:22.561854+0000","last_became_active":"2024-09-19T13:40:38.245245+0000","last_became_peered":"2024-09-19T13:40:38.245245+0000","last_unstale":"2024-09-19T15:29:22.561854+0000","last_undegraded":"2024-09-19T15:29:22.561854+0000","last_fullsized":"2024-09-19T15:29:22.561854+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:31:40.598604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'514","reported_seq":1193,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.066494+0000","last_change":"2024-09-19T13:40:40.231208+0000","last_active":"2024-09-19T15:31:40.066494+0000","last_peered":"2024-09-19T15:31:40.066494+0000","last_clean":"2024-09-19T15:31:40.066494+0000","last_became_active":"2024-09-19T13:40:40.230404+0000","last_became_peered":"2024-09-19T13:40:40.230404+0000","last_unstale":"2024-09-19T15:31:40.066494+0000","last_undegraded":"2024-09-19T15:31:40.066494+0000","last_fullsized":"2024-09-19T15:31:40.066494+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:12:10.298800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93154,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":887,"num_read_kb":2046,"num_write":714,"num_write_kb":570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.557534+0000","last_change":"2024-09-19T13:40:42.250031+0000","last_active":"2024-09-19T15:29:02.557534+0000","last_peered":"2024-09-19T15:29:02.557534+0000","last_clean":"2024-09-19T15:29:02.557534+0000","last_became_active":"2024-09-19T13:40:42.248721+0000","last_became_peered":"2024-09-19T13:40:42.248721+0000","last_unstale":"2024-09-19T15:29:02.557534+0000","last_undegraded":"2024-09-19T15:29:02.557534+0000","last_fullsized":"2024-09-19T15:29:02.557534+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:31.801182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'162","reported_seq":711,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:46.507086+0000","last_change":"2024-09-19T13:40:44.256561+0000","last_active":"2024-09-19T15:29:46.507086+0000","last_peered":"2024-09-19T15:29:46.507086+0000","last_clean":"2024-09-19T15:29:46.507086+0000","last_became_active":"2024-09-19T13:40:44.255644+0000","last_became_peered":"2024-09-19T13:40:44.255644+0000","last_unstale":"2024-09-19T15:29:46.507086+0000","last_undegraded":"2024-09-19T15:29:46.507086+0000","last_fullsized":"2024-09-19T15:29:46.507086+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:41.469474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":234,"num_write":369,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'795","reported_seq":2371,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.393505+0000","last_change":"2024-09-19T13:40:36.235347+0000","last_active":"2024-09-19T15:29:48.393505+0000","last_peered":"2024-09-19T15:29:48.393505+0000","last_clean":"2024-09-19T15:29:48.393505+0000","last_became_active":"2024-09-19T13:40:36.231071+0000","last_became_peered":"2024-09-19T13:40:36.231071+0000","last_unstale":"2024-09-19T15:29:48.393505+0000","last_undegraded":"2024-09-19T15:29:48.393505+0000","last_fullsized":"2024-09-19T15:29:48.393505+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:57.506822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3782,"num_read_kb":3405,"num_write":1031,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'344","reported_seq":1000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.547493+0000","last_change":"2024-09-19T13:40:34.230219+0000","last_active":"2024-09-19T15:31:40.547493+0000","last_peered":"2024-09-19T15:31:40.547493+0000","last_clean":"2024-09-19T15:31:40.547493+0000","last_became_active":"2024-09-19T13:40:34.229859+0000","last_became_peered":"2024-09-19T13:40:34.229859+0000","last_unstale":"2024-09-19T15:31:40.547493+0000","last_undegraded":"2024-09-19T15:31:40.547493+0000","last_fullsized":"2024-09-19T15:31:40.547493+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:22:23.963676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":581,"num_read_kb":8832,"num_write":1027,"num_write_kb":25070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.553962+0000","last_change":"2024-09-19T13:40:38.233850+0000","last_active":"2024-09-19T15:28:42.553962+0000","last_peered":"2024-09-19T15:28:42.553962+0000","last_clean":"2024-09-19T15:28:42.553962+0000","last_became_active":"2024-09-19T13:40:38.233312+0000","last_became_peered":"2024-09-19T13:40:38.233312+0000","last_unstale":"2024-09-19T15:28:42.553962+0000","last_undegraded":"2024-09-19T15:28:42.553962+0000","last_fullsized":"2024-09-19T15:28:42.553962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:06:31.511312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'329","reported_seq":959,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.602238+0000","last_change":"2024-09-19T13:40:40.248769+0000","last_active":"2024-09-19T15:31:38.602238+0000","last_peered":"2024-09-19T15:31:38.602238+0000","last_clean":"2024-09-19T15:31:38.602238+0000","last_became_active":"2024-09-19T13:40:40.247025+0000","last_became_peered":"2024-09-19T13:40:40.247025+0000","last_unstale":"2024-09-19T15:31:38.602238+0000","last_undegraded":"2024-09-19T15:31:38.602238+0000","last_fullsized":"2024-09-19T15:31:38.602238+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:56.478380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47892,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":557,"num_read_kb":1096,"num_write":476,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:17.195848+0000","last_change":"2024-09-19T13:40:42.244143+0000","last_active":"2024-09-19T15:29:17.195848+0000","last_peered":"2024-09-19T15:29:17.195848+0000","last_clean":"2024-09-19T15:29:17.195848+0000","last_became_active":"2024-09-19T13:40:42.243325+0000","last_became_peered":"2024-09-19T13:40:42.243325+0000","last_unstale":"2024-09-19T15:29:17.195848+0000","last_undegraded":"2024-09-19T15:29:17.195848+0000","last_fullsized":"2024-09-19T15:29:17.195848+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:23.365075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'144","reported_seq":676,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:00.462703+0000","last_change":"2024-09-19T13:40:44.268565+0000","last_active":"2024-09-19T15:31:00.462703+0000","last_peered":"2024-09-19T15:31:00.462703+0000","last_clean":"2024-09-19T15:31:00.462703+0000","last_became_active":"2024-09-19T13:40:44.267716+0000","last_became_peered":"2024-09-19T13:40:44.267716+0000","last_unstale":"2024-09-19T15:31:00.462703+0000","last_undegraded":"2024-09-19T15:31:00.462703+0000","last_fullsized":"2024-09-19T15:31:00.462703+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:15.203052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":190,"num_read_kb":181,"num_write":368,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'1168","reported_seq":2989,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.606972+0000","last_change":"2024-09-19T13:40:36.217087+0000","last_active":"2024-09-19T15:28:37.606972+0000","last_peered":"2024-09-19T15:28:37.606972+0000","last_clean":"2024-09-19T15:28:37.606972+0000","last_became_active":"2024-09-19T13:40:36.216332+0000","last_became_peered":"2024-09-19T13:40:36.216332+0000","last_unstale":"2024-09-19T15:28:37.606972+0000","last_undegraded":"2024-09-19T15:28:37.606972+0000","last_fullsized":"2024-09-19T15:28:37.606972+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":1100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:37.143369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5686,"num_read_kb":5084,"num_write":1563,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'376","reported_seq":1046,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.601569+0000","last_change":"2024-09-19T13:41:05.315224+0000","last_active":"2024-09-19T15:31:40.601569+0000","last_peered":"2024-09-19T15:31:40.601569+0000","last_clean":"2024-09-19T15:31:40.601569+0000","last_became_active":"2024-09-19T13:41:05.314782+0000","last_became_peered":"2024-09-19T13:41:05.314782+0000","last_unstale":"2024-09-19T15:31:40.601569+0000","last_undegraded":"2024-09-19T15:31:40.601569+0000","last_fullsized":"2024-09-19T15:31:40.601569+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:05:31.081233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":644,"num_read_kb":47078,"num_write":1156,"num_write_kb":40849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.388400+0000","last_change":"2024-09-19T13:40:38.247209+0000","last_active":"2024-09-19T15:28:42.388400+0000","last_peered":"2024-09-19T15:28:42.388400+0000","last_clean":"2024-09-19T15:28:42.388400+0000","last_became_active":"2024-09-19T13:40:38.246684+0000","last_became_peered":"2024-09-19T13:40:38.246684+0000","last_unstale":"2024-09-19T15:28:42.388400+0000","last_undegraded":"2024-09-19T15:28:42.388400+0000","last_fullsized":"2024-09-19T15:28:42.388400+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:06.464294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'386","reported_seq":1039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.432406+0000","last_change":"2024-09-19T13:40:40.222514+0000","last_active":"2024-09-19T15:31:40.432406+0000","last_peered":"2024-09-19T15:31:40.432406+0000","last_clean":"2024-09-19T15:31:40.432406+0000","last_became_active":"2024-09-19T13:40:40.221766+0000","last_became_peered":"2024-09-19T13:40:40.221766+0000","last_unstale":"2024-09-19T15:31:40.432406+0000","last_undegraded":"2024-09-19T15:31:40.432406+0000","last_fullsized":"2024-09-19T15:31:40.432406+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:00.029066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44832,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":632,"num_read_kb":1260,"num_write":492,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'744","reported_seq":3076,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.027114+0000","last_change":"2024-09-19T13:40:42.246641+0000","last_active":"2024-09-19T15:31:40.027114+0000","last_peered":"2024-09-19T15:31:40.027114+0000","last_clean":"2024-09-19T15:31:40.027114+0000","last_became_active":"2024-09-19T13:40:42.246030+0000","last_became_peered":"2024-09-19T13:40:42.246030+0000","last_unstale":"2024-09-19T15:31:40.027114+0000","last_undegraded":"2024-09-19T15:31:40.027114+0000","last_fullsized":"2024-09-19T15:31:40.027114+0000","mapping_epoch":33,"log_start":"268'702","ondisk_log_start":"268'702","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":702,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:14.301444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'123","reported_seq":645,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:45.486708+0000","last_change":"2024-09-19T13:40:44.250279+0000","last_active":"2024-09-19T15:29:45.486708+0000","last_peered":"2024-09-19T15:29:45.486708+0000","last_clean":"2024-09-19T15:29:45.486708+0000","last_became_active":"2024-09-19T13:40:44.249529+0000","last_became_peered":"2024-09-19T13:40:44.249529+0000","last_unstale":"2024-09-19T15:29:45.486708+0000","last_undegraded":"2024-09-19T15:29:45.486708+0000","last_fullsized":"2024-09-19T15:29:45.486708+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:10.551071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1650,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":290,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'1316","reported_seq":3126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.313578+0000","last_change":"2024-09-19T13:40:36.219605+0000","last_active":"2024-09-19T15:29:41.313578+0000","last_peered":"2024-09-19T15:29:41.313578+0000","last_clean":"2024-09-19T15:29:41.313578+0000","last_became_active":"2024-09-19T13:40:36.218760+0000","last_became_peered":"2024-09-19T13:40:36.218760+0000","last_unstale":"2024-09-19T15:29:41.313578+0000","last_undegraded":"2024-09-19T15:29:41.313578+0000","last_fullsized":"2024-09-19T15:29:41.313578+0000","mapping_epoch":27,"log_start":"268'1300","ondisk_log_start":"268'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":1300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:53:31.922716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6184,"num_read_kb":5469,"num_write":1814,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'395","reported_seq":1104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.542475+0000","last_change":"2024-09-19T13:40:34.266782+0000","last_active":"2024-09-19T15:31:40.542475+0000","last_peered":"2024-09-19T15:31:40.542475+0000","last_clean":"2024-09-19T15:31:40.542475+0000","last_became_active":"2024-09-19T13:40:34.264354+0000","last_became_peered":"2024-09-19T13:40:34.264354+0000","last_unstale":"2024-09-19T15:31:40.542475+0000","last_undegraded":"2024-09-19T15:31:40.542475+0000","last_fullsized":"2024-09-19T15:31:40.542475+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:30.107330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":738,"num_read_kb":5537,"num_write":1291,"num_write_kb":30004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1485,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.130834+0000","last_change":"2024-09-19T13:40:38.226450+0000","last_active":"2024-09-19T15:31:38.130834+0000","last_peered":"2024-09-19T15:31:38.130834+0000","last_clean":"2024-09-19T15:31:38.130834+0000","last_became_active":"2024-09-19T13:40:38.225663+0000","last_became_peered":"2024-09-19T13:40:38.225663+0000","last_unstale":"2024-09-19T15:31:38.130834+0000","last_undegraded":"2024-09-19T15:31:38.130834+0000","last_fullsized":"2024-09-19T15:31:38.130834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:47:48.193799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":948,"num_read_kb":948,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'147","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.976337+0000","last_change":"2024-09-19T13:40:40.220948+0000","last_active":"2024-09-19T15:31:17.976337+0000","last_peered":"2024-09-19T15:31:17.976337+0000","last_clean":"2024-09-19T15:31:17.976337+0000","last_became_active":"2024-09-19T13:40:40.220534+0000","last_became_peered":"2024-09-19T13:40:40.220534+0000","last_unstale":"2024-09-19T15:31:17.976337+0000","last_undegraded":"2024-09-19T15:31:17.976337+0000","last_fullsized":"2024-09-19T15:31:17.976337+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:55.268748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":176,"num_write":122,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'765","reported_seq":5681,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.166147+0000","last_change":"2024-09-19T13:40:42.249926+0000","last_active":"2024-09-19T15:31:38.166147+0000","last_peered":"2024-09-19T15:31:38.166147+0000","last_clean":"2024-09-19T15:31:38.166147+0000","last_became_active":"2024-09-19T13:40:42.240074+0000","last_became_peered":"2024-09-19T13:40:42.240074+0000","last_unstale":"2024-09-19T15:31:38.166147+0000","last_undegraded":"2024-09-19T15:31:38.166147+0000","last_fullsized":"2024-09-19T15:31:38.166147+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:40:31.249282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'114","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:07.614003+0000","last_change":"2024-09-19T13:40:44.252306+0000","last_active":"2024-09-19T15:29:07.614003+0000","last_peered":"2024-09-19T15:29:07.614003+0000","last_clean":"2024-09-19T15:29:07.614003+0000","last_became_active":"2024-09-19T13:40:44.251353+0000","last_became_peered":"2024-09-19T13:40:44.251353+0000","last_unstale":"2024-09-19T15:29:07.614003+0000","last_undegraded":"2024-09-19T15:29:07.614003+0000","last_fullsized":"2024-09-19T15:29:07.614003+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:54.088845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'1842","reported_seq":3612,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.383231+0000","last_change":"2024-09-19T13:40:36.221951+0000","last_active":"2024-09-19T15:29:48.383231+0000","last_peered":"2024-09-19T15:29:48.383231+0000","last_clean":"2024-09-19T15:29:48.383231+0000","last_became_active":"2024-09-19T13:40:36.221638+0000","last_became_peered":"2024-09-19T13:40:36.221638+0000","last_unstale":"2024-09-19T15:29:48.383231+0000","last_undegraded":"2024-09-19T15:29:48.383231+0000","last_fullsized":"2024-09-19T15:29:48.383231+0000","mapping_epoch":27,"log_start":"268'1800","ondisk_log_start":"268'1800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":1800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:09:05.373765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8811,"num_read_kb":7740,"num_write":2693,"num_write_kb":1220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"268'357","reported_seq":1053,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.509271+0000","last_change":"2024-09-19T13:40:34.236641+0000","last_active":"2024-09-19T15:31:40.509271+0000","last_peered":"2024-09-19T15:31:40.509271+0000","last_clean":"2024-09-19T15:31:40.509271+0000","last_became_active":"2024-09-19T13:40:34.236257+0000","last_became_peered":"2024-09-19T13:40:34.236257+0000","last_unstale":"2024-09-19T15:31:40.509271+0000","last_undegraded":"2024-09-19T15:31:40.509271+0000","last_fullsized":"2024-09-19T15:31:40.509271+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:57.681584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136845,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":663,"num_read_kb":21601,"num_write":1219,"num_write_kb":27464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.608313+0000","last_change":"2024-09-19T13:40:38.236430+0000","last_active":"2024-09-19T15:28:42.608313+0000","last_peered":"2024-09-19T15:28:42.608313+0000","last_clean":"2024-09-19T15:28:42.608313+0000","last_became_active":"2024-09-19T13:40:38.235737+0000","last_became_peered":"2024-09-19T13:40:38.235737+0000","last_unstale":"2024-09-19T15:28:42.608313+0000","last_undegraded":"2024-09-19T15:28:42.608313+0000","last_fullsized":"2024-09-19T15:28:42.608313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:01.868972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'549","reported_seq":1242,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.591245+0000","last_change":"2024-09-19T13:40:40.236361+0000","last_active":"2024-09-19T15:31:39.591245+0000","last_peered":"2024-09-19T15:31:39.591245+0000","last_clean":"2024-09-19T15:31:39.591245+0000","last_became_active":"2024-09-19T13:40:40.235679+0000","last_became_peered":"2024-09-19T13:40:40.235679+0000","last_unstale":"2024-09-19T15:31:39.591245+0000","last_undegraded":"2024-09-19T15:31:39.591245+0000","last_fullsized":"2024-09-19T15:31:39.591245+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:05.212537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50661,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1488,"num_read_kb":2077,"num_write":2114,"num_write_kb":1883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.390727+0000","last_change":"2024-09-19T13:40:42.252473+0000","last_active":"2024-09-19T15:28:42.390727+0000","last_peered":"2024-09-19T15:28:42.390727+0000","last_clean":"2024-09-19T15:28:42.390727+0000","last_became_active":"2024-09-19T13:40:42.250462+0000","last_became_peered":"2024-09-19T13:40:42.250462+0000","last_unstale":"2024-09-19T15:28:42.390727+0000","last_undegraded":"2024-09-19T15:28:42.390727+0000","last_fullsized":"2024-09-19T15:28:42.390727+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:28:26.494633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'145","reported_seq":676,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:07.394194+0000","last_change":"2024-09-19T13:40:44.267433+0000","last_active":"2024-09-19T15:29:07.394194+0000","last_peered":"2024-09-19T15:29:07.394194+0000","last_clean":"2024-09-19T15:29:07.394194+0000","last_became_active":"2024-09-19T13:40:44.266642+0000","last_became_peered":"2024-09-19T13:40:44.266642+0000","last_unstale":"2024-09-19T15:29:07.394194+0000","last_undegraded":"2024-09-19T15:29:07.394194+0000","last_fullsized":"2024-09-19T15:29:07.394194+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:58.071145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":208,"num_write":352,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'499","reported_seq":2070,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:27.401142+0000","last_change":"2024-09-19T13:40:36.219246+0000","last_active":"2024-09-19T15:29:27.401142+0000","last_peered":"2024-09-19T15:29:27.401142+0000","last_clean":"2024-09-19T15:29:27.401142+0000","last_became_active":"2024-09-19T13:40:36.218550+0000","last_became_peered":"2024-09-19T13:40:36.218550+0000","last_unstale":"2024-09-19T15:29:27.401142+0000","last_undegraded":"2024-09-19T15:29:27.401142+0000","last_fullsized":"2024-09-19T15:29:27.401142+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:10.154764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2652,"num_read_kb":2446,"num_write":622,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":653,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.648997+0000","last_change":"2024-09-19T13:40:13.616691+0000","last_active":"2024-09-19T15:28:42.648997+0000","last_peered":"2024-09-19T15:28:42.648997+0000","last_clean":"2024-09-19T15:28:42.648997+0000","last_became_active":"2024-09-19T13:40:13.615965+0000","last_became_peered":"2024-09-19T13:40:13.615965+0000","last_unstale":"2024-09-19T15:28:42.648997+0000","last_undegraded":"2024-09-19T15:28:42.648997+0000","last_fullsized":"2024-09-19T15:28:42.648997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:12.602317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:12.602317+0000","last_clean_scrub_stamp":"2024-09-19T13:40:12.602317+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:03.931360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":566,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.627501+0000","last_change":"2024-09-19T13:40:22.120433+0000","last_active":"2024-09-19T15:28:42.627501+0000","last_peered":"2024-09-19T15:28:42.627501+0000","last_clean":"2024-09-19T15:28:42.627501+0000","last_became_active":"2024-09-19T13:40:20.100760+0000","last_became_peered":"2024-09-19T13:40:20.100760+0000","last_unstale":"2024-09-19T15:28:42.627501+0000","last_undegraded":"2024-09-19T15:28:42.627501+0000","last_fullsized":"2024-09-19T15:28:42.627501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:10.051308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001106569,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'318","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.589417+0000","last_change":"2024-09-19T13:40:34.241552+0000","last_active":"2024-09-19T15:31:40.589417+0000","last_peered":"2024-09-19T15:31:40.589417+0000","last_clean":"2024-09-19T15:31:40.589417+0000","last_became_active":"2024-09-19T13:40:34.241162+0000","last_became_peered":"2024-09-19T13:40:34.241162+0000","last_unstale":"2024-09-19T15:31:40.589417+0000","last_undegraded":"2024-09-19T15:31:40.589417+0000","last_fullsized":"2024-09-19T15:31:40.589417+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:44.355824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":104186,"num_write":970,"num_write_kb":16810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.654042+0000","last_change":"2024-09-19T13:40:38.232446+0000","last_active":"2024-09-19T15:29:02.654042+0000","last_peered":"2024-09-19T15:29:02.654042+0000","last_clean":"2024-09-19T15:29:02.654042+0000","last_became_active":"2024-09-19T13:40:38.231762+0000","last_became_peered":"2024-09-19T13:40:38.231762+0000","last_unstale":"2024-09-19T15:29:02.654042+0000","last_undegraded":"2024-09-19T15:29:02.654042+0000","last_fullsized":"2024-09-19T15:29:02.654042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:39.721678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'756","reported_seq":1515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.311187+0000","last_change":"2024-09-19T13:40:40.240118+0000","last_active":"2024-09-19T15:31:40.311187+0000","last_peered":"2024-09-19T15:31:40.311187+0000","last_clean":"2024-09-19T15:31:40.311187+0000","last_became_active":"2024-09-19T13:40:40.239392+0000","last_became_peered":"2024-09-19T13:40:40.239392+0000","last_unstale":"2024-09-19T15:31:40.311187+0000","last_undegraded":"2024-09-19T15:31:40.311187+0000","last_fullsized":"2024-09-19T15:31:40.311187+0000","mapping_epoch":31,"log_start":"268'700","ondisk_log_start":"268'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:00.876178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146379,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1466,"num_read_kb":3232,"num_write":1394,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.192068+0000","last_change":"2024-09-19T13:40:42.240498+0000","last_active":"2024-09-19T15:29:02.192068+0000","last_peered":"2024-09-19T15:29:02.192068+0000","last_clean":"2024-09-19T15:29:02.192068+0000","last_became_active":"2024-09-19T13:40:42.239749+0000","last_became_peered":"2024-09-19T13:40:42.239749+0000","last_unstale":"2024-09-19T15:29:02.192068+0000","last_undegraded":"2024-09-19T15:29:02.192068+0000","last_fullsized":"2024-09-19T15:29:02.192068+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:55:48.115594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'200","reported_seq":921,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.733071+0000","last_change":"2024-09-19T13:40:44.265188+0000","last_active":"2024-09-19T15:29:50.733071+0000","last_peered":"2024-09-19T15:29:50.733071+0000","last_clean":"2024-09-19T15:29:50.733071+0000","last_became_active":"2024-09-19T13:40:44.264456+0000","last_became_peered":"2024-09-19T13:40:44.264456+0000","last_unstale":"2024-09-19T15:29:50.733071+0000","last_undegraded":"2024-09-19T15:29:50.733071+0000","last_fullsized":"2024-09-19T15:29:50.733071+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:46.004583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":469,"num_write":408,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'750","reported_seq":2265,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.375238+0000","last_change":"2024-09-19T13:40:36.223322+0000","last_active":"2024-09-19T15:29:48.375238+0000","last_peered":"2024-09-19T15:29:48.375238+0000","last_clean":"2024-09-19T15:29:48.375238+0000","last_became_active":"2024-09-19T13:40:36.221186+0000","last_became_peered":"2024-09-19T13:40:36.221186+0000","last_unstale":"2024-09-19T15:29:48.375238+0000","last_undegraded":"2024-09-19T15:29:48.375238+0000","last_fullsized":"2024-09-19T15:29:48.375238+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:28:28.786321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3545,"num_read_kb":3202,"num_write":973,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":562,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:47.650225+0000","last_change":"2024-09-19T13:40:23.121191+0000","last_active":"2024-09-19T15:28:47.650225+0000","last_peered":"2024-09-19T15:28:47.650225+0000","last_clean":"2024-09-19T15:28:47.650225+0000","last_became_active":"2024-09-19T13:40:20.099608+0000","last_became_peered":"2024-09-19T13:40:20.099608+0000","last_unstale":"2024-09-19T15:28:47.650225+0000","last_undegraded":"2024-09-19T15:28:47.650225+0000","last_fullsized":"2024-09-19T15:28:47.650225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:29.188183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001034798,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'310","reported_seq":993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.607734+0000","last_change":"2024-09-19T13:40:34.265231+0000","last_active":"2024-09-19T15:31:40.607734+0000","last_peered":"2024-09-19T15:31:40.607734+0000","last_clean":"2024-09-19T15:31:40.607734+0000","last_became_active":"2024-09-19T13:40:34.264819+0000","last_became_peered":"2024-09-19T13:40:34.264819+0000","last_unstale":"2024-09-19T15:31:40.607734+0000","last_undegraded":"2024-09-19T15:31:40.607734+0000","last_fullsized":"2024-09-19T15:31:40.607734+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:02:26.810163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":579,"num_read_kb":52358,"num_write":971,"num_write_kb":38982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.632334+0000","last_change":"2024-09-19T13:40:38.223702+0000","last_active":"2024-09-19T15:29:02.632334+0000","last_peered":"2024-09-19T15:29:02.632334+0000","last_clean":"2024-09-19T15:29:02.632334+0000","last_became_active":"2024-09-19T13:40:38.222905+0000","last_became_peered":"2024-09-19T13:40:38.222905+0000","last_unstale":"2024-09-19T15:29:02.632334+0000","last_undegraded":"2024-09-19T15:29:02.632334+0000","last_fullsized":"2024-09-19T15:29:02.632334+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:40:37.494887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'1438","reported_seq":3758,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.670211+0000","last_change":"2024-09-19T13:40:40.241249+0000","last_active":"2024-09-19T15:31:39.670211+0000","last_peered":"2024-09-19T15:31:39.670211+0000","last_clean":"2024-09-19T15:31:39.670211+0000","last_became_active":"2024-09-19T13:40:40.240768+0000","last_became_peered":"2024-09-19T13:40:40.240768+0000","last_unstale":"2024-09-19T15:31:39.670211+0000","last_undegraded":"2024-09-19T15:31:39.670211+0000","last_fullsized":"2024-09-19T15:31:39.670211+0000","mapping_epoch":31,"log_start":"268'1400","ondisk_log_start":"268'1400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:22:28.103563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140168,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2240,"num_read_kb":4108,"num_write":1354,"num_write_kb":1102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:27.660131+0000","last_change":"2024-09-19T13:40:42.252880+0000","last_active":"2024-09-19T15:29:27.660131+0000","last_peered":"2024-09-19T15:29:27.660131+0000","last_clean":"2024-09-19T15:29:27.660131+0000","last_became_active":"2024-09-19T13:40:42.250172+0000","last_became_peered":"2024-09-19T13:40:42.250172+0000","last_unstale":"2024-09-19T15:29:27.660131+0000","last_undegraded":"2024-09-19T15:29:27.660131+0000","last_fullsized":"2024-09-19T15:29:27.660131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:36:32.481597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'250","reported_seq":838,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:37.400055+0000","last_change":"2024-09-19T13:40:44.273159+0000","last_active":"2024-09-19T15:29:37.400055+0000","last_peered":"2024-09-19T15:29:37.400055+0000","last_clean":"2024-09-19T15:29:37.400055+0000","last_became_active":"2024-09-19T13:40:44.272356+0000","last_became_peered":"2024-09-19T13:40:44.272356+0000","last_unstale":"2024-09-19T15:29:37.400055+0000","last_undegraded":"2024-09-19T15:29:37.400055+0000","last_fullsized":"2024-09-19T15:29:37.400055+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:13:14.438529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":580,"num_read_kb":531,"num_write":551,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'464","reported_seq":2138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391925+0000","last_change":"2024-09-19T13:40:36.242222+0000","last_active":"2024-09-19T15:28:57.391925+0000","last_peered":"2024-09-19T15:28:57.391925+0000","last_clean":"2024-09-19T15:28:57.391925+0000","last_became_active":"2024-09-19T13:40:36.241832+0000","last_became_peered":"2024-09-19T13:40:36.241832+0000","last_unstale":"2024-09-19T15:28:57.391925+0000","last_undegraded":"2024-09-19T15:28:57.391925+0000","last_fullsized":"2024-09-19T15:28:57.391925+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:22:08.294812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2706,"num_read_kb":2545,"num_write":558,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":553,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.553858+0000","last_change":"2024-09-19T13:40:22.375307+0000","last_active":"2024-09-19T15:28:42.553858+0000","last_peered":"2024-09-19T15:28:42.553858+0000","last_clean":"2024-09-19T15:28:42.553858+0000","last_became_active":"2024-09-19T13:40:20.096900+0000","last_became_peered":"2024-09-19T13:40:20.096900+0000","last_unstale":"2024-09-19T15:28:42.553858+0000","last_undegraded":"2024-09-19T15:28:42.553858+0000","last_fullsized":"2024-09-19T15:28:42.553858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:28.240242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074274699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'333","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.580511+0000","last_change":"2024-09-19T13:40:34.235882+0000","last_active":"2024-09-19T15:31:40.580511+0000","last_peered":"2024-09-19T15:31:40.580511+0000","last_clean":"2024-09-19T15:31:40.580511+0000","last_became_active":"2024-09-19T13:40:34.235483+0000","last_became_peered":"2024-09-19T13:40:34.235483+0000","last_unstale":"2024-09-19T15:31:40.580511+0000","last_undegraded":"2024-09-19T15:31:40.580511+0000","last_fullsized":"2024-09-19T15:31:40.580511+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:16:09.641672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":610,"num_read_kb":5129,"num_write":1002,"num_write_kb":29541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.557673+0000","last_change":"2024-09-19T13:40:38.228915+0000","last_active":"2024-09-19T15:29:02.557673+0000","last_peered":"2024-09-19T15:29:02.557673+0000","last_clean":"2024-09-19T15:29:02.557673+0000","last_became_active":"2024-09-19T13:40:38.228364+0000","last_became_peered":"2024-09-19T13:40:38.228364+0000","last_unstale":"2024-09-19T15:29:02.557673+0000","last_undegraded":"2024-09-19T15:29:02.557673+0000","last_fullsized":"2024-09-19T15:29:02.557673+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:20.446950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'367","reported_seq":2304,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.215985+0000","last_change":"2024-09-19T13:40:40.232258+0000","last_active":"2024-09-19T15:31:18.215985+0000","last_peered":"2024-09-19T15:31:18.215985+0000","last_clean":"2024-09-19T15:31:18.215985+0000","last_became_active":"2024-09-19T13:40:40.231491+0000","last_became_peered":"2024-09-19T13:40:40.231491+0000","last_unstale":"2024-09-19T15:31:18.215985+0000","last_undegraded":"2024-09-19T15:31:18.215985+0000","last_fullsized":"2024-09-19T15:31:18.215985+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:37.420062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":364,"num_read_kb":356,"num_write":351,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.191956+0000","last_change":"2024-09-19T13:40:42.227173+0000","last_active":"2024-09-19T15:29:02.191956+0000","last_peered":"2024-09-19T15:29:02.191956+0000","last_clean":"2024-09-19T15:29:02.191956+0000","last_became_active":"2024-09-19T13:40:42.226706+0000","last_became_peered":"2024-09-19T13:40:42.226706+0000","last_unstale":"2024-09-19T15:29:02.191956+0000","last_undegraded":"2024-09-19T15:29:02.191956+0000","last_fullsized":"2024-09-19T15:29:02.191956+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:12:31.408133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'257","reported_seq":907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:51.222389+0000","last_change":"2024-09-19T13:40:44.241756+0000","last_active":"2024-09-19T15:29:51.222389+0000","last_peered":"2024-09-19T15:29:51.222389+0000","last_clean":"2024-09-19T15:29:51.222389+0000","last_became_active":"2024-09-19T13:40:44.240277+0000","last_became_peered":"2024-09-19T13:40:44.240277+0000","last_unstale":"2024-09-19T15:29:51.222389+0000","last_undegraded":"2024-09-19T15:29:51.222389+0000","last_fullsized":"2024-09-19T15:29:51.222389+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:50.745130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":590,"num_read_kb":596,"num_write":565,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'478","reported_seq":2079,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.652407+0000","last_change":"2024-09-19T13:40:36.221661+0000","last_active":"2024-09-19T15:29:50.652407+0000","last_peered":"2024-09-19T15:29:50.652407+0000","last_clean":"2024-09-19T15:29:50.652407+0000","last_became_active":"2024-09-19T13:40:36.220514+0000","last_became_peered":"2024-09-19T13:40:36.220514+0000","last_unstale":"2024-09-19T15:29:50.652407+0000","last_undegraded":"2024-09-19T15:29:50.652407+0000","last_fullsized":"2024-09-19T15:29:50.652407+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:03.001074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2550,"num_read_kb":2381,"num_write":569,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":567,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.627408+0000","last_change":"2024-09-19T13:40:22.121910+0000","last_active":"2024-09-19T15:28:42.627408+0000","last_peered":"2024-09-19T15:28:42.627408+0000","last_clean":"2024-09-19T15:28:42.627408+0000","last_became_active":"2024-09-19T13:40:20.101198+0000","last_became_peered":"2024-09-19T13:40:20.101198+0000","last_unstale":"2024-09-19T15:28:42.627408+0000","last_undegraded":"2024-09-19T15:28:42.627408+0000","last_fullsized":"2024-09-19T15:28:42.627408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:03:31.869167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026053059999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'331","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.532776+0000","last_change":"2024-09-19T13:40:34.229956+0000","last_active":"2024-09-19T15:31:40.532776+0000","last_peered":"2024-09-19T15:31:40.532776+0000","last_clean":"2024-09-19T15:31:40.532776+0000","last_became_active":"2024-09-19T13:40:34.228632+0000","last_became_peered":"2024-09-19T13:40:34.228632+0000","last_unstale":"2024-09-19T15:31:40.532776+0000","last_undegraded":"2024-09-19T15:31:40.532776+0000","last_fullsized":"2024-09-19T15:31:40.532776+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:27:09.603584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":586,"num_read_kb":6959,"num_write":997,"num_write_kb":25273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:37.199902+0000","last_change":"2024-09-19T13:40:38.229900+0000","last_active":"2024-09-19T15:29:37.199902+0000","last_peered":"2024-09-19T15:29:37.199902+0000","last_clean":"2024-09-19T15:29:37.199902+0000","last_became_active":"2024-09-19T13:40:38.229144+0000","last_became_peered":"2024-09-19T13:40:38.229144+0000","last_unstale":"2024-09-19T15:29:37.199902+0000","last_undegraded":"2024-09-19T15:29:37.199902+0000","last_fullsized":"2024-09-19T15:29:37.199902+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:43.905801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'214","reported_seq":829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.912084+0000","last_change":"2024-09-19T13:40:40.249690+0000","last_active":"2024-09-19T15:31:17.912084+0000","last_peered":"2024-09-19T15:31:17.912084+0000","last_clean":"2024-09-19T15:31:17.912084+0000","last_became_active":"2024-09-19T13:40:40.249102+0000","last_became_peered":"2024-09-19T13:40:40.249102+0000","last_unstale":"2024-09-19T15:31:17.912084+0000","last_undegraded":"2024-09-19T15:31:17.912084+0000","last_fullsized":"2024-09-19T15:31:17.912084+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:09.297865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":198,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.395494+0000","last_change":"2024-09-19T13:40:42.254540+0000","last_active":"2024-09-19T15:29:02.395494+0000","last_peered":"2024-09-19T15:29:02.395494+0000","last_clean":"2024-09-19T15:29:02.395494+0000","last_became_active":"2024-09-19T13:40:42.250662+0000","last_became_peered":"2024-09-19T13:40:42.250662+0000","last_unstale":"2024-09-19T15:29:02.395494+0000","last_undegraded":"2024-09-19T15:29:02.395494+0000","last_fullsized":"2024-09-19T15:29:02.395494+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:12.417076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'126","reported_seq":718,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:43.404178+0000","last_change":"2024-09-19T13:40:44.267544+0000","last_active":"2024-09-19T15:29:43.404178+0000","last_peered":"2024-09-19T15:29:43.404178+0000","last_clean":"2024-09-19T15:29:43.404178+0000","last_became_active":"2024-09-19T13:40:44.266678+0000","last_became_peered":"2024-09-19T13:40:44.266678+0000","last_unstale":"2024-09-19T15:29:43.404178+0000","last_undegraded":"2024-09-19T15:29:43.404178+0000","last_fullsized":"2024-09-19T15:29:43.404178+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:56:44.218291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":283,"num_read_kb":273,"num_write":324,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'759","reported_seq":2286,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391645+0000","last_change":"2024-09-19T13:40:36.244736+0000","last_active":"2024-09-19T15:28:57.391645+0000","last_peered":"2024-09-19T15:28:57.391645+0000","last_clean":"2024-09-19T15:28:57.391645+0000","last_became_active":"2024-09-19T13:40:36.244403+0000","last_became_peered":"2024-09-19T13:40:36.244403+0000","last_unstale":"2024-09-19T15:28:57.391645+0000","last_undegraded":"2024-09-19T15:28:57.391645+0000","last_fullsized":"2024-09-19T15:28:57.391645+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:21.219635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3619,"num_read_kb":3269,"num_write":981,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'331","reported_seq":1046,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.544253+0000","last_change":"2024-09-19T13:40:34.226710+0000","last_active":"2024-09-19T15:31:40.544253+0000","last_peered":"2024-09-19T15:31:40.544253+0000","last_clean":"2024-09-19T15:31:40.544253+0000","last_became_active":"2024-09-19T13:40:34.225452+0000","last_became_peered":"2024-09-19T13:40:34.225452+0000","last_unstale":"2024-09-19T15:31:40.544253+0000","last_undegraded":"2024-09-19T15:31:40.544253+0000","last_fullsized":"2024-09-19T15:31:40.544253+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:24:16.701686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":603,"num_read_kb":97113,"num_write":1108,"num_write_kb":15979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":551,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.388367+0000","last_change":"2024-09-19T13:40:22.113821+0000","last_active":"2024-09-19T15:28:42.388367+0000","last_peered":"2024-09-19T15:28:42.388367+0000","last_clean":"2024-09-19T15:28:42.388367+0000","last_became_active":"2024-09-19T13:40:20.095294+0000","last_became_peered":"2024-09-19T13:40:20.095294+0000","last_unstale":"2024-09-19T15:28:42.388367+0000","last_undegraded":"2024-09-19T15:28:42.388367+0000","last_fullsized":"2024-09-19T15:28:42.388367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:38.696147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088577700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.191905+0000","last_change":"2024-09-19T13:40:38.230538+0000","last_active":"2024-09-19T15:29:02.191905+0000","last_peered":"2024-09-19T15:29:02.191905+0000","last_clean":"2024-09-19T15:29:02.191905+0000","last_became_active":"2024-09-19T13:40:38.229743+0000","last_became_peered":"2024-09-19T13:40:38.229743+0000","last_unstale":"2024-09-19T15:29:02.191905+0000","last_undegraded":"2024-09-19T15:29:02.191905+0000","last_fullsized":"2024-09-19T15:29:02.191905+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:00.135611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'622","reported_seq":1357,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.368618+0000","last_change":"2024-09-19T13:40:40.224386+0000","last_active":"2024-09-19T15:31:40.368618+0000","last_peered":"2024-09-19T15:31:40.368618+0000","last_clean":"2024-09-19T15:31:40.368618+0000","last_became_active":"2024-09-19T13:40:40.223632+0000","last_became_peered":"2024-09-19T13:40:40.223632+0000","last_unstale":"2024-09-19T15:31:40.368618+0000","last_undegraded":"2024-09-19T15:31:40.368618+0000","last_fullsized":"2024-09-19T15:31:40.368618+0000","mapping_epoch":31,"log_start":"268'600","ondisk_log_start":"268'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:52.387211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101088,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1063,"num_read_kb":2259,"num_write":846,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.612861+0000","last_change":"2024-09-19T13:40:42.246177+0000","last_active":"2024-09-19T15:29:02.612861+0000","last_peered":"2024-09-19T15:29:02.612861+0000","last_clean":"2024-09-19T15:29:02.612861+0000","last_became_active":"2024-09-19T13:40:42.245476+0000","last_became_peered":"2024-09-19T13:40:42.245476+0000","last_unstale":"2024-09-19T15:29:02.612861+0000","last_undegraded":"2024-09-19T15:29:02.612861+0000","last_fullsized":"2024-09-19T15:29:02.612861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:33:09.183782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'141","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:11.923727+0000","last_change":"2024-09-19T13:40:44.275185+0000","last_active":"2024-09-19T15:31:11.923727+0000","last_peered":"2024-09-19T15:31:11.923727+0000","last_clean":"2024-09-19T15:31:11.923727+0000","last_became_active":"2024-09-19T13:40:44.274333+0000","last_became_peered":"2024-09-19T13:40:44.274333+0000","last_unstale":"2024-09-19T15:31:11.923727+0000","last_undegraded":"2024-09-19T15:31:11.923727+0000","last_fullsized":"2024-09-19T15:31:11.923727+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:10.763011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":236,"num_read_kb":218,"num_write":346,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'455","reported_seq":2038,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.656021+0000","last_change":"2024-09-19T13:40:36.242002+0000","last_active":"2024-09-19T15:29:50.656021+0000","last_peered":"2024-09-19T15:29:50.656021+0000","last_clean":"2024-09-19T15:29:50.656021+0000","last_became_active":"2024-09-19T13:40:36.241654+0000","last_became_peered":"2024-09-19T13:40:36.241654+0000","last_unstale":"2024-09-19T15:29:50.656021+0000","last_undegraded":"2024-09-19T15:29:50.656021+0000","last_fullsized":"2024-09-19T15:29:50.656021+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:39:35.530454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2406,"num_read_kb":2267,"num_write":541,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'310","reported_seq":961,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.366490+0000","last_change":"2024-09-19T13:40:34.249506+0000","last_active":"2024-09-19T15:31:40.366490+0000","last_peered":"2024-09-19T15:31:40.366490+0000","last_clean":"2024-09-19T15:31:40.366490+0000","last_became_active":"2024-09-19T13:40:34.248944+0000","last_became_peered":"2024-09-19T13:40:34.248944+0000","last_unstale":"2024-09-19T15:31:40.366490+0000","last_undegraded":"2024-09-19T15:31:40.366490+0000","last_fullsized":"2024-09-19T15:31:40.366490+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:14:45.859987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":481,"num_read_kb":60023,"num_write":924,"num_write_kb":13648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":560,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:07.655294+0000","last_change":"2024-09-19T13:40:23.121258+0000","last_active":"2024-09-19T15:29:07.655294+0000","last_peered":"2024-09-19T15:29:07.655294+0000","last_clean":"2024-09-19T15:29:07.655294+0000","last_became_active":"2024-09-19T13:40:20.096321+0000","last_became_peered":"2024-09-19T13:40:20.096321+0000","last_unstale":"2024-09-19T15:29:07.655294+0000","last_undegraded":"2024-09-19T15:29:07.655294+0000","last_fullsized":"2024-09-19T15:29:07.655294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:56.853216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001025329,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.395362+0000","last_change":"2024-09-19T13:40:38.230448+0000","last_active":"2024-09-19T15:29:02.395362+0000","last_peered":"2024-09-19T15:29:02.395362+0000","last_clean":"2024-09-19T15:29:02.395362+0000","last_became_active":"2024-09-19T13:40:38.229784+0000","last_became_peered":"2024-09-19T13:40:38.229784+0000","last_unstale":"2024-09-19T15:29:02.395362+0000","last_undegraded":"2024-09-19T15:29:02.395362+0000","last_fullsized":"2024-09-19T15:29:02.395362+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:28:13.132545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'339","reported_seq":975,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.261784+0000","last_change":"2024-09-19T13:40:40.240170+0000","last_active":"2024-09-19T15:31:18.261784+0000","last_peered":"2024-09-19T15:31:18.261784+0000","last_clean":"2024-09-19T15:31:18.261784+0000","last_became_active":"2024-09-19T13:40:40.239406+0000","last_became_peered":"2024-09-19T13:40:40.239406+0000","last_unstale":"2024-09-19T15:31:18.261784+0000","last_undegraded":"2024-09-19T15:31:18.261784+0000","last_fullsized":"2024-09-19T15:31:18.261784+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:48:52.979382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":438,"num_read_kb":429,"num_write":416,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'785","reported_seq":3361,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.024171+0000","last_change":"2024-09-19T13:40:42.245618+0000","last_active":"2024-09-19T15:31:40.024171+0000","last_peered":"2024-09-19T15:31:40.024171+0000","last_clean":"2024-09-19T15:31:40.024171+0000","last_became_active":"2024-09-19T13:40:42.244921+0000","last_became_peered":"2024-09-19T13:40:42.244921+0000","last_unstale":"2024-09-19T15:31:40.024171+0000","last_undegraded":"2024-09-19T15:31:40.024171+0000","last_fullsized":"2024-09-19T15:31:40.024171+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:59.793708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'142","reported_seq":702,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.263529+0000","last_change":"2024-09-19T13:40:44.279820+0000","last_active":"2024-09-19T15:31:13.263529+0000","last_peered":"2024-09-19T15:31:13.263529+0000","last_clean":"2024-09-19T15:31:13.263529+0000","last_became_active":"2024-09-19T13:40:44.277602+0000","last_became_peered":"2024-09-19T13:40:44.277602+0000","last_unstale":"2024-09-19T15:31:13.263529+0000","last_undegraded":"2024-09-19T15:31:13.263529+0000","last_fullsized":"2024-09-19T15:31:13.263529+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:34:45.143706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":303,"num_read_kb":269,"num_write":341,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'434","reported_seq":1934,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:48.240820+0000","last_change":"2024-09-19T13:40:36.235651+0000","last_active":"2024-09-19T15:28:48.240820+0000","last_peered":"2024-09-19T15:28:48.240820+0000","last_clean":"2024-09-19T15:28:48.240820+0000","last_became_active":"2024-09-19T13:40:36.235186+0000","last_became_peered":"2024-09-19T13:40:36.235186+0000","last_unstale":"2024-09-19T15:28:48.240820+0000","last_undegraded":"2024-09-19T15:28:48.240820+0000","last_fullsized":"2024-09-19T15:28:48.240820+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:14.271645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2268,"num_read_kb":2120,"num_write":492,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'422","reported_seq":1259,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.532414+0000","last_change":"2024-09-19T13:40:34.236743+0000","last_active":"2024-09-19T15:31:40.532414+0000","last_peered":"2024-09-19T15:31:40.532414+0000","last_clean":"2024-09-19T15:31:40.532414+0000","last_became_active":"2024-09-19T13:40:34.236325+0000","last_became_peered":"2024-09-19T13:40:34.236325+0000","last_unstale":"2024-09-19T15:31:40.532414+0000","last_undegraded":"2024-09-19T15:31:40.532414+0000","last_fullsized":"2024-09-19T15:31:40.532414+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:08.160460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":865,"num_read_kb":111541,"num_write":1317,"num_write_kb":62709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":549,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.388450+0000","last_change":"2024-09-19T13:40:22.113992+0000","last_active":"2024-09-19T15:28:42.388450+0000","last_peered":"2024-09-19T15:28:42.388450+0000","last_clean":"2024-09-19T15:28:42.388450+0000","last_became_active":"2024-09-19T13:40:20.101186+0000","last_became_peered":"2024-09-19T13:40:20.101186+0000","last_unstale":"2024-09-19T15:28:42.388450+0000","last_undegraded":"2024-09-19T15:28:42.388450+0000","last_fullsized":"2024-09-19T15:28:42.388450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:40.208910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010323750000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.612811+0000","last_change":"2024-09-19T13:40:38.235854+0000","last_active":"2024-09-19T15:29:02.612811+0000","last_peered":"2024-09-19T15:29:02.612811+0000","last_clean":"2024-09-19T15:29:02.612811+0000","last_became_active":"2024-09-19T13:40:38.235109+0000","last_became_peered":"2024-09-19T13:40:38.235109+0000","last_unstale":"2024-09-19T15:29:02.612811+0000","last_undegraded":"2024-09-19T15:29:02.612811+0000","last_fullsized":"2024-09-19T15:29:02.612811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:18.997643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'193","reported_seq":793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.185499+0000","last_change":"2024-09-19T13:40:40.248167+0000","last_active":"2024-09-19T15:31:18.185499+0000","last_peered":"2024-09-19T15:31:18.185499+0000","last_clean":"2024-09-19T15:31:18.185499+0000","last_became_active":"2024-09-19T13:40:40.244484+0000","last_became_peered":"2024-09-19T13:40:40.244484+0000","last_unstale":"2024-09-19T15:31:18.185499+0000","last_undegraded":"2024-09-19T15:31:18.185499+0000","last_fullsized":"2024-09-19T15:31:18.185499+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:26.251998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":238,"num_read_kb":228,"num_write":166,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'789","reported_seq":5112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.553678+0000","last_change":"2024-09-19T13:40:42.258379+0000","last_active":"2024-09-19T15:31:40.553678+0000","last_peered":"2024-09-19T15:31:40.553678+0000","last_clean":"2024-09-19T15:31:40.553678+0000","last_became_active":"2024-09-19T13:40:42.257799+0000","last_became_peered":"2024-09-19T13:40:42.257799+0000","last_unstale":"2024-09-19T15:31:40.553678+0000","last_undegraded":"2024-09-19T15:31:40.553678+0000","last_fullsized":"2024-09-19T15:31:40.553678+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:03:48.981520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'191","reported_seq":724,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.522019+0000","last_change":"2024-09-19T13:40:44.259985+0000","last_active":"2024-09-19T15:29:48.522019+0000","last_peered":"2024-09-19T15:29:48.522019+0000","last_clean":"2024-09-19T15:29:48.522019+0000","last_became_active":"2024-09-19T13:40:44.259077+0000","last_became_peered":"2024-09-19T13:40:44.259077+0000","last_unstale":"2024-09-19T15:29:48.522019+0000","last_undegraded":"2024-09-19T15:29:48.522019+0000","last_fullsized":"2024-09-19T15:29:48.522019+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:06:05.199311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":211,"num_read_kb":198,"num_write":423,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'428","reported_seq":1954,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.611513+0000","last_change":"2024-09-19T13:40:36.243340+0000","last_active":"2024-09-19T15:28:57.611513+0000","last_peered":"2024-09-19T15:28:57.611513+0000","last_clean":"2024-09-19T15:28:57.611513+0000","last_became_active":"2024-09-19T13:40:36.242739+0000","last_became_peered":"2024-09-19T13:40:36.242739+0000","last_unstale":"2024-09-19T15:28:57.611513+0000","last_undegraded":"2024-09-19T15:28:57.611513+0000","last_fullsized":"2024-09-19T15:28:57.611513+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:12.677759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2240,"num_read_kb":2109,"num_write":493,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'308","reported_seq":960,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.546357+0000","last_change":"2024-09-19T13:41:05.316778+0000","last_active":"2024-09-19T15:31:40.546357+0000","last_peered":"2024-09-19T15:31:40.546357+0000","last_clean":"2024-09-19T15:31:40.546357+0000","last_became_active":"2024-09-19T13:41:05.316287+0000","last_became_peered":"2024-09-19T13:41:05.316287+0000","last_unstale":"2024-09-19T15:31:40.546357+0000","last_undegraded":"2024-09-19T15:31:40.546357+0000","last_fullsized":"2024-09-19T15:31:40.546357+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:28.207137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":643,"num_read_kb":12872,"num_write":1020,"num_write_kb":31603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":546,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.390813+0000","last_change":"2024-09-19T13:40:22.308878+0000","last_active":"2024-09-19T15:28:42.390813+0000","last_peered":"2024-09-19T15:28:42.390813+0000","last_clean":"2024-09-19T15:28:42.390813+0000","last_became_active":"2024-09-19T13:40:20.103134+0000","last_became_peered":"2024-09-19T13:40:20.103134+0000","last_unstale":"2024-09-19T15:28:42.390813+0000","last_undegraded":"2024-09-19T15:28:42.390813+0000","last_fullsized":"2024-09-19T15:28:42.390813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:19.066579+0000","last_clean_scrub_stamp":"2024-09-19T13:40:19.066579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:38.150405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093870599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:53.241996+0000","last_change":"2024-09-19T13:40:38.221807+0000","last_active":"2024-09-19T15:28:53.241996+0000","last_peered":"2024-09-19T15:28:53.241996+0000","last_clean":"2024-09-19T15:28:53.241996+0000","last_became_active":"2024-09-19T13:40:38.221430+0000","last_became_peered":"2024-09-19T13:40:38.221430+0000","last_unstale":"2024-09-19T15:28:53.241996+0000","last_undegraded":"2024-09-19T15:28:53.241996+0000","last_fullsized":"2024-09-19T15:28:53.241996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:13.637760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'840","reported_seq":1632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.445033+0000","last_change":"2024-09-19T13:40:40.230230+0000","last_active":"2024-09-19T15:31:39.445033+0000","last_peered":"2024-09-19T15:31:39.445033+0000","last_clean":"2024-09-19T15:31:39.445033+0000","last_became_active":"2024-09-19T13:40:40.229426+0000","last_became_peered":"2024-09-19T13:40:40.229426+0000","last_unstale":"2024-09-19T15:31:39.445033+0000","last_undegraded":"2024-09-19T15:31:39.445033+0000","last_fullsized":"2024-09-19T15:31:39.445033+0000","mapping_epoch":31,"log_start":"268'800","ondisk_log_start":"268'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":800,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:41:10.280326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140545,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1480,"num_read_kb":3413,"num_write":1200,"num_write_kb":946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:03.244490+0000","last_change":"2024-09-19T13:40:42.245759+0000","last_active":"2024-09-19T15:29:03.244490+0000","last_peered":"2024-09-19T15:29:03.244490+0000","last_clean":"2024-09-19T15:29:03.244490+0000","last_became_active":"2024-09-19T13:40:42.244291+0000","last_became_peered":"2024-09-19T13:40:42.244291+0000","last_unstale":"2024-09-19T15:29:03.244490+0000","last_undegraded":"2024-09-19T15:29:03.244490+0000","last_fullsized":"2024-09-19T15:29:03.244490+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:28.425275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'152","reported_seq":709,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:47.628704+0000","last_change":"2024-09-19T13:40:44.274189+0000","last_active":"2024-09-19T15:28:47.628704+0000","last_peered":"2024-09-19T15:28:47.628704+0000","last_clean":"2024-09-19T15:28:47.628704+0000","last_became_active":"2024-09-19T13:40:44.273409+0000","last_became_peered":"2024-09-19T13:40:44.273409+0000","last_unstale":"2024-09-19T15:28:47.628704+0000","last_undegraded":"2024-09-19T15:28:47.628704+0000","last_fullsized":"2024-09-19T15:28:47.628704+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:21.357101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":293,"num_read_kb":268,"num_write":395,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'157","reported_seq":741,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:51.129484+0000","last_change":"2024-09-19T13:40:44.264292+0000","last_active":"2024-09-19T15:29:51.129484+0000","last_peered":"2024-09-19T15:29:51.129484+0000","last_clean":"2024-09-19T15:29:51.129484+0000","last_became_active":"2024-09-19T13:40:44.263575+0000","last_became_peered":"2024-09-19T13:40:44.263575+0000","last_unstale":"2024-09-19T15:29:51.129484+0000","last_undegraded":"2024-09-19T15:29:51.129484+0000","last_fullsized":"2024-09-19T15:29:51.129484+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:21.299012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":274,"num_read_kb":267,"num_write":381,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'488","reported_seq":2271,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:49.327444+0000","last_change":"2024-09-19T13:40:36.228857+0000","last_active":"2024-09-19T15:28:49.327444+0000","last_peered":"2024-09-19T15:28:49.327444+0000","last_clean":"2024-09-19T15:28:49.327444+0000","last_became_active":"2024-09-19T13:40:36.221019+0000","last_became_peered":"2024-09-19T13:40:36.221019+0000","last_unstale":"2024-09-19T15:28:49.327444+0000","last_undegraded":"2024-09-19T15:28:49.327444+0000","last_fullsized":"2024-09-19T15:28:49.327444+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:18:02.656810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2720,"num_read_kb":2588,"num_write":552,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'395","reported_seq":1063,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.590201+0000","last_change":"2024-09-19T13:40:34.268385+0000","last_active":"2024-09-19T15:31:40.590201+0000","last_peered":"2024-09-19T15:31:40.590201+0000","last_clean":"2024-09-19T15:31:40.590201+0000","last_became_active":"2024-09-19T13:40:34.263276+0000","last_became_peered":"2024-09-19T13:40:34.263276+0000","last_unstale":"2024-09-19T15:31:40.590201+0000","last_undegraded":"2024-09-19T15:31:40.590201+0000","last_fullsized":"2024-09-19T15:31:40.590201+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:53.534025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":686,"num_read_kb":11371,"num_write":1228,"num_write_kb":39217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"37'5","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.114784+0000","last_change":"2024-09-19T13:40:38.216204+0000","last_active":"2024-09-19T15:31:38.114784+0000","last_peered":"2024-09-19T15:31:38.114784+0000","last_clean":"2024-09-19T15:31:38.114784+0000","last_became_active":"2024-09-19T13:40:38.215364+0000","last_became_peered":"2024-09-19T13:40:38.215364+0000","last_unstale":"2024-09-19T15:31:38.114784+0000","last_undegraded":"2024-09-19T15:31:38.114784+0000","last_fullsized":"2024-09-19T15:31:38.114784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:27.296619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":1184,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'360","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.869781+0000","last_change":"2024-09-19T13:40:40.230669+0000","last_active":"2024-09-19T15:31:39.869781+0000","last_peered":"2024-09-19T15:31:39.869781+0000","last_clean":"2024-09-19T15:31:39.869781+0000","last_became_active":"2024-09-19T13:40:40.229872+0000","last_became_peered":"2024-09-19T13:40:40.229872+0000","last_unstale":"2024-09-19T15:31:39.869781+0000","last_undegraded":"2024-09-19T15:31:39.869781+0000","last_fullsized":"2024-09-19T15:31:39.869781+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:36.305353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":585,"num_read_kb":1412,"num_write":468,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:03.230352+0000","last_change":"2024-09-19T13:40:42.243067+0000","last_active":"2024-09-19T15:28:03.230352+0000","last_peered":"2024-09-19T15:28:03.230352+0000","last_clean":"2024-09-19T15:28:03.230352+0000","last_became_active":"2024-09-19T13:40:42.242368+0000","last_became_peered":"2024-09-19T13:40:42.242368+0000","last_unstale":"2024-09-19T15:28:03.230352+0000","last_undegraded":"2024-09-19T15:28:03.230352+0000","last_fullsized":"2024-09-19T15:28:03.230352+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:59.628504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'121","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:46.522969+0000","last_change":"2024-09-19T13:40:44.269881+0000","last_active":"2024-09-19T15:29:46.522969+0000","last_peered":"2024-09-19T15:29:46.522969+0000","last_clean":"2024-09-19T15:29:46.522969+0000","last_became_active":"2024-09-19T13:40:44.268946+0000","last_became_peered":"2024-09-19T13:40:44.268946+0000","last_unstale":"2024-09-19T15:29:46.522969+0000","last_undegraded":"2024-09-19T15:29:46.522969+0000","last_fullsized":"2024-09-19T15:29:46.522969+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:40.184840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":128,"num_write":265,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'468","reported_seq":2032,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:19.439069+0000","last_change":"2024-09-19T13:40:36.226704+0000","last_active":"2024-09-19T15:28:19.439069+0000","last_peered":"2024-09-19T15:28:19.439069+0000","last_clean":"2024-09-19T15:28:19.439069+0000","last_became_active":"2024-09-19T13:40:36.226164+0000","last_became_peered":"2024-09-19T13:40:36.226164+0000","last_unstale":"2024-09-19T15:28:19.439069+0000","last_undegraded":"2024-09-19T15:28:19.439069+0000","last_fullsized":"2024-09-19T15:28:19.439069+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:08.833158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2492,"num_read_kb":2321,"num_write":561,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'308","reported_seq":1052,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.528237+0000","last_change":"2024-09-19T13:41:05.389078+0000","last_active":"2024-09-19T15:31:40.528237+0000","last_peered":"2024-09-19T15:31:40.528237+0000","last_clean":"2024-09-19T15:31:40.528237+0000","last_became_active":"2024-09-19T13:41:05.387779+0000","last_became_peered":"2024-09-19T13:41:05.387779+0000","last_unstale":"2024-09-19T15:31:40.528237+0000","last_undegraded":"2024-09-19T15:31:40.528237+0000","last_fullsized":"2024-09-19T15:31:40.528237+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:33:11.159579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":891,"num_read_kb":29706,"num_write":1011,"num_write_kb":41961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:03.230639+0000","last_change":"2024-09-19T13:40:38.229142+0000","last_active":"2024-09-19T15:28:03.230639+0000","last_peered":"2024-09-19T15:28:03.230639+0000","last_clean":"2024-09-19T15:28:03.230639+0000","last_became_active":"2024-09-19T13:40:38.228856+0000","last_became_peered":"2024-09-19T13:40:38.228856+0000","last_unstale":"2024-09-19T15:28:03.230639+0000","last_undegraded":"2024-09-19T15:28:03.230639+0000","last_fullsized":"2024-09-19T15:28:03.230639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:57:01.786775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'85","reported_seq":624,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.250690+0000","last_change":"2024-09-19T13:40:40.236243+0000","last_active":"2024-09-19T15:31:17.250690+0000","last_peered":"2024-09-19T15:31:17.250690+0000","last_clean":"2024-09-19T15:31:17.250690+0000","last_became_active":"2024-09-19T13:40:40.235528+0000","last_became_peered":"2024-09-19T13:40:40.235528+0000","last_unstale":"2024-09-19T15:31:17.250690+0000","last_undegraded":"2024-09-19T15:31:17.250690+0000","last_fullsized":"2024-09-19T15:31:17.250690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:33:05.231869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":75,"num_write":58,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.639370+0000","last_change":"2024-09-19T13:40:42.243881+0000","last_active":"2024-09-19T15:28:02.639370+0000","last_peered":"2024-09-19T15:28:02.639370+0000","last_clean":"2024-09-19T15:28:02.639370+0000","last_became_active":"2024-09-19T13:40:42.243224+0000","last_became_peered":"2024-09-19T13:40:42.243224+0000","last_unstale":"2024-09-19T15:28:02.639370+0000","last_undegraded":"2024-09-19T15:28:02.639370+0000","last_fullsized":"2024-09-19T15:28:02.639370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:08:53.998486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'210","reported_seq":756,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.410376+0000","last_change":"2024-09-19T13:40:44.259510+0000","last_active":"2024-09-19T15:29:48.410376+0000","last_peered":"2024-09-19T15:29:48.410376+0000","last_clean":"2024-09-19T15:29:48.410376+0000","last_became_active":"2024-09-19T13:40:44.258721+0000","last_became_peered":"2024-09-19T13:40:44.258721+0000","last_unstale":"2024-09-19T15:29:48.410376+0000","last_undegraded":"2024-09-19T15:29:48.410376+0000","last_fullsized":"2024-09-19T15:29:48.410376+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:08.449777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":369,"num_read_kb":358,"num_write":477,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'367","reported_seq":1888,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.249898+0000","last_change":"2024-09-19T13:40:36.240148+0000","last_active":"2024-09-19T15:31:12.249898+0000","last_peered":"2024-09-19T15:31:12.249898+0000","last_clean":"2024-09-19T15:31:12.249898+0000","last_became_active":"2024-09-19T13:40:36.239629+0000","last_became_peered":"2024-09-19T13:40:36.239629+0000","last_unstale":"2024-09-19T15:31:12.249898+0000","last_undegraded":"2024-09-19T15:31:12.249898+0000","last_fullsized":"2024-09-19T15:31:12.249898+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:24.215137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2075,"num_read_kb":1985,"num_write":419,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'332","reported_seq":1006,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.507035+0000","last_change":"2024-09-19T13:40:34.257051+0000","last_active":"2024-09-19T15:31:40.507035+0000","last_peered":"2024-09-19T15:31:40.507035+0000","last_clean":"2024-09-19T15:31:40.507035+0000","last_became_active":"2024-09-19T13:40:34.256236+0000","last_became_peered":"2024-09-19T13:40:34.256236+0000","last_unstale":"2024-09-19T15:31:40.507035+0000","last_undegraded":"2024-09-19T15:31:40.507035+0000","last_fullsized":"2024-09-19T15:31:40.507035+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:27:07.032068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136863,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":566,"num_read_kb":16816,"num_write":988,"num_write_kb":29952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.639311+0000","last_change":"2024-09-19T13:40:38.252067+0000","last_active":"2024-09-19T15:28:02.639311+0000","last_peered":"2024-09-19T15:28:02.639311+0000","last_clean":"2024-09-19T15:28:02.639311+0000","last_became_active":"2024-09-19T13:40:38.249269+0000","last_became_peered":"2024-09-19T13:40:38.249269+0000","last_unstale":"2024-09-19T15:28:02.639311+0000","last_undegraded":"2024-09-19T15:28:02.639311+0000","last_fullsized":"2024-09-19T15:28:02.639311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:17.524647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'357","reported_seq":1006,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.007611+0000","last_change":"2024-09-19T13:40:40.230649+0000","last_active":"2024-09-19T15:31:39.007611+0000","last_peered":"2024-09-19T15:31:39.007611+0000","last_clean":"2024-09-19T15:31:39.007611+0000","last_became_active":"2024-09-19T13:40:40.229852+0000","last_became_peered":"2024-09-19T13:40:40.229852+0000","last_unstale":"2024-09-19T15:31:39.007611+0000","last_undegraded":"2024-09-19T15:31:39.007611+0000","last_fullsized":"2024-09-19T15:31:39.007611+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:48.815571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47808,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":586,"num_read_kb":1181,"num_write":454,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.381985+0000","last_change":"2024-09-19T13:40:42.250045+0000","last_active":"2024-09-19T15:28:02.381985+0000","last_peered":"2024-09-19T15:28:02.381985+0000","last_clean":"2024-09-19T15:28:02.381985+0000","last_became_active":"2024-09-19T13:40:42.240135+0000","last_became_peered":"2024-09-19T13:40:42.240135+0000","last_unstale":"2024-09-19T15:28:02.381985+0000","last_undegraded":"2024-09-19T15:28:02.381985+0000","last_fullsized":"2024-09-19T15:28:02.381985+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:14.195144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'85","reported_seq":635,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:45.986381+0000","last_change":"2024-09-19T13:40:44.269896+0000","last_active":"2024-09-19T15:28:45.986381+0000","last_peered":"2024-09-19T15:28:45.986381+0000","last_clean":"2024-09-19T15:28:45.986381+0000","last_became_active":"2024-09-19T13:40:44.269134+0000","last_became_peered":"2024-09-19T13:40:44.269134+0000","last_unstale":"2024-09-19T15:28:45.986381+0000","last_undegraded":"2024-09-19T15:28:45.986381+0000","last_fullsized":"2024-09-19T15:28:45.986381+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:09.390631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":160,"num_write":196,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'609","reported_seq":2425,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.655880+0000","last_change":"2024-09-19T13:40:36.219585+0000","last_active":"2024-09-19T15:29:50.655880+0000","last_peered":"2024-09-19T15:29:50.655880+0000","last_clean":"2024-09-19T15:29:50.655880+0000","last_became_active":"2024-09-19T13:40:36.217925+0000","last_became_peered":"2024-09-19T13:40:36.217925+0000","last_unstale":"2024-09-19T15:29:50.655880+0000","last_undegraded":"2024-09-19T15:29:50.655880+0000","last_fullsized":"2024-09-19T15:29:50.655880+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":500,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:53.942689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3256,"num_read_kb":3011,"num_write":769,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'364","reported_seq":1019,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.561629+0000","last_change":"2024-09-19T13:40:34.228238+0000","last_active":"2024-09-19T15:31:40.561629+0000","last_peered":"2024-09-19T15:31:40.561629+0000","last_clean":"2024-09-19T15:31:40.561629+0000","last_became_active":"2024-09-19T13:40:34.227791+0000","last_became_peered":"2024-09-19T13:40:34.227791+0000","last_unstale":"2024-09-19T15:31:40.561629+0000","last_undegraded":"2024-09-19T15:31:40.561629+0000","last_fullsized":"2024-09-19T15:31:40.561629+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:08.249649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":536,"num_read_kb":35857,"num_write":1057,"num_write_kb":31805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.381920+0000","last_change":"2024-09-19T13:40:38.246952+0000","last_active":"2024-09-19T15:28:02.381920+0000","last_peered":"2024-09-19T15:28:02.381920+0000","last_clean":"2024-09-19T15:28:02.381920+0000","last_became_active":"2024-09-19T13:40:38.246129+0000","last_became_peered":"2024-09-19T13:40:38.246129+0000","last_unstale":"2024-09-19T15:28:02.381920+0000","last_undegraded":"2024-09-19T15:28:02.381920+0000","last_fullsized":"2024-09-19T15:28:02.381920+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:34.896613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'315","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.767910+0000","last_change":"2024-09-19T13:40:40.219645+0000","last_active":"2024-09-19T15:31:38.767910+0000","last_peered":"2024-09-19T15:31:38.767910+0000","last_clean":"2024-09-19T15:31:38.767910+0000","last_became_active":"2024-09-19T13:40:40.218434+0000","last_became_peered":"2024-09-19T13:40:40.218434+0000","last_unstale":"2024-09-19T15:31:38.767910+0000","last_undegraded":"2024-09-19T15:31:38.767910+0000","last_fullsized":"2024-09-19T15:31:38.767910+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:27.205776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44825,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":1129,"num_write":414,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.178023+0000","last_change":"2024-09-19T13:40:42.240830+0000","last_active":"2024-09-19T15:28:02.178023+0000","last_peered":"2024-09-19T15:28:02.178023+0000","last_clean":"2024-09-19T15:28:02.178023+0000","last_became_active":"2024-09-19T13:40:42.238908+0000","last_became_peered":"2024-09-19T13:40:42.238908+0000","last_unstale":"2024-09-19T15:28:02.178023+0000","last_undegraded":"2024-09-19T15:28:02.178023+0000","last_fullsized":"2024-09-19T15:28:02.178023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:27.434117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'522","reported_seq":2138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.266057+0000","last_change":"2024-09-19T13:40:36.244240+0000","last_active":"2024-09-19T15:31:12.266057+0000","last_peered":"2024-09-19T15:31:12.266057+0000","last_clean":"2024-09-19T15:31:12.266057+0000","last_became_active":"2024-09-19T13:40:36.243653+0000","last_became_peered":"2024-09-19T13:40:36.243653+0000","last_unstale":"2024-09-19T15:31:12.266057+0000","last_undegraded":"2024-09-19T15:31:12.266057+0000","last_fullsized":"2024-09-19T15:31:12.266057+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:58.132339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2759,"num_read_kb":2556,"num_write":676,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'358","reported_seq":1000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.557563+0000","last_change":"2024-09-19T13:40:34.220157+0000","last_active":"2024-09-19T15:31:40.557563+0000","last_peered":"2024-09-19T15:31:40.557563+0000","last_clean":"2024-09-19T15:31:40.557563+0000","last_became_active":"2024-09-19T13:40:34.219131+0000","last_became_peered":"2024-09-19T13:40:34.219131+0000","last_unstale":"2024-09-19T15:31:40.557563+0000","last_undegraded":"2024-09-19T15:31:40.557563+0000","last_fullsized":"2024-09-19T15:31:40.557563+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:20.075063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273703,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":16977,"num_write":1175,"num_write_kb":67471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:17.195724+0000","last_change":"2024-09-19T13:40:38.232297+0000","last_active":"2024-09-19T15:29:17.195724+0000","last_peered":"2024-09-19T15:29:17.195724+0000","last_clean":"2024-09-19T15:29:17.195724+0000","last_became_active":"2024-09-19T13:40:38.231992+0000","last_became_peered":"2024-09-19T13:40:38.231992+0000","last_unstale":"2024-09-19T15:29:17.195724+0000","last_undegraded":"2024-09-19T15:29:17.195724+0000","last_fullsized":"2024-09-19T15:29:17.195724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:52.322584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'563","reported_seq":1234,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.251285+0000","last_change":"2024-09-19T13:40:40.242437+0000","last_active":"2024-09-19T15:31:40.251285+0000","last_peered":"2024-09-19T15:31:40.251285+0000","last_clean":"2024-09-19T15:31:40.251285+0000","last_became_active":"2024-09-19T13:40:40.241045+0000","last_became_peered":"2024-09-19T13:40:40.241045+0000","last_unstale":"2024-09-19T15:31:40.251285+0000","last_undegraded":"2024-09-19T15:31:40.251285+0000","last_fullsized":"2024-09-19T15:31:40.251285+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:12.858930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102495,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":998,"num_read_kb":2312,"num_write":864,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.620732+0000","last_change":"2024-09-19T13:40:42.266732+0000","last_active":"2024-09-19T15:28:12.620732+0000","last_peered":"2024-09-19T15:28:12.620732+0000","last_clean":"2024-09-19T15:28:12.620732+0000","last_became_active":"2024-09-19T13:40:42.266161+0000","last_became_peered":"2024-09-19T13:40:42.266161+0000","last_unstale":"2024-09-19T15:28:12.620732+0000","last_undegraded":"2024-09-19T15:28:12.620732+0000","last_fullsized":"2024-09-19T15:28:12.620732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:36.831314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'153","reported_seq":684,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:08.231621+0000","last_change":"2024-09-19T13:40:44.280809+0000","last_active":"2024-09-19T15:28:08.231621+0000","last_peered":"2024-09-19T15:28:08.231621+0000","last_clean":"2024-09-19T15:28:08.231621+0000","last_became_active":"2024-09-19T13:40:44.280362+0000","last_became_peered":"2024-09-19T13:40:44.280362+0000","last_unstale":"2024-09-19T15:28:08.231621+0000","last_undegraded":"2024-09-19T15:28:08.231621+0000","last_fullsized":"2024-09-19T15:28:08.231621+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:26:28.134421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":216,"num_read_kb":226,"num_write":329,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'908","reported_seq":2606,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.194253+0000","last_change":"2024-09-19T13:40:36.234854+0000","last_active":"2024-09-19T15:29:12.194253+0000","last_peered":"2024-09-19T15:29:12.194253+0000","last_clean":"2024-09-19T15:29:12.194253+0000","last_became_active":"2024-09-19T13:40:36.234428+0000","last_became_peered":"2024-09-19T13:40:36.234428+0000","last_unstale":"2024-09-19T15:29:12.194253+0000","last_undegraded":"2024-09-19T15:29:12.194253+0000","last_fullsized":"2024-09-19T15:29:12.194253+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":800,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:32.532292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4426,"num_read_kb":3975,"num_write":1248,"num_write_kb":508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'387","reported_seq":1097,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.531117+0000","last_change":"2024-09-19T13:40:34.250086+0000","last_active":"2024-09-19T15:31:40.531117+0000","last_peered":"2024-09-19T15:31:40.531117+0000","last_clean":"2024-09-19T15:31:40.531117+0000","last_became_active":"2024-09-19T13:40:34.249719+0000","last_became_peered":"2024-09-19T13:40:34.249719+0000","last_unstale":"2024-09-19T15:31:40.531117+0000","last_undegraded":"2024-09-19T15:31:40.531117+0000","last_fullsized":"2024-09-19T15:31:40.531117+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:25:54.224688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2165812,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":691,"num_read_kb":108324,"num_write":1302,"num_write_kb":34137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"37'3","reported_seq":1000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.118413+0000","last_change":"2024-09-19T13:40:38.246559+0000","last_active":"2024-09-19T15:31:38.118413+0000","last_peered":"2024-09-19T15:31:38.118413+0000","last_clean":"2024-09-19T15:31:38.118413+0000","last_became_active":"2024-09-19T13:40:38.245835+0000","last_became_peered":"2024-09-19T13:40:38.245835+0000","last_unstale":"2024-09-19T15:31:38.118413+0000","last_undegraded":"2024-09-19T15:31:38.118413+0000","last_fullsized":"2024-09-19T15:31:38.118413+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:31:52.188595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":719,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'387","reported_seq":1042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.840198+0000","last_change":"2024-09-19T13:40:40.238081+0000","last_active":"2024-09-19T15:31:38.840198+0000","last_peered":"2024-09-19T15:31:38.840198+0000","last_clean":"2024-09-19T15:31:38.840198+0000","last_became_active":"2024-09-19T13:40:40.237537+0000","last_became_peered":"2024-09-19T13:40:40.237537+0000","last_unstale":"2024-09-19T15:31:38.840198+0000","last_undegraded":"2024-09-19T15:31:38.840198+0000","last_fullsized":"2024-09-19T15:31:38.840198+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:45.292548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49094,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":653,"num_read_kb":1263,"num_write":536,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381450+0000","last_change":"2024-09-19T13:40:42.252696+0000","last_active":"2024-09-19T15:28:12.381450+0000","last_peered":"2024-09-19T15:28:12.381450+0000","last_clean":"2024-09-19T15:28:12.381450+0000","last_became_active":"2024-09-19T13:40:42.251896+0000","last_became_peered":"2024-09-19T13:40:42.251896+0000","last_unstale":"2024-09-19T15:28:12.381450+0000","last_undegraded":"2024-09-19T15:28:12.381450+0000","last_fullsized":"2024-09-19T15:28:12.381450+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:38.583676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'201","reported_seq":1087,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:43.276093+0000","last_change":"2024-09-19T13:40:44.269379+0000","last_active":"2024-09-19T15:29:43.276093+0000","last_peered":"2024-09-19T15:29:43.276093+0000","last_clean":"2024-09-19T15:29:43.276093+0000","last_became_active":"2024-09-19T13:40:44.268710+0000","last_became_peered":"2024-09-19T13:40:44.268710+0000","last_unstale":"2024-09-19T15:29:43.276093+0000","last_undegraded":"2024-09-19T15:29:43.276093+0000","last_fullsized":"2024-09-19T15:29:43.276093+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:25.122775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":655,"num_read_kb":652,"num_write":565,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'581","reported_seq":2263,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:49.326176+0000","last_change":"2024-09-19T13:40:36.218790+0000","last_active":"2024-09-19T15:28:49.326176+0000","last_peered":"2024-09-19T15:28:49.326176+0000","last_clean":"2024-09-19T15:28:49.326176+0000","last_became_active":"2024-09-19T13:40:36.217961+0000","last_became_peered":"2024-09-19T13:40:36.217961+0000","last_unstale":"2024-09-19T15:28:49.326176+0000","last_undegraded":"2024-09-19T15:28:49.326176+0000","last_fullsized":"2024-09-19T15:28:49.326176+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:06.866384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2994,"num_read_kb":2751,"num_write":739,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'361","reported_seq":1159,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.451212+0000","last_change":"2024-09-19T13:40:34.254466+0000","last_active":"2024-09-19T15:31:40.451212+0000","last_peered":"2024-09-19T15:31:40.451212+0000","last_clean":"2024-09-19T15:31:40.451212+0000","last_became_active":"2024-09-19T13:40:34.253708+0000","last_became_peered":"2024-09-19T13:40:34.253708+0000","last_unstale":"2024-09-19T15:31:40.451212+0000","last_undegraded":"2024-09-19T15:31:40.451212+0000","last_fullsized":"2024-09-19T15:31:40.451212+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:37:08.846663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":758,"num_read_kb":54804,"num_write":1089,"num_write_kb":28785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.601276+0000","last_change":"2024-09-19T13:40:38.245697+0000","last_active":"2024-09-19T15:28:12.601276+0000","last_peered":"2024-09-19T15:28:12.601276+0000","last_clean":"2024-09-19T15:28:12.601276+0000","last_became_active":"2024-09-19T13:40:38.245018+0000","last_became_peered":"2024-09-19T13:40:38.245018+0000","last_unstale":"2024-09-19T15:28:12.601276+0000","last_undegraded":"2024-09-19T15:28:12.601276+0000","last_fullsized":"2024-09-19T15:28:12.601276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:48.463235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'349","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.131655+0000","last_change":"2024-09-19T13:40:40.234381+0000","last_active":"2024-09-19T15:31:40.131655+0000","last_peered":"2024-09-19T15:31:40.131655+0000","last_clean":"2024-09-19T15:31:40.131655+0000","last_became_active":"2024-09-19T13:40:40.229201+0000","last_became_peered":"2024-09-19T13:40:40.229201+0000","last_unstale":"2024-09-19T15:31:40.131655+0000","last_undegraded":"2024-09-19T15:31:40.131655+0000","last_fullsized":"2024-09-19T15:31:40.131655+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:53.097533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43041,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":567,"num_read_kb":1167,"num_write":454,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.395355+0000","last_change":"2024-09-19T13:40:42.247045+0000","last_active":"2024-09-19T15:29:12.395355+0000","last_peered":"2024-09-19T15:29:12.395355+0000","last_clean":"2024-09-19T15:29:12.395355+0000","last_became_active":"2024-09-19T13:40:42.246286+0000","last_became_peered":"2024-09-19T13:40:42.246286+0000","last_unstale":"2024-09-19T15:29:12.395355+0000","last_undegraded":"2024-09-19T15:29:12.395355+0000","last_fullsized":"2024-09-19T15:29:12.395355+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:20:14.165507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'161","reported_seq":725,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.256170+0000","last_change":"2024-09-19T13:40:44.270342+0000","last_active":"2024-09-19T15:31:13.256170+0000","last_peered":"2024-09-19T15:31:13.256170+0000","last_clean":"2024-09-19T15:31:13.256170+0000","last_became_active":"2024-09-19T13:40:44.267428+0000","last_became_peered":"2024-09-19T13:40:44.267428+0000","last_unstale":"2024-09-19T15:31:13.256170+0000","last_undegraded":"2024-09-19T15:31:13.256170+0000","last_fullsized":"2024-09-19T15:31:13.256170+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:14.956268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":325,"num_read_kb":284,"num_write":406,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'372","reported_seq":2097,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.308591+0000","last_change":"2024-09-19T13:40:36.231144+0000","last_active":"2024-09-19T15:29:41.308591+0000","last_peered":"2024-09-19T15:29:41.308591+0000","last_clean":"2024-09-19T15:29:41.308591+0000","last_became_active":"2024-09-19T13:40:36.230842+0000","last_became_peered":"2024-09-19T13:40:36.230842+0000","last_unstale":"2024-09-19T15:29:41.308591+0000","last_undegraded":"2024-09-19T15:29:41.308591+0000","last_fullsized":"2024-09-19T15:29:41.308591+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:13.952447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2340,"num_read_kb":2286,"num_write":408,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'380","reported_seq":1162,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.571339+0000","last_change":"2024-09-19T13:41:05.307783+0000","last_active":"2024-09-19T15:31:40.571339+0000","last_peered":"2024-09-19T15:31:40.571339+0000","last_clean":"2024-09-19T15:31:40.571339+0000","last_became_active":"2024-09-19T13:41:05.307368+0000","last_became_peered":"2024-09-19T13:41:05.307368+0000","last_unstale":"2024-09-19T15:31:40.571339+0000","last_undegraded":"2024-09-19T15:31:40.571339+0000","last_fullsized":"2024-09-19T15:31:40.571339+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:24.705807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":987,"num_read_kb":73584,"num_write":1229,"num_write_kb":59214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381473+0000","last_change":"2024-09-19T13:40:38.245965+0000","last_active":"2024-09-19T15:28:12.381473+0000","last_peered":"2024-09-19T15:28:12.381473+0000","last_clean":"2024-09-19T15:28:12.381473+0000","last_became_active":"2024-09-19T13:40:38.245287+0000","last_became_peered":"2024-09-19T13:40:38.245287+0000","last_unstale":"2024-09-19T15:28:12.381473+0000","last_undegraded":"2024-09-19T15:28:12.381473+0000","last_fullsized":"2024-09-19T15:28:12.381473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:07.416511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'172","reported_seq":758,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.249753+0000","last_change":"2024-09-19T13:40:40.247785+0000","last_active":"2024-09-19T15:31:18.249753+0000","last_peered":"2024-09-19T15:31:18.249753+0000","last_clean":"2024-09-19T15:31:18.249753+0000","last_became_active":"2024-09-19T13:40:40.246680+0000","last_became_peered":"2024-09-19T13:40:40.246680+0000","last_unstale":"2024-09-19T15:31:18.249753+0000","last_undegraded":"2024-09-19T15:31:18.249753+0000","last_fullsized":"2024-09-19T15:31:18.249753+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:04.960514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":223,"num_read_kb":217,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'765","reported_seq":2973,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.158907+0000","last_change":"2024-09-19T13:40:42.253045+0000","last_active":"2024-09-19T15:31:38.158907+0000","last_peered":"2024-09-19T15:31:38.158907+0000","last_clean":"2024-09-19T15:31:38.158907+0000","last_became_active":"2024-09-19T13:40:42.250436+0000","last_became_peered":"2024-09-19T13:40:42.250436+0000","last_unstale":"2024-09-19T15:31:38.158907+0000","last_undegraded":"2024-09-19T15:31:38.158907+0000","last_fullsized":"2024-09-19T15:31:38.158907+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:00.593974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'100","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:27.673954+0000","last_change":"2024-09-19T13:40:44.269427+0000","last_active":"2024-09-19T15:30:27.673954+0000","last_peered":"2024-09-19T15:30:27.673954+0000","last_clean":"2024-09-19T15:30:27.673954+0000","last_became_active":"2024-09-19T13:40:44.268630+0000","last_became_peered":"2024-09-19T13:40:44.268630+0000","last_unstale":"2024-09-19T15:30:27.673954+0000","last_undegraded":"2024-09-19T15:30:27.673954+0000","last_fullsized":"2024-09-19T15:30:27.673954+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:59.722843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":162,"num_read_kb":149,"num_write":244,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'1161","reported_seq":2729,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:39.716195+0000","last_change":"2024-09-19T13:41:05.321007+0000","last_active":"2024-09-19T15:28:39.716195+0000","last_peered":"2024-09-19T15:28:39.716195+0000","last_clean":"2024-09-19T15:28:39.716195+0000","last_became_active":"2024-09-19T13:41:05.320040+0000","last_became_peered":"2024-09-19T13:41:05.320040+0000","last_unstale":"2024-09-19T15:28:39.716195+0000","last_undegraded":"2024-09-19T15:28:39.716195+0000","last_fullsized":"2024-09-19T15:28:39.716195+0000","mapping_epoch":38,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":1100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:09:24.769399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5194,"num_read_kb":4574,"num_write":1598,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'367","reported_seq":1029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.523831+0000","last_change":"2024-09-19T13:40:34.252303+0000","last_active":"2024-09-19T15:31:40.523831+0000","last_peered":"2024-09-19T15:31:40.523831+0000","last_clean":"2024-09-19T15:31:40.523831+0000","last_became_active":"2024-09-19T13:40:34.251475+0000","last_became_peered":"2024-09-19T13:40:34.251475+0000","last_unstale":"2024-09-19T15:31:40.523831+0000","last_undegraded":"2024-09-19T15:31:40.523831+0000","last_fullsized":"2024-09-19T15:31:40.523831+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:25:30.036187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":623,"num_read_kb":3575,"num_write":1141,"num_write_kb":19359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.641848+0000","last_change":"2024-09-19T13:40:38.246925+0000","last_active":"2024-09-19T15:28:12.641848+0000","last_peered":"2024-09-19T15:28:12.641848+0000","last_clean":"2024-09-19T15:28:12.641848+0000","last_became_active":"2024-09-19T13:40:38.246205+0000","last_became_peered":"2024-09-19T13:40:38.246205+0000","last_unstale":"2024-09-19T15:28:12.641848+0000","last_undegraded":"2024-09-19T15:28:12.641848+0000","last_fullsized":"2024-09-19T15:28:12.641848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:54.953146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'383","reported_seq":1044,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.492905+0000","last_change":"2024-09-19T13:40:40.242303+0000","last_active":"2024-09-19T15:31:40.492905+0000","last_peered":"2024-09-19T15:31:40.492905+0000","last_clean":"2024-09-19T15:31:40.492905+0000","last_became_active":"2024-09-19T13:40:40.241730+0000","last_became_peered":"2024-09-19T13:40:40.241730+0000","last_unstale":"2024-09-19T15:31:40.492905+0000","last_undegraded":"2024-09-19T15:31:40.492905+0000","last_fullsized":"2024-09-19T15:31:40.492905+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:27.316298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69547,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":608,"num_read_kb":1209,"num_write":470,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:02.165536+0000","last_change":"2024-09-19T13:40:42.240898+0000","last_active":"2024-09-19T15:27:02.165536+0000","last_peered":"2024-09-19T15:27:02.165536+0000","last_clean":"2024-09-19T15:27:02.165536+0000","last_became_active":"2024-09-19T13:40:42.240191+0000","last_became_peered":"2024-09-19T13:40:42.240191+0000","last_unstale":"2024-09-19T15:27:02.165536+0000","last_undegraded":"2024-09-19T15:27:02.165536+0000","last_fullsized":"2024-09-19T15:27:02.165536+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:00.682593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'128","reported_seq":652,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:49.771957+0000","last_change":"2024-09-19T13:40:44.274954+0000","last_active":"2024-09-19T15:29:49.771957+0000","last_peered":"2024-09-19T15:29:49.771957+0000","last_clean":"2024-09-19T15:29:49.771957+0000","last_became_active":"2024-09-19T13:40:44.274449+0000","last_became_peered":"2024-09-19T13:40:44.274449+0000","last_unstale":"2024-09-19T15:29:49.771957+0000","last_undegraded":"2024-09-19T15:29:49.771957+0000","last_fullsized":"2024-09-19T15:29:49.771957+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:28.625729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":153,"num_write":303,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'796","reported_seq":2343,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.600083+0000","last_change":"2024-09-19T13:40:36.231742+0000","last_active":"2024-09-19T15:28:07.600083+0000","last_peered":"2024-09-19T15:28:07.600083+0000","last_clean":"2024-09-19T15:28:07.600083+0000","last_became_active":"2024-09-19T13:40:36.227359+0000","last_became_peered":"2024-09-19T13:40:36.227359+0000","last_unstale":"2024-09-19T15:28:07.600083+0000","last_undegraded":"2024-09-19T15:28:07.600083+0000","last_fullsized":"2024-09-19T15:28:07.600083+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:05:00.421649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3854,"num_read_kb":3454,"num_write":1058,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'425","reported_seq":1182,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.583911+0000","last_change":"2024-09-19T13:41:05.314078+0000","last_active":"2024-09-19T15:31:40.583911+0000","last_peered":"2024-09-19T15:31:40.583911+0000","last_clean":"2024-09-19T15:31:40.583911+0000","last_became_active":"2024-09-19T13:41:05.313209+0000","last_became_peered":"2024-09-19T13:41:05.313209+0000","last_unstale":"2024-09-19T15:31:40.583911+0000","last_undegraded":"2024-09-19T15:31:40.583911+0000","last_fullsized":"2024-09-19T15:31:40.583911+0000","mapping_epoch":38,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:11.443410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136845,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":777,"num_read_kb":102227,"num_write":1424,"num_write_kb":49987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.620697+0000","last_change":"2024-09-19T13:40:38.230747+0000","last_active":"2024-09-19T15:28:12.620697+0000","last_peered":"2024-09-19T15:28:12.620697+0000","last_clean":"2024-09-19T15:28:12.620697+0000","last_became_active":"2024-09-19T13:40:38.229929+0000","last_became_peered":"2024-09-19T13:40:38.229929+0000","last_unstale":"2024-09-19T15:28:12.620697+0000","last_undegraded":"2024-09-19T15:28:12.620697+0000","last_fullsized":"2024-09-19T15:28:12.620697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:58:25.811713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'302","reported_seq":913,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.549300+0000","last_change":"2024-09-19T13:40:40.241834+0000","last_active":"2024-09-19T15:31:40.549300+0000","last_peered":"2024-09-19T15:31:40.549300+0000","last_clean":"2024-09-19T15:31:40.549300+0000","last_became_active":"2024-09-19T13:40:40.241404+0000","last_became_peered":"2024-09-19T13:40:40.241404+0000","last_unstale":"2024-09-19T15:31:40.549300+0000","last_undegraded":"2024-09-19T15:31:40.549300+0000","last_fullsized":"2024-09-19T15:31:40.549300+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:41.176371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45708,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":1069,"num_write":394,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:27.572162+0000","last_change":"2024-09-19T13:40:42.254516+0000","last_active":"2024-09-19T15:27:27.572162+0000","last_peered":"2024-09-19T15:27:27.572162+0000","last_clean":"2024-09-19T15:27:27.572162+0000","last_became_active":"2024-09-19T13:40:42.251413+0000","last_became_peered":"2024-09-19T13:40:42.251413+0000","last_unstale":"2024-09-19T15:27:27.572162+0000","last_undegraded":"2024-09-19T15:27:27.572162+0000","last_fullsized":"2024-09-19T15:27:27.572162+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:44:42.558167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'161","reported_seq":716,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.091208+0000","last_change":"2024-09-19T13:40:44.278568+0000","last_active":"2024-09-19T15:29:50.091208+0000","last_peered":"2024-09-19T15:29:50.091208+0000","last_clean":"2024-09-19T15:29:50.091208+0000","last_became_active":"2024-09-19T13:40:44.277774+0000","last_became_peered":"2024-09-19T13:40:44.277774+0000","last_unstale":"2024-09-19T15:29:50.091208+0000","last_undegraded":"2024-09-19T15:29:50.091208+0000","last_fullsized":"2024-09-19T15:29:50.091208+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:30.389728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":980,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216,"num_read_kb":207,"num_write":371,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'464","reported_seq":2234,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.261421+0000","last_change":"2024-09-19T13:40:36.223086+0000","last_active":"2024-09-19T15:31:12.261421+0000","last_peered":"2024-09-19T15:31:12.261421+0000","last_clean":"2024-09-19T15:31:12.261421+0000","last_became_active":"2024-09-19T13:40:36.222632+0000","last_became_peered":"2024-09-19T13:40:36.222632+0000","last_unstale":"2024-09-19T15:31:12.261421+0000","last_undegraded":"2024-09-19T15:31:12.261421+0000","last_fullsized":"2024-09-19T15:31:12.261421+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:02.744559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2809,"num_read_kb":2663,"num_write":534,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'381","reported_seq":1083,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.581172+0000","last_change":"2024-09-19T13:40:34.258460+0000","last_active":"2024-09-19T15:31:40.581172+0000","last_peered":"2024-09-19T15:31:40.581172+0000","last_clean":"2024-09-19T15:31:40.581172+0000","last_became_active":"2024-09-19T13:40:34.258068+0000","last_became_peered":"2024-09-19T13:40:34.258068+0000","last_unstale":"2024-09-19T15:31:40.581172+0000","last_undegraded":"2024-09-19T15:31:40.581172+0000","last_fullsized":"2024-09-19T15:31:40.581172+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:06:27.239604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":750,"num_read_kb":11976,"num_write":1179,"num_write_kb":32337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:02.584884+0000","last_change":"2024-09-19T13:40:38.240655+0000","last_active":"2024-09-19T15:27:02.584884+0000","last_peered":"2024-09-19T15:27:02.584884+0000","last_clean":"2024-09-19T15:27:02.584884+0000","last_became_active":"2024-09-19T13:40:38.236724+0000","last_became_peered":"2024-09-19T13:40:38.236724+0000","last_unstale":"2024-09-19T15:27:02.584884+0000","last_undegraded":"2024-09-19T15:27:02.584884+0000","last_fullsized":"2024-09-19T15:27:02.584884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:37:16.998791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'276","reported_seq":870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.004625+0000","last_change":"2024-09-19T13:40:40.223389+0000","last_active":"2024-09-19T15:31:40.004625+0000","last_peered":"2024-09-19T15:31:40.004625+0000","last_clean":"2024-09-19T15:31:40.004625+0000","last_became_active":"2024-09-19T13:40:40.222807+0000","last_became_peered":"2024-09-19T13:40:40.222807+0000","last_unstale":"2024-09-19T15:31:40.004625+0000","last_undegraded":"2024-09-19T15:31:40.004625+0000","last_fullsized":"2024-09-19T15:31:40.004625+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:53.228422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47535,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":1137,"num_write":394,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.601222+0000","last_change":"2024-09-19T13:40:42.251870+0000","last_active":"2024-09-19T15:28:12.601222+0000","last_peered":"2024-09-19T15:28:12.601222+0000","last_clean":"2024-09-19T15:28:12.601222+0000","last_became_active":"2024-09-19T13:40:42.251057+0000","last_became_peered":"2024-09-19T13:40:42.251057+0000","last_unstale":"2024-09-19T15:28:12.601222+0000","last_undegraded":"2024-09-19T15:28:12.601222+0000","last_fullsized":"2024-09-19T15:28:12.601222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:37.359054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'143","reported_seq":1274,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:42.301571+0000","last_change":"2024-09-19T13:40:44.271381+0000","last_active":"2024-09-19T15:29:42.301571+0000","last_peered":"2024-09-19T15:29:42.301571+0000","last_clean":"2024-09-19T15:29:42.301571+0000","last_became_active":"2024-09-19T13:40:44.270656+0000","last_became_peered":"2024-09-19T13:40:44.270656+0000","last_unstale":"2024-09-19T15:29:42.301571+0000","last_undegraded":"2024-09-19T15:29:42.301571+0000","last_fullsized":"2024-09-19T15:29:42.301571+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:12:45.652710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":816,"num_read_kb":810,"num_write":350,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'465","reported_seq":1994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:39.716302+0000","last_change":"2024-09-19T13:40:36.218077+0000","last_active":"2024-09-19T15:28:39.716302+0000","last_peered":"2024-09-19T15:28:39.716302+0000","last_clean":"2024-09-19T15:28:39.716302+0000","last_became_active":"2024-09-19T13:40:36.217230+0000","last_became_peered":"2024-09-19T13:40:36.217230+0000","last_unstale":"2024-09-19T15:28:39.716302+0000","last_undegraded":"2024-09-19T15:28:39.716302+0000","last_fullsized":"2024-09-19T15:28:39.716302+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:27.690091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2437,"num_read_kb":2267,"num_write":569,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'335","reported_seq":993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.581905+0000","last_change":"2024-09-19T13:40:34.258755+0000","last_active":"2024-09-19T15:31:40.581905+0000","last_peered":"2024-09-19T15:31:40.581905+0000","last_clean":"2024-09-19T15:31:40.581905+0000","last_became_active":"2024-09-19T13:40:34.258416+0000","last_became_peered":"2024-09-19T13:40:34.258416+0000","last_unstale":"2024-09-19T15:31:40.581905+0000","last_undegraded":"2024-09-19T15:31:40.581905+0000","last_fullsized":"2024-09-19T15:31:40.581905+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:47.238199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":559,"num_read_kb":6695,"num_write":1052,"num_write_kb":15020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.371514+0000","last_change":"2024-09-19T13:40:38.217596+0000","last_active":"2024-09-19T15:27:32.371514+0000","last_peered":"2024-09-19T15:27:32.371514+0000","last_clean":"2024-09-19T15:27:32.371514+0000","last_became_active":"2024-09-19T13:40:38.214571+0000","last_became_peered":"2024-09-19T13:40:38.214571+0000","last_unstale":"2024-09-19T15:27:32.371514+0000","last_undegraded":"2024-09-19T15:27:32.371514+0000","last_fullsized":"2024-09-19T15:27:32.371514+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:52.834683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'350","reported_seq":979,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.191119+0000","last_change":"2024-09-19T13:40:40.248984+0000","last_active":"2024-09-19T15:31:40.191119+0000","last_peered":"2024-09-19T15:31:40.191119+0000","last_clean":"2024-09-19T15:31:40.191119+0000","last_became_active":"2024-09-19T13:40:40.245368+0000","last_became_peered":"2024-09-19T13:40:40.245368+0000","last_unstale":"2024-09-19T15:31:40.191119+0000","last_undegraded":"2024-09-19T15:31:40.191119+0000","last_fullsized":"2024-09-19T15:31:40.191119+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:10.651187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48547,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":571,"num_read_kb":1175,"num_write":452,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.180073+0000","last_change":"2024-09-19T13:40:42.240218+0000","last_active":"2024-09-19T15:28:12.180073+0000","last_peered":"2024-09-19T15:28:12.180073+0000","last_clean":"2024-09-19T15:28:12.180073+0000","last_became_active":"2024-09-19T13:40:42.239391+0000","last_became_peered":"2024-09-19T13:40:42.239391+0000","last_unstale":"2024-09-19T15:28:12.180073+0000","last_undegraded":"2024-09-19T15:28:12.180073+0000","last_fullsized":"2024-09-19T15:28:12.180073+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:58.943534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'128","reported_seq":656,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.238755+0000","last_change":"2024-09-19T13:40:44.249845+0000","last_active":"2024-09-19T15:31:12.238755+0000","last_peered":"2024-09-19T15:31:12.238755+0000","last_clean":"2024-09-19T15:31:12.238755+0000","last_became_active":"2024-09-19T13:40:44.249201+0000","last_became_peered":"2024-09-19T13:40:44.249201+0000","last_unstale":"2024-09-19T15:31:12.238755+0000","last_undegraded":"2024-09-19T15:31:12.238755+0000","last_fullsized":"2024-09-19T15:31:12.238755+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:40.297816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":210,"num_read_kb":190,"num_write":320,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'403","reported_seq":2077,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391896+0000","last_change":"2024-09-19T13:40:36.226270+0000","last_active":"2024-09-19T15:28:57.391896+0000","last_peered":"2024-09-19T15:28:57.391896+0000","last_clean":"2024-09-19T15:28:57.391896+0000","last_became_active":"2024-09-19T13:40:36.225885+0000","last_became_peered":"2024-09-19T13:40:36.225885+0000","last_unstale":"2024-09-19T15:28:57.391896+0000","last_undegraded":"2024-09-19T15:28:57.391896+0000","last_fullsized":"2024-09-19T15:28:57.391896+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:53.469735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2307,"num_read_kb":2225,"num_write":450,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'329","reported_seq":962,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.532480+0000","last_change":"2024-09-19T13:40:34.262660+0000","last_active":"2024-09-19T15:31:40.532480+0000","last_peered":"2024-09-19T15:31:40.532480+0000","last_clean":"2024-09-19T15:31:40.532480+0000","last_became_active":"2024-09-19T13:40:34.249068+0000","last_became_peered":"2024-09-19T13:40:34.249068+0000","last_unstale":"2024-09-19T15:31:40.532480+0000","last_undegraded":"2024-09-19T15:31:40.532480+0000","last_fullsized":"2024-09-19T15:31:40.532480+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:53.622353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":27093,"num_write":1002,"num_write_kb":27581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"268'459","reported_seq":2102,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.313338+0000","last_change":"2024-09-19T13:40:36.222782+0000","last_active":"2024-09-19T15:29:41.313338+0000","last_peered":"2024-09-19T15:29:41.313338+0000","last_clean":"2024-09-19T15:29:41.313338+0000","last_became_active":"2024-09-19T13:40:36.220569+0000","last_became_peered":"2024-09-19T13:40:36.220569+0000","last_unstale":"2024-09-19T15:29:41.313338+0000","last_undegraded":"2024-09-19T15:29:41.313338+0000","last_fullsized":"2024-09-19T15:29:41.313338+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:10:08.215249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2535,"num_read_kb":2389,"num_write":539,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"268'416","reported_seq":1132,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.527496+0000","last_change":"2024-09-19T13:40:34.239840+0000","last_active":"2024-09-19T15:31:40.527496+0000","last_peered":"2024-09-19T15:31:40.527496+0000","last_clean":"2024-09-19T15:31:40.527496+0000","last_became_active":"2024-09-19T13:40:34.239357+0000","last_became_peered":"2024-09-19T13:40:34.239357+0000","last_unstale":"2024-09-19T15:31:40.527496+0000","last_undegraded":"2024-09-19T15:31:40.527496+0000","last_fullsized":"2024-09-19T15:31:40.527496+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:11:55.800088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":787,"num_read_kb":92890,"num_write":1403,"num_write_kb":63384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'594","reported_seq":2305,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.631054+0000","last_change":"2024-09-19T13:40:36.242232+0000","last_active":"2024-09-19T15:28:57.631054+0000","last_peered":"2024-09-19T15:28:57.631054+0000","last_clean":"2024-09-19T15:28:57.631054+0000","last_became_active":"2024-09-19T13:40:36.241566+0000","last_became_peered":"2024-09-19T13:40:36.241566+0000","last_unstale":"2024-09-19T15:28:57.631054+0000","last_undegraded":"2024-09-19T15:28:57.631054+0000","last_fullsized":"2024-09-19T15:28:57.631054+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":500,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:03.964274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3019,"num_read_kb":2776,"num_write":751,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'363","reported_seq":1044,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.448187+0000","last_change":"2024-09-19T13:40:34.227009+0000","last_active":"2024-09-19T15:31:40.448187+0000","last_peered":"2024-09-19T15:31:40.448187+0000","last_clean":"2024-09-19T15:31:40.448187+0000","last_became_active":"2024-09-19T13:40:34.221057+0000","last_became_peered":"2024-09-19T13:40:34.221057+0000","last_unstale":"2024-09-19T15:31:40.448187+0000","last_undegraded":"2024-09-19T15:31:40.448187+0000","last_fullsized":"2024-09-19T15:31:40.448187+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:25:54.224688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":673,"num_read_kb":11742,"num_write":1135,"num_write_kb":23593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'495","reported_seq":2263,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.311749+0000","last_change":"2024-09-19T13:40:36.238558+0000","last_active":"2024-09-19T15:29:41.311749+0000","last_peered":"2024-09-19T15:29:41.311749+0000","last_clean":"2024-09-19T15:29:41.311749+0000","last_became_active":"2024-09-19T13:40:36.238166+0000","last_became_peered":"2024-09-19T13:40:36.238166+0000","last_unstale":"2024-09-19T15:29:41.311749+0000","last_undegraded":"2024-09-19T15:29:41.311749+0000","last_fullsized":"2024-09-19T15:29:41.311749+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:30:49.066869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2902,"num_read_kb":2744,"num_write":591,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'345","reported_seq":1059,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.531177+0000","last_change":"2024-09-19T13:40:34.232529+0000","last_active":"2024-09-19T15:31:40.531177+0000","last_peered":"2024-09-19T15:31:40.531177+0000","last_clean":"2024-09-19T15:31:40.531177+0000","last_became_active":"2024-09-19T13:40:34.232099+0000","last_became_peered":"2024-09-19T13:40:34.232099+0000","last_unstale":"2024-09-19T15:31:40.531177+0000","last_undegraded":"2024-09-19T15:31:40.531177+0000","last_fullsized":"2024-09-19T15:31:40.531177+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:31.553740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136873,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":758,"num_read_kb":12572,"num_write":1035,"num_write_kb":46357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"268'463","reported_seq":2045,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:08.245703+0000","last_change":"2024-09-19T13:40:36.239180+0000","last_active":"2024-09-19T15:29:08.245703+0000","last_peered":"2024-09-19T15:29:08.245703+0000","last_clean":"2024-09-19T15:29:08.245703+0000","last_became_active":"2024-09-19T13:40:36.238644+0000","last_became_peered":"2024-09-19T13:40:36.238644+0000","last_unstale":"2024-09-19T15:29:08.245703+0000","last_undegraded":"2024-09-19T15:29:08.245703+0000","last_fullsized":"2024-09-19T15:29:08.245703+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:20.371624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2315,"num_read_kb":2185,"num_write":554,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'403","reported_seq":1115,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.523605+0000","last_change":"2024-09-19T13:40:34.249999+0000","last_active":"2024-09-19T15:31:40.523605+0000","last_peered":"2024-09-19T15:31:40.523605+0000","last_clean":"2024-09-19T15:31:40.523605+0000","last_became_active":"2024-09-19T13:40:34.249600+0000","last_became_peered":"2024-09-19T13:40:34.249600+0000","last_unstale":"2024-09-19T15:31:40.523605+0000","last_undegraded":"2024-09-19T15:31:40.523605+0000","last_fullsized":"2024-09-19T15:31:40.523605+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:21.988391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":720,"num_read_kb":53970,"num_write":1365,"num_write_kb":53250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'832","reported_seq":2486,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.611644+0000","last_change":"2024-09-19T13:40:36.217498+0000","last_active":"2024-09-19T15:28:57.611644+0000","last_peered":"2024-09-19T15:28:57.611644+0000","last_clean":"2024-09-19T15:28:57.611644+0000","last_became_active":"2024-09-19T13:40:36.216697+0000","last_became_peered":"2024-09-19T13:40:36.216697+0000","last_unstale":"2024-09-19T15:28:57.611644+0000","last_undegraded":"2024-09-19T15:28:57.611644+0000","last_fullsized":"2024-09-19T15:28:57.611644+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":800,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:18:43.576589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4198,"num_read_kb":3766,"num_write":1106,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'330","reported_seq":1026,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.506919+0000","last_change":"2024-09-19T13:40:34.217279+0000","last_active":"2024-09-19T15:31:40.506919+0000","last_peered":"2024-09-19T15:31:40.506919+0000","last_clean":"2024-09-19T15:31:40.506919+0000","last_became_active":"2024-09-19T13:40:34.216774+0000","last_became_peered":"2024-09-19T13:40:34.216774+0000","last_unstale":"2024-09-19T15:31:40.506919+0000","last_undegraded":"2024-09-19T15:31:40.506919+0000","last_fullsized":"2024-09-19T15:31:40.506919+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:06.986984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":651,"num_read_kb":47831,"num_write":981,"num_write_kb":20035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'563","reported_seq":2253,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.655516+0000","last_change":"2024-09-19T13:40:36.220200+0000","last_active":"2024-09-19T15:29:50.655516+0000","last_peered":"2024-09-19T15:29:50.655516+0000","last_clean":"2024-09-19T15:29:50.655516+0000","last_became_active":"2024-09-19T13:40:36.218090+0000","last_became_peered":"2024-09-19T13:40:36.218090+0000","last_unstale":"2024-09-19T15:29:50.655516+0000","last_undegraded":"2024-09-19T15:29:50.655516+0000","last_fullsized":"2024-09-19T15:29:50.655516+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:34:01.490693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2933,"num_read_kb":2699,"num_write":698,"num_write_kb":201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'354","reported_seq":1135,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.530130+0000","last_change":"2024-09-19T13:40:34.273323+0000","last_active":"2024-09-19T15:31:40.530130+0000","last_peered":"2024-09-19T15:31:40.530130+0000","last_clean":"2024-09-19T15:31:40.530130+0000","last_became_active":"2024-09-19T13:40:34.272629+0000","last_became_peered":"2024-09-19T13:40:34.272629+0000","last_unstale":"2024-09-19T15:31:40.530130+0000","last_undegraded":"2024-09-19T15:31:40.530130+0000","last_fullsized":"2024-09-19T15:31:40.530130+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:34.984552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174644,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":935,"num_read_kb":42229,"num_write":1199,"num_write_kb":17971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'338","reported_seq":1780,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.312852+0000","last_change":"2024-09-19T13:40:36.225078+0000","last_active":"2024-09-19T15:29:41.312852+0000","last_peered":"2024-09-19T15:29:41.312852+0000","last_clean":"2024-09-19T15:29:41.312852+0000","last_became_active":"2024-09-19T13:40:36.224228+0000","last_became_peered":"2024-09-19T13:40:36.224228+0000","last_unstale":"2024-09-19T15:29:41.312852+0000","last_undegraded":"2024-09-19T15:29:41.312852+0000","last_fullsized":"2024-09-19T15:29:41.312852+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:01.743464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1855,"num_read_kb":1782,"num_write":368,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'385","reported_seq":1141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.588440+0000","last_change":"2024-09-19T13:40:34.245539+0000","last_active":"2024-09-19T15:31:40.588440+0000","last_peered":"2024-09-19T15:31:40.588440+0000","last_clean":"2024-09-19T15:31:40.588440+0000","last_became_active":"2024-09-19T13:40:34.245197+0000","last_became_peered":"2024-09-19T13:40:34.245197+0000","last_unstale":"2024-09-19T15:31:40.588440+0000","last_undegraded":"2024-09-19T15:31:40.588440+0000","last_fullsized":"2024-09-19T15:31:40.588440+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:24:09.091484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273700,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":750,"num_read_kb":129994,"num_write":1223,"num_write_kb":46426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"268'494","reported_seq":2038,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.313857+0000","last_change":"2024-09-19T13:40:36.227530+0000","last_active":"2024-09-19T15:29:41.313857+0000","last_peered":"2024-09-19T15:29:41.313857+0000","last_clean":"2024-09-19T15:29:41.313857+0000","last_became_active":"2024-09-19T13:40:36.226839+0000","last_became_peered":"2024-09-19T13:40:36.226839+0000","last_unstale":"2024-09-19T15:29:41.313857+0000","last_undegraded":"2024-09-19T15:29:41.313857+0000","last_fullsized":"2024-09-19T15:29:41.313857+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:19:28.265909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2632,"num_read_kb":2421,"num_write":626,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'349","reported_seq":1165,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.557629+0000","last_change":"2024-09-19T13:40:34.229368+0000","last_active":"2024-09-19T15:31:40.557629+0000","last_peered":"2024-09-19T15:31:40.557629+0000","last_clean":"2024-09-19T15:31:40.557629+0000","last_became_active":"2024-09-19T13:40:34.228472+0000","last_became_peered":"2024-09-19T13:40:34.228472+0000","last_unstale":"2024-09-19T15:31:40.557629+0000","last_undegraded":"2024-09-19T15:31:40.557629+0000","last_fullsized":"2024-09-19T15:31:40.557629+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:51.349525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1120,"num_read_kb":37188,"num_write":1213,"num_write_kb":31649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'800","reported_seq":2500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.280835+0000","last_change":"2024-09-19T13:40:36.219439+0000","last_active":"2024-09-19T15:31:12.280835+0000","last_peered":"2024-09-19T15:31:12.280835+0000","last_clean":"2024-09-19T15:31:12.280835+0000","last_became_active":"2024-09-19T13:40:36.217870+0000","last_became_peered":"2024-09-19T13:40:36.217870+0000","last_unstale":"2024-09-19T15:31:12.280835+0000","last_undegraded":"2024-09-19T15:31:12.280835+0000","last_fullsized":"2024-09-19T15:31:12.280835+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:00:58.023208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3954,"num_read_kb":3588,"num_write":1044,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'308","reported_seq":1000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.584810+0000","last_change":"2024-09-19T13:41:05.311322+0000","last_active":"2024-09-19T15:31:40.584810+0000","last_peered":"2024-09-19T15:31:40.584810+0000","last_clean":"2024-09-19T15:31:40.584810+0000","last_became_active":"2024-09-19T13:41:05.310802+0000","last_became_peered":"2024-09-19T13:41:05.310802+0000","last_unstale":"2024-09-19T15:31:40.584810+0000","last_undegraded":"2024-09-19T15:31:40.584810+0000","last_fullsized":"2024-09-19T15:31:40.584810+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:42.603416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136937,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":757,"num_read_kb":21770,"num_write":969,"num_write_kb":19448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"268'360","reported_seq":1959,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.653018+0000","last_change":"2024-09-19T13:40:36.216178+0000","last_active":"2024-09-19T15:29:50.653018+0000","last_peered":"2024-09-19T15:29:50.653018+0000","last_clean":"2024-09-19T15:29:50.653018+0000","last_became_active":"2024-09-19T13:40:36.215821+0000","last_became_peered":"2024-09-19T13:40:36.215821+0000","last_unstale":"2024-09-19T15:29:50.653018+0000","last_undegraded":"2024-09-19T15:29:50.653018+0000","last_fullsized":"2024-09-19T15:29:50.653018+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:38:26.917147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2112,"num_read_kb":2049,"num_write":394,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'450","reported_seq":1185,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.595152+0000","last_change":"2024-09-19T13:40:34.262686+0000","last_active":"2024-09-19T15:31:40.595152+0000","last_peered":"2024-09-19T15:31:40.595152+0000","last_clean":"2024-09-19T15:31:40.595152+0000","last_became_active":"2024-09-19T13:40:34.261812+0000","last_became_peered":"2024-09-19T13:40:34.261812+0000","last_unstale":"2024-09-19T15:31:40.595152+0000","last_undegraded":"2024-09-19T15:31:40.595152+0000","last_fullsized":"2024-09-19T15:31:40.595152+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:29.120216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136844,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":935,"num_read_kb":21060,"num_write":1238,"num_write_kb":41159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'746","reported_seq":2331,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.606887+0000","last_change":"2024-09-19T13:40:36.217355+0000","last_active":"2024-09-19T15:28:37.606887+0000","last_peered":"2024-09-19T15:28:37.606887+0000","last_clean":"2024-09-19T15:28:37.606887+0000","last_became_active":"2024-09-19T13:40:36.216597+0000","last_became_peered":"2024-09-19T13:40:36.216597+0000","last_unstale":"2024-09-19T15:28:37.606887+0000","last_undegraded":"2024-09-19T15:28:37.606887+0000","last_fullsized":"2024-09-19T15:28:37.606887+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:59:18.319568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3535,"num_read_kb":3206,"num_write":942,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'389","reported_seq":1096,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.588905+0000","last_change":"2024-09-19T13:40:34.255731+0000","last_active":"2024-09-19T15:31:40.588905+0000","last_peered":"2024-09-19T15:31:40.588905+0000","last_clean":"2024-09-19T15:31:40.588905+0000","last_became_active":"2024-09-19T13:40:34.255374+0000","last_became_peered":"2024-09-19T13:40:34.255374+0000","last_unstale":"2024-09-19T15:31:40.588905+0000","last_undegraded":"2024-09-19T15:31:40.588905+0000","last_fullsized":"2024-09-19T15:31:40.588905+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:19:13.519227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":672,"num_read_kb":82615,"num_write":1215,"num_write_kb":54973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'1055","reported_seq":2691,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.652822+0000","last_change":"2024-09-19T13:40:36.239660+0000","last_active":"2024-09-19T15:29:50.652822+0000","last_peered":"2024-09-19T15:29:50.652822+0000","last_clean":"2024-09-19T15:29:50.652822+0000","last_became_active":"2024-09-19T13:40:36.238907+0000","last_became_peered":"2024-09-19T13:40:36.238907+0000","last_unstale":"2024-09-19T15:29:50.652822+0000","last_undegraded":"2024-09-19T15:29:50.652822+0000","last_fullsized":"2024-09-19T15:29:50.652822+0000","mapping_epoch":27,"log_start":"268'1000","ondisk_log_start":"268'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1000,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:58:06.626307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5049,"num_read_kb":4427,"num_write":1568,"num_write_kb":756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'420","reported_seq":1097,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.506851+0000","last_change":"2024-09-19T13:40:34.273536+0000","last_active":"2024-09-19T15:31:40.506851+0000","last_peered":"2024-09-19T15:31:40.506851+0000","last_clean":"2024-09-19T15:31:40.506851+0000","last_became_active":"2024-09-19T13:40:34.272618+0000","last_became_peered":"2024-09-19T13:40:34.272618+0000","last_unstale":"2024-09-19T15:31:40.506851+0000","last_undegraded":"2024-09-19T15:31:40.506851+0000","last_fullsized":"2024-09-19T15:31:40.506851+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:56:58.613614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":788,"num_read_kb":25154,"num_write":1353,"num_write_kb":33238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'500","reported_seq":2189,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.257325+0000","last_change":"2024-09-19T13:40:36.227186+0000","last_active":"2024-09-19T15:31:12.257325+0000","last_peered":"2024-09-19T15:31:12.257325+0000","last_clean":"2024-09-19T15:31:12.257325+0000","last_became_active":"2024-09-19T13:40:36.226572+0000","last_became_peered":"2024-09-19T13:40:36.226572+0000","last_unstale":"2024-09-19T15:31:12.257325+0000","last_undegraded":"2024-09-19T15:31:12.257325+0000","last_fullsized":"2024-09-19T15:31:12.257325+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:15.302809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2633,"num_read_kb":2478,"num_write":570,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'448","reported_seq":1203,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.589292+0000","last_change":"2024-09-19T13:40:34.276063+0000","last_active":"2024-09-19T15:31:40.589292+0000","last_peered":"2024-09-19T15:31:40.589292+0000","last_clean":"2024-09-19T15:31:40.589292+0000","last_became_active":"2024-09-19T13:40:34.274523+0000","last_became_peered":"2024-09-19T13:40:34.274523+0000","last_unstale":"2024-09-19T15:31:40.589292+0000","last_undegraded":"2024-09-19T15:31:40.589292+0000","last_fullsized":"2024-09-19T15:31:40.589292+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:32.241517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":885,"num_read_kb":117461,"num_write":1361,"num_write_kb":54900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"268'906","reported_seq":2407,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.374609+0000","last_change":"2024-09-19T13:40:36.221889+0000","last_active":"2024-09-19T15:29:48.374609+0000","last_peered":"2024-09-19T15:29:48.374609+0000","last_clean":"2024-09-19T15:29:48.374609+0000","last_became_active":"2024-09-19T13:40:36.219017+0000","last_became_peered":"2024-09-19T13:40:36.219017+0000","last_unstale":"2024-09-19T15:29:48.374609+0000","last_undegraded":"2024-09-19T15:29:48.374609+0000","last_fullsized":"2024-09-19T15:29:48.374609+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":800,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:53.854378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5981,"num_read_kb":5463,"num_write":1432,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'347","reported_seq":1024,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.583101+0000","last_change":"2024-09-19T13:40:34.258686+0000","last_active":"2024-09-19T15:31:40.583101+0000","last_peered":"2024-09-19T15:31:40.583101+0000","last_clean":"2024-09-19T15:31:40.583101+0000","last_became_active":"2024-09-19T13:40:34.258251+0000","last_became_peered":"2024-09-19T13:40:34.258251+0000","last_unstale":"2024-09-19T15:31:40.583101+0000","last_undegraded":"2024-09-19T15:31:40.583101+0000","last_fullsized":"2024-09-19T15:31:40.583101+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:47.902849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":664,"num_read_kb":8565,"num_write":1177,"num_write_kb":30274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'817","reported_seq":2512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.331001+0000","last_change":"2024-09-19T13:40:36.236629+0000","last_active":"2024-09-19T15:31:12.331001+0000","last_peered":"2024-09-19T15:31:12.331001+0000","last_clean":"2024-09-19T15:31:12.331001+0000","last_became_active":"2024-09-19T13:40:36.234463+0000","last_became_peered":"2024-09-19T13:40:36.234463+0000","last_unstale":"2024-09-19T15:31:12.331001+0000","last_undegraded":"2024-09-19T15:31:12.331001+0000","last_fullsized":"2024-09-19T15:31:12.331001+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:20.810918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4113,"num_read_kb":3717,"num_write":1084,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'332","reported_seq":993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.577371+0000","last_change":"2024-09-19T13:40:34.258670+0000","last_active":"2024-09-19T15:31:40.577371+0000","last_peered":"2024-09-19T15:31:40.577371+0000","last_clean":"2024-09-19T15:31:40.577371+0000","last_became_active":"2024-09-19T13:40:34.257895+0000","last_became_peered":"2024-09-19T13:40:34.257895+0000","last_unstale":"2024-09-19T15:31:40.577371+0000","last_undegraded":"2024-09-19T15:31:40.577371+0000","last_fullsized":"2024-09-19T15:31:40.577371+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:39:05.564293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":616,"num_read_kb":2702,"num_write":1090,"num_write_kb":37833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'365","reported_seq":1057,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.602227+0000","last_change":"2024-09-19T13:41:05.314325+0000","last_active":"2024-09-19T15:31:40.602227+0000","last_peered":"2024-09-19T15:31:40.602227+0000","last_clean":"2024-09-19T15:31:40.602227+0000","last_became_active":"2024-09-19T13:41:05.313139+0000","last_became_peered":"2024-09-19T13:41:05.313139+0000","last_unstale":"2024-09-19T15:31:40.602227+0000","last_undegraded":"2024-09-19T15:31:40.602227+0000","last_fullsized":"2024-09-19T15:31:40.602227+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:38.914445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":636,"num_read_kb":5598,"num_write":1148,"num_write_kb":52319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'584","reported_seq":2285,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.253632+0000","last_change":"2024-09-19T13:40:36.225847+0000","last_active":"2024-09-19T15:31:12.253632+0000","last_peered":"2024-09-19T15:31:12.253632+0000","last_clean":"2024-09-19T15:31:12.253632+0000","last_became_active":"2024-09-19T13:40:36.225131+0000","last_became_peered":"2024-09-19T13:40:36.225131+0000","last_unstale":"2024-09-19T15:31:12.253632+0000","last_undegraded":"2024-09-19T15:31:12.253632+0000","last_fullsized":"2024-09-19T15:31:12.253632+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:19.360510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3409,"num_read_kb":3161,"num_write":806,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'423","reported_seq":1185,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.582951+0000","last_change":"2024-09-19T13:40:34.252937+0000","last_active":"2024-09-19T15:31:40.582951+0000","last_peered":"2024-09-19T15:31:40.582951+0000","last_clean":"2024-09-19T15:31:40.582951+0000","last_became_active":"2024-09-19T13:40:34.252585+0000","last_became_peered":"2024-09-19T13:40:34.252585+0000","last_unstale":"2024-09-19T15:31:40.582951+0000","last_undegraded":"2024-09-19T15:31:40.582951+0000","last_fullsized":"2024-09-19T15:31:40.582951+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:33.178732+0000","last_clean_scrub_stamp":"2024-09-19T13:40:33.178732+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:29.120216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1089,"num_read_kb":22295,"num_write":1244,"num_write_kb":33627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'492","reported_seq":2098,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:41.711923+0000","last_change":"2024-09-19T13:40:36.233305+0000","last_active":"2024-09-19T15:27:41.711923+0000","last_peered":"2024-09-19T15:27:41.711923+0000","last_clean":"2024-09-19T15:27:41.711923+0000","last_became_active":"2024-09-19T13:40:36.232695+0000","last_became_peered":"2024-09-19T13:40:36.232695+0000","last_unstale":"2024-09-19T15:27:41.711923+0000","last_undegraded":"2024-09-19T15:27:41.711923+0000","last_fullsized":"2024-09-19T15:27:41.711923+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:37:22.928402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2752,"num_read_kb":2570,"num_write":600,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10865,"num_read_kb":9021,"num_write":3118,"num_write_kb":1011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1008,"ondisk_log_size":1008,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14601,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":16485,"num_read_kb":16147,"num_write":17047,"num_write_kb":4982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":29202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1794,"ondisk_log_size":1794,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":596,"ondisk_log_size":596,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1631422,"num_objects":200,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":21072,"num_read_kb":40733,"num_write":17629,"num_write_kb":12600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1768,"ondisk_log_size":1768,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2392,"num_read_kb":2851,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":220859,"num_read_kb":201873,"num_write":56069,"num_write_kb":19197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4108,"ondisk_log_size":4108,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":23942209,"num_objects":277,"num_object_clones":0,"num_object_copies":831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":0,"num_read":44439,"num_read_kb":2347980,"num_write":73000,"num_write_kb":2178675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37318656,"data_stored":37318656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3768,"ondisk_log_size":3768,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":215739,"num_write":161,"num_write_kb":136883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":195259,"num_write":161,"num_write_kb":136883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543491,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296440,"kb_used_data":8368,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94075400,"statfs":{"total":96636764160,"available":96333209600,"internally_reserved":0,"allocated":8568832,"data_stored":6565575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":294910410},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543486,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250960,"kb_used_data":7164,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94120880,"statfs":{"total":96636764160,"available":96379781120,"internally_reserved":0,"allocated":7335936,"data_stored":5380296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":249428422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543489,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149416,"kb_used_data":9964,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94222424,"statfs":{"total":96636764160,"available":96483762176,"internally_reserved":0,"allocated":10203136,"data_stored":8155658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543486,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":115868,"kb_used_data":8248,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94255972,"statfs":{"total":96636764160,"available":96518115328,"internally_reserved":0,"allocated":8445952,"data_stored":6509947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543491,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296860,"kb_used_data":12688,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94074980,"statfs":{"total":96636764160,"available":96332779520,"internally_reserved":0,"allocated":12992512,"data_stored":10993023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":290650567},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543488,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92516,"kb_used_data":7092,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94279324,"statfs":{"total":96636764160,"available":96542027776,"internally_reserved":0,"allocated":7262208,"data_stored":5318104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543487,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":192720,"kb_used_data":8764,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94179120,"statfs":{"total":96636764160,"available":96439418880,"internally_reserved":0,"allocated":8974336,"data_stored":6990912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543487,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":278936,"kb_used_data":8836,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94092904,"statfs":{"total":96636764160,"available":96351133696,"internally_reserved":0,"allocated":9048064,"data_stored":7057331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":276429255},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4157440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4681728,"data_stored":4681728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3010560,"data_stored":3010560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8683520,"data_stored":8683520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4202496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5844992,"data_stored":5844992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3072000,"data_stored":3072000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3665920,"data_stored":3665920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T15:31:48.342 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.343 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.343 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.343 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.343 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.343 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.343 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.343 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.343 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.344 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.344 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.344 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.344 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.344 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.344 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.344 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.344 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.344 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.345 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.345 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.345 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.345 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.345 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.345 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.345 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.345 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.345 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.346 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.346 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.346 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.346 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.346 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.346 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.346 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.346 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.346 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.347 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.347 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.347 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.347 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.347 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.347 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.347 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.347 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.347 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.348 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.348 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.348 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.348 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.348 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.348 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.348 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.348 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.348 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.348 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.349 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.349 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.349 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.349 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.349 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.349 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.349 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.349 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.349 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.349 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.350 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.350 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.350 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.350 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.350 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.350 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.350 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.350 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.350 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.351 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.351 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.351 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.351 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.351 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.351 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.351 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.351 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.351 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.352 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.352 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.352 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.352 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.352 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.352 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.352 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.352 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.353 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.353 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.353 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.353 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.353 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.353 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.353 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.353 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.353 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.354 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.354 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.354 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.354 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.354 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.354 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.354 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.354 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.354 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.354 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.355 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.355 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.355 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.355 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.355 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.355 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.355 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.355 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.355 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.355 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.356 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.356 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.356 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.356 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.356 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.356 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.356 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.356 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.356 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.356 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.357 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.357 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.357 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.357 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.357 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.357 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.357 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.357 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.357 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.358 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.358 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.358 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.358 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.358 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.358 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.358 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.358 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.358 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.359 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.359 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.359 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.359 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.359 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.359 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.359 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.359 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.359 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.359 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.360 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.360 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.360 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.360 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.360 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.360 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.360 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.360 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.360 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.361 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.361 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.361 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.361 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.361 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.361 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.361 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.361 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.361 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.361 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.362 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.362 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.362 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.362 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.362 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.362 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.362 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.362 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.362 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.363 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.363 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.363 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.363 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.363 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.363 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.363 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.363 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.363 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.364 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.364 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.364 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.364 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.364 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.364 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.364 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.364 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.364 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.365 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.365 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.365 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.365 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.365 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.365 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.365 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.365 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.366 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.366 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.366 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.366 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.366 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.366 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.366 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.366 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.366 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.367 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.367 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.367 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.367 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.367 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.367 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.367 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.367 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.367 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-19T13:40:12.602317+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=12, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.367 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-19T13:40:19.066579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.368 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.368 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.368 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.368 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.368 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.368 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.368 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-19T13:40:19.066579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.368 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.368 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.368 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.369 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.369 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.369 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.369 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-19T13:40:19.066579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.369 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.369 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.369 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.369 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.369 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.370 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.370 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-19T13:40:19.066579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.370 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.370 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.370 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.370 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.370 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.370 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.370 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.370 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-19T13:40:19.066579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.371 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.371 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.371 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.371 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.371 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.371 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.371 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-19T13:40:19.066579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.371 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.371 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.371 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.372 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.372 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.372 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.372 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-19T13:40:19.066579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.372 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.372 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.372 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.372 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.372 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.372 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.373 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-19T13:40:19.066579+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=19, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.373 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.373 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.373 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.373 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.373 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.373 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.373 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.373 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.374 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.374 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.374 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.374 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.374 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.374 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.374 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.374 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.374 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.374 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.374 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.375 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.375 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.375 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.375 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.375 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.375 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.375 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.375 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.375 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.375 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.376 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.376 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.376 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.376 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.376 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.376 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.376 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.376 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.376 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.376 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.377 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.377 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.377 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.377 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.377 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.377 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.377 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.377 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.377 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.378 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.378 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.378 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.378 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.378 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.378 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.378 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.378 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.378 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.379 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.379 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.379 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.379 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.379 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.379 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.379 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.379 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.379 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.380 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.380 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.380 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.380 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.380 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.380 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.380 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.380 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.380 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.381 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.381 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.381 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.381 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.381 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.381 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.381 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.381 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.381 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.382 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.382 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.382 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.382 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.382 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.382 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.382 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.382 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.382 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.383 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.383 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.383 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.383 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.383 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.383 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.383 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.383 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.383 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.384 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.384 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.384 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.384 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.384 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.384 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.384 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.384 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.385 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-19T13:40:33.178732+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=33, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.385 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:31:48.385 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-19T15:32:08.385 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T15:32:08.753 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:32:08.764 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-19T15:32:08.770 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":3617,"stamp":"2024-09-19T15:32:08.657681+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26180412,"num_objects":726,"num_object_clones":0,"num_object_copies":1729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":726,"num_whiteouts":0,"num_read":316475,"num_read_kb":3029670,"num_write":167328,"num_write_kb":2491887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":71647,"num_omap_keys":217,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13421,"ondisk_log_size":13421,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1672660,"kb_used_data":71124,"kb_used_omap":12,"kb_used_meta":1601395,"kb_avail":753302060,"statfs":{"total":773094113280,"available":771381309440,"internally_reserved":0,"allocated":72830976,"data_stored":56970846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1639829042},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":71647,"num_omap_keys":217,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008302"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.609067+0000","last_change":"2024-09-19T14:29:51.038023+0000","last_active":"2024-09-19T15:27:22.609067+0000","last_peered":"2024-09-19T15:27:22.609067+0000","last_clean":"2024-09-19T15:27:22.609067+0000","last_became_active":"2024-09-19T14:29:51.036952+0000","last_became_peered":"2024-09-19T14:29:51.036952+0000","last_unstale":"2024-09-19T15:27:22.609067+0000","last_undegraded":"2024-09-19T15:27:22.609067+0000","last_fullsized":"2024-09-19T15:27:22.609067+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:10:00.951609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:37.612687+0000","last_change":"2024-09-19T14:02:36.913041+0000","last_active":"2024-09-19T15:27:37.612687+0000","last_peered":"2024-09-19T15:27:37.612687+0000","last_clean":"2024-09-19T15:27:37.612687+0000","last_became_active":"2024-09-19T14:02:36.912307+0000","last_became_peered":"2024-09-19T14:02:36.912307+0000","last_unstale":"2024-09-19T15:27:37.612687+0000","last_undegraded":"2024-09-19T15:27:37.612687+0000","last_fullsized":"2024-09-19T15:27:37.612687+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:18:44.440160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"268'11","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.256849+0000","last_change":"2024-09-19T14:02:29.740551+0000","last_active":"2024-09-19T15:31:38.256849+0000","last_peered":"2024-09-19T15:31:38.256849+0000","last_clean":"2024-09-19T15:31:38.256849+0000","last_became_active":"2024-09-19T14:02:29.739721+0000","last_became_peered":"2024-09-19T14:02:29.739721+0000","last_unstale":"2024-09-19T15:31:38.256849+0000","last_undegraded":"2024-09-19T15:31:38.256849+0000","last_fullsized":"2024-09-19T15:31:38.256849+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:40.747086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":13312,"num_write":21,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'35","reported_seq":168,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:07.179075+0000","last_change":"2024-09-19T13:56:23.181765+0000","last_active":"2024-09-19T15:28:07.179075+0000","last_peered":"2024-09-19T15:28:07.179075+0000","last_clean":"2024-09-19T15:28:07.179075+0000","last_became_active":"2024-09-19T13:56:23.180176+0000","last_became_peered":"2024-09-19T13:56:23.180176+0000","last_unstale":"2024-09-19T15:28:07.179075+0000","last_undegraded":"2024-09-19T15:28:07.179075+0000","last_fullsized":"2024-09-19T15:28:07.179075+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:39.781109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":165,"num_write":94,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.537242+0000","last_change":"2024-09-19T14:29:51.039282+0000","last_active":"2024-09-19T15:27:22.537242+0000","last_peered":"2024-09-19T15:27:22.537242+0000","last_clean":"2024-09-19T15:27:22.537242+0000","last_became_active":"2024-09-19T14:29:51.038289+0000","last_became_peered":"2024-09-19T14:29:51.038289+0000","last_unstale":"2024-09-19T15:27:22.537242+0000","last_undegraded":"2024-09-19T15:27:22.537242+0000","last_fullsized":"2024-09-19T15:27:22.537242+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:16.350420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'2","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:07.627354+0000","last_change":"2024-09-19T14:02:36.915848+0000","last_active":"2024-09-19T15:30:07.627354+0000","last_peered":"2024-09-19T15:30:07.627354+0000","last_clean":"2024-09-19T15:30:07.627354+0000","last_became_active":"2024-09-19T14:02:36.914769+0000","last_became_peered":"2024-09-19T14:02:36.914769+0000","last_unstale":"2024-09-19T15:30:07.627354+0000","last_undegraded":"2024-09-19T15:30:07.627354+0000","last_fullsized":"2024-09-19T15:30:07.627354+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:22.428331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"268'6","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.100940+0000","last_change":"2024-09-19T14:02:29.748087+0000","last_active":"2024-09-19T15:31:39.100940+0000","last_peered":"2024-09-19T15:31:39.100940+0000","last_clean":"2024-09-19T15:31:39.100940+0000","last_became_active":"2024-09-19T14:02:29.747492+0000","last_became_peered":"2024-09-19T14:02:29.747492+0000","last_unstale":"2024-09-19T15:31:39.100940+0000","last_undegraded":"2024-09-19T15:31:39.100940+0000","last_fullsized":"2024-09-19T15:31:39.100940+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:00.163612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'26","reported_seq":153,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.554031+0000","last_change":"2024-09-19T13:56:23.182940+0000","last_active":"2024-09-19T15:28:42.554031+0000","last_peered":"2024-09-19T15:28:42.554031+0000","last_clean":"2024-09-19T15:28:42.554031+0000","last_became_active":"2024-09-19T13:56:23.173377+0000","last_became_peered":"2024-09-19T13:56:23.173377+0000","last_unstale":"2024-09-19T15:28:42.554031+0000","last_undegraded":"2024-09-19T15:28:42.554031+0000","last_fullsized":"2024-09-19T15:28:42.554031+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:53.676663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":124,"num_write":71,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:52.379379+0000","last_change":"2024-09-19T14:29:51.044849+0000","last_active":"2024-09-19T15:27:52.379379+0000","last_peered":"2024-09-19T15:27:52.379379+0000","last_clean":"2024-09-19T15:27:52.379379+0000","last_became_active":"2024-09-19T14:29:51.039043+0000","last_became_peered":"2024-09-19T14:29:51.039043+0000","last_unstale":"2024-09-19T15:27:52.379379+0000","last_undegraded":"2024-09-19T15:27:52.379379+0000","last_fullsized":"2024-09-19T15:27:52.379379+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:50.442880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"268'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:07.209630+0000","last_change":"2024-09-19T14:02:37.054013+0000","last_active":"2024-09-19T15:30:07.209630+0000","last_peered":"2024-09-19T15:30:07.209630+0000","last_clean":"2024-09-19T15:30:07.209630+0000","last_became_active":"2024-09-19T14:02:37.051665+0000","last_became_peered":"2024-09-19T14:02:37.051665+0000","last_unstale":"2024-09-19T15:30:07.209630+0000","last_undegraded":"2024-09-19T15:30:07.209630+0000","last_fullsized":"2024-09-19T15:30:07.209630+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:50.720956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:52.556050+0000","last_change":"2024-09-19T14:02:29.725591+0000","last_active":"2024-09-19T15:28:52.556050+0000","last_peered":"2024-09-19T15:28:52.556050+0000","last_clean":"2024-09-19T15:28:52.556050+0000","last_became_active":"2024-09-19T14:02:29.724866+0000","last_became_peered":"2024-09-19T14:02:29.724866+0000","last_unstale":"2024-09-19T15:28:52.556050+0000","last_undegraded":"2024-09-19T15:28:52.556050+0000","last_fullsized":"2024-09-19T15:28:52.556050+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:44.282362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'36","reported_seq":169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.190273+0000","last_change":"2024-09-19T13:56:23.181435+0000","last_active":"2024-09-19T15:28:57.190273+0000","last_peered":"2024-09-19T15:28:57.190273+0000","last_clean":"2024-09-19T15:28:57.190273+0000","last_became_active":"2024-09-19T13:56:23.180159+0000","last_became_peered":"2024-09-19T13:56:23.180159+0000","last_unstale":"2024-09-19T15:28:57.190273+0000","last_undegraded":"2024-09-19T15:28:57.190273+0000","last_fullsized":"2024-09-19T15:28:57.190273+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:34:32.230609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":283,"num_read_kb":171,"num_write":89,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:03.230461+0000","last_change":"2024-09-19T14:29:51.030209+0000","last_active":"2024-09-19T15:28:03.230461+0000","last_peered":"2024-09-19T15:28:03.230461+0000","last_clean":"2024-09-19T15:28:03.230461+0000","last_became_active":"2024-09-19T14:29:51.029426+0000","last_became_peered":"2024-09-19T14:29:51.029426+0000","last_unstale":"2024-09-19T15:28:03.230461+0000","last_undegraded":"2024-09-19T15:28:03.230461+0000","last_fullsized":"2024-09-19T15:28:03.230461+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:42:56.183067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"268'3","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:53.047918+0000","last_change":"2024-09-19T14:02:37.053245+0000","last_active":"2024-09-19T15:30:53.047918+0000","last_peered":"2024-09-19T15:30:53.047918+0000","last_clean":"2024-09-19T15:30:53.047918+0000","last_became_active":"2024-09-19T14:02:37.052510+0000","last_became_peered":"2024-09-19T14:02:37.052510+0000","last_unstale":"2024-09-19T15:30:53.047918+0000","last_undegraded":"2024-09-19T15:30:53.047918+0000","last_fullsized":"2024-09-19T15:30:53.047918+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:25.091691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:02.626302+0000","last_change":"2024-09-19T14:02:29.736849+0000","last_active":"2024-09-19T15:30:02.626302+0000","last_peered":"2024-09-19T15:30:02.626302+0000","last_clean":"2024-09-19T15:30:02.626302+0000","last_became_active":"2024-09-19T14:02:29.736074+0000","last_became_peered":"2024-09-19T14:02:29.736074+0000","last_unstale":"2024-09-19T15:30:02.626302+0000","last_undegraded":"2024-09-19T15:30:02.626302+0000","last_fullsized":"2024-09-19T15:30:02.626302+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'63","reported_seq":244,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:53.242175+0000","last_change":"2024-09-19T13:56:23.179692+0000","last_active":"2024-09-19T15:28:53.242175+0000","last_peered":"2024-09-19T15:28:53.242175+0000","last_clean":"2024-09-19T15:28:53.242175+0000","last_became_active":"2024-09-19T13:56:23.179235+0000","last_became_peered":"2024-09-19T13:56:23.179235+0000","last_unstale":"2024-09-19T15:28:53.242175+0000","last_undegraded":"2024-09-19T15:28:53.242175+0000","last_fullsized":"2024-09-19T15:28:53.242175+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:47.927569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":508,"num_read_kb":362,"num_write":155,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:03.258946+0000","last_change":"2024-09-19T14:29:51.053238+0000","last_active":"2024-09-19T15:30:03.258946+0000","last_peered":"2024-09-19T15:30:03.258946+0000","last_clean":"2024-09-19T15:30:03.258946+0000","last_became_active":"2024-09-19T14:29:51.052562+0000","last_became_peered":"2024-09-19T14:29:51.052562+0000","last_unstale":"2024-09-19T15:30:03.258946+0000","last_undegraded":"2024-09-19T15:30:03.258946+0000","last_fullsized":"2024-09-19T15:30:03.258946+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"268'9","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.876210+0000","last_change":"2024-09-19T14:02:36.931028+0000","last_active":"2024-09-19T15:31:39.876210+0000","last_peered":"2024-09-19T15:31:39.876210+0000","last_clean":"2024-09-19T15:31:39.876210+0000","last_became_active":"2024-09-19T14:02:36.930344+0000","last_became_peered":"2024-09-19T14:02:36.930344+0000","last_unstale":"2024-09-19T15:31:39.876210+0000","last_undegraded":"2024-09-19T15:31:39.876210+0000","last_fullsized":"2024-09-19T15:31:39.876210+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:10:56.230063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":19,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'8","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.537564+0000","last_change":"2024-09-19T14:02:29.741351+0000","last_active":"2024-09-19T15:31:39.537564+0000","last_peered":"2024-09-19T15:31:39.537564+0000","last_clean":"2024-09-19T15:31:39.537564+0000","last_became_active":"2024-09-19T14:02:29.740291+0000","last_became_peered":"2024-09-19T14:02:29.740291+0000","last_unstale":"2024-09-19T15:31:39.537564+0000","last_undegraded":"2024-09-19T15:31:39.537564+0000","last_fullsized":"2024-09-19T15:31:39.537564+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'10","reported_seq":101,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:53.242112+0000","last_change":"2024-09-19T13:56:23.170087+0000","last_active":"2024-09-19T15:28:53.242112+0000","last_peered":"2024-09-19T15:28:53.242112+0000","last_clean":"2024-09-19T15:28:53.242112+0000","last_became_active":"2024-09-19T13:56:23.169371+0000","last_became_peered":"2024-09-19T13:56:23.169371+0000","last_unstale":"2024-09-19T15:28:53.242112+0000","last_undegraded":"2024-09-19T15:28:53.242112+0000","last_fullsized":"2024-09-19T15:28:53.242112+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:41:15.161070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":43,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381528+0000","last_change":"2024-09-19T14:29:51.049819+0000","last_active":"2024-09-19T15:28:12.381528+0000","last_peered":"2024-09-19T15:28:12.381528+0000","last_clean":"2024-09-19T15:28:12.381528+0000","last_became_active":"2024-09-19T14:29:51.049146+0000","last_became_peered":"2024-09-19T14:29:51.049146+0000","last_unstale":"2024-09-19T15:28:12.381528+0000","last_undegraded":"2024-09-19T15:28:12.381528+0000","last_fullsized":"2024-09-19T15:28:12.381528+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:39.379659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:37.403218+0000","last_change":"2024-09-19T14:02:36.928119+0000","last_active":"2024-09-19T15:29:37.403218+0000","last_peered":"2024-09-19T15:29:37.403218+0000","last_clean":"2024-09-19T15:29:37.403218+0000","last_became_active":"2024-09-19T14:02:36.927382+0000","last_became_peered":"2024-09-19T14:02:36.927382+0000","last_unstale":"2024-09-19T15:29:37.403218+0000","last_undegraded":"2024-09-19T15:29:37.403218+0000","last_fullsized":"2024-09-19T15:29:37.403218+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"268'2","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:52.623969+0000","last_change":"2024-09-19T14:02:29.723753+0000","last_active":"2024-09-19T15:29:52.623969+0000","last_peered":"2024-09-19T15:29:52.623969+0000","last_clean":"2024-09-19T15:29:52.623969+0000","last_became_active":"2024-09-19T14:02:29.722193+0000","last_became_peered":"2024-09-19T14:02:29.722193+0000","last_unstale":"2024-09-19T15:29:52.623969+0000","last_undegraded":"2024-09-19T15:29:52.623969+0000","last_fullsized":"2024-09-19T15:29:52.623969+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:12.251421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'21","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:52.392809+0000","last_change":"2024-09-19T13:56:23.175249+0000","last_active":"2024-09-19T15:28:52.392809+0000","last_peered":"2024-09-19T15:28:52.392809+0000","last_clean":"2024-09-19T15:28:52.392809+0000","last_became_active":"2024-09-19T13:56:23.174511+0000","last_became_peered":"2024-09-19T13:56:23.174511+0000","last_unstale":"2024-09-19T15:28:52.392809+0000","last_undegraded":"2024-09-19T15:28:52.392809+0000","last_fullsized":"2024-09-19T15:28:52.392809+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:24.782915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":102,"num_write":56,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.629613+0000","last_change":"2024-09-19T14:29:51.041850+0000","last_active":"2024-09-19T15:27:22.629613+0000","last_peered":"2024-09-19T15:27:22.629613+0000","last_clean":"2024-09-19T15:27:22.629613+0000","last_became_active":"2024-09-19T14:29:51.039919+0000","last_became_peered":"2024-09-19T14:29:51.039919+0000","last_unstale":"2024-09-19T15:27:22.629613+0000","last_undegraded":"2024-09-19T15:27:22.629613+0000","last_fullsized":"2024-09-19T15:27:22.629613+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:56.764514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"265'8","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:37.574384+0000","last_change":"2024-09-19T14:02:36.919460+0000","last_active":"2024-09-19T15:27:37.574384+0000","last_peered":"2024-09-19T15:27:37.574384+0000","last_clean":"2024-09-19T15:27:37.574384+0000","last_became_active":"2024-09-19T14:02:36.918707+0000","last_became_peered":"2024-09-19T14:02:36.918707+0000","last_unstale":"2024-09-19T15:27:37.574384+0000","last_undegraded":"2024-09-19T15:27:37.574384+0000","last_fullsized":"2024-09-19T15:27:37.574384+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:50.554567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9218,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.591968+0000","last_change":"2024-09-19T14:02:29.740667+0000","last_active":"2024-09-19T15:27:32.591968+0000","last_peered":"2024-09-19T15:27:32.591968+0000","last_clean":"2024-09-19T15:27:32.591968+0000","last_became_active":"2024-09-19T14:02:29.739955+0000","last_became_peered":"2024-09-19T14:02:29.739955+0000","last_unstale":"2024-09-19T15:27:32.591968+0000","last_undegraded":"2024-09-19T15:27:32.591968+0000","last_fullsized":"2024-09-19T15:27:32.591968+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:34:51.448763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'12","reported_seq":107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:47.187823+0000","last_change":"2024-09-19T13:56:23.179307+0000","last_active":"2024-09-19T15:28:47.187823+0000","last_peered":"2024-09-19T15:28:47.187823+0000","last_clean":"2024-09-19T15:28:47.187823+0000","last_became_active":"2024-09-19T13:56:23.170272+0000","last_became_peered":"2024-09-19T13:56:23.170272+0000","last_unstale":"2024-09-19T15:28:47.187823+0000","last_undegraded":"2024-09-19T15:28:47.187823+0000","last_fullsized":"2024-09-19T15:28:47.187823+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:47:57.598767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:22.629764+0000","last_change":"2024-09-19T14:29:51.059050+0000","last_active":"2024-09-19T15:27:22.629764+0000","last_peered":"2024-09-19T15:27:22.629764+0000","last_clean":"2024-09-19T15:27:22.629764+0000","last_became_active":"2024-09-19T14:29:51.058380+0000","last_became_peered":"2024-09-19T14:29:51.058380+0000","last_unstale":"2024-09-19T15:27:22.629764+0000","last_undegraded":"2024-09-19T15:27:22.629764+0000","last_fullsized":"2024-09-19T15:27:22.629764+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:35.762726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:38.224574+0000","last_change":"2024-09-19T14:02:36.926259+0000","last_active":"2024-09-19T15:27:38.224574+0000","last_peered":"2024-09-19T15:27:38.224574+0000","last_clean":"2024-09-19T15:27:38.224574+0000","last_became_active":"2024-09-19T14:02:36.924268+0000","last_became_peered":"2024-09-19T14:02:36.924268+0000","last_unstale":"2024-09-19T15:27:38.224574+0000","last_undegraded":"2024-09-19T15:27:38.224574+0000","last_fullsized":"2024-09-19T15:27:38.224574+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:52.337740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.171539+0000","last_change":"2024-09-19T14:02:29.745987+0000","last_active":"2024-09-19T15:27:32.171539+0000","last_peered":"2024-09-19T15:27:32.171539+0000","last_clean":"2024-09-19T15:27:32.171539+0000","last_became_active":"2024-09-19T14:02:29.741114+0000","last_became_peered":"2024-09-19T14:02:29.741114+0000","last_unstale":"2024-09-19T15:27:32.171539+0000","last_undegraded":"2024-09-19T15:27:32.171539+0000","last_fullsized":"2024-09-19T15:27:32.171539+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:21.115185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"268'44","reported_seq":192,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381292+0000","last_change":"2024-09-19T13:56:23.177841+0000","last_active":"2024-09-19T15:28:12.381292+0000","last_peered":"2024-09-19T15:28:12.381292+0000","last_clean":"2024-09-19T15:28:12.381292+0000","last_became_active":"2024-09-19T13:56:23.177082+0000","last_became_peered":"2024-09-19T13:56:23.177082+0000","last_unstale":"2024-09-19T15:28:12.381292+0000","last_undegraded":"2024-09-19T15:28:12.381292+0000","last_fullsized":"2024-09-19T15:28:12.381292+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:57:48.702504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":229,"num_write":111,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381366+0000","last_change":"2024-09-19T14:29:51.037911+0000","last_active":"2024-09-19T15:28:12.381366+0000","last_peered":"2024-09-19T15:28:12.381366+0000","last_clean":"2024-09-19T15:28:12.381366+0000","last_became_active":"2024-09-19T14:29:51.036980+0000","last_became_peered":"2024-09-19T14:29:51.036980+0000","last_unstale":"2024-09-19T15:28:12.381366+0000","last_undegraded":"2024-09-19T15:28:12.381366+0000","last_fullsized":"2024-09-19T15:28:12.381366+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:55.591300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:38.252715+0000","last_change":"2024-09-19T14:02:37.052547+0000","last_active":"2024-09-19T15:29:38.252715+0000","last_peered":"2024-09-19T15:29:38.252715+0000","last_clean":"2024-09-19T15:29:38.252715+0000","last_became_active":"2024-09-19T14:02:37.051627+0000","last_became_peered":"2024-09-19T14:02:37.051627+0000","last_unstale":"2024-09-19T15:29:38.252715+0000","last_undegraded":"2024-09-19T15:29:38.252715+0000","last_fullsized":"2024-09-19T15:29:38.252715+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'10","reported_seq":87,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:32.668758+0000","last_change":"2024-09-19T14:02:29.725819+0000","last_active":"2024-09-19T15:31:32.668758+0000","last_peered":"2024-09-19T15:31:32.668758+0000","last_clean":"2024-09-19T15:31:32.668758+0000","last_became_active":"2024-09-19T14:02:29.725042+0000","last_became_peered":"2024-09-19T14:02:29.725042+0000","last_unstale":"2024-09-19T15:31:32.668758+0000","last_undegraded":"2024-09-19T15:31:32.668758+0000","last_fullsized":"2024-09-19T15:31:32.668758+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:36.488155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":17453,"num_write":15,"num_write_kb":14381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'39","reported_seq":180,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:17.181387+0000","last_change":"2024-09-19T13:56:23.180645+0000","last_active":"2024-09-19T15:28:17.181387+0000","last_peered":"2024-09-19T15:28:17.181387+0000","last_clean":"2024-09-19T15:28:17.181387+0000","last_became_active":"2024-09-19T13:56:23.179656+0000","last_became_peered":"2024-09-19T13:56:23.179656+0000","last_unstale":"2024-09-19T15:28:17.181387+0000","last_undegraded":"2024-09-19T15:28:17.181387+0000","last_fullsized":"2024-09-19T15:28:17.181387+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:23.453827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":202,"num_write":114,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.547652+0000","last_change":"2024-09-19T14:29:51.035627+0000","last_active":"2024-09-19T15:28:12.547652+0000","last_peered":"2024-09-19T15:28:12.547652+0000","last_clean":"2024-09-19T15:28:12.547652+0000","last_became_active":"2024-09-19T14:29:51.034910+0000","last_became_peered":"2024-09-19T14:29:51.034910+0000","last_unstale":"2024-09-19T15:28:12.547652+0000","last_undegraded":"2024-09-19T15:28:12.547652+0000","last_fullsized":"2024-09-19T15:28:12.547652+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:34:52.799048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"268'5","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.702266+0000","last_change":"2024-09-19T14:02:37.050424+0000","last_active":"2024-09-19T15:31:38.702266+0000","last_peered":"2024-09-19T15:31:38.702266+0000","last_clean":"2024-09-19T15:31:38.702266+0000","last_became_active":"2024-09-19T14:02:37.049593+0000","last_became_peered":"2024-09-19T14:02:37.049593+0000","last_unstale":"2024-09-19T15:31:38.702266+0000","last_undegraded":"2024-09-19T15:31:38.702266+0000","last_fullsized":"2024-09-19T15:31:38.702266+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:09.018084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":571,"num_write":10,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"268'7","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.846254+0000","last_change":"2024-09-19T14:02:29.738371+0000","last_active":"2024-09-19T15:31:38.846254+0000","last_peered":"2024-09-19T15:31:38.846254+0000","last_clean":"2024-09-19T15:31:38.846254+0000","last_became_active":"2024-09-19T14:02:29.737689+0000","last_became_peered":"2024-09-19T14:02:29.737689+0000","last_unstale":"2024-09-19T15:31:38.846254+0000","last_undegraded":"2024-09-19T15:31:38.846254+0000","last_fullsized":"2024-09-19T15:31:38.846254+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5718,"num_write":7,"num_write_kb":5718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'32","reported_seq":159,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:13.233083+0000","last_change":"2024-09-19T13:56:23.172875+0000","last_active":"2024-09-19T15:28:13.233083+0000","last_peered":"2024-09-19T15:28:13.233083+0000","last_clean":"2024-09-19T15:28:13.233083+0000","last_became_active":"2024-09-19T13:56:23.172185+0000","last_became_peered":"2024-09-19T13:56:23.172185+0000","last_unstale":"2024-09-19T15:28:13.233083+0000","last_undegraded":"2024-09-19T15:28:13.233083+0000","last_fullsized":"2024-09-19T15:28:13.233083+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:08:40.622542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":246,"num_read_kb":158,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.641708+0000","last_change":"2024-09-19T14:29:51.040551+0000","last_active":"2024-09-19T15:28:12.641708+0000","last_peered":"2024-09-19T15:28:12.641708+0000","last_clean":"2024-09-19T15:28:12.641708+0000","last_became_active":"2024-09-19T14:29:51.039877+0000","last_became_peered":"2024-09-19T14:29:51.039877+0000","last_unstale":"2024-09-19T15:28:12.641708+0000","last_undegraded":"2024-09-19T15:28:12.641708+0000","last_fullsized":"2024-09-19T15:28:12.641708+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:34:37.191773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"268'11","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.677847+0000","last_change":"2024-09-19T14:02:37.055970+0000","last_active":"2024-09-19T15:31:39.677847+0000","last_peered":"2024-09-19T15:31:39.677847+0000","last_clean":"2024-09-19T15:31:39.677847+0000","last_became_active":"2024-09-19T14:02:37.055184+0000","last_became_peered":"2024-09-19T14:02:37.055184+0000","last_unstale":"2024-09-19T15:31:39.677847+0000","last_undegraded":"2024-09-19T15:31:39.677847+0000","last_fullsized":"2024-09-19T15:31:39.677847+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":24576,"num_write":21,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"268'3","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.498273+0000","last_change":"2024-09-19T14:02:29.733490+0000","last_active":"2024-09-19T15:31:40.498273+0000","last_peered":"2024-09-19T15:31:40.498273+0000","last_clean":"2024-09-19T15:31:40.498273+0000","last_became_active":"2024-09-19T14:02:29.732063+0000","last_became_peered":"2024-09-19T14:02:29.732063+0000","last_unstale":"2024-09-19T15:31:40.498273+0000","last_undegraded":"2024-09-19T15:31:40.498273+0000","last_fullsized":"2024-09-19T15:31:40.498273+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'18","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.547747+0000","last_change":"2024-09-19T13:56:23.181555+0000","last_active":"2024-09-19T15:28:12.547747+0000","last_peered":"2024-09-19T15:28:12.547747+0000","last_clean":"2024-09-19T15:28:12.547747+0000","last_became_active":"2024-09-19T13:56:23.172998+0000","last_became_peered":"2024-09-19T13:56:23.172998+0000","last_unstale":"2024-09-19T15:28:12.547747+0000","last_undegraded":"2024-09-19T15:28:12.547747+0000","last_fullsized":"2024-09-19T15:28:12.547747+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:40:22.358000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.620591+0000","last_change":"2024-09-19T14:29:51.021155+0000","last_active":"2024-09-19T15:28:12.620591+0000","last_peered":"2024-09-19T15:28:12.620591+0000","last_clean":"2024-09-19T15:28:12.620591+0000","last_became_active":"2024-09-19T14:29:51.020277+0000","last_became_peered":"2024-09-19T14:29:51.020277+0000","last_unstale":"2024-09-19T15:28:12.620591+0000","last_undegraded":"2024-09-19T15:28:12.620591+0000","last_fullsized":"2024-09-19T15:28:12.620591+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:00.755087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"268'3","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.013694+0000","last_change":"2024-09-19T14:02:36.916711+0000","last_active":"2024-09-19T15:31:40.013694+0000","last_peered":"2024-09-19T15:31:40.013694+0000","last_clean":"2024-09-19T15:31:40.013694+0000","last_became_active":"2024-09-19T14:02:36.915962+0000","last_became_peered":"2024-09-19T14:02:36.915962+0000","last_unstale":"2024-09-19T15:31:40.013694+0000","last_undegraded":"2024-09-19T15:31:40.013694+0000","last_fullsized":"2024-09-19T15:31:40.013694+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:32.198886+0000","last_change":"2024-09-19T14:02:29.746541+0000","last_active":"2024-09-19T15:29:32.198886+0000","last_peered":"2024-09-19T15:29:32.198886+0000","last_clean":"2024-09-19T15:29:32.198886+0000","last_became_active":"2024-09-19T14:02:29.741726+0000","last_became_peered":"2024-09-19T14:02:29.741726+0000","last_unstale":"2024-09-19T15:29:32.198886+0000","last_undegraded":"2024-09-19T15:29:32.198886+0000","last_fullsized":"2024-09-19T15:29:32.198886+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'18","reported_seq":120,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:42.634520+0000","last_change":"2024-09-19T13:56:23.176208+0000","last_active":"2024-09-19T15:27:42.634520+0000","last_peered":"2024-09-19T15:27:42.634520+0000","last_clean":"2024-09-19T15:27:42.634520+0000","last_became_active":"2024-09-19T13:56:23.175483+0000","last_became_peered":"2024-09-19T13:56:23.175483+0000","last_unstale":"2024-09-19T15:27:42.634520+0000","last_undegraded":"2024-09-19T15:27:42.634520+0000","last_fullsized":"2024-09-19T15:27:42.634520+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:44:12.241473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":81,"num_write":47,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:53.228080+0000","last_change":"2024-09-19T14:29:51.055111+0000","last_active":"2024-09-19T15:27:53.228080+0000","last_peered":"2024-09-19T15:27:53.228080+0000","last_clean":"2024-09-19T15:27:53.228080+0000","last_became_active":"2024-09-19T14:29:51.054440+0000","last_became_peered":"2024-09-19T14:29:51.054440+0000","last_unstale":"2024-09-19T15:27:53.228080+0000","last_undegraded":"2024-09-19T15:27:53.228080+0000","last_fullsized":"2024-09-19T15:27:53.228080+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:41:52.609606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391603+0000","last_change":"2024-09-19T14:02:36.918632+0000","last_active":"2024-09-19T15:28:57.391603+0000","last_peered":"2024-09-19T15:28:57.391603+0000","last_clean":"2024-09-19T15:28:57.391603+0000","last_became_active":"2024-09-19T14:02:36.917886+0000","last_became_peered":"2024-09-19T14:02:36.917886+0000","last_unstale":"2024-09-19T15:28:57.391603+0000","last_undegraded":"2024-09-19T15:28:57.391603+0000","last_fullsized":"2024-09-19T15:28:57.391603+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:45:01.058163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"268'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.641739+0000","last_change":"2024-09-19T14:02:29.730814+0000","last_active":"2024-09-19T15:31:12.641739+0000","last_peered":"2024-09-19T15:31:12.641739+0000","last_clean":"2024-09-19T15:31:12.641739+0000","last_became_active":"2024-09-19T14:02:29.730095+0000","last_became_peered":"2024-09-19T14:02:29.730095+0000","last_unstale":"2024-09-19T15:31:12.641739+0000","last_undegraded":"2024-09-19T15:31:12.641739+0000","last_fullsized":"2024-09-19T15:31:12.641739+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:08.221591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'29","reported_seq":149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:42.663601+0000","last_change":"2024-09-19T13:56:23.184572+0000","last_active":"2024-09-19T15:29:42.663601+0000","last_peered":"2024-09-19T15:29:42.663601+0000","last_clean":"2024-09-19T15:29:42.663601+0000","last_became_active":"2024-09-19T13:56:23.183825+0000","last_became_peered":"2024-09-19T13:56:23.183825+0000","last_unstale":"2024-09-19T15:29:42.663601+0000","last_undegraded":"2024-09-19T15:29:42.663601+0000","last_fullsized":"2024-09-19T15:29:42.663601+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":139,"num_write":76,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:52.175719+0000","last_change":"2024-09-19T14:29:51.036785+0000","last_active":"2024-09-19T15:27:52.175719+0000","last_peered":"2024-09-19T15:27:52.175719+0000","last_clean":"2024-09-19T15:27:52.175719+0000","last_became_active":"2024-09-19T14:29:51.036062+0000","last_became_peered":"2024-09-19T14:29:51.036062+0000","last_unstale":"2024-09-19T15:27:52.175719+0000","last_undegraded":"2024-09-19T15:27:52.175719+0000","last_fullsized":"2024-09-19T15:27:52.175719+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:13:16.540530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'3","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.391538+0000","last_change":"2024-09-19T14:02:36.911361+0000","last_active":"2024-09-19T15:28:57.391538+0000","last_peered":"2024-09-19T15:28:57.391538+0000","last_clean":"2024-09-19T15:28:57.391538+0000","last_became_active":"2024-09-19T14:02:36.910298+0000","last_became_peered":"2024-09-19T14:02:36.910298+0000","last_unstale":"2024-09-19T15:28:57.391538+0000","last_undegraded":"2024-09-19T15:28:57.391538+0000","last_fullsized":"2024-09-19T15:28:57.391538+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:11:03.122123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'3","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.052551+0000","last_change":"2024-09-19T14:02:29.734818+0000","last_active":"2024-09-19T15:31:13.052551+0000","last_peered":"2024-09-19T15:31:13.052551+0000","last_clean":"2024-09-19T15:31:13.052551+0000","last_became_active":"2024-09-19T14:02:29.732413+0000","last_became_peered":"2024-09-19T14:02:29.732413+0000","last_unstale":"2024-09-19T15:31:13.052551+0000","last_undegraded":"2024-09-19T15:31:13.052551+0000","last_fullsized":"2024-09-19T15:31:13.052551+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:35.923776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"268'52","reported_seq":215,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:47.202174+0000","last_change":"2024-09-19T13:56:23.162178+0000","last_active":"2024-09-19T15:29:47.202174+0000","last_peered":"2024-09-19T15:29:47.202174+0000","last_clean":"2024-09-19T15:29:47.202174+0000","last_became_active":"2024-09-19T13:56:23.161268+0000","last_became_peered":"2024-09-19T13:56:23.161268+0000","last_unstale":"2024-09-19T15:29:47.202174+0000","last_undegraded":"2024-09-19T15:29:47.202174+0000","last_fullsized":"2024-09-19T15:29:47.202174+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":413,"num_read_kb":272,"num_write":131,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:32.184540+0000","last_change":"2024-09-19T14:29:51.057255+0000","last_active":"2024-09-19T15:28:32.184540+0000","last_peered":"2024-09-19T15:28:32.184540+0000","last_clean":"2024-09-19T15:28:32.184540+0000","last_became_active":"2024-09-19T14:29:51.055396+0000","last_became_peered":"2024-09-19T14:29:51.055396+0000","last_unstale":"2024-09-19T15:28:32.184540+0000","last_undegraded":"2024-09-19T15:28:32.184540+0000","last_fullsized":"2024-09-19T15:28:32.184540+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:09.497977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:58.243369+0000","last_change":"2024-09-19T14:02:36.927347+0000","last_active":"2024-09-19T15:28:58.243369+0000","last_peered":"2024-09-19T15:28:58.243369+0000","last_clean":"2024-09-19T15:28:58.243369+0000","last_became_active":"2024-09-19T14:02:36.926038+0000","last_became_peered":"2024-09-19T14:02:36.926038+0000","last_unstale":"2024-09-19T15:28:58.243369+0000","last_undegraded":"2024-09-19T15:28:58.243369+0000","last_fullsized":"2024-09-19T15:28:58.243369+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:13:52.343458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"268'6","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.612372+0000","last_change":"2024-09-19T14:02:29.741324+0000","last_active":"2024-09-19T15:31:38.612372+0000","last_peered":"2024-09-19T15:31:38.612372+0000","last_clean":"2024-09-19T15:31:38.612372+0000","last_became_active":"2024-09-19T14:02:29.740451+0000","last_became_peered":"2024-09-19T14:02:29.740451+0000","last_unstale":"2024-09-19T15:31:38.612372+0000","last_undegraded":"2024-09-19T15:31:38.612372+0000","last_fullsized":"2024-09-19T15:31:38.612372+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:22.134435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'35","reported_seq":174,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:42.621908+0000","last_change":"2024-09-19T13:56:23.176932+0000","last_active":"2024-09-19T15:29:42.621908+0000","last_peered":"2024-09-19T15:29:42.621908+0000","last_clean":"2024-09-19T15:29:42.621908+0000","last_became_active":"2024-09-19T13:56:23.170486+0000","last_became_peered":"2024-09-19T13:56:23.170486+0000","last_unstale":"2024-09-19T15:29:42.621908+0000","last_undegraded":"2024-09-19T15:29:42.621908+0000","last_fullsized":"2024-09-19T15:29:42.621908+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":196,"num_write":86,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:53.227989+0000","last_change":"2024-09-19T14:29:51.045330+0000","last_active":"2024-09-19T15:27:53.227989+0000","last_peered":"2024-09-19T15:27:53.227989+0000","last_clean":"2024-09-19T15:27:53.227989+0000","last_became_active":"2024-09-19T14:29:51.044154+0000","last_became_peered":"2024-09-19T14:29:51.044154+0000","last_unstale":"2024-09-19T15:27:53.227989+0000","last_undegraded":"2024-09-19T15:27:53.227989+0000","last_fullsized":"2024-09-19T15:27:53.227989+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:18.797951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.394100+0000","last_change":"2024-09-19T14:02:36.923267+0000","last_active":"2024-09-19T15:28:57.394100+0000","last_peered":"2024-09-19T15:28:57.394100+0000","last_clean":"2024-09-19T15:28:57.394100+0000","last_became_active":"2024-09-19T14:02:36.918735+0000","last_became_peered":"2024-09-19T14:02:36.918735+0000","last_unstale":"2024-09-19T15:28:57.394100+0000","last_undegraded":"2024-09-19T15:28:57.394100+0000","last_fullsized":"2024-09-19T15:28:57.394100+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:11.400154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:52.629773+0000","last_change":"2024-09-19T14:02:29.742726+0000","last_active":"2024-09-19T15:28:52.629773+0000","last_peered":"2024-09-19T15:28:52.629773+0000","last_clean":"2024-09-19T15:28:52.629773+0000","last_became_active":"2024-09-19T14:02:29.742091+0000","last_became_peered":"2024-09-19T14:02:29.742091+0000","last_unstale":"2024-09-19T15:28:52.629773+0000","last_undegraded":"2024-09-19T15:28:52.629773+0000","last_fullsized":"2024-09-19T15:28:52.629773+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:13:04.562095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'40","reported_seq":181,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:43.253717+0000","last_change":"2024-09-19T13:56:23.173987+0000","last_active":"2024-09-19T15:29:43.253717+0000","last_peered":"2024-09-19T15:29:43.253717+0000","last_clean":"2024-09-19T15:29:43.253717+0000","last_became_active":"2024-09-19T13:56:23.173245+0000","last_became_peered":"2024-09-19T13:56:23.173245+0000","last_unstale":"2024-09-19T15:29:43.253717+0000","last_undegraded":"2024-09-19T15:29:43.253717+0000","last_fullsized":"2024-09-19T15:29:43.253717+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":315,"num_read_kb":214,"num_write":104,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.552846+0000","last_change":"2024-09-19T14:29:51.044619+0000","last_active":"2024-09-19T15:28:37.552846+0000","last_peered":"2024-09-19T15:28:37.552846+0000","last_clean":"2024-09-19T15:28:37.552846+0000","last_became_active":"2024-09-19T14:29:51.043979+0000","last_became_peered":"2024-09-19T14:29:51.043979+0000","last_unstale":"2024-09-19T15:28:37.552846+0000","last_undegraded":"2024-09-19T15:28:37.552846+0000","last_fullsized":"2024-09-19T15:28:37.552846+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:31:38.625664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"268'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:23.263179+0000","last_change":"2024-09-19T14:02:36.926635+0000","last_active":"2024-09-19T15:30:23.263179+0000","last_peered":"2024-09-19T15:30:23.263179+0000","last_clean":"2024-09-19T15:30:23.263179+0000","last_became_active":"2024-09-19T14:02:36.925870+0000","last_became_peered":"2024-09-19T14:02:36.925870+0000","last_unstale":"2024-09-19T15:30:23.263179+0000","last_undegraded":"2024-09-19T15:30:23.263179+0000","last_fullsized":"2024-09-19T15:30:23.263179+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:50:58.009640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.639477+0000","last_change":"2024-09-19T14:02:29.745325+0000","last_active":"2024-09-19T15:28:02.639477+0000","last_peered":"2024-09-19T15:28:02.639477+0000","last_clean":"2024-09-19T15:28:02.639477+0000","last_became_active":"2024-09-19T14:02:29.744169+0000","last_became_peered":"2024-09-19T14:02:29.744169+0000","last_unstale":"2024-09-19T15:28:02.639477+0000","last_undegraded":"2024-09-19T15:28:02.639477+0000","last_fullsized":"2024-09-19T15:28:02.639477+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:49:32.607973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'31","reported_seq":167,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:48.241100+0000","last_change":"2024-09-19T13:56:23.167169+0000","last_active":"2024-09-19T15:28:48.241100+0000","last_peered":"2024-09-19T15:28:48.241100+0000","last_clean":"2024-09-19T15:28:48.241100+0000","last_became_active":"2024-09-19T13:56:23.160134+0000","last_became_peered":"2024-09-19T13:56:23.160134+0000","last_unstale":"2024-09-19T15:28:48.241100+0000","last_undegraded":"2024-09-19T15:28:48.241100+0000","last_fullsized":"2024-09-19T15:28:48.241100+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:17.424039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":163,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644264+0000","last_change":"2024-09-19T14:29:51.059018+0000","last_active":"2024-09-19T15:28:22.644264+0000","last_peered":"2024-09-19T15:28:22.644264+0000","last_clean":"2024-09-19T15:28:22.644264+0000","last_became_active":"2024-09-19T14:29:51.058494+0000","last_became_peered":"2024-09-19T14:29:51.058494+0000","last_unstale":"2024-09-19T15:28:22.644264+0000","last_undegraded":"2024-09-19T15:28:22.644264+0000","last_fullsized":"2024-09-19T15:28:22.644264+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:29.224657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:08.231677+0000","last_change":"2024-09-19T14:02:36.924847+0000","last_active":"2024-09-19T15:28:08.231677+0000","last_peered":"2024-09-19T15:28:08.231677+0000","last_clean":"2024-09-19T15:28:08.231677+0000","last_became_active":"2024-09-19T14:02:36.924213+0000","last_became_peered":"2024-09-19T14:02:36.924213+0000","last_unstale":"2024-09-19T15:28:08.231677+0000","last_undegraded":"2024-09-19T15:28:08.231677+0000","last_fullsized":"2024-09-19T15:28:08.231677+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:25.039869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.545625+0000","last_change":"2024-09-19T14:02:29.752025+0000","last_active":"2024-09-19T15:28:02.545625+0000","last_peered":"2024-09-19T15:28:02.545625+0000","last_clean":"2024-09-19T15:28:02.545625+0000","last_became_active":"2024-09-19T14:02:29.751229+0000","last_became_peered":"2024-09-19T14:02:29.751229+0000","last_unstale":"2024-09-19T15:28:02.545625+0000","last_undegraded":"2024-09-19T15:28:02.545625+0000","last_fullsized":"2024-09-19T15:28:02.545625+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:04.084148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"268'30","reported_seq":156,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.626409+0000","last_change":"2024-09-19T13:56:23.168672+0000","last_active":"2024-09-19T15:28:37.626409+0000","last_peered":"2024-09-19T15:28:37.626409+0000","last_clean":"2024-09-19T15:28:37.626409+0000","last_became_active":"2024-09-19T13:56:23.166406+0000","last_became_peered":"2024-09-19T13:56:23.166406+0000","last_unstale":"2024-09-19T15:28:37.626409+0000","last_undegraded":"2024-09-19T15:28:37.626409+0000","last_fullsized":"2024-09-19T15:28:37.626409+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:17.132230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":158,"num_write":72,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.386230+0000","last_change":"2024-09-19T14:29:51.051349+0000","last_active":"2024-09-19T15:28:22.386230+0000","last_peered":"2024-09-19T15:28:22.386230+0000","last_clean":"2024-09-19T15:28:22.386230+0000","last_became_active":"2024-09-19T14:29:51.050808+0000","last_became_peered":"2024-09-19T14:29:51.050808+0000","last_unstale":"2024-09-19T15:28:22.386230+0000","last_undegraded":"2024-09-19T15:28:22.386230+0000","last_fullsized":"2024-09-19T15:28:22.386230+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:22:11.404680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"268'3","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:47.413935+0000","last_change":"2024-09-19T14:02:37.053056+0000","last_active":"2024-09-19T15:30:47.413935+0000","last_peered":"2024-09-19T15:30:47.413935+0000","last_clean":"2024-09-19T15:30:47.413935+0000","last_became_active":"2024-09-19T14:02:37.052121+0000","last_became_peered":"2024-09-19T14:02:37.052121+0000","last_unstale":"2024-09-19T15:30:47.413935+0000","last_undegraded":"2024-09-19T15:30:47.413935+0000","last_fullsized":"2024-09-19T15:30:47.413935+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:00.496165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.178139+0000","last_change":"2024-09-19T14:02:29.749448+0000","last_active":"2024-09-19T15:28:02.178139+0000","last_peered":"2024-09-19T15:28:02.178139+0000","last_clean":"2024-09-19T15:28:02.178139+0000","last_became_active":"2024-09-19T14:02:29.748469+0000","last_became_peered":"2024-09-19T14:02:29.748469+0000","last_unstale":"2024-09-19T15:28:02.178139+0000","last_undegraded":"2024-09-19T15:28:02.178139+0000","last_fullsized":"2024-09-19T15:28:02.178139+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:25.962511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"268'120","reported_seq":440,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:37.389638+0000","last_change":"2024-09-19T13:56:23.172759+0000","last_active":"2024-09-19T15:28:37.389638+0000","last_peered":"2024-09-19T15:28:37.389638+0000","last_clean":"2024-09-19T15:28:37.389638+0000","last_became_active":"2024-09-19T13:56:23.164737+0000","last_became_peered":"2024-09-19T13:56:23.164737+0000","last_unstale":"2024-09-19T15:28:37.389638+0000","last_undegraded":"2024-09-19T15:28:37.389638+0000","last_fullsized":"2024-09-19T15:28:37.389638+0000","mapping_epoch":255,"log_start":"265'100","ondisk_log_start":"265'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:31:33.872663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1135,"num_read_kb":1191,"num_write":240,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644185+0000","last_change":"2024-09-19T14:29:51.024362+0000","last_active":"2024-09-19T15:28:22.644185+0000","last_peered":"2024-09-19T15:28:22.644185+0000","last_clean":"2024-09-19T15:28:22.644185+0000","last_became_active":"2024-09-19T14:29:51.022975+0000","last_became_peered":"2024-09-19T14:29:51.022975+0000","last_unstale":"2024-09-19T15:28:22.644185+0000","last_undegraded":"2024-09-19T15:28:22.644185+0000","last_fullsized":"2024-09-19T15:28:22.644185+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:44:44.124646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"268'3","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:23.263213+0000","last_change":"2024-09-19T14:02:36.926595+0000","last_active":"2024-09-19T15:30:23.263213+0000","last_peered":"2024-09-19T15:30:23.263213+0000","last_clean":"2024-09-19T15:30:23.263213+0000","last_became_active":"2024-09-19T14:02:36.924349+0000","last_became_peered":"2024-09-19T14:02:36.924349+0000","last_unstale":"2024-09-19T15:30:23.263213+0000","last_undegraded":"2024-09-19T15:30:23.263213+0000","last_fullsized":"2024-09-19T15:30:23.263213+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:10.123769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:27.385058+0000","last_change":"2024-09-19T14:02:29.731121+0000","last_active":"2024-09-19T15:28:27.385058+0000","last_peered":"2024-09-19T15:28:27.385058+0000","last_clean":"2024-09-19T15:28:27.385058+0000","last_became_active":"2024-09-19T14:02:29.730280+0000","last_became_peered":"2024-09-19T14:02:29.730280+0000","last_unstale":"2024-09-19T15:28:27.385058+0000","last_undegraded":"2024-09-19T15:28:27.385058+0000","last_fullsized":"2024-09-19T15:28:27.385058+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:25.212771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'28","reported_seq":157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.948745+0000","last_change":"2024-09-19T15:32:05.948745+0000","last_active":"2024-09-19T15:32:05.948745+0000","last_peered":"2024-09-19T15:32:05.948745+0000","last_clean":"2024-09-19T15:32:05.948745+0000","last_became_active":"2024-09-19T13:56:23.182103+0000","last_became_peered":"2024-09-19T13:56:23.182103+0000","last_unstale":"2024-09-19T15:32:05.948745+0000","last_undegraded":"2024-09-19T15:32:05.948745+0000","last_fullsized":"2024-09-19T15:32:05.948745+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'28","last_scrub_stamp":"2024-09-19T15:32:05.948526+0000","last_deep_scrub":"268'28","last_deep_scrub_stamp":"2024-09-19T15:32:05.948526+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.948526+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:07:24.807541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":141,"num_write":72,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:23.235388+0000","last_change":"2024-09-19T14:29:51.030844+0000","last_active":"2024-09-19T15:28:23.235388+0000","last_peered":"2024-09-19T15:28:23.235388+0000","last_clean":"2024-09-19T15:28:23.235388+0000","last_became_active":"2024-09-19T14:29:51.030200+0000","last_became_peered":"2024-09-19T14:29:51.030200+0000","last_unstale":"2024-09-19T15:28:23.235388+0000","last_undegraded":"2024-09-19T15:28:23.235388+0000","last_fullsized":"2024-09-19T15:28:23.235388+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:34:22.342028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"265'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:17.616101+0000","last_change":"2024-09-19T14:02:36.929045+0000","last_active":"2024-09-19T15:29:17.616101+0000","last_peered":"2024-09-19T15:29:17.616101+0000","last_clean":"2024-09-19T15:29:17.616101+0000","last_became_active":"2024-09-19T14:02:36.927585+0000","last_became_peered":"2024-09-19T14:02:36.927585+0000","last_unstale":"2024-09-19T15:29:17.616101+0000","last_undegraded":"2024-09-19T15:29:17.616101+0000","last_fullsized":"2024-09-19T15:29:17.616101+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:44:02.469367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"265'5","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.194026+0000","last_change":"2024-09-19T14:02:29.740714+0000","last_active":"2024-09-19T15:29:12.194026+0000","last_peered":"2024-09-19T15:29:12.194026+0000","last_clean":"2024-09-19T15:29:12.194026+0000","last_became_active":"2024-09-19T14:02:29.739469+0000","last_became_peered":"2024-09-19T14:02:29.739469+0000","last_unstale":"2024-09-19T15:29:12.194026+0000","last_undegraded":"2024-09-19T15:29:12.194026+0000","last_fullsized":"2024-09-19T15:29:12.194026+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:23.314643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'26","reported_seq":145,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.186692+0000","last_change":"2024-09-19T13:56:23.180908+0000","last_active":"2024-09-19T15:28:42.186692+0000","last_peered":"2024-09-19T15:28:42.186692+0000","last_clean":"2024-09-19T15:28:42.186692+0000","last_became_active":"2024-09-19T13:56:23.170897+0000","last_became_peered":"2024-09-19T13:56:23.170897+0000","last_unstale":"2024-09-19T15:28:42.186692+0000","last_undegraded":"2024-09-19T15:28:42.186692+0000","last_fullsized":"2024-09-19T15:28:42.186692+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:59.535564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":129,"num_write":67,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:32.646832+0000","last_change":"2024-09-19T14:29:51.047203+0000","last_active":"2024-09-19T15:28:32.646832+0000","last_peered":"2024-09-19T15:28:32.646832+0000","last_clean":"2024-09-19T15:28:32.646832+0000","last_became_active":"2024-09-19T14:29:51.046273+0000","last_became_peered":"2024-09-19T14:29:51.046273+0000","last_unstale":"2024-09-19T15:28:32.646832+0000","last_undegraded":"2024-09-19T15:28:32.646832+0000","last_fullsized":"2024-09-19T15:28:32.646832+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:15.605088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"268'8","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:27.688771+0000","last_change":"2024-09-19T14:02:37.051538+0000","last_active":"2024-09-19T15:31:27.688771+0000","last_peered":"2024-09-19T15:31:27.688771+0000","last_clean":"2024-09-19T15:31:27.688771+0000","last_became_active":"2024-09-19T14:02:37.050689+0000","last_became_peered":"2024-09-19T14:02:37.050689+0000","last_unstale":"2024-09-19T15:31:27.688771+0000","last_undegraded":"2024-09-19T15:31:27.688771+0000","last_fullsized":"2024-09-19T15:31:27.688771+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:21.698768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32770,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"265'5","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.395204+0000","last_change":"2024-09-19T14:02:29.731282+0000","last_active":"2024-09-19T15:29:12.395204+0000","last_peered":"2024-09-19T15:29:12.395204+0000","last_clean":"2024-09-19T15:29:12.395204+0000","last_became_active":"2024-09-19T14:02:29.730624+0000","last_became_peered":"2024-09-19T14:02:29.730624+0000","last_unstale":"2024-09-19T15:29:12.395204+0000","last_undegraded":"2024-09-19T15:29:12.395204+0000","last_fullsized":"2024-09-19T15:29:12.395204+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:58.498165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'5","reported_seq":91,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:52.665890+0000","last_change":"2024-09-19T13:56:23.182572+0000","last_active":"2024-09-19T15:29:52.665890+0000","last_peered":"2024-09-19T15:29:52.665890+0000","last_clean":"2024-09-19T15:29:52.665890+0000","last_became_active":"2024-09-19T13:56:23.181867+0000","last_became_peered":"2024-09-19T13:56:23.181867+0000","last_unstale":"2024-09-19T15:29:52.665890+0000","last_undegraded":"2024-09-19T15:29:52.665890+0000","last_fullsized":"2024-09-19T15:29:52.665890+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644309+0000","last_change":"2024-09-19T14:29:51.037068+0000","last_active":"2024-09-19T15:28:22.644309+0000","last_peered":"2024-09-19T15:28:22.644309+0000","last_clean":"2024-09-19T15:28:22.644309+0000","last_became_active":"2024-09-19T14:29:51.036292+0000","last_became_peered":"2024-09-19T14:29:51.036292+0000","last_unstale":"2024-09-19T15:28:22.644309+0000","last_undegraded":"2024-09-19T15:28:22.644309+0000","last_fullsized":"2024-09-19T15:28:22.644309+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:12.187433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"268'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:22.410283+0000","last_change":"2024-09-19T14:02:36.924261+0000","last_active":"2024-09-19T15:30:22.410283+0000","last_peered":"2024-09-19T15:30:22.410283+0000","last_clean":"2024-09-19T15:30:22.410283+0000","last_became_active":"2024-09-19T14:02:36.923500+0000","last_became_peered":"2024-09-19T14:02:36.923500+0000","last_unstale":"2024-09-19T15:30:22.410283+0000","last_undegraded":"2024-09-19T15:30:22.410283+0000","last_fullsized":"2024-09-19T15:30:22.410283+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:28:12.672018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'3","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.099729+0000","last_change":"2024-09-19T14:02:29.746888+0000","last_active":"2024-09-19T15:31:39.099729+0000","last_peered":"2024-09-19T15:31:39.099729+0000","last_clean":"2024-09-19T15:31:39.099729+0000","last_became_active":"2024-09-19T14:02:29.746148+0000","last_became_peered":"2024-09-19T14:02:29.746148+0000","last_unstale":"2024-09-19T15:31:39.099729+0000","last_undegraded":"2024-09-19T15:31:39.099729+0000","last_fullsized":"2024-09-19T15:31:39.099729+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'41","reported_seq":188,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:33.251302+0000","last_change":"2024-09-19T13:56:23.174360+0000","last_active":"2024-09-19T15:29:33.251302+0000","last_peered":"2024-09-19T15:29:33.251302+0000","last_clean":"2024-09-19T15:29:33.251302+0000","last_became_active":"2024-09-19T13:56:23.173918+0000","last_became_peered":"2024-09-19T13:56:23.173918+0000","last_unstale":"2024-09-19T15:29:33.251302+0000","last_undegraded":"2024-09-19T15:29:33.251302+0000","last_fullsized":"2024-09-19T15:29:33.251302+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:23.496354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":206,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.182455+0000","last_change":"2024-09-19T14:29:51.034137+0000","last_active":"2024-09-19T15:28:22.182455+0000","last_peered":"2024-09-19T15:28:22.182455+0000","last_clean":"2024-09-19T15:28:22.182455+0000","last_became_active":"2024-09-19T14:29:51.033329+0000","last_became_peered":"2024-09-19T14:29:51.033329+0000","last_unstale":"2024-09-19T15:28:22.182455+0000","last_undegraded":"2024-09-19T15:28:22.182455+0000","last_fullsized":"2024-09-19T15:28:22.182455+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:09.961864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'5","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:37.662441+0000","last_change":"2024-09-19T14:03:07.396429+0000","last_active":"2024-09-19T15:29:37.662441+0000","last_peered":"2024-09-19T15:29:37.662441+0000","last_clean":"2024-09-19T15:29:37.662441+0000","last_became_active":"2024-09-19T14:03:07.395844+0000","last_became_peered":"2024-09-19T14:03:07.395844+0000","last_unstale":"2024-09-19T15:29:37.662441+0000","last_undegraded":"2024-09-19T15:29:37.662441+0000","last_fullsized":"2024-09-19T15:29:37.662441+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:30.854364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5147,"num_write":5,"num_write_kb":5147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'3","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.598913+0000","last_change":"2024-09-19T14:02:29.733169+0000","last_active":"2024-09-19T15:28:02.598913+0000","last_peered":"2024-09-19T15:28:02.598913+0000","last_clean":"2024-09-19T15:28:02.598913+0000","last_became_active":"2024-09-19T14:02:29.732416+0000","last_became_peered":"2024-09-19T14:02:29.732416+0000","last_unstale":"2024-09-19T15:28:02.598913+0000","last_undegraded":"2024-09-19T15:28:02.598913+0000","last_fullsized":"2024-09-19T15:28:02.598913+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:49:13.647937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'38","reported_seq":188,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:32.402062+0000","last_change":"2024-09-19T13:56:23.173200+0000","last_active":"2024-09-19T15:29:32.402062+0000","last_peered":"2024-09-19T15:29:32.402062+0000","last_clean":"2024-09-19T15:29:32.402062+0000","last_became_active":"2024-09-19T13:56:23.172437+0000","last_became_peered":"2024-09-19T13:56:23.172437+0000","last_unstale":"2024-09-19T15:29:32.402062+0000","last_undegraded":"2024-09-19T15:29:32.402062+0000","last_fullsized":"2024-09-19T15:29:32.402062+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:43:47.758946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":311,"num_read_kb":193,"num_write":96,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.641824+0000","last_change":"2024-09-19T14:29:51.037099+0000","last_active":"2024-09-19T15:28:12.641824+0000","last_peered":"2024-09-19T15:28:12.641824+0000","last_clean":"2024-09-19T15:28:12.641824+0000","last_became_active":"2024-09-19T14:29:51.036386+0000","last_became_peered":"2024-09-19T14:29:51.036386+0000","last_unstale":"2024-09-19T15:28:12.641824+0000","last_undegraded":"2024-09-19T15:28:12.641824+0000","last_fullsized":"2024-09-19T15:28:12.641824+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:47.754572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:32.184569+0000","last_change":"2024-09-19T14:02:36.913472+0000","last_active":"2024-09-19T15:28:32.184569+0000","last_peered":"2024-09-19T15:28:32.184569+0000","last_clean":"2024-09-19T15:28:32.184569+0000","last_became_active":"2024-09-19T14:02:36.912757+0000","last_became_peered":"2024-09-19T14:02:36.912757+0000","last_unstale":"2024-09-19T15:28:32.184569+0000","last_undegraded":"2024-09-19T15:28:32.184569+0000","last_fullsized":"2024-09-19T15:28:32.184569+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:28.705324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"268'3","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.017160+0000","last_change":"2024-09-19T14:02:29.726496+0000","last_active":"2024-09-19T15:31:39.017160+0000","last_peered":"2024-09-19T15:31:39.017160+0000","last_clean":"2024-09-19T15:31:39.017160+0000","last_became_active":"2024-09-19T14:02:29.725707+0000","last_became_peered":"2024-09-19T14:02:29.725707+0000","last_unstale":"2024-09-19T15:31:39.017160+0000","last_undegraded":"2024-09-19T15:31:39.017160+0000","last_fullsized":"2024-09-19T15:31:39.017160+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'2","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:37.199998+0000","last_change":"2024-09-19T13:56:23.181807+0000","last_active":"2024-09-19T15:29:37.199998+0000","last_peered":"2024-09-19T15:29:37.199998+0000","last_clean":"2024-09-19T15:29:37.199998+0000","last_became_active":"2024-09-19T13:56:23.180518+0000","last_became_peered":"2024-09-19T13:56:23.180518+0000","last_unstale":"2024-09-19T15:29:37.199998+0000","last_undegraded":"2024-09-19T15:29:37.199998+0000","last_fullsized":"2024-09-19T15:29:37.199998+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.620670+0000","last_change":"2024-09-19T14:29:51.030804+0000","last_active":"2024-09-19T15:28:12.620670+0000","last_peered":"2024-09-19T15:28:12.620670+0000","last_clean":"2024-09-19T15:28:12.620670+0000","last_became_active":"2024-09-19T14:29:51.030021+0000","last_became_peered":"2024-09-19T14:29:51.030021+0000","last_unstale":"2024-09-19T15:28:12.620670+0000","last_undegraded":"2024-09-19T15:28:12.620670+0000","last_fullsized":"2024-09-19T15:28:12.620670+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:03.409322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"265'3","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.178084+0000","last_change":"2024-09-19T14:02:37.052572+0000","last_active":"2024-09-19T15:28:02.178084+0000","last_peered":"2024-09-19T15:28:02.178084+0000","last_clean":"2024-09-19T15:28:02.178084+0000","last_became_active":"2024-09-19T14:02:37.051567+0000","last_became_peered":"2024-09-19T14:02:37.051567+0000","last_unstale":"2024-09-19T15:28:02.178084+0000","last_undegraded":"2024-09-19T15:28:02.178084+0000","last_fullsized":"2024-09-19T15:28:02.178084+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:19:54.029118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:17.548757+0000","last_change":"2024-09-19T14:02:29.748318+0000","last_active":"2024-09-19T15:28:17.548757+0000","last_peered":"2024-09-19T15:28:17.548757+0000","last_clean":"2024-09-19T15:28:17.548757+0000","last_became_active":"2024-09-19T14:02:29.747539+0000","last_became_peered":"2024-09-19T14:02:29.747539+0000","last_unstale":"2024-09-19T15:28:17.548757+0000","last_undegraded":"2024-09-19T15:28:17.548757+0000","last_fullsized":"2024-09-19T15:28:17.548757+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:42:39.905932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"268'12","reported_seq":110,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:32.402224+0000","last_change":"2024-09-19T13:56:23.174992+0000","last_active":"2024-09-19T15:29:32.402224+0000","last_peered":"2024-09-19T15:29:32.402224+0000","last_clean":"2024-09-19T15:29:32.402224+0000","last_became_active":"2024-09-19T13:56:23.173882+0000","last_became_peered":"2024-09-19T13:56:23.173882+0000","last_unstale":"2024-09-19T15:29:32.402224+0000","last_undegraded":"2024-09-19T15:29:32.402224+0000","last_fullsized":"2024-09-19T15:29:32.402224+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:21.063143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":61,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381230+0000","last_change":"2024-09-19T14:29:51.050041+0000","last_active":"2024-09-19T15:28:12.381230+0000","last_peered":"2024-09-19T15:28:12.381230+0000","last_clean":"2024-09-19T15:28:12.381230+0000","last_became_active":"2024-09-19T14:29:51.049356+0000","last_became_peered":"2024-09-19T14:29:51.049356+0000","last_unstale":"2024-09-19T15:28:12.381230+0000","last_undegraded":"2024-09-19T15:28:12.381230+0000","last_fullsized":"2024-09-19T15:28:12.381230+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:28.752706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"268'8","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:27.688992+0000","last_change":"2024-09-19T14:02:37.057637+0000","last_active":"2024-09-19T15:31:27.688992+0000","last_peered":"2024-09-19T15:31:27.688992+0000","last_clean":"2024-09-19T15:31:27.688992+0000","last_became_active":"2024-09-19T14:02:37.056814+0000","last_became_peered":"2024-09-19T14:02:37.056814+0000","last_unstale":"2024-09-19T15:31:27.688992+0000","last_undegraded":"2024-09-19T15:31:27.688992+0000","last_fullsized":"2024-09-19T15:31:27.688992+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:04:44.022820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.634682+0000","last_change":"2024-09-19T14:02:29.724061+0000","last_active":"2024-09-19T15:29:12.634682+0000","last_peered":"2024-09-19T15:29:12.634682+0000","last_clean":"2024-09-19T15:29:12.634682+0000","last_became_active":"2024-09-19T14:02:29.723298+0000","last_became_peered":"2024-09-19T14:02:29.723298+0000","last_unstale":"2024-09-19T15:29:12.634682+0000","last_undegraded":"2024-09-19T15:29:12.634682+0000","last_fullsized":"2024-09-19T15:29:12.634682+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:04:40.406319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'20","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644346+0000","last_change":"2024-09-19T13:56:23.190217+0000","last_active":"2024-09-19T15:28:22.644346+0000","last_peered":"2024-09-19T15:28:22.644346+0000","last_clean":"2024-09-19T15:28:22.644346+0000","last_became_active":"2024-09-19T13:56:23.189485+0000","last_became_peered":"2024-09-19T13:56:23.189485+0000","last_unstale":"2024-09-19T15:28:22.644346+0000","last_undegraded":"2024-09-19T15:28:22.644346+0000","last_fullsized":"2024-09-19T15:28:22.644346+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:26:00.955840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":106,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.601092+0000","last_change":"2024-09-19T14:29:51.029750+0000","last_active":"2024-09-19T15:28:12.601092+0000","last_peered":"2024-09-19T15:28:12.601092+0000","last_clean":"2024-09-19T15:28:12.601092+0000","last_became_active":"2024-09-19T14:29:51.028866+0000","last_became_peered":"2024-09-19T14:29:51.028866+0000","last_unstale":"2024-09-19T15:28:12.601092+0000","last_undegraded":"2024-09-19T15:28:12.601092+0000","last_fullsized":"2024-09-19T15:28:12.601092+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:57:37.166340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'5","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.469786+0000","last_change":"2024-09-19T14:02:36.917356+0000","last_active":"2024-09-19T15:31:38.469786+0000","last_peered":"2024-09-19T15:31:38.469786+0000","last_clean":"2024-09-19T15:31:38.469786+0000","last_became_active":"2024-09-19T14:02:36.916389+0000","last_became_peered":"2024-09-19T14:02:36.916389+0000","last_unstale":"2024-09-19T15:31:38.469786+0000","last_undegraded":"2024-09-19T15:31:38.469786+0000","last_fullsized":"2024-09-19T15:31:38.469786+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:02.036578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12336,"num_write":5,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"268'8","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:22.687755+0000","last_change":"2024-09-19T14:02:29.741915+0000","last_active":"2024-09-19T15:31:22.687755+0000","last_peered":"2024-09-19T15:31:22.687755+0000","last_clean":"2024-09-19T15:31:22.687755+0000","last_became_active":"2024-09-19T14:02:29.740227+0000","last_became_peered":"2024-09-19T14:02:29.740227+0000","last_unstale":"2024-09-19T15:31:22.687755+0000","last_undegraded":"2024-09-19T15:31:22.687755+0000","last_fullsized":"2024-09-19T15:31:22.687755+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:46.277985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":9218,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'41","reported_seq":190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.378845+0000","last_change":"2024-09-19T13:56:23.174685+0000","last_active":"2024-09-19T15:28:02.378845+0000","last_peered":"2024-09-19T15:28:02.378845+0000","last_clean":"2024-09-19T15:28:02.378845+0000","last_became_active":"2024-09-19T13:56:23.173938+0000","last_became_peered":"2024-09-19T13:56:23.173938+0000","last_unstale":"2024-09-19T15:28:02.378845+0000","last_undegraded":"2024-09-19T15:28:02.378845+0000","last_fullsized":"2024-09-19T15:28:02.378845+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:20.591650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":330,"num_read_kb":229,"num_write":110,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.549879+0000","last_change":"2024-09-19T14:29:51.026777+0000","last_active":"2024-09-19T15:28:22.549879+0000","last_peered":"2024-09-19T15:28:22.549879+0000","last_clean":"2024-09-19T15:28:22.549879+0000","last_became_active":"2024-09-19T14:29:51.025959+0000","last_became_peered":"2024-09-19T14:29:51.025959+0000","last_unstale":"2024-09-19T15:28:22.549879+0000","last_undegraded":"2024-09-19T15:28:22.549879+0000","last_fullsized":"2024-09-19T15:28:22.549879+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:11:23.290380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.378636+0000","last_change":"2024-09-19T14:02:36.912701+0000","last_active":"2024-09-19T15:28:02.378636+0000","last_peered":"2024-09-19T15:28:02.378636+0000","last_clean":"2024-09-19T15:28:02.378636+0000","last_became_active":"2024-09-19T14:02:36.911804+0000","last_became_peered":"2024-09-19T14:02:36.911804+0000","last_unstale":"2024-09-19T15:28:02.378636+0000","last_undegraded":"2024-09-19T15:28:02.378636+0000","last_fullsized":"2024-09-19T15:28:02.378636+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:12.422526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"268'8","reported_seq":89,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.538893+0000","last_change":"2024-09-19T14:02:29.748278+0000","last_active":"2024-09-19T15:31:39.538893+0000","last_peered":"2024-09-19T15:31:39.538893+0000","last_clean":"2024-09-19T15:31:39.538893+0000","last_became_active":"2024-09-19T14:02:29.747553+0000","last_became_peered":"2024-09-19T14:02:29.747553+0000","last_unstale":"2024-09-19T15:31:39.538893+0000","last_undegraded":"2024-09-19T15:31:39.538893+0000","last_fullsized":"2024-09-19T15:31:39.538893+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:20:14.376148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":21504,"num_write":8,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'275","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.618334+0000","last_change":"2024-09-19T13:56:23.186164+0000","last_active":"2024-09-19T15:28:02.618334+0000","last_peered":"2024-09-19T15:28:02.618334+0000","last_clean":"2024-09-19T15:28:02.618334+0000","last_became_active":"2024-09-19T13:56:23.185522+0000","last_became_peered":"2024-09-19T13:56:23.185522+0000","last_unstale":"2024-09-19T15:28:02.618334+0000","last_undegraded":"2024-09-19T15:28:02.618334+0000","last_fullsized":"2024-09-19T15:28:02.618334+0000","mapping_epoch":255,"log_start":"265'200","ondisk_log_start":"265'200","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:23.817224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2606,"num_read_kb":3112,"num_write":537,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.182535+0000","last_change":"2024-09-19T14:29:51.043009+0000","last_active":"2024-09-19T15:28:22.182535+0000","last_peered":"2024-09-19T15:28:22.182535+0000","last_clean":"2024-09-19T15:28:22.182535+0000","last_became_active":"2024-09-19T14:29:51.042287+0000","last_became_peered":"2024-09-19T14:29:51.042287+0000","last_unstale":"2024-09-19T15:28:22.182535+0000","last_undegraded":"2024-09-19T15:28:22.182535+0000","last_fullsized":"2024-09-19T15:28:22.182535+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:00:55.357725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"268'3","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:57.659838+0000","last_change":"2024-09-19T14:02:36.913575+0000","last_active":"2024-09-19T15:30:57.659838+0000","last_peered":"2024-09-19T15:30:57.659838+0000","last_clean":"2024-09-19T15:30:57.659838+0000","last_became_active":"2024-09-19T14:02:36.912642+0000","last_became_peered":"2024-09-19T14:02:36.912642+0000","last_unstale":"2024-09-19T15:30:57.659838+0000","last_undegraded":"2024-09-19T15:30:57.659838+0000","last_fullsized":"2024-09-19T15:30:57.659838+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:53.289654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:02.668215+0000","last_change":"2024-09-19T14:02:29.740640+0000","last_active":"2024-09-19T15:30:02.668215+0000","last_peered":"2024-09-19T15:30:02.668215+0000","last_clean":"2024-09-19T15:30:02.668215+0000","last_became_active":"2024-09-19T14:02:29.739397+0000","last_became_peered":"2024-09-19T14:02:29.739397+0000","last_unstale":"2024-09-19T15:30:02.668215+0000","last_undegraded":"2024-09-19T15:30:02.668215+0000","last_fullsized":"2024-09-19T15:30:02.668215+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'26","reported_seq":155,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.598838+0000","last_change":"2024-09-19T13:56:23.179600+0000","last_active":"2024-09-19T15:28:02.598838+0000","last_peered":"2024-09-19T15:28:02.598838+0000","last_clean":"2024-09-19T15:28:02.598838+0000","last_became_active":"2024-09-19T13:56:23.178722+0000","last_became_peered":"2024-09-19T13:56:23.178722+0000","last_unstale":"2024-09-19T15:28:02.598838+0000","last_undegraded":"2024-09-19T15:28:02.598838+0000","last_fullsized":"2024-09-19T15:28:02.598838+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:17.896929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":137,"num_write":65,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.180147+0000","last_change":"2024-09-19T14:29:51.040094+0000","last_active":"2024-09-19T15:28:12.180147+0000","last_peered":"2024-09-19T15:28:12.180147+0000","last_clean":"2024-09-19T15:28:12.180147+0000","last_became_active":"2024-09-19T14:29:51.037398+0000","last_became_peered":"2024-09-19T14:29:51.037398+0000","last_unstale":"2024-09-19T15:28:12.180147+0000","last_undegraded":"2024-09-19T15:28:12.180147+0000","last_fullsized":"2024-09-19T15:28:12.180147+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:38.720027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.382027+0000","last_change":"2024-09-19T14:02:36.929646+0000","last_active":"2024-09-19T15:28:02.382027+0000","last_peered":"2024-09-19T15:28:02.382027+0000","last_clean":"2024-09-19T15:28:02.382027+0000","last_became_active":"2024-09-19T14:02:36.928598+0000","last_became_peered":"2024-09-19T14:02:36.928598+0000","last_unstale":"2024-09-19T15:28:02.382027+0000","last_undegraded":"2024-09-19T15:28:02.382027+0000","last_fullsized":"2024-09-19T15:28:02.382027+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:55:11.565586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"268'2","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.609718+0000","last_change":"2024-09-19T14:02:29.738035+0000","last_active":"2024-09-19T15:31:38.609718+0000","last_peered":"2024-09-19T15:31:38.609718+0000","last_clean":"2024-09-19T15:31:38.609718+0000","last_became_active":"2024-09-19T14:02:29.737082+0000","last_became_peered":"2024-09-19T14:02:29.737082+0000","last_unstale":"2024-09-19T15:31:38.609718+0000","last_undegraded":"2024-09-19T15:31:38.609718+0000","last_fullsized":"2024-09-19T15:31:38.609718+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'51","reported_seq":222,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.381862+0000","last_change":"2024-09-19T13:56:23.173928+0000","last_active":"2024-09-19T15:28:02.381862+0000","last_peered":"2024-09-19T15:28:02.381862+0000","last_clean":"2024-09-19T15:28:02.381862+0000","last_became_active":"2024-09-19T13:56:23.173172+0000","last_became_peered":"2024-09-19T13:56:23.173172+0000","last_unstale":"2024-09-19T15:28:02.381862+0000","last_undegraded":"2024-09-19T15:28:02.381862+0000","last_fullsized":"2024-09-19T15:28:02.381862+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:40:50.508754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":432,"num_read_kb":295,"num_write":119,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644369+0000","last_change":"2024-09-19T14:29:51.048750+0000","last_active":"2024-09-19T15:28:22.644369+0000","last_peered":"2024-09-19T15:28:22.644369+0000","last_clean":"2024-09-19T15:28:22.644369+0000","last_became_active":"2024-09-19T14:29:51.047826+0000","last_became_peered":"2024-09-19T14:29:51.047826+0000","last_unstale":"2024-09-19T15:28:22.644369+0000","last_undegraded":"2024-09-19T15:28:22.644369+0000","last_fullsized":"2024-09-19T15:28:22.644369+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:01.510352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'5","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.598789+0000","last_change":"2024-09-19T14:02:36.910670+0000","last_active":"2024-09-19T15:28:02.598789+0000","last_peered":"2024-09-19T15:28:02.598789+0000","last_clean":"2024-09-19T15:28:02.598789+0000","last_became_active":"2024-09-19T14:02:36.910154+0000","last_became_peered":"2024-09-19T14:02:36.910154+0000","last_unstale":"2024-09-19T15:28:02.598789+0000","last_undegraded":"2024-09-19T15:28:02.598789+0000","last_fullsized":"2024-09-19T15:28:02.598789+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:30:56.428703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"268'2","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.470866+0000","last_change":"2024-09-19T14:02:29.723856+0000","last_active":"2024-09-19T15:31:38.470866+0000","last_peered":"2024-09-19T15:31:38.470866+0000","last_clean":"2024-09-19T15:31:38.470866+0000","last_became_active":"2024-09-19T14:02:29.723084+0000","last_became_peered":"2024-09-19T14:02:29.723084+0000","last_unstale":"2024-09-19T15:31:38.470866+0000","last_undegraded":"2024-09-19T15:31:38.470866+0000","last_fullsized":"2024-09-19T15:31:38.470866+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'52","reported_seq":217,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.648963+0000","last_change":"2024-09-19T13:56:23.182198+0000","last_active":"2024-09-19T15:28:42.648963+0000","last_peered":"2024-09-19T15:28:42.648963+0000","last_clean":"2024-09-19T15:28:42.648963+0000","last_became_active":"2024-09-19T13:56:23.181354+0000","last_became_peered":"2024-09-19T13:56:23.181354+0000","last_unstale":"2024-09-19T15:28:42.648963+0000","last_undegraded":"2024-09-19T15:28:42.648963+0000","last_fullsized":"2024-09-19T15:28:42.648963+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:38.576519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":381,"num_read_kb":254,"num_write":133,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'384","reported_seq":1097,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.661911+0000","last_change":"2024-09-19T15:32:00.661911+0000","last_active":"2024-09-19T15:32:00.661911+0000","last_peered":"2024-09-19T15:32:00.661911+0000","last_clean":"2024-09-19T15:32:00.661911+0000","last_became_active":"2024-09-19T13:40:34.278366+0000","last_became_peered":"2024-09-19T13:40:34.278366+0000","last_unstale":"2024-09-19T15:32:00.661911+0000","last_undegraded":"2024-09-19T15:32:00.661911+0000","last_fullsized":"2024-09-19T15:32:00.661911+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'384","last_scrub_stamp":"2024-09-19T15:32:00.661714+0000","last_deep_scrub":"268'384","last_deep_scrub_stamp":"2024-09-19T15:32:00.661714+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.661714+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:17:20.451042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":664,"num_read_kb":97882,"num_write":1263,"num_write_kb":51204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'904","reported_seq":2638,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.758397+0000","last_change":"2024-09-19T15:32:05.758397+0000","last_active":"2024-09-19T15:32:05.758397+0000","last_peered":"2024-09-19T15:32:05.758397+0000","last_clean":"2024-09-19T15:32:05.758397+0000","last_became_active":"2024-09-19T13:40:36.233265+0000","last_became_peered":"2024-09-19T13:40:36.233265+0000","last_unstale":"2024-09-19T15:32:05.758397+0000","last_undegraded":"2024-09-19T15:32:05.758397+0000","last_fullsized":"2024-09-19T15:32:05.758397+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'904","last_scrub_stamp":"2024-09-19T15:32:05.758196+0000","last_deep_scrub":"268'904","last_deep_scrub_stamp":"2024-09-19T15:32:05.758196+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.758196+0000","objects_scrubbed":8,"log_size":104,"log_dups_size":800,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:22:11.832649+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4503,"num_read_kb":4037,"num_write":1205,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3446,"num_omap_keys":14,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'293","reported_seq":924,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.638153+0000","last_change":"2024-09-19T15:31:50.638153+0000","last_active":"2024-09-19T15:31:50.638153+0000","last_peered":"2024-09-19T15:31:50.638153+0000","last_clean":"2024-09-19T15:31:50.638153+0000","last_became_active":"2024-09-19T13:40:34.240412+0000","last_became_peered":"2024-09-19T13:40:34.240412+0000","last_unstale":"2024-09-19T15:31:50.638153+0000","last_undegraded":"2024-09-19T15:31:50.638153+0000","last_fullsized":"2024-09-19T15:31:50.638153+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'293","last_scrub_stamp":"2024-09-19T15:31:50.637951+0000","last_deep_scrub":"268'293","last_deep_scrub_stamp":"2024-09-19T15:31:50.637951+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.637951+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:16.720237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":459,"num_read_kb":36198,"num_write":952,"num_write_kb":29274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'624","reported_seq":2335,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.730768+0000","last_change":"2024-09-19T15:32:04.730768+0000","last_active":"2024-09-19T15:32:04.730768+0000","last_peered":"2024-09-19T15:32:04.730768+0000","last_clean":"2024-09-19T15:32:04.730768+0000","last_became_active":"2024-09-19T13:40:36.232504+0000","last_became_peered":"2024-09-19T13:40:36.232504+0000","last_unstale":"2024-09-19T15:32:04.730768+0000","last_undegraded":"2024-09-19T15:32:04.730768+0000","last_fullsized":"2024-09-19T15:32:04.730768+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'624","last_scrub_stamp":"2024-09-19T15:32:04.730583+0000","last_deep_scrub":"268'624","last_deep_scrub_stamp":"2024-09-19T15:32:04.730583+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.730583+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":600,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:57:53.057219+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3362,"num_read_kb":3070,"num_write":813,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'361","reported_seq":1050,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.669495+0000","last_change":"2024-09-19T15:31:51.669495+0000","last_active":"2024-09-19T15:31:51.669495+0000","last_peered":"2024-09-19T15:31:51.669495+0000","last_clean":"2024-09-19T15:31:51.669495+0000","last_became_active":"2024-09-19T13:40:34.215960+0000","last_became_peered":"2024-09-19T13:40:34.215960+0000","last_unstale":"2024-09-19T15:31:51.669495+0000","last_undegraded":"2024-09-19T15:31:51.669495+0000","last_fullsized":"2024-09-19T15:31:51.669495+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'361","last_scrub_stamp":"2024-09-19T15:31:51.669302+0000","last_deep_scrub":"268'361","last_deep_scrub_stamp":"2024-09-19T15:31:51.669302+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.669302+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:44:16.452038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":684,"num_read_kb":31785,"num_write":1188,"num_write_kb":29902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'840","reported_seq":2398,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.563507+0000","last_change":"2024-09-19T15:32:04.563507+0000","last_active":"2024-09-19T15:32:04.563507+0000","last_peered":"2024-09-19T15:32:04.563507+0000","last_clean":"2024-09-19T15:32:04.563507+0000","last_became_active":"2024-09-19T13:40:36.220563+0000","last_became_peered":"2024-09-19T13:40:36.220563+0000","last_unstale":"2024-09-19T15:32:04.563507+0000","last_undegraded":"2024-09-19T15:32:04.563507+0000","last_fullsized":"2024-09-19T15:32:04.563507+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'840","last_scrub_stamp":"2024-09-19T15:32:04.563306+0000","last_deep_scrub":"268'840","last_deep_scrub_stamp":"2024-09-19T15:32:04.563306+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.563306+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":800,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:04:09.857112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4017,"num_read_kb":3603,"num_write":1098,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'358","reported_seq":1039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.799136+0000","last_change":"2024-09-19T15:32:00.799136+0000","last_active":"2024-09-19T15:32:00.799136+0000","last_peered":"2024-09-19T15:32:00.799136+0000","last_clean":"2024-09-19T15:32:00.799136+0000","last_became_active":"2024-09-19T13:40:34.239843+0000","last_became_peered":"2024-09-19T13:40:34.239843+0000","last_unstale":"2024-09-19T15:32:00.799136+0000","last_undegraded":"2024-09-19T15:32:00.799136+0000","last_fullsized":"2024-09-19T15:32:00.799136+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'358","last_scrub_stamp":"2024-09-19T15:32:00.798848+0000","last_deep_scrub":"268'358","last_deep_scrub_stamp":"2024-09-19T15:32:00.798848+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.798848+0000","objects_scrubbed":7,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:22:42.485481+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136873,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":579,"num_read_kb":4189,"num_write":1155,"num_write_kb":27975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'1557","reported_seq":3234,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.739899+0000","last_change":"2024-09-19T15:32:00.739899+0000","last_active":"2024-09-19T15:32:00.739899+0000","last_peered":"2024-09-19T15:32:00.739899+0000","last_clean":"2024-09-19T15:32:00.739899+0000","last_became_active":"2024-09-19T13:40:36.225954+0000","last_became_peered":"2024-09-19T13:40:36.225954+0000","last_unstale":"2024-09-19T15:32:00.739899+0000","last_undegraded":"2024-09-19T15:32:00.739899+0000","last_fullsized":"2024-09-19T15:32:00.739899+0000","mapping_epoch":27,"log_start":"268'1500","ondisk_log_start":"268'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1557","last_scrub_stamp":"2024-09-19T15:32:00.739686+0000","last_deep_scrub":"268'1557","last_deep_scrub_stamp":"2024-09-19T15:32:00.739686+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.739686+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":1500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:51:44.541143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7021,"num_read_kb":6136,"num_write":2176,"num_write_kb":944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'323","reported_seq":1034,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.653559+0000","last_change":"2024-09-19T15:31:58.653559+0000","last_active":"2024-09-19T15:31:58.653559+0000","last_peered":"2024-09-19T15:31:58.653559+0000","last_clean":"2024-09-19T15:31:58.653559+0000","last_became_active":"2024-09-19T13:40:34.267254+0000","last_became_peered":"2024-09-19T13:40:34.267254+0000","last_unstale":"2024-09-19T15:31:58.653559+0000","last_undegraded":"2024-09-19T15:31:58.653559+0000","last_fullsized":"2024-09-19T15:31:58.653559+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'323","last_scrub_stamp":"2024-09-19T15:31:58.653334+0000","last_deep_scrub":"268'323","last_deep_scrub_stamp":"2024-09-19T15:31:58.653334+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.653334+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:29:03.902030+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":674,"num_read_kb":4762,"num_write":931,"num_write_kb":10224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"268'448","reported_seq":2108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.925601+0000","last_change":"2024-09-19T15:31:58.925601+0000","last_active":"2024-09-19T15:31:58.925601+0000","last_peered":"2024-09-19T15:31:58.925601+0000","last_clean":"2024-09-19T15:31:58.925601+0000","last_became_active":"2024-09-19T13:40:36.220431+0000","last_became_peered":"2024-09-19T13:40:36.220431+0000","last_unstale":"2024-09-19T15:31:58.925601+0000","last_undegraded":"2024-09-19T15:31:58.925601+0000","last_fullsized":"2024-09-19T15:31:58.925601+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'448","last_scrub_stamp":"2024-09-19T15:31:58.925377+0000","last_deep_scrub":"268'448","last_deep_scrub_stamp":"2024-09-19T15:31:58.925377+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.925377+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:32.879919+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2602,"num_read_kb":2484,"num_write":543,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'313","reported_seq":967,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.808520+0000","last_change":"2024-09-19T15:31:59.808520+0000","last_active":"2024-09-19T15:31:59.808520+0000","last_peered":"2024-09-19T15:31:59.808520+0000","last_clean":"2024-09-19T15:31:59.808520+0000","last_became_active":"2024-09-19T13:40:34.218957+0000","last_became_peered":"2024-09-19T13:40:34.218957+0000","last_unstale":"2024-09-19T15:31:59.808520+0000","last_undegraded":"2024-09-19T15:31:59.808520+0000","last_fullsized":"2024-09-19T15:31:59.808520+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'313","last_scrub_stamp":"2024-09-19T15:31:59.808323+0000","last_deep_scrub":"268'313","last_deep_scrub_stamp":"2024-09-19T15:31:59.808323+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.808323+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:28:51.505054+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136870,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":503,"num_read_kb":8139,"num_write":970,"num_write_kb":24727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'797","reported_seq":2568,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.543607+0000","last_change":"2024-09-19T15:32:06.543607+0000","last_active":"2024-09-19T15:32:06.543607+0000","last_peered":"2024-09-19T15:32:06.543607+0000","last_clean":"2024-09-19T15:32:06.543607+0000","last_became_active":"2024-09-19T13:40:36.228785+0000","last_became_peered":"2024-09-19T13:40:36.228785+0000","last_unstale":"2024-09-19T15:32:06.543607+0000","last_undegraded":"2024-09-19T15:32:06.543607+0000","last_fullsized":"2024-09-19T15:32:06.543607+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'797","last_scrub_stamp":"2024-09-19T15:32:06.543396+0000","last_deep_scrub":"268'797","last_deep_scrub_stamp":"2024-09-19T15:32:06.543396+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.543396+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:52:36.348722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4179,"num_read_kb":3830,"num_write":1044,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'342","reported_seq":998,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.666756+0000","last_change":"2024-09-19T15:31:57.666756+0000","last_active":"2024-09-19T15:31:57.666756+0000","last_peered":"2024-09-19T15:31:57.666756+0000","last_clean":"2024-09-19T15:31:57.666756+0000","last_became_active":"2024-09-19T13:40:34.267647+0000","last_became_peered":"2024-09-19T13:40:34.267647+0000","last_unstale":"2024-09-19T15:31:57.666756+0000","last_undegraded":"2024-09-19T15:31:57.666756+0000","last_fullsized":"2024-09-19T15:31:57.666756+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'342","last_scrub_stamp":"2024-09-19T15:31:57.666543+0000","last_deep_scrub":"268'342","last_deep_scrub_stamp":"2024-09-19T15:31:57.666543+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.666543+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:41:13.021177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":19593,"num_write":1075,"num_write_kb":28817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"268'1154","reported_seq":2774,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.631097+0000","last_change":"2024-09-19T13:40:36.231346+0000","last_active":"2024-09-19T15:28:57.631097+0000","last_peered":"2024-09-19T15:28:57.631097+0000","last_clean":"2024-09-19T15:28:57.631097+0000","last_became_active":"2024-09-19T13:40:36.230581+0000","last_became_peered":"2024-09-19T13:40:36.230581+0000","last_unstale":"2024-09-19T15:28:57.631097+0000","last_undegraded":"2024-09-19T15:28:57.631097+0000","last_fullsized":"2024-09-19T15:28:57.631097+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:35.185637+0000","last_clean_scrub_stamp":"2024-09-19T13:40:35.185637+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":1100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:33:28.578391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5418,"num_read_kb":4799,"num_write":1598,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'386","reported_seq":1137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.947499+0000","last_change":"2024-09-19T15:31:55.947499+0000","last_active":"2024-09-19T15:31:55.947499+0000","last_peered":"2024-09-19T15:31:55.947499+0000","last_clean":"2024-09-19T15:31:55.947499+0000","last_became_active":"2024-09-19T13:40:34.237561+0000","last_became_peered":"2024-09-19T13:40:34.237561+0000","last_unstale":"2024-09-19T15:31:55.947499+0000","last_undegraded":"2024-09-19T15:31:55.947499+0000","last_fullsized":"2024-09-19T15:31:55.947499+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'386","last_scrub_stamp":"2024-09-19T15:31:55.947285+0000","last_deep_scrub":"268'386","last_deep_scrub_stamp":"2024-09-19T15:31:55.947285+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.947285+0000","objects_scrubbed":8,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:40:34.514330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136898,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":851,"num_read_kb":72188,"num_write":1180,"num_write_kb":41551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'653","reported_seq":2366,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.862758+0000","last_change":"2024-09-19T15:31:57.862758+0000","last_active":"2024-09-19T15:31:57.862758+0000","last_peered":"2024-09-19T15:31:57.862758+0000","last_clean":"2024-09-19T15:31:57.862758+0000","last_became_active":"2024-09-19T13:40:36.221587+0000","last_became_peered":"2024-09-19T13:40:36.221587+0000","last_unstale":"2024-09-19T15:31:57.862758+0000","last_undegraded":"2024-09-19T15:31:57.862758+0000","last_fullsized":"2024-09-19T15:31:57.862758+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'653","last_scrub_stamp":"2024-09-19T15:31:57.862563+0000","last_deep_scrub":"268'653","last_deep_scrub_stamp":"2024-09-19T15:31:57.862563+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.862563+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":600,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:10:32.434848+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3331,"num_read_kb":3024,"num_write":858,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'1221","reported_seq":3038,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.529541+0000","last_change":"2024-09-19T15:32:03.529541+0000","last_active":"2024-09-19T15:32:03.529541+0000","last_peered":"2024-09-19T15:32:03.529541+0000","last_clean":"2024-09-19T15:32:03.529541+0000","last_became_active":"2024-09-19T13:40:36.220889+0000","last_became_peered":"2024-09-19T13:40:36.220889+0000","last_unstale":"2024-09-19T15:32:03.529541+0000","last_undegraded":"2024-09-19T15:32:03.529541+0000","last_fullsized":"2024-09-19T15:32:03.529541+0000","mapping_epoch":27,"log_start":"268'1200","ondisk_log_start":"268'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1221","last_scrub_stamp":"2024-09-19T15:32:03.529327+0000","last_deep_scrub":"268'1221","last_deep_scrub_stamp":"2024-09-19T15:32:03.529327+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.529327+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":1200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:46.924744+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5895,"num_read_kb":5235,"num_write":1696,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2040,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'416","reported_seq":1154,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.626980+0000","last_change":"2024-09-19T15:31:59.626980+0000","last_active":"2024-09-19T15:31:59.626980+0000","last_peered":"2024-09-19T15:31:59.626980+0000","last_clean":"2024-09-19T15:31:59.626980+0000","last_became_active":"2024-09-19T13:40:34.278991+0000","last_became_peered":"2024-09-19T13:40:34.278991+0000","last_unstale":"2024-09-19T15:31:59.626980+0000","last_undegraded":"2024-09-19T15:31:59.626980+0000","last_fullsized":"2024-09-19T15:31:59.626980+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'416","last_scrub_stamp":"2024-09-19T15:31:59.626756+0000","last_deep_scrub":"268'416","last_deep_scrub_stamp":"2024-09-19T15:31:59.626756+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.626756+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:27:36.553637+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136848,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":967,"num_read_kb":8273,"num_write":1275,"num_write_kb":26935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'1135","reported_seq":2658,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.698161+0000","last_change":"2024-09-19T15:32:03.698161+0000","last_active":"2024-09-19T15:32:03.698161+0000","last_peered":"2024-09-19T15:32:03.698161+0000","last_clean":"2024-09-19T15:32:03.698161+0000","last_became_active":"2024-09-19T13:40:36.233032+0000","last_became_peered":"2024-09-19T13:40:36.233032+0000","last_unstale":"2024-09-19T15:32:03.698161+0000","last_undegraded":"2024-09-19T15:32:03.698161+0000","last_fullsized":"2024-09-19T15:32:03.698161+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1135","last_scrub_stamp":"2024-09-19T15:32:03.697969+0000","last_deep_scrub":"268'1135","last_deep_scrub_stamp":"2024-09-19T15:32:03.697969+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.697969+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":1100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:38.136899+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5185,"num_read_kb":4564,"num_write":1576,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'361","reported_seq":1029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.926301+0000","last_change":"2024-09-19T15:31:54.926301+0000","last_active":"2024-09-19T15:31:54.926301+0000","last_peered":"2024-09-19T15:31:54.926301+0000","last_clean":"2024-09-19T15:31:54.926301+0000","last_became_active":"2024-09-19T13:40:34.257994+0000","last_became_peered":"2024-09-19T13:40:34.257994+0000","last_unstale":"2024-09-19T15:31:54.926301+0000","last_undegraded":"2024-09-19T15:31:54.926301+0000","last_fullsized":"2024-09-19T15:31:54.926301+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'361","last_scrub_stamp":"2024-09-19T15:31:54.925917+0000","last_deep_scrub":"268'361","last_deep_scrub_stamp":"2024-09-19T15:31:54.925917+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.925917+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:27:05.992674+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":609,"num_read_kb":26261,"num_write":1202,"num_write_kb":39497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"268'592","reported_seq":2579,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.748952+0000","last_change":"2024-09-19T15:32:04.748952+0000","last_active":"2024-09-19T15:32:04.748952+0000","last_peered":"2024-09-19T15:32:04.748952+0000","last_clean":"2024-09-19T15:32:04.748952+0000","last_became_active":"2024-09-19T13:40:36.231554+0000","last_became_peered":"2024-09-19T13:40:36.231554+0000","last_unstale":"2024-09-19T15:32:04.748952+0000","last_undegraded":"2024-09-19T15:32:04.748952+0000","last_fullsized":"2024-09-19T15:32:04.748952+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'592","last_scrub_stamp":"2024-09-19T15:32:04.748748+0000","last_deep_scrub":"268'592","last_deep_scrub_stamp":"2024-09-19T15:32:04.748748+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.748748+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":500,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:25.544452+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3450,"num_read_kb":3252,"num_write":736,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2777,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'354","reported_seq":1003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.894244+0000","last_change":"2024-09-19T15:31:51.894244+0000","last_active":"2024-09-19T15:31:51.894244+0000","last_peered":"2024-09-19T15:31:51.894244+0000","last_clean":"2024-09-19T15:31:51.894244+0000","last_became_active":"2024-09-19T13:40:34.264349+0000","last_became_peered":"2024-09-19T13:40:34.264349+0000","last_unstale":"2024-09-19T15:31:51.894244+0000","last_undegraded":"2024-09-19T15:31:51.894244+0000","last_fullsized":"2024-09-19T15:31:51.894244+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'354","last_scrub_stamp":"2024-09-19T15:31:51.894022+0000","last_deep_scrub":"268'354","last_deep_scrub_stamp":"2024-09-19T15:31:51.894022+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.894022+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:08.557909+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":590,"num_read_kb":18139,"num_write":1138,"num_write_kb":28020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'536","reported_seq":2168,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.817859+0000","last_change":"2024-09-19T15:31:56.817859+0000","last_active":"2024-09-19T15:31:56.817859+0000","last_peered":"2024-09-19T15:31:56.817859+0000","last_clean":"2024-09-19T15:31:56.817859+0000","last_became_active":"2024-09-19T13:40:36.221266+0000","last_became_peered":"2024-09-19T13:40:36.221266+0000","last_unstale":"2024-09-19T15:31:56.817859+0000","last_undegraded":"2024-09-19T15:31:56.817859+0000","last_fullsized":"2024-09-19T15:31:56.817859+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'536","last_scrub_stamp":"2024-09-19T15:31:56.817666+0000","last_deep_scrub":"268'536","last_deep_scrub_stamp":"2024-09-19T15:31:56.817666+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.817666+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":500,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:15.258731+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2921,"num_read_kb":2700,"num_write":709,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'351","reported_seq":1207,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.497107+0000","last_change":"2024-09-19T15:31:50.497107+0000","last_active":"2024-09-19T15:31:50.497107+0000","last_peered":"2024-09-19T15:31:50.497107+0000","last_clean":"2024-09-19T15:31:50.497107+0000","last_became_active":"2024-09-19T13:40:34.262084+0000","last_became_peered":"2024-09-19T13:40:34.262084+0000","last_unstale":"2024-09-19T15:31:50.497107+0000","last_undegraded":"2024-09-19T15:31:50.497107+0000","last_fullsized":"2024-09-19T15:31:50.497107+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'351","last_scrub_stamp":"2024-09-19T15:31:50.496887+0000","last_deep_scrub":"268'351","last_deep_scrub_stamp":"2024-09-19T15:31:50.496887+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.496887+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:55:19.272837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1177,"num_read_kb":45013,"num_write":1025,"num_write_kb":26916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"268'462","reported_seq":2076,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.816018+0000","last_change":"2024-09-19T15:31:54.816018+0000","last_active":"2024-09-19T15:31:54.816018+0000","last_peered":"2024-09-19T15:31:54.816018+0000","last_clean":"2024-09-19T15:31:54.816018+0000","last_became_active":"2024-09-19T13:40:36.216082+0000","last_became_peered":"2024-09-19T13:40:36.216082+0000","last_unstale":"2024-09-19T15:31:54.816018+0000","last_undegraded":"2024-09-19T15:31:54.816018+0000","last_fullsized":"2024-09-19T15:31:54.816018+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'462","last_scrub_stamp":"2024-09-19T15:31:54.815843+0000","last_deep_scrub":"268'462","last_deep_scrub_stamp":"2024-09-19T15:31:54.815843+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.815843+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:57.752317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2409,"num_read_kb":2273,"num_write":537,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'339","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.915768+0000","last_change":"2024-09-19T15:31:54.915768+0000","last_active":"2024-09-19T15:31:54.915768+0000","last_peered":"2024-09-19T15:31:54.915768+0000","last_clean":"2024-09-19T15:31:54.915768+0000","last_became_active":"2024-09-19T13:40:34.237589+0000","last_became_peered":"2024-09-19T13:40:34.237589+0000","last_unstale":"2024-09-19T15:31:54.915768+0000","last_undegraded":"2024-09-19T15:31:54.915768+0000","last_fullsized":"2024-09-19T15:31:54.915768+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-19T15:31:54.915566+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-19T15:31:54.915566+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.915566+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:43.777729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":471,"num_read_kb":27580,"num_write":960,"num_write_kb":52672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'578","reported_seq":2271,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.519448+0000","last_change":"2024-09-19T15:32:05.519448+0000","last_active":"2024-09-19T15:32:05.519448+0000","last_peered":"2024-09-19T15:32:05.519448+0000","last_clean":"2024-09-19T15:32:05.519448+0000","last_became_active":"2024-09-19T13:40:36.220183+0000","last_became_peered":"2024-09-19T13:40:36.220183+0000","last_unstale":"2024-09-19T15:32:05.519448+0000","last_undegraded":"2024-09-19T15:32:05.519448+0000","last_fullsized":"2024-09-19T15:32:05.519448+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'578","last_scrub_stamp":"2024-09-19T15:32:05.519220+0000","last_deep_scrub":"268'578","last_deep_scrub_stamp":"2024-09-19T15:32:05.519220+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.519220+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":500,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:28.549608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3052,"num_read_kb":2823,"num_write":743,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'385","reported_seq":1099,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.717970+0000","last_change":"2024-09-19T15:31:52.717970+0000","last_active":"2024-09-19T15:31:52.717970+0000","last_peered":"2024-09-19T15:31:52.717970+0000","last_clean":"2024-09-19T15:31:52.717970+0000","last_became_active":"2024-09-19T13:40:34.224813+0000","last_became_peered":"2024-09-19T13:40:34.224813+0000","last_unstale":"2024-09-19T15:31:52.717970+0000","last_undegraded":"2024-09-19T15:31:52.717970+0000","last_fullsized":"2024-09-19T15:31:52.717970+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'385","last_scrub_stamp":"2024-09-19T15:31:52.717747+0000","last_deep_scrub":"268'385","last_deep_scrub_stamp":"2024-09-19T15:31:52.717747+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.717747+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:25:38.923053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":831,"num_read_kb":1243,"num_write":1485,"num_write_kb":25860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'139","reported_seq":665,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.976690+0000","last_change":"2024-09-19T13:40:44.242817+0000","last_active":"2024-09-19T15:29:50.976690+0000","last_peered":"2024-09-19T15:29:50.976690+0000","last_clean":"2024-09-19T15:29:50.976690+0000","last_became_active":"2024-09-19T13:40:44.242028+0000","last_became_peered":"2024-09-19T13:40:44.242028+0000","last_unstale":"2024-09-19T15:29:50.976690+0000","last_undegraded":"2024-09-19T15:29:50.976690+0000","last_fullsized":"2024-09-19T15:29:50.976690+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":180,"num_write":320,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'410","reported_seq":1942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.052954+0000","last_change":"2024-09-19T15:32:01.052954+0000","last_active":"2024-09-19T15:32:01.052954+0000","last_peered":"2024-09-19T15:32:01.052954+0000","last_clean":"2024-09-19T15:32:01.052954+0000","last_became_active":"2024-09-19T13:40:36.218091+0000","last_became_peered":"2024-09-19T13:40:36.218091+0000","last_unstale":"2024-09-19T15:32:01.052954+0000","last_undegraded":"2024-09-19T15:32:01.052954+0000","last_fullsized":"2024-09-19T15:32:01.052954+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'410","last_scrub_stamp":"2024-09-19T15:32:01.052731+0000","last_deep_scrub":"268'410","last_deep_scrub_stamp":"2024-09-19T15:32:01.052731+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.052731+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:54:24.981092+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2211,"num_read_kb":2096,"num_write":485,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"268'348","reported_seq":990,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.881044+0000","last_change":"2024-09-19T15:31:50.881044+0000","last_active":"2024-09-19T15:31:50.881044+0000","last_peered":"2024-09-19T15:31:50.881044+0000","last_clean":"2024-09-19T15:31:50.881044+0000","last_became_active":"2024-09-19T13:41:05.386216+0000","last_became_peered":"2024-09-19T13:41:05.386216+0000","last_unstale":"2024-09-19T15:31:50.881044+0000","last_undegraded":"2024-09-19T15:31:50.881044+0000","last_fullsized":"2024-09-19T15:31:50.881044+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'348","last_scrub_stamp":"2024-09-19T15:31:50.880838+0000","last_deep_scrub":"268'348","last_deep_scrub_stamp":"2024-09-19T15:31:50.880838+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.880838+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:14.516054+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":616,"num_read_kb":13820,"num_write":1168,"num_write_kb":52710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:27.638258+0000","last_change":"2024-09-19T13:40:38.223574+0000","last_active":"2024-09-19T15:29:27.638258+0000","last_peered":"2024-09-19T15:29:27.638258+0000","last_clean":"2024-09-19T15:29:27.638258+0000","last_became_active":"2024-09-19T13:40:38.222863+0000","last_became_peered":"2024-09-19T13:40:38.222863+0000","last_unstale":"2024-09-19T15:29:27.638258+0000","last_undegraded":"2024-09-19T15:29:27.638258+0000","last_fullsized":"2024-09-19T15:29:27.638258+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'384","reported_seq":1030,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.531280+0000","last_change":"2024-09-19T13:40:40.231128+0000","last_active":"2024-09-19T15:31:39.531280+0000","last_peered":"2024-09-19T15:31:39.531280+0000","last_clean":"2024-09-19T15:31:39.531280+0000","last_became_active":"2024-09-19T13:40:40.230368+0000","last_became_peered":"2024-09-19T13:40:40.230368+0000","last_unstale":"2024-09-19T15:31:39.531280+0000","last_undegraded":"2024-09-19T15:31:39.531280+0000","last_fullsized":"2024-09-19T15:31:39.531280+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46964,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":623,"num_read_kb":1259,"num_write":490,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:27.660205+0000","last_change":"2024-09-19T13:40:42.240924+0000","last_active":"2024-09-19T15:29:27.660205+0000","last_peered":"2024-09-19T15:29:27.660205+0000","last_clean":"2024-09-19T15:29:27.660205+0000","last_became_active":"2024-09-19T13:40:42.240244+0000","last_became_peered":"2024-09-19T13:40:42.240244+0000","last_unstale":"2024-09-19T15:29:27.660205+0000","last_undegraded":"2024-09-19T15:29:27.660205+0000","last_fullsized":"2024-09-19T15:29:27.660205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'2486","reported_seq":4344,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:45.480776+0000","last_change":"2024-09-19T13:40:44.263920+0000","last_active":"2024-09-19T15:29:45.480776+0000","last_peered":"2024-09-19T15:29:45.480776+0000","last_clean":"2024-09-19T15:29:45.480776+0000","last_became_active":"2024-09-19T13:40:44.263152+0000","last_became_peered":"2024-09-19T13:40:44.263152+0000","last_unstale":"2024-09-19T15:29:45.480776+0000","last_undegraded":"2024-09-19T15:29:45.480776+0000","last_fullsized":"2024-09-19T15:29:45.480776+0000","mapping_epoch":35,"log_start":"268'2400","ondisk_log_start":"268'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":2400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:49:06.263897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6208,"num_read_kb":6212,"num_write":5020,"num_write_kb":1848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'370","reported_seq":1876,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.779015+0000","last_change":"2024-09-19T15:32:02.779015+0000","last_active":"2024-09-19T15:32:02.779015+0000","last_peered":"2024-09-19T15:32:02.779015+0000","last_clean":"2024-09-19T15:32:02.779015+0000","last_became_active":"2024-09-19T13:40:36.242260+0000","last_became_peered":"2024-09-19T13:40:36.242260+0000","last_unstale":"2024-09-19T15:32:02.779015+0000","last_undegraded":"2024-09-19T15:32:02.779015+0000","last_fullsized":"2024-09-19T15:32:02.779015+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-19T15:32:02.778799+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-19T15:32:02.778799+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.778799+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:58:11.339987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2141,"num_read_kb":2035,"num_write":405,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'304","reported_seq":966,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:45.643356+0000","last_change":"2024-09-19T15:31:45.643356+0000","last_active":"2024-09-19T15:31:45.643356+0000","last_peered":"2024-09-19T15:31:45.643356+0000","last_clean":"2024-09-19T15:31:45.643356+0000","last_became_active":"2024-09-19T13:40:34.254811+0000","last_became_peered":"2024-09-19T13:40:34.254811+0000","last_unstale":"2024-09-19T15:31:45.643356+0000","last_undegraded":"2024-09-19T15:31:45.643356+0000","last_fullsized":"2024-09-19T15:31:45.643356+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'304","last_scrub_stamp":"2024-09-19T15:31:45.643211+0000","last_deep_scrub":"268'304","last_deep_scrub_stamp":"2024-09-19T15:31:45.643211+0000","last_clean_scrub_stamp":"2024-09-19T15:31:45.643211+0000","objects_scrubbed":8,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:42.025896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":583,"num_read_kb":3104,"num_write":1034,"num_write_kb":15827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:13.233018+0000","last_change":"2024-09-19T13:40:38.234491+0000","last_active":"2024-09-19T15:28:13.233018+0000","last_peered":"2024-09-19T15:28:13.233018+0000","last_clean":"2024-09-19T15:28:13.233018+0000","last_became_active":"2024-09-19T13:40:38.233854+0000","last_became_peered":"2024-09-19T13:40:38.233854+0000","last_unstale":"2024-09-19T15:28:13.233018+0000","last_undegraded":"2024-09-19T15:28:13.233018+0000","last_fullsized":"2024-09-19T15:28:13.233018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:58.032011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'125","reported_seq":694,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.060141+0000","last_change":"2024-09-19T13:40:40.245668+0000","last_active":"2024-09-19T15:31:18.060141+0000","last_peered":"2024-09-19T15:31:18.060141+0000","last_clean":"2024-09-19T15:31:18.060141+0000","last_became_active":"2024-09-19T13:40:40.244841+0000","last_became_peered":"2024-09-19T13:40:40.244841+0000","last_unstale":"2024-09-19T15:31:18.060141+0000","last_undegraded":"2024-09-19T15:31:18.060141+0000","last_fullsized":"2024-09-19T15:31:18.060141+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":152,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:27.618807+0000","last_change":"2024-09-19T13:40:42.235946+0000","last_active":"2024-09-19T15:29:27.618807+0000","last_peered":"2024-09-19T15:29:27.618807+0000","last_clean":"2024-09-19T15:29:27.618807+0000","last_became_active":"2024-09-19T13:40:42.235151+0000","last_became_peered":"2024-09-19T13:40:42.235151+0000","last_unstale":"2024-09-19T15:29:27.618807+0000","last_undegraded":"2024-09-19T15:29:27.618807+0000","last_fullsized":"2024-09-19T15:29:27.618807+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'95","reported_seq":615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:17.181187+0000","last_change":"2024-09-19T13:40:44.263112+0000","last_active":"2024-09-19T15:28:17.181187+0000","last_peered":"2024-09-19T15:28:17.181187+0000","last_clean":"2024-09-19T15:28:17.181187+0000","last_became_active":"2024-09-19T13:40:44.262343+0000","last_became_peered":"2024-09-19T13:40:44.262343+0000","last_unstale":"2024-09-19T15:28:17.181187+0000","last_undegraded":"2024-09-19T15:28:17.181187+0000","last_fullsized":"2024-09-19T15:28:17.181187+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:52.097942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":127,"num_write":220,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'739","reported_seq":2248,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.747931+0000","last_change":"2024-09-19T15:31:56.747931+0000","last_active":"2024-09-19T15:31:56.747931+0000","last_peered":"2024-09-19T15:31:56.747931+0000","last_clean":"2024-09-19T15:31:56.747931+0000","last_became_active":"2024-09-19T13:40:36.225170+0000","last_became_peered":"2024-09-19T13:40:36.225170+0000","last_unstale":"2024-09-19T15:31:56.747931+0000","last_undegraded":"2024-09-19T15:31:56.747931+0000","last_fullsized":"2024-09-19T15:31:56.747931+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'739","last_scrub_stamp":"2024-09-19T15:31:56.747710+0000","last_deep_scrub":"268'739","last_deep_scrub_stamp":"2024-09-19T15:31:56.747710+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.747710+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:45:39.254884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3445,"num_read_kb":3119,"num_write":970,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'347","reported_seq":986,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.754774+0000","last_change":"2024-09-19T15:31:52.754774+0000","last_active":"2024-09-19T15:31:52.754774+0000","last_peered":"2024-09-19T15:31:52.754774+0000","last_clean":"2024-09-19T15:31:52.754774+0000","last_became_active":"2024-09-19T13:40:34.273656+0000","last_became_peered":"2024-09-19T13:40:34.273656+0000","last_unstale":"2024-09-19T15:31:52.754774+0000","last_undegraded":"2024-09-19T15:31:52.754774+0000","last_fullsized":"2024-09-19T15:31:52.754774+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'347","last_scrub_stamp":"2024-09-19T15:31:52.754452+0000","last_deep_scrub":"268'347","last_deep_scrub_stamp":"2024-09-19T15:31:52.754452+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.754452+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:28:40.714033+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136842,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":513,"num_read_kb":12420,"num_write":1036,"num_write_kb":39158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:28.250392+0000","last_change":"2024-09-19T13:40:38.220743+0000","last_active":"2024-09-19T15:29:28.250392+0000","last_peered":"2024-09-19T15:29:28.250392+0000","last_clean":"2024-09-19T15:29:28.250392+0000","last_became_active":"2024-09-19T13:40:38.220474+0000","last_became_peered":"2024-09-19T13:40:38.220474+0000","last_unstale":"2024-09-19T15:29:28.250392+0000","last_undegraded":"2024-09-19T15:29:28.250392+0000","last_fullsized":"2024-09-19T15:29:28.250392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'194","reported_seq":795,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.972239+0000","last_change":"2024-09-19T15:32:02.972239+0000","last_active":"2024-09-19T15:32:02.972239+0000","last_peered":"2024-09-19T15:32:02.972239+0000","last_clean":"2024-09-19T15:32:02.972239+0000","last_became_active":"2024-09-19T13:40:40.247893+0000","last_became_peered":"2024-09-19T13:40:40.247893+0000","last_unstale":"2024-09-19T15:32:02.972239+0000","last_undegraded":"2024-09-19T15:32:02.972239+0000","last_fullsized":"2024-09-19T15:32:02.972239+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'194","last_scrub_stamp":"2024-09-19T15:32:02.971992+0000","last_deep_scrub":"268'194","last_deep_scrub_stamp":"2024-09-19T15:32:02.971992+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.971992+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:29.838775+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":225,"num_write":160,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'761","reported_seq":3181,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.616478+0000","last_change":"2024-09-19T13:40:42.239953+0000","last_active":"2024-09-19T15:31:40.616478+0000","last_peered":"2024-09-19T15:31:40.616478+0000","last_clean":"2024-09-19T15:31:40.616478+0000","last_became_active":"2024-09-19T13:40:42.239059+0000","last_became_peered":"2024-09-19T13:40:42.239059+0000","last_unstale":"2024-09-19T15:31:40.616478+0000","last_undegraded":"2024-09-19T15:31:40.616478+0000","last_fullsized":"2024-09-19T15:31:40.616478+0000","mapping_epoch":33,"log_start":"268'701","ondisk_log_start":"268'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":701,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'225","reported_seq":1068,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:51.070933+0000","last_change":"2024-09-19T13:40:44.278447+0000","last_active":"2024-09-19T15:29:51.070933+0000","last_peered":"2024-09-19T15:29:51.070933+0000","last_clean":"2024-09-19T15:29:51.070933+0000","last_became_active":"2024-09-19T13:40:44.277966+0000","last_became_peered":"2024-09-19T13:40:44.277966+0000","last_unstale":"2024-09-19T15:29:51.070933+0000","last_undegraded":"2024-09-19T15:29:51.070933+0000","last_fullsized":"2024-09-19T15:29:51.070933+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:46.773156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":650,"num_read_kb":649,"num_write":494,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'748","reported_seq":2169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.029942+0000","last_change":"2024-09-19T15:32:00.029942+0000","last_active":"2024-09-19T15:32:00.029942+0000","last_peered":"2024-09-19T15:32:00.029942+0000","last_clean":"2024-09-19T15:32:00.029942+0000","last_became_active":"2024-09-19T13:40:36.238400+0000","last_became_peered":"2024-09-19T13:40:36.238400+0000","last_unstale":"2024-09-19T15:32:00.029942+0000","last_undegraded":"2024-09-19T15:32:00.029942+0000","last_fullsized":"2024-09-19T15:32:00.029942+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'748","last_scrub_stamp":"2024-09-19T15:32:00.029701+0000","last_deep_scrub":"268'748","last_deep_scrub_stamp":"2024-09-19T15:32:00.029701+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.029701+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:17.299402+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3489,"num_read_kb":3124,"num_write":1003,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'393","reported_seq":1083,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.900923+0000","last_change":"2024-09-19T15:31:49.900923+0000","last_active":"2024-09-19T15:31:49.900923+0000","last_peered":"2024-09-19T15:31:49.900923+0000","last_clean":"2024-09-19T15:31:49.900923+0000","last_became_active":"2024-09-19T13:40:34.257596+0000","last_became_peered":"2024-09-19T13:40:34.257596+0000","last_unstale":"2024-09-19T15:31:49.900923+0000","last_undegraded":"2024-09-19T15:31:49.900923+0000","last_fullsized":"2024-09-19T15:31:49.900923+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'393","last_scrub_stamp":"2024-09-19T15:31:49.900735+0000","last_deep_scrub":"268'393","last_deep_scrub_stamp":"2024-09-19T15:31:49.900735+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.900735+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:09.592854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":35384,"num_write":1329,"num_write_kb":23932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:27.638288+0000","last_change":"2024-09-19T13:40:38.212988+0000","last_active":"2024-09-19T15:29:27.638288+0000","last_peered":"2024-09-19T15:29:27.638288+0000","last_clean":"2024-09-19T15:29:27.638288+0000","last_became_active":"2024-09-19T13:40:38.212327+0000","last_became_peered":"2024-09-19T13:40:38.212327+0000","last_unstale":"2024-09-19T15:29:27.638288+0000","last_undegraded":"2024-09-19T15:29:27.638288+0000","last_fullsized":"2024-09-19T15:29:27.638288+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'314","reported_seq":935,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.095387+0000","last_change":"2024-09-19T13:40:40.226231+0000","last_active":"2024-09-19T15:31:39.095387+0000","last_peered":"2024-09-19T15:31:39.095387+0000","last_clean":"2024-09-19T15:31:39.095387+0000","last_became_active":"2024-09-19T13:40:40.225512+0000","last_became_peered":"2024-09-19T13:40:40.225512+0000","last_unstale":"2024-09-19T15:31:39.095387+0000","last_undegraded":"2024-09-19T15:31:39.095387+0000","last_fullsized":"2024-09-19T15:31:39.095387+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43264,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":513,"num_read_kb":1124,"num_write":410,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'789","reported_seq":2996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.553852+0000","last_change":"2024-09-19T13:40:42.264377+0000","last_active":"2024-09-19T15:31:40.553852+0000","last_peered":"2024-09-19T15:31:40.553852+0000","last_clean":"2024-09-19T15:31:40.553852+0000","last_became_active":"2024-09-19T13:40:42.263635+0000","last_became_peered":"2024-09-19T13:40:42.263635+0000","last_unstale":"2024-09-19T15:31:40.553852+0000","last_undegraded":"2024-09-19T15:31:40.553852+0000","last_fullsized":"2024-09-19T15:31:40.553852+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:30.524751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'503","reported_seq":2114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.805627+0000","last_change":"2024-09-19T15:32:01.805627+0000","last_active":"2024-09-19T15:32:01.805627+0000","last_peered":"2024-09-19T15:32:01.805627+0000","last_clean":"2024-09-19T15:32:01.805627+0000","last_became_active":"2024-09-19T13:40:36.235739+0000","last_became_peered":"2024-09-19T13:40:36.235739+0000","last_unstale":"2024-09-19T15:32:01.805627+0000","last_undegraded":"2024-09-19T15:32:01.805627+0000","last_fullsized":"2024-09-19T15:32:01.805627+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'503","last_scrub_stamp":"2024-09-19T15:32:01.805424+0000","last_deep_scrub":"268'503","last_deep_scrub_stamp":"2024-09-19T15:32:01.805424+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.805424+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:33:53.497137+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2574,"num_read_kb":2392,"num_write":618,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'357","reported_seq":1080,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.762833+0000","last_change":"2024-09-19T15:31:53.762833+0000","last_active":"2024-09-19T15:31:53.762833+0000","last_peered":"2024-09-19T15:31:53.762833+0000","last_clean":"2024-09-19T15:31:53.762833+0000","last_became_active":"2024-09-19T13:41:05.309594+0000","last_became_peered":"2024-09-19T13:41:05.309594+0000","last_unstale":"2024-09-19T15:31:53.762833+0000","last_undegraded":"2024-09-19T15:31:53.762833+0000","last_fullsized":"2024-09-19T15:31:53.762833+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'357","last_scrub_stamp":"2024-09-19T15:31:53.762612+0000","last_deep_scrub":"268'357","last_deep_scrub_stamp":"2024-09-19T15:31:53.762612+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.762612+0000","objects_scrubbed":7,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:30:03.838874+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":758,"num_read_kb":65190,"num_write":1172,"num_write_kb":23524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.681085+0000","last_change":"2024-09-19T15:32:07.681085+0000","last_active":"2024-09-19T15:32:07.681085+0000","last_peered":"2024-09-19T15:32:07.681085+0000","last_clean":"2024-09-19T15:32:07.681085+0000","last_became_active":"2024-09-19T13:40:38.233892+0000","last_became_peered":"2024-09-19T13:40:38.233892+0000","last_unstale":"2024-09-19T15:32:07.681085+0000","last_undegraded":"2024-09-19T15:32:07.681085+0000","last_fullsized":"2024-09-19T15:32:07.681085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:07.680900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:07.680900+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.680900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:13.848920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'458","reported_seq":1165,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.812321+0000","last_change":"2024-09-19T13:40:40.233291+0000","last_active":"2024-09-19T15:31:39.812321+0000","last_peered":"2024-09-19T15:31:39.812321+0000","last_clean":"2024-09-19T15:31:39.812321+0000","last_became_active":"2024-09-19T13:40:40.232582+0000","last_became_peered":"2024-09-19T13:40:40.232582+0000","last_unstale":"2024-09-19T15:31:39.812321+0000","last_undegraded":"2024-09-19T15:31:39.812321+0000","last_fullsized":"2024-09-19T15:31:39.812321+0000","mapping_epoch":31,"log_start":"268'400","ondisk_log_start":"268'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:05.930746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44624,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":740,"num_read_kb":1351,"num_write":560,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.388312+0000","last_change":"2024-09-19T13:40:42.240589+0000","last_active":"2024-09-19T15:28:42.388312+0000","last_peered":"2024-09-19T15:28:42.388312+0000","last_clean":"2024-09-19T15:28:42.388312+0000","last_became_active":"2024-09-19T13:40:42.239961+0000","last_became_peered":"2024-09-19T13:40:42.239961+0000","last_unstale":"2024-09-19T15:28:42.388312+0000","last_undegraded":"2024-09-19T15:28:42.388312+0000","last_fullsized":"2024-09-19T15:28:42.388312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:04.578390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'544","reported_seq":1392,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.257388+0000","last_change":"2024-09-19T13:40:44.264532+0000","last_active":"2024-09-19T15:31:13.257388+0000","last_peered":"2024-09-19T15:31:13.257388+0000","last_clean":"2024-09-19T15:31:13.257388+0000","last_became_active":"2024-09-19T13:40:44.263313+0000","last_became_peered":"2024-09-19T13:40:44.263313+0000","last_unstale":"2024-09-19T15:31:13.257388+0000","last_undegraded":"2024-09-19T15:31:13.257388+0000","last_fullsized":"2024-09-19T15:31:13.257388+0000","mapping_epoch":35,"log_start":"268'500","ondisk_log_start":"268'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":500,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:17.459491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1297,"num_read_kb":1297,"num_write":1122,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'467","reported_seq":2122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.456349+0000","last_change":"2024-09-19T15:31:52.456349+0000","last_active":"2024-09-19T15:31:52.456349+0000","last_peered":"2024-09-19T15:31:52.456349+0000","last_clean":"2024-09-19T15:31:52.456349+0000","last_became_active":"2024-09-19T13:40:36.218822+0000","last_became_peered":"2024-09-19T13:40:36.218822+0000","last_unstale":"2024-09-19T15:31:52.456349+0000","last_undegraded":"2024-09-19T15:31:52.456349+0000","last_fullsized":"2024-09-19T15:31:52.456349+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'467","last_scrub_stamp":"2024-09-19T15:31:52.456167+0000","last_deep_scrub":"268'467","last_deep_scrub_stamp":"2024-09-19T15:31:52.456167+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.456167+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:04:13.506665+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2519,"num_read_kb":2376,"num_write":558,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'323","reported_seq":984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.705812+0000","last_change":"2024-09-19T15:31:56.705812+0000","last_active":"2024-09-19T15:31:56.705812+0000","last_peered":"2024-09-19T15:31:56.705812+0000","last_clean":"2024-09-19T15:31:56.705812+0000","last_became_active":"2024-09-19T13:40:34.278684+0000","last_became_peered":"2024-09-19T13:40:34.278684+0000","last_unstale":"2024-09-19T15:31:56.705812+0000","last_undegraded":"2024-09-19T15:31:56.705812+0000","last_fullsized":"2024-09-19T15:31:56.705812+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'323","last_scrub_stamp":"2024-09-19T15:31:56.705455+0000","last_deep_scrub":"268'323","last_deep_scrub_stamp":"2024-09-19T15:31:56.705455+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.705455+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:31:32.186266+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":542,"num_read_kb":16871,"num_write":997,"num_write_kb":22319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.905540+0000","last_change":"2024-09-19T15:31:58.905540+0000","last_active":"2024-09-19T15:31:58.905540+0000","last_peered":"2024-09-19T15:31:58.905540+0000","last_clean":"2024-09-19T15:31:58.905540+0000","last_became_active":"2024-09-19T13:40:38.228765+0000","last_became_peered":"2024-09-19T13:40:38.228765+0000","last_unstale":"2024-09-19T15:31:58.905540+0000","last_undegraded":"2024-09-19T15:31:58.905540+0000","last_fullsized":"2024-09-19T15:31:58.905540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:58.905356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:58.905356+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.905356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:59.885919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'314","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.609856+0000","last_change":"2024-09-19T13:40:40.228045+0000","last_active":"2024-09-19T15:31:40.609856+0000","last_peered":"2024-09-19T15:31:40.609856+0000","last_clean":"2024-09-19T15:31:40.609856+0000","last_became_active":"2024-09-19T13:40:40.226899+0000","last_became_peered":"2024-09-19T13:40:40.226899+0000","last_unstale":"2024-09-19T15:31:40.609856+0000","last_undegraded":"2024-09-19T15:31:40.609856+0000","last_fullsized":"2024-09-19T15:31:40.609856+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:59.398796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46888,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":525,"num_read_kb":1137,"num_write":420,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:13.246852+0000","last_change":"2024-09-19T13:40:42.250224+0000","last_active":"2024-09-19T15:29:13.246852+0000","last_peered":"2024-09-19T15:29:13.246852+0000","last_clean":"2024-09-19T15:29:13.246852+0000","last_became_active":"2024-09-19T13:40:42.245030+0000","last_became_peered":"2024-09-19T13:40:42.245030+0000","last_unstale":"2024-09-19T15:29:13.246852+0000","last_undegraded":"2024-09-19T15:29:13.246852+0000","last_fullsized":"2024-09-19T15:29:13.246852+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:07:01.322432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'125","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:00.457822+0000","last_change":"2024-09-19T13:40:44.254756+0000","last_active":"2024-09-19T15:31:00.457822+0000","last_peered":"2024-09-19T15:31:00.457822+0000","last_clean":"2024-09-19T15:31:00.457822+0000","last_became_active":"2024-09-19T13:40:44.254015+0000","last_became_peered":"2024-09-19T13:40:44.254015+0000","last_unstale":"2024-09-19T15:31:00.457822+0000","last_undegraded":"2024-09-19T15:31:00.457822+0000","last_fullsized":"2024-09-19T15:31:00.457822+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:31:55.327099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":134,"num_write":317,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'414","reported_seq":1984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.921763+0000","last_change":"2024-09-19T15:31:55.921763+0000","last_active":"2024-09-19T15:31:55.921763+0000","last_peered":"2024-09-19T15:31:55.921763+0000","last_clean":"2024-09-19T15:31:55.921763+0000","last_became_active":"2024-09-19T13:42:05.613410+0000","last_became_peered":"2024-09-19T13:42:05.613410+0000","last_unstale":"2024-09-19T15:31:55.921763+0000","last_undegraded":"2024-09-19T15:31:55.921763+0000","last_fullsized":"2024-09-19T15:31:55.921763+0000","mapping_epoch":40,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'414","last_scrub_stamp":"2024-09-19T15:31:55.921598+0000","last_deep_scrub":"268'414","last_deep_scrub_stamp":"2024-09-19T15:31:55.921598+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.921598+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:20.548732+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2294,"num_read_kb":2176,"num_write":469,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'350","reported_seq":1074,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.766022+0000","last_change":"2024-09-19T15:31:51.766022+0000","last_active":"2024-09-19T15:31:51.766022+0000","last_peered":"2024-09-19T15:31:51.766022+0000","last_clean":"2024-09-19T15:31:51.766022+0000","last_became_active":"2024-09-19T13:40:34.268005+0000","last_became_peered":"2024-09-19T13:40:34.268005+0000","last_unstale":"2024-09-19T15:31:51.766022+0000","last_undegraded":"2024-09-19T15:31:51.766022+0000","last_fullsized":"2024-09-19T15:31:51.766022+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'350","last_scrub_stamp":"2024-09-19T15:31:51.765823+0000","last_deep_scrub":"268'350","last_deep_scrub_stamp":"2024-09-19T15:31:51.765823+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.765823+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:50.728579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":754,"num_read_kb":24616,"num_write":1259,"num_write_kb":39661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.937891+0000","last_change":"2024-09-19T15:32:01.937891+0000","last_active":"2024-09-19T15:32:01.937891+0000","last_peered":"2024-09-19T15:32:01.937891+0000","last_clean":"2024-09-19T15:32:01.937891+0000","last_became_active":"2024-09-19T13:40:38.231698+0000","last_became_peered":"2024-09-19T13:40:38.231698+0000","last_unstale":"2024-09-19T15:32:01.937891+0000","last_undegraded":"2024-09-19T15:32:01.937891+0000","last_fullsized":"2024-09-19T15:32:01.937891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:01.937609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:01.937609+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.937609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:29.037967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'393","reported_seq":1055,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.937331+0000","last_change":"2024-09-19T13:40:40.219381+0000","last_active":"2024-09-19T15:31:39.937331+0000","last_peered":"2024-09-19T15:31:39.937331+0000","last_clean":"2024-09-19T15:31:39.937331+0000","last_became_active":"2024-09-19T13:40:40.218529+0000","last_became_peered":"2024-09-19T13:40:40.218529+0000","last_unstale":"2024-09-19T15:31:39.937331+0000","last_undegraded":"2024-09-19T15:31:39.937331+0000","last_fullsized":"2024-09-19T15:31:39.937331+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:35.038776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45323,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":615,"num_read_kb":1192,"num_write":478,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'802","reported_seq":3180,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.127458+0000","last_change":"2024-09-19T13:40:42.238099+0000","last_active":"2024-09-19T15:31:40.127458+0000","last_peered":"2024-09-19T15:31:40.127458+0000","last_clean":"2024-09-19T15:31:40.127458+0000","last_became_active":"2024-09-19T13:40:42.237168+0000","last_became_peered":"2024-09-19T13:40:42.237168+0000","last_unstale":"2024-09-19T15:31:40.127458+0000","last_undegraded":"2024-09-19T15:31:40.127458+0000","last_fullsized":"2024-09-19T15:31:40.127458+0000","mapping_epoch":33,"log_start":"268'701","ondisk_log_start":"268'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":701,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:55.917452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'185","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.287972+0000","last_change":"2024-09-19T13:40:44.262160+0000","last_active":"2024-09-19T15:31:12.287972+0000","last_peered":"2024-09-19T15:31:12.287972+0000","last_clean":"2024-09-19T15:31:12.287972+0000","last_became_active":"2024-09-19T13:40:44.259964+0000","last_became_peered":"2024-09-19T13:40:44.259964+0000","last_unstale":"2024-09-19T15:31:12.287972+0000","last_undegraded":"2024-09-19T15:31:12.287972+0000","last_fullsized":"2024-09-19T15:31:12.287972+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:41:49.811154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":275,"num_read_kb":244,"num_write":336,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'518","reported_seq":2217,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.706807+0000","last_change":"2024-09-19T15:31:55.706807+0000","last_active":"2024-09-19T15:31:55.706807+0000","last_peered":"2024-09-19T15:31:55.706807+0000","last_clean":"2024-09-19T15:31:55.706807+0000","last_became_active":"2024-09-19T13:40:36.221248+0000","last_became_peered":"2024-09-19T13:40:36.221248+0000","last_unstale":"2024-09-19T15:31:55.706807+0000","last_undegraded":"2024-09-19T15:31:55.706807+0000","last_fullsized":"2024-09-19T15:31:55.706807+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'518","last_scrub_stamp":"2024-09-19T15:31:55.706590+0000","last_deep_scrub":"268'518","last_deep_scrub_stamp":"2024-09-19T15:31:55.706590+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.706590+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:26.121902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2802,"num_read_kb":2611,"num_write":645,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'296","reported_seq":950,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.841863+0000","last_change":"2024-09-19T15:31:50.841863+0000","last_active":"2024-09-19T15:31:50.841863+0000","last_peered":"2024-09-19T15:31:50.841863+0000","last_clean":"2024-09-19T15:31:50.841863+0000","last_became_active":"2024-09-19T13:40:34.259994+0000","last_became_peered":"2024-09-19T13:40:34.259994+0000","last_unstale":"2024-09-19T15:31:50.841863+0000","last_undegraded":"2024-09-19T15:31:50.841863+0000","last_fullsized":"2024-09-19T15:31:50.841863+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'296","last_scrub_stamp":"2024-09-19T15:31:50.841553+0000","last_deep_scrub":"268'296","last_deep_scrub_stamp":"2024-09-19T15:31:50.841553+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.841553+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:13.764383+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":7460,"num_write":978,"num_write_kb":22776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.951669+0000","last_change":"2024-09-19T15:32:00.951669+0000","last_active":"2024-09-19T15:32:00.951669+0000","last_peered":"2024-09-19T15:32:00.951669+0000","last_clean":"2024-09-19T15:32:00.951669+0000","last_became_active":"2024-09-19T13:40:38.245245+0000","last_became_peered":"2024-09-19T13:40:38.245245+0000","last_unstale":"2024-09-19T15:32:00.951669+0000","last_undegraded":"2024-09-19T15:32:00.951669+0000","last_fullsized":"2024-09-19T15:32:00.951669+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:00.951493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:00.951493+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.951493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:47.140968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'517","reported_seq":1204,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.700660+0000","last_change":"2024-09-19T15:32:05.700660+0000","last_active":"2024-09-19T15:32:05.700660+0000","last_peered":"2024-09-19T15:32:05.700660+0000","last_clean":"2024-09-19T15:32:05.700660+0000","last_became_active":"2024-09-19T13:40:40.230404+0000","last_became_peered":"2024-09-19T13:40:40.230404+0000","last_unstale":"2024-09-19T15:32:05.700660+0000","last_undegraded":"2024-09-19T15:32:05.700660+0000","last_fullsized":"2024-09-19T15:32:05.700660+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'517","last_scrub_stamp":"2024-09-19T15:32:05.700478+0000","last_deep_scrub":"268'517","last_deep_scrub_stamp":"2024-09-19T15:32:05.700478+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.700478+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:06.189367+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93154,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":887,"num_read_kb":2046,"num_write":714,"num_write_kb":570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.950947+0000","last_change":"2024-09-19T15:32:04.950947+0000","last_active":"2024-09-19T15:32:04.950947+0000","last_peered":"2024-09-19T15:32:04.950947+0000","last_clean":"2024-09-19T15:32:04.950947+0000","last_became_active":"2024-09-19T13:40:42.248721+0000","last_became_peered":"2024-09-19T13:40:42.248721+0000","last_unstale":"2024-09-19T15:32:04.950947+0000","last_undegraded":"2024-09-19T15:32:04.950947+0000","last_fullsized":"2024-09-19T15:32:04.950947+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:04.950740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:04.950740+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.950740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:50:58.634069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'162","reported_seq":711,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:46.507086+0000","last_change":"2024-09-19T13:40:44.256561+0000","last_active":"2024-09-19T15:29:46.507086+0000","last_peered":"2024-09-19T15:29:46.507086+0000","last_clean":"2024-09-19T15:29:46.507086+0000","last_became_active":"2024-09-19T13:40:44.255644+0000","last_became_peered":"2024-09-19T13:40:44.255644+0000","last_unstale":"2024-09-19T15:29:46.507086+0000","last_undegraded":"2024-09-19T15:29:46.507086+0000","last_fullsized":"2024-09-19T15:29:46.507086+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:41.469474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":234,"num_write":369,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'797","reported_seq":2381,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.553171+0000","last_change":"2024-09-19T15:31:59.553171+0000","last_active":"2024-09-19T15:31:59.553171+0000","last_peered":"2024-09-19T15:31:59.553171+0000","last_clean":"2024-09-19T15:31:59.553171+0000","last_became_active":"2024-09-19T13:40:36.231071+0000","last_became_peered":"2024-09-19T13:40:36.231071+0000","last_unstale":"2024-09-19T15:31:59.553171+0000","last_undegraded":"2024-09-19T15:31:59.553171+0000","last_fullsized":"2024-09-19T15:31:59.553171+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'797","last_scrub_stamp":"2024-09-19T15:31:59.552987+0000","last_deep_scrub":"268'797","last_deep_scrub_stamp":"2024-09-19T15:31:59.552987+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.552987+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:12.521548+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3782,"num_read_kb":3405,"num_write":1031,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'344","reported_seq":1008,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.943571+0000","last_change":"2024-09-19T15:31:53.943571+0000","last_active":"2024-09-19T15:31:53.943571+0000","last_peered":"2024-09-19T15:31:53.943571+0000","last_clean":"2024-09-19T15:31:53.943571+0000","last_became_active":"2024-09-19T13:40:34.229859+0000","last_became_peered":"2024-09-19T13:40:34.229859+0000","last_unstale":"2024-09-19T15:31:53.943571+0000","last_undegraded":"2024-09-19T15:31:53.943571+0000","last_fullsized":"2024-09-19T15:31:53.943571+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'344","last_scrub_stamp":"2024-09-19T15:31:53.943359+0000","last_deep_scrub":"268'344","last_deep_scrub_stamp":"2024-09-19T15:31:53.943359+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.943359+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:11:29.492578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":581,"num_read_kb":8832,"num_write":1027,"num_write_kb":25070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.941343+0000","last_change":"2024-09-19T15:31:59.941343+0000","last_active":"2024-09-19T15:31:59.941343+0000","last_peered":"2024-09-19T15:31:59.941343+0000","last_clean":"2024-09-19T15:31:59.941343+0000","last_became_active":"2024-09-19T13:40:38.233312+0000","last_became_peered":"2024-09-19T13:40:38.233312+0000","last_unstale":"2024-09-19T15:31:59.941343+0000","last_undegraded":"2024-09-19T15:31:59.941343+0000","last_fullsized":"2024-09-19T15:31:59.941343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:59.941164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:59.941164+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.941164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:40:15.114932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'329","reported_seq":959,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.602238+0000","last_change":"2024-09-19T13:40:40.248769+0000","last_active":"2024-09-19T15:31:38.602238+0000","last_peered":"2024-09-19T15:31:38.602238+0000","last_clean":"2024-09-19T15:31:38.602238+0000","last_became_active":"2024-09-19T13:40:40.247025+0000","last_became_peered":"2024-09-19T13:40:40.247025+0000","last_unstale":"2024-09-19T15:31:38.602238+0000","last_undegraded":"2024-09-19T15:31:38.602238+0000","last_fullsized":"2024-09-19T15:31:38.602238+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:56.478380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47892,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":557,"num_read_kb":1096,"num_write":476,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:17.195848+0000","last_change":"2024-09-19T13:40:42.244143+0000","last_active":"2024-09-19T15:29:17.195848+0000","last_peered":"2024-09-19T15:29:17.195848+0000","last_clean":"2024-09-19T15:29:17.195848+0000","last_became_active":"2024-09-19T13:40:42.243325+0000","last_became_peered":"2024-09-19T13:40:42.243325+0000","last_unstale":"2024-09-19T15:29:17.195848+0000","last_undegraded":"2024-09-19T15:29:17.195848+0000","last_fullsized":"2024-09-19T15:29:17.195848+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:23.365075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'144","reported_seq":676,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:00.462703+0000","last_change":"2024-09-19T13:40:44.268565+0000","last_active":"2024-09-19T15:31:00.462703+0000","last_peered":"2024-09-19T15:31:00.462703+0000","last_clean":"2024-09-19T15:31:00.462703+0000","last_became_active":"2024-09-19T13:40:44.267716+0000","last_became_peered":"2024-09-19T13:40:44.267716+0000","last_unstale":"2024-09-19T15:31:00.462703+0000","last_undegraded":"2024-09-19T15:31:00.462703+0000","last_fullsized":"2024-09-19T15:31:00.462703+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:15.203052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":190,"num_read_kb":181,"num_write":368,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'1170","reported_seq":2999,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.490117+0000","last_change":"2024-09-19T15:31:53.490117+0000","last_active":"2024-09-19T15:31:53.490117+0000","last_peered":"2024-09-19T15:31:53.490117+0000","last_clean":"2024-09-19T15:31:53.490117+0000","last_became_active":"2024-09-19T13:40:36.216332+0000","last_became_peered":"2024-09-19T13:40:36.216332+0000","last_unstale":"2024-09-19T15:31:53.490117+0000","last_undegraded":"2024-09-19T15:31:53.490117+0000","last_fullsized":"2024-09-19T15:31:53.490117+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1170","last_scrub_stamp":"2024-09-19T15:31:53.489935+0000","last_deep_scrub":"268'1170","last_deep_scrub_stamp":"2024-09-19T15:31:53.489935+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.489935+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":1100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:06.157095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5686,"num_read_kb":5084,"num_write":1563,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1534,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'376","reported_seq":1055,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:46.953114+0000","last_change":"2024-09-19T15:31:46.952878+0000","last_active":"2024-09-19T15:31:46.953114+0000","last_peered":"2024-09-19T15:31:46.953114+0000","last_clean":"2024-09-19T15:31:46.953114+0000","last_became_active":"2024-09-19T13:41:05.314782+0000","last_became_peered":"2024-09-19T13:41:05.314782+0000","last_unstale":"2024-09-19T15:31:46.953114+0000","last_undegraded":"2024-09-19T15:31:46.953114+0000","last_fullsized":"2024-09-19T15:31:46.953114+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'376","last_scrub_stamp":"2024-09-19T15:31:46.952619+0000","last_deep_scrub":"268'376","last_deep_scrub_stamp":"2024-09-19T15:31:46.952619+0000","last_clean_scrub_stamp":"2024-09-19T15:31:46.952619+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:39:58.061630+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":644,"num_read_kb":47078,"num_write":1156,"num_write_kb":40849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.614797+0000","last_change":"2024-09-19T15:32:00.614797+0000","last_active":"2024-09-19T15:32:00.614797+0000","last_peered":"2024-09-19T15:32:00.614797+0000","last_clean":"2024-09-19T15:32:00.614797+0000","last_became_active":"2024-09-19T13:40:38.246684+0000","last_became_peered":"2024-09-19T13:40:38.246684+0000","last_unstale":"2024-09-19T15:32:00.614797+0000","last_undegraded":"2024-09-19T15:32:00.614797+0000","last_fullsized":"2024-09-19T15:32:00.614797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:00.614607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:00.614607+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.614607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:00.446450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'392","reported_seq":1053,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.992019+0000","last_change":"2024-09-19T15:32:03.992019+0000","last_active":"2024-09-19T15:32:03.992019+0000","last_peered":"2024-09-19T15:32:03.992019+0000","last_clean":"2024-09-19T15:32:03.992019+0000","last_became_active":"2024-09-19T13:40:40.221766+0000","last_became_peered":"2024-09-19T13:40:40.221766+0000","last_unstale":"2024-09-19T15:32:03.992019+0000","last_undegraded":"2024-09-19T15:32:03.992019+0000","last_fullsized":"2024-09-19T15:32:03.992019+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'392","last_scrub_stamp":"2024-09-19T15:32:03.991763+0000","last_deep_scrub":"268'392","last_deep_scrub_stamp":"2024-09-19T15:32:03.991763+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.991763+0000","objects_scrubbed":7,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:45.051102+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44832,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":632,"num_read_kb":1260,"num_write":492,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'744","reported_seq":3084,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.931429+0000","last_change":"2024-09-19T15:32:06.931429+0000","last_active":"2024-09-19T15:32:06.931429+0000","last_peered":"2024-09-19T15:32:06.931429+0000","last_clean":"2024-09-19T15:32:06.931429+0000","last_became_active":"2024-09-19T13:40:42.246030+0000","last_became_peered":"2024-09-19T13:40:42.246030+0000","last_unstale":"2024-09-19T15:32:06.931429+0000","last_undegraded":"2024-09-19T15:32:06.931429+0000","last_fullsized":"2024-09-19T15:32:06.931429+0000","mapping_epoch":33,"log_start":"268'702","ondisk_log_start":"268'702","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'744","last_scrub_stamp":"2024-09-19T15:32:06.931254+0000","last_deep_scrub":"268'744","last_deep_scrub_stamp":"2024-09-19T15:32:06.931254+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.931254+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":702,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:22:51.911715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'123","reported_seq":645,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:45.486708+0000","last_change":"2024-09-19T13:40:44.250279+0000","last_active":"2024-09-19T15:29:45.486708+0000","last_peered":"2024-09-19T15:29:45.486708+0000","last_clean":"2024-09-19T15:29:45.486708+0000","last_became_active":"2024-09-19T13:40:44.249529+0000","last_became_peered":"2024-09-19T13:40:44.249529+0000","last_unstale":"2024-09-19T15:29:45.486708+0000","last_undegraded":"2024-09-19T15:29:45.486708+0000","last_fullsized":"2024-09-19T15:29:45.486708+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:10.551071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1650,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":290,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'1318","reported_seq":3136,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.504535+0000","last_change":"2024-09-19T15:31:54.504535+0000","last_active":"2024-09-19T15:31:54.504535+0000","last_peered":"2024-09-19T15:31:54.504535+0000","last_clean":"2024-09-19T15:31:54.504535+0000","last_became_active":"2024-09-19T13:40:36.218760+0000","last_became_peered":"2024-09-19T13:40:36.218760+0000","last_unstale":"2024-09-19T15:31:54.504535+0000","last_undegraded":"2024-09-19T15:31:54.504535+0000","last_fullsized":"2024-09-19T15:31:54.504535+0000","mapping_epoch":27,"log_start":"268'1300","ondisk_log_start":"268'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1318","last_scrub_stamp":"2024-09-19T15:31:54.504354+0000","last_deep_scrub":"268'1318","last_deep_scrub_stamp":"2024-09-19T15:31:54.504354+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.504354+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":1300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:19:34.417947+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6184,"num_read_kb":5469,"num_write":1814,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'395","reported_seq":1112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.562943+0000","last_change":"2024-09-19T15:31:48.562943+0000","last_active":"2024-09-19T15:31:48.562943+0000","last_peered":"2024-09-19T15:31:48.562943+0000","last_clean":"2024-09-19T15:31:48.562943+0000","last_became_active":"2024-09-19T13:40:34.264354+0000","last_became_peered":"2024-09-19T13:40:34.264354+0000","last_unstale":"2024-09-19T15:31:48.562943+0000","last_undegraded":"2024-09-19T15:31:48.562943+0000","last_fullsized":"2024-09-19T15:31:48.562943+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'395","last_scrub_stamp":"2024-09-19T15:31:48.562728+0000","last_deep_scrub":"268'395","last_deep_scrub_stamp":"2024-09-19T15:31:48.562728+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.562728+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:53.759979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":738,"num_read_kb":5537,"num_write":1291,"num_write_kb":30004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1485,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.130834+0000","last_change":"2024-09-19T13:40:38.226450+0000","last_active":"2024-09-19T15:31:38.130834+0000","last_peered":"2024-09-19T15:31:38.130834+0000","last_clean":"2024-09-19T15:31:38.130834+0000","last_became_active":"2024-09-19T13:40:38.225663+0000","last_became_peered":"2024-09-19T13:40:38.225663+0000","last_unstale":"2024-09-19T15:31:38.130834+0000","last_undegraded":"2024-09-19T15:31:38.130834+0000","last_fullsized":"2024-09-19T15:31:38.130834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:47:48.193799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":948,"num_read_kb":948,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'147","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.976337+0000","last_change":"2024-09-19T13:40:40.220948+0000","last_active":"2024-09-19T15:31:17.976337+0000","last_peered":"2024-09-19T15:31:17.976337+0000","last_clean":"2024-09-19T15:31:17.976337+0000","last_became_active":"2024-09-19T13:40:40.220534+0000","last_became_peered":"2024-09-19T13:40:40.220534+0000","last_unstale":"2024-09-19T15:31:17.976337+0000","last_undegraded":"2024-09-19T15:31:17.976337+0000","last_fullsized":"2024-09-19T15:31:17.976337+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:55.268748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":176,"num_write":122,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'765","reported_seq":5689,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.994466+0000","last_change":"2024-09-19T15:32:04.994466+0000","last_active":"2024-09-19T15:32:04.994466+0000","last_peered":"2024-09-19T15:32:04.994466+0000","last_clean":"2024-09-19T15:32:04.994466+0000","last_became_active":"2024-09-19T13:40:42.240074+0000","last_became_peered":"2024-09-19T13:40:42.240074+0000","last_unstale":"2024-09-19T15:32:04.994466+0000","last_undegraded":"2024-09-19T15:32:04.994466+0000","last_fullsized":"2024-09-19T15:32:04.994466+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'765","last_scrub_stamp":"2024-09-19T15:32:04.994274+0000","last_deep_scrub":"268'765","last_deep_scrub_stamp":"2024-09-19T15:32:04.994274+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.994274+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:38.710010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'114","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:07.614003+0000","last_change":"2024-09-19T13:40:44.252306+0000","last_active":"2024-09-19T15:29:07.614003+0000","last_peered":"2024-09-19T15:29:07.614003+0000","last_clean":"2024-09-19T15:29:07.614003+0000","last_became_active":"2024-09-19T13:40:44.251353+0000","last_became_peered":"2024-09-19T13:40:44.251353+0000","last_unstale":"2024-09-19T15:29:07.614003+0000","last_undegraded":"2024-09-19T15:29:07.614003+0000","last_fullsized":"2024-09-19T15:29:07.614003+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:54.088845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'1844","reported_seq":3622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.612221+0000","last_change":"2024-09-19T15:31:56.612221+0000","last_active":"2024-09-19T15:31:56.612221+0000","last_peered":"2024-09-19T15:31:56.612221+0000","last_clean":"2024-09-19T15:31:56.612221+0000","last_became_active":"2024-09-19T13:40:36.221638+0000","last_became_peered":"2024-09-19T13:40:36.221638+0000","last_unstale":"2024-09-19T15:31:56.612221+0000","last_undegraded":"2024-09-19T15:31:56.612221+0000","last_fullsized":"2024-09-19T15:31:56.612221+0000","mapping_epoch":27,"log_start":"268'1800","ondisk_log_start":"268'1800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1844","last_scrub_stamp":"2024-09-19T15:31:56.612043+0000","last_deep_scrub":"268'1844","last_deep_scrub_stamp":"2024-09-19T15:31:56.612043+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.612043+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":1800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:26.022150+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8811,"num_read_kb":7740,"num_write":2693,"num_write_kb":1220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"268'357","reported_seq":1061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.880923+0000","last_change":"2024-09-19T15:31:48.880923+0000","last_active":"2024-09-19T15:31:48.880923+0000","last_peered":"2024-09-19T15:31:48.880923+0000","last_clean":"2024-09-19T15:31:48.880923+0000","last_became_active":"2024-09-19T13:40:34.236257+0000","last_became_peered":"2024-09-19T13:40:34.236257+0000","last_unstale":"2024-09-19T15:31:48.880923+0000","last_undegraded":"2024-09-19T15:31:48.880923+0000","last_fullsized":"2024-09-19T15:31:48.880923+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'357","last_scrub_stamp":"2024-09-19T15:31:48.880705+0000","last_deep_scrub":"268'357","last_deep_scrub_stamp":"2024-09-19T15:31:48.880705+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.880705+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:23.093501+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136845,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":663,"num_read_kb":21601,"num_write":1219,"num_write_kb":27464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:42.608313+0000","last_change":"2024-09-19T13:40:38.236430+0000","last_active":"2024-09-19T15:28:42.608313+0000","last_peered":"2024-09-19T15:28:42.608313+0000","last_clean":"2024-09-19T15:28:42.608313+0000","last_became_active":"2024-09-19T13:40:38.235737+0000","last_became_peered":"2024-09-19T13:40:38.235737+0000","last_unstale":"2024-09-19T15:28:42.608313+0000","last_undegraded":"2024-09-19T15:28:42.608313+0000","last_fullsized":"2024-09-19T15:28:42.608313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:51:01.868972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'549","reported_seq":1242,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.591245+0000","last_change":"2024-09-19T13:40:40.236361+0000","last_active":"2024-09-19T15:31:39.591245+0000","last_peered":"2024-09-19T15:31:39.591245+0000","last_clean":"2024-09-19T15:31:39.591245+0000","last_became_active":"2024-09-19T13:40:40.235679+0000","last_became_peered":"2024-09-19T13:40:40.235679+0000","last_unstale":"2024-09-19T15:31:39.591245+0000","last_undegraded":"2024-09-19T15:31:39.591245+0000","last_fullsized":"2024-09-19T15:31:39.591245+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":500,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:05.212537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50661,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1488,"num_read_kb":2077,"num_write":2114,"num_write_kb":1883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.022561+0000","last_change":"2024-09-19T15:32:04.022561+0000","last_active":"2024-09-19T15:32:04.022561+0000","last_peered":"2024-09-19T15:32:04.022561+0000","last_clean":"2024-09-19T15:32:04.022561+0000","last_became_active":"2024-09-19T13:40:42.250462+0000","last_became_peered":"2024-09-19T13:40:42.250462+0000","last_unstale":"2024-09-19T15:32:04.022561+0000","last_undegraded":"2024-09-19T15:32:04.022561+0000","last_fullsized":"2024-09-19T15:32:04.022561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:04.022361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:04.022361+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.022361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:05.155379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'145","reported_seq":676,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:07.394194+0000","last_change":"2024-09-19T13:40:44.267433+0000","last_active":"2024-09-19T15:29:07.394194+0000","last_peered":"2024-09-19T15:29:07.394194+0000","last_clean":"2024-09-19T15:29:07.394194+0000","last_became_active":"2024-09-19T13:40:44.266642+0000","last_became_peered":"2024-09-19T13:40:44.266642+0000","last_unstale":"2024-09-19T15:29:07.394194+0000","last_undegraded":"2024-09-19T15:29:07.394194+0000","last_fullsized":"2024-09-19T15:29:07.394194+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:58.071145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":208,"num_write":352,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'502","reported_seq":2081,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.895993+0000","last_change":"2024-09-19T15:31:53.895993+0000","last_active":"2024-09-19T15:31:53.895993+0000","last_peered":"2024-09-19T15:31:53.895993+0000","last_clean":"2024-09-19T15:31:53.895993+0000","last_became_active":"2024-09-19T13:40:36.218550+0000","last_became_peered":"2024-09-19T13:40:36.218550+0000","last_unstale":"2024-09-19T15:31:53.895993+0000","last_undegraded":"2024-09-19T15:31:53.895993+0000","last_fullsized":"2024-09-19T15:31:53.895993+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'502","last_scrub_stamp":"2024-09-19T15:31:53.895802+0000","last_deep_scrub":"268'502","last_deep_scrub_stamp":"2024-09-19T15:31:53.895802+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.895802+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:03:34.157384+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2652,"num_read_kb":2446,"num_write":622,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"268'74","reported_seq":663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.790703+0000","last_change":"2024-09-19T15:31:48.790703+0000","last_active":"2024-09-19T15:31:48.790703+0000","last_peered":"2024-09-19T15:31:48.790703+0000","last_clean":"2024-09-19T15:31:48.790703+0000","last_became_active":"2024-09-19T13:40:13.615965+0000","last_became_peered":"2024-09-19T13:40:13.615965+0000","last_unstale":"2024-09-19T15:31:48.790703+0000","last_undegraded":"2024-09-19T15:31:48.790703+0000","last_fullsized":"2024-09-19T15:31:48.790703+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'74","last_scrub_stamp":"2024-09-19T15:31:48.790514+0000","last_deep_scrub":"268'74","last_deep_scrub_stamp":"2024-09-19T15:31:48.790514+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.790514+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:19.499884+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"268'2","reported_seq":575,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.839150+0000","last_change":"2024-09-19T15:31:48.839150+0000","last_active":"2024-09-19T15:31:48.839150+0000","last_peered":"2024-09-19T15:31:48.839150+0000","last_clean":"2024-09-19T15:31:48.839150+0000","last_became_active":"2024-09-19T13:40:20.100760+0000","last_became_peered":"2024-09-19T13:40:20.100760+0000","last_unstale":"2024-09-19T15:31:48.839150+0000","last_undegraded":"2024-09-19T15:31:48.839150+0000","last_fullsized":"2024-09-19T15:31:48.839150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:31:48.838968+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:31:48.838968+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.838968+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:39.704823+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001106569,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'318","reported_seq":1010,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.849582+0000","last_change":"2024-09-19T15:31:47.849582+0000","last_active":"2024-09-19T15:31:47.849582+0000","last_peered":"2024-09-19T15:31:47.849582+0000","last_clean":"2024-09-19T15:31:47.849582+0000","last_became_active":"2024-09-19T13:40:34.241162+0000","last_became_peered":"2024-09-19T13:40:34.241162+0000","last_unstale":"2024-09-19T15:31:47.849582+0000","last_undegraded":"2024-09-19T15:31:47.849582+0000","last_fullsized":"2024-09-19T15:31:47.849582+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'318","last_scrub_stamp":"2024-09-19T15:31:47.849462+0000","last_deep_scrub":"268'318","last_deep_scrub_stamp":"2024-09-19T15:31:47.849462+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.849462+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:11.026243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":104186,"num_write":970,"num_write_kb":16810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":542,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.709741+0000","last_change":"2024-09-19T15:32:05.709741+0000","last_active":"2024-09-19T15:32:05.709741+0000","last_peered":"2024-09-19T15:32:05.709741+0000","last_clean":"2024-09-19T15:32:05.709741+0000","last_became_active":"2024-09-19T13:40:38.231762+0000","last_became_peered":"2024-09-19T13:40:38.231762+0000","last_unstale":"2024-09-19T15:32:05.709741+0000","last_undegraded":"2024-09-19T15:32:05.709741+0000","last_fullsized":"2024-09-19T15:32:05.709741+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:05.709473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:05.709473+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.709473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:16:34.993980+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'756","reported_seq":1515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.311187+0000","last_change":"2024-09-19T13:40:40.240118+0000","last_active":"2024-09-19T15:31:40.311187+0000","last_peered":"2024-09-19T15:31:40.311187+0000","last_clean":"2024-09-19T15:31:40.311187+0000","last_became_active":"2024-09-19T13:40:40.239392+0000","last_became_peered":"2024-09-19T13:40:40.239392+0000","last_unstale":"2024-09-19T15:31:40.311187+0000","last_undegraded":"2024-09-19T15:31:40.311187+0000","last_fullsized":"2024-09-19T15:31:40.311187+0000","mapping_epoch":31,"log_start":"268'700","ondisk_log_start":"268'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:00.876178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146379,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1466,"num_read_kb":3232,"num_write":1394,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.192068+0000","last_change":"2024-09-19T13:40:42.240498+0000","last_active":"2024-09-19T15:29:02.192068+0000","last_peered":"2024-09-19T15:29:02.192068+0000","last_clean":"2024-09-19T15:29:02.192068+0000","last_became_active":"2024-09-19T13:40:42.239749+0000","last_became_peered":"2024-09-19T13:40:42.239749+0000","last_unstale":"2024-09-19T15:29:02.192068+0000","last_undegraded":"2024-09-19T15:29:02.192068+0000","last_fullsized":"2024-09-19T15:29:02.192068+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:55:48.115594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'200","reported_seq":921,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.733071+0000","last_change":"2024-09-19T13:40:44.265188+0000","last_active":"2024-09-19T15:29:50.733071+0000","last_peered":"2024-09-19T15:29:50.733071+0000","last_clean":"2024-09-19T15:29:50.733071+0000","last_became_active":"2024-09-19T13:40:44.264456+0000","last_became_peered":"2024-09-19T13:40:44.264456+0000","last_unstale":"2024-09-19T15:29:50.733071+0000","last_undegraded":"2024-09-19T15:29:50.733071+0000","last_fullsized":"2024-09-19T15:29:50.733071+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:46.004583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":469,"num_write":408,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'754","reported_seq":2277,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.751994+0000","last_change":"2024-09-19T15:31:54.751994+0000","last_active":"2024-09-19T15:31:54.751994+0000","last_peered":"2024-09-19T15:31:54.751994+0000","last_clean":"2024-09-19T15:31:54.751994+0000","last_became_active":"2024-09-19T13:40:36.221186+0000","last_became_peered":"2024-09-19T13:40:36.221186+0000","last_unstale":"2024-09-19T15:31:54.751994+0000","last_undegraded":"2024-09-19T15:31:54.751994+0000","last_fullsized":"2024-09-19T15:31:54.751994+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'754","last_scrub_stamp":"2024-09-19T15:31:54.751805+0000","last_deep_scrub":"268'754","last_deep_scrub_stamp":"2024-09-19T15:31:54.751805+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.751805+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:42:16.653037+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3545,"num_read_kb":3202,"num_write":973,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":570,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.770258+0000","last_change":"2024-09-19T15:31:49.770258+0000","last_active":"2024-09-19T15:31:49.770258+0000","last_peered":"2024-09-19T15:31:49.770258+0000","last_clean":"2024-09-19T15:31:49.770258+0000","last_became_active":"2024-09-19T13:40:20.099608+0000","last_became_peered":"2024-09-19T13:40:20.099608+0000","last_unstale":"2024-09-19T15:31:49.770258+0000","last_undegraded":"2024-09-19T15:31:49.770258+0000","last_fullsized":"2024-09-19T15:31:49.770258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:49.770079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:49.770079+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.770079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:35.739125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001034798,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'310","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:44.606331+0000","last_change":"2024-09-19T15:31:44.606331+0000","last_active":"2024-09-19T15:31:44.606331+0000","last_peered":"2024-09-19T15:31:44.606331+0000","last_clean":"2024-09-19T15:31:44.606331+0000","last_became_active":"2024-09-19T13:40:34.264819+0000","last_became_peered":"2024-09-19T13:40:34.264819+0000","last_unstale":"2024-09-19T15:31:44.606331+0000","last_undegraded":"2024-09-19T15:31:44.606331+0000","last_fullsized":"2024-09-19T15:31:44.606331+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'310","last_scrub_stamp":"2024-09-19T15:31:44.606212+0000","last_deep_scrub":"268'310","last_deep_scrub_stamp":"2024-09-19T15:31:44.606212+0000","last_clean_scrub_stamp":"2024-09-19T15:31:44.606212+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:25:58.694141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":579,"num_read_kb":52358,"num_write":971,"num_write_kb":38982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.632334+0000","last_change":"2024-09-19T13:40:38.223702+0000","last_active":"2024-09-19T15:29:02.632334+0000","last_peered":"2024-09-19T15:29:02.632334+0000","last_clean":"2024-09-19T15:29:02.632334+0000","last_became_active":"2024-09-19T13:40:38.222905+0000","last_became_peered":"2024-09-19T13:40:38.222905+0000","last_unstale":"2024-09-19T15:29:02.632334+0000","last_undegraded":"2024-09-19T15:29:02.632334+0000","last_fullsized":"2024-09-19T15:29:02.632334+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:40:37.494887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'1438","reported_seq":3758,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.670211+0000","last_change":"2024-09-19T13:40:40.241249+0000","last_active":"2024-09-19T15:31:39.670211+0000","last_peered":"2024-09-19T15:31:39.670211+0000","last_clean":"2024-09-19T15:31:39.670211+0000","last_became_active":"2024-09-19T13:40:40.240768+0000","last_became_peered":"2024-09-19T13:40:40.240768+0000","last_unstale":"2024-09-19T15:31:39.670211+0000","last_undegraded":"2024-09-19T15:31:39.670211+0000","last_fullsized":"2024-09-19T15:31:39.670211+0000","mapping_epoch":31,"log_start":"268'1400","ondisk_log_start":"268'1400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:22:28.103563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140168,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2240,"num_read_kb":4108,"num_write":1354,"num_write_kb":1102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:27.660131+0000","last_change":"2024-09-19T13:40:42.252880+0000","last_active":"2024-09-19T15:29:27.660131+0000","last_peered":"2024-09-19T15:29:27.660131+0000","last_clean":"2024-09-19T15:29:27.660131+0000","last_became_active":"2024-09-19T13:40:42.250172+0000","last_became_peered":"2024-09-19T13:40:42.250172+0000","last_unstale":"2024-09-19T15:29:27.660131+0000","last_undegraded":"2024-09-19T15:29:27.660131+0000","last_fullsized":"2024-09-19T15:29:27.660131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:36:32.481597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'250","reported_seq":839,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:41.272502+0000","last_change":"2024-09-19T13:40:44.273159+0000","last_active":"2024-09-19T15:29:41.272502+0000","last_peered":"2024-09-19T15:29:41.272502+0000","last_clean":"2024-09-19T15:29:41.272502+0000","last_became_active":"2024-09-19T13:40:44.272356+0000","last_became_peered":"2024-09-19T13:40:44.272356+0000","last_unstale":"2024-09-19T15:29:41.272502+0000","last_undegraded":"2024-09-19T15:29:41.272502+0000","last_fullsized":"2024-09-19T15:29:41.272502+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":580,"num_read_kb":531,"num_write":551,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'465","reported_seq":2147,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.602220+0000","last_change":"2024-09-19T15:31:54.602220+0000","last_active":"2024-09-19T15:31:54.602220+0000","last_peered":"2024-09-19T15:31:54.602220+0000","last_clean":"2024-09-19T15:31:54.602220+0000","last_became_active":"2024-09-19T13:40:36.241832+0000","last_became_peered":"2024-09-19T13:40:36.241832+0000","last_unstale":"2024-09-19T15:31:54.602220+0000","last_undegraded":"2024-09-19T15:31:54.602220+0000","last_fullsized":"2024-09-19T15:31:54.602220+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'465","last_scrub_stamp":"2024-09-19T15:31:54.602015+0000","last_deep_scrub":"268'465","last_deep_scrub_stamp":"2024-09-19T15:31:54.602015+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.602015+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:16:12.446436+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2706,"num_read_kb":2545,"num_write":558,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":561,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:45.916600+0000","last_change":"2024-09-19T15:31:45.916600+0000","last_active":"2024-09-19T15:31:45.916600+0000","last_peered":"2024-09-19T15:31:45.916600+0000","last_clean":"2024-09-19T15:31:45.916600+0000","last_became_active":"2024-09-19T13:40:20.096900+0000","last_became_peered":"2024-09-19T13:40:20.096900+0000","last_unstale":"2024-09-19T15:31:45.916600+0000","last_undegraded":"2024-09-19T15:31:45.916600+0000","last_fullsized":"2024-09-19T15:31:45.916600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:45.916488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:45.916488+0000","last_clean_scrub_stamp":"2024-09-19T15:31:45.916488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:25:28.228849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00074274699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'333","reported_seq":1004,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:46.591446+0000","last_change":"2024-09-19T15:31:46.591446+0000","last_active":"2024-09-19T15:31:46.591446+0000","last_peered":"2024-09-19T15:31:46.591446+0000","last_clean":"2024-09-19T15:31:46.591446+0000","last_became_active":"2024-09-19T13:40:34.235483+0000","last_became_peered":"2024-09-19T13:40:34.235483+0000","last_unstale":"2024-09-19T15:31:46.591446+0000","last_undegraded":"2024-09-19T15:31:46.591446+0000","last_fullsized":"2024-09-19T15:31:46.591446+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'333","last_scrub_stamp":"2024-09-19T15:31:46.591292+0000","last_deep_scrub":"268'333","last_deep_scrub_stamp":"2024-09-19T15:31:46.591292+0000","last_clean_scrub_stamp":"2024-09-19T15:31:46.591292+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:16.796032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":610,"num_read_kb":5129,"num_write":1002,"num_write_kb":29541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"268'2","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.858708+0000","last_change":"2024-09-19T15:31:55.858708+0000","last_active":"2024-09-19T15:31:55.858708+0000","last_peered":"2024-09-19T15:31:55.858708+0000","last_clean":"2024-09-19T15:31:55.858708+0000","last_became_active":"2024-09-19T13:40:38.228364+0000","last_became_peered":"2024-09-19T13:40:38.228364+0000","last_unstale":"2024-09-19T15:31:55.858708+0000","last_undegraded":"2024-09-19T15:31:55.858708+0000","last_fullsized":"2024-09-19T15:31:55.858708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:31:55.858532+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:31:55.858532+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.858532+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:13:50.260015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'367","reported_seq":2304,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.215985+0000","last_change":"2024-09-19T13:40:40.232258+0000","last_active":"2024-09-19T15:31:18.215985+0000","last_peered":"2024-09-19T15:31:18.215985+0000","last_clean":"2024-09-19T15:31:18.215985+0000","last_became_active":"2024-09-19T13:40:40.231491+0000","last_became_peered":"2024-09-19T13:40:40.231491+0000","last_unstale":"2024-09-19T15:31:18.215985+0000","last_undegraded":"2024-09-19T15:31:18.215985+0000","last_fullsized":"2024-09-19T15:31:18.215985+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:37.420062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":364,"num_read_kb":356,"num_write":351,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.191956+0000","last_change":"2024-09-19T13:40:42.227173+0000","last_active":"2024-09-19T15:29:02.191956+0000","last_peered":"2024-09-19T15:29:02.191956+0000","last_clean":"2024-09-19T15:29:02.191956+0000","last_became_active":"2024-09-19T13:40:42.226706+0000","last_became_peered":"2024-09-19T13:40:42.226706+0000","last_unstale":"2024-09-19T15:29:02.191956+0000","last_undegraded":"2024-09-19T15:29:02.191956+0000","last_fullsized":"2024-09-19T15:29:02.191956+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:12:31.408133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'257","reported_seq":907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:51.222389+0000","last_change":"2024-09-19T13:40:44.241756+0000","last_active":"2024-09-19T15:29:51.222389+0000","last_peered":"2024-09-19T15:29:51.222389+0000","last_clean":"2024-09-19T15:29:51.222389+0000","last_became_active":"2024-09-19T13:40:44.240277+0000","last_became_peered":"2024-09-19T13:40:44.240277+0000","last_unstale":"2024-09-19T15:29:51.222389+0000","last_undegraded":"2024-09-19T15:29:51.222389+0000","last_fullsized":"2024-09-19T15:29:51.222389+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:50.745130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":590,"num_read_kb":596,"num_write":565,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'478","reported_seq":2087,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.589189+0000","last_change":"2024-09-19T15:31:52.589189+0000","last_active":"2024-09-19T15:31:52.589189+0000","last_peered":"2024-09-19T15:31:52.589189+0000","last_clean":"2024-09-19T15:31:52.589189+0000","last_became_active":"2024-09-19T13:40:36.220514+0000","last_became_peered":"2024-09-19T13:40:36.220514+0000","last_unstale":"2024-09-19T15:31:52.589189+0000","last_undegraded":"2024-09-19T15:31:52.589189+0000","last_fullsized":"2024-09-19T15:31:52.589189+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'478","last_scrub_stamp":"2024-09-19T15:31:52.588993+0000","last_deep_scrub":"268'478","last_deep_scrub_stamp":"2024-09-19T15:31:52.588993+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.588993+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:13.983822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2550,"num_read_kb":2381,"num_write":569,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"268'3","reported_seq":576,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.883980+0000","last_change":"2024-09-19T15:31:49.883980+0000","last_active":"2024-09-19T15:31:49.883980+0000","last_peered":"2024-09-19T15:31:49.883980+0000","last_clean":"2024-09-19T15:31:49.883980+0000","last_became_active":"2024-09-19T13:40:20.101198+0000","last_became_peered":"2024-09-19T13:40:20.101198+0000","last_unstale":"2024-09-19T15:31:49.883980+0000","last_undegraded":"2024-09-19T15:31:49.883980+0000","last_fullsized":"2024-09-19T15:31:49.883980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:31:49.883770+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:31:49.883770+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.883770+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:31.078465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0026053059999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'331","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.535052+0000","last_change":"2024-09-19T15:31:49.535052+0000","last_active":"2024-09-19T15:31:49.535052+0000","last_peered":"2024-09-19T15:31:49.535052+0000","last_clean":"2024-09-19T15:31:49.535052+0000","last_became_active":"2024-09-19T13:40:34.228632+0000","last_became_peered":"2024-09-19T13:40:34.228632+0000","last_unstale":"2024-09-19T15:31:49.535052+0000","last_undegraded":"2024-09-19T15:31:49.535052+0000","last_fullsized":"2024-09-19T15:31:49.535052+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'331","last_scrub_stamp":"2024-09-19T15:31:49.534756+0000","last_deep_scrub":"268'331","last_deep_scrub_stamp":"2024-09-19T15:31:49.534756+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.534756+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:30.697194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":586,"num_read_kb":6959,"num_write":997,"num_write_kb":25273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.682193+0000","last_change":"2024-09-19T15:32:02.682193+0000","last_active":"2024-09-19T15:32:02.682193+0000","last_peered":"2024-09-19T15:32:02.682193+0000","last_clean":"2024-09-19T15:32:02.682193+0000","last_became_active":"2024-09-19T13:40:38.229144+0000","last_became_peered":"2024-09-19T13:40:38.229144+0000","last_unstale":"2024-09-19T15:32:02.682193+0000","last_undegraded":"2024-09-19T15:32:02.682193+0000","last_fullsized":"2024-09-19T15:32:02.682193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:02.681899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:02.681899+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.681899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:38:34.444774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'214","reported_seq":829,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.912084+0000","last_change":"2024-09-19T13:40:40.249690+0000","last_active":"2024-09-19T15:31:17.912084+0000","last_peered":"2024-09-19T15:31:17.912084+0000","last_clean":"2024-09-19T15:31:17.912084+0000","last_became_active":"2024-09-19T13:40:40.249102+0000","last_became_peered":"2024-09-19T13:40:40.249102+0000","last_unstale":"2024-09-19T15:31:17.912084+0000","last_undegraded":"2024-09-19T15:31:17.912084+0000","last_fullsized":"2024-09-19T15:31:17.912084+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:37:09.297865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":198,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.976413+0000","last_change":"2024-09-19T15:32:02.976413+0000","last_active":"2024-09-19T15:32:02.976413+0000","last_peered":"2024-09-19T15:32:02.976413+0000","last_clean":"2024-09-19T15:32:02.976413+0000","last_became_active":"2024-09-19T13:40:42.250662+0000","last_became_peered":"2024-09-19T13:40:42.250662+0000","last_unstale":"2024-09-19T15:32:02.976413+0000","last_undegraded":"2024-09-19T15:32:02.976413+0000","last_fullsized":"2024-09-19T15:32:02.976413+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:02.976144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:02.976144+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.976144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:01:47.323179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'126","reported_seq":718,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:43.404178+0000","last_change":"2024-09-19T13:40:44.267544+0000","last_active":"2024-09-19T15:29:43.404178+0000","last_peered":"2024-09-19T15:29:43.404178+0000","last_clean":"2024-09-19T15:29:43.404178+0000","last_became_active":"2024-09-19T13:40:44.266678+0000","last_became_peered":"2024-09-19T13:40:44.266678+0000","last_unstale":"2024-09-19T15:29:43.404178+0000","last_undegraded":"2024-09-19T15:29:43.404178+0000","last_fullsized":"2024-09-19T15:29:43.404178+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:56:44.218291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":283,"num_read_kb":273,"num_write":324,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'763","reported_seq":2298,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.608306+0000","last_change":"2024-09-19T15:31:51.608306+0000","last_active":"2024-09-19T15:31:51.608306+0000","last_peered":"2024-09-19T15:31:51.608306+0000","last_clean":"2024-09-19T15:31:51.608306+0000","last_became_active":"2024-09-19T13:40:36.244403+0000","last_became_peered":"2024-09-19T13:40:36.244403+0000","last_unstale":"2024-09-19T15:31:51.608306+0000","last_undegraded":"2024-09-19T15:31:51.608306+0000","last_fullsized":"2024-09-19T15:31:51.608306+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'763","last_scrub_stamp":"2024-09-19T15:31:51.608119+0000","last_deep_scrub":"268'763","last_deep_scrub_stamp":"2024-09-19T15:31:51.608119+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.608119+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:20:55.798909+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3619,"num_read_kb":3269,"num_write":981,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'331","reported_seq":1054,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.872562+0000","last_change":"2024-09-19T15:31:47.872562+0000","last_active":"2024-09-19T15:31:47.872562+0000","last_peered":"2024-09-19T15:31:47.872562+0000","last_clean":"2024-09-19T15:31:47.872562+0000","last_became_active":"2024-09-19T13:40:34.225452+0000","last_became_peered":"2024-09-19T13:40:34.225452+0000","last_unstale":"2024-09-19T15:31:47.872562+0000","last_undegraded":"2024-09-19T15:31:47.872562+0000","last_fullsized":"2024-09-19T15:31:47.872562+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'331","last_scrub_stamp":"2024-09-19T15:31:47.872337+0000","last_deep_scrub":"268'331","last_deep_scrub_stamp":"2024-09-19T15:31:47.872337+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.872337+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:54:19.173058+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":603,"num_read_kb":97113,"num_write":1108,"num_write_kb":15979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":559,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.574504+0000","last_change":"2024-09-19T15:31:53.574504+0000","last_active":"2024-09-19T15:31:53.574504+0000","last_peered":"2024-09-19T15:31:53.574504+0000","last_clean":"2024-09-19T15:31:53.574504+0000","last_became_active":"2024-09-19T13:40:20.095294+0000","last_became_peered":"2024-09-19T13:40:20.095294+0000","last_unstale":"2024-09-19T15:31:53.574504+0000","last_undegraded":"2024-09-19T15:31:53.574504+0000","last_fullsized":"2024-09-19T15:31:53.574504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:53.574327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:53.574327+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.574327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:10:59.805802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088577700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.695360+0000","last_change":"2024-09-19T15:32:03.695360+0000","last_active":"2024-09-19T15:32:03.695360+0000","last_peered":"2024-09-19T15:32:03.695360+0000","last_clean":"2024-09-19T15:32:03.695360+0000","last_became_active":"2024-09-19T13:40:38.229743+0000","last_became_peered":"2024-09-19T13:40:38.229743+0000","last_unstale":"2024-09-19T15:32:03.695360+0000","last_undegraded":"2024-09-19T15:32:03.695360+0000","last_fullsized":"2024-09-19T15:32:03.695360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:03.695122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:03.695122+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.695122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:24.519149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'629","reported_seq":1372,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.718978+0000","last_change":"2024-09-19T15:32:06.718978+0000","last_active":"2024-09-19T15:32:06.718978+0000","last_peered":"2024-09-19T15:32:06.718978+0000","last_clean":"2024-09-19T15:32:06.718978+0000","last_became_active":"2024-09-19T13:40:40.223632+0000","last_became_peered":"2024-09-19T13:40:40.223632+0000","last_unstale":"2024-09-19T15:32:06.718978+0000","last_undegraded":"2024-09-19T15:32:06.718978+0000","last_fullsized":"2024-09-19T15:32:06.718978+0000","mapping_epoch":31,"log_start":"268'600","ondisk_log_start":"268'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'629","last_scrub_stamp":"2024-09-19T15:32:06.718778+0000","last_deep_scrub":"268'629","last_deep_scrub_stamp":"2024-09-19T15:32:06.718778+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.718778+0000","objects_scrubbed":9,"log_size":29,"log_dups_size":600,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:03:42.317447+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101088,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1063,"num_read_kb":2259,"num_write":846,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4334,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:02.612861+0000","last_change":"2024-09-19T13:40:42.246177+0000","last_active":"2024-09-19T15:29:02.612861+0000","last_peered":"2024-09-19T15:29:02.612861+0000","last_clean":"2024-09-19T15:29:02.612861+0000","last_became_active":"2024-09-19T13:40:42.245476+0000","last_became_peered":"2024-09-19T13:40:42.245476+0000","last_unstale":"2024-09-19T15:29:02.612861+0000","last_undegraded":"2024-09-19T15:29:02.612861+0000","last_fullsized":"2024-09-19T15:29:02.612861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:33:09.183782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'141","reported_seq":679,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:11.923727+0000","last_change":"2024-09-19T13:40:44.275185+0000","last_active":"2024-09-19T15:31:11.923727+0000","last_peered":"2024-09-19T15:31:11.923727+0000","last_clean":"2024-09-19T15:31:11.923727+0000","last_became_active":"2024-09-19T13:40:44.274333+0000","last_became_peered":"2024-09-19T13:40:44.274333+0000","last_unstale":"2024-09-19T15:31:11.923727+0000","last_undegraded":"2024-09-19T15:31:11.923727+0000","last_fullsized":"2024-09-19T15:31:11.923727+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:10.763011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":236,"num_read_kb":218,"num_write":346,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'457","reported_seq":2048,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.718250+0000","last_change":"2024-09-19T15:31:53.718250+0000","last_active":"2024-09-19T15:31:53.718250+0000","last_peered":"2024-09-19T15:31:53.718250+0000","last_clean":"2024-09-19T15:31:53.718250+0000","last_became_active":"2024-09-19T13:40:36.241654+0000","last_became_peered":"2024-09-19T13:40:36.241654+0000","last_unstale":"2024-09-19T15:31:53.718250+0000","last_undegraded":"2024-09-19T15:31:53.718250+0000","last_fullsized":"2024-09-19T15:31:53.718250+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'457","last_scrub_stamp":"2024-09-19T15:31:53.718067+0000","last_deep_scrub":"268'457","last_deep_scrub_stamp":"2024-09-19T15:31:53.718067+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.718067+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:46.154892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2406,"num_read_kb":2267,"num_write":541,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'310","reported_seq":969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.607762+0000","last_change":"2024-09-19T15:31:47.607762+0000","last_active":"2024-09-19T15:31:47.607762+0000","last_peered":"2024-09-19T15:31:47.607762+0000","last_clean":"2024-09-19T15:31:47.607762+0000","last_became_active":"2024-09-19T13:40:34.248944+0000","last_became_peered":"2024-09-19T13:40:34.248944+0000","last_unstale":"2024-09-19T15:31:47.607762+0000","last_undegraded":"2024-09-19T15:31:47.607762+0000","last_fullsized":"2024-09-19T15:31:47.607762+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'310","last_scrub_stamp":"2024-09-19T15:31:47.607553+0000","last_deep_scrub":"268'310","last_deep_scrub_stamp":"2024-09-19T15:31:47.607553+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.607553+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:29.191774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":481,"num_read_kb":60023,"num_write":924,"num_write_kb":13648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":568,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.812139+0000","last_change":"2024-09-19T15:31:50.812139+0000","last_active":"2024-09-19T15:31:50.812139+0000","last_peered":"2024-09-19T15:31:50.812139+0000","last_clean":"2024-09-19T15:31:50.812139+0000","last_became_active":"2024-09-19T13:40:20.096321+0000","last_became_peered":"2024-09-19T13:40:20.096321+0000","last_unstale":"2024-09-19T15:31:50.812139+0000","last_undegraded":"2024-09-19T15:31:50.812139+0000","last_fullsized":"2024-09-19T15:31:50.812139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:50.811952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:50.811952+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.811952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:18:19.479967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001025329,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.917066+0000","last_change":"2024-09-19T15:31:59.917066+0000","last_active":"2024-09-19T15:31:59.917066+0000","last_peered":"2024-09-19T15:31:59.917066+0000","last_clean":"2024-09-19T15:31:59.917066+0000","last_became_active":"2024-09-19T13:40:38.229784+0000","last_became_peered":"2024-09-19T13:40:38.229784+0000","last_unstale":"2024-09-19T15:31:59.917066+0000","last_undegraded":"2024-09-19T15:31:59.917066+0000","last_fullsized":"2024-09-19T15:31:59.917066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:59.916882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:59.916882+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.916882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:52:47.622841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'347","reported_seq":991,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.645649+0000","last_change":"2024-09-19T15:32:04.645649+0000","last_active":"2024-09-19T15:32:04.645649+0000","last_peered":"2024-09-19T15:32:04.645649+0000","last_clean":"2024-09-19T15:32:04.645649+0000","last_became_active":"2024-09-19T13:40:40.239406+0000","last_became_peered":"2024-09-19T13:40:40.239406+0000","last_unstale":"2024-09-19T15:32:04.645649+0000","last_undegraded":"2024-09-19T15:32:04.645649+0000","last_fullsized":"2024-09-19T15:32:04.645649+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'347","last_scrub_stamp":"2024-09-19T15:32:04.645520+0000","last_deep_scrub":"268'347","last_deep_scrub_stamp":"2024-09-19T15:32:04.645520+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.645520+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:32:12.200401+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":438,"num_read_kb":429,"num_write":416,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6602,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'785","reported_seq":3361,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.024171+0000","last_change":"2024-09-19T13:40:42.245618+0000","last_active":"2024-09-19T15:31:40.024171+0000","last_peered":"2024-09-19T15:31:40.024171+0000","last_clean":"2024-09-19T15:31:40.024171+0000","last_became_active":"2024-09-19T13:40:42.244921+0000","last_became_peered":"2024-09-19T13:40:42.244921+0000","last_unstale":"2024-09-19T15:31:40.024171+0000","last_undegraded":"2024-09-19T15:31:40.024171+0000","last_fullsized":"2024-09-19T15:31:40.024171+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:59.793708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'142","reported_seq":702,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.263529+0000","last_change":"2024-09-19T13:40:44.279820+0000","last_active":"2024-09-19T15:31:13.263529+0000","last_peered":"2024-09-19T15:31:13.263529+0000","last_clean":"2024-09-19T15:31:13.263529+0000","last_became_active":"2024-09-19T13:40:44.277602+0000","last_became_peered":"2024-09-19T13:40:44.277602+0000","last_unstale":"2024-09-19T15:31:13.263529+0000","last_undegraded":"2024-09-19T15:31:13.263529+0000","last_fullsized":"2024-09-19T15:31:13.263529+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:34:45.143706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":303,"num_read_kb":269,"num_write":341,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'434","reported_seq":1942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.956165+0000","last_change":"2024-09-19T15:31:56.956165+0000","last_active":"2024-09-19T15:31:56.956165+0000","last_peered":"2024-09-19T15:31:56.956165+0000","last_clean":"2024-09-19T15:31:56.956165+0000","last_became_active":"2024-09-19T13:40:36.235186+0000","last_became_peered":"2024-09-19T13:40:36.235186+0000","last_unstale":"2024-09-19T15:31:56.956165+0000","last_undegraded":"2024-09-19T15:31:56.956165+0000","last_fullsized":"2024-09-19T15:31:56.956165+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'434","last_scrub_stamp":"2024-09-19T15:31:56.955979+0000","last_deep_scrub":"268'434","last_deep_scrub_stamp":"2024-09-19T15:31:56.955979+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.955979+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:06.924774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2268,"num_read_kb":2120,"num_write":492,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'422","reported_seq":1267,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:46.840046+0000","last_change":"2024-09-19T15:31:46.840046+0000","last_active":"2024-09-19T15:31:46.840046+0000","last_peered":"2024-09-19T15:31:46.840046+0000","last_clean":"2024-09-19T15:31:46.840046+0000","last_became_active":"2024-09-19T13:40:34.236325+0000","last_became_peered":"2024-09-19T13:40:34.236325+0000","last_unstale":"2024-09-19T15:31:46.840046+0000","last_undegraded":"2024-09-19T15:31:46.840046+0000","last_fullsized":"2024-09-19T15:31:46.840046+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'422","last_scrub_stamp":"2024-09-19T15:31:46.839904+0000","last_deep_scrub":"268'422","last_deep_scrub_stamp":"2024-09-19T15:31:46.839904+0000","last_clean_scrub_stamp":"2024-09-19T15:31:46.839904+0000","objects_scrubbed":8,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:07.793346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":865,"num_read_kb":111541,"num_write":1317,"num_write_kb":62709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":557,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:45.587206+0000","last_change":"2024-09-19T15:31:45.587206+0000","last_active":"2024-09-19T15:31:45.587206+0000","last_peered":"2024-09-19T15:31:45.587206+0000","last_clean":"2024-09-19T15:31:45.587206+0000","last_became_active":"2024-09-19T13:40:20.101186+0000","last_became_peered":"2024-09-19T13:40:20.101186+0000","last_unstale":"2024-09-19T15:31:45.587206+0000","last_undegraded":"2024-09-19T15:31:45.587206+0000","last_fullsized":"2024-09-19T15:31:45.587206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:45.587128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:45.587128+0000","last_clean_scrub_stamp":"2024-09-19T15:31:45.587128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:24.645925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010323750000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.533455+0000","last_change":"2024-09-19T15:32:07.533455+0000","last_active":"2024-09-19T15:32:07.533455+0000","last_peered":"2024-09-19T15:32:07.533455+0000","last_clean":"2024-09-19T15:32:07.533455+0000","last_became_active":"2024-09-19T13:40:38.235109+0000","last_became_peered":"2024-09-19T13:40:38.235109+0000","last_unstale":"2024-09-19T15:32:07.533455+0000","last_undegraded":"2024-09-19T15:32:07.533455+0000","last_fullsized":"2024-09-19T15:32:07.533455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:07.533271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:07.533271+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.533271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:11:41.966852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'193","reported_seq":793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.185499+0000","last_change":"2024-09-19T13:40:40.248167+0000","last_active":"2024-09-19T15:31:18.185499+0000","last_peered":"2024-09-19T15:31:18.185499+0000","last_clean":"2024-09-19T15:31:18.185499+0000","last_became_active":"2024-09-19T13:40:40.244484+0000","last_became_peered":"2024-09-19T13:40:40.244484+0000","last_unstale":"2024-09-19T15:31:18.185499+0000","last_undegraded":"2024-09-19T15:31:18.185499+0000","last_fullsized":"2024-09-19T15:31:18.185499+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:26.251998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":238,"num_read_kb":228,"num_write":166,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'789","reported_seq":5112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.553678+0000","last_change":"2024-09-19T13:40:42.258379+0000","last_active":"2024-09-19T15:31:40.553678+0000","last_peered":"2024-09-19T15:31:40.553678+0000","last_clean":"2024-09-19T15:31:40.553678+0000","last_became_active":"2024-09-19T13:40:42.257799+0000","last_became_peered":"2024-09-19T13:40:42.257799+0000","last_unstale":"2024-09-19T15:31:40.553678+0000","last_undegraded":"2024-09-19T15:31:40.553678+0000","last_fullsized":"2024-09-19T15:31:40.553678+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:03:48.981520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'191","reported_seq":724,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.522019+0000","last_change":"2024-09-19T13:40:44.259985+0000","last_active":"2024-09-19T15:29:48.522019+0000","last_peered":"2024-09-19T15:29:48.522019+0000","last_clean":"2024-09-19T15:29:48.522019+0000","last_became_active":"2024-09-19T13:40:44.259077+0000","last_became_peered":"2024-09-19T13:40:44.259077+0000","last_unstale":"2024-09-19T15:29:48.522019+0000","last_undegraded":"2024-09-19T15:29:48.522019+0000","last_fullsized":"2024-09-19T15:29:48.522019+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:06:05.199311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":211,"num_read_kb":198,"num_write":423,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'430","reported_seq":1964,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.463133+0000","last_change":"2024-09-19T15:31:51.463133+0000","last_active":"2024-09-19T15:31:51.463133+0000","last_peered":"2024-09-19T15:31:51.463133+0000","last_clean":"2024-09-19T15:31:51.463133+0000","last_became_active":"2024-09-19T13:40:36.242739+0000","last_became_peered":"2024-09-19T13:40:36.242739+0000","last_unstale":"2024-09-19T15:31:51.463133+0000","last_undegraded":"2024-09-19T15:31:51.463133+0000","last_fullsized":"2024-09-19T15:31:51.463133+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'430","last_scrub_stamp":"2024-09-19T15:31:51.462915+0000","last_deep_scrub":"268'430","last_deep_scrub_stamp":"2024-09-19T15:31:51.462915+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.462915+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:56:09.165916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2240,"num_read_kb":2109,"num_write":493,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'308","reported_seq":968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.911724+0000","last_change":"2024-09-19T15:31:47.911724+0000","last_active":"2024-09-19T15:31:47.911724+0000","last_peered":"2024-09-19T15:31:47.911724+0000","last_clean":"2024-09-19T15:31:47.911724+0000","last_became_active":"2024-09-19T13:41:05.316287+0000","last_became_peered":"2024-09-19T13:41:05.316287+0000","last_unstale":"2024-09-19T15:31:47.911724+0000","last_undegraded":"2024-09-19T15:31:47.911724+0000","last_fullsized":"2024-09-19T15:31:47.911724+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'308","last_scrub_stamp":"2024-09-19T15:31:47.911606+0000","last_deep_scrub":"268'308","last_deep_scrub_stamp":"2024-09-19T15:31:47.911606+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.911606+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:23.680919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":643,"num_read_kb":12872,"num_write":1020,"num_write_kb":31603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":554,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.930367+0000","last_change":"2024-09-19T15:31:47.930367+0000","last_active":"2024-09-19T15:31:47.930367+0000","last_peered":"2024-09-19T15:31:47.930367+0000","last_clean":"2024-09-19T15:31:47.930367+0000","last_became_active":"2024-09-19T13:40:20.103134+0000","last_became_peered":"2024-09-19T13:40:20.103134+0000","last_unstale":"2024-09-19T15:31:47.930367+0000","last_undegraded":"2024-09-19T15:31:47.930367+0000","last_fullsized":"2024-09-19T15:31:47.930367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:47.930194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:47.930194+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.930194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:21.433702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093870599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.020103+0000","last_change":"2024-09-19T15:32:07.020103+0000","last_active":"2024-09-19T15:32:07.020103+0000","last_peered":"2024-09-19T15:32:07.020103+0000","last_clean":"2024-09-19T15:32:07.020103+0000","last_became_active":"2024-09-19T13:40:38.221430+0000","last_became_peered":"2024-09-19T13:40:38.221430+0000","last_unstale":"2024-09-19T15:32:07.020103+0000","last_undegraded":"2024-09-19T15:32:07.020103+0000","last_fullsized":"2024-09-19T15:32:07.020103+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:07.019913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:07.019913+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.019913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:54:53.009598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'840","reported_seq":1632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.445033+0000","last_change":"2024-09-19T13:40:40.230230+0000","last_active":"2024-09-19T15:31:39.445033+0000","last_peered":"2024-09-19T15:31:39.445033+0000","last_clean":"2024-09-19T15:31:39.445033+0000","last_became_active":"2024-09-19T13:40:40.229426+0000","last_became_peered":"2024-09-19T13:40:40.229426+0000","last_unstale":"2024-09-19T15:31:39.445033+0000","last_undegraded":"2024-09-19T15:31:39.445033+0000","last_fullsized":"2024-09-19T15:31:39.445033+0000","mapping_epoch":31,"log_start":"268'800","ondisk_log_start":"268'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":800,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:41:10.280326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140545,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1480,"num_read_kb":3413,"num_write":1200,"num_write_kb":946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:03.244490+0000","last_change":"2024-09-19T13:40:42.245759+0000","last_active":"2024-09-19T15:29:03.244490+0000","last_peered":"2024-09-19T15:29:03.244490+0000","last_clean":"2024-09-19T15:29:03.244490+0000","last_became_active":"2024-09-19T13:40:42.244291+0000","last_became_peered":"2024-09-19T13:40:42.244291+0000","last_unstale":"2024-09-19T15:29:03.244490+0000","last_undegraded":"2024-09-19T15:29:03.244490+0000","last_fullsized":"2024-09-19T15:29:03.244490+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:28.425275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'152","reported_seq":709,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:47.628704+0000","last_change":"2024-09-19T13:40:44.274189+0000","last_active":"2024-09-19T15:28:47.628704+0000","last_peered":"2024-09-19T15:28:47.628704+0000","last_clean":"2024-09-19T15:28:47.628704+0000","last_became_active":"2024-09-19T13:40:44.273409+0000","last_became_peered":"2024-09-19T13:40:44.273409+0000","last_unstale":"2024-09-19T15:28:47.628704+0000","last_undegraded":"2024-09-19T15:28:47.628704+0000","last_fullsized":"2024-09-19T15:28:47.628704+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:21.357101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":293,"num_read_kb":268,"num_write":395,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'157","reported_seq":741,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:51.129484+0000","last_change":"2024-09-19T13:40:44.264292+0000","last_active":"2024-09-19T15:29:51.129484+0000","last_peered":"2024-09-19T15:29:51.129484+0000","last_clean":"2024-09-19T15:29:51.129484+0000","last_became_active":"2024-09-19T13:40:44.263575+0000","last_became_peered":"2024-09-19T13:40:44.263575+0000","last_unstale":"2024-09-19T15:29:51.129484+0000","last_undegraded":"2024-09-19T15:29:51.129484+0000","last_fullsized":"2024-09-19T15:29:51.129484+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:21.299012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":274,"num_read_kb":267,"num_write":381,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'492","reported_seq":2283,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.506648+0000","last_change":"2024-09-19T15:31:56.506648+0000","last_active":"2024-09-19T15:31:56.506648+0000","last_peered":"2024-09-19T15:31:56.506648+0000","last_clean":"2024-09-19T15:31:56.506648+0000","last_became_active":"2024-09-19T13:40:36.221019+0000","last_became_peered":"2024-09-19T13:40:36.221019+0000","last_unstale":"2024-09-19T15:31:56.506648+0000","last_undegraded":"2024-09-19T15:31:56.506648+0000","last_fullsized":"2024-09-19T15:31:56.506648+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'492","last_scrub_stamp":"2024-09-19T15:31:56.506455+0000","last_deep_scrub":"268'492","last_deep_scrub_stamp":"2024-09-19T15:31:56.506455+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.506455+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:19.156962+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2720,"num_read_kb":2588,"num_write":552,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'395","reported_seq":1071,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:46.557289+0000","last_change":"2024-09-19T15:31:46.557289+0000","last_active":"2024-09-19T15:31:46.557289+0000","last_peered":"2024-09-19T15:31:46.557289+0000","last_clean":"2024-09-19T15:31:46.557289+0000","last_became_active":"2024-09-19T13:40:34.263276+0000","last_became_peered":"2024-09-19T13:40:34.263276+0000","last_unstale":"2024-09-19T15:31:46.557289+0000","last_undegraded":"2024-09-19T15:31:46.557289+0000","last_fullsized":"2024-09-19T15:31:46.557289+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'395","last_scrub_stamp":"2024-09-19T15:31:46.557001+0000","last_deep_scrub":"268'395","last_deep_scrub_stamp":"2024-09-19T15:31:46.557001+0000","last_clean_scrub_stamp":"2024-09-19T15:31:46.557001+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:39:37.507208+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":686,"num_read_kb":11371,"num_write":1228,"num_write_kb":39217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"268'6","reported_seq":1005,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.615454+0000","last_change":"2024-09-19T15:32:02.615454+0000","last_active":"2024-09-19T15:32:02.615454+0000","last_peered":"2024-09-19T15:32:02.615454+0000","last_clean":"2024-09-19T15:32:02.615454+0000","last_became_active":"2024-09-19T13:40:38.215364+0000","last_became_peered":"2024-09-19T13:40:38.215364+0000","last_unstale":"2024-09-19T15:32:02.615454+0000","last_undegraded":"2024-09-19T15:32:02.615454+0000","last_fullsized":"2024-09-19T15:32:02.615454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-19T15:32:02.615245+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-19T15:32:02.615245+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.615245+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:36.144028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":1184,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'360","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.869781+0000","last_change":"2024-09-19T13:40:40.230669+0000","last_active":"2024-09-19T15:31:39.869781+0000","last_peered":"2024-09-19T15:31:39.869781+0000","last_clean":"2024-09-19T15:31:39.869781+0000","last_became_active":"2024-09-19T13:40:40.229872+0000","last_became_peered":"2024-09-19T13:40:40.229872+0000","last_unstale":"2024-09-19T15:31:39.869781+0000","last_undegraded":"2024-09-19T15:31:39.869781+0000","last_fullsized":"2024-09-19T15:31:39.869781+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:36.305353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":585,"num_read_kb":1412,"num_write":468,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:03.230352+0000","last_change":"2024-09-19T13:40:42.243067+0000","last_active":"2024-09-19T15:28:03.230352+0000","last_peered":"2024-09-19T15:28:03.230352+0000","last_clean":"2024-09-19T15:28:03.230352+0000","last_became_active":"2024-09-19T13:40:42.242368+0000","last_became_peered":"2024-09-19T13:40:42.242368+0000","last_unstale":"2024-09-19T15:28:03.230352+0000","last_undegraded":"2024-09-19T15:28:03.230352+0000","last_fullsized":"2024-09-19T15:28:03.230352+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:59.628504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'121","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:46.522969+0000","last_change":"2024-09-19T13:40:44.269881+0000","last_active":"2024-09-19T15:29:46.522969+0000","last_peered":"2024-09-19T15:29:46.522969+0000","last_clean":"2024-09-19T15:29:46.522969+0000","last_became_active":"2024-09-19T13:40:44.268946+0000","last_became_peered":"2024-09-19T13:40:44.268946+0000","last_unstale":"2024-09-19T15:29:46.522969+0000","last_undegraded":"2024-09-19T15:29:46.522969+0000","last_fullsized":"2024-09-19T15:29:46.522969+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:40.184840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":128,"num_write":265,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'469","reported_seq":2041,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.567600+0000","last_change":"2024-09-19T15:31:57.567600+0000","last_active":"2024-09-19T15:31:57.567600+0000","last_peered":"2024-09-19T15:31:57.567600+0000","last_clean":"2024-09-19T15:31:57.567600+0000","last_became_active":"2024-09-19T13:40:36.226164+0000","last_became_peered":"2024-09-19T13:40:36.226164+0000","last_unstale":"2024-09-19T15:31:57.567600+0000","last_undegraded":"2024-09-19T15:31:57.567600+0000","last_fullsized":"2024-09-19T15:31:57.567600+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'469","last_scrub_stamp":"2024-09-19T15:31:57.567370+0000","last_deep_scrub":"268'469","last_deep_scrub_stamp":"2024-09-19T15:31:57.567370+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.567370+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:50.223505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2492,"num_read_kb":2321,"num_write":561,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'308","reported_seq":1061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.734220+0000","last_change":"2024-09-19T15:31:54.734220+0000","last_active":"2024-09-19T15:31:54.734220+0000","last_peered":"2024-09-19T15:31:54.734220+0000","last_clean":"2024-09-19T15:31:54.734220+0000","last_became_active":"2024-09-19T13:41:05.387779+0000","last_became_peered":"2024-09-19T13:41:05.387779+0000","last_unstale":"2024-09-19T15:31:54.734220+0000","last_undegraded":"2024-09-19T15:31:54.734220+0000","last_fullsized":"2024-09-19T15:31:54.734220+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'308","last_scrub_stamp":"2024-09-19T15:31:54.734020+0000","last_deep_scrub":"268'308","last_deep_scrub_stamp":"2024-09-19T15:31:54.734020+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.734020+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:08.138762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":891,"num_read_kb":29706,"num_write":1011,"num_write_kb":41961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.051796+0000","last_change":"2024-09-19T15:32:08.051796+0000","last_active":"2024-09-19T15:32:08.051796+0000","last_peered":"2024-09-19T15:32:08.051796+0000","last_clean":"2024-09-19T15:32:08.051796+0000","last_became_active":"2024-09-19T13:40:38.228856+0000","last_became_peered":"2024-09-19T13:40:38.228856+0000","last_unstale":"2024-09-19T15:32:08.051796+0000","last_undegraded":"2024-09-19T15:32:08.051796+0000","last_fullsized":"2024-09-19T15:32:08.051796+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:08.051584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:08.051584+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.051584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:44.498532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'85","reported_seq":624,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:17.250690+0000","last_change":"2024-09-19T13:40:40.236243+0000","last_active":"2024-09-19T15:31:17.250690+0000","last_peered":"2024-09-19T15:31:17.250690+0000","last_clean":"2024-09-19T15:31:17.250690+0000","last_became_active":"2024-09-19T13:40:40.235528+0000","last_became_peered":"2024-09-19T13:40:40.235528+0000","last_unstale":"2024-09-19T15:31:17.250690+0000","last_undegraded":"2024-09-19T15:31:17.250690+0000","last_fullsized":"2024-09-19T15:31:17.250690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:33:05.231869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":75,"num_write":58,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.639370+0000","last_change":"2024-09-19T13:40:42.243881+0000","last_active":"2024-09-19T15:28:02.639370+0000","last_peered":"2024-09-19T15:28:02.639370+0000","last_clean":"2024-09-19T15:28:02.639370+0000","last_became_active":"2024-09-19T13:40:42.243224+0000","last_became_peered":"2024-09-19T13:40:42.243224+0000","last_unstale":"2024-09-19T15:28:02.639370+0000","last_undegraded":"2024-09-19T15:28:02.639370+0000","last_fullsized":"2024-09-19T15:28:02.639370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:08:53.998486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'210","reported_seq":756,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:48.410376+0000","last_change":"2024-09-19T13:40:44.259510+0000","last_active":"2024-09-19T15:29:48.410376+0000","last_peered":"2024-09-19T15:29:48.410376+0000","last_clean":"2024-09-19T15:29:48.410376+0000","last_became_active":"2024-09-19T13:40:44.258721+0000","last_became_peered":"2024-09-19T13:40:44.258721+0000","last_unstale":"2024-09-19T15:29:48.410376+0000","last_undegraded":"2024-09-19T15:29:48.410376+0000","last_fullsized":"2024-09-19T15:29:48.410376+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:08.449777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":369,"num_read_kb":358,"num_write":477,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'371","reported_seq":1900,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.999581+0000","last_change":"2024-09-19T15:31:58.999581+0000","last_active":"2024-09-19T15:31:58.999581+0000","last_peered":"2024-09-19T15:31:58.999581+0000","last_clean":"2024-09-19T15:31:58.999581+0000","last_became_active":"2024-09-19T13:40:36.239629+0000","last_became_peered":"2024-09-19T13:40:36.239629+0000","last_unstale":"2024-09-19T15:31:58.999581+0000","last_undegraded":"2024-09-19T15:31:58.999581+0000","last_fullsized":"2024-09-19T15:31:58.999581+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'371","last_scrub_stamp":"2024-09-19T15:31:58.999403+0000","last_deep_scrub":"268'371","last_deep_scrub_stamp":"2024-09-19T15:31:58.999403+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.999403+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:05:57.130902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2075,"num_read_kb":1985,"num_write":419,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'332","reported_seq":1015,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.805753+0000","last_change":"2024-09-19T15:31:51.805753+0000","last_active":"2024-09-19T15:31:51.805753+0000","last_peered":"2024-09-19T15:31:51.805753+0000","last_clean":"2024-09-19T15:31:51.805753+0000","last_became_active":"2024-09-19T13:40:34.256236+0000","last_became_peered":"2024-09-19T13:40:34.256236+0000","last_unstale":"2024-09-19T15:31:51.805753+0000","last_undegraded":"2024-09-19T15:31:51.805753+0000","last_fullsized":"2024-09-19T15:31:51.805753+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'332","last_scrub_stamp":"2024-09-19T15:31:51.805479+0000","last_deep_scrub":"268'332","last_deep_scrub_stamp":"2024-09-19T15:31:51.805479+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.805479+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:20:24.903372+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136863,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":566,"num_read_kb":16816,"num_write":988,"num_write_kb":29952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.715494+0000","last_change":"2024-09-19T15:32:06.715494+0000","last_active":"2024-09-19T15:32:06.715494+0000","last_peered":"2024-09-19T15:32:06.715494+0000","last_clean":"2024-09-19T15:32:06.715494+0000","last_became_active":"2024-09-19T13:40:38.249269+0000","last_became_peered":"2024-09-19T13:40:38.249269+0000","last_unstale":"2024-09-19T15:32:06.715494+0000","last_undegraded":"2024-09-19T15:32:06.715494+0000","last_fullsized":"2024-09-19T15:32:06.715494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:06.715201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:06.715201+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.715201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:37.301841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'357","reported_seq":1006,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.007611+0000","last_change":"2024-09-19T13:40:40.230649+0000","last_active":"2024-09-19T15:31:39.007611+0000","last_peered":"2024-09-19T15:31:39.007611+0000","last_clean":"2024-09-19T15:31:39.007611+0000","last_became_active":"2024-09-19T13:40:40.229852+0000","last_became_peered":"2024-09-19T13:40:40.229852+0000","last_unstale":"2024-09-19T15:31:39.007611+0000","last_undegraded":"2024-09-19T15:31:39.007611+0000","last_fullsized":"2024-09-19T15:31:39.007611+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:48.815571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47808,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":586,"num_read_kb":1181,"num_write":454,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.977985+0000","last_change":"2024-09-19T15:32:05.977985+0000","last_active":"2024-09-19T15:32:05.977985+0000","last_peered":"2024-09-19T15:32:05.977985+0000","last_clean":"2024-09-19T15:32:05.977985+0000","last_became_active":"2024-09-19T13:40:42.240135+0000","last_became_peered":"2024-09-19T13:40:42.240135+0000","last_unstale":"2024-09-19T15:32:05.977985+0000","last_undegraded":"2024-09-19T15:32:05.977985+0000","last_fullsized":"2024-09-19T15:32:05.977985+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:05.977797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:05.977797+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.977797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:47:40.751125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'85","reported_seq":635,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:45.986381+0000","last_change":"2024-09-19T13:40:44.269896+0000","last_active":"2024-09-19T15:28:45.986381+0000","last_peered":"2024-09-19T15:28:45.986381+0000","last_clean":"2024-09-19T15:28:45.986381+0000","last_became_active":"2024-09-19T13:40:44.269134+0000","last_became_peered":"2024-09-19T13:40:44.269134+0000","last_unstale":"2024-09-19T15:28:45.986381+0000","last_undegraded":"2024-09-19T15:28:45.986381+0000","last_fullsized":"2024-09-19T15:28:45.986381+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:09.390631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":160,"num_write":196,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'611","reported_seq":2435,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.975666+0000","last_change":"2024-09-19T15:31:57.975666+0000","last_active":"2024-09-19T15:31:57.975666+0000","last_peered":"2024-09-19T15:31:57.975666+0000","last_clean":"2024-09-19T15:31:57.975666+0000","last_became_active":"2024-09-19T13:40:36.217925+0000","last_became_peered":"2024-09-19T13:40:36.217925+0000","last_unstale":"2024-09-19T15:31:57.975666+0000","last_undegraded":"2024-09-19T15:31:57.975666+0000","last_fullsized":"2024-09-19T15:31:57.975666+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'611","last_scrub_stamp":"2024-09-19T15:31:57.975494+0000","last_deep_scrub":"268'611","last_deep_scrub_stamp":"2024-09-19T15:31:57.975494+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.975494+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":600,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:29.200346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3256,"num_read_kb":3011,"num_write":769,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'364","reported_seq":1028,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:46.648604+0000","last_change":"2024-09-19T15:31:46.648440+0000","last_active":"2024-09-19T15:31:46.648604+0000","last_peered":"2024-09-19T15:31:46.648604+0000","last_clean":"2024-09-19T15:31:46.648604+0000","last_became_active":"2024-09-19T13:40:34.227791+0000","last_became_peered":"2024-09-19T13:40:34.227791+0000","last_unstale":"2024-09-19T15:31:46.648604+0000","last_undegraded":"2024-09-19T15:31:46.648604+0000","last_fullsized":"2024-09-19T15:31:46.648604+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'364","last_scrub_stamp":"2024-09-19T15:31:46.648241+0000","last_deep_scrub":"268'364","last_deep_scrub_stamp":"2024-09-19T15:31:46.648241+0000","last_clean_scrub_stamp":"2024-09-19T15:31:46.648241+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:28:35.850047+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":536,"num_read_kb":35857,"num_write":1057,"num_write_kb":31805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.930353+0000","last_change":"2024-09-19T15:32:00.930353+0000","last_active":"2024-09-19T15:32:00.930353+0000","last_peered":"2024-09-19T15:32:00.930353+0000","last_clean":"2024-09-19T15:32:00.930353+0000","last_became_active":"2024-09-19T13:40:38.246129+0000","last_became_peered":"2024-09-19T13:40:38.246129+0000","last_unstale":"2024-09-19T15:32:00.930353+0000","last_undegraded":"2024-09-19T15:32:00.930353+0000","last_fullsized":"2024-09-19T15:32:00.930353+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:00.930173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:00.930173+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.930173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:14:00.787540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'315","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.767910+0000","last_change":"2024-09-19T13:40:40.219645+0000","last_active":"2024-09-19T15:31:38.767910+0000","last_peered":"2024-09-19T15:31:38.767910+0000","last_clean":"2024-09-19T15:31:38.767910+0000","last_became_active":"2024-09-19T13:40:40.218434+0000","last_became_peered":"2024-09-19T13:40:40.218434+0000","last_unstale":"2024-09-19T15:31:38.767910+0000","last_undegraded":"2024-09-19T15:31:38.767910+0000","last_fullsized":"2024-09-19T15:31:38.767910+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:27.205776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44825,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":1129,"num_write":414,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.178023+0000","last_change":"2024-09-19T13:40:42.240830+0000","last_active":"2024-09-19T15:28:02.178023+0000","last_peered":"2024-09-19T15:28:02.178023+0000","last_clean":"2024-09-19T15:28:02.178023+0000","last_became_active":"2024-09-19T13:40:42.238908+0000","last_became_peered":"2024-09-19T13:40:42.238908+0000","last_unstale":"2024-09-19T15:28:02.178023+0000","last_undegraded":"2024-09-19T15:28:02.178023+0000","last_fullsized":"2024-09-19T15:28:02.178023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:27.434117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'524","reported_seq":2148,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.913104+0000","last_change":"2024-09-19T15:31:56.913104+0000","last_active":"2024-09-19T15:31:56.913104+0000","last_peered":"2024-09-19T15:31:56.913104+0000","last_clean":"2024-09-19T15:31:56.913104+0000","last_became_active":"2024-09-19T13:40:36.243653+0000","last_became_peered":"2024-09-19T13:40:36.243653+0000","last_unstale":"2024-09-19T15:31:56.913104+0000","last_undegraded":"2024-09-19T15:31:56.913104+0000","last_fullsized":"2024-09-19T15:31:56.913104+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'524","last_scrub_stamp":"2024-09-19T15:31:56.912913+0000","last_deep_scrub":"268'524","last_deep_scrub_stamp":"2024-09-19T15:31:56.912913+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.912913+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:58.666306+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2759,"num_read_kb":2556,"num_write":676,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'358","reported_seq":1009,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.920601+0000","last_change":"2024-09-19T15:31:52.920601+0000","last_active":"2024-09-19T15:31:52.920601+0000","last_peered":"2024-09-19T15:31:52.920601+0000","last_clean":"2024-09-19T15:31:52.920601+0000","last_became_active":"2024-09-19T13:40:34.219131+0000","last_became_peered":"2024-09-19T13:40:34.219131+0000","last_unstale":"2024-09-19T15:31:52.920601+0000","last_undegraded":"2024-09-19T15:31:52.920601+0000","last_fullsized":"2024-09-19T15:31:52.920601+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'358","last_scrub_stamp":"2024-09-19T15:31:52.920370+0000","last_deep_scrub":"268'358","last_deep_scrub_stamp":"2024-09-19T15:31:52.920370+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.920370+0000","objects_scrubbed":6,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:04.736453+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273703,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":16977,"num_write":1175,"num_write_kb":67471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.685857+0000","last_change":"2024-09-19T15:32:04.685857+0000","last_active":"2024-09-19T15:32:04.685857+0000","last_peered":"2024-09-19T15:32:04.685857+0000","last_clean":"2024-09-19T15:32:04.685857+0000","last_became_active":"2024-09-19T13:40:38.231992+0000","last_became_peered":"2024-09-19T13:40:38.231992+0000","last_unstale":"2024-09-19T15:32:04.685857+0000","last_undegraded":"2024-09-19T15:32:04.685857+0000","last_fullsized":"2024-09-19T15:32:04.685857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:04.685669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:04.685669+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.685669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:07:07.380312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'568","reported_seq":1247,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.642848+0000","last_change":"2024-09-19T15:32:06.642848+0000","last_active":"2024-09-19T15:32:06.642848+0000","last_peered":"2024-09-19T15:32:06.642848+0000","last_clean":"2024-09-19T15:32:06.642848+0000","last_became_active":"2024-09-19T13:40:40.241045+0000","last_became_peered":"2024-09-19T13:40:40.241045+0000","last_unstale":"2024-09-19T15:32:06.642848+0000","last_undegraded":"2024-09-19T15:32:06.642848+0000","last_fullsized":"2024-09-19T15:32:06.642848+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'568","last_scrub_stamp":"2024-09-19T15:32:06.642662+0000","last_deep_scrub":"268'568","last_deep_scrub_stamp":"2024-09-19T15:32:06.642662+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.642662+0000","objects_scrubbed":7,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:33.019641+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102495,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":998,"num_read_kb":2312,"num_write":864,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":522,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.620732+0000","last_change":"2024-09-19T13:40:42.266732+0000","last_active":"2024-09-19T15:28:12.620732+0000","last_peered":"2024-09-19T15:28:12.620732+0000","last_clean":"2024-09-19T15:28:12.620732+0000","last_became_active":"2024-09-19T13:40:42.266161+0000","last_became_peered":"2024-09-19T13:40:42.266161+0000","last_unstale":"2024-09-19T15:28:12.620732+0000","last_undegraded":"2024-09-19T15:28:12.620732+0000","last_fullsized":"2024-09-19T15:28:12.620732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:36.831314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'153","reported_seq":684,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:08.231621+0000","last_change":"2024-09-19T13:40:44.280809+0000","last_active":"2024-09-19T15:28:08.231621+0000","last_peered":"2024-09-19T15:28:08.231621+0000","last_clean":"2024-09-19T15:28:08.231621+0000","last_became_active":"2024-09-19T13:40:44.280362+0000","last_became_peered":"2024-09-19T13:40:44.280362+0000","last_unstale":"2024-09-19T15:28:08.231621+0000","last_undegraded":"2024-09-19T15:28:08.231621+0000","last_fullsized":"2024-09-19T15:28:08.231621+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:26:28.134421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":216,"num_read_kb":226,"num_write":329,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'909","reported_seq":2615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.735293+0000","last_change":"2024-09-19T15:31:57.735293+0000","last_active":"2024-09-19T15:31:57.735293+0000","last_peered":"2024-09-19T15:31:57.735293+0000","last_clean":"2024-09-19T15:31:57.735293+0000","last_became_active":"2024-09-19T13:40:36.234428+0000","last_became_peered":"2024-09-19T13:40:36.234428+0000","last_unstale":"2024-09-19T15:31:57.735293+0000","last_undegraded":"2024-09-19T15:31:57.735293+0000","last_fullsized":"2024-09-19T15:31:57.735293+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'909","last_scrub_stamp":"2024-09-19T15:31:57.735111+0000","last_deep_scrub":"268'909","last_deep_scrub_stamp":"2024-09-19T15:31:57.735111+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.735111+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":800,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:43:16.615480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4426,"num_read_kb":3975,"num_write":1248,"num_write_kb":508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'387","reported_seq":1105,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.658391+0000","last_change":"2024-09-19T15:31:49.658391+0000","last_active":"2024-09-19T15:31:49.658391+0000","last_peered":"2024-09-19T15:31:49.658391+0000","last_clean":"2024-09-19T15:31:49.658391+0000","last_became_active":"2024-09-19T13:40:34.249719+0000","last_became_peered":"2024-09-19T13:40:34.249719+0000","last_unstale":"2024-09-19T15:31:49.658391+0000","last_undegraded":"2024-09-19T15:31:49.658391+0000","last_fullsized":"2024-09-19T15:31:49.658391+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'387","last_scrub_stamp":"2024-09-19T15:31:49.658119+0000","last_deep_scrub":"268'387","last_deep_scrub_stamp":"2024-09-19T15:31:49.658119+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.658119+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:45.295555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2165812,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":691,"num_read_kb":108324,"num_write":1302,"num_write_kb":34137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"268'4","reported_seq":1009,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.964764+0000","last_change":"2024-09-19T15:32:01.964764+0000","last_active":"2024-09-19T15:32:01.964764+0000","last_peered":"2024-09-19T15:32:01.964764+0000","last_clean":"2024-09-19T15:32:01.964764+0000","last_became_active":"2024-09-19T13:40:38.245835+0000","last_became_peered":"2024-09-19T13:40:38.245835+0000","last_unstale":"2024-09-19T15:32:01.964764+0000","last_undegraded":"2024-09-19T15:32:01.964764+0000","last_fullsized":"2024-09-19T15:32:01.964764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-19T15:32:01.964584+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-19T15:32:01.964584+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.964584+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:59:35.197432+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":719,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'387","reported_seq":1042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.840198+0000","last_change":"2024-09-19T13:40:40.238081+0000","last_active":"2024-09-19T15:31:38.840198+0000","last_peered":"2024-09-19T15:31:38.840198+0000","last_clean":"2024-09-19T15:31:38.840198+0000","last_became_active":"2024-09-19T13:40:40.237537+0000","last_became_peered":"2024-09-19T13:40:40.237537+0000","last_unstale":"2024-09-19T15:31:38.840198+0000","last_undegraded":"2024-09-19T15:31:38.840198+0000","last_fullsized":"2024-09-19T15:31:38.840198+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:45.292548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49094,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":653,"num_read_kb":1263,"num_write":536,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381450+0000","last_change":"2024-09-19T13:40:42.252696+0000","last_active":"2024-09-19T15:28:12.381450+0000","last_peered":"2024-09-19T15:28:12.381450+0000","last_clean":"2024-09-19T15:28:12.381450+0000","last_became_active":"2024-09-19T13:40:42.251896+0000","last_became_peered":"2024-09-19T13:40:42.251896+0000","last_unstale":"2024-09-19T15:28:12.381450+0000","last_undegraded":"2024-09-19T15:28:12.381450+0000","last_fullsized":"2024-09-19T15:28:12.381450+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:17:38.583676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'201","reported_seq":1087,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:43.276093+0000","last_change":"2024-09-19T13:40:44.269379+0000","last_active":"2024-09-19T15:29:43.276093+0000","last_peered":"2024-09-19T15:29:43.276093+0000","last_clean":"2024-09-19T15:29:43.276093+0000","last_became_active":"2024-09-19T13:40:44.268710+0000","last_became_peered":"2024-09-19T13:40:44.268710+0000","last_unstale":"2024-09-19T15:29:43.276093+0000","last_undegraded":"2024-09-19T15:29:43.276093+0000","last_fullsized":"2024-09-19T15:29:43.276093+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:25.122775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":655,"num_read_kb":652,"num_write":565,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'581","reported_seq":2271,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.008735+0000","last_change":"2024-09-19T15:32:05.008735+0000","last_active":"2024-09-19T15:32:05.008735+0000","last_peered":"2024-09-19T15:32:05.008735+0000","last_clean":"2024-09-19T15:32:05.008735+0000","last_became_active":"2024-09-19T13:40:36.217961+0000","last_became_peered":"2024-09-19T13:40:36.217961+0000","last_unstale":"2024-09-19T15:32:05.008735+0000","last_undegraded":"2024-09-19T15:32:05.008735+0000","last_fullsized":"2024-09-19T15:32:05.008735+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'581","last_scrub_stamp":"2024-09-19T15:32:05.008452+0000","last_deep_scrub":"268'581","last_deep_scrub_stamp":"2024-09-19T15:32:05.008452+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.008452+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:51.104635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2994,"num_read_kb":2751,"num_write":739,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'361","reported_seq":1167,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.549717+0000","last_change":"2024-09-19T15:31:47.549717+0000","last_active":"2024-09-19T15:31:47.549717+0000","last_peered":"2024-09-19T15:31:47.549717+0000","last_clean":"2024-09-19T15:31:47.549717+0000","last_became_active":"2024-09-19T13:40:34.253708+0000","last_became_peered":"2024-09-19T13:40:34.253708+0000","last_unstale":"2024-09-19T15:31:47.549717+0000","last_undegraded":"2024-09-19T15:31:47.549717+0000","last_fullsized":"2024-09-19T15:31:47.549717+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'361","last_scrub_stamp":"2024-09-19T15:31:47.549493+0000","last_deep_scrub":"268'361","last_deep_scrub_stamp":"2024-09-19T15:31:47.549493+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.549493+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:11:12.191338+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":758,"num_read_kb":54804,"num_write":1089,"num_write_kb":28785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.601276+0000","last_change":"2024-09-19T13:40:38.245697+0000","last_active":"2024-09-19T15:28:12.601276+0000","last_peered":"2024-09-19T15:28:12.601276+0000","last_clean":"2024-09-19T15:28:12.601276+0000","last_became_active":"2024-09-19T13:40:38.245018+0000","last_became_peered":"2024-09-19T13:40:38.245018+0000","last_unstale":"2024-09-19T15:28:12.601276+0000","last_undegraded":"2024-09-19T15:28:12.601276+0000","last_fullsized":"2024-09-19T15:28:12.601276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:24:48.463235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'349","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.131655+0000","last_change":"2024-09-19T13:40:40.234381+0000","last_active":"2024-09-19T15:31:40.131655+0000","last_peered":"2024-09-19T15:31:40.131655+0000","last_clean":"2024-09-19T15:31:40.131655+0000","last_became_active":"2024-09-19T13:40:40.229201+0000","last_became_peered":"2024-09-19T13:40:40.229201+0000","last_unstale":"2024-09-19T15:31:40.131655+0000","last_undegraded":"2024-09-19T15:31:40.131655+0000","last_fullsized":"2024-09-19T15:31:40.131655+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:53.097533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43041,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":567,"num_read_kb":1167,"num_write":454,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.395355+0000","last_change":"2024-09-19T13:40:42.247045+0000","last_active":"2024-09-19T15:29:12.395355+0000","last_peered":"2024-09-19T15:29:12.395355+0000","last_clean":"2024-09-19T15:29:12.395355+0000","last_became_active":"2024-09-19T13:40:42.246286+0000","last_became_peered":"2024-09-19T13:40:42.246286+0000","last_unstale":"2024-09-19T15:29:12.395355+0000","last_undegraded":"2024-09-19T15:29:12.395355+0000","last_fullsized":"2024-09-19T15:29:12.395355+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:20:14.165507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'161","reported_seq":725,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.256170+0000","last_change":"2024-09-19T13:40:44.270342+0000","last_active":"2024-09-19T15:31:13.256170+0000","last_peered":"2024-09-19T15:31:13.256170+0000","last_clean":"2024-09-19T15:31:13.256170+0000","last_became_active":"2024-09-19T13:40:44.267428+0000","last_became_peered":"2024-09-19T13:40:44.267428+0000","last_unstale":"2024-09-19T15:31:13.256170+0000","last_undegraded":"2024-09-19T15:31:13.256170+0000","last_fullsized":"2024-09-19T15:31:13.256170+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:14.956268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":325,"num_read_kb":284,"num_write":406,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'374","reported_seq":2107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.834458+0000","last_change":"2024-09-19T15:31:51.834458+0000","last_active":"2024-09-19T15:31:51.834458+0000","last_peered":"2024-09-19T15:31:51.834458+0000","last_clean":"2024-09-19T15:31:51.834458+0000","last_became_active":"2024-09-19T13:40:36.230842+0000","last_became_peered":"2024-09-19T13:40:36.230842+0000","last_unstale":"2024-09-19T15:31:51.834458+0000","last_undegraded":"2024-09-19T15:31:51.834458+0000","last_fullsized":"2024-09-19T15:31:51.834458+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'374","last_scrub_stamp":"2024-09-19T15:31:51.834239+0000","last_deep_scrub":"268'374","last_deep_scrub_stamp":"2024-09-19T15:31:51.834239+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.834239+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:37.484036+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2340,"num_read_kb":2286,"num_write":408,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'380","reported_seq":1170,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.696898+0000","last_change":"2024-09-19T15:31:49.696898+0000","last_active":"2024-09-19T15:31:49.696898+0000","last_peered":"2024-09-19T15:31:49.696898+0000","last_clean":"2024-09-19T15:31:49.696898+0000","last_became_active":"2024-09-19T13:41:05.307368+0000","last_became_peered":"2024-09-19T13:41:05.307368+0000","last_unstale":"2024-09-19T15:31:49.696898+0000","last_undegraded":"2024-09-19T15:31:49.696898+0000","last_fullsized":"2024-09-19T15:31:49.696898+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'380","last_scrub_stamp":"2024-09-19T15:31:49.696677+0000","last_deep_scrub":"268'380","last_deep_scrub_stamp":"2024-09-19T15:31:49.696677+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.696677+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:46.518267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":987,"num_read_kb":73584,"num_write":1229,"num_write_kb":59214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.597487+0000","last_change":"2024-09-19T15:32:03.597487+0000","last_active":"2024-09-19T15:32:03.597487+0000","last_peered":"2024-09-19T15:32:03.597487+0000","last_clean":"2024-09-19T15:32:03.597487+0000","last_became_active":"2024-09-19T13:40:38.245287+0000","last_became_peered":"2024-09-19T13:40:38.245287+0000","last_unstale":"2024-09-19T15:32:03.597487+0000","last_undegraded":"2024-09-19T15:32:03.597487+0000","last_fullsized":"2024-09-19T15:32:03.597487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:03.597281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:03.597281+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.597281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:23.720458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'172","reported_seq":758,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:18.249753+0000","last_change":"2024-09-19T13:40:40.247785+0000","last_active":"2024-09-19T15:31:18.249753+0000","last_peered":"2024-09-19T15:31:18.249753+0000","last_clean":"2024-09-19T15:31:18.249753+0000","last_became_active":"2024-09-19T13:40:40.246680+0000","last_became_peered":"2024-09-19T13:40:40.246680+0000","last_unstale":"2024-09-19T15:31:18.249753+0000","last_undegraded":"2024-09-19T15:31:18.249753+0000","last_fullsized":"2024-09-19T15:31:18.249753+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:04.960514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":223,"num_read_kb":217,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'765","reported_seq":2973,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.158907+0000","last_change":"2024-09-19T13:40:42.253045+0000","last_active":"2024-09-19T15:31:38.158907+0000","last_peered":"2024-09-19T15:31:38.158907+0000","last_clean":"2024-09-19T15:31:38.158907+0000","last_became_active":"2024-09-19T13:40:42.250436+0000","last_became_peered":"2024-09-19T13:40:42.250436+0000","last_unstale":"2024-09-19T15:31:38.158907+0000","last_undegraded":"2024-09-19T15:31:38.158907+0000","last_fullsized":"2024-09-19T15:31:38.158907+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:00.593974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'100","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:27.673954+0000","last_change":"2024-09-19T13:40:44.269427+0000","last_active":"2024-09-19T15:30:27.673954+0000","last_peered":"2024-09-19T15:30:27.673954+0000","last_clean":"2024-09-19T15:30:27.673954+0000","last_became_active":"2024-09-19T13:40:44.268630+0000","last_became_peered":"2024-09-19T13:40:44.268630+0000","last_unstale":"2024-09-19T15:30:27.673954+0000","last_undegraded":"2024-09-19T15:30:27.673954+0000","last_fullsized":"2024-09-19T15:30:27.673954+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:59.722843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":162,"num_read_kb":149,"num_write":244,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'1165","reported_seq":2741,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.534176+0000","last_change":"2024-09-19T15:31:58.534176+0000","last_active":"2024-09-19T15:31:58.534176+0000","last_peered":"2024-09-19T15:31:58.534176+0000","last_clean":"2024-09-19T15:31:58.534176+0000","last_became_active":"2024-09-19T13:41:05.320040+0000","last_became_peered":"2024-09-19T13:41:05.320040+0000","last_unstale":"2024-09-19T15:31:58.534176+0000","last_undegraded":"2024-09-19T15:31:58.534176+0000","last_fullsized":"2024-09-19T15:31:58.534176+0000","mapping_epoch":38,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1165","last_scrub_stamp":"2024-09-19T15:31:58.533998+0000","last_deep_scrub":"268'1165","last_deep_scrub_stamp":"2024-09-19T15:31:58.533998+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.533998+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":1100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:51.390548+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5194,"num_read_kb":4574,"num_write":1598,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'367","reported_seq":1037,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.813433+0000","last_change":"2024-09-19T15:31:52.813433+0000","last_active":"2024-09-19T15:31:52.813433+0000","last_peered":"2024-09-19T15:31:52.813433+0000","last_clean":"2024-09-19T15:31:52.813433+0000","last_became_active":"2024-09-19T13:40:34.251475+0000","last_became_peered":"2024-09-19T13:40:34.251475+0000","last_unstale":"2024-09-19T15:31:52.813433+0000","last_undegraded":"2024-09-19T15:31:52.813433+0000","last_fullsized":"2024-09-19T15:31:52.813433+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'367","last_scrub_stamp":"2024-09-19T15:31:52.813085+0000","last_deep_scrub":"268'367","last_deep_scrub_stamp":"2024-09-19T15:31:52.813085+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.813085+0000","objects_scrubbed":3,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:50.638803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":623,"num_read_kb":3575,"num_write":1141,"num_write_kb":19359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.641848+0000","last_change":"2024-09-19T13:40:38.246925+0000","last_active":"2024-09-19T15:28:12.641848+0000","last_peered":"2024-09-19T15:28:12.641848+0000","last_clean":"2024-09-19T15:28:12.641848+0000","last_became_active":"2024-09-19T13:40:38.246205+0000","last_became_peered":"2024-09-19T13:40:38.246205+0000","last_unstale":"2024-09-19T15:28:12.641848+0000","last_undegraded":"2024-09-19T15:28:12.641848+0000","last_fullsized":"2024-09-19T15:28:12.641848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:54.953146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'383","reported_seq":1044,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.492905+0000","last_change":"2024-09-19T13:40:40.242303+0000","last_active":"2024-09-19T15:31:40.492905+0000","last_peered":"2024-09-19T15:31:40.492905+0000","last_clean":"2024-09-19T15:31:40.492905+0000","last_became_active":"2024-09-19T13:40:40.241730+0000","last_became_peered":"2024-09-19T13:40:40.241730+0000","last_unstale":"2024-09-19T15:31:40.492905+0000","last_undegraded":"2024-09-19T15:31:40.492905+0000","last_fullsized":"2024-09-19T15:31:40.492905+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:27.316298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69547,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":608,"num_read_kb":1209,"num_write":470,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:27.197621+0000","last_change":"2024-09-19T13:40:42.240898+0000","last_active":"2024-09-19T15:29:27.197621+0000","last_peered":"2024-09-19T15:29:27.197621+0000","last_clean":"2024-09-19T15:29:27.197621+0000","last_became_active":"2024-09-19T13:40:42.240191+0000","last_became_peered":"2024-09-19T13:40:42.240191+0000","last_unstale":"2024-09-19T15:29:27.197621+0000","last_undegraded":"2024-09-19T15:29:27.197621+0000","last_fullsized":"2024-09-19T15:29:27.197621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'128","reported_seq":653,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.616124+0000","last_change":"2024-09-19T13:40:44.274954+0000","last_active":"2024-09-19T15:29:50.616124+0000","last_peered":"2024-09-19T15:29:50.616124+0000","last_clean":"2024-09-19T15:29:50.616124+0000","last_became_active":"2024-09-19T13:40:44.274449+0000","last_became_peered":"2024-09-19T13:40:44.274449+0000","last_unstale":"2024-09-19T15:29:50.616124+0000","last_undegraded":"2024-09-19T15:29:50.616124+0000","last_fullsized":"2024-09-19T15:29:50.616124+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":153,"num_write":303,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'798","reported_seq":2353,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.488362+0000","last_change":"2024-09-19T15:31:57.488362+0000","last_active":"2024-09-19T15:31:57.488362+0000","last_peered":"2024-09-19T15:31:57.488362+0000","last_clean":"2024-09-19T15:31:57.488362+0000","last_became_active":"2024-09-19T13:40:36.227359+0000","last_became_peered":"2024-09-19T13:40:36.227359+0000","last_unstale":"2024-09-19T15:31:57.488362+0000","last_undegraded":"2024-09-19T15:31:57.488362+0000","last_fullsized":"2024-09-19T15:31:57.488362+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'798","last_scrub_stamp":"2024-09-19T15:31:57.488181+0000","last_deep_scrub":"268'798","last_deep_scrub_stamp":"2024-09-19T15:31:57.488181+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.488181+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:25.410101+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3854,"num_read_kb":3454,"num_write":1058,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":689,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'425","reported_seq":1190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.803379+0000","last_change":"2024-09-19T15:31:53.803379+0000","last_active":"2024-09-19T15:31:53.803379+0000","last_peered":"2024-09-19T15:31:53.803379+0000","last_clean":"2024-09-19T15:31:53.803379+0000","last_became_active":"2024-09-19T13:41:05.313209+0000","last_became_peered":"2024-09-19T13:41:05.313209+0000","last_unstale":"2024-09-19T15:31:53.803379+0000","last_undegraded":"2024-09-19T15:31:53.803379+0000","last_fullsized":"2024-09-19T15:31:53.803379+0000","mapping_epoch":38,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'425","last_scrub_stamp":"2024-09-19T15:31:53.803129+0000","last_deep_scrub":"268'425","last_deep_scrub_stamp":"2024-09-19T15:31:53.803129+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.803129+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:11:25.265777+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136845,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":777,"num_read_kb":102227,"num_write":1424,"num_write_kb":49987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.620697+0000","last_change":"2024-09-19T13:40:38.230747+0000","last_active":"2024-09-19T15:28:12.620697+0000","last_peered":"2024-09-19T15:28:12.620697+0000","last_clean":"2024-09-19T15:28:12.620697+0000","last_became_active":"2024-09-19T13:40:38.229929+0000","last_became_peered":"2024-09-19T13:40:38.229929+0000","last_unstale":"2024-09-19T15:28:12.620697+0000","last_undegraded":"2024-09-19T15:28:12.620697+0000","last_fullsized":"2024-09-19T15:28:12.620697+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:58:25.811713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'302","reported_seq":914,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.550216+0000","last_change":"2024-09-19T13:40:40.241834+0000","last_active":"2024-09-19T15:31:40.550216+0000","last_peered":"2024-09-19T15:31:40.550216+0000","last_clean":"2024-09-19T15:31:40.550216+0000","last_became_active":"2024-09-19T13:40:40.241404+0000","last_became_peered":"2024-09-19T13:40:40.241404+0000","last_unstale":"2024-09-19T15:31:40.550216+0000","last_undegraded":"2024-09-19T15:31:40.550216+0000","last_fullsized":"2024-09-19T15:31:40.550216+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45708,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":1069,"num_write":394,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.952418+0000","last_change":"2024-09-19T15:32:06.952418+0000","last_active":"2024-09-19T15:32:06.952418+0000","last_peered":"2024-09-19T15:32:06.952418+0000","last_clean":"2024-09-19T15:32:06.952418+0000","last_became_active":"2024-09-19T13:40:42.251413+0000","last_became_peered":"2024-09-19T13:40:42.251413+0000","last_unstale":"2024-09-19T15:32:06.952418+0000","last_undegraded":"2024-09-19T15:32:06.952418+0000","last_fullsized":"2024-09-19T15:32:06.952418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:06.952230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:06.952230+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.952230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:46:16.041934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'161","reported_seq":717,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:50.632881+0000","last_change":"2024-09-19T13:40:44.278568+0000","last_active":"2024-09-19T15:29:50.632881+0000","last_peered":"2024-09-19T15:29:50.632881+0000","last_clean":"2024-09-19T15:29:50.632881+0000","last_became_active":"2024-09-19T13:40:44.277774+0000","last_became_peered":"2024-09-19T13:40:44.277774+0000","last_unstale":"2024-09-19T15:29:50.632881+0000","last_undegraded":"2024-09-19T15:29:50.632881+0000","last_fullsized":"2024-09-19T15:29:50.632881+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":980,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216,"num_read_kb":207,"num_write":371,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'468","reported_seq":2247,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.010835+0000","last_change":"2024-09-19T15:32:02.010694+0000","last_active":"2024-09-19T15:32:02.010835+0000","last_peered":"2024-09-19T15:32:02.010835+0000","last_clean":"2024-09-19T15:32:02.010835+0000","last_became_active":"2024-09-19T13:40:36.222632+0000","last_became_peered":"2024-09-19T13:40:36.222632+0000","last_unstale":"2024-09-19T15:32:02.010835+0000","last_undegraded":"2024-09-19T15:32:02.010835+0000","last_fullsized":"2024-09-19T15:32:02.010835+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'468","last_scrub_stamp":"2024-09-19T15:32:02.010501+0000","last_deep_scrub":"268'468","last_deep_scrub_stamp":"2024-09-19T15:32:02.010501+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.010501+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:51:35.207348+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2809,"num_read_kb":2663,"num_write":534,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3595,"num_omap_keys":15,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'381","reported_seq":1091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.916447+0000","last_change":"2024-09-19T15:31:49.916447+0000","last_active":"2024-09-19T15:31:49.916447+0000","last_peered":"2024-09-19T15:31:49.916447+0000","last_clean":"2024-09-19T15:31:49.916447+0000","last_became_active":"2024-09-19T13:40:34.258068+0000","last_became_peered":"2024-09-19T13:40:34.258068+0000","last_unstale":"2024-09-19T15:31:49.916447+0000","last_undegraded":"2024-09-19T15:31:49.916447+0000","last_fullsized":"2024-09-19T15:31:49.916447+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'381","last_scrub_stamp":"2024-09-19T15:31:49.916243+0000","last_deep_scrub":"268'381","last_deep_scrub_stamp":"2024-09-19T15:31:49.916243+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.916243+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:51:34.097674+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":750,"num_read_kb":11976,"num_write":1179,"num_write_kb":32337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:27.618614+0000","last_change":"2024-09-19T13:40:38.240655+0000","last_active":"2024-09-19T15:29:27.618614+0000","last_peered":"2024-09-19T15:29:27.618614+0000","last_clean":"2024-09-19T15:29:27.618614+0000","last_became_active":"2024-09-19T13:40:38.236724+0000","last_became_peered":"2024-09-19T13:40:38.236724+0000","last_unstale":"2024-09-19T15:29:27.618614+0000","last_undegraded":"2024-09-19T15:29:27.618614+0000","last_fullsized":"2024-09-19T15:29:27.618614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:37.192400+0000","last_clean_scrub_stamp":"2024-09-19T13:40:37.192400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'276","reported_seq":870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.004625+0000","last_change":"2024-09-19T13:40:40.223389+0000","last_active":"2024-09-19T15:31:40.004625+0000","last_peered":"2024-09-19T15:31:40.004625+0000","last_clean":"2024-09-19T15:31:40.004625+0000","last_became_active":"2024-09-19T13:40:40.222807+0000","last_became_peered":"2024-09-19T13:40:40.222807+0000","last_unstale":"2024-09-19T15:31:40.004625+0000","last_undegraded":"2024-09-19T15:31:40.004625+0000","last_fullsized":"2024-09-19T15:31:40.004625+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:53.228422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47535,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":1137,"num_write":394,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.601222+0000","last_change":"2024-09-19T13:40:42.251870+0000","last_active":"2024-09-19T15:28:12.601222+0000","last_peered":"2024-09-19T15:28:12.601222+0000","last_clean":"2024-09-19T15:28:12.601222+0000","last_became_active":"2024-09-19T13:40:42.251057+0000","last_became_peered":"2024-09-19T13:40:42.251057+0000","last_unstale":"2024-09-19T15:28:12.601222+0000","last_undegraded":"2024-09-19T15:28:12.601222+0000","last_fullsized":"2024-09-19T15:28:12.601222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:37.359054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'143","reported_seq":1275,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:43.116669+0000","last_change":"2024-09-19T13:40:44.271381+0000","last_active":"2024-09-19T15:29:43.116669+0000","last_peered":"2024-09-19T15:29:43.116669+0000","last_clean":"2024-09-19T15:29:43.116669+0000","last_became_active":"2024-09-19T13:40:44.270656+0000","last_became_peered":"2024-09-19T13:40:44.270656+0000","last_unstale":"2024-09-19T15:29:43.116669+0000","last_undegraded":"2024-09-19T15:29:43.116669+0000","last_fullsized":"2024-09-19T15:29:43.116669+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":816,"num_read_kb":810,"num_write":350,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'465","reported_seq":2003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.548394+0000","last_change":"2024-09-19T15:31:55.548394+0000","last_active":"2024-09-19T15:31:55.548394+0000","last_peered":"2024-09-19T15:31:55.548394+0000","last_clean":"2024-09-19T15:31:55.548394+0000","last_became_active":"2024-09-19T13:40:36.217230+0000","last_became_peered":"2024-09-19T13:40:36.217230+0000","last_unstale":"2024-09-19T15:31:55.548394+0000","last_undegraded":"2024-09-19T15:31:55.548394+0000","last_fullsized":"2024-09-19T15:31:55.548394+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'465","last_scrub_stamp":"2024-09-19T15:31:55.548152+0000","last_deep_scrub":"268'465","last_deep_scrub_stamp":"2024-09-19T15:31:55.548152+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.548152+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:04.184032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2437,"num_read_kb":2267,"num_write":569,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'335","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.661888+0000","last_change":"2024-09-19T15:31:47.661888+0000","last_active":"2024-09-19T15:31:47.661888+0000","last_peered":"2024-09-19T15:31:47.661888+0000","last_clean":"2024-09-19T15:31:47.661888+0000","last_became_active":"2024-09-19T13:40:34.258416+0000","last_became_peered":"2024-09-19T13:40:34.258416+0000","last_unstale":"2024-09-19T15:31:47.661888+0000","last_undegraded":"2024-09-19T15:31:47.661888+0000","last_fullsized":"2024-09-19T15:31:47.661888+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'335","last_scrub_stamp":"2024-09-19T15:31:47.661793+0000","last_deep_scrub":"268'335","last_deep_scrub_stamp":"2024-09-19T15:31:47.661793+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.661793+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:16.145468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":559,"num_read_kb":6695,"num_write":1052,"num_write_kb":15020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"268'2","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.657108+0000","last_change":"2024-09-19T15:32:05.657108+0000","last_active":"2024-09-19T15:32:05.657108+0000","last_peered":"2024-09-19T15:32:05.657108+0000","last_clean":"2024-09-19T15:32:05.657108+0000","last_became_active":"2024-09-19T13:40:38.214571+0000","last_became_peered":"2024-09-19T13:40:38.214571+0000","last_unstale":"2024-09-19T15:32:05.657108+0000","last_undegraded":"2024-09-19T15:32:05.657108+0000","last_fullsized":"2024-09-19T15:32:05.657108+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:05.656919+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:05.656919+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.656919+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:18:39.425426+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'350","reported_seq":979,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.191119+0000","last_change":"2024-09-19T13:40:40.248984+0000","last_active":"2024-09-19T15:31:40.191119+0000","last_peered":"2024-09-19T15:31:40.191119+0000","last_clean":"2024-09-19T15:31:40.191119+0000","last_became_active":"2024-09-19T13:40:40.245368+0000","last_became_peered":"2024-09-19T13:40:40.245368+0000","last_unstale":"2024-09-19T15:31:40.191119+0000","last_undegraded":"2024-09-19T15:31:40.191119+0000","last_fullsized":"2024-09-19T15:31:40.191119+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:39.198484+0000","last_clean_scrub_stamp":"2024-09-19T13:40:39.198484+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:10.651187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48547,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":571,"num_read_kb":1175,"num_write":452,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.180073+0000","last_change":"2024-09-19T13:40:42.240218+0000","last_active":"2024-09-19T15:28:12.180073+0000","last_peered":"2024-09-19T15:28:12.180073+0000","last_clean":"2024-09-19T15:28:12.180073+0000","last_became_active":"2024-09-19T13:40:42.239391+0000","last_became_peered":"2024-09-19T13:40:42.239391+0000","last_unstale":"2024-09-19T15:28:12.180073+0000","last_undegraded":"2024-09-19T15:28:12.180073+0000","last_fullsized":"2024-09-19T15:28:12.180073+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:41.204505+0000","last_clean_scrub_stamp":"2024-09-19T13:40:41.204505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:58.943534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'128","reported_seq":656,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:12.238755+0000","last_change":"2024-09-19T13:40:44.249845+0000","last_active":"2024-09-19T15:31:12.238755+0000","last_peered":"2024-09-19T15:31:12.238755+0000","last_clean":"2024-09-19T15:31:12.238755+0000","last_became_active":"2024-09-19T13:40:44.249201+0000","last_became_peered":"2024-09-19T13:40:44.249201+0000","last_unstale":"2024-09-19T15:31:12.238755+0000","last_undegraded":"2024-09-19T15:31:12.238755+0000","last_fullsized":"2024-09-19T15:31:12.238755+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:40.297816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":210,"num_read_kb":190,"num_write":320,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'404","reported_seq":2086,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.650457+0000","last_change":"2024-09-19T15:31:59.650457+0000","last_active":"2024-09-19T15:31:59.650457+0000","last_peered":"2024-09-19T15:31:59.650457+0000","last_clean":"2024-09-19T15:31:59.650457+0000","last_became_active":"2024-09-19T13:40:36.225885+0000","last_became_peered":"2024-09-19T13:40:36.225885+0000","last_unstale":"2024-09-19T15:31:59.650457+0000","last_undegraded":"2024-09-19T15:31:59.650457+0000","last_fullsized":"2024-09-19T15:31:59.650457+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'404","last_scrub_stamp":"2024-09-19T15:31:59.650266+0000","last_deep_scrub":"268'404","last_deep_scrub_stamp":"2024-09-19T15:31:59.650266+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.650266+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:40.113541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2307,"num_read_kb":2225,"num_write":450,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'329","reported_seq":970,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.933899+0000","last_change":"2024-09-19T15:31:52.933899+0000","last_active":"2024-09-19T15:31:52.933899+0000","last_peered":"2024-09-19T15:31:52.933899+0000","last_clean":"2024-09-19T15:31:52.933899+0000","last_became_active":"2024-09-19T13:40:34.249068+0000","last_became_peered":"2024-09-19T13:40:34.249068+0000","last_unstale":"2024-09-19T15:31:52.933899+0000","last_undegraded":"2024-09-19T15:31:52.933899+0000","last_fullsized":"2024-09-19T15:31:52.933899+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'329","last_scrub_stamp":"2024-09-19T15:31:52.933659+0000","last_deep_scrub":"268'329","last_deep_scrub_stamp":"2024-09-19T15:31:52.933659+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.933659+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:49.241793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":27093,"num_write":1002,"num_write_kb":27581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"268'462","reported_seq":2113,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.639393+0000","last_change":"2024-09-19T15:32:01.639393+0000","last_active":"2024-09-19T15:32:01.639393+0000","last_peered":"2024-09-19T15:32:01.639393+0000","last_clean":"2024-09-19T15:32:01.639393+0000","last_became_active":"2024-09-19T13:40:36.220569+0000","last_became_peered":"2024-09-19T13:40:36.220569+0000","last_unstale":"2024-09-19T15:32:01.639393+0000","last_undegraded":"2024-09-19T15:32:01.639393+0000","last_fullsized":"2024-09-19T15:32:01.639393+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'462","last_scrub_stamp":"2024-09-19T15:32:01.639153+0000","last_deep_scrub":"268'462","last_deep_scrub_stamp":"2024-09-19T15:32:01.639153+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.639153+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:32:50.011020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2535,"num_read_kb":2389,"num_write":539,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"268'416","reported_seq":1140,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.890155+0000","last_change":"2024-09-19T15:31:48.890155+0000","last_active":"2024-09-19T15:31:48.890155+0000","last_peered":"2024-09-19T15:31:48.890155+0000","last_clean":"2024-09-19T15:31:48.890155+0000","last_became_active":"2024-09-19T13:40:34.239357+0000","last_became_peered":"2024-09-19T13:40:34.239357+0000","last_unstale":"2024-09-19T15:31:48.890155+0000","last_undegraded":"2024-09-19T15:31:48.890155+0000","last_fullsized":"2024-09-19T15:31:48.890155+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'416","last_scrub_stamp":"2024-09-19T15:31:48.889953+0000","last_deep_scrub":"268'416","last_deep_scrub_stamp":"2024-09-19T15:31:48.889953+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.889953+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:51:03.904838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":787,"num_read_kb":92890,"num_write":1403,"num_write_kb":63384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'596","reported_seq":2315,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.766403+0000","last_change":"2024-09-19T15:32:03.766403+0000","last_active":"2024-09-19T15:32:03.766403+0000","last_peered":"2024-09-19T15:32:03.766403+0000","last_clean":"2024-09-19T15:32:03.766403+0000","last_became_active":"2024-09-19T13:40:36.241566+0000","last_became_peered":"2024-09-19T13:40:36.241566+0000","last_unstale":"2024-09-19T15:32:03.766403+0000","last_undegraded":"2024-09-19T15:32:03.766403+0000","last_fullsized":"2024-09-19T15:32:03.766403+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'596","last_scrub_stamp":"2024-09-19T15:32:03.766219+0000","last_deep_scrub":"268'596","last_deep_scrub_stamp":"2024-09-19T15:32:03.766219+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.766219+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:13:52.457376+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3019,"num_read_kb":2776,"num_write":751,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'363","reported_seq":1052,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.812126+0000","last_change":"2024-09-19T15:31:54.812126+0000","last_active":"2024-09-19T15:31:54.812126+0000","last_peered":"2024-09-19T15:31:54.812126+0000","last_clean":"2024-09-19T15:31:54.812126+0000","last_became_active":"2024-09-19T13:40:34.221057+0000","last_became_peered":"2024-09-19T13:40:34.221057+0000","last_unstale":"2024-09-19T15:31:54.812126+0000","last_undegraded":"2024-09-19T15:31:54.812126+0000","last_fullsized":"2024-09-19T15:31:54.812126+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'363","last_scrub_stamp":"2024-09-19T15:31:54.811762+0000","last_deep_scrub":"268'363","last_deep_scrub_stamp":"2024-09-19T15:31:54.811762+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.811762+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:58.508853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":673,"num_read_kb":11742,"num_write":1135,"num_write_kb":23593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'496","reported_seq":2272,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.604022+0000","last_change":"2024-09-19T15:31:58.604022+0000","last_active":"2024-09-19T15:31:58.604022+0000","last_peered":"2024-09-19T15:31:58.604022+0000","last_clean":"2024-09-19T15:31:58.604022+0000","last_became_active":"2024-09-19T13:40:36.238166+0000","last_became_peered":"2024-09-19T13:40:36.238166+0000","last_unstale":"2024-09-19T15:31:58.604022+0000","last_undegraded":"2024-09-19T15:31:58.604022+0000","last_fullsized":"2024-09-19T15:31:58.604022+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'496","last_scrub_stamp":"2024-09-19T15:31:58.603838+0000","last_deep_scrub":"268'496","last_deep_scrub_stamp":"2024-09-19T15:31:58.603838+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.603838+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:02:50.763311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2902,"num_read_kb":2744,"num_write":591,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'345","reported_seq":1067,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.696407+0000","last_change":"2024-09-19T15:31:48.696407+0000","last_active":"2024-09-19T15:31:48.696407+0000","last_peered":"2024-09-19T15:31:48.696407+0000","last_clean":"2024-09-19T15:31:48.696407+0000","last_became_active":"2024-09-19T13:40:34.232099+0000","last_became_peered":"2024-09-19T13:40:34.232099+0000","last_unstale":"2024-09-19T15:31:48.696407+0000","last_undegraded":"2024-09-19T15:31:48.696407+0000","last_fullsized":"2024-09-19T15:31:48.696407+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'345","last_scrub_stamp":"2024-09-19T15:31:48.696153+0000","last_deep_scrub":"268'345","last_deep_scrub_stamp":"2024-09-19T15:31:48.696153+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.696153+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:49:42.668267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136873,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":758,"num_read_kb":12572,"num_write":1035,"num_write_kb":46357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"268'464","reported_seq":2054,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.060300+0000","last_change":"2024-09-19T15:32:04.060300+0000","last_active":"2024-09-19T15:32:04.060300+0000","last_peered":"2024-09-19T15:32:04.060300+0000","last_clean":"2024-09-19T15:32:04.060300+0000","last_became_active":"2024-09-19T13:40:36.238644+0000","last_became_peered":"2024-09-19T13:40:36.238644+0000","last_unstale":"2024-09-19T15:32:04.060300+0000","last_undegraded":"2024-09-19T15:32:04.060300+0000","last_fullsized":"2024-09-19T15:32:04.060300+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'464","last_scrub_stamp":"2024-09-19T15:32:04.060118+0000","last_deep_scrub":"268'464","last_deep_scrub_stamp":"2024-09-19T15:32:04.060118+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.060118+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:50:53.942088+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2315,"num_read_kb":2185,"num_write":554,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'403","reported_seq":1123,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.920457+0000","last_change":"2024-09-19T15:31:50.920457+0000","last_active":"2024-09-19T15:31:50.920457+0000","last_peered":"2024-09-19T15:31:50.920457+0000","last_clean":"2024-09-19T15:31:50.920457+0000","last_became_active":"2024-09-19T13:40:34.249600+0000","last_became_peered":"2024-09-19T13:40:34.249600+0000","last_unstale":"2024-09-19T15:31:50.920457+0000","last_undegraded":"2024-09-19T15:31:50.920457+0000","last_fullsized":"2024-09-19T15:31:50.920457+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'403","last_scrub_stamp":"2024-09-19T15:31:50.920243+0000","last_deep_scrub":"268'403","last_deep_scrub_stamp":"2024-09-19T15:31:50.920243+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.920243+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:44.928927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":720,"num_read_kb":53970,"num_write":1365,"num_write_kb":53250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'834","reported_seq":2496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.535048+0000","last_change":"2024-09-19T15:32:00.535048+0000","last_active":"2024-09-19T15:32:00.535048+0000","last_peered":"2024-09-19T15:32:00.535048+0000","last_clean":"2024-09-19T15:32:00.535048+0000","last_became_active":"2024-09-19T13:40:36.216697+0000","last_became_peered":"2024-09-19T13:40:36.216697+0000","last_unstale":"2024-09-19T15:32:00.535048+0000","last_undegraded":"2024-09-19T15:32:00.535048+0000","last_fullsized":"2024-09-19T15:32:00.535048+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'834","last_scrub_stamp":"2024-09-19T15:32:00.534857+0000","last_deep_scrub":"268'834","last_deep_scrub_stamp":"2024-09-19T15:32:00.534857+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.534857+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:46:06.736133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4198,"num_read_kb":3766,"num_write":1106,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'330","reported_seq":1034,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.609462+0000","last_change":"2024-09-19T15:31:48.609462+0000","last_active":"2024-09-19T15:31:48.609462+0000","last_peered":"2024-09-19T15:31:48.609462+0000","last_clean":"2024-09-19T15:31:48.609462+0000","last_became_active":"2024-09-19T13:40:34.216774+0000","last_became_peered":"2024-09-19T13:40:34.216774+0000","last_unstale":"2024-09-19T15:31:48.609462+0000","last_undegraded":"2024-09-19T15:31:48.609462+0000","last_fullsized":"2024-09-19T15:31:48.609462+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'330","last_scrub_stamp":"2024-09-19T15:31:48.609254+0000","last_deep_scrub":"268'330","last_deep_scrub_stamp":"2024-09-19T15:31:48.609254+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.609254+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:28.120319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":651,"num_read_kb":47831,"num_write":981,"num_write_kb":20035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'563","reported_seq":2261,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.041159+0000","last_change":"2024-09-19T15:32:03.041159+0000","last_active":"2024-09-19T15:32:03.041159+0000","last_peered":"2024-09-19T15:32:03.041159+0000","last_clean":"2024-09-19T15:32:03.041159+0000","last_became_active":"2024-09-19T13:40:36.218090+0000","last_became_peered":"2024-09-19T13:40:36.218090+0000","last_unstale":"2024-09-19T15:32:03.041159+0000","last_undegraded":"2024-09-19T15:32:03.041159+0000","last_fullsized":"2024-09-19T15:32:03.041159+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'563","last_scrub_stamp":"2024-09-19T15:32:03.040966+0000","last_deep_scrub":"268'563","last_deep_scrub_stamp":"2024-09-19T15:32:03.040966+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.040966+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:59.258463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2933,"num_read_kb":2699,"num_write":698,"num_write_kb":201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'354","reported_seq":1143,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.932331+0000","last_change":"2024-09-19T15:31:50.932331+0000","last_active":"2024-09-19T15:31:50.932331+0000","last_peered":"2024-09-19T15:31:50.932331+0000","last_clean":"2024-09-19T15:31:50.932331+0000","last_became_active":"2024-09-19T13:40:34.272629+0000","last_became_peered":"2024-09-19T13:40:34.272629+0000","last_unstale":"2024-09-19T15:31:50.932331+0000","last_undegraded":"2024-09-19T15:31:50.932331+0000","last_fullsized":"2024-09-19T15:31:50.932331+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'354","last_scrub_stamp":"2024-09-19T15:31:50.932113+0000","last_deep_scrub":"268'354","last_deep_scrub_stamp":"2024-09-19T15:31:50.932113+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.932113+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:18:14.426357+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174644,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":935,"num_read_kb":42229,"num_write":1199,"num_write_kb":17971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'342","reported_seq":1792,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.944349+0000","last_change":"2024-09-19T15:31:57.944349+0000","last_active":"2024-09-19T15:31:57.944349+0000","last_peered":"2024-09-19T15:31:57.944349+0000","last_clean":"2024-09-19T15:31:57.944349+0000","last_became_active":"2024-09-19T13:40:36.224228+0000","last_became_peered":"2024-09-19T13:40:36.224228+0000","last_unstale":"2024-09-19T15:31:57.944349+0000","last_undegraded":"2024-09-19T15:31:57.944349+0000","last_fullsized":"2024-09-19T15:31:57.944349+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'342","last_scrub_stamp":"2024-09-19T15:31:57.944097+0000","last_deep_scrub":"268'342","last_deep_scrub_stamp":"2024-09-19T15:31:57.944097+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.944097+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:57.675155+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1855,"num_read_kb":1782,"num_write":368,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'385","reported_seq":1149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.890591+0000","last_change":"2024-09-19T15:31:51.890591+0000","last_active":"2024-09-19T15:31:51.890591+0000","last_peered":"2024-09-19T15:31:51.890591+0000","last_clean":"2024-09-19T15:31:51.890591+0000","last_became_active":"2024-09-19T13:40:34.245197+0000","last_became_peered":"2024-09-19T13:40:34.245197+0000","last_unstale":"2024-09-19T15:31:51.890591+0000","last_undegraded":"2024-09-19T15:31:51.890591+0000","last_fullsized":"2024-09-19T15:31:51.890591+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'385","last_scrub_stamp":"2024-09-19T15:31:51.890329+0000","last_deep_scrub":"268'385","last_deep_scrub_stamp":"2024-09-19T15:31:51.890329+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.890329+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:30.384059+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273700,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":750,"num_read_kb":129994,"num_write":1223,"num_write_kb":46426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"268'497","reported_seq":2049,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.736843+0000","last_change":"2024-09-19T15:31:58.736843+0000","last_active":"2024-09-19T15:31:58.736843+0000","last_peered":"2024-09-19T15:31:58.736843+0000","last_clean":"2024-09-19T15:31:58.736843+0000","last_became_active":"2024-09-19T13:40:36.226839+0000","last_became_peered":"2024-09-19T13:40:36.226839+0000","last_unstale":"2024-09-19T15:31:58.736843+0000","last_undegraded":"2024-09-19T15:31:58.736843+0000","last_fullsized":"2024-09-19T15:31:58.736843+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'497","last_scrub_stamp":"2024-09-19T15:31:58.736663+0000","last_deep_scrub":"268'497","last_deep_scrub_stamp":"2024-09-19T15:31:58.736663+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.736663+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:38:24.306737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2632,"num_read_kb":2421,"num_write":626,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'349","reported_seq":1173,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.757738+0000","last_change":"2024-09-19T15:31:56.757738+0000","last_active":"2024-09-19T15:31:56.757738+0000","last_peered":"2024-09-19T15:31:56.757738+0000","last_clean":"2024-09-19T15:31:56.757738+0000","last_became_active":"2024-09-19T13:40:34.228472+0000","last_became_peered":"2024-09-19T13:40:34.228472+0000","last_unstale":"2024-09-19T15:31:56.757738+0000","last_undegraded":"2024-09-19T15:31:56.757738+0000","last_fullsized":"2024-09-19T15:31:56.757738+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'349","last_scrub_stamp":"2024-09-19T15:31:56.757523+0000","last_deep_scrub":"268'349","last_deep_scrub_stamp":"2024-09-19T15:31:56.757523+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.757523+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:45.800606+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1120,"num_read_kb":37188,"num_write":1213,"num_write_kb":31649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'801","reported_seq":2509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.491208+0000","last_change":"2024-09-19T15:32:02.491208+0000","last_active":"2024-09-19T15:32:02.491208+0000","last_peered":"2024-09-19T15:32:02.491208+0000","last_clean":"2024-09-19T15:32:02.491208+0000","last_became_active":"2024-09-19T13:40:36.217870+0000","last_became_peered":"2024-09-19T13:40:36.217870+0000","last_unstale":"2024-09-19T15:32:02.491208+0000","last_undegraded":"2024-09-19T15:32:02.491208+0000","last_fullsized":"2024-09-19T15:32:02.491208+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'801","last_scrub_stamp":"2024-09-19T15:32:02.491031+0000","last_deep_scrub":"268'801","last_deep_scrub_stamp":"2024-09-19T15:32:02.491031+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.491031+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:55.926935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3954,"num_read_kb":3588,"num_write":1044,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'308","reported_seq":1008,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.871956+0000","last_change":"2024-09-19T15:31:49.871956+0000","last_active":"2024-09-19T15:31:49.871956+0000","last_peered":"2024-09-19T15:31:49.871956+0000","last_clean":"2024-09-19T15:31:49.871956+0000","last_became_active":"2024-09-19T13:41:05.310802+0000","last_became_peered":"2024-09-19T13:41:05.310802+0000","last_unstale":"2024-09-19T15:31:49.871956+0000","last_undegraded":"2024-09-19T15:31:49.871956+0000","last_fullsized":"2024-09-19T15:31:49.871956+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'308","last_scrub_stamp":"2024-09-19T15:31:49.871682+0000","last_deep_scrub":"268'308","last_deep_scrub_stamp":"2024-09-19T15:31:49.871682+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.871682+0000","objects_scrubbed":10,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:31:02.847445+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136937,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":757,"num_read_kb":21770,"num_write":969,"num_write_kb":19448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"268'361","reported_seq":1968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.789067+0000","last_change":"2024-09-19T15:31:52.789067+0000","last_active":"2024-09-19T15:31:52.789067+0000","last_peered":"2024-09-19T15:31:52.789067+0000","last_clean":"2024-09-19T15:31:52.789067+0000","last_became_active":"2024-09-19T13:40:36.215821+0000","last_became_peered":"2024-09-19T13:40:36.215821+0000","last_unstale":"2024-09-19T15:31:52.789067+0000","last_undegraded":"2024-09-19T15:31:52.789067+0000","last_fullsized":"2024-09-19T15:31:52.789067+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'361","last_scrub_stamp":"2024-09-19T15:31:52.788781+0000","last_deep_scrub":"268'361","last_deep_scrub_stamp":"2024-09-19T15:31:52.788781+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.788781+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:07.602774+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2112,"num_read_kb":2049,"num_write":394,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'450","reported_seq":1193,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.772885+0000","last_change":"2024-09-19T15:31:55.772885+0000","last_active":"2024-09-19T15:31:55.772885+0000","last_peered":"2024-09-19T15:31:55.772885+0000","last_clean":"2024-09-19T15:31:55.772885+0000","last_became_active":"2024-09-19T13:40:34.261812+0000","last_became_peered":"2024-09-19T13:40:34.261812+0000","last_unstale":"2024-09-19T15:31:55.772885+0000","last_undegraded":"2024-09-19T15:31:55.772885+0000","last_fullsized":"2024-09-19T15:31:55.772885+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'450","last_scrub_stamp":"2024-09-19T15:31:55.772408+0000","last_deep_scrub":"268'450","last_deep_scrub_stamp":"2024-09-19T15:31:55.772408+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.772408+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:27:33.627722+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136844,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":935,"num_read_kb":21060,"num_write":1238,"num_write_kb":41159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'747","reported_seq":2340,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.528088+0000","last_change":"2024-09-19T15:32:01.528088+0000","last_active":"2024-09-19T15:32:01.528088+0000","last_peered":"2024-09-19T15:32:01.528088+0000","last_clean":"2024-09-19T15:32:01.528088+0000","last_became_active":"2024-09-19T13:40:36.216597+0000","last_became_peered":"2024-09-19T13:40:36.216597+0000","last_unstale":"2024-09-19T15:32:01.528088+0000","last_undegraded":"2024-09-19T15:32:01.528088+0000","last_fullsized":"2024-09-19T15:32:01.528088+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'747","last_scrub_stamp":"2024-09-19T15:32:01.527862+0000","last_deep_scrub":"268'747","last_deep_scrub_stamp":"2024-09-19T15:32:01.527862+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.527862+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:58.511021+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3535,"num_read_kb":3206,"num_write":942,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'389","reported_seq":1104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.688371+0000","last_change":"2024-09-19T15:31:50.688371+0000","last_active":"2024-09-19T15:31:50.688371+0000","last_peered":"2024-09-19T15:31:50.688371+0000","last_clean":"2024-09-19T15:31:50.688371+0000","last_became_active":"2024-09-19T13:40:34.255374+0000","last_became_peered":"2024-09-19T13:40:34.255374+0000","last_unstale":"2024-09-19T15:31:50.688371+0000","last_undegraded":"2024-09-19T15:31:50.688371+0000","last_fullsized":"2024-09-19T15:31:50.688371+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'389","last_scrub_stamp":"2024-09-19T15:31:50.688138+0000","last_deep_scrub":"268'389","last_deep_scrub_stamp":"2024-09-19T15:31:50.688138+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.688138+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:59:16.557745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":672,"num_read_kb":82615,"num_write":1215,"num_write_kb":54973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'1055","reported_seq":2699,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.729121+0000","last_change":"2024-09-19T15:32:02.729121+0000","last_active":"2024-09-19T15:32:02.729121+0000","last_peered":"2024-09-19T15:32:02.729121+0000","last_clean":"2024-09-19T15:32:02.729121+0000","last_became_active":"2024-09-19T13:40:36.238907+0000","last_became_peered":"2024-09-19T13:40:36.238907+0000","last_unstale":"2024-09-19T15:32:02.729121+0000","last_undegraded":"2024-09-19T15:32:02.729121+0000","last_fullsized":"2024-09-19T15:32:02.729121+0000","mapping_epoch":27,"log_start":"268'1000","ondisk_log_start":"268'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1055","last_scrub_stamp":"2024-09-19T15:32:02.728906+0000","last_deep_scrub":"268'1055","last_deep_scrub_stamp":"2024-09-19T15:32:02.728906+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.728906+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1000,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:49:49.972281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5049,"num_read_kb":4427,"num_write":1568,"num_write_kb":756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'420","reported_seq":1105,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.888307+0000","last_change":"2024-09-19T15:31:48.888307+0000","last_active":"2024-09-19T15:31:48.888307+0000","last_peered":"2024-09-19T15:31:48.888307+0000","last_clean":"2024-09-19T15:31:48.888307+0000","last_became_active":"2024-09-19T13:40:34.272618+0000","last_became_peered":"2024-09-19T13:40:34.272618+0000","last_unstale":"2024-09-19T15:31:48.888307+0000","last_undegraded":"2024-09-19T15:31:48.888307+0000","last_fullsized":"2024-09-19T15:31:48.888307+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'420","last_scrub_stamp":"2024-09-19T15:31:48.888059+0000","last_deep_scrub":"268'420","last_deep_scrub_stamp":"2024-09-19T15:31:48.888059+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.888059+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:42:39.951922+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":788,"num_read_kb":25154,"num_write":1353,"num_write_kb":33238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'504","reported_seq":2201,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.714567+0000","last_change":"2024-09-19T15:31:59.714567+0000","last_active":"2024-09-19T15:31:59.714567+0000","last_peered":"2024-09-19T15:31:59.714567+0000","last_clean":"2024-09-19T15:31:59.714567+0000","last_became_active":"2024-09-19T13:40:36.226572+0000","last_became_peered":"2024-09-19T13:40:36.226572+0000","last_unstale":"2024-09-19T15:31:59.714567+0000","last_undegraded":"2024-09-19T15:31:59.714567+0000","last_fullsized":"2024-09-19T15:31:59.714567+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'504","last_scrub_stamp":"2024-09-19T15:31:59.714369+0000","last_deep_scrub":"268'504","last_deep_scrub_stamp":"2024-09-19T15:31:59.714369+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.714369+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:23:18.997611+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2633,"num_read_kb":2478,"num_write":570,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'448","reported_seq":1211,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.710466+0000","last_change":"2024-09-19T15:31:55.710466+0000","last_active":"2024-09-19T15:31:55.710466+0000","last_peered":"2024-09-19T15:31:55.710466+0000","last_clean":"2024-09-19T15:31:55.710466+0000","last_became_active":"2024-09-19T13:40:34.274523+0000","last_became_peered":"2024-09-19T13:40:34.274523+0000","last_unstale":"2024-09-19T15:31:55.710466+0000","last_undegraded":"2024-09-19T15:31:55.710466+0000","last_fullsized":"2024-09-19T15:31:55.710466+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'448","last_scrub_stamp":"2024-09-19T15:31:55.710272+0000","last_deep_scrub":"268'448","last_deep_scrub_stamp":"2024-09-19T15:31:55.710272+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.710272+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:32:09.787284+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":885,"num_read_kb":117461,"num_write":1361,"num_write_kb":54900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"268'910","reported_seq":2419,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.053655+0000","last_change":"2024-09-19T15:32:06.053655+0000","last_active":"2024-09-19T15:32:06.053655+0000","last_peered":"2024-09-19T15:32:06.053655+0000","last_clean":"2024-09-19T15:32:06.053655+0000","last_became_active":"2024-09-19T13:40:36.219017+0000","last_became_peered":"2024-09-19T13:40:36.219017+0000","last_unstale":"2024-09-19T15:32:06.053655+0000","last_undegraded":"2024-09-19T15:32:06.053655+0000","last_fullsized":"2024-09-19T15:32:06.053655+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'910","last_scrub_stamp":"2024-09-19T15:32:06.053447+0000","last_deep_scrub":"268'910","last_deep_scrub_stamp":"2024-09-19T15:32:06.053447+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.053447+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":800,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:14.042097+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5981,"num_read_kb":5463,"num_write":1432,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'347","reported_seq":1032,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.834495+0000","last_change":"2024-09-19T15:31:53.834495+0000","last_active":"2024-09-19T15:31:53.834495+0000","last_peered":"2024-09-19T15:31:53.834495+0000","last_clean":"2024-09-19T15:31:53.834495+0000","last_became_active":"2024-09-19T13:40:34.258251+0000","last_became_peered":"2024-09-19T13:40:34.258251+0000","last_unstale":"2024-09-19T15:31:53.834495+0000","last_undegraded":"2024-09-19T15:31:53.834495+0000","last_fullsized":"2024-09-19T15:31:53.834495+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'347","last_scrub_stamp":"2024-09-19T15:31:53.834285+0000","last_deep_scrub":"268'347","last_deep_scrub_stamp":"2024-09-19T15:31:53.834285+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.834285+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:28:52.290958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":664,"num_read_kb":8565,"num_write":1177,"num_write_kb":30274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'822","reported_seq":2525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.703943+0000","last_change":"2024-09-19T15:32:01.703943+0000","last_active":"2024-09-19T15:32:01.703943+0000","last_peered":"2024-09-19T15:32:01.703943+0000","last_clean":"2024-09-19T15:32:01.703943+0000","last_became_active":"2024-09-19T13:40:36.234463+0000","last_became_peered":"2024-09-19T13:40:36.234463+0000","last_unstale":"2024-09-19T15:32:01.703943+0000","last_undegraded":"2024-09-19T15:32:01.703943+0000","last_fullsized":"2024-09-19T15:32:01.703943+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'822","last_scrub_stamp":"2024-09-19T15:32:01.703761+0000","last_deep_scrub":"268'822","last_deep_scrub_stamp":"2024-09-19T15:32:01.703761+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.703761+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:30:12.604793+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4113,"num_read_kb":3717,"num_write":1084,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2509,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'332","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.789415+0000","last_change":"2024-09-19T15:31:57.789415+0000","last_active":"2024-09-19T15:31:57.789415+0000","last_peered":"2024-09-19T15:31:57.789415+0000","last_clean":"2024-09-19T15:31:57.789415+0000","last_became_active":"2024-09-19T13:40:34.257895+0000","last_became_peered":"2024-09-19T13:40:34.257895+0000","last_unstale":"2024-09-19T15:31:57.789415+0000","last_undegraded":"2024-09-19T15:31:57.789415+0000","last_fullsized":"2024-09-19T15:31:57.789415+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'332","last_scrub_stamp":"2024-09-19T15:31:57.789227+0000","last_deep_scrub":"268'332","last_deep_scrub_stamp":"2024-09-19T15:31:57.789227+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.789227+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:08:45.295282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":616,"num_read_kb":2702,"num_write":1090,"num_write_kb":37833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'365","reported_seq":1065,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.835074+0000","last_change":"2024-09-19T15:31:58.835074+0000","last_active":"2024-09-19T15:31:58.835074+0000","last_peered":"2024-09-19T15:31:58.835074+0000","last_clean":"2024-09-19T15:31:58.835074+0000","last_became_active":"2024-09-19T13:41:05.313139+0000","last_became_peered":"2024-09-19T13:41:05.313139+0000","last_unstale":"2024-09-19T15:31:58.835074+0000","last_undegraded":"2024-09-19T15:31:58.835074+0000","last_fullsized":"2024-09-19T15:31:58.835074+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'365","last_scrub_stamp":"2024-09-19T15:31:58.834854+0000","last_deep_scrub":"268'365","last_deep_scrub_stamp":"2024-09-19T15:31:58.834854+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.834854+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:08.987958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":636,"num_read_kb":5598,"num_write":1148,"num_write_kb":52319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'585","reported_seq":2294,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.715002+0000","last_change":"2024-09-19T15:32:01.715002+0000","last_active":"2024-09-19T15:32:01.715002+0000","last_peered":"2024-09-19T15:32:01.715002+0000","last_clean":"2024-09-19T15:32:01.715002+0000","last_became_active":"2024-09-19T13:40:36.225131+0000","last_became_peered":"2024-09-19T13:40:36.225131+0000","last_unstale":"2024-09-19T15:32:01.715002+0000","last_undegraded":"2024-09-19T15:32:01.715002+0000","last_fullsized":"2024-09-19T15:32:01.715002+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'585","last_scrub_stamp":"2024-09-19T15:32:01.714790+0000","last_deep_scrub":"268'585","last_deep_scrub_stamp":"2024-09-19T15:32:01.714790+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.714790+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":500,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:56.655110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3409,"num_read_kb":3161,"num_write":806,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'423","reported_seq":1193,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.619026+0000","last_change":"2024-09-19T15:31:55.619026+0000","last_active":"2024-09-19T15:31:55.619026+0000","last_peered":"2024-09-19T15:31:55.619026+0000","last_clean":"2024-09-19T15:31:55.619026+0000","last_became_active":"2024-09-19T13:40:34.252585+0000","last_became_peered":"2024-09-19T13:40:34.252585+0000","last_unstale":"2024-09-19T15:31:55.619026+0000","last_undegraded":"2024-09-19T15:31:55.619026+0000","last_fullsized":"2024-09-19T15:31:55.619026+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'423","last_scrub_stamp":"2024-09-19T15:31:55.618823+0000","last_deep_scrub":"268'423","last_deep_scrub_stamp":"2024-09-19T15:31:55.618823+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.618823+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:57.280079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1089,"num_read_kb":22295,"num_write":1244,"num_write_kb":33627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'496","reported_seq":2111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.795339+0000","last_change":"2024-09-19T15:32:06.795339+0000","last_active":"2024-09-19T15:32:06.795339+0000","last_peered":"2024-09-19T15:32:06.795339+0000","last_clean":"2024-09-19T15:32:06.795339+0000","last_became_active":"2024-09-19T13:40:36.232695+0000","last_became_peered":"2024-09-19T13:40:36.232695+0000","last_unstale":"2024-09-19T15:32:06.795339+0000","last_undegraded":"2024-09-19T15:32:06.795339+0000","last_fullsized":"2024-09-19T15:32:06.795339+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'496","last_scrub_stamp":"2024-09-19T15:32:06.795165+0000","last_deep_scrub":"268'496","last_deep_scrub_stamp":"2024-09-19T15:32:06.795165+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.795165+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:10:31.458475+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2752,"num_read_kb":2570,"num_write":600,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":963,"num_omap_keys":4,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10865,"num_read_kb":9021,"num_write":3118,"num_write_kb":1011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1008,"ondisk_log_size":1008,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14601,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":16485,"num_read_kb":16147,"num_write":17047,"num_write_kb":4982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":29202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1794,"ondisk_log_size":1794,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":596,"ondisk_log_size":596,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1631422,"num_objects":200,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":21072,"num_read_kb":40733,"num_write":17629,"num_write_kb":12600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":36192,"num_omap_keys":74,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1804,"ondisk_log_size":1804,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2392,"num_read_kb":2851,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":220859,"num_read_kb":201873,"num_write":56069,"num_write_kb":19197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35455,"num_omap_keys":143,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4148,"ondisk_log_size":4148,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":23942209,"num_objects":277,"num_object_clones":0,"num_object_copies":831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":0,"num_read":44439,"num_read_kb":2347980,"num_write":73000,"num_write_kb":2178675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37318656,"data_stored":37318656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3768,"ondisk_log_size":3768,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":215739,"num_write":161,"num_write_kb":136883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":195259,"num_write":161,"num_write_kb":136883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543496,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296384,"kb_used_data":8368,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94075456,"statfs":{"total":96636764160,"available":96333266944,"internally_reserved":0,"allocated":8568832,"data_stored":6565575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":294910410},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543491,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250764,"kb_used_data":7164,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94121076,"statfs":{"total":96636764160,"available":96379981824,"internally_reserved":0,"allocated":7335936,"data_stored":5380296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":249428422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543494,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149372,"kb_used_data":9964,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94222468,"statfs":{"total":96636764160,"available":96483807232,"internally_reserved":0,"allocated":10203136,"data_stored":8155658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543491,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":115784,"kb_used_data":8248,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94256056,"statfs":{"total":96636764160,"available":96518201344,"internally_reserved":0,"allocated":8445952,"data_stored":6509947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543496,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296544,"kb_used_data":12688,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94075296,"statfs":{"total":96636764160,"available":96333103104,"internally_reserved":0,"allocated":12992512,"data_stored":10993023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":290650567},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543494,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92420,"kb_used_data":7092,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94279420,"statfs":{"total":96636764160,"available":96542126080,"internally_reserved":0,"allocated":7262208,"data_stored":5318104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543492,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":192588,"kb_used_data":8764,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94179252,"statfs":{"total":96636764160,"available":96439554048,"internally_reserved":0,"allocated":8974336,"data_stored":6990912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543492,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":278804,"kb_used_data":8836,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94093036,"statfs":{"total":96636764160,"available":96351268864,"internally_reserved":0,"allocated":9048064,"data_stored":7057331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":276429255},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4157440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4681728,"data_stored":4681728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3010560,"data_stored":3010560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8683520,"data_stored":8683520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4202496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5844992,"data_stored":5844992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3072000,"data_stored":3072000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3665920,"data_stored":3665920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T15:32:08.785 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.785 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.785 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.785 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.785 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.785 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.785 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.785 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.786 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.786 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.786 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.786 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.786 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.786 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.786 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.786 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.786 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.787 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.787 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.787 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.787 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.787 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.787 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.787 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.787 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.787 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.788 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.788 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.788 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.788 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.788 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.788 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.788 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.788 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.788 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.789 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.789 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.789 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.789 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.789 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.789 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.790 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.790 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.790 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.790 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.790 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.790 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.790 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.790 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.790 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.791 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.791 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.791 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.791 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.791 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.791 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.791 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.791 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.791 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.792 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.792 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.792 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.792 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.792 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.792 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.792 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.792 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.792 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.793 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.793 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.793 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.793 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.793 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.793 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.793 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.793 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.793 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.794 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.794 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.794 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.794 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.794 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.794 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.794 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.794 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.794 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.795 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.795 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.795 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.795 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.795 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.795 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.795 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.795 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.795 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.796 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.796 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.796 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.796 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.796 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.796 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.796 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.796 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.796 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.797 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.797 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.797 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.797 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.797 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.797 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.797 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.797 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.797 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.798 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.798 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.798 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.798 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.798 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.798 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.798 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.798 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.798 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.799 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.799 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.799 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.799 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.799 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.799 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-19T13:40:35.185637+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.799 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.800 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.800 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.800 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.800 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.800 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.800 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.800 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.800 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.801 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.801 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.801 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.801 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.801 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.801 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.801 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.801 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.802 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.802 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.802 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.802 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.802 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.802 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.802 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.803 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.803 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.803 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.803 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.803 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.803 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.803 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.803 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.804 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.804 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.804 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.804 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.804 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.804 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.804 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.805 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.805 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.805 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.805 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.805 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.805 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.805 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.805 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.806 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.806 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.806 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.806 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.806 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.806 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.806 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.807 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.807 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.807 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.807 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.807 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.807 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.807 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.807 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.807 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.808 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.808 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.808 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.808 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.808 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.808 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.808 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.809 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.809 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.809 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.809 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.809 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.809 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.809 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.809 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.809 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.810 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.810 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.810 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.810 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.810 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.810 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.810 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.810 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.811 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-19T13:40:37.192400+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=37, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.811 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.811 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.811 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.811 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-19T13:40:39.198484+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=39, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.811 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-19T13:40:41.204505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=41, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.811 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:08.812 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-19T15:32:28.813 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T15:32:29.183 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:32:29.201 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-19T15:32:29.218 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":3627,"stamp":"2024-09-19T15:32:28.672199+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26180412,"num_objects":726,"num_object_clones":0,"num_object_copies":1729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":726,"num_whiteouts":0,"num_read":316475,"num_read_kb":3029670,"num_write":167328,"num_write_kb":2491887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":742935,"num_omap_keys":1796,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13666,"ondisk_log_size":13666,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1676820,"kb_used_data":71124,"kb_used_omap":12,"kb_used_meta":1605555,"kb_avail":753297900,"statfs":{"total":773094113280,"available":771377049600,"internally_reserved":0,"allocated":72830976,"data_stored":56970846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1644088882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":639498,"num_omap_keys":1494,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007880"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:52.644047+0000","last_change":"2024-09-19T14:29:51.038023+0000","last_active":"2024-09-19T15:29:52.644047+0000","last_peered":"2024-09-19T15:29:52.644047+0000","last_clean":"2024-09-19T15:29:52.644047+0000","last_became_active":"2024-09-19T14:29:51.036952+0000","last_became_peered":"2024-09-19T14:29:51.036952+0000","last_unstale":"2024-09-19T15:29:52.644047+0000","last_undegraded":"2024-09-19T15:29:52.644047+0000","last_fullsized":"2024-09-19T15:29:52.644047+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:37.612687+0000","last_change":"2024-09-19T14:02:36.913041+0000","last_active":"2024-09-19T15:27:37.612687+0000","last_peered":"2024-09-19T15:27:37.612687+0000","last_clean":"2024-09-19T15:27:37.612687+0000","last_became_active":"2024-09-19T14:02:36.912307+0000","last_became_peered":"2024-09-19T14:02:36.912307+0000","last_unstale":"2024-09-19T15:27:37.612687+0000","last_undegraded":"2024-09-19T15:27:37.612687+0000","last_fullsized":"2024-09-19T15:27:37.612687+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:18:44.440160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"268'11","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.256849+0000","last_change":"2024-09-19T14:02:29.740551+0000","last_active":"2024-09-19T15:31:38.256849+0000","last_peered":"2024-09-19T15:31:38.256849+0000","last_clean":"2024-09-19T15:31:38.256849+0000","last_became_active":"2024-09-19T14:02:29.739721+0000","last_became_peered":"2024-09-19T14:02:29.739721+0000","last_unstale":"2024-09-19T15:31:38.256849+0000","last_undegraded":"2024-09-19T15:31:38.256849+0000","last_fullsized":"2024-09-19T15:31:38.256849+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:40.747086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":13312,"num_write":21,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'35","reported_seq":169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:12.210655+0000","last_change":"2024-09-19T13:56:23.181765+0000","last_active":"2024-09-19T15:30:12.210655+0000","last_peered":"2024-09-19T15:30:12.210655+0000","last_clean":"2024-09-19T15:30:12.210655+0000","last_became_active":"2024-09-19T13:56:23.180176+0000","last_became_peered":"2024-09-19T13:56:23.180176+0000","last_unstale":"2024-09-19T15:30:12.210655+0000","last_undegraded":"2024-09-19T15:30:12.210655+0000","last_fullsized":"2024-09-19T15:30:12.210655+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":165,"num_write":94,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:17.100705+0000","last_change":"2024-09-19T15:32:17.100562+0000","last_active":"2024-09-19T15:32:17.100705+0000","last_peered":"2024-09-19T15:32:17.100705+0000","last_clean":"2024-09-19T15:32:17.100705+0000","last_became_active":"2024-09-19T14:29:51.038289+0000","last_became_peered":"2024-09-19T14:29:51.038289+0000","last_unstale":"2024-09-19T15:32:17.100705+0000","last_undegraded":"2024-09-19T15:32:17.100705+0000","last_fullsized":"2024-09-19T15:32:17.100705+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:17.100380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:17.100380+0000","last_clean_scrub_stamp":"2024-09-19T15:32:17.100380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:36.465601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'2","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:07.627354+0000","last_change":"2024-09-19T14:02:36.915848+0000","last_active":"2024-09-19T15:30:07.627354+0000","last_peered":"2024-09-19T15:30:07.627354+0000","last_clean":"2024-09-19T15:30:07.627354+0000","last_became_active":"2024-09-19T14:02:36.914769+0000","last_became_peered":"2024-09-19T14:02:36.914769+0000","last_unstale":"2024-09-19T15:30:07.627354+0000","last_undegraded":"2024-09-19T15:30:07.627354+0000","last_fullsized":"2024-09-19T15:30:07.627354+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:22.428331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"268'6","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:20.710105+0000","last_change":"2024-09-19T15:32:20.710105+0000","last_active":"2024-09-19T15:32:20.710105+0000","last_peered":"2024-09-19T15:32:20.710105+0000","last_clean":"2024-09-19T15:32:20.710105+0000","last_became_active":"2024-09-19T14:02:29.747492+0000","last_became_peered":"2024-09-19T14:02:29.747492+0000","last_unstale":"2024-09-19T15:32:20.710105+0000","last_undegraded":"2024-09-19T15:32:20.710105+0000","last_fullsized":"2024-09-19T15:32:20.710105+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-19T15:32:20.709867+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-19T15:32:20.709867+0000","last_clean_scrub_stamp":"2024-09-19T15:32:20.709867+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:29:53.880609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'26","reported_seq":161,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.946687+0000","last_change":"2024-09-19T15:32:08.946687+0000","last_active":"2024-09-19T15:32:08.946687+0000","last_peered":"2024-09-19T15:32:08.946687+0000","last_clean":"2024-09-19T15:32:08.946687+0000","last_became_active":"2024-09-19T13:56:23.173377+0000","last_became_peered":"2024-09-19T13:56:23.173377+0000","last_unstale":"2024-09-19T15:32:08.946687+0000","last_undegraded":"2024-09-19T15:32:08.946687+0000","last_fullsized":"2024-09-19T15:32:08.946687+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-09-19T15:32:08.946505+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-09-19T15:32:08.946505+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.946505+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:48.722723+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":124,"num_write":71,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:24.231760+0000","last_change":"2024-09-19T15:32:24.231760+0000","last_active":"2024-09-19T15:32:24.231760+0000","last_peered":"2024-09-19T15:32:24.231760+0000","last_clean":"2024-09-19T15:32:24.231760+0000","last_became_active":"2024-09-19T14:29:51.039043+0000","last_became_peered":"2024-09-19T14:29:51.039043+0000","last_unstale":"2024-09-19T15:32:24.231760+0000","last_undegraded":"2024-09-19T15:32:24.231760+0000","last_fullsized":"2024-09-19T15:32:24.231760+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:24.231568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:24.231568+0000","last_clean_scrub_stamp":"2024-09-19T15:32:24.231568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:48:11.358259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"268'3","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.315905+0000","last_change":"2024-09-19T14:02:37.054013+0000","last_active":"2024-09-19T15:31:40.315905+0000","last_peered":"2024-09-19T15:31:40.315905+0000","last_clean":"2024-09-19T15:31:40.315905+0000","last_became_active":"2024-09-19T14:02:37.051665+0000","last_became_peered":"2024-09-19T14:02:37.051665+0000","last_unstale":"2024-09-19T15:31:40.315905+0000","last_undegraded":"2024-09-19T15:31:40.315905+0000","last_fullsized":"2024-09-19T15:31:40.315905+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":81,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:13.026322+0000","last_change":"2024-09-19T15:32:13.026322+0000","last_active":"2024-09-19T15:32:13.026322+0000","last_peered":"2024-09-19T15:32:13.026322+0000","last_clean":"2024-09-19T15:32:13.026322+0000","last_became_active":"2024-09-19T14:02:29.724866+0000","last_became_peered":"2024-09-19T14:02:29.724866+0000","last_unstale":"2024-09-19T15:32:13.026322+0000","last_undegraded":"2024-09-19T15:32:13.026322+0000","last_fullsized":"2024-09-19T15:32:13.026322+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:13.026035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:13.026035+0000","last_clean_scrub_stamp":"2024-09-19T15:32:13.026035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:47:17.974515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'36","reported_seq":169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:57.190273+0000","last_change":"2024-09-19T13:56:23.181435+0000","last_active":"2024-09-19T15:28:57.190273+0000","last_peered":"2024-09-19T15:28:57.190273+0000","last_clean":"2024-09-19T15:28:57.190273+0000","last_became_active":"2024-09-19T13:56:23.180159+0000","last_became_peered":"2024-09-19T13:56:23.180159+0000","last_unstale":"2024-09-19T15:28:57.190273+0000","last_undegraded":"2024-09-19T15:28:57.190273+0000","last_fullsized":"2024-09-19T15:28:57.190273+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:34:32.230609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":283,"num_read_kb":171,"num_write":89,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:03.230461+0000","last_change":"2024-09-19T14:29:51.030209+0000","last_active":"2024-09-19T15:28:03.230461+0000","last_peered":"2024-09-19T15:28:03.230461+0000","last_clean":"2024-09-19T15:28:03.230461+0000","last_became_active":"2024-09-19T14:29:51.029426+0000","last_became_peered":"2024-09-19T14:29:51.029426+0000","last_unstale":"2024-09-19T15:28:03.230461+0000","last_undegraded":"2024-09-19T15:28:03.230461+0000","last_fullsized":"2024-09-19T15:28:03.230461+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:42:56.183067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"268'3","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:53.047918+0000","last_change":"2024-09-19T14:02:37.053245+0000","last_active":"2024-09-19T15:30:53.047918+0000","last_peered":"2024-09-19T15:30:53.047918+0000","last_clean":"2024-09-19T15:30:53.047918+0000","last_became_active":"2024-09-19T14:02:37.052510+0000","last_became_peered":"2024-09-19T14:02:37.052510+0000","last_unstale":"2024-09-19T15:30:53.047918+0000","last_undegraded":"2024-09-19T15:30:53.047918+0000","last_fullsized":"2024-09-19T15:30:53.047918+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:25.091691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:02.626302+0000","last_change":"2024-09-19T14:02:29.736849+0000","last_active":"2024-09-19T15:30:02.626302+0000","last_peered":"2024-09-19T15:30:02.626302+0000","last_clean":"2024-09-19T15:30:02.626302+0000","last_became_active":"2024-09-19T14:02:29.736074+0000","last_became_peered":"2024-09-19T14:02:29.736074+0000","last_unstale":"2024-09-19T15:30:02.626302+0000","last_undegraded":"2024-09-19T15:30:02.626302+0000","last_fullsized":"2024-09-19T15:30:02.626302+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'63","reported_seq":244,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:53.242175+0000","last_change":"2024-09-19T13:56:23.179692+0000","last_active":"2024-09-19T15:28:53.242175+0000","last_peered":"2024-09-19T15:28:53.242175+0000","last_clean":"2024-09-19T15:28:53.242175+0000","last_became_active":"2024-09-19T13:56:23.179235+0000","last_became_peered":"2024-09-19T13:56:23.179235+0000","last_unstale":"2024-09-19T15:28:53.242175+0000","last_undegraded":"2024-09-19T15:28:53.242175+0000","last_fullsized":"2024-09-19T15:28:53.242175+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:47.927569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":508,"num_read_kb":362,"num_write":155,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:03.258946+0000","last_change":"2024-09-19T14:29:51.053238+0000","last_active":"2024-09-19T15:30:03.258946+0000","last_peered":"2024-09-19T15:30:03.258946+0000","last_clean":"2024-09-19T15:30:03.258946+0000","last_became_active":"2024-09-19T14:29:51.052562+0000","last_became_peered":"2024-09-19T14:29:51.052562+0000","last_unstale":"2024-09-19T15:30:03.258946+0000","last_undegraded":"2024-09-19T15:30:03.258946+0000","last_fullsized":"2024-09-19T15:30:03.258946+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"268'9","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.375657+0000","last_change":"2024-09-19T14:02:36.931028+0000","last_active":"2024-09-19T15:31:40.375657+0000","last_peered":"2024-09-19T15:31:40.375657+0000","last_clean":"2024-09-19T15:31:40.375657+0000","last_became_active":"2024-09-19T14:02:36.930344+0000","last_became_peered":"2024-09-19T14:02:36.930344+0000","last_unstale":"2024-09-19T15:31:40.375657+0000","last_undegraded":"2024-09-19T15:31:40.375657+0000","last_fullsized":"2024-09-19T15:31:40.375657+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":19,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'8","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.537564+0000","last_change":"2024-09-19T14:02:29.741351+0000","last_active":"2024-09-19T15:31:39.537564+0000","last_peered":"2024-09-19T15:31:39.537564+0000","last_clean":"2024-09-19T15:31:39.537564+0000","last_became_active":"2024-09-19T14:02:29.740291+0000","last_became_peered":"2024-09-19T14:02:29.740291+0000","last_unstale":"2024-09-19T15:31:39.537564+0000","last_undegraded":"2024-09-19T15:31:39.537564+0000","last_fullsized":"2024-09-19T15:31:39.537564+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'10","reported_seq":101,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:53.242112+0000","last_change":"2024-09-19T13:56:23.170087+0000","last_active":"2024-09-19T15:28:53.242112+0000","last_peered":"2024-09-19T15:28:53.242112+0000","last_clean":"2024-09-19T15:28:53.242112+0000","last_became_active":"2024-09-19T13:56:23.169371+0000","last_became_peered":"2024-09-19T13:56:23.169371+0000","last_unstale":"2024-09-19T15:28:53.242112+0000","last_undegraded":"2024-09-19T15:28:53.242112+0000","last_fullsized":"2024-09-19T15:28:53.242112+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:41:15.161070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":43,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:17.409233+0000","last_change":"2024-09-19T14:29:51.049819+0000","last_active":"2024-09-19T15:30:17.409233+0000","last_peered":"2024-09-19T15:30:17.409233+0000","last_clean":"2024-09-19T15:30:17.409233+0000","last_became_active":"2024-09-19T14:29:51.049146+0000","last_became_peered":"2024-09-19T14:29:51.049146+0000","last_unstale":"2024-09-19T15:30:17.409233+0000","last_undegraded":"2024-09-19T15:30:17.409233+0000","last_fullsized":"2024-09-19T15:30:17.409233+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:22.256761+0000","last_change":"2024-09-19T15:32:22.256761+0000","last_active":"2024-09-19T15:32:22.256761+0000","last_peered":"2024-09-19T15:32:22.256761+0000","last_clean":"2024-09-19T15:32:22.256761+0000","last_became_active":"2024-09-19T14:02:36.927382+0000","last_became_peered":"2024-09-19T14:02:36.927382+0000","last_unstale":"2024-09-19T15:32:22.256761+0000","last_undegraded":"2024-09-19T15:32:22.256761+0000","last_fullsized":"2024-09-19T15:32:22.256761+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:22.256572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:22.256572+0000","last_clean_scrub_stamp":"2024-09-19T15:32:22.256572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:39:31.563943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"268'2","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:27.549816+0000","last_change":"2024-09-19T15:32:27.549816+0000","last_active":"2024-09-19T15:32:27.549816+0000","last_peered":"2024-09-19T15:32:27.549816+0000","last_clean":"2024-09-19T15:32:27.549816+0000","last_became_active":"2024-09-19T14:02:29.722193+0000","last_became_peered":"2024-09-19T14:02:29.722193+0000","last_unstale":"2024-09-19T15:32:27.549816+0000","last_undegraded":"2024-09-19T15:32:27.549816+0000","last_fullsized":"2024-09-19T15:32:27.549816+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:27.549627+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:27.549627+0000","last_clean_scrub_stamp":"2024-09-19T15:32:27.549627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:17:01.030933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'21","reported_seq":138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:17.229517+0000","last_change":"2024-09-19T15:32:17.229517+0000","last_active":"2024-09-19T15:32:17.229517+0000","last_peered":"2024-09-19T15:32:17.229517+0000","last_clean":"2024-09-19T15:32:17.229517+0000","last_became_active":"2024-09-19T13:56:23.174511+0000","last_became_peered":"2024-09-19T13:56:23.174511+0000","last_unstale":"2024-09-19T15:32:17.229517+0000","last_undegraded":"2024-09-19T15:32:17.229517+0000","last_fullsized":"2024-09-19T15:32:17.229517+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'21","last_scrub_stamp":"2024-09-19T15:32:17.229340+0000","last_deep_scrub":"268'21","last_deep_scrub_stamp":"2024-09-19T15:32:17.229340+0000","last_clean_scrub_stamp":"2024-09-19T15:32:17.229340+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:46.598126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":102,"num_write":56,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:52.665958+0000","last_change":"2024-09-19T14:29:51.041850+0000","last_active":"2024-09-19T15:29:52.665958+0000","last_peered":"2024-09-19T15:29:52.665958+0000","last_clean":"2024-09-19T15:29:52.665958+0000","last_became_active":"2024-09-19T14:29:51.039919+0000","last_became_peered":"2024-09-19T14:29:51.039919+0000","last_unstale":"2024-09-19T15:29:52.665958+0000","last_undegraded":"2024-09-19T15:29:52.665958+0000","last_fullsized":"2024-09-19T15:29:52.665958+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"265'8","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:21.247760+0000","last_change":"2024-09-19T15:32:21.247760+0000","last_active":"2024-09-19T15:32:21.247760+0000","last_peered":"2024-09-19T15:32:21.247760+0000","last_clean":"2024-09-19T15:32:21.247760+0000","last_became_active":"2024-09-19T14:02:36.918707+0000","last_became_peered":"2024-09-19T14:02:36.918707+0000","last_unstale":"2024-09-19T15:32:21.247760+0000","last_undegraded":"2024-09-19T15:32:21.247760+0000","last_fullsized":"2024-09-19T15:32:21.247760+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-19T15:32:21.247546+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-19T15:32:21.247546+0000","last_clean_scrub_stamp":"2024-09-19T15:32:21.247546+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:16:01.540595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9218,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.591968+0000","last_change":"2024-09-19T14:02:29.740667+0000","last_active":"2024-09-19T15:27:32.591968+0000","last_peered":"2024-09-19T15:27:32.591968+0000","last_clean":"2024-09-19T15:27:32.591968+0000","last_became_active":"2024-09-19T14:02:29.739955+0000","last_became_peered":"2024-09-19T14:02:29.739955+0000","last_unstale":"2024-09-19T15:27:32.591968+0000","last_undegraded":"2024-09-19T15:27:32.591968+0000","last_fullsized":"2024-09-19T15:27:32.591968+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:34:51.448763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'12","reported_seq":107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:47.187823+0000","last_change":"2024-09-19T13:56:23.179307+0000","last_active":"2024-09-19T15:28:47.187823+0000","last_peered":"2024-09-19T15:28:47.187823+0000","last_clean":"2024-09-19T15:28:47.187823+0000","last_became_active":"2024-09-19T13:56:23.170272+0000","last_became_peered":"2024-09-19T13:56:23.170272+0000","last_unstale":"2024-09-19T15:28:47.187823+0000","last_undegraded":"2024-09-19T15:28:47.187823+0000","last_fullsized":"2024-09-19T15:28:47.187823+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:47:57.598767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:52.666039+0000","last_change":"2024-09-19T14:29:51.059050+0000","last_active":"2024-09-19T15:29:52.666039+0000","last_peered":"2024-09-19T15:29:52.666039+0000","last_clean":"2024-09-19T15:29:52.666039+0000","last_became_active":"2024-09-19T14:29:51.058380+0000","last_became_peered":"2024-09-19T14:29:51.058380+0000","last_unstale":"2024-09-19T15:29:52.666039+0000","last_undegraded":"2024-09-19T15:29:52.666039+0000","last_fullsized":"2024-09-19T15:29:52.666039+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:38.224574+0000","last_change":"2024-09-19T14:02:36.926259+0000","last_active":"2024-09-19T15:27:38.224574+0000","last_peered":"2024-09-19T15:27:38.224574+0000","last_clean":"2024-09-19T15:27:38.224574+0000","last_became_active":"2024-09-19T14:02:36.924268+0000","last_became_peered":"2024-09-19T14:02:36.924268+0000","last_unstale":"2024-09-19T15:27:38.224574+0000","last_undegraded":"2024-09-19T15:27:38.224574+0000","last_fullsized":"2024-09-19T15:27:38.224574+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:52.337740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:32.171539+0000","last_change":"2024-09-19T14:02:29.745987+0000","last_active":"2024-09-19T15:27:32.171539+0000","last_peered":"2024-09-19T15:27:32.171539+0000","last_clean":"2024-09-19T15:27:32.171539+0000","last_became_active":"2024-09-19T14:02:29.741114+0000","last_became_peered":"2024-09-19T14:02:29.741114+0000","last_unstale":"2024-09-19T15:27:32.171539+0000","last_undegraded":"2024-09-19T15:27:32.171539+0000","last_fullsized":"2024-09-19T15:27:32.171539+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:25:21.115185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"268'44","reported_seq":200,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:15.627129+0000","last_change":"2024-09-19T15:32:15.627129+0000","last_active":"2024-09-19T15:32:15.627129+0000","last_peered":"2024-09-19T15:32:15.627129+0000","last_clean":"2024-09-19T15:32:15.627129+0000","last_became_active":"2024-09-19T13:56:23.177082+0000","last_became_peered":"2024-09-19T13:56:23.177082+0000","last_unstale":"2024-09-19T15:32:15.627129+0000","last_undegraded":"2024-09-19T15:32:15.627129+0000","last_fullsized":"2024-09-19T15:32:15.627129+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'44","last_scrub_stamp":"2024-09-19T15:32:15.626942+0000","last_deep_scrub":"268'44","last_deep_scrub_stamp":"2024-09-19T15:32:15.626942+0000","last_clean_scrub_stamp":"2024-09-19T15:32:15.626942+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:17:49.667859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":229,"num_write":111,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.381366+0000","last_change":"2024-09-19T14:29:51.037911+0000","last_active":"2024-09-19T15:28:12.381366+0000","last_peered":"2024-09-19T15:28:12.381366+0000","last_clean":"2024-09-19T15:28:12.381366+0000","last_became_active":"2024-09-19T14:29:51.036980+0000","last_became_peered":"2024-09-19T14:29:51.036980+0000","last_unstale":"2024-09-19T15:28:12.381366+0000","last_undegraded":"2024-09-19T15:28:12.381366+0000","last_fullsized":"2024-09-19T15:28:12.381366+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:55.591300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:38.252715+0000","last_change":"2024-09-19T14:02:37.052547+0000","last_active":"2024-09-19T15:29:38.252715+0000","last_peered":"2024-09-19T15:29:38.252715+0000","last_clean":"2024-09-19T15:29:38.252715+0000","last_became_active":"2024-09-19T14:02:37.051627+0000","last_became_peered":"2024-09-19T14:02:37.051627+0000","last_unstale":"2024-09-19T15:29:38.252715+0000","last_undegraded":"2024-09-19T15:29:38.252715+0000","last_fullsized":"2024-09-19T15:29:38.252715+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'10","reported_seq":87,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:32.668758+0000","last_change":"2024-09-19T14:02:29.725819+0000","last_active":"2024-09-19T15:31:32.668758+0000","last_peered":"2024-09-19T15:31:32.668758+0000","last_clean":"2024-09-19T15:31:32.668758+0000","last_became_active":"2024-09-19T14:02:29.725042+0000","last_became_peered":"2024-09-19T14:02:29.725042+0000","last_unstale":"2024-09-19T15:31:32.668758+0000","last_undegraded":"2024-09-19T15:31:32.668758+0000","last_fullsized":"2024-09-19T15:31:32.668758+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:36.488155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":17453,"num_write":15,"num_write_kb":14381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'39","reported_seq":188,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:26.488438+0000","last_change":"2024-09-19T15:32:26.488438+0000","last_active":"2024-09-19T15:32:26.488438+0000","last_peered":"2024-09-19T15:32:26.488438+0000","last_clean":"2024-09-19T15:32:26.488438+0000","last_became_active":"2024-09-19T13:56:23.179656+0000","last_became_peered":"2024-09-19T13:56:23.179656+0000","last_unstale":"2024-09-19T15:32:26.488438+0000","last_undegraded":"2024-09-19T15:32:26.488438+0000","last_fullsized":"2024-09-19T15:32:26.488438+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'39","last_scrub_stamp":"2024-09-19T15:32:26.488259+0000","last_deep_scrub":"268'39","last_deep_scrub_stamp":"2024-09-19T15:32:26.488259+0000","last_clean_scrub_stamp":"2024-09-19T15:32:26.488259+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:14:34.206551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":202,"num_write":114,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'2","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:15.053751+0000","last_change":"2024-09-19T15:32:15.053751+0000","last_active":"2024-09-19T15:32:15.053751+0000","last_peered":"2024-09-19T15:32:15.053751+0000","last_clean":"2024-09-19T15:32:15.053751+0000","last_became_active":"2024-09-19T14:29:51.034910+0000","last_became_peered":"2024-09-19T14:29:51.034910+0000","last_unstale":"2024-09-19T15:32:15.053751+0000","last_undegraded":"2024-09-19T15:32:15.053751+0000","last_fullsized":"2024-09-19T15:32:15.053751+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:15.053568+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:15.053568+0000","last_clean_scrub_stamp":"2024-09-19T15:32:15.053568+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:48:53.440303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"268'5","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.702266+0000","last_change":"2024-09-19T14:02:37.050424+0000","last_active":"2024-09-19T15:31:38.702266+0000","last_peered":"2024-09-19T15:31:38.702266+0000","last_clean":"2024-09-19T15:31:38.702266+0000","last_became_active":"2024-09-19T14:02:37.049593+0000","last_became_peered":"2024-09-19T14:02:37.049593+0000","last_unstale":"2024-09-19T15:31:38.702266+0000","last_undegraded":"2024-09-19T15:31:38.702266+0000","last_fullsized":"2024-09-19T15:31:38.702266+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:09.018084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":571,"num_write":10,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"268'7","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.846254+0000","last_change":"2024-09-19T14:02:29.738371+0000","last_active":"2024-09-19T15:31:38.846254+0000","last_peered":"2024-09-19T15:31:38.846254+0000","last_clean":"2024-09-19T15:31:38.846254+0000","last_became_active":"2024-09-19T14:02:29.737689+0000","last_became_peered":"2024-09-19T14:02:29.737689+0000","last_unstale":"2024-09-19T15:31:38.846254+0000","last_undegraded":"2024-09-19T15:31:38.846254+0000","last_fullsized":"2024-09-19T15:31:38.846254+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5718,"num_write":7,"num_write_kb":5718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'32","reported_seq":159,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:13.233083+0000","last_change":"2024-09-19T13:56:23.172875+0000","last_active":"2024-09-19T15:28:13.233083+0000","last_peered":"2024-09-19T15:28:13.233083+0000","last_clean":"2024-09-19T15:28:13.233083+0000","last_became_active":"2024-09-19T13:56:23.172185+0000","last_became_peered":"2024-09-19T13:56:23.172185+0000","last_unstale":"2024-09-19T15:28:13.233083+0000","last_undegraded":"2024-09-19T15:28:13.233083+0000","last_fullsized":"2024-09-19T15:28:13.233083+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:08:40.622542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":246,"num_read_kb":158,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.641708+0000","last_change":"2024-09-19T14:29:51.040551+0000","last_active":"2024-09-19T15:28:12.641708+0000","last_peered":"2024-09-19T15:28:12.641708+0000","last_clean":"2024-09-19T15:28:12.641708+0000","last_became_active":"2024-09-19T14:29:51.039877+0000","last_became_peered":"2024-09-19T14:29:51.039877+0000","last_unstale":"2024-09-19T15:28:12.641708+0000","last_undegraded":"2024-09-19T15:28:12.641708+0000","last_fullsized":"2024-09-19T15:28:12.641708+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:34:37.191773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"268'11","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.677847+0000","last_change":"2024-09-19T14:02:37.055970+0000","last_active":"2024-09-19T15:31:39.677847+0000","last_peered":"2024-09-19T15:31:39.677847+0000","last_clean":"2024-09-19T15:31:39.677847+0000","last_became_active":"2024-09-19T14:02:37.055184+0000","last_became_peered":"2024-09-19T14:02:37.055184+0000","last_unstale":"2024-09-19T15:31:39.677847+0000","last_undegraded":"2024-09-19T15:31:39.677847+0000","last_fullsized":"2024-09-19T15:31:39.677847+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":24576,"num_write":21,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"268'3","reported_seq":81,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:11.976816+0000","last_change":"2024-09-19T15:32:11.976816+0000","last_active":"2024-09-19T15:32:11.976816+0000","last_peered":"2024-09-19T15:32:11.976816+0000","last_clean":"2024-09-19T15:32:11.976816+0000","last_became_active":"2024-09-19T14:02:29.732063+0000","last_became_peered":"2024-09-19T14:02:29.732063+0000","last_unstale":"2024-09-19T15:32:11.976816+0000","last_undegraded":"2024-09-19T15:32:11.976816+0000","last_fullsized":"2024-09-19T15:32:11.976816+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:11.976624+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:11.976624+0000","last_clean_scrub_stamp":"2024-09-19T15:32:11.976624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:43:10.588819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'18","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.967647+0000","last_change":"2024-09-19T15:32:07.967647+0000","last_active":"2024-09-19T15:32:07.967647+0000","last_peered":"2024-09-19T15:32:07.967647+0000","last_clean":"2024-09-19T15:32:07.967647+0000","last_became_active":"2024-09-19T13:56:23.172998+0000","last_became_peered":"2024-09-19T13:56:23.172998+0000","last_unstale":"2024-09-19T15:32:07.967647+0000","last_undegraded":"2024-09-19T15:32:07.967647+0000","last_fullsized":"2024-09-19T15:32:07.967647+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'18","last_scrub_stamp":"2024-09-19T15:32:07.967355+0000","last_deep_scrub":"268'18","last_deep_scrub_stamp":"2024-09-19T15:32:07.967355+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.967355+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:41:09.208852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:12.620591+0000","last_change":"2024-09-19T14:29:51.021155+0000","last_active":"2024-09-19T15:28:12.620591+0000","last_peered":"2024-09-19T15:28:12.620591+0000","last_clean":"2024-09-19T15:28:12.620591+0000","last_became_active":"2024-09-19T14:29:51.020277+0000","last_became_peered":"2024-09-19T14:29:51.020277+0000","last_unstale":"2024-09-19T15:28:12.620591+0000","last_undegraded":"2024-09-19T15:28:12.620591+0000","last_fullsized":"2024-09-19T15:28:12.620591+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:00.755087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"268'3","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:40.013694+0000","last_change":"2024-09-19T14:02:36.916711+0000","last_active":"2024-09-19T15:31:40.013694+0000","last_peered":"2024-09-19T15:31:40.013694+0000","last_clean":"2024-09-19T15:31:40.013694+0000","last_became_active":"2024-09-19T14:02:36.915962+0000","last_became_peered":"2024-09-19T14:02:36.915962+0000","last_unstale":"2024-09-19T15:31:40.013694+0000","last_undegraded":"2024-09-19T15:31:40.013694+0000","last_fullsized":"2024-09-19T15:31:40.013694+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:32.198886+0000","last_change":"2024-09-19T14:02:29.746541+0000","last_active":"2024-09-19T15:29:32.198886+0000","last_peered":"2024-09-19T15:29:32.198886+0000","last_clean":"2024-09-19T15:29:32.198886+0000","last_became_active":"2024-09-19T14:02:29.741726+0000","last_became_peered":"2024-09-19T14:02:29.741726+0000","last_unstale":"2024-09-19T15:29:32.198886+0000","last_undegraded":"2024-09-19T15:29:32.198886+0000","last_fullsized":"2024-09-19T15:29:32.198886+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'18","reported_seq":129,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:25.646726+0000","last_change":"2024-09-19T15:32:25.646726+0000","last_active":"2024-09-19T15:32:25.646726+0000","last_peered":"2024-09-19T15:32:25.646726+0000","last_clean":"2024-09-19T15:32:25.646726+0000","last_became_active":"2024-09-19T13:56:23.175483+0000","last_became_peered":"2024-09-19T13:56:23.175483+0000","last_unstale":"2024-09-19T15:32:25.646726+0000","last_undegraded":"2024-09-19T15:32:25.646726+0000","last_fullsized":"2024-09-19T15:32:25.646726+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'18","last_scrub_stamp":"2024-09-19T15:32:25.646546+0000","last_deep_scrub":"268'18","last_deep_scrub_stamp":"2024-09-19T15:32:25.646546+0000","last_clean_scrub_stamp":"2024-09-19T15:32:25.646546+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:43:11.573506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":81,"num_write":47,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:53.228080+0000","last_change":"2024-09-19T14:29:51.055111+0000","last_active":"2024-09-19T15:27:53.228080+0000","last_peered":"2024-09-19T15:27:53.228080+0000","last_clean":"2024-09-19T15:27:53.228080+0000","last_became_active":"2024-09-19T14:29:51.054440+0000","last_became_peered":"2024-09-19T14:29:51.054440+0000","last_unstale":"2024-09-19T15:27:53.228080+0000","last_undegraded":"2024-09-19T15:27:53.228080+0000","last_fullsized":"2024-09-19T15:27:53.228080+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:41:52.609606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:24.733196+0000","last_change":"2024-09-19T15:32:24.733196+0000","last_active":"2024-09-19T15:32:24.733196+0000","last_peered":"2024-09-19T15:32:24.733196+0000","last_clean":"2024-09-19T15:32:24.733196+0000","last_became_active":"2024-09-19T14:02:36.917886+0000","last_became_peered":"2024-09-19T14:02:36.917886+0000","last_unstale":"2024-09-19T15:32:24.733196+0000","last_undegraded":"2024-09-19T15:32:24.733196+0000","last_fullsized":"2024-09-19T15:32:24.733196+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:24.733018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:24.733018+0000","last_clean_scrub_stamp":"2024-09-19T15:32:24.733018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:18:44.716865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"268'3","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:26.557957+0000","last_change":"2024-09-19T15:32:26.557957+0000","last_active":"2024-09-19T15:32:26.557957+0000","last_peered":"2024-09-19T15:32:26.557957+0000","last_clean":"2024-09-19T15:32:26.557957+0000","last_became_active":"2024-09-19T14:02:29.730095+0000","last_became_peered":"2024-09-19T14:02:29.730095+0000","last_unstale":"2024-09-19T15:32:26.557957+0000","last_undegraded":"2024-09-19T15:32:26.557957+0000","last_fullsized":"2024-09-19T15:32:26.557957+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:26.557775+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:26.557775+0000","last_clean_scrub_stamp":"2024-09-19T15:32:26.557775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:20:23.909493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'29","reported_seq":157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:26.672788+0000","last_change":"2024-09-19T15:32:26.672788+0000","last_active":"2024-09-19T15:32:26.672788+0000","last_peered":"2024-09-19T15:32:26.672788+0000","last_clean":"2024-09-19T15:32:26.672788+0000","last_became_active":"2024-09-19T13:56:23.183825+0000","last_became_peered":"2024-09-19T13:56:23.183825+0000","last_unstale":"2024-09-19T15:32:26.672788+0000","last_undegraded":"2024-09-19T15:32:26.672788+0000","last_fullsized":"2024-09-19T15:32:26.672788+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'29","last_scrub_stamp":"2024-09-19T15:32:26.672589+0000","last_deep_scrub":"268'29","last_deep_scrub_stamp":"2024-09-19T15:32:26.672589+0000","last_clean_scrub_stamp":"2024-09-19T15:32:26.672589+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:27.804236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":139,"num_write":76,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:52.175719+0000","last_change":"2024-09-19T14:29:51.036785+0000","last_active":"2024-09-19T15:27:52.175719+0000","last_peered":"2024-09-19T15:27:52.175719+0000","last_clean":"2024-09-19T15:27:52.175719+0000","last_became_active":"2024-09-19T14:29:51.036062+0000","last_became_peered":"2024-09-19T14:29:51.036062+0000","last_unstale":"2024-09-19T15:27:52.175719+0000","last_undegraded":"2024-09-19T15:27:52.175719+0000","last_fullsized":"2024-09-19T15:27:52.175719+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:13:16.540530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'3","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:25.742701+0000","last_change":"2024-09-19T15:32:25.742701+0000","last_active":"2024-09-19T15:32:25.742701+0000","last_peered":"2024-09-19T15:32:25.742701+0000","last_clean":"2024-09-19T15:32:25.742701+0000","last_became_active":"2024-09-19T14:02:36.910298+0000","last_became_peered":"2024-09-19T14:02:36.910298+0000","last_unstale":"2024-09-19T15:32:25.742701+0000","last_undegraded":"2024-09-19T15:32:25.742701+0000","last_fullsized":"2024-09-19T15:32:25.742701+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-19T15:32:25.742469+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-19T15:32:25.742469+0000","last_clean_scrub_stamp":"2024-09-19T15:32:25.742469+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:01.917327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'3","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:13.052551+0000","last_change":"2024-09-19T14:02:29.734818+0000","last_active":"2024-09-19T15:31:13.052551+0000","last_peered":"2024-09-19T15:31:13.052551+0000","last_clean":"2024-09-19T15:31:13.052551+0000","last_became_active":"2024-09-19T14:02:29.732413+0000","last_became_peered":"2024-09-19T14:02:29.732413+0000","last_unstale":"2024-09-19T15:31:13.052551+0000","last_undegraded":"2024-09-19T15:31:13.052551+0000","last_fullsized":"2024-09-19T15:31:13.052551+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:35.923776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"268'52","reported_seq":223,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:25.518320+0000","last_change":"2024-09-19T15:32:25.518320+0000","last_active":"2024-09-19T15:32:25.518320+0000","last_peered":"2024-09-19T15:32:25.518320+0000","last_clean":"2024-09-19T15:32:25.518320+0000","last_became_active":"2024-09-19T13:56:23.161268+0000","last_became_peered":"2024-09-19T13:56:23.161268+0000","last_unstale":"2024-09-19T15:32:25.518320+0000","last_undegraded":"2024-09-19T15:32:25.518320+0000","last_fullsized":"2024-09-19T15:32:25.518320+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'52","last_scrub_stamp":"2024-09-19T15:32:25.518067+0000","last_deep_scrub":"268'52","last_deep_scrub_stamp":"2024-09-19T15:32:25.518067+0000","last_clean_scrub_stamp":"2024-09-19T15:32:25.518067+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:01.595629+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":413,"num_read_kb":272,"num_write":131,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:32.184540+0000","last_change":"2024-09-19T14:29:51.057255+0000","last_active":"2024-09-19T15:28:32.184540+0000","last_peered":"2024-09-19T15:28:32.184540+0000","last_clean":"2024-09-19T15:28:32.184540+0000","last_became_active":"2024-09-19T14:29:51.055396+0000","last_became_peered":"2024-09-19T14:29:51.055396+0000","last_unstale":"2024-09-19T15:28:32.184540+0000","last_undegraded":"2024-09-19T15:28:32.184540+0000","last_fullsized":"2024-09-19T15:28:32.184540+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:36:09.497977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:58.243369+0000","last_change":"2024-09-19T14:02:36.927347+0000","last_active":"2024-09-19T15:28:58.243369+0000","last_peered":"2024-09-19T15:28:58.243369+0000","last_clean":"2024-09-19T15:28:58.243369+0000","last_became_active":"2024-09-19T14:02:36.926038+0000","last_became_peered":"2024-09-19T14:02:36.926038+0000","last_unstale":"2024-09-19T15:28:58.243369+0000","last_undegraded":"2024-09-19T15:28:58.243369+0000","last_fullsized":"2024-09-19T15:28:58.243369+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:13:52.343458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"268'6","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:18.192988+0000","last_change":"2024-09-19T15:32:18.192988+0000","last_active":"2024-09-19T15:32:18.192988+0000","last_peered":"2024-09-19T15:32:18.192988+0000","last_clean":"2024-09-19T15:32:18.192988+0000","last_became_active":"2024-09-19T14:02:29.740451+0000","last_became_peered":"2024-09-19T14:02:29.740451+0000","last_unstale":"2024-09-19T15:32:18.192988+0000","last_undegraded":"2024-09-19T15:32:18.192988+0000","last_fullsized":"2024-09-19T15:32:18.192988+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-19T15:32:18.192767+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-19T15:32:18.192767+0000","last_clean_scrub_stamp":"2024-09-19T15:32:18.192767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:13:07.938345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'35","reported_seq":182,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:25.585607+0000","last_change":"2024-09-19T15:32:25.585607+0000","last_active":"2024-09-19T15:32:25.585607+0000","last_peered":"2024-09-19T15:32:25.585607+0000","last_clean":"2024-09-19T15:32:25.585607+0000","last_became_active":"2024-09-19T13:56:23.170486+0000","last_became_peered":"2024-09-19T13:56:23.170486+0000","last_unstale":"2024-09-19T15:32:25.585607+0000","last_undegraded":"2024-09-19T15:32:25.585607+0000","last_fullsized":"2024-09-19T15:32:25.585607+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'35","last_scrub_stamp":"2024-09-19T15:32:25.585436+0000","last_deep_scrub":"268'35","last_deep_scrub_stamp":"2024-09-19T15:32:25.585436+0000","last_clean_scrub_stamp":"2024-09-19T15:32:25.585436+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:57.333276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":196,"num_write":86,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:27:53.227989+0000","last_change":"2024-09-19T14:29:51.045330+0000","last_active":"2024-09-19T15:27:53.227989+0000","last_peered":"2024-09-19T15:27:53.227989+0000","last_clean":"2024-09-19T15:27:53.227989+0000","last_became_active":"2024-09-19T14:29:51.044154+0000","last_became_peered":"2024-09-19T14:29:51.044154+0000","last_unstale":"2024-09-19T15:27:53.227989+0000","last_undegraded":"2024-09-19T15:27:53.227989+0000","last_fullsized":"2024-09-19T15:27:53.227989+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:18.797951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'2","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:20.205390+0000","last_change":"2024-09-19T15:32:20.205390+0000","last_active":"2024-09-19T15:32:20.205390+0000","last_peered":"2024-09-19T15:32:20.205390+0000","last_clean":"2024-09-19T15:32:20.205390+0000","last_became_active":"2024-09-19T14:02:36.918735+0000","last_became_peered":"2024-09-19T14:02:36.918735+0000","last_unstale":"2024-09-19T15:32:20.205390+0000","last_undegraded":"2024-09-19T15:32:20.205390+0000","last_fullsized":"2024-09-19T15:32:20.205390+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-19T15:32:20.205204+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-19T15:32:20.205204+0000","last_clean_scrub_stamp":"2024-09-19T15:32:20.205204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:58.167806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:52.629773+0000","last_change":"2024-09-19T14:02:29.742726+0000","last_active":"2024-09-19T15:28:52.629773+0000","last_peered":"2024-09-19T15:28:52.629773+0000","last_clean":"2024-09-19T15:28:52.629773+0000","last_became_active":"2024-09-19T14:02:29.742091+0000","last_became_peered":"2024-09-19T14:02:29.742091+0000","last_unstale":"2024-09-19T15:28:52.629773+0000","last_undegraded":"2024-09-19T15:28:52.629773+0000","last_fullsized":"2024-09-19T15:28:52.629773+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:13:04.562095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'40","reported_seq":181,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:43.253717+0000","last_change":"2024-09-19T13:56:23.173987+0000","last_active":"2024-09-19T15:29:43.253717+0000","last_peered":"2024-09-19T15:29:43.253717+0000","last_clean":"2024-09-19T15:29:43.253717+0000","last_became_active":"2024-09-19T13:56:23.173245+0000","last_became_peered":"2024-09-19T13:56:23.173245+0000","last_unstale":"2024-09-19T15:29:43.253717+0000","last_undegraded":"2024-09-19T15:29:43.253717+0000","last_fullsized":"2024-09-19T15:29:43.253717+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":315,"num_read_kb":214,"num_write":104,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:16.051373+0000","last_change":"2024-09-19T15:32:16.051373+0000","last_active":"2024-09-19T15:32:16.051373+0000","last_peered":"2024-09-19T15:32:16.051373+0000","last_clean":"2024-09-19T15:32:16.051373+0000","last_became_active":"2024-09-19T14:29:51.043979+0000","last_became_peered":"2024-09-19T14:29:51.043979+0000","last_unstale":"2024-09-19T15:32:16.051373+0000","last_undegraded":"2024-09-19T15:32:16.051373+0000","last_fullsized":"2024-09-19T15:32:16.051373+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:16.051172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:16.051172+0000","last_clean_scrub_stamp":"2024-09-19T15:32:16.051172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:17.401042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"268'2","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:23.263179+0000","last_change":"2024-09-19T14:02:36.926635+0000","last_active":"2024-09-19T15:30:23.263179+0000","last_peered":"2024-09-19T15:30:23.263179+0000","last_clean":"2024-09-19T15:30:23.263179+0000","last_became_active":"2024-09-19T14:02:36.925870+0000","last_became_peered":"2024-09-19T14:02:36.925870+0000","last_unstale":"2024-09-19T15:30:23.263179+0000","last_undegraded":"2024-09-19T15:30:23.263179+0000","last_fullsized":"2024-09-19T15:30:23.263179+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:50:58.009640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.639477+0000","last_change":"2024-09-19T14:02:29.745325+0000","last_active":"2024-09-19T15:28:02.639477+0000","last_peered":"2024-09-19T15:28:02.639477+0000","last_clean":"2024-09-19T15:28:02.639477+0000","last_became_active":"2024-09-19T14:02:29.744169+0000","last_became_peered":"2024-09-19T14:02:29.744169+0000","last_unstale":"2024-09-19T15:28:02.639477+0000","last_undegraded":"2024-09-19T15:28:02.639477+0000","last_fullsized":"2024-09-19T15:28:02.639477+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:49:32.607973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'31","reported_seq":167,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:48.241100+0000","last_change":"2024-09-19T13:56:23.167169+0000","last_active":"2024-09-19T15:28:48.241100+0000","last_peered":"2024-09-19T15:28:48.241100+0000","last_clean":"2024-09-19T15:28:48.241100+0000","last_became_active":"2024-09-19T13:56:23.160134+0000","last_became_peered":"2024-09-19T13:56:23.160134+0000","last_unstale":"2024-09-19T15:28:48.241100+0000","last_undegraded":"2024-09-19T15:28:48.241100+0000","last_fullsized":"2024-09-19T15:28:48.241100+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:17.424039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":163,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644264+0000","last_change":"2024-09-19T14:29:51.059018+0000","last_active":"2024-09-19T15:28:22.644264+0000","last_peered":"2024-09-19T15:28:22.644264+0000","last_clean":"2024-09-19T15:28:22.644264+0000","last_became_active":"2024-09-19T14:29:51.058494+0000","last_became_peered":"2024-09-19T14:29:51.058494+0000","last_unstale":"2024-09-19T15:28:22.644264+0000","last_undegraded":"2024-09-19T15:28:22.644264+0000","last_fullsized":"2024-09-19T15:28:22.644264+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:29.224657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":62,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:08.231677+0000","last_change":"2024-09-19T14:02:36.924847+0000","last_active":"2024-09-19T15:28:08.231677+0000","last_peered":"2024-09-19T15:28:08.231677+0000","last_clean":"2024-09-19T15:28:08.231677+0000","last_became_active":"2024-09-19T14:02:36.924213+0000","last_became_peered":"2024-09-19T14:02:36.924213+0000","last_unstale":"2024-09-19T15:28:08.231677+0000","last_undegraded":"2024-09-19T15:28:08.231677+0000","last_fullsized":"2024-09-19T15:28:08.231677+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:25.039869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:10.946761+0000","last_change":"2024-09-19T15:32:10.946761+0000","last_active":"2024-09-19T15:32:10.946761+0000","last_peered":"2024-09-19T15:32:10.946761+0000","last_clean":"2024-09-19T15:32:10.946761+0000","last_became_active":"2024-09-19T14:02:29.751229+0000","last_became_peered":"2024-09-19T14:02:29.751229+0000","last_unstale":"2024-09-19T15:32:10.946761+0000","last_undegraded":"2024-09-19T15:32:10.946761+0000","last_fullsized":"2024-09-19T15:32:10.946761+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:10.946572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:10.946572+0000","last_clean_scrub_stamp":"2024-09-19T15:32:10.946572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:11:22.828742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"268'30","reported_seq":164,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:26.587599+0000","last_change":"2024-09-19T15:32:26.587599+0000","last_active":"2024-09-19T15:32:26.587599+0000","last_peered":"2024-09-19T15:32:26.587599+0000","last_clean":"2024-09-19T15:32:26.587599+0000","last_became_active":"2024-09-19T13:56:23.166406+0000","last_became_peered":"2024-09-19T13:56:23.166406+0000","last_unstale":"2024-09-19T15:32:26.587599+0000","last_undegraded":"2024-09-19T15:32:26.587599+0000","last_fullsized":"2024-09-19T15:32:26.587599+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-09-19T15:32:26.587412+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-09-19T15:32:26.587412+0000","last_clean_scrub_stamp":"2024-09-19T15:32:26.587412+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:39:35.546888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":158,"num_write":72,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:23.251155+0000","last_change":"2024-09-19T15:32:23.251155+0000","last_active":"2024-09-19T15:32:23.251155+0000","last_peered":"2024-09-19T15:32:23.251155+0000","last_clean":"2024-09-19T15:32:23.251155+0000","last_became_active":"2024-09-19T14:29:51.050808+0000","last_became_peered":"2024-09-19T14:29:51.050808+0000","last_unstale":"2024-09-19T15:32:23.251155+0000","last_undegraded":"2024-09-19T15:32:23.251155+0000","last_fullsized":"2024-09-19T15:32:23.251155+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:23.250978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:23.250978+0000","last_clean_scrub_stamp":"2024-09-19T15:32:23.250978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:49:49.918319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"268'3","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:23.728755+0000","last_change":"2024-09-19T15:32:23.728755+0000","last_active":"2024-09-19T15:32:23.728755+0000","last_peered":"2024-09-19T15:32:23.728755+0000","last_clean":"2024-09-19T15:32:23.728755+0000","last_became_active":"2024-09-19T14:02:37.052121+0000","last_became_peered":"2024-09-19T14:02:37.052121+0000","last_unstale":"2024-09-19T15:32:23.728755+0000","last_undegraded":"2024-09-19T15:32:23.728755+0000","last_fullsized":"2024-09-19T15:32:23.728755+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:23.728572+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:23.728572+0000","last_clean_scrub_stamp":"2024-09-19T15:32:23.728572+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:41:47.058406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:02.178139+0000","last_change":"2024-09-19T14:02:29.749448+0000","last_active":"2024-09-19T15:28:02.178139+0000","last_peered":"2024-09-19T15:28:02.178139+0000","last_clean":"2024-09-19T15:28:02.178139+0000","last_became_active":"2024-09-19T14:02:29.748469+0000","last_became_peered":"2024-09-19T14:02:29.748469+0000","last_unstale":"2024-09-19T15:28:02.178139+0000","last_undegraded":"2024-09-19T15:28:02.178139+0000","last_fullsized":"2024-09-19T15:28:02.178139+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:25.962511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"268'120","reported_seq":448,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:15.141891+0000","last_change":"2024-09-19T15:32:15.141891+0000","last_active":"2024-09-19T15:32:15.141891+0000","last_peered":"2024-09-19T15:32:15.141891+0000","last_clean":"2024-09-19T15:32:15.141891+0000","last_became_active":"2024-09-19T13:56:23.164737+0000","last_became_peered":"2024-09-19T13:56:23.164737+0000","last_unstale":"2024-09-19T15:32:15.141891+0000","last_undegraded":"2024-09-19T15:32:15.141891+0000","last_fullsized":"2024-09-19T15:32:15.141891+0000","mapping_epoch":255,"log_start":"265'100","ondisk_log_start":"265'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'120","last_scrub_stamp":"2024-09-19T15:32:15.141719+0000","last_deep_scrub":"268'120","last_deep_scrub_stamp":"2024-09-19T15:32:15.141719+0000","last_clean_scrub_stamp":"2024-09-19T15:32:15.141719+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:28:48.051613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1135,"num_read_kb":1191,"num_write":240,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644185+0000","last_change":"2024-09-19T14:29:51.024362+0000","last_active":"2024-09-19T15:28:22.644185+0000","last_peered":"2024-09-19T15:28:22.644185+0000","last_clean":"2024-09-19T15:28:22.644185+0000","last_became_active":"2024-09-19T14:29:51.022975+0000","last_became_peered":"2024-09-19T14:29:51.022975+0000","last_unstale":"2024-09-19T15:28:22.644185+0000","last_undegraded":"2024-09-19T15:28:22.644185+0000","last_fullsized":"2024-09-19T15:28:22.644185+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:44:44.124646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"268'3","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:23.263213+0000","last_change":"2024-09-19T14:02:36.926595+0000","last_active":"2024-09-19T15:30:23.263213+0000","last_peered":"2024-09-19T15:30:23.263213+0000","last_clean":"2024-09-19T15:30:23.263213+0000","last_became_active":"2024-09-19T14:02:36.924349+0000","last_became_peered":"2024-09-19T14:02:36.924349+0000","last_unstale":"2024-09-19T15:30:23.263213+0000","last_undegraded":"2024-09-19T15:30:23.263213+0000","last_fullsized":"2024-09-19T15:30:23.263213+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:10.123769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:18.662215+0000","last_change":"2024-09-19T15:32:18.662215+0000","last_active":"2024-09-19T15:32:18.662215+0000","last_peered":"2024-09-19T15:32:18.662215+0000","last_clean":"2024-09-19T15:32:18.662215+0000","last_became_active":"2024-09-19T14:02:29.730280+0000","last_became_peered":"2024-09-19T14:02:29.730280+0000","last_unstale":"2024-09-19T15:32:18.662215+0000","last_undegraded":"2024-09-19T15:32:18.662215+0000","last_fullsized":"2024-09-19T15:32:18.662215+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:18.662024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:18.662024+0000","last_clean_scrub_stamp":"2024-09-19T15:32:18.662024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:44:59.899540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'28","reported_seq":157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.948745+0000","last_change":"2024-09-19T15:32:05.948745+0000","last_active":"2024-09-19T15:32:05.948745+0000","last_peered":"2024-09-19T15:32:05.948745+0000","last_clean":"2024-09-19T15:32:05.948745+0000","last_became_active":"2024-09-19T13:56:23.182103+0000","last_became_peered":"2024-09-19T13:56:23.182103+0000","last_unstale":"2024-09-19T15:32:05.948745+0000","last_undegraded":"2024-09-19T15:32:05.948745+0000","last_fullsized":"2024-09-19T15:32:05.948745+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'28","last_scrub_stamp":"2024-09-19T15:32:05.948526+0000","last_deep_scrub":"268'28","last_deep_scrub_stamp":"2024-09-19T15:32:05.948526+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.948526+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:07:24.807541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":141,"num_write":72,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:23.235388+0000","last_change":"2024-09-19T14:29:51.030844+0000","last_active":"2024-09-19T15:28:23.235388+0000","last_peered":"2024-09-19T15:28:23.235388+0000","last_clean":"2024-09-19T15:28:23.235388+0000","last_became_active":"2024-09-19T14:29:51.030200+0000","last_became_peered":"2024-09-19T14:29:51.030200+0000","last_unstale":"2024-09-19T15:28:23.235388+0000","last_undegraded":"2024-09-19T15:28:23.235388+0000","last_fullsized":"2024-09-19T15:28:23.235388+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:34:22.342028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"265'3","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:17.616101+0000","last_change":"2024-09-19T14:02:36.929045+0000","last_active":"2024-09-19T15:29:17.616101+0000","last_peered":"2024-09-19T15:29:17.616101+0000","last_clean":"2024-09-19T15:29:17.616101+0000","last_became_active":"2024-09-19T14:02:36.927585+0000","last_became_peered":"2024-09-19T14:02:36.927585+0000","last_unstale":"2024-09-19T15:29:17.616101+0000","last_undegraded":"2024-09-19T15:29:17.616101+0000","last_fullsized":"2024-09-19T15:29:17.616101+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:44:02.469367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"265'5","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:12.194026+0000","last_change":"2024-09-19T14:02:29.740714+0000","last_active":"2024-09-19T15:29:12.194026+0000","last_peered":"2024-09-19T15:29:12.194026+0000","last_clean":"2024-09-19T15:29:12.194026+0000","last_became_active":"2024-09-19T14:02:29.739469+0000","last_became_peered":"2024-09-19T14:02:29.739469+0000","last_unstale":"2024-09-19T15:29:12.194026+0000","last_undegraded":"2024-09-19T15:29:12.194026+0000","last_fullsized":"2024-09-19T15:29:12.194026+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:23.314643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'26","reported_seq":153,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:23.573569+0000","last_change":"2024-09-19T15:32:23.573569+0000","last_active":"2024-09-19T15:32:23.573569+0000","last_peered":"2024-09-19T15:32:23.573569+0000","last_clean":"2024-09-19T15:32:23.573569+0000","last_became_active":"2024-09-19T13:56:23.170897+0000","last_became_peered":"2024-09-19T13:56:23.170897+0000","last_unstale":"2024-09-19T15:32:23.573569+0000","last_undegraded":"2024-09-19T15:32:23.573569+0000","last_fullsized":"2024-09-19T15:32:23.573569+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-09-19T15:32:23.573388+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-09-19T15:32:23.573388+0000","last_clean_scrub_stamp":"2024-09-19T15:32:23.573388+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:11:45.786011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":129,"num_write":67,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:32.646832+0000","last_change":"2024-09-19T14:29:51.047203+0000","last_active":"2024-09-19T15:28:32.646832+0000","last_peered":"2024-09-19T15:28:32.646832+0000","last_clean":"2024-09-19T15:28:32.646832+0000","last_became_active":"2024-09-19T14:29:51.046273+0000","last_became_peered":"2024-09-19T14:29:51.046273+0000","last_unstale":"2024-09-19T15:28:32.646832+0000","last_undegraded":"2024-09-19T15:28:32.646832+0000","last_fullsized":"2024-09-19T15:28:32.646832+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:15.605088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"268'8","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:27.688771+0000","last_change":"2024-09-19T14:02:37.051538+0000","last_active":"2024-09-19T15:31:27.688771+0000","last_peered":"2024-09-19T15:31:27.688771+0000","last_clean":"2024-09-19T15:31:27.688771+0000","last_became_active":"2024-09-19T14:02:37.050689+0000","last_became_peered":"2024-09-19T14:02:37.050689+0000","last_unstale":"2024-09-19T15:31:27.688771+0000","last_undegraded":"2024-09-19T15:31:27.688771+0000","last_fullsized":"2024-09-19T15:31:27.688771+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:21.698768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32770,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"265'5","reported_seq":93,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:17.636019+0000","last_change":"2024-09-19T15:32:17.636019+0000","last_active":"2024-09-19T15:32:17.636019+0000","last_peered":"2024-09-19T15:32:17.636019+0000","last_clean":"2024-09-19T15:32:17.636019+0000","last_became_active":"2024-09-19T14:02:29.730624+0000","last_became_peered":"2024-09-19T14:02:29.730624+0000","last_unstale":"2024-09-19T15:32:17.636019+0000","last_undegraded":"2024-09-19T15:32:17.636019+0000","last_fullsized":"2024-09-19T15:32:17.636019+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-19T15:32:17.635821+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-19T15:32:17.635821+0000","last_clean_scrub_stamp":"2024-09-19T15:32:17.635821+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:32:00.090008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'5","reported_seq":99,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:24.596943+0000","last_change":"2024-09-19T15:32:24.596943+0000","last_active":"2024-09-19T15:32:24.596943+0000","last_peered":"2024-09-19T15:32:24.596943+0000","last_clean":"2024-09-19T15:32:24.596943+0000","last_became_active":"2024-09-19T13:56:23.181867+0000","last_became_peered":"2024-09-19T13:56:23.181867+0000","last_unstale":"2024-09-19T15:32:24.596943+0000","last_undegraded":"2024-09-19T15:32:24.596943+0000","last_fullsized":"2024-09-19T15:32:24.596943+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-19T15:32:24.596657+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-19T15:32:24.596657+0000","last_clean_scrub_stamp":"2024-09-19T15:32:24.596657+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:15.545868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644309+0000","last_change":"2024-09-19T14:29:51.037068+0000","last_active":"2024-09-19T15:28:22.644309+0000","last_peered":"2024-09-19T15:28:22.644309+0000","last_clean":"2024-09-19T15:28:22.644309+0000","last_became_active":"2024-09-19T14:29:51.036292+0000","last_became_peered":"2024-09-19T14:29:51.036292+0000","last_unstale":"2024-09-19T15:28:22.644309+0000","last_undegraded":"2024-09-19T15:28:22.644309+0000","last_fullsized":"2024-09-19T15:28:22.644309+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:12.187433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"268'2","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:22.708237+0000","last_change":"2024-09-19T15:32:22.708237+0000","last_active":"2024-09-19T15:32:22.708237+0000","last_peered":"2024-09-19T15:32:22.708237+0000","last_clean":"2024-09-19T15:32:22.708237+0000","last_became_active":"2024-09-19T14:02:36.923500+0000","last_became_peered":"2024-09-19T14:02:36.923500+0000","last_unstale":"2024-09-19T15:32:22.708237+0000","last_undegraded":"2024-09-19T15:32:22.708237+0000","last_fullsized":"2024-09-19T15:32:22.708237+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:22.708046+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:22.708046+0000","last_clean_scrub_stamp":"2024-09-19T15:32:22.708046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:52:30.468832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'3","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.099729+0000","last_change":"2024-09-19T14:02:29.746888+0000","last_active":"2024-09-19T15:31:39.099729+0000","last_peered":"2024-09-19T15:31:39.099729+0000","last_clean":"2024-09-19T15:31:39.099729+0000","last_became_active":"2024-09-19T14:02:29.746148+0000","last_became_peered":"2024-09-19T14:02:29.746148+0000","last_unstale":"2024-09-19T15:31:39.099729+0000","last_undegraded":"2024-09-19T15:31:39.099729+0000","last_fullsized":"2024-09-19T15:31:39.099729+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'41","reported_seq":188,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:33.251302+0000","last_change":"2024-09-19T13:56:23.174360+0000","last_active":"2024-09-19T15:29:33.251302+0000","last_peered":"2024-09-19T15:29:33.251302+0000","last_clean":"2024-09-19T15:29:33.251302+0000","last_became_active":"2024-09-19T13:56:23.173918+0000","last_became_peered":"2024-09-19T13:56:23.173918+0000","last_unstale":"2024-09-19T15:29:33.251302+0000","last_undegraded":"2024-09-19T15:29:33.251302+0000","last_fullsized":"2024-09-19T15:29:33.251302+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:56:22.119877+0000","last_clean_scrub_stamp":"2024-09-19T13:56:22.119877+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:23.496354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":206,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.182455+0000","last_change":"2024-09-19T14:29:51.034137+0000","last_active":"2024-09-19T15:28:22.182455+0000","last_peered":"2024-09-19T15:28:22.182455+0000","last_clean":"2024-09-19T15:28:22.182455+0000","last_became_active":"2024-09-19T14:29:51.033329+0000","last_became_peered":"2024-09-19T14:29:51.033329+0000","last_unstale":"2024-09-19T15:28:22.182455+0000","last_undegraded":"2024-09-19T15:28:22.182455+0000","last_fullsized":"2024-09-19T15:28:22.182455+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:09.961864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'5","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:37.662441+0000","last_change":"2024-09-19T14:03:07.396429+0000","last_active":"2024-09-19T15:29:37.662441+0000","last_peered":"2024-09-19T15:29:37.662441+0000","last_clean":"2024-09-19T15:29:37.662441+0000","last_became_active":"2024-09-19T14:03:07.395844+0000","last_became_peered":"2024-09-19T14:03:07.395844+0000","last_unstale":"2024-09-19T15:29:37.662441+0000","last_undegraded":"2024-09-19T15:29:37.662441+0000","last_fullsized":"2024-09-19T15:29:37.662441+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:30.854364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5147,"num_write":5,"num_write_kb":5147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'3","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:24.563688+0000","last_change":"2024-09-19T15:32:24.563688+0000","last_active":"2024-09-19T15:32:24.563688+0000","last_peered":"2024-09-19T15:32:24.563688+0000","last_clean":"2024-09-19T15:32:24.563688+0000","last_became_active":"2024-09-19T14:02:29.732416+0000","last_became_peered":"2024-09-19T14:02:29.732416+0000","last_unstale":"2024-09-19T15:32:24.563688+0000","last_undegraded":"2024-09-19T15:32:24.563688+0000","last_fullsized":"2024-09-19T15:32:24.563688+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-19T15:32:24.563464+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-19T15:32:24.563464+0000","last_clean_scrub_stamp":"2024-09-19T15:32:24.563464+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:52:11.908670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'38","reported_seq":196,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:14.109983+0000","last_change":"2024-09-19T15:32:14.109983+0000","last_active":"2024-09-19T15:32:14.109983+0000","last_peered":"2024-09-19T15:32:14.109983+0000","last_clean":"2024-09-19T15:32:14.109983+0000","last_became_active":"2024-09-19T13:56:23.172437+0000","last_became_peered":"2024-09-19T13:56:23.172437+0000","last_unstale":"2024-09-19T15:32:14.109983+0000","last_undegraded":"2024-09-19T15:32:14.109983+0000","last_fullsized":"2024-09-19T15:32:14.109983+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'38","last_scrub_stamp":"2024-09-19T15:32:14.109805+0000","last_deep_scrub":"268'38","last_deep_scrub_stamp":"2024-09-19T15:32:14.109805+0000","last_clean_scrub_stamp":"2024-09-19T15:32:14.109805+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:23.811311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":311,"num_read_kb":193,"num_write":96,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:17.671745+0000","last_change":"2024-09-19T14:29:51.037099+0000","last_active":"2024-09-19T15:30:17.671745+0000","last_peered":"2024-09-19T15:30:17.671745+0000","last_clean":"2024-09-19T15:30:17.671745+0000","last_became_active":"2024-09-19T14:29:51.036386+0000","last_became_peered":"2024-09-19T14:29:51.036386+0000","last_unstale":"2024-09-19T15:30:17.671745+0000","last_undegraded":"2024-09-19T15:30:17.671745+0000","last_fullsized":"2024-09-19T15:30:17.671745+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:32.184569+0000","last_change":"2024-09-19T14:02:36.913472+0000","last_active":"2024-09-19T15:28:32.184569+0000","last_peered":"2024-09-19T15:28:32.184569+0000","last_clean":"2024-09-19T15:28:32.184569+0000","last_became_active":"2024-09-19T14:02:36.912757+0000","last_became_peered":"2024-09-19T14:02:36.912757+0000","last_unstale":"2024-09-19T15:28:32.184569+0000","last_undegraded":"2024-09-19T15:28:32.184569+0000","last_fullsized":"2024-09-19T15:28:32.184569+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:28.705324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"268'3","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:39.017160+0000","last_change":"2024-09-19T14:02:29.726496+0000","last_active":"2024-09-19T15:31:39.017160+0000","last_peered":"2024-09-19T15:31:39.017160+0000","last_clean":"2024-09-19T15:31:39.017160+0000","last_became_active":"2024-09-19T14:02:29.725707+0000","last_became_peered":"2024-09-19T14:02:29.725707+0000","last_unstale":"2024-09-19T15:31:39.017160+0000","last_undegraded":"2024-09-19T15:31:39.017160+0000","last_fullsized":"2024-09-19T15:31:39.017160+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'2","reported_seq":93,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:24.542932+0000","last_change":"2024-09-19T15:32:24.542932+0000","last_active":"2024-09-19T15:32:24.542932+0000","last_peered":"2024-09-19T15:32:24.542932+0000","last_clean":"2024-09-19T15:32:24.542932+0000","last_became_active":"2024-09-19T13:56:23.180518+0000","last_became_peered":"2024-09-19T13:56:23.180518+0000","last_unstale":"2024-09-19T15:32:24.542932+0000","last_undegraded":"2024-09-19T15:32:24.542932+0000","last_fullsized":"2024-09-19T15:32:24.542932+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:24.542742+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:24.542742+0000","last_clean_scrub_stamp":"2024-09-19T15:32:24.542742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:35.344874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:17.650063+0000","last_change":"2024-09-19T14:29:51.030804+0000","last_active":"2024-09-19T15:30:17.650063+0000","last_peered":"2024-09-19T15:30:17.650063+0000","last_clean":"2024-09-19T15:30:17.650063+0000","last_became_active":"2024-09-19T14:29:51.030021+0000","last_became_peered":"2024-09-19T14:29:51.030021+0000","last_unstale":"2024-09-19T15:30:17.650063+0000","last_undegraded":"2024-09-19T15:30:17.650063+0000","last_fullsized":"2024-09-19T15:30:17.650063+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"265'3","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:07.209529+0000","last_change":"2024-09-19T14:02:37.052572+0000","last_active":"2024-09-19T15:30:07.209529+0000","last_peered":"2024-09-19T15:30:07.209529+0000","last_clean":"2024-09-19T15:30:07.209529+0000","last_became_active":"2024-09-19T14:02:37.051567+0000","last_became_peered":"2024-09-19T14:02:37.051567+0000","last_unstale":"2024-09-19T15:30:07.209529+0000","last_undegraded":"2024-09-19T15:30:07.209529+0000","last_fullsized":"2024-09-19T15:30:07.209529+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:09.942600+0000","last_change":"2024-09-19T15:32:09.942445+0000","last_active":"2024-09-19T15:32:09.942600+0000","last_peered":"2024-09-19T15:32:09.942600+0000","last_clean":"2024-09-19T15:32:09.942600+0000","last_became_active":"2024-09-19T14:02:29.747539+0000","last_became_peered":"2024-09-19T14:02:29.747539+0000","last_unstale":"2024-09-19T15:32:09.942600+0000","last_undegraded":"2024-09-19T15:32:09.942600+0000","last_fullsized":"2024-09-19T15:32:09.942600+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:09.942261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:09.942261+0000","last_clean_scrub_stamp":"2024-09-19T15:32:09.942261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:10:00.802028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"268'12","reported_seq":118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:13.085399+0000","last_change":"2024-09-19T15:32:13.085399+0000","last_active":"2024-09-19T15:32:13.085399+0000","last_peered":"2024-09-19T15:32:13.085399+0000","last_clean":"2024-09-19T15:32:13.085399+0000","last_became_active":"2024-09-19T13:56:23.173882+0000","last_became_peered":"2024-09-19T13:56:23.173882+0000","last_unstale":"2024-09-19T15:32:13.085399+0000","last_undegraded":"2024-09-19T15:32:13.085399+0000","last_fullsized":"2024-09-19T15:32:13.085399+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'12","last_scrub_stamp":"2024-09-19T15:32:13.085210+0000","last_deep_scrub":"268'12","last_deep_scrub_stamp":"2024-09-19T15:32:13.085210+0000","last_clean_scrub_stamp":"2024-09-19T15:32:13.085210+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:08:01.896984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":61,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:26.783029+0000","last_change":"2024-09-19T15:32:26.783029+0000","last_active":"2024-09-19T15:32:26.783029+0000","last_peered":"2024-09-19T15:32:26.783029+0000","last_clean":"2024-09-19T15:32:26.783029+0000","last_became_active":"2024-09-19T14:29:51.049356+0000","last_became_peered":"2024-09-19T14:29:51.049356+0000","last_unstale":"2024-09-19T15:32:26.783029+0000","last_undegraded":"2024-09-19T15:32:26.783029+0000","last_fullsized":"2024-09-19T15:32:26.783029+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:26.782842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:26.782842+0000","last_clean_scrub_stamp":"2024-09-19T15:32:26.782842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:24.086928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"268'8","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:27.688992+0000","last_change":"2024-09-19T14:02:37.057637+0000","last_active":"2024-09-19T15:31:27.688992+0000","last_peered":"2024-09-19T15:31:27.688992+0000","last_clean":"2024-09-19T15:31:27.688992+0000","last_became_active":"2024-09-19T14:02:37.056814+0000","last_became_peered":"2024-09-19T14:02:37.056814+0000","last_unstale":"2024-09-19T15:31:27.688992+0000","last_undegraded":"2024-09-19T15:31:27.688992+0000","last_fullsized":"2024-09-19T15:31:27.688992+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:04:44.022820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:27.609272+0000","last_change":"2024-09-19T15:32:27.609272+0000","last_active":"2024-09-19T15:32:27.609272+0000","last_peered":"2024-09-19T15:32:27.609272+0000","last_clean":"2024-09-19T15:32:27.609272+0000","last_became_active":"2024-09-19T14:02:29.723298+0000","last_became_peered":"2024-09-19T14:02:29.723298+0000","last_unstale":"2024-09-19T15:32:27.609272+0000","last_undegraded":"2024-09-19T15:32:27.609272+0000","last_fullsized":"2024-09-19T15:32:27.609272+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:27.609094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:27.609094+0000","last_clean_scrub_stamp":"2024-09-19T15:32:27.609094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:06.843611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'20","reported_seq":142,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:23.617681+0000","last_change":"2024-09-19T15:32:23.617681+0000","last_active":"2024-09-19T15:32:23.617681+0000","last_peered":"2024-09-19T15:32:23.617681+0000","last_clean":"2024-09-19T15:32:23.617681+0000","last_became_active":"2024-09-19T13:56:23.189485+0000","last_became_peered":"2024-09-19T13:56:23.189485+0000","last_unstale":"2024-09-19T15:32:23.617681+0000","last_undegraded":"2024-09-19T15:32:23.617681+0000","last_fullsized":"2024-09-19T15:32:23.617681+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'20","last_scrub_stamp":"2024-09-19T15:32:23.617397+0000","last_deep_scrub":"265'20","last_deep_scrub_stamp":"2024-09-19T15:32:23.617397+0000","last_clean_scrub_stamp":"2024-09-19T15:32:23.617397+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:00.650819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":106,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:17.629350+0000","last_change":"2024-09-19T14:29:51.029750+0000","last_active":"2024-09-19T15:30:17.629350+0000","last_peered":"2024-09-19T15:30:17.629350+0000","last_clean":"2024-09-19T15:30:17.629350+0000","last_became_active":"2024-09-19T14:29:51.028866+0000","last_became_peered":"2024-09-19T14:29:51.028866+0000","last_unstale":"2024-09-19T15:30:17.629350+0000","last_undegraded":"2024-09-19T15:30:17.629350+0000","last_fullsized":"2024-09-19T15:30:17.629350+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'5","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:38.469786+0000","last_change":"2024-09-19T14:02:36.917356+0000","last_active":"2024-09-19T15:31:38.469786+0000","last_peered":"2024-09-19T15:31:38.469786+0000","last_clean":"2024-09-19T15:31:38.469786+0000","last_became_active":"2024-09-19T14:02:36.916389+0000","last_became_peered":"2024-09-19T14:02:36.916389+0000","last_unstale":"2024-09-19T15:31:38.469786+0000","last_undegraded":"2024-09-19T15:31:38.469786+0000","last_fullsized":"2024-09-19T15:31:38.469786+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:02.036578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12336,"num_write":5,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"268'8","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:22.687755+0000","last_change":"2024-09-19T14:02:29.741915+0000","last_active":"2024-09-19T15:31:22.687755+0000","last_peered":"2024-09-19T15:31:22.687755+0000","last_clean":"2024-09-19T15:31:22.687755+0000","last_became_active":"2024-09-19T14:02:29.740227+0000","last_became_peered":"2024-09-19T14:02:29.740227+0000","last_unstale":"2024-09-19T15:31:22.687755+0000","last_undegraded":"2024-09-19T15:31:22.687755+0000","last_fullsized":"2024-09-19T15:31:22.687755+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:46.277985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":9218,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'41","reported_seq":199,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:14.653040+0000","last_change":"2024-09-19T15:32:14.653040+0000","last_active":"2024-09-19T15:32:14.653040+0000","last_peered":"2024-09-19T15:32:14.653040+0000","last_clean":"2024-09-19T15:32:14.653040+0000","last_became_active":"2024-09-19T13:56:23.173938+0000","last_became_peered":"2024-09-19T13:56:23.173938+0000","last_unstale":"2024-09-19T15:32:14.653040+0000","last_undegraded":"2024-09-19T15:32:14.653040+0000","last_fullsized":"2024-09-19T15:32:14.653040+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'41","last_scrub_stamp":"2024-09-19T15:32:14.652854+0000","last_deep_scrub":"268'41","last_deep_scrub_stamp":"2024-09-19T15:32:14.652854+0000","last_clean_scrub_stamp":"2024-09-19T15:32:14.652854+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:00:20.171224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":330,"num_read_kb":229,"num_write":110,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"268'2","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:14.028442+0000","last_change":"2024-09-19T15:32:14.028442+0000","last_active":"2024-09-19T15:32:14.028442+0000","last_peered":"2024-09-19T15:32:14.028442+0000","last_clean":"2024-09-19T15:32:14.028442+0000","last_became_active":"2024-09-19T14:29:51.025959+0000","last_became_peered":"2024-09-19T14:29:51.025959+0000","last_unstale":"2024-09-19T15:32:14.028442+0000","last_undegraded":"2024-09-19T15:32:14.028442+0000","last_fullsized":"2024-09-19T15:32:14.028442+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:14.028271+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:14.028271+0000","last_clean_scrub_stamp":"2024-09-19T15:32:14.028271+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:00.080778+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:21.694777+0000","last_change":"2024-09-19T15:32:21.694777+0000","last_active":"2024-09-19T15:32:21.694777+0000","last_peered":"2024-09-19T15:32:21.694777+0000","last_clean":"2024-09-19T15:32:21.694777+0000","last_became_active":"2024-09-19T14:02:36.911804+0000","last_became_peered":"2024-09-19T14:02:36.911804+0000","last_unstale":"2024-09-19T15:32:21.694777+0000","last_undegraded":"2024-09-19T15:32:21.694777+0000","last_fullsized":"2024-09-19T15:32:21.694777+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:21.694597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:21.694597+0000","last_clean_scrub_stamp":"2024-09-19T15:32:21.694597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:52.219045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"268'8","reported_seq":97,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:27.646410+0000","last_change":"2024-09-19T15:32:27.646410+0000","last_active":"2024-09-19T15:32:27.646410+0000","last_peered":"2024-09-19T15:32:27.646410+0000","last_clean":"2024-09-19T15:32:27.646410+0000","last_became_active":"2024-09-19T14:02:29.747553+0000","last_became_peered":"2024-09-19T14:02:29.747553+0000","last_unstale":"2024-09-19T15:32:27.646410+0000","last_undegraded":"2024-09-19T15:32:27.646410+0000","last_fullsized":"2024-09-19T15:32:27.646410+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-19T15:32:27.646219+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-19T15:32:27.646219+0000","last_clean_scrub_stamp":"2024-09-19T15:32:27.646219+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:19.597519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":21504,"num_write":8,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'275","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:25.562184+0000","last_change":"2024-09-19T15:32:25.562184+0000","last_active":"2024-09-19T15:32:25.562184+0000","last_peered":"2024-09-19T15:32:25.562184+0000","last_clean":"2024-09-19T15:32:25.562184+0000","last_became_active":"2024-09-19T13:56:23.185522+0000","last_became_peered":"2024-09-19T13:56:23.185522+0000","last_unstale":"2024-09-19T15:32:25.562184+0000","last_undegraded":"2024-09-19T15:32:25.562184+0000","last_fullsized":"2024-09-19T15:32:25.562184+0000","mapping_epoch":255,"log_start":"265'200","ondisk_log_start":"265'200","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'275","last_scrub_stamp":"2024-09-19T15:32:25.561999+0000","last_deep_scrub":"268'275","last_deep_scrub_stamp":"2024-09-19T15:32:25.561999+0000","last_clean_scrub_stamp":"2024-09-19T15:32:25.561999+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:58.252254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2606,"num_read_kb":3112,"num_write":537,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.182535+0000","last_change":"2024-09-19T14:29:51.043009+0000","last_active":"2024-09-19T15:28:22.182535+0000","last_peered":"2024-09-19T15:28:22.182535+0000","last_clean":"2024-09-19T15:28:22.182535+0000","last_became_active":"2024-09-19T14:29:51.042287+0000","last_became_peered":"2024-09-19T14:29:51.042287+0000","last_unstale":"2024-09-19T15:28:22.182535+0000","last_undegraded":"2024-09-19T15:28:22.182535+0000","last_fullsized":"2024-09-19T15:28:22.182535+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:00:55.357725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"268'3","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:57.659838+0000","last_change":"2024-09-19T14:02:36.913575+0000","last_active":"2024-09-19T15:30:57.659838+0000","last_peered":"2024-09-19T15:30:57.659838+0000","last_clean":"2024-09-19T15:30:57.659838+0000","last_became_active":"2024-09-19T14:02:36.912642+0000","last_became_peered":"2024-09-19T14:02:36.912642+0000","last_unstale":"2024-09-19T15:30:57.659838+0000","last_undegraded":"2024-09-19T15:30:57.659838+0000","last_fullsized":"2024-09-19T15:30:57.659838+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:53.289654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":72,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:02.668215+0000","last_change":"2024-09-19T14:02:29.740640+0000","last_active":"2024-09-19T15:30:02.668215+0000","last_peered":"2024-09-19T15:30:02.668215+0000","last_clean":"2024-09-19T15:30:02.668215+0000","last_became_active":"2024-09-19T14:02:29.739397+0000","last_became_peered":"2024-09-19T14:02:29.739397+0000","last_unstale":"2024-09-19T15:30:02.668215+0000","last_undegraded":"2024-09-19T15:30:02.668215+0000","last_fullsized":"2024-09-19T15:30:02.668215+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:28.688896+0000","last_clean_scrub_stamp":"2024-09-19T14:02:28.688896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'26","reported_seq":164,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:23.513521+0000","last_change":"2024-09-19T15:32:23.513521+0000","last_active":"2024-09-19T15:32:23.513521+0000","last_peered":"2024-09-19T15:32:23.513521+0000","last_clean":"2024-09-19T15:32:23.513521+0000","last_became_active":"2024-09-19T13:56:23.178722+0000","last_became_peered":"2024-09-19T13:56:23.178722+0000","last_unstale":"2024-09-19T15:32:23.513521+0000","last_undegraded":"2024-09-19T15:32:23.513521+0000","last_fullsized":"2024-09-19T15:32:23.513521+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-09-19T15:32:23.513292+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-09-19T15:32:23.513292+0000","last_clean_scrub_stamp":"2024-09-19T15:32:23.513292+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:23.938059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":137,"num_write":65,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:17.211450+0000","last_change":"2024-09-19T14:29:51.040094+0000","last_active":"2024-09-19T15:30:17.211450+0000","last_peered":"2024-09-19T15:30:17.211450+0000","last_clean":"2024-09-19T15:30:17.211450+0000","last_became_active":"2024-09-19T14:29:51.037398+0000","last_became_peered":"2024-09-19T14:29:51.037398+0000","last_unstale":"2024-09-19T15:30:17.211450+0000","last_undegraded":"2024-09-19T15:30:17.211450+0000","last_fullsized":"2024-09-19T15:30:17.211450+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:19.232551+0000","last_change":"2024-09-19T15:32:19.232551+0000","last_active":"2024-09-19T15:32:19.232551+0000","last_peered":"2024-09-19T15:32:19.232551+0000","last_clean":"2024-09-19T15:32:19.232551+0000","last_became_active":"2024-09-19T14:02:36.928598+0000","last_became_peered":"2024-09-19T14:02:36.928598+0000","last_unstale":"2024-09-19T15:32:19.232551+0000","last_undegraded":"2024-09-19T15:32:19.232551+0000","last_fullsized":"2024-09-19T15:32:19.232551+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:19.232356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:19.232356+0000","last_clean_scrub_stamp":"2024-09-19T15:32:19.232356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:27:19.465367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"268'2","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:19.690478+0000","last_change":"2024-09-19T15:32:19.690478+0000","last_active":"2024-09-19T15:32:19.690478+0000","last_peered":"2024-09-19T15:32:19.690478+0000","last_clean":"2024-09-19T15:32:19.690478+0000","last_became_active":"2024-09-19T14:02:29.737082+0000","last_became_peered":"2024-09-19T14:02:29.737082+0000","last_unstale":"2024-09-19T15:32:19.690478+0000","last_undegraded":"2024-09-19T15:32:19.690478+0000","last_fullsized":"2024-09-19T15:32:19.690478+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:19.690288+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:19.690288+0000","last_clean_scrub_stamp":"2024-09-19T15:32:19.690288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:59:41.042363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'51","reported_seq":231,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:12.092894+0000","last_change":"2024-09-19T15:32:12.092747+0000","last_active":"2024-09-19T15:32:12.092894+0000","last_peered":"2024-09-19T15:32:12.092894+0000","last_clean":"2024-09-19T15:32:12.092894+0000","last_became_active":"2024-09-19T13:56:23.173172+0000","last_became_peered":"2024-09-19T13:56:23.173172+0000","last_unstale":"2024-09-19T15:32:12.092894+0000","last_undegraded":"2024-09-19T15:32:12.092894+0000","last_fullsized":"2024-09-19T15:32:12.092894+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'51","last_scrub_stamp":"2024-09-19T15:32:12.092566+0000","last_deep_scrub":"268'51","last_deep_scrub_stamp":"2024-09-19T15:32:12.092566+0000","last_clean_scrub_stamp":"2024-09-19T15:32:12.092566+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:04:40.498969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":432,"num_read_kb":295,"num_write":119,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:22.644369+0000","last_change":"2024-09-19T14:29:51.048750+0000","last_active":"2024-09-19T15:28:22.644369+0000","last_peered":"2024-09-19T15:28:22.644369+0000","last_clean":"2024-09-19T15:28:22.644369+0000","last_became_active":"2024-09-19T14:29:51.047826+0000","last_became_peered":"2024-09-19T14:29:51.047826+0000","last_unstale":"2024-09-19T15:28:22.644369+0000","last_undegraded":"2024-09-19T15:28:22.644369+0000","last_fullsized":"2024-09-19T15:28:22.644369+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:59:01.510352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'5","reported_seq":81,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:07.627231+0000","last_change":"2024-09-19T14:02:36.910670+0000","last_active":"2024-09-19T15:30:07.627231+0000","last_peered":"2024-09-19T15:30:07.627231+0000","last_clean":"2024-09-19T15:30:07.627231+0000","last_became_active":"2024-09-19T14:02:36.910154+0000","last_became_peered":"2024-09-19T14:02:36.910154+0000","last_unstale":"2024-09-19T15:30:07.627231+0000","last_undegraded":"2024-09-19T15:30:07.627231+0000","last_fullsized":"2024-09-19T15:30:07.627231+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:02:35.861753+0000","last_clean_scrub_stamp":"2024-09-19T14:02:35.861753+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"268'2","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:16.181486+0000","last_change":"2024-09-19T15:32:16.181486+0000","last_active":"2024-09-19T15:32:16.181486+0000","last_peered":"2024-09-19T15:32:16.181486+0000","last_clean":"2024-09-19T15:32:16.181486+0000","last_became_active":"2024-09-19T14:02:29.723084+0000","last_became_peered":"2024-09-19T14:02:29.723084+0000","last_unstale":"2024-09-19T15:32:16.181486+0000","last_undegraded":"2024-09-19T15:32:16.181486+0000","last_fullsized":"2024-09-19T15:32:16.181486+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:16.181300+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:16.181300+0000","last_clean_scrub_stamp":"2024-09-19T15:32:16.181300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:13:52.521060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'52","reported_seq":225,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:22.596581+0000","last_change":"2024-09-19T15:32:22.596581+0000","last_active":"2024-09-19T15:32:22.596581+0000","last_peered":"2024-09-19T15:32:22.596581+0000","last_clean":"2024-09-19T15:32:22.596581+0000","last_became_active":"2024-09-19T13:56:23.181354+0000","last_became_peered":"2024-09-19T13:56:23.181354+0000","last_unstale":"2024-09-19T15:32:22.596581+0000","last_undegraded":"2024-09-19T15:32:22.596581+0000","last_fullsized":"2024-09-19T15:32:22.596581+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'52","last_scrub_stamp":"2024-09-19T15:32:22.596389+0000","last_deep_scrub":"268'52","last_deep_scrub_stamp":"2024-09-19T15:32:22.596389+0000","last_clean_scrub_stamp":"2024-09-19T15:32:22.596389+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:36:49.263021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":381,"num_read_kb":254,"num_write":133,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'384","reported_seq":1097,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.661911+0000","last_change":"2024-09-19T15:32:00.661911+0000","last_active":"2024-09-19T15:32:00.661911+0000","last_peered":"2024-09-19T15:32:00.661911+0000","last_clean":"2024-09-19T15:32:00.661911+0000","last_became_active":"2024-09-19T13:40:34.278366+0000","last_became_peered":"2024-09-19T13:40:34.278366+0000","last_unstale":"2024-09-19T15:32:00.661911+0000","last_undegraded":"2024-09-19T15:32:00.661911+0000","last_fullsized":"2024-09-19T15:32:00.661911+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'384","last_scrub_stamp":"2024-09-19T15:32:00.661714+0000","last_deep_scrub":"268'384","last_deep_scrub_stamp":"2024-09-19T15:32:00.661714+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.661714+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:17:20.451042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":664,"num_read_kb":97882,"num_write":1263,"num_write_kb":51204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'904","reported_seq":2638,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.758397+0000","last_change":"2024-09-19T15:32:05.758397+0000","last_active":"2024-09-19T15:32:05.758397+0000","last_peered":"2024-09-19T15:32:05.758397+0000","last_clean":"2024-09-19T15:32:05.758397+0000","last_became_active":"2024-09-19T13:40:36.233265+0000","last_became_peered":"2024-09-19T13:40:36.233265+0000","last_unstale":"2024-09-19T15:32:05.758397+0000","last_undegraded":"2024-09-19T15:32:05.758397+0000","last_fullsized":"2024-09-19T15:32:05.758397+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'904","last_scrub_stamp":"2024-09-19T15:32:05.758196+0000","last_deep_scrub":"268'904","last_deep_scrub_stamp":"2024-09-19T15:32:05.758196+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.758196+0000","objects_scrubbed":8,"log_size":104,"log_dups_size":800,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:22:11.832649+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4503,"num_read_kb":4037,"num_write":1205,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3446,"num_omap_keys":14,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'293","reported_seq":924,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.638153+0000","last_change":"2024-09-19T15:31:50.638153+0000","last_active":"2024-09-19T15:31:50.638153+0000","last_peered":"2024-09-19T15:31:50.638153+0000","last_clean":"2024-09-19T15:31:50.638153+0000","last_became_active":"2024-09-19T13:40:34.240412+0000","last_became_peered":"2024-09-19T13:40:34.240412+0000","last_unstale":"2024-09-19T15:31:50.638153+0000","last_undegraded":"2024-09-19T15:31:50.638153+0000","last_fullsized":"2024-09-19T15:31:50.638153+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'293","last_scrub_stamp":"2024-09-19T15:31:50.637951+0000","last_deep_scrub":"268'293","last_deep_scrub_stamp":"2024-09-19T15:31:50.637951+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.637951+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:16.720237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":459,"num_read_kb":36198,"num_write":952,"num_write_kb":29274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'624","reported_seq":2335,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.730768+0000","last_change":"2024-09-19T15:32:04.730768+0000","last_active":"2024-09-19T15:32:04.730768+0000","last_peered":"2024-09-19T15:32:04.730768+0000","last_clean":"2024-09-19T15:32:04.730768+0000","last_became_active":"2024-09-19T13:40:36.232504+0000","last_became_peered":"2024-09-19T13:40:36.232504+0000","last_unstale":"2024-09-19T15:32:04.730768+0000","last_undegraded":"2024-09-19T15:32:04.730768+0000","last_fullsized":"2024-09-19T15:32:04.730768+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'624","last_scrub_stamp":"2024-09-19T15:32:04.730583+0000","last_deep_scrub":"268'624","last_deep_scrub_stamp":"2024-09-19T15:32:04.730583+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.730583+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":600,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:57:53.057219+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3362,"num_read_kb":3070,"num_write":813,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'361","reported_seq":1050,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.669495+0000","last_change":"2024-09-19T15:31:51.669495+0000","last_active":"2024-09-19T15:31:51.669495+0000","last_peered":"2024-09-19T15:31:51.669495+0000","last_clean":"2024-09-19T15:31:51.669495+0000","last_became_active":"2024-09-19T13:40:34.215960+0000","last_became_peered":"2024-09-19T13:40:34.215960+0000","last_unstale":"2024-09-19T15:31:51.669495+0000","last_undegraded":"2024-09-19T15:31:51.669495+0000","last_fullsized":"2024-09-19T15:31:51.669495+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'361","last_scrub_stamp":"2024-09-19T15:31:51.669302+0000","last_deep_scrub":"268'361","last_deep_scrub_stamp":"2024-09-19T15:31:51.669302+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.669302+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:44:16.452038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":684,"num_read_kb":31785,"num_write":1188,"num_write_kb":29902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'840","reported_seq":2398,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.563507+0000","last_change":"2024-09-19T15:32:04.563507+0000","last_active":"2024-09-19T15:32:04.563507+0000","last_peered":"2024-09-19T15:32:04.563507+0000","last_clean":"2024-09-19T15:32:04.563507+0000","last_became_active":"2024-09-19T13:40:36.220563+0000","last_became_peered":"2024-09-19T13:40:36.220563+0000","last_unstale":"2024-09-19T15:32:04.563507+0000","last_undegraded":"2024-09-19T15:32:04.563507+0000","last_fullsized":"2024-09-19T15:32:04.563507+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'840","last_scrub_stamp":"2024-09-19T15:32:04.563306+0000","last_deep_scrub":"268'840","last_deep_scrub_stamp":"2024-09-19T15:32:04.563306+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.563306+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":800,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:04:09.857112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4017,"num_read_kb":3603,"num_write":1098,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'358","reported_seq":1039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.799136+0000","last_change":"2024-09-19T15:32:00.799136+0000","last_active":"2024-09-19T15:32:00.799136+0000","last_peered":"2024-09-19T15:32:00.799136+0000","last_clean":"2024-09-19T15:32:00.799136+0000","last_became_active":"2024-09-19T13:40:34.239843+0000","last_became_peered":"2024-09-19T13:40:34.239843+0000","last_unstale":"2024-09-19T15:32:00.799136+0000","last_undegraded":"2024-09-19T15:32:00.799136+0000","last_fullsized":"2024-09-19T15:32:00.799136+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'358","last_scrub_stamp":"2024-09-19T15:32:00.798848+0000","last_deep_scrub":"268'358","last_deep_scrub_stamp":"2024-09-19T15:32:00.798848+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.798848+0000","objects_scrubbed":7,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:22:42.485481+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136873,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":579,"num_read_kb":4189,"num_write":1155,"num_write_kb":27975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'1557","reported_seq":3234,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.739899+0000","last_change":"2024-09-19T15:32:00.739899+0000","last_active":"2024-09-19T15:32:00.739899+0000","last_peered":"2024-09-19T15:32:00.739899+0000","last_clean":"2024-09-19T15:32:00.739899+0000","last_became_active":"2024-09-19T13:40:36.225954+0000","last_became_peered":"2024-09-19T13:40:36.225954+0000","last_unstale":"2024-09-19T15:32:00.739899+0000","last_undegraded":"2024-09-19T15:32:00.739899+0000","last_fullsized":"2024-09-19T15:32:00.739899+0000","mapping_epoch":27,"log_start":"268'1500","ondisk_log_start":"268'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1557","last_scrub_stamp":"2024-09-19T15:32:00.739686+0000","last_deep_scrub":"268'1557","last_deep_scrub_stamp":"2024-09-19T15:32:00.739686+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.739686+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":1500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:51:44.541143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7021,"num_read_kb":6136,"num_write":2176,"num_write_kb":944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'323","reported_seq":1034,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.653559+0000","last_change":"2024-09-19T15:31:58.653559+0000","last_active":"2024-09-19T15:31:58.653559+0000","last_peered":"2024-09-19T15:31:58.653559+0000","last_clean":"2024-09-19T15:31:58.653559+0000","last_became_active":"2024-09-19T13:40:34.267254+0000","last_became_peered":"2024-09-19T13:40:34.267254+0000","last_unstale":"2024-09-19T15:31:58.653559+0000","last_undegraded":"2024-09-19T15:31:58.653559+0000","last_fullsized":"2024-09-19T15:31:58.653559+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'323","last_scrub_stamp":"2024-09-19T15:31:58.653334+0000","last_deep_scrub":"268'323","last_deep_scrub_stamp":"2024-09-19T15:31:58.653334+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.653334+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:29:03.902030+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":674,"num_read_kb":4762,"num_write":931,"num_write_kb":10224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"268'448","reported_seq":2108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.925601+0000","last_change":"2024-09-19T15:31:58.925601+0000","last_active":"2024-09-19T15:31:58.925601+0000","last_peered":"2024-09-19T15:31:58.925601+0000","last_clean":"2024-09-19T15:31:58.925601+0000","last_became_active":"2024-09-19T13:40:36.220431+0000","last_became_peered":"2024-09-19T13:40:36.220431+0000","last_unstale":"2024-09-19T15:31:58.925601+0000","last_undegraded":"2024-09-19T15:31:58.925601+0000","last_fullsized":"2024-09-19T15:31:58.925601+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'448","last_scrub_stamp":"2024-09-19T15:31:58.925377+0000","last_deep_scrub":"268'448","last_deep_scrub_stamp":"2024-09-19T15:31:58.925377+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.925377+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:32.879919+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2602,"num_read_kb":2484,"num_write":543,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'313","reported_seq":967,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.808520+0000","last_change":"2024-09-19T15:31:59.808520+0000","last_active":"2024-09-19T15:31:59.808520+0000","last_peered":"2024-09-19T15:31:59.808520+0000","last_clean":"2024-09-19T15:31:59.808520+0000","last_became_active":"2024-09-19T13:40:34.218957+0000","last_became_peered":"2024-09-19T13:40:34.218957+0000","last_unstale":"2024-09-19T15:31:59.808520+0000","last_undegraded":"2024-09-19T15:31:59.808520+0000","last_fullsized":"2024-09-19T15:31:59.808520+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'313","last_scrub_stamp":"2024-09-19T15:31:59.808323+0000","last_deep_scrub":"268'313","last_deep_scrub_stamp":"2024-09-19T15:31:59.808323+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.808323+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:28:51.505054+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136870,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":503,"num_read_kb":8139,"num_write":970,"num_write_kb":24727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'797","reported_seq":2568,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.543607+0000","last_change":"2024-09-19T15:32:06.543607+0000","last_active":"2024-09-19T15:32:06.543607+0000","last_peered":"2024-09-19T15:32:06.543607+0000","last_clean":"2024-09-19T15:32:06.543607+0000","last_became_active":"2024-09-19T13:40:36.228785+0000","last_became_peered":"2024-09-19T13:40:36.228785+0000","last_unstale":"2024-09-19T15:32:06.543607+0000","last_undegraded":"2024-09-19T15:32:06.543607+0000","last_fullsized":"2024-09-19T15:32:06.543607+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'797","last_scrub_stamp":"2024-09-19T15:32:06.543396+0000","last_deep_scrub":"268'797","last_deep_scrub_stamp":"2024-09-19T15:32:06.543396+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.543396+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:52:36.348722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4179,"num_read_kb":3830,"num_write":1044,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'342","reported_seq":998,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.666756+0000","last_change":"2024-09-19T15:31:57.666756+0000","last_active":"2024-09-19T15:31:57.666756+0000","last_peered":"2024-09-19T15:31:57.666756+0000","last_clean":"2024-09-19T15:31:57.666756+0000","last_became_active":"2024-09-19T13:40:34.267647+0000","last_became_peered":"2024-09-19T13:40:34.267647+0000","last_unstale":"2024-09-19T15:31:57.666756+0000","last_undegraded":"2024-09-19T15:31:57.666756+0000","last_fullsized":"2024-09-19T15:31:57.666756+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'342","last_scrub_stamp":"2024-09-19T15:31:57.666543+0000","last_deep_scrub":"268'342","last_deep_scrub_stamp":"2024-09-19T15:31:57.666543+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.666543+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:41:13.021177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":19593,"num_write":1075,"num_write_kb":28817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"268'1157","reported_seq":2785,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.773733+0000","last_change":"2024-09-19T15:32:07.773733+0000","last_active":"2024-09-19T15:32:07.773733+0000","last_peered":"2024-09-19T15:32:07.773733+0000","last_clean":"2024-09-19T15:32:07.773733+0000","last_became_active":"2024-09-19T13:40:36.230581+0000","last_became_peered":"2024-09-19T13:40:36.230581+0000","last_unstale":"2024-09-19T15:32:07.773733+0000","last_undegraded":"2024-09-19T15:32:07.773733+0000","last_fullsized":"2024-09-19T15:32:07.773733+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1157","last_scrub_stamp":"2024-09-19T15:32:07.773545+0000","last_deep_scrub":"268'1157","last_deep_scrub_stamp":"2024-09-19T15:32:07.773545+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.773545+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":1100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:38.669375+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5418,"num_read_kb":4799,"num_write":1598,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'386","reported_seq":1137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.947499+0000","last_change":"2024-09-19T15:31:55.947499+0000","last_active":"2024-09-19T15:31:55.947499+0000","last_peered":"2024-09-19T15:31:55.947499+0000","last_clean":"2024-09-19T15:31:55.947499+0000","last_became_active":"2024-09-19T13:40:34.237561+0000","last_became_peered":"2024-09-19T13:40:34.237561+0000","last_unstale":"2024-09-19T15:31:55.947499+0000","last_undegraded":"2024-09-19T15:31:55.947499+0000","last_fullsized":"2024-09-19T15:31:55.947499+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'386","last_scrub_stamp":"2024-09-19T15:31:55.947285+0000","last_deep_scrub":"268'386","last_deep_scrub_stamp":"2024-09-19T15:31:55.947285+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.947285+0000","objects_scrubbed":8,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:40:34.514330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136898,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":851,"num_read_kb":72188,"num_write":1180,"num_write_kb":41551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'653","reported_seq":2366,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.862758+0000","last_change":"2024-09-19T15:31:57.862758+0000","last_active":"2024-09-19T15:31:57.862758+0000","last_peered":"2024-09-19T15:31:57.862758+0000","last_clean":"2024-09-19T15:31:57.862758+0000","last_became_active":"2024-09-19T13:40:36.221587+0000","last_became_peered":"2024-09-19T13:40:36.221587+0000","last_unstale":"2024-09-19T15:31:57.862758+0000","last_undegraded":"2024-09-19T15:31:57.862758+0000","last_fullsized":"2024-09-19T15:31:57.862758+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'653","last_scrub_stamp":"2024-09-19T15:31:57.862563+0000","last_deep_scrub":"268'653","last_deep_scrub_stamp":"2024-09-19T15:31:57.862563+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.862563+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":600,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:10:32.434848+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3331,"num_read_kb":3024,"num_write":858,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'1221","reported_seq":3038,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.529541+0000","last_change":"2024-09-19T15:32:03.529541+0000","last_active":"2024-09-19T15:32:03.529541+0000","last_peered":"2024-09-19T15:32:03.529541+0000","last_clean":"2024-09-19T15:32:03.529541+0000","last_became_active":"2024-09-19T13:40:36.220889+0000","last_became_peered":"2024-09-19T13:40:36.220889+0000","last_unstale":"2024-09-19T15:32:03.529541+0000","last_undegraded":"2024-09-19T15:32:03.529541+0000","last_fullsized":"2024-09-19T15:32:03.529541+0000","mapping_epoch":27,"log_start":"268'1200","ondisk_log_start":"268'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1221","last_scrub_stamp":"2024-09-19T15:32:03.529327+0000","last_deep_scrub":"268'1221","last_deep_scrub_stamp":"2024-09-19T15:32:03.529327+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.529327+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":1200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:46.924744+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5895,"num_read_kb":5235,"num_write":1696,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2040,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'416","reported_seq":1155,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.627136+0000","last_change":"2024-09-19T15:31:59.626980+0000","last_active":"2024-09-19T15:31:59.627136+0000","last_peered":"2024-09-19T15:31:59.627136+0000","last_clean":"2024-09-19T15:31:59.627136+0000","last_became_active":"2024-09-19T13:40:34.278991+0000","last_became_peered":"2024-09-19T13:40:34.278991+0000","last_unstale":"2024-09-19T15:31:59.627136+0000","last_undegraded":"2024-09-19T15:31:59.627136+0000","last_fullsized":"2024-09-19T15:31:59.627136+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'416","last_scrub_stamp":"2024-09-19T15:31:59.626756+0000","last_deep_scrub":"268'416","last_deep_scrub_stamp":"2024-09-19T15:31:59.626756+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.626756+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:27:36.553637+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136848,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":967,"num_read_kb":8273,"num_write":1275,"num_write_kb":26935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'1135","reported_seq":2658,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.698161+0000","last_change":"2024-09-19T15:32:03.698161+0000","last_active":"2024-09-19T15:32:03.698161+0000","last_peered":"2024-09-19T15:32:03.698161+0000","last_clean":"2024-09-19T15:32:03.698161+0000","last_became_active":"2024-09-19T13:40:36.233032+0000","last_became_peered":"2024-09-19T13:40:36.233032+0000","last_unstale":"2024-09-19T15:32:03.698161+0000","last_undegraded":"2024-09-19T15:32:03.698161+0000","last_fullsized":"2024-09-19T15:32:03.698161+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1135","last_scrub_stamp":"2024-09-19T15:32:03.697969+0000","last_deep_scrub":"268'1135","last_deep_scrub_stamp":"2024-09-19T15:32:03.697969+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.697969+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":1100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:38.136899+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5185,"num_read_kb":4564,"num_write":1576,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'361","reported_seq":1029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.926301+0000","last_change":"2024-09-19T15:31:54.926301+0000","last_active":"2024-09-19T15:31:54.926301+0000","last_peered":"2024-09-19T15:31:54.926301+0000","last_clean":"2024-09-19T15:31:54.926301+0000","last_became_active":"2024-09-19T13:40:34.257994+0000","last_became_peered":"2024-09-19T13:40:34.257994+0000","last_unstale":"2024-09-19T15:31:54.926301+0000","last_undegraded":"2024-09-19T15:31:54.926301+0000","last_fullsized":"2024-09-19T15:31:54.926301+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'361","last_scrub_stamp":"2024-09-19T15:31:54.925917+0000","last_deep_scrub":"268'361","last_deep_scrub_stamp":"2024-09-19T15:31:54.925917+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.925917+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:27:05.992674+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":609,"num_read_kb":26261,"num_write":1202,"num_write_kb":39497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"268'592","reported_seq":2579,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.748952+0000","last_change":"2024-09-19T15:32:04.748952+0000","last_active":"2024-09-19T15:32:04.748952+0000","last_peered":"2024-09-19T15:32:04.748952+0000","last_clean":"2024-09-19T15:32:04.748952+0000","last_became_active":"2024-09-19T13:40:36.231554+0000","last_became_peered":"2024-09-19T13:40:36.231554+0000","last_unstale":"2024-09-19T15:32:04.748952+0000","last_undegraded":"2024-09-19T15:32:04.748952+0000","last_fullsized":"2024-09-19T15:32:04.748952+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'592","last_scrub_stamp":"2024-09-19T15:32:04.748748+0000","last_deep_scrub":"268'592","last_deep_scrub_stamp":"2024-09-19T15:32:04.748748+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.748748+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":500,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:25.544452+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3450,"num_read_kb":3252,"num_write":736,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2777,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'354","reported_seq":1003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.894244+0000","last_change":"2024-09-19T15:31:51.894244+0000","last_active":"2024-09-19T15:31:51.894244+0000","last_peered":"2024-09-19T15:31:51.894244+0000","last_clean":"2024-09-19T15:31:51.894244+0000","last_became_active":"2024-09-19T13:40:34.264349+0000","last_became_peered":"2024-09-19T13:40:34.264349+0000","last_unstale":"2024-09-19T15:31:51.894244+0000","last_undegraded":"2024-09-19T15:31:51.894244+0000","last_fullsized":"2024-09-19T15:31:51.894244+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'354","last_scrub_stamp":"2024-09-19T15:31:51.894022+0000","last_deep_scrub":"268'354","last_deep_scrub_stamp":"2024-09-19T15:31:51.894022+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.894022+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:08.557909+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":590,"num_read_kb":18139,"num_write":1138,"num_write_kb":28020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'536","reported_seq":2168,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.817859+0000","last_change":"2024-09-19T15:31:56.817859+0000","last_active":"2024-09-19T15:31:56.817859+0000","last_peered":"2024-09-19T15:31:56.817859+0000","last_clean":"2024-09-19T15:31:56.817859+0000","last_became_active":"2024-09-19T13:40:36.221266+0000","last_became_peered":"2024-09-19T13:40:36.221266+0000","last_unstale":"2024-09-19T15:31:56.817859+0000","last_undegraded":"2024-09-19T15:31:56.817859+0000","last_fullsized":"2024-09-19T15:31:56.817859+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'536","last_scrub_stamp":"2024-09-19T15:31:56.817666+0000","last_deep_scrub":"268'536","last_deep_scrub_stamp":"2024-09-19T15:31:56.817666+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.817666+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":500,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:15.258731+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2921,"num_read_kb":2700,"num_write":709,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'351","reported_seq":1207,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.497107+0000","last_change":"2024-09-19T15:31:50.497107+0000","last_active":"2024-09-19T15:31:50.497107+0000","last_peered":"2024-09-19T15:31:50.497107+0000","last_clean":"2024-09-19T15:31:50.497107+0000","last_became_active":"2024-09-19T13:40:34.262084+0000","last_became_peered":"2024-09-19T13:40:34.262084+0000","last_unstale":"2024-09-19T15:31:50.497107+0000","last_undegraded":"2024-09-19T15:31:50.497107+0000","last_fullsized":"2024-09-19T15:31:50.497107+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'351","last_scrub_stamp":"2024-09-19T15:31:50.496887+0000","last_deep_scrub":"268'351","last_deep_scrub_stamp":"2024-09-19T15:31:50.496887+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.496887+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:55:19.272837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1177,"num_read_kb":45013,"num_write":1025,"num_write_kb":26916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"268'462","reported_seq":2076,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.816018+0000","last_change":"2024-09-19T15:31:54.816018+0000","last_active":"2024-09-19T15:31:54.816018+0000","last_peered":"2024-09-19T15:31:54.816018+0000","last_clean":"2024-09-19T15:31:54.816018+0000","last_became_active":"2024-09-19T13:40:36.216082+0000","last_became_peered":"2024-09-19T13:40:36.216082+0000","last_unstale":"2024-09-19T15:31:54.816018+0000","last_undegraded":"2024-09-19T15:31:54.816018+0000","last_fullsized":"2024-09-19T15:31:54.816018+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'462","last_scrub_stamp":"2024-09-19T15:31:54.815843+0000","last_deep_scrub":"268'462","last_deep_scrub_stamp":"2024-09-19T15:31:54.815843+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.815843+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:57.752317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2409,"num_read_kb":2273,"num_write":537,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'339","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.915768+0000","last_change":"2024-09-19T15:31:54.915768+0000","last_active":"2024-09-19T15:31:54.915768+0000","last_peered":"2024-09-19T15:31:54.915768+0000","last_clean":"2024-09-19T15:31:54.915768+0000","last_became_active":"2024-09-19T13:40:34.237589+0000","last_became_peered":"2024-09-19T13:40:34.237589+0000","last_unstale":"2024-09-19T15:31:54.915768+0000","last_undegraded":"2024-09-19T15:31:54.915768+0000","last_fullsized":"2024-09-19T15:31:54.915768+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-19T15:31:54.915566+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-19T15:31:54.915566+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.915566+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:43.777729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":471,"num_read_kb":27580,"num_write":960,"num_write_kb":52672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'578","reported_seq":2271,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.519448+0000","last_change":"2024-09-19T15:32:05.519448+0000","last_active":"2024-09-19T15:32:05.519448+0000","last_peered":"2024-09-19T15:32:05.519448+0000","last_clean":"2024-09-19T15:32:05.519448+0000","last_became_active":"2024-09-19T13:40:36.220183+0000","last_became_peered":"2024-09-19T13:40:36.220183+0000","last_unstale":"2024-09-19T15:32:05.519448+0000","last_undegraded":"2024-09-19T15:32:05.519448+0000","last_fullsized":"2024-09-19T15:32:05.519448+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'578","last_scrub_stamp":"2024-09-19T15:32:05.519220+0000","last_deep_scrub":"268'578","last_deep_scrub_stamp":"2024-09-19T15:32:05.519220+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.519220+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":500,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:28.549608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3052,"num_read_kb":2823,"num_write":743,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'385","reported_seq":1099,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.717970+0000","last_change":"2024-09-19T15:31:52.717970+0000","last_active":"2024-09-19T15:31:52.717970+0000","last_peered":"2024-09-19T15:31:52.717970+0000","last_clean":"2024-09-19T15:31:52.717970+0000","last_became_active":"2024-09-19T13:40:34.224813+0000","last_became_peered":"2024-09-19T13:40:34.224813+0000","last_unstale":"2024-09-19T15:31:52.717970+0000","last_undegraded":"2024-09-19T15:31:52.717970+0000","last_fullsized":"2024-09-19T15:31:52.717970+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'385","last_scrub_stamp":"2024-09-19T15:31:52.717747+0000","last_deep_scrub":"268'385","last_deep_scrub_stamp":"2024-09-19T15:31:52.717747+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.717747+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:25:38.923053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":831,"num_read_kb":1243,"num_write":1485,"num_write_kb":25860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'141","reported_seq":675,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:20.588361+0000","last_change":"2024-09-19T15:32:20.588361+0000","last_active":"2024-09-19T15:32:20.588361+0000","last_peered":"2024-09-19T15:32:20.588361+0000","last_clean":"2024-09-19T15:32:20.588361+0000","last_became_active":"2024-09-19T13:40:44.242028+0000","last_became_peered":"2024-09-19T13:40:44.242028+0000","last_unstale":"2024-09-19T15:32:20.588361+0000","last_undegraded":"2024-09-19T15:32:20.588361+0000","last_fullsized":"2024-09-19T15:32:20.588361+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'141","last_scrub_stamp":"2024-09-19T15:32:20.588175+0000","last_deep_scrub":"268'141","last_deep_scrub_stamp":"2024-09-19T15:32:20.588175+0000","last_clean_scrub_stamp":"2024-09-19T15:32:20.588175+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:35.558306+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":180,"num_write":320,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'410","reported_seq":1942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.052954+0000","last_change":"2024-09-19T15:32:01.052954+0000","last_active":"2024-09-19T15:32:01.052954+0000","last_peered":"2024-09-19T15:32:01.052954+0000","last_clean":"2024-09-19T15:32:01.052954+0000","last_became_active":"2024-09-19T13:40:36.218091+0000","last_became_peered":"2024-09-19T13:40:36.218091+0000","last_unstale":"2024-09-19T15:32:01.052954+0000","last_undegraded":"2024-09-19T15:32:01.052954+0000","last_fullsized":"2024-09-19T15:32:01.052954+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'410","last_scrub_stamp":"2024-09-19T15:32:01.052731+0000","last_deep_scrub":"268'410","last_deep_scrub_stamp":"2024-09-19T15:32:01.052731+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.052731+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:54:24.981092+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2211,"num_read_kb":2096,"num_write":485,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"268'348","reported_seq":990,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.881044+0000","last_change":"2024-09-19T15:31:50.881044+0000","last_active":"2024-09-19T15:31:50.881044+0000","last_peered":"2024-09-19T15:31:50.881044+0000","last_clean":"2024-09-19T15:31:50.881044+0000","last_became_active":"2024-09-19T13:41:05.386216+0000","last_became_peered":"2024-09-19T13:41:05.386216+0000","last_unstale":"2024-09-19T15:31:50.881044+0000","last_undegraded":"2024-09-19T15:31:50.881044+0000","last_fullsized":"2024-09-19T15:31:50.881044+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'348","last_scrub_stamp":"2024-09-19T15:31:50.880838+0000","last_deep_scrub":"268'348","last_deep_scrub_stamp":"2024-09-19T15:31:50.880838+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.880838+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:14.516054+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":616,"num_read_kb":13820,"num_write":1168,"num_write_kb":52710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:10.688994+0000","last_change":"2024-09-19T15:32:10.688994+0000","last_active":"2024-09-19T15:32:10.688994+0000","last_peered":"2024-09-19T15:32:10.688994+0000","last_clean":"2024-09-19T15:32:10.688994+0000","last_became_active":"2024-09-19T13:40:38.222863+0000","last_became_peered":"2024-09-19T13:40:38.222863+0000","last_unstale":"2024-09-19T15:32:10.688994+0000","last_undegraded":"2024-09-19T15:32:10.688994+0000","last_fullsized":"2024-09-19T15:32:10.688994+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:10.688812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:10.688812+0000","last_clean_scrub_stamp":"2024-09-19T15:32:10.688812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:42.956381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'388","reported_seq":1042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.693514+0000","last_change":"2024-09-19T15:32:07.693514+0000","last_active":"2024-09-19T15:32:07.693514+0000","last_peered":"2024-09-19T15:32:07.693514+0000","last_clean":"2024-09-19T15:32:07.693514+0000","last_became_active":"2024-09-19T13:40:40.230368+0000","last_became_peered":"2024-09-19T13:40:40.230368+0000","last_unstale":"2024-09-19T15:32:07.693514+0000","last_undegraded":"2024-09-19T15:32:07.693514+0000","last_fullsized":"2024-09-19T15:32:07.693514+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'388","last_scrub_stamp":"2024-09-19T15:32:07.693335+0000","last_deep_scrub":"268'388","last_deep_scrub_stamp":"2024-09-19T15:32:07.693335+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.693335+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:40:16.124155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46964,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":623,"num_read_kb":1259,"num_write":490,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:18.700662+0000","last_change":"2024-09-19T15:32:18.700662+0000","last_active":"2024-09-19T15:32:18.700662+0000","last_peered":"2024-09-19T15:32:18.700662+0000","last_clean":"2024-09-19T15:32:18.700662+0000","last_became_active":"2024-09-19T13:40:42.240244+0000","last_became_peered":"2024-09-19T13:40:42.240244+0000","last_unstale":"2024-09-19T15:32:18.700662+0000","last_undegraded":"2024-09-19T15:32:18.700662+0000","last_fullsized":"2024-09-19T15:32:18.700662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:18.700485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:18.700485+0000","last_clean_scrub_stamp":"2024-09-19T15:32:18.700485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:04:21.150878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'2489","reported_seq":4356,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:23.643216+0000","last_change":"2024-09-19T15:32:23.643216+0000","last_active":"2024-09-19T15:32:23.643216+0000","last_peered":"2024-09-19T15:32:23.643216+0000","last_clean":"2024-09-19T15:32:23.643216+0000","last_became_active":"2024-09-19T13:40:44.263152+0000","last_became_peered":"2024-09-19T13:40:44.263152+0000","last_unstale":"2024-09-19T15:32:23.643216+0000","last_undegraded":"2024-09-19T15:32:23.643216+0000","last_fullsized":"2024-09-19T15:32:23.643216+0000","mapping_epoch":35,"log_start":"268'2400","ondisk_log_start":"268'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2489","last_scrub_stamp":"2024-09-19T15:32:23.643031+0000","last_deep_scrub":"268'2489","last_deep_scrub_stamp":"2024-09-19T15:32:23.643031+0000","last_clean_scrub_stamp":"2024-09-19T15:32:23.643031+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":2400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:42.489155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6208,"num_read_kb":6212,"num_write":5020,"num_write_kb":1848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'370","reported_seq":1876,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.779015+0000","last_change":"2024-09-19T15:32:02.779015+0000","last_active":"2024-09-19T15:32:02.779015+0000","last_peered":"2024-09-19T15:32:02.779015+0000","last_clean":"2024-09-19T15:32:02.779015+0000","last_became_active":"2024-09-19T13:40:36.242260+0000","last_became_peered":"2024-09-19T13:40:36.242260+0000","last_unstale":"2024-09-19T15:32:02.779015+0000","last_undegraded":"2024-09-19T15:32:02.779015+0000","last_fullsized":"2024-09-19T15:32:02.779015+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-19T15:32:02.778799+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-19T15:32:02.778799+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.778799+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:58:11.339987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2141,"num_read_kb":2035,"num_write":405,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'304","reported_seq":966,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:45.643356+0000","last_change":"2024-09-19T15:31:45.643356+0000","last_active":"2024-09-19T15:31:45.643356+0000","last_peered":"2024-09-19T15:31:45.643356+0000","last_clean":"2024-09-19T15:31:45.643356+0000","last_became_active":"2024-09-19T13:40:34.254811+0000","last_became_peered":"2024-09-19T13:40:34.254811+0000","last_unstale":"2024-09-19T15:31:45.643356+0000","last_undegraded":"2024-09-19T15:31:45.643356+0000","last_fullsized":"2024-09-19T15:31:45.643356+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'304","last_scrub_stamp":"2024-09-19T15:31:45.643211+0000","last_deep_scrub":"268'304","last_deep_scrub_stamp":"2024-09-19T15:31:45.643211+0000","last_clean_scrub_stamp":"2024-09-19T15:31:45.643211+0000","objects_scrubbed":8,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:42.025896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":583,"num_read_kb":3104,"num_write":1034,"num_write_kb":15827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:09.098212+0000","last_change":"2024-09-19T15:32:09.098212+0000","last_active":"2024-09-19T15:32:09.098212+0000","last_peered":"2024-09-19T15:32:09.098212+0000","last_clean":"2024-09-19T15:32:09.098212+0000","last_became_active":"2024-09-19T13:40:38.233854+0000","last_became_peered":"2024-09-19T13:40:38.233854+0000","last_unstale":"2024-09-19T15:32:09.098212+0000","last_undegraded":"2024-09-19T15:32:09.098212+0000","last_fullsized":"2024-09-19T15:32:09.098212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:09.098028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:09.098028+0000","last_clean_scrub_stamp":"2024-09-19T15:32:09.098028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:37:11.684872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'128","reported_seq":705,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:13.548069+0000","last_change":"2024-09-19T15:32:13.548069+0000","last_active":"2024-09-19T15:32:13.548069+0000","last_peered":"2024-09-19T15:32:13.548069+0000","last_clean":"2024-09-19T15:32:13.548069+0000","last_became_active":"2024-09-19T13:40:40.244841+0000","last_became_peered":"2024-09-19T13:40:40.244841+0000","last_unstale":"2024-09-19T15:32:13.548069+0000","last_undegraded":"2024-09-19T15:32:13.548069+0000","last_fullsized":"2024-09-19T15:32:13.548069+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'128","last_scrub_stamp":"2024-09-19T15:32:13.547828+0000","last_deep_scrub":"268'128","last_deep_scrub_stamp":"2024-09-19T15:32:13.547828+0000","last_clean_scrub_stamp":"2024-09-19T15:32:13.547828+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:35:26.393560+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":152,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:17.571750+0000","last_change":"2024-09-19T15:32:17.571750+0000","last_active":"2024-09-19T15:32:17.571750+0000","last_peered":"2024-09-19T15:32:17.571750+0000","last_clean":"2024-09-19T15:32:17.571750+0000","last_became_active":"2024-09-19T13:40:42.235151+0000","last_became_peered":"2024-09-19T13:40:42.235151+0000","last_unstale":"2024-09-19T15:32:17.571750+0000","last_undegraded":"2024-09-19T15:32:17.571750+0000","last_fullsized":"2024-09-19T15:32:17.571750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:17.571503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:17.571503+0000","last_clean_scrub_stamp":"2024-09-19T15:32:17.571503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:27:14.904541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'99","reported_seq":627,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:20.633689+0000","last_change":"2024-09-19T15:32:20.633689+0000","last_active":"2024-09-19T15:32:20.633689+0000","last_peered":"2024-09-19T15:32:20.633689+0000","last_clean":"2024-09-19T15:32:20.633689+0000","last_became_active":"2024-09-19T13:40:44.262343+0000","last_became_peered":"2024-09-19T13:40:44.262343+0000","last_unstale":"2024-09-19T15:32:20.633689+0000","last_undegraded":"2024-09-19T15:32:20.633689+0000","last_fullsized":"2024-09-19T15:32:20.633689+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'99","last_scrub_stamp":"2024-09-19T15:32:20.633491+0000","last_deep_scrub":"268'99","last_deep_scrub_stamp":"2024-09-19T15:32:20.633491+0000","last_clean_scrub_stamp":"2024-09-19T15:32:20.633491+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:00:16.771664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":127,"num_write":220,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'739","reported_seq":2248,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.747931+0000","last_change":"2024-09-19T15:31:56.747931+0000","last_active":"2024-09-19T15:31:56.747931+0000","last_peered":"2024-09-19T15:31:56.747931+0000","last_clean":"2024-09-19T15:31:56.747931+0000","last_became_active":"2024-09-19T13:40:36.225170+0000","last_became_peered":"2024-09-19T13:40:36.225170+0000","last_unstale":"2024-09-19T15:31:56.747931+0000","last_undegraded":"2024-09-19T15:31:56.747931+0000","last_fullsized":"2024-09-19T15:31:56.747931+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'739","last_scrub_stamp":"2024-09-19T15:31:56.747710+0000","last_deep_scrub":"268'739","last_deep_scrub_stamp":"2024-09-19T15:31:56.747710+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.747710+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:45:39.254884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3445,"num_read_kb":3119,"num_write":970,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'347","reported_seq":986,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.754774+0000","last_change":"2024-09-19T15:31:52.754774+0000","last_active":"2024-09-19T15:31:52.754774+0000","last_peered":"2024-09-19T15:31:52.754774+0000","last_clean":"2024-09-19T15:31:52.754774+0000","last_became_active":"2024-09-19T13:40:34.273656+0000","last_became_peered":"2024-09-19T13:40:34.273656+0000","last_unstale":"2024-09-19T15:31:52.754774+0000","last_undegraded":"2024-09-19T15:31:52.754774+0000","last_fullsized":"2024-09-19T15:31:52.754774+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'347","last_scrub_stamp":"2024-09-19T15:31:52.754452+0000","last_deep_scrub":"268'347","last_deep_scrub_stamp":"2024-09-19T15:31:52.754452+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.754452+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:28:40.714033+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136842,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":513,"num_read_kb":12420,"num_write":1036,"num_write_kb":39158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:10.085570+0000","last_change":"2024-09-19T15:32:10.085570+0000","last_active":"2024-09-19T15:32:10.085570+0000","last_peered":"2024-09-19T15:32:10.085570+0000","last_clean":"2024-09-19T15:32:10.085570+0000","last_became_active":"2024-09-19T13:40:38.220474+0000","last_became_peered":"2024-09-19T13:40:38.220474+0000","last_unstale":"2024-09-19T15:32:10.085570+0000","last_undegraded":"2024-09-19T15:32:10.085570+0000","last_fullsized":"2024-09-19T15:32:10.085570+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:10.085385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:10.085385+0000","last_clean_scrub_stamp":"2024-09-19T15:32:10.085385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:53.008740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'194","reported_seq":795,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.972239+0000","last_change":"2024-09-19T15:32:02.972239+0000","last_active":"2024-09-19T15:32:02.972239+0000","last_peered":"2024-09-19T15:32:02.972239+0000","last_clean":"2024-09-19T15:32:02.972239+0000","last_became_active":"2024-09-19T13:40:40.247893+0000","last_became_peered":"2024-09-19T13:40:40.247893+0000","last_unstale":"2024-09-19T15:32:02.972239+0000","last_undegraded":"2024-09-19T15:32:02.972239+0000","last_fullsized":"2024-09-19T15:32:02.972239+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'194","last_scrub_stamp":"2024-09-19T15:32:02.971992+0000","last_deep_scrub":"268'194","last_deep_scrub_stamp":"2024-09-19T15:32:02.971992+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.971992+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:29.838775+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":225,"num_write":160,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'762","reported_seq":3190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:17.676596+0000","last_change":"2024-09-19T15:32:17.676596+0000","last_active":"2024-09-19T15:32:17.676596+0000","last_peered":"2024-09-19T15:32:17.676596+0000","last_clean":"2024-09-19T15:32:17.676596+0000","last_became_active":"2024-09-19T13:40:42.239059+0000","last_became_peered":"2024-09-19T13:40:42.239059+0000","last_unstale":"2024-09-19T15:32:17.676596+0000","last_undegraded":"2024-09-19T15:32:17.676596+0000","last_fullsized":"2024-09-19T15:32:17.676596+0000","mapping_epoch":33,"log_start":"268'701","ondisk_log_start":"268'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'762","last_scrub_stamp":"2024-09-19T15:32:17.676409+0000","last_deep_scrub":"268'762","last_deep_scrub_stamp":"2024-09-19T15:32:17.676409+0000","last_clean_scrub_stamp":"2024-09-19T15:32:17.676409+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":701,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:50.314671+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'228","reported_seq":1079,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:21.544440+0000","last_change":"2024-09-19T15:32:21.544440+0000","last_active":"2024-09-19T15:32:21.544440+0000","last_peered":"2024-09-19T15:32:21.544440+0000","last_clean":"2024-09-19T15:32:21.544440+0000","last_became_active":"2024-09-19T13:40:44.277966+0000","last_became_peered":"2024-09-19T13:40:44.277966+0000","last_unstale":"2024-09-19T15:32:21.544440+0000","last_undegraded":"2024-09-19T15:32:21.544440+0000","last_fullsized":"2024-09-19T15:32:21.544440+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'228","last_scrub_stamp":"2024-09-19T15:32:21.544253+0000","last_deep_scrub":"268'228","last_deep_scrub_stamp":"2024-09-19T15:32:21.544253+0000","last_clean_scrub_stamp":"2024-09-19T15:32:21.544253+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:25.413782+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":650,"num_read_kb":649,"num_write":494,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'748","reported_seq":2169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.029942+0000","last_change":"2024-09-19T15:32:00.029942+0000","last_active":"2024-09-19T15:32:00.029942+0000","last_peered":"2024-09-19T15:32:00.029942+0000","last_clean":"2024-09-19T15:32:00.029942+0000","last_became_active":"2024-09-19T13:40:36.238400+0000","last_became_peered":"2024-09-19T13:40:36.238400+0000","last_unstale":"2024-09-19T15:32:00.029942+0000","last_undegraded":"2024-09-19T15:32:00.029942+0000","last_fullsized":"2024-09-19T15:32:00.029942+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'748","last_scrub_stamp":"2024-09-19T15:32:00.029701+0000","last_deep_scrub":"268'748","last_deep_scrub_stamp":"2024-09-19T15:32:00.029701+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.029701+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:17.299402+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3489,"num_read_kb":3124,"num_write":1003,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'393","reported_seq":1083,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.900923+0000","last_change":"2024-09-19T15:31:49.900923+0000","last_active":"2024-09-19T15:31:49.900923+0000","last_peered":"2024-09-19T15:31:49.900923+0000","last_clean":"2024-09-19T15:31:49.900923+0000","last_became_active":"2024-09-19T13:40:34.257596+0000","last_became_peered":"2024-09-19T13:40:34.257596+0000","last_unstale":"2024-09-19T15:31:49.900923+0000","last_undegraded":"2024-09-19T15:31:49.900923+0000","last_fullsized":"2024-09-19T15:31:49.900923+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'393","last_scrub_stamp":"2024-09-19T15:31:49.900735+0000","last_deep_scrub":"268'393","last_deep_scrub_stamp":"2024-09-19T15:31:49.900735+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.900735+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:09.592854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":35384,"num_write":1329,"num_write_kb":23932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:11.670640+0000","last_change":"2024-09-19T15:32:11.670640+0000","last_active":"2024-09-19T15:32:11.670640+0000","last_peered":"2024-09-19T15:32:11.670640+0000","last_clean":"2024-09-19T15:32:11.670640+0000","last_became_active":"2024-09-19T13:40:38.212327+0000","last_became_peered":"2024-09-19T13:40:38.212327+0000","last_unstale":"2024-09-19T15:32:11.670640+0000","last_undegraded":"2024-09-19T15:32:11.670640+0000","last_fullsized":"2024-09-19T15:32:11.670640+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:11.670461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:11.670461+0000","last_clean_scrub_stamp":"2024-09-19T15:32:11.670461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:57.215802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'318","reported_seq":947,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:14.726525+0000","last_change":"2024-09-19T15:32:14.726525+0000","last_active":"2024-09-19T15:32:14.726525+0000","last_peered":"2024-09-19T15:32:14.726525+0000","last_clean":"2024-09-19T15:32:14.726525+0000","last_became_active":"2024-09-19T13:40:40.225512+0000","last_became_peered":"2024-09-19T13:40:40.225512+0000","last_unstale":"2024-09-19T15:32:14.726525+0000","last_undegraded":"2024-09-19T15:32:14.726525+0000","last_fullsized":"2024-09-19T15:32:14.726525+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'318","last_scrub_stamp":"2024-09-19T15:32:14.726315+0000","last_deep_scrub":"268'318","last_deep_scrub_stamp":"2024-09-19T15:32:14.726315+0000","last_clean_scrub_stamp":"2024-09-19T15:32:14.726315+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:05.810318+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43264,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":513,"num_read_kb":1124,"num_write":410,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'790","reported_seq":3005,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:21.201361+0000","last_change":"2024-09-19T15:32:21.201361+0000","last_active":"2024-09-19T15:32:21.201361+0000","last_peered":"2024-09-19T15:32:21.201361+0000","last_clean":"2024-09-19T15:32:21.201361+0000","last_became_active":"2024-09-19T13:40:42.263635+0000","last_became_peered":"2024-09-19T13:40:42.263635+0000","last_unstale":"2024-09-19T15:32:21.201361+0000","last_undegraded":"2024-09-19T15:32:21.201361+0000","last_fullsized":"2024-09-19T15:32:21.201361+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'790","last_scrub_stamp":"2024-09-19T15:32:21.201174+0000","last_deep_scrub":"268'790","last_deep_scrub_stamp":"2024-09-19T15:32:21.201174+0000","last_clean_scrub_stamp":"2024-09-19T15:32:21.201174+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:22.262573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'503","reported_seq":2114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.805627+0000","last_change":"2024-09-19T15:32:01.805627+0000","last_active":"2024-09-19T15:32:01.805627+0000","last_peered":"2024-09-19T15:32:01.805627+0000","last_clean":"2024-09-19T15:32:01.805627+0000","last_became_active":"2024-09-19T13:40:36.235739+0000","last_became_peered":"2024-09-19T13:40:36.235739+0000","last_unstale":"2024-09-19T15:32:01.805627+0000","last_undegraded":"2024-09-19T15:32:01.805627+0000","last_fullsized":"2024-09-19T15:32:01.805627+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'503","last_scrub_stamp":"2024-09-19T15:32:01.805424+0000","last_deep_scrub":"268'503","last_deep_scrub_stamp":"2024-09-19T15:32:01.805424+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.805424+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:33:53.497137+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2574,"num_read_kb":2392,"num_write":618,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'357","reported_seq":1080,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.762833+0000","last_change":"2024-09-19T15:31:53.762833+0000","last_active":"2024-09-19T15:31:53.762833+0000","last_peered":"2024-09-19T15:31:53.762833+0000","last_clean":"2024-09-19T15:31:53.762833+0000","last_became_active":"2024-09-19T13:41:05.309594+0000","last_became_peered":"2024-09-19T13:41:05.309594+0000","last_unstale":"2024-09-19T15:31:53.762833+0000","last_undegraded":"2024-09-19T15:31:53.762833+0000","last_fullsized":"2024-09-19T15:31:53.762833+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'357","last_scrub_stamp":"2024-09-19T15:31:53.762612+0000","last_deep_scrub":"268'357","last_deep_scrub_stamp":"2024-09-19T15:31:53.762612+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.762612+0000","objects_scrubbed":7,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:30:03.838874+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":758,"num_read_kb":65190,"num_write":1172,"num_write_kb":23524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.681085+0000","last_change":"2024-09-19T15:32:07.681085+0000","last_active":"2024-09-19T15:32:07.681085+0000","last_peered":"2024-09-19T15:32:07.681085+0000","last_clean":"2024-09-19T15:32:07.681085+0000","last_became_active":"2024-09-19T13:40:38.233892+0000","last_became_peered":"2024-09-19T13:40:38.233892+0000","last_unstale":"2024-09-19T15:32:07.681085+0000","last_undegraded":"2024-09-19T15:32:07.681085+0000","last_fullsized":"2024-09-19T15:32:07.681085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:07.680900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:07.680900+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.680900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:13.848920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'467","reported_seq":1182,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:14.678325+0000","last_change":"2024-09-19T15:32:14.678325+0000","last_active":"2024-09-19T15:32:14.678325+0000","last_peered":"2024-09-19T15:32:14.678325+0000","last_clean":"2024-09-19T15:32:14.678325+0000","last_became_active":"2024-09-19T13:40:40.232582+0000","last_became_peered":"2024-09-19T13:40:40.232582+0000","last_unstale":"2024-09-19T15:32:14.678325+0000","last_undegraded":"2024-09-19T15:32:14.678325+0000","last_fullsized":"2024-09-19T15:32:14.678325+0000","mapping_epoch":31,"log_start":"268'400","ondisk_log_start":"268'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'467","last_scrub_stamp":"2024-09-19T15:32:14.678058+0000","last_deep_scrub":"268'467","last_deep_scrub_stamp":"2024-09-19T15:32:14.678058+0000","last_clean_scrub_stamp":"2024-09-19T15:32:14.678058+0000","objects_scrubbed":9,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:08:47.724207+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44624,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":740,"num_read_kb":1351,"num_write":560,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.598875+0000","last_change":"2024-09-19T15:32:08.598875+0000","last_active":"2024-09-19T15:32:08.598875+0000","last_peered":"2024-09-19T15:32:08.598875+0000","last_clean":"2024-09-19T15:32:08.598875+0000","last_became_active":"2024-09-19T13:40:42.239961+0000","last_became_peered":"2024-09-19T13:40:42.239961+0000","last_unstale":"2024-09-19T15:32:08.598875+0000","last_undegraded":"2024-09-19T15:32:08.598875+0000","last_fullsized":"2024-09-19T15:32:08.598875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:08.598673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:08.598673+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.598673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:30:30.732339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'548","reported_seq":1404,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:19.646257+0000","last_change":"2024-09-19T15:32:19.646257+0000","last_active":"2024-09-19T15:32:19.646257+0000","last_peered":"2024-09-19T15:32:19.646257+0000","last_clean":"2024-09-19T15:32:19.646257+0000","last_became_active":"2024-09-19T13:40:44.263313+0000","last_became_peered":"2024-09-19T13:40:44.263313+0000","last_unstale":"2024-09-19T15:32:19.646257+0000","last_undegraded":"2024-09-19T15:32:19.646257+0000","last_fullsized":"2024-09-19T15:32:19.646257+0000","mapping_epoch":35,"log_start":"268'500","ondisk_log_start":"268'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'548","last_scrub_stamp":"2024-09-19T15:32:19.646056+0000","last_deep_scrub":"268'548","last_deep_scrub_stamp":"2024-09-19T15:32:19.646056+0000","last_clean_scrub_stamp":"2024-09-19T15:32:19.646056+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:42:19.204187+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1297,"num_read_kb":1297,"num_write":1122,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'467","reported_seq":2122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.456349+0000","last_change":"2024-09-19T15:31:52.456349+0000","last_active":"2024-09-19T15:31:52.456349+0000","last_peered":"2024-09-19T15:31:52.456349+0000","last_clean":"2024-09-19T15:31:52.456349+0000","last_became_active":"2024-09-19T13:40:36.218822+0000","last_became_peered":"2024-09-19T13:40:36.218822+0000","last_unstale":"2024-09-19T15:31:52.456349+0000","last_undegraded":"2024-09-19T15:31:52.456349+0000","last_fullsized":"2024-09-19T15:31:52.456349+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'467","last_scrub_stamp":"2024-09-19T15:31:52.456167+0000","last_deep_scrub":"268'467","last_deep_scrub_stamp":"2024-09-19T15:31:52.456167+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.456167+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:04:13.506665+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2519,"num_read_kb":2376,"num_write":558,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'323","reported_seq":984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.705812+0000","last_change":"2024-09-19T15:31:56.705812+0000","last_active":"2024-09-19T15:31:56.705812+0000","last_peered":"2024-09-19T15:31:56.705812+0000","last_clean":"2024-09-19T15:31:56.705812+0000","last_became_active":"2024-09-19T13:40:34.278684+0000","last_became_peered":"2024-09-19T13:40:34.278684+0000","last_unstale":"2024-09-19T15:31:56.705812+0000","last_undegraded":"2024-09-19T15:31:56.705812+0000","last_fullsized":"2024-09-19T15:31:56.705812+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'323","last_scrub_stamp":"2024-09-19T15:31:56.705455+0000","last_deep_scrub":"268'323","last_deep_scrub_stamp":"2024-09-19T15:31:56.705455+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.705455+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:31:32.186266+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":542,"num_read_kb":16871,"num_write":997,"num_write_kb":22319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.905540+0000","last_change":"2024-09-19T15:31:58.905540+0000","last_active":"2024-09-19T15:31:58.905540+0000","last_peered":"2024-09-19T15:31:58.905540+0000","last_clean":"2024-09-19T15:31:58.905540+0000","last_became_active":"2024-09-19T13:40:38.228765+0000","last_became_peered":"2024-09-19T13:40:38.228765+0000","last_unstale":"2024-09-19T15:31:58.905540+0000","last_undegraded":"2024-09-19T15:31:58.905540+0000","last_fullsized":"2024-09-19T15:31:58.905540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:58.905356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:58.905356+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.905356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:59.885919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'318","reported_seq":949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:12.102311+0000","last_change":"2024-09-19T15:32:12.102311+0000","last_active":"2024-09-19T15:32:12.102311+0000","last_peered":"2024-09-19T15:32:12.102311+0000","last_clean":"2024-09-19T15:32:12.102311+0000","last_became_active":"2024-09-19T13:40:40.226899+0000","last_became_peered":"2024-09-19T13:40:40.226899+0000","last_unstale":"2024-09-19T15:32:12.102311+0000","last_undegraded":"2024-09-19T15:32:12.102311+0000","last_fullsized":"2024-09-19T15:32:12.102311+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'318","last_scrub_stamp":"2024-09-19T15:32:12.102112+0000","last_deep_scrub":"268'318","last_deep_scrub_stamp":"2024-09-19T15:32:12.102112+0000","last_clean_scrub_stamp":"2024-09-19T15:32:12.102112+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:13:50.462555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46888,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":525,"num_read_kb":1137,"num_write":420,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:20.211397+0000","last_change":"2024-09-19T15:32:20.211397+0000","last_active":"2024-09-19T15:32:20.211397+0000","last_peered":"2024-09-19T15:32:20.211397+0000","last_clean":"2024-09-19T15:32:20.211397+0000","last_became_active":"2024-09-19T13:40:42.245030+0000","last_became_peered":"2024-09-19T13:40:42.245030+0000","last_unstale":"2024-09-19T15:32:20.211397+0000","last_undegraded":"2024-09-19T15:32:20.211397+0000","last_fullsized":"2024-09-19T15:32:20.211397+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:20.211223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:20.211223+0000","last_clean_scrub_stamp":"2024-09-19T15:32:20.211223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:11:45.637564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'126","reported_seq":645,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.974019+0000","last_change":"2024-09-19T15:32:08.974019+0000","last_active":"2024-09-19T15:32:08.974019+0000","last_peered":"2024-09-19T15:32:08.974019+0000","last_clean":"2024-09-19T15:32:08.974019+0000","last_became_active":"2024-09-19T13:40:44.254015+0000","last_became_peered":"2024-09-19T13:40:44.254015+0000","last_unstale":"2024-09-19T15:32:08.974019+0000","last_undegraded":"2024-09-19T15:32:08.974019+0000","last_fullsized":"2024-09-19T15:32:08.974019+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'126","last_scrub_stamp":"2024-09-19T15:32:08.973841+0000","last_deep_scrub":"268'126","last_deep_scrub_stamp":"2024-09-19T15:32:08.973841+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.973841+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:13:17.778447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":134,"num_write":317,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'414","reported_seq":1984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.921763+0000","last_change":"2024-09-19T15:31:55.921763+0000","last_active":"2024-09-19T15:31:55.921763+0000","last_peered":"2024-09-19T15:31:55.921763+0000","last_clean":"2024-09-19T15:31:55.921763+0000","last_became_active":"2024-09-19T13:42:05.613410+0000","last_became_peered":"2024-09-19T13:42:05.613410+0000","last_unstale":"2024-09-19T15:31:55.921763+0000","last_undegraded":"2024-09-19T15:31:55.921763+0000","last_fullsized":"2024-09-19T15:31:55.921763+0000","mapping_epoch":40,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'414","last_scrub_stamp":"2024-09-19T15:31:55.921598+0000","last_deep_scrub":"268'414","last_deep_scrub_stamp":"2024-09-19T15:31:55.921598+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.921598+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:20.548732+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2294,"num_read_kb":2176,"num_write":469,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'350","reported_seq":1074,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.766022+0000","last_change":"2024-09-19T15:31:51.766022+0000","last_active":"2024-09-19T15:31:51.766022+0000","last_peered":"2024-09-19T15:31:51.766022+0000","last_clean":"2024-09-19T15:31:51.766022+0000","last_became_active":"2024-09-19T13:40:34.268005+0000","last_became_peered":"2024-09-19T13:40:34.268005+0000","last_unstale":"2024-09-19T15:31:51.766022+0000","last_undegraded":"2024-09-19T15:31:51.766022+0000","last_fullsized":"2024-09-19T15:31:51.766022+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'350","last_scrub_stamp":"2024-09-19T15:31:51.765823+0000","last_deep_scrub":"268'350","last_deep_scrub_stamp":"2024-09-19T15:31:51.765823+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.765823+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:50.728579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":754,"num_read_kb":24616,"num_write":1259,"num_write_kb":39661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.937891+0000","last_change":"2024-09-19T15:32:01.937891+0000","last_active":"2024-09-19T15:32:01.937891+0000","last_peered":"2024-09-19T15:32:01.937891+0000","last_clean":"2024-09-19T15:32:01.937891+0000","last_became_active":"2024-09-19T13:40:38.231698+0000","last_became_peered":"2024-09-19T13:40:38.231698+0000","last_unstale":"2024-09-19T15:32:01.937891+0000","last_undegraded":"2024-09-19T15:32:01.937891+0000","last_fullsized":"2024-09-19T15:32:01.937891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:01.937609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:01.937609+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.937609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:29.037967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'401","reported_seq":1071,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:11.645597+0000","last_change":"2024-09-19T15:32:11.645597+0000","last_active":"2024-09-19T15:32:11.645597+0000","last_peered":"2024-09-19T15:32:11.645597+0000","last_clean":"2024-09-19T15:32:11.645597+0000","last_became_active":"2024-09-19T13:40:40.218529+0000","last_became_peered":"2024-09-19T13:40:40.218529+0000","last_unstale":"2024-09-19T15:32:11.645597+0000","last_undegraded":"2024-09-19T15:32:11.645597+0000","last_fullsized":"2024-09-19T15:32:11.645597+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'401","last_scrub_stamp":"2024-09-19T15:32:11.645485+0000","last_deep_scrub":"268'401","last_deep_scrub_stamp":"2024-09-19T15:32:11.645485+0000","last_clean_scrub_stamp":"2024-09-19T15:32:11.645485+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:37.568114+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45323,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":615,"num_read_kb":1192,"num_write":478,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'803","reported_seq":3189,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:13.604648+0000","last_change":"2024-09-19T15:32:13.604648+0000","last_active":"2024-09-19T15:32:13.604648+0000","last_peered":"2024-09-19T15:32:13.604648+0000","last_clean":"2024-09-19T15:32:13.604648+0000","last_became_active":"2024-09-19T13:40:42.237168+0000","last_became_peered":"2024-09-19T13:40:42.237168+0000","last_unstale":"2024-09-19T15:32:13.604648+0000","last_undegraded":"2024-09-19T15:32:13.604648+0000","last_fullsized":"2024-09-19T15:32:13.604648+0000","mapping_epoch":33,"log_start":"268'701","ondisk_log_start":"268'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'803","last_scrub_stamp":"2024-09-19T15:32:13.604468+0000","last_deep_scrub":"268'803","last_deep_scrub_stamp":"2024-09-19T15:32:13.604468+0000","last_clean_scrub_stamp":"2024-09-19T15:32:13.604468+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":701,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:45:40.175931+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'187","reported_seq":742,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:17.580154+0000","last_change":"2024-09-19T15:32:17.580154+0000","last_active":"2024-09-19T15:32:17.580154+0000","last_peered":"2024-09-19T15:32:17.580154+0000","last_clean":"2024-09-19T15:32:17.580154+0000","last_became_active":"2024-09-19T13:40:44.259964+0000","last_became_peered":"2024-09-19T13:40:44.259964+0000","last_unstale":"2024-09-19T15:32:17.580154+0000","last_undegraded":"2024-09-19T15:32:17.580154+0000","last_fullsized":"2024-09-19T15:32:17.580154+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'187","last_scrub_stamp":"2024-09-19T15:32:17.579976+0000","last_deep_scrub":"268'187","last_deep_scrub_stamp":"2024-09-19T15:32:17.579976+0000","last_clean_scrub_stamp":"2024-09-19T15:32:17.579976+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:21.261184+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":275,"num_read_kb":244,"num_write":336,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'518","reported_seq":2217,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.706807+0000","last_change":"2024-09-19T15:31:55.706807+0000","last_active":"2024-09-19T15:31:55.706807+0000","last_peered":"2024-09-19T15:31:55.706807+0000","last_clean":"2024-09-19T15:31:55.706807+0000","last_became_active":"2024-09-19T13:40:36.221248+0000","last_became_peered":"2024-09-19T13:40:36.221248+0000","last_unstale":"2024-09-19T15:31:55.706807+0000","last_undegraded":"2024-09-19T15:31:55.706807+0000","last_fullsized":"2024-09-19T15:31:55.706807+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'518","last_scrub_stamp":"2024-09-19T15:31:55.706590+0000","last_deep_scrub":"268'518","last_deep_scrub_stamp":"2024-09-19T15:31:55.706590+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.706590+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:26.121902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2802,"num_read_kb":2611,"num_write":645,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'296","reported_seq":950,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.841863+0000","last_change":"2024-09-19T15:31:50.841863+0000","last_active":"2024-09-19T15:31:50.841863+0000","last_peered":"2024-09-19T15:31:50.841863+0000","last_clean":"2024-09-19T15:31:50.841863+0000","last_became_active":"2024-09-19T13:40:34.259994+0000","last_became_peered":"2024-09-19T13:40:34.259994+0000","last_unstale":"2024-09-19T15:31:50.841863+0000","last_undegraded":"2024-09-19T15:31:50.841863+0000","last_fullsized":"2024-09-19T15:31:50.841863+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'296","last_scrub_stamp":"2024-09-19T15:31:50.841553+0000","last_deep_scrub":"268'296","last_deep_scrub_stamp":"2024-09-19T15:31:50.841553+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.841553+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:13.764383+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":7460,"num_write":978,"num_write_kb":22776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.951669+0000","last_change":"2024-09-19T15:32:00.951669+0000","last_active":"2024-09-19T15:32:00.951669+0000","last_peered":"2024-09-19T15:32:00.951669+0000","last_clean":"2024-09-19T15:32:00.951669+0000","last_became_active":"2024-09-19T13:40:38.245245+0000","last_became_peered":"2024-09-19T13:40:38.245245+0000","last_unstale":"2024-09-19T15:32:00.951669+0000","last_undegraded":"2024-09-19T15:32:00.951669+0000","last_fullsized":"2024-09-19T15:32:00.951669+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:00.951493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:00.951493+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.951493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:47.140968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'517","reported_seq":1204,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.700660+0000","last_change":"2024-09-19T15:32:05.700660+0000","last_active":"2024-09-19T15:32:05.700660+0000","last_peered":"2024-09-19T15:32:05.700660+0000","last_clean":"2024-09-19T15:32:05.700660+0000","last_became_active":"2024-09-19T13:40:40.230404+0000","last_became_peered":"2024-09-19T13:40:40.230404+0000","last_unstale":"2024-09-19T15:32:05.700660+0000","last_undegraded":"2024-09-19T15:32:05.700660+0000","last_fullsized":"2024-09-19T15:32:05.700660+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'517","last_scrub_stamp":"2024-09-19T15:32:05.700478+0000","last_deep_scrub":"268'517","last_deep_scrub_stamp":"2024-09-19T15:32:05.700478+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.700478+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:06.189367+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93154,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":887,"num_read_kb":2046,"num_write":714,"num_write_kb":570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.950947+0000","last_change":"2024-09-19T15:32:04.950947+0000","last_active":"2024-09-19T15:32:04.950947+0000","last_peered":"2024-09-19T15:32:04.950947+0000","last_clean":"2024-09-19T15:32:04.950947+0000","last_became_active":"2024-09-19T13:40:42.248721+0000","last_became_peered":"2024-09-19T13:40:42.248721+0000","last_unstale":"2024-09-19T15:32:04.950947+0000","last_undegraded":"2024-09-19T15:32:04.950947+0000","last_fullsized":"2024-09-19T15:32:04.950947+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:04.950740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:04.950740+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.950740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:50:58.634069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'164","reported_seq":721,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:13.697201+0000","last_change":"2024-09-19T15:32:13.697201+0000","last_active":"2024-09-19T15:32:13.697201+0000","last_peered":"2024-09-19T15:32:13.697201+0000","last_clean":"2024-09-19T15:32:13.697201+0000","last_became_active":"2024-09-19T13:40:44.255644+0000","last_became_peered":"2024-09-19T13:40:44.255644+0000","last_unstale":"2024-09-19T15:32:13.697201+0000","last_undegraded":"2024-09-19T15:32:13.697201+0000","last_fullsized":"2024-09-19T15:32:13.697201+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'164","last_scrub_stamp":"2024-09-19T15:32:13.697000+0000","last_deep_scrub":"268'164","last_deep_scrub_stamp":"2024-09-19T15:32:13.697000+0000","last_clean_scrub_stamp":"2024-09-19T15:32:13.697000+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:19:16.779049+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":234,"num_write":369,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'797","reported_seq":2381,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.553171+0000","last_change":"2024-09-19T15:31:59.553171+0000","last_active":"2024-09-19T15:31:59.553171+0000","last_peered":"2024-09-19T15:31:59.553171+0000","last_clean":"2024-09-19T15:31:59.553171+0000","last_became_active":"2024-09-19T13:40:36.231071+0000","last_became_peered":"2024-09-19T13:40:36.231071+0000","last_unstale":"2024-09-19T15:31:59.553171+0000","last_undegraded":"2024-09-19T15:31:59.553171+0000","last_fullsized":"2024-09-19T15:31:59.553171+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'797","last_scrub_stamp":"2024-09-19T15:31:59.552987+0000","last_deep_scrub":"268'797","last_deep_scrub_stamp":"2024-09-19T15:31:59.552987+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.552987+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:12.521548+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3782,"num_read_kb":3405,"num_write":1031,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'344","reported_seq":1008,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.943571+0000","last_change":"2024-09-19T15:31:53.943571+0000","last_active":"2024-09-19T15:31:53.943571+0000","last_peered":"2024-09-19T15:31:53.943571+0000","last_clean":"2024-09-19T15:31:53.943571+0000","last_became_active":"2024-09-19T13:40:34.229859+0000","last_became_peered":"2024-09-19T13:40:34.229859+0000","last_unstale":"2024-09-19T15:31:53.943571+0000","last_undegraded":"2024-09-19T15:31:53.943571+0000","last_fullsized":"2024-09-19T15:31:53.943571+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'344","last_scrub_stamp":"2024-09-19T15:31:53.943359+0000","last_deep_scrub":"268'344","last_deep_scrub_stamp":"2024-09-19T15:31:53.943359+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.943359+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:11:29.492578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":581,"num_read_kb":8832,"num_write":1027,"num_write_kb":25070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.941343+0000","last_change":"2024-09-19T15:31:59.941343+0000","last_active":"2024-09-19T15:31:59.941343+0000","last_peered":"2024-09-19T15:31:59.941343+0000","last_clean":"2024-09-19T15:31:59.941343+0000","last_became_active":"2024-09-19T13:40:38.233312+0000","last_became_peered":"2024-09-19T13:40:38.233312+0000","last_unstale":"2024-09-19T15:31:59.941343+0000","last_undegraded":"2024-09-19T15:31:59.941343+0000","last_fullsized":"2024-09-19T15:31:59.941343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:59.941164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:59.941164+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.941164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:40:15.114932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'335","reported_seq":973,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:12.545619+0000","last_change":"2024-09-19T15:32:12.545619+0000","last_active":"2024-09-19T15:32:12.545619+0000","last_peered":"2024-09-19T15:32:12.545619+0000","last_clean":"2024-09-19T15:32:12.545619+0000","last_became_active":"2024-09-19T13:40:40.247025+0000","last_became_peered":"2024-09-19T13:40:40.247025+0000","last_unstale":"2024-09-19T15:32:12.545619+0000","last_undegraded":"2024-09-19T15:32:12.545619+0000","last_fullsized":"2024-09-19T15:32:12.545619+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'335","last_scrub_stamp":"2024-09-19T15:32:12.545383+0000","last_deep_scrub":"268'335","last_deep_scrub_stamp":"2024-09-19T15:32:12.545383+0000","last_clean_scrub_stamp":"2024-09-19T15:32:12.545383+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:50:50.860604+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47892,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":557,"num_read_kb":1096,"num_write":476,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:12.629800+0000","last_change":"2024-09-19T15:32:12.629800+0000","last_active":"2024-09-19T15:32:12.629800+0000","last_peered":"2024-09-19T15:32:12.629800+0000","last_clean":"2024-09-19T15:32:12.629800+0000","last_became_active":"2024-09-19T13:40:42.243325+0000","last_became_peered":"2024-09-19T13:40:42.243325+0000","last_unstale":"2024-09-19T15:32:12.629800+0000","last_undegraded":"2024-09-19T15:32:12.629800+0000","last_fullsized":"2024-09-19T15:32:12.629800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:12.629625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:12.629625+0000","last_clean_scrub_stamp":"2024-09-19T15:32:12.629625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:25:02.824347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'147","reported_seq":687,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:24.155393+0000","last_change":"2024-09-19T15:32:24.155393+0000","last_active":"2024-09-19T15:32:24.155393+0000","last_peered":"2024-09-19T15:32:24.155393+0000","last_clean":"2024-09-19T15:32:24.155393+0000","last_became_active":"2024-09-19T13:40:44.267716+0000","last_became_peered":"2024-09-19T13:40:44.267716+0000","last_unstale":"2024-09-19T15:32:24.155393+0000","last_undegraded":"2024-09-19T15:32:24.155393+0000","last_fullsized":"2024-09-19T15:32:24.155393+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'147","last_scrub_stamp":"2024-09-19T15:32:24.155219+0000","last_deep_scrub":"268'147","last_deep_scrub_stamp":"2024-09-19T15:32:24.155219+0000","last_clean_scrub_stamp":"2024-09-19T15:32:24.155219+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:34:30.313308+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":190,"num_read_kb":181,"num_write":368,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'1170","reported_seq":2999,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.490117+0000","last_change":"2024-09-19T15:31:53.490117+0000","last_active":"2024-09-19T15:31:53.490117+0000","last_peered":"2024-09-19T15:31:53.490117+0000","last_clean":"2024-09-19T15:31:53.490117+0000","last_became_active":"2024-09-19T13:40:36.216332+0000","last_became_peered":"2024-09-19T13:40:36.216332+0000","last_unstale":"2024-09-19T15:31:53.490117+0000","last_undegraded":"2024-09-19T15:31:53.490117+0000","last_fullsized":"2024-09-19T15:31:53.490117+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1170","last_scrub_stamp":"2024-09-19T15:31:53.489935+0000","last_deep_scrub":"268'1170","last_deep_scrub_stamp":"2024-09-19T15:31:53.489935+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.489935+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":1100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:06.157095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5686,"num_read_kb":5084,"num_write":1563,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1534,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'376","reported_seq":1055,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:46.953114+0000","last_change":"2024-09-19T15:31:46.952878+0000","last_active":"2024-09-19T15:31:46.953114+0000","last_peered":"2024-09-19T15:31:46.953114+0000","last_clean":"2024-09-19T15:31:46.953114+0000","last_became_active":"2024-09-19T13:41:05.314782+0000","last_became_peered":"2024-09-19T13:41:05.314782+0000","last_unstale":"2024-09-19T15:31:46.953114+0000","last_undegraded":"2024-09-19T15:31:46.953114+0000","last_fullsized":"2024-09-19T15:31:46.953114+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'376","last_scrub_stamp":"2024-09-19T15:31:46.952619+0000","last_deep_scrub":"268'376","last_deep_scrub_stamp":"2024-09-19T15:31:46.952619+0000","last_clean_scrub_stamp":"2024-09-19T15:31:46.952619+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:39:58.061630+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":644,"num_read_kb":47078,"num_write":1156,"num_write_kb":40849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.614797+0000","last_change":"2024-09-19T15:32:00.614797+0000","last_active":"2024-09-19T15:32:00.614797+0000","last_peered":"2024-09-19T15:32:00.614797+0000","last_clean":"2024-09-19T15:32:00.614797+0000","last_became_active":"2024-09-19T13:40:38.246684+0000","last_became_peered":"2024-09-19T13:40:38.246684+0000","last_unstale":"2024-09-19T15:32:00.614797+0000","last_undegraded":"2024-09-19T15:32:00.614797+0000","last_fullsized":"2024-09-19T15:32:00.614797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:00.614607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:00.614607+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.614607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:00.446450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'392","reported_seq":1053,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.992019+0000","last_change":"2024-09-19T15:32:03.992019+0000","last_active":"2024-09-19T15:32:03.992019+0000","last_peered":"2024-09-19T15:32:03.992019+0000","last_clean":"2024-09-19T15:32:03.992019+0000","last_became_active":"2024-09-19T13:40:40.221766+0000","last_became_peered":"2024-09-19T13:40:40.221766+0000","last_unstale":"2024-09-19T15:32:03.992019+0000","last_undegraded":"2024-09-19T15:32:03.992019+0000","last_fullsized":"2024-09-19T15:32:03.992019+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'392","last_scrub_stamp":"2024-09-19T15:32:03.991763+0000","last_deep_scrub":"268'392","last_deep_scrub_stamp":"2024-09-19T15:32:03.991763+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.991763+0000","objects_scrubbed":7,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:45.051102+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44832,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":632,"num_read_kb":1260,"num_write":492,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'744","reported_seq":3084,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.931429+0000","last_change":"2024-09-19T15:32:06.931429+0000","last_active":"2024-09-19T15:32:06.931429+0000","last_peered":"2024-09-19T15:32:06.931429+0000","last_clean":"2024-09-19T15:32:06.931429+0000","last_became_active":"2024-09-19T13:40:42.246030+0000","last_became_peered":"2024-09-19T13:40:42.246030+0000","last_unstale":"2024-09-19T15:32:06.931429+0000","last_undegraded":"2024-09-19T15:32:06.931429+0000","last_fullsized":"2024-09-19T15:32:06.931429+0000","mapping_epoch":33,"log_start":"268'702","ondisk_log_start":"268'702","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'744","last_scrub_stamp":"2024-09-19T15:32:06.931254+0000","last_deep_scrub":"268'744","last_deep_scrub_stamp":"2024-09-19T15:32:06.931254+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.931254+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":702,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:22:51.911715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'127","reported_seq":657,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:11.683400+0000","last_change":"2024-09-19T15:32:11.683400+0000","last_active":"2024-09-19T15:32:11.683400+0000","last_peered":"2024-09-19T15:32:11.683400+0000","last_clean":"2024-09-19T15:32:11.683400+0000","last_became_active":"2024-09-19T13:40:44.249529+0000","last_became_peered":"2024-09-19T13:40:44.249529+0000","last_unstale":"2024-09-19T15:32:11.683400+0000","last_undegraded":"2024-09-19T15:32:11.683400+0000","last_fullsized":"2024-09-19T15:32:11.683400+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'127","last_scrub_stamp":"2024-09-19T15:32:11.683167+0000","last_deep_scrub":"268'127","last_deep_scrub_stamp":"2024-09-19T15:32:11.683167+0000","last_clean_scrub_stamp":"2024-09-19T15:32:11.683167+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:38.497896+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1650,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":290,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'1318","reported_seq":3136,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.504535+0000","last_change":"2024-09-19T15:31:54.504535+0000","last_active":"2024-09-19T15:31:54.504535+0000","last_peered":"2024-09-19T15:31:54.504535+0000","last_clean":"2024-09-19T15:31:54.504535+0000","last_became_active":"2024-09-19T13:40:36.218760+0000","last_became_peered":"2024-09-19T13:40:36.218760+0000","last_unstale":"2024-09-19T15:31:54.504535+0000","last_undegraded":"2024-09-19T15:31:54.504535+0000","last_fullsized":"2024-09-19T15:31:54.504535+0000","mapping_epoch":27,"log_start":"268'1300","ondisk_log_start":"268'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1318","last_scrub_stamp":"2024-09-19T15:31:54.504354+0000","last_deep_scrub":"268'1318","last_deep_scrub_stamp":"2024-09-19T15:31:54.504354+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.504354+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":1300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:19:34.417947+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6184,"num_read_kb":5469,"num_write":1814,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'395","reported_seq":1112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.562943+0000","last_change":"2024-09-19T15:31:48.562943+0000","last_active":"2024-09-19T15:31:48.562943+0000","last_peered":"2024-09-19T15:31:48.562943+0000","last_clean":"2024-09-19T15:31:48.562943+0000","last_became_active":"2024-09-19T13:40:34.264354+0000","last_became_peered":"2024-09-19T13:40:34.264354+0000","last_unstale":"2024-09-19T15:31:48.562943+0000","last_undegraded":"2024-09-19T15:31:48.562943+0000","last_fullsized":"2024-09-19T15:31:48.562943+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'395","last_scrub_stamp":"2024-09-19T15:31:48.562728+0000","last_deep_scrub":"268'395","last_deep_scrub_stamp":"2024-09-19T15:31:48.562728+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.562728+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:53.759979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":738,"num_read_kb":5537,"num_write":1291,"num_write_kb":30004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"268'4","reported_seq":1495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:09.740426+0000","last_change":"2024-09-19T15:32:09.740426+0000","last_active":"2024-09-19T15:32:09.740426+0000","last_peered":"2024-09-19T15:32:09.740426+0000","last_clean":"2024-09-19T15:32:09.740426+0000","last_became_active":"2024-09-19T13:40:38.225663+0000","last_became_peered":"2024-09-19T13:40:38.225663+0000","last_unstale":"2024-09-19T15:32:09.740426+0000","last_undegraded":"2024-09-19T15:32:09.740426+0000","last_fullsized":"2024-09-19T15:32:09.740426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-19T15:32:09.740237+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-19T15:32:09.740237+0000","last_clean_scrub_stamp":"2024-09-19T15:32:09.740237+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:46:34.207630+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":948,"num_read_kb":948,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'152","reported_seq":745,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:13.115013+0000","last_change":"2024-09-19T15:32:13.115013+0000","last_active":"2024-09-19T15:32:13.115013+0000","last_peered":"2024-09-19T15:32:13.115013+0000","last_clean":"2024-09-19T15:32:13.115013+0000","last_became_active":"2024-09-19T13:40:40.220534+0000","last_became_peered":"2024-09-19T13:40:40.220534+0000","last_unstale":"2024-09-19T15:32:13.115013+0000","last_undegraded":"2024-09-19T15:32:13.115013+0000","last_fullsized":"2024-09-19T15:32:13.115013+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'152","last_scrub_stamp":"2024-09-19T15:32:13.114764+0000","last_deep_scrub":"268'152","last_deep_scrub_stamp":"2024-09-19T15:32:13.114764+0000","last_clean_scrub_stamp":"2024-09-19T15:32:13.114764+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:44.466910+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":176,"num_write":122,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'765","reported_seq":5689,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.994466+0000","last_change":"2024-09-19T15:32:04.994466+0000","last_active":"2024-09-19T15:32:04.994466+0000","last_peered":"2024-09-19T15:32:04.994466+0000","last_clean":"2024-09-19T15:32:04.994466+0000","last_became_active":"2024-09-19T13:40:42.240074+0000","last_became_peered":"2024-09-19T13:40:42.240074+0000","last_unstale":"2024-09-19T15:32:04.994466+0000","last_undegraded":"2024-09-19T15:32:04.994466+0000","last_fullsized":"2024-09-19T15:32:04.994466+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'765","last_scrub_stamp":"2024-09-19T15:32:04.994274+0000","last_deep_scrub":"268'765","last_deep_scrub_stamp":"2024-09-19T15:32:04.994274+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.994274+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:38.710010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'114","reported_seq":644,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:19.609109+0000","last_change":"2024-09-19T15:32:19.609109+0000","last_active":"2024-09-19T15:32:19.609109+0000","last_peered":"2024-09-19T15:32:19.609109+0000","last_clean":"2024-09-19T15:32:19.609109+0000","last_became_active":"2024-09-19T13:40:44.251353+0000","last_became_peered":"2024-09-19T13:40:44.251353+0000","last_unstale":"2024-09-19T15:32:19.609109+0000","last_undegraded":"2024-09-19T15:32:19.609109+0000","last_fullsized":"2024-09-19T15:32:19.609109+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'114","last_scrub_stamp":"2024-09-19T15:32:19.608922+0000","last_deep_scrub":"268'114","last_deep_scrub_stamp":"2024-09-19T15:32:19.608922+0000","last_clean_scrub_stamp":"2024-09-19T15:32:19.608922+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:32.666808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'1844","reported_seq":3622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.612221+0000","last_change":"2024-09-19T15:31:56.612221+0000","last_active":"2024-09-19T15:31:56.612221+0000","last_peered":"2024-09-19T15:31:56.612221+0000","last_clean":"2024-09-19T15:31:56.612221+0000","last_became_active":"2024-09-19T13:40:36.221638+0000","last_became_peered":"2024-09-19T13:40:36.221638+0000","last_unstale":"2024-09-19T15:31:56.612221+0000","last_undegraded":"2024-09-19T15:31:56.612221+0000","last_fullsized":"2024-09-19T15:31:56.612221+0000","mapping_epoch":27,"log_start":"268'1800","ondisk_log_start":"268'1800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1844","last_scrub_stamp":"2024-09-19T15:31:56.612043+0000","last_deep_scrub":"268'1844","last_deep_scrub_stamp":"2024-09-19T15:31:56.612043+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.612043+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":1800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:26.022150+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8811,"num_read_kb":7740,"num_write":2693,"num_write_kb":1220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"268'357","reported_seq":1061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.880923+0000","last_change":"2024-09-19T15:31:48.880923+0000","last_active":"2024-09-19T15:31:48.880923+0000","last_peered":"2024-09-19T15:31:48.880923+0000","last_clean":"2024-09-19T15:31:48.880923+0000","last_became_active":"2024-09-19T13:40:34.236257+0000","last_became_peered":"2024-09-19T13:40:34.236257+0000","last_unstale":"2024-09-19T15:31:48.880923+0000","last_undegraded":"2024-09-19T15:31:48.880923+0000","last_fullsized":"2024-09-19T15:31:48.880923+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'357","last_scrub_stamp":"2024-09-19T15:31:48.880705+0000","last_deep_scrub":"268'357","last_deep_scrub_stamp":"2024-09-19T15:31:48.880705+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.880705+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:23.093501+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136845,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":663,"num_read_kb":21601,"num_write":1219,"num_write_kb":27464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:09.574695+0000","last_change":"2024-09-19T15:32:09.574695+0000","last_active":"2024-09-19T15:32:09.574695+0000","last_peered":"2024-09-19T15:32:09.574695+0000","last_clean":"2024-09-19T15:32:09.574695+0000","last_became_active":"2024-09-19T13:40:38.235737+0000","last_became_peered":"2024-09-19T13:40:38.235737+0000","last_unstale":"2024-09-19T15:32:09.574695+0000","last_undegraded":"2024-09-19T15:32:09.574695+0000","last_fullsized":"2024-09-19T15:32:09.574695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:09.574502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:09.574502+0000","last_clean_scrub_stamp":"2024-09-19T15:32:09.574502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:24.866773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'558","reported_seq":1259,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:15.673846+0000","last_change":"2024-09-19T15:32:15.673846+0000","last_active":"2024-09-19T15:32:15.673846+0000","last_peered":"2024-09-19T15:32:15.673846+0000","last_clean":"2024-09-19T15:32:15.673846+0000","last_became_active":"2024-09-19T13:40:40.235679+0000","last_became_peered":"2024-09-19T13:40:40.235679+0000","last_unstale":"2024-09-19T15:32:15.673846+0000","last_undegraded":"2024-09-19T15:32:15.673846+0000","last_fullsized":"2024-09-19T15:32:15.673846+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'558","last_scrub_stamp":"2024-09-19T15:32:15.673706+0000","last_deep_scrub":"268'558","last_deep_scrub_stamp":"2024-09-19T15:32:15.673706+0000","last_clean_scrub_stamp":"2024-09-19T15:32:15.673706+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:08:05.911020+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50661,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1488,"num_read_kb":2077,"num_write":2114,"num_write_kb":1883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":517528,"num_omap_keys":1192,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.022561+0000","last_change":"2024-09-19T15:32:04.022561+0000","last_active":"2024-09-19T15:32:04.022561+0000","last_peered":"2024-09-19T15:32:04.022561+0000","last_clean":"2024-09-19T15:32:04.022561+0000","last_became_active":"2024-09-19T13:40:42.250462+0000","last_became_peered":"2024-09-19T13:40:42.250462+0000","last_unstale":"2024-09-19T15:32:04.022561+0000","last_undegraded":"2024-09-19T15:32:04.022561+0000","last_fullsized":"2024-09-19T15:32:04.022561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:04.022361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:04.022361+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.022361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:05.155379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'149","reported_seq":688,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:12.725072+0000","last_change":"2024-09-19T15:32:12.725072+0000","last_active":"2024-09-19T15:32:12.725072+0000","last_peered":"2024-09-19T15:32:12.725072+0000","last_clean":"2024-09-19T15:32:12.725072+0000","last_became_active":"2024-09-19T13:40:44.266642+0000","last_became_peered":"2024-09-19T13:40:44.266642+0000","last_unstale":"2024-09-19T15:32:12.725072+0000","last_undegraded":"2024-09-19T15:32:12.725072+0000","last_fullsized":"2024-09-19T15:32:12.725072+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'149","last_scrub_stamp":"2024-09-19T15:32:12.724895+0000","last_deep_scrub":"268'149","last_deep_scrub_stamp":"2024-09-19T15:32:12.724895+0000","last_clean_scrub_stamp":"2024-09-19T15:32:12.724895+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:08:26.047796+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":208,"num_write":352,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'502","reported_seq":2081,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.895993+0000","last_change":"2024-09-19T15:31:53.895993+0000","last_active":"2024-09-19T15:31:53.895993+0000","last_peered":"2024-09-19T15:31:53.895993+0000","last_clean":"2024-09-19T15:31:53.895993+0000","last_became_active":"2024-09-19T13:40:36.218550+0000","last_became_peered":"2024-09-19T13:40:36.218550+0000","last_unstale":"2024-09-19T15:31:53.895993+0000","last_undegraded":"2024-09-19T15:31:53.895993+0000","last_fullsized":"2024-09-19T15:31:53.895993+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'502","last_scrub_stamp":"2024-09-19T15:31:53.895802+0000","last_deep_scrub":"268'502","last_deep_scrub_stamp":"2024-09-19T15:31:53.895802+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.895802+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:03:34.157384+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2652,"num_read_kb":2446,"num_write":622,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"268'74","reported_seq":663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.790703+0000","last_change":"2024-09-19T15:31:48.790703+0000","last_active":"2024-09-19T15:31:48.790703+0000","last_peered":"2024-09-19T15:31:48.790703+0000","last_clean":"2024-09-19T15:31:48.790703+0000","last_became_active":"2024-09-19T13:40:13.615965+0000","last_became_peered":"2024-09-19T13:40:13.615965+0000","last_unstale":"2024-09-19T15:31:48.790703+0000","last_undegraded":"2024-09-19T15:31:48.790703+0000","last_fullsized":"2024-09-19T15:31:48.790703+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'74","last_scrub_stamp":"2024-09-19T15:31:48.790514+0000","last_deep_scrub":"268'74","last_deep_scrub_stamp":"2024-09-19T15:31:48.790514+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.790514+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:19.499884+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"268'2","reported_seq":575,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.839150+0000","last_change":"2024-09-19T15:31:48.839150+0000","last_active":"2024-09-19T15:31:48.839150+0000","last_peered":"2024-09-19T15:31:48.839150+0000","last_clean":"2024-09-19T15:31:48.839150+0000","last_became_active":"2024-09-19T13:40:20.100760+0000","last_became_peered":"2024-09-19T13:40:20.100760+0000","last_unstale":"2024-09-19T15:31:48.839150+0000","last_undegraded":"2024-09-19T15:31:48.839150+0000","last_fullsized":"2024-09-19T15:31:48.839150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:31:48.838968+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:31:48.838968+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.838968+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:39.704823+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001106569,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'318","reported_seq":1010,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.849582+0000","last_change":"2024-09-19T15:31:47.849582+0000","last_active":"2024-09-19T15:31:47.849582+0000","last_peered":"2024-09-19T15:31:47.849582+0000","last_clean":"2024-09-19T15:31:47.849582+0000","last_became_active":"2024-09-19T13:40:34.241162+0000","last_became_peered":"2024-09-19T13:40:34.241162+0000","last_unstale":"2024-09-19T15:31:47.849582+0000","last_undegraded":"2024-09-19T15:31:47.849582+0000","last_fullsized":"2024-09-19T15:31:47.849582+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'318","last_scrub_stamp":"2024-09-19T15:31:47.849462+0000","last_deep_scrub":"268'318","last_deep_scrub_stamp":"2024-09-19T15:31:47.849462+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.849462+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:11.026243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":104186,"num_write":970,"num_write_kb":16810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":542,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.709741+0000","last_change":"2024-09-19T15:32:05.709741+0000","last_active":"2024-09-19T15:32:05.709741+0000","last_peered":"2024-09-19T15:32:05.709741+0000","last_clean":"2024-09-19T15:32:05.709741+0000","last_became_active":"2024-09-19T13:40:38.231762+0000","last_became_peered":"2024-09-19T13:40:38.231762+0000","last_unstale":"2024-09-19T15:32:05.709741+0000","last_undegraded":"2024-09-19T15:32:05.709741+0000","last_fullsized":"2024-09-19T15:32:05.709741+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:05.709473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:05.709473+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.709473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:16:34.993980+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'762","reported_seq":1529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:13.705887+0000","last_change":"2024-09-19T15:32:13.705887+0000","last_active":"2024-09-19T15:32:13.705887+0000","last_peered":"2024-09-19T15:32:13.705887+0000","last_clean":"2024-09-19T15:32:13.705887+0000","last_became_active":"2024-09-19T13:40:40.239392+0000","last_became_peered":"2024-09-19T13:40:40.239392+0000","last_unstale":"2024-09-19T15:32:13.705887+0000","last_undegraded":"2024-09-19T15:32:13.705887+0000","last_fullsized":"2024-09-19T15:32:13.705887+0000","mapping_epoch":31,"log_start":"268'700","ondisk_log_start":"268'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'762","last_scrub_stamp":"2024-09-19T15:32:13.705693+0000","last_deep_scrub":"268'762","last_deep_scrub_stamp":"2024-09-19T15:32:13.705693+0000","last_clean_scrub_stamp":"2024-09-19T15:32:13.705693+0000","objects_scrubbed":6,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:58.948100+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146379,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1466,"num_read_kb":3232,"num_write":1394,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89512,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:11.635083+0000","last_change":"2024-09-19T15:32:11.635083+0000","last_active":"2024-09-19T15:32:11.635083+0000","last_peered":"2024-09-19T15:32:11.635083+0000","last_clean":"2024-09-19T15:32:11.635083+0000","last_became_active":"2024-09-19T13:40:42.239749+0000","last_became_peered":"2024-09-19T13:40:42.239749+0000","last_unstale":"2024-09-19T15:32:11.635083+0000","last_undegraded":"2024-09-19T15:32:11.635083+0000","last_fullsized":"2024-09-19T15:32:11.635083+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:11.634896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:11.634896+0000","last_clean_scrub_stamp":"2024-09-19T15:32:11.634896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:49.517598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'202","reported_seq":931,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:10.013388+0000","last_change":"2024-09-19T15:32:10.013388+0000","last_active":"2024-09-19T15:32:10.013388+0000","last_peered":"2024-09-19T15:32:10.013388+0000","last_clean":"2024-09-19T15:32:10.013388+0000","last_became_active":"2024-09-19T13:40:44.264456+0000","last_became_peered":"2024-09-19T13:40:44.264456+0000","last_unstale":"2024-09-19T15:32:10.013388+0000","last_undegraded":"2024-09-19T15:32:10.013388+0000","last_fullsized":"2024-09-19T15:32:10.013388+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'202","last_scrub_stamp":"2024-09-19T15:32:10.013305+0000","last_deep_scrub":"268'202","last_deep_scrub_stamp":"2024-09-19T15:32:10.013305+0000","last_clean_scrub_stamp":"2024-09-19T15:32:10.013305+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:58:41.371854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":469,"num_write":408,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'754","reported_seq":2277,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.751994+0000","last_change":"2024-09-19T15:31:54.751994+0000","last_active":"2024-09-19T15:31:54.751994+0000","last_peered":"2024-09-19T15:31:54.751994+0000","last_clean":"2024-09-19T15:31:54.751994+0000","last_became_active":"2024-09-19T13:40:36.221186+0000","last_became_peered":"2024-09-19T13:40:36.221186+0000","last_unstale":"2024-09-19T15:31:54.751994+0000","last_undegraded":"2024-09-19T15:31:54.751994+0000","last_fullsized":"2024-09-19T15:31:54.751994+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'754","last_scrub_stamp":"2024-09-19T15:31:54.751805+0000","last_deep_scrub":"268'754","last_deep_scrub_stamp":"2024-09-19T15:31:54.751805+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.751805+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:42:16.653037+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3545,"num_read_kb":3202,"num_write":973,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":570,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.770258+0000","last_change":"2024-09-19T15:31:49.770258+0000","last_active":"2024-09-19T15:31:49.770258+0000","last_peered":"2024-09-19T15:31:49.770258+0000","last_clean":"2024-09-19T15:31:49.770258+0000","last_became_active":"2024-09-19T13:40:20.099608+0000","last_became_peered":"2024-09-19T13:40:20.099608+0000","last_unstale":"2024-09-19T15:31:49.770258+0000","last_undegraded":"2024-09-19T15:31:49.770258+0000","last_fullsized":"2024-09-19T15:31:49.770258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:49.770079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:49.770079+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.770079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:35.739125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001034798,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'310","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:44.606331+0000","last_change":"2024-09-19T15:31:44.606331+0000","last_active":"2024-09-19T15:31:44.606331+0000","last_peered":"2024-09-19T15:31:44.606331+0000","last_clean":"2024-09-19T15:31:44.606331+0000","last_became_active":"2024-09-19T13:40:34.264819+0000","last_became_peered":"2024-09-19T13:40:34.264819+0000","last_unstale":"2024-09-19T15:31:44.606331+0000","last_undegraded":"2024-09-19T15:31:44.606331+0000","last_fullsized":"2024-09-19T15:31:44.606331+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'310","last_scrub_stamp":"2024-09-19T15:31:44.606212+0000","last_deep_scrub":"268'310","last_deep_scrub_stamp":"2024-09-19T15:31:44.606212+0000","last_clean_scrub_stamp":"2024-09-19T15:31:44.606212+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:25:58.694141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":579,"num_read_kb":52358,"num_write":971,"num_write_kb":38982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":545,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.770241+0000","last_change":"2024-09-19T15:32:08.770241+0000","last_active":"2024-09-19T15:32:08.770241+0000","last_peered":"2024-09-19T15:32:08.770241+0000","last_clean":"2024-09-19T15:32:08.770241+0000","last_became_active":"2024-09-19T13:40:38.222905+0000","last_became_peered":"2024-09-19T13:40:38.222905+0000","last_unstale":"2024-09-19T15:32:08.770241+0000","last_undegraded":"2024-09-19T15:32:08.770241+0000","last_fullsized":"2024-09-19T15:32:08.770241+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:08.770061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:08.770061+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.770061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:12.097558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'1445","reported_seq":3773,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.602207+0000","last_change":"2024-09-19T15:32:07.602207+0000","last_active":"2024-09-19T15:32:07.602207+0000","last_peered":"2024-09-19T15:32:07.602207+0000","last_clean":"2024-09-19T15:32:07.602207+0000","last_became_active":"2024-09-19T13:40:40.240768+0000","last_became_peered":"2024-09-19T13:40:40.240768+0000","last_unstale":"2024-09-19T15:32:07.602207+0000","last_undegraded":"2024-09-19T15:32:07.602207+0000","last_fullsized":"2024-09-19T15:32:07.602207+0000","mapping_epoch":31,"log_start":"268'1400","ondisk_log_start":"268'1400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1445","last_scrub_stamp":"2024-09-19T15:32:07.602011+0000","last_deep_scrub":"268'1445","last_deep_scrub_stamp":"2024-09-19T15:32:07.602011+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.602011+0000","objects_scrubbed":11,"log_size":45,"log_dups_size":1400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:33:19.664247+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140168,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2240,"num_read_kb":4108,"num_write":1354,"num_write_kb":1102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:15.675453+0000","last_change":"2024-09-19T15:32:15.675453+0000","last_active":"2024-09-19T15:32:15.675453+0000","last_peered":"2024-09-19T15:32:15.675453+0000","last_clean":"2024-09-19T15:32:15.675453+0000","last_became_active":"2024-09-19T13:40:42.250172+0000","last_became_peered":"2024-09-19T13:40:42.250172+0000","last_unstale":"2024-09-19T15:32:15.675453+0000","last_undegraded":"2024-09-19T15:32:15.675453+0000","last_fullsized":"2024-09-19T15:32:15.675453+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:15.675277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:15.675277+0000","last_clean_scrub_stamp":"2024-09-19T15:32:15.675277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:42.491231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'253","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:16.648130+0000","last_change":"2024-09-19T15:32:16.648130+0000","last_active":"2024-09-19T15:32:16.648130+0000","last_peered":"2024-09-19T15:32:16.648130+0000","last_clean":"2024-09-19T15:32:16.648130+0000","last_became_active":"2024-09-19T13:40:44.272356+0000","last_became_peered":"2024-09-19T13:40:44.272356+0000","last_unstale":"2024-09-19T15:32:16.648130+0000","last_undegraded":"2024-09-19T15:32:16.648130+0000","last_fullsized":"2024-09-19T15:32:16.648130+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'253","last_scrub_stamp":"2024-09-19T15:32:16.647930+0000","last_deep_scrub":"268'253","last_deep_scrub_stamp":"2024-09-19T15:32:16.647930+0000","last_clean_scrub_stamp":"2024-09-19T15:32:16.647930+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:12.305679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":580,"num_read_kb":531,"num_write":551,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'465","reported_seq":2147,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.602220+0000","last_change":"2024-09-19T15:31:54.602220+0000","last_active":"2024-09-19T15:31:54.602220+0000","last_peered":"2024-09-19T15:31:54.602220+0000","last_clean":"2024-09-19T15:31:54.602220+0000","last_became_active":"2024-09-19T13:40:36.241832+0000","last_became_peered":"2024-09-19T13:40:36.241832+0000","last_unstale":"2024-09-19T15:31:54.602220+0000","last_undegraded":"2024-09-19T15:31:54.602220+0000","last_fullsized":"2024-09-19T15:31:54.602220+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'465","last_scrub_stamp":"2024-09-19T15:31:54.602015+0000","last_deep_scrub":"268'465","last_deep_scrub_stamp":"2024-09-19T15:31:54.602015+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.602015+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:16:12.446436+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2706,"num_read_kb":2545,"num_write":558,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":561,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:45.916600+0000","last_change":"2024-09-19T15:31:45.916600+0000","last_active":"2024-09-19T15:31:45.916600+0000","last_peered":"2024-09-19T15:31:45.916600+0000","last_clean":"2024-09-19T15:31:45.916600+0000","last_became_active":"2024-09-19T13:40:20.096900+0000","last_became_peered":"2024-09-19T13:40:20.096900+0000","last_unstale":"2024-09-19T15:31:45.916600+0000","last_undegraded":"2024-09-19T15:31:45.916600+0000","last_fullsized":"2024-09-19T15:31:45.916600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:45.916488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:45.916488+0000","last_clean_scrub_stamp":"2024-09-19T15:31:45.916488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:25:28.228849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00074274699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'333","reported_seq":1004,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:46.591446+0000","last_change":"2024-09-19T15:31:46.591446+0000","last_active":"2024-09-19T15:31:46.591446+0000","last_peered":"2024-09-19T15:31:46.591446+0000","last_clean":"2024-09-19T15:31:46.591446+0000","last_became_active":"2024-09-19T13:40:34.235483+0000","last_became_peered":"2024-09-19T13:40:34.235483+0000","last_unstale":"2024-09-19T15:31:46.591446+0000","last_undegraded":"2024-09-19T15:31:46.591446+0000","last_fullsized":"2024-09-19T15:31:46.591446+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'333","last_scrub_stamp":"2024-09-19T15:31:46.591292+0000","last_deep_scrub":"268'333","last_deep_scrub_stamp":"2024-09-19T15:31:46.591292+0000","last_clean_scrub_stamp":"2024-09-19T15:31:46.591292+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:16.796032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":610,"num_read_kb":5129,"num_write":1002,"num_write_kb":29541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"268'2","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.858708+0000","last_change":"2024-09-19T15:31:55.858708+0000","last_active":"2024-09-19T15:31:55.858708+0000","last_peered":"2024-09-19T15:31:55.858708+0000","last_clean":"2024-09-19T15:31:55.858708+0000","last_became_active":"2024-09-19T13:40:38.228364+0000","last_became_peered":"2024-09-19T13:40:38.228364+0000","last_unstale":"2024-09-19T15:31:55.858708+0000","last_undegraded":"2024-09-19T15:31:55.858708+0000","last_fullsized":"2024-09-19T15:31:55.858708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:31:55.858532+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:31:55.858532+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.858532+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:13:50.260015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'376","reported_seq":2321,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:10.621029+0000","last_change":"2024-09-19T15:32:10.621029+0000","last_active":"2024-09-19T15:32:10.621029+0000","last_peered":"2024-09-19T15:32:10.621029+0000","last_clean":"2024-09-19T15:32:10.621029+0000","last_became_active":"2024-09-19T13:40:40.231491+0000","last_became_peered":"2024-09-19T13:40:40.231491+0000","last_unstale":"2024-09-19T15:32:10.621029+0000","last_undegraded":"2024-09-19T15:32:10.621029+0000","last_fullsized":"2024-09-19T15:32:10.621029+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'376","last_scrub_stamp":"2024-09-19T15:32:10.620833+0000","last_deep_scrub":"268'376","last_deep_scrub_stamp":"2024-09-19T15:32:10.620833+0000","last_clean_scrub_stamp":"2024-09-19T15:32:10.620833+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:23:33.220998+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":364,"num_read_kb":356,"num_write":351,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:09.669183+0000","last_change":"2024-09-19T15:32:09.669183+0000","last_active":"2024-09-19T15:32:09.669183+0000","last_peered":"2024-09-19T15:32:09.669183+0000","last_clean":"2024-09-19T15:32:09.669183+0000","last_became_active":"2024-09-19T13:40:42.226706+0000","last_became_peered":"2024-09-19T13:40:42.226706+0000","last_unstale":"2024-09-19T15:32:09.669183+0000","last_undegraded":"2024-09-19T15:32:09.669183+0000","last_fullsized":"2024-09-19T15:32:09.669183+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:09.668955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:09.668955+0000","last_clean_scrub_stamp":"2024-09-19T15:32:09.668955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:20.743988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'260","reported_seq":918,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:23.162860+0000","last_change":"2024-09-19T15:32:23.162860+0000","last_active":"2024-09-19T15:32:23.162860+0000","last_peered":"2024-09-19T15:32:23.162860+0000","last_clean":"2024-09-19T15:32:23.162860+0000","last_became_active":"2024-09-19T13:40:44.240277+0000","last_became_peered":"2024-09-19T13:40:44.240277+0000","last_unstale":"2024-09-19T15:32:23.162860+0000","last_undegraded":"2024-09-19T15:32:23.162860+0000","last_fullsized":"2024-09-19T15:32:23.162860+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'260","last_scrub_stamp":"2024-09-19T15:32:23.162672+0000","last_deep_scrub":"268'260","last_deep_scrub_stamp":"2024-09-19T15:32:23.162672+0000","last_clean_scrub_stamp":"2024-09-19T15:32:23.162672+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:16:24.144823+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":590,"num_read_kb":596,"num_write":565,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'478","reported_seq":2087,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.589189+0000","last_change":"2024-09-19T15:31:52.589189+0000","last_active":"2024-09-19T15:31:52.589189+0000","last_peered":"2024-09-19T15:31:52.589189+0000","last_clean":"2024-09-19T15:31:52.589189+0000","last_became_active":"2024-09-19T13:40:36.220514+0000","last_became_peered":"2024-09-19T13:40:36.220514+0000","last_unstale":"2024-09-19T15:31:52.589189+0000","last_undegraded":"2024-09-19T15:31:52.589189+0000","last_fullsized":"2024-09-19T15:31:52.589189+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'478","last_scrub_stamp":"2024-09-19T15:31:52.588993+0000","last_deep_scrub":"268'478","last_deep_scrub_stamp":"2024-09-19T15:31:52.588993+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.588993+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:13.983822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2550,"num_read_kb":2381,"num_write":569,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"268'3","reported_seq":576,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.883980+0000","last_change":"2024-09-19T15:31:49.883980+0000","last_active":"2024-09-19T15:31:49.883980+0000","last_peered":"2024-09-19T15:31:49.883980+0000","last_clean":"2024-09-19T15:31:49.883980+0000","last_became_active":"2024-09-19T13:40:20.101198+0000","last_became_peered":"2024-09-19T13:40:20.101198+0000","last_unstale":"2024-09-19T15:31:49.883980+0000","last_undegraded":"2024-09-19T15:31:49.883980+0000","last_fullsized":"2024-09-19T15:31:49.883980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:31:49.883770+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:31:49.883770+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.883770+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:31.078465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0026053059999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'331","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.535052+0000","last_change":"2024-09-19T15:31:49.535052+0000","last_active":"2024-09-19T15:31:49.535052+0000","last_peered":"2024-09-19T15:31:49.535052+0000","last_clean":"2024-09-19T15:31:49.535052+0000","last_became_active":"2024-09-19T13:40:34.228632+0000","last_became_peered":"2024-09-19T13:40:34.228632+0000","last_unstale":"2024-09-19T15:31:49.535052+0000","last_undegraded":"2024-09-19T15:31:49.535052+0000","last_fullsized":"2024-09-19T15:31:49.535052+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'331","last_scrub_stamp":"2024-09-19T15:31:49.534756+0000","last_deep_scrub":"268'331","last_deep_scrub_stamp":"2024-09-19T15:31:49.534756+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.534756+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:30.697194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":586,"num_read_kb":6959,"num_write":997,"num_write_kb":25273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.682193+0000","last_change":"2024-09-19T15:32:02.682193+0000","last_active":"2024-09-19T15:32:02.682193+0000","last_peered":"2024-09-19T15:32:02.682193+0000","last_clean":"2024-09-19T15:32:02.682193+0000","last_became_active":"2024-09-19T13:40:38.229144+0000","last_became_peered":"2024-09-19T13:40:38.229144+0000","last_unstale":"2024-09-19T15:32:02.682193+0000","last_undegraded":"2024-09-19T15:32:02.682193+0000","last_fullsized":"2024-09-19T15:32:02.682193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:02.681899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:02.681899+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.681899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:38:34.444774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'221","reported_seq":844,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:11.123386+0000","last_change":"2024-09-19T15:32:11.123386+0000","last_active":"2024-09-19T15:32:11.123386+0000","last_peered":"2024-09-19T15:32:11.123386+0000","last_clean":"2024-09-19T15:32:11.123386+0000","last_became_active":"2024-09-19T13:40:40.249102+0000","last_became_peered":"2024-09-19T13:40:40.249102+0000","last_unstale":"2024-09-19T15:32:11.123386+0000","last_undegraded":"2024-09-19T15:32:11.123386+0000","last_fullsized":"2024-09-19T15:32:11.123386+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'221","last_scrub_stamp":"2024-09-19T15:32:11.123189+0000","last_deep_scrub":"268'221","last_deep_scrub_stamp":"2024-09-19T15:32:11.123189+0000","last_clean_scrub_stamp":"2024-09-19T15:32:11.123189+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:43.556142+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":198,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.976413+0000","last_change":"2024-09-19T15:32:02.976413+0000","last_active":"2024-09-19T15:32:02.976413+0000","last_peered":"2024-09-19T15:32:02.976413+0000","last_clean":"2024-09-19T15:32:02.976413+0000","last_became_active":"2024-09-19T13:40:42.250662+0000","last_became_peered":"2024-09-19T13:40:42.250662+0000","last_unstale":"2024-09-19T15:32:02.976413+0000","last_undegraded":"2024-09-19T15:32:02.976413+0000","last_fullsized":"2024-09-19T15:32:02.976413+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:02.976144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:02.976144+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.976144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:01:47.323179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'129","reported_seq":729,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:20.690284+0000","last_change":"2024-09-19T15:32:20.690284+0000","last_active":"2024-09-19T15:32:20.690284+0000","last_peered":"2024-09-19T15:32:20.690284+0000","last_clean":"2024-09-19T15:32:20.690284+0000","last_became_active":"2024-09-19T13:40:44.266678+0000","last_became_peered":"2024-09-19T13:40:44.266678+0000","last_unstale":"2024-09-19T15:32:20.690284+0000","last_undegraded":"2024-09-19T15:32:20.690284+0000","last_fullsized":"2024-09-19T15:32:20.690284+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'129","last_scrub_stamp":"2024-09-19T15:32:20.690092+0000","last_deep_scrub":"268'129","last_deep_scrub_stamp":"2024-09-19T15:32:20.690092+0000","last_clean_scrub_stamp":"2024-09-19T15:32:20.690092+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:58:14.495253+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":283,"num_read_kb":273,"num_write":324,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'763","reported_seq":2298,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.608306+0000","last_change":"2024-09-19T15:31:51.608306+0000","last_active":"2024-09-19T15:31:51.608306+0000","last_peered":"2024-09-19T15:31:51.608306+0000","last_clean":"2024-09-19T15:31:51.608306+0000","last_became_active":"2024-09-19T13:40:36.244403+0000","last_became_peered":"2024-09-19T13:40:36.244403+0000","last_unstale":"2024-09-19T15:31:51.608306+0000","last_undegraded":"2024-09-19T15:31:51.608306+0000","last_fullsized":"2024-09-19T15:31:51.608306+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'763","last_scrub_stamp":"2024-09-19T15:31:51.608119+0000","last_deep_scrub":"268'763","last_deep_scrub_stamp":"2024-09-19T15:31:51.608119+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.608119+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:20:55.798909+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3619,"num_read_kb":3269,"num_write":981,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'331","reported_seq":1054,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.872562+0000","last_change":"2024-09-19T15:31:47.872562+0000","last_active":"2024-09-19T15:31:47.872562+0000","last_peered":"2024-09-19T15:31:47.872562+0000","last_clean":"2024-09-19T15:31:47.872562+0000","last_became_active":"2024-09-19T13:40:34.225452+0000","last_became_peered":"2024-09-19T13:40:34.225452+0000","last_unstale":"2024-09-19T15:31:47.872562+0000","last_undegraded":"2024-09-19T15:31:47.872562+0000","last_fullsized":"2024-09-19T15:31:47.872562+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'331","last_scrub_stamp":"2024-09-19T15:31:47.872337+0000","last_deep_scrub":"268'331","last_deep_scrub_stamp":"2024-09-19T15:31:47.872337+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.872337+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:54:19.173058+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":603,"num_read_kb":97113,"num_write":1108,"num_write_kb":15979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":559,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.574504+0000","last_change":"2024-09-19T15:31:53.574504+0000","last_active":"2024-09-19T15:31:53.574504+0000","last_peered":"2024-09-19T15:31:53.574504+0000","last_clean":"2024-09-19T15:31:53.574504+0000","last_became_active":"2024-09-19T13:40:20.095294+0000","last_became_peered":"2024-09-19T13:40:20.095294+0000","last_unstale":"2024-09-19T15:31:53.574504+0000","last_undegraded":"2024-09-19T15:31:53.574504+0000","last_fullsized":"2024-09-19T15:31:53.574504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:53.574327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:53.574327+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.574327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:10:59.805802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088577700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.695360+0000","last_change":"2024-09-19T15:32:03.695360+0000","last_active":"2024-09-19T15:32:03.695360+0000","last_peered":"2024-09-19T15:32:03.695360+0000","last_clean":"2024-09-19T15:32:03.695360+0000","last_became_active":"2024-09-19T13:40:38.229743+0000","last_became_peered":"2024-09-19T13:40:38.229743+0000","last_unstale":"2024-09-19T15:32:03.695360+0000","last_undegraded":"2024-09-19T15:32:03.695360+0000","last_fullsized":"2024-09-19T15:32:03.695360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:03.695122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:03.695122+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.695122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:24.519149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'629","reported_seq":1372,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.718978+0000","last_change":"2024-09-19T15:32:06.718978+0000","last_active":"2024-09-19T15:32:06.718978+0000","last_peered":"2024-09-19T15:32:06.718978+0000","last_clean":"2024-09-19T15:32:06.718978+0000","last_became_active":"2024-09-19T13:40:40.223632+0000","last_became_peered":"2024-09-19T13:40:40.223632+0000","last_unstale":"2024-09-19T15:32:06.718978+0000","last_undegraded":"2024-09-19T15:32:06.718978+0000","last_fullsized":"2024-09-19T15:32:06.718978+0000","mapping_epoch":31,"log_start":"268'600","ondisk_log_start":"268'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'629","last_scrub_stamp":"2024-09-19T15:32:06.718778+0000","last_deep_scrub":"268'629","last_deep_scrub_stamp":"2024-09-19T15:32:06.718778+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.718778+0000","objects_scrubbed":9,"log_size":29,"log_dups_size":600,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:03:42.317447+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101088,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1063,"num_read_kb":2259,"num_write":846,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4334,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:15.560755+0000","last_change":"2024-09-19T15:32:15.560755+0000","last_active":"2024-09-19T15:32:15.560755+0000","last_peered":"2024-09-19T15:32:15.560755+0000","last_clean":"2024-09-19T15:32:15.560755+0000","last_became_active":"2024-09-19T13:40:42.245476+0000","last_became_peered":"2024-09-19T13:40:42.245476+0000","last_unstale":"2024-09-19T15:32:15.560755+0000","last_undegraded":"2024-09-19T15:32:15.560755+0000","last_fullsized":"2024-09-19T15:32:15.560755+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:15.560570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:15.560570+0000","last_clean_scrub_stamp":"2024-09-19T15:32:15.560570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:17:12.700932+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'144","reported_seq":690,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:18.590074+0000","last_change":"2024-09-19T15:32:18.590074+0000","last_active":"2024-09-19T15:32:18.590074+0000","last_peered":"2024-09-19T15:32:18.590074+0000","last_clean":"2024-09-19T15:32:18.590074+0000","last_became_active":"2024-09-19T13:40:44.274333+0000","last_became_peered":"2024-09-19T13:40:44.274333+0000","last_unstale":"2024-09-19T15:32:18.590074+0000","last_undegraded":"2024-09-19T15:32:18.590074+0000","last_fullsized":"2024-09-19T15:32:18.590074+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'144","last_scrub_stamp":"2024-09-19T15:32:18.589874+0000","last_deep_scrub":"268'144","last_deep_scrub_stamp":"2024-09-19T15:32:18.589874+0000","last_clean_scrub_stamp":"2024-09-19T15:32:18.589874+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:14.788018+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":236,"num_read_kb":218,"num_write":346,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'457","reported_seq":2048,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.718250+0000","last_change":"2024-09-19T15:31:53.718250+0000","last_active":"2024-09-19T15:31:53.718250+0000","last_peered":"2024-09-19T15:31:53.718250+0000","last_clean":"2024-09-19T15:31:53.718250+0000","last_became_active":"2024-09-19T13:40:36.241654+0000","last_became_peered":"2024-09-19T13:40:36.241654+0000","last_unstale":"2024-09-19T15:31:53.718250+0000","last_undegraded":"2024-09-19T15:31:53.718250+0000","last_fullsized":"2024-09-19T15:31:53.718250+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'457","last_scrub_stamp":"2024-09-19T15:31:53.718067+0000","last_deep_scrub":"268'457","last_deep_scrub_stamp":"2024-09-19T15:31:53.718067+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.718067+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:46.154892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2406,"num_read_kb":2267,"num_write":541,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'310","reported_seq":969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.607762+0000","last_change":"2024-09-19T15:31:47.607762+0000","last_active":"2024-09-19T15:31:47.607762+0000","last_peered":"2024-09-19T15:31:47.607762+0000","last_clean":"2024-09-19T15:31:47.607762+0000","last_became_active":"2024-09-19T13:40:34.248944+0000","last_became_peered":"2024-09-19T13:40:34.248944+0000","last_unstale":"2024-09-19T15:31:47.607762+0000","last_undegraded":"2024-09-19T15:31:47.607762+0000","last_fullsized":"2024-09-19T15:31:47.607762+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'310","last_scrub_stamp":"2024-09-19T15:31:47.607553+0000","last_deep_scrub":"268'310","last_deep_scrub_stamp":"2024-09-19T15:31:47.607553+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.607553+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:29.191774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":481,"num_read_kb":60023,"num_write":924,"num_write_kb":13648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":568,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.812139+0000","last_change":"2024-09-19T15:31:50.812139+0000","last_active":"2024-09-19T15:31:50.812139+0000","last_peered":"2024-09-19T15:31:50.812139+0000","last_clean":"2024-09-19T15:31:50.812139+0000","last_became_active":"2024-09-19T13:40:20.096321+0000","last_became_peered":"2024-09-19T13:40:20.096321+0000","last_unstale":"2024-09-19T15:31:50.812139+0000","last_undegraded":"2024-09-19T15:31:50.812139+0000","last_fullsized":"2024-09-19T15:31:50.812139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:50.811952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:50.811952+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.811952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:18:19.479967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001025329,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.917066+0000","last_change":"2024-09-19T15:31:59.917066+0000","last_active":"2024-09-19T15:31:59.917066+0000","last_peered":"2024-09-19T15:31:59.917066+0000","last_clean":"2024-09-19T15:31:59.917066+0000","last_became_active":"2024-09-19T13:40:38.229784+0000","last_became_peered":"2024-09-19T13:40:38.229784+0000","last_unstale":"2024-09-19T15:31:59.917066+0000","last_undegraded":"2024-09-19T15:31:59.917066+0000","last_fullsized":"2024-09-19T15:31:59.917066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:59.916882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:59.916882+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.916882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:52:47.622841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'347","reported_seq":991,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.645649+0000","last_change":"2024-09-19T15:32:04.645649+0000","last_active":"2024-09-19T15:32:04.645649+0000","last_peered":"2024-09-19T15:32:04.645649+0000","last_clean":"2024-09-19T15:32:04.645649+0000","last_became_active":"2024-09-19T13:40:40.239406+0000","last_became_peered":"2024-09-19T13:40:40.239406+0000","last_unstale":"2024-09-19T15:32:04.645649+0000","last_undegraded":"2024-09-19T15:32:04.645649+0000","last_fullsized":"2024-09-19T15:32:04.645649+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'347","last_scrub_stamp":"2024-09-19T15:32:04.645520+0000","last_deep_scrub":"268'347","last_deep_scrub_stamp":"2024-09-19T15:32:04.645520+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.645520+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:32:12.200401+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":438,"num_read_kb":429,"num_write":416,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6602,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'786","reported_seq":3370,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:17.648638+0000","last_change":"2024-09-19T15:32:17.648638+0000","last_active":"2024-09-19T15:32:17.648638+0000","last_peered":"2024-09-19T15:32:17.648638+0000","last_clean":"2024-09-19T15:32:17.648638+0000","last_became_active":"2024-09-19T13:40:42.244921+0000","last_became_peered":"2024-09-19T13:40:42.244921+0000","last_unstale":"2024-09-19T15:32:17.648638+0000","last_undegraded":"2024-09-19T15:32:17.648638+0000","last_fullsized":"2024-09-19T15:32:17.648638+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'786","last_scrub_stamp":"2024-09-19T15:32:17.648461+0000","last_deep_scrub":"268'786","last_deep_scrub_stamp":"2024-09-19T15:32:17.648461+0000","last_clean_scrub_stamp":"2024-09-19T15:32:17.648461+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:59.218164+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'144","reported_seq":712,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:25.112227+0000","last_change":"2024-09-19T15:32:25.112227+0000","last_active":"2024-09-19T15:32:25.112227+0000","last_peered":"2024-09-19T15:32:25.112227+0000","last_clean":"2024-09-19T15:32:25.112227+0000","last_became_active":"2024-09-19T13:40:44.277602+0000","last_became_peered":"2024-09-19T13:40:44.277602+0000","last_unstale":"2024-09-19T15:32:25.112227+0000","last_undegraded":"2024-09-19T15:32:25.112227+0000","last_fullsized":"2024-09-19T15:32:25.112227+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'144","last_scrub_stamp":"2024-09-19T15:32:25.112017+0000","last_deep_scrub":"268'144","last_deep_scrub_stamp":"2024-09-19T15:32:25.112017+0000","last_clean_scrub_stamp":"2024-09-19T15:32:25.112017+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:47.863568+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":303,"num_read_kb":269,"num_write":341,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'434","reported_seq":1942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.956165+0000","last_change":"2024-09-19T15:31:56.956165+0000","last_active":"2024-09-19T15:31:56.956165+0000","last_peered":"2024-09-19T15:31:56.956165+0000","last_clean":"2024-09-19T15:31:56.956165+0000","last_became_active":"2024-09-19T13:40:36.235186+0000","last_became_peered":"2024-09-19T13:40:36.235186+0000","last_unstale":"2024-09-19T15:31:56.956165+0000","last_undegraded":"2024-09-19T15:31:56.956165+0000","last_fullsized":"2024-09-19T15:31:56.956165+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'434","last_scrub_stamp":"2024-09-19T15:31:56.955979+0000","last_deep_scrub":"268'434","last_deep_scrub_stamp":"2024-09-19T15:31:56.955979+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.955979+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:06.924774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2268,"num_read_kb":2120,"num_write":492,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'422","reported_seq":1267,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:46.840046+0000","last_change":"2024-09-19T15:31:46.840046+0000","last_active":"2024-09-19T15:31:46.840046+0000","last_peered":"2024-09-19T15:31:46.840046+0000","last_clean":"2024-09-19T15:31:46.840046+0000","last_became_active":"2024-09-19T13:40:34.236325+0000","last_became_peered":"2024-09-19T13:40:34.236325+0000","last_unstale":"2024-09-19T15:31:46.840046+0000","last_undegraded":"2024-09-19T15:31:46.840046+0000","last_fullsized":"2024-09-19T15:31:46.840046+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'422","last_scrub_stamp":"2024-09-19T15:31:46.839904+0000","last_deep_scrub":"268'422","last_deep_scrub_stamp":"2024-09-19T15:31:46.839904+0000","last_clean_scrub_stamp":"2024-09-19T15:31:46.839904+0000","objects_scrubbed":8,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:07.793346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":865,"num_read_kb":111541,"num_write":1317,"num_write_kb":62709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":557,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:45.587206+0000","last_change":"2024-09-19T15:31:45.587206+0000","last_active":"2024-09-19T15:31:45.587206+0000","last_peered":"2024-09-19T15:31:45.587206+0000","last_clean":"2024-09-19T15:31:45.587206+0000","last_became_active":"2024-09-19T13:40:20.101186+0000","last_became_peered":"2024-09-19T13:40:20.101186+0000","last_unstale":"2024-09-19T15:31:45.587206+0000","last_undegraded":"2024-09-19T15:31:45.587206+0000","last_fullsized":"2024-09-19T15:31:45.587206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:45.587128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:45.587128+0000","last_clean_scrub_stamp":"2024-09-19T15:31:45.587128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:24.645925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010323750000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.533455+0000","last_change":"2024-09-19T15:32:07.533455+0000","last_active":"2024-09-19T15:32:07.533455+0000","last_peered":"2024-09-19T15:32:07.533455+0000","last_clean":"2024-09-19T15:32:07.533455+0000","last_became_active":"2024-09-19T13:40:38.235109+0000","last_became_peered":"2024-09-19T13:40:38.235109+0000","last_unstale":"2024-09-19T15:32:07.533455+0000","last_undegraded":"2024-09-19T15:32:07.533455+0000","last_fullsized":"2024-09-19T15:32:07.533455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:07.533271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:07.533271+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.533271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:11:41.966852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'198","reported_seq":806,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:11.587452+0000","last_change":"2024-09-19T15:32:11.587452+0000","last_active":"2024-09-19T15:32:11.587452+0000","last_peered":"2024-09-19T15:32:11.587452+0000","last_clean":"2024-09-19T15:32:11.587452+0000","last_became_active":"2024-09-19T13:40:40.244484+0000","last_became_peered":"2024-09-19T13:40:40.244484+0000","last_unstale":"2024-09-19T15:32:11.587452+0000","last_undegraded":"2024-09-19T15:32:11.587452+0000","last_fullsized":"2024-09-19T15:32:11.587452+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'198","last_scrub_stamp":"2024-09-19T15:32:11.587262+0000","last_deep_scrub":"268'198","last_deep_scrub_stamp":"2024-09-19T15:32:11.587262+0000","last_clean_scrub_stamp":"2024-09-19T15:32:11.587262+0000","objects_scrubbed":5,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:58.251932+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":238,"num_read_kb":228,"num_write":166,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'790","reported_seq":5121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:19.198016+0000","last_change":"2024-09-19T15:32:19.198016+0000","last_active":"2024-09-19T15:32:19.198016+0000","last_peered":"2024-09-19T15:32:19.198016+0000","last_clean":"2024-09-19T15:32:19.198016+0000","last_became_active":"2024-09-19T13:40:42.257799+0000","last_became_peered":"2024-09-19T13:40:42.257799+0000","last_unstale":"2024-09-19T15:32:19.198016+0000","last_undegraded":"2024-09-19T15:32:19.198016+0000","last_fullsized":"2024-09-19T15:32:19.198016+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'790","last_scrub_stamp":"2024-09-19T15:32:19.197825+0000","last_deep_scrub":"268'790","last_deep_scrub_stamp":"2024-09-19T15:32:19.197825+0000","last_clean_scrub_stamp":"2024-09-19T15:32:19.197825+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:30:42.393600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'193","reported_seq":734,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:19.618188+0000","last_change":"2024-09-19T15:32:19.618188+0000","last_active":"2024-09-19T15:32:19.618188+0000","last_peered":"2024-09-19T15:32:19.618188+0000","last_clean":"2024-09-19T15:32:19.618188+0000","last_became_active":"2024-09-19T13:40:44.259077+0000","last_became_peered":"2024-09-19T13:40:44.259077+0000","last_unstale":"2024-09-19T15:32:19.618188+0000","last_undegraded":"2024-09-19T15:32:19.618188+0000","last_fullsized":"2024-09-19T15:32:19.618188+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'193","last_scrub_stamp":"2024-09-19T15:32:19.618021+0000","last_deep_scrub":"268'193","last_deep_scrub_stamp":"2024-09-19T15:32:19.618021+0000","last_clean_scrub_stamp":"2024-09-19T15:32:19.618021+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:33:46.257575+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":211,"num_read_kb":198,"num_write":423,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'430","reported_seq":1964,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.463133+0000","last_change":"2024-09-19T15:31:51.463133+0000","last_active":"2024-09-19T15:31:51.463133+0000","last_peered":"2024-09-19T15:31:51.463133+0000","last_clean":"2024-09-19T15:31:51.463133+0000","last_became_active":"2024-09-19T13:40:36.242739+0000","last_became_peered":"2024-09-19T13:40:36.242739+0000","last_unstale":"2024-09-19T15:31:51.463133+0000","last_undegraded":"2024-09-19T15:31:51.463133+0000","last_fullsized":"2024-09-19T15:31:51.463133+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'430","last_scrub_stamp":"2024-09-19T15:31:51.462915+0000","last_deep_scrub":"268'430","last_deep_scrub_stamp":"2024-09-19T15:31:51.462915+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.462915+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:56:09.165916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2240,"num_read_kb":2109,"num_write":493,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'308","reported_seq":968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.911724+0000","last_change":"2024-09-19T15:31:47.911724+0000","last_active":"2024-09-19T15:31:47.911724+0000","last_peered":"2024-09-19T15:31:47.911724+0000","last_clean":"2024-09-19T15:31:47.911724+0000","last_became_active":"2024-09-19T13:41:05.316287+0000","last_became_peered":"2024-09-19T13:41:05.316287+0000","last_unstale":"2024-09-19T15:31:47.911724+0000","last_undegraded":"2024-09-19T15:31:47.911724+0000","last_fullsized":"2024-09-19T15:31:47.911724+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'308","last_scrub_stamp":"2024-09-19T15:31:47.911606+0000","last_deep_scrub":"268'308","last_deep_scrub_stamp":"2024-09-19T15:31:47.911606+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.911606+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:23.680919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":643,"num_read_kb":12872,"num_write":1020,"num_write_kb":31603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":554,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.930367+0000","last_change":"2024-09-19T15:31:47.930367+0000","last_active":"2024-09-19T15:31:47.930367+0000","last_peered":"2024-09-19T15:31:47.930367+0000","last_clean":"2024-09-19T15:31:47.930367+0000","last_became_active":"2024-09-19T13:40:20.103134+0000","last_became_peered":"2024-09-19T13:40:20.103134+0000","last_unstale":"2024-09-19T15:31:47.930367+0000","last_undegraded":"2024-09-19T15:31:47.930367+0000","last_fullsized":"2024-09-19T15:31:47.930367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:47.930194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:47.930194+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.930194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:21.433702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093870599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.020103+0000","last_change":"2024-09-19T15:32:07.020103+0000","last_active":"2024-09-19T15:32:07.020103+0000","last_peered":"2024-09-19T15:32:07.020103+0000","last_clean":"2024-09-19T15:32:07.020103+0000","last_became_active":"2024-09-19T13:40:38.221430+0000","last_became_peered":"2024-09-19T13:40:38.221430+0000","last_unstale":"2024-09-19T15:32:07.020103+0000","last_undegraded":"2024-09-19T15:32:07.020103+0000","last_fullsized":"2024-09-19T15:32:07.020103+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:07.019913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:07.019913+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.019913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:54:53.009598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'848","reported_seq":1648,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:09.663377+0000","last_change":"2024-09-19T15:32:09.663377+0000","last_active":"2024-09-19T15:32:09.663377+0000","last_peered":"2024-09-19T15:32:09.663377+0000","last_clean":"2024-09-19T15:32:09.663377+0000","last_became_active":"2024-09-19T13:40:40.229426+0000","last_became_peered":"2024-09-19T13:40:40.229426+0000","last_unstale":"2024-09-19T15:32:09.663377+0000","last_undegraded":"2024-09-19T15:32:09.663377+0000","last_fullsized":"2024-09-19T15:32:09.663377+0000","mapping_epoch":31,"log_start":"268'800","ondisk_log_start":"268'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'848","last_scrub_stamp":"2024-09-19T15:32:09.663116+0000","last_deep_scrub":"268'848","last_deep_scrub_stamp":"2024-09-19T15:32:09.663116+0000","last_clean_scrub_stamp":"2024-09-19T15:32:09.663116+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":800,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:43.808766+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140545,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1480,"num_read_kb":3413,"num_write":1200,"num_write_kb":946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:18.172465+0000","last_change":"2024-09-19T15:32:18.172465+0000","last_active":"2024-09-19T15:32:18.172465+0000","last_peered":"2024-09-19T15:32:18.172465+0000","last_clean":"2024-09-19T15:32:18.172465+0000","last_became_active":"2024-09-19T13:40:42.244291+0000","last_became_peered":"2024-09-19T13:40:42.244291+0000","last_unstale":"2024-09-19T15:32:18.172465+0000","last_undegraded":"2024-09-19T15:32:18.172465+0000","last_fullsized":"2024-09-19T15:32:18.172465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:18.172280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:18.172280+0000","last_clean_scrub_stamp":"2024-09-19T15:32:18.172280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:46.823936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'154","reported_seq":719,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:21.645279+0000","last_change":"2024-09-19T15:32:21.645279+0000","last_active":"2024-09-19T15:32:21.645279+0000","last_peered":"2024-09-19T15:32:21.645279+0000","last_clean":"2024-09-19T15:32:21.645279+0000","last_became_active":"2024-09-19T13:40:44.273409+0000","last_became_peered":"2024-09-19T13:40:44.273409+0000","last_unstale":"2024-09-19T15:32:21.645279+0000","last_undegraded":"2024-09-19T15:32:21.645279+0000","last_fullsized":"2024-09-19T15:32:21.645279+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'154","last_scrub_stamp":"2024-09-19T15:32:21.645095+0000","last_deep_scrub":"268'154","last_deep_scrub_stamp":"2024-09-19T15:32:21.645095+0000","last_clean_scrub_stamp":"2024-09-19T15:32:21.645095+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:13:10.870852+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":293,"num_read_kb":268,"num_write":395,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'159","reported_seq":751,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:21.624736+0000","last_change":"2024-09-19T15:32:21.624736+0000","last_active":"2024-09-19T15:32:21.624736+0000","last_peered":"2024-09-19T15:32:21.624736+0000","last_clean":"2024-09-19T15:32:21.624736+0000","last_became_active":"2024-09-19T13:40:44.263575+0000","last_became_peered":"2024-09-19T13:40:44.263575+0000","last_unstale":"2024-09-19T15:32:21.624736+0000","last_undegraded":"2024-09-19T15:32:21.624736+0000","last_fullsized":"2024-09-19T15:32:21.624736+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'159","last_scrub_stamp":"2024-09-19T15:32:21.624559+0000","last_deep_scrub":"268'159","last_deep_scrub_stamp":"2024-09-19T15:32:21.624559+0000","last_clean_scrub_stamp":"2024-09-19T15:32:21.624559+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:42.336374+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":274,"num_read_kb":267,"num_write":381,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'492","reported_seq":2283,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.506648+0000","last_change":"2024-09-19T15:31:56.506648+0000","last_active":"2024-09-19T15:31:56.506648+0000","last_peered":"2024-09-19T15:31:56.506648+0000","last_clean":"2024-09-19T15:31:56.506648+0000","last_became_active":"2024-09-19T13:40:36.221019+0000","last_became_peered":"2024-09-19T13:40:36.221019+0000","last_unstale":"2024-09-19T15:31:56.506648+0000","last_undegraded":"2024-09-19T15:31:56.506648+0000","last_fullsized":"2024-09-19T15:31:56.506648+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'492","last_scrub_stamp":"2024-09-19T15:31:56.506455+0000","last_deep_scrub":"268'492","last_deep_scrub_stamp":"2024-09-19T15:31:56.506455+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.506455+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:19.156962+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2720,"num_read_kb":2588,"num_write":552,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'395","reported_seq":1071,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:46.557289+0000","last_change":"2024-09-19T15:31:46.557289+0000","last_active":"2024-09-19T15:31:46.557289+0000","last_peered":"2024-09-19T15:31:46.557289+0000","last_clean":"2024-09-19T15:31:46.557289+0000","last_became_active":"2024-09-19T13:40:34.263276+0000","last_became_peered":"2024-09-19T13:40:34.263276+0000","last_unstale":"2024-09-19T15:31:46.557289+0000","last_undegraded":"2024-09-19T15:31:46.557289+0000","last_fullsized":"2024-09-19T15:31:46.557289+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'395","last_scrub_stamp":"2024-09-19T15:31:46.557001+0000","last_deep_scrub":"268'395","last_deep_scrub_stamp":"2024-09-19T15:31:46.557001+0000","last_clean_scrub_stamp":"2024-09-19T15:31:46.557001+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:39:37.507208+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":686,"num_read_kb":11371,"num_write":1228,"num_write_kb":39217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"268'6","reported_seq":1005,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.615454+0000","last_change":"2024-09-19T15:32:02.615454+0000","last_active":"2024-09-19T15:32:02.615454+0000","last_peered":"2024-09-19T15:32:02.615454+0000","last_clean":"2024-09-19T15:32:02.615454+0000","last_became_active":"2024-09-19T13:40:38.215364+0000","last_became_peered":"2024-09-19T13:40:38.215364+0000","last_unstale":"2024-09-19T15:32:02.615454+0000","last_undegraded":"2024-09-19T15:32:02.615454+0000","last_fullsized":"2024-09-19T15:32:02.615454+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-19T15:32:02.615245+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-19T15:32:02.615245+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.615245+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:36.144028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":1184,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'365","reported_seq":1007,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:14.155620+0000","last_change":"2024-09-19T15:32:14.155620+0000","last_active":"2024-09-19T15:32:14.155620+0000","last_peered":"2024-09-19T15:32:14.155620+0000","last_clean":"2024-09-19T15:32:14.155620+0000","last_became_active":"2024-09-19T13:40:40.229872+0000","last_became_peered":"2024-09-19T13:40:40.229872+0000","last_unstale":"2024-09-19T15:32:14.155620+0000","last_undegraded":"2024-09-19T15:32:14.155620+0000","last_fullsized":"2024-09-19T15:32:14.155620+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'365","last_scrub_stamp":"2024-09-19T15:32:14.155416+0000","last_deep_scrub":"268'365","last_deep_scrub_stamp":"2024-09-19T15:32:14.155416+0000","last_clean_scrub_stamp":"2024-09-19T15:32:14.155416+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:05.890368+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":585,"num_read_kb":1412,"num_write":468,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:22.168016+0000","last_change":"2024-09-19T15:32:22.168016+0000","last_active":"2024-09-19T15:32:22.168016+0000","last_peered":"2024-09-19T15:32:22.168016+0000","last_clean":"2024-09-19T15:32:22.168016+0000","last_became_active":"2024-09-19T13:40:42.242368+0000","last_became_peered":"2024-09-19T13:40:42.242368+0000","last_unstale":"2024-09-19T15:32:22.168016+0000","last_undegraded":"2024-09-19T15:32:22.168016+0000","last_fullsized":"2024-09-19T15:32:22.168016+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:22.167830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:22.167830+0000","last_clean_scrub_stamp":"2024-09-19T15:32:22.167830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:51.867912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'121","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:29:46.522969+0000","last_change":"2024-09-19T13:40:44.269881+0000","last_active":"2024-09-19T15:29:46.522969+0000","last_peered":"2024-09-19T15:29:46.522969+0000","last_clean":"2024-09-19T15:29:46.522969+0000","last_became_active":"2024-09-19T13:40:44.268946+0000","last_became_peered":"2024-09-19T13:40:44.268946+0000","last_unstale":"2024-09-19T15:29:46.522969+0000","last_undegraded":"2024-09-19T15:29:46.522969+0000","last_fullsized":"2024-09-19T15:29:46.522969+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T13:40:43.210858+0000","last_clean_scrub_stamp":"2024-09-19T13:40:43.210858+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:40.184840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":128,"num_write":265,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'469","reported_seq":2041,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.567600+0000","last_change":"2024-09-19T15:31:57.567600+0000","last_active":"2024-09-19T15:31:57.567600+0000","last_peered":"2024-09-19T15:31:57.567600+0000","last_clean":"2024-09-19T15:31:57.567600+0000","last_became_active":"2024-09-19T13:40:36.226164+0000","last_became_peered":"2024-09-19T13:40:36.226164+0000","last_unstale":"2024-09-19T15:31:57.567600+0000","last_undegraded":"2024-09-19T15:31:57.567600+0000","last_fullsized":"2024-09-19T15:31:57.567600+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'469","last_scrub_stamp":"2024-09-19T15:31:57.567370+0000","last_deep_scrub":"268'469","last_deep_scrub_stamp":"2024-09-19T15:31:57.567370+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.567370+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:50.223505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2492,"num_read_kb":2321,"num_write":561,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'308","reported_seq":1061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.734220+0000","last_change":"2024-09-19T15:31:54.734220+0000","last_active":"2024-09-19T15:31:54.734220+0000","last_peered":"2024-09-19T15:31:54.734220+0000","last_clean":"2024-09-19T15:31:54.734220+0000","last_became_active":"2024-09-19T13:41:05.387779+0000","last_became_peered":"2024-09-19T13:41:05.387779+0000","last_unstale":"2024-09-19T15:31:54.734220+0000","last_undegraded":"2024-09-19T15:31:54.734220+0000","last_fullsized":"2024-09-19T15:31:54.734220+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'308","last_scrub_stamp":"2024-09-19T15:31:54.734020+0000","last_deep_scrub":"268'308","last_deep_scrub_stamp":"2024-09-19T15:31:54.734020+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.734020+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:08.138762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":891,"num_read_kb":29706,"num_write":1011,"num_write_kb":41961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.051796+0000","last_change":"2024-09-19T15:32:08.051796+0000","last_active":"2024-09-19T15:32:08.051796+0000","last_peered":"2024-09-19T15:32:08.051796+0000","last_clean":"2024-09-19T15:32:08.051796+0000","last_became_active":"2024-09-19T13:40:38.228856+0000","last_became_peered":"2024-09-19T13:40:38.228856+0000","last_unstale":"2024-09-19T15:32:08.051796+0000","last_undegraded":"2024-09-19T15:32:08.051796+0000","last_fullsized":"2024-09-19T15:32:08.051796+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:08.051584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:08.051584+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.051584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:44.498532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'88","reported_seq":635,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.666857+0000","last_change":"2024-09-19T15:32:08.666857+0000","last_active":"2024-09-19T15:32:08.666857+0000","last_peered":"2024-09-19T15:32:08.666857+0000","last_clean":"2024-09-19T15:32:08.666857+0000","last_became_active":"2024-09-19T13:40:40.235528+0000","last_became_peered":"2024-09-19T13:40:40.235528+0000","last_unstale":"2024-09-19T15:32:08.666857+0000","last_undegraded":"2024-09-19T15:32:08.666857+0000","last_fullsized":"2024-09-19T15:32:08.666857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'88","last_scrub_stamp":"2024-09-19T15:32:08.666742+0000","last_deep_scrub":"268'88","last_deep_scrub_stamp":"2024-09-19T15:32:08.666742+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.666742+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:31.018966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":75,"num_write":58,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:16.633560+0000","last_change":"2024-09-19T15:32:16.633560+0000","last_active":"2024-09-19T15:32:16.633560+0000","last_peered":"2024-09-19T15:32:16.633560+0000","last_clean":"2024-09-19T15:32:16.633560+0000","last_became_active":"2024-09-19T13:40:42.243224+0000","last_became_peered":"2024-09-19T13:40:42.243224+0000","last_unstale":"2024-09-19T15:32:16.633560+0000","last_undegraded":"2024-09-19T15:32:16.633560+0000","last_fullsized":"2024-09-19T15:32:16.633560+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:16.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:16.633480+0000","last_clean_scrub_stamp":"2024-09-19T15:32:16.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:16:17.039545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'211","reported_seq":765,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:22.591547+0000","last_change":"2024-09-19T15:32:22.591547+0000","last_active":"2024-09-19T15:32:22.591547+0000","last_peered":"2024-09-19T15:32:22.591547+0000","last_clean":"2024-09-19T15:32:22.591547+0000","last_became_active":"2024-09-19T13:40:44.258721+0000","last_became_peered":"2024-09-19T13:40:44.258721+0000","last_unstale":"2024-09-19T15:32:22.591547+0000","last_undegraded":"2024-09-19T15:32:22.591547+0000","last_fullsized":"2024-09-19T15:32:22.591547+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'211","last_scrub_stamp":"2024-09-19T15:32:22.591333+0000","last_deep_scrub":"268'211","last_deep_scrub_stamp":"2024-09-19T15:32:22.591333+0000","last_clean_scrub_stamp":"2024-09-19T15:32:22.591333+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":100,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:21.010735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":369,"num_read_kb":358,"num_write":477,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'371","reported_seq":1900,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.999581+0000","last_change":"2024-09-19T15:31:58.999581+0000","last_active":"2024-09-19T15:31:58.999581+0000","last_peered":"2024-09-19T15:31:58.999581+0000","last_clean":"2024-09-19T15:31:58.999581+0000","last_became_active":"2024-09-19T13:40:36.239629+0000","last_became_peered":"2024-09-19T13:40:36.239629+0000","last_unstale":"2024-09-19T15:31:58.999581+0000","last_undegraded":"2024-09-19T15:31:58.999581+0000","last_fullsized":"2024-09-19T15:31:58.999581+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'371","last_scrub_stamp":"2024-09-19T15:31:58.999403+0000","last_deep_scrub":"268'371","last_deep_scrub_stamp":"2024-09-19T15:31:58.999403+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.999403+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:05:57.130902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2075,"num_read_kb":1985,"num_write":419,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'332","reported_seq":1015,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.805753+0000","last_change":"2024-09-19T15:31:51.805753+0000","last_active":"2024-09-19T15:31:51.805753+0000","last_peered":"2024-09-19T15:31:51.805753+0000","last_clean":"2024-09-19T15:31:51.805753+0000","last_became_active":"2024-09-19T13:40:34.256236+0000","last_became_peered":"2024-09-19T13:40:34.256236+0000","last_unstale":"2024-09-19T15:31:51.805753+0000","last_undegraded":"2024-09-19T15:31:51.805753+0000","last_fullsized":"2024-09-19T15:31:51.805753+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'332","last_scrub_stamp":"2024-09-19T15:31:51.805479+0000","last_deep_scrub":"268'332","last_deep_scrub_stamp":"2024-09-19T15:31:51.805479+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.805479+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:20:24.903372+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136863,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":566,"num_read_kb":16816,"num_write":988,"num_write_kb":29952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.715494+0000","last_change":"2024-09-19T15:32:06.715494+0000","last_active":"2024-09-19T15:32:06.715494+0000","last_peered":"2024-09-19T15:32:06.715494+0000","last_clean":"2024-09-19T15:32:06.715494+0000","last_became_active":"2024-09-19T13:40:38.249269+0000","last_became_peered":"2024-09-19T13:40:38.249269+0000","last_unstale":"2024-09-19T15:32:06.715494+0000","last_undegraded":"2024-09-19T15:32:06.715494+0000","last_fullsized":"2024-09-19T15:32:06.715494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:06.715201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:06.715201+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.715201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:37.301841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'362","reported_seq":1019,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:15.151597+0000","last_change":"2024-09-19T15:32:15.151597+0000","last_active":"2024-09-19T15:32:15.151597+0000","last_peered":"2024-09-19T15:32:15.151597+0000","last_clean":"2024-09-19T15:32:15.151597+0000","last_became_active":"2024-09-19T13:40:40.229852+0000","last_became_peered":"2024-09-19T13:40:40.229852+0000","last_unstale":"2024-09-19T15:32:15.151597+0000","last_undegraded":"2024-09-19T15:32:15.151597+0000","last_fullsized":"2024-09-19T15:32:15.151597+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'362","last_scrub_stamp":"2024-09-19T15:32:15.151403+0000","last_deep_scrub":"268'362","last_deep_scrub_stamp":"2024-09-19T15:32:15.151403+0000","last_clean_scrub_stamp":"2024-09-19T15:32:15.151403+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:56:58.413638+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47808,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":586,"num_read_kb":1181,"num_write":454,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.977985+0000","last_change":"2024-09-19T15:32:05.977985+0000","last_active":"2024-09-19T15:32:05.977985+0000","last_peered":"2024-09-19T15:32:05.977985+0000","last_clean":"2024-09-19T15:32:05.977985+0000","last_became_active":"2024-09-19T13:40:42.240135+0000","last_became_peered":"2024-09-19T13:40:42.240135+0000","last_unstale":"2024-09-19T15:32:05.977985+0000","last_undegraded":"2024-09-19T15:32:05.977985+0000","last_fullsized":"2024-09-19T15:32:05.977985+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:05.977797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:05.977797+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.977797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:47:40.751125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'86","reported_seq":644,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:24.602402+0000","last_change":"2024-09-19T15:32:24.602402+0000","last_active":"2024-09-19T15:32:24.602402+0000","last_peered":"2024-09-19T15:32:24.602402+0000","last_clean":"2024-09-19T15:32:24.602402+0000","last_became_active":"2024-09-19T13:40:44.269134+0000","last_became_peered":"2024-09-19T13:40:44.269134+0000","last_unstale":"2024-09-19T15:32:24.602402+0000","last_undegraded":"2024-09-19T15:32:24.602402+0000","last_fullsized":"2024-09-19T15:32:24.602402+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'86","last_scrub_stamp":"2024-09-19T15:32:24.602220+0000","last_deep_scrub":"268'86","last_deep_scrub_stamp":"2024-09-19T15:32:24.602220+0000","last_clean_scrub_stamp":"2024-09-19T15:32:24.602220+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:23:47.926200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":160,"num_write":196,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'611","reported_seq":2435,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.975666+0000","last_change":"2024-09-19T15:31:57.975666+0000","last_active":"2024-09-19T15:31:57.975666+0000","last_peered":"2024-09-19T15:31:57.975666+0000","last_clean":"2024-09-19T15:31:57.975666+0000","last_became_active":"2024-09-19T13:40:36.217925+0000","last_became_peered":"2024-09-19T13:40:36.217925+0000","last_unstale":"2024-09-19T15:31:57.975666+0000","last_undegraded":"2024-09-19T15:31:57.975666+0000","last_fullsized":"2024-09-19T15:31:57.975666+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'611","last_scrub_stamp":"2024-09-19T15:31:57.975494+0000","last_deep_scrub":"268'611","last_deep_scrub_stamp":"2024-09-19T15:31:57.975494+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.975494+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":600,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:29.200346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3256,"num_read_kb":3011,"num_write":769,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'364","reported_seq":1028,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:46.648604+0000","last_change":"2024-09-19T15:31:46.648440+0000","last_active":"2024-09-19T15:31:46.648604+0000","last_peered":"2024-09-19T15:31:46.648604+0000","last_clean":"2024-09-19T15:31:46.648604+0000","last_became_active":"2024-09-19T13:40:34.227791+0000","last_became_peered":"2024-09-19T13:40:34.227791+0000","last_unstale":"2024-09-19T15:31:46.648604+0000","last_undegraded":"2024-09-19T15:31:46.648604+0000","last_fullsized":"2024-09-19T15:31:46.648604+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'364","last_scrub_stamp":"2024-09-19T15:31:46.648241+0000","last_deep_scrub":"268'364","last_deep_scrub_stamp":"2024-09-19T15:31:46.648241+0000","last_clean_scrub_stamp":"2024-09-19T15:31:46.648241+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:28:35.850047+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":536,"num_read_kb":35857,"num_write":1057,"num_write_kb":31805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.930353+0000","last_change":"2024-09-19T15:32:00.930353+0000","last_active":"2024-09-19T15:32:00.930353+0000","last_peered":"2024-09-19T15:32:00.930353+0000","last_clean":"2024-09-19T15:32:00.930353+0000","last_became_active":"2024-09-19T13:40:38.246129+0000","last_became_peered":"2024-09-19T13:40:38.246129+0000","last_unstale":"2024-09-19T15:32:00.930353+0000","last_undegraded":"2024-09-19T15:32:00.930353+0000","last_fullsized":"2024-09-19T15:32:00.930353+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:00.930173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:00.930173+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.930173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:14:00.787540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'319","reported_seq":949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:12.666334+0000","last_change":"2024-09-19T15:32:12.666334+0000","last_active":"2024-09-19T15:32:12.666334+0000","last_peered":"2024-09-19T15:32:12.666334+0000","last_clean":"2024-09-19T15:32:12.666334+0000","last_became_active":"2024-09-19T13:40:40.218434+0000","last_became_peered":"2024-09-19T13:40:40.218434+0000","last_unstale":"2024-09-19T15:32:12.666334+0000","last_undegraded":"2024-09-19T15:32:12.666334+0000","last_fullsized":"2024-09-19T15:32:12.666334+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'319","last_scrub_stamp":"2024-09-19T15:32:12.666134+0000","last_deep_scrub":"268'319","last_deep_scrub_stamp":"2024-09-19T15:32:12.666134+0000","last_clean_scrub_stamp":"2024-09-19T15:32:12.666134+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:09:43.541168+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44825,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":1129,"num_write":414,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:14.567886+0000","last_change":"2024-09-19T15:32:14.567886+0000","last_active":"2024-09-19T15:32:14.567886+0000","last_peered":"2024-09-19T15:32:14.567886+0000","last_clean":"2024-09-19T15:32:14.567886+0000","last_became_active":"2024-09-19T13:40:42.238908+0000","last_became_peered":"2024-09-19T13:40:42.238908+0000","last_unstale":"2024-09-19T15:32:14.567886+0000","last_undegraded":"2024-09-19T15:32:14.567886+0000","last_fullsized":"2024-09-19T15:32:14.567886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:14.567692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:14.567692+0000","last_clean_scrub_stamp":"2024-09-19T15:32:14.567692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:33.260592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'524","reported_seq":2148,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.913104+0000","last_change":"2024-09-19T15:31:56.913104+0000","last_active":"2024-09-19T15:31:56.913104+0000","last_peered":"2024-09-19T15:31:56.913104+0000","last_clean":"2024-09-19T15:31:56.913104+0000","last_became_active":"2024-09-19T13:40:36.243653+0000","last_became_peered":"2024-09-19T13:40:36.243653+0000","last_unstale":"2024-09-19T15:31:56.913104+0000","last_undegraded":"2024-09-19T15:31:56.913104+0000","last_fullsized":"2024-09-19T15:31:56.913104+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'524","last_scrub_stamp":"2024-09-19T15:31:56.912913+0000","last_deep_scrub":"268'524","last_deep_scrub_stamp":"2024-09-19T15:31:56.912913+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.912913+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:58.666306+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2759,"num_read_kb":2556,"num_write":676,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'358","reported_seq":1009,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.920601+0000","last_change":"2024-09-19T15:31:52.920601+0000","last_active":"2024-09-19T15:31:52.920601+0000","last_peered":"2024-09-19T15:31:52.920601+0000","last_clean":"2024-09-19T15:31:52.920601+0000","last_became_active":"2024-09-19T13:40:34.219131+0000","last_became_peered":"2024-09-19T13:40:34.219131+0000","last_unstale":"2024-09-19T15:31:52.920601+0000","last_undegraded":"2024-09-19T15:31:52.920601+0000","last_fullsized":"2024-09-19T15:31:52.920601+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'358","last_scrub_stamp":"2024-09-19T15:31:52.920370+0000","last_deep_scrub":"268'358","last_deep_scrub_stamp":"2024-09-19T15:31:52.920370+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.920370+0000","objects_scrubbed":6,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:04.736453+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273703,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":16977,"num_write":1175,"num_write_kb":67471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.685857+0000","last_change":"2024-09-19T15:32:04.685857+0000","last_active":"2024-09-19T15:32:04.685857+0000","last_peered":"2024-09-19T15:32:04.685857+0000","last_clean":"2024-09-19T15:32:04.685857+0000","last_became_active":"2024-09-19T13:40:38.231992+0000","last_became_peered":"2024-09-19T13:40:38.231992+0000","last_unstale":"2024-09-19T15:32:04.685857+0000","last_undegraded":"2024-09-19T15:32:04.685857+0000","last_fullsized":"2024-09-19T15:32:04.685857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:04.685669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:04.685669+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.685669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:07:07.380312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'568","reported_seq":1247,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.642848+0000","last_change":"2024-09-19T15:32:06.642848+0000","last_active":"2024-09-19T15:32:06.642848+0000","last_peered":"2024-09-19T15:32:06.642848+0000","last_clean":"2024-09-19T15:32:06.642848+0000","last_became_active":"2024-09-19T13:40:40.241045+0000","last_became_peered":"2024-09-19T13:40:40.241045+0000","last_unstale":"2024-09-19T15:32:06.642848+0000","last_undegraded":"2024-09-19T15:32:06.642848+0000","last_fullsized":"2024-09-19T15:32:06.642848+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'568","last_scrub_stamp":"2024-09-19T15:32:06.642662+0000","last_deep_scrub":"268'568","last_deep_scrub_stamp":"2024-09-19T15:32:06.642662+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.642662+0000","objects_scrubbed":7,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:33.019641+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102495,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":998,"num_read_kb":2312,"num_write":864,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:18.654557+0000","last_change":"2024-09-19T15:32:18.654557+0000","last_active":"2024-09-19T15:32:18.654557+0000","last_peered":"2024-09-19T15:32:18.654557+0000","last_clean":"2024-09-19T15:32:18.654557+0000","last_became_active":"2024-09-19T13:40:42.266161+0000","last_became_peered":"2024-09-19T13:40:42.266161+0000","last_unstale":"2024-09-19T15:32:18.654557+0000","last_undegraded":"2024-09-19T15:32:18.654557+0000","last_fullsized":"2024-09-19T15:32:18.654557+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:18.654355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:18.654355+0000","last_clean_scrub_stamp":"2024-09-19T15:32:18.654355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:49:19.531268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'155","reported_seq":694,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:27.116171+0000","last_change":"2024-09-19T15:32:27.116171+0000","last_active":"2024-09-19T15:32:27.116171+0000","last_peered":"2024-09-19T15:32:27.116171+0000","last_clean":"2024-09-19T15:32:27.116171+0000","last_became_active":"2024-09-19T13:40:44.280362+0000","last_became_peered":"2024-09-19T13:40:44.280362+0000","last_unstale":"2024-09-19T15:32:27.116171+0000","last_undegraded":"2024-09-19T15:32:27.116171+0000","last_fullsized":"2024-09-19T15:32:27.116171+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'155","last_scrub_stamp":"2024-09-19T15:32:27.115991+0000","last_deep_scrub":"268'155","last_deep_scrub_stamp":"2024-09-19T15:32:27.115991+0000","last_clean_scrub_stamp":"2024-09-19T15:32:27.115991+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:42:49.154644+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":216,"num_read_kb":226,"num_write":329,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'909","reported_seq":2615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.735293+0000","last_change":"2024-09-19T15:31:57.735293+0000","last_active":"2024-09-19T15:31:57.735293+0000","last_peered":"2024-09-19T15:31:57.735293+0000","last_clean":"2024-09-19T15:31:57.735293+0000","last_became_active":"2024-09-19T13:40:36.234428+0000","last_became_peered":"2024-09-19T13:40:36.234428+0000","last_unstale":"2024-09-19T15:31:57.735293+0000","last_undegraded":"2024-09-19T15:31:57.735293+0000","last_fullsized":"2024-09-19T15:31:57.735293+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'909","last_scrub_stamp":"2024-09-19T15:31:57.735111+0000","last_deep_scrub":"268'909","last_deep_scrub_stamp":"2024-09-19T15:31:57.735111+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.735111+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":800,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:43:16.615480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4426,"num_read_kb":3975,"num_write":1248,"num_write_kb":508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'387","reported_seq":1106,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.658635+0000","last_change":"2024-09-19T15:31:49.658391+0000","last_active":"2024-09-19T15:31:49.658635+0000","last_peered":"2024-09-19T15:31:49.658635+0000","last_clean":"2024-09-19T15:31:49.658635+0000","last_became_active":"2024-09-19T13:40:34.249719+0000","last_became_peered":"2024-09-19T13:40:34.249719+0000","last_unstale":"2024-09-19T15:31:49.658635+0000","last_undegraded":"2024-09-19T15:31:49.658635+0000","last_fullsized":"2024-09-19T15:31:49.658635+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'387","last_scrub_stamp":"2024-09-19T15:31:49.658119+0000","last_deep_scrub":"268'387","last_deep_scrub_stamp":"2024-09-19T15:31:49.658119+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.658119+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:45.295555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2165812,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":691,"num_read_kb":108324,"num_write":1302,"num_write_kb":34137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"268'4","reported_seq":1009,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.964764+0000","last_change":"2024-09-19T15:32:01.964764+0000","last_active":"2024-09-19T15:32:01.964764+0000","last_peered":"2024-09-19T15:32:01.964764+0000","last_clean":"2024-09-19T15:32:01.964764+0000","last_became_active":"2024-09-19T13:40:38.245835+0000","last_became_peered":"2024-09-19T13:40:38.245835+0000","last_unstale":"2024-09-19T15:32:01.964764+0000","last_undegraded":"2024-09-19T15:32:01.964764+0000","last_fullsized":"2024-09-19T15:32:01.964764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-19T15:32:01.964584+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-19T15:32:01.964584+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.964584+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:59:35.197432+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":719,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'395","reported_seq":1058,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:13.694480+0000","last_change":"2024-09-19T15:32:13.694480+0000","last_active":"2024-09-19T15:32:13.694480+0000","last_peered":"2024-09-19T15:32:13.694480+0000","last_clean":"2024-09-19T15:32:13.694480+0000","last_became_active":"2024-09-19T13:40:40.237537+0000","last_became_peered":"2024-09-19T13:40:40.237537+0000","last_unstale":"2024-09-19T15:32:13.694480+0000","last_undegraded":"2024-09-19T15:32:13.694480+0000","last_fullsized":"2024-09-19T15:32:13.694480+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'395","last_scrub_stamp":"2024-09-19T15:32:13.694279+0000","last_deep_scrub":"268'395","last_deep_scrub_stamp":"2024-09-19T15:32:13.694279+0000","last_clean_scrub_stamp":"2024-09-19T15:32:13.694279+0000","objects_scrubbed":8,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:26.735974+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49094,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":653,"num_read_kb":1263,"num_write":536,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:10.670226+0000","last_change":"2024-09-19T15:32:10.670226+0000","last_active":"2024-09-19T15:32:10.670226+0000","last_peered":"2024-09-19T15:32:10.670226+0000","last_clean":"2024-09-19T15:32:10.670226+0000","last_became_active":"2024-09-19T13:40:42.251896+0000","last_became_peered":"2024-09-19T13:40:42.251896+0000","last_unstale":"2024-09-19T15:32:10.670226+0000","last_undegraded":"2024-09-19T15:32:10.670226+0000","last_fullsized":"2024-09-19T15:32:10.670226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:10.670041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:10.670041+0000","last_clean_scrub_stamp":"2024-09-19T15:32:10.670041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:53.016060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'206","reported_seq":1100,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:11.064051+0000","last_change":"2024-09-19T15:32:11.064051+0000","last_active":"2024-09-19T15:32:11.064051+0000","last_peered":"2024-09-19T15:32:11.064051+0000","last_clean":"2024-09-19T15:32:11.064051+0000","last_became_active":"2024-09-19T13:40:44.268710+0000","last_became_peered":"2024-09-19T13:40:44.268710+0000","last_unstale":"2024-09-19T15:32:11.064051+0000","last_undegraded":"2024-09-19T15:32:11.064051+0000","last_fullsized":"2024-09-19T15:32:11.064051+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'206","last_scrub_stamp":"2024-09-19T15:32:11.063850+0000","last_deep_scrub":"268'206","last_deep_scrub_stamp":"2024-09-19T15:32:11.063850+0000","last_clean_scrub_stamp":"2024-09-19T15:32:11.063850+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:41.173552+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":655,"num_read_kb":652,"num_write":565,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'581","reported_seq":2271,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.008735+0000","last_change":"2024-09-19T15:32:05.008735+0000","last_active":"2024-09-19T15:32:05.008735+0000","last_peered":"2024-09-19T15:32:05.008735+0000","last_clean":"2024-09-19T15:32:05.008735+0000","last_became_active":"2024-09-19T13:40:36.217961+0000","last_became_peered":"2024-09-19T13:40:36.217961+0000","last_unstale":"2024-09-19T15:32:05.008735+0000","last_undegraded":"2024-09-19T15:32:05.008735+0000","last_fullsized":"2024-09-19T15:32:05.008735+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'581","last_scrub_stamp":"2024-09-19T15:32:05.008452+0000","last_deep_scrub":"268'581","last_deep_scrub_stamp":"2024-09-19T15:32:05.008452+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.008452+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:51.104635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2994,"num_read_kb":2751,"num_write":739,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'361","reported_seq":1167,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.549717+0000","last_change":"2024-09-19T15:31:47.549717+0000","last_active":"2024-09-19T15:31:47.549717+0000","last_peered":"2024-09-19T15:31:47.549717+0000","last_clean":"2024-09-19T15:31:47.549717+0000","last_became_active":"2024-09-19T13:40:34.253708+0000","last_became_peered":"2024-09-19T13:40:34.253708+0000","last_unstale":"2024-09-19T15:31:47.549717+0000","last_undegraded":"2024-09-19T15:31:47.549717+0000","last_fullsized":"2024-09-19T15:31:47.549717+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'361","last_scrub_stamp":"2024-09-19T15:31:47.549493+0000","last_deep_scrub":"268'361","last_deep_scrub_stamp":"2024-09-19T15:31:47.549493+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.549493+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:11:12.191338+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":758,"num_read_kb":54804,"num_write":1089,"num_write_kb":28785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:10.582279+0000","last_change":"2024-09-19T15:32:10.582279+0000","last_active":"2024-09-19T15:32:10.582279+0000","last_peered":"2024-09-19T15:32:10.582279+0000","last_clean":"2024-09-19T15:32:10.582279+0000","last_became_active":"2024-09-19T13:40:38.245018+0000","last_became_peered":"2024-09-19T13:40:38.245018+0000","last_unstale":"2024-09-19T15:32:10.582279+0000","last_undegraded":"2024-09-19T15:32:10.582279+0000","last_fullsized":"2024-09-19T15:32:10.582279+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:10.582106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:10.582106+0000","last_clean_scrub_stamp":"2024-09-19T15:32:10.582106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:06.488949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'355","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:17.157824+0000","last_change":"2024-09-19T15:32:17.157824+0000","last_active":"2024-09-19T15:32:17.157824+0000","last_peered":"2024-09-19T15:32:17.157824+0000","last_clean":"2024-09-19T15:32:17.157824+0000","last_became_active":"2024-09-19T13:40:40.229201+0000","last_became_peered":"2024-09-19T13:40:40.229201+0000","last_unstale":"2024-09-19T15:32:17.157824+0000","last_undegraded":"2024-09-19T15:32:17.157824+0000","last_fullsized":"2024-09-19T15:32:17.157824+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'355","last_scrub_stamp":"2024-09-19T15:32:17.157622+0000","last_deep_scrub":"268'355","last_deep_scrub_stamp":"2024-09-19T15:32:17.157622+0000","last_clean_scrub_stamp":"2024-09-19T15:32:17.157622+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:08:17.221388+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43041,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":567,"num_read_kb":1167,"num_write":454,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:09.644092+0000","last_change":"2024-09-19T15:32:09.644092+0000","last_active":"2024-09-19T15:32:09.644092+0000","last_peered":"2024-09-19T15:32:09.644092+0000","last_clean":"2024-09-19T15:32:09.644092+0000","last_became_active":"2024-09-19T13:40:42.246286+0000","last_became_peered":"2024-09-19T13:40:42.246286+0000","last_unstale":"2024-09-19T15:32:09.644092+0000","last_undegraded":"2024-09-19T15:32:09.644092+0000","last_fullsized":"2024-09-19T15:32:09.644092+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:09.643912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:09.643912+0000","last_clean_scrub_stamp":"2024-09-19T15:32:09.643912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:20.999995+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'165","reported_seq":737,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:22.613917+0000","last_change":"2024-09-19T15:32:22.613917+0000","last_active":"2024-09-19T15:32:22.613917+0000","last_peered":"2024-09-19T15:32:22.613917+0000","last_clean":"2024-09-19T15:32:22.613917+0000","last_became_active":"2024-09-19T13:40:44.267428+0000","last_became_peered":"2024-09-19T13:40:44.267428+0000","last_unstale":"2024-09-19T15:32:22.613917+0000","last_undegraded":"2024-09-19T15:32:22.613917+0000","last_fullsized":"2024-09-19T15:32:22.613917+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'165","last_scrub_stamp":"2024-09-19T15:32:22.613708+0000","last_deep_scrub":"268'165","last_deep_scrub_stamp":"2024-09-19T15:32:22.613708+0000","last_clean_scrub_stamp":"2024-09-19T15:32:22.613708+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:12:11.772585+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":325,"num_read_kb":284,"num_write":406,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'374","reported_seq":2107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.834458+0000","last_change":"2024-09-19T15:31:51.834458+0000","last_active":"2024-09-19T15:31:51.834458+0000","last_peered":"2024-09-19T15:31:51.834458+0000","last_clean":"2024-09-19T15:31:51.834458+0000","last_became_active":"2024-09-19T13:40:36.230842+0000","last_became_peered":"2024-09-19T13:40:36.230842+0000","last_unstale":"2024-09-19T15:31:51.834458+0000","last_undegraded":"2024-09-19T15:31:51.834458+0000","last_fullsized":"2024-09-19T15:31:51.834458+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'374","last_scrub_stamp":"2024-09-19T15:31:51.834239+0000","last_deep_scrub":"268'374","last_deep_scrub_stamp":"2024-09-19T15:31:51.834239+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.834239+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:37.484036+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2340,"num_read_kb":2286,"num_write":408,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'380","reported_seq":1170,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.696898+0000","last_change":"2024-09-19T15:31:49.696898+0000","last_active":"2024-09-19T15:31:49.696898+0000","last_peered":"2024-09-19T15:31:49.696898+0000","last_clean":"2024-09-19T15:31:49.696898+0000","last_became_active":"2024-09-19T13:41:05.307368+0000","last_became_peered":"2024-09-19T13:41:05.307368+0000","last_unstale":"2024-09-19T15:31:49.696898+0000","last_undegraded":"2024-09-19T15:31:49.696898+0000","last_fullsized":"2024-09-19T15:31:49.696898+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'380","last_scrub_stamp":"2024-09-19T15:31:49.696677+0000","last_deep_scrub":"268'380","last_deep_scrub_stamp":"2024-09-19T15:31:49.696677+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.696677+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:46.518267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":987,"num_read_kb":73584,"num_write":1229,"num_write_kb":59214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.597487+0000","last_change":"2024-09-19T15:32:03.597487+0000","last_active":"2024-09-19T15:32:03.597487+0000","last_peered":"2024-09-19T15:32:03.597487+0000","last_clean":"2024-09-19T15:32:03.597487+0000","last_became_active":"2024-09-19T13:40:38.245287+0000","last_became_peered":"2024-09-19T13:40:38.245287+0000","last_unstale":"2024-09-19T15:32:03.597487+0000","last_undegraded":"2024-09-19T15:32:03.597487+0000","last_fullsized":"2024-09-19T15:32:03.597487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:03.597281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:03.597281+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.597281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:23.720458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'179","reported_seq":773,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:14.584713+0000","last_change":"2024-09-19T15:32:14.584713+0000","last_active":"2024-09-19T15:32:14.584713+0000","last_peered":"2024-09-19T15:32:14.584713+0000","last_clean":"2024-09-19T15:32:14.584713+0000","last_became_active":"2024-09-19T13:40:40.246680+0000","last_became_peered":"2024-09-19T13:40:40.246680+0000","last_unstale":"2024-09-19T15:32:14.584713+0000","last_undegraded":"2024-09-19T15:32:14.584713+0000","last_fullsized":"2024-09-19T15:32:14.584713+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'179","last_scrub_stamp":"2024-09-19T15:32:14.584522+0000","last_deep_scrub":"268'179","last_deep_scrub_stamp":"2024-09-19T15:32:14.584522+0000","last_clean_scrub_stamp":"2024-09-19T15:32:14.584522+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:30:59.612795+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":223,"num_read_kb":217,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'765","reported_seq":2981,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.935783+0000","last_change":"2024-09-19T15:32:07.935783+0000","last_active":"2024-09-19T15:32:07.935783+0000","last_peered":"2024-09-19T15:32:07.935783+0000","last_clean":"2024-09-19T15:32:07.935783+0000","last_became_active":"2024-09-19T13:40:42.250436+0000","last_became_peered":"2024-09-19T13:40:42.250436+0000","last_unstale":"2024-09-19T15:32:07.935783+0000","last_undegraded":"2024-09-19T15:32:07.935783+0000","last_fullsized":"2024-09-19T15:32:07.935783+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'765","last_scrub_stamp":"2024-09-19T15:32:07.935587+0000","last_deep_scrub":"268'765","last_deep_scrub_stamp":"2024-09-19T15:32:07.935587+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.935587+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:37.846498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'102","reported_seq":646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:19.687128+0000","last_change":"2024-09-19T15:32:19.687128+0000","last_active":"2024-09-19T15:32:19.687128+0000","last_peered":"2024-09-19T15:32:19.687128+0000","last_clean":"2024-09-19T15:32:19.687128+0000","last_became_active":"2024-09-19T13:40:44.268630+0000","last_became_peered":"2024-09-19T13:40:44.268630+0000","last_unstale":"2024-09-19T15:32:19.687128+0000","last_undegraded":"2024-09-19T15:32:19.687128+0000","last_fullsized":"2024-09-19T15:32:19.687128+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'102","last_scrub_stamp":"2024-09-19T15:32:19.686909+0000","last_deep_scrub":"268'102","last_deep_scrub_stamp":"2024-09-19T15:32:19.686909+0000","last_clean_scrub_stamp":"2024-09-19T15:32:19.686909+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:34.595882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":162,"num_read_kb":149,"num_write":244,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'1165","reported_seq":2741,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.534176+0000","last_change":"2024-09-19T15:31:58.534176+0000","last_active":"2024-09-19T15:31:58.534176+0000","last_peered":"2024-09-19T15:31:58.534176+0000","last_clean":"2024-09-19T15:31:58.534176+0000","last_became_active":"2024-09-19T13:41:05.320040+0000","last_became_peered":"2024-09-19T13:41:05.320040+0000","last_unstale":"2024-09-19T15:31:58.534176+0000","last_undegraded":"2024-09-19T15:31:58.534176+0000","last_fullsized":"2024-09-19T15:31:58.534176+0000","mapping_epoch":38,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1165","last_scrub_stamp":"2024-09-19T15:31:58.533998+0000","last_deep_scrub":"268'1165","last_deep_scrub_stamp":"2024-09-19T15:31:58.533998+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.533998+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":1100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:51.390548+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5194,"num_read_kb":4574,"num_write":1598,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'367","reported_seq":1037,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.813433+0000","last_change":"2024-09-19T15:31:52.813433+0000","last_active":"2024-09-19T15:31:52.813433+0000","last_peered":"2024-09-19T15:31:52.813433+0000","last_clean":"2024-09-19T15:31:52.813433+0000","last_became_active":"2024-09-19T13:40:34.251475+0000","last_became_peered":"2024-09-19T13:40:34.251475+0000","last_unstale":"2024-09-19T15:31:52.813433+0000","last_undegraded":"2024-09-19T15:31:52.813433+0000","last_fullsized":"2024-09-19T15:31:52.813433+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'367","last_scrub_stamp":"2024-09-19T15:31:52.813085+0000","last_deep_scrub":"268'367","last_deep_scrub_stamp":"2024-09-19T15:31:52.813085+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.813085+0000","objects_scrubbed":3,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:50.638803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":623,"num_read_kb":3575,"num_write":1141,"num_write_kb":19359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.633155+0000","last_change":"2024-09-19T15:32:08.633155+0000","last_active":"2024-09-19T15:32:08.633155+0000","last_peered":"2024-09-19T15:32:08.633155+0000","last_clean":"2024-09-19T15:32:08.633155+0000","last_became_active":"2024-09-19T13:40:38.246205+0000","last_became_peered":"2024-09-19T13:40:38.246205+0000","last_unstale":"2024-09-19T15:32:08.633155+0000","last_undegraded":"2024-09-19T15:32:08.633155+0000","last_fullsized":"2024-09-19T15:32:08.633155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:08.632970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:08.632970+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.632970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:46.231112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'391","reported_seq":1061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:16.627040+0000","last_change":"2024-09-19T15:32:16.626907+0000","last_active":"2024-09-19T15:32:16.627040+0000","last_peered":"2024-09-19T15:32:16.627040+0000","last_clean":"2024-09-19T15:32:16.627040+0000","last_became_active":"2024-09-19T13:40:40.241730+0000","last_became_peered":"2024-09-19T13:40:40.241730+0000","last_unstale":"2024-09-19T15:32:16.627040+0000","last_undegraded":"2024-09-19T15:32:16.627040+0000","last_fullsized":"2024-09-19T15:32:16.627040+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'391","last_scrub_stamp":"2024-09-19T15:32:16.626717+0000","last_deep_scrub":"268'391","last_deep_scrub_stamp":"2024-09-19T15:32:16.626717+0000","last_clean_scrub_stamp":"2024-09-19T15:32:16.626717+0000","objects_scrubbed":8,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:16.732410+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69547,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":608,"num_read_kb":1209,"num_write":470,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:15.608498+0000","last_change":"2024-09-19T15:32:15.608498+0000","last_active":"2024-09-19T15:32:15.608498+0000","last_peered":"2024-09-19T15:32:15.608498+0000","last_clean":"2024-09-19T15:32:15.608498+0000","last_became_active":"2024-09-19T13:40:42.240191+0000","last_became_peered":"2024-09-19T13:40:42.240191+0000","last_unstale":"2024-09-19T15:32:15.608498+0000","last_undegraded":"2024-09-19T15:32:15.608498+0000","last_fullsized":"2024-09-19T15:32:15.608498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:15.608302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:15.608302+0000","last_clean_scrub_stamp":"2024-09-19T15:32:15.608302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:59.856035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'130","reported_seq":663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:21.614445+0000","last_change":"2024-09-19T15:32:21.614445+0000","last_active":"2024-09-19T15:32:21.614445+0000","last_peered":"2024-09-19T15:32:21.614445+0000","last_clean":"2024-09-19T15:32:21.614445+0000","last_became_active":"2024-09-19T13:40:44.274449+0000","last_became_peered":"2024-09-19T13:40:44.274449+0000","last_unstale":"2024-09-19T15:32:21.614445+0000","last_undegraded":"2024-09-19T15:32:21.614445+0000","last_fullsized":"2024-09-19T15:32:21.614445+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'130","last_scrub_stamp":"2024-09-19T15:32:21.614259+0000","last_deep_scrub":"268'130","last_deep_scrub_stamp":"2024-09-19T15:32:21.614259+0000","last_clean_scrub_stamp":"2024-09-19T15:32:21.614259+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:17:58.072102+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":153,"num_write":303,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'798","reported_seq":2353,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.488362+0000","last_change":"2024-09-19T15:31:57.488362+0000","last_active":"2024-09-19T15:31:57.488362+0000","last_peered":"2024-09-19T15:31:57.488362+0000","last_clean":"2024-09-19T15:31:57.488362+0000","last_became_active":"2024-09-19T13:40:36.227359+0000","last_became_peered":"2024-09-19T13:40:36.227359+0000","last_unstale":"2024-09-19T15:31:57.488362+0000","last_undegraded":"2024-09-19T15:31:57.488362+0000","last_fullsized":"2024-09-19T15:31:57.488362+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'798","last_scrub_stamp":"2024-09-19T15:31:57.488181+0000","last_deep_scrub":"268'798","last_deep_scrub_stamp":"2024-09-19T15:31:57.488181+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.488181+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:25.410101+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3854,"num_read_kb":3454,"num_write":1058,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":689,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'425","reported_seq":1190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.803379+0000","last_change":"2024-09-19T15:31:53.803379+0000","last_active":"2024-09-19T15:31:53.803379+0000","last_peered":"2024-09-19T15:31:53.803379+0000","last_clean":"2024-09-19T15:31:53.803379+0000","last_became_active":"2024-09-19T13:41:05.313209+0000","last_became_peered":"2024-09-19T13:41:05.313209+0000","last_unstale":"2024-09-19T15:31:53.803379+0000","last_undegraded":"2024-09-19T15:31:53.803379+0000","last_fullsized":"2024-09-19T15:31:53.803379+0000","mapping_epoch":38,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'425","last_scrub_stamp":"2024-09-19T15:31:53.803129+0000","last_deep_scrub":"268'425","last_deep_scrub_stamp":"2024-09-19T15:31:53.803129+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.803129+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:11:25.265777+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136845,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":777,"num_read_kb":102227,"num_write":1424,"num_write_kb":49987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:12.705223+0000","last_change":"2024-09-19T15:32:12.705223+0000","last_active":"2024-09-19T15:32:12.705223+0000","last_peered":"2024-09-19T15:32:12.705223+0000","last_clean":"2024-09-19T15:32:12.705223+0000","last_became_active":"2024-09-19T13:40:38.229929+0000","last_became_peered":"2024-09-19T13:40:38.229929+0000","last_unstale":"2024-09-19T15:32:12.705223+0000","last_undegraded":"2024-09-19T15:32:12.705223+0000","last_fullsized":"2024-09-19T15:32:12.705223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:12.704925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:12.704925+0000","last_clean_scrub_stamp":"2024-09-19T15:32:12.704925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:09:57.542107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'306","reported_seq":926,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:10.641013+0000","last_change":"2024-09-19T15:32:10.641013+0000","last_active":"2024-09-19T15:32:10.641013+0000","last_peered":"2024-09-19T15:32:10.641013+0000","last_clean":"2024-09-19T15:32:10.641013+0000","last_became_active":"2024-09-19T13:40:40.241404+0000","last_became_peered":"2024-09-19T13:40:40.241404+0000","last_unstale":"2024-09-19T15:32:10.641013+0000","last_undegraded":"2024-09-19T15:32:10.641013+0000","last_fullsized":"2024-09-19T15:32:10.641013+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'306","last_scrub_stamp":"2024-09-19T15:32:10.640809+0000","last_deep_scrub":"268'306","last_deep_scrub_stamp":"2024-09-19T15:32:10.640809+0000","last_clean_scrub_stamp":"2024-09-19T15:32:10.640809+0000","objects_scrubbed":4,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:35.973568+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45708,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":1069,"num_write":394,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.952575+0000","last_change":"2024-09-19T15:32:06.952418+0000","last_active":"2024-09-19T15:32:06.952575+0000","last_peered":"2024-09-19T15:32:06.952575+0000","last_clean":"2024-09-19T15:32:06.952575+0000","last_became_active":"2024-09-19T13:40:42.251413+0000","last_became_peered":"2024-09-19T13:40:42.251413+0000","last_unstale":"2024-09-19T15:32:06.952575+0000","last_undegraded":"2024-09-19T15:32:06.952575+0000","last_fullsized":"2024-09-19T15:32:06.952575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:06.952230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:06.952230+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.952230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:46:16.041934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'164","reported_seq":728,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:26.080657+0000","last_change":"2024-09-19T15:32:26.080657+0000","last_active":"2024-09-19T15:32:26.080657+0000","last_peered":"2024-09-19T15:32:26.080657+0000","last_clean":"2024-09-19T15:32:26.080657+0000","last_became_active":"2024-09-19T13:40:44.277774+0000","last_became_peered":"2024-09-19T13:40:44.277774+0000","last_unstale":"2024-09-19T15:32:26.080657+0000","last_undegraded":"2024-09-19T15:32:26.080657+0000","last_fullsized":"2024-09-19T15:32:26.080657+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'164","last_scrub_stamp":"2024-09-19T15:32:26.080469+0000","last_deep_scrub":"268'164","last_deep_scrub_stamp":"2024-09-19T15:32:26.080469+0000","last_clean_scrub_stamp":"2024-09-19T15:32:26.080469+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:38.054276+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":980,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216,"num_read_kb":207,"num_write":371,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'468","reported_seq":2247,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.010835+0000","last_change":"2024-09-19T15:32:02.010694+0000","last_active":"2024-09-19T15:32:02.010835+0000","last_peered":"2024-09-19T15:32:02.010835+0000","last_clean":"2024-09-19T15:32:02.010835+0000","last_became_active":"2024-09-19T13:40:36.222632+0000","last_became_peered":"2024-09-19T13:40:36.222632+0000","last_unstale":"2024-09-19T15:32:02.010835+0000","last_undegraded":"2024-09-19T15:32:02.010835+0000","last_fullsized":"2024-09-19T15:32:02.010835+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'468","last_scrub_stamp":"2024-09-19T15:32:02.010501+0000","last_deep_scrub":"268'468","last_deep_scrub_stamp":"2024-09-19T15:32:02.010501+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.010501+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:51:35.207348+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2809,"num_read_kb":2663,"num_write":534,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3595,"num_omap_keys":15,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'381","reported_seq":1091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.916447+0000","last_change":"2024-09-19T15:31:49.916447+0000","last_active":"2024-09-19T15:31:49.916447+0000","last_peered":"2024-09-19T15:31:49.916447+0000","last_clean":"2024-09-19T15:31:49.916447+0000","last_became_active":"2024-09-19T13:40:34.258068+0000","last_became_peered":"2024-09-19T13:40:34.258068+0000","last_unstale":"2024-09-19T15:31:49.916447+0000","last_undegraded":"2024-09-19T15:31:49.916447+0000","last_fullsized":"2024-09-19T15:31:49.916447+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'381","last_scrub_stamp":"2024-09-19T15:31:49.916243+0000","last_deep_scrub":"268'381","last_deep_scrub_stamp":"2024-09-19T15:31:49.916243+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.916243+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:51:34.097674+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":750,"num_read_kb":11976,"num_write":1179,"num_write_kb":32337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.568678+0000","last_change":"2024-09-19T15:32:08.568678+0000","last_active":"2024-09-19T15:32:08.568678+0000","last_peered":"2024-09-19T15:32:08.568678+0000","last_clean":"2024-09-19T15:32:08.568678+0000","last_became_active":"2024-09-19T13:40:38.236724+0000","last_became_peered":"2024-09-19T13:40:38.236724+0000","last_unstale":"2024-09-19T15:32:08.568678+0000","last_undegraded":"2024-09-19T15:32:08.568678+0000","last_fullsized":"2024-09-19T15:32:08.568678+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:08.568485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:08.568485+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.568485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:28.356524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'279","reported_seq":881,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:16.193007+0000","last_change":"2024-09-19T15:32:16.193007+0000","last_active":"2024-09-19T15:32:16.193007+0000","last_peered":"2024-09-19T15:32:16.193007+0000","last_clean":"2024-09-19T15:32:16.193007+0000","last_became_active":"2024-09-19T13:40:40.222807+0000","last_became_peered":"2024-09-19T13:40:40.222807+0000","last_unstale":"2024-09-19T15:32:16.193007+0000","last_undegraded":"2024-09-19T15:32:16.193007+0000","last_fullsized":"2024-09-19T15:32:16.193007+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'279","last_scrub_stamp":"2024-09-19T15:32:16.192819+0000","last_deep_scrub":"268'279","last_deep_scrub_stamp":"2024-09-19T15:32:16.192819+0000","last_clean_scrub_stamp":"2024-09-19T15:32:16.192819+0000","objects_scrubbed":3,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:55:09.211321+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47535,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":1137,"num_write":394,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:22.489802+0000","last_change":"2024-09-19T15:32:22.489802+0000","last_active":"2024-09-19T15:32:22.489802+0000","last_peered":"2024-09-19T15:32:22.489802+0000","last_clean":"2024-09-19T15:32:22.489802+0000","last_became_active":"2024-09-19T13:40:42.251057+0000","last_became_peered":"2024-09-19T13:40:42.251057+0000","last_unstale":"2024-09-19T15:32:22.489802+0000","last_undegraded":"2024-09-19T15:32:22.489802+0000","last_fullsized":"2024-09-19T15:32:22.489802+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:22.489612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:22.489612+0000","last_clean_scrub_stamp":"2024-09-19T15:32:22.489612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:52.279574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'147","reported_seq":1287,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:20.654690+0000","last_change":"2024-09-19T15:32:20.654690+0000","last_active":"2024-09-19T15:32:20.654690+0000","last_peered":"2024-09-19T15:32:20.654690+0000","last_clean":"2024-09-19T15:32:20.654690+0000","last_became_active":"2024-09-19T13:40:44.270656+0000","last_became_peered":"2024-09-19T13:40:44.270656+0000","last_unstale":"2024-09-19T15:32:20.654690+0000","last_undegraded":"2024-09-19T15:32:20.654690+0000","last_fullsized":"2024-09-19T15:32:20.654690+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'147","last_scrub_stamp":"2024-09-19T15:32:20.654476+0000","last_deep_scrub":"268'147","last_deep_scrub_stamp":"2024-09-19T15:32:20.654476+0000","last_clean_scrub_stamp":"2024-09-19T15:32:20.654476+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:26.821573+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":816,"num_read_kb":810,"num_write":350,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'465","reported_seq":2003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.548394+0000","last_change":"2024-09-19T15:31:55.548394+0000","last_active":"2024-09-19T15:31:55.548394+0000","last_peered":"2024-09-19T15:31:55.548394+0000","last_clean":"2024-09-19T15:31:55.548394+0000","last_became_active":"2024-09-19T13:40:36.217230+0000","last_became_peered":"2024-09-19T13:40:36.217230+0000","last_unstale":"2024-09-19T15:31:55.548394+0000","last_undegraded":"2024-09-19T15:31:55.548394+0000","last_fullsized":"2024-09-19T15:31:55.548394+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'465","last_scrub_stamp":"2024-09-19T15:31:55.548152+0000","last_deep_scrub":"268'465","last_deep_scrub_stamp":"2024-09-19T15:31:55.548152+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.548152+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:04.184032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2437,"num_read_kb":2267,"num_write":569,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'335","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.661888+0000","last_change":"2024-09-19T15:31:47.661888+0000","last_active":"2024-09-19T15:31:47.661888+0000","last_peered":"2024-09-19T15:31:47.661888+0000","last_clean":"2024-09-19T15:31:47.661888+0000","last_became_active":"2024-09-19T13:40:34.258416+0000","last_became_peered":"2024-09-19T13:40:34.258416+0000","last_unstale":"2024-09-19T15:31:47.661888+0000","last_undegraded":"2024-09-19T15:31:47.661888+0000","last_fullsized":"2024-09-19T15:31:47.661888+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'335","last_scrub_stamp":"2024-09-19T15:31:47.661793+0000","last_deep_scrub":"268'335","last_deep_scrub_stamp":"2024-09-19T15:31:47.661793+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.661793+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:16.145468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":559,"num_read_kb":6695,"num_write":1052,"num_write_kb":15020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"268'2","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.657305+0000","last_change":"2024-09-19T15:32:05.657108+0000","last_active":"2024-09-19T15:32:05.657305+0000","last_peered":"2024-09-19T15:32:05.657305+0000","last_clean":"2024-09-19T15:32:05.657305+0000","last_became_active":"2024-09-19T13:40:38.214571+0000","last_became_peered":"2024-09-19T13:40:38.214571+0000","last_unstale":"2024-09-19T15:32:05.657305+0000","last_undegraded":"2024-09-19T15:32:05.657305+0000","last_fullsized":"2024-09-19T15:32:05.657305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:05.656919+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:05.656919+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.656919+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:18:39.425426+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'355","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:16.604721+0000","last_change":"2024-09-19T15:32:16.604721+0000","last_active":"2024-09-19T15:32:16.604721+0000","last_peered":"2024-09-19T15:32:16.604721+0000","last_clean":"2024-09-19T15:32:16.604721+0000","last_became_active":"2024-09-19T13:40:40.245368+0000","last_became_peered":"2024-09-19T13:40:40.245368+0000","last_unstale":"2024-09-19T15:32:16.604721+0000","last_undegraded":"2024-09-19T15:32:16.604721+0000","last_fullsized":"2024-09-19T15:32:16.604721+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'355","last_scrub_stamp":"2024-09-19T15:32:16.604529+0000","last_deep_scrub":"268'355","last_deep_scrub_stamp":"2024-09-19T15:32:16.604529+0000","last_clean_scrub_stamp":"2024-09-19T15:32:16.604529+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:31:33.028785+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48547,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":571,"num_read_kb":1175,"num_write":452,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:16.612659+0000","last_change":"2024-09-19T15:32:16.612659+0000","last_active":"2024-09-19T15:32:16.612659+0000","last_peered":"2024-09-19T15:32:16.612659+0000","last_clean":"2024-09-19T15:32:16.612659+0000","last_became_active":"2024-09-19T13:40:42.239391+0000","last_became_peered":"2024-09-19T13:40:42.239391+0000","last_unstale":"2024-09-19T15:32:16.612659+0000","last_undegraded":"2024-09-19T15:32:16.612659+0000","last_fullsized":"2024-09-19T15:32:16.612659+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:16.612481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:16.612481+0000","last_clean_scrub_stamp":"2024-09-19T15:32:16.612481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:37.873230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'131","reported_seq":667,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:18.583804+0000","last_change":"2024-09-19T15:32:18.583804+0000","last_active":"2024-09-19T15:32:18.583804+0000","last_peered":"2024-09-19T15:32:18.583804+0000","last_clean":"2024-09-19T15:32:18.583804+0000","last_became_active":"2024-09-19T13:40:44.249201+0000","last_became_peered":"2024-09-19T13:40:44.249201+0000","last_unstale":"2024-09-19T15:32:18.583804+0000","last_undegraded":"2024-09-19T15:32:18.583804+0000","last_fullsized":"2024-09-19T15:32:18.583804+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'131","last_scrub_stamp":"2024-09-19T15:32:18.583609+0000","last_deep_scrub":"268'131","last_deep_scrub_stamp":"2024-09-19T15:32:18.583609+0000","last_clean_scrub_stamp":"2024-09-19T15:32:18.583609+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:15:18.362322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":210,"num_read_kb":190,"num_write":320,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'404","reported_seq":2086,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.650457+0000","last_change":"2024-09-19T15:31:59.650457+0000","last_active":"2024-09-19T15:31:59.650457+0000","last_peered":"2024-09-19T15:31:59.650457+0000","last_clean":"2024-09-19T15:31:59.650457+0000","last_became_active":"2024-09-19T13:40:36.225885+0000","last_became_peered":"2024-09-19T13:40:36.225885+0000","last_unstale":"2024-09-19T15:31:59.650457+0000","last_undegraded":"2024-09-19T15:31:59.650457+0000","last_fullsized":"2024-09-19T15:31:59.650457+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'404","last_scrub_stamp":"2024-09-19T15:31:59.650266+0000","last_deep_scrub":"268'404","last_deep_scrub_stamp":"2024-09-19T15:31:59.650266+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.650266+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:40.113541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2307,"num_read_kb":2225,"num_write":450,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'329","reported_seq":970,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.933899+0000","last_change":"2024-09-19T15:31:52.933899+0000","last_active":"2024-09-19T15:31:52.933899+0000","last_peered":"2024-09-19T15:31:52.933899+0000","last_clean":"2024-09-19T15:31:52.933899+0000","last_became_active":"2024-09-19T13:40:34.249068+0000","last_became_peered":"2024-09-19T13:40:34.249068+0000","last_unstale":"2024-09-19T15:31:52.933899+0000","last_undegraded":"2024-09-19T15:31:52.933899+0000","last_fullsized":"2024-09-19T15:31:52.933899+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'329","last_scrub_stamp":"2024-09-19T15:31:52.933659+0000","last_deep_scrub":"268'329","last_deep_scrub_stamp":"2024-09-19T15:31:52.933659+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.933659+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:49.241793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":27093,"num_write":1002,"num_write_kb":27581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"268'462","reported_seq":2113,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.639393+0000","last_change":"2024-09-19T15:32:01.639393+0000","last_active":"2024-09-19T15:32:01.639393+0000","last_peered":"2024-09-19T15:32:01.639393+0000","last_clean":"2024-09-19T15:32:01.639393+0000","last_became_active":"2024-09-19T13:40:36.220569+0000","last_became_peered":"2024-09-19T13:40:36.220569+0000","last_unstale":"2024-09-19T15:32:01.639393+0000","last_undegraded":"2024-09-19T15:32:01.639393+0000","last_fullsized":"2024-09-19T15:32:01.639393+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'462","last_scrub_stamp":"2024-09-19T15:32:01.639153+0000","last_deep_scrub":"268'462","last_deep_scrub_stamp":"2024-09-19T15:32:01.639153+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.639153+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:32:50.011020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2535,"num_read_kb":2389,"num_write":539,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"268'416","reported_seq":1140,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.890155+0000","last_change":"2024-09-19T15:31:48.890155+0000","last_active":"2024-09-19T15:31:48.890155+0000","last_peered":"2024-09-19T15:31:48.890155+0000","last_clean":"2024-09-19T15:31:48.890155+0000","last_became_active":"2024-09-19T13:40:34.239357+0000","last_became_peered":"2024-09-19T13:40:34.239357+0000","last_unstale":"2024-09-19T15:31:48.890155+0000","last_undegraded":"2024-09-19T15:31:48.890155+0000","last_fullsized":"2024-09-19T15:31:48.890155+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'416","last_scrub_stamp":"2024-09-19T15:31:48.889953+0000","last_deep_scrub":"268'416","last_deep_scrub_stamp":"2024-09-19T15:31:48.889953+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.889953+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:51:03.904838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":787,"num_read_kb":92890,"num_write":1403,"num_write_kb":63384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'596","reported_seq":2315,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.766403+0000","last_change":"2024-09-19T15:32:03.766403+0000","last_active":"2024-09-19T15:32:03.766403+0000","last_peered":"2024-09-19T15:32:03.766403+0000","last_clean":"2024-09-19T15:32:03.766403+0000","last_became_active":"2024-09-19T13:40:36.241566+0000","last_became_peered":"2024-09-19T13:40:36.241566+0000","last_unstale":"2024-09-19T15:32:03.766403+0000","last_undegraded":"2024-09-19T15:32:03.766403+0000","last_fullsized":"2024-09-19T15:32:03.766403+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'596","last_scrub_stamp":"2024-09-19T15:32:03.766219+0000","last_deep_scrub":"268'596","last_deep_scrub_stamp":"2024-09-19T15:32:03.766219+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.766219+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:13:52.457376+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3019,"num_read_kb":2776,"num_write":751,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'363","reported_seq":1052,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.812126+0000","last_change":"2024-09-19T15:31:54.812126+0000","last_active":"2024-09-19T15:31:54.812126+0000","last_peered":"2024-09-19T15:31:54.812126+0000","last_clean":"2024-09-19T15:31:54.812126+0000","last_became_active":"2024-09-19T13:40:34.221057+0000","last_became_peered":"2024-09-19T13:40:34.221057+0000","last_unstale":"2024-09-19T15:31:54.812126+0000","last_undegraded":"2024-09-19T15:31:54.812126+0000","last_fullsized":"2024-09-19T15:31:54.812126+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'363","last_scrub_stamp":"2024-09-19T15:31:54.811762+0000","last_deep_scrub":"268'363","last_deep_scrub_stamp":"2024-09-19T15:31:54.811762+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.811762+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:58.508853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":673,"num_read_kb":11742,"num_write":1135,"num_write_kb":23593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'496","reported_seq":2272,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.604022+0000","last_change":"2024-09-19T15:31:58.604022+0000","last_active":"2024-09-19T15:31:58.604022+0000","last_peered":"2024-09-19T15:31:58.604022+0000","last_clean":"2024-09-19T15:31:58.604022+0000","last_became_active":"2024-09-19T13:40:36.238166+0000","last_became_peered":"2024-09-19T13:40:36.238166+0000","last_unstale":"2024-09-19T15:31:58.604022+0000","last_undegraded":"2024-09-19T15:31:58.604022+0000","last_fullsized":"2024-09-19T15:31:58.604022+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'496","last_scrub_stamp":"2024-09-19T15:31:58.603838+0000","last_deep_scrub":"268'496","last_deep_scrub_stamp":"2024-09-19T15:31:58.603838+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.603838+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:02:50.763311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2902,"num_read_kb":2744,"num_write":591,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'345","reported_seq":1067,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.696407+0000","last_change":"2024-09-19T15:31:48.696407+0000","last_active":"2024-09-19T15:31:48.696407+0000","last_peered":"2024-09-19T15:31:48.696407+0000","last_clean":"2024-09-19T15:31:48.696407+0000","last_became_active":"2024-09-19T13:40:34.232099+0000","last_became_peered":"2024-09-19T13:40:34.232099+0000","last_unstale":"2024-09-19T15:31:48.696407+0000","last_undegraded":"2024-09-19T15:31:48.696407+0000","last_fullsized":"2024-09-19T15:31:48.696407+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'345","last_scrub_stamp":"2024-09-19T15:31:48.696153+0000","last_deep_scrub":"268'345","last_deep_scrub_stamp":"2024-09-19T15:31:48.696153+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.696153+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:49:42.668267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136873,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":758,"num_read_kb":12572,"num_write":1035,"num_write_kb":46357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"268'464","reported_seq":2054,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.060300+0000","last_change":"2024-09-19T15:32:04.060300+0000","last_active":"2024-09-19T15:32:04.060300+0000","last_peered":"2024-09-19T15:32:04.060300+0000","last_clean":"2024-09-19T15:32:04.060300+0000","last_became_active":"2024-09-19T13:40:36.238644+0000","last_became_peered":"2024-09-19T13:40:36.238644+0000","last_unstale":"2024-09-19T15:32:04.060300+0000","last_undegraded":"2024-09-19T15:32:04.060300+0000","last_fullsized":"2024-09-19T15:32:04.060300+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'464","last_scrub_stamp":"2024-09-19T15:32:04.060118+0000","last_deep_scrub":"268'464","last_deep_scrub_stamp":"2024-09-19T15:32:04.060118+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.060118+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:50:53.942088+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2315,"num_read_kb":2185,"num_write":554,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'403","reported_seq":1123,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.920457+0000","last_change":"2024-09-19T15:31:50.920457+0000","last_active":"2024-09-19T15:31:50.920457+0000","last_peered":"2024-09-19T15:31:50.920457+0000","last_clean":"2024-09-19T15:31:50.920457+0000","last_became_active":"2024-09-19T13:40:34.249600+0000","last_became_peered":"2024-09-19T13:40:34.249600+0000","last_unstale":"2024-09-19T15:31:50.920457+0000","last_undegraded":"2024-09-19T15:31:50.920457+0000","last_fullsized":"2024-09-19T15:31:50.920457+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'403","last_scrub_stamp":"2024-09-19T15:31:50.920243+0000","last_deep_scrub":"268'403","last_deep_scrub_stamp":"2024-09-19T15:31:50.920243+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.920243+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:44.928927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":720,"num_read_kb":53970,"num_write":1365,"num_write_kb":53250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'834","reported_seq":2496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.535048+0000","last_change":"2024-09-19T15:32:00.535048+0000","last_active":"2024-09-19T15:32:00.535048+0000","last_peered":"2024-09-19T15:32:00.535048+0000","last_clean":"2024-09-19T15:32:00.535048+0000","last_became_active":"2024-09-19T13:40:36.216697+0000","last_became_peered":"2024-09-19T13:40:36.216697+0000","last_unstale":"2024-09-19T15:32:00.535048+0000","last_undegraded":"2024-09-19T15:32:00.535048+0000","last_fullsized":"2024-09-19T15:32:00.535048+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'834","last_scrub_stamp":"2024-09-19T15:32:00.534857+0000","last_deep_scrub":"268'834","last_deep_scrub_stamp":"2024-09-19T15:32:00.534857+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.534857+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:46:06.736133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4198,"num_read_kb":3766,"num_write":1106,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'330","reported_seq":1034,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.609462+0000","last_change":"2024-09-19T15:31:48.609462+0000","last_active":"2024-09-19T15:31:48.609462+0000","last_peered":"2024-09-19T15:31:48.609462+0000","last_clean":"2024-09-19T15:31:48.609462+0000","last_became_active":"2024-09-19T13:40:34.216774+0000","last_became_peered":"2024-09-19T13:40:34.216774+0000","last_unstale":"2024-09-19T15:31:48.609462+0000","last_undegraded":"2024-09-19T15:31:48.609462+0000","last_fullsized":"2024-09-19T15:31:48.609462+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'330","last_scrub_stamp":"2024-09-19T15:31:48.609254+0000","last_deep_scrub":"268'330","last_deep_scrub_stamp":"2024-09-19T15:31:48.609254+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.609254+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:28.120319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":651,"num_read_kb":47831,"num_write":981,"num_write_kb":20035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'563","reported_seq":2261,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.041159+0000","last_change":"2024-09-19T15:32:03.041159+0000","last_active":"2024-09-19T15:32:03.041159+0000","last_peered":"2024-09-19T15:32:03.041159+0000","last_clean":"2024-09-19T15:32:03.041159+0000","last_became_active":"2024-09-19T13:40:36.218090+0000","last_became_peered":"2024-09-19T13:40:36.218090+0000","last_unstale":"2024-09-19T15:32:03.041159+0000","last_undegraded":"2024-09-19T15:32:03.041159+0000","last_fullsized":"2024-09-19T15:32:03.041159+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'563","last_scrub_stamp":"2024-09-19T15:32:03.040966+0000","last_deep_scrub":"268'563","last_deep_scrub_stamp":"2024-09-19T15:32:03.040966+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.040966+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:59.258463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2933,"num_read_kb":2699,"num_write":698,"num_write_kb":201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'354","reported_seq":1143,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.932331+0000","last_change":"2024-09-19T15:31:50.932331+0000","last_active":"2024-09-19T15:31:50.932331+0000","last_peered":"2024-09-19T15:31:50.932331+0000","last_clean":"2024-09-19T15:31:50.932331+0000","last_became_active":"2024-09-19T13:40:34.272629+0000","last_became_peered":"2024-09-19T13:40:34.272629+0000","last_unstale":"2024-09-19T15:31:50.932331+0000","last_undegraded":"2024-09-19T15:31:50.932331+0000","last_fullsized":"2024-09-19T15:31:50.932331+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'354","last_scrub_stamp":"2024-09-19T15:31:50.932113+0000","last_deep_scrub":"268'354","last_deep_scrub_stamp":"2024-09-19T15:31:50.932113+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.932113+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:18:14.426357+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174644,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":935,"num_read_kb":42229,"num_write":1199,"num_write_kb":17971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'342","reported_seq":1792,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.944349+0000","last_change":"2024-09-19T15:31:57.944349+0000","last_active":"2024-09-19T15:31:57.944349+0000","last_peered":"2024-09-19T15:31:57.944349+0000","last_clean":"2024-09-19T15:31:57.944349+0000","last_became_active":"2024-09-19T13:40:36.224228+0000","last_became_peered":"2024-09-19T13:40:36.224228+0000","last_unstale":"2024-09-19T15:31:57.944349+0000","last_undegraded":"2024-09-19T15:31:57.944349+0000","last_fullsized":"2024-09-19T15:31:57.944349+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'342","last_scrub_stamp":"2024-09-19T15:31:57.944097+0000","last_deep_scrub":"268'342","last_deep_scrub_stamp":"2024-09-19T15:31:57.944097+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.944097+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:57.675155+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1855,"num_read_kb":1782,"num_write":368,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'385","reported_seq":1149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.890591+0000","last_change":"2024-09-19T15:31:51.890591+0000","last_active":"2024-09-19T15:31:51.890591+0000","last_peered":"2024-09-19T15:31:51.890591+0000","last_clean":"2024-09-19T15:31:51.890591+0000","last_became_active":"2024-09-19T13:40:34.245197+0000","last_became_peered":"2024-09-19T13:40:34.245197+0000","last_unstale":"2024-09-19T15:31:51.890591+0000","last_undegraded":"2024-09-19T15:31:51.890591+0000","last_fullsized":"2024-09-19T15:31:51.890591+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'385","last_scrub_stamp":"2024-09-19T15:31:51.890329+0000","last_deep_scrub":"268'385","last_deep_scrub_stamp":"2024-09-19T15:31:51.890329+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.890329+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:30.384059+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273700,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":750,"num_read_kb":129994,"num_write":1223,"num_write_kb":46426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"268'497","reported_seq":2049,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.736843+0000","last_change":"2024-09-19T15:31:58.736843+0000","last_active":"2024-09-19T15:31:58.736843+0000","last_peered":"2024-09-19T15:31:58.736843+0000","last_clean":"2024-09-19T15:31:58.736843+0000","last_became_active":"2024-09-19T13:40:36.226839+0000","last_became_peered":"2024-09-19T13:40:36.226839+0000","last_unstale":"2024-09-19T15:31:58.736843+0000","last_undegraded":"2024-09-19T15:31:58.736843+0000","last_fullsized":"2024-09-19T15:31:58.736843+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'497","last_scrub_stamp":"2024-09-19T15:31:58.736663+0000","last_deep_scrub":"268'497","last_deep_scrub_stamp":"2024-09-19T15:31:58.736663+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.736663+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:38:24.306737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2632,"num_read_kb":2421,"num_write":626,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'349","reported_seq":1173,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.757738+0000","last_change":"2024-09-19T15:31:56.757738+0000","last_active":"2024-09-19T15:31:56.757738+0000","last_peered":"2024-09-19T15:31:56.757738+0000","last_clean":"2024-09-19T15:31:56.757738+0000","last_became_active":"2024-09-19T13:40:34.228472+0000","last_became_peered":"2024-09-19T13:40:34.228472+0000","last_unstale":"2024-09-19T15:31:56.757738+0000","last_undegraded":"2024-09-19T15:31:56.757738+0000","last_fullsized":"2024-09-19T15:31:56.757738+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'349","last_scrub_stamp":"2024-09-19T15:31:56.757523+0000","last_deep_scrub":"268'349","last_deep_scrub_stamp":"2024-09-19T15:31:56.757523+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.757523+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:45.800606+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1120,"num_read_kb":37188,"num_write":1213,"num_write_kb":31649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'801","reported_seq":2509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.491208+0000","last_change":"2024-09-19T15:32:02.491208+0000","last_active":"2024-09-19T15:32:02.491208+0000","last_peered":"2024-09-19T15:32:02.491208+0000","last_clean":"2024-09-19T15:32:02.491208+0000","last_became_active":"2024-09-19T13:40:36.217870+0000","last_became_peered":"2024-09-19T13:40:36.217870+0000","last_unstale":"2024-09-19T15:32:02.491208+0000","last_undegraded":"2024-09-19T15:32:02.491208+0000","last_fullsized":"2024-09-19T15:32:02.491208+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'801","last_scrub_stamp":"2024-09-19T15:32:02.491031+0000","last_deep_scrub":"268'801","last_deep_scrub_stamp":"2024-09-19T15:32:02.491031+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.491031+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:55.926935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3954,"num_read_kb":3588,"num_write":1044,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'308","reported_seq":1008,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.871956+0000","last_change":"2024-09-19T15:31:49.871956+0000","last_active":"2024-09-19T15:31:49.871956+0000","last_peered":"2024-09-19T15:31:49.871956+0000","last_clean":"2024-09-19T15:31:49.871956+0000","last_became_active":"2024-09-19T13:41:05.310802+0000","last_became_peered":"2024-09-19T13:41:05.310802+0000","last_unstale":"2024-09-19T15:31:49.871956+0000","last_undegraded":"2024-09-19T15:31:49.871956+0000","last_fullsized":"2024-09-19T15:31:49.871956+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'308","last_scrub_stamp":"2024-09-19T15:31:49.871682+0000","last_deep_scrub":"268'308","last_deep_scrub_stamp":"2024-09-19T15:31:49.871682+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.871682+0000","objects_scrubbed":10,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:31:02.847445+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136937,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":757,"num_read_kb":21770,"num_write":969,"num_write_kb":19448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"268'361","reported_seq":1968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.789067+0000","last_change":"2024-09-19T15:31:52.789067+0000","last_active":"2024-09-19T15:31:52.789067+0000","last_peered":"2024-09-19T15:31:52.789067+0000","last_clean":"2024-09-19T15:31:52.789067+0000","last_became_active":"2024-09-19T13:40:36.215821+0000","last_became_peered":"2024-09-19T13:40:36.215821+0000","last_unstale":"2024-09-19T15:31:52.789067+0000","last_undegraded":"2024-09-19T15:31:52.789067+0000","last_fullsized":"2024-09-19T15:31:52.789067+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'361","last_scrub_stamp":"2024-09-19T15:31:52.788781+0000","last_deep_scrub":"268'361","last_deep_scrub_stamp":"2024-09-19T15:31:52.788781+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.788781+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:07.602774+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2112,"num_read_kb":2049,"num_write":394,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'450","reported_seq":1193,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.772885+0000","last_change":"2024-09-19T15:31:55.772885+0000","last_active":"2024-09-19T15:31:55.772885+0000","last_peered":"2024-09-19T15:31:55.772885+0000","last_clean":"2024-09-19T15:31:55.772885+0000","last_became_active":"2024-09-19T13:40:34.261812+0000","last_became_peered":"2024-09-19T13:40:34.261812+0000","last_unstale":"2024-09-19T15:31:55.772885+0000","last_undegraded":"2024-09-19T15:31:55.772885+0000","last_fullsized":"2024-09-19T15:31:55.772885+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'450","last_scrub_stamp":"2024-09-19T15:31:55.772408+0000","last_deep_scrub":"268'450","last_deep_scrub_stamp":"2024-09-19T15:31:55.772408+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.772408+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:27:33.627722+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136844,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":935,"num_read_kb":21060,"num_write":1238,"num_write_kb":41159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'747","reported_seq":2340,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.528088+0000","last_change":"2024-09-19T15:32:01.528088+0000","last_active":"2024-09-19T15:32:01.528088+0000","last_peered":"2024-09-19T15:32:01.528088+0000","last_clean":"2024-09-19T15:32:01.528088+0000","last_became_active":"2024-09-19T13:40:36.216597+0000","last_became_peered":"2024-09-19T13:40:36.216597+0000","last_unstale":"2024-09-19T15:32:01.528088+0000","last_undegraded":"2024-09-19T15:32:01.528088+0000","last_fullsized":"2024-09-19T15:32:01.528088+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'747","last_scrub_stamp":"2024-09-19T15:32:01.527862+0000","last_deep_scrub":"268'747","last_deep_scrub_stamp":"2024-09-19T15:32:01.527862+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.527862+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:58.511021+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3535,"num_read_kb":3206,"num_write":942,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'389","reported_seq":1104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.688371+0000","last_change":"2024-09-19T15:31:50.688371+0000","last_active":"2024-09-19T15:31:50.688371+0000","last_peered":"2024-09-19T15:31:50.688371+0000","last_clean":"2024-09-19T15:31:50.688371+0000","last_became_active":"2024-09-19T13:40:34.255374+0000","last_became_peered":"2024-09-19T13:40:34.255374+0000","last_unstale":"2024-09-19T15:31:50.688371+0000","last_undegraded":"2024-09-19T15:31:50.688371+0000","last_fullsized":"2024-09-19T15:31:50.688371+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'389","last_scrub_stamp":"2024-09-19T15:31:50.688138+0000","last_deep_scrub":"268'389","last_deep_scrub_stamp":"2024-09-19T15:31:50.688138+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.688138+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:59:16.557745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":672,"num_read_kb":82615,"num_write":1215,"num_write_kb":54973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'1055","reported_seq":2699,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.729121+0000","last_change":"2024-09-19T15:32:02.729121+0000","last_active":"2024-09-19T15:32:02.729121+0000","last_peered":"2024-09-19T15:32:02.729121+0000","last_clean":"2024-09-19T15:32:02.729121+0000","last_became_active":"2024-09-19T13:40:36.238907+0000","last_became_peered":"2024-09-19T13:40:36.238907+0000","last_unstale":"2024-09-19T15:32:02.729121+0000","last_undegraded":"2024-09-19T15:32:02.729121+0000","last_fullsized":"2024-09-19T15:32:02.729121+0000","mapping_epoch":27,"log_start":"268'1000","ondisk_log_start":"268'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1055","last_scrub_stamp":"2024-09-19T15:32:02.728906+0000","last_deep_scrub":"268'1055","last_deep_scrub_stamp":"2024-09-19T15:32:02.728906+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.728906+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1000,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:49:49.972281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5049,"num_read_kb":4427,"num_write":1568,"num_write_kb":756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'420","reported_seq":1105,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.888307+0000","last_change":"2024-09-19T15:31:48.888307+0000","last_active":"2024-09-19T15:31:48.888307+0000","last_peered":"2024-09-19T15:31:48.888307+0000","last_clean":"2024-09-19T15:31:48.888307+0000","last_became_active":"2024-09-19T13:40:34.272618+0000","last_became_peered":"2024-09-19T13:40:34.272618+0000","last_unstale":"2024-09-19T15:31:48.888307+0000","last_undegraded":"2024-09-19T15:31:48.888307+0000","last_fullsized":"2024-09-19T15:31:48.888307+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'420","last_scrub_stamp":"2024-09-19T15:31:48.888059+0000","last_deep_scrub":"268'420","last_deep_scrub_stamp":"2024-09-19T15:31:48.888059+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.888059+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:42:39.951922+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":788,"num_read_kb":25154,"num_write":1353,"num_write_kb":33238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'504","reported_seq":2201,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.714567+0000","last_change":"2024-09-19T15:31:59.714567+0000","last_active":"2024-09-19T15:31:59.714567+0000","last_peered":"2024-09-19T15:31:59.714567+0000","last_clean":"2024-09-19T15:31:59.714567+0000","last_became_active":"2024-09-19T13:40:36.226572+0000","last_became_peered":"2024-09-19T13:40:36.226572+0000","last_unstale":"2024-09-19T15:31:59.714567+0000","last_undegraded":"2024-09-19T15:31:59.714567+0000","last_fullsized":"2024-09-19T15:31:59.714567+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'504","last_scrub_stamp":"2024-09-19T15:31:59.714369+0000","last_deep_scrub":"268'504","last_deep_scrub_stamp":"2024-09-19T15:31:59.714369+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.714369+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:23:18.997611+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2633,"num_read_kb":2478,"num_write":570,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'448","reported_seq":1211,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.710466+0000","last_change":"2024-09-19T15:31:55.710466+0000","last_active":"2024-09-19T15:31:55.710466+0000","last_peered":"2024-09-19T15:31:55.710466+0000","last_clean":"2024-09-19T15:31:55.710466+0000","last_became_active":"2024-09-19T13:40:34.274523+0000","last_became_peered":"2024-09-19T13:40:34.274523+0000","last_unstale":"2024-09-19T15:31:55.710466+0000","last_undegraded":"2024-09-19T15:31:55.710466+0000","last_fullsized":"2024-09-19T15:31:55.710466+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'448","last_scrub_stamp":"2024-09-19T15:31:55.710272+0000","last_deep_scrub":"268'448","last_deep_scrub_stamp":"2024-09-19T15:31:55.710272+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.710272+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:32:09.787284+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":885,"num_read_kb":117461,"num_write":1361,"num_write_kb":54900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"268'910","reported_seq":2419,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.053655+0000","last_change":"2024-09-19T15:32:06.053655+0000","last_active":"2024-09-19T15:32:06.053655+0000","last_peered":"2024-09-19T15:32:06.053655+0000","last_clean":"2024-09-19T15:32:06.053655+0000","last_became_active":"2024-09-19T13:40:36.219017+0000","last_became_peered":"2024-09-19T13:40:36.219017+0000","last_unstale":"2024-09-19T15:32:06.053655+0000","last_undegraded":"2024-09-19T15:32:06.053655+0000","last_fullsized":"2024-09-19T15:32:06.053655+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'910","last_scrub_stamp":"2024-09-19T15:32:06.053447+0000","last_deep_scrub":"268'910","last_deep_scrub_stamp":"2024-09-19T15:32:06.053447+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.053447+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":800,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:14.042097+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5981,"num_read_kb":5463,"num_write":1432,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'347","reported_seq":1032,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.834495+0000","last_change":"2024-09-19T15:31:53.834495+0000","last_active":"2024-09-19T15:31:53.834495+0000","last_peered":"2024-09-19T15:31:53.834495+0000","last_clean":"2024-09-19T15:31:53.834495+0000","last_became_active":"2024-09-19T13:40:34.258251+0000","last_became_peered":"2024-09-19T13:40:34.258251+0000","last_unstale":"2024-09-19T15:31:53.834495+0000","last_undegraded":"2024-09-19T15:31:53.834495+0000","last_fullsized":"2024-09-19T15:31:53.834495+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'347","last_scrub_stamp":"2024-09-19T15:31:53.834285+0000","last_deep_scrub":"268'347","last_deep_scrub_stamp":"2024-09-19T15:31:53.834285+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.834285+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:28:52.290958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":664,"num_read_kb":8565,"num_write":1177,"num_write_kb":30274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'822","reported_seq":2525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.703943+0000","last_change":"2024-09-19T15:32:01.703943+0000","last_active":"2024-09-19T15:32:01.703943+0000","last_peered":"2024-09-19T15:32:01.703943+0000","last_clean":"2024-09-19T15:32:01.703943+0000","last_became_active":"2024-09-19T13:40:36.234463+0000","last_became_peered":"2024-09-19T13:40:36.234463+0000","last_unstale":"2024-09-19T15:32:01.703943+0000","last_undegraded":"2024-09-19T15:32:01.703943+0000","last_fullsized":"2024-09-19T15:32:01.703943+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'822","last_scrub_stamp":"2024-09-19T15:32:01.703761+0000","last_deep_scrub":"268'822","last_deep_scrub_stamp":"2024-09-19T15:32:01.703761+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.703761+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:30:12.604793+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4113,"num_read_kb":3717,"num_write":1084,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2509,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'332","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.789415+0000","last_change":"2024-09-19T15:31:57.789415+0000","last_active":"2024-09-19T15:31:57.789415+0000","last_peered":"2024-09-19T15:31:57.789415+0000","last_clean":"2024-09-19T15:31:57.789415+0000","last_became_active":"2024-09-19T13:40:34.257895+0000","last_became_peered":"2024-09-19T13:40:34.257895+0000","last_unstale":"2024-09-19T15:31:57.789415+0000","last_undegraded":"2024-09-19T15:31:57.789415+0000","last_fullsized":"2024-09-19T15:31:57.789415+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'332","last_scrub_stamp":"2024-09-19T15:31:57.789227+0000","last_deep_scrub":"268'332","last_deep_scrub_stamp":"2024-09-19T15:31:57.789227+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.789227+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:08:45.295282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":616,"num_read_kb":2702,"num_write":1090,"num_write_kb":37833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'365","reported_seq":1065,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.835074+0000","last_change":"2024-09-19T15:31:58.835074+0000","last_active":"2024-09-19T15:31:58.835074+0000","last_peered":"2024-09-19T15:31:58.835074+0000","last_clean":"2024-09-19T15:31:58.835074+0000","last_became_active":"2024-09-19T13:41:05.313139+0000","last_became_peered":"2024-09-19T13:41:05.313139+0000","last_unstale":"2024-09-19T15:31:58.835074+0000","last_undegraded":"2024-09-19T15:31:58.835074+0000","last_fullsized":"2024-09-19T15:31:58.835074+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'365","last_scrub_stamp":"2024-09-19T15:31:58.834854+0000","last_deep_scrub":"268'365","last_deep_scrub_stamp":"2024-09-19T15:31:58.834854+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.834854+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:08.987958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":636,"num_read_kb":5598,"num_write":1148,"num_write_kb":52319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'585","reported_seq":2295,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.715259+0000","last_change":"2024-09-19T15:32:01.715002+0000","last_active":"2024-09-19T15:32:01.715259+0000","last_peered":"2024-09-19T15:32:01.715259+0000","last_clean":"2024-09-19T15:32:01.715259+0000","last_became_active":"2024-09-19T13:40:36.225131+0000","last_became_peered":"2024-09-19T13:40:36.225131+0000","last_unstale":"2024-09-19T15:32:01.715259+0000","last_undegraded":"2024-09-19T15:32:01.715259+0000","last_fullsized":"2024-09-19T15:32:01.715259+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'585","last_scrub_stamp":"2024-09-19T15:32:01.714790+0000","last_deep_scrub":"268'585","last_deep_scrub_stamp":"2024-09-19T15:32:01.714790+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.714790+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":500,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:56.655110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3409,"num_read_kb":3161,"num_write":806,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'423","reported_seq":1193,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.619026+0000","last_change":"2024-09-19T15:31:55.619026+0000","last_active":"2024-09-19T15:31:55.619026+0000","last_peered":"2024-09-19T15:31:55.619026+0000","last_clean":"2024-09-19T15:31:55.619026+0000","last_became_active":"2024-09-19T13:40:34.252585+0000","last_became_peered":"2024-09-19T13:40:34.252585+0000","last_unstale":"2024-09-19T15:31:55.619026+0000","last_undegraded":"2024-09-19T15:31:55.619026+0000","last_fullsized":"2024-09-19T15:31:55.619026+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'423","last_scrub_stamp":"2024-09-19T15:31:55.618823+0000","last_deep_scrub":"268'423","last_deep_scrub_stamp":"2024-09-19T15:31:55.618823+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.618823+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:57.280079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1089,"num_read_kb":22295,"num_write":1244,"num_write_kb":33627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'496","reported_seq":2111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.795339+0000","last_change":"2024-09-19T15:32:06.795339+0000","last_active":"2024-09-19T15:32:06.795339+0000","last_peered":"2024-09-19T15:32:06.795339+0000","last_clean":"2024-09-19T15:32:06.795339+0000","last_became_active":"2024-09-19T13:40:36.232695+0000","last_became_peered":"2024-09-19T13:40:36.232695+0000","last_unstale":"2024-09-19T15:32:06.795339+0000","last_undegraded":"2024-09-19T15:32:06.795339+0000","last_fullsized":"2024-09-19T15:32:06.795339+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'496","last_scrub_stamp":"2024-09-19T15:32:06.795165+0000","last_deep_scrub":"268'496","last_deep_scrub_stamp":"2024-09-19T15:32:06.795165+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.795165+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:10:31.458475+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2752,"num_read_kb":2570,"num_write":600,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":963,"num_omap_keys":4,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10865,"num_read_kb":9021,"num_write":3118,"num_write_kb":1011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1008,"ondisk_log_size":1008,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14601,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":16485,"num_read_kb":16147,"num_write":17047,"num_write_kb":4982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2448,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":29202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1875,"ondisk_log_size":1875,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":601,"ondisk_log_size":601,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1631422,"num_objects":200,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":21072,"num_read_kb":40733,"num_write":17629,"num_write_kb":12600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":704656,"num_omap_keys":1634,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1956,"ondisk_log_size":1956,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2392,"num_read_kb":2851,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":220859,"num_read_kb":201873,"num_write":56069,"num_write_kb":19197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35455,"num_omap_keys":143,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4151,"ondisk_log_size":4151,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":23942209,"num_objects":277,"num_object_clones":0,"num_object_copies":831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":0,"num_read":44439,"num_read_kb":2347980,"num_write":73000,"num_write_kb":2178675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37318656,"data_stored":37318656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3768,"ondisk_log_size":3768,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":215739,"num_write":161,"num_write_kb":136883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":195259,"num_write":161,"num_write_kb":136883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543500,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296384,"kb_used_data":8368,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94075456,"statfs":{"total":96636764160,"available":96333266944,"internally_reserved":0,"allocated":8568832,"data_stored":6565575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":294910410},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543495,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250764,"kb_used_data":7164,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94121076,"statfs":{"total":96636764160,"available":96379981824,"internally_reserved":0,"allocated":7335936,"data_stored":5380296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":249428422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543498,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149372,"kb_used_data":9964,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94222468,"statfs":{"total":96636764160,"available":96483807232,"internally_reserved":0,"allocated":10203136,"data_stored":8155658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543495,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":115784,"kb_used_data":8248,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94256056,"statfs":{"total":96636764160,"available":96518201344,"internally_reserved":0,"allocated":8445952,"data_stored":6509947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543500,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296544,"kb_used_data":12688,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94075296,"statfs":{"total":96636764160,"available":96333103104,"internally_reserved":0,"allocated":12992512,"data_stored":10993023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":290650567},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543498,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92420,"kb_used_data":7092,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94279420,"statfs":{"total":96636764160,"available":96542126080,"internally_reserved":0,"allocated":7262208,"data_stored":5318104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543496,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":192588,"kb_used_data":8764,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94179252,"statfs":{"total":96636764160,"available":96439554048,"internally_reserved":0,"allocated":8974336,"data_stored":6990912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543496,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":282964,"kb_used_data":8836,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94088876,"statfs":{"total":96636764160,"available":96347009024,"internally_reserved":0,"allocated":9048064,"data_stored":7057331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":280689095},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4157440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4681728,"data_stored":4681728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3010560,"data_stored":3010560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8683520,"data_stored":8683520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4202496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5844992,"data_stored":5844992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3072000,"data_stored":3072000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3665920,"data_stored":3665920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T15:32:29.233 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.233 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.233 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.233 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.233 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.234 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.234 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.234 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.234 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.234 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.234 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.234 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.234 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.235 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.235 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.235 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.235 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.235 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.235 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.235 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.235 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.236 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.236 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.236 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.236 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.236 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.236 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.236 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.237 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.237 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.237 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.237 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.237 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.237 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.237 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.238 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.238 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.238 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.238 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.238 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.238 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.238 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.238 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.238 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.239 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.239 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.239 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.239 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.239 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.239 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.239 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.240 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.240 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.240 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.240 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.240 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.240 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-19T13:56:22.119877+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=56, tm_sec=22, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.240 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.240 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.241 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.241 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.241 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.241 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.241 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.241 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.241 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.242 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.242 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.242 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.242 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.242 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-19T14:02:28.688896+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=28, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.242 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.242 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.243 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-19T14:02:35.861753+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=2, tm_sec=35, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.245 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-19T13:40:43.210858+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=13, tm_min=40, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:29.246 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-19T15:32:49.247 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T15:32:49.611 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:32:49.631 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-19T15:32:49.642 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":3637,"stamp":"2024-09-19T15:32:48.686561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26180412,"num_objects":726,"num_object_clones":0,"num_object_copies":1729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":726,"num_whiteouts":0,"num_read":316475,"num_read_kb":3029670,"num_write":167328,"num_write_kb":2491887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":743499,"num_omap_keys":1802,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13670,"ondisk_log_size":13670,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1676820,"kb_used_data":71124,"kb_used_omap":12,"kb_used_meta":1605555,"kb_avail":753297900,"statfs":{"total":773094113280,"available":771377049600,"internally_reserved":0,"allocated":72830976,"data_stored":56970846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1644088882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":564,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007873"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:35.699526+0000","last_change":"2024-09-19T15:32:35.699526+0000","last_active":"2024-09-19T15:32:35.699526+0000","last_peered":"2024-09-19T15:32:35.699526+0000","last_clean":"2024-09-19T15:32:35.699526+0000","last_became_active":"2024-09-19T14:29:51.036952+0000","last_became_peered":"2024-09-19T14:29:51.036952+0000","last_unstale":"2024-09-19T15:32:35.699526+0000","last_undegraded":"2024-09-19T15:32:35.699526+0000","last_fullsized":"2024-09-19T15:32:35.699526+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:35.699348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:35.699348+0000","last_clean_scrub_stamp":"2024-09-19T15:32:35.699348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:53:11.007787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:33.713803+0000","last_change":"2024-09-19T15:32:33.713677+0000","last_active":"2024-09-19T15:32:33.713803+0000","last_peered":"2024-09-19T15:32:33.713803+0000","last_clean":"2024-09-19T15:32:33.713803+0000","last_became_active":"2024-09-19T14:02:36.912307+0000","last_became_peered":"2024-09-19T14:02:36.912307+0000","last_unstale":"2024-09-19T15:32:33.713803+0000","last_undegraded":"2024-09-19T15:32:33.713803+0000","last_fullsized":"2024-09-19T15:32:33.713803+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:33.713492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:33.713492+0000","last_clean_scrub_stamp":"2024-09-19T15:32:33.713492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:48:13.623014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"268'11","reported_seq":92,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:36.123124+0000","last_change":"2024-09-19T15:32:36.123124+0000","last_active":"2024-09-19T15:32:36.123124+0000","last_peered":"2024-09-19T15:32:36.123124+0000","last_clean":"2024-09-19T15:32:36.123124+0000","last_became_active":"2024-09-19T14:02:29.739721+0000","last_became_peered":"2024-09-19T14:02:29.739721+0000","last_unstale":"2024-09-19T15:32:36.123124+0000","last_undegraded":"2024-09-19T15:32:36.123124+0000","last_fullsized":"2024-09-19T15:32:36.123124+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'11","last_scrub_stamp":"2024-09-19T15:32:36.122935+0000","last_deep_scrub":"268'11","last_deep_scrub_stamp":"2024-09-19T15:32:36.122935+0000","last_clean_scrub_stamp":"2024-09-19T15:32:36.122935+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:52:52.708932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":13312,"num_write":21,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'35","reported_seq":177,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:29.488608+0000","last_change":"2024-09-19T15:32:29.488608+0000","last_active":"2024-09-19T15:32:29.488608+0000","last_peered":"2024-09-19T15:32:29.488608+0000","last_clean":"2024-09-19T15:32:29.488608+0000","last_became_active":"2024-09-19T13:56:23.180176+0000","last_became_peered":"2024-09-19T13:56:23.180176+0000","last_unstale":"2024-09-19T15:32:29.488608+0000","last_undegraded":"2024-09-19T15:32:29.488608+0000","last_fullsized":"2024-09-19T15:32:29.488608+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'35","last_scrub_stamp":"2024-09-19T15:32:29.488421+0000","last_deep_scrub":"268'35","last_deep_scrub_stamp":"2024-09-19T15:32:29.488421+0000","last_clean_scrub_stamp":"2024-09-19T15:32:29.488421+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:18:29.961954+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":165,"num_write":94,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:17.100705+0000","last_change":"2024-09-19T15:32:17.100562+0000","last_active":"2024-09-19T15:32:17.100705+0000","last_peered":"2024-09-19T15:32:17.100705+0000","last_clean":"2024-09-19T15:32:17.100705+0000","last_became_active":"2024-09-19T14:29:51.038289+0000","last_became_peered":"2024-09-19T14:29:51.038289+0000","last_unstale":"2024-09-19T15:32:17.100705+0000","last_undegraded":"2024-09-19T15:32:17.100705+0000","last_fullsized":"2024-09-19T15:32:17.100705+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:17.100380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:17.100380+0000","last_clean_scrub_stamp":"2024-09-19T15:32:17.100380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:36.465601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'2","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:34.585173+0000","last_change":"2024-09-19T15:32:34.584988+0000","last_active":"2024-09-19T15:32:34.585173+0000","last_peered":"2024-09-19T15:32:34.585173+0000","last_clean":"2024-09-19T15:32:34.585173+0000","last_became_active":"2024-09-19T14:02:36.914769+0000","last_became_peered":"2024-09-19T14:02:36.914769+0000","last_unstale":"2024-09-19T15:32:34.585173+0000","last_undegraded":"2024-09-19T15:32:34.585173+0000","last_fullsized":"2024-09-19T15:32:34.585173+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:34.584801+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:34.584801+0000","last_clean_scrub_stamp":"2024-09-19T15:32:34.584801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:20:22.201440+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"268'6","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:20.710350+0000","last_change":"2024-09-19T15:32:20.710105+0000","last_active":"2024-09-19T15:32:20.710350+0000","last_peered":"2024-09-19T15:32:20.710350+0000","last_clean":"2024-09-19T15:32:20.710350+0000","last_became_active":"2024-09-19T14:02:29.747492+0000","last_became_peered":"2024-09-19T14:02:29.747492+0000","last_unstale":"2024-09-19T15:32:20.710350+0000","last_undegraded":"2024-09-19T15:32:20.710350+0000","last_fullsized":"2024-09-19T15:32:20.710350+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-19T15:32:20.709867+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-19T15:32:20.709867+0000","last_clean_scrub_stamp":"2024-09-19T15:32:20.709867+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:29:53.880609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'26","reported_seq":162,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.946853+0000","last_change":"2024-09-19T15:32:08.946687+0000","last_active":"2024-09-19T15:32:08.946853+0000","last_peered":"2024-09-19T15:32:08.946853+0000","last_clean":"2024-09-19T15:32:08.946853+0000","last_became_active":"2024-09-19T13:56:23.173377+0000","last_became_peered":"2024-09-19T13:56:23.173377+0000","last_unstale":"2024-09-19T15:32:08.946853+0000","last_undegraded":"2024-09-19T15:32:08.946853+0000","last_fullsized":"2024-09-19T15:32:08.946853+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-09-19T15:32:08.946505+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-09-19T15:32:08.946505+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.946505+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:48.722723+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":124,"num_write":71,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:24.231905+0000","last_change":"2024-09-19T15:32:24.231760+0000","last_active":"2024-09-19T15:32:24.231905+0000","last_peered":"2024-09-19T15:32:24.231905+0000","last_clean":"2024-09-19T15:32:24.231905+0000","last_became_active":"2024-09-19T14:29:51.039043+0000","last_became_peered":"2024-09-19T14:29:51.039043+0000","last_unstale":"2024-09-19T15:32:24.231905+0000","last_undegraded":"2024-09-19T15:32:24.231905+0000","last_fullsized":"2024-09-19T15:32:24.231905+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:24.231568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:24.231568+0000","last_clean_scrub_stamp":"2024-09-19T15:32:24.231568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:48:11.358259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"268'3","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:39.533334+0000","last_change":"2024-09-19T15:32:39.533334+0000","last_active":"2024-09-19T15:32:39.533334+0000","last_peered":"2024-09-19T15:32:39.533334+0000","last_clean":"2024-09-19T15:32:39.533334+0000","last_became_active":"2024-09-19T14:02:37.051665+0000","last_became_peered":"2024-09-19T14:02:37.051665+0000","last_unstale":"2024-09-19T15:32:39.533334+0000","last_undegraded":"2024-09-19T15:32:39.533334+0000","last_fullsized":"2024-09-19T15:32:39.533334+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:39.533156+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:39.533156+0000","last_clean_scrub_stamp":"2024-09-19T15:32:39.533156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:44.640857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":81,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:13.026322+0000","last_change":"2024-09-19T15:32:13.026322+0000","last_active":"2024-09-19T15:32:13.026322+0000","last_peered":"2024-09-19T15:32:13.026322+0000","last_clean":"2024-09-19T15:32:13.026322+0000","last_became_active":"2024-09-19T14:02:29.724866+0000","last_became_peered":"2024-09-19T14:02:29.724866+0000","last_unstale":"2024-09-19T15:32:13.026322+0000","last_undegraded":"2024-09-19T15:32:13.026322+0000","last_fullsized":"2024-09-19T15:32:13.026322+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:13.026035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:13.026035+0000","last_clean_scrub_stamp":"2024-09-19T15:32:13.026035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:47:17.974515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'36","reported_seq":177,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:27.473468+0000","last_change":"2024-09-19T15:32:27.473468+0000","last_active":"2024-09-19T15:32:27.473468+0000","last_peered":"2024-09-19T15:32:27.473468+0000","last_clean":"2024-09-19T15:32:27.473468+0000","last_became_active":"2024-09-19T13:56:23.180159+0000","last_became_peered":"2024-09-19T13:56:23.180159+0000","last_unstale":"2024-09-19T15:32:27.473468+0000","last_undegraded":"2024-09-19T15:32:27.473468+0000","last_fullsized":"2024-09-19T15:32:27.473468+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'36","last_scrub_stamp":"2024-09-19T15:32:27.473280+0000","last_deep_scrub":"268'36","last_deep_scrub_stamp":"2024-09-19T15:32:27.473280+0000","last_clean_scrub_stamp":"2024-09-19T15:32:27.473280+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:11:38.100859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":283,"num_read_kb":171,"num_write":89,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:28:03.230461+0000","last_change":"2024-09-19T14:29:51.030209+0000","last_active":"2024-09-19T15:28:03.230461+0000","last_peered":"2024-09-19T15:28:03.230461+0000","last_clean":"2024-09-19T15:28:03.230461+0000","last_became_active":"2024-09-19T14:29:51.029426+0000","last_became_peered":"2024-09-19T14:29:51.029426+0000","last_unstale":"2024-09-19T15:28:03.230461+0000","last_undegraded":"2024-09-19T15:28:03.230461+0000","last_fullsized":"2024-09-19T15:28:03.230461+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:42:56.183067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"268'3","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:43.121503+0000","last_change":"2024-09-19T15:32:43.121503+0000","last_active":"2024-09-19T15:32:43.121503+0000","last_peered":"2024-09-19T15:32:43.121503+0000","last_clean":"2024-09-19T15:32:43.121503+0000","last_became_active":"2024-09-19T14:02:37.052510+0000","last_became_peered":"2024-09-19T14:02:37.052510+0000","last_unstale":"2024-09-19T15:32:43.121503+0000","last_undegraded":"2024-09-19T15:32:43.121503+0000","last_fullsized":"2024-09-19T15:32:43.121503+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:43.121311+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:43.121311+0000","last_clean_scrub_stamp":"2024-09-19T15:32:43.121311+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:08:29.062586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:31.617464+0000","last_change":"2024-09-19T15:32:31.617464+0000","last_active":"2024-09-19T15:32:31.617464+0000","last_peered":"2024-09-19T15:32:31.617464+0000","last_clean":"2024-09-19T15:32:31.617464+0000","last_became_active":"2024-09-19T14:02:29.736074+0000","last_became_peered":"2024-09-19T14:02:29.736074+0000","last_unstale":"2024-09-19T15:32:31.617464+0000","last_undegraded":"2024-09-19T15:32:31.617464+0000","last_fullsized":"2024-09-19T15:32:31.617464+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:31.617280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:31.617280+0000","last_clean_scrub_stamp":"2024-09-19T15:32:31.617280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:22.537882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'63","reported_seq":252,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:34.062230+0000","last_change":"2024-09-19T15:32:34.062230+0000","last_active":"2024-09-19T15:32:34.062230+0000","last_peered":"2024-09-19T15:32:34.062230+0000","last_clean":"2024-09-19T15:32:34.062230+0000","last_became_active":"2024-09-19T13:56:23.179235+0000","last_became_peered":"2024-09-19T13:56:23.179235+0000","last_unstale":"2024-09-19T15:32:34.062230+0000","last_undegraded":"2024-09-19T15:32:34.062230+0000","last_fullsized":"2024-09-19T15:32:34.062230+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'63","last_scrub_stamp":"2024-09-19T15:32:34.062044+0000","last_deep_scrub":"268'63","last_deep_scrub_stamp":"2024-09-19T15:32:34.062044+0000","last_clean_scrub_stamp":"2024-09-19T15:32:34.062044+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:45.886522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":508,"num_read_kb":362,"num_write":155,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:03.258946+0000","last_change":"2024-09-19T14:29:51.053238+0000","last_active":"2024-09-19T15:30:03.258946+0000","last_peered":"2024-09-19T15:30:03.258946+0000","last_clean":"2024-09-19T15:30:03.258946+0000","last_became_active":"2024-09-19T14:29:51.052562+0000","last_became_peered":"2024-09-19T14:29:51.052562+0000","last_unstale":"2024-09-19T15:30:03.258946+0000","last_undegraded":"2024-09-19T15:30:03.258946+0000","last_fullsized":"2024-09-19T15:30:03.258946+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"268'9","reported_seq":81,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:31.702673+0000","last_change":"2024-09-19T15:32:31.702673+0000","last_active":"2024-09-19T15:32:31.702673+0000","last_peered":"2024-09-19T15:32:31.702673+0000","last_clean":"2024-09-19T15:32:31.702673+0000","last_became_active":"2024-09-19T14:02:36.930344+0000","last_became_peered":"2024-09-19T14:02:36.930344+0000","last_unstale":"2024-09-19T15:32:31.702673+0000","last_undegraded":"2024-09-19T15:32:31.702673+0000","last_fullsized":"2024-09-19T15:32:31.702673+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'9","last_scrub_stamp":"2024-09-19T15:32:31.702490+0000","last_deep_scrub":"268'9","last_deep_scrub_stamp":"2024-09-19T15:32:31.702490+0000","last_clean_scrub_stamp":"2024-09-19T15:32:31.702490+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:53:04.502723+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":19,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'8","reported_seq":94,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:33.530153+0000","last_change":"2024-09-19T15:32:33.530153+0000","last_active":"2024-09-19T15:32:33.530153+0000","last_peered":"2024-09-19T15:32:33.530153+0000","last_clean":"2024-09-19T15:32:33.530153+0000","last_became_active":"2024-09-19T14:02:29.740291+0000","last_became_peered":"2024-09-19T14:02:29.740291+0000","last_unstale":"2024-09-19T15:32:33.530153+0000","last_undegraded":"2024-09-19T15:32:33.530153+0000","last_fullsized":"2024-09-19T15:32:33.530153+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-19T15:32:33.529968+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-19T15:32:33.529968+0000","last_clean_scrub_stamp":"2024-09-19T15:32:33.529968+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:15:32.960769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'10","reported_seq":109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:33.092347+0000","last_change":"2024-09-19T15:32:33.092347+0000","last_active":"2024-09-19T15:32:33.092347+0000","last_peered":"2024-09-19T15:32:33.092347+0000","last_clean":"2024-09-19T15:32:33.092347+0000","last_became_active":"2024-09-19T13:56:23.169371+0000","last_became_peered":"2024-09-19T13:56:23.169371+0000","last_unstale":"2024-09-19T15:32:33.092347+0000","last_undegraded":"2024-09-19T15:32:33.092347+0000","last_fullsized":"2024-09-19T15:32:33.092347+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'10","last_scrub_stamp":"2024-09-19T15:32:33.092157+0000","last_deep_scrub":"268'10","last_deep_scrub_stamp":"2024-09-19T15:32:33.092157+0000","last_clean_scrub_stamp":"2024-09-19T15:32:33.092157+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:42.468925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":43,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:27.746400+0000","last_change":"2024-09-19T15:32:27.746400+0000","last_active":"2024-09-19T15:32:27.746400+0000","last_peered":"2024-09-19T15:32:27.746400+0000","last_clean":"2024-09-19T15:32:27.746400+0000","last_became_active":"2024-09-19T14:29:51.049146+0000","last_became_peered":"2024-09-19T14:29:51.049146+0000","last_unstale":"2024-09-19T15:32:27.746400+0000","last_undegraded":"2024-09-19T15:32:27.746400+0000","last_fullsized":"2024-09-19T15:32:27.746400+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:27.746199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:27.746199+0000","last_clean_scrub_stamp":"2024-09-19T15:32:27.746199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:21:21.517262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:22.256761+0000","last_change":"2024-09-19T15:32:22.256761+0000","last_active":"2024-09-19T15:32:22.256761+0000","last_peered":"2024-09-19T15:32:22.256761+0000","last_clean":"2024-09-19T15:32:22.256761+0000","last_became_active":"2024-09-19T14:02:36.927382+0000","last_became_peered":"2024-09-19T14:02:36.927382+0000","last_unstale":"2024-09-19T15:32:22.256761+0000","last_undegraded":"2024-09-19T15:32:22.256761+0000","last_fullsized":"2024-09-19T15:32:22.256761+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:22.256572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:22.256572+0000","last_clean_scrub_stamp":"2024-09-19T15:32:22.256572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:39:31.563943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"268'2","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:27.549816+0000","last_change":"2024-09-19T15:32:27.549816+0000","last_active":"2024-09-19T15:32:27.549816+0000","last_peered":"2024-09-19T15:32:27.549816+0000","last_clean":"2024-09-19T15:32:27.549816+0000","last_became_active":"2024-09-19T14:02:29.722193+0000","last_became_peered":"2024-09-19T14:02:29.722193+0000","last_unstale":"2024-09-19T15:32:27.549816+0000","last_undegraded":"2024-09-19T15:32:27.549816+0000","last_fullsized":"2024-09-19T15:32:27.549816+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:27.549627+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:27.549627+0000","last_clean_scrub_stamp":"2024-09-19T15:32:27.549627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:17:01.030933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'21","reported_seq":138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:17.229517+0000","last_change":"2024-09-19T15:32:17.229517+0000","last_active":"2024-09-19T15:32:17.229517+0000","last_peered":"2024-09-19T15:32:17.229517+0000","last_clean":"2024-09-19T15:32:17.229517+0000","last_became_active":"2024-09-19T13:56:23.174511+0000","last_became_peered":"2024-09-19T13:56:23.174511+0000","last_unstale":"2024-09-19T15:32:17.229517+0000","last_undegraded":"2024-09-19T15:32:17.229517+0000","last_fullsized":"2024-09-19T15:32:17.229517+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'21","last_scrub_stamp":"2024-09-19T15:32:17.229340+0000","last_deep_scrub":"268'21","last_deep_scrub_stamp":"2024-09-19T15:32:17.229340+0000","last_clean_scrub_stamp":"2024-09-19T15:32:17.229340+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:46.598126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":102,"num_write":56,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'2","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:43.672691+0000","last_change":"2024-09-19T15:32:43.672691+0000","last_active":"2024-09-19T15:32:43.672691+0000","last_peered":"2024-09-19T15:32:43.672691+0000","last_clean":"2024-09-19T15:32:43.672691+0000","last_became_active":"2024-09-19T14:29:51.039919+0000","last_became_peered":"2024-09-19T14:29:51.039919+0000","last_unstale":"2024-09-19T15:32:43.672691+0000","last_undegraded":"2024-09-19T15:32:43.672691+0000","last_fullsized":"2024-09-19T15:32:43.672691+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:43.672499+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:43.672499+0000","last_clean_scrub_stamp":"2024-09-19T15:32:43.672499+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:14:56.522475+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"265'8","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:21.247929+0000","last_change":"2024-09-19T15:32:21.247760+0000","last_active":"2024-09-19T15:32:21.247929+0000","last_peered":"2024-09-19T15:32:21.247929+0000","last_clean":"2024-09-19T15:32:21.247929+0000","last_became_active":"2024-09-19T14:02:36.918707+0000","last_became_peered":"2024-09-19T14:02:36.918707+0000","last_unstale":"2024-09-19T15:32:21.247929+0000","last_undegraded":"2024-09-19T15:32:21.247929+0000","last_fullsized":"2024-09-19T15:32:21.247929+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-19T15:32:21.247546+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-19T15:32:21.247546+0000","last_clean_scrub_stamp":"2024-09-19T15:32:21.247546+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:16:01.540595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9218,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:28.593171+0000","last_change":"2024-09-19T15:32:28.593004+0000","last_active":"2024-09-19T15:32:28.593171+0000","last_peered":"2024-09-19T15:32:28.593171+0000","last_clean":"2024-09-19T15:32:28.593171+0000","last_became_active":"2024-09-19T14:02:29.739955+0000","last_became_peered":"2024-09-19T14:02:29.739955+0000","last_unstale":"2024-09-19T15:32:28.593171+0000","last_undegraded":"2024-09-19T15:32:28.593171+0000","last_fullsized":"2024-09-19T15:32:28.593171+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:28.592827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:28.592827+0000","last_clean_scrub_stamp":"2024-09-19T15:32:28.592827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:55:18.092817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'12","reported_seq":115,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:28.452682+0000","last_change":"2024-09-19T15:32:28.452682+0000","last_active":"2024-09-19T15:32:28.452682+0000","last_peered":"2024-09-19T15:32:28.452682+0000","last_clean":"2024-09-19T15:32:28.452682+0000","last_became_active":"2024-09-19T13:56:23.170272+0000","last_became_peered":"2024-09-19T13:56:23.170272+0000","last_unstale":"2024-09-19T15:32:28.452682+0000","last_undegraded":"2024-09-19T15:32:28.452682+0000","last_fullsized":"2024-09-19T15:32:28.452682+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'12","last_scrub_stamp":"2024-09-19T15:32:28.452475+0000","last_deep_scrub":"268'12","last_deep_scrub_stamp":"2024-09-19T15:32:28.452475+0000","last_clean_scrub_stamp":"2024-09-19T15:32:28.452475+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:08:44.036993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:42.714403+0000","last_change":"2024-09-19T15:32:42.714403+0000","last_active":"2024-09-19T15:32:42.714403+0000","last_peered":"2024-09-19T15:32:42.714403+0000","last_clean":"2024-09-19T15:32:42.714403+0000","last_became_active":"2024-09-19T14:29:51.058380+0000","last_became_peered":"2024-09-19T14:29:51.058380+0000","last_unstale":"2024-09-19T15:32:42.714403+0000","last_undegraded":"2024-09-19T15:32:42.714403+0000","last_fullsized":"2024-09-19T15:32:42.714403+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:42.714174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:42.714174+0000","last_clean_scrub_stamp":"2024-09-19T15:32:42.714174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:14:42.519042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:46.176896+0000","last_change":"2024-09-19T15:32:46.176896+0000","last_active":"2024-09-19T15:32:46.176896+0000","last_peered":"2024-09-19T15:32:46.176896+0000","last_clean":"2024-09-19T15:32:46.176896+0000","last_became_active":"2024-09-19T14:02:36.924268+0000","last_became_peered":"2024-09-19T14:02:36.924268+0000","last_unstale":"2024-09-19T15:32:46.176896+0000","last_undegraded":"2024-09-19T15:32:46.176896+0000","last_fullsized":"2024-09-19T15:32:46.176896+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-19T15:32:46.176695+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-19T15:32:46.176695+0000","last_clean_scrub_stamp":"2024-09-19T15:32:46.176695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:33:40.196264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'3","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:31.522793+0000","last_change":"2024-09-19T15:32:31.522554+0000","last_active":"2024-09-19T15:32:31.522793+0000","last_peered":"2024-09-19T15:32:31.522793+0000","last_clean":"2024-09-19T15:32:31.522793+0000","last_became_active":"2024-09-19T14:02:29.741114+0000","last_became_peered":"2024-09-19T14:02:29.741114+0000","last_unstale":"2024-09-19T15:32:31.522793+0000","last_undegraded":"2024-09-19T15:32:31.522793+0000","last_fullsized":"2024-09-19T15:32:31.522793+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-19T15:32:31.522329+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-19T15:32:31.522329+0000","last_clean_scrub_stamp":"2024-09-19T15:32:31.522329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:17:31.739854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"268'44","reported_seq":200,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:15.627129+0000","last_change":"2024-09-19T15:32:15.627129+0000","last_active":"2024-09-19T15:32:15.627129+0000","last_peered":"2024-09-19T15:32:15.627129+0000","last_clean":"2024-09-19T15:32:15.627129+0000","last_became_active":"2024-09-19T13:56:23.177082+0000","last_became_peered":"2024-09-19T13:56:23.177082+0000","last_unstale":"2024-09-19T15:32:15.627129+0000","last_undegraded":"2024-09-19T15:32:15.627129+0000","last_fullsized":"2024-09-19T15:32:15.627129+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'44","last_scrub_stamp":"2024-09-19T15:32:15.626942+0000","last_deep_scrub":"268'44","last_deep_scrub_stamp":"2024-09-19T15:32:15.626942+0000","last_clean_scrub_stamp":"2024-09-19T15:32:15.626942+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:17:49.667859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":229,"num_write":111,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:28.724578+0000","last_change":"2024-09-19T15:32:28.724578+0000","last_active":"2024-09-19T15:32:28.724578+0000","last_peered":"2024-09-19T15:32:28.724578+0000","last_clean":"2024-09-19T15:32:28.724578+0000","last_became_active":"2024-09-19T14:29:51.036980+0000","last_became_peered":"2024-09-19T14:29:51.036980+0000","last_unstale":"2024-09-19T15:32:28.724578+0000","last_undegraded":"2024-09-19T15:32:28.724578+0000","last_fullsized":"2024-09-19T15:32:28.724578+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:28.724367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:28.724367+0000","last_clean_scrub_stamp":"2024-09-19T15:32:28.724367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:41:10.209734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:44.147359+0000","last_change":"2024-09-19T15:32:44.147359+0000","last_active":"2024-09-19T15:32:44.147359+0000","last_peered":"2024-09-19T15:32:44.147359+0000","last_clean":"2024-09-19T15:32:44.147359+0000","last_became_active":"2024-09-19T14:02:37.051627+0000","last_became_peered":"2024-09-19T14:02:37.051627+0000","last_unstale":"2024-09-19T15:32:44.147359+0000","last_undegraded":"2024-09-19T15:32:44.147359+0000","last_fullsized":"2024-09-19T15:32:44.147359+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:44.147177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:44.147177+0000","last_clean_scrub_stamp":"2024-09-19T15:32:44.147177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:42.489340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'10","reported_seq":95,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:29.676960+0000","last_change":"2024-09-19T15:32:29.676960+0000","last_active":"2024-09-19T15:32:29.676960+0000","last_peered":"2024-09-19T15:32:29.676960+0000","last_clean":"2024-09-19T15:32:29.676960+0000","last_became_active":"2024-09-19T14:02:29.725042+0000","last_became_peered":"2024-09-19T14:02:29.725042+0000","last_unstale":"2024-09-19T15:32:29.676960+0000","last_undegraded":"2024-09-19T15:32:29.676960+0000","last_fullsized":"2024-09-19T15:32:29.676960+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'10","last_scrub_stamp":"2024-09-19T15:32:29.676781+0000","last_deep_scrub":"268'10","last_deep_scrub_stamp":"2024-09-19T15:32:29.676781+0000","last_clean_scrub_stamp":"2024-09-19T15:32:29.676781+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:14.189291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":17453,"num_write":15,"num_write_kb":14381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'39","reported_seq":188,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:26.488438+0000","last_change":"2024-09-19T15:32:26.488438+0000","last_active":"2024-09-19T15:32:26.488438+0000","last_peered":"2024-09-19T15:32:26.488438+0000","last_clean":"2024-09-19T15:32:26.488438+0000","last_became_active":"2024-09-19T13:56:23.179656+0000","last_became_peered":"2024-09-19T13:56:23.179656+0000","last_unstale":"2024-09-19T15:32:26.488438+0000","last_undegraded":"2024-09-19T15:32:26.488438+0000","last_fullsized":"2024-09-19T15:32:26.488438+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'39","last_scrub_stamp":"2024-09-19T15:32:26.488259+0000","last_deep_scrub":"268'39","last_deep_scrub_stamp":"2024-09-19T15:32:26.488259+0000","last_clean_scrub_stamp":"2024-09-19T15:32:26.488259+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:14:34.206551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":202,"num_write":114,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'2","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:15.053751+0000","last_change":"2024-09-19T15:32:15.053751+0000","last_active":"2024-09-19T15:32:15.053751+0000","last_peered":"2024-09-19T15:32:15.053751+0000","last_clean":"2024-09-19T15:32:15.053751+0000","last_became_active":"2024-09-19T14:29:51.034910+0000","last_became_peered":"2024-09-19T14:29:51.034910+0000","last_unstale":"2024-09-19T15:32:15.053751+0000","last_undegraded":"2024-09-19T15:32:15.053751+0000","last_fullsized":"2024-09-19T15:32:15.053751+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:15.053568+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:15.053568+0000","last_clean_scrub_stamp":"2024-09-19T15:32:15.053568+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:48:53.440303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"268'5","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:41.079903+0000","last_change":"2024-09-19T15:32:41.079903+0000","last_active":"2024-09-19T15:32:41.079903+0000","last_peered":"2024-09-19T15:32:41.079903+0000","last_clean":"2024-09-19T15:32:41.079903+0000","last_became_active":"2024-09-19T14:02:37.049593+0000","last_became_peered":"2024-09-19T14:02:37.049593+0000","last_unstale":"2024-09-19T15:32:41.079903+0000","last_undegraded":"2024-09-19T15:32:41.079903+0000","last_fullsized":"2024-09-19T15:32:41.079903+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-19T15:32:41.079685+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-19T15:32:41.079685+0000","last_clean_scrub_stamp":"2024-09-19T15:32:41.079685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:20.351275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":571,"num_write":10,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"268'7","reported_seq":87,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:32.621303+0000","last_change":"2024-09-19T15:32:32.621303+0000","last_active":"2024-09-19T15:32:32.621303+0000","last_peered":"2024-09-19T15:32:32.621303+0000","last_clean":"2024-09-19T15:32:32.621303+0000","last_became_active":"2024-09-19T14:02:29.737689+0000","last_became_peered":"2024-09-19T14:02:29.737689+0000","last_unstale":"2024-09-19T15:32:32.621303+0000","last_undegraded":"2024-09-19T15:32:32.621303+0000","last_fullsized":"2024-09-19T15:32:32.621303+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-19T15:32:32.621124+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-19T15:32:32.621124+0000","last_clean_scrub_stamp":"2024-09-19T15:32:32.621124+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:22:09.947066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5718,"num_write":7,"num_write_kb":5718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'32","reported_seq":167,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:32.053550+0000","last_change":"2024-09-19T15:32:32.053550+0000","last_active":"2024-09-19T15:32:32.053550+0000","last_peered":"2024-09-19T15:32:32.053550+0000","last_clean":"2024-09-19T15:32:32.053550+0000","last_became_active":"2024-09-19T13:56:23.172185+0000","last_became_peered":"2024-09-19T13:56:23.172185+0000","last_unstale":"2024-09-19T15:32:32.053550+0000","last_undegraded":"2024-09-19T15:32:32.053550+0000","last_fullsized":"2024-09-19T15:32:32.053550+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'32","last_scrub_stamp":"2024-09-19T15:32:32.053357+0000","last_deep_scrub":"268'32","last_deep_scrub_stamp":"2024-09-19T15:32:32.053357+0000","last_clean_scrub_stamp":"2024-09-19T15:32:32.053357+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:31:47.424078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":246,"num_read_kb":158,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:41.673897+0000","last_change":"2024-09-19T15:32:41.673897+0000","last_active":"2024-09-19T15:32:41.673897+0000","last_peered":"2024-09-19T15:32:41.673897+0000","last_clean":"2024-09-19T15:32:41.673897+0000","last_became_active":"2024-09-19T14:29:51.039877+0000","last_became_peered":"2024-09-19T14:29:51.039877+0000","last_unstale":"2024-09-19T15:32:41.673897+0000","last_undegraded":"2024-09-19T15:32:41.673897+0000","last_fullsized":"2024-09-19T15:32:41.673897+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:41.673705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:41.673705+0000","last_clean_scrub_stamp":"2024-09-19T15:32:41.673705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:19.210506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"268'11","reported_seq":90,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:42.121299+0000","last_change":"2024-09-19T15:32:42.121299+0000","last_active":"2024-09-19T15:32:42.121299+0000","last_peered":"2024-09-19T15:32:42.121299+0000","last_clean":"2024-09-19T15:32:42.121299+0000","last_became_active":"2024-09-19T14:02:37.055184+0000","last_became_peered":"2024-09-19T14:02:37.055184+0000","last_unstale":"2024-09-19T15:32:42.121299+0000","last_undegraded":"2024-09-19T15:32:42.121299+0000","last_fullsized":"2024-09-19T15:32:42.121299+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'11","last_scrub_stamp":"2024-09-19T15:32:42.121120+0000","last_deep_scrub":"268'11","last_deep_scrub_stamp":"2024-09-19T15:32:42.121120+0000","last_clean_scrub_stamp":"2024-09-19T15:32:42.121120+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:26:53.706311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":24576,"num_write":21,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"268'3","reported_seq":81,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:11.976816+0000","last_change":"2024-09-19T15:32:11.976816+0000","last_active":"2024-09-19T15:32:11.976816+0000","last_peered":"2024-09-19T15:32:11.976816+0000","last_clean":"2024-09-19T15:32:11.976816+0000","last_became_active":"2024-09-19T14:02:29.732063+0000","last_became_peered":"2024-09-19T14:02:29.732063+0000","last_unstale":"2024-09-19T15:32:11.976816+0000","last_undegraded":"2024-09-19T15:32:11.976816+0000","last_fullsized":"2024-09-19T15:32:11.976816+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:11.976624+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:11.976624+0000","last_clean_scrub_stamp":"2024-09-19T15:32:11.976624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:43:10.588819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'18","reported_seq":130,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.967647+0000","last_change":"2024-09-19T15:32:07.967647+0000","last_active":"2024-09-19T15:32:07.967647+0000","last_peered":"2024-09-19T15:32:07.967647+0000","last_clean":"2024-09-19T15:32:07.967647+0000","last_became_active":"2024-09-19T13:56:23.172998+0000","last_became_peered":"2024-09-19T13:56:23.172998+0000","last_unstale":"2024-09-19T15:32:07.967647+0000","last_undegraded":"2024-09-19T15:32:07.967647+0000","last_fullsized":"2024-09-19T15:32:07.967647+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'18","last_scrub_stamp":"2024-09-19T15:32:07.967355+0000","last_deep_scrub":"268'18","last_deep_scrub_stamp":"2024-09-19T15:32:07.967355+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.967355+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:41:09.208852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:34.713917+0000","last_change":"2024-09-19T15:32:34.713917+0000","last_active":"2024-09-19T15:32:34.713917+0000","last_peered":"2024-09-19T15:32:34.713917+0000","last_clean":"2024-09-19T15:32:34.713917+0000","last_became_active":"2024-09-19T14:29:51.020277+0000","last_became_peered":"2024-09-19T14:29:51.020277+0000","last_unstale":"2024-09-19T15:32:34.713917+0000","last_undegraded":"2024-09-19T15:32:34.713917+0000","last_fullsized":"2024-09-19T15:32:34.713917+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:34.713712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:34.713712+0000","last_clean_scrub_stamp":"2024-09-19T15:32:34.713712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:44:20.099725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"268'3","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:33.608306+0000","last_change":"2024-09-19T15:32:33.608306+0000","last_active":"2024-09-19T15:32:33.608306+0000","last_peered":"2024-09-19T15:32:33.608306+0000","last_clean":"2024-09-19T15:32:33.608306+0000","last_became_active":"2024-09-19T14:02:36.915962+0000","last_became_peered":"2024-09-19T14:02:36.915962+0000","last_unstale":"2024-09-19T15:32:33.608306+0000","last_undegraded":"2024-09-19T15:32:33.608306+0000","last_fullsized":"2024-09-19T15:32:33.608306+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:33.608129+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:33.608129+0000","last_clean_scrub_stamp":"2024-09-19T15:32:33.608129+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:40.591218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:32.510780+0000","last_change":"2024-09-19T15:32:32.510780+0000","last_active":"2024-09-19T15:32:32.510780+0000","last_peered":"2024-09-19T15:32:32.510780+0000","last_clean":"2024-09-19T15:32:32.510780+0000","last_became_active":"2024-09-19T14:02:29.741726+0000","last_became_peered":"2024-09-19T14:02:29.741726+0000","last_unstale":"2024-09-19T15:32:32.510780+0000","last_undegraded":"2024-09-19T15:32:32.510780+0000","last_fullsized":"2024-09-19T15:32:32.510780+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:32.510565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:32.510565+0000","last_clean_scrub_stamp":"2024-09-19T15:32:32.510565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:49:51.567588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'18","reported_seq":129,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:25.646726+0000","last_change":"2024-09-19T15:32:25.646726+0000","last_active":"2024-09-19T15:32:25.646726+0000","last_peered":"2024-09-19T15:32:25.646726+0000","last_clean":"2024-09-19T15:32:25.646726+0000","last_became_active":"2024-09-19T13:56:23.175483+0000","last_became_peered":"2024-09-19T13:56:23.175483+0000","last_unstale":"2024-09-19T15:32:25.646726+0000","last_undegraded":"2024-09-19T15:32:25.646726+0000","last_fullsized":"2024-09-19T15:32:25.646726+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'18","last_scrub_stamp":"2024-09-19T15:32:25.646546+0000","last_deep_scrub":"268'18","last_deep_scrub_stamp":"2024-09-19T15:32:25.646546+0000","last_clean_scrub_stamp":"2024-09-19T15:32:25.646546+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:43:11.573506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":81,"num_write":47,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:47.146644+0000","last_change":"2024-09-19T15:32:47.146644+0000","last_active":"2024-09-19T15:32:47.146644+0000","last_peered":"2024-09-19T15:32:47.146644+0000","last_clean":"2024-09-19T15:32:47.146644+0000","last_became_active":"2024-09-19T14:29:51.054440+0000","last_became_peered":"2024-09-19T14:29:51.054440+0000","last_unstale":"2024-09-19T15:32:47.146644+0000","last_undegraded":"2024-09-19T15:32:47.146644+0000","last_fullsized":"2024-09-19T15:32:47.146644+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:47.146451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:47.146451+0000","last_clean_scrub_stamp":"2024-09-19T15:32:47.146451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:49:07.597289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:24.733196+0000","last_change":"2024-09-19T15:32:24.733196+0000","last_active":"2024-09-19T15:32:24.733196+0000","last_peered":"2024-09-19T15:32:24.733196+0000","last_clean":"2024-09-19T15:32:24.733196+0000","last_became_active":"2024-09-19T14:02:36.917886+0000","last_became_peered":"2024-09-19T14:02:36.917886+0000","last_unstale":"2024-09-19T15:32:24.733196+0000","last_undegraded":"2024-09-19T15:32:24.733196+0000","last_fullsized":"2024-09-19T15:32:24.733196+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:24.733018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:24.733018+0000","last_clean_scrub_stamp":"2024-09-19T15:32:24.733018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:18:44.716865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"268'3","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:26.557957+0000","last_change":"2024-09-19T15:32:26.557957+0000","last_active":"2024-09-19T15:32:26.557957+0000","last_peered":"2024-09-19T15:32:26.557957+0000","last_clean":"2024-09-19T15:32:26.557957+0000","last_became_active":"2024-09-19T14:02:29.730095+0000","last_became_peered":"2024-09-19T14:02:29.730095+0000","last_unstale":"2024-09-19T15:32:26.557957+0000","last_undegraded":"2024-09-19T15:32:26.557957+0000","last_fullsized":"2024-09-19T15:32:26.557957+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:26.557775+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:26.557775+0000","last_clean_scrub_stamp":"2024-09-19T15:32:26.557775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:20:23.909493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'29","reported_seq":157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:26.672788+0000","last_change":"2024-09-19T15:32:26.672788+0000","last_active":"2024-09-19T15:32:26.672788+0000","last_peered":"2024-09-19T15:32:26.672788+0000","last_clean":"2024-09-19T15:32:26.672788+0000","last_became_active":"2024-09-19T13:56:23.183825+0000","last_became_peered":"2024-09-19T13:56:23.183825+0000","last_unstale":"2024-09-19T15:32:26.672788+0000","last_undegraded":"2024-09-19T15:32:26.672788+0000","last_fullsized":"2024-09-19T15:32:26.672788+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'29","last_scrub_stamp":"2024-09-19T15:32:26.672589+0000","last_deep_scrub":"268'29","last_deep_scrub_stamp":"2024-09-19T15:32:26.672589+0000","last_clean_scrub_stamp":"2024-09-19T15:32:26.672589+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:27.804236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":139,"num_write":76,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:43.556229+0000","last_change":"2024-09-19T15:32:43.556229+0000","last_active":"2024-09-19T15:32:43.556229+0000","last_peered":"2024-09-19T15:32:43.556229+0000","last_clean":"2024-09-19T15:32:43.556229+0000","last_became_active":"2024-09-19T14:29:51.036062+0000","last_became_peered":"2024-09-19T14:29:51.036062+0000","last_unstale":"2024-09-19T15:32:43.556229+0000","last_undegraded":"2024-09-19T15:32:43.556229+0000","last_fullsized":"2024-09-19T15:32:43.556229+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:43.556048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:43.556048+0000","last_clean_scrub_stamp":"2024-09-19T15:32:43.556048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:36.925510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'3","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:25.742701+0000","last_change":"2024-09-19T15:32:25.742701+0000","last_active":"2024-09-19T15:32:25.742701+0000","last_peered":"2024-09-19T15:32:25.742701+0000","last_clean":"2024-09-19T15:32:25.742701+0000","last_became_active":"2024-09-19T14:02:36.910298+0000","last_became_peered":"2024-09-19T14:02:36.910298+0000","last_unstale":"2024-09-19T15:32:25.742701+0000","last_undegraded":"2024-09-19T15:32:25.742701+0000","last_fullsized":"2024-09-19T15:32:25.742701+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-19T15:32:25.742469+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-19T15:32:25.742469+0000","last_clean_scrub_stamp":"2024-09-19T15:32:25.742469+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:01.917327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'3","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:35.077489+0000","last_change":"2024-09-19T15:32:35.077489+0000","last_active":"2024-09-19T15:32:35.077489+0000","last_peered":"2024-09-19T15:32:35.077489+0000","last_clean":"2024-09-19T15:32:35.077489+0000","last_became_active":"2024-09-19T14:02:29.732413+0000","last_became_peered":"2024-09-19T14:02:29.732413+0000","last_unstale":"2024-09-19T15:32:35.077489+0000","last_undegraded":"2024-09-19T15:32:35.077489+0000","last_fullsized":"2024-09-19T15:32:35.077489+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:35.077297+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:35.077297+0000","last_clean_scrub_stamp":"2024-09-19T15:32:35.077297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:33:55.999488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"268'52","reported_seq":223,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:25.518320+0000","last_change":"2024-09-19T15:32:25.518320+0000","last_active":"2024-09-19T15:32:25.518320+0000","last_peered":"2024-09-19T15:32:25.518320+0000","last_clean":"2024-09-19T15:32:25.518320+0000","last_became_active":"2024-09-19T13:56:23.161268+0000","last_became_peered":"2024-09-19T13:56:23.161268+0000","last_unstale":"2024-09-19T15:32:25.518320+0000","last_undegraded":"2024-09-19T15:32:25.518320+0000","last_fullsized":"2024-09-19T15:32:25.518320+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'52","last_scrub_stamp":"2024-09-19T15:32:25.518067+0000","last_deep_scrub":"268'52","last_deep_scrub_stamp":"2024-09-19T15:32:25.518067+0000","last_clean_scrub_stamp":"2024-09-19T15:32:25.518067+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:01.595629+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":413,"num_read_kb":272,"num_write":131,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"268'2","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:40.584136+0000","last_change":"2024-09-19T15:32:40.584136+0000","last_active":"2024-09-19T15:32:40.584136+0000","last_peered":"2024-09-19T15:32:40.584136+0000","last_clean":"2024-09-19T15:32:40.584136+0000","last_became_active":"2024-09-19T14:29:51.055396+0000","last_became_peered":"2024-09-19T14:29:51.055396+0000","last_unstale":"2024-09-19T15:32:40.584136+0000","last_undegraded":"2024-09-19T15:32:40.584136+0000","last_fullsized":"2024-09-19T15:32:40.584136+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:40.583911+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:40.583911+0000","last_clean_scrub_stamp":"2024-09-19T15:32:40.583911+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:57.266184+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:39.159142+0000","last_change":"2024-09-19T15:32:39.159142+0000","last_active":"2024-09-19T15:32:39.159142+0000","last_peered":"2024-09-19T15:32:39.159142+0000","last_clean":"2024-09-19T15:32:39.159142+0000","last_became_active":"2024-09-19T14:02:36.926038+0000","last_became_peered":"2024-09-19T14:02:36.926038+0000","last_unstale":"2024-09-19T15:32:39.159142+0000","last_undegraded":"2024-09-19T15:32:39.159142+0000","last_fullsized":"2024-09-19T15:32:39.159142+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:39.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:39.158922+0000","last_clean_scrub_stamp":"2024-09-19T15:32:39.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:49:19.479414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"268'6","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:18.192988+0000","last_change":"2024-09-19T15:32:18.192988+0000","last_active":"2024-09-19T15:32:18.192988+0000","last_peered":"2024-09-19T15:32:18.192988+0000","last_clean":"2024-09-19T15:32:18.192988+0000","last_became_active":"2024-09-19T14:02:29.740451+0000","last_became_peered":"2024-09-19T14:02:29.740451+0000","last_unstale":"2024-09-19T15:32:18.192988+0000","last_undegraded":"2024-09-19T15:32:18.192988+0000","last_fullsized":"2024-09-19T15:32:18.192988+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-19T15:32:18.192767+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-19T15:32:18.192767+0000","last_clean_scrub_stamp":"2024-09-19T15:32:18.192767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:13:07.938345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'35","reported_seq":182,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:25.585607+0000","last_change":"2024-09-19T15:32:25.585607+0000","last_active":"2024-09-19T15:32:25.585607+0000","last_peered":"2024-09-19T15:32:25.585607+0000","last_clean":"2024-09-19T15:32:25.585607+0000","last_became_active":"2024-09-19T13:56:23.170486+0000","last_became_peered":"2024-09-19T13:56:23.170486+0000","last_unstale":"2024-09-19T15:32:25.585607+0000","last_undegraded":"2024-09-19T15:32:25.585607+0000","last_fullsized":"2024-09-19T15:32:25.585607+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'35","last_scrub_stamp":"2024-09-19T15:32:25.585436+0000","last_deep_scrub":"268'35","last_deep_scrub_stamp":"2024-09-19T15:32:25.585436+0000","last_clean_scrub_stamp":"2024-09-19T15:32:25.585436+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:57.333276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":196,"num_write":86,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:30:18.262001+0000","last_change":"2024-09-19T14:29:51.045330+0000","last_active":"2024-09-19T15:30:18.262001+0000","last_peered":"2024-09-19T15:30:18.262001+0000","last_clean":"2024-09-19T15:30:18.262001+0000","last_became_active":"2024-09-19T14:29:51.044154+0000","last_became_peered":"2024-09-19T14:29:51.044154+0000","last_unstale":"2024-09-19T15:30:18.262001+0000","last_undegraded":"2024-09-19T15:30:18.262001+0000","last_fullsized":"2024-09-19T15:30:18.262001+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T14:29:49.992655+0000","last_clean_scrub_stamp":"2024-09-19T14:29:49.992655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'2","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:20.205390+0000","last_change":"2024-09-19T15:32:20.205390+0000","last_active":"2024-09-19T15:32:20.205390+0000","last_peered":"2024-09-19T15:32:20.205390+0000","last_clean":"2024-09-19T15:32:20.205390+0000","last_became_active":"2024-09-19T14:02:36.918735+0000","last_became_peered":"2024-09-19T14:02:36.918735+0000","last_unstale":"2024-09-19T15:32:20.205390+0000","last_undegraded":"2024-09-19T15:32:20.205390+0000","last_fullsized":"2024-09-19T15:32:20.205390+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-19T15:32:20.205204+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-19T15:32:20.205204+0000","last_clean_scrub_stamp":"2024-09-19T15:32:20.205204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:58.167806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:28.629879+0000","last_change":"2024-09-19T15:32:28.629879+0000","last_active":"2024-09-19T15:32:28.629879+0000","last_peered":"2024-09-19T15:32:28.629879+0000","last_clean":"2024-09-19T15:32:28.629879+0000","last_became_active":"2024-09-19T14:02:29.742091+0000","last_became_peered":"2024-09-19T14:02:29.742091+0000","last_unstale":"2024-09-19T15:32:28.629879+0000","last_undegraded":"2024-09-19T15:32:28.629879+0000","last_fullsized":"2024-09-19T15:32:28.629879+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:28.629704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:28.629704+0000","last_clean_scrub_stamp":"2024-09-19T15:32:28.629704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:24.319951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'40","reported_seq":189,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:30.065215+0000","last_change":"2024-09-19T15:32:30.065215+0000","last_active":"2024-09-19T15:32:30.065215+0000","last_peered":"2024-09-19T15:32:30.065215+0000","last_clean":"2024-09-19T15:32:30.065215+0000","last_became_active":"2024-09-19T13:56:23.173245+0000","last_became_peered":"2024-09-19T13:56:23.173245+0000","last_unstale":"2024-09-19T15:32:30.065215+0000","last_undegraded":"2024-09-19T15:32:30.065215+0000","last_fullsized":"2024-09-19T15:32:30.065215+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'40","last_scrub_stamp":"2024-09-19T15:32:30.064995+0000","last_deep_scrub":"268'40","last_deep_scrub_stamp":"2024-09-19T15:32:30.064995+0000","last_clean_scrub_stamp":"2024-09-19T15:32:30.064995+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:50.398017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":315,"num_read_kb":214,"num_write":104,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:16.051373+0000","last_change":"2024-09-19T15:32:16.051373+0000","last_active":"2024-09-19T15:32:16.051373+0000","last_peered":"2024-09-19T15:32:16.051373+0000","last_clean":"2024-09-19T15:32:16.051373+0000","last_became_active":"2024-09-19T14:29:51.043979+0000","last_became_peered":"2024-09-19T14:29:51.043979+0000","last_unstale":"2024-09-19T15:32:16.051373+0000","last_undegraded":"2024-09-19T15:32:16.051373+0000","last_fullsized":"2024-09-19T15:32:16.051373+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:16.051172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:16.051172+0000","last_clean_scrub_stamp":"2024-09-19T15:32:16.051172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:17.401042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"268'2","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:40.123379+0000","last_change":"2024-09-19T15:32:40.123379+0000","last_active":"2024-09-19T15:32:40.123379+0000","last_peered":"2024-09-19T15:32:40.123379+0000","last_clean":"2024-09-19T15:32:40.123379+0000","last_became_active":"2024-09-19T14:02:36.925870+0000","last_became_peered":"2024-09-19T14:02:36.925870+0000","last_unstale":"2024-09-19T15:32:40.123379+0000","last_undegraded":"2024-09-19T15:32:40.123379+0000","last_fullsized":"2024-09-19T15:32:40.123379+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:40.123176+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:40.123176+0000","last_clean_scrub_stamp":"2024-09-19T15:32:40.123176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:43.232032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:30.679996+0000","last_change":"2024-09-19T15:32:30.679848+0000","last_active":"2024-09-19T15:32:30.679996+0000","last_peered":"2024-09-19T15:32:30.679996+0000","last_clean":"2024-09-19T15:32:30.679996+0000","last_became_active":"2024-09-19T14:02:29.744169+0000","last_became_peered":"2024-09-19T14:02:29.744169+0000","last_unstale":"2024-09-19T15:32:30.679996+0000","last_undegraded":"2024-09-19T15:32:30.679996+0000","last_fullsized":"2024-09-19T15:32:30.679996+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:30.679657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:30.679657+0000","last_clean_scrub_stamp":"2024-09-19T15:32:30.679657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:01.300637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'31","reported_seq":175,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:31.026315+0000","last_change":"2024-09-19T15:32:31.026315+0000","last_active":"2024-09-19T15:32:31.026315+0000","last_peered":"2024-09-19T15:32:31.026315+0000","last_clean":"2024-09-19T15:32:31.026315+0000","last_became_active":"2024-09-19T13:56:23.160134+0000","last_became_peered":"2024-09-19T13:56:23.160134+0000","last_unstale":"2024-09-19T15:32:31.026315+0000","last_undegraded":"2024-09-19T15:32:31.026315+0000","last_fullsized":"2024-09-19T15:32:31.026315+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'31","last_scrub_stamp":"2024-09-19T15:32:31.026123+0000","last_deep_scrub":"268'31","last_deep_scrub_stamp":"2024-09-19T15:32:31.026123+0000","last_clean_scrub_stamp":"2024-09-19T15:32:31.026123+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:05.378989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":163,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:39.643549+0000","last_change":"2024-09-19T15:32:39.643549+0000","last_active":"2024-09-19T15:32:39.643549+0000","last_peered":"2024-09-19T15:32:39.643549+0000","last_clean":"2024-09-19T15:32:39.643549+0000","last_became_active":"2024-09-19T14:29:51.058494+0000","last_became_peered":"2024-09-19T14:29:51.058494+0000","last_unstale":"2024-09-19T15:32:39.643549+0000","last_undegraded":"2024-09-19T15:32:39.643549+0000","last_fullsized":"2024-09-19T15:32:39.643549+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:39.643359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:39.643359+0000","last_clean_scrub_stamp":"2024-09-19T15:32:39.643359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:27:36.743956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:37.158672+0000","last_change":"2024-09-19T15:32:37.158511+0000","last_active":"2024-09-19T15:32:37.158672+0000","last_peered":"2024-09-19T15:32:37.158672+0000","last_clean":"2024-09-19T15:32:37.158672+0000","last_became_active":"2024-09-19T14:02:36.924213+0000","last_became_peered":"2024-09-19T14:02:36.924213+0000","last_unstale":"2024-09-19T15:32:37.158672+0000","last_undegraded":"2024-09-19T15:32:37.158672+0000","last_fullsized":"2024-09-19T15:32:37.158672+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:37.158332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:37.158332+0000","last_clean_scrub_stamp":"2024-09-19T15:32:37.158332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:28.555804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:10.946903+0000","last_change":"2024-09-19T15:32:10.946761+0000","last_active":"2024-09-19T15:32:10.946903+0000","last_peered":"2024-09-19T15:32:10.946903+0000","last_clean":"2024-09-19T15:32:10.946903+0000","last_became_active":"2024-09-19T14:02:29.751229+0000","last_became_peered":"2024-09-19T14:02:29.751229+0000","last_unstale":"2024-09-19T15:32:10.946903+0000","last_undegraded":"2024-09-19T15:32:10.946903+0000","last_fullsized":"2024-09-19T15:32:10.946903+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:10.946572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:10.946572+0000","last_clean_scrub_stamp":"2024-09-19T15:32:10.946572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:11:22.828742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"268'30","reported_seq":164,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:26.587599+0000","last_change":"2024-09-19T15:32:26.587599+0000","last_active":"2024-09-19T15:32:26.587599+0000","last_peered":"2024-09-19T15:32:26.587599+0000","last_clean":"2024-09-19T15:32:26.587599+0000","last_became_active":"2024-09-19T13:56:23.166406+0000","last_became_peered":"2024-09-19T13:56:23.166406+0000","last_unstale":"2024-09-19T15:32:26.587599+0000","last_undegraded":"2024-09-19T15:32:26.587599+0000","last_fullsized":"2024-09-19T15:32:26.587599+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-09-19T15:32:26.587412+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-09-19T15:32:26.587412+0000","last_clean_scrub_stamp":"2024-09-19T15:32:26.587412+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:39:35.546888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":158,"num_write":72,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:23.251292+0000","last_change":"2024-09-19T15:32:23.251155+0000","last_active":"2024-09-19T15:32:23.251292+0000","last_peered":"2024-09-19T15:32:23.251292+0000","last_clean":"2024-09-19T15:32:23.251292+0000","last_became_active":"2024-09-19T14:29:51.050808+0000","last_became_peered":"2024-09-19T14:29:51.050808+0000","last_unstale":"2024-09-19T15:32:23.251292+0000","last_undegraded":"2024-09-19T15:32:23.251292+0000","last_fullsized":"2024-09-19T15:32:23.251292+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:23.250978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:23.250978+0000","last_clean_scrub_stamp":"2024-09-19T15:32:23.250978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:49:49.918319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"268'3","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:23.728755+0000","last_change":"2024-09-19T15:32:23.728755+0000","last_active":"2024-09-19T15:32:23.728755+0000","last_peered":"2024-09-19T15:32:23.728755+0000","last_clean":"2024-09-19T15:32:23.728755+0000","last_became_active":"2024-09-19T14:02:37.052121+0000","last_became_peered":"2024-09-19T14:02:37.052121+0000","last_unstale":"2024-09-19T15:32:23.728755+0000","last_undegraded":"2024-09-19T15:32:23.728755+0000","last_fullsized":"2024-09-19T15:32:23.728755+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:23.728572+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:23.728572+0000","last_clean_scrub_stamp":"2024-09-19T15:32:23.728572+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:41:47.058406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:37.552909+0000","last_change":"2024-09-19T15:32:37.552909+0000","last_active":"2024-09-19T15:32:37.552909+0000","last_peered":"2024-09-19T15:32:37.552909+0000","last_clean":"2024-09-19T15:32:37.552909+0000","last_became_active":"2024-09-19T14:02:29.748469+0000","last_became_peered":"2024-09-19T14:02:29.748469+0000","last_unstale":"2024-09-19T15:32:37.552909+0000","last_undegraded":"2024-09-19T15:32:37.552909+0000","last_fullsized":"2024-09-19T15:32:37.552909+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:37.552705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:37.552705+0000","last_clean_scrub_stamp":"2024-09-19T15:32:37.552705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:42.447761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"268'120","reported_seq":448,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:15.141891+0000","last_change":"2024-09-19T15:32:15.141891+0000","last_active":"2024-09-19T15:32:15.141891+0000","last_peered":"2024-09-19T15:32:15.141891+0000","last_clean":"2024-09-19T15:32:15.141891+0000","last_became_active":"2024-09-19T13:56:23.164737+0000","last_became_peered":"2024-09-19T13:56:23.164737+0000","last_unstale":"2024-09-19T15:32:15.141891+0000","last_undegraded":"2024-09-19T15:32:15.141891+0000","last_fullsized":"2024-09-19T15:32:15.141891+0000","mapping_epoch":255,"log_start":"265'100","ondisk_log_start":"265'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'120","last_scrub_stamp":"2024-09-19T15:32:15.141719+0000","last_deep_scrub":"268'120","last_deep_scrub_stamp":"2024-09-19T15:32:15.141719+0000","last_clean_scrub_stamp":"2024-09-19T15:32:15.141719+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:28:48.051613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1135,"num_read_kb":1191,"num_write":240,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:38.686946+0000","last_change":"2024-09-19T15:32:38.686790+0000","last_active":"2024-09-19T15:32:38.686946+0000","last_peered":"2024-09-19T15:32:38.686946+0000","last_clean":"2024-09-19T15:32:38.686946+0000","last_became_active":"2024-09-19T14:29:51.022975+0000","last_became_peered":"2024-09-19T14:29:51.022975+0000","last_unstale":"2024-09-19T15:32:38.686946+0000","last_undegraded":"2024-09-19T15:32:38.686946+0000","last_fullsized":"2024-09-19T15:32:38.686946+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:38.686607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:38.686607+0000","last_clean_scrub_stamp":"2024-09-19T15:32:38.686607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:05:07.434958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"268'3","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:38.133951+0000","last_change":"2024-09-19T15:32:38.133951+0000","last_active":"2024-09-19T15:32:38.133951+0000","last_peered":"2024-09-19T15:32:38.133951+0000","last_clean":"2024-09-19T15:32:38.133951+0000","last_became_active":"2024-09-19T14:02:36.924349+0000","last_became_peered":"2024-09-19T14:02:36.924349+0000","last_unstale":"2024-09-19T15:32:38.133951+0000","last_undegraded":"2024-09-19T15:32:38.133951+0000","last_fullsized":"2024-09-19T15:32:38.133951+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:38.133755+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:38.133755+0000","last_clean_scrub_stamp":"2024-09-19T15:32:38.133755+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:46:31.285098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":76,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:18.662215+0000","last_change":"2024-09-19T15:32:18.662215+0000","last_active":"2024-09-19T15:32:18.662215+0000","last_peered":"2024-09-19T15:32:18.662215+0000","last_clean":"2024-09-19T15:32:18.662215+0000","last_became_active":"2024-09-19T14:02:29.730280+0000","last_became_peered":"2024-09-19T14:02:29.730280+0000","last_unstale":"2024-09-19T15:32:18.662215+0000","last_undegraded":"2024-09-19T15:32:18.662215+0000","last_fullsized":"2024-09-19T15:32:18.662215+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:18.662024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:18.662024+0000","last_clean_scrub_stamp":"2024-09-19T15:32:18.662024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:44:59.899540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'28","reported_seq":157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.948745+0000","last_change":"2024-09-19T15:32:05.948745+0000","last_active":"2024-09-19T15:32:05.948745+0000","last_peered":"2024-09-19T15:32:05.948745+0000","last_clean":"2024-09-19T15:32:05.948745+0000","last_became_active":"2024-09-19T13:56:23.182103+0000","last_became_peered":"2024-09-19T13:56:23.182103+0000","last_unstale":"2024-09-19T15:32:05.948745+0000","last_undegraded":"2024-09-19T15:32:05.948745+0000","last_fullsized":"2024-09-19T15:32:05.948745+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'28","last_scrub_stamp":"2024-09-19T15:32:05.948526+0000","last_deep_scrub":"268'28","last_deep_scrub_stamp":"2024-09-19T15:32:05.948526+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.948526+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:07:24.807541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":141,"num_write":72,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:45.140217+0000","last_change":"2024-09-19T15:32:45.140217+0000","last_active":"2024-09-19T15:32:45.140217+0000","last_peered":"2024-09-19T15:32:45.140217+0000","last_clean":"2024-09-19T15:32:45.140217+0000","last_became_active":"2024-09-19T14:29:51.030200+0000","last_became_peered":"2024-09-19T14:29:51.030200+0000","last_unstale":"2024-09-19T15:32:45.140217+0000","last_undegraded":"2024-09-19T15:32:45.140217+0000","last_fullsized":"2024-09-19T15:32:45.140217+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:45.139998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:45.139998+0000","last_clean_scrub_stamp":"2024-09-19T15:32:45.139998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:32:20.371590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"265'3","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:32.649348+0000","last_change":"2024-09-19T15:32:32.649348+0000","last_active":"2024-09-19T15:32:32.649348+0000","last_peered":"2024-09-19T15:32:32.649348+0000","last_clean":"2024-09-19T15:32:32.649348+0000","last_became_active":"2024-09-19T14:02:36.927585+0000","last_became_peered":"2024-09-19T14:02:36.927585+0000","last_unstale":"2024-09-19T15:32:32.649348+0000","last_undegraded":"2024-09-19T15:32:32.649348+0000","last_fullsized":"2024-09-19T15:32:32.649348+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-19T15:32:32.649116+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-19T15:32:32.649116+0000","last_clean_scrub_stamp":"2024-09-19T15:32:32.649116+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:17.633779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"265'5","reported_seq":93,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:30.538560+0000","last_change":"2024-09-19T15:32:30.538560+0000","last_active":"2024-09-19T15:32:30.538560+0000","last_peered":"2024-09-19T15:32:30.538560+0000","last_clean":"2024-09-19T15:32:30.538560+0000","last_became_active":"2024-09-19T14:02:29.739469+0000","last_became_peered":"2024-09-19T14:02:29.739469+0000","last_unstale":"2024-09-19T15:32:30.538560+0000","last_undegraded":"2024-09-19T15:32:30.538560+0000","last_fullsized":"2024-09-19T15:32:30.538560+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-19T15:32:30.538365+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-19T15:32:30.538365+0000","last_clean_scrub_stamp":"2024-09-19T15:32:30.538365+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:27:11.791134+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'26","reported_seq":153,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:23.573569+0000","last_change":"2024-09-19T15:32:23.573569+0000","last_active":"2024-09-19T15:32:23.573569+0000","last_peered":"2024-09-19T15:32:23.573569+0000","last_clean":"2024-09-19T15:32:23.573569+0000","last_became_active":"2024-09-19T13:56:23.170897+0000","last_became_peered":"2024-09-19T13:56:23.170897+0000","last_unstale":"2024-09-19T15:32:23.573569+0000","last_undegraded":"2024-09-19T15:32:23.573569+0000","last_fullsized":"2024-09-19T15:32:23.573569+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-09-19T15:32:23.573388+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-09-19T15:32:23.573388+0000","last_clean_scrub_stamp":"2024-09-19T15:32:23.573388+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:11:45.786011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":129,"num_write":67,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:44.667980+0000","last_change":"2024-09-19T15:32:44.667980+0000","last_active":"2024-09-19T15:32:44.667980+0000","last_peered":"2024-09-19T15:32:44.667980+0000","last_clean":"2024-09-19T15:32:44.667980+0000","last_became_active":"2024-09-19T14:29:51.046273+0000","last_became_peered":"2024-09-19T14:29:51.046273+0000","last_unstale":"2024-09-19T15:32:44.667980+0000","last_undegraded":"2024-09-19T15:32:44.667980+0000","last_fullsized":"2024-09-19T15:32:44.667980+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:44.667787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:44.667787+0000","last_clean_scrub_stamp":"2024-09-19T15:32:44.667787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:30:46.016522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"268'8","reported_seq":94,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:33.638753+0000","last_change":"2024-09-19T15:32:33.638753+0000","last_active":"2024-09-19T15:32:33.638753+0000","last_peered":"2024-09-19T15:32:33.638753+0000","last_clean":"2024-09-19T15:32:33.638753+0000","last_became_active":"2024-09-19T14:02:37.050689+0000","last_became_peered":"2024-09-19T14:02:37.050689+0000","last_unstale":"2024-09-19T15:32:33.638753+0000","last_undegraded":"2024-09-19T15:32:33.638753+0000","last_fullsized":"2024-09-19T15:32:33.638753+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-19T15:32:33.638568+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-19T15:32:33.638568+0000","last_clean_scrub_stamp":"2024-09-19T15:32:33.638568+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:42:29.475536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32770,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"265'5","reported_seq":93,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:17.636019+0000","last_change":"2024-09-19T15:32:17.636019+0000","last_active":"2024-09-19T15:32:17.636019+0000","last_peered":"2024-09-19T15:32:17.636019+0000","last_clean":"2024-09-19T15:32:17.636019+0000","last_became_active":"2024-09-19T14:02:29.730624+0000","last_became_peered":"2024-09-19T14:02:29.730624+0000","last_unstale":"2024-09-19T15:32:17.636019+0000","last_undegraded":"2024-09-19T15:32:17.636019+0000","last_fullsized":"2024-09-19T15:32:17.636019+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-19T15:32:17.635821+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-19T15:32:17.635821+0000","last_clean_scrub_stamp":"2024-09-19T15:32:17.635821+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:32:00.090008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'5","reported_seq":99,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:24.596943+0000","last_change":"2024-09-19T15:32:24.596943+0000","last_active":"2024-09-19T15:32:24.596943+0000","last_peered":"2024-09-19T15:32:24.596943+0000","last_clean":"2024-09-19T15:32:24.596943+0000","last_became_active":"2024-09-19T13:56:23.181867+0000","last_became_peered":"2024-09-19T13:56:23.181867+0000","last_unstale":"2024-09-19T15:32:24.596943+0000","last_undegraded":"2024-09-19T15:32:24.596943+0000","last_fullsized":"2024-09-19T15:32:24.596943+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-19T15:32:24.596657+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-19T15:32:24.596657+0000","last_clean_scrub_stamp":"2024-09-19T15:32:24.596657+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:15.545868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'2","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:40.664673+0000","last_change":"2024-09-19T15:32:40.664673+0000","last_active":"2024-09-19T15:32:40.664673+0000","last_peered":"2024-09-19T15:32:40.664673+0000","last_clean":"2024-09-19T15:32:40.664673+0000","last_became_active":"2024-09-19T14:29:51.036292+0000","last_became_peered":"2024-09-19T14:29:51.036292+0000","last_unstale":"2024-09-19T15:32:40.664673+0000","last_undegraded":"2024-09-19T15:32:40.664673+0000","last_fullsized":"2024-09-19T15:32:40.664673+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:40.664491+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:40.664491+0000","last_clean_scrub_stamp":"2024-09-19T15:32:40.664491+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:45:12.303499+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"268'2","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:22.708402+0000","last_change":"2024-09-19T15:32:22.708237+0000","last_active":"2024-09-19T15:32:22.708402+0000","last_peered":"2024-09-19T15:32:22.708402+0000","last_clean":"2024-09-19T15:32:22.708402+0000","last_became_active":"2024-09-19T14:02:36.923500+0000","last_became_peered":"2024-09-19T14:02:36.923500+0000","last_unstale":"2024-09-19T15:32:22.708402+0000","last_undegraded":"2024-09-19T15:32:22.708402+0000","last_fullsized":"2024-09-19T15:32:22.708402+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:22.708046+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:22.708046+0000","last_clean_scrub_stamp":"2024-09-19T15:32:22.708046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:52:30.468832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'3","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:36.560160+0000","last_change":"2024-09-19T15:32:36.560160+0000","last_active":"2024-09-19T15:32:36.560160+0000","last_peered":"2024-09-19T15:32:36.560160+0000","last_clean":"2024-09-19T15:32:36.560160+0000","last_became_active":"2024-09-19T14:02:29.746148+0000","last_became_peered":"2024-09-19T14:02:29.746148+0000","last_unstale":"2024-09-19T15:32:36.560160+0000","last_undegraded":"2024-09-19T15:32:36.560160+0000","last_fullsized":"2024-09-19T15:32:36.560160+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:36.559969+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:36.559969+0000","last_clean_scrub_stamp":"2024-09-19T15:32:36.559969+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:17.830022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'41","reported_seq":196,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:29.057381+0000","last_change":"2024-09-19T15:32:29.057381+0000","last_active":"2024-09-19T15:32:29.057381+0000","last_peered":"2024-09-19T15:32:29.057381+0000","last_clean":"2024-09-19T15:32:29.057381+0000","last_became_active":"2024-09-19T13:56:23.173918+0000","last_became_peered":"2024-09-19T13:56:23.173918+0000","last_unstale":"2024-09-19T15:32:29.057381+0000","last_undegraded":"2024-09-19T15:32:29.057381+0000","last_fullsized":"2024-09-19T15:32:29.057381+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'41","last_scrub_stamp":"2024-09-19T15:32:29.057205+0000","last_deep_scrub":"268'41","last_deep_scrub_stamp":"2024-09-19T15:32:29.057205+0000","last_clean_scrub_stamp":"2024-09-19T15:32:29.057205+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:02:25.994176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":206,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:42.598398+0000","last_change":"2024-09-19T15:32:42.598398+0000","last_active":"2024-09-19T15:32:42.598398+0000","last_peered":"2024-09-19T15:32:42.598398+0000","last_clean":"2024-09-19T15:32:42.598398+0000","last_became_active":"2024-09-19T14:29:51.033329+0000","last_became_peered":"2024-09-19T14:29:51.033329+0000","last_unstale":"2024-09-19T15:32:42.598398+0000","last_undegraded":"2024-09-19T15:32:42.598398+0000","last_fullsized":"2024-09-19T15:32:42.598398+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:42.598180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:42.598180+0000","last_clean_scrub_stamp":"2024-09-19T15:32:42.598180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:45.690961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'5","reported_seq":88,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:35.582690+0000","last_change":"2024-09-19T15:32:35.582690+0000","last_active":"2024-09-19T15:32:35.582690+0000","last_peered":"2024-09-19T15:32:35.582690+0000","last_clean":"2024-09-19T15:32:35.582690+0000","last_became_active":"2024-09-19T14:03:07.395844+0000","last_became_peered":"2024-09-19T14:03:07.395844+0000","last_unstale":"2024-09-19T15:32:35.582690+0000","last_undegraded":"2024-09-19T15:32:35.582690+0000","last_fullsized":"2024-09-19T15:32:35.582690+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-19T15:32:35.582501+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-19T15:32:35.582501+0000","last_clean_scrub_stamp":"2024-09-19T15:32:35.582501+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:14.722286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5147,"num_write":5,"num_write_kb":5147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'3","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:24.563821+0000","last_change":"2024-09-19T15:32:24.563688+0000","last_active":"2024-09-19T15:32:24.563821+0000","last_peered":"2024-09-19T15:32:24.563821+0000","last_clean":"2024-09-19T15:32:24.563821+0000","last_became_active":"2024-09-19T14:02:29.732416+0000","last_became_peered":"2024-09-19T14:02:29.732416+0000","last_unstale":"2024-09-19T15:32:24.563821+0000","last_undegraded":"2024-09-19T15:32:24.563821+0000","last_fullsized":"2024-09-19T15:32:24.563821+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-19T15:32:24.563464+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-19T15:32:24.563464+0000","last_clean_scrub_stamp":"2024-09-19T15:32:24.563464+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:52:11.908670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'38","reported_seq":196,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:14.109983+0000","last_change":"2024-09-19T15:32:14.109983+0000","last_active":"2024-09-19T15:32:14.109983+0000","last_peered":"2024-09-19T15:32:14.109983+0000","last_clean":"2024-09-19T15:32:14.109983+0000","last_became_active":"2024-09-19T13:56:23.172437+0000","last_became_peered":"2024-09-19T13:56:23.172437+0000","last_unstale":"2024-09-19T15:32:14.109983+0000","last_undegraded":"2024-09-19T15:32:14.109983+0000","last_fullsized":"2024-09-19T15:32:14.109983+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'38","last_scrub_stamp":"2024-09-19T15:32:14.109805+0000","last_deep_scrub":"268'38","last_deep_scrub_stamp":"2024-09-19T15:32:14.109805+0000","last_clean_scrub_stamp":"2024-09-19T15:32:14.109805+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:23.811311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":311,"num_read_kb":193,"num_write":96,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:37.642753+0000","last_change":"2024-09-19T15:32:37.642753+0000","last_active":"2024-09-19T15:32:37.642753+0000","last_peered":"2024-09-19T15:32:37.642753+0000","last_clean":"2024-09-19T15:32:37.642753+0000","last_became_active":"2024-09-19T14:29:51.036386+0000","last_became_peered":"2024-09-19T14:29:51.036386+0000","last_unstale":"2024-09-19T15:32:37.642753+0000","last_undegraded":"2024-09-19T15:32:37.642753+0000","last_fullsized":"2024-09-19T15:32:37.642753+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:37.642573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:37.642573+0000","last_clean_scrub_stamp":"2024-09-19T15:32:37.642573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:03:14.055263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:35.561835+0000","last_change":"2024-09-19T15:32:35.561694+0000","last_active":"2024-09-19T15:32:35.561835+0000","last_peered":"2024-09-19T15:32:35.561835+0000","last_clean":"2024-09-19T15:32:35.561835+0000","last_became_active":"2024-09-19T14:02:36.912757+0000","last_became_peered":"2024-09-19T14:02:36.912757+0000","last_unstale":"2024-09-19T15:32:35.561835+0000","last_undegraded":"2024-09-19T15:32:35.561835+0000","last_fullsized":"2024-09-19T15:32:35.561835+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:35.561510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:35.561510+0000","last_clean_scrub_stamp":"2024-09-19T15:32:35.561510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:43.017343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"268'3","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:29.660542+0000","last_change":"2024-09-19T15:32:29.660542+0000","last_active":"2024-09-19T15:32:29.660542+0000","last_peered":"2024-09-19T15:32:29.660542+0000","last_clean":"2024-09-19T15:32:29.660542+0000","last_became_active":"2024-09-19T14:02:29.725707+0000","last_became_peered":"2024-09-19T14:02:29.725707+0000","last_unstale":"2024-09-19T15:32:29.660542+0000","last_undegraded":"2024-09-19T15:32:29.660542+0000","last_fullsized":"2024-09-19T15:32:29.660542+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:29.660364+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:29.660364+0000","last_clean_scrub_stamp":"2024-09-19T15:32:29.660364+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:58:09.169652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'2","reported_seq":93,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:24.542932+0000","last_change":"2024-09-19T15:32:24.542932+0000","last_active":"2024-09-19T15:32:24.542932+0000","last_peered":"2024-09-19T15:32:24.542932+0000","last_clean":"2024-09-19T15:32:24.542932+0000","last_became_active":"2024-09-19T13:56:23.180518+0000","last_became_peered":"2024-09-19T13:56:23.180518+0000","last_unstale":"2024-09-19T15:32:24.542932+0000","last_undegraded":"2024-09-19T15:32:24.542932+0000","last_fullsized":"2024-09-19T15:32:24.542932+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:24.542742+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:24.542742+0000","last_clean_scrub_stamp":"2024-09-19T15:32:24.542742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:35.344874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:32.681946+0000","last_change":"2024-09-19T15:32:32.681946+0000","last_active":"2024-09-19T15:32:32.681946+0000","last_peered":"2024-09-19T15:32:32.681946+0000","last_clean":"2024-09-19T15:32:32.681946+0000","last_became_active":"2024-09-19T14:29:51.030021+0000","last_became_peered":"2024-09-19T14:29:51.030021+0000","last_unstale":"2024-09-19T15:32:32.681946+0000","last_undegraded":"2024-09-19T15:32:32.681946+0000","last_fullsized":"2024-09-19T15:32:32.681946+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:32.681775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:32.681775+0000","last_clean_scrub_stamp":"2024-09-19T15:32:32.681775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:15.511871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"265'3","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:34.539181+0000","last_change":"2024-09-19T15:32:34.539181+0000","last_active":"2024-09-19T15:32:34.539181+0000","last_peered":"2024-09-19T15:32:34.539181+0000","last_clean":"2024-09-19T15:32:34.539181+0000","last_became_active":"2024-09-19T14:02:37.051567+0000","last_became_peered":"2024-09-19T14:02:37.051567+0000","last_unstale":"2024-09-19T15:32:34.539181+0000","last_undegraded":"2024-09-19T15:32:34.539181+0000","last_fullsized":"2024-09-19T15:32:34.539181+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-19T15:32:34.538991+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-19T15:32:34.538991+0000","last_clean_scrub_stamp":"2024-09-19T15:32:34.538991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:33:55.866556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:09.942600+0000","last_change":"2024-09-19T15:32:09.942445+0000","last_active":"2024-09-19T15:32:09.942600+0000","last_peered":"2024-09-19T15:32:09.942600+0000","last_clean":"2024-09-19T15:32:09.942600+0000","last_became_active":"2024-09-19T14:02:29.747539+0000","last_became_peered":"2024-09-19T14:02:29.747539+0000","last_unstale":"2024-09-19T15:32:09.942600+0000","last_undegraded":"2024-09-19T15:32:09.942600+0000","last_fullsized":"2024-09-19T15:32:09.942600+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:09.942261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:09.942261+0000","last_clean_scrub_stamp":"2024-09-19T15:32:09.942261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:10:00.802028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"268'12","reported_seq":118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:13.085399+0000","last_change":"2024-09-19T15:32:13.085399+0000","last_active":"2024-09-19T15:32:13.085399+0000","last_peered":"2024-09-19T15:32:13.085399+0000","last_clean":"2024-09-19T15:32:13.085399+0000","last_became_active":"2024-09-19T13:56:23.173882+0000","last_became_peered":"2024-09-19T13:56:23.173882+0000","last_unstale":"2024-09-19T15:32:13.085399+0000","last_undegraded":"2024-09-19T15:32:13.085399+0000","last_fullsized":"2024-09-19T15:32:13.085399+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'12","last_scrub_stamp":"2024-09-19T15:32:13.085210+0000","last_deep_scrub":"268'12","last_deep_scrub_stamp":"2024-09-19T15:32:13.085210+0000","last_clean_scrub_stamp":"2024-09-19T15:32:13.085210+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:08:01.896984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":61,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:26.783029+0000","last_change":"2024-09-19T15:32:26.783029+0000","last_active":"2024-09-19T15:32:26.783029+0000","last_peered":"2024-09-19T15:32:26.783029+0000","last_clean":"2024-09-19T15:32:26.783029+0000","last_became_active":"2024-09-19T14:29:51.049356+0000","last_became_peered":"2024-09-19T14:29:51.049356+0000","last_unstale":"2024-09-19T15:32:26.783029+0000","last_undegraded":"2024-09-19T15:32:26.783029+0000","last_fullsized":"2024-09-19T15:32:26.783029+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:26.782842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:26.782842+0000","last_clean_scrub_stamp":"2024-09-19T15:32:26.782842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:24.086928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"268'8","reported_seq":90,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:34.593438+0000","last_change":"2024-09-19T15:32:34.593438+0000","last_active":"2024-09-19T15:32:34.593438+0000","last_peered":"2024-09-19T15:32:34.593438+0000","last_clean":"2024-09-19T15:32:34.593438+0000","last_became_active":"2024-09-19T14:02:37.056814+0000","last_became_peered":"2024-09-19T14:02:37.056814+0000","last_unstale":"2024-09-19T15:32:34.593438+0000","last_undegraded":"2024-09-19T15:32:34.593438+0000","last_fullsized":"2024-09-19T15:32:34.593438+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-19T15:32:34.593248+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-19T15:32:34.593248+0000","last_clean_scrub_stamp":"2024-09-19T15:32:34.593248+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:13:26.005981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:27.609272+0000","last_change":"2024-09-19T15:32:27.609272+0000","last_active":"2024-09-19T15:32:27.609272+0000","last_peered":"2024-09-19T15:32:27.609272+0000","last_clean":"2024-09-19T15:32:27.609272+0000","last_became_active":"2024-09-19T14:02:29.723298+0000","last_became_peered":"2024-09-19T14:02:29.723298+0000","last_unstale":"2024-09-19T15:32:27.609272+0000","last_undegraded":"2024-09-19T15:32:27.609272+0000","last_fullsized":"2024-09-19T15:32:27.609272+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:27.609094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:27.609094+0000","last_clean_scrub_stamp":"2024-09-19T15:32:27.609094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:06.843611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'20","reported_seq":143,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:23.617945+0000","last_change":"2024-09-19T15:32:23.617681+0000","last_active":"2024-09-19T15:32:23.617945+0000","last_peered":"2024-09-19T15:32:23.617945+0000","last_clean":"2024-09-19T15:32:23.617945+0000","last_became_active":"2024-09-19T13:56:23.189485+0000","last_became_peered":"2024-09-19T13:56:23.189485+0000","last_unstale":"2024-09-19T15:32:23.617945+0000","last_undegraded":"2024-09-19T15:32:23.617945+0000","last_fullsized":"2024-09-19T15:32:23.617945+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'20","last_scrub_stamp":"2024-09-19T15:32:23.617397+0000","last_deep_scrub":"265'20","last_deep_scrub_stamp":"2024-09-19T15:32:23.617397+0000","last_clean_scrub_stamp":"2024-09-19T15:32:23.617397+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:00.650819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":106,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:35.568472+0000","last_change":"2024-09-19T15:32:35.568472+0000","last_active":"2024-09-19T15:32:35.568472+0000","last_peered":"2024-09-19T15:32:35.568472+0000","last_clean":"2024-09-19T15:32:35.568472+0000","last_became_active":"2024-09-19T14:29:51.028866+0000","last_became_peered":"2024-09-19T14:29:51.028866+0000","last_unstale":"2024-09-19T15:32:35.568472+0000","last_undegraded":"2024-09-19T15:32:35.568472+0000","last_fullsized":"2024-09-19T15:32:35.568472+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:35.568286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:35.568286+0000","last_clean_scrub_stamp":"2024-09-19T15:32:35.568286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:29:34.283543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'5","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:30.651695+0000","last_change":"2024-09-19T15:32:30.651695+0000","last_active":"2024-09-19T15:32:30.651695+0000","last_peered":"2024-09-19T15:32:30.651695+0000","last_clean":"2024-09-19T15:32:30.651695+0000","last_became_active":"2024-09-19T14:02:36.916389+0000","last_became_peered":"2024-09-19T14:02:36.916389+0000","last_unstale":"2024-09-19T15:32:30.651695+0000","last_undegraded":"2024-09-19T15:32:30.651695+0000","last_fullsized":"2024-09-19T15:32:30.651695+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-19T15:32:30.651485+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-19T15:32:30.651485+0000","last_clean_scrub_stamp":"2024-09-19T15:32:30.651485+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:40.775239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12336,"num_write":5,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"268'8","reported_seq":94,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:31.655735+0000","last_change":"2024-09-19T15:32:31.655735+0000","last_active":"2024-09-19T15:32:31.655735+0000","last_peered":"2024-09-19T15:32:31.655735+0000","last_clean":"2024-09-19T15:32:31.655735+0000","last_became_active":"2024-09-19T14:02:29.740227+0000","last_became_peered":"2024-09-19T14:02:29.740227+0000","last_unstale":"2024-09-19T15:32:31.655735+0000","last_undegraded":"2024-09-19T15:32:31.655735+0000","last_fullsized":"2024-09-19T15:32:31.655735+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-19T15:32:31.655511+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-19T15:32:31.655511+0000","last_clean_scrub_stamp":"2024-09-19T15:32:31.655511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:21:30.577104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":9218,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'41","reported_seq":199,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:14.653040+0000","last_change":"2024-09-19T15:32:14.653040+0000","last_active":"2024-09-19T15:32:14.653040+0000","last_peered":"2024-09-19T15:32:14.653040+0000","last_clean":"2024-09-19T15:32:14.653040+0000","last_became_active":"2024-09-19T13:56:23.173938+0000","last_became_peered":"2024-09-19T13:56:23.173938+0000","last_unstale":"2024-09-19T15:32:14.653040+0000","last_undegraded":"2024-09-19T15:32:14.653040+0000","last_fullsized":"2024-09-19T15:32:14.653040+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'41","last_scrub_stamp":"2024-09-19T15:32:14.652854+0000","last_deep_scrub":"268'41","last_deep_scrub_stamp":"2024-09-19T15:32:14.652854+0000","last_clean_scrub_stamp":"2024-09-19T15:32:14.652854+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:00:20.171224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":330,"num_read_kb":229,"num_write":110,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"268'2","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:14.028613+0000","last_change":"2024-09-19T15:32:14.028442+0000","last_active":"2024-09-19T15:32:14.028613+0000","last_peered":"2024-09-19T15:32:14.028613+0000","last_clean":"2024-09-19T15:32:14.028613+0000","last_became_active":"2024-09-19T14:29:51.025959+0000","last_became_peered":"2024-09-19T14:29:51.025959+0000","last_unstale":"2024-09-19T15:32:14.028613+0000","last_undegraded":"2024-09-19T15:32:14.028613+0000","last_fullsized":"2024-09-19T15:32:14.028613+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:14.028271+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:14.028271+0000","last_clean_scrub_stamp":"2024-09-19T15:32:14.028271+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:00.080778+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:21.694777+0000","last_change":"2024-09-19T15:32:21.694777+0000","last_active":"2024-09-19T15:32:21.694777+0000","last_peered":"2024-09-19T15:32:21.694777+0000","last_clean":"2024-09-19T15:32:21.694777+0000","last_became_active":"2024-09-19T14:02:36.911804+0000","last_became_peered":"2024-09-19T14:02:36.911804+0000","last_unstale":"2024-09-19T15:32:21.694777+0000","last_undegraded":"2024-09-19T15:32:21.694777+0000","last_fullsized":"2024-09-19T15:32:21.694777+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:21.694597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:21.694597+0000","last_clean_scrub_stamp":"2024-09-19T15:32:21.694597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:52.219045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"268'8","reported_seq":97,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:27.646410+0000","last_change":"2024-09-19T15:32:27.646410+0000","last_active":"2024-09-19T15:32:27.646410+0000","last_peered":"2024-09-19T15:32:27.646410+0000","last_clean":"2024-09-19T15:32:27.646410+0000","last_became_active":"2024-09-19T14:02:29.747553+0000","last_became_peered":"2024-09-19T14:02:29.747553+0000","last_unstale":"2024-09-19T15:32:27.646410+0000","last_undegraded":"2024-09-19T15:32:27.646410+0000","last_fullsized":"2024-09-19T15:32:27.646410+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-19T15:32:27.646219+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-19T15:32:27.646219+0000","last_clean_scrub_stamp":"2024-09-19T15:32:27.646219+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:19.597519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":21504,"num_write":8,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'275","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:25.562184+0000","last_change":"2024-09-19T15:32:25.562184+0000","last_active":"2024-09-19T15:32:25.562184+0000","last_peered":"2024-09-19T15:32:25.562184+0000","last_clean":"2024-09-19T15:32:25.562184+0000","last_became_active":"2024-09-19T13:56:23.185522+0000","last_became_peered":"2024-09-19T13:56:23.185522+0000","last_unstale":"2024-09-19T15:32:25.562184+0000","last_undegraded":"2024-09-19T15:32:25.562184+0000","last_fullsized":"2024-09-19T15:32:25.562184+0000","mapping_epoch":255,"log_start":"265'200","ondisk_log_start":"265'200","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'275","last_scrub_stamp":"2024-09-19T15:32:25.561999+0000","last_deep_scrub":"268'275","last_deep_scrub_stamp":"2024-09-19T15:32:25.561999+0000","last_clean_scrub_stamp":"2024-09-19T15:32:25.561999+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:58.252254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2606,"num_read_kb":3112,"num_write":537,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:41.593057+0000","last_change":"2024-09-19T15:32:41.592917+0000","last_active":"2024-09-19T15:32:41.593057+0000","last_peered":"2024-09-19T15:32:41.593057+0000","last_clean":"2024-09-19T15:32:41.593057+0000","last_became_active":"2024-09-19T14:29:51.042287+0000","last_became_peered":"2024-09-19T14:29:51.042287+0000","last_unstale":"2024-09-19T15:32:41.593057+0000","last_undegraded":"2024-09-19T15:32:41.593057+0000","last_fullsized":"2024-09-19T15:32:41.593057+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:41.592731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:41.592731+0000","last_clean_scrub_stamp":"2024-09-19T15:32:41.592731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:15.791463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"268'3","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:30.694245+0000","last_change":"2024-09-19T15:32:30.694245+0000","last_active":"2024-09-19T15:32:30.694245+0000","last_peered":"2024-09-19T15:32:30.694245+0000","last_clean":"2024-09-19T15:32:30.694245+0000","last_became_active":"2024-09-19T14:02:36.912642+0000","last_became_peered":"2024-09-19T14:02:36.912642+0000","last_unstale":"2024-09-19T15:32:30.694245+0000","last_undegraded":"2024-09-19T15:32:30.694245+0000","last_fullsized":"2024-09-19T15:32:30.694245+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:30.694055+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:30.694055+0000","last_clean_scrub_stamp":"2024-09-19T15:32:30.694055+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:51:58.875029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:28.611834+0000","last_change":"2024-09-19T15:32:28.611834+0000","last_active":"2024-09-19T15:32:28.611834+0000","last_peered":"2024-09-19T15:32:28.611834+0000","last_clean":"2024-09-19T15:32:28.611834+0000","last_became_active":"2024-09-19T14:02:29.739397+0000","last_became_peered":"2024-09-19T14:02:29.739397+0000","last_unstale":"2024-09-19T15:32:28.611834+0000","last_undegraded":"2024-09-19T15:32:28.611834+0000","last_fullsized":"2024-09-19T15:32:28.611834+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:28.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:28.611644+0000","last_clean_scrub_stamp":"2024-09-19T15:32:28.611644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:34.176899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'26","reported_seq":164,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:23.513521+0000","last_change":"2024-09-19T15:32:23.513521+0000","last_active":"2024-09-19T15:32:23.513521+0000","last_peered":"2024-09-19T15:32:23.513521+0000","last_clean":"2024-09-19T15:32:23.513521+0000","last_became_active":"2024-09-19T13:56:23.178722+0000","last_became_peered":"2024-09-19T13:56:23.178722+0000","last_unstale":"2024-09-19T15:32:23.513521+0000","last_undegraded":"2024-09-19T15:32:23.513521+0000","last_fullsized":"2024-09-19T15:32:23.513521+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-09-19T15:32:23.513292+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-09-19T15:32:23.513292+0000","last_clean_scrub_stamp":"2024-09-19T15:32:23.513292+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:23.938059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":137,"num_write":65,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:38.518914+0000","last_change":"2024-09-19T15:32:38.518914+0000","last_active":"2024-09-19T15:32:38.518914+0000","last_peered":"2024-09-19T15:32:38.518914+0000","last_clean":"2024-09-19T15:32:38.518914+0000","last_became_active":"2024-09-19T14:29:51.037398+0000","last_became_peered":"2024-09-19T14:29:51.037398+0000","last_unstale":"2024-09-19T15:32:38.518914+0000","last_undegraded":"2024-09-19T15:32:38.518914+0000","last_fullsized":"2024-09-19T15:32:38.518914+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:38.518733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:38.518733+0000","last_clean_scrub_stamp":"2024-09-19T15:32:38.518733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:26:28.980306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:19.232551+0000","last_change":"2024-09-19T15:32:19.232551+0000","last_active":"2024-09-19T15:32:19.232551+0000","last_peered":"2024-09-19T15:32:19.232551+0000","last_clean":"2024-09-19T15:32:19.232551+0000","last_became_active":"2024-09-19T14:02:36.928598+0000","last_became_peered":"2024-09-19T14:02:36.928598+0000","last_unstale":"2024-09-19T15:32:19.232551+0000","last_undegraded":"2024-09-19T15:32:19.232551+0000","last_fullsized":"2024-09-19T15:32:19.232551+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:19.232356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:19.232356+0000","last_clean_scrub_stamp":"2024-09-19T15:32:19.232356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:27:19.465367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"268'2","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:19.690478+0000","last_change":"2024-09-19T15:32:19.690478+0000","last_active":"2024-09-19T15:32:19.690478+0000","last_peered":"2024-09-19T15:32:19.690478+0000","last_clean":"2024-09-19T15:32:19.690478+0000","last_became_active":"2024-09-19T14:02:29.737082+0000","last_became_peered":"2024-09-19T14:02:29.737082+0000","last_unstale":"2024-09-19T15:32:19.690478+0000","last_undegraded":"2024-09-19T15:32:19.690478+0000","last_fullsized":"2024-09-19T15:32:19.690478+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:19.690288+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:19.690288+0000","last_clean_scrub_stamp":"2024-09-19T15:32:19.690288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:59:41.042363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'51","reported_seq":231,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:12.092894+0000","last_change":"2024-09-19T15:32:12.092747+0000","last_active":"2024-09-19T15:32:12.092894+0000","last_peered":"2024-09-19T15:32:12.092894+0000","last_clean":"2024-09-19T15:32:12.092894+0000","last_became_active":"2024-09-19T13:56:23.173172+0000","last_became_peered":"2024-09-19T13:56:23.173172+0000","last_unstale":"2024-09-19T15:32:12.092894+0000","last_undegraded":"2024-09-19T15:32:12.092894+0000","last_fullsized":"2024-09-19T15:32:12.092894+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'51","last_scrub_stamp":"2024-09-19T15:32:12.092566+0000","last_deep_scrub":"268'51","last_deep_scrub_stamp":"2024-09-19T15:32:12.092566+0000","last_clean_scrub_stamp":"2024-09-19T15:32:12.092566+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:04:40.498969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":432,"num_read_kb":295,"num_write":119,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:36.628282+0000","last_change":"2024-09-19T15:32:36.628282+0000","last_active":"2024-09-19T15:32:36.628282+0000","last_peered":"2024-09-19T15:32:36.628282+0000","last_clean":"2024-09-19T15:32:36.628282+0000","last_became_active":"2024-09-19T14:29:51.047826+0000","last_became_peered":"2024-09-19T14:29:51.047826+0000","last_unstale":"2024-09-19T15:32:36.628282+0000","last_undegraded":"2024-09-19T15:32:36.628282+0000","last_fullsized":"2024-09-19T15:32:36.628282+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:36.628097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:36.628097+0000","last_clean_scrub_stamp":"2024-09-19T15:32:36.628097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:53.346515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'5","reported_seq":89,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:29.611332+0000","last_change":"2024-09-19T15:32:29.611332+0000","last_active":"2024-09-19T15:32:29.611332+0000","last_peered":"2024-09-19T15:32:29.611332+0000","last_clean":"2024-09-19T15:32:29.611332+0000","last_became_active":"2024-09-19T14:02:36.910154+0000","last_became_peered":"2024-09-19T14:02:36.910154+0000","last_unstale":"2024-09-19T15:32:29.611332+0000","last_undegraded":"2024-09-19T15:32:29.611332+0000","last_fullsized":"2024-09-19T15:32:29.611332+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-19T15:32:29.611105+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-19T15:32:29.611105+0000","last_clean_scrub_stamp":"2024-09-19T15:32:29.611105+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:24.269510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"268'2","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:16.181486+0000","last_change":"2024-09-19T15:32:16.181486+0000","last_active":"2024-09-19T15:32:16.181486+0000","last_peered":"2024-09-19T15:32:16.181486+0000","last_clean":"2024-09-19T15:32:16.181486+0000","last_became_active":"2024-09-19T14:02:29.723084+0000","last_became_peered":"2024-09-19T14:02:29.723084+0000","last_unstale":"2024-09-19T15:32:16.181486+0000","last_undegraded":"2024-09-19T15:32:16.181486+0000","last_fullsized":"2024-09-19T15:32:16.181486+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:16.181300+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:16.181300+0000","last_clean_scrub_stamp":"2024-09-19T15:32:16.181300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:13:52.521060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'52","reported_seq":226,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:22.596736+0000","last_change":"2024-09-19T15:32:22.596581+0000","last_active":"2024-09-19T15:32:22.596736+0000","last_peered":"2024-09-19T15:32:22.596736+0000","last_clean":"2024-09-19T15:32:22.596736+0000","last_became_active":"2024-09-19T13:56:23.181354+0000","last_became_peered":"2024-09-19T13:56:23.181354+0000","last_unstale":"2024-09-19T15:32:22.596736+0000","last_undegraded":"2024-09-19T15:32:22.596736+0000","last_fullsized":"2024-09-19T15:32:22.596736+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'52","last_scrub_stamp":"2024-09-19T15:32:22.596389+0000","last_deep_scrub":"268'52","last_deep_scrub_stamp":"2024-09-19T15:32:22.596389+0000","last_clean_scrub_stamp":"2024-09-19T15:32:22.596389+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:36:49.263021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":381,"num_read_kb":254,"num_write":133,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'384","reported_seq":1097,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.661911+0000","last_change":"2024-09-19T15:32:00.661911+0000","last_active":"2024-09-19T15:32:00.661911+0000","last_peered":"2024-09-19T15:32:00.661911+0000","last_clean":"2024-09-19T15:32:00.661911+0000","last_became_active":"2024-09-19T13:40:34.278366+0000","last_became_peered":"2024-09-19T13:40:34.278366+0000","last_unstale":"2024-09-19T15:32:00.661911+0000","last_undegraded":"2024-09-19T15:32:00.661911+0000","last_fullsized":"2024-09-19T15:32:00.661911+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'384","last_scrub_stamp":"2024-09-19T15:32:00.661714+0000","last_deep_scrub":"268'384","last_deep_scrub_stamp":"2024-09-19T15:32:00.661714+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.661714+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:17:20.451042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":664,"num_read_kb":97882,"num_write":1263,"num_write_kb":51204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'904","reported_seq":2638,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.758397+0000","last_change":"2024-09-19T15:32:05.758397+0000","last_active":"2024-09-19T15:32:05.758397+0000","last_peered":"2024-09-19T15:32:05.758397+0000","last_clean":"2024-09-19T15:32:05.758397+0000","last_became_active":"2024-09-19T13:40:36.233265+0000","last_became_peered":"2024-09-19T13:40:36.233265+0000","last_unstale":"2024-09-19T15:32:05.758397+0000","last_undegraded":"2024-09-19T15:32:05.758397+0000","last_fullsized":"2024-09-19T15:32:05.758397+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'904","last_scrub_stamp":"2024-09-19T15:32:05.758196+0000","last_deep_scrub":"268'904","last_deep_scrub_stamp":"2024-09-19T15:32:05.758196+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.758196+0000","objects_scrubbed":8,"log_size":104,"log_dups_size":800,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:22:11.832649+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4503,"num_read_kb":4037,"num_write":1205,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3446,"num_omap_keys":14,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'293","reported_seq":924,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.638153+0000","last_change":"2024-09-19T15:31:50.638153+0000","last_active":"2024-09-19T15:31:50.638153+0000","last_peered":"2024-09-19T15:31:50.638153+0000","last_clean":"2024-09-19T15:31:50.638153+0000","last_became_active":"2024-09-19T13:40:34.240412+0000","last_became_peered":"2024-09-19T13:40:34.240412+0000","last_unstale":"2024-09-19T15:31:50.638153+0000","last_undegraded":"2024-09-19T15:31:50.638153+0000","last_fullsized":"2024-09-19T15:31:50.638153+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'293","last_scrub_stamp":"2024-09-19T15:31:50.637951+0000","last_deep_scrub":"268'293","last_deep_scrub_stamp":"2024-09-19T15:31:50.637951+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.637951+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:16.720237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":459,"num_read_kb":36198,"num_write":952,"num_write_kb":29274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'624","reported_seq":2335,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.730768+0000","last_change":"2024-09-19T15:32:04.730768+0000","last_active":"2024-09-19T15:32:04.730768+0000","last_peered":"2024-09-19T15:32:04.730768+0000","last_clean":"2024-09-19T15:32:04.730768+0000","last_became_active":"2024-09-19T13:40:36.232504+0000","last_became_peered":"2024-09-19T13:40:36.232504+0000","last_unstale":"2024-09-19T15:32:04.730768+0000","last_undegraded":"2024-09-19T15:32:04.730768+0000","last_fullsized":"2024-09-19T15:32:04.730768+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'624","last_scrub_stamp":"2024-09-19T15:32:04.730583+0000","last_deep_scrub":"268'624","last_deep_scrub_stamp":"2024-09-19T15:32:04.730583+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.730583+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":600,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:57:53.057219+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3362,"num_read_kb":3070,"num_write":813,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'361","reported_seq":1050,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.669495+0000","last_change":"2024-09-19T15:31:51.669495+0000","last_active":"2024-09-19T15:31:51.669495+0000","last_peered":"2024-09-19T15:31:51.669495+0000","last_clean":"2024-09-19T15:31:51.669495+0000","last_became_active":"2024-09-19T13:40:34.215960+0000","last_became_peered":"2024-09-19T13:40:34.215960+0000","last_unstale":"2024-09-19T15:31:51.669495+0000","last_undegraded":"2024-09-19T15:31:51.669495+0000","last_fullsized":"2024-09-19T15:31:51.669495+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'361","last_scrub_stamp":"2024-09-19T15:31:51.669302+0000","last_deep_scrub":"268'361","last_deep_scrub_stamp":"2024-09-19T15:31:51.669302+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.669302+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:44:16.452038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":684,"num_read_kb":31785,"num_write":1188,"num_write_kb":29902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'840","reported_seq":2398,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.563507+0000","last_change":"2024-09-19T15:32:04.563507+0000","last_active":"2024-09-19T15:32:04.563507+0000","last_peered":"2024-09-19T15:32:04.563507+0000","last_clean":"2024-09-19T15:32:04.563507+0000","last_became_active":"2024-09-19T13:40:36.220563+0000","last_became_peered":"2024-09-19T13:40:36.220563+0000","last_unstale":"2024-09-19T15:32:04.563507+0000","last_undegraded":"2024-09-19T15:32:04.563507+0000","last_fullsized":"2024-09-19T15:32:04.563507+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'840","last_scrub_stamp":"2024-09-19T15:32:04.563306+0000","last_deep_scrub":"268'840","last_deep_scrub_stamp":"2024-09-19T15:32:04.563306+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.563306+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":800,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:04:09.857112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4017,"num_read_kb":3603,"num_write":1098,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'358","reported_seq":1039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.799136+0000","last_change":"2024-09-19T15:32:00.799136+0000","last_active":"2024-09-19T15:32:00.799136+0000","last_peered":"2024-09-19T15:32:00.799136+0000","last_clean":"2024-09-19T15:32:00.799136+0000","last_became_active":"2024-09-19T13:40:34.239843+0000","last_became_peered":"2024-09-19T13:40:34.239843+0000","last_unstale":"2024-09-19T15:32:00.799136+0000","last_undegraded":"2024-09-19T15:32:00.799136+0000","last_fullsized":"2024-09-19T15:32:00.799136+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'358","last_scrub_stamp":"2024-09-19T15:32:00.798848+0000","last_deep_scrub":"268'358","last_deep_scrub_stamp":"2024-09-19T15:32:00.798848+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.798848+0000","objects_scrubbed":7,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:22:42.485481+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136873,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":579,"num_read_kb":4189,"num_write":1155,"num_write_kb":27975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'1557","reported_seq":3234,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.739899+0000","last_change":"2024-09-19T15:32:00.739899+0000","last_active":"2024-09-19T15:32:00.739899+0000","last_peered":"2024-09-19T15:32:00.739899+0000","last_clean":"2024-09-19T15:32:00.739899+0000","last_became_active":"2024-09-19T13:40:36.225954+0000","last_became_peered":"2024-09-19T13:40:36.225954+0000","last_unstale":"2024-09-19T15:32:00.739899+0000","last_undegraded":"2024-09-19T15:32:00.739899+0000","last_fullsized":"2024-09-19T15:32:00.739899+0000","mapping_epoch":27,"log_start":"268'1500","ondisk_log_start":"268'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1557","last_scrub_stamp":"2024-09-19T15:32:00.739686+0000","last_deep_scrub":"268'1557","last_deep_scrub_stamp":"2024-09-19T15:32:00.739686+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.739686+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":1500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:51:44.541143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7021,"num_read_kb":6136,"num_write":2176,"num_write_kb":944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'323","reported_seq":1034,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.653559+0000","last_change":"2024-09-19T15:31:58.653559+0000","last_active":"2024-09-19T15:31:58.653559+0000","last_peered":"2024-09-19T15:31:58.653559+0000","last_clean":"2024-09-19T15:31:58.653559+0000","last_became_active":"2024-09-19T13:40:34.267254+0000","last_became_peered":"2024-09-19T13:40:34.267254+0000","last_unstale":"2024-09-19T15:31:58.653559+0000","last_undegraded":"2024-09-19T15:31:58.653559+0000","last_fullsized":"2024-09-19T15:31:58.653559+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'323","last_scrub_stamp":"2024-09-19T15:31:58.653334+0000","last_deep_scrub":"268'323","last_deep_scrub_stamp":"2024-09-19T15:31:58.653334+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.653334+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:29:03.902030+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":674,"num_read_kb":4762,"num_write":931,"num_write_kb":10224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"268'448","reported_seq":2108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.925601+0000","last_change":"2024-09-19T15:31:58.925601+0000","last_active":"2024-09-19T15:31:58.925601+0000","last_peered":"2024-09-19T15:31:58.925601+0000","last_clean":"2024-09-19T15:31:58.925601+0000","last_became_active":"2024-09-19T13:40:36.220431+0000","last_became_peered":"2024-09-19T13:40:36.220431+0000","last_unstale":"2024-09-19T15:31:58.925601+0000","last_undegraded":"2024-09-19T15:31:58.925601+0000","last_fullsized":"2024-09-19T15:31:58.925601+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'448","last_scrub_stamp":"2024-09-19T15:31:58.925377+0000","last_deep_scrub":"268'448","last_deep_scrub_stamp":"2024-09-19T15:31:58.925377+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.925377+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:32.879919+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2602,"num_read_kb":2484,"num_write":543,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'313","reported_seq":967,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.808520+0000","last_change":"2024-09-19T15:31:59.808520+0000","last_active":"2024-09-19T15:31:59.808520+0000","last_peered":"2024-09-19T15:31:59.808520+0000","last_clean":"2024-09-19T15:31:59.808520+0000","last_became_active":"2024-09-19T13:40:34.218957+0000","last_became_peered":"2024-09-19T13:40:34.218957+0000","last_unstale":"2024-09-19T15:31:59.808520+0000","last_undegraded":"2024-09-19T15:31:59.808520+0000","last_fullsized":"2024-09-19T15:31:59.808520+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'313","last_scrub_stamp":"2024-09-19T15:31:59.808323+0000","last_deep_scrub":"268'313","last_deep_scrub_stamp":"2024-09-19T15:31:59.808323+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.808323+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:28:51.505054+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136870,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":503,"num_read_kb":8139,"num_write":970,"num_write_kb":24727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'797","reported_seq":2568,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.543607+0000","last_change":"2024-09-19T15:32:06.543607+0000","last_active":"2024-09-19T15:32:06.543607+0000","last_peered":"2024-09-19T15:32:06.543607+0000","last_clean":"2024-09-19T15:32:06.543607+0000","last_became_active":"2024-09-19T13:40:36.228785+0000","last_became_peered":"2024-09-19T13:40:36.228785+0000","last_unstale":"2024-09-19T15:32:06.543607+0000","last_undegraded":"2024-09-19T15:32:06.543607+0000","last_fullsized":"2024-09-19T15:32:06.543607+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'797","last_scrub_stamp":"2024-09-19T15:32:06.543396+0000","last_deep_scrub":"268'797","last_deep_scrub_stamp":"2024-09-19T15:32:06.543396+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.543396+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:52:36.348722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4179,"num_read_kb":3830,"num_write":1044,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'342","reported_seq":998,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.666756+0000","last_change":"2024-09-19T15:31:57.666756+0000","last_active":"2024-09-19T15:31:57.666756+0000","last_peered":"2024-09-19T15:31:57.666756+0000","last_clean":"2024-09-19T15:31:57.666756+0000","last_became_active":"2024-09-19T13:40:34.267647+0000","last_became_peered":"2024-09-19T13:40:34.267647+0000","last_unstale":"2024-09-19T15:31:57.666756+0000","last_undegraded":"2024-09-19T15:31:57.666756+0000","last_fullsized":"2024-09-19T15:31:57.666756+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'342","last_scrub_stamp":"2024-09-19T15:31:57.666543+0000","last_deep_scrub":"268'342","last_deep_scrub_stamp":"2024-09-19T15:31:57.666543+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.666543+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:41:13.021177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":19593,"num_write":1075,"num_write_kb":28817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"268'1157","reported_seq":2785,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.773733+0000","last_change":"2024-09-19T15:32:07.773733+0000","last_active":"2024-09-19T15:32:07.773733+0000","last_peered":"2024-09-19T15:32:07.773733+0000","last_clean":"2024-09-19T15:32:07.773733+0000","last_became_active":"2024-09-19T13:40:36.230581+0000","last_became_peered":"2024-09-19T13:40:36.230581+0000","last_unstale":"2024-09-19T15:32:07.773733+0000","last_undegraded":"2024-09-19T15:32:07.773733+0000","last_fullsized":"2024-09-19T15:32:07.773733+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1157","last_scrub_stamp":"2024-09-19T15:32:07.773545+0000","last_deep_scrub":"268'1157","last_deep_scrub_stamp":"2024-09-19T15:32:07.773545+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.773545+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":1100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:38.669375+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5418,"num_read_kb":4799,"num_write":1598,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'386","reported_seq":1137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.947499+0000","last_change":"2024-09-19T15:31:55.947499+0000","last_active":"2024-09-19T15:31:55.947499+0000","last_peered":"2024-09-19T15:31:55.947499+0000","last_clean":"2024-09-19T15:31:55.947499+0000","last_became_active":"2024-09-19T13:40:34.237561+0000","last_became_peered":"2024-09-19T13:40:34.237561+0000","last_unstale":"2024-09-19T15:31:55.947499+0000","last_undegraded":"2024-09-19T15:31:55.947499+0000","last_fullsized":"2024-09-19T15:31:55.947499+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'386","last_scrub_stamp":"2024-09-19T15:31:55.947285+0000","last_deep_scrub":"268'386","last_deep_scrub_stamp":"2024-09-19T15:31:55.947285+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.947285+0000","objects_scrubbed":8,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:40:34.514330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136898,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":851,"num_read_kb":72188,"num_write":1180,"num_write_kb":41551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'653","reported_seq":2366,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.862758+0000","last_change":"2024-09-19T15:31:57.862758+0000","last_active":"2024-09-19T15:31:57.862758+0000","last_peered":"2024-09-19T15:31:57.862758+0000","last_clean":"2024-09-19T15:31:57.862758+0000","last_became_active":"2024-09-19T13:40:36.221587+0000","last_became_peered":"2024-09-19T13:40:36.221587+0000","last_unstale":"2024-09-19T15:31:57.862758+0000","last_undegraded":"2024-09-19T15:31:57.862758+0000","last_fullsized":"2024-09-19T15:31:57.862758+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'653","last_scrub_stamp":"2024-09-19T15:31:57.862563+0000","last_deep_scrub":"268'653","last_deep_scrub_stamp":"2024-09-19T15:31:57.862563+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.862563+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":600,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:10:32.434848+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3331,"num_read_kb":3024,"num_write":858,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'1221","reported_seq":3039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.529686+0000","last_change":"2024-09-19T15:32:03.529541+0000","last_active":"2024-09-19T15:32:03.529686+0000","last_peered":"2024-09-19T15:32:03.529686+0000","last_clean":"2024-09-19T15:32:03.529686+0000","last_became_active":"2024-09-19T13:40:36.220889+0000","last_became_peered":"2024-09-19T13:40:36.220889+0000","last_unstale":"2024-09-19T15:32:03.529686+0000","last_undegraded":"2024-09-19T15:32:03.529686+0000","last_fullsized":"2024-09-19T15:32:03.529686+0000","mapping_epoch":27,"log_start":"268'1200","ondisk_log_start":"268'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1221","last_scrub_stamp":"2024-09-19T15:32:03.529327+0000","last_deep_scrub":"268'1221","last_deep_scrub_stamp":"2024-09-19T15:32:03.529327+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.529327+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":1200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:46.924744+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5895,"num_read_kb":5235,"num_write":1696,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2040,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'416","reported_seq":1155,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.627136+0000","last_change":"2024-09-19T15:31:59.626980+0000","last_active":"2024-09-19T15:31:59.627136+0000","last_peered":"2024-09-19T15:31:59.627136+0000","last_clean":"2024-09-19T15:31:59.627136+0000","last_became_active":"2024-09-19T13:40:34.278991+0000","last_became_peered":"2024-09-19T13:40:34.278991+0000","last_unstale":"2024-09-19T15:31:59.627136+0000","last_undegraded":"2024-09-19T15:31:59.627136+0000","last_fullsized":"2024-09-19T15:31:59.627136+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'416","last_scrub_stamp":"2024-09-19T15:31:59.626756+0000","last_deep_scrub":"268'416","last_deep_scrub_stamp":"2024-09-19T15:31:59.626756+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.626756+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:27:36.553637+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136848,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":967,"num_read_kb":8273,"num_write":1275,"num_write_kb":26935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'1135","reported_seq":2659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.698303+0000","last_change":"2024-09-19T15:32:03.698161+0000","last_active":"2024-09-19T15:32:03.698303+0000","last_peered":"2024-09-19T15:32:03.698303+0000","last_clean":"2024-09-19T15:32:03.698303+0000","last_became_active":"2024-09-19T13:40:36.233032+0000","last_became_peered":"2024-09-19T13:40:36.233032+0000","last_unstale":"2024-09-19T15:32:03.698303+0000","last_undegraded":"2024-09-19T15:32:03.698303+0000","last_fullsized":"2024-09-19T15:32:03.698303+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1135","last_scrub_stamp":"2024-09-19T15:32:03.697969+0000","last_deep_scrub":"268'1135","last_deep_scrub_stamp":"2024-09-19T15:32:03.697969+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.697969+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":1100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:38.136899+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5185,"num_read_kb":4564,"num_write":1576,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'361","reported_seq":1029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.926301+0000","last_change":"2024-09-19T15:31:54.926301+0000","last_active":"2024-09-19T15:31:54.926301+0000","last_peered":"2024-09-19T15:31:54.926301+0000","last_clean":"2024-09-19T15:31:54.926301+0000","last_became_active":"2024-09-19T13:40:34.257994+0000","last_became_peered":"2024-09-19T13:40:34.257994+0000","last_unstale":"2024-09-19T15:31:54.926301+0000","last_undegraded":"2024-09-19T15:31:54.926301+0000","last_fullsized":"2024-09-19T15:31:54.926301+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'361","last_scrub_stamp":"2024-09-19T15:31:54.925917+0000","last_deep_scrub":"268'361","last_deep_scrub_stamp":"2024-09-19T15:31:54.925917+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.925917+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:27:05.992674+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":609,"num_read_kb":26261,"num_write":1202,"num_write_kb":39497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"268'592","reported_seq":2579,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.748952+0000","last_change":"2024-09-19T15:32:04.748952+0000","last_active":"2024-09-19T15:32:04.748952+0000","last_peered":"2024-09-19T15:32:04.748952+0000","last_clean":"2024-09-19T15:32:04.748952+0000","last_became_active":"2024-09-19T13:40:36.231554+0000","last_became_peered":"2024-09-19T13:40:36.231554+0000","last_unstale":"2024-09-19T15:32:04.748952+0000","last_undegraded":"2024-09-19T15:32:04.748952+0000","last_fullsized":"2024-09-19T15:32:04.748952+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'592","last_scrub_stamp":"2024-09-19T15:32:04.748748+0000","last_deep_scrub":"268'592","last_deep_scrub_stamp":"2024-09-19T15:32:04.748748+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.748748+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":500,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:25.544452+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3450,"num_read_kb":3252,"num_write":736,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2777,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'354","reported_seq":1003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.894244+0000","last_change":"2024-09-19T15:31:51.894244+0000","last_active":"2024-09-19T15:31:51.894244+0000","last_peered":"2024-09-19T15:31:51.894244+0000","last_clean":"2024-09-19T15:31:51.894244+0000","last_became_active":"2024-09-19T13:40:34.264349+0000","last_became_peered":"2024-09-19T13:40:34.264349+0000","last_unstale":"2024-09-19T15:31:51.894244+0000","last_undegraded":"2024-09-19T15:31:51.894244+0000","last_fullsized":"2024-09-19T15:31:51.894244+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'354","last_scrub_stamp":"2024-09-19T15:31:51.894022+0000","last_deep_scrub":"268'354","last_deep_scrub_stamp":"2024-09-19T15:31:51.894022+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.894022+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:08.557909+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":590,"num_read_kb":18139,"num_write":1138,"num_write_kb":28020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'536","reported_seq":2168,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.817859+0000","last_change":"2024-09-19T15:31:56.817859+0000","last_active":"2024-09-19T15:31:56.817859+0000","last_peered":"2024-09-19T15:31:56.817859+0000","last_clean":"2024-09-19T15:31:56.817859+0000","last_became_active":"2024-09-19T13:40:36.221266+0000","last_became_peered":"2024-09-19T13:40:36.221266+0000","last_unstale":"2024-09-19T15:31:56.817859+0000","last_undegraded":"2024-09-19T15:31:56.817859+0000","last_fullsized":"2024-09-19T15:31:56.817859+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'536","last_scrub_stamp":"2024-09-19T15:31:56.817666+0000","last_deep_scrub":"268'536","last_deep_scrub_stamp":"2024-09-19T15:31:56.817666+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.817666+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":500,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:15.258731+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2921,"num_read_kb":2700,"num_write":709,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'351","reported_seq":1207,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.497107+0000","last_change":"2024-09-19T15:31:50.497107+0000","last_active":"2024-09-19T15:31:50.497107+0000","last_peered":"2024-09-19T15:31:50.497107+0000","last_clean":"2024-09-19T15:31:50.497107+0000","last_became_active":"2024-09-19T13:40:34.262084+0000","last_became_peered":"2024-09-19T13:40:34.262084+0000","last_unstale":"2024-09-19T15:31:50.497107+0000","last_undegraded":"2024-09-19T15:31:50.497107+0000","last_fullsized":"2024-09-19T15:31:50.497107+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'351","last_scrub_stamp":"2024-09-19T15:31:50.496887+0000","last_deep_scrub":"268'351","last_deep_scrub_stamp":"2024-09-19T15:31:50.496887+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.496887+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:55:19.272837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1177,"num_read_kb":45013,"num_write":1025,"num_write_kb":26916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"268'462","reported_seq":2076,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.816018+0000","last_change":"2024-09-19T15:31:54.816018+0000","last_active":"2024-09-19T15:31:54.816018+0000","last_peered":"2024-09-19T15:31:54.816018+0000","last_clean":"2024-09-19T15:31:54.816018+0000","last_became_active":"2024-09-19T13:40:36.216082+0000","last_became_peered":"2024-09-19T13:40:36.216082+0000","last_unstale":"2024-09-19T15:31:54.816018+0000","last_undegraded":"2024-09-19T15:31:54.816018+0000","last_fullsized":"2024-09-19T15:31:54.816018+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'462","last_scrub_stamp":"2024-09-19T15:31:54.815843+0000","last_deep_scrub":"268'462","last_deep_scrub_stamp":"2024-09-19T15:31:54.815843+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.815843+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:57.752317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2409,"num_read_kb":2273,"num_write":537,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'339","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.915768+0000","last_change":"2024-09-19T15:31:54.915768+0000","last_active":"2024-09-19T15:31:54.915768+0000","last_peered":"2024-09-19T15:31:54.915768+0000","last_clean":"2024-09-19T15:31:54.915768+0000","last_became_active":"2024-09-19T13:40:34.237589+0000","last_became_peered":"2024-09-19T13:40:34.237589+0000","last_unstale":"2024-09-19T15:31:54.915768+0000","last_undegraded":"2024-09-19T15:31:54.915768+0000","last_fullsized":"2024-09-19T15:31:54.915768+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-19T15:31:54.915566+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-19T15:31:54.915566+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.915566+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:43.777729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":471,"num_read_kb":27580,"num_write":960,"num_write_kb":52672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'578","reported_seq":2271,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.519448+0000","last_change":"2024-09-19T15:32:05.519448+0000","last_active":"2024-09-19T15:32:05.519448+0000","last_peered":"2024-09-19T15:32:05.519448+0000","last_clean":"2024-09-19T15:32:05.519448+0000","last_became_active":"2024-09-19T13:40:36.220183+0000","last_became_peered":"2024-09-19T13:40:36.220183+0000","last_unstale":"2024-09-19T15:32:05.519448+0000","last_undegraded":"2024-09-19T15:32:05.519448+0000","last_fullsized":"2024-09-19T15:32:05.519448+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'578","last_scrub_stamp":"2024-09-19T15:32:05.519220+0000","last_deep_scrub":"268'578","last_deep_scrub_stamp":"2024-09-19T15:32:05.519220+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.519220+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":500,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:28.549608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3052,"num_read_kb":2823,"num_write":743,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'385","reported_seq":1099,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.717970+0000","last_change":"2024-09-19T15:31:52.717970+0000","last_active":"2024-09-19T15:31:52.717970+0000","last_peered":"2024-09-19T15:31:52.717970+0000","last_clean":"2024-09-19T15:31:52.717970+0000","last_became_active":"2024-09-19T13:40:34.224813+0000","last_became_peered":"2024-09-19T13:40:34.224813+0000","last_unstale":"2024-09-19T15:31:52.717970+0000","last_undegraded":"2024-09-19T15:31:52.717970+0000","last_fullsized":"2024-09-19T15:31:52.717970+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'385","last_scrub_stamp":"2024-09-19T15:31:52.717747+0000","last_deep_scrub":"268'385","last_deep_scrub_stamp":"2024-09-19T15:31:52.717747+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.717747+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:25:38.923053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":831,"num_read_kb":1243,"num_write":1485,"num_write_kb":25860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'141","reported_seq":675,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:20.588361+0000","last_change":"2024-09-19T15:32:20.588361+0000","last_active":"2024-09-19T15:32:20.588361+0000","last_peered":"2024-09-19T15:32:20.588361+0000","last_clean":"2024-09-19T15:32:20.588361+0000","last_became_active":"2024-09-19T13:40:44.242028+0000","last_became_peered":"2024-09-19T13:40:44.242028+0000","last_unstale":"2024-09-19T15:32:20.588361+0000","last_undegraded":"2024-09-19T15:32:20.588361+0000","last_fullsized":"2024-09-19T15:32:20.588361+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'141","last_scrub_stamp":"2024-09-19T15:32:20.588175+0000","last_deep_scrub":"268'141","last_deep_scrub_stamp":"2024-09-19T15:32:20.588175+0000","last_clean_scrub_stamp":"2024-09-19T15:32:20.588175+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:35.558306+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":180,"num_write":320,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'410","reported_seq":1942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.052954+0000","last_change":"2024-09-19T15:32:01.052954+0000","last_active":"2024-09-19T15:32:01.052954+0000","last_peered":"2024-09-19T15:32:01.052954+0000","last_clean":"2024-09-19T15:32:01.052954+0000","last_became_active":"2024-09-19T13:40:36.218091+0000","last_became_peered":"2024-09-19T13:40:36.218091+0000","last_unstale":"2024-09-19T15:32:01.052954+0000","last_undegraded":"2024-09-19T15:32:01.052954+0000","last_fullsized":"2024-09-19T15:32:01.052954+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'410","last_scrub_stamp":"2024-09-19T15:32:01.052731+0000","last_deep_scrub":"268'410","last_deep_scrub_stamp":"2024-09-19T15:32:01.052731+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.052731+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:54:24.981092+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2211,"num_read_kb":2096,"num_write":485,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"268'348","reported_seq":990,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.881044+0000","last_change":"2024-09-19T15:31:50.881044+0000","last_active":"2024-09-19T15:31:50.881044+0000","last_peered":"2024-09-19T15:31:50.881044+0000","last_clean":"2024-09-19T15:31:50.881044+0000","last_became_active":"2024-09-19T13:41:05.386216+0000","last_became_peered":"2024-09-19T13:41:05.386216+0000","last_unstale":"2024-09-19T15:31:50.881044+0000","last_undegraded":"2024-09-19T15:31:50.881044+0000","last_fullsized":"2024-09-19T15:31:50.881044+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'348","last_scrub_stamp":"2024-09-19T15:31:50.880838+0000","last_deep_scrub":"268'348","last_deep_scrub_stamp":"2024-09-19T15:31:50.880838+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.880838+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:14.516054+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":616,"num_read_kb":13820,"num_write":1168,"num_write_kb":52710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:10.688994+0000","last_change":"2024-09-19T15:32:10.688994+0000","last_active":"2024-09-19T15:32:10.688994+0000","last_peered":"2024-09-19T15:32:10.688994+0000","last_clean":"2024-09-19T15:32:10.688994+0000","last_became_active":"2024-09-19T13:40:38.222863+0000","last_became_peered":"2024-09-19T13:40:38.222863+0000","last_unstale":"2024-09-19T15:32:10.688994+0000","last_undegraded":"2024-09-19T15:32:10.688994+0000","last_fullsized":"2024-09-19T15:32:10.688994+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:10.688812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:10.688812+0000","last_clean_scrub_stamp":"2024-09-19T15:32:10.688812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:42.956381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'388","reported_seq":1042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.693514+0000","last_change":"2024-09-19T15:32:07.693514+0000","last_active":"2024-09-19T15:32:07.693514+0000","last_peered":"2024-09-19T15:32:07.693514+0000","last_clean":"2024-09-19T15:32:07.693514+0000","last_became_active":"2024-09-19T13:40:40.230368+0000","last_became_peered":"2024-09-19T13:40:40.230368+0000","last_unstale":"2024-09-19T15:32:07.693514+0000","last_undegraded":"2024-09-19T15:32:07.693514+0000","last_fullsized":"2024-09-19T15:32:07.693514+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'388","last_scrub_stamp":"2024-09-19T15:32:07.693335+0000","last_deep_scrub":"268'388","last_deep_scrub_stamp":"2024-09-19T15:32:07.693335+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.693335+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:40:16.124155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46964,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":623,"num_read_kb":1259,"num_write":490,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:18.700662+0000","last_change":"2024-09-19T15:32:18.700662+0000","last_active":"2024-09-19T15:32:18.700662+0000","last_peered":"2024-09-19T15:32:18.700662+0000","last_clean":"2024-09-19T15:32:18.700662+0000","last_became_active":"2024-09-19T13:40:42.240244+0000","last_became_peered":"2024-09-19T13:40:42.240244+0000","last_unstale":"2024-09-19T15:32:18.700662+0000","last_undegraded":"2024-09-19T15:32:18.700662+0000","last_fullsized":"2024-09-19T15:32:18.700662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:18.700485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:18.700485+0000","last_clean_scrub_stamp":"2024-09-19T15:32:18.700485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:04:21.150878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'2489","reported_seq":4356,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:23.643216+0000","last_change":"2024-09-19T15:32:23.643216+0000","last_active":"2024-09-19T15:32:23.643216+0000","last_peered":"2024-09-19T15:32:23.643216+0000","last_clean":"2024-09-19T15:32:23.643216+0000","last_became_active":"2024-09-19T13:40:44.263152+0000","last_became_peered":"2024-09-19T13:40:44.263152+0000","last_unstale":"2024-09-19T15:32:23.643216+0000","last_undegraded":"2024-09-19T15:32:23.643216+0000","last_fullsized":"2024-09-19T15:32:23.643216+0000","mapping_epoch":35,"log_start":"268'2400","ondisk_log_start":"268'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2489","last_scrub_stamp":"2024-09-19T15:32:23.643031+0000","last_deep_scrub":"268'2489","last_deep_scrub_stamp":"2024-09-19T15:32:23.643031+0000","last_clean_scrub_stamp":"2024-09-19T15:32:23.643031+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":2400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:42.489155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6208,"num_read_kb":6212,"num_write":5020,"num_write_kb":1848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'370","reported_seq":1876,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.779015+0000","last_change":"2024-09-19T15:32:02.779015+0000","last_active":"2024-09-19T15:32:02.779015+0000","last_peered":"2024-09-19T15:32:02.779015+0000","last_clean":"2024-09-19T15:32:02.779015+0000","last_became_active":"2024-09-19T13:40:36.242260+0000","last_became_peered":"2024-09-19T13:40:36.242260+0000","last_unstale":"2024-09-19T15:32:02.779015+0000","last_undegraded":"2024-09-19T15:32:02.779015+0000","last_fullsized":"2024-09-19T15:32:02.779015+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-19T15:32:02.778799+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-19T15:32:02.778799+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.778799+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:58:11.339987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2141,"num_read_kb":2035,"num_write":405,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'304","reported_seq":967,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:45.643430+0000","last_change":"2024-09-19T15:31:45.643356+0000","last_active":"2024-09-19T15:31:45.643430+0000","last_peered":"2024-09-19T15:31:45.643430+0000","last_clean":"2024-09-19T15:31:45.643430+0000","last_became_active":"2024-09-19T13:40:34.254811+0000","last_became_peered":"2024-09-19T13:40:34.254811+0000","last_unstale":"2024-09-19T15:31:45.643430+0000","last_undegraded":"2024-09-19T15:31:45.643430+0000","last_fullsized":"2024-09-19T15:31:45.643430+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'304","last_scrub_stamp":"2024-09-19T15:31:45.643211+0000","last_deep_scrub":"268'304","last_deep_scrub_stamp":"2024-09-19T15:31:45.643211+0000","last_clean_scrub_stamp":"2024-09-19T15:31:45.643211+0000","objects_scrubbed":8,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:42.025896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":583,"num_read_kb":3104,"num_write":1034,"num_write_kb":15827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:09.098212+0000","last_change":"2024-09-19T15:32:09.098212+0000","last_active":"2024-09-19T15:32:09.098212+0000","last_peered":"2024-09-19T15:32:09.098212+0000","last_clean":"2024-09-19T15:32:09.098212+0000","last_became_active":"2024-09-19T13:40:38.233854+0000","last_became_peered":"2024-09-19T13:40:38.233854+0000","last_unstale":"2024-09-19T15:32:09.098212+0000","last_undegraded":"2024-09-19T15:32:09.098212+0000","last_fullsized":"2024-09-19T15:32:09.098212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:09.098028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:09.098028+0000","last_clean_scrub_stamp":"2024-09-19T15:32:09.098028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:37:11.684872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'128","reported_seq":705,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:13.548069+0000","last_change":"2024-09-19T15:32:13.548069+0000","last_active":"2024-09-19T15:32:13.548069+0000","last_peered":"2024-09-19T15:32:13.548069+0000","last_clean":"2024-09-19T15:32:13.548069+0000","last_became_active":"2024-09-19T13:40:40.244841+0000","last_became_peered":"2024-09-19T13:40:40.244841+0000","last_unstale":"2024-09-19T15:32:13.548069+0000","last_undegraded":"2024-09-19T15:32:13.548069+0000","last_fullsized":"2024-09-19T15:32:13.548069+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'128","last_scrub_stamp":"2024-09-19T15:32:13.547828+0000","last_deep_scrub":"268'128","last_deep_scrub_stamp":"2024-09-19T15:32:13.547828+0000","last_clean_scrub_stamp":"2024-09-19T15:32:13.547828+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:35:26.393560+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":152,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:17.571750+0000","last_change":"2024-09-19T15:32:17.571750+0000","last_active":"2024-09-19T15:32:17.571750+0000","last_peered":"2024-09-19T15:32:17.571750+0000","last_clean":"2024-09-19T15:32:17.571750+0000","last_became_active":"2024-09-19T13:40:42.235151+0000","last_became_peered":"2024-09-19T13:40:42.235151+0000","last_unstale":"2024-09-19T15:32:17.571750+0000","last_undegraded":"2024-09-19T15:32:17.571750+0000","last_fullsized":"2024-09-19T15:32:17.571750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:17.571503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:17.571503+0000","last_clean_scrub_stamp":"2024-09-19T15:32:17.571503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:27:14.904541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'99","reported_seq":627,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:20.633689+0000","last_change":"2024-09-19T15:32:20.633689+0000","last_active":"2024-09-19T15:32:20.633689+0000","last_peered":"2024-09-19T15:32:20.633689+0000","last_clean":"2024-09-19T15:32:20.633689+0000","last_became_active":"2024-09-19T13:40:44.262343+0000","last_became_peered":"2024-09-19T13:40:44.262343+0000","last_unstale":"2024-09-19T15:32:20.633689+0000","last_undegraded":"2024-09-19T15:32:20.633689+0000","last_fullsized":"2024-09-19T15:32:20.633689+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'99","last_scrub_stamp":"2024-09-19T15:32:20.633491+0000","last_deep_scrub":"268'99","last_deep_scrub_stamp":"2024-09-19T15:32:20.633491+0000","last_clean_scrub_stamp":"2024-09-19T15:32:20.633491+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:00:16.771664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":127,"num_write":220,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'739","reported_seq":2248,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.747931+0000","last_change":"2024-09-19T15:31:56.747931+0000","last_active":"2024-09-19T15:31:56.747931+0000","last_peered":"2024-09-19T15:31:56.747931+0000","last_clean":"2024-09-19T15:31:56.747931+0000","last_became_active":"2024-09-19T13:40:36.225170+0000","last_became_peered":"2024-09-19T13:40:36.225170+0000","last_unstale":"2024-09-19T15:31:56.747931+0000","last_undegraded":"2024-09-19T15:31:56.747931+0000","last_fullsized":"2024-09-19T15:31:56.747931+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'739","last_scrub_stamp":"2024-09-19T15:31:56.747710+0000","last_deep_scrub":"268'739","last_deep_scrub_stamp":"2024-09-19T15:31:56.747710+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.747710+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:45:39.254884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3445,"num_read_kb":3119,"num_write":970,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'347","reported_seq":987,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.755049+0000","last_change":"2024-09-19T15:31:52.754774+0000","last_active":"2024-09-19T15:31:52.755049+0000","last_peered":"2024-09-19T15:31:52.755049+0000","last_clean":"2024-09-19T15:31:52.755049+0000","last_became_active":"2024-09-19T13:40:34.273656+0000","last_became_peered":"2024-09-19T13:40:34.273656+0000","last_unstale":"2024-09-19T15:31:52.755049+0000","last_undegraded":"2024-09-19T15:31:52.755049+0000","last_fullsized":"2024-09-19T15:31:52.755049+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'347","last_scrub_stamp":"2024-09-19T15:31:52.754452+0000","last_deep_scrub":"268'347","last_deep_scrub_stamp":"2024-09-19T15:31:52.754452+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.754452+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:28:40.714033+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136842,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":513,"num_read_kb":12420,"num_write":1036,"num_write_kb":39158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:10.085570+0000","last_change":"2024-09-19T15:32:10.085570+0000","last_active":"2024-09-19T15:32:10.085570+0000","last_peered":"2024-09-19T15:32:10.085570+0000","last_clean":"2024-09-19T15:32:10.085570+0000","last_became_active":"2024-09-19T13:40:38.220474+0000","last_became_peered":"2024-09-19T13:40:38.220474+0000","last_unstale":"2024-09-19T15:32:10.085570+0000","last_undegraded":"2024-09-19T15:32:10.085570+0000","last_fullsized":"2024-09-19T15:32:10.085570+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:10.085385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:10.085385+0000","last_clean_scrub_stamp":"2024-09-19T15:32:10.085385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:53.008740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'194","reported_seq":795,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.972239+0000","last_change":"2024-09-19T15:32:02.972239+0000","last_active":"2024-09-19T15:32:02.972239+0000","last_peered":"2024-09-19T15:32:02.972239+0000","last_clean":"2024-09-19T15:32:02.972239+0000","last_became_active":"2024-09-19T13:40:40.247893+0000","last_became_peered":"2024-09-19T13:40:40.247893+0000","last_unstale":"2024-09-19T15:32:02.972239+0000","last_undegraded":"2024-09-19T15:32:02.972239+0000","last_fullsized":"2024-09-19T15:32:02.972239+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'194","last_scrub_stamp":"2024-09-19T15:32:02.971992+0000","last_deep_scrub":"268'194","last_deep_scrub_stamp":"2024-09-19T15:32:02.971992+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.971992+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:29.838775+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":225,"num_write":160,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'762","reported_seq":3190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:17.676596+0000","last_change":"2024-09-19T15:32:17.676596+0000","last_active":"2024-09-19T15:32:17.676596+0000","last_peered":"2024-09-19T15:32:17.676596+0000","last_clean":"2024-09-19T15:32:17.676596+0000","last_became_active":"2024-09-19T13:40:42.239059+0000","last_became_peered":"2024-09-19T13:40:42.239059+0000","last_unstale":"2024-09-19T15:32:17.676596+0000","last_undegraded":"2024-09-19T15:32:17.676596+0000","last_fullsized":"2024-09-19T15:32:17.676596+0000","mapping_epoch":33,"log_start":"268'701","ondisk_log_start":"268'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'762","last_scrub_stamp":"2024-09-19T15:32:17.676409+0000","last_deep_scrub":"268'762","last_deep_scrub_stamp":"2024-09-19T15:32:17.676409+0000","last_clean_scrub_stamp":"2024-09-19T15:32:17.676409+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":701,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:50.314671+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'228","reported_seq":1079,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:21.544440+0000","last_change":"2024-09-19T15:32:21.544440+0000","last_active":"2024-09-19T15:32:21.544440+0000","last_peered":"2024-09-19T15:32:21.544440+0000","last_clean":"2024-09-19T15:32:21.544440+0000","last_became_active":"2024-09-19T13:40:44.277966+0000","last_became_peered":"2024-09-19T13:40:44.277966+0000","last_unstale":"2024-09-19T15:32:21.544440+0000","last_undegraded":"2024-09-19T15:32:21.544440+0000","last_fullsized":"2024-09-19T15:32:21.544440+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'228","last_scrub_stamp":"2024-09-19T15:32:21.544253+0000","last_deep_scrub":"268'228","last_deep_scrub_stamp":"2024-09-19T15:32:21.544253+0000","last_clean_scrub_stamp":"2024-09-19T15:32:21.544253+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:25.413782+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":650,"num_read_kb":649,"num_write":494,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'748","reported_seq":2169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.029942+0000","last_change":"2024-09-19T15:32:00.029942+0000","last_active":"2024-09-19T15:32:00.029942+0000","last_peered":"2024-09-19T15:32:00.029942+0000","last_clean":"2024-09-19T15:32:00.029942+0000","last_became_active":"2024-09-19T13:40:36.238400+0000","last_became_peered":"2024-09-19T13:40:36.238400+0000","last_unstale":"2024-09-19T15:32:00.029942+0000","last_undegraded":"2024-09-19T15:32:00.029942+0000","last_fullsized":"2024-09-19T15:32:00.029942+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'748","last_scrub_stamp":"2024-09-19T15:32:00.029701+0000","last_deep_scrub":"268'748","last_deep_scrub_stamp":"2024-09-19T15:32:00.029701+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.029701+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:17.299402+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3489,"num_read_kb":3124,"num_write":1003,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'393","reported_seq":1084,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.901063+0000","last_change":"2024-09-19T15:31:49.900923+0000","last_active":"2024-09-19T15:31:49.901063+0000","last_peered":"2024-09-19T15:31:49.901063+0000","last_clean":"2024-09-19T15:31:49.901063+0000","last_became_active":"2024-09-19T13:40:34.257596+0000","last_became_peered":"2024-09-19T13:40:34.257596+0000","last_unstale":"2024-09-19T15:31:49.901063+0000","last_undegraded":"2024-09-19T15:31:49.901063+0000","last_fullsized":"2024-09-19T15:31:49.901063+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'393","last_scrub_stamp":"2024-09-19T15:31:49.900735+0000","last_deep_scrub":"268'393","last_deep_scrub_stamp":"2024-09-19T15:31:49.900735+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.900735+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:09.592854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":35384,"num_write":1329,"num_write_kb":23932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:11.670640+0000","last_change":"2024-09-19T15:32:11.670640+0000","last_active":"2024-09-19T15:32:11.670640+0000","last_peered":"2024-09-19T15:32:11.670640+0000","last_clean":"2024-09-19T15:32:11.670640+0000","last_became_active":"2024-09-19T13:40:38.212327+0000","last_became_peered":"2024-09-19T13:40:38.212327+0000","last_unstale":"2024-09-19T15:32:11.670640+0000","last_undegraded":"2024-09-19T15:32:11.670640+0000","last_fullsized":"2024-09-19T15:32:11.670640+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:11.670461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:11.670461+0000","last_clean_scrub_stamp":"2024-09-19T15:32:11.670461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:57.215802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'318","reported_seq":947,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:14.726525+0000","last_change":"2024-09-19T15:32:14.726525+0000","last_active":"2024-09-19T15:32:14.726525+0000","last_peered":"2024-09-19T15:32:14.726525+0000","last_clean":"2024-09-19T15:32:14.726525+0000","last_became_active":"2024-09-19T13:40:40.225512+0000","last_became_peered":"2024-09-19T13:40:40.225512+0000","last_unstale":"2024-09-19T15:32:14.726525+0000","last_undegraded":"2024-09-19T15:32:14.726525+0000","last_fullsized":"2024-09-19T15:32:14.726525+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'318","last_scrub_stamp":"2024-09-19T15:32:14.726315+0000","last_deep_scrub":"268'318","last_deep_scrub_stamp":"2024-09-19T15:32:14.726315+0000","last_clean_scrub_stamp":"2024-09-19T15:32:14.726315+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:05.810318+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43264,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":513,"num_read_kb":1124,"num_write":410,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'790","reported_seq":3005,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:21.201361+0000","last_change":"2024-09-19T15:32:21.201361+0000","last_active":"2024-09-19T15:32:21.201361+0000","last_peered":"2024-09-19T15:32:21.201361+0000","last_clean":"2024-09-19T15:32:21.201361+0000","last_became_active":"2024-09-19T13:40:42.263635+0000","last_became_peered":"2024-09-19T13:40:42.263635+0000","last_unstale":"2024-09-19T15:32:21.201361+0000","last_undegraded":"2024-09-19T15:32:21.201361+0000","last_fullsized":"2024-09-19T15:32:21.201361+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'790","last_scrub_stamp":"2024-09-19T15:32:21.201174+0000","last_deep_scrub":"268'790","last_deep_scrub_stamp":"2024-09-19T15:32:21.201174+0000","last_clean_scrub_stamp":"2024-09-19T15:32:21.201174+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:22.262573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'503","reported_seq":2114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.805627+0000","last_change":"2024-09-19T15:32:01.805627+0000","last_active":"2024-09-19T15:32:01.805627+0000","last_peered":"2024-09-19T15:32:01.805627+0000","last_clean":"2024-09-19T15:32:01.805627+0000","last_became_active":"2024-09-19T13:40:36.235739+0000","last_became_peered":"2024-09-19T13:40:36.235739+0000","last_unstale":"2024-09-19T15:32:01.805627+0000","last_undegraded":"2024-09-19T15:32:01.805627+0000","last_fullsized":"2024-09-19T15:32:01.805627+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'503","last_scrub_stamp":"2024-09-19T15:32:01.805424+0000","last_deep_scrub":"268'503","last_deep_scrub_stamp":"2024-09-19T15:32:01.805424+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.805424+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:33:53.497137+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2574,"num_read_kb":2392,"num_write":618,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'357","reported_seq":1080,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.762833+0000","last_change":"2024-09-19T15:31:53.762833+0000","last_active":"2024-09-19T15:31:53.762833+0000","last_peered":"2024-09-19T15:31:53.762833+0000","last_clean":"2024-09-19T15:31:53.762833+0000","last_became_active":"2024-09-19T13:41:05.309594+0000","last_became_peered":"2024-09-19T13:41:05.309594+0000","last_unstale":"2024-09-19T15:31:53.762833+0000","last_undegraded":"2024-09-19T15:31:53.762833+0000","last_fullsized":"2024-09-19T15:31:53.762833+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'357","last_scrub_stamp":"2024-09-19T15:31:53.762612+0000","last_deep_scrub":"268'357","last_deep_scrub_stamp":"2024-09-19T15:31:53.762612+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.762612+0000","objects_scrubbed":7,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:30:03.838874+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":758,"num_read_kb":65190,"num_write":1172,"num_write_kb":23524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.681085+0000","last_change":"2024-09-19T15:32:07.681085+0000","last_active":"2024-09-19T15:32:07.681085+0000","last_peered":"2024-09-19T15:32:07.681085+0000","last_clean":"2024-09-19T15:32:07.681085+0000","last_became_active":"2024-09-19T13:40:38.233892+0000","last_became_peered":"2024-09-19T13:40:38.233892+0000","last_unstale":"2024-09-19T15:32:07.681085+0000","last_undegraded":"2024-09-19T15:32:07.681085+0000","last_fullsized":"2024-09-19T15:32:07.681085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:07.680900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:07.680900+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.680900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:13.848920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'467","reported_seq":1182,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:14.678325+0000","last_change":"2024-09-19T15:32:14.678325+0000","last_active":"2024-09-19T15:32:14.678325+0000","last_peered":"2024-09-19T15:32:14.678325+0000","last_clean":"2024-09-19T15:32:14.678325+0000","last_became_active":"2024-09-19T13:40:40.232582+0000","last_became_peered":"2024-09-19T13:40:40.232582+0000","last_unstale":"2024-09-19T15:32:14.678325+0000","last_undegraded":"2024-09-19T15:32:14.678325+0000","last_fullsized":"2024-09-19T15:32:14.678325+0000","mapping_epoch":31,"log_start":"268'400","ondisk_log_start":"268'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'467","last_scrub_stamp":"2024-09-19T15:32:14.678058+0000","last_deep_scrub":"268'467","last_deep_scrub_stamp":"2024-09-19T15:32:14.678058+0000","last_clean_scrub_stamp":"2024-09-19T15:32:14.678058+0000","objects_scrubbed":9,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:08:47.724207+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44624,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":740,"num_read_kb":1351,"num_write":560,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.598875+0000","last_change":"2024-09-19T15:32:08.598875+0000","last_active":"2024-09-19T15:32:08.598875+0000","last_peered":"2024-09-19T15:32:08.598875+0000","last_clean":"2024-09-19T15:32:08.598875+0000","last_became_active":"2024-09-19T13:40:42.239961+0000","last_became_peered":"2024-09-19T13:40:42.239961+0000","last_unstale":"2024-09-19T15:32:08.598875+0000","last_undegraded":"2024-09-19T15:32:08.598875+0000","last_fullsized":"2024-09-19T15:32:08.598875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:08.598673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:08.598673+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.598673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:30:30.732339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'548","reported_seq":1404,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:19.646257+0000","last_change":"2024-09-19T15:32:19.646257+0000","last_active":"2024-09-19T15:32:19.646257+0000","last_peered":"2024-09-19T15:32:19.646257+0000","last_clean":"2024-09-19T15:32:19.646257+0000","last_became_active":"2024-09-19T13:40:44.263313+0000","last_became_peered":"2024-09-19T13:40:44.263313+0000","last_unstale":"2024-09-19T15:32:19.646257+0000","last_undegraded":"2024-09-19T15:32:19.646257+0000","last_fullsized":"2024-09-19T15:32:19.646257+0000","mapping_epoch":35,"log_start":"268'500","ondisk_log_start":"268'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'548","last_scrub_stamp":"2024-09-19T15:32:19.646056+0000","last_deep_scrub":"268'548","last_deep_scrub_stamp":"2024-09-19T15:32:19.646056+0000","last_clean_scrub_stamp":"2024-09-19T15:32:19.646056+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:42:19.204187+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1297,"num_read_kb":1297,"num_write":1122,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'467","reported_seq":2122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.456349+0000","last_change":"2024-09-19T15:31:52.456349+0000","last_active":"2024-09-19T15:31:52.456349+0000","last_peered":"2024-09-19T15:31:52.456349+0000","last_clean":"2024-09-19T15:31:52.456349+0000","last_became_active":"2024-09-19T13:40:36.218822+0000","last_became_peered":"2024-09-19T13:40:36.218822+0000","last_unstale":"2024-09-19T15:31:52.456349+0000","last_undegraded":"2024-09-19T15:31:52.456349+0000","last_fullsized":"2024-09-19T15:31:52.456349+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'467","last_scrub_stamp":"2024-09-19T15:31:52.456167+0000","last_deep_scrub":"268'467","last_deep_scrub_stamp":"2024-09-19T15:31:52.456167+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.456167+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:04:13.506665+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2519,"num_read_kb":2376,"num_write":558,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'323","reported_seq":984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.705812+0000","last_change":"2024-09-19T15:31:56.705812+0000","last_active":"2024-09-19T15:31:56.705812+0000","last_peered":"2024-09-19T15:31:56.705812+0000","last_clean":"2024-09-19T15:31:56.705812+0000","last_became_active":"2024-09-19T13:40:34.278684+0000","last_became_peered":"2024-09-19T13:40:34.278684+0000","last_unstale":"2024-09-19T15:31:56.705812+0000","last_undegraded":"2024-09-19T15:31:56.705812+0000","last_fullsized":"2024-09-19T15:31:56.705812+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'323","last_scrub_stamp":"2024-09-19T15:31:56.705455+0000","last_deep_scrub":"268'323","last_deep_scrub_stamp":"2024-09-19T15:31:56.705455+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.705455+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:31:32.186266+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":542,"num_read_kb":16871,"num_write":997,"num_write_kb":22319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.905540+0000","last_change":"2024-09-19T15:31:58.905540+0000","last_active":"2024-09-19T15:31:58.905540+0000","last_peered":"2024-09-19T15:31:58.905540+0000","last_clean":"2024-09-19T15:31:58.905540+0000","last_became_active":"2024-09-19T13:40:38.228765+0000","last_became_peered":"2024-09-19T13:40:38.228765+0000","last_unstale":"2024-09-19T15:31:58.905540+0000","last_undegraded":"2024-09-19T15:31:58.905540+0000","last_fullsized":"2024-09-19T15:31:58.905540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:58.905356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:58.905356+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.905356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:59.885919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'318","reported_seq":949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:12.102311+0000","last_change":"2024-09-19T15:32:12.102311+0000","last_active":"2024-09-19T15:32:12.102311+0000","last_peered":"2024-09-19T15:32:12.102311+0000","last_clean":"2024-09-19T15:32:12.102311+0000","last_became_active":"2024-09-19T13:40:40.226899+0000","last_became_peered":"2024-09-19T13:40:40.226899+0000","last_unstale":"2024-09-19T15:32:12.102311+0000","last_undegraded":"2024-09-19T15:32:12.102311+0000","last_fullsized":"2024-09-19T15:32:12.102311+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'318","last_scrub_stamp":"2024-09-19T15:32:12.102112+0000","last_deep_scrub":"268'318","last_deep_scrub_stamp":"2024-09-19T15:32:12.102112+0000","last_clean_scrub_stamp":"2024-09-19T15:32:12.102112+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:13:50.462555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46888,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":525,"num_read_kb":1137,"num_write":420,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:20.211397+0000","last_change":"2024-09-19T15:32:20.211397+0000","last_active":"2024-09-19T15:32:20.211397+0000","last_peered":"2024-09-19T15:32:20.211397+0000","last_clean":"2024-09-19T15:32:20.211397+0000","last_became_active":"2024-09-19T13:40:42.245030+0000","last_became_peered":"2024-09-19T13:40:42.245030+0000","last_unstale":"2024-09-19T15:32:20.211397+0000","last_undegraded":"2024-09-19T15:32:20.211397+0000","last_fullsized":"2024-09-19T15:32:20.211397+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:20.211223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:20.211223+0000","last_clean_scrub_stamp":"2024-09-19T15:32:20.211223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:11:45.637564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'126","reported_seq":645,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.974019+0000","last_change":"2024-09-19T15:32:08.974019+0000","last_active":"2024-09-19T15:32:08.974019+0000","last_peered":"2024-09-19T15:32:08.974019+0000","last_clean":"2024-09-19T15:32:08.974019+0000","last_became_active":"2024-09-19T13:40:44.254015+0000","last_became_peered":"2024-09-19T13:40:44.254015+0000","last_unstale":"2024-09-19T15:32:08.974019+0000","last_undegraded":"2024-09-19T15:32:08.974019+0000","last_fullsized":"2024-09-19T15:32:08.974019+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'126","last_scrub_stamp":"2024-09-19T15:32:08.973841+0000","last_deep_scrub":"268'126","last_deep_scrub_stamp":"2024-09-19T15:32:08.973841+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.973841+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:13:17.778447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":134,"num_write":317,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'414","reported_seq":1984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.921763+0000","last_change":"2024-09-19T15:31:55.921763+0000","last_active":"2024-09-19T15:31:55.921763+0000","last_peered":"2024-09-19T15:31:55.921763+0000","last_clean":"2024-09-19T15:31:55.921763+0000","last_became_active":"2024-09-19T13:42:05.613410+0000","last_became_peered":"2024-09-19T13:42:05.613410+0000","last_unstale":"2024-09-19T15:31:55.921763+0000","last_undegraded":"2024-09-19T15:31:55.921763+0000","last_fullsized":"2024-09-19T15:31:55.921763+0000","mapping_epoch":40,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'414","last_scrub_stamp":"2024-09-19T15:31:55.921598+0000","last_deep_scrub":"268'414","last_deep_scrub_stamp":"2024-09-19T15:31:55.921598+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.921598+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:20.548732+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2294,"num_read_kb":2176,"num_write":469,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'350","reported_seq":1074,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.766022+0000","last_change":"2024-09-19T15:31:51.766022+0000","last_active":"2024-09-19T15:31:51.766022+0000","last_peered":"2024-09-19T15:31:51.766022+0000","last_clean":"2024-09-19T15:31:51.766022+0000","last_became_active":"2024-09-19T13:40:34.268005+0000","last_became_peered":"2024-09-19T13:40:34.268005+0000","last_unstale":"2024-09-19T15:31:51.766022+0000","last_undegraded":"2024-09-19T15:31:51.766022+0000","last_fullsized":"2024-09-19T15:31:51.766022+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'350","last_scrub_stamp":"2024-09-19T15:31:51.765823+0000","last_deep_scrub":"268'350","last_deep_scrub_stamp":"2024-09-19T15:31:51.765823+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.765823+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:50.728579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":754,"num_read_kb":24616,"num_write":1259,"num_write_kb":39661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.937891+0000","last_change":"2024-09-19T15:32:01.937891+0000","last_active":"2024-09-19T15:32:01.937891+0000","last_peered":"2024-09-19T15:32:01.937891+0000","last_clean":"2024-09-19T15:32:01.937891+0000","last_became_active":"2024-09-19T13:40:38.231698+0000","last_became_peered":"2024-09-19T13:40:38.231698+0000","last_unstale":"2024-09-19T15:32:01.937891+0000","last_undegraded":"2024-09-19T15:32:01.937891+0000","last_fullsized":"2024-09-19T15:32:01.937891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:01.937609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:01.937609+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.937609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:29.037967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'401","reported_seq":1071,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:11.645597+0000","last_change":"2024-09-19T15:32:11.645597+0000","last_active":"2024-09-19T15:32:11.645597+0000","last_peered":"2024-09-19T15:32:11.645597+0000","last_clean":"2024-09-19T15:32:11.645597+0000","last_became_active":"2024-09-19T13:40:40.218529+0000","last_became_peered":"2024-09-19T13:40:40.218529+0000","last_unstale":"2024-09-19T15:32:11.645597+0000","last_undegraded":"2024-09-19T15:32:11.645597+0000","last_fullsized":"2024-09-19T15:32:11.645597+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'401","last_scrub_stamp":"2024-09-19T15:32:11.645485+0000","last_deep_scrub":"268'401","last_deep_scrub_stamp":"2024-09-19T15:32:11.645485+0000","last_clean_scrub_stamp":"2024-09-19T15:32:11.645485+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:37.568114+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45323,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":615,"num_read_kb":1192,"num_write":478,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'803","reported_seq":3189,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:13.604648+0000","last_change":"2024-09-19T15:32:13.604648+0000","last_active":"2024-09-19T15:32:13.604648+0000","last_peered":"2024-09-19T15:32:13.604648+0000","last_clean":"2024-09-19T15:32:13.604648+0000","last_became_active":"2024-09-19T13:40:42.237168+0000","last_became_peered":"2024-09-19T13:40:42.237168+0000","last_unstale":"2024-09-19T15:32:13.604648+0000","last_undegraded":"2024-09-19T15:32:13.604648+0000","last_fullsized":"2024-09-19T15:32:13.604648+0000","mapping_epoch":33,"log_start":"268'701","ondisk_log_start":"268'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'803","last_scrub_stamp":"2024-09-19T15:32:13.604468+0000","last_deep_scrub":"268'803","last_deep_scrub_stamp":"2024-09-19T15:32:13.604468+0000","last_clean_scrub_stamp":"2024-09-19T15:32:13.604468+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":701,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:45:40.175931+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'187","reported_seq":742,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:17.580154+0000","last_change":"2024-09-19T15:32:17.580154+0000","last_active":"2024-09-19T15:32:17.580154+0000","last_peered":"2024-09-19T15:32:17.580154+0000","last_clean":"2024-09-19T15:32:17.580154+0000","last_became_active":"2024-09-19T13:40:44.259964+0000","last_became_peered":"2024-09-19T13:40:44.259964+0000","last_unstale":"2024-09-19T15:32:17.580154+0000","last_undegraded":"2024-09-19T15:32:17.580154+0000","last_fullsized":"2024-09-19T15:32:17.580154+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'187","last_scrub_stamp":"2024-09-19T15:32:17.579976+0000","last_deep_scrub":"268'187","last_deep_scrub_stamp":"2024-09-19T15:32:17.579976+0000","last_clean_scrub_stamp":"2024-09-19T15:32:17.579976+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:21.261184+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":275,"num_read_kb":244,"num_write":336,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'518","reported_seq":2217,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.706807+0000","last_change":"2024-09-19T15:31:55.706807+0000","last_active":"2024-09-19T15:31:55.706807+0000","last_peered":"2024-09-19T15:31:55.706807+0000","last_clean":"2024-09-19T15:31:55.706807+0000","last_became_active":"2024-09-19T13:40:36.221248+0000","last_became_peered":"2024-09-19T13:40:36.221248+0000","last_unstale":"2024-09-19T15:31:55.706807+0000","last_undegraded":"2024-09-19T15:31:55.706807+0000","last_fullsized":"2024-09-19T15:31:55.706807+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'518","last_scrub_stamp":"2024-09-19T15:31:55.706590+0000","last_deep_scrub":"268'518","last_deep_scrub_stamp":"2024-09-19T15:31:55.706590+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.706590+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:26.121902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2802,"num_read_kb":2611,"num_write":645,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'296","reported_seq":950,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.841863+0000","last_change":"2024-09-19T15:31:50.841863+0000","last_active":"2024-09-19T15:31:50.841863+0000","last_peered":"2024-09-19T15:31:50.841863+0000","last_clean":"2024-09-19T15:31:50.841863+0000","last_became_active":"2024-09-19T13:40:34.259994+0000","last_became_peered":"2024-09-19T13:40:34.259994+0000","last_unstale":"2024-09-19T15:31:50.841863+0000","last_undegraded":"2024-09-19T15:31:50.841863+0000","last_fullsized":"2024-09-19T15:31:50.841863+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'296","last_scrub_stamp":"2024-09-19T15:31:50.841553+0000","last_deep_scrub":"268'296","last_deep_scrub_stamp":"2024-09-19T15:31:50.841553+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.841553+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:13.764383+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":7460,"num_write":978,"num_write_kb":22776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.951669+0000","last_change":"2024-09-19T15:32:00.951669+0000","last_active":"2024-09-19T15:32:00.951669+0000","last_peered":"2024-09-19T15:32:00.951669+0000","last_clean":"2024-09-19T15:32:00.951669+0000","last_became_active":"2024-09-19T13:40:38.245245+0000","last_became_peered":"2024-09-19T13:40:38.245245+0000","last_unstale":"2024-09-19T15:32:00.951669+0000","last_undegraded":"2024-09-19T15:32:00.951669+0000","last_fullsized":"2024-09-19T15:32:00.951669+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:00.951493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:00.951493+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.951493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:47.140968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'517","reported_seq":1204,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.700660+0000","last_change":"2024-09-19T15:32:05.700660+0000","last_active":"2024-09-19T15:32:05.700660+0000","last_peered":"2024-09-19T15:32:05.700660+0000","last_clean":"2024-09-19T15:32:05.700660+0000","last_became_active":"2024-09-19T13:40:40.230404+0000","last_became_peered":"2024-09-19T13:40:40.230404+0000","last_unstale":"2024-09-19T15:32:05.700660+0000","last_undegraded":"2024-09-19T15:32:05.700660+0000","last_fullsized":"2024-09-19T15:32:05.700660+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'517","last_scrub_stamp":"2024-09-19T15:32:05.700478+0000","last_deep_scrub":"268'517","last_deep_scrub_stamp":"2024-09-19T15:32:05.700478+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.700478+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:06.189367+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93154,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":887,"num_read_kb":2046,"num_write":714,"num_write_kb":570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.950947+0000","last_change":"2024-09-19T15:32:04.950947+0000","last_active":"2024-09-19T15:32:04.950947+0000","last_peered":"2024-09-19T15:32:04.950947+0000","last_clean":"2024-09-19T15:32:04.950947+0000","last_became_active":"2024-09-19T13:40:42.248721+0000","last_became_peered":"2024-09-19T13:40:42.248721+0000","last_unstale":"2024-09-19T15:32:04.950947+0000","last_undegraded":"2024-09-19T15:32:04.950947+0000","last_fullsized":"2024-09-19T15:32:04.950947+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:04.950740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:04.950740+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.950740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:50:58.634069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'164","reported_seq":721,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:13.697201+0000","last_change":"2024-09-19T15:32:13.697201+0000","last_active":"2024-09-19T15:32:13.697201+0000","last_peered":"2024-09-19T15:32:13.697201+0000","last_clean":"2024-09-19T15:32:13.697201+0000","last_became_active":"2024-09-19T13:40:44.255644+0000","last_became_peered":"2024-09-19T13:40:44.255644+0000","last_unstale":"2024-09-19T15:32:13.697201+0000","last_undegraded":"2024-09-19T15:32:13.697201+0000","last_fullsized":"2024-09-19T15:32:13.697201+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'164","last_scrub_stamp":"2024-09-19T15:32:13.697000+0000","last_deep_scrub":"268'164","last_deep_scrub_stamp":"2024-09-19T15:32:13.697000+0000","last_clean_scrub_stamp":"2024-09-19T15:32:13.697000+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:19:16.779049+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":234,"num_write":369,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'797","reported_seq":2381,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.553171+0000","last_change":"2024-09-19T15:31:59.553171+0000","last_active":"2024-09-19T15:31:59.553171+0000","last_peered":"2024-09-19T15:31:59.553171+0000","last_clean":"2024-09-19T15:31:59.553171+0000","last_became_active":"2024-09-19T13:40:36.231071+0000","last_became_peered":"2024-09-19T13:40:36.231071+0000","last_unstale":"2024-09-19T15:31:59.553171+0000","last_undegraded":"2024-09-19T15:31:59.553171+0000","last_fullsized":"2024-09-19T15:31:59.553171+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'797","last_scrub_stamp":"2024-09-19T15:31:59.552987+0000","last_deep_scrub":"268'797","last_deep_scrub_stamp":"2024-09-19T15:31:59.552987+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.552987+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:12.521548+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3782,"num_read_kb":3405,"num_write":1031,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'344","reported_seq":1008,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.943571+0000","last_change":"2024-09-19T15:31:53.943571+0000","last_active":"2024-09-19T15:31:53.943571+0000","last_peered":"2024-09-19T15:31:53.943571+0000","last_clean":"2024-09-19T15:31:53.943571+0000","last_became_active":"2024-09-19T13:40:34.229859+0000","last_became_peered":"2024-09-19T13:40:34.229859+0000","last_unstale":"2024-09-19T15:31:53.943571+0000","last_undegraded":"2024-09-19T15:31:53.943571+0000","last_fullsized":"2024-09-19T15:31:53.943571+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'344","last_scrub_stamp":"2024-09-19T15:31:53.943359+0000","last_deep_scrub":"268'344","last_deep_scrub_stamp":"2024-09-19T15:31:53.943359+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.943359+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:11:29.492578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":581,"num_read_kb":8832,"num_write":1027,"num_write_kb":25070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.941343+0000","last_change":"2024-09-19T15:31:59.941343+0000","last_active":"2024-09-19T15:31:59.941343+0000","last_peered":"2024-09-19T15:31:59.941343+0000","last_clean":"2024-09-19T15:31:59.941343+0000","last_became_active":"2024-09-19T13:40:38.233312+0000","last_became_peered":"2024-09-19T13:40:38.233312+0000","last_unstale":"2024-09-19T15:31:59.941343+0000","last_undegraded":"2024-09-19T15:31:59.941343+0000","last_fullsized":"2024-09-19T15:31:59.941343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:59.941164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:59.941164+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.941164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:40:15.114932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'335","reported_seq":973,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:12.545619+0000","last_change":"2024-09-19T15:32:12.545619+0000","last_active":"2024-09-19T15:32:12.545619+0000","last_peered":"2024-09-19T15:32:12.545619+0000","last_clean":"2024-09-19T15:32:12.545619+0000","last_became_active":"2024-09-19T13:40:40.247025+0000","last_became_peered":"2024-09-19T13:40:40.247025+0000","last_unstale":"2024-09-19T15:32:12.545619+0000","last_undegraded":"2024-09-19T15:32:12.545619+0000","last_fullsized":"2024-09-19T15:32:12.545619+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'335","last_scrub_stamp":"2024-09-19T15:32:12.545383+0000","last_deep_scrub":"268'335","last_deep_scrub_stamp":"2024-09-19T15:32:12.545383+0000","last_clean_scrub_stamp":"2024-09-19T15:32:12.545383+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:50:50.860604+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47892,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":557,"num_read_kb":1096,"num_write":476,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:12.629800+0000","last_change":"2024-09-19T15:32:12.629800+0000","last_active":"2024-09-19T15:32:12.629800+0000","last_peered":"2024-09-19T15:32:12.629800+0000","last_clean":"2024-09-19T15:32:12.629800+0000","last_became_active":"2024-09-19T13:40:42.243325+0000","last_became_peered":"2024-09-19T13:40:42.243325+0000","last_unstale":"2024-09-19T15:32:12.629800+0000","last_undegraded":"2024-09-19T15:32:12.629800+0000","last_fullsized":"2024-09-19T15:32:12.629800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:12.629625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:12.629625+0000","last_clean_scrub_stamp":"2024-09-19T15:32:12.629625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:25:02.824347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'147","reported_seq":687,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:24.155393+0000","last_change":"2024-09-19T15:32:24.155393+0000","last_active":"2024-09-19T15:32:24.155393+0000","last_peered":"2024-09-19T15:32:24.155393+0000","last_clean":"2024-09-19T15:32:24.155393+0000","last_became_active":"2024-09-19T13:40:44.267716+0000","last_became_peered":"2024-09-19T13:40:44.267716+0000","last_unstale":"2024-09-19T15:32:24.155393+0000","last_undegraded":"2024-09-19T15:32:24.155393+0000","last_fullsized":"2024-09-19T15:32:24.155393+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'147","last_scrub_stamp":"2024-09-19T15:32:24.155219+0000","last_deep_scrub":"268'147","last_deep_scrub_stamp":"2024-09-19T15:32:24.155219+0000","last_clean_scrub_stamp":"2024-09-19T15:32:24.155219+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:34:30.313308+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":190,"num_read_kb":181,"num_write":368,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'1170","reported_seq":2999,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.490117+0000","last_change":"2024-09-19T15:31:53.490117+0000","last_active":"2024-09-19T15:31:53.490117+0000","last_peered":"2024-09-19T15:31:53.490117+0000","last_clean":"2024-09-19T15:31:53.490117+0000","last_became_active":"2024-09-19T13:40:36.216332+0000","last_became_peered":"2024-09-19T13:40:36.216332+0000","last_unstale":"2024-09-19T15:31:53.490117+0000","last_undegraded":"2024-09-19T15:31:53.490117+0000","last_fullsized":"2024-09-19T15:31:53.490117+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1170","last_scrub_stamp":"2024-09-19T15:31:53.489935+0000","last_deep_scrub":"268'1170","last_deep_scrub_stamp":"2024-09-19T15:31:53.489935+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.489935+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":1100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:06.157095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5686,"num_read_kb":5084,"num_write":1563,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1534,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'376","reported_seq":1055,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:46.953114+0000","last_change":"2024-09-19T15:31:46.952878+0000","last_active":"2024-09-19T15:31:46.953114+0000","last_peered":"2024-09-19T15:31:46.953114+0000","last_clean":"2024-09-19T15:31:46.953114+0000","last_became_active":"2024-09-19T13:41:05.314782+0000","last_became_peered":"2024-09-19T13:41:05.314782+0000","last_unstale":"2024-09-19T15:31:46.953114+0000","last_undegraded":"2024-09-19T15:31:46.953114+0000","last_fullsized":"2024-09-19T15:31:46.953114+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'376","last_scrub_stamp":"2024-09-19T15:31:46.952619+0000","last_deep_scrub":"268'376","last_deep_scrub_stamp":"2024-09-19T15:31:46.952619+0000","last_clean_scrub_stamp":"2024-09-19T15:31:46.952619+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:39:58.061630+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":644,"num_read_kb":47078,"num_write":1156,"num_write_kb":40849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.614797+0000","last_change":"2024-09-19T15:32:00.614797+0000","last_active":"2024-09-19T15:32:00.614797+0000","last_peered":"2024-09-19T15:32:00.614797+0000","last_clean":"2024-09-19T15:32:00.614797+0000","last_became_active":"2024-09-19T13:40:38.246684+0000","last_became_peered":"2024-09-19T13:40:38.246684+0000","last_unstale":"2024-09-19T15:32:00.614797+0000","last_undegraded":"2024-09-19T15:32:00.614797+0000","last_fullsized":"2024-09-19T15:32:00.614797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:00.614607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:00.614607+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.614607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:00.446450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'392","reported_seq":1053,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.992019+0000","last_change":"2024-09-19T15:32:03.992019+0000","last_active":"2024-09-19T15:32:03.992019+0000","last_peered":"2024-09-19T15:32:03.992019+0000","last_clean":"2024-09-19T15:32:03.992019+0000","last_became_active":"2024-09-19T13:40:40.221766+0000","last_became_peered":"2024-09-19T13:40:40.221766+0000","last_unstale":"2024-09-19T15:32:03.992019+0000","last_undegraded":"2024-09-19T15:32:03.992019+0000","last_fullsized":"2024-09-19T15:32:03.992019+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'392","last_scrub_stamp":"2024-09-19T15:32:03.991763+0000","last_deep_scrub":"268'392","last_deep_scrub_stamp":"2024-09-19T15:32:03.991763+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.991763+0000","objects_scrubbed":7,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:45.051102+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44832,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":632,"num_read_kb":1260,"num_write":492,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'744","reported_seq":3084,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.931429+0000","last_change":"2024-09-19T15:32:06.931429+0000","last_active":"2024-09-19T15:32:06.931429+0000","last_peered":"2024-09-19T15:32:06.931429+0000","last_clean":"2024-09-19T15:32:06.931429+0000","last_became_active":"2024-09-19T13:40:42.246030+0000","last_became_peered":"2024-09-19T13:40:42.246030+0000","last_unstale":"2024-09-19T15:32:06.931429+0000","last_undegraded":"2024-09-19T15:32:06.931429+0000","last_fullsized":"2024-09-19T15:32:06.931429+0000","mapping_epoch":33,"log_start":"268'702","ondisk_log_start":"268'702","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'744","last_scrub_stamp":"2024-09-19T15:32:06.931254+0000","last_deep_scrub":"268'744","last_deep_scrub_stamp":"2024-09-19T15:32:06.931254+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.931254+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":702,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:22:51.911715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'127","reported_seq":657,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:11.683400+0000","last_change":"2024-09-19T15:32:11.683400+0000","last_active":"2024-09-19T15:32:11.683400+0000","last_peered":"2024-09-19T15:32:11.683400+0000","last_clean":"2024-09-19T15:32:11.683400+0000","last_became_active":"2024-09-19T13:40:44.249529+0000","last_became_peered":"2024-09-19T13:40:44.249529+0000","last_unstale":"2024-09-19T15:32:11.683400+0000","last_undegraded":"2024-09-19T15:32:11.683400+0000","last_fullsized":"2024-09-19T15:32:11.683400+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'127","last_scrub_stamp":"2024-09-19T15:32:11.683167+0000","last_deep_scrub":"268'127","last_deep_scrub_stamp":"2024-09-19T15:32:11.683167+0000","last_clean_scrub_stamp":"2024-09-19T15:32:11.683167+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:38.497896+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1650,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":290,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'1318","reported_seq":3136,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.504535+0000","last_change":"2024-09-19T15:31:54.504535+0000","last_active":"2024-09-19T15:31:54.504535+0000","last_peered":"2024-09-19T15:31:54.504535+0000","last_clean":"2024-09-19T15:31:54.504535+0000","last_became_active":"2024-09-19T13:40:36.218760+0000","last_became_peered":"2024-09-19T13:40:36.218760+0000","last_unstale":"2024-09-19T15:31:54.504535+0000","last_undegraded":"2024-09-19T15:31:54.504535+0000","last_fullsized":"2024-09-19T15:31:54.504535+0000","mapping_epoch":27,"log_start":"268'1300","ondisk_log_start":"268'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1318","last_scrub_stamp":"2024-09-19T15:31:54.504354+0000","last_deep_scrub":"268'1318","last_deep_scrub_stamp":"2024-09-19T15:31:54.504354+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.504354+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":1300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:19:34.417947+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6184,"num_read_kb":5469,"num_write":1814,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'395","reported_seq":1112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.562943+0000","last_change":"2024-09-19T15:31:48.562943+0000","last_active":"2024-09-19T15:31:48.562943+0000","last_peered":"2024-09-19T15:31:48.562943+0000","last_clean":"2024-09-19T15:31:48.562943+0000","last_became_active":"2024-09-19T13:40:34.264354+0000","last_became_peered":"2024-09-19T13:40:34.264354+0000","last_unstale":"2024-09-19T15:31:48.562943+0000","last_undegraded":"2024-09-19T15:31:48.562943+0000","last_fullsized":"2024-09-19T15:31:48.562943+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'395","last_scrub_stamp":"2024-09-19T15:31:48.562728+0000","last_deep_scrub":"268'395","last_deep_scrub_stamp":"2024-09-19T15:31:48.562728+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.562728+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:53.759979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":738,"num_read_kb":5537,"num_write":1291,"num_write_kb":30004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"268'4","reported_seq":1495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:09.740426+0000","last_change":"2024-09-19T15:32:09.740426+0000","last_active":"2024-09-19T15:32:09.740426+0000","last_peered":"2024-09-19T15:32:09.740426+0000","last_clean":"2024-09-19T15:32:09.740426+0000","last_became_active":"2024-09-19T13:40:38.225663+0000","last_became_peered":"2024-09-19T13:40:38.225663+0000","last_unstale":"2024-09-19T15:32:09.740426+0000","last_undegraded":"2024-09-19T15:32:09.740426+0000","last_fullsized":"2024-09-19T15:32:09.740426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-19T15:32:09.740237+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-19T15:32:09.740237+0000","last_clean_scrub_stamp":"2024-09-19T15:32:09.740237+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:46:34.207630+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":948,"num_read_kb":948,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'152","reported_seq":745,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:13.115013+0000","last_change":"2024-09-19T15:32:13.115013+0000","last_active":"2024-09-19T15:32:13.115013+0000","last_peered":"2024-09-19T15:32:13.115013+0000","last_clean":"2024-09-19T15:32:13.115013+0000","last_became_active":"2024-09-19T13:40:40.220534+0000","last_became_peered":"2024-09-19T13:40:40.220534+0000","last_unstale":"2024-09-19T15:32:13.115013+0000","last_undegraded":"2024-09-19T15:32:13.115013+0000","last_fullsized":"2024-09-19T15:32:13.115013+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'152","last_scrub_stamp":"2024-09-19T15:32:13.114764+0000","last_deep_scrub":"268'152","last_deep_scrub_stamp":"2024-09-19T15:32:13.114764+0000","last_clean_scrub_stamp":"2024-09-19T15:32:13.114764+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:44.466910+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":176,"num_write":122,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'765","reported_seq":5689,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.994466+0000","last_change":"2024-09-19T15:32:04.994466+0000","last_active":"2024-09-19T15:32:04.994466+0000","last_peered":"2024-09-19T15:32:04.994466+0000","last_clean":"2024-09-19T15:32:04.994466+0000","last_became_active":"2024-09-19T13:40:42.240074+0000","last_became_peered":"2024-09-19T13:40:42.240074+0000","last_unstale":"2024-09-19T15:32:04.994466+0000","last_undegraded":"2024-09-19T15:32:04.994466+0000","last_fullsized":"2024-09-19T15:32:04.994466+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'765","last_scrub_stamp":"2024-09-19T15:32:04.994274+0000","last_deep_scrub":"268'765","last_deep_scrub_stamp":"2024-09-19T15:32:04.994274+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.994274+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:38.710010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'114","reported_seq":644,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:19.609109+0000","last_change":"2024-09-19T15:32:19.609109+0000","last_active":"2024-09-19T15:32:19.609109+0000","last_peered":"2024-09-19T15:32:19.609109+0000","last_clean":"2024-09-19T15:32:19.609109+0000","last_became_active":"2024-09-19T13:40:44.251353+0000","last_became_peered":"2024-09-19T13:40:44.251353+0000","last_unstale":"2024-09-19T15:32:19.609109+0000","last_undegraded":"2024-09-19T15:32:19.609109+0000","last_fullsized":"2024-09-19T15:32:19.609109+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'114","last_scrub_stamp":"2024-09-19T15:32:19.608922+0000","last_deep_scrub":"268'114","last_deep_scrub_stamp":"2024-09-19T15:32:19.608922+0000","last_clean_scrub_stamp":"2024-09-19T15:32:19.608922+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:32.666808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'1844","reported_seq":3622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.612221+0000","last_change":"2024-09-19T15:31:56.612221+0000","last_active":"2024-09-19T15:31:56.612221+0000","last_peered":"2024-09-19T15:31:56.612221+0000","last_clean":"2024-09-19T15:31:56.612221+0000","last_became_active":"2024-09-19T13:40:36.221638+0000","last_became_peered":"2024-09-19T13:40:36.221638+0000","last_unstale":"2024-09-19T15:31:56.612221+0000","last_undegraded":"2024-09-19T15:31:56.612221+0000","last_fullsized":"2024-09-19T15:31:56.612221+0000","mapping_epoch":27,"log_start":"268'1800","ondisk_log_start":"268'1800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1844","last_scrub_stamp":"2024-09-19T15:31:56.612043+0000","last_deep_scrub":"268'1844","last_deep_scrub_stamp":"2024-09-19T15:31:56.612043+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.612043+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":1800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:26.022150+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8811,"num_read_kb":7740,"num_write":2693,"num_write_kb":1220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"268'357","reported_seq":1061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.880923+0000","last_change":"2024-09-19T15:31:48.880923+0000","last_active":"2024-09-19T15:31:48.880923+0000","last_peered":"2024-09-19T15:31:48.880923+0000","last_clean":"2024-09-19T15:31:48.880923+0000","last_became_active":"2024-09-19T13:40:34.236257+0000","last_became_peered":"2024-09-19T13:40:34.236257+0000","last_unstale":"2024-09-19T15:31:48.880923+0000","last_undegraded":"2024-09-19T15:31:48.880923+0000","last_fullsized":"2024-09-19T15:31:48.880923+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'357","last_scrub_stamp":"2024-09-19T15:31:48.880705+0000","last_deep_scrub":"268'357","last_deep_scrub_stamp":"2024-09-19T15:31:48.880705+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.880705+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:23.093501+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136845,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":663,"num_read_kb":21601,"num_write":1219,"num_write_kb":27464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:09.574695+0000","last_change":"2024-09-19T15:32:09.574695+0000","last_active":"2024-09-19T15:32:09.574695+0000","last_peered":"2024-09-19T15:32:09.574695+0000","last_clean":"2024-09-19T15:32:09.574695+0000","last_became_active":"2024-09-19T13:40:38.235737+0000","last_became_peered":"2024-09-19T13:40:38.235737+0000","last_unstale":"2024-09-19T15:32:09.574695+0000","last_undegraded":"2024-09-19T15:32:09.574695+0000","last_fullsized":"2024-09-19T15:32:09.574695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:09.574502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:09.574502+0000","last_clean_scrub_stamp":"2024-09-19T15:32:09.574502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:24.866773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'558","reported_seq":1259,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:15.673846+0000","last_change":"2024-09-19T15:32:15.673846+0000","last_active":"2024-09-19T15:32:15.673846+0000","last_peered":"2024-09-19T15:32:15.673846+0000","last_clean":"2024-09-19T15:32:15.673846+0000","last_became_active":"2024-09-19T13:40:40.235679+0000","last_became_peered":"2024-09-19T13:40:40.235679+0000","last_unstale":"2024-09-19T15:32:15.673846+0000","last_undegraded":"2024-09-19T15:32:15.673846+0000","last_fullsized":"2024-09-19T15:32:15.673846+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'558","last_scrub_stamp":"2024-09-19T15:32:15.673706+0000","last_deep_scrub":"268'558","last_deep_scrub_stamp":"2024-09-19T15:32:15.673706+0000","last_clean_scrub_stamp":"2024-09-19T15:32:15.673706+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:08:05.911020+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50661,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1488,"num_read_kb":2077,"num_write":2114,"num_write_kb":1883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":517528,"num_omap_keys":1192,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.022561+0000","last_change":"2024-09-19T15:32:04.022561+0000","last_active":"2024-09-19T15:32:04.022561+0000","last_peered":"2024-09-19T15:32:04.022561+0000","last_clean":"2024-09-19T15:32:04.022561+0000","last_became_active":"2024-09-19T13:40:42.250462+0000","last_became_peered":"2024-09-19T13:40:42.250462+0000","last_unstale":"2024-09-19T15:32:04.022561+0000","last_undegraded":"2024-09-19T15:32:04.022561+0000","last_fullsized":"2024-09-19T15:32:04.022561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:04.022361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:04.022361+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.022361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:05.155379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'149","reported_seq":688,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:12.725072+0000","last_change":"2024-09-19T15:32:12.725072+0000","last_active":"2024-09-19T15:32:12.725072+0000","last_peered":"2024-09-19T15:32:12.725072+0000","last_clean":"2024-09-19T15:32:12.725072+0000","last_became_active":"2024-09-19T13:40:44.266642+0000","last_became_peered":"2024-09-19T13:40:44.266642+0000","last_unstale":"2024-09-19T15:32:12.725072+0000","last_undegraded":"2024-09-19T15:32:12.725072+0000","last_fullsized":"2024-09-19T15:32:12.725072+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'149","last_scrub_stamp":"2024-09-19T15:32:12.724895+0000","last_deep_scrub":"268'149","last_deep_scrub_stamp":"2024-09-19T15:32:12.724895+0000","last_clean_scrub_stamp":"2024-09-19T15:32:12.724895+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:08:26.047796+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":208,"num_write":352,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'502","reported_seq":2081,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.895993+0000","last_change":"2024-09-19T15:31:53.895993+0000","last_active":"2024-09-19T15:31:53.895993+0000","last_peered":"2024-09-19T15:31:53.895993+0000","last_clean":"2024-09-19T15:31:53.895993+0000","last_became_active":"2024-09-19T13:40:36.218550+0000","last_became_peered":"2024-09-19T13:40:36.218550+0000","last_unstale":"2024-09-19T15:31:53.895993+0000","last_undegraded":"2024-09-19T15:31:53.895993+0000","last_fullsized":"2024-09-19T15:31:53.895993+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'502","last_scrub_stamp":"2024-09-19T15:31:53.895802+0000","last_deep_scrub":"268'502","last_deep_scrub_stamp":"2024-09-19T15:31:53.895802+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.895802+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:03:34.157384+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2652,"num_read_kb":2446,"num_write":622,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"268'74","reported_seq":664,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.790835+0000","last_change":"2024-09-19T15:31:48.790703+0000","last_active":"2024-09-19T15:31:48.790835+0000","last_peered":"2024-09-19T15:31:48.790835+0000","last_clean":"2024-09-19T15:31:48.790835+0000","last_became_active":"2024-09-19T13:40:13.615965+0000","last_became_peered":"2024-09-19T13:40:13.615965+0000","last_unstale":"2024-09-19T15:31:48.790835+0000","last_undegraded":"2024-09-19T15:31:48.790835+0000","last_fullsized":"2024-09-19T15:31:48.790835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'74","last_scrub_stamp":"2024-09-19T15:31:48.790514+0000","last_deep_scrub":"268'74","last_deep_scrub_stamp":"2024-09-19T15:31:48.790514+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.790514+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:19.499884+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"268'2","reported_seq":575,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.839150+0000","last_change":"2024-09-19T15:31:48.839150+0000","last_active":"2024-09-19T15:31:48.839150+0000","last_peered":"2024-09-19T15:31:48.839150+0000","last_clean":"2024-09-19T15:31:48.839150+0000","last_became_active":"2024-09-19T13:40:20.100760+0000","last_became_peered":"2024-09-19T13:40:20.100760+0000","last_unstale":"2024-09-19T15:31:48.839150+0000","last_undegraded":"2024-09-19T15:31:48.839150+0000","last_fullsized":"2024-09-19T15:31:48.839150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:31:48.838968+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:31:48.838968+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.838968+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:39.704823+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001106569,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'318","reported_seq":1010,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.849582+0000","last_change":"2024-09-19T15:31:47.849582+0000","last_active":"2024-09-19T15:31:47.849582+0000","last_peered":"2024-09-19T15:31:47.849582+0000","last_clean":"2024-09-19T15:31:47.849582+0000","last_became_active":"2024-09-19T13:40:34.241162+0000","last_became_peered":"2024-09-19T13:40:34.241162+0000","last_unstale":"2024-09-19T15:31:47.849582+0000","last_undegraded":"2024-09-19T15:31:47.849582+0000","last_fullsized":"2024-09-19T15:31:47.849582+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'318","last_scrub_stamp":"2024-09-19T15:31:47.849462+0000","last_deep_scrub":"268'318","last_deep_scrub_stamp":"2024-09-19T15:31:47.849462+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.849462+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:11.026243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":104186,"num_write":970,"num_write_kb":16810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":542,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.709741+0000","last_change":"2024-09-19T15:32:05.709741+0000","last_active":"2024-09-19T15:32:05.709741+0000","last_peered":"2024-09-19T15:32:05.709741+0000","last_clean":"2024-09-19T15:32:05.709741+0000","last_became_active":"2024-09-19T13:40:38.231762+0000","last_became_peered":"2024-09-19T13:40:38.231762+0000","last_unstale":"2024-09-19T15:32:05.709741+0000","last_undegraded":"2024-09-19T15:32:05.709741+0000","last_fullsized":"2024-09-19T15:32:05.709741+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:05.709473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:05.709473+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.709473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:16:34.993980+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'762","reported_seq":1529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:13.705887+0000","last_change":"2024-09-19T15:32:13.705887+0000","last_active":"2024-09-19T15:32:13.705887+0000","last_peered":"2024-09-19T15:32:13.705887+0000","last_clean":"2024-09-19T15:32:13.705887+0000","last_became_active":"2024-09-19T13:40:40.239392+0000","last_became_peered":"2024-09-19T13:40:40.239392+0000","last_unstale":"2024-09-19T15:32:13.705887+0000","last_undegraded":"2024-09-19T15:32:13.705887+0000","last_fullsized":"2024-09-19T15:32:13.705887+0000","mapping_epoch":31,"log_start":"268'700","ondisk_log_start":"268'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'762","last_scrub_stamp":"2024-09-19T15:32:13.705693+0000","last_deep_scrub":"268'762","last_deep_scrub_stamp":"2024-09-19T15:32:13.705693+0000","last_clean_scrub_stamp":"2024-09-19T15:32:13.705693+0000","objects_scrubbed":6,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:58.948100+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146379,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1466,"num_read_kb":3232,"num_write":1394,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89512,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:11.635083+0000","last_change":"2024-09-19T15:32:11.635083+0000","last_active":"2024-09-19T15:32:11.635083+0000","last_peered":"2024-09-19T15:32:11.635083+0000","last_clean":"2024-09-19T15:32:11.635083+0000","last_became_active":"2024-09-19T13:40:42.239749+0000","last_became_peered":"2024-09-19T13:40:42.239749+0000","last_unstale":"2024-09-19T15:32:11.635083+0000","last_undegraded":"2024-09-19T15:32:11.635083+0000","last_fullsized":"2024-09-19T15:32:11.635083+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:11.634896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:11.634896+0000","last_clean_scrub_stamp":"2024-09-19T15:32:11.634896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:49.517598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'202","reported_seq":931,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:10.013388+0000","last_change":"2024-09-19T15:32:10.013388+0000","last_active":"2024-09-19T15:32:10.013388+0000","last_peered":"2024-09-19T15:32:10.013388+0000","last_clean":"2024-09-19T15:32:10.013388+0000","last_became_active":"2024-09-19T13:40:44.264456+0000","last_became_peered":"2024-09-19T13:40:44.264456+0000","last_unstale":"2024-09-19T15:32:10.013388+0000","last_undegraded":"2024-09-19T15:32:10.013388+0000","last_fullsized":"2024-09-19T15:32:10.013388+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'202","last_scrub_stamp":"2024-09-19T15:32:10.013305+0000","last_deep_scrub":"268'202","last_deep_scrub_stamp":"2024-09-19T15:32:10.013305+0000","last_clean_scrub_stamp":"2024-09-19T15:32:10.013305+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:58:41.371854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":469,"num_write":408,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'754","reported_seq":2277,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.751994+0000","last_change":"2024-09-19T15:31:54.751994+0000","last_active":"2024-09-19T15:31:54.751994+0000","last_peered":"2024-09-19T15:31:54.751994+0000","last_clean":"2024-09-19T15:31:54.751994+0000","last_became_active":"2024-09-19T13:40:36.221186+0000","last_became_peered":"2024-09-19T13:40:36.221186+0000","last_unstale":"2024-09-19T15:31:54.751994+0000","last_undegraded":"2024-09-19T15:31:54.751994+0000","last_fullsized":"2024-09-19T15:31:54.751994+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'754","last_scrub_stamp":"2024-09-19T15:31:54.751805+0000","last_deep_scrub":"268'754","last_deep_scrub_stamp":"2024-09-19T15:31:54.751805+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.751805+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:42:16.653037+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3545,"num_read_kb":3202,"num_write":973,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":571,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.770417+0000","last_change":"2024-09-19T15:31:49.770258+0000","last_active":"2024-09-19T15:31:49.770417+0000","last_peered":"2024-09-19T15:31:49.770417+0000","last_clean":"2024-09-19T15:31:49.770417+0000","last_became_active":"2024-09-19T13:40:20.099608+0000","last_became_peered":"2024-09-19T13:40:20.099608+0000","last_unstale":"2024-09-19T15:31:49.770417+0000","last_undegraded":"2024-09-19T15:31:49.770417+0000","last_fullsized":"2024-09-19T15:31:49.770417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:49.770079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:49.770079+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.770079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:35.739125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001034798,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'310","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:44.606331+0000","last_change":"2024-09-19T15:31:44.606331+0000","last_active":"2024-09-19T15:31:44.606331+0000","last_peered":"2024-09-19T15:31:44.606331+0000","last_clean":"2024-09-19T15:31:44.606331+0000","last_became_active":"2024-09-19T13:40:34.264819+0000","last_became_peered":"2024-09-19T13:40:34.264819+0000","last_unstale":"2024-09-19T15:31:44.606331+0000","last_undegraded":"2024-09-19T15:31:44.606331+0000","last_fullsized":"2024-09-19T15:31:44.606331+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'310","last_scrub_stamp":"2024-09-19T15:31:44.606212+0000","last_deep_scrub":"268'310","last_deep_scrub_stamp":"2024-09-19T15:31:44.606212+0000","last_clean_scrub_stamp":"2024-09-19T15:31:44.606212+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:25:58.694141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":579,"num_read_kb":52358,"num_write":971,"num_write_kb":38982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":545,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.770241+0000","last_change":"2024-09-19T15:32:08.770241+0000","last_active":"2024-09-19T15:32:08.770241+0000","last_peered":"2024-09-19T15:32:08.770241+0000","last_clean":"2024-09-19T15:32:08.770241+0000","last_became_active":"2024-09-19T13:40:38.222905+0000","last_became_peered":"2024-09-19T13:40:38.222905+0000","last_unstale":"2024-09-19T15:32:08.770241+0000","last_undegraded":"2024-09-19T15:32:08.770241+0000","last_fullsized":"2024-09-19T15:32:08.770241+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:08.770061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:08.770061+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.770061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:12.097558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'1445","reported_seq":3773,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.602207+0000","last_change":"2024-09-19T15:32:07.602207+0000","last_active":"2024-09-19T15:32:07.602207+0000","last_peered":"2024-09-19T15:32:07.602207+0000","last_clean":"2024-09-19T15:32:07.602207+0000","last_became_active":"2024-09-19T13:40:40.240768+0000","last_became_peered":"2024-09-19T13:40:40.240768+0000","last_unstale":"2024-09-19T15:32:07.602207+0000","last_undegraded":"2024-09-19T15:32:07.602207+0000","last_fullsized":"2024-09-19T15:32:07.602207+0000","mapping_epoch":31,"log_start":"268'1400","ondisk_log_start":"268'1400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1445","last_scrub_stamp":"2024-09-19T15:32:07.602011+0000","last_deep_scrub":"268'1445","last_deep_scrub_stamp":"2024-09-19T15:32:07.602011+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.602011+0000","objects_scrubbed":11,"log_size":45,"log_dups_size":1400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:33:19.664247+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140168,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2240,"num_read_kb":4108,"num_write":1354,"num_write_kb":1102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:15.675453+0000","last_change":"2024-09-19T15:32:15.675453+0000","last_active":"2024-09-19T15:32:15.675453+0000","last_peered":"2024-09-19T15:32:15.675453+0000","last_clean":"2024-09-19T15:32:15.675453+0000","last_became_active":"2024-09-19T13:40:42.250172+0000","last_became_peered":"2024-09-19T13:40:42.250172+0000","last_unstale":"2024-09-19T15:32:15.675453+0000","last_undegraded":"2024-09-19T15:32:15.675453+0000","last_fullsized":"2024-09-19T15:32:15.675453+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:15.675277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:15.675277+0000","last_clean_scrub_stamp":"2024-09-19T15:32:15.675277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:42.491231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'253","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:16.648130+0000","last_change":"2024-09-19T15:32:16.648130+0000","last_active":"2024-09-19T15:32:16.648130+0000","last_peered":"2024-09-19T15:32:16.648130+0000","last_clean":"2024-09-19T15:32:16.648130+0000","last_became_active":"2024-09-19T13:40:44.272356+0000","last_became_peered":"2024-09-19T13:40:44.272356+0000","last_unstale":"2024-09-19T15:32:16.648130+0000","last_undegraded":"2024-09-19T15:32:16.648130+0000","last_fullsized":"2024-09-19T15:32:16.648130+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'253","last_scrub_stamp":"2024-09-19T15:32:16.647930+0000","last_deep_scrub":"268'253","last_deep_scrub_stamp":"2024-09-19T15:32:16.647930+0000","last_clean_scrub_stamp":"2024-09-19T15:32:16.647930+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:12.305679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":580,"num_read_kb":531,"num_write":551,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'465","reported_seq":2147,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.602220+0000","last_change":"2024-09-19T15:31:54.602220+0000","last_active":"2024-09-19T15:31:54.602220+0000","last_peered":"2024-09-19T15:31:54.602220+0000","last_clean":"2024-09-19T15:31:54.602220+0000","last_became_active":"2024-09-19T13:40:36.241832+0000","last_became_peered":"2024-09-19T13:40:36.241832+0000","last_unstale":"2024-09-19T15:31:54.602220+0000","last_undegraded":"2024-09-19T15:31:54.602220+0000","last_fullsized":"2024-09-19T15:31:54.602220+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'465","last_scrub_stamp":"2024-09-19T15:31:54.602015+0000","last_deep_scrub":"268'465","last_deep_scrub_stamp":"2024-09-19T15:31:54.602015+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.602015+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:16:12.446436+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2706,"num_read_kb":2545,"num_write":558,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":561,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:45.916600+0000","last_change":"2024-09-19T15:31:45.916600+0000","last_active":"2024-09-19T15:31:45.916600+0000","last_peered":"2024-09-19T15:31:45.916600+0000","last_clean":"2024-09-19T15:31:45.916600+0000","last_became_active":"2024-09-19T13:40:20.096900+0000","last_became_peered":"2024-09-19T13:40:20.096900+0000","last_unstale":"2024-09-19T15:31:45.916600+0000","last_undegraded":"2024-09-19T15:31:45.916600+0000","last_fullsized":"2024-09-19T15:31:45.916600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:45.916488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:45.916488+0000","last_clean_scrub_stamp":"2024-09-19T15:31:45.916488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:25:28.228849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00074274699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'333","reported_seq":1004,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:46.591446+0000","last_change":"2024-09-19T15:31:46.591446+0000","last_active":"2024-09-19T15:31:46.591446+0000","last_peered":"2024-09-19T15:31:46.591446+0000","last_clean":"2024-09-19T15:31:46.591446+0000","last_became_active":"2024-09-19T13:40:34.235483+0000","last_became_peered":"2024-09-19T13:40:34.235483+0000","last_unstale":"2024-09-19T15:31:46.591446+0000","last_undegraded":"2024-09-19T15:31:46.591446+0000","last_fullsized":"2024-09-19T15:31:46.591446+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'333","last_scrub_stamp":"2024-09-19T15:31:46.591292+0000","last_deep_scrub":"268'333","last_deep_scrub_stamp":"2024-09-19T15:31:46.591292+0000","last_clean_scrub_stamp":"2024-09-19T15:31:46.591292+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:16.796032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":610,"num_read_kb":5129,"num_write":1002,"num_write_kb":29541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"268'2","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.858708+0000","last_change":"2024-09-19T15:31:55.858708+0000","last_active":"2024-09-19T15:31:55.858708+0000","last_peered":"2024-09-19T15:31:55.858708+0000","last_clean":"2024-09-19T15:31:55.858708+0000","last_became_active":"2024-09-19T13:40:38.228364+0000","last_became_peered":"2024-09-19T13:40:38.228364+0000","last_unstale":"2024-09-19T15:31:55.858708+0000","last_undegraded":"2024-09-19T15:31:55.858708+0000","last_fullsized":"2024-09-19T15:31:55.858708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:31:55.858532+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:31:55.858532+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.858532+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:13:50.260015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'376","reported_seq":2321,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:10.621029+0000","last_change":"2024-09-19T15:32:10.621029+0000","last_active":"2024-09-19T15:32:10.621029+0000","last_peered":"2024-09-19T15:32:10.621029+0000","last_clean":"2024-09-19T15:32:10.621029+0000","last_became_active":"2024-09-19T13:40:40.231491+0000","last_became_peered":"2024-09-19T13:40:40.231491+0000","last_unstale":"2024-09-19T15:32:10.621029+0000","last_undegraded":"2024-09-19T15:32:10.621029+0000","last_fullsized":"2024-09-19T15:32:10.621029+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'376","last_scrub_stamp":"2024-09-19T15:32:10.620833+0000","last_deep_scrub":"268'376","last_deep_scrub_stamp":"2024-09-19T15:32:10.620833+0000","last_clean_scrub_stamp":"2024-09-19T15:32:10.620833+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:23:33.220998+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":364,"num_read_kb":356,"num_write":351,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:09.669183+0000","last_change":"2024-09-19T15:32:09.669183+0000","last_active":"2024-09-19T15:32:09.669183+0000","last_peered":"2024-09-19T15:32:09.669183+0000","last_clean":"2024-09-19T15:32:09.669183+0000","last_became_active":"2024-09-19T13:40:42.226706+0000","last_became_peered":"2024-09-19T13:40:42.226706+0000","last_unstale":"2024-09-19T15:32:09.669183+0000","last_undegraded":"2024-09-19T15:32:09.669183+0000","last_fullsized":"2024-09-19T15:32:09.669183+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:09.668955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:09.668955+0000","last_clean_scrub_stamp":"2024-09-19T15:32:09.668955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:20.743988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'260","reported_seq":918,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:23.162860+0000","last_change":"2024-09-19T15:32:23.162860+0000","last_active":"2024-09-19T15:32:23.162860+0000","last_peered":"2024-09-19T15:32:23.162860+0000","last_clean":"2024-09-19T15:32:23.162860+0000","last_became_active":"2024-09-19T13:40:44.240277+0000","last_became_peered":"2024-09-19T13:40:44.240277+0000","last_unstale":"2024-09-19T15:32:23.162860+0000","last_undegraded":"2024-09-19T15:32:23.162860+0000","last_fullsized":"2024-09-19T15:32:23.162860+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'260","last_scrub_stamp":"2024-09-19T15:32:23.162672+0000","last_deep_scrub":"268'260","last_deep_scrub_stamp":"2024-09-19T15:32:23.162672+0000","last_clean_scrub_stamp":"2024-09-19T15:32:23.162672+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:16:24.144823+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":590,"num_read_kb":596,"num_write":565,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'478","reported_seq":2087,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.589189+0000","last_change":"2024-09-19T15:31:52.589189+0000","last_active":"2024-09-19T15:31:52.589189+0000","last_peered":"2024-09-19T15:31:52.589189+0000","last_clean":"2024-09-19T15:31:52.589189+0000","last_became_active":"2024-09-19T13:40:36.220514+0000","last_became_peered":"2024-09-19T13:40:36.220514+0000","last_unstale":"2024-09-19T15:31:52.589189+0000","last_undegraded":"2024-09-19T15:31:52.589189+0000","last_fullsized":"2024-09-19T15:31:52.589189+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'478","last_scrub_stamp":"2024-09-19T15:31:52.588993+0000","last_deep_scrub":"268'478","last_deep_scrub_stamp":"2024-09-19T15:31:52.588993+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.588993+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:13.983822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2550,"num_read_kb":2381,"num_write":569,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"268'3","reported_seq":576,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.883980+0000","last_change":"2024-09-19T15:31:49.883980+0000","last_active":"2024-09-19T15:31:49.883980+0000","last_peered":"2024-09-19T15:31:49.883980+0000","last_clean":"2024-09-19T15:31:49.883980+0000","last_became_active":"2024-09-19T13:40:20.101198+0000","last_became_peered":"2024-09-19T13:40:20.101198+0000","last_unstale":"2024-09-19T15:31:49.883980+0000","last_undegraded":"2024-09-19T15:31:49.883980+0000","last_fullsized":"2024-09-19T15:31:49.883980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:31:49.883770+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:31:49.883770+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.883770+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:31.078465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0026053059999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'331","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.535052+0000","last_change":"2024-09-19T15:31:49.535052+0000","last_active":"2024-09-19T15:31:49.535052+0000","last_peered":"2024-09-19T15:31:49.535052+0000","last_clean":"2024-09-19T15:31:49.535052+0000","last_became_active":"2024-09-19T13:40:34.228632+0000","last_became_peered":"2024-09-19T13:40:34.228632+0000","last_unstale":"2024-09-19T15:31:49.535052+0000","last_undegraded":"2024-09-19T15:31:49.535052+0000","last_fullsized":"2024-09-19T15:31:49.535052+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'331","last_scrub_stamp":"2024-09-19T15:31:49.534756+0000","last_deep_scrub":"268'331","last_deep_scrub_stamp":"2024-09-19T15:31:49.534756+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.534756+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:30.697194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":586,"num_read_kb":6959,"num_write":997,"num_write_kb":25273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.682193+0000","last_change":"2024-09-19T15:32:02.682193+0000","last_active":"2024-09-19T15:32:02.682193+0000","last_peered":"2024-09-19T15:32:02.682193+0000","last_clean":"2024-09-19T15:32:02.682193+0000","last_became_active":"2024-09-19T13:40:38.229144+0000","last_became_peered":"2024-09-19T13:40:38.229144+0000","last_unstale":"2024-09-19T15:32:02.682193+0000","last_undegraded":"2024-09-19T15:32:02.682193+0000","last_fullsized":"2024-09-19T15:32:02.682193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:02.681899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:02.681899+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.681899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:38:34.444774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'221","reported_seq":844,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:11.123386+0000","last_change":"2024-09-19T15:32:11.123386+0000","last_active":"2024-09-19T15:32:11.123386+0000","last_peered":"2024-09-19T15:32:11.123386+0000","last_clean":"2024-09-19T15:32:11.123386+0000","last_became_active":"2024-09-19T13:40:40.249102+0000","last_became_peered":"2024-09-19T13:40:40.249102+0000","last_unstale":"2024-09-19T15:32:11.123386+0000","last_undegraded":"2024-09-19T15:32:11.123386+0000","last_fullsized":"2024-09-19T15:32:11.123386+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'221","last_scrub_stamp":"2024-09-19T15:32:11.123189+0000","last_deep_scrub":"268'221","last_deep_scrub_stamp":"2024-09-19T15:32:11.123189+0000","last_clean_scrub_stamp":"2024-09-19T15:32:11.123189+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:43.556142+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":198,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.976413+0000","last_change":"2024-09-19T15:32:02.976413+0000","last_active":"2024-09-19T15:32:02.976413+0000","last_peered":"2024-09-19T15:32:02.976413+0000","last_clean":"2024-09-19T15:32:02.976413+0000","last_became_active":"2024-09-19T13:40:42.250662+0000","last_became_peered":"2024-09-19T13:40:42.250662+0000","last_unstale":"2024-09-19T15:32:02.976413+0000","last_undegraded":"2024-09-19T15:32:02.976413+0000","last_fullsized":"2024-09-19T15:32:02.976413+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:02.976144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:02.976144+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.976144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:01:47.323179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'129","reported_seq":729,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:20.690284+0000","last_change":"2024-09-19T15:32:20.690284+0000","last_active":"2024-09-19T15:32:20.690284+0000","last_peered":"2024-09-19T15:32:20.690284+0000","last_clean":"2024-09-19T15:32:20.690284+0000","last_became_active":"2024-09-19T13:40:44.266678+0000","last_became_peered":"2024-09-19T13:40:44.266678+0000","last_unstale":"2024-09-19T15:32:20.690284+0000","last_undegraded":"2024-09-19T15:32:20.690284+0000","last_fullsized":"2024-09-19T15:32:20.690284+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'129","last_scrub_stamp":"2024-09-19T15:32:20.690092+0000","last_deep_scrub":"268'129","last_deep_scrub_stamp":"2024-09-19T15:32:20.690092+0000","last_clean_scrub_stamp":"2024-09-19T15:32:20.690092+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:58:14.495253+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":283,"num_read_kb":273,"num_write":324,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'763","reported_seq":2298,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.608306+0000","last_change":"2024-09-19T15:31:51.608306+0000","last_active":"2024-09-19T15:31:51.608306+0000","last_peered":"2024-09-19T15:31:51.608306+0000","last_clean":"2024-09-19T15:31:51.608306+0000","last_became_active":"2024-09-19T13:40:36.244403+0000","last_became_peered":"2024-09-19T13:40:36.244403+0000","last_unstale":"2024-09-19T15:31:51.608306+0000","last_undegraded":"2024-09-19T15:31:51.608306+0000","last_fullsized":"2024-09-19T15:31:51.608306+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'763","last_scrub_stamp":"2024-09-19T15:31:51.608119+0000","last_deep_scrub":"268'763","last_deep_scrub_stamp":"2024-09-19T15:31:51.608119+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.608119+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:20:55.798909+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3619,"num_read_kb":3269,"num_write":981,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'331","reported_seq":1054,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.872562+0000","last_change":"2024-09-19T15:31:47.872562+0000","last_active":"2024-09-19T15:31:47.872562+0000","last_peered":"2024-09-19T15:31:47.872562+0000","last_clean":"2024-09-19T15:31:47.872562+0000","last_became_active":"2024-09-19T13:40:34.225452+0000","last_became_peered":"2024-09-19T13:40:34.225452+0000","last_unstale":"2024-09-19T15:31:47.872562+0000","last_undegraded":"2024-09-19T15:31:47.872562+0000","last_fullsized":"2024-09-19T15:31:47.872562+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'331","last_scrub_stamp":"2024-09-19T15:31:47.872337+0000","last_deep_scrub":"268'331","last_deep_scrub_stamp":"2024-09-19T15:31:47.872337+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.872337+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:54:19.173058+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":603,"num_read_kb":97113,"num_write":1108,"num_write_kb":15979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":559,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.574504+0000","last_change":"2024-09-19T15:31:53.574504+0000","last_active":"2024-09-19T15:31:53.574504+0000","last_peered":"2024-09-19T15:31:53.574504+0000","last_clean":"2024-09-19T15:31:53.574504+0000","last_became_active":"2024-09-19T13:40:20.095294+0000","last_became_peered":"2024-09-19T13:40:20.095294+0000","last_unstale":"2024-09-19T15:31:53.574504+0000","last_undegraded":"2024-09-19T15:31:53.574504+0000","last_fullsized":"2024-09-19T15:31:53.574504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:53.574327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:53.574327+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.574327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:10:59.805802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088577700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.695360+0000","last_change":"2024-09-19T15:32:03.695360+0000","last_active":"2024-09-19T15:32:03.695360+0000","last_peered":"2024-09-19T15:32:03.695360+0000","last_clean":"2024-09-19T15:32:03.695360+0000","last_became_active":"2024-09-19T13:40:38.229743+0000","last_became_peered":"2024-09-19T13:40:38.229743+0000","last_unstale":"2024-09-19T15:32:03.695360+0000","last_undegraded":"2024-09-19T15:32:03.695360+0000","last_fullsized":"2024-09-19T15:32:03.695360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:03.695122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:03.695122+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.695122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:24.519149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'629","reported_seq":1372,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.718978+0000","last_change":"2024-09-19T15:32:06.718978+0000","last_active":"2024-09-19T15:32:06.718978+0000","last_peered":"2024-09-19T15:32:06.718978+0000","last_clean":"2024-09-19T15:32:06.718978+0000","last_became_active":"2024-09-19T13:40:40.223632+0000","last_became_peered":"2024-09-19T13:40:40.223632+0000","last_unstale":"2024-09-19T15:32:06.718978+0000","last_undegraded":"2024-09-19T15:32:06.718978+0000","last_fullsized":"2024-09-19T15:32:06.718978+0000","mapping_epoch":31,"log_start":"268'600","ondisk_log_start":"268'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'629","last_scrub_stamp":"2024-09-19T15:32:06.718778+0000","last_deep_scrub":"268'629","last_deep_scrub_stamp":"2024-09-19T15:32:06.718778+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.718778+0000","objects_scrubbed":9,"log_size":29,"log_dups_size":600,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:03:42.317447+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101088,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1063,"num_read_kb":2259,"num_write":846,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4334,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:15.560755+0000","last_change":"2024-09-19T15:32:15.560755+0000","last_active":"2024-09-19T15:32:15.560755+0000","last_peered":"2024-09-19T15:32:15.560755+0000","last_clean":"2024-09-19T15:32:15.560755+0000","last_became_active":"2024-09-19T13:40:42.245476+0000","last_became_peered":"2024-09-19T13:40:42.245476+0000","last_unstale":"2024-09-19T15:32:15.560755+0000","last_undegraded":"2024-09-19T15:32:15.560755+0000","last_fullsized":"2024-09-19T15:32:15.560755+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:15.560570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:15.560570+0000","last_clean_scrub_stamp":"2024-09-19T15:32:15.560570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:17:12.700932+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'144","reported_seq":690,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:18.590074+0000","last_change":"2024-09-19T15:32:18.590074+0000","last_active":"2024-09-19T15:32:18.590074+0000","last_peered":"2024-09-19T15:32:18.590074+0000","last_clean":"2024-09-19T15:32:18.590074+0000","last_became_active":"2024-09-19T13:40:44.274333+0000","last_became_peered":"2024-09-19T13:40:44.274333+0000","last_unstale":"2024-09-19T15:32:18.590074+0000","last_undegraded":"2024-09-19T15:32:18.590074+0000","last_fullsized":"2024-09-19T15:32:18.590074+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'144","last_scrub_stamp":"2024-09-19T15:32:18.589874+0000","last_deep_scrub":"268'144","last_deep_scrub_stamp":"2024-09-19T15:32:18.589874+0000","last_clean_scrub_stamp":"2024-09-19T15:32:18.589874+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:14.788018+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":236,"num_read_kb":218,"num_write":346,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'457","reported_seq":2048,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.718250+0000","last_change":"2024-09-19T15:31:53.718250+0000","last_active":"2024-09-19T15:31:53.718250+0000","last_peered":"2024-09-19T15:31:53.718250+0000","last_clean":"2024-09-19T15:31:53.718250+0000","last_became_active":"2024-09-19T13:40:36.241654+0000","last_became_peered":"2024-09-19T13:40:36.241654+0000","last_unstale":"2024-09-19T15:31:53.718250+0000","last_undegraded":"2024-09-19T15:31:53.718250+0000","last_fullsized":"2024-09-19T15:31:53.718250+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'457","last_scrub_stamp":"2024-09-19T15:31:53.718067+0000","last_deep_scrub":"268'457","last_deep_scrub_stamp":"2024-09-19T15:31:53.718067+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.718067+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:46.154892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2406,"num_read_kb":2267,"num_write":541,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'310","reported_seq":969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.607762+0000","last_change":"2024-09-19T15:31:47.607762+0000","last_active":"2024-09-19T15:31:47.607762+0000","last_peered":"2024-09-19T15:31:47.607762+0000","last_clean":"2024-09-19T15:31:47.607762+0000","last_became_active":"2024-09-19T13:40:34.248944+0000","last_became_peered":"2024-09-19T13:40:34.248944+0000","last_unstale":"2024-09-19T15:31:47.607762+0000","last_undegraded":"2024-09-19T15:31:47.607762+0000","last_fullsized":"2024-09-19T15:31:47.607762+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'310","last_scrub_stamp":"2024-09-19T15:31:47.607553+0000","last_deep_scrub":"268'310","last_deep_scrub_stamp":"2024-09-19T15:31:47.607553+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.607553+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:29.191774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":481,"num_read_kb":60023,"num_write":924,"num_write_kb":13648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":568,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.812139+0000","last_change":"2024-09-19T15:31:50.812139+0000","last_active":"2024-09-19T15:31:50.812139+0000","last_peered":"2024-09-19T15:31:50.812139+0000","last_clean":"2024-09-19T15:31:50.812139+0000","last_became_active":"2024-09-19T13:40:20.096321+0000","last_became_peered":"2024-09-19T13:40:20.096321+0000","last_unstale":"2024-09-19T15:31:50.812139+0000","last_undegraded":"2024-09-19T15:31:50.812139+0000","last_fullsized":"2024-09-19T15:31:50.812139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:50.811952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:50.811952+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.811952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:18:19.479967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001025329,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.917066+0000","last_change":"2024-09-19T15:31:59.917066+0000","last_active":"2024-09-19T15:31:59.917066+0000","last_peered":"2024-09-19T15:31:59.917066+0000","last_clean":"2024-09-19T15:31:59.917066+0000","last_became_active":"2024-09-19T13:40:38.229784+0000","last_became_peered":"2024-09-19T13:40:38.229784+0000","last_unstale":"2024-09-19T15:31:59.917066+0000","last_undegraded":"2024-09-19T15:31:59.917066+0000","last_fullsized":"2024-09-19T15:31:59.917066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:59.916882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:59.916882+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.916882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:52:47.622841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'347","reported_seq":991,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.645649+0000","last_change":"2024-09-19T15:32:04.645649+0000","last_active":"2024-09-19T15:32:04.645649+0000","last_peered":"2024-09-19T15:32:04.645649+0000","last_clean":"2024-09-19T15:32:04.645649+0000","last_became_active":"2024-09-19T13:40:40.239406+0000","last_became_peered":"2024-09-19T13:40:40.239406+0000","last_unstale":"2024-09-19T15:32:04.645649+0000","last_undegraded":"2024-09-19T15:32:04.645649+0000","last_fullsized":"2024-09-19T15:32:04.645649+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'347","last_scrub_stamp":"2024-09-19T15:32:04.645520+0000","last_deep_scrub":"268'347","last_deep_scrub_stamp":"2024-09-19T15:32:04.645520+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.645520+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:32:12.200401+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":438,"num_read_kb":429,"num_write":416,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6602,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'786","reported_seq":3370,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:17.648638+0000","last_change":"2024-09-19T15:32:17.648638+0000","last_active":"2024-09-19T15:32:17.648638+0000","last_peered":"2024-09-19T15:32:17.648638+0000","last_clean":"2024-09-19T15:32:17.648638+0000","last_became_active":"2024-09-19T13:40:42.244921+0000","last_became_peered":"2024-09-19T13:40:42.244921+0000","last_unstale":"2024-09-19T15:32:17.648638+0000","last_undegraded":"2024-09-19T15:32:17.648638+0000","last_fullsized":"2024-09-19T15:32:17.648638+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'786","last_scrub_stamp":"2024-09-19T15:32:17.648461+0000","last_deep_scrub":"268'786","last_deep_scrub_stamp":"2024-09-19T15:32:17.648461+0000","last_clean_scrub_stamp":"2024-09-19T15:32:17.648461+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:59.218164+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'144","reported_seq":712,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:25.112227+0000","last_change":"2024-09-19T15:32:25.112227+0000","last_active":"2024-09-19T15:32:25.112227+0000","last_peered":"2024-09-19T15:32:25.112227+0000","last_clean":"2024-09-19T15:32:25.112227+0000","last_became_active":"2024-09-19T13:40:44.277602+0000","last_became_peered":"2024-09-19T13:40:44.277602+0000","last_unstale":"2024-09-19T15:32:25.112227+0000","last_undegraded":"2024-09-19T15:32:25.112227+0000","last_fullsized":"2024-09-19T15:32:25.112227+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'144","last_scrub_stamp":"2024-09-19T15:32:25.112017+0000","last_deep_scrub":"268'144","last_deep_scrub_stamp":"2024-09-19T15:32:25.112017+0000","last_clean_scrub_stamp":"2024-09-19T15:32:25.112017+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:47.863568+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":303,"num_read_kb":269,"num_write":341,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'434","reported_seq":1942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.956165+0000","last_change":"2024-09-19T15:31:56.956165+0000","last_active":"2024-09-19T15:31:56.956165+0000","last_peered":"2024-09-19T15:31:56.956165+0000","last_clean":"2024-09-19T15:31:56.956165+0000","last_became_active":"2024-09-19T13:40:36.235186+0000","last_became_peered":"2024-09-19T13:40:36.235186+0000","last_unstale":"2024-09-19T15:31:56.956165+0000","last_undegraded":"2024-09-19T15:31:56.956165+0000","last_fullsized":"2024-09-19T15:31:56.956165+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'434","last_scrub_stamp":"2024-09-19T15:31:56.955979+0000","last_deep_scrub":"268'434","last_deep_scrub_stamp":"2024-09-19T15:31:56.955979+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.955979+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:06.924774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2268,"num_read_kb":2120,"num_write":492,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'422","reported_seq":1267,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:46.840046+0000","last_change":"2024-09-19T15:31:46.840046+0000","last_active":"2024-09-19T15:31:46.840046+0000","last_peered":"2024-09-19T15:31:46.840046+0000","last_clean":"2024-09-19T15:31:46.840046+0000","last_became_active":"2024-09-19T13:40:34.236325+0000","last_became_peered":"2024-09-19T13:40:34.236325+0000","last_unstale":"2024-09-19T15:31:46.840046+0000","last_undegraded":"2024-09-19T15:31:46.840046+0000","last_fullsized":"2024-09-19T15:31:46.840046+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'422","last_scrub_stamp":"2024-09-19T15:31:46.839904+0000","last_deep_scrub":"268'422","last_deep_scrub_stamp":"2024-09-19T15:31:46.839904+0000","last_clean_scrub_stamp":"2024-09-19T15:31:46.839904+0000","objects_scrubbed":8,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:07.793346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":865,"num_read_kb":111541,"num_write":1317,"num_write_kb":62709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":557,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:45.587206+0000","last_change":"2024-09-19T15:31:45.587206+0000","last_active":"2024-09-19T15:31:45.587206+0000","last_peered":"2024-09-19T15:31:45.587206+0000","last_clean":"2024-09-19T15:31:45.587206+0000","last_became_active":"2024-09-19T13:40:20.101186+0000","last_became_peered":"2024-09-19T13:40:20.101186+0000","last_unstale":"2024-09-19T15:31:45.587206+0000","last_undegraded":"2024-09-19T15:31:45.587206+0000","last_fullsized":"2024-09-19T15:31:45.587206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:45.587128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:45.587128+0000","last_clean_scrub_stamp":"2024-09-19T15:31:45.587128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:24.645925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010323750000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.533455+0000","last_change":"2024-09-19T15:32:07.533455+0000","last_active":"2024-09-19T15:32:07.533455+0000","last_peered":"2024-09-19T15:32:07.533455+0000","last_clean":"2024-09-19T15:32:07.533455+0000","last_became_active":"2024-09-19T13:40:38.235109+0000","last_became_peered":"2024-09-19T13:40:38.235109+0000","last_unstale":"2024-09-19T15:32:07.533455+0000","last_undegraded":"2024-09-19T15:32:07.533455+0000","last_fullsized":"2024-09-19T15:32:07.533455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:07.533271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:07.533271+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.533271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:11:41.966852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'198","reported_seq":806,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:11.587452+0000","last_change":"2024-09-19T15:32:11.587452+0000","last_active":"2024-09-19T15:32:11.587452+0000","last_peered":"2024-09-19T15:32:11.587452+0000","last_clean":"2024-09-19T15:32:11.587452+0000","last_became_active":"2024-09-19T13:40:40.244484+0000","last_became_peered":"2024-09-19T13:40:40.244484+0000","last_unstale":"2024-09-19T15:32:11.587452+0000","last_undegraded":"2024-09-19T15:32:11.587452+0000","last_fullsized":"2024-09-19T15:32:11.587452+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'198","last_scrub_stamp":"2024-09-19T15:32:11.587262+0000","last_deep_scrub":"268'198","last_deep_scrub_stamp":"2024-09-19T15:32:11.587262+0000","last_clean_scrub_stamp":"2024-09-19T15:32:11.587262+0000","objects_scrubbed":5,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:58.251932+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":238,"num_read_kb":228,"num_write":166,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'790","reported_seq":5121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:19.198016+0000","last_change":"2024-09-19T15:32:19.198016+0000","last_active":"2024-09-19T15:32:19.198016+0000","last_peered":"2024-09-19T15:32:19.198016+0000","last_clean":"2024-09-19T15:32:19.198016+0000","last_became_active":"2024-09-19T13:40:42.257799+0000","last_became_peered":"2024-09-19T13:40:42.257799+0000","last_unstale":"2024-09-19T15:32:19.198016+0000","last_undegraded":"2024-09-19T15:32:19.198016+0000","last_fullsized":"2024-09-19T15:32:19.198016+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'790","last_scrub_stamp":"2024-09-19T15:32:19.197825+0000","last_deep_scrub":"268'790","last_deep_scrub_stamp":"2024-09-19T15:32:19.197825+0000","last_clean_scrub_stamp":"2024-09-19T15:32:19.197825+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:30:42.393600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'193","reported_seq":734,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:19.618188+0000","last_change":"2024-09-19T15:32:19.618188+0000","last_active":"2024-09-19T15:32:19.618188+0000","last_peered":"2024-09-19T15:32:19.618188+0000","last_clean":"2024-09-19T15:32:19.618188+0000","last_became_active":"2024-09-19T13:40:44.259077+0000","last_became_peered":"2024-09-19T13:40:44.259077+0000","last_unstale":"2024-09-19T15:32:19.618188+0000","last_undegraded":"2024-09-19T15:32:19.618188+0000","last_fullsized":"2024-09-19T15:32:19.618188+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'193","last_scrub_stamp":"2024-09-19T15:32:19.618021+0000","last_deep_scrub":"268'193","last_deep_scrub_stamp":"2024-09-19T15:32:19.618021+0000","last_clean_scrub_stamp":"2024-09-19T15:32:19.618021+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:33:46.257575+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":211,"num_read_kb":198,"num_write":423,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'430","reported_seq":1964,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.463133+0000","last_change":"2024-09-19T15:31:51.463133+0000","last_active":"2024-09-19T15:31:51.463133+0000","last_peered":"2024-09-19T15:31:51.463133+0000","last_clean":"2024-09-19T15:31:51.463133+0000","last_became_active":"2024-09-19T13:40:36.242739+0000","last_became_peered":"2024-09-19T13:40:36.242739+0000","last_unstale":"2024-09-19T15:31:51.463133+0000","last_undegraded":"2024-09-19T15:31:51.463133+0000","last_fullsized":"2024-09-19T15:31:51.463133+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'430","last_scrub_stamp":"2024-09-19T15:31:51.462915+0000","last_deep_scrub":"268'430","last_deep_scrub_stamp":"2024-09-19T15:31:51.462915+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.462915+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:56:09.165916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2240,"num_read_kb":2109,"num_write":493,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'308","reported_seq":968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.911724+0000","last_change":"2024-09-19T15:31:47.911724+0000","last_active":"2024-09-19T15:31:47.911724+0000","last_peered":"2024-09-19T15:31:47.911724+0000","last_clean":"2024-09-19T15:31:47.911724+0000","last_became_active":"2024-09-19T13:41:05.316287+0000","last_became_peered":"2024-09-19T13:41:05.316287+0000","last_unstale":"2024-09-19T15:31:47.911724+0000","last_undegraded":"2024-09-19T15:31:47.911724+0000","last_fullsized":"2024-09-19T15:31:47.911724+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'308","last_scrub_stamp":"2024-09-19T15:31:47.911606+0000","last_deep_scrub":"268'308","last_deep_scrub_stamp":"2024-09-19T15:31:47.911606+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.911606+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:23.680919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":643,"num_read_kb":12872,"num_write":1020,"num_write_kb":31603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":554,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.930367+0000","last_change":"2024-09-19T15:31:47.930367+0000","last_active":"2024-09-19T15:31:47.930367+0000","last_peered":"2024-09-19T15:31:47.930367+0000","last_clean":"2024-09-19T15:31:47.930367+0000","last_became_active":"2024-09-19T13:40:20.103134+0000","last_became_peered":"2024-09-19T13:40:20.103134+0000","last_unstale":"2024-09-19T15:31:47.930367+0000","last_undegraded":"2024-09-19T15:31:47.930367+0000","last_fullsized":"2024-09-19T15:31:47.930367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:47.930194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:47.930194+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.930194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:21.433702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093870599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.020103+0000","last_change":"2024-09-19T15:32:07.020103+0000","last_active":"2024-09-19T15:32:07.020103+0000","last_peered":"2024-09-19T15:32:07.020103+0000","last_clean":"2024-09-19T15:32:07.020103+0000","last_became_active":"2024-09-19T13:40:38.221430+0000","last_became_peered":"2024-09-19T13:40:38.221430+0000","last_unstale":"2024-09-19T15:32:07.020103+0000","last_undegraded":"2024-09-19T15:32:07.020103+0000","last_fullsized":"2024-09-19T15:32:07.020103+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:07.019913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:07.019913+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.019913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:54:53.009598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'848","reported_seq":1648,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:09.663377+0000","last_change":"2024-09-19T15:32:09.663377+0000","last_active":"2024-09-19T15:32:09.663377+0000","last_peered":"2024-09-19T15:32:09.663377+0000","last_clean":"2024-09-19T15:32:09.663377+0000","last_became_active":"2024-09-19T13:40:40.229426+0000","last_became_peered":"2024-09-19T13:40:40.229426+0000","last_unstale":"2024-09-19T15:32:09.663377+0000","last_undegraded":"2024-09-19T15:32:09.663377+0000","last_fullsized":"2024-09-19T15:32:09.663377+0000","mapping_epoch":31,"log_start":"268'800","ondisk_log_start":"268'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'848","last_scrub_stamp":"2024-09-19T15:32:09.663116+0000","last_deep_scrub":"268'848","last_deep_scrub_stamp":"2024-09-19T15:32:09.663116+0000","last_clean_scrub_stamp":"2024-09-19T15:32:09.663116+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":800,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:43.808766+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140545,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1480,"num_read_kb":3413,"num_write":1200,"num_write_kb":946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:18.172465+0000","last_change":"2024-09-19T15:32:18.172465+0000","last_active":"2024-09-19T15:32:18.172465+0000","last_peered":"2024-09-19T15:32:18.172465+0000","last_clean":"2024-09-19T15:32:18.172465+0000","last_became_active":"2024-09-19T13:40:42.244291+0000","last_became_peered":"2024-09-19T13:40:42.244291+0000","last_unstale":"2024-09-19T15:32:18.172465+0000","last_undegraded":"2024-09-19T15:32:18.172465+0000","last_fullsized":"2024-09-19T15:32:18.172465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:18.172280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:18.172280+0000","last_clean_scrub_stamp":"2024-09-19T15:32:18.172280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:46.823936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'154","reported_seq":719,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:21.645279+0000","last_change":"2024-09-19T15:32:21.645279+0000","last_active":"2024-09-19T15:32:21.645279+0000","last_peered":"2024-09-19T15:32:21.645279+0000","last_clean":"2024-09-19T15:32:21.645279+0000","last_became_active":"2024-09-19T13:40:44.273409+0000","last_became_peered":"2024-09-19T13:40:44.273409+0000","last_unstale":"2024-09-19T15:32:21.645279+0000","last_undegraded":"2024-09-19T15:32:21.645279+0000","last_fullsized":"2024-09-19T15:32:21.645279+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'154","last_scrub_stamp":"2024-09-19T15:32:21.645095+0000","last_deep_scrub":"268'154","last_deep_scrub_stamp":"2024-09-19T15:32:21.645095+0000","last_clean_scrub_stamp":"2024-09-19T15:32:21.645095+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:13:10.870852+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":293,"num_read_kb":268,"num_write":395,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'159","reported_seq":751,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:21.624736+0000","last_change":"2024-09-19T15:32:21.624736+0000","last_active":"2024-09-19T15:32:21.624736+0000","last_peered":"2024-09-19T15:32:21.624736+0000","last_clean":"2024-09-19T15:32:21.624736+0000","last_became_active":"2024-09-19T13:40:44.263575+0000","last_became_peered":"2024-09-19T13:40:44.263575+0000","last_unstale":"2024-09-19T15:32:21.624736+0000","last_undegraded":"2024-09-19T15:32:21.624736+0000","last_fullsized":"2024-09-19T15:32:21.624736+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'159","last_scrub_stamp":"2024-09-19T15:32:21.624559+0000","last_deep_scrub":"268'159","last_deep_scrub_stamp":"2024-09-19T15:32:21.624559+0000","last_clean_scrub_stamp":"2024-09-19T15:32:21.624559+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:42.336374+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":274,"num_read_kb":267,"num_write":381,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'492","reported_seq":2284,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.506802+0000","last_change":"2024-09-19T15:31:56.506648+0000","last_active":"2024-09-19T15:31:56.506802+0000","last_peered":"2024-09-19T15:31:56.506802+0000","last_clean":"2024-09-19T15:31:56.506802+0000","last_became_active":"2024-09-19T13:40:36.221019+0000","last_became_peered":"2024-09-19T13:40:36.221019+0000","last_unstale":"2024-09-19T15:31:56.506802+0000","last_undegraded":"2024-09-19T15:31:56.506802+0000","last_fullsized":"2024-09-19T15:31:56.506802+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'492","last_scrub_stamp":"2024-09-19T15:31:56.506455+0000","last_deep_scrub":"268'492","last_deep_scrub_stamp":"2024-09-19T15:31:56.506455+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.506455+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:19.156962+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2720,"num_read_kb":2588,"num_write":552,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'395","reported_seq":1071,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:46.557289+0000","last_change":"2024-09-19T15:31:46.557289+0000","last_active":"2024-09-19T15:31:46.557289+0000","last_peered":"2024-09-19T15:31:46.557289+0000","last_clean":"2024-09-19T15:31:46.557289+0000","last_became_active":"2024-09-19T13:40:34.263276+0000","last_became_peered":"2024-09-19T13:40:34.263276+0000","last_unstale":"2024-09-19T15:31:46.557289+0000","last_undegraded":"2024-09-19T15:31:46.557289+0000","last_fullsized":"2024-09-19T15:31:46.557289+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'395","last_scrub_stamp":"2024-09-19T15:31:46.557001+0000","last_deep_scrub":"268'395","last_deep_scrub_stamp":"2024-09-19T15:31:46.557001+0000","last_clean_scrub_stamp":"2024-09-19T15:31:46.557001+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:39:37.507208+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":686,"num_read_kb":11371,"num_write":1228,"num_write_kb":39217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"268'6","reported_seq":1006,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.615629+0000","last_change":"2024-09-19T15:32:02.615454+0000","last_active":"2024-09-19T15:32:02.615629+0000","last_peered":"2024-09-19T15:32:02.615629+0000","last_clean":"2024-09-19T15:32:02.615629+0000","last_became_active":"2024-09-19T13:40:38.215364+0000","last_became_peered":"2024-09-19T13:40:38.215364+0000","last_unstale":"2024-09-19T15:32:02.615629+0000","last_undegraded":"2024-09-19T15:32:02.615629+0000","last_fullsized":"2024-09-19T15:32:02.615629+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-19T15:32:02.615245+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-19T15:32:02.615245+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.615245+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:36.144028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":1184,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'365","reported_seq":1008,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:14.155801+0000","last_change":"2024-09-19T15:32:14.155620+0000","last_active":"2024-09-19T15:32:14.155801+0000","last_peered":"2024-09-19T15:32:14.155801+0000","last_clean":"2024-09-19T15:32:14.155801+0000","last_became_active":"2024-09-19T13:40:40.229872+0000","last_became_peered":"2024-09-19T13:40:40.229872+0000","last_unstale":"2024-09-19T15:32:14.155801+0000","last_undegraded":"2024-09-19T15:32:14.155801+0000","last_fullsized":"2024-09-19T15:32:14.155801+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'365","last_scrub_stamp":"2024-09-19T15:32:14.155416+0000","last_deep_scrub":"268'365","last_deep_scrub_stamp":"2024-09-19T15:32:14.155416+0000","last_clean_scrub_stamp":"2024-09-19T15:32:14.155416+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:05.890368+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":585,"num_read_kb":1412,"num_write":468,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:22.168176+0000","last_change":"2024-09-19T15:32:22.168016+0000","last_active":"2024-09-19T15:32:22.168176+0000","last_peered":"2024-09-19T15:32:22.168176+0000","last_clean":"2024-09-19T15:32:22.168176+0000","last_became_active":"2024-09-19T13:40:42.242368+0000","last_became_peered":"2024-09-19T13:40:42.242368+0000","last_unstale":"2024-09-19T15:32:22.168176+0000","last_undegraded":"2024-09-19T15:32:22.168176+0000","last_fullsized":"2024-09-19T15:32:22.168176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:22.167830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:22.167830+0000","last_clean_scrub_stamp":"2024-09-19T15:32:22.167830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:51.867912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'122","reported_seq":660,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:28.083754+0000","last_change":"2024-09-19T15:32:28.083754+0000","last_active":"2024-09-19T15:32:28.083754+0000","last_peered":"2024-09-19T15:32:28.083754+0000","last_clean":"2024-09-19T15:32:28.083754+0000","last_became_active":"2024-09-19T13:40:44.268946+0000","last_became_peered":"2024-09-19T13:40:44.268946+0000","last_unstale":"2024-09-19T15:32:28.083754+0000","last_undegraded":"2024-09-19T15:32:28.083754+0000","last_fullsized":"2024-09-19T15:32:28.083754+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'122","last_scrub_stamp":"2024-09-19T15:32:28.083518+0000","last_deep_scrub":"268'122","last_deep_scrub_stamp":"2024-09-19T15:32:28.083518+0000","last_clean_scrub_stamp":"2024-09-19T15:32:28.083518+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:30.513074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":128,"num_write":265,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'469","reported_seq":2042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.567897+0000","last_change":"2024-09-19T15:31:57.567600+0000","last_active":"2024-09-19T15:31:57.567897+0000","last_peered":"2024-09-19T15:31:57.567897+0000","last_clean":"2024-09-19T15:31:57.567897+0000","last_became_active":"2024-09-19T13:40:36.226164+0000","last_became_peered":"2024-09-19T13:40:36.226164+0000","last_unstale":"2024-09-19T15:31:57.567897+0000","last_undegraded":"2024-09-19T15:31:57.567897+0000","last_fullsized":"2024-09-19T15:31:57.567897+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'469","last_scrub_stamp":"2024-09-19T15:31:57.567370+0000","last_deep_scrub":"268'469","last_deep_scrub_stamp":"2024-09-19T15:31:57.567370+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.567370+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:50.223505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2492,"num_read_kb":2321,"num_write":561,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'308","reported_seq":1061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.734220+0000","last_change":"2024-09-19T15:31:54.734220+0000","last_active":"2024-09-19T15:31:54.734220+0000","last_peered":"2024-09-19T15:31:54.734220+0000","last_clean":"2024-09-19T15:31:54.734220+0000","last_became_active":"2024-09-19T13:41:05.387779+0000","last_became_peered":"2024-09-19T13:41:05.387779+0000","last_unstale":"2024-09-19T15:31:54.734220+0000","last_undegraded":"2024-09-19T15:31:54.734220+0000","last_fullsized":"2024-09-19T15:31:54.734220+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'308","last_scrub_stamp":"2024-09-19T15:31:54.734020+0000","last_deep_scrub":"268'308","last_deep_scrub_stamp":"2024-09-19T15:31:54.734020+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.734020+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:08.138762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":891,"num_read_kb":29706,"num_write":1011,"num_write_kb":41961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.051944+0000","last_change":"2024-09-19T15:32:08.051796+0000","last_active":"2024-09-19T15:32:08.051944+0000","last_peered":"2024-09-19T15:32:08.051944+0000","last_clean":"2024-09-19T15:32:08.051944+0000","last_became_active":"2024-09-19T13:40:38.228856+0000","last_became_peered":"2024-09-19T13:40:38.228856+0000","last_unstale":"2024-09-19T15:32:08.051944+0000","last_undegraded":"2024-09-19T15:32:08.051944+0000","last_fullsized":"2024-09-19T15:32:08.051944+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:08.051584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:08.051584+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.051584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:44.498532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'88","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.666957+0000","last_change":"2024-09-19T15:32:08.666857+0000","last_active":"2024-09-19T15:32:08.666957+0000","last_peered":"2024-09-19T15:32:08.666957+0000","last_clean":"2024-09-19T15:32:08.666957+0000","last_became_active":"2024-09-19T13:40:40.235528+0000","last_became_peered":"2024-09-19T13:40:40.235528+0000","last_unstale":"2024-09-19T15:32:08.666957+0000","last_undegraded":"2024-09-19T15:32:08.666957+0000","last_fullsized":"2024-09-19T15:32:08.666957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'88","last_scrub_stamp":"2024-09-19T15:32:08.666742+0000","last_deep_scrub":"268'88","last_deep_scrub_stamp":"2024-09-19T15:32:08.666742+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.666742+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:31.018966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":75,"num_write":58,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:16.633620+0000","last_change":"2024-09-19T15:32:16.633560+0000","last_active":"2024-09-19T15:32:16.633620+0000","last_peered":"2024-09-19T15:32:16.633620+0000","last_clean":"2024-09-19T15:32:16.633620+0000","last_became_active":"2024-09-19T13:40:42.243224+0000","last_became_peered":"2024-09-19T13:40:42.243224+0000","last_unstale":"2024-09-19T15:32:16.633620+0000","last_undegraded":"2024-09-19T15:32:16.633620+0000","last_fullsized":"2024-09-19T15:32:16.633620+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:16.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:16.633480+0000","last_clean_scrub_stamp":"2024-09-19T15:32:16.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:16:17.039545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'211","reported_seq":765,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:22.591547+0000","last_change":"2024-09-19T15:32:22.591547+0000","last_active":"2024-09-19T15:32:22.591547+0000","last_peered":"2024-09-19T15:32:22.591547+0000","last_clean":"2024-09-19T15:32:22.591547+0000","last_became_active":"2024-09-19T13:40:44.258721+0000","last_became_peered":"2024-09-19T13:40:44.258721+0000","last_unstale":"2024-09-19T15:32:22.591547+0000","last_undegraded":"2024-09-19T15:32:22.591547+0000","last_fullsized":"2024-09-19T15:32:22.591547+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'211","last_scrub_stamp":"2024-09-19T15:32:22.591333+0000","last_deep_scrub":"268'211","last_deep_scrub_stamp":"2024-09-19T15:32:22.591333+0000","last_clean_scrub_stamp":"2024-09-19T15:32:22.591333+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":100,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:21.010735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":369,"num_read_kb":358,"num_write":477,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'371","reported_seq":1901,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.999716+0000","last_change":"2024-09-19T15:31:58.999581+0000","last_active":"2024-09-19T15:31:58.999716+0000","last_peered":"2024-09-19T15:31:58.999716+0000","last_clean":"2024-09-19T15:31:58.999716+0000","last_became_active":"2024-09-19T13:40:36.239629+0000","last_became_peered":"2024-09-19T13:40:36.239629+0000","last_unstale":"2024-09-19T15:31:58.999716+0000","last_undegraded":"2024-09-19T15:31:58.999716+0000","last_fullsized":"2024-09-19T15:31:58.999716+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'371","last_scrub_stamp":"2024-09-19T15:31:58.999403+0000","last_deep_scrub":"268'371","last_deep_scrub_stamp":"2024-09-19T15:31:58.999403+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.999403+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:05:57.130902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2075,"num_read_kb":1985,"num_write":419,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'332","reported_seq":1015,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.805753+0000","last_change":"2024-09-19T15:31:51.805753+0000","last_active":"2024-09-19T15:31:51.805753+0000","last_peered":"2024-09-19T15:31:51.805753+0000","last_clean":"2024-09-19T15:31:51.805753+0000","last_became_active":"2024-09-19T13:40:34.256236+0000","last_became_peered":"2024-09-19T13:40:34.256236+0000","last_unstale":"2024-09-19T15:31:51.805753+0000","last_undegraded":"2024-09-19T15:31:51.805753+0000","last_fullsized":"2024-09-19T15:31:51.805753+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'332","last_scrub_stamp":"2024-09-19T15:31:51.805479+0000","last_deep_scrub":"268'332","last_deep_scrub_stamp":"2024-09-19T15:31:51.805479+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.805479+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:20:24.903372+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136863,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":566,"num_read_kb":16816,"num_write":988,"num_write_kb":29952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.715706+0000","last_change":"2024-09-19T15:32:06.715494+0000","last_active":"2024-09-19T15:32:06.715706+0000","last_peered":"2024-09-19T15:32:06.715706+0000","last_clean":"2024-09-19T15:32:06.715706+0000","last_became_active":"2024-09-19T13:40:38.249269+0000","last_became_peered":"2024-09-19T13:40:38.249269+0000","last_unstale":"2024-09-19T15:32:06.715706+0000","last_undegraded":"2024-09-19T15:32:06.715706+0000","last_fullsized":"2024-09-19T15:32:06.715706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:06.715201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:06.715201+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.715201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:37.301841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'362","reported_seq":1020,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:15.151748+0000","last_change":"2024-09-19T15:32:15.151597+0000","last_active":"2024-09-19T15:32:15.151748+0000","last_peered":"2024-09-19T15:32:15.151748+0000","last_clean":"2024-09-19T15:32:15.151748+0000","last_became_active":"2024-09-19T13:40:40.229852+0000","last_became_peered":"2024-09-19T13:40:40.229852+0000","last_unstale":"2024-09-19T15:32:15.151748+0000","last_undegraded":"2024-09-19T15:32:15.151748+0000","last_fullsized":"2024-09-19T15:32:15.151748+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'362","last_scrub_stamp":"2024-09-19T15:32:15.151403+0000","last_deep_scrub":"268'362","last_deep_scrub_stamp":"2024-09-19T15:32:15.151403+0000","last_clean_scrub_stamp":"2024-09-19T15:32:15.151403+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:56:58.413638+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47808,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":586,"num_read_kb":1181,"num_write":454,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.978208+0000","last_change":"2024-09-19T15:32:05.977985+0000","last_active":"2024-09-19T15:32:05.978208+0000","last_peered":"2024-09-19T15:32:05.978208+0000","last_clean":"2024-09-19T15:32:05.978208+0000","last_became_active":"2024-09-19T13:40:42.240135+0000","last_became_peered":"2024-09-19T13:40:42.240135+0000","last_unstale":"2024-09-19T15:32:05.978208+0000","last_undegraded":"2024-09-19T15:32:05.978208+0000","last_fullsized":"2024-09-19T15:32:05.978208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:05.977797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:05.977797+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.977797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:47:40.751125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'86","reported_seq":644,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:24.602402+0000","last_change":"2024-09-19T15:32:24.602402+0000","last_active":"2024-09-19T15:32:24.602402+0000","last_peered":"2024-09-19T15:32:24.602402+0000","last_clean":"2024-09-19T15:32:24.602402+0000","last_became_active":"2024-09-19T13:40:44.269134+0000","last_became_peered":"2024-09-19T13:40:44.269134+0000","last_unstale":"2024-09-19T15:32:24.602402+0000","last_undegraded":"2024-09-19T15:32:24.602402+0000","last_fullsized":"2024-09-19T15:32:24.602402+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'86","last_scrub_stamp":"2024-09-19T15:32:24.602220+0000","last_deep_scrub":"268'86","last_deep_scrub_stamp":"2024-09-19T15:32:24.602220+0000","last_clean_scrub_stamp":"2024-09-19T15:32:24.602220+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:23:47.926200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":160,"num_write":196,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'611","reported_seq":2436,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.975880+0000","last_change":"2024-09-19T15:31:57.975666+0000","last_active":"2024-09-19T15:31:57.975880+0000","last_peered":"2024-09-19T15:31:57.975880+0000","last_clean":"2024-09-19T15:31:57.975880+0000","last_became_active":"2024-09-19T13:40:36.217925+0000","last_became_peered":"2024-09-19T13:40:36.217925+0000","last_unstale":"2024-09-19T15:31:57.975880+0000","last_undegraded":"2024-09-19T15:31:57.975880+0000","last_fullsized":"2024-09-19T15:31:57.975880+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'611","last_scrub_stamp":"2024-09-19T15:31:57.975494+0000","last_deep_scrub":"268'611","last_deep_scrub_stamp":"2024-09-19T15:31:57.975494+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.975494+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":600,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:29.200346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3256,"num_read_kb":3011,"num_write":769,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'364","reported_seq":1028,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:46.648604+0000","last_change":"2024-09-19T15:31:46.648440+0000","last_active":"2024-09-19T15:31:46.648604+0000","last_peered":"2024-09-19T15:31:46.648604+0000","last_clean":"2024-09-19T15:31:46.648604+0000","last_became_active":"2024-09-19T13:40:34.227791+0000","last_became_peered":"2024-09-19T13:40:34.227791+0000","last_unstale":"2024-09-19T15:31:46.648604+0000","last_undegraded":"2024-09-19T15:31:46.648604+0000","last_fullsized":"2024-09-19T15:31:46.648604+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'364","last_scrub_stamp":"2024-09-19T15:31:46.648241+0000","last_deep_scrub":"268'364","last_deep_scrub_stamp":"2024-09-19T15:31:46.648241+0000","last_clean_scrub_stamp":"2024-09-19T15:31:46.648241+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:28:35.850047+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":536,"num_read_kb":35857,"num_write":1057,"num_write_kb":31805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.930492+0000","last_change":"2024-09-19T15:32:00.930353+0000","last_active":"2024-09-19T15:32:00.930492+0000","last_peered":"2024-09-19T15:32:00.930492+0000","last_clean":"2024-09-19T15:32:00.930492+0000","last_became_active":"2024-09-19T13:40:38.246129+0000","last_became_peered":"2024-09-19T13:40:38.246129+0000","last_unstale":"2024-09-19T15:32:00.930492+0000","last_undegraded":"2024-09-19T15:32:00.930492+0000","last_fullsized":"2024-09-19T15:32:00.930492+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:00.930173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:00.930173+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.930173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:14:00.787540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'319","reported_seq":950,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:12.666475+0000","last_change":"2024-09-19T15:32:12.666334+0000","last_active":"2024-09-19T15:32:12.666475+0000","last_peered":"2024-09-19T15:32:12.666475+0000","last_clean":"2024-09-19T15:32:12.666475+0000","last_became_active":"2024-09-19T13:40:40.218434+0000","last_became_peered":"2024-09-19T13:40:40.218434+0000","last_unstale":"2024-09-19T15:32:12.666475+0000","last_undegraded":"2024-09-19T15:32:12.666475+0000","last_fullsized":"2024-09-19T15:32:12.666475+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'319","last_scrub_stamp":"2024-09-19T15:32:12.666134+0000","last_deep_scrub":"268'319","last_deep_scrub_stamp":"2024-09-19T15:32:12.666134+0000","last_clean_scrub_stamp":"2024-09-19T15:32:12.666134+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:09:43.541168+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44825,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":1129,"num_write":414,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:14.568073+0000","last_change":"2024-09-19T15:32:14.567886+0000","last_active":"2024-09-19T15:32:14.568073+0000","last_peered":"2024-09-19T15:32:14.568073+0000","last_clean":"2024-09-19T15:32:14.568073+0000","last_became_active":"2024-09-19T13:40:42.238908+0000","last_became_peered":"2024-09-19T13:40:42.238908+0000","last_unstale":"2024-09-19T15:32:14.568073+0000","last_undegraded":"2024-09-19T15:32:14.568073+0000","last_fullsized":"2024-09-19T15:32:14.568073+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:14.567692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:14.567692+0000","last_clean_scrub_stamp":"2024-09-19T15:32:14.567692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:33.260592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'524","reported_seq":2148,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.913104+0000","last_change":"2024-09-19T15:31:56.913104+0000","last_active":"2024-09-19T15:31:56.913104+0000","last_peered":"2024-09-19T15:31:56.913104+0000","last_clean":"2024-09-19T15:31:56.913104+0000","last_became_active":"2024-09-19T13:40:36.243653+0000","last_became_peered":"2024-09-19T13:40:36.243653+0000","last_unstale":"2024-09-19T15:31:56.913104+0000","last_undegraded":"2024-09-19T15:31:56.913104+0000","last_fullsized":"2024-09-19T15:31:56.913104+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'524","last_scrub_stamp":"2024-09-19T15:31:56.912913+0000","last_deep_scrub":"268'524","last_deep_scrub_stamp":"2024-09-19T15:31:56.912913+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.912913+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:58.666306+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2759,"num_read_kb":2556,"num_write":676,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'358","reported_seq":1009,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.920601+0000","last_change":"2024-09-19T15:31:52.920601+0000","last_active":"2024-09-19T15:31:52.920601+0000","last_peered":"2024-09-19T15:31:52.920601+0000","last_clean":"2024-09-19T15:31:52.920601+0000","last_became_active":"2024-09-19T13:40:34.219131+0000","last_became_peered":"2024-09-19T13:40:34.219131+0000","last_unstale":"2024-09-19T15:31:52.920601+0000","last_undegraded":"2024-09-19T15:31:52.920601+0000","last_fullsized":"2024-09-19T15:31:52.920601+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'358","last_scrub_stamp":"2024-09-19T15:31:52.920370+0000","last_deep_scrub":"268'358","last_deep_scrub_stamp":"2024-09-19T15:31:52.920370+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.920370+0000","objects_scrubbed":6,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:04.736453+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273703,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":16977,"num_write":1175,"num_write_kb":67471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.685857+0000","last_change":"2024-09-19T15:32:04.685857+0000","last_active":"2024-09-19T15:32:04.685857+0000","last_peered":"2024-09-19T15:32:04.685857+0000","last_clean":"2024-09-19T15:32:04.685857+0000","last_became_active":"2024-09-19T13:40:38.231992+0000","last_became_peered":"2024-09-19T13:40:38.231992+0000","last_unstale":"2024-09-19T15:32:04.685857+0000","last_undegraded":"2024-09-19T15:32:04.685857+0000","last_fullsized":"2024-09-19T15:32:04.685857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:04.685669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:04.685669+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.685669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:07:07.380312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'568","reported_seq":1247,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.642848+0000","last_change":"2024-09-19T15:32:06.642848+0000","last_active":"2024-09-19T15:32:06.642848+0000","last_peered":"2024-09-19T15:32:06.642848+0000","last_clean":"2024-09-19T15:32:06.642848+0000","last_became_active":"2024-09-19T13:40:40.241045+0000","last_became_peered":"2024-09-19T13:40:40.241045+0000","last_unstale":"2024-09-19T15:32:06.642848+0000","last_undegraded":"2024-09-19T15:32:06.642848+0000","last_fullsized":"2024-09-19T15:32:06.642848+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'568","last_scrub_stamp":"2024-09-19T15:32:06.642662+0000","last_deep_scrub":"268'568","last_deep_scrub_stamp":"2024-09-19T15:32:06.642662+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.642662+0000","objects_scrubbed":7,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:33.019641+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102495,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":998,"num_read_kb":2312,"num_write":864,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:18.654557+0000","last_change":"2024-09-19T15:32:18.654557+0000","last_active":"2024-09-19T15:32:18.654557+0000","last_peered":"2024-09-19T15:32:18.654557+0000","last_clean":"2024-09-19T15:32:18.654557+0000","last_became_active":"2024-09-19T13:40:42.266161+0000","last_became_peered":"2024-09-19T13:40:42.266161+0000","last_unstale":"2024-09-19T15:32:18.654557+0000","last_undegraded":"2024-09-19T15:32:18.654557+0000","last_fullsized":"2024-09-19T15:32:18.654557+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:18.654355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:18.654355+0000","last_clean_scrub_stamp":"2024-09-19T15:32:18.654355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:49:19.531268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'155","reported_seq":695,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:27.116308+0000","last_change":"2024-09-19T15:32:27.116171+0000","last_active":"2024-09-19T15:32:27.116308+0000","last_peered":"2024-09-19T15:32:27.116308+0000","last_clean":"2024-09-19T15:32:27.116308+0000","last_became_active":"2024-09-19T13:40:44.280362+0000","last_became_peered":"2024-09-19T13:40:44.280362+0000","last_unstale":"2024-09-19T15:32:27.116308+0000","last_undegraded":"2024-09-19T15:32:27.116308+0000","last_fullsized":"2024-09-19T15:32:27.116308+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'155","last_scrub_stamp":"2024-09-19T15:32:27.115991+0000","last_deep_scrub":"268'155","last_deep_scrub_stamp":"2024-09-19T15:32:27.115991+0000","last_clean_scrub_stamp":"2024-09-19T15:32:27.115991+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:42:49.154644+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":216,"num_read_kb":226,"num_write":329,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'909","reported_seq":2615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.735293+0000","last_change":"2024-09-19T15:31:57.735293+0000","last_active":"2024-09-19T15:31:57.735293+0000","last_peered":"2024-09-19T15:31:57.735293+0000","last_clean":"2024-09-19T15:31:57.735293+0000","last_became_active":"2024-09-19T13:40:36.234428+0000","last_became_peered":"2024-09-19T13:40:36.234428+0000","last_unstale":"2024-09-19T15:31:57.735293+0000","last_undegraded":"2024-09-19T15:31:57.735293+0000","last_fullsized":"2024-09-19T15:31:57.735293+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'909","last_scrub_stamp":"2024-09-19T15:31:57.735111+0000","last_deep_scrub":"268'909","last_deep_scrub_stamp":"2024-09-19T15:31:57.735111+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.735111+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":800,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:43:16.615480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4426,"num_read_kb":3975,"num_write":1248,"num_write_kb":508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'387","reported_seq":1106,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.658635+0000","last_change":"2024-09-19T15:31:49.658391+0000","last_active":"2024-09-19T15:31:49.658635+0000","last_peered":"2024-09-19T15:31:49.658635+0000","last_clean":"2024-09-19T15:31:49.658635+0000","last_became_active":"2024-09-19T13:40:34.249719+0000","last_became_peered":"2024-09-19T13:40:34.249719+0000","last_unstale":"2024-09-19T15:31:49.658635+0000","last_undegraded":"2024-09-19T15:31:49.658635+0000","last_fullsized":"2024-09-19T15:31:49.658635+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'387","last_scrub_stamp":"2024-09-19T15:31:49.658119+0000","last_deep_scrub":"268'387","last_deep_scrub_stamp":"2024-09-19T15:31:49.658119+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.658119+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:45.295555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2165812,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":691,"num_read_kb":108324,"num_write":1302,"num_write_kb":34137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"268'4","reported_seq":1009,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.964764+0000","last_change":"2024-09-19T15:32:01.964764+0000","last_active":"2024-09-19T15:32:01.964764+0000","last_peered":"2024-09-19T15:32:01.964764+0000","last_clean":"2024-09-19T15:32:01.964764+0000","last_became_active":"2024-09-19T13:40:38.245835+0000","last_became_peered":"2024-09-19T13:40:38.245835+0000","last_unstale":"2024-09-19T15:32:01.964764+0000","last_undegraded":"2024-09-19T15:32:01.964764+0000","last_fullsized":"2024-09-19T15:32:01.964764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-19T15:32:01.964584+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-19T15:32:01.964584+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.964584+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:59:35.197432+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":719,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'395","reported_seq":1058,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:13.694480+0000","last_change":"2024-09-19T15:32:13.694480+0000","last_active":"2024-09-19T15:32:13.694480+0000","last_peered":"2024-09-19T15:32:13.694480+0000","last_clean":"2024-09-19T15:32:13.694480+0000","last_became_active":"2024-09-19T13:40:40.237537+0000","last_became_peered":"2024-09-19T13:40:40.237537+0000","last_unstale":"2024-09-19T15:32:13.694480+0000","last_undegraded":"2024-09-19T15:32:13.694480+0000","last_fullsized":"2024-09-19T15:32:13.694480+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'395","last_scrub_stamp":"2024-09-19T15:32:13.694279+0000","last_deep_scrub":"268'395","last_deep_scrub_stamp":"2024-09-19T15:32:13.694279+0000","last_clean_scrub_stamp":"2024-09-19T15:32:13.694279+0000","objects_scrubbed":8,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:26.735974+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49094,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":653,"num_read_kb":1263,"num_write":536,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:10.670226+0000","last_change":"2024-09-19T15:32:10.670226+0000","last_active":"2024-09-19T15:32:10.670226+0000","last_peered":"2024-09-19T15:32:10.670226+0000","last_clean":"2024-09-19T15:32:10.670226+0000","last_became_active":"2024-09-19T13:40:42.251896+0000","last_became_peered":"2024-09-19T13:40:42.251896+0000","last_unstale":"2024-09-19T15:32:10.670226+0000","last_undegraded":"2024-09-19T15:32:10.670226+0000","last_fullsized":"2024-09-19T15:32:10.670226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:10.670041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:10.670041+0000","last_clean_scrub_stamp":"2024-09-19T15:32:10.670041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:53.016060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'206","reported_seq":1101,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:11.064271+0000","last_change":"2024-09-19T15:32:11.064051+0000","last_active":"2024-09-19T15:32:11.064271+0000","last_peered":"2024-09-19T15:32:11.064271+0000","last_clean":"2024-09-19T15:32:11.064271+0000","last_became_active":"2024-09-19T13:40:44.268710+0000","last_became_peered":"2024-09-19T13:40:44.268710+0000","last_unstale":"2024-09-19T15:32:11.064271+0000","last_undegraded":"2024-09-19T15:32:11.064271+0000","last_fullsized":"2024-09-19T15:32:11.064271+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'206","last_scrub_stamp":"2024-09-19T15:32:11.063850+0000","last_deep_scrub":"268'206","last_deep_scrub_stamp":"2024-09-19T15:32:11.063850+0000","last_clean_scrub_stamp":"2024-09-19T15:32:11.063850+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:41.173552+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":655,"num_read_kb":652,"num_write":565,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'581","reported_seq":2271,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.008735+0000","last_change":"2024-09-19T15:32:05.008735+0000","last_active":"2024-09-19T15:32:05.008735+0000","last_peered":"2024-09-19T15:32:05.008735+0000","last_clean":"2024-09-19T15:32:05.008735+0000","last_became_active":"2024-09-19T13:40:36.217961+0000","last_became_peered":"2024-09-19T13:40:36.217961+0000","last_unstale":"2024-09-19T15:32:05.008735+0000","last_undegraded":"2024-09-19T15:32:05.008735+0000","last_fullsized":"2024-09-19T15:32:05.008735+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'581","last_scrub_stamp":"2024-09-19T15:32:05.008452+0000","last_deep_scrub":"268'581","last_deep_scrub_stamp":"2024-09-19T15:32:05.008452+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.008452+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:51.104635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2994,"num_read_kb":2751,"num_write":739,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'361","reported_seq":1167,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.549717+0000","last_change":"2024-09-19T15:31:47.549717+0000","last_active":"2024-09-19T15:31:47.549717+0000","last_peered":"2024-09-19T15:31:47.549717+0000","last_clean":"2024-09-19T15:31:47.549717+0000","last_became_active":"2024-09-19T13:40:34.253708+0000","last_became_peered":"2024-09-19T13:40:34.253708+0000","last_unstale":"2024-09-19T15:31:47.549717+0000","last_undegraded":"2024-09-19T15:31:47.549717+0000","last_fullsized":"2024-09-19T15:31:47.549717+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'361","last_scrub_stamp":"2024-09-19T15:31:47.549493+0000","last_deep_scrub":"268'361","last_deep_scrub_stamp":"2024-09-19T15:31:47.549493+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.549493+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:11:12.191338+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":758,"num_read_kb":54804,"num_write":1089,"num_write_kb":28785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:10.582279+0000","last_change":"2024-09-19T15:32:10.582279+0000","last_active":"2024-09-19T15:32:10.582279+0000","last_peered":"2024-09-19T15:32:10.582279+0000","last_clean":"2024-09-19T15:32:10.582279+0000","last_became_active":"2024-09-19T13:40:38.245018+0000","last_became_peered":"2024-09-19T13:40:38.245018+0000","last_unstale":"2024-09-19T15:32:10.582279+0000","last_undegraded":"2024-09-19T15:32:10.582279+0000","last_fullsized":"2024-09-19T15:32:10.582279+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:10.582106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:10.582106+0000","last_clean_scrub_stamp":"2024-09-19T15:32:10.582106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:06.488949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'355","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:17.157824+0000","last_change":"2024-09-19T15:32:17.157824+0000","last_active":"2024-09-19T15:32:17.157824+0000","last_peered":"2024-09-19T15:32:17.157824+0000","last_clean":"2024-09-19T15:32:17.157824+0000","last_became_active":"2024-09-19T13:40:40.229201+0000","last_became_peered":"2024-09-19T13:40:40.229201+0000","last_unstale":"2024-09-19T15:32:17.157824+0000","last_undegraded":"2024-09-19T15:32:17.157824+0000","last_fullsized":"2024-09-19T15:32:17.157824+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'355","last_scrub_stamp":"2024-09-19T15:32:17.157622+0000","last_deep_scrub":"268'355","last_deep_scrub_stamp":"2024-09-19T15:32:17.157622+0000","last_clean_scrub_stamp":"2024-09-19T15:32:17.157622+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:08:17.221388+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43041,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":567,"num_read_kb":1167,"num_write":454,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:09.644092+0000","last_change":"2024-09-19T15:32:09.644092+0000","last_active":"2024-09-19T15:32:09.644092+0000","last_peered":"2024-09-19T15:32:09.644092+0000","last_clean":"2024-09-19T15:32:09.644092+0000","last_became_active":"2024-09-19T13:40:42.246286+0000","last_became_peered":"2024-09-19T13:40:42.246286+0000","last_unstale":"2024-09-19T15:32:09.644092+0000","last_undegraded":"2024-09-19T15:32:09.644092+0000","last_fullsized":"2024-09-19T15:32:09.644092+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:09.643912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:09.643912+0000","last_clean_scrub_stamp":"2024-09-19T15:32:09.643912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:20.999995+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'165","reported_seq":738,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:22.614052+0000","last_change":"2024-09-19T15:32:22.613917+0000","last_active":"2024-09-19T15:32:22.614052+0000","last_peered":"2024-09-19T15:32:22.614052+0000","last_clean":"2024-09-19T15:32:22.614052+0000","last_became_active":"2024-09-19T13:40:44.267428+0000","last_became_peered":"2024-09-19T13:40:44.267428+0000","last_unstale":"2024-09-19T15:32:22.614052+0000","last_undegraded":"2024-09-19T15:32:22.614052+0000","last_fullsized":"2024-09-19T15:32:22.614052+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'165","last_scrub_stamp":"2024-09-19T15:32:22.613708+0000","last_deep_scrub":"268'165","last_deep_scrub_stamp":"2024-09-19T15:32:22.613708+0000","last_clean_scrub_stamp":"2024-09-19T15:32:22.613708+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:12:11.772585+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":325,"num_read_kb":284,"num_write":406,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'374","reported_seq":2107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.834458+0000","last_change":"2024-09-19T15:31:51.834458+0000","last_active":"2024-09-19T15:31:51.834458+0000","last_peered":"2024-09-19T15:31:51.834458+0000","last_clean":"2024-09-19T15:31:51.834458+0000","last_became_active":"2024-09-19T13:40:36.230842+0000","last_became_peered":"2024-09-19T13:40:36.230842+0000","last_unstale":"2024-09-19T15:31:51.834458+0000","last_undegraded":"2024-09-19T15:31:51.834458+0000","last_fullsized":"2024-09-19T15:31:51.834458+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'374","last_scrub_stamp":"2024-09-19T15:31:51.834239+0000","last_deep_scrub":"268'374","last_deep_scrub_stamp":"2024-09-19T15:31:51.834239+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.834239+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:37.484036+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2340,"num_read_kb":2286,"num_write":408,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'380","reported_seq":1170,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.696898+0000","last_change":"2024-09-19T15:31:49.696898+0000","last_active":"2024-09-19T15:31:49.696898+0000","last_peered":"2024-09-19T15:31:49.696898+0000","last_clean":"2024-09-19T15:31:49.696898+0000","last_became_active":"2024-09-19T13:41:05.307368+0000","last_became_peered":"2024-09-19T13:41:05.307368+0000","last_unstale":"2024-09-19T15:31:49.696898+0000","last_undegraded":"2024-09-19T15:31:49.696898+0000","last_fullsized":"2024-09-19T15:31:49.696898+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'380","last_scrub_stamp":"2024-09-19T15:31:49.696677+0000","last_deep_scrub":"268'380","last_deep_scrub_stamp":"2024-09-19T15:31:49.696677+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.696677+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:46.518267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":987,"num_read_kb":73584,"num_write":1229,"num_write_kb":59214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.597487+0000","last_change":"2024-09-19T15:32:03.597487+0000","last_active":"2024-09-19T15:32:03.597487+0000","last_peered":"2024-09-19T15:32:03.597487+0000","last_clean":"2024-09-19T15:32:03.597487+0000","last_became_active":"2024-09-19T13:40:38.245287+0000","last_became_peered":"2024-09-19T13:40:38.245287+0000","last_unstale":"2024-09-19T15:32:03.597487+0000","last_undegraded":"2024-09-19T15:32:03.597487+0000","last_fullsized":"2024-09-19T15:32:03.597487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:03.597281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:03.597281+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.597281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:23.720458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'179","reported_seq":773,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:14.584713+0000","last_change":"2024-09-19T15:32:14.584713+0000","last_active":"2024-09-19T15:32:14.584713+0000","last_peered":"2024-09-19T15:32:14.584713+0000","last_clean":"2024-09-19T15:32:14.584713+0000","last_became_active":"2024-09-19T13:40:40.246680+0000","last_became_peered":"2024-09-19T13:40:40.246680+0000","last_unstale":"2024-09-19T15:32:14.584713+0000","last_undegraded":"2024-09-19T15:32:14.584713+0000","last_fullsized":"2024-09-19T15:32:14.584713+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'179","last_scrub_stamp":"2024-09-19T15:32:14.584522+0000","last_deep_scrub":"268'179","last_deep_scrub_stamp":"2024-09-19T15:32:14.584522+0000","last_clean_scrub_stamp":"2024-09-19T15:32:14.584522+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:30:59.612795+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":223,"num_read_kb":217,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'765","reported_seq":2981,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.935783+0000","last_change":"2024-09-19T15:32:07.935783+0000","last_active":"2024-09-19T15:32:07.935783+0000","last_peered":"2024-09-19T15:32:07.935783+0000","last_clean":"2024-09-19T15:32:07.935783+0000","last_became_active":"2024-09-19T13:40:42.250436+0000","last_became_peered":"2024-09-19T13:40:42.250436+0000","last_unstale":"2024-09-19T15:32:07.935783+0000","last_undegraded":"2024-09-19T15:32:07.935783+0000","last_fullsized":"2024-09-19T15:32:07.935783+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'765","last_scrub_stamp":"2024-09-19T15:32:07.935587+0000","last_deep_scrub":"268'765","last_deep_scrub_stamp":"2024-09-19T15:32:07.935587+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.935587+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:37.846498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'102","reported_seq":647,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:19.687388+0000","last_change":"2024-09-19T15:32:19.687128+0000","last_active":"2024-09-19T15:32:19.687388+0000","last_peered":"2024-09-19T15:32:19.687388+0000","last_clean":"2024-09-19T15:32:19.687388+0000","last_became_active":"2024-09-19T13:40:44.268630+0000","last_became_peered":"2024-09-19T13:40:44.268630+0000","last_unstale":"2024-09-19T15:32:19.687388+0000","last_undegraded":"2024-09-19T15:32:19.687388+0000","last_fullsized":"2024-09-19T15:32:19.687388+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'102","last_scrub_stamp":"2024-09-19T15:32:19.686909+0000","last_deep_scrub":"268'102","last_deep_scrub_stamp":"2024-09-19T15:32:19.686909+0000","last_clean_scrub_stamp":"2024-09-19T15:32:19.686909+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:34.595882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":162,"num_read_kb":149,"num_write":244,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'1165","reported_seq":2741,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.534176+0000","last_change":"2024-09-19T15:31:58.534176+0000","last_active":"2024-09-19T15:31:58.534176+0000","last_peered":"2024-09-19T15:31:58.534176+0000","last_clean":"2024-09-19T15:31:58.534176+0000","last_became_active":"2024-09-19T13:41:05.320040+0000","last_became_peered":"2024-09-19T13:41:05.320040+0000","last_unstale":"2024-09-19T15:31:58.534176+0000","last_undegraded":"2024-09-19T15:31:58.534176+0000","last_fullsized":"2024-09-19T15:31:58.534176+0000","mapping_epoch":38,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1165","last_scrub_stamp":"2024-09-19T15:31:58.533998+0000","last_deep_scrub":"268'1165","last_deep_scrub_stamp":"2024-09-19T15:31:58.533998+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.533998+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":1100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:51.390548+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5194,"num_read_kb":4574,"num_write":1598,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'367","reported_seq":1037,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.813433+0000","last_change":"2024-09-19T15:31:52.813433+0000","last_active":"2024-09-19T15:31:52.813433+0000","last_peered":"2024-09-19T15:31:52.813433+0000","last_clean":"2024-09-19T15:31:52.813433+0000","last_became_active":"2024-09-19T13:40:34.251475+0000","last_became_peered":"2024-09-19T13:40:34.251475+0000","last_unstale":"2024-09-19T15:31:52.813433+0000","last_undegraded":"2024-09-19T15:31:52.813433+0000","last_fullsized":"2024-09-19T15:31:52.813433+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'367","last_scrub_stamp":"2024-09-19T15:31:52.813085+0000","last_deep_scrub":"268'367","last_deep_scrub_stamp":"2024-09-19T15:31:52.813085+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.813085+0000","objects_scrubbed":3,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:50.638803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":623,"num_read_kb":3575,"num_write":1141,"num_write_kb":19359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.633155+0000","last_change":"2024-09-19T15:32:08.633155+0000","last_active":"2024-09-19T15:32:08.633155+0000","last_peered":"2024-09-19T15:32:08.633155+0000","last_clean":"2024-09-19T15:32:08.633155+0000","last_became_active":"2024-09-19T13:40:38.246205+0000","last_became_peered":"2024-09-19T13:40:38.246205+0000","last_unstale":"2024-09-19T15:32:08.633155+0000","last_undegraded":"2024-09-19T15:32:08.633155+0000","last_fullsized":"2024-09-19T15:32:08.633155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:08.632970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:08.632970+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.632970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:46.231112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'391","reported_seq":1061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:16.627040+0000","last_change":"2024-09-19T15:32:16.626907+0000","last_active":"2024-09-19T15:32:16.627040+0000","last_peered":"2024-09-19T15:32:16.627040+0000","last_clean":"2024-09-19T15:32:16.627040+0000","last_became_active":"2024-09-19T13:40:40.241730+0000","last_became_peered":"2024-09-19T13:40:40.241730+0000","last_unstale":"2024-09-19T15:32:16.627040+0000","last_undegraded":"2024-09-19T15:32:16.627040+0000","last_fullsized":"2024-09-19T15:32:16.627040+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'391","last_scrub_stamp":"2024-09-19T15:32:16.626717+0000","last_deep_scrub":"268'391","last_deep_scrub_stamp":"2024-09-19T15:32:16.626717+0000","last_clean_scrub_stamp":"2024-09-19T15:32:16.626717+0000","objects_scrubbed":8,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:16.732410+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69547,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":608,"num_read_kb":1209,"num_write":470,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:15.608498+0000","last_change":"2024-09-19T15:32:15.608498+0000","last_active":"2024-09-19T15:32:15.608498+0000","last_peered":"2024-09-19T15:32:15.608498+0000","last_clean":"2024-09-19T15:32:15.608498+0000","last_became_active":"2024-09-19T13:40:42.240191+0000","last_became_peered":"2024-09-19T13:40:42.240191+0000","last_unstale":"2024-09-19T15:32:15.608498+0000","last_undegraded":"2024-09-19T15:32:15.608498+0000","last_fullsized":"2024-09-19T15:32:15.608498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:15.608302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:15.608302+0000","last_clean_scrub_stamp":"2024-09-19T15:32:15.608302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:59.856035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'130","reported_seq":663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:21.614445+0000","last_change":"2024-09-19T15:32:21.614445+0000","last_active":"2024-09-19T15:32:21.614445+0000","last_peered":"2024-09-19T15:32:21.614445+0000","last_clean":"2024-09-19T15:32:21.614445+0000","last_became_active":"2024-09-19T13:40:44.274449+0000","last_became_peered":"2024-09-19T13:40:44.274449+0000","last_unstale":"2024-09-19T15:32:21.614445+0000","last_undegraded":"2024-09-19T15:32:21.614445+0000","last_fullsized":"2024-09-19T15:32:21.614445+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'130","last_scrub_stamp":"2024-09-19T15:32:21.614259+0000","last_deep_scrub":"268'130","last_deep_scrub_stamp":"2024-09-19T15:32:21.614259+0000","last_clean_scrub_stamp":"2024-09-19T15:32:21.614259+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:17:58.072102+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":153,"num_write":303,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'798","reported_seq":2353,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.488362+0000","last_change":"2024-09-19T15:31:57.488362+0000","last_active":"2024-09-19T15:31:57.488362+0000","last_peered":"2024-09-19T15:31:57.488362+0000","last_clean":"2024-09-19T15:31:57.488362+0000","last_became_active":"2024-09-19T13:40:36.227359+0000","last_became_peered":"2024-09-19T13:40:36.227359+0000","last_unstale":"2024-09-19T15:31:57.488362+0000","last_undegraded":"2024-09-19T15:31:57.488362+0000","last_fullsized":"2024-09-19T15:31:57.488362+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'798","last_scrub_stamp":"2024-09-19T15:31:57.488181+0000","last_deep_scrub":"268'798","last_deep_scrub_stamp":"2024-09-19T15:31:57.488181+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.488181+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:25.410101+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3854,"num_read_kb":3454,"num_write":1058,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":689,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'425","reported_seq":1190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.803379+0000","last_change":"2024-09-19T15:31:53.803379+0000","last_active":"2024-09-19T15:31:53.803379+0000","last_peered":"2024-09-19T15:31:53.803379+0000","last_clean":"2024-09-19T15:31:53.803379+0000","last_became_active":"2024-09-19T13:41:05.313209+0000","last_became_peered":"2024-09-19T13:41:05.313209+0000","last_unstale":"2024-09-19T15:31:53.803379+0000","last_undegraded":"2024-09-19T15:31:53.803379+0000","last_fullsized":"2024-09-19T15:31:53.803379+0000","mapping_epoch":38,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'425","last_scrub_stamp":"2024-09-19T15:31:53.803129+0000","last_deep_scrub":"268'425","last_deep_scrub_stamp":"2024-09-19T15:31:53.803129+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.803129+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:11:25.265777+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136845,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":777,"num_read_kb":102227,"num_write":1424,"num_write_kb":49987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:12.705223+0000","last_change":"2024-09-19T15:32:12.705223+0000","last_active":"2024-09-19T15:32:12.705223+0000","last_peered":"2024-09-19T15:32:12.705223+0000","last_clean":"2024-09-19T15:32:12.705223+0000","last_became_active":"2024-09-19T13:40:38.229929+0000","last_became_peered":"2024-09-19T13:40:38.229929+0000","last_unstale":"2024-09-19T15:32:12.705223+0000","last_undegraded":"2024-09-19T15:32:12.705223+0000","last_fullsized":"2024-09-19T15:32:12.705223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:12.704925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:12.704925+0000","last_clean_scrub_stamp":"2024-09-19T15:32:12.704925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:09:57.542107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'306","reported_seq":926,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:10.641013+0000","last_change":"2024-09-19T15:32:10.641013+0000","last_active":"2024-09-19T15:32:10.641013+0000","last_peered":"2024-09-19T15:32:10.641013+0000","last_clean":"2024-09-19T15:32:10.641013+0000","last_became_active":"2024-09-19T13:40:40.241404+0000","last_became_peered":"2024-09-19T13:40:40.241404+0000","last_unstale":"2024-09-19T15:32:10.641013+0000","last_undegraded":"2024-09-19T15:32:10.641013+0000","last_fullsized":"2024-09-19T15:32:10.641013+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'306","last_scrub_stamp":"2024-09-19T15:32:10.640809+0000","last_deep_scrub":"268'306","last_deep_scrub_stamp":"2024-09-19T15:32:10.640809+0000","last_clean_scrub_stamp":"2024-09-19T15:32:10.640809+0000","objects_scrubbed":4,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:35.973568+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45708,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":1069,"num_write":394,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.952575+0000","last_change":"2024-09-19T15:32:06.952418+0000","last_active":"2024-09-19T15:32:06.952575+0000","last_peered":"2024-09-19T15:32:06.952575+0000","last_clean":"2024-09-19T15:32:06.952575+0000","last_became_active":"2024-09-19T13:40:42.251413+0000","last_became_peered":"2024-09-19T13:40:42.251413+0000","last_unstale":"2024-09-19T15:32:06.952575+0000","last_undegraded":"2024-09-19T15:32:06.952575+0000","last_fullsized":"2024-09-19T15:32:06.952575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:06.952230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:06.952230+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.952230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:46:16.041934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'164","reported_seq":728,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:26.080657+0000","last_change":"2024-09-19T15:32:26.080657+0000","last_active":"2024-09-19T15:32:26.080657+0000","last_peered":"2024-09-19T15:32:26.080657+0000","last_clean":"2024-09-19T15:32:26.080657+0000","last_became_active":"2024-09-19T13:40:44.277774+0000","last_became_peered":"2024-09-19T13:40:44.277774+0000","last_unstale":"2024-09-19T15:32:26.080657+0000","last_undegraded":"2024-09-19T15:32:26.080657+0000","last_fullsized":"2024-09-19T15:32:26.080657+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'164","last_scrub_stamp":"2024-09-19T15:32:26.080469+0000","last_deep_scrub":"268'164","last_deep_scrub_stamp":"2024-09-19T15:32:26.080469+0000","last_clean_scrub_stamp":"2024-09-19T15:32:26.080469+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:38.054276+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":980,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216,"num_read_kb":207,"num_write":371,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'468","reported_seq":2247,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.010835+0000","last_change":"2024-09-19T15:32:02.010694+0000","last_active":"2024-09-19T15:32:02.010835+0000","last_peered":"2024-09-19T15:32:02.010835+0000","last_clean":"2024-09-19T15:32:02.010835+0000","last_became_active":"2024-09-19T13:40:36.222632+0000","last_became_peered":"2024-09-19T13:40:36.222632+0000","last_unstale":"2024-09-19T15:32:02.010835+0000","last_undegraded":"2024-09-19T15:32:02.010835+0000","last_fullsized":"2024-09-19T15:32:02.010835+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'468","last_scrub_stamp":"2024-09-19T15:32:02.010501+0000","last_deep_scrub":"268'468","last_deep_scrub_stamp":"2024-09-19T15:32:02.010501+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.010501+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:51:35.207348+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2809,"num_read_kb":2663,"num_write":534,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3595,"num_omap_keys":15,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'381","reported_seq":1091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.916447+0000","last_change":"2024-09-19T15:31:49.916447+0000","last_active":"2024-09-19T15:31:49.916447+0000","last_peered":"2024-09-19T15:31:49.916447+0000","last_clean":"2024-09-19T15:31:49.916447+0000","last_became_active":"2024-09-19T13:40:34.258068+0000","last_became_peered":"2024-09-19T13:40:34.258068+0000","last_unstale":"2024-09-19T15:31:49.916447+0000","last_undegraded":"2024-09-19T15:31:49.916447+0000","last_fullsized":"2024-09-19T15:31:49.916447+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'381","last_scrub_stamp":"2024-09-19T15:31:49.916243+0000","last_deep_scrub":"268'381","last_deep_scrub_stamp":"2024-09-19T15:31:49.916243+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.916243+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:51:34.097674+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":750,"num_read_kb":11976,"num_write":1179,"num_write_kb":32337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.568678+0000","last_change":"2024-09-19T15:32:08.568678+0000","last_active":"2024-09-19T15:32:08.568678+0000","last_peered":"2024-09-19T15:32:08.568678+0000","last_clean":"2024-09-19T15:32:08.568678+0000","last_became_active":"2024-09-19T13:40:38.236724+0000","last_became_peered":"2024-09-19T13:40:38.236724+0000","last_unstale":"2024-09-19T15:32:08.568678+0000","last_undegraded":"2024-09-19T15:32:08.568678+0000","last_fullsized":"2024-09-19T15:32:08.568678+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:08.568485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:08.568485+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.568485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:28.356524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'279","reported_seq":881,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:16.193007+0000","last_change":"2024-09-19T15:32:16.193007+0000","last_active":"2024-09-19T15:32:16.193007+0000","last_peered":"2024-09-19T15:32:16.193007+0000","last_clean":"2024-09-19T15:32:16.193007+0000","last_became_active":"2024-09-19T13:40:40.222807+0000","last_became_peered":"2024-09-19T13:40:40.222807+0000","last_unstale":"2024-09-19T15:32:16.193007+0000","last_undegraded":"2024-09-19T15:32:16.193007+0000","last_fullsized":"2024-09-19T15:32:16.193007+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'279","last_scrub_stamp":"2024-09-19T15:32:16.192819+0000","last_deep_scrub":"268'279","last_deep_scrub_stamp":"2024-09-19T15:32:16.192819+0000","last_clean_scrub_stamp":"2024-09-19T15:32:16.192819+0000","objects_scrubbed":3,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:55:09.211321+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47535,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":1137,"num_write":394,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:22.489802+0000","last_change":"2024-09-19T15:32:22.489802+0000","last_active":"2024-09-19T15:32:22.489802+0000","last_peered":"2024-09-19T15:32:22.489802+0000","last_clean":"2024-09-19T15:32:22.489802+0000","last_became_active":"2024-09-19T13:40:42.251057+0000","last_became_peered":"2024-09-19T13:40:42.251057+0000","last_unstale":"2024-09-19T15:32:22.489802+0000","last_undegraded":"2024-09-19T15:32:22.489802+0000","last_fullsized":"2024-09-19T15:32:22.489802+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:22.489612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:22.489612+0000","last_clean_scrub_stamp":"2024-09-19T15:32:22.489612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:52.279574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'147","reported_seq":1287,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:20.654690+0000","last_change":"2024-09-19T15:32:20.654690+0000","last_active":"2024-09-19T15:32:20.654690+0000","last_peered":"2024-09-19T15:32:20.654690+0000","last_clean":"2024-09-19T15:32:20.654690+0000","last_became_active":"2024-09-19T13:40:44.270656+0000","last_became_peered":"2024-09-19T13:40:44.270656+0000","last_unstale":"2024-09-19T15:32:20.654690+0000","last_undegraded":"2024-09-19T15:32:20.654690+0000","last_fullsized":"2024-09-19T15:32:20.654690+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'147","last_scrub_stamp":"2024-09-19T15:32:20.654476+0000","last_deep_scrub":"268'147","last_deep_scrub_stamp":"2024-09-19T15:32:20.654476+0000","last_clean_scrub_stamp":"2024-09-19T15:32:20.654476+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:26.821573+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":816,"num_read_kb":810,"num_write":350,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'465","reported_seq":2003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.548394+0000","last_change":"2024-09-19T15:31:55.548394+0000","last_active":"2024-09-19T15:31:55.548394+0000","last_peered":"2024-09-19T15:31:55.548394+0000","last_clean":"2024-09-19T15:31:55.548394+0000","last_became_active":"2024-09-19T13:40:36.217230+0000","last_became_peered":"2024-09-19T13:40:36.217230+0000","last_unstale":"2024-09-19T15:31:55.548394+0000","last_undegraded":"2024-09-19T15:31:55.548394+0000","last_fullsized":"2024-09-19T15:31:55.548394+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'465","last_scrub_stamp":"2024-09-19T15:31:55.548152+0000","last_deep_scrub":"268'465","last_deep_scrub_stamp":"2024-09-19T15:31:55.548152+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.548152+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:04.184032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2437,"num_read_kb":2267,"num_write":569,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'335","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.661888+0000","last_change":"2024-09-19T15:31:47.661888+0000","last_active":"2024-09-19T15:31:47.661888+0000","last_peered":"2024-09-19T15:31:47.661888+0000","last_clean":"2024-09-19T15:31:47.661888+0000","last_became_active":"2024-09-19T13:40:34.258416+0000","last_became_peered":"2024-09-19T13:40:34.258416+0000","last_unstale":"2024-09-19T15:31:47.661888+0000","last_undegraded":"2024-09-19T15:31:47.661888+0000","last_fullsized":"2024-09-19T15:31:47.661888+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'335","last_scrub_stamp":"2024-09-19T15:31:47.661793+0000","last_deep_scrub":"268'335","last_deep_scrub_stamp":"2024-09-19T15:31:47.661793+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.661793+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:16.145468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":559,"num_read_kb":6695,"num_write":1052,"num_write_kb":15020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"268'2","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.657305+0000","last_change":"2024-09-19T15:32:05.657108+0000","last_active":"2024-09-19T15:32:05.657305+0000","last_peered":"2024-09-19T15:32:05.657305+0000","last_clean":"2024-09-19T15:32:05.657305+0000","last_became_active":"2024-09-19T13:40:38.214571+0000","last_became_peered":"2024-09-19T13:40:38.214571+0000","last_unstale":"2024-09-19T15:32:05.657305+0000","last_undegraded":"2024-09-19T15:32:05.657305+0000","last_fullsized":"2024-09-19T15:32:05.657305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:05.656919+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:05.656919+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.656919+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:18:39.425426+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'355","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:16.604721+0000","last_change":"2024-09-19T15:32:16.604721+0000","last_active":"2024-09-19T15:32:16.604721+0000","last_peered":"2024-09-19T15:32:16.604721+0000","last_clean":"2024-09-19T15:32:16.604721+0000","last_became_active":"2024-09-19T13:40:40.245368+0000","last_became_peered":"2024-09-19T13:40:40.245368+0000","last_unstale":"2024-09-19T15:32:16.604721+0000","last_undegraded":"2024-09-19T15:32:16.604721+0000","last_fullsized":"2024-09-19T15:32:16.604721+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'355","last_scrub_stamp":"2024-09-19T15:32:16.604529+0000","last_deep_scrub":"268'355","last_deep_scrub_stamp":"2024-09-19T15:32:16.604529+0000","last_clean_scrub_stamp":"2024-09-19T15:32:16.604529+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:31:33.028785+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48547,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":571,"num_read_kb":1175,"num_write":452,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:16.612659+0000","last_change":"2024-09-19T15:32:16.612659+0000","last_active":"2024-09-19T15:32:16.612659+0000","last_peered":"2024-09-19T15:32:16.612659+0000","last_clean":"2024-09-19T15:32:16.612659+0000","last_became_active":"2024-09-19T13:40:42.239391+0000","last_became_peered":"2024-09-19T13:40:42.239391+0000","last_unstale":"2024-09-19T15:32:16.612659+0000","last_undegraded":"2024-09-19T15:32:16.612659+0000","last_fullsized":"2024-09-19T15:32:16.612659+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:16.612481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:16.612481+0000","last_clean_scrub_stamp":"2024-09-19T15:32:16.612481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:37.873230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'131","reported_seq":667,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:18.583804+0000","last_change":"2024-09-19T15:32:18.583804+0000","last_active":"2024-09-19T15:32:18.583804+0000","last_peered":"2024-09-19T15:32:18.583804+0000","last_clean":"2024-09-19T15:32:18.583804+0000","last_became_active":"2024-09-19T13:40:44.249201+0000","last_became_peered":"2024-09-19T13:40:44.249201+0000","last_unstale":"2024-09-19T15:32:18.583804+0000","last_undegraded":"2024-09-19T15:32:18.583804+0000","last_fullsized":"2024-09-19T15:32:18.583804+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'131","last_scrub_stamp":"2024-09-19T15:32:18.583609+0000","last_deep_scrub":"268'131","last_deep_scrub_stamp":"2024-09-19T15:32:18.583609+0000","last_clean_scrub_stamp":"2024-09-19T15:32:18.583609+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:15:18.362322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":210,"num_read_kb":190,"num_write":320,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'404","reported_seq":2086,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.650457+0000","last_change":"2024-09-19T15:31:59.650457+0000","last_active":"2024-09-19T15:31:59.650457+0000","last_peered":"2024-09-19T15:31:59.650457+0000","last_clean":"2024-09-19T15:31:59.650457+0000","last_became_active":"2024-09-19T13:40:36.225885+0000","last_became_peered":"2024-09-19T13:40:36.225885+0000","last_unstale":"2024-09-19T15:31:59.650457+0000","last_undegraded":"2024-09-19T15:31:59.650457+0000","last_fullsized":"2024-09-19T15:31:59.650457+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'404","last_scrub_stamp":"2024-09-19T15:31:59.650266+0000","last_deep_scrub":"268'404","last_deep_scrub_stamp":"2024-09-19T15:31:59.650266+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.650266+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:40.113541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2307,"num_read_kb":2225,"num_write":450,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'329","reported_seq":970,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.933899+0000","last_change":"2024-09-19T15:31:52.933899+0000","last_active":"2024-09-19T15:31:52.933899+0000","last_peered":"2024-09-19T15:31:52.933899+0000","last_clean":"2024-09-19T15:31:52.933899+0000","last_became_active":"2024-09-19T13:40:34.249068+0000","last_became_peered":"2024-09-19T13:40:34.249068+0000","last_unstale":"2024-09-19T15:31:52.933899+0000","last_undegraded":"2024-09-19T15:31:52.933899+0000","last_fullsized":"2024-09-19T15:31:52.933899+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'329","last_scrub_stamp":"2024-09-19T15:31:52.933659+0000","last_deep_scrub":"268'329","last_deep_scrub_stamp":"2024-09-19T15:31:52.933659+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.933659+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:49.241793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":27093,"num_write":1002,"num_write_kb":27581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"268'462","reported_seq":2113,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.639393+0000","last_change":"2024-09-19T15:32:01.639393+0000","last_active":"2024-09-19T15:32:01.639393+0000","last_peered":"2024-09-19T15:32:01.639393+0000","last_clean":"2024-09-19T15:32:01.639393+0000","last_became_active":"2024-09-19T13:40:36.220569+0000","last_became_peered":"2024-09-19T13:40:36.220569+0000","last_unstale":"2024-09-19T15:32:01.639393+0000","last_undegraded":"2024-09-19T15:32:01.639393+0000","last_fullsized":"2024-09-19T15:32:01.639393+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'462","last_scrub_stamp":"2024-09-19T15:32:01.639153+0000","last_deep_scrub":"268'462","last_deep_scrub_stamp":"2024-09-19T15:32:01.639153+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.639153+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:32:50.011020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2535,"num_read_kb":2389,"num_write":539,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"268'416","reported_seq":1140,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.890155+0000","last_change":"2024-09-19T15:31:48.890155+0000","last_active":"2024-09-19T15:31:48.890155+0000","last_peered":"2024-09-19T15:31:48.890155+0000","last_clean":"2024-09-19T15:31:48.890155+0000","last_became_active":"2024-09-19T13:40:34.239357+0000","last_became_peered":"2024-09-19T13:40:34.239357+0000","last_unstale":"2024-09-19T15:31:48.890155+0000","last_undegraded":"2024-09-19T15:31:48.890155+0000","last_fullsized":"2024-09-19T15:31:48.890155+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'416","last_scrub_stamp":"2024-09-19T15:31:48.889953+0000","last_deep_scrub":"268'416","last_deep_scrub_stamp":"2024-09-19T15:31:48.889953+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.889953+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:51:03.904838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":787,"num_read_kb":92890,"num_write":1403,"num_write_kb":63384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'596","reported_seq":2315,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.766403+0000","last_change":"2024-09-19T15:32:03.766403+0000","last_active":"2024-09-19T15:32:03.766403+0000","last_peered":"2024-09-19T15:32:03.766403+0000","last_clean":"2024-09-19T15:32:03.766403+0000","last_became_active":"2024-09-19T13:40:36.241566+0000","last_became_peered":"2024-09-19T13:40:36.241566+0000","last_unstale":"2024-09-19T15:32:03.766403+0000","last_undegraded":"2024-09-19T15:32:03.766403+0000","last_fullsized":"2024-09-19T15:32:03.766403+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'596","last_scrub_stamp":"2024-09-19T15:32:03.766219+0000","last_deep_scrub":"268'596","last_deep_scrub_stamp":"2024-09-19T15:32:03.766219+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.766219+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:13:52.457376+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3019,"num_read_kb":2776,"num_write":751,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'363","reported_seq":1052,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.812126+0000","last_change":"2024-09-19T15:31:54.812126+0000","last_active":"2024-09-19T15:31:54.812126+0000","last_peered":"2024-09-19T15:31:54.812126+0000","last_clean":"2024-09-19T15:31:54.812126+0000","last_became_active":"2024-09-19T13:40:34.221057+0000","last_became_peered":"2024-09-19T13:40:34.221057+0000","last_unstale":"2024-09-19T15:31:54.812126+0000","last_undegraded":"2024-09-19T15:31:54.812126+0000","last_fullsized":"2024-09-19T15:31:54.812126+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'363","last_scrub_stamp":"2024-09-19T15:31:54.811762+0000","last_deep_scrub":"268'363","last_deep_scrub_stamp":"2024-09-19T15:31:54.811762+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.811762+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:58.508853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":673,"num_read_kb":11742,"num_write":1135,"num_write_kb":23593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'496","reported_seq":2272,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.604022+0000","last_change":"2024-09-19T15:31:58.604022+0000","last_active":"2024-09-19T15:31:58.604022+0000","last_peered":"2024-09-19T15:31:58.604022+0000","last_clean":"2024-09-19T15:31:58.604022+0000","last_became_active":"2024-09-19T13:40:36.238166+0000","last_became_peered":"2024-09-19T13:40:36.238166+0000","last_unstale":"2024-09-19T15:31:58.604022+0000","last_undegraded":"2024-09-19T15:31:58.604022+0000","last_fullsized":"2024-09-19T15:31:58.604022+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'496","last_scrub_stamp":"2024-09-19T15:31:58.603838+0000","last_deep_scrub":"268'496","last_deep_scrub_stamp":"2024-09-19T15:31:58.603838+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.603838+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:02:50.763311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2902,"num_read_kb":2744,"num_write":591,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'345","reported_seq":1067,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.696407+0000","last_change":"2024-09-19T15:31:48.696407+0000","last_active":"2024-09-19T15:31:48.696407+0000","last_peered":"2024-09-19T15:31:48.696407+0000","last_clean":"2024-09-19T15:31:48.696407+0000","last_became_active":"2024-09-19T13:40:34.232099+0000","last_became_peered":"2024-09-19T13:40:34.232099+0000","last_unstale":"2024-09-19T15:31:48.696407+0000","last_undegraded":"2024-09-19T15:31:48.696407+0000","last_fullsized":"2024-09-19T15:31:48.696407+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'345","last_scrub_stamp":"2024-09-19T15:31:48.696153+0000","last_deep_scrub":"268'345","last_deep_scrub_stamp":"2024-09-19T15:31:48.696153+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.696153+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:49:42.668267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136873,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":758,"num_read_kb":12572,"num_write":1035,"num_write_kb":46357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"268'464","reported_seq":2054,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.060300+0000","last_change":"2024-09-19T15:32:04.060300+0000","last_active":"2024-09-19T15:32:04.060300+0000","last_peered":"2024-09-19T15:32:04.060300+0000","last_clean":"2024-09-19T15:32:04.060300+0000","last_became_active":"2024-09-19T13:40:36.238644+0000","last_became_peered":"2024-09-19T13:40:36.238644+0000","last_unstale":"2024-09-19T15:32:04.060300+0000","last_undegraded":"2024-09-19T15:32:04.060300+0000","last_fullsized":"2024-09-19T15:32:04.060300+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'464","last_scrub_stamp":"2024-09-19T15:32:04.060118+0000","last_deep_scrub":"268'464","last_deep_scrub_stamp":"2024-09-19T15:32:04.060118+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.060118+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:50:53.942088+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2315,"num_read_kb":2185,"num_write":554,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'403","reported_seq":1123,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.920457+0000","last_change":"2024-09-19T15:31:50.920457+0000","last_active":"2024-09-19T15:31:50.920457+0000","last_peered":"2024-09-19T15:31:50.920457+0000","last_clean":"2024-09-19T15:31:50.920457+0000","last_became_active":"2024-09-19T13:40:34.249600+0000","last_became_peered":"2024-09-19T13:40:34.249600+0000","last_unstale":"2024-09-19T15:31:50.920457+0000","last_undegraded":"2024-09-19T15:31:50.920457+0000","last_fullsized":"2024-09-19T15:31:50.920457+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'403","last_scrub_stamp":"2024-09-19T15:31:50.920243+0000","last_deep_scrub":"268'403","last_deep_scrub_stamp":"2024-09-19T15:31:50.920243+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.920243+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:44.928927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":720,"num_read_kb":53970,"num_write":1365,"num_write_kb":53250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'834","reported_seq":2496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.535048+0000","last_change":"2024-09-19T15:32:00.535048+0000","last_active":"2024-09-19T15:32:00.535048+0000","last_peered":"2024-09-19T15:32:00.535048+0000","last_clean":"2024-09-19T15:32:00.535048+0000","last_became_active":"2024-09-19T13:40:36.216697+0000","last_became_peered":"2024-09-19T13:40:36.216697+0000","last_unstale":"2024-09-19T15:32:00.535048+0000","last_undegraded":"2024-09-19T15:32:00.535048+0000","last_fullsized":"2024-09-19T15:32:00.535048+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'834","last_scrub_stamp":"2024-09-19T15:32:00.534857+0000","last_deep_scrub":"268'834","last_deep_scrub_stamp":"2024-09-19T15:32:00.534857+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.534857+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:46:06.736133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4198,"num_read_kb":3766,"num_write":1106,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'330","reported_seq":1034,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.609462+0000","last_change":"2024-09-19T15:31:48.609462+0000","last_active":"2024-09-19T15:31:48.609462+0000","last_peered":"2024-09-19T15:31:48.609462+0000","last_clean":"2024-09-19T15:31:48.609462+0000","last_became_active":"2024-09-19T13:40:34.216774+0000","last_became_peered":"2024-09-19T13:40:34.216774+0000","last_unstale":"2024-09-19T15:31:48.609462+0000","last_undegraded":"2024-09-19T15:31:48.609462+0000","last_fullsized":"2024-09-19T15:31:48.609462+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'330","last_scrub_stamp":"2024-09-19T15:31:48.609254+0000","last_deep_scrub":"268'330","last_deep_scrub_stamp":"2024-09-19T15:31:48.609254+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.609254+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:28.120319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":651,"num_read_kb":47831,"num_write":981,"num_write_kb":20035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'563","reported_seq":2261,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.041159+0000","last_change":"2024-09-19T15:32:03.041159+0000","last_active":"2024-09-19T15:32:03.041159+0000","last_peered":"2024-09-19T15:32:03.041159+0000","last_clean":"2024-09-19T15:32:03.041159+0000","last_became_active":"2024-09-19T13:40:36.218090+0000","last_became_peered":"2024-09-19T13:40:36.218090+0000","last_unstale":"2024-09-19T15:32:03.041159+0000","last_undegraded":"2024-09-19T15:32:03.041159+0000","last_fullsized":"2024-09-19T15:32:03.041159+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'563","last_scrub_stamp":"2024-09-19T15:32:03.040966+0000","last_deep_scrub":"268'563","last_deep_scrub_stamp":"2024-09-19T15:32:03.040966+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.040966+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:59.258463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2933,"num_read_kb":2699,"num_write":698,"num_write_kb":201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'354","reported_seq":1143,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.932331+0000","last_change":"2024-09-19T15:31:50.932331+0000","last_active":"2024-09-19T15:31:50.932331+0000","last_peered":"2024-09-19T15:31:50.932331+0000","last_clean":"2024-09-19T15:31:50.932331+0000","last_became_active":"2024-09-19T13:40:34.272629+0000","last_became_peered":"2024-09-19T13:40:34.272629+0000","last_unstale":"2024-09-19T15:31:50.932331+0000","last_undegraded":"2024-09-19T15:31:50.932331+0000","last_fullsized":"2024-09-19T15:31:50.932331+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'354","last_scrub_stamp":"2024-09-19T15:31:50.932113+0000","last_deep_scrub":"268'354","last_deep_scrub_stamp":"2024-09-19T15:31:50.932113+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.932113+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:18:14.426357+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174644,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":935,"num_read_kb":42229,"num_write":1199,"num_write_kb":17971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'342","reported_seq":1792,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.944349+0000","last_change":"2024-09-19T15:31:57.944349+0000","last_active":"2024-09-19T15:31:57.944349+0000","last_peered":"2024-09-19T15:31:57.944349+0000","last_clean":"2024-09-19T15:31:57.944349+0000","last_became_active":"2024-09-19T13:40:36.224228+0000","last_became_peered":"2024-09-19T13:40:36.224228+0000","last_unstale":"2024-09-19T15:31:57.944349+0000","last_undegraded":"2024-09-19T15:31:57.944349+0000","last_fullsized":"2024-09-19T15:31:57.944349+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'342","last_scrub_stamp":"2024-09-19T15:31:57.944097+0000","last_deep_scrub":"268'342","last_deep_scrub_stamp":"2024-09-19T15:31:57.944097+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.944097+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:57.675155+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1855,"num_read_kb":1782,"num_write":368,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'385","reported_seq":1149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.890591+0000","last_change":"2024-09-19T15:31:51.890591+0000","last_active":"2024-09-19T15:31:51.890591+0000","last_peered":"2024-09-19T15:31:51.890591+0000","last_clean":"2024-09-19T15:31:51.890591+0000","last_became_active":"2024-09-19T13:40:34.245197+0000","last_became_peered":"2024-09-19T13:40:34.245197+0000","last_unstale":"2024-09-19T15:31:51.890591+0000","last_undegraded":"2024-09-19T15:31:51.890591+0000","last_fullsized":"2024-09-19T15:31:51.890591+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'385","last_scrub_stamp":"2024-09-19T15:31:51.890329+0000","last_deep_scrub":"268'385","last_deep_scrub_stamp":"2024-09-19T15:31:51.890329+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.890329+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:30.384059+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273700,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":750,"num_read_kb":129994,"num_write":1223,"num_write_kb":46426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"268'497","reported_seq":2050,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.736984+0000","last_change":"2024-09-19T15:31:58.736843+0000","last_active":"2024-09-19T15:31:58.736984+0000","last_peered":"2024-09-19T15:31:58.736984+0000","last_clean":"2024-09-19T15:31:58.736984+0000","last_became_active":"2024-09-19T13:40:36.226839+0000","last_became_peered":"2024-09-19T13:40:36.226839+0000","last_unstale":"2024-09-19T15:31:58.736984+0000","last_undegraded":"2024-09-19T15:31:58.736984+0000","last_fullsized":"2024-09-19T15:31:58.736984+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'497","last_scrub_stamp":"2024-09-19T15:31:58.736663+0000","last_deep_scrub":"268'497","last_deep_scrub_stamp":"2024-09-19T15:31:58.736663+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.736663+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:38:24.306737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2632,"num_read_kb":2421,"num_write":626,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'349","reported_seq":1173,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.757738+0000","last_change":"2024-09-19T15:31:56.757738+0000","last_active":"2024-09-19T15:31:56.757738+0000","last_peered":"2024-09-19T15:31:56.757738+0000","last_clean":"2024-09-19T15:31:56.757738+0000","last_became_active":"2024-09-19T13:40:34.228472+0000","last_became_peered":"2024-09-19T13:40:34.228472+0000","last_unstale":"2024-09-19T15:31:56.757738+0000","last_undegraded":"2024-09-19T15:31:56.757738+0000","last_fullsized":"2024-09-19T15:31:56.757738+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'349","last_scrub_stamp":"2024-09-19T15:31:56.757523+0000","last_deep_scrub":"268'349","last_deep_scrub_stamp":"2024-09-19T15:31:56.757523+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.757523+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:45.800606+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1120,"num_read_kb":37188,"num_write":1213,"num_write_kb":31649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'801","reported_seq":2510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.491418+0000","last_change":"2024-09-19T15:32:02.491208+0000","last_active":"2024-09-19T15:32:02.491418+0000","last_peered":"2024-09-19T15:32:02.491418+0000","last_clean":"2024-09-19T15:32:02.491418+0000","last_became_active":"2024-09-19T13:40:36.217870+0000","last_became_peered":"2024-09-19T13:40:36.217870+0000","last_unstale":"2024-09-19T15:32:02.491418+0000","last_undegraded":"2024-09-19T15:32:02.491418+0000","last_fullsized":"2024-09-19T15:32:02.491418+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'801","last_scrub_stamp":"2024-09-19T15:32:02.491031+0000","last_deep_scrub":"268'801","last_deep_scrub_stamp":"2024-09-19T15:32:02.491031+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.491031+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:55.926935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3954,"num_read_kb":3588,"num_write":1044,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'308","reported_seq":1008,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.871956+0000","last_change":"2024-09-19T15:31:49.871956+0000","last_active":"2024-09-19T15:31:49.871956+0000","last_peered":"2024-09-19T15:31:49.871956+0000","last_clean":"2024-09-19T15:31:49.871956+0000","last_became_active":"2024-09-19T13:41:05.310802+0000","last_became_peered":"2024-09-19T13:41:05.310802+0000","last_unstale":"2024-09-19T15:31:49.871956+0000","last_undegraded":"2024-09-19T15:31:49.871956+0000","last_fullsized":"2024-09-19T15:31:49.871956+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'308","last_scrub_stamp":"2024-09-19T15:31:49.871682+0000","last_deep_scrub":"268'308","last_deep_scrub_stamp":"2024-09-19T15:31:49.871682+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.871682+0000","objects_scrubbed":10,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:31:02.847445+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136937,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":757,"num_read_kb":21770,"num_write":969,"num_write_kb":19448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"268'361","reported_seq":1968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.789067+0000","last_change":"2024-09-19T15:31:52.789067+0000","last_active":"2024-09-19T15:31:52.789067+0000","last_peered":"2024-09-19T15:31:52.789067+0000","last_clean":"2024-09-19T15:31:52.789067+0000","last_became_active":"2024-09-19T13:40:36.215821+0000","last_became_peered":"2024-09-19T13:40:36.215821+0000","last_unstale":"2024-09-19T15:31:52.789067+0000","last_undegraded":"2024-09-19T15:31:52.789067+0000","last_fullsized":"2024-09-19T15:31:52.789067+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'361","last_scrub_stamp":"2024-09-19T15:31:52.788781+0000","last_deep_scrub":"268'361","last_deep_scrub_stamp":"2024-09-19T15:31:52.788781+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.788781+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:07.602774+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2112,"num_read_kb":2049,"num_write":394,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'450","reported_seq":1193,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.772885+0000","last_change":"2024-09-19T15:31:55.772885+0000","last_active":"2024-09-19T15:31:55.772885+0000","last_peered":"2024-09-19T15:31:55.772885+0000","last_clean":"2024-09-19T15:31:55.772885+0000","last_became_active":"2024-09-19T13:40:34.261812+0000","last_became_peered":"2024-09-19T13:40:34.261812+0000","last_unstale":"2024-09-19T15:31:55.772885+0000","last_undegraded":"2024-09-19T15:31:55.772885+0000","last_fullsized":"2024-09-19T15:31:55.772885+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'450","last_scrub_stamp":"2024-09-19T15:31:55.772408+0000","last_deep_scrub":"268'450","last_deep_scrub_stamp":"2024-09-19T15:31:55.772408+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.772408+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:27:33.627722+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136844,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":935,"num_read_kb":21060,"num_write":1238,"num_write_kb":41159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'747","reported_seq":2340,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.528088+0000","last_change":"2024-09-19T15:32:01.528088+0000","last_active":"2024-09-19T15:32:01.528088+0000","last_peered":"2024-09-19T15:32:01.528088+0000","last_clean":"2024-09-19T15:32:01.528088+0000","last_became_active":"2024-09-19T13:40:36.216597+0000","last_became_peered":"2024-09-19T13:40:36.216597+0000","last_unstale":"2024-09-19T15:32:01.528088+0000","last_undegraded":"2024-09-19T15:32:01.528088+0000","last_fullsized":"2024-09-19T15:32:01.528088+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'747","last_scrub_stamp":"2024-09-19T15:32:01.527862+0000","last_deep_scrub":"268'747","last_deep_scrub_stamp":"2024-09-19T15:32:01.527862+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.527862+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:58.511021+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3535,"num_read_kb":3206,"num_write":942,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'389","reported_seq":1104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.688371+0000","last_change":"2024-09-19T15:31:50.688371+0000","last_active":"2024-09-19T15:31:50.688371+0000","last_peered":"2024-09-19T15:31:50.688371+0000","last_clean":"2024-09-19T15:31:50.688371+0000","last_became_active":"2024-09-19T13:40:34.255374+0000","last_became_peered":"2024-09-19T13:40:34.255374+0000","last_unstale":"2024-09-19T15:31:50.688371+0000","last_undegraded":"2024-09-19T15:31:50.688371+0000","last_fullsized":"2024-09-19T15:31:50.688371+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'389","last_scrub_stamp":"2024-09-19T15:31:50.688138+0000","last_deep_scrub":"268'389","last_deep_scrub_stamp":"2024-09-19T15:31:50.688138+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.688138+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:59:16.557745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":672,"num_read_kb":82615,"num_write":1215,"num_write_kb":54973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'1055","reported_seq":2699,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.729121+0000","last_change":"2024-09-19T15:32:02.729121+0000","last_active":"2024-09-19T15:32:02.729121+0000","last_peered":"2024-09-19T15:32:02.729121+0000","last_clean":"2024-09-19T15:32:02.729121+0000","last_became_active":"2024-09-19T13:40:36.238907+0000","last_became_peered":"2024-09-19T13:40:36.238907+0000","last_unstale":"2024-09-19T15:32:02.729121+0000","last_undegraded":"2024-09-19T15:32:02.729121+0000","last_fullsized":"2024-09-19T15:32:02.729121+0000","mapping_epoch":27,"log_start":"268'1000","ondisk_log_start":"268'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1055","last_scrub_stamp":"2024-09-19T15:32:02.728906+0000","last_deep_scrub":"268'1055","last_deep_scrub_stamp":"2024-09-19T15:32:02.728906+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.728906+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1000,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:49:49.972281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5049,"num_read_kb":4427,"num_write":1568,"num_write_kb":756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'420","reported_seq":1105,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.888307+0000","last_change":"2024-09-19T15:31:48.888307+0000","last_active":"2024-09-19T15:31:48.888307+0000","last_peered":"2024-09-19T15:31:48.888307+0000","last_clean":"2024-09-19T15:31:48.888307+0000","last_became_active":"2024-09-19T13:40:34.272618+0000","last_became_peered":"2024-09-19T13:40:34.272618+0000","last_unstale":"2024-09-19T15:31:48.888307+0000","last_undegraded":"2024-09-19T15:31:48.888307+0000","last_fullsized":"2024-09-19T15:31:48.888307+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'420","last_scrub_stamp":"2024-09-19T15:31:48.888059+0000","last_deep_scrub":"268'420","last_deep_scrub_stamp":"2024-09-19T15:31:48.888059+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.888059+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:42:39.951922+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":788,"num_read_kb":25154,"num_write":1353,"num_write_kb":33238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'504","reported_seq":2201,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.714567+0000","last_change":"2024-09-19T15:31:59.714567+0000","last_active":"2024-09-19T15:31:59.714567+0000","last_peered":"2024-09-19T15:31:59.714567+0000","last_clean":"2024-09-19T15:31:59.714567+0000","last_became_active":"2024-09-19T13:40:36.226572+0000","last_became_peered":"2024-09-19T13:40:36.226572+0000","last_unstale":"2024-09-19T15:31:59.714567+0000","last_undegraded":"2024-09-19T15:31:59.714567+0000","last_fullsized":"2024-09-19T15:31:59.714567+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'504","last_scrub_stamp":"2024-09-19T15:31:59.714369+0000","last_deep_scrub":"268'504","last_deep_scrub_stamp":"2024-09-19T15:31:59.714369+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.714369+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:23:18.997611+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2633,"num_read_kb":2478,"num_write":570,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'448","reported_seq":1211,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.710466+0000","last_change":"2024-09-19T15:31:55.710466+0000","last_active":"2024-09-19T15:31:55.710466+0000","last_peered":"2024-09-19T15:31:55.710466+0000","last_clean":"2024-09-19T15:31:55.710466+0000","last_became_active":"2024-09-19T13:40:34.274523+0000","last_became_peered":"2024-09-19T13:40:34.274523+0000","last_unstale":"2024-09-19T15:31:55.710466+0000","last_undegraded":"2024-09-19T15:31:55.710466+0000","last_fullsized":"2024-09-19T15:31:55.710466+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'448","last_scrub_stamp":"2024-09-19T15:31:55.710272+0000","last_deep_scrub":"268'448","last_deep_scrub_stamp":"2024-09-19T15:31:55.710272+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.710272+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:32:09.787284+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":885,"num_read_kb":117461,"num_write":1361,"num_write_kb":54900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"268'910","reported_seq":2419,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.053655+0000","last_change":"2024-09-19T15:32:06.053655+0000","last_active":"2024-09-19T15:32:06.053655+0000","last_peered":"2024-09-19T15:32:06.053655+0000","last_clean":"2024-09-19T15:32:06.053655+0000","last_became_active":"2024-09-19T13:40:36.219017+0000","last_became_peered":"2024-09-19T13:40:36.219017+0000","last_unstale":"2024-09-19T15:32:06.053655+0000","last_undegraded":"2024-09-19T15:32:06.053655+0000","last_fullsized":"2024-09-19T15:32:06.053655+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'910","last_scrub_stamp":"2024-09-19T15:32:06.053447+0000","last_deep_scrub":"268'910","last_deep_scrub_stamp":"2024-09-19T15:32:06.053447+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.053447+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":800,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:14.042097+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5981,"num_read_kb":5463,"num_write":1432,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'347","reported_seq":1033,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.834655+0000","last_change":"2024-09-19T15:31:53.834495+0000","last_active":"2024-09-19T15:31:53.834655+0000","last_peered":"2024-09-19T15:31:53.834655+0000","last_clean":"2024-09-19T15:31:53.834655+0000","last_became_active":"2024-09-19T13:40:34.258251+0000","last_became_peered":"2024-09-19T13:40:34.258251+0000","last_unstale":"2024-09-19T15:31:53.834655+0000","last_undegraded":"2024-09-19T15:31:53.834655+0000","last_fullsized":"2024-09-19T15:31:53.834655+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'347","last_scrub_stamp":"2024-09-19T15:31:53.834285+0000","last_deep_scrub":"268'347","last_deep_scrub_stamp":"2024-09-19T15:31:53.834285+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.834285+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:28:52.290958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":664,"num_read_kb":8565,"num_write":1177,"num_write_kb":30274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'822","reported_seq":2525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.703943+0000","last_change":"2024-09-19T15:32:01.703943+0000","last_active":"2024-09-19T15:32:01.703943+0000","last_peered":"2024-09-19T15:32:01.703943+0000","last_clean":"2024-09-19T15:32:01.703943+0000","last_became_active":"2024-09-19T13:40:36.234463+0000","last_became_peered":"2024-09-19T13:40:36.234463+0000","last_unstale":"2024-09-19T15:32:01.703943+0000","last_undegraded":"2024-09-19T15:32:01.703943+0000","last_fullsized":"2024-09-19T15:32:01.703943+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'822","last_scrub_stamp":"2024-09-19T15:32:01.703761+0000","last_deep_scrub":"268'822","last_deep_scrub_stamp":"2024-09-19T15:32:01.703761+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.703761+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:30:12.604793+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4113,"num_read_kb":3717,"num_write":1084,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2509,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'332","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.789546+0000","last_change":"2024-09-19T15:31:57.789415+0000","last_active":"2024-09-19T15:31:57.789546+0000","last_peered":"2024-09-19T15:31:57.789546+0000","last_clean":"2024-09-19T15:31:57.789546+0000","last_became_active":"2024-09-19T13:40:34.257895+0000","last_became_peered":"2024-09-19T13:40:34.257895+0000","last_unstale":"2024-09-19T15:31:57.789546+0000","last_undegraded":"2024-09-19T15:31:57.789546+0000","last_fullsized":"2024-09-19T15:31:57.789546+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'332","last_scrub_stamp":"2024-09-19T15:31:57.789227+0000","last_deep_scrub":"268'332","last_deep_scrub_stamp":"2024-09-19T15:31:57.789227+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.789227+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:08:45.295282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":616,"num_read_kb":2702,"num_write":1090,"num_write_kb":37833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'365","reported_seq":1066,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.835286+0000","last_change":"2024-09-19T15:31:58.835074+0000","last_active":"2024-09-19T15:31:58.835286+0000","last_peered":"2024-09-19T15:31:58.835286+0000","last_clean":"2024-09-19T15:31:58.835286+0000","last_became_active":"2024-09-19T13:41:05.313139+0000","last_became_peered":"2024-09-19T13:41:05.313139+0000","last_unstale":"2024-09-19T15:31:58.835286+0000","last_undegraded":"2024-09-19T15:31:58.835286+0000","last_fullsized":"2024-09-19T15:31:58.835286+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'365","last_scrub_stamp":"2024-09-19T15:31:58.834854+0000","last_deep_scrub":"268'365","last_deep_scrub_stamp":"2024-09-19T15:31:58.834854+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.834854+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:08.987958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":636,"num_read_kb":5598,"num_write":1148,"num_write_kb":52319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'585","reported_seq":2295,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.715259+0000","last_change":"2024-09-19T15:32:01.715002+0000","last_active":"2024-09-19T15:32:01.715259+0000","last_peered":"2024-09-19T15:32:01.715259+0000","last_clean":"2024-09-19T15:32:01.715259+0000","last_became_active":"2024-09-19T13:40:36.225131+0000","last_became_peered":"2024-09-19T13:40:36.225131+0000","last_unstale":"2024-09-19T15:32:01.715259+0000","last_undegraded":"2024-09-19T15:32:01.715259+0000","last_fullsized":"2024-09-19T15:32:01.715259+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'585","last_scrub_stamp":"2024-09-19T15:32:01.714790+0000","last_deep_scrub":"268'585","last_deep_scrub_stamp":"2024-09-19T15:32:01.714790+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.714790+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":500,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:56.655110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3409,"num_read_kb":3161,"num_write":806,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'423","reported_seq":1194,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.619222+0000","last_change":"2024-09-19T15:31:55.619026+0000","last_active":"2024-09-19T15:31:55.619222+0000","last_peered":"2024-09-19T15:31:55.619222+0000","last_clean":"2024-09-19T15:31:55.619222+0000","last_became_active":"2024-09-19T13:40:34.252585+0000","last_became_peered":"2024-09-19T13:40:34.252585+0000","last_unstale":"2024-09-19T15:31:55.619222+0000","last_undegraded":"2024-09-19T15:31:55.619222+0000","last_fullsized":"2024-09-19T15:31:55.619222+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'423","last_scrub_stamp":"2024-09-19T15:31:55.618823+0000","last_deep_scrub":"268'423","last_deep_scrub_stamp":"2024-09-19T15:31:55.618823+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.618823+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:57.280079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1089,"num_read_kb":22295,"num_write":1244,"num_write_kb":33627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'496","reported_seq":2111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.795339+0000","last_change":"2024-09-19T15:32:06.795339+0000","last_active":"2024-09-19T15:32:06.795339+0000","last_peered":"2024-09-19T15:32:06.795339+0000","last_clean":"2024-09-19T15:32:06.795339+0000","last_became_active":"2024-09-19T13:40:36.232695+0000","last_became_peered":"2024-09-19T13:40:36.232695+0000","last_unstale":"2024-09-19T15:32:06.795339+0000","last_undegraded":"2024-09-19T15:32:06.795339+0000","last_fullsized":"2024-09-19T15:32:06.795339+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'496","last_scrub_stamp":"2024-09-19T15:32:06.795165+0000","last_deep_scrub":"268'496","last_deep_scrub_stamp":"2024-09-19T15:32:06.795165+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.795165+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:10:31.458475+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2752,"num_read_kb":2570,"num_write":600,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":963,"num_omap_keys":4,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10865,"num_read_kb":9021,"num_write":3118,"num_write_kb":1011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1008,"ondisk_log_size":1008,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14601,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":16485,"num_read_kb":16147,"num_write":17047,"num_write_kb":4982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2448,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":29202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1876,"ondisk_log_size":1876,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":601,"ondisk_log_size":601,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1631422,"num_objects":200,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":21072,"num_read_kb":40733,"num_write":17629,"num_write_kb":12600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":704656,"num_omap_keys":1634,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1956,"ondisk_log_size":1956,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2392,"num_read_kb":2851,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":220859,"num_read_kb":201873,"num_write":56069,"num_write_kb":19197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35455,"num_omap_keys":143,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4151,"ondisk_log_size":4151,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":940,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":23942209,"num_objects":277,"num_object_clones":0,"num_object_copies":831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":0,"num_read":44439,"num_read_kb":2347980,"num_write":73000,"num_write_kb":2178675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37318656,"data_stored":37318656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3768,"ondisk_log_size":3768,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":215739,"num_write":161,"num_write_kb":136883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":195259,"num_write":161,"num_write_kb":136883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543504,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296384,"kb_used_data":8368,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94075456,"statfs":{"total":96636764160,"available":96333266944,"internally_reserved":0,"allocated":8568832,"data_stored":6565575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":294910410},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543499,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250764,"kb_used_data":7164,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94121076,"statfs":{"total":96636764160,"available":96379981824,"internally_reserved":0,"allocated":7335936,"data_stored":5380296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":249428422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543502,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149372,"kb_used_data":9964,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94222468,"statfs":{"total":96636764160,"available":96483807232,"internally_reserved":0,"allocated":10203136,"data_stored":8155658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543499,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":115784,"kb_used_data":8248,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94256056,"statfs":{"total":96636764160,"available":96518201344,"internally_reserved":0,"allocated":8445952,"data_stored":6509947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543504,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296544,"kb_used_data":12688,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94075296,"statfs":{"total":96636764160,"available":96333103104,"internally_reserved":0,"allocated":12992512,"data_stored":10993023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":290650567},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543502,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92420,"kb_used_data":7092,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94279420,"statfs":{"total":96636764160,"available":96542126080,"internally_reserved":0,"allocated":7262208,"data_stored":5318104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543500,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":192588,"kb_used_data":8764,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94179252,"statfs":{"total":96636764160,"available":96439554048,"internally_reserved":0,"allocated":8974336,"data_stored":6990912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543500,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":282964,"kb_used_data":8836,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94088876,"statfs":{"total":96636764160,"available":96347009024,"internally_reserved":0,"allocated":9048064,"data_stored":7057331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":280689095},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4157440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4681728,"data_stored":4681728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3010560,"data_stored":3010560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8683520,"data_stored":8683520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4202496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5844992,"data_stored":5844992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3072000,"data_stored":3072000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3665920,"data_stored":3665920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T15:32:49.657 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:49.658 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:49.658 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-19T14:29:49.992655+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=14, tm_min=29, tm_sec=49, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=15, tm_min=31, tm_sec=43, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T15:32:49.662 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-19T15:33:09.663 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T15:33:10.039 INFO:teuthology.orchestra.run.smithi153.stdout: 2024-09-19T15:33:10.052 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2024-09-19T15:33:10.061 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":3647,"stamp":"2024-09-19T15:33:08.700733+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26180412,"num_objects":726,"num_object_clones":0,"num_object_copies":1729,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":726,"num_whiteouts":0,"num_read":316475,"num_read_kb":3029670,"num_write":167328,"num_write_kb":2491887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":189,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":743687,"num_omap_keys":1804,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13671,"ondisk_log_size":13671,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1676820,"kb_used_data":71124,"kb_used_omap":12,"kb_used_meta":1605555,"kb_avail":753297900,"statfs":{"total":773094113280,"available":771377049600,"internally_reserved":0,"allocated":72830976,"data_stored":56970846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1644088882},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007807"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:35.699526+0000","last_change":"2024-09-19T15:32:35.699526+0000","last_active":"2024-09-19T15:32:35.699526+0000","last_peered":"2024-09-19T15:32:35.699526+0000","last_clean":"2024-09-19T15:32:35.699526+0000","last_became_active":"2024-09-19T14:29:51.036952+0000","last_became_peered":"2024-09-19T14:29:51.036952+0000","last_unstale":"2024-09-19T15:32:35.699526+0000","last_undegraded":"2024-09-19T15:32:35.699526+0000","last_fullsized":"2024-09-19T15:32:35.699526+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:35.699348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:35.699348+0000","last_clean_scrub_stamp":"2024-09-19T15:32:35.699348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:53:11.007787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:33.713803+0000","last_change":"2024-09-19T15:32:33.713677+0000","last_active":"2024-09-19T15:32:33.713803+0000","last_peered":"2024-09-19T15:32:33.713803+0000","last_clean":"2024-09-19T15:32:33.713803+0000","last_became_active":"2024-09-19T14:02:36.912307+0000","last_became_peered":"2024-09-19T14:02:36.912307+0000","last_unstale":"2024-09-19T15:32:33.713803+0000","last_undegraded":"2024-09-19T15:32:33.713803+0000","last_fullsized":"2024-09-19T15:32:33.713803+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:33.713492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:33.713492+0000","last_clean_scrub_stamp":"2024-09-19T15:32:33.713492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:48:13.623014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"268'11","reported_seq":92,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:36.123124+0000","last_change":"2024-09-19T15:32:36.123124+0000","last_active":"2024-09-19T15:32:36.123124+0000","last_peered":"2024-09-19T15:32:36.123124+0000","last_clean":"2024-09-19T15:32:36.123124+0000","last_became_active":"2024-09-19T14:02:29.739721+0000","last_became_peered":"2024-09-19T14:02:29.739721+0000","last_unstale":"2024-09-19T15:32:36.123124+0000","last_undegraded":"2024-09-19T15:32:36.123124+0000","last_fullsized":"2024-09-19T15:32:36.123124+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'11","last_scrub_stamp":"2024-09-19T15:32:36.122935+0000","last_deep_scrub":"268'11","last_deep_scrub_stamp":"2024-09-19T15:32:36.122935+0000","last_clean_scrub_stamp":"2024-09-19T15:32:36.122935+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:52:52.708932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":13312,"num_write":21,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"268'35","reported_seq":177,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:29.488608+0000","last_change":"2024-09-19T15:32:29.488608+0000","last_active":"2024-09-19T15:32:29.488608+0000","last_peered":"2024-09-19T15:32:29.488608+0000","last_clean":"2024-09-19T15:32:29.488608+0000","last_became_active":"2024-09-19T13:56:23.180176+0000","last_became_peered":"2024-09-19T13:56:23.180176+0000","last_unstale":"2024-09-19T15:32:29.488608+0000","last_undegraded":"2024-09-19T15:32:29.488608+0000","last_fullsized":"2024-09-19T15:32:29.488608+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'35","last_scrub_stamp":"2024-09-19T15:32:29.488421+0000","last_deep_scrub":"268'35","last_deep_scrub_stamp":"2024-09-19T15:32:29.488421+0000","last_clean_scrub_stamp":"2024-09-19T15:32:29.488421+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:18:29.961954+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":252,"num_read_kb":165,"num_write":94,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:17.100705+0000","last_change":"2024-09-19T15:32:17.100562+0000","last_active":"2024-09-19T15:32:17.100705+0000","last_peered":"2024-09-19T15:32:17.100705+0000","last_clean":"2024-09-19T15:32:17.100705+0000","last_became_active":"2024-09-19T14:29:51.038289+0000","last_became_peered":"2024-09-19T14:29:51.038289+0000","last_unstale":"2024-09-19T15:32:17.100705+0000","last_undegraded":"2024-09-19T15:32:17.100705+0000","last_fullsized":"2024-09-19T15:32:17.100705+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:17.100380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:17.100380+0000","last_clean_scrub_stamp":"2024-09-19T15:32:17.100380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:36.465601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"268'2","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:34.585173+0000","last_change":"2024-09-19T15:32:34.584988+0000","last_active":"2024-09-19T15:32:34.585173+0000","last_peered":"2024-09-19T15:32:34.585173+0000","last_clean":"2024-09-19T15:32:34.585173+0000","last_became_active":"2024-09-19T14:02:36.914769+0000","last_became_peered":"2024-09-19T14:02:36.914769+0000","last_unstale":"2024-09-19T15:32:34.585173+0000","last_undegraded":"2024-09-19T15:32:34.585173+0000","last_fullsized":"2024-09-19T15:32:34.585173+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:34.584801+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:34.584801+0000","last_clean_scrub_stamp":"2024-09-19T15:32:34.584801+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:20:22.201440+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"268'6","reported_seq":85,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:20.710350+0000","last_change":"2024-09-19T15:32:20.710105+0000","last_active":"2024-09-19T15:32:20.710350+0000","last_peered":"2024-09-19T15:32:20.710350+0000","last_clean":"2024-09-19T15:32:20.710350+0000","last_became_active":"2024-09-19T14:02:29.747492+0000","last_became_peered":"2024-09-19T14:02:29.747492+0000","last_unstale":"2024-09-19T15:32:20.710350+0000","last_undegraded":"2024-09-19T15:32:20.710350+0000","last_fullsized":"2024-09-19T15:32:20.710350+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-19T15:32:20.709867+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-19T15:32:20.709867+0000","last_clean_scrub_stamp":"2024-09-19T15:32:20.709867+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:29:53.880609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"268'26","reported_seq":162,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.946853+0000","last_change":"2024-09-19T15:32:08.946687+0000","last_active":"2024-09-19T15:32:08.946853+0000","last_peered":"2024-09-19T15:32:08.946853+0000","last_clean":"2024-09-19T15:32:08.946853+0000","last_became_active":"2024-09-19T13:56:23.173377+0000","last_became_peered":"2024-09-19T13:56:23.173377+0000","last_unstale":"2024-09-19T15:32:08.946853+0000","last_undegraded":"2024-09-19T15:32:08.946853+0000","last_fullsized":"2024-09-19T15:32:08.946853+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-09-19T15:32:08.946505+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-09-19T15:32:08.946505+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.946505+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:48.722723+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":124,"num_write":71,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:24.231905+0000","last_change":"2024-09-19T15:32:24.231760+0000","last_active":"2024-09-19T15:32:24.231905+0000","last_peered":"2024-09-19T15:32:24.231905+0000","last_clean":"2024-09-19T15:32:24.231905+0000","last_became_active":"2024-09-19T14:29:51.039043+0000","last_became_peered":"2024-09-19T14:29:51.039043+0000","last_unstale":"2024-09-19T15:32:24.231905+0000","last_undegraded":"2024-09-19T15:32:24.231905+0000","last_fullsized":"2024-09-19T15:32:24.231905+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:24.231568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:24.231568+0000","last_clean_scrub_stamp":"2024-09-19T15:32:24.231568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:48:11.358259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"268'3","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:39.533334+0000","last_change":"2024-09-19T15:32:39.533334+0000","last_active":"2024-09-19T15:32:39.533334+0000","last_peered":"2024-09-19T15:32:39.533334+0000","last_clean":"2024-09-19T15:32:39.533334+0000","last_became_active":"2024-09-19T14:02:37.051665+0000","last_became_peered":"2024-09-19T14:02:37.051665+0000","last_unstale":"2024-09-19T15:32:39.533334+0000","last_undegraded":"2024-09-19T15:32:39.533334+0000","last_fullsized":"2024-09-19T15:32:39.533334+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:39.533156+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:39.533156+0000","last_clean_scrub_stamp":"2024-09-19T15:32:39.533156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:44.640857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"0'0","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:13.026477+0000","last_change":"2024-09-19T15:32:13.026322+0000","last_active":"2024-09-19T15:32:13.026477+0000","last_peered":"2024-09-19T15:32:13.026477+0000","last_clean":"2024-09-19T15:32:13.026477+0000","last_became_active":"2024-09-19T14:02:29.724866+0000","last_became_peered":"2024-09-19T14:02:29.724866+0000","last_unstale":"2024-09-19T15:32:13.026477+0000","last_undegraded":"2024-09-19T15:32:13.026477+0000","last_fullsized":"2024-09-19T15:32:13.026477+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:13.026035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:13.026035+0000","last_clean_scrub_stamp":"2024-09-19T15:32:13.026035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:47:17.974515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"268'36","reported_seq":177,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:27.473468+0000","last_change":"2024-09-19T15:32:27.473468+0000","last_active":"2024-09-19T15:32:27.473468+0000","last_peered":"2024-09-19T15:32:27.473468+0000","last_clean":"2024-09-19T15:32:27.473468+0000","last_became_active":"2024-09-19T13:56:23.180159+0000","last_became_peered":"2024-09-19T13:56:23.180159+0000","last_unstale":"2024-09-19T15:32:27.473468+0000","last_undegraded":"2024-09-19T15:32:27.473468+0000","last_fullsized":"2024-09-19T15:32:27.473468+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'36","last_scrub_stamp":"2024-09-19T15:32:27.473280+0000","last_deep_scrub":"268'36","last_deep_scrub_stamp":"2024-09-19T15:32:27.473280+0000","last_clean_scrub_stamp":"2024-09-19T15:32:27.473280+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:11:38.100859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":283,"num_read_kb":171,"num_write":89,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:48.196716+0000","last_change":"2024-09-19T15:32:48.196566+0000","last_active":"2024-09-19T15:32:48.196716+0000","last_peered":"2024-09-19T15:32:48.196716+0000","last_clean":"2024-09-19T15:32:48.196716+0000","last_became_active":"2024-09-19T14:29:51.029426+0000","last_became_peered":"2024-09-19T14:29:51.029426+0000","last_unstale":"2024-09-19T15:32:48.196716+0000","last_undegraded":"2024-09-19T15:32:48.196716+0000","last_fullsized":"2024-09-19T15:32:48.196716+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:48.196375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:48.196375+0000","last_clean_scrub_stamp":"2024-09-19T15:32:48.196375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:05.106052+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"268'3","reported_seq":81,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:43.121698+0000","last_change":"2024-09-19T15:32:43.121503+0000","last_active":"2024-09-19T15:32:43.121698+0000","last_peered":"2024-09-19T15:32:43.121698+0000","last_clean":"2024-09-19T15:32:43.121698+0000","last_became_active":"2024-09-19T14:02:37.052510+0000","last_became_peered":"2024-09-19T14:02:37.052510+0000","last_unstale":"2024-09-19T15:32:43.121698+0000","last_undegraded":"2024-09-19T15:32:43.121698+0000","last_fullsized":"2024-09-19T15:32:43.121698+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:43.121311+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:43.121311+0000","last_clean_scrub_stamp":"2024-09-19T15:32:43.121311+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:08:29.062586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:31.617464+0000","last_change":"2024-09-19T15:32:31.617464+0000","last_active":"2024-09-19T15:32:31.617464+0000","last_peered":"2024-09-19T15:32:31.617464+0000","last_clean":"2024-09-19T15:32:31.617464+0000","last_became_active":"2024-09-19T14:02:29.736074+0000","last_became_peered":"2024-09-19T14:02:29.736074+0000","last_unstale":"2024-09-19T15:32:31.617464+0000","last_undegraded":"2024-09-19T15:32:31.617464+0000","last_fullsized":"2024-09-19T15:32:31.617464+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:31.617280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:31.617280+0000","last_clean_scrub_stamp":"2024-09-19T15:32:31.617280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:22.537882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"268'63","reported_seq":252,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:34.062230+0000","last_change":"2024-09-19T15:32:34.062230+0000","last_active":"2024-09-19T15:32:34.062230+0000","last_peered":"2024-09-19T15:32:34.062230+0000","last_clean":"2024-09-19T15:32:34.062230+0000","last_became_active":"2024-09-19T13:56:23.179235+0000","last_became_peered":"2024-09-19T13:56:23.179235+0000","last_unstale":"2024-09-19T15:32:34.062230+0000","last_undegraded":"2024-09-19T15:32:34.062230+0000","last_fullsized":"2024-09-19T15:32:34.062230+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'63","last_scrub_stamp":"2024-09-19T15:32:34.062044+0000","last_deep_scrub":"268'63","last_deep_scrub_stamp":"2024-09-19T15:32:34.062044+0000","last_clean_scrub_stamp":"2024-09-19T15:32:34.062044+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:45.886522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":508,"num_read_kb":362,"num_write":155,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:49.174847+0000","last_change":"2024-09-19T15:32:49.174847+0000","last_active":"2024-09-19T15:32:49.174847+0000","last_peered":"2024-09-19T15:32:49.174847+0000","last_clean":"2024-09-19T15:32:49.174847+0000","last_became_active":"2024-09-19T14:29:51.052562+0000","last_became_peered":"2024-09-19T14:29:51.052562+0000","last_unstale":"2024-09-19T15:32:49.174847+0000","last_undegraded":"2024-09-19T15:32:49.174847+0000","last_fullsized":"2024-09-19T15:32:49.174847+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:49.174636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:49.174636+0000","last_clean_scrub_stamp":"2024-09-19T15:32:49.174636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:24:14.675190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"268'9","reported_seq":81,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:31.702673+0000","last_change":"2024-09-19T15:32:31.702673+0000","last_active":"2024-09-19T15:32:31.702673+0000","last_peered":"2024-09-19T15:32:31.702673+0000","last_clean":"2024-09-19T15:32:31.702673+0000","last_became_active":"2024-09-19T14:02:36.930344+0000","last_became_peered":"2024-09-19T14:02:36.930344+0000","last_unstale":"2024-09-19T15:32:31.702673+0000","last_undegraded":"2024-09-19T15:32:31.702673+0000","last_fullsized":"2024-09-19T15:32:31.702673+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'9","last_scrub_stamp":"2024-09-19T15:32:31.702490+0000","last_deep_scrub":"268'9","last_deep_scrub_stamp":"2024-09-19T15:32:31.702490+0000","last_clean_scrub_stamp":"2024-09-19T15:32:31.702490+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:53:04.502723+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8192,"num_write":19,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"268'8","reported_seq":94,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:33.530153+0000","last_change":"2024-09-19T15:32:33.530153+0000","last_active":"2024-09-19T15:32:33.530153+0000","last_peered":"2024-09-19T15:32:33.530153+0000","last_clean":"2024-09-19T15:32:33.530153+0000","last_became_active":"2024-09-19T14:02:29.740291+0000","last_became_peered":"2024-09-19T14:02:29.740291+0000","last_unstale":"2024-09-19T15:32:33.530153+0000","last_undegraded":"2024-09-19T15:32:33.530153+0000","last_fullsized":"2024-09-19T15:32:33.530153+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-19T15:32:33.529968+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-19T15:32:33.529968+0000","last_clean_scrub_stamp":"2024-09-19T15:32:33.529968+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:15:32.960769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"268'10","reported_seq":109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:33.092347+0000","last_change":"2024-09-19T15:32:33.092347+0000","last_active":"2024-09-19T15:32:33.092347+0000","last_peered":"2024-09-19T15:32:33.092347+0000","last_clean":"2024-09-19T15:32:33.092347+0000","last_became_active":"2024-09-19T13:56:23.169371+0000","last_became_peered":"2024-09-19T13:56:23.169371+0000","last_unstale":"2024-09-19T15:32:33.092347+0000","last_undegraded":"2024-09-19T15:32:33.092347+0000","last_fullsized":"2024-09-19T15:32:33.092347+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'10","last_scrub_stamp":"2024-09-19T15:32:33.092157+0000","last_deep_scrub":"268'10","last_deep_scrub_stamp":"2024-09-19T15:32:33.092157+0000","last_clean_scrub_stamp":"2024-09-19T15:32:33.092157+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:42.468925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":43,"num_write":27,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:27.746400+0000","last_change":"2024-09-19T15:32:27.746400+0000","last_active":"2024-09-19T15:32:27.746400+0000","last_peered":"2024-09-19T15:32:27.746400+0000","last_clean":"2024-09-19T15:32:27.746400+0000","last_became_active":"2024-09-19T14:29:51.049146+0000","last_became_peered":"2024-09-19T14:29:51.049146+0000","last_unstale":"2024-09-19T15:32:27.746400+0000","last_undegraded":"2024-09-19T15:32:27.746400+0000","last_fullsized":"2024-09-19T15:32:27.746400+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:27.746199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:27.746199+0000","last_clean_scrub_stamp":"2024-09-19T15:32:27.746199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:21:21.517262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:22.256761+0000","last_change":"2024-09-19T15:32:22.256761+0000","last_active":"2024-09-19T15:32:22.256761+0000","last_peered":"2024-09-19T15:32:22.256761+0000","last_clean":"2024-09-19T15:32:22.256761+0000","last_became_active":"2024-09-19T14:02:36.927382+0000","last_became_peered":"2024-09-19T14:02:36.927382+0000","last_unstale":"2024-09-19T15:32:22.256761+0000","last_undegraded":"2024-09-19T15:32:22.256761+0000","last_fullsized":"2024-09-19T15:32:22.256761+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:22.256572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:22.256572+0000","last_clean_scrub_stamp":"2024-09-19T15:32:22.256572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:39:31.563943+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"268'2","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:27.549816+0000","last_change":"2024-09-19T15:32:27.549816+0000","last_active":"2024-09-19T15:32:27.549816+0000","last_peered":"2024-09-19T15:32:27.549816+0000","last_clean":"2024-09-19T15:32:27.549816+0000","last_became_active":"2024-09-19T14:02:29.722193+0000","last_became_peered":"2024-09-19T14:02:29.722193+0000","last_unstale":"2024-09-19T15:32:27.549816+0000","last_undegraded":"2024-09-19T15:32:27.549816+0000","last_fullsized":"2024-09-19T15:32:27.549816+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:27.549627+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:27.549627+0000","last_clean_scrub_stamp":"2024-09-19T15:32:27.549627+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:17:01.030933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"268'21","reported_seq":138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:17.229517+0000","last_change":"2024-09-19T15:32:17.229517+0000","last_active":"2024-09-19T15:32:17.229517+0000","last_peered":"2024-09-19T15:32:17.229517+0000","last_clean":"2024-09-19T15:32:17.229517+0000","last_became_active":"2024-09-19T13:56:23.174511+0000","last_became_peered":"2024-09-19T13:56:23.174511+0000","last_unstale":"2024-09-19T15:32:17.229517+0000","last_undegraded":"2024-09-19T15:32:17.229517+0000","last_fullsized":"2024-09-19T15:32:17.229517+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'21","last_scrub_stamp":"2024-09-19T15:32:17.229340+0000","last_deep_scrub":"268'21","last_deep_scrub_stamp":"2024-09-19T15:32:17.229340+0000","last_clean_scrub_stamp":"2024-09-19T15:32:17.229340+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:46.598126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":102,"num_write":56,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"268'2","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:43.672691+0000","last_change":"2024-09-19T15:32:43.672691+0000","last_active":"2024-09-19T15:32:43.672691+0000","last_peered":"2024-09-19T15:32:43.672691+0000","last_clean":"2024-09-19T15:32:43.672691+0000","last_became_active":"2024-09-19T14:29:51.039919+0000","last_became_peered":"2024-09-19T14:29:51.039919+0000","last_unstale":"2024-09-19T15:32:43.672691+0000","last_undegraded":"2024-09-19T15:32:43.672691+0000","last_fullsized":"2024-09-19T15:32:43.672691+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:43.672499+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:43.672499+0000","last_clean_scrub_stamp":"2024-09-19T15:32:43.672499+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:14:56.522475+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"265'8","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:21.247929+0000","last_change":"2024-09-19T15:32:21.247760+0000","last_active":"2024-09-19T15:32:21.247929+0000","last_peered":"2024-09-19T15:32:21.247929+0000","last_clean":"2024-09-19T15:32:21.247929+0000","last_became_active":"2024-09-19T14:02:36.918707+0000","last_became_peered":"2024-09-19T14:02:36.918707+0000","last_unstale":"2024-09-19T15:32:21.247929+0000","last_undegraded":"2024-09-19T15:32:21.247929+0000","last_fullsized":"2024-09-19T15:32:21.247929+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-19T15:32:21.247546+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-19T15:32:21.247546+0000","last_clean_scrub_stamp":"2024-09-19T15:32:21.247546+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:16:01.540595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":9218,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:28.593171+0000","last_change":"2024-09-19T15:32:28.593004+0000","last_active":"2024-09-19T15:32:28.593171+0000","last_peered":"2024-09-19T15:32:28.593171+0000","last_clean":"2024-09-19T15:32:28.593171+0000","last_became_active":"2024-09-19T14:02:29.739955+0000","last_became_peered":"2024-09-19T14:02:29.739955+0000","last_unstale":"2024-09-19T15:32:28.593171+0000","last_undegraded":"2024-09-19T15:32:28.593171+0000","last_fullsized":"2024-09-19T15:32:28.593171+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:28.592827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:28.592827+0000","last_clean_scrub_stamp":"2024-09-19T15:32:28.592827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:55:18.092817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"268'12","reported_seq":115,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:28.452682+0000","last_change":"2024-09-19T15:32:28.452682+0000","last_active":"2024-09-19T15:32:28.452682+0000","last_peered":"2024-09-19T15:32:28.452682+0000","last_clean":"2024-09-19T15:32:28.452682+0000","last_became_active":"2024-09-19T13:56:23.170272+0000","last_became_peered":"2024-09-19T13:56:23.170272+0000","last_unstale":"2024-09-19T15:32:28.452682+0000","last_undegraded":"2024-09-19T15:32:28.452682+0000","last_fullsized":"2024-09-19T15:32:28.452682+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'12","last_scrub_stamp":"2024-09-19T15:32:28.452475+0000","last_deep_scrub":"268'12","last_deep_scrub_stamp":"2024-09-19T15:32:28.452475+0000","last_clean_scrub_stamp":"2024-09-19T15:32:28.452475+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:08:44.036993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":63,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:42.714403+0000","last_change":"2024-09-19T15:32:42.714403+0000","last_active":"2024-09-19T15:32:42.714403+0000","last_peered":"2024-09-19T15:32:42.714403+0000","last_clean":"2024-09-19T15:32:42.714403+0000","last_became_active":"2024-09-19T14:29:51.058380+0000","last_became_peered":"2024-09-19T14:29:51.058380+0000","last_unstale":"2024-09-19T15:32:42.714403+0000","last_undegraded":"2024-09-19T15:32:42.714403+0000","last_fullsized":"2024-09-19T15:32:42.714403+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:42.714174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:42.714174+0000","last_clean_scrub_stamp":"2024-09-19T15:32:42.714174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:14:42.519042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:46.176896+0000","last_change":"2024-09-19T15:32:46.176896+0000","last_active":"2024-09-19T15:32:46.176896+0000","last_peered":"2024-09-19T15:32:46.176896+0000","last_clean":"2024-09-19T15:32:46.176896+0000","last_became_active":"2024-09-19T14:02:36.924268+0000","last_became_peered":"2024-09-19T14:02:36.924268+0000","last_unstale":"2024-09-19T15:32:46.176896+0000","last_undegraded":"2024-09-19T15:32:46.176896+0000","last_fullsized":"2024-09-19T15:32:46.176896+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-19T15:32:46.176695+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-19T15:32:46.176695+0000","last_clean_scrub_stamp":"2024-09-19T15:32:46.176695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:33:40.196264+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"265'3","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:31.522793+0000","last_change":"2024-09-19T15:32:31.522554+0000","last_active":"2024-09-19T15:32:31.522793+0000","last_peered":"2024-09-19T15:32:31.522793+0000","last_clean":"2024-09-19T15:32:31.522793+0000","last_became_active":"2024-09-19T14:02:29.741114+0000","last_became_peered":"2024-09-19T14:02:29.741114+0000","last_unstale":"2024-09-19T15:32:31.522793+0000","last_undegraded":"2024-09-19T15:32:31.522793+0000","last_fullsized":"2024-09-19T15:32:31.522793+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-19T15:32:31.522329+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-19T15:32:31.522329+0000","last_clean_scrub_stamp":"2024-09-19T15:32:31.522329+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:17:31.739854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"268'44","reported_seq":201,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:15.627279+0000","last_change":"2024-09-19T15:32:15.627129+0000","last_active":"2024-09-19T15:32:15.627279+0000","last_peered":"2024-09-19T15:32:15.627279+0000","last_clean":"2024-09-19T15:32:15.627279+0000","last_became_active":"2024-09-19T13:56:23.177082+0000","last_became_peered":"2024-09-19T13:56:23.177082+0000","last_unstale":"2024-09-19T15:32:15.627279+0000","last_undegraded":"2024-09-19T15:32:15.627279+0000","last_fullsized":"2024-09-19T15:32:15.627279+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'44","last_scrub_stamp":"2024-09-19T15:32:15.626942+0000","last_deep_scrub":"268'44","last_deep_scrub_stamp":"2024-09-19T15:32:15.626942+0000","last_clean_scrub_stamp":"2024-09-19T15:32:15.626942+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:17:49.667859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":229,"num_write":111,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:28.724814+0000","last_change":"2024-09-19T15:32:28.724578+0000","last_active":"2024-09-19T15:32:28.724814+0000","last_peered":"2024-09-19T15:32:28.724814+0000","last_clean":"2024-09-19T15:32:28.724814+0000","last_became_active":"2024-09-19T14:29:51.036980+0000","last_became_peered":"2024-09-19T14:29:51.036980+0000","last_unstale":"2024-09-19T15:32:28.724814+0000","last_undegraded":"2024-09-19T15:32:28.724814+0000","last_fullsized":"2024-09-19T15:32:28.724814+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:28.724367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:28.724367+0000","last_clean_scrub_stamp":"2024-09-19T15:32:28.724367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:41:10.209734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:44.147359+0000","last_change":"2024-09-19T15:32:44.147359+0000","last_active":"2024-09-19T15:32:44.147359+0000","last_peered":"2024-09-19T15:32:44.147359+0000","last_clean":"2024-09-19T15:32:44.147359+0000","last_became_active":"2024-09-19T14:02:37.051627+0000","last_became_peered":"2024-09-19T14:02:37.051627+0000","last_unstale":"2024-09-19T15:32:44.147359+0000","last_undegraded":"2024-09-19T15:32:44.147359+0000","last_fullsized":"2024-09-19T15:32:44.147359+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:44.147177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:44.147177+0000","last_clean_scrub_stamp":"2024-09-19T15:32:44.147177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:42.489340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"268'10","reported_seq":95,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:29.676960+0000","last_change":"2024-09-19T15:32:29.676960+0000","last_active":"2024-09-19T15:32:29.676960+0000","last_peered":"2024-09-19T15:32:29.676960+0000","last_clean":"2024-09-19T15:32:29.676960+0000","last_became_active":"2024-09-19T14:02:29.725042+0000","last_became_peered":"2024-09-19T14:02:29.725042+0000","last_unstale":"2024-09-19T15:32:29.676960+0000","last_undegraded":"2024-09-19T15:32:29.676960+0000","last_fullsized":"2024-09-19T15:32:29.676960+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'10","last_scrub_stamp":"2024-09-19T15:32:29.676781+0000","last_deep_scrub":"268'10","last_deep_scrub_stamp":"2024-09-19T15:32:29.676781+0000","last_clean_scrub_stamp":"2024-09-19T15:32:29.676781+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:14.189291+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":17453,"num_write":15,"num_write_kb":14381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"268'39","reported_seq":189,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:26.488621+0000","last_change":"2024-09-19T15:32:26.488438+0000","last_active":"2024-09-19T15:32:26.488621+0000","last_peered":"2024-09-19T15:32:26.488621+0000","last_clean":"2024-09-19T15:32:26.488621+0000","last_became_active":"2024-09-19T13:56:23.179656+0000","last_became_peered":"2024-09-19T13:56:23.179656+0000","last_unstale":"2024-09-19T15:32:26.488621+0000","last_undegraded":"2024-09-19T15:32:26.488621+0000","last_fullsized":"2024-09-19T15:32:26.488621+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'39","last_scrub_stamp":"2024-09-19T15:32:26.488259+0000","last_deep_scrub":"268'39","last_deep_scrub_stamp":"2024-09-19T15:32:26.488259+0000","last_clean_scrub_stamp":"2024-09-19T15:32:26.488259+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:14:34.206551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":202,"num_write":114,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"268'2","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:15.053940+0000","last_change":"2024-09-19T15:32:15.053751+0000","last_active":"2024-09-19T15:32:15.053940+0000","last_peered":"2024-09-19T15:32:15.053940+0000","last_clean":"2024-09-19T15:32:15.053940+0000","last_became_active":"2024-09-19T14:29:51.034910+0000","last_became_peered":"2024-09-19T14:29:51.034910+0000","last_unstale":"2024-09-19T15:32:15.053940+0000","last_undegraded":"2024-09-19T15:32:15.053940+0000","last_fullsized":"2024-09-19T15:32:15.053940+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:15.053568+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:15.053568+0000","last_clean_scrub_stamp":"2024-09-19T15:32:15.053568+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:48:53.440303+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"268'5","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:41.079903+0000","last_change":"2024-09-19T15:32:41.079903+0000","last_active":"2024-09-19T15:32:41.079903+0000","last_peered":"2024-09-19T15:32:41.079903+0000","last_clean":"2024-09-19T15:32:41.079903+0000","last_became_active":"2024-09-19T14:02:37.049593+0000","last_became_peered":"2024-09-19T14:02:37.049593+0000","last_unstale":"2024-09-19T15:32:41.079903+0000","last_undegraded":"2024-09-19T15:32:41.079903+0000","last_fullsized":"2024-09-19T15:32:41.079903+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-19T15:32:41.079685+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-19T15:32:41.079685+0000","last_clean_scrub_stamp":"2024-09-19T15:32:41.079685+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:20.351275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":571,"num_write":10,"num_write_kb":5691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"268'7","reported_seq":87,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:32.621303+0000","last_change":"2024-09-19T15:32:32.621303+0000","last_active":"2024-09-19T15:32:32.621303+0000","last_peered":"2024-09-19T15:32:32.621303+0000","last_clean":"2024-09-19T15:32:32.621303+0000","last_became_active":"2024-09-19T14:02:29.737689+0000","last_became_peered":"2024-09-19T14:02:29.737689+0000","last_unstale":"2024-09-19T15:32:32.621303+0000","last_undegraded":"2024-09-19T15:32:32.621303+0000","last_fullsized":"2024-09-19T15:32:32.621303+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'7","last_scrub_stamp":"2024-09-19T15:32:32.621124+0000","last_deep_scrub":"268'7","last_deep_scrub_stamp":"2024-09-19T15:32:32.621124+0000","last_clean_scrub_stamp":"2024-09-19T15:32:32.621124+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:22:09.947066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5718,"num_write":7,"num_write_kb":5718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"268'32","reported_seq":168,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:32.053687+0000","last_change":"2024-09-19T15:32:32.053550+0000","last_active":"2024-09-19T15:32:32.053687+0000","last_peered":"2024-09-19T15:32:32.053687+0000","last_clean":"2024-09-19T15:32:32.053687+0000","last_became_active":"2024-09-19T13:56:23.172185+0000","last_became_peered":"2024-09-19T13:56:23.172185+0000","last_unstale":"2024-09-19T15:32:32.053687+0000","last_undegraded":"2024-09-19T15:32:32.053687+0000","last_fullsized":"2024-09-19T15:32:32.053687+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'32","last_scrub_stamp":"2024-09-19T15:32:32.053357+0000","last_deep_scrub":"268'32","last_deep_scrub_stamp":"2024-09-19T15:32:32.053357+0000","last_clean_scrub_stamp":"2024-09-19T15:32:32.053357+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:31:47.424078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":246,"num_read_kb":158,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:41.674029+0000","last_change":"2024-09-19T15:32:41.673897+0000","last_active":"2024-09-19T15:32:41.674029+0000","last_peered":"2024-09-19T15:32:41.674029+0000","last_clean":"2024-09-19T15:32:41.674029+0000","last_became_active":"2024-09-19T14:29:51.039877+0000","last_became_peered":"2024-09-19T14:29:51.039877+0000","last_unstale":"2024-09-19T15:32:41.674029+0000","last_undegraded":"2024-09-19T15:32:41.674029+0000","last_fullsized":"2024-09-19T15:32:41.674029+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:41.673705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:41.673705+0000","last_clean_scrub_stamp":"2024-09-19T15:32:41.673705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:19.210506+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"268'11","reported_seq":90,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:42.121299+0000","last_change":"2024-09-19T15:32:42.121299+0000","last_active":"2024-09-19T15:32:42.121299+0000","last_peered":"2024-09-19T15:32:42.121299+0000","last_clean":"2024-09-19T15:32:42.121299+0000","last_became_active":"2024-09-19T14:02:37.055184+0000","last_became_peered":"2024-09-19T14:02:37.055184+0000","last_unstale":"2024-09-19T15:32:42.121299+0000","last_undegraded":"2024-09-19T15:32:42.121299+0000","last_fullsized":"2024-09-19T15:32:42.121299+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'11","last_scrub_stamp":"2024-09-19T15:32:42.121120+0000","last_deep_scrub":"268'11","last_deep_scrub_stamp":"2024-09-19T15:32:42.121120+0000","last_clean_scrub_stamp":"2024-09-19T15:32:42.121120+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:26:53.706311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":24576,"num_write":21,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"268'3","reported_seq":81,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:11.976816+0000","last_change":"2024-09-19T15:32:11.976816+0000","last_active":"2024-09-19T15:32:11.976816+0000","last_peered":"2024-09-19T15:32:11.976816+0000","last_clean":"2024-09-19T15:32:11.976816+0000","last_became_active":"2024-09-19T14:02:29.732063+0000","last_became_peered":"2024-09-19T14:02:29.732063+0000","last_unstale":"2024-09-19T15:32:11.976816+0000","last_undegraded":"2024-09-19T15:32:11.976816+0000","last_fullsized":"2024-09-19T15:32:11.976816+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:11.976624+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:11.976624+0000","last_clean_scrub_stamp":"2024-09-19T15:32:11.976624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:43:10.588819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"268'18","reported_seq":131,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.967980+0000","last_change":"2024-09-19T15:32:07.967647+0000","last_active":"2024-09-19T15:32:07.967980+0000","last_peered":"2024-09-19T15:32:07.967980+0000","last_clean":"2024-09-19T15:32:07.967980+0000","last_became_active":"2024-09-19T13:56:23.172998+0000","last_became_peered":"2024-09-19T13:56:23.172998+0000","last_unstale":"2024-09-19T15:32:07.967980+0000","last_undegraded":"2024-09-19T15:32:07.967980+0000","last_fullsized":"2024-09-19T15:32:07.967980+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'18","last_scrub_stamp":"2024-09-19T15:32:07.967355+0000","last_deep_scrub":"268'18","last_deep_scrub_stamp":"2024-09-19T15:32:07.967355+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.967355+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:41:09.208852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":101,"num_write":42,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:34.714184+0000","last_change":"2024-09-19T15:32:34.713917+0000","last_active":"2024-09-19T15:32:34.714184+0000","last_peered":"2024-09-19T15:32:34.714184+0000","last_clean":"2024-09-19T15:32:34.714184+0000","last_became_active":"2024-09-19T14:29:51.020277+0000","last_became_peered":"2024-09-19T14:29:51.020277+0000","last_unstale":"2024-09-19T15:32:34.714184+0000","last_undegraded":"2024-09-19T15:32:34.714184+0000","last_fullsized":"2024-09-19T15:32:34.714184+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:34.713712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:34.713712+0000","last_clean_scrub_stamp":"2024-09-19T15:32:34.713712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:44:20.099725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"268'3","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:33.608306+0000","last_change":"2024-09-19T15:32:33.608306+0000","last_active":"2024-09-19T15:32:33.608306+0000","last_peered":"2024-09-19T15:32:33.608306+0000","last_clean":"2024-09-19T15:32:33.608306+0000","last_became_active":"2024-09-19T14:02:36.915962+0000","last_became_peered":"2024-09-19T14:02:36.915962+0000","last_unstale":"2024-09-19T15:32:33.608306+0000","last_undegraded":"2024-09-19T15:32:33.608306+0000","last_fullsized":"2024-09-19T15:32:33.608306+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:33.608129+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:33.608129+0000","last_clean_scrub_stamp":"2024-09-19T15:32:33.608129+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:40.591218+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:32.510780+0000","last_change":"2024-09-19T15:32:32.510780+0000","last_active":"2024-09-19T15:32:32.510780+0000","last_peered":"2024-09-19T15:32:32.510780+0000","last_clean":"2024-09-19T15:32:32.510780+0000","last_became_active":"2024-09-19T14:02:29.741726+0000","last_became_peered":"2024-09-19T14:02:29.741726+0000","last_unstale":"2024-09-19T15:32:32.510780+0000","last_undegraded":"2024-09-19T15:32:32.510780+0000","last_fullsized":"2024-09-19T15:32:32.510780+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:32.510565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:32.510565+0000","last_clean_scrub_stamp":"2024-09-19T15:32:32.510565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:49:51.567588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"268'18","reported_seq":129,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:25.646726+0000","last_change":"2024-09-19T15:32:25.646726+0000","last_active":"2024-09-19T15:32:25.646726+0000","last_peered":"2024-09-19T15:32:25.646726+0000","last_clean":"2024-09-19T15:32:25.646726+0000","last_became_active":"2024-09-19T13:56:23.175483+0000","last_became_peered":"2024-09-19T13:56:23.175483+0000","last_unstale":"2024-09-19T15:32:25.646726+0000","last_undegraded":"2024-09-19T15:32:25.646726+0000","last_fullsized":"2024-09-19T15:32:25.646726+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'18","last_scrub_stamp":"2024-09-19T15:32:25.646546+0000","last_deep_scrub":"268'18","last_deep_scrub_stamp":"2024-09-19T15:32:25.646546+0000","last_clean_scrub_stamp":"2024-09-19T15:32:25.646546+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:43:11.573506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":81,"num_write":47,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:47.146644+0000","last_change":"2024-09-19T15:32:47.146644+0000","last_active":"2024-09-19T15:32:47.146644+0000","last_peered":"2024-09-19T15:32:47.146644+0000","last_clean":"2024-09-19T15:32:47.146644+0000","last_became_active":"2024-09-19T14:29:51.054440+0000","last_became_peered":"2024-09-19T14:29:51.054440+0000","last_unstale":"2024-09-19T15:32:47.146644+0000","last_undegraded":"2024-09-19T15:32:47.146644+0000","last_fullsized":"2024-09-19T15:32:47.146644+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:47.146451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:47.146451+0000","last_clean_scrub_stamp":"2024-09-19T15:32:47.146451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:49:07.597289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:24.733196+0000","last_change":"2024-09-19T15:32:24.733196+0000","last_active":"2024-09-19T15:32:24.733196+0000","last_peered":"2024-09-19T15:32:24.733196+0000","last_clean":"2024-09-19T15:32:24.733196+0000","last_became_active":"2024-09-19T14:02:36.917886+0000","last_became_peered":"2024-09-19T14:02:36.917886+0000","last_unstale":"2024-09-19T15:32:24.733196+0000","last_undegraded":"2024-09-19T15:32:24.733196+0000","last_fullsized":"2024-09-19T15:32:24.733196+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:24.733018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:24.733018+0000","last_clean_scrub_stamp":"2024-09-19T15:32:24.733018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:18:44.716865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"268'3","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:26.557957+0000","last_change":"2024-09-19T15:32:26.557957+0000","last_active":"2024-09-19T15:32:26.557957+0000","last_peered":"2024-09-19T15:32:26.557957+0000","last_clean":"2024-09-19T15:32:26.557957+0000","last_became_active":"2024-09-19T14:02:29.730095+0000","last_became_peered":"2024-09-19T14:02:29.730095+0000","last_unstale":"2024-09-19T15:32:26.557957+0000","last_undegraded":"2024-09-19T15:32:26.557957+0000","last_fullsized":"2024-09-19T15:32:26.557957+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:26.557775+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:26.557775+0000","last_clean_scrub_stamp":"2024-09-19T15:32:26.557775+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:20:23.909493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"268'29","reported_seq":157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:26.672788+0000","last_change":"2024-09-19T15:32:26.672788+0000","last_active":"2024-09-19T15:32:26.672788+0000","last_peered":"2024-09-19T15:32:26.672788+0000","last_clean":"2024-09-19T15:32:26.672788+0000","last_became_active":"2024-09-19T13:56:23.183825+0000","last_became_peered":"2024-09-19T13:56:23.183825+0000","last_unstale":"2024-09-19T15:32:26.672788+0000","last_undegraded":"2024-09-19T15:32:26.672788+0000","last_fullsized":"2024-09-19T15:32:26.672788+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'29","last_scrub_stamp":"2024-09-19T15:32:26.672589+0000","last_deep_scrub":"268'29","last_deep_scrub_stamp":"2024-09-19T15:32:26.672589+0000","last_clean_scrub_stamp":"2024-09-19T15:32:26.672589+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:27.804236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":139,"num_write":76,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:43.556229+0000","last_change":"2024-09-19T15:32:43.556229+0000","last_active":"2024-09-19T15:32:43.556229+0000","last_peered":"2024-09-19T15:32:43.556229+0000","last_clean":"2024-09-19T15:32:43.556229+0000","last_became_active":"2024-09-19T14:29:51.036062+0000","last_became_peered":"2024-09-19T14:29:51.036062+0000","last_unstale":"2024-09-19T15:32:43.556229+0000","last_undegraded":"2024-09-19T15:32:43.556229+0000","last_fullsized":"2024-09-19T15:32:43.556229+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:43.556048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:43.556048+0000","last_clean_scrub_stamp":"2024-09-19T15:32:43.556048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:36.925510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"265'3","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:25.742701+0000","last_change":"2024-09-19T15:32:25.742701+0000","last_active":"2024-09-19T15:32:25.742701+0000","last_peered":"2024-09-19T15:32:25.742701+0000","last_clean":"2024-09-19T15:32:25.742701+0000","last_became_active":"2024-09-19T14:02:36.910298+0000","last_became_peered":"2024-09-19T14:02:36.910298+0000","last_unstale":"2024-09-19T15:32:25.742701+0000","last_undegraded":"2024-09-19T15:32:25.742701+0000","last_fullsized":"2024-09-19T15:32:25.742701+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-19T15:32:25.742469+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-19T15:32:25.742469+0000","last_clean_scrub_stamp":"2024-09-19T15:32:25.742469+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:01.917327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"268'3","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:35.077489+0000","last_change":"2024-09-19T15:32:35.077489+0000","last_active":"2024-09-19T15:32:35.077489+0000","last_peered":"2024-09-19T15:32:35.077489+0000","last_clean":"2024-09-19T15:32:35.077489+0000","last_became_active":"2024-09-19T14:02:29.732413+0000","last_became_peered":"2024-09-19T14:02:29.732413+0000","last_unstale":"2024-09-19T15:32:35.077489+0000","last_undegraded":"2024-09-19T15:32:35.077489+0000","last_fullsized":"2024-09-19T15:32:35.077489+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:35.077297+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:35.077297+0000","last_clean_scrub_stamp":"2024-09-19T15:32:35.077297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:33:55.999488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"268'52","reported_seq":223,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:25.518320+0000","last_change":"2024-09-19T15:32:25.518320+0000","last_active":"2024-09-19T15:32:25.518320+0000","last_peered":"2024-09-19T15:32:25.518320+0000","last_clean":"2024-09-19T15:32:25.518320+0000","last_became_active":"2024-09-19T13:56:23.161268+0000","last_became_peered":"2024-09-19T13:56:23.161268+0000","last_unstale":"2024-09-19T15:32:25.518320+0000","last_undegraded":"2024-09-19T15:32:25.518320+0000","last_fullsized":"2024-09-19T15:32:25.518320+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'52","last_scrub_stamp":"2024-09-19T15:32:25.518067+0000","last_deep_scrub":"268'52","last_deep_scrub_stamp":"2024-09-19T15:32:25.518067+0000","last_clean_scrub_stamp":"2024-09-19T15:32:25.518067+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:01.595629+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":413,"num_read_kb":272,"num_write":131,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"268'2","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:40.584136+0000","last_change":"2024-09-19T15:32:40.584136+0000","last_active":"2024-09-19T15:32:40.584136+0000","last_peered":"2024-09-19T15:32:40.584136+0000","last_clean":"2024-09-19T15:32:40.584136+0000","last_became_active":"2024-09-19T14:29:51.055396+0000","last_became_peered":"2024-09-19T14:29:51.055396+0000","last_unstale":"2024-09-19T15:32:40.584136+0000","last_undegraded":"2024-09-19T15:32:40.584136+0000","last_fullsized":"2024-09-19T15:32:40.584136+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:40.583911+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:40.583911+0000","last_clean_scrub_stamp":"2024-09-19T15:32:40.583911+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:57.266184+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:39.159142+0000","last_change":"2024-09-19T15:32:39.159142+0000","last_active":"2024-09-19T15:32:39.159142+0000","last_peered":"2024-09-19T15:32:39.159142+0000","last_clean":"2024-09-19T15:32:39.159142+0000","last_became_active":"2024-09-19T14:02:36.926038+0000","last_became_peered":"2024-09-19T14:02:36.926038+0000","last_unstale":"2024-09-19T15:32:39.159142+0000","last_undegraded":"2024-09-19T15:32:39.159142+0000","last_fullsized":"2024-09-19T15:32:39.159142+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:39.158922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:39.158922+0000","last_clean_scrub_stamp":"2024-09-19T15:32:39.158922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:49:19.479414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"268'6","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:18.192988+0000","last_change":"2024-09-19T15:32:18.192988+0000","last_active":"2024-09-19T15:32:18.192988+0000","last_peered":"2024-09-19T15:32:18.192988+0000","last_clean":"2024-09-19T15:32:18.192988+0000","last_became_active":"2024-09-19T14:02:29.740451+0000","last_became_peered":"2024-09-19T14:02:29.740451+0000","last_unstale":"2024-09-19T15:32:18.192988+0000","last_undegraded":"2024-09-19T15:32:18.192988+0000","last_fullsized":"2024-09-19T15:32:18.192988+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-19T15:32:18.192767+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-19T15:32:18.192767+0000","last_clean_scrub_stamp":"2024-09-19T15:32:18.192767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:13:07.938345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"268'35","reported_seq":182,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:25.585607+0000","last_change":"2024-09-19T15:32:25.585607+0000","last_active":"2024-09-19T15:32:25.585607+0000","last_peered":"2024-09-19T15:32:25.585607+0000","last_clean":"2024-09-19T15:32:25.585607+0000","last_became_active":"2024-09-19T13:56:23.170486+0000","last_became_peered":"2024-09-19T13:56:23.170486+0000","last_unstale":"2024-09-19T15:32:25.585607+0000","last_undegraded":"2024-09-19T15:32:25.585607+0000","last_fullsized":"2024-09-19T15:32:25.585607+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'35","last_scrub_stamp":"2024-09-19T15:32:25.585436+0000","last_deep_scrub":"268'35","last_deep_scrub_stamp":"2024-09-19T15:32:25.585436+0000","last_clean_scrub_stamp":"2024-09-19T15:32:25.585436+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:57.333276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":278,"num_read_kb":196,"num_write":86,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"268'2","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:50.225295+0000","last_change":"2024-09-19T15:32:50.225295+0000","last_active":"2024-09-19T15:32:50.225295+0000","last_peered":"2024-09-19T15:32:50.225295+0000","last_clean":"2024-09-19T15:32:50.225295+0000","last_became_active":"2024-09-19T14:29:51.044154+0000","last_became_peered":"2024-09-19T14:29:51.044154+0000","last_unstale":"2024-09-19T15:32:50.225295+0000","last_undegraded":"2024-09-19T15:32:50.225295+0000","last_fullsized":"2024-09-19T15:32:50.225295+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:50.225108+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:50.225108+0000","last_clean_scrub_stamp":"2024-09-19T15:32:50.225108+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:18:43.928233+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"265'2","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:20.205390+0000","last_change":"2024-09-19T15:32:20.205390+0000","last_active":"2024-09-19T15:32:20.205390+0000","last_peered":"2024-09-19T15:32:20.205390+0000","last_clean":"2024-09-19T15:32:20.205390+0000","last_became_active":"2024-09-19T14:02:36.918735+0000","last_became_peered":"2024-09-19T14:02:36.918735+0000","last_unstale":"2024-09-19T15:32:20.205390+0000","last_undegraded":"2024-09-19T15:32:20.205390+0000","last_fullsized":"2024-09-19T15:32:20.205390+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-19T15:32:20.205204+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-19T15:32:20.205204+0000","last_clean_scrub_stamp":"2024-09-19T15:32:20.205204+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:58.167806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:28.629879+0000","last_change":"2024-09-19T15:32:28.629879+0000","last_active":"2024-09-19T15:32:28.629879+0000","last_peered":"2024-09-19T15:32:28.629879+0000","last_clean":"2024-09-19T15:32:28.629879+0000","last_became_active":"2024-09-19T14:02:29.742091+0000","last_became_peered":"2024-09-19T14:02:29.742091+0000","last_unstale":"2024-09-19T15:32:28.629879+0000","last_undegraded":"2024-09-19T15:32:28.629879+0000","last_fullsized":"2024-09-19T15:32:28.629879+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:28.629704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:28.629704+0000","last_clean_scrub_stamp":"2024-09-19T15:32:28.629704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:24.319951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"268'40","reported_seq":189,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:30.065215+0000","last_change":"2024-09-19T15:32:30.065215+0000","last_active":"2024-09-19T15:32:30.065215+0000","last_peered":"2024-09-19T15:32:30.065215+0000","last_clean":"2024-09-19T15:32:30.065215+0000","last_became_active":"2024-09-19T13:56:23.173245+0000","last_became_peered":"2024-09-19T13:56:23.173245+0000","last_unstale":"2024-09-19T15:32:30.065215+0000","last_undegraded":"2024-09-19T15:32:30.065215+0000","last_fullsized":"2024-09-19T15:32:30.065215+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'40","last_scrub_stamp":"2024-09-19T15:32:30.064995+0000","last_deep_scrub":"268'40","last_deep_scrub_stamp":"2024-09-19T15:32:30.064995+0000","last_clean_scrub_stamp":"2024-09-19T15:32:30.064995+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:50.398017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":315,"num_read_kb":214,"num_write":104,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:16.051607+0000","last_change":"2024-09-19T15:32:16.051373+0000","last_active":"2024-09-19T15:32:16.051607+0000","last_peered":"2024-09-19T15:32:16.051607+0000","last_clean":"2024-09-19T15:32:16.051607+0000","last_became_active":"2024-09-19T14:29:51.043979+0000","last_became_peered":"2024-09-19T14:29:51.043979+0000","last_unstale":"2024-09-19T15:32:16.051607+0000","last_undegraded":"2024-09-19T15:32:16.051607+0000","last_fullsized":"2024-09-19T15:32:16.051607+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:16.051172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:16.051172+0000","last_clean_scrub_stamp":"2024-09-19T15:32:16.051172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:17.401042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"268'2","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:40.123379+0000","last_change":"2024-09-19T15:32:40.123379+0000","last_active":"2024-09-19T15:32:40.123379+0000","last_peered":"2024-09-19T15:32:40.123379+0000","last_clean":"2024-09-19T15:32:40.123379+0000","last_became_active":"2024-09-19T14:02:36.925870+0000","last_became_peered":"2024-09-19T14:02:36.925870+0000","last_unstale":"2024-09-19T15:32:40.123379+0000","last_undegraded":"2024-09-19T15:32:40.123379+0000","last_fullsized":"2024-09-19T15:32:40.123379+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:40.123176+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:40.123176+0000","last_clean_scrub_stamp":"2024-09-19T15:32:40.123176+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:43.232032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:30.679996+0000","last_change":"2024-09-19T15:32:30.679848+0000","last_active":"2024-09-19T15:32:30.679996+0000","last_peered":"2024-09-19T15:32:30.679996+0000","last_clean":"2024-09-19T15:32:30.679996+0000","last_became_active":"2024-09-19T14:02:29.744169+0000","last_became_peered":"2024-09-19T14:02:29.744169+0000","last_unstale":"2024-09-19T15:32:30.679996+0000","last_undegraded":"2024-09-19T15:32:30.679996+0000","last_fullsized":"2024-09-19T15:32:30.679996+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:30.679657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:30.679657+0000","last_clean_scrub_stamp":"2024-09-19T15:32:30.679657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:01.300637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"268'31","reported_seq":175,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:31.026315+0000","last_change":"2024-09-19T15:32:31.026315+0000","last_active":"2024-09-19T15:32:31.026315+0000","last_peered":"2024-09-19T15:32:31.026315+0000","last_clean":"2024-09-19T15:32:31.026315+0000","last_became_active":"2024-09-19T13:56:23.160134+0000","last_became_peered":"2024-09-19T13:56:23.160134+0000","last_unstale":"2024-09-19T15:32:31.026315+0000","last_undegraded":"2024-09-19T15:32:31.026315+0000","last_fullsized":"2024-09-19T15:32:31.026315+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'31","last_scrub_stamp":"2024-09-19T15:32:31.026123+0000","last_deep_scrub":"268'31","last_deep_scrub_stamp":"2024-09-19T15:32:31.026123+0000","last_clean_scrub_stamp":"2024-09-19T15:32:31.026123+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:05.378989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":163,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:39.643718+0000","last_change":"2024-09-19T15:32:39.643549+0000","last_active":"2024-09-19T15:32:39.643718+0000","last_peered":"2024-09-19T15:32:39.643718+0000","last_clean":"2024-09-19T15:32:39.643718+0000","last_became_active":"2024-09-19T14:29:51.058494+0000","last_became_peered":"2024-09-19T14:29:51.058494+0000","last_unstale":"2024-09-19T15:32:39.643718+0000","last_undegraded":"2024-09-19T15:32:39.643718+0000","last_fullsized":"2024-09-19T15:32:39.643718+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:39.643359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:39.643359+0000","last_clean_scrub_stamp":"2024-09-19T15:32:39.643359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:27:36.743956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":71,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:37.158672+0000","last_change":"2024-09-19T15:32:37.158511+0000","last_active":"2024-09-19T15:32:37.158672+0000","last_peered":"2024-09-19T15:32:37.158672+0000","last_clean":"2024-09-19T15:32:37.158672+0000","last_became_active":"2024-09-19T14:02:36.924213+0000","last_became_peered":"2024-09-19T14:02:36.924213+0000","last_unstale":"2024-09-19T15:32:37.158672+0000","last_undegraded":"2024-09-19T15:32:37.158672+0000","last_fullsized":"2024-09-19T15:32:37.158672+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:37.158332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:37.158332+0000","last_clean_scrub_stamp":"2024-09-19T15:32:37.158332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:28.555804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:10.946903+0000","last_change":"2024-09-19T15:32:10.946761+0000","last_active":"2024-09-19T15:32:10.946903+0000","last_peered":"2024-09-19T15:32:10.946903+0000","last_clean":"2024-09-19T15:32:10.946903+0000","last_became_active":"2024-09-19T14:02:29.751229+0000","last_became_peered":"2024-09-19T14:02:29.751229+0000","last_unstale":"2024-09-19T15:32:10.946903+0000","last_undegraded":"2024-09-19T15:32:10.946903+0000","last_fullsized":"2024-09-19T15:32:10.946903+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:10.946572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:10.946572+0000","last_clean_scrub_stamp":"2024-09-19T15:32:10.946572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:11:22.828742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"268'30","reported_seq":165,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:26.587769+0000","last_change":"2024-09-19T15:32:26.587599+0000","last_active":"2024-09-19T15:32:26.587769+0000","last_peered":"2024-09-19T15:32:26.587769+0000","last_clean":"2024-09-19T15:32:26.587769+0000","last_became_active":"2024-09-19T13:56:23.166406+0000","last_became_peered":"2024-09-19T13:56:23.166406+0000","last_unstale":"2024-09-19T15:32:26.587769+0000","last_undegraded":"2024-09-19T15:32:26.587769+0000","last_fullsized":"2024-09-19T15:32:26.587769+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-09-19T15:32:26.587412+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-09-19T15:32:26.587412+0000","last_clean_scrub_stamp":"2024-09-19T15:32:26.587412+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:39:35.546888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":158,"num_write":72,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:23.251292+0000","last_change":"2024-09-19T15:32:23.251155+0000","last_active":"2024-09-19T15:32:23.251292+0000","last_peered":"2024-09-19T15:32:23.251292+0000","last_clean":"2024-09-19T15:32:23.251292+0000","last_became_active":"2024-09-19T14:29:51.050808+0000","last_became_peered":"2024-09-19T14:29:51.050808+0000","last_unstale":"2024-09-19T15:32:23.251292+0000","last_undegraded":"2024-09-19T15:32:23.251292+0000","last_fullsized":"2024-09-19T15:32:23.251292+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:23.250978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:23.250978+0000","last_clean_scrub_stamp":"2024-09-19T15:32:23.250978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:49:49.918319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"268'3","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:23.728904+0000","last_change":"2024-09-19T15:32:23.728755+0000","last_active":"2024-09-19T15:32:23.728904+0000","last_peered":"2024-09-19T15:32:23.728904+0000","last_clean":"2024-09-19T15:32:23.728904+0000","last_became_active":"2024-09-19T14:02:37.052121+0000","last_became_peered":"2024-09-19T14:02:37.052121+0000","last_unstale":"2024-09-19T15:32:23.728904+0000","last_undegraded":"2024-09-19T15:32:23.728904+0000","last_fullsized":"2024-09-19T15:32:23.728904+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:23.728572+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:23.728572+0000","last_clean_scrub_stamp":"2024-09-19T15:32:23.728572+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:41:47.058406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:37.552909+0000","last_change":"2024-09-19T15:32:37.552909+0000","last_active":"2024-09-19T15:32:37.552909+0000","last_peered":"2024-09-19T15:32:37.552909+0000","last_clean":"2024-09-19T15:32:37.552909+0000","last_became_active":"2024-09-19T14:02:29.748469+0000","last_became_peered":"2024-09-19T14:02:29.748469+0000","last_unstale":"2024-09-19T15:32:37.552909+0000","last_undegraded":"2024-09-19T15:32:37.552909+0000","last_fullsized":"2024-09-19T15:32:37.552909+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:37.552705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:37.552705+0000","last_clean_scrub_stamp":"2024-09-19T15:32:37.552705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:42.447761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"268'120","reported_seq":449,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:15.142073+0000","last_change":"2024-09-19T15:32:15.141891+0000","last_active":"2024-09-19T15:32:15.142073+0000","last_peered":"2024-09-19T15:32:15.142073+0000","last_clean":"2024-09-19T15:32:15.142073+0000","last_became_active":"2024-09-19T13:56:23.164737+0000","last_became_peered":"2024-09-19T13:56:23.164737+0000","last_unstale":"2024-09-19T15:32:15.142073+0000","last_undegraded":"2024-09-19T15:32:15.142073+0000","last_fullsized":"2024-09-19T15:32:15.142073+0000","mapping_epoch":255,"log_start":"265'100","ondisk_log_start":"265'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'120","last_scrub_stamp":"2024-09-19T15:32:15.141719+0000","last_deep_scrub":"268'120","last_deep_scrub_stamp":"2024-09-19T15:32:15.141719+0000","last_clean_scrub_stamp":"2024-09-19T15:32:15.141719+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:28:48.051613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1135,"num_read_kb":1191,"num_write":240,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:38.686946+0000","last_change":"2024-09-19T15:32:38.686790+0000","last_active":"2024-09-19T15:32:38.686946+0000","last_peered":"2024-09-19T15:32:38.686946+0000","last_clean":"2024-09-19T15:32:38.686946+0000","last_became_active":"2024-09-19T14:29:51.022975+0000","last_became_peered":"2024-09-19T14:29:51.022975+0000","last_unstale":"2024-09-19T15:32:38.686946+0000","last_undegraded":"2024-09-19T15:32:38.686946+0000","last_fullsized":"2024-09-19T15:32:38.686946+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:38.686607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:38.686607+0000","last_clean_scrub_stamp":"2024-09-19T15:32:38.686607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:05:07.434958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"268'3","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:38.133951+0000","last_change":"2024-09-19T15:32:38.133951+0000","last_active":"2024-09-19T15:32:38.133951+0000","last_peered":"2024-09-19T15:32:38.133951+0000","last_clean":"2024-09-19T15:32:38.133951+0000","last_became_active":"2024-09-19T14:02:36.924349+0000","last_became_peered":"2024-09-19T14:02:36.924349+0000","last_unstale":"2024-09-19T15:32:38.133951+0000","last_undegraded":"2024-09-19T15:32:38.133951+0000","last_fullsized":"2024-09-19T15:32:38.133951+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:38.133755+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:38.133755+0000","last_clean_scrub_stamp":"2024-09-19T15:32:38.133755+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:46:31.285098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":77,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:18.662409+0000","last_change":"2024-09-19T15:32:18.662215+0000","last_active":"2024-09-19T15:32:18.662409+0000","last_peered":"2024-09-19T15:32:18.662409+0000","last_clean":"2024-09-19T15:32:18.662409+0000","last_became_active":"2024-09-19T14:02:29.730280+0000","last_became_peered":"2024-09-19T14:02:29.730280+0000","last_unstale":"2024-09-19T15:32:18.662409+0000","last_undegraded":"2024-09-19T15:32:18.662409+0000","last_fullsized":"2024-09-19T15:32:18.662409+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:18.662024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:18.662024+0000","last_clean_scrub_stamp":"2024-09-19T15:32:18.662024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:44:59.899540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"268'28","reported_seq":158,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.948987+0000","last_change":"2024-09-19T15:32:05.948745+0000","last_active":"2024-09-19T15:32:05.948987+0000","last_peered":"2024-09-19T15:32:05.948987+0000","last_clean":"2024-09-19T15:32:05.948987+0000","last_became_active":"2024-09-19T13:56:23.182103+0000","last_became_peered":"2024-09-19T13:56:23.182103+0000","last_unstale":"2024-09-19T15:32:05.948987+0000","last_undegraded":"2024-09-19T15:32:05.948987+0000","last_fullsized":"2024-09-19T15:32:05.948987+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'28","last_scrub_stamp":"2024-09-19T15:32:05.948526+0000","last_deep_scrub":"268'28","last_deep_scrub_stamp":"2024-09-19T15:32:05.948526+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.948526+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:07:24.807541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":141,"num_write":72,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:45.140369+0000","last_change":"2024-09-19T15:32:45.140217+0000","last_active":"2024-09-19T15:32:45.140369+0000","last_peered":"2024-09-19T15:32:45.140369+0000","last_clean":"2024-09-19T15:32:45.140369+0000","last_became_active":"2024-09-19T14:29:51.030200+0000","last_became_peered":"2024-09-19T14:29:51.030200+0000","last_unstale":"2024-09-19T15:32:45.140369+0000","last_undegraded":"2024-09-19T15:32:45.140369+0000","last_fullsized":"2024-09-19T15:32:45.140369+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:45.139998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:45.139998+0000","last_clean_scrub_stamp":"2024-09-19T15:32:45.139998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:32:20.371590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"265'3","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:32.649348+0000","last_change":"2024-09-19T15:32:32.649348+0000","last_active":"2024-09-19T15:32:32.649348+0000","last_peered":"2024-09-19T15:32:32.649348+0000","last_clean":"2024-09-19T15:32:32.649348+0000","last_became_active":"2024-09-19T14:02:36.927585+0000","last_became_peered":"2024-09-19T14:02:36.927585+0000","last_unstale":"2024-09-19T15:32:32.649348+0000","last_undegraded":"2024-09-19T15:32:32.649348+0000","last_fullsized":"2024-09-19T15:32:32.649348+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-19T15:32:32.649116+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-19T15:32:32.649116+0000","last_clean_scrub_stamp":"2024-09-19T15:32:32.649116+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:17.633779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"265'5","reported_seq":93,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:30.538560+0000","last_change":"2024-09-19T15:32:30.538560+0000","last_active":"2024-09-19T15:32:30.538560+0000","last_peered":"2024-09-19T15:32:30.538560+0000","last_clean":"2024-09-19T15:32:30.538560+0000","last_became_active":"2024-09-19T14:02:29.739469+0000","last_became_peered":"2024-09-19T14:02:29.739469+0000","last_unstale":"2024-09-19T15:32:30.538560+0000","last_undegraded":"2024-09-19T15:32:30.538560+0000","last_fullsized":"2024-09-19T15:32:30.538560+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-19T15:32:30.538365+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-19T15:32:30.538365+0000","last_clean_scrub_stamp":"2024-09-19T15:32:30.538365+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:27:11.791134+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"268'26","reported_seq":153,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:23.573569+0000","last_change":"2024-09-19T15:32:23.573569+0000","last_active":"2024-09-19T15:32:23.573569+0000","last_peered":"2024-09-19T15:32:23.573569+0000","last_clean":"2024-09-19T15:32:23.573569+0000","last_became_active":"2024-09-19T13:56:23.170897+0000","last_became_peered":"2024-09-19T13:56:23.170897+0000","last_unstale":"2024-09-19T15:32:23.573569+0000","last_undegraded":"2024-09-19T15:32:23.573569+0000","last_fullsized":"2024-09-19T15:32:23.573569+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-09-19T15:32:23.573388+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-09-19T15:32:23.573388+0000","last_clean_scrub_stamp":"2024-09-19T15:32:23.573388+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:11:45.786011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":129,"num_write":67,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:44.668153+0000","last_change":"2024-09-19T15:32:44.667980+0000","last_active":"2024-09-19T15:32:44.668153+0000","last_peered":"2024-09-19T15:32:44.668153+0000","last_clean":"2024-09-19T15:32:44.668153+0000","last_became_active":"2024-09-19T14:29:51.046273+0000","last_became_peered":"2024-09-19T14:29:51.046273+0000","last_unstale":"2024-09-19T15:32:44.668153+0000","last_undegraded":"2024-09-19T15:32:44.668153+0000","last_fullsized":"2024-09-19T15:32:44.668153+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:44.667787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:44.667787+0000","last_clean_scrub_stamp":"2024-09-19T15:32:44.667787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:30:46.016522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"268'8","reported_seq":94,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:33.638753+0000","last_change":"2024-09-19T15:32:33.638753+0000","last_active":"2024-09-19T15:32:33.638753+0000","last_peered":"2024-09-19T15:32:33.638753+0000","last_clean":"2024-09-19T15:32:33.638753+0000","last_became_active":"2024-09-19T14:02:37.050689+0000","last_became_peered":"2024-09-19T14:02:37.050689+0000","last_unstale":"2024-09-19T15:32:33.638753+0000","last_undegraded":"2024-09-19T15:32:33.638753+0000","last_fullsized":"2024-09-19T15:32:33.638753+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-19T15:32:33.638568+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-19T15:32:33.638568+0000","last_clean_scrub_stamp":"2024-09-19T15:32:33.638568+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:42:29.475536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32770,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"265'5","reported_seq":93,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:17.636019+0000","last_change":"2024-09-19T15:32:17.636019+0000","last_active":"2024-09-19T15:32:17.636019+0000","last_peered":"2024-09-19T15:32:17.636019+0000","last_clean":"2024-09-19T15:32:17.636019+0000","last_became_active":"2024-09-19T14:02:29.730624+0000","last_became_peered":"2024-09-19T14:02:29.730624+0000","last_unstale":"2024-09-19T15:32:17.636019+0000","last_undegraded":"2024-09-19T15:32:17.636019+0000","last_fullsized":"2024-09-19T15:32:17.636019+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-19T15:32:17.635821+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-19T15:32:17.635821+0000","last_clean_scrub_stamp":"2024-09-19T15:32:17.635821+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:32:00.090008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"268'5","reported_seq":99,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:24.596943+0000","last_change":"2024-09-19T15:32:24.596943+0000","last_active":"2024-09-19T15:32:24.596943+0000","last_peered":"2024-09-19T15:32:24.596943+0000","last_clean":"2024-09-19T15:32:24.596943+0000","last_became_active":"2024-09-19T13:56:23.181867+0000","last_became_peered":"2024-09-19T13:56:23.181867+0000","last_unstale":"2024-09-19T15:32:24.596943+0000","last_undegraded":"2024-09-19T15:32:24.596943+0000","last_fullsized":"2024-09-19T15:32:24.596943+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-19T15:32:24.596657+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-19T15:32:24.596657+0000","last_clean_scrub_stamp":"2024-09-19T15:32:24.596657+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:15.545868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"268'2","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:40.664842+0000","last_change":"2024-09-19T15:32:40.664673+0000","last_active":"2024-09-19T15:32:40.664842+0000","last_peered":"2024-09-19T15:32:40.664842+0000","last_clean":"2024-09-19T15:32:40.664842+0000","last_became_active":"2024-09-19T14:29:51.036292+0000","last_became_peered":"2024-09-19T14:29:51.036292+0000","last_unstale":"2024-09-19T15:32:40.664842+0000","last_undegraded":"2024-09-19T15:32:40.664842+0000","last_fullsized":"2024-09-19T15:32:40.664842+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:40.664491+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:40.664491+0000","last_clean_scrub_stamp":"2024-09-19T15:32:40.664491+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:45:12.303499+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"268'2","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:22.708402+0000","last_change":"2024-09-19T15:32:22.708237+0000","last_active":"2024-09-19T15:32:22.708402+0000","last_peered":"2024-09-19T15:32:22.708402+0000","last_clean":"2024-09-19T15:32:22.708402+0000","last_became_active":"2024-09-19T14:02:36.923500+0000","last_became_peered":"2024-09-19T14:02:36.923500+0000","last_unstale":"2024-09-19T15:32:22.708402+0000","last_undegraded":"2024-09-19T15:32:22.708402+0000","last_fullsized":"2024-09-19T15:32:22.708402+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:22.708046+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:22.708046+0000","last_clean_scrub_stamp":"2024-09-19T15:32:22.708046+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:52:30.468832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"268'3","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:36.560160+0000","last_change":"2024-09-19T15:32:36.560160+0000","last_active":"2024-09-19T15:32:36.560160+0000","last_peered":"2024-09-19T15:32:36.560160+0000","last_clean":"2024-09-19T15:32:36.560160+0000","last_became_active":"2024-09-19T14:02:29.746148+0000","last_became_peered":"2024-09-19T14:02:29.746148+0000","last_unstale":"2024-09-19T15:32:36.560160+0000","last_undegraded":"2024-09-19T15:32:36.560160+0000","last_fullsized":"2024-09-19T15:32:36.560160+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:36.559969+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:36.559969+0000","last_clean_scrub_stamp":"2024-09-19T15:32:36.559969+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:17.830022+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"268'41","reported_seq":196,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:29.057381+0000","last_change":"2024-09-19T15:32:29.057381+0000","last_active":"2024-09-19T15:32:29.057381+0000","last_peered":"2024-09-19T15:32:29.057381+0000","last_clean":"2024-09-19T15:32:29.057381+0000","last_became_active":"2024-09-19T13:56:23.173918+0000","last_became_peered":"2024-09-19T13:56:23.173918+0000","last_unstale":"2024-09-19T15:32:29.057381+0000","last_undegraded":"2024-09-19T15:32:29.057381+0000","last_fullsized":"2024-09-19T15:32:29.057381+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'41","last_scrub_stamp":"2024-09-19T15:32:29.057205+0000","last_deep_scrub":"268'41","last_deep_scrub_stamp":"2024-09-19T15:32:29.057205+0000","last_clean_scrub_stamp":"2024-09-19T15:32:29.057205+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:02:25.994176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":206,"num_write":101,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:42.598674+0000","last_change":"2024-09-19T15:32:42.598398+0000","last_active":"2024-09-19T15:32:42.598674+0000","last_peered":"2024-09-19T15:32:42.598674+0000","last_clean":"2024-09-19T15:32:42.598674+0000","last_became_active":"2024-09-19T14:29:51.033329+0000","last_became_peered":"2024-09-19T14:29:51.033329+0000","last_unstale":"2024-09-19T15:32:42.598674+0000","last_undegraded":"2024-09-19T15:32:42.598674+0000","last_fullsized":"2024-09-19T15:32:42.598674+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:42.598180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:42.598180+0000","last_clean_scrub_stamp":"2024-09-19T15:32:42.598180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:45.690961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"265'5","reported_seq":88,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:35.582690+0000","last_change":"2024-09-19T15:32:35.582690+0000","last_active":"2024-09-19T15:32:35.582690+0000","last_peered":"2024-09-19T15:32:35.582690+0000","last_clean":"2024-09-19T15:32:35.582690+0000","last_became_active":"2024-09-19T14:03:07.395844+0000","last_became_peered":"2024-09-19T14:03:07.395844+0000","last_unstale":"2024-09-19T15:32:35.582690+0000","last_undegraded":"2024-09-19T15:32:35.582690+0000","last_fullsized":"2024-09-19T15:32:35.582690+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-19T15:32:35.582501+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-19T15:32:35.582501+0000","last_clean_scrub_stamp":"2024-09-19T15:32:35.582501+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:14.722286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5147,"num_write":5,"num_write_kb":5147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"265'3","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:24.563821+0000","last_change":"2024-09-19T15:32:24.563688+0000","last_active":"2024-09-19T15:32:24.563821+0000","last_peered":"2024-09-19T15:32:24.563821+0000","last_clean":"2024-09-19T15:32:24.563821+0000","last_became_active":"2024-09-19T14:02:29.732416+0000","last_became_peered":"2024-09-19T14:02:29.732416+0000","last_unstale":"2024-09-19T15:32:24.563821+0000","last_undegraded":"2024-09-19T15:32:24.563821+0000","last_fullsized":"2024-09-19T15:32:24.563821+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-19T15:32:24.563464+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-19T15:32:24.563464+0000","last_clean_scrub_stamp":"2024-09-19T15:32:24.563464+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:52:11.908670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"268'38","reported_seq":196,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:14.109983+0000","last_change":"2024-09-19T15:32:14.109983+0000","last_active":"2024-09-19T15:32:14.109983+0000","last_peered":"2024-09-19T15:32:14.109983+0000","last_clean":"2024-09-19T15:32:14.109983+0000","last_became_active":"2024-09-19T13:56:23.172437+0000","last_became_peered":"2024-09-19T13:56:23.172437+0000","last_unstale":"2024-09-19T15:32:14.109983+0000","last_undegraded":"2024-09-19T15:32:14.109983+0000","last_fullsized":"2024-09-19T15:32:14.109983+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'38","last_scrub_stamp":"2024-09-19T15:32:14.109805+0000","last_deep_scrub":"268'38","last_deep_scrub_stamp":"2024-09-19T15:32:14.109805+0000","last_clean_scrub_stamp":"2024-09-19T15:32:14.109805+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:23.811311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":311,"num_read_kb":193,"num_write":96,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:37.642753+0000","last_change":"2024-09-19T15:32:37.642753+0000","last_active":"2024-09-19T15:32:37.642753+0000","last_peered":"2024-09-19T15:32:37.642753+0000","last_clean":"2024-09-19T15:32:37.642753+0000","last_became_active":"2024-09-19T14:29:51.036386+0000","last_became_peered":"2024-09-19T14:29:51.036386+0000","last_unstale":"2024-09-19T15:32:37.642753+0000","last_undegraded":"2024-09-19T15:32:37.642753+0000","last_fullsized":"2024-09-19T15:32:37.642753+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:37.642573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:37.642573+0000","last_clean_scrub_stamp":"2024-09-19T15:32:37.642573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:03:14.055263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:35.561835+0000","last_change":"2024-09-19T15:32:35.561694+0000","last_active":"2024-09-19T15:32:35.561835+0000","last_peered":"2024-09-19T15:32:35.561835+0000","last_clean":"2024-09-19T15:32:35.561835+0000","last_became_active":"2024-09-19T14:02:36.912757+0000","last_became_peered":"2024-09-19T14:02:36.912757+0000","last_unstale":"2024-09-19T15:32:35.561835+0000","last_undegraded":"2024-09-19T15:32:35.561835+0000","last_fullsized":"2024-09-19T15:32:35.561835+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:35.561510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:35.561510+0000","last_clean_scrub_stamp":"2024-09-19T15:32:35.561510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:43.017343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"268'3","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:29.660542+0000","last_change":"2024-09-19T15:32:29.660542+0000","last_active":"2024-09-19T15:32:29.660542+0000","last_peered":"2024-09-19T15:32:29.660542+0000","last_clean":"2024-09-19T15:32:29.660542+0000","last_became_active":"2024-09-19T14:02:29.725707+0000","last_became_peered":"2024-09-19T14:02:29.725707+0000","last_unstale":"2024-09-19T15:32:29.660542+0000","last_undegraded":"2024-09-19T15:32:29.660542+0000","last_fullsized":"2024-09-19T15:32:29.660542+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:29.660364+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:29.660364+0000","last_clean_scrub_stamp":"2024-09-19T15:32:29.660364+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:58:09.169652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"268'2","reported_seq":93,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:24.542932+0000","last_change":"2024-09-19T15:32:24.542932+0000","last_active":"2024-09-19T15:32:24.542932+0000","last_peered":"2024-09-19T15:32:24.542932+0000","last_clean":"2024-09-19T15:32:24.542932+0000","last_became_active":"2024-09-19T13:56:23.180518+0000","last_became_peered":"2024-09-19T13:56:23.180518+0000","last_unstale":"2024-09-19T15:32:24.542932+0000","last_undegraded":"2024-09-19T15:32:24.542932+0000","last_fullsized":"2024-09-19T15:32:24.542932+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:24.542742+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:24.542742+0000","last_clean_scrub_stamp":"2024-09-19T15:32:24.542742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:35.344874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:32.681946+0000","last_change":"2024-09-19T15:32:32.681946+0000","last_active":"2024-09-19T15:32:32.681946+0000","last_peered":"2024-09-19T15:32:32.681946+0000","last_clean":"2024-09-19T15:32:32.681946+0000","last_became_active":"2024-09-19T14:29:51.030021+0000","last_became_peered":"2024-09-19T14:29:51.030021+0000","last_unstale":"2024-09-19T15:32:32.681946+0000","last_undegraded":"2024-09-19T15:32:32.681946+0000","last_fullsized":"2024-09-19T15:32:32.681946+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:32.681775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:32.681775+0000","last_clean_scrub_stamp":"2024-09-19T15:32:32.681775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:15.511871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"265'3","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:34.539181+0000","last_change":"2024-09-19T15:32:34.539181+0000","last_active":"2024-09-19T15:32:34.539181+0000","last_peered":"2024-09-19T15:32:34.539181+0000","last_clean":"2024-09-19T15:32:34.539181+0000","last_became_active":"2024-09-19T14:02:37.051567+0000","last_became_peered":"2024-09-19T14:02:37.051567+0000","last_unstale":"2024-09-19T15:32:34.539181+0000","last_undegraded":"2024-09-19T15:32:34.539181+0000","last_fullsized":"2024-09-19T15:32:34.539181+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-19T15:32:34.538991+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-19T15:32:34.538991+0000","last_clean_scrub_stamp":"2024-09-19T15:32:34.538991+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:33:55.866556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:09.942600+0000","last_change":"2024-09-19T15:32:09.942445+0000","last_active":"2024-09-19T15:32:09.942600+0000","last_peered":"2024-09-19T15:32:09.942600+0000","last_clean":"2024-09-19T15:32:09.942600+0000","last_became_active":"2024-09-19T14:02:29.747539+0000","last_became_peered":"2024-09-19T14:02:29.747539+0000","last_unstale":"2024-09-19T15:32:09.942600+0000","last_undegraded":"2024-09-19T15:32:09.942600+0000","last_fullsized":"2024-09-19T15:32:09.942600+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:09.942261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:09.942261+0000","last_clean_scrub_stamp":"2024-09-19T15:32:09.942261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:10:00.802028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"268'12","reported_seq":118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:13.085399+0000","last_change":"2024-09-19T15:32:13.085399+0000","last_active":"2024-09-19T15:32:13.085399+0000","last_peered":"2024-09-19T15:32:13.085399+0000","last_clean":"2024-09-19T15:32:13.085399+0000","last_became_active":"2024-09-19T13:56:23.173882+0000","last_became_peered":"2024-09-19T13:56:23.173882+0000","last_unstale":"2024-09-19T15:32:13.085399+0000","last_undegraded":"2024-09-19T15:32:13.085399+0000","last_fullsized":"2024-09-19T15:32:13.085399+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'12","last_scrub_stamp":"2024-09-19T15:32:13.085210+0000","last_deep_scrub":"268'12","last_deep_scrub_stamp":"2024-09-19T15:32:13.085210+0000","last_clean_scrub_stamp":"2024-09-19T15:32:13.085210+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:08:01.896984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":61,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:26.783029+0000","last_change":"2024-09-19T15:32:26.783029+0000","last_active":"2024-09-19T15:32:26.783029+0000","last_peered":"2024-09-19T15:32:26.783029+0000","last_clean":"2024-09-19T15:32:26.783029+0000","last_became_active":"2024-09-19T14:29:51.049356+0000","last_became_peered":"2024-09-19T14:29:51.049356+0000","last_unstale":"2024-09-19T15:32:26.783029+0000","last_undegraded":"2024-09-19T15:32:26.783029+0000","last_fullsized":"2024-09-19T15:32:26.783029+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:26.782842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:26.782842+0000","last_clean_scrub_stamp":"2024-09-19T15:32:26.782842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:35:24.086928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"268'8","reported_seq":90,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:34.593438+0000","last_change":"2024-09-19T15:32:34.593438+0000","last_active":"2024-09-19T15:32:34.593438+0000","last_peered":"2024-09-19T15:32:34.593438+0000","last_clean":"2024-09-19T15:32:34.593438+0000","last_became_active":"2024-09-19T14:02:37.056814+0000","last_became_peered":"2024-09-19T14:02:37.056814+0000","last_unstale":"2024-09-19T15:32:34.593438+0000","last_undegraded":"2024-09-19T15:32:34.593438+0000","last_fullsized":"2024-09-19T15:32:34.593438+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-19T15:32:34.593248+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-19T15:32:34.593248+0000","last_clean_scrub_stamp":"2024-09-19T15:32:34.593248+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:13:26.005981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":18,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"0'0","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:27.609272+0000","last_change":"2024-09-19T15:32:27.609272+0000","last_active":"2024-09-19T15:32:27.609272+0000","last_peered":"2024-09-19T15:32:27.609272+0000","last_clean":"2024-09-19T15:32:27.609272+0000","last_became_active":"2024-09-19T14:02:29.723298+0000","last_became_peered":"2024-09-19T14:02:29.723298+0000","last_unstale":"2024-09-19T15:32:27.609272+0000","last_undegraded":"2024-09-19T15:32:27.609272+0000","last_fullsized":"2024-09-19T15:32:27.609272+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:27.609094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:27.609094+0000","last_clean_scrub_stamp":"2024-09-19T15:32:27.609094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:06.843611+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"265'20","reported_seq":143,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:23.617945+0000","last_change":"2024-09-19T15:32:23.617681+0000","last_active":"2024-09-19T15:32:23.617945+0000","last_peered":"2024-09-19T15:32:23.617945+0000","last_clean":"2024-09-19T15:32:23.617945+0000","last_became_active":"2024-09-19T13:56:23.189485+0000","last_became_peered":"2024-09-19T13:56:23.189485+0000","last_unstale":"2024-09-19T15:32:23.617945+0000","last_undegraded":"2024-09-19T15:32:23.617945+0000","last_fullsized":"2024-09-19T15:32:23.617945+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'20","last_scrub_stamp":"2024-09-19T15:32:23.617397+0000","last_deep_scrub":"265'20","last_deep_scrub_stamp":"2024-09-19T15:32:23.617397+0000","last_clean_scrub_stamp":"2024-09-19T15:32:23.617397+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:00.650819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":106,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:35.568472+0000","last_change":"2024-09-19T15:32:35.568472+0000","last_active":"2024-09-19T15:32:35.568472+0000","last_peered":"2024-09-19T15:32:35.568472+0000","last_clean":"2024-09-19T15:32:35.568472+0000","last_became_active":"2024-09-19T14:29:51.028866+0000","last_became_peered":"2024-09-19T14:29:51.028866+0000","last_unstale":"2024-09-19T15:32:35.568472+0000","last_undegraded":"2024-09-19T15:32:35.568472+0000","last_fullsized":"2024-09-19T15:32:35.568472+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:35.568286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:35.568286+0000","last_clean_scrub_stamp":"2024-09-19T15:32:35.568286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:29:34.283543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"268'5","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:30.651695+0000","last_change":"2024-09-19T15:32:30.651695+0000","last_active":"2024-09-19T15:32:30.651695+0000","last_peered":"2024-09-19T15:32:30.651695+0000","last_clean":"2024-09-19T15:32:30.651695+0000","last_became_active":"2024-09-19T14:02:36.916389+0000","last_became_peered":"2024-09-19T14:02:36.916389+0000","last_unstale":"2024-09-19T15:32:30.651695+0000","last_undegraded":"2024-09-19T15:32:30.651695+0000","last_fullsized":"2024-09-19T15:32:30.651695+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-19T15:32:30.651485+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-19T15:32:30.651485+0000","last_clean_scrub_stamp":"2024-09-19T15:32:30.651485+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:40.775239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12336,"num_write":5,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"268'8","reported_seq":94,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:31.655735+0000","last_change":"2024-09-19T15:32:31.655735+0000","last_active":"2024-09-19T15:32:31.655735+0000","last_peered":"2024-09-19T15:32:31.655735+0000","last_clean":"2024-09-19T15:32:31.655735+0000","last_became_active":"2024-09-19T14:02:29.740227+0000","last_became_peered":"2024-09-19T14:02:29.740227+0000","last_unstale":"2024-09-19T15:32:31.655735+0000","last_undegraded":"2024-09-19T15:32:31.655735+0000","last_fullsized":"2024-09-19T15:32:31.655735+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-19T15:32:31.655511+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-19T15:32:31.655511+0000","last_clean_scrub_stamp":"2024-09-19T15:32:31.655511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:21:30.577104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":9218,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"268'41","reported_seq":199,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:14.653040+0000","last_change":"2024-09-19T15:32:14.653040+0000","last_active":"2024-09-19T15:32:14.653040+0000","last_peered":"2024-09-19T15:32:14.653040+0000","last_clean":"2024-09-19T15:32:14.653040+0000","last_became_active":"2024-09-19T13:56:23.173938+0000","last_became_peered":"2024-09-19T13:56:23.173938+0000","last_unstale":"2024-09-19T15:32:14.653040+0000","last_undegraded":"2024-09-19T15:32:14.653040+0000","last_fullsized":"2024-09-19T15:32:14.653040+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'41","last_scrub_stamp":"2024-09-19T15:32:14.652854+0000","last_deep_scrub":"268'41","last_deep_scrub_stamp":"2024-09-19T15:32:14.652854+0000","last_clean_scrub_stamp":"2024-09-19T15:32:14.652854+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:00:20.171224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":330,"num_read_kb":229,"num_write":110,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"268'2","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:14.028613+0000","last_change":"2024-09-19T15:32:14.028442+0000","last_active":"2024-09-19T15:32:14.028613+0000","last_peered":"2024-09-19T15:32:14.028613+0000","last_clean":"2024-09-19T15:32:14.028613+0000","last_became_active":"2024-09-19T14:29:51.025959+0000","last_became_peered":"2024-09-19T14:29:51.025959+0000","last_unstale":"2024-09-19T15:32:14.028613+0000","last_undegraded":"2024-09-19T15:32:14.028613+0000","last_fullsized":"2024-09-19T15:32:14.028613+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:14.028271+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:14.028271+0000","last_clean_scrub_stamp":"2024-09-19T15:32:14.028271+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:28:00.080778+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:21.694777+0000","last_change":"2024-09-19T15:32:21.694777+0000","last_active":"2024-09-19T15:32:21.694777+0000","last_peered":"2024-09-19T15:32:21.694777+0000","last_clean":"2024-09-19T15:32:21.694777+0000","last_became_active":"2024-09-19T14:02:36.911804+0000","last_became_peered":"2024-09-19T14:02:36.911804+0000","last_unstale":"2024-09-19T15:32:21.694777+0000","last_undegraded":"2024-09-19T15:32:21.694777+0000","last_fullsized":"2024-09-19T15:32:21.694777+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:21.694597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:21.694597+0000","last_clean_scrub_stamp":"2024-09-19T15:32:21.694597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:52.219045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"268'8","reported_seq":98,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:27.646544+0000","last_change":"2024-09-19T15:32:27.646410+0000","last_active":"2024-09-19T15:32:27.646544+0000","last_peered":"2024-09-19T15:32:27.646544+0000","last_clean":"2024-09-19T15:32:27.646544+0000","last_became_active":"2024-09-19T14:02:29.747553+0000","last_became_peered":"2024-09-19T14:02:29.747553+0000","last_unstale":"2024-09-19T15:32:27.646544+0000","last_undegraded":"2024-09-19T15:32:27.646544+0000","last_fullsized":"2024-09-19T15:32:27.646544+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-19T15:32:27.646219+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-19T15:32:27.646219+0000","last_clean_scrub_stamp":"2024-09-19T15:32:27.646219+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:44:19.597519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":21504,"num_write":8,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"268'275","reported_seq":917,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:25.562184+0000","last_change":"2024-09-19T15:32:25.562184+0000","last_active":"2024-09-19T15:32:25.562184+0000","last_peered":"2024-09-19T15:32:25.562184+0000","last_clean":"2024-09-19T15:32:25.562184+0000","last_became_active":"2024-09-19T13:56:23.185522+0000","last_became_peered":"2024-09-19T13:56:23.185522+0000","last_unstale":"2024-09-19T15:32:25.562184+0000","last_undegraded":"2024-09-19T15:32:25.562184+0000","last_fullsized":"2024-09-19T15:32:25.562184+0000","mapping_epoch":255,"log_start":"265'200","ondisk_log_start":"265'200","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'275","last_scrub_stamp":"2024-09-19T15:32:25.561999+0000","last_deep_scrub":"268'275","last_deep_scrub_stamp":"2024-09-19T15:32:25.561999+0000","last_clean_scrub_stamp":"2024-09-19T15:32:25.561999+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:58.252254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2606,"num_read_kb":3112,"num_write":537,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:41.593057+0000","last_change":"2024-09-19T15:32:41.592917+0000","last_active":"2024-09-19T15:32:41.593057+0000","last_peered":"2024-09-19T15:32:41.593057+0000","last_clean":"2024-09-19T15:32:41.593057+0000","last_became_active":"2024-09-19T14:29:51.042287+0000","last_became_peered":"2024-09-19T14:29:51.042287+0000","last_unstale":"2024-09-19T15:32:41.593057+0000","last_undegraded":"2024-09-19T15:32:41.593057+0000","last_fullsized":"2024-09-19T15:32:41.593057+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:41.592731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:41.592731+0000","last_clean_scrub_stamp":"2024-09-19T15:32:41.592731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:15.791463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"268'3","reported_seq":81,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:30.694384+0000","last_change":"2024-09-19T15:32:30.694245+0000","last_active":"2024-09-19T15:32:30.694384+0000","last_peered":"2024-09-19T15:32:30.694384+0000","last_clean":"2024-09-19T15:32:30.694384+0000","last_became_active":"2024-09-19T14:02:36.912642+0000","last_became_peered":"2024-09-19T14:02:36.912642+0000","last_unstale":"2024-09-19T15:32:30.694384+0000","last_undegraded":"2024-09-19T15:32:30.694384+0000","last_fullsized":"2024-09-19T15:32:30.694384+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:32:30.694055+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:32:30.694055+0000","last_clean_scrub_stamp":"2024-09-19T15:32:30.694055+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:51:58.875029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":80,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:28.611834+0000","last_change":"2024-09-19T15:32:28.611834+0000","last_active":"2024-09-19T15:32:28.611834+0000","last_peered":"2024-09-19T15:32:28.611834+0000","last_clean":"2024-09-19T15:32:28.611834+0000","last_became_active":"2024-09-19T14:02:29.739397+0000","last_became_peered":"2024-09-19T14:02:29.739397+0000","last_unstale":"2024-09-19T15:32:28.611834+0000","last_undegraded":"2024-09-19T15:32:28.611834+0000","last_fullsized":"2024-09-19T15:32:28.611834+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:28.611644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:28.611644+0000","last_clean_scrub_stamp":"2024-09-19T15:32:28.611644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:34.176899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"268'26","reported_seq":164,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:23.513521+0000","last_change":"2024-09-19T15:32:23.513521+0000","last_active":"2024-09-19T15:32:23.513521+0000","last_peered":"2024-09-19T15:32:23.513521+0000","last_clean":"2024-09-19T15:32:23.513521+0000","last_became_active":"2024-09-19T13:56:23.178722+0000","last_became_peered":"2024-09-19T13:56:23.178722+0000","last_unstale":"2024-09-19T15:32:23.513521+0000","last_undegraded":"2024-09-19T15:32:23.513521+0000","last_fullsized":"2024-09-19T15:32:23.513521+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-09-19T15:32:23.513292+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-09-19T15:32:23.513292+0000","last_clean_scrub_stamp":"2024-09-19T15:32:23.513292+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:23.938059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":137,"num_write":65,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:38.518914+0000","last_change":"2024-09-19T15:32:38.518914+0000","last_active":"2024-09-19T15:32:38.518914+0000","last_peered":"2024-09-19T15:32:38.518914+0000","last_clean":"2024-09-19T15:32:38.518914+0000","last_became_active":"2024-09-19T14:29:51.037398+0000","last_became_peered":"2024-09-19T14:29:51.037398+0000","last_unstale":"2024-09-19T15:32:38.518914+0000","last_undegraded":"2024-09-19T15:32:38.518914+0000","last_fullsized":"2024-09-19T15:32:38.518914+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:38.518733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:38.518733+0000","last_clean_scrub_stamp":"2024-09-19T15:32:38.518733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:26:28.980306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":74,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:19.232551+0000","last_change":"2024-09-19T15:32:19.232551+0000","last_active":"2024-09-19T15:32:19.232551+0000","last_peered":"2024-09-19T15:32:19.232551+0000","last_clean":"2024-09-19T15:32:19.232551+0000","last_became_active":"2024-09-19T14:02:36.928598+0000","last_became_peered":"2024-09-19T14:02:36.928598+0000","last_unstale":"2024-09-19T15:32:19.232551+0000","last_undegraded":"2024-09-19T15:32:19.232551+0000","last_fullsized":"2024-09-19T15:32:19.232551+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:19.232356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:19.232356+0000","last_clean_scrub_stamp":"2024-09-19T15:32:19.232356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:27:19.465367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"268'2","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:19.690478+0000","last_change":"2024-09-19T15:32:19.690478+0000","last_active":"2024-09-19T15:32:19.690478+0000","last_peered":"2024-09-19T15:32:19.690478+0000","last_clean":"2024-09-19T15:32:19.690478+0000","last_became_active":"2024-09-19T14:02:29.737082+0000","last_became_peered":"2024-09-19T14:02:29.737082+0000","last_unstale":"2024-09-19T15:32:19.690478+0000","last_undegraded":"2024-09-19T15:32:19.690478+0000","last_fullsized":"2024-09-19T15:32:19.690478+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:19.690288+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:19.690288+0000","last_clean_scrub_stamp":"2024-09-19T15:32:19.690288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:59:41.042363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"268'51","reported_seq":231,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:12.092894+0000","last_change":"2024-09-19T15:32:12.092747+0000","last_active":"2024-09-19T15:32:12.092894+0000","last_peered":"2024-09-19T15:32:12.092894+0000","last_clean":"2024-09-19T15:32:12.092894+0000","last_became_active":"2024-09-19T13:56:23.173172+0000","last_became_peered":"2024-09-19T13:56:23.173172+0000","last_unstale":"2024-09-19T15:32:12.092894+0000","last_undegraded":"2024-09-19T15:32:12.092894+0000","last_fullsized":"2024-09-19T15:32:12.092894+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'51","last_scrub_stamp":"2024-09-19T15:32:12.092566+0000","last_deep_scrub":"268'51","last_deep_scrub_stamp":"2024-09-19T15:32:12.092566+0000","last_clean_scrub_stamp":"2024-09-19T15:32:12.092566+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:04:40.498969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":432,"num_read_kb":295,"num_write":119,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:36.628282+0000","last_change":"2024-09-19T15:32:36.628282+0000","last_active":"2024-09-19T15:32:36.628282+0000","last_peered":"2024-09-19T15:32:36.628282+0000","last_clean":"2024-09-19T15:32:36.628282+0000","last_became_active":"2024-09-19T14:29:51.047826+0000","last_became_peered":"2024-09-19T14:29:51.047826+0000","last_unstale":"2024-09-19T15:32:36.628282+0000","last_undegraded":"2024-09-19T15:32:36.628282+0000","last_fullsized":"2024-09-19T15:32:36.628282+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:36.628097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:36.628097+0000","last_clean_scrub_stamp":"2024-09-19T15:32:36.628097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:53.346515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"265'5","reported_seq":89,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:29.611332+0000","last_change":"2024-09-19T15:32:29.611332+0000","last_active":"2024-09-19T15:32:29.611332+0000","last_peered":"2024-09-19T15:32:29.611332+0000","last_clean":"2024-09-19T15:32:29.611332+0000","last_became_active":"2024-09-19T14:02:36.910154+0000","last_became_peered":"2024-09-19T14:02:36.910154+0000","last_unstale":"2024-09-19T15:32:29.611332+0000","last_undegraded":"2024-09-19T15:32:29.611332+0000","last_fullsized":"2024-09-19T15:32:29.611332+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-19T15:32:29.611105+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-19T15:32:29.611105+0000","last_clean_scrub_stamp":"2024-09-19T15:32:29.611105+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:24.269510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"268'2","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:16.181486+0000","last_change":"2024-09-19T15:32:16.181486+0000","last_active":"2024-09-19T15:32:16.181486+0000","last_peered":"2024-09-19T15:32:16.181486+0000","last_clean":"2024-09-19T15:32:16.181486+0000","last_became_active":"2024-09-19T14:02:29.723084+0000","last_became_peered":"2024-09-19T14:02:29.723084+0000","last_unstale":"2024-09-19T15:32:16.181486+0000","last_undegraded":"2024-09-19T15:32:16.181486+0000","last_fullsized":"2024-09-19T15:32:16.181486+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:16.181300+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:16.181300+0000","last_clean_scrub_stamp":"2024-09-19T15:32:16.181300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:13:52.521060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"268'52","reported_seq":226,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:22.596736+0000","last_change":"2024-09-19T15:32:22.596581+0000","last_active":"2024-09-19T15:32:22.596736+0000","last_peered":"2024-09-19T15:32:22.596736+0000","last_clean":"2024-09-19T15:32:22.596736+0000","last_became_active":"2024-09-19T13:56:23.181354+0000","last_became_peered":"2024-09-19T13:56:23.181354+0000","last_unstale":"2024-09-19T15:32:22.596736+0000","last_undegraded":"2024-09-19T15:32:22.596736+0000","last_fullsized":"2024-09-19T15:32:22.596736+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'52","last_scrub_stamp":"2024-09-19T15:32:22.596389+0000","last_deep_scrub":"268'52","last_deep_scrub_stamp":"2024-09-19T15:32:22.596389+0000","last_clean_scrub_stamp":"2024-09-19T15:32:22.596389+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:36:49.263021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":381,"num_read_kb":254,"num_write":133,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"268'384","reported_seq":1098,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.662100+0000","last_change":"2024-09-19T15:32:00.661911+0000","last_active":"2024-09-19T15:32:00.662100+0000","last_peered":"2024-09-19T15:32:00.662100+0000","last_clean":"2024-09-19T15:32:00.662100+0000","last_became_active":"2024-09-19T13:40:34.278366+0000","last_became_peered":"2024-09-19T13:40:34.278366+0000","last_unstale":"2024-09-19T15:32:00.662100+0000","last_undegraded":"2024-09-19T15:32:00.662100+0000","last_fullsized":"2024-09-19T15:32:00.662100+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'384","last_scrub_stamp":"2024-09-19T15:32:00.661714+0000","last_deep_scrub":"268'384","last_deep_scrub_stamp":"2024-09-19T15:32:00.661714+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.661714+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:17:20.451042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":664,"num_read_kb":97882,"num_write":1263,"num_write_kb":51204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"268'904","reported_seq":2639,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.758553+0000","last_change":"2024-09-19T15:32:05.758397+0000","last_active":"2024-09-19T15:32:05.758553+0000","last_peered":"2024-09-19T15:32:05.758553+0000","last_clean":"2024-09-19T15:32:05.758553+0000","last_became_active":"2024-09-19T13:40:36.233265+0000","last_became_peered":"2024-09-19T13:40:36.233265+0000","last_unstale":"2024-09-19T15:32:05.758553+0000","last_undegraded":"2024-09-19T15:32:05.758553+0000","last_fullsized":"2024-09-19T15:32:05.758553+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'904","last_scrub_stamp":"2024-09-19T15:32:05.758196+0000","last_deep_scrub":"268'904","last_deep_scrub_stamp":"2024-09-19T15:32:05.758196+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.758196+0000","objects_scrubbed":8,"log_size":104,"log_dups_size":800,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:22:11.832649+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4503,"num_read_kb":4037,"num_write":1205,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3446,"num_omap_keys":14,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"268'293","reported_seq":925,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.638322+0000","last_change":"2024-09-19T15:31:50.638153+0000","last_active":"2024-09-19T15:31:50.638322+0000","last_peered":"2024-09-19T15:31:50.638322+0000","last_clean":"2024-09-19T15:31:50.638322+0000","last_became_active":"2024-09-19T13:40:34.240412+0000","last_became_peered":"2024-09-19T13:40:34.240412+0000","last_unstale":"2024-09-19T15:31:50.638322+0000","last_undegraded":"2024-09-19T15:31:50.638322+0000","last_fullsized":"2024-09-19T15:31:50.638322+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'293","last_scrub_stamp":"2024-09-19T15:31:50.637951+0000","last_deep_scrub":"268'293","last_deep_scrub_stamp":"2024-09-19T15:31:50.637951+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.637951+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:16.720237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":459,"num_read_kb":36198,"num_write":952,"num_write_kb":29274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"268'624","reported_seq":2336,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.730911+0000","last_change":"2024-09-19T15:32:04.730768+0000","last_active":"2024-09-19T15:32:04.730911+0000","last_peered":"2024-09-19T15:32:04.730911+0000","last_clean":"2024-09-19T15:32:04.730911+0000","last_became_active":"2024-09-19T13:40:36.232504+0000","last_became_peered":"2024-09-19T13:40:36.232504+0000","last_unstale":"2024-09-19T15:32:04.730911+0000","last_undegraded":"2024-09-19T15:32:04.730911+0000","last_fullsized":"2024-09-19T15:32:04.730911+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'624","last_scrub_stamp":"2024-09-19T15:32:04.730583+0000","last_deep_scrub":"268'624","last_deep_scrub_stamp":"2024-09-19T15:32:04.730583+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.730583+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":600,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:57:53.057219+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3362,"num_read_kb":3070,"num_write":813,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"268'361","reported_seq":1051,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.669636+0000","last_change":"2024-09-19T15:31:51.669495+0000","last_active":"2024-09-19T15:31:51.669636+0000","last_peered":"2024-09-19T15:31:51.669636+0000","last_clean":"2024-09-19T15:31:51.669636+0000","last_became_active":"2024-09-19T13:40:34.215960+0000","last_became_peered":"2024-09-19T13:40:34.215960+0000","last_unstale":"2024-09-19T15:31:51.669636+0000","last_undegraded":"2024-09-19T15:31:51.669636+0000","last_fullsized":"2024-09-19T15:31:51.669636+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'361","last_scrub_stamp":"2024-09-19T15:31:51.669302+0000","last_deep_scrub":"268'361","last_deep_scrub_stamp":"2024-09-19T15:31:51.669302+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.669302+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:44:16.452038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":684,"num_read_kb":31785,"num_write":1188,"num_write_kb":29902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"268'840","reported_seq":2399,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.563667+0000","last_change":"2024-09-19T15:32:04.563507+0000","last_active":"2024-09-19T15:32:04.563667+0000","last_peered":"2024-09-19T15:32:04.563667+0000","last_clean":"2024-09-19T15:32:04.563667+0000","last_became_active":"2024-09-19T13:40:36.220563+0000","last_became_peered":"2024-09-19T13:40:36.220563+0000","last_unstale":"2024-09-19T15:32:04.563667+0000","last_undegraded":"2024-09-19T15:32:04.563667+0000","last_fullsized":"2024-09-19T15:32:04.563667+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'840","last_scrub_stamp":"2024-09-19T15:32:04.563306+0000","last_deep_scrub":"268'840","last_deep_scrub_stamp":"2024-09-19T15:32:04.563306+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.563306+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":800,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:04:09.857112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4017,"num_read_kb":3603,"num_write":1098,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"268'358","reported_seq":1040,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.799280+0000","last_change":"2024-09-19T15:32:00.799136+0000","last_active":"2024-09-19T15:32:00.799280+0000","last_peered":"2024-09-19T15:32:00.799280+0000","last_clean":"2024-09-19T15:32:00.799280+0000","last_became_active":"2024-09-19T13:40:34.239843+0000","last_became_peered":"2024-09-19T13:40:34.239843+0000","last_unstale":"2024-09-19T15:32:00.799280+0000","last_undegraded":"2024-09-19T15:32:00.799280+0000","last_fullsized":"2024-09-19T15:32:00.799280+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'358","last_scrub_stamp":"2024-09-19T15:32:00.798848+0000","last_deep_scrub":"268'358","last_deep_scrub_stamp":"2024-09-19T15:32:00.798848+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.798848+0000","objects_scrubbed":7,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:22:42.485481+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136873,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":579,"num_read_kb":4189,"num_write":1155,"num_write_kb":27975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"268'1557","reported_seq":3235,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.740057+0000","last_change":"2024-09-19T15:32:00.739899+0000","last_active":"2024-09-19T15:32:00.740057+0000","last_peered":"2024-09-19T15:32:00.740057+0000","last_clean":"2024-09-19T15:32:00.740057+0000","last_became_active":"2024-09-19T13:40:36.225954+0000","last_became_peered":"2024-09-19T13:40:36.225954+0000","last_unstale":"2024-09-19T15:32:00.740057+0000","last_undegraded":"2024-09-19T15:32:00.740057+0000","last_fullsized":"2024-09-19T15:32:00.740057+0000","mapping_epoch":27,"log_start":"268'1500","ondisk_log_start":"268'1500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1557","last_scrub_stamp":"2024-09-19T15:32:00.739686+0000","last_deep_scrub":"268'1557","last_deep_scrub_stamp":"2024-09-19T15:32:00.739686+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.739686+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":1500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:51:44.541143+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7021,"num_read_kb":6136,"num_write":2176,"num_write_kb":944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"268'323","reported_seq":1035,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.653777+0000","last_change":"2024-09-19T15:31:58.653559+0000","last_active":"2024-09-19T15:31:58.653777+0000","last_peered":"2024-09-19T15:31:58.653777+0000","last_clean":"2024-09-19T15:31:58.653777+0000","last_became_active":"2024-09-19T13:40:34.267254+0000","last_became_peered":"2024-09-19T13:40:34.267254+0000","last_unstale":"2024-09-19T15:31:58.653777+0000","last_undegraded":"2024-09-19T15:31:58.653777+0000","last_fullsized":"2024-09-19T15:31:58.653777+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'323","last_scrub_stamp":"2024-09-19T15:31:58.653334+0000","last_deep_scrub":"268'323","last_deep_scrub_stamp":"2024-09-19T15:31:58.653334+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.653334+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:29:03.902030+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":674,"num_read_kb":4762,"num_write":931,"num_write_kb":10224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"268'448","reported_seq":2109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.925873+0000","last_change":"2024-09-19T15:31:58.925601+0000","last_active":"2024-09-19T15:31:58.925873+0000","last_peered":"2024-09-19T15:31:58.925873+0000","last_clean":"2024-09-19T15:31:58.925873+0000","last_became_active":"2024-09-19T13:40:36.220431+0000","last_became_peered":"2024-09-19T13:40:36.220431+0000","last_unstale":"2024-09-19T15:31:58.925873+0000","last_undegraded":"2024-09-19T15:31:58.925873+0000","last_fullsized":"2024-09-19T15:31:58.925873+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'448","last_scrub_stamp":"2024-09-19T15:31:58.925377+0000","last_deep_scrub":"268'448","last_deep_scrub_stamp":"2024-09-19T15:31:58.925377+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.925377+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:32.879919+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2602,"num_read_kb":2484,"num_write":543,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"268'313","reported_seq":968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.808674+0000","last_change":"2024-09-19T15:31:59.808520+0000","last_active":"2024-09-19T15:31:59.808674+0000","last_peered":"2024-09-19T15:31:59.808674+0000","last_clean":"2024-09-19T15:31:59.808674+0000","last_became_active":"2024-09-19T13:40:34.218957+0000","last_became_peered":"2024-09-19T13:40:34.218957+0000","last_unstale":"2024-09-19T15:31:59.808674+0000","last_undegraded":"2024-09-19T15:31:59.808674+0000","last_fullsized":"2024-09-19T15:31:59.808674+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'313","last_scrub_stamp":"2024-09-19T15:31:59.808323+0000","last_deep_scrub":"268'313","last_deep_scrub_stamp":"2024-09-19T15:31:59.808323+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.808323+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:28:51.505054+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136870,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":503,"num_read_kb":8139,"num_write":970,"num_write_kb":24727,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"268'797","reported_seq":2569,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.543792+0000","last_change":"2024-09-19T15:32:06.543607+0000","last_active":"2024-09-19T15:32:06.543792+0000","last_peered":"2024-09-19T15:32:06.543792+0000","last_clean":"2024-09-19T15:32:06.543792+0000","last_became_active":"2024-09-19T13:40:36.228785+0000","last_became_peered":"2024-09-19T13:40:36.228785+0000","last_unstale":"2024-09-19T15:32:06.543792+0000","last_undegraded":"2024-09-19T15:32:06.543792+0000","last_fullsized":"2024-09-19T15:32:06.543792+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'797","last_scrub_stamp":"2024-09-19T15:32:06.543396+0000","last_deep_scrub":"268'797","last_deep_scrub_stamp":"2024-09-19T15:32:06.543396+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.543396+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:52:36.348722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4179,"num_read_kb":3830,"num_write":1044,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"268'342","reported_seq":999,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.666916+0000","last_change":"2024-09-19T15:31:57.666756+0000","last_active":"2024-09-19T15:31:57.666916+0000","last_peered":"2024-09-19T15:31:57.666916+0000","last_clean":"2024-09-19T15:31:57.666916+0000","last_became_active":"2024-09-19T13:40:34.267647+0000","last_became_peered":"2024-09-19T13:40:34.267647+0000","last_unstale":"2024-09-19T15:31:57.666916+0000","last_undegraded":"2024-09-19T15:31:57.666916+0000","last_fullsized":"2024-09-19T15:31:57.666916+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'342","last_scrub_stamp":"2024-09-19T15:31:57.666543+0000","last_deep_scrub":"268'342","last_deep_scrub_stamp":"2024-09-19T15:31:57.666543+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.666543+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:41:13.021177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":19593,"num_write":1075,"num_write_kb":28817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"268'1157","reported_seq":2786,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.773863+0000","last_change":"2024-09-19T15:32:07.773733+0000","last_active":"2024-09-19T15:32:07.773863+0000","last_peered":"2024-09-19T15:32:07.773863+0000","last_clean":"2024-09-19T15:32:07.773863+0000","last_became_active":"2024-09-19T13:40:36.230581+0000","last_became_peered":"2024-09-19T13:40:36.230581+0000","last_unstale":"2024-09-19T15:32:07.773863+0000","last_undegraded":"2024-09-19T15:32:07.773863+0000","last_fullsized":"2024-09-19T15:32:07.773863+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1157","last_scrub_stamp":"2024-09-19T15:32:07.773545+0000","last_deep_scrub":"268'1157","last_deep_scrub_stamp":"2024-09-19T15:32:07.773545+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.773545+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":1100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:38.669375+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5418,"num_read_kb":4799,"num_write":1598,"num_write_kb":657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"268'386","reported_seq":1138,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.947684+0000","last_change":"2024-09-19T15:31:55.947499+0000","last_active":"2024-09-19T15:31:55.947684+0000","last_peered":"2024-09-19T15:31:55.947684+0000","last_clean":"2024-09-19T15:31:55.947684+0000","last_became_active":"2024-09-19T13:40:34.237561+0000","last_became_peered":"2024-09-19T13:40:34.237561+0000","last_unstale":"2024-09-19T15:31:55.947684+0000","last_undegraded":"2024-09-19T15:31:55.947684+0000","last_fullsized":"2024-09-19T15:31:55.947684+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'386","last_scrub_stamp":"2024-09-19T15:31:55.947285+0000","last_deep_scrub":"268'386","last_deep_scrub_stamp":"2024-09-19T15:31:55.947285+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.947285+0000","objects_scrubbed":8,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:40:34.514330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136898,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":851,"num_read_kb":72188,"num_write":1180,"num_write_kb":41551,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"268'653","reported_seq":2367,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.862898+0000","last_change":"2024-09-19T15:31:57.862758+0000","last_active":"2024-09-19T15:31:57.862898+0000","last_peered":"2024-09-19T15:31:57.862898+0000","last_clean":"2024-09-19T15:31:57.862898+0000","last_became_active":"2024-09-19T13:40:36.221587+0000","last_became_peered":"2024-09-19T13:40:36.221587+0000","last_unstale":"2024-09-19T15:31:57.862898+0000","last_undegraded":"2024-09-19T15:31:57.862898+0000","last_fullsized":"2024-09-19T15:31:57.862898+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'653","last_scrub_stamp":"2024-09-19T15:31:57.862563+0000","last_deep_scrub":"268'653","last_deep_scrub_stamp":"2024-09-19T15:31:57.862563+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.862563+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":600,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:10:32.434848+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3331,"num_read_kb":3024,"num_write":858,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"268'1221","reported_seq":3039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.529686+0000","last_change":"2024-09-19T15:32:03.529541+0000","last_active":"2024-09-19T15:32:03.529686+0000","last_peered":"2024-09-19T15:32:03.529686+0000","last_clean":"2024-09-19T15:32:03.529686+0000","last_became_active":"2024-09-19T13:40:36.220889+0000","last_became_peered":"2024-09-19T13:40:36.220889+0000","last_unstale":"2024-09-19T15:32:03.529686+0000","last_undegraded":"2024-09-19T15:32:03.529686+0000","last_fullsized":"2024-09-19T15:32:03.529686+0000","mapping_epoch":27,"log_start":"268'1200","ondisk_log_start":"268'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1221","last_scrub_stamp":"2024-09-19T15:32:03.529327+0000","last_deep_scrub":"268'1221","last_deep_scrub_stamp":"2024-09-19T15:32:03.529327+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.529327+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":1200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:46.924744+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5895,"num_read_kb":5235,"num_write":1696,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2040,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"268'416","reported_seq":1155,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.627136+0000","last_change":"2024-09-19T15:31:59.626980+0000","last_active":"2024-09-19T15:31:59.627136+0000","last_peered":"2024-09-19T15:31:59.627136+0000","last_clean":"2024-09-19T15:31:59.627136+0000","last_became_active":"2024-09-19T13:40:34.278991+0000","last_became_peered":"2024-09-19T13:40:34.278991+0000","last_unstale":"2024-09-19T15:31:59.627136+0000","last_undegraded":"2024-09-19T15:31:59.627136+0000","last_fullsized":"2024-09-19T15:31:59.627136+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'416","last_scrub_stamp":"2024-09-19T15:31:59.626756+0000","last_deep_scrub":"268'416","last_deep_scrub_stamp":"2024-09-19T15:31:59.626756+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.626756+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:27:36.553637+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136848,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":967,"num_read_kb":8273,"num_write":1275,"num_write_kb":26935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"268'1135","reported_seq":2659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.698303+0000","last_change":"2024-09-19T15:32:03.698161+0000","last_active":"2024-09-19T15:32:03.698303+0000","last_peered":"2024-09-19T15:32:03.698303+0000","last_clean":"2024-09-19T15:32:03.698303+0000","last_became_active":"2024-09-19T13:40:36.233032+0000","last_became_peered":"2024-09-19T13:40:36.233032+0000","last_unstale":"2024-09-19T15:32:03.698303+0000","last_undegraded":"2024-09-19T15:32:03.698303+0000","last_fullsized":"2024-09-19T15:32:03.698303+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1135","last_scrub_stamp":"2024-09-19T15:32:03.697969+0000","last_deep_scrub":"268'1135","last_deep_scrub_stamp":"2024-09-19T15:32:03.697969+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.697969+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":1100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:38.136899+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5185,"num_read_kb":4564,"num_write":1576,"num_write_kb":658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"268'361","reported_seq":1029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.926301+0000","last_change":"2024-09-19T15:31:54.926301+0000","last_active":"2024-09-19T15:31:54.926301+0000","last_peered":"2024-09-19T15:31:54.926301+0000","last_clean":"2024-09-19T15:31:54.926301+0000","last_became_active":"2024-09-19T13:40:34.257994+0000","last_became_peered":"2024-09-19T13:40:34.257994+0000","last_unstale":"2024-09-19T15:31:54.926301+0000","last_undegraded":"2024-09-19T15:31:54.926301+0000","last_fullsized":"2024-09-19T15:31:54.926301+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'361","last_scrub_stamp":"2024-09-19T15:31:54.925917+0000","last_deep_scrub":"268'361","last_deep_scrub_stamp":"2024-09-19T15:31:54.925917+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.925917+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:27:05.992674+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":609,"num_read_kb":26261,"num_write":1202,"num_write_kb":39497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"268'592","reported_seq":2580,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.749079+0000","last_change":"2024-09-19T15:32:04.748952+0000","last_active":"2024-09-19T15:32:04.749079+0000","last_peered":"2024-09-19T15:32:04.749079+0000","last_clean":"2024-09-19T15:32:04.749079+0000","last_became_active":"2024-09-19T13:40:36.231554+0000","last_became_peered":"2024-09-19T13:40:36.231554+0000","last_unstale":"2024-09-19T15:32:04.749079+0000","last_undegraded":"2024-09-19T15:32:04.749079+0000","last_fullsized":"2024-09-19T15:32:04.749079+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'592","last_scrub_stamp":"2024-09-19T15:32:04.748748+0000","last_deep_scrub":"268'592","last_deep_scrub_stamp":"2024-09-19T15:32:04.748748+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.748748+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":500,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:25.544452+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3450,"num_read_kb":3252,"num_write":736,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2777,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"268'354","reported_seq":1003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.894244+0000","last_change":"2024-09-19T15:31:51.894244+0000","last_active":"2024-09-19T15:31:51.894244+0000","last_peered":"2024-09-19T15:31:51.894244+0000","last_clean":"2024-09-19T15:31:51.894244+0000","last_became_active":"2024-09-19T13:40:34.264349+0000","last_became_peered":"2024-09-19T13:40:34.264349+0000","last_unstale":"2024-09-19T15:31:51.894244+0000","last_undegraded":"2024-09-19T15:31:51.894244+0000","last_fullsized":"2024-09-19T15:31:51.894244+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'354","last_scrub_stamp":"2024-09-19T15:31:51.894022+0000","last_deep_scrub":"268'354","last_deep_scrub_stamp":"2024-09-19T15:31:51.894022+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.894022+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:08.557909+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":590,"num_read_kb":18139,"num_write":1138,"num_write_kb":28020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"268'536","reported_seq":2168,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.817859+0000","last_change":"2024-09-19T15:31:56.817859+0000","last_active":"2024-09-19T15:31:56.817859+0000","last_peered":"2024-09-19T15:31:56.817859+0000","last_clean":"2024-09-19T15:31:56.817859+0000","last_became_active":"2024-09-19T13:40:36.221266+0000","last_became_peered":"2024-09-19T13:40:36.221266+0000","last_unstale":"2024-09-19T15:31:56.817859+0000","last_undegraded":"2024-09-19T15:31:56.817859+0000","last_fullsized":"2024-09-19T15:31:56.817859+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'536","last_scrub_stamp":"2024-09-19T15:31:56.817666+0000","last_deep_scrub":"268'536","last_deep_scrub_stamp":"2024-09-19T15:31:56.817666+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.817666+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":500,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:15.258731+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2921,"num_read_kb":2700,"num_write":709,"num_write_kb":255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"268'351","reported_seq":1207,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.497107+0000","last_change":"2024-09-19T15:31:50.497107+0000","last_active":"2024-09-19T15:31:50.497107+0000","last_peered":"2024-09-19T15:31:50.497107+0000","last_clean":"2024-09-19T15:31:50.497107+0000","last_became_active":"2024-09-19T13:40:34.262084+0000","last_became_peered":"2024-09-19T13:40:34.262084+0000","last_unstale":"2024-09-19T15:31:50.497107+0000","last_undegraded":"2024-09-19T15:31:50.497107+0000","last_fullsized":"2024-09-19T15:31:50.497107+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'351","last_scrub_stamp":"2024-09-19T15:31:50.496887+0000","last_deep_scrub":"268'351","last_deep_scrub_stamp":"2024-09-19T15:31:50.496887+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.496887+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:55:19.272837+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1177,"num_read_kb":45013,"num_write":1025,"num_write_kb":26916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"268'462","reported_seq":2076,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.816018+0000","last_change":"2024-09-19T15:31:54.816018+0000","last_active":"2024-09-19T15:31:54.816018+0000","last_peered":"2024-09-19T15:31:54.816018+0000","last_clean":"2024-09-19T15:31:54.816018+0000","last_became_active":"2024-09-19T13:40:36.216082+0000","last_became_peered":"2024-09-19T13:40:36.216082+0000","last_unstale":"2024-09-19T15:31:54.816018+0000","last_undegraded":"2024-09-19T15:31:54.816018+0000","last_fullsized":"2024-09-19T15:31:54.816018+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'462","last_scrub_stamp":"2024-09-19T15:31:54.815843+0000","last_deep_scrub":"268'462","last_deep_scrub_stamp":"2024-09-19T15:31:54.815843+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.815843+0000","objects_scrubbed":1,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:57.752317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2409,"num_read_kb":2273,"num_write":537,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"268'339","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.915768+0000","last_change":"2024-09-19T15:31:54.915768+0000","last_active":"2024-09-19T15:31:54.915768+0000","last_peered":"2024-09-19T15:31:54.915768+0000","last_clean":"2024-09-19T15:31:54.915768+0000","last_became_active":"2024-09-19T13:40:34.237589+0000","last_became_peered":"2024-09-19T13:40:34.237589+0000","last_unstale":"2024-09-19T15:31:54.915768+0000","last_undegraded":"2024-09-19T15:31:54.915768+0000","last_fullsized":"2024-09-19T15:31:54.915768+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-19T15:31:54.915566+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-19T15:31:54.915566+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.915566+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:43.777729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":471,"num_read_kb":27580,"num_write":960,"num_write_kb":52672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"268'578","reported_seq":2271,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.519448+0000","last_change":"2024-09-19T15:32:05.519448+0000","last_active":"2024-09-19T15:32:05.519448+0000","last_peered":"2024-09-19T15:32:05.519448+0000","last_clean":"2024-09-19T15:32:05.519448+0000","last_became_active":"2024-09-19T13:40:36.220183+0000","last_became_peered":"2024-09-19T13:40:36.220183+0000","last_unstale":"2024-09-19T15:32:05.519448+0000","last_undegraded":"2024-09-19T15:32:05.519448+0000","last_fullsized":"2024-09-19T15:32:05.519448+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'578","last_scrub_stamp":"2024-09-19T15:32:05.519220+0000","last_deep_scrub":"268'578","last_deep_scrub_stamp":"2024-09-19T15:32:05.519220+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.519220+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":500,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:28.549608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3052,"num_read_kb":2823,"num_write":743,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"268'385","reported_seq":1099,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.717970+0000","last_change":"2024-09-19T15:31:52.717970+0000","last_active":"2024-09-19T15:31:52.717970+0000","last_peered":"2024-09-19T15:31:52.717970+0000","last_clean":"2024-09-19T15:31:52.717970+0000","last_became_active":"2024-09-19T13:40:34.224813+0000","last_became_peered":"2024-09-19T13:40:34.224813+0000","last_unstale":"2024-09-19T15:31:52.717970+0000","last_undegraded":"2024-09-19T15:31:52.717970+0000","last_fullsized":"2024-09-19T15:31:52.717970+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'385","last_scrub_stamp":"2024-09-19T15:31:52.717747+0000","last_deep_scrub":"268'385","last_deep_scrub_stamp":"2024-09-19T15:31:52.717747+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.717747+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:25:38.923053+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":831,"num_read_kb":1243,"num_write":1485,"num_write_kb":25860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"268'141","reported_seq":675,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:20.588361+0000","last_change":"2024-09-19T15:32:20.588361+0000","last_active":"2024-09-19T15:32:20.588361+0000","last_peered":"2024-09-19T15:32:20.588361+0000","last_clean":"2024-09-19T15:32:20.588361+0000","last_became_active":"2024-09-19T13:40:44.242028+0000","last_became_peered":"2024-09-19T13:40:44.242028+0000","last_unstale":"2024-09-19T15:32:20.588361+0000","last_undegraded":"2024-09-19T15:32:20.588361+0000","last_fullsized":"2024-09-19T15:32:20.588361+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'141","last_scrub_stamp":"2024-09-19T15:32:20.588175+0000","last_deep_scrub":"268'141","last_deep_scrub_stamp":"2024-09-19T15:32:20.588175+0000","last_clean_scrub_stamp":"2024-09-19T15:32:20.588175+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:35.558306+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":184,"num_read_kb":180,"num_write":320,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"268'410","reported_seq":1943,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.053199+0000","last_change":"2024-09-19T15:32:01.052954+0000","last_active":"2024-09-19T15:32:01.053199+0000","last_peered":"2024-09-19T15:32:01.053199+0000","last_clean":"2024-09-19T15:32:01.053199+0000","last_became_active":"2024-09-19T13:40:36.218091+0000","last_became_peered":"2024-09-19T13:40:36.218091+0000","last_unstale":"2024-09-19T15:32:01.053199+0000","last_undegraded":"2024-09-19T15:32:01.053199+0000","last_fullsized":"2024-09-19T15:32:01.053199+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'410","last_scrub_stamp":"2024-09-19T15:32:01.052731+0000","last_deep_scrub":"268'410","last_deep_scrub_stamp":"2024-09-19T15:32:01.052731+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.052731+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:54:24.981092+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2211,"num_read_kb":2096,"num_write":485,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"268'348","reported_seq":991,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.881182+0000","last_change":"2024-09-19T15:31:50.881044+0000","last_active":"2024-09-19T15:31:50.881182+0000","last_peered":"2024-09-19T15:31:50.881182+0000","last_clean":"2024-09-19T15:31:50.881182+0000","last_became_active":"2024-09-19T13:41:05.386216+0000","last_became_peered":"2024-09-19T13:41:05.386216+0000","last_unstale":"2024-09-19T15:31:50.881182+0000","last_undegraded":"2024-09-19T15:31:50.881182+0000","last_fullsized":"2024-09-19T15:31:50.881182+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'348","last_scrub_stamp":"2024-09-19T15:31:50.880838+0000","last_deep_scrub":"268'348","last_deep_scrub_stamp":"2024-09-19T15:31:50.880838+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.880838+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:14.516054+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":616,"num_read_kb":13820,"num_write":1168,"num_write_kb":52710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:10.688994+0000","last_change":"2024-09-19T15:32:10.688994+0000","last_active":"2024-09-19T15:32:10.688994+0000","last_peered":"2024-09-19T15:32:10.688994+0000","last_clean":"2024-09-19T15:32:10.688994+0000","last_became_active":"2024-09-19T13:40:38.222863+0000","last_became_peered":"2024-09-19T13:40:38.222863+0000","last_unstale":"2024-09-19T15:32:10.688994+0000","last_undegraded":"2024-09-19T15:32:10.688994+0000","last_fullsized":"2024-09-19T15:32:10.688994+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:10.688812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:10.688812+0000","last_clean_scrub_stamp":"2024-09-19T15:32:10.688812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:42.956381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"268'388","reported_seq":1042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.693514+0000","last_change":"2024-09-19T15:32:07.693514+0000","last_active":"2024-09-19T15:32:07.693514+0000","last_peered":"2024-09-19T15:32:07.693514+0000","last_clean":"2024-09-19T15:32:07.693514+0000","last_became_active":"2024-09-19T13:40:40.230368+0000","last_became_peered":"2024-09-19T13:40:40.230368+0000","last_unstale":"2024-09-19T15:32:07.693514+0000","last_undegraded":"2024-09-19T15:32:07.693514+0000","last_fullsized":"2024-09-19T15:32:07.693514+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'388","last_scrub_stamp":"2024-09-19T15:32:07.693335+0000","last_deep_scrub":"268'388","last_deep_scrub_stamp":"2024-09-19T15:32:07.693335+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.693335+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:40:16.124155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46964,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":623,"num_read_kb":1259,"num_write":490,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:18.700662+0000","last_change":"2024-09-19T15:32:18.700662+0000","last_active":"2024-09-19T15:32:18.700662+0000","last_peered":"2024-09-19T15:32:18.700662+0000","last_clean":"2024-09-19T15:32:18.700662+0000","last_became_active":"2024-09-19T13:40:42.240244+0000","last_became_peered":"2024-09-19T13:40:42.240244+0000","last_unstale":"2024-09-19T15:32:18.700662+0000","last_undegraded":"2024-09-19T15:32:18.700662+0000","last_fullsized":"2024-09-19T15:32:18.700662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:18.700485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:18.700485+0000","last_clean_scrub_stamp":"2024-09-19T15:32:18.700485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:04:21.150878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"268'2489","reported_seq":4356,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:23.643216+0000","last_change":"2024-09-19T15:32:23.643216+0000","last_active":"2024-09-19T15:32:23.643216+0000","last_peered":"2024-09-19T15:32:23.643216+0000","last_clean":"2024-09-19T15:32:23.643216+0000","last_became_active":"2024-09-19T13:40:44.263152+0000","last_became_peered":"2024-09-19T13:40:44.263152+0000","last_unstale":"2024-09-19T15:32:23.643216+0000","last_undegraded":"2024-09-19T15:32:23.643216+0000","last_fullsized":"2024-09-19T15:32:23.643216+0000","mapping_epoch":35,"log_start":"268'2400","ondisk_log_start":"268'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2489","last_scrub_stamp":"2024-09-19T15:32:23.643031+0000","last_deep_scrub":"268'2489","last_deep_scrub_stamp":"2024-09-19T15:32:23.643031+0000","last_clean_scrub_stamp":"2024-09-19T15:32:23.643031+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":2400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:42.489155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":445,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6208,"num_read_kb":6212,"num_write":5020,"num_write_kb":1848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"268'370","reported_seq":1876,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.779015+0000","last_change":"2024-09-19T15:32:02.779015+0000","last_active":"2024-09-19T15:32:02.779015+0000","last_peered":"2024-09-19T15:32:02.779015+0000","last_clean":"2024-09-19T15:32:02.779015+0000","last_became_active":"2024-09-19T13:40:36.242260+0000","last_became_peered":"2024-09-19T13:40:36.242260+0000","last_unstale":"2024-09-19T15:32:02.779015+0000","last_undegraded":"2024-09-19T15:32:02.779015+0000","last_fullsized":"2024-09-19T15:32:02.779015+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-19T15:32:02.778799+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-19T15:32:02.778799+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.778799+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:58:11.339987+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2141,"num_read_kb":2035,"num_write":405,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"268'304","reported_seq":967,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:45.643430+0000","last_change":"2024-09-19T15:31:45.643356+0000","last_active":"2024-09-19T15:31:45.643430+0000","last_peered":"2024-09-19T15:31:45.643430+0000","last_clean":"2024-09-19T15:31:45.643430+0000","last_became_active":"2024-09-19T13:40:34.254811+0000","last_became_peered":"2024-09-19T13:40:34.254811+0000","last_unstale":"2024-09-19T15:31:45.643430+0000","last_undegraded":"2024-09-19T15:31:45.643430+0000","last_fullsized":"2024-09-19T15:31:45.643430+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'304","last_scrub_stamp":"2024-09-19T15:31:45.643211+0000","last_deep_scrub":"268'304","last_deep_scrub_stamp":"2024-09-19T15:31:45.643211+0000","last_clean_scrub_stamp":"2024-09-19T15:31:45.643211+0000","objects_scrubbed":8,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:42.025896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":583,"num_read_kb":3104,"num_write":1034,"num_write_kb":15827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:09.098354+0000","last_change":"2024-09-19T15:32:09.098212+0000","last_active":"2024-09-19T15:32:09.098354+0000","last_peered":"2024-09-19T15:32:09.098354+0000","last_clean":"2024-09-19T15:32:09.098354+0000","last_became_active":"2024-09-19T13:40:38.233854+0000","last_became_peered":"2024-09-19T13:40:38.233854+0000","last_unstale":"2024-09-19T15:32:09.098354+0000","last_undegraded":"2024-09-19T15:32:09.098354+0000","last_fullsized":"2024-09-19T15:32:09.098354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:09.098028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:09.098028+0000","last_clean_scrub_stamp":"2024-09-19T15:32:09.098028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:37:11.684872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"268'128","reported_seq":705,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:13.548069+0000","last_change":"2024-09-19T15:32:13.548069+0000","last_active":"2024-09-19T15:32:13.548069+0000","last_peered":"2024-09-19T15:32:13.548069+0000","last_clean":"2024-09-19T15:32:13.548069+0000","last_became_active":"2024-09-19T13:40:40.244841+0000","last_became_peered":"2024-09-19T13:40:40.244841+0000","last_unstale":"2024-09-19T15:32:13.548069+0000","last_undegraded":"2024-09-19T15:32:13.548069+0000","last_fullsized":"2024-09-19T15:32:13.548069+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'128","last_scrub_stamp":"2024-09-19T15:32:13.547828+0000","last_deep_scrub":"268'128","last_deep_scrub_stamp":"2024-09-19T15:32:13.547828+0000","last_clean_scrub_stamp":"2024-09-19T15:32:13.547828+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:35:26.393560+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":157,"num_read_kb":152,"num_write":106,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:17.571750+0000","last_change":"2024-09-19T15:32:17.571750+0000","last_active":"2024-09-19T15:32:17.571750+0000","last_peered":"2024-09-19T15:32:17.571750+0000","last_clean":"2024-09-19T15:32:17.571750+0000","last_became_active":"2024-09-19T13:40:42.235151+0000","last_became_peered":"2024-09-19T13:40:42.235151+0000","last_unstale":"2024-09-19T15:32:17.571750+0000","last_undegraded":"2024-09-19T15:32:17.571750+0000","last_fullsized":"2024-09-19T15:32:17.571750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:17.571503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:17.571503+0000","last_clean_scrub_stamp":"2024-09-19T15:32:17.571503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:27:14.904541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"268'99","reported_seq":627,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:20.633689+0000","last_change":"2024-09-19T15:32:20.633689+0000","last_active":"2024-09-19T15:32:20.633689+0000","last_peered":"2024-09-19T15:32:20.633689+0000","last_clean":"2024-09-19T15:32:20.633689+0000","last_became_active":"2024-09-19T13:40:44.262343+0000","last_became_peered":"2024-09-19T13:40:44.262343+0000","last_unstale":"2024-09-19T15:32:20.633689+0000","last_undegraded":"2024-09-19T15:32:20.633689+0000","last_fullsized":"2024-09-19T15:32:20.633689+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'99","last_scrub_stamp":"2024-09-19T15:32:20.633491+0000","last_deep_scrub":"268'99","last_deep_scrub_stamp":"2024-09-19T15:32:20.633491+0000","last_clean_scrub_stamp":"2024-09-19T15:32:20.633491+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:00:16.771664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":129,"num_read_kb":127,"num_write":220,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"268'739","reported_seq":2248,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.747931+0000","last_change":"2024-09-19T15:31:56.747931+0000","last_active":"2024-09-19T15:31:56.747931+0000","last_peered":"2024-09-19T15:31:56.747931+0000","last_clean":"2024-09-19T15:31:56.747931+0000","last_became_active":"2024-09-19T13:40:36.225170+0000","last_became_peered":"2024-09-19T13:40:36.225170+0000","last_unstale":"2024-09-19T15:31:56.747931+0000","last_undegraded":"2024-09-19T15:31:56.747931+0000","last_fullsized":"2024-09-19T15:31:56.747931+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'739","last_scrub_stamp":"2024-09-19T15:31:56.747710+0000","last_deep_scrub":"268'739","last_deep_scrub_stamp":"2024-09-19T15:31:56.747710+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.747710+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:45:39.254884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3445,"num_read_kb":3119,"num_write":970,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"268'347","reported_seq":987,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.755049+0000","last_change":"2024-09-19T15:31:52.754774+0000","last_active":"2024-09-19T15:31:52.755049+0000","last_peered":"2024-09-19T15:31:52.755049+0000","last_clean":"2024-09-19T15:31:52.755049+0000","last_became_active":"2024-09-19T13:40:34.273656+0000","last_became_peered":"2024-09-19T13:40:34.273656+0000","last_unstale":"2024-09-19T15:31:52.755049+0000","last_undegraded":"2024-09-19T15:31:52.755049+0000","last_fullsized":"2024-09-19T15:31:52.755049+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'347","last_scrub_stamp":"2024-09-19T15:31:52.754452+0000","last_deep_scrub":"268'347","last_deep_scrub_stamp":"2024-09-19T15:31:52.754452+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.754452+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:28:40.714033+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136842,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":513,"num_read_kb":12420,"num_write":1036,"num_write_kb":39158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:10.085570+0000","last_change":"2024-09-19T15:32:10.085570+0000","last_active":"2024-09-19T15:32:10.085570+0000","last_peered":"2024-09-19T15:32:10.085570+0000","last_clean":"2024-09-19T15:32:10.085570+0000","last_became_active":"2024-09-19T13:40:38.220474+0000","last_became_peered":"2024-09-19T13:40:38.220474+0000","last_unstale":"2024-09-19T15:32:10.085570+0000","last_undegraded":"2024-09-19T15:32:10.085570+0000","last_fullsized":"2024-09-19T15:32:10.085570+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:10.085385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:10.085385+0000","last_clean_scrub_stamp":"2024-09-19T15:32:10.085385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:53.008740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"268'194","reported_seq":796,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.972485+0000","last_change":"2024-09-19T15:32:02.972239+0000","last_active":"2024-09-19T15:32:02.972485+0000","last_peered":"2024-09-19T15:32:02.972485+0000","last_clean":"2024-09-19T15:32:02.972485+0000","last_became_active":"2024-09-19T13:40:40.247893+0000","last_became_peered":"2024-09-19T13:40:40.247893+0000","last_unstale":"2024-09-19T15:32:02.972485+0000","last_undegraded":"2024-09-19T15:32:02.972485+0000","last_fullsized":"2024-09-19T15:32:02.972485+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'194","last_scrub_stamp":"2024-09-19T15:32:02.971992+0000","last_deep_scrub":"268'194","last_deep_scrub_stamp":"2024-09-19T15:32:02.971992+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.971992+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:29.838775+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":232,"num_read_kb":225,"num_write":160,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"268'762","reported_seq":3190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:17.676596+0000","last_change":"2024-09-19T15:32:17.676596+0000","last_active":"2024-09-19T15:32:17.676596+0000","last_peered":"2024-09-19T15:32:17.676596+0000","last_clean":"2024-09-19T15:32:17.676596+0000","last_became_active":"2024-09-19T13:40:42.239059+0000","last_became_peered":"2024-09-19T13:40:42.239059+0000","last_unstale":"2024-09-19T15:32:17.676596+0000","last_undegraded":"2024-09-19T15:32:17.676596+0000","last_fullsized":"2024-09-19T15:32:17.676596+0000","mapping_epoch":33,"log_start":"268'701","ondisk_log_start":"268'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'762","last_scrub_stamp":"2024-09-19T15:32:17.676409+0000","last_deep_scrub":"268'762","last_deep_scrub_stamp":"2024-09-19T15:32:17.676409+0000","last_clean_scrub_stamp":"2024-09-19T15:32:17.676409+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":701,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:50.314671+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"268'228","reported_seq":1079,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:21.544440+0000","last_change":"2024-09-19T15:32:21.544440+0000","last_active":"2024-09-19T15:32:21.544440+0000","last_peered":"2024-09-19T15:32:21.544440+0000","last_clean":"2024-09-19T15:32:21.544440+0000","last_became_active":"2024-09-19T13:40:44.277966+0000","last_became_peered":"2024-09-19T13:40:44.277966+0000","last_unstale":"2024-09-19T15:32:21.544440+0000","last_undegraded":"2024-09-19T15:32:21.544440+0000","last_fullsized":"2024-09-19T15:32:21.544440+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'228","last_scrub_stamp":"2024-09-19T15:32:21.544253+0000","last_deep_scrub":"268'228","last_deep_scrub_stamp":"2024-09-19T15:32:21.544253+0000","last_clean_scrub_stamp":"2024-09-19T15:32:21.544253+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:25.413782+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":650,"num_read_kb":649,"num_write":494,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"268'748","reported_seq":2169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.029942+0000","last_change":"2024-09-19T15:32:00.029942+0000","last_active":"2024-09-19T15:32:00.029942+0000","last_peered":"2024-09-19T15:32:00.029942+0000","last_clean":"2024-09-19T15:32:00.029942+0000","last_became_active":"2024-09-19T13:40:36.238400+0000","last_became_peered":"2024-09-19T13:40:36.238400+0000","last_unstale":"2024-09-19T15:32:00.029942+0000","last_undegraded":"2024-09-19T15:32:00.029942+0000","last_fullsized":"2024-09-19T15:32:00.029942+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'748","last_scrub_stamp":"2024-09-19T15:32:00.029701+0000","last_deep_scrub":"268'748","last_deep_scrub_stamp":"2024-09-19T15:32:00.029701+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.029701+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:17.299402+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3489,"num_read_kb":3124,"num_write":1003,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"268'393","reported_seq":1084,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.901063+0000","last_change":"2024-09-19T15:31:49.900923+0000","last_active":"2024-09-19T15:31:49.901063+0000","last_peered":"2024-09-19T15:31:49.901063+0000","last_clean":"2024-09-19T15:31:49.901063+0000","last_became_active":"2024-09-19T13:40:34.257596+0000","last_became_peered":"2024-09-19T13:40:34.257596+0000","last_unstale":"2024-09-19T15:31:49.901063+0000","last_undegraded":"2024-09-19T15:31:49.901063+0000","last_fullsized":"2024-09-19T15:31:49.901063+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'393","last_scrub_stamp":"2024-09-19T15:31:49.900735+0000","last_deep_scrub":"268'393","last_deep_scrub_stamp":"2024-09-19T15:31:49.900735+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.900735+0000","objects_scrubbed":1,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:09.592854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":736,"num_read_kb":35384,"num_write":1329,"num_write_kb":23932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:11.670640+0000","last_change":"2024-09-19T15:32:11.670640+0000","last_active":"2024-09-19T15:32:11.670640+0000","last_peered":"2024-09-19T15:32:11.670640+0000","last_clean":"2024-09-19T15:32:11.670640+0000","last_became_active":"2024-09-19T13:40:38.212327+0000","last_became_peered":"2024-09-19T13:40:38.212327+0000","last_unstale":"2024-09-19T15:32:11.670640+0000","last_undegraded":"2024-09-19T15:32:11.670640+0000","last_fullsized":"2024-09-19T15:32:11.670640+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:11.670461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:11.670461+0000","last_clean_scrub_stamp":"2024-09-19T15:32:11.670461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:57.215802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"268'318","reported_seq":947,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:14.726525+0000","last_change":"2024-09-19T15:32:14.726525+0000","last_active":"2024-09-19T15:32:14.726525+0000","last_peered":"2024-09-19T15:32:14.726525+0000","last_clean":"2024-09-19T15:32:14.726525+0000","last_became_active":"2024-09-19T13:40:40.225512+0000","last_became_peered":"2024-09-19T13:40:40.225512+0000","last_unstale":"2024-09-19T15:32:14.726525+0000","last_undegraded":"2024-09-19T15:32:14.726525+0000","last_fullsized":"2024-09-19T15:32:14.726525+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'318","last_scrub_stamp":"2024-09-19T15:32:14.726315+0000","last_deep_scrub":"268'318","last_deep_scrub_stamp":"2024-09-19T15:32:14.726315+0000","last_clean_scrub_stamp":"2024-09-19T15:32:14.726315+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:05.810318+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43264,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":513,"num_read_kb":1124,"num_write":410,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"268'790","reported_seq":3006,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:21.201505+0000","last_change":"2024-09-19T15:32:21.201361+0000","last_active":"2024-09-19T15:32:21.201505+0000","last_peered":"2024-09-19T15:32:21.201505+0000","last_clean":"2024-09-19T15:32:21.201505+0000","last_became_active":"2024-09-19T13:40:42.263635+0000","last_became_peered":"2024-09-19T13:40:42.263635+0000","last_unstale":"2024-09-19T15:32:21.201505+0000","last_undegraded":"2024-09-19T15:32:21.201505+0000","last_fullsized":"2024-09-19T15:32:21.201505+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'790","last_scrub_stamp":"2024-09-19T15:32:21.201174+0000","last_deep_scrub":"268'790","last_deep_scrub_stamp":"2024-09-19T15:32:21.201174+0000","last_clean_scrub_stamp":"2024-09-19T15:32:21.201174+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:22.262573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"268'503","reported_seq":2114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.805627+0000","last_change":"2024-09-19T15:32:01.805627+0000","last_active":"2024-09-19T15:32:01.805627+0000","last_peered":"2024-09-19T15:32:01.805627+0000","last_clean":"2024-09-19T15:32:01.805627+0000","last_became_active":"2024-09-19T13:40:36.235739+0000","last_became_peered":"2024-09-19T13:40:36.235739+0000","last_unstale":"2024-09-19T15:32:01.805627+0000","last_undegraded":"2024-09-19T15:32:01.805627+0000","last_fullsized":"2024-09-19T15:32:01.805627+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'503","last_scrub_stamp":"2024-09-19T15:32:01.805424+0000","last_deep_scrub":"268'503","last_deep_scrub_stamp":"2024-09-19T15:32:01.805424+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.805424+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:33:53.497137+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2574,"num_read_kb":2392,"num_write":618,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"268'357","reported_seq":1080,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.762833+0000","last_change":"2024-09-19T15:31:53.762833+0000","last_active":"2024-09-19T15:31:53.762833+0000","last_peered":"2024-09-19T15:31:53.762833+0000","last_clean":"2024-09-19T15:31:53.762833+0000","last_became_active":"2024-09-19T13:41:05.309594+0000","last_became_peered":"2024-09-19T13:41:05.309594+0000","last_unstale":"2024-09-19T15:31:53.762833+0000","last_undegraded":"2024-09-19T15:31:53.762833+0000","last_fullsized":"2024-09-19T15:31:53.762833+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'357","last_scrub_stamp":"2024-09-19T15:31:53.762612+0000","last_deep_scrub":"268'357","last_deep_scrub_stamp":"2024-09-19T15:31:53.762612+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.762612+0000","objects_scrubbed":7,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:30:03.838874+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":758,"num_read_kb":65190,"num_write":1172,"num_write_kb":23524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0],"acting":[7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.681085+0000","last_change":"2024-09-19T15:32:07.681085+0000","last_active":"2024-09-19T15:32:07.681085+0000","last_peered":"2024-09-19T15:32:07.681085+0000","last_clean":"2024-09-19T15:32:07.681085+0000","last_became_active":"2024-09-19T13:40:38.233892+0000","last_became_peered":"2024-09-19T13:40:38.233892+0000","last_unstale":"2024-09-19T15:32:07.681085+0000","last_undegraded":"2024-09-19T15:32:07.681085+0000","last_fullsized":"2024-09-19T15:32:07.681085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:07.680900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:07.680900+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.680900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:13.848920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"268'467","reported_seq":1182,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:14.678325+0000","last_change":"2024-09-19T15:32:14.678325+0000","last_active":"2024-09-19T15:32:14.678325+0000","last_peered":"2024-09-19T15:32:14.678325+0000","last_clean":"2024-09-19T15:32:14.678325+0000","last_became_active":"2024-09-19T13:40:40.232582+0000","last_became_peered":"2024-09-19T13:40:40.232582+0000","last_unstale":"2024-09-19T15:32:14.678325+0000","last_undegraded":"2024-09-19T15:32:14.678325+0000","last_fullsized":"2024-09-19T15:32:14.678325+0000","mapping_epoch":31,"log_start":"268'400","ondisk_log_start":"268'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'467","last_scrub_stamp":"2024-09-19T15:32:14.678058+0000","last_deep_scrub":"268'467","last_deep_scrub_stamp":"2024-09-19T15:32:14.678058+0000","last_clean_scrub_stamp":"2024-09-19T15:32:14.678058+0000","objects_scrubbed":9,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:08:47.724207+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44624,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":740,"num_read_kb":1351,"num_write":560,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.598875+0000","last_change":"2024-09-19T15:32:08.598875+0000","last_active":"2024-09-19T15:32:08.598875+0000","last_peered":"2024-09-19T15:32:08.598875+0000","last_clean":"2024-09-19T15:32:08.598875+0000","last_became_active":"2024-09-19T13:40:42.239961+0000","last_became_peered":"2024-09-19T13:40:42.239961+0000","last_unstale":"2024-09-19T15:32:08.598875+0000","last_undegraded":"2024-09-19T15:32:08.598875+0000","last_fullsized":"2024-09-19T15:32:08.598875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:08.598673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:08.598673+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.598673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:30:30.732339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"268'548","reported_seq":1404,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:19.646257+0000","last_change":"2024-09-19T15:32:19.646257+0000","last_active":"2024-09-19T15:32:19.646257+0000","last_peered":"2024-09-19T15:32:19.646257+0000","last_clean":"2024-09-19T15:32:19.646257+0000","last_became_active":"2024-09-19T13:40:44.263313+0000","last_became_peered":"2024-09-19T13:40:44.263313+0000","last_unstale":"2024-09-19T15:32:19.646257+0000","last_undegraded":"2024-09-19T15:32:19.646257+0000","last_fullsized":"2024-09-19T15:32:19.646257+0000","mapping_epoch":35,"log_start":"268'500","ondisk_log_start":"268'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'548","last_scrub_stamp":"2024-09-19T15:32:19.646056+0000","last_deep_scrub":"268'548","last_deep_scrub_stamp":"2024-09-19T15:32:19.646056+0000","last_clean_scrub_stamp":"2024-09-19T15:32:19.646056+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":500,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:42:19.204187+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1297,"num_read_kb":1297,"num_write":1122,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"268'467","reported_seq":2122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.456349+0000","last_change":"2024-09-19T15:31:52.456349+0000","last_active":"2024-09-19T15:31:52.456349+0000","last_peered":"2024-09-19T15:31:52.456349+0000","last_clean":"2024-09-19T15:31:52.456349+0000","last_became_active":"2024-09-19T13:40:36.218822+0000","last_became_peered":"2024-09-19T13:40:36.218822+0000","last_unstale":"2024-09-19T15:31:52.456349+0000","last_undegraded":"2024-09-19T15:31:52.456349+0000","last_fullsized":"2024-09-19T15:31:52.456349+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'467","last_scrub_stamp":"2024-09-19T15:31:52.456167+0000","last_deep_scrub":"268'467","last_deep_scrub_stamp":"2024-09-19T15:31:52.456167+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.456167+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:04:13.506665+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2519,"num_read_kb":2376,"num_write":558,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"268'323","reported_seq":985,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.706063+0000","last_change":"2024-09-19T15:31:56.705812+0000","last_active":"2024-09-19T15:31:56.706063+0000","last_peered":"2024-09-19T15:31:56.706063+0000","last_clean":"2024-09-19T15:31:56.706063+0000","last_became_active":"2024-09-19T13:40:34.278684+0000","last_became_peered":"2024-09-19T13:40:34.278684+0000","last_unstale":"2024-09-19T15:31:56.706063+0000","last_undegraded":"2024-09-19T15:31:56.706063+0000","last_fullsized":"2024-09-19T15:31:56.706063+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'323","last_scrub_stamp":"2024-09-19T15:31:56.705455+0000","last_deep_scrub":"268'323","last_deep_scrub_stamp":"2024-09-19T15:31:56.705455+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.705455+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:31:32.186266+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":542,"num_read_kb":16871,"num_write":997,"num_write_kb":22319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.905540+0000","last_change":"2024-09-19T15:31:58.905540+0000","last_active":"2024-09-19T15:31:58.905540+0000","last_peered":"2024-09-19T15:31:58.905540+0000","last_clean":"2024-09-19T15:31:58.905540+0000","last_became_active":"2024-09-19T13:40:38.228765+0000","last_became_peered":"2024-09-19T13:40:38.228765+0000","last_unstale":"2024-09-19T15:31:58.905540+0000","last_undegraded":"2024-09-19T15:31:58.905540+0000","last_fullsized":"2024-09-19T15:31:58.905540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:58.905356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:58.905356+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.905356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:59.885919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"268'318","reported_seq":949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:12.102311+0000","last_change":"2024-09-19T15:32:12.102311+0000","last_active":"2024-09-19T15:32:12.102311+0000","last_peered":"2024-09-19T15:32:12.102311+0000","last_clean":"2024-09-19T15:32:12.102311+0000","last_became_active":"2024-09-19T13:40:40.226899+0000","last_became_peered":"2024-09-19T13:40:40.226899+0000","last_unstale":"2024-09-19T15:32:12.102311+0000","last_undegraded":"2024-09-19T15:32:12.102311+0000","last_fullsized":"2024-09-19T15:32:12.102311+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'318","last_scrub_stamp":"2024-09-19T15:32:12.102112+0000","last_deep_scrub":"268'318","last_deep_scrub_stamp":"2024-09-19T15:32:12.102112+0000","last_clean_scrub_stamp":"2024-09-19T15:32:12.102112+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:13:50.462555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46888,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":525,"num_read_kb":1137,"num_write":420,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:20.211397+0000","last_change":"2024-09-19T15:32:20.211397+0000","last_active":"2024-09-19T15:32:20.211397+0000","last_peered":"2024-09-19T15:32:20.211397+0000","last_clean":"2024-09-19T15:32:20.211397+0000","last_became_active":"2024-09-19T13:40:42.245030+0000","last_became_peered":"2024-09-19T13:40:42.245030+0000","last_unstale":"2024-09-19T15:32:20.211397+0000","last_undegraded":"2024-09-19T15:32:20.211397+0000","last_fullsized":"2024-09-19T15:32:20.211397+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:20.211223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:20.211223+0000","last_clean_scrub_stamp":"2024-09-19T15:32:20.211223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:11:45.637564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"268'126","reported_seq":645,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.974019+0000","last_change":"2024-09-19T15:32:08.974019+0000","last_active":"2024-09-19T15:32:08.974019+0000","last_peered":"2024-09-19T15:32:08.974019+0000","last_clean":"2024-09-19T15:32:08.974019+0000","last_became_active":"2024-09-19T13:40:44.254015+0000","last_became_peered":"2024-09-19T13:40:44.254015+0000","last_unstale":"2024-09-19T15:32:08.974019+0000","last_undegraded":"2024-09-19T15:32:08.974019+0000","last_fullsized":"2024-09-19T15:32:08.974019+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'126","last_scrub_stamp":"2024-09-19T15:32:08.973841+0000","last_deep_scrub":"268'126","last_deep_scrub_stamp":"2024-09-19T15:32:08.973841+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.973841+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:13:17.778447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":134,"num_write":317,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"268'414","reported_seq":1984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.921763+0000","last_change":"2024-09-19T15:31:55.921763+0000","last_active":"2024-09-19T15:31:55.921763+0000","last_peered":"2024-09-19T15:31:55.921763+0000","last_clean":"2024-09-19T15:31:55.921763+0000","last_became_active":"2024-09-19T13:42:05.613410+0000","last_became_peered":"2024-09-19T13:42:05.613410+0000","last_unstale":"2024-09-19T15:31:55.921763+0000","last_undegraded":"2024-09-19T15:31:55.921763+0000","last_fullsized":"2024-09-19T15:31:55.921763+0000","mapping_epoch":40,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'414","last_scrub_stamp":"2024-09-19T15:31:55.921598+0000","last_deep_scrub":"268'414","last_deep_scrub_stamp":"2024-09-19T15:31:55.921598+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.921598+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:20.548732+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2294,"num_read_kb":2176,"num_write":469,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"268'350","reported_seq":1075,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.766154+0000","last_change":"2024-09-19T15:31:51.766022+0000","last_active":"2024-09-19T15:31:51.766154+0000","last_peered":"2024-09-19T15:31:51.766154+0000","last_clean":"2024-09-19T15:31:51.766154+0000","last_became_active":"2024-09-19T13:40:34.268005+0000","last_became_peered":"2024-09-19T13:40:34.268005+0000","last_unstale":"2024-09-19T15:31:51.766154+0000","last_undegraded":"2024-09-19T15:31:51.766154+0000","last_fullsized":"2024-09-19T15:31:51.766154+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'350","last_scrub_stamp":"2024-09-19T15:31:51.765823+0000","last_deep_scrub":"268'350","last_deep_scrub_stamp":"2024-09-19T15:31:51.765823+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.765823+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:50.728579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":754,"num_read_kb":24616,"num_write":1259,"num_write_kb":39661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.937891+0000","last_change":"2024-09-19T15:32:01.937891+0000","last_active":"2024-09-19T15:32:01.937891+0000","last_peered":"2024-09-19T15:32:01.937891+0000","last_clean":"2024-09-19T15:32:01.937891+0000","last_became_active":"2024-09-19T13:40:38.231698+0000","last_became_peered":"2024-09-19T13:40:38.231698+0000","last_unstale":"2024-09-19T15:32:01.937891+0000","last_undegraded":"2024-09-19T15:32:01.937891+0000","last_fullsized":"2024-09-19T15:32:01.937891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:01.937609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:01.937609+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.937609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:29.037967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"268'401","reported_seq":1071,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:11.645597+0000","last_change":"2024-09-19T15:32:11.645597+0000","last_active":"2024-09-19T15:32:11.645597+0000","last_peered":"2024-09-19T15:32:11.645597+0000","last_clean":"2024-09-19T15:32:11.645597+0000","last_became_active":"2024-09-19T13:40:40.218529+0000","last_became_peered":"2024-09-19T13:40:40.218529+0000","last_unstale":"2024-09-19T15:32:11.645597+0000","last_undegraded":"2024-09-19T15:32:11.645597+0000","last_fullsized":"2024-09-19T15:32:11.645597+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'401","last_scrub_stamp":"2024-09-19T15:32:11.645485+0000","last_deep_scrub":"268'401","last_deep_scrub_stamp":"2024-09-19T15:32:11.645485+0000","last_clean_scrub_stamp":"2024-09-19T15:32:11.645485+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:37.568114+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45323,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":615,"num_read_kb":1192,"num_write":478,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"268'803","reported_seq":3189,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:13.604648+0000","last_change":"2024-09-19T15:32:13.604648+0000","last_active":"2024-09-19T15:32:13.604648+0000","last_peered":"2024-09-19T15:32:13.604648+0000","last_clean":"2024-09-19T15:32:13.604648+0000","last_became_active":"2024-09-19T13:40:42.237168+0000","last_became_peered":"2024-09-19T13:40:42.237168+0000","last_unstale":"2024-09-19T15:32:13.604648+0000","last_undegraded":"2024-09-19T15:32:13.604648+0000","last_fullsized":"2024-09-19T15:32:13.604648+0000","mapping_epoch":33,"log_start":"268'701","ondisk_log_start":"268'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'803","last_scrub_stamp":"2024-09-19T15:32:13.604468+0000","last_deep_scrub":"268'803","last_deep_scrub_stamp":"2024-09-19T15:32:13.604468+0000","last_clean_scrub_stamp":"2024-09-19T15:32:13.604468+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":701,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:45:40.175931+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"268'187","reported_seq":742,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:17.580154+0000","last_change":"2024-09-19T15:32:17.580154+0000","last_active":"2024-09-19T15:32:17.580154+0000","last_peered":"2024-09-19T15:32:17.580154+0000","last_clean":"2024-09-19T15:32:17.580154+0000","last_became_active":"2024-09-19T13:40:44.259964+0000","last_became_peered":"2024-09-19T13:40:44.259964+0000","last_unstale":"2024-09-19T15:32:17.580154+0000","last_undegraded":"2024-09-19T15:32:17.580154+0000","last_fullsized":"2024-09-19T15:32:17.580154+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'187","last_scrub_stamp":"2024-09-19T15:32:17.579976+0000","last_deep_scrub":"268'187","last_deep_scrub_stamp":"2024-09-19T15:32:17.579976+0000","last_clean_scrub_stamp":"2024-09-19T15:32:17.579976+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:21.261184+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":808,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":275,"num_read_kb":244,"num_write":336,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"268'518","reported_seq":2218,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.707048+0000","last_change":"2024-09-19T15:31:55.706807+0000","last_active":"2024-09-19T15:31:55.707048+0000","last_peered":"2024-09-19T15:31:55.707048+0000","last_clean":"2024-09-19T15:31:55.707048+0000","last_became_active":"2024-09-19T13:40:36.221248+0000","last_became_peered":"2024-09-19T13:40:36.221248+0000","last_unstale":"2024-09-19T15:31:55.707048+0000","last_undegraded":"2024-09-19T15:31:55.707048+0000","last_fullsized":"2024-09-19T15:31:55.707048+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'518","last_scrub_stamp":"2024-09-19T15:31:55.706590+0000","last_deep_scrub":"268'518","last_deep_scrub_stamp":"2024-09-19T15:31:55.706590+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.706590+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":500,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:26.121902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2802,"num_read_kb":2611,"num_write":645,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"268'296","reported_seq":951,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.842004+0000","last_change":"2024-09-19T15:31:50.841863+0000","last_active":"2024-09-19T15:31:50.842004+0000","last_peered":"2024-09-19T15:31:50.842004+0000","last_clean":"2024-09-19T15:31:50.842004+0000","last_became_active":"2024-09-19T13:40:34.259994+0000","last_became_peered":"2024-09-19T13:40:34.259994+0000","last_unstale":"2024-09-19T15:31:50.842004+0000","last_undegraded":"2024-09-19T15:31:50.842004+0000","last_fullsized":"2024-09-19T15:31:50.842004+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'296","last_scrub_stamp":"2024-09-19T15:31:50.841553+0000","last_deep_scrub":"268'296","last_deep_scrub_stamp":"2024-09-19T15:31:50.841553+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.841553+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:13.764383+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136829,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":7460,"num_write":978,"num_write_kb":22776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.951669+0000","last_change":"2024-09-19T15:32:00.951669+0000","last_active":"2024-09-19T15:32:00.951669+0000","last_peered":"2024-09-19T15:32:00.951669+0000","last_clean":"2024-09-19T15:32:00.951669+0000","last_became_active":"2024-09-19T13:40:38.245245+0000","last_became_peered":"2024-09-19T13:40:38.245245+0000","last_unstale":"2024-09-19T15:32:00.951669+0000","last_undegraded":"2024-09-19T15:32:00.951669+0000","last_fullsized":"2024-09-19T15:32:00.951669+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:00.951493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:00.951493+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.951493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:47.140968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"268'517","reported_seq":1204,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.700660+0000","last_change":"2024-09-19T15:32:05.700660+0000","last_active":"2024-09-19T15:32:05.700660+0000","last_peered":"2024-09-19T15:32:05.700660+0000","last_clean":"2024-09-19T15:32:05.700660+0000","last_became_active":"2024-09-19T13:40:40.230404+0000","last_became_peered":"2024-09-19T13:40:40.230404+0000","last_unstale":"2024-09-19T15:32:05.700660+0000","last_undegraded":"2024-09-19T15:32:05.700660+0000","last_fullsized":"2024-09-19T15:32:05.700660+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'517","last_scrub_stamp":"2024-09-19T15:32:05.700478+0000","last_deep_scrub":"268'517","last_deep_scrub_stamp":"2024-09-19T15:32:05.700478+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.700478+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:50:06.189367+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93154,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":887,"num_read_kb":2046,"num_write":714,"num_write_kb":570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.950947+0000","last_change":"2024-09-19T15:32:04.950947+0000","last_active":"2024-09-19T15:32:04.950947+0000","last_peered":"2024-09-19T15:32:04.950947+0000","last_clean":"2024-09-19T15:32:04.950947+0000","last_became_active":"2024-09-19T13:40:42.248721+0000","last_became_peered":"2024-09-19T13:40:42.248721+0000","last_unstale":"2024-09-19T15:32:04.950947+0000","last_undegraded":"2024-09-19T15:32:04.950947+0000","last_fullsized":"2024-09-19T15:32:04.950947+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:04.950740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:04.950740+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.950740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:50:58.634069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"268'164","reported_seq":721,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:13.697201+0000","last_change":"2024-09-19T15:32:13.697201+0000","last_active":"2024-09-19T15:32:13.697201+0000","last_peered":"2024-09-19T15:32:13.697201+0000","last_clean":"2024-09-19T15:32:13.697201+0000","last_became_active":"2024-09-19T13:40:44.255644+0000","last_became_peered":"2024-09-19T13:40:44.255644+0000","last_unstale":"2024-09-19T15:32:13.697201+0000","last_undegraded":"2024-09-19T15:32:13.697201+0000","last_fullsized":"2024-09-19T15:32:13.697201+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'164","last_scrub_stamp":"2024-09-19T15:32:13.697000+0000","last_deep_scrub":"268'164","last_deep_scrub_stamp":"2024-09-19T15:32:13.697000+0000","last_clean_scrub_stamp":"2024-09-19T15:32:13.697000+0000","objects_scrubbed":2,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:19:16.779049+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":234,"num_write":369,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"268'797","reported_seq":2382,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.553333+0000","last_change":"2024-09-19T15:31:59.553171+0000","last_active":"2024-09-19T15:31:59.553333+0000","last_peered":"2024-09-19T15:31:59.553333+0000","last_clean":"2024-09-19T15:31:59.553333+0000","last_became_active":"2024-09-19T13:40:36.231071+0000","last_became_peered":"2024-09-19T13:40:36.231071+0000","last_unstale":"2024-09-19T15:31:59.553333+0000","last_undegraded":"2024-09-19T15:31:59.553333+0000","last_fullsized":"2024-09-19T15:31:59.553333+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'797","last_scrub_stamp":"2024-09-19T15:31:59.552987+0000","last_deep_scrub":"268'797","last_deep_scrub_stamp":"2024-09-19T15:31:59.552987+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.552987+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:12.521548+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3782,"num_read_kb":3405,"num_write":1031,"num_write_kb":373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"268'344","reported_seq":1009,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.943708+0000","last_change":"2024-09-19T15:31:53.943571+0000","last_active":"2024-09-19T15:31:53.943708+0000","last_peered":"2024-09-19T15:31:53.943708+0000","last_clean":"2024-09-19T15:31:53.943708+0000","last_became_active":"2024-09-19T13:40:34.229859+0000","last_became_peered":"2024-09-19T13:40:34.229859+0000","last_unstale":"2024-09-19T15:31:53.943708+0000","last_undegraded":"2024-09-19T15:31:53.943708+0000","last_fullsized":"2024-09-19T15:31:53.943708+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'344","last_scrub_stamp":"2024-09-19T15:31:53.943359+0000","last_deep_scrub":"268'344","last_deep_scrub_stamp":"2024-09-19T15:31:53.943359+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.943359+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:11:29.492578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":581,"num_read_kb":8832,"num_write":1027,"num_write_kb":25070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.941343+0000","last_change":"2024-09-19T15:31:59.941343+0000","last_active":"2024-09-19T15:31:59.941343+0000","last_peered":"2024-09-19T15:31:59.941343+0000","last_clean":"2024-09-19T15:31:59.941343+0000","last_became_active":"2024-09-19T13:40:38.233312+0000","last_became_peered":"2024-09-19T13:40:38.233312+0000","last_unstale":"2024-09-19T15:31:59.941343+0000","last_undegraded":"2024-09-19T15:31:59.941343+0000","last_fullsized":"2024-09-19T15:31:59.941343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:59.941164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:59.941164+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.941164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:40:15.114932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"268'335","reported_seq":973,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:12.545619+0000","last_change":"2024-09-19T15:32:12.545619+0000","last_active":"2024-09-19T15:32:12.545619+0000","last_peered":"2024-09-19T15:32:12.545619+0000","last_clean":"2024-09-19T15:32:12.545619+0000","last_became_active":"2024-09-19T13:40:40.247025+0000","last_became_peered":"2024-09-19T13:40:40.247025+0000","last_unstale":"2024-09-19T15:32:12.545619+0000","last_undegraded":"2024-09-19T15:32:12.545619+0000","last_fullsized":"2024-09-19T15:32:12.545619+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'335","last_scrub_stamp":"2024-09-19T15:32:12.545383+0000","last_deep_scrub":"268'335","last_deep_scrub_stamp":"2024-09-19T15:32:12.545383+0000","last_clean_scrub_stamp":"2024-09-19T15:32:12.545383+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:50:50.860604+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47892,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":557,"num_read_kb":1096,"num_write":476,"num_write_kb":343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:12.629800+0000","last_change":"2024-09-19T15:32:12.629800+0000","last_active":"2024-09-19T15:32:12.629800+0000","last_peered":"2024-09-19T15:32:12.629800+0000","last_clean":"2024-09-19T15:32:12.629800+0000","last_became_active":"2024-09-19T13:40:42.243325+0000","last_became_peered":"2024-09-19T13:40:42.243325+0000","last_unstale":"2024-09-19T15:32:12.629800+0000","last_undegraded":"2024-09-19T15:32:12.629800+0000","last_fullsized":"2024-09-19T15:32:12.629800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:12.629625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:12.629625+0000","last_clean_scrub_stamp":"2024-09-19T15:32:12.629625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:25:02.824347+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"268'147","reported_seq":688,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:24.155557+0000","last_change":"2024-09-19T15:32:24.155393+0000","last_active":"2024-09-19T15:32:24.155557+0000","last_peered":"2024-09-19T15:32:24.155557+0000","last_clean":"2024-09-19T15:32:24.155557+0000","last_became_active":"2024-09-19T13:40:44.267716+0000","last_became_peered":"2024-09-19T13:40:44.267716+0000","last_unstale":"2024-09-19T15:32:24.155557+0000","last_undegraded":"2024-09-19T15:32:24.155557+0000","last_fullsized":"2024-09-19T15:32:24.155557+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'147","last_scrub_stamp":"2024-09-19T15:32:24.155219+0000","last_deep_scrub":"268'147","last_deep_scrub_stamp":"2024-09-19T15:32:24.155219+0000","last_clean_scrub_stamp":"2024-09-19T15:32:24.155219+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:34:30.313308+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":190,"num_read_kb":181,"num_write":368,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"268'1170","reported_seq":3000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.490295+0000","last_change":"2024-09-19T15:31:53.490117+0000","last_active":"2024-09-19T15:31:53.490295+0000","last_peered":"2024-09-19T15:31:53.490295+0000","last_clean":"2024-09-19T15:31:53.490295+0000","last_became_active":"2024-09-19T13:40:36.216332+0000","last_became_peered":"2024-09-19T13:40:36.216332+0000","last_unstale":"2024-09-19T15:31:53.490295+0000","last_undegraded":"2024-09-19T15:31:53.490295+0000","last_fullsized":"2024-09-19T15:31:53.490295+0000","mapping_epoch":27,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1170","last_scrub_stamp":"2024-09-19T15:31:53.489935+0000","last_deep_scrub":"268'1170","last_deep_scrub_stamp":"2024-09-19T15:31:53.489935+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.489935+0000","objects_scrubbed":2,"log_size":70,"log_dups_size":1100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:06.157095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5686,"num_read_kb":5084,"num_write":1563,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1534,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"268'376","reported_seq":1055,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:46.953114+0000","last_change":"2024-09-19T15:31:46.952878+0000","last_active":"2024-09-19T15:31:46.953114+0000","last_peered":"2024-09-19T15:31:46.953114+0000","last_clean":"2024-09-19T15:31:46.953114+0000","last_became_active":"2024-09-19T13:41:05.314782+0000","last_became_peered":"2024-09-19T13:41:05.314782+0000","last_unstale":"2024-09-19T15:31:46.953114+0000","last_undegraded":"2024-09-19T15:31:46.953114+0000","last_fullsized":"2024-09-19T15:31:46.953114+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'376","last_scrub_stamp":"2024-09-19T15:31:46.952619+0000","last_deep_scrub":"268'376","last_deep_scrub_stamp":"2024-09-19T15:31:46.952619+0000","last_clean_scrub_stamp":"2024-09-19T15:31:46.952619+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:39:58.061630+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":644,"num_read_kb":47078,"num_write":1156,"num_write_kb":40849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.614797+0000","last_change":"2024-09-19T15:32:00.614797+0000","last_active":"2024-09-19T15:32:00.614797+0000","last_peered":"2024-09-19T15:32:00.614797+0000","last_clean":"2024-09-19T15:32:00.614797+0000","last_became_active":"2024-09-19T13:40:38.246684+0000","last_became_peered":"2024-09-19T13:40:38.246684+0000","last_unstale":"2024-09-19T15:32:00.614797+0000","last_undegraded":"2024-09-19T15:32:00.614797+0000","last_fullsized":"2024-09-19T15:32:00.614797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:00.614607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:00.614607+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.614607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:00.446450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"268'392","reported_seq":1053,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.992019+0000","last_change":"2024-09-19T15:32:03.992019+0000","last_active":"2024-09-19T15:32:03.992019+0000","last_peered":"2024-09-19T15:32:03.992019+0000","last_clean":"2024-09-19T15:32:03.992019+0000","last_became_active":"2024-09-19T13:40:40.221766+0000","last_became_peered":"2024-09-19T13:40:40.221766+0000","last_unstale":"2024-09-19T15:32:03.992019+0000","last_undegraded":"2024-09-19T15:32:03.992019+0000","last_fullsized":"2024-09-19T15:32:03.992019+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'392","last_scrub_stamp":"2024-09-19T15:32:03.991763+0000","last_deep_scrub":"268'392","last_deep_scrub_stamp":"2024-09-19T15:32:03.991763+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.991763+0000","objects_scrubbed":7,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:45.051102+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44832,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":632,"num_read_kb":1260,"num_write":492,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"268'744","reported_seq":3084,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.931429+0000","last_change":"2024-09-19T15:32:06.931429+0000","last_active":"2024-09-19T15:32:06.931429+0000","last_peered":"2024-09-19T15:32:06.931429+0000","last_clean":"2024-09-19T15:32:06.931429+0000","last_became_active":"2024-09-19T13:40:42.246030+0000","last_became_peered":"2024-09-19T13:40:42.246030+0000","last_unstale":"2024-09-19T15:32:06.931429+0000","last_undegraded":"2024-09-19T15:32:06.931429+0000","last_fullsized":"2024-09-19T15:32:06.931429+0000","mapping_epoch":33,"log_start":"268'702","ondisk_log_start":"268'702","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'744","last_scrub_stamp":"2024-09-19T15:32:06.931254+0000","last_deep_scrub":"268'744","last_deep_scrub_stamp":"2024-09-19T15:32:06.931254+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.931254+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":702,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:22:51.911715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"268'127","reported_seq":657,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:11.683400+0000","last_change":"2024-09-19T15:32:11.683400+0000","last_active":"2024-09-19T15:32:11.683400+0000","last_peered":"2024-09-19T15:32:11.683400+0000","last_clean":"2024-09-19T15:32:11.683400+0000","last_became_active":"2024-09-19T13:40:44.249529+0000","last_became_peered":"2024-09-19T13:40:44.249529+0000","last_unstale":"2024-09-19T15:32:11.683400+0000","last_undegraded":"2024-09-19T15:32:11.683400+0000","last_fullsized":"2024-09-19T15:32:11.683400+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'127","last_scrub_stamp":"2024-09-19T15:32:11.683167+0000","last_deep_scrub":"268'127","last_deep_scrub_stamp":"2024-09-19T15:32:11.683167+0000","last_clean_scrub_stamp":"2024-09-19T15:32:11.683167+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:38.497896+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1650,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":290,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"268'1318","reported_seq":3137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.504723+0000","last_change":"2024-09-19T15:31:54.504535+0000","last_active":"2024-09-19T15:31:54.504723+0000","last_peered":"2024-09-19T15:31:54.504723+0000","last_clean":"2024-09-19T15:31:54.504723+0000","last_became_active":"2024-09-19T13:40:36.218760+0000","last_became_peered":"2024-09-19T13:40:36.218760+0000","last_unstale":"2024-09-19T15:31:54.504723+0000","last_undegraded":"2024-09-19T15:31:54.504723+0000","last_fullsized":"2024-09-19T15:31:54.504723+0000","mapping_epoch":27,"log_start":"268'1300","ondisk_log_start":"268'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1318","last_scrub_stamp":"2024-09-19T15:31:54.504354+0000","last_deep_scrub":"268'1318","last_deep_scrub_stamp":"2024-09-19T15:31:54.504354+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.504354+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":1300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:19:34.417947+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6184,"num_read_kb":5469,"num_write":1814,"num_write_kb":747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"268'395","reported_seq":1112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.562943+0000","last_change":"2024-09-19T15:31:48.562943+0000","last_active":"2024-09-19T15:31:48.562943+0000","last_peered":"2024-09-19T15:31:48.562943+0000","last_clean":"2024-09-19T15:31:48.562943+0000","last_became_active":"2024-09-19T13:40:34.264354+0000","last_became_peered":"2024-09-19T13:40:34.264354+0000","last_unstale":"2024-09-19T15:31:48.562943+0000","last_undegraded":"2024-09-19T15:31:48.562943+0000","last_fullsized":"2024-09-19T15:31:48.562943+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'395","last_scrub_stamp":"2024-09-19T15:31:48.562728+0000","last_deep_scrub":"268'395","last_deep_scrub_stamp":"2024-09-19T15:31:48.562728+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.562728+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:53.759979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":738,"num_read_kb":5537,"num_write":1291,"num_write_kb":30004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"268'4","reported_seq":1495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:09.740426+0000","last_change":"2024-09-19T15:32:09.740426+0000","last_active":"2024-09-19T15:32:09.740426+0000","last_peered":"2024-09-19T15:32:09.740426+0000","last_clean":"2024-09-19T15:32:09.740426+0000","last_became_active":"2024-09-19T13:40:38.225663+0000","last_became_peered":"2024-09-19T13:40:38.225663+0000","last_unstale":"2024-09-19T15:32:09.740426+0000","last_undegraded":"2024-09-19T15:32:09.740426+0000","last_fullsized":"2024-09-19T15:32:09.740426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-19T15:32:09.740237+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-19T15:32:09.740237+0000","last_clean_scrub_stamp":"2024-09-19T15:32:09.740237+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:46:34.207630+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":948,"num_read_kb":948,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"268'152","reported_seq":745,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:13.115013+0000","last_change":"2024-09-19T15:32:13.115013+0000","last_active":"2024-09-19T15:32:13.115013+0000","last_peered":"2024-09-19T15:32:13.115013+0000","last_clean":"2024-09-19T15:32:13.115013+0000","last_became_active":"2024-09-19T13:40:40.220534+0000","last_became_peered":"2024-09-19T13:40:40.220534+0000","last_unstale":"2024-09-19T15:32:13.115013+0000","last_undegraded":"2024-09-19T15:32:13.115013+0000","last_fullsized":"2024-09-19T15:32:13.115013+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'152","last_scrub_stamp":"2024-09-19T15:32:13.114764+0000","last_deep_scrub":"268'152","last_deep_scrub_stamp":"2024-09-19T15:32:13.114764+0000","last_clean_scrub_stamp":"2024-09-19T15:32:13.114764+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:44.466910+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":182,"num_read_kb":176,"num_write":122,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"268'765","reported_seq":5689,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.994466+0000","last_change":"2024-09-19T15:32:04.994466+0000","last_active":"2024-09-19T15:32:04.994466+0000","last_peered":"2024-09-19T15:32:04.994466+0000","last_clean":"2024-09-19T15:32:04.994466+0000","last_became_active":"2024-09-19T13:40:42.240074+0000","last_became_peered":"2024-09-19T13:40:42.240074+0000","last_unstale":"2024-09-19T15:32:04.994466+0000","last_undegraded":"2024-09-19T15:32:04.994466+0000","last_fullsized":"2024-09-19T15:32:04.994466+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'765","last_scrub_stamp":"2024-09-19T15:32:04.994274+0000","last_deep_scrub":"268'765","last_deep_scrub_stamp":"2024-09-19T15:32:04.994274+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.994274+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:38.710010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"268'114","reported_seq":644,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:19.609109+0000","last_change":"2024-09-19T15:32:19.609109+0000","last_active":"2024-09-19T15:32:19.609109+0000","last_peered":"2024-09-19T15:32:19.609109+0000","last_clean":"2024-09-19T15:32:19.609109+0000","last_became_active":"2024-09-19T13:40:44.251353+0000","last_became_peered":"2024-09-19T13:40:44.251353+0000","last_unstale":"2024-09-19T15:32:19.609109+0000","last_undegraded":"2024-09-19T15:32:19.609109+0000","last_fullsized":"2024-09-19T15:32:19.609109+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'114","last_scrub_stamp":"2024-09-19T15:32:19.608922+0000","last_deep_scrub":"268'114","last_deep_scrub_stamp":"2024-09-19T15:32:19.608922+0000","last_clean_scrub_stamp":"2024-09-19T15:32:19.608922+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:32.666808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":129,"num_read_kb":126,"num_write":279,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"268'1844","reported_seq":3622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.612221+0000","last_change":"2024-09-19T15:31:56.612221+0000","last_active":"2024-09-19T15:31:56.612221+0000","last_peered":"2024-09-19T15:31:56.612221+0000","last_clean":"2024-09-19T15:31:56.612221+0000","last_became_active":"2024-09-19T13:40:36.221638+0000","last_became_peered":"2024-09-19T13:40:36.221638+0000","last_unstale":"2024-09-19T15:31:56.612221+0000","last_undegraded":"2024-09-19T15:31:56.612221+0000","last_fullsized":"2024-09-19T15:31:56.612221+0000","mapping_epoch":27,"log_start":"268'1800","ondisk_log_start":"268'1800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1844","last_scrub_stamp":"2024-09-19T15:31:56.612043+0000","last_deep_scrub":"268'1844","last_deep_scrub_stamp":"2024-09-19T15:31:56.612043+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.612043+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":1800,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:26.022150+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8811,"num_read_kb":7740,"num_write":2693,"num_write_kb":1220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"268'357","reported_seq":1061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.880923+0000","last_change":"2024-09-19T15:31:48.880923+0000","last_active":"2024-09-19T15:31:48.880923+0000","last_peered":"2024-09-19T15:31:48.880923+0000","last_clean":"2024-09-19T15:31:48.880923+0000","last_became_active":"2024-09-19T13:40:34.236257+0000","last_became_peered":"2024-09-19T13:40:34.236257+0000","last_unstale":"2024-09-19T15:31:48.880923+0000","last_undegraded":"2024-09-19T15:31:48.880923+0000","last_fullsized":"2024-09-19T15:31:48.880923+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'357","last_scrub_stamp":"2024-09-19T15:31:48.880705+0000","last_deep_scrub":"268'357","last_deep_scrub_stamp":"2024-09-19T15:31:48.880705+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.880705+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:23.093501+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136845,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":663,"num_read_kb":21601,"num_write":1219,"num_write_kb":27464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:09.574695+0000","last_change":"2024-09-19T15:32:09.574695+0000","last_active":"2024-09-19T15:32:09.574695+0000","last_peered":"2024-09-19T15:32:09.574695+0000","last_clean":"2024-09-19T15:32:09.574695+0000","last_became_active":"2024-09-19T13:40:38.235737+0000","last_became_peered":"2024-09-19T13:40:38.235737+0000","last_unstale":"2024-09-19T15:32:09.574695+0000","last_undegraded":"2024-09-19T15:32:09.574695+0000","last_fullsized":"2024-09-19T15:32:09.574695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:09.574502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:09.574502+0000","last_clean_scrub_stamp":"2024-09-19T15:32:09.574502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:24.866773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"268'558","reported_seq":1259,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:15.673846+0000","last_change":"2024-09-19T15:32:15.673846+0000","last_active":"2024-09-19T15:32:15.673846+0000","last_peered":"2024-09-19T15:32:15.673846+0000","last_clean":"2024-09-19T15:32:15.673846+0000","last_became_active":"2024-09-19T13:40:40.235679+0000","last_became_peered":"2024-09-19T13:40:40.235679+0000","last_unstale":"2024-09-19T15:32:15.673846+0000","last_undegraded":"2024-09-19T15:32:15.673846+0000","last_fullsized":"2024-09-19T15:32:15.673846+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'558","last_scrub_stamp":"2024-09-19T15:32:15.673706+0000","last_deep_scrub":"268'558","last_deep_scrub_stamp":"2024-09-19T15:32:15.673706+0000","last_clean_scrub_stamp":"2024-09-19T15:32:15.673706+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:08:05.911020+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50661,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1488,"num_read_kb":2077,"num_write":2114,"num_write_kb":1883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":517528,"num_omap_keys":1192,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.022561+0000","last_change":"2024-09-19T15:32:04.022561+0000","last_active":"2024-09-19T15:32:04.022561+0000","last_peered":"2024-09-19T15:32:04.022561+0000","last_clean":"2024-09-19T15:32:04.022561+0000","last_became_active":"2024-09-19T13:40:42.250462+0000","last_became_peered":"2024-09-19T13:40:42.250462+0000","last_unstale":"2024-09-19T15:32:04.022561+0000","last_undegraded":"2024-09-19T15:32:04.022561+0000","last_fullsized":"2024-09-19T15:32:04.022561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:04.022361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:04.022361+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.022361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:05.155379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"268'149","reported_seq":688,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:12.725072+0000","last_change":"2024-09-19T15:32:12.725072+0000","last_active":"2024-09-19T15:32:12.725072+0000","last_peered":"2024-09-19T15:32:12.725072+0000","last_clean":"2024-09-19T15:32:12.725072+0000","last_became_active":"2024-09-19T13:40:44.266642+0000","last_became_peered":"2024-09-19T13:40:44.266642+0000","last_unstale":"2024-09-19T15:32:12.725072+0000","last_undegraded":"2024-09-19T15:32:12.725072+0000","last_fullsized":"2024-09-19T15:32:12.725072+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'149","last_scrub_stamp":"2024-09-19T15:32:12.724895+0000","last_deep_scrub":"268'149","last_deep_scrub_stamp":"2024-09-19T15:32:12.724895+0000","last_clean_scrub_stamp":"2024-09-19T15:32:12.724895+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:08:26.047796+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":223,"num_read_kb":208,"num_write":352,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"268'502","reported_seq":2081,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.895993+0000","last_change":"2024-09-19T15:31:53.895993+0000","last_active":"2024-09-19T15:31:53.895993+0000","last_peered":"2024-09-19T15:31:53.895993+0000","last_clean":"2024-09-19T15:31:53.895993+0000","last_became_active":"2024-09-19T13:40:36.218550+0000","last_became_peered":"2024-09-19T13:40:36.218550+0000","last_unstale":"2024-09-19T15:31:53.895993+0000","last_undegraded":"2024-09-19T15:31:53.895993+0000","last_fullsized":"2024-09-19T15:31:53.895993+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'502","last_scrub_stamp":"2024-09-19T15:31:53.895802+0000","last_deep_scrub":"268'502","last_deep_scrub_stamp":"2024-09-19T15:31:53.895802+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.895802+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:03:34.157384+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2652,"num_read_kb":2446,"num_write":622,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"268'74","reported_seq":664,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.790835+0000","last_change":"2024-09-19T15:31:48.790703+0000","last_active":"2024-09-19T15:31:48.790835+0000","last_peered":"2024-09-19T15:31:48.790835+0000","last_clean":"2024-09-19T15:31:48.790835+0000","last_became_active":"2024-09-19T13:40:13.615965+0000","last_became_peered":"2024-09-19T13:40:13.615965+0000","last_unstale":"2024-09-19T15:31:48.790835+0000","last_undegraded":"2024-09-19T15:31:48.790835+0000","last_fullsized":"2024-09-19T15:31:48.790835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'74","last_scrub_stamp":"2024-09-19T15:31:48.790514+0000","last_deep_scrub":"268'74","last_deep_scrub_stamp":"2024-09-19T15:31:48.790514+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.790514+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:19.499884+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"268'2","reported_seq":576,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.839307+0000","last_change":"2024-09-19T15:31:48.839150+0000","last_active":"2024-09-19T15:31:48.839307+0000","last_peered":"2024-09-19T15:31:48.839307+0000","last_clean":"2024-09-19T15:31:48.839307+0000","last_became_active":"2024-09-19T13:40:20.100760+0000","last_became_peered":"2024-09-19T13:40:20.100760+0000","last_unstale":"2024-09-19T15:31:48.839307+0000","last_undegraded":"2024-09-19T15:31:48.839307+0000","last_fullsized":"2024-09-19T15:31:48.839307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:31:48.838968+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:31:48.838968+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.838968+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:39.704823+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001106569,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"268'318","reported_seq":1011,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.849678+0000","last_change":"2024-09-19T15:31:47.849582+0000","last_active":"2024-09-19T15:31:47.849678+0000","last_peered":"2024-09-19T15:31:47.849678+0000","last_clean":"2024-09-19T15:31:47.849678+0000","last_became_active":"2024-09-19T13:40:34.241162+0000","last_became_peered":"2024-09-19T13:40:34.241162+0000","last_unstale":"2024-09-19T15:31:47.849678+0000","last_undegraded":"2024-09-19T15:31:47.849678+0000","last_fullsized":"2024-09-19T15:31:47.849678+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'318","last_scrub_stamp":"2024-09-19T15:31:47.849462+0000","last_deep_scrub":"268'318","last_deep_scrub_stamp":"2024-09-19T15:31:47.849462+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.849462+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:11.026243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":104186,"num_write":970,"num_write_kb":16810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":542,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.709741+0000","last_change":"2024-09-19T15:32:05.709741+0000","last_active":"2024-09-19T15:32:05.709741+0000","last_peered":"2024-09-19T15:32:05.709741+0000","last_clean":"2024-09-19T15:32:05.709741+0000","last_became_active":"2024-09-19T13:40:38.231762+0000","last_became_peered":"2024-09-19T13:40:38.231762+0000","last_unstale":"2024-09-19T15:32:05.709741+0000","last_undegraded":"2024-09-19T15:32:05.709741+0000","last_fullsized":"2024-09-19T15:32:05.709741+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:05.709473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:05.709473+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.709473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:16:34.993980+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"268'762","reported_seq":1529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:13.705887+0000","last_change":"2024-09-19T15:32:13.705887+0000","last_active":"2024-09-19T15:32:13.705887+0000","last_peered":"2024-09-19T15:32:13.705887+0000","last_clean":"2024-09-19T15:32:13.705887+0000","last_became_active":"2024-09-19T13:40:40.239392+0000","last_became_peered":"2024-09-19T13:40:40.239392+0000","last_unstale":"2024-09-19T15:32:13.705887+0000","last_undegraded":"2024-09-19T15:32:13.705887+0000","last_fullsized":"2024-09-19T15:32:13.705887+0000","mapping_epoch":31,"log_start":"268'700","ondisk_log_start":"268'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'762","last_scrub_stamp":"2024-09-19T15:32:13.705693+0000","last_deep_scrub":"268'762","last_deep_scrub_stamp":"2024-09-19T15:32:13.705693+0000","last_clean_scrub_stamp":"2024-09-19T15:32:13.705693+0000","objects_scrubbed":6,"log_size":62,"log_dups_size":700,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:58.948100+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146379,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1466,"num_read_kb":3232,"num_write":1394,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89512,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:11.635083+0000","last_change":"2024-09-19T15:32:11.635083+0000","last_active":"2024-09-19T15:32:11.635083+0000","last_peered":"2024-09-19T15:32:11.635083+0000","last_clean":"2024-09-19T15:32:11.635083+0000","last_became_active":"2024-09-19T13:40:42.239749+0000","last_became_peered":"2024-09-19T13:40:42.239749+0000","last_unstale":"2024-09-19T15:32:11.635083+0000","last_undegraded":"2024-09-19T15:32:11.635083+0000","last_fullsized":"2024-09-19T15:32:11.635083+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:11.634896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:11.634896+0000","last_clean_scrub_stamp":"2024-09-19T15:32:11.634896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:49.517598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"268'202","reported_seq":931,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:10.013388+0000","last_change":"2024-09-19T15:32:10.013388+0000","last_active":"2024-09-19T15:32:10.013388+0000","last_peered":"2024-09-19T15:32:10.013388+0000","last_clean":"2024-09-19T15:32:10.013388+0000","last_became_active":"2024-09-19T13:40:44.264456+0000","last_became_peered":"2024-09-19T13:40:44.264456+0000","last_unstale":"2024-09-19T15:32:10.013388+0000","last_undegraded":"2024-09-19T15:32:10.013388+0000","last_fullsized":"2024-09-19T15:32:10.013388+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'202","last_scrub_stamp":"2024-09-19T15:32:10.013305+0000","last_deep_scrub":"268'202","last_deep_scrub_stamp":"2024-09-19T15:32:10.013305+0000","last_clean_scrub_stamp":"2024-09-19T15:32:10.013305+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:58:41.371854+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":469,"num_read_kb":469,"num_write":408,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"268'754","reported_seq":2277,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.751994+0000","last_change":"2024-09-19T15:31:54.751994+0000","last_active":"2024-09-19T15:31:54.751994+0000","last_peered":"2024-09-19T15:31:54.751994+0000","last_clean":"2024-09-19T15:31:54.751994+0000","last_became_active":"2024-09-19T13:40:36.221186+0000","last_became_peered":"2024-09-19T13:40:36.221186+0000","last_unstale":"2024-09-19T15:31:54.751994+0000","last_undegraded":"2024-09-19T15:31:54.751994+0000","last_fullsized":"2024-09-19T15:31:54.751994+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'754","last_scrub_stamp":"2024-09-19T15:31:54.751805+0000","last_deep_scrub":"268'754","last_deep_scrub_stamp":"2024-09-19T15:31:54.751805+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.751805+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:42:16.653037+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3545,"num_read_kb":3202,"num_write":973,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":571,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.770417+0000","last_change":"2024-09-19T15:31:49.770258+0000","last_active":"2024-09-19T15:31:49.770417+0000","last_peered":"2024-09-19T15:31:49.770417+0000","last_clean":"2024-09-19T15:31:49.770417+0000","last_became_active":"2024-09-19T13:40:20.099608+0000","last_became_peered":"2024-09-19T13:40:20.099608+0000","last_unstale":"2024-09-19T15:31:49.770417+0000","last_undegraded":"2024-09-19T15:31:49.770417+0000","last_fullsized":"2024-09-19T15:31:49.770417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:49.770079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:49.770079+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.770079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:35.739125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001034798,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"268'310","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:44.606408+0000","last_change":"2024-09-19T15:31:44.606331+0000","last_active":"2024-09-19T15:31:44.606408+0000","last_peered":"2024-09-19T15:31:44.606408+0000","last_clean":"2024-09-19T15:31:44.606408+0000","last_became_active":"2024-09-19T13:40:34.264819+0000","last_became_peered":"2024-09-19T13:40:34.264819+0000","last_unstale":"2024-09-19T15:31:44.606408+0000","last_undegraded":"2024-09-19T15:31:44.606408+0000","last_fullsized":"2024-09-19T15:31:44.606408+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'310","last_scrub_stamp":"2024-09-19T15:31:44.606212+0000","last_deep_scrub":"268'310","last_deep_scrub_stamp":"2024-09-19T15:31:44.606212+0000","last_clean_scrub_stamp":"2024-09-19T15:31:44.606212+0000","objects_scrubbed":3,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:25:58.694141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":579,"num_read_kb":52358,"num_write":971,"num_write_kb":38982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":545,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.770241+0000","last_change":"2024-09-19T15:32:08.770241+0000","last_active":"2024-09-19T15:32:08.770241+0000","last_peered":"2024-09-19T15:32:08.770241+0000","last_clean":"2024-09-19T15:32:08.770241+0000","last_became_active":"2024-09-19T13:40:38.222905+0000","last_became_peered":"2024-09-19T13:40:38.222905+0000","last_unstale":"2024-09-19T15:32:08.770241+0000","last_undegraded":"2024-09-19T15:32:08.770241+0000","last_fullsized":"2024-09-19T15:32:08.770241+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:08.770061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:08.770061+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.770061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:39:12.097558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"268'1445","reported_seq":3773,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.602207+0000","last_change":"2024-09-19T15:32:07.602207+0000","last_active":"2024-09-19T15:32:07.602207+0000","last_peered":"2024-09-19T15:32:07.602207+0000","last_clean":"2024-09-19T15:32:07.602207+0000","last_became_active":"2024-09-19T13:40:40.240768+0000","last_became_peered":"2024-09-19T13:40:40.240768+0000","last_unstale":"2024-09-19T15:32:07.602207+0000","last_undegraded":"2024-09-19T15:32:07.602207+0000","last_fullsized":"2024-09-19T15:32:07.602207+0000","mapping_epoch":31,"log_start":"268'1400","ondisk_log_start":"268'1400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1445","last_scrub_stamp":"2024-09-19T15:32:07.602011+0000","last_deep_scrub":"268'1445","last_deep_scrub_stamp":"2024-09-19T15:32:07.602011+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.602011+0000","objects_scrubbed":11,"log_size":45,"log_dups_size":1400,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:33:19.664247+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140168,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":2240,"num_read_kb":4108,"num_write":1354,"num_write_kb":1102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:15.675453+0000","last_change":"2024-09-19T15:32:15.675453+0000","last_active":"2024-09-19T15:32:15.675453+0000","last_peered":"2024-09-19T15:32:15.675453+0000","last_clean":"2024-09-19T15:32:15.675453+0000","last_became_active":"2024-09-19T13:40:42.250172+0000","last_became_peered":"2024-09-19T13:40:42.250172+0000","last_unstale":"2024-09-19T15:32:15.675453+0000","last_undegraded":"2024-09-19T15:32:15.675453+0000","last_fullsized":"2024-09-19T15:32:15.675453+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:15.675277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:15.675277+0000","last_clean_scrub_stamp":"2024-09-19T15:32:15.675277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:42.491231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"268'253","reported_seq":850,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:16.648130+0000","last_change":"2024-09-19T15:32:16.648130+0000","last_active":"2024-09-19T15:32:16.648130+0000","last_peered":"2024-09-19T15:32:16.648130+0000","last_clean":"2024-09-19T15:32:16.648130+0000","last_became_active":"2024-09-19T13:40:44.272356+0000","last_became_peered":"2024-09-19T13:40:44.272356+0000","last_unstale":"2024-09-19T15:32:16.648130+0000","last_undegraded":"2024-09-19T15:32:16.648130+0000","last_fullsized":"2024-09-19T15:32:16.648130+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'253","last_scrub_stamp":"2024-09-19T15:32:16.647930+0000","last_deep_scrub":"268'253","last_deep_scrub_stamp":"2024-09-19T15:32:16.647930+0000","last_clean_scrub_stamp":"2024-09-19T15:32:16.647930+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:12.305679+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":580,"num_read_kb":531,"num_write":551,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"268'465","reported_seq":2147,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.602220+0000","last_change":"2024-09-19T15:31:54.602220+0000","last_active":"2024-09-19T15:31:54.602220+0000","last_peered":"2024-09-19T15:31:54.602220+0000","last_clean":"2024-09-19T15:31:54.602220+0000","last_became_active":"2024-09-19T13:40:36.241832+0000","last_became_peered":"2024-09-19T13:40:36.241832+0000","last_unstale":"2024-09-19T15:31:54.602220+0000","last_undegraded":"2024-09-19T15:31:54.602220+0000","last_fullsized":"2024-09-19T15:31:54.602220+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'465","last_scrub_stamp":"2024-09-19T15:31:54.602015+0000","last_deep_scrub":"268'465","last_deep_scrub_stamp":"2024-09-19T15:31:54.602015+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.602015+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:16:12.446436+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2706,"num_read_kb":2545,"num_write":558,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":562,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:45.916688+0000","last_change":"2024-09-19T15:31:45.916600+0000","last_active":"2024-09-19T15:31:45.916688+0000","last_peered":"2024-09-19T15:31:45.916688+0000","last_clean":"2024-09-19T15:31:45.916688+0000","last_became_active":"2024-09-19T13:40:20.096900+0000","last_became_peered":"2024-09-19T13:40:20.096900+0000","last_unstale":"2024-09-19T15:31:45.916688+0000","last_undegraded":"2024-09-19T15:31:45.916688+0000","last_fullsized":"2024-09-19T15:31:45.916688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:45.916488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:45.916488+0000","last_clean_scrub_stamp":"2024-09-19T15:31:45.916488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:25:28.228849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00074274699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"268'333","reported_seq":1005,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:46.591552+0000","last_change":"2024-09-19T15:31:46.591446+0000","last_active":"2024-09-19T15:31:46.591552+0000","last_peered":"2024-09-19T15:31:46.591552+0000","last_clean":"2024-09-19T15:31:46.591552+0000","last_became_active":"2024-09-19T13:40:34.235483+0000","last_became_peered":"2024-09-19T13:40:34.235483+0000","last_unstale":"2024-09-19T15:31:46.591552+0000","last_undegraded":"2024-09-19T15:31:46.591552+0000","last_fullsized":"2024-09-19T15:31:46.591552+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'333","last_scrub_stamp":"2024-09-19T15:31:46.591292+0000","last_deep_scrub":"268'333","last_deep_scrub_stamp":"2024-09-19T15:31:46.591292+0000","last_clean_scrub_stamp":"2024-09-19T15:31:46.591292+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:29:16.796032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":610,"num_read_kb":5129,"num_write":1002,"num_write_kb":29541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"268'2","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.858708+0000","last_change":"2024-09-19T15:31:55.858708+0000","last_active":"2024-09-19T15:31:55.858708+0000","last_peered":"2024-09-19T15:31:55.858708+0000","last_clean":"2024-09-19T15:31:55.858708+0000","last_became_active":"2024-09-19T13:40:38.228364+0000","last_became_peered":"2024-09-19T13:40:38.228364+0000","last_unstale":"2024-09-19T15:31:55.858708+0000","last_undegraded":"2024-09-19T15:31:55.858708+0000","last_fullsized":"2024-09-19T15:31:55.858708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:31:55.858532+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:31:55.858532+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.858532+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:13:50.260015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"268'376","reported_seq":2321,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:10.621029+0000","last_change":"2024-09-19T15:32:10.621029+0000","last_active":"2024-09-19T15:32:10.621029+0000","last_peered":"2024-09-19T15:32:10.621029+0000","last_clean":"2024-09-19T15:32:10.621029+0000","last_became_active":"2024-09-19T13:40:40.231491+0000","last_became_peered":"2024-09-19T13:40:40.231491+0000","last_unstale":"2024-09-19T15:32:10.621029+0000","last_undegraded":"2024-09-19T15:32:10.621029+0000","last_fullsized":"2024-09-19T15:32:10.621029+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'376","last_scrub_stamp":"2024-09-19T15:32:10.620833+0000","last_deep_scrub":"268'376","last_deep_scrub_stamp":"2024-09-19T15:32:10.620833+0000","last_clean_scrub_stamp":"2024-09-19T15:32:10.620833+0000","objects_scrubbed":9,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:23:33.220998+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":364,"num_read_kb":356,"num_write":351,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5582,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:09.669183+0000","last_change":"2024-09-19T15:32:09.669183+0000","last_active":"2024-09-19T15:32:09.669183+0000","last_peered":"2024-09-19T15:32:09.669183+0000","last_clean":"2024-09-19T15:32:09.669183+0000","last_became_active":"2024-09-19T13:40:42.226706+0000","last_became_peered":"2024-09-19T13:40:42.226706+0000","last_unstale":"2024-09-19T15:32:09.669183+0000","last_undegraded":"2024-09-19T15:32:09.669183+0000","last_fullsized":"2024-09-19T15:32:09.669183+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:09.668955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:09.668955+0000","last_clean_scrub_stamp":"2024-09-19T15:32:09.668955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:20.743988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"268'260","reported_seq":918,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:23.162860+0000","last_change":"2024-09-19T15:32:23.162860+0000","last_active":"2024-09-19T15:32:23.162860+0000","last_peered":"2024-09-19T15:32:23.162860+0000","last_clean":"2024-09-19T15:32:23.162860+0000","last_became_active":"2024-09-19T13:40:44.240277+0000","last_became_peered":"2024-09-19T13:40:44.240277+0000","last_unstale":"2024-09-19T15:32:23.162860+0000","last_undegraded":"2024-09-19T15:32:23.162860+0000","last_fullsized":"2024-09-19T15:32:23.162860+0000","mapping_epoch":35,"log_start":"268'200","ondisk_log_start":"268'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'260","last_scrub_stamp":"2024-09-19T15:32:23.162672+0000","last_deep_scrub":"268'260","last_deep_scrub_stamp":"2024-09-19T15:32:23.162672+0000","last_clean_scrub_stamp":"2024-09-19T15:32:23.162672+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:16:24.144823+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":590,"num_read_kb":596,"num_write":565,"num_write_kb":164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"268'478","reported_seq":2088,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.589333+0000","last_change":"2024-09-19T15:31:52.589189+0000","last_active":"2024-09-19T15:31:52.589333+0000","last_peered":"2024-09-19T15:31:52.589333+0000","last_clean":"2024-09-19T15:31:52.589333+0000","last_became_active":"2024-09-19T13:40:36.220514+0000","last_became_peered":"2024-09-19T13:40:36.220514+0000","last_unstale":"2024-09-19T15:31:52.589333+0000","last_undegraded":"2024-09-19T15:31:52.589333+0000","last_fullsized":"2024-09-19T15:31:52.589333+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'478","last_scrub_stamp":"2024-09-19T15:31:52.588993+0000","last_deep_scrub":"268'478","last_deep_scrub_stamp":"2024-09-19T15:31:52.588993+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.588993+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:13.983822+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2550,"num_read_kb":2381,"num_write":569,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"268'3","reported_seq":577,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.884123+0000","last_change":"2024-09-19T15:31:49.883980+0000","last_active":"2024-09-19T15:31:49.884123+0000","last_peered":"2024-09-19T15:31:49.884123+0000","last_clean":"2024-09-19T15:31:49.884123+0000","last_became_active":"2024-09-19T13:40:20.101198+0000","last_became_peered":"2024-09-19T13:40:20.101198+0000","last_unstale":"2024-09-19T15:31:49.884123+0000","last_undegraded":"2024-09-19T15:31:49.884123+0000","last_fullsized":"2024-09-19T15:31:49.884123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-19T15:31:49.883770+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-19T15:31:49.883770+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.883770+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:31.078465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0026053059999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"268'331","reported_seq":1003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.535314+0000","last_change":"2024-09-19T15:31:49.535052+0000","last_active":"2024-09-19T15:31:49.535314+0000","last_peered":"2024-09-19T15:31:49.535314+0000","last_clean":"2024-09-19T15:31:49.535314+0000","last_became_active":"2024-09-19T13:40:34.228632+0000","last_became_peered":"2024-09-19T13:40:34.228632+0000","last_unstale":"2024-09-19T15:31:49.535314+0000","last_undegraded":"2024-09-19T15:31:49.535314+0000","last_fullsized":"2024-09-19T15:31:49.535314+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'331","last_scrub_stamp":"2024-09-19T15:31:49.534756+0000","last_deep_scrub":"268'331","last_deep_scrub_stamp":"2024-09-19T15:31:49.534756+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.534756+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:30.697194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":586,"num_read_kb":6959,"num_write":997,"num_write_kb":25273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.682193+0000","last_change":"2024-09-19T15:32:02.682193+0000","last_active":"2024-09-19T15:32:02.682193+0000","last_peered":"2024-09-19T15:32:02.682193+0000","last_clean":"2024-09-19T15:32:02.682193+0000","last_became_active":"2024-09-19T13:40:38.229144+0000","last_became_peered":"2024-09-19T13:40:38.229144+0000","last_unstale":"2024-09-19T15:32:02.682193+0000","last_undegraded":"2024-09-19T15:32:02.682193+0000","last_fullsized":"2024-09-19T15:32:02.682193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:02.681899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:02.681899+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.681899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:38:34.444774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"268'221","reported_seq":844,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:11.123386+0000","last_change":"2024-09-19T15:32:11.123386+0000","last_active":"2024-09-19T15:32:11.123386+0000","last_peered":"2024-09-19T15:32:11.123386+0000","last_clean":"2024-09-19T15:32:11.123386+0000","last_became_active":"2024-09-19T13:40:40.249102+0000","last_became_peered":"2024-09-19T13:40:40.249102+0000","last_unstale":"2024-09-19T15:32:11.123386+0000","last_undegraded":"2024-09-19T15:32:11.123386+0000","last_fullsized":"2024-09-19T15:32:11.123386+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'221","last_scrub_stamp":"2024-09-19T15:32:11.123189+0000","last_deep_scrub":"268'221","last_deep_scrub_stamp":"2024-09-19T15:32:11.123189+0000","last_clean_scrub_stamp":"2024-09-19T15:32:11.123189+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:43.556142+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":273,"num_read_kb":267,"num_write":198,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.976413+0000","last_change":"2024-09-19T15:32:02.976413+0000","last_active":"2024-09-19T15:32:02.976413+0000","last_peered":"2024-09-19T15:32:02.976413+0000","last_clean":"2024-09-19T15:32:02.976413+0000","last_became_active":"2024-09-19T13:40:42.250662+0000","last_became_peered":"2024-09-19T13:40:42.250662+0000","last_unstale":"2024-09-19T15:32:02.976413+0000","last_undegraded":"2024-09-19T15:32:02.976413+0000","last_fullsized":"2024-09-19T15:32:02.976413+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:02.976144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:02.976144+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.976144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:01:47.323179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"268'129","reported_seq":729,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:20.690284+0000","last_change":"2024-09-19T15:32:20.690284+0000","last_active":"2024-09-19T15:32:20.690284+0000","last_peered":"2024-09-19T15:32:20.690284+0000","last_clean":"2024-09-19T15:32:20.690284+0000","last_became_active":"2024-09-19T13:40:44.266678+0000","last_became_peered":"2024-09-19T13:40:44.266678+0000","last_unstale":"2024-09-19T15:32:20.690284+0000","last_undegraded":"2024-09-19T15:32:20.690284+0000","last_fullsized":"2024-09-19T15:32:20.690284+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'129","last_scrub_stamp":"2024-09-19T15:32:20.690092+0000","last_deep_scrub":"268'129","last_deep_scrub_stamp":"2024-09-19T15:32:20.690092+0000","last_clean_scrub_stamp":"2024-09-19T15:32:20.690092+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:58:14.495253+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":644,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":283,"num_read_kb":273,"num_write":324,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"268'763","reported_seq":2299,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.608453+0000","last_change":"2024-09-19T15:31:51.608306+0000","last_active":"2024-09-19T15:31:51.608453+0000","last_peered":"2024-09-19T15:31:51.608453+0000","last_clean":"2024-09-19T15:31:51.608453+0000","last_became_active":"2024-09-19T13:40:36.244403+0000","last_became_peered":"2024-09-19T13:40:36.244403+0000","last_unstale":"2024-09-19T15:31:51.608453+0000","last_undegraded":"2024-09-19T15:31:51.608453+0000","last_fullsized":"2024-09-19T15:31:51.608453+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'763","last_scrub_stamp":"2024-09-19T15:31:51.608119+0000","last_deep_scrub":"268'763","last_deep_scrub_stamp":"2024-09-19T15:31:51.608119+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.608119+0000","objects_scrubbed":4,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:20:55.798909+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3619,"num_read_kb":3269,"num_write":981,"num_write_kb":347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"268'331","reported_seq":1054,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.872562+0000","last_change":"2024-09-19T15:31:47.872562+0000","last_active":"2024-09-19T15:31:47.872562+0000","last_peered":"2024-09-19T15:31:47.872562+0000","last_clean":"2024-09-19T15:31:47.872562+0000","last_became_active":"2024-09-19T13:40:34.225452+0000","last_became_peered":"2024-09-19T13:40:34.225452+0000","last_unstale":"2024-09-19T15:31:47.872562+0000","last_undegraded":"2024-09-19T15:31:47.872562+0000","last_fullsized":"2024-09-19T15:31:47.872562+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'331","last_scrub_stamp":"2024-09-19T15:31:47.872337+0000","last_deep_scrub":"268'331","last_deep_scrub_stamp":"2024-09-19T15:31:47.872337+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.872337+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:54:19.173058+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":603,"num_read_kb":97113,"num_write":1108,"num_write_kb":15979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":560,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.574661+0000","last_change":"2024-09-19T15:31:53.574504+0000","last_active":"2024-09-19T15:31:53.574661+0000","last_peered":"2024-09-19T15:31:53.574661+0000","last_clean":"2024-09-19T15:31:53.574661+0000","last_became_active":"2024-09-19T13:40:20.095294+0000","last_became_peered":"2024-09-19T13:40:20.095294+0000","last_unstale":"2024-09-19T15:31:53.574661+0000","last_undegraded":"2024-09-19T15:31:53.574661+0000","last_fullsized":"2024-09-19T15:31:53.574661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:53.574327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:53.574327+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.574327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:10:59.805802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088577700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.695360+0000","last_change":"2024-09-19T15:32:03.695360+0000","last_active":"2024-09-19T15:32:03.695360+0000","last_peered":"2024-09-19T15:32:03.695360+0000","last_clean":"2024-09-19T15:32:03.695360+0000","last_became_active":"2024-09-19T13:40:38.229743+0000","last_became_peered":"2024-09-19T13:40:38.229743+0000","last_unstale":"2024-09-19T15:32:03.695360+0000","last_undegraded":"2024-09-19T15:32:03.695360+0000","last_fullsized":"2024-09-19T15:32:03.695360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:03.695122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:03.695122+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.695122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:24.519149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"268'629","reported_seq":1372,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.718978+0000","last_change":"2024-09-19T15:32:06.718978+0000","last_active":"2024-09-19T15:32:06.718978+0000","last_peered":"2024-09-19T15:32:06.718978+0000","last_clean":"2024-09-19T15:32:06.718978+0000","last_became_active":"2024-09-19T13:40:40.223632+0000","last_became_peered":"2024-09-19T13:40:40.223632+0000","last_unstale":"2024-09-19T15:32:06.718978+0000","last_undegraded":"2024-09-19T15:32:06.718978+0000","last_fullsized":"2024-09-19T15:32:06.718978+0000","mapping_epoch":31,"log_start":"268'600","ondisk_log_start":"268'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'629","last_scrub_stamp":"2024-09-19T15:32:06.718778+0000","last_deep_scrub":"268'629","last_deep_scrub_stamp":"2024-09-19T15:32:06.718778+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.718778+0000","objects_scrubbed":9,"log_size":29,"log_dups_size":600,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:03:42.317447+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101088,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1063,"num_read_kb":2259,"num_write":846,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4334,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:15.560755+0000","last_change":"2024-09-19T15:32:15.560755+0000","last_active":"2024-09-19T15:32:15.560755+0000","last_peered":"2024-09-19T15:32:15.560755+0000","last_clean":"2024-09-19T15:32:15.560755+0000","last_became_active":"2024-09-19T13:40:42.245476+0000","last_became_peered":"2024-09-19T13:40:42.245476+0000","last_unstale":"2024-09-19T15:32:15.560755+0000","last_undegraded":"2024-09-19T15:32:15.560755+0000","last_fullsized":"2024-09-19T15:32:15.560755+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:15.560570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:15.560570+0000","last_clean_scrub_stamp":"2024-09-19T15:32:15.560570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:17:12.700932+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"268'144","reported_seq":690,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:18.590074+0000","last_change":"2024-09-19T15:32:18.590074+0000","last_active":"2024-09-19T15:32:18.590074+0000","last_peered":"2024-09-19T15:32:18.590074+0000","last_clean":"2024-09-19T15:32:18.590074+0000","last_became_active":"2024-09-19T13:40:44.274333+0000","last_became_peered":"2024-09-19T13:40:44.274333+0000","last_unstale":"2024-09-19T15:32:18.590074+0000","last_undegraded":"2024-09-19T15:32:18.590074+0000","last_fullsized":"2024-09-19T15:32:18.590074+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'144","last_scrub_stamp":"2024-09-19T15:32:18.589874+0000","last_deep_scrub":"268'144","last_deep_scrub_stamp":"2024-09-19T15:32:18.589874+0000","last_clean_scrub_stamp":"2024-09-19T15:32:18.589874+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:56:14.788018+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":236,"num_read_kb":218,"num_write":346,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"268'457","reported_seq":2049,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.718389+0000","last_change":"2024-09-19T15:31:53.718250+0000","last_active":"2024-09-19T15:31:53.718389+0000","last_peered":"2024-09-19T15:31:53.718389+0000","last_clean":"2024-09-19T15:31:53.718389+0000","last_became_active":"2024-09-19T13:40:36.241654+0000","last_became_peered":"2024-09-19T13:40:36.241654+0000","last_unstale":"2024-09-19T15:31:53.718389+0000","last_undegraded":"2024-09-19T15:31:53.718389+0000","last_fullsized":"2024-09-19T15:31:53.718389+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'457","last_scrub_stamp":"2024-09-19T15:31:53.718067+0000","last_deep_scrub":"268'457","last_deep_scrub_stamp":"2024-09-19T15:31:53.718067+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.718067+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:46.154892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2406,"num_read_kb":2267,"num_write":541,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"268'310","reported_seq":970,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.607957+0000","last_change":"2024-09-19T15:31:47.607762+0000","last_active":"2024-09-19T15:31:47.607957+0000","last_peered":"2024-09-19T15:31:47.607957+0000","last_clean":"2024-09-19T15:31:47.607957+0000","last_became_active":"2024-09-19T13:40:34.248944+0000","last_became_peered":"2024-09-19T13:40:34.248944+0000","last_unstale":"2024-09-19T15:31:47.607957+0000","last_undegraded":"2024-09-19T15:31:47.607957+0000","last_fullsized":"2024-09-19T15:31:47.607957+0000","mapping_epoch":25,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'310","last_scrub_stamp":"2024-09-19T15:31:47.607553+0000","last_deep_scrub":"268'310","last_deep_scrub_stamp":"2024-09-19T15:31:47.607553+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.607553+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:29.191774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":481,"num_read_kb":60023,"num_write":924,"num_write_kb":13648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":568,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.812139+0000","last_change":"2024-09-19T15:31:50.812139+0000","last_active":"2024-09-19T15:31:50.812139+0000","last_peered":"2024-09-19T15:31:50.812139+0000","last_clean":"2024-09-19T15:31:50.812139+0000","last_became_active":"2024-09-19T13:40:20.096321+0000","last_became_peered":"2024-09-19T13:40:20.096321+0000","last_unstale":"2024-09-19T15:31:50.812139+0000","last_undegraded":"2024-09-19T15:31:50.812139+0000","last_fullsized":"2024-09-19T15:31:50.812139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:50.811952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:50.811952+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.811952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:18:19.479967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001025329,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.917066+0000","last_change":"2024-09-19T15:31:59.917066+0000","last_active":"2024-09-19T15:31:59.917066+0000","last_peered":"2024-09-19T15:31:59.917066+0000","last_clean":"2024-09-19T15:31:59.917066+0000","last_became_active":"2024-09-19T13:40:38.229784+0000","last_became_peered":"2024-09-19T13:40:38.229784+0000","last_unstale":"2024-09-19T15:31:59.917066+0000","last_undegraded":"2024-09-19T15:31:59.917066+0000","last_fullsized":"2024-09-19T15:31:59.917066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:59.916882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:59.916882+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.916882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:52:47.622841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"268'347","reported_seq":991,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.645649+0000","last_change":"2024-09-19T15:32:04.645649+0000","last_active":"2024-09-19T15:32:04.645649+0000","last_peered":"2024-09-19T15:32:04.645649+0000","last_clean":"2024-09-19T15:32:04.645649+0000","last_became_active":"2024-09-19T13:40:40.239406+0000","last_became_peered":"2024-09-19T13:40:40.239406+0000","last_unstale":"2024-09-19T15:32:04.645649+0000","last_undegraded":"2024-09-19T15:32:04.645649+0000","last_fullsized":"2024-09-19T15:32:04.645649+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'347","last_scrub_stamp":"2024-09-19T15:32:04.645520+0000","last_deep_scrub":"268'347","last_deep_scrub_stamp":"2024-09-19T15:32:04.645520+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.645520+0000","objects_scrubbed":8,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:32:12.200401+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":438,"num_read_kb":429,"num_write":416,"num_write_kb":188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6602,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"268'786","reported_seq":3371,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:17.648806+0000","last_change":"2024-09-19T15:32:17.648638+0000","last_active":"2024-09-19T15:32:17.648806+0000","last_peered":"2024-09-19T15:32:17.648806+0000","last_clean":"2024-09-19T15:32:17.648806+0000","last_became_active":"2024-09-19T13:40:42.244921+0000","last_became_peered":"2024-09-19T13:40:42.244921+0000","last_unstale":"2024-09-19T15:32:17.648806+0000","last_undegraded":"2024-09-19T15:32:17.648806+0000","last_fullsized":"2024-09-19T15:32:17.648806+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'786","last_scrub_stamp":"2024-09-19T15:32:17.648461+0000","last_deep_scrub":"268'786","last_deep_scrub_stamp":"2024-09-19T15:32:17.648461+0000","last_clean_scrub_stamp":"2024-09-19T15:32:17.648461+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:59.218164+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"268'144","reported_seq":712,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:25.112227+0000","last_change":"2024-09-19T15:32:25.112227+0000","last_active":"2024-09-19T15:32:25.112227+0000","last_peered":"2024-09-19T15:32:25.112227+0000","last_clean":"2024-09-19T15:32:25.112227+0000","last_became_active":"2024-09-19T13:40:44.277602+0000","last_became_peered":"2024-09-19T13:40:44.277602+0000","last_unstale":"2024-09-19T15:32:25.112227+0000","last_undegraded":"2024-09-19T15:32:25.112227+0000","last_fullsized":"2024-09-19T15:32:25.112227+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'144","last_scrub_stamp":"2024-09-19T15:32:25.112017+0000","last_deep_scrub":"268'144","last_deep_scrub_stamp":"2024-09-19T15:32:25.112017+0000","last_clean_scrub_stamp":"2024-09-19T15:32:25.112017+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:47.863568+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":303,"num_read_kb":269,"num_write":341,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"268'434","reported_seq":1943,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.956346+0000","last_change":"2024-09-19T15:31:56.956165+0000","last_active":"2024-09-19T15:31:56.956346+0000","last_peered":"2024-09-19T15:31:56.956346+0000","last_clean":"2024-09-19T15:31:56.956346+0000","last_became_active":"2024-09-19T13:40:36.235186+0000","last_became_peered":"2024-09-19T13:40:36.235186+0000","last_unstale":"2024-09-19T15:31:56.956346+0000","last_undegraded":"2024-09-19T15:31:56.956346+0000","last_fullsized":"2024-09-19T15:31:56.956346+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'434","last_scrub_stamp":"2024-09-19T15:31:56.955979+0000","last_deep_scrub":"268'434","last_deep_scrub_stamp":"2024-09-19T15:31:56.955979+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.955979+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:06.924774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2268,"num_read_kb":2120,"num_write":492,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"268'422","reported_seq":1267,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:46.840046+0000","last_change":"2024-09-19T15:31:46.840046+0000","last_active":"2024-09-19T15:31:46.840046+0000","last_peered":"2024-09-19T15:31:46.840046+0000","last_clean":"2024-09-19T15:31:46.840046+0000","last_became_active":"2024-09-19T13:40:34.236325+0000","last_became_peered":"2024-09-19T13:40:34.236325+0000","last_unstale":"2024-09-19T15:31:46.840046+0000","last_undegraded":"2024-09-19T15:31:46.840046+0000","last_fullsized":"2024-09-19T15:31:46.840046+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'422","last_scrub_stamp":"2024-09-19T15:31:46.839904+0000","last_deep_scrub":"268'422","last_deep_scrub_stamp":"2024-09-19T15:31:46.839904+0000","last_clean_scrub_stamp":"2024-09-19T15:31:46.839904+0000","objects_scrubbed":8,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:07.793346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":865,"num_read_kb":111541,"num_write":1317,"num_write_kb":62709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":558,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:45.587267+0000","last_change":"2024-09-19T15:31:45.587206+0000","last_active":"2024-09-19T15:31:45.587267+0000","last_peered":"2024-09-19T15:31:45.587267+0000","last_clean":"2024-09-19T15:31:45.587267+0000","last_became_active":"2024-09-19T13:40:20.101186+0000","last_became_peered":"2024-09-19T13:40:20.101186+0000","last_unstale":"2024-09-19T15:31:45.587267+0000","last_undegraded":"2024-09-19T15:31:45.587267+0000","last_fullsized":"2024-09-19T15:31:45.587267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:45.587128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:45.587128+0000","last_clean_scrub_stamp":"2024-09-19T15:31:45.587128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:24.645925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010323750000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.533455+0000","last_change":"2024-09-19T15:32:07.533455+0000","last_active":"2024-09-19T15:32:07.533455+0000","last_peered":"2024-09-19T15:32:07.533455+0000","last_clean":"2024-09-19T15:32:07.533455+0000","last_became_active":"2024-09-19T13:40:38.235109+0000","last_became_peered":"2024-09-19T13:40:38.235109+0000","last_unstale":"2024-09-19T15:32:07.533455+0000","last_undegraded":"2024-09-19T15:32:07.533455+0000","last_fullsized":"2024-09-19T15:32:07.533455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:07.533271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:07.533271+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.533271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:11:41.966852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"268'198","reported_seq":806,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:11.587452+0000","last_change":"2024-09-19T15:32:11.587452+0000","last_active":"2024-09-19T15:32:11.587452+0000","last_peered":"2024-09-19T15:32:11.587452+0000","last_clean":"2024-09-19T15:32:11.587452+0000","last_became_active":"2024-09-19T13:40:40.244484+0000","last_became_peered":"2024-09-19T13:40:40.244484+0000","last_unstale":"2024-09-19T15:32:11.587452+0000","last_undegraded":"2024-09-19T15:32:11.587452+0000","last_fullsized":"2024-09-19T15:32:11.587452+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'198","last_scrub_stamp":"2024-09-19T15:32:11.587262+0000","last_deep_scrub":"268'198","last_deep_scrub_stamp":"2024-09-19T15:32:11.587262+0000","last_clean_scrub_stamp":"2024-09-19T15:32:11.587262+0000","objects_scrubbed":5,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:58.251932+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":238,"num_read_kb":228,"num_write":166,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"268'790","reported_seq":5121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:19.198016+0000","last_change":"2024-09-19T15:32:19.198016+0000","last_active":"2024-09-19T15:32:19.198016+0000","last_peered":"2024-09-19T15:32:19.198016+0000","last_clean":"2024-09-19T15:32:19.198016+0000","last_became_active":"2024-09-19T13:40:42.257799+0000","last_became_peered":"2024-09-19T13:40:42.257799+0000","last_unstale":"2024-09-19T15:32:19.198016+0000","last_undegraded":"2024-09-19T15:32:19.198016+0000","last_fullsized":"2024-09-19T15:32:19.198016+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'790","last_scrub_stamp":"2024-09-19T15:32:19.197825+0000","last_deep_scrub":"268'790","last_deep_scrub_stamp":"2024-09-19T15:32:19.197825+0000","last_clean_scrub_stamp":"2024-09-19T15:32:19.197825+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:30:42.393600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"268'193","reported_seq":734,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:19.618188+0000","last_change":"2024-09-19T15:32:19.618188+0000","last_active":"2024-09-19T15:32:19.618188+0000","last_peered":"2024-09-19T15:32:19.618188+0000","last_clean":"2024-09-19T15:32:19.618188+0000","last_became_active":"2024-09-19T13:40:44.259077+0000","last_became_peered":"2024-09-19T13:40:44.259077+0000","last_unstale":"2024-09-19T15:32:19.618188+0000","last_undegraded":"2024-09-19T15:32:19.618188+0000","last_fullsized":"2024-09-19T15:32:19.618188+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'193","last_scrub_stamp":"2024-09-19T15:32:19.618021+0000","last_deep_scrub":"268'193","last_deep_scrub_stamp":"2024-09-19T15:32:19.618021+0000","last_clean_scrub_stamp":"2024-09-19T15:32:19.618021+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:33:46.257575+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":211,"num_read_kb":198,"num_write":423,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"268'430","reported_seq":1965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.463373+0000","last_change":"2024-09-19T15:31:51.463133+0000","last_active":"2024-09-19T15:31:51.463373+0000","last_peered":"2024-09-19T15:31:51.463373+0000","last_clean":"2024-09-19T15:31:51.463373+0000","last_became_active":"2024-09-19T13:40:36.242739+0000","last_became_peered":"2024-09-19T13:40:36.242739+0000","last_unstale":"2024-09-19T15:31:51.463373+0000","last_undegraded":"2024-09-19T15:31:51.463373+0000","last_fullsized":"2024-09-19T15:31:51.463373+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'430","last_scrub_stamp":"2024-09-19T15:31:51.462915+0000","last_deep_scrub":"268'430","last_deep_scrub_stamp":"2024-09-19T15:31:51.462915+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.462915+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:56:09.165916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2240,"num_read_kb":2109,"num_write":493,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"268'308","reported_seq":968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.911724+0000","last_change":"2024-09-19T15:31:47.911724+0000","last_active":"2024-09-19T15:31:47.911724+0000","last_peered":"2024-09-19T15:31:47.911724+0000","last_clean":"2024-09-19T15:31:47.911724+0000","last_became_active":"2024-09-19T13:41:05.316287+0000","last_became_peered":"2024-09-19T13:41:05.316287+0000","last_unstale":"2024-09-19T15:31:47.911724+0000","last_undegraded":"2024-09-19T15:31:47.911724+0000","last_fullsized":"2024-09-19T15:31:47.911724+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'308","last_scrub_stamp":"2024-09-19T15:31:47.911606+0000","last_deep_scrub":"268'308","last_deep_scrub_stamp":"2024-09-19T15:31:47.911606+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.911606+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:23.680919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":643,"num_read_kb":12872,"num_write":1020,"num_write_kb":31603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":555,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.930501+0000","last_change":"2024-09-19T15:31:47.930367+0000","last_active":"2024-09-19T15:31:47.930501+0000","last_peered":"2024-09-19T15:31:47.930501+0000","last_clean":"2024-09-19T15:31:47.930501+0000","last_became_active":"2024-09-19T13:40:20.103134+0000","last_became_peered":"2024-09-19T13:40:20.103134+0000","last_unstale":"2024-09-19T15:31:47.930501+0000","last_undegraded":"2024-09-19T15:31:47.930501+0000","last_fullsized":"2024-09-19T15:31:47.930501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:31:47.930194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:31:47.930194+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.930194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:21.433702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093870599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":544,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.020245+0000","last_change":"2024-09-19T15:32:07.020103+0000","last_active":"2024-09-19T15:32:07.020245+0000","last_peered":"2024-09-19T15:32:07.020245+0000","last_clean":"2024-09-19T15:32:07.020245+0000","last_became_active":"2024-09-19T13:40:38.221430+0000","last_became_peered":"2024-09-19T13:40:38.221430+0000","last_unstale":"2024-09-19T15:32:07.020245+0000","last_undegraded":"2024-09-19T15:32:07.020245+0000","last_fullsized":"2024-09-19T15:32:07.020245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:07.019913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:07.019913+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.019913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:54:53.009598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"268'848","reported_seq":1648,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:09.663377+0000","last_change":"2024-09-19T15:32:09.663377+0000","last_active":"2024-09-19T15:32:09.663377+0000","last_peered":"2024-09-19T15:32:09.663377+0000","last_clean":"2024-09-19T15:32:09.663377+0000","last_became_active":"2024-09-19T13:40:40.229426+0000","last_became_peered":"2024-09-19T13:40:40.229426+0000","last_unstale":"2024-09-19T15:32:09.663377+0000","last_undegraded":"2024-09-19T15:32:09.663377+0000","last_fullsized":"2024-09-19T15:32:09.663377+0000","mapping_epoch":31,"log_start":"268'800","ondisk_log_start":"268'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'848","last_scrub_stamp":"2024-09-19T15:32:09.663116+0000","last_deep_scrub":"268'848","last_deep_scrub_stamp":"2024-09-19T15:32:09.663116+0000","last_clean_scrub_stamp":"2024-09-19T15:32:09.663116+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":800,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:43.808766+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140545,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1480,"num_read_kb":3413,"num_write":1200,"num_write_kb":946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:18.172465+0000","last_change":"2024-09-19T15:32:18.172465+0000","last_active":"2024-09-19T15:32:18.172465+0000","last_peered":"2024-09-19T15:32:18.172465+0000","last_clean":"2024-09-19T15:32:18.172465+0000","last_became_active":"2024-09-19T13:40:42.244291+0000","last_became_peered":"2024-09-19T13:40:42.244291+0000","last_unstale":"2024-09-19T15:32:18.172465+0000","last_undegraded":"2024-09-19T15:32:18.172465+0000","last_fullsized":"2024-09-19T15:32:18.172465+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:18.172280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:18.172280+0000","last_clean_scrub_stamp":"2024-09-19T15:32:18.172280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:46.823936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"268'154","reported_seq":719,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:21.645279+0000","last_change":"2024-09-19T15:32:21.645279+0000","last_active":"2024-09-19T15:32:21.645279+0000","last_peered":"2024-09-19T15:32:21.645279+0000","last_clean":"2024-09-19T15:32:21.645279+0000","last_became_active":"2024-09-19T13:40:44.273409+0000","last_became_peered":"2024-09-19T13:40:44.273409+0000","last_unstale":"2024-09-19T15:32:21.645279+0000","last_undegraded":"2024-09-19T15:32:21.645279+0000","last_fullsized":"2024-09-19T15:32:21.645279+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'154","last_scrub_stamp":"2024-09-19T15:32:21.645095+0000","last_deep_scrub":"268'154","last_deep_scrub_stamp":"2024-09-19T15:32:21.645095+0000","last_clean_scrub_stamp":"2024-09-19T15:32:21.645095+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:13:10.870852+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":293,"num_read_kb":268,"num_write":395,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"268'159","reported_seq":751,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:21.624736+0000","last_change":"2024-09-19T15:32:21.624736+0000","last_active":"2024-09-19T15:32:21.624736+0000","last_peered":"2024-09-19T15:32:21.624736+0000","last_clean":"2024-09-19T15:32:21.624736+0000","last_became_active":"2024-09-19T13:40:44.263575+0000","last_became_peered":"2024-09-19T13:40:44.263575+0000","last_unstale":"2024-09-19T15:32:21.624736+0000","last_undegraded":"2024-09-19T15:32:21.624736+0000","last_fullsized":"2024-09-19T15:32:21.624736+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'159","last_scrub_stamp":"2024-09-19T15:32:21.624559+0000","last_deep_scrub":"268'159","last_deep_scrub_stamp":"2024-09-19T15:32:21.624559+0000","last_clean_scrub_stamp":"2024-09-19T15:32:21.624559+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:42.336374+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":425,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":274,"num_read_kb":267,"num_write":381,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"268'492","reported_seq":2284,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.506802+0000","last_change":"2024-09-19T15:31:56.506648+0000","last_active":"2024-09-19T15:31:56.506802+0000","last_peered":"2024-09-19T15:31:56.506802+0000","last_clean":"2024-09-19T15:31:56.506802+0000","last_became_active":"2024-09-19T13:40:36.221019+0000","last_became_peered":"2024-09-19T13:40:36.221019+0000","last_unstale":"2024-09-19T15:31:56.506802+0000","last_undegraded":"2024-09-19T15:31:56.506802+0000","last_fullsized":"2024-09-19T15:31:56.506802+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'492","last_scrub_stamp":"2024-09-19T15:31:56.506455+0000","last_deep_scrub":"268'492","last_deep_scrub_stamp":"2024-09-19T15:31:56.506455+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.506455+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:19.156962+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2720,"num_read_kb":2588,"num_write":552,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"268'395","reported_seq":1072,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:46.557434+0000","last_change":"2024-09-19T15:31:46.557289+0000","last_active":"2024-09-19T15:31:46.557434+0000","last_peered":"2024-09-19T15:31:46.557434+0000","last_clean":"2024-09-19T15:31:46.557434+0000","last_became_active":"2024-09-19T13:40:34.263276+0000","last_became_peered":"2024-09-19T13:40:34.263276+0000","last_unstale":"2024-09-19T15:31:46.557434+0000","last_undegraded":"2024-09-19T15:31:46.557434+0000","last_fullsized":"2024-09-19T15:31:46.557434+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'395","last_scrub_stamp":"2024-09-19T15:31:46.557001+0000","last_deep_scrub":"268'395","last_deep_scrub_stamp":"2024-09-19T15:31:46.557001+0000","last_clean_scrub_stamp":"2024-09-19T15:31:46.557001+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:39:37.507208+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":686,"num_read_kb":11371,"num_write":1228,"num_write_kb":39217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"268'6","reported_seq":1006,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.615629+0000","last_change":"2024-09-19T15:32:02.615454+0000","last_active":"2024-09-19T15:32:02.615629+0000","last_peered":"2024-09-19T15:32:02.615629+0000","last_clean":"2024-09-19T15:32:02.615629+0000","last_became_active":"2024-09-19T13:40:38.215364+0000","last_became_peered":"2024-09-19T13:40:38.215364+0000","last_unstale":"2024-09-19T15:32:02.615629+0000","last_undegraded":"2024-09-19T15:32:02.615629+0000","last_fullsized":"2024-09-19T15:32:02.615629+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-19T15:32:02.615245+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-19T15:32:02.615245+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.615245+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:36.144028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":1184,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"268'365","reported_seq":1008,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:14.155801+0000","last_change":"2024-09-19T15:32:14.155620+0000","last_active":"2024-09-19T15:32:14.155801+0000","last_peered":"2024-09-19T15:32:14.155801+0000","last_clean":"2024-09-19T15:32:14.155801+0000","last_became_active":"2024-09-19T13:40:40.229872+0000","last_became_peered":"2024-09-19T13:40:40.229872+0000","last_unstale":"2024-09-19T15:32:14.155801+0000","last_undegraded":"2024-09-19T15:32:14.155801+0000","last_fullsized":"2024-09-19T15:32:14.155801+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'365","last_scrub_stamp":"2024-09-19T15:32:14.155416+0000","last_deep_scrub":"268'365","last_deep_scrub_stamp":"2024-09-19T15:32:14.155416+0000","last_clean_scrub_stamp":"2024-09-19T15:32:14.155416+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:05.890368+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140886,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":585,"num_read_kb":1412,"num_write":468,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":528,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:22.168176+0000","last_change":"2024-09-19T15:32:22.168016+0000","last_active":"2024-09-19T15:32:22.168176+0000","last_peered":"2024-09-19T15:32:22.168176+0000","last_clean":"2024-09-19T15:32:22.168176+0000","last_became_active":"2024-09-19T13:40:42.242368+0000","last_became_peered":"2024-09-19T13:40:42.242368+0000","last_unstale":"2024-09-19T15:32:22.168176+0000","last_undegraded":"2024-09-19T15:32:22.168176+0000","last_fullsized":"2024-09-19T15:32:22.168176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:22.167830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:22.167830+0000","last_clean_scrub_stamp":"2024-09-19T15:32:22.167830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:51.867912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"268'122","reported_seq":661,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:28.083992+0000","last_change":"2024-09-19T15:32:28.083754+0000","last_active":"2024-09-19T15:32:28.083992+0000","last_peered":"2024-09-19T15:32:28.083992+0000","last_clean":"2024-09-19T15:32:28.083992+0000","last_became_active":"2024-09-19T13:40:44.268946+0000","last_became_peered":"2024-09-19T13:40:44.268946+0000","last_unstale":"2024-09-19T15:32:28.083992+0000","last_undegraded":"2024-09-19T15:32:28.083992+0000","last_fullsized":"2024-09-19T15:32:28.083992+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'122","last_scrub_stamp":"2024-09-19T15:32:28.083518+0000","last_deep_scrub":"268'122","last_deep_scrub_stamp":"2024-09-19T15:32:28.083518+0000","last_clean_scrub_stamp":"2024-09-19T15:32:28.083518+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:30.513074+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":134,"num_read_kb":128,"num_write":265,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"268'469","reported_seq":2042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.567897+0000","last_change":"2024-09-19T15:31:57.567600+0000","last_active":"2024-09-19T15:31:57.567897+0000","last_peered":"2024-09-19T15:31:57.567897+0000","last_clean":"2024-09-19T15:31:57.567897+0000","last_became_active":"2024-09-19T13:40:36.226164+0000","last_became_peered":"2024-09-19T13:40:36.226164+0000","last_unstale":"2024-09-19T15:31:57.567897+0000","last_undegraded":"2024-09-19T15:31:57.567897+0000","last_fullsized":"2024-09-19T15:31:57.567897+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'469","last_scrub_stamp":"2024-09-19T15:31:57.567370+0000","last_deep_scrub":"268'469","last_deep_scrub_stamp":"2024-09-19T15:31:57.567370+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.567370+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:50.223505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2492,"num_read_kb":2321,"num_write":561,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"268'308","reported_seq":1061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.734220+0000","last_change":"2024-09-19T15:31:54.734220+0000","last_active":"2024-09-19T15:31:54.734220+0000","last_peered":"2024-09-19T15:31:54.734220+0000","last_clean":"2024-09-19T15:31:54.734220+0000","last_became_active":"2024-09-19T13:41:05.387779+0000","last_became_peered":"2024-09-19T13:41:05.387779+0000","last_unstale":"2024-09-19T15:31:54.734220+0000","last_undegraded":"2024-09-19T15:31:54.734220+0000","last_fullsized":"2024-09-19T15:31:54.734220+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'308","last_scrub_stamp":"2024-09-19T15:31:54.734020+0000","last_deep_scrub":"268'308","last_deep_scrub_stamp":"2024-09-19T15:31:54.734020+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.734020+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:08.138762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":891,"num_read_kb":29706,"num_write":1011,"num_write_kb":41961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":536,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.051944+0000","last_change":"2024-09-19T15:32:08.051796+0000","last_active":"2024-09-19T15:32:08.051944+0000","last_peered":"2024-09-19T15:32:08.051944+0000","last_clean":"2024-09-19T15:32:08.051944+0000","last_became_active":"2024-09-19T13:40:38.228856+0000","last_became_peered":"2024-09-19T13:40:38.228856+0000","last_unstale":"2024-09-19T15:32:08.051944+0000","last_undegraded":"2024-09-19T15:32:08.051944+0000","last_fullsized":"2024-09-19T15:32:08.051944+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:08.051584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:08.051584+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.051584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:37:44.498532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"268'88","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.666957+0000","last_change":"2024-09-19T15:32:08.666857+0000","last_active":"2024-09-19T15:32:08.666957+0000","last_peered":"2024-09-19T15:32:08.666957+0000","last_clean":"2024-09-19T15:32:08.666957+0000","last_became_active":"2024-09-19T13:40:40.235528+0000","last_became_peered":"2024-09-19T13:40:40.235528+0000","last_unstale":"2024-09-19T15:32:08.666957+0000","last_undegraded":"2024-09-19T15:32:08.666957+0000","last_fullsized":"2024-09-19T15:32:08.666957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'88","last_scrub_stamp":"2024-09-19T15:32:08.666742+0000","last_deep_scrub":"268'88","last_deep_scrub_stamp":"2024-09-19T15:32:08.666742+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.666742+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:31.018966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":75,"num_write":58,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:16.633620+0000","last_change":"2024-09-19T15:32:16.633560+0000","last_active":"2024-09-19T15:32:16.633620+0000","last_peered":"2024-09-19T15:32:16.633620+0000","last_clean":"2024-09-19T15:32:16.633620+0000","last_became_active":"2024-09-19T13:40:42.243224+0000","last_became_peered":"2024-09-19T13:40:42.243224+0000","last_unstale":"2024-09-19T15:32:16.633620+0000","last_undegraded":"2024-09-19T15:32:16.633620+0000","last_fullsized":"2024-09-19T15:32:16.633620+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:16.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:16.633480+0000","last_clean_scrub_stamp":"2024-09-19T15:32:16.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:16:17.039545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"268'211","reported_seq":765,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:22.591547+0000","last_change":"2024-09-19T15:32:22.591547+0000","last_active":"2024-09-19T15:32:22.591547+0000","last_peered":"2024-09-19T15:32:22.591547+0000","last_clean":"2024-09-19T15:32:22.591547+0000","last_became_active":"2024-09-19T13:40:44.258721+0000","last_became_peered":"2024-09-19T13:40:44.258721+0000","last_unstale":"2024-09-19T15:32:22.591547+0000","last_undegraded":"2024-09-19T15:32:22.591547+0000","last_fullsized":"2024-09-19T15:32:22.591547+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'211","last_scrub_stamp":"2024-09-19T15:32:22.591333+0000","last_deep_scrub":"268'211","last_deep_scrub_stamp":"2024-09-19T15:32:22.591333+0000","last_clean_scrub_stamp":"2024-09-19T15:32:22.591333+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":100,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:39:21.010735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":369,"num_read_kb":358,"num_write":477,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"268'371","reported_seq":1901,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.999716+0000","last_change":"2024-09-19T15:31:58.999581+0000","last_active":"2024-09-19T15:31:58.999716+0000","last_peered":"2024-09-19T15:31:58.999716+0000","last_clean":"2024-09-19T15:31:58.999716+0000","last_became_active":"2024-09-19T13:40:36.239629+0000","last_became_peered":"2024-09-19T13:40:36.239629+0000","last_unstale":"2024-09-19T15:31:58.999716+0000","last_undegraded":"2024-09-19T15:31:58.999716+0000","last_fullsized":"2024-09-19T15:31:58.999716+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'371","last_scrub_stamp":"2024-09-19T15:31:58.999403+0000","last_deep_scrub":"268'371","last_deep_scrub_stamp":"2024-09-19T15:31:58.999403+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.999403+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:05:57.130902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2075,"num_read_kb":1985,"num_write":419,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"268'332","reported_seq":1015,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.805753+0000","last_change":"2024-09-19T15:31:51.805753+0000","last_active":"2024-09-19T15:31:51.805753+0000","last_peered":"2024-09-19T15:31:51.805753+0000","last_clean":"2024-09-19T15:31:51.805753+0000","last_became_active":"2024-09-19T13:40:34.256236+0000","last_became_peered":"2024-09-19T13:40:34.256236+0000","last_unstale":"2024-09-19T15:31:51.805753+0000","last_undegraded":"2024-09-19T15:31:51.805753+0000","last_fullsized":"2024-09-19T15:31:51.805753+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'332","last_scrub_stamp":"2024-09-19T15:31:51.805479+0000","last_deep_scrub":"268'332","last_deep_scrub_stamp":"2024-09-19T15:31:51.805479+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.805479+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:20:24.903372+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136863,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":566,"num_read_kb":16816,"num_write":988,"num_write_kb":29952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":537,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.715706+0000","last_change":"2024-09-19T15:32:06.715494+0000","last_active":"2024-09-19T15:32:06.715706+0000","last_peered":"2024-09-19T15:32:06.715706+0000","last_clean":"2024-09-19T15:32:06.715706+0000","last_became_active":"2024-09-19T13:40:38.249269+0000","last_became_peered":"2024-09-19T13:40:38.249269+0000","last_unstale":"2024-09-19T15:32:06.715706+0000","last_undegraded":"2024-09-19T15:32:06.715706+0000","last_fullsized":"2024-09-19T15:32:06.715706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:06.715201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:06.715201+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.715201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:37.301841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"268'362","reported_seq":1020,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:15.151748+0000","last_change":"2024-09-19T15:32:15.151597+0000","last_active":"2024-09-19T15:32:15.151748+0000","last_peered":"2024-09-19T15:32:15.151748+0000","last_clean":"2024-09-19T15:32:15.151748+0000","last_became_active":"2024-09-19T13:40:40.229852+0000","last_became_peered":"2024-09-19T13:40:40.229852+0000","last_unstale":"2024-09-19T15:32:15.151748+0000","last_undegraded":"2024-09-19T15:32:15.151748+0000","last_fullsized":"2024-09-19T15:32:15.151748+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'362","last_scrub_stamp":"2024-09-19T15:32:15.151403+0000","last_deep_scrub":"268'362","last_deep_scrub_stamp":"2024-09-19T15:32:15.151403+0000","last_clean_scrub_stamp":"2024-09-19T15:32:15.151403+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:56:58.413638+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47808,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":586,"num_read_kb":1181,"num_write":454,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":517,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.978208+0000","last_change":"2024-09-19T15:32:05.977985+0000","last_active":"2024-09-19T15:32:05.978208+0000","last_peered":"2024-09-19T15:32:05.978208+0000","last_clean":"2024-09-19T15:32:05.978208+0000","last_became_active":"2024-09-19T13:40:42.240135+0000","last_became_peered":"2024-09-19T13:40:42.240135+0000","last_unstale":"2024-09-19T15:32:05.978208+0000","last_undegraded":"2024-09-19T15:32:05.978208+0000","last_fullsized":"2024-09-19T15:32:05.978208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:05.977797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:05.977797+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.977797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:47:40.751125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"268'86","reported_seq":644,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:24.602402+0000","last_change":"2024-09-19T15:32:24.602402+0000","last_active":"2024-09-19T15:32:24.602402+0000","last_peered":"2024-09-19T15:32:24.602402+0000","last_clean":"2024-09-19T15:32:24.602402+0000","last_became_active":"2024-09-19T13:40:44.269134+0000","last_became_peered":"2024-09-19T13:40:44.269134+0000","last_unstale":"2024-09-19T15:32:24.602402+0000","last_undegraded":"2024-09-19T15:32:24.602402+0000","last_fullsized":"2024-09-19T15:32:24.602402+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'86","last_scrub_stamp":"2024-09-19T15:32:24.602220+0000","last_deep_scrub":"268'86","last_deep_scrub_stamp":"2024-09-19T15:32:24.602220+0000","last_clean_scrub_stamp":"2024-09-19T15:32:24.602220+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:23:47.926200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":169,"num_read_kb":160,"num_write":196,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"268'611","reported_seq":2436,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.975880+0000","last_change":"2024-09-19T15:31:57.975666+0000","last_active":"2024-09-19T15:31:57.975880+0000","last_peered":"2024-09-19T15:31:57.975880+0000","last_clean":"2024-09-19T15:31:57.975880+0000","last_became_active":"2024-09-19T13:40:36.217925+0000","last_became_peered":"2024-09-19T13:40:36.217925+0000","last_unstale":"2024-09-19T15:31:57.975880+0000","last_undegraded":"2024-09-19T15:31:57.975880+0000","last_fullsized":"2024-09-19T15:31:57.975880+0000","mapping_epoch":27,"log_start":"268'600","ondisk_log_start":"268'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'611","last_scrub_stamp":"2024-09-19T15:31:57.975494+0000","last_deep_scrub":"268'611","last_deep_scrub_stamp":"2024-09-19T15:31:57.975494+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.975494+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":600,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:29.200346+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3256,"num_read_kb":3011,"num_write":769,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"268'364","reported_seq":1028,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:46.648604+0000","last_change":"2024-09-19T15:31:46.648440+0000","last_active":"2024-09-19T15:31:46.648604+0000","last_peered":"2024-09-19T15:31:46.648604+0000","last_clean":"2024-09-19T15:31:46.648604+0000","last_became_active":"2024-09-19T13:40:34.227791+0000","last_became_peered":"2024-09-19T13:40:34.227791+0000","last_unstale":"2024-09-19T15:31:46.648604+0000","last_undegraded":"2024-09-19T15:31:46.648604+0000","last_fullsized":"2024-09-19T15:31:46.648604+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'364","last_scrub_stamp":"2024-09-19T15:31:46.648241+0000","last_deep_scrub":"268'364","last_deep_scrub_stamp":"2024-09-19T15:31:46.648241+0000","last_clean_scrub_stamp":"2024-09-19T15:31:46.648241+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:28:35.850047+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":536,"num_read_kb":35857,"num_write":1057,"num_write_kb":31805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.930492+0000","last_change":"2024-09-19T15:32:00.930353+0000","last_active":"2024-09-19T15:32:00.930492+0000","last_peered":"2024-09-19T15:32:00.930492+0000","last_clean":"2024-09-19T15:32:00.930492+0000","last_became_active":"2024-09-19T13:40:38.246129+0000","last_became_peered":"2024-09-19T13:40:38.246129+0000","last_unstale":"2024-09-19T15:32:00.930492+0000","last_undegraded":"2024-09-19T15:32:00.930492+0000","last_fullsized":"2024-09-19T15:32:00.930492+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:00.930173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:00.930173+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.930173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:14:00.787540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"268'319","reported_seq":950,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:12.666475+0000","last_change":"2024-09-19T15:32:12.666334+0000","last_active":"2024-09-19T15:32:12.666475+0000","last_peered":"2024-09-19T15:32:12.666475+0000","last_clean":"2024-09-19T15:32:12.666475+0000","last_became_active":"2024-09-19T13:40:40.218434+0000","last_became_peered":"2024-09-19T13:40:40.218434+0000","last_unstale":"2024-09-19T15:32:12.666475+0000","last_undegraded":"2024-09-19T15:32:12.666475+0000","last_fullsized":"2024-09-19T15:32:12.666475+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'319","last_scrub_stamp":"2024-09-19T15:32:12.666134+0000","last_deep_scrub":"268'319","last_deep_scrub_stamp":"2024-09-19T15:32:12.666134+0000","last_clean_scrub_stamp":"2024-09-19T15:32:12.666134+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:09:43.541168+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44825,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":1129,"num_write":414,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:14.568073+0000","last_change":"2024-09-19T15:32:14.567886+0000","last_active":"2024-09-19T15:32:14.568073+0000","last_peered":"2024-09-19T15:32:14.568073+0000","last_clean":"2024-09-19T15:32:14.568073+0000","last_became_active":"2024-09-19T13:40:42.238908+0000","last_became_peered":"2024-09-19T13:40:42.238908+0000","last_unstale":"2024-09-19T15:32:14.568073+0000","last_undegraded":"2024-09-19T15:32:14.568073+0000","last_fullsized":"2024-09-19T15:32:14.568073+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:14.567692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:14.567692+0000","last_clean_scrub_stamp":"2024-09-19T15:32:14.567692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:33.260592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"268'524","reported_seq":2149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.913247+0000","last_change":"2024-09-19T15:31:56.913104+0000","last_active":"2024-09-19T15:31:56.913247+0000","last_peered":"2024-09-19T15:31:56.913247+0000","last_clean":"2024-09-19T15:31:56.913247+0000","last_became_active":"2024-09-19T13:40:36.243653+0000","last_became_peered":"2024-09-19T13:40:36.243653+0000","last_unstale":"2024-09-19T15:31:56.913247+0000","last_undegraded":"2024-09-19T15:31:56.913247+0000","last_fullsized":"2024-09-19T15:31:56.913247+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'524","last_scrub_stamp":"2024-09-19T15:31:56.912913+0000","last_deep_scrub":"268'524","last_deep_scrub_stamp":"2024-09-19T15:31:56.912913+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.912913+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:58.666306+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2759,"num_read_kb":2556,"num_write":676,"num_write_kb":206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"268'358","reported_seq":1009,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.920601+0000","last_change":"2024-09-19T15:31:52.920601+0000","last_active":"2024-09-19T15:31:52.920601+0000","last_peered":"2024-09-19T15:31:52.920601+0000","last_clean":"2024-09-19T15:31:52.920601+0000","last_became_active":"2024-09-19T13:40:34.219131+0000","last_became_peered":"2024-09-19T13:40:34.219131+0000","last_unstale":"2024-09-19T15:31:52.920601+0000","last_undegraded":"2024-09-19T15:31:52.920601+0000","last_fullsized":"2024-09-19T15:31:52.920601+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'358","last_scrub_stamp":"2024-09-19T15:31:52.920370+0000","last_deep_scrub":"268'358","last_deep_scrub_stamp":"2024-09-19T15:31:52.920370+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.920370+0000","objects_scrubbed":6,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:04.736453+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273703,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":527,"num_read_kb":16977,"num_write":1175,"num_write_kb":67471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.685857+0000","last_change":"2024-09-19T15:32:04.685857+0000","last_active":"2024-09-19T15:32:04.685857+0000","last_peered":"2024-09-19T15:32:04.685857+0000","last_clean":"2024-09-19T15:32:04.685857+0000","last_became_active":"2024-09-19T13:40:38.231992+0000","last_became_peered":"2024-09-19T13:40:38.231992+0000","last_unstale":"2024-09-19T15:32:04.685857+0000","last_undegraded":"2024-09-19T15:32:04.685857+0000","last_fullsized":"2024-09-19T15:32:04.685857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:04.685669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:04.685669+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.685669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:07:07.380312+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"268'568","reported_seq":1247,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.642848+0000","last_change":"2024-09-19T15:32:06.642848+0000","last_active":"2024-09-19T15:32:06.642848+0000","last_peered":"2024-09-19T15:32:06.642848+0000","last_clean":"2024-09-19T15:32:06.642848+0000","last_became_active":"2024-09-19T13:40:40.241045+0000","last_became_peered":"2024-09-19T13:40:40.241045+0000","last_unstale":"2024-09-19T15:32:06.642848+0000","last_undegraded":"2024-09-19T15:32:06.642848+0000","last_fullsized":"2024-09-19T15:32:06.642848+0000","mapping_epoch":31,"log_start":"268'500","ondisk_log_start":"268'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'568","last_scrub_stamp":"2024-09-19T15:32:06.642662+0000","last_deep_scrub":"268'568","last_deep_scrub_stamp":"2024-09-19T15:32:06.642662+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.642662+0000","objects_scrubbed":7,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:33.019641+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102495,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":998,"num_read_kb":2312,"num_write":864,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":530,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:18.654557+0000","last_change":"2024-09-19T15:32:18.654557+0000","last_active":"2024-09-19T15:32:18.654557+0000","last_peered":"2024-09-19T15:32:18.654557+0000","last_clean":"2024-09-19T15:32:18.654557+0000","last_became_active":"2024-09-19T13:40:42.266161+0000","last_became_peered":"2024-09-19T13:40:42.266161+0000","last_unstale":"2024-09-19T15:32:18.654557+0000","last_undegraded":"2024-09-19T15:32:18.654557+0000","last_fullsized":"2024-09-19T15:32:18.654557+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:18.654355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:18.654355+0000","last_clean_scrub_stamp":"2024-09-19T15:32:18.654355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:49:19.531268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"268'155","reported_seq":695,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:27.116308+0000","last_change":"2024-09-19T15:32:27.116171+0000","last_active":"2024-09-19T15:32:27.116308+0000","last_peered":"2024-09-19T15:32:27.116308+0000","last_clean":"2024-09-19T15:32:27.116308+0000","last_became_active":"2024-09-19T13:40:44.280362+0000","last_became_peered":"2024-09-19T13:40:44.280362+0000","last_unstale":"2024-09-19T15:32:27.116308+0000","last_undegraded":"2024-09-19T15:32:27.116308+0000","last_fullsized":"2024-09-19T15:32:27.116308+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'155","last_scrub_stamp":"2024-09-19T15:32:27.115991+0000","last_deep_scrub":"268'155","last_deep_scrub_stamp":"2024-09-19T15:32:27.115991+0000","last_clean_scrub_stamp":"2024-09-19T15:32:27.115991+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:42:49.154644+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":216,"num_read_kb":226,"num_write":329,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"268'909","reported_seq":2615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.735293+0000","last_change":"2024-09-19T15:31:57.735293+0000","last_active":"2024-09-19T15:31:57.735293+0000","last_peered":"2024-09-19T15:31:57.735293+0000","last_clean":"2024-09-19T15:31:57.735293+0000","last_became_active":"2024-09-19T13:40:36.234428+0000","last_became_peered":"2024-09-19T13:40:36.234428+0000","last_unstale":"2024-09-19T15:31:57.735293+0000","last_undegraded":"2024-09-19T15:31:57.735293+0000","last_fullsized":"2024-09-19T15:31:57.735293+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'909","last_scrub_stamp":"2024-09-19T15:31:57.735111+0000","last_deep_scrub":"268'909","last_deep_scrub_stamp":"2024-09-19T15:31:57.735111+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.735111+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":800,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:43:16.615480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4426,"num_read_kb":3975,"num_write":1248,"num_write_kb":508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"268'387","reported_seq":1106,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.658635+0000","last_change":"2024-09-19T15:31:49.658391+0000","last_active":"2024-09-19T15:31:49.658635+0000","last_peered":"2024-09-19T15:31:49.658635+0000","last_clean":"2024-09-19T15:31:49.658635+0000","last_became_active":"2024-09-19T13:40:34.249719+0000","last_became_peered":"2024-09-19T13:40:34.249719+0000","last_unstale":"2024-09-19T15:31:49.658635+0000","last_undegraded":"2024-09-19T15:31:49.658635+0000","last_fullsized":"2024-09-19T15:31:49.658635+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'387","last_scrub_stamp":"2024-09-19T15:31:49.658119+0000","last_deep_scrub":"268'387","last_deep_scrub_stamp":"2024-09-19T15:31:49.658119+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.658119+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:45.295555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2165812,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":691,"num_read_kb":108324,"num_write":1302,"num_write_kb":34137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"268'4","reported_seq":1009,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.964764+0000","last_change":"2024-09-19T15:32:01.964764+0000","last_active":"2024-09-19T15:32:01.964764+0000","last_peered":"2024-09-19T15:32:01.964764+0000","last_clean":"2024-09-19T15:32:01.964764+0000","last_became_active":"2024-09-19T13:40:38.245835+0000","last_became_peered":"2024-09-19T13:40:38.245835+0000","last_unstale":"2024-09-19T15:32:01.964764+0000","last_undegraded":"2024-09-19T15:32:01.964764+0000","last_fullsized":"2024-09-19T15:32:01.964764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-19T15:32:01.964584+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-19T15:32:01.964584+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.964584+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:59:35.197432+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":719,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"268'395","reported_seq":1058,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:13.694480+0000","last_change":"2024-09-19T15:32:13.694480+0000","last_active":"2024-09-19T15:32:13.694480+0000","last_peered":"2024-09-19T15:32:13.694480+0000","last_clean":"2024-09-19T15:32:13.694480+0000","last_became_active":"2024-09-19T13:40:40.237537+0000","last_became_peered":"2024-09-19T13:40:40.237537+0000","last_unstale":"2024-09-19T15:32:13.694480+0000","last_undegraded":"2024-09-19T15:32:13.694480+0000","last_fullsized":"2024-09-19T15:32:13.694480+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'395","last_scrub_stamp":"2024-09-19T15:32:13.694279+0000","last_deep_scrub":"268'395","last_deep_scrub_stamp":"2024-09-19T15:32:13.694279+0000","last_clean_scrub_stamp":"2024-09-19T15:32:13.694279+0000","objects_scrubbed":8,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:26.735974+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49094,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":653,"num_read_kb":1263,"num_write":536,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:10.670226+0000","last_change":"2024-09-19T15:32:10.670226+0000","last_active":"2024-09-19T15:32:10.670226+0000","last_peered":"2024-09-19T15:32:10.670226+0000","last_clean":"2024-09-19T15:32:10.670226+0000","last_became_active":"2024-09-19T13:40:42.251896+0000","last_became_peered":"2024-09-19T13:40:42.251896+0000","last_unstale":"2024-09-19T15:32:10.670226+0000","last_undegraded":"2024-09-19T15:32:10.670226+0000","last_fullsized":"2024-09-19T15:32:10.670226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:10.670041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:10.670041+0000","last_clean_scrub_stamp":"2024-09-19T15:32:10.670041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:53.016060+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"268'206","reported_seq":1101,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:11.064271+0000","last_change":"2024-09-19T15:32:11.064051+0000","last_active":"2024-09-19T15:32:11.064271+0000","last_peered":"2024-09-19T15:32:11.064271+0000","last_clean":"2024-09-19T15:32:11.064271+0000","last_became_active":"2024-09-19T13:40:44.268710+0000","last_became_peered":"2024-09-19T13:40:44.268710+0000","last_unstale":"2024-09-19T15:32:11.064271+0000","last_undegraded":"2024-09-19T15:32:11.064271+0000","last_fullsized":"2024-09-19T15:32:11.064271+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'206","last_scrub_stamp":"2024-09-19T15:32:11.063850+0000","last_deep_scrub":"268'206","last_deep_scrub_stamp":"2024-09-19T15:32:11.063850+0000","last_clean_scrub_stamp":"2024-09-19T15:32:11.063850+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:41.173552+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":655,"num_read_kb":652,"num_write":565,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"268'581","reported_seq":2272,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.009024+0000","last_change":"2024-09-19T15:32:05.008735+0000","last_active":"2024-09-19T15:32:05.009024+0000","last_peered":"2024-09-19T15:32:05.009024+0000","last_clean":"2024-09-19T15:32:05.009024+0000","last_became_active":"2024-09-19T13:40:36.217961+0000","last_became_peered":"2024-09-19T13:40:36.217961+0000","last_unstale":"2024-09-19T15:32:05.009024+0000","last_undegraded":"2024-09-19T15:32:05.009024+0000","last_fullsized":"2024-09-19T15:32:05.009024+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'581","last_scrub_stamp":"2024-09-19T15:32:05.008452+0000","last_deep_scrub":"268'581","last_deep_scrub_stamp":"2024-09-19T15:32:05.008452+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.008452+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:51.104635+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2994,"num_read_kb":2751,"num_write":739,"num_write_kb":238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"268'361","reported_seq":1168,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.549870+0000","last_change":"2024-09-19T15:31:47.549717+0000","last_active":"2024-09-19T15:31:47.549870+0000","last_peered":"2024-09-19T15:31:47.549870+0000","last_clean":"2024-09-19T15:31:47.549870+0000","last_became_active":"2024-09-19T13:40:34.253708+0000","last_became_peered":"2024-09-19T13:40:34.253708+0000","last_unstale":"2024-09-19T15:31:47.549870+0000","last_undegraded":"2024-09-19T15:31:47.549870+0000","last_fullsized":"2024-09-19T15:31:47.549870+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'361","last_scrub_stamp":"2024-09-19T15:31:47.549493+0000","last_deep_scrub":"268'361","last_deep_scrub_stamp":"2024-09-19T15:31:47.549493+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.549493+0000","objects_scrubbed":7,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:11:12.191338+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":758,"num_read_kb":54804,"num_write":1089,"num_write_kb":28785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:10.582279+0000","last_change":"2024-09-19T15:32:10.582279+0000","last_active":"2024-09-19T15:32:10.582279+0000","last_peered":"2024-09-19T15:32:10.582279+0000","last_clean":"2024-09-19T15:32:10.582279+0000","last_became_active":"2024-09-19T13:40:38.245018+0000","last_became_peered":"2024-09-19T13:40:38.245018+0000","last_unstale":"2024-09-19T15:32:10.582279+0000","last_undegraded":"2024-09-19T15:32:10.582279+0000","last_fullsized":"2024-09-19T15:32:10.582279+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:10.582106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:10.582106+0000","last_clean_scrub_stamp":"2024-09-19T15:32:10.582106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:06.488949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"268'355","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:17.157824+0000","last_change":"2024-09-19T15:32:17.157824+0000","last_active":"2024-09-19T15:32:17.157824+0000","last_peered":"2024-09-19T15:32:17.157824+0000","last_clean":"2024-09-19T15:32:17.157824+0000","last_became_active":"2024-09-19T13:40:40.229201+0000","last_became_peered":"2024-09-19T13:40:40.229201+0000","last_unstale":"2024-09-19T15:32:17.157824+0000","last_undegraded":"2024-09-19T15:32:17.157824+0000","last_fullsized":"2024-09-19T15:32:17.157824+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'355","last_scrub_stamp":"2024-09-19T15:32:17.157622+0000","last_deep_scrub":"268'355","last_deep_scrub_stamp":"2024-09-19T15:32:17.157622+0000","last_clean_scrub_stamp":"2024-09-19T15:32:17.157622+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:08:17.221388+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43041,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":567,"num_read_kb":1167,"num_write":454,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":526,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:09.644092+0000","last_change":"2024-09-19T15:32:09.644092+0000","last_active":"2024-09-19T15:32:09.644092+0000","last_peered":"2024-09-19T15:32:09.644092+0000","last_clean":"2024-09-19T15:32:09.644092+0000","last_became_active":"2024-09-19T13:40:42.246286+0000","last_became_peered":"2024-09-19T13:40:42.246286+0000","last_unstale":"2024-09-19T15:32:09.644092+0000","last_undegraded":"2024-09-19T15:32:09.644092+0000","last_fullsized":"2024-09-19T15:32:09.644092+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:09.643912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:09.643912+0000","last_clean_scrub_stamp":"2024-09-19T15:32:09.643912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:01:20.999995+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"268'165","reported_seq":738,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:22.614052+0000","last_change":"2024-09-19T15:32:22.613917+0000","last_active":"2024-09-19T15:32:22.614052+0000","last_peered":"2024-09-19T15:32:22.614052+0000","last_clean":"2024-09-19T15:32:22.614052+0000","last_became_active":"2024-09-19T13:40:44.267428+0000","last_became_peered":"2024-09-19T13:40:44.267428+0000","last_unstale":"2024-09-19T15:32:22.614052+0000","last_undegraded":"2024-09-19T15:32:22.614052+0000","last_fullsized":"2024-09-19T15:32:22.614052+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'165","last_scrub_stamp":"2024-09-19T15:32:22.613708+0000","last_deep_scrub":"268'165","last_deep_scrub_stamp":"2024-09-19T15:32:22.613708+0000","last_clean_scrub_stamp":"2024-09-19T15:32:22.613708+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:12:11.772585+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":325,"num_read_kb":284,"num_write":406,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"268'374","reported_seq":2108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.834707+0000","last_change":"2024-09-19T15:31:51.834458+0000","last_active":"2024-09-19T15:31:51.834707+0000","last_peered":"2024-09-19T15:31:51.834707+0000","last_clean":"2024-09-19T15:31:51.834707+0000","last_became_active":"2024-09-19T13:40:36.230842+0000","last_became_peered":"2024-09-19T13:40:36.230842+0000","last_unstale":"2024-09-19T15:31:51.834707+0000","last_undegraded":"2024-09-19T15:31:51.834707+0000","last_fullsized":"2024-09-19T15:31:51.834707+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'374","last_scrub_stamp":"2024-09-19T15:31:51.834239+0000","last_deep_scrub":"268'374","last_deep_scrub_stamp":"2024-09-19T15:31:51.834239+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.834239+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:37.484036+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2340,"num_read_kb":2286,"num_write":408,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"268'380","reported_seq":1171,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.697045+0000","last_change":"2024-09-19T15:31:49.696898+0000","last_active":"2024-09-19T15:31:49.697045+0000","last_peered":"2024-09-19T15:31:49.697045+0000","last_clean":"2024-09-19T15:31:49.697045+0000","last_became_active":"2024-09-19T13:41:05.307368+0000","last_became_peered":"2024-09-19T13:41:05.307368+0000","last_unstale":"2024-09-19T15:31:49.697045+0000","last_undegraded":"2024-09-19T15:31:49.697045+0000","last_fullsized":"2024-09-19T15:31:49.697045+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'380","last_scrub_stamp":"2024-09-19T15:31:49.696677+0000","last_deep_scrub":"268'380","last_deep_scrub_stamp":"2024-09-19T15:31:49.696677+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.696677+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:46.518267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":987,"num_read_kb":73584,"num_write":1229,"num_write_kb":59214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.597487+0000","last_change":"2024-09-19T15:32:03.597487+0000","last_active":"2024-09-19T15:32:03.597487+0000","last_peered":"2024-09-19T15:32:03.597487+0000","last_clean":"2024-09-19T15:32:03.597487+0000","last_became_active":"2024-09-19T13:40:38.245287+0000","last_became_peered":"2024-09-19T13:40:38.245287+0000","last_unstale":"2024-09-19T15:32:03.597487+0000","last_undegraded":"2024-09-19T15:32:03.597487+0000","last_fullsized":"2024-09-19T15:32:03.597487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:03.597281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:03.597281+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.597281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:23.720458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"268'179","reported_seq":774,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:14.584853+0000","last_change":"2024-09-19T15:32:14.584713+0000","last_active":"2024-09-19T15:32:14.584853+0000","last_peered":"2024-09-19T15:32:14.584853+0000","last_clean":"2024-09-19T15:32:14.584853+0000","last_became_active":"2024-09-19T13:40:40.246680+0000","last_became_peered":"2024-09-19T13:40:40.246680+0000","last_unstale":"2024-09-19T15:32:14.584853+0000","last_undegraded":"2024-09-19T15:32:14.584853+0000","last_fullsized":"2024-09-19T15:32:14.584853+0000","mapping_epoch":31,"log_start":"268'100","ondisk_log_start":"268'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'179","last_scrub_stamp":"2024-09-19T15:32:14.584522+0000","last_deep_scrub":"268'179","last_deep_scrub_stamp":"2024-09-19T15:32:14.584522+0000","last_clean_scrub_stamp":"2024-09-19T15:32:14.584522+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:30:59.612795+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":223,"num_read_kb":217,"num_write":204,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"268'765","reported_seq":2981,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:07.935783+0000","last_change":"2024-09-19T15:32:07.935783+0000","last_active":"2024-09-19T15:32:07.935783+0000","last_peered":"2024-09-19T15:32:07.935783+0000","last_clean":"2024-09-19T15:32:07.935783+0000","last_became_active":"2024-09-19T13:40:42.250436+0000","last_became_peered":"2024-09-19T13:40:42.250436+0000","last_unstale":"2024-09-19T15:32:07.935783+0000","last_undegraded":"2024-09-19T15:32:07.935783+0000","last_fullsized":"2024-09-19T15:32:07.935783+0000","mapping_epoch":33,"log_start":"268'700","ondisk_log_start":"268'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'765","last_scrub_stamp":"2024-09-19T15:32:07.935587+0000","last_deep_scrub":"268'765","last_deep_scrub_stamp":"2024-09-19T15:32:07.935587+0000","last_clean_scrub_stamp":"2024-09-19T15:32:07.935587+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:37.846498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"268'102","reported_seq":647,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:19.687388+0000","last_change":"2024-09-19T15:32:19.687128+0000","last_active":"2024-09-19T15:32:19.687388+0000","last_peered":"2024-09-19T15:32:19.687388+0000","last_clean":"2024-09-19T15:32:19.687388+0000","last_became_active":"2024-09-19T13:40:44.268630+0000","last_became_peered":"2024-09-19T13:40:44.268630+0000","last_unstale":"2024-09-19T15:32:19.687388+0000","last_undegraded":"2024-09-19T15:32:19.687388+0000","last_fullsized":"2024-09-19T15:32:19.687388+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'102","last_scrub_stamp":"2024-09-19T15:32:19.686909+0000","last_deep_scrub":"268'102","last_deep_scrub_stamp":"2024-09-19T15:32:19.686909+0000","last_clean_scrub_stamp":"2024-09-19T15:32:19.686909+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:49:34.595882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":162,"num_read_kb":149,"num_write":244,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"268'1165","reported_seq":2742,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.534318+0000","last_change":"2024-09-19T15:31:58.534176+0000","last_active":"2024-09-19T15:31:58.534318+0000","last_peered":"2024-09-19T15:31:58.534318+0000","last_clean":"2024-09-19T15:31:58.534318+0000","last_became_active":"2024-09-19T13:41:05.320040+0000","last_became_peered":"2024-09-19T13:41:05.320040+0000","last_unstale":"2024-09-19T15:31:58.534318+0000","last_undegraded":"2024-09-19T15:31:58.534318+0000","last_fullsized":"2024-09-19T15:31:58.534318+0000","mapping_epoch":38,"log_start":"268'1100","ondisk_log_start":"268'1100","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1165","last_scrub_stamp":"2024-09-19T15:31:58.533998+0000","last_deep_scrub":"268'1165","last_deep_scrub_stamp":"2024-09-19T15:31:58.533998+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.533998+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":1100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:51.390548+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5194,"num_read_kb":4574,"num_write":1598,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"268'367","reported_seq":1038,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.813699+0000","last_change":"2024-09-19T15:31:52.813433+0000","last_active":"2024-09-19T15:31:52.813699+0000","last_peered":"2024-09-19T15:31:52.813699+0000","last_clean":"2024-09-19T15:31:52.813699+0000","last_became_active":"2024-09-19T13:40:34.251475+0000","last_became_peered":"2024-09-19T13:40:34.251475+0000","last_unstale":"2024-09-19T15:31:52.813699+0000","last_undegraded":"2024-09-19T15:31:52.813699+0000","last_fullsized":"2024-09-19T15:31:52.813699+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'367","last_scrub_stamp":"2024-09-19T15:31:52.813085+0000","last_deep_scrub":"268'367","last_deep_scrub_stamp":"2024-09-19T15:31:52.813085+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.813085+0000","objects_scrubbed":3,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:50.638803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":623,"num_read_kb":3575,"num_write":1141,"num_write_kb":19359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.633155+0000","last_change":"2024-09-19T15:32:08.633155+0000","last_active":"2024-09-19T15:32:08.633155+0000","last_peered":"2024-09-19T15:32:08.633155+0000","last_clean":"2024-09-19T15:32:08.633155+0000","last_became_active":"2024-09-19T13:40:38.246205+0000","last_became_peered":"2024-09-19T13:40:38.246205+0000","last_unstale":"2024-09-19T15:32:08.633155+0000","last_undegraded":"2024-09-19T15:32:08.633155+0000","last_fullsized":"2024-09-19T15:32:08.633155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:08.632970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:08.632970+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.632970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:46.231112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"268'391","reported_seq":1061,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:16.627040+0000","last_change":"2024-09-19T15:32:16.626907+0000","last_active":"2024-09-19T15:32:16.627040+0000","last_peered":"2024-09-19T15:32:16.627040+0000","last_clean":"2024-09-19T15:32:16.627040+0000","last_became_active":"2024-09-19T13:40:40.241730+0000","last_became_peered":"2024-09-19T13:40:40.241730+0000","last_unstale":"2024-09-19T15:32:16.627040+0000","last_undegraded":"2024-09-19T15:32:16.627040+0000","last_fullsized":"2024-09-19T15:32:16.627040+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'391","last_scrub_stamp":"2024-09-19T15:32:16.626717+0000","last_deep_scrub":"268'391","last_deep_scrub_stamp":"2024-09-19T15:32:16.626717+0000","last_clean_scrub_stamp":"2024-09-19T15:32:16.626717+0000","objects_scrubbed":8,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:16.732410+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69547,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":608,"num_read_kb":1209,"num_write":470,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":518,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:15.608498+0000","last_change":"2024-09-19T15:32:15.608498+0000","last_active":"2024-09-19T15:32:15.608498+0000","last_peered":"2024-09-19T15:32:15.608498+0000","last_clean":"2024-09-19T15:32:15.608498+0000","last_became_active":"2024-09-19T13:40:42.240191+0000","last_became_peered":"2024-09-19T13:40:42.240191+0000","last_unstale":"2024-09-19T15:32:15.608498+0000","last_undegraded":"2024-09-19T15:32:15.608498+0000","last_fullsized":"2024-09-19T15:32:15.608498+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:15.608302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:15.608302+0000","last_clean_scrub_stamp":"2024-09-19T15:32:15.608302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:59.856035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"268'130","reported_seq":663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:21.614445+0000","last_change":"2024-09-19T15:32:21.614445+0000","last_active":"2024-09-19T15:32:21.614445+0000","last_peered":"2024-09-19T15:32:21.614445+0000","last_clean":"2024-09-19T15:32:21.614445+0000","last_became_active":"2024-09-19T13:40:44.274449+0000","last_became_peered":"2024-09-19T13:40:44.274449+0000","last_unstale":"2024-09-19T15:32:21.614445+0000","last_undegraded":"2024-09-19T15:32:21.614445+0000","last_fullsized":"2024-09-19T15:32:21.614445+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'130","last_scrub_stamp":"2024-09-19T15:32:21.614259+0000","last_deep_scrub":"268'130","last_deep_scrub_stamp":"2024-09-19T15:32:21.614259+0000","last_clean_scrub_stamp":"2024-09-19T15:32:21.614259+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:17:58.072102+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":153,"num_write":303,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"268'798","reported_seq":2354,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.488511+0000","last_change":"2024-09-19T15:31:57.488362+0000","last_active":"2024-09-19T15:31:57.488511+0000","last_peered":"2024-09-19T15:31:57.488511+0000","last_clean":"2024-09-19T15:31:57.488511+0000","last_became_active":"2024-09-19T13:40:36.227359+0000","last_became_peered":"2024-09-19T13:40:36.227359+0000","last_unstale":"2024-09-19T15:31:57.488511+0000","last_undegraded":"2024-09-19T15:31:57.488511+0000","last_fullsized":"2024-09-19T15:31:57.488511+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'798","last_scrub_stamp":"2024-09-19T15:31:57.488181+0000","last_deep_scrub":"268'798","last_deep_scrub_stamp":"2024-09-19T15:31:57.488181+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.488181+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:25.410101+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3854,"num_read_kb":3454,"num_write":1058,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":689,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"268'425","reported_seq":1191,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.803545+0000","last_change":"2024-09-19T15:31:53.803379+0000","last_active":"2024-09-19T15:31:53.803545+0000","last_peered":"2024-09-19T15:31:53.803545+0000","last_clean":"2024-09-19T15:31:53.803545+0000","last_became_active":"2024-09-19T13:41:05.313209+0000","last_became_peered":"2024-09-19T13:41:05.313209+0000","last_unstale":"2024-09-19T15:31:53.803545+0000","last_undegraded":"2024-09-19T15:31:53.803545+0000","last_fullsized":"2024-09-19T15:31:53.803545+0000","mapping_epoch":38,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'425","last_scrub_stamp":"2024-09-19T15:31:53.803129+0000","last_deep_scrub":"268'425","last_deep_scrub_stamp":"2024-09-19T15:31:53.803129+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.803129+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:11:25.265777+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136845,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":777,"num_read_kb":102227,"num_write":1424,"num_write_kb":49987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":538,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:12.705223+0000","last_change":"2024-09-19T15:32:12.705223+0000","last_active":"2024-09-19T15:32:12.705223+0000","last_peered":"2024-09-19T15:32:12.705223+0000","last_clean":"2024-09-19T15:32:12.705223+0000","last_became_active":"2024-09-19T13:40:38.229929+0000","last_became_peered":"2024-09-19T13:40:38.229929+0000","last_unstale":"2024-09-19T15:32:12.705223+0000","last_undegraded":"2024-09-19T15:32:12.705223+0000","last_fullsized":"2024-09-19T15:32:12.705223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:12.704925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:12.704925+0000","last_clean_scrub_stamp":"2024-09-19T15:32:12.704925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:09:57.542107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"268'306","reported_seq":926,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:10.641013+0000","last_change":"2024-09-19T15:32:10.641013+0000","last_active":"2024-09-19T15:32:10.641013+0000","last_peered":"2024-09-19T15:32:10.641013+0000","last_clean":"2024-09-19T15:32:10.641013+0000","last_became_active":"2024-09-19T13:40:40.241404+0000","last_became_peered":"2024-09-19T13:40:40.241404+0000","last_unstale":"2024-09-19T15:32:10.641013+0000","last_undegraded":"2024-09-19T15:32:10.641013+0000","last_fullsized":"2024-09-19T15:32:10.641013+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'306","last_scrub_stamp":"2024-09-19T15:32:10.640809+0000","last_deep_scrub":"268'306","last_deep_scrub_stamp":"2024-09-19T15:32:10.640809+0000","last_clean_scrub_stamp":"2024-09-19T15:32:10.640809+0000","objects_scrubbed":4,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:35.973568+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45708,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":1069,"num_write":394,"num_write_kb":285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":515,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.952575+0000","last_change":"2024-09-19T15:32:06.952418+0000","last_active":"2024-09-19T15:32:06.952575+0000","last_peered":"2024-09-19T15:32:06.952575+0000","last_clean":"2024-09-19T15:32:06.952575+0000","last_became_active":"2024-09-19T13:40:42.251413+0000","last_became_peered":"2024-09-19T13:40:42.251413+0000","last_unstale":"2024-09-19T15:32:06.952575+0000","last_undegraded":"2024-09-19T15:32:06.952575+0000","last_fullsized":"2024-09-19T15:32:06.952575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:06.952230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:06.952230+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.952230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:46:16.041934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"268'164","reported_seq":728,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:26.080657+0000","last_change":"2024-09-19T15:32:26.080657+0000","last_active":"2024-09-19T15:32:26.080657+0000","last_peered":"2024-09-19T15:32:26.080657+0000","last_clean":"2024-09-19T15:32:26.080657+0000","last_became_active":"2024-09-19T13:40:44.277774+0000","last_became_peered":"2024-09-19T13:40:44.277774+0000","last_unstale":"2024-09-19T15:32:26.080657+0000","last_undegraded":"2024-09-19T15:32:26.080657+0000","last_fullsized":"2024-09-19T15:32:26.080657+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'164","last_scrub_stamp":"2024-09-19T15:32:26.080469+0000","last_deep_scrub":"268'164","last_deep_scrub_stamp":"2024-09-19T15:32:26.080469+0000","last_clean_scrub_stamp":"2024-09-19T15:32:26.080469+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:38.054276+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":980,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":216,"num_read_kb":207,"num_write":371,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"268'468","reported_seq":2247,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.010835+0000","last_change":"2024-09-19T15:32:02.010694+0000","last_active":"2024-09-19T15:32:02.010835+0000","last_peered":"2024-09-19T15:32:02.010835+0000","last_clean":"2024-09-19T15:32:02.010835+0000","last_became_active":"2024-09-19T13:40:36.222632+0000","last_became_peered":"2024-09-19T13:40:36.222632+0000","last_unstale":"2024-09-19T15:32:02.010835+0000","last_undegraded":"2024-09-19T15:32:02.010835+0000","last_fullsized":"2024-09-19T15:32:02.010835+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'468","last_scrub_stamp":"2024-09-19T15:32:02.010501+0000","last_deep_scrub":"268'468","last_deep_scrub_stamp":"2024-09-19T15:32:02.010501+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.010501+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:51:35.207348+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2809,"num_read_kb":2663,"num_write":534,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3595,"num_omap_keys":15,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"268'381","reported_seq":1092,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.916585+0000","last_change":"2024-09-19T15:31:49.916447+0000","last_active":"2024-09-19T15:31:49.916585+0000","last_peered":"2024-09-19T15:31:49.916585+0000","last_clean":"2024-09-19T15:31:49.916585+0000","last_became_active":"2024-09-19T13:40:34.258068+0000","last_became_peered":"2024-09-19T13:40:34.258068+0000","last_unstale":"2024-09-19T15:31:49.916585+0000","last_undegraded":"2024-09-19T15:31:49.916585+0000","last_fullsized":"2024-09-19T15:31:49.916585+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'381","last_scrub_stamp":"2024-09-19T15:31:49.916243+0000","last_deep_scrub":"268'381","last_deep_scrub_stamp":"2024-09-19T15:31:49.916243+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.916243+0000","objects_scrubbed":3,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:51:34.097674+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":750,"num_read_kb":11976,"num_write":1179,"num_write_kb":32337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":529,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:08.568678+0000","last_change":"2024-09-19T15:32:08.568678+0000","last_active":"2024-09-19T15:32:08.568678+0000","last_peered":"2024-09-19T15:32:08.568678+0000","last_clean":"2024-09-19T15:32:08.568678+0000","last_became_active":"2024-09-19T13:40:38.236724+0000","last_became_peered":"2024-09-19T13:40:38.236724+0000","last_unstale":"2024-09-19T15:32:08.568678+0000","last_undegraded":"2024-09-19T15:32:08.568678+0000","last_fullsized":"2024-09-19T15:32:08.568678+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:08.568485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:08.568485+0000","last_clean_scrub_stamp":"2024-09-19T15:32:08.568485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:28.356524+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"268'279","reported_seq":881,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:16.193007+0000","last_change":"2024-09-19T15:32:16.193007+0000","last_active":"2024-09-19T15:32:16.193007+0000","last_peered":"2024-09-19T15:32:16.193007+0000","last_clean":"2024-09-19T15:32:16.193007+0000","last_became_active":"2024-09-19T13:40:40.222807+0000","last_became_peered":"2024-09-19T13:40:40.222807+0000","last_unstale":"2024-09-19T15:32:16.193007+0000","last_undegraded":"2024-09-19T15:32:16.193007+0000","last_fullsized":"2024-09-19T15:32:16.193007+0000","mapping_epoch":31,"log_start":"268'200","ondisk_log_start":"268'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'279","last_scrub_stamp":"2024-09-19T15:32:16.192819+0000","last_deep_scrub":"268'279","last_deep_scrub_stamp":"2024-09-19T15:32:16.192819+0000","last_clean_scrub_stamp":"2024-09-19T15:32:16.192819+0000","objects_scrubbed":3,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:55:09.211321+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47535,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":1137,"num_write":394,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":519,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:22.489802+0000","last_change":"2024-09-19T15:32:22.489802+0000","last_active":"2024-09-19T15:32:22.489802+0000","last_peered":"2024-09-19T15:32:22.489802+0000","last_clean":"2024-09-19T15:32:22.489802+0000","last_became_active":"2024-09-19T13:40:42.251057+0000","last_became_peered":"2024-09-19T13:40:42.251057+0000","last_unstale":"2024-09-19T15:32:22.489802+0000","last_undegraded":"2024-09-19T15:32:22.489802+0000","last_fullsized":"2024-09-19T15:32:22.489802+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:22.489612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:22.489612+0000","last_clean_scrub_stamp":"2024-09-19T15:32:22.489612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:52.279574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"268'147","reported_seq":1287,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:20.654690+0000","last_change":"2024-09-19T15:32:20.654690+0000","last_active":"2024-09-19T15:32:20.654690+0000","last_peered":"2024-09-19T15:32:20.654690+0000","last_clean":"2024-09-19T15:32:20.654690+0000","last_became_active":"2024-09-19T13:40:44.270656+0000","last_became_peered":"2024-09-19T13:40:44.270656+0000","last_unstale":"2024-09-19T15:32:20.654690+0000","last_undegraded":"2024-09-19T15:32:20.654690+0000","last_fullsized":"2024-09-19T15:32:20.654690+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'147","last_scrub_stamp":"2024-09-19T15:32:20.654476+0000","last_deep_scrub":"268'147","last_deep_scrub_stamp":"2024-09-19T15:32:20.654476+0000","last_clean_scrub_stamp":"2024-09-19T15:32:20.654476+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:26.821573+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":816,"num_read_kb":810,"num_write":350,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"268'465","reported_seq":2003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.548394+0000","last_change":"2024-09-19T15:31:55.548394+0000","last_active":"2024-09-19T15:31:55.548394+0000","last_peered":"2024-09-19T15:31:55.548394+0000","last_clean":"2024-09-19T15:31:55.548394+0000","last_became_active":"2024-09-19T13:40:36.217230+0000","last_became_peered":"2024-09-19T13:40:36.217230+0000","last_unstale":"2024-09-19T15:31:55.548394+0000","last_undegraded":"2024-09-19T15:31:55.548394+0000","last_fullsized":"2024-09-19T15:31:55.548394+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'465","last_scrub_stamp":"2024-09-19T15:31:55.548152+0000","last_deep_scrub":"268'465","last_deep_scrub_stamp":"2024-09-19T15:31:55.548152+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.548152+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:04.184032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2437,"num_read_kb":2267,"num_write":569,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"268'335","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:47.661949+0000","last_change":"2024-09-19T15:31:47.661888+0000","last_active":"2024-09-19T15:31:47.661949+0000","last_peered":"2024-09-19T15:31:47.661949+0000","last_clean":"2024-09-19T15:31:47.661949+0000","last_became_active":"2024-09-19T13:40:34.258416+0000","last_became_peered":"2024-09-19T13:40:34.258416+0000","last_unstale":"2024-09-19T15:31:47.661949+0000","last_undegraded":"2024-09-19T15:31:47.661949+0000","last_fullsized":"2024-09-19T15:31:47.661949+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'335","last_scrub_stamp":"2024-09-19T15:31:47.661793+0000","last_deep_scrub":"268'335","last_deep_scrub_stamp":"2024-09-19T15:31:47.661793+0000","last_clean_scrub_stamp":"2024-09-19T15:31:47.661793+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:16.145468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":559,"num_read_kb":6695,"num_write":1052,"num_write_kb":15020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"268'2","reported_seq":527,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:05.657305+0000","last_change":"2024-09-19T15:32:05.657108+0000","last_active":"2024-09-19T15:32:05.657305+0000","last_peered":"2024-09-19T15:32:05.657305+0000","last_clean":"2024-09-19T15:32:05.657305+0000","last_became_active":"2024-09-19T13:40:38.214571+0000","last_became_peered":"2024-09-19T13:40:38.214571+0000","last_unstale":"2024-09-19T15:32:05.657305+0000","last_undegraded":"2024-09-19T15:32:05.657305+0000","last_fullsized":"2024-09-19T15:32:05.657305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-19T15:32:05.656919+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-19T15:32:05.656919+0000","last_clean_scrub_stamp":"2024-09-19T15:32:05.656919+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:18:39.425426+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"268'355","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:16.604721+0000","last_change":"2024-09-19T15:32:16.604721+0000","last_active":"2024-09-19T15:32:16.604721+0000","last_peered":"2024-09-19T15:32:16.604721+0000","last_clean":"2024-09-19T15:32:16.604721+0000","last_became_active":"2024-09-19T13:40:40.245368+0000","last_became_peered":"2024-09-19T13:40:40.245368+0000","last_unstale":"2024-09-19T15:32:16.604721+0000","last_undegraded":"2024-09-19T15:32:16.604721+0000","last_fullsized":"2024-09-19T15:32:16.604721+0000","mapping_epoch":31,"log_start":"268'300","ondisk_log_start":"268'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'355","last_scrub_stamp":"2024-09-19T15:32:16.604529+0000","last_deep_scrub":"268'355","last_deep_scrub_stamp":"2024-09-19T15:32:16.604529+0000","last_clean_scrub_stamp":"2024-09-19T15:32:16.604529+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:31:33.028785+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48547,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":571,"num_read_kb":1175,"num_write":452,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":516,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:16.612659+0000","last_change":"2024-09-19T15:32:16.612659+0000","last_active":"2024-09-19T15:32:16.612659+0000","last_peered":"2024-09-19T15:32:16.612659+0000","last_clean":"2024-09-19T15:32:16.612659+0000","last_became_active":"2024-09-19T13:40:42.239391+0000","last_became_peered":"2024-09-19T13:40:42.239391+0000","last_unstale":"2024-09-19T15:32:16.612659+0000","last_undegraded":"2024-09-19T15:32:16.612659+0000","last_fullsized":"2024-09-19T15:32:16.612659+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T15:32:16.612481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T15:32:16.612481+0000","last_clean_scrub_stamp":"2024-09-19T15:32:16.612481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:37.873230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"268'131","reported_seq":668,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:18.583940+0000","last_change":"2024-09-19T15:32:18.583804+0000","last_active":"2024-09-19T15:32:18.583940+0000","last_peered":"2024-09-19T15:32:18.583940+0000","last_clean":"2024-09-19T15:32:18.583940+0000","last_became_active":"2024-09-19T13:40:44.249201+0000","last_became_peered":"2024-09-19T13:40:44.249201+0000","last_unstale":"2024-09-19T15:32:18.583940+0000","last_undegraded":"2024-09-19T15:32:18.583940+0000","last_fullsized":"2024-09-19T15:32:18.583940+0000","mapping_epoch":35,"log_start":"268'100","ondisk_log_start":"268'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'131","last_scrub_stamp":"2024-09-19T15:32:18.583609+0000","last_deep_scrub":"268'131","last_deep_scrub_stamp":"2024-09-19T15:32:18.583609+0000","last_clean_scrub_stamp":"2024-09-19T15:32:18.583609+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:15:18.362322+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":629,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":210,"num_read_kb":190,"num_write":320,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"268'404","reported_seq":2086,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.650457+0000","last_change":"2024-09-19T15:31:59.650457+0000","last_active":"2024-09-19T15:31:59.650457+0000","last_peered":"2024-09-19T15:31:59.650457+0000","last_clean":"2024-09-19T15:31:59.650457+0000","last_became_active":"2024-09-19T13:40:36.225885+0000","last_became_peered":"2024-09-19T13:40:36.225885+0000","last_unstale":"2024-09-19T15:31:59.650457+0000","last_undegraded":"2024-09-19T15:31:59.650457+0000","last_fullsized":"2024-09-19T15:31:59.650457+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'404","last_scrub_stamp":"2024-09-19T15:31:59.650266+0000","last_deep_scrub":"268'404","last_deep_scrub_stamp":"2024-09-19T15:31:59.650266+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.650266+0000","objects_scrubbed":1,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:40.113541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2307,"num_read_kb":2225,"num_write":450,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"268'329","reported_seq":971,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.934064+0000","last_change":"2024-09-19T15:31:52.933899+0000","last_active":"2024-09-19T15:31:52.934064+0000","last_peered":"2024-09-19T15:31:52.934064+0000","last_clean":"2024-09-19T15:31:52.934064+0000","last_became_active":"2024-09-19T13:40:34.249068+0000","last_became_peered":"2024-09-19T13:40:34.249068+0000","last_unstale":"2024-09-19T15:31:52.934064+0000","last_undegraded":"2024-09-19T15:31:52.934064+0000","last_fullsized":"2024-09-19T15:31:52.934064+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'329","last_scrub_stamp":"2024-09-19T15:31:52.933659+0000","last_deep_scrub":"268'329","last_deep_scrub_stamp":"2024-09-19T15:31:52.933659+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.933659+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:49.241793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":27093,"num_write":1002,"num_write_kb":27581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"268'462","reported_seq":2113,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.639393+0000","last_change":"2024-09-19T15:32:01.639393+0000","last_active":"2024-09-19T15:32:01.639393+0000","last_peered":"2024-09-19T15:32:01.639393+0000","last_clean":"2024-09-19T15:32:01.639393+0000","last_became_active":"2024-09-19T13:40:36.220569+0000","last_became_peered":"2024-09-19T13:40:36.220569+0000","last_unstale":"2024-09-19T15:32:01.639393+0000","last_undegraded":"2024-09-19T15:32:01.639393+0000","last_fullsized":"2024-09-19T15:32:01.639393+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'462","last_scrub_stamp":"2024-09-19T15:32:01.639153+0000","last_deep_scrub":"268'462","last_deep_scrub_stamp":"2024-09-19T15:32:01.639153+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.639153+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:32:50.011020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2535,"num_read_kb":2389,"num_write":539,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"268'416","reported_seq":1141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.890316+0000","last_change":"2024-09-19T15:31:48.890155+0000","last_active":"2024-09-19T15:31:48.890316+0000","last_peered":"2024-09-19T15:31:48.890316+0000","last_clean":"2024-09-19T15:31:48.890316+0000","last_became_active":"2024-09-19T13:40:34.239357+0000","last_became_peered":"2024-09-19T13:40:34.239357+0000","last_unstale":"2024-09-19T15:31:48.890316+0000","last_undegraded":"2024-09-19T15:31:48.890316+0000","last_fullsized":"2024-09-19T15:31:48.890316+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'416","last_scrub_stamp":"2024-09-19T15:31:48.889953+0000","last_deep_scrub":"268'416","last_deep_scrub_stamp":"2024-09-19T15:31:48.889953+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.889953+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:51:03.904838+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":787,"num_read_kb":92890,"num_write":1403,"num_write_kb":63384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"268'596","reported_seq":2315,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.766403+0000","last_change":"2024-09-19T15:32:03.766403+0000","last_active":"2024-09-19T15:32:03.766403+0000","last_peered":"2024-09-19T15:32:03.766403+0000","last_clean":"2024-09-19T15:32:03.766403+0000","last_became_active":"2024-09-19T13:40:36.241566+0000","last_became_peered":"2024-09-19T13:40:36.241566+0000","last_unstale":"2024-09-19T15:32:03.766403+0000","last_undegraded":"2024-09-19T15:32:03.766403+0000","last_fullsized":"2024-09-19T15:32:03.766403+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'596","last_scrub_stamp":"2024-09-19T15:32:03.766219+0000","last_deep_scrub":"268'596","last_deep_scrub_stamp":"2024-09-19T15:32:03.766219+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.766219+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":500,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:13:52.457376+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3019,"num_read_kb":2776,"num_write":751,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"268'363","reported_seq":1053,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:54.812362+0000","last_change":"2024-09-19T15:31:54.812126+0000","last_active":"2024-09-19T15:31:54.812362+0000","last_peered":"2024-09-19T15:31:54.812362+0000","last_clean":"2024-09-19T15:31:54.812362+0000","last_became_active":"2024-09-19T13:40:34.221057+0000","last_became_peered":"2024-09-19T13:40:34.221057+0000","last_unstale":"2024-09-19T15:31:54.812362+0000","last_undegraded":"2024-09-19T15:31:54.812362+0000","last_fullsized":"2024-09-19T15:31:54.812362+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'363","last_scrub_stamp":"2024-09-19T15:31:54.811762+0000","last_deep_scrub":"268'363","last_deep_scrub_stamp":"2024-09-19T15:31:54.811762+0000","last_clean_scrub_stamp":"2024-09-19T15:31:54.811762+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:58.508853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":673,"num_read_kb":11742,"num_write":1135,"num_write_kb":23593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"268'496","reported_seq":2272,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.604022+0000","last_change":"2024-09-19T15:31:58.604022+0000","last_active":"2024-09-19T15:31:58.604022+0000","last_peered":"2024-09-19T15:31:58.604022+0000","last_clean":"2024-09-19T15:31:58.604022+0000","last_became_active":"2024-09-19T13:40:36.238166+0000","last_became_peered":"2024-09-19T13:40:36.238166+0000","last_unstale":"2024-09-19T15:31:58.604022+0000","last_undegraded":"2024-09-19T15:31:58.604022+0000","last_fullsized":"2024-09-19T15:31:58.604022+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'496","last_scrub_stamp":"2024-09-19T15:31:58.603838+0000","last_deep_scrub":"268'496","last_deep_scrub_stamp":"2024-09-19T15:31:58.603838+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.603838+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:02:50.763311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2902,"num_read_kb":2744,"num_write":591,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"268'345","reported_seq":1067,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.696407+0000","last_change":"2024-09-19T15:31:48.696407+0000","last_active":"2024-09-19T15:31:48.696407+0000","last_peered":"2024-09-19T15:31:48.696407+0000","last_clean":"2024-09-19T15:31:48.696407+0000","last_became_active":"2024-09-19T13:40:34.232099+0000","last_became_peered":"2024-09-19T13:40:34.232099+0000","last_unstale":"2024-09-19T15:31:48.696407+0000","last_undegraded":"2024-09-19T15:31:48.696407+0000","last_fullsized":"2024-09-19T15:31:48.696407+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'345","last_scrub_stamp":"2024-09-19T15:31:48.696153+0000","last_deep_scrub":"268'345","last_deep_scrub_stamp":"2024-09-19T15:31:48.696153+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.696153+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:49:42.668267+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136873,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":758,"num_read_kb":12572,"num_write":1035,"num_write_kb":46357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"268'464","reported_seq":2054,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:04.060300+0000","last_change":"2024-09-19T15:32:04.060300+0000","last_active":"2024-09-19T15:32:04.060300+0000","last_peered":"2024-09-19T15:32:04.060300+0000","last_clean":"2024-09-19T15:32:04.060300+0000","last_became_active":"2024-09-19T13:40:36.238644+0000","last_became_peered":"2024-09-19T13:40:36.238644+0000","last_unstale":"2024-09-19T15:32:04.060300+0000","last_undegraded":"2024-09-19T15:32:04.060300+0000","last_fullsized":"2024-09-19T15:32:04.060300+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'464","last_scrub_stamp":"2024-09-19T15:32:04.060118+0000","last_deep_scrub":"268'464","last_deep_scrub_stamp":"2024-09-19T15:32:04.060118+0000","last_clean_scrub_stamp":"2024-09-19T15:32:04.060118+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:50:53.942088+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2315,"num_read_kb":2185,"num_write":554,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"268'403","reported_seq":1123,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.920457+0000","last_change":"2024-09-19T15:31:50.920457+0000","last_active":"2024-09-19T15:31:50.920457+0000","last_peered":"2024-09-19T15:31:50.920457+0000","last_clean":"2024-09-19T15:31:50.920457+0000","last_became_active":"2024-09-19T13:40:34.249600+0000","last_became_peered":"2024-09-19T13:40:34.249600+0000","last_unstale":"2024-09-19T15:31:50.920457+0000","last_undegraded":"2024-09-19T15:31:50.920457+0000","last_fullsized":"2024-09-19T15:31:50.920457+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'403","last_scrub_stamp":"2024-09-19T15:31:50.920243+0000","last_deep_scrub":"268'403","last_deep_scrub_stamp":"2024-09-19T15:31:50.920243+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.920243+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:44.928927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":720,"num_read_kb":53970,"num_write":1365,"num_write_kb":53250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"268'834","reported_seq":2497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:00.535189+0000","last_change":"2024-09-19T15:32:00.535048+0000","last_active":"2024-09-19T15:32:00.535189+0000","last_peered":"2024-09-19T15:32:00.535189+0000","last_clean":"2024-09-19T15:32:00.535189+0000","last_became_active":"2024-09-19T13:40:36.216697+0000","last_became_peered":"2024-09-19T13:40:36.216697+0000","last_unstale":"2024-09-19T15:32:00.535189+0000","last_undegraded":"2024-09-19T15:32:00.535189+0000","last_fullsized":"2024-09-19T15:32:00.535189+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'834","last_scrub_stamp":"2024-09-19T15:32:00.534857+0000","last_deep_scrub":"268'834","last_deep_scrub_stamp":"2024-09-19T15:32:00.534857+0000","last_clean_scrub_stamp":"2024-09-19T15:32:00.534857+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:46:06.736133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4198,"num_read_kb":3766,"num_write":1106,"num_write_kb":432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"268'330","reported_seq":1034,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.609462+0000","last_change":"2024-09-19T15:31:48.609462+0000","last_active":"2024-09-19T15:31:48.609462+0000","last_peered":"2024-09-19T15:31:48.609462+0000","last_clean":"2024-09-19T15:31:48.609462+0000","last_became_active":"2024-09-19T13:40:34.216774+0000","last_became_peered":"2024-09-19T13:40:34.216774+0000","last_unstale":"2024-09-19T15:31:48.609462+0000","last_undegraded":"2024-09-19T15:31:48.609462+0000","last_fullsized":"2024-09-19T15:31:48.609462+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'330","last_scrub_stamp":"2024-09-19T15:31:48.609254+0000","last_deep_scrub":"268'330","last_deep_scrub_stamp":"2024-09-19T15:31:48.609254+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.609254+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:28.120319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136855,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":651,"num_read_kb":47831,"num_write":981,"num_write_kb":20035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"268'563","reported_seq":2262,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:03.041301+0000","last_change":"2024-09-19T15:32:03.041159+0000","last_active":"2024-09-19T15:32:03.041301+0000","last_peered":"2024-09-19T15:32:03.041301+0000","last_clean":"2024-09-19T15:32:03.041301+0000","last_became_active":"2024-09-19T13:40:36.218090+0000","last_became_peered":"2024-09-19T13:40:36.218090+0000","last_unstale":"2024-09-19T15:32:03.041301+0000","last_undegraded":"2024-09-19T15:32:03.041301+0000","last_fullsized":"2024-09-19T15:32:03.041301+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'563","last_scrub_stamp":"2024-09-19T15:32:03.040966+0000","last_deep_scrub":"268'563","last_deep_scrub_stamp":"2024-09-19T15:32:03.040966+0000","last_clean_scrub_stamp":"2024-09-19T15:32:03.040966+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:59.258463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2933,"num_read_kb":2699,"num_write":698,"num_write_kb":201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"268'354","reported_seq":1143,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.932331+0000","last_change":"2024-09-19T15:31:50.932331+0000","last_active":"2024-09-19T15:31:50.932331+0000","last_peered":"2024-09-19T15:31:50.932331+0000","last_clean":"2024-09-19T15:31:50.932331+0000","last_became_active":"2024-09-19T13:40:34.272629+0000","last_became_peered":"2024-09-19T13:40:34.272629+0000","last_unstale":"2024-09-19T15:31:50.932331+0000","last_undegraded":"2024-09-19T15:31:50.932331+0000","last_fullsized":"2024-09-19T15:31:50.932331+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'354","last_scrub_stamp":"2024-09-19T15:31:50.932113+0000","last_deep_scrub":"268'354","last_deep_scrub_stamp":"2024-09-19T15:31:50.932113+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.932113+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T00:18:14.426357+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174644,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":935,"num_read_kb":42229,"num_write":1199,"num_write_kb":17971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"268'342","reported_seq":1793,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.944572+0000","last_change":"2024-09-19T15:31:57.944349+0000","last_active":"2024-09-19T15:31:57.944572+0000","last_peered":"2024-09-19T15:31:57.944572+0000","last_clean":"2024-09-19T15:31:57.944572+0000","last_became_active":"2024-09-19T13:40:36.224228+0000","last_became_peered":"2024-09-19T13:40:36.224228+0000","last_unstale":"2024-09-19T15:31:57.944572+0000","last_undegraded":"2024-09-19T15:31:57.944572+0000","last_fullsized":"2024-09-19T15:31:57.944572+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'342","last_scrub_stamp":"2024-09-19T15:31:57.944097+0000","last_deep_scrub":"268'342","last_deep_scrub_stamp":"2024-09-19T15:31:57.944097+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.944097+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:57.675155+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1855,"num_read_kb":1782,"num_write":368,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"268'385","reported_seq":1149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:51.890591+0000","last_change":"2024-09-19T15:31:51.890591+0000","last_active":"2024-09-19T15:31:51.890591+0000","last_peered":"2024-09-19T15:31:51.890591+0000","last_clean":"2024-09-19T15:31:51.890591+0000","last_became_active":"2024-09-19T13:40:34.245197+0000","last_became_peered":"2024-09-19T13:40:34.245197+0000","last_unstale":"2024-09-19T15:31:51.890591+0000","last_undegraded":"2024-09-19T15:31:51.890591+0000","last_fullsized":"2024-09-19T15:31:51.890591+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'385","last_scrub_stamp":"2024-09-19T15:31:51.890329+0000","last_deep_scrub":"268'385","last_deep_scrub_stamp":"2024-09-19T15:31:51.890329+0000","last_clean_scrub_stamp":"2024-09-19T15:31:51.890329+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:10:30.384059+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2273700,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":750,"num_read_kb":129994,"num_write":1223,"num_write_kb":46426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"268'497","reported_seq":2050,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.736984+0000","last_change":"2024-09-19T15:31:58.736843+0000","last_active":"2024-09-19T15:31:58.736984+0000","last_peered":"2024-09-19T15:31:58.736984+0000","last_clean":"2024-09-19T15:31:58.736984+0000","last_became_active":"2024-09-19T13:40:36.226839+0000","last_became_peered":"2024-09-19T13:40:36.226839+0000","last_unstale":"2024-09-19T15:31:58.736984+0000","last_undegraded":"2024-09-19T15:31:58.736984+0000","last_fullsized":"2024-09-19T15:31:58.736984+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'497","last_scrub_stamp":"2024-09-19T15:31:58.736663+0000","last_deep_scrub":"268'497","last_deep_scrub_stamp":"2024-09-19T15:31:58.736663+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.736663+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:38:24.306737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2632,"num_read_kb":2421,"num_write":626,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"268'349","reported_seq":1173,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:56.757738+0000","last_change":"2024-09-19T15:31:56.757738+0000","last_active":"2024-09-19T15:31:56.757738+0000","last_peered":"2024-09-19T15:31:56.757738+0000","last_clean":"2024-09-19T15:31:56.757738+0000","last_became_active":"2024-09-19T13:40:34.228472+0000","last_became_peered":"2024-09-19T13:40:34.228472+0000","last_unstale":"2024-09-19T15:31:56.757738+0000","last_undegraded":"2024-09-19T15:31:56.757738+0000","last_fullsized":"2024-09-19T15:31:56.757738+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'349","last_scrub_stamp":"2024-09-19T15:31:56.757523+0000","last_deep_scrub":"268'349","last_deep_scrub_stamp":"2024-09-19T15:31:56.757523+0000","last_clean_scrub_stamp":"2024-09-19T15:31:56.757523+0000","objects_scrubbed":6,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:30:45.800606+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1120,"num_read_kb":37188,"num_write":1213,"num_write_kb":31649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"268'801","reported_seq":2510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.491418+0000","last_change":"2024-09-19T15:32:02.491208+0000","last_active":"2024-09-19T15:32:02.491418+0000","last_peered":"2024-09-19T15:32:02.491418+0000","last_clean":"2024-09-19T15:32:02.491418+0000","last_became_active":"2024-09-19T13:40:36.217870+0000","last_became_peered":"2024-09-19T13:40:36.217870+0000","last_unstale":"2024-09-19T15:32:02.491418+0000","last_undegraded":"2024-09-19T15:32:02.491418+0000","last_fullsized":"2024-09-19T15:32:02.491418+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'801","last_scrub_stamp":"2024-09-19T15:32:02.491031+0000","last_deep_scrub":"268'801","last_deep_scrub_stamp":"2024-09-19T15:32:02.491031+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.491031+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:55.926935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3954,"num_read_kb":3588,"num_write":1044,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"268'308","reported_seq":1008,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:49.871956+0000","last_change":"2024-09-19T15:31:49.871956+0000","last_active":"2024-09-19T15:31:49.871956+0000","last_peered":"2024-09-19T15:31:49.871956+0000","last_clean":"2024-09-19T15:31:49.871956+0000","last_became_active":"2024-09-19T13:41:05.310802+0000","last_became_peered":"2024-09-19T13:41:05.310802+0000","last_unstale":"2024-09-19T15:31:49.871956+0000","last_undegraded":"2024-09-19T15:31:49.871956+0000","last_fullsized":"2024-09-19T15:31:49.871956+0000","mapping_epoch":38,"log_start":"268'200","ondisk_log_start":"268'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'308","last_scrub_stamp":"2024-09-19T15:31:49.871682+0000","last_deep_scrub":"268'308","last_deep_scrub_stamp":"2024-09-19T15:31:49.871682+0000","last_clean_scrub_stamp":"2024-09-19T15:31:49.871682+0000","objects_scrubbed":10,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:31:02.847445+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136937,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":757,"num_read_kb":21770,"num_write":969,"num_write_kb":19448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"268'361","reported_seq":1968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:52.789067+0000","last_change":"2024-09-19T15:31:52.789067+0000","last_active":"2024-09-19T15:31:52.789067+0000","last_peered":"2024-09-19T15:31:52.789067+0000","last_clean":"2024-09-19T15:31:52.789067+0000","last_became_active":"2024-09-19T13:40:36.215821+0000","last_became_peered":"2024-09-19T13:40:36.215821+0000","last_unstale":"2024-09-19T15:31:52.789067+0000","last_undegraded":"2024-09-19T15:31:52.789067+0000","last_fullsized":"2024-09-19T15:31:52.789067+0000","mapping_epoch":27,"log_start":"268'300","ondisk_log_start":"268'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'361","last_scrub_stamp":"2024-09-19T15:31:52.788781+0000","last_deep_scrub":"268'361","last_deep_scrub_stamp":"2024-09-19T15:31:52.788781+0000","last_clean_scrub_stamp":"2024-09-19T15:31:52.788781+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:07.602774+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2112,"num_read_kb":2049,"num_write":394,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"268'450","reported_seq":1194,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.773178+0000","last_change":"2024-09-19T15:31:55.772885+0000","last_active":"2024-09-19T15:31:55.773178+0000","last_peered":"2024-09-19T15:31:55.773178+0000","last_clean":"2024-09-19T15:31:55.773178+0000","last_became_active":"2024-09-19T13:40:34.261812+0000","last_became_peered":"2024-09-19T13:40:34.261812+0000","last_unstale":"2024-09-19T15:31:55.773178+0000","last_undegraded":"2024-09-19T15:31:55.773178+0000","last_fullsized":"2024-09-19T15:31:55.773178+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'450","last_scrub_stamp":"2024-09-19T15:31:55.772408+0000","last_deep_scrub":"268'450","last_deep_scrub_stamp":"2024-09-19T15:31:55.772408+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.772408+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T03:27:33.627722+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136844,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":935,"num_read_kb":21060,"num_write":1238,"num_write_kb":41159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"268'747","reported_seq":2341,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.528354+0000","last_change":"2024-09-19T15:32:01.528088+0000","last_active":"2024-09-19T15:32:01.528354+0000","last_peered":"2024-09-19T15:32:01.528354+0000","last_clean":"2024-09-19T15:32:01.528354+0000","last_became_active":"2024-09-19T13:40:36.216597+0000","last_became_peered":"2024-09-19T13:40:36.216597+0000","last_unstale":"2024-09-19T15:32:01.528354+0000","last_undegraded":"2024-09-19T15:32:01.528354+0000","last_fullsized":"2024-09-19T15:32:01.528354+0000","mapping_epoch":27,"log_start":"268'700","ondisk_log_start":"268'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'747","last_scrub_stamp":"2024-09-19T15:32:01.527862+0000","last_deep_scrub":"268'747","last_deep_scrub_stamp":"2024-09-19T15:32:01.527862+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.527862+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":700,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:21:58.511021+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3535,"num_read_kb":3206,"num_write":942,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"268'389","reported_seq":1105,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:50.688505+0000","last_change":"2024-09-19T15:31:50.688371+0000","last_active":"2024-09-19T15:31:50.688505+0000","last_peered":"2024-09-19T15:31:50.688505+0000","last_clean":"2024-09-19T15:31:50.688505+0000","last_became_active":"2024-09-19T13:40:34.255374+0000","last_became_peered":"2024-09-19T13:40:34.255374+0000","last_unstale":"2024-09-19T15:31:50.688505+0000","last_undegraded":"2024-09-19T15:31:50.688505+0000","last_fullsized":"2024-09-19T15:31:50.688505+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'389","last_scrub_stamp":"2024-09-19T15:31:50.688138+0000","last_deep_scrub":"268'389","last_deep_scrub_stamp":"2024-09-19T15:31:50.688138+0000","last_clean_scrub_stamp":"2024-09-19T15:31:50.688138+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:59:16.557745+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":672,"num_read_kb":82615,"num_write":1215,"num_write_kb":54973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"268'1055","reported_seq":2700,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:02.729393+0000","last_change":"2024-09-19T15:32:02.729121+0000","last_active":"2024-09-19T15:32:02.729393+0000","last_peered":"2024-09-19T15:32:02.729393+0000","last_clean":"2024-09-19T15:32:02.729393+0000","last_became_active":"2024-09-19T13:40:36.238907+0000","last_became_peered":"2024-09-19T13:40:36.238907+0000","last_unstale":"2024-09-19T15:32:02.729393+0000","last_undegraded":"2024-09-19T15:32:02.729393+0000","last_fullsized":"2024-09-19T15:32:02.729393+0000","mapping_epoch":27,"log_start":"268'1000","ondisk_log_start":"268'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1055","last_scrub_stamp":"2024-09-19T15:32:02.728906+0000","last_deep_scrub":"268'1055","last_deep_scrub_stamp":"2024-09-19T15:32:02.728906+0000","last_clean_scrub_stamp":"2024-09-19T15:32:02.728906+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1000,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:49:49.972281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5049,"num_read_kb":4427,"num_write":1568,"num_write_kb":756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"268'420","reported_seq":1106,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:48.888449+0000","last_change":"2024-09-19T15:31:48.888307+0000","last_active":"2024-09-19T15:31:48.888449+0000","last_peered":"2024-09-19T15:31:48.888449+0000","last_clean":"2024-09-19T15:31:48.888449+0000","last_became_active":"2024-09-19T13:40:34.272618+0000","last_became_peered":"2024-09-19T13:40:34.272618+0000","last_unstale":"2024-09-19T15:31:48.888449+0000","last_undegraded":"2024-09-19T15:31:48.888449+0000","last_fullsized":"2024-09-19T15:31:48.888449+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'420","last_scrub_stamp":"2024-09-19T15:31:48.888059+0000","last_deep_scrub":"268'420","last_deep_scrub_stamp":"2024-09-19T15:31:48.888059+0000","last_clean_scrub_stamp":"2024-09-19T15:31:48.888059+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T01:42:39.951922+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":788,"num_read_kb":25154,"num_write":1353,"num_write_kb":33238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"268'504","reported_seq":2202,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:59.714703+0000","last_change":"2024-09-19T15:31:59.714567+0000","last_active":"2024-09-19T15:31:59.714703+0000","last_peered":"2024-09-19T15:31:59.714703+0000","last_clean":"2024-09-19T15:31:59.714703+0000","last_became_active":"2024-09-19T13:40:36.226572+0000","last_became_peered":"2024-09-19T13:40:36.226572+0000","last_unstale":"2024-09-19T15:31:59.714703+0000","last_undegraded":"2024-09-19T15:31:59.714703+0000","last_fullsized":"2024-09-19T15:31:59.714703+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'504","last_scrub_stamp":"2024-09-19T15:31:59.714369+0000","last_deep_scrub":"268'504","last_deep_scrub_stamp":"2024-09-19T15:31:59.714369+0000","last_clean_scrub_stamp":"2024-09-19T15:31:59.714369+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:23:18.997611+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2633,"num_read_kb":2478,"num_write":570,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"268'448","reported_seq":1211,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.710466+0000","last_change":"2024-09-19T15:31:55.710466+0000","last_active":"2024-09-19T15:31:55.710466+0000","last_peered":"2024-09-19T15:31:55.710466+0000","last_clean":"2024-09-19T15:31:55.710466+0000","last_became_active":"2024-09-19T13:40:34.274523+0000","last_became_peered":"2024-09-19T13:40:34.274523+0000","last_unstale":"2024-09-19T15:31:55.710466+0000","last_undegraded":"2024-09-19T15:31:55.710466+0000","last_fullsized":"2024-09-19T15:31:55.710466+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'448","last_scrub_stamp":"2024-09-19T15:31:55.710272+0000","last_deep_scrub":"268'448","last_deep_scrub_stamp":"2024-09-19T15:31:55.710272+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.710272+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:32:09.787284+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":885,"num_read_kb":117461,"num_write":1361,"num_write_kb":54900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"268'910","reported_seq":2420,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.053812+0000","last_change":"2024-09-19T15:32:06.053655+0000","last_active":"2024-09-19T15:32:06.053812+0000","last_peered":"2024-09-19T15:32:06.053812+0000","last_clean":"2024-09-19T15:32:06.053812+0000","last_became_active":"2024-09-19T13:40:36.219017+0000","last_became_peered":"2024-09-19T13:40:36.219017+0000","last_unstale":"2024-09-19T15:32:06.053812+0000","last_undegraded":"2024-09-19T15:32:06.053812+0000","last_fullsized":"2024-09-19T15:32:06.053812+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'910","last_scrub_stamp":"2024-09-19T15:32:06.053447+0000","last_deep_scrub":"268'910","last_deep_scrub_stamp":"2024-09-19T15:32:06.053447+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.053447+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":800,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:14.042097+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5981,"num_read_kb":5463,"num_write":1432,"num_write_kb":593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"268'347","reported_seq":1033,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:53.834655+0000","last_change":"2024-09-19T15:31:53.834495+0000","last_active":"2024-09-19T15:31:53.834655+0000","last_peered":"2024-09-19T15:31:53.834655+0000","last_clean":"2024-09-19T15:31:53.834655+0000","last_became_active":"2024-09-19T13:40:34.258251+0000","last_became_peered":"2024-09-19T13:40:34.258251+0000","last_unstale":"2024-09-19T15:31:53.834655+0000","last_undegraded":"2024-09-19T15:31:53.834655+0000","last_fullsized":"2024-09-19T15:31:53.834655+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'347","last_scrub_stamp":"2024-09-19T15:31:53.834285+0000","last_deep_scrub":"268'347","last_deep_scrub_stamp":"2024-09-19T15:31:53.834285+0000","last_clean_scrub_stamp":"2024-09-19T15:31:53.834285+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:28:52.290958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":664,"num_read_kb":8565,"num_write":1177,"num_write_kb":30274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"268'822","reported_seq":2525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.703943+0000","last_change":"2024-09-19T15:32:01.703943+0000","last_active":"2024-09-19T15:32:01.703943+0000","last_peered":"2024-09-19T15:32:01.703943+0000","last_clean":"2024-09-19T15:32:01.703943+0000","last_became_active":"2024-09-19T13:40:36.234463+0000","last_became_peered":"2024-09-19T13:40:36.234463+0000","last_unstale":"2024-09-19T15:32:01.703943+0000","last_undegraded":"2024-09-19T15:32:01.703943+0000","last_fullsized":"2024-09-19T15:32:01.703943+0000","mapping_epoch":27,"log_start":"268'800","ondisk_log_start":"268'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'822","last_scrub_stamp":"2024-09-19T15:32:01.703761+0000","last_deep_scrub":"268'822","last_deep_scrub_stamp":"2024-09-19T15:32:01.703761+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.703761+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:30:12.604793+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4113,"num_read_kb":3717,"num_write":1084,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2509,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"268'332","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:57.789546+0000","last_change":"2024-09-19T15:31:57.789415+0000","last_active":"2024-09-19T15:31:57.789546+0000","last_peered":"2024-09-19T15:31:57.789546+0000","last_clean":"2024-09-19T15:31:57.789546+0000","last_became_active":"2024-09-19T13:40:34.257895+0000","last_became_peered":"2024-09-19T13:40:34.257895+0000","last_unstale":"2024-09-19T15:31:57.789546+0000","last_undegraded":"2024-09-19T15:31:57.789546+0000","last_fullsized":"2024-09-19T15:31:57.789546+0000","mapping_epoch":25,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'332","last_scrub_stamp":"2024-09-19T15:31:57.789227+0000","last_deep_scrub":"268'332","last_deep_scrub_stamp":"2024-09-19T15:31:57.789227+0000","last_clean_scrub_stamp":"2024-09-19T15:31:57.789227+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-21T02:08:45.295282+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":616,"num_read_kb":2702,"num_write":1090,"num_write_kb":37833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4],"acting":[5,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"268'365","reported_seq":1066,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:58.835286+0000","last_change":"2024-09-19T15:31:58.835074+0000","last_active":"2024-09-19T15:31:58.835286+0000","last_peered":"2024-09-19T15:31:58.835286+0000","last_clean":"2024-09-19T15:31:58.835286+0000","last_became_active":"2024-09-19T13:41:05.313139+0000","last_became_peered":"2024-09-19T13:41:05.313139+0000","last_unstale":"2024-09-19T15:31:58.835286+0000","last_undegraded":"2024-09-19T15:31:58.835286+0000","last_fullsized":"2024-09-19T15:31:58.835286+0000","mapping_epoch":38,"log_start":"268'300","ondisk_log_start":"268'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'365","last_scrub_stamp":"2024-09-19T15:31:58.834854+0000","last_deep_scrub":"268'365","last_deep_scrub_stamp":"2024-09-19T15:31:58.834854+0000","last_clean_scrub_stamp":"2024-09-19T15:31:58.834854+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:08.987958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":636,"num_read_kb":5598,"num_write":1148,"num_write_kb":52319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"268'585","reported_seq":2295,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:01.715259+0000","last_change":"2024-09-19T15:32:01.715002+0000","last_active":"2024-09-19T15:32:01.715259+0000","last_peered":"2024-09-19T15:32:01.715259+0000","last_clean":"2024-09-19T15:32:01.715259+0000","last_became_active":"2024-09-19T13:40:36.225131+0000","last_became_peered":"2024-09-19T13:40:36.225131+0000","last_unstale":"2024-09-19T15:32:01.715259+0000","last_undegraded":"2024-09-19T15:32:01.715259+0000","last_fullsized":"2024-09-19T15:32:01.715259+0000","mapping_epoch":27,"log_start":"268'500","ondisk_log_start":"268'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'585","last_scrub_stamp":"2024-09-19T15:32:01.714790+0000","last_deep_scrub":"268'585","last_deep_scrub_stamp":"2024-09-19T15:32:01.714790+0000","last_clean_scrub_stamp":"2024-09-19T15:32:01.714790+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":500,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:56.655110+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3409,"num_read_kb":3161,"num_write":806,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"268'423","reported_seq":1194,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:31:55.619222+0000","last_change":"2024-09-19T15:31:55.619026+0000","last_active":"2024-09-19T15:31:55.619222+0000","last_peered":"2024-09-19T15:31:55.619222+0000","last_clean":"2024-09-19T15:31:55.619222+0000","last_became_active":"2024-09-19T13:40:34.252585+0000","last_became_peered":"2024-09-19T13:40:34.252585+0000","last_unstale":"2024-09-19T15:31:55.619222+0000","last_undegraded":"2024-09-19T15:31:55.619222+0000","last_fullsized":"2024-09-19T15:31:55.619222+0000","mapping_epoch":25,"log_start":"268'400","ondisk_log_start":"268'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'423","last_scrub_stamp":"2024-09-19T15:31:55.618823+0000","last_deep_scrub":"268'423","last_deep_scrub_stamp":"2024-09-19T15:31:55.618823+0000","last_clean_scrub_stamp":"2024-09-19T15:31:55.618823+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:57.280079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1089,"num_read_kb":22295,"num_write":1244,"num_write_kb":33627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"268'496","reported_seq":2111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-19T15:32:06.795339+0000","last_change":"2024-09-19T15:32:06.795339+0000","last_active":"2024-09-19T15:32:06.795339+0000","last_peered":"2024-09-19T15:32:06.795339+0000","last_clean":"2024-09-19T15:32:06.795339+0000","last_became_active":"2024-09-19T13:40:36.232695+0000","last_became_peered":"2024-09-19T13:40:36.232695+0000","last_unstale":"2024-09-19T15:32:06.795339+0000","last_undegraded":"2024-09-19T15:32:06.795339+0000","last_fullsized":"2024-09-19T15:32:06.795339+0000","mapping_epoch":27,"log_start":"268'400","ondisk_log_start":"268'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'496","last_scrub_stamp":"2024-09-19T15:32:06.795165+0000","last_deep_scrub":"268'496","last_deep_scrub_stamp":"2024-09-19T15:32:06.795165+0000","last_clean_scrub_stamp":"2024-09-19T15:32:06.795165+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:10:31.458475+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2752,"num_read_kb":2570,"num_write":600,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":963,"num_omap_keys":4,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10865,"num_read_kb":9021,"num_write":3118,"num_write_kb":1011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1008,"ondisk_log_size":1008,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14601,"num_objects":82,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":16485,"num_read_kb":16147,"num_write":17047,"num_write_kb":4982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2448,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":29202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1876,"ondisk_log_size":1876,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":601,"ondisk_log_size":601,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1631422,"num_objects":200,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":0,"num_read":21072,"num_read_kb":40733,"num_write":17629,"num_write_kb":12600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":704656,"num_omap_keys":1634,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1956,"ondisk_log_size":1956,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2392,"num_read_kb":2851,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":220859,"num_read_kb":201873,"num_write":56069,"num_write_kb":19197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35455,"num_omap_keys":143,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4151,"ondisk_log_size":4151,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":23942209,"num_objects":277,"num_object_clones":0,"num_object_copies":831,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":0,"num_read":44439,"num_read_kb":2347980,"num_write":73000,"num_write_kb":2178675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37318656,"data_stored":37318656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3768,"ondisk_log_size":3768,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":215739,"num_write":161,"num_write_kb":136883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":195259,"num_write":161,"num_write_kb":136883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129543508,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296384,"kb_used_data":8368,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94075456,"statfs":{"total":96636764160,"available":96333266944,"internally_reserved":0,"allocated":8568832,"data_stored":6565575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":294910410},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129543503,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":250764,"kb_used_data":7164,"kb_used_omap":1,"kb_used_meta":243582,"kb_avail":94121076,"statfs":{"total":96636764160,"available":96379981824,"internally_reserved":0,"allocated":7335936,"data_stored":5380296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":249428422},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129543506,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149372,"kb_used_data":9964,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94222468,"statfs":{"total":96636764160,"available":96483807232,"internally_reserved":0,"allocated":10203136,"data_stored":8155658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129543503,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":115784,"kb_used_data":8248,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94256056,"statfs":{"total":96636764160,"available":96518201344,"internally_reserved":0,"allocated":8445952,"data_stored":6509947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129543508,"num_pgs":125,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296544,"kb_used_data":12688,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94075296,"statfs":{"total":96636764160,"available":96333103104,"internally_reserved":0,"allocated":12992512,"data_stored":10993023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":290650567},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129543506,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92420,"kb_used_data":7092,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94279420,"statfs":{"total":96636764160,"available":96542126080,"internally_reserved":0,"allocated":7262208,"data_stored":5318104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87357893},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543504,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":192588,"kb_used_data":8764,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94179252,"statfs":{"total":96636764160,"available":96439554048,"internally_reserved":0,"allocated":8974336,"data_stored":6990912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129543504,"num_pgs":110,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":282964,"kb_used_data":8836,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94088876,"statfs":{"total":96636764160,"available":96347009024,"internally_reserved":0,"allocated":9048064,"data_stored":7057331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":280689095},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4157440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4681728,"data_stored":4681728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3010560,"data_stored":3010560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8683520,"data_stored":8683520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4202496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5844992,"data_stored":5844992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3072000,"data_stored":3072000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3665920,"data_stored":3665920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":3963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T15:33:10.082 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-19T15:33:10.437 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-19T15:33:10.437 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-19T15:33:10.438 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-19T15:33:10.438 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T15:33:10.519 INFO:tasks.ceph.osd.0:Stopped 2024-09-19T15:33:10.519 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-19T15:33:10.520 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T15:33:10.619 INFO:tasks.ceph.osd.1:Stopped 2024-09-19T15:33:10.619 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-19T15:33:10.619 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T15:33:10.718 INFO:tasks.ceph.osd.2:Stopped 2024-09-19T15:33:10.718 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-19T15:33:10.719 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T15:33:16.820 INFO:tasks.ceph.osd.3:Stopped 2024-09-19T15:33:16.820 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-19T15:33:16.821 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T15:33:16.903 INFO:tasks.ceph.osd.4:Stopped 2024-09-19T15:33:16.903 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-19T15:33:16.903 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T15:33:17.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-19T15:33:23.004 INFO:tasks.ceph.osd.5:Stopped 2024-09-19T15:33:23.005 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-19T15:33:23.005 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T15:33:23.259 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-19T15:33:23.260 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-19T15:33:28.865 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-19T15:33:28.865 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-19T15:33:29.107 INFO:tasks.ceph.osd.6:Stopped 2024-09-19T15:33:29.107 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-19T15:33:29.107 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T15:33:29.180 INFO:tasks.ceph.osd.7:Stopped 2024-09-19T15:33:29.180 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-19T15:33:29.181 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-19T15:33:29.181 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T15:33:29.209 INFO:tasks.ceph.mgr.y:Stopped 2024-09-19T15:33:29.209 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-19T15:33:29.209 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T15:33:29.242 INFO:tasks.ceph.mgr.x:Stopped 2024-09-19T15:33:29.242 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-19T15:33:29.242 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-19T15:33:29.242 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T15:33:29.280 INFO:tasks.ceph.mon.a:Stopped 2024-09-19T15:33:29.280 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-19T15:33:29.280 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T15:33:29.343 INFO:tasks.ceph.mon.c:Stopped 2024-09-19T15:33:29.343 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-19T15:33:29.344 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T15:33:29.374 INFO:tasks.ceph.mon.b:Stopped 2024-09-19T15:33:29.374 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-19T15:33:29.374 DEBUG:teuthology.orchestra.run.smithi153:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-19T15:33:29.404 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-19T15:33:29.404 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-19T15:33:29.766 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-19T15:33:29.766 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-19T15:33:30.027 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-19T15:33:30.027 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-19T15:33:30.210 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi153.front.sepia.ceph.com 2024-09-19T15:33:30.210 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-19T15:33:30.404 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi196.front.sepia.ceph.com 2024-09-19T15:33:30.404 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-19T15:33:30.832 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi196.front.sepia.ceph.com 2024-09-19T15:33:30.832 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-19T15:33:31.040 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi196.front.sepia.ceph.com 2024-09-19T15:33:31.040 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-19T15:33:31.248 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi196.front.sepia.ceph.com 2024-09-19T15:33:31.248 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-19T15:33:31.441 INFO:tasks.ceph:Archiving mon data... 2024-09-19T15:33:31.442 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912477/data/mon.a.tgz 2024-09-19T15:33:31.442 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-09-19T15:33:31.448 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.hsYXp7SmWf 2024-09-19T15:33:31.449 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.hsYXp7SmWf 2024-09-19T15:33:31.622 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.hsYXp7SmWf 2024-09-19T15:33:31.683 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.hsYXp7SmWf is 534KB 2024-09-19T15:33:31.746 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.hsYXp7SmWf 2024-09-19T15:33:31.750 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912477/data/mon.c.tgz 2024-09-19T15:33:31.751 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2024-09-19T15:33:31.795 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.4eE5o5R5FG 2024-09-19T15:33:31.796 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.4eE5o5R5FG 2024-09-19T15:33:31.969 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.4eE5o5R5FG 2024-09-19T15:33:32.031 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.4eE5o5R5FG is 539KB 2024-09-19T15:33:32.090 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.4eE5o5R5FG 2024-09-19T15:33:32.097 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912477/data/mon.b.tgz 2024-09-19T15:33:32.097 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2024-09-19T15:33:32.104 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.7awBv5pMxE 2024-09-19T15:33:32.104 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.7awBv5pMxE 2024-09-19T15:33:32.282 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.7awBv5pMxE 2024-09-19T15:33:32.347 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.7awBv5pMxE is 539KB 2024-09-19T15:33:32.409 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.7awBv5pMxE 2024-09-19T15:33:32.414 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-19T15:33:32.414 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-19T15:33:32.416 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-19T15:33:32.531 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-19T15:33:32.537 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-19T15:33:32.537 INFO:tasks.ceph:Archiving crash dumps... 2024-09-19T15:33:32.539 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/crash to /home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912477/remote/smithi153/crash 2024-09-19T15:33:32.540 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-19T15:33:32.553 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/crash to /home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912477/remote/smithi196/crash 2024-09-19T15:33:32.554 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-19T15:33:32.591 INFO:tasks.ceph:Compressing logs... 2024-09-19T15:33:32.591 DEBUG:teuthology.orchestra.run.smithi153:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T15:33:32.601 DEBUG:teuthology.orchestra.run.smithi196:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T15:33:32.626 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-19T15:33:32.627 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32204.log 2024-09-19T15:33:32.627 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56155.log 2024-09-19T15:33:32.628 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73892.log 2024-09-19T15:33:32.628 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32204.log.gz 2024-09-19T15:33:32.628 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.56155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142926.log 2024-09-19T15:33:32.628 INFO:teuthology.orchestra.run.smithi153.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.56155.log.gz 2024-09-19T15:33:32.630 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.73892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68388.log 2024-09-19T15:33:32.630 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.142926.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.73892.log.gz 2024-09-19T15:33:32.630 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55035.log 2024-09-19T15:33:32.630 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.68388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59971.log 2024-09-19T15:33:32.630 INFO:teuthology.orchestra.run.smithi153.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.0.68388.log.gz 2024-09-19T15:33:32.631 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.55035.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-19T15:33:32.631 INFO:teuthology.orchestra.run.smithi153.stderr: 62.5% -- replaced with /var/log/ceph/ceph-client.admin.55035.log.gz 2024-09-19T15:33:32.631 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.59971.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.142926.log.gz 2024-09-19T15:33:32.631 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79202.log 2024-09-19T15:33:32.631 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154748.log 2024-09-19T15:33:32.633 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.79202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164825.log 2024-09-19T15:33:32.633 INFO:teuthology.orchestra.run.smithi153.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.79202.log.gz 2024-09-19T15:33:32.633 INFO:teuthology.orchestra.run.smithi153.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.59971.log.gz 2024-09-19T15:33:32.633 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32356.log 2024-09-19T15:33:32.633 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.154748.log: /var/log/ceph/ceph-client.admin.164825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37442.log 2024-09-19T15:33:32.633 INFO:teuthology.orchestra.run.smithi153.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.154748.log.gz 2024-09-19T15:33:32.633 INFO:teuthology.orchestra.run.smithi153.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.164825.log.gz 2024-09-19T15:33:32.633 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76842.log 2024-09-19T15:33:32.633 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32356.log.gz 2024-09-19T15:33:32.635 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.37442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124045.log 2024-09-19T15:33:32.635 INFO:teuthology.orchestra.run.smithi153.stderr: 43.2% -- replaced with /var/log/ceph/ceph-client.0.37442.log.gz 2024-09-19T15:33:32.636 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.76842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38610.log 2024-09-19T15:33:32.636 INFO:teuthology.orchestra.run.smithi153.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.76842.log.gz 2024-09-19T15:33:32.636 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.124045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182683.log 2024-09-19T15:33:32.636 INFO:teuthology.orchestra.run.smithi153.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.124045.log.gz 2024-09-19T15:33:32.636 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.38610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120504.log 2024-09-19T15:33:32.636 INFO:teuthology.orchestra.run.smithi153.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.38610.log.gz 2024-09-19T15:33:32.636 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.182683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182683.log.gz 2024-09-19T15:33:32.636 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33801.log 2024-09-19T15:33:32.636 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147056.log 2024-09-19T15:33:32.638 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.120504.log: /var/log/ceph/ceph-client.admin.33801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33801.log.gz 2024-09-19T15:33:32.638 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182162.log 2024-09-19T15:33:32.638 INFO:teuthology.orchestra.run.smithi153.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.120504.log.gz 2024-09-19T15:33:32.638 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.147056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.159286.log 2024-09-19T15:33:32.639 INFO:teuthology.orchestra.run.smithi153.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.147056.log.gz 2024-09-19T15:33:32.639 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.182162.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.182162.log.gz /var/log/ceph/ceph-client.admin.99263.log 2024-09-19T15:33:32.639 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-19T15:33:32.639 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.159286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112244.log 2024-09-19T15:33:32.639 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.99263.log: 84.7% -- replaced with /var/log/ceph/ceph-client.0.159286.log.gz 2024-09-19T15:33:32.639 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55601.log 2024-09-19T15:33:32.639 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.112244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32551.log 2024-09-19T15:33:32.639 INFO:teuthology.orchestra.run.smithi153.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.112244.log.gz 2024-09-19T15:33:32.639 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.55601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179631.log 2024-09-19T15:33:32.644 INFO:teuthology.orchestra.run.smithi153.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.55601.log.gz 2024-09-19T15:33:32.644 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32551.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32551.log.gz 2024-09-19T15:33:32.645 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54350.log 2024-09-19T15:33:32.645 INFO:teuthology.orchestra.run.smithi153.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.99263.log.gz 2024-09-19T15:33:32.645 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-19T15:33:32.645 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.179631.log: /var/log/ceph/ceph-client.admin.54350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178867.log 2024-09-19T15:33:32.645 INFO:teuthology.orchestra.run.smithi153.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.54350.log.gz 2024-09-19T15:33:32.645 INFO:teuthology.orchestra.run.smithi153.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.179631.log.gz 2024-09-19T15:33:32.645 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182500.log 2024-09-19T15:33:32.645 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96903.log 2024-09-19T15:33:32.645 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.178867.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178867.log.gz 2024-09-19T15:33:32.645 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.182500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182500.log.gz 2024-09-19T15:33:32.645 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179555.log 2024-09-19T15:33:32.645 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76252.log 2024-09-19T15:33:32.645 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.96903.log: /var/log/ceph/ceph-client.admin.179555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179555.log.gz 2024-09-19T15:33:32.646 INFO:teuthology.orchestra.run.smithi153.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.96903.log.gz 2024-09-19T15:33:32.646 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146466.log 2024-09-19T15:33:32.646 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152388.log 2024-09-19T15:33:32.646 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.76252.log: /var/log/ceph/ceph-client.admin.146466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61913.log 2024-09-19T15:33:32.646 INFO:teuthology.orchestra.run.smithi153.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.76252.log.gz 2024-09-19T15:33:32.646 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.152388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55578.log 2024-09-19T15:33:32.646 INFO:teuthology.orchestra.run.smithi153.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.152388.log.gz 2024-09-19T15:33:32.646 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.61913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182292.log 2024-09-19T15:33:32.646 INFO:teuthology.orchestra.run.smithi153.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.146466.log.gz 2024-09-19T15:33:32.646 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.55578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157798.log 2024-09-19T15:33:32.646 INFO:teuthology.orchestra.run.smithi153.stderr: 56.0% -- replaced with /var/log/ceph/ceph-client.admin.55578.log.gz 2024-09-19T15:33:32.646 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170825.log 2024-09-19T15:33:32.646 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.182292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182292.log.gz 2024-09-19T15:33:32.649 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.157798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89233.log 2024-09-19T15:33:32.649 INFO:teuthology.orchestra.run.smithi153.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.157798.log.gz 2024-09-19T15:33:32.649 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.170825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134076.log 2024-09-19T15:33:32.649 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182136.log 2024-09-19T15:33:32.649 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.89233.log: 84.6% -- replaced with /var/log/ceph/ceph-client.0.170825.log.gz 2024-09-19T15:33:32.649 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.134076.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.61913.log.gz 2024-09-19T15:33:32.649 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44784.log 2024-09-19T15:33:32.649 INFO:teuthology.orchestra.run.smithi153.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.89233.log.gz 2024-09-19T15:33:32.649 INFO:teuthology.orchestra.run.smithi153.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.134076.log.gz 2024-09-19T15:33:32.649 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.182136.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182136.log.gz 2024-09-19T15:33:32.650 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58036.log 2024-09-19T15:33:32.650 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58681.log 2024-09-19T15:33:32.650 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.44784.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44784.log.gz 2024-09-19T15:33:32.650 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.58036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72122.log 2024-09-19T15:33:32.650 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.58681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182735.log 2024-09-19T15:33:32.650 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.72122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180825.log 2024-09-19T15:33:32.650 INFO:teuthology.orchestra.run.smithi153.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.72122.log.gz 2024-09-19T15:33:32.650 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.182735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32224.log 2024-09-19T15:33:32.650 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182735.log.gz 2024-09-19T15:33:32.652 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.180825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171415.log 2024-09-19T15:33:32.653 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133486.log 2024-09-19T15:33:32.653 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32224.log.gz 93.1% 2024-09-19T15:33:32.653 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.171415.log: -- replaced with /var/log/ceph/ceph-client.admin.58681.log.gz 2024-09-19T15:33:32.653 INFO:teuthology.orchestra.run.smithi153.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.0.171415.log.gz 2024-09-19T15:33:32.654 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155363.log 2024-09-19T15:33:32.656 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.133486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157158.log 2024-09-19T15:33:32.656 INFO:teuthology.orchestra.run.smithi153.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.133486.log.gz 2024-09-19T15:33:32.656 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.155363.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-19T15:33:32.656 INFO:teuthology.orchestra.run.smithi153.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.58036.log.gz 2024-09-19T15:33:32.656 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155363.log.gz 2024-09-19T15:33:32.656 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104573.log 2024-09-19T15:33:32.656 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.157158.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157158.log.gz 2024-09-19T15:33:32.656 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135256.log 2024-09-19T15:33:32.656 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.104573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156568.log 2024-09-19T15:33:32.656 INFO:teuthology.orchestra.run.smithi153.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.104573.log.gz 2024-09-19T15:33:32.656 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.135256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155338.log 2024-09-19T15:33:32.663 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26875.log 2024-09-19T15:33:32.664 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26803.log 2024-09-19T15:33:32.664 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.26875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26875.log.gz 2024-09-19T15:33:32.664 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26930.log 2024-09-19T15:33:32.664 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.26803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26803.log.gz 2024-09-19T15:33:32.664 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-19T15:33:32.664 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.26930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26827.log 2024-09-19T15:33:32.664 INFO:teuthology.orchestra.run.smithi196.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26930.log.gz 2024-09-19T15:33:32.664 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-19T15:33:32.664 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-client.admin.26827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26827.log.gz 2024-09-19T15:33:32.664 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26906.log 2024-09-19T15:33:32.664 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26755.log 2024-09-19T15:33:32.665 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.26906.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26906.log.gz 2024-09-19T15:33:32.665 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-19T15:33:32.665 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26851.log 2024-09-19T15:33:32.665 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.26755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26755.log.gz 2024-09-19T15:33:32.665 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26779.log 2024-09-19T15:33:32.665 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.26851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26851.log.gz 2024-09-19T15:33:32.665 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-19T15:33:32.665 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-19T15:33:32.665 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.26779.log: /var/log/ceph/ceph-mgr.x.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26779.log.gzgzip 2024-09-19T15:33:32.665 INFO:teuthology.orchestra.run.smithi196.stderr: -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-19T15:33:32.665 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-19T15:33:32.665 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-19T15:33:32.669 INFO:teuthology.orchestra.run.smithi153.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.135256.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78022.log 2024-09-19T15:33:32.669 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-19T15:33:32.669 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.156568.log: /var/log/ceph/ceph-client.admin.155338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155338.log.gz 2024-09-19T15:33:32.669 INFO:teuthology.orchestra.run.smithi153.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.156568.log.gz 2024-09-19T15:33:32.670 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173185.log 2024-09-19T15:33:32.670 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.78022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108704.log 2024-09-19T15:33:32.670 INFO:teuthology.orchestra.run.smithi153.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.78022.log.gz 2024-09-19T15:33:32.670 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.173185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182709.log 2024-09-19T15:33:32.670 INFO:teuthology.orchestra.run.smithi153.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.0.173185.log.gz 2024-09-19T15:33:32.670 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.108704.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.108704.log.gz 2024-09-19T15:33:32.670 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137026.log 2024-09-19T15:33:32.670 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.182709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144106.log 2024-09-19T15:33:32.670 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182709.log.gz 2024-09-19T15:33:32.670 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.137026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55324.log 2024-09-19T15:33:32.670 INFO:teuthology.orchestra.run.smithi153.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.137026.log.gz 2024-09-19T15:33:32.670 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132896.log 2024-09-19T15:33:32.670 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.144106.log: /var/log/ceph/ceph-client.admin.55324.log: 60.1% -- replaced with /var/log/ceph/ceph-client.admin.55324.log.gz 2024-09-19T15:33:32.671 INFO:teuthology.orchestra.run.smithi153.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.144106.log.gz 2024-09-19T15:33:32.671 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-19T15:33:32.671 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.132896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167864.log 2024-09-19T15:33:32.671 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mon.a.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.132896.log.gz 2024-09-19T15:33:32.671 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164236.log 2024-09-19T15:33:32.671 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105753.log 2024-09-19T15:33:32.672 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.167864.log: /var/log/ceph/ceph-client.admin.164236.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.167864.log.gz 2024-09-19T15:33:32.672 INFO:teuthology.orchestra.run.smithi153.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.164236.log.gz 2024-09-19T15:33:32.672 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176725.log 2024-09-19T15:33:32.672 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.105753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122865.log 2024-09-19T15:33:32.673 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.176725.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.176725.log.gz 2024-09-19T15:33:32.673 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26894.log 2024-09-19T15:33:32.673 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.122865.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.105753.log.gz 82.2% -- replaced with /var/log/ceph/ceph-client.admin.122865.log.gz 2024-09-19T15:33:32.673 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-19T15:33:32.673 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101033.log 2024-09-19T15:33:32.673 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182318.log 2024-09-19T15:33:32.673 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.26894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26894.log.gz 2024-09-19T15:33:32.673 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.101033.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.101033.log.gz 2024-09-19T15:33:32.674 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157208.log 2024-09-19T15:33:32.674 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.182318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83332.log 2024-09-19T15:33:32.674 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182318.log.gz 2024-09-19T15:33:32.675 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 90.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-19T15:33:32.680 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.157208.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.157208.log.gz 2024-09-19T15:33:32.680 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31872.log 2024-09-19T15:33:32.680 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145876.log 2024-09-19T15:33:32.680 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.83332.log: /var/log/ceph/ceph-client.admin.31872.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.83332.log.gz 2024-09-19T15:33:32.680 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31872.log.gz 2024-09-19T15:33:32.680 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70240.log 2024-09-19T15:33:32.680 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103983.log 2024-09-19T15:33:32.680 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.145876.log: /var/log/ceph/ceph-client.0.70240.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.145876.log.gz 2024-09-19T15:33:32.680 INFO:teuthology.orchestra.run.smithi153.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.70240.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32563.log 2024-09-19T15:33:32.680 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-19T15:33:32.680 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.103983.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.103983.log.gz 2024-09-19T15:33:32.680 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90413.log 2024-09-19T15:33:32.680 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43579.log 2024-09-19T15:33:32.681 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32563.log.gz 2024-09-19T15:33:32.681 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.90413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32338.log 2024-09-19T15:33:32.681 INFO:teuthology.orchestra.run.smithi153.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.90413.log.gz 2024-09-19T15:33:32.681 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.43579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132306.log 2024-09-19T15:33:32.681 INFO:teuthology.orchestra.run.smithi153.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.43579.log.gz 2024-09-19T15:33:32.681 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32338.log.gz 2024-09-19T15:33:32.681 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32351.log 2024-09-19T15:33:32.681 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.132306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47759.log 2024-09-19T15:33:32.681 INFO:teuthology.orchestra.run.smithi153.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.132306.log.gz 2024-09-19T15:33:32.681 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32351.log.gz 2024-09-19T15:33:32.681 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142336.log 2024-09-19T15:33:32.681 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182188.log 2024-09-19T15:33:32.681 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.47759.log: /var/log/ceph/ceph-client.admin.142336.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.47759.log.gz 2024-09-19T15:33:32.681 INFO:teuthology.orchestra.run.smithi153.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.142336.log.gz 2024-09-19T15:33:32.681 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71532.log 2024-09-19T15:33:32.682 INFO:teuthology.orchestra.run.smithi196.stderr: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-19T15:33:32.687 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.182188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182188.log.gz 2024-09-19T15:33:32.687 INFO:teuthology.orchestra.run.smithi153.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.0.180825.log.gz 2024-09-19T15:33:32.687 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161742.log 2024-09-19T15:33:32.687 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.71532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99853.log 2024-09-19T15:33:32.687 INFO:teuthology.orchestra.run.smithi153.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.71532.log.gz 2024-09-19T15:33:32.687 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.161742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109294.log 2024-09-19T15:33:32.687 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176135.log 2024-09-19T15:33:32.687 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.99853.log: /var/log/ceph/ceph-client.admin.109294.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.99853.log.gz 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109294.log.gz 2024-09-19T15:33:32.687 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-19T15:33:32.688 INFO:teuthology.orchestra.run.smithi153.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.161742.log.gz 2024-09-19T15:33:32.688 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131125.log 2024-09-19T15:33:32.688 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98673.log 2024-09-19T15:33:32.688 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.176135.log: /var/log/ceph/ceph-client.admin.131125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32552.log 2024-09-19T15:33:32.688 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.98673.log: 84.7% -- replaced with /var/log/ceph/ceph-client.0.176135.log.gz 2024-09-19T15:33:32.688 INFO:teuthology.orchestra.run.smithi153.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.131125.log.gz 2024-09-19T15:33:32.688 INFO:teuthology.orchestra.run.smithi153.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.98673.log.gz 2024-09-19T15:33:32.688 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75072.log 2024-09-19T15:33:32.688 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86282.log 2024-09-19T15:33:32.688 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32552.log: /var/log/ceph/ceph-client.admin.75072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158388.log 2024-09-19T15:33:32.688 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32552.log.gz 2024-09-19T15:33:32.688 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.86282.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.75072.log.gz 2024-09-19T15:33:32.688 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182266.log 2024-09-19T15:33:32.689 INFO:teuthology.orchestra.run.smithi153.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.86282.log.gz 2024-09-19T15:33:32.689 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32542.log 2024-09-19T15:33:32.689 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.158388.log: /var/log/ceph/ceph-client.admin.182266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48349.log 2024-09-19T15:33:32.689 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% 82.3% -- replaced with /var/log/ceph/ceph-client.admin.182266.log.gz -- replaced with /var/log/ceph/ceph-client.admin.158388.log.gz 2024-09-19T15:33:32.689 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32542.log: 2024-09-19T15:33:32.689 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32542.log.gz 2024-09-19T15:33:32.689 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66564.log 2024-09-19T15:33:32.693 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36268.log 2024-09-19T15:33:32.693 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.48349.log: /var/log/ceph/ceph-client.admin.66564.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.48349.log.gz 2024-09-19T15:33:32.693 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93363.log 2024-09-19T15:33:32.693 INFO:teuthology.orchestra.run.smithi153.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66564.log.gz 2024-09-19T15:33:32.693 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55529.log 2024-09-19T15:33:32.693 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.36268.log: /var/log/ceph/ceph-client.admin.93363.log: 81.2% -- replaced with /var/log/ceph/ceph-client.0.36268.log.gz 2024-09-19T15:33:32.693 INFO:teuthology.orchestra.run.smithi153.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.93363.log.gz 2024-09-19T15:33:32.693 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21948.log 2024-09-19T15:33:32.693 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85102.log 2024-09-19T15:33:32.693 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.55529.log: /var/log/ceph/ceph.tmp-client.admin.21948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140566.log 2024-09-19T15:33:32.693 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21948.log.gz 2024-09-19T15:33:32.693 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55529.log.gz 2024-09-19T15:33:32.694 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.85102.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.85102.log.gz 2024-09-19T15:33:32.694 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92773.log 2024-09-19T15:33:32.694 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108114.log 2024-09-19T15:33:32.694 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.140566.log: /var/log/ceph/ceph-client.admin.92773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182578.log 2024-09-19T15:33:32.694 INFO:teuthology.orchestra.run.smithi153.stderr: 82.6%/var/log/ceph/ceph-client.admin.108114.log: -- replaced with /var/log/ceph/ceph-client.admin.140566.log.gz 2024-09-19T15:33:32.694 INFO:teuthology.orchestra.run.smithi153.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.92773.log.gz 2024-09-19T15:33:32.694 INFO:teuthology.orchestra.run.smithi153.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.108114.log.gz 2024-09-19T15:33:32.694 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32770.log 2024-09-19T15:33:32.697 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141746.log 2024-09-19T15:33:32.697 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.182578.log: /var/log/ceph/ceph-client.admin.32770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59326.log 2024-09-19T15:33:32.697 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182578.log.gz 2024-09-19T15:33:32.697 INFO:teuthology.orchestra.run.smithi153.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32770.log.gz 2024-09-19T15:33:32.697 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.141746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125225.log 2024-09-19T15:33:32.697 INFO:teuthology.orchestra.run.smithi153.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.141746.log.gz 2024-09-19T15:33:32.697 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80972.log 2024-09-19T15:33:32.698 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.59326.log: /var/log/ceph/ceph-client.admin.125225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67154.log 2024-09-19T15:33:32.698 INFO:teuthology.orchestra.run.smithi153.stderr: 82.2%/var/log/ceph/ceph-client.admin.80972.log: -- replaced with /var/log/ceph/ceph-client.admin.125225.log.gz 2024-09-19T15:33:32.698 INFO:teuthology.orchestra.run.smithi153.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.80972.log.gz 2024-09-19T15:33:32.698 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91003.log 2024-09-19T15:33:32.698 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.67154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84512.log 2024-09-19T15:33:32.698 INFO:teuthology.orchestra.run.smithi153.stderr: 81.5%/var/log/ceph/ceph-client.admin.91003.log: -- replaced with /var/log/ceph/ceph-client.admin.67154.log.gz 2024-09-19T15:33:32.698 INFO:teuthology.orchestra.run.smithi153.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.91003.log.gz 2024-09-19T15:33:32.700 INFO:teuthology.orchestra.run.smithi153.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.59326.log.gz 2024-09-19T15:33:32.701 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174365.log 2024-09-19T15:33:32.701 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.84512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182344.log 2024-09-19T15:33:32.704 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.174365.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.84512.log.gz 2024-09-19T15:33:32.705 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38026.log 2024-09-19T15:33:32.705 INFO:teuthology.orchestra.run.smithi153.stderr: 84.8%gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-19T15:33:32.705 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.182344.log: -- replaced with /var/log/ceph/ceph-client.0.174365.log.gz 2024-09-19T15:33:32.705 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182344.log.gz 2024-09-19T15:33:32.705 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.38026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100443.log 2024-09-19T15:33:32.705 INFO:teuthology.orchestra.run.smithi153.stderr: 95.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 43.9% -- replaced with /var/log/ceph/ceph-client.0.38026.log.gz 2024-09-19T15:33:32.705 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-19T15:33:32.705 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65383.log 2024-09-19T15:33:32.705 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.100443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130535.log 2024-09-19T15:33:32.705 INFO:teuthology.orchestra.run.smithi153.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.100443.log.gz/var/log/ceph/ceph-client.admin.65383.log: 2024-09-19T15:33:32.706 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92183.log 2024-09-19T15:33:32.706 INFO:teuthology.orchestra.run.smithi153.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.65383.log.gz 2024-09-19T15:33:32.706 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119914.log 2024-09-19T15:33:32.706 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.92183.log: /var/log/ceph/ceph-client.admin.130535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46579.log 2024-09-19T15:33:32.706 INFO:teuthology.orchestra.run.smithi153.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.92183.log.gz 2024-09-19T15:33:32.706 INFO:teuthology.orchestra.run.smithi153.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.130535.log.gz 2024-09-19T15:33:32.709 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.119914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106343.log 2024-09-19T15:33:32.710 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.46579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96313.log 2024-09-19T15:33:32.710 INFO:teuthology.orchestra.run.smithi153.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.46579.log.gz 2024-09-19T15:33:32.710 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.106343.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.106343.log.gz 2024-09-19T15:33:32.710 INFO:teuthology.orchestra.run.smithi153.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.119914.log.gz 2024-09-19T15:33:32.710 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177664.log 2024-09-19T15:33:32.710 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118734.log 2024-09-19T15:33:32.710 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.96313.log: /var/log/ceph/ceph-client.admin.177664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175545.log 2024-09-19T15:33:32.710 INFO:teuthology.orchestra.run.smithi153.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.96313.log.gz 2024-09-19T15:33:32.710 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.118734.log: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.177664.log.gz 2024-09-19T15:33:32.710 INFO:teuthology.orchestra.run.smithi153.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.118734.log.gz 2024-09-19T15:33:32.710 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86872.log 2024-09-19T15:33:32.710 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73302.log 2024-09-19T15:33:32.710 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.175545.log: /var/log/ceph/ceph-client.admin.86872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124635.log 2024-09-19T15:33:32.711 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.73302.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.86872.log.gz 2024-09-19T15:33:32.711 INFO:teuthology.orchestra.run.smithi153.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.175545.log.gz 2024-09-19T15:33:32.711 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178844.log 2024-09-19T15:33:32.711 INFO:teuthology.orchestra.run.smithi153.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.73302.log.gz 2024-09-19T15:33:32.711 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41759.log 2024-09-19T15:33:32.711 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.124635.log: /var/log/ceph/ceph-client.admin.178844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55491.log 2024-09-19T15:33:32.714 INFO:teuthology.orchestra.run.smithi153.stderr: 25.6% -- replaced with /var/log/ceph/ceph-client.admin.178844.log.gz 2024-09-19T15:33:32.714 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.41759.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.124635.log.gz 2024-09-19T15:33:32.714 INFO:teuthology.orchestra.run.smithi153.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.41759.log.gz 2024-09-19T15:33:32.714 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32250.log 2024-09-19T15:33:32.714 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41169.log 2024-09-19T15:33:32.715 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.55491.log: /var/log/ceph/ceph-client.admin.32250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129945.log 2024-09-19T15:33:32.715 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32250.log.gz 89.9% -- replaced with /var/log/ceph/ceph-client.admin.55491.log.gz 2024-09-19T15:33:32.715 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-19T15:33:32.715 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.41169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126405.log 2024-09-19T15:33:32.715 INFO:teuthology.orchestra.run.smithi153.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.41169.log.gz 2024-09-19T15:33:32.715 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.129945.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.129945.log.gz 2024-09-19T15:33:32.715 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115784.log 2024-09-19T15:33:32.715 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64504.log 2024-09-19T15:33:32.715 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.126405.log: /var/log/ceph/ceph-client.admin.115784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121685.log 2024-09-19T15:33:32.715 INFO:teuthology.orchestra.run.smithi153.stderr: 82.1%/var/log/ceph/ceph-client.admin.64504.log: -- replaced with /var/log/ceph/ceph-client.admin.115784.log.gz 2024-09-19T15:33:32.715 INFO:teuthology.orchestra.run.smithi153.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.64504.log.gz 2024-09-19T15:33:32.718 INFO:teuthology.orchestra.run.smithi153.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.126405.log.gz 2024-09-19T15:33:32.718 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32156.log 2024-09-19T15:33:32.718 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88643.log 2024-09-19T15:33:32.718 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.121685.log: /var/log/ceph/ceph-client.admin.32156.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-19T15:33:32.718 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32156.log.gz 2024-09-19T15:33:32.718 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.88643.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.121685.log.gz 2024-09-19T15:33:32.718 INFO:teuthology.orchestra.run.smithi153.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.88643.log.gz 2024-09-19T15:33:32.718 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137616.log 2024-09-19T15:33:32.719 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166003.log 2024-09-19T15:33:32.719 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: /var/log/ceph/ceph-client.admin.137616.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-19T15:33:32.719 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.166003.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.137616.log.gz 2024-09-19T15:33:32.719 INFO:teuthology.orchestra.run.smithi153.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.166003.log.gz 2024-09-19T15:33:32.722 INFO:teuthology.orchestra.run.smithi153.stderr: 94.1% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-19T15:33:32.723 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32562.log 2024-09-19T15:33:32.724 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182630.log 2024-09-19T15:33:32.724 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.32562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157183.log 2024-09-19T15:33:32.724 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32562.log.gz 2024-09-19T15:33:32.725 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.182630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182630.log.gz 2024-09-19T15:33:32.740 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33849.log 2024-09-19T15:33:32.740 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.157183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148826.log 2024-09-19T15:33:32.740 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157183.log.gz 2024-09-19T15:33:32.741 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138796.log 2024-09-19T15:33:32.741 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33849.log.gz 2024-09-19T15:33:32.742 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.148826.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.148826.log.gz 2024-09-19T15:33:32.742 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69616.log 2024-09-19T15:33:32.742 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.138796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35094.log 2024-09-19T15:33:32.743 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.69616.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.69616.log.gz 2024-09-19T15:33:32.743 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68978.log 2024-09-19T15:33:32.744 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.35094.log: 81.1% -- replaced with /var/log/ceph/ceph-client.0.35094.log.gz 2024-09-19T15:33:32.745 INFO:teuthology.orchestra.run.smithi153.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.138796.log.gz 2024-09-19T15:33:32.745 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150596.log 2024-09-19T15:33:32.745 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.68978.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.68978.log.gz 2024-09-19T15:33:32.746 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147646.log 2024-09-19T15:33:32.746 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35684.log 2024-09-19T15:33:32.746 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.150596.log: /var/log/ceph/ceph-client.admin.147646.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.150596.log.gz 2024-09-19T15:33:32.747 INFO:teuthology.orchestra.run.smithi153.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.147646.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83922.log 2024-09-19T15:33:32.747 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-19T15:33:32.747 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.35684.log: 43.2% -- replaced with /var/log/ceph/ceph-client.0.35684.log.gz 2024-09-19T15:33:32.752 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182526.log 2024-09-19T15:33:32.753 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182214.log 2024-09-19T15:33:32.753 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.83922.log: /var/log/ceph/ceph-client.admin.182526.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.83922.log.gz 2024-09-19T15:33:32.753 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182526.log.gz 2024-09-19T15:33:32.753 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103393.log 2024-09-19T15:33:32.753 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97493.log 2024-09-19T15:33:32.753 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.182214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182214.log.gz 2024-09-19T15:33:32.753 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.103393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165414.log 2024-09-19T15:33:32.753 INFO:teuthology.orchestra.run.smithi153.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.103393.log.gz 2024-09-19T15:33:32.753 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.97493.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97493.log.gz 2024-09-19T15:33:32.753 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48939.log 2024-09-19T15:33:32.753 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182396.log 2024-09-19T15:33:32.753 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.165414.log: /var/log/ceph/ceph-client.admin.48939.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.165414.log.gz 2024-09-19T15:33:32.753 INFO:teuthology.orchestra.run.smithi153.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.48939.log.gz 2024-09-19T15:33:32.754 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170235.log 2024-09-19T15:33:32.754 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144696.log 2024-09-19T15:33:32.754 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.182396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182396.log.gz 2024-09-19T15:33:32.754 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.170235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141156.log 80.6% 2024-09-19T15:33:32.754 INFO:teuthology.orchestra.run.smithi153.stderr: -- replaced with /var/log/ceph/ceph-client.0.170235.log.gz 2024-09-19T15:33:32.755 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.144696.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.144696.log.gz 2024-09-19T15:33:32.755 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32559.log 2024-09-19T15:33:32.769 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106933.log 2024-09-19T15:33:32.769 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.141156.log: /var/log/ceph/ceph-client.admin.32559.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.141156.log.gz 2024-09-19T15:33:32.770 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32559.log.gz 2024-09-19T15:33:32.770 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51349.log 2024-09-19T15:33:32.770 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109884.log 2024-09-19T15:33:32.770 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.106933.log: /var/log/ceph/ceph-client.admin.51349.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.106933.log.gz 2024-09-19T15:33:32.770 INFO:teuthology.orchestra.run.smithi153.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.51349.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53119.log 2024-09-19T15:33:32.770 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-19T15:33:32.770 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.109884.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.109884.log.gz 2024-09-19T15:33:32.771 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182474.log 2024-09-19T15:33:32.771 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53760.log 2024-09-19T15:33:32.771 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.53119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53119.log.gz 2024-09-19T15:33:32.771 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.182474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182474.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116964.log 2024-09-19T15:33:32.771 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-19T15:33:32.771 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.53760.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.53760.log.gz 2024-09-19T15:33:32.771 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32342.log 2024-09-19T15:33:32.771 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155978.log 2024-09-19T15:33:32.772 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.116964.log: /var/log/ceph/ceph-client.admin.32342.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.116964.log.gz 2024-09-19T15:33:32.772 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32342.log.gz 2024-09-19T15:33:32.772 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82742.log 2024-09-19T15:33:32.772 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182552.log 2024-09-19T15:33:32.772 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.155978.log: /var/log/ceph/ceph-client.admin.82742.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.155978.log.gz 2024-09-19T15:33:32.772 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26986.log 2024-09-19T15:33:32.772 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.182552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182552.log.gz 2024-09-19T15:33:32.773 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114604.log 2024-09-19T15:33:32.773 INFO:teuthology.orchestra.run.smithi153.stderr: 86.4%/var/log/ceph/ceph-client.admin.26986.log: -- replaced with /var/log/ceph/ceph-client.admin.82742.log.gz 2024-09-19T15:33:32.773 INFO:teuthology.orchestra.run.smithi153.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26986.log.gz 2024-09-19T15:33:32.773 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115194.log 2024-09-19T15:33:32.773 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78612.log 2024-09-19T15:33:32.773 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.114604.log: /var/log/ceph/ceph-client.admin.115194.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.114604.log.gz 2024-09-19T15:33:32.773 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131715.log 2024-09-19T15:33:32.774 INFO:teuthology.orchestra.run.smithi153.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.115194.log.gz 2024-09-19T15:33:32.774 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.78612.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.78612.log.gz 2024-09-19T15:33:32.774 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72712.log 2024-09-19T15:33:32.774 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-19T15:33:32.774 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.131715.log: /var/log/ceph/ceph-client.admin.72712.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.131715.log.gz 2024-09-19T15:33:32.774 INFO:teuthology.orchestra.run.smithi153.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.72712.log.gz 2024-09-19T15:33:32.774 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179606.log 2024-09-19T15:33:32.775 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151776.log 2024-09-19T15:33:32.775 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.179606.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179606.log.gz 2024-09-19T15:33:32.780 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139386.log 2024-09-19T15:33:32.781 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.151776.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.151776.log.gz 2024-09-19T15:33:32.781 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153568.log 2024-09-19T15:33:32.782 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.139386.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.139386.log.gz 2024-09-19T15:33:32.783 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149416.log 2024-09-19T15:33:32.783 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.153568.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.153568.log.gz 2024-09-19T15:33:32.783 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63204.log 2024-09-19T15:33:32.784 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.149416.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.149416.log.gz 2024-09-19T15:33:32.785 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26740.log 2024-09-19T15:33:32.786 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.63204.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63204.log.gz 2024-09-19T15:33:32.787 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75662.log 2024-09-19T15:33:32.787 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.26740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26740.log.gz 2024-09-19T15:33:32.788 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94543.log 2024-09-19T15:33:32.788 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.75662.log: 93.8% 81.2% -- replaced with /var/log/ceph/ceph.log.gz -- replaced with /var/log/ceph/ceph-client.admin.75662.log.gz 2024-09-19T15:33:32.789 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-19T15:33:32.790 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34510.log 2024-09-19T15:33:32.790 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.94543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172595.log 2024-09-19T15:33:32.790 INFO:teuthology.orchestra.run.smithi153.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.94543.log.gz 2024-09-19T15:33:32.790 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.34510.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.34510.log.gz 2024-09-19T15:33:32.791 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65972.log 2024-09-19T15:33:32.791 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.172595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143516.log 2024-09-19T15:33:32.792 INFO:teuthology.orchestra.run.smithi153.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.0.172595.log.gz 2024-09-19T15:33:32.792 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.65972.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.65972.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101623.log 2024-09-19T15:33:32.792 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-19T15:33:32.792 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.143516.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.143516.log.gz 2024-09-19T15:33:32.795 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32744.log 2024-09-19T15:33:32.795 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.101623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122275.log 2024-09-19T15:33:32.795 INFO:teuthology.orchestra.run.smithi153.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.101623.log.gz 2024-09-19T15:33:32.795 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32744.log.gz 2024-09-19T15:33:32.795 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50759.log 2024-09-19T15:33:32.795 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.122275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32348.log 2024-09-19T15:33:32.796 INFO:teuthology.orchestra.run.smithi153.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.122275.log.gz 2024-09-19T15:33:32.796 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.50759.log: 85.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47169.log 2024-09-19T15:33:32.796 INFO:teuthology.orchestra.run.smithi153.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50759.log.gz 2024-09-19T15:33:32.796 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32348.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32564.log 2024-09-19T15:33:32.796 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-19T15:33:32.797 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.47169.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.47169.log.gz 2024-09-19T15:33:32.797 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63852.log 2024-09-19T15:33:32.797 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114014.log 2024-09-19T15:33:32.797 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32564.log.gz 2024-09-19T15:33:32.797 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.63852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53144.log 2024-09-19T15:33:32.799 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.114014.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.114014.log.gz 2024-09-19T15:33:32.799 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116374.log 2024-09-19T15:33:32.800 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.53144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53144.log.gz 2024-09-19T15:33:32.800 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180228.log 2024-09-19T15:33:32.801 INFO:teuthology.orchestra.run.smithi153.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.63852.log.gz 2024-09-19T15:33:32.801 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.116374.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.116374.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119324.log 2024-09-19T15:33:32.801 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-19T15:33:32.803 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.180228.log: 80.9% -- replaced with /var/log/ceph/ceph-client.0.180228.log.gz 2024-09-19T15:33:32.803 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56744.log 2024-09-19T15:33:32.803 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.119324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182761.log 2024-09-19T15:33:32.803 INFO:teuthology.orchestra.run.smithi153.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.119324.log.gz 2024-09-19T15:33:32.803 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.56744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148236.log 2024-09-19T15:33:32.804 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.182761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182761.log.gz 2024-09-19T15:33:32.808 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182370.log 2024-09-19T15:33:32.808 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.148236.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.148236.log.gz 2024-09-19T15:33:32.809 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87462.log 2024-09-19T15:33:32.809 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.182370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182370.log.gz 2024-09-19T15:33:32.810 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33825.log 2024-09-19T15:33:32.811 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.87462.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.87462.log.gz 2024-09-19T15:33:32.811 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182785.log 2024-09-19T15:33:32.812 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33825.log.gz 2024-09-19T15:33:32.812 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88052.log 2024-09-19T15:33:32.813 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.182785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182785.log.gz 2024-09-19T15:33:32.813 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45399.log 2024-09-19T15:33:32.814 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.88052.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.88052.log.gz 2024-09-19T15:33:32.814 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-19T15:33:32.815 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.45399.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.45399.log.gz 2024-09-19T15:33:32.816 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55253.log 2024-09-19T15:33:32.818 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-mon.c.log: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.56744.log.gz 2024-09-19T15:33:32.829 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36858.log 2024-09-19T15:33:32.829 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.55253.log: 57.5% -- replaced with /var/log/ceph/ceph-client.admin.55253.log.gz 2024-09-19T15:33:32.829 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32276.log 2024-09-19T15:33:32.830 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.36858.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.36858.log.gz 2024-09-19T15:33:32.830 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173775.log 2024-09-19T15:33:32.831 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32276.log.gz 2024-09-19T15:33:32.831 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174955.log 2024-09-19T15:33:32.832 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.173775.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.173775.log.gz 2024-09-19T15:33:32.832 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42989.log 2024-09-19T15:33:32.833 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.174955.log: 81.1% -- replaced with /var/log/ceph/ceph-client.0.174955.log.gz 2024-09-19T15:33:32.833 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98083.log 2024-09-19T15:33:32.834 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.42989.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.42989.log.gz 2024-09-19T15:33:32.834 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53170.log 2024-09-19T15:33:32.835 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.98083.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.98083.log.gz 2024-09-19T15:33:32.836 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160467.log 2024-09-19T15:33:32.836 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.53170.log: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.53170.log.gz 2024-09-19T15:33:32.837 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80382.log 2024-09-19T15:33:32.838 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.160467.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.160467.log.gz 2024-09-19T15:33:32.838 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68336.log 2024-09-19T15:33:32.839 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.80382.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.80382.log.gz 2024-09-19T15:33:32.839 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145286.log 2024-09-19T15:33:32.840 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.68336.log: 24.7% -- replaced with /var/log/ceph/ceph-client.admin.68336.log.gz 2024-09-19T15:33:32.840 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118144.log 2024-09-19T15:33:32.841 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.145286.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.145286.log.gz 2024-09-19T15:33:32.841 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102803.log 2024-09-19T15:33:32.842 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.118144.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118144.log.gz 2024-09-19T15:33:32.843 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91593.log 2024-09-19T15:33:32.844 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.102803.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102803.log.gz 2024-09-19T15:33:32.844 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178892.log 2024-09-19T15:33:32.845 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.91593.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.91593.log.gz 2024-09-19T15:33:32.845 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179580.log 2024-09-19T15:33:32.846 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.178892.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178892.log.gz 2024-09-19T15:33:32.846 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32181.log 2024-09-19T15:33:32.846 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.179580.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179580.log.gz 2024-09-19T15:33:32.847 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32355.log 2024-09-19T15:33:32.848 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32181.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32181.log.gz 2024-09-19T15:33:32.848 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60616.log 2024-09-19T15:33:32.849 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32355.log.gz 2024-09-19T15:33:32.849 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-19T15:33:32.851 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.60616.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.60616.log.gz 2024-09-19T15:33:32.851 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136436.log 2024-09-19T15:33:32.864 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127585.log 2024-09-19T15:33:32.865 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.136436.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.136436.log.gz 2024-09-19T15:33:32.880 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95133.log 2024-09-19T15:33:32.880 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.127585.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.127585.log.gz 2024-09-19T15:33:32.888 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117554.log 2024-09-19T15:33:32.888 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.95133.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.95133.log.gz 2024-09-19T15:33:32.896 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52529.log 2024-09-19T15:33:32.896 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.117554.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.117554.log.gz 2024-09-19T15:33:32.904 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129355.log 2024-09-19T15:33:32.904 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.52529.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.52529.log.gz 2024-09-19T15:33:32.912 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-19T15:33:32.912 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.129355.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.129355.log.gz 2024-09-19T15:33:32.922 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154158.log 2024-09-19T15:33:32.926 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph.audit.log: 94.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-19T15:33:32.932 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155388.log 2024-09-19T15:33:32.932 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.154158.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.154158.log.gz 2024-09-19T15:33:32.944 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151186.log 2024-09-19T15:33:32.944 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.155388.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.155388.log.gz 2024-09-19T15:33:32.956 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128175.log 2024-09-19T15:33:32.956 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.151186.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.151186.log.gz 2024-09-19T15:33:32.976 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56121.log 2024-09-19T15:33:32.977 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.128175.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.128175.log.gz 2024-09-19T15:33:32.983 INFO:teuthology.orchestra.run.smithi153.stderr: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-19T15:33:32.984 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51939.log 2024-09-19T15:33:32.985 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.56121.log: 19.9% -- replaced with /var/log/ceph/ceph-client.admin.56121.log.gz 2024-09-19T15:33:32.985 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85692.log 2024-09-19T15:33:32.986 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.51939.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.51939.log.gz 2024-09-19T15:33:32.986 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50119.log 2024-09-19T15:33:32.987 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.85692.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.85692.log.gz 2024-09-19T15:33:32.987 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182656.log 2024-09-19T15:33:32.988 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.50119.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.50119.log.gz 2024-09-19T15:33:32.988 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-09-19T15:33:32.989 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.182656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182656.log.gz 2024-09-19T15:33:32.989 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138206.log 2024-09-19T15:33:32.993 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/valgrind/ceph.client.0.log: 63.1% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-09-19T15:33:32.993 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134666.log 2024-09-19T15:33:32.993 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.138206.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.138206.log.gz 2024-09-19T15:33:32.993 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179530.log 2024-09-19T15:33:32.994 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.134666.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.134666.log.gz 2024-09-19T15:33:32.994 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32796.log 2024-09-19T15:33:32.995 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.179530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179530.log.gz 2024-09-19T15:33:32.995 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82152.log 2024-09-19T15:33:32.996 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32796.log.gz 2024-09-19T15:33:32.996 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178254.log 2024-09-19T15:33:32.997 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.82152.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.82152.log.gz 2024-09-19T15:33:32.997 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62558.log 2024-09-19T15:33:32.998 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.178254.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.178254.log.gz 2024-09-19T15:33:32.998 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139976.log 2024-09-19T15:33:33.000 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.62558.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62558.log.gz 2024-09-19T15:33:33.000 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167275.log 2024-09-19T15:33:33.001 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.139976.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.139976.log.gz 2024-09-19T15:33:33.002 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182240.log 2024-09-19T15:33:33.004 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.167275.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.167275.log.gz 2024-09-19T15:33:33.005 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182448.log 2024-09-19T15:33:33.005 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.182240.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182240.log.gz 2024-09-19T15:33:33.007 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159878.log 2024-09-19T15:33:33.007 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.182448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182448.log.gz 2024-09-19T15:33:33.007 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32302.log 2024-09-19T15:33:33.011 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.159878.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.159878.log.gz 2024-09-19T15:33:33.011 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182604.log 2024-09-19T15:33:33.012 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32302.log.gz 2024-09-19T15:33:33.012 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107524.log 2024-09-19T15:33:33.013 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.182604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182604.log.gz 2024-09-19T15:33:33.013 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105163.log 2024-09-19T15:33:33.014 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.107524.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.107524.log.gz 2024-09-19T15:33:33.015 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79792.log 2024-09-19T15:33:33.015 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.105163.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.105163.log.gz 2024-09-19T15:33:33.016 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89823.log 2024-09-19T15:33:33.017 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.79792.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.79792.log.gz 2024-09-19T15:33:33.017 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56096.log 2024-09-19T15:33:33.018 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.89823.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.89823.log.gz 2024-09-19T15:33:33.018 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33873.log 2024-09-19T15:33:33.019 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.56096.log: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.56096.log.gz 2024-09-19T15:33:33.019 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81562.log 2024-09-19T15:33:33.020 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33873.log.gz 2024-09-19T15:33:33.020 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172005.log 2024-09-19T15:33:33.021 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.81562.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.81562.log.gz 2024-09-19T15:33:33.021 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61267.log 2024-09-19T15:33:33.022 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.172005.log: 84.8% -- replaced with /var/log/ceph/ceph-client.0.172005.log.gz 2024-09-19T15:33:33.022 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44169.log 2024-09-19T15:33:33.040 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.61267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50709.log 2024-09-19T15:33:33.041 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.44169.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.44169.log.gz 2024-09-19T15:33:33.050 INFO:teuthology.orchestra.run.smithi153.stderr: 95.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135846.log 2024-09-19T15:33:33.051 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.50709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50709.log.gz 2024-09-19T15:33:33.051 INFO:teuthology.orchestra.run.smithi153.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61267.log.gz 2024-09-19T15:33:33.051 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162920.log 2024-09-19T15:33:33.052 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.135846.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.135846.log.gz 2024-09-19T15:33:33.052 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152978.log 2024-09-19T15:33:33.053 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.162920.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.162920.log.gz 2024-09-19T15:33:33.054 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113424.log 2024-09-19T15:33:33.055 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.152978.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.152978.log.gz 2024-09-19T15:33:33.055 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111064.log 2024-09-19T15:33:33.056 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.113424.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.113424.log.gz 2024-09-19T15:33:33.056 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69650.log 2024-09-19T15:33:33.057 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.111064.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.111064.log.gz 2024-09-19T15:33:33.057 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126995.log 2024-09-19T15:33:33.061 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.69650.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.69650.log.gz 2024-09-19T15:33:33.061 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123455.log 2024-09-19T15:33:33.062 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.126995.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.126995.log.gz 2024-09-19T15:33:33.062 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33920.log 2024-09-19T15:33:33.063 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.123455.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.123455.log.gz 2024-09-19T15:33:33.063 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163509.log 2024-09-19T15:33:33.065 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.33920.log: 95.9% -- replaced with /var/log/ceph/ceph-client.0.33920.log.gz 2024-09-19T15:33:33.065 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42399.log 2024-09-19T15:33:33.066 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.163509.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.163509.log.gz 2024-09-19T15:33:33.066 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74482.log 2024-09-19T15:33:33.067 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.42399.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.42399.log.gz 2024-09-19T15:33:33.068 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77432.log 2024-09-19T15:33:33.068 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.74482.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.74482.log.gz 2024-09-19T15:33:33.069 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169055.log 2024-09-19T15:33:33.069 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.77432.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.77432.log.gz 2024-09-19T15:33:33.070 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110474.log 2024-09-19T15:33:33.071 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.169055.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.169055.log.gz 2024-09-19T15:33:33.071 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39989.log 2024-09-19T15:33:33.072 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.110474.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110474.log.gz 2024-09-19T15:33:33.072 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32536.log 2024-09-19T15:33:33.073 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.39989.log: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.39989.log.gz 2024-09-19T15:33:33.073 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95723.log 2024-09-19T15:33:33.074 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32536.log.gz 2024-09-19T15:33:33.074 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44759.log 2024-09-19T15:33:33.075 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.95723.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.95723.log.gz 2024-09-19T15:33:33.076 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45989.log 2024-09-19T15:33:33.076 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.44759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44759.log.gz 2024-09-19T15:33:33.076 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112834.log 2024-09-19T15:33:33.078 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.45989.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.45989.log.gz 2024-09-19T15:33:33.078 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182422.log 2024-09-19T15:33:33.079 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.112834.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.112834.log.gz 2024-09-19T15:33:33.079 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50734.log 2024-09-19T15:33:33.080 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.182422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182422.log.gz 2024-09-19T15:33:33.081 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162331.log 2024-09-19T15:33:33.082 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.50734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50734.log.gz 2024-09-19T15:33:33.082 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152366.log 2024-09-19T15:33:33.083 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.162331.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.162331.log.gz 2024-09-19T15:33:33.083 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93953.log 2024-09-19T15:33:33.083 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.152366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152366.log.gz 2024-09-19T15:33:33.083 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55552.log 2024-09-19T15:33:33.085 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.93953.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.93953.log.gz 2024-09-19T15:33:33.085 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150006.log 2024-09-19T15:33:33.100 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.55552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111654.log 2024-09-19T15:33:33.101 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.150006.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.150006.log.gz 2024-09-19T15:33:33.101 INFO:teuthology.orchestra.run.smithi153.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55552.log.gz 2024-09-19T15:33:33.101 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67745.log 2024-09-19T15:33:33.102 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.111654.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.111654.log.gz 2024-09-19T15:33:33.102 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125815.log 2024-09-19T15:33:33.103 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.67745.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.67745.log.gz 2024-09-19T15:33:33.104 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33897.log 2024-09-19T15:33:33.104 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.125815.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.125815.log.gz 2024-09-19T15:33:33.105 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32353.log 2024-09-19T15:33:33.105 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.33897.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33897.log.gz 2024-09-19T15:33:33.106 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102213.log 2024-09-19T15:33:33.107 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32353.log.gz 2024-09-19T15:33:33.107 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42374.log 2024-09-19T15:33:33.108 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.102213.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.102213.log.gz 2024-09-19T15:33:33.108 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179507.log 2024-09-19T15:33:33.109 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.42374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42374.log.gz 2024-09-19T15:33:33.109 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128765.log 2024-09-19T15:33:33.110 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.179507.log: 25.2% -- replaced with /var/log/ceph/ceph-client.admin.179507.log.gz 2024-09-19T15:33:33.110 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168465.log 2024-09-19T15:33:33.111 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.128765.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.128765.log.gz 2024-09-19T15:33:33.111 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42349.log 2024-09-19T15:33:33.112 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.168465.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.168465.log.gz 2024-09-19T15:33:33.113 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44809.log 2024-09-19T15:33:33.113 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.42349.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42349.log.gz 2024-09-19T15:33:33.114 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32352.log 2024-09-19T15:33:33.114 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.44809.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.44809.log.gz 2024-09-19T15:33:33.114 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49529.log 2024-09-19T15:33:33.115 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.32352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32352.log.gz 2024-09-19T15:33:33.115 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57391.log 2024-09-19T15:33:33.116 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.49529.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.49529.log.gz 2024-09-19T15:33:33.117 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70942.log 2024-09-19T15:33:33.122 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.57391.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.57391.log.gz 2024-09-19T15:33:33.122 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169645.log 2024-09-19T15:33:33.122 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.70942.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.70942.log.gz 2024-09-19T15:33:33.122 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121094.log 2024-09-19T15:33:33.122 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.0.169645.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.169645.log.gz 2024-09-19T15:33:33.122 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178917.log 2024-09-19T15:33:33.122 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.121094.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.121094.log.gz 2024-09-19T15:33:33.122 INFO:teuthology.orchestra.run.smithi153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40579.log 2024-09-19T15:33:33.123 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.178917.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.178917.log.gz 2024-09-19T15:33:33.123 INFO:teuthology.orchestra.run.smithi153.stderr:/var/log/ceph/ceph-client.admin.40579.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.40579.log.gz 2024-09-19T15:33:33.698 INFO:teuthology.orchestra.run.smithi196.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-19T15:33:33.867 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-19T15:33:34.355 INFO:teuthology.orchestra.run.smithi196.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-19T15:33:34.693 INFO:teuthology.orchestra.run.smithi153.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-19T15:33:36.967 INFO:teuthology.orchestra.run.smithi153.stderr: 92.6% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-19T15:33:37.778 INFO:teuthology.orchestra.run.smithi153.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-19T15:33:42.373 INFO:teuthology.orchestra.run.smithi153.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-19T15:33:45.020 INFO:teuthology.orchestra.run.smithi196.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-19T15:33:45.227 INFO:teuthology.orchestra.run.smithi196.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-19T15:33:45.371 INFO:teuthology.orchestra.run.smithi153.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-19T15:33:45.780 INFO:teuthology.orchestra.run.smithi196.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-19T15:33:48.635 INFO:teuthology.orchestra.run.smithi153.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-19T15:33:49.372 INFO:teuthology.orchestra.run.smithi196.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-19T15:33:49.373 INFO:teuthology.orchestra.run.smithi196.stderr: 2024-09-19T15:33:49.373 INFO:teuthology.orchestra.run.smithi196.stderr:real 0m16.733s 2024-09-19T15:33:49.374 INFO:teuthology.orchestra.run.smithi196.stderr:user 0m55.525s 2024-09-19T15:33:49.374 INFO:teuthology.orchestra.run.smithi196.stderr:sys 0m2.015s 2024-09-19T15:33:53.977 INFO:teuthology.orchestra.run.smithi153.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-19T15:33:53.978 INFO:teuthology.orchestra.run.smithi153.stderr: 2024-09-19T15:33:53.978 INFO:teuthology.orchestra.run.smithi153.stderr:real 0m21.374s 2024-09-19T15:33:53.978 INFO:teuthology.orchestra.run.smithi153.stderr:user 1m9.130s 2024-09-19T15:33:53.979 INFO:teuthology.orchestra.run.smithi153.stderr:sys 0m2.563s 2024-09-19T15:33:53.979 INFO:tasks.ceph:Archiving logs... 2024-09-19T15:33:53.979 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912477/remote/smithi153/log 2024-09-19T15:33:53.980 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T15:34:01.618 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/log/ceph to /home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912477/remote/smithi196/log 2024-09-19T15:34:01.619 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T15:34:08.261 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T15:34:08.272 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T15:34:08.272 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T15:34:08.275 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T15:34:08.367 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T15:34:08.377 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T15:34:08.378 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T15:34:08.380 DEBUG:teuthology.orchestra.run.smithi196:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T15:34:08.394 INFO:teuthology.orchestra.run.smithi153.stdout: remote refid st t when poll reach delay offset jitter 2024-09-19T15:34:08.394 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================== 2024-09-19T15:34:08.394 INFO:teuthology.orchestra.run.smithi153.stdout:*hv01.front.sepi 67.205.162.81 3 u 97 128 377 0.164 -0.274 0.155 2024-09-19T15:34:08.394 INFO:teuthology.orchestra.run.smithi153.stdout:+hv02.front.sepi 63.231.80.2 3 u 7 128 377 0.179 -0.190 0.212 2024-09-19T15:34:08.395 INFO:teuthology.orchestra.run.smithi153.stdout:+hv03.front.sepi 74.6.168.72 3 u 2 128 377 0.190 -1.041 0.069 2024-09-19T15:34:08.395 INFO:teuthology.orchestra.run.smithi153.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-19T15:34:08.396 INFO:teuthology.orchestra.run.smithi196.stdout: remote refid st t when poll reach delay offset jitter 2024-09-19T15:34:08.396 INFO:teuthology.orchestra.run.smithi196.stdout:============================================================================== 2024-09-19T15:34:08.396 INFO:teuthology.orchestra.run.smithi196.stdout:*hv01.front.sepi 67.205.162.81 3 u 57 128 377 0.164 -1.671 0.481 2024-09-19T15:34:08.396 INFO:teuthology.orchestra.run.smithi196.stdout:+hv02.front.sepi 63.231.80.2 3 u 65 128 377 0.157 -1.304 0.152 2024-09-19T15:34:08.397 INFO:teuthology.orchestra.run.smithi196.stdout:+hv03.front.sepi 74.6.168.72 3 u 77 128 377 0.183 -2.129 0.197 2024-09-19T15:34:08.397 INFO:teuthology.orchestra.run.smithi196.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-19T15:34:08.397 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T15:34:08.410 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T15:34:08.410 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T15:34:08.426 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T15:34:08.446 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T15:34:08.466 INFO:teuthology.task.internal:Duration was 7479.662206 seconds 2024-09-19T15:34:08.466 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T15:34:08.485 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T15:34:08.485 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T15:34:08.488 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T15:34:08.526 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T15:34:08.526 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2024-09-19T15:34:08.526 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T15:34:08.577 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi196.front.sepia.ceph.com 2024-09-19T15:34:08.578 DEBUG:teuthology.orchestra.run.smithi196:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T15:34:08.587 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T15:34:08.587 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T15:34:08.621 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T15:34:08.657 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T15:34:08.657 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T15:34:08.689 DEBUG:teuthology.orchestra.run.smithi196:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T15:34:08.755 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T15:34:08.767 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T15:34:08.767 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T15:34:08.779 DEBUG:teuthology.orchestra.run.smithi196:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T15:34:08.790 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T15:34:08.813 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T15:34:08.825 DEBUG:teuthology.orchestra.run.smithi196:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T15:34:08.832 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2024-09-19T15:34:08.845 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = core 2024-09-19T15:34:08.955 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T15:34:08.959 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T15:34:08.960 DEBUG:teuthology.orchestra.run.smithi196:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T15:34:09.002 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T15:34:09.003 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T15:34:09.014 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T15:34:09.015 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912477/remote/smithi153 2024-09-19T15:34:09.015 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T15:34:09.040 DEBUG:teuthology.misc:Transferring archived files from smithi196:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuvalif-2024-09-19_13:09:30-rgw-wip-yuval-test-distro-default-smithi/7912477/remote/smithi196 2024-09-19T15:34:09.040 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T15:34:09.066 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T15:34:09.066 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T15:34:09.077 DEBUG:teuthology.orchestra.run.smithi196:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T15:34:09.111 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T15:34:09.144 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T15:34:09.144 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T15:34:09.201 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T15:34:09.201 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T15:34:09.204 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T15:34:09.207 INFO:teuthology.orchestra.run.smithi153.stdout: 658638 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 15:34 /home/ubuntu/cephtest 2024-09-19T15:34:09.211 INFO:teuthology.orchestra.run.smithi196.stdout: 658622 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 15:34 /home/ubuntu/cephtest 2024-09-19T15:34:09.212 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T15:34:09.237 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T15:34:09.282 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 7479.662206172943 flavor: default owner: scheduled_yuvalif@teuthology success: true 2024-09-19T15:34:09.282 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T15:34:09.365 INFO:teuthology.run:pass